2023-07-14T12:18:39.763 INFO:root:teuthology version: 0.0.1.dev145+gaa6a80e 2023-07-14T12:18:39.765 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337461 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} -- /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337461/orig.config.yaml 2023-07-14T12:18:39.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T12:18:39.907 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337461 branch: wip-rishabh-2023Jul13 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} email: null first_in_suite: false job_id: '7337461' kernel: client: branch: testing flavor: default kdb: true sha1: a440c79eee0258ae07e4988d8690fe6187b8b7a3 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rishabh-2023Jul13 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 3fc0089cc1082313a98853d48b892acdc1385b8b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 3fc0089cc1082313a98853d48b892acdc1385b8b kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023Jul13 sha1: 3fc0089cc1082313a98853d48b892acdc1385b8b owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: 3fc0089cc1082313a98853d48b892acdc1385b8b sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-2023Jul13 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 3fc0089cc1082313a98853d48b892acdc1385b8b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi005.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIO6MUPJGyxhEQGbyPRalUYJJyyKVvFI90MtlRSRJVrh4lI8MN5kZBhRyHOlto2qEY1DLWW6iNyoLvvpOLCrWak= smithi154.front.sepia.ceph.com: ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJgfpGvqME+amZ3DxuaEgD4CZDCoPQNjjnrXGmd7lLic tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_snap_schedules teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: aa6a80e6cc655fff48452a7eca02070e61d074fc timestamp: 2023-07-14_10:26:42 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-14T12:18:39.907 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa; will attempt to use it 2023-07-14T12:18:39.908 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks 2023-07-14T12:18:39.909 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-14T12:18:39.911 INFO:teuthology.task.internal:Checking packages... 2023-07-14T12:18:39.939 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '3fc0089cc1082313a98853d48b892acdc1385b8b' 2023-07-14T12:18:39.939 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-14T12:18:39.940 INFO:teuthology.packaging:ref: None 2023-07-14T12:18:39.940 INFO:teuthology.packaging:tag: None 2023-07-14T12:18:39.940 INFO:teuthology.packaging:branch: wip-rishabh-2023Jul13 2023-07-14T12:18:39.940 INFO:teuthology.packaging:sha1: 3fc0089cc1082313a98853d48b892acdc1385b8b 2023-07-14T12:18:39.941 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rishabh-2023Jul13 2023-07-14T12:18:40.337 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4757-g3fc0089c-1jammy 2023-07-14T12:18:40.337 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-14T12:18:40.344 INFO:teuthology.task.internal:no buildpackages task found 2023-07-14T12:18:40.344 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-14T12:18:40.370 INFO:teuthology.task.internal:Saving configuration 2023-07-14T12:18:40.387 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-14T12:18:40.395 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T12:18:40.424 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337461', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 12:13:01.952668', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDAkmxlpEaUuiBy6t2d8k3uCXihBIyx1/3/5RHOi7C3p'} 2023-07-14T12:18:40.449 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337461', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 12:13:01.950658', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJgfpGvqME+amZ3DxuaEgD4CZDCoPQNjjnrXGmd7lLic'} 2023-07-14T12:18:40.450 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-14T12:18:40.456 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-07-14T12:18:40.456 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-07-14T12:18:40.456 INFO:teuthology.run_tasks:Running task console_log... 2023-07-14T12:18:40.554 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f776c0af4c0>, signals=[15]) 2023-07-14T12:18:40.555 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-14T12:18:40.562 INFO:teuthology.task.internal:Opening connections... 2023-07-14T12:18:40.562 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi005.front.sepia.ceph.com 2023-07-14T12:18:40.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T12:18:40.644 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2023-07-14T12:18:40.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T12:18:40.719 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-14T12:18:40.726 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2023-07-14T12:18:40.731 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2023-07-14T12:18:40.731 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2023-07-14T12:18:40.780 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-14T12:18:40.780 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="Ubuntu" 2023-07-14T12:18:40.781 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="22.04" 2023-07-14T12:18:40.781 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-14T12:18:40.781 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_CODENAME=jammy 2023-07-14T12:18:40.781 INFO:teuthology.orchestra.run.smithi005.stdout:ID=ubuntu 2023-07-14T12:18:40.781 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE=debian 2023-07-14T12:18:40.781 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-14T12:18:40.782 INFO:teuthology.orchestra.run.smithi005.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-14T12:18:40.782 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-14T12:18:40.782 INFO:teuthology.orchestra.run.smithi005.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-14T12:18:40.782 INFO:teuthology.orchestra.run.smithi005.stdout:UBUNTU_CODENAME=jammy 2023-07-14T12:18:40.783 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2023-07-14T12:18:40.805 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2023-07-14T12:18:40.810 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2023-07-14T12:18:40.811 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2023-07-14T12:18:40.858 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-14T12:18:40.859 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Ubuntu" 2023-07-14T12:18:40.859 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="22.04" 2023-07-14T12:18:40.859 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-14T12:18:40.860 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_CODENAME=jammy 2023-07-14T12:18:40.860 INFO:teuthology.orchestra.run.smithi154.stdout:ID=ubuntu 2023-07-14T12:18:40.860 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE=debian 2023-07-14T12:18:40.860 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-14T12:18:40.861 INFO:teuthology.orchestra.run.smithi154.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-14T12:18:40.861 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-14T12:18:40.861 INFO:teuthology.orchestra.run.smithi154.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-14T12:18:40.861 INFO:teuthology.orchestra.run.smithi154.stdout:UBUNTU_CODENAME=jammy 2023-07-14T12:18:40.861 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-07-14T12:18:40.888 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-14T12:18:40.898 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-14T12:18:40.921 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-14T12:18:40.921 DEBUG:teuthology.orchestra.run.smithi005:> test '!' -e /home/ubuntu/cephtest 2023-07-14T12:18:40.924 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2023-07-14T12:18:40.928 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-14T12:18:40.946 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-14T12:18:40.946 DEBUG:teuthology.orchestra.run.smithi005:> test -z $(ls -A /var/lib/ceph) 2023-07-14T12:18:40.970 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2023-07-14T12:18:40.979 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-14T12:18:41.046 INFO:teuthology.run_tasks:Running task kernel... 2023-07-14T12:18:41.063 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a440c79eee0258ae07e4988d8690fe6187b8b7a3'} 2023-07-14T12:18:41.064 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-07-14T12:18:41.064 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-07-14T12:18:41.065 DEBUG:teuthology.orchestra.run.smithi005:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-14T12:18:41.065 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-14T12:18:41.070 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T12:18:41.070 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-07-14T12:18:41.073 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T12:18:41.073 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-07-14T12:18:41.501 DEBUG:teuthology.task.kernel:sha1 for client.0 is a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T12:18:41.502 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "a440c79eee0258ae07e4988d8690fe6187b8b7a3"... 2023-07-14T12:18:41.502 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2023-07-14T12:18:41.507 INFO:teuthology.orchestra.run.smithi005.stdout:5.15.0-56-generic 2023-07-14T12:18:41.508 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T12:18:41.508 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-14T12:18:41.509 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-07-14T12:18:41.509 DEBUG:teuthology.orchestra.run.smithi005:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-07-14T12:18:41.512 DEBUG:teuthology.task.kernel:sha1 for client.1 is a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T12:18:41.512 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "a440c79eee0258ae07e4988d8690fe6187b8b7a3"... 2023-07-14T12:18:41.513 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2023-07-14T12:18:41.518 INFO:teuthology.orchestra.run.smithi154.stdout:5.15.0-56-generic 2023-07-14T12:18:41.518 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T12:18:41.518 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-14T12:18:41.519 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-07-14T12:18:41.519 DEBUG:teuthology.orchestra.run.smithi154:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-07-14T12:18:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-07-14T12:18:41.582 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-07-14T12:18:41.678 INFO:teuthology.orchestra.run.smithi005.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-07-14T12:18:41.679 INFO:teuthology.orchestra.run.smithi005.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-07-14T12:18:41.679 INFO:teuthology.orchestra.run.smithi005.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-07-14T12:18:41.679 INFO:teuthology.orchestra.run.smithi005.stderr:hint: 2023-07-14T12:18:41.679 INFO:teuthology.orchestra.run.smithi005.stderr:hint: git config --global init.defaultBranch 2023-07-14T12:18:41.679 INFO:teuthology.orchestra.run.smithi005.stderr:hint: 2023-07-14T12:18:41.679 INFO:teuthology.orchestra.run.smithi005.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-07-14T12:18:41.680 INFO:teuthology.orchestra.run.smithi005.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-07-14T12:18:41.680 INFO:teuthology.orchestra.run.smithi005.stderr:hint: 2023-07-14T12:18:41.680 INFO:teuthology.orchestra.run.smithi005.stderr:hint: git branch -m 2023-07-14T12:18:41.680 INFO:teuthology.orchestra.run.smithi005.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-07-14T12:18:41.682 DEBUG:teuthology.orchestra.run.smithi005:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-07-14T12:18:41.717 INFO:teuthology.orchestra.run.smithi154.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-07-14T12:18:41.717 INFO:teuthology.orchestra.run.smithi154.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-07-14T12:18:41.718 INFO:teuthology.orchestra.run.smithi154.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-07-14T12:18:41.718 INFO:teuthology.orchestra.run.smithi154.stderr:hint: 2023-07-14T12:18:41.718 INFO:teuthology.orchestra.run.smithi154.stderr:hint: git config --global init.defaultBranch 2023-07-14T12:18:41.718 INFO:teuthology.orchestra.run.smithi154.stderr:hint: 2023-07-14T12:18:41.718 INFO:teuthology.orchestra.run.smithi154.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-07-14T12:18:41.718 INFO:teuthology.orchestra.run.smithi154.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-07-14T12:18:41.718 INFO:teuthology.orchestra.run.smithi154.stderr:hint: 2023-07-14T12:18:41.719 INFO:teuthology.orchestra.run.smithi154.stderr:hint: git branch -m 2023-07-14T12:18:41.719 INFO:teuthology.orchestra.run.smithi154.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-07-14T12:18:41.720 DEBUG:teuthology.orchestra.run.smithi154:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-07-14T12:18:41.749 DEBUG:teuthology.orchestra.run.smithi005:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-07-14T12:18:41.785 DEBUG:teuthology.orchestra.run.smithi154:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-07-14T12:18:41.808 DEBUG:teuthology.orchestra.run.smithi005:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-07-14T12:18:41.838 DEBUG:teuthology.orchestra.run.smithi154:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-07-14T12:36:00.699 INFO:teuthology.orchestra.run.smithi005.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-07-14T12:36:00.700 INFO:teuthology.orchestra.run.smithi005.stderr: * [new branch] main -> origin/main 2023-07-14T12:36:00.729 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20190312 -> 20190312 2023-07-14T12:36:00.729 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20190416 -> 20190416 2023-07-14T12:36:00.729 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20190514 -> 20190514 2023-07-14T12:36:00.729 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20190618 -> 20190618 2023-07-14T12:36:00.729 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20190717 -> 20190717 2023-07-14T12:36:00.730 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20190815 -> 20190815 2023-07-14T12:36:00.730 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20190923 -> 20190923 2023-07-14T12:36:00.730 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20191022 -> 20191022 2023-07-14T12:36:00.730 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20191215 -> 20191215 2023-07-14T12:36:00.733 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20200122 -> 20200122 2023-07-14T12:36:00.734 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20200316 -> 20200316 2023-07-14T12:36:00.734 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20200421 -> 20200421 2023-07-14T12:36:00.734 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20200519 -> 20200519 2023-07-14T12:36:00.734 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20200619 -> 20200619 2023-07-14T12:36:00.735 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20200721 -> 20200721 2023-07-14T12:36:00.735 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20200817 -> 20200817 2023-07-14T12:36:00.735 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20200918 -> 20200918 2023-07-14T12:36:00.735 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20201022 -> 20201022 2023-07-14T12:36:00.735 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20201118 -> 20201118 2023-07-14T12:36:00.736 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20201218 -> 20201218 2023-07-14T12:36:00.736 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20210208 -> 20210208 2023-07-14T12:36:00.736 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20210315 -> 20210315 2023-07-14T12:36:00.736 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20210511 -> 20210511 2023-07-14T12:36:00.736 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20210716 -> 20210716 2023-07-14T12:36:00.737 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20210818 -> 20210818 2023-07-14T12:36:00.737 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20210919 -> 20210919 2023-07-14T12:36:00.737 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20211027 -> 20211027 2023-07-14T12:36:00.737 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20211216 -> 20211216 2023-07-14T12:36:00.737 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20220209 -> 20220209 2023-07-14T12:36:00.737 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20220310 -> 20220310 2023-07-14T12:36:00.737 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20220411 -> 20220411 2023-07-14T12:36:00.738 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20220509 -> 20220509 2023-07-14T12:36:00.738 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20220610 -> 20220610 2023-07-14T12:36:00.738 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20220708 -> 20220708 2023-07-14T12:36:00.738 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20220815 -> 20220815 2023-07-14T12:36:00.738 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20220913 -> 20220913 2023-07-14T12:36:00.739 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20221012 -> 20221012 2023-07-14T12:36:00.739 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20221109 -> 20221109 2023-07-14T12:36:00.739 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20221214 -> 20221214 2023-07-14T12:36:00.740 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20230117 -> 20230117 2023-07-14T12:36:00.740 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20230210 -> 20230210 2023-07-14T12:36:00.741 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20230310 -> 20230310 2023-07-14T12:36:00.741 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20230404 -> 20230404 2023-07-14T12:36:00.741 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20230515 -> 20230515 2023-07-14T12:36:00.741 INFO:teuthology.orchestra.run.smithi005.stderr: * [new tag] 20230625 -> 20230625 2023-07-14T12:36:04.157 INFO:teuthology.orchestra.run.smithi005.stderr:Updating files: 48% (1437/2977) Updating files: 49% (1459/2977) Updating files: 50% (1489/2977) Updating files: 51% (1519/2977) Updating files: 52% (1549/2977) Updating files: 53% (1578/2977) Updating files: 54% (1608/2977) Updating files: 55% (1638/2977) Updating files: 56% (1668/2977) Updating files: 57% (1697/2977) Updating files: 58% (1727/2977) Updating files: 59% (1757/2977) Updating files: 60% (1787/2977) Updating files: 61% (1816/2977) Updating files: 62% (1846/2977) Updating files: 63% (1876/2977) Updating files: 64% (1906/2977) Updating files: 65% (1936/2977) Updating files: 65% (1952/2977) Updating files: 66% (1965/2977) Updating files: 67% (1995/2977) Updating files: 68% (2025/2977) Updating files: 69% (2055/2977) Updating files: 70% (2084/2977) Updating files: 71% (2114/2977) Updating files: 72% (2144/2977) Updating files: 73% (2174/2977) Updating files: 74% (2203/2977) Updating files: 75% (2233/2977) Updating files: 76% (2263/2977) Updating files: 77% (2293/2977) Updating files: 78% (2323/2977) Updating files: 79% (2352/2977) Updating files: 80% (2382/2977) Updating files: 81% (2412/2977) Updating files: 81% (2429/2977) Updating files: 82% (2442/2977) Updating files: 83% (2471/2977) Updating files: 84% (2501/2977) Updating files: 85% (2531/2977) Updating files: 86% (2561/2977) Updating files: 87% (2590/2977) Updating files: 88% (2620/2977) Updating files: 89% (2650/2977) Updating files: 90% (2680/2977) Updating files: 91% (2710/2977) Updating files: 92% (2739/2977) Updating files: 93% (2769/2977) Updating files: 94% (2799/2977) Updating files: 95% (2829/2977) Updating files: 96% (2858/2977) Updating files: 97% (2888/2977) Updating files: 98% (2918/2977) Updating files: 99% (2948/2977) Updating files: 100% (2977/2977) Updating files: 100% (2977/2977), done. 2023-07-14T12:36:04.162 INFO:teuthology.orchestra.run.smithi005.stdout:HEAD is now at d3f66064 Partially revert "amdgpu: DMCUB updates for DCN 3.1.4 and 3.1.5" 2023-07-14T12:36:04.182 INFO:teuthology.task.kernel:Downloading kernel a440c79eee0258ae07e4988d8690fe6187b8b7a3 on client.0... 2023-07-14T12:36:04.182 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T12:36:04.626 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc1-ga440c79eee02/ 2023-07-14T12:36:04.626 DEBUG:teuthology.orchestra.run.smithi005:> rm -f /tmp/linux-image.deb && echo linux-image-6.5.0-rc1-ga440c79eee02_6.5.0-rc1-ga440c79eee02-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc1-ga440c79eee02/ --input-file=- 2023-07-14T12:36:04.629 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi005.front.sepia.ceph.com to complete... 2023-07-14T12:36:23.832 INFO:teuthology.orchestra.run.smithi154.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-07-14T12:36:23.832 INFO:teuthology.orchestra.run.smithi154.stderr: * [new branch] main -> origin/main 2023-07-14T12:36:23.853 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20190312 -> 20190312 2023-07-14T12:36:23.853 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20190416 -> 20190416 2023-07-14T12:36:23.853 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20190514 -> 20190514 2023-07-14T12:36:23.853 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20190618 -> 20190618 2023-07-14T12:36:23.854 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20190717 -> 20190717 2023-07-14T12:36:23.855 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20190815 -> 20190815 2023-07-14T12:36:23.855 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20190923 -> 20190923 2023-07-14T12:36:23.855 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20191022 -> 20191022 2023-07-14T12:36:23.855 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20191215 -> 20191215 2023-07-14T12:36:23.856 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20200122 -> 20200122 2023-07-14T12:36:23.856 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20200316 -> 20200316 2023-07-14T12:36:23.856 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20200421 -> 20200421 2023-07-14T12:36:23.856 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20200519 -> 20200519 2023-07-14T12:36:23.856 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20200619 -> 20200619 2023-07-14T12:36:23.856 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20200721 -> 20200721 2023-07-14T12:36:23.856 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20200817 -> 20200817 2023-07-14T12:36:23.857 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20200918 -> 20200918 2023-07-14T12:36:23.857 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20201022 -> 20201022 2023-07-14T12:36:23.857 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20201118 -> 20201118 2023-07-14T12:36:23.859 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20201218 -> 20201218 2023-07-14T12:36:23.859 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20210208 -> 20210208 2023-07-14T12:36:23.859 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20210315 -> 20210315 2023-07-14T12:36:23.859 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20210511 -> 20210511 2023-07-14T12:36:23.859 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20210716 -> 20210716 2023-07-14T12:36:23.859 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20210818 -> 20210818 2023-07-14T12:36:23.860 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20210919 -> 20210919 2023-07-14T12:36:23.860 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20211027 -> 20211027 2023-07-14T12:36:23.860 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20211216 -> 20211216 2023-07-14T12:36:23.860 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20220209 -> 20220209 2023-07-14T12:36:23.860 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20220310 -> 20220310 2023-07-14T12:36:23.860 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20220411 -> 20220411 2023-07-14T12:36:23.860 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20220509 -> 20220509 2023-07-14T12:36:23.861 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20220610 -> 20220610 2023-07-14T12:36:23.861 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20220708 -> 20220708 2023-07-14T12:36:23.861 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20220815 -> 20220815 2023-07-14T12:36:23.861 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20220913 -> 20220913 2023-07-14T12:36:23.861 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20221012 -> 20221012 2023-07-14T12:36:23.861 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20221109 -> 20221109 2023-07-14T12:36:23.861 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20221214 -> 20221214 2023-07-14T12:36:23.861 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20230117 -> 20230117 2023-07-14T12:36:23.862 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20230210 -> 20230210 2023-07-14T12:36:23.862 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20230310 -> 20230310 2023-07-14T12:36:23.862 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20230404 -> 20230404 2023-07-14T12:36:23.862 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20230515 -> 20230515 2023-07-14T12:36:23.862 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20230625 -> 20230625 2023-07-14T12:36:27.109 INFO:teuthology.orchestra.run.smithi154.stderr:Updating files: 50% (1511/2977) Updating files: 51% (1519/2977) Updating files: 52% (1549/2977) Updating files: 53% (1578/2977) Updating files: 54% (1608/2977) Updating files: 55% (1638/2977) Updating files: 56% (1668/2977) Updating files: 57% (1697/2977) Updating files: 58% (1727/2977) Updating files: 59% (1757/2977) Updating files: 60% (1787/2977) Updating files: 61% (1816/2977) Updating files: 62% (1846/2977) Updating files: 63% (1876/2977) Updating files: 64% (1906/2977) Updating files: 65% (1936/2977) Updating files: 65% (1955/2977) Updating files: 66% (1965/2977) Updating files: 67% (1995/2977) Updating files: 68% (2025/2977) Updating files: 69% (2055/2977) Updating files: 70% (2084/2977) Updating files: 71% (2114/2977) Updating files: 72% (2144/2977) Updating files: 73% (2174/2977) Updating files: 74% (2203/2977) Updating files: 75% (2233/2977) Updating files: 76% (2263/2977) Updating files: 77% (2293/2977) Updating files: 78% (2323/2977) Updating files: 79% (2352/2977) Updating files: 80% (2382/2977) Updating files: 81% (2412/2977) Updating files: 82% (2442/2977) Updating files: 82% (2448/2977) Updating files: 83% (2471/2977) Updating files: 84% (2501/2977) Updating files: 85% (2531/2977) Updating files: 86% (2561/2977) Updating files: 87% (2590/2977) Updating files: 88% (2620/2977) Updating files: 89% (2650/2977) Updating files: 90% (2680/2977) Updating files: 91% (2710/2977) Updating files: 92% (2739/2977) Updating files: 93% (2769/2977) Updating files: 94% (2799/2977) Updating files: 95% (2829/2977) Updating files: 96% (2858/2977) Updating files: 97% (2888/2977) Updating files: 98% (2918/2977) Updating files: 99% (2948/2977) Updating files: 100% (2977/2977) Updating files: 100% (2977/2977), done. 2023-07-14T12:36:27.113 INFO:teuthology.orchestra.run.smithi154.stdout:HEAD is now at d3f66064 Partially revert "amdgpu: DMCUB updates for DCN 3.1.4 and 3.1.5" 2023-07-14T12:36:27.132 INFO:teuthology.task.kernel:Downloading kernel a440c79eee0258ae07e4988d8690fe6187b8b7a3 on client.1... 2023-07-14T12:36:27.132 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T12:36:27.392 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc1-ga440c79eee02/ 2023-07-14T12:36:27.392 DEBUG:teuthology.orchestra.run.smithi154:> rm -f /tmp/linux-image.deb && echo linux-image-6.5.0-rc1-ga440c79eee02_6.5.0-rc1-ga440c79eee02-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc1-ga440c79eee02/ --input-file=- 2023-07-14T12:36:27.396 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi154.front.sepia.ceph.com to complete... 2023-07-14T12:36:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14 12:36:28 URL:https://1.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc1-ga440c79eee02/linux-image-6.5.0-rc1-ga440c79eee02_6.5.0-rc1-ga440c79eee02-1_amd64.deb [38847948/38847948] -> "/tmp/linux-image.deb" [1] 2023-07-14T12:36:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:FINISHED --2023-07-14 12:36:28-- 2023-07-14T12:36:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:Total wall clock time: 24s 2023-07-14T12:36:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:Downloaded: 1 files, 37M in 23s (1.60 MB/s) 2023-07-14T12:36:28.256 INFO:teuthology.task.kernel:Installing kernel a440c79eee0258ae07e4988d8690fe6187b8b7a3 on client.0... 2023-07-14T12:36:28.257 DEBUG:teuthology.orchestra.run.smithi005:> sudo dpkg -i /tmp/linux-image.deb 2023-07-14T12:36:28.504 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package linux-image-6.5.0-rc1-ga440c79eee02. 2023-07-14T12:36:32.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14 12:36:32 URL:https://1.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc1-ga440c79eee02/linux-image-6.5.0-rc1-ga440c79eee02_6.5.0-rc1-ga440c79eee02-1_amd64.deb [38847948/38847948] -> "/tmp/linux-image.deb" [1] 2023-07-14T12:36:32.044 INFO:teuthology.orchestra.run.smithi154.stderr:FINISHED --2023-07-14 12:36:32-- 2023-07-14T12:36:32.045 INFO:teuthology.orchestra.run.smithi154.stderr:Total wall clock time: 4.6s 2023-07-14T12:36:32.045 INFO:teuthology.orchestra.run.smithi154.stderr:Downloaded: 1 files, 37M in 4.3s (8.62 MB/s) 2023-07-14T12:36:32.046 INFO:teuthology.task.kernel:Installing kernel a440c79eee0258ae07e4988d8690fe6187b8b7a3 on client.1... 2023-07-14T12:36:32.046 DEBUG:teuthology.orchestra.run.smithi154:> sudo dpkg -i /tmp/linux-image.deb 2023-07-14T12:36:32.309 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-image-6.5.0-rc1-ga440c79eee02. 2023-07-14T12:36:34.355 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-07-14T12:36:34.359 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-07-14T12:36:34.484 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-image-6.5.0-rc1-ga440c79eee02 (6.5.0-rc1-ga440c79eee02-1) ... 2023-07-14T12:36:37.595 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-image-6.5.0-rc1-ga440c79eee02 (6.5.0-rc1-ga440c79eee02-1) ... 2023-07-14T12:36:37.683 INFO:teuthology.orchestra.run.smithi154.stderr:update-initramfs: Generating /boot/initrd.img-6.5.0-rc1-ga440c79eee02 2023-07-14T12:36:42.183 INFO:teuthology.orchestra.run.smithi005.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-07-14T12:36:42.190 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-07-14T12:36:42.820 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking linux-image-6.5.0-rc1-ga440c79eee02 (6.5.0-rc1-ga440c79eee02-1) ... 2023-07-14T12:36:46.201 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up linux-image-6.5.0-rc1-ga440c79eee02 (6.5.0-rc1-ga440c79eee02-1) ... 2023-07-14T12:36:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:update-initramfs: Generating /boot/initrd.img-6.5.0-rc1-ga440c79eee02 2023-07-14T12:36:54.775 INFO:teuthology.orchestra.run.smithi005.stderr:Sourcing file `/etc/default/grub' 2023-07-14T12:36:54.779 INFO:teuthology.orchestra.run.smithi005.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-14T12:36:54.795 INFO:teuthology.orchestra.run.smithi005.stderr:Generating grub configuration file ... 2023-07-14T12:36:55.123 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 2023-07-14T12:36:55.143 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc1-ga440c79eee02 2023-07-14T12:36:55.394 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-07-14T12:36:55.406 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-07-14T12:36:55.466 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-07-14T12:36:55.471 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-07-14T12:36:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-07-14T12:36:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-07-14T12:36:55.614 INFO:teuthology.orchestra.run.smithi005.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-07-14T12:36:55.658 INFO:teuthology.orchestra.run.smithi005.stderr:done 2023-07-14T12:36:55.838 DEBUG:teuthology.orchestra.run.smithi005:> dpkg-deb -c /tmp/linux-image.deb 2023-07-14T12:36:55.846 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./ 2023-07-14T12:36:55.846 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./boot/ 2023-07-14T12:36:55.846 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 4380308 2023-07-13 12:30 ./boot/System.map-6.5.0-rc1-ga440c79eee02 2023-07-14T12:36:55.858 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 168433 2023-07-13 12:30 ./boot/config-6.5.0-rc1-ga440c79eee02 2023-07-14T12:36:55.858 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11280160 2023-07-13 12:30 ./boot/vmlinuz-6.5.0-rc1-ga440c79eee02 2023-07-14T12:36:55.876 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./etc/ 2023-07-14T12:36:55.877 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./etc/kernel/ 2023-07-14T12:36:55.877 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./etc/kernel/postinst.d/ 2023-07-14T12:36:55.877 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./etc/kernel/postrm.d/ 2023-07-14T12:36:55.877 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./etc/kernel/preinst.d/ 2023-07-14T12:36:55.877 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./etc/kernel/prerm.d/ 2023-07-14T12:36:55.877 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/ 2023-07-14T12:36:55.877 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/ 2023-07-14T12:36:55.878 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/ 2023-07-14T12:36:55.878 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/ 2023-07-14T12:36:55.878 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/ 2023-07-14T12:36:55.878 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/ 2023-07-14T12:36:55.878 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/ 2023-07-14T12:36:55.878 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 490385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/aesni-intel.ko 2023-07-14T12:36:55.881 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-14T12:36:55.882 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-14T12:36:55.883 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-14T12:36:55.883 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 93113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-14T12:36:55.883 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 106729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-14T12:36:55.883 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 152241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-14T12:36:55.883 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-14T12:36:55.883 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13777 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-14T12:36:55.883 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 83889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-14T12:36:55.884 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-14T12:36:55.884 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-14T12:36:55.885 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47209 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-14T12:36:55.885 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-14T12:36:55.885 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-14T12:36:55.885 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-14T12:36:55.885 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 58585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-14T12:36:55.885 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-14T12:36:55.885 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-14T12:36:55.886 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-14T12:36:55.886 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/ 2023-07-14T12:36:55.886 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu/ 2023-07-14T12:36:55.886 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu/mce/ 2023-07-14T12:36:55.886 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-14T12:36:55.886 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13281 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpuid.ko 2023-07-14T12:36:55.886 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/msr.ko 2023-07-14T12:36:55.887 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/ 2023-07-14T12:36:55.887 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 348417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-14T12:36:55.887 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 972641 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-14T12:36:55.887 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 2273145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm.ko 2023-07-14T12:36:55.900 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/ 2023-07-14T12:36:55.900 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/af_alg.ko 2023-07-14T12:36:55.900 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/algif_hash.ko 2023-07-14T12:36:55.900 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/algif_skcipher.ko 2023-07-14T12:36:55.901 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17209 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/ansi_cprng.ko 2023-07-14T12:36:55.901 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19641 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/anubis.ko 2023-07-14T12:36:55.901 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/arc4.ko 2023-07-14T12:36:55.901 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/asymmetric_keys/ 2023-07-14T12:36:55.901 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-07-14T12:36:55.901 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/ 2023-07-14T12:36:55.901 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_memcpy.ko 2023-07-14T12:36:55.902 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_pq.ko 2023-07-14T12:36:55.902 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21561 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-14T12:36:55.902 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_tx.ko 2023-07-14T12:36:55.902 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_xor.ko 2023-07-14T12:36:55.902 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/raid6test.ko 2023-07-14T12:36:55.902 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/authenc.ko 2023-07-14T12:36:55.902 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22641 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/authencesn.ko 2023-07-14T12:36:55.903 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blake2b_generic.ko 2023-07-14T12:36:55.903 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blowfish_common.ko 2023-07-14T12:36:55.903 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blowfish_generic.ko 2023-07-14T12:36:55.903 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/camellia_generic.ko 2023-07-14T12:36:55.903 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast5_generic.ko 2023-07-14T12:36:55.903 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast6_generic.ko 2023-07-14T12:36:55.903 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast_common.ko 2023-07-14T12:36:55.903 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/ccm.ko 2023-07-14T12:36:55.904 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14769 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cmac.ko 2023-07-14T12:36:55.904 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crc32_generic.ko 2023-07-14T12:36:55.904 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 46961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cryptd.ko 2023-07-14T12:36:55.904 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crypto_engine.ko 2023-07-14T12:36:55.905 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crypto_simd.ko 2023-07-14T12:36:55.905 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crypto_user.ko 2023-07-14T12:36:55.905 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cts.ko 2023-07-14T12:36:55.905 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/des_generic.ko 2023-07-14T12:36:55.906 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/dh_generic.ko 2023-07-14T12:36:55.906 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/echainiv.ko 2023-07-14T12:36:55.906 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/essiv.ko 2023-07-14T12:36:55.906 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/fcrypt.ko 2023-07-14T12:36:55.906 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/khazad.ko 2023-07-14T12:36:55.906 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/lrw.ko 2023-07-14T12:36:55.906 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11513 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/lz4.ko 2023-07-14T12:36:55.907 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/lz4hc.ko 2023-07-14T12:36:55.907 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11761 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/md4.ko 2023-07-14T12:36:55.907 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/michael_mic.ko 2023-07-14T12:36:55.907 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/pcbc.ko 2023-07-14T12:36:55.907 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/pcrypt.ko 2023-07-14T12:36:55.908 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/rmd160.ko 2023-07-14T12:36:55.908 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/seed.ko 2023-07-14T12:36:55.908 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/serpent_generic.ko 2023-07-14T12:36:55.908 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 149193 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/tcrypt.ko 2023-07-14T12:36:55.909 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/tea.ko 2023-07-14T12:36:55.909 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28777 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/twofish_common.ko 2023-07-14T12:36:55.909 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13233 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/twofish_generic.ko 2023-07-14T12:36:55.910 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/vmac.ko 2023-07-14T12:36:55.910 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/wp512.ko 2023-07-14T12:36:55.910 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xcbc.ko 2023-07-14T12:36:55.911 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xor.ko 2023-07-14T12:36:55.911 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xts.ko 2023-07-14T12:36:55.911 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9481 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xxhash_generic.ko 2023-07-14T12:36:55.911 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ 2023-07-14T12:36:55.912 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/ 2023-07-14T12:36:55.912 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/acpi_extlog.ko 2023-07-14T12:36:55.912 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-14T12:36:55.913 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/acpi_pad.ko 2023-07-14T12:36:55.913 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/apei/ 2023-07-14T12:36:55.913 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/apei/einj.ko 2023-07-14T12:36:55.914 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/ec_sys.ko 2023-07-14T12:36:55.914 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/platform_profile.ko 2023-07-14T12:36:55.914 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/sbs.ko 2023-07-14T12:36:55.914 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/sbshc.ko 2023-07-14T12:36:55.915 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 100401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/video.ko 2023-07-14T12:36:55.915 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/ 2023-07-14T12:36:55.915 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/acard-ahci.ko 2023-07-14T12:36:55.916 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 88625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/ahci.ko 2023-07-14T12:36:55.916 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/ahci_platform.ko 2023-07-14T12:36:55.916 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 87841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/libahci.ko 2023-07-14T12:36:55.916 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/libahci_platform.ko 2023-07-14T12:36:55.917 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17009 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_acpi.ko 2023-07-14T12:36:55.917 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ali.ko 2023-07-14T12:36:55.917 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_amd.ko 2023-07-14T12:36:55.917 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21201 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_artop.ko 2023-07-14T12:36:55.918 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_atiixp.ko 2023-07-14T12:36:55.918 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_atp867x.ko 2023-07-14T12:36:55.918 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cmd640.ko 2023-07-14T12:36:55.918 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cmd64x.ko 2023-07-14T12:36:55.919 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cypress.ko 2023-07-14T12:36:55.919 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_efar.ko 2023-07-14T12:36:55.919 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt366.ko 2023-07-14T12:36:55.919 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34033 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt37x.ko 2023-07-14T12:36:55.920 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-14T12:36:55.920 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-14T12:36:55.920 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_it8213.ko 2023-07-14T12:36:55.920 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35177 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_it821x.ko 2023-07-14T12:36:55.920 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_jmicron.ko 2023-07-14T12:36:55.921 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_legacy.ko 2023-07-14T12:36:55.921 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_marvell.ko 2023-07-14T12:36:55.921 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_mpiix.ko 2023-07-14T12:36:55.921 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_netcell.ko 2023-07-14T12:36:55.921 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ninja32.ko 2023-07-14T12:36:55.921 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ns87410.ko 2023-07-14T12:36:55.921 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ns87415.ko 2023-07-14T12:36:55.922 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_oldpiix.ko 2023-07-14T12:36:55.922 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_opti.ko 2023-07-14T12:36:55.922 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20609 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_optidma.ko 2023-07-14T12:36:55.922 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pcmcia.ko 2023-07-14T12:36:55.923 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-14T12:36:55.923 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-14T12:36:55.923 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_piccolo.ko 2023-07-14T12:36:55.923 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_radisys.ko 2023-07-14T12:36:55.924 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_rdc.ko 2023-07-14T12:36:55.924 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15201 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_rz1000.ko 2023-07-14T12:36:55.924 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sch.ko 2023-07-14T12:36:55.924 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_serverworks.ko 2023-07-14T12:36:55.924 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sil680.ko 2023-07-14T12:36:55.925 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19569 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sl82c105.ko 2023-07-14T12:36:55.925 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_triflex.ko 2023-07-14T12:36:55.925 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_via.ko 2023-07-14T12:36:55.925 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pdc_adma.ko 2023-07-14T12:36:55.925 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_inic162x.ko 2023-07-14T12:36:55.925 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 83225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_mv.ko 2023-07-14T12:36:55.926 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 70537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_nv.ko 2023-07-14T12:36:55.926 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37369 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_promise.ko 2023-07-14T12:36:55.926 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_qstor.ko 2023-07-14T12:36:55.926 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29201 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sil.ko 2023-07-14T12:36:55.926 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sil24.ko 2023-07-14T12:36:55.926 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sis.ko 2023-07-14T12:36:55.926 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_svw.ko 2023-07-14T12:36:55.927 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sx4.ko 2023-07-14T12:36:55.927 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_uli.ko 2023-07-14T12:36:55.927 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_via.ko 2023-07-14T12:36:55.927 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_vsc.ko 2023-07-14T12:36:55.927 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/auxdisplay/ 2023-07-14T12:36:55.927 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16289 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/auxdisplay/ks0108.ko 2023-07-14T12:36:55.927 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/bcma/ 2023-07-14T12:36:55.928 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 124457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/bcma/bcma.ko 2023-07-14T12:36:55.928 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/ 2023-07-14T12:36:55.928 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/aoe/ 2023-07-14T12:36:55.928 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 113705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/aoe/aoe.ko 2023-07-14T12:36:55.928 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/drbd/ 2023-07-14T12:36:55.928 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 968433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/drbd/drbd.ko 2023-07-14T12:36:55.928 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 173201 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/floppy.ko 2023-07-14T12:36:55.929 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/mtip32xx/ 2023-07-14T12:36:55.929 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 94297 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-14T12:36:55.929 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 115345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/nbd.ko 2023-07-14T12:36:55.929 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/null_blk/ 2023-07-14T12:36:55.929 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 110361 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/null_blk/null_blk.ko 2023-07-14T12:36:55.929 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 98225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/pktcdvd.ko 2023-07-14T12:36:55.929 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 257529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/rbd.ko 2023-07-14T12:36:55.930 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkback/ 2023-07-14T12:36:55.930 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 98129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-14T12:36:55.930 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/zram/ 2023-07-14T12:36:55.930 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 60201 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/zram/zram.ko 2023-07-14T12:36:55.930 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ 2023-07-14T12:36:55.930 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/applicom.ko 2023-07-14T12:36:55.930 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12009 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hangcheck-timer.ko 2023-07-14T12:36:55.930 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/ 2023-07-14T12:36:55.931 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-14T12:36:55.931 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-14T12:36:55.931 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-14T12:36:55.931 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/via-rng.ko 2023-07-14T12:36:55.931 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15633 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-14T12:36:55.931 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ 2023-07-14T12:36:55.931 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-14T12:36:55.931 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 150665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-14T12:36:55.932 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26561 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-14T12:36:55.932 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 139057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-14T12:36:55.932 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 70833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-14T12:36:55.932 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53609 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-14T12:36:55.932 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/lp.ko 2023-07-14T12:36:55.932 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/mwave/ 2023-07-14T12:36:55.933 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 84121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/mwave/mwave.ko 2023-07-14T12:36:55.933 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/nvram.ko 2023-07-14T12:36:55.933 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ppdev.ko 2023-07-14T12:36:55.933 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tlclk.ko 2023-07-14T12:36:55.933 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/ 2023-07-14T12:36:55.933 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-14T12:36:55.933 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-07-14T12:36:55.933 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-07-14T12:36:55.934 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-07-14T12:36:55.934 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-14T12:36:55.934 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22697 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-14T12:36:55.934 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23561 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-07-14T12:36:55.934 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/xillybus/ 2023-07-14T12:36:55.935 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/xillybus/xillybus_class.ko 2023-07-14T12:36:55.935 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50945 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/xillybus/xillybus_core.ko 2023-07-14T12:36:55.935 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-07-14T12:36:55.935 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/clk/ 2023-07-14T12:36:55.935 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/clk/clk-palmas.ko 2023-07-14T12:36:55.935 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/clk/clk-si5351.ko 2023-07-14T12:36:55.936 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/clk/clk-twl6040.ko 2023-07-14T12:36:55.936 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/clk/clk-wm831x.ko 2023-07-14T12:36:55.936 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/ 2023-07-14T12:36:55.936 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-14T12:36:55.936 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-14T12:36:55.936 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25297 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-14T12:36:55.936 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ 2023-07-14T12:36:55.937 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp/ 2023-07-14T12:36:55.937 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 70785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-14T12:36:55.937 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 234473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp/ccp.ko 2023-07-14T12:36:55.937 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/ 2023-07-14T12:36:55.937 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/ 2023-07-14T12:36:55.937 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_common/ 2023-07-14T12:36:55.938 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 408489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-14T12:36:55.938 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-07-14T12:36:55.938 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-14T12:36:55.938 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/padlock-aes.ko 2023-07-14T12:36:55.938 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/padlock-sha.ko 2023-07-14T12:36:55.938 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/virtio/ 2023-07-14T12:36:55.939 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 68937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-14T12:36:55.939 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dca/ 2023-07-14T12:36:55.939 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dca/dca.ko 2023-07-14T12:36:55.939 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/ 2023-07-14T12:36:55.939 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/dw/ 2023-07-14T12:36:55.939 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-14T12:36:55.940 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/ioat/ 2023-07-14T12:36:55.940 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 122641 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-14T12:36:55.940 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/ 2023-07-14T12:36:55.940 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 80273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/amd64_edac.ko 2023-07-14T12:36:55.940 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35769 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/e752x_edac.ko 2023-07-14T12:36:55.941 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 63617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/edac_mce_amd.ko 2023-07-14T12:36:56.029 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i3000_edac.ko 2023-07-14T12:36:56.029 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i3200_edac.ko 2023-07-14T12:36:56.029 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i5100_edac.ko 2023-07-14T12:36:56.030 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i5400_edac.ko 2023-07-14T12:36:56.030 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i7300_edac.ko 2023-07-14T12:36:56.030 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 52025 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i7core_edac.ko 2023-07-14T12:36:56.030 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i82975x_edac.ko 2023-07-14T12:36:56.030 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/ie31200_edac.ko 2023-07-14T12:36:56.030 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 56809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/sb_edac.ko 2023-07-14T12:36:56.030 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/x38_edac.ko 2023-07-14T12:36:56.031 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/extcon/ 2023-07-14T12:36:56.031 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/extcon/extcon-gpio.ko 2023-07-14T12:36:56.031 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/extcon/extcon-max14577.ko 2023-07-14T12:36:56.031 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29569 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/extcon/extcon-max77693.ko 2023-07-14T12:36:56.031 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/extcon/extcon-max8997.ko 2023-07-14T12:36:56.031 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/extcon/extcon-palmas.ko 2023-07-14T12:36:56.031 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/extcon/extcon-rt8973a.ko 2023-07-14T12:36:56.031 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/extcon/extcon-sm5502.ko 2023-07-14T12:36:56.032 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware/ 2023-07-14T12:36:56.032 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware/dmi-sysfs.ko 2023-07-14T12:36:56.032 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware/efi/ 2023-07-14T12:36:56.032 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware/efi/efi-pstore.ko 2023-07-14T12:36:56.032 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-14T12:36:56.032 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/ 2023-07-14T12:36:56.032 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-adp5520.ko 2023-07-14T12:36:56.033 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-amd8111.ko 2023-07-14T12:36:56.033 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-arizona.ko 2023-07-14T12:36:56.033 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-da9052.ko 2023-07-14T12:36:56.033 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-da9055.ko 2023-07-14T12:36:56.033 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-dln2.ko 2023-07-14T12:36:56.033 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 77849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-f7188x.ko 2023-07-14T12:36:56.033 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-generic.ko 2023-07-14T12:36:56.033 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19569 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-ich.ko 2023-07-14T12:36:56.034 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-07-14T12:36:56.034 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-kempld.ko 2023-07-14T12:36:56.034 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-lp3943.ko 2023-07-14T12:36:56.034 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-max7300.ko 2023-07-14T12:36:56.034 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-max730x.ko 2023-07-14T12:36:56.034 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18577 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-max732x.ko 2023-07-14T12:36:56.034 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-07-14T12:36:56.034 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 46761 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-pca953x.ko 2023-07-14T12:36:56.035 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-pcf857x.ko 2023-07-14T12:36:56.035 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14377 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-rdc321x.ko 2023-07-14T12:36:56.035 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-sch.ko 2023-07-14T12:36:56.035 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-sch311x.ko 2023-07-14T12:36:56.035 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-tps65912.ko 2023-07-14T12:36:56.035 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-twl4030.ko 2023-07-14T12:36:56.035 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-twl6040.ko 2023-07-14T12:36:56.036 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-14T12:36:56.036 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-vx855.ko 2023-07-14T12:36:56.036 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16281 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-wm831x.ko 2023-07-14T12:36:56.036 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-wm8350.ko 2023-07-14T12:36:56.036 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-wm8994.ko 2023-07-14T12:36:56.036 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/ 2023-07-14T12:36:56.036 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11577 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-a4tech.ko 2023-07-14T12:36:56.036 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-apple.ko 2023-07-14T12:36:56.037 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14481 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-appleir.ko 2023-07-14T12:36:56.037 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8353 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-aureal.ko 2023-07-14T12:36:56.037 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-axff.ko 2023-07-14T12:36:56.037 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-belkin.ko 2023-07-14T12:36:56.037 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-cherry.ko 2023-07-14T12:36:56.037 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16041 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-chicony.ko 2023-07-14T12:36:56.037 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-cp2112.ko 2023-07-14T12:36:56.037 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-cypress.ko 2023-07-14T12:36:56.038 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-dr.ko 2023-07-14T12:36:56.038 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10697 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-elecom.ko 2023-07-14T12:36:56.038 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-elo.ko 2023-07-14T12:36:56.038 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-emsff.ko 2023-07-14T12:36:56.038 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-ezkey.ko 2023-07-14T12:36:56.038 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gaff.ko 2023-07-14T12:36:56.038 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-generic.ko 2023-07-14T12:36:56.039 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gt683r.ko 2023-07-14T12:36:56.039 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gyration.ko 2023-07-14T12:36:56.039 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-14T12:36:56.039 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-14T12:36:56.039 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtekff.ko 2023-07-14T12:36:56.039 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19041 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-hyperv.ko 2023-07-14T12:36:56.039 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-icade.ko 2023-07-14T12:36:56.039 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-kensington.ko 2023-07-14T12:36:56.040 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-keytouch.ko 2023-07-14T12:36:56.040 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17201 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-kye.ko 2023-07-14T12:36:56.040 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-lcpower.ko 2023-07-14T12:36:56.040 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-led.ko 2023-07-14T12:36:56.040 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42297 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-lenovo.ko 2023-07-14T12:36:56.040 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30761 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-lg-g15.ko 2023-07-14T12:36:56.040 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 57809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-14T12:36:56.041 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 100897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-14T12:36:56.041 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 80993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-logitech.ko 2023-07-14T12:36:56.041 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-magicmouse.ko 2023-07-14T12:36:56.041 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-microsoft.ko 2023-07-14T12:36:56.041 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10361 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-monterey.ko 2023-07-14T12:36:56.041 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-multitouch.ko 2023-07-14T12:36:56.041 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-ntrig.ko 2023-07-14T12:36:56.041 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-ortek.ko 2023-07-14T12:36:56.042 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-penmount.ko 2023-07-14T12:36:56.042 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12289 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-petalynx.ko 2023-07-14T12:36:56.042 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 72937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-picolcd.ko 2023-07-14T12:36:56.042 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-pl.ko 2023-07-14T12:36:56.042 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-plantronics.ko 2023-07-14T12:36:56.042 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-primax.ko 2023-07-14T12:36:56.042 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-rmi.ko 2023-07-14T12:36:56.042 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20761 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-14T12:36:56.043 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-common.ko 2023-07-14T12:36:56.043 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31361 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-14T12:36:56.043 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-14T12:36:56.043 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-14T12:36:56.043 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-14T12:36:56.043 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-14T12:36:56.043 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-14T12:36:56.044 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-14T12:36:56.044 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-14T12:36:56.044 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-14T12:36:56.044 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat.ko 2023-07-14T12:36:56.044 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-saitek.ko 2023-07-14T12:36:56.044 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15193 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-samsung.ko 2023-07-14T12:36:56.044 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-14T12:36:56.044 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sjoy.ko 2023-07-14T12:36:56.045 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51201 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sony.ko 2023-07-14T12:36:56.045 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-speedlink.ko 2023-07-14T12:36:56.045 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-steelseries.ko 2023-07-14T12:36:56.045 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sunplus.ko 2023-07-14T12:36:56.045 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-14T12:36:56.045 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-tivo.ko 2023-07-14T12:36:56.045 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-tmff.ko 2023-07-14T12:36:56.046 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-topseed.ko 2023-07-14T12:36:56.046 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-twinhan.ko 2023-07-14T12:36:56.046 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 71457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-uclogic.ko 2023-07-14T12:36:56.046 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-waltop.ko 2023-07-14T12:36:56.046 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 143585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-wiimote.ko 2023-07-14T12:36:56.046 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-xinmo.ko 2023-07-14T12:36:56.046 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-zpff.ko 2023-07-14T12:36:56.046 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-zydacron.ko 2023-07-14T12:36:56.047 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 267713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid.ko 2023-07-14T12:36:56.047 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/uhid.ko 2023-07-14T12:36:56.047 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/usbhid/ 2023-07-14T12:36:56.047 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 125721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/usbhid/usbhid.ko 2023-07-14T12:36:56.047 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19137 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/usbhid/usbkbd.ko 2023-07-14T12:36:56.047 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/usbhid/usbmouse.ko 2023-07-14T12:36:56.047 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 217401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/wacom.ko 2023-07-14T12:36:56.048 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/ 2023-07-14T12:36:56.048 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 63497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_balloon.ko 2023-07-14T12:36:56.048 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 89609 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_utils.ko 2023-07-14T12:36:56.048 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 301449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_vmbus.ko 2023-07-14T12:36:56.048 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ 2023-07-14T12:36:56.048 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/abituguru.ko 2023-07-14T12:36:56.048 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 61393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/abituguru3.ko 2023-07-14T12:36:56.048 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-14T12:36:56.049 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ad7414.ko 2023-07-14T12:36:56.049 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ad7418.ko 2023-07-14T12:36:56.049 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adc128d818.ko 2023-07-14T12:36:56.049 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1025.ko 2023-07-14T12:36:56.049 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 97977 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1026.ko 2023-07-14T12:36:56.049 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1029.ko 2023-07-14T12:36:56.049 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 45553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1031.ko 2023-07-14T12:36:56.050 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26289 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm9240.ko 2023-07-14T12:36:56.050 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14769 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ads7828.ko 2023-07-14T12:36:56.050 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10769 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7410.ko 2023-07-14T12:36:56.050 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7411.ko 2023-07-14T12:36:56.050 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 74433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7462.ko 2023-07-14T12:36:56.050 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7470.ko 2023-07-14T12:36:56.050 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 67929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7475.ko 2023-07-14T12:36:56.050 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7x10.ko 2023-07-14T12:36:56.051 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/amc6821.ko 2023-07-14T12:36:56.051 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 55265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/applesmc.ko 2023-07-14T12:36:56.051 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asb100.ko 2023-07-14T12:36:56.051 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 58617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asc7621.ko 2023-07-14T12:36:56.051 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-14T12:36:56.051 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/atxp1.ko 2023-07-14T12:36:56.051 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28281 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/coretemp.ko 2023-07-14T12:36:56.051 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/da9052-hwmon.ko 2023-07-14T12:36:56.052 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/da9055-hwmon.ko 2023-07-14T12:36:56.052 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-14T12:36:56.052 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 99601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/dme1737.ko 2023-07-14T12:36:56.052 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ds1621.ko 2023-07-14T12:36:56.052 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ds620.ko 2023-07-14T12:36:56.052 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29777 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/emc1403.ko 2023-07-14T12:36:56.052 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/emc2103.ko 2023-07-14T12:36:56.053 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/emc6w201.ko 2023-07-14T12:36:56.053 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f71805f.ko 2023-07-14T12:36:56.053 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 94457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f71882fg.ko 2023-07-14T12:36:56.053 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f75375s.ko 2023-07-14T12:36:56.053 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/fam15h_power.ko 2023-07-14T12:36:56.053 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 55433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/fschmd.ko 2023-07-14T12:36:56.053 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14481 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/g760a.ko 2023-07-14T12:36:56.053 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/g762.ko 2023-07-14T12:36:56.054 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 46801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/gl518sm.ko 2023-07-14T12:36:56.054 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 45529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/gl520sm.ko 2023-07-14T12:36:56.054 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/hih6130.ko 2023-07-14T12:36:56.054 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-14T12:36:56.054 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/i5500_temp.ko 2023-07-14T12:36:56.054 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/i5k_amb.ko 2023-07-14T12:36:56.054 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ibmaem.ko 2023-07-14T12:36:56.054 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21297 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ibmpex.ko 2023-07-14T12:36:56.055 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ina209.ko 2023-07-14T12:36:56.055 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ina2xx.ko 2023-07-14T12:36:56.055 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 129217 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/it87.ko 2023-07-14T12:36:56.055 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/jc42.ko 2023-07-14T12:36:56.055 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/k10temp.ko 2023-07-14T12:36:56.055 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/k8temp.ko 2023-07-14T12:36:56.055 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lineage-pem.ko 2023-07-14T12:36:56.056 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 48601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm63.ko 2023-07-14T12:36:56.056 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16761 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm73.ko 2023-07-14T12:36:56.056 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36777 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm75.ko 2023-07-14T12:36:56.056 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm77.ko 2023-07-14T12:36:56.056 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm78.ko 2023-07-14T12:36:56.056 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm80.ko 2023-07-14T12:36:56.056 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm83.ko 2023-07-14T12:36:56.056 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 72833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm85.ko 2023-07-14T12:36:56.057 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 46153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm87.ko 2023-07-14T12:36:56.057 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm90.ko 2023-07-14T12:36:56.057 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm92.ko 2023-07-14T12:36:56.057 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 108841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm93.ko 2023-07-14T12:36:56.057 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95234.ko 2023-07-14T12:36:56.057 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95241.ko 2023-07-14T12:36:56.057 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95245.ko 2023-07-14T12:36:56.058 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc2945.ko 2023-07-14T12:36:56.058 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4151.ko 2023-07-14T12:36:56.058 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15193 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4215.ko 2023-07-14T12:36:56.058 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4222.ko 2023-07-14T12:36:56.058 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4245.ko 2023-07-14T12:36:56.058 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4260.ko 2023-07-14T12:36:56.058 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4261.ko 2023-07-14T12:36:56.058 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max16065.ko 2023-07-14T12:36:56.059 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max1619.ko 2023-07-14T12:36:56.059 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24353 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max1668.ko 2023-07-14T12:36:56.059 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max197.ko 2023-07-14T12:36:56.059 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6639.ko 2023-07-14T12:36:56.059 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6650.ko 2023-07-14T12:36:56.059 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35777 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6697.ko 2023-07-14T12:36:56.059 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/mc13783-adc.ko 2023-07-14T12:36:56.059 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/mcp3021.ko 2023-07-14T12:36:56.060 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-07-14T12:36:56.060 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6683.ko 2023-07-14T12:36:56.060 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 116737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6775-core.ko 2023-07-14T12:36:56.060 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 60705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6775.ko 2023-07-14T12:36:56.060 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct7802.ko 2023-07-14T12:36:56.060 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 82337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pc87360.ko 2023-07-14T12:36:56.060 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 54433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pc87427.ko 2023-07-14T12:36:56.060 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pcf8591.ko 2023-07-14T12:36:56.061 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ 2023-07-14T12:36:56.061 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21353 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-14T12:36:56.061 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-14T12:36:56.061 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-14T12:36:56.061 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9577 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-14T12:36:56.061 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-14T12:36:56.061 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-14T12:36:56.062 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-14T12:36:56.062 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 81841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-14T12:36:56.062 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-14T12:36:56.062 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-14T12:36:56.062 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-14T12:36:56.062 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-14T12:36:56.062 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/powr1220.ko 2023-07-14T12:36:56.062 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch5627.ko 2023-07-14T12:36:56.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch5636.ko 2023-07-14T12:36:56.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-14T12:36:56.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32137 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sht15.ko 2023-07-14T12:36:56.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sht21.ko 2023-07-14T12:36:56.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/shtc1.ko 2023-07-14T12:36:56.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sis5595.ko 2023-07-14T12:36:56.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smm665.ko 2023-07-14T12:36:56.063 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19577 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47b397.ko 2023-07-14T12:36:56.064 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39193 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47m1.ko 2023-07-14T12:36:56.064 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47m192.ko 2023-07-14T12:36:56.064 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/thmc50.ko 2023-07-14T12:36:56.064 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp102.ko 2023-07-14T12:36:56.064 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp103.ko 2023-07-14T12:36:56.064 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp401.ko 2023-07-14T12:36:56.064 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp421.ko 2023-07-14T12:36:56.064 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19697 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/via-cputemp.ko 2023-07-14T12:36:56.065 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41945 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/via686a.ko 2023-07-14T12:36:56.065 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 52457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/vt1211.ko 2023-07-14T12:36:56.065 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/vt8231.ko 2023-07-14T12:36:56.065 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 57513 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83627ehf.ko 2023-07-14T12:36:56.065 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 78873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83627hf.ko 2023-07-14T12:36:56.065 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 71345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83781d.ko 2023-07-14T12:36:56.065 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 63289 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83791d.ko 2023-07-14T12:36:56.066 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 71321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83792d.ko 2023-07-14T12:36:56.066 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 101457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83793.ko 2023-07-14T12:36:56.066 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 119505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83795.ko 2023-07-14T12:36:56.066 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83l785ts.ko 2023-07-14T12:36:56.066 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83l786ng.ko 2023-07-14T12:36:56.066 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-07-14T12:36:56.066 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-07-14T12:36:56.066 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/ 2023-07-14T12:36:56.067 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos/ 2023-07-14T12:36:56.067 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-14T12:36:56.067 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-14T12:36:56.067 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/ 2023-07-14T12:36:56.067 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-07-14T12:36:56.067 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-07-14T12:36:56.067 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27777 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-07-14T12:36:56.067 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-14T12:36:56.068 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26193 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-14T12:36:56.068 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16201 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-14T12:36:56.068 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-07-14T12:36:56.068 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 6929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-14T12:36:56.068 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-07-14T12:36:56.068 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 48553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-14T12:36:56.068 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23905 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-14T12:36:56.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-14T12:36:56.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-14T12:36:56.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-07-14T12:36:56.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-07-14T12:36:56.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 62729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-14T12:36:56.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-14T12:36:56.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-14T12:36:56.069 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17369 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-07-14T12:36:56.070 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-14T12:36:56.070 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-14T12:36:56.070 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-07-14T12:36:56.070 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-14T12:36:56.070 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-14T12:36:56.070 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-14T12:36:56.070 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15289 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-07-14T12:36:56.070 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-14T12:36:56.071 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-14T12:36:56.071 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-07-14T12:36:56.071 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29361 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-07-14T12:36:56.071 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-14T12:36:56.071 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-07-14T12:36:56.071 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-14T12:36:56.071 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-14T12:36:56.072 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-14T12:36:56.072 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19041 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-14T12:36:56.072 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-07-14T12:36:56.072 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-mux.ko 2023-07-14T12:36:56.072 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-smbus.ko 2023-07-14T12:36:56.072 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-stub.ko 2023-07-14T12:36:56.072 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/muxes/ 2023-07-14T12:36:56.073 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-07-14T12:36:56.073 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-07-14T12:36:56.073 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-07-14T12:36:56.073 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ 2023-07-14T12:36:56.073 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ 2023-07-14T12:36:56.073 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 273641 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-14T12:36:56.073 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 876913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_core.ko 2023-07-14T12:36:56.073 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 69321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-14T12:36:56.074 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 324145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-14T12:36:56.074 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 97961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-14T12:36:56.074 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 279321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-14T12:36:56.074 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66177 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-14T12:36:56.074 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/ 2023-07-14T12:36:56.074 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/cxgb4/ 2023-07-14T12:36:56.074 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 492561 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-14T12:36:56.075 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx4/ 2023-07-14T12:36:56.075 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 419217 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-14T12:36:56.075 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx5/ 2023-07-14T12:36:56.075 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 739705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-14T12:36:56.075 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mthca/ 2023-07-14T12:36:56.075 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 296649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-14T12:36:56.075 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/ocrdma/ 2023-07-14T12:36:56.075 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 153681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-07-14T12:36:56.076 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/usnic/ 2023-07-14T12:36:56.076 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 169017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-07-14T12:36:56.076 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/ 2023-07-14T12:36:56.076 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/ipoib/ 2023-07-14T12:36:56.076 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 263177 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-14T12:36:56.076 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/iser/ 2023-07-14T12:36:56.076 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 100225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-14T12:36:56.077 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/isert/ 2023-07-14T12:36:56.077 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 111993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-14T12:36:56.077 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srp/ 2023-07-14T12:36:56.077 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 129081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-14T12:36:56.077 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srpt/ 2023-07-14T12:36:56.077 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 129553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-14T12:36:56.077 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/ 2023-07-14T12:36:56.077 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/evbug.ko 2023-07-14T12:36:56.078 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/ff-memless.ko 2023-07-14T12:36:56.078 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/ 2023-07-14T12:36:56.078 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-14T12:36:56.078 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-14T12:36:56.078 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41217 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/gameport.ko 2023-07-14T12:36:56.078 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/lightning.ko 2023-07-14T12:36:56.078 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/ns558.ko 2023-07-14T12:36:56.078 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/joydev.ko 2023-07-14T12:36:56.079 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/ 2023-07-14T12:36:56.079 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-07-14T12:36:56.079 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-07-14T12:36:56.079 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26905 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-07-14T12:36:56.079 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24761 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-07-14T12:36:56.079 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-14T12:36:56.079 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-07-14T12:36:56.080 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/lkkbd.ko 2023-07-14T12:36:56.080 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/lm8323.ko 2023-07-14T12:36:56.080 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/lm8333.ko 2023-07-14T12:36:56.080 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-07-14T12:36:56.080 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18217 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-07-14T12:36:56.080 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-07-14T12:36:56.080 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-07-14T12:36:56.080 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/newtonkbd.ko 2023-07-14T12:36:56.081 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-07-14T12:36:56.081 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15209 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/qt1070.ko 2023-07-14T12:36:56.081 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/qt2160.ko 2023-07-14T12:36:56.081 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-07-14T12:36:56.081 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11481 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/stowaway.ko 2023-07-14T12:36:56.081 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18289 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/sunkbd.ko 2023-07-14T12:36:56.081 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-07-14T12:36:56.082 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16177 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-07-14T12:36:56.082 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-07-14T12:36:56.082 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/xtkbd.ko 2023-07-14T12:36:56.082 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/matrix-keymap.ko 2023-07-14T12:36:56.082 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/ 2023-07-14T12:36:56.082 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/appletouch.ko 2023-07-14T12:36:56.082 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34177 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/bcm5974.ko 2023-07-14T12:36:56.082 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 123681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/cyapatp.ko 2023-07-14T12:36:56.083 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 89449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-14T12:36:56.083 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14025 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/gpio_mouse.ko 2023-07-14T12:36:56.083 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 335849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/psmouse.ko 2023-07-14T12:36:56.083 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/sermouse.ko 2023-07-14T12:36:56.083 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-14T12:36:56.083 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22569 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-14T12:36:56.083 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-14T12:36:56.083 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/rmi4/ 2023-07-14T12:36:56.084 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 109849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-14T12:36:56.084 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/ 2023-07-14T12:36:56.084 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/altera_ps2.ko 2023-07-14T12:36:56.084 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16289 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/arc_ps2.ko 2023-07-14T12:36:56.084 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/ct82c710.ko 2023-07-14T12:36:56.084 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-14T12:36:56.084 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/parkbd.ko 2023-07-14T12:36:56.085 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/pcips2.ko 2023-07-14T12:36:56.085 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/ps2mult.ko 2023-07-14T12:36:56.085 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/serio_raw.ko 2023-07-14T12:36:56.085 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17977 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/serport.ko 2023-07-14T12:36:56.085 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/sparse-keymap.ko 2023-07-14T12:36:56.085 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu/ 2023-07-14T12:36:56.085 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu/amd/ 2023-07-14T12:36:56.085 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-14T12:36:56.086 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/ 2023-07-14T12:36:56.086 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-88pm860x.ko 2023-07-14T12:36:56.086 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-adp5520.ko 2023-07-14T12:36:56.086 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-bd2802.ko 2023-07-14T12:36:56.086 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-blinkm.ko 2023-07-14T12:36:56.086 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-da903x.ko 2023-07-14T12:36:56.086 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-da9052.ko 2023-07-14T12:36:56.086 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16561 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-gpio.ko 2023-07-14T12:36:56.087 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lm3530.ko 2023-07-14T12:36:56.087 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lm3533.ko 2023-07-14T12:36:56.087 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19353 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lm355x.ko 2023-07-14T12:36:56.087 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lm3642.ko 2023-07-14T12:36:56.087 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lp3944.ko 2023-07-14T12:36:56.087 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11233 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lp8788.ko 2023-07-14T12:36:56.087 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-max8997.ko 2023-07-14T12:36:56.088 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12609 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-mc13783.ko 2023-07-14T12:36:56.088 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-menf21bmc.ko 2023-07-14T12:36:56.088 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-pca9532.ko 2023-07-14T12:36:56.088 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20481 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-pca955x.ko 2023-07-14T12:36:56.088 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-pca963x.ko 2023-07-14T12:36:56.088 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-ss4200.ko 2023-07-14T12:36:56.088 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-tca6507.ko 2023-07-14T12:36:56.088 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-wm831x-status.ko 2023-07-14T12:36:56.089 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-wm8350.ko 2023-07-14T12:36:56.089 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ 2023-07-14T12:36:56.089 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-14T12:36:56.089 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-14T12:36:56.089 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-14T12:36:56.089 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-14T12:36:56.089 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-14T12:36:56.089 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-14T12:36:56.090 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-14T12:36:56.090 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-14T12:36:56.090 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/ 2023-07-14T12:36:56.090 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/bcache/ 2023-07-14T12:36:56.090 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 655473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/bcache/bcache.ko 2023-07-14T12:36:56.090 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40569 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-bio-prison.ko 2023-07-14T12:36:56.090 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 89601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-bufio.ko 2023-07-14T12:36:56.091 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-cache-smq.ko 2023-07-14T12:36:56.091 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 155993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-cache.ko 2023-07-14T12:36:56.091 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 107049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-crypt.ko 2023-07-14T12:36:56.091 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-delay.ko 2023-07-14T12:36:56.091 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-era.ko 2023-07-14T12:36:56.091 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-flakey.ko 2023-07-14T12:36:56.091 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-log-userspace.ko 2023-07-14T12:36:56.091 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-log.ko 2023-07-14T12:36:56.092 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-mirror.ko 2023-07-14T12:36:56.092 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 78017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-multipath.ko 2023-07-14T12:36:56.092 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-queue-length.ko 2023-07-14T12:36:56.092 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 70769 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-raid.ko 2023-07-14T12:36:56.092 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-region-hash.ko 2023-07-14T12:36:56.092 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-round-robin.ko 2023-07-14T12:36:56.092 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-service-time.ko 2023-07-14T12:36:56.093 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 109593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-snapshot.ko 2023-07-14T12:36:56.093 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19361 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-switch.ko 2023-07-14T12:36:56.093 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 181585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-thin-pool.ko 2023-07-14T12:36:56.093 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-verity.ko 2023-07-14T12:36:56.093 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-zero.ko 2023-07-14T12:36:56.093 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/faulty.ko 2023-07-14T12:36:56.093 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/linear.ko 2023-07-14T12:36:56.093 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/multipath.ko 2023-07-14T12:36:56.094 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/persistent-data/ 2023-07-14T12:36:56.094 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 199937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-14T12:36:56.094 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid0.ko 2023-07-14T12:36:56.094 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 112609 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid1.ko 2023-07-14T12:36:56.094 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 160553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid10.ko 2023-07-14T12:36:56.094 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 396153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid456.ko 2023-07-14T12:36:56.094 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/ 2023-07-14T12:36:56.094 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/ 2023-07-14T12:36:56.095 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 178113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptbase.ko 2023-07-14T12:36:56.095 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 63385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptctl.ko 2023-07-14T12:36:56.095 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptfc.ko 2023-07-14T12:36:56.095 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptlan.ko 2023-07-14T12:36:56.095 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 123305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptsas.ko 2023-07-14T12:36:56.095 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 79017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptscsih.ko 2023-07-14T12:36:56.095 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptspi.ko 2023-07-14T12:36:56.095 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/ 2023-07-14T12:36:56.096 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/88pm800.ko 2023-07-14T12:36:56.096 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12761 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/88pm805.ko 2023-07-14T12:36:56.096 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11193 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/88pm80x.ko 2023-07-14T12:36:56.096 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/arizona-i2c.ko 2023-07-14T12:36:56.096 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 123721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/arizona.ko 2023-07-14T12:36:56.096 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/bcm590xx.ko 2023-07-14T12:36:56.096 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/cros_ec_dev.ko 2023-07-14T12:36:56.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/dln2.ko 2023-07-14T12:36:56.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16689 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/janz-cmodio.ko 2023-07-14T12:36:56.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/kempld-core.ko 2023-07-14T12:36:56.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/lm3533-core.ko 2023-07-14T12:36:56.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-07-14T12:36:56.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13009 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/lp3943.ko 2023-07-14T12:36:56.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 54569 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/lpc_ich.ko 2023-07-14T12:36:56.097 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/lpc_sch.ko 2023-07-14T12:36:56.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17409 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/max8907.ko 2023-07-14T12:36:56.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/mc13xxx-core.ko 2023-07-14T12:36:56.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-07-14T12:36:56.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/menf21bmc.ko 2023-07-14T12:36:56.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/pcf50633-adc.ko 2023-07-14T12:36:56.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/pcf50633-gpio.ko 2023-07-14T12:36:56.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/pcf50633.ko 2023-07-14T12:36:56.098 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-07-14T12:36:56.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20289 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/retu-mfd.ko 2023-07-14T12:36:56.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 80425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/si476x-core.ko 2023-07-14T12:36:56.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 48441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/sm501.ko 2023-07-14T12:36:56.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-07-14T12:36:56.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51137 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/tps65010.ko 2023-07-14T12:36:56.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/tps6507x.ko 2023-07-14T12:36:56.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/viperboard.ko 2023-07-14T12:36:56.099 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/vx855.ko 2023-07-14T12:36:56.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/wl1273-core.ko 2023-07-14T12:36:56.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/wm8994.ko 2023-07-14T12:36:56.100 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/ 2023-07-14T12:36:56.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-07-14T12:36:56.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 48489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/ad525x_dpot.ko 2023-07-14T12:36:56.100 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/altera-stapl/ 2023-07-14T12:36:56.100 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 46585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-14T12:36:56.101 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/apds9802als.ko 2023-07-14T12:36:56.101 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/apds990x.ko 2023-07-14T12:36:56.101 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 45593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/bh1770glc.ko 2023-07-14T12:36:56.101 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/c2port/ 2023-07-14T12:36:56.101 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-07-14T12:36:56.101 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/c2port/core.ko 2023-07-14T12:36:56.101 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/cb710/ 2023-07-14T12:36:56.101 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/cb710/cb710.ko 2023-07-14T12:36:56.102 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/ds1682.ko 2023-07-14T12:36:56.102 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/dummy-irq.ko 2023-07-14T12:36:56.102 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/echo/ 2023-07-14T12:36:56.102 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/echo/echo.ko 2023-07-14T12:36:56.102 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/ 2023-07-14T12:36:56.102 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/at24.ko 2023-07-14T12:36:56.102 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-14T12:36:56.102 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14769 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-14T12:36:56.103 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/max6875.ko 2023-07-14T12:36:56.103 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/enclosure.ko 2023-07-14T12:36:56.103 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/genwqe/ 2023-07-14T12:36:56.103 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 152137 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-07-14T12:36:56.103 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/hmc6352.ko 2023-07-14T12:36:56.103 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31193 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/hpilo.ko 2023-07-14T12:36:56.103 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/ibmasm/ 2023-07-14T12:36:56.103 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 72601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-07-14T12:36:56.104 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/ics932s401.ko 2023-07-14T12:36:56.104 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/isl29003.ko 2023-07-14T12:36:56.104 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/isl29020.ko 2023-07-14T12:36:56.104 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d/ 2023-07-14T12:36:56.104 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-14T12:36:56.104 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-14T12:36:56.104 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/ 2023-07-14T12:36:56.104 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 125209 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei-me.ko 2023-07-14T12:36:56.105 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 56521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei-txe.ko 2023-07-14T12:36:56.105 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 309857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei.ko 2023-07-14T12:36:56.105 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/phantom.ko 2023-07-14T12:36:56.105 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/ti-st/ 2023-07-14T12:36:56.105 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 74905 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/ti-st/st_drv.ko 2023-07-14T12:36:56.105 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tifm_7xx1.ko 2023-07-14T12:36:56.105 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tifm_core.ko 2023-07-14T12:36:56.106 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tsl2550.ko 2023-07-14T12:36:56.106 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 48673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_balloon.ko 2023-07-14T12:36:56.106 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_vmci/ 2023-07-14T12:36:56.106 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 183857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-14T12:36:56.106 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ 2023-07-14T12:36:56.106 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/bonding/ 2023-07-14T12:36:56.106 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 487801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/bonding/bonding.ko 2023-07-14T12:36:56.106 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/ 2023-07-14T12:36:56.107 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/b53/ 2023-07-14T12:36:56.107 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 106009 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-14T12:36:56.107 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40281 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-14T12:36:56.107 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14689 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-14T12:36:56.107 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6xxx/ 2023-07-14T12:36:56.107 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 452481 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-14T12:36:56.107 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dummy.ko 2023-07-14T12:36:56.107 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17945 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/eql.ko 2023-07-14T12:36:56.108 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ 2023-07-14T12:36:56.108 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/ 2023-07-14T12:36:56.108 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 45785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-14T12:36:56.108 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-14T12:36:56.108 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 130489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-14T12:36:56.108 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 68785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-14T12:36:56.108 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/ 2023-07-14T12:36:56.108 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-14T12:36:56.109 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59689 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-14T12:36:56.109 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27193 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-14T12:36:56.109 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 99113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-14T12:36:56.109 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/adaptec/ 2023-07-14T12:36:56.109 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 54521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-14T12:36:56.109 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/agere/ 2023-07-14T12:36:56.109 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 69145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-14T12:36:56.110 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/alteon/ 2023-07-14T12:36:56.110 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-14T12:36:56.110 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/altera/ 2023-07-14T12:36:56.110 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-14T12:36:56.110 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/ 2023-07-14T12:36:56.110 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 54545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-14T12:36:56.110 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-14T12:36:56.110 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 87345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-14T12:36:56.111 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/ 2023-07-14T12:36:56.111 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/alx/ 2023-07-14T12:36:56.111 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 97321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-14T12:36:56.111 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-07-14T12:36:56.111 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 104585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-14T12:36:56.111 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-07-14T12:36:56.111 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 90257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-14T12:36:56.111 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx/ 2023-07-14T12:36:56.112 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 81505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-14T12:36:56.112 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 69713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-14T12:36:56.112 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/ 2023-07-14T12:36:56.112 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 78401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-14T12:36:56.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 176881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-14T12:36:56.113 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-07-14T12:36:56.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1422209 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-14T12:36:56.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 128377 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-14T12:36:56.113 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/genet/ 2023-07-14T12:36:56.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 132289 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-14T12:36:56.113 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 312145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-14T12:36:56.113 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade/ 2023-07-14T12:36:56.114 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade/bna/ 2023-07-14T12:36:56.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 323601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-14T12:36:56.114 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/ 2023-07-14T12:36:56.114 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-07-14T12:36:56.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 193433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-14T12:36:56.114 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-07-14T12:36:56.114 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 347641 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-14T12:36:56.114 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-07-14T12:36:56.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1044145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-14T12:36:56.115 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-07-14T12:36:56.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 166113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-14T12:36:56.115 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-07-14T12:36:56.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-14T12:36:56.115 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco/ 2023-07-14T12:36:56.115 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco/enic/ 2023-07-14T12:36:56.115 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 204329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-14T12:36:56.116 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/ 2023-07-14T12:36:56.116 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/ 2023-07-14T12:36:56.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 69449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-14T12:36:56.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 61489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-14T12:36:56.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 141161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-14T12:36:56.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-14T12:36:56.116 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 62865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-14T12:36:56.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-14T12:36:56.117 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink/ 2023-07-14T12:36:56.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 60873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-14T12:36:56.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 62833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-14T12:36:56.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 45721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dnet.ko 2023-07-14T12:36:56.117 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25233 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ec_bhf.ko 2023-07-14T12:36:56.117 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex/ 2023-07-14T12:36:56.117 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex/benet/ 2023-07-14T12:36:56.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 281329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-14T12:36:56.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ethoc.ko 2023-07-14T12:36:56.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/fealnx.ko 2023-07-14T12:36:56.118 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/fujitsu/ 2023-07-14T12:36:56.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 45281 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-07-14T12:36:56.118 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ 2023-07-14T12:36:56.118 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 90465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-14T12:36:56.118 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000/ 2023-07-14T12:36:56.119 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 295713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-14T12:36:56.119 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000e/ 2023-07-14T12:36:56.119 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 584249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-14T12:36:56.119 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/fm10k/ 2023-07-14T12:36:56.119 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 246321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-14T12:36:56.119 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/i40e/ 2023-07-14T12:36:56.119 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 923969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-14T12:36:56.119 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/iavf/ 2023-07-14T12:36:56.120 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 298097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-14T12:36:56.120 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igb/ 2023-07-14T12:36:56.120 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 514889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-14T12:36:56.120 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igbvf/ 2023-07-14T12:36:56.120 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 93593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-14T12:36:56.120 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-07-14T12:36:56.120 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 734297 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-14T12:36:56.121 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-07-14T12:36:56.121 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 151841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-14T12:36:56.121 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 86921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/jme.ko 2023-07-14T12:36:56.121 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/ 2023-07-14T12:36:56.121 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20977 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-14T12:36:56.121 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 102385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-14T12:36:56.121 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 122681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-14T12:36:56.121 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/ 2023-07-14T12:36:56.122 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-07-14T12:36:56.122 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 727433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-14T12:36:56.122 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 280513 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-14T12:36:56.122 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-07-14T12:36:56.122 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-07-14T12:36:56.122 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1095817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-14T12:36:56.122 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/micrel/ 2023-07-14T12:36:56.122 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53041 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-07-14T12:36:56.123 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-07-14T12:36:56.123 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-07-14T12:36:56.123 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 95665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-14T12:36:56.123 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom/ 2023-07-14T12:36:56.123 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-07-14T12:36:56.123 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 108809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-14T12:36:56.123 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi/ 2023-07-14T12:36:56.123 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 73377 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-14T12:36:56.124 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-14T12:36:56.124 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/neterion/ 2023-07-14T12:36:56.124 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 150905 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-14T12:36:56.124 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/nvidia/ 2023-07-14T12:36:56.124 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 136785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-14T12:36:56.124 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines/ 2023-07-14T12:36:56.124 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50481 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-14T12:36:56.125 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-14T12:36:56.125 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/ 2023-07-14T12:36:56.125 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-07-14T12:36:56.125 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 227113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-14T12:36:56.125 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 87081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-14T12:36:56.125 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-07-14T12:36:56.125 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 671393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-14T12:36:56.125 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rdc/ 2023-07-14T12:36:56.126 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-14T12:36:56.126 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/ 2023-07-14T12:36:56.126 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 67385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-14T12:36:56.126 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 83921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-14T12:36:56.126 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-14T12:36:56.126 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 190089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-14T12:36:56.126 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/samsung/ 2023-07-14T12:36:56.126 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-07-14T12:36:56.127 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 104241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-07-14T12:36:56.127 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sfc/ 2023-07-14T12:36:56.127 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 952881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-14T12:36:56.127 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/silan/ 2023-07-14T12:36:56.127 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47177 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-14T12:36:56.127 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis/ 2023-07-14T12:36:56.127 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 54809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-14T12:36:56.127 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 63273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-14T12:36:56.128 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/ 2023-07-14T12:36:56.128 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 61537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-14T12:36:56.128 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 67129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-14T12:36:56.128 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 73345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-14T12:36:56.128 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 68209 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-14T12:36:56.128 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/ 2023-07-14T12:36:56.128 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-07-14T12:36:56.128 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-07-14T12:36:56.129 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40137 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-14T12:36:56.129 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20769 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-07-14T12:36:56.129 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 481681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-14T12:36:56.129 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/ 2023-07-14T12:36:56.129 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 103321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-14T12:36:56.129 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 166121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-14T12:36:56.129 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-14T12:36:56.130 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 78737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-14T12:36:56.130 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/tehuti/ 2023-07-14T12:36:56.130 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-14T12:36:56.130 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ti/ 2023-07-14T12:36:56.130 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 86465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-14T12:36:56.130 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via/ 2023-07-14T12:36:56.130 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 80257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-14T12:36:56.130 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 83681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-14T12:36:56.131 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet/ 2023-07-14T12:36:56.131 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 46241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-14T12:36:56.131 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-14T12:36:56.131 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/xircom/ 2023-07-14T12:36:56.131 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 60041 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-14T12:36:56.131 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/fddi/ 2023-07-14T12:36:56.131 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/fddi/defxx.ko 2023-07-14T12:36:56.131 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/fddi/skfp/ 2023-07-14T12:36:56.132 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 216977 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/fddi/skfp/skfp.ko 2023-07-14T12:36:56.132 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 77401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/geneve.ko 2023-07-14T12:36:56.132 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/hyperv/ 2023-07-14T12:36:56.132 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 235593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-14T12:36:56.132 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ieee802154/ 2023-07-14T12:36:56.132 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-14T12:36:56.132 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ifb.ko 2023-07-14T12:36:56.132 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ipvlan/ 2023-07-14T12:36:56.133 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 83737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-14T12:36:56.133 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 62065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/macvlan.ko 2023-07-14T12:36:56.133 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/macvtap.ko 2023-07-14T12:36:56.133 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/ 2023-07-14T12:36:56.133 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-14T12:36:56.133 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-14T12:36:56.133 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-gpio.ko 2023-07-14T12:36:56.133 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-regmap.ko 2023-07-14T12:36:56.134 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16025 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio.ko 2023-07-14T12:36:56.134 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20513 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mii.ko 2023-07-14T12:36:56.134 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41697 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/netconsole.ko 2023-07-14T12:36:56.134 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/nlmon.ko 2023-07-14T12:36:56.134 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs/ 2023-07-14T12:36:56.134 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs/pcs-lynx.ko 2023-07-14T12:36:56.134 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-14T12:36:56.135 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/ 2023-07-14T12:36:56.135 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/amd.ko 2023-07-14T12:36:56.135 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-14T12:36:56.135 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-14T12:36:56.135 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm87xx.ko 2023-07-14T12:36:56.135 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/broadcom.ko 2023-07-14T12:36:56.135 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10561 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/cicada.ko 2023-07-14T12:36:56.135 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/davicom.ko 2023-07-14T12:36:56.136 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/et1011c.ko 2023-07-14T12:36:56.136 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24905 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/icplus.ko 2023-07-14T12:36:56.136 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/lxt.ko 2023-07-14T12:36:56.136 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 78185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/marvell.ko 2023-07-14T12:36:56.136 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 75713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/micrel.ko 2023-07-14T12:36:56.136 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12033 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/national.ko 2023-07-14T12:36:56.136 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 97265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/phylink.ko 2023-07-14T12:36:56.136 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/qsemi.ko 2023-07-14T12:36:56.137 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/realtek.ko 2023-07-14T12:36:56.137 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/smsc.ko 2023-07-14T12:36:56.137 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/ste10Xp.ko 2023-07-14T12:36:56.137 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24033 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/vitesse.ko 2023-07-14T12:36:56.137 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/plip/ 2023-07-14T12:36:56.137 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/plip/plip.ko 2023-07-14T12:36:56.137 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ 2023-07-14T12:36:56.138 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-14T12:36:56.138 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_async.ko 2023-07-14T12:36:56.138 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-14T12:36:56.138 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-14T12:36:56.138 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28945 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-14T12:36:56.138 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pppoe.ko 2023-07-14T12:36:56.138 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pppox.ko 2023-07-14T12:36:56.138 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pptp.ko 2023-07-14T12:36:56.139 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/sb1000.ko 2023-07-14T12:36:56.139 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip/ 2023-07-14T12:36:56.139 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42513 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip/slip.ko 2023-07-14T12:36:56.139 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/sungem_phy.ko 2023-07-14T12:36:56.139 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 64889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/tap.ko 2023-07-14T12:36:56.139 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/ 2023-07-14T12:36:56.139 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 105961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team.ko 2023-07-14T12:36:56.139 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-14T12:36:56.140 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10209 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-14T12:36:56.140 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-14T12:36:56.140 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9641 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_random.ko 2023-07-14T12:36:56.140 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-14T12:36:56.140 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 88193 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/veth.ko 2023-07-14T12:36:56.140 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vmxnet3/ 2023-07-14T12:36:56.140 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 120497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-14T12:36:56.140 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vxlan/ 2023-07-14T12:36:56.141 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 290665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vxlan/vxlan.ko 2023-07-14T12:36:56.141 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netback/ 2023-07-14T12:36:56.141 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 143801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-14T12:36:56.141 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ntb/ 2023-07-14T12:36:56.141 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ntb/ntb.ko 2023-07-14T12:36:56.141 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/ 2023-07-14T12:36:56.141 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host/ 2023-07-14T12:36:56.142 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 266561 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host/nvme-core.ko 2023-07-14T12:36:56.142 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 101937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host/nvme.ko 2023-07-14T12:36:56.142 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/ 2023-07-14T12:36:56.142 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 133817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport.ko 2023-07-14T12:36:56.142 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14561 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_cs.ko 2023-07-14T12:36:56.142 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 84337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_pc.ko 2023-07-14T12:36:56.142 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_serial.ko 2023-07-14T12:36:56.142 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/ 2023-07-14T12:36:56.143 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/hotplug/ 2023-07-14T12:36:56.143 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25009 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-14T12:36:56.143 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-07-14T12:36:56.143 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20137 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-07-14T12:36:56.143 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/pci-stub.ko 2023-07-14T12:36:56.143 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47377 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/xen-pcifront.ko 2023-07-14T12:36:56.143 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/ 2023-07-14T12:36:56.143 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/i82092.ko 2023-07-14T12:36:56.144 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 145785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/pcmcia.ko 2023-07-14T12:36:56.144 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 62081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/pcmcia_core.ko 2023-07-14T12:36:56.144 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-07-14T12:36:56.144 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/pd6729.ko 2023-07-14T12:36:56.144 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 112913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-14T12:36:56.144 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/phy/ 2023-07-14T12:36:56.144 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/phy/broadcom/ 2023-07-14T12:36:56.144 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-07-14T12:36:56.145 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/phy/samsung/ 2023-07-14T12:36:56.145 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-07-14T12:36:56.145 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl/ 2023-07-14T12:36:56.145 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl/intel/ 2023-07-14T12:36:56.145 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 71521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-14T12:36:56.145 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/ 2023-07-14T12:36:56.145 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/chrome/ 2023-07-14T12:36:56.146 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-07-14T12:36:56.146 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/chrome/cros_ec.ko 2023-07-14T12:36:56.146 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-07-14T12:36:56.146 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-07-14T12:36:56.146 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-07-14T12:36:56.146 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18201 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-07-14T12:36:56.146 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-07-14T12:36:56.146 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/ 2023-07-14T12:36:56.147 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 67097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-14T12:36:56.147 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/acerhdf.ko 2023-07-14T12:36:56.147 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-14T12:36:56.147 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-14T12:36:56.147 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-14T12:36:56.147 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 106873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-14T12:36:56.147 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-14T12:36:56.147 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-14T12:36:56.148 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-14T12:36:56.148 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-14T12:36:56.148 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-14T12:36:56.148 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/hdaps.ko 2023-07-14T12:36:56.148 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/ibm_rtl.ko 2023-07-14T12:36:56.148 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel/ 2023-07-14T12:36:56.148 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-14T12:36:56.148 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-07-14T12:36:56.149 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel_ips.ko 2023-07-14T12:36:56.149 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-14T12:36:56.149 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10377 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-14T12:36:56.149 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-14T12:36:56.149 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-14T12:36:56.149 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-14T12:36:56.149 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-14T12:36:56.149 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-14T12:36:56.150 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-14T12:36:56.150 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-14T12:36:56.150 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 57665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/wmi.ko 2023-07-14T12:36:56.150 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/ 2023-07-14T12:36:56.150 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/ 2023-07-14T12:36:56.150 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/88pm860x_battery.ko 2023-07-14T12:36:56.150 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/88pm860x_charger.ko 2023-07-14T12:36:56.151 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 55057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/bq2415x_charger.ko 2023-07-14T12:36:56.151 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/bq24190_charger.ko 2023-07-14T12:36:56.151 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/bq24735-charger.ko 2023-07-14T12:36:56.151 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-07-14T12:36:56.151 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19609 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/da9030_battery.ko 2023-07-14T12:36:56.151 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/da9052-battery.ko 2023-07-14T12:36:56.151 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29281 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/ds2760_battery.ko 2023-07-14T12:36:56.151 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23217 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/ds2780_battery.ko 2023-07-14T12:36:56.152 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23353 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/ds2781_battery.ko 2023-07-14T12:36:56.152 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/ds2782_battery.ko 2023-07-14T12:36:56.152 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20353 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/gpio-charger.ko 2023-07-14T12:36:56.152 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18041 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/isp1704_charger.ko 2023-07-14T12:36:56.152 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/lp8727_charger.ko 2023-07-14T12:36:56.152 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12577 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/max14577_charger.ko 2023-07-14T12:36:56.152 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/max17040_battery.ko 2023-07-14T12:36:56.152 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30289 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/max17042_battery.ko 2023-07-14T12:36:56.153 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/max8903_charger.ko 2023-07-14T12:36:56.153 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/max8925_power.ko 2023-07-14T12:36:56.153 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/pcf50633-charger.ko 2023-07-14T12:36:56.153 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38009 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/sbs-battery.ko 2023-07-14T12:36:56.153 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/test_power.ko 2023-07-14T12:36:56.153 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/tps65090-charger.ko 2023-07-14T12:36:56.153 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/wm831x_backup.ko 2023-07-14T12:36:56.153 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/wm831x_power.ko 2023-07-14T12:36:56.154 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/wm8350_power.ko 2023-07-14T12:36:56.154 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap/ 2023-07-14T12:36:56.154 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 57737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-14T12:36:56.154 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-14T12:36:56.154 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/ 2023-07-14T12:36:56.154 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/ 2023-07-14T12:36:56.154 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-14T12:36:56.155 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-14T12:36:56.155 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps_parport.ko 2023-07-14T12:36:56.155 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/pps_core.ko 2023-07-14T12:36:56.155 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp/ 2023-07-14T12:36:56.155 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp/ptp.ko 2023-07-14T12:36:56.155 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp/ptp_kvm.ko 2023-07-14T12:36:56.155 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/ 2023-07-14T12:36:56.155 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-88pm80x.ko 2023-07-14T12:36:56.156 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-88pm860x.ko 2023-07-14T12:36:56.156 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-14T12:36:56.156 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-14T12:36:56.156 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-da9052.ko 2023-07-14T12:36:56.156 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-da9055.ko 2023-07-14T12:36:56.156 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20177 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-da9063.ko 2023-07-14T12:36:56.156 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-14T12:36:56.156 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 68577 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-14T12:36:56.157 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-14T12:36:56.157 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18217 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-14T12:36:56.157 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-14T12:36:56.157 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-14T12:36:56.157 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13369 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-14T12:36:56.157 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-14T12:36:56.157 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-14T12:36:56.157 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-em3027.ko 2023-07-14T12:36:56.158 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-14T12:36:56.158 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-14T12:36:56.158 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-14T12:36:56.158 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-lp8788.ko 2023-07-14T12:36:56.158 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-14T12:36:56.158 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-14T12:36:56.158 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25945 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-14T12:36:56.158 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14177 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m48t86.ko 2023-07-14T12:36:56.159 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11633 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-max6900.ko 2023-07-14T12:36:56.159 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-max8907.ko 2023-07-14T12:36:56.159 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15409 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-max8925.ko 2023-07-14T12:36:56.159 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-max8997.ko 2023-07-14T12:36:56.159 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-max8998.ko 2023-07-14T12:36:56.159 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18513 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-07-14T12:36:56.159 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11409 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-14T12:36:56.160 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-palmas.ko 2023-07-14T12:36:56.160 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-14T12:36:56.160 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17977 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf50633.ko 2023-07-14T12:36:56.160 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-14T12:36:56.160 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-14T12:36:56.160 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-14T12:36:56.160 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-14T12:36:56.160 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18033 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rc5t583.ko 2023-07-14T12:36:56.161 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-14T12:36:56.161 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-14T12:36:56.161 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-14T12:36:56.161 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-14T12:36:56.161 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-14T12:36:56.161 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-s35390a.ko 2023-07-14T12:36:56.161 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-14T12:36:56.161 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-tps6586x.ko 2023-07-14T12:36:56.162 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-tps65910.ko 2023-07-14T12:36:56.162 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-wm831x.ko 2023-07-14T12:36:56.162 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-wm8350.ko 2023-07-14T12:36:56.162 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-x1205.ko 2023-07-14T12:36:56.162 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ 2023-07-14T12:36:56.162 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 77617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-9xxx.ko 2023-07-14T12:36:56.162 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 57665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-sas.ko 2023-07-14T12:36:56.162 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 55169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-xxxx.ko 2023-07-14T12:36:56.163 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 135169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/BusLogic.ko 2023-07-14T12:36:56.163 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/a100u2w.ko 2023-07-14T12:36:56.163 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aacraid/ 2023-07-14T12:36:56.163 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 272353 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-14T12:36:56.163 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 100617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/advansys.ko 2023-07-14T12:36:56.163 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx/ 2023-07-14T12:36:56.163 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 356265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-14T12:36:56.163 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 295801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-14T12:36:56.164 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic94xx/ 2023-07-14T12:36:56.164 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 189321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-07-14T12:36:56.164 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/am53c974.ko 2023-07-14T12:36:56.164 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/arcmsr/ 2023-07-14T12:36:56.164 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 106569 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-14T12:36:56.164 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/atp870u.ko 2023-07-14T12:36:56.164 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/be2iscsi/ 2023-07-14T12:36:56.165 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 246897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-14T12:36:56.165 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bfa/ 2023-07-14T12:36:56.165 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1172185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bfa/bfa.ko 2023-07-14T12:36:56.165 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2fc/ 2023-07-14T12:36:56.165 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 237169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-14T12:36:56.165 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2i/ 2023-07-14T12:36:56.165 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 115393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-14T12:36:56.165 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40609 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ch.ko 2023-07-14T12:36:56.166 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/csiostor/ 2023-07-14T12:36:56.166 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 308889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-14T12:36:56.166 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/ 2023-07-14T12:36:56.166 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-07-14T12:36:56.166 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 76193 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-14T12:36:56.166 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-07-14T12:36:56.166 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 101449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-14T12:36:56.166 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 146785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-14T12:36:56.167 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 75529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/dc395x.ko 2023-07-14T12:36:56.167 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/dmx3191d.ko 2023-07-14T12:36:56.167 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esas2r/ 2023-07-14T12:36:56.167 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 212401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-14T12:36:56.167 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 60489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esp_scsi.ko 2023-07-14T12:36:56.167 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe/ 2023-07-14T12:36:56.167 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 78289 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-14T12:36:56.167 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 158193 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-14T12:36:56.168 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18945 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fdomain.ko 2023-07-14T12:36:56.168 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fnic/ 2023-07-14T12:36:56.168 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 261913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fnic/fnic.ko 2023-07-14T12:36:56.168 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 201793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hpsa.ko 2023-07-14T12:36:56.168 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hptiop.ko 2023-07-14T12:36:56.168 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hv_storvsc.ko 2023-07-14T12:36:56.168 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/imm.ko 2023-07-14T12:36:56.168 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/initio.ko 2023-07-14T12:36:56.169 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 266521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ipr.ko 2023-07-14T12:36:56.169 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 101881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ips.ko 2023-07-14T12:36:56.169 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/isci/ 2023-07-14T12:36:56.169 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 317249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/isci/isci.ko 2023-07-14T12:36:56.169 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26361 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-14T12:36:56.169 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 52897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-14T12:36:56.169 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libfc/ 2023-07-14T12:36:56.169 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 314961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libfc/libfc.ko 2023-07-14T12:36:56.170 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 145569 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libiscsi.ko 2023-07-14T12:36:56.170 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-14T12:36:56.170 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libsas/ 2023-07-14T12:36:56.170 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 217209 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libsas/libsas.ko 2023-07-14T12:36:56.170 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/lpfc/ 2023-07-14T12:36:56.170 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 2192449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-14T12:36:56.170 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/ 2023-07-14T12:36:56.171 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 73545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-14T12:36:56.171 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33569 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-14T12:36:56.171 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 310729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-14T12:36:56.171 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 84697 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid.ko 2023-07-14T12:36:56.171 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mpt3sas/ 2023-07-14T12:36:56.171 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 659577 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-14T12:36:56.171 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvsas/ 2023-07-14T12:36:56.171 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 119929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-14T12:36:56.172 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 78153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvumi.ko 2023-07-14T12:36:56.172 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pcmcia/ 2023-07-14T12:36:56.172 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 81601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-07-14T12:36:56.172 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-07-14T12:36:56.172 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-07-14T12:36:56.172 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-07-14T12:36:56.172 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pm8001/ 2023-07-14T12:36:56.172 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 364257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-14T12:36:56.173 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 123489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pmcraid.ko 2023-07-14T12:36:56.173 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ppa.ko 2023-07-14T12:36:56.173 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 55345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla1280.ko 2023-07-14T12:36:56.173 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx/ 2023-07-14T12:36:56.173 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1860025 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-14T12:36:56.173 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 85313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-14T12:36:56.173 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla4xxx/ 2023-07-14T12:36:56.173 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 558865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-14T12:36:56.174 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19025 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qlogicfas408.ko 2023-07-14T12:36:56.174 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/raid_class.ko 2023-07-14T12:36:56.174 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 238801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_debug.ko 2023-07-14T12:36:56.174 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 173921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-14T12:36:56.174 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 278865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-14T12:36:56.175 INFO:teuthology.orchestra.run.smithi154.stderr:Sourcing file `/etc/default/grub' 2023-07-14T12:36:56.175 INFO:teuthology.orchestra.run.smithi154.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-14T12:36:56.180 INFO:teuthology.orchestra.run.smithi154.stderr:Generating grub configuration file ... 2023-07-14T12:36:56.233 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 97705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-14T12:36:56.234 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 73881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-14T12:36:56.234 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-14T12:36:56.234 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ses.ko 2023-07-14T12:36:56.234 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 115849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/st.ko 2023-07-14T12:36:56.234 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 46825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/stex.ko 2023-07-14T12:36:56.235 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/sym53c8xx_2/ 2023-07-14T12:36:56.235 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 162121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-14T12:36:56.235 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42361 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/virtio_scsi.ko 2023-07-14T12:36:56.235 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50297 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-14T12:36:56.235 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/wd719x.ko 2023-07-14T12:36:56.235 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50025 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/xen-scsifront.ko 2023-07-14T12:36:56.235 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ssb/ 2023-07-14T12:36:56.236 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 129417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ssb/ssb.ko 2023-07-14T12:36:56.236 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/ 2023-07-14T12:36:56.236 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/iscsi/ 2023-07-14T12:36:56.236 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 739089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-14T12:36:56.236 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/loopback/ 2023-07-14T12:36:56.236 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-14T12:36:56.236 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_file.ko 2023-07-14T12:36:56.236 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_iblock.ko 2023-07-14T12:36:56.237 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 931721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_mod.ko 2023-07-14T12:36:56.237 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_pscsi.ko 2023-07-14T12:36:56.237 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 122545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_user.ko 2023-07-14T12:36:56.237 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/tcm_fc/ 2023-07-14T12:36:56.237 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 75641 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-14T12:36:56.237 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/ 2023-07-14T12:36:56.237 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/ 2023-07-14T12:36:56.238 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/ 2023-07-14T12:36:56.238 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23481 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-14T12:36:56.238 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-14T12:36:56.238 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-14T12:36:56.238 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-14T12:36:56.238 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-14T12:36:56.238 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-14T12:36:56.238 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-14T12:36:56.239 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20281 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-14T12:36:56.239 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-14T12:36:56.239 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-14T12:36:56.239 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-14T12:36:56.239 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-14T12:36:56.239 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-07-14T12:36:56.239 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-14T12:36:56.239 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-14T12:36:56.240 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-14T12:36:56.240 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/ 2023-07-14T12:36:56.240 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/ipwireless/ 2023-07-14T12:36:56.240 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 78073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-14T12:36:56.240 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 57881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/moxa.ko 2023-07-14T12:36:56.240 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 50793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/mxser.ko 2023-07-14T12:36:56.240 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 107545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/n_gsm.ko 2023-07-14T12:36:56.241 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32041 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/n_hdlc.ko 2023-07-14T12:36:56.241 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 68137 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/nozomi.ko 2023-07-14T12:36:56.241 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/ 2023-07-14T12:36:56.241 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/8250/ 2023-07-14T12:36:56.241 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-07-14T12:36:56.241 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-14T12:36:56.242 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18209 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-07-14T12:36:56.242 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/altera_uart.ko 2023-07-14T12:36:56.242 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/arc_uart.ko 2023-07-14T12:36:56.242 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 72193 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-07-14T12:36:56.242 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/jsm/ 2023-07-14T12:36:56.242 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 103017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-14T12:36:56.242 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/rp2.ko 2023-07-14T12:36:56.243 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 52073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/sc16is7xx.ko 2023-07-14T12:36:56.243 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 100185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/synclink_gt.ko 2023-07-14T12:36:56.243 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/ 2023-07-14T12:36:56.243 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/core/ 2023-07-14T12:36:56.243 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 536617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-14T12:36:56.243 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/host/ 2023-07-14T12:36:56.243 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28377 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-14T12:36:56.244 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-07-14T12:36:56.244 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/ 2023-07-14T12:36:56.244 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio.ko 2023-07-14T12:36:56.244 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_aec.ko 2023-07-14T12:36:56.244 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11281 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_cif.ko 2023-07-14T12:36:56.244 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_dmem_genirq.ko 2023-07-14T12:36:56.244 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_mf624.ko 2023-07-14T12:36:56.245 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12177 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_netx.ko 2023-07-14T12:36:56.245 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_pci_generic.ko 2023-07-14T12:36:56.245 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-07-14T12:36:56.245 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13633 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_sercos3.ko 2023-07-14T12:36:56.245 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/ 2023-07-14T12:36:56.246 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/c67x00/ 2023-07-14T12:36:56.246 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 73273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/c67x00/c67x00.ko 2023-07-14T12:36:56.246 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/chipidea/ 2023-07-14T12:36:56.246 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 143785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-07-14T12:36:56.246 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-07-14T12:36:56.246 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-07-14T12:36:56.246 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-07-14T12:36:56.246 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/ 2023-07-14T12:36:56.247 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 85457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/cdc-acm.ko 2023-07-14T12:36:56.247 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-14T12:36:56.247 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/usblp.ko 2023-07-14T12:36:56.247 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 89833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/usbtmc.ko 2023-07-14T12:36:56.247 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/common/ 2023-07-14T12:36:56.248 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/common/ulpi.ko 2023-07-14T12:36:56.248 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/dwc2/ 2023-07-14T12:36:56.248 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-07-14T12:36:56.248 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/dwc3/ 2023-07-14T12:36:56.248 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-07-14T12:36:56.248 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-07-14T12:36:56.248 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 445801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/dwc3/dwc3.ko 2023-07-14T12:36:56.249 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/ 2023-07-14T12:36:56.249 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/ 2023-07-14T12:36:56.249 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 60089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/u_ether.ko 2023-07-14T12:36:56.249 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/u_serial.ko 2023-07-14T12:36:56.249 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-07-14T12:36:56.249 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-07-14T12:36:56.249 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-07-14T12:36:56.250 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-07-14T12:36:56.250 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 92377 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-07-14T12:36:56.250 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51025 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-07-14T12:36:56.250 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 122073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-07-14T12:36:56.250 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 57921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-07-14T12:36:56.250 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-07-14T12:36:56.250 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-07-14T12:36:56.251 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 57705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-07-14T12:36:56.251 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 85841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-07-14T12:36:56.251 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-07-14T12:36:56.251 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 58433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-07-14T12:36:56.251 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 67337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-07-14T12:36:56.251 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/ 2023-07-14T12:36:56.251 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-07-14T12:36:56.251 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-07-14T12:36:56.252 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-07-14T12:36:56.252 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-07-14T12:36:56.252 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-07-14T12:36:56.252 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-07-14T12:36:56.252 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20409 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-07-14T12:36:56.252 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16977 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-07-14T12:36:56.252 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-07-14T12:36:56.253 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-07-14T12:36:56.253 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-07-14T12:36:56.253 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27201 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-07-14T12:36:56.253 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 62153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-07-14T12:36:56.253 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15201 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-07-14T12:36:56.253 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 161233 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/libcomposite.ko 2023-07-14T12:36:56.253 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/ 2023-07-14T12:36:56.253 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-07-14T12:36:56.254 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/bdc/ 2023-07-14T12:36:56.254 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 157665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-07-14T12:36:56.254 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-07-14T12:36:56.254 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 52993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-07-14T12:36:56.254 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 69689 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-07-14T12:36:56.254 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 56009 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-07-14T12:36:56.254 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 76033 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/net2272.ko 2023-07-14T12:36:56.254 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 75057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/net2280.ko 2023-07-14T12:36:56.255 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 73153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-07-14T12:36:56.255 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 65793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-07-14T12:36:56.255 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-07-14T12:36:56.255 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 81489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-07-14T12:36:56.255 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 156033 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-07-14T12:36:56.255 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host/ 2023-07-14T12:36:56.255 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host/bcma-hcd.ko 2023-07-14T12:36:56.255 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 80097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host/isp116x-hcd.ko 2023-07-14T12:36:56.256 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 87337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-07-14T12:36:56.256 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 78849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-07-14T12:36:56.256 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-14T12:36:56.256 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host/sl811_cs.ko 2023-07-14T12:36:56.256 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host/ssb-hcd.ko 2023-07-14T12:36:56.256 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25945 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-07-14T12:36:56.256 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image/ 2023-07-14T12:36:56.257 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image/mdc800.ko 2023-07-14T12:36:56.257 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image/microtek.ko 2023-07-14T12:36:56.257 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/ 2023-07-14T12:36:56.257 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/adutux.ko 2023-07-14T12:36:56.257 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/appledisplay.ko 2023-07-14T12:36:56.257 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-07-14T12:36:56.257 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/cytherm.ko 2023-07-14T12:36:56.257 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/ehset.ko 2023-07-14T12:36:56.258 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/emi26.ko 2023-07-14T12:36:56.258 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/emi62.ko 2023-07-14T12:36:56.258 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/ezusb.ko 2023-07-14T12:36:56.258 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19297 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/idmouse.ko 2023-07-14T12:36:56.258 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/iowarrior.ko 2023-07-14T12:36:56.258 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-14T12:36:56.258 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/ldusb.ko 2023-07-14T12:36:56.258 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/legousbtower.ko 2023-07-14T12:36:56.259 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/lvstest.ko 2023-07-14T12:36:56.259 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/sisusbvga/ 2023-07-14T12:36:56.259 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 64841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-14T12:36:56.259 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-14T12:36:56.259 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usb3503.ko 2023-07-14T12:36:56.259 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usblcd.ko 2023-07-14T12:36:56.259 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-14T12:36:56.259 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 70873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usbtest.ko 2023-07-14T12:36:56.260 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41945 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/uss720.ko 2023-07-14T12:36:56.260 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/yurex.ko 2023-07-14T12:36:56.260 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/mon/ 2023-07-14T12:36:56.260 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 73185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/mon/usbmon.ko 2023-07-14T12:36:56.260 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/musb/ 2023-07-14T12:36:56.260 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 301521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/musb/musb_hdrc.ko 2023-07-14T12:36:56.260 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/phy/ 2023-07-14T12:36:56.261 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/phy/phy-generic.ko 2023-07-14T12:36:56.261 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20177 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-07-14T12:36:56.261 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/phy/phy-isp1301.ko 2023-07-14T12:36:56.261 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/phy/phy-tahvo.ko 2023-07-14T12:36:56.261 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ 2023-07-14T12:36:56.261 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/aircable.ko 2023-07-14T12:36:56.262 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ark3116.ko 2023-07-14T12:36:56.262 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-14T12:36:56.262 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ch341.ko 2023-07-14T12:36:56.262 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 70209 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cp210x.ko 2023-07-14T12:36:56.262 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cyberjack.ko 2023-07-14T12:36:56.262 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 57937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-14T12:36:56.262 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-14T12:36:56.262 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/empeg.ko 2023-07-14T12:36:56.263 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/f81232.ko 2023-07-14T12:36:56.263 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 175145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-14T12:36:56.263 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 52713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-14T12:36:56.263 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 137105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-14T12:36:56.263 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 124673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/io_ti.ko 2023-07-14T12:36:56.263 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 67769 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ipaq.ko 2023-07-14T12:36:56.263 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ipw.ko 2023-07-14T12:36:56.264 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ir-usb.ko 2023-07-14T12:36:56.264 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 57937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-14T12:36:56.264 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 107417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/keyspan.ko 2023-07-14T12:36:56.264 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-14T12:36:56.264 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-14T12:36:56.264 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-14T12:36:56.264 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mct_u232.ko 2023-07-14T12:36:56.265 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/metro-usb.ko 2023-07-14T12:36:56.265 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mos7720.ko 2023-07-14T12:36:56.265 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 78113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mos7840.ko 2023-07-14T12:36:56.265 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 56593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mxuport.ko 2023-07-14T12:36:56.265 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/navman.ko 2023-07-14T12:36:56.265 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/omninet.ko 2023-07-14T12:36:56.265 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24281 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/opticon.ko 2023-07-14T12:36:56.265 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 189729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/option.ko 2023-07-14T12:36:56.266 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38905 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/oti6858.ko 2023-07-14T12:36:56.266 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 54313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/pl2303.ko 2023-07-14T12:36:56.266 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/qcaux.ko 2023-07-14T12:36:56.266 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/qcserial.ko 2023-07-14T12:36:56.266 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34561 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/quatech2.ko 2023-07-14T12:36:56.266 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/safe_serial.ko 2023-07-14T12:36:56.266 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 51297 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/sierra.ko 2023-07-14T12:36:56.267 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-14T12:36:56.267 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ssu100.ko 2023-07-14T12:36:56.267 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/symbolserial.ko 2023-07-14T12:36:56.267 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 61337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-14T12:36:56.267 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-14T12:36:56.267 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb_debug.ko 2023-07-14T12:36:56.267 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-14T12:36:56.267 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 125505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usbserial.ko 2023-07-14T12:36:56.268 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/visor.ko 2023-07-14T12:36:56.268 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37409 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/whiteheat.ko 2023-07-14T12:36:56.268 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/wishbone-serial.ko 2023-07-14T12:36:56.268 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9289 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-14T12:36:56.268 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ 2023-07-14T12:36:56.268 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 52913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/uas.ko 2023-07-14T12:36:56.268 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-14T12:36:56.268 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-14T12:36:56.269 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-14T12:36:56.269 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-14T12:36:56.269 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-14T12:36:56.269 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19769 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-14T12:36:56.269 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19361 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-14T12:36:56.269 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-karma.ko 2023-07-14T12:36:56.269 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-14T12:36:56.270 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-14T12:36:56.270 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28905 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-14T12:36:56.270 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-14T12:36:56.270 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-14T12:36:56.270 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 180017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/usb-storage.ko 2023-07-14T12:36:56.270 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/ 2023-07-14T12:36:56.270 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 67457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-14T12:36:56.270 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 71345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-14T12:36:56.271 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 105401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-14T12:36:56.271 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/ 2023-07-14T12:36:56.271 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci/ 2023-07-14T12:36:56.271 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 153697 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-14T12:36:56.271 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-14T12:36:56.271 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 100569 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/vfio.ko 2023-07-14T12:36:56.271 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 75137 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-14T12:36:56.271 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/ 2023-07-14T12:36:56.272 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 113889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost.ko 2023-07-14T12:36:56.272 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-14T12:36:56.272 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 58137 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_net.ko 2023-07-14T12:36:56.272 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 86521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_scsi.ko 2023-07-14T12:36:56.272 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/ 2023-07-14T12:36:56.272 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/ 2023-07-14T12:36:56.273 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-07-14T12:36:56.273 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/aat2870_bl.ko 2023-07-14T12:36:56.273 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/adp5520_bl.ko 2023-07-14T12:36:56.273 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32609 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/adp8860_bl.ko 2023-07-14T12:36:56.273 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/adp8870_bl.ko 2023-07-14T12:36:56.273 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/apple_bl.ko 2023-07-14T12:36:56.273 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16777 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/as3711_bl.ko 2023-07-14T12:36:56.273 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/bd6107.ko 2023-07-14T12:36:56.274 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11409 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/da903x_bl.ko 2023-07-14T12:36:56.274 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/da9052_bl.ko 2023-07-14T12:36:56.274 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11945 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/gpio_backlight.ko 2023-07-14T12:36:56.274 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14769 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/kb3886_bl.ko 2023-07-14T12:36:56.274 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/lcd.ko 2023-07-14T12:36:56.274 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/lm3533_bl.ko 2023-07-14T12:36:56.274 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/lm3639_bl.ko 2023-07-14T12:36:56.275 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/lv5207lp.ko 2023-07-14T12:36:56.275 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/max8925_bl.ko 2023-07-14T12:36:56.275 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/pandora_bl.ko 2023-07-14T12:36:56.275 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-07-14T12:36:56.275 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-14T12:36:56.275 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/wm831x_bl.ko 2023-07-14T12:36:56.275 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/ 2023-07-14T12:36:56.276 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters/ 2023-07-14T12:36:56.276 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters/ds2482.ko 2023-07-14T12:36:56.276 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters/ds2490.ko 2023-07-14T12:36:56.276 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters/matrox_w1.ko 2023-07-14T12:36:56.276 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters/w1-gpio.ko 2023-07-14T12:36:56.276 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/ 2023-07-14T12:36:56.276 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12041 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-14T12:36:56.277 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-14T12:36:56.277 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-14T12:36:56.277 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-14T12:36:56.277 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-14T12:36:56.277 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-14T12:36:56.277 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-14T12:36:56.277 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-14T12:36:56.278 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-14T12:36:56.278 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-14T12:36:56.278 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 56425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-14T12:36:56.278 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 102657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/wire.ko 2023-07-14T12:36:56.278 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ 2023-07-14T12:36:56.278 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/acquirewdt.ko 2023-07-14T12:36:56.278 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19977 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/advantechwdt.ko 2023-07-14T12:36:56.278 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18561 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-14T12:36:56.279 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-14T12:36:56.279 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/cpu5wdt.ko 2023-07-14T12:36:56.279 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/da9052_wdt.ko 2023-07-14T12:36:56.279 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12777 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/da9055_wdt.ko 2023-07-14T12:36:56.279 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17409 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/da9063_wdt.ko 2023-07-14T12:36:56.279 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/dw_wdt.ko 2023-07-14T12:36:56.279 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/eurotechwdt.ko 2023-07-14T12:36:56.280 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-14T12:36:56.280 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/hpwdt.ko 2023-07-14T12:36:56.280 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15577 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/i6300esb.ko 2023-07-14T12:36:56.280 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-14T12:36:56.280 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-14T12:36:56.280 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ib700wdt.ko 2023-07-14T12:36:56.280 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18689 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ibmasr.ko 2023-07-14T12:36:56.280 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-14T12:36:56.281 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-14T12:36:56.281 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/it87_wdt.ko 2023-07-14T12:36:56.281 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/kempld_wdt.ko 2023-07-14T12:36:56.281 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/machzwd.ko 2023-07-14T12:36:56.281 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/mena21_wdt.ko 2023-07-14T12:36:56.281 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13217 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-07-14T12:36:56.281 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/nv_tco.ko 2023-07-14T12:36:56.281 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-07-14T12:36:56.282 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/pc87413_wdt.ko 2023-07-14T12:36:56.282 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-14T12:36:56.282 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-14T12:36:56.282 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/retu_wdt.ko 2023-07-14T12:36:56.282 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-07-14T12:36:56.282 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-07-14T12:36:56.282 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-14T12:36:56.283 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sc1200wdt.ko 2023-07-14T12:36:56.283 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-14T12:36:56.283 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21577 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-07-14T12:36:56.283 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/softdog.ko 2023-07-14T12:36:56.283 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-14T12:36:56.283 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/twl4030_wdt.ko 2023-07-14T12:36:56.283 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/via_wdt.ko 2023-07-14T12:36:56.284 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-14T12:36:56.284 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-14T12:36:56.284 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25409 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-14T12:36:56.284 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/wafer5823wdt.ko 2023-07-14T12:36:56.284 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/wdt_pci.ko 2023-07-14T12:36:56.284 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/wm831x_wdt.ko 2023-07-14T12:36:56.284 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/wm8350_wdt.ko 2023-07-14T12:36:56.284 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15697 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/xen_wdt.ko 2023-07-14T12:36:56.285 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/ 2023-07-14T12:36:56.285 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-evtchn.ko 2023-07-14T12:36:56.285 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-gntalloc.ko 2023-07-14T12:36:56.285 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-gntdev.ko 2023-07-14T12:36:56.285 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-pciback/ 2023-07-14T12:36:56.285 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 176417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-14T12:36:56.285 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-privcmd.ko 2023-07-14T12:36:56.285 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 71321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-scsiback.ko 2023-07-14T12:36:56.286 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xenfs/ 2023-07-14T12:36:56.286 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-14T12:36:56.286 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ 2023-07-14T12:36:56.286 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/9p/ 2023-07-14T12:36:56.286 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 165697 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/9p/9p.ko 2023-07-14T12:36:56.286 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/adfs/ 2023-07-14T12:36:56.286 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 60881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/adfs/adfs.ko 2023-07-14T12:36:56.287 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/affs/ 2023-07-14T12:36:56.287 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 162617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/affs/affs.ko 2023-07-14T12:36:56.287 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/afs/ 2023-07-14T12:36:56.287 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 931937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/afs/kafs.ko 2023-07-14T12:36:56.287 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/autofs/ 2023-07-14T12:36:56.287 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 100937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/autofs/autofs4.ko 2023-07-14T12:36:56.287 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/befs/ 2023-07-14T12:36:56.287 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 64481 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/befs/befs.ko 2023-07-14T12:36:56.288 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/bfs/ 2023-07-14T12:36:56.288 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/bfs/bfs.ko 2023-07-14T12:36:56.288 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/binfmt_misc.ko 2023-07-14T12:36:56.288 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/btrfs/ 2023-07-14T12:36:56.288 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 3468681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/btrfs/btrfs.ko 2023-07-14T12:36:56.288 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cachefiles/ 2023-07-14T12:36:56.288 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 305745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cachefiles/cachefiles.ko 2023-07-14T12:36:56.289 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ceph/ 2023-07-14T12:36:56.289 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1312521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ceph/ceph.ko 2023-07-14T12:36:56.289 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/coda/ 2023-07-14T12:36:56.289 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 100321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/coda/coda.ko 2023-07-14T12:36:56.289 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/configfs/ 2023-07-14T12:36:56.289 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 108073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/configfs/configfs.ko 2023-07-14T12:36:56.289 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cramfs/ 2023-07-14T12:36:56.289 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cramfs/cramfs.ko 2023-07-14T12:36:56.290 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/dlm/ 2023-07-14T12:36:56.290 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 633825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/dlm/dlm.ko 2023-07-14T12:36:56.290 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/efs/ 2023-07-14T12:36:56.290 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/efs/efs.ko 2023-07-14T12:36:56.290 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/f2fs/ 2023-07-14T12:36:56.290 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1500513 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/f2fs/f2fs.ko 2023-07-14T12:36:56.290 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/ 2023-07-14T12:36:56.290 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/msdos.ko 2023-07-14T12:36:56.291 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/freevxfs/ 2023-07-14T12:36:56.291 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/freevxfs/freevxfs.ko 2023-07-14T12:36:56.291 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fscache/ 2023-07-14T12:36:56.291 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 226505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fscache/fscache.ko 2023-07-14T12:36:56.291 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse/ 2023-07-14T12:36:56.291 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse/cuse.ko 2023-07-14T12:36:56.291 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/gfs2/ 2023-07-14T12:36:56.291 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1226249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/gfs2/gfs2.ko 2023-07-14T12:36:56.292 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfs/ 2023-07-14T12:36:56.292 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 141241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfs/hfs.ko 2023-07-14T12:36:56.292 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfsplus/ 2023-07-14T12:36:56.292 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 221553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfsplus/hfsplus.ko 2023-07-14T12:36:56.292 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hpfs/ 2023-07-14T12:36:56.292 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 193577 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hpfs/hpfs.ko 2023-07-14T12:36:56.292 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/isofs/ 2023-07-14T12:36:56.293 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 74393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/isofs/isofs.ko 2023-07-14T12:36:56.293 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/jfs/ 2023-07-14T12:36:56.293 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 420745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/jfs/jfs.ko 2023-07-14T12:36:56.293 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/lockd/ 2023-07-14T12:36:56.293 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 279041 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/lockd/lockd.ko 2023-07-14T12:36:56.293 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/minix/ 2023-07-14T12:36:56.293 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 87897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/minix/minix.ko 2023-07-14T12:36:56.293 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/netfs/ 2023-07-14T12:36:56.294 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 124697 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/netfs/netfs.ko 2023-07-14T12:36:56.294 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/ 2023-07-14T12:36:56.294 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/blocklayout/ 2023-07-14T12:36:56.294 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 81521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-14T12:36:56.294 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/filelayout/ 2023-07-14T12:36:56.294 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-14T12:36:56.294 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/flexfilelayout/ 2023-07-14T12:36:56.294 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 117705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-14T12:36:56.295 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1053889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfs.ko 2023-07-14T12:36:56.295 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfsv2.ko 2023-07-14T12:36:56.295 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 119801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfsv3.ko 2023-07-14T12:36:56.295 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 2041809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfsv4.ko 2023-07-14T12:36:56.295 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common/ 2023-07-14T12:36:56.295 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common/grace.ko 2023-07-14T12:36:56.295 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common/nfs_acl.ko 2023-07-14T12:36:56.295 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfsd/ 2023-07-14T12:36:56.296 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1504993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfsd/nfsd.ko 2023-07-14T12:36:56.296 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nilfs2/ 2023-07-14T12:36:56.296 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 591417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nilfs2/nilfs2.ko 2023-07-14T12:36:56.296 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/ 2023-07-14T12:36:56.296 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-celtic.ko 2023-07-14T12:36:56.296 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-centeuro.ko 2023-07-14T12:36:56.296 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-croatian.ko 2023-07-14T12:36:56.296 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-cyrillic.ko 2023-07-14T12:36:56.297 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13481 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-gaelic.ko 2023-07-14T12:36:56.297 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-greek.ko 2023-07-14T12:36:56.297 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-iceland.ko 2023-07-14T12:36:56.297 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-inuit.ko 2023-07-14T12:36:56.297 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-roman.ko 2023-07-14T12:36:56.297 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-romanian.ko 2023-07-14T12:36:56.297 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-turkish.ko 2023-07-14T12:36:56.298 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11297 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_ascii.ko 2023-07-14T12:36:56.298 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1250.ko 2023-07-14T12:36:56.298 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12233 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1251.ko 2023-07-14T12:36:56.298 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1255.ko 2023-07-14T12:36:56.298 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp737.ko 2023-07-14T12:36:56.298 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp775.ko 2023-07-14T12:36:56.298 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp850.ko 2023-07-14T12:36:56.298 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp852.ko 2023-07-14T12:36:56.299 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp855.ko 2023-07-14T12:36:56.299 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp857.ko 2023-07-14T12:36:56.299 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp860.ko 2023-07-14T12:36:56.299 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp861.ko 2023-07-14T12:36:56.299 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp862.ko 2023-07-14T12:36:56.299 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp863.ko 2023-07-14T12:36:56.299 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp864.ko 2023-07-14T12:36:56.299 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp865.ko 2023-07-14T12:36:56.300 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp866.ko 2023-07-14T12:36:56.300 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp869.ko 2023-07-14T12:36:56.300 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp874.ko 2023-07-14T12:36:56.300 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 94137 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp932.ko 2023-07-14T12:36:56.300 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 142673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp936.ko 2023-07-14T12:36:56.300 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 165745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp949.ko 2023-07-14T12:36:56.300 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 118121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp950.ko 2023-07-14T12:36:56.300 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_euc-jp.ko 2023-07-14T12:36:56.301 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-1.ko 2023-07-14T12:36:56.301 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-13.ko 2023-07-14T12:36:56.301 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-14.ko 2023-07-14T12:36:56.301 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-15.ko 2023-07-14T12:36:56.301 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-2.ko 2023-07-14T12:36:56.301 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-3.ko 2023-07-14T12:36:56.301 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-4.ko 2023-07-14T12:36:56.301 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-5.ko 2023-07-14T12:36:56.302 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-6.ko 2023-07-14T12:36:56.302 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12233 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-7.ko 2023-07-14T12:36:56.302 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-9.ko 2023-07-14T12:36:56.302 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-r.ko 2023-07-14T12:36:56.302 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-ru.ko 2023-07-14T12:36:56.302 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-u.ko 2023-07-14T12:36:56.302 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_utf8.ko 2023-07-14T12:36:56.303 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ntfs/ 2023-07-14T12:36:56.303 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 219073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ntfs/ntfs.ko 2023-07-14T12:36:56.303 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ 2023-07-14T12:36:56.303 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/cluster/ 2023-07-14T12:36:56.303 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 244177 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-14T12:36:56.303 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlm/ 2023-07-14T12:36:56.303 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 440785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-14T12:36:56.303 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlmfs/ 2023-07-14T12:36:56.304 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-14T12:36:56.304 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 2589569 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2.ko 2023-07-14T12:36:56.304 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17905 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-14T12:36:56.304 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-14T12:36:56.304 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-14T12:36:56.304 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/omfs/ 2023-07-14T12:36:56.304 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 52569 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/omfs/omfs.ko 2023-07-14T12:36:56.304 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/overlayfs/ 2023-07-14T12:36:56.305 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 336473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/overlayfs/overlay.ko 2023-07-14T12:36:56.305 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/pstore/ 2023-07-14T12:36:56.305 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 54609 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/pstore/ramoops.ko 2023-07-14T12:36:56.305 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/qnx4/ 2023-07-14T12:36:56.305 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/qnx4/qnx4.ko 2023-07-14T12:36:56.305 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/qnx6/ 2023-07-14T12:36:56.305 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 46649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/qnx6/qnx6.ko 2023-07-14T12:36:56.305 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/quota/ 2023-07-14T12:36:56.306 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/quota/quota_tree.ko 2023-07-14T12:36:56.306 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14361 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/quota/quota_v1.ko 2023-07-14T12:36:56.306 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/quota/quota_v2.ko 2023-07-14T12:36:56.306 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/reiserfs/ 2023-07-14T12:36:56.306 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 530697 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/reiserfs/reiserfs.ko 2023-07-14T12:36:56.306 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/romfs/ 2023-07-14T12:36:56.306 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/romfs/romfs.ko 2023-07-14T12:36:56.306 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/ 2023-07-14T12:36:56.307 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/client/ 2023-07-14T12:36:56.307 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 2658777 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/client/cifs.ko 2023-07-14T12:36:56.307 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common/ 2023-07-14T12:36:56.307 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common/cifs_arc4.ko 2023-07-14T12:36:56.307 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common/cifs_md4.ko 2023-07-14T12:36:56.307 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/squashfs/ 2023-07-14T12:36:56.307 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 134313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/squashfs/squashfs.ko 2023-07-14T12:36:56.308 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/sysv/ 2023-07-14T12:36:56.308 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 89737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/sysv/sysv.ko 2023-07-14T12:36:56.308 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/udf/ 2023-07-14T12:36:56.308 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 248049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/udf/udf.ko 2023-07-14T12:36:56.308 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ufs/ 2023-07-14T12:36:56.308 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 160857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ufs/ufs.ko 2023-07-14T12:36:56.308 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/xfs/ 2023-07-14T12:36:56.308 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 3998129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/xfs/xfs.ko 2023-07-14T12:36:56.309 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/ 2023-07-14T12:36:56.309 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/locking/ 2023-07-14T12:36:56.309 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 74865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/locking/locktorture.ko 2023-07-14T12:36:56.309 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/time/ 2023-07-14T12:36:56.309 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/time/test_udelay.ko 2023-07-14T12:36:56.309 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 58473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/torture.ko 2023-07-14T12:36:56.309 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ 2023-07-14T12:36:56.309 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 6833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crc-itu-t.ko 2023-07-14T12:36:56.310 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 6529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crc7.ko 2023-07-14T12:36:56.310 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7025 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crc8.ko 2023-07-14T12:36:56.310 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto/ 2023-07-14T12:36:56.310 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto/libarc4.ko 2023-07-14T12:36:56.310 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto/libdes.ko 2023-07-14T12:36:56.310 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/interval_tree_test.ko 2023-07-14T12:36:56.310 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/libcrc32c.ko 2023-07-14T12:36:56.310 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lru_cache.ko 2023-07-14T12:36:56.311 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4/ 2023-07-14T12:36:56.311 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4/lz4_compress.ko 2023-07-14T12:36:56.311 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22633 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4/lz4hc_compress.ko 2023-07-14T12:36:56.311 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/math/ 2023-07-14T12:36:56.311 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 6617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/math/cordic.ko 2023-07-14T12:36:56.311 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8233 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/memory-notifier-error-inject.ko 2023-07-14T12:36:56.311 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/notifier-error-inject.ko 2023-07-14T12:36:56.312 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/percpu_test.ko 2023-07-14T12:36:56.312 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/pm-notifier-error-inject.ko 2023-07-14T12:36:56.312 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/raid6/ 2023-07-14T12:36:56.312 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 143433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/raid6/raid6_pq.ko 2023-07-14T12:36:56.312 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/rbtree_test.ko 2023-07-14T12:36:56.312 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/reed_solomon/ 2023-07-14T12:36:56.312 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-14T12:36:56.313 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/test-kstrtox.ko 2023-07-14T12:36:56.313 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/test-string_helpers.ko 2023-07-14T12:36:56.313 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 4760825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/test_bpf.ko 2023-07-14T12:36:56.313 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/test_firmware.ko 2023-07-14T12:36:56.313 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 6369 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/test_module.ko 2023-07-14T12:36:56.313 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/test_user_copy.ko 2023-07-14T12:36:56.313 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_bm.ko 2023-07-14T12:36:56.313 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_fsm.ko 2023-07-14T12:36:56.314 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9689 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_kmp.ko 2023-07-14T12:36:56.314 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/xz/ 2023-07-14T12:36:56.314 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/xz/xz_dec_test.ko 2023-07-14T12:36:56.314 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/mm/ 2023-07-14T12:36:56.314 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/mm/hwpoison-inject.ko 2023-07-14T12:36:56.314 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ 2023-07-14T12:36:56.314 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/ 2023-07-14T12:36:56.314 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 55737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/6lowpan.ko 2023-07-14T12:36:56.315 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_dest.ko 2023-07-14T12:36:56.315 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_fragment.ko 2023-07-14T12:36:56.315 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_hop.ko 2023-07-14T12:36:56.315 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 6985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-14T12:36:56.315 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_mobility.ko 2023-07-14T12:36:56.315 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_routing.ko 2023-07-14T12:36:56.315 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_udp.ko 2023-07-14T12:36:56.315 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/ 2023-07-14T12:36:56.316 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/garp.ko 2023-07-14T12:36:56.316 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/mrp.ko 2023-07-14T12:36:56.316 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/p8022.ko 2023-07-14T12:36:56.316 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/psnap.ko 2023-07-14T12:36:56.316 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/stp.ko 2023-07-14T12:36:56.316 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/8021q/ 2023-07-14T12:36:56.316 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 81017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/8021q/8021q.ko 2023-07-14T12:36:56.317 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/ 2023-07-14T12:36:56.317 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 198417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet.ko 2023-07-14T12:36:56.317 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_fd.ko 2023-07-14T12:36:56.317 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_rdma.ko 2023-07-14T12:36:56.317 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_virtio.ko 2023-07-14T12:36:56.317 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/batman-adv/ 2023-07-14T12:36:56.317 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 652553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/batman-adv/batman-adv.ko 2023-07-14T12:36:56.317 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/ 2023-07-14T12:36:56.318 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 63825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/br_netfilter.ko 2023-07-14T12:36:56.318 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 772505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/bridge.ko 2023-07-14T12:36:56.318 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ 2023-07-14T12:36:56.318 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-14T12:36:56.318 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-14T12:36:56.318 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-14T12:36:56.318 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-14T12:36:56.318 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-14T12:36:56.319 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-14T12:36:56.319 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-14T12:36:56.319 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-14T12:36:56.319 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13217 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-14T12:36:56.319 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-14T12:36:56.319 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-14T12:36:56.319 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-14T12:36:56.320 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-14T12:36:56.320 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-14T12:36:56.320 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-14T12:36:56.320 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-14T12:36:56.320 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-14T12:36:56.320 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-14T12:36:56.320 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-14T12:36:56.321 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-14T12:36:56.321 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 55937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtables.ko 2023-07-14T12:36:56.321 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14041 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-14T12:36:56.321 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13945 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-14T12:36:56.321 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ceph/ 2023-07-14T12:36:56.321 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1046417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ceph/libceph.ko 2023-07-14T12:36:56.321 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core/ 2023-07-14T12:36:56.321 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 124793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core/pktgen.ko 2023-07-14T12:36:56.322 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/ 2023-07-14T12:36:56.322 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 194321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp.ko 2023-07-14T12:36:56.322 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_diag.ko 2023-07-14T12:36:56.322 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 56945 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_ipv4.ko 2023-07-14T12:36:56.322 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_ipv6.ko 2023-07-14T12:36:56.322 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/ 2023-07-14T12:36:56.322 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 390297 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/dsa_core.ko 2023-07-14T12:36:56.322 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_brcm.ko 2023-07-14T12:36:56.323 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12577 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_dsa.ko 2023-07-14T12:36:56.323 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_none.ko 2023-07-14T12:36:56.323 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_trailer.ko 2023-07-14T12:36:56.323 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/hsr/ 2023-07-14T12:36:56.323 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 100257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/hsr/hsr.ko 2023-07-14T12:36:56.323 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/ 2023-07-14T12:36:56.323 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/6lowpan/ 2023-07-14T12:36:56.323 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 45169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-14T12:36:56.324 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 254601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/ieee802154.ko 2023-07-14T12:36:56.324 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-14T12:36:56.324 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ 2023-07-14T12:36:56.324 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ah4.ko 2023-07-14T12:36:56.324 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/esp4.ko 2023-07-14T12:36:56.324 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 48345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/fou.ko 2023-07-14T12:36:56.324 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/gre.ko 2023-07-14T12:36:56.325 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 48529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/inet_diag.ko 2023-07-14T12:36:56.325 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 60529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_gre.ko 2023-07-14T12:36:56.325 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 61281 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_tunnel.ko 2023-07-14T12:36:56.325 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34369 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_vti.ko 2023-07-14T12:36:56.325 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ipcomp.ko 2023-07-14T12:36:56.325 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ipip.ko 2023-07-14T12:36:56.325 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ 2023-07-14T12:36:56.325 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37689 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-14T12:36:56.326 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-14T12:36:56.326 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10409 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-14T12:36:56.326 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ip_tables.ko 2023-07-14T12:36:56.326 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-14T12:36:56.326 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-07-14T12:36:56.326 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-14T12:36:56.326 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11177 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-14T12:36:56.326 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-14T12:36:56.327 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-07-14T12:36:56.327 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-14T12:36:56.327 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-14T12:36:56.327 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-14T12:36:56.327 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10409 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-14T12:36:56.327 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-14T12:36:56.327 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-14T12:36:56.327 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-14T12:36:56.328 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-14T12:36:56.328 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-14T12:36:56.328 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20561 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-07-14T12:36:56.328 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-14T12:36:56.328 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-14T12:36:56.328 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-14T12:36:56.328 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-14T12:36:56.329 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9009 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-14T12:36:56.329 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_bic.ko 2023-07-14T12:36:56.329 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_dctcp.ko 2023-07-14T12:36:56.329 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_diag.ko 2023-07-14T12:36:56.329 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_highspeed.ko 2023-07-14T12:36:56.329 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_htcp.ko 2023-07-14T12:36:56.329 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_hybla.ko 2023-07-14T12:36:56.329 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_illinois.ko 2023-07-14T12:36:56.330 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_lp.ko 2023-07-14T12:36:56.330 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_scalable.ko 2023-07-14T12:36:56.330 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_vegas.ko 2023-07-14T12:36:56.330 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_veno.ko 2023-07-14T12:36:56.330 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_westwood.ko 2023-07-14T12:36:56.330 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_yeah.ko 2023-07-14T12:36:56.330 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tunnel4.ko 2023-07-14T12:36:56.330 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16361 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/udp_diag.ko 2023-07-14T12:36:56.331 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 41577 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/udp_tunnel.ko 2023-07-14T12:36:56.331 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-14T12:36:56.331 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ 2023-07-14T12:36:56.331 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ah6.ko 2023-07-14T12:36:56.331 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/esp6.ko 2023-07-14T12:36:56.331 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/fou6.ko 2023-07-14T12:36:56.331 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 80793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_gre.ko 2023-07-14T12:36:56.331 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 92817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_tunnel.ko 2023-07-14T12:36:56.332 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10609 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-14T12:36:56.332 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 54001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_vti.ko 2023-07-14T12:36:56.332 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ipcomp6.ko 2023-07-14T12:36:56.332 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/mip6.ko 2023-07-14T12:36:56.332 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ 2023-07-14T12:36:56.332 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 42209 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-14T12:36:56.332 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-07-14T12:36:56.332 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-14T12:36:56.333 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-14T12:36:56.333 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-14T12:36:56.333 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-14T12:36:56.333 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16209 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-14T12:36:56.333 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16033 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-14T12:36:56.333 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-14T12:36:56.333 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-14T12:36:56.334 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-14T12:36:56.334 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-14T12:36:56.334 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-14T12:36:56.334 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-14T12:36:56.334 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-14T12:36:56.334 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-14T12:36:56.334 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-14T12:36:56.334 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-14T12:36:56.335 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-14T12:36:56.335 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-14T12:36:56.335 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-14T12:36:56.335 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-14T12:36:56.335 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9633 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-14T12:36:56.335 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16025 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-14T12:36:56.335 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9009 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-14T12:36:56.335 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 73161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/sit.ko 2023-07-14T12:36:56.336 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24193 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/tunnel6.ko 2023-07-14T12:36:56.336 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-14T12:36:56.336 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/key/ 2023-07-14T12:36:56.336 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 82929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/key/af_key.ko 2023-07-14T12:36:56.336 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/ 2023-07-14T12:36:56.336 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 125873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_core.ko 2023-07-14T12:36:56.336 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-14T12:36:56.336 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 25865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_eth.ko 2023-07-14T12:36:56.337 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ip.ko 2023-07-14T12:36:56.337 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ip6.ko 2023-07-14T12:36:56.337 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_netlink.ko 2023-07-14T12:36:56.337 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 53153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ppp.ko 2023-07-14T12:36:56.337 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/lapb/ 2023-07-14T12:36:56.337 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 48065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/lapb/lapb.ko 2023-07-14T12:36:56.337 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/llc/ 2023-07-14T12:36:56.338 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/llc/llc.ko 2023-07-14T12:36:56.338 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 267017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/llc/llc2.ko 2023-07-14T12:36:56.338 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mac802154/ 2023-07-14T12:36:56.338 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 291041 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mac802154/mac802154.ko 2023-07-14T12:36:56.338 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mpls/ 2023-07-14T12:36:56.338 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mpls/mpls_gso.ko 2023-07-14T12:36:56.338 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ 2023-07-14T12:36:56.338 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ 2023-07-14T12:36:56.339 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 119649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set.ko 2023-07-14T12:36:56.339 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-14T12:36:56.339 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27033 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-14T12:36:56.339 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-14T12:36:56.339 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 102033 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-14T12:36:56.339 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 103121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-14T12:36:56.339 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 104593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-14T12:36:56.339 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 105129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-14T12:36:56.340 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 114393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-14T12:36:56.340 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 61161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-14T12:36:56.340 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 111161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-14T12:36:56.340 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 114673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-14T12:36:56.340 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 114329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-14T12:36:56.340 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 113217 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-14T12:36:56.340 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 116217 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-14T12:36:56.341 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-14T12:36:56.341 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ 2023-07-14T12:36:56.341 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 412481 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-14T12:36:56.341 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-14T12:36:56.341 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-14T12:36:56.341 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-14T12:36:56.341 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17905 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-14T12:36:56.341 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-14T12:36:56.342 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7689 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-14T12:36:56.342 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7689 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-14T12:36:56.342 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-14T12:36:56.342 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9233 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-14T12:36:56.342 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7697 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-14T12:36:56.342 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-14T12:36:56.342 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7697 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-14T12:36:56.342 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-14T12:36:56.343 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 48897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conncount.ko 2023-07-14T12:36:56.343 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 408689 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack.ko 2023-07-14T12:36:56.343 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-14T12:36:56.343 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10177 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-14T12:36:56.343 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33761 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-14T12:36:56.343 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 118145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-14T12:36:56.343 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-14T12:36:56.344 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-14T12:36:56.344 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 108393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-14T12:36:56.344 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-14T12:36:56.344 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-14T12:36:56.344 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 66641 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-14T12:36:56.344 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11233 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-14T12:36:56.344 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-14T12:36:56.344 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-14T12:36:56.345 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 88513 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_flow_table.ko 2023-07-14T12:36:56.345 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-14T12:36:56.345 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_log_syslog.ko 2023-07-14T12:36:56.345 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 95353 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat.ko 2023-07-14T12:36:56.345 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-14T12:36:56.345 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-14T12:36:56.345 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_irc.ko 2023-07-14T12:36:56.345 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_sip.ko 2023-07-14T12:36:56.346 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-14T12:36:56.346 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 44025 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-14T12:36:56.346 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 592185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_tables.ko 2023-07-14T12:36:56.346 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink.ko 2023-07-14T12:36:56.346 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-14T12:36:56.346 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-07-14T12:36:56.346 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 39905 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_log.ko 2023-07-14T12:36:56.346 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-14T12:36:56.347 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 49673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-14T12:36:56.347 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_chain_nat.ko 2023-07-14T12:36:56.347 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_compat.ko 2023-07-14T12:36:56.347 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 40721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_ct.ko 2023-07-14T12:36:56.347 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-14T12:36:56.347 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_fib.ko 2023-07-14T12:36:56.347 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-14T12:36:56.347 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_hash.ko 2023-07-14T12:36:56.348 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_limit.ko 2023-07-14T12:36:56.348 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_log.ko 2023-07-14T12:36:56.348 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_masq.ko 2023-07-14T12:36:56.348 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_nat.ko 2023-07-14T12:36:56.348 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_numgen.ko 2023-07-14T12:36:56.348 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_osf.ko 2023-07-14T12:36:56.348 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_queue.ko 2023-07-14T12:36:56.349 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_redir.ko 2023-07-14T12:36:56.349 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_reject.ko 2023-07-14T12:36:56.349 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_reject_inet.ko 2023-07-14T12:36:56.349 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_socket.ko 2023-07-14T12:36:56.349 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_synproxy.ko 2023-07-14T12:36:56.349 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_tproxy.ko 2023-07-14T12:36:56.349 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 89329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/x_tables.ko 2023-07-14T12:36:56.349 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_AUDIT.ko 2023-07-14T12:36:56.350 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9633 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-14T12:36:56.350 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-14T12:36:56.350 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-14T12:36:56.350 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 18169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CT.ko 2023-07-14T12:36:56.350 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_DSCP.ko 2023-07-14T12:36:56.350 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_HL.ko 2023-07-14T12:36:56.350 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_HMARK.ko 2023-07-14T12:36:56.350 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 38857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-14T12:36:56.351 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_LED.ko 2023-07-14T12:36:56.351 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_LOG.ko 2023-07-14T12:36:56.351 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-14T12:36:56.351 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NETMAP.ko 2023-07-14T12:36:56.351 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NFLOG.ko 2023-07-14T12:36:56.351 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13289 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-14T12:36:56.351 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19689 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_RATEEST.ko 2023-07-14T12:36:56.351 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-14T12:36:56.352 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 14337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_SECMARK.ko 2023-07-14T12:36:56.352 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-14T12:36:56.352 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-14T12:36:56.352 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17369 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TEE.ko 2023-07-14T12:36:56.352 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TPROXY.ko 2023-07-14T12:36:56.352 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TRACE.ko 2023-07-14T12:36:56.352 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_addrtype.ko 2023-07-14T12:36:56.353 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_bpf.ko 2023-07-14T12:36:56.353 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15577 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cgroup.ko 2023-07-14T12:36:56.353 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11209 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cluster.ko 2023-07-14T12:36:56.353 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_comment.ko 2023-07-14T12:36:56.353 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connbytes.ko 2023-07-14T12:36:56.353 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connlabel.ko 2023-07-14T12:36:56.353 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connlimit.ko 2023-07-14T12:36:56.353 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connmark.ko 2023-07-14T12:36:56.354 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_conntrack.ko 2023-07-14T12:36:56.354 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cpu.ko 2023-07-14T12:36:56.354 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_dccp.ko 2023-07-14T12:36:56.354 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_devgroup.ko 2023-07-14T12:36:56.354 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_dscp.ko 2023-07-14T12:36:56.354 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ecn.ko 2023-07-14T12:36:56.354 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_esp.ko 2023-07-14T12:36:56.354 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_hashlimit.ko 2023-07-14T12:36:56.355 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_helper.ko 2023-07-14T12:36:56.355 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_hl.ko 2023-07-14T12:36:56.355 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ipcomp.ko 2023-07-14T12:36:56.355 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_iprange.ko 2023-07-14T12:36:56.355 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ipvs.ko 2023-07-14T12:36:56.355 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16041 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_l2tp.ko 2023-07-14T12:36:56.355 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_length.ko 2023-07-14T12:36:56.355 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_limit.ko 2023-07-14T12:36:56.356 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_mac.ko 2023-07-14T12:36:56.356 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8641 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_mark.ko 2023-07-14T12:36:56.356 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_multiport.ko 2023-07-14T12:36:56.356 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_nat.ko 2023-07-14T12:36:56.356 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_nfacct.ko 2023-07-14T12:36:56.356 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8297 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_osf.ko 2023-07-14T12:36:56.356 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_owner.ko 2023-07-14T12:36:56.356 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_physdev.ko 2023-07-14T12:36:56.357 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7633 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_pkttype.ko 2023-07-14T12:36:56.357 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_policy.ko 2023-07-14T12:36:56.357 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_quota.ko 2023-07-14T12:36:56.357 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10409 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_rateest.ko 2023-07-14T12:36:56.357 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_realm.ko 2023-07-14T12:36:56.357 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_recent.ko 2023-07-14T12:36:56.357 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_sctp.ko 2023-07-14T12:36:56.358 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 30089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_set.ko 2023-07-14T12:36:56.358 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_socket.ko 2023-07-14T12:36:56.358 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_state.ko 2023-07-14T12:36:56.358 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_statistic.ko 2023-07-14T12:36:56.358 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_string.ko 2023-07-14T12:36:56.358 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 8553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_tcpmss.ko 2023-07-14T12:36:56.358 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15777 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_tcpudp.ko 2023-07-14T12:36:56.358 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_time.ko 2023-07-14T12:36:56.359 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_u32.ko 2023-07-14T12:36:56.359 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netlink/ 2023-07-14T12:36:56.359 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netlink/netlink_diag.ko 2023-07-14T12:36:56.359 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/nsh/ 2023-07-14T12:36:56.359 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 12425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/nsh/nsh.ko 2023-07-14T12:36:56.359 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/ 2023-07-14T12:36:56.359 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 379545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/openvswitch.ko 2023-07-14T12:36:56.359 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-geneve.ko 2023-07-14T12:36:56.360 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-gre.ko 2023-07-14T12:36:56.360 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 11793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-vxlan.ko 2023-07-14T12:36:56.360 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/packet/ 2023-07-14T12:36:56.360 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/packet/af_packet_diag.ko 2023-07-14T12:36:56.360 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/phonet/ 2023-07-14T12:36:56.360 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 109961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/phonet/phonet.ko 2023-07-14T12:36:56.360 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 54761 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/phonet/pn_pep.ko 2023-07-14T12:36:56.361 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/ 2023-07-14T12:36:56.361 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 252825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds.ko 2023-07-14T12:36:56.361 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 165081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds_rdma.ko 2023-07-14T12:36:56.361 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 67241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds_tcp.ko 2023-07-14T12:36:56.361 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rxrpc/ 2023-07-14T12:36:56.361 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 820137 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rxrpc/rxrpc.ko 2023-07-14T12:36:56.361 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/ 2023-07-14T12:36:56.362 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_csum.ko 2023-07-14T12:36:56.362 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_gact.ko 2023-07-14T12:36:56.362 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_ipt.ko 2023-07-14T12:36:56.362 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 34057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_mirred.ko 2023-07-14T12:36:56.362 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_nat.ko 2023-07-14T12:36:56.362 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 43817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_pedit.ko 2023-07-14T12:36:56.362 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_police.ko 2023-07-14T12:36:56.362 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_simple.ko 2023-07-14T12:36:56.363 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36353 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_skbedit.ko 2023-07-14T12:36:56.363 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 36057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_vlan.ko 2023-07-14T12:36:56.363 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_basic.ko 2023-07-14T12:36:56.363 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_bpf.ko 2023-07-14T12:36:56.363 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19233 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_cgroup.ko 2023-07-14T12:36:56.363 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31377 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_flow.ko 2023-07-14T12:36:56.363 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_fw.ko 2023-07-14T12:36:56.364 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 37953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_route.ko 2023-07-14T12:36:56.364 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 59217 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_u32.ko 2023-07-14T12:36:56.364 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_cmp.ko 2023-07-14T12:36:56.364 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 13457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_ipset.ko 2023-07-14T12:36:56.364 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_meta.ko 2023-07-14T12:36:56.364 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_nbyte.ko 2023-07-14T12:36:56.365 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_text.ko 2023-07-14T12:36:56.365 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_u32.ko 2023-07-14T12:36:56.365 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 21649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_choke.ko 2023-07-14T12:36:56.365 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_codel.ko 2023-07-14T12:36:56.365 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_drr.ko 2023-07-14T12:36:56.365 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 33609 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_fq.ko 2023-07-14T12:36:56.365 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_fq_codel.ko 2023-07-14T12:36:56.365 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_gred.ko 2023-07-14T12:36:56.366 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 48409 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_hfsc.ko 2023-07-14T12:36:56.366 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_hhf.ko 2023-07-14T12:36:56.366 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 65793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_htb.ko 2023-07-14T12:36:56.366 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 16065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_ingress.ko 2023-07-14T12:36:56.366 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 29809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_mqprio.ko 2023-07-14T12:36:56.366 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_mqprio_lib.ko 2023-07-14T12:36:56.366 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_multiq.ko 2023-07-14T12:36:56.366 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 35601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_netem.ko 2023-07-14T12:36:56.367 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_pie.ko 2023-07-14T12:36:56.367 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_plug.ko 2023-07-14T12:36:56.367 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 24729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_prio.ko 2023-07-14T12:36:56.367 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 47617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_qfq.ko 2023-07-14T12:36:56.367 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 32953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_red.ko 2023-07-14T12:36:56.367 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 26881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_sfb.ko 2023-07-14T12:36:56.367 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 31425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_sfq.ko 2023-07-14T12:36:56.368 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 28897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_tbf.ko 2023-07-14T12:36:56.368 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 27729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_teql.ko 2023-07-14T12:36:56.368 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp/ 2023-07-14T12:36:56.368 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 930369 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp/sctp.ko 2023-07-14T12:36:56.368 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 19033 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp/sctp_diag.ko 2023-07-14T12:36:56.368 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/ 2023-07-14T12:36:56.368 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss/ 2023-07-14T12:36:56.369 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 335569 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-14T12:36:56.369 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 61833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-14T12:36:56.369 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 1514649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/sunrpc.ko 2023-07-14T12:36:56.369 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/xprtrdma/ 2023-07-14T12:36:56.369 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 707401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-14T12:36:56.369 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc/ 2023-07-14T12:36:56.369 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10025 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc/diag.ko 2023-07-14T12:36:56.369 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 862233 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc/tipc.ko 2023-07-14T12:36:56.370 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/unix/ 2023-07-14T12:36:56.370 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/unix/unix_diag.ko 2023-07-14T12:36:56.370 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/ 2023-07-14T12:36:56.370 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 84841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-14T12:36:56.370 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 68033 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-14T12:36:56.370 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 95985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock.ko 2023-07-14T12:36:56.371 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 10705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-14T12:36:56.371 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 17521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-14T12:36:56.371 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/x25/ 2023-07-14T12:36:56.371 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 125097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/x25/x25.ko 2023-07-14T12:36:56.371 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/xfrm/ 2023-07-14T12:36:56.371 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 22657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/xfrm/xfrm_algo.ko 2023-07-14T12:36:56.371 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 20705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-14T12:36:56.371 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 102265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/xfrm/xfrm_user.ko 2023-07-14T12:36:56.372 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt/ 2023-07-14T12:36:56.372 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt/lib/ 2023-07-14T12:36:56.372 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 15513 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt/lib/irqbypass.ko 2023-07-14T12:36:56.372 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 638200 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/modules.alias 2023-07-14T12:36:56.372 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 623896 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/modules.alias.bin 2023-07-14T12:36:56.372 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 7656 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin 2023-07-14T12:36:56.372 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 23361 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin.alias.bin 2023-07-14T12:36:56.373 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 9821 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin.bin 2023-07-14T12:36:56.373 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 69903 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin.modinfo 2023-07-14T12:36:56.373 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 146449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/modules.dep 2023-07-14T12:36:56.373 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 232695 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/modules.dep.bin 2023-07-14T12:36:56.373 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 210 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/modules.devname 2023-07-14T12:36:56.373 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 72754 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/modules.order 2023-07-14T12:36:56.373 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 879 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/modules.softdep 2023-07-14T12:36:56.374 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 252883 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/modules.symbols 2023-07-14T12:36:56.374 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 307884 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/modules.symbols.bin 2023-07-14T12:36:56.374 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./usr/ 2023-07-14T12:36:56.374 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./usr/share/ 2023-07-14T12:36:56.374 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./usr/share/doc/ 2023-07-14T12:36:56.374 INFO:teuthology.orchestra.run.smithi005.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./usr/share/doc/linux-image-6.5.0-rc1-ga440c79eee02/ 2023-07-14T12:36:56.374 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 173 2023-07-13 12:30 ./usr/share/doc/linux-image-6.5.0-rc1-ga440c79eee02/changelog.Debian.gz 2023-07-14T12:36:56.375 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r-- root/root 691 2023-07-13 12:30 ./usr/share/doc/linux-image-6.5.0-rc1-ga440c79eee02/copyright 2023-07-14T12:36:56.376 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc1-ga440c79eee02 2023-07-14T12:36:56.376 INFO:teuthology.task.kernel:searching for kernel 6.5.0-rc1-ga440c79eee02 2023-07-14T12:36:56.376 DEBUG:teuthology.orchestra.run.smithi005:> egrep '(submenu|menuentry.*6.5.0-rc1-ga440c79eee02).*{' /boot/grub/grub.cfg 2023-07-14T12:36:56.383 INFO:teuthology.orchestra.run.smithi005.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-14T12:36:56.383 INFO:teuthology.orchestra.run.smithi005.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc1-ga440c79eee02' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc1-ga440c79eee02-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-14T12:36:56.384 INFO:teuthology.orchestra.run.smithi005.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc1-ga440c79eee02 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc1-ga440c79eee02-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-14T12:36:56.384 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-07-14T12:36:56.384 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.5.0-rc1-ga440c79eee02 2023-07-14T12:36:56.385 DEBUG:teuthology.orchestra.run.smithi005:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-07-14T12:36:56.427 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi005.front.sepia.ceph.com to complete... 2023-07-14T12:36:56.520 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 2023-07-14T12:36:56.539 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc1-ga440c79eee02 2023-07-14T12:36:56.769 INFO:teuthology.orchestra.run.smithi005.stderr:Sourcing file `/etc/default/grub' 2023-07-14T12:36:56.770 INFO:teuthology.orchestra.run.smithi005.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-14T12:36:56.789 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-07-14T12:36:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:Generating grub configuration file ... 2023-07-14T12:36:56.802 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-07-14T12:36:56.856 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-07-14T12:36:56.861 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-07-14T12:36:56.974 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 2023-07-14T12:36:56.980 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc1-ga440c79eee02 2023-07-14T12:36:57.013 INFO:teuthology.orchestra.run.smithi154.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-07-14T12:36:57.014 INFO:teuthology.orchestra.run.smithi154.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-07-14T12:36:57.014 INFO:teuthology.orchestra.run.smithi154.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-07-14T12:36:57.052 INFO:teuthology.orchestra.run.smithi154.stderr:done 2023-07-14T12:36:57.202 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-07-14T12:36:57.208 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-07-14T12:36:57.211 DEBUG:teuthology.orchestra.run.smithi154:> dpkg-deb -c /tmp/linux-image.deb 2023-07-14T12:36:57.219 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./ 2023-07-14T12:36:57.219 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./boot/ 2023-07-14T12:36:57.219 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 4380308 2023-07-13 12:30 ./boot/System.map-6.5.0-rc1-ga440c79eee02 2023-07-14T12:36:57.230 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 168433 2023-07-13 12:30 ./boot/config-6.5.0-rc1-ga440c79eee02 2023-07-14T12:36:57.231 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11280160 2023-07-13 12:30 ./boot/vmlinuz-6.5.0-rc1-ga440c79eee02 2023-07-14T12:36:57.253 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./etc/ 2023-07-14T12:36:57.253 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./etc/kernel/ 2023-07-14T12:36:57.253 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./etc/kernel/postinst.d/ 2023-07-14T12:36:57.253 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./etc/kernel/postrm.d/ 2023-07-14T12:36:57.253 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./etc/kernel/preinst.d/ 2023-07-14T12:36:57.254 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./etc/kernel/prerm.d/ 2023-07-14T12:36:57.254 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/ 2023-07-14T12:36:57.254 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/ 2023-07-14T12:36:57.254 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/ 2023-07-14T12:36:57.254 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/ 2023-07-14T12:36:57.254 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/ 2023-07-14T12:36:57.254 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/ 2023-07-14T12:36:57.255 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/ 2023-07-14T12:36:57.255 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 490385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/aesni-intel.ko 2023-07-14T12:36:57.255 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-14T12:36:57.255 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-14T12:36:57.255 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-14T12:36:57.256 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 93113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-14T12:36:57.256 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 106729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-14T12:36:57.256 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 152241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-14T12:36:57.256 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-14T12:36:57.256 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13777 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-14T12:36:57.257 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 83889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-14T12:36:57.257 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-14T12:36:57.257 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-14T12:36:57.258 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47209 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-14T12:36:57.258 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-14T12:36:57.258 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-14T12:36:57.258 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 40529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-14T12:36:57.259 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 58585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-14T12:36:57.259 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 50497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-14T12:36:57.259 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-14T12:36:57.259 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-14T12:36:57.259 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/ 2023-07-14T12:36:57.259 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu/ 2023-07-14T12:36:57.259 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu/mce/ 2023-07-14T12:36:57.259 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 40113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-14T12:36:57.260 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13281 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpuid.ko 2023-07-14T12:36:57.260 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/msr.ko 2023-07-14T12:36:57.260 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/ 2023-07-14T12:36:57.260 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 348417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-14T12:36:57.260 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 972641 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-14T12:36:57.261 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-07-14T12:36:57.261 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-07-14T12:36:57.272 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 2273145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm.ko 2023-07-14T12:36:57.272 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/ 2023-07-14T12:36:57.272 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 53521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/af_alg.ko 2023-07-14T12:36:57.272 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/algif_hash.ko 2023-07-14T12:36:57.273 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/algif_skcipher.ko 2023-07-14T12:36:57.273 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17209 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/ansi_cprng.ko 2023-07-14T12:36:57.273 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19641 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/anubis.ko 2023-07-14T12:36:57.273 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/arc4.ko 2023-07-14T12:36:57.273 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/asymmetric_keys/ 2023-07-14T12:36:57.273 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-07-14T12:36:57.273 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/ 2023-07-14T12:36:57.274 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_memcpy.ko 2023-07-14T12:36:57.274 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_pq.ko 2023-07-14T12:36:57.274 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21561 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-14T12:36:57.274 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_tx.ko 2023-07-14T12:36:57.274 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_xor.ko 2023-07-14T12:36:57.274 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/raid6test.ko 2023-07-14T12:36:57.275 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/authenc.ko 2023-07-14T12:36:57.275 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22641 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/authencesn.ko 2023-07-14T12:36:57.275 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blake2b_generic.ko 2023-07-14T12:36:57.275 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blowfish_common.ko 2023-07-14T12:36:57.275 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blowfish_generic.ko 2023-07-14T12:36:57.275 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/camellia_generic.ko 2023-07-14T12:36:57.276 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast5_generic.ko 2023-07-14T12:36:57.276 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast6_generic.ko 2023-07-14T12:36:57.276 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast_common.ko 2023-07-14T12:36:57.276 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/ccm.ko 2023-07-14T12:36:57.276 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14769 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cmac.ko 2023-07-14T12:36:57.277 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crc32_generic.ko 2023-07-14T12:36:57.277 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 46961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cryptd.ko 2023-07-14T12:36:57.277 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crypto_engine.ko 2023-07-14T12:36:57.277 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crypto_simd.ko 2023-07-14T12:36:57.277 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crypto_user.ko 2023-07-14T12:36:57.277 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cts.ko 2023-07-14T12:36:57.278 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/des_generic.ko 2023-07-14T12:36:57.283 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/dh_generic.ko 2023-07-14T12:36:57.283 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/echainiv.ko 2023-07-14T12:36:57.283 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/essiv.ko 2023-07-14T12:36:57.283 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/fcrypt.ko 2023-07-14T12:36:57.284 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/khazad.ko 2023-07-14T12:36:57.284 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/lrw.ko 2023-07-14T12:36:57.284 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11513 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/lz4.ko 2023-07-14T12:36:57.284 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/lz4hc.ko 2023-07-14T12:36:57.284 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11761 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/md4.ko 2023-07-14T12:36:57.284 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/michael_mic.ko 2023-07-14T12:36:57.284 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/pcbc.ko 2023-07-14T12:36:57.285 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/pcrypt.ko 2023-07-14T12:36:57.285 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/rmd160.ko 2023-07-14T12:36:57.285 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/seed.ko 2023-07-14T12:36:57.285 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/serpent_generic.ko 2023-07-14T12:36:57.285 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 149193 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/tcrypt.ko 2023-07-14T12:36:57.285 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/tea.ko 2023-07-14T12:36:57.286 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28777 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/twofish_common.ko 2023-07-14T12:36:57.286 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13233 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/twofish_generic.ko 2023-07-14T12:36:57.286 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/vmac.ko 2023-07-14T12:36:57.286 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/wp512.ko 2023-07-14T12:36:57.286 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xcbc.ko 2023-07-14T12:36:57.286 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xor.ko 2023-07-14T12:36:57.286 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xts.ko 2023-07-14T12:36:57.286 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9481 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xxhash_generic.ko 2023-07-14T12:36:57.287 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ 2023-07-14T12:36:57.287 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/ 2023-07-14T12:36:57.287 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/acpi_extlog.ko 2023-07-14T12:36:57.287 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-14T12:36:57.287 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/acpi_pad.ko 2023-07-14T12:36:57.287 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/apei/ 2023-07-14T12:36:57.287 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/apei/einj.ko 2023-07-14T12:36:57.287 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/ec_sys.ko 2023-07-14T12:36:57.288 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/platform_profile.ko 2023-07-14T12:36:57.288 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/sbs.ko 2023-07-14T12:36:57.288 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/sbshc.ko 2023-07-14T12:36:57.288 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 100401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/video.ko 2023-07-14T12:36:57.289 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/ 2023-07-14T12:36:57.289 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/acard-ahci.ko 2023-07-14T12:36:57.289 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 88625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/ahci.ko 2023-07-14T12:36:57.289 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/ahci_platform.ko 2023-07-14T12:36:57.289 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 87841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/libahci.ko 2023-07-14T12:36:57.289 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/libahci_platform.ko 2023-07-14T12:36:57.290 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17009 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_acpi.ko 2023-07-14T12:36:57.290 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ali.ko 2023-07-14T12:36:57.290 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_amd.ko 2023-07-14T12:36:57.290 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21201 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_artop.ko 2023-07-14T12:36:57.290 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_atiixp.ko 2023-07-14T12:36:57.291 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_atp867x.ko 2023-07-14T12:36:57.291 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cmd640.ko 2023-07-14T12:36:57.291 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cmd64x.ko 2023-07-14T12:36:57.291 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cypress.ko 2023-07-14T12:36:57.291 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_efar.ko 2023-07-14T12:36:57.291 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt366.ko 2023-07-14T12:36:57.291 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34033 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt37x.ko 2023-07-14T12:36:57.292 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-14T12:36:57.292 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-14T12:36:57.292 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_it8213.ko 2023-07-14T12:36:57.292 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35177 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_it821x.ko 2023-07-14T12:36:57.292 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_jmicron.ko 2023-07-14T12:36:57.292 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_legacy.ko 2023-07-14T12:36:57.292 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_marvell.ko 2023-07-14T12:36:57.293 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_mpiix.ko 2023-07-14T12:36:57.293 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_netcell.ko 2023-07-14T12:36:57.293 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ninja32.ko 2023-07-14T12:36:57.293 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ns87410.ko 2023-07-14T12:36:57.293 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ns87415.ko 2023-07-14T12:36:57.293 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_oldpiix.ko 2023-07-14T12:36:57.293 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_opti.ko 2023-07-14T12:36:57.293 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20609 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_optidma.ko 2023-07-14T12:36:57.294 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pcmcia.ko 2023-07-14T12:36:57.294 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-14T12:36:57.294 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-14T12:36:57.294 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_piccolo.ko 2023-07-14T12:36:57.294 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_radisys.ko 2023-07-14T12:36:57.294 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_rdc.ko 2023-07-14T12:36:57.294 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15201 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_rz1000.ko 2023-07-14T12:36:57.295 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sch.ko 2023-07-14T12:36:57.295 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_serverworks.ko 2023-07-14T12:36:57.295 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sil680.ko 2023-07-14T12:36:57.295 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19569 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sl82c105.ko 2023-07-14T12:36:57.295 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_triflex.ko 2023-07-14T12:36:57.295 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_via.ko 2023-07-14T12:36:57.295 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pdc_adma.ko 2023-07-14T12:36:57.295 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_inic162x.ko 2023-07-14T12:36:57.296 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 83225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_mv.ko 2023-07-14T12:36:57.296 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 70537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_nv.ko 2023-07-14T12:36:57.296 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37369 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_promise.ko 2023-07-14T12:36:57.296 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_qstor.ko 2023-07-14T12:36:57.296 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29201 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sil.ko 2023-07-14T12:36:57.296 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sil24.ko 2023-07-14T12:36:57.296 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sis.ko 2023-07-14T12:36:57.297 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_svw.ko 2023-07-14T12:36:57.297 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 44721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sx4.ko 2023-07-14T12:36:57.297 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_uli.ko 2023-07-14T12:36:57.297 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_via.ko 2023-07-14T12:36:57.297 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_vsc.ko 2023-07-14T12:36:57.297 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/auxdisplay/ 2023-07-14T12:36:57.297 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16289 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/auxdisplay/ks0108.ko 2023-07-14T12:36:57.298 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/bcma/ 2023-07-14T12:36:57.298 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 124457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/bcma/bcma.ko 2023-07-14T12:36:57.298 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/ 2023-07-14T12:36:57.298 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/aoe/ 2023-07-14T12:36:57.298 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 113705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/aoe/aoe.ko 2023-07-14T12:36:57.298 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/drbd/ 2023-07-14T12:36:57.299 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 968433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/drbd/drbd.ko 2023-07-14T12:36:57.299 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 173201 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/floppy.ko 2023-07-14T12:36:57.299 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/mtip32xx/ 2023-07-14T12:36:57.299 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 94297 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-14T12:36:57.299 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 115345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/nbd.ko 2023-07-14T12:36:57.299 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/null_blk/ 2023-07-14T12:36:57.300 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 110361 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/null_blk/null_blk.ko 2023-07-14T12:36:57.300 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 98225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/pktcdvd.ko 2023-07-14T12:36:57.300 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 257529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/rbd.ko 2023-07-14T12:36:57.300 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkback/ 2023-07-14T12:36:57.300 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 98129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-14T12:36:57.300 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/zram/ 2023-07-14T12:36:57.300 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 60201 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/zram/zram.ko 2023-07-14T12:36:57.301 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ 2023-07-14T12:36:57.301 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/applicom.ko 2023-07-14T12:36:57.301 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12009 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hangcheck-timer.ko 2023-07-14T12:36:57.301 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/ 2023-07-14T12:36:57.301 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-14T12:36:57.301 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-14T12:36:57.301 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-14T12:36:57.302 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/via-rng.ko 2023-07-14T12:36:57.302 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15633 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-14T12:36:57.302 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ 2023-07-14T12:36:57.302 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-14T12:36:57.302 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 150665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-14T12:36:57.302 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26561 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-14T12:36:57.303 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 139057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-14T12:36:57.303 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 70833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-14T12:36:57.303 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 53609 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-14T12:36:57.303 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/lp.ko 2023-07-14T12:36:57.303 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/mwave/ 2023-07-14T12:36:57.303 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 84121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/mwave/mwave.ko 2023-07-14T12:36:57.303 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/nvram.ko 2023-07-14T12:36:57.304 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ppdev.ko 2023-07-14T12:36:57.304 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tlclk.ko 2023-07-14T12:36:57.304 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/ 2023-07-14T12:36:57.304 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-14T12:36:57.304 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-07-14T12:36:57.304 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-07-14T12:36:57.304 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-07-14T12:36:57.305 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-14T12:36:57.305 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22697 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-14T12:36:57.305 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23561 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-07-14T12:36:57.305 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/xillybus/ 2023-07-14T12:36:57.305 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/xillybus/xillybus_class.ko 2023-07-14T12:36:57.306 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 50945 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/xillybus/xillybus_core.ko 2023-07-14T12:36:57.306 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-07-14T12:36:57.306 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/clk/ 2023-07-14T12:36:57.306 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/clk/clk-palmas.ko 2023-07-14T12:36:57.306 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/clk/clk-si5351.ko 2023-07-14T12:36:57.306 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/clk/clk-twl6040.ko 2023-07-14T12:36:57.306 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/clk/clk-wm831x.ko 2023-07-14T12:36:57.306 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/ 2023-07-14T12:36:57.307 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-14T12:36:57.307 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-14T12:36:57.307 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25297 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-14T12:36:57.307 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ 2023-07-14T12:36:57.307 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp/ 2023-07-14T12:36:57.307 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 70785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-14T12:36:57.307 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 234473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp/ccp.ko 2023-07-14T12:36:57.380 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/ 2023-07-14T12:36:57.380 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/ 2023-07-14T12:36:57.380 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_common/ 2023-07-14T12:36:57.380 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 408489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-14T12:36:57.380 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-07-14T12:36:57.381 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-14T12:36:57.381 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/padlock-aes.ko 2023-07-14T12:36:57.381 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/padlock-sha.ko 2023-07-14T12:36:57.381 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/virtio/ 2023-07-14T12:36:57.381 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 68937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-14T12:36:57.381 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dca/ 2023-07-14T12:36:57.381 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dca/dca.ko 2023-07-14T12:36:57.382 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/ 2023-07-14T12:36:57.382 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/dw/ 2023-07-14T12:36:57.382 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-14T12:36:57.382 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/ioat/ 2023-07-14T12:36:57.382 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 122641 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-14T12:36:57.382 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/ 2023-07-14T12:36:57.382 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 80273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/amd64_edac.ko 2023-07-14T12:36:57.382 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35769 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/e752x_edac.ko 2023-07-14T12:36:57.383 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 63617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/edac_mce_amd.ko 2023-07-14T12:36:57.383 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i3000_edac.ko 2023-07-14T12:36:57.383 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i3200_edac.ko 2023-07-14T12:36:57.383 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i5100_edac.ko 2023-07-14T12:36:57.383 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i5400_edac.ko 2023-07-14T12:36:57.383 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i7300_edac.ko 2023-07-14T12:36:57.383 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 52025 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i7core_edac.ko 2023-07-14T12:36:57.383 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i82975x_edac.ko 2023-07-14T12:36:57.384 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/ie31200_edac.ko 2023-07-14T12:36:57.384 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 56809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/sb_edac.ko 2023-07-14T12:36:57.384 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/x38_edac.ko 2023-07-14T12:36:57.384 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/extcon/ 2023-07-14T12:36:57.384 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/extcon/extcon-gpio.ko 2023-07-14T12:36:57.384 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/extcon/extcon-max14577.ko 2023-07-14T12:36:57.384 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29569 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/extcon/extcon-max77693.ko 2023-07-14T12:36:57.385 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/extcon/extcon-max8997.ko 2023-07-14T12:36:57.385 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/extcon/extcon-palmas.ko 2023-07-14T12:36:57.385 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/extcon/extcon-rt8973a.ko 2023-07-14T12:36:57.385 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/extcon/extcon-sm5502.ko 2023-07-14T12:36:57.385 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware/ 2023-07-14T12:36:57.385 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware/dmi-sysfs.ko 2023-07-14T12:36:57.385 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware/efi/ 2023-07-14T12:36:57.385 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware/efi/efi-pstore.ko 2023-07-14T12:36:57.386 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-14T12:36:57.386 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/ 2023-07-14T12:36:57.386 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-adp5520.ko 2023-07-14T12:36:57.386 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-amd8111.ko 2023-07-14T12:36:57.386 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-arizona.ko 2023-07-14T12:36:57.386 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-da9052.ko 2023-07-14T12:36:57.386 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-da9055.ko 2023-07-14T12:36:57.387 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-dln2.ko 2023-07-14T12:36:57.387 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 77849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-f7188x.ko 2023-07-14T12:36:57.387 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-generic.ko 2023-07-14T12:36:57.387 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19569 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-ich.ko 2023-07-14T12:36:57.387 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-07-14T12:36:57.387 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-kempld.ko 2023-07-14T12:36:57.387 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-lp3943.ko 2023-07-14T12:36:57.387 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-max7300.ko 2023-07-14T12:36:57.388 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-max730x.ko 2023-07-14T12:36:57.388 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18577 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-max732x.ko 2023-07-14T12:36:57.388 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-07-14T12:36:57.388 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 46761 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-pca953x.ko 2023-07-14T12:36:57.388 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-pcf857x.ko 2023-07-14T12:36:57.388 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14377 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-rdc321x.ko 2023-07-14T12:36:57.388 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-sch.ko 2023-07-14T12:36:57.388 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-sch311x.ko 2023-07-14T12:36:57.389 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-tps65912.ko 2023-07-14T12:36:57.389 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-twl4030.ko 2023-07-14T12:36:57.389 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-twl6040.ko 2023-07-14T12:36:57.389 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-14T12:36:57.389 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-vx855.ko 2023-07-14T12:36:57.389 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16281 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-wm831x.ko 2023-07-14T12:36:57.389 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-wm8350.ko 2023-07-14T12:36:57.390 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-wm8994.ko 2023-07-14T12:36:57.390 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/ 2023-07-14T12:36:57.390 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11577 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-a4tech.ko 2023-07-14T12:36:57.390 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 39081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-apple.ko 2023-07-14T12:36:57.390 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14481 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-appleir.ko 2023-07-14T12:36:57.390 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8353 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-aureal.ko 2023-07-14T12:36:57.390 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-axff.ko 2023-07-14T12:36:57.390 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-belkin.ko 2023-07-14T12:36:57.391 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-cherry.ko 2023-07-14T12:36:57.391 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16041 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-chicony.ko 2023-07-14T12:36:57.391 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 59145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-cp2112.ko 2023-07-14T12:36:57.391 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-cypress.ko 2023-07-14T12:36:57.391 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-dr.ko 2023-07-14T12:36:57.391 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10697 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-elecom.ko 2023-07-14T12:36:57.391 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-elo.ko 2023-07-14T12:36:57.391 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-emsff.ko 2023-07-14T12:36:57.392 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-ezkey.ko 2023-07-14T12:36:57.392 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gaff.ko 2023-07-14T12:36:57.392 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-generic.ko 2023-07-14T12:36:57.392 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gt683r.ko 2023-07-14T12:36:57.392 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gyration.ko 2023-07-14T12:36:57.392 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-14T12:36:57.392 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-14T12:36:57.393 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtekff.ko 2023-07-14T12:36:57.393 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19041 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-hyperv.ko 2023-07-14T12:36:57.393 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-icade.ko 2023-07-14T12:36:57.393 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-kensington.ko 2023-07-14T12:36:57.393 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-keytouch.ko 2023-07-14T12:36:57.393 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17201 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-kye.ko 2023-07-14T12:36:57.393 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-lcpower.ko 2023-07-14T12:36:57.393 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-led.ko 2023-07-14T12:36:57.394 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 42297 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-lenovo.ko 2023-07-14T12:36:57.394 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30761 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-lg-g15.ko 2023-07-14T12:36:57.394 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 57809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-14T12:36:57.394 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 100897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-14T12:36:57.394 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 80993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-logitech.ko 2023-07-14T12:36:57.394 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-magicmouse.ko 2023-07-14T12:36:57.394 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-microsoft.ko 2023-07-14T12:36:57.394 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10361 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-monterey.ko 2023-07-14T12:36:57.395 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 50153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-multitouch.ko 2023-07-14T12:36:57.395 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-ntrig.ko 2023-07-14T12:36:57.395 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-ortek.ko 2023-07-14T12:36:57.395 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-penmount.ko 2023-07-14T12:36:57.395 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12289 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-petalynx.ko 2023-07-14T12:36:57.395 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 72937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-picolcd.ko 2023-07-14T12:36:57.395 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-pl.ko 2023-07-14T12:36:57.395 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-plantronics.ko 2023-07-14T12:36:57.396 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-primax.ko 2023-07-14T12:36:57.396 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-rmi.ko 2023-07-14T12:36:57.396 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20761 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-14T12:36:57.396 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-common.ko 2023-07-14T12:36:57.396 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31361 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-14T12:36:57.396 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-14T12:36:57.396 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-14T12:36:57.397 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-14T12:36:57.397 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-14T12:36:57.397 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-14T12:36:57.397 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-14T12:36:57.397 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-14T12:36:57.397 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-14T12:36:57.397 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat.ko 2023-07-14T12:36:57.398 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-saitek.ko 2023-07-14T12:36:57.398 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15193 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-samsung.ko 2023-07-14T12:36:57.398 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-14T12:36:57.398 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sjoy.ko 2023-07-14T12:36:57.398 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51201 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sony.ko 2023-07-14T12:36:57.399 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-speedlink.ko 2023-07-14T12:36:57.399 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-steelseries.ko 2023-07-14T12:36:57.399 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sunplus.ko 2023-07-14T12:36:57.399 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-14T12:36:57.399 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-tivo.ko 2023-07-14T12:36:57.399 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-tmff.ko 2023-07-14T12:36:57.399 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-topseed.ko 2023-07-14T12:36:57.399 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-twinhan.ko 2023-07-14T12:36:57.400 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 71457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-uclogic.ko 2023-07-14T12:36:57.400 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-waltop.ko 2023-07-14T12:36:57.400 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 143585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-wiimote.ko 2023-07-14T12:36:57.400 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-xinmo.ko 2023-07-14T12:36:57.400 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-zpff.ko 2023-07-14T12:36:57.400 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-zydacron.ko 2023-07-14T12:36:57.400 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 267713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid.ko 2023-07-14T12:36:57.400 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/uhid.ko 2023-07-14T12:36:57.401 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/usbhid/ 2023-07-14T12:36:57.401 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 125721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/usbhid/usbhid.ko 2023-07-14T12:36:57.401 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19137 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/usbhid/usbkbd.ko 2023-07-14T12:36:57.401 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/usbhid/usbmouse.ko 2023-07-14T12:36:57.401 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 217401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/wacom.ko 2023-07-14T12:36:57.401 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/ 2023-07-14T12:36:57.401 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 63497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_balloon.ko 2023-07-14T12:36:57.402 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 89609 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_utils.ko 2023-07-14T12:36:57.402 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 301449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_vmbus.ko 2023-07-14T12:36:57.402 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ 2023-07-14T12:36:57.402 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 66593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/abituguru.ko 2023-07-14T12:36:57.402 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 61393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/abituguru3.ko 2023-07-14T12:36:57.402 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-14T12:36:57.402 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ad7414.ko 2023-07-14T12:36:57.402 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ad7418.ko 2023-07-14T12:36:57.403 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adc128d818.ko 2023-07-14T12:36:57.403 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1025.ko 2023-07-14T12:36:57.403 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 97977 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1026.ko 2023-07-14T12:36:57.403 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1029.ko 2023-07-14T12:36:57.403 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 45553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1031.ko 2023-07-14T12:36:57.403 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26289 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm9240.ko 2023-07-14T12:36:57.403 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14769 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ads7828.ko 2023-07-14T12:36:57.403 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10769 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7410.ko 2023-07-14T12:36:57.404 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7411.ko 2023-07-14T12:36:57.404 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 74433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7462.ko 2023-07-14T12:36:57.404 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 39585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7470.ko 2023-07-14T12:36:57.404 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 67929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7475.ko 2023-07-14T12:36:57.404 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7x10.ko 2023-07-14T12:36:57.404 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 39073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/amc6821.ko 2023-07-14T12:36:57.404 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 55265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/applesmc.ko 2023-07-14T12:36:57.405 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 49913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asb100.ko 2023-07-14T12:36:57.405 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 58617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asc7621.ko 2023-07-14T12:36:57.405 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 40881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-14T12:36:57.405 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/atxp1.ko 2023-07-14T12:36:57.405 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28281 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/coretemp.ko 2023-07-14T12:36:57.405 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/da9052-hwmon.ko 2023-07-14T12:36:57.405 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/da9055-hwmon.ko 2023-07-14T12:36:57.405 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 44465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-14T12:36:57.406 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 99601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/dme1737.ko 2023-07-14T12:36:57.406 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ds1621.ko 2023-07-14T12:36:57.406 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ds620.ko 2023-07-14T12:36:57.406 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29777 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/emc1403.ko 2023-07-14T12:36:57.406 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/emc2103.ko 2023-07-14T12:36:57.406 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/emc6w201.ko 2023-07-14T12:36:57.406 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 66985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f71805f.ko 2023-07-14T12:36:57.406 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 94457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f71882fg.ko 2023-07-14T12:36:57.407 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 41401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f75375s.ko 2023-07-14T12:36:57.407 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/fam15h_power.ko 2023-07-14T12:36:57.407 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 55433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/fschmd.ko 2023-07-14T12:36:57.407 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14481 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/g760a.ko 2023-07-14T12:36:57.407 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/g762.ko 2023-07-14T12:36:57.407 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 46801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/gl518sm.ko 2023-07-14T12:36:57.407 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 45529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/gl520sm.ko 2023-07-14T12:36:57.408 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/hih6130.ko 2023-07-14T12:36:57.408 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-14T12:36:57.408 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/i5500_temp.ko 2023-07-14T12:36:57.408 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/i5k_amb.ko 2023-07-14T12:36:57.408 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ibmaem.ko 2023-07-14T12:36:57.408 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21297 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ibmpex.ko 2023-07-14T12:36:57.408 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ina209.ko 2023-07-14T12:36:57.409 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ina2xx.ko 2023-07-14T12:36:57.409 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 129217 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/it87.ko 2023-07-14T12:36:57.409 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/jc42.ko 2023-07-14T12:36:57.409 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/k10temp.ko 2023-07-14T12:36:57.409 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/k8temp.ko 2023-07-14T12:36:57.409 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lineage-pem.ko 2023-07-14T12:36:57.409 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 48601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm63.ko 2023-07-14T12:36:57.409 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16761 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm73.ko 2023-07-14T12:36:57.410 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36777 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm75.ko 2023-07-14T12:36:57.410 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm77.ko 2023-07-14T12:36:57.410 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm78.ko 2023-07-14T12:36:57.410 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm80.ko 2023-07-14T12:36:57.410 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm83.ko 2023-07-14T12:36:57.410 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 72833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm85.ko 2023-07-14T12:36:57.410 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 46153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm87.ko 2023-07-14T12:36:57.411 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm90.ko 2023-07-14T12:36:57.411 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm92.ko 2023-07-14T12:36:57.411 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 108841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm93.ko 2023-07-14T12:36:57.411 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95234.ko 2023-07-14T12:36:57.411 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95241.ko 2023-07-14T12:36:57.411 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95245.ko 2023-07-14T12:36:57.411 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc2945.ko 2023-07-14T12:36:57.411 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4151.ko 2023-07-14T12:36:57.412 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15193 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4215.ko 2023-07-14T12:36:57.412 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4222.ko 2023-07-14T12:36:57.412 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4245.ko 2023-07-14T12:36:57.412 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4260.ko 2023-07-14T12:36:57.412 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4261.ko 2023-07-14T12:36:57.412 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max16065.ko 2023-07-14T12:36:57.413 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max1619.ko 2023-07-14T12:36:57.413 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24353 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max1668.ko 2023-07-14T12:36:57.413 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max197.ko 2023-07-14T12:36:57.413 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6639.ko 2023-07-14T12:36:57.413 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6650.ko 2023-07-14T12:36:57.413 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35777 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6697.ko 2023-07-14T12:36:57.414 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/mc13783-adc.ko 2023-07-14T12:36:57.414 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/mcp3021.ko 2023-07-14T12:36:57.414 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-07-14T12:36:57.414 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 44129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6683.ko 2023-07-14T12:36:57.414 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 116737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6775-core.ko 2023-07-14T12:36:57.414 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 60705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6775.ko 2023-07-14T12:36:57.414 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 59737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct7802.ko 2023-07-14T12:36:57.414 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 82337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pc87360.ko 2023-07-14T12:36:57.415 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 54433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pc87427.ko 2023-07-14T12:36:57.415 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pcf8591.ko 2023-07-14T12:36:57.415 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ 2023-07-14T12:36:57.415 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21353 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-14T12:36:57.415 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-14T12:36:57.415 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-14T12:36:57.415 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9577 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-14T12:36:57.415 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-14T12:36:57.416 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-14T12:36:57.416 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-14T12:36:57.416 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 81841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-14T12:36:57.416 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-14T12:36:57.416 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-14T12:36:57.416 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-14T12:36:57.416 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-14T12:36:57.417 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/powr1220.ko 2023-07-14T12:36:57.417 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch5627.ko 2023-07-14T12:36:57.417 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch5636.ko 2023-07-14T12:36:57.417 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-14T12:36:57.417 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32137 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sht15.ko 2023-07-14T12:36:57.417 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sht21.ko 2023-07-14T12:36:57.417 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/shtc1.ko 2023-07-14T12:36:57.417 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 40105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sis5595.ko 2023-07-14T12:36:57.418 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smm665.ko 2023-07-14T12:36:57.418 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19577 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47b397.ko 2023-07-14T12:36:57.418 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 39193 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47m1.ko 2023-07-14T12:36:57.418 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47m192.ko 2023-07-14T12:36:57.418 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/thmc50.ko 2023-07-14T12:36:57.418 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp102.ko 2023-07-14T12:36:57.419 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp103.ko 2023-07-14T12:36:57.419 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp401.ko 2023-07-14T12:36:57.419 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp421.ko 2023-07-14T12:36:57.419 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19697 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/via-cputemp.ko 2023-07-14T12:36:57.419 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 41945 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/via686a.ko 2023-07-14T12:36:57.419 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 52457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/vt1211.ko 2023-07-14T12:36:57.419 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/vt8231.ko 2023-07-14T12:36:57.420 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 57513 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83627ehf.ko 2023-07-14T12:36:57.420 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 78873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83627hf.ko 2023-07-14T12:36:57.420 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 71345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83781d.ko 2023-07-14T12:36:57.420 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 63289 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83791d.ko 2023-07-14T12:36:57.420 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 71321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83792d.ko 2023-07-14T12:36:57.420 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 101457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83793.ko 2023-07-14T12:36:57.420 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 119505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83795.ko 2023-07-14T12:36:57.421 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83l785ts.ko 2023-07-14T12:36:57.421 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83l786ng.ko 2023-07-14T12:36:57.421 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-07-14T12:36:57.421 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-07-14T12:36:57.421 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/ 2023-07-14T12:36:57.421 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos/ 2023-07-14T12:36:57.421 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-14T12:36:57.421 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-14T12:36:57.422 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/ 2023-07-14T12:36:57.422 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-07-14T12:36:57.422 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-07-14T12:36:57.422 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27777 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-07-14T12:36:57.422 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-14T12:36:57.422 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26193 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-14T12:36:57.422 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16201 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-14T12:36:57.423 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-07-14T12:36:57.423 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 6929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-14T12:36:57.423 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-07-14T12:36:57.423 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 48553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-14T12:36:57.423 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23905 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-14T12:36:57.423 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-14T12:36:57.423 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-14T12:36:57.423 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-07-14T12:36:57.424 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-07-14T12:36:57.424 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 62729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-14T12:36:57.424 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-14T12:36:57.424 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-14T12:36:57.424 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17369 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-07-14T12:36:57.424 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-14T12:36:57.424 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-14T12:36:57.424 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-07-14T12:36:57.425 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-14T12:36:57.425 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-14T12:36:57.425 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-14T12:36:57.425 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15289 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-07-14T12:36:57.425 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-14T12:36:57.425 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-14T12:36:57.425 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-07-14T12:36:57.425 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29361 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-07-14T12:36:57.426 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-14T12:36:57.426 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-07-14T12:36:57.426 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-14T12:36:57.426 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-14T12:36:57.426 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-14T12:36:57.426 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19041 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-14T12:36:57.426 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-07-14T12:36:57.427 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-mux.ko 2023-07-14T12:36:57.427 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-smbus.ko 2023-07-14T12:36:57.427 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-stub.ko 2023-07-14T12:36:57.427 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/muxes/ 2023-07-14T12:36:57.427 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-07-14T12:36:57.427 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-07-14T12:36:57.427 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-07-14T12:36:57.428 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ 2023-07-14T12:36:57.428 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ 2023-07-14T12:36:57.428 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 273641 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-14T12:36:57.428 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 876913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_core.ko 2023-07-14T12:36:57.428 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 69321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-14T12:36:57.428 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 324145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-14T12:36:57.428 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 97961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-14T12:36:57.428 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 279321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-14T12:36:57.429 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 66177 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-14T12:36:57.429 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/ 2023-07-14T12:36:57.429 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/cxgb4/ 2023-07-14T12:36:57.429 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 492561 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-14T12:36:57.429 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx4/ 2023-07-14T12:36:57.429 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 419217 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-14T12:36:57.429 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx5/ 2023-07-14T12:36:57.429 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 739705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-14T12:36:57.430 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mthca/ 2023-07-14T12:36:57.430 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 296649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-14T12:36:57.430 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/ocrdma/ 2023-07-14T12:36:57.430 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 153681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-07-14T12:36:57.430 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/usnic/ 2023-07-14T12:36:57.430 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 169017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-07-14T12:36:57.430 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/ 2023-07-14T12:36:57.430 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/ipoib/ 2023-07-14T12:36:57.431 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 263177 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-14T12:36:57.431 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/iser/ 2023-07-14T12:36:57.431 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 100225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-14T12:36:57.431 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/isert/ 2023-07-14T12:36:57.431 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 111993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-14T12:36:57.431 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srp/ 2023-07-14T12:36:57.431 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 129081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-14T12:36:57.432 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srpt/ 2023-07-14T12:36:57.432 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 129553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-14T12:36:57.432 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/ 2023-07-14T12:36:57.432 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/evbug.ko 2023-07-14T12:36:57.432 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/ff-memless.ko 2023-07-14T12:36:57.432 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/ 2023-07-14T12:36:57.432 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-14T12:36:57.432 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-14T12:36:57.433 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 41217 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/gameport.ko 2023-07-14T12:36:57.433 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/lightning.ko 2023-07-14T12:36:57.433 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/ns558.ko 2023-07-14T12:36:57.433 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 41825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/joydev.ko 2023-07-14T12:36:57.433 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/ 2023-07-14T12:36:57.433 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-07-14T12:36:57.433 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-07-14T12:36:57.434 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26905 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-07-14T12:36:57.434 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24761 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-07-14T12:36:57.434 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-14T12:36:57.434 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-07-14T12:36:57.434 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/lkkbd.ko 2023-07-14T12:36:57.434 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/lm8323.ko 2023-07-14T12:36:57.434 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/lm8333.ko 2023-07-14T12:36:57.434 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-07-14T12:36:57.435 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18217 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-07-14T12:36:57.435 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-07-14T12:36:57.435 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-07-14T12:36:57.435 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/newtonkbd.ko 2023-07-14T12:36:57.436 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-07-14T12:36:57.436 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15209 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/qt1070.ko 2023-07-14T12:36:57.436 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/qt2160.ko 2023-07-14T12:36:57.436 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-07-14T12:36:57.436 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11481 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/stowaway.ko 2023-07-14T12:36:57.436 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18289 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/sunkbd.ko 2023-07-14T12:36:57.436 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-07-14T12:36:57.437 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16177 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-07-14T12:36:57.437 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-07-14T12:36:57.437 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/xtkbd.ko 2023-07-14T12:36:57.437 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/matrix-keymap.ko 2023-07-14T12:36:57.437 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/ 2023-07-14T12:36:57.437 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/appletouch.ko 2023-07-14T12:36:57.437 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34177 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/bcm5974.ko 2023-07-14T12:36:57.438 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 123681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/cyapatp.ko 2023-07-14T12:36:57.438 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 89449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-14T12:36:57.438 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14025 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/gpio_mouse.ko 2023-07-14T12:36:57.438 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 335849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/psmouse.ko 2023-07-14T12:36:57.438 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/sermouse.ko 2023-07-14T12:36:57.438 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-14T12:36:57.438 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22569 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-14T12:36:57.438 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-14T12:36:57.439 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/rmi4/ 2023-07-14T12:36:57.439 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 109849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-14T12:36:57.439 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/ 2023-07-14T12:36:57.439 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/altera_ps2.ko 2023-07-14T12:36:57.439 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16289 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/arc_ps2.ko 2023-07-14T12:36:57.439 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/ct82c710.ko 2023-07-14T12:36:57.439 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-14T12:36:57.439 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/parkbd.ko 2023-07-14T12:36:57.440 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/pcips2.ko 2023-07-14T12:36:57.440 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/ps2mult.ko 2023-07-14T12:36:57.440 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/serio_raw.ko 2023-07-14T12:36:57.440 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17977 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/serport.ko 2023-07-14T12:36:57.440 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/sparse-keymap.ko 2023-07-14T12:36:57.440 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu/ 2023-07-14T12:36:57.440 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu/amd/ 2023-07-14T12:36:57.441 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-14T12:36:57.441 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/ 2023-07-14T12:36:57.441 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-88pm860x.ko 2023-07-14T12:36:57.441 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-adp5520.ko 2023-07-14T12:36:57.441 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 59753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-bd2802.ko 2023-07-14T12:36:57.441 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-blinkm.ko 2023-07-14T12:36:57.441 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-da903x.ko 2023-07-14T12:36:57.441 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-da9052.ko 2023-07-14T12:36:57.442 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16561 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-gpio.ko 2023-07-14T12:36:57.442 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lm3530.ko 2023-07-14T12:36:57.442 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lm3533.ko 2023-07-14T12:36:57.442 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19353 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lm355x.ko 2023-07-14T12:36:57.442 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lm3642.ko 2023-07-14T12:36:57.442 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lp3944.ko 2023-07-14T12:36:57.442 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11233 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lp8788.ko 2023-07-14T12:36:57.442 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-max8997.ko 2023-07-14T12:36:57.443 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12609 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-mc13783.ko 2023-07-14T12:36:57.443 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-menf21bmc.ko 2023-07-14T12:36:57.443 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-pca9532.ko 2023-07-14T12:36:57.443 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20481 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-pca955x.ko 2023-07-14T12:36:57.443 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-pca963x.ko 2023-07-14T12:36:57.443 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-ss4200.ko 2023-07-14T12:36:57.443 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-tca6507.ko 2023-07-14T12:36:57.444 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-wm831x-status.ko 2023-07-14T12:36:57.444 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-wm8350.ko 2023-07-14T12:36:57.444 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ 2023-07-14T12:36:57.444 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-14T12:36:57.444 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-14T12:36:57.444 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-14T12:36:57.444 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-14T12:36:57.444 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-14T12:36:57.445 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-14T12:36:57.445 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-14T12:36:57.445 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-14T12:36:57.445 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/ 2023-07-14T12:36:57.445 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/bcache/ 2023-07-14T12:36:57.446 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 655473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/bcache/bcache.ko 2023-07-14T12:36:57.446 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 40569 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-bio-prison.ko 2023-07-14T12:36:57.446 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 89601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-bufio.ko 2023-07-14T12:36:57.446 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-cache-smq.ko 2023-07-14T12:36:57.446 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 155993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-cache.ko 2023-07-14T12:36:57.446 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 107049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-crypt.ko 2023-07-14T12:36:57.446 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-delay.ko 2023-07-14T12:36:57.446 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 53897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-era.ko 2023-07-14T12:36:57.447 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-flakey.ko 2023-07-14T12:36:57.447 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 41593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-log-userspace.ko 2023-07-14T12:36:57.447 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-log.ko 2023-07-14T12:36:57.447 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 49545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-mirror.ko 2023-07-14T12:36:57.447 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 78017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-multipath.ko 2023-07-14T12:36:57.447 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-queue-length.ko 2023-07-14T12:36:57.447 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 70769 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-raid.ko 2023-07-14T12:36:57.448 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-region-hash.ko 2023-07-14T12:36:57.448 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-round-robin.ko 2023-07-14T12:36:57.448 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-service-time.ko 2023-07-14T12:36:57.448 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 109593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-snapshot.ko 2023-07-14T12:36:57.448 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19361 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-switch.ko 2023-07-14T12:36:57.448 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 181585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-thin-pool.ko 2023-07-14T12:36:57.448 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-verity.ko 2023-07-14T12:36:57.448 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-zero.ko 2023-07-14T12:36:57.449 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/faulty.ko 2023-07-14T12:36:57.449 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/linear.ko 2023-07-14T12:36:57.449 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/multipath.ko 2023-07-14T12:36:57.449 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/persistent-data/ 2023-07-14T12:36:57.449 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 199937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-14T12:36:57.449 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid0.ko 2023-07-14T12:36:57.449 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 112609 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid1.ko 2023-07-14T12:36:57.449 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 160553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid10.ko 2023-07-14T12:36:57.450 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 396153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid456.ko 2023-07-14T12:36:57.450 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/ 2023-07-14T12:36:57.450 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/ 2023-07-14T12:36:57.450 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 178113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptbase.ko 2023-07-14T12:36:57.450 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 63385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptctl.ko 2023-07-14T12:36:57.450 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 44649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptfc.ko 2023-07-14T12:36:57.450 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptlan.ko 2023-07-14T12:36:57.450 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 123305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptsas.ko 2023-07-14T12:36:57.451 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 79017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptscsih.ko 2023-07-14T12:36:57.451 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 53081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptspi.ko 2023-07-14T12:36:57.451 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/ 2023-07-14T12:36:57.451 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/88pm800.ko 2023-07-14T12:36:57.451 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12761 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/88pm805.ko 2023-07-14T12:36:57.451 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11193 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/88pm80x.ko 2023-07-14T12:36:57.451 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/arizona-i2c.ko 2023-07-14T12:36:57.451 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 123721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/arizona.ko 2023-07-14T12:36:57.452 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/bcm590xx.ko 2023-07-14T12:36:57.452 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/cros_ec_dev.ko 2023-07-14T12:36:57.452 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/dln2.ko 2023-07-14T12:36:57.452 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16689 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/janz-cmodio.ko 2023-07-14T12:36:57.452 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 53585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/kempld-core.ko 2023-07-14T12:36:57.452 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/lm3533-core.ko 2023-07-14T12:36:57.452 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-07-14T12:36:57.453 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13009 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/lp3943.ko 2023-07-14T12:36:57.453 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 54569 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/lpc_ich.ko 2023-07-14T12:36:57.453 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/lpc_sch.ko 2023-07-14T12:36:57.453 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17409 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/max8907.ko 2023-07-14T12:36:57.453 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/mc13xxx-core.ko 2023-07-14T12:36:57.453 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-07-14T12:36:57.453 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/menf21bmc.ko 2023-07-14T12:36:57.453 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/pcf50633-adc.ko 2023-07-14T12:36:57.454 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/pcf50633-gpio.ko 2023-07-14T12:36:57.454 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/pcf50633.ko 2023-07-14T12:36:57.454 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-07-14T12:36:57.454 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20289 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/retu-mfd.ko 2023-07-14T12:36:57.454 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 80425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/si476x-core.ko 2023-07-14T12:36:57.454 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 48441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/sm501.ko 2023-07-14T12:36:57.454 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-07-14T12:36:57.454 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51137 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/tps65010.ko 2023-07-14T12:36:57.455 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/tps6507x.ko 2023-07-14T12:36:57.455 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/viperboard.ko 2023-07-14T12:36:57.455 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/vx855.ko 2023-07-14T12:36:57.455 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/wl1273-core.ko 2023-07-14T12:36:57.455 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 44345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/wm8994.ko 2023-07-14T12:36:57.455 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/ 2023-07-14T12:36:57.455 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-07-14T12:36:57.456 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 48489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/ad525x_dpot.ko 2023-07-14T12:36:57.456 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/altera-stapl/ 2023-07-14T12:36:57.456 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 46585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-14T12:36:57.456 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/apds9802als.ko 2023-07-14T12:36:57.456 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/apds990x.ko 2023-07-14T12:36:57.456 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 45593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/bh1770glc.ko 2023-07-14T12:36:57.456 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/c2port/ 2023-07-14T12:36:57.456 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-07-14T12:36:57.457 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/c2port/core.ko 2023-07-14T12:36:57.457 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/cb710/ 2023-07-14T12:36:57.457 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/cb710/cb710.ko 2023-07-14T12:36:57.457 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/ds1682.ko 2023-07-14T12:36:57.457 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/dummy-irq.ko 2023-07-14T12:36:57.457 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/echo/ 2023-07-14T12:36:57.457 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/echo/echo.ko 2023-07-14T12:36:57.457 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/ 2023-07-14T12:36:57.458 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/at24.ko 2023-07-14T12:36:57.458 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-14T12:36:57.458 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14769 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-14T12:36:57.458 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/max6875.ko 2023-07-14T12:36:57.458 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/enclosure.ko 2023-07-14T12:36:57.458 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/genwqe/ 2023-07-14T12:36:57.458 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 152137 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-07-14T12:36:57.458 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/hmc6352.ko 2023-07-14T12:36:57.459 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31193 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/hpilo.ko 2023-07-14T12:36:57.459 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/ibmasm/ 2023-07-14T12:36:57.459 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 72601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-07-14T12:36:57.459 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/ics932s401.ko 2023-07-14T12:36:57.459 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/isl29003.ko 2023-07-14T12:36:57.459 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/isl29020.ko 2023-07-14T12:36:57.459 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d/ 2023-07-14T12:36:57.460 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 42585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-14T12:36:57.460 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-14T12:36:57.460 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/ 2023-07-14T12:36:57.460 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 125209 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei-me.ko 2023-07-14T12:36:57.460 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 56521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei-txe.ko 2023-07-14T12:36:57.460 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 309857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei.ko 2023-07-14T12:36:57.460 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/phantom.ko 2023-07-14T12:36:57.460 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/ti-st/ 2023-07-14T12:36:57.461 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 74905 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/ti-st/st_drv.ko 2023-07-14T12:36:57.461 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tifm_7xx1.ko 2023-07-14T12:36:57.461 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tifm_core.ko 2023-07-14T12:36:57.461 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tsl2550.ko 2023-07-14T12:36:57.461 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 48673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_balloon.ko 2023-07-14T12:36:57.461 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_vmci/ 2023-07-14T12:36:57.461 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 183857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-14T12:36:57.461 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ 2023-07-14T12:36:57.462 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/bonding/ 2023-07-14T12:36:57.462 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 487801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/bonding/bonding.ko 2023-07-14T12:36:57.462 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/ 2023-07-14T12:36:57.462 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/b53/ 2023-07-14T12:36:57.462 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 106009 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-14T12:36:57.462 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 40281 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-14T12:36:57.462 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14689 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-14T12:36:57.463 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6xxx/ 2023-07-14T12:36:57.463 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 452481 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-14T12:36:57.463 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dummy.ko 2023-07-14T12:36:57.463 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17945 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/eql.ko 2023-07-14T12:36:57.463 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ 2023-07-14T12:36:57.463 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/ 2023-07-14T12:36:57.463 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 45785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-14T12:36:57.463 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 42105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-14T12:36:57.464 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 130489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-14T12:36:57.464 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 68785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-14T12:36:57.464 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/ 2023-07-14T12:36:57.464 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-14T12:36:57.464 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 59689 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-14T12:36:57.464 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27193 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-14T12:36:57.464 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 99113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-14T12:36:57.464 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/adaptec/ 2023-07-14T12:36:57.465 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 54521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-14T12:36:57.465 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/agere/ 2023-07-14T12:36:57.465 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 69145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-14T12:36:57.465 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/alteon/ 2023-07-14T12:36:57.465 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 59521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-14T12:36:57.465 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/altera/ 2023-07-14T12:36:57.465 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 41393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-14T12:36:57.465 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/ 2023-07-14T12:36:57.466 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 54545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-14T12:36:57.466 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 49225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-14T12:36:57.466 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 87345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-14T12:36:57.466 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/ 2023-07-14T12:36:57.466 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/alx/ 2023-07-14T12:36:57.466 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 97321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-14T12:36:57.466 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-07-14T12:36:57.467 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 104585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-14T12:36:57.467 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-07-14T12:36:57.467 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 90257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-14T12:36:57.467 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx/ 2023-07-14T12:36:57.467 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 81505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-14T12:36:57.467 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 69713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-14T12:36:57.467 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/ 2023-07-14T12:36:57.467 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 78401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-14T12:36:57.468 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 176881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-14T12:36:57.468 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-07-14T12:36:57.468 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 1422209 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-14T12:36:57.468 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 128377 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-14T12:36:57.468 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/genet/ 2023-07-14T12:36:57.468 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 132289 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-14T12:36:57.468 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 312145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-14T12:36:57.468 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade/ 2023-07-14T12:36:57.469 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade/bna/ 2023-07-14T12:36:57.469 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 323601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-14T12:36:57.469 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/ 2023-07-14T12:36:57.469 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-07-14T12:36:57.469 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 193433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-14T12:36:57.469 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-07-14T12:36:57.469 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 347641 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-14T12:36:57.470 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-07-14T12:36:57.470 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 1044145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-14T12:36:57.470 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-07-14T12:36:57.470 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 166113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-14T12:36:57.470 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-07-14T12:36:57.470 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-14T12:36:57.470 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco/ 2023-07-14T12:36:57.470 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco/enic/ 2023-07-14T12:36:57.471 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 204329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-14T12:36:57.471 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/ 2023-07-14T12:36:57.471 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/ 2023-07-14T12:36:57.471 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 69449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-14T12:36:57.471 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 61489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-14T12:36:57.471 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 141161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-14T12:36:57.471 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-14T12:36:57.472 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 62865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-14T12:36:57.472 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-14T12:36:57.472 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink/ 2023-07-14T12:36:57.472 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 60873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-14T12:36:57.472 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 62833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-14T12:36:57.472 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 45721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dnet.ko 2023-07-14T12:36:57.472 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25233 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ec_bhf.ko 2023-07-14T12:36:57.472 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex/ 2023-07-14T12:36:57.473 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex/benet/ 2023-07-14T12:36:57.473 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 281329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-14T12:36:57.473 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 49505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ethoc.ko 2023-07-14T12:36:57.473 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/fealnx.ko 2023-07-14T12:36:57.473 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/fujitsu/ 2023-07-14T12:36:57.473 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 45281 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-07-14T12:36:57.473 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ 2023-07-14T12:36:57.473 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 90465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-14T12:36:57.474 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000/ 2023-07-14T12:36:57.474 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 295713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-14T12:36:57.474 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000e/ 2023-07-14T12:36:57.474 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 584249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-14T12:36:57.474 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/fm10k/ 2023-07-14T12:36:57.474 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 246321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-14T12:36:57.474 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/i40e/ 2023-07-14T12:36:57.475 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 923969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-14T12:36:57.475 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/iavf/ 2023-07-14T12:36:57.475 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 298097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-14T12:36:57.475 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igb/ 2023-07-14T12:36:57.475 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 514889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-14T12:36:57.475 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igbvf/ 2023-07-14T12:36:57.475 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 93593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-14T12:36:57.475 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-07-14T12:36:57.476 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 734297 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-14T12:36:57.476 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-07-14T12:36:57.476 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 151841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-14T12:36:57.476 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 86921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/jme.ko 2023-07-14T12:36:57.476 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/ 2023-07-14T12:36:57.476 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20977 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-14T12:36:57.476 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 102385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-14T12:36:57.476 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 122681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-14T12:36:57.477 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/ 2023-07-14T12:36:57.477 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-07-14T12:36:57.477 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 727433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-14T12:36:57.477 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 280513 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-14T12:36:57.477 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-07-14T12:36:57.477 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-07-14T12:36:57.477 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 1095817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-14T12:36:57.478 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/micrel/ 2023-07-14T12:36:57.478 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 53041 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-07-14T12:36:57.478 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 40993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-07-14T12:36:57.478 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-07-14T12:36:57.478 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 95665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-14T12:36:57.478 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom/ 2023-07-14T12:36:57.478 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-07-14T12:36:57.478 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 108809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-14T12:36:57.479 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi/ 2023-07-14T12:36:57.479 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 73377 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-14T12:36:57.479 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-14T12:36:57.479 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/neterion/ 2023-07-14T12:36:57.479 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 150905 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-14T12:36:57.479 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/nvidia/ 2023-07-14T12:36:57.479 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 136785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-14T12:36:57.479 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines/ 2023-07-14T12:36:57.480 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 50481 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-14T12:36:57.480 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 43145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-14T12:36:57.480 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/ 2023-07-14T12:36:57.480 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-07-14T12:36:57.480 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 227113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-14T12:36:57.480 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 87081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-14T12:36:57.480 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-07-14T12:36:57.481 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 671393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-14T12:36:57.481 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rdc/ 2023-07-14T12:36:57.481 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 43017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-14T12:36:57.481 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/ 2023-07-14T12:36:57.481 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 67385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-14T12:36:57.481 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 83921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-14T12:36:57.481 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-14T12:36:57.481 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 190089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-14T12:36:57.482 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/samsung/ 2023-07-14T12:36:57.482 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-07-14T12:36:57.482 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 104241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-07-14T12:36:57.482 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sfc/ 2023-07-14T12:36:57.482 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 952881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-14T12:36:57.482 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/silan/ 2023-07-14T12:36:57.482 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47177 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-14T12:36:57.482 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis/ 2023-07-14T12:36:57.483 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 54809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-14T12:36:57.483 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 63273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-14T12:36:57.483 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/ 2023-07-14T12:36:57.483 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 61537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-14T12:36:57.483 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 67129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-14T12:36:57.483 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 73345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-14T12:36:57.483 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 68209 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-14T12:36:57.483 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/ 2023-07-14T12:36:57.484 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-07-14T12:36:57.484 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-07-14T12:36:57.484 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 40137 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-14T12:36:57.484 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20769 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-07-14T12:36:57.484 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 481681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-14T12:36:57.484 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/ 2023-07-14T12:36:57.484 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 103321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-14T12:36:57.485 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 166121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-14T12:36:57.485 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 66473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-14T12:36:57.485 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 78737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-14T12:36:57.485 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/tehuti/ 2023-07-14T12:36:57.485 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 49993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-14T12:36:57.485 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ti/ 2023-07-14T12:36:57.485 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 86465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-14T12:36:57.486 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via/ 2023-07-14T12:36:57.486 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 80257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-14T12:36:57.486 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 83681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-14T12:36:57.486 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet/ 2023-07-14T12:36:57.486 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 46241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-14T12:36:57.486 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-14T12:36:57.486 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/xircom/ 2023-07-14T12:36:57.486 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 60041 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-14T12:36:57.487 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/fddi/ 2023-07-14T12:36:57.487 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 41001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/fddi/defxx.ko 2023-07-14T12:36:57.487 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/fddi/skfp/ 2023-07-14T12:36:57.487 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 216977 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/fddi/skfp/skfp.ko 2023-07-14T12:36:57.487 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 77401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/geneve.ko 2023-07-14T12:36:57.487 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/hyperv/ 2023-07-14T12:36:57.487 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 235593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-14T12:36:57.488 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ieee802154/ 2023-07-14T12:36:57.488 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-14T12:36:57.488 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ifb.ko 2023-07-14T12:36:57.488 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ipvlan/ 2023-07-14T12:36:57.488 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 83737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-14T12:36:57.488 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 62065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/macvlan.ko 2023-07-14T12:36:57.488 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/macvtap.ko 2023-07-14T12:36:57.488 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/ 2023-07-14T12:36:57.489 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-14T12:36:57.489 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-14T12:36:57.489 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-gpio.ko 2023-07-14T12:36:57.489 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-regmap.ko 2023-07-14T12:36:57.489 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16025 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio.ko 2023-07-14T12:36:57.489 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20513 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mii.ko 2023-07-14T12:36:57.489 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 41697 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/netconsole.ko 2023-07-14T12:36:57.489 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/nlmon.ko 2023-07-14T12:36:57.490 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs/ 2023-07-14T12:36:57.490 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs/pcs-lynx.ko 2023-07-14T12:36:57.490 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-14T12:36:57.490 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/ 2023-07-14T12:36:57.490 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/amd.ko 2023-07-14T12:36:57.490 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 50097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-14T12:36:57.490 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 43273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-14T12:36:57.491 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm87xx.ko 2023-07-14T12:36:57.491 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 41337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/broadcom.ko 2023-07-14T12:36:57.491 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10561 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/cicada.ko 2023-07-14T12:36:57.491 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/davicom.ko 2023-07-14T12:36:57.491 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/et1011c.ko 2023-07-14T12:36:57.491 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24905 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/icplus.ko 2023-07-14T12:36:57.491 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/lxt.ko 2023-07-14T12:36:57.491 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 78185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/marvell.ko 2023-07-14T12:36:57.492 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 75713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/micrel.ko 2023-07-14T12:36:57.492 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12033 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/national.ko 2023-07-14T12:36:57.492 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 97265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/phylink.ko 2023-07-14T12:36:57.492 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/qsemi.ko 2023-07-14T12:36:57.492 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 49553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/realtek.ko 2023-07-14T12:36:57.492 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/smsc.ko 2023-07-14T12:36:57.492 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/ste10Xp.ko 2023-07-14T12:36:57.492 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24033 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/vitesse.ko 2023-07-14T12:36:57.493 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/plip/ 2023-07-14T12:36:57.493 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 43465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/plip/plip.ko 2023-07-14T12:36:57.493 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ 2023-07-14T12:36:57.493 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-14T12:36:57.493 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_async.ko 2023-07-14T12:36:57.493 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-14T12:36:57.493 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-14T12:36:57.494 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28945 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-14T12:36:57.494 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 42545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pppoe.ko 2023-07-14T12:36:57.494 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pppox.ko 2023-07-14T12:36:57.494 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pptp.ko 2023-07-14T12:36:57.494 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/sb1000.ko 2023-07-14T12:36:57.494 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip/ 2023-07-14T12:36:57.494 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 42513 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip/slip.ko 2023-07-14T12:36:57.494 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/sungem_phy.ko 2023-07-14T12:36:57.495 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 64889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/tap.ko 2023-07-14T12:36:57.495 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/ 2023-07-14T12:36:57.495 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 105961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team.ko 2023-07-14T12:36:57.495 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-14T12:36:57.495 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10209 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-14T12:36:57.495 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-14T12:36:57.495 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9641 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_random.ko 2023-07-14T12:36:57.496 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-14T12:36:57.496 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 88193 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/veth.ko 2023-07-14T12:36:57.496 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vmxnet3/ 2023-07-14T12:36:57.496 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 120497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-14T12:36:57.496 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vxlan/ 2023-07-14T12:36:57.496 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 290665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vxlan/vxlan.ko 2023-07-14T12:36:57.496 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netback/ 2023-07-14T12:36:57.497 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 143801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-14T12:36:57.497 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ntb/ 2023-07-14T12:36:57.497 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ntb/ntb.ko 2023-07-14T12:36:57.497 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/ 2023-07-14T12:36:57.497 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host/ 2023-07-14T12:36:57.497 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 266561 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host/nvme-core.ko 2023-07-14T12:36:57.497 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 101937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host/nvme.ko 2023-07-14T12:36:57.498 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/ 2023-07-14T12:36:57.498 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 133817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport.ko 2023-07-14T12:36:57.498 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14561 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_cs.ko 2023-07-14T12:36:57.498 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 84337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_pc.ko 2023-07-14T12:36:57.498 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_serial.ko 2023-07-14T12:36:57.498 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/ 2023-07-14T12:36:57.498 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/hotplug/ 2023-07-14T12:36:57.498 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25009 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-14T12:36:57.499 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-07-14T12:36:57.499 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20137 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-07-14T12:36:57.499 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/pci-stub.ko 2023-07-14T12:36:57.499 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47377 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/xen-pcifront.ko 2023-07-14T12:36:57.499 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/ 2023-07-14T12:36:57.499 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/i82092.ko 2023-07-14T12:36:57.499 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 145785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/pcmcia.ko 2023-07-14T12:36:57.499 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 62081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/pcmcia_core.ko 2023-07-14T12:36:57.500 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-07-14T12:36:57.500 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/pd6729.ko 2023-07-14T12:36:57.500 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 112913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-14T12:36:57.500 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/phy/ 2023-07-14T12:36:57.500 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/phy/broadcom/ 2023-07-14T12:36:57.500 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-07-14T12:36:57.500 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/phy/samsung/ 2023-07-14T12:36:57.501 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-07-14T12:36:57.501 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl/ 2023-07-14T12:36:57.501 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl/intel/ 2023-07-14T12:36:57.501 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 71521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-14T12:36:57.501 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/ 2023-07-14T12:36:57.501 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/chrome/ 2023-07-14T12:36:57.501 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 50889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-07-14T12:36:57.502 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/chrome/cros_ec.ko 2023-07-14T12:36:57.502 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-07-14T12:36:57.502 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-07-14T12:36:57.502 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-07-14T12:36:57.502 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18201 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-07-14T12:36:57.502 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-07-14T12:36:57.502 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/ 2023-07-14T12:36:57.502 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 67097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-14T12:36:57.503 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 39145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/acerhdf.ko 2023-07-14T12:36:57.503 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-14T12:36:57.503 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 59665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-14T12:36:57.503 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-14T12:36:57.503 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 106873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-14T12:36:57.503 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-14T12:36:57.503 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 49121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-14T12:36:57.503 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-14T12:36:57.504 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 40265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-14T12:36:57.504 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-14T12:36:57.504 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/hdaps.ko 2023-07-14T12:36:57.504 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/ibm_rtl.ko 2023-07-14T12:36:57.504 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel/ 2023-07-14T12:36:57.504 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-14T12:36:57.504 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-07-14T12:36:57.505 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 43521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel_ips.ko 2023-07-14T12:36:57.505 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-14T12:36:57.505 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10377 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-14T12:36:57.505 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-14T12:36:57.505 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 42329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-14T12:36:57.505 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-14T12:36:57.505 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-14T12:36:57.505 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-14T12:36:57.506 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-14T12:36:57.506 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-14T12:36:57.506 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 57665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/wmi.ko 2023-07-14T12:36:57.506 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/ 2023-07-14T12:36:57.506 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/ 2023-07-14T12:36:57.506 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/88pm860x_battery.ko 2023-07-14T12:36:57.506 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/88pm860x_charger.ko 2023-07-14T12:36:57.506 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 55057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/bq2415x_charger.ko 2023-07-14T12:36:57.507 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 53993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/bq24190_charger.ko 2023-07-14T12:36:57.507 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/bq24735-charger.ko 2023-07-14T12:36:57.507 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-07-14T12:36:57.507 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19609 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/da9030_battery.ko 2023-07-14T12:36:57.507 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/da9052-battery.ko 2023-07-14T12:36:57.507 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29281 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/ds2760_battery.ko 2023-07-14T12:36:57.507 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23217 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/ds2780_battery.ko 2023-07-14T12:36:57.508 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23353 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/ds2781_battery.ko 2023-07-14T12:36:57.508 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/ds2782_battery.ko 2023-07-14T12:36:57.508 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20353 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/gpio-charger.ko 2023-07-14T12:36:57.508 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18041 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/isp1704_charger.ko 2023-07-14T12:36:57.508 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/lp8727_charger.ko 2023-07-14T12:36:57.508 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12577 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/max14577_charger.ko 2023-07-14T12:36:57.508 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/max17040_battery.ko 2023-07-14T12:36:57.509 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30289 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/max17042_battery.ko 2023-07-14T12:36:57.509 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/max8903_charger.ko 2023-07-14T12:36:57.509 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/max8925_power.ko 2023-07-14T12:36:57.509 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/pcf50633-charger.ko 2023-07-14T12:36:57.509 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38009 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/sbs-battery.ko 2023-07-14T12:36:57.509 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/test_power.ko 2023-07-14T12:36:57.509 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/tps65090-charger.ko 2023-07-14T12:36:57.509 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/wm831x_backup.ko 2023-07-14T12:36:57.510 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/wm831x_power.ko 2023-07-14T12:36:57.510 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/power/supply/wm8350_power.ko 2023-07-14T12:36:57.510 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap/ 2023-07-14T12:36:57.510 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 57737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-14T12:36:57.510 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-14T12:36:57.510 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/ 2023-07-14T12:36:57.510 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/ 2023-07-14T12:36:57.510 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-14T12:36:57.511 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-14T12:36:57.511 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps_parport.ko 2023-07-14T12:36:57.511 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 41921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/pps_core.ko 2023-07-14T12:36:57.511 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp/ 2023-07-14T12:36:57.511 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 66385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp/ptp.ko 2023-07-14T12:36:57.511 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp/ptp_kvm.ko 2023-07-14T12:36:57.511 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/ 2023-07-14T12:36:57.512 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-88pm80x.ko 2023-07-14T12:36:57.512 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-88pm860x.ko 2023-07-14T12:36:57.512 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-14T12:36:57.512 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-14T12:36:57.512 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-da9052.ko 2023-07-14T12:36:57.512 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-da9055.ko 2023-07-14T12:36:57.512 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20177 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-da9063.ko 2023-07-14T12:36:57.512 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-14T12:36:57.513 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 68577 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-14T12:36:57.513 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-14T12:36:57.513 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18217 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-14T12:36:57.513 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-14T12:36:57.513 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-14T12:36:57.514 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13369 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-14T12:36:57.514 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-14T12:36:57.514 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-14T12:36:57.514 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-em3027.ko 2023-07-14T12:36:57.514 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-14T12:36:57.514 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-14T12:36:57.514 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-14T12:36:57.515 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-lp8788.ko 2023-07-14T12:36:57.515 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-14T12:36:57.515 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-14T12:36:57.515 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25945 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-14T12:36:57.515 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14177 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m48t86.ko 2023-07-14T12:36:57.515 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11633 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-max6900.ko 2023-07-14T12:36:57.515 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-max8907.ko 2023-07-14T12:36:57.515 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15409 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-max8925.ko 2023-07-14T12:36:57.516 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-max8997.ko 2023-07-14T12:36:57.516 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-max8998.ko 2023-07-14T12:36:57.516 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18513 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-07-14T12:36:57.516 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11409 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-14T12:36:57.516 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-palmas.ko 2023-07-14T12:36:57.516 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 40121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-14T12:36:57.516 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17977 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf50633.ko 2023-07-14T12:36:57.516 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-14T12:36:57.517 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-14T12:36:57.517 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-14T12:36:57.517 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-14T12:36:57.517 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18033 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rc5t583.ko 2023-07-14T12:36:57.517 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-14T12:36:57.517 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-14T12:36:57.517 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-14T12:36:57.518 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-14T12:36:57.518 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-14T12:36:57.518 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-s35390a.ko 2023-07-14T12:36:57.518 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-14T12:36:57.518 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-tps6586x.ko 2023-07-14T12:36:57.518 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-tps65910.ko 2023-07-14T12:36:57.518 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-wm831x.ko 2023-07-14T12:36:57.518 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-wm8350.ko 2023-07-14T12:36:57.519 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-x1205.ko 2023-07-14T12:36:57.519 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ 2023-07-14T12:36:57.519 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 77617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-9xxx.ko 2023-07-14T12:36:57.519 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 57665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-sas.ko 2023-07-14T12:36:57.519 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 55169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-xxxx.ko 2023-07-14T12:36:57.519 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 135169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/BusLogic.ko 2023-07-14T12:36:57.519 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/a100u2w.ko 2023-07-14T12:36:57.519 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aacraid/ 2023-07-14T12:36:57.520 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 272353 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-14T12:36:57.520 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 100617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/advansys.ko 2023-07-14T12:36:57.520 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx/ 2023-07-14T12:36:57.520 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 356265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-14T12:36:57.520 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 295801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-14T12:36:57.520 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic94xx/ 2023-07-14T12:36:57.520 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 189321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-07-14T12:36:57.520 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/am53c974.ko 2023-07-14T12:36:57.521 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/arcmsr/ 2023-07-14T12:36:57.521 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 106569 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-14T12:36:57.521 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/atp870u.ko 2023-07-14T12:36:57.521 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/be2iscsi/ 2023-07-14T12:36:57.521 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 246897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-14T12:36:57.521 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bfa/ 2023-07-14T12:36:57.521 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 1172185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bfa/bfa.ko 2023-07-14T12:36:57.522 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2fc/ 2023-07-14T12:36:57.522 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 237169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-14T12:36:57.522 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2i/ 2023-07-14T12:36:57.522 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 115393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-14T12:36:57.522 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 40609 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ch.ko 2023-07-14T12:36:57.522 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/csiostor/ 2023-07-14T12:36:57.522 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 308889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-14T12:36:57.522 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/ 2023-07-14T12:36:57.523 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-07-14T12:36:57.523 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 76193 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-14T12:36:57.523 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-07-14T12:36:57.523 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 101449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-14T12:36:57.523 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 146785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-14T12:36:57.523 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 75529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/dc395x.ko 2023-07-14T12:36:57.523 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/dmx3191d.ko 2023-07-14T12:36:57.524 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esas2r/ 2023-07-14T12:36:57.524 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 212401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-14T12:36:57.524 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 60489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esp_scsi.ko 2023-07-14T12:36:57.524 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe/ 2023-07-14T12:36:57.524 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 78289 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-14T12:36:57.525 INFO:teuthology.orchestra.run.smithi005.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-07-14T12:36:57.525 INFO:teuthology.orchestra.run.smithi005.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-07-14T12:36:57.526 INFO:teuthology.orchestra.run.smithi005.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-07-14T12:36:57.526 INFO:teuthology.orchestra.run.smithi005.stderr:done 2023-07-14T12:36:57.587 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 158193 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-14T12:36:57.587 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18945 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fdomain.ko 2023-07-14T12:36:57.587 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fnic/ 2023-07-14T12:36:57.587 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 261913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fnic/fnic.ko 2023-07-14T12:36:57.587 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 201793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hpsa.ko 2023-07-14T12:36:57.588 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hptiop.ko 2023-07-14T12:36:57.588 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 49065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hv_storvsc.ko 2023-07-14T12:36:57.588 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/imm.ko 2023-07-14T12:36:57.588 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 44057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/initio.ko 2023-07-14T12:36:57.588 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 266521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ipr.ko 2023-07-14T12:36:57.588 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 101881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ips.ko 2023-07-14T12:36:57.588 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/isci/ 2023-07-14T12:36:57.589 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 317249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/isci/isci.ko 2023-07-14T12:36:57.589 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26361 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-14T12:36:57.589 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 52897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-14T12:36:57.589 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libfc/ 2023-07-14T12:36:57.589 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 314961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libfc/libfc.ko 2023-07-14T12:36:57.589 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 145569 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libiscsi.ko 2023-07-14T12:36:57.589 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 53521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-14T12:36:57.589 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libsas/ 2023-07-14T12:36:57.590 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 217209 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libsas/libsas.ko 2023-07-14T12:36:57.590 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/lpfc/ 2023-07-14T12:36:57.590 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 2192449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-14T12:36:57.590 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/ 2023-07-14T12:36:57.590 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 73545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-14T12:36:57.590 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33569 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-14T12:36:57.590 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 310729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-14T12:36:57.591 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 84697 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid.ko 2023-07-14T12:36:57.591 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mpt3sas/ 2023-07-14T12:36:57.591 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 659577 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-14T12:36:57.591 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvsas/ 2023-07-14T12:36:57.591 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 119929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-14T12:36:57.591 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 78153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvumi.ko 2023-07-14T12:36:57.591 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pcmcia/ 2023-07-14T12:36:57.591 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 81601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-07-14T12:36:57.592 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-07-14T12:36:57.592 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-07-14T12:36:57.592 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-07-14T12:36:57.592 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pm8001/ 2023-07-14T12:36:57.592 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 364257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-14T12:36:57.592 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 123489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pmcraid.ko 2023-07-14T12:36:57.592 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ppa.ko 2023-07-14T12:36:57.593 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 55345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla1280.ko 2023-07-14T12:36:57.593 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx/ 2023-07-14T12:36:57.593 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 1860025 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-14T12:36:57.593 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 85313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-14T12:36:57.593 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla4xxx/ 2023-07-14T12:36:57.593 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 558865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-14T12:36:57.593 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19025 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qlogicfas408.ko 2023-07-14T12:36:57.593 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/raid_class.ko 2023-07-14T12:36:57.594 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 238801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_debug.ko 2023-07-14T12:36:57.594 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 173921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-14T12:36:57.594 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 278865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-14T12:36:57.594 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 97705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-14T12:36:57.594 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 73881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-14T12:36:57.594 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 44993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-14T12:36:57.594 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ses.ko 2023-07-14T12:36:57.594 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 115849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/st.ko 2023-07-14T12:36:57.595 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 46825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/stex.ko 2023-07-14T12:36:57.595 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/sym53c8xx_2/ 2023-07-14T12:36:57.595 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 162121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-14T12:36:57.595 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 42361 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/virtio_scsi.ko 2023-07-14T12:36:57.595 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 50297 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-14T12:36:57.595 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 40001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/wd719x.ko 2023-07-14T12:36:57.595 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 50025 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/xen-scsifront.ko 2023-07-14T12:36:57.595 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ssb/ 2023-07-14T12:36:57.596 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 129417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ssb/ssb.ko 2023-07-14T12:36:57.596 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/ 2023-07-14T12:36:57.596 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/iscsi/ 2023-07-14T12:36:57.596 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 739089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-14T12:36:57.596 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/loopback/ 2023-07-14T12:36:57.596 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 49985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-14T12:36:57.596 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 39713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_file.ko 2023-07-14T12:36:57.597 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 42961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_iblock.ko 2023-07-14T12:36:57.597 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 931721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_mod.ko 2023-07-14T12:36:57.597 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 44321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_pscsi.ko 2023-07-14T12:36:57.597 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 122545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_user.ko 2023-07-14T12:36:57.597 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/tcm_fc/ 2023-07-14T12:36:57.597 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 75641 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-14T12:36:57.597 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/ 2023-07-14T12:36:57.598 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/ 2023-07-14T12:36:57.598 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/ 2023-07-14T12:36:57.598 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23481 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-14T12:36:57.598 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-14T12:36:57.598 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-14T12:36:57.598 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-14T12:36:57.598 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-14T12:36:57.598 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-14T12:36:57.599 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-14T12:36:57.599 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20281 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-14T12:36:57.599 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-14T12:36:57.599 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-14T12:36:57.599 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-14T12:36:57.599 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-14T12:36:57.599 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-07-14T12:36:57.599 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-14T12:36:57.600 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-14T12:36:57.600 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-14T12:36:57.600 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/ 2023-07-14T12:36:57.600 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/ipwireless/ 2023-07-14T12:36:57.600 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 78073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-14T12:36:57.600 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 57881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/moxa.ko 2023-07-14T12:36:57.600 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 50793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/mxser.ko 2023-07-14T12:36:57.601 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 107545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/n_gsm.ko 2023-07-14T12:36:57.601 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32041 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/n_hdlc.ko 2023-07-14T12:36:57.601 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 68137 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/nozomi.ko 2023-07-14T12:36:57.601 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/ 2023-07-14T12:36:57.601 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/8250/ 2023-07-14T12:36:57.601 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-07-14T12:36:57.601 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 59497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-14T12:36:57.601 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18209 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-07-14T12:36:57.602 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/altera_uart.ko 2023-07-14T12:36:57.602 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/arc_uart.ko 2023-07-14T12:36:57.602 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 72193 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-07-14T12:36:57.602 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/jsm/ 2023-07-14T12:36:57.602 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 103017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-14T12:36:57.602 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/rp2.ko 2023-07-14T12:36:57.602 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 52073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/sc16is7xx.ko 2023-07-14T12:36:57.602 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 100185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/synclink_gt.ko 2023-07-14T12:36:57.603 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/ 2023-07-14T12:36:57.603 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/core/ 2023-07-14T12:36:57.603 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 536617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-14T12:36:57.603 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/host/ 2023-07-14T12:36:57.603 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28377 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-14T12:36:57.603 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-07-14T12:36:57.603 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/ 2023-07-14T12:36:57.604 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 44585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio.ko 2023-07-14T12:36:57.604 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_aec.ko 2023-07-14T12:36:57.604 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11281 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_cif.ko 2023-07-14T12:36:57.604 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_dmem_genirq.ko 2023-07-14T12:36:57.604 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_mf624.ko 2023-07-14T12:36:57.604 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12177 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_netx.ko 2023-07-14T12:36:57.604 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_pci_generic.ko 2023-07-14T12:36:57.604 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-07-14T12:36:57.605 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13633 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_sercos3.ko 2023-07-14T12:36:57.605 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/ 2023-07-14T12:36:57.605 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/c67x00/ 2023-07-14T12:36:57.605 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 73273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/c67x00/c67x00.ko 2023-07-14T12:36:57.605 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/chipidea/ 2023-07-14T12:36:57.605 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 143785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-07-14T12:36:57.605 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-07-14T12:36:57.606 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-07-14T12:36:57.606 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-07-14T12:36:57.606 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/ 2023-07-14T12:36:57.606 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 85457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/cdc-acm.ko 2023-07-14T12:36:57.606 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-14T12:36:57.606 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/usblp.ko 2023-07-14T12:36:57.606 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 89833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/usbtmc.ko 2023-07-14T12:36:57.606 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/common/ 2023-07-14T12:36:57.607 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/common/ulpi.ko 2023-07-14T12:36:57.607 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/dwc2/ 2023-07-14T12:36:57.607 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-07-14T12:36:57.607 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/dwc3/ 2023-07-14T12:36:57.607 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-07-14T12:36:57.607 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-07-14T12:36:57.607 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 445801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/dwc3/dwc3.ko 2023-07-14T12:36:57.608 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/ 2023-07-14T12:36:57.608 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/ 2023-07-14T12:36:57.608 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 60089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/u_ether.ko 2023-07-14T12:36:57.608 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/u_serial.ko 2023-07-14T12:36:57.608 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-07-14T12:36:57.608 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 42649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-07-14T12:36:57.608 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-07-14T12:36:57.608 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-07-14T12:36:57.609 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 92377 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-07-14T12:36:57.609 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51025 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-07-14T12:36:57.609 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 122073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-07-14T12:36:57.609 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 57921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-07-14T12:36:57.609 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-07-14T12:36:57.609 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-07-14T12:36:57.609 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 57705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-07-14T12:36:57.610 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 85841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-07-14T12:36:57.610 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-07-14T12:36:57.610 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 58433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-07-14T12:36:57.610 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 67337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-07-14T12:36:57.610 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/ 2023-07-14T12:36:57.610 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-07-14T12:36:57.610 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-07-14T12:36:57.610 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-07-14T12:36:57.611 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-07-14T12:36:57.611 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-07-14T12:36:57.611 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-07-14T12:36:57.611 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20409 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-07-14T12:36:57.611 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16977 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-07-14T12:36:57.611 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-07-14T12:36:57.611 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-07-14T12:36:57.611 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-07-14T12:36:57.612 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27201 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-07-14T12:36:57.612 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 62153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-07-14T12:36:57.612 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15201 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-07-14T12:36:57.612 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 161233 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/libcomposite.ko 2023-07-14T12:36:57.612 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/ 2023-07-14T12:36:57.612 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-07-14T12:36:57.612 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/bdc/ 2023-07-14T12:36:57.613 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 157665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-07-14T12:36:57.613 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-07-14T12:36:57.613 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 52993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-07-14T12:36:57.613 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 69689 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-07-14T12:36:57.613 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 56009 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-07-14T12:36:57.613 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 76033 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/net2272.ko 2023-07-14T12:36:57.613 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 75057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/net2280.ko 2023-07-14T12:36:57.613 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 73153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-07-14T12:36:57.614 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 65793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-07-14T12:36:57.614 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 66073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-07-14T12:36:57.614 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 81489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-07-14T12:36:57.614 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 156033 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-07-14T12:36:57.614 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host/ 2023-07-14T12:36:57.614 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host/bcma-hcd.ko 2023-07-14T12:36:57.614 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 80097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host/isp116x-hcd.ko 2023-07-14T12:36:57.615 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 87337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-07-14T12:36:57.615 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 78849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-07-14T12:36:57.615 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-14T12:36:57.615 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host/sl811_cs.ko 2023-07-14T12:36:57.615 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host/ssb-hcd.ko 2023-07-14T12:36:57.615 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25945 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-07-14T12:36:57.615 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image/ 2023-07-14T12:36:57.615 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image/mdc800.ko 2023-07-14T12:36:57.616 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image/microtek.ko 2023-07-14T12:36:57.616 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/ 2023-07-14T12:36:57.616 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 41841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/adutux.ko 2023-07-14T12:36:57.616 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/appledisplay.ko 2023-07-14T12:36:57.616 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-07-14T12:36:57.616 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/cytherm.ko 2023-07-14T12:36:57.616 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/ehset.ko 2023-07-14T12:36:57.616 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/emi26.ko 2023-07-14T12:36:57.617 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/emi62.ko 2023-07-14T12:36:57.617 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/ezusb.ko 2023-07-14T12:36:57.617 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19297 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/idmouse.ko 2023-07-14T12:36:57.617 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/iowarrior.ko 2023-07-14T12:36:57.617 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-14T12:36:57.617 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/ldusb.ko 2023-07-14T12:36:57.617 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/legousbtower.ko 2023-07-14T12:36:57.618 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/lvstest.ko 2023-07-14T12:36:57.618 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/sisusbvga/ 2023-07-14T12:36:57.618 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 64841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-14T12:36:57.618 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-14T12:36:57.618 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usb3503.ko 2023-07-14T12:36:57.618 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usblcd.ko 2023-07-14T12:36:57.618 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-14T12:36:57.618 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 70873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usbtest.ko 2023-07-14T12:36:57.619 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 41945 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/uss720.ko 2023-07-14T12:36:57.619 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/yurex.ko 2023-07-14T12:36:57.619 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/mon/ 2023-07-14T12:36:57.619 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 73185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/mon/usbmon.ko 2023-07-14T12:36:57.619 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/musb/ 2023-07-14T12:36:57.619 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 301521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/musb/musb_hdrc.ko 2023-07-14T12:36:57.619 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/phy/ 2023-07-14T12:36:57.619 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/phy/phy-generic.ko 2023-07-14T12:36:57.620 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20177 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-07-14T12:36:57.620 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/phy/phy-isp1301.ko 2023-07-14T12:36:57.620 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/phy/phy-tahvo.ko 2023-07-14T12:36:57.620 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ 2023-07-14T12:36:57.620 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/aircable.ko 2023-07-14T12:36:57.620 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ark3116.ko 2023-07-14T12:36:57.620 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-14T12:36:57.621 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ch341.ko 2023-07-14T12:36:57.621 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 70209 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cp210x.ko 2023-07-14T12:36:57.621 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cyberjack.ko 2023-07-14T12:36:57.621 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 57937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-14T12:36:57.621 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 49753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-14T12:36:57.621 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/empeg.ko 2023-07-14T12:36:57.621 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 43897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/f81232.ko 2023-07-14T12:36:57.621 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 175145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-14T12:36:57.622 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 52713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-14T12:36:57.622 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 137105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-14T12:36:57.622 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 124673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/io_ti.ko 2023-07-14T12:36:57.622 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 67769 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ipaq.ko 2023-07-14T12:36:57.622 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ipw.ko 2023-07-14T12:36:57.622 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ir-usb.ko 2023-07-14T12:36:57.622 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 57937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-14T12:36:57.622 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 107417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/keyspan.ko 2023-07-14T12:36:57.623 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-14T12:36:57.623 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-14T12:36:57.623 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-14T12:36:57.623 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mct_u232.ko 2023-07-14T12:36:57.623 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/metro-usb.ko 2023-07-14T12:36:57.623 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 66489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mos7720.ko 2023-07-14T12:36:57.623 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 78113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mos7840.ko 2023-07-14T12:36:57.624 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 56593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mxuport.ko 2023-07-14T12:36:57.624 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/navman.ko 2023-07-14T12:36:57.624 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/omninet.ko 2023-07-14T12:36:57.624 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24281 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/opticon.ko 2023-07-14T12:36:57.624 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 189729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/option.ko 2023-07-14T12:36:57.624 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38905 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/oti6858.ko 2023-07-14T12:36:57.624 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 54313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/pl2303.ko 2023-07-14T12:36:57.624 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/qcaux.ko 2023-07-14T12:36:57.625 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/qcserial.ko 2023-07-14T12:36:57.625 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34561 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/quatech2.ko 2023-07-14T12:36:57.625 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/safe_serial.ko 2023-07-14T12:36:57.625 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51297 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/sierra.ko 2023-07-14T12:36:57.625 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-14T12:36:57.625 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ssu100.ko 2023-07-14T12:36:57.625 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/symbolserial.ko 2023-07-14T12:36:57.625 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 61337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-14T12:36:57.626 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-14T12:36:57.626 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb_debug.ko 2023-07-14T12:36:57.626 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-14T12:36:57.626 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 125505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usbserial.ko 2023-07-14T12:36:57.626 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/visor.ko 2023-07-14T12:36:57.626 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37409 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/whiteheat.ko 2023-07-14T12:36:57.626 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/wishbone-serial.ko 2023-07-14T12:36:57.627 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9289 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-14T12:36:57.627 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ 2023-07-14T12:36:57.627 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 52913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/uas.ko 2023-07-14T12:36:57.627 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-14T12:36:57.627 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-14T12:36:57.627 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-14T12:36:57.627 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-14T12:36:57.627 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-14T12:36:57.628 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19769 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-14T12:36:57.628 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19361 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-14T12:36:57.628 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-karma.ko 2023-07-14T12:36:57.628 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-14T12:36:57.628 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-14T12:36:57.628 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28905 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-14T12:36:57.628 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-14T12:36:57.629 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-14T12:36:57.629 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 180017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/usb-storage.ko 2023-07-14T12:36:57.629 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/ 2023-07-14T12:36:57.629 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 67457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-14T12:36:57.629 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 71345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-14T12:36:57.629 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 105401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-14T12:36:57.629 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/ 2023-07-14T12:36:57.629 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci/ 2023-07-14T12:36:57.630 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 153697 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-14T12:36:57.630 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-14T12:36:57.630 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 100569 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/vfio.ko 2023-07-14T12:36:57.630 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 75137 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-14T12:36:57.630 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/ 2023-07-14T12:36:57.630 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 113889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost.ko 2023-07-14T12:36:57.630 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-14T12:36:57.631 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 58137 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_net.ko 2023-07-14T12:36:57.631 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 86521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_scsi.ko 2023-07-14T12:36:57.631 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/ 2023-07-14T12:36:57.631 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/ 2023-07-14T12:36:57.631 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-07-14T12:36:57.631 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/aat2870_bl.ko 2023-07-14T12:36:57.631 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/adp5520_bl.ko 2023-07-14T12:36:57.632 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32609 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/adp8860_bl.ko 2023-07-14T12:36:57.632 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 39993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/adp8870_bl.ko 2023-07-14T12:36:57.632 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/apple_bl.ko 2023-07-14T12:36:57.632 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16777 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/as3711_bl.ko 2023-07-14T12:36:57.632 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/bd6107.ko 2023-07-14T12:36:57.632 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11409 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/da903x_bl.ko 2023-07-14T12:36:57.632 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/da9052_bl.ko 2023-07-14T12:36:57.632 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11945 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/gpio_backlight.ko 2023-07-14T12:36:57.633 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14769 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/kb3886_bl.ko 2023-07-14T12:36:57.633 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/lcd.ko 2023-07-14T12:36:57.633 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/lm3533_bl.ko 2023-07-14T12:36:57.633 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/lm3639_bl.ko 2023-07-14T12:36:57.633 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/lv5207lp.ko 2023-07-14T12:36:57.633 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/max8925_bl.ko 2023-07-14T12:36:57.633 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/pandora_bl.ko 2023-07-14T12:36:57.634 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-07-14T12:36:57.634 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-14T12:36:57.634 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/wm831x_bl.ko 2023-07-14T12:36:57.634 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/ 2023-07-14T12:36:57.634 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters/ 2023-07-14T12:36:57.634 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters/ds2482.ko 2023-07-14T12:36:57.634 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters/ds2490.ko 2023-07-14T12:36:57.634 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters/matrox_w1.ko 2023-07-14T12:36:57.635 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters/w1-gpio.ko 2023-07-14T12:36:57.635 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/ 2023-07-14T12:36:57.635 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12041 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-14T12:36:57.635 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-14T12:36:57.635 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-14T12:36:57.635 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-14T12:36:57.635 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-14T12:36:57.635 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-14T12:36:57.636 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-14T12:36:57.636 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-14T12:36:57.636 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-14T12:36:57.636 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-14T12:36:57.636 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 56425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-14T12:36:57.636 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 102657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/wire.ko 2023-07-14T12:36:57.636 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ 2023-07-14T12:36:57.637 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/acquirewdt.ko 2023-07-14T12:36:57.637 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19977 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/advantechwdt.ko 2023-07-14T12:36:57.637 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18561 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-14T12:36:57.637 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-14T12:36:57.637 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/cpu5wdt.ko 2023-07-14T12:36:57.637 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/da9052_wdt.ko 2023-07-14T12:36:57.637 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12777 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/da9055_wdt.ko 2023-07-14T12:36:57.637 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17409 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/da9063_wdt.ko 2023-07-14T12:36:57.638 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/dw_wdt.ko 2023-07-14T12:36:57.638 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/eurotechwdt.ko 2023-07-14T12:36:57.638 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-14T12:36:57.638 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/hpwdt.ko 2023-07-14T12:36:57.638 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15577 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/i6300esb.ko 2023-07-14T12:36:57.638 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-14T12:36:57.638 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-14T12:36:57.639 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ib700wdt.ko 2023-07-14T12:36:57.639 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18689 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ibmasr.ko 2023-07-14T12:36:57.639 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-14T12:36:57.639 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-14T12:36:57.639 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/it87_wdt.ko 2023-07-14T12:36:57.639 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/kempld_wdt.ko 2023-07-14T12:36:57.639 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/machzwd.ko 2023-07-14T12:36:57.639 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/mena21_wdt.ko 2023-07-14T12:36:57.640 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13217 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-07-14T12:36:57.640 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/nv_tco.ko 2023-07-14T12:36:57.640 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-07-14T12:36:57.640 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/pc87413_wdt.ko 2023-07-14T12:36:57.640 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-14T12:36:57.640 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-14T12:36:57.640 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/retu_wdt.ko 2023-07-14T12:36:57.641 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-07-14T12:36:57.641 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-07-14T12:36:57.641 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-14T12:36:57.641 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sc1200wdt.ko 2023-07-14T12:36:57.641 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-14T12:36:57.641 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21577 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-07-14T12:36:57.641 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/softdog.ko 2023-07-14T12:36:57.641 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-14T12:36:57.642 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/twl4030_wdt.ko 2023-07-14T12:36:57.642 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/via_wdt.ko 2023-07-14T12:36:57.642 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-14T12:36:57.642 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-14T12:36:57.642 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25409 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-14T12:36:57.642 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/wafer5823wdt.ko 2023-07-14T12:36:57.642 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/wdt_pci.ko 2023-07-14T12:36:57.643 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/wm831x_wdt.ko 2023-07-14T12:36:57.643 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/wm8350_wdt.ko 2023-07-14T12:36:57.643 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15697 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/xen_wdt.ko 2023-07-14T12:36:57.643 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/ 2023-07-14T12:36:57.643 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-evtchn.ko 2023-07-14T12:36:57.643 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-gntalloc.ko 2023-07-14T12:36:57.643 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-gntdev.ko 2023-07-14T12:36:57.643 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-pciback/ 2023-07-14T12:36:57.644 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 176417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-14T12:36:57.644 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 40105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-privcmd.ko 2023-07-14T12:36:57.644 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 71321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-scsiback.ko 2023-07-14T12:36:57.644 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xenfs/ 2023-07-14T12:36:57.644 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-14T12:36:57.644 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ 2023-07-14T12:36:57.644 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/9p/ 2023-07-14T12:36:57.645 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 165697 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/9p/9p.ko 2023-07-14T12:36:57.645 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/adfs/ 2023-07-14T12:36:57.645 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 60881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/adfs/adfs.ko 2023-07-14T12:36:57.645 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/affs/ 2023-07-14T12:36:57.645 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 162617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/affs/affs.ko 2023-07-14T12:36:57.645 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/afs/ 2023-07-14T12:36:57.645 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 931937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/afs/kafs.ko 2023-07-14T12:36:57.646 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/autofs/ 2023-07-14T12:36:57.646 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 100937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/autofs/autofs4.ko 2023-07-14T12:36:57.646 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/befs/ 2023-07-14T12:36:57.646 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 64481 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/befs/befs.ko 2023-07-14T12:36:57.646 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/bfs/ 2023-07-14T12:36:57.646 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 40993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/bfs/bfs.ko 2023-07-14T12:36:57.646 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/binfmt_misc.ko 2023-07-14T12:36:57.646 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/btrfs/ 2023-07-14T12:36:57.647 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 3468681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/btrfs/btrfs.ko 2023-07-14T12:36:57.647 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cachefiles/ 2023-07-14T12:36:57.647 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 305745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cachefiles/cachefiles.ko 2023-07-14T12:36:57.647 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ceph/ 2023-07-14T12:36:57.647 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 1312521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ceph/ceph.ko 2023-07-14T12:36:57.647 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/coda/ 2023-07-14T12:36:57.647 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 100321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/coda/coda.ko 2023-07-14T12:36:57.647 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/configfs/ 2023-07-14T12:36:57.648 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 108073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/configfs/configfs.ko 2023-07-14T12:36:57.648 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cramfs/ 2023-07-14T12:36:57.648 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cramfs/cramfs.ko 2023-07-14T12:36:57.648 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/dlm/ 2023-07-14T12:36:57.648 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 633825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/dlm/dlm.ko 2023-07-14T12:36:57.648 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/efs/ 2023-07-14T12:36:57.648 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/efs/efs.ko 2023-07-14T12:36:57.648 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/f2fs/ 2023-07-14T12:36:57.649 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 1500513 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/f2fs/f2fs.ko 2023-07-14T12:36:57.649 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/ 2023-07-14T12:36:57.649 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/msdos.ko 2023-07-14T12:36:57.649 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/freevxfs/ 2023-07-14T12:36:57.649 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 42457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/freevxfs/freevxfs.ko 2023-07-14T12:36:57.649 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fscache/ 2023-07-14T12:36:57.649 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 226505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fscache/fscache.ko 2023-07-14T12:36:57.650 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse/ 2023-07-14T12:36:57.650 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse/cuse.ko 2023-07-14T12:36:57.650 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/gfs2/ 2023-07-14T12:36:57.650 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 1226249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/gfs2/gfs2.ko 2023-07-14T12:36:57.650 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfs/ 2023-07-14T12:36:57.650 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 141241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfs/hfs.ko 2023-07-14T12:36:57.650 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfsplus/ 2023-07-14T12:36:57.650 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 221553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfsplus/hfsplus.ko 2023-07-14T12:36:57.651 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hpfs/ 2023-07-14T12:36:57.651 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 193577 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hpfs/hpfs.ko 2023-07-14T12:36:57.651 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/isofs/ 2023-07-14T12:36:57.651 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 74393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/isofs/isofs.ko 2023-07-14T12:36:57.651 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/jfs/ 2023-07-14T12:36:57.651 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 420745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/jfs/jfs.ko 2023-07-14T12:36:57.651 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/lockd/ 2023-07-14T12:36:57.651 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 279041 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/lockd/lockd.ko 2023-07-14T12:36:57.652 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/minix/ 2023-07-14T12:36:57.652 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 87897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/minix/minix.ko 2023-07-14T12:36:57.652 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/netfs/ 2023-07-14T12:36:57.652 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 124697 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/netfs/netfs.ko 2023-07-14T12:36:57.652 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/ 2023-07-14T12:36:57.652 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/blocklayout/ 2023-07-14T12:36:57.652 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 81521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-14T12:36:57.652 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/filelayout/ 2023-07-14T12:36:57.653 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 59425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-14T12:36:57.653 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/flexfilelayout/ 2023-07-14T12:36:57.653 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 117705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-14T12:36:57.653 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 1053889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfs.ko 2023-07-14T12:36:57.653 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 66089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfsv2.ko 2023-07-14T12:36:57.653 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 119801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfsv3.ko 2023-07-14T12:36:57.653 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 2041809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfsv4.ko 2023-07-14T12:36:57.654 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common/ 2023-07-14T12:36:57.654 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common/grace.ko 2023-07-14T12:36:57.654 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common/nfs_acl.ko 2023-07-14T12:36:57.654 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfsd/ 2023-07-14T12:36:57.654 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 1504993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfsd/nfsd.ko 2023-07-14T12:36:57.654 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nilfs2/ 2023-07-14T12:36:57.654 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 591417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nilfs2/nilfs2.ko 2023-07-14T12:36:57.654 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/ 2023-07-14T12:36:57.655 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-celtic.ko 2023-07-14T12:36:57.655 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-centeuro.ko 2023-07-14T12:36:57.655 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-croatian.ko 2023-07-14T12:36:57.655 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-cyrillic.ko 2023-07-14T12:36:57.655 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13481 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-gaelic.ko 2023-07-14T12:36:57.655 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-greek.ko 2023-07-14T12:36:57.655 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-iceland.ko 2023-07-14T12:36:57.655 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-inuit.ko 2023-07-14T12:36:57.656 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-roman.ko 2023-07-14T12:36:57.656 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-romanian.ko 2023-07-14T12:36:57.656 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-turkish.ko 2023-07-14T12:36:57.656 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11297 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_ascii.ko 2023-07-14T12:36:57.656 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1250.ko 2023-07-14T12:36:57.656 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12233 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1251.ko 2023-07-14T12:36:57.656 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1255.ko 2023-07-14T12:36:57.656 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp737.ko 2023-07-14T12:36:57.657 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp775.ko 2023-07-14T12:36:57.657 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp850.ko 2023-07-14T12:36:57.657 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp852.ko 2023-07-14T12:36:57.657 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp855.ko 2023-07-14T12:36:57.657 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp857.ko 2023-07-14T12:36:57.657 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp860.ko 2023-07-14T12:36:57.657 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp861.ko 2023-07-14T12:36:57.658 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp862.ko 2023-07-14T12:36:57.658 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp863.ko 2023-07-14T12:36:57.658 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp864.ko 2023-07-14T12:36:57.658 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp865.ko 2023-07-14T12:36:57.658 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp866.ko 2023-07-14T12:36:57.658 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp869.ko 2023-07-14T12:36:57.658 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp874.ko 2023-07-14T12:36:57.658 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 94137 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp932.ko 2023-07-14T12:36:57.659 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 142673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp936.ko 2023-07-14T12:36:57.659 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 165745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp949.ko 2023-07-14T12:36:57.659 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 118121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp950.ko 2023-07-14T12:36:57.659 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_euc-jp.ko 2023-07-14T12:36:57.659 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-1.ko 2023-07-14T12:36:57.659 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-13.ko 2023-07-14T12:36:57.659 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-14.ko 2023-07-14T12:36:57.659 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-15.ko 2023-07-14T12:36:57.660 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-2.ko 2023-07-14T12:36:57.660 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-3.ko 2023-07-14T12:36:57.660 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-4.ko 2023-07-14T12:36:57.660 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-5.ko 2023-07-14T12:36:57.660 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-6.ko 2023-07-14T12:36:57.660 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12233 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-7.ko 2023-07-14T12:36:57.660 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-9.ko 2023-07-14T12:36:57.661 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-r.ko 2023-07-14T12:36:57.661 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-ru.ko 2023-07-14T12:36:57.661 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-u.ko 2023-07-14T12:36:57.661 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_utf8.ko 2023-07-14T12:36:57.661 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ntfs/ 2023-07-14T12:36:57.661 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 219073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ntfs/ntfs.ko 2023-07-14T12:36:57.661 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ 2023-07-14T12:36:57.661 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/cluster/ 2023-07-14T12:36:57.662 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 244177 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-14T12:36:57.662 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlm/ 2023-07-14T12:36:57.662 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 440785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-14T12:36:57.662 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlmfs/ 2023-07-14T12:36:57.662 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 53841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-14T12:36:57.662 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 2589569 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2.ko 2023-07-14T12:36:57.662 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17905 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-14T12:36:57.662 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-14T12:36:57.663 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-14T12:36:57.663 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/omfs/ 2023-07-14T12:36:57.663 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 52569 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/omfs/omfs.ko 2023-07-14T12:36:57.663 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/overlayfs/ 2023-07-14T12:36:57.663 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 336473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/overlayfs/overlay.ko 2023-07-14T12:36:57.663 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/pstore/ 2023-07-14T12:36:57.663 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 54609 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/pstore/ramoops.ko 2023-07-14T12:36:57.663 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/qnx4/ 2023-07-14T12:36:57.664 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/qnx4/qnx4.ko 2023-07-14T12:36:57.664 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/qnx6/ 2023-07-14T12:36:57.664 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 46649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/qnx6/qnx6.ko 2023-07-14T12:36:57.664 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/quota/ 2023-07-14T12:36:57.664 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/quota/quota_tree.ko 2023-07-14T12:36:57.664 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14361 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/quota/quota_v1.ko 2023-07-14T12:36:57.664 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/quota/quota_v2.ko 2023-07-14T12:36:57.665 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/reiserfs/ 2023-07-14T12:36:57.665 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 530697 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/reiserfs/reiserfs.ko 2023-07-14T12:36:57.665 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/romfs/ 2023-07-14T12:36:57.665 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/romfs/romfs.ko 2023-07-14T12:36:57.665 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/ 2023-07-14T12:36:57.665 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/client/ 2023-07-14T12:36:57.665 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 2658777 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/client/cifs.ko 2023-07-14T12:36:57.665 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common/ 2023-07-14T12:36:57.666 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common/cifs_arc4.ko 2023-07-14T12:36:57.666 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common/cifs_md4.ko 2023-07-14T12:36:57.666 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/squashfs/ 2023-07-14T12:36:57.666 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 134313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/squashfs/squashfs.ko 2023-07-14T12:36:57.666 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/sysv/ 2023-07-14T12:36:57.666 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 89737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/sysv/sysv.ko 2023-07-14T12:36:57.666 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/udf/ 2023-07-14T12:36:57.666 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 248049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/udf/udf.ko 2023-07-14T12:36:57.667 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ufs/ 2023-07-14T12:36:57.667 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 160857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ufs/ufs.ko 2023-07-14T12:36:57.667 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/xfs/ 2023-07-14T12:36:57.667 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 3998129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/xfs/xfs.ko 2023-07-14T12:36:57.667 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/ 2023-07-14T12:36:57.667 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/locking/ 2023-07-14T12:36:57.667 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 74865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/locking/locktorture.ko 2023-07-14T12:36:57.667 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/time/ 2023-07-14T12:36:57.668 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/time/test_udelay.ko 2023-07-14T12:36:57.668 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 58473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/torture.ko 2023-07-14T12:36:57.668 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ 2023-07-14T12:36:57.668 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 6833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crc-itu-t.ko 2023-07-14T12:36:57.668 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 6529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crc7.ko 2023-07-14T12:36:57.668 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7025 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crc8.ko 2023-07-14T12:36:57.668 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto/ 2023-07-14T12:36:57.669 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto/libarc4.ko 2023-07-14T12:36:57.669 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto/libdes.ko 2023-07-14T12:36:57.669 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/interval_tree_test.ko 2023-07-14T12:36:57.669 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/libcrc32c.ko 2023-07-14T12:36:57.669 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lru_cache.ko 2023-07-14T12:36:57.669 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4/ 2023-07-14T12:36:57.669 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4/lz4_compress.ko 2023-07-14T12:36:57.670 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22633 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4/lz4hc_compress.ko 2023-07-14T12:36:57.670 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/math/ 2023-07-14T12:36:57.670 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 6617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/math/cordic.ko 2023-07-14T12:36:57.670 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8233 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/memory-notifier-error-inject.ko 2023-07-14T12:36:57.670 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/notifier-error-inject.ko 2023-07-14T12:36:57.670 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/percpu_test.ko 2023-07-14T12:36:57.670 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/pm-notifier-error-inject.ko 2023-07-14T12:36:57.671 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/raid6/ 2023-07-14T12:36:57.671 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 143433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/raid6/raid6_pq.ko 2023-07-14T12:36:57.671 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/rbtree_test.ko 2023-07-14T12:36:57.671 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/reed_solomon/ 2023-07-14T12:36:57.671 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-14T12:36:57.671 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/test-kstrtox.ko 2023-07-14T12:36:57.671 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/test-string_helpers.ko 2023-07-14T12:36:57.671 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 4760825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/test_bpf.ko 2023-07-14T12:36:57.672 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 49081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/test_firmware.ko 2023-07-14T12:36:57.672 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 6369 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/test_module.ko 2023-07-14T12:36:57.672 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/test_user_copy.ko 2023-07-14T12:36:57.672 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_bm.ko 2023-07-14T12:36:57.672 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_fsm.ko 2023-07-14T12:36:57.672 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9689 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_kmp.ko 2023-07-14T12:36:57.672 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/xz/ 2023-07-14T12:36:57.672 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/xz/xz_dec_test.ko 2023-07-14T12:36:57.673 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/mm/ 2023-07-14T12:36:57.673 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/mm/hwpoison-inject.ko 2023-07-14T12:36:57.673 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ 2023-07-14T12:36:57.673 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/ 2023-07-14T12:36:57.673 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 55737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/6lowpan.ko 2023-07-14T12:36:57.673 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_dest.ko 2023-07-14T12:36:57.673 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_fragment.ko 2023-07-14T12:36:57.674 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_hop.ko 2023-07-14T12:36:57.674 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 6985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-14T12:36:57.674 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_mobility.ko 2023-07-14T12:36:57.674 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_routing.ko 2023-07-14T12:36:57.674 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_udp.ko 2023-07-14T12:36:57.674 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/ 2023-07-14T12:36:57.674 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/garp.ko 2023-07-14T12:36:57.674 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/mrp.ko 2023-07-14T12:36:57.675 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/p8022.ko 2023-07-14T12:36:57.675 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/psnap.ko 2023-07-14T12:36:57.675 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/stp.ko 2023-07-14T12:36:57.675 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/8021q/ 2023-07-14T12:36:57.675 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 81017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/8021q/8021q.ko 2023-07-14T12:36:57.675 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/ 2023-07-14T12:36:57.675 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 198417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet.ko 2023-07-14T12:36:57.675 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_fd.ko 2023-07-14T12:36:57.676 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_rdma.ko 2023-07-14T12:36:57.676 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_virtio.ko 2023-07-14T12:36:57.676 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/batman-adv/ 2023-07-14T12:36:57.676 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 652553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/batman-adv/batman-adv.ko 2023-07-14T12:36:57.676 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/ 2023-07-14T12:36:57.676 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 63825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/br_netfilter.ko 2023-07-14T12:36:57.676 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 772505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/bridge.ko 2023-07-14T12:36:57.677 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ 2023-07-14T12:36:57.677 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-14T12:36:57.677 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-14T12:36:57.677 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-14T12:36:57.677 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-14T12:36:57.677 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-14T12:36:57.677 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-14T12:36:57.677 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-14T12:36:57.678 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-14T12:36:57.678 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13217 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-14T12:36:57.678 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7585 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-14T12:36:57.678 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-14T12:36:57.678 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8385 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-14T12:36:57.678 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-14T12:36:57.678 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-14T12:36:57.679 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-14T12:36:57.679 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-14T12:36:57.679 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-14T12:36:57.679 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-14T12:36:57.679 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-14T12:36:57.679 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-14T12:36:57.679 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 55937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtables.ko 2023-07-14T12:36:57.679 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14041 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-14T12:36:57.680 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13945 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-14T12:36:57.680 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ceph/ 2023-07-14T12:36:57.680 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 1046417 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ceph/libceph.ko 2023-07-14T12:36:57.680 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core/ 2023-07-14T12:36:57.680 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 124793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core/pktgen.ko 2023-07-14T12:36:57.680 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/ 2023-07-14T12:36:57.680 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 194321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp.ko 2023-07-14T12:36:57.681 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8665 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_diag.ko 2023-07-14T12:36:57.681 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 56945 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_ipv4.ko 2023-07-14T12:36:57.681 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 59457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_ipv6.ko 2023-07-14T12:36:57.681 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/ 2023-07-14T12:36:57.681 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 390297 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/dsa_core.ko 2023-07-14T12:36:57.681 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_brcm.ko 2023-07-14T12:36:57.681 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12577 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_dsa.ko 2023-07-14T12:36:57.681 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_none.ko 2023-07-14T12:36:57.682 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_trailer.ko 2023-07-14T12:36:57.682 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/hsr/ 2023-07-14T12:36:57.682 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 100257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/hsr/hsr.ko 2023-07-14T12:36:57.682 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/ 2023-07-14T12:36:57.682 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/6lowpan/ 2023-07-14T12:36:57.682 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 45169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-14T12:36:57.682 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 254601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/ieee802154.ko 2023-07-14T12:36:57.682 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-14T12:36:57.683 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ 2023-07-14T12:36:57.683 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ah4.ko 2023-07-14T12:36:57.683 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/esp4.ko 2023-07-14T12:36:57.683 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 48345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/fou.ko 2023-07-14T12:36:57.683 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/gre.ko 2023-07-14T12:36:57.683 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 48529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/inet_diag.ko 2023-07-14T12:36:57.683 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 60529 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_gre.ko 2023-07-14T12:36:57.684 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 61281 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_tunnel.ko 2023-07-14T12:36:57.684 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34369 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_vti.ko 2023-07-14T12:36:57.684 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ipcomp.ko 2023-07-14T12:36:57.684 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28889 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ipip.ko 2023-07-14T12:36:57.684 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ 2023-07-14T12:36:57.684 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37689 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-14T12:36:57.684 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-14T12:36:57.684 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10409 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-14T12:36:57.685 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 41601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ip_tables.ko 2023-07-14T12:36:57.685 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-14T12:36:57.685 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-07-14T12:36:57.685 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-14T12:36:57.685 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11177 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-14T12:36:57.685 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-14T12:36:57.685 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-07-14T12:36:57.685 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-14T12:36:57.686 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-14T12:36:57.686 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-14T12:36:57.686 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10409 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-14T12:36:57.686 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-14T12:36:57.686 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-14T12:36:57.686 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-14T12:36:57.686 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-14T12:36:57.687 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-14T12:36:57.687 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20561 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-07-14T12:36:57.687 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-14T12:36:57.687 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15225 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-14T12:36:57.687 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-14T12:36:57.687 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-14T12:36:57.687 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9009 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-14T12:36:57.687 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_bic.ko 2023-07-14T12:36:57.688 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_dctcp.ko 2023-07-14T12:36:57.688 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_diag.ko 2023-07-14T12:36:57.688 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_highspeed.ko 2023-07-14T12:36:57.688 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_htcp.ko 2023-07-14T12:36:57.688 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_hybla.ko 2023-07-14T12:36:57.688 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_illinois.ko 2023-07-14T12:36:57.688 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_lp.ko 2023-07-14T12:36:57.689 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_scalable.ko 2023-07-14T12:36:57.689 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_vegas.ko 2023-07-14T12:36:57.689 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_veno.ko 2023-07-14T12:36:57.689 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_westwood.ko 2023-07-14T12:36:57.689 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_yeah.ko 2023-07-14T12:36:57.689 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tunnel4.ko 2023-07-14T12:36:57.689 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16361 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/udp_diag.ko 2023-07-14T12:36:57.689 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 41577 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/udp_tunnel.ko 2023-07-14T12:36:57.690 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-14T12:36:57.690 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ 2023-07-14T12:36:57.690 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ah6.ko 2023-07-14T12:36:57.690 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 39537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/esp6.ko 2023-07-14T12:36:57.690 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/fou6.ko 2023-07-14T12:36:57.690 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 80793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_gre.ko 2023-07-14T12:36:57.690 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 92817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_tunnel.ko 2023-07-14T12:36:57.690 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10609 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-14T12:36:57.691 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 54001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_vti.ko 2023-07-14T12:36:57.691 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ipcomp6.ko 2023-07-14T12:36:57.691 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/mip6.ko 2023-07-14T12:36:57.691 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ 2023-07-14T12:36:57.691 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 42209 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-14T12:36:57.691 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-07-14T12:36:57.691 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-14T12:36:57.691 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-14T12:36:57.692 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-14T12:36:57.692 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-14T12:36:57.692 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16209 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-14T12:36:57.692 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16033 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-14T12:36:57.692 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8913 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-14T12:36:57.692 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-14T12:36:57.692 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10937 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-14T12:36:57.693 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-14T12:36:57.693 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-14T12:36:57.693 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-14T12:36:57.693 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-14T12:36:57.693 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-14T12:36:57.693 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-14T12:36:57.693 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-14T12:36:57.693 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-14T12:36:57.694 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-14T12:36:57.694 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-14T12:36:57.694 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-14T12:36:57.694 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9633 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-14T12:36:57.694 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16025 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-14T12:36:57.694 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9009 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-14T12:36:57.694 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 73161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/sit.ko 2023-07-14T12:36:57.694 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24193 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/tunnel6.ko 2023-07-14T12:36:57.695 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23305 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-14T12:36:57.695 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/key/ 2023-07-14T12:36:57.695 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 82929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/key/af_key.ko 2023-07-14T12:36:57.695 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/ 2023-07-14T12:36:57.695 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 125873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_core.ko 2023-07-14T12:36:57.695 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-14T12:36:57.695 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_eth.ko 2023-07-14T12:36:57.696 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35049 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ip.ko 2023-07-14T12:36:57.696 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ip6.ko 2023-07-14T12:36:57.696 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_netlink.ko 2023-07-14T12:36:57.696 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 53153 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ppp.ko 2023-07-14T12:36:57.696 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/lapb/ 2023-07-14T12:36:57.696 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 48065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/lapb/lapb.ko 2023-07-14T12:36:57.696 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/llc/ 2023-07-14T12:36:57.696 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/llc/llc.ko 2023-07-14T12:36:57.697 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 267017 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/llc/llc2.ko 2023-07-14T12:36:57.697 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mac802154/ 2023-07-14T12:36:57.697 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 291041 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mac802154/mac802154.ko 2023-07-14T12:36:57.697 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mpls/ 2023-07-14T12:36:57.697 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mpls/mpls_gso.ko 2023-07-14T12:36:57.697 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ 2023-07-14T12:36:57.697 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ 2023-07-14T12:36:57.697 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 119649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set.ko 2023-07-14T12:36:57.698 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-14T12:36:57.698 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27033 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-14T12:36:57.698 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-14T12:36:57.698 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 102033 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-14T12:36:57.698 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 103121 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-14T12:36:57.698 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 104593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-14T12:36:57.698 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 105129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-14T12:36:57.699 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 114393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-14T12:36:57.699 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 61161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-14T12:36:57.699 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 111161 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-14T12:36:57.699 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 114673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-14T12:36:57.699 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 114329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-14T12:36:57.699 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 113217 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-14T12:36:57.699 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 116217 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-14T12:36:57.699 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-14T12:36:57.700 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ 2023-07-14T12:36:57.700 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 412481 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-14T12:36:57.700 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-14T12:36:57.700 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-14T12:36:57.700 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-14T12:36:57.700 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17905 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-14T12:36:57.700 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-14T12:36:57.701 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7689 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-14T12:36:57.701 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7689 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-14T12:36:57.701 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10681 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-14T12:36:57.701 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9233 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-14T12:36:57.701 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7697 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-14T12:36:57.701 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-14T12:36:57.701 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7697 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-14T12:36:57.701 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10993 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-14T12:36:57.702 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 48897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conncount.ko 2023-07-14T12:36:57.702 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 408689 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack.ko 2023-07-14T12:36:57.702 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-14T12:36:57.702 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10177 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-14T12:36:57.702 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33761 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-14T12:36:57.702 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 118145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-14T12:36:57.702 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-14T12:36:57.702 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-14T12:36:57.703 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 108393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-14T12:36:57.703 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-14T12:36:57.703 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-14T12:36:57.703 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 66641 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-14T12:36:57.703 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11233 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-14T12:36:57.703 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-14T12:36:57.703 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10113 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-14T12:36:57.703 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 88513 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_flow_table.ko 2023-07-14T12:36:57.704 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9593 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-14T12:36:57.704 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_log_syslog.ko 2023-07-14T12:36:57.704 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 95353 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat.ko 2023-07-14T12:36:57.704 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-14T12:36:57.704 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-14T12:36:57.704 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_irc.ko 2023-07-14T12:36:57.704 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28929 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_sip.ko 2023-07-14T12:36:57.705 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-14T12:36:57.705 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 44025 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-14T12:36:57.705 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 592185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_tables.ko 2023-07-14T12:36:57.705 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 43873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink.ko 2023-07-14T12:36:57.705 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-14T12:36:57.705 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-07-14T12:36:57.705 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 39905 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_log.ko 2023-07-14T12:36:57.705 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22713 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-14T12:36:57.706 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 49673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-14T12:36:57.706 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_chain_nat.ko 2023-07-14T12:36:57.706 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_compat.ko 2023-07-14T12:36:57.706 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 40721 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_ct.ko 2023-07-14T12:36:57.706 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-14T12:36:57.706 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11345 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_fib.ko 2023-07-14T12:36:57.706 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13745 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-14T12:36:57.706 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14185 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_hash.ko 2023-07-14T12:36:57.707 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_limit.ko 2023-07-14T12:36:57.707 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_log.ko 2023-07-14T12:36:57.707 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_masq.ko 2023-07-14T12:36:57.707 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_nat.ko 2023-07-14T12:36:57.707 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_numgen.ko 2023-07-14T12:36:57.707 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_osf.ko 2023-07-14T12:36:57.707 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_queue.ko 2023-07-14T12:36:57.707 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_redir.ko 2023-07-14T12:36:57.708 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_reject.ko 2023-07-14T12:36:57.708 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_reject_inet.ko 2023-07-14T12:36:57.708 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12737 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_socket.ko 2023-07-14T12:36:57.708 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20393 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_synproxy.ko 2023-07-14T12:36:57.708 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14849 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_tproxy.ko 2023-07-14T12:36:57.708 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 89329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/x_tables.ko 2023-07-14T12:36:57.708 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_AUDIT.ko 2023-07-14T12:36:57.709 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9633 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-14T12:36:57.709 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-14T12:36:57.709 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-14T12:36:57.709 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18169 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CT.ko 2023-07-14T12:36:57.709 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10497 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_DSCP.ko 2023-07-14T12:36:57.709 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_HL.ko 2023-07-14T12:36:57.709 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_HMARK.ko 2023-07-14T12:36:57.709 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38857 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-14T12:36:57.710 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13873 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_LED.ko 2023-07-14T12:36:57.710 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11489 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_LOG.ko 2023-07-14T12:36:57.710 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-14T12:36:57.710 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NETMAP.ko 2023-07-14T12:36:57.710 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NFLOG.ko 2023-07-14T12:36:57.710 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13289 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-14T12:36:57.710 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19689 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_RATEEST.ko 2023-07-14T12:36:57.710 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-14T12:36:57.711 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_SECMARK.ko 2023-07-14T12:36:57.711 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-14T12:36:57.711 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-14T12:36:57.711 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17369 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TEE.ko 2023-07-14T12:36:57.711 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TPROXY.ko 2023-07-14T12:36:57.711 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TRACE.ko 2023-07-14T12:36:57.711 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_addrtype.ko 2023-07-14T12:36:57.711 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_bpf.ko 2023-07-14T12:36:57.712 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15577 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cgroup.ko 2023-07-14T12:36:57.712 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11209 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cluster.ko 2023-07-14T12:36:57.712 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_comment.ko 2023-07-14T12:36:57.712 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10465 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connbytes.ko 2023-07-14T12:36:57.712 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connlabel.ko 2023-07-14T12:36:57.712 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connlimit.ko 2023-07-14T12:36:57.712 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connmark.ko 2023-07-14T12:36:57.713 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_conntrack.ko 2023-07-14T12:36:57.713 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cpu.ko 2023-07-14T12:36:57.713 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_dccp.ko 2023-07-14T12:36:57.713 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_devgroup.ko 2023-07-14T12:36:57.713 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8801 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_dscp.ko 2023-07-14T12:36:57.713 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ecn.ko 2023-07-14T12:36:57.713 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_esp.ko 2023-07-14T12:36:57.713 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 43457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_hashlimit.ko 2023-07-14T12:36:57.714 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_helper.ko 2023-07-14T12:36:57.714 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7865 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_hl.ko 2023-07-14T12:36:57.714 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11921 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ipcomp.ko 2023-07-14T12:36:57.714 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_iprange.ko 2023-07-14T12:36:57.715 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11785 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ipvs.ko 2023-07-14T12:36:57.715 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16041 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_l2tp.ko 2023-07-14T12:36:57.715 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8001 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_length.ko 2023-07-14T12:36:57.715 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10273 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_limit.ko 2023-07-14T12:36:57.715 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_mac.ko 2023-07-14T12:36:57.715 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8641 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_mark.ko 2023-07-14T12:36:57.715 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_multiport.ko 2023-07-14T12:36:57.715 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_nat.ko 2023-07-14T12:36:57.716 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_nfacct.ko 2023-07-14T12:36:57.716 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8297 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_osf.ko 2023-07-14T12:36:57.716 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_owner.ko 2023-07-14T12:36:57.716 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_physdev.ko 2023-07-14T12:36:57.716 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7633 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_pkttype.ko 2023-07-14T12:36:57.716 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_policy.ko 2023-07-14T12:36:57.716 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_quota.ko 2023-07-14T12:36:57.717 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10409 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_rateest.ko 2023-07-14T12:36:57.717 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8257 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_realm.ko 2023-07-14T12:36:57.717 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_recent.ko 2023-07-14T12:36:57.717 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13329 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_sctp.ko 2023-07-14T12:36:57.717 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_set.ko 2023-07-14T12:36:57.717 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16089 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_socket.ko 2023-07-14T12:36:57.717 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9505 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_state.ko 2023-07-14T12:36:57.717 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9473 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_statistic.ko 2023-07-14T12:36:57.718 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_string.ko 2023-07-14T12:36:57.718 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8553 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_tcpmss.ko 2023-07-14T12:36:57.718 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15777 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_tcpudp.ko 2023-07-14T12:36:57.718 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11129 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_time.ko 2023-07-14T12:36:57.718 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9105 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_u32.ko 2023-07-14T12:36:57.718 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netlink/ 2023-07-14T12:36:57.718 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13969 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netlink/netlink_diag.ko 2023-07-14T12:36:57.718 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/nsh/ 2023-07-14T12:36:57.719 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/nsh/nsh.ko 2023-07-14T12:36:57.719 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/ 2023-07-14T12:36:57.719 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 379545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/openvswitch.ko 2023-07-14T12:36:57.719 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10321 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-geneve.ko 2023-07-14T12:36:57.719 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-gre.ko 2023-07-14T12:36:57.719 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-vxlan.ko 2023-07-14T12:36:57.719 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/packet/ 2023-07-14T12:36:57.720 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/packet/af_packet_diag.ko 2023-07-14T12:36:57.720 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/phonet/ 2023-07-14T12:36:57.720 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 109961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/phonet/phonet.ko 2023-07-14T12:36:57.720 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 54761 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/phonet/pn_pep.ko 2023-07-14T12:36:57.720 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/ 2023-07-14T12:36:57.720 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 252825 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds.ko 2023-07-14T12:36:57.720 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 165081 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds_rdma.ko 2023-07-14T12:36:57.720 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 67241 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds_tcp.ko 2023-07-14T12:36:57.721 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rxrpc/ 2023-07-14T12:36:57.721 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 820137 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rxrpc/rxrpc.ko 2023-07-14T12:36:57.721 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/ 2023-07-14T12:36:57.721 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_csum.ko 2023-07-14T12:36:57.721 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23537 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_gact.ko 2023-07-14T12:36:57.721 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_ipt.ko 2023-07-14T12:36:57.721 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_mirred.ko 2023-07-14T12:36:57.722 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_nat.ko 2023-07-14T12:36:57.722 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 43817 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_pedit.ko 2023-07-14T12:36:57.722 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_police.ko 2023-07-14T12:36:57.722 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20313 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_simple.ko 2023-07-14T12:36:57.722 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36353 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_skbedit.ko 2023-07-14T12:36:57.722 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36057 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_vlan.ko 2023-07-14T12:36:57.722 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26145 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_basic.ko 2023-07-14T12:36:57.722 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33673 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_bpf.ko 2023-07-14T12:36:57.723 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19233 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_cgroup.ko 2023-07-14T12:36:57.723 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31377 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_flow.ko 2023-07-14T12:36:57.723 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_fw.ko 2023-07-14T12:36:57.723 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_route.ko 2023-07-14T12:36:57.723 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 59217 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_u32.ko 2023-07-14T12:36:57.723 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7441 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_cmp.ko 2023-07-14T12:36:57.723 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13457 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_ipset.ko 2023-07-14T12:36:57.724 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33337 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_meta.ko 2023-07-14T12:36:57.724 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_nbyte.ko 2023-07-14T12:36:57.724 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10625 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_text.ko 2023-07-14T12:36:57.724 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7249 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_u32.ko 2023-07-14T12:36:57.724 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_choke.ko 2023-07-14T12:36:57.724 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20961 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_codel.ko 2023-07-14T12:36:57.724 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33753 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_drr.ko 2023-07-14T12:36:57.724 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33609 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_fq.ko 2023-07-14T12:36:57.725 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_fq_codel.ko 2023-07-14T12:36:57.725 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35433 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_gred.ko 2023-07-14T12:36:57.725 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 48409 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_hfsc.ko 2023-07-14T12:36:57.725 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22073 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_hhf.ko 2023-07-14T12:36:57.725 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 65793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_htb.ko 2023-07-14T12:36:57.725 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_ingress.ko 2023-07-14T12:36:57.725 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29809 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_mqprio.ko 2023-07-14T12:36:57.726 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10793 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_mqprio_lib.ko 2023-07-14T12:36:57.726 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26065 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_multiq.ko 2023-07-14T12:36:57.726 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35601 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_netem.ko 2023-07-14T12:36:57.726 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27545 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_pie.ko 2023-07-14T12:36:57.726 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_plug.ko 2023-07-14T12:36:57.726 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_prio.ko 2023-07-14T12:36:57.726 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47617 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_qfq.ko 2023-07-14T12:36:57.726 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32953 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_red.ko 2023-07-14T12:36:57.727 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26881 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_sfb.ko 2023-07-14T12:36:57.727 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31425 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_sfq.ko 2023-07-14T12:36:57.727 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28897 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_tbf.ko 2023-07-14T12:36:57.727 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_teql.ko 2023-07-14T12:36:57.727 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp/ 2023-07-14T12:36:57.727 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 930369 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp/sctp.ko 2023-07-14T12:36:57.727 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19033 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp/sctp_diag.ko 2023-07-14T12:36:57.728 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/ 2023-07-14T12:36:57.728 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss/ 2023-07-14T12:36:57.728 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 335569 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-14T12:36:57.728 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 61833 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-14T12:36:57.728 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 1514649 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/sunrpc.ko 2023-07-14T12:36:57.728 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/xprtrdma/ 2023-07-14T12:36:57.728 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 707401 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-14T12:36:57.728 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc/ 2023-07-14T12:36:57.729 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10025 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc/diag.ko 2023-07-14T12:36:57.729 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 862233 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc/tipc.ko 2023-07-14T12:36:57.729 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/unix/ 2023-07-14T12:36:57.729 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15729 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/unix/unix_diag.ko 2023-07-14T12:36:57.729 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/ 2023-07-14T12:36:57.729 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 84841 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-14T12:36:57.729 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 68033 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-14T12:36:57.729 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 95985 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock.ko 2023-07-14T12:36:57.730 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-14T12:36:57.730 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17521 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-14T12:36:57.730 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/x25/ 2023-07-14T12:36:57.730 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 125097 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/x25/x25.ko 2023-07-14T12:36:57.730 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/xfrm/ 2023-07-14T12:36:57.730 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22657 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/xfrm/xfrm_algo.ko 2023-07-14T12:36:57.730 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20705 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-14T12:36:57.730 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 102265 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/xfrm/xfrm_user.ko 2023-07-14T12:36:57.731 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt/ 2023-07-14T12:36:57.731 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt/lib/ 2023-07-14T12:36:57.731 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15513 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt/lib/irqbypass.ko 2023-07-14T12:36:57.731 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 638200 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/modules.alias 2023-07-14T12:36:57.731 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 623896 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/modules.alias.bin 2023-07-14T12:36:57.731 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7656 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin 2023-07-14T12:36:57.731 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23361 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin.alias.bin 2023-07-14T12:36:57.732 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9821 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin.bin 2023-07-14T12:36:57.732 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 69903 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin.modinfo 2023-07-14T12:36:57.732 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 146449 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/modules.dep 2023-07-14T12:36:57.732 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 232695 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/modules.dep.bin 2023-07-14T12:36:57.732 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 210 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/modules.devname 2023-07-14T12:36:57.732 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 72754 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/modules.order 2023-07-14T12:36:57.732 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 879 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/modules.softdep 2023-07-14T12:36:57.732 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 252883 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/modules.symbols 2023-07-14T12:36:57.733 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 307884 2023-07-13 12:30 ./lib/modules/6.5.0-rc1-ga440c79eee02/modules.symbols.bin 2023-07-14T12:36:57.733 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./usr/ 2023-07-14T12:36:57.733 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./usr/share/ 2023-07-14T12:36:57.733 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./usr/share/doc/ 2023-07-14T12:36:57.733 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-07-13 12:30 ./usr/share/doc/linux-image-6.5.0-rc1-ga440c79eee02/ 2023-07-14T12:36:57.733 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 173 2023-07-13 12:30 ./usr/share/doc/linux-image-6.5.0-rc1-ga440c79eee02/changelog.Debian.gz 2023-07-14T12:36:57.733 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 691 2023-07-13 12:30 ./usr/share/doc/linux-image-6.5.0-rc1-ga440c79eee02/copyright 2023-07-14T12:36:57.734 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc1-ga440c79eee02 2023-07-14T12:36:57.735 INFO:teuthology.task.kernel:searching for kernel 6.5.0-rc1-ga440c79eee02 2023-07-14T12:36:57.735 DEBUG:teuthology.orchestra.run.smithi154:> egrep '(submenu|menuentry.*6.5.0-rc1-ga440c79eee02).*{' /boot/grub/grub.cfg 2023-07-14T12:36:57.741 INFO:teuthology.orchestra.run.smithi154.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-14T12:36:57.741 INFO:teuthology.orchestra.run.smithi154.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc1-ga440c79eee02' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc1-ga440c79eee02-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-14T12:36:57.742 INFO:teuthology.orchestra.run.smithi154.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc1-ga440c79eee02 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc1-ga440c79eee02-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-14T12:36:57.742 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-07-14T12:36:57.742 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.5.0-rc1-ga440c79eee02 2023-07-14T12:36:57.742 DEBUG:teuthology.orchestra.run.smithi154:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-07-14T12:36:57.784 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi154.front.sepia.ceph.com to complete... 2023-07-14T12:36:58.133 INFO:teuthology.orchestra.run.smithi154.stderr:Sourcing file `/etc/default/grub' 2023-07-14T12:36:58.134 INFO:teuthology.orchestra.run.smithi154.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-14T12:36:58.160 INFO:teuthology.orchestra.run.smithi154.stderr:Generating grub configuration file ... 2023-07-14T12:36:58.356 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 2023-07-14T12:36:58.362 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc1-ga440c79eee02 2023-07-14T12:36:58.598 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-07-14T12:36:58.603 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-07-14T12:36:58.641 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-07-14T12:36:58.646 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-07-14T12:36:58.789 INFO:teuthology.orchestra.run.smithi154.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-07-14T12:36:58.789 INFO:teuthology.orchestra.run.smithi154.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-07-14T12:36:58.789 INFO:teuthology.orchestra.run.smithi154.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-07-14T12:36:58.799 INFO:teuthology.orchestra.run.smithi154.stderr:done 2023-07-14T12:36:59.951 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-14T12:37:28.552 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-07-14T12:37:28.553 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-07-14T12:37:28.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T12:37:29.955 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-07-14T12:37:29.956 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-07-14T12:37:29.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T12:37:46.992 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.5 2023-07-14T12:37:48.272 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-07-14T12:37:56.000 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-07-14T12:37:56.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T12:37:57.275 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-07-14T12:37:57.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T12:38:00.336 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-07-14T12:38:12.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-07-14T12:38:12.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T12:38:30.768 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-07-14T12:38:45.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-07-14T12:38:45.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T12:38:45.786 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-07-14T12:38:56.008 DEBUG:teuthology.orchestra.remote:timed out 2023-07-14T12:39:03.793 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-07-14T12:39:03.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T12:39:04.086 DEBUG:teuthology.orchestra.run.smithi154:> true 2023-07-14T12:39:04.840 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-07-14T12:39:04.841 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.5.0-rc1-ga440c79eee02"... 2023-07-14T12:39:04.841 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2023-07-14T12:39:04.889 INFO:teuthology.orchestra.run.smithi154.stdout:6.5.0-rc1-ga440c79eee02 2023-07-14T12:39:04.889 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc1-ga440c79eee02 vs 6.5.0-rc1-ga440c79eee02 2023-07-14T12:39:04.889 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-14T12:39:04.890 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-07-14T12:39:05.891 DEBUG:teuthology.parallel:result is None 2023-07-14T12:39:08.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-07-14T12:39:08.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T12:39:08.248 DEBUG:teuthology.orchestra.run.smithi005:> true 2023-07-14T12:39:08.979 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-07-14T12:39:08.979 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc1-ga440c79eee02"... 2023-07-14T12:39:08.980 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2023-07-14T12:39:09.030 INFO:teuthology.orchestra.run.smithi005.stdout:6.5.0-rc1-ga440c79eee02 2023-07-14T12:39:09.031 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc1-ga440c79eee02 vs 6.5.0-rc1-ga440c79eee02 2023-07-14T12:39:09.031 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-14T12:39:09.032 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-07-14T12:39:10.033 DEBUG:teuthology.parallel:result is None 2023-07-14T12:39:10.034 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-14T12:39:10.042 INFO:teuthology.task.internal:Creating test directory... 2023-07-14T12:39:10.043 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-14T12:39:10.046 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-14T12:39:10.056 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-14T12:39:10.078 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-14T12:39:10.112 INFO:teuthology.task.internal:Creating archive directory... 2023-07-14T12:39:10.112 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-14T12:39:10.116 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-14T12:39:10.167 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-14T12:39:10.176 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-14T12:39:10.177 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-14T12:39:10.180 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-14T12:39:10.249 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-14T12:39:10.272 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-14T12:39:10.281 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-14T12:39:10.302 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-14T12:39:10.304 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-14T12:39:10.313 INFO:teuthology.task.internal:Configuring sudo... 2023-07-14T12:39:10.314 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-14T12:39:10.318 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-14T12:39:10.343 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-14T12:39:10.354 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-14T12:39:10.354 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-14T12:39:10.382 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-14T12:39:10.397 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-14T12:39:10.440 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-14T12:39:10.495 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:39:10.496 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-14T12:39:10.574 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-14T12:39:10.584 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-14T12:39:10.637 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:39:10.638 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-14T12:39:10.712 DEBUG:teuthology.orchestra.run.smithi005:> sudo service rsyslog restart 2023-07-14T12:39:10.716 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2023-07-14T12:39:10.823 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-14T12:39:10.831 INFO:teuthology.task.internal:Starting timer... 2023-07-14T12:39:10.831 INFO:teuthology.run_tasks:Running task pcp... 2023-07-14T12:39:10.859 INFO:teuthology.run_tasks:Running task selinux... 2023-07-14T12:39:10.893 DEBUG:teuthology.task.selinux:Excluding smithi005: OS 'ubuntu' does not support SELinux 2023-07-14T12:39:10.894 DEBUG:teuthology.task.selinux:Excluding smithi154: OS 'ubuntu' does not support SELinux 2023-07-14T12:39:10.894 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-14T12:39:10.895 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-07-14T12:39:10.895 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-14T12:39:10.896 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-14T12:39:10.924 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-07-14T12:39:10.932 INFO:teuthology.repo_utils:Fetching main from origin 2023-07-14T12:39:11.074 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-14T12:39:11.106 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-14T12:39:11.107 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi005.front.sepia.ceph.com,smithi154.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-14T12:48:01.093 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi005.front.sepia.ceph.com'), Remote(name='ubuntu@smithi154.front.sepia.ceph.com')] 2023-07-14T12:48:01.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-07-14T12:48:01.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T12:48:01.179 DEBUG:teuthology.orchestra.run.smithi005:> true 2023-07-14T12:48:01.295 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-07-14T12:48:01.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-07-14T12:48:01.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T12:48:01.368 DEBUG:teuthology.orchestra.run.smithi154:> true 2023-07-14T12:48:01.474 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-07-14T12:48:01.475 INFO:teuthology.run_tasks:Running task clock... 2023-07-14T12:48:01.486 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-14T12:48:01.486 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-14T12:48:01.487 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-14T12:48:01.490 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-14T12:48:01.491 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-14T12:48:01.528 INFO:teuthology.orchestra.run.smithi005.stdout:14 Jul 12:48:01 ntpd[27340]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-07-14T12:48:01.529 INFO:teuthology.orchestra.run.smithi005.stdout:14 Jul 12:48:01 ntpd[27340]: Command line: ntpd -gq 2023-07-14T12:48:01.529 INFO:teuthology.orchestra.run.smithi005.stdout:14 Jul 12:48:01 ntpd[27340]: ---------------------------------------------------- 2023-07-14T12:48:01.529 INFO:teuthology.orchestra.run.smithi005.stdout:14 Jul 12:48:01 ntpd[27340]: ntp-4 is maintained by Network Time Foundation, 2023-07-14T12:48:01.529 INFO:teuthology.orchestra.run.smithi005.stdout:14 Jul 12:48:01 ntpd[27340]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-07-14T12:48:01.529 INFO:teuthology.orchestra.run.smithi005.stdout:14 Jul 12:48:01 ntpd[27340]: corporation. Support and training for ntp-4 are 2023-07-14T12:48:01.529 INFO:teuthology.orchestra.run.smithi005.stdout:14 Jul 12:48:01 ntpd[27340]: available at https://www.nwtime.org/support 2023-07-14T12:48:01.529 INFO:teuthology.orchestra.run.smithi005.stdout:14 Jul 12:48:01 ntpd[27340]: ---------------------------------------------------- 2023-07-14T12:48:01.530 INFO:teuthology.orchestra.run.smithi005.stdout:14 Jul 12:48:01 ntpd[27340]: proto: precision = 0.042 usec (-24) 2023-07-14T12:48:01.530 INFO:teuthology.orchestra.run.smithi005.stdout:14 Jul 12:48:01 ntpd[27340]: basedate set to 2022-02-04 2023-07-14T12:48:01.530 INFO:teuthology.orchestra.run.smithi005.stdout:14 Jul 12:48:01 ntpd[27340]: gps base set to 2022-02-06 (week 2196) 2023-07-14T12:48:01.531 INFO:teuthology.orchestra.run.smithi005.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-14T12:48:01.531 INFO:teuthology.orchestra.run.smithi005.stdout:14 Jul 12:48:01 ntpd[27340]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-14T12:48:01.531 INFO:teuthology.orchestra.run.smithi005.stderr:restrict ::: KOD does nothing without LIMITED. 2023-07-14T12:48:01.532 INFO:teuthology.orchestra.run.smithi005.stdout:14 Jul 12:48:01 ntpd[27340]: restrict ::: KOD does nothing without LIMITED. 2023-07-14T12:48:01.532 INFO:teuthology.orchestra.run.smithi005.stdout:14 Jul 12:48:01 ntpd[27340]: Listen and drop on 0 v6wildcard [::]:123 2023-07-14T12:48:01.533 INFO:teuthology.orchestra.run.smithi005.stdout:14 Jul 12:48:01 ntpd[27340]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-07-14T12:48:01.533 INFO:teuthology.orchestra.run.smithi005.stdout:14 Jul 12:48:01 ntpd[27340]: Listen normally on 2 lo 127.0.0.1:123 2023-07-14T12:48:01.533 INFO:teuthology.orchestra.run.smithi005.stdout:14 Jul 12:48:01 ntpd[27340]: Listen normally on 3 ens1f0 172.21.15.5:123 2023-07-14T12:48:01.533 INFO:teuthology.orchestra.run.smithi005.stdout:14 Jul 12:48:01 ntpd[27340]: Listen normally on 4 lo [::1]:123 2023-07-14T12:48:01.533 INFO:teuthology.orchestra.run.smithi005.stdout:14 Jul 12:48:01 ntpd[27340]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1442%3]:123 2023-07-14T12:48:01.533 INFO:teuthology.orchestra.run.smithi005.stdout:14 Jul 12:48:01 ntpd[27340]: Listening on routing socket on fd #22 for interface updates 2023-07-14T12:48:01.555 INFO:teuthology.orchestra.run.smithi154.stdout:14 Jul 12:48:01 ntpd[27440]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-07-14T12:48:01.555 INFO:teuthology.orchestra.run.smithi154.stdout:14 Jul 12:48:01 ntpd[27440]: Command line: ntpd -gq 2023-07-14T12:48:01.556 INFO:teuthology.orchestra.run.smithi154.stdout:14 Jul 12:48:01 ntpd[27440]: ---------------------------------------------------- 2023-07-14T12:48:01.556 INFO:teuthology.orchestra.run.smithi154.stdout:14 Jul 12:48:01 ntpd[27440]: ntp-4 is maintained by Network Time Foundation, 2023-07-14T12:48:01.556 INFO:teuthology.orchestra.run.smithi154.stdout:14 Jul 12:48:01 ntpd[27440]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-07-14T12:48:01.556 INFO:teuthology.orchestra.run.smithi154.stdout:14 Jul 12:48:01 ntpd[27440]: corporation. Support and training for ntp-4 are 2023-07-14T12:48:01.556 INFO:teuthology.orchestra.run.smithi154.stdout:14 Jul 12:48:01 ntpd[27440]: available at https://www.nwtime.org/support 2023-07-14T12:48:01.556 INFO:teuthology.orchestra.run.smithi154.stdout:14 Jul 12:48:01 ntpd[27440]: ---------------------------------------------------- 2023-07-14T12:48:01.557 INFO:teuthology.orchestra.run.smithi154.stdout:14 Jul 12:48:01 ntpd[27440]: proto: precision = 0.041 usec (-24) 2023-07-14T12:48:01.557 INFO:teuthology.orchestra.run.smithi154.stdout:14 Jul 12:48:01 ntpd[27440]: basedate set to 2022-02-04 2023-07-14T12:48:01.557 INFO:teuthology.orchestra.run.smithi154.stdout:14 Jul 12:48:01 ntpd[27440]: gps base set to 2022-02-06 (week 2196) 2023-07-14T12:48:01.558 INFO:teuthology.orchestra.run.smithi154.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-14T12:48:01.558 INFO:teuthology.orchestra.run.smithi154.stdout:14 Jul 12:48:01 ntpd[27440]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-14T12:48:01.558 INFO:teuthology.orchestra.run.smithi154.stdout:14 Jul 12:48:01 ntpd[27440]: restrict ::: KOD does nothing without LIMITED. 2023-07-14T12:48:01.558 INFO:teuthology.orchestra.run.smithi154.stderr:restrict ::: KOD does nothing without LIMITED. 2023-07-14T12:48:01.559 INFO:teuthology.orchestra.run.smithi154.stdout:14 Jul 12:48:01 ntpd[27440]: Listen and drop on 0 v6wildcard [::]:123 2023-07-14T12:48:01.559 INFO:teuthology.orchestra.run.smithi154.stdout:14 Jul 12:48:01 ntpd[27440]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-07-14T12:48:01.560 INFO:teuthology.orchestra.run.smithi154.stdout:14 Jul 12:48:01 ntpd[27440]: Listen normally on 2 lo 127.0.0.1:123 2023-07-14T12:48:01.560 INFO:teuthology.orchestra.run.smithi154.stdout:14 Jul 12:48:01 ntpd[27440]: Listen normally on 3 enp3s0f1 172.21.15.154:123 2023-07-14T12:48:01.560 INFO:teuthology.orchestra.run.smithi154.stdout:14 Jul 12:48:01 ntpd[27440]: Listen normally on 4 lo [::1]:123 2023-07-14T12:48:01.560 INFO:teuthology.orchestra.run.smithi154.stdout:14 Jul 12:48:01 ntpd[27440]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7761%5]:123 2023-07-14T12:48:01.561 INFO:teuthology.orchestra.run.smithi154.stdout:14 Jul 12:48:01 ntpd[27440]: Listening on routing socket on fd #22 for interface updates 2023-07-14T12:48:02.529 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:02 ntpd[27340]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:02.529 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:02 ntpd[27340]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:02.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:02 ntpd[27340]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:02.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:02 ntpd[27340]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:02.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:02 ntpd[27340]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-14T12:48:02.531 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:02 ntpd[27340]: can't open /var/log/ntpstats/peerstats.20230714: Permission denied 2023-07-14T12:48:03.529 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:03 ntpd[27340]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:03.529 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:03 ntpd[27340]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:03.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:03 ntpd[27340]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:03.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:03 ntpd[27340]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:03.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:03 ntpd[27340]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-14T12:48:03.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:03 ntpd[27340]: can't open /var/log/ntpstats/peerstats.20230714: Permission denied 2023-07-14T12:48:03.556 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:03 ntpd[27440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:03.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:03 ntpd[27440]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:03.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:03 ntpd[27440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:03.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:03 ntpd[27440]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:03.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:03 ntpd[27440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-14T12:48:03.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:03 ntpd[27440]: can't open /var/log/ntpstats/peerstats.20230714: Permission denied 2023-07-14T12:48:04.529 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:04 ntpd[27340]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:04.529 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:04 ntpd[27340]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:04.529 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:04 ntpd[27340]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:04 ntpd[27340]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:04 ntpd[27340]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-14T12:48:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:04 ntpd[27340]: can't open /var/log/ntpstats/peerstats.20230714: Permission denied 2023-07-14T12:48:04.556 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:04 ntpd[27440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:04.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:04 ntpd[27440]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:04.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:04 ntpd[27440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:04.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:04 ntpd[27440]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:04.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:04 ntpd[27440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:04.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:04 ntpd[27440]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:04.558 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:04 ntpd[27440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:04.558 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:04 ntpd[27440]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:04.558 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:04 ntpd[27440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-14T12:48:04.558 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:04 ntpd[27440]: can't open /var/log/ntpstats/peerstats.20230714: Permission denied 2023-07-14T12:48:04.558 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:04 ntpd[27440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:04.558 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:04 ntpd[27440]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:04.558 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:04 ntpd[27440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-14T12:48:04.558 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:04 ntpd[27440]: can't open /var/log/ntpstats/peerstats.20230714: Permission denied 2023-07-14T12:48:05.529 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:05 ntpd[27340]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:05.529 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:05 ntpd[27340]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:05.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:05 ntpd[27340]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:05.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:05 ntpd[27340]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:05.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:05 ntpd[27340]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:05.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:05 ntpd[27340]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:05.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:05 ntpd[27340]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-14T12:48:05.531 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:05 ntpd[27340]: can't open /var/log/ntpstats/peerstats.20230714: Permission denied 2023-07-14T12:48:05.556 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:05 ntpd[27440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:05.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:05 ntpd[27440]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:05.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:05 ntpd[27440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:05.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:05 ntpd[27440]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:05.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:05 ntpd[27440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-14T12:48:05.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:05 ntpd[27440]: can't open /var/log/ntpstats/peerstats.20230714: Permission denied 2023-07-14T12:48:06.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:06 ntpd[27340]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:06.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:06 ntpd[27340]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:06.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:06 ntpd[27340]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:06.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:06 ntpd[27340]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:06.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:06 ntpd[27340]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:06.531 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:06 ntpd[27340]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:06.531 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:06 ntpd[27340]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-14T12:48:06.531 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:06 ntpd[27340]: can't open /var/log/ntpstats/peerstats.20230714: Permission denied 2023-07-14T12:48:06.531 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:06 ntpd[27340]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:06.531 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:06 ntpd[27340]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:06.531 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:06 ntpd[27340]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-14T12:48:06.531 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:06 ntpd[27340]: can't open /var/log/ntpstats/peerstats.20230714: Permission denied 2023-07-14T12:48:06.556 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:06 ntpd[27440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:06.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:06 ntpd[27440]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:06.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:06 ntpd[27440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:06.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:06 ntpd[27440]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:06.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:06 ntpd[27440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:06.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:06 ntpd[27440]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:06.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:06 ntpd[27440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-14T12:48:06.558 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:06 ntpd[27440]: can't open /var/log/ntpstats/peerstats.20230714: Permission denied 2023-07-14T12:48:06.558 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:06 ntpd[27440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:06.558 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:06 ntpd[27440]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:06.558 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:06 ntpd[27440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-14T12:48:06.558 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:06 ntpd[27440]: can't open /var/log/ntpstats/peerstats.20230714: Permission denied 2023-07-14T12:48:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:07 ntpd[27340]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:07 ntpd[27340]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:07.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:07 ntpd[27340]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:07.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:07 ntpd[27340]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:07.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:07 ntpd[27340]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-14T12:48:07.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:07 ntpd[27340]: can't open /var/log/ntpstats/peerstats.20230714: Permission denied 2023-07-14T12:48:07.556 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:07 ntpd[27440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:07.556 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:07 ntpd[27440]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:07.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:07 ntpd[27440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:07.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:07 ntpd[27440]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:07.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:07 ntpd[27440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-14T12:48:07.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:07 ntpd[27440]: can't open /var/log/ntpstats/peerstats.20230714: Permission denied 2023-07-14T12:48:08.529 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:08 ntpd[27340]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:08.529 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:08 ntpd[27340]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:08.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:08 ntpd[27340]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:08.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:08 ntpd[27340]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:08.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:08 ntpd[27340]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:08.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:08 ntpd[27340]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:08.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:08 ntpd[27340]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-14T12:48:08.530 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:08 ntpd[27340]: can't open /var/log/ntpstats/peerstats.20230714: Permission denied 2023-07-14T12:48:08.531 INFO:teuthology.orchestra.run.smithi005.stdout:14 Jul 12:48:08 ntpd[27340]: ntpd: time slew +0.000302 s 2023-07-14T12:48:08.531 INFO:teuthology.orchestra.run.smithi005.stdout:ntpd: time slew +0.000302s 2023-07-14T12:48:08.532 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:08 ntpd[27340]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-07-14T12:48:08.532 INFO:teuthology.orchestra.run.smithi005.stderr:14 Jul 12:48:08 ntpd[27340]: can't open /var/log/ntpstats/loopstats.20230714: Permission denied 2023-07-14T12:48:08.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:08 ntpd[27440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:08.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:08 ntpd[27440]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:08.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:08 ntpd[27440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:08.558 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:08 ntpd[27440]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:08.558 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:08 ntpd[27440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:08.558 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:08 ntpd[27440]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:08.558 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:08 ntpd[27440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-14T12:48:08.558 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:08 ntpd[27440]: can't open /var/log/ntpstats/peerstats.20230714: Permission denied 2023-07-14T12:48:08.558 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:08 ntpd[27440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:08.558 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:08 ntpd[27440]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:08.558 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:08 ntpd[27440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-14T12:48:08.559 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:08 ntpd[27440]: can't open /var/log/ntpstats/peerstats.20230714: Permission denied 2023-07-14T12:48:08.623 INFO:teuthology.orchestra.run.smithi005.stdout: remote refid st t when poll reach delay offset jitter 2023-07-14T12:48:08.624 INFO:teuthology.orchestra.run.smithi005.stdout:============================================================================== 2023-07-14T12:48:08.624 INFO:teuthology.orchestra.run.smithi005.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-14T12:48:08.624 INFO:teuthology.orchestra.run.smithi005.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-14T12:48:08.624 INFO:teuthology.orchestra.run.smithi005.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-14T12:48:08.624 INFO:teuthology.orchestra.run.smithi005.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-14T12:48:09.556 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:09 ntpd[27440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:09.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:09 ntpd[27440]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:09.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:09 ntpd[27440]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-14T12:48:09.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:09 ntpd[27440]: can't open /var/log/ntpstats/rawstats.20230714: Permission denied 2023-07-14T12:48:09.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:09 ntpd[27440]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-14T12:48:09.557 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:09 ntpd[27440]: can't open /var/log/ntpstats/peerstats.20230714: Permission denied 2023-07-14T12:48:09.557 INFO:teuthology.orchestra.run.smithi154.stdout:14 Jul 12:48:09 ntpd[27440]: ntpd: time slew -0.003672 s 2023-07-14T12:48:09.558 INFO:teuthology.orchestra.run.smithi154.stdout:ntpd: time slew -0.003672s 2023-07-14T12:48:09.558 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:09 ntpd[27440]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-07-14T12:48:09.558 INFO:teuthology.orchestra.run.smithi154.stderr:14 Jul 12:48:09 ntpd[27440]: can't open /var/log/ntpstats/loopstats.20230714: Permission denied 2023-07-14T12:48:09.664 INFO:teuthology.orchestra.run.smithi154.stdout: remote refid st t when poll reach delay offset jitter 2023-07-14T12:48:09.664 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================== 2023-07-14T12:48:09.664 INFO:teuthology.orchestra.run.smithi154.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-14T12:48:09.664 INFO:teuthology.orchestra.run.smithi154.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-14T12:48:09.664 INFO:teuthology.orchestra.run.smithi154.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-14T12:48:09.665 INFO:teuthology.orchestra.run.smithi154.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-14T12:48:09.665 INFO:teuthology.run_tasks:Running task install... 2023-07-14T12:48:09.677 DEBUG:teuthology.task.install:project ceph 2023-07-14T12:48:09.677 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b'}} 2023-07-14T12:48:09.677 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b'} 2023-07-14T12:48:09.678 INFO:teuthology.task.install:Using flavor: default 2023-07-14T12:48:09.683 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-14T12:48:09.684 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-14T12:48:09.684 DEBUG:teuthology.orchestra.run.smithi005:> sudo apt-key list | grep Ceph 2023-07-14T12:48:09.685 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-key list | grep Ceph 2023-07-14T12:48:09.799 INFO:teuthology.orchestra.run.smithi005.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-07-14T12:48:09.815 INFO:teuthology.orchestra.run.smithi154.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-07-14T12:48:09.855 INFO:teuthology.orchestra.run.smithi005.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-07-14T12:48:09.856 INFO:teuthology.orchestra.run.smithi005.stdout:uid [ unknown] Ceph.com (release key) 2023-07-14T12:48:09.857 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-07-14T12:48:09.857 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-07-14T12:48:09.857 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3fc0089cc1082313a98853d48b892acdc1385b8b 2023-07-14T12:48:09.868 INFO:teuthology.orchestra.run.smithi154.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-07-14T12:48:09.869 INFO:teuthology.orchestra.run.smithi154.stdout:uid [ unknown] Ceph.com (release key) 2023-07-14T12:48:09.870 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-07-14T12:48:09.870 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-07-14T12:48:09.870 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3fc0089cc1082313a98853d48b892acdc1385b8b 2023-07-14T12:48:10.145 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default/ 2023-07-14T12:48:10.145 INFO:teuthology.task.install.deb:Package version is 18.0.0-4757-g3fc0089c-1jammy 2023-07-14T12:48:10.150 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default/ 2023-07-14T12:48:10.150 INFO:teuthology.task.install.deb:Package version is 18.0.0-4757-g3fc0089c-1jammy 2023-07-14T12:48:10.378 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:48:10.378 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-07-14T12:48:10.387 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:48:10.387 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-07-14T12:48:10.400 DEBUG:teuthology.orchestra.run.smithi005:> sudo apt-get update 2023-07-14T12:48:10.408 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2023-07-14T12:48:10.645 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-07-14T12:48:10.647 INFO:teuthology.orchestra.run.smithi005.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-07-14T12:48:10.678 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-07-14T12:48:10.679 INFO:teuthology.orchestra.run.smithi005.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-07-14T12:48:10.723 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-07-14T12:48:10.725 INFO:teuthology.orchestra.run.smithi005.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-07-14T12:48:10.794 INFO:teuthology.orchestra.run.smithi154.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy InRelease 2023-07-14T12:48:10.796 INFO:teuthology.orchestra.run.smithi005.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy InRelease 2023-07-14T12:48:10.805 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-07-14T12:48:10.805 INFO:teuthology.orchestra.run.smithi005.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-07-14T12:48:10.855 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-07-14T12:48:10.857 INFO:teuthology.orchestra.run.smithi005.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-07-14T12:48:10.917 INFO:teuthology.orchestra.run.smithi154.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy Release.gpg 2023-07-14T12:48:10.920 INFO:teuthology.orchestra.run.smithi005.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy Release.gpg 2023-07-14T12:48:10.979 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2023-07-14T12:48:10.984 INFO:teuthology.orchestra.run.smithi005.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-07-14T12:48:11.058 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-07-14T12:48:11.065 INFO:teuthology.orchestra.run.smithi005.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2023-07-14T12:48:11.273 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 28.6 kB in 1s (44.7 kB/s) 2023-07-14T12:48:11.301 INFO:teuthology.orchestra.run.smithi005.stdout:Fetched 28.6 kB in 1s (42.9 kB/s) 2023-07-14T12:48:12.139 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2023-07-14T12:48:12.156 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4757-g3fc0089c-1jammy cephadm=18.0.0-4757-g3fc0089c-1jammy ceph-mds=18.0.0-4757-g3fc0089c-1jammy ceph-mgr=18.0.0-4757-g3fc0089c-1jammy ceph-common=18.0.0-4757-g3fc0089c-1jammy ceph-fuse=18.0.0-4757-g3fc0089c-1jammy ceph-test=18.0.0-4757-g3fc0089c-1jammy ceph-volume=18.0.0-4757-g3fc0089c-1jammy radosgw=18.0.0-4757-g3fc0089c-1jammy python3-rados=18.0.0-4757-g3fc0089c-1jammy python3-rgw=18.0.0-4757-g3fc0089c-1jammy python3-cephfs=18.0.0-4757-g3fc0089c-1jammy python3-rbd=18.0.0-4757-g3fc0089c-1jammy libcephfs2=18.0.0-4757-g3fc0089c-1jammy libcephfs-dev=18.0.0-4757-g3fc0089c-1jammy librados2=18.0.0-4757-g3fc0089c-1jammy librbd1=18.0.0-4757-g3fc0089c-1jammy rbd-fuse=18.0.0-4757-g3fc0089c-1jammy python3-cephfs=18.0.0-4757-g3fc0089c-1jammy cephfs-shell=18.0.0-4757-g3fc0089c-1jammy cephfs-top=18.0.0-4757-g3fc0089c-1jammy cephfs-mirror=18.0.0-4757-g3fc0089c-1jammy 2023-07-14T12:48:12.202 INFO:teuthology.orchestra.run.smithi005.stdout:Reading package lists... 2023-07-14T12:48:12.219 DEBUG:teuthology.orchestra.run.smithi005:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4757-g3fc0089c-1jammy cephadm=18.0.0-4757-g3fc0089c-1jammy ceph-mds=18.0.0-4757-g3fc0089c-1jammy ceph-mgr=18.0.0-4757-g3fc0089c-1jammy ceph-common=18.0.0-4757-g3fc0089c-1jammy ceph-fuse=18.0.0-4757-g3fc0089c-1jammy ceph-test=18.0.0-4757-g3fc0089c-1jammy ceph-volume=18.0.0-4757-g3fc0089c-1jammy radosgw=18.0.0-4757-g3fc0089c-1jammy python3-rados=18.0.0-4757-g3fc0089c-1jammy python3-rgw=18.0.0-4757-g3fc0089c-1jammy python3-cephfs=18.0.0-4757-g3fc0089c-1jammy python3-rbd=18.0.0-4757-g3fc0089c-1jammy libcephfs2=18.0.0-4757-g3fc0089c-1jammy libcephfs-dev=18.0.0-4757-g3fc0089c-1jammy librados2=18.0.0-4757-g3fc0089c-1jammy librbd1=18.0.0-4757-g3fc0089c-1jammy rbd-fuse=18.0.0-4757-g3fc0089c-1jammy python3-cephfs=18.0.0-4757-g3fc0089c-1jammy cephfs-shell=18.0.0-4757-g3fc0089c-1jammy cephfs-top=18.0.0-4757-g3fc0089c-1jammy cephfs-mirror=18.0.0-4757-g3fc0089c-1jammy 2023-07-14T12:48:12.231 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2023-07-14T12:48:12.296 INFO:teuthology.orchestra.run.smithi005.stdout:Reading package lists... 2023-07-14T12:48:12.388 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2023-07-14T12:48:12.388 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2023-07-14T12:48:12.454 INFO:teuthology.orchestra.run.smithi005.stdout:Building dependency tree... 2023-07-14T12:48:12.455 INFO:teuthology.orchestra.run.smithi005.stdout:Reading state information... 2023-07-14T12:48:12.530 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2023-07-14T12:48:12.531 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-07-14T12:48:12.531 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-07-14T12:48:12.531 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-07-14T12:48:12.532 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-07-14T12:48:12.532 INFO:teuthology.orchestra.run.smithi154.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-07-14T12:48:12.532 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-14T12:48:12.532 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2023-07-14T12:48:12.533 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-07-14T12:48:12.533 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-07-14T12:48:12.533 INFO:teuthology.orchestra.run.smithi154.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-07-14T12:48:12.533 INFO:teuthology.orchestra.run.smithi154.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-07-14T12:48:12.534 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-07-14T12:48:12.534 INFO:teuthology.orchestra.run.smithi154.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-07-14T12:48:12.534 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-07-14T12:48:12.535 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-07-14T12:48:12.535 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-07-14T12:48:12.535 INFO:teuthology.orchestra.run.smithi154.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-07-14T12:48:12.535 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-07-14T12:48:12.535 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-07-14T12:48:12.535 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-07-14T12:48:12.535 INFO:teuthology.orchestra.run.smithi154.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-07-14T12:48:12.536 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-07-14T12:48:12.536 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-07-14T12:48:12.536 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-07-14T12:48:12.536 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-07-14T12:48:12.536 INFO:teuthology.orchestra.run.smithi154.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-07-14T12:48:12.536 INFO:teuthology.orchestra.run.smithi154.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-07-14T12:48:12.536 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-07-14T12:48:12.537 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-07-14T12:48:12.537 INFO:teuthology.orchestra.run.smithi154.stdout: qttranslations5-l10n socat xmlstarlet 2023-07-14T12:48:12.537 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2023-07-14T12:48:12.537 INFO:teuthology.orchestra.run.smithi154.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-07-14T12:48:12.537 INFO:teuthology.orchestra.run.smithi154.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-07-14T12:48:12.537 INFO:teuthology.orchestra.run.smithi154.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-07-14T12:48:12.537 INFO:teuthology.orchestra.run.smithi154.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-07-14T12:48:12.538 INFO:teuthology.orchestra.run.smithi154.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-07-14T12:48:12.538 INFO:teuthology.orchestra.run.smithi154.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-07-14T12:48:12.538 INFO:teuthology.orchestra.run.smithi154.stdout: python3-watchdog 2023-07-14T12:48:12.538 INFO:teuthology.orchestra.run.smithi154.stdout:Recommended packages: 2023-07-14T12:48:12.538 INFO:teuthology.orchestra.run.smithi154.stdout: btrfs-tools 2023-07-14T12:48:12.602 INFO:teuthology.orchestra.run.smithi005.stdout:The following packages were automatically installed and are no longer required: 2023-07-14T12:48:12.603 INFO:teuthology.orchestra.run.smithi005.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-07-14T12:48:12.603 INFO:teuthology.orchestra.run.smithi005.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-07-14T12:48:12.603 INFO:teuthology.orchestra.run.smithi005.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-07-14T12:48:12.604 INFO:teuthology.orchestra.run.smithi005.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-07-14T12:48:12.604 INFO:teuthology.orchestra.run.smithi005.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-07-14T12:48:12.604 INFO:teuthology.orchestra.run.smithi005.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-14T12:48:12.604 INFO:teuthology.orchestra.run.smithi005.stdout:The following additional packages will be installed: 2023-07-14T12:48:12.605 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-07-14T12:48:12.605 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-07-14T12:48:12.605 INFO:teuthology.orchestra.run.smithi005.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-07-14T12:48:12.605 INFO:teuthology.orchestra.run.smithi005.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-07-14T12:48:12.606 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-07-14T12:48:12.606 INFO:teuthology.orchestra.run.smithi005.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-07-14T12:48:12.606 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-07-14T12:48:12.607 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-07-14T12:48:12.607 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-07-14T12:48:12.607 INFO:teuthology.orchestra.run.smithi005.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-07-14T12:48:12.607 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-07-14T12:48:12.607 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-07-14T12:48:12.607 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-07-14T12:48:12.607 INFO:teuthology.orchestra.run.smithi005.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-07-14T12:48:12.608 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-07-14T12:48:12.608 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-07-14T12:48:12.608 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-07-14T12:48:12.608 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-07-14T12:48:12.608 INFO:teuthology.orchestra.run.smithi005.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-07-14T12:48:12.608 INFO:teuthology.orchestra.run.smithi005.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-07-14T12:48:12.608 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-07-14T12:48:12.608 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-07-14T12:48:12.609 INFO:teuthology.orchestra.run.smithi005.stdout: qttranslations5-l10n socat xmlstarlet 2023-07-14T12:48:12.609 INFO:teuthology.orchestra.run.smithi005.stdout:Suggested packages: 2023-07-14T12:48:12.609 INFO:teuthology.orchestra.run.smithi005.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-07-14T12:48:12.609 INFO:teuthology.orchestra.run.smithi005.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-07-14T12:48:12.609 INFO:teuthology.orchestra.run.smithi005.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-07-14T12:48:12.609 INFO:teuthology.orchestra.run.smithi005.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-07-14T12:48:12.609 INFO:teuthology.orchestra.run.smithi005.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-07-14T12:48:12.609 INFO:teuthology.orchestra.run.smithi005.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-07-14T12:48:12.610 INFO:teuthology.orchestra.run.smithi005.stdout: python3-watchdog 2023-07-14T12:48:12.610 INFO:teuthology.orchestra.run.smithi005.stdout:Recommended packages: 2023-07-14T12:48:12.610 INFO:teuthology.orchestra.run.smithi005.stdout: btrfs-tools 2023-07-14T12:48:12.674 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2023-07-14T12:48:12.674 INFO:teuthology.orchestra.run.smithi154.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-07-14T12:48:12.674 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-07-14T12:48:12.674 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-07-14T12:48:12.674 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-07-14T12:48:12.676 INFO:teuthology.orchestra.run.smithi154.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-07-14T12:48:12.676 INFO:teuthology.orchestra.run.smithi154.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-07-14T12:48:12.676 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-07-14T12:48:12.676 INFO:teuthology.orchestra.run.smithi154.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-07-14T12:48:12.676 INFO:teuthology.orchestra.run.smithi154.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-07-14T12:48:12.676 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-07-14T12:48:12.676 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-07-14T12:48:12.677 INFO:teuthology.orchestra.run.smithi154.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-07-14T12:48:12.677 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-07-14T12:48:12.677 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-07-14T12:48:12.677 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-07-14T12:48:12.677 INFO:teuthology.orchestra.run.smithi154.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-07-14T12:48:12.677 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-07-14T12:48:12.677 INFO:teuthology.orchestra.run.smithi154.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-07-14T12:48:12.678 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-07-14T12:48:12.678 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-07-14T12:48:12.678 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-07-14T12:48:12.678 INFO:teuthology.orchestra.run.smithi154.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-07-14T12:48:12.678 INFO:teuthology.orchestra.run.smithi154.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-07-14T12:48:12.678 INFO:teuthology.orchestra.run.smithi154.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-07-14T12:48:12.678 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-07-14T12:48:12.678 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-07-14T12:48:12.679 INFO:teuthology.orchestra.run.smithi154.stdout: socat xmlstarlet 2023-07-14T12:48:12.750 INFO:teuthology.orchestra.run.smithi005.stdout:The following NEW packages will be installed: 2023-07-14T12:48:12.751 INFO:teuthology.orchestra.run.smithi005.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-07-14T12:48:12.751 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-07-14T12:48:12.751 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-07-14T12:48:12.751 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-07-14T12:48:12.753 INFO:teuthology.orchestra.run.smithi005.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-07-14T12:48:12.753 INFO:teuthology.orchestra.run.smithi005.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-07-14T12:48:12.753 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-07-14T12:48:12.753 INFO:teuthology.orchestra.run.smithi005.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-07-14T12:48:12.753 INFO:teuthology.orchestra.run.smithi005.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-07-14T12:48:12.753 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-07-14T12:48:12.754 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-07-14T12:48:12.754 INFO:teuthology.orchestra.run.smithi005.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-07-14T12:48:12.754 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-07-14T12:48:12.754 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-07-14T12:48:12.754 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-07-14T12:48:12.754 INFO:teuthology.orchestra.run.smithi005.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-07-14T12:48:12.754 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-07-14T12:48:12.754 INFO:teuthology.orchestra.run.smithi005.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-07-14T12:48:12.755 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-07-14T12:48:12.755 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-07-14T12:48:12.755 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-07-14T12:48:12.755 INFO:teuthology.orchestra.run.smithi005.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-07-14T12:48:12.755 INFO:teuthology.orchestra.run.smithi005.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-07-14T12:48:12.755 INFO:teuthology.orchestra.run.smithi005.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-07-14T12:48:12.755 INFO:teuthology.orchestra.run.smithi005.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-07-14T12:48:12.756 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-07-14T12:48:12.756 INFO:teuthology.orchestra.run.smithi005.stdout: socat xmlstarlet 2023-07-14T12:48:12.906 INFO:teuthology.orchestra.run.smithi005.stdout:0 upgraded, 115 newly installed, 0 to remove and 210 not upgraded. 2023-07-14T12:48:12.906 INFO:teuthology.orchestra.run.smithi005.stdout:Need to get 183 MB of archives. 2023-07-14T12:48:12.906 INFO:teuthology.orchestra.run.smithi005.stdout:After this operation, 820 MB of additional disk space will be used. 2023-07-14T12:48:12.907 INFO:teuthology.orchestra.run.smithi005.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-07-14T12:48:12.939 INFO:teuthology.orchestra.run.smithi154.stdout:0 upgraded, 115 newly installed, 0 to remove and 210 not upgraded. 2023-07-14T12:48:12.939 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 183 MB of archives. 2023-07-14T12:48:12.939 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 820 MB of additional disk space will be used. 2023-07-14T12:48:12.939 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-07-14T12:48:12.967 INFO:teuthology.orchestra.run.smithi005.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-07-14T12:48:13.004 INFO:teuthology.orchestra.run.smithi005.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-07-14T12:48:13.061 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-07-14T12:48:13.087 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-4757-g3fc0089c-1jammy [3,404 kB] 2023-07-14T12:48:13.130 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-07-14T12:48:13.157 INFO:teuthology.orchestra.run.smithi005.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-07-14T12:48:13.183 INFO:teuthology.orchestra.run.smithi005.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-4757-g3fc0089c-1jammy [3,404 kB] 2023-07-14T12:48:13.194 INFO:teuthology.orchestra.run.smithi005.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-07-14T12:48:13.253 INFO:teuthology.orchestra.run.smithi005.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-07-14T12:48:13.261 INFO:teuthology.orchestra.run.smithi005.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-07-14T12:48:13.298 INFO:teuthology.orchestra.run.smithi005.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-07-14T12:48:13.428 INFO:teuthology.orchestra.run.smithi005.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-07-14T12:48:13.433 INFO:teuthology.orchestra.run.smithi005.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-07-14T12:48:13.440 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-07-14T12:48:13.456 INFO:teuthology.orchestra.run.smithi005.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-07-14T12:48:13.506 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-07-14T12:48:13.572 INFO:teuthology.orchestra.run.smithi005.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-07-14T12:48:13.620 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-07-14T12:48:13.637 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-07-14T12:48:13.701 INFO:teuthology.orchestra.run.smithi005.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-07-14T12:48:13.707 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-07-14T12:48:13.933 INFO:teuthology.orchestra.run.smithi005.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-07-14T12:48:13.936 INFO:teuthology.orchestra.run.smithi005.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-07-14T12:48:13.937 INFO:teuthology.orchestra.run.smithi005.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-07-14T12:48:13.946 INFO:teuthology.orchestra.run.smithi005.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-07-14T12:48:13.946 INFO:teuthology.orchestra.run.smithi005.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-07-14T12:48:13.948 INFO:teuthology.orchestra.run.smithi005.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-07-14T12:48:13.950 INFO:teuthology.orchestra.run.smithi005.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-07-14T12:48:13.951 INFO:teuthology.orchestra.run.smithi005.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-07-14T12:48:13.952 INFO:teuthology.orchestra.run.smithi005.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-07-14T12:48:13.959 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-07-14T12:48:13.970 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-07-14T12:48:14.005 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-07-14T12:48:14.060 INFO:teuthology.orchestra.run.smithi005.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-07-14T12:48:14.237 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-07-14T12:48:14.324 INFO:teuthology.orchestra.run.smithi005.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-07-14T12:48:14.332 INFO:teuthology.orchestra.run.smithi005.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-07-14T12:48:14.336 INFO:teuthology.orchestra.run.smithi005.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-07-14T12:48:14.341 INFO:teuthology.orchestra.run.smithi005.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-07-14T12:48:14.360 INFO:teuthology.orchestra.run.smithi005.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-07-14T12:48:14.362 INFO:teuthology.orchestra.run.smithi005.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-07-14T12:48:14.364 INFO:teuthology.orchestra.run.smithi005.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-07-14T12:48:14.394 INFO:teuthology.orchestra.run.smithi005.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-07-14T12:48:14.402 INFO:teuthology.orchestra.run.smithi005.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-07-14T12:48:14.403 INFO:teuthology.orchestra.run.smithi005.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-07-14T12:48:14.514 INFO:teuthology.orchestra.run.smithi154.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-07-14T12:48:14.563 INFO:teuthology.orchestra.run.smithi005.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-07-14T12:48:14.610 INFO:teuthology.orchestra.run.smithi005.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-07-14T12:48:14.664 INFO:teuthology.orchestra.run.smithi005.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-07-14T12:48:14.706 INFO:teuthology.orchestra.run.smithi005.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-07-14T12:48:14.785 INFO:teuthology.orchestra.run.smithi005.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-07-14T12:48:14.838 INFO:teuthology.orchestra.run.smithi005.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-07-14T12:48:14.852 INFO:teuthology.orchestra.run.smithi005.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-07-14T12:48:14.874 INFO:teuthology.orchestra.run.smithi005.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-07-14T12:48:14.880 INFO:teuthology.orchestra.run.smithi005.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-07-14T12:48:14.892 INFO:teuthology.orchestra.run.smithi154.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-4757-g3fc0089c-1jammy [3,094 kB] 2023-07-14T12:48:14.910 INFO:teuthology.orchestra.run.smithi005.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-07-14T12:48:14.915 INFO:teuthology.orchestra.run.smithi005.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-07-14T12:48:15.036 INFO:teuthology.orchestra.run.smithi005.stdout:Get:46 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-4757-g3fc0089c-1jammy [3,094 kB] 2023-07-14T12:48:15.037 INFO:teuthology.orchestra.run.smithi154.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-07-14T12:48:15.051 INFO:teuthology.orchestra.run.smithi154.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-07-14T12:48:15.053 INFO:teuthology.orchestra.run.smithi005.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-07-14T12:48:15.053 INFO:teuthology.orchestra.run.smithi154.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-07-14T12:48:15.073 INFO:teuthology.orchestra.run.smithi154.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-07-14T12:48:15.075 INFO:teuthology.orchestra.run.smithi154.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-07-14T12:48:15.079 INFO:teuthology.orchestra.run.smithi154.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-07-14T12:48:15.082 INFO:teuthology.orchestra.run.smithi154.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-07-14T12:48:15.089 INFO:teuthology.orchestra.run.smithi154.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-07-14T12:48:15.091 INFO:teuthology.orchestra.run.smithi154.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-07-14T12:48:15.331 INFO:teuthology.orchestra.run.smithi154.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-07-14T12:48:15.725 INFO:teuthology.orchestra.run.smithi154.stdout:Get:26 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-4757-g3fc0089c-1jammy [657 kB] 2023-07-14T12:48:15.745 INFO:teuthology.orchestra.run.smithi005.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-07-14T12:48:15.746 INFO:teuthology.orchestra.run.smithi005.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-07-14T12:48:15.749 INFO:teuthology.orchestra.run.smithi005.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-07-14T12:48:15.749 INFO:teuthology.orchestra.run.smithi005.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-07-14T12:48:15.750 INFO:teuthology.orchestra.run.smithi005.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-07-14T12:48:15.751 INFO:teuthology.orchestra.run.smithi005.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-07-14T12:48:15.797 INFO:teuthology.orchestra.run.smithi005.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-07-14T12:48:15.811 INFO:teuthology.orchestra.run.smithi005.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-07-14T12:48:15.813 INFO:teuthology.orchestra.run.smithi005.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-07-14T12:48:15.817 INFO:teuthology.orchestra.run.smithi154.stdout:Get:27 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-4757-g3fc0089c-1jammy [345 kB] 2023-07-14T12:48:15.870 INFO:teuthology.orchestra.run.smithi005.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-4757-g3fc0089c-1jammy [657 kB] 2023-07-14T12:48:15.924 INFO:teuthology.orchestra.run.smithi154.stdout:Get:28 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-4757-g3fc0089c-1jammy [23.0 kB] 2023-07-14T12:48:15.926 INFO:teuthology.orchestra.run.smithi154.stdout:Get:29 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-4757-g3fc0089c-1jammy [170 kB] 2023-07-14T12:48:15.945 INFO:teuthology.orchestra.run.smithi005.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-07-14T12:48:15.989 INFO:teuthology.orchestra.run.smithi154.stdout:Get:30 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-4757-g3fc0089c-1jammy [49.0 kB] 2023-07-14T12:48:16.003 INFO:teuthology.orchestra.run.smithi005.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-4757-g3fc0089c-1jammy [345 kB] 2023-07-14T12:48:16.007 INFO:teuthology.orchestra.run.smithi154.stdout:Get:31 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-4757-g3fc0089c-1jammy [318 kB] 2023-07-14T12:48:16.056 INFO:teuthology.orchestra.run.smithi154.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-07-14T12:48:16.061 INFO:teuthology.orchestra.run.smithi005.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-07-14T12:48:16.075 INFO:teuthology.orchestra.run.smithi154.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-07-14T12:48:16.086 INFO:teuthology.orchestra.run.smithi154.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-07-14T12:48:16.094 INFO:teuthology.orchestra.run.smithi154.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-07-14T12:48:16.133 INFO:teuthology.orchestra.run.smithi154.stdout:Get:36 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-4757-g3fc0089c-1jammy [6,060 kB] 2023-07-14T12:48:16.137 INFO:teuthology.orchestra.run.smithi005.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-4757-g3fc0089c-1jammy [23.0 kB] 2023-07-14T12:48:16.138 INFO:teuthology.orchestra.run.smithi005.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-4757-g3fc0089c-1jammy [170 kB] 2023-07-14T12:48:16.144 INFO:teuthology.orchestra.run.smithi005.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-4757-g3fc0089c-1jammy [49.0 kB] 2023-07-14T12:48:16.186 INFO:teuthology.orchestra.run.smithi154.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-07-14T12:48:16.190 INFO:teuthology.orchestra.run.smithi154.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-07-14T12:48:16.195 INFO:teuthology.orchestra.run.smithi154.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-07-14T12:48:16.209 INFO:teuthology.orchestra.run.smithi005.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-4757-g3fc0089c-1jammy [318 kB] 2023-07-14T12:48:16.245 INFO:teuthology.orchestra.run.smithi154.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-07-14T12:48:16.250 INFO:teuthology.orchestra.run.smithi005.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-07-14T12:48:16.270 INFO:teuthology.orchestra.run.smithi154.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-07-14T12:48:16.275 INFO:teuthology.orchestra.run.smithi005.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-07-14T12:48:16.279 INFO:teuthology.orchestra.run.smithi154.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-07-14T12:48:16.294 INFO:teuthology.orchestra.run.smithi005.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-4757-g3fc0089c-1jammy [6,060 kB] 2023-07-14T12:48:16.295 INFO:teuthology.orchestra.run.smithi005.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-07-14T12:48:16.349 INFO:teuthology.orchestra.run.smithi005.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-07-14T12:48:16.363 INFO:teuthology.orchestra.run.smithi005.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-07-14T12:48:16.383 INFO:teuthology.orchestra.run.smithi005.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-07-14T12:48:16.477 INFO:teuthology.orchestra.run.smithi005.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-07-14T12:48:16.499 INFO:teuthology.orchestra.run.smithi005.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-07-14T12:48:16.517 INFO:teuthology.orchestra.run.smithi005.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-07-14T12:48:16.519 INFO:teuthology.orchestra.run.smithi005.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-07-14T12:48:16.656 INFO:teuthology.orchestra.run.smithi005.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-07-14T12:48:16.706 INFO:teuthology.orchestra.run.smithi154.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-07-14T12:48:16.823 INFO:teuthology.orchestra.run.smithi154.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-07-14T12:48:16.931 INFO:teuthology.orchestra.run.smithi154.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-07-14T12:48:16.949 INFO:teuthology.orchestra.run.smithi005.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-07-14T12:48:16.953 INFO:teuthology.orchestra.run.smithi005.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-07-14T12:48:17.015 INFO:teuthology.orchestra.run.smithi154.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-07-14T12:48:17.052 INFO:teuthology.orchestra.run.smithi005.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-07-14T12:48:17.086 INFO:teuthology.orchestra.run.smithi005.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-07-14T12:48:17.086 INFO:teuthology.orchestra.run.smithi005.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-07-14T12:48:17.089 INFO:teuthology.orchestra.run.smithi005.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-07-14T12:48:17.091 INFO:teuthology.orchestra.run.smithi005.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-07-14T12:48:17.103 INFO:teuthology.orchestra.run.smithi005.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-07-14T12:48:17.107 INFO:teuthology.orchestra.run.smithi005.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-07-14T12:48:17.141 INFO:teuthology.orchestra.run.smithi005.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-07-14T12:48:17.186 INFO:teuthology.orchestra.run.smithi154.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-07-14T12:48:17.236 INFO:teuthology.orchestra.run.smithi005.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-07-14T12:48:17.323 INFO:teuthology.orchestra.run.smithi154.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-07-14T12:48:17.345 INFO:teuthology.orchestra.run.smithi005.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-07-14T12:48:17.355 INFO:teuthology.orchestra.run.smithi154.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-07-14T12:48:17.401 INFO:teuthology.orchestra.run.smithi154.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-07-14T12:48:17.424 INFO:teuthology.orchestra.run.smithi154.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-07-14T12:48:17.521 INFO:teuthology.orchestra.run.smithi005.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-07-14T12:48:17.522 INFO:teuthology.orchestra.run.smithi005.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-07-14T12:48:17.553 INFO:teuthology.orchestra.run.smithi154.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-07-14T12:48:17.553 INFO:teuthology.orchestra.run.smithi154.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-07-14T12:48:17.809 INFO:teuthology.orchestra.run.smithi154.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-07-14T12:48:18.205 INFO:teuthology.orchestra.run.smithi005.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-4757-g3fc0089c-1jammy [102 kB] 2023-07-14T12:48:18.249 INFO:teuthology.orchestra.run.smithi005.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-4757-g3fc0089c-1jammy [430 kB] 2023-07-14T12:48:18.440 INFO:teuthology.orchestra.run.smithi005.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-4757-g3fc0089c-1jammy [22.3 MB] 2023-07-14T12:48:18.904 INFO:teuthology.orchestra.run.smithi154.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-07-14T12:48:18.905 INFO:teuthology.orchestra.run.smithi154.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-07-14T12:48:18.907 INFO:teuthology.orchestra.run.smithi154.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-07-14T12:48:18.908 INFO:teuthology.orchestra.run.smithi154.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-07-14T12:48:18.908 INFO:teuthology.orchestra.run.smithi154.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-07-14T12:48:18.909 INFO:teuthology.orchestra.run.smithi154.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-07-14T12:48:18.946 INFO:teuthology.orchestra.run.smithi154.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-07-14T12:48:18.949 INFO:teuthology.orchestra.run.smithi154.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-07-14T12:48:18.949 INFO:teuthology.orchestra.run.smithi154.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-07-14T12:48:19.038 INFO:teuthology.orchestra.run.smithi154.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-07-14T12:48:19.117 INFO:teuthology.orchestra.run.smithi154.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-4757-g3fc0089c-1jammy [102 kB] 2023-07-14T12:48:19.168 INFO:teuthology.orchestra.run.smithi154.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-4757-g3fc0089c-1jammy [430 kB] 2023-07-14T12:48:19.281 INFO:teuthology.orchestra.run.smithi154.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-07-14T12:48:19.400 INFO:teuthology.orchestra.run.smithi154.stdout:Get:68 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-4757-g3fc0089c-1jammy [22.3 MB] 2023-07-14T12:48:19.571 INFO:teuthology.orchestra.run.smithi154.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-07-14T12:48:19.609 INFO:teuthology.orchestra.run.smithi154.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-07-14T12:48:19.677 INFO:teuthology.orchestra.run.smithi154.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-07-14T12:48:19.703 INFO:teuthology.orchestra.run.smithi154.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-07-14T12:48:19.727 INFO:teuthology.orchestra.run.smithi154.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-07-14T12:48:19.764 INFO:teuthology.orchestra.run.smithi154.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-07-14T12:48:19.919 INFO:teuthology.orchestra.run.smithi154.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-07-14T12:48:19.967 INFO:teuthology.orchestra.run.smithi154.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-07-14T12:48:19.998 INFO:teuthology.orchestra.run.smithi154.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-07-14T12:48:20.005 INFO:teuthology.orchestra.run.smithi154.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-07-14T12:48:20.240 INFO:teuthology.orchestra.run.smithi154.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-07-14T12:48:20.810 INFO:teuthology.orchestra.run.smithi154.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-07-14T12:48:20.821 INFO:teuthology.orchestra.run.smithi154.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-07-14T12:48:20.991 INFO:teuthology.orchestra.run.smithi154.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-07-14T12:48:21.056 INFO:teuthology.orchestra.run.smithi154.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-07-14T12:48:21.057 INFO:teuthology.orchestra.run.smithi154.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-07-14T12:48:21.065 INFO:teuthology.orchestra.run.smithi154.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-07-14T12:48:21.069 INFO:teuthology.orchestra.run.smithi154.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-07-14T12:48:21.097 INFO:teuthology.orchestra.run.smithi154.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-07-14T12:48:21.106 INFO:teuthology.orchestra.run.smithi154.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-07-14T12:48:21.184 INFO:teuthology.orchestra.run.smithi154.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-07-14T12:48:21.395 INFO:teuthology.orchestra.run.smithi154.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-07-14T12:48:21.581 INFO:teuthology.orchestra.run.smithi154.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-07-14T12:48:21.901 INFO:teuthology.orchestra.run.smithi154.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-07-14T12:48:21.931 INFO:teuthology.orchestra.run.smithi154.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-07-14T12:48:25.600 INFO:teuthology.orchestra.run.smithi005.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-4757-g3fc0089c-1jammy [6,825 kB] 2023-07-14T12:48:28.233 INFO:teuthology.orchestra.run.smithi005.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-4757-g3fc0089c-1jammy [226 kB] 2023-07-14T12:48:28.233 INFO:teuthology.orchestra.run.smithi154.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-4757-g3fc0089c-1jammy [6,825 kB] 2023-07-14T12:48:28.300 INFO:teuthology.orchestra.run.smithi005.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4757-g3fc0089c-1jammy [114 kB] 2023-07-14T12:48:28.342 INFO:teuthology.orchestra.run.smithi005.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-4757-g3fc0089c-1jammy [1,470 kB] 2023-07-14T12:48:28.950 INFO:teuthology.orchestra.run.smithi005.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-4757-g3fc0089c-1jammy [9,866 kB] 2023-07-14T12:48:31.658 INFO:teuthology.orchestra.run.smithi154.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-4757-g3fc0089c-1jammy [226 kB] 2023-07-14T12:48:31.819 INFO:teuthology.orchestra.run.smithi154.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4757-g3fc0089c-1jammy [114 kB] 2023-07-14T12:48:31.884 INFO:teuthology.orchestra.run.smithi154.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-4757-g3fc0089c-1jammy [1,470 kB] 2023-07-14T12:48:32.918 INFO:teuthology.orchestra.run.smithi154.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-4757-g3fc0089c-1jammy [9,866 kB] 2023-07-14T12:48:34.156 INFO:teuthology.orchestra.run.smithi005.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-4757-g3fc0089c-1jammy [31.6 MB] 2023-07-14T12:48:41.219 INFO:teuthology.orchestra.run.smithi154.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-4757-g3fc0089c-1jammy [31.6 MB] 2023-07-14T12:48:48.532 INFO:teuthology.orchestra.run.smithi154.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-4757-g3fc0089c-1jammy [3,596 B] 2023-07-14T12:48:48.532 INFO:teuthology.orchestra.run.smithi154.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-4757-g3fc0089c-1jammy [811 kB] 2023-07-14T12:48:48.718 INFO:teuthology.orchestra.run.smithi154.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-4757-g3fc0089c-1jammy [2,165 kB] 2023-07-14T12:48:49.189 INFO:teuthology.orchestra.run.smithi154.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-4757-g3fc0089c-1jammy [218 kB] 2023-07-14T12:48:49.238 INFO:teuthology.orchestra.run.smithi154.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-4757-g3fc0089c-1jammy [125 kB] 2023-07-14T12:48:49.278 INFO:teuthology.orchestra.run.smithi154.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-4757-g3fc0089c-1jammy [1,842 kB] 2023-07-14T12:48:49.478 INFO:teuthology.orchestra.run.smithi005.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-4757-g3fc0089c-1jammy [3,596 B] 2023-07-14T12:48:49.479 INFO:teuthology.orchestra.run.smithi005.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-4757-g3fc0089c-1jammy [811 kB] 2023-07-14T12:48:49.766 INFO:teuthology.orchestra.run.smithi005.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-4757-g3fc0089c-1jammy [2,165 kB] 2023-07-14T12:48:49.816 INFO:teuthology.orchestra.run.smithi154.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4757-g3fc0089c-1jammy [8,615 kB] 2023-07-14T12:48:50.452 INFO:teuthology.orchestra.run.smithi005.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-4757-g3fc0089c-1jammy [218 kB] 2023-07-14T12:48:50.507 INFO:teuthology.orchestra.run.smithi005.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-4757-g3fc0089c-1jammy [125 kB] 2023-07-14T12:48:50.557 INFO:teuthology.orchestra.run.smithi005.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-4757-g3fc0089c-1jammy [1,842 kB] 2023-07-14T12:48:52.325 INFO:teuthology.orchestra.run.smithi005.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4757-g3fc0089c-1jammy [8,615 kB] 2023-07-14T12:48:54.514 INFO:teuthology.orchestra.run.smithi154.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-4757-g3fc0089c-1jammy [3,726 B] 2023-07-14T12:48:54.514 INFO:teuthology.orchestra.run.smithi154.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-4757-g3fc0089c-1jammy [47.5 MB] 2023-07-14T12:48:55.085 INFO:teuthology.orchestra.run.smithi005.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-4757-g3fc0089c-1jammy [3,726 B] 2023-07-14T12:48:55.086 INFO:teuthology.orchestra.run.smithi005.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-4757-g3fc0089c-1jammy [47.5 MB] 2023-07-14T12:49:11.079 INFO:teuthology.orchestra.run.smithi005.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-4757-g3fc0089c-1jammy [231 kB] 2023-07-14T12:49:11.121 INFO:teuthology.orchestra.run.smithi005.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-4757-g3fc0089c-1jammy [216 kB] 2023-07-14T12:49:11.180 INFO:teuthology.orchestra.run.smithi005.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-4757-g3fc0089c-1jammy [23.8 kB] 2023-07-14T12:49:11.180 INFO:teuthology.orchestra.run.smithi005.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-4757-g3fc0089c-1jammy [13.2 kB] 2023-07-14T12:49:11.211 INFO:teuthology.orchestra.run.smithi005.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-4757-g3fc0089c-1jammy [28.3 kB] 2023-07-14T12:49:11.237 INFO:teuthology.orchestra.run.smithi005.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-4757-g3fc0089c-1jammy [12.0 MB] 2023-07-14T12:49:14.902 INFO:teuthology.orchestra.run.smithi005.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-4757-g3fc0089c-1jammy [81.9 kB] 2023-07-14T12:49:15.533 INFO:teuthology.orchestra.run.smithi005.stdout:Fetched 183 MB in 1min 2s (2,939 kB/s) 2023-07-14T12:49:15.755 INFO:teuthology.orchestra.run.smithi154.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-4757-g3fc0089c-1jammy [231 kB] 2023-07-14T12:49:15.782 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pyperclip. 2023-07-14T12:49:15.853 INFO:teuthology.orchestra.run.smithi005.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132932 files and directories currently installed.) 2023-07-14T12:49:15.856 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-07-14T12:49:15.897 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-07-14T12:49:15.909 INFO:teuthology.orchestra.run.smithi154.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-4757-g3fc0089c-1jammy [216 kB] 2023-07-14T12:49:15.966 INFO:teuthology.orchestra.run.smithi154.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-4757-g3fc0089c-1jammy [23.8 kB] 2023-07-14T12:49:15.966 INFO:teuthology.orchestra.run.smithi154.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-4757-g3fc0089c-1jammy [13.2 kB] 2023-07-14T12:49:15.967 INFO:teuthology.orchestra.run.smithi154.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-4757-g3fc0089c-1jammy [28.3 kB] 2023-07-14T12:49:15.967 INFO:teuthology.orchestra.run.smithi154.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-4757-g3fc0089c-1jammy [12.0 MB] 2023-07-14T12:49:16.208 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-wcwidth. 2023-07-14T12:49:16.222 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-07-14T12:49:16.258 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-07-14T12:49:16.611 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-cmd2. 2023-07-14T12:49:16.625 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-07-14T12:49:16.669 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-07-14T12:49:16.980 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libfmt8:amd64. 2023-07-14T12:49:16.994 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-07-14T12:49:17.064 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-07-14T12:49:17.384 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-07-14T12:49:17.399 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-07-14T12:49:17.442 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-07-14T12:49:17.829 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-07-14T12:49:17.844 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-07-14T12:49:17.887 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-07-14T12:49:18.240 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-07-14T12:49:18.255 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-07-14T12:49:18.290 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-07-14T12:49:18.744 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-07-14T12:49:18.759 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-14T12:49:18.810 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-14T12:49:19.239 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-07-14T12:49:19.254 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-14T12:49:19.297 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-14T12:49:19.625 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-07-14T12:49:19.640 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-14T12:49:19.675 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-14T12:49:19.771 INFO:teuthology.orchestra.run.smithi154.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-4757-g3fc0089c-1jammy [81.9 kB] 2023-07-14T12:49:20.011 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-07-14T12:49:20.026 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-07-14T12:49:20.070 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-07-14T12:49:20.355 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 183 MB in 1min 7s (2,723 kB/s) 2023-07-14T12:49:20.383 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package librados2. 2023-07-14T12:49:20.398 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../011-librados2_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:20.441 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking librados2 (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:20.498 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyperclip. 2023-07-14T12:49:20.568 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132932 files and directories currently installed.) 2023-07-14T12:49:20.572 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-07-14T12:49:20.613 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-07-14T12:49:20.902 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package librbd1. 2023-07-14T12:49:20.917 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../012-librbd1_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:20.958 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-wcwidth. 2023-07-14T12:49:20.969 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking librbd1 (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:20.971 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-07-14T12:49:21.016 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-07-14T12:49:21.310 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cmd2. 2023-07-14T12:49:21.324 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-07-14T12:49:21.394 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-07-14T12:49:21.438 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libcephfs2. 2023-07-14T12:49:21.454 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:21.505 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libcephfs2 (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:21.696 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libfmt8:amd64. 2023-07-14T12:49:21.710 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-07-14T12:49:21.796 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-07-14T12:49:21.841 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-rados. 2023-07-14T12:49:21.856 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../014-python3-rados_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:21.907 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-rados (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:22.175 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-07-14T12:49:22.189 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-07-14T12:49:22.233 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-07-14T12:49:22.252 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-07-14T12:49:22.267 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-4757-g3fc0089c-1jammy_all.deb ... 2023-07-14T12:49:22.310 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-ceph-argparse (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:22.561 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-07-14T12:49:22.576 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-07-14T12:49:22.587 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-cephfs. 2023-07-14T12:49:22.603 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:22.644 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-07-14T12:49:22.654 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-cephfs (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:22.981 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-07-14T12:49:22.996 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-07-14T12:49:23.039 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-07-14T12:49:23.065 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-ceph-common. 2023-07-14T12:49:23.080 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-4757-g3fc0089c-1jammy_all.deb ... 2023-07-14T12:49:23.132 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-ceph-common (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:23.526 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-prettytable. 2023-07-14T12:49:23.542 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-07-14T12:49:23.593 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-07-14T12:49:23.651 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-07-14T12:49:23.666 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-14T12:49:23.726 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-14T12:49:23.887 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-rbd. 2023-07-14T12:49:23.902 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:23.945 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-rbd (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:24.179 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-07-14T12:49:24.194 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-14T12:49:24.237 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-14T12:49:24.323 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-07-14T12:49:24.338 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-07-14T12:49:24.390 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-07-14T12:49:24.607 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-07-14T12:49:24.622 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-14T12:49:24.665 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-14T12:49:24.801 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package librgw2. 2023-07-14T12:49:24.816 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../021-librgw2_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:24.876 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking librgw2 (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:25.002 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-07-14T12:49:25.016 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-07-14T12:49:25.060 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-07-14T12:49:25.387 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-rgw. 2023-07-14T12:49:25.402 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:25.404 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librados2. 2023-07-14T12:49:25.419 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../011-librados2_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:25.453 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-rgw (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:25.463 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librados2 (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:25.915 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librbd1. 2023-07-14T12:49:25.930 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../012-librbd1_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:25.973 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librbd1 (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:25.998 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package liboath0:amd64. 2023-07-14T12:49:26.013 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-07-14T12:49:26.056 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-07-14T12:49:26.376 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcephfs2. 2023-07-14T12:49:26.390 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:26.434 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libradosstriper1. 2023-07-14T12:49:26.435 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcephfs2 (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:26.449 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:26.501 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libradosstriper1 (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:26.729 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rados. 2023-07-14T12:49:26.743 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../014-python3-rados_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:26.787 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rados (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:27.020 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-common. 2023-07-14T12:49:27.036 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../025-ceph-common_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:27.087 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-common (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:27.131 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-07-14T12:49:27.146 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-4757-g3fc0089c-1jammy_all.deb ... 2023-07-14T12:49:27.189 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-ceph-argparse (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:27.426 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cephfs. 2023-07-14T12:49:27.440 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:27.476 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cephfs (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:27.811 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-ceph-common. 2023-07-14T12:49:27.826 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-4757-g3fc0089c-1jammy_all.deb ... 2023-07-14T12:49:27.869 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-ceph-common (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:28.189 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-prettytable. 2023-07-14T12:49:28.204 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-07-14T12:49:28.226 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-base. 2023-07-14T12:49:28.241 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../026-ceph-base_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:28.247 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-07-14T12:49:28.294 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-base (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:28.533 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rbd. 2023-07-14T12:49:28.548 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:28.592 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rbd (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:28.920 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-07-14T12:49:28.934 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-07-14T12:49:28.969 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-07-14T12:49:29.022 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-07-14T12:49:29.036 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-07-14T12:49:29.080 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-07-14T12:49:29.322 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librgw2. 2023-07-14T12:49:29.337 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../021-librgw2_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:29.372 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librgw2 (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:29.374 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-cheroot. 2023-07-14T12:49:29.389 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-07-14T12:49:29.433 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-07-14T12:49:29.761 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-07-14T12:49:29.776 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-07-14T12:49:29.819 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-07-14T12:49:29.833 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rgw. 2023-07-14T12:49:29.847 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:29.893 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rgw (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:30.122 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-jaraco.text. 2023-07-14T12:49:30.137 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-07-14T12:49:30.172 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-07-14T12:49:30.246 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liboath0:amd64. 2023-07-14T12:49:30.260 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-07-14T12:49:30.337 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-07-14T12:49:30.441 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-07-14T12:49:30.457 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-07-14T12:49:30.500 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-07-14T12:49:30.607 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libradosstriper1. 2023-07-14T12:49:30.621 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:30.665 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libradosstriper1 (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:30.786 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-tempora. 2023-07-14T12:49:30.801 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-07-14T12:49:30.844 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-07-14T12:49:31.127 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-common. 2023-07-14T12:49:31.142 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../025-ceph-common_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:31.172 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-portend. 2023-07-14T12:49:31.185 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-common (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:31.187 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-07-14T12:49:31.230 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-07-14T12:49:31.508 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-07-14T12:49:31.523 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-07-14T12:49:31.574 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-07-14T12:49:31.919 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-cherrypy3. 2023-07-14T12:49:31.934 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-07-14T12:49:31.977 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-07-14T12:49:32.291 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-base. 2023-07-14T12:49:32.306 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../026-ceph-base_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:32.356 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-natsort. 2023-07-14T12:49:32.359 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-base (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:32.371 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-07-14T12:49:32.414 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-07-14T12:49:32.692 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-logutils. 2023-07-14T12:49:32.707 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-07-14T12:49:32.742 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-07-14T12:49:33.045 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-markupsafe. 2023-07-14T12:49:33.060 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-07-14T12:49:33.062 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-07-14T12:49:33.076 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-07-14T12:49:33.112 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-07-14T12:49:33.128 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-07-14T12:49:33.390 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cheroot. 2023-07-14T12:49:33.404 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-07-14T12:49:33.431 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-mako. 2023-07-14T12:49:33.446 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-07-14T12:49:33.448 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-07-14T12:49:33.489 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-07-14T12:49:33.802 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-07-14T12:49:33.817 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-07-14T12:49:33.826 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-simplegeneric. 2023-07-14T12:49:33.841 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-07-14T12:49:33.860 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-07-14T12:49:33.876 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-07-14T12:49:34.170 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-singledispatch. 2023-07-14T12:49:34.186 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-07-14T12:49:34.187 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.text. 2023-07-14T12:49:34.203 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-07-14T12:49:34.228 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-07-14T12:49:34.246 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-07-14T12:49:34.524 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-07-14T12:49:34.539 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-07-14T12:49:34.574 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-07-14T12:49:34.589 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-webob. 2023-07-14T12:49:34.605 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-07-14T12:49:34.656 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-07-14T12:49:34.860 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-tempora. 2023-07-14T12:49:34.875 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-07-14T12:49:34.918 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-07-14T12:49:35.209 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-waitress. 2023-07-14T12:49:35.224 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-07-14T12:49:35.229 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-portend. 2023-07-14T12:49:35.244 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-07-14T12:49:35.278 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-07-14T12:49:35.288 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-07-14T12:49:35.566 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-07-14T12:49:35.581 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-07-14T12:49:35.624 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-07-14T12:49:35.653 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-tempita. 2023-07-14T12:49:35.668 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-07-14T12:49:35.720 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-07-14T12:49:35.885 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cherrypy3. 2023-07-14T12:49:35.900 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-07-14T12:49:35.952 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-07-14T12:49:36.090 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-paste. 2023-07-14T12:49:36.105 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-07-14T12:49:36.181 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-07-14T12:49:36.313 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-natsort. 2023-07-14T12:49:36.328 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-07-14T12:49:36.372 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-07-14T12:49:36.551 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-07-14T12:49:36.567 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-07-14T12:49:36.617 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-07-14T12:49:36.658 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-logutils. 2023-07-14T12:49:36.673 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-07-14T12:49:36.742 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-07-14T12:49:36.970 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pastedeploy. 2023-07-14T12:49:36.986 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-07-14T12:49:37.003 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-markupsafe. 2023-07-14T12:49:37.018 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-07-14T12:49:37.037 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-07-14T12:49:37.061 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-07-14T12:49:37.389 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-mako. 2023-07-14T12:49:37.404 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-07-14T12:49:37.406 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-webtest. 2023-07-14T12:49:37.422 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-07-14T12:49:37.447 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-07-14T12:49:37.473 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-07-14T12:49:37.776 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-simplegeneric. 2023-07-14T12:49:37.791 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-07-14T12:49:37.834 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-07-14T12:49:37.859 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pecan. 2023-07-14T12:49:37.874 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-07-14T12:49:37.926 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-07-14T12:49:38.162 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-singledispatch. 2023-07-14T12:49:38.177 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-07-14T12:49:38.220 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-07-14T12:49:38.356 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-certifi. 2023-07-14T12:49:38.371 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-07-14T12:49:38.422 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-07-14T12:49:38.506 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-webob. 2023-07-14T12:49:38.521 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-07-14T12:49:38.556 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-07-14T12:49:38.733 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-idna. 2023-07-14T12:49:38.749 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-07-14T12:49:38.800 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-idna (3.3-1) ... 2023-07-14T12:49:38.884 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-waitress. 2023-07-14T12:49:38.899 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-07-14T12:49:38.945 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-07-14T12:49:39.186 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-urllib3. 2023-07-14T12:49:39.202 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-07-14T12:49:39.254 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-tempita. 2023-07-14T12:49:39.268 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-07-14T12:49:39.269 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-07-14T12:49:39.329 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-07-14T12:49:39.573 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-paste. 2023-07-14T12:49:39.588 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-07-14T12:49:39.623 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-07-14T12:49:39.656 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-requests. 2023-07-14T12:49:39.671 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-07-14T12:49:39.722 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-07-14T12:49:39.968 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-07-14T12:49:39.983 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-07-14T12:49:40.026 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-07-14T12:49:40.033 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-werkzeug. 2023-07-14T12:49:40.049 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-07-14T12:49:40.092 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-07-14T12:49:40.296 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pastedeploy. 2023-07-14T12:49:40.311 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-07-14T12:49:40.345 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-07-14T12:49:40.395 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-07-14T12:49:40.410 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-4757-g3fc0089c-1jammy_all.deb ... 2023-07-14T12:49:40.453 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:40.691 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-webtest. 2023-07-14T12:49:40.706 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-07-14T12:49:40.749 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-07-14T12:49:40.816 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-07-14T12:49:40.831 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:40.866 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:41.060 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pecan. 2023-07-14T12:49:41.075 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-07-14T12:49:41.118 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-07-14T12:49:41.169 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-openssl. 2023-07-14T12:49:41.184 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-07-14T12:49:41.227 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-07-14T12:49:41.498 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-certifi. 2023-07-14T12:49:41.513 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-07-14T12:49:41.548 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-07-14T12:49:41.613 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mgr. 2023-07-14T12:49:41.629 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:41.671 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mgr (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:41.834 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-idna. 2023-07-14T12:49:41.849 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-07-14T12:49:41.909 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-idna (3.3-1) ... 2023-07-14T12:49:42.066 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mon. 2023-07-14T12:49:42.081 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:42.116 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mon (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:42.220 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-urllib3. 2023-07-14T12:49:42.236 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-07-14T12:49:42.279 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-07-14T12:49:42.615 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-requests. 2023-07-14T12:49:42.630 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-07-14T12:49:42.673 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-07-14T12:49:42.903 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-osd. 2023-07-14T12:49:42.918 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:42.961 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-osd (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:42.985 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-werkzeug. 2023-07-14T12:49:42.999 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-07-14T12:49:43.043 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-07-14T12:49:43.371 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-07-14T12:49:43.386 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-4757-g3fc0089c-1jammy_all.deb ... 2023-07-14T12:49:43.429 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:43.826 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-07-14T12:49:43.840 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:43.876 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:44.170 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-openssl. 2023-07-14T12:49:44.185 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-07-14T12:49:44.215 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph. 2023-07-14T12:49:44.229 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-07-14T12:49:44.229 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../061-ceph_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:44.273 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:44.573 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr. 2023-07-14T12:49:44.588 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:44.592 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-fuse. 2023-07-14T12:49:44.607 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:44.631 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:44.650 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-fuse (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:45.010 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mon. 2023-07-14T12:49:45.024 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:45.029 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mds. 2023-07-14T12:49:45.044 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:45.087 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mds (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:45.093 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mon (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:45.465 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package cephadm. 2023-07-14T12:49:45.480 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../064-cephadm_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:45.523 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking cephadm (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:45.860 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-asyncssh. 2023-07-14T12:49:45.876 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-07-14T12:49:45.909 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-07-14T12:49:46.005 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-osd. 2023-07-14T12:49:46.020 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:46.072 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-osd (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:46.412 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python-babel-localedata. 2023-07-14T12:49:46.428 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-07-14T12:49:46.470 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-07-14T12:49:47.367 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph. 2023-07-14T12:49:47.382 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../061-ceph_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:47.433 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:47.467 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-babel. 2023-07-14T12:49:47.482 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-07-14T12:49:47.534 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-07-14T12:49:47.786 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-fuse. 2023-07-14T12:49:47.801 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:47.853 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-fuse (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:47.870 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-jinja2. 2023-07-14T12:49:47.885 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-07-14T12:49:47.929 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-07-14T12:49:48.273 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-07-14T12:49:48.289 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-4757-g3fc0089c-1jammy_all.deb ... 2023-07-14T12:49:48.314 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mds. 2023-07-14T12:49:48.330 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:48.332 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:48.381 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mds (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:48.669 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-bcrypt. 2023-07-14T12:49:48.684 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-07-14T12:49:48.727 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-07-14T12:49:48.826 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package cephadm. 2023-07-14T12:49:48.840 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../064-cephadm_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:48.892 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking cephadm (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:49.063 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-repoze.lru. 2023-07-14T12:49:49.079 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-07-14T12:49:49.121 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-07-14T12:49:49.229 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-asyncssh. 2023-07-14T12:49:49.244 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-07-14T12:49:49.287 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-07-14T12:49:49.424 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-routes. 2023-07-14T12:49:49.440 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-07-14T12:49:49.482 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-07-14T12:49:49.623 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-babel-localedata. 2023-07-14T12:49:49.639 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-07-14T12:49:49.681 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-07-14T12:49:49.852 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-07-14T12:49:49.868 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-4757-g3fc0089c-1jammy_all.deb ... 2023-07-14T12:49:49.910 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:50.322 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-07-14T12:49:50.337 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-07-14T12:49:50.380 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-07-14T12:49:50.704 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-babel. 2023-07-14T12:49:50.718 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-07-14T12:49:50.762 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-07-14T12:49:50.909 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-joblib. 2023-07-14T12:49:50.925 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-07-14T12:49:50.967 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-07-14T12:49:51.148 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jinja2. 2023-07-14T12:49:51.162 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-07-14T12:49:51.215 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-07-14T12:49:51.304 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-07-14T12:49:51.319 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-07-14T12:49:51.362 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-07-14T12:49:51.618 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-07-14T12:49:51.632 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-4757-g3fc0089c-1jammy_all.deb ... 2023-07-14T12:49:51.665 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-sklearn. 2023-07-14T12:49:51.679 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-07-14T12:49:51.684 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:51.723 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-07-14T12:49:52.055 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-bcrypt. 2023-07-14T12:49:52.069 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-07-14T12:49:52.122 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-07-14T12:49:52.365 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-07-14T12:49:52.380 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-4757-g3fc0089c-1jammy_all.deb ... 2023-07-14T12:49:52.423 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:52.524 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-repoze.lru. 2023-07-14T12:49:52.539 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-07-14T12:49:52.591 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-07-14T12:49:52.944 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-routes. 2023-07-14T12:49:52.958 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-07-14T12:49:53.002 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-07-14T12:49:53.331 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-07-14T12:49:53.345 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-4757-g3fc0089c-1jammy_all.deb ... 2023-07-14T12:49:53.389 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:53.468 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-cachetools. 2023-07-14T12:49:53.484 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-07-14T12:49:53.526 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-07-14T12:49:53.767 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-07-14T12:49:53.781 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-07-14T12:49:53.817 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-07-14T12:49:53.829 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pyasn1. 2023-07-14T12:49:53.845 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-07-14T12:49:53.887 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-07-14T12:49:54.241 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-07-14T12:49:54.257 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-07-14T12:49:54.290 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-07-14T12:49:54.563 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-joblib. 2023-07-14T12:49:54.578 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-07-14T12:49:54.610 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-rsa. 2023-07-14T12:49:54.621 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-07-14T12:49:54.626 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-07-14T12:49:54.660 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-rsa (4.8-1) ... 2023-07-14T12:49:54.992 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-07-14T12:49:55.006 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-07-14T12:49:55.050 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-07-14T12:49:55.082 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-google-auth. 2023-07-14T12:49:55.098 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-07-14T12:49:55.140 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-07-14T12:49:55.328 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-sklearn. 2023-07-14T12:49:55.342 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-07-14T12:49:55.412 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-07-14T12:49:55.485 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-07-14T12:49:55.501 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-07-14T12:49:55.543 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-07-14T12:49:55.813 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-websocket. 2023-07-14T12:49:55.829 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-07-14T12:49:55.871 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-07-14T12:49:56.095 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-07-14T12:49:56.109 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-4757-g3fc0089c-1jammy_all.deb ... 2023-07-14T12:49:56.161 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:56.199 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-kubernetes. 2023-07-14T12:49:56.215 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-07-14T12:49:56.257 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-07-14T12:49:56.946 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-07-14T12:49:56.961 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-4757-g3fc0089c-1jammy_all.deb ... 2023-07-14T12:49:57.005 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:57.115 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cachetools. 2023-07-14T12:49:57.130 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-07-14T12:49:57.173 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-07-14T12:49:57.324 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libonig5:amd64. 2023-07-14T12:49:57.338 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-07-14T12:49:57.382 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-07-14T12:49:57.509 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyasn1. 2023-07-14T12:49:57.525 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-07-14T12:49:57.567 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-07-14T12:49:57.676 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libjq1:amd64. 2023-07-14T12:49:57.692 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-07-14T12:49:57.735 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-07-14T12:49:57.888 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-07-14T12:49:57.903 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-07-14T12:49:57.970 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-07-14T12:49:57.987 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package jq. 2023-07-14T12:49:58.003 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-07-14T12:49:58.046 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-07-14T12:49:58.282 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rsa. 2023-07-14T12:49:58.297 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-07-14T12:49:58.315 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package socat. 2023-07-14T12:49:58.331 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-07-14T12:49:58.340 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rsa (4.8-1) ... 2023-07-14T12:49:58.365 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-07-14T12:49:58.660 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package xmlstarlet. 2023-07-14T12:49:58.676 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-07-14T12:49:58.710 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-07-14T12:49:58.745 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-google-auth. 2023-07-14T12:49:58.760 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-07-14T12:49:58.804 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-07-14T12:49:59.074 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-test. 2023-07-14T12:49:59.089 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../093-ceph-test_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:49:59.115 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-07-14T12:49:59.130 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-07-14T12:49:59.166 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-test (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:49:59.173 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-07-14T12:49:59.518 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-websocket. 2023-07-14T12:49:59.533 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-07-14T12:49:59.576 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-07-14T12:49:59.930 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-kubernetes. 2023-07-14T12:49:59.946 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-07-14T12:49:59.988 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-07-14T12:50:00.693 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-07-14T12:50:00.708 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-4757-g3fc0089c-1jammy_all.deb ... 2023-07-14T12:50:00.751 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:01.003 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ceph-volume. 2023-07-14T12:50:01.018 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-4757-g3fc0089c-1jammy_all.deb ... 2023-07-14T12:50:01.052 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ceph-volume (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:01.063 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libonig5:amd64. 2023-07-14T12:50:01.077 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-07-14T12:50:01.113 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-07-14T12:50:01.466 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libjq1:amd64. 2023-07-14T12:50:01.480 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-07-14T12:50:01.491 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package cephfs-mirror. 2023-07-14T12:50:01.506 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:50:01.524 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-07-14T12:50:01.549 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking cephfs-mirror (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:01.809 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package jq. 2023-07-14T12:50:01.824 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-07-14T12:50:01.868 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-07-14T12:50:01.869 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-colorama. 2023-07-14T12:50:01.885 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-07-14T12:50:01.927 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-07-14T12:50:02.121 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package socat. 2023-07-14T12:50:02.137 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-07-14T12:50:02.171 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-07-14T12:50:02.222 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package cephfs-shell. 2023-07-14T12:50:02.237 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-4757-g3fc0089c-1jammy_all.deb ... 2023-07-14T12:50:02.280 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking cephfs-shell (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:02.475 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package xmlstarlet. 2023-07-14T12:50:02.491 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-07-14T12:50:02.491 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package cephfs-top. 2023-07-14T12:50:02.506 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-4757-g3fc0089c-1jammy_all.deb ... 2023-07-14T12:50:02.524 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-07-14T12:50:02.549 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking cephfs-top (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:02.802 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libcephfs-dev. 2023-07-14T12:50:02.817 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:50:02.853 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-test. 2023-07-14T12:50:02.860 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libcephfs-dev (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:02.868 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../093-ceph-test_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:50:02.911 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-test (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:03.271 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package nvme-cli. 2023-07-14T12:50:03.287 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-07-14T12:50:03.330 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-07-14T12:50:03.676 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-07-14T12:50:03.691 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-07-14T12:50:03.734 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-07-14T12:50:04.179 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-iniconfig. 2023-07-14T12:50:04.195 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-07-14T12:50:04.270 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-07-14T12:50:04.548 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pastescript. 2023-07-14T12:50:04.564 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-07-14T12:50:04.606 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-07-14T12:50:04.682 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-volume. 2023-07-14T12:50:04.698 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-4757-g3fc0089c-1jammy_all.deb ... 2023-07-14T12:50:04.740 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-volume (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:04.868 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pluggy. 2023-07-14T12:50:04.884 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-07-14T12:50:04.918 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-07-14T12:50:05.162 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package cephfs-mirror. 2023-07-14T12:50:05.177 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:50:05.229 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-psutil. 2023-07-14T12:50:05.230 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking cephfs-mirror (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:05.245 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-07-14T12:50:05.329 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-07-14T12:50:05.549 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-colorama. 2023-07-14T12:50:05.565 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-07-14T12:50:05.607 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-07-14T12:50:05.665 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-py. 2023-07-14T12:50:05.681 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-07-14T12:50:05.723 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-py (1.10.0-1) ... 2023-07-14T12:50:05.860 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package cephfs-shell. 2023-07-14T12:50:05.875 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-4757-g3fc0089c-1jammy_all.deb ... 2023-07-14T12:50:05.910 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking cephfs-shell (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:06.043 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pygments. 2023-07-14T12:50:06.059 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-07-14T12:50:06.101 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-07-14T12:50:06.179 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package cephfs-top. 2023-07-14T12:50:06.195 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-4757-g3fc0089c-1jammy_all.deb ... 2023-07-14T12:50:06.237 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking cephfs-top (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:06.524 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcephfs-dev. 2023-07-14T12:50:06.539 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:50:06.582 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcephfs-dev (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:06.589 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pyinotify. 2023-07-14T12:50:06.604 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-07-14T12:50:06.647 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-07-14T12:50:06.950 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-toml. 2023-07-14T12:50:06.951 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package nvme-cli. 2023-07-14T12:50:06.966 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-07-14T12:50:06.967 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-07-14T12:50:07.008 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-07-14T12:50:07.043 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-07-14T12:50:07.269 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-pytest. 2023-07-14T12:50:07.285 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-07-14T12:50:07.344 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-07-14T12:50:07.367 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-07-14T12:50:07.382 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-07-14T12:50:07.417 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-07-14T12:50:07.689 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package python3-simplejson. 2023-07-14T12:50:07.705 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-07-14T12:50:07.747 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-07-14T12:50:07.862 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-iniconfig. 2023-07-14T12:50:07.876 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-07-14T12:50:07.911 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-07-14T12:50:07.991 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-07-14T12:50:08.008 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-07-14T12:50:08.050 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-07-14T12:50:08.148 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pastescript. 2023-07-14T12:50:08.163 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-07-14T12:50:08.197 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-07-14T12:50:08.551 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pluggy. 2023-07-14T12:50:08.566 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-07-14T12:50:08.609 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-07-14T12:50:08.853 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package radosgw. 2023-07-14T12:50:08.868 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../113-radosgw_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:50:08.911 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking radosgw (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:08.941 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-psutil. 2023-07-14T12:50:08.957 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-07-14T12:50:09.004 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-07-14T12:50:09.374 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-py. 2023-07-14T12:50:09.389 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-07-14T12:50:09.431 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-py (1.10.0-1) ... 2023-07-14T12:50:09.631 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package rbd-fuse. 2023-07-14T12:50:09.647 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:50:09.689 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking rbd-fuse (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:09.777 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pygments. 2023-07-14T12:50:09.792 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-07-14T12:50:09.835 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-07-14T12:50:10.000 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-07-14T12:50:10.252 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-07-14T12:50:10.306 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyinotify. 2023-07-14T12:50:10.320 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-07-14T12:50:10.355 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-07-14T12:50:10.378 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-07-14T12:50:10.649 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-07-14T12:50:10.658 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-toml. 2023-07-14T12:50:10.673 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-07-14T12:50:10.717 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-07-14T12:50:11.044 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pytest. 2023-07-14T12:50:11.050 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-07-14T12:50:11.060 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-07-14T12:50:11.102 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-07-14T12:50:11.414 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-simplejson. 2023-07-14T12:50:11.429 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-07-14T12:50:11.472 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-07-14T12:50:11.706 INFO:teuthology.orchestra.run.smithi005.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-07-14T12:50:11.720 INFO:teuthology.orchestra.run.smithi005.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-07-14T12:50:11.767 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-07-14T12:50:11.782 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-07-14T12:50:11.825 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-07-14T12:50:11.843 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up cephadm (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:12.493 INFO:teuthology.orchestra.run.smithi005.stdout:Adding system user cephadm....done 2023-07-14T12:50:12.587 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package radosgw. 2023-07-14T12:50:12.601 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../113-radosgw_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:50:12.645 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking radosgw (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:12.979 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-07-14T12:50:13.248 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package rbd-fuse. 2023-07-14T12:50:13.263 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-4757-g3fc0089c-1jammy_amd64.deb ... 2023-07-14T12:50:13.297 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-07-14T12:50:13.298 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking rbd-fuse (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:13.565 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-07-14T12:50:13.582 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-07-14T12:50:13.708 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-07-14T12:50:13.845 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-07-14T12:50:13.946 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-07-14T12:50:13.967 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-07-14T12:50:14.203 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-07-14T12:50:14.218 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-07-14T12:50:14.352 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-py (1.10.0-1) ... 2023-07-14T12:50:14.614 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-07-14T12:50:14.696 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-07-14T12:50:15.098 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-07-14T12:50:15.227 INFO:teuthology.orchestra.run.smithi154.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-07-14T12:50:15.275 INFO:teuthology.orchestra.run.smithi154.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-07-14T12:50:15.323 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up cephadm (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:15.391 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-07-14T12:50:15.700 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-07-14T12:50:15.893 INFO:teuthology.orchestra.run.smithi154.stdout:Adding system user cephadm....done 2023-07-14T12:50:16.073 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-07-14T12:50:16.110 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-07-14T12:50:16.355 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-07-14T12:50:16.361 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-07-14T12:50:16.623 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-07-14T12:50:16.628 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-07-14T12:50:16.782 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-07-14T12:50:16.921 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-ceph-argparse (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:17.042 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-07-14T12:50:17.310 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-07-14T12:50:17.381 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-07-14T12:50:17.444 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-py (1.10.0-1) ... 2023-07-14T12:50:17.507 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-07-14T12:50:17.738 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-07-14T12:50:17.808 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-07-14T12:50:18.100 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-07-14T12:50:18.106 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-07-14T12:50:18.201 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-07-14T12:50:18.374 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-07-14T12:50:18.561 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-07-14T12:50:18.659 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-07-14T12:50:18.712 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-07-14T12:50:18.952 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-07-14T12:50:19.030 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-07-14T12:50:19.194 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-07-14T12:50:19.314 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-07-14T12:50:19.495 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-07-14T12:50:19.657 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-07-14T12:50:19.755 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-ceph-argparse (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:20.031 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-07-14T12:50:20.157 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-07-14T12:50:20.393 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-07-14T12:50:20.408 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-07-14T12:50:20.659 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-07-14T12:50:20.668 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-07-14T12:50:20.778 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-07-14T12:50:20.785 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-07-14T12:50:20.929 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-07-14T12:50:21.145 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-07-14T12:50:21.255 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-07-14T12:50:21.287 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-07-14T12:50:21.563 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-07-14T12:50:21.698 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-07-14T12:50:21.882 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-07-14T12:50:21.999 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-07-14T12:50:22.183 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-07-14T12:50:22.425 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-07-14T12:50:22.727 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-07-14T12:50:22.868 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-07-14T12:50:23.044 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-07-14T12:50:23.152 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-07-14T12:50:23.253 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-07-14T12:50:23.371 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-07-14T12:50:23.438 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-07-14T12:50:23.697 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-07-14T12:50:23.739 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-07-14T12:50:23.923 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-ceph-common (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:24.124 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-07-14T12:50:24.249 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-idna (3.3-1) ... 2023-07-14T12:50:24.416 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-07-14T12:50:24.609 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-07-14T12:50:24.801 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-07-14T12:50:25.103 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-07-14T12:50:25.712 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-07-14T12:50:25.915 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-14T12:50:26.072 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-07-14T12:50:26.074 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-toml (0.10.2-1) ... 2023-07-14T12:50:26.356 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-07-14T12:50:26.367 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-07-14T12:50:26.468 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-07-14T12:50:26.474 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-ceph-common (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:26.568 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-07-14T12:50:26.775 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-idna (3.3-1) ... 2023-07-14T12:50:26.861 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-07-14T12:50:27.118 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-07-14T12:50:27.146 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-07-14T12:50:27.430 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-14T12:50:27.557 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-07-14T12:50:27.682 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-07-14T12:50:28.034 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-07-14T12:50:28.293 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-07-14T12:50:28.357 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-14T12:50:28.491 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-toml (0.10.2-1) ... 2023-07-14T12:50:28.561 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-07-14T12:50:28.767 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-07-14T12:50:28.837 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-07-14T12:50:28.910 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-07-14T12:50:29.019 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-07-14T12:50:29.130 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-07-14T12:50:29.304 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-07-14T12:50:29.423 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-07-14T12:50:29.549 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-07-14T12:50:29.580 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-07-14T12:50:29.848 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-14T12:50:29.849 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-07-14T12:50:29.966 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-07-14T12:50:29.992 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-07-14T12:50:30.067 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-07-14T12:50:30.327 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-07-14T12:50:30.419 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-07-14T12:50:30.645 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-07-14T12:50:30.686 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-07-14T12:50:30.929 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-07-14T12:50:30.954 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-07-14T12:50:31.213 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-07-14T12:50:31.300 INFO:teuthology.orchestra.run.smithi005.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-07-14T12:50:31.490 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-07-14T12:50:31.574 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-07-14T12:50:31.700 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-07-14T12:50:31.757 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-07-14T12:50:31.883 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-07-14T12:50:32.126 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-07-14T12:50:32.176 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-07-14T12:50:32.302 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-07-14T12:50:32.394 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-portend (3.0.0-1) ... 2023-07-14T12:50:32.586 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-07-14T12:50:32.662 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-14T12:50:32.816 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-07-14T12:50:32.887 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-07-14T12:50:33.156 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-07-14T12:50:33.197 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-07-14T12:50:33.515 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-07-14T12:50:33.564 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-07-14T12:50:33.816 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-07-14T12:50:33.825 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-07-14T12:50:33.951 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-07-14T12:50:33.959 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-rsa (4.8-1) ... 2023-07-14T12:50:34.244 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-07-14T12:50:34.369 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-07-14T12:50:34.503 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-07-14T12:50:34.671 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-portend (3.0.0-1) ... 2023-07-14T12:50:34.812 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-07-14T12:50:34.929 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-14T12:50:35.055 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-07-14T12:50:35.272 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-07-14T12:50:35.391 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-07-14T12:50:35.598 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-07-14T12:50:35.708 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-07-14T12:50:35.984 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-07-14T12:50:35.992 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-07-14T12:50:36.110 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up librados2 (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:36.118 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rsa (4.8-1) ... 2023-07-14T12:50:36.244 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up librgw2 (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:36.386 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-07-14T12:50:36.514 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:36.665 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libcephfs2 (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:36.671 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-07-14T12:50:36.816 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libradosstriper1 (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:36.939 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-07-14T12:50:36.967 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-07-14T12:50:37.277 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up librbd1 (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:37.332 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-07-14T12:50:37.437 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mgr-modules-core (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:37.562 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-fuse (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:37.633 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-07-14T12:50:37.783 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-14T12:50:37.783 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-14T12:50:37.993 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-07-14T12:50:38.094 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librados2 (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:38.212 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librgw2 (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:38.424 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:38.498 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libcephfs-dev (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:38.566 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcephfs2 (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:38.648 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-rados (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:38.667 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libradosstriper1 (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:38.794 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-07-14T12:50:38.799 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up cephfs-top (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:38.950 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-07-14T12:50:39.129 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librbd1 (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:39.255 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-modules-core (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:39.380 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-fuse (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:39.582 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-14T12:50:39.583 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-14T12:50:40.265 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcephfs-dev (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:40.288 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-rbd (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:40.397 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rados (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:40.464 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up rbd-fuse (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:40.526 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up cephfs-top (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:40.615 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-rgw (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:40.652 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-07-14T12:50:40.766 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up python3-cephfs (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:40.917 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up cephfs-shell (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:41.043 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-common (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:41.664 INFO:teuthology.orchestra.run.smithi005.stdout:Adding group ceph....done 2023-07-14T12:50:41.932 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rbd (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:42.050 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up rbd-fuse (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:42.082 INFO:teuthology.orchestra.run.smithi005.stdout:Adding system user ceph....done 2023-07-14T12:50:42.175 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rgw (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:42.243 INFO:teuthology.orchestra.run.smithi005.stdout:Setting system user ceph properties....done 2023-07-14T12:50:42.260 INFO:teuthology.orchestra.run.smithi005.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-07-14T12:50:42.325 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cephfs (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:42.407 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-07-14T12:50:42.453 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up cephfs-shell (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:42.579 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-common (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:42.799 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-07-14T12:50:43.149 INFO:teuthology.orchestra.run.smithi154.stdout:Adding group ceph....done 2023-07-14T12:50:43.461 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up cephfs-mirror (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:43.483 INFO:teuthology.orchestra.run.smithi154.stdout:Adding system user ceph....done 2023-07-14T12:50:43.696 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-14T12:50:43.696 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-14T12:50:43.697 INFO:teuthology.orchestra.run.smithi154.stdout:Setting system user ceph properties....done 2023-07-14T12:50:43.715 INFO:teuthology.orchestra.run.smithi154.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-07-14T12:50:43.852 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-07-14T12:50:44.248 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-07-14T12:50:44.321 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-test (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:44.472 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up radosgw (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:44.776 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-14T12:50:44.777 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-14T12:50:44.980 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up cephfs-mirror (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:45.188 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-14T12:50:45.188 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-14T12:50:45.799 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-base (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:45.831 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-test (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:45.941 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up radosgw (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:46.130 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-07-14T12:50:46.179 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-14T12:50:46.179 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-14T12:50:46.776 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mds (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:47.006 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-14T12:50:47.006 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-14T12:50:47.101 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-base (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:47.456 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-07-14T12:50:47.661 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mgr (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:48.128 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mds (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:48.187 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-14T12:50:48.187 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-14T12:50:48.350 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-14T12:50:48.351 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-14T12:50:48.846 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-osd (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:48.988 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:49.200 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-14T12:50:49.201 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-14T12:50:49.201 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-14T12:50:49.201 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-14T12:50:49.856 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-osd (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:49.857 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:49.982 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:50.125 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mon (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:50.225 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-14T12:50:50.226 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-14T12:50:50.326 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-14T12:50:50.326 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-14T12:50:50.950 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:50.960 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mgr-cephadm (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:51.060 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:51.094 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:51.220 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-mgr-dashboard (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:51.236 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mon (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:51.379 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ceph-volume (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:51.539 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-07-14T12:50:51.555 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-14T12:50:51.556 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-14T12:50:52.211 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-cephadm (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:52.347 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-07-14T12:50:52.354 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:52.480 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-dashboard (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:52.656 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-volume (18.0.0-4757-g3fc0089c-1jammy) ... 2023-07-14T12:50:52.783 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-07-14T12:50:52.842 INFO:teuthology.orchestra.run.smithi005.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-14T12:50:52.846 DEBUG:teuthology.orchestra.run.smithi005:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-07-14T12:50:52.925 INFO:teuthology.orchestra.run.smithi005.stdout:Reading package lists... 2023-07-14T12:50:53.085 INFO:teuthology.orchestra.run.smithi005.stdout:Building dependency tree... 2023-07-14T12:50:53.086 INFO:teuthology.orchestra.run.smithi005.stdout:Reading state information... 2023-07-14T12:50:53.233 INFO:teuthology.orchestra.run.smithi005.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-07-14T12:50:53.234 INFO:teuthology.orchestra.run.smithi005.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-07-14T12:50:53.234 INFO:teuthology.orchestra.run.smithi005.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-07-14T12:50:53.234 INFO:teuthology.orchestra.run.smithi005.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-07-14T12:50:53.234 INFO:teuthology.orchestra.run.smithi005.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-07-14T12:50:53.234 INFO:teuthology.orchestra.run.smithi005.stdout:The following packages were automatically installed and are no longer required: 2023-07-14T12:50:53.234 INFO:teuthology.orchestra.run.smithi005.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-07-14T12:50:53.234 INFO:teuthology.orchestra.run.smithi005.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-07-14T12:50:53.234 INFO:teuthology.orchestra.run.smithi005.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-07-14T12:50:53.235 INFO:teuthology.orchestra.run.smithi005.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-07-14T12:50:53.235 INFO:teuthology.orchestra.run.smithi005.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-07-14T12:50:53.236 INFO:teuthology.orchestra.run.smithi005.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-14T12:50:53.236 INFO:teuthology.orchestra.run.smithi005.stdout:The following additional packages will be installed: 2023-07-14T12:50:53.236 INFO:teuthology.orchestra.run.smithi005.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-07-14T12:50:53.236 INFO:teuthology.orchestra.run.smithi005.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-07-14T12:50:53.236 INFO:teuthology.orchestra.run.smithi005.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-07-14T12:50:53.236 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-07-14T12:50:53.237 INFO:teuthology.orchestra.run.smithi005.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-14T12:50:53.237 INFO:teuthology.orchestra.run.smithi005.stdout:Suggested packages: 2023-07-14T12:50:53.237 INFO:teuthology.orchestra.run.smithi005.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-07-14T12:50:53.237 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-07-14T12:50:53.237 INFO:teuthology.orchestra.run.smithi005.stdout: libengine-pkcs11-openssl 2023-07-14T12:50:53.282 INFO:teuthology.orchestra.run.smithi005.stdout:The following NEW packages will be installed: 2023-07-14T12:50:53.283 INFO:teuthology.orchestra.run.smithi005.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-07-14T12:50:53.284 INFO:teuthology.orchestra.run.smithi005.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-07-14T12:50:53.284 INFO:teuthology.orchestra.run.smithi005.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-07-14T12:50:53.284 INFO:teuthology.orchestra.run.smithi005.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-07-14T12:50:53.284 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-07-14T12:50:53.284 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-07-14T12:50:53.284 INFO:teuthology.orchestra.run.smithi005.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-14T12:50:53.285 INFO:teuthology.orchestra.run.smithi005.stdout:The following packages will be upgraded: 2023-07-14T12:50:53.285 INFO:teuthology.orchestra.run.smithi005.stdout: libssl3 2023-07-14T12:50:53.569 INFO:teuthology.orchestra.run.smithi005.stdout:1 upgraded, 39 newly installed, 0 to remove and 209 not upgraded. 2023-07-14T12:50:53.570 INFO:teuthology.orchestra.run.smithi005.stdout:Need to get 54.6 MB of archives. 2023-07-14T12:50:53.570 INFO:teuthology.orchestra.run.smithi005.stdout:After this operation, 202 MB of additional disk space will be used. 2023-07-14T12:50:53.570 INFO:teuthology.orchestra.run.smithi005.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-07-14T12:50:53.590 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-07-14T12:50:54.099 INFO:teuthology.orchestra.run.smithi154.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-14T12:50:54.103 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-07-14T12:50:54.179 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2023-07-14T12:50:54.264 INFO:teuthology.orchestra.run.smithi005.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-07-14T12:50:54.343 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2023-07-14T12:50:54.343 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2023-07-14T12:50:54.488 INFO:teuthology.orchestra.run.smithi154.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-07-14T12:50:54.489 INFO:teuthology.orchestra.run.smithi154.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-07-14T12:50:54.489 INFO:teuthology.orchestra.run.smithi154.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-07-14T12:50:54.489 INFO:teuthology.orchestra.run.smithi154.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-07-14T12:50:54.489 INFO:teuthology.orchestra.run.smithi154.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-07-14T12:50:54.489 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2023-07-14T12:50:54.489 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-07-14T12:50:54.489 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-07-14T12:50:54.490 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-07-14T12:50:54.490 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-07-14T12:50:54.491 INFO:teuthology.orchestra.run.smithi154.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-07-14T12:50:54.491 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-14T12:50:54.491 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2023-07-14T12:50:54.491 INFO:teuthology.orchestra.run.smithi154.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-07-14T12:50:54.491 INFO:teuthology.orchestra.run.smithi154.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-07-14T12:50:54.491 INFO:teuthology.orchestra.run.smithi154.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-07-14T12:50:54.491 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-07-14T12:50:54.492 INFO:teuthology.orchestra.run.smithi154.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-14T12:50:54.492 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2023-07-14T12:50:54.492 INFO:teuthology.orchestra.run.smithi154.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-07-14T12:50:54.492 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-07-14T12:50:54.492 INFO:teuthology.orchestra.run.smithi154.stdout: libengine-pkcs11-openssl 2023-07-14T12:50:54.537 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2023-07-14T12:50:54.538 INFO:teuthology.orchestra.run.smithi154.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-07-14T12:50:54.538 INFO:teuthology.orchestra.run.smithi154.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-07-14T12:50:54.538 INFO:teuthology.orchestra.run.smithi154.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-07-14T12:50:54.538 INFO:teuthology.orchestra.run.smithi154.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-07-14T12:50:54.538 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-07-14T12:50:54.539 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-07-14T12:50:54.539 INFO:teuthology.orchestra.run.smithi154.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-14T12:50:54.540 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages will be upgraded: 2023-07-14T12:50:54.540 INFO:teuthology.orchestra.run.smithi154.stdout: libssl3 2023-07-14T12:50:54.739 INFO:teuthology.orchestra.run.smithi005.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-07-14T12:50:54.787 INFO:teuthology.orchestra.run.smithi154.stdout:1 upgraded, 39 newly installed, 0 to remove and 209 not upgraded. 2023-07-14T12:50:54.787 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 54.6 MB of archives. 2023-07-14T12:50:54.787 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 202 MB of additional disk space will be used. 2023-07-14T12:50:54.788 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-07-14T12:50:54.799 INFO:teuthology.orchestra.run.smithi005.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-07-14T12:50:54.800 INFO:teuthology.orchestra.run.smithi005.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-07-14T12:50:54.806 INFO:teuthology.orchestra.run.smithi005.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-07-14T12:50:54.808 INFO:teuthology.orchestra.run.smithi005.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-07-14T12:50:54.809 INFO:teuthology.orchestra.run.smithi005.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-07-14T12:50:54.814 INFO:teuthology.orchestra.run.smithi005.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-07-14T12:50:54.821 INFO:teuthology.orchestra.run.smithi005.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-07-14T12:50:54.822 INFO:teuthology.orchestra.run.smithi005.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-07-14T12:50:55.041 INFO:teuthology.orchestra.run.smithi005.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-07-14T12:50:55.381 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-07-14T12:50:55.424 INFO:teuthology.orchestra.run.smithi005.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-07-14T12:50:55.736 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-07-14T12:50:55.769 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-07-14T12:50:55.772 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-07-14T12:50:55.780 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-07-14T12:50:55.784 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-07-14T12:50:55.785 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-07-14T12:50:55.790 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-07-14T12:50:55.792 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-07-14T12:50:55.793 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-07-14T12:50:56.012 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-07-14T12:50:56.482 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-07-14T12:50:56.960 INFO:teuthology.orchestra.run.smithi005.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-07-14T12:50:56.962 INFO:teuthology.orchestra.run.smithi005.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-07-14T12:50:56.962 INFO:teuthology.orchestra.run.smithi005.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-07-14T12:50:56.965 INFO:teuthology.orchestra.run.smithi005.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-07-14T12:50:56.966 INFO:teuthology.orchestra.run.smithi005.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-07-14T12:50:56.971 INFO:teuthology.orchestra.run.smithi005.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.8-0ubuntu0.22.04.1 [141 kB] 2023-07-14T12:50:56.972 INFO:teuthology.orchestra.run.smithi005.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-07-14T12:50:56.994 INFO:teuthology.orchestra.run.smithi005.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-07-14T12:50:56.994 INFO:teuthology.orchestra.run.smithi005.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-07-14T12:50:57.284 INFO:teuthology.orchestra.run.smithi005.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-07-14T12:50:57.374 INFO:teuthology.orchestra.run.smithi005.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-07-14T12:50:57.864 INFO:teuthology.orchestra.run.smithi154.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-07-14T12:50:57.866 INFO:teuthology.orchestra.run.smithi154.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-07-14T12:50:57.866 INFO:teuthology.orchestra.run.smithi154.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-07-14T12:50:57.869 INFO:teuthology.orchestra.run.smithi154.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-07-14T12:50:57.869 INFO:teuthology.orchestra.run.smithi154.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-07-14T12:50:57.874 INFO:teuthology.orchestra.run.smithi154.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.8-0ubuntu0.22.04.1 [141 kB] 2023-07-14T12:50:57.876 INFO:teuthology.orchestra.run.smithi154.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-07-14T12:50:57.924 INFO:teuthology.orchestra.run.smithi154.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-07-14T12:50:57.924 INFO:teuthology.orchestra.run.smithi154.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-07-14T12:50:57.933 INFO:teuthology.orchestra.run.smithi005.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-07-14T12:50:58.112 INFO:teuthology.orchestra.run.smithi005.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-07-14T12:50:58.121 INFO:teuthology.orchestra.run.smithi005.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-07-14T12:50:58.123 INFO:teuthology.orchestra.run.smithi005.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-07-14T12:50:58.124 INFO:teuthology.orchestra.run.smithi005.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-07-14T12:50:58.125 INFO:teuthology.orchestra.run.smithi005.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.8-0ubuntu0.22.04.1 [1,221 kB] 2023-07-14T12:50:58.162 INFO:teuthology.orchestra.run.smithi005.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-07-14T12:50:58.168 INFO:teuthology.orchestra.run.smithi005.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.8-0ubuntu0.22.04.1 [16.1 MB] 2023-07-14T12:50:58.192 INFO:teuthology.orchestra.run.smithi154.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-07-14T12:50:58.281 INFO:teuthology.orchestra.run.smithi154.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-07-14T12:50:58.653 INFO:teuthology.orchestra.run.smithi005.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-07-14T12:50:58.810 INFO:teuthology.orchestra.run.smithi154.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-07-14T12:50:58.828 INFO:teuthology.orchestra.run.smithi005.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-07-14T12:50:58.916 INFO:teuthology.orchestra.run.smithi005.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-07-14T12:50:58.916 INFO:teuthology.orchestra.run.smithi005.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-07-14T12:50:58.951 INFO:teuthology.orchestra.run.smithi154.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-07-14T12:50:58.967 INFO:teuthology.orchestra.run.smithi154.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-07-14T12:50:58.969 INFO:teuthology.orchestra.run.smithi154.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-07-14T12:50:58.970 INFO:teuthology.orchestra.run.smithi154.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-07-14T12:50:58.971 INFO:teuthology.orchestra.run.smithi154.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.8-0ubuntu0.22.04.1 [1,221 kB] 2023-07-14T12:50:59.004 INFO:teuthology.orchestra.run.smithi005.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-07-14T12:50:59.007 INFO:teuthology.orchestra.run.smithi154.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-07-14T12:50:59.011 INFO:teuthology.orchestra.run.smithi154.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.8-0ubuntu0.22.04.1 [16.1 MB] 2023-07-14T12:50:59.013 INFO:teuthology.orchestra.run.smithi005.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-07-14T12:50:59.494 INFO:teuthology.orchestra.run.smithi154.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-07-14T12:50:59.554 INFO:teuthology.orchestra.run.smithi005.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-07-14T12:50:59.556 INFO:teuthology.orchestra.run.smithi005.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-07-14T12:50:59.670 INFO:teuthology.orchestra.run.smithi154.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-07-14T12:50:59.770 INFO:teuthology.orchestra.run.smithi154.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-07-14T12:50:59.770 INFO:teuthology.orchestra.run.smithi154.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-07-14T12:50:59.857 INFO:teuthology.orchestra.run.smithi154.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-07-14T12:50:59.869 INFO:teuthology.orchestra.run.smithi154.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-07-14T12:50:59.972 INFO:teuthology.orchestra.run.smithi005.stdout:Preconfiguring packages ... 2023-07-14T12:51:00.152 INFO:teuthology.orchestra.run.smithi005.stdout:Fetched 54.6 MB in 6s (8,717 kB/s) 2023-07-14T12:51:00.305 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package flex. 2023-07-14T12:51:00.382 INFO:teuthology.orchestra.run.smithi005.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139906 files and directories currently installed.) 2023-07-14T12:51:00.385 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-07-14T12:51:00.411 INFO:teuthology.orchestra.run.smithi154.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-07-14T12:51:00.414 INFO:teuthology.orchestra.run.smithi154.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-07-14T12:51:00.431 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking flex (2.6.4-8build2) ... 2023-07-14T12:51:00.799 INFO:teuthology.orchestra.run.smithi154.stdout:Preconfiguring packages ... 2023-07-14T12:51:00.967 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-07-14T12:51:00.998 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 54.6 MB in 6s (9,304 kB/s) 2023-07-14T12:51:01.120 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-07-14T12:51:01.441 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package flex. 2023-07-14T12:51:01.515 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139906 files and directories currently installed.) 2023-07-14T12:51:01.519 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-07-14T12:51:01.552 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-14T12:51:01.564 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking flex (2.6.4-8build2) ... 2023-07-14T12:51:02.092 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-07-14T12:51:02.170 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package bison. 2023-07-14T12:51:02.249 INFO:teuthology.orchestra.run.smithi005.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139979 files and directories currently installed.) 2023-07-14T12:51:02.253 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-07-14T12:51:02.279 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-07-14T12:51:02.298 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-07-14T12:51:02.643 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-14T12:51:02.782 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-07-14T12:51:02.797 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-07-14T12:51:02.849 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-07-14T12:51:03.196 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package bison. 2023-07-14T12:51:03.202 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package dump. 2023-07-14T12:51:03.217 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-07-14T12:51:03.269 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139979 files and directories currently installed.) 2023-07-14T12:51:03.272 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-07-14T12:51:03.293 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking dump (0.4b47-3) ... 2023-07-14T12:51:03.315 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-07-14T12:51:03.672 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package indent. 2023-07-14T12:51:03.689 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-07-14T12:51:03.739 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking indent (2.2.12-1build2) ... 2023-07-14T12:51:03.774 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-07-14T12:51:03.788 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-07-14T12:51:03.832 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-07-14T12:51:04.025 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-07-14T12:51:04.041 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-07-14T12:51:04.091 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-07-14T12:51:04.194 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package dump. 2023-07-14T12:51:04.207 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-07-14T12:51:04.252 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking dump (0.4b47-3) ... 2023-07-14T12:51:04.462 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-07-14T12:51:04.478 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-07-14T12:51:04.520 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-07-14T12:51:04.547 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package indent. 2023-07-14T12:51:04.561 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-07-14T12:51:04.597 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking indent (2.2.12-1build2) ... 2023-07-14T12:51:04.823 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-07-14T12:51:04.839 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-07-14T12:51:04.883 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-07-14T12:51:04.897 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-07-14T12:51:04.906 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-07-14T12:51:04.941 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-07-14T12:51:05.253 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-07-14T12:51:05.267 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-07-14T12:51:05.311 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-07-14T12:51:05.351 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libfl2:amd64. 2023-07-14T12:51:05.368 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-07-14T12:51:05.417 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-07-14T12:51:05.599 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-07-14T12:51:05.614 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-07-14T12:51:05.658 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-07-14T12:51:05.720 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-07-14T12:51:05.736 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-07-14T12:51:05.779 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-07-14T12:51:06.019 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libfl2:amd64. 2023-07-14T12:51:06.035 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-07-14T12:51:06.048 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libjson-perl. 2023-07-14T12:51:06.064 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-07-14T12:51:06.077 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-07-14T12:51:06.114 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-07-14T12:51:06.313 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-07-14T12:51:06.329 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-07-14T12:51:06.405 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-07-14T12:51:06.509 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libllvm14:amd64. 2023-07-14T12:51:06.526 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-07-14T12:51:06.576 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-07-14T12:51:06.683 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libjson-perl. 2023-07-14T12:51:06.699 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-07-14T12:51:06.741 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-07-14T12:51:07.052 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libllvm14:amd64. 2023-07-14T12:51:07.068 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-07-14T12:51:07.111 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-07-14T12:51:08.087 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-07-14T12:51:08.103 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-07-14T12:51:08.153 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-07-14T12:51:08.389 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libmbim-proxy. 2023-07-14T12:51:08.406 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-07-14T12:51:08.439 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-07-14T12:51:08.513 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-07-14T12:51:08.529 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-07-14T12:51:08.572 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-07-14T12:51:08.843 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-07-14T12:51:08.849 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libmbim-proxy. 2023-07-14T12:51:08.860 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-07-14T12:51:08.865 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-07-14T12:51:08.899 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-07-14T12:51:08.901 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-07-14T12:51:09.218 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-07-14T12:51:09.234 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-07-14T12:51:09.246 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libndp0:amd64. 2023-07-14T12:51:09.262 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-07-14T12:51:09.277 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-07-14T12:51:09.304 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-07-14T12:51:09.598 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libnm0:amd64. 2023-07-14T12:51:09.615 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-07-14T12:51:09.646 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libndp0:amd64. 2023-07-14T12:51:09.648 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-07-14T12:51:09.662 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-07-14T12:51:09.705 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-07-14T12:51:09.999 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libnm0:amd64. 2023-07-14T12:51:10.014 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-07-14T12:51:10.026 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libpq5:amd64. 2023-07-14T12:51:10.042 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../16-libpq5_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-14T12:51:10.049 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-07-14T12:51:10.084 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-07-14T12:51:10.418 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libpq5:amd64. 2023-07-14T12:51:10.434 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../16-libpq5_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-14T12:51:10.445 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-07-14T12:51:10.462 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-07-14T12:51:10.477 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-07-14T12:51:10.504 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-07-14T12:51:10.815 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libqmi-proxy. 2023-07-14T12:51:10.831 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-07-14T12:51:10.863 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-07-14T12:51:10.864 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-07-14T12:51:10.879 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-07-14T12:51:10.921 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-07-14T12:51:11.092 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-07-14T12:51:11.108 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-07-14T12:51:11.150 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-14T12:51:11.199 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqmi-proxy. 2023-07-14T12:51:11.214 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-07-14T12:51:11.248 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-07-14T12:51:11.654 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-07-14T12:51:11.660 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-07-14T12:51:11.670 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-07-14T12:51:11.675 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-07-14T12:51:11.712 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-07-14T12:51:11.719 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-14T12:51:12.031 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package modemmanager. 2023-07-14T12:51:12.048 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-07-14T12:51:12.091 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-07-14T12:51:12.230 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-07-14T12:51:12.245 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-07-14T12:51:12.289 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-07-14T12:51:12.592 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package modemmanager. 2023-07-14T12:51:12.607 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-07-14T12:51:12.675 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-07-14T12:51:12.813 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package network-manager. 2023-07-14T12:51:12.829 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-07-14T12:51:12.905 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-07-14T12:51:13.323 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package network-manager. 2023-07-14T12:51:13.338 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-07-14T12:51:13.389 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-07-14T12:51:13.445 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package ppp. 2023-07-14T12:51:13.461 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-07-14T12:51:13.823 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-07-14T12:51:14.013 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ppp. 2023-07-14T12:51:14.029 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-07-14T12:51:14.176 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package pptp-linux. 2023-07-14T12:51:14.191 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-07-14T12:51:14.226 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-07-14T12:51:14.384 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-07-14T12:51:14.436 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package network-manager-pptp. 2023-07-14T12:51:14.451 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-07-14T12:51:14.495 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-07-14T12:51:14.735 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package pptp-linux. 2023-07-14T12:51:14.749 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-07-14T12:51:14.793 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-07-14T12:51:14.839 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package postgresql-client-common. 2023-07-14T12:51:14.855 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-07-14T12:51:14.914 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking postgresql-client-common (238) ... 2023-07-14T12:51:15.045 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package network-manager-pptp. 2023-07-14T12:51:15.060 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-07-14T12:51:15.103 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-07-14T12:51:15.218 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package postgresql-client-14. 2023-07-14T12:51:15.234 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../27-postgresql-client-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-14T12:51:15.276 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-14T12:51:15.406 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql-client-common. 2023-07-14T12:51:15.421 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-07-14T12:51:15.456 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql-client-common (238) ... 2023-07-14T12:51:15.823 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package postgresql-common. 2023-07-14T12:51:15.839 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-07-14T12:51:15.869 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql-client-14. 2023-07-14T12:51:15.884 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../27-postgresql-client-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-14T12:51:15.900 INFO:teuthology.orchestra.run.smithi005.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-07-14T12:51:15.927 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-14T12:51:15.947 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking postgresql-common (238) ... 2023-07-14T12:51:16.372 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package postgresql-14. 2023-07-14T12:51:16.388 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../29-postgresql-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-14T12:51:16.425 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-14T12:51:16.524 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql-common. 2023-07-14T12:51:16.538 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-07-14T12:51:16.658 INFO:teuthology.orchestra.run.smithi154.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-07-14T12:51:16.691 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql-common (238) ... 2023-07-14T12:51:17.149 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql-14. 2023-07-14T12:51:17.163 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../29-postgresql-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-14T12:51:17.201 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-14T12:51:17.725 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package postgresql. 2023-07-14T12:51:17.740 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-07-14T12:51:17.783 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking postgresql (14+238) ... 2023-07-14T12:51:18.019 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package postgresql-client. 2023-07-14T12:51:18.034 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-07-14T12:51:18.069 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking postgresql-client (14+238) ... 2023-07-14T12:51:18.294 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql. 2023-07-14T12:51:18.295 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package postgresql-contrib. 2023-07-14T12:51:18.309 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-07-14T12:51:18.311 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-07-14T12:51:18.346 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking postgresql-contrib (14+238) ... 2023-07-14T12:51:18.352 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql (14+238) ... 2023-07-14T12:51:18.621 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql-client. 2023-07-14T12:51:18.635 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-07-14T12:51:18.665 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package tcl8.6. 2023-07-14T12:51:18.679 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql-client (14+238) ... 2023-07-14T12:51:18.681 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-07-14T12:51:18.723 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-07-14T12:51:18.915 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql-contrib. 2023-07-14T12:51:18.929 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-07-14T12:51:18.965 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql-contrib (14+238) ... 2023-07-14T12:51:19.301 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package tcl8.6. 2023-07-14T12:51:19.316 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-07-14T12:51:19.351 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package tcl. 2023-07-14T12:51:19.359 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-07-14T12:51:19.368 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-07-14T12:51:19.414 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-07-14T12:51:19.662 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package tcl. 2023-07-14T12:51:19.678 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-07-14T12:51:19.712 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package wpasupplicant. 2023-07-14T12:51:19.725 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-07-14T12:51:19.729 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-07-14T12:51:19.762 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-07-14T12:51:20.098 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package wpasupplicant. 2023-07-14T12:51:20.114 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-07-14T12:51:20.116 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-07-14T12:51:20.132 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-07-14T12:51:20.156 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-07-14T12:51:20.166 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-07-14T12:51:20.503 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-07-14T12:51:20.519 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-07-14T12:51:20.561 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-07-14T12:51:20.561 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package usb-modeswitch. 2023-07-14T12:51:20.577 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-07-14T12:51:20.628 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-07-14T12:51:20.921 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up postgresql-client-common (238) ... 2023-07-14T12:51:20.939 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package usb-modeswitch. 2023-07-14T12:51:20.955 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-07-14T12:51:21.006 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-07-14T12:51:21.092 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up flex (2.6.4-8build2) ... 2023-07-14T12:51:21.209 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-07-14T12:51:21.315 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql-client-common (238) ... 2023-07-14T12:51:21.369 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-07-14T12:51:21.495 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-07-14T12:51:21.503 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up flex (2.6.4-8build2) ... 2023-07-14T12:51:21.621 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-07-14T12:51:21.629 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-07-14T12:51:21.747 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-14T12:51:21.797 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-07-14T12:51:21.923 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-07-14T12:51:22.049 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-07-14T12:51:22.184 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-14T12:51:22.787 INFO:teuthology.orchestra.run.smithi005.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-07-14T12:51:22.886 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-07-14T12:51:23.206 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-07-14T12:51:23.272 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-14T12:51:23.272 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-14T12:51:23.306 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-07-14T12:51:23.684 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-14T12:51:23.684 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-14T12:51:24.248 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-07-14T12:51:24.384 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-07-14T12:51:24.390 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-14T12:51:24.499 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-07-14T12:51:24.510 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-14T12:51:24.601 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-07-14T12:51:24.636 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-07-14T12:51:24.727 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-07-14T12:51:24.754 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-07-14T12:51:24.853 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-07-14T12:51:24.888 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-07-14T12:51:25.006 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-07-14T12:51:25.079 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-07-14T12:51:25.132 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-07-14T12:51:25.709 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-07-14T12:51:25.835 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up dump (0.4b47-3) ... 2023-07-14T12:51:25.837 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-07-14T12:51:25.931 INFO:teuthology.orchestra.run.smithi005.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-07-14T12:51:25.963 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up dump (0.4b47-3) ... 2023-07-14T12:51:25.987 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-07-14T12:51:26.058 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-07-14T12:51:26.113 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-07-14T12:51:26.123 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-07-14T12:51:26.239 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up tcl (8.6.11+1build2) ... 2023-07-14T12:51:26.291 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-07-14T12:51:26.356 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libjson-perl (4.04000-1) ... 2023-07-14T12:51:26.425 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up tcl (8.6.11+1build2) ... 2023-07-14T12:51:26.507 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-07-14T12:51:26.564 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libjson-perl (4.04000-1) ... 2023-07-14T12:51:26.589 INFO:teuthology.orchestra.run.smithi005.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-07-14T12:51:26.659 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up indent (2.2.12-1build2) ... 2023-07-14T12:51:26.694 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-07-14T12:51:26.785 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-07-14T12:51:26.809 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-07-14T12:51:26.961 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-07-14T12:51:27.087 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-07-14T12:51:27.162 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up indent (2.2.12-1build2) ... 2023-07-14T12:51:27.213 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-07-14T12:51:27.288 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-07-14T12:51:27.365 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up postgresql-client (14+238) ... 2023-07-14T12:51:27.498 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-07-14T12:51:27.507 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-07-14T12:51:27.624 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-07-14T12:51:27.751 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-07-14T12:51:27.918 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql-client (14+238) ... 2023-07-14T12:51:28.044 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-07-14T12:51:28.097 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:28.098 INFO:teuthology.orchestra.run.smithi005.stdout:The following network interfaces were found in /etc/network/interfaces 2023-07-14T12:51:28.098 INFO:teuthology.orchestra.run.smithi005.stdout:which means they are currently configured by ifupdown: 2023-07-14T12:51:28.099 INFO:teuthology.orchestra.run.smithi005.stdout:- ens1f0 2023-07-14T12:51:28.099 INFO:teuthology.orchestra.run.smithi005.stdout:If you want to manage those interfaces with NetworkManager instead 2023-07-14T12:51:28.099 INFO:teuthology.orchestra.run.smithi005.stdout:remove their configuration from /etc/network/interfaces. 2023-07-14T12:51:28.099 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:28.239 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-07-14T12:51:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:28.659 INFO:teuthology.orchestra.run.smithi154.stdout:The following network interfaces were found in /etc/network/interfaces 2023-07-14T12:51:28.659 INFO:teuthology.orchestra.run.smithi154.stdout:which means they are currently configured by ifupdown: 2023-07-14T12:51:28.659 INFO:teuthology.orchestra.run.smithi154.stdout:- enp3s0f1 2023-07-14T12:51:28.659 INFO:teuthology.orchestra.run.smithi154.stdout:If you want to manage those interfaces with NetworkManager instead 2023-07-14T12:51:28.660 INFO:teuthology.orchestra.run.smithi154.stdout:remove their configuration from /etc/network/interfaces. 2023-07-14T12:51:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:28.662 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-07-14T12:51:28.793 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-07-14T12:51:29.089 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-07-14T12:51:29.206 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-07-14T12:51:29.669 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-07-14T12:51:29.794 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-07-14T12:51:29.945 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-07-14T12:51:30.071 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-07-14T12:51:30.197 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up postgresql-common (238) ... 2023-07-14T12:51:30.372 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-07-14T12:51:30.523 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-07-14T12:51:30.675 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-07-14T12:51:30.826 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql-common (238) ... 2023-07-14T12:51:31.069 INFO:teuthology.orchestra.run.smithi005.stdout:Adding user postgres to group ssl-cert 2023-07-14T12:51:31.329 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:31.330 INFO:teuthology.orchestra.run.smithi005.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-07-14T12:51:31.595 INFO:teuthology.orchestra.run.smithi005.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-07-14T12:51:31.595 INFO:teuthology.orchestra.run.smithi005.stdout:Removing obsolete dictionary files: 2023-07-14T12:51:31.834 INFO:teuthology.orchestra.run.smithi154.stdout:Adding user postgres to group ssl-cert 2023-07-14T12:51:32.131 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:32.132 INFO:teuthology.orchestra.run.smithi154.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-07-14T12:51:32.370 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-07-14T12:51:32.372 INFO:teuthology.orchestra.run.smithi154.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-07-14T12:51:32.372 INFO:teuthology.orchestra.run.smithi154.stdout:Removing obsolete dictionary files: 2023-07-14T12:51:33.023 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-14T12:51:33.088 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-07-14T12:51:33.361 INFO:teuthology.orchestra.run.smithi005.stdout:Creating new PostgreSQL cluster 14/main ... 2023-07-14T12:51:33.378 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-07-14T12:51:33.428 INFO:teuthology.orchestra.run.smithi005.stdout:The files belonging to this database system will be owned by user "postgres". 2023-07-14T12:51:33.428 INFO:teuthology.orchestra.run.smithi005.stdout:This user must also own the server process. 2023-07-14T12:51:33.428 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:33.428 INFO:teuthology.orchestra.run.smithi005.stdout:The database cluster will be initialized with locale "en_US". 2023-07-14T12:51:33.428 INFO:teuthology.orchestra.run.smithi005.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-07-14T12:51:33.429 INFO:teuthology.orchestra.run.smithi005.stdout:The default text search configuration will be set to "english". 2023-07-14T12:51:33.429 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:33.429 INFO:teuthology.orchestra.run.smithi005.stdout:Data page checksums are disabled. 2023-07-14T12:51:33.429 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:33.429 INFO:teuthology.orchestra.run.smithi005.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-07-14T12:51:33.430 INFO:teuthology.orchestra.run.smithi005.stdout:creating subdirectories ... ok 2023-07-14T12:51:33.430 INFO:teuthology.orchestra.run.smithi005.stdout:selecting dynamic shared memory implementation ... posix 2023-07-14T12:51:33.454 INFO:teuthology.orchestra.run.smithi005.stdout:selecting default max_connections ... 100 2023-07-14T12:51:33.490 INFO:teuthology.orchestra.run.smithi005.stdout:selecting default shared_buffers ... 128MB 2023-07-14T12:51:33.504 INFO:teuthology.orchestra.run.smithi005.stdout:selecting default time zone ... Etc/UTC 2023-07-14T12:51:33.505 INFO:teuthology.orchestra.run.smithi005.stdout:creating configuration files ... ok 2023-07-14T12:51:33.561 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-14T12:51:33.691 INFO:teuthology.orchestra.run.smithi005.stdout:running bootstrap script ... ok 2023-07-14T12:51:33.900 INFO:teuthology.orchestra.run.smithi154.stdout:Creating new PostgreSQL cluster 14/main ... 2023-07-14T12:51:33.925 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-07-14T12:51:33.981 INFO:teuthology.orchestra.run.smithi154.stdout:The files belonging to this database system will be owned by user "postgres". 2023-07-14T12:51:33.981 INFO:teuthology.orchestra.run.smithi154.stdout:This user must also own the server process. 2023-07-14T12:51:33.982 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:33.982 INFO:teuthology.orchestra.run.smithi154.stdout:The database cluster will be initialized with locale "en_US". 2023-07-14T12:51:33.982 INFO:teuthology.orchestra.run.smithi154.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-07-14T12:51:33.982 INFO:teuthology.orchestra.run.smithi154.stdout:The default text search configuration will be set to "english". 2023-07-14T12:51:33.982 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:33.982 INFO:teuthology.orchestra.run.smithi154.stdout:Data page checksums are disabled. 2023-07-14T12:51:33.982 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:33.983 INFO:teuthology.orchestra.run.smithi154.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-07-14T12:51:33.983 INFO:teuthology.orchestra.run.smithi154.stdout:creating subdirectories ... ok 2023-07-14T12:51:33.983 INFO:teuthology.orchestra.run.smithi154.stdout:selecting dynamic shared memory implementation ... posix 2023-07-14T12:51:34.007 INFO:teuthology.orchestra.run.smithi154.stdout:selecting default max_connections ... 100 2023-07-14T12:51:34.041 INFO:teuthology.orchestra.run.smithi154.stdout:selecting default shared_buffers ... 128MB 2023-07-14T12:51:34.054 INFO:teuthology.orchestra.run.smithi154.stdout:selecting default time zone ... Etc/UTC 2023-07-14T12:51:34.055 INFO:teuthology.orchestra.run.smithi154.stdout:creating configuration files ... ok 2023-07-14T12:51:34.231 INFO:teuthology.orchestra.run.smithi154.stdout:running bootstrap script ... ok 2023-07-14T12:51:34.342 INFO:teuthology.orchestra.run.smithi005.stdout:performing post-bootstrap initialization ... ok 2023-07-14T12:51:34.867 INFO:teuthology.orchestra.run.smithi154.stdout:performing post-bootstrap initialization ... ok 2023-07-14T12:51:34.929 INFO:teuthology.orchestra.run.smithi005.stdout:syncing data to disk ... ok 2023-07-14T12:51:35.440 INFO:teuthology.orchestra.run.smithi154.stdout:syncing data to disk ... ok 2023-07-14T12:51:35.495 INFO:teuthology.orchestra.run.smithi005.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-07-14T12:51:35.977 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-07-14T12:51:38.581 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-07-14T12:51:38.698 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up postgresql-contrib (14+238) ... 2023-07-14T12:51:38.827 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up postgresql (14+238) ... 2023-07-14T12:51:38.942 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-07-14T12:51:39.068 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-07-14T12:51:39.335 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-07-14T12:51:39.336 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-07-14T12:51:39.336 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-07-14T12:51:39.445 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql-contrib (14+238) ... 2023-07-14T12:51:39.554 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql (14+238) ... 2023-07-14T12:51:39.680 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-07-14T12:51:39.847 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-07-14T12:51:40.107 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-07-14T12:51:40.108 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-07-14T12:51:40.120 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-07-14T12:51:40.406 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-07-14T12:51:40.549 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-07-14T12:51:40.900 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-07-14T12:51:41.252 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-07-14T12:51:41.395 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-07-14T12:51:41.568 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-07-14T12:51:41.668 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-07-14T12:51:42.347 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-07-14T12:51:42.403 INFO:teuthology.orchestra.run.smithi005.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-14T12:51:42.407 DEBUG:teuthology.parallel:result is None 2023-07-14T12:51:42.431 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-07-14T12:51:43.089 INFO:teuthology.orchestra.run.smithi154.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-14T12:51:43.092 DEBUG:teuthology.parallel:result is None 2023-07-14T12:51:43.093 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3fc0089cc1082313a98853d48b892acdc1385b8b 2023-07-14T12:51:43.568 DEBUG:teuthology.orchestra.run.smithi005:> dpkg-query -W -f '${Version}' ceph 2023-07-14T12:51:43.592 INFO:teuthology.orchestra.run.smithi005.stdout:18.0.0-4757-g3fc0089c-1jammy 2023-07-14T12:51:43.593 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4757-g3fc0089c-1jammy 2023-07-14T12:51:43.593 INFO:teuthology.task.install:The correct ceph version 18.0.0-4757-g3fc0089c-1jammy is installed. 2023-07-14T12:51:43.594 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3fc0089cc1082313a98853d48b892acdc1385b8b 2023-07-14T12:51:44.222 DEBUG:teuthology.orchestra.run.smithi154:> dpkg-query -W -f '${Version}' ceph 2023-07-14T12:51:44.247 INFO:teuthology.orchestra.run.smithi154.stdout:18.0.0-4757-g3fc0089c-1jammy 2023-07-14T12:51:44.247 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4757-g3fc0089c-1jammy 2023-07-14T12:51:44.247 INFO:teuthology.task.install:The correct ceph version 18.0.0-4757-g3fc0089c-1jammy is installed. 2023-07-14T12:51:44.248 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-14T12:51:44.248 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:51:44.248 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-14T12:51:44.273 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:51:44.273 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-14T12:51:44.312 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-14T12:51:44.313 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:51:44.313 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/daemon-helper 2023-07-14T12:51:44.341 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-14T12:51:44.404 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:51:44.404 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2023-07-14T12:51:44.427 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-14T12:51:44.491 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-14T12:51:44.492 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:51:44.492 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-14T12:51:44.514 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-14T12:51:44.576 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:51:44.576 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-14T12:51:44.598 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-14T12:51:44.659 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-14T12:51:44.659 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:51:44.660 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/stdin-killer 2023-07-14T12:51:44.682 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-14T12:51:44.744 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:51:44.745 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2023-07-14T12:51:44.767 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-14T12:51:44.831 INFO:teuthology.run_tasks:Running task ceph... 2023-07-14T12:51:44.904 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-14T12:51:44.905 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 777 /var/log/ceph 2023-07-14T12:51:44.909 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /var/log/ceph 2023-07-14T12:51:44.930 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-14T12:51:44.931 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-14T12:51:44.974 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-14T12:51:44.996 INFO:tasks.ceph:Creating extra log directories... 2023-07-14T12:51:44.996 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-14T12:51:45.038 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-14T12:51:45.066 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-14T12:51:45.067 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-14T12:51:45.067 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-14T12:51:45.067 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:51:45.068 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-14T12:51:45.107 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-14T12:51:45.208 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:51:45.209 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-14T12:51:45.217 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-14T12:51:45.321 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-14T12:51:45.322 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-14T12:51:45.323 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337461', 'branch': 'wip-rishabh-2023Jul13', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}', 'email': None, 'first_in_suite': False, 'job_id': '7337461', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a440c79eee0258ae07e4988d8690fe6187b8b7a3'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-2023Jul13'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-2023Jul13', 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-2023Jul13', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi005.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIO6MUPJGyxhEQGbyPRalUYJJyyKVvFI90MtlRSRJVrh4lI8MN5kZBhRyHOlto2qEY1DLWW6iNyoLvvpOLCrWak=', 'smithi154.front.sepia.ceph.com': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJgfpGvqME+amZ3DxuaEgD4CZDCoPQNjjnrXGmd7lLic'}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a440c79eee0258ae07e4988d8690fe6187b8b7a3'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_snap_schedules']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'aa6a80e6cc655fff48452a7eca02070e61d074fc', 'timestamp': '2023-07-14_10:26:42', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-14T12:51:45.324 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-14T12:51:45.329 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-14T12:51:45.338 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/run/ceph 2023-07-14T12:51:45.381 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/run/ceph 2023-07-14T12:51:45.403 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:51:45.403 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/scratch_devs of=/dev/stdout 2023-07-14T12:51:45.451 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-14T12:51:45.452 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_1 2023-07-14T12:51:45.504 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-14T12:51:45.504 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T12:51:45.504 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 888 Links: 1 2023-07-14T12:51:45.504 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T12:51:45.504 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-07-14 12:44:20.251926855 +0000 2023-07-14T12:51:45.505 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-07-14 12:44:19.831930608 +0000 2023-07-14T12:51:45.505 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-07-14 12:44:19.831930608 +0000 2023-07-14T12:51:45.505 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2023-07-14 12:44:19.831930608 +0000 2023-07-14T12:51:45.505 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-14T12:51:45.570 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-07-14T12:51:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-07-14T12:51:45.571 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000264096 s, 1.9 MB/s 2023-07-14T12:51:45.572 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-14T12:51:45.625 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_2 2023-07-14T12:51:45.676 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-14T12:51:45.676 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T12:51:45.676 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 906 Links: 1 2023-07-14T12:51:45.677 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T12:51:45.677 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-07-14 12:44:20.951920603 +0000 2023-07-14T12:51:45.677 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-07-14 12:44:20.499924640 +0000 2023-07-14T12:51:45.677 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-07-14 12:44:20.499924640 +0000 2023-07-14T12:51:45.677 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2023-07-14 12:44:20.499924640 +0000 2023-07-14T12:51:45.677 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-14T12:51:45.742 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-07-14T12:51:45.743 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-07-14T12:51:45.743 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000262425 s, 2.0 MB/s 2023-07-14T12:51:45.744 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-14T12:51:45.801 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_3 2023-07-14T12:51:45.856 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-14T12:51:45.857 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T12:51:45.857 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 923 Links: 1 2023-07-14T12:51:45.857 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T12:51:45.857 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-07-14 12:44:21.631914529 +0000 2023-07-14T12:51:45.857 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-07-14 12:44:21.215918246 +0000 2023-07-14T12:51:45.857 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-07-14 12:44:21.215918246 +0000 2023-07-14T12:51:45.857 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2023-07-14 12:44:21.215918246 +0000 2023-07-14T12:51:45.858 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-14T12:51:45.923 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-07-14T12:51:45.923 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-07-14T12:51:45.923 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.00026249 s, 2.0 MB/s 2023-07-14T12:51:45.925 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-14T12:51:45.982 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_4 2023-07-14T12:51:46.036 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-14T12:51:46.036 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T12:51:46.036 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 939 Links: 1 2023-07-14T12:51:46.036 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T12:51:46.037 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-07-14 12:44:22.387907774 +0000 2023-07-14T12:51:46.037 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-07-14 12:44:21.975911457 +0000 2023-07-14T12:51:46.037 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-07-14 12:44:21.975911457 +0000 2023-07-14T12:51:46.037 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2023-07-14 12:44:21.975911457 +0000 2023-07-14T12:51:46.037 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-14T12:51:46.103 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-07-14T12:51:46.103 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-07-14T12:51:46.104 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000248309 s, 2.1 MB/s 2023-07-14T12:51:46.105 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-14T12:51:46.158 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-14T12:51:46.158 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:51:46.159 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2023-07-14T12:51:46.168 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-14T12:51:46.169 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2023-07-14T12:51:46.223 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-14T12:51:46.223 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T12:51:46.223 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 886 Links: 1 2023-07-14T12:51:46.223 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T12:51:46.223 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-07-14 12:44:18.465895024 +0000 2023-07-14T12:51:46.224 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-07-14 12:44:18.053898699 +0000 2023-07-14T12:51:46.224 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-07-14 12:44:18.053898699 +0000 2023-07-14T12:51:46.224 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2023-07-14 12:44:18.053898699 +0000 2023-07-14T12:51:46.224 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-14T12:51:46.290 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-07-14T12:51:46.290 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-07-14T12:51:46.290 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000408283 s, 1.3 MB/s 2023-07-14T12:51:46.292 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-14T12:51:46.345 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2023-07-14T12:51:46.395 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-14T12:51:46.395 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T12:51:46.395 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 906 Links: 1 2023-07-14T12:51:46.395 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T12:51:46.396 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-07-14 12:44:19.161888814 +0000 2023-07-14T12:51:46.396 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-07-14 12:44:18.749892491 +0000 2023-07-14T12:51:46.396 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-07-14 12:44:18.749892491 +0000 2023-07-14T12:51:46.396 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2023-07-14 12:44:18.749892491 +0000 2023-07-14T12:51:46.396 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-14T12:51:46.457 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-07-14T12:51:46.458 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-07-14T12:51:46.458 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000395304 s, 1.3 MB/s 2023-07-14T12:51:46.459 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-14T12:51:46.517 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2023-07-14T12:51:46.567 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-14T12:51:46.567 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T12:51:46.567 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 923 Links: 1 2023-07-14T12:51:46.567 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T12:51:46.568 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-07-14 12:44:19.829882856 +0000 2023-07-14T12:51:46.568 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-07-14 12:44:19.405886638 +0000 2023-07-14T12:51:46.568 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-07-14 12:44:19.405886638 +0000 2023-07-14T12:51:46.568 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2023-07-14 12:44:19.405886638 +0000 2023-07-14T12:51:46.568 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-14T12:51:46.634 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-07-14T12:51:46.634 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-07-14T12:51:46.634 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000392868 s, 1.3 MB/s 2023-07-14T12:51:46.636 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-14T12:51:46.689 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2023-07-14T12:51:46.739 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-14T12:51:46.739 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T12:51:46.739 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 938 Links: 1 2023-07-14T12:51:46.739 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T12:51:46.740 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-07-14 12:44:20.513876753 +0000 2023-07-14T12:51:46.740 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-07-14 12:44:20.109880358 +0000 2023-07-14T12:51:46.740 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-07-14 12:44:20.109880358 +0000 2023-07-14T12:51:46.740 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2023-07-14 12:44:20.109880358 +0000 2023-07-14T12:51:46.740 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-14T12:51:46.802 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-07-14T12:51:46.802 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-07-14T12:51:46.803 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000384926 s, 1.3 MB/s 2023-07-14T12:51:46.804 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-14T12:51:46.857 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-14T12:51:46.857 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-14T12:51:46.857 INFO:tasks.ceph:Generating config... 2023-07-14T12:51:46.858 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-14T12:51:46.859 INFO:tasks.ceph:[client] debug client = 20 2023-07-14T12:51:46.859 INFO:tasks.ceph:[client] debug ms = 1 2023-07-14T12:51:46.859 INFO:tasks.ceph:[client] pid file = 2023-07-14T12:51:46.859 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-14T12:51:46.860 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-14T12:51:46.860 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-07-14T12:51:46.860 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-14T12:51:46.860 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-07-14T12:51:46.860 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-14T12:51:46.861 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-14T12:51:46.861 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-14T12:51:46.861 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-14T12:51:46.861 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-14T12:51:46.861 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-14T12:51:46.862 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-14T12:51:46.862 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-14T12:51:46.862 INFO:tasks.ceph:[mgr] debug client = 20 2023-07-14T12:51:46.862 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-07-14T12:51:46.862 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-14T12:51:46.862 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-14T12:51:46.863 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-14T12:51:46.863 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-14T12:51:46.863 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-14T12:51:46.863 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-14T12:51:46.863 INFO:tasks.ceph:[osd] bdev async discard = True 2023-07-14T12:51:46.864 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-07-14T12:51:46.864 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-07-14T12:51:46.864 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-14T12:51:46.864 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-14T12:51:46.865 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-07-14T12:51:46.865 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-07-14T12:51:46.865 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-14T12:51:46.865 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-14T12:51:46.865 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-07-14T12:51:46.866 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-14T12:51:46.866 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-14T12:51:46.866 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-14T12:51:46.866 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-14T12:51:46.866 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-14T12:51:46.867 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-14T12:51:46.867 INFO:tasks.ceph:Setting up mon.a... 2023-07-14T12:51:46.867 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-14T12:51:46.916 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.keyring 2023-07-14T12:51:46.930 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-14T12:51:46.981 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-14T12:51:47.002 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.5'), ('mon.b', '172.21.15.154'), ('mon.c', '[v2:172.21.15.154:3301,v1:172.21.15.154:6790]')] 2023-07-14T12:51:47.003 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.5,172.21.15.154,[v2:172.21.15.154:3301,v1:172.21.15.154:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-14T12:51:47.004 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:51:47.005 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-14T12:51:47.055 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.5 --add b 172.21.15.154 --addv c '[v2:172.21.15.154:3301,v1:172.21.15.154:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-14T12:51:47.147 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-14T12:51:47.147 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: generated fsid 22affb8d-e389-40f8-a764-dd40eb1759c8 2023-07-14T12:51:47.147 INFO:teuthology.orchestra.run.smithi005.stdout:setting min_mon_release = pacific 2023-07-14T12:51:47.147 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 0 2023-07-14T12:51:47.147 INFO:teuthology.orchestra.run.smithi005.stdout:fsid 22affb8d-e389-40f8-a764-dd40eb1759c8 2023-07-14T12:51:47.148 INFO:teuthology.orchestra.run.smithi005.stdout:last_changed 2023-07-14T12:51:47.127373+0000 2023-07-14T12:51:47.148 INFO:teuthology.orchestra.run.smithi005.stdout:created 2023-07-14T12:51:47.127373+0000 2023-07-14T12:51:47.148 INFO:teuthology.orchestra.run.smithi005.stdout:min_mon_release 16 (pacific) 2023-07-14T12:51:47.148 INFO:teuthology.orchestra.run.smithi005.stdout:election_strategy: 1 2023-07-14T12:51:47.148 INFO:teuthology.orchestra.run.smithi005.stdout:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-07-14T12:51:47.148 INFO:teuthology.orchestra.run.smithi005.stdout:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2023-07-14T12:51:47.148 INFO:teuthology.orchestra.run.smithi005.stdout:2: [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] mon.c 2023-07-14T12:51:47.149 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-14T12:51:47.150 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-14T12:51:47.158 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 22affb8d-e389-40f8-a764-dd40eb1759c8... 2023-07-14T12:51:47.159 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-14T12:51:47.202 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-14T12:51:47.245 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2023-07-14T12:51:47.246 INFO:teuthology.orchestra.run.smithi005.stdout: chdir = "" 2023-07-14T12:51:47.246 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-14T12:51:47.246 INFO:teuthology.orchestra.run.smithi005.stdout: auth supported = cephx 2023-07-14T12:51:47.246 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.246 INFO:teuthology.orchestra.run.smithi005.stdout: filestore xattr use omap = true 2023-07-14T12:51:47.246 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.247 INFO:teuthology.orchestra.run.smithi005.stdout: mon clock drift allowed = 1.000 2023-07-14T12:51:47.247 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.247 INFO:teuthology.orchestra.run.smithi005.stdout: osd crush chooseleaf type = 0 2023-07-14T12:51:47.247 INFO:teuthology.orchestra.run.smithi005.stdout: auth debug = true 2023-07-14T12:51:47.247 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.247 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on old message = true 2023-07-14T12:51:47.247 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on bug = true 2023-07-14T12:51:47.248 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.248 INFO:teuthology.orchestra.run.smithi005.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-14T12:51:47.248 INFO:teuthology.orchestra.run.smithi005.stdout: mon pg warn max object skew = 0 2023-07-14T12:51:47.248 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.248 INFO:teuthology.orchestra.run.smithi005.stdout: # disable pg_autoscaler by default for new pools 2023-07-14T12:51:47.248 INFO:teuthology.orchestra.run.smithi005.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-14T12:51:47.248 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.249 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default size = 2 2023-07-14T12:51:47.249 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.249 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow primary affinity = true 2023-07-14T12:51:47.249 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow pg remap = true 2023-07-14T12:51:47.249 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on legacy crush tunables = false 2023-07-14T12:51:47.249 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on crush straw calc version zero = false 2023-07-14T12:51:47.249 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on no sortbitwise = false 2023-07-14T12:51:47.249 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on osd down out interval zero = false 2023-07-14T12:51:47.250 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on too few osds = false 2023-07-14T12:51:47.250 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-14T12:51:47.250 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-14T12:51:47.250 INFO:teuthology.orchestra.run.smithi005.stdout: mon_allow_pool_size_one = true 2023-07-14T12:51:47.250 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.250 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-14T12:51:47.250 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.250 INFO:teuthology.orchestra.run.smithi005.stdout: osd default data pool replay window = 5 2023-07-14T12:51:47.251 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.251 INFO:teuthology.orchestra.run.smithi005.stdout: mon allow pool delete = true 2023-07-14T12:51:47.251 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.251 INFO:teuthology.orchestra.run.smithi005.stdout: mon cluster log file level = debug 2023-07-14T12:51:47.251 INFO:teuthology.orchestra.run.smithi005.stdout: debug asserts on shutdown = true 2023-07-14T12:51:47.251 INFO:teuthology.orchestra.run.smithi005.stdout: mon health detail to clog = false 2023-07-14T12:51:47.251 INFO:teuthology.orchestra.run.smithi005.stdout: mon host = "172.21.15.5,172.21.15.154,[v2:172.21.15.154:3301,v1:172.21.15.154:6790]" 2023-07-14T12:51:47.251 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on skipped message = False 2023-07-14T12:51:47.252 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = 22affb8d-e389-40f8-a764-dd40eb1759c8 2023-07-14T12:51:47.252 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.252 INFO:teuthology.orchestra.run.smithi005.stdout:[osd] 2023-07-14T12:51:47.252 INFO:teuthology.orchestra.run.smithi005.stdout: osd journal size = 100 2023-07-14T12:51:47.252 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.252 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub load threshold = 5.0 2023-07-14T12:51:47.252 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub max interval = 600 2023-07-14T12:51:47.252 INFO:teuthology.orchestra.run.smithi005.stdout: osd mclock profile = high_recovery_ops 2023-07-14T12:51:47.253 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.253 INFO:teuthology.orchestra.run.smithi005.stdout: osd recover clone overlap = true 2023-07-14T12:51:47.253 INFO:teuthology.orchestra.run.smithi005.stdout: osd recovery max chunk = 1048576 2023-07-14T12:51:47.253 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.253 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug shutdown = true 2023-07-14T12:51:47.253 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug op order = true 2023-07-14T12:51:47.254 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify stray on activate = true 2023-07-14T12:51:47.254 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.254 INFO:teuthology.orchestra.run.smithi005.stdout: osd open classes on start = true 2023-07-14T12:51:47.254 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug pg log writeout = true 2023-07-14T12:51:47.254 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.254 INFO:teuthology.orchestra.run.smithi005.stdout: osd deep scrub update digest min age = 30 2023-07-14T12:51:47.254 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.254 INFO:teuthology.orchestra.run.smithi005.stdout: osd map max advance = 10 2023-07-14T12:51:47.255 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.255 INFO:teuthology.orchestra.run.smithi005.stdout: journal zero on create = true 2023-07-14T12:51:47.255 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.255 INFO:teuthology.orchestra.run.smithi005.stdout: filestore ondisk finisher threads = 3 2023-07-14T12:51:47.255 INFO:teuthology.orchestra.run.smithi005.stdout: filestore apply finisher threads = 3 2023-07-14T12:51:47.255 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.255 INFO:teuthology.orchestra.run.smithi005.stdout: bdev debug aio = true 2023-07-14T12:51:47.255 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug misdirected ops = true 2023-07-14T12:51:47.256 INFO:teuthology.orchestra.run.smithi005.stdout: bdev async discard = True 2023-07-14T12:51:47.256 INFO:teuthology.orchestra.run.smithi005.stdout: bdev enable discard = True 2023-07-14T12:51:47.256 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore allocator = bitmap 2023-07-14T12:51:47.256 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore block size = 96636764160 2023-07-14T12:51:47.256 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore fsck on mount = True 2023-07-14T12:51:47.256 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluefs = 1/20 2023-07-14T12:51:47.256 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluestore = 1/20 2023-07-14T12:51:47.256 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-07-14T12:51:47.257 INFO:teuthology.orchestra.run.smithi005.stdout: debug osd = 20 2023-07-14T12:51:47.257 INFO:teuthology.orchestra.run.smithi005.stdout: debug rocksdb = 4/10 2023-07-14T12:51:47.257 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd backfillfull_ratio = 0.85 2023-07-14T12:51:47.257 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd full ratio = 0.9 2023-07-14T12:51:47.257 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd nearfull ratio = 0.8 2023-07-14T12:51:47.257 INFO:teuthology.orchestra.run.smithi005.stdout: osd failsafe full ratio = 0.95 2023-07-14T12:51:47.258 INFO:teuthology.orchestra.run.smithi005.stdout: osd objectstore = bluestore 2023-07-14T12:51:47.258 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2023-07-14T12:51:47.258 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.258 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr] 2023-07-14T12:51:47.258 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-07-14T12:51:47.258 INFO:teuthology.orchestra.run.smithi005.stdout: debug mgr = 20 2023-07-14T12:51:47.258 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2023-07-14T12:51:47.259 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2023-07-14T12:51:47.259 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2023-07-14T12:51:47.259 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2023-07-14T12:51:47.259 INFO:teuthology.orchestra.run.smithi005.stdout: mgr/telemetry/nag = false 2023-07-14T12:51:47.259 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2023-07-14T12:51:47.260 INFO:teuthology.orchestra.run.smithi005.stdout: debug finisher = 20 2023-07-14T12:51:47.260 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.260 INFO:teuthology.orchestra.run.smithi005.stdout:[mon] 2023-07-14T12:51:47.261 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-07-14T12:51:47.261 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2023-07-14T12:51:47.261 INFO:teuthology.orchestra.run.smithi005.stdout: debug paxos = 20 2023-07-14T12:51:47.261 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2023-07-14T12:51:47.262 INFO:teuthology.orchestra.run.smithi005.stdout: mon data avail warn = 5 2023-07-14T12:51:47.262 INFO:teuthology.orchestra.run.smithi005.stdout: mon mgr mkfs grace = 240 2023-07-14T12:51:47.262 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2023-07-14T12:51:47.262 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd reporter subtree level = osd 2023-07-14T12:51:47.263 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd prime pg temp = true 2023-07-14T12:51:47.263 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2023-07-14T12:51:47.263 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.264 INFO:teuthology.orchestra.run.smithi005.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-14T12:51:47.264 INFO:teuthology.orchestra.run.smithi005.stdout: auth mon ticket ttl = 660 # 11m 2023-07-14T12:51:47.264 INFO:teuthology.orchestra.run.smithi005.stdout: auth service ticket ttl = 240 # 4m 2023-07-14T12:51:47.265 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.265 INFO:teuthology.orchestra.run.smithi005.stdout: # don't complain about insecure global_id in the test suite 2023-07-14T12:51:47.265 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-14T12:51:47.265 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-14T12:51:47.266 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.266 INFO:teuthology.orchestra.run.smithi005.stdout: # 1m isn't quite enough 2023-07-14T12:51:47.266 INFO:teuthology.orchestra.run.smithi005.stdout: mon_down_mkfs_grace = 2m 2023-07-14T12:51:47.267 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.267 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_filestore_osds = false 2023-07-14T12:51:47.267 INFO:teuthology.orchestra.run.smithi005.stdout: mon op complaint time = 120 2023-07-14T12:51:47.267 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:51:47.267 INFO:teuthology.orchestra.run.smithi005.stdout:[client] 2023-07-14T12:51:47.268 INFO:teuthology.orchestra.run.smithi005.stdout: rgw cache enabled = true 2023-07-14T12:51:47.268 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable ops log = true 2023-07-14T12:51:47.268 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable usage log = true 2023-07-14T12:51:47.269 INFO:teuthology.orchestra.run.smithi005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-14T12:51:47.269 INFO:teuthology.orchestra.run.smithi005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-14T12:51:47.269 INFO:teuthology.orchestra.run.smithi005.stdout: client mount timeout = 600 2023-07-14T12:51:47.269 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2023-07-14T12:51:47.270 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-07-14T12:51:47.270 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = "" 2023-07-14T12:51:47.270 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2023-07-14T12:51:47.270 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2023-07-14T12:51:47.270 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.a] 2023-07-14T12:51:47.270 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.b] 2023-07-14T12:51:47.271 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.c] 2023-07-14T12:51:47.271 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2023-07-14T12:51:47.271 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2023-07-14T12:51:47.271 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2023-07-14T12:51:47.271 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2023-07-14T12:51:47.271 INFO:teuthology.orchestra.run.smithi005.stdout:[mds] 2023-07-14T12:51:47.271 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds = 20 2023-07-14T12:51:47.271 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds balancer = 20 2023-07-14T12:51:47.272 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-07-14T12:51:47.272 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug frag = True 2023-07-14T12:51:47.272 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug scatterstat = True 2023-07-14T12:51:47.272 INFO:teuthology.orchestra.run.smithi005.stdout: mds op complaint time = 180 2023-07-14T12:51:47.272 INFO:teuthology.orchestra.run.smithi005.stdout: mds verify scatter = True 2023-07-14T12:51:47.272 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2023-07-14T12:51:47.273 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2023-07-14T12:51:47.273 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2023-07-14T12:51:47.274 INFO:teuthology.orchestra.run.smithi154.stdout:[global] 2023-07-14T12:51:47.274 INFO:teuthology.orchestra.run.smithi154.stdout: chdir = "" 2023-07-14T12:51:47.274 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-14T12:51:47.274 INFO:teuthology.orchestra.run.smithi154.stdout: auth supported = cephx 2023-07-14T12:51:47.275 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.275 INFO:teuthology.orchestra.run.smithi154.stdout: filestore xattr use omap = true 2023-07-14T12:51:47.275 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.275 INFO:teuthology.orchestra.run.smithi154.stdout: mon clock drift allowed = 1.000 2023-07-14T12:51:47.275 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.275 INFO:teuthology.orchestra.run.smithi154.stdout: osd crush chooseleaf type = 0 2023-07-14T12:51:47.275 INFO:teuthology.orchestra.run.smithi154.stdout: auth debug = true 2023-07-14T12:51:47.276 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.276 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on old message = true 2023-07-14T12:51:47.276 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on bug = true 2023-07-14T12:51:47.276 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.276 INFO:teuthology.orchestra.run.smithi154.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-14T12:51:47.276 INFO:teuthology.orchestra.run.smithi154.stdout: mon pg warn max object skew = 0 2023-07-14T12:51:47.276 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.277 INFO:teuthology.orchestra.run.smithi154.stdout: # disable pg_autoscaler by default for new pools 2023-07-14T12:51:47.277 INFO:teuthology.orchestra.run.smithi154.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-14T12:51:47.277 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.277 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default size = 2 2023-07-14T12:51:47.277 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.277 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow primary affinity = true 2023-07-14T12:51:47.277 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow pg remap = true 2023-07-14T12:51:47.277 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on legacy crush tunables = false 2023-07-14T12:51:47.278 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on crush straw calc version zero = false 2023-07-14T12:51:47.278 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on no sortbitwise = false 2023-07-14T12:51:47.278 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on osd down out interval zero = false 2023-07-14T12:51:47.278 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on too few osds = false 2023-07-14T12:51:47.278 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-14T12:51:47.278 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-14T12:51:47.278 INFO:teuthology.orchestra.run.smithi154.stdout: mon_allow_pool_size_one = true 2023-07-14T12:51:47.278 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.279 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-14T12:51:47.279 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.279 INFO:teuthology.orchestra.run.smithi154.stdout: osd default data pool replay window = 5 2023-07-14T12:51:47.279 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.279 INFO:teuthology.orchestra.run.smithi154.stdout: mon allow pool delete = true 2023-07-14T12:51:47.279 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.279 INFO:teuthology.orchestra.run.smithi154.stdout: mon cluster log file level = debug 2023-07-14T12:51:47.279 INFO:teuthology.orchestra.run.smithi154.stdout: debug asserts on shutdown = true 2023-07-14T12:51:47.280 INFO:teuthology.orchestra.run.smithi154.stdout: mon health detail to clog = false 2023-07-14T12:51:47.280 INFO:teuthology.orchestra.run.smithi154.stdout: mon host = "172.21.15.5,172.21.15.154,[v2:172.21.15.154:3301,v1:172.21.15.154:6790]" 2023-07-14T12:51:47.280 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on skipped message = False 2023-07-14T12:51:47.280 INFO:teuthology.orchestra.run.smithi154.stdout: fsid = 22affb8d-e389-40f8-a764-dd40eb1759c8 2023-07-14T12:51:47.280 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.280 INFO:teuthology.orchestra.run.smithi154.stdout:[osd] 2023-07-14T12:51:47.280 INFO:teuthology.orchestra.run.smithi154.stdout: osd journal size = 100 2023-07-14T12:51:47.281 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.281 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub load threshold = 5.0 2023-07-14T12:51:47.281 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub max interval = 600 2023-07-14T12:51:47.281 INFO:teuthology.orchestra.run.smithi154.stdout: osd mclock profile = high_recovery_ops 2023-07-14T12:51:47.281 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.281 INFO:teuthology.orchestra.run.smithi154.stdout: osd recover clone overlap = true 2023-07-14T12:51:47.281 INFO:teuthology.orchestra.run.smithi154.stdout: osd recovery max chunk = 1048576 2023-07-14T12:51:47.281 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.282 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug shutdown = true 2023-07-14T12:51:47.282 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug op order = true 2023-07-14T12:51:47.282 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug verify stray on activate = true 2023-07-14T12:51:47.282 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.282 INFO:teuthology.orchestra.run.smithi154.stdout: osd open classes on start = true 2023-07-14T12:51:47.282 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug pg log writeout = true 2023-07-14T12:51:47.282 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.283 INFO:teuthology.orchestra.run.smithi154.stdout: osd deep scrub update digest min age = 30 2023-07-14T12:51:47.283 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.283 INFO:teuthology.orchestra.run.smithi154.stdout: osd map max advance = 10 2023-07-14T12:51:47.283 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.283 INFO:teuthology.orchestra.run.smithi154.stdout: journal zero on create = true 2023-07-14T12:51:47.283 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.283 INFO:teuthology.orchestra.run.smithi154.stdout: filestore ondisk finisher threads = 3 2023-07-14T12:51:47.283 INFO:teuthology.orchestra.run.smithi154.stdout: filestore apply finisher threads = 3 2023-07-14T12:51:47.284 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.284 INFO:teuthology.orchestra.run.smithi154.stdout: bdev debug aio = true 2023-07-14T12:51:47.284 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug misdirected ops = true 2023-07-14T12:51:47.284 INFO:teuthology.orchestra.run.smithi154.stdout: bdev async discard = True 2023-07-14T12:51:47.284 INFO:teuthology.orchestra.run.smithi154.stdout: bdev enable discard = True 2023-07-14T12:51:47.284 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore allocator = bitmap 2023-07-14T12:51:47.284 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore block size = 96636764160 2023-07-14T12:51:47.285 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore fsck on mount = True 2023-07-14T12:51:47.285 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluefs = 1/20 2023-07-14T12:51:47.285 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluestore = 1/20 2023-07-14T12:51:47.285 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-07-14T12:51:47.285 INFO:teuthology.orchestra.run.smithi154.stdout: debug osd = 20 2023-07-14T12:51:47.285 INFO:teuthology.orchestra.run.smithi154.stdout: debug rocksdb = 4/10 2023-07-14T12:51:47.285 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd backfillfull_ratio = 0.85 2023-07-14T12:51:47.285 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd full ratio = 0.9 2023-07-14T12:51:47.286 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd nearfull ratio = 0.8 2023-07-14T12:51:47.286 INFO:teuthology.orchestra.run.smithi154.stdout: osd failsafe full ratio = 0.95 2023-07-14T12:51:47.286 INFO:teuthology.orchestra.run.smithi154.stdout: osd objectstore = bluestore 2023-07-14T12:51:47.286 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2023-07-14T12:51:47.286 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.286 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr] 2023-07-14T12:51:47.286 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-07-14T12:51:47.286 INFO:teuthology.orchestra.run.smithi154.stdout: debug mgr = 20 2023-07-14T12:51:47.287 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2023-07-14T12:51:47.287 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2023-07-14T12:51:47.287 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2023-07-14T12:51:47.287 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2023-07-14T12:51:47.287 INFO:teuthology.orchestra.run.smithi154.stdout: mgr/telemetry/nag = false 2023-07-14T12:51:47.287 INFO:teuthology.orchestra.run.smithi154.stdout: debug client = 20 2023-07-14T12:51:47.287 INFO:teuthology.orchestra.run.smithi154.stdout: debug finisher = 20 2023-07-14T12:51:47.287 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.288 INFO:teuthology.orchestra.run.smithi154.stdout:[mon] 2023-07-14T12:51:47.288 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-07-14T12:51:47.288 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2023-07-14T12:51:47.288 INFO:teuthology.orchestra.run.smithi154.stdout: debug paxos = 20 2023-07-14T12:51:47.288 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2023-07-14T12:51:47.288 INFO:teuthology.orchestra.run.smithi154.stdout: mon data avail warn = 5 2023-07-14T12:51:47.288 INFO:teuthology.orchestra.run.smithi154.stdout: mon mgr mkfs grace = 240 2023-07-14T12:51:47.289 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2023-07-14T12:51:47.289 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd reporter subtree level = osd 2023-07-14T12:51:47.289 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd prime pg temp = true 2023-07-14T12:51:47.289 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2023-07-14T12:51:47.289 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.289 INFO:teuthology.orchestra.run.smithi154.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-14T12:51:47.289 INFO:teuthology.orchestra.run.smithi154.stdout: auth mon ticket ttl = 660 # 11m 2023-07-14T12:51:47.289 INFO:teuthology.orchestra.run.smithi154.stdout: auth service ticket ttl = 240 # 4m 2023-07-14T12:51:47.290 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.290 INFO:teuthology.orchestra.run.smithi154.stdout: # don't complain about insecure global_id in the test suite 2023-07-14T12:51:47.290 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-14T12:51:47.290 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-14T12:51:47.290 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.290 INFO:teuthology.orchestra.run.smithi154.stdout: # 1m isn't quite enough 2023-07-14T12:51:47.290 INFO:teuthology.orchestra.run.smithi154.stdout: mon_down_mkfs_grace = 2m 2023-07-14T12:51:47.290 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.291 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_filestore_osds = false 2023-07-14T12:51:47.291 INFO:teuthology.orchestra.run.smithi154.stdout: mon op complaint time = 120 2023-07-14T12:51:47.291 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-14T12:51:47.291 INFO:teuthology.orchestra.run.smithi154.stdout:[client] 2023-07-14T12:51:47.291 INFO:teuthology.orchestra.run.smithi154.stdout: rgw cache enabled = true 2023-07-14T12:51:47.291 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable ops log = true 2023-07-14T12:51:47.291 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable usage log = true 2023-07-14T12:51:47.291 INFO:teuthology.orchestra.run.smithi154.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-14T12:51:47.292 INFO:teuthology.orchestra.run.smithi154.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-14T12:51:47.292 INFO:teuthology.orchestra.run.smithi154.stdout: client mount timeout = 600 2023-07-14T12:51:47.292 INFO:teuthology.orchestra.run.smithi154.stdout: debug client = 20 2023-07-14T12:51:47.292 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-07-14T12:51:47.292 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = "" 2023-07-14T12:51:47.292 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2023-07-14T12:51:47.292 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2023-07-14T12:51:47.293 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.a] 2023-07-14T12:51:47.293 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.b] 2023-07-14T12:51:47.293 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.c] 2023-07-14T12:51:47.293 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2023-07-14T12:51:47.293 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.c] 2023-07-14T12:51:47.293 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.b] 2023-07-14T12:51:47.293 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.d] 2023-07-14T12:51:47.293 INFO:teuthology.orchestra.run.smithi154.stdout:[mds] 2023-07-14T12:51:47.294 INFO:teuthology.orchestra.run.smithi154.stdout: debug mds = 20 2023-07-14T12:51:47.294 INFO:teuthology.orchestra.run.smithi154.stdout: debug mds balancer = 20 2023-07-14T12:51:47.294 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-07-14T12:51:47.294 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug frag = True 2023-07-14T12:51:47.294 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug scatterstat = True 2023-07-14T12:51:47.294 INFO:teuthology.orchestra.run.smithi154.stdout: mds op complaint time = 180 2023-07-14T12:51:47.294 INFO:teuthology.orchestra.run.smithi154.stdout: mds verify scatter = True 2023-07-14T12:51:47.294 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2023-07-14T12:51:47.295 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2023-07-14T12:51:47.295 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2023-07-14T12:51:47.295 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-14T12:51:47.295 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-14T12:51:47.378 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-14T12:51:47.378 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:51:47.378 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-14T12:51:47.387 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:51:47.387 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-14T12:51:47.435 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi005.front.sepia.ceph.com 2023-07-14T12:51:47.435 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:51:47.435 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-14T12:51:47.435 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-14T12:51:47.513 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:51:47.513 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-14T12:51:47.564 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi154.front.sepia.ceph.com 2023-07-14T12:51:47.565 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:51:47.565 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-14T12:51:47.566 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-14T12:51:47.603 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:51:47.604 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-14T12:51:47.655 INFO:tasks.ceph:Setting up mon nodes... 2023-07-14T12:51:47.655 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-14T12:51:47.655 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-14T12:51:47.716 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-14T12:51:47.721 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-14T12:51:47.784 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-14T12:51:47.797 INFO:tasks.ceph:Setting up mds nodes... 2023-07-14T12:51:47.798 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-14T12:51:47.857 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-14T12:51:47.861 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-14T12:51:47.884 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-14T12:51:47.985 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-14T12:51:47.990 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-14T12:51:48.011 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-14T12:51:48.074 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-14T12:51:48.079 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-14T12:51:48.100 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-07-14T12:51:48.200 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-07-14T12:51:48.204 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-07-14T12:51:48.224 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-14T12:51:48.225 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-14T12:51:48.271 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-14T12:51:48.289 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-07-14T12:51:48.375 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-07-14T12:51:48.393 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-07-14T12:51:48.436 INFO:teuthology.orchestra.run.smithi154.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-07-14T12:51:48.454 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-07-14T12:51:48.537 INFO:teuthology.orchestra.run.smithi154.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-07-14T12:51:48.554 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-14T12:51:48.555 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-14T12:51:48.555 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-14T12:51:48.576 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-14T12:51:48.577 INFO:tasks.ceph:role: osd.0 2023-07-14T12:51:48.577 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com 2023-07-14T12:51:48.577 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-14T12:51:48.639 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-14T12:51:48.640 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-14T12:51:48.640 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-14T12:51:48.640 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-14T12:51:48.640 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-14T12:51:48.640 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2023-07-14T12:51:48.640 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-14T12:51:48.641 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-14T12:51:48.641 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-14T12:51:48.641 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-14T12:51:48.664 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2023-07-14T12:51:48.666 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2023-07-14T12:51:48.667 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-14T12:51:48.734 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-14T12:51:48.792 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: /sbin/restorecon: command not found 2023-07-14T12:51:48.793 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T12:51:48.793 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-14T12:51:48.856 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-14T12:51:48.856 INFO:tasks.ceph:role: osd.1 2023-07-14T12:51:48.856 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com 2023-07-14T12:51:48.857 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-14T12:51:48.923 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-14T12:51:48.923 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-14T12:51:48.924 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-14T12:51:48.924 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-14T12:51:48.924 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-14T12:51:48.924 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2023-07-14T12:51:48.924 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-14T12:51:48.925 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-14T12:51:48.925 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-14T12:51:48.925 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-14T12:51:48.948 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2023-07-14T12:51:48.950 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2023-07-14T12:51:48.950 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-14T12:51:49.022 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-14T12:51:49.079 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: /sbin/restorecon: command not found 2023-07-14T12:51:49.080 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T12:51:49.081 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-14T12:51:49.147 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-14T12:51:49.148 INFO:tasks.ceph:role: osd.2 2023-07-14T12:51:49.148 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com 2023-07-14T12:51:49.148 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-14T12:51:49.211 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-14T12:51:49.212 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-14T12:51:49.212 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-14T12:51:49.212 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-14T12:51:49.212 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-14T12:51:49.212 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2023-07-14T12:51:49.212 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-14T12:51:49.212 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-14T12:51:49.213 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-14T12:51:49.213 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-14T12:51:49.236 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2023-07-14T12:51:49.238 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2023-07-14T12:51:49.238 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-14T12:51:49.308 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-14T12:51:49.367 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: /sbin/restorecon: command not found 2023-07-14T12:51:49.368 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T12:51:49.369 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-14T12:51:49.435 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-14T12:51:49.435 INFO:tasks.ceph:role: osd.3 2023-07-14T12:51:49.435 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com 2023-07-14T12:51:49.436 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-14T12:51:49.500 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-14T12:51:49.500 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-14T12:51:49.500 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-14T12:51:49.501 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-14T12:51:49.501 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-14T12:51:49.501 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2023-07-14T12:51:49.501 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-14T12:51:49.501 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-14T12:51:49.501 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-14T12:51:49.501 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-14T12:51:49.524 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2023-07-14T12:51:49.527 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2023-07-14T12:51:49.527 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-14T12:51:49.593 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-14T12:51:49.656 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: /sbin/restorecon: command not found 2023-07-14T12:51:49.657 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T12:51:49.658 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-14T12:51:49.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:51:49.769+0000 7f60e86f3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-14T12:51:49.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:51:49.769+0000 7f60e86f3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-14T12:51:49.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:51:49.769+0000 7f60e86f3640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-14T12:51:49.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:51:49.769+0000 7f60e86f3640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-14T12:51:49.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:51:49.769+0000 7f60e86f3640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-14T12:51:49.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:51:49.769+0000 7f60e86f3640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-14T12:51:52.792 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-14T12:51:52.815 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-14T12:51:52.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:51:52.893+0000 7f7f420a2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-14T12:51:52.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:51:52.893+0000 7f7f420a2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-14T12:51:52.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:51:52.893+0000 7f7f420a2640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-14T12:51:52.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:51:52.893+0000 7f7f420a2640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-14T12:51:52.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:51:52.893+0000 7f7f420a2640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-14T12:51:52.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:51:52.893+0000 7f7f420a2640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-14T12:51:55.924 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-14T12:51:55.947 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-14T12:51:56.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:51:56.028+0000 7fa981667640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-14T12:51:56.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:51:56.028+0000 7fa981667640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-14T12:51:56.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:51:56.028+0000 7fa981667640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-14T12:51:56.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:51:56.028+0000 7fa981667640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-14T12:51:56.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:51:56.028+0000 7fa981667640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-14T12:51:56.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:51:56.028+0000 7fa981667640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-14T12:51:59.048 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-14T12:51:59.072 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-14T12:51:59.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:51:59.148+0000 7f846bb9f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-14T12:51:59.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:51:59.152+0000 7f846bb9f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-14T12:51:59.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:51:59.152+0000 7f846bb9f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-14T12:51:59.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:51:59.152+0000 7f846bb9f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-14T12:51:59.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:51:59.152+0000 7f846bb9f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-14T12:51:59.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:51:59.152+0000 7f846bb9f640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-07-14T12:52:02.159 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-14T12:52:02.182 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-14T12:52:02.205 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-14T12:52:02.205 INFO:tasks.ceph:role: osd.4 2023-07-14T12:52:02.206 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com 2023-07-14T12:52:02.206 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-14T12:52:02.277 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-14T12:52:02.277 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-14T12:52:02.277 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-14T12:52:02.277 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-14T12:52:02.278 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-14T12:52:02.278 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-07-14T12:52:02.278 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-14T12:52:02.278 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-14T12:52:02.278 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-14T12:52:02.278 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-14T12:52:02.739 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-07-14T12:52:02.742 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-07-14T12:52:02.742 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-14T12:52:02.850 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-14T12:52:02.868 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2023-07-14T12:52:02.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T12:52:02.869 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-14T12:52:02.936 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-14T12:52:02.936 INFO:tasks.ceph:role: osd.5 2023-07-14T12:52:02.936 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com 2023-07-14T12:52:02.937 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-14T12:52:03.013 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-14T12:52:03.013 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-14T12:52:03.013 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-14T12:52:03.013 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-14T12:52:03.014 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-14T12:52:03.014 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-07-14T12:52:03.014 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-14T12:52:03.014 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-14T12:52:03.014 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-14T12:52:03.015 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-14T12:52:03.506 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-07-14T12:52:03.510 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-07-14T12:52:03.510 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-14T12:52:03.639 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-14T12:52:03.657 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2023-07-14T12:52:03.658 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T12:52:03.658 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-14T12:52:03.725 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-14T12:52:03.725 INFO:tasks.ceph:role: osd.6 2023-07-14T12:52:03.726 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com 2023-07-14T12:52:03.726 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-14T12:52:03.796 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-14T12:52:03.796 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-14T12:52:03.797 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-14T12:52:03.797 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-14T12:52:03.797 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-14T12:52:03.797 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-07-14T12:52:03.797 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-14T12:52:03.797 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-14T12:52:03.798 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-14T12:52:03.798 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-14T12:52:04.277 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-07-14T12:52:04.280 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-07-14T12:52:04.281 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-14T12:52:04.415 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-14T12:52:04.434 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2023-07-14T12:52:04.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T12:52:04.436 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-14T12:52:04.501 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-14T12:52:04.501 INFO:tasks.ceph:role: osd.7 2023-07-14T12:52:04.502 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com 2023-07-14T12:52:04.502 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-14T12:52:04.572 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-14T12:52:04.572 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-14T12:52:04.573 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-14T12:52:04.573 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-14T12:52:04.573 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-14T12:52:04.573 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-07-14T12:52:04.573 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-14T12:52:04.573 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-14T12:52:04.573 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-14T12:52:04.574 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-14T12:52:05.023 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-07-14T12:52:05.025 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-07-14T12:52:05.026 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-14T12:52:05.132 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-14T12:52:05.150 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2023-07-14T12:52:05.151 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T12:52:05.152 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-14T12:52:05.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:05.260+0000 7f7eba5a7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-14T12:52:05.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:05.264+0000 7f7eba5a7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-14T12:52:05.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:05.264+0000 7f7eba5a7640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-14T12:52:05.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:05.264+0000 7f7eba5a7640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-14T12:52:05.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:05.264+0000 7f7eba5a7640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-14T12:52:05.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:05.272+0000 7f7eba5a7640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-07-14T12:52:08.279 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-14T12:52:08.300 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-14T12:52:08.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:08.372+0000 7f8757628640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-14T12:52:08.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:08.376+0000 7f8757628640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-14T12:52:08.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:08.376+0000 7f8757628640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-14T12:52:08.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:08.376+0000 7f8757628640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-14T12:52:08.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:08.376+0000 7f8757628640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-14T12:52:08.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:08.376+0000 7f8757628640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-07-14T12:52:11.386 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-14T12:52:11.408 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-14T12:52:11.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:11.480+0000 7f1e62db0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-14T12:52:11.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:11.484+0000 7f1e62db0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-14T12:52:11.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:11.484+0000 7f1e62db0640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-14T12:52:11.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:11.484+0000 7f1e62db0640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-14T12:52:11.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:11.484+0000 7f1e62db0640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-14T12:52:11.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:11.484+0000 7f1e62db0640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-07-14T12:52:14.490 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-14T12:52:14.511 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-14T12:52:14.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:14.584+0000 7f76daeab640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-14T12:52:14.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:14.584+0000 7f76daeab640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-14T12:52:14.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:14.584+0000 7f76daeab640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-14T12:52:14.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:14.584+0000 7f76daeab640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-14T12:52:14.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:14.584+0000 7f76daeab640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-14T12:52:14.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:14.584+0000 7f76daeab640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-07-14T12:52:15.326 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:52:15.330 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:52:17.606 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-14T12:52:17.627 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-14T12:52:17.628 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:52:17.628 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-14T12:52:17.652 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:52:17.653 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-14T12:52:17.714 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:52:17.715 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-14T12:52:17.778 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:52:17.779 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-14T12:52:17.842 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:52:17.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-14T12:52:17.906 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:52:17.906 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-14T12:52:17.970 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:52:17.970 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-14T12:52:18.035 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:52:18.035 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-14T12:52:18.065 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:52:18.065 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-14T12:52:18.128 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:52:18.128 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-07-14T12:52:18.191 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:52:18.192 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-14T12:52:18.256 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:52:18.256 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-14T12:52:18.319 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:52:18.320 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-14T12:52:18.383 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:52:18.383 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-14T12:52:18.443 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:52:18.444 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-14T12:52:18.453 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:52:18.453 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-07-14T12:52:18.505 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:52:18.506 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-07-14T12:52:18.514 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:52:18.514 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-07-14T12:52:18.567 INFO:tasks.ceph:Adding keys to all mons... 2023-07-14T12:52:18.567 DEBUG:teuthology.orchestra.run.smithi005:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-14T12:52:18.571 DEBUG:teuthology.orchestra.run.smithi154:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-14T12:52:18.615 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.y] 2023-07-14T12:52:18.615 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDjRLFkSvp/KRAAwvjYlrZYNeGbhCiDrTmnrA== 2023-07-14T12:52:18.615 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2023-07-14T12:52:18.615 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDjRLFkGNTsMRAA5T/zjdynxEKmoNAAK0cChw== 2023-07-14T12:52:18.615 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2023-07-14T12:52:18.616 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDjRLFk6NGUORAA+5odxrAlCCXYGc64nzFWwQ== 2023-07-14T12:52:18.616 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.0] 2023-07-14T12:52:18.616 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDlRLFkJ6MULhAAxExAqekc/gWudYBJ2sY4MQ== 2023-07-14T12:52:18.616 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.1] 2023-07-14T12:52:18.616 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDoRLFksXGBNRAAFtHZt5OQw0aB6k3CkxOzZQ== 2023-07-14T12:52:18.616 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.2] 2023-07-14T12:52:18.616 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDsRLFkaUH0ARAAkqgsKPX1dTSZQjn0cRxxRQ== 2023-07-14T12:52:18.617 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.3] 2023-07-14T12:52:18.617 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDvRLFkvElJCRAAnox5LKwobP/1Qaf5d9UsjA== 2023-07-14T12:52:18.617 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.x] 2023-07-14T12:52:18.617 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDjRLFkugeXLRAAEVAnLk/dldtqrpkdzQI3SA== 2023-07-14T12:52:18.617 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2023-07-14T12:52:18.617 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDkRLFkqXNAAxAAb7bzXyE8cSS0A3Rz2de6TA== 2023-07-14T12:52:18.617 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2023-07-14T12:52:18.617 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDkRLFkGh/BChAA5p9amLIC6ORC0JJov0bSVg== 2023-07-14T12:52:18.618 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.4] 2023-07-14T12:52:18.618 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQD1RLFkMNyyDxAA19dJkhhuSpcgVPQEyxb3lg== 2023-07-14T12:52:18.618 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.5] 2023-07-14T12:52:18.618 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQD4RLFkR8mTFhAAP5qUgUJI23XOvVAnNCSgRQ== 2023-07-14T12:52:18.618 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.6] 2023-07-14T12:52:18.618 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQD7RLFkpWL9HBAAo8MfszRnB4sHsDPPcRjCAg== 2023-07-14T12:52:18.618 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.7] 2023-07-14T12:52:18.619 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQD+RLFkL5cRIxAAF/4ndtYf0oiH3uhhDKnQQg== 2023-07-14T12:52:18.619 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-07-14T12:52:18.619 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDkRLFkCav/DhAA6SOiONAbTcWCnUZXcm7BcQ== 2023-07-14T12:52:18.619 INFO:teuthology.orchestra.run.smithi005.stdout:[client.2] 2023-07-14T12:52:18.619 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDkRLFkeBs4FRAAJ/UjIEKDajVyDb7PejPqAw== 2023-07-14T12:52:18.619 INFO:teuthology.orchestra.run.smithi005.stdout:[client.1] 2023-07-14T12:52:18.619 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDkRLFkgS/hGBAAevMD2/lfNuaeV74w0Xj0Zw== 2023-07-14T12:52:18.619 INFO:teuthology.orchestra.run.smithi005.stdout:[client.3] 2023-07-14T12:52:18.620 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDkRLFkSkDiHhAAV86wIrAVz3o/PI2CaBC44w== 2023-07-14T12:52:18.629 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.y] 2023-07-14T12:52:18.629 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDjRLFkSvp/KRAAwvjYlrZYNeGbhCiDrTmnrA== 2023-07-14T12:52:18.630 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2023-07-14T12:52:18.630 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDjRLFkGNTsMRAA5T/zjdynxEKmoNAAK0cChw== 2023-07-14T12:52:18.630 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.c] 2023-07-14T12:52:18.630 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDjRLFk6NGUORAA+5odxrAlCCXYGc64nzFWwQ== 2023-07-14T12:52:18.630 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.0] 2023-07-14T12:52:18.630 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDlRLFkJ6MULhAAxExAqekc/gWudYBJ2sY4MQ== 2023-07-14T12:52:18.630 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.1] 2023-07-14T12:52:18.631 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDoRLFksXGBNRAAFtHZt5OQw0aB6k3CkxOzZQ== 2023-07-14T12:52:18.631 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.2] 2023-07-14T12:52:18.631 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDsRLFkaUH0ARAAkqgsKPX1dTSZQjn0cRxxRQ== 2023-07-14T12:52:18.631 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.3] 2023-07-14T12:52:18.631 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDvRLFkvElJCRAAnox5LKwobP/1Qaf5d9UsjA== 2023-07-14T12:52:18.631 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.x] 2023-07-14T12:52:18.631 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDjRLFkugeXLRAAEVAnLk/dldtqrpkdzQI3SA== 2023-07-14T12:52:18.631 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.b] 2023-07-14T12:52:18.632 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDkRLFkqXNAAxAAb7bzXyE8cSS0A3Rz2de6TA== 2023-07-14T12:52:18.632 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.d] 2023-07-14T12:52:18.632 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDkRLFkGh/BChAA5p9amLIC6ORC0JJov0bSVg== 2023-07-14T12:52:18.632 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.4] 2023-07-14T12:52:18.632 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQD1RLFkMNyyDxAA19dJkhhuSpcgVPQEyxb3lg== 2023-07-14T12:52:18.632 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.5] 2023-07-14T12:52:18.632 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQD4RLFkR8mTFhAAP5qUgUJI23XOvVAnNCSgRQ== 2023-07-14T12:52:18.633 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.6] 2023-07-14T12:52:18.633 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQD7RLFkpWL9HBAAo8MfszRnB4sHsDPPcRjCAg== 2023-07-14T12:52:18.633 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.7] 2023-07-14T12:52:18.633 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQD+RLFkL5cRIxAAF/4ndtYf0oiH3uhhDKnQQg== 2023-07-14T12:52:18.633 INFO:teuthology.orchestra.run.smithi154.stdout:[client.0] 2023-07-14T12:52:18.633 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDkRLFkCav/DhAA6SOiONAbTcWCnUZXcm7BcQ== 2023-07-14T12:52:18.633 INFO:teuthology.orchestra.run.smithi154.stdout:[client.2] 2023-07-14T12:52:18.633 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDkRLFkeBs4FRAAJ/UjIEKDajVyDb7PejPqAw== 2023-07-14T12:52:18.634 INFO:teuthology.orchestra.run.smithi154.stdout:[client.1] 2023-07-14T12:52:18.634 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDkRLFkgS/hGBAAevMD2/lfNuaeV74w0Xj0Zw== 2023-07-14T12:52:18.634 INFO:teuthology.orchestra.run.smithi154.stdout:[client.3] 2023-07-14T12:52:18.634 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDkRLFkSkDiHhAAV86wIrAVz3o/PI2CaBC44w== 2023-07-14T12:52:18.635 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-14T12:52:18.672 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-14T12:52:18.731 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-14T12:52:18.735 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-14T12:52:18.793 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-14T12:52:18.797 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-14T12:52:18.855 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T12:52:18.859 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T12:52:18.914 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T12:52:18.918 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T12:52:18.973 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T12:52:18.977 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T12:52:19.031 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T12:52:19.035 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T12:52:19.090 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-14T12:52:19.095 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-14T12:52:19.151 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-14T12:52:19.154 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-14T12:52:19.212 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-14T12:52:19.216 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-14T12:52:19.274 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T12:52:19.278 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T12:52:19.334 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T12:52:19.337 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T12:52:19.392 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T12:52:19.395 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T12:52:19.450 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T12:52:19.454 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-14T12:52:19.509 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-14T12:52:19.512 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-14T12:52:19.570 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-14T12:52:19.574 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-14T12:52:19.633 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-14T12:52:19.636 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-14T12:52:19.694 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-14T12:52:19.698 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-14T12:52:19.755 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-14T12:52:19.755 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-14T12:52:19.776 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-14T12:52:19.889 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-14T12:52:19.911 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-14T12:52:19.932 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-14T12:52:20.047 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-14T12:52:20.068 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-14T12:52:20.131 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-14T12:52:20.242 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-14T12:52:20.263 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-14T12:52:20.266 DEBUG:teuthology.orchestra.run.smithi154:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-14T12:52:20.310 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-14T12:52:20.311 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-14T12:52:20.311 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-14T12:52:20.319 INFO:tasks.ceph.mon.a:Started 2023-07-14T12:52:20.319 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-14T12:52:20.320 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-14T12:52:20.358 INFO:tasks.ceph.mon.b:Started 2023-07-14T12:52:20.358 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-14T12:52:20.358 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-14T12:52:20.361 INFO:tasks.ceph.mon.c:Started 2023-07-14T12:52:20.362 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-14T12:52:20.362 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-14T12:52:20.362 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-14T12:52:20.366 INFO:tasks.ceph.mgr.y:Started 2023-07-14T12:52:20.366 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-14T12:52:20.366 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-14T12:52:20.369 INFO:tasks.ceph.mgr.x:Started 2023-07-14T12:52:20.369 INFO:tasks.ceph:Setting crush tunables to default 2023-07-14T12:52:20.370 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd crush tunables default 2023-07-14T12:52:20.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.487+0000 7ffbc41d2640 1 Processor -- start 2023-07-14T12:52:20.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.491+0000 7ffbc41d2640 1 -- start start 2023-07-14T12:52:20.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.491+0000 7ffbc41d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffbbc06a540 0x7ffbbc0cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:20.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.491+0000 7ffbc41d2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffbbc1601f0 0x7ffbbc0cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:20.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.491+0000 7ffbc41d2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbbc0ccf50 con 0x7ffbbc06a910 2023-07-14T12:52:20.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.491+0000 7ffbc41d2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbbc0cd1f0 con 0x7ffbbc1601f0 2023-07-14T12:52:20.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.491+0000 7ffbc41d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc0cd4d0 con 0x7ffbbc06a540 2023-07-14T12:52:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.491+0000 7ffbc176d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffbbc1601f0 0x7ffbbc0cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.491+0000 7ffbc176d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffbbc1601f0 0x7ffbbc0cca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50650/0 (socket says 172.21.15.5:50650) 2023-07-14T12:52:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.491+0000 7ffbc176d640 1 -- 172.21.15.5:0/2509800834 learned_addr learned my addr 172.21.15.5:0/2509800834 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.491+0000 7ffbc1f6e640 1 --2- 172.21.15.5:0/2509800834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffbbc06a540 0x7ffbbc0cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.491+0000 7ffbc176d640 1 -- 172.21.15.5:0/2509800834 >> v2:172.21.15.5:3300/0 conn(0x7ffbbc1601f0 msgr2=0x7ffbbc0cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-14T12:52:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.491+0000 7ffbc176d640 1 -- 172.21.15.5:0/2509800834 >> v2:172.21.15.5:3300/0 conn(0x7ffbbc1601f0 msgr2=0x7ffbbc0cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-14T12:52:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.491+0000 7ffbc176d640 1 --2- 172.21.15.5:0/2509800834 >> v2:172.21.15.5:3300/0 conn(0x7ffbbc1601f0 0x7ffbbc0cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-14T12:52:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.491+0000 7ffbc176d640 1 --2- 172.21.15.5:0/2509800834 >> v2:172.21.15.5:3300/0 conn(0x7ffbbc1601f0 0x7ffbbc0cca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T12:52:20.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.491+0000 7ffbc1f6e640 1 -- 172.21.15.5:0/2509800834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffbbc06a540 msgr2=0x7ffbbc0cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-14T12:52:20.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.491+0000 7ffbc1f6e640 1 -- 172.21.15.5:0/2509800834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffbbc06a540 msgr2=0x7ffbbc0cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-14T12:52:20.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.491+0000 7ffbc1f6e640 1 --2- 172.21.15.5:0/2509800834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffbbc06a540 0x7ffbbc0cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-14T12:52:20.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.491+0000 7ffbc1f6e640 1 --2- 172.21.15.5:0/2509800834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffbbc06a540 0x7ffbbc0cdcd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T12:52:20.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.687+0000 7ffbc0f6c640 1 -- 172.21.15.5:0/2509800834 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2147299098 0 0) 0x7ffbbc0ccf50 con 0x7ffbbc06a910 2023-07-14T12:52:20.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.687+0000 7ffbc0f6c640 1 -- 172.21.15.5:0/2509800834 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffba8003530 con 0x7ffbbc06a910 2023-07-14T12:52:20.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.691+0000 7ffbc0f6c640 1 -- 172.21.15.5:0/2509800834 <== mon.1 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 979909719 0 0) 0x7ffba8003530 con 0x7ffbbc06a910 2023-07-14T12:52:20.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.691+0000 7ffbc0f6c640 1 -- 172.21.15.5:0/2509800834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffbbc06a540 msgr2=0x7ffbbc0cdcd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T12:52:20.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.691+0000 7ffbc0f6c640 1 --2- 172.21.15.5:0/2509800834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffbbc06a540 0x7ffbbc0cdcd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:20.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.691+0000 7ffbc0f6c640 1 -- 172.21.15.5:0/2509800834 >> v2:172.21.15.5:3300/0 conn(0x7ffbbc1601f0 msgr2=0x7ffbbc0cca10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T12:52:20.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.691+0000 7ffbc0f6c640 1 --2- 172.21.15.5:0/2509800834 >> v2:172.21.15.5:3300/0 conn(0x7ffbbc1601f0 0x7ffbbc0cca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:20.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.691+0000 7ffbc0f6c640 1 -- 172.21.15.5:0/2509800834 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbbc0cd7b0 con 0x7ffbbc06a910 2023-07-14T12:52:20.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.691+0000 7ffbc0f6c640 1 -- 172.21.15.5:0/2509800834 <== mon.1 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7ffbb4001a00 con 0x7ffbbc06a910 2023-07-14T12:52:20.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.691+0000 7ffbc0f6c640 1 -- 172.21.15.5:0/2509800834 >> v1:172.21.15.154:6789/0 conn(0x7ffbbc06a910 legacy=0x7ffbbc0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:20.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.691+0000 7ffbc0f6c640 1 --2- 172.21.15.5:0/2509800834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffbbc06a540 0x7ffba8003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:20.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.691+0000 7ffbc0f6c640 1 --2- 172.21.15.5:0/2509800834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffba8004000 0x7ffba80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:20.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.691+0000 7ffbc0f6c640 1 --2- 172.21.15.5:0/2509800834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffba8004d10 0x7ffba8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:20.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.691+0000 7ffbc0f6c640 1 -- 172.21.15.5:0/2509800834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc0cd1f0 con 0x7ffba8004000 2023-07-14T12:52:20.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.691+0000 7ffbc0f6c640 1 -- 172.21.15.5:0/2509800834 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc0cd4d0 con 0x7ffba8004d10 2023-07-14T12:52:20.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.691+0000 7ffbc0f6c640 1 -- 172.21.15.5:0/2509800834 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba800bb70 con 0x7ffbbc06a540 2023-07-14T12:52:20.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.691+0000 7ffbc1f6e640 1 --2- 172.21.15.5:0/2509800834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffbbc06a540 0x7ffba8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:20.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.691+0000 7ffbc176d640 1 --2- 172.21.15.5:0/2509800834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffba8004000 0x7ffba80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:20.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.691+0000 7ffbc276f640 1 --2- 172.21.15.5:0/2509800834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffba8004d10 0x7ffba8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:20.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.691+0000 7ffbc176d640 1 -- 172.21.15.5:0/2509800834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffbbc06a540 msgr2=0x7ffba8003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:20.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.691+0000 7ffbc176d640 1 --2- 172.21.15.5:0/2509800834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffbbc06a540 0x7ffba8003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:20.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.691+0000 7ffbc176d640 1 -- 172.21.15.5:0/2509800834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffba8004d10 msgr2=0x7ffba8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:20.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.691+0000 7ffbc176d640 1 --2- 172.21.15.5:0/2509800834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffba8004d10 0x7ffba8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:20.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.691+0000 7ffbc176d640 1 -- 172.21.15.5:0/2509800834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba8003530 con 0x7ffba8004000 2023-07-14T12:52:20.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.691+0000 7ffbc1f6e640 1 --2- 172.21.15.5:0/2509800834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffbbc06a540 0x7ffba8003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:52:20.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.695+0000 7ffbc176d640 1 --2- 172.21.15.5:0/2509800834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffba8004000 0x7ffba80047d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ffbac009100 tx=0x7ffbac01c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a580116660430e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:20.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.695+0000 7ffbc0f6c640 1 -- 172.21.15.5:0/2509800834 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac0aa640 con 0x7ffba8004000 2023-07-14T12:52:20.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.695+0000 7ffbc0f6c640 1 -- 172.21.15.5:0/2509800834 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbac0aa7c0 con 0x7ffba8004000 2023-07-14T12:52:20.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.695+0000 7ffbc0f6c640 1 -- 172.21.15.5:0/2509800834 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac0aab70 con 0x7ffba8004000 2023-07-14T12:52:20.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.699+0000 7ffbc41d2640 1 -- 172.21.15.5:0/2509800834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffba8004000 msgr2=0x7ffba80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:20.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.699+0000 7ffbc41d2640 1 --2- 172.21.15.5:0/2509800834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffba8004000 0x7ffba80047d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ffbac009100 tx=0x7ffbac01c5a0 comp rx=0 tx=0).stop 2023-07-14T12:52:20.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.699+0000 7ffbc276f640 1 -- 172.21.15.5:0/2509800834 reap_dead start 2023-07-14T12:52:20.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.699+0000 7ffbc41d2640 1 -- 172.21.15.5:0/2509800834 shutdown_connections 2023-07-14T12:52:20.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.699+0000 7ffbc41d2640 1 -- 172.21.15.5:0/2509800834 >> 172.21.15.5:0/2509800834 conn(0x7ffbbc099490 msgr2=0x7ffbbc089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:20.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.699+0000 7ffbc41d2640 1 -- 172.21.15.5:0/2509800834 shutdown_connections 2023-07-14T12:52:20.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.699+0000 7ffbc41d2640 1 -- 172.21.15.5:0/2509800834 wait complete. 2023-07-14T12:52:20.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.699+0000 7ffbc41d2640 1 Processor -- start 2023-07-14T12:52:20.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.699+0000 7ffbc41d2640 1 -- start start 2023-07-14T12:52:20.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.699+0000 7ffbc41d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffba8004000 0x7ffbbc1629c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:20.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.699+0000 7ffbc41d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbbc0c50f0 0x7ffbbc0c6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:20.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.699+0000 7ffbc41d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffbbc0cca70 0x7ffbbc0b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:20.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.699+0000 7ffbc41d2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc15af80 con 0x7ffbbc0c50f0 2023-07-14T12:52:20.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.699+0000 7ffbc41d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc15d7c0 con 0x7ffba8004000 2023-07-14T12:52:20.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.699+0000 7ffbc41d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc0c5890 con 0x7ffbbc0cca70 2023-07-14T12:52:20.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.699+0000 7ffbc176d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbbc0c50f0 0x7ffbbc0c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:20.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.699+0000 7ffbc1f6e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffba8004000 0x7ffbbc1629c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:20.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.699+0000 7ffbc176d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbbc0c50f0 0x7ffbbc0c6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50690/0 (socket says 172.21.15.5:50690) 2023-07-14T12:52:20.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.699+0000 7ffbc176d640 1 -- 172.21.15.5:0/1043361965 learned_addr learned my addr 172.21.15.5:0/1043361965 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:20.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.699+0000 7ffbc276f640 1 --2- 172.21.15.5:0/1043361965 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffbbc0cca70 0x7ffbbc0b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:20.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.699+0000 7ffbc176d640 1 -- 172.21.15.5:0/1043361965 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffbbc0cca70 msgr2=0x7ffbbc0b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:20.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.699+0000 7ffbc176d640 1 --2- 172.21.15.5:0/1043361965 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffbbc0cca70 0x7ffbbc0b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:20.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.699+0000 7ffbc176d640 1 -- 172.21.15.5:0/1043361965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffba8004000 msgr2=0x7ffbbc1629c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:20.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.699+0000 7ffbc176d640 1 --2- 172.21.15.5:0/1043361965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffba8004000 0x7ffbbc1629c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:20.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.699+0000 7ffbc176d640 1 -- 172.21.15.5:0/1043361965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbbc0c55b0 con 0x7ffbbc0c50f0 2023-07-14T12:52:20.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.703+0000 7ffbc176d640 1 --2- 172.21.15.5:0/1043361965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbbc0c50f0 0x7ffbbc0c6460 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ffbac001ec0 tx=0x7ffba8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:20.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.703+0000 7ffbb27fc640 1 -- 172.21.15.5:0/1043361965 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac0aa440 con 0x7ffbbc0c50f0 2023-07-14T12:52:20.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.703+0000 7ffbb27fc640 1 -- 172.21.15.5:0/1043361965 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbac0aa5a0 con 0x7ffbbc0c50f0 2023-07-14T12:52:20.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.703+0000 7ffbb27fc640 1 -- 172.21.15.5:0/1043361965 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac0aad70 con 0x7ffbbc0c50f0 2023-07-14T12:52:20.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.703+0000 7ffbc41d2640 1 -- 172.21.15.5:0/1043361965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbbc15d170 con 0x7ffbbc0c50f0 2023-07-14T12:52:20.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.703+0000 7ffbc41d2640 1 -- 172.21.15.5:0/1043361965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbbc0c69a0 con 0x7ffbbc0c50f0 2023-07-14T12:52:20.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.703+0000 7ffbb27fc640 1 -- 172.21.15.5:0/1043361965 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ffbac0a8050 con 0x7ffbbc0c50f0 2023-07-14T12:52:20.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.703+0000 7ffbb27fc640 1 -- 172.21.15.5:0/1043361965 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ffbac0c53f0 con 0x7ffbbc0c50f0 2023-07-14T12:52:20.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.703+0000 7ffbc41d2640 1 -- 172.21.15.5:0/1043361965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbbc15d930 con 0x7ffbbc0c50f0 2023-07-14T12:52:20.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.715+0000 7ffbb27fc640 1 -- 172.21.15.5:0/1043361965 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7ffbac0c1070 con 0x7ffbbc0c50f0 2023-07-14T12:52:20.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.775+0000 7ffbc41d2640 1 -- 172.21.15.5:0/1043361965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ffbbc0678d0 con 0x7ffbbc0c50f0 2023-07-14T12:52:20.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.779+0000 7ffbb27fc640 1 -- 172.21.15.5:0/1043361965 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ffbac00f040 con 0x7ffbbc0c50f0 2023-07-14T12:52:20.804 INFO:teuthology.orchestra.run.smithi005.stderr:adjusted tunables profile to default 2023-07-14T12:52:20.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.783+0000 7ffbc41d2640 1 -- 172.21.15.5:0/1043361965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbbc0c50f0 msgr2=0x7ffbbc0c6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:20.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.783+0000 7ffbc41d2640 1 --2- 172.21.15.5:0/1043361965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbbc0c50f0 0x7ffbbc0c6460 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ffbac001ec0 tx=0x7ffba8005800 comp rx=0 tx=0).stop 2023-07-14T12:52:20.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.783+0000 7ffbc41d2640 1 -- 172.21.15.5:0/1043361965 shutdown_connections 2023-07-14T12:52:20.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.783+0000 7ffbc41d2640 1 --2- 172.21.15.5:0/1043361965 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffbbc0cca70 0x7ffbbc0b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:20.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.783+0000 7ffbc41d2640 1 --2- 172.21.15.5:0/1043361965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbbc0c50f0 0x7ffbbc0c6460 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:20.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.783+0000 7ffbc41d2640 1 --2- 172.21.15.5:0/1043361965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffba8004000 0x7ffbbc1629c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:20.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.783+0000 7ffbc41d2640 1 -- 172.21.15.5:0/1043361965 >> 172.21.15.5:0/1043361965 conn(0x7ffbbc099490 msgr2=0x7ffbbc0ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:20.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.783+0000 7ffbc41d2640 1 -- 172.21.15.5:0/1043361965 shutdown_connections 2023-07-14T12:52:20.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:20.783+0000 7ffbc41d2640 1 -- 172.21.15.5:0/1043361965 wait complete. 2023-07-14T12:52:20.824 INFO:tasks.ceph:check_enable_crimson: False 2023-07-14T12:52:20.825 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-14T12:52:20.825 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:52:20.825 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-14T12:52:20.846 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:52:20.846 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-14T12:52:20.909 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:52:20.909 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-14T12:52:20.910 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:52:20.884+0000 7fef1704a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T12:52:20.936 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:52:20.911+0000 7fa77d2d9180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T12:52:20.957 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:52:20.957 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-14T12:52:21.025 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:52:21.026 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-14T12:52:21.047 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:52:21.047 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-14T12:52:21.107 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:52:21.108 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-14T12:52:21.171 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:52:21.172 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-14T12:52:21.235 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 0b5d4170-8039-4c70-a6c2-84b9adc130d6 0 2023-07-14T12:52:21.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.388+0000 7f6155ffa640 1 Processor -- start 2023-07-14T12:52:21.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.388+0000 7f6155ffa640 1 -- start start 2023-07-14T12:52:21.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.392+0000 7f6155ffa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61500d06b0 0x7f61500b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:21.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.392+0000 7f6155ffa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6150145430 0x7f61500b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:21.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.392+0000 7f6155ffa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61500b2410 con 0x7f61500b1f70 2023-07-14T12:52:21.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.392+0000 7f6155ffa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61500b26f0 con 0x7f6150145430 2023-07-14T12:52:21.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.392+0000 7f6155ffa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61500b29d0 con 0x7f61500d06b0 2023-07-14T12:52:21.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.392+0000 7f614f7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61500d06b0 0x7f61500b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:21.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.392+0000 7f614f7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61500d06b0 0x7f61500b1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34432/0 (socket says 172.21.15.154:34432) 2023-07-14T12:52:21.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.392+0000 7f614f7fe640 1 -- 172.21.15.154:0/2675731934 learned_addr learned my addr 172.21.15.154:0/2675731934 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-07-14T12:52:21.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.392+0000 7f614ffff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f61500b1f70 0x7f61500d22e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:58348/0 (socket says 172.21.15.154:58348) 2023-07-14T12:52:21.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.392+0000 7f614effd640 1 --2- 172.21.15.154:0/2675731934 >> v2:172.21.15.5:3300/0 conn(0x7f6150145430 0x7f61500b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:21.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.392+0000 7f614f7fe640 1 -- 172.21.15.154:0/2675731934 >> v2:172.21.15.5:3300/0 conn(0x7f6150145430 msgr2=0x7f61500b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:21.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.392+0000 7f614f7fe640 1 --2- 172.21.15.154:0/2675731934 >> v2:172.21.15.5:3300/0 conn(0x7f6150145430 0x7f61500b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:21.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.392+0000 7f614f7fe640 1 -- 172.21.15.154:0/2675731934 >> v1:172.21.15.154:6789/0 conn(0x7f61500b1f70 legacy=0x7f61500d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:21.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.392+0000 7f614f7fe640 1 -- 172.21.15.154:0/2675731934 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61500b2cb0 con 0x7f61500d06b0 2023-07-14T12:52:21.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.392+0000 7f614e7fc640 1 -- 172.21.15.154:0/2675731934 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135753327 0 0) 0x7f61500b2410 con 0x7f61500b1f70 2023-07-14T12:52:21.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.396+0000 7f614f7fe640 1 --2- 172.21.15.154:0/2675731934 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61500d06b0 0x7f61500b1a30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6140009870 tx=0x7f614001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f51bdb421b5fe85 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:21.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.396+0000 7f614e7fc640 1 -- 172.21.15.154:0/2675731934 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61400a95f0 con 0x7f61500d06b0 2023-07-14T12:52:21.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.396+0000 7f614e7fc640 1 -- 172.21.15.154:0/2675731934 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61400a9750 con 0x7f61500d06b0 2023-07-14T12:52:21.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.396+0000 7f614e7fc640 1 -- 172.21.15.154:0/2675731934 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61400a9ae0 con 0x7f61500d06b0 2023-07-14T12:52:21.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.396+0000 7f6155ffa640 1 -- 172.21.15.154:0/2675731934 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61500d06b0 msgr2=0x7f61500b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:21.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.396+0000 7f6155ffa640 1 --2- 172.21.15.154:0/2675731934 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61500d06b0 0x7f61500b1a30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6140009870 tx=0x7f614001c510 comp rx=0 tx=0).stop 2023-07-14T12:52:21.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.396+0000 7f6155ffa640 1 -- 172.21.15.154:0/2675731934 shutdown_connections 2023-07-14T12:52:21.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.396+0000 7f6155ffa640 1 --2- 172.21.15.154:0/2675731934 >> v2:172.21.15.5:3300/0 conn(0x7f6150145430 0x7f61500b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:21.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.396+0000 7f6155ffa640 1 --2- 172.21.15.154:0/2675731934 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61500d06b0 0x7f61500b1a30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:21.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.396+0000 7f6155ffa640 1 -- 172.21.15.154:0/2675731934 >> 172.21.15.154:0/2675731934 conn(0x7f61500659d0 msgr2=0x7f615009b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:21.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.396+0000 7f6155ffa640 1 -- 172.21.15.154:0/2675731934 shutdown_connections 2023-07-14T12:52:21.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.396+0000 7f6155ffa640 1 -- 172.21.15.154:0/2675731934 wait complete. 2023-07-14T12:52:21.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.396+0000 7f6155ffa640 1 Processor -- start 2023-07-14T12:52:21.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.400+0000 7f6155ffa640 1 -- start start 2023-07-14T12:52:21.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.400+0000 7f6155ffa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61500b1f70 0x7f61500c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:21.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.400+0000 7f6155ffa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61500d06b0 0x7f615015d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:21.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.400+0000 7f6155ffa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f615015d9e0 0x7f61501569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:21.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.400+0000 7f6155ffa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615015e500 con 0x7f61500b1f70 2023-07-14T12:52:21.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.400+0000 7f6155ffa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61500cce70 con 0x7f61500d06b0 2023-07-14T12:52:21.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.400+0000 7f6155ffa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615015df40 con 0x7f615015d9e0 2023-07-14T12:52:21.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.400+0000 7f614effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61500d06b0 0x7f615015d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:21.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.400+0000 7f614ffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f615015d9e0 0x7f61501569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:21.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.400+0000 7f614effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61500d06b0 0x7f615015d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52588/0 (socket says 172.21.15.154:52588) 2023-07-14T12:52:21.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.400+0000 7f614effd640 1 -- 172.21.15.154:0/1784115288 learned_addr learned my addr 172.21.15.154:0/1784115288 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-07-14T12:52:21.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.400+0000 7f614f7fe640 1 --2- 172.21.15.154:0/1784115288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61500b1f70 0x7f61500c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:21.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.400+0000 7f614effd640 1 -- 172.21.15.154:0/1784115288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f615015d9e0 msgr2=0x7f61501569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:21.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.400+0000 7f614effd640 1 --2- 172.21.15.154:0/1784115288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f615015d9e0 0x7f61501569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:21.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.400+0000 7f614effd640 1 -- 172.21.15.154:0/1784115288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61500b1f70 msgr2=0x7f61500c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:21.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.400+0000 7f614effd640 1 --2- 172.21.15.154:0/1784115288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61500b1f70 0x7f61500c5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:21.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.400+0000 7f614effd640 1 -- 172.21.15.154:0/1784115288 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61400094d0 con 0x7f61500d06b0 2023-07-14T12:52:21.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.400+0000 7f614ffff640 1 --2- 172.21.15.154:0/1784115288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f615015d9e0 0x7f61501569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:52:21.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.400+0000 7f614effd640 1 --2- 172.21.15.154:0/1784115288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61500d06b0 0x7f615015d4a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f614400d800 tx=0x7f614400dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:21.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.400+0000 7f6137fff640 1 -- 172.21.15.154:0/1784115288 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614400b6c0 con 0x7f61500d06b0 2023-07-14T12:52:21.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.400+0000 7f6137fff640 1 -- 172.21.15.154:0/1784115288 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614400b820 con 0x7f61500d06b0 2023-07-14T12:52:21.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.400+0000 7f6137fff640 1 -- 172.21.15.154:0/1784115288 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614400bb90 con 0x7f61500d06b0 2023-07-14T12:52:21.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.400+0000 7f6155ffa640 1 -- 172.21.15.154:0/1784115288 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615015e220 con 0x7f61500d06b0 2023-07-14T12:52:21.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.400+0000 7f6155ffa640 1 -- 172.21.15.154:0/1784115288 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61500cf9a0 con 0x7f61500d06b0 2023-07-14T12:52:21.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.400+0000 7f6137fff640 1 -- 172.21.15.154:0/1784115288 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f614401e460 con 0x7f61500d06b0 2023-07-14T12:52:21.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.400+0000 7f6137fff640 1 -- 172.21.15.154:0/1784115288 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f61440146e0 con 0x7f61500d06b0 2023-07-14T12:52:21.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.400+0000 7f6155ffa640 1 -- 172.21.15.154:0/1784115288 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6150072e70 con 0x7f61500d06b0 2023-07-14T12:52:21.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.420+0000 7f6137fff640 1 -- 172.21.15.154:0/1784115288 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f61440148a0 con 0x7f61500d06b0 2023-07-14T12:52:21.454 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:52:21.428+0000 7fef1704a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T12:52:21.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.484+0000 7f6155ffa640 1 -- 172.21.15.154:0/1784115288 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0b5d4170-8039-4c70-a6c2-84b9adc130d6", "id": 0} v 0) v1 -- 0x7f61500cc930 con 0x7f61500d06b0 2023-07-14T12:52:21.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.492+0000 7f6137fff640 1 -- 172.21.15.154:0/1784115288 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0b5d4170-8039-4c70-a6c2-84b9adc130d6", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6144014b10 con 0x7f61500d06b0 2023-07-14T12:52:21.518 INFO:teuthology.orchestra.run.smithi154.stdout:0 2023-07-14T12:52:21.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.492+0000 7f6155ffa640 1 -- 172.21.15.154:0/1784115288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61500d06b0 msgr2=0x7f615015d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:21.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.492+0000 7f6155ffa640 1 --2- 172.21.15.154:0/1784115288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61500d06b0 0x7f615015d4a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f614400d800 tx=0x7f614400dcc0 comp rx=0 tx=0).stop 2023-07-14T12:52:21.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.492+0000 7f6155ffa640 1 -- 172.21.15.154:0/1784115288 shutdown_connections 2023-07-14T12:52:21.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.492+0000 7f6155ffa640 1 --2- 172.21.15.154:0/1784115288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f615015d9e0 0x7f61501569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:21.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.492+0000 7f6155ffa640 1 --2- 172.21.15.154:0/1784115288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61500d06b0 0x7f615015d4a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:21.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.492+0000 7f6155ffa640 1 --2- 172.21.15.154:0/1784115288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61500b1f70 0x7f61500c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:21.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.492+0000 7f6155ffa640 1 -- 172.21.15.154:0/1784115288 >> 172.21.15.154:0/1784115288 conn(0x7f61500659d0 msgr2=0x7f61500afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:21.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.492+0000 7f6155ffa640 1 -- 172.21.15.154:0/1784115288 shutdown_connections 2023-07-14T12:52:21.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.492+0000 7f6155ffa640 1 -- 172.21.15.154:0/1784115288 wait complete. 2023-07-14T12:52:21.538 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 24f9a129-8121-4ae9-b0a2-db55951b75d9 1 2023-07-14T12:52:21.638 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:52:21.615+0000 7fa77d2d9180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T12:52:21.666 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:52:21.640+0000 7fef1704a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T12:52:21.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.648+0000 7f61ff311640 1 Processor -- start 2023-07-14T12:52:21.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.648+0000 7f61ff311640 1 -- start start 2023-07-14T12:52:21.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.652+0000 7f61ff311640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61f80d06b0 0x7f61f80b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:21.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.652+0000 7f61ff311640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f61f80b1f70 0x7f61f80d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:21.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.652+0000 7f61ff311640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f80b2410 con 0x7f61f8145430 2023-07-14T12:52:21.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.652+0000 7f61ff311640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f80b26f0 con 0x7f61f80b1f70 2023-07-14T12:52:21.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.652+0000 7f61ff311640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f80b29d0 con 0x7f61f80d06b0 2023-07-14T12:52:21.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.652+0000 7f61fd0ad640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61f80d06b0 0x7f61f80b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:21.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.652+0000 7f61fd0ad640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61f80d06b0 0x7f61f80b1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52596/0 (socket says 172.21.15.154:52596) 2023-07-14T12:52:21.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.652+0000 7f61fd0ad640 1 -- 172.21.15.154:0/2963296342 learned_addr learned my addr 172.21.15.154:0/2963296342 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-07-14T12:52:21.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.652+0000 7f61fd8ae640 1 --2- 172.21.15.154:0/2963296342 >> v2:172.21.15.5:3300/0 conn(0x7f61f80b1f70 0x7f61f80d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:21.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.652+0000 7f61fd0ad640 1 -- 172.21.15.154:0/2963296342 >> v2:172.21.15.5:3300/0 conn(0x7f61f80b1f70 msgr2=0x7f61f80d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:21.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.652+0000 7f61fd0ad640 1 --2- 172.21.15.154:0/2963296342 >> v2:172.21.15.5:3300/0 conn(0x7f61f80b1f70 0x7f61f80d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:21.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.652+0000 7f61fd0ad640 1 -- 172.21.15.154:0/2963296342 >> v1:172.21.15.154:6789/0 conn(0x7f61f8145430 legacy=0x7f61f80b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:21.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.652+0000 7f61fd0ad640 1 -- 172.21.15.154:0/2963296342 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f80b2cb0 con 0x7f61f80d06b0 2023-07-14T12:52:21.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.652+0000 7f61effff640 1 -- 172.21.15.154:0/2963296342 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3547867648 0 0) 0x7f61f80b2410 con 0x7f61f8145430 2023-07-14T12:52:21.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.656+0000 7f61fd0ad640 1 --2- 172.21.15.154:0/2963296342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61f80d06b0 0x7f61f80b1a30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f61f808b420 tx=0x7f61f401c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eacf113455ac99ab server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:21.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.656+0000 7f61effff640 1 -- 172.21.15.154:0/2963296342 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f40ac640 con 0x7f61f80d06b0 2023-07-14T12:52:21.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.656+0000 7f61effff640 1 -- 172.21.15.154:0/2963296342 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f40ac7a0 con 0x7f61f80d06b0 2023-07-14T12:52:21.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.656+0000 7f61effff640 1 -- 172.21.15.154:0/2963296342 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f40acb30 con 0x7f61f80d06b0 2023-07-14T12:52:21.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.656+0000 7f61ff311640 1 -- 172.21.15.154:0/2963296342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61f80d06b0 msgr2=0x7f61f80b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:21.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.656+0000 7f61ff311640 1 --2- 172.21.15.154:0/2963296342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61f80d06b0 0x7f61f80b1a30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f61f808b420 tx=0x7f61f401c4d0 comp rx=0 tx=0).stop 2023-07-14T12:52:21.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.656+0000 7f61ff311640 1 -- 172.21.15.154:0/2963296342 shutdown_connections 2023-07-14T12:52:21.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.656+0000 7f61ff311640 1 --2- 172.21.15.154:0/2963296342 >> v2:172.21.15.5:3300/0 conn(0x7f61f80b1f70 0x7f61f80d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:21.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.656+0000 7f61ff311640 1 --2- 172.21.15.154:0/2963296342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61f80d06b0 0x7f61f80b1a30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:21.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.656+0000 7f61ff311640 1 -- 172.21.15.154:0/2963296342 >> 172.21.15.154:0/2963296342 conn(0x7f61f80659d0 msgr2=0x7f61f809b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:21.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.656+0000 7f61ff311640 1 -- 172.21.15.154:0/2963296342 shutdown_connections 2023-07-14T12:52:21.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.656+0000 7f61ff311640 1 -- 172.21.15.154:0/2963296342 wait complete. 2023-07-14T12:52:21.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.656+0000 7f61ff311640 1 Processor -- start 2023-07-14T12:52:21.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.656+0000 7f61ff311640 1 -- start start 2023-07-14T12:52:21.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.660+0000 7f61ff311640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61f80b1f70 0x7f61f8155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:21.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.660+0000 7f61ff311640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61f80d06b0 0x7f61f80b71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:21.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.660+0000 7f61ff311640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61f80b5180 0x7f61f8160230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:21.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.660+0000 7f61ff311640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f815dcb0 con 0x7f61f80b5180 2023-07-14T12:52:21.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.660+0000 7f61ff311640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f80b7730 con 0x7f61f80b1f70 2023-07-14T12:52:21.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.660+0000 7f61ff311640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f80b7f20 con 0x7f61f80d06b0 2023-07-14T12:52:21.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.660+0000 7f61fc8ac640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61f80d06b0 0x7f61f80b71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:21.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.660+0000 7f61fd0ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61f80b1f70 0x7f61f8155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:21.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.660+0000 7f61fd0ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61f80b1f70 0x7f61f8155a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52604/0 (socket says 172.21.15.154:52604) 2023-07-14T12:52:21.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.660+0000 7f61fd0ad640 1 -- 172.21.15.154:0/3359358439 learned_addr learned my addr 172.21.15.154:0/3359358439 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-07-14T12:52:21.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.660+0000 7f61fd8ae640 1 --2- 172.21.15.154:0/3359358439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61f80b5180 0x7f61f8160230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:21.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.660+0000 7f61fc8ac640 1 -- 172.21.15.154:0/3359358439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61f80b1f70 msgr2=0x7f61f8155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:21.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.660+0000 7f61fc8ac640 1 --2- 172.21.15.154:0/3359358439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61f80b1f70 0x7f61f8155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:21.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.660+0000 7f61fc8ac640 1 -- 172.21.15.154:0/3359358439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61f80b5180 msgr2=0x7f61f8160230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:21.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.660+0000 7f61fc8ac640 1 --2- 172.21.15.154:0/3359358439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61f80b5180 0x7f61f8160230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:21.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.660+0000 7f61fc8ac640 1 -- 172.21.15.154:0/3359358439 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f40094d0 con 0x7f61f80d06b0 2023-07-14T12:52:21.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.660+0000 7f61fd0ad640 1 --2- 172.21.15.154:0/3359358439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61f80b1f70 0x7f61f8155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:52:21.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.660+0000 7f61fc8ac640 1 --2- 172.21.15.154:0/3359358439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61f80d06b0 0x7f61f80b71f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f61e80011f0 tx=0x7f61e800c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:21.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.660+0000 7f61edffb640 1 -- 172.21.15.154:0/3359358439 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e80054e0 con 0x7f61f80d06b0 2023-07-14T12:52:21.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.660+0000 7f61edffb640 1 -- 172.21.15.154:0/3359358439 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e8003600 con 0x7f61f80d06b0 2023-07-14T12:52:21.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.660+0000 7f61ff311640 1 -- 172.21.15.154:0/3359358439 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f80b7960 con 0x7f61f80d06b0 2023-07-14T12:52:21.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.660+0000 7f61edffb640 1 -- 172.21.15.154:0/3359358439 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e8003a30 con 0x7f61f80d06b0 2023-07-14T12:52:21.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.660+0000 7f61edffb640 1 -- 172.21.15.154:0/3359358439 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f61e8012400 con 0x7f61f80d06b0 2023-07-14T12:52:21.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.660+0000 7f61ff311640 1 -- 172.21.15.154:0/3359358439 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f815de90 con 0x7f61f80d06b0 2023-07-14T12:52:21.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.660+0000 7f61edffb640 1 -- 172.21.15.154:0/3359358439 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f61e8012c90 con 0x7f61f80d06b0 2023-07-14T12:52:21.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.660+0000 7f61ff311640 1 -- 172.21.15.154:0/3359358439 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f8072e70 con 0x7f61f80d06b0 2023-07-14T12:52:21.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.664+0000 7f61edffb640 1 -- 172.21.15.154:0/3359358439 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f61e8017070 con 0x7f61f80d06b0 2023-07-14T12:52:21.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.732+0000 7f61ff311640 1 -- 172.21.15.154:0/3359358439 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd new", "uuid": "24f9a129-8121-4ae9-b0a2-db55951b75d9", "id": 1} v 0) v1 -- 0x7f61f80678d0 con 0x7f61f80d06b0 2023-07-14T12:52:21.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.736+0000 7f61edffb640 1 -- 172.21.15.154:0/3359358439 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "24f9a129-8121-4ae9-b0a2-db55951b75d9", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f61e801b4a0 con 0x7f61f80d06b0 2023-07-14T12:52:21.762 INFO:teuthology.orchestra.run.smithi154.stdout:1 2023-07-14T12:52:21.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.736+0000 7f61ff311640 1 -- 172.21.15.154:0/3359358439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61f80d06b0 msgr2=0x7f61f80b71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:21.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.736+0000 7f61ff311640 1 --2- 172.21.15.154:0/3359358439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61f80d06b0 0x7f61f80b71f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f61e80011f0 tx=0x7f61e800c8c0 comp rx=0 tx=0).stop 2023-07-14T12:52:21.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.736+0000 7f61ff311640 1 -- 172.21.15.154:0/3359358439 shutdown_connections 2023-07-14T12:52:21.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.736+0000 7f61ff311640 1 --2- 172.21.15.154:0/3359358439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61f80b5180 0x7f61f8160230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:21.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.736+0000 7f61ff311640 1 --2- 172.21.15.154:0/3359358439 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61f80d06b0 0x7f61f80b71f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:21.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.736+0000 7f61ff311640 1 --2- 172.21.15.154:0/3359358439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61f80b1f70 0x7f61f8155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:21.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.736+0000 7f61ff311640 1 -- 172.21.15.154:0/3359358439 >> 172.21.15.154:0/3359358439 conn(0x7f61f80659d0 msgr2=0x7f61f815c910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:21.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.736+0000 7f61ff311640 1 -- 172.21.15.154:0/3359358439 shutdown_connections 2023-07-14T12:52:21.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.736+0000 7f61ff311640 1 -- 172.21.15.154:0/3359358439 wait complete. 2023-07-14T12:52:21.781 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 96df165e-d6f1-46fc-b59b-d01b30bebf3d 2 2023-07-14T12:52:21.855 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:52:21.831+0000 7fa77d2d9180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T12:52:21.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.892+0000 7fd33e693640 1 Processor -- start 2023-07-14T12:52:21.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.892+0000 7fd33e693640 1 -- start start 2023-07-14T12:52:21.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.892+0000 7fd33e693640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd338145430 0x7fd3380b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:21.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.892+0000 7fd33e693640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd3380b39f0 0x7fd3380d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:21.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.892+0000 7fd33e693640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3380b2140 con 0x7fd3380d06b0 2023-07-14T12:52:21.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.892+0000 7fd33e693640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3380b2410 con 0x7fd3380b39f0 2023-07-14T12:52:21.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.892+0000 7fd33e693640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3380b26f0 con 0x7fd338145430 2023-07-14T12:52:21.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.892+0000 7fd337fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd3380d06b0 0x7fd3380b1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:58376/0 (socket says 172.21.15.154:58376) 2023-07-14T12:52:21.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.892+0000 7fd337fff640 1 -- 172.21.15.154:0/1669040469 learned_addr learned my addr 172.21.15.154:0/1669040469 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-07-14T12:52:21.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.892+0000 7fd3377fe640 1 --2- 172.21.15.154:0/1669040469 >> v2:172.21.15.154:3300/0 conn(0x7fd338145430 0x7fd3380b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:21.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.892+0000 7fd33cc30640 1 --2- 172.21.15.154:0/1669040469 >> v2:172.21.15.5:3300/0 conn(0x7fd3380b39f0 0x7fd3380d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:21.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.892+0000 7fd3377fe640 1 -- 172.21.15.154:0/1669040469 >> v2:172.21.15.5:3300/0 conn(0x7fd3380b39f0 msgr2=0x7fd3380d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:21.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.892+0000 7fd3377fe640 1 --2- 172.21.15.154:0/1669040469 >> v2:172.21.15.5:3300/0 conn(0x7fd3380b39f0 0x7fd3380d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:21.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.892+0000 7fd3377fe640 1 -- 172.21.15.154:0/1669040469 >> v1:172.21.15.154:6789/0 conn(0x7fd3380d06b0 legacy=0x7fd3380b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:21.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.892+0000 7fd336ffd640 1 -- 172.21.15.154:0/1669040469 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613302417 0 0) 0x7fd3380b2140 con 0x7fd3380d06b0 2023-07-14T12:52:21.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.892+0000 7fd3377fe640 1 -- 172.21.15.154:0/1669040469 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3380b29d0 con 0x7fd338145430 2023-07-14T12:52:21.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.892+0000 7fd33cc30640 1 --2- 172.21.15.154:0/1669040469 >> v2:172.21.15.5:3300/0 conn(0x7fd3380b39f0 0x7fd3380d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:52:21.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.896+0000 7fd3377fe640 1 --2- 172.21.15.154:0/1669040469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd338145430 0x7fd3380b34b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd33808b230 tx=0x7fd32c01c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74779c5a5f97415f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:21.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.896+0000 7fd336ffd640 1 -- 172.21.15.154:0/1669040469 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c0ab600 con 0x7fd338145430 2023-07-14T12:52:21.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.896+0000 7fd336ffd640 1 -- 172.21.15.154:0/1669040469 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32c0a7050 con 0x7fd338145430 2023-07-14T12:52:21.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.896+0000 7fd336ffd640 1 -- 172.21.15.154:0/1669040469 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c0ab980 con 0x7fd338145430 2023-07-14T12:52:21.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.896+0000 7fd33e693640 1 -- 172.21.15.154:0/1669040469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd338145430 msgr2=0x7fd3380b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:21.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.896+0000 7fd33e693640 1 --2- 172.21.15.154:0/1669040469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd338145430 0x7fd3380b34b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd33808b230 tx=0x7fd32c01c430 comp rx=0 tx=0).stop 2023-07-14T12:52:21.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.896+0000 7fd33e693640 1 -- 172.21.15.154:0/1669040469 shutdown_connections 2023-07-14T12:52:21.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.896+0000 7fd33e693640 1 --2- 172.21.15.154:0/1669040469 >> v2:172.21.15.5:3300/0 conn(0x7fd3380b39f0 0x7fd3380d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:21.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.896+0000 7fd33e693640 1 --2- 172.21.15.154:0/1669040469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd338145430 0x7fd3380b34b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:21.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.896+0000 7fd33e693640 1 -- 172.21.15.154:0/1669040469 >> 172.21.15.154:0/1669040469 conn(0x7fd3380659d0 msgr2=0x7fd33809b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:21.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.896+0000 7fd33e693640 1 -- 172.21.15.154:0/1669040469 shutdown_connections 2023-07-14T12:52:21.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.896+0000 7fd33e693640 1 -- 172.21.15.154:0/1669040469 wait complete. 2023-07-14T12:52:21.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.900+0000 7fd33e693640 1 Processor -- start 2023-07-14T12:52:21.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.900+0000 7fd33e693640 1 -- start start 2023-07-14T12:52:21.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.900+0000 7fd33e693640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3380b39f0 0x7fd33806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:21.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.900+0000 7fd33e693640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3380d06b0 0x7fd3381542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:21.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.900+0000 7fd33e693640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd338156040 0x7fd33815a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:21.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.900+0000 7fd33e693640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd338155920 con 0x7fd338156040 2023-07-14T12:52:21.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.900+0000 7fd33e693640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd338154a70 con 0x7fd3380d06b0 2023-07-14T12:52:21.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.900+0000 7fd33e693640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd338155db0 con 0x7fd3380b39f0 2023-07-14T12:52:21.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.900+0000 7fd3377fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3380d06b0 0x7fd3381542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:21.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.900+0000 7fd337fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3380b39f0 0x7fd33806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:21.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.900+0000 7fd3377fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3380d06b0 0x7fd3381542d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52612/0 (socket says 172.21.15.154:52612) 2023-07-14T12:52:21.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.900+0000 7fd3377fe640 1 -- 172.21.15.154:0/1244872754 learned_addr learned my addr 172.21.15.154:0/1244872754 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-07-14T12:52:21.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.900+0000 7fd33cc30640 1 --2- 172.21.15.154:0/1244872754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd338156040 0x7fd33815a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:21.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.900+0000 7fd3377fe640 1 -- 172.21.15.154:0/1244872754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3380b39f0 msgr2=0x7fd33806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:21.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.900+0000 7fd3377fe640 1 --2- 172.21.15.154:0/1244872754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3380b39f0 0x7fd33806b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:21.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.900+0000 7fd3377fe640 1 -- 172.21.15.154:0/1244872754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd338156040 msgr2=0x7fd33815a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:21.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.900+0000 7fd3377fe640 1 --2- 172.21.15.154:0/1244872754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd338156040 0x7fd33815a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:21.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.900+0000 7fd3377fe640 1 -- 172.21.15.154:0/1244872754 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32c009420 con 0x7fd3380d06b0 2023-07-14T12:52:21.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.900+0000 7fd337fff640 1 --2- 172.21.15.154:0/1244872754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3380b39f0 0x7fd33806b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:52:21.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.900+0000 7fd3377fe640 1 --2- 172.21.15.154:0/1244872754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3380d06b0 0x7fd3381542d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd32c01a060 tx=0x7fd32c0191d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:21.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.900+0000 7fd334ff9640 1 -- 172.21.15.154:0/1244872754 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c0b4600 con 0x7fd3380d06b0 2023-07-14T12:52:21.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.900+0000 7fd334ff9640 1 -- 172.21.15.154:0/1244872754 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32c0b4760 con 0x7fd3380d06b0 2023-07-14T12:52:21.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.900+0000 7fd334ff9640 1 -- 172.21.15.154:0/1244872754 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c0b4ad0 con 0x7fd3380d06b0 2023-07-14T12:52:21.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.900+0000 7fd33e693640 1 -- 172.21.15.154:0/1244872754 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd338154d10 con 0x7fd3380d06b0 2023-07-14T12:52:21.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.900+0000 7fd33e693640 1 -- 172.21.15.154:0/1244872754 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3381552d0 con 0x7fd3380d06b0 2023-07-14T12:52:21.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.904+0000 7fd334ff9640 1 -- 172.21.15.154:0/1244872754 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd32c0b2040 con 0x7fd3380d06b0 2023-07-14T12:52:21.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.904+0000 7fd334ff9640 1 -- 172.21.15.154:0/1244872754 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fd32c0c0460 con 0x7fd3380d06b0 2023-07-14T12:52:21.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.904+0000 7fd33e693640 1 -- 172.21.15.154:0/1244872754 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd338072e70 con 0x7fd3380d06b0 2023-07-14T12:52:21.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.904+0000 7fd334ff9640 1 -- 172.21.15.154:0/1244872754 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fd32c0b0070 con 0x7fd3380d06b0 2023-07-14T12:52:21.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.972+0000 7fd33e693640 1 -- 172.21.15.154:0/1244872754 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "96df165e-d6f1-46fc-b59b-d01b30bebf3d", "id": 2} v 0) v1 -- 0x7fd338155a90 con 0x7fd3380d06b0 2023-07-14T12:52:22.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.976+0000 7fd334ff9640 1 -- 172.21.15.154:0/1244872754 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "96df165e-d6f1-46fc-b59b-d01b30bebf3d", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd32c0ce0b0 con 0x7fd3380d06b0 2023-07-14T12:52:22.002 INFO:teuthology.orchestra.run.smithi154.stdout:2 2023-07-14T12:52:22.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.976+0000 7fd33e693640 1 -- 172.21.15.154:0/1244872754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3380d06b0 msgr2=0x7fd3381542d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:22.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.976+0000 7fd33e693640 1 --2- 172.21.15.154:0/1244872754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3380d06b0 0x7fd3381542d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd32c01a060 tx=0x7fd32c0191d0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.976+0000 7fd33e693640 1 -- 172.21.15.154:0/1244872754 shutdown_connections 2023-07-14T12:52:22.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.976+0000 7fd33e693640 1 --2- 172.21.15.154:0/1244872754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd338156040 0x7fd33815a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.976+0000 7fd33e693640 1 --2- 172.21.15.154:0/1244872754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3380d06b0 0x7fd3381542d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.976+0000 7fd33e693640 1 --2- 172.21.15.154:0/1244872754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3380b39f0 0x7fd33806b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.976+0000 7fd33e693640 1 -- 172.21.15.154:0/1244872754 >> 172.21.15.154:0/1244872754 conn(0x7fd3380659d0 msgr2=0x7fd3380b1700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:22.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.976+0000 7fd33e693640 1 -- 172.21.15.154:0/1244872754 shutdown_connections 2023-07-14T12:52:22.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:21.976+0000 7fd33e693640 1 -- 172.21.15.154:0/1244872754 wait complete. 2023-07-14T12:52:22.021 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 341ba276-347e-4e95-b16a-d28f4fff8d2d 3 2023-07-14T12:52:22.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.132+0000 7fd22bdd2640 1 Processor -- start 2023-07-14T12:52:22.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.136+0000 7fd22bdd2640 1 -- start start 2023-07-14T12:52:22.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.136+0000 7fd22bdd2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd224145900 0x7fd2240af070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:22.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.136+0000 7fd22bdd2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd2240b1d40 0x7fd2240d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:22.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.136+0000 7fd22bdd2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2240b2200 con 0x7fd2240d0970 2023-07-14T12:52:22.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.136+0000 7fd22bdd2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2240b24e0 con 0x7fd2240b1d40 2023-07-14T12:52:22.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.136+0000 7fd22bdd2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2240b27c0 con 0x7fd224145900 2023-07-14T12:52:22.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.136+0000 7fd229b6e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd224145900 0x7fd2240af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:22.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.136+0000 7fd22a36f640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd2240d0970 0x7fd2240cedf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:58380/0 (socket says 172.21.15.154:58380) 2023-07-14T12:52:22.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.136+0000 7fd22a36f640 1 -- 172.21.15.154:0/92828260 learned_addr learned my addr 172.21.15.154:0/92828260 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-07-14T12:52:22.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.136+0000 7fd22936d640 1 --2- 172.21.15.154:0/92828260 >> v2:172.21.15.5:3300/0 conn(0x7fd2240b1d40 0x7fd2240d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:22.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.136+0000 7fd229b6e640 1 -- 172.21.15.154:0/92828260 >> v2:172.21.15.5:3300/0 conn(0x7fd2240b1d40 msgr2=0x7fd2240d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:22.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.136+0000 7fd229b6e640 1 --2- 172.21.15.154:0/92828260 >> v2:172.21.15.5:3300/0 conn(0x7fd2240b1d40 0x7fd2240d0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.136+0000 7fd229b6e640 1 -- 172.21.15.154:0/92828260 >> v1:172.21.15.154:6789/0 conn(0x7fd2240d0970 legacy=0x7fd2240cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:22.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.136+0000 7fd229b6e640 1 -- 172.21.15.154:0/92828260 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2240b2aa0 con 0x7fd224145900 2023-07-14T12:52:22.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.136+0000 7fd228b6c640 1 -- 172.21.15.154:0/92828260 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685391014 0 0) 0x7fd2240b2200 con 0x7fd2240d0970 2023-07-14T12:52:22.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.140+0000 7fd229b6e640 1 --2- 172.21.15.154:0/92828260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd224145900 0x7fd2240af070 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd224072ed0 tx=0x7fd22001c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5749d0a2011a94f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:22.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.140+0000 7fd228b6c640 1 -- 172.21.15.154:0/92828260 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2200ab680 con 0x7fd224145900 2023-07-14T12:52:22.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.140+0000 7fd228b6c640 1 -- 172.21.15.154:0/92828260 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2200ab7e0 con 0x7fd224145900 2023-07-14T12:52:22.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.140+0000 7fd228b6c640 1 -- 172.21.15.154:0/92828260 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2200abb70 con 0x7fd224145900 2023-07-14T12:52:22.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.140+0000 7fd22bdd2640 1 -- 172.21.15.154:0/92828260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd224145900 msgr2=0x7fd2240af070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:22.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.140+0000 7fd22bdd2640 1 --2- 172.21.15.154:0/92828260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd224145900 0x7fd2240af070 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd224072ed0 tx=0x7fd22001c460 comp rx=0 tx=0).stop 2023-07-14T12:52:22.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.140+0000 7fd22bdd2640 1 -- 172.21.15.154:0/92828260 shutdown_connections 2023-07-14T12:52:22.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.140+0000 7fd22bdd2640 1 --2- 172.21.15.154:0/92828260 >> v2:172.21.15.5:3300/0 conn(0x7fd2240b1d40 0x7fd2240d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.140+0000 7fd22bdd2640 1 --2- 172.21.15.154:0/92828260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd224145900 0x7fd2240af070 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.140+0000 7fd22bdd2640 1 -- 172.21.15.154:0/92828260 >> 172.21.15.154:0/92828260 conn(0x7fd2240659d0 msgr2=0x7fd22409b710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:22.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.140+0000 7fd22bdd2640 1 -- 172.21.15.154:0/92828260 shutdown_connections 2023-07-14T12:52:22.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.140+0000 7fd22bdd2640 1 -- 172.21.15.154:0/92828260 wait complete. 2023-07-14T12:52:22.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.140+0000 7fd22bdd2640 1 Processor -- start 2023-07-14T12:52:22.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.144+0000 7fd22bdd2640 1 -- start start 2023-07-14T12:52:22.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.144+0000 7fd22bdd2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2240b1d40 0x7fd2240c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:22.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.144+0000 7fd22bdd2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2240d0970 0x7fd22409fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:22.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.144+0000 7fd22bdd2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd224145900 0x7fd22415cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:22.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.144+0000 7fd22bdd2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22409ff40 con 0x7fd224145900 2023-07-14T12:52:22.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.144+0000 7fd22bdd2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2240c7f60 con 0x7fd2240d0970 2023-07-14T12:52:22.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.144+0000 7fd22bdd2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2240c7350 con 0x7fd2240b1d40 2023-07-14T12:52:22.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.144+0000 7fd22936d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2240d0970 0x7fd22409fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:22.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.144+0000 7fd229b6e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2240b1d40 0x7fd2240c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:22.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.144+0000 7fd22936d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2240d0970 0x7fd22409fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52628/0 (socket says 172.21.15.154:52628) 2023-07-14T12:52:22.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.144+0000 7fd22936d640 1 -- 172.21.15.154:0/1182187586 learned_addr learned my addr 172.21.15.154:0/1182187586 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-07-14T12:52:22.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.144+0000 7fd22a36f640 1 --2- 172.21.15.154:0/1182187586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd224145900 0x7fd22415cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:22.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.144+0000 7fd22936d640 1 -- 172.21.15.154:0/1182187586 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2240b1d40 msgr2=0x7fd2240c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:22.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.144+0000 7fd22936d640 1 --2- 172.21.15.154:0/1182187586 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2240b1d40 0x7fd2240c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.144+0000 7fd22936d640 1 -- 172.21.15.154:0/1182187586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd224145900 msgr2=0x7fd22415cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:22.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.144+0000 7fd22936d640 1 --2- 172.21.15.154:0/1182187586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd224145900 0x7fd22415cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.144+0000 7fd22936d640 1 -- 172.21.15.154:0/1182187586 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd220009420 con 0x7fd2240d0970 2023-07-14T12:52:22.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.144+0000 7fd229b6e640 1 --2- 172.21.15.154:0/1182187586 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2240b1d40 0x7fd2240c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:52:22.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.144+0000 7fd22936d640 1 --2- 172.21.15.154:0/1182187586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2240d0970 0x7fd22409fa00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd21400e900 tx=0x7fd21400edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:22.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.144+0000 7fd21a7fc640 1 -- 172.21.15.154:0/1182187586 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd214009690 con 0x7fd2240d0970 2023-07-14T12:52:22.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.144+0000 7fd21a7fc640 1 -- 172.21.15.154:0/1182187586 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21400ca00 con 0x7fd2240d0970 2023-07-14T12:52:22.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.144+0000 7fd22bdd2640 1 -- 172.21.15.154:0/1182187586 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2240c7630 con 0x7fd2240d0970 2023-07-14T12:52:22.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.144+0000 7fd21a7fc640 1 -- 172.21.15.154:0/1182187586 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21400cdb0 con 0x7fd2240d0970 2023-07-14T12:52:22.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.144+0000 7fd22bdd2640 1 -- 172.21.15.154:0/1182187586 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2240c7bf0 con 0x7fd2240d0970 2023-07-14T12:52:22.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.144+0000 7fd21a7fc640 1 -- 172.21.15.154:0/1182187586 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd214013770 con 0x7fd2240d0970 2023-07-14T12:52:22.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.144+0000 7fd21a7fc640 1 -- 172.21.15.154:0/1182187586 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fd21401c450 con 0x7fd2240d0970 2023-07-14T12:52:22.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.144+0000 7fd22bdd2640 1 -- 172.21.15.154:0/1182187586 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2240678d0 con 0x7fd2240d0970 2023-07-14T12:52:22.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.148+0000 7fd21a7fc640 1 -- 172.21.15.154:0/1182187586 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fd21403bb20 con 0x7fd2240d0970 2023-07-14T12:52:22.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.212+0000 7fd22bdd2640 1 -- 172.21.15.154:0/1182187586 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "341ba276-347e-4e95-b16a-d28f4fff8d2d", "id": 3} v 0) v1 -- 0x7fd224070fc0 con 0x7fd2240d0970 2023-07-14T12:52:22.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.216+0000 7fd21a7fc640 1 -- 172.21.15.154:0/1182187586 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "341ba276-347e-4e95-b16a-d28f4fff8d2d", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd21402a070 con 0x7fd2240d0970 2023-07-14T12:52:22.243 INFO:teuthology.orchestra.run.smithi154.stdout:3 2023-07-14T12:52:22.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.220+0000 7fd22bdd2640 1 -- 172.21.15.154:0/1182187586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2240d0970 msgr2=0x7fd22409fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:22.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.220+0000 7fd22bdd2640 1 --2- 172.21.15.154:0/1182187586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2240d0970 0x7fd22409fa00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd21400e900 tx=0x7fd21400edc0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.220+0000 7fd22bdd2640 1 -- 172.21.15.154:0/1182187586 shutdown_connections 2023-07-14T12:52:22.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.220+0000 7fd22bdd2640 1 --2- 172.21.15.154:0/1182187586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd224145900 0x7fd22415cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.220+0000 7fd22bdd2640 1 --2- 172.21.15.154:0/1182187586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2240d0970 0x7fd22409fa00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.220+0000 7fd22bdd2640 1 --2- 172.21.15.154:0/1182187586 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2240b1d40 0x7fd2240c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.220+0000 7fd22bdd2640 1 -- 172.21.15.154:0/1182187586 >> 172.21.15.154:0/1182187586 conn(0x7fd2240659d0 msgr2=0x7fd22406ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:22.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.220+0000 7fd22bdd2640 1 -- 172.21.15.154:0/1182187586 shutdown_connections 2023-07-14T12:52:22.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.220+0000 7fd22bdd2640 1 -- 172.21.15.154:0/1182187586 wait complete. 2023-07-14T12:52:22.263 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new aa4274bf-d048-43f5-b03f-30613bbdc78e 4 2023-07-14T12:52:22.335 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:52:22.308+0000 7fef1704a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T12:52:22.399 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:52:22.372+0000 7fef1704a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T12:52:22.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.372+0000 7f00af8d8640 1 Processor -- start 2023-07-14T12:52:22.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.376+0000 7f00af8d8640 1 -- start start 2023-07-14T12:52:22.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.376+0000 7f00af8d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a80b1d40 0x7f00a80d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:22.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.376+0000 7f00af8d8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f00a80d0970 0x7f00a80cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:22.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.376+0000 7f00af8d8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00a80af780 con 0x7f00a8145900 2023-07-14T12:52:22.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.376+0000 7f00af8d8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00a80b2200 con 0x7f00a80d0970 2023-07-14T12:52:22.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.376+0000 7f00af8d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a80b24e0 con 0x7f00a80b1d40 2023-07-14T12:52:22.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.376+0000 7f00ace73640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a80b1d40 0x7f00a80d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:22.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.376+0000 7f00ace73640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a80b1d40 0x7f00a80d0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34474/0 (socket says 172.21.15.154:34474) 2023-07-14T12:52:22.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.376+0000 7f00ace73640 1 -- 172.21.15.154:0/4109176435 learned_addr learned my addr 172.21.15.154:0/4109176435 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-07-14T12:52:22.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.376+0000 7f00ad674640 1 --1- 172.21.15.154:0/4109176435 >> v1:172.21.15.154:6789/0 conn(0x7f00a8145900 0x7f00a80af070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:58386/0 (socket says 172.21.15.154:58386) 2023-07-14T12:52:22.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.376+0000 7f00ade75640 1 --2- 172.21.15.154:0/4109176435 >> v2:172.21.15.154:3300/0 conn(0x7f00a80d0970 0x7f00a80cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:22.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.376+0000 7f00ace73640 1 -- 172.21.15.154:0/4109176435 >> v2:172.21.15.154:3300/0 conn(0x7f00a80d0970 msgr2=0x7f00a80cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:22.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.376+0000 7f00ace73640 1 --2- 172.21.15.154:0/4109176435 >> v2:172.21.15.154:3300/0 conn(0x7f00a80d0970 0x7f00a80cedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.376+0000 7f00ace73640 1 -- 172.21.15.154:0/4109176435 >> v1:172.21.15.154:6789/0 conn(0x7f00a8145900 legacy=0x7f00a80af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:22.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.376+0000 7f00ace73640 1 -- 172.21.15.154:0/4109176435 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a80b27c0 con 0x7f00a80b1d40 2023-07-14T12:52:22.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.380+0000 7f00ace73640 1 --2- 172.21.15.154:0/4109176435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a80b1d40 0x7f00a80d0430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0098009870 tx=0x7f009801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df01f39bf63cb455 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:22.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.380+0000 7f009ffff640 1 -- 172.21.15.154:0/4109176435 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00980ab650 con 0x7f00a80b1d40 2023-07-14T12:52:22.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.380+0000 7f009ffff640 1 -- 172.21.15.154:0/4109176435 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00980ab7b0 con 0x7f00a80b1d40 2023-07-14T12:52:22.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.380+0000 7f009ffff640 1 -- 172.21.15.154:0/4109176435 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00980abb40 con 0x7f00a80b1d40 2023-07-14T12:52:22.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.380+0000 7f00af8d8640 1 -- 172.21.15.154:0/4109176435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a80b1d40 msgr2=0x7f00a80d0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:22.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.380+0000 7f00af8d8640 1 --2- 172.21.15.154:0/4109176435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a80b1d40 0x7f00a80d0430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0098009870 tx=0x7f009801c540 comp rx=0 tx=0).stop 2023-07-14T12:52:22.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.380+0000 7f00af8d8640 1 -- 172.21.15.154:0/4109176435 shutdown_connections 2023-07-14T12:52:22.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.380+0000 7f00af8d8640 1 --2- 172.21.15.154:0/4109176435 >> v2:172.21.15.154:3300/0 conn(0x7f00a80d0970 0x7f00a80cedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.380+0000 7f00af8d8640 1 --2- 172.21.15.154:0/4109176435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a80b1d40 0x7f00a80d0430 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.380+0000 7f00af8d8640 1 -- 172.21.15.154:0/4109176435 >> 172.21.15.154:0/4109176435 conn(0x7f00a80659d0 msgr2=0x7f00a809b710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:22.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.380+0000 7f00af8d8640 1 -- 172.21.15.154:0/4109176435 shutdown_connections 2023-07-14T12:52:22.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.380+0000 7f00af8d8640 1 -- 172.21.15.154:0/4109176435 wait complete. 2023-07-14T12:52:22.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.384+0000 7f00af8d8640 1 Processor -- start 2023-07-14T12:52:22.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.384+0000 7f00af8d8640 1 -- start start 2023-07-14T12:52:22.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.384+0000 7f00af8d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00a80b1d40 0x7f00a806b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:22.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.384+0000 7f00af8d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a80d0970 0x7f00a80b5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:22.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.384+0000 7f00af8d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00a8145900 0x7f00a80b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:22.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.384+0000 7f00af8d8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a80c66f0 con 0x7f00a8145900 2023-07-14T12:52:22.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.384+0000 7f00af8d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a80cbf40 con 0x7f00a80b1d40 2023-07-14T12:52:22.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.384+0000 7f00af8d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a80cc220 con 0x7f00a80d0970 2023-07-14T12:52:22.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.384+0000 7f00ad674640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00a80b1d40 0x7f00a806b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:22.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.384+0000 7f00ad674640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00a80b1d40 0x7f00a806b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52642/0 (socket says 172.21.15.154:52642) 2023-07-14T12:52:22.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.384+0000 7f00ad674640 1 -- 172.21.15.154:0/393133814 learned_addr learned my addr 172.21.15.154:0/393133814 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-07-14T12:52:22.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.384+0000 7f00ace73640 1 --2- 172.21.15.154:0/393133814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a80d0970 0x7f00a80b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:22.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.384+0000 7f00ade75640 1 --2- 172.21.15.154:0/393133814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00a8145900 0x7f00a80b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:22.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.384+0000 7f00ad674640 1 -- 172.21.15.154:0/393133814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a80d0970 msgr2=0x7f00a80b5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:22.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.384+0000 7f00ad674640 1 --2- 172.21.15.154:0/393133814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a80d0970 0x7f00a80b5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.384+0000 7f00ad674640 1 -- 172.21.15.154:0/393133814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00a8145900 msgr2=0x7f00a80b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:22.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.384+0000 7f00ad674640 1 --2- 172.21.15.154:0/393133814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00a8145900 0x7f00a80b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.384+0000 7f00ad674640 1 -- 172.21.15.154:0/393133814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00980094d0 con 0x7f00a80b1d40 2023-07-14T12:52:22.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.384+0000 7f00ad674640 1 --2- 172.21.15.154:0/393133814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00a80b1d40 0x7f00a806b260 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f00a400c430 tx=0x7f00a400c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:22.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.384+0000 7f009dffb640 1 -- 172.21.15.154:0/393133814 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a40074e0 con 0x7f00a80b1d40 2023-07-14T12:52:22.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.384+0000 7f009dffb640 1 -- 172.21.15.154:0/393133814 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a4007640 con 0x7f00a80b1d40 2023-07-14T12:52:22.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.384+0000 7f009dffb640 1 -- 172.21.15.154:0/393133814 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a4004a10 con 0x7f00a80b1d40 2023-07-14T12:52:22.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.384+0000 7f00af8d8640 1 -- 172.21.15.154:0/393133814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a80c69a0 con 0x7f00a80b1d40 2023-07-14T12:52:22.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.384+0000 7f009dffb640 1 -- 172.21.15.154:0/393133814 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f00a4013400 con 0x7f00a80b1d40 2023-07-14T12:52:22.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.384+0000 7f00af8d8640 1 -- 172.21.15.154:0/393133814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a80b5c60 con 0x7f00a80b1d40 2023-07-14T12:52:22.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.384+0000 7f009dffb640 1 -- 172.21.15.154:0/393133814 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f00a4013df0 con 0x7f00a80b1d40 2023-07-14T12:52:22.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.384+0000 7f00af8d8640 1 -- 172.21.15.154:0/393133814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a80678d0 con 0x7f00a80b1d40 2023-07-14T12:52:22.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.388+0000 7f009dffb640 1 -- 172.21.15.154:0/393133814 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f00a40138e0 con 0x7f00a80b1d40 2023-07-14T12:52:22.464 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:52:22.440+0000 7fef1704a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T12:52:22.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.456+0000 7f00af8d8640 1 -- 172.21.15.154:0/393133814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "aa4274bf-d048-43f5-b03f-30613bbdc78e", "id": 4} v 0) v1 -- 0x7f00a808b4a0 con 0x7f00a80b1d40 2023-07-14T12:52:22.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.460+0000 7f009dffb640 1 -- 172.21.15.154:0/393133814 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aa4274bf-d048-43f5-b03f-30613bbdc78e", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f00a4013b50 con 0x7f00a80b1d40 2023-07-14T12:52:22.486 INFO:teuthology.orchestra.run.smithi154.stdout:4 2023-07-14T12:52:22.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.460+0000 7f00af8d8640 1 -- 172.21.15.154:0/393133814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00a80b1d40 msgr2=0x7f00a806b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:22.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.460+0000 7f00af8d8640 1 --2- 172.21.15.154:0/393133814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00a80b1d40 0x7f00a806b260 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f00a400c430 tx=0x7f00a400c8f0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.460+0000 7f00af8d8640 1 -- 172.21.15.154:0/393133814 shutdown_connections 2023-07-14T12:52:22.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.460+0000 7f00af8d8640 1 --2- 172.21.15.154:0/393133814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00a8145900 0x7f00a80b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.460+0000 7f00af8d8640 1 --2- 172.21.15.154:0/393133814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00a80d0970 0x7f00a80b5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.460+0000 7f00af8d8640 1 --2- 172.21.15.154:0/393133814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00a80b1d40 0x7f00a806b260 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.460+0000 7f00af8d8640 1 -- 172.21.15.154:0/393133814 >> 172.21.15.154:0/393133814 conn(0x7f00a80659d0 msgr2=0x7f00a80af070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:22.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.460+0000 7f00af8d8640 1 -- 172.21.15.154:0/393133814 shutdown_connections 2023-07-14T12:52:22.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.460+0000 7f00af8d8640 1 -- 172.21.15.154:0/393133814 wait complete. 2023-07-14T12:52:22.507 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 7e96140e-6ae9-460d-9c5c-de34010e030c 5 2023-07-14T12:52:22.528 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:52:22.503+0000 7fa77d2d9180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T12:52:22.559 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:52:22.532+0000 7fef1704a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T12:52:22.593 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:52:22.571+0000 7fa77d2d9180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T12:52:22.621 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:52:22.596+0000 7fef1704a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T12:52:22.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.620+0000 7fe789034640 1 Processor -- start 2023-07-14T12:52:22.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.620+0000 7fe789034640 1 -- start start 2023-07-14T12:52:22.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.620+0000 7fe789034640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe7840d06b0 0x7fe7840b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:22.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.620+0000 7fe789034640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe784145430 0x7fe7840b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:22.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.620+0000 7fe789034640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7840b2410 con 0x7fe7840b1f70 2023-07-14T12:52:22.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.620+0000 7fe789034640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7840b26f0 con 0x7fe7840d06b0 2023-07-14T12:52:22.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.620+0000 7fe789034640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7840b29d0 con 0x7fe784145430 2023-07-14T12:52:22.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.620+0000 7fe78259c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe784145430 0x7fe7840b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:22.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.620+0000 7fe78259c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe784145430 0x7fe7840b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52644/0 (socket says 172.21.15.154:52644) 2023-07-14T12:52:22.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.620+0000 7fe78259c640 1 -- 172.21.15.154:0/760798306 learned_addr learned my addr 172.21.15.154:0/760798306 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-07-14T12:52:22.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.620+0000 7fe782d9d640 1 --2- 172.21.15.154:0/760798306 >> v2:172.21.15.5:3300/0 conn(0x7fe7840d06b0 0x7fe7840b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:22.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.620+0000 7fe78259c640 1 -- 172.21.15.154:0/760798306 >> v2:172.21.15.5:3300/0 conn(0x7fe7840d06b0 msgr2=0x7fe7840b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:22.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.620+0000 7fe78259c640 1 --2- 172.21.15.154:0/760798306 >> v2:172.21.15.5:3300/0 conn(0x7fe7840d06b0 0x7fe7840b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.620+0000 7fe78259c640 1 -- 172.21.15.154:0/760798306 >> v1:172.21.15.154:6789/0 conn(0x7fe7840b1f70 legacy=0x7fe7840d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:22.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.620+0000 7fe78259c640 1 -- 172.21.15.154:0/760798306 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7840b2cb0 con 0x7fe784145430 2023-07-14T12:52:22.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.620+0000 7fe781d9b640 1 -- 172.21.15.154:0/760798306 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2922068548 0 0) 0x7fe7840b2410 con 0x7fe7840b1f70 2023-07-14T12:52:22.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.624+0000 7fe78259c640 1 --2- 172.21.15.154:0/760798306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe784145430 0x7fe7840b34b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe78408b230 tx=0x7fe77801c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4e07d1008e60cf0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:22.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.624+0000 7fe781d9b640 1 -- 172.21.15.154:0/760798306 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7780aa650 con 0x7fe784145430 2023-07-14T12:52:22.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.624+0000 7fe781d9b640 1 -- 172.21.15.154:0/760798306 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7780aa7b0 con 0x7fe784145430 2023-07-14T12:52:22.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.624+0000 7fe781d9b640 1 -- 172.21.15.154:0/760798306 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7780aab40 con 0x7fe784145430 2023-07-14T12:52:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.624+0000 7fe789034640 1 -- 172.21.15.154:0/760798306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe784145430 msgr2=0x7fe7840b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.624+0000 7fe789034640 1 --2- 172.21.15.154:0/760798306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe784145430 0x7fe7840b34b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe78408b230 tx=0x7fe77801c4d0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.624+0000 7fe789034640 1 -- 172.21.15.154:0/760798306 shutdown_connections 2023-07-14T12:52:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.624+0000 7fe789034640 1 --2- 172.21.15.154:0/760798306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe784145430 0x7fe7840b34b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.624+0000 7fe789034640 1 --2- 172.21.15.154:0/760798306 >> v2:172.21.15.5:3300/0 conn(0x7fe7840d06b0 0x7fe7840b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.624+0000 7fe789034640 1 -- 172.21.15.154:0/760798306 >> 172.21.15.154:0/760798306 conn(0x7fe7840659d0 msgr2=0x7fe78409b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.624+0000 7fe789034640 1 -- 172.21.15.154:0/760798306 shutdown_connections 2023-07-14T12:52:22.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.624+0000 7fe789034640 1 -- 172.21.15.154:0/760798306 wait complete. 2023-07-14T12:52:22.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.628+0000 7fe789034640 1 Processor -- start 2023-07-14T12:52:22.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.628+0000 7fe789034640 1 -- start start 2023-07-14T12:52:22.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.628+0000 7fe789034640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7840b1f70 0x7fe78415dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:22.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.628+0000 7fe789034640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7840d06b0 0x7fe7841534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:22.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.628+0000 7fe789034640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7840ca640 0x7fe78406aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:22.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.628+0000 7fe789034640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7840cb7f0 con 0x7fe7840d06b0 2023-07-14T12:52:22.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.628+0000 7fe789034640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7840cab70 con 0x7fe7840b1f70 2023-07-14T12:52:22.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.628+0000 7fe789034640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7840cae50 con 0x7fe7840ca640 2023-07-14T12:52:22.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.628+0000 7fe782d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7840b1f70 0x7fe78415dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:22.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.628+0000 7fe782d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7840b1f70 0x7fe78415dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52656/0 (socket says 172.21.15.154:52656) 2023-07-14T12:52:22.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.628+0000 7fe782d9d640 1 -- 172.21.15.154:0/3906072914 learned_addr learned my addr 172.21.15.154:0/3906072914 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-07-14T12:52:22.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.628+0000 7fe78359e640 1 --2- 172.21.15.154:0/3906072914 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7840ca640 0x7fe78406aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:22.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.628+0000 7fe78259c640 1 --2- 172.21.15.154:0/3906072914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7840d06b0 0x7fe7841534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:22.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.628+0000 7fe782d9d640 1 -- 172.21.15.154:0/3906072914 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7840ca640 msgr2=0x7fe78406aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:22.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.628+0000 7fe782d9d640 1 --2- 172.21.15.154:0/3906072914 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7840ca640 0x7fe78406aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.628+0000 7fe782d9d640 1 -- 172.21.15.154:0/3906072914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7840d06b0 msgr2=0x7fe7841534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:22.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.628+0000 7fe782d9d640 1 --2- 172.21.15.154:0/3906072914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7840d06b0 0x7fe7841534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.628+0000 7fe782d9d640 1 -- 172.21.15.154:0/3906072914 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7780094d0 con 0x7fe7840b1f70 2023-07-14T12:52:22.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.628+0000 7fe78359e640 1 --2- 172.21.15.154:0/3906072914 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7840ca640 0x7fe78406aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:52:22.658 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:52:22.635+0000 7fa77d2d9180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T12:52:22.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.628+0000 7fe782d9d640 1 --2- 172.21.15.154:0/3906072914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7840b1f70 0x7fe78415dcc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe77400e930 tx=0x7fe77400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:22.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.632+0000 7fe76b7fe640 1 -- 172.21.15.154:0/3906072914 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe774009690 con 0x7fe7840b1f70 2023-07-14T12:52:22.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.632+0000 7fe76b7fe640 1 -- 172.21.15.154:0/3906072914 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77400ca00 con 0x7fe7840b1f70 2023-07-14T12:52:22.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.632+0000 7fe789034640 1 -- 172.21.15.154:0/3906072914 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7840cb130 con 0x7fe7840b1f70 2023-07-14T12:52:22.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.632+0000 7fe76b7fe640 1 -- 172.21.15.154:0/3906072914 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77400cd70 con 0x7fe7840b1f70 2023-07-14T12:52:22.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.632+0000 7fe789034640 1 -- 172.21.15.154:0/3906072914 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe78415d000 con 0x7fe7840b1f70 2023-07-14T12:52:22.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.632+0000 7fe76b7fe640 1 -- 172.21.15.154:0/3906072914 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe774005ca0 con 0x7fe7840b1f70 2023-07-14T12:52:22.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.632+0000 7fe76b7fe640 1 -- 172.21.15.154:0/3906072914 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fe7740065a0 con 0x7fe7840b1f70 2023-07-14T12:52:22.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.632+0000 7fe789034640 1 -- 172.21.15.154:0/3906072914 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe784072e70 con 0x7fe7840b1f70 2023-07-14T12:52:22.661 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.632+0000 7fe76b7fe640 1 -- 172.21.15.154:0/3906072914 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fe774021060 con 0x7fe7840b1f70 2023-07-14T12:52:22.715 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:52:22.688+0000 7fef1704a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T12:52:22.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.700+0000 7fe789034640 1 -- 172.21.15.154:0/3906072914 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7e96140e-6ae9-460d-9c5c-de34010e030c", "id": 5} v 0) v1 -- 0x7fe7840678d0 con 0x7fe7840b1f70 2023-07-14T12:52:22.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.704+0000 7fe76b7fe640 1 -- 172.21.15.154:0/3906072914 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7e96140e-6ae9-460d-9c5c-de34010e030c", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe774029020 con 0x7fe7840b1f70 2023-07-14T12:52:22.731 INFO:teuthology.orchestra.run.smithi154.stdout:5 2023-07-14T12:52:22.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.704+0000 7fe789034640 1 -- 172.21.15.154:0/3906072914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7840b1f70 msgr2=0x7fe78415dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:22.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.704+0000 7fe789034640 1 --2- 172.21.15.154:0/3906072914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7840b1f70 0x7fe78415dcc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe77400e930 tx=0x7fe77400edf0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.704+0000 7fe789034640 1 -- 172.21.15.154:0/3906072914 shutdown_connections 2023-07-14T12:52:22.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.708+0000 7fe789034640 1 --2- 172.21.15.154:0/3906072914 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7840ca640 0x7fe78406aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.708+0000 7fe789034640 1 --2- 172.21.15.154:0/3906072914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7840d06b0 0x7fe7841534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.708+0000 7fe789034640 1 --2- 172.21.15.154:0/3906072914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7840b1f70 0x7fe78415dcc0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.708+0000 7fe789034640 1 -- 172.21.15.154:0/3906072914 >> 172.21.15.154:0/3906072914 conn(0x7fe7840659d0 msgr2=0x7fe78415eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:22.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.708+0000 7fe789034640 1 -- 172.21.15.154:0/3906072914 shutdown_connections 2023-07-14T12:52:22.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.708+0000 7fe789034640 1 -- 172.21.15.154:0/3906072914 wait complete. 2023-07-14T12:52:22.750 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new d40ff6ff-0eae-408f-a751-2f83b9d03620 6 2023-07-14T12:52:22.752 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:52:22.727+0000 7fa77d2d9180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T12:52:22.778 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:52:22.752+0000 7fef1704a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T12:52:22.815 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:52:22.791+0000 7fa77d2d9180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T12:52:22.908 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:52:22.883+0000 7fa77d2d9180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T12:52:22.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.888+0000 7f67e71fa640 1 Processor -- start 2023-07-14T12:52:22.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.888+0000 7f67e71fa640 1 -- start start 2023-07-14T12:52:22.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.888+0000 7f67e71fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67e00d22e0 0x7f67e00d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:22.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.892+0000 7f67e71fa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e00b2140 con 0x7f67e00d06b0 2023-07-14T12:52:22.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.892+0000 7f67e71fa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e00b2410 con 0x7f67e0145430 2023-07-14T12:52:22.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.892+0000 7f67e71fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e00d2cc0 con 0x7f67e00d22e0 2023-07-14T12:52:22.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.892+0000 7f67e5797640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67e00d22e0 0x7f67e00d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:22.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.892+0000 7f67e5797640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67e00d22e0 0x7f67e00d2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34498/0 (socket says 172.21.15.154:34498) 2023-07-14T12:52:22.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.892+0000 7f67e5797640 1 -- 172.21.15.154:0/2563283627 learned_addr learned my addr 172.21.15.154:0/2563283627 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-07-14T12:52:22.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.892+0000 7f67dffff640 1 --1- 172.21.15.154:0/2563283627 >> v1:172.21.15.154:6789/0 conn(0x7f67e0145430 0x7f67e00b34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:58402/0 (socket says 172.21.15.154:58402) 2023-07-14T12:52:22.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.892+0000 7f67e5797640 1 -- 172.21.15.154:0/2563283627 >> v1:172.21.15.154:6789/0 conn(0x7f67e0145430 legacy=0x7f67e00b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:22.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.892+0000 7f67e5797640 1 -- 172.21.15.154:0/2563283627 >> v1:172.21.15.5:6789/0 conn(0x7f67e00d06b0 legacy=0x7f67e00b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:22.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.892+0000 7f67e5797640 1 -- 172.21.15.154:0/2563283627 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e00b26f0 con 0x7f67e00d22e0 2023-07-14T12:52:22.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.892+0000 7f67e5797640 1 --2- 172.21.15.154:0/2563283627 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67e00d22e0 0x7f67e00d2780 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f67d8009e80 tx=0x7f67d801ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24ff89b7f557a070 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:22.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.892+0000 7f67df7fe640 1 -- 172.21.15.154:0/2563283627 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d80a58d0 con 0x7f67e00d22e0 2023-07-14T12:52:22.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.892+0000 7f67df7fe640 1 -- 172.21.15.154:0/2563283627 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d80a5a30 con 0x7f67e00d22e0 2023-07-14T12:52:22.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.892+0000 7f67df7fe640 1 -- 172.21.15.154:0/2563283627 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d80a5dc0 con 0x7f67e00d22e0 2023-07-14T12:52:22.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.896+0000 7f67e71fa640 1 -- 172.21.15.154:0/2563283627 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67e00d22e0 msgr2=0x7f67e00d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:22.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.896+0000 7f67e71fa640 1 --2- 172.21.15.154:0/2563283627 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67e00d22e0 0x7f67e00d2780 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f67d8009e80 tx=0x7f67d801ca00 comp rx=0 tx=0).stop 2023-07-14T12:52:22.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.896+0000 7f67e71fa640 1 -- 172.21.15.154:0/2563283627 shutdown_connections 2023-07-14T12:52:22.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.896+0000 7f67e71fa640 1 --2- 172.21.15.154:0/2563283627 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67e00d22e0 0x7f67e00d2780 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.896+0000 7f67e71fa640 1 -- 172.21.15.154:0/2563283627 >> 172.21.15.154:0/2563283627 conn(0x7f67e00659d0 msgr2=0x7f67e009b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:22.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.896+0000 7f67e71fa640 1 -- 172.21.15.154:0/2563283627 shutdown_connections 2023-07-14T12:52:22.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.896+0000 7f67e71fa640 1 -- 172.21.15.154:0/2563283627 wait complete. 2023-07-14T12:52:22.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.896+0000 7f67e71fa640 1 Processor -- start 2023-07-14T12:52:22.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.896+0000 7f67e71fa640 1 -- start start 2023-07-14T12:52:22.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.896+0000 7f67e71fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67e00d06b0 0x7f67e00cef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:22.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.896+0000 7f67e71fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e00d22e0 0x7f67e01550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:22.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.896+0000 7f67e71fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67e00c9420 0x7f67e00c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:22.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.896+0000 7f67e71fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e00cbe00 con 0x7f67e00d22e0 2023-07-14T12:52:22.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.896+0000 7f67e71fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e00cca20 con 0x7f67e00d06b0 2023-07-14T12:52:22.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.896+0000 7f67e71fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e00cf4b0 con 0x7f67e00c9420 2023-07-14T12:52:22.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.896+0000 7f67e4f96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67e00d06b0 0x7f67e00cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:22.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.896+0000 7f67e4f96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67e00d06b0 0x7f67e00cef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52670/0 (socket says 172.21.15.154:52670) 2023-07-14T12:52:22.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.896+0000 7f67e4f96640 1 -- 172.21.15.154:0/133860180 learned_addr learned my addr 172.21.15.154:0/133860180 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-07-14T12:52:22.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.896+0000 7f67dffff640 1 --2- 172.21.15.154:0/133860180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e00d22e0 0x7f67e01550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:22.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.896+0000 7f67e5797640 1 --2- 172.21.15.154:0/133860180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67e00c9420 0x7f67e00c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:22.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.900+0000 7f67e4f96640 1 -- 172.21.15.154:0/133860180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67e00c9420 msgr2=0x7f67e00c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:22.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.900+0000 7f67e4f96640 1 --2- 172.21.15.154:0/133860180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67e00c9420 0x7f67e00c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.900+0000 7f67e4f96640 1 -- 172.21.15.154:0/133860180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e00d22e0 msgr2=0x7f67e01550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:22.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.900+0000 7f67e4f96640 1 --2- 172.21.15.154:0/133860180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e00d22e0 0x7f67e01550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.900+0000 7f67e4f96640 1 -- 172.21.15.154:0/133860180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d8009b30 con 0x7f67e00d06b0 2023-07-14T12:52:22.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.900+0000 7f67e4f96640 1 --2- 172.21.15.154:0/133860180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67e00d06b0 0x7f67e00cef70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f67d400c3c0 tx=0x7f67d400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:22.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.900+0000 7f67dd7fa640 1 -- 172.21.15.154:0/133860180 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d40052d0 con 0x7f67e00d06b0 2023-07-14T12:52:22.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.900+0000 7f67dd7fa640 1 -- 172.21.15.154:0/133860180 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d4005430 con 0x7f67e00d06b0 2023-07-14T12:52:22.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.900+0000 7f67dd7fa640 1 -- 172.21.15.154:0/133860180 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d4003840 con 0x7f67e00d06b0 2023-07-14T12:52:22.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.900+0000 7f67e71fa640 1 -- 172.21.15.154:0/133860180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e00cccc0 con 0x7f67e00d06b0 2023-07-14T12:52:22.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.900+0000 7f67e71fa640 1 -- 172.21.15.154:0/133860180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e00cd280 con 0x7f67e00d06b0 2023-07-14T12:52:22.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.900+0000 7f67dd7fa640 1 -- 172.21.15.154:0/133860180 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f67d4003ca0 con 0x7f67e00d06b0 2023-07-14T12:52:22.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.900+0000 7f67dd7fa640 1 -- 172.21.15.154:0/133860180 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f67d4012420 con 0x7f67e00d06b0 2023-07-14T12:52:22.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.900+0000 7f67e71fa640 1 -- 172.21.15.154:0/133860180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e00678d0 con 0x7f67e00d06b0 2023-07-14T12:52:22.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.904+0000 7f67dd7fa640 1 -- 172.21.15.154:0/133860180 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f67d4017070 con 0x7f67e00d06b0 2023-07-14T12:52:22.939 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:52:22.912+0000 7fef1704a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T12:52:22.971 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:52:22.947+0000 7fa77d2d9180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T12:52:22.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.968+0000 7f67e71fa640 1 -- 172.21.15.154:0/133860180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d40ff6ff-0eae-408f-a751-2f83b9d03620", "id": 6} v 0) v1 -- 0x7f67e00d2e80 con 0x7f67e00d06b0 2023-07-14T12:52:22.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.972+0000 7f67dd7fa640 1 -- 172.21.15.154:0/133860180 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d40ff6ff-0eae-408f-a751-2f83b9d03620", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f67d4011590 con 0x7f67e00d06b0 2023-07-14T12:52:22.997 INFO:teuthology.orchestra.run.smithi154.stdout:6 2023-07-14T12:52:22.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.972+0000 7f67e71fa640 1 -- 172.21.15.154:0/133860180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67e00d06b0 msgr2=0x7f67e00cef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:22.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.972+0000 7f67e71fa640 1 --2- 172.21.15.154:0/133860180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67e00d06b0 0x7f67e00cef70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f67d400c3c0 tx=0x7f67d400c880 comp rx=0 tx=0).stop 2023-07-14T12:52:22.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.972+0000 7f67e71fa640 1 -- 172.21.15.154:0/133860180 shutdown_connections 2023-07-14T12:52:22.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.972+0000 7f67e71fa640 1 --2- 172.21.15.154:0/133860180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67e00c9420 0x7f67e00c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.972+0000 7f67e71fa640 1 --2- 172.21.15.154:0/133860180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e00d22e0 0x7f67e01550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.972+0000 7f67e71fa640 1 --2- 172.21.15.154:0/133860180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67e00d06b0 0x7f67e00cef70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:22.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.972+0000 7f67e71fa640 1 -- 172.21.15.154:0/133860180 >> 172.21.15.154:0/133860180 conn(0x7f67e00659d0 msgr2=0x7f67e00b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:22.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.972+0000 7f67e71fa640 1 -- 172.21.15.154:0/133860180 shutdown_connections 2023-07-14T12:52:23.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:22.972+0000 7f67e71fa640 1 -- 172.21.15.154:0/133860180 wait complete. 2023-07-14T12:52:23.012 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:52:22.988+0000 7fef1704a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T12:52:23.017 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new e9467169-12e1-410b-9736-d698b22f92c3 7 2023-07-14T12:52:23.133 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:52:23.107+0000 7fa77d2d9180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T12:52:23.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.128+0000 7f4a2825c640 1 Processor -- start 2023-07-14T12:52:23.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.128+0000 7f4a2825c640 1 -- start start 2023-07-14T12:52:23.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.128+0000 7f4a2825c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4a20145430 0x7f4a200b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:23.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.128+0000 7f4a2825c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a200b39f0 0x7f4a200d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:23.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.128+0000 7f4a2825c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a200b2140 con 0x7f4a200d06b0 2023-07-14T12:52:23.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.128+0000 7f4a2825c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a200b2410 con 0x7f4a20145430 2023-07-14T12:52:23.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.128+0000 7f4a2825c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200b26f0 con 0x7f4a200b39f0 2023-07-14T12:52:23.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.128+0000 7f4a267f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a200b39f0 0x7f4a200d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:23.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.128+0000 7f4a267f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a200b39f0 0x7f4a200d22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:34520/0 (socket says 172.21.15.154:34520) 2023-07-14T12:52:23.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.128+0000 7f4a267f9640 1 -- 172.21.15.154:0/3727960977 learned_addr learned my addr 172.21.15.154:0/3727960977 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-07-14T12:52:23.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.128+0000 7f4a257f7640 1 --2- 172.21.15.154:0/3727960977 >> v2:172.21.15.154:3300/0 conn(0x7f4a20145430 0x7f4a200b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:23.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.128+0000 7f4a267f9640 1 -- 172.21.15.154:0/3727960977 >> v2:172.21.15.154:3300/0 conn(0x7f4a20145430 msgr2=0x7f4a200b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:23.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.128+0000 7f4a267f9640 1 --2- 172.21.15.154:0/3727960977 >> v2:172.21.15.154:3300/0 conn(0x7f4a20145430 0x7f4a200b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:23.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.128+0000 7f4a267f9640 1 -- 172.21.15.154:0/3727960977 >> v1:172.21.15.5:6789/0 conn(0x7f4a200d06b0 legacy=0x7f4a200b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:23.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.128+0000 7f4a24ff6640 1 -- 172.21.15.154:0/3727960977 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679108340 0 0) 0x7f4a200b2140 con 0x7f4a200d06b0 2023-07-14T12:52:23.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.128+0000 7f4a267f9640 1 -- 172.21.15.154:0/3727960977 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a200b29d0 con 0x7f4a200b39f0 2023-07-14T12:52:23.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.128+0000 7f4a257f7640 1 --2- 172.21.15.154:0/3727960977 >> v2:172.21.15.154:3300/0 conn(0x7f4a20145430 0x7f4a200b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:52:23.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.132+0000 7f4a267f9640 1 --2- 172.21.15.154:0/3727960977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a200b39f0 0x7f4a200d22e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009e50 tx=0x7f4a1801c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e47a88ecbfa43d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:23.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.132+0000 7f4a24ff6640 1 -- 172.21.15.154:0/3727960977 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a180a57c0 con 0x7f4a200b39f0 2023-07-14T12:52:23.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.132+0000 7f4a24ff6640 1 -- 172.21.15.154:0/3727960977 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a180a5920 con 0x7f4a200b39f0 2023-07-14T12:52:23.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.132+0000 7f4a24ff6640 1 -- 172.21.15.154:0/3727960977 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a180a5cb0 con 0x7f4a200b39f0 2023-07-14T12:52:23.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.132+0000 7f4a2825c640 1 -- 172.21.15.154:0/3727960977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a200b39f0 msgr2=0x7f4a200d22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:23.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.132+0000 7f4a2825c640 1 --2- 172.21.15.154:0/3727960977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a200b39f0 0x7f4a200d22e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009e50 tx=0x7f4a1801c9e0 comp rx=0 tx=0).stop 2023-07-14T12:52:23.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.132+0000 7f4a2825c640 1 -- 172.21.15.154:0/3727960977 shutdown_connections 2023-07-14T12:52:23.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.132+0000 7f4a2825c640 1 --2- 172.21.15.154:0/3727960977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a200b39f0 0x7f4a200d22e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:23.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.132+0000 7f4a2825c640 1 --2- 172.21.15.154:0/3727960977 >> v2:172.21.15.154:3300/0 conn(0x7f4a20145430 0x7f4a200b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:23.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.132+0000 7f4a2825c640 1 -- 172.21.15.154:0/3727960977 >> 172.21.15.154:0/3727960977 conn(0x7f4a200659d0 msgr2=0x7f4a2009b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:23.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.132+0000 7f4a2825c640 1 -- 172.21.15.154:0/3727960977 shutdown_connections 2023-07-14T12:52:23.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.132+0000 7f4a2825c640 1 -- 172.21.15.154:0/3727960977 wait complete. 2023-07-14T12:52:23.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.136+0000 7f4a2825c640 1 Processor -- start 2023-07-14T12:52:23.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.136+0000 7f4a2825c640 1 -- start start 2023-07-14T12:52:23.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.136+0000 7f4a2825c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a200b39f0 0x7f4a20152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:23.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.136+0000 7f4a2825c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a200d06b0 0x7f4a20153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:23.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.136+0000 7f4a2825c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a2015ec10 0x7f4a201543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:23.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.136+0000 7f4a2825c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a20152bc0 con 0x7f4a2015ec10 2023-07-14T12:52:23.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.136+0000 7f4a2825c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200cf400 con 0x7f4a200b39f0 2023-07-14T12:52:23.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.136+0000 7f4a2825c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2015f180 con 0x7f4a200d06b0 2023-07-14T12:52:23.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.136+0000 7f4a25ff8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a200b39f0 0x7f4a20152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:23.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.136+0000 7f4a257f7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a200d06b0 0x7f4a20153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:23.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.136+0000 7f4a25ff8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a200b39f0 0x7f4a20152680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52696/0 (socket says 172.21.15.154:52696) 2023-07-14T12:52:23.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.136+0000 7f4a25ff8640 1 -- 172.21.15.154:0/4010122065 learned_addr learned my addr 172.21.15.154:0/4010122065 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-07-14T12:52:23.164 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.136+0000 7f4a267f9640 1 --2- 172.21.15.154:0/4010122065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a2015ec10 0x7f4a201543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:23.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.136+0000 7f4a257f7640 1 -- 172.21.15.154:0/4010122065 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a200b39f0 msgr2=0x7f4a20152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:23.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.136+0000 7f4a257f7640 1 --2- 172.21.15.154:0/4010122065 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a200b39f0 0x7f4a20152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:23.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.136+0000 7f4a257f7640 1 -- 172.21.15.154:0/4010122065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a2015ec10 msgr2=0x7f4a201543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:23.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.136+0000 7f4a257f7640 1 --2- 172.21.15.154:0/4010122065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a2015ec10 0x7f4a201543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:23.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.136+0000 7f4a257f7640 1 -- 172.21.15.154:0/4010122065 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a10009420 con 0x7f4a200d06b0 2023-07-14T12:52:23.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.136+0000 7f4a25ff8640 1 --2- 172.21.15.154:0/4010122065 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a200b39f0 0x7f4a20152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:52:23.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.136+0000 7f4a257f7640 1 --2- 172.21.15.154:0/4010122065 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a200d06b0 0x7f4a20153e70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4a1000e9b0 tx=0x7f4a1000ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:23.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.136+0000 7f4a167fc640 1 -- 172.21.15.154:0/4010122065 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1000c9a0 con 0x7f4a200d06b0 2023-07-14T12:52:23.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.136+0000 7f4a167fc640 1 -- 172.21.15.154:0/4010122065 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1000cb00 con 0x7f4a200d06b0 2023-07-14T12:52:23.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.136+0000 7f4a167fc640 1 -- 172.21.15.154:0/4010122065 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10013470 con 0x7f4a200d06b0 2023-07-14T12:52:23.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.136+0000 7f4a2825c640 1 -- 172.21.15.154:0/4010122065 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a18009b30 con 0x7f4a200d06b0 2023-07-14T12:52:23.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.136+0000 7f4a2825c640 1 -- 172.21.15.154:0/4010122065 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a200cec00 con 0x7f4a200d06b0 2023-07-14T12:52:23.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.140+0000 7f4a167fc640 1 -- 172.21.15.154:0/4010122065 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4a10005ca0 con 0x7f4a200d06b0 2023-07-14T12:52:23.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.140+0000 7f4a167fc640 1 -- 172.21.15.154:0/4010122065 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f4a10013e40 con 0x7f4a200d06b0 2023-07-14T12:52:23.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.140+0000 7f4a2825c640 1 -- 172.21.15.154:0/4010122065 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a200678d0 con 0x7f4a200d06b0 2023-07-14T12:52:23.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.140+0000 7f4a167fc640 1 -- 172.21.15.154:0/4010122065 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f4a10021060 con 0x7f4a200d06b0 2023-07-14T12:52:23.205 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:52:23.183+0000 7fa77d2d9180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T12:52:23.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.208+0000 7f4a2825c640 1 -- 172.21.15.154:0/4010122065 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e9467169-12e1-410b-9736-d698b22f92c3", "id": 7} v 0) v1 -- 0x7f4a20145910 con 0x7f4a200d06b0 2023-07-14T12:52:23.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.212+0000 7f4a167fc640 1 -- 172.21.15.154:0/4010122065 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e9467169-12e1-410b-9736-d698b22f92c3", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4a10029020 con 0x7f4a200d06b0 2023-07-14T12:52:23.237 INFO:teuthology.orchestra.run.smithi154.stdout:7 2023-07-14T12:52:23.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.212+0000 7f4a2825c640 1 -- 172.21.15.154:0/4010122065 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a200d06b0 msgr2=0x7f4a20153e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:23.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.212+0000 7f4a2825c640 1 --2- 172.21.15.154:0/4010122065 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a200d06b0 0x7f4a20153e70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4a1000e9b0 tx=0x7f4a1000ee70 comp rx=0 tx=0).stop 2023-07-14T12:52:23.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.212+0000 7f4a2825c640 1 -- 172.21.15.154:0/4010122065 shutdown_connections 2023-07-14T12:52:23.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.212+0000 7f4a2825c640 1 --2- 172.21.15.154:0/4010122065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a2015ec10 0x7f4a201543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:23.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.212+0000 7f4a2825c640 1 --2- 172.21.15.154:0/4010122065 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a200d06b0 0x7f4a20153e70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:23.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.212+0000 7f4a2825c640 1 --2- 172.21.15.154:0/4010122065 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a200b39f0 0x7f4a20152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:23.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.212+0000 7f4a2825c640 1 -- 172.21.15.154:0/4010122065 >> 172.21.15.154:0/4010122065 conn(0x7f4a200659d0 msgr2=0x7f4a2006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:23.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.212+0000 7f4a2825c640 1 -- 172.21.15.154:0/4010122065 shutdown_connections 2023-07-14T12:52:23.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-07-14T12:52:23.212+0000 7f4a2825c640 1 -- 172.21.15.154:0/4010122065 wait complete. 2023-07-14T12:52:23.256 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-14T12:52:23.257 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-14T12:52:23.260 INFO:tasks.ceph.osd.0:Started 2023-07-14T12:52:23.261 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-14T12:52:23.261 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-14T12:52:23.264 INFO:tasks.ceph.osd.1:Started 2023-07-14T12:52:23.264 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-14T12:52:23.265 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-14T12:52:23.268 INFO:tasks.ceph.osd.2:Started 2023-07-14T12:52:23.268 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-14T12:52:23.268 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-07-14T12:52:23.273 INFO:tasks.ceph.osd.3:Started 2023-07-14T12:52:23.273 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-14T12:52:23.274 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-07-14T12:52:23.277 INFO:tasks.ceph.osd.4:Started 2023-07-14T12:52:23.277 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-14T12:52:23.277 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-07-14T12:52:23.280 INFO:tasks.ceph.osd.5:Started 2023-07-14T12:52:23.281 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-14T12:52:23.281 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-07-14T12:52:23.284 INFO:tasks.ceph.osd.6:Started 2023-07-14T12:52:23.284 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-14T12:52:23.285 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-07-14T12:52:23.288 INFO:tasks.ceph.osd.7:Started 2023-07-14T12:52:23.288 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:52:23.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.455+0000 7f11435fa640 1 Processor -- start 2023-07-14T12:52:23.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.455+0000 7f11435fa640 1 -- start start 2023-07-14T12:52:23.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.455+0000 7f11435fa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f113c15fd60 0x7f113c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:23.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.455+0000 7f11435fa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f113c0ccaf0 con 0x7f113c0d1850 2023-07-14T12:52:23.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.455+0000 7f11435fa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f113c160320 con 0x7f113c0b7c70 2023-07-14T12:52:23.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.455+0000 7f11435fa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f113c0d1190 con 0x7f113c15fd60 2023-07-14T12:52:23.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.455+0000 7f1141b97640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f113c0d1850 0x7f113c0d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43264/0 (socket says 172.21.15.5:43264) 2023-07-14T12:52:23.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.455+0000 7f1141b97640 1 -- 172.21.15.5:0/3456798307 learned_addr learned my addr 172.21.15.5:0/3456798307 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:23.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.455+0000 7f1140b95640 1 --2- 172.21.15.5:0/3456798307 >> v2:172.21.15.154:3300/0 conn(0x7f113c15fd60 0x7f113c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:23.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.455+0000 7f1133fff640 1 -- 172.21.15.5:0/3456798307 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 238324984 0 0) 0x7f113c0ccaf0 con 0x7f113c0d1850 2023-07-14T12:52:23.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.455+0000 7f1133fff640 1 -- 172.21.15.5:0/3456798307 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1128003530 con 0x7f113c0d1850 2023-07-14T12:52:23.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.455+0000 7f1140b95640 1 -- 172.21.15.5:0/3456798307 >> v1:172.21.15.154:6789/0 conn(0x7f113c0b7c70 legacy=0x7f113c15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:23.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.455+0000 7f1133fff640 1 -- 172.21.15.5:0/3456798307 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1617755533 0 0) 0x7f113c160320 con 0x7f113c0b7c70 2023-07-14T12:52:23.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.455+0000 7f1140b95640 1 -- 172.21.15.5:0/3456798307 >> v1:172.21.15.5:6789/0 conn(0x7f113c0d1850 legacy=0x7f113c0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:23.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.455+0000 7f1140b95640 1 -- 172.21.15.5:0/3456798307 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113c0ccd90 con 0x7f113c15fd60 2023-07-14T12:52:23.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.459+0000 7f1140b95640 1 --2- 172.21.15.5:0/3456798307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f113c15fd60 0x7f113c0d0c50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f112c0097c0 tx=0x7f112c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1a4431c27d6219f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:23.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.459+0000 7f1133fff640 1 -- 172.21.15.5:0/3456798307 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c0a8050 con 0x7f113c15fd60 2023-07-14T12:52:23.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.459+0000 7f1133fff640 1 -- 172.21.15.5:0/3456798307 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112c0ac5f0 con 0x7f113c15fd60 2023-07-14T12:52:23.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.459+0000 7f1133fff640 1 -- 172.21.15.5:0/3456798307 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c0ac980 con 0x7f113c15fd60 2023-07-14T12:52:23.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.459+0000 7f11435fa640 1 -- 172.21.15.5:0/3456798307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f113c15fd60 msgr2=0x7f113c0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:23.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.459+0000 7f11435fa640 1 --2- 172.21.15.5:0/3456798307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f113c15fd60 0x7f113c0d0c50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f112c0097c0 tx=0x7f112c01c480 comp rx=0 tx=0).stop 2023-07-14T12:52:23.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.459+0000 7f11435fa640 1 -- 172.21.15.5:0/3456798307 shutdown_connections 2023-07-14T12:52:23.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.459+0000 7f11435fa640 1 --2- 172.21.15.5:0/3456798307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f113c15fd60 0x7f113c0d0c50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:23.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.459+0000 7f11435fa640 1 -- 172.21.15.5:0/3456798307 >> 172.21.15.5:0/3456798307 conn(0x7f113c0650b0 msgr2=0x7f113c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:23.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.459+0000 7f11435fa640 1 -- 172.21.15.5:0/3456798307 shutdown_connections 2023-07-14T12:52:23.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.459+0000 7f11435fa640 1 -- 172.21.15.5:0/3456798307 wait complete. 2023-07-14T12:52:23.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.463+0000 7f11435fa640 1 Processor -- start 2023-07-14T12:52:23.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.463+0000 7f11435fa640 1 -- start start 2023-07-14T12:52:23.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.463+0000 7f11435fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f113c0b7c70 0x7f113c14a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:23.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.463+0000 7f11435fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f113c0d1850 0x7f113c0b6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:23.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.463+0000 7f11435fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f113c15fd60 0x7f113c0b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:23.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.463+0000 7f11435fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113c14a710 con 0x7f113c0d1850 2023-07-14T12:52:23.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.463+0000 7f11435fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113c151510 con 0x7f113c0b7c70 2023-07-14T12:52:23.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.463+0000 7f11435fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113c1517f0 con 0x7f113c15fd60 2023-07-14T12:52:23.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.463+0000 7f1140b95640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f113c0d1850 0x7f113c0b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:23.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.463+0000 7f1141396640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f113c0b7c70 0x7f113c14a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:23.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.463+0000 7f1141396640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f113c0b7c70 0x7f113c14a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:40720/0 (socket says 172.21.15.5:40720) 2023-07-14T12:52:23.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.463+0000 7f1141396640 1 -- 172.21.15.5:0/2807498707 learned_addr learned my addr 172.21.15.5:0/2807498707 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:23.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.463+0000 7f1141b97640 1 --2- 172.21.15.5:0/2807498707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f113c15fd60 0x7f113c0b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:23.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.463+0000 7f1141396640 1 -- 172.21.15.5:0/2807498707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f113c15fd60 msgr2=0x7f113c0b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:23.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.463+0000 7f1141396640 1 --2- 172.21.15.5:0/2807498707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f113c15fd60 0x7f113c0b66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:23.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.463+0000 7f1141396640 1 -- 172.21.15.5:0/2807498707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f113c0d1850 msgr2=0x7f113c0b6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:23.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.463+0000 7f1141396640 1 --2- 172.21.15.5:0/2807498707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f113c0d1850 0x7f113c0b6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:23.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.463+0000 7f1141396640 1 -- 172.21.15.5:0/2807498707 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112c009420 con 0x7f113c0b7c70 2023-07-14T12:52:23.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.463+0000 7f1141396640 1 --2- 172.21.15.5:0/2807498707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f113c0b7c70 0x7f113c14a1d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f113800c450 tx=0x7f113800c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:23.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.463+0000 7f1131ffb640 1 -- 172.21.15.5:0/2807498707 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1138005480 con 0x7f113c0b7c70 2023-07-14T12:52:23.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.463+0000 7f1131ffb640 1 -- 172.21.15.5:0/2807498707 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1138003600 con 0x7f113c0b7c70 2023-07-14T12:52:23.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.463+0000 7f1131ffb640 1 -- 172.21.15.5:0/2807498707 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11380039b0 con 0x7f113c0b7c70 2023-07-14T12:52:23.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.463+0000 7f11435fa640 1 -- 172.21.15.5:0/2807498707 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f113c151ad0 con 0x7f113c0b7c70 2023-07-14T12:52:23.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.463+0000 7f1131ffb640 1 -- 172.21.15.5:0/2807498707 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1138012400 con 0x7f113c0b7c70 2023-07-14T12:52:23.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.463+0000 7f11435fa640 1 -- 172.21.15.5:0/2807498707 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f113c152090 con 0x7f113c0b7c70 2023-07-14T12:52:23.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.467+0000 7f1131ffb640 1 -- 172.21.15.5:0/2807498707 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f113801b3b0 con 0x7f113c0b7c70 2023-07-14T12:52:23.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.467+0000 7f11435fa640 1 -- 172.21.15.5:0/2807498707 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f113c0c9220 con 0x7f113c0b7c70 2023-07-14T12:52:23.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.467+0000 7f1131ffb640 1 -- 172.21.15.5:0/2807498707 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f1138017070 con 0x7f113c0b7c70 2023-07-14T12:52:23.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.523+0000 7f11435fa640 1 -- 172.21.15.5:0/2807498707 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f113c152280 con 0x7f113c0b7c70 2023-07-14T12:52:23.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.527+0000 7f1131ffb640 1 -- 172.21.15.5:0/2807498707 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f1138012890 con 0x7f113c0b7c70 2023-07-14T12:52:23.551 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:52:23.551 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":10,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:52:23.212067+0000","last_up_change":"0.000000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:52:23.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.527+0000 7f11435fa640 1 -- 172.21.15.5:0/2807498707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f113c0b7c70 msgr2=0x7f113c14a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:23.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.527+0000 7f11435fa640 1 --2- 172.21.15.5:0/2807498707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f113c0b7c70 0x7f113c14a1d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f113800c450 tx=0x7f113800c910 comp rx=0 tx=0).stop 2023-07-14T12:52:23.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.527+0000 7f11435fa640 1 -- 172.21.15.5:0/2807498707 shutdown_connections 2023-07-14T12:52:23.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.527+0000 7f11435fa640 1 --2- 172.21.15.5:0/2807498707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f113c15fd60 0x7f113c0b66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:23.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.527+0000 7f11435fa640 1 --2- 172.21.15.5:0/2807498707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f113c0d1850 0x7f113c0b6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:23.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.527+0000 7f11435fa640 1 --2- 172.21.15.5:0/2807498707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f113c0b7c70 0x7f113c14a1d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:23.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.527+0000 7f11435fa640 1 -- 172.21.15.5:0/2807498707 >> 172.21.15.5:0/2807498707 conn(0x7f113c0650b0 msgr2=0x7f113c0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:23.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.527+0000 7f11435fa640 1 -- 172.21.15.5:0/2807498707 shutdown_connections 2023-07-14T12:52:23.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:23.527+0000 7f11435fa640 1 -- 172.21.15.5:0/2807498707 wait complete. 2023-07-14T12:52:23.570 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-14T12:52:23.570 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-14T12:52:23.656 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T12:52:23.657 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T12:52:23.657 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2023-07-14T12:52:23.715 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:52:23.688+0000 7fef1704a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T12:52:23.849 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:52:23.824+0000 7fef1704a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T12:52:23.934 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-07-14T12:52:23.911+0000 7f9bae992640 -1 Falling back to public interface 2023-07-14T12:52:23.946 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-07-14T12:52:23.923+0000 7f068fd2d640 -1 Falling back to public interface 2023-07-14T12:52:23.947 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-07-14T12:52:23.923+0000 7f1fb628e640 -1 Falling back to public interface 2023-07-14T12:52:23.965 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-07-14T12:52:23.940+0000 7f0875257640 -1 Falling back to public interface 2023-07-14T12:52:23.966 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-07-14T12:52:23.943+0000 7f597ae63640 -1 Falling back to public interface 2023-07-14T12:52:23.981 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-07-14T12:52:23.956+0000 7f21f62e6640 -1 Falling back to public interface 2023-07-14T12:52:23.981 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-07-14T12:52:23.956+0000 7f353d8e4640 -1 Falling back to public interface 2023-07-14T12:52:24.013 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-07-14T12:52:23.988+0000 7f4f8d446640 -1 Falling back to public interface 2023-07-14T12:52:24.019 INFO:tasks.ceph.mgr.y.smithi005.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T12:52:24.019 INFO:tasks.ceph.mgr.y.smithi005.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T12:52:24.019 INFO:tasks.ceph.mgr.y.smithi005.stderr: from numpy import show_config as show_numpy_config 2023-07-14T12:52:24.029 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:52:24.004+0000 7fef1704a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T12:52:24.061 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:52:24.035+0000 7fa77d2d9180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T12:52:24.103 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:52:24.076+0000 7fef1704a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T12:52:24.200 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:52:24.175+0000 7fa77d2d9180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T12:52:24.238 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:52:24.212+0000 7fef1704a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T12:52:24.375 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-14T12:52:24.396 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:52:24.371+0000 7fa77d2d9180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T12:52:24.474 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:52:24.451+0000 7fa77d2d9180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T12:52:24.509 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.487+0000 7f53d9967640 1 Processor -- start 2023-07-14T12:52:24.509 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.487+0000 7f53d9967640 1 -- start start 2023-07-14T12:52:24.510 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.487+0000 7f53d9967640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f53d40b0170 0x7f53d40ca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:24.510 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.487+0000 7f53d9967640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f53d406cb20 0x7f53d415c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:24.511 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.487+0000 7f53d9967640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d40c8ef0 con 0x7f53d4070350 2023-07-14T12:52:24.511 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.487+0000 7f53d9967640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d40c9800 con 0x7f53d406cb20 2023-07-14T12:52:24.511 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.487+0000 7f53d9967640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d4070720 con 0x7f53d40b0170 2023-07-14T12:52:24.511 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.487+0000 7f53d37fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f53d406cb20 0x7f53d415c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:24.512 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.487+0000 7f53d37fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f53d406cb20 0x7f53d415c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50720/0 (socket says 172.21.15.5:50720) 2023-07-14T12:52:24.512 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.487+0000 7f53d37fe640 1 -- 172.21.15.5:0/1942515089 learned_addr learned my addr 172.21.15.5:0/1942515089 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:24.512 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.487+0000 7f53d27fc640 1 --2- 172.21.15.5:0/1942515089 >> v2:172.21.15.154:3300/0 conn(0x7f53d40b0170 0x7f53d40ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:24.512 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.487+0000 7f53d37fe640 1 -- 172.21.15.5:0/1942515089 >> v2:172.21.15.154:3300/0 conn(0x7f53d40b0170 msgr2=0x7f53d40ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:24.512 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.487+0000 7f53d37fe640 1 --2- 172.21.15.5:0/1942515089 >> v2:172.21.15.154:3300/0 conn(0x7f53d40b0170 0x7f53d40ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:24.512 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.487+0000 7f53d37fe640 1 -- 172.21.15.5:0/1942515089 >> v1:172.21.15.154:6789/0 conn(0x7f53d4070350 legacy=0x7f53d40afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:24.512 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.487+0000 7f53d37fe640 1 -- 172.21.15.5:0/1942515089 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d4158dd0 con 0x7f53d406cb20 2023-07-14T12:52:24.514 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.491+0000 7f53d37fe640 1 --2- 172.21.15.5:0/1942515089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53d406cb20 0x7f53d415c4c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f53d4071630 tx=0x7f53cc01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcf9055c0dd1fb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:24.514 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.491+0000 7f53d1ffb640 1 -- 172.21.15.5:0/1942515089 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc0a5780 con 0x7f53d406cb20 2023-07-14T12:52:24.514 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.491+0000 7f53d1ffb640 1 -- 172.21.15.5:0/1942515089 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53cc0a58e0 con 0x7f53d406cb20 2023-07-14T12:52:24.515 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.491+0000 7f53d1ffb640 1 -- 172.21.15.5:0/1942515089 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc0a5c70 con 0x7f53d406cb20 2023-07-14T12:52:24.515 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.491+0000 7f53d9967640 1 -- 172.21.15.5:0/1942515089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53d406cb20 msgr2=0x7f53d415c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:24.515 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.491+0000 7f53d9967640 1 --2- 172.21.15.5:0/1942515089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53d406cb20 0x7f53d415c4c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f53d4071630 tx=0x7f53cc01c9d0 comp rx=0 tx=0).stop 2023-07-14T12:52:24.516 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.491+0000 7f53d9967640 1 -- 172.21.15.5:0/1942515089 shutdown_connections 2023-07-14T12:52:24.516 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.491+0000 7f53d9967640 1 --2- 172.21.15.5:0/1942515089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53d406cb20 0x7f53d415c4c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:24.516 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.491+0000 7f53d9967640 1 --2- 172.21.15.5:0/1942515089 >> v2:172.21.15.154:3300/0 conn(0x7f53d40b0170 0x7f53d40ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:24.516 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.491+0000 7f53d9967640 1 -- 172.21.15.5:0/1942515089 >> 172.21.15.5:0/1942515089 conn(0x7f53d40caa60 msgr2=0x7f53d40cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:24.516 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.491+0000 7f53d9967640 1 -- 172.21.15.5:0/1942515089 shutdown_connections 2023-07-14T12:52:24.516 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.491+0000 7f53d9967640 1 -- 172.21.15.5:0/1942515089 wait complete. 2023-07-14T12:52:24.517 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.491+0000 7f53d9967640 1 Processor -- start 2023-07-14T12:52:24.517 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.495+0000 7f53d9967640 1 -- start start 2023-07-14T12:52:24.518 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.495+0000 7f53d9967640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53d406cb20 0x7f53d415bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:24.518 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.495+0000 7f53d9967640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53d4070350 0x7f53d4152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:24.519 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.495+0000 7f53d9967640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53d40b0170 0x7f53d4148af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:24.519 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.495+0000 7f53d9967640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d4149030 con 0x7f53d4070350 2023-07-14T12:52:24.519 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.495+0000 7f53d9967640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d40c7310 con 0x7f53d40b0170 2023-07-14T12:52:24.519 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.495+0000 7f53d9967640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d40c75f0 con 0x7f53d406cb20 2023-07-14T12:52:24.519 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.495+0000 7f53d27fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53d4070350 0x7f53d4152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:24.519 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.495+0000 7f53d27fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53d4070350 0x7f53d4152700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50736/0 (socket says 172.21.15.5:50736) 2023-07-14T12:52:24.519 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.495+0000 7f53d27fc640 1 -- 172.21.15.5:0/244993822 learned_addr learned my addr 172.21.15.5:0/244993822 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:24.519 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.495+0000 7f53d37fe640 1 --2- 172.21.15.5:0/244993822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53d40b0170 0x7f53d4148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:24.520 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.495+0000 7f53d2ffd640 1 --2- 172.21.15.5:0/244993822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53d406cb20 0x7f53d415bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:24.521 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.495+0000 7f53d27fc640 1 -- 172.21.15.5:0/244993822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53d406cb20 msgr2=0x7f53d415bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:24.521 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.495+0000 7f53d27fc640 1 --2- 172.21.15.5:0/244993822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53d406cb20 0x7f53d415bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:24.521 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.495+0000 7f53d27fc640 1 -- 172.21.15.5:0/244993822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53d40b0170 msgr2=0x7f53d4148af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:24.521 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.495+0000 7f53d27fc640 1 --2- 172.21.15.5:0/244993822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53d40b0170 0x7f53d4148af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:24.521 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.495+0000 7f53d27fc640 1 -- 172.21.15.5:0/244993822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc009b30 con 0x7f53d4070350 2023-07-14T12:52:24.521 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.495+0000 7f53d37fe640 1 --2- 172.21.15.5:0/244993822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53d40b0170 0x7f53d4148af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:52:24.522 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.495+0000 7f53d27fc640 1 --2- 172.21.15.5:0/244993822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53d4070350 0x7f53d4152700 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f53c800e900 tx=0x7f53c800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:24.522 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.495+0000 7f53bbfff640 1 -- 172.21.15.5:0/244993822 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8009690 con 0x7f53d4070350 2023-07-14T12:52:24.522 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.495+0000 7f53bbfff640 1 -- 172.21.15.5:0/244993822 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c800ca00 con 0x7f53d4070350 2023-07-14T12:52:24.522 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.495+0000 7f53bbfff640 1 -- 172.21.15.5:0/244993822 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c800cdb0 con 0x7f53d4070350 2023-07-14T12:52:24.522 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.495+0000 7f53d9967640 1 -- 172.21.15.5:0/244993822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d40c78d0 con 0x7f53d4070350 2023-07-14T12:52:24.522 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.495+0000 7f53bbfff640 1 -- 172.21.15.5:0/244993822 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f53c8013770 con 0x7f53d4070350 2023-07-14T12:52:24.522 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.495+0000 7f53d9967640 1 -- 172.21.15.5:0/244993822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d40c7e90 con 0x7f53d4070350 2023-07-14T12:52:24.522 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.495+0000 7f53bbfff640 1 -- 172.21.15.5:0/244993822 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f53c801c450 con 0x7f53d4070350 2023-07-14T12:52:24.523 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.495+0000 7f53d9967640 1 -- 172.21.15.5:0/244993822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d40c9400 con 0x7f53d4070350 2023-07-14T12:52:24.523 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.499+0000 7f53bbfff640 1 -- 172.21.15.5:0/244993822 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f53d40c9400 con 0x7f53d4070350 2023-07-14T12:52:24.581 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.555+0000 7f53d9967640 1 -- 172.21.15.5:0/244993822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53d404d7d0 con 0x7f53d4070350 2023-07-14T12:52:24.582 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.559+0000 7f53bbfff640 1 -- 172.21.15.5:0/244993822 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f53c802a090 con 0x7f53d4070350 2023-07-14T12:52:24.582 INFO:teuthology.misc.health.smithi005.stdout: 2023-07-14T12:52:24.583 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":10,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:52:23.212067+0000","last_up_change":"0.000000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:52:24.583 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.559+0000 7f53d9967640 1 -- 172.21.15.5:0/244993822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53d4070350 msgr2=0x7f53d4152700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:24.583 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.559+0000 7f53d9967640 1 --2- 172.21.15.5:0/244993822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53d4070350 0x7f53d4152700 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f53c800e900 tx=0x7f53c800edc0 comp rx=0 tx=0).stop 2023-07-14T12:52:24.584 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.559+0000 7f53d9967640 1 -- 172.21.15.5:0/244993822 shutdown_connections 2023-07-14T12:52:24.584 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.559+0000 7f53d9967640 1 --2- 172.21.15.5:0/244993822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53d40b0170 0x7f53d4148af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:24.584 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.559+0000 7f53d9967640 1 --2- 172.21.15.5:0/244993822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53d4070350 0x7f53d4152700 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:24.584 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.559+0000 7f53d9967640 1 --2- 172.21.15.5:0/244993822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53d406cb20 0x7f53d415bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:24.584 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.559+0000 7f53d9967640 1 -- 172.21.15.5:0/244993822 >> 172.21.15.5:0/244993822 conn(0x7f53d40caa60 msgr2=0x7f53d4159050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:24.584 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.559+0000 7f53d9967640 1 -- 172.21.15.5:0/244993822 shutdown_connections 2023-07-14T12:52:24.584 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:24.559+0000 7f53d9967640 1 -- 172.21.15.5:0/244993822 wait complete. 2023-07-14T12:52:24.600 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-14T12:52:24.623 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:52:24.599+0000 7fa77d2d9180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T12:52:24.922 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:52:24.896+0000 7fef1704a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T12:52:25.009 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:52:24.984+0000 7fef1704a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T12:52:25.198 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:52:25.172+0000 7fef1704a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T12:52:25.284 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:52:25.260+0000 7fef1704a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T12:52:25.327 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:52:25.303+0000 7fa77d2d9180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T12:52:25.418 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:52:25.395+0000 7fa77d2d9180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T12:52:25.568 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:52:25.540+0000 7fef1704a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T12:52:25.617 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:52:25.591+0000 7fa77d2d9180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T12:52:25.636 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:52:25.608+0000 7fef1704a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T12:52:25.713 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:52:25.691+0000 7fa77d2d9180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T12:52:26.009 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:52:25.983+0000 7fa77d2d9180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T12:52:26.080 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:52:26.055+0000 7fa77d2d9180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T12:52:26.659 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:52:26.632+0000 7feebde2d640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-14T12:52:26.660 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:52:26.636+0000 7feebde2d640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-14T12:52:27.797 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-07-14T12:52:27.775+0000 7f9bae992640 -1 osd.2 0 log_to_monitors true 2023-07-14T12:52:27.866 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-07-14T12:52:27.840+0000 7f21f62e6640 -1 osd.4 0 log_to_monitors true 2023-07-14T12:52:27.871 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-07-14T12:52:27.847+0000 7f1fb628e640 -1 osd.1 0 log_to_monitors true 2023-07-14T12:52:27.918 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-07-14T12:52:27.895+0000 7f068fd2d640 -1 osd.0 0 log_to_monitors true 2023-07-14T12:52:27.927 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-07-14T12:52:27.900+0000 7f353d8e4640 -1 osd.7 0 log_to_monitors true 2023-07-14T12:52:27.947 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-07-14T12:52:27.923+0000 7f597ae63640 -1 osd.3 0 log_to_monitors true 2023-07-14T12:52:28.089 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-07-14T12:52:28.064+0000 7f0875257640 -1 osd.5 0 log_to_monitors true 2023-07-14T12:52:28.148 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-07-14T12:52:28.120+0000 7f4f8d446640 -1 osd.6 0 log_to_monitors true 2023-07-14T12:52:31.406 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-14T12:52:31.521 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-07-14T12:52:31.495+0000 7f1fb1a12640 -1 osd.1 0 waiting for initial osdmap 2023-07-14T12:52:31.539 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-07-14T12:52:31.515+0000 7f9baa114640 -1 osd.2 0 waiting for initial osdmap 2023-07-14T12:52:31.566 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-07-14T12:52:31.543+0000 7f1faa057640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T12:52:31.586 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-07-14T12:52:31.563+0000 7f9ba2759640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T12:52:31.612 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.587+0000 7f24d4b70640 1 Processor -- start 2023-07-14T12:52:31.612 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.587+0000 7f24d4b70640 1 -- start start 2023-07-14T12:52:31.613 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.587+0000 7f24d4b70640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24d00cc890 0x7f24d00cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:31.613 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.587+0000 7f24d4b70640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d00b3b20 con 0x7f24d00d0520 2023-07-14T12:52:31.614 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.591+0000 7f24d4b70640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d00cdeb0 con 0x7f24d00b3750 2023-07-14T12:52:31.614 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.591+0000 7f24d4b70640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00cdcc0 con 0x7f24d00cc890 2023-07-14T12:52:31.614 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.591+0000 7f24ceffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f24d00d0520 0x7f24d00b5400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39652/0 (socket says 172.21.15.5:39652) 2023-07-14T12:52:31.615 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.591+0000 7f24ceffd640 1 -- 172.21.15.5:0/3834606663 learned_addr learned my addr 172.21.15.5:0/3834606663 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:31.615 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.591+0000 7f24cffff640 1 --2- 172.21.15.5:0/3834606663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24d00cc890 0x7f24d00cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:31.615 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.591+0000 7f24ce7fc640 1 -- 172.21.15.5:0/3834606663 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2245700038 0 0) 0x7f24d00b3b20 con 0x7f24d00d0520 2023-07-14T12:52:31.615 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.591+0000 7f24ce7fc640 1 -- 172.21.15.5:0/3834606663 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24b8003530 con 0x7f24d00d0520 2023-07-14T12:52:31.615 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.591+0000 7f24cffff640 1 -- 172.21.15.5:0/3834606663 >> v1:172.21.15.154:6789/0 conn(0x7f24d00b3750 legacy=0x7f24d00cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:31.615 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.591+0000 7f24cffff640 1 -- 172.21.15.5:0/3834606663 >> v1:172.21.15.5:6789/0 conn(0x7f24d00d0520 legacy=0x7f24d00b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:31.616 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.591+0000 7f24cffff640 1 -- 172.21.15.5:0/3834606663 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d00ce190 con 0x7f24d00cc890 2023-07-14T12:52:31.617 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.595+0000 7f24cffff640 1 --2- 172.21.15.5:0/3834606663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24d00cc890 0x7f24d00cd780 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f24c8009dc0 tx=0x7f24c801c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a65a24aa36d44ef7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:31.618 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.595+0000 7f24ce7fc640 1 -- 172.21.15.5:0/3834606663 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c80a5870 con 0x7f24d00cc890 2023-07-14T12:52:31.618 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.595+0000 7f24ce7fc640 1 -- 172.21.15.5:0/3834606663 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c80a59d0 con 0x7f24d00cc890 2023-07-14T12:52:31.618 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.595+0000 7f24ce7fc640 1 -- 172.21.15.5:0/3834606663 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c80a5d60 con 0x7f24d00cc890 2023-07-14T12:52:31.619 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.595+0000 7f24d4b70640 1 -- 172.21.15.5:0/3834606663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24d00cc890 msgr2=0x7f24d00cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:31.619 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.595+0000 7f24d4b70640 1 --2- 172.21.15.5:0/3834606663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24d00cc890 0x7f24d00cd780 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f24c8009dc0 tx=0x7f24c801c8a0 comp rx=0 tx=0).stop 2023-07-14T12:52:31.619 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.595+0000 7f24d4b70640 1 -- 172.21.15.5:0/3834606663 shutdown_connections 2023-07-14T12:52:31.619 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.595+0000 7f24d4b70640 1 --2- 172.21.15.5:0/3834606663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24d00cc890 0x7f24d00cd780 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:31.619 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.595+0000 7f24d4b70640 1 -- 172.21.15.5:0/3834606663 >> 172.21.15.5:0/3834606663 conn(0x7f24d009b4d0 msgr2=0x7f24d00d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:31.619 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.595+0000 7f24d4b70640 1 -- 172.21.15.5:0/3834606663 shutdown_connections 2023-07-14T12:52:31.620 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.595+0000 7f24d4b70640 1 -- 172.21.15.5:0/3834606663 wait complete. 2023-07-14T12:52:31.620 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.595+0000 7f24d4b70640 1 Processor -- start 2023-07-14T12:52:31.621 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.595+0000 7f24d4b70640 1 -- start start 2023-07-14T12:52:31.622 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.599+0000 7f24d4b70640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24d00b3750 0x7f24d014d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:31.622 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.599+0000 7f24d4b70640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24d00cc890 0x7f24d0156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:31.622 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.599+0000 7f24d4b70640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24d00d0520 0x7f24d006a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:31.622 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.599+0000 7f24d4b70640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00c6ab0 con 0x7f24d00cc890 2023-07-14T12:52:31.623 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.599+0000 7f24d4b70640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00c5e30 con 0x7f24d00d0520 2023-07-14T12:52:31.623 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.599+0000 7f24d4b70640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00c6110 con 0x7f24d00b3750 2023-07-14T12:52:31.623 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.599+0000 7f24ceffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24d00cc890 0x7f24d0156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:31.623 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.599+0000 7f24ceffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24d00cc890 0x7f24d0156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59200/0 (socket says 172.21.15.5:59200) 2023-07-14T12:52:31.623 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.599+0000 7f24ceffd640 1 -- 172.21.15.5:0/1617605728 learned_addr learned my addr 172.21.15.5:0/1617605728 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:31.623 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.599+0000 7f24cf7fe640 1 --2- 172.21.15.5:0/1617605728 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24d00b3750 0x7f24d014d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:31.624 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.599+0000 7f24cffff640 1 --2- 172.21.15.5:0/1617605728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24d00d0520 0x7f24d006a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:31.624 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.599+0000 7f24ceffd640 1 -- 172.21.15.5:0/1617605728 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24d00b3750 msgr2=0x7f24d014d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:31.625 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.599+0000 7f24ceffd640 1 --2- 172.21.15.5:0/1617605728 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24d00b3750 0x7f24d014d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:31.625 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.599+0000 7f24ceffd640 1 -- 172.21.15.5:0/1617605728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24d00d0520 msgr2=0x7f24d006a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:31.625 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.599+0000 7f24ceffd640 1 --2- 172.21.15.5:0/1617605728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24d00d0520 0x7f24d006a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:31.625 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.599+0000 7f24ceffd640 1 -- 172.21.15.5:0/1617605728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c8009a70 con 0x7f24d00cc890 2023-07-14T12:52:31.625 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.599+0000 7f24cffff640 1 --2- 172.21.15.5:0/1617605728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24d00d0520 0x7f24d006a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:52:31.625 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.599+0000 7f24ceffd640 1 --2- 172.21.15.5:0/1617605728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24d00cc890 0x7f24d0156580 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f24c400c470 tx=0x7f24c400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:31.625 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.599+0000 7f24b7fff640 1 -- 172.21.15.5:0/1617605728 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c40074e0 con 0x7f24d00cc890 2023-07-14T12:52:31.626 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.599+0000 7f24b7fff640 1 -- 172.21.15.5:0/1617605728 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c4007640 con 0x7f24d00cc890 2023-07-14T12:52:31.626 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.599+0000 7f24b7fff640 1 -- 172.21.15.5:0/1617605728 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c40049f0 con 0x7f24d00cc890 2023-07-14T12:52:31.626 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.599+0000 7f24d4b70640 1 -- 172.21.15.5:0/1617605728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d00c63f0 con 0x7f24d00cc890 2023-07-14T12:52:31.626 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.599+0000 7f24d4b70640 1 -- 172.21.15.5:0/1617605728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d014dc30 con 0x7f24d00cc890 2023-07-14T12:52:31.626 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.603+0000 7f24d4b70640 1 -- 172.21.15.5:0/1617605728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d00c6bf0 con 0x7f24d00cc890 2023-07-14T12:52:31.628 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.603+0000 7f24b7fff640 1 -- 172.21.15.5:0/1617605728 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 85602+0+0 (secure 0 0 0) 0x7f24c4004b50 con 0x7f24d00cc890 2023-07-14T12:52:31.629 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.607+0000 7f24b7fff640 1 --2- 172.21.15.5:0/1617605728 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f24bc0661f0 0x7f24bc0686a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:31.629 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.607+0000 7f24b7fff640 1 -- 172.21.15.5:0/1617605728 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f24c4081ee0 con 0x7f24d00cc890 2023-07-14T12:52:31.630 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.607+0000 7f24cf7fe640 1 --2- 172.21.15.5:0/1617605728 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f24bc0661f0 0x7f24bc0686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:31.630 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.607+0000 7f24cf7fe640 1 --2- 172.21.15.5:0/1617605728 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f24bc0661f0 0x7f24bc0686a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f24c0007fd0 tx=0x7f24c0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:31.638 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.615+0000 7f24b7fff640 1 -- 172.21.15.5:0/1617605728 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f24d00c6bf0 con 0x7f24d00cc890 2023-07-14T12:52:31.659 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-07-14T12:52:31.635+0000 7f59765e5640 -1 osd.3 0 waiting for initial osdmap 2023-07-14T12:52:31.690 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-07-14T12:52:31.667+0000 7f596ec2a640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T12:52:31.719 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-07-14T12:52:31.695+0000 7f068b4b1640 -1 osd.0 0 waiting for initial osdmap 2023-07-14T12:52:31.758 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-07-14T12:52:31.735+0000 7f0683af6640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T12:52:31.829 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.803+0000 7f24d4b70640 1 -- 172.21.15.5:0/1617605728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24d00c6bf0 con 0x7f24d00cc890 2023-07-14T12:52:31.830 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.807+0000 7f24b7fff640 1 -- 172.21.15.5:0/1617605728 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f24d00c6bf0 con 0x7f24d00cc890 2023-07-14T12:52:31.830 INFO:teuthology.misc.health.smithi005.stdout: 2023-07-14T12:52:31.830 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":12,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:52:29.639865+0000","last_up_change":"0.000000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:52:31.831 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.807+0000 7f24d4b70640 1 -- 172.21.15.5:0/1617605728 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f24bc0661f0 msgr2=0x7f24bc0686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:31.832 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.807+0000 7f24d4b70640 1 --2- 172.21.15.5:0/1617605728 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f24bc0661f0 0x7f24bc0686a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f24c0007fd0 tx=0x7f24c0009040 comp rx=0 tx=0).stop 2023-07-14T12:52:31.832 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.807+0000 7f24d4b70640 1 -- 172.21.15.5:0/1617605728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24d00cc890 msgr2=0x7f24d0156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:31.832 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.807+0000 7f24d4b70640 1 --2- 172.21.15.5:0/1617605728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24d00cc890 0x7f24d0156580 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f24c400c470 tx=0x7f24c400c930 comp rx=0 tx=0).stop 2023-07-14T12:52:31.832 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.807+0000 7f24d4b70640 1 -- 172.21.15.5:0/1617605728 shutdown_connections 2023-07-14T12:52:31.832 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.807+0000 7f24d4b70640 1 --2- 172.21.15.5:0/1617605728 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f24bc0661f0 0x7f24bc0686a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:31.832 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.807+0000 7f24d4b70640 1 --2- 172.21.15.5:0/1617605728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24d00d0520 0x7f24d006a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:31.832 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.807+0000 7f24d4b70640 1 --2- 172.21.15.5:0/1617605728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24d00cc890 0x7f24d0156580 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:31.833 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.807+0000 7f24d4b70640 1 --2- 172.21.15.5:0/1617605728 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f24d00b3750 0x7f24d014d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:31.833 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.807+0000 7f24d4b70640 1 -- 172.21.15.5:0/1617605728 >> 172.21.15.5:0/1617605728 conn(0x7f24d009b4d0 msgr2=0x7f24d015b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:31.833 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.807+0000 7f24d4b70640 1 -- 172.21.15.5:0/1617605728 shutdown_connections 2023-07-14T12:52:31.833 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:31.807+0000 7f24d4b70640 1 -- 172.21.15.5:0/1617605728 wait complete. 2023-07-14T12:52:31.850 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-14T12:52:32.026 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-07-14T12:52:32.000+0000 7f4f88bc8640 -1 osd.6 0 waiting for initial osdmap 2023-07-14T12:52:32.046 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-07-14T12:52:32.020+0000 7f3539066640 -1 osd.7 0 waiting for initial osdmap 2023-07-14T12:52:32.060 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-07-14T12:52:32.036+0000 7f21f1a68640 -1 osd.4 0 waiting for initial osdmap 2023-07-14T12:52:32.061 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-07-14T12:52:32.036+0000 7f4f8120d640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T12:52:32.070 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-07-14T12:52:32.044+0000 7f08709d9640 -1 osd.5 0 waiting for initial osdmap 2023-07-14T12:52:32.076 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-07-14T12:52:32.052+0000 7f35316ab640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T12:52:32.096 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-07-14T12:52:32.072+0000 7f21ea0ad640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T12:52:32.104 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-07-14T12:52:32.080+0000 7f086901e640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T12:52:38.658 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-14T12:52:38.802 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.779+0000 7f9cdf6bd640 1 Processor -- start 2023-07-14T12:52:38.803 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.779+0000 7f9cdf6bd640 1 -- start start 2023-07-14T12:52:38.804 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.779+0000 7f9cdf6bd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9cd80d16e0 0x7f9cd8166e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:38.804 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.779+0000 7f9cdf6bd640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd80b1c50 con 0x7f9cd80b4570 2023-07-14T12:52:38.805 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.779+0000 7f9cdf6bd640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd80d2840 con 0x7f9cd80ce6e0 2023-07-14T12:52:38.805 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.779+0000 7f9cdf6bd640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cd80cff60 con 0x7f9cd80d16e0 2023-07-14T12:52:38.805 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.779+0000 7f9cdcc58640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9cd80b4570 0x7f9cd81636e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39662/0 (socket says 172.21.15.5:39662) 2023-07-14T12:52:38.805 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.779+0000 7f9cdcc58640 1 -- 172.21.15.5:0/640375887 learned_addr learned my addr 172.21.15.5:0/640375887 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:38.805 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.779+0000 7f9cddc5a640 1 --2- 172.21.15.5:0/640375887 >> v2:172.21.15.154:3300/0 conn(0x7f9cd80d16e0 0x7f9cd8166e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:38.806 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.779+0000 7f9ccffff640 1 -- 172.21.15.5:0/640375887 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307412919 0 0) 0x7f9cc8001120 con 0x7f9cd80b4570 2023-07-14T12:52:38.806 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.779+0000 7f9ccffff640 1 -- 172.21.15.5:0/640375887 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cc4003530 con 0x7f9cd80b4570 2023-07-14T12:52:38.806 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.779+0000 7f9ccffff640 1 -- 172.21.15.5:0/640375887 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 253685811 0 0) 0x7f9cd80d2840 con 0x7f9cd80ce6e0 2023-07-14T12:52:38.806 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.779+0000 7f9ccffff640 1 -- 172.21.15.5:0/640375887 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cc8001120 con 0x7f9cd80ce6e0 2023-07-14T12:52:38.807 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.779+0000 7f9cddc5a640 1 -- 172.21.15.5:0/640375887 >> v1:172.21.15.154:6789/0 conn(0x7f9cd80ce6e0 legacy=0x7f9cd80ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:38.807 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.779+0000 7f9cddc5a640 1 -- 172.21.15.5:0/640375887 >> v1:172.21.15.5:6789/0 conn(0x7f9cd80b4570 legacy=0x7f9cd81636e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:38.807 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.779+0000 7f9cddc5a640 1 -- 172.21.15.5:0/640375887 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd80d0240 con 0x7f9cd80d16e0 2023-07-14T12:52:38.808 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.783+0000 7f9cddc5a640 1 --2- 172.21.15.5:0/640375887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd80d16e0 0x7f9cd8166e10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0009d90 tx=0x7f9cd001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aadb274e087902fe server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:38.808 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.783+0000 7f9ccffff640 1 -- 172.21.15.5:0/640375887 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd00a59e0 con 0x7f9cd80d16e0 2023-07-14T12:52:38.809 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.783+0000 7f9ccffff640 1 -- 172.21.15.5:0/640375887 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd00a5b40 con 0x7f9cd80d16e0 2023-07-14T12:52:38.809 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.783+0000 7f9ccffff640 1 -- 172.21.15.5:0/640375887 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd00ad440 con 0x7f9cd80d16e0 2023-07-14T12:52:38.809 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.783+0000 7f9cdf6bd640 1 -- 172.21.15.5:0/640375887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd80d16e0 msgr2=0x7f9cd8166e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:38.810 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.783+0000 7f9cdf6bd640 1 --2- 172.21.15.5:0/640375887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd80d16e0 0x7f9cd8166e10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0009d90 tx=0x7f9cd001c920 comp rx=0 tx=0).stop 2023-07-14T12:52:38.810 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.783+0000 7f9cdf6bd640 1 -- 172.21.15.5:0/640375887 shutdown_connections 2023-07-14T12:52:38.810 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.783+0000 7f9cdf6bd640 1 --2- 172.21.15.5:0/640375887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd80d16e0 0x7f9cd8166e10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:38.810 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.783+0000 7f9cdf6bd640 1 -- 172.21.15.5:0/640375887 >> 172.21.15.5:0/640375887 conn(0x7f9cd8070b60 msgr2=0x7f9cd8070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:38.810 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.787+0000 7f9cdf6bd640 1 -- 172.21.15.5:0/640375887 shutdown_connections 2023-07-14T12:52:38.810 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.787+0000 7f9cdf6bd640 1 -- 172.21.15.5:0/640375887 wait complete. 2023-07-14T12:52:38.811 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.787+0000 7f9cdf6bd640 1 Processor -- start 2023-07-14T12:52:38.811 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.787+0000 7f9cdf6bd640 1 -- start start 2023-07-14T12:52:38.812 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.787+0000 7f9cdf6bd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd80b4570 0x7f9cd80cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:38.813 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.787+0000 7f9cdf6bd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cd80ce6e0 0x7f9cd8155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:38.813 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.787+0000 7f9cdf6bd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cd80d16e0 0x7f9cd80c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:38.813 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.787+0000 7f9cdf6bd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd80c5ec0 con 0x7f9cd80d16e0 2023-07-14T12:52:38.813 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.787+0000 7f9cdf6bd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd8156400 con 0x7f9cd80b4570 2023-07-14T12:52:38.813 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.787+0000 7f9cdf6bd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd81566e0 con 0x7f9cd80ce6e0 2023-07-14T12:52:38.813 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.787+0000 7f9cddc5a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cd80d16e0 0x7f9cd80c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:38.814 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.787+0000 7f9cddc5a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cd80d16e0 0x7f9cd80c9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59214/0 (socket says 172.21.15.5:59214) 2023-07-14T12:52:38.814 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.787+0000 7f9cddc5a640 1 -- 172.21.15.5:0/3960154584 learned_addr learned my addr 172.21.15.5:0/3960154584 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:38.815 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.787+0000 7f9cdd459640 1 --2- 172.21.15.5:0/3960154584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd80b4570 0x7f9cd80cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:38.815 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.787+0000 7f9cdcc58640 1 --2- 172.21.15.5:0/3960154584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cd80ce6e0 0x7f9cd8155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:38.815 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.787+0000 7f9cddc5a640 1 -- 172.21.15.5:0/3960154584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cd80ce6e0 msgr2=0x7f9cd8155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:38.815 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.787+0000 7f9cddc5a640 1 --2- 172.21.15.5:0/3960154584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cd80ce6e0 0x7f9cd8155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:38.815 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.787+0000 7f9cddc5a640 1 -- 172.21.15.5:0/3960154584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd80b4570 msgr2=0x7f9cd80cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:38.815 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.787+0000 7f9cddc5a640 1 --2- 172.21.15.5:0/3960154584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd80b4570 0x7f9cd80cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:38.816 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.787+0000 7f9cddc5a640 1 -- 172.21.15.5:0/3960154584 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd0009a70 con 0x7f9cd80d16e0 2023-07-14T12:52:38.816 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.787+0000 7f9cdd459640 1 --2- 172.21.15.5:0/3960154584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd80b4570 0x7f9cd80cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:52:38.816 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.791+0000 7f9cddc5a640 1 --2- 172.21.15.5:0/3960154584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cd80d16e0 0x7f9cd80c9460 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9cd00b0040 tx=0x7f9cd00196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:38.816 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.791+0000 7f9ccdffb640 1 -- 172.21.15.5:0/3960154584 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd00adce0 con 0x7f9cd80d16e0 2023-07-14T12:52:38.816 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.791+0000 7f9ccdffb640 1 -- 172.21.15.5:0/3960154584 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd00ade40 con 0x7f9cd80d16e0 2023-07-14T12:52:38.816 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.791+0000 7f9ccdffb640 1 -- 172.21.15.5:0/3960154584 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd00b9690 con 0x7f9cd80d16e0 2023-07-14T12:52:38.816 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.791+0000 7f9cdf6bd640 1 -- 172.21.15.5:0/3960154584 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd81569c0 con 0x7f9cd80d16e0 2023-07-14T12:52:38.817 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.791+0000 7f9cdf6bd640 1 -- 172.21.15.5:0/3960154584 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd8156f80 con 0x7f9cd80d16e0 2023-07-14T12:52:38.817 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.791+0000 7f9cdf6bd640 1 -- 172.21.15.5:0/3960154584 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cd8157170 con 0x7f9cd80d16e0 2023-07-14T12:52:38.817 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.791+0000 7f9ccdffb640 1 -- 172.21.15.5:0/3960154584 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9cd00b97f0 con 0x7f9cd80d16e0 2023-07-14T12:52:38.818 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.791+0000 7f9ccdffb640 1 --2- 172.21.15.5:0/3960154584 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9cbc066280 0x7f9cbc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:38.818 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.791+0000 7f9ccdffb640 1 -- 172.21.15.5:0/3960154584 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9cd011f130 con 0x7f9cd80d16e0 2023-07-14T12:52:38.818 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.791+0000 7f9cdd459640 1 --2- 172.21.15.5:0/3960154584 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9cbc066280 0x7f9cbc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:38.818 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.795+0000 7f9cdd459640 1 --2- 172.21.15.5:0/3960154584 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9cbc066280 0x7f9cbc068730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9cd40011f0 tx=0x7f9cd4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:38.822 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.799+0000 7f9ccdffb640 1 -- 172.21.15.5:0/3960154584 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9cd00ec940 con 0x7f9cd80d16e0 2023-07-14T12:52:38.982 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.959+0000 7f9cdf6bd640 1 -- 172.21.15.5:0/3960154584 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cd804d7d0 con 0x7f9cd80d16e0 2023-07-14T12:52:38.982 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.959+0000 7f9ccdffb640 1 -- 172.21.15.5:0/3960154584 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12802 (secure 0 0 0) 0x7f9cd0009450 con 0x7f9cd80d16e0 2023-07-14T12:52:38.983 INFO:teuthology.misc.health.smithi005.stdout: 2023-07-14T12:52:38.983 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":16,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:52:35.779859+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:52:38.984 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.959+0000 7f9cdf6bd640 1 -- 172.21.15.5:0/3960154584 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9cbc066280 msgr2=0x7f9cbc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:38.985 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.959+0000 7f9cdf6bd640 1 --2- 172.21.15.5:0/3960154584 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9cbc066280 0x7f9cbc068730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9cd40011f0 tx=0x7f9cd4009040 comp rx=0 tx=0).stop 2023-07-14T12:52:38.985 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.959+0000 7f9cdf6bd640 1 -- 172.21.15.5:0/3960154584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cd80d16e0 msgr2=0x7f9cd80c9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:38.985 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.959+0000 7f9cdf6bd640 1 --2- 172.21.15.5:0/3960154584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cd80d16e0 0x7f9cd80c9460 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9cd00b0040 tx=0x7f9cd00196c0 comp rx=0 tx=0).stop 2023-07-14T12:52:38.985 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.959+0000 7f9cdf6bd640 1 -- 172.21.15.5:0/3960154584 shutdown_connections 2023-07-14T12:52:38.985 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.959+0000 7f9cdf6bd640 1 --2- 172.21.15.5:0/3960154584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cd80d16e0 0x7f9cd80c9460 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:38.985 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.959+0000 7f9cdf6bd640 1 --2- 172.21.15.5:0/3960154584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cd80ce6e0 0x7f9cd8155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:38.986 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.959+0000 7f9cdf6bd640 1 --2- 172.21.15.5:0/3960154584 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9cbc066280 0x7f9cbc068730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:38.986 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.959+0000 7f9cdf6bd640 1 --2- 172.21.15.5:0/3960154584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd80b4570 0x7f9cd80cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:38.986 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.959+0000 7f9cdf6bd640 1 -- 172.21.15.5:0/3960154584 >> 172.21.15.5:0/3960154584 conn(0x7f9cd8070b60 msgr2=0x7f9cd80b6540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:38.986 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.959+0000 7f9cdf6bd640 1 -- 172.21.15.5:0/3960154584 shutdown_connections 2023-07-14T12:52:38.986 INFO:teuthology.misc.health.smithi005.stderr:2023-07-14T12:52:38.959+0000 7f9cdf6bd640 1 -- 172.21.15.5:0/3960154584 wait complete. 2023-07-14T12:52:39.002 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-14T12:52:39.003 INFO:tasks.ceph:Creating RBD pool 2023-07-14T12:52:39.003 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-14T12:52:39.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.119+0000 7fda3be6a640 1 Processor -- start 2023-07-14T12:52:39.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.123+0000 7fda3be6a640 1 -- start start 2023-07-14T12:52:39.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.123+0000 7fda3be6a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda3415cef0 0x7fda34158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:39.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.123+0000 7fda3be6a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda34159270 0x7fda340c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:39.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.123+0000 7fda3be6a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda341532b0 con 0x7fda340aeb40 2023-07-14T12:52:39.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.123+0000 7fda3be6a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda3415d360 con 0x7fda34159270 2023-07-14T12:52:39.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.123+0000 7fda3be6a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda340ca6f0 con 0x7fda3415cef0 2023-07-14T12:52:39.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.123+0000 7fda3a407640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda34159270 0x7fda340c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:39.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.123+0000 7fda3a407640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda34159270 0x7fda340c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53192/0 (socket says 172.21.15.5:53192) 2023-07-14T12:52:39.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.123+0000 7fda39c06640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fda340aeb40 0x7fda340aef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39006/0 (socket says 172.21.15.5:39006) 2023-07-14T12:52:39.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.123+0000 7fda3a407640 1 -- 172.21.15.5:0/685713991 learned_addr learned my addr 172.21.15.5:0/685713991 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:39.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.123+0000 7fda39405640 1 --2- 172.21.15.5:0/685713991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda3415cef0 0x7fda34158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:39.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.123+0000 7fda3a407640 1 -- 172.21.15.5:0/685713991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda3415cef0 msgr2=0x7fda34158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:39.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.123+0000 7fda3a407640 1 --2- 172.21.15.5:0/685713991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda3415cef0 0x7fda34158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:39.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.123+0000 7fda3a407640 1 -- 172.21.15.5:0/685713991 >> v1:172.21.15.5:6789/0 conn(0x7fda340aeb40 legacy=0x7fda340aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:39.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.123+0000 7fda3a407640 1 -- 172.21.15.5:0/685713991 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda341599d0 con 0x7fda34159270 2023-07-14T12:52:39.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.123+0000 7fda38c04640 1 -- 172.21.15.5:0/685713991 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753735302 0 0) 0x7fda341532b0 con 0x7fda340aeb40 2023-07-14T12:52:39.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.127+0000 7fda3a407640 1 --2- 172.21.15.5:0/685713991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda34159270 0x7fda340c88c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fda2c009e50 tx=0x7fda2c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59340e23ec49e481 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:39.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.127+0000 7fda38c04640 1 -- 172.21.15.5:0/685713991 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c0a58a0 con 0x7fda34159270 2023-07-14T12:52:39.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.127+0000 7fda38c04640 1 -- 172.21.15.5:0/685713991 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2c0a5a00 con 0x7fda34159270 2023-07-14T12:52:39.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.127+0000 7fda38c04640 1 -- 172.21.15.5:0/685713991 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c0a5d90 con 0x7fda34159270 2023-07-14T12:52:39.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.127+0000 7fda3be6a640 1 -- 172.21.15.5:0/685713991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda34159270 msgr2=0x7fda340c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:39.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.127+0000 7fda3be6a640 1 --2- 172.21.15.5:0/685713991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda34159270 0x7fda340c88c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fda2c009e50 tx=0x7fda2c01c9e0 comp rx=0 tx=0).stop 2023-07-14T12:52:39.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.127+0000 7fda3be6a640 1 -- 172.21.15.5:0/685713991 shutdown_connections 2023-07-14T12:52:39.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.127+0000 7fda3be6a640 1 --2- 172.21.15.5:0/685713991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda34159270 0x7fda340c88c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:39.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.127+0000 7fda3be6a640 1 --2- 172.21.15.5:0/685713991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda3415cef0 0x7fda34158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:39.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.127+0000 7fda3be6a640 1 -- 172.21.15.5:0/685713991 >> 172.21.15.5:0/685713991 conn(0x7fda340cde90 msgr2=0x7fda340ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:39.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.127+0000 7fda3be6a640 1 -- 172.21.15.5:0/685713991 shutdown_connections 2023-07-14T12:52:39.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.127+0000 7fda3be6a640 1 -- 172.21.15.5:0/685713991 wait complete. 2023-07-14T12:52:39.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.127+0000 7fda3be6a640 1 Processor -- start 2023-07-14T12:52:39.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.127+0000 7fda3be6a640 1 -- start start 2023-07-14T12:52:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.131+0000 7fda3be6a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda340aeb40 0x7fda3406fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.131+0000 7fda3be6a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda34159270 0x7fda34156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.131+0000 7fda3be6a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda3415cef0 0x7fda3414ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.131+0000 7fda3be6a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda34158030 con 0x7fda3415cef0 2023-07-14T12:52:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.131+0000 7fda3be6a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda341f40b0 con 0x7fda340aeb40 2023-07-14T12:52:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.131+0000 7fda3be6a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda34070120 con 0x7fda34159270 2023-07-14T12:52:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.131+0000 7fda3a407640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda3415cef0 0x7fda3414ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.131+0000 7fda3a407640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda3415cef0 0x7fda3414ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53202/0 (socket says 172.21.15.5:53202) 2023-07-14T12:52:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.131+0000 7fda3a407640 1 -- 172.21.15.5:0/3274316872 learned_addr learned my addr 172.21.15.5:0/3274316872 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.131+0000 7fda3a407640 1 -- 172.21.15.5:0/3274316872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda34159270 msgr2=0x7fda34156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.131+0000 7fda3a407640 1 --2- 172.21.15.5:0/3274316872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda34159270 0x7fda34156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.131+0000 7fda3a407640 1 -- 172.21.15.5:0/3274316872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda340aeb40 msgr2=0x7fda3406fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.131+0000 7fda3a407640 1 --2- 172.21.15.5:0/3274316872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda340aeb40 0x7fda3406fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:39.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.131+0000 7fda3a407640 1 -- 172.21.15.5:0/3274316872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2c009b30 con 0x7fda3415cef0 2023-07-14T12:52:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.131+0000 7fda3a407640 1 --2- 172.21.15.5:0/3274316872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda3415cef0 0x7fda3414ee20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fda2c009e50 tx=0x7fda2c019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.131+0000 7fda2a7fc640 1 -- 172.21.15.5:0/3274316872 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c0b8680 con 0x7fda3415cef0 2023-07-14T12:52:39.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.131+0000 7fda2a7fc640 1 -- 172.21.15.5:0/3274316872 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2c0b87e0 con 0x7fda3415cef0 2023-07-14T12:52:39.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.131+0000 7fda2a7fc640 1 -- 172.21.15.5:0/3274316872 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c0b8b50 con 0x7fda3415cef0 2023-07-14T12:52:39.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.131+0000 7fda3be6a640 1 -- 172.21.15.5:0/3274316872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda34157790 con 0x7fda3415cef0 2023-07-14T12:52:39.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.131+0000 7fda3be6a640 1 -- 172.21.15.5:0/3274316872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda34157d50 con 0x7fda3415cef0 2023-07-14T12:52:39.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.131+0000 7fda3be6a640 1 -- 172.21.15.5:0/3274316872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda340678d0 con 0x7fda3415cef0 2023-07-14T12:52:39.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.131+0000 7fda2a7fc640 1 -- 172.21.15.5:0/3274316872 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fda340c9610 con 0x7fda3415cef0 2023-07-14T12:52:39.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.135+0000 7fda2a7fc640 1 --2- 172.21.15.5:0/3274316872 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fda18066280 0x7fda18068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:39.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.135+0000 7fda2a7fc640 1 -- 172.21.15.5:0/3274316872 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fda2c11e280 con 0x7fda3415cef0 2023-07-14T12:52:39.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.135+0000 7fda39c06640 1 --2- 172.21.15.5:0/3274316872 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fda18066280 0x7fda18068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:39.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.135+0000 7fda39c06640 1 --2- 172.21.15.5:0/3274316872 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fda18066280 0x7fda18068730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fda300015a0 tx=0x7fda30007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:39.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.139+0000 7fda2a7fc640 1 -- 172.21.15.5:0/3274316872 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fda2c0ebb10 con 0x7fda3415cef0 2023-07-14T12:52:39.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:39.295+0000 7fda3be6a640 1 -- 172.21.15.5:0/3274316872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fda340c2ee0 con 0x7fda3415cef0 2023-07-14T12:52:40.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.019+0000 7fda2a7fc640 1 -- 172.21.15.5:0/3274316872 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7fda2c0b8cb0 con 0x7fda3415cef0 2023-07-14T12:52:40.045 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'rbd' created 2023-07-14T12:52:40.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.023+0000 7fda3be6a640 1 -- 172.21.15.5:0/3274316872 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fda18066280 msgr2=0x7fda18068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:40.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.023+0000 7fda3be6a640 1 --2- 172.21.15.5:0/3274316872 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fda18066280 0x7fda18068730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fda300015a0 tx=0x7fda30007970 comp rx=0 tx=0).stop 2023-07-14T12:52:40.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.023+0000 7fda3be6a640 1 -- 172.21.15.5:0/3274316872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda3415cef0 msgr2=0x7fda3414ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:40.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.023+0000 7fda3be6a640 1 --2- 172.21.15.5:0/3274316872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda3415cef0 0x7fda3414ee20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fda2c009e50 tx=0x7fda2c019780 comp rx=0 tx=0).stop 2023-07-14T12:52:40.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.023+0000 7fda3be6a640 1 -- 172.21.15.5:0/3274316872 shutdown_connections 2023-07-14T12:52:40.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.023+0000 7fda3be6a640 1 --2- 172.21.15.5:0/3274316872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda3415cef0 0x7fda3414ee20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:40.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.023+0000 7fda3be6a640 1 --2- 172.21.15.5:0/3274316872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fda34159270 0x7fda34156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:40.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.023+0000 7fda3be6a640 1 --2- 172.21.15.5:0/3274316872 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fda18066280 0x7fda18068730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:40.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.023+0000 7fda3be6a640 1 --2- 172.21.15.5:0/3274316872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda340aeb40 0x7fda3406fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:40.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.023+0000 7fda3be6a640 1 -- 172.21.15.5:0/3274316872 >> 172.21.15.5:0/3274316872 conn(0x7fda340cde90 msgr2=0x7fda340cb810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:40.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.023+0000 7fda3be6a640 1 -- 172.21.15.5:0/3274316872 shutdown_connections 2023-07-14T12:52:40.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.023+0000 7fda3be6a640 1 -- 172.21.15.5:0/3274316872 wait complete. 2023-07-14T12:52:40.073 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-14T12:52:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.195+0000 7f64655d2640 1 Processor -- start 2023-07-14T12:52:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.195+0000 7f64655d2640 1 -- start start 2023-07-14T12:52:40.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.199+0000 7f64655d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f646015bde0 0x7f64600d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:40.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.199+0000 7f64655d2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f64600d2300 0x7f64600d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:40.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.199+0000 7f64655d2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64600b04c0 con 0x7f64600d2fc0 2023-07-14T12:52:40.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.199+0000 7f64655d2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64600d2ce0 con 0x7f64600d2300 2023-07-14T12:52:40.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.199+0000 7f64655d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646015c1b0 con 0x7f646015bde0 2023-07-14T12:52:40.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.199+0000 7f645f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f64600d2300 0x7f64600d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:40.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.199+0000 7f645f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f64600d2300 0x7f64600d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53208/0 (socket says 172.21.15.5:53208) 2023-07-14T12:52:40.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.199+0000 7f645f7fe640 1 -- 172.21.15.5:0/536520313 learned_addr learned my addr 172.21.15.5:0/536520313 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:40.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.199+0000 7f645effd640 1 --2- 172.21.15.5:0/536520313 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f646015bde0 0x7f64600d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:40.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.199+0000 7f645f7fe640 1 -- 172.21.15.5:0/536520313 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f646015bde0 msgr2=0x7f64600d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:40.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.199+0000 7f645f7fe640 1 --2- 172.21.15.5:0/536520313 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f646015bde0 0x7f64600d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:40.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.199+0000 7f645f7fe640 1 -- 172.21.15.5:0/536520313 >> v1:172.21.15.154:6789/0 conn(0x7f64600d2fc0 legacy=0x7f64600b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:40.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.199+0000 7f645f7fe640 1 -- 172.21.15.5:0/536520313 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64600b1060 con 0x7f64600d2300 2023-07-14T12:52:40.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.199+0000 7f645f7fe640 1 --2- 172.21.15.5:0/536520313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64600d2300 0x7f64600d27a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6458009e50 tx=0x7f645801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651f47c3bcc578fb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:40.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.203+0000 7f645e7fc640 1 -- 172.21.15.5:0/536520313 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64580a57f0 con 0x7f64600d2300 2023-07-14T12:52:40.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.203+0000 7f645e7fc640 1 -- 172.21.15.5:0/536520313 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64580a5950 con 0x7f64600d2300 2023-07-14T12:52:40.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.203+0000 7f645e7fc640 1 -- 172.21.15.5:0/536520313 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64580a5ce0 con 0x7f64600d2300 2023-07-14T12:52:40.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.203+0000 7f64655d2640 1 -- 172.21.15.5:0/536520313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64600d2300 msgr2=0x7f64600d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:40.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.203+0000 7f64655d2640 1 --2- 172.21.15.5:0/536520313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64600d2300 0x7f64600d27a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6458009e50 tx=0x7f645801ca10 comp rx=0 tx=0).stop 2023-07-14T12:52:40.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.203+0000 7f64655d2640 1 -- 172.21.15.5:0/536520313 shutdown_connections 2023-07-14T12:52:40.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.203+0000 7f64655d2640 1 --2- 172.21.15.5:0/536520313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64600d2300 0x7f64600d27a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:40.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.203+0000 7f64655d2640 1 --2- 172.21.15.5:0/536520313 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f646015bde0 0x7f64600d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:40.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.203+0000 7f64655d2640 1 -- 172.21.15.5:0/536520313 >> 172.21.15.5:0/536520313 conn(0x7f64600659d0 msgr2=0x7f646009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:40.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.203+0000 7f64655d2640 1 -- 172.21.15.5:0/536520313 shutdown_connections 2023-07-14T12:52:40.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.203+0000 7f64655d2640 1 -- 172.21.15.5:0/536520313 wait complete. 2023-07-14T12:52:40.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.203+0000 7f64655d2640 1 Processor -- start 2023-07-14T12:52:40.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.203+0000 7f64655d2640 1 -- start start 2023-07-14T12:52:40.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.203+0000 7f64655d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64600d2300 0x7f646014e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:40.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.203+0000 7f64655d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64600d2fc0 0x7f646014c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:40.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.203+0000 7f64655d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f646015bde0 0x7f64600cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:40.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.203+0000 7f64655d2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646014dfa0 con 0x7f64600d2300 2023-07-14T12:52:40.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.203+0000 7f64655d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646015a660 con 0x7f646015bde0 2023-07-14T12:52:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.203+0000 7f64655d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646014d0d0 con 0x7f64600d2fc0 2023-07-14T12:52:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.203+0000 7f645effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64600d2300 0x7f646014e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.203+0000 7f645effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64600d2300 0x7f646014e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53224/0 (socket says 172.21.15.5:53224) 2023-07-14T12:52:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.203+0000 7f645effd640 1 -- 172.21.15.5:0/3532288406 learned_addr learned my addr 172.21.15.5:0/3532288406 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.207+0000 7f6457fff640 1 --2- 172.21.15.5:0/3532288406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64600d2fc0 0x7f646014c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.207+0000 7f645f7fe640 1 --2- 172.21.15.5:0/3532288406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f646015bde0 0x7f64600cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.207+0000 7f645effd640 1 -- 172.21.15.5:0/3532288406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64600d2fc0 msgr2=0x7f646014c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:40.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.207+0000 7f645effd640 1 --2- 172.21.15.5:0/3532288406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64600d2fc0 0x7f646014c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:40.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.207+0000 7f645effd640 1 -- 172.21.15.5:0/3532288406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f646015bde0 msgr2=0x7f64600cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:40.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.207+0000 7f645effd640 1 --2- 172.21.15.5:0/3532288406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f646015bde0 0x7f64600cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:40.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.207+0000 7f645effd640 1 -- 172.21.15.5:0/3532288406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6458009b30 con 0x7f64600d2300 2023-07-14T12:52:40.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.207+0000 7f6457fff640 1 --2- 172.21.15.5:0/3532288406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64600d2fc0 0x7f646014c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:52:40.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.207+0000 7f645f7fe640 1 --2- 172.21.15.5:0/3532288406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f646015bde0 0x7f64600cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:52:40.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.207+0000 7f645effd640 1 --2- 172.21.15.5:0/3532288406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64600d2300 0x7f646014e3c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f645000d830 tx=0x7f645000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:40.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.207+0000 7f64577fe640 1 -- 172.21.15.5:0/3532288406 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6450018070 con 0x7f64600d2300 2023-07-14T12:52:40.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.207+0000 7f64577fe640 1 -- 172.21.15.5:0/3532288406 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64500059a0 con 0x7f64600d2300 2023-07-14T12:52:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.207+0000 7f64655d2640 1 -- 172.21.15.5:0/3532288406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f646014e900 con 0x7f64600d2300 2023-07-14T12:52:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.207+0000 7f64577fe640 1 -- 172.21.15.5:0/3532288406 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6450005b50 con 0x7f64600d2300 2023-07-14T12:52:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.207+0000 7f64655d2640 1 -- 172.21.15.5:0/3532288406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646014d600 con 0x7f64600d2300 2023-07-14T12:52:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.207+0000 7f64655d2640 1 -- 172.21.15.5:0/3532288406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f646014e210 con 0x7f64600d2300 2023-07-14T12:52:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.207+0000 7f64577fe640 1 -- 172.21.15.5:0/3532288406 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f645000b6c0 con 0x7f64600d2300 2023-07-14T12:52:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.207+0000 7f64577fe640 1 --2- 172.21.15.5:0/3532288406 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f64400662b0 0x7f6440068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.207+0000 7f64577fe640 1 -- 172.21.15.5:0/3532288406 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f6450083a50 con 0x7f64600d2300 2023-07-14T12:52:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.211+0000 7f6457fff640 1 --2- 172.21.15.5:0/3532288406 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f64400662b0 0x7f6440068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.211+0000 7f6457fff640 1 --2- 172.21.15.5:0/3532288406 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f64400662b0 0x7f6440068760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f64600b42f0 tx=0x7f6448009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:40.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.215+0000 7f64577fe640 1 -- 172.21.15.5:0/3532288406 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6450051220 con 0x7f64600d2300 2023-07-14T12:52:40.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:40.366+0000 7f64655d2640 1 -- 172.21.15.5:0/3532288406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f64600d0750 con 0x7f64600d2300 2023-07-14T12:52:41.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.022+0000 7f64577fe640 1 -- 172.21.15.5:0/3532288406 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7f6450011340 con 0x7f64600d2300 2023-07-14T12:52:41.049 INFO:teuthology.orchestra.run.smithi005.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-14T12:52:41.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.026+0000 7f64655d2640 1 -- 172.21.15.5:0/3532288406 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f64400662b0 msgr2=0x7f6440068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:41.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.026+0000 7f64655d2640 1 --2- 172.21.15.5:0/3532288406 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f64400662b0 0x7f6440068760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f64600b42f0 tx=0x7f6448009040 comp rx=0 tx=0).stop 2023-07-14T12:52:41.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.026+0000 7f64655d2640 1 -- 172.21.15.5:0/3532288406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64600d2300 msgr2=0x7f646014e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:41.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.026+0000 7f64655d2640 1 --2- 172.21.15.5:0/3532288406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64600d2300 0x7f646014e3c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f645000d830 tx=0x7f645000dcf0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.026+0000 7f64655d2640 1 -- 172.21.15.5:0/3532288406 shutdown_connections 2023-07-14T12:52:41.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.026+0000 7f64655d2640 1 --2- 172.21.15.5:0/3532288406 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f64400662b0 0x7f6440068760 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.026+0000 7f64655d2640 1 --2- 172.21.15.5:0/3532288406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f646015bde0 0x7f64600cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.026+0000 7f64655d2640 1 --2- 172.21.15.5:0/3532288406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64600d2fc0 0x7f646014c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.026+0000 7f64655d2640 1 --2- 172.21.15.5:0/3532288406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64600d2300 0x7f646014e3c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.026+0000 7f64655d2640 1 -- 172.21.15.5:0/3532288406 >> 172.21.15.5:0/3532288406 conn(0x7f64600659d0 msgr2=0x7f646006afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.026+0000 7f64655d2640 1 -- 172.21.15.5:0/3532288406 shutdown_connections 2023-07-14T12:52:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.026+0000 7f64655d2640 1 -- 172.21.15.5:0/3532288406 wait complete. 2023-07-14T12:52:41.078 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-14T12:52:41.079 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-14T12:52:41.079 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-14T12:52:41.083 INFO:tasks.ceph.mds.a:Started 2023-07-14T12:52:41.083 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-14T12:52:41.084 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-14T12:52:41.087 INFO:tasks.ceph.mds.c:Started 2023-07-14T12:52:41.088 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-14T12:52:41.088 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-14T12:52:41.092 INFO:tasks.ceph.mds.b:Started 2023-07-14T12:52:41.092 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-14T12:52:41.092 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-14T12:52:41.097 INFO:tasks.ceph.mds.d:Started 2023-07-14T12:52:41.097 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-14T12:52:41.098 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:52:41.188 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-07-14T12:52:41.188 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-07-14T12:52:41.212 INFO:tasks.ceph.mds.d.smithi154.stdout:starting mds.d at 2023-07-14T12:52:41.214 INFO:tasks.ceph.mds.b.smithi154.stdout:starting mds.b at 2023-07-14T12:52:41.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.230+0000 7faa86737640 1 Processor -- start 2023-07-14T12:52:41.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.230+0000 7faa86737640 1 -- start start 2023-07-14T12:52:41.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.230+0000 7faa86737640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa800cb780 0x7faa800cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:41.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.230+0000 7faa86737640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faa8006b8f0 0x7faa800cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:41.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.230+0000 7faa86737640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa8006f900 con 0x7faa8015b7c0 2023-07-14T12:52:41.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.230+0000 7faa86737640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa800cdce0 con 0x7faa8006b8f0 2023-07-14T12:52:41.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.230+0000 7faa86737640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa800ca830 con 0x7faa800cb780 2023-07-14T12:52:41.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.230+0000 7faa7ffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faa8015b7c0 0x7faa8006b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39020/0 (socket says 172.21.15.5:39020) 2023-07-14T12:52:41.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.230+0000 7faa7ffff640 1 -- 172.21.15.5:0/42380858 learned_addr learned my addr 172.21.15.5:0/42380858 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:41.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.230+0000 7faa77fff640 1 --2- 172.21.15.5:0/42380858 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa800cb780 0x7faa800cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:41.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.230+0000 7faa84cd4640 1 --2- 172.21.15.5:0/42380858 >> v2:172.21.15.154:3300/0 conn(0x7faa8006b8f0 0x7faa800cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:41.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.234+0000 7faa7f7fe640 1 -- 172.21.15.5:0/42380858 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 920104096 0 0) 0x7faa8006f900 con 0x7faa8015b7c0 2023-07-14T12:52:41.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.234+0000 7faa84cd4640 1 -- 172.21.15.5:0/42380858 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa800cb780 msgr2=0x7faa800cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:41.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.234+0000 7faa84cd4640 1 --2- 172.21.15.5:0/42380858 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa800cb780 0x7faa800cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.234+0000 7faa84cd4640 1 -- 172.21.15.5:0/42380858 >> v1:172.21.15.5:6789/0 conn(0x7faa8015b7c0 legacy=0x7faa8006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:41.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.234+0000 7faa84cd4640 1 -- 172.21.15.5:0/42380858 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8015bb90 con 0x7faa8006b8f0 2023-07-14T12:52:41.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.234+0000 7faa84cd4640 1 --2- 172.21.15.5:0/42380858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa8006b8f0 0x7faa800cc270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faa7800aea0 tx=0x7faa7801da20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25d6b8b9d098fc3b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:41.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.234+0000 7faa7f7fe640 1 -- 172.21.15.5:0/42380858 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7800a2d0 con 0x7faa8006b8f0 2023-07-14T12:52:41.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.234+0000 7faa7f7fe640 1 -- 172.21.15.5:0/42380858 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa780a6860 con 0x7faa8006b8f0 2023-07-14T12:52:41.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.234+0000 7faa7f7fe640 1 -- 172.21.15.5:0/42380858 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa780a6bf0 con 0x7faa8006b8f0 2023-07-14T12:52:41.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.238+0000 7faa86737640 1 -- 172.21.15.5:0/42380858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa8006b8f0 msgr2=0x7faa800cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:41.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.238+0000 7faa86737640 1 --2- 172.21.15.5:0/42380858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa8006b8f0 0x7faa800cc270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faa7800aea0 tx=0x7faa7801da20 comp rx=0 tx=0).stop 2023-07-14T12:52:41.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.238+0000 7faa86737640 1 -- 172.21.15.5:0/42380858 shutdown_connections 2023-07-14T12:52:41.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.238+0000 7faa86737640 1 --2- 172.21.15.5:0/42380858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa8006b8f0 0x7faa800cc270 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.238+0000 7faa86737640 1 --2- 172.21.15.5:0/42380858 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa800cb780 0x7faa800cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.238+0000 7faa86737640 1 -- 172.21.15.5:0/42380858 >> 172.21.15.5:0/42380858 conn(0x7faa800afcf0 msgr2=0x7faa800b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:41.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.238+0000 7faa86737640 1 -- 172.21.15.5:0/42380858 shutdown_connections 2023-07-14T12:52:41.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.238+0000 7faa86737640 1 -- 172.21.15.5:0/42380858 wait complete. 2023-07-14T12:52:41.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.238+0000 7faa86737640 1 Processor -- start 2023-07-14T12:52:41.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.238+0000 7faa86737640 1 -- start start 2023-07-14T12:52:41.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.238+0000 7faa86737640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa8006b8f0 0x7faa800c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:41.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.238+0000 7faa86737640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa8015b7c0 0x7faa80154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:41.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.238+0000 7faa86737640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa801f57e0 0x7faa80156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:41.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.238+0000 7faa86737640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa80152f80 con 0x7faa8015b7c0 2023-07-14T12:52:41.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.238+0000 7faa86737640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa801f5c60 con 0x7faa8006b8f0 2023-07-14T12:52:41.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.238+0000 7faa86737640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa800c2320 con 0x7faa801f57e0 2023-07-14T12:52:41.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.238+0000 7faa77fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa8015b7c0 0x7faa80154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:41.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.238+0000 7faa77fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa8015b7c0 0x7faa80154f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53280/0 (socket says 172.21.15.5:53280) 2023-07-14T12:52:41.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.238+0000 7faa77fff640 1 -- 172.21.15.5:0/232758528 learned_addr learned my addr 172.21.15.5:0/232758528 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:41.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.238+0000 7faa7ffff640 1 --2- 172.21.15.5:0/232758528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa8006b8f0 0x7faa800c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:41.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.238+0000 7faa84cd4640 1 --2- 172.21.15.5:0/232758528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa801f57e0 0x7faa80156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:41.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.238+0000 7faa77fff640 1 -- 172.21.15.5:0/232758528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa801f57e0 msgr2=0x7faa80156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:41.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.238+0000 7faa77fff640 1 --2- 172.21.15.5:0/232758528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa801f57e0 0x7faa80156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.238+0000 7faa77fff640 1 -- 172.21.15.5:0/232758528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa8006b8f0 msgr2=0x7faa800c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:41.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.238+0000 7faa77fff640 1 --2- 172.21.15.5:0/232758528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa8006b8f0 0x7faa800c1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.238+0000 7faa77fff640 1 -- 172.21.15.5:0/232758528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7800ab80 con 0x7faa8015b7c0 2023-07-14T12:52:41.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.242+0000 7faa77fff640 1 --2- 172.21.15.5:0/232758528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa8015b7c0 0x7faa80154f70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faa6800e930 tx=0x7faa6800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:41.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.242+0000 7faa7d7fa640 1 -- 172.21.15.5:0/232758528 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa68009690 con 0x7faa8015b7c0 2023-07-14T12:52:41.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.242+0000 7faa7d7fa640 1 -- 172.21.15.5:0/232758528 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6800ca00 con 0x7faa8015b7c0 2023-07-14T12:52:41.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.242+0000 7faa86737640 1 -- 172.21.15.5:0/232758528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa800c2600 con 0x7faa8015b7c0 2023-07-14T12:52:41.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.242+0000 7faa7d7fa640 1 -- 172.21.15.5:0/232758528 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6800cd70 con 0x7faa8015b7c0 2023-07-14T12:52:41.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.242+0000 7faa86737640 1 -- 172.21.15.5:0/232758528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa800c2bc0 con 0x7faa8015b7c0 2023-07-14T12:52:41.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.242+0000 7faa86737640 1 -- 172.21.15.5:0/232758528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa800678d0 con 0x7faa8015b7c0 2023-07-14T12:52:41.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.242+0000 7faa7d7fa640 1 -- 172.21.15.5:0/232758528 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faa68013470 con 0x7faa8015b7c0 2023-07-14T12:52:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.242+0000 7faa7d7fa640 1 --2- 172.21.15.5:0/232758528 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7faa60066280 0x7faa60068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.242+0000 7faa7d7fa640 1 -- 172.21.15.5:0/232758528 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7faa68083cb0 con 0x7faa8015b7c0 2023-07-14T12:52:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.242+0000 7faa7ffff640 1 --2- 172.21.15.5:0/232758528 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7faa60066280 0x7faa60068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:41.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.246+0000 7faa7ffff640 1 --2- 172.21.15.5:0/232758528 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7faa60066280 0x7faa60068730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faa70000f70 tx=0x7faa70007c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:41.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.246+0000 7faa7d7fa640 1 -- 172.21.15.5:0/232758528 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7faa68051530 con 0x7faa8015b7c0 2023-07-14T12:52:41.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.406+0000 7faa86737640 1 -- 172.21.15.5:0/232758528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa8015af80 con 0x7faa8015b7c0 2023-07-14T12:52:41.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.410+0000 7faa7d7fa640 1 -- 172.21.15.5:0/232758528 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14601 (secure 0 0 0) 0x7faa68054b50 con 0x7faa8015b7c0 2023-07-14T12:52:41.435 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:52:41.435 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":18,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:52:41.020191+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:52:41.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.410+0000 7faa86737640 1 -- 172.21.15.5:0/232758528 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7faa60066280 msgr2=0x7faa60068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:41.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.410+0000 7faa86737640 1 --2- 172.21.15.5:0/232758528 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7faa60066280 0x7faa60068730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faa70000f70 tx=0x7faa70007c10 comp rx=0 tx=0).stop 2023-07-14T12:52:41.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.410+0000 7faa86737640 1 -- 172.21.15.5:0/232758528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa8015b7c0 msgr2=0x7faa80154f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:41.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.410+0000 7faa86737640 1 --2- 172.21.15.5:0/232758528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa8015b7c0 0x7faa80154f70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faa6800e930 tx=0x7faa6800edf0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.410+0000 7faa86737640 1 -- 172.21.15.5:0/232758528 shutdown_connections 2023-07-14T12:52:41.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.410+0000 7faa86737640 1 --2- 172.21.15.5:0/232758528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa801f57e0 0x7faa80156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.410+0000 7faa86737640 1 --2- 172.21.15.5:0/232758528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa8015b7c0 0x7faa80154f70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.410+0000 7faa86737640 1 --2- 172.21.15.5:0/232758528 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7faa60066280 0x7faa60068730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.410+0000 7faa86737640 1 --2- 172.21.15.5:0/232758528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa8006b8f0 0x7faa800c1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.410+0000 7faa86737640 1 -- 172.21.15.5:0/232758528 >> 172.21.15.5:0/232758528 conn(0x7faa800afcf0 msgr2=0x7faa8015a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:41.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.410+0000 7faa86737640 1 -- 172.21.15.5:0/232758528 shutdown_connections 2023-07-14T12:52:41.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.410+0000 7faa86737640 1 -- 172.21.15.5:0/232758528 wait complete. 2023-07-14T12:52:41.457 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T12:52:41.458 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T12:52:41.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.578+0000 7f364bf74640 1 Processor -- start 2023-07-14T12:52:41.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.578+0000 7f364bf74640 1 -- start start 2023-07-14T12:52:41.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.582+0000 7f364bf74640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f364406a540 0x7f364406a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:41.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.582+0000 7f364bf74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36440cf710 0x7f36440cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:41.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.582+0000 7f364bf74640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36440cb7a0 con 0x7f36440cf2e0 2023-07-14T12:52:41.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.582+0000 7f364bf74640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36440d0920 con 0x7f364406a540 2023-07-14T12:52:41.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.582+0000 7f364bf74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364415bfd0 con 0x7f36440cf710 2023-07-14T12:52:41.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.582+0000 7f3649d10640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f364406a540 0x7f364406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:41.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.582+0000 7f3649d10640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f364406a540 0x7f364406a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53282/0 (socket says 172.21.15.5:53282) 2023-07-14T12:52:41.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.582+0000 7f3649d10640 1 -- 172.21.15.5:0/3916392991 learned_addr learned my addr 172.21.15.5:0/3916392991 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:41.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.582+0000 7f364a511640 1 --2- 172.21.15.5:0/3916392991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36440cf710 0x7f36440cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:41.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.582+0000 7f3649d10640 1 -- 172.21.15.5:0/3916392991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36440cf710 msgr2=0x7f36440cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.582+0000 7f3649d10640 1 --2- 172.21.15.5:0/3916392991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36440cf710 0x7f36440cd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.582+0000 7f3649d10640 1 -- 172.21.15.5:0/3916392991 >> v1:172.21.15.154:6789/0 conn(0x7f36440cf2e0 legacy=0x7f36440cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:41.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.582+0000 7f3649d10640 1 -- 172.21.15.5:0/3916392991 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364406ae50 con 0x7f364406a540 2023-07-14T12:52:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.586+0000 7f3649d10640 1 --2- 172.21.15.5:0/3916392991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f364406a540 0x7f364406a910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3640009870 tx=0x7f364001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15bd8ee448ea9381 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.586+0000 7f3648d0e640 1 -- 172.21.15.5:0/3916392991 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36400ab620 con 0x7f364406a540 2023-07-14T12:52:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.586+0000 7f3648d0e640 1 -- 172.21.15.5:0/3916392991 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36400ab780 con 0x7f364406a540 2023-07-14T12:52:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.586+0000 7f3648d0e640 1 -- 172.21.15.5:0/3916392991 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36400abb10 con 0x7f364406a540 2023-07-14T12:52:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.586+0000 7f364bf74640 1 -- 172.21.15.5:0/3916392991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f364406a540 msgr2=0x7f364406a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:41.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.586+0000 7f364bf74640 1 --2- 172.21.15.5:0/3916392991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f364406a540 0x7f364406a910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3640009870 tx=0x7f364001c510 comp rx=0 tx=0).stop 2023-07-14T12:52:41.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.586+0000 7f364bf74640 1 -- 172.21.15.5:0/3916392991 shutdown_connections 2023-07-14T12:52:41.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.586+0000 7f364bf74640 1 --2- 172.21.15.5:0/3916392991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36440cf710 0x7f36440cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.586+0000 7f364bf74640 1 --2- 172.21.15.5:0/3916392991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f364406a540 0x7f364406a910 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.586+0000 7f364bf74640 1 -- 172.21.15.5:0/3916392991 >> 172.21.15.5:0/3916392991 conn(0x7f3644099490 msgr2=0x7f3644089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:41.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.586+0000 7f364bf74640 1 -- 172.21.15.5:0/3916392991 shutdown_connections 2023-07-14T12:52:41.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.586+0000 7f364bf74640 1 -- 172.21.15.5:0/3916392991 wait complete. 2023-07-14T12:52:41.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.586+0000 7f364bf74640 1 Processor -- start 2023-07-14T12:52:41.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.586+0000 7f364bf74640 1 -- start start 2023-07-14T12:52:41.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.590+0000 7f364bf74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f364406a540 0x7f3644157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:41.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.590+0000 7f364bf74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36440cf2e0 0x7f364414aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:41.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.590+0000 7f364bf74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36440cf710 0x7f364415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.590+0000 7f364bf74640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364414af90 con 0x7f364406a540 2023-07-14T12:52:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.590+0000 7f364bf74640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36440b0060 con 0x7f36440cf2e0 2023-07-14T12:52:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.590+0000 7f364bf74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36440b0bd0 con 0x7f36440cf710 2023-07-14T12:52:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.590+0000 7f3649d10640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f364406a540 0x7f3644157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.590+0000 7f3649d10640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f364406a540 0x7f3644157380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53288/0 (socket says 172.21.15.5:53288) 2023-07-14T12:52:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.590+0000 7f3649d10640 1 -- 172.21.15.5:0/1111725693 learned_addr learned my addr 172.21.15.5:0/1111725693 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.590+0000 7f364950f640 1 --2- 172.21.15.5:0/1111725693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36440cf2e0 0x7f364414aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.590+0000 7f364a511640 1 --2- 172.21.15.5:0/1111725693 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36440cf710 0x7f364415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:41.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.590+0000 7f3649d10640 1 -- 172.21.15.5:0/1111725693 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36440cf710 msgr2=0x7f364415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:41.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.590+0000 7f3649d10640 1 --2- 172.21.15.5:0/1111725693 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36440cf710 0x7f364415a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.590+0000 7f3649d10640 1 -- 172.21.15.5:0/1111725693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36440cf2e0 msgr2=0x7f364414aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:41.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.590+0000 7f3649d10640 1 --2- 172.21.15.5:0/1111725693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36440cf2e0 0x7f364414aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.590+0000 7f3649d10640 1 -- 172.21.15.5:0/1111725693 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36400094d0 con 0x7f364406a540 2023-07-14T12:52:41.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.590+0000 7f3649d10640 1 --2- 172.21.15.5:0/1111725693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f364406a540 0x7f3644157380 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f36400ad040 tx=0x7f364001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:41.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.590+0000 7f363a7fc640 1 -- 172.21.15.5:0/1111725693 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36400abe40 con 0x7f364406a540 2023-07-14T12:52:41.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.590+0000 7f363a7fc640 1 -- 172.21.15.5:0/1111725693 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36400be3f0 con 0x7f364406a540 2023-07-14T12:52:41.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.590+0000 7f363a7fc640 1 -- 172.21.15.5:0/1111725693 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36400be7a0 con 0x7f364406a540 2023-07-14T12:52:41.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.590+0000 7f364bf74640 1 -- 172.21.15.5:0/1111725693 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364415a720 con 0x7f364406a540 2023-07-14T12:52:41.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.590+0000 7f364bf74640 1 -- 172.21.15.5:0/1111725693 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36440b0580 con 0x7f364406a540 2023-07-14T12:52:41.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.590+0000 7f363a7fc640 1 -- 172.21.15.5:0/1111725693 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f36400b43f0 con 0x7f364406a540 2023-07-14T12:52:41.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.590+0000 7f364bf74640 1 -- 172.21.15.5:0/1111725693 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36440678d0 con 0x7f364406a540 2023-07-14T12:52:41.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.594+0000 7f363a7fc640 1 --2- 172.21.15.5:0/1111725693 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3628066280 0x7f3628068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:41.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.594+0000 7f363a7fc640 1 -- 172.21.15.5:0/1111725693 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f364011df40 con 0x7f364406a540 2023-07-14T12:52:41.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.594+0000 7f364950f640 1 --2- 172.21.15.5:0/1111725693 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3628066280 0x7f3628068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:41.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.594+0000 7f364950f640 1 --2- 172.21.15.5:0/1111725693 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3628066280 0x7f3628068730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f36440b61b0 tx=0x7f3634009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.598+0000 7f363a7fc640 1 -- 172.21.15.5:0/1111725693 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f36400eb720 con 0x7f364406a540 2023-07-14T12:52:41.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.754+0000 7f364bf74640 1 -- 172.21.15.5:0/1111725693 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f36440adbf0 con 0x7f364406a540 2023-07-14T12:52:41.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.754+0000 7f363a7fc640 1 -- 172.21.15.5:0/1111725693 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f36400eed40 con 0x7f364406a540 2023-07-14T12:52:41.779 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T12:52:41.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.754+0000 7f364bf74640 1 -- 172.21.15.5:0/1111725693 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3628066280 msgr2=0x7f3628068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:41.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.754+0000 7f364bf74640 1 --2- 172.21.15.5:0/1111725693 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3628066280 0x7f3628068730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f36440b61b0 tx=0x7f3634009040 comp rx=0 tx=0).stop 2023-07-14T12:52:41.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.754+0000 7f364bf74640 1 -- 172.21.15.5:0/1111725693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f364406a540 msgr2=0x7f3644157380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:41.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.754+0000 7f364bf74640 1 --2- 172.21.15.5:0/1111725693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f364406a540 0x7f3644157380 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f36400ad040 tx=0x7f364001ad50 comp rx=0 tx=0).stop 2023-07-14T12:52:41.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.754+0000 7f364bf74640 1 -- 172.21.15.5:0/1111725693 shutdown_connections 2023-07-14T12:52:41.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.754+0000 7f364bf74640 1 --2- 172.21.15.5:0/1111725693 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36440cf710 0x7f364415a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.754+0000 7f364bf74640 1 --2- 172.21.15.5:0/1111725693 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3628066280 0x7f3628068730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.754+0000 7f364bf74640 1 --2- 172.21.15.5:0/1111725693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36440cf2e0 0x7f364414aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.754+0000 7f364bf74640 1 --2- 172.21.15.5:0/1111725693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f364406a540 0x7f3644157380 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.754+0000 7f364bf74640 1 -- 172.21.15.5:0/1111725693 >> 172.21.15.5:0/1111725693 conn(0x7f3644099490 msgr2=0x7f3644089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:41.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.754+0000 7f364bf74640 1 -- 172.21.15.5:0/1111725693 shutdown_connections 2023-07-14T12:52:41.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.754+0000 7f364bf74640 1 -- 172.21.15.5:0/1111725693 wait complete. 2023-07-14T12:52:41.800 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T12:52:41.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.922+0000 7fce2e3ad640 1 Processor -- start 2023-07-14T12:52:41.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.922+0000 7fce2e3ad640 1 -- start start 2023-07-14T12:52:41.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.922+0000 7fce2e3ad640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fce28069430 0x7fce28069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:41.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.922+0000 7fce2e3ad640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fce28070f30 0x7fce280ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:41.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.922+0000 7fce2e3ad640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce28159d70 con 0x7fce280af2b0 2023-07-14T12:52:41.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.922+0000 7fce2e3ad640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce28069d40 con 0x7fce28069430 2023-07-14T12:52:41.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.922+0000 7fce2e3ad640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce280c9c60 con 0x7fce28070f30 2023-07-14T12:52:41.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.922+0000 7fce27fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fce28069430 0x7fce28069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:41.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.922+0000 7fce2c94a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fce280af2b0 0x7fce2815a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39024/0 (socket says 172.21.15.5:39024) 2023-07-14T12:52:41.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.922+0000 7fce2c94a640 1 -- 172.21.15.5:0/3204139694 learned_addr learned my addr 172.21.15.5:0/3204139694 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:41.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.922+0000 7fce277fe640 1 --2- 172.21.15.5:0/3204139694 >> v2:172.21.15.154:3300/0 conn(0x7fce28070f30 0x7fce280ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:41.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.922+0000 7fce27fff640 1 -- 172.21.15.5:0/3204139694 >> v2:172.21.15.154:3300/0 conn(0x7fce28070f30 msgr2=0x7fce280ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:41.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.922+0000 7fce27fff640 1 --2- 172.21.15.5:0/3204139694 >> v2:172.21.15.154:3300/0 conn(0x7fce28070f30 0x7fce280ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.922+0000 7fce27fff640 1 -- 172.21.15.5:0/3204139694 >> v1:172.21.15.5:6789/0 conn(0x7fce280af2b0 legacy=0x7fce2815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:41.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.922+0000 7fce27fff640 1 -- 172.21.15.5:0/3204139694 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce280c9f40 con 0x7fce28069430 2023-07-14T12:52:41.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.926+0000 7fce27fff640 1 --2- 172.21.15.5:0/3204139694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce28069430 0x7fce28069800 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fce280c9830 tx=0x7fce1801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a1c7b8ebf9244e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:41.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.926+0000 7fce26ffd640 1 -- 172.21.15.5:0/3204139694 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce180ab600 con 0x7fce28069430 2023-07-14T12:52:41.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.926+0000 7fce26ffd640 1 -- 172.21.15.5:0/3204139694 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce180a7050 con 0x7fce28069430 2023-07-14T12:52:41.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.926+0000 7fce26ffd640 1 -- 172.21.15.5:0/3204139694 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce180ab980 con 0x7fce28069430 2023-07-14T12:52:41.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.926+0000 7fce2e3ad640 1 -- 172.21.15.5:0/3204139694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce28069430 msgr2=0x7fce28069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:41.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.926+0000 7fce2e3ad640 1 --2- 172.21.15.5:0/3204139694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce28069430 0x7fce28069800 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fce280c9830 tx=0x7fce1801c460 comp rx=0 tx=0).stop 2023-07-14T12:52:41.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.926+0000 7fce2e3ad640 1 -- 172.21.15.5:0/3204139694 shutdown_connections 2023-07-14T12:52:41.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.926+0000 7fce2e3ad640 1 --2- 172.21.15.5:0/3204139694 >> v2:172.21.15.154:3300/0 conn(0x7fce28070f30 0x7fce280ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.926+0000 7fce2e3ad640 1 --2- 172.21.15.5:0/3204139694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce28069430 0x7fce28069800 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.926+0000 7fce2e3ad640 1 -- 172.21.15.5:0/3204139694 >> 172.21.15.5:0/3204139694 conn(0x7fce280cde90 msgr2=0x7fce280ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:41.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.926+0000 7fce2e3ad640 1 -- 172.21.15.5:0/3204139694 shutdown_connections 2023-07-14T12:52:41.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.926+0000 7fce2e3ad640 1 -- 172.21.15.5:0/3204139694 wait complete. 2023-07-14T12:52:41.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.930+0000 7fce2e3ad640 1 Processor -- start 2023-07-14T12:52:41.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.930+0000 7fce2e3ad640 1 -- start start 2023-07-14T12:52:41.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.930+0000 7fce2e3ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce28069430 0x7fce280c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:41.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.930+0000 7fce2e3ad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce28070f30 0x7fce280cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:41.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.930+0000 7fce2e3ad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce280af2b0 0x7fce281f45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:41.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.930+0000 7fce2e3ad640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce28154130 con 0x7fce280af2b0 2023-07-14T12:52:41.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.930+0000 7fce2e3ad640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce280cc650 con 0x7fce28069430 2023-07-14T12:52:41.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.930+0000 7fce2e3ad640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce28153800 con 0x7fce28070f30 2023-07-14T12:52:41.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.930+0000 7fce2c94a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce280af2b0 0x7fce281f45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:41.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.930+0000 7fce27fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce28069430 0x7fce280c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:41.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.930+0000 7fce27fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce28069430 0x7fce280c2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:42332/0 (socket says 172.21.15.5:42332) 2023-07-14T12:52:41.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.930+0000 7fce27fff640 1 -- 172.21.15.5:0/1421304304 learned_addr learned my addr 172.21.15.5:0/1421304304 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:41.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.930+0000 7fce277fe640 1 --2- 172.21.15.5:0/1421304304 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce28070f30 0x7fce280cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:41.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.930+0000 7fce27fff640 1 -- 172.21.15.5:0/1421304304 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce28070f30 msgr2=0x7fce280cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:41.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.930+0000 7fce27fff640 1 --2- 172.21.15.5:0/1421304304 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce28070f30 0x7fce280cbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.930+0000 7fce27fff640 1 -- 172.21.15.5:0/1421304304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce280af2b0 msgr2=0x7fce281f45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:41.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.930+0000 7fce27fff640 1 --2- 172.21.15.5:0/1421304304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce280af2b0 0x7fce281f45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:41.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.930+0000 7fce27fff640 1 -- 172.21.15.5:0/1421304304 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce18009420 con 0x7fce28069430 2023-07-14T12:52:41.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.930+0000 7fce277fe640 1 --2- 172.21.15.5:0/1421304304 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce28070f30 0x7fce280cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:52:41.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.930+0000 7fce2c94a640 1 --2- 172.21.15.5:0/1421304304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce280af2b0 0x7fce281f45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:52:41.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.930+0000 7fce27fff640 1 --2- 172.21.15.5:0/1421304304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce28069430 0x7fce280c2d30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fce180ae040 tx=0x7fce1801aca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:41.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.930+0000 7fce24ff9640 1 -- 172.21.15.5:0/1421304304 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce180b7650 con 0x7fce28069430 2023-07-14T12:52:41.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.930+0000 7fce2e3ad640 1 -- 172.21.15.5:0/1421304304 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce28153ae0 con 0x7fce28069430 2023-07-14T12:52:41.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.930+0000 7fce24ff9640 1 -- 172.21.15.5:0/1421304304 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce180b77d0 con 0x7fce28069430 2023-07-14T12:52:41.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.930+0000 7fce24ff9640 1 -- 172.21.15.5:0/1421304304 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce180b7b80 con 0x7fce28069430 2023-07-14T12:52:41.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.930+0000 7fce2e3ad640 1 -- 172.21.15.5:0/1421304304 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce281f5350 con 0x7fce28069430 2023-07-14T12:52:41.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.934+0000 7fce2e3ad640 1 -- 172.21.15.5:0/1421304304 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce28153f90 con 0x7fce28069430 2023-07-14T12:52:41.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.934+0000 7fce24ff9640 1 -- 172.21.15.5:0/1421304304 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fce180b7ce0 con 0x7fce28069430 2023-07-14T12:52:41.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.934+0000 7fce24ff9640 1 --2- 172.21.15.5:0/1421304304 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fce140662b0 0x7fce14068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:41.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.934+0000 7fce24ff9640 1 -- 172.21.15.5:0/1421304304 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fce1811ea10 con 0x7fce28069430 2023-07-14T12:52:41.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.934+0000 7fce277fe640 1 --2- 172.21.15.5:0/1421304304 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fce140662b0 0x7fce14068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:41.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.934+0000 7fce277fe640 1 --2- 172.21.15.5:0/1421304304 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fce140662b0 0x7fce14068760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fce28159ca0 tx=0x7fce1c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:41.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:41.938+0000 7fce24ff9640 1 -- 172.21.15.5:0/1421304304 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fce180ec140 con 0x7fce28069430 2023-07-14T12:52:42.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.098+0000 7fce2e3ad640 1 -- 172.21.15.5:0/1421304304 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fce28153f90 con 0x7fce28069430 2023-07-14T12:52:42.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.098+0000 7fce24ff9640 1 -- 172.21.15.5:0/1421304304 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7fce28153f90 con 0x7fce28069430 2023-07-14T12:52:42.124 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T12:52:42.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.102+0000 7fce2e3ad640 1 -- 172.21.15.5:0/1421304304 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fce140662b0 msgr2=0x7fce14068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:42.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.102+0000 7fce2e3ad640 1 --2- 172.21.15.5:0/1421304304 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fce140662b0 0x7fce14068760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fce28159ca0 tx=0x7fce1c008040 comp rx=0 tx=0).stop 2023-07-14T12:52:42.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.102+0000 7fce2e3ad640 1 -- 172.21.15.5:0/1421304304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce28069430 msgr2=0x7fce280c2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:42.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.102+0000 7fce2e3ad640 1 --2- 172.21.15.5:0/1421304304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce28069430 0x7fce280c2d30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fce180ae040 tx=0x7fce1801aca0 comp rx=0 tx=0).stop 2023-07-14T12:52:42.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.102+0000 7fce2e3ad640 1 -- 172.21.15.5:0/1421304304 shutdown_connections 2023-07-14T12:52:42.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.102+0000 7fce2e3ad640 1 --2- 172.21.15.5:0/1421304304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce280af2b0 0x7fce281f45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:42.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.102+0000 7fce2e3ad640 1 --2- 172.21.15.5:0/1421304304 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce28070f30 0x7fce280cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:42.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.102+0000 7fce2e3ad640 1 --2- 172.21.15.5:0/1421304304 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fce140662b0 0x7fce14068760 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:42.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.102+0000 7fce2e3ad640 1 --2- 172.21.15.5:0/1421304304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce28069430 0x7fce280c2d30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:42.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.102+0000 7fce2e3ad640 1 -- 172.21.15.5:0/1421304304 >> 172.21.15.5:0/1421304304 conn(0x7fce280cde90 msgr2=0x7fce28156730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:42.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.102+0000 7fce2e3ad640 1 -- 172.21.15.5:0/1421304304 shutdown_connections 2023-07-14T12:52:42.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.102+0000 7fce2e3ad640 1 -- 172.21.15.5:0/1421304304 wait complete. 2023-07-14T12:52:42.145 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:52:42.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.266+0000 7f240299f640 1 Processor -- start 2023-07-14T12:52:42.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.266+0000 7f240299f640 1 -- start start 2023-07-14T12:52:42.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.266+0000 7f240299f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f23fc15fd60 0x7f23fc0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.266+0000 7f240299f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23fc0d1850 0x7f23fc0d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.266+0000 7f240299f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23fc0ccaf0 con 0x7f23fc0b7c70 2023-07-14T12:52:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.266+0000 7f240299f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23fc0d1190 con 0x7f23fc15fd60 2023-07-14T12:52:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.266+0000 7f240299f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc160600 con 0x7f23fc0d1850 2023-07-14T12:52:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.266+0000 7f23fbfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f23fc0b7c70 0x7f23fc15f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39036/0 (socket says 172.21.15.5:39036) 2023-07-14T12:52:42.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.266+0000 7f23fbfff640 1 -- 172.21.15.5:0/1403497037 learned_addr learned my addr 172.21.15.5:0/1403497037 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:42.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.266+0000 7f23fb7fe640 1 --2- 172.21.15.5:0/1403497037 >> v2:172.21.15.5:3300/0 conn(0x7f23fc15fd60 0x7f23fc0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:42.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.266+0000 7f2400f3c640 1 --2- 172.21.15.5:0/1403497037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23fc0d1850 0x7f23fc0d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:42.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.266+0000 7f23faffd640 1 -- 172.21.15.5:0/1403497037 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2720075813 0 0) 0x7f23fc0ccaf0 con 0x7f23fc0b7c70 2023-07-14T12:52:42.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.266+0000 7f23faffd640 1 -- 172.21.15.5:0/1403497037 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23e4003530 con 0x7f23fc0b7c70 2023-07-14T12:52:42.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.266+0000 7f23fb7fe640 1 -- 172.21.15.5:0/1403497037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23fc0d1850 msgr2=0x7f23fc0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:42.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.266+0000 7f23fb7fe640 1 --2- 172.21.15.5:0/1403497037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23fc0d1850 0x7f23fc0d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:42.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.266+0000 7f23fb7fe640 1 -- 172.21.15.5:0/1403497037 >> v1:172.21.15.5:6789/0 conn(0x7f23fc0b7c70 legacy=0x7f23fc15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:42.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.266+0000 7f23fb7fe640 1 -- 172.21.15.5:0/1403497037 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23fc160320 con 0x7f23fc15fd60 2023-07-14T12:52:42.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.270+0000 7f23fb7fe640 1 --2- 172.21.15.5:0/1403497037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc15fd60 0x7f23fc0d0c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f23f00097c0 tx=0x7f23f001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=697c2ce508dfdda4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:42.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.270+0000 7f23faffd640 1 -- 172.21.15.5:0/1403497037 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f00ab670 con 0x7f23fc15fd60 2023-07-14T12:52:42.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.270+0000 7f23faffd640 1 -- 172.21.15.5:0/1403497037 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f00ab7d0 con 0x7f23fc15fd60 2023-07-14T12:52:42.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.270+0000 7f23faffd640 1 -- 172.21.15.5:0/1403497037 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f00abb60 con 0x7f23fc15fd60 2023-07-14T12:52:42.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.270+0000 7f240299f640 1 -- 172.21.15.5:0/1403497037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc15fd60 msgr2=0x7f23fc0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:42.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.270+0000 7f240299f640 1 --2- 172.21.15.5:0/1403497037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc15fd60 0x7f23fc0d0c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f23f00097c0 tx=0x7f23f001c450 comp rx=0 tx=0).stop 2023-07-14T12:52:42.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.270+0000 7f240299f640 1 -- 172.21.15.5:0/1403497037 shutdown_connections 2023-07-14T12:52:42.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.270+0000 7f240299f640 1 --2- 172.21.15.5:0/1403497037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23fc0d1850 0x7f23fc0d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:42.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.270+0000 7f240299f640 1 --2- 172.21.15.5:0/1403497037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc15fd60 0x7f23fc0d0c50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:42.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.270+0000 7f240299f640 1 -- 172.21.15.5:0/1403497037 >> 172.21.15.5:0/1403497037 conn(0x7f23fc0650b0 msgr2=0x7f23fc0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:42.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.270+0000 7f240299f640 1 -- 172.21.15.5:0/1403497037 shutdown_connections 2023-07-14T12:52:42.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.270+0000 7f240299f640 1 -- 172.21.15.5:0/1403497037 wait complete. 2023-07-14T12:52:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.274+0000 7f240299f640 1 Processor -- start 2023-07-14T12:52:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.274+0000 7f240299f640 1 -- start start 2023-07-14T12:52:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.274+0000 7f240299f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23fc0b7c70 0x7f23fc0c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.274+0000 7f240299f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc0d1850 0x7f23fc0c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.274+0000 7f240299f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23fc15fd60 0x7f23fc0c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.274+0000 7f240299f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc15c6b0 con 0x7f23fc0d1850 2023-07-14T12:52:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.274+0000 7f240299f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc15efe0 con 0x7f23fc0b7c70 2023-07-14T12:52:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.274+0000 7f240299f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc0c6370 con 0x7f23fc15fd60 2023-07-14T12:52:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.274+0000 7f23fb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc0d1850 0x7f23fc0c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.274+0000 7f23fb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc0d1850 0x7f23fc0c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53312/0 (socket says 172.21.15.5:53312) 2023-07-14T12:52:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.274+0000 7f23fb7fe640 1 -- 172.21.15.5:0/3238576375 learned_addr learned my addr 172.21.15.5:0/3238576375 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.274+0000 7f23fbfff640 1 --2- 172.21.15.5:0/3238576375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23fc0b7c70 0x7f23fc0c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.274+0000 7f2400f3c640 1 --2- 172.21.15.5:0/3238576375 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23fc15fd60 0x7f23fc0c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.274+0000 7f23fb7fe640 1 -- 172.21.15.5:0/3238576375 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23fc15fd60 msgr2=0x7f23fc0c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.274+0000 7f23fb7fe640 1 --2- 172.21.15.5:0/3238576375 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23fc15fd60 0x7f23fc0c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.274+0000 7f23fb7fe640 1 -- 172.21.15.5:0/3238576375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23fc0b7c70 msgr2=0x7f23fc0c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.274+0000 7f23fb7fe640 1 --2- 172.21.15.5:0/3238576375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23fc0b7c70 0x7f23fc0c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.274+0000 7f23fb7fe640 1 -- 172.21.15.5:0/3238576375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f0009420 con 0x7f23fc0d1850 2023-07-14T12:52:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.274+0000 7f23fbfff640 1 --2- 172.21.15.5:0/3238576375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23fc0b7c70 0x7f23fc0c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:52:42.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.274+0000 7f2400f3c640 1 --2- 172.21.15.5:0/3238576375 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23fc15fd60 0x7f23fc0c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:52:42.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.274+0000 7f23fb7fe640 1 --2- 172.21.15.5:0/3238576375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc0d1850 0x7f23fc0c82d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f23f001a080 tx=0x7f23f00191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:42.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.274+0000 7f23f8ff9640 1 -- 172.21.15.5:0/3238576375 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f00abe10 con 0x7f23fc0d1850 2023-07-14T12:52:42.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.274+0000 7f23f8ff9640 1 -- 172.21.15.5:0/3238576375 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f00bf450 con 0x7f23fc0d1850 2023-07-14T12:52:42.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.274+0000 7f23f8ff9640 1 -- 172.21.15.5:0/3238576375 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f00bf800 con 0x7f23fc0d1850 2023-07-14T12:52:42.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.274+0000 7f240299f640 1 -- 172.21.15.5:0/3238576375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23fc15c310 con 0x7f23fc0d1850 2023-07-14T12:52:42.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.278+0000 7f240299f640 1 -- 172.21.15.5:0/3238576375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23fc15ed00 con 0x7f23fc0d1850 2023-07-14T12:52:42.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.278+0000 7f240299f640 1 -- 172.21.15.5:0/3238576375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23fc15c170 con 0x7f23fc0d1850 2023-07-14T12:52:42.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.278+0000 7f23f8ff9640 1 -- 172.21.15.5:0/3238576375 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f23f00b43f0 con 0x7f23fc0d1850 2023-07-14T12:52:42.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.278+0000 7f23f8ff9640 1 --2- 172.21.15.5:0/3238576375 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f23e8066280 0x7f23e8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:42.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.278+0000 7f23f8ff9640 1 -- 172.21.15.5:0/3238576375 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f23f011e160 con 0x7f23fc0d1850 2023-07-14T12:52:42.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.278+0000 7f23fbfff640 1 --2- 172.21.15.5:0/3238576375 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f23e8066280 0x7f23e8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:42.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.278+0000 7f23fbfff640 1 --2- 172.21.15.5:0/3238576375 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f23e8066280 0x7f23e8068730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f23ec0011f0 tx=0x7f23ec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:42.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.282+0000 7f23f8ff9640 1 -- 172.21.15.5:0/3238576375 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f23fc15c170 con 0x7f23fc0d1850 2023-07-14T12:52:42.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.470+0000 7f240299f640 1 -- 172.21.15.5:0/3238576375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23fc15c170 con 0x7f23fc0d1850 2023-07-14T12:52:42.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.470+0000 7f23f8ff9640 1 -- 172.21.15.5:0/3238576375 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3524 (secure 0 0 0) 0x7f23fc15c170 con 0x7f23fc0d1850 2023-07-14T12:52:42.495 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:52:42.495 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1953958881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1953958881},{"type":"v1","addr":"172.21.15.154:6837","nonce":1953958881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3138000501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3138000501},{"type":"v1","addr":"172.21.15.5:6834","nonce":3138000501}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1911549775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1911549775},{"type":"v1","addr":"172.21.15.5:6835","nonce":1911549775}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3154882793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3154882793},{"type":"v1","addr":"172.21.15.154:6836","nonce":3154882793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-14T12:52:42.496 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 3 2023-07-14T12:52:42.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.470+0000 7f240299f640 1 -- 172.21.15.5:0/3238576375 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f23e8066280 msgr2=0x7f23e8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:42.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.470+0000 7f240299f640 1 --2- 172.21.15.5:0/3238576375 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f23e8066280 0x7f23e8068730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f23ec0011f0 tx=0x7f23ec009040 comp rx=0 tx=0).stop 2023-07-14T12:52:42.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.470+0000 7f240299f640 1 -- 172.21.15.5:0/3238576375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc0d1850 msgr2=0x7f23fc0c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:42.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.470+0000 7f240299f640 1 --2- 172.21.15.5:0/3238576375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc0d1850 0x7f23fc0c82d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f23f001a080 tx=0x7f23f00191f0 comp rx=0 tx=0).stop 2023-07-14T12:52:42.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.470+0000 7f240299f640 1 -- 172.21.15.5:0/3238576375 shutdown_connections 2023-07-14T12:52:42.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.470+0000 7f240299f640 1 --2- 172.21.15.5:0/3238576375 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23fc15fd60 0x7f23fc0c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:42.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.470+0000 7f240299f640 1 --2- 172.21.15.5:0/3238576375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc0d1850 0x7f23fc0c82d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:42.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.470+0000 7f240299f640 1 --2- 172.21.15.5:0/3238576375 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f23e8066280 0x7f23e8068730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:42.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.470+0000 7f240299f640 1 --2- 172.21.15.5:0/3238576375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23fc0b7c70 0x7f23fc0c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:42.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.470+0000 7f240299f640 1 -- 172.21.15.5:0/3238576375 >> 172.21.15.5:0/3238576375 conn(0x7f23fc0650b0 msgr2=0x7f23fc0b7140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:42.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.470+0000 7f240299f640 1 -- 172.21.15.5:0/3238576375 shutdown_connections 2023-07-14T12:52:42.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.470+0000 7f240299f640 1 -- 172.21.15.5:0/3238576375 wait complete. 2023-07-14T12:52:42.517 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:52:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.634+0000 7f6a60a34640 1 Processor -- start 2023-07-14T12:52:42.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.634+0000 7f6a60a34640 1 -- start start 2023-07-14T12:52:42.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.634+0000 7f6a60a34640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6a5c070b70 0x7f6a5c070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:42.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.634+0000 7f6a60a34640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a5c06b1e0 0x7f6a5c0c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:42.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.634+0000 7f6a60a34640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5c0cac70 con 0x7f6a5c0c21f0 2023-07-14T12:52:42.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.634+0000 7f6a60a34640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5c071480 con 0x7f6a5c070b70 2023-07-14T12:52:42.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.634+0000 7f6a60a34640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c0ca060 con 0x7f6a5c06b1e0 2023-07-14T12:52:42.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.634+0000 7f6a5a59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6a5c070b70 0x7f6a5c070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:42.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.634+0000 7f6a5a59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6a5c070b70 0x7f6a5c070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53324/0 (socket says 172.21.15.5:53324) 2023-07-14T12:52:42.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.634+0000 7f6a5a59c640 1 -- 172.21.15.5:0/2590465521 learned_addr learned my addr 172.21.15.5:0/2590465521 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:42.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.634+0000 7f6a5a59c640 1 -- 172.21.15.5:0/2590465521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a5c06b1e0 msgr2=0x7f6a5c0c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:42.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.634+0000 7f6a53fff640 1 --2- 172.21.15.5:0/2590465521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a5c06b1e0 0x7f6a5c0c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:42.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.634+0000 7f6a5a59c640 1 --2- 172.21.15.5:0/2590465521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a5c06b1e0 0x7f6a5c0c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:42.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.634+0000 7f6a5a59c640 1 -- 172.21.15.5:0/2590465521 >> v1:172.21.15.154:6789/0 conn(0x7f6a5c0c21f0 legacy=0x7f6a5c0cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:42.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.634+0000 7f6a5a59c640 1 -- 172.21.15.5:0/2590465521 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5c0ca340 con 0x7f6a5c070b70 2023-07-14T12:52:42.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.634+0000 7f6a53fff640 1 --2- 172.21.15.5:0/2590465521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a5c06b1e0 0x7f6a5c0c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:52:42.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.638+0000 7f6a5a59c640 1 --2- 172.21.15.5:0/2590465521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a5c070b70 0x7f6a5c070f40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009870 tx=0x7f6a4c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c21374360e34b95 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:42.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.638+0000 7f6a59d9b640 1 -- 172.21.15.5:0/2590465521 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c0ab600 con 0x7f6a5c070b70 2023-07-14T12:52:42.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.638+0000 7f6a59d9b640 1 -- 172.21.15.5:0/2590465521 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4c0ab760 con 0x7f6a5c070b70 2023-07-14T12:52:42.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.638+0000 7f6a59d9b640 1 -- 172.21.15.5:0/2590465521 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c0abaf0 con 0x7f6a5c070b70 2023-07-14T12:52:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.638+0000 7f6a60a34640 1 -- 172.21.15.5:0/2590465521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a5c070b70 msgr2=0x7f6a5c070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.638+0000 7f6a60a34640 1 --2- 172.21.15.5:0/2590465521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a5c070b70 0x7f6a5c070f40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009870 tx=0x7f6a4c01c440 comp rx=0 tx=0).stop 2023-07-14T12:52:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.638+0000 7f6a60a34640 1 -- 172.21.15.5:0/2590465521 shutdown_connections 2023-07-14T12:52:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.638+0000 7f6a60a34640 1 --2- 172.21.15.5:0/2590465521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a5c06b1e0 0x7f6a5c0c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.638+0000 7f6a60a34640 1 --2- 172.21.15.5:0/2590465521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a5c070b70 0x7f6a5c070f40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.638+0000 7f6a60a34640 1 -- 172.21.15.5:0/2590465521 >> 172.21.15.5:0/2590465521 conn(0x7f6a5c0afcf0 msgr2=0x7f6a5c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.638+0000 7f6a60a34640 1 -- 172.21.15.5:0/2590465521 shutdown_connections 2023-07-14T12:52:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.638+0000 7f6a60a34640 1 -- 172.21.15.5:0/2590465521 wait complete. 2023-07-14T12:52:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.642+0000 7f6a60a34640 1 Processor -- start 2023-07-14T12:52:42.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.642+0000 7f6a60a34640 1 -- start start 2023-07-14T12:52:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.642+0000 7f6a60a34640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a5c06b1e0 0x7f6a5c1f5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.642+0000 7f6a60a34640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a5c070b70 0x7f6a5c151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.642+0000 7f6a60a34640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a5c0c21f0 0x7f6a5c0c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.642+0000 7f6a60a34640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c1f4550 con 0x7f6a5c070b70 2023-07-14T12:52:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.642+0000 7f6a60a34640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c1f5c40 con 0x7f6a5c06b1e0 2023-07-14T12:52:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.642+0000 7f6a60a34640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c158f80 con 0x7f6a5c0c21f0 2023-07-14T12:52:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.642+0000 7f6a53fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a5c070b70 0x7f6a5c151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.642+0000 7f6a53fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a5c070b70 0x7f6a5c151590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53332/0 (socket says 172.21.15.5:53332) 2023-07-14T12:52:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.642+0000 7f6a53fff640 1 -- 172.21.15.5:0/255806050 learned_addr learned my addr 172.21.15.5:0/255806050 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.642+0000 7f6a5a59c640 1 --2- 172.21.15.5:0/255806050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a5c06b1e0 0x7f6a5c1f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.642+0000 7f6a5ad9d640 1 --2- 172.21.15.5:0/255806050 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a5c0c21f0 0x7f6a5c0c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:42.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.642+0000 7f6a53fff640 1 -- 172.21.15.5:0/255806050 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a5c0c21f0 msgr2=0x7f6a5c0c3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:42.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.642+0000 7f6a53fff640 1 --2- 172.21.15.5:0/255806050 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a5c0c21f0 0x7f6a5c0c3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:42.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.642+0000 7f6a53fff640 1 -- 172.21.15.5:0/255806050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a5c06b1e0 msgr2=0x7f6a5c1f5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:42.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.642+0000 7f6a53fff640 1 --2- 172.21.15.5:0/255806050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a5c06b1e0 0x7f6a5c1f5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:42.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.642+0000 7f6a53fff640 1 -- 172.21.15.5:0/255806050 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c0094d0 con 0x7f6a5c070b70 2023-07-14T12:52:42.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.642+0000 7f6a53fff640 1 --2- 172.21.15.5:0/255806050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a5c070b70 0x7f6a5c151590 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400c7c0 tx=0x7f6a4400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:42.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.642+0000 7f6a52ffd640 1 -- 172.21.15.5:0/255806050 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a44007a30 con 0x7f6a5c070b70 2023-07-14T12:52:42.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.642+0000 7f6a52ffd640 1 -- 172.21.15.5:0/255806050 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a44007b90 con 0x7f6a5c070b70 2023-07-14T12:52:42.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.646+0000 7f6a60a34640 1 -- 172.21.15.5:0/255806050 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a5c159260 con 0x7f6a5c070b70 2023-07-14T12:52:42.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.646+0000 7f6a52ffd640 1 -- 172.21.15.5:0/255806050 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4400ce70 con 0x7f6a5c070b70 2023-07-14T12:52:42.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.646+0000 7f6a60a34640 1 -- 172.21.15.5:0/255806050 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5c159820 con 0x7f6a5c070b70 2023-07-14T12:52:42.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.646+0000 7f6a60a34640 1 -- 172.21.15.5:0/255806050 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a5c0678d0 con 0x7f6a5c070b70 2023-07-14T12:52:42.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.646+0000 7f6a52ffd640 1 -- 172.21.15.5:0/255806050 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6a440113f0 con 0x7f6a5c070b70 2023-07-14T12:52:42.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.646+0000 7f6a52ffd640 1 --2- 172.21.15.5:0/255806050 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f6a3c066280 0x7f6a3c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:42.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.646+0000 7f6a52ffd640 1 -- 172.21.15.5:0/255806050 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6a44083e00 con 0x7f6a5c070b70 2023-07-14T12:52:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.646+0000 7f6a5a59c640 1 --2- 172.21.15.5:0/255806050 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f6a3c066280 0x7f6a3c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.650+0000 7f6a5a59c640 1 --2- 172.21.15.5:0/255806050 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f6a3c066280 0x7f6a3c068730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c0af000 tx=0x7f6a4c0b6040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.650+0000 7f6a52ffd640 1 -- 172.21.15.5:0/255806050 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6a44051670 con 0x7f6a5c070b70 2023-07-14T12:52:42.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.806+0000 7f6a60a34640 1 -- 172.21.15.5:0/255806050 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a5c0c98c0 con 0x7f6a5c070b70 2023-07-14T12:52:42.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.810+0000 7f6a52ffd640 1 -- 172.21.15.5:0/255806050 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14588 (secure 0 0 0) 0x7f6a44054c90 con 0x7f6a5c070b70 2023-07-14T12:52:42.835 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:52:42.835 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":19,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:52:42.032123+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:52:42.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.810+0000 7f6a60a34640 1 -- 172.21.15.5:0/255806050 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f6a3c066280 msgr2=0x7f6a3c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:42.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.810+0000 7f6a60a34640 1 --2- 172.21.15.5:0/255806050 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f6a3c066280 0x7f6a3c068730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c0af000 tx=0x7f6a4c0b6040 comp rx=0 tx=0).stop 2023-07-14T12:52:42.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.810+0000 7f6a60a34640 1 -- 172.21.15.5:0/255806050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a5c070b70 msgr2=0x7f6a5c151590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:42.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.810+0000 7f6a60a34640 1 --2- 172.21.15.5:0/255806050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a5c070b70 0x7f6a5c151590 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400c7c0 tx=0x7f6a4400cc80 comp rx=0 tx=0).stop 2023-07-14T12:52:42.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.810+0000 7f6a60a34640 1 -- 172.21.15.5:0/255806050 shutdown_connections 2023-07-14T12:52:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.810+0000 7f6a60a34640 1 --2- 172.21.15.5:0/255806050 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a5c0c21f0 0x7f6a5c0c3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.810+0000 7f6a60a34640 1 --2- 172.21.15.5:0/255806050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a5c070b70 0x7f6a5c151590 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.810+0000 7f6a60a34640 1 --2- 172.21.15.5:0/255806050 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f6a3c066280 0x7f6a3c068730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.810+0000 7f6a60a34640 1 --2- 172.21.15.5:0/255806050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a5c06b1e0 0x7f6a5c1f5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.810+0000 7f6a60a34640 1 -- 172.21.15.5:0/255806050 >> 172.21.15.5:0/255806050 conn(0x7f6a5c0afcf0 msgr2=0x7f6a5c151de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.810+0000 7f6a60a34640 1 -- 172.21.15.5:0/255806050 shutdown_connections 2023-07-14T12:52:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.810+0000 7f6a60a34640 1 -- 172.21.15.5:0/255806050 wait complete. 2023-07-14T12:52:42.855 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T12:52:42.856 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T12:52:43.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.978+0000 7fa329dfa640 1 Processor -- start 2023-07-14T12:52:43.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.978+0000 7fa329dfa640 1 -- start start 2023-07-14T12:52:43.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.978+0000 7fa329dfa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3240aeb40 0x7fa32415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:43.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.978+0000 7fa329dfa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3240aef10 0x7fa324158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:43.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.978+0000 7fa329dfa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3241532b0 con 0x7fa324159270 2023-07-14T12:52:43.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.978+0000 7fa329dfa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3240ca6f0 con 0x7fa3240aef10 2023-07-14T12:52:43.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.978+0000 7fa329dfa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3241599d0 con 0x7fa3240aeb40 2023-07-14T12:52:43.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.978+0000 7fa323fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa324159270 0x7fa3240c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39042/0 (socket says 172.21.15.5:39042) 2023-07-14T12:52:43.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.978+0000 7fa323fff640 1 -- 172.21.15.5:0/3102390088 learned_addr learned my addr 172.21.15.5:0/3102390088 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:43.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.978+0000 7fa31bfff640 1 --2- 172.21.15.5:0/3102390088 >> v2:172.21.15.5:3300/0 conn(0x7fa3240aef10 0x7fa324158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:43.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.982+0000 7fa3237fe640 1 --2- 172.21.15.5:0/3102390088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3240aeb40 0x7fa32415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:43.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.982+0000 7fa322ffd640 1 -- 172.21.15.5:0/3102390088 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3640562187 0 0) 0x7fa3241532b0 con 0x7fa324159270 2023-07-14T12:52:43.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.982+0000 7fa322ffd640 1 -- 172.21.15.5:0/3102390088 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa310005740 con 0x7fa324159270 2023-07-14T12:52:43.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.982+0000 7fa31bfff640 1 -- 172.21.15.5:0/3102390088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3240aeb40 msgr2=0x7fa32415cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:43.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.982+0000 7fa31bfff640 1 --2- 172.21.15.5:0/3102390088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3240aeb40 0x7fa32415cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:43.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.982+0000 7fa31bfff640 1 -- 172.21.15.5:0/3102390088 >> v1:172.21.15.5:6789/0 conn(0x7fa324159270 legacy=0x7fa3240c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:43.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.982+0000 7fa31bfff640 1 -- 172.21.15.5:0/3102390088 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa324159cb0 con 0x7fa3240aef10 2023-07-14T12:52:43.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.982+0000 7fa3237fe640 1 --2- 172.21.15.5:0/3102390088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3240aeb40 0x7fa32415cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:52:43.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.982+0000 7fa31bfff640 1 --2- 172.21.15.5:0/3102390088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3240aef10 0x7fa324158d30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0097c0 tx=0x7fa30c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414853c9e1c99e4e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:43.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.982+0000 7fa322ffd640 1 -- 172.21.15.5:0/3102390088 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c0ac620 con 0x7fa3240aef10 2023-07-14T12:52:43.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.982+0000 7fa322ffd640 1 -- 172.21.15.5:0/3102390088 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30c0ac780 con 0x7fa3240aef10 2023-07-14T12:52:43.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.982+0000 7fa322ffd640 1 -- 172.21.15.5:0/3102390088 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c0acb10 con 0x7fa3240aef10 2023-07-14T12:52:43.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.986+0000 7fa329dfa640 1 -- 172.21.15.5:0/3102390088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3240aef10 msgr2=0x7fa324158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:43.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.986+0000 7fa329dfa640 1 --2- 172.21.15.5:0/3102390088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3240aef10 0x7fa324158d30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0097c0 tx=0x7fa30c01c3c0 comp rx=0 tx=0).stop 2023-07-14T12:52:43.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.986+0000 7fa329dfa640 1 -- 172.21.15.5:0/3102390088 shutdown_connections 2023-07-14T12:52:43.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.986+0000 7fa329dfa640 1 --2- 172.21.15.5:0/3102390088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3240aef10 0x7fa324158d30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:43.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.986+0000 7fa329dfa640 1 --2- 172.21.15.5:0/3102390088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3240aeb40 0x7fa32415cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:43.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.986+0000 7fa329dfa640 1 -- 172.21.15.5:0/3102390088 >> 172.21.15.5:0/3102390088 conn(0x7fa3240cde90 msgr2=0x7fa3240ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:43.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.986+0000 7fa329dfa640 1 -- 172.21.15.5:0/3102390088 shutdown_connections 2023-07-14T12:52:43.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.986+0000 7fa329dfa640 1 -- 172.21.15.5:0/3102390088 wait complete. 2023-07-14T12:52:43.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.986+0000 7fa329dfa640 1 Processor -- start 2023-07-14T12:52:43.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.986+0000 7fa329dfa640 1 -- start start 2023-07-14T12:52:43.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.986+0000 7fa329dfa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3240aeb40 0x7fa32413e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:43.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.986+0000 7fa329dfa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3240aef10 0x7fa324070820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:43.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.986+0000 7fa329dfa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa324159270 0x7fa32415af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:43.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.986+0000 7fa329dfa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3240b2b50 con 0x7fa3240aef10 2023-07-14T12:52:43.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.986+0000 7fa329dfa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3240b16a0 con 0x7fa324159270 2023-07-14T12:52:43.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.986+0000 7fa329dfa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa324140b60 con 0x7fa3240aeb40 2023-07-14T12:52:43.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.986+0000 7fa31bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3240aef10 0x7fa324070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:43.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.986+0000 7fa31bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3240aef10 0x7fa324070820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53354/0 (socket says 172.21.15.5:53354) 2023-07-14T12:52:43.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.986+0000 7fa31bfff640 1 -- 172.21.15.5:0/3187478964 learned_addr learned my addr 172.21.15.5:0/3187478964 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:43.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.986+0000 7fa3237fe640 1 --2- 172.21.15.5:0/3187478964 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3240aeb40 0x7fa32413e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:43.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.986+0000 7fa323fff640 1 --2- 172.21.15.5:0/3187478964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa324159270 0x7fa32415af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:43.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.986+0000 7fa31bfff640 1 -- 172.21.15.5:0/3187478964 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3240aeb40 msgr2=0x7fa32413e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:43.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.986+0000 7fa31bfff640 1 --2- 172.21.15.5:0/3187478964 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3240aeb40 0x7fa32413e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:43.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.986+0000 7fa31bfff640 1 -- 172.21.15.5:0/3187478964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa324159270 msgr2=0x7fa32415af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:43.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.986+0000 7fa31bfff640 1 --2- 172.21.15.5:0/3187478964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa324159270 0x7fa32415af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:43.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.986+0000 7fa31bfff640 1 -- 172.21.15.5:0/3187478964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c009420 con 0x7fa3240aef10 2023-07-14T12:52:43.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.986+0000 7fa31bfff640 1 --2- 172.21.15.5:0/3187478964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3240aef10 0x7fa324070820 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0af040 tx=0x7fa30c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:43.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.990+0000 7fa320ff9640 1 -- 172.21.15.5:0/3187478964 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c0b5410 con 0x7fa3240aef10 2023-07-14T12:52:43.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.990+0000 7fa320ff9640 1 -- 172.21.15.5:0/3187478964 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30c0b5590 con 0x7fa3240aef10 2023-07-14T12:52:43.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.990+0000 7fa329dfa640 1 -- 172.21.15.5:0/3187478964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa324140e40 con 0x7fa3240aef10 2023-07-14T12:52:43.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.990+0000 7fa320ff9640 1 -- 172.21.15.5:0/3187478964 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c0b5940 con 0x7fa3240aef10 2023-07-14T12:52:43.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.990+0000 7fa329dfa640 1 -- 172.21.15.5:0/3187478964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa324141400 con 0x7fa3240aef10 2023-07-14T12:52:43.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.990+0000 7fa329dfa640 1 -- 172.21.15.5:0/3187478964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3241415f0 con 0x7fa3240aef10 2023-07-14T12:52:43.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.990+0000 7fa320ff9640 1 -- 172.21.15.5:0/3187478964 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa30c0b3040 con 0x7fa3240aef10 2023-07-14T12:52:43.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.990+0000 7fa320ff9640 1 --2- 172.21.15.5:0/3187478964 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa3040662b0 0x7fa304068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:43.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.990+0000 7fa320ff9640 1 -- 172.21.15.5:0/3187478964 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa30c11dae0 con 0x7fa3240aef10 2023-07-14T12:52:43.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.990+0000 7fa3237fe640 1 --2- 172.21.15.5:0/3187478964 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa3040662b0 0x7fa304068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:43.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.994+0000 7fa3237fe640 1 --2- 172.21.15.5:0/3187478964 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa3040662b0 0x7fa304068760 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa3140098b0 tx=0x7fa314008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:43.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:42.994+0000 7fa320ff9640 1 -- 172.21.15.5:0/3187478964 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa30c0eb2a0 con 0x7fa3240aef10 2023-07-14T12:52:43.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.150+0000 7fa329dfa640 1 -- 172.21.15.5:0/3187478964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa3240678d0 con 0x7fa3240aef10 2023-07-14T12:52:43.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.150+0000 7fa320ff9640 1 -- 172.21.15.5:0/3187478964 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa30c0b1020 con 0x7fa3240aef10 2023-07-14T12:52:43.178 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T12:52:43.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.154+0000 7fa329dfa640 1 -- 172.21.15.5:0/3187478964 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa3040662b0 msgr2=0x7fa304068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:43.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.154+0000 7fa329dfa640 1 --2- 172.21.15.5:0/3187478964 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa3040662b0 0x7fa304068760 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa3140098b0 tx=0x7fa314008040 comp rx=0 tx=0).stop 2023-07-14T12:52:43.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.154+0000 7fa329dfa640 1 -- 172.21.15.5:0/3187478964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3240aef10 msgr2=0x7fa324070820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:43.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.154+0000 7fa329dfa640 1 --2- 172.21.15.5:0/3187478964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3240aef10 0x7fa324070820 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0af040 tx=0x7fa30c019160 comp rx=0 tx=0).stop 2023-07-14T12:52:43.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.154+0000 7fa329dfa640 1 -- 172.21.15.5:0/3187478964 shutdown_connections 2023-07-14T12:52:43.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.154+0000 7fa329dfa640 1 --2- 172.21.15.5:0/3187478964 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa3040662b0 0x7fa304068760 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:43.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.154+0000 7fa329dfa640 1 --2- 172.21.15.5:0/3187478964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa324159270 0x7fa32415af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:43.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.154+0000 7fa329dfa640 1 --2- 172.21.15.5:0/3187478964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3240aef10 0x7fa324070820 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:43.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.154+0000 7fa329dfa640 1 --2- 172.21.15.5:0/3187478964 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3240aeb40 0x7fa32413e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:43.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.154+0000 7fa329dfa640 1 -- 172.21.15.5:0/3187478964 >> 172.21.15.5:0/3187478964 conn(0x7fa3240cde90 msgr2=0x7fa3240ad8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:43.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.154+0000 7fa329dfa640 1 -- 172.21.15.5:0/3187478964 shutdown_connections 2023-07-14T12:52:43.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.154+0000 7fa329dfa640 1 -- 172.21.15.5:0/3187478964 wait complete. 2023-07-14T12:52:43.198 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T12:52:43.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.318+0000 7fc1f9337640 1 Processor -- start 2023-07-14T12:52:43.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.322+0000 7fc1f9337640 1 -- start start 2023-07-14T12:52:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.322+0000 7fc1f9337640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc1f415bde0 0x7fc1f40d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.322+0000 7fc1f9337640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1f40d2300 0x7fc1f40d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.322+0000 7fc1f9337640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f40b04c0 con 0x7fc1f40d2fc0 2023-07-14T12:52:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.322+0000 7fc1f9337640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f415c1b0 con 0x7fc1f415bde0 2023-07-14T12:52:43.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.322+0000 7fc1f9337640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40d2cc0 con 0x7fc1f40d2300 2023-07-14T12:52:43.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.322+0000 7fc1f37fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1f40d2300 0x7fc1f40d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:43.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.322+0000 7fc1ebfff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc1f40d2fc0 0x7fc1f40b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:53152/0 (socket says 172.21.15.5:53152) 2023-07-14T12:52:43.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.322+0000 7fc1f2ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc1f415bde0 0x7fc1f40d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:43.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.322+0000 7fc1ebfff640 1 -- 172.21.15.5:0/2033082769 learned_addr learned my addr 172.21.15.5:0/2033082769 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:43.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.322+0000 7fc1f27fc640 1 -- 172.21.15.5:0/2033082769 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2491076494 0 0) 0x7fc1f40b04c0 con 0x7fc1f40d2fc0 2023-07-14T12:52:43.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.322+0000 7fc1f27fc640 1 -- 172.21.15.5:0/2033082769 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1e0003530 con 0x7fc1f40d2fc0 2023-07-14T12:52:43.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.322+0000 7fc1f2ffd640 1 -- 172.21.15.5:0/2033082769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1f40d2300 msgr2=0x7fc1f40d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.322+0000 7fc1f2ffd640 1 --2- 172.21.15.5:0/2033082769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1f40d2300 0x7fc1f40d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.322+0000 7fc1f2ffd640 1 -- 172.21.15.5:0/2033082769 >> v1:172.21.15.154:6789/0 conn(0x7fc1f40d2fc0 legacy=0x7fc1f40b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.322+0000 7fc1f2ffd640 1 -- 172.21.15.5:0/2033082769 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f40b1060 con 0x7fc1f415bde0 2023-07-14T12:52:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.322+0000 7fc1f37fe640 1 --2- 172.21.15.5:0/2033082769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1f40d2300 0x7fc1f40d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:52:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.326+0000 7fc1f2ffd640 1 --2- 172.21.15.5:0/2033082769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1f415bde0 0x7fc1f40d0270 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40097a0 tx=0x7fc1e401c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7031c3c1e5c39f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:43.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.326+0000 7fc1f27fc640 1 -- 172.21.15.5:0/2033082769 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e40ab600 con 0x7fc1f415bde0 2023-07-14T12:52:43.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.326+0000 7fc1f27fc640 1 -- 172.21.15.5:0/2033082769 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e40a7050 con 0x7fc1f415bde0 2023-07-14T12:52:43.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.326+0000 7fc1f27fc640 1 -- 172.21.15.5:0/2033082769 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e40ab980 con 0x7fc1f415bde0 2023-07-14T12:52:43.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.326+0000 7fc1f9337640 1 -- 172.21.15.5:0/2033082769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1f415bde0 msgr2=0x7fc1f40d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.326+0000 7fc1f9337640 1 --2- 172.21.15.5:0/2033082769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1f415bde0 0x7fc1f40d0270 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40097a0 tx=0x7fc1e401c460 comp rx=0 tx=0).stop 2023-07-14T12:52:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.326+0000 7fc1f9337640 1 -- 172.21.15.5:0/2033082769 shutdown_connections 2023-07-14T12:52:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.326+0000 7fc1f9337640 1 --2- 172.21.15.5:0/2033082769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1f40d2300 0x7fc1f40d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.326+0000 7fc1f9337640 1 --2- 172.21.15.5:0/2033082769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1f415bde0 0x7fc1f40d0270 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.326+0000 7fc1f9337640 1 -- 172.21.15.5:0/2033082769 >> 172.21.15.5:0/2033082769 conn(0x7fc1f40659d0 msgr2=0x7fc1f409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.326+0000 7fc1f9337640 1 -- 172.21.15.5:0/2033082769 shutdown_connections 2023-07-14T12:52:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.326+0000 7fc1f9337640 1 -- 172.21.15.5:0/2033082769 wait complete. 2023-07-14T12:52:43.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.330+0000 7fc1f9337640 1 Processor -- start 2023-07-14T12:52:43.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.330+0000 7fc1f9337640 1 -- start start 2023-07-14T12:52:43.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.330+0000 7fc1f9337640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1f40d2300 0x7fc1f40b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:43.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.330+0000 7fc1f9337640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1f40d2fc0 0x7fc1f4159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:43.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.330+0000 7fc1f9337640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1f415bde0 0x7fc1f4153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:43.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.330+0000 7fc1f9337640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40b58a0 con 0x7fc1f40d2fc0 2023-07-14T12:52:43.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.330+0000 7fc1f9337640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40b5b80 con 0x7fc1f40d2300 2023-07-14T12:52:43.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.330+0000 7fc1f9337640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40b5e60 con 0x7fc1f415bde0 2023-07-14T12:52:43.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.330+0000 7fc1ebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1f40d2fc0 0x7fc1f4159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:43.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.330+0000 7fc1ebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1f40d2fc0 0x7fc1f4159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53360/0 (socket says 172.21.15.5:53360) 2023-07-14T12:52:43.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.330+0000 7fc1ebfff640 1 -- 172.21.15.5:0/2746427220 learned_addr learned my addr 172.21.15.5:0/2746427220 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:43.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.330+0000 7fc1f2ffd640 1 --2- 172.21.15.5:0/2746427220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1f40d2300 0x7fc1f40b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:43.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.330+0000 7fc1f37fe640 1 --2- 172.21.15.5:0/2746427220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1f415bde0 0x7fc1f4153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:43.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.330+0000 7fc1ebfff640 1 -- 172.21.15.5:0/2746427220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1f415bde0 msgr2=0x7fc1f4153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:43.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.330+0000 7fc1ebfff640 1 --2- 172.21.15.5:0/2746427220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1f415bde0 0x7fc1f4153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:43.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.330+0000 7fc1ebfff640 1 -- 172.21.15.5:0/2746427220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1f40d2300 msgr2=0x7fc1f40b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:43.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.330+0000 7fc1ebfff640 1 --2- 172.21.15.5:0/2746427220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1f40d2300 0x7fc1f40b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:43.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.330+0000 7fc1ebfff640 1 -- 172.21.15.5:0/2746427220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec009a70 con 0x7fc1f40d2fc0 2023-07-14T12:52:43.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.330+0000 7fc1f2ffd640 1 --2- 172.21.15.5:0/2746427220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1f40d2300 0x7fc1f40b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:52:43.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.330+0000 7fc1f37fe640 1 --2- 172.21.15.5:0/2746427220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1f415bde0 0x7fc1f4153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:52:43.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.330+0000 7fc1ebfff640 1 --2- 172.21.15.5:0/2746427220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1f40d2fc0 0x7fc1f4159a70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00c400 tx=0x7fc1dc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:43.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.330+0000 7fc1eb7fe640 1 -- 172.21.15.5:0/2746427220 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc005cf0 con 0x7fc1f40d2fc0 2023-07-14T12:52:43.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.330+0000 7fc1eb7fe640 1 -- 172.21.15.5:0/2746427220 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc005e50 con 0x7fc1f40d2fc0 2023-07-14T12:52:43.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.330+0000 7fc1eb7fe640 1 -- 172.21.15.5:0/2746427220 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc0072d0 con 0x7fc1f40d2fc0 2023-07-14T12:52:43.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.330+0000 7fc1f9337640 1 -- 172.21.15.5:0/2746427220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e40093b0 con 0x7fc1f40d2fc0 2023-07-14T12:52:43.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.330+0000 7fc1f9337640 1 -- 172.21.15.5:0/2746427220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f41f4050 con 0x7fc1f40d2fc0 2023-07-14T12:52:43.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.330+0000 7fc1f9337640 1 -- 172.21.15.5:0/2746427220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f4159fb0 con 0x7fc1f40d2fc0 2023-07-14T12:52:43.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.334+0000 7fc1eb7fe640 1 -- 172.21.15.5:0/2746427220 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc1dc007430 con 0x7fc1f40d2fc0 2023-07-14T12:52:43.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.334+0000 7fc1eb7fe640 1 --2- 172.21.15.5:0/2746427220 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc1d40662b0 0x7fc1d4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:43.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.334+0000 7fc1eb7fe640 1 -- 172.21.15.5:0/2746427220 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc1dc082b70 con 0x7fc1f40d2fc0 2023-07-14T12:52:43.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.334+0000 7fc1f2ffd640 1 --2- 172.21.15.5:0/2746427220 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc1d40662b0 0x7fc1d4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:43.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.334+0000 7fc1f2ffd640 1 --2- 172.21.15.5:0/2746427220 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc1d40662b0 0x7fc1d4068760 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40ad000 tx=0x7fc1e4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:43.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.338+0000 7fc1eb7fe640 1 -- 172.21.15.5:0/2746427220 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc1dc0504a0 con 0x7fc1f40d2fc0 2023-07-14T12:52:43.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.490+0000 7fc1f9337640 1 -- 172.21.15.5:0/2746427220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc1f41f4240 con 0x7fc1f40d2fc0 2023-07-14T12:52:43.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.490+0000 7fc1eb7fe640 1 -- 172.21.15.5:0/2746427220 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc1dc0170a0 con 0x7fc1f40d2fc0 2023-07-14T12:52:43.517 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T12:52:43.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.494+0000 7fc1f9337640 1 -- 172.21.15.5:0/2746427220 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc1d40662b0 msgr2=0x7fc1d4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:43.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.494+0000 7fc1f9337640 1 --2- 172.21.15.5:0/2746427220 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc1d40662b0 0x7fc1d4068760 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40ad000 tx=0x7fc1e4008040 comp rx=0 tx=0).stop 2023-07-14T12:52:43.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.494+0000 7fc1f9337640 1 -- 172.21.15.5:0/2746427220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1f40d2fc0 msgr2=0x7fc1f4159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:43.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.494+0000 7fc1f9337640 1 --2- 172.21.15.5:0/2746427220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1f40d2fc0 0x7fc1f4159a70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00c400 tx=0x7fc1dc00c8c0 comp rx=0 tx=0).stop 2023-07-14T12:52:43.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.494+0000 7fc1f9337640 1 -- 172.21.15.5:0/2746427220 shutdown_connections 2023-07-14T12:52:43.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.494+0000 7fc1f9337640 1 --2- 172.21.15.5:0/2746427220 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1f415bde0 0x7fc1f4153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:43.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.494+0000 7fc1f9337640 1 --2- 172.21.15.5:0/2746427220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1f40d2fc0 0x7fc1f4159a70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:43.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.494+0000 7fc1f9337640 1 --2- 172.21.15.5:0/2746427220 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc1d40662b0 0x7fc1d4068760 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:43.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.494+0000 7fc1f9337640 1 --2- 172.21.15.5:0/2746427220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1f40d2300 0x7fc1f40b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:43.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.494+0000 7fc1f9337640 1 -- 172.21.15.5:0/2746427220 >> 172.21.15.5:0/2746427220 conn(0x7fc1f40659d0 msgr2=0x7fc1f40cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:43.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.494+0000 7fc1f9337640 1 -- 172.21.15.5:0/2746427220 shutdown_connections 2023-07-14T12:52:43.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.494+0000 7fc1f9337640 1 -- 172.21.15.5:0/2746427220 wait complete. 2023-07-14T12:52:43.538 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-14T12:52:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.658+0000 7f427ba48640 1 Processor -- start 2023-07-14T12:52:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.658+0000 7f427ba48640 1 -- start start 2023-07-14T12:52:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.658+0000 7f427ba48640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f42740b7c70 0x7f42740d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:43.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.658+0000 7f427ba48640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42740ccaf0 con 0x7f427415fd60 2023-07-14T12:52:43.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.658+0000 7f427ba48640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4274160320 con 0x7f42740d1850 2023-07-14T12:52:43.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.658+0000 7f427ba48640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42740d1190 con 0x7f42740b7c70 2023-07-14T12:52:43.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.658+0000 7f42797e4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f42740b7c70 0x7f42740d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.658+0000 7f4279fe5640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f427415fd60 0x7f42740d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39044/0 (socket says 172.21.15.5:39044) 2023-07-14T12:52:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.658+0000 7f4279fe5640 1 -- 172.21.15.5:0/1372675629 learned_addr learned my addr 172.21.15.5:0/1372675629 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.658+0000 7f42797e4640 1 -- 172.21.15.5:0/1372675629 >> v1:172.21.15.154:6789/0 conn(0x7f42740d1850 legacy=0x7f427415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.658+0000 7f42797e4640 1 -- 172.21.15.5:0/1372675629 >> v1:172.21.15.5:6789/0 conn(0x7f427415fd60 legacy=0x7f42740d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.658+0000 7f42797e4640 1 -- 172.21.15.5:0/1372675629 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42740ccd90 con 0x7f42740b7c70 2023-07-14T12:52:43.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.658+0000 7f426bfff640 1 -- 172.21.15.5:0/1372675629 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1354462592 0 0) 0x7f42740ccaf0 con 0x7f427415fd60 2023-07-14T12:52:43.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.662+0000 7f42797e4640 1 --2- 172.21.15.5:0/1372675629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42740b7c70 0x7f42740d0c50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f42700097c0 tx=0x7f427001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f628ee4419c57a4a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:43.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.662+0000 7f426bfff640 1 -- 172.21.15.5:0/1372675629 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42700a8050 con 0x7f42740b7c70 2023-07-14T12:52:43.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.662+0000 7f426bfff640 1 -- 172.21.15.5:0/1372675629 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42700ac5f0 con 0x7f42740b7c70 2023-07-14T12:52:43.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.662+0000 7f426bfff640 1 -- 172.21.15.5:0/1372675629 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42700ac980 con 0x7f42740b7c70 2023-07-14T12:52:43.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.662+0000 7f427ba48640 1 -- 172.21.15.5:0/1372675629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42740b7c70 msgr2=0x7f42740d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:43.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.662+0000 7f427ba48640 1 --2- 172.21.15.5:0/1372675629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42740b7c70 0x7f42740d0c50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f42700097c0 tx=0x7f427001c480 comp rx=0 tx=0).stop 2023-07-14T12:52:43.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.662+0000 7f427ba48640 1 -- 172.21.15.5:0/1372675629 shutdown_connections 2023-07-14T12:52:43.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.662+0000 7f427ba48640 1 --2- 172.21.15.5:0/1372675629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42740b7c70 0x7f42740d0c50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:43.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.662+0000 7f427ba48640 1 -- 172.21.15.5:0/1372675629 >> 172.21.15.5:0/1372675629 conn(0x7f42740650b0 msgr2=0x7f42740654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:43.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.662+0000 7f427ba48640 1 -- 172.21.15.5:0/1372675629 shutdown_connections 2023-07-14T12:52:43.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.662+0000 7f427ba48640 1 -- 172.21.15.5:0/1372675629 wait complete. 2023-07-14T12:52:43.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.666+0000 7f427ba48640 1 Processor -- start 2023-07-14T12:52:43.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.666+0000 7f427ba48640 1 -- start start 2023-07-14T12:52:43.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.666+0000 7f427ba48640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42740b7c70 0x7f427414ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:43.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.666+0000 7f427ba48640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42740d1850 0x7f427414a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:43.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.666+0000 7f427ba48640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f427415fd60 0x7f42741554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:43.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.666+0000 7f427ba48640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4274159ea0 con 0x7f42740d1850 2023-07-14T12:52:43.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.666+0000 7f427ba48640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4274158010 con 0x7f42740b7c70 2023-07-14T12:52:43.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.666+0000 7f427ba48640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427415c2d0 con 0x7f427415fd60 2023-07-14T12:52:43.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.666+0000 7f4278fe3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42740d1850 0x7f427414a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:43.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.666+0000 7f4278fe3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42740d1850 0x7f427414a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53376/0 (socket says 172.21.15.5:53376) 2023-07-14T12:52:43.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.666+0000 7f4278fe3640 1 -- 172.21.15.5:0/3453489474 learned_addr learned my addr 172.21.15.5:0/3453489474 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:43.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.666+0000 7f42797e4640 1 --2- 172.21.15.5:0/3453489474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42740b7c70 0x7f427414ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:43.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.666+0000 7f4279fe5640 1 --2- 172.21.15.5:0/3453489474 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f427415fd60 0x7f42741554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:43.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.666+0000 7f4278fe3640 1 -- 172.21.15.5:0/3453489474 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f427415fd60 msgr2=0x7f42741554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.666+0000 7f4278fe3640 1 --2- 172.21.15.5:0/3453489474 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f427415fd60 0x7f42741554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.666+0000 7f4278fe3640 1 -- 172.21.15.5:0/3453489474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42740b7c70 msgr2=0x7f427414ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.666+0000 7f4278fe3640 1 --2- 172.21.15.5:0/3453489474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42740b7c70 0x7f427414ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.666+0000 7f4278fe3640 1 -- 172.21.15.5:0/3453489474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4270009420 con 0x7f42740d1850 2023-07-14T12:52:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.666+0000 7f4278fe3640 1 --2- 172.21.15.5:0/3453489474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42740d1850 0x7f427414a2c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f426400c3c0 tx=0x7f426400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.666+0000 7f4269ffb640 1 -- 172.21.15.5:0/3453489474 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42640052d0 con 0x7f42740d1850 2023-07-14T12:52:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.666+0000 7f4269ffb640 1 -- 172.21.15.5:0/3453489474 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4264005430 con 0x7f42740d1850 2023-07-14T12:52:43.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.666+0000 7f4269ffb640 1 -- 172.21.15.5:0/3453489474 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4264003840 con 0x7f42740d1850 2023-07-14T12:52:43.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.666+0000 7f427ba48640 1 -- 172.21.15.5:0/3453489474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427414cf20 con 0x7f42740d1850 2023-07-14T12:52:43.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.666+0000 7f427ba48640 1 -- 172.21.15.5:0/3453489474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4274159600 con 0x7f42740d1850 2023-07-14T12:52:43.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.666+0000 7f427ba48640 1 -- 172.21.15.5:0/3453489474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42740678d0 con 0x7f42740d1850 2023-07-14T12:52:43.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.670+0000 7f4269ffb640 1 -- 172.21.15.5:0/3453489474 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f42640039a0 con 0x7f42740d1850 2023-07-14T12:52:43.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.670+0000 7f4269ffb640 1 --2- 172.21.15.5:0/3453489474 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4258066280 0x7f4258068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:43.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.670+0000 7f4269ffb640 1 -- 172.21.15.5:0/3453489474 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4264082ed0 con 0x7f42740d1850 2023-07-14T12:52:43.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.670+0000 7f42797e4640 1 --2- 172.21.15.5:0/3453489474 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4258066280 0x7f4258068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:43.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.670+0000 7f42797e4640 1 --2- 172.21.15.5:0/3453489474 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4258066280 0x7f4258068730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f42700ae000 tx=0x7f42700a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:43.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.674+0000 7f4269ffb640 1 -- 172.21.15.5:0/3453489474 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f42640506b0 con 0x7f42740d1850 2023-07-14T12:52:43.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.830+0000 7f427ba48640 1 -- 172.21.15.5:0/3453489474 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4274065480 con 0x7f42740d1850 2023-07-14T12:52:43.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.834+0000 7f4269ffb640 1 -- 172.21.15.5:0/3453489474 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7f4264017090 con 0x7f42740d1850 2023-07-14T12:52:43.858 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:52:43.859 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-07-14T12:52:43.859 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:52:43.859 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-07-14T12:52:43.859 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-07-14T12:52:43.859 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T12:52:43.860 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:52:43.860 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 2, 2023-07-14T12:52:43.860 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": "rbd" 2023-07-14T12:52:43.860 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:52:43.860 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-07-14T12:52:43.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.834+0000 7f427ba48640 1 -- 172.21.15.5:0/3453489474 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4258066280 msgr2=0x7f4258068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.834+0000 7f427ba48640 1 --2- 172.21.15.5:0/3453489474 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4258066280 0x7f4258068730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f42700ae000 tx=0x7f42700a7000 comp rx=0 tx=0).stop 2023-07-14T12:52:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.834+0000 7f427ba48640 1 -- 172.21.15.5:0/3453489474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42740d1850 msgr2=0x7f427414a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.834+0000 7f427ba48640 1 --2- 172.21.15.5:0/3453489474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42740d1850 0x7f427414a2c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f426400c3c0 tx=0x7f426400c880 comp rx=0 tx=0).stop 2023-07-14T12:52:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.834+0000 7f427ba48640 1 -- 172.21.15.5:0/3453489474 shutdown_connections 2023-07-14T12:52:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.834+0000 7f427ba48640 1 --2- 172.21.15.5:0/3453489474 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f427415fd60 0x7f42741554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.834+0000 7f427ba48640 1 --2- 172.21.15.5:0/3453489474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42740d1850 0x7f427414a2c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:43.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.834+0000 7f427ba48640 1 --2- 172.21.15.5:0/3453489474 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4258066280 0x7f4258068730 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:43.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.834+0000 7f427ba48640 1 --2- 172.21.15.5:0/3453489474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42740b7c70 0x7f427414ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:43.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.834+0000 7f427ba48640 1 -- 172.21.15.5:0/3453489474 >> 172.21.15.5:0/3453489474 conn(0x7f42740650b0 msgr2=0x7f427415f370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:43.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.834+0000 7f427ba48640 1 -- 172.21.15.5:0/3453489474 shutdown_connections 2023-07-14T12:52:43.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:43.834+0000 7f427ba48640 1 -- 172.21.15.5:0/3453489474 wait complete. 2023-07-14T12:52:43.879 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-14T12:52:43.880 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-14T12:52:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.002+0000 7f7a60fe9640 1 Processor -- start 2023-07-14T12:52:44.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.002+0000 7f7a60fe9640 1 -- start start 2023-07-14T12:52:44.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.002+0000 7f7a60fe9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7a5c070f30 0x7f7a5c0ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.002+0000 7f7a60fe9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a5c0af2b0 0x7f7a5c15a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.002+0000 7f7a60fe9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a5c159d70 con 0x7f7a5c069430 2023-07-14T12:52:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.002+0000 7f7a60fe9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a5c0c9c60 con 0x7f7a5c0af2b0 2023-07-14T12:52:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.002+0000 7f7a60fe9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a5c0c9f40 con 0x7f7a5c070f30 2023-07-14T12:52:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.002+0000 7f7a5ad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a5c0af2b0 0x7f7a5c15a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.002+0000 7f7a5ad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a5c0af2b0 0x7f7a5c15a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53378/0 (socket says 172.21.15.5:53378) 2023-07-14T12:52:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.002+0000 7f7a5ad9d640 1 -- 172.21.15.5:0/2619422577 learned_addr learned my addr 172.21.15.5:0/2619422577 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.002+0000 7f7a53fff640 1 --2- 172.21.15.5:0/2619422577 >> v2:172.21.15.154:3300/0 conn(0x7f7a5c070f30 0x7f7a5c0ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.006+0000 7f7a5ad9d640 1 -- 172.21.15.5:0/2619422577 >> v2:172.21.15.154:3300/0 conn(0x7f7a5c070f30 msgr2=0x7f7a5c0ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.006+0000 7f7a5ad9d640 1 --2- 172.21.15.5:0/2619422577 >> v2:172.21.15.154:3300/0 conn(0x7f7a5c070f30 0x7f7a5c0ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.006+0000 7f7a5ad9d640 1 -- 172.21.15.5:0/2619422577 >> v1:172.21.15.154:6789/0 conn(0x7f7a5c069430 legacy=0x7f7a5c069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.006+0000 7f7a5ad9d640 1 -- 172.21.15.5:0/2619422577 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c0ca220 con 0x7f7a5c0af2b0 2023-07-14T12:52:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.006+0000 7f7a5ad9d640 1 --2- 172.21.15.5:0/2619422577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a5c0af2b0 0x7f7a5c15a1f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0c9830 tx=0x7f7a5401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b1dab74a572f80 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.006+0000 7f7a59d9b640 1 -- 172.21.15.5:0/2619422577 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a540a57a0 con 0x7f7a5c0af2b0 2023-07-14T12:52:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.006+0000 7f7a59d9b640 1 -- 172.21.15.5:0/2619422577 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a540a5900 con 0x7f7a5c0af2b0 2023-07-14T12:52:44.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.006+0000 7f7a59d9b640 1 -- 172.21.15.5:0/2619422577 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a540a5c90 con 0x7f7a5c0af2b0 2023-07-14T12:52:44.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.006+0000 7f7a60fe9640 1 -- 172.21.15.5:0/2619422577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a5c0af2b0 msgr2=0x7f7a5c15a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:44.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.006+0000 7f7a60fe9640 1 --2- 172.21.15.5:0/2619422577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a5c0af2b0 0x7f7a5c15a1f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0c9830 tx=0x7f7a5401c9d0 comp rx=0 tx=0).stop 2023-07-14T12:52:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.010+0000 7f7a60fe9640 1 -- 172.21.15.5:0/2619422577 shutdown_connections 2023-07-14T12:52:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.010+0000 7f7a60fe9640 1 --2- 172.21.15.5:0/2619422577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a5c0af2b0 0x7f7a5c15a1f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.010+0000 7f7a60fe9640 1 --2- 172.21.15.5:0/2619422577 >> v2:172.21.15.154:3300/0 conn(0x7f7a5c070f30 0x7f7a5c0ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.010+0000 7f7a60fe9640 1 -- 172.21.15.5:0/2619422577 >> 172.21.15.5:0/2619422577 conn(0x7f7a5c0cde90 msgr2=0x7f7a5c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.010+0000 7f7a60fe9640 1 -- 172.21.15.5:0/2619422577 shutdown_connections 2023-07-14T12:52:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.010+0000 7f7a60fe9640 1 -- 172.21.15.5:0/2619422577 wait complete. 2023-07-14T12:52:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.010+0000 7f7a60fe9640 1 Processor -- start 2023-07-14T12:52:44.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.010+0000 7f7a60fe9640 1 -- start start 2023-07-14T12:52:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.010+0000 7f7a60fe9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a5c069430 0x7f7a5c13e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.010+0000 7f7a60fe9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a5c070f30 0x7f7a5c158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.010+0000 7f7a60fe9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a5c0af2b0 0x7f7a5c158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.010+0000 7f7a60fe9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c1570a0 con 0x7f7a5c069430 2023-07-14T12:52:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.010+0000 7f7a60fe9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c156ae0 con 0x7f7a5c0af2b0 2023-07-14T12:52:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.010+0000 7f7a60fe9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c156dc0 con 0x7f7a5c070f30 2023-07-14T12:52:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.010+0000 7f7a5a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a5c069430 0x7f7a5c13e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.010+0000 7f7a5ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a5c0af2b0 0x7f7a5c158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.010+0000 7f7a5ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a5c0af2b0 0x7f7a5c158960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:42402/0 (socket says 172.21.15.5:42402) 2023-07-14T12:52:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.010+0000 7f7a5a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a5c069430 0x7f7a5c13e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53382/0 (socket says 172.21.15.5:53382) 2023-07-14T12:52:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.010+0000 7f7a5ad9d640 1 -- 172.21.15.5:0/4278245425 learned_addr learned my addr 172.21.15.5:0/4278245425 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.010+0000 7f7a53fff640 1 --2- 172.21.15.5:0/4278245425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a5c070f30 0x7f7a5c158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.010+0000 7f7a5ad9d640 1 -- 172.21.15.5:0/4278245425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a5c070f30 msgr2=0x7f7a5c158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.010+0000 7f7a5ad9d640 1 --2- 172.21.15.5:0/4278245425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a5c070f30 0x7f7a5c158420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.010+0000 7f7a5ad9d640 1 -- 172.21.15.5:0/4278245425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a5c069430 msgr2=0x7f7a5c13e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.010+0000 7f7a5ad9d640 1 --2- 172.21.15.5:0/4278245425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a5c069430 0x7f7a5c13e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.010+0000 7f7a5ad9d640 1 -- 172.21.15.5:0/4278245425 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a54009b30 con 0x7f7a5c0af2b0 2023-07-14T12:52:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.010+0000 7f7a5a59c640 1 --2- 172.21.15.5:0/4278245425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a5c069430 0x7f7a5c13e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:52:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.014+0000 7f7a5ad9d640 1 --2- 172.21.15.5:0/4278245425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a5c0af2b0 0x7f7a5c158960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7a540af040 tx=0x7f7a54019770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:44.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.014+0000 7f7a52ffd640 1 -- 172.21.15.5:0/4278245425 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a540b8670 con 0x7f7a5c0af2b0 2023-07-14T12:52:44.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.014+0000 7f7a52ffd640 1 -- 172.21.15.5:0/4278245425 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a540b87d0 con 0x7f7a5c0af2b0 2023-07-14T12:52:44.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.014+0000 7f7a60fe9640 1 -- 172.21.15.5:0/4278245425 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5c0ca9a0 con 0x7f7a5c0af2b0 2023-07-14T12:52:44.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.014+0000 7f7a52ffd640 1 -- 172.21.15.5:0/4278245425 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a540b8b80 con 0x7f7a5c0af2b0 2023-07-14T12:52:44.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.014+0000 7f7a60fe9640 1 -- 172.21.15.5:0/4278245425 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5c13ed60 con 0x7f7a5c0af2b0 2023-07-14T12:52:44.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.014+0000 7f7a60fe9640 1 -- 172.21.15.5:0/4278245425 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a5c0caec0 con 0x7f7a5c0af2b0 2023-07-14T12:52:44.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.014+0000 7f7a52ffd640 1 -- 172.21.15.5:0/4278245425 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7a540b8ce0 con 0x7f7a5c0af2b0 2023-07-14T12:52:44.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.014+0000 7f7a52ffd640 1 --2- 172.21.15.5:0/4278245425 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7a3c066280 0x7f7a3c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:44.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.014+0000 7f7a52ffd640 1 -- 172.21.15.5:0/4278245425 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7a5411f5a0 con 0x7f7a5c0af2b0 2023-07-14T12:52:44.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.018+0000 7f7a5a59c640 1 --2- 172.21.15.5:0/4278245425 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7a3c066280 0x7f7a3c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:44.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.018+0000 7f7a5a59c640 1 --2- 172.21.15.5:0/4278245425 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7a3c066280 0x7f7a3c068730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c007fd0 tx=0x7f7a4c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:44.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.018+0000 7f7a52ffd640 1 -- 172.21.15.5:0/4278245425 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7a540ece00 con 0x7f7a5c0af2b0 2023-07-14T12:52:44.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:44.174+0000 7f7a60fe9640 1 -- 172.21.15.5:0/4278245425 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7a5c0caec0 con 0x7f7a5c0af2b0 2023-07-14T12:52:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.062+0000 7f7a52ffd640 1 -- 172.21.15.5:0/4278245425 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7a5c0caec0 con 0x7f7a5c0af2b0 2023-07-14T12:52:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-07-14T12:52:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.066+0000 7f7a60fe9640 1 -- 172.21.15.5:0/4278245425 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7a3c066280 msgr2=0x7f7a3c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.066+0000 7f7a60fe9640 1 --2- 172.21.15.5:0/4278245425 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7a3c066280 0x7f7a3c068730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c007fd0 tx=0x7f7a4c009040 comp rx=0 tx=0).stop 2023-07-14T12:52:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.066+0000 7f7a60fe9640 1 -- 172.21.15.5:0/4278245425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a5c0af2b0 msgr2=0x7f7a5c158960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.066+0000 7f7a60fe9640 1 --2- 172.21.15.5:0/4278245425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a5c0af2b0 0x7f7a5c158960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7a540af040 tx=0x7f7a54019770 comp rx=0 tx=0).stop 2023-07-14T12:52:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.066+0000 7f7a60fe9640 1 -- 172.21.15.5:0/4278245425 shutdown_connections 2023-07-14T12:52:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.066+0000 7f7a60fe9640 1 --2- 172.21.15.5:0/4278245425 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7a3c066280 0x7f7a3c068730 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.066+0000 7f7a60fe9640 1 --2- 172.21.15.5:0/4278245425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a5c0af2b0 0x7f7a5c158960 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.066+0000 7f7a60fe9640 1 --2- 172.21.15.5:0/4278245425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a5c070f30 0x7f7a5c158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.066+0000 7f7a60fe9640 1 --2- 172.21.15.5:0/4278245425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a5c069430 0x7f7a5c13e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.066+0000 7f7a60fe9640 1 -- 172.21.15.5:0/4278245425 >> 172.21.15.5:0/4278245425 conn(0x7f7a5c0cde90 msgr2=0x7f7a5c06fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.066+0000 7f7a60fe9640 1 -- 172.21.15.5:0/4278245425 shutdown_connections 2023-07-14T12:52:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.066+0000 7f7a60fe9640 1 -- 172.21.15.5:0/4278245425 wait complete. 2023-07-14T12:52:45.117 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-14T12:52:45.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.246+0000 7fa18c693640 1 Processor -- start 2023-07-14T12:52:45.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.246+0000 7fa18c693640 1 -- start start 2023-07-14T12:52:45.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.250+0000 7fa18c693640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa18406a100 0x7fa18406fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:45.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.250+0000 7fa18c693640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa18406ff80 0x7fa18406cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:45.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.250+0000 7fa18c693640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa18406d8e0 con 0x7fa18406d480 2023-07-14T12:52:45.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.250+0000 7fa18c693640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1840703d0 con 0x7fa18406ff80 2023-07-14T12:52:45.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.250+0000 7fa18c693640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18415f6a0 con 0x7fa18406a100 2023-07-14T12:52:45.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.250+0000 7fa189c2e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa18406ff80 0x7fa18406cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:45.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.250+0000 7fa189c2e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa18406ff80 0x7fa18406cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53394/0 (socket says 172.21.15.5:53394) 2023-07-14T12:52:45.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.250+0000 7fa189c2e640 1 -- 172.21.15.5:0/3937775504 learned_addr learned my addr 172.21.15.5:0/3937775504 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:45.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.250+0000 7fa18a42f640 1 --2- 172.21.15.5:0/3937775504 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa18406a100 0x7fa18406fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:45.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.250+0000 7fa189c2e640 1 -- 172.21.15.5:0/3937775504 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa18406a100 msgr2=0x7fa18406fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:45.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.250+0000 7fa189c2e640 1 --2- 172.21.15.5:0/3937775504 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa18406a100 0x7fa18406fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:45.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.250+0000 7fa189c2e640 1 -- 172.21.15.5:0/3937775504 >> v1:172.21.15.154:6789/0 conn(0x7fa18406d480 legacy=0x7fa18406ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:45.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.250+0000 7fa189c2e640 1 -- 172.21.15.5:0/3937775504 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa184160220 con 0x7fa18406ff80 2023-07-14T12:52:45.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.254+0000 7fa189c2e640 1 --2- 172.21.15.5:0/3937775504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa18406ff80 0x7fa18406cf40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa174009870 tx=0x7fa17401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be68b7bf204eec5c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:45.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.254+0000 7fa18942d640 1 -- 172.21.15.5:0/3937775504 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1740ac630 con 0x7fa18406ff80 2023-07-14T12:52:45.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.254+0000 7fa18942d640 1 -- 172.21.15.5:0/3937775504 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1740ac790 con 0x7fa18406ff80 2023-07-14T12:52:45.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.254+0000 7fa18942d640 1 -- 172.21.15.5:0/3937775504 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1740acb20 con 0x7fa18406ff80 2023-07-14T12:52:45.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.254+0000 7fa18c693640 1 -- 172.21.15.5:0/3937775504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa18406ff80 msgr2=0x7fa18406cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:45.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.254+0000 7fa18c693640 1 --2- 172.21.15.5:0/3937775504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa18406ff80 0x7fa18406cf40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa174009870 tx=0x7fa17401c4b0 comp rx=0 tx=0).stop 2023-07-14T12:52:45.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.254+0000 7fa18c693640 1 -- 172.21.15.5:0/3937775504 shutdown_connections 2023-07-14T12:52:45.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.254+0000 7fa18c693640 1 --2- 172.21.15.5:0/3937775504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa18406ff80 0x7fa18406cf40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:45.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.254+0000 7fa18c693640 1 --2- 172.21.15.5:0/3937775504 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa18406a100 0x7fa18406fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:45.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.254+0000 7fa18c693640 1 -- 172.21.15.5:0/3937775504 >> 172.21.15.5:0/3937775504 conn(0x7fa1840b0490 msgr2=0x7fa1840b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:45.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.254+0000 7fa18c693640 1 -- 172.21.15.5:0/3937775504 shutdown_connections 2023-07-14T12:52:45.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.254+0000 7fa18c693640 1 -- 172.21.15.5:0/3937775504 wait complete. 2023-07-14T12:52:45.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.254+0000 7fa18c693640 1 Processor -- start 2023-07-14T12:52:45.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.254+0000 7fa18c693640 1 -- start start 2023-07-14T12:52:45.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.258+0000 7fa18c693640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa18406a100 0x7fa1840c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:45.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.258+0000 7fa18c693640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa18406d480 0x7fa184161640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:45.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.258+0000 7fa18c693640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa18406ff80 0x7fa1841451d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:45.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.258+0000 7fa18c693640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1840cb0d0 con 0x7fa18406d480 2023-07-14T12:52:45.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.258+0000 7fa18c693640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1840ca210 con 0x7fa18406a100 2023-07-14T12:52:45.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.258+0000 7fa18c693640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa184161b80 con 0x7fa18406ff80 2023-07-14T12:52:45.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.258+0000 7fa189c2e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa18406d480 0x7fa184161640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:45.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.258+0000 7fa189c2e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa18406d480 0x7fa184161640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53408/0 (socket says 172.21.15.5:53408) 2023-07-14T12:52:45.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.258+0000 7fa189c2e640 1 -- 172.21.15.5:0/2453268349 learned_addr learned my addr 172.21.15.5:0/2453268349 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:45.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.258+0000 7fa18a42f640 1 --2- 172.21.15.5:0/2453268349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa18406a100 0x7fa1840c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:45.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.258+0000 7fa18ac30640 1 --2- 172.21.15.5:0/2453268349 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa18406ff80 0x7fa1841451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:45.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.258+0000 7fa189c2e640 1 -- 172.21.15.5:0/2453268349 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa18406ff80 msgr2=0x7fa1841451d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:45.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.258+0000 7fa189c2e640 1 --2- 172.21.15.5:0/2453268349 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa18406ff80 0x7fa1841451d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:45.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.258+0000 7fa189c2e640 1 -- 172.21.15.5:0/2453268349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa18406a100 msgr2=0x7fa1840c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:45.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.258+0000 7fa189c2e640 1 --2- 172.21.15.5:0/2453268349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa18406a100 0x7fa1840c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:45.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.258+0000 7fa189c2e640 1 -- 172.21.15.5:0/2453268349 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1740094d0 con 0x7fa18406d480 2023-07-14T12:52:45.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.258+0000 7fa18ac30640 1 --2- 172.21.15.5:0/2453268349 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa18406ff80 0x7fa1841451d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:52:45.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.258+0000 7fa189c2e640 1 --2- 172.21.15.5:0/2453268349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa18406d480 0x7fa184161640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa17401ab60 tx=0x7fa174019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:45.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.258+0000 7fa17affd640 1 -- 172.21.15.5:0/2453268349 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1740b5440 con 0x7fa18406d480 2023-07-14T12:52:45.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.258+0000 7fa17affd640 1 -- 172.21.15.5:0/2453268349 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1740b55a0 con 0x7fa18406d480 2023-07-14T12:52:45.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.258+0000 7fa18c693640 1 -- 172.21.15.5:0/2453268349 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1840ca450 con 0x7fa18406d480 2023-07-14T12:52:45.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.258+0000 7fa17affd640 1 -- 172.21.15.5:0/2453268349 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1740b5950 con 0x7fa18406d480 2023-07-14T12:52:45.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.258+0000 7fa18c693640 1 -- 172.21.15.5:0/2453268349 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1840caa10 con 0x7fa18406d480 2023-07-14T12:52:45.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.258+0000 7fa18c693640 1 -- 172.21.15.5:0/2453268349 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1840678d0 con 0x7fa18406d480 2023-07-14T12:52:45.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.262+0000 7fa17affd640 1 -- 172.21.15.5:0/2453268349 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa1740b3070 con 0x7fa18406d480 2023-07-14T12:52:45.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.262+0000 7fa17affd640 1 --2- 172.21.15.5:0/2453268349 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa1680662b0 0x7fa168068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:45.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.262+0000 7fa17affd640 1 -- 172.21.15.5:0/2453268349 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fa17411dc50 con 0x7fa18406d480 2023-07-14T12:52:45.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.262+0000 7fa18a42f640 1 --2- 172.21.15.5:0/2453268349 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa1680662b0 0x7fa168068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:45.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.262+0000 7fa18a42f640 1 --2- 172.21.15.5:0/2453268349 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa1680662b0 0x7fa168068760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa1800079c0 tx=0x7fa180008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:45.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.266+0000 7fa17affd640 1 -- 172.21.15.5:0/2453268349 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa1740eb3b0 con 0x7fa18406d480 2023-07-14T12:52:45.409 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:52:45.414 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:52:45.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:45.422+0000 7fa18c693640 1 -- 172.21.15.5:0/2453268349 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa1840cdfc0 con 0x7fa18406d480 2023-07-14T12:52:46.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.062+0000 7fa17affd640 1 -- 172.21.15.5:0/2453268349 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa1740ee9d0 con 0x7fa18406d480 2023-07-14T12:52:46.090 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-07-14T12:52:46.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.070+0000 7fa18c693640 1 -- 172.21.15.5:0/2453268349 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa1680662b0 msgr2=0x7fa168068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:46.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.070+0000 7fa18c693640 1 --2- 172.21.15.5:0/2453268349 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa1680662b0 0x7fa168068760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa1800079c0 tx=0x7fa180008040 comp rx=0 tx=0).stop 2023-07-14T12:52:46.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.070+0000 7fa18c693640 1 -- 172.21.15.5:0/2453268349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa18406d480 msgr2=0x7fa184161640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:46.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.070+0000 7fa18c693640 1 --2- 172.21.15.5:0/2453268349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa18406d480 0x7fa184161640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa17401ab60 tx=0x7fa174019250 comp rx=0 tx=0).stop 2023-07-14T12:52:46.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.070+0000 7fa18c693640 1 -- 172.21.15.5:0/2453268349 shutdown_connections 2023-07-14T12:52:46.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.070+0000 7fa18c693640 1 --2- 172.21.15.5:0/2453268349 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa18406ff80 0x7fa1841451d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:46.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.070+0000 7fa18c693640 1 --2- 172.21.15.5:0/2453268349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa18406d480 0x7fa184161640 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa17401ab60 tx=0x7fa174019250 comp rx=0 tx=0).stop 2023-07-14T12:52:46.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.070+0000 7fa18c693640 1 --2- 172.21.15.5:0/2453268349 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa1680662b0 0x7fa168068760 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:46.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.070+0000 7fa18c693640 1 --2- 172.21.15.5:0/2453268349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa18406a100 0x7fa1840c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:46.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.070+0000 7fa18c693640 1 -- 172.21.15.5:0/2453268349 >> 172.21.15.5:0/2453268349 conn(0x7fa1840b0490 msgr2=0x7fa1840b0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:46.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.074+0000 7fa18c693640 1 -- 172.21.15.5:0/2453268349 shutdown_connections 2023-07-14T12:52:46.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.078+0000 7fa18c693640 1 -- 172.21.15.5:0/2453268349 wait complete. 2023-07-14T12:52:46.140 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-14T12:52:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.262+0000 7fe741363640 1 Processor -- start 2023-07-14T12:52:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.262+0000 7fe741363640 1 -- start start 2023-07-14T12:52:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.266+0000 7fe741363640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe73c0af8b0 0x7fe73c0afc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.266+0000 7fe741363640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe73c0703a0 con 0x7fe73c15c2a0 2023-07-14T12:52:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.266+0000 7fe741363640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe73c0b01c0 con 0x7fe73c0c8db0 2023-07-14T12:52:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.266+0000 7fe741363640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe73c15ce20 con 0x7fe73c0af8b0 2023-07-14T12:52:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.266+0000 7fe73bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe73c0af8b0 0x7fe73c0afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.266+0000 7fe73b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe73c15c2a0 0x7fe73c15c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39056/0 (socket says 172.21.15.5:39056) 2023-07-14T12:52:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.266+0000 7fe73b7fe640 1 -- 172.21.15.5:0/1987662264 learned_addr learned my addr 172.21.15.5:0/1987662264 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.266+0000 7fe73bfff640 1 -- 172.21.15.5:0/1987662264 >> v1:172.21.15.154:6789/0 conn(0x7fe73c0c8db0 legacy=0x7fe73c0c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.266+0000 7fe73bfff640 1 -- 172.21.15.5:0/1987662264 >> v1:172.21.15.5:6789/0 conn(0x7fe73c15c2a0 legacy=0x7fe73c15c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:46.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.266+0000 7fe73bfff640 1 -- 172.21.15.5:0/1987662264 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73c15d010 con 0x7fe73c0af8b0 2023-07-14T12:52:46.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.266+0000 7fe73affd640 1 -- 172.21.15.5:0/1987662264 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200675608 0 0) 0x7fe730001120 con 0x7fe73c15c2a0 2023-07-14T12:52:46.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.270+0000 7fe73bfff640 1 --2- 172.21.15.5:0/1987662264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe73c0af8b0 0x7fe73c0afc80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe72c0097c0 tx=0x7fe72c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7eed2a840d79602 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:46.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.270+0000 7fe73affd640 1 -- 172.21.15.5:0/1987662264 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c0ab650 con 0x7fe73c0af8b0 2023-07-14T12:52:46.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.270+0000 7fe73affd640 1 -- 172.21.15.5:0/1987662264 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72c0ab7b0 con 0x7fe73c0af8b0 2023-07-14T12:52:46.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.270+0000 7fe73affd640 1 -- 172.21.15.5:0/1987662264 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c0abb40 con 0x7fe73c0af8b0 2023-07-14T12:52:46.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.270+0000 7fe741363640 1 -- 172.21.15.5:0/1987662264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe73c0af8b0 msgr2=0x7fe73c0afc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:46.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.270+0000 7fe741363640 1 --2- 172.21.15.5:0/1987662264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe73c0af8b0 0x7fe73c0afc80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe72c0097c0 tx=0x7fe72c01c450 comp rx=0 tx=0).stop 2023-07-14T12:52:46.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.270+0000 7fe741363640 1 -- 172.21.15.5:0/1987662264 shutdown_connections 2023-07-14T12:52:46.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.270+0000 7fe741363640 1 --2- 172.21.15.5:0/1987662264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe73c0af8b0 0x7fe73c0afc80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:46.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.270+0000 7fe741363640 1 -- 172.21.15.5:0/1987662264 >> 172.21.15.5:0/1987662264 conn(0x7fe73c0ca8b0 msgr2=0x7fe73c0cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:46.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.270+0000 7fe741363640 1 -- 172.21.15.5:0/1987662264 shutdown_connections 2023-07-14T12:52:46.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.270+0000 7fe741363640 1 -- 172.21.15.5:0/1987662264 wait complete. 2023-07-14T12:52:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.270+0000 7fe741363640 1 Processor -- start 2023-07-14T12:52:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.270+0000 7fe741363640 1 -- start start 2023-07-14T12:52:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.274+0000 7fe741363640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe73c0af8b0 0x7fe73c14c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.274+0000 7fe741363640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe73c0c8db0 0x7fe73c0c5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.274+0000 7fe741363640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe73c15c2a0 0x7fe73c14e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.274+0000 7fe741363640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c0c8140 con 0x7fe73c15c2a0 2023-07-14T12:52:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.274+0000 7fe741363640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c14e560 con 0x7fe73c0af8b0 2023-07-14T12:52:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.274+0000 7fe741363640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c0c7530 con 0x7fe73c0c8db0 2023-07-14T12:52:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.274+0000 7fe740b62640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe73c15c2a0 0x7fe73c14e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.274+0000 7fe73bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe73c0af8b0 0x7fe73c14c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.274+0000 7fe740b62640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe73c15c2a0 0x7fe73c14e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53432/0 (socket says 172.21.15.5:53432) 2023-07-14T12:52:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.274+0000 7fe73b7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe73c0c8db0 0x7fe73c0c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.274+0000 7fe740b62640 1 -- 172.21.15.5:0/3090783379 learned_addr learned my addr 172.21.15.5:0/3090783379 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:46.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.274+0000 7fe740b62640 1 -- 172.21.15.5:0/3090783379 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe73c0c8db0 msgr2=0x7fe73c0c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:46.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.274+0000 7fe740b62640 1 --2- 172.21.15.5:0/3090783379 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe73c0c8db0 0x7fe73c0c5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:46.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.274+0000 7fe740b62640 1 -- 172.21.15.5:0/3090783379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe73c0af8b0 msgr2=0x7fe73c14c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:46.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.274+0000 7fe740b62640 1 --2- 172.21.15.5:0/3090783379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe73c0af8b0 0x7fe73c14c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:46.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.274+0000 7fe740b62640 1 -- 172.21.15.5:0/3090783379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72c009420 con 0x7fe73c15c2a0 2023-07-14T12:52:46.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.274+0000 7fe740b62640 1 --2- 172.21.15.5:0/3090783379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe73c15c2a0 0x7fe73c14e020 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe73400c730 tx=0x7fe73400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:46.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.274+0000 7fe738ff9640 1 -- 172.21.15.5:0/3090783379 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe734003b80 con 0x7fe73c15c2a0 2023-07-14T12:52:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.274+0000 7fe738ff9640 1 -- 172.21.15.5:0/3090783379 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe734003ce0 con 0x7fe73c15c2a0 2023-07-14T12:52:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.274+0000 7fe741363640 1 -- 172.21.15.5:0/3090783379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe73c0c7810 con 0x7fe73c15c2a0 2023-07-14T12:52:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.274+0000 7fe738ff9640 1 -- 172.21.15.5:0/3090783379 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73400aa30 con 0x7fe73c15c2a0 2023-07-14T12:52:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.274+0000 7fe741363640 1 -- 172.21.15.5:0/3090783379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe73c0c7dd0 con 0x7fe73c15c2a0 2023-07-14T12:52:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.274+0000 7fe741363640 1 -- 172.21.15.5:0/3090783379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe73c04e020 con 0x7fe73c15c2a0 2023-07-14T12:52:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.274+0000 7fe738ff9640 1 -- 172.21.15.5:0/3090783379 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe73400ab90 con 0x7fe73c15c2a0 2023-07-14T12:52:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.278+0000 7fe738ff9640 1 --2- 172.21.15.5:0/3090783379 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe728066280 0x7fe728068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.278+0000 7fe738ff9640 1 -- 172.21.15.5:0/3090783379 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fe7340839d0 con 0x7fe73c15c2a0 2023-07-14T12:52:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.278+0000 7fe73bfff640 1 --2- 172.21.15.5:0/3090783379 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe728066280 0x7fe728068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:46.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.278+0000 7fe73bfff640 1 --2- 172.21.15.5:0/3090783379 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe728066280 0x7fe728068730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe72c0af000 tx=0x7fe72c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:46.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.282+0000 7fe738ff9640 1 -- 172.21.15.5:0/3090783379 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe734050ec0 con 0x7fe73c15c2a0 2023-07-14T12:52:46.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:46.470+0000 7fe741363640 1 -- 172.21.15.5:0/3090783379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe73c0c8280 con 0x7fe73c15c2a0 2023-07-14T12:52:47.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.418+0000 7fe738ff9640 1 -- 172.21.15.5:0/3090783379 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe73c0c8280 con 0x7fe73c15c2a0 2023-07-14T12:52:47.444 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 3 and data pool 4 2023-07-14T12:52:47.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.422+0000 7fe741363640 1 -- 172.21.15.5:0/3090783379 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe728066280 msgr2=0x7fe728068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:47.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.422+0000 7fe741363640 1 --2- 172.21.15.5:0/3090783379 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe728066280 0x7fe728068730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe72c0af000 tx=0x7fe72c0a7000 comp rx=0 tx=0).stop 2023-07-14T12:52:47.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.422+0000 7fe741363640 1 -- 172.21.15.5:0/3090783379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe73c15c2a0 msgr2=0x7fe73c14e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:47.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.422+0000 7fe741363640 1 --2- 172.21.15.5:0/3090783379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe73c15c2a0 0x7fe73c14e020 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe73400c730 tx=0x7fe73400cbf0 comp rx=0 tx=0).stop 2023-07-14T12:52:47.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.422+0000 7fe741363640 1 -- 172.21.15.5:0/3090783379 shutdown_connections 2023-07-14T12:52:47.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.422+0000 7fe741363640 1 --2- 172.21.15.5:0/3090783379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe73c15c2a0 0x7fe73c14e020 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:47.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.422+0000 7fe741363640 1 --2- 172.21.15.5:0/3090783379 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe73c0c8db0 0x7fe73c0c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:47.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.422+0000 7fe741363640 1 --2- 172.21.15.5:0/3090783379 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe728066280 0x7fe728068730 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:47.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.422+0000 7fe741363640 1 --2- 172.21.15.5:0/3090783379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe73c0af8b0 0x7fe73c14c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:47.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.422+0000 7fe741363640 1 -- 172.21.15.5:0/3090783379 >> 172.21.15.5:0/3090783379 conn(0x7fe73c0ca8b0 msgr2=0x7fe73c06ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:47.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.422+0000 7fe741363640 1 -- 172.21.15.5:0/3090783379 shutdown_connections 2023-07-14T12:52:47.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.422+0000 7fe741363640 1 -- 172.21.15.5:0/3090783379 wait complete. 2023-07-14T12:52:47.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:52:47.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.598+0000 7fafa3c93640 1 Processor -- start 2023-07-14T12:52:47.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.598+0000 7fafa3c93640 1 -- start start 2023-07-14T12:52:47.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.598+0000 7fafa3c93640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faf9c145430 0x7faf9c0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:47.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.598+0000 7fafa3c93640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faf9c0b39f0 0x7faf9c0d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:47.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.598+0000 7fafa3c93640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf9c0b2140 con 0x7faf9c0d06b0 2023-07-14T12:52:47.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.598+0000 7fafa3c93640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf9c0b2410 con 0x7faf9c145430 2023-07-14T12:52:47.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.598+0000 7fafa3c93640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf9c0b26f0 con 0x7faf9c0b39f0 2023-07-14T12:52:47.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.598+0000 7fafa122e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faf9c145430 0x7faf9c0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:47.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.598+0000 7fafa122e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faf9c145430 0x7faf9c0b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53442/0 (socket says 172.21.15.5:53442) 2023-07-14T12:52:47.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.602+0000 7fafa122e640 1 -- 172.21.15.5:0/2588364474 learned_addr learned my addr 172.21.15.5:0/2588364474 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:47.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.602+0000 7fafa2230640 1 --2- 172.21.15.5:0/2588364474 >> v2:172.21.15.154:3300/0 conn(0x7faf9c0b39f0 0x7faf9c0d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:47.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.602+0000 7fafa122e640 1 -- 172.21.15.5:0/2588364474 >> v2:172.21.15.154:3300/0 conn(0x7faf9c0b39f0 msgr2=0x7faf9c0d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:47.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.602+0000 7fafa122e640 1 --2- 172.21.15.5:0/2588364474 >> v2:172.21.15.154:3300/0 conn(0x7faf9c0b39f0 0x7faf9c0d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:47.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.602+0000 7fafa122e640 1 -- 172.21.15.5:0/2588364474 >> v1:172.21.15.154:6789/0 conn(0x7faf9c0d06b0 legacy=0x7faf9c0b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:47.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.602+0000 7fafa122e640 1 -- 172.21.15.5:0/2588364474 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c0b29d0 con 0x7faf9c145430 2023-07-14T12:52:47.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.602+0000 7fafa122e640 1 --2- 172.21.15.5:0/2588364474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf9c145430 0x7faf9c0b34b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faf9c08cb00 tx=0x7faf8c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f70b3e742a4dfea server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:47.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.602+0000 7fafa0a2d640 1 -- 172.21.15.5:0/2588364474 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c0ac640 con 0x7faf9c145430 2023-07-14T12:52:47.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.602+0000 7fafa0a2d640 1 -- 172.21.15.5:0/2588364474 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c0ac7a0 con 0x7faf9c145430 2023-07-14T12:52:47.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.602+0000 7fafa0a2d640 1 -- 172.21.15.5:0/2588364474 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c0acb30 con 0x7faf9c145430 2023-07-14T12:52:47.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa3c93640 1 -- 172.21.15.5:0/2588364474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf9c145430 msgr2=0x7faf9c0b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:47.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa3c93640 1 --2- 172.21.15.5:0/2588364474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf9c145430 0x7faf9c0b34b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faf9c08cb00 tx=0x7faf8c01c4d0 comp rx=0 tx=0).stop 2023-07-14T12:52:47.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa3c93640 1 -- 172.21.15.5:0/2588364474 shutdown_connections 2023-07-14T12:52:47.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa3c93640 1 --2- 172.21.15.5:0/2588364474 >> v2:172.21.15.154:3300/0 conn(0x7faf9c0b39f0 0x7faf9c0d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:47.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa3c93640 1 --2- 172.21.15.5:0/2588364474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf9c145430 0x7faf9c0b34b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:47.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa3c93640 1 -- 172.21.15.5:0/2588364474 >> 172.21.15.5:0/2588364474 conn(0x7faf9c0659d0 msgr2=0x7faf9c09b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:47.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa3c93640 1 -- 172.21.15.5:0/2588364474 shutdown_connections 2023-07-14T12:52:47.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa3c93640 1 -- 172.21.15.5:0/2588364474 wait complete. 2023-07-14T12:52:47.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa3c93640 1 Processor -- start 2023-07-14T12:52:47.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa3c93640 1 -- start start 2023-07-14T12:52:47.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa3c93640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf9c0b39f0 0x7faf9c157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:47.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa3c93640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf9c0d06b0 0x7faf9c156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:47.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa3c93640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf9c0c8a90 0x7faf9c156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:47.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa3c93640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c0b73f0 con 0x7faf9c0c8a90 2023-07-14T12:52:47.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa3c93640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c0b76d0 con 0x7faf9c0d06b0 2023-07-14T12:52:47.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa3c93640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c0b79b0 con 0x7faf9c0b39f0 2023-07-14T12:52:47.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa2230640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf9c0c8a90 0x7faf9c156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:47.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa2230640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf9c0c8a90 0x7faf9c156a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53446/0 (socket says 172.21.15.5:53446) 2023-07-14T12:52:47.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa2230640 1 -- 172.21.15.5:0/98162445 learned_addr learned my addr 172.21.15.5:0/98162445 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:47.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa1a2f640 1 --2- 172.21.15.5:0/98162445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf9c0b39f0 0x7faf9c157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:47.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa122e640 1 --2- 172.21.15.5:0/98162445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf9c0d06b0 0x7faf9c156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:47.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa2230640 1 -- 172.21.15.5:0/98162445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf9c0b39f0 msgr2=0x7faf9c157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:47.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa2230640 1 --2- 172.21.15.5:0/98162445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf9c0b39f0 0x7faf9c157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:47.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa2230640 1 -- 172.21.15.5:0/98162445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf9c0d06b0 msgr2=0x7faf9c156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:47.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa2230640 1 --2- 172.21.15.5:0/98162445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf9c0d06b0 0x7faf9c156260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:47.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa2230640 1 -- 172.21.15.5:0/98162445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8c0094d0 con 0x7faf9c0c8a90 2023-07-14T12:52:47.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa1a2f640 1 --2- 172.21.15.5:0/98162445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf9c0b39f0 0x7faf9c157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:52:47.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.606+0000 7fafa2230640 1 --2- 172.21.15.5:0/98162445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf9c0c8a90 0x7faf9c156a90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faf9400efc0 tx=0x7faf9400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:47.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.610+0000 7faf927fc640 1 -- 172.21.15.5:0/98162445 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf94009b20 con 0x7faf9c0c8a90 2023-07-14T12:52:47.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.610+0000 7faf927fc640 1 -- 172.21.15.5:0/98162445 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9400f040 con 0x7faf9c0c8a90 2023-07-14T12:52:47.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.610+0000 7faf927fc640 1 -- 172.21.15.5:0/98162445 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf940146c0 con 0x7faf9c0c8a90 2023-07-14T12:52:47.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.610+0000 7fafa3c93640 1 -- 172.21.15.5:0/98162445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf9c0b7c90 con 0x7faf9c0c8a90 2023-07-14T12:52:47.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.610+0000 7fafa3c93640 1 -- 172.21.15.5:0/98162445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf9c15f2f0 con 0x7faf9c0c8a90 2023-07-14T12:52:47.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.610+0000 7fafa3c93640 1 -- 172.21.15.5:0/98162445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf9c072e70 con 0x7faf9c0c8a90 2023-07-14T12:52:47.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.610+0000 7faf927fc640 1 -- 172.21.15.5:0/98162445 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faf94014820 con 0x7faf9c0c8a90 2023-07-14T12:52:47.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.610+0000 7faf927fc640 1 --2- 172.21.15.5:0/98162445 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7faf800662b0 0x7faf80068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:47.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.610+0000 7faf927fc640 1 -- 172.21.15.5:0/98162445 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faf94084ae0 con 0x7faf9c0c8a90 2023-07-14T12:52:47.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.610+0000 7fafa1a2f640 1 --2- 172.21.15.5:0/98162445 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7faf800662b0 0x7faf80068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:47.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.614+0000 7fafa1a2f640 1 --2- 172.21.15.5:0/98162445 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7faf800662b0 0x7faf80068760 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faf9c15ba10 tx=0x7faf98009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:47.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.614+0000 7faf927fc640 1 -- 172.21.15.5:0/98162445 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7faf94051ec0 con 0x7faf9c0c8a90 2023-07-14T12:52:47.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.770+0000 7fafa3c93640 1 -- 172.21.15.5:0/98162445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf9c0b7530 con 0x7faf9c0c8a90 2023-07-14T12:52:47.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.770+0000 7faf927fc640 1 -- 172.21.15.5:0/98162445 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18244 (secure 0 0 0) 0x7faf9c0b7530 con 0x7faf9c0c8a90 2023-07-14T12:52:47.798 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:52:47.798 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:52:46.472852+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:52:44.223082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T12:52:45.469396+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:52:47.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.774+0000 7fafa3c93640 1 -- 172.21.15.5:0/98162445 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7faf800662b0 msgr2=0x7faf80068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:47.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.774+0000 7fafa3c93640 1 --2- 172.21.15.5:0/98162445 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7faf800662b0 0x7faf80068760 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faf9c15ba10 tx=0x7faf98009040 comp rx=0 tx=0).stop 2023-07-14T12:52:47.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.774+0000 7fafa3c93640 1 -- 172.21.15.5:0/98162445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf9c0c8a90 msgr2=0x7faf9c156a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:47.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.774+0000 7fafa3c93640 1 --2- 172.21.15.5:0/98162445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf9c0c8a90 0x7faf9c156a90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faf9400efc0 tx=0x7faf9400c490 comp rx=0 tx=0).stop 2023-07-14T12:52:47.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.774+0000 7fafa3c93640 1 -- 172.21.15.5:0/98162445 shutdown_connections 2023-07-14T12:52:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.774+0000 7fafa3c93640 1 --2- 172.21.15.5:0/98162445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf9c0c8a90 0x7faf9c156a90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.774+0000 7fafa3c93640 1 --2- 172.21.15.5:0/98162445 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7faf800662b0 0x7faf80068760 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.774+0000 7fafa3c93640 1 --2- 172.21.15.5:0/98162445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf9c0d06b0 0x7faf9c156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:47.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.774+0000 7fafa3c93640 1 --2- 172.21.15.5:0/98162445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf9c0b39f0 0x7faf9c157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:47.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.774+0000 7fafa3c93640 1 -- 172.21.15.5:0/98162445 >> 172.21.15.5:0/98162445 conn(0x7faf9c0659d0 msgr2=0x7faf9c06b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:47.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.774+0000 7fafa3c93640 1 -- 172.21.15.5:0/98162445 shutdown_connections 2023-07-14T12:52:47.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.774+0000 7fafa3c93640 1 -- 172.21.15.5:0/98162445 wait complete. 2023-07-14T12:52:47.818 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:52:47.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.934+0000 7f3d7f06a640 1 Processor -- start 2023-07-14T12:52:47.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.934+0000 7f3d7f06a640 1 -- start start 2023-07-14T12:52:47.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.938+0000 7f3d7f06a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3d78158ce0 0x7f3d78070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:47.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.938+0000 7f3d7f06a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d780c8ad0 0x7f3d780c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:47.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.938+0000 7f3d7f06a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d780cc700 con 0x7f3d780c9560 2023-07-14T12:52:47.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.938+0000 7f3d7f06a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d780c99e0 con 0x7f3d78158ce0 2023-07-14T12:52:47.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.938+0000 7f3d7f06a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d780b0ff0 con 0x7f3d780c8ad0 2023-07-14T12:52:47.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.938+0000 7f3d77fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d780c8ad0 0x7f3d780c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:47.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.938+0000 7f3d77fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d780c8ad0 0x7f3d780c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:47306/0 (socket says 172.21.15.5:47306) 2023-07-14T12:52:47.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.938+0000 7f3d77fff640 1 -- 172.21.15.5:0/2367439741 learned_addr learned my addr 172.21.15.5:0/2367439741 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:47.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.938+0000 7f3d7ce06640 1 --2- 172.21.15.5:0/2367439741 >> v2:172.21.15.154:3300/0 conn(0x7f3d78158ce0 0x7f3d78070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:47.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.938+0000 7f3d77fff640 1 -- 172.21.15.5:0/2367439741 >> v2:172.21.15.154:3300/0 conn(0x7f3d78158ce0 msgr2=0x7f3d78070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:47.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.938+0000 7f3d77fff640 1 --2- 172.21.15.5:0/2367439741 >> v2:172.21.15.154:3300/0 conn(0x7f3d78158ce0 0x7f3d78070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:47.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.938+0000 7f3d77fff640 1 -- 172.21.15.5:0/2367439741 >> v1:172.21.15.154:6789/0 conn(0x7f3d780c9560 legacy=0x7f3d780cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:47.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.938+0000 7f3d77fff640 1 -- 172.21.15.5:0/2367439741 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d78070c80 con 0x7f3d780c8ad0 2023-07-14T12:52:47.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.942+0000 7f3d77fff640 1 --2- 172.21.15.5:0/2367439741 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d780c8ad0 0x7f3d780c9020 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3d64009870 tx=0x7f3d6401e600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eab972a53f495599 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:47.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.942+0000 7f3d777fe640 1 -- 172.21.15.5:0/2367439741 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d780cba20 con 0x7f3d780c8ad0 2023-07-14T12:52:47.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.942+0000 7f3d777fe640 1 -- 172.21.15.5:0/2367439741 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d640aa630 con 0x7f3d780c8ad0 2023-07-14T12:52:47.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.942+0000 7f3d777fe640 1 -- 172.21.15.5:0/2367439741 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d640aa9c0 con 0x7f3d780c8ad0 2023-07-14T12:52:47.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.942+0000 7f3d7f06a640 1 -- 172.21.15.5:0/2367439741 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d780c8ad0 msgr2=0x7f3d780c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:47.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.942+0000 7f3d7f06a640 1 --2- 172.21.15.5:0/2367439741 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d780c8ad0 0x7f3d780c9020 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3d64009870 tx=0x7f3d6401e600 comp rx=0 tx=0).stop 2023-07-14T12:52:47.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.942+0000 7f3d7f06a640 1 -- 172.21.15.5:0/2367439741 shutdown_connections 2023-07-14T12:52:47.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.942+0000 7f3d7f06a640 1 --2- 172.21.15.5:0/2367439741 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d780c8ad0 0x7f3d780c9020 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:47.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.942+0000 7f3d7f06a640 1 --2- 172.21.15.5:0/2367439741 >> v2:172.21.15.154:3300/0 conn(0x7f3d78158ce0 0x7f3d78070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:47.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.942+0000 7f3d7f06a640 1 -- 172.21.15.5:0/2367439741 >> 172.21.15.5:0/2367439741 conn(0x7f3d780afcf0 msgr2=0x7f3d780b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:47.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.942+0000 7f3d7f06a640 1 -- 172.21.15.5:0/2367439741 shutdown_connections 2023-07-14T12:52:47.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.942+0000 7f3d7f06a640 1 -- 172.21.15.5:0/2367439741 wait complete. 2023-07-14T12:52:47.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.942+0000 7f3d7f06a640 1 Processor -- start 2023-07-14T12:52:47.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.942+0000 7f3d7f06a640 1 -- start start 2023-07-14T12:52:47.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.946+0000 7f3d7f06a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d780c8ad0 0x7f3d780c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:47.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.946+0000 7f3d7f06a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d780c9560 0x7f3d7814d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:47.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.946+0000 7f3d7f06a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d78158ce0 0x7f3d781479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:47.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.946+0000 7f3d7f06a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7814d610 con 0x7f3d78158ce0 2023-07-14T12:52:47.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.946+0000 7f3d7f06a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d780c2370 con 0x7f3d780c9560 2023-07-14T12:52:47.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.946+0000 7f3d7f06a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d780c2650 con 0x7f3d780c8ad0 2023-07-14T12:52:47.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.946+0000 7f3d7d607640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d78158ce0 0x7f3d781479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:47.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.946+0000 7f3d7ce06640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d780c8ad0 0x7f3d780c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:47.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.946+0000 7f3d7d607640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d78158ce0 0x7f3d781479a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53448/0 (socket says 172.21.15.5:53448) 2023-07-14T12:52:47.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.946+0000 7f3d7d607640 1 -- 172.21.15.5:0/2021965773 learned_addr learned my addr 172.21.15.5:0/2021965773 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:47.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.946+0000 7f3d7ce06640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d780c8ad0 0x7f3d780c1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:47308/0 (socket says 172.21.15.5:47308) 2023-07-14T12:52:47.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.946+0000 7f3d77fff640 1 --2- 172.21.15.5:0/2021965773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d780c9560 0x7f3d7814d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:47.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.946+0000 7f3d7d607640 1 -- 172.21.15.5:0/2021965773 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d780c8ad0 msgr2=0x7f3d780c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:47.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.946+0000 7f3d7d607640 1 --2- 172.21.15.5:0/2021965773 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d780c8ad0 0x7f3d780c1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:47.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.946+0000 7f3d7d607640 1 -- 172.21.15.5:0/2021965773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d780c9560 msgr2=0x7f3d7814d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:47.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.946+0000 7f3d7d607640 1 --2- 172.21.15.5:0/2021965773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d780c9560 0x7f3d7814d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:47.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.946+0000 7f3d7d607640 1 -- 172.21.15.5:0/2021965773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d640094d0 con 0x7f3d78158ce0 2023-07-14T12:52:47.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.946+0000 7f3d7d607640 1 --2- 172.21.15.5:0/2021965773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d78158ce0 0x7f3d781479a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000c770 tx=0x7f3d7000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:47.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.946+0000 7f3d757fa640 1 -- 172.21.15.5:0/2021965773 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d70003b80 con 0x7f3d78158ce0 2023-07-14T12:52:47.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.946+0000 7f3d757fa640 1 -- 172.21.15.5:0/2021965773 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d70003ce0 con 0x7f3d78158ce0 2023-07-14T12:52:47.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.946+0000 7f3d757fa640 1 -- 172.21.15.5:0/2021965773 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7000aa90 con 0x7f3d78158ce0 2023-07-14T12:52:47.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.946+0000 7f3d7f06a640 1 -- 172.21.15.5:0/2021965773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d780c2930 con 0x7f3d78158ce0 2023-07-14T12:52:47.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.946+0000 7f3d7f06a640 1 -- 172.21.15.5:0/2021965773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d780abc20 con 0x7f3d78158ce0 2023-07-14T12:52:47.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.946+0000 7f3d7f06a640 1 -- 172.21.15.5:0/2021965773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d780ca1a0 con 0x7f3d78158ce0 2023-07-14T12:52:47.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.950+0000 7f3d757fa640 1 -- 172.21.15.5:0/2021965773 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3d7000abf0 con 0x7f3d78158ce0 2023-07-14T12:52:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.950+0000 7f3d757fa640 1 --2- 172.21.15.5:0/2021965773 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3d5c066280 0x7f3d5c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.950+0000 7f3d757fa640 1 -- 172.21.15.5:0/2021965773 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3d70083b60 con 0x7f3d78158ce0 2023-07-14T12:52:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.950+0000 7f3d7ce06640 1 --2- 172.21.15.5:0/2021965773 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3d5c066280 0x7f3d5c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:47.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.950+0000 7f3d7ce06640 1 --2- 172.21.15.5:0/2021965773 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3d5c066280 0x7f3d5c068730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009b60 tx=0x7f3d6c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:47.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:47.954+0000 7f3d757fa640 1 -- 172.21.15.5:0/2021965773 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3d70050f70 con 0x7f3d78158ce0 2023-07-14T12:52:48.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.110+0000 7f3d7f06a640 1 -- 172.21.15.5:0/2021965773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d780abe10 con 0x7f3d78158ce0 2023-07-14T12:52:48.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.110+0000 7f3d757fa640 1 -- 172.21.15.5:0/2021965773 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18231 (secure 0 0 0) 0x7f3d70054590 con 0x7f3d78158ce0 2023-07-14T12:52:48.138 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:52:48.138 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":23,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:52:48.091483+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:52:44.223082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T12:52:45.469396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:52:48.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.114+0000 7f3d7f06a640 1 -- 172.21.15.5:0/2021965773 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3d5c066280 msgr2=0x7f3d5c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:48.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.114+0000 7f3d7f06a640 1 --2- 172.21.15.5:0/2021965773 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3d5c066280 0x7f3d5c068730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009b60 tx=0x7f3d6c009190 comp rx=0 tx=0).stop 2023-07-14T12:52:48.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.114+0000 7f3d7f06a640 1 -- 172.21.15.5:0/2021965773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d78158ce0 msgr2=0x7f3d781479a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:48.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.114+0000 7f3d7f06a640 1 --2- 172.21.15.5:0/2021965773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d78158ce0 0x7f3d781479a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000c770 tx=0x7f3d7000cc30 comp rx=0 tx=0).stop 2023-07-14T12:52:48.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.114+0000 7f3d7f06a640 1 -- 172.21.15.5:0/2021965773 shutdown_connections 2023-07-14T12:52:48.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.114+0000 7f3d7f06a640 1 --2- 172.21.15.5:0/2021965773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d78158ce0 0x7f3d781479a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:48.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.114+0000 7f3d7f06a640 1 --2- 172.21.15.5:0/2021965773 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3d5c066280 0x7f3d5c068730 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:48.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.114+0000 7f3d7f06a640 1 --2- 172.21.15.5:0/2021965773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d780c9560 0x7f3d7814d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:48.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.114+0000 7f3d7f06a640 1 --2- 172.21.15.5:0/2021965773 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d780c8ad0 0x7f3d780c1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:48.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.114+0000 7f3d7f06a640 1 -- 172.21.15.5:0/2021965773 >> 172.21.15.5:0/2021965773 conn(0x7f3d780afcf0 msgr2=0x7f3d78070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:48.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.114+0000 7f3d7f06a640 1 -- 172.21.15.5:0/2021965773 shutdown_connections 2023-07-14T12:52:48.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.114+0000 7f3d7f06a640 1 -- 172.21.15.5:0/2021965773 wait complete. 2023-07-14T12:52:48.160 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-14T12:52:48.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.282+0000 7fe801b00640 1 Processor -- start 2023-07-14T12:52:48.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.282+0000 7fe801b00640 1 -- start start 2023-07-14T12:52:48.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.282+0000 7fe801b00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe7fc15bde0 0x7fe7fc0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:48.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.282+0000 7fe801b00640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7fc0d2300 0x7fe7fc0d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:48.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.282+0000 7fe801b00640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7fc0b04c0 con 0x7fe7fc0d2fc0 2023-07-14T12:52:48.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.282+0000 7fe801b00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7fc15c1b0 con 0x7fe7fc15bde0 2023-07-14T12:52:48.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.282+0000 7fe801b00640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc0d2cc0 con 0x7fe7fc0d2300 2023-07-14T12:52:48.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.282+0000 7fe7fb7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe7fc15bde0 0x7fe7fc0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:48.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.282+0000 7fe7fb7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe7fc15bde0 0x7fe7fc0d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53456/0 (socket says 172.21.15.5:53456) 2023-07-14T12:52:48.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.282+0000 7fe7fb7fe640 1 -- 172.21.15.5:0/2054312449 learned_addr learned my addr 172.21.15.5:0/2054312449 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:48.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.282+0000 7fe7fbfff640 1 --2- 172.21.15.5:0/2054312449 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7fc0d2300 0x7fe7fc0d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:48.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.282+0000 7fe7fb7fe640 1 -- 172.21.15.5:0/2054312449 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7fc0d2300 msgr2=0x7fe7fc0d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:48.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.282+0000 7fe7fb7fe640 1 --2- 172.21.15.5:0/2054312449 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7fc0d2300 0x7fe7fc0d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:48.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.282+0000 7fe7fb7fe640 1 -- 172.21.15.5:0/2054312449 >> v1:172.21.15.154:6789/0 conn(0x7fe7fc0d2fc0 legacy=0x7fe7fc0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:48.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.282+0000 7fe7fb7fe640 1 -- 172.21.15.5:0/2054312449 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc0b1060 con 0x7fe7fc15bde0 2023-07-14T12:52:48.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.282+0000 7fe7fbfff640 1 --2- 172.21.15.5:0/2054312449 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7fc0d2300 0x7fe7fc0d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:52:48.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.286+0000 7fe7fb7fe640 1 --2- 172.21.15.5:0/2054312449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7fc15bde0 0x7fe7fc0d0270 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec006fd0 tx=0x7fe7ec01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e983ad27e2954e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:48.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.286+0000 7fe7fa7fc640 1 -- 172.21.15.5:0/2054312449 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec0ac410 con 0x7fe7fc15bde0 2023-07-14T12:52:48.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.286+0000 7fe7fa7fc640 1 -- 172.21.15.5:0/2054312449 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ec0ac570 con 0x7fe7fc15bde0 2023-07-14T12:52:48.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.286+0000 7fe7fa7fc640 1 -- 172.21.15.5:0/2054312449 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec0ac900 con 0x7fe7fc15bde0 2023-07-14T12:52:48.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.286+0000 7fe801b00640 1 -- 172.21.15.5:0/2054312449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7fc15bde0 msgr2=0x7fe7fc0d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:48.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.286+0000 7fe801b00640 1 --2- 172.21.15.5:0/2054312449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7fc15bde0 0x7fe7fc0d0270 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec006fd0 tx=0x7fe7ec01c4e0 comp rx=0 tx=0).stop 2023-07-14T12:52:48.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.286+0000 7fe801b00640 1 -- 172.21.15.5:0/2054312449 shutdown_connections 2023-07-14T12:52:48.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.286+0000 7fe801b00640 1 --2- 172.21.15.5:0/2054312449 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7fc0d2300 0x7fe7fc0d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:48.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.286+0000 7fe801b00640 1 --2- 172.21.15.5:0/2054312449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7fc15bde0 0x7fe7fc0d0270 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:48.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.286+0000 7fe801b00640 1 -- 172.21.15.5:0/2054312449 >> 172.21.15.5:0/2054312449 conn(0x7fe7fc0659d0 msgr2=0x7fe7fc09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:48.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.286+0000 7fe801b00640 1 -- 172.21.15.5:0/2054312449 shutdown_connections 2023-07-14T12:52:48.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.286+0000 7fe801b00640 1 -- 172.21.15.5:0/2054312449 wait complete. 2023-07-14T12:52:48.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.290+0000 7fe801b00640 1 Processor -- start 2023-07-14T12:52:48.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.290+0000 7fe801b00640 1 -- start start 2023-07-14T12:52:48.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.290+0000 7fe801b00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7fc0d2300 0x7fe7fc158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:48.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.290+0000 7fe801b00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7fc0d2fc0 0x7fe7fc0c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:48.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.290+0000 7fe801b00640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7fc15bde0 0x7fe7fc0c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:48.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.290+0000 7fe801b00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc0cbfb0 con 0x7fe7fc0d2fc0 2023-07-14T12:52:48.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.290+0000 7fe801b00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc0c8f90 con 0x7fe7fc0d2300 2023-07-14T12:52:48.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.290+0000 7fe801b00640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc0cc3d0 con 0x7fe7fc15bde0 2023-07-14T12:52:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.290+0000 7fe7faffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7fc0d2fc0 0x7fe7fc0c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.290+0000 7fe7faffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7fc0d2fc0 0x7fe7fc0c8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53464/0 (socket says 172.21.15.5:53464) 2023-07-14T12:52:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.290+0000 7fe7faffd640 1 -- 172.21.15.5:0/724643133 learned_addr learned my addr 172.21.15.5:0/724643133 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.290+0000 7fe7fb7fe640 1 --2- 172.21.15.5:0/724643133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7fc0d2300 0x7fe7fc158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.290+0000 7fe7fbfff640 1 --2- 172.21.15.5:0/724643133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7fc15bde0 0x7fe7fc0c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.290+0000 7fe7faffd640 1 -- 172.21.15.5:0/724643133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7fc15bde0 msgr2=0x7fe7fc0c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.290+0000 7fe7faffd640 1 --2- 172.21.15.5:0/724643133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7fc15bde0 0x7fe7fc0c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:48.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.290+0000 7fe7faffd640 1 -- 172.21.15.5:0/724643133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7fc0d2300 msgr2=0x7fe7fc158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:48.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.290+0000 7fe7faffd640 1 --2- 172.21.15.5:0/724643133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7fc0d2300 0x7fe7fc158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:48.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.290+0000 7fe7faffd640 1 -- 172.21.15.5:0/724643133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ec009480 con 0x7fe7fc0d2fc0 2023-07-14T12:52:48.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.290+0000 7fe7fbfff640 1 --2- 172.21.15.5:0/724643133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7fc15bde0 0x7fe7fc0c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:52:48.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.290+0000 7fe7faffd640 1 --2- 172.21.15.5:0/724643133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7fc0d2fc0 0x7fe7fc0c8510 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe7f000c410 tx=0x7fe7f000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:48.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.290+0000 7fe7e3fff640 1 -- 172.21.15.5:0/724643133 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f0011790 con 0x7fe7fc0d2fc0 2023-07-14T12:52:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.290+0000 7fe7e3fff640 1 -- 172.21.15.5:0/724643133 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f00118f0 con 0x7fe7fc0d2fc0 2023-07-14T12:52:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.290+0000 7fe801b00640 1 -- 172.21.15.5:0/724643133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7fc0cb330 con 0x7fe7fc0d2fc0 2023-07-14T12:52:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.290+0000 7fe7e3fff640 1 -- 172.21.15.5:0/724643133 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f0011ce0 con 0x7fe7fc0d2fc0 2023-07-14T12:52:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.290+0000 7fe801b00640 1 -- 172.21.15.5:0/724643133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7fc0cb8f0 con 0x7fe7fc0d2fc0 2023-07-14T12:52:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.294+0000 7fe801b00640 1 -- 172.21.15.5:0/724643133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7fc0cc0f0 con 0x7fe7fc0d2fc0 2023-07-14T12:52:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.294+0000 7fe7e3fff640 1 -- 172.21.15.5:0/724643133 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe7f001c460 con 0x7fe7fc0d2fc0 2023-07-14T12:52:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.294+0000 7fe7e3fff640 1 --2- 172.21.15.5:0/724643133 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe7e8066280 0x7fe7e8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.294+0000 7fe7e3fff640 1 -- 172.21.15.5:0/724643133 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe7f0083a40 con 0x7fe7fc0d2fc0 2023-07-14T12:52:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.294+0000 7fe7fb7fe640 1 --2- 172.21.15.5:0/724643133 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe7e8066280 0x7fe7e8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:48.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.294+0000 7fe7fb7fe640 1 --2- 172.21.15.5:0/724643133 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe7e8066280 0x7fe7e8068730 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec0ae000 tx=0x7fe7ec0a6040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:48.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.298+0000 7fe7e3fff640 1 -- 172.21.15.5:0/724643133 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe7fc0cc0f0 con 0x7fe7fc0d2fc0 2023-07-14T12:52:48.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:48.486+0000 7fe801b00640 1 -- 172.21.15.5:0/724643133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe7fc0cc0f0 con 0x7fe7fc0d2fc0 2023-07-14T12:52:49.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.430+0000 7fe7e3fff640 1 -- 172.21.15.5:0/724643133 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe7fc0cc0f0 con 0x7fe7fc0d2fc0 2023-07-14T12:52:49.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.434+0000 7fe801b00640 1 -- 172.21.15.5:0/724643133 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe7e8066280 msgr2=0x7fe7e8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:49.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.434+0000 7fe801b00640 1 --2- 172.21.15.5:0/724643133 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe7e8066280 0x7fe7e8068730 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec0ae000 tx=0x7fe7ec0a6040 comp rx=0 tx=0).stop 2023-07-14T12:52:49.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.434+0000 7fe801b00640 1 -- 172.21.15.5:0/724643133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7fc0d2fc0 msgr2=0x7fe7fc0c8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:49.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.434+0000 7fe801b00640 1 --2- 172.21.15.5:0/724643133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7fc0d2fc0 0x7fe7fc0c8510 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe7f000c410 tx=0x7fe7f000c8d0 comp rx=0 tx=0).stop 2023-07-14T12:52:49.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.434+0000 7fe801b00640 1 -- 172.21.15.5:0/724643133 shutdown_connections 2023-07-14T12:52:49.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.434+0000 7fe801b00640 1 --2- 172.21.15.5:0/724643133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7fc15bde0 0x7fe7fc0c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:49.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.434+0000 7fe801b00640 1 --2- 172.21.15.5:0/724643133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7fc0d2fc0 0x7fe7fc0c8510 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:49.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.434+0000 7fe801b00640 1 --2- 172.21.15.5:0/724643133 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe7e8066280 0x7fe7e8068730 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:49.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.434+0000 7fe801b00640 1 --2- 172.21.15.5:0/724643133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7fc0d2300 0x7fe7fc158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:49.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.434+0000 7fe801b00640 1 -- 172.21.15.5:0/724643133 >> 172.21.15.5:0/724643133 conn(0x7fe7fc0659d0 msgr2=0x7fe7fc0ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:49.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.434+0000 7fe801b00640 1 -- 172.21.15.5:0/724643133 shutdown_connections 2023-07-14T12:52:49.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.434+0000 7fe801b00640 1 -- 172.21.15.5:0/724643133 wait complete. 2023-07-14T12:52:49.484 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-14T12:52:49.484 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-14T12:52:49.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.610+0000 7fc176e6d640 1 Processor -- start 2023-07-14T12:52:49.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.610+0000 7fc176e6d640 1 -- start start 2023-07-14T12:52:49.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.610+0000 7fc176e6d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc170070f30 0x7fc1700ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:49.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.610+0000 7fc176e6d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc1700af2b0 0x7fc17015a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:49.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.610+0000 7fc176e6d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc170159d70 con 0x7fc170069430 2023-07-14T12:52:49.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.610+0000 7fc176e6d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1700c9c60 con 0x7fc170070f30 2023-07-14T12:52:49.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.610+0000 7fc176e6d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1700c9f40 con 0x7fc1700af2b0 2023-07-14T12:52:49.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.610+0000 7fc174c09640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc170069430 0x7fc170069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38812/0 (socket says 172.21.15.5:38812) 2023-07-14T12:52:49.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.610+0000 7fc16ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc170070f30 0x7fc1700ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:49.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.610+0000 7fc174c09640 1 -- 172.21.15.5:0/4003154570 learned_addr learned my addr 172.21.15.5:0/4003154570 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:49.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.610+0000 7fc17540a640 1 --2- 172.21.15.5:0/4003154570 >> v2:172.21.15.154:3300/0 conn(0x7fc1700af2b0 0x7fc17015a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:49.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.614+0000 7fc16ffff640 1 -- 172.21.15.5:0/4003154570 >> v2:172.21.15.154:3300/0 conn(0x7fc1700af2b0 msgr2=0x7fc17015a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:49.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.614+0000 7fc16ffff640 1 --2- 172.21.15.5:0/4003154570 >> v2:172.21.15.154:3300/0 conn(0x7fc1700af2b0 0x7fc17015a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:49.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.614+0000 7fc16ffff640 1 -- 172.21.15.5:0/4003154570 >> v1:172.21.15.5:6789/0 conn(0x7fc170069430 legacy=0x7fc170069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:49.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.614+0000 7fc16ffff640 1 -- 172.21.15.5:0/4003154570 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1700ca220 con 0x7fc170070f30 2023-07-14T12:52:49.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.614+0000 7fc17540a640 1 --2- 172.21.15.5:0/4003154570 >> v2:172.21.15.154:3300/0 conn(0x7fc1700af2b0 0x7fc17015a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:52:49.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.614+0000 7fc16ffff640 1 --2- 172.21.15.5:0/4003154570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc170070f30 0x7fc1700ad6f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc1700cef70 tx=0x7fc15c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e164c961bb4746 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:49.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.614+0000 7fc16f7fe640 1 -- 172.21.15.5:0/4003154570 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c0ab660 con 0x7fc170070f30 2023-07-14T12:52:49.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.614+0000 7fc16f7fe640 1 -- 172.21.15.5:0/4003154570 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15c0ab7c0 con 0x7fc170070f30 2023-07-14T12:52:49.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.614+0000 7fc16f7fe640 1 -- 172.21.15.5:0/4003154570 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c0abb50 con 0x7fc170070f30 2023-07-14T12:52:49.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.614+0000 7fc176e6d640 1 -- 172.21.15.5:0/4003154570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc170070f30 msgr2=0x7fc1700ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:49.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.614+0000 7fc176e6d640 1 --2- 172.21.15.5:0/4003154570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc170070f30 0x7fc1700ad6f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc1700cef70 tx=0x7fc15c01c460 comp rx=0 tx=0).stop 2023-07-14T12:52:49.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.614+0000 7fc176e6d640 1 -- 172.21.15.5:0/4003154570 shutdown_connections 2023-07-14T12:52:49.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.614+0000 7fc176e6d640 1 --2- 172.21.15.5:0/4003154570 >> v2:172.21.15.154:3300/0 conn(0x7fc1700af2b0 0x7fc17015a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:49.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.614+0000 7fc176e6d640 1 --2- 172.21.15.5:0/4003154570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc170070f30 0x7fc1700ad6f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:49.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.614+0000 7fc176e6d640 1 -- 172.21.15.5:0/4003154570 >> 172.21.15.5:0/4003154570 conn(0x7fc1700cde90 msgr2=0x7fc1700ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:49.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.614+0000 7fc176e6d640 1 -- 172.21.15.5:0/4003154570 shutdown_connections 2023-07-14T12:52:49.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.614+0000 7fc176e6d640 1 -- 172.21.15.5:0/4003154570 wait complete. 2023-07-14T12:52:49.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.618+0000 7fc176e6d640 1 Processor -- start 2023-07-14T12:52:49.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.618+0000 7fc176e6d640 1 -- start start 2023-07-14T12:52:49.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.618+0000 7fc176e6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc170069430 0x7fc1700b2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:49.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.618+0000 7fc176e6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc170070f30 0x7fc170158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:49.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.618+0000 7fc176e6d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1700af2b0 0x7fc170158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:49.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.618+0000 7fc176e6d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1700b2a90 con 0x7fc170069430 2023-07-14T12:52:49.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.618+0000 7fc176e6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1700b2ca0 con 0x7fc170070f30 2023-07-14T12:52:49.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.618+0000 7fc176e6d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1700b2f80 con 0x7fc1700af2b0 2023-07-14T12:52:49.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.618+0000 7fc174c09640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc170069430 0x7fc1700b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:49.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.618+0000 7fc174c09640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc170069430 0x7fc1700b2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52464/0 (socket says 172.21.15.5:52464) 2023-07-14T12:52:49.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.618+0000 7fc174c09640 1 -- 172.21.15.5:0/3423316213 learned_addr learned my addr 172.21.15.5:0/3423316213 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:49.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.618+0000 7fc16ffff640 1 --2- 172.21.15.5:0/3423316213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc170070f30 0x7fc170158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:49.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.618+0000 7fc17540a640 1 --2- 172.21.15.5:0/3423316213 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1700af2b0 0x7fc170158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:49.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.618+0000 7fc174c09640 1 -- 172.21.15.5:0/3423316213 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1700af2b0 msgr2=0x7fc170158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:49.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.618+0000 7fc174c09640 1 --2- 172.21.15.5:0/3423316213 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1700af2b0 0x7fc170158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:49.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.618+0000 7fc174c09640 1 -- 172.21.15.5:0/3423316213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc170070f30 msgr2=0x7fc170158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:49.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.618+0000 7fc174c09640 1 --2- 172.21.15.5:0/3423316213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc170070f30 0x7fc170158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:49.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.618+0000 7fc174c09640 1 -- 172.21.15.5:0/3423316213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc15c009420 con 0x7fc170069430 2023-07-14T12:52:49.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.618+0000 7fc17540a640 1 --2- 172.21.15.5:0/3423316213 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1700af2b0 0x7fc170158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:52:49.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.618+0000 7fc174c09640 1 --2- 172.21.15.5:0/3423316213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc170069430 0x7fc1700b2550 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc16400c400 tx=0x7fc16400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:49.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.618+0000 7fc16d7fa640 1 -- 172.21.15.5:0/3423316213 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164005cf0 con 0x7fc170069430 2023-07-14T12:52:49.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.618+0000 7fc16d7fa640 1 -- 172.21.15.5:0/3423316213 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc164005e50 con 0x7fc170069430 2023-07-14T12:52:49.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.618+0000 7fc16d7fa640 1 -- 172.21.15.5:0/3423316213 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1640072d0 con 0x7fc170069430 2023-07-14T12:52:49.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.618+0000 7fc176e6d640 1 -- 172.21.15.5:0/3423316213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1700b3260 con 0x7fc170069430 2023-07-14T12:52:49.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.622+0000 7fc176e6d640 1 -- 172.21.15.5:0/3423316213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1701f55a0 con 0x7fc170069430 2023-07-14T12:52:49.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.622+0000 7fc176e6d640 1 -- 172.21.15.5:0/3423316213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1700678d0 con 0x7fc170069430 2023-07-14T12:52:49.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.622+0000 7fc16d7fa640 1 -- 172.21.15.5:0/3423316213 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc164007430 con 0x7fc170069430 2023-07-14T12:52:49.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.622+0000 7fc16d7fa640 1 --2- 172.21.15.5:0/3423316213 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc154066280 0x7fc154068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:49.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.622+0000 7fc16d7fa640 1 -- 172.21.15.5:0/3423316213 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc1640838c0 con 0x7fc170069430 2023-07-14T12:52:49.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.622+0000 7fc16ffff640 1 --2- 172.21.15.5:0/3423316213 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc154066280 0x7fc154068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:49.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.626+0000 7fc16ffff640 1 --2- 172.21.15.5:0/3423316213 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc154066280 0x7fc154068730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0af000 tx=0x7fc15c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:49.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.626+0000 7fc16d7fa640 1 -- 172.21.15.5:0/3423316213 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc164050dd0 con 0x7fc170069430 2023-07-14T12:52:49.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:49.818+0000 7fc176e6d640 1 -- 172.21.15.5:0/3423316213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc170159d70 con 0x7fc170069430 2023-07-14T12:52:50.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.438+0000 7fc16d7fa640 1 -- 172.21.15.5:0/3423316213 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc170159d70 con 0x7fc170069430 2023-07-14T12:52:50.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.438+0000 7fc176e6d640 1 -- 172.21.15.5:0/3423316213 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc154066280 msgr2=0x7fc154068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:50.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.438+0000 7fc176e6d640 1 --2- 172.21.15.5:0/3423316213 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc154066280 0x7fc154068730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0af000 tx=0x7fc15c0a7000 comp rx=0 tx=0).stop 2023-07-14T12:52:50.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.438+0000 7fc176e6d640 1 -- 172.21.15.5:0/3423316213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc170069430 msgr2=0x7fc1700b2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:50.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.438+0000 7fc176e6d640 1 --2- 172.21.15.5:0/3423316213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc170069430 0x7fc1700b2550 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc16400c400 tx=0x7fc16400c8c0 comp rx=0 tx=0).stop 2023-07-14T12:52:50.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.442+0000 7fc176e6d640 1 -- 172.21.15.5:0/3423316213 shutdown_connections 2023-07-14T12:52:50.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.442+0000 7fc176e6d640 1 --2- 172.21.15.5:0/3423316213 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1700af2b0 0x7fc170158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:50.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.442+0000 7fc176e6d640 1 --2- 172.21.15.5:0/3423316213 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc154066280 0x7fc154068730 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:50.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.442+0000 7fc176e6d640 1 --2- 172.21.15.5:0/3423316213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc170070f30 0x7fc170158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:50.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.442+0000 7fc176e6d640 1 --2- 172.21.15.5:0/3423316213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc170069430 0x7fc1700b2550 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:50.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.442+0000 7fc176e6d640 1 -- 172.21.15.5:0/3423316213 >> 172.21.15.5:0/3423316213 conn(0x7fc1700cde90 msgr2=0x7fc1700cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:50.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.442+0000 7fc176e6d640 1 -- 172.21.15.5:0/3423316213 shutdown_connections 2023-07-14T12:52:50.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.442+0000 7fc176e6d640 1 -- 172.21.15.5:0/3423316213 wait complete. 2023-07-14T12:52:50.488 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-14T12:52:50.489 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:52:50.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.610+0000 7f0b4059f640 1 Processor -- start 2023-07-14T12:52:50.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.610+0000 7f0b4059f640 1 -- start start 2023-07-14T12:52:50.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.614+0000 7f0b4059f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b38158ce0 0x7f0b38070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:50.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.614+0000 7f0b4059f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0b380c8ad0 0x7f0b380c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:50.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.614+0000 7f0b4059f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b380cc700 con 0x7f0b380c9560 2023-07-14T12:52:50.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.614+0000 7f0b4059f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b380c99e0 con 0x7f0b380c8ad0 2023-07-14T12:52:50.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.614+0000 7f0b4059f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b380b0ff0 con 0x7f0b38158ce0 2023-07-14T12:52:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.614+0000 7f0b3db3a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0b380c8ad0 0x7f0b380c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.614+0000 7f0b3e33b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b38158ce0 0x7f0b38070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.614+0000 7f0b3db3a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0b380c8ad0 0x7f0b380c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52474/0 (socket says 172.21.15.5:52474) 2023-07-14T12:52:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.614+0000 7f0b3db3a640 1 -- 172.21.15.5:0/1426545828 learned_addr learned my addr 172.21.15.5:0/1426545828 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.614+0000 7f0b3eb3c640 1 --1- 172.21.15.5:0/1426545828 >> v1:172.21.15.154:6789/0 conn(0x7f0b380c9560 0x7f0b380cab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:57948/0 (socket says 172.21.15.5:57948) 2023-07-14T12:52:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.614+0000 7f0b3db3a640 1 -- 172.21.15.5:0/1426545828 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b38158ce0 msgr2=0x7f0b38070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.614+0000 7f0b3db3a640 1 --2- 172.21.15.5:0/1426545828 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b38158ce0 0x7f0b38070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:50.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.614+0000 7f0b3db3a640 1 -- 172.21.15.5:0/1426545828 >> v1:172.21.15.154:6789/0 conn(0x7f0b380c9560 legacy=0x7f0b380cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:50.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.614+0000 7f0b3db3a640 1 -- 172.21.15.5:0/1426545828 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b38070c80 con 0x7f0b380c8ad0 2023-07-14T12:52:50.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.614+0000 7f0b3e33b640 1 --2- 172.21.15.5:0/1426545828 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b38158ce0 0x7f0b38070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:52:50.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.614+0000 7f0b3db3a640 1 --2- 172.21.15.5:0/1426545828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b380c8ad0 0x7f0b380c9020 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009870 tx=0x7f0b2801e600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a57d6fbf0686bb3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:50.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.618+0000 7f0b3d339640 1 -- 172.21.15.5:0/1426545828 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b380cba20 con 0x7f0b380c8ad0 2023-07-14T12:52:50.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.618+0000 7f0b3d339640 1 -- 172.21.15.5:0/1426545828 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b280aa630 con 0x7f0b380c8ad0 2023-07-14T12:52:50.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.618+0000 7f0b3d339640 1 -- 172.21.15.5:0/1426545828 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b280aa9c0 con 0x7f0b380c8ad0 2023-07-14T12:52:50.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.618+0000 7f0b4059f640 1 -- 172.21.15.5:0/1426545828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b380c8ad0 msgr2=0x7f0b380c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.618+0000 7f0b4059f640 1 --2- 172.21.15.5:0/1426545828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b380c8ad0 0x7f0b380c9020 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009870 tx=0x7f0b2801e600 comp rx=0 tx=0).stop 2023-07-14T12:52:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.618+0000 7f0b4059f640 1 -- 172.21.15.5:0/1426545828 shutdown_connections 2023-07-14T12:52:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.618+0000 7f0b4059f640 1 --2- 172.21.15.5:0/1426545828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b380c8ad0 0x7f0b380c9020 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.618+0000 7f0b4059f640 1 --2- 172.21.15.5:0/1426545828 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b38158ce0 0x7f0b38070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:50.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.618+0000 7f0b4059f640 1 -- 172.21.15.5:0/1426545828 >> 172.21.15.5:0/1426545828 conn(0x7f0b380afcf0 msgr2=0x7f0b380b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:50.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.618+0000 7f0b4059f640 1 -- 172.21.15.5:0/1426545828 shutdown_connections 2023-07-14T12:52:50.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.618+0000 7f0b4059f640 1 -- 172.21.15.5:0/1426545828 wait complete. 2023-07-14T12:52:50.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.618+0000 7f0b4059f640 1 Processor -- start 2023-07-14T12:52:50.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.618+0000 7f0b4059f640 1 -- start start 2023-07-14T12:52:50.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.618+0000 7f0b4059f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b380c8ad0 0x7f0b380ace90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:50.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.618+0000 7f0b4059f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b380c9560 0x7f0b381f4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:50.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.618+0000 7f0b4059f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b38158ce0 0x7f0b380c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:50.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.618+0000 7f0b4059f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b38157740 con 0x7f0b380c9560 2023-07-14T12:52:50.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.618+0000 7f0b4059f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b380c7610 con 0x7f0b38158ce0 2023-07-14T12:52:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.618+0000 7f0b4059f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b381f5070 con 0x7f0b380c8ad0 2023-07-14T12:52:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.618+0000 7f0b3db3a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b380c9560 0x7f0b381f4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.622+0000 7f0b3db3a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b380c9560 0x7f0b381f4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52488/0 (socket says 172.21.15.5:52488) 2023-07-14T12:52:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.622+0000 7f0b3db3a640 1 -- 172.21.15.5:0/2072269989 learned_addr learned my addr 172.21.15.5:0/2072269989 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.622+0000 7f0b3eb3c640 1 --2- 172.21.15.5:0/2072269989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b38158ce0 0x7f0b380c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.622+0000 7f0b3e33b640 1 --2- 172.21.15.5:0/2072269989 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b380c8ad0 0x7f0b380ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.622+0000 7f0b3db3a640 1 -- 172.21.15.5:0/2072269989 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b380c8ad0 msgr2=0x7f0b380ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.622+0000 7f0b3db3a640 1 --2- 172.21.15.5:0/2072269989 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b380c8ad0 0x7f0b380ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.622+0000 7f0b3db3a640 1 -- 172.21.15.5:0/2072269989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b38158ce0 msgr2=0x7f0b380c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.622+0000 7f0b3db3a640 1 --2- 172.21.15.5:0/2072269989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b38158ce0 0x7f0b380c7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.622+0000 7f0b3db3a640 1 -- 172.21.15.5:0/2072269989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b34009420 con 0x7f0b380c9560 2023-07-14T12:52:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.622+0000 7f0b3db3a640 1 --2- 172.21.15.5:0/2072269989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b380c9560 0x7f0b381f4b30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0b2801ccb0 tx=0x7f0b2801b3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.622+0000 7f0b2effd640 1 -- 172.21.15.5:0/2072269989 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b280b2610 con 0x7f0b380c9560 2023-07-14T12:52:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.622+0000 7f0b2effd640 1 -- 172.21.15.5:0/2072269989 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b280b2770 con 0x7f0b380c9560 2023-07-14T12:52:50.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.622+0000 7f0b2effd640 1 -- 172.21.15.5:0/2072269989 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b280b2ae0 con 0x7f0b380c9560 2023-07-14T12:52:50.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.622+0000 7f0b4059f640 1 -- 172.21.15.5:0/2072269989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b280094d0 con 0x7f0b380c9560 2023-07-14T12:52:50.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.622+0000 7f0b4059f640 1 -- 172.21.15.5:0/2072269989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b38157460 con 0x7f0b380c9560 2023-07-14T12:52:50.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.622+0000 7f0b4059f640 1 -- 172.21.15.5:0/2072269989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b380ca1a0 con 0x7f0b380c9560 2023-07-14T12:52:50.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.622+0000 7f0b2effd640 1 -- 172.21.15.5:0/2072269989 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0b280b2c40 con 0x7f0b380c9560 2023-07-14T12:52:50.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.626+0000 7f0b2effd640 1 --2- 172.21.15.5:0/2072269989 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f0b1c066280 0x7f0b1c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:50.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.626+0000 7f0b2effd640 1 -- 172.21.15.5:0/2072269989 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0b2811dfe0 con 0x7f0b380c9560 2023-07-14T12:52:50.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.626+0000 7f0b3e33b640 1 --2- 172.21.15.5:0/2072269989 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f0b1c066280 0x7f0b1c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:50.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.626+0000 7f0b3e33b640 1 --2- 172.21.15.5:0/2072269989 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f0b1c066280 0x7f0b1c068730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0b34009cf0 tx=0x7f0b34009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:50.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.630+0000 7f0b2effd640 1 -- 172.21.15.5:0/2072269989 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f0b280eb5a0 con 0x7f0b380c9560 2023-07-14T12:52:50.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.818+0000 7f0b4059f640 1 -- 172.21.15.5:0/2072269989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b380678d0 con 0x7f0b380c9560 2023-07-14T12:52:50.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.818+0000 7f0b2effd640 1 -- 172.21.15.5:0/2072269989 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4703 (secure 0 0 0) 0x7f0b280eebc0 con 0x7f0b380c9560 2023-07-14T12:52:50.845 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:52:50.845 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1953958881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1953958881},{"type":"v1","addr":"172.21.15.154:6837","nonce":1953958881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3138000501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3138000501},{"type":"v1","addr":"172.21.15.5:6834","nonce":3138000501}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1911549775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1911549775},{"type":"v1","addr":"172.21.15.5:6835","nonce":1911549775}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T12:52:46.473195+0000","modified":"2023-07-14T12:52:50.433872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6836/3154882793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3154882793},{"type":"v1","addr":"172.21.15.154:6836","nonce":3154882793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T12:52:50.846 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2023-07-14T12:52:50.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.822+0000 7f0b4059f640 1 -- 172.21.15.5:0/2072269989 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f0b1c066280 msgr2=0x7f0b1c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.822+0000 7f0b4059f640 1 --2- 172.21.15.5:0/2072269989 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f0b1c066280 0x7f0b1c068730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0b34009cf0 tx=0x7f0b34009190 comp rx=0 tx=0).stop 2023-07-14T12:52:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.822+0000 7f0b4059f640 1 -- 172.21.15.5:0/2072269989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b380c9560 msgr2=0x7f0b381f4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.822+0000 7f0b4059f640 1 --2- 172.21.15.5:0/2072269989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b380c9560 0x7f0b381f4b30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0b2801ccb0 tx=0x7f0b2801b3a0 comp rx=0 tx=0).stop 2023-07-14T12:52:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.822+0000 7f0b4059f640 1 -- 172.21.15.5:0/2072269989 shutdown_connections 2023-07-14T12:52:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.822+0000 7f0b4059f640 1 --2- 172.21.15.5:0/2072269989 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f0b1c066280 0x7f0b1c068730 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.822+0000 7f0b4059f640 1 --2- 172.21.15.5:0/2072269989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b38158ce0 0x7f0b380c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:50.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.822+0000 7f0b4059f640 1 --2- 172.21.15.5:0/2072269989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b380c9560 0x7f0b381f4b30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:50.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.822+0000 7f0b4059f640 1 --2- 172.21.15.5:0/2072269989 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b380c8ad0 0x7f0b380ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:50.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.822+0000 7f0b4059f640 1 -- 172.21.15.5:0/2072269989 >> 172.21.15.5:0/2072269989 conn(0x7f0b380afcf0 msgr2=0x7f0b3806b370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:50.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.822+0000 7f0b4059f640 1 -- 172.21.15.5:0/2072269989 shutdown_connections 2023-07-14T12:52:50.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.822+0000 7f0b4059f640 1 -- 172.21.15.5:0/2072269989 wait complete. 2023-07-14T12:52:50.866 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:52:51.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3de2537640 1 Processor -- start 2023-07-14T12:52:51.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3de2537640 1 -- start start 2023-07-14T12:52:51.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3de2537640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3ddc0b7c70 0x7f3ddc0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:51.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3de2537640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ddc0d1850 0x7f3ddc15f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:51.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3de2537640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ddc0ccaf0 con 0x7f3ddc0d1300 2023-07-14T12:52:51.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3de2537640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ddc0d1190 con 0x7f3ddc0b7c70 2023-07-14T12:52:51.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3de2537640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc160600 con 0x7f3ddc0d1850 2023-07-14T12:52:51.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3de0ad4640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3ddc0d1300 0x7f3ddc0d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38814/0 (socket says 172.21.15.5:38814) 2023-07-14T12:52:51.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3de0ad4640 1 -- 172.21.15.5:0/1323213685 learned_addr learned my addr 172.21.15.5:0/1323213685 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:51.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3ddb7fe640 1 --2- 172.21.15.5:0/1323213685 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ddc0d1850 0x7f3ddc15f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:51.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3ddbfff640 1 --2- 172.21.15.5:0/1323213685 >> v2:172.21.15.154:3300/0 conn(0x7f3ddc0b7c70 0x7f3ddc0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:51.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3ddaffd640 1 -- 172.21.15.5:0/1323213685 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1062894651 0 0) 0x7f3ddc0ccaf0 con 0x7f3ddc0d1300 2023-07-14T12:52:51.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3ddaffd640 1 -- 172.21.15.5:0/1323213685 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dc4003530 con 0x7f3ddc0d1300 2023-07-14T12:52:51.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3ddaffd640 1 -- 172.21.15.5:0/1323213685 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2258445716 0 0) 0x7f3dc4003530 con 0x7f3ddc0d1300 2023-07-14T12:52:51.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3ddaffd640 1 -- 172.21.15.5:0/1323213685 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ddc0d1850 msgr2=0x7f3ddc15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:51.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3ddaffd640 1 --2- 172.21.15.5:0/1323213685 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ddc0d1850 0x7f3ddc15f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3ddaffd640 1 -- 172.21.15.5:0/1323213685 >> v2:172.21.15.154:3300/0 conn(0x7f3ddc0b7c70 msgr2=0x7f3ddc0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:51.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3ddaffd640 1 --2- 172.21.15.5:0/1323213685 >> v2:172.21.15.154:3300/0 conn(0x7f3ddc0b7c70 0x7f3ddc0d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3ddaffd640 1 -- 172.21.15.5:0/1323213685 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc160320 con 0x7f3ddc0d1300 2023-07-14T12:52:51.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3ddaffd640 1 -- 172.21.15.5:0/1323213685 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f3dd4001a00 con 0x7f3ddc0d1300 2023-07-14T12:52:51.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3ddaffd640 1 -- 172.21.15.5:0/1323213685 >> v1:172.21.15.5:6789/0 conn(0x7f3ddc0d1300 legacy=0x7f3ddc0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:51.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3ddaffd640 1 --2- 172.21.15.5:0/1323213685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dc40039b0 0x7f3dc4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:51.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3ddaffd640 1 --2- 172.21.15.5:0/1323213685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dc40047d0 0x7f3dc4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:51.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3ddaffd640 1 --2- 172.21.15.5:0/1323213685 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ddc0d1850 0x7f3dc4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:51.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3ddaffd640 1 -- 172.21.15.5:0/1323213685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc160600 con 0x7f3dc40039b0 2023-07-14T12:52:51.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3ddaffd640 1 -- 172.21.15.5:0/1323213685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc400b990 con 0x7f3dc40047d0 2023-07-14T12:52:51.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3ddaffd640 1 -- 172.21.15.5:0/1323213685 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc400bad0 con 0x7f3ddc0d1850 2023-07-14T12:52:51.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3ddbfff640 1 --2- 172.21.15.5:0/1323213685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dc40039b0 0x7f3dc4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:51.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3ddb7fe640 1 --2- 172.21.15.5:0/1323213685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dc40047d0 0x7f3dc4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:51.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3de0ad4640 1 --2- 172.21.15.5:0/1323213685 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ddc0d1850 0x7f3dc4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:51.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3ddbfff640 1 -- 172.21.15.5:0/1323213685 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ddc0d1850 msgr2=0x7f3dc4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:51.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3ddbfff640 1 --2- 172.21.15.5:0/1323213685 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ddc0d1850 0x7f3dc4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3ddbfff640 1 -- 172.21.15.5:0/1323213685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dc40047d0 msgr2=0x7f3dc4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:51.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3ddbfff640 1 --2- 172.21.15.5:0/1323213685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dc40047d0 0x7f3dc4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.986+0000 7f3ddbfff640 1 -- 172.21.15.5:0/1323213685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc4003530 con 0x7f3dc40039b0 2023-07-14T12:52:51.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.990+0000 7f3ddbfff640 1 --2- 172.21.15.5:0/1323213685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dc40039b0 0x7f3dc4003dc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009ae0 tx=0x7f3dcc01ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c165cc1cfefdd9b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:51.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.990+0000 7f3ddaffd640 1 -- 172.21.15.5:0/1323213685 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc0a5540 con 0x7f3dc40039b0 2023-07-14T12:52:51.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.990+0000 7f3ddaffd640 1 -- 172.21.15.5:0/1323213685 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc0a56a0 con 0x7f3dc40039b0 2023-07-14T12:52:51.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.990+0000 7f3ddaffd640 1 -- 172.21.15.5:0/1323213685 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc0a5a50 con 0x7f3dc40039b0 2023-07-14T12:52:51.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.990+0000 7f3de2537640 1 -- 172.21.15.5:0/1323213685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dc40039b0 msgr2=0x7f3dc4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:51.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.990+0000 7f3de2537640 1 --2- 172.21.15.5:0/1323213685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dc40039b0 0x7f3dc4003dc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009ae0 tx=0x7f3dcc01ca60 comp rx=0 tx=0).stop 2023-07-14T12:52:51.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.990+0000 7f3de0ad4640 1 -- 172.21.15.5:0/1323213685 reap_dead start 2023-07-14T12:52:51.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.990+0000 7f3de2537640 1 -- 172.21.15.5:0/1323213685 shutdown_connections 2023-07-14T12:52:51.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.990+0000 7f3de2537640 1 -- 172.21.15.5:0/1323213685 >> 172.21.15.5:0/1323213685 conn(0x7f3ddc0650b0 msgr2=0x7f3ddc0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:51.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.990+0000 7f3de2537640 1 -- 172.21.15.5:0/1323213685 shutdown_connections 2023-07-14T12:52:51.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.990+0000 7f3de2537640 1 -- 172.21.15.5:0/1323213685 wait complete. 2023-07-14T12:52:51.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.994+0000 7f3de2537640 1 Processor -- start 2023-07-14T12:52:51.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.994+0000 7f3de2537640 1 -- start start 2023-07-14T12:52:51.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.994+0000 7f3de2537640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dc40039b0 0x7f3ddc0cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:51.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.994+0000 7f3de2537640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ddc158900 0x7f3ddc156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:51.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.994+0000 7f3de2537640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ddc157440 0x7f3ddc15c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:51.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.994+0000 7f3de2537640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc15bfe0 con 0x7f3ddc157440 2023-07-14T12:52:51.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.994+0000 7f3de2537640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc15b740 con 0x7f3dc40039b0 2023-07-14T12:52:51.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.994+0000 7f3de2537640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc15ba20 con 0x7f3ddc158900 2023-07-14T12:52:51.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.994+0000 7f3de0ad4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ddc157440 0x7f3ddc15c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:51.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.994+0000 7f3de0ad4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ddc157440 0x7f3ddc15c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52516/0 (socket says 172.21.15.5:52516) 2023-07-14T12:52:51.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.994+0000 7f3de0ad4640 1 -- 172.21.15.5:0/1021436993 learned_addr learned my addr 172.21.15.5:0/1021436993 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:51.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.994+0000 7f3ddb7fe640 1 --2- 172.21.15.5:0/1021436993 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ddc158900 0x7f3ddc156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:51.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.994+0000 7f3ddbfff640 1 --2- 172.21.15.5:0/1021436993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dc40039b0 0x7f3ddc0cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:51.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.994+0000 7f3de0ad4640 1 -- 172.21.15.5:0/1021436993 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ddc158900 msgr2=0x7f3ddc156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:51.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.994+0000 7f3de0ad4640 1 --2- 172.21.15.5:0/1021436993 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ddc158900 0x7f3ddc156f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.994+0000 7f3de0ad4640 1 -- 172.21.15.5:0/1021436993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dc40039b0 msgr2=0x7f3ddc0cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:51.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.994+0000 7f3de0ad4640 1 --2- 172.21.15.5:0/1021436993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dc40039b0 0x7f3ddc0cbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.994+0000 7f3de0ad4640 1 -- 172.21.15.5:0/1021436993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc15bd00 con 0x7f3ddc157440 2023-07-14T12:52:51.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.994+0000 7f3de0ad4640 1 --2- 172.21.15.5:0/1021436993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ddc157440 0x7f3ddc15c3f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc08b5d0 tx=0x7f3dd4007960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:51.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.994+0000 7f3dd8ff9640 1 -- 172.21.15.5:0/1021436993 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd40114f0 con 0x7f3ddc157440 2023-07-14T12:52:51.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.994+0000 7f3dd8ff9640 1 -- 172.21.15.5:0/1021436993 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd4011690 con 0x7f3ddc157440 2023-07-14T12:52:51.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.994+0000 7f3dd8ff9640 1 -- 172.21.15.5:0/1021436993 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4011a40 con 0x7f3ddc157440 2023-07-14T12:52:51.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.994+0000 7f3de2537640 1 -- 172.21.15.5:0/1021436993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ddc1583e0 con 0x7f3ddc157440 2023-07-14T12:52:51.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.994+0000 7f3de2537640 1 -- 172.21.15.5:0/1021436993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ddc162000 con 0x7f3ddc157440 2023-07-14T12:52:51.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.994+0000 7f3de2537640 1 -- 172.21.15.5:0/1021436993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ddc0c9220 con 0x7f3ddc157440 2023-07-14T12:52:51.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.998+0000 7f3dd8ff9640 1 -- 172.21.15.5:0/1021436993 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3dd4011ba0 con 0x7f3ddc157440 2023-07-14T12:52:51.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.998+0000 7f3dd8ff9640 1 --2- 172.21.15.5:0/1021436993 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3dc8066280 0x7f3dc8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:51.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.998+0000 7f3dd8ff9640 1 -- 172.21.15.5:0/1021436993 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3dd4083610 con 0x7f3ddc157440 2023-07-14T12:52:51.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.998+0000 7f3ddbfff640 1 --2- 172.21.15.5:0/1021436993 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3dc8066280 0x7f3dc8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:51.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:50.998+0000 7f3ddbfff640 1 --2- 172.21.15.5:0/1021436993 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3dc8066280 0x7f3dc8068730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0af000 tx=0x7f3dcc0046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:51.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.002+0000 7f3dd8ff9640 1 -- 172.21.15.5:0/1021436993 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3dd4050aa0 con 0x7f3ddc157440 2023-07-14T12:52:51.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.158+0000 7f3de2537640 1 -- 172.21.15.5:0/1021436993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ddc158240 con 0x7f3ddc157440 2023-07-14T12:52:51.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.158+0000 7f3dd8ff9640 1 -- 172.21.15.5:0/1021436993 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18231 (secure 0 0 0) 0x7f3ddc158240 con 0x7f3ddc157440 2023-07-14T12:52:51.185 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:52:51.185 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":23,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:52:48.091483+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:52:44.223082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T12:52:45.469396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:52:51.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.158+0000 7f3de2537640 1 -- 172.21.15.5:0/1021436993 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3dc8066280 msgr2=0x7f3dc8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:51.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.158+0000 7f3de2537640 1 --2- 172.21.15.5:0/1021436993 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3dc8066280 0x7f3dc8068730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0af000 tx=0x7f3dcc0046d0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.158+0000 7f3de2537640 1 -- 172.21.15.5:0/1021436993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ddc157440 msgr2=0x7f3ddc15c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:51.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.162+0000 7f3de2537640 1 --2- 172.21.15.5:0/1021436993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ddc157440 0x7f3ddc15c3f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc08b5d0 tx=0x7f3dd4007960 comp rx=0 tx=0).stop 2023-07-14T12:52:51.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.162+0000 7f3de2537640 1 -- 172.21.15.5:0/1021436993 shutdown_connections 2023-07-14T12:52:51.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.162+0000 7f3de2537640 1 --2- 172.21.15.5:0/1021436993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ddc157440 0x7f3ddc15c3f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.162+0000 7f3de2537640 1 --2- 172.21.15.5:0/1021436993 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ddc158900 0x7f3ddc156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.162+0000 7f3de2537640 1 --2- 172.21.15.5:0/1021436993 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3dc8066280 0x7f3dc8068730 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.162+0000 7f3de2537640 1 --2- 172.21.15.5:0/1021436993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dc40039b0 0x7f3ddc0cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.162+0000 7f3de2537640 1 -- 172.21.15.5:0/1021436993 >> 172.21.15.5:0/1021436993 conn(0x7f3ddc0650b0 msgr2=0x7f3ddc160ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:51.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.162+0000 7f3de2537640 1 -- 172.21.15.5:0/1021436993 shutdown_connections 2023-07-14T12:52:51.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.162+0000 7f3de2537640 1 -- 172.21.15.5:0/1021436993 wait complete. 2023-07-14T12:52:51.206 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-14T12:52:51.206 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T12:52:51.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.322+0000 7f9aac248640 1 Processor -- start 2023-07-14T12:52:51.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.322+0000 7f9aac248640 1 -- start start 2023-07-14T12:52:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.326+0000 7f9aac248640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9aa4158ce0 0x7f9aa4070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.326+0000 7f9aac248640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa40c9730 0x7f9aa40ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.326+0000 7f9aac248640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa40cc700 con 0x7f9aa40c8ad0 2023-07-14T12:52:51.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.326+0000 7f9aac248640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa40b0ff0 con 0x7f9aa4158ce0 2023-07-14T12:52:51.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.326+0000 7f9aac248640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa4070c80 con 0x7f9aa40c9730 2023-07-14T12:52:51.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.326+0000 7f9aa97e3640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9aa40c8ad0 0x7f9aa40c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38826/0 (socket says 172.21.15.5:38826) 2023-07-14T12:52:51.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.326+0000 7f9aa97e3640 1 -- 172.21.15.5:0/1636164025 learned_addr learned my addr 172.21.15.5:0/1636164025 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:51.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.326+0000 7f9aaa7e5640 1 --2- 172.21.15.5:0/1636164025 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa40c9730 0x7f9aa40ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:51.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.326+0000 7f9aa9fe4640 1 --2- 172.21.15.5:0/1636164025 >> v2:172.21.15.154:3300/0 conn(0x7f9aa4158ce0 0x7f9aa4070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:51.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.326+0000 7f9aa8fe2640 1 -- 172.21.15.5:0/1636164025 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1359945321 0 0) 0x7f9aa40cc700 con 0x7f9aa40c8ad0 2023-07-14T12:52:51.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.326+0000 7f9aa8fe2640 1 -- 172.21.15.5:0/1636164025 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a90003530 con 0x7f9aa40c8ad0 2023-07-14T12:52:51.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.326+0000 7f9aaa7e5640 1 -- 172.21.15.5:0/1636164025 >> v2:172.21.15.154:3300/0 conn(0x7f9aa4158ce0 msgr2=0x7f9aa4070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:51.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.326+0000 7f9aaa7e5640 1 --2- 172.21.15.5:0/1636164025 >> v2:172.21.15.154:3300/0 conn(0x7f9aa4158ce0 0x7f9aa4070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.326+0000 7f9aaa7e5640 1 -- 172.21.15.5:0/1636164025 >> v1:172.21.15.5:6789/0 conn(0x7f9aa40c8ad0 legacy=0x7f9aa40c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:51.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.326+0000 7f9aaa7e5640 1 -- 172.21.15.5:0/1636164025 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa40cbdd0 con 0x7f9aa40c9730 2023-07-14T12:52:51.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.330+0000 7f9aaa7e5640 1 --2- 172.21.15.5:0/1636164025 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa40c9730 0x7f9aa40ccb90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c009d90 tx=0x7f9a9c01c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=103310635025f988 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:51.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.330+0000 7f9aa8fe2640 1 -- 172.21.15.5:0/1636164025 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c0a57d0 con 0x7f9aa40c9730 2023-07-14T12:52:51.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.330+0000 7f9aa8fe2640 1 -- 172.21.15.5:0/1636164025 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9c0a5930 con 0x7f9aa40c9730 2023-07-14T12:52:51.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.330+0000 7f9aa8fe2640 1 -- 172.21.15.5:0/1636164025 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c0a5cc0 con 0x7f9aa40c9730 2023-07-14T12:52:51.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.330+0000 7f9aac248640 1 -- 172.21.15.5:0/1636164025 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa40c9730 msgr2=0x7f9aa40ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:51.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.330+0000 7f9aac248640 1 --2- 172.21.15.5:0/1636164025 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa40c9730 0x7f9aa40ccb90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c009d90 tx=0x7f9a9c01c800 comp rx=0 tx=0).stop 2023-07-14T12:52:51.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.330+0000 7f9aac248640 1 -- 172.21.15.5:0/1636164025 shutdown_connections 2023-07-14T12:52:51.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.330+0000 7f9aac248640 1 --2- 172.21.15.5:0/1636164025 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa40c9730 0x7f9aa40ccb90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.330+0000 7f9aac248640 1 --2- 172.21.15.5:0/1636164025 >> v2:172.21.15.154:3300/0 conn(0x7f9aa4158ce0 0x7f9aa4070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.330+0000 7f9aac248640 1 -- 172.21.15.5:0/1636164025 >> 172.21.15.5:0/1636164025 conn(0x7f9aa40afcf0 msgr2=0x7f9aa40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:51.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.330+0000 7f9aac248640 1 -- 172.21.15.5:0/1636164025 shutdown_connections 2023-07-14T12:52:51.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.330+0000 7f9aac248640 1 -- 172.21.15.5:0/1636164025 wait complete. 2023-07-14T12:52:51.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.330+0000 7f9aac248640 1 Processor -- start 2023-07-14T12:52:51.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.334+0000 7f9aac248640 1 -- start start 2023-07-14T12:52:51.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.334+0000 7f9aac248640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa40c8ad0 0x7f9aa40c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:51.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.334+0000 7f9aac248640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9aa40c9730 0x7f9aa414a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:51.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.334+0000 7f9aac248640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9aa4158ce0 0x7f9aa415ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:51.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.334+0000 7f9aac248640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa40c6e30 con 0x7f9aa40c9730 2023-07-14T12:52:51.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.334+0000 7f9aac248640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa40c6590 con 0x7f9aa4158ce0 2023-07-14T12:52:51.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.334+0000 7f9aac248640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa40c6870 con 0x7f9aa40c8ad0 2023-07-14T12:52:51.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.334+0000 7f9aa97e3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9aa40c9730 0x7f9aa414a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:51.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.334+0000 7f9aa97e3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9aa40c9730 0x7f9aa414a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52530/0 (socket says 172.21.15.5:52530) 2023-07-14T12:52:51.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.334+0000 7f9aa97e3640 1 -- 172.21.15.5:0/3641215054 learned_addr learned my addr 172.21.15.5:0/3641215054 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:51.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.334+0000 7f9aa9fe4640 1 --2- 172.21.15.5:0/3641215054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa40c8ad0 0x7f9aa40c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:51.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.334+0000 7f9aaa7e5640 1 --2- 172.21.15.5:0/3641215054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9aa4158ce0 0x7f9aa415ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:51.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.334+0000 7f9aa97e3640 1 -- 172.21.15.5:0/3641215054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa40c8ad0 msgr2=0x7f9aa40c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:51.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.334+0000 7f9aa97e3640 1 --2- 172.21.15.5:0/3641215054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa40c8ad0 0x7f9aa40c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.334+0000 7f9aa97e3640 1 -- 172.21.15.5:0/3641215054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9aa4158ce0 msgr2=0x7f9aa415ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:51.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.334+0000 7f9aa97e3640 1 --2- 172.21.15.5:0/3641215054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9aa4158ce0 0x7f9aa415ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.334+0000 7f9aa97e3640 1 -- 172.21.15.5:0/3641215054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9c009a70 con 0x7f9aa40c9730 2023-07-14T12:52:51.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.334+0000 7f9aaa7e5640 1 --2- 172.21.15.5:0/3641215054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9aa4158ce0 0x7f9aa415ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:52:51.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.334+0000 7f9aa97e3640 1 --2- 172.21.15.5:0/3641215054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9aa40c9730 0x7f9aa414a2d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400c4d0 tx=0x7f9a9400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:51.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.334+0000 7f9a9a7fc640 1 -- 172.21.15.5:0/3641215054 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a94005cf0 con 0x7f9aa40c9730 2023-07-14T12:52:51.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.334+0000 7f9a9a7fc640 1 -- 172.21.15.5:0/3641215054 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a94005e50 con 0x7f9aa40c9730 2023-07-14T12:52:51.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.334+0000 7f9aac248640 1 -- 172.21.15.5:0/3641215054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa40c6b50 con 0x7f9aa40c9730 2023-07-14T12:52:51.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.334+0000 7f9a9a7fc640 1 -- 172.21.15.5:0/3641215054 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a94007270 con 0x7f9aa40c9730 2023-07-14T12:52:51.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.334+0000 7f9aac248640 1 -- 172.21.15.5:0/3641215054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa40c80c0 con 0x7f9aa40c9730 2023-07-14T12:52:51.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.334+0000 7f9aac248640 1 -- 172.21.15.5:0/3641215054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa40ca1a0 con 0x7f9aa40c9730 2023-07-14T12:52:51.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.338+0000 7f9a9a7fc640 1 -- 172.21.15.5:0/3641215054 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9a940073d0 con 0x7f9aa40c9730 2023-07-14T12:52:51.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.338+0000 7f9a9a7fc640 1 --2- 172.21.15.5:0/3641215054 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9a88066280 0x7f9a88068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:51.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.338+0000 7f9a9a7fc640 1 -- 172.21.15.5:0/3641215054 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9a94083230 con 0x7f9aa40c9730 2023-07-14T12:52:51.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.338+0000 7f9aa9fe4640 1 --2- 172.21.15.5:0/3641215054 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9a88066280 0x7f9a88068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:51.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.338+0000 7f9aa9fe4640 1 --2- 172.21.15.5:0/3641215054 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9a88066280 0x7f9a88068730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009a50 tx=0x7f9aa0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:51.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.342+0000 7f9a9a7fc640 1 -- 172.21.15.5:0/3641215054 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9a94050750 con 0x7f9aa40c9730 2023-07-14T12:52:51.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.494+0000 7f9aac248640 1 -- 172.21.15.5:0/3641215054 --> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9aa41590b0 con 0x7f9a88066280 2023-07-14T12:52:51.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.506+0000 7f9a9a7fc640 1 -- 172.21.15.5:0/3641215054 <== mgr.4102 v2:172.21.15.154:6832/2736441655 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286675 (secure 0 0 0) 0x7f9aa00119a0 con 0x7f9a88066280 2023-07-14T12:52:51.532 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:52:51.534 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T12:52:51.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.510+0000 7f9aac248640 1 -- 172.21.15.5:0/3641215054 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9a88066280 msgr2=0x7f9a88068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:51.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.510+0000 7f9aac248640 1 --2- 172.21.15.5:0/3641215054 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9a88066280 0x7f9a88068730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009a50 tx=0x7f9aa0008040 comp rx=0 tx=0).stop 2023-07-14T12:52:51.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.510+0000 7f9aac248640 1 -- 172.21.15.5:0/3641215054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9aa40c9730 msgr2=0x7f9aa414a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:51.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.510+0000 7f9aac248640 1 --2- 172.21.15.5:0/3641215054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9aa40c9730 0x7f9aa414a2d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400c4d0 tx=0x7f9a9400c990 comp rx=0 tx=0).stop 2023-07-14T12:52:51.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.510+0000 7f9aac248640 1 -- 172.21.15.5:0/3641215054 shutdown_connections 2023-07-14T12:52:51.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.510+0000 7f9aac248640 1 --2- 172.21.15.5:0/3641215054 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9a88066280 0x7f9a88068730 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.510+0000 7f9aac248640 1 --2- 172.21.15.5:0/3641215054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9aa4158ce0 0x7f9aa415ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.510+0000 7f9aac248640 1 --2- 172.21.15.5:0/3641215054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9aa40c9730 0x7f9aa414a2d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.510+0000 7f9aac248640 1 --2- 172.21.15.5:0/3641215054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9aa40c8ad0 0x7f9aa40c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.510+0000 7f9aac248640 1 -- 172.21.15.5:0/3641215054 >> 172.21.15.5:0/3641215054 conn(0x7f9aa40afcf0 msgr2=0x7f9aa4156aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:51.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.510+0000 7f9aac248640 1 -- 172.21.15.5:0/3641215054 shutdown_connections 2023-07-14T12:52:51.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.510+0000 7f9aac248640 1 -- 172.21.15.5:0/3641215054 wait complete. 2023-07-14T12:52:51.554 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-14T12:52:49.635279+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":73,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234884,"kb_used_data":2884,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754739836,"statfs":{"total":773094113280,"available":772853592064,"internally_reserved":0,"allocated":2953216,"data_stored":1806626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.572807"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.122983+0000","last_change":"2023-07-14T12:52:47.109113+0000","last_active":"2023-07-14T12:52:47.122983+0000","last_peered":"2023-07-14T12:52:47.122983+0000","last_clean":"2023-07-14T12:52:47.122983+0000","last_became_active":"2023-07-14T12:52:47.107356+0000","last_became_peered":"2023-07-14T12:52:47.107356+0000","last_unstale":"2023-07-14T12:52:47.122983+0000","last_undegraded":"2023-07-14T12:52:47.122983+0000","last_fullsized":"2023-07-14T12:52:47.122983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:53:34.310211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.121021+0000","last_change":"2023-07-14T12:52:47.119687+0000","last_active":"2023-07-14T12:52:47.121021+0000","last_peered":"2023-07-14T12:52:47.121021+0000","last_clean":"2023-07-14T12:52:47.121021+0000","last_became_active":"2023-07-14T12:52:47.119063+0000","last_became_peered":"2023-07-14T12:52:47.119063+0000","last_unstale":"2023-07-14T12:52:47.121021+0000","last_undegraded":"2023-07-14T12:52:47.121021+0000","last_fullsized":"2023-07-14T12:52:47.121021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:39:09.060324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.126512+0000","last_change":"2023-07-14T12:52:47.121019+0000","last_active":"2023-07-14T12:52:47.126512+0000","last_peered":"2023-07-14T12:52:47.126512+0000","last_clean":"2023-07-14T12:52:47.126512+0000","last_became_active":"2023-07-14T12:52:47.120756+0000","last_became_peered":"2023-07-14T12:52:47.120756+0000","last_unstale":"2023-07-14T12:52:47.126512+0000","last_undegraded":"2023-07-14T12:52:47.126512+0000","last_fullsized":"2023-07-14T12:52:47.126512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:30.872502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.116627+0000","last_change":"2023-07-14T12:52:47.114539+0000","last_active":"2023-07-14T12:52:47.116627+0000","last_peered":"2023-07-14T12:52:47.116627+0000","last_clean":"2023-07-14T12:52:47.116627+0000","last_became_active":"2023-07-14T12:52:47.114187+0000","last_became_peered":"2023-07-14T12:52:47.114187+0000","last_unstale":"2023-07-14T12:52:47.116627+0000","last_undegraded":"2023-07-14T12:52:47.116627+0000","last_fullsized":"2023-07-14T12:52:47.116627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:11:05.608818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.114352+0000","last_change":"2023-07-14T12:52:47.111120+0000","last_active":"2023-07-14T12:52:47.114352+0000","last_peered":"2023-07-14T12:52:47.114352+0000","last_clean":"2023-07-14T12:52:47.114352+0000","last_became_active":"2023-07-14T12:52:47.110781+0000","last_became_peered":"2023-07-14T12:52:47.110781+0000","last_unstale":"2023-07-14T12:52:47.114352+0000","last_undegraded":"2023-07-14T12:52:47.114352+0000","last_fullsized":"2023-07-14T12:52:47.114352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:28:08.399324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.121322+0000","last_change":"2023-07-14T12:52:47.111259+0000","last_active":"2023-07-14T12:52:47.121322+0000","last_peered":"2023-07-14T12:52:47.121322+0000","last_clean":"2023-07-14T12:52:47.121322+0000","last_became_active":"2023-07-14T12:52:47.111023+0000","last_became_peered":"2023-07-14T12:52:47.111023+0000","last_unstale":"2023-07-14T12:52:47.121322+0000","last_undegraded":"2023-07-14T12:52:47.121322+0000","last_fullsized":"2023-07-14T12:52:47.121322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:36:08.215135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125518+0000","last_change":"2023-07-14T12:52:47.122189+0000","last_active":"2023-07-14T12:52:47.125518+0000","last_peered":"2023-07-14T12:52:47.125518+0000","last_clean":"2023-07-14T12:52:47.125518+0000","last_became_active":"2023-07-14T12:52:47.121465+0000","last_became_peered":"2023-07-14T12:52:47.121465+0000","last_unstale":"2023-07-14T12:52:47.125518+0000","last_undegraded":"2023-07-14T12:52:47.125518+0000","last_fullsized":"2023-07-14T12:52:47.125518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:39:09.060324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.124976+0000","last_change":"2023-07-14T12:52:47.123614+0000","last_active":"2023-07-14T12:52:47.124976+0000","last_peered":"2023-07-14T12:52:47.124976+0000","last_clean":"2023-07-14T12:52:47.124976+0000","last_became_active":"2023-07-14T12:52:47.123147+0000","last_became_peered":"2023-07-14T12:52:47.123147+0000","last_unstale":"2023-07-14T12:52:47.124976+0000","last_undegraded":"2023-07-14T12:52:47.124976+0000","last_fullsized":"2023-07-14T12:52:47.124976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:36:08.215135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.126677+0000","last_change":"2023-07-14T12:52:47.123993+0000","last_active":"2023-07-14T12:52:47.126677+0000","last_peered":"2023-07-14T12:52:47.126677+0000","last_clean":"2023-07-14T12:52:47.126677+0000","last_became_active":"2023-07-14T12:52:47.123709+0000","last_became_peered":"2023-07-14T12:52:47.123709+0000","last_unstale":"2023-07-14T12:52:47.126677+0000","last_undegraded":"2023-07-14T12:52:47.126677+0000","last_fullsized":"2023-07-14T12:52:47.126677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:05:14.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.118637+0000","last_change":"2023-07-14T12:52:47.112624+0000","last_active":"2023-07-14T12:52:47.118637+0000","last_peered":"2023-07-14T12:52:47.118637+0000","last_clean":"2023-07-14T12:52:47.118637+0000","last_became_active":"2023-07-14T12:52:47.112322+0000","last_became_peered":"2023-07-14T12:52:47.112322+0000","last_unstale":"2023-07-14T12:52:47.118637+0000","last_undegraded":"2023-07-14T12:52:47.118637+0000","last_fullsized":"2023-07-14T12:52:47.118637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:30.872502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125824+0000","last_change":"2023-07-14T12:52:47.118589+0000","last_active":"2023-07-14T12:52:47.125824+0000","last_peered":"2023-07-14T12:52:47.125824+0000","last_clean":"2023-07-14T12:52:47.125824+0000","last_became_active":"2023-07-14T12:52:47.118256+0000","last_became_peered":"2023-07-14T12:52:47.118256+0000","last_unstale":"2023-07-14T12:52:47.125824+0000","last_undegraded":"2023-07-14T12:52:47.125824+0000","last_fullsized":"2023-07-14T12:52:47.125824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:43.338222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125843+0000","last_change":"2023-07-14T12:52:47.118304+0000","last_active":"2023-07-14T12:52:47.125843+0000","last_peered":"2023-07-14T12:52:47.125843+0000","last_clean":"2023-07-14T12:52:47.125843+0000","last_became_active":"2023-07-14T12:52:47.117930+0000","last_became_peered":"2023-07-14T12:52:47.117930+0000","last_unstale":"2023-07-14T12:52:47.125843+0000","last_undegraded":"2023-07-14T12:52:47.125843+0000","last_fullsized":"2023-07-14T12:52:47.125843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:20:31.282979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125434+0000","last_change":"2023-07-14T12:52:47.108380+0000","last_active":"2023-07-14T12:52:47.125434+0000","last_peered":"2023-07-14T12:52:47.125434+0000","last_clean":"2023-07-14T12:52:47.125434+0000","last_became_active":"2023-07-14T12:52:47.107936+0000","last_became_peered":"2023-07-14T12:52:47.107936+0000","last_unstale":"2023-07-14T12:52:47.125434+0000","last_undegraded":"2023-07-14T12:52:47.125434+0000","last_fullsized":"2023-07-14T12:52:47.125434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:05:14.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.118578+0000","last_change":"2023-07-14T12:52:47.111677+0000","last_active":"2023-07-14T12:52:47.118578+0000","last_peered":"2023-07-14T12:52:47.118578+0000","last_clean":"2023-07-14T12:52:47.118578+0000","last_became_active":"2023-07-14T12:52:47.111411+0000","last_became_peered":"2023-07-14T12:52:47.111411+0000","last_unstale":"2023-07-14T12:52:47.118578+0000","last_undegraded":"2023-07-14T12:52:47.118578+0000","last_fullsized":"2023-07-14T12:52:47.118578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:28:08.399324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125538+0000","last_change":"2023-07-14T12:52:47.122345+0000","last_active":"2023-07-14T12:52:47.125538+0000","last_peered":"2023-07-14T12:52:47.125538+0000","last_clean":"2023-07-14T12:52:47.125538+0000","last_became_active":"2023-07-14T12:52:47.121885+0000","last_became_peered":"2023-07-14T12:52:47.121885+0000","last_unstale":"2023-07-14T12:52:47.125538+0000","last_undegraded":"2023-07-14T12:52:47.125538+0000","last_fullsized":"2023-07-14T12:52:47.125538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:08:09.613480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.122659+0000","last_change":"2023-07-14T12:52:47.107126+0000","last_active":"2023-07-14T12:52:47.122659+0000","last_peered":"2023-07-14T12:52:47.122659+0000","last_clean":"2023-07-14T12:52:47.122659+0000","last_became_active":"2023-07-14T12:52:47.106204+0000","last_became_peered":"2023-07-14T12:52:47.106204+0000","last_unstale":"2023-07-14T12:52:47.122659+0000","last_undegraded":"2023-07-14T12:52:47.122659+0000","last_fullsized":"2023-07-14T12:52:47.122659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:21:14.784949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.112586+0000","last_change":"2023-07-14T12:52:47.109761+0000","last_active":"2023-07-14T12:52:47.112586+0000","last_peered":"2023-07-14T12:52:47.112586+0000","last_clean":"2023-07-14T12:52:47.112586+0000","last_became_active":"2023-07-14T12:52:47.109438+0000","last_became_peered":"2023-07-14T12:52:47.109438+0000","last_unstale":"2023-07-14T12:52:47.112586+0000","last_undegraded":"2023-07-14T12:52:47.112586+0000","last_fullsized":"2023-07-14T12:52:47.112586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:21:14.784949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.128126+0000","last_change":"2023-07-14T12:52:47.126985+0000","last_active":"2023-07-14T12:52:47.128126+0000","last_peered":"2023-07-14T12:52:47.128126+0000","last_clean":"2023-07-14T12:52:47.128126+0000","last_became_active":"2023-07-14T12:52:47.126696+0000","last_became_peered":"2023-07-14T12:52:47.126696+0000","last_unstale":"2023-07-14T12:52:47.128126+0000","last_undegraded":"2023-07-14T12:52:47.128126+0000","last_fullsized":"2023-07-14T12:52:47.128126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:03:43.488480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125754+0000","last_change":"2023-07-14T12:52:47.115418+0000","last_active":"2023-07-14T12:52:47.125754+0000","last_peered":"2023-07-14T12:52:47.125754+0000","last_clean":"2023-07-14T12:52:47.125754+0000","last_became_active":"2023-07-14T12:52:47.115115+0000","last_became_peered":"2023-07-14T12:52:47.115115+0000","last_unstale":"2023-07-14T12:52:47.125754+0000","last_undegraded":"2023-07-14T12:52:47.125754+0000","last_fullsized":"2023-07-14T12:52:47.125754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:09:54.636774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125649+0000","last_change":"2023-07-14T12:52:47.116335+0000","last_active":"2023-07-14T12:52:47.125649+0000","last_peered":"2023-07-14T12:52:47.125649+0000","last_clean":"2023-07-14T12:52:47.125649+0000","last_became_active":"2023-07-14T12:52:47.115763+0000","last_became_peered":"2023-07-14T12:52:47.115763+0000","last_unstale":"2023-07-14T12:52:47.125649+0000","last_undegraded":"2023-07-14T12:52:47.125649+0000","last_fullsized":"2023-07-14T12:52:47.125649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:24.288374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.126113+0000","last_change":"2023-07-14T12:52:47.124746+0000","last_active":"2023-07-14T12:52:47.126113+0000","last_peered":"2023-07-14T12:52:47.126113+0000","last_clean":"2023-07-14T12:52:47.126113+0000","last_became_active":"2023-07-14T12:52:47.124450+0000","last_became_peered":"2023-07-14T12:52:47.124450+0000","last_unstale":"2023-07-14T12:52:47.126113+0000","last_undegraded":"2023-07-14T12:52:47.126113+0000","last_fullsized":"2023-07-14T12:52:47.126113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:30:03.280675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.120400+0000","last_change":"2023-07-14T12:52:47.118958+0000","last_active":"2023-07-14T12:52:47.120400+0000","last_peered":"2023-07-14T12:52:47.120400+0000","last_clean":"2023-07-14T12:52:47.120400+0000","last_became_active":"2023-07-14T12:52:47.118640+0000","last_became_peered":"2023-07-14T12:52:47.118640+0000","last_unstale":"2023-07-14T12:52:47.120400+0000","last_undegraded":"2023-07-14T12:52:47.120400+0000","last_fullsized":"2023-07-14T12:52:47.120400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:11:05.608818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.123453+0000","last_change":"2023-07-14T12:52:47.112201+0000","last_active":"2023-07-14T12:52:47.123453+0000","last_peered":"2023-07-14T12:52:47.123453+0000","last_clean":"2023-07-14T12:52:47.123453+0000","last_became_active":"2023-07-14T12:52:47.111873+0000","last_became_peered":"2023-07-14T12:52:47.111873+0000","last_unstale":"2023-07-14T12:52:47.123453+0000","last_undegraded":"2023-07-14T12:52:47.123453+0000","last_fullsized":"2023-07-14T12:52:47.123453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:05:39.967713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.116632+0000","last_change":"2023-07-14T12:52:47.114122+0000","last_active":"2023-07-14T12:52:47.116632+0000","last_peered":"2023-07-14T12:52:47.116632+0000","last_clean":"2023-07-14T12:52:47.116632+0000","last_became_active":"2023-07-14T12:52:47.113796+0000","last_became_peered":"2023-07-14T12:52:47.113796+0000","last_unstale":"2023-07-14T12:52:47.116632+0000","last_undegraded":"2023-07-14T12:52:47.116632+0000","last_fullsized":"2023-07-14T12:52:47.116632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:46.115861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.119496+0000","last_change":"2023-07-14T12:52:47.116443+0000","last_active":"2023-07-14T12:52:47.119496+0000","last_peered":"2023-07-14T12:52:47.119496+0000","last_clean":"2023-07-14T12:52:47.119496+0000","last_became_active":"2023-07-14T12:52:47.116134+0000","last_became_peered":"2023-07-14T12:52:47.116134+0000","last_unstale":"2023-07-14T12:52:47.119496+0000","last_undegraded":"2023-07-14T12:52:47.119496+0000","last_fullsized":"2023-07-14T12:52:47.119496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:43.338222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.128072+0000","last_change":"2023-07-14T12:52:47.126857+0000","last_active":"2023-07-14T12:52:47.128072+0000","last_peered":"2023-07-14T12:52:47.128072+0000","last_clean":"2023-07-14T12:52:47.128072+0000","last_became_active":"2023-07-14T12:52:47.126551+0000","last_became_peered":"2023-07-14T12:52:47.126551+0000","last_unstale":"2023-07-14T12:52:47.128072+0000","last_undegraded":"2023-07-14T12:52:47.128072+0000","last_fullsized":"2023-07-14T12:52:47.128072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:53:34.310211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.120300+0000","last_change":"2023-07-14T12:52:47.116313+0000","last_active":"2023-07-14T12:52:47.120300+0000","last_peered":"2023-07-14T12:52:47.120300+0000","last_clean":"2023-07-14T12:52:47.120300+0000","last_became_active":"2023-07-14T12:52:47.116052+0000","last_became_peered":"2023-07-14T12:52:47.116052+0000","last_unstale":"2023-07-14T12:52:47.120300+0000","last_undegraded":"2023-07-14T12:52:47.120300+0000","last_fullsized":"2023-07-14T12:52:47.120300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:03:43.488480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.121138+0000","last_change":"2023-07-14T12:52:47.113963+0000","last_active":"2023-07-14T12:52:47.121138+0000","last_peered":"2023-07-14T12:52:47.121138+0000","last_clean":"2023-07-14T12:52:47.121138+0000","last_became_active":"2023-07-14T12:52:47.113636+0000","last_became_peered":"2023-07-14T12:52:47.113636+0000","last_unstale":"2023-07-14T12:52:47.121138+0000","last_undegraded":"2023-07-14T12:52:47.121138+0000","last_fullsized":"2023-07-14T12:52:47.121138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:03:43.488480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.124240+0000","last_change":"2023-07-14T12:52:47.114586+0000","last_active":"2023-07-14T12:52:47.124240+0000","last_peered":"2023-07-14T12:52:47.124240+0000","last_clean":"2023-07-14T12:52:47.124240+0000","last_became_active":"2023-07-14T12:52:47.114296+0000","last_became_peered":"2023-07-14T12:52:47.114296+0000","last_unstale":"2023-07-14T12:52:47.124240+0000","last_undegraded":"2023-07-14T12:52:47.124240+0000","last_fullsized":"2023-07-14T12:52:47.124240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:36:08.215135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125821+0000","last_change":"2023-07-14T12:52:47.118226+0000","last_active":"2023-07-14T12:52:47.125821+0000","last_peered":"2023-07-14T12:52:47.125821+0000","last_clean":"2023-07-14T12:52:47.125821+0000","last_became_active":"2023-07-14T12:52:47.117714+0000","last_became_peered":"2023-07-14T12:52:47.117714+0000","last_unstale":"2023-07-14T12:52:47.125821+0000","last_undegraded":"2023-07-14T12:52:47.125821+0000","last_fullsized":"2023-07-14T12:52:47.125821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:09:54.636774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.126434+0000","last_change":"2023-07-14T12:52:47.120308+0000","last_active":"2023-07-14T12:52:47.126434+0000","last_peered":"2023-07-14T12:52:47.126434+0000","last_clean":"2023-07-14T12:52:47.126434+0000","last_became_active":"2023-07-14T12:52:47.119847+0000","last_became_peered":"2023-07-14T12:52:47.119847+0000","last_unstale":"2023-07-14T12:52:47.126434+0000","last_undegraded":"2023-07-14T12:52:47.126434+0000","last_fullsized":"2023-07-14T12:52:47.126434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:52:25.699239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.128039+0000","last_change":"2023-07-14T12:52:47.127275+0000","last_active":"2023-07-14T12:52:47.128039+0000","last_peered":"2023-07-14T12:52:47.128039+0000","last_clean":"2023-07-14T12:52:47.128039+0000","last_became_active":"2023-07-14T12:52:47.126883+0000","last_became_peered":"2023-07-14T12:52:47.126883+0000","last_unstale":"2023-07-14T12:52:47.128039+0000","last_undegraded":"2023-07-14T12:52:47.128039+0000","last_fullsized":"2023-07-14T12:52:47.128039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:05:14.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.126420+0000","last_change":"2023-07-14T12:52:47.121988+0000","last_active":"2023-07-14T12:52:47.126420+0000","last_peered":"2023-07-14T12:52:47.126420+0000","last_clean":"2023-07-14T12:52:47.126420+0000","last_became_active":"2023-07-14T12:52:47.121687+0000","last_became_peered":"2023-07-14T12:52:47.121687+0000","last_unstale":"2023-07-14T12:52:47.126420+0000","last_undegraded":"2023-07-14T12:52:47.126420+0000","last_fullsized":"2023-07-14T12:52:47.126420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:28:08.399324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.440659+0000","last_change":"2023-07-14T12:52:46.094170+0000","last_active":"2023-07-14T12:52:47.440659+0000","last_peered":"2023-07-14T12:52:47.440659+0000","last_clean":"2023-07-14T12:52:47.440659+0000","last_became_active":"2023-07-14T12:52:46.093847+0000","last_became_peered":"2023-07-14T12:52:46.093847+0000","last_unstale":"2023-07-14T12:52:47.440659+0000","last_undegraded":"2023-07-14T12:52:47.440659+0000","last_fullsized":"2023-07-14T12:52:47.440659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:45:21.373943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.120315+0000","last_change":"2023-07-14T12:52:47.117512+0000","last_active":"2023-07-14T12:52:47.120315+0000","last_peered":"2023-07-14T12:52:47.120315+0000","last_clean":"2023-07-14T12:52:47.120315+0000","last_became_active":"2023-07-14T12:52:47.117268+0000","last_became_peered":"2023-07-14T12:52:47.117268+0000","last_unstale":"2023-07-14T12:52:47.120315+0000","last_undegraded":"2023-07-14T12:52:47.120315+0000","last_fullsized":"2023-07-14T12:52:47.120315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:26:00.737284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.107441+0000","last_change":"2023-07-14T12:52:46.086633+0000","last_active":"2023-07-14T12:52:47.107441+0000","last_peered":"2023-07-14T12:52:47.107441+0000","last_clean":"2023-07-14T12:52:47.107441+0000","last_became_active":"2023-07-14T12:52:46.084673+0000","last_became_peered":"2023-07-14T12:52:46.084673+0000","last_unstale":"2023-07-14T12:52:47.107441+0000","last_undegraded":"2023-07-14T12:52:47.107441+0000","last_fullsized":"2023-07-14T12:52:47.107441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:03:42.477374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.114851+0000","last_change":"2023-07-14T12:52:47.111606+0000","last_active":"2023-07-14T12:52:47.114851+0000","last_peered":"2023-07-14T12:52:47.114851+0000","last_clean":"2023-07-14T12:52:47.114851+0000","last_became_active":"2023-07-14T12:52:47.111132+0000","last_became_peered":"2023-07-14T12:52:47.111132+0000","last_unstale":"2023-07-14T12:52:47.114851+0000","last_undegraded":"2023-07-14T12:52:47.114851+0000","last_fullsized":"2023-07-14T12:52:47.114851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:53:34.310211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.105756+0000","last_change":"2023-07-14T12:52:46.094259+0000","last_active":"2023-07-14T12:52:47.105756+0000","last_peered":"2023-07-14T12:52:47.105756+0000","last_clean":"2023-07-14T12:52:47.105756+0000","last_became_active":"2023-07-14T12:52:46.093946+0000","last_became_peered":"2023-07-14T12:52:46.093946+0000","last_unstale":"2023-07-14T12:52:47.105756+0000","last_undegraded":"2023-07-14T12:52:47.105756+0000","last_fullsized":"2023-07-14T12:52:47.105756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:45:16.620577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.123315+0000","last_change":"2023-07-14T12:52:47.109858+0000","last_active":"2023-07-14T12:52:47.123315+0000","last_peered":"2023-07-14T12:52:47.123315+0000","last_clean":"2023-07-14T12:52:47.123315+0000","last_became_active":"2023-07-14T12:52:47.109547+0000","last_became_peered":"2023-07-14T12:52:47.109547+0000","last_unstale":"2023-07-14T12:52:47.123315+0000","last_undegraded":"2023-07-14T12:52:47.123315+0000","last_fullsized":"2023-07-14T12:52:47.123315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:09:54.636774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.437836+0000","last_change":"2023-07-14T12:52:46.083042+0000","last_active":"2023-07-14T12:52:47.437836+0000","last_peered":"2023-07-14T12:52:47.437836+0000","last_clean":"2023-07-14T12:52:47.437836+0000","last_became_active":"2023-07-14T12:52:46.082506+0000","last_became_peered":"2023-07-14T12:52:46.082506+0000","last_unstale":"2023-07-14T12:52:47.437836+0000","last_undegraded":"2023-07-14T12:52:47.437836+0000","last_fullsized":"2023-07-14T12:52:47.437836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:09:53.625668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.434583+0000","last_change":"2023-07-14T12:52:46.088541+0000","last_active":"2023-07-14T12:52:47.434583+0000","last_peered":"2023-07-14T12:52:47.434583+0000","last_clean":"2023-07-14T12:52:47.434583+0000","last_became_active":"2023-07-14T12:52:46.088185+0000","last_became_peered":"2023-07-14T12:52:46.088185+0000","last_unstale":"2023-07-14T12:52:47.434583+0000","last_undegraded":"2023-07-14T12:52:47.434583+0000","last_fullsized":"2023-07-14T12:52:47.434583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:52:24.688133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.120269+0000","last_change":"2023-07-14T12:52:47.115030+0000","last_active":"2023-07-14T12:52:47.120269+0000","last_peered":"2023-07-14T12:52:47.120269+0000","last_clean":"2023-07-14T12:52:47.120269+0000","last_became_active":"2023-07-14T12:52:47.114732+0000","last_became_peered":"2023-07-14T12:52:47.114732+0000","last_unstale":"2023-07-14T12:52:47.120269+0000","last_undegraded":"2023-07-14T12:52:47.120269+0000","last_fullsized":"2023-07-14T12:52:47.120269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:53:34.310211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.439259+0000","last_change":"2023-07-14T12:52:46.089168+0000","last_active":"2023-07-14T12:52:47.439259+0000","last_peered":"2023-07-14T12:52:47.439259+0000","last_clean":"2023-07-14T12:52:47.439259+0000","last_became_active":"2023-07-14T12:52:46.088899+0000","last_became_peered":"2023-07-14T12:52:46.088899+0000","last_unstale":"2023-07-14T12:52:47.439259+0000","last_undegraded":"2023-07-14T12:52:47.439259+0000","last_fullsized":"2023-07-14T12:52:47.439259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:23:36.193943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.121343+0000","last_change":"2023-07-14T12:52:47.113901+0000","last_active":"2023-07-14T12:52:47.121343+0000","last_peered":"2023-07-14T12:52:47.121343+0000","last_clean":"2023-07-14T12:52:47.121343+0000","last_became_active":"2023-07-14T12:52:47.113606+0000","last_became_peered":"2023-07-14T12:52:47.113606+0000","last_unstale":"2023-07-14T12:52:47.121343+0000","last_undegraded":"2023-07-14T12:52:47.121343+0000","last_fullsized":"2023-07-14T12:52:47.121343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:11:05.608818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.439513+0000","last_change":"2023-07-14T12:52:46.091961+0000","last_active":"2023-07-14T12:52:47.439513+0000","last_peered":"2023-07-14T12:52:47.439513+0000","last_clean":"2023-07-14T12:52:47.439513+0000","last_became_active":"2023-07-14T12:52:46.091673+0000","last_became_peered":"2023-07-14T12:52:46.091673+0000","last_unstale":"2023-07-14T12:52:47.439513+0000","last_undegraded":"2023-07-14T12:52:47.439513+0000","last_fullsized":"2023-07-14T12:52:47.439513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:01:36.455280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.122924+0000","last_change":"2023-07-14T12:52:47.120755+0000","last_active":"2023-07-14T12:52:47.122924+0000","last_peered":"2023-07-14T12:52:47.122924+0000","last_clean":"2023-07-14T12:52:47.122924+0000","last_became_active":"2023-07-14T12:52:47.120428+0000","last_became_peered":"2023-07-14T12:52:47.120428+0000","last_unstale":"2023-07-14T12:52:47.122924+0000","last_undegraded":"2023-07-14T12:52:47.122924+0000","last_fullsized":"2023-07-14T12:52:47.122924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:38:13.646177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.105252+0000","last_change":"2023-07-14T12:52:46.081037+0000","last_active":"2023-07-14T12:52:47.105252+0000","last_peered":"2023-07-14T12:52:47.105252+0000","last_clean":"2023-07-14T12:52:47.105252+0000","last_became_active":"2023-07-14T12:52:46.080737+0000","last_became_peered":"2023-07-14T12:52:46.080737+0000","last_unstale":"2023-07-14T12:52:47.105252+0000","last_undegraded":"2023-07-14T12:52:47.105252+0000","last_fullsized":"2023-07-14T12:52:47.105252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:05:38.956607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.122178+0000","last_change":"2023-07-14T12:52:47.120358+0000","last_active":"2023-07-14T12:52:47.122178+0000","last_peered":"2023-07-14T12:52:47.122178+0000","last_clean":"2023-07-14T12:52:47.122178+0000","last_became_active":"2023-07-14T12:52:47.119985+0000","last_became_peered":"2023-07-14T12:52:47.119985+0000","last_unstale":"2023-07-14T12:52:47.122178+0000","last_undegraded":"2023-07-14T12:52:47.122178+0000","last_fullsized":"2023-07-14T12:52:47.122178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:26:00.737284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.439116+0000","last_change":"2023-07-14T12:52:46.085362+0000","last_active":"2023-07-14T12:52:47.439116+0000","last_peered":"2023-07-14T12:52:47.439116+0000","last_clean":"2023-07-14T12:52:47.439116+0000","last_became_active":"2023-07-14T12:52:46.084995+0000","last_became_peered":"2023-07-14T12:52:46.084995+0000","last_unstale":"2023-07-14T12:52:47.439116+0000","last_undegraded":"2023-07-14T12:52:47.439116+0000","last_fullsized":"2023-07-14T12:52:47.439116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:23.277268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125628+0000","last_change":"2023-07-14T12:52:47.116159+0000","last_active":"2023-07-14T12:52:47.125628+0000","last_peered":"2023-07-14T12:52:47.125628+0000","last_clean":"2023-07-14T12:52:47.125628+0000","last_became_active":"2023-07-14T12:52:47.115435+0000","last_became_peered":"2023-07-14T12:52:47.115435+0000","last_unstale":"2023-07-14T12:52:47.125628+0000","last_undegraded":"2023-07-14T12:52:47.125628+0000","last_fullsized":"2023-07-14T12:52:47.125628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:30:07.070537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.109691+0000","last_change":"2023-07-14T12:52:46.093095+0000","last_active":"2023-07-14T12:52:47.109691+0000","last_peered":"2023-07-14T12:52:47.109691+0000","last_clean":"2023-07-14T12:52:47.109691+0000","last_became_active":"2023-07-14T12:52:46.092806+0000","last_became_peered":"2023-07-14T12:52:46.092806+0000","last_unstale":"2023-07-14T12:52:47.109691+0000","last_undegraded":"2023-07-14T12:52:47.109691+0000","last_fullsized":"2023-07-14T12:52:47.109691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:53:33.299105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125710+0000","last_change":"2023-07-14T12:52:47.117743+0000","last_active":"2023-07-14T12:52:47.125710+0000","last_peered":"2023-07-14T12:52:47.125710+0000","last_clean":"2023-07-14T12:52:47.125710+0000","last_became_active":"2023-07-14T12:52:47.117463+0000","last_became_peered":"2023-07-14T12:52:47.117463+0000","last_unstale":"2023-07-14T12:52:47.125710+0000","last_undegraded":"2023-07-14T12:52:47.125710+0000","last_fullsized":"2023-07-14T12:52:47.125710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:26:00.737284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.099503+0000","last_change":"2023-07-14T12:52:46.084899+0000","last_active":"2023-07-14T12:52:47.099503+0000","last_peered":"2023-07-14T12:52:47.099503+0000","last_clean":"2023-07-14T12:52:47.099503+0000","last_became_active":"2023-07-14T12:52:46.084636+0000","last_became_peered":"2023-07-14T12:52:46.084636+0000","last_unstale":"2023-07-14T12:52:47.099503+0000","last_undegraded":"2023-07-14T12:52:47.099503+0000","last_fullsized":"2023-07-14T12:52:47.099503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:52:24.688133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125569+0000","last_change":"2023-07-14T12:52:47.114756+0000","last_active":"2023-07-14T12:52:47.125569+0000","last_peered":"2023-07-14T12:52:47.125569+0000","last_clean":"2023-07-14T12:52:47.125569+0000","last_became_active":"2023-07-14T12:52:47.114480+0000","last_became_peered":"2023-07-14T12:52:47.114480+0000","last_unstale":"2023-07-14T12:52:47.125569+0000","last_undegraded":"2023-07-14T12:52:47.125569+0000","last_fullsized":"2023-07-14T12:52:47.125569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:39:09.060324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.099714+0000","last_change":"2023-07-14T12:52:46.090947+0000","last_active":"2023-07-14T12:52:47.099714+0000","last_peered":"2023-07-14T12:52:47.099714+0000","last_clean":"2023-07-14T12:52:47.099714+0000","last_became_active":"2023-07-14T12:52:46.090670+0000","last_became_peered":"2023-07-14T12:52:46.090670+0000","last_unstale":"2023-07-14T12:52:47.099714+0000","last_undegraded":"2023-07-14T12:52:47.099714+0000","last_fullsized":"2023-07-14T12:52:47.099714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:53:33.299105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.126201+0000","last_change":"2023-07-14T12:52:47.124181+0000","last_active":"2023-07-14T12:52:47.126201+0000","last_peered":"2023-07-14T12:52:47.126201+0000","last_clean":"2023-07-14T12:52:47.126201+0000","last_became_active":"2023-07-14T12:52:47.123815+0000","last_became_peered":"2023-07-14T12:52:47.123815+0000","last_unstale":"2023-07-14T12:52:47.126201+0000","last_undegraded":"2023-07-14T12:52:47.126201+0000","last_fullsized":"2023-07-14T12:52:47.126201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:26:00.737284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.108033+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T12:52:47.108033+0000","last_peered":"2023-07-14T12:52:47.108033+0000","last_clean":"2023-07-14T12:52:47.108033+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T12:52:47.108033+0000","last_undegraded":"2023-07-14T12:52:47.108033+0000","last_fullsized":"2023-07-14T12:52:47.108033+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:22.197747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.105551+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T12:52:47.105551+0000","last_peered":"2023-07-14T12:52:47.105551+0000","last_clean":"2023-07-14T12:52:47.105551+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T12:52:47.105551+0000","last_undegraded":"2023-07-14T12:52:47.105551+0000","last_fullsized":"2023-07-14T12:52:47.105551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:23:31.160628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.101570+0000","last_change":"2023-07-14T12:52:46.083051+0000","last_active":"2023-07-14T12:52:47.101570+0000","last_peered":"2023-07-14T12:52:47.101570+0000","last_clean":"2023-07-14T12:52:47.101570+0000","last_became_active":"2023-07-14T12:52:46.082304+0000","last_became_peered":"2023-07-14T12:52:46.082304+0000","last_unstale":"2023-07-14T12:52:47.101570+0000","last_undegraded":"2023-07-14T12:52:47.101570+0000","last_fullsized":"2023-07-14T12:52:47.101570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:42.327116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.123996+0000","last_change":"2023-07-14T12:52:47.122248+0000","last_active":"2023-07-14T12:52:47.123996+0000","last_peered":"2023-07-14T12:52:47.123996+0000","last_clean":"2023-07-14T12:52:47.123996+0000","last_became_active":"2023-07-14T12:52:47.121773+0000","last_became_peered":"2023-07-14T12:52:47.121773+0000","last_unstale":"2023-07-14T12:52:47.123996+0000","last_undegraded":"2023-07-14T12:52:47.123996+0000","last_fullsized":"2023-07-14T12:52:47.123996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:21:14.784949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.105592+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T12:52:47.105592+0000","last_peered":"2023-07-14T12:52:47.105592+0000","last_clean":"2023-07-14T12:52:47.105592+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T12:52:47.105592+0000","last_undegraded":"2023-07-14T12:52:47.105592+0000","last_fullsized":"2023-07-14T12:52:47.105592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:37:53.659671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.103678+0000","last_change":"2023-07-14T12:52:46.093346+0000","last_active":"2023-07-14T12:52:47.103678+0000","last_peered":"2023-07-14T12:52:47.103678+0000","last_clean":"2023-07-14T12:52:47.103678+0000","last_became_active":"2023-07-14T12:52:46.093008+0000","last_became_peered":"2023-07-14T12:52:46.093008+0000","last_unstale":"2023-07-14T12:52:47.103678+0000","last_undegraded":"2023-07-14T12:52:47.103678+0000","last_fullsized":"2023-07-14T12:52:47.103678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:36:07.204029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.121345+0000","last_change":"2023-07-14T12:52:47.120008+0000","last_active":"2023-07-14T12:52:47.121345+0000","last_peered":"2023-07-14T12:52:47.121345+0000","last_clean":"2023-07-14T12:52:47.121345+0000","last_became_active":"2023-07-14T12:52:47.119629+0000","last_became_peered":"2023-07-14T12:52:47.119629+0000","last_unstale":"2023-07-14T12:52:47.121345+0000","last_undegraded":"2023-07-14T12:52:47.121345+0000","last_fullsized":"2023-07-14T12:52:47.121345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:20:31.282979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.094001+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T12:52:47.094001+0000","last_peered":"2023-07-14T12:52:47.094001+0000","last_clean":"2023-07-14T12:52:47.094001+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T12:52:47.094001+0000","last_undegraded":"2023-07-14T12:52:47.094001+0000","last_fullsized":"2023-07-14T12:52:47.094001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:21:08.740527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.099466+0000","last_change":"2023-07-14T12:52:46.082644+0000","last_active":"2023-07-14T12:52:47.099466+0000","last_peered":"2023-07-14T12:52:47.099466+0000","last_clean":"2023-07-14T12:52:47.099466+0000","last_became_active":"2023-07-14T12:52:46.082010+0000","last_became_peered":"2023-07-14T12:52:46.082010+0000","last_unstale":"2023-07-14T12:52:47.099466+0000","last_undegraded":"2023-07-14T12:52:47.099466+0000","last_fullsized":"2023-07-14T12:52:47.099466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:29.861396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.118914+0000","last_change":"2023-07-14T12:52:47.112236+0000","last_active":"2023-07-14T12:52:47.118914+0000","last_peered":"2023-07-14T12:52:47.118914+0000","last_clean":"2023-07-14T12:52:47.118914+0000","last_became_active":"2023-07-14T12:52:47.111932+0000","last_became_peered":"2023-07-14T12:52:47.111932+0000","last_unstale":"2023-07-14T12:52:47.118914+0000","last_undegraded":"2023-07-14T12:52:47.118914+0000","last_fullsized":"2023-07-14T12:52:47.118914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:36:08.215135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.102372+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T12:52:47.102372+0000","last_peered":"2023-07-14T12:52:47.102372+0000","last_clean":"2023-07-14T12:52:47.102372+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T12:52:47.102372+0000","last_undegraded":"2023-07-14T12:52:47.102372+0000","last_fullsized":"2023-07-14T12:52:47.102372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:30:01.026115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.100153+0000","last_change":"2023-07-14T12:52:46.093820+0000","last_active":"2023-07-14T12:52:47.100153+0000","last_peered":"2023-07-14T12:52:47.100153+0000","last_clean":"2023-07-14T12:52:47.100153+0000","last_became_active":"2023-07-14T12:52:46.093558+0000","last_became_peered":"2023-07-14T12:52:46.093558+0000","last_unstale":"2023-07-14T12:52:47.100153+0000","last_undegraded":"2023-07-14T12:52:47.100153+0000","last_fullsized":"2023-07-14T12:52:47.100153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:23:36.193943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.128687+0000","last_change":"2023-07-14T12:52:47.127415+0000","last_active":"2023-07-14T12:52:47.128687+0000","last_peered":"2023-07-14T12:52:47.128687+0000","last_clean":"2023-07-14T12:52:47.128687+0000","last_became_active":"2023-07-14T12:52:47.127167+0000","last_became_peered":"2023-07-14T12:52:47.127167+0000","last_unstale":"2023-07-14T12:52:47.128687+0000","last_undegraded":"2023-07-14T12:52:47.128687+0000","last_fullsized":"2023-07-14T12:52:47.128687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:24.288374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.104136+0000","last_change":"2023-07-14T12:52:46.090967+0000","last_active":"2023-07-14T12:52:47.104136+0000","last_peered":"2023-07-14T12:52:47.104136+0000","last_clean":"2023-07-14T12:52:47.104136+0000","last_became_active":"2023-07-14T12:52:46.087916+0000","last_became_peered":"2023-07-14T12:52:46.087916+0000","last_unstale":"2023-07-14T12:52:47.104136+0000","last_undegraded":"2023-07-14T12:52:47.104136+0000","last_fullsized":"2023-07-14T12:52:47.104136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:42.327116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.099839+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T12:52:47.099839+0000","last_peered":"2023-07-14T12:52:47.099839+0000","last_clean":"2023-07-14T12:52:47.099839+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T12:52:47.099839+0000","last_undegraded":"2023-07-14T12:52:47.099839+0000","last_fullsized":"2023-07-14T12:52:47.099839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:52:19.654817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.119159+0000","last_change":"2023-07-14T12:52:47.112617+0000","last_active":"2023-07-14T12:52:47.119159+0000","last_peered":"2023-07-14T12:52:47.119159+0000","last_clean":"2023-07-14T12:52:47.119159+0000","last_became_active":"2023-07-14T12:52:47.112317+0000","last_became_peered":"2023-07-14T12:52:47.112317+0000","last_unstale":"2023-07-14T12:52:47.119159+0000","last_undegraded":"2023-07-14T12:52:47.119159+0000","last_fullsized":"2023-07-14T12:52:47.119159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:05:39.967713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.099750+0000","last_change":"2023-07-14T12:52:46.082409+0000","last_active":"2023-07-14T12:52:47.099750+0000","last_peered":"2023-07-14T12:52:47.099750+0000","last_clean":"2023-07-14T12:52:47.099750+0000","last_became_active":"2023-07-14T12:52:46.082027+0000","last_became_peered":"2023-07-14T12:52:46.082027+0000","last_unstale":"2023-07-14T12:52:47.099750+0000","last_undegraded":"2023-07-14T12:52:47.099750+0000","last_fullsized":"2023-07-14T12:52:47.099750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:39:08.049218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.104180+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T12:52:47.104180+0000","last_peered":"2023-07-14T12:52:47.104180+0000","last_clean":"2023-07-14T12:52:47.104180+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T12:52:47.104180+0000","last_undegraded":"2023-07-14T12:52:47.104180+0000","last_fullsized":"2023-07-14T12:52:47.104180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:50:50.611379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.120504+0000","last_change":"2023-07-14T12:52:47.118665+0000","last_active":"2023-07-14T12:52:47.120504+0000","last_peered":"2023-07-14T12:52:47.120504+0000","last_clean":"2023-07-14T12:52:47.120504+0000","last_became_active":"2023-07-14T12:52:47.118454+0000","last_became_peered":"2023-07-14T12:52:47.118454+0000","last_unstale":"2023-07-14T12:52:47.120504+0000","last_undegraded":"2023-07-14T12:52:47.120504+0000","last_fullsized":"2023-07-14T12:52:47.120504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:30:07.070537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.439673+0000","last_change":"2023-07-14T12:52:46.090135+0000","last_active":"2023-07-14T12:52:47.439673+0000","last_peered":"2023-07-14T12:52:47.439673+0000","last_clean":"2023-07-14T12:52:47.439673+0000","last_became_active":"2023-07-14T12:52:46.089807+0000","last_became_peered":"2023-07-14T12:52:46.089807+0000","last_unstale":"2023-07-14T12:52:47.439673+0000","last_undegraded":"2023-07-14T12:52:47.439673+0000","last_fullsized":"2023-07-14T12:52:47.439673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:25:59.726178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.098518+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T12:52:47.098518+0000","last_peered":"2023-07-14T12:52:47.098518+0000","last_clean":"2023-07-14T12:52:47.098518+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T12:52:47.098518+0000","last_undegraded":"2023-07-14T12:52:47.098518+0000","last_fullsized":"2023-07-14T12:52:47.098518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:30:01.026115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.123587+0000","last_change":"2023-07-14T12:52:47.114917+0000","last_active":"2023-07-14T12:52:47.123587+0000","last_peered":"2023-07-14T12:52:47.123587+0000","last_clean":"2023-07-14T12:52:47.123587+0000","last_became_active":"2023-07-14T12:52:47.114437+0000","last_became_peered":"2023-07-14T12:52:47.114437+0000","last_unstale":"2023-07-14T12:52:47.123587+0000","last_undegraded":"2023-07-14T12:52:47.123587+0000","last_fullsized":"2023-07-14T12:52:47.123587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:05:14.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.109223+0000","last_change":"2023-07-14T12:52:46.089258+0000","last_active":"2023-07-14T12:52:47.109223+0000","last_peered":"2023-07-14T12:52:47.109223+0000","last_clean":"2023-07-14T12:52:47.109223+0000","last_became_active":"2023-07-14T12:52:46.088621+0000","last_became_peered":"2023-07-14T12:52:46.088621+0000","last_unstale":"2023-07-14T12:52:47.109223+0000","last_undegraded":"2023-07-14T12:52:47.109223+0000","last_fullsized":"2023-07-14T12:52:47.109223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:29.861396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.108501+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T12:52:47.108501+0000","last_peered":"2023-07-14T12:52:47.108501+0000","last_clean":"2023-07-14T12:52:47.108501+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T12:52:47.108501+0000","last_undegraded":"2023-07-14T12:52:47.108501+0000","last_fullsized":"2023-07-14T12:52:47.108501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:20:25.238557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.121325+0000","last_change":"2023-07-14T12:52:47.108704+0000","last_active":"2023-07-14T12:52:47.121325+0000","last_peered":"2023-07-14T12:52:47.121325+0000","last_clean":"2023-07-14T12:52:47.121325+0000","last_became_active":"2023-07-14T12:52:47.108394+0000","last_became_peered":"2023-07-14T12:52:47.108394+0000","last_unstale":"2023-07-14T12:52:47.121325+0000","last_undegraded":"2023-07-14T12:52:47.121325+0000","last_fullsized":"2023-07-14T12:52:47.121325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:38:13.646177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125660+0000","last_change":"2023-07-14T12:52:47.117094+0000","last_active":"2023-07-14T12:52:47.125660+0000","last_peered":"2023-07-14T12:52:47.125660+0000","last_clean":"2023-07-14T12:52:47.125660+0000","last_became_active":"2023-07-14T12:52:47.116803+0000","last_became_peered":"2023-07-14T12:52:47.116803+0000","last_unstale":"2023-07-14T12:52:47.125660+0000","last_undegraded":"2023-07-14T12:52:47.125660+0000","last_fullsized":"2023-07-14T12:52:47.125660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:20:31.282979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.442759+0000","last_change":"2023-07-14T12:52:46.084583+0000","last_active":"2023-07-14T12:52:47.442759+0000","last_peered":"2023-07-14T12:52:47.442759+0000","last_clean":"2023-07-14T12:52:47.442759+0000","last_became_active":"2023-07-14T12:52:46.083903+0000","last_became_peered":"2023-07-14T12:52:46.083903+0000","last_unstale":"2023-07-14T12:52:47.442759+0000","last_undegraded":"2023-07-14T12:52:47.442759+0000","last_fullsized":"2023-07-14T12:52:47.442759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:01:36.455280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.120266+0000","last_change":"2023-07-14T12:52:47.117195+0000","last_active":"2023-07-14T12:52:47.120266+0000","last_peered":"2023-07-14T12:52:47.120266+0000","last_clean":"2023-07-14T12:52:47.120266+0000","last_became_active":"2023-07-14T12:52:47.116928+0000","last_became_peered":"2023-07-14T12:52:47.116928+0000","last_unstale":"2023-07-14T12:52:47.120266+0000","last_undegraded":"2023-07-14T12:52:47.120266+0000","last_fullsized":"2023-07-14T12:52:47.120266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:23:37.205050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.437244+0000","last_change":"2023-07-14T12:52:46.094565+0000","last_active":"2023-07-14T12:52:47.437244+0000","last_peered":"2023-07-14T12:52:47.437244+0000","last_clean":"2023-07-14T12:52:47.437244+0000","last_became_active":"2023-07-14T12:52:46.094318+0000","last_became_peered":"2023-07-14T12:52:46.094318+0000","last_unstale":"2023-07-14T12:52:47.437244+0000","last_undegraded":"2023-07-14T12:52:47.437244+0000","last_fullsized":"2023-07-14T12:52:47.437244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:05:38.956607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.107292+0000","last_change":"2023-07-14T12:52:46.086205+0000","last_active":"2023-07-14T12:52:47.107292+0000","last_peered":"2023-07-14T12:52:47.107292+0000","last_clean":"2023-07-14T12:52:47.107292+0000","last_became_active":"2023-07-14T12:52:46.085742+0000","last_became_peered":"2023-07-14T12:52:46.085742+0000","last_unstale":"2023-07-14T12:52:47.107292+0000","last_undegraded":"2023-07-14T12:52:47.107292+0000","last_fullsized":"2023-07-14T12:52:47.107292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:01:36.455280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.124123+0000","last_change":"2023-07-14T12:52:47.114145+0000","last_active":"2023-07-14T12:52:47.124123+0000","last_peered":"2023-07-14T12:52:47.124123+0000","last_clean":"2023-07-14T12:52:47.124123+0000","last_became_active":"2023-07-14T12:52:47.113888+0000","last_became_peered":"2023-07-14T12:52:47.113888+0000","last_unstale":"2023-07-14T12:52:47.124123+0000","last_undegraded":"2023-07-14T12:52:47.124123+0000","last_fullsized":"2023-07-14T12:52:47.124123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:39:09.060324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.109176+0000","last_change":"2023-07-14T12:52:46.088585+0000","last_active":"2023-07-14T12:52:47.109176+0000","last_peered":"2023-07-14T12:52:47.109176+0000","last_clean":"2023-07-14T12:52:47.109176+0000","last_became_active":"2023-07-14T12:52:46.088263+0000","last_became_peered":"2023-07-14T12:52:46.088263+0000","last_unstale":"2023-07-14T12:52:47.109176+0000","last_undegraded":"2023-07-14T12:52:47.109176+0000","last_fullsized":"2023-07-14T12:52:47.109176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:42.327116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.126450+0000","last_change":"2023-07-14T12:52:47.119037+0000","last_active":"2023-07-14T12:52:47.126450+0000","last_peered":"2023-07-14T12:52:47.126450+0000","last_clean":"2023-07-14T12:52:47.126450+0000","last_became_active":"2023-07-14T12:52:47.118770+0000","last_became_peered":"2023-07-14T12:52:47.118770+0000","last_unstale":"2023-07-14T12:52:47.126450+0000","last_undegraded":"2023-07-14T12:52:47.126450+0000","last_fullsized":"2023-07-14T12:52:47.126450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:20:31.282979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.115329+0000","last_change":"2023-07-14T12:52:47.112620+0000","last_active":"2023-07-14T12:52:47.115329+0000","last_peered":"2023-07-14T12:52:47.115329+0000","last_clean":"2023-07-14T12:52:47.115329+0000","last_became_active":"2023-07-14T12:52:47.112372+0000","last_became_peered":"2023-07-14T12:52:47.112372+0000","last_unstale":"2023-07-14T12:52:47.115329+0000","last_undegraded":"2023-07-14T12:52:47.115329+0000","last_fullsized":"2023-07-14T12:52:47.115329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:02:02.692874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.099683+0000","last_change":"2023-07-14T12:52:46.086638+0000","last_active":"2023-07-14T12:52:47.099683+0000","last_peered":"2023-07-14T12:52:47.099683+0000","last_clean":"2023-07-14T12:52:47.099683+0000","last_became_active":"2023-07-14T12:52:46.085797+0000","last_became_peered":"2023-07-14T12:52:46.085797+0000","last_unstale":"2023-07-14T12:52:47.099683+0000","last_undegraded":"2023-07-14T12:52:47.099683+0000","last_fullsized":"2023-07-14T12:52:47.099683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:11:04.597711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.119967+0000","last_change":"2023-07-14T12:52:47.114763+0000","last_active":"2023-07-14T12:52:47.119967+0000","last_peered":"2023-07-14T12:52:47.119967+0000","last_clean":"2023-07-14T12:52:47.119967+0000","last_became_active":"2023-07-14T12:52:47.114421+0000","last_became_peered":"2023-07-14T12:52:47.114421+0000","last_unstale":"2023-07-14T12:52:47.119967+0000","last_undegraded":"2023-07-14T12:52:47.119967+0000","last_fullsized":"2023-07-14T12:52:47.119967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:09:54.636774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.098550+0000","last_change":"2023-07-14T12:52:46.087077+0000","last_active":"2023-07-14T12:52:47.098550+0000","last_peered":"2023-07-14T12:52:47.098550+0000","last_clean":"2023-07-14T12:52:47.098550+0000","last_became_active":"2023-07-14T12:52:46.086797+0000","last_became_peered":"2023-07-14T12:52:46.086797+0000","last_unstale":"2023-07-14T12:52:47.098550+0000","last_undegraded":"2023-07-14T12:52:47.098550+0000","last_fullsized":"2023-07-14T12:52:47.098550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:28:07.388218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.126469+0000","last_change":"2023-07-14T12:52:47.118332+0000","last_active":"2023-07-14T12:52:47.126469+0000","last_peered":"2023-07-14T12:52:47.126469+0000","last_clean":"2023-07-14T12:52:47.126469+0000","last_became_active":"2023-07-14T12:52:47.118046+0000","last_became_peered":"2023-07-14T12:52:47.118046+0000","last_unstale":"2023-07-14T12:52:47.126469+0000","last_undegraded":"2023-07-14T12:52:47.126469+0000","last_fullsized":"2023-07-14T12:52:47.126469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:03:43.488480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.440448+0000","last_change":"2023-07-14T12:52:46.090684+0000","last_active":"2023-07-14T12:52:47.440448+0000","last_peered":"2023-07-14T12:52:47.440448+0000","last_clean":"2023-07-14T12:52:47.440448+0000","last_became_active":"2023-07-14T12:52:46.090365+0000","last_became_peered":"2023-07-14T12:52:46.090365+0000","last_unstale":"2023-07-14T12:52:47.440448+0000","last_undegraded":"2023-07-14T12:52:47.440448+0000","last_fullsized":"2023-07-14T12:52:47.440448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:05:38.956607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125628+0000","last_change":"2023-07-14T12:52:47.115150+0000","last_active":"2023-07-14T12:52:47.125628+0000","last_peered":"2023-07-14T12:52:47.125628+0000","last_clean":"2023-07-14T12:52:47.125628+0000","last_became_active":"2023-07-14T12:52:47.114705+0000","last_became_peered":"2023-07-14T12:52:47.114705+0000","last_unstale":"2023-07-14T12:52:47.125628+0000","last_undegraded":"2023-07-14T12:52:47.125628+0000","last_fullsized":"2023-07-14T12:52:47.125628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:11:05.608818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.440051+0000","last_change":"2023-07-14T12:52:46.089673+0000","last_active":"2023-07-14T12:52:47.440051+0000","last_peered":"2023-07-14T12:52:47.440051+0000","last_clean":"2023-07-14T12:52:47.440051+0000","last_became_active":"2023-07-14T12:52:46.088813+0000","last_became_peered":"2023-07-14T12:52:46.088813+0000","last_unstale":"2023-07-14T12:52:47.440051+0000","last_undegraded":"2023-07-14T12:52:47.440051+0000","last_fullsized":"2023-07-14T12:52:47.440051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:39:08.049218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.122620+0000","last_change":"2023-07-14T12:52:47.110872+0000","last_active":"2023-07-14T12:52:47.122620+0000","last_peered":"2023-07-14T12:52:47.122620+0000","last_clean":"2023-07-14T12:52:47.122620+0000","last_became_active":"2023-07-14T12:52:47.110526+0000","last_became_peered":"2023-07-14T12:52:47.110526+0000","last_unstale":"2023-07-14T12:52:47.122620+0000","last_undegraded":"2023-07-14T12:52:47.122620+0000","last_fullsized":"2023-07-14T12:52:47.122620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:53:34.310211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.440804+0000","last_change":"2023-07-14T12:52:46.090553+0000","last_active":"2023-07-14T12:52:47.440804+0000","last_peered":"2023-07-14T12:52:47.440804+0000","last_clean":"2023-07-14T12:52:47.440804+0000","last_became_active":"2023-07-14T12:52:46.090136+0000","last_became_peered":"2023-07-14T12:52:46.090136+0000","last_unstale":"2023-07-14T12:52:47.440804+0000","last_undegraded":"2023-07-14T12:52:47.440804+0000","last_fullsized":"2023-07-14T12:52:47.440804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:52:24.688133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125801+0000","last_change":"2023-07-14T12:52:47.118033+0000","last_active":"2023-07-14T12:52:47.125801+0000","last_peered":"2023-07-14T12:52:47.125801+0000","last_clean":"2023-07-14T12:52:47.125801+0000","last_became_active":"2023-07-14T12:52:47.117334+0000","last_became_peered":"2023-07-14T12:52:47.117334+0000","last_unstale":"2023-07-14T12:52:47.125801+0000","last_undegraded":"2023-07-14T12:52:47.125801+0000","last_fullsized":"2023-07-14T12:52:47.125801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:28:08.399324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.433426+0000","last_change":"2023-07-14T12:52:46.090568+0000","last_active":"2023-07-14T12:52:47.433426+0000","last_peered":"2023-07-14T12:52:47.433426+0000","last_clean":"2023-07-14T12:52:47.433426+0000","last_became_active":"2023-07-14T12:52:46.087626+0000","last_became_peered":"2023-07-14T12:52:46.087626+0000","last_unstale":"2023-07-14T12:52:47.433426+0000","last_undegraded":"2023-07-14T12:52:47.433426+0000","last_fullsized":"2023-07-14T12:52:47.433426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:23.277268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.128079+0000","last_change":"2023-07-14T12:52:47.126294+0000","last_active":"2023-07-14T12:52:47.128079+0000","last_peered":"2023-07-14T12:52:47.128079+0000","last_clean":"2023-07-14T12:52:47.128079+0000","last_became_active":"2023-07-14T12:52:47.125928+0000","last_became_peered":"2023-07-14T12:52:47.125928+0000","last_unstale":"2023-07-14T12:52:47.128079+0000","last_undegraded":"2023-07-14T12:52:47.128079+0000","last_fullsized":"2023-07-14T12:52:47.128079+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:30.872502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.439285+0000","last_change":"2023-07-14T12:52:46.089467+0000","last_active":"2023-07-14T12:52:47.439285+0000","last_peered":"2023-07-14T12:52:47.439285+0000","last_clean":"2023-07-14T12:52:47.439285+0000","last_became_active":"2023-07-14T12:52:46.087179+0000","last_became_peered":"2023-07-14T12:52:46.087179+0000","last_unstale":"2023-07-14T12:52:47.439285+0000","last_undegraded":"2023-07-14T12:52:47.439285+0000","last_fullsized":"2023-07-14T12:52:47.439285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:30:06.059431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125845+0000","last_change":"2023-07-14T12:52:47.118229+0000","last_active":"2023-07-14T12:52:47.125845+0000","last_peered":"2023-07-14T12:52:47.125845+0000","last_clean":"2023-07-14T12:52:47.125845+0000","last_became_active":"2023-07-14T12:52:47.117903+0000","last_became_peered":"2023-07-14T12:52:47.117903+0000","last_unstale":"2023-07-14T12:52:47.125845+0000","last_undegraded":"2023-07-14T12:52:47.125845+0000","last_fullsized":"2023-07-14T12:52:47.125845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:05:14.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.439459+0000","last_change":"2023-07-14T12:52:46.089959+0000","last_active":"2023-07-14T12:52:47.439459+0000","last_peered":"2023-07-14T12:52:47.439459+0000","last_clean":"2023-07-14T12:52:47.439459+0000","last_became_active":"2023-07-14T12:52:46.089119+0000","last_became_peered":"2023-07-14T12:52:46.089119+0000","last_unstale":"2023-07-14T12:52:47.439459+0000","last_undegraded":"2023-07-14T12:52:47.439459+0000","last_fullsized":"2023-07-14T12:52:47.439459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:23.277268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":666186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":75818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31260,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340580,"statfs":{"total":96636764160,"available":96604753920,"internally_reserved":0,"allocated":217088,"data_stored":75818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31256,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340584,"statfs":{"total":96636764160,"available":96604758016,"internally_reserved":0,"allocated":212992,"data_stored":74799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31272,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340568,"statfs":{"total":96636764160,"available":96604741632,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":665167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T12:52:51.562 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T12:52:51.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.714+0000 7f447d311640 1 Processor -- start 2023-07-14T12:52:51.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.714+0000 7f447d311640 1 -- start start 2023-07-14T12:52:51.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.718+0000 7f447d311640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f44780d06b0 0x7f44780b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:51.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.718+0000 7f447d311640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4478145430 0x7f44780b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:51.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.718+0000 7f447d311640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44780b2410 con 0x7f44780b1f70 2023-07-14T12:52:51.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.718+0000 7f447d311640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44780b26f0 con 0x7f44780d06b0 2023-07-14T12:52:51.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.718+0000 7f447d311640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44780b29d0 con 0x7f4478145430 2023-07-14T12:52:51.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.718+0000 7f4476ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f44780d06b0 0x7f44780b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:51.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.718+0000 7f4476ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f44780d06b0 0x7f44780b1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52532/0 (socket says 172.21.15.5:52532) 2023-07-14T12:52:51.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.718+0000 7f4476ffd640 1 -- 172.21.15.5:0/2723039326 learned_addr learned my addr 172.21.15.5:0/2723039326 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:51.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.718+0000 7f446ffff640 1 --2- 172.21.15.5:0/2723039326 >> v2:172.21.15.154:3300/0 conn(0x7f4478145430 0x7f44780b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:51.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.718+0000 7f4476ffd640 1 -- 172.21.15.5:0/2723039326 >> v2:172.21.15.154:3300/0 conn(0x7f4478145430 msgr2=0x7f44780b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:51.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.718+0000 7f4476ffd640 1 --2- 172.21.15.5:0/2723039326 >> v2:172.21.15.154:3300/0 conn(0x7f4478145430 0x7f44780b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.718+0000 7f4476ffd640 1 -- 172.21.15.5:0/2723039326 >> v1:172.21.15.154:6789/0 conn(0x7f44780b1f70 legacy=0x7f44780d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:51.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.718+0000 7f4476ffd640 1 -- 172.21.15.5:0/2723039326 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44780b2cb0 con 0x7f44780d06b0 2023-07-14T12:52:51.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.722+0000 7f4476ffd640 1 --2- 172.21.15.5:0/2723039326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44780d06b0 0x7f44780b1a30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f447808b230 tx=0x7f446801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24cf9a2fdfe98949 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:51.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.722+0000 7f44767fc640 1 -- 172.21.15.5:0/2723039326 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44680aa610 con 0x7f44780d06b0 2023-07-14T12:52:51.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.722+0000 7f44767fc640 1 -- 172.21.15.5:0/2723039326 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44680a6040 con 0x7f44780d06b0 2023-07-14T12:52:51.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.722+0000 7f44767fc640 1 -- 172.21.15.5:0/2723039326 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44680aa990 con 0x7f44780d06b0 2023-07-14T12:52:51.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.722+0000 7f447d311640 1 -- 172.21.15.5:0/2723039326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44780d06b0 msgr2=0x7f44780b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:51.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.722+0000 7f447d311640 1 --2- 172.21.15.5:0/2723039326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44780d06b0 0x7f44780b1a30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f447808b230 tx=0x7f446801c490 comp rx=0 tx=0).stop 2023-07-14T12:52:51.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.722+0000 7f447d311640 1 -- 172.21.15.5:0/2723039326 shutdown_connections 2023-07-14T12:52:51.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.722+0000 7f447d311640 1 --2- 172.21.15.5:0/2723039326 >> v2:172.21.15.154:3300/0 conn(0x7f4478145430 0x7f44780b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.722+0000 7f447d311640 1 --2- 172.21.15.5:0/2723039326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44780d06b0 0x7f44780b1a30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.722+0000 7f447d311640 1 -- 172.21.15.5:0/2723039326 >> 172.21.15.5:0/2723039326 conn(0x7f44780659d0 msgr2=0x7f447809b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:51.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.722+0000 7f447d311640 1 -- 172.21.15.5:0/2723039326 shutdown_connections 2023-07-14T12:52:51.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.722+0000 7f447d311640 1 -- 172.21.15.5:0/2723039326 wait complete. 2023-07-14T12:52:51.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.722+0000 7f447d311640 1 Processor -- start 2023-07-14T12:52:51.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.722+0000 7f447d311640 1 -- start start 2023-07-14T12:52:51.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.726+0000 7f447d311640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44780b1f70 0x7f44780c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:51.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.726+0000 7f447d311640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44780d06b0 0x7f4478157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:51.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.726+0000 7f447d311640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4478153e00 0x7f447815d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:51.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.726+0000 7f447d311640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44780c5990 con 0x7f44780b1f70 2023-07-14T12:52:51.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.726+0000 7f447d311640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4478154f10 con 0x7f4478153e00 2023-07-14T12:52:51.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.726+0000 7f447d311640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4478154300 con 0x7f44780d06b0 2023-07-14T12:52:51.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.726+0000 7f4476ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44780b1f70 0x7f44780c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:51.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.726+0000 7f4476ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44780b1f70 0x7f44780c5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52546/0 (socket says 172.21.15.5:52546) 2023-07-14T12:52:51.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.726+0000 7f4476ffd640 1 -- 172.21.15.5:0/11081349 learned_addr learned my addr 172.21.15.5:0/11081349 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:51.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.726+0000 7f44777fe640 1 --2- 172.21.15.5:0/11081349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4478153e00 0x7f447815d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:51.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.726+0000 7f446ffff640 1 --2- 172.21.15.5:0/11081349 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44780d06b0 0x7f4478157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:51.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.726+0000 7f4476ffd640 1 -- 172.21.15.5:0/11081349 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44780d06b0 msgr2=0x7f4478157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:51.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.726+0000 7f4476ffd640 1 --2- 172.21.15.5:0/11081349 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44780d06b0 0x7f4478157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.726+0000 7f4476ffd640 1 -- 172.21.15.5:0/11081349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4478153e00 msgr2=0x7f447815d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:51.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.726+0000 7f4476ffd640 1 --2- 172.21.15.5:0/11081349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4478153e00 0x7f447815d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.726+0000 7f4476ffd640 1 -- 172.21.15.5:0/11081349 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44680094d0 con 0x7f44780b1f70 2023-07-14T12:52:51.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.726+0000 7f446ffff640 1 --2- 172.21.15.5:0/11081349 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44780d06b0 0x7f4478157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:52:51.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.726+0000 7f44777fe640 1 --2- 172.21.15.5:0/11081349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4478153e00 0x7f447815d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:52:51.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.726+0000 7f4476ffd640 1 --2- 172.21.15.5:0/11081349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44780b1f70 0x7f44780c5450 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f446801a0c0 tx=0x7f446801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:51.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.726+0000 7f446f7fe640 1 -- 172.21.15.5:0/11081349 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44680bd5f0 con 0x7f44780b1f70 2023-07-14T12:52:51.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.726+0000 7f446f7fe640 1 -- 172.21.15.5:0/11081349 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44680bd750 con 0x7f44780b1f70 2023-07-14T12:52:51.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.726+0000 7f446f7fe640 1 -- 172.21.15.5:0/11081349 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44680bdb00 con 0x7f44780b1f70 2023-07-14T12:52:51.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.726+0000 7f447d311640 1 -- 172.21.15.5:0/11081349 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44781545e0 con 0x7f44780b1f70 2023-07-14T12:52:51.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.726+0000 7f447d311640 1 -- 172.21.15.5:0/11081349 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4478154ba0 con 0x7f44780b1f70 2023-07-14T12:52:51.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.726+0000 7f447d311640 1 -- 172.21.15.5:0/11081349 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4478072e70 con 0x7f44780b1f70 2023-07-14T12:52:51.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.726+0000 7f446f7fe640 1 -- 172.21.15.5:0/11081349 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f44680b33f0 con 0x7f44780b1f70 2023-07-14T12:52:51.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.730+0000 7f446f7fe640 1 --2- 172.21.15.5:0/11081349 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4458066280 0x7f4458068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:51.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.730+0000 7f446f7fe640 1 -- 172.21.15.5:0/11081349 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f446811ea10 con 0x7f44780b1f70 2023-07-14T12:52:51.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.730+0000 7f446ffff640 1 --2- 172.21.15.5:0/11081349 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4458066280 0x7f4458068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:51.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.730+0000 7f446ffff640 1 --2- 172.21.15.5:0/11081349 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4458066280 0x7f4458068730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f44781f75f0 tx=0x7f4460008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:51.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.734+0000 7f446f7fe640 1 -- 172.21.15.5:0/11081349 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f44680ebe10 con 0x7f44780b1f70 2023-07-14T12:52:51.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.882+0000 7f447d311640 1 -- 172.21.15.5:0/11081349 --> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f44780d29f0 con 0x7f4458066280 2023-07-14T12:52:51.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.890+0000 7f446f7fe640 1 -- 172.21.15.5:0/11081349 <== mgr.4102 v2:172.21.15.154:6832/2736441655 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286675 (secure 0 0 0) 0x7f4460009df0 con 0x7f4458066280 2023-07-14T12:52:51.919 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:52:51.920 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T12:52:51.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.894+0000 7f447d311640 1 -- 172.21.15.5:0/11081349 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4458066280 msgr2=0x7f4458068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.894+0000 7f447d311640 1 --2- 172.21.15.5:0/11081349 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4458066280 0x7f4458068730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f44781f75f0 tx=0x7f4460008040 comp rx=0 tx=0).stop 2023-07-14T12:52:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.894+0000 7f447d311640 1 -- 172.21.15.5:0/11081349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44780b1f70 msgr2=0x7f44780c5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.894+0000 7f447d311640 1 --2- 172.21.15.5:0/11081349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44780b1f70 0x7f44780c5450 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f446801a0c0 tx=0x7f446801acd0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.894+0000 7f447d311640 1 -- 172.21.15.5:0/11081349 shutdown_connections 2023-07-14T12:52:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.894+0000 7f447d311640 1 --2- 172.21.15.5:0/11081349 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4458066280 0x7f4458068730 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.894+0000 7f447d311640 1 --2- 172.21.15.5:0/11081349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4478153e00 0x7f447815d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.894+0000 7f447d311640 1 --2- 172.21.15.5:0/11081349 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44780d06b0 0x7f4478157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.894+0000 7f447d311640 1 --2- 172.21.15.5:0/11081349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44780b1f70 0x7f44780c5450 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:51.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.894+0000 7f447d311640 1 -- 172.21.15.5:0/11081349 >> 172.21.15.5:0/11081349 conn(0x7f44780659d0 msgr2=0x7f447815c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:51.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.894+0000 7f447d311640 1 -- 172.21.15.5:0/11081349 shutdown_connections 2023-07-14T12:52:51.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:51.894+0000 7f447d311640 1 -- 172.21.15.5:0/11081349 wait complete. 2023-07-14T12:52:51.939 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-14T12:52:51.635632+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":73,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234884,"kb_used_data":2884,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754739836,"statfs":{"total":773094113280,"available":772853592064,"internally_reserved":0,"allocated":2953216,"data_stored":1806626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001225"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.122983+0000","last_change":"2023-07-14T12:52:47.109113+0000","last_active":"2023-07-14T12:52:47.122983+0000","last_peered":"2023-07-14T12:52:47.122983+0000","last_clean":"2023-07-14T12:52:47.122983+0000","last_became_active":"2023-07-14T12:52:47.107356+0000","last_became_peered":"2023-07-14T12:52:47.107356+0000","last_unstale":"2023-07-14T12:52:47.122983+0000","last_undegraded":"2023-07-14T12:52:47.122983+0000","last_fullsized":"2023-07-14T12:52:47.122983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:53:34.310211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.121021+0000","last_change":"2023-07-14T12:52:47.119687+0000","last_active":"2023-07-14T12:52:47.121021+0000","last_peered":"2023-07-14T12:52:47.121021+0000","last_clean":"2023-07-14T12:52:47.121021+0000","last_became_active":"2023-07-14T12:52:47.119063+0000","last_became_peered":"2023-07-14T12:52:47.119063+0000","last_unstale":"2023-07-14T12:52:47.121021+0000","last_undegraded":"2023-07-14T12:52:47.121021+0000","last_fullsized":"2023-07-14T12:52:47.121021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:39:09.060324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.126512+0000","last_change":"2023-07-14T12:52:47.121019+0000","last_active":"2023-07-14T12:52:47.126512+0000","last_peered":"2023-07-14T12:52:47.126512+0000","last_clean":"2023-07-14T12:52:47.126512+0000","last_became_active":"2023-07-14T12:52:47.120756+0000","last_became_peered":"2023-07-14T12:52:47.120756+0000","last_unstale":"2023-07-14T12:52:47.126512+0000","last_undegraded":"2023-07-14T12:52:47.126512+0000","last_fullsized":"2023-07-14T12:52:47.126512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:30.872502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.116627+0000","last_change":"2023-07-14T12:52:47.114539+0000","last_active":"2023-07-14T12:52:47.116627+0000","last_peered":"2023-07-14T12:52:47.116627+0000","last_clean":"2023-07-14T12:52:47.116627+0000","last_became_active":"2023-07-14T12:52:47.114187+0000","last_became_peered":"2023-07-14T12:52:47.114187+0000","last_unstale":"2023-07-14T12:52:47.116627+0000","last_undegraded":"2023-07-14T12:52:47.116627+0000","last_fullsized":"2023-07-14T12:52:47.116627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:11:05.608818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.114352+0000","last_change":"2023-07-14T12:52:47.111120+0000","last_active":"2023-07-14T12:52:47.114352+0000","last_peered":"2023-07-14T12:52:47.114352+0000","last_clean":"2023-07-14T12:52:47.114352+0000","last_became_active":"2023-07-14T12:52:47.110781+0000","last_became_peered":"2023-07-14T12:52:47.110781+0000","last_unstale":"2023-07-14T12:52:47.114352+0000","last_undegraded":"2023-07-14T12:52:47.114352+0000","last_fullsized":"2023-07-14T12:52:47.114352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:28:08.399324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.121322+0000","last_change":"2023-07-14T12:52:47.111259+0000","last_active":"2023-07-14T12:52:47.121322+0000","last_peered":"2023-07-14T12:52:47.121322+0000","last_clean":"2023-07-14T12:52:47.121322+0000","last_became_active":"2023-07-14T12:52:47.111023+0000","last_became_peered":"2023-07-14T12:52:47.111023+0000","last_unstale":"2023-07-14T12:52:47.121322+0000","last_undegraded":"2023-07-14T12:52:47.121322+0000","last_fullsized":"2023-07-14T12:52:47.121322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:36:08.215135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125518+0000","last_change":"2023-07-14T12:52:47.122189+0000","last_active":"2023-07-14T12:52:47.125518+0000","last_peered":"2023-07-14T12:52:47.125518+0000","last_clean":"2023-07-14T12:52:47.125518+0000","last_became_active":"2023-07-14T12:52:47.121465+0000","last_became_peered":"2023-07-14T12:52:47.121465+0000","last_unstale":"2023-07-14T12:52:47.125518+0000","last_undegraded":"2023-07-14T12:52:47.125518+0000","last_fullsized":"2023-07-14T12:52:47.125518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:39:09.060324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.124976+0000","last_change":"2023-07-14T12:52:47.123614+0000","last_active":"2023-07-14T12:52:47.124976+0000","last_peered":"2023-07-14T12:52:47.124976+0000","last_clean":"2023-07-14T12:52:47.124976+0000","last_became_active":"2023-07-14T12:52:47.123147+0000","last_became_peered":"2023-07-14T12:52:47.123147+0000","last_unstale":"2023-07-14T12:52:47.124976+0000","last_undegraded":"2023-07-14T12:52:47.124976+0000","last_fullsized":"2023-07-14T12:52:47.124976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:36:08.215135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.126677+0000","last_change":"2023-07-14T12:52:47.123993+0000","last_active":"2023-07-14T12:52:47.126677+0000","last_peered":"2023-07-14T12:52:47.126677+0000","last_clean":"2023-07-14T12:52:47.126677+0000","last_became_active":"2023-07-14T12:52:47.123709+0000","last_became_peered":"2023-07-14T12:52:47.123709+0000","last_unstale":"2023-07-14T12:52:47.126677+0000","last_undegraded":"2023-07-14T12:52:47.126677+0000","last_fullsized":"2023-07-14T12:52:47.126677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:05:14.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.118637+0000","last_change":"2023-07-14T12:52:47.112624+0000","last_active":"2023-07-14T12:52:47.118637+0000","last_peered":"2023-07-14T12:52:47.118637+0000","last_clean":"2023-07-14T12:52:47.118637+0000","last_became_active":"2023-07-14T12:52:47.112322+0000","last_became_peered":"2023-07-14T12:52:47.112322+0000","last_unstale":"2023-07-14T12:52:47.118637+0000","last_undegraded":"2023-07-14T12:52:47.118637+0000","last_fullsized":"2023-07-14T12:52:47.118637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:30.872502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125824+0000","last_change":"2023-07-14T12:52:47.118589+0000","last_active":"2023-07-14T12:52:47.125824+0000","last_peered":"2023-07-14T12:52:47.125824+0000","last_clean":"2023-07-14T12:52:47.125824+0000","last_became_active":"2023-07-14T12:52:47.118256+0000","last_became_peered":"2023-07-14T12:52:47.118256+0000","last_unstale":"2023-07-14T12:52:47.125824+0000","last_undegraded":"2023-07-14T12:52:47.125824+0000","last_fullsized":"2023-07-14T12:52:47.125824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:43.338222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125843+0000","last_change":"2023-07-14T12:52:47.118304+0000","last_active":"2023-07-14T12:52:47.125843+0000","last_peered":"2023-07-14T12:52:47.125843+0000","last_clean":"2023-07-14T12:52:47.125843+0000","last_became_active":"2023-07-14T12:52:47.117930+0000","last_became_peered":"2023-07-14T12:52:47.117930+0000","last_unstale":"2023-07-14T12:52:47.125843+0000","last_undegraded":"2023-07-14T12:52:47.125843+0000","last_fullsized":"2023-07-14T12:52:47.125843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:20:31.282979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125434+0000","last_change":"2023-07-14T12:52:47.108380+0000","last_active":"2023-07-14T12:52:47.125434+0000","last_peered":"2023-07-14T12:52:47.125434+0000","last_clean":"2023-07-14T12:52:47.125434+0000","last_became_active":"2023-07-14T12:52:47.107936+0000","last_became_peered":"2023-07-14T12:52:47.107936+0000","last_unstale":"2023-07-14T12:52:47.125434+0000","last_undegraded":"2023-07-14T12:52:47.125434+0000","last_fullsized":"2023-07-14T12:52:47.125434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:05:14.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.118578+0000","last_change":"2023-07-14T12:52:47.111677+0000","last_active":"2023-07-14T12:52:47.118578+0000","last_peered":"2023-07-14T12:52:47.118578+0000","last_clean":"2023-07-14T12:52:47.118578+0000","last_became_active":"2023-07-14T12:52:47.111411+0000","last_became_peered":"2023-07-14T12:52:47.111411+0000","last_unstale":"2023-07-14T12:52:47.118578+0000","last_undegraded":"2023-07-14T12:52:47.118578+0000","last_fullsized":"2023-07-14T12:52:47.118578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:28:08.399324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125538+0000","last_change":"2023-07-14T12:52:47.122345+0000","last_active":"2023-07-14T12:52:47.125538+0000","last_peered":"2023-07-14T12:52:47.125538+0000","last_clean":"2023-07-14T12:52:47.125538+0000","last_became_active":"2023-07-14T12:52:47.121885+0000","last_became_peered":"2023-07-14T12:52:47.121885+0000","last_unstale":"2023-07-14T12:52:47.125538+0000","last_undegraded":"2023-07-14T12:52:47.125538+0000","last_fullsized":"2023-07-14T12:52:47.125538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:08:09.613480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.122659+0000","last_change":"2023-07-14T12:52:47.107126+0000","last_active":"2023-07-14T12:52:47.122659+0000","last_peered":"2023-07-14T12:52:47.122659+0000","last_clean":"2023-07-14T12:52:47.122659+0000","last_became_active":"2023-07-14T12:52:47.106204+0000","last_became_peered":"2023-07-14T12:52:47.106204+0000","last_unstale":"2023-07-14T12:52:47.122659+0000","last_undegraded":"2023-07-14T12:52:47.122659+0000","last_fullsized":"2023-07-14T12:52:47.122659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:21:14.784949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.112586+0000","last_change":"2023-07-14T12:52:47.109761+0000","last_active":"2023-07-14T12:52:47.112586+0000","last_peered":"2023-07-14T12:52:47.112586+0000","last_clean":"2023-07-14T12:52:47.112586+0000","last_became_active":"2023-07-14T12:52:47.109438+0000","last_became_peered":"2023-07-14T12:52:47.109438+0000","last_unstale":"2023-07-14T12:52:47.112586+0000","last_undegraded":"2023-07-14T12:52:47.112586+0000","last_fullsized":"2023-07-14T12:52:47.112586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:21:14.784949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.128126+0000","last_change":"2023-07-14T12:52:47.126985+0000","last_active":"2023-07-14T12:52:47.128126+0000","last_peered":"2023-07-14T12:52:47.128126+0000","last_clean":"2023-07-14T12:52:47.128126+0000","last_became_active":"2023-07-14T12:52:47.126696+0000","last_became_peered":"2023-07-14T12:52:47.126696+0000","last_unstale":"2023-07-14T12:52:47.128126+0000","last_undegraded":"2023-07-14T12:52:47.128126+0000","last_fullsized":"2023-07-14T12:52:47.128126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:03:43.488480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125754+0000","last_change":"2023-07-14T12:52:47.115418+0000","last_active":"2023-07-14T12:52:47.125754+0000","last_peered":"2023-07-14T12:52:47.125754+0000","last_clean":"2023-07-14T12:52:47.125754+0000","last_became_active":"2023-07-14T12:52:47.115115+0000","last_became_peered":"2023-07-14T12:52:47.115115+0000","last_unstale":"2023-07-14T12:52:47.125754+0000","last_undegraded":"2023-07-14T12:52:47.125754+0000","last_fullsized":"2023-07-14T12:52:47.125754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:09:54.636774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125649+0000","last_change":"2023-07-14T12:52:47.116335+0000","last_active":"2023-07-14T12:52:47.125649+0000","last_peered":"2023-07-14T12:52:47.125649+0000","last_clean":"2023-07-14T12:52:47.125649+0000","last_became_active":"2023-07-14T12:52:47.115763+0000","last_became_peered":"2023-07-14T12:52:47.115763+0000","last_unstale":"2023-07-14T12:52:47.125649+0000","last_undegraded":"2023-07-14T12:52:47.125649+0000","last_fullsized":"2023-07-14T12:52:47.125649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:24.288374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.126113+0000","last_change":"2023-07-14T12:52:47.124746+0000","last_active":"2023-07-14T12:52:47.126113+0000","last_peered":"2023-07-14T12:52:47.126113+0000","last_clean":"2023-07-14T12:52:47.126113+0000","last_became_active":"2023-07-14T12:52:47.124450+0000","last_became_peered":"2023-07-14T12:52:47.124450+0000","last_unstale":"2023-07-14T12:52:47.126113+0000","last_undegraded":"2023-07-14T12:52:47.126113+0000","last_fullsized":"2023-07-14T12:52:47.126113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:30:03.280675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.120400+0000","last_change":"2023-07-14T12:52:47.118958+0000","last_active":"2023-07-14T12:52:47.120400+0000","last_peered":"2023-07-14T12:52:47.120400+0000","last_clean":"2023-07-14T12:52:47.120400+0000","last_became_active":"2023-07-14T12:52:47.118640+0000","last_became_peered":"2023-07-14T12:52:47.118640+0000","last_unstale":"2023-07-14T12:52:47.120400+0000","last_undegraded":"2023-07-14T12:52:47.120400+0000","last_fullsized":"2023-07-14T12:52:47.120400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:11:05.608818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.123453+0000","last_change":"2023-07-14T12:52:47.112201+0000","last_active":"2023-07-14T12:52:47.123453+0000","last_peered":"2023-07-14T12:52:47.123453+0000","last_clean":"2023-07-14T12:52:47.123453+0000","last_became_active":"2023-07-14T12:52:47.111873+0000","last_became_peered":"2023-07-14T12:52:47.111873+0000","last_unstale":"2023-07-14T12:52:47.123453+0000","last_undegraded":"2023-07-14T12:52:47.123453+0000","last_fullsized":"2023-07-14T12:52:47.123453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:05:39.967713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.116632+0000","last_change":"2023-07-14T12:52:47.114122+0000","last_active":"2023-07-14T12:52:47.116632+0000","last_peered":"2023-07-14T12:52:47.116632+0000","last_clean":"2023-07-14T12:52:47.116632+0000","last_became_active":"2023-07-14T12:52:47.113796+0000","last_became_peered":"2023-07-14T12:52:47.113796+0000","last_unstale":"2023-07-14T12:52:47.116632+0000","last_undegraded":"2023-07-14T12:52:47.116632+0000","last_fullsized":"2023-07-14T12:52:47.116632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:46.115861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.119496+0000","last_change":"2023-07-14T12:52:47.116443+0000","last_active":"2023-07-14T12:52:47.119496+0000","last_peered":"2023-07-14T12:52:47.119496+0000","last_clean":"2023-07-14T12:52:47.119496+0000","last_became_active":"2023-07-14T12:52:47.116134+0000","last_became_peered":"2023-07-14T12:52:47.116134+0000","last_unstale":"2023-07-14T12:52:47.119496+0000","last_undegraded":"2023-07-14T12:52:47.119496+0000","last_fullsized":"2023-07-14T12:52:47.119496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:43.338222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.128072+0000","last_change":"2023-07-14T12:52:47.126857+0000","last_active":"2023-07-14T12:52:47.128072+0000","last_peered":"2023-07-14T12:52:47.128072+0000","last_clean":"2023-07-14T12:52:47.128072+0000","last_became_active":"2023-07-14T12:52:47.126551+0000","last_became_peered":"2023-07-14T12:52:47.126551+0000","last_unstale":"2023-07-14T12:52:47.128072+0000","last_undegraded":"2023-07-14T12:52:47.128072+0000","last_fullsized":"2023-07-14T12:52:47.128072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:53:34.310211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.120300+0000","last_change":"2023-07-14T12:52:47.116313+0000","last_active":"2023-07-14T12:52:47.120300+0000","last_peered":"2023-07-14T12:52:47.120300+0000","last_clean":"2023-07-14T12:52:47.120300+0000","last_became_active":"2023-07-14T12:52:47.116052+0000","last_became_peered":"2023-07-14T12:52:47.116052+0000","last_unstale":"2023-07-14T12:52:47.120300+0000","last_undegraded":"2023-07-14T12:52:47.120300+0000","last_fullsized":"2023-07-14T12:52:47.120300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:03:43.488480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.121138+0000","last_change":"2023-07-14T12:52:47.113963+0000","last_active":"2023-07-14T12:52:47.121138+0000","last_peered":"2023-07-14T12:52:47.121138+0000","last_clean":"2023-07-14T12:52:47.121138+0000","last_became_active":"2023-07-14T12:52:47.113636+0000","last_became_peered":"2023-07-14T12:52:47.113636+0000","last_unstale":"2023-07-14T12:52:47.121138+0000","last_undegraded":"2023-07-14T12:52:47.121138+0000","last_fullsized":"2023-07-14T12:52:47.121138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:03:43.488480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.124240+0000","last_change":"2023-07-14T12:52:47.114586+0000","last_active":"2023-07-14T12:52:47.124240+0000","last_peered":"2023-07-14T12:52:47.124240+0000","last_clean":"2023-07-14T12:52:47.124240+0000","last_became_active":"2023-07-14T12:52:47.114296+0000","last_became_peered":"2023-07-14T12:52:47.114296+0000","last_unstale":"2023-07-14T12:52:47.124240+0000","last_undegraded":"2023-07-14T12:52:47.124240+0000","last_fullsized":"2023-07-14T12:52:47.124240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:36:08.215135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125821+0000","last_change":"2023-07-14T12:52:47.118226+0000","last_active":"2023-07-14T12:52:47.125821+0000","last_peered":"2023-07-14T12:52:47.125821+0000","last_clean":"2023-07-14T12:52:47.125821+0000","last_became_active":"2023-07-14T12:52:47.117714+0000","last_became_peered":"2023-07-14T12:52:47.117714+0000","last_unstale":"2023-07-14T12:52:47.125821+0000","last_undegraded":"2023-07-14T12:52:47.125821+0000","last_fullsized":"2023-07-14T12:52:47.125821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:09:54.636774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.126434+0000","last_change":"2023-07-14T12:52:47.120308+0000","last_active":"2023-07-14T12:52:47.126434+0000","last_peered":"2023-07-14T12:52:47.126434+0000","last_clean":"2023-07-14T12:52:47.126434+0000","last_became_active":"2023-07-14T12:52:47.119847+0000","last_became_peered":"2023-07-14T12:52:47.119847+0000","last_unstale":"2023-07-14T12:52:47.126434+0000","last_undegraded":"2023-07-14T12:52:47.126434+0000","last_fullsized":"2023-07-14T12:52:47.126434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:52:25.699239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.128039+0000","last_change":"2023-07-14T12:52:47.127275+0000","last_active":"2023-07-14T12:52:47.128039+0000","last_peered":"2023-07-14T12:52:47.128039+0000","last_clean":"2023-07-14T12:52:47.128039+0000","last_became_active":"2023-07-14T12:52:47.126883+0000","last_became_peered":"2023-07-14T12:52:47.126883+0000","last_unstale":"2023-07-14T12:52:47.128039+0000","last_undegraded":"2023-07-14T12:52:47.128039+0000","last_fullsized":"2023-07-14T12:52:47.128039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:05:14.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.126420+0000","last_change":"2023-07-14T12:52:47.121988+0000","last_active":"2023-07-14T12:52:47.126420+0000","last_peered":"2023-07-14T12:52:47.126420+0000","last_clean":"2023-07-14T12:52:47.126420+0000","last_became_active":"2023-07-14T12:52:47.121687+0000","last_became_peered":"2023-07-14T12:52:47.121687+0000","last_unstale":"2023-07-14T12:52:47.126420+0000","last_undegraded":"2023-07-14T12:52:47.126420+0000","last_fullsized":"2023-07-14T12:52:47.126420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:28:08.399324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.440659+0000","last_change":"2023-07-14T12:52:46.094170+0000","last_active":"2023-07-14T12:52:47.440659+0000","last_peered":"2023-07-14T12:52:47.440659+0000","last_clean":"2023-07-14T12:52:47.440659+0000","last_became_active":"2023-07-14T12:52:46.093847+0000","last_became_peered":"2023-07-14T12:52:46.093847+0000","last_unstale":"2023-07-14T12:52:47.440659+0000","last_undegraded":"2023-07-14T12:52:47.440659+0000","last_fullsized":"2023-07-14T12:52:47.440659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:45:21.373943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.120315+0000","last_change":"2023-07-14T12:52:47.117512+0000","last_active":"2023-07-14T12:52:47.120315+0000","last_peered":"2023-07-14T12:52:47.120315+0000","last_clean":"2023-07-14T12:52:47.120315+0000","last_became_active":"2023-07-14T12:52:47.117268+0000","last_became_peered":"2023-07-14T12:52:47.117268+0000","last_unstale":"2023-07-14T12:52:47.120315+0000","last_undegraded":"2023-07-14T12:52:47.120315+0000","last_fullsized":"2023-07-14T12:52:47.120315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:26:00.737284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.107441+0000","last_change":"2023-07-14T12:52:46.086633+0000","last_active":"2023-07-14T12:52:47.107441+0000","last_peered":"2023-07-14T12:52:47.107441+0000","last_clean":"2023-07-14T12:52:47.107441+0000","last_became_active":"2023-07-14T12:52:46.084673+0000","last_became_peered":"2023-07-14T12:52:46.084673+0000","last_unstale":"2023-07-14T12:52:47.107441+0000","last_undegraded":"2023-07-14T12:52:47.107441+0000","last_fullsized":"2023-07-14T12:52:47.107441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:03:42.477374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.114851+0000","last_change":"2023-07-14T12:52:47.111606+0000","last_active":"2023-07-14T12:52:47.114851+0000","last_peered":"2023-07-14T12:52:47.114851+0000","last_clean":"2023-07-14T12:52:47.114851+0000","last_became_active":"2023-07-14T12:52:47.111132+0000","last_became_peered":"2023-07-14T12:52:47.111132+0000","last_unstale":"2023-07-14T12:52:47.114851+0000","last_undegraded":"2023-07-14T12:52:47.114851+0000","last_fullsized":"2023-07-14T12:52:47.114851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:53:34.310211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.105756+0000","last_change":"2023-07-14T12:52:46.094259+0000","last_active":"2023-07-14T12:52:47.105756+0000","last_peered":"2023-07-14T12:52:47.105756+0000","last_clean":"2023-07-14T12:52:47.105756+0000","last_became_active":"2023-07-14T12:52:46.093946+0000","last_became_peered":"2023-07-14T12:52:46.093946+0000","last_unstale":"2023-07-14T12:52:47.105756+0000","last_undegraded":"2023-07-14T12:52:47.105756+0000","last_fullsized":"2023-07-14T12:52:47.105756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:45:16.620577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.123315+0000","last_change":"2023-07-14T12:52:47.109858+0000","last_active":"2023-07-14T12:52:47.123315+0000","last_peered":"2023-07-14T12:52:47.123315+0000","last_clean":"2023-07-14T12:52:47.123315+0000","last_became_active":"2023-07-14T12:52:47.109547+0000","last_became_peered":"2023-07-14T12:52:47.109547+0000","last_unstale":"2023-07-14T12:52:47.123315+0000","last_undegraded":"2023-07-14T12:52:47.123315+0000","last_fullsized":"2023-07-14T12:52:47.123315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:09:54.636774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.437836+0000","last_change":"2023-07-14T12:52:46.083042+0000","last_active":"2023-07-14T12:52:47.437836+0000","last_peered":"2023-07-14T12:52:47.437836+0000","last_clean":"2023-07-14T12:52:47.437836+0000","last_became_active":"2023-07-14T12:52:46.082506+0000","last_became_peered":"2023-07-14T12:52:46.082506+0000","last_unstale":"2023-07-14T12:52:47.437836+0000","last_undegraded":"2023-07-14T12:52:47.437836+0000","last_fullsized":"2023-07-14T12:52:47.437836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:09:53.625668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.434583+0000","last_change":"2023-07-14T12:52:46.088541+0000","last_active":"2023-07-14T12:52:47.434583+0000","last_peered":"2023-07-14T12:52:47.434583+0000","last_clean":"2023-07-14T12:52:47.434583+0000","last_became_active":"2023-07-14T12:52:46.088185+0000","last_became_peered":"2023-07-14T12:52:46.088185+0000","last_unstale":"2023-07-14T12:52:47.434583+0000","last_undegraded":"2023-07-14T12:52:47.434583+0000","last_fullsized":"2023-07-14T12:52:47.434583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:52:24.688133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.120269+0000","last_change":"2023-07-14T12:52:47.115030+0000","last_active":"2023-07-14T12:52:47.120269+0000","last_peered":"2023-07-14T12:52:47.120269+0000","last_clean":"2023-07-14T12:52:47.120269+0000","last_became_active":"2023-07-14T12:52:47.114732+0000","last_became_peered":"2023-07-14T12:52:47.114732+0000","last_unstale":"2023-07-14T12:52:47.120269+0000","last_undegraded":"2023-07-14T12:52:47.120269+0000","last_fullsized":"2023-07-14T12:52:47.120269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:53:34.310211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.439259+0000","last_change":"2023-07-14T12:52:46.089168+0000","last_active":"2023-07-14T12:52:47.439259+0000","last_peered":"2023-07-14T12:52:47.439259+0000","last_clean":"2023-07-14T12:52:47.439259+0000","last_became_active":"2023-07-14T12:52:46.088899+0000","last_became_peered":"2023-07-14T12:52:46.088899+0000","last_unstale":"2023-07-14T12:52:47.439259+0000","last_undegraded":"2023-07-14T12:52:47.439259+0000","last_fullsized":"2023-07-14T12:52:47.439259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:23:36.193943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.121343+0000","last_change":"2023-07-14T12:52:47.113901+0000","last_active":"2023-07-14T12:52:47.121343+0000","last_peered":"2023-07-14T12:52:47.121343+0000","last_clean":"2023-07-14T12:52:47.121343+0000","last_became_active":"2023-07-14T12:52:47.113606+0000","last_became_peered":"2023-07-14T12:52:47.113606+0000","last_unstale":"2023-07-14T12:52:47.121343+0000","last_undegraded":"2023-07-14T12:52:47.121343+0000","last_fullsized":"2023-07-14T12:52:47.121343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:11:05.608818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.439513+0000","last_change":"2023-07-14T12:52:46.091961+0000","last_active":"2023-07-14T12:52:47.439513+0000","last_peered":"2023-07-14T12:52:47.439513+0000","last_clean":"2023-07-14T12:52:47.439513+0000","last_became_active":"2023-07-14T12:52:46.091673+0000","last_became_peered":"2023-07-14T12:52:46.091673+0000","last_unstale":"2023-07-14T12:52:47.439513+0000","last_undegraded":"2023-07-14T12:52:47.439513+0000","last_fullsized":"2023-07-14T12:52:47.439513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:01:36.455280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.122924+0000","last_change":"2023-07-14T12:52:47.120755+0000","last_active":"2023-07-14T12:52:47.122924+0000","last_peered":"2023-07-14T12:52:47.122924+0000","last_clean":"2023-07-14T12:52:47.122924+0000","last_became_active":"2023-07-14T12:52:47.120428+0000","last_became_peered":"2023-07-14T12:52:47.120428+0000","last_unstale":"2023-07-14T12:52:47.122924+0000","last_undegraded":"2023-07-14T12:52:47.122924+0000","last_fullsized":"2023-07-14T12:52:47.122924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:38:13.646177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.105252+0000","last_change":"2023-07-14T12:52:46.081037+0000","last_active":"2023-07-14T12:52:47.105252+0000","last_peered":"2023-07-14T12:52:47.105252+0000","last_clean":"2023-07-14T12:52:47.105252+0000","last_became_active":"2023-07-14T12:52:46.080737+0000","last_became_peered":"2023-07-14T12:52:46.080737+0000","last_unstale":"2023-07-14T12:52:47.105252+0000","last_undegraded":"2023-07-14T12:52:47.105252+0000","last_fullsized":"2023-07-14T12:52:47.105252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:05:38.956607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.122178+0000","last_change":"2023-07-14T12:52:47.120358+0000","last_active":"2023-07-14T12:52:47.122178+0000","last_peered":"2023-07-14T12:52:47.122178+0000","last_clean":"2023-07-14T12:52:47.122178+0000","last_became_active":"2023-07-14T12:52:47.119985+0000","last_became_peered":"2023-07-14T12:52:47.119985+0000","last_unstale":"2023-07-14T12:52:47.122178+0000","last_undegraded":"2023-07-14T12:52:47.122178+0000","last_fullsized":"2023-07-14T12:52:47.122178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:26:00.737284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.439116+0000","last_change":"2023-07-14T12:52:46.085362+0000","last_active":"2023-07-14T12:52:47.439116+0000","last_peered":"2023-07-14T12:52:47.439116+0000","last_clean":"2023-07-14T12:52:47.439116+0000","last_became_active":"2023-07-14T12:52:46.084995+0000","last_became_peered":"2023-07-14T12:52:46.084995+0000","last_unstale":"2023-07-14T12:52:47.439116+0000","last_undegraded":"2023-07-14T12:52:47.439116+0000","last_fullsized":"2023-07-14T12:52:47.439116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:23.277268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125628+0000","last_change":"2023-07-14T12:52:47.116159+0000","last_active":"2023-07-14T12:52:47.125628+0000","last_peered":"2023-07-14T12:52:47.125628+0000","last_clean":"2023-07-14T12:52:47.125628+0000","last_became_active":"2023-07-14T12:52:47.115435+0000","last_became_peered":"2023-07-14T12:52:47.115435+0000","last_unstale":"2023-07-14T12:52:47.125628+0000","last_undegraded":"2023-07-14T12:52:47.125628+0000","last_fullsized":"2023-07-14T12:52:47.125628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:30:07.070537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.109691+0000","last_change":"2023-07-14T12:52:46.093095+0000","last_active":"2023-07-14T12:52:47.109691+0000","last_peered":"2023-07-14T12:52:47.109691+0000","last_clean":"2023-07-14T12:52:47.109691+0000","last_became_active":"2023-07-14T12:52:46.092806+0000","last_became_peered":"2023-07-14T12:52:46.092806+0000","last_unstale":"2023-07-14T12:52:47.109691+0000","last_undegraded":"2023-07-14T12:52:47.109691+0000","last_fullsized":"2023-07-14T12:52:47.109691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:53:33.299105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125710+0000","last_change":"2023-07-14T12:52:47.117743+0000","last_active":"2023-07-14T12:52:47.125710+0000","last_peered":"2023-07-14T12:52:47.125710+0000","last_clean":"2023-07-14T12:52:47.125710+0000","last_became_active":"2023-07-14T12:52:47.117463+0000","last_became_peered":"2023-07-14T12:52:47.117463+0000","last_unstale":"2023-07-14T12:52:47.125710+0000","last_undegraded":"2023-07-14T12:52:47.125710+0000","last_fullsized":"2023-07-14T12:52:47.125710+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:26:00.737284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.099503+0000","last_change":"2023-07-14T12:52:46.084899+0000","last_active":"2023-07-14T12:52:47.099503+0000","last_peered":"2023-07-14T12:52:47.099503+0000","last_clean":"2023-07-14T12:52:47.099503+0000","last_became_active":"2023-07-14T12:52:46.084636+0000","last_became_peered":"2023-07-14T12:52:46.084636+0000","last_unstale":"2023-07-14T12:52:47.099503+0000","last_undegraded":"2023-07-14T12:52:47.099503+0000","last_fullsized":"2023-07-14T12:52:47.099503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:52:24.688133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125569+0000","last_change":"2023-07-14T12:52:47.114756+0000","last_active":"2023-07-14T12:52:47.125569+0000","last_peered":"2023-07-14T12:52:47.125569+0000","last_clean":"2023-07-14T12:52:47.125569+0000","last_became_active":"2023-07-14T12:52:47.114480+0000","last_became_peered":"2023-07-14T12:52:47.114480+0000","last_unstale":"2023-07-14T12:52:47.125569+0000","last_undegraded":"2023-07-14T12:52:47.125569+0000","last_fullsized":"2023-07-14T12:52:47.125569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:39:09.060324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.099714+0000","last_change":"2023-07-14T12:52:46.090947+0000","last_active":"2023-07-14T12:52:47.099714+0000","last_peered":"2023-07-14T12:52:47.099714+0000","last_clean":"2023-07-14T12:52:47.099714+0000","last_became_active":"2023-07-14T12:52:46.090670+0000","last_became_peered":"2023-07-14T12:52:46.090670+0000","last_unstale":"2023-07-14T12:52:47.099714+0000","last_undegraded":"2023-07-14T12:52:47.099714+0000","last_fullsized":"2023-07-14T12:52:47.099714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:53:33.299105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.126201+0000","last_change":"2023-07-14T12:52:47.124181+0000","last_active":"2023-07-14T12:52:47.126201+0000","last_peered":"2023-07-14T12:52:47.126201+0000","last_clean":"2023-07-14T12:52:47.126201+0000","last_became_active":"2023-07-14T12:52:47.123815+0000","last_became_peered":"2023-07-14T12:52:47.123815+0000","last_unstale":"2023-07-14T12:52:47.126201+0000","last_undegraded":"2023-07-14T12:52:47.126201+0000","last_fullsized":"2023-07-14T12:52:47.126201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:26:00.737284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.108033+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T12:52:47.108033+0000","last_peered":"2023-07-14T12:52:47.108033+0000","last_clean":"2023-07-14T12:52:47.108033+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T12:52:47.108033+0000","last_undegraded":"2023-07-14T12:52:47.108033+0000","last_fullsized":"2023-07-14T12:52:47.108033+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:22.197747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.105551+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T12:52:47.105551+0000","last_peered":"2023-07-14T12:52:47.105551+0000","last_clean":"2023-07-14T12:52:47.105551+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T12:52:47.105551+0000","last_undegraded":"2023-07-14T12:52:47.105551+0000","last_fullsized":"2023-07-14T12:52:47.105551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:23:31.160628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.101570+0000","last_change":"2023-07-14T12:52:46.083051+0000","last_active":"2023-07-14T12:52:47.101570+0000","last_peered":"2023-07-14T12:52:47.101570+0000","last_clean":"2023-07-14T12:52:47.101570+0000","last_became_active":"2023-07-14T12:52:46.082304+0000","last_became_peered":"2023-07-14T12:52:46.082304+0000","last_unstale":"2023-07-14T12:52:47.101570+0000","last_undegraded":"2023-07-14T12:52:47.101570+0000","last_fullsized":"2023-07-14T12:52:47.101570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:42.327116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.123996+0000","last_change":"2023-07-14T12:52:47.122248+0000","last_active":"2023-07-14T12:52:47.123996+0000","last_peered":"2023-07-14T12:52:47.123996+0000","last_clean":"2023-07-14T12:52:47.123996+0000","last_became_active":"2023-07-14T12:52:47.121773+0000","last_became_peered":"2023-07-14T12:52:47.121773+0000","last_unstale":"2023-07-14T12:52:47.123996+0000","last_undegraded":"2023-07-14T12:52:47.123996+0000","last_fullsized":"2023-07-14T12:52:47.123996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:21:14.784949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.105592+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T12:52:47.105592+0000","last_peered":"2023-07-14T12:52:47.105592+0000","last_clean":"2023-07-14T12:52:47.105592+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T12:52:47.105592+0000","last_undegraded":"2023-07-14T12:52:47.105592+0000","last_fullsized":"2023-07-14T12:52:47.105592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:37:53.659671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.103678+0000","last_change":"2023-07-14T12:52:46.093346+0000","last_active":"2023-07-14T12:52:47.103678+0000","last_peered":"2023-07-14T12:52:47.103678+0000","last_clean":"2023-07-14T12:52:47.103678+0000","last_became_active":"2023-07-14T12:52:46.093008+0000","last_became_peered":"2023-07-14T12:52:46.093008+0000","last_unstale":"2023-07-14T12:52:47.103678+0000","last_undegraded":"2023-07-14T12:52:47.103678+0000","last_fullsized":"2023-07-14T12:52:47.103678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:36:07.204029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.121345+0000","last_change":"2023-07-14T12:52:47.120008+0000","last_active":"2023-07-14T12:52:47.121345+0000","last_peered":"2023-07-14T12:52:47.121345+0000","last_clean":"2023-07-14T12:52:47.121345+0000","last_became_active":"2023-07-14T12:52:47.119629+0000","last_became_peered":"2023-07-14T12:52:47.119629+0000","last_unstale":"2023-07-14T12:52:47.121345+0000","last_undegraded":"2023-07-14T12:52:47.121345+0000","last_fullsized":"2023-07-14T12:52:47.121345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:20:31.282979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.094001+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T12:52:47.094001+0000","last_peered":"2023-07-14T12:52:47.094001+0000","last_clean":"2023-07-14T12:52:47.094001+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T12:52:47.094001+0000","last_undegraded":"2023-07-14T12:52:47.094001+0000","last_fullsized":"2023-07-14T12:52:47.094001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:21:08.740527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.099466+0000","last_change":"2023-07-14T12:52:46.082644+0000","last_active":"2023-07-14T12:52:47.099466+0000","last_peered":"2023-07-14T12:52:47.099466+0000","last_clean":"2023-07-14T12:52:47.099466+0000","last_became_active":"2023-07-14T12:52:46.082010+0000","last_became_peered":"2023-07-14T12:52:46.082010+0000","last_unstale":"2023-07-14T12:52:47.099466+0000","last_undegraded":"2023-07-14T12:52:47.099466+0000","last_fullsized":"2023-07-14T12:52:47.099466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:29.861396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.118914+0000","last_change":"2023-07-14T12:52:47.112236+0000","last_active":"2023-07-14T12:52:47.118914+0000","last_peered":"2023-07-14T12:52:47.118914+0000","last_clean":"2023-07-14T12:52:47.118914+0000","last_became_active":"2023-07-14T12:52:47.111932+0000","last_became_peered":"2023-07-14T12:52:47.111932+0000","last_unstale":"2023-07-14T12:52:47.118914+0000","last_undegraded":"2023-07-14T12:52:47.118914+0000","last_fullsized":"2023-07-14T12:52:47.118914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:36:08.215135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.102372+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T12:52:47.102372+0000","last_peered":"2023-07-14T12:52:47.102372+0000","last_clean":"2023-07-14T12:52:47.102372+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T12:52:47.102372+0000","last_undegraded":"2023-07-14T12:52:47.102372+0000","last_fullsized":"2023-07-14T12:52:47.102372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:30:01.026115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.100153+0000","last_change":"2023-07-14T12:52:46.093820+0000","last_active":"2023-07-14T12:52:47.100153+0000","last_peered":"2023-07-14T12:52:47.100153+0000","last_clean":"2023-07-14T12:52:47.100153+0000","last_became_active":"2023-07-14T12:52:46.093558+0000","last_became_peered":"2023-07-14T12:52:46.093558+0000","last_unstale":"2023-07-14T12:52:47.100153+0000","last_undegraded":"2023-07-14T12:52:47.100153+0000","last_fullsized":"2023-07-14T12:52:47.100153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:23:36.193943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.128687+0000","last_change":"2023-07-14T12:52:47.127415+0000","last_active":"2023-07-14T12:52:47.128687+0000","last_peered":"2023-07-14T12:52:47.128687+0000","last_clean":"2023-07-14T12:52:47.128687+0000","last_became_active":"2023-07-14T12:52:47.127167+0000","last_became_peered":"2023-07-14T12:52:47.127167+0000","last_unstale":"2023-07-14T12:52:47.128687+0000","last_undegraded":"2023-07-14T12:52:47.128687+0000","last_fullsized":"2023-07-14T12:52:47.128687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:24.288374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.104136+0000","last_change":"2023-07-14T12:52:46.090967+0000","last_active":"2023-07-14T12:52:47.104136+0000","last_peered":"2023-07-14T12:52:47.104136+0000","last_clean":"2023-07-14T12:52:47.104136+0000","last_became_active":"2023-07-14T12:52:46.087916+0000","last_became_peered":"2023-07-14T12:52:46.087916+0000","last_unstale":"2023-07-14T12:52:47.104136+0000","last_undegraded":"2023-07-14T12:52:47.104136+0000","last_fullsized":"2023-07-14T12:52:47.104136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:42.327116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.099839+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T12:52:47.099839+0000","last_peered":"2023-07-14T12:52:47.099839+0000","last_clean":"2023-07-14T12:52:47.099839+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T12:52:47.099839+0000","last_undegraded":"2023-07-14T12:52:47.099839+0000","last_fullsized":"2023-07-14T12:52:47.099839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:52:19.654817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.119159+0000","last_change":"2023-07-14T12:52:47.112617+0000","last_active":"2023-07-14T12:52:47.119159+0000","last_peered":"2023-07-14T12:52:47.119159+0000","last_clean":"2023-07-14T12:52:47.119159+0000","last_became_active":"2023-07-14T12:52:47.112317+0000","last_became_peered":"2023-07-14T12:52:47.112317+0000","last_unstale":"2023-07-14T12:52:47.119159+0000","last_undegraded":"2023-07-14T12:52:47.119159+0000","last_fullsized":"2023-07-14T12:52:47.119159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:05:39.967713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.099750+0000","last_change":"2023-07-14T12:52:46.082409+0000","last_active":"2023-07-14T12:52:47.099750+0000","last_peered":"2023-07-14T12:52:47.099750+0000","last_clean":"2023-07-14T12:52:47.099750+0000","last_became_active":"2023-07-14T12:52:46.082027+0000","last_became_peered":"2023-07-14T12:52:46.082027+0000","last_unstale":"2023-07-14T12:52:47.099750+0000","last_undegraded":"2023-07-14T12:52:47.099750+0000","last_fullsized":"2023-07-14T12:52:47.099750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:39:08.049218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.104180+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T12:52:47.104180+0000","last_peered":"2023-07-14T12:52:47.104180+0000","last_clean":"2023-07-14T12:52:47.104180+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T12:52:47.104180+0000","last_undegraded":"2023-07-14T12:52:47.104180+0000","last_fullsized":"2023-07-14T12:52:47.104180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:50:50.611379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.120504+0000","last_change":"2023-07-14T12:52:47.118665+0000","last_active":"2023-07-14T12:52:47.120504+0000","last_peered":"2023-07-14T12:52:47.120504+0000","last_clean":"2023-07-14T12:52:47.120504+0000","last_became_active":"2023-07-14T12:52:47.118454+0000","last_became_peered":"2023-07-14T12:52:47.118454+0000","last_unstale":"2023-07-14T12:52:47.120504+0000","last_undegraded":"2023-07-14T12:52:47.120504+0000","last_fullsized":"2023-07-14T12:52:47.120504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:30:07.070537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.439673+0000","last_change":"2023-07-14T12:52:46.090135+0000","last_active":"2023-07-14T12:52:47.439673+0000","last_peered":"2023-07-14T12:52:47.439673+0000","last_clean":"2023-07-14T12:52:47.439673+0000","last_became_active":"2023-07-14T12:52:46.089807+0000","last_became_peered":"2023-07-14T12:52:46.089807+0000","last_unstale":"2023-07-14T12:52:47.439673+0000","last_undegraded":"2023-07-14T12:52:47.439673+0000","last_fullsized":"2023-07-14T12:52:47.439673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:25:59.726178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.098518+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T12:52:47.098518+0000","last_peered":"2023-07-14T12:52:47.098518+0000","last_clean":"2023-07-14T12:52:47.098518+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T12:52:47.098518+0000","last_undegraded":"2023-07-14T12:52:47.098518+0000","last_fullsized":"2023-07-14T12:52:47.098518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:30:01.026115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.123587+0000","last_change":"2023-07-14T12:52:47.114917+0000","last_active":"2023-07-14T12:52:47.123587+0000","last_peered":"2023-07-14T12:52:47.123587+0000","last_clean":"2023-07-14T12:52:47.123587+0000","last_became_active":"2023-07-14T12:52:47.114437+0000","last_became_peered":"2023-07-14T12:52:47.114437+0000","last_unstale":"2023-07-14T12:52:47.123587+0000","last_undegraded":"2023-07-14T12:52:47.123587+0000","last_fullsized":"2023-07-14T12:52:47.123587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:05:14.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.109223+0000","last_change":"2023-07-14T12:52:46.089258+0000","last_active":"2023-07-14T12:52:47.109223+0000","last_peered":"2023-07-14T12:52:47.109223+0000","last_clean":"2023-07-14T12:52:47.109223+0000","last_became_active":"2023-07-14T12:52:46.088621+0000","last_became_peered":"2023-07-14T12:52:46.088621+0000","last_unstale":"2023-07-14T12:52:47.109223+0000","last_undegraded":"2023-07-14T12:52:47.109223+0000","last_fullsized":"2023-07-14T12:52:47.109223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:29.861396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.108501+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T12:52:47.108501+0000","last_peered":"2023-07-14T12:52:47.108501+0000","last_clean":"2023-07-14T12:52:47.108501+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T12:52:47.108501+0000","last_undegraded":"2023-07-14T12:52:47.108501+0000","last_fullsized":"2023-07-14T12:52:47.108501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:20:25.238557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.121325+0000","last_change":"2023-07-14T12:52:47.108704+0000","last_active":"2023-07-14T12:52:47.121325+0000","last_peered":"2023-07-14T12:52:47.121325+0000","last_clean":"2023-07-14T12:52:47.121325+0000","last_became_active":"2023-07-14T12:52:47.108394+0000","last_became_peered":"2023-07-14T12:52:47.108394+0000","last_unstale":"2023-07-14T12:52:47.121325+0000","last_undegraded":"2023-07-14T12:52:47.121325+0000","last_fullsized":"2023-07-14T12:52:47.121325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:38:13.646177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125660+0000","last_change":"2023-07-14T12:52:47.117094+0000","last_active":"2023-07-14T12:52:47.125660+0000","last_peered":"2023-07-14T12:52:47.125660+0000","last_clean":"2023-07-14T12:52:47.125660+0000","last_became_active":"2023-07-14T12:52:47.116803+0000","last_became_peered":"2023-07-14T12:52:47.116803+0000","last_unstale":"2023-07-14T12:52:47.125660+0000","last_undegraded":"2023-07-14T12:52:47.125660+0000","last_fullsized":"2023-07-14T12:52:47.125660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:20:31.282979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.442759+0000","last_change":"2023-07-14T12:52:46.084583+0000","last_active":"2023-07-14T12:52:47.442759+0000","last_peered":"2023-07-14T12:52:47.442759+0000","last_clean":"2023-07-14T12:52:47.442759+0000","last_became_active":"2023-07-14T12:52:46.083903+0000","last_became_peered":"2023-07-14T12:52:46.083903+0000","last_unstale":"2023-07-14T12:52:47.442759+0000","last_undegraded":"2023-07-14T12:52:47.442759+0000","last_fullsized":"2023-07-14T12:52:47.442759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:01:36.455280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.120266+0000","last_change":"2023-07-14T12:52:47.117195+0000","last_active":"2023-07-14T12:52:47.120266+0000","last_peered":"2023-07-14T12:52:47.120266+0000","last_clean":"2023-07-14T12:52:47.120266+0000","last_became_active":"2023-07-14T12:52:47.116928+0000","last_became_peered":"2023-07-14T12:52:47.116928+0000","last_unstale":"2023-07-14T12:52:47.120266+0000","last_undegraded":"2023-07-14T12:52:47.120266+0000","last_fullsized":"2023-07-14T12:52:47.120266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:23:37.205050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.437244+0000","last_change":"2023-07-14T12:52:46.094565+0000","last_active":"2023-07-14T12:52:47.437244+0000","last_peered":"2023-07-14T12:52:47.437244+0000","last_clean":"2023-07-14T12:52:47.437244+0000","last_became_active":"2023-07-14T12:52:46.094318+0000","last_became_peered":"2023-07-14T12:52:46.094318+0000","last_unstale":"2023-07-14T12:52:47.437244+0000","last_undegraded":"2023-07-14T12:52:47.437244+0000","last_fullsized":"2023-07-14T12:52:47.437244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:05:38.956607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.107292+0000","last_change":"2023-07-14T12:52:46.086205+0000","last_active":"2023-07-14T12:52:47.107292+0000","last_peered":"2023-07-14T12:52:47.107292+0000","last_clean":"2023-07-14T12:52:47.107292+0000","last_became_active":"2023-07-14T12:52:46.085742+0000","last_became_peered":"2023-07-14T12:52:46.085742+0000","last_unstale":"2023-07-14T12:52:47.107292+0000","last_undegraded":"2023-07-14T12:52:47.107292+0000","last_fullsized":"2023-07-14T12:52:47.107292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:01:36.455280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.124123+0000","last_change":"2023-07-14T12:52:47.114145+0000","last_active":"2023-07-14T12:52:47.124123+0000","last_peered":"2023-07-14T12:52:47.124123+0000","last_clean":"2023-07-14T12:52:47.124123+0000","last_became_active":"2023-07-14T12:52:47.113888+0000","last_became_peered":"2023-07-14T12:52:47.113888+0000","last_unstale":"2023-07-14T12:52:47.124123+0000","last_undegraded":"2023-07-14T12:52:47.124123+0000","last_fullsized":"2023-07-14T12:52:47.124123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:39:09.060324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.109176+0000","last_change":"2023-07-14T12:52:46.088585+0000","last_active":"2023-07-14T12:52:47.109176+0000","last_peered":"2023-07-14T12:52:47.109176+0000","last_clean":"2023-07-14T12:52:47.109176+0000","last_became_active":"2023-07-14T12:52:46.088263+0000","last_became_peered":"2023-07-14T12:52:46.088263+0000","last_unstale":"2023-07-14T12:52:47.109176+0000","last_undegraded":"2023-07-14T12:52:47.109176+0000","last_fullsized":"2023-07-14T12:52:47.109176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:42.327116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.126450+0000","last_change":"2023-07-14T12:52:47.119037+0000","last_active":"2023-07-14T12:52:47.126450+0000","last_peered":"2023-07-14T12:52:47.126450+0000","last_clean":"2023-07-14T12:52:47.126450+0000","last_became_active":"2023-07-14T12:52:47.118770+0000","last_became_peered":"2023-07-14T12:52:47.118770+0000","last_unstale":"2023-07-14T12:52:47.126450+0000","last_undegraded":"2023-07-14T12:52:47.126450+0000","last_fullsized":"2023-07-14T12:52:47.126450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:20:31.282979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.115329+0000","last_change":"2023-07-14T12:52:47.112620+0000","last_active":"2023-07-14T12:52:47.115329+0000","last_peered":"2023-07-14T12:52:47.115329+0000","last_clean":"2023-07-14T12:52:47.115329+0000","last_became_active":"2023-07-14T12:52:47.112372+0000","last_became_peered":"2023-07-14T12:52:47.112372+0000","last_unstale":"2023-07-14T12:52:47.115329+0000","last_undegraded":"2023-07-14T12:52:47.115329+0000","last_fullsized":"2023-07-14T12:52:47.115329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:02:02.692874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.099683+0000","last_change":"2023-07-14T12:52:46.086638+0000","last_active":"2023-07-14T12:52:47.099683+0000","last_peered":"2023-07-14T12:52:47.099683+0000","last_clean":"2023-07-14T12:52:47.099683+0000","last_became_active":"2023-07-14T12:52:46.085797+0000","last_became_peered":"2023-07-14T12:52:46.085797+0000","last_unstale":"2023-07-14T12:52:47.099683+0000","last_undegraded":"2023-07-14T12:52:47.099683+0000","last_fullsized":"2023-07-14T12:52:47.099683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:11:04.597711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.119967+0000","last_change":"2023-07-14T12:52:47.114763+0000","last_active":"2023-07-14T12:52:47.119967+0000","last_peered":"2023-07-14T12:52:47.119967+0000","last_clean":"2023-07-14T12:52:47.119967+0000","last_became_active":"2023-07-14T12:52:47.114421+0000","last_became_peered":"2023-07-14T12:52:47.114421+0000","last_unstale":"2023-07-14T12:52:47.119967+0000","last_undegraded":"2023-07-14T12:52:47.119967+0000","last_fullsized":"2023-07-14T12:52:47.119967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:09:54.636774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.098550+0000","last_change":"2023-07-14T12:52:46.087077+0000","last_active":"2023-07-14T12:52:47.098550+0000","last_peered":"2023-07-14T12:52:47.098550+0000","last_clean":"2023-07-14T12:52:47.098550+0000","last_became_active":"2023-07-14T12:52:46.086797+0000","last_became_peered":"2023-07-14T12:52:46.086797+0000","last_unstale":"2023-07-14T12:52:47.098550+0000","last_undegraded":"2023-07-14T12:52:47.098550+0000","last_fullsized":"2023-07-14T12:52:47.098550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:28:07.388218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.126469+0000","last_change":"2023-07-14T12:52:47.118332+0000","last_active":"2023-07-14T12:52:47.126469+0000","last_peered":"2023-07-14T12:52:47.126469+0000","last_clean":"2023-07-14T12:52:47.126469+0000","last_became_active":"2023-07-14T12:52:47.118046+0000","last_became_peered":"2023-07-14T12:52:47.118046+0000","last_unstale":"2023-07-14T12:52:47.126469+0000","last_undegraded":"2023-07-14T12:52:47.126469+0000","last_fullsized":"2023-07-14T12:52:47.126469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:03:43.488480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.440448+0000","last_change":"2023-07-14T12:52:46.090684+0000","last_active":"2023-07-14T12:52:47.440448+0000","last_peered":"2023-07-14T12:52:47.440448+0000","last_clean":"2023-07-14T12:52:47.440448+0000","last_became_active":"2023-07-14T12:52:46.090365+0000","last_became_peered":"2023-07-14T12:52:46.090365+0000","last_unstale":"2023-07-14T12:52:47.440448+0000","last_undegraded":"2023-07-14T12:52:47.440448+0000","last_fullsized":"2023-07-14T12:52:47.440448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:05:38.956607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125628+0000","last_change":"2023-07-14T12:52:47.115150+0000","last_active":"2023-07-14T12:52:47.125628+0000","last_peered":"2023-07-14T12:52:47.125628+0000","last_clean":"2023-07-14T12:52:47.125628+0000","last_became_active":"2023-07-14T12:52:47.114705+0000","last_became_peered":"2023-07-14T12:52:47.114705+0000","last_unstale":"2023-07-14T12:52:47.125628+0000","last_undegraded":"2023-07-14T12:52:47.125628+0000","last_fullsized":"2023-07-14T12:52:47.125628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:11:05.608818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.440051+0000","last_change":"2023-07-14T12:52:46.089673+0000","last_active":"2023-07-14T12:52:47.440051+0000","last_peered":"2023-07-14T12:52:47.440051+0000","last_clean":"2023-07-14T12:52:47.440051+0000","last_became_active":"2023-07-14T12:52:46.088813+0000","last_became_peered":"2023-07-14T12:52:46.088813+0000","last_unstale":"2023-07-14T12:52:47.440051+0000","last_undegraded":"2023-07-14T12:52:47.440051+0000","last_fullsized":"2023-07-14T12:52:47.440051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:39:08.049218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.122620+0000","last_change":"2023-07-14T12:52:47.110872+0000","last_active":"2023-07-14T12:52:47.122620+0000","last_peered":"2023-07-14T12:52:47.122620+0000","last_clean":"2023-07-14T12:52:47.122620+0000","last_became_active":"2023-07-14T12:52:47.110526+0000","last_became_peered":"2023-07-14T12:52:47.110526+0000","last_unstale":"2023-07-14T12:52:47.122620+0000","last_undegraded":"2023-07-14T12:52:47.122620+0000","last_fullsized":"2023-07-14T12:52:47.122620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:53:34.310211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.440804+0000","last_change":"2023-07-14T12:52:46.090553+0000","last_active":"2023-07-14T12:52:47.440804+0000","last_peered":"2023-07-14T12:52:47.440804+0000","last_clean":"2023-07-14T12:52:47.440804+0000","last_became_active":"2023-07-14T12:52:46.090136+0000","last_became_peered":"2023-07-14T12:52:46.090136+0000","last_unstale":"2023-07-14T12:52:47.440804+0000","last_undegraded":"2023-07-14T12:52:47.440804+0000","last_fullsized":"2023-07-14T12:52:47.440804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:52:24.688133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125801+0000","last_change":"2023-07-14T12:52:47.118033+0000","last_active":"2023-07-14T12:52:47.125801+0000","last_peered":"2023-07-14T12:52:47.125801+0000","last_clean":"2023-07-14T12:52:47.125801+0000","last_became_active":"2023-07-14T12:52:47.117334+0000","last_became_peered":"2023-07-14T12:52:47.117334+0000","last_unstale":"2023-07-14T12:52:47.125801+0000","last_undegraded":"2023-07-14T12:52:47.125801+0000","last_fullsized":"2023-07-14T12:52:47.125801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:28:08.399324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.433426+0000","last_change":"2023-07-14T12:52:46.090568+0000","last_active":"2023-07-14T12:52:47.433426+0000","last_peered":"2023-07-14T12:52:47.433426+0000","last_clean":"2023-07-14T12:52:47.433426+0000","last_became_active":"2023-07-14T12:52:46.087626+0000","last_became_peered":"2023-07-14T12:52:46.087626+0000","last_unstale":"2023-07-14T12:52:47.433426+0000","last_undegraded":"2023-07-14T12:52:47.433426+0000","last_fullsized":"2023-07-14T12:52:47.433426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:23.277268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.128079+0000","last_change":"2023-07-14T12:52:47.126294+0000","last_active":"2023-07-14T12:52:47.128079+0000","last_peered":"2023-07-14T12:52:47.128079+0000","last_clean":"2023-07-14T12:52:47.128079+0000","last_became_active":"2023-07-14T12:52:47.125928+0000","last_became_peered":"2023-07-14T12:52:47.125928+0000","last_unstale":"2023-07-14T12:52:47.128079+0000","last_undegraded":"2023-07-14T12:52:47.128079+0000","last_fullsized":"2023-07-14T12:52:47.128079+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:30.872502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.439285+0000","last_change":"2023-07-14T12:52:46.089467+0000","last_active":"2023-07-14T12:52:47.439285+0000","last_peered":"2023-07-14T12:52:47.439285+0000","last_clean":"2023-07-14T12:52:47.439285+0000","last_became_active":"2023-07-14T12:52:46.087179+0000","last_became_peered":"2023-07-14T12:52:46.087179+0000","last_unstale":"2023-07-14T12:52:47.439285+0000","last_undegraded":"2023-07-14T12:52:47.439285+0000","last_fullsized":"2023-07-14T12:52:47.439285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:30:06.059431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.125845+0000","last_change":"2023-07-14T12:52:47.118229+0000","last_active":"2023-07-14T12:52:47.125845+0000","last_peered":"2023-07-14T12:52:47.125845+0000","last_clean":"2023-07-14T12:52:47.125845+0000","last_became_active":"2023-07-14T12:52:47.117903+0000","last_became_peered":"2023-07-14T12:52:47.117903+0000","last_unstale":"2023-07-14T12:52:47.125845+0000","last_undegraded":"2023-07-14T12:52:47.125845+0000","last_fullsized":"2023-07-14T12:52:47.125845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:05:14.396604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-14T12:52:47.439459+0000","last_change":"2023-07-14T12:52:46.089959+0000","last_active":"2023-07-14T12:52:47.439459+0000","last_peered":"2023-07-14T12:52:47.439459+0000","last_clean":"2023-07-14T12:52:47.439459+0000","last_became_active":"2023-07-14T12:52:46.089119+0000","last_became_peered":"2023-07-14T12:52:46.089119+0000","last_unstale":"2023-07-14T12:52:47.439459+0000","last_undegraded":"2023-07-14T12:52:47.439459+0000","last_fullsized":"2023-07-14T12:52:47.439459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:23.277268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":666186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":75818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31260,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340580,"statfs":{"total":96636764160,"available":96604753920,"internally_reserved":0,"allocated":217088,"data_stored":75818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31256,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340584,"statfs":{"total":96636764160,"available":96604758016,"internally_reserved":0,"allocated":212992,"data_stored":74799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31272,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340568,"statfs":{"total":96636764160,"available":96604741632,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":665167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T12:52:51.945 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-14T12:52:51.946 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-14T12:52:51.946 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-14T12:52:51.946 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-14T12:52:51.947 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-14T12:52:52.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.098+0000 7fe1aea48640 1 Processor -- start 2023-07-14T12:52:52.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.098+0000 7fe1aea48640 1 -- start start 2023-07-14T12:52:52.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1aea48640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe1a80cfd40 0x7fe1a8070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:52.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1aea48640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a80b4bf0 con 0x7fe1a8069430 2023-07-14T12:52:52.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1aea48640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a80ae8e0 con 0x7fe1a8159c70 2023-07-14T12:52:52.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1aea48640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a80ce980 con 0x7fe1a80cfd40 2023-07-14T12:52:52.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1a7fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe1a8069430 0x7fe1a8069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38838/0 (socket says 172.21.15.5:38838) 2023-07-14T12:52:52.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1a7fff640 1 -- 172.21.15.5:0/1184899993 learned_addr learned my addr 172.21.15.5:0/1184899993 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:52.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1a6ffd640 1 -- 172.21.15.5:0/1184899993 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1179454269 0 0) 0x7fe1a80b4bf0 con 0x7fe1a8069430 2023-07-14T12:52:52.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1acfe5640 1 --2- 172.21.15.5:0/1184899993 >> v2:172.21.15.154:3300/0 conn(0x7fe1a80cfd40 0x7fe1a8070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:52.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1a6ffd640 1 -- 172.21.15.5:0/1184899993 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe190003530 con 0x7fe1a8069430 2023-07-14T12:52:52.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1a6ffd640 1 -- 172.21.15.5:0/1184899993 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 881020567 0 0) 0x7fe190003530 con 0x7fe1a8069430 2023-07-14T12:52:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1a6ffd640 1 -- 172.21.15.5:0/1184899993 >> v2:172.21.15.154:3300/0 conn(0x7fe1a80cfd40 msgr2=0x7fe1a8070ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1a6ffd640 1 --2- 172.21.15.5:0/1184899993 >> v2:172.21.15.154:3300/0 conn(0x7fe1a80cfd40 0x7fe1a8070ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1a6ffd640 1 -- 172.21.15.5:0/1184899993 >> v1:172.21.15.154:6789/0 conn(0x7fe1a8159c70 legacy=0x7fe1a80703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1a6ffd640 1 -- 172.21.15.5:0/1184899993 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a806c660 con 0x7fe1a8069430 2023-07-14T12:52:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1a6ffd640 1 -- 172.21.15.5:0/1184899993 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7fe198001680 con 0x7fe1a8069430 2023-07-14T12:52:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1a6ffd640 1 -- 172.21.15.5:0/1184899993 >> v1:172.21.15.5:6789/0 conn(0x7fe1a8069430 legacy=0x7fe1a8069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1a6ffd640 1 --2- 172.21.15.5:0/1184899993 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe190003980 0x7fe190003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:52.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1a6ffd640 1 --2- 172.21.15.5:0/1184899993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1900047d0 0x7fe190004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:52.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1a6ffd640 1 --2- 172.21.15.5:0/1184899993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1900051d0 0x7fe19000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:52.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1a6ffd640 1 -- 172.21.15.5:0/1184899993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a80ce980 con 0x7fe1900051d0 2023-07-14T12:52:52.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1a6ffd640 1 -- 172.21.15.5:0/1184899993 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19000c0e0 con 0x7fe1900047d0 2023-07-14T12:52:52.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1a6ffd640 1 -- 172.21.15.5:0/1184899993 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19000c2a0 con 0x7fe190003980 2023-07-14T12:52:52.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1acfe5640 1 --2- 172.21.15.5:0/1184899993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1900051d0 0x7fe19000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:52.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1a77fe640 1 --2- 172.21.15.5:0/1184899993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1900047d0 0x7fe190004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:52.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1a7fff640 1 --2- 172.21.15.5:0/1184899993 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe190003980 0x7fe190003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:52.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1acfe5640 1 -- 172.21.15.5:0/1184899993 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe190003980 msgr2=0x7fe190003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:52.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1acfe5640 1 --2- 172.21.15.5:0/1184899993 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe190003980 0x7fe190003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:52.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1acfe5640 1 -- 172.21.15.5:0/1184899993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1900047d0 msgr2=0x7fe190004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:52.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1acfe5640 1 --2- 172.21.15.5:0/1184899993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1900047d0 0x7fe190004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:52.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.102+0000 7fe1acfe5640 1 -- 172.21.15.5:0/1184899993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a806c660 con 0x7fe1900051d0 2023-07-14T12:52:52.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.106+0000 7fe1acfe5640 1 -- 172.21.15.5:0/1184899993 reap_dead start 2023-07-14T12:52:52.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.106+0000 7fe1acfe5640 1 --2- 172.21.15.5:0/1184899993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1900051d0 0x7fe19000b990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0009f90 tx=0x7fe1a001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b88e664038adb3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:52.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.106+0000 7fe1a6ffd640 1 -- 172.21.15.5:0/1184899993 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a00a5bc0 con 0x7fe1900051d0 2023-07-14T12:52:52.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.106+0000 7fe1a6ffd640 1 -- 172.21.15.5:0/1184899993 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a000f040 con 0x7fe1900051d0 2023-07-14T12:52:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.106+0000 7fe1a6ffd640 1 -- 172.21.15.5:0/1184899993 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a00039a0 con 0x7fe1900051d0 2023-07-14T12:52:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.106+0000 7fe1aea48640 1 -- 172.21.15.5:0/1184899993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1900051d0 msgr2=0x7fe19000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.106+0000 7fe1aea48640 1 --2- 172.21.15.5:0/1184899993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1900051d0 0x7fe19000b990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0009f90 tx=0x7fe1a001cc30 comp rx=0 tx=0).stop 2023-07-14T12:52:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.106+0000 7fe1aea48640 1 -- 172.21.15.5:0/1184899993 shutdown_connections 2023-07-14T12:52:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.106+0000 7fe1aea48640 1 --2- 172.21.15.5:0/1184899993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1900051d0 0x7fe19000b990 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.106+0000 7fe1aea48640 1 -- 172.21.15.5:0/1184899993 >> 172.21.15.5:0/1184899993 conn(0x7fe1a80b1840 msgr2=0x7fe1a80cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:52.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.106+0000 7fe1aea48640 1 -- 172.21.15.5:0/1184899993 shutdown_connections 2023-07-14T12:52:52.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.106+0000 7fe1aea48640 1 -- 172.21.15.5:0/1184899993 wait complete. 2023-07-14T12:52:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.106+0000 7fe1aea48640 1 Processor -- start 2023-07-14T12:52:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.106+0000 7fe1aea48640 1 -- start start 2023-07-14T12:52:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.110+0000 7fe1aea48640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1900051d0 0x7fe1a80c5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:52.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.110+0000 7fe1aea48640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1a80afda0 0x7fe1a814ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:52.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.110+0000 7fe1aea48640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1a815c8c0 0x7fe1a815a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:52.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.110+0000 7fe1aea48640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a814b0c0 con 0x7fe1900051d0 2023-07-14T12:52:52.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.110+0000 7fe1aea48640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a80c4ca0 con 0x7fe1a815c8c0 2023-07-14T12:52:52.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.110+0000 7fe1aea48640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a80b0540 con 0x7fe1a80afda0 2023-07-14T12:52:52.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.110+0000 7fe1a7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1900051d0 0x7fe1a80c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:52.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.110+0000 7fe1a7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1900051d0 0x7fe1a80c5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52570/0 (socket says 172.21.15.5:52570) 2023-07-14T12:52:52.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.110+0000 7fe1a7fff640 1 -- 172.21.15.5:0/384849945 learned_addr learned my addr 172.21.15.5:0/384849945 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:52.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.110+0000 7fe1a77fe640 1 --2- 172.21.15.5:0/384849945 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1a80afda0 0x7fe1a814ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:52.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.110+0000 7fe1acfe5640 1 --2- 172.21.15.5:0/384849945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1a815c8c0 0x7fe1a815a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:52.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.110+0000 7fe1a7fff640 1 -- 172.21.15.5:0/384849945 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1a80afda0 msgr2=0x7fe1a814ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:52.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.110+0000 7fe1a7fff640 1 --2- 172.21.15.5:0/384849945 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1a80afda0 0x7fe1a814ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.110+0000 7fe1a7fff640 1 -- 172.21.15.5:0/384849945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1a815c8c0 msgr2=0x7fe1a815a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.110+0000 7fe1a7fff640 1 --2- 172.21.15.5:0/384849945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1a815c8c0 0x7fe1a815a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.110+0000 7fe1a7fff640 1 -- 172.21.15.5:0/384849945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a80b0260 con 0x7fe1900051d0 2023-07-14T12:52:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.110+0000 7fe1acfe5640 1 --2- 172.21.15.5:0/384849945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1a815c8c0 0x7fe1a815a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:52:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.110+0000 7fe1a7fff640 1 --2- 172.21.15.5:0/384849945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1900051d0 0x7fe1a80c5130 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe1980072e0 tx=0x7fe1980077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.110+0000 7fe1a4ff9640 1 -- 172.21.15.5:0/384849945 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19800f940 con 0x7fe1900051d0 2023-07-14T12:52:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.110+0000 7fe1a4ff9640 1 -- 172.21.15.5:0/384849945 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19800faa0 con 0x7fe1900051d0 2023-07-14T12:52:52.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.110+0000 7fe1aea48640 1 -- 172.21.15.5:0/384849945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a80c4650 con 0x7fe1900051d0 2023-07-14T12:52:52.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.110+0000 7fe1a4ff9640 1 -- 172.21.15.5:0/384849945 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19800fe50 con 0x7fe1900051d0 2023-07-14T12:52:52.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.110+0000 7fe1aea48640 1 -- 172.21.15.5:0/384849945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a815cd30 con 0x7fe1900051d0 2023-07-14T12:52:52.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.110+0000 7fe1aea48640 1 -- 172.21.15.5:0/384849945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a80678d0 con 0x7fe1900051d0 2023-07-14T12:52:52.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.114+0000 7fe1a4ff9640 1 -- 172.21.15.5:0/384849945 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe19801d460 con 0x7fe1900051d0 2023-07-14T12:52:52.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.114+0000 7fe1a4ff9640 1 --2- 172.21.15.5:0/384849945 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe1940662b0 0x7fe194068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:52.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.114+0000 7fe1a4ff9640 1 -- 172.21.15.5:0/384849945 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe198083e40 con 0x7fe1900051d0 2023-07-14T12:52:52.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.114+0000 7fe1a77fe640 1 --2- 172.21.15.5:0/384849945 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe1940662b0 0x7fe194068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:52.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.114+0000 7fe1a77fe640 1 --2- 172.21.15.5:0/384849945 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe1940662b0 0x7fe194068760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe1a815d5f0 tx=0x7fe19c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:52.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.118+0000 7fe1a4ff9640 1 -- 172.21.15.5:0/384849945 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe1980512b0 con 0x7fe1900051d0 2023-07-14T12:52:52.215 INFO:tasks.ceph.mds.d.smithi154.stderr:2023-07-14T12:52:52.191+0000 7f767d59b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T12:52:52.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.306+0000 7fe1aea48640 1 -- 172.21.15.5:0/384849945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe1a80716c0 con 0x7fe1900051d0 2023-07-14T12:52:52.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.310+0000 7fe1a4ff9640 1 -- 172.21.15.5:0/384849945 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164248 (secure 0 0 0) 0x7fe1980548d0 con 0x7fe1900051d0 2023-07-14T12:52:52.337 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:52:52.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.314+0000 7fe1aea48640 1 -- 172.21.15.5:0/384849945 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe1940662b0 msgr2=0x7fe194068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:52.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.314+0000 7fe1aea48640 1 --2- 172.21.15.5:0/384849945 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe1940662b0 0x7fe194068760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe1a815d5f0 tx=0x7fe19c009040 comp rx=0 tx=0).stop 2023-07-14T12:52:52.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.314+0000 7fe1aea48640 1 -- 172.21.15.5:0/384849945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1900051d0 msgr2=0x7fe1a80c5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:52.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.314+0000 7fe1aea48640 1 --2- 172.21.15.5:0/384849945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1900051d0 0x7fe1a80c5130 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe1980072e0 tx=0x7fe1980077a0 comp rx=0 tx=0).stop 2023-07-14T12:52:52.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.314+0000 7fe1aea48640 1 -- 172.21.15.5:0/384849945 shutdown_connections 2023-07-14T12:52:52.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.314+0000 7fe1aea48640 1 --2- 172.21.15.5:0/384849945 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe1940662b0 0x7fe194068760 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:52.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.314+0000 7fe1aea48640 1 --2- 172.21.15.5:0/384849945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1a815c8c0 0x7fe1a815a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:52.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.314+0000 7fe1aea48640 1 --2- 172.21.15.5:0/384849945 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1a80afda0 0x7fe1a814ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:52.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.314+0000 7fe1aea48640 1 --2- 172.21.15.5:0/384849945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1900051d0 0x7fe1a80c5130 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:52.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.314+0000 7fe1aea48640 1 -- 172.21.15.5:0/384849945 >> 172.21.15.5:0/384849945 conn(0x7fe1a80b1840 msgr2=0x7fe1a80cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:52.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.314+0000 7fe1aea48640 1 -- 172.21.15.5:0/384849945 shutdown_connections 2023-07-14T12:52:52.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.314+0000 7fe1aea48640 1 -- 172.21.15.5:0/384849945 wait complete. 2023-07-14T12:52:52.357 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":5,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2736441655},{"type":"v1","addr":"172.21.15.154:6833","nonce":2736441655}]},"active_addr":"172.21.15.154:6833/2736441655","active_change":"2023-07-14T12:52:25.617405+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":3140351861}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":3341947062}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":844038179}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":1533499204}]}]} 2023-07-14T12:52:52.362 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-14T12:52:52.362 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-14T12:52:52.362 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:52:52.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.478+0000 7fdf11ddf640 1 Processor -- start 2023-07-14T12:52:52.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.478+0000 7fdf11ddf640 1 -- start start 2023-07-14T12:52:52.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.482+0000 7fdf11ddf640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdf0c0c8ad0 0x7fdf0c0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:52.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.482+0000 7fdf11ddf640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf0c0c99c0 con 0x7fdf0c0c9560 2023-07-14T12:52:52.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.482+0000 7fdf11ddf640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf0c0cc700 con 0x7fdf0c158ce0 2023-07-14T12:52:52.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.482+0000 7fdf11ddf640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf0c0b0ff0 con 0x7fdf0c0c8ad0 2023-07-14T12:52:52.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.482+0000 7fdf0bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdf0c0c9560 0x7fdf0c0ccb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38844/0 (socket says 172.21.15.5:38844) 2023-07-14T12:52:52.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.482+0000 7fdf0bfff640 1 -- 172.21.15.5:0/2241647451 learned_addr learned my addr 172.21.15.5:0/2241647451 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:52.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.482+0000 7fdf0affd640 1 --2- 172.21.15.5:0/2241647451 >> v2:172.21.15.154:3300/0 conn(0x7fdf0c0c8ad0 0x7fdf0c0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:52.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.482+0000 7fdf0a7fc640 1 -- 172.21.15.5:0/2241647451 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196641450 0 0) 0x7fdf0c0c99c0 con 0x7fdf0c0c9560 2023-07-14T12:52:52.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.482+0000 7fdf0a7fc640 1 -- 172.21.15.5:0/2241647451 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdef4003530 con 0x7fdf0c0c9560 2023-07-14T12:52:52.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.482+0000 7fdf0a7fc640 1 -- 172.21.15.5:0/2241647451 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945482191 0 0) 0x7fdf0c0cc700 con 0x7fdf0c158ce0 2023-07-14T12:52:52.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.482+0000 7fdf0a7fc640 1 -- 172.21.15.5:0/2241647451 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf0c0c99c0 con 0x7fdf0c158ce0 2023-07-14T12:52:52.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.482+0000 7fdf0a7fc640 1 -- 172.21.15.5:0/2241647451 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4050405156 0 0) 0x7fdef4003530 con 0x7fdf0c0c9560 2023-07-14T12:52:52.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.482+0000 7fdf0affd640 1 -- 172.21.15.5:0/2241647451 >> v1:172.21.15.154:6789/0 conn(0x7fdf0c158ce0 legacy=0x7fdf0c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:52.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.482+0000 7fdf0affd640 1 -- 172.21.15.5:0/2241647451 >> v1:172.21.15.5:6789/0 conn(0x7fdf0c0c9560 legacy=0x7fdf0c0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:52.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.482+0000 7fdf0affd640 1 -- 172.21.15.5:0/2241647451 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0c070c80 con 0x7fdf0c0c8ad0 2023-07-14T12:52:52.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.486+0000 7fdf0affd640 1 --2- 172.21.15.5:0/2241647451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf0c0c8ad0 0x7fdf0c0c9020 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdf000097c0 tx=0x7fdf0001c250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8618834fce49f892 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:52.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.486+0000 7fdf0a7fc640 1 -- 172.21.15.5:0/2241647451 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf04001a00 con 0x7fdf0c0c8ad0 2023-07-14T12:52:52.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.486+0000 7fdf0a7fc640 1 -- 172.21.15.5:0/2241647451 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf000a7050 con 0x7fdf0c0c8ad0 2023-07-14T12:52:52.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.486+0000 7fdf0a7fc640 1 -- 172.21.15.5:0/2241647451 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf000ab620 con 0x7fdf0c0c8ad0 2023-07-14T12:52:52.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.486+0000 7fdf11ddf640 1 -- 172.21.15.5:0/2241647451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf0c0c8ad0 msgr2=0x7fdf0c0c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:52.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.486+0000 7fdf11ddf640 1 --2- 172.21.15.5:0/2241647451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf0c0c8ad0 0x7fdf0c0c9020 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdf000097c0 tx=0x7fdf0001c250 comp rx=0 tx=0).stop 2023-07-14T12:52:52.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.486+0000 7fdf11ddf640 1 -- 172.21.15.5:0/2241647451 shutdown_connections 2023-07-14T12:52:52.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.486+0000 7fdf11ddf640 1 --2- 172.21.15.5:0/2241647451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf0c0c8ad0 0x7fdf0c0c9020 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:52.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.486+0000 7fdf11ddf640 1 -- 172.21.15.5:0/2241647451 >> 172.21.15.5:0/2241647451 conn(0x7fdf0c0afcf0 msgr2=0x7fdf0c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:52.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.486+0000 7fdf11ddf640 1 -- 172.21.15.5:0/2241647451 shutdown_connections 2023-07-14T12:52:52.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.486+0000 7fdf11ddf640 1 -- 172.21.15.5:0/2241647451 wait complete. 2023-07-14T12:52:52.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.486+0000 7fdf11ddf640 1 Processor -- start 2023-07-14T12:52:52.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.486+0000 7fdf11ddf640 1 -- start start 2023-07-14T12:52:52.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.490+0000 7fdf11ddf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf0c0c8ad0 0x7fdf0c0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:52.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.490+0000 7fdf11ddf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf0c0c9560 0x7fdf0c143640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:52.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.490+0000 7fdf11ddf640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf0c158ce0 0x7fdf0c0b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:52.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.490+0000 7fdf11ddf640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c143b80 con 0x7fdf0c0c8ad0 2023-07-14T12:52:52.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.490+0000 7fdf11ddf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c0b3910 con 0x7fdf0c0c9560 2023-07-14T12:52:52.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.490+0000 7fdf11ddf640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c0c4c10 con 0x7fdf0c158ce0 2023-07-14T12:52:52.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.490+0000 7fdf0b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf0c0c8ad0 0x7fdf0c0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:52.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.490+0000 7fdf0b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf0c0c8ad0 0x7fdf0c0b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52580/0 (socket says 172.21.15.5:52580) 2023-07-14T12:52:52.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.490+0000 7fdf0b7fe640 1 -- 172.21.15.5:0/1894199664 learned_addr learned my addr 172.21.15.5:0/1894199664 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:52.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.490+0000 7fdf0affd640 1 --2- 172.21.15.5:0/1894199664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf0c0c9560 0x7fdf0c143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:52.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.490+0000 7fdf0bfff640 1 --2- 172.21.15.5:0/1894199664 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf0c158ce0 0x7fdf0c0b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:52.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.490+0000 7fdf0b7fe640 1 -- 172.21.15.5:0/1894199664 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf0c158ce0 msgr2=0x7fdf0c0b2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:52.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.490+0000 7fdf0b7fe640 1 --2- 172.21.15.5:0/1894199664 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf0c158ce0 0x7fdf0c0b2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:52.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.490+0000 7fdf0b7fe640 1 -- 172.21.15.5:0/1894199664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf0c0c9560 msgr2=0x7fdf0c143640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:52.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.490+0000 7fdf0b7fe640 1 --2- 172.21.15.5:0/1894199664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf0c0c9560 0x7fdf0c143640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:52.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.490+0000 7fdf0b7fe640 1 -- 172.21.15.5:0/1894199664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf00009420 con 0x7fdf0c0c8ad0 2023-07-14T12:52:52.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.490+0000 7fdf0b7fe640 1 --2- 172.21.15.5:0/1894199664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf0c0c8ad0 0x7fdf0c0b3da0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdefc00c430 tx=0x7fdefc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:52.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.490+0000 7fdef3fff640 1 -- 172.21.15.5:0/1894199664 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc0052d0 con 0x7fdf0c0c8ad0 2023-07-14T12:52:52.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.490+0000 7fdef3fff640 1 -- 172.21.15.5:0/1894199664 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdefc005450 con 0x7fdf0c0c8ad0 2023-07-14T12:52:52.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.490+0000 7fdf11ddf640 1 -- 172.21.15.5:0/1894199664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0c0c4650 con 0x7fdf0c0c8ad0 2023-07-14T12:52:52.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.490+0000 7fdef3fff640 1 -- 172.21.15.5:0/1894199664 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc003840 con 0x7fdf0c0c8ad0 2023-07-14T12:52:52.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.490+0000 7fdf11ddf640 1 -- 172.21.15.5:0/1894199664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0c0b35a0 con 0x7fdf0c0c8ad0 2023-07-14T12:52:52.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.490+0000 7fdf11ddf640 1 -- 172.21.15.5:0/1894199664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf0c0678d0 con 0x7fdf0c0c8ad0 2023-07-14T12:52:52.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.494+0000 7fdef3fff640 1 -- 172.21.15.5:0/1894199664 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdefc0039a0 con 0x7fdf0c0c8ad0 2023-07-14T12:52:52.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.494+0000 7fdef3fff640 1 --2- 172.21.15.5:0/1894199664 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fdef8066280 0x7fdef8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:52.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.494+0000 7fdef3fff640 1 -- 172.21.15.5:0/1894199664 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdefc0832b0 con 0x7fdf0c0c8ad0 2023-07-14T12:52:52.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.494+0000 7fdf0affd640 1 --2- 172.21.15.5:0/1894199664 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fdef8066280 0x7fdef8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:52.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.494+0000 7fdf0affd640 1 --2- 172.21.15.5:0/1894199664 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fdef8066280 0x7fdef8068730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdf000ad000 tx=0x7fdf000a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:52.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.498+0000 7fdef3fff640 1 -- 172.21.15.5:0/1894199664 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fdefc0507e0 con 0x7fdf0c0c8ad0 2023-07-14T12:52:52.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.654+0000 7fdf11ddf640 1 -- 172.21.15.5:0/1894199664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf0c0ca120 con 0x7fdf0c0c8ad0 2023-07-14T12:52:52.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.654+0000 7fdef3fff640 1 -- 172.21.15.5:0/1894199664 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18231 (secure 0 0 0) 0x7fdefc053e00 con 0x7fdf0c0c8ad0 2023-07-14T12:52:52.680 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:52:52.680 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":23,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:52:48.091483+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:52:44.223082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T12:52:45.469396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:52:52.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.654+0000 7fdf11ddf640 1 -- 172.21.15.5:0/1894199664 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fdef8066280 msgr2=0x7fdef8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:52.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.654+0000 7fdf11ddf640 1 --2- 172.21.15.5:0/1894199664 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fdef8066280 0x7fdef8068730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdf000ad000 tx=0x7fdf000a6000 comp rx=0 tx=0).stop 2023-07-14T12:52:52.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.654+0000 7fdf11ddf640 1 -- 172.21.15.5:0/1894199664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf0c0c8ad0 msgr2=0x7fdf0c0b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:52.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.654+0000 7fdf11ddf640 1 --2- 172.21.15.5:0/1894199664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf0c0c8ad0 0x7fdf0c0b3da0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdefc00c430 tx=0x7fdefc00c8f0 comp rx=0 tx=0).stop 2023-07-14T12:52:52.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.654+0000 7fdf11ddf640 1 -- 172.21.15.5:0/1894199664 shutdown_connections 2023-07-14T12:52:52.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.654+0000 7fdf11ddf640 1 --2- 172.21.15.5:0/1894199664 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf0c158ce0 0x7fdf0c0b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:52.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.654+0000 7fdf11ddf640 1 --2- 172.21.15.5:0/1894199664 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fdef8066280 0x7fdef8068730 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:52.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.654+0000 7fdf11ddf640 1 --2- 172.21.15.5:0/1894199664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf0c0c9560 0x7fdf0c143640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:52.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.654+0000 7fdf11ddf640 1 --2- 172.21.15.5:0/1894199664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf0c0c8ad0 0x7fdf0c0b3da0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:52.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.654+0000 7fdf11ddf640 1 -- 172.21.15.5:0/1894199664 >> 172.21.15.5:0/1894199664 conn(0x7fdf0c0afcf0 msgr2=0x7fdf0c1509c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:52.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.654+0000 7fdf11ddf640 1 -- 172.21.15.5:0/1894199664 shutdown_connections 2023-07-14T12:52:52.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.654+0000 7fdf11ddf640 1 -- 172.21.15.5:0/1894199664 wait complete. 2023-07-14T12:52:52.702 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-14T12:52:52.703 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:52:52.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.822+0000 7fc1a7493640 1 Processor -- start 2023-07-14T12:52:52.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.822+0000 7fc1a7493640 1 -- start start 2023-07-14T12:52:52.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.822+0000 7fc1a7493640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc1a00c0f80 0x7fc1a00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:52.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.822+0000 7fc1a7493640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a00c17d0 con 0x7fc1a00c8940 2023-07-14T12:52:52.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.822+0000 7fc1a7493640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a00c14f0 con 0x7fc1a0160330 2023-07-14T12:52:52.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.822+0000 7fc1a7493640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1a00cdd70 con 0x7fc1a00c0f80 2023-07-14T12:52:52.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.822+0000 7fc1a4a2e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc1a00c8940 0x7fc1a00cd660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38848/0 (socket says 172.21.15.5:38848) 2023-07-14T12:52:52.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.822+0000 7fc1a4a2e640 1 -- 172.21.15.5:0/3465648625 learned_addr learned my addr 172.21.15.5:0/3465648625 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:52.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.822+0000 7fc1a5a30640 1 --2- 172.21.15.5:0/3465648625 >> v2:172.21.15.5:3300/0 conn(0x7fc1a00c0f80 0x7fc1a00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:52.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.822+0000 7fc1a5a30640 1 -- 172.21.15.5:0/3465648625 >> v1:172.21.15.154:6789/0 conn(0x7fc1a0160330 legacy=0x7fc1a00ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:52.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.822+0000 7fc1a5a30640 1 -- 172.21.15.5:0/3465648625 >> v1:172.21.15.5:6789/0 conn(0x7fc1a00c8940 legacy=0x7fc1a00cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:52.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.822+0000 7fc1a5a30640 1 -- 172.21.15.5:0/3465648625 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a00cac10 con 0x7fc1a00c0f80 2023-07-14T12:52:52.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.822+0000 7fc197fff640 1 -- 172.21.15.5:0/3465648625 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3863039625 0 0) 0x7fc1a00c17d0 con 0x7fc1a00c8940 2023-07-14T12:52:52.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.826+0000 7fc1a5a30640 1 --2- 172.21.15.5:0/3465648625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1a00c0f80 0x7fc1a00cb6f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc198009d90 tx=0x7fc19801f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f5f493fd4430e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:52.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.826+0000 7fc197fff640 1 -- 172.21.15.5:0/3465648625 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1980af600 con 0x7fc1a00c0f80 2023-07-14T12:52:52.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.826+0000 7fc197fff640 1 -- 172.21.15.5:0/3465648625 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1980ab050 con 0x7fc1a00c0f80 2023-07-14T12:52:52.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.826+0000 7fc197fff640 1 -- 172.21.15.5:0/3465648625 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1980af980 con 0x7fc1a00c0f80 2023-07-14T12:52:52.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.826+0000 7fc1a7493640 1 -- 172.21.15.5:0/3465648625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1a00c0f80 msgr2=0x7fc1a00cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:52.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.826+0000 7fc1a7493640 1 --2- 172.21.15.5:0/3465648625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1a00c0f80 0x7fc1a00cb6f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc198009d90 tx=0x7fc19801f130 comp rx=0 tx=0).stop 2023-07-14T12:52:52.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.826+0000 7fc1a7493640 1 -- 172.21.15.5:0/3465648625 shutdown_connections 2023-07-14T12:52:52.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.826+0000 7fc1a7493640 1 --2- 172.21.15.5:0/3465648625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1a00c0f80 0x7fc1a00cb6f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:52.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.826+0000 7fc1a7493640 1 -- 172.21.15.5:0/3465648625 >> 172.21.15.5:0/3465648625 conn(0x7fc1a00afcf0 msgr2=0x7fc1a00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:52.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.826+0000 7fc1a7493640 1 -- 172.21.15.5:0/3465648625 shutdown_connections 2023-07-14T12:52:52.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.826+0000 7fc1a7493640 1 -- 172.21.15.5:0/3465648625 wait complete. 2023-07-14T12:52:52.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.830+0000 7fc1a7493640 1 Processor -- start 2023-07-14T12:52:52.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.830+0000 7fc1a7493640 1 -- start start 2023-07-14T12:52:52.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.830+0000 7fc1a7493640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1a00c0f80 0x7fc1a01559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:52.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.830+0000 7fc1a7493640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1a00c8940 0x7fc1a00c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:52.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.830+0000 7fc1a7493640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1a0160330 0x7fc1a00b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:52.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.830+0000 7fc1a7493640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a00b1090 con 0x7fc1a00c8940 2023-07-14T12:52:52.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.830+0000 7fc1a7493640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a00c6f30 con 0x7fc1a00c0f80 2023-07-14T12:52:52.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.830+0000 7fc1a7493640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a00b1330 con 0x7fc1a0160330 2023-07-14T12:52:52.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.830+0000 7fc1a4a2e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1a00c8940 0x7fc1a00c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:52.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.830+0000 7fc1a4a2e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1a00c8940 0x7fc1a00c6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52598/0 (socket says 172.21.15.5:52598) 2023-07-14T12:52:52.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.830+0000 7fc1a4a2e640 1 -- 172.21.15.5:0/3476049393 learned_addr learned my addr 172.21.15.5:0/3476049393 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:52.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.830+0000 7fc1a5a30640 1 --2- 172.21.15.5:0/3476049393 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1a0160330 0x7fc1a00b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:52.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.830+0000 7fc1a4a2e640 1 -- 172.21.15.5:0/3476049393 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1a0160330 msgr2=0x7fc1a00b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:52.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.830+0000 7fc1a522f640 1 --2- 172.21.15.5:0/3476049393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1a00c0f80 0x7fc1a01559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:52.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.830+0000 7fc1a4a2e640 1 --2- 172.21.15.5:0/3476049393 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1a0160330 0x7fc1a00b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:52.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.830+0000 7fc1a4a2e640 1 -- 172.21.15.5:0/3476049393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1a00c0f80 msgr2=0x7fc1a01559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:52.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.830+0000 7fc1a4a2e640 1 --2- 172.21.15.5:0/3476049393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1a00c0f80 0x7fc1a01559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:52.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.830+0000 7fc1a4a2e640 1 -- 172.21.15.5:0/3476049393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc198009a70 con 0x7fc1a00c8940 2023-07-14T12:52:52.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.830+0000 7fc1a5a30640 1 --2- 172.21.15.5:0/3476049393 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1a0160330 0x7fc1a00b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:52:52.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.830+0000 7fc1a522f640 1 --2- 172.21.15.5:0/3476049393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1a00c0f80 0x7fc1a01559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:52:52.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.830+0000 7fc1a4a2e640 1 --2- 172.21.15.5:0/3476049393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1a00c8940 0x7fc1a00c6670 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc19000c4a0 tx=0x7fc19000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:52.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.830+0000 7fc195ffb640 1 -- 172.21.15.5:0/3476049393 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1900074e0 con 0x7fc1a00c8940 2023-07-14T12:52:52.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.830+0000 7fc195ffb640 1 -- 172.21.15.5:0/3476049393 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc190007640 con 0x7fc1a00c8940 2023-07-14T12:52:52.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.830+0000 7fc195ffb640 1 -- 172.21.15.5:0/3476049393 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc190004a30 con 0x7fc1a00c8940 2023-07-14T12:52:52.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.830+0000 7fc1a7493640 1 -- 172.21.15.5:0/3476049393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a00b1610 con 0x7fc1a00c8940 2023-07-14T12:52:52.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.834+0000 7fc1a7493640 1 -- 172.21.15.5:0/3476049393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a00c6bb0 con 0x7fc1a00c8940 2023-07-14T12:52:52.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.834+0000 7fc1a7493640 1 -- 172.21.15.5:0/3476049393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a00678d0 con 0x7fc1a00c8940 2023-07-14T12:52:52.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.834+0000 7fc195ffb640 1 -- 172.21.15.5:0/3476049393 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc190004b90 con 0x7fc1a00c8940 2023-07-14T12:52:52.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.834+0000 7fc195ffb640 1 --2- 172.21.15.5:0/3476049393 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc184066280 0x7fc184068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:52.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.834+0000 7fc195ffb640 1 -- 172.21.15.5:0/3476049393 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc190083080 con 0x7fc1a00c8940 2023-07-14T12:52:52.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.834+0000 7fc1a522f640 1 --2- 172.21.15.5:0/3476049393 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc184066280 0x7fc184068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:52.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.834+0000 7fc1a522f640 1 --2- 172.21.15.5:0/3476049393 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc184066280 0x7fc184068730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc19c000f70 tx=0x7fc19c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:52.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.838+0000 7fc195ffb640 1 -- 172.21.15.5:0/3476049393 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc1900b3720 con 0x7fc1a00c8940 2023-07-14T12:52:53.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.994+0000 7fc1a7493640 1 -- 172.21.15.5:0/3476049393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1a0066810 con 0x7fc1a00c8940 2023-07-14T12:52:53.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.994+0000 7fc195ffb640 1 -- 172.21.15.5:0/3476049393 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18231 (secure 0 0 0) 0x7fc190018070 con 0x7fc1a00c8940 2023-07-14T12:52:53.022 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:52:53.022 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":23,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:52:48.091483+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:52:44.223082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T12:52:45.469396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:52:53.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.998+0000 7fc1a7493640 1 -- 172.21.15.5:0/3476049393 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc184066280 msgr2=0x7fc184068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.998+0000 7fc1a7493640 1 --2- 172.21.15.5:0/3476049393 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc184066280 0x7fc184068730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc19c000f70 tx=0x7fc19c009040 comp rx=0 tx=0).stop 2023-07-14T12:52:53.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.998+0000 7fc1a7493640 1 -- 172.21.15.5:0/3476049393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1a00c8940 msgr2=0x7fc1a00c6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.998+0000 7fc1a7493640 1 --2- 172.21.15.5:0/3476049393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1a00c8940 0x7fc1a00c6670 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc19000c4a0 tx=0x7fc19000c960 comp rx=0 tx=0).stop 2023-07-14T12:52:53.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.998+0000 7fc1a7493640 1 -- 172.21.15.5:0/3476049393 shutdown_connections 2023-07-14T12:52:53.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.998+0000 7fc1a7493640 1 --2- 172.21.15.5:0/3476049393 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1a0160330 0x7fc1a00b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.998+0000 7fc1a7493640 1 --2- 172.21.15.5:0/3476049393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1a00c8940 0x7fc1a00c6670 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.998+0000 7fc1a7493640 1 --2- 172.21.15.5:0/3476049393 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc184066280 0x7fc184068730 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.998+0000 7fc1a7493640 1 --2- 172.21.15.5:0/3476049393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1a00c0f80 0x7fc1a01559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.998+0000 7fc1a7493640 1 -- 172.21.15.5:0/3476049393 >> 172.21.15.5:0/3476049393 conn(0x7fc1a00afcf0 msgr2=0x7fc1a00cbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:53.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.998+0000 7fc1a7493640 1 -- 172.21.15.5:0/3476049393 shutdown_connections 2023-07-14T12:52:53.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:52.998+0000 7fc1a7493640 1 -- 172.21.15.5:0/3476049393 wait complete. 2023-07-14T12:52:53.043 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-14T12:52:53.043 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-14T12:52:53.044 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-14T12:52:53.044 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-14T12:52:53.045 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-14T12:52:53.045 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-14T12:52:53.046 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-14T12:52:53.046 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-14T12:52:53.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.266+0000 7f257d2ca640 1 Processor -- start 2023-07-14T12:52:53.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.266+0000 7f5218974640 1 Processor -- start 2023-07-14T12:52:53.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.266+0000 7f5218974640 1 -- start start 2023-07-14T12:52:53.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.266+0000 7f257d2ca640 1 -- start start 2023-07-14T12:52:53.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.266+0000 7f257d2ca640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f257815ff10 0x7f25780c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f5218974640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f521406c100 0x7f52140cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f257d2ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25780c1340 0x7f25780cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f257d2ca640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f25780cd3a0 0x7f2578069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f257d2ca640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f257806aff0 con 0x7f257815ff10 2023-07-14T12:52:53.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f257d2ca640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25780cd800 con 0x7f25780cd3a0 2023-07-14T12:52:53.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f257d2ca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257806eef0 con 0x7f25780c1340 2023-07-14T12:52:53.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f5218974640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f521406f7e0 0x7f521406fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f5218974640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52140ccce0 con 0x7f521406c4d0 2023-07-14T12:52:53.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f5218974640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52140ccfc0 con 0x7f521406f7e0 2023-07-14T12:52:53.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f5218974640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52140cd2a0 con 0x7f521406c100 2023-07-14T12:52:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f2576ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f257815ff10 0x7f25780c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f2576ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f257815ff10 0x7f25780c0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52600/0 (socket says 172.21.15.5:52600) 2023-07-14T12:52:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f2576ffd640 1 -- 172.21.15.5:0/915124360 learned_addr learned my addr 172.21.15.5:0/915124360 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f5212d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f521406f7e0 0x7f521406fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f5212d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f521406f7e0 0x7f521406fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52616/0 (socket says 172.21.15.5:52616) 2023-07-14T12:52:53.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f5212d9d640 1 -- 172.21.15.5:0/3778402621 learned_addr learned my addr 172.21.15.5:0/3778402621 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:53.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f521259c640 1 --2- 172.21.15.5:0/3778402621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f521406c100 0x7f52140cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f25777fe640 1 --2- 172.21.15.5:0/915124360 >> v2:172.21.15.154:3300/0 conn(0x7f25780cd3a0 0x7f2578069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f2576ffd640 1 -- 172.21.15.5:0/915124360 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25780c1340 msgr2=0x7f25780cce60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T12:52:53.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f5212d9d640 1 -- 172.21.15.5:0/3778402621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f521406c100 msgr2=0x7f52140cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:53.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f5212d9d640 1 --2- 172.21.15.5:0/3778402621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f521406c100 0x7f52140cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f5212d9d640 1 -- 172.21.15.5:0/3778402621 >> v1:172.21.15.154:6789/0 conn(0x7f521406c4d0 legacy=0x7f52140c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f5212d9d640 1 -- 172.21.15.5:0/3778402621 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52140cd580 con 0x7f521406f7e0 2023-07-14T12:52:53.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f2576ffd640 1 --2- 172.21.15.5:0/915124360 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25780c1340 0x7f25780cce60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f2576ffd640 1 -- 172.21.15.5:0/915124360 >> v2:172.21.15.154:3300/0 conn(0x7f25780cd3a0 msgr2=0x7f2578069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:53.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f2576ffd640 1 --2- 172.21.15.5:0/915124360 >> v2:172.21.15.154:3300/0 conn(0x7f25780cd3a0 0x7f2578069430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f2576ffd640 1 -- 172.21.15.5:0/915124360 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25780cc020 con 0x7f257815ff10 2023-07-14T12:52:53.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.270+0000 7f25777fe640 1 --2- 172.21.15.5:0/915124360 >> v2:172.21.15.154:3300/0 conn(0x7f25780cd3a0 0x7f2578069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:52:53.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.274+0000 7f5212d9d640 1 --2- 172.21.15.5:0/3778402621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f521406f7e0 0x7f521406fc30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5204009ad0 tx=0x7f520401efb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8870fb19415bbfd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.274+0000 7f2576ffd640 1 --2- 172.21.15.5:0/915124360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257815ff10 0x7f25780c0e00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f257806e990 tx=0x7f257001c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3565ee9a9890c23b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.274+0000 7f521159a640 1 -- 172.21.15.5:0/3778402621 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52040a8c90 con 0x7f521406f7e0 2023-07-14T12:52:53.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.274+0000 7f521159a640 1 -- 172.21.15.5:0/3778402621 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52040a8df0 con 0x7f521406f7e0 2023-07-14T12:52:53.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.274+0000 7f521159a640 1 -- 172.21.15.5:0/3778402621 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52040b0660 con 0x7f521406f7e0 2023-07-14T12:52:53.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.274+0000 7f2575ffb640 1 -- 172.21.15.5:0/915124360 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25700a5580 con 0x7f257815ff10 2023-07-14T12:52:53.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.274+0000 7f2575ffb640 1 -- 172.21.15.5:0/915124360 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25700a56e0 con 0x7f257815ff10 2023-07-14T12:52:53.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.274+0000 7f2575ffb640 1 -- 172.21.15.5:0/915124360 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25700a5a70 con 0x7f257815ff10 2023-07-14T12:52:53.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7fa06e27b640 1 Processor -- start 2023-07-14T12:52:53.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7f5218974640 1 -- 172.21.15.5:0/3778402621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f521406f7e0 msgr2=0x7f521406fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7f5218974640 1 --2- 172.21.15.5:0/3778402621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f521406f7e0 0x7f521406fc30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5204009ad0 tx=0x7f520401efb0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7fa06e27b640 1 -- start start 2023-07-14T12:52:53.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7f5218974640 1 -- 172.21.15.5:0/3778402621 shutdown_connections 2023-07-14T12:52:53.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7f5218974640 1 --2- 172.21.15.5:0/3778402621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f521406f7e0 0x7f521406fc30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7f5218974640 1 --2- 172.21.15.5:0/3778402621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f521406c100 0x7f52140cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7f5218974640 1 -- 172.21.15.5:0/3778402621 >> 172.21.15.5:0/3778402621 conn(0x7f52140ce9d0 msgr2=0x7f52140ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:53.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7f5218974640 1 -- 172.21.15.5:0/3778402621 shutdown_connections 2023-07-14T12:52:53.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7f257d2ca640 1 -- 172.21.15.5:0/915124360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257815ff10 msgr2=0x7f25780c0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7f257d2ca640 1 --2- 172.21.15.5:0/915124360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257815ff10 0x7f25780c0e00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f257806e990 tx=0x7f257001c720 comp rx=0 tx=0).stop 2023-07-14T12:52:53.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7f257d2ca640 1 -- 172.21.15.5:0/915124360 shutdown_connections 2023-07-14T12:52:53.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7f257d2ca640 1 --2- 172.21.15.5:0/915124360 >> v2:172.21.15.154:3300/0 conn(0x7f25780cd3a0 0x7f2578069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7f257d2ca640 1 --2- 172.21.15.5:0/915124360 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25780c1340 0x7f25780cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7f257d2ca640 1 --2- 172.21.15.5:0/915124360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257815ff10 0x7f25780c0e00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7f257d2ca640 1 -- 172.21.15.5:0/915124360 >> 172.21.15.5:0/915124360 conn(0x7f25780ce9d0 msgr2=0x7f25780ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:53.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7f257d2ca640 1 -- 172.21.15.5:0/915124360 shutdown_connections 2023-07-14T12:52:53.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7f5218974640 1 -- 172.21.15.5:0/3778402621 wait complete. 2023-07-14T12:52:53.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7fa06e27b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0680cb280 0x7fa068069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7fa06e27b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa068069970 0x7fa0680c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7fa06e27b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0680cdac0 con 0x7fa06815bc30 2023-07-14T12:52:53.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7fa06e27b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa06806c060 con 0x7fa0680cb280 2023-07-14T12:52:53.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7fa06e27b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa068069d90 con 0x7fa068069970 2023-07-14T12:52:53.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7f257d2ca640 1 -- 172.21.15.5:0/915124360 wait complete. 2023-07-14T12:52:53.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7fa0677fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0680cb280 0x7fa068069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7fa0677fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0680cb280 0x7fa068069430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52620/0 (socket says 172.21.15.5:52620) 2023-07-14T12:52:53.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7fa0677fe640 1 -- 172.21.15.5:0/2884876646 learned_addr learned my addr 172.21.15.5:0/2884876646 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:53.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7fa06c818640 1 --2- 172.21.15.5:0/2884876646 >> v2:172.21.15.154:3300/0 conn(0x7fa068069970 0x7fa0680c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7fa06c818640 1 -- 172.21.15.5:0/2884876646 >> v2:172.21.15.5:3300/0 conn(0x7fa0680cb280 msgr2=0x7fa068069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:53.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7fa06c818640 1 --2- 172.21.15.5:0/2884876646 >> v2:172.21.15.5:3300/0 conn(0x7fa0680cb280 0x7fa068069430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.278+0000 7fa06c818640 1 -- 172.21.15.5:0/2884876646 >> v1:172.21.15.154:6789/0 conn(0x7fa06815bc30 legacy=0x7fa0680cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7fa06c818640 1 -- 172.21.15.5:0/2884876646 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06806baa0 con 0x7fa068069970 2023-07-14T12:52:53.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7fa066ffd640 1 -- 172.21.15.5:0/2884876646 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4211082325 0 0) 0x7fa0680cdac0 con 0x7fa06815bc30 2023-07-14T12:52:53.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f5218974640 1 Processor -- start 2023-07-14T12:52:53.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f5218974640 1 -- start start 2023-07-14T12:52:53.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f5218974640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f521406c100 0x7f52141eef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f5218974640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f521406c4d0 0x7f5214152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f257d2ca640 1 Processor -- start 2023-07-14T12:52:53.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f5218974640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f521406f7e0 0x7f521415aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f5218974640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52140c5e90 con 0x7f521406c100 2023-07-14T12:52:53.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f5218974640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52140c5280 con 0x7f521406c4d0 2023-07-14T12:52:53.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f5218974640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52140c5560 con 0x7f521406f7e0 2023-07-14T12:52:53.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f5211d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f521406c4d0 0x7f5214152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f5211d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f521406c4d0 0x7f5214152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:44958/0 (socket says 172.21.15.5:44958) 2023-07-14T12:52:53.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f5211d9b640 1 -- 172.21.15.5:0/1098662252 learned_addr learned my addr 172.21.15.5:0/1098662252 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:53.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f521259c640 1 --2- 172.21.15.5:0/1098662252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f521406c100 0x7f52141eef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f257d2ca640 1 -- start start 2023-07-14T12:52:53.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f257d2ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25780c1340 0x7f25780b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f5212d9d640 1 --2- 172.21.15.5:0/1098662252 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f521406f7e0 0x7f521415aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f5211d9b640 1 -- 172.21.15.5:0/1098662252 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f521406f7e0 msgr2=0x7f521415aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f5211d9b640 1 --2- 172.21.15.5:0/1098662252 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f521406f7e0 0x7f521415aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f5211d9b640 1 -- 172.21.15.5:0/1098662252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f521406c100 msgr2=0x7f52141eef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f5211d9b640 1 --2- 172.21.15.5:0/1098662252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f521406c100 0x7f52141eef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f5211d9b640 1 -- 172.21.15.5:0/1098662252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52040094d0 con 0x7f521406c4d0 2023-07-14T12:52:53.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f5211d9b640 1 --2- 172.21.15.5:0/1098662252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f521406c4d0 0x7f5214152280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f520800c400 tx=0x7f520800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f257d2ca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25780cd3a0 0x7f25780c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f257d2ca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257815ff10 0x7f25780af890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f257d2ca640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25780c2550 con 0x7f257815ff10 2023-07-14T12:52:53.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f257d2ca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25780c2970 con 0x7f25780cd3a0 2023-07-14T12:52:53.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f257d2ca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25780c18d0 con 0x7f25780c1340 2023-07-14T12:52:53.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f2576ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25780c1340 0x7f25780b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f2576ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25780c1340 0x7f25780b27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:54824/0 (socket says 172.21.15.5:54824) 2023-07-14T12:52:53.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f2576ffd640 1 -- 172.21.15.5:0/661100838 learned_addr learned my addr 172.21.15.5:0/661100838 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:53.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f25767fc640 1 --2- 172.21.15.5:0/661100838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25780cd3a0 0x7f25780c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.282+0000 7f9a864d8640 1 Processor -- start 2023-07-14T12:52:53.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f25777fe640 1 --2- 172.21.15.5:0/661100838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257815ff10 0x7f25780af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f5202ffd640 1 -- 172.21.15.5:0/1098662252 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52080052d0 con 0x7f521406c4d0 2023-07-14T12:52:53.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f5202ffd640 1 -- 172.21.15.5:0/1098662252 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5208005430 con 0x7f521406c4d0 2023-07-14T12:52:53.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f5202ffd640 1 -- 172.21.15.5:0/1098662252 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5208003840 con 0x7f521406c4d0 2023-07-14T12:52:53.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f5218974640 1 -- 172.21.15.5:0/1098662252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f521406caa0 con 0x7f521406c4d0 2023-07-14T12:52:53.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f5218974640 1 -- 172.21.15.5:0/1098662252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52140c5b20 con 0x7f521406c4d0 2023-07-14T12:52:53.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f2576ffd640 1 -- 172.21.15.5:0/661100838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25780cd3a0 msgr2=0x7f25780c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f2576ffd640 1 --2- 172.21.15.5:0/661100838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25780cd3a0 0x7f25780c36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f2576ffd640 1 -- 172.21.15.5:0/661100838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257815ff10 msgr2=0x7f25780af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f2576ffd640 1 --2- 172.21.15.5:0/661100838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f257815ff10 0x7f25780af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f2576ffd640 1 -- 172.21.15.5:0/661100838 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2570009b30 con 0x7f25780c1340 2023-07-14T12:52:53.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7fa06c818640 1 --2- 172.21.15.5:0/2884876646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa068069970 0x7fa0680c8c30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa0680cdcd0 tx=0x7fa06001c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89a81e30520da29e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f2576ffd640 1 --2- 172.21.15.5:0/661100838 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25780c1340 0x7f25780b27d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f25700af040 tx=0x7f25700194c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f5218974640 1 -- 172.21.15.5:0/1098662252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f521406c920 con 0x7f521406c4d0 2023-07-14T12:52:53.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7fa066ffd640 1 -- 172.21.15.5:0/2884876646 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0600a5880 con 0x7fa068069970 2023-07-14T12:52:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7fa066ffd640 1 -- 172.21.15.5:0/2884876646 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0600a59e0 con 0x7fa068069970 2023-07-14T12:52:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7fa066ffd640 1 -- 172.21.15.5:0/2884876646 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0600a5d70 con 0x7fa068069970 2023-07-14T12:52:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f9a864d8640 1 -- start start 2023-07-14T12:52:53.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f9a864d8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9a80157990 0x7f9a800c8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f9a864d8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a80158fb0 con 0x7f9a800ca0b0 2023-07-14T12:52:53.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f9a864d8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a800cb6a0 con 0x7f9a8006b700 2023-07-14T12:52:53.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f9a864d8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a8006bb80 con 0x7f9a80157990 2023-07-14T12:52:53.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f9a84a75640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9a8006b700 0x7f9a80069430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:58000/0 (socket says 172.21.15.5:58000) 2023-07-14T12:52:53.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f9a84a75640 1 -- 172.21.15.5:0/2391498422 learned_addr learned my addr 172.21.15.5:0/2391498422 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:53.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7fa06e27b640 1 -- 172.21.15.5:0/2884876646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa068069970 msgr2=0x7fa0680c8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7fa06e27b640 1 --2- 172.21.15.5:0/2884876646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa068069970 0x7fa0680c8c30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa0680cdcd0 tx=0x7fa06001c7e0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f9a7effd640 1 -- 172.21.15.5:0/2391498422 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730352853 0 0) 0x7f9a800cb6a0 con 0x7f9a8006b700 2023-07-14T12:52:53.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f9a7effd640 1 -- 172.21.15.5:0/2391498422 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a68003530 con 0x7f9a8006b700 2023-07-14T12:52:53.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f255f7fe640 1 -- 172.21.15.5:0/661100838 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25700b8670 con 0x7f25780c1340 2023-07-14T12:52:53.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f255f7fe640 1 -- 172.21.15.5:0/661100838 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25700b87d0 con 0x7f25780c1340 2023-07-14T12:52:53.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f255f7fe640 1 -- 172.21.15.5:0/661100838 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25700b8b80 con 0x7f25780c1340 2023-07-14T12:52:53.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f257d2ca640 1 -- 172.21.15.5:0/661100838 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25780c1bb0 con 0x7f25780c1340 2023-07-14T12:52:53.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f257d2ca640 1 -- 172.21.15.5:0/661100838 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25780c2170 con 0x7f25780c1340 2023-07-14T12:52:53.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7fa06e27b640 1 -- 172.21.15.5:0/2884876646 shutdown_connections 2023-07-14T12:52:53.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7fa06e27b640 1 --2- 172.21.15.5:0/2884876646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa068069970 0x7fa0680c8c30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7fa06e27b640 1 --2- 172.21.15.5:0/2884876646 >> v2:172.21.15.5:3300/0 conn(0x7fa0680cb280 0x7fa068069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7fa06e27b640 1 -- 172.21.15.5:0/2884876646 >> 172.21.15.5:0/2884876646 conn(0x7fa0680ce980 msgr2=0x7fa0680ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:53.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.286+0000 7f9a7ffff640 1 --2- 172.21.15.5:0/2391498422 >> v2:172.21.15.5:3300/0 conn(0x7f9a80157990 0x7f9a800c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7fa06e27b640 1 -- 172.21.15.5:0/2884876646 shutdown_connections 2023-07-14T12:52:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7fa06e27b640 1 -- 172.21.15.5:0/2884876646 wait complete. 2023-07-14T12:52:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f257d2ca640 1 -- 172.21.15.5:0/661100838 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f25781602e0 con 0x7f25780c1340 2023-07-14T12:52:53.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f5202ffd640 1 -- 172.21.15.5:0/1098662252 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f52080039a0 con 0x7f521406c4d0 2023-07-14T12:52:53.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f9a7effd640 1 -- 172.21.15.5:0/2391498422 <== mon.1 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1827826155 0 0) 0x7f9a68003530 con 0x7f9a8006b700 2023-07-14T12:52:53.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f9a7effd640 1 -- 172.21.15.5:0/2391498422 >> v2:172.21.15.5:3300/0 conn(0x7f9a80157990 msgr2=0x7f9a800c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:53.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f9a7effd640 1 --2- 172.21.15.5:0/2391498422 >> v2:172.21.15.5:3300/0 conn(0x7f9a80157990 0x7f9a800c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f9a7effd640 1 -- 172.21.15.5:0/2391498422 >> v1:172.21.15.5:6789/0 conn(0x7f9a800ca0b0 legacy=0x7f9a8006aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:53.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f9a7effd640 1 -- 172.21.15.5:0/2391498422 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a800ca550 con 0x7f9a8006b700 2023-07-14T12:52:53.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f9a7effd640 1 -- 172.21.15.5:0/2391498422 <== mon.1 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f9a70001660 con 0x7f9a8006b700 2023-07-14T12:52:53.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f9a7effd640 1 -- 172.21.15.5:0/2391498422 >> v1:172.21.15.154:6789/0 conn(0x7f9a8006b700 legacy=0x7f9a80069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f9a7effd640 1 --2- 172.21.15.5:0/2391498422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a68003980 0x7f9a68003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f9a7effd640 1 --2- 172.21.15.5:0/2391498422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a680047d0 0x7f9a68004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f9a7effd640 1 --2- 172.21.15.5:0/2391498422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a68005180 0x7f9a6800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f9a7effd640 1 -- 172.21.15.5:0/2391498422 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8006bb80 con 0x7f9a68005180 2023-07-14T12:52:53.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f9a7effd640 1 -- 172.21.15.5:0/2391498422 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6800c190 con 0x7f9a68003980 2023-07-14T12:52:53.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f9a7effd640 1 -- 172.21.15.5:0/2391498422 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6800c350 con 0x7f9a680047d0 2023-07-14T12:52:53.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f28e3b03640 1 Processor -- start 2023-07-14T12:52:53.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f9a84a75640 1 --2- 172.21.15.5:0/2391498422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a68005180 0x7f9a6800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f9a7f7fe640 1 --2- 172.21.15.5:0/2391498422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a680047d0 0x7f9a68004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f9a7ffff640 1 --2- 172.21.15.5:0/2391498422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a68003980 0x7f9a68003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f28e3b03640 1 -- start start 2023-07-14T12:52:53.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f9a7ffff640 1 -- 172.21.15.5:0/2391498422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a680047d0 msgr2=0x7f9a68004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:53.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f9a7ffff640 1 --2- 172.21.15.5:0/2391498422 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a680047d0 0x7f9a68004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f9a7ffff640 1 -- 172.21.15.5:0/2391498422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a68005180 msgr2=0x7f9a6800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:53.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f9a7ffff640 1 --2- 172.21.15.5:0/2391498422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a68005180 0x7f9a6800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f9a7ffff640 1 -- 172.21.15.5:0/2391498422 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a800ca550 con 0x7f9a68003980 2023-07-14T12:52:53.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f5202ffd640 1 --2- 172.21.15.5:0/1098662252 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f51f4066350 0x7f51f4068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f9a84a75640 1 -- 172.21.15.5:0/2391498422 reap_dead start 2023-07-14T12:52:53.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f5202ffd640 1 -- 172.21.15.5:0/1098662252 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5208083650 con 0x7f521406c4d0 2023-07-14T12:52:53.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f09db40b640 1 Processor -- start 2023-07-14T12:52:53.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f521259c640 1 --2- 172.21.15.5:0/1098662252 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f51f4066350 0x7f51f4068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f5202ffd640 1 --2- 172.21.15.5:0/1098662252 >> [v2:172.21.15.5:6809/3251687665,v1:172.21.15.5:6811/3251687665] conn(0x7f51f406ec00 0x7f51f4071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f521259c640 1 --2- 172.21.15.5:0/1098662252 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f51f4066350 0x7f51f4068800 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f520c0073f0 tx=0x7f520c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f5202ffd640 1 -- 172.21.15.5:0/1098662252 --> [v2:172.21.15.5:6809/3251687665,v1:172.21.15.5:6811/3251687665] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f51f40716c0 con 0x7f51f406ec00 2023-07-14T12:52:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f5202ffd640 1 -- 172.21.15.5:0/1098662252 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5208083a00 con 0x7f521406c4d0 2023-07-14T12:52:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f28e3b03640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f28dc06bb40 0x7f28dc069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f28e3b03640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28dc0b3990 0x7f28dc069970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f28e3b03640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28dc159d70 con 0x7f28dc06bf10 2023-07-14T12:52:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f28e3b03640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28dc15d500 con 0x7f28dc06bb40 2023-07-14T12:52:53.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f28e3b03640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc15d7a0 con 0x7f28dc0b3990 2023-07-14T12:52:53.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f5212d9d640 1 --2- 172.21.15.5:0/1098662252 >> [v2:172.21.15.5:6809/3251687665,v1:172.21.15.5:6811/3251687665] conn(0x7f51f406ec00 0x7f51f4071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f28e20a0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28dc0b3990 0x7f28dc069970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f28e109e640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f28dc06bf10 0x7f28dc0b3280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:58008/0 (socket says 172.21.15.5:58008) 2023-07-14T12:52:53.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f28e109e640 1 -- 172.21.15.5:0/3985446839 learned_addr learned my addr 172.21.15.5:0/3985446839 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:53.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f3fdf893640 1 Processor -- start 2023-07-14T12:52:53.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7fa06e27b640 1 Processor -- start 2023-07-14T12:52:53.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7fa06e27b640 1 -- start start 2023-07-14T12:52:53.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f255f7fe640 1 -- 172.21.15.5:0/661100838 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f25700b8ce0 con 0x7f25780c1340 2023-07-14T12:52:53.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f28e089d640 1 -- 172.21.15.5:0/3985446839 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3967159619 0 0) 0x7f28dc159d70 con 0x7f28dc06bf10 2023-07-14T12:52:53.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f28e089d640 1 -- 172.21.15.5:0/3985446839 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28c8003530 con 0x7f28dc06bf10 2023-07-14T12:52:53.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.290+0000 7f09db40b640 1 -- start start 2023-07-14T12:52:53.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f09db40b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09d40b42c0 0x7f09d406a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f09db40b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09d40cee90 0x7f09d40d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f09db40b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d40cf2f0 con 0x7f09d40b7a10 2023-07-14T12:52:53.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f09db40b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d40cff30 con 0x7f09d40b42c0 2023-07-14T12:52:53.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f09db40b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d40ccee0 con 0x7f09d40cee90 2023-07-14T12:52:53.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f3fdf893640 1 -- start start 2023-07-14T12:52:53.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f28e089d640 1 -- 172.21.15.5:0/3985446839 <== mon.1 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3129842391 0 0) 0x7f28c8003530 con 0x7f28dc06bf10 2023-07-14T12:52:53.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f28e089d640 1 -- 172.21.15.5:0/3985446839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28dc0b3990 msgr2=0x7f28dc069970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f28e089d640 1 --2- 172.21.15.5:0/3985446839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28dc0b3990 0x7f28dc069970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f28e089d640 1 -- 172.21.15.5:0/3985446839 >> v2:172.21.15.5:3300/0 conn(0x7f28dc06bb40 msgr2=0x7f28dc069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f28e089d640 1 --2- 172.21.15.5:0/3985446839 >> v2:172.21.15.5:3300/0 conn(0x7f28dc06bb40 0x7f28dc069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f28e089d640 1 -- 172.21.15.5:0/3985446839 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28dc15da80 con 0x7f28dc06bf10 2023-07-14T12:52:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f28e089d640 1 -- 172.21.15.5:0/3985446839 <== mon.1 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f28d80016d0 con 0x7f28dc06bf10 2023-07-14T12:52:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f28e089d640 1 -- 172.21.15.5:0/3985446839 >> v1:172.21.15.154:6789/0 conn(0x7f28dc06bf10 legacy=0x7f28dc0b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f5212d9d640 1 --2- 172.21.15.5:0/1098662252 >> [v2:172.21.15.5:6809/3251687665,v1:172.21.15.5:6811/3251687665] conn(0x7f51f406ec00 0x7f51f4071010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f28e089d640 1 --2- 172.21.15.5:0/3985446839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28c8003980 0x7f28c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f28e089d640 1 --2- 172.21.15.5:0/3985446839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28c8004360 0x7f28c8004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f28e089d640 1 --2- 172.21.15.5:0/3985446839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28c8004fe0 0x7f28c800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f28e089d640 1 -- 172.21.15.5:0/3985446839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc15d500 con 0x7f28c8003980 2023-07-14T12:52:53.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f28e089d640 1 -- 172.21.15.5:0/3985446839 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc15d7a0 con 0x7f28c8004fe0 2023-07-14T12:52:53.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f28e089d640 1 -- 172.21.15.5:0/3985446839 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c8010390 con 0x7f28c8004360 2023-07-14T12:52:53.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f9a7ffff640 1 --2- 172.21.15.5:0/2391498422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a68003980 0x7f9a68003d90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9a7400ba30 tx=0x7f9a7401c650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc8e7ba0ea76f4bc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f28e109e640 1 --2- 172.21.15.5:0/3985446839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28c8004360 0x7f28c8004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f28e20a0640 1 --2- 172.21.15.5:0/3985446839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28c8004fe0 0x7f28c800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f09dac0a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09d40cee90 0x7f09d40d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f09da409640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f09d40b7a10 0x7f09d40b3bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38866/0 (socket says 172.21.15.5:38866) 2023-07-14T12:52:53.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f09da409640 1 -- 172.21.15.5:0/3546070717 learned_addr learned my addr 172.21.15.5:0/3546070717 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:53.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f09d9c08640 1 --2- 172.21.15.5:0/3546070717 >> v2:172.21.15.5:3300/0 conn(0x7f09d40b42c0 0x7f09d406a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f5202ffd640 1 -- 172.21.15.5:0/1098662252 <== osd.0 v2:172.21.15.5:6809/3251687665 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f51f40716c0 con 0x7f51f406ec00 2023-07-14T12:52:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f28e20a0640 1 -- 172.21.15.5:0/3985446839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28c8004360 msgr2=0x7f28c8004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f28e20a0640 1 --2- 172.21.15.5:0/3985446839 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28c8004360 0x7f28c8004830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f28e20a0640 1 -- 172.21.15.5:0/3985446839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28c8003980 msgr2=0x7f28c8003d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T12:52:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f28e20a0640 1 --2- 172.21.15.5:0/3985446839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28c8003980 0x7f28c8003d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f28e20a0640 1 -- 172.21.15.5:0/3985446839 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28dc15da80 con 0x7f28c8004fe0 2023-07-14T12:52:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f3fdf893640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3fd806c000 0x7f3fd80ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f3fdf893640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd80ca8f0 con 0x7f3fd806b1e0 2023-07-14T12:52:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f09d9c08640 1 -- 172.21.15.5:0/3546070717 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09d40cee90 msgr2=0x7f09d40d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:53.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f3fdf893640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd8158150 con 0x7f3fd815bf80 2023-07-14T12:52:53.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f3fdf893640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd8141900 con 0x7f3fd806c000 2023-07-14T12:52:53.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f09d9407640 1 -- 172.21.15.5:0/3546070717 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813213633 0 0) 0x7f09d40cf2f0 con 0x7f09d40b7a10 2023-07-14T12:52:53.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f09d9c08640 1 --2- 172.21.15.5:0/3546070717 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09d40cee90 0x7f09d40d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f09d9c08640 1 -- 172.21.15.5:0/3546070717 >> v1:172.21.15.5:6789/0 conn(0x7f09d40b7a10 legacy=0x7f09d40b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7fa06e27b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa068069970 0x7fa06806f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7fa067fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa068069970 0x7fa06806f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7fa067fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa068069970 0x7fa06806f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:54842/0 (socket says 172.21.15.5:54842) 2023-07-14T12:52:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7fa06e27b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0680cb280 0x7fa0680c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7fa06e27b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0680c5450 0x7fa0680b3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7fa06e27b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0680c58d0 con 0x7fa0680cb280 2023-07-14T12:52:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7fa06e27b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06806fc70 con 0x7fa0680c5450 2023-07-14T12:52:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7fa06e27b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06806ff50 con 0x7fa068069970 2023-07-14T12:52:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f255f7fe640 1 --2- 172.21.15.5:0/661100838 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2564066350 0x7f2564068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f3fdde30640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3fd806c000 0x7f3fd80ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f255f7fe640 1 -- 172.21.15.5:0/661100838 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f257011f430 con 0x7f25780c1340 2023-07-14T12:52:53.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f255f7fe640 1 --2- 172.21.15.5:0/661100838 >> [v2:172.21.15.5:6808/4141609580,v1:172.21.15.5:6810/4141609580] conn(0x7f256406ec00 0x7f2564071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f255f7fe640 1 -- 172.21.15.5:0/661100838 --> [v2:172.21.15.5:6808/4141609580,v1:172.21.15.5:6810/4141609580] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f25640716c0 con 0x7f256406ec00 2023-07-14T12:52:53.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f255f7fe640 1 -- 172.21.15.5:0/661100838 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f257011f7e0 con 0x7f25780c1340 2023-07-14T12:52:53.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7f3fdde30640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3fd806c000 0x7f3fd80ca3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:44994/0 (socket says 172.21.15.5:44994) 2023-07-14T12:52:53.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7f3fdde30640 1 -- 172.21.15.5:0/3043775638 learned_addr learned my addr 172.21.15.5:0/3043775638 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:53.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7f25767fc640 1 --2- 172.21.15.5:0/661100838 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2564066350 0x7f2564068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7f25777fe640 1 --2- 172.21.15.5:0/661100838 >> [v2:172.21.15.5:6808/4141609580,v1:172.21.15.5:6810/4141609580] conn(0x7f256406ec00 0x7f2564071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7f25767fc640 1 --2- 172.21.15.5:0/661100838 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2564066350 0x7f2564068800 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f25780c3640 tx=0x7f256c009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7f25777fe640 1 --2- 172.21.15.5:0/661100838 >> [v2:172.21.15.5:6808/4141609580,v1:172.21.15.5:6810/4141609580] conn(0x7f256406ec00 0x7f2564071010 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7fa0677fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0680cb280 0x7fa0680c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7fa0677fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0680cb280 0x7fa0680c4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52674/0 (socket says 172.21.15.5:52674) 2023-07-14T12:52:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7fa0677fe640 1 -- 172.21.15.5:0/702100137 learned_addr learned my addr 172.21.15.5:0/702100137 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7fa06c818640 1 --2- 172.21.15.5:0/702100137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0680c5450 0x7fa0680b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7fa067fff640 1 -- 172.21.15.5:0/702100137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0680c5450 msgr2=0x7fa0680b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7fa067fff640 1 --2- 172.21.15.5:0/702100137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0680c5450 0x7fa0680b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7fa067fff640 1 -- 172.21.15.5:0/702100137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0680cb280 msgr2=0x7fa0680c4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7fa067fff640 1 --2- 172.21.15.5:0/702100137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0680cb280 0x7fa0680c4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7fa067fff640 1 -- 172.21.15.5:0/702100137 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa060009a70 con 0x7fa068069970 2023-07-14T12:52:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7fa067fff640 1 --2- 172.21.15.5:0/702100137 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa068069970 0x7fa06806f410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa05c000f70 tx=0x7fa05c00c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f9a7effd640 1 -- 172.21.15.5:0/2391498422 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a740ad410 con 0x7f9a68003980 2023-07-14T12:52:53.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f9a7effd640 1 -- 172.21.15.5:0/2391498422 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a740a7030 con 0x7f9a68003980 2023-07-14T12:52:53.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.294+0000 7f9a7effd640 1 -- 172.21.15.5:0/2391498422 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a740ad7b0 con 0x7f9a68003980 2023-07-14T12:52:53.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7f9a864d8640 1 -- 172.21.15.5:0/2391498422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a68003980 msgr2=0x7f9a68003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7f9a864d8640 1 --2- 172.21.15.5:0/2391498422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a68003980 0x7f9a68003d90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9a7400ba30 tx=0x7f9a7401c650 comp rx=0 tx=0).stop 2023-07-14T12:52:53.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7f09d9c08640 1 -- 172.21.15.5:0/3546070717 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d40cc920 con 0x7f09d40b42c0 2023-07-14T12:52:53.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7f3fdde30640 1 -- 172.21.15.5:0/3043775638 >> v1:172.21.15.154:6789/0 conn(0x7f3fd815bf80 legacy=0x7f3fd806f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7f3fdde30640 1 -- 172.21.15.5:0/3043775638 >> v1:172.21.15.5:6789/0 conn(0x7f3fd806b1e0 legacy=0x7f3fd806b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:53.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7f3fdde30640 1 -- 172.21.15.5:0/3043775638 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd815c7a0 con 0x7f3fd806c000 2023-07-14T12:52:53.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7fa064ff9640 1 -- 172.21.15.5:0/702100137 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c0054e0 con 0x7fa068069970 2023-07-14T12:52:53.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7fa064ff9640 1 -- 172.21.15.5:0/702100137 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05c003600 con 0x7fa068069970 2023-07-14T12:52:53.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7fa064ff9640 1 -- 172.21.15.5:0/702100137 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c0039f0 con 0x7fa068069970 2023-07-14T12:52:53.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7fa06e27b640 1 -- 172.21.15.5:0/702100137 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa068070230 con 0x7fa068069970 2023-07-14T12:52:53.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7f9a864d8640 1 -- 172.21.15.5:0/2391498422 shutdown_connections 2023-07-14T12:52:53.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7f9a864d8640 1 --2- 172.21.15.5:0/2391498422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a68003980 0x7f9a68003d90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7f9a864d8640 1 -- 172.21.15.5:0/2391498422 >> 172.21.15.5:0/2391498422 conn(0x7f9a800ce980 msgr2=0x7f9a800ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:53.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7ff75facb640 1 Processor -- start 2023-07-14T12:52:53.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7ff75facb640 1 -- start start 2023-07-14T12:52:53.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7ff75facb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff758157bc0 0x7ff75806c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7f09dac0a640 1 --2- 172.21.15.5:0/3546070717 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09d40cee90 0x7f09d40d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:52:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7ff75facb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff758158be0 0x7ff7580c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7ff75facb640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff758071170 con 0x7ff758069430 2023-07-14T12:52:53.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7ff75facb640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7580ca5b0 con 0x7ff758157bc0 2023-07-14T12:52:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7fa06e27b640 1 -- 172.21.15.5:0/702100137 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0680707f0 con 0x7fa068069970 2023-07-14T12:52:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7f9a864d8640 1 -- 172.21.15.5:0/2391498422 shutdown_connections 2023-07-14T12:52:53.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7ff75facb640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7580ca2d0 con 0x7ff758158be0 2023-07-14T12:52:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7ff75d867640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff758069430 0x7ff758069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:58024/0 (socket says 172.21.15.5:58024) 2023-07-14T12:52:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7f28e20a0640 1 --2- 172.21.15.5:0/3985446839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28c8004fe0 0x7f28c800b990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0b3d60 tx=0x7f28d401cba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bb4cb622656a075 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7f255f7fe640 1 -- 172.21.15.5:0/661100838 <== osd.1 v2:172.21.15.5:6808/4141609580 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f25640716c0 con 0x7f256406ec00 2023-07-14T12:52:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7fa04e7fc640 1 -- 172.21.15.5:0/702100137 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa0680c8710 con 0x7fa068069970 2023-07-14T12:52:53.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7f9a864d8640 1 -- 172.21.15.5:0/2391498422 wait complete. 2023-07-14T12:52:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7f28e089d640 1 -- 172.21.15.5:0/3985446839 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d40a6700 con 0x7f28c8004fe0 2023-07-14T12:52:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7f28e089d640 1 -- 172.21.15.5:0/3985446839 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d400f040 con 0x7f28c8004fe0 2023-07-14T12:52:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7f28e089d640 1 -- 172.21.15.5:0/3985446839 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d40a6ac0 con 0x7f28c8004fe0 2023-07-14T12:52:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7f28e3b03640 1 -- 172.21.15.5:0/3985446839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28c8004fe0 msgr2=0x7f28c800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7f28e3b03640 1 --2- 172.21.15.5:0/3985446839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28c8004fe0 0x7f28c800b990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0b3d60 tx=0x7f28d401cba0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7f28e20a0640 1 -- 172.21.15.5:0/3985446839 reap_dead start 2023-07-14T12:52:53.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7f28e3b03640 1 -- 172.21.15.5:0/3985446839 shutdown_connections 2023-07-14T12:52:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7f28e3b03640 1 -- 172.21.15.5:0/3985446839 >> 172.21.15.5:0/3985446839 conn(0x7f28dc0ce9d0 msgr2=0x7f28dc0ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7f3fdde30640 1 --2- 172.21.15.5:0/3043775638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fd806c000 0x7f3fd80ca3b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009e50 tx=0x7f3fd001c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20e3b40586f17f20 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7f9a864d8640 1 Processor -- start 2023-07-14T12:52:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7f28e3b03640 1 -- 172.21.15.5:0/3985446839 shutdown_connections 2023-07-14T12:52:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7f3fcffff640 1 -- 172.21.15.5:0/3043775638 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd00a57d0 con 0x7f3fd806c000 2023-07-14T12:52:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7f3fcffff640 1 -- 172.21.15.5:0/3043775638 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd00a5930 con 0x7f3fd806c000 2023-07-14T12:52:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7f3fcffff640 1 -- 172.21.15.5:0/3043775638 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd00a5cc0 con 0x7f3fd806c000 2023-07-14T12:52:53.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7f3fdf893640 1 -- 172.21.15.5:0/3043775638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fd806c000 msgr2=0x7f3fd80ca3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7f3fdf893640 1 --2- 172.21.15.5:0/3043775638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fd806c000 0x7f3fd80ca3b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009e50 tx=0x7f3fd001c930 comp rx=0 tx=0).stop 2023-07-14T12:52:53.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7f3fdf893640 1 -- 172.21.15.5:0/3043775638 shutdown_connections 2023-07-14T12:52:53.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7f3fdf893640 1 --2- 172.21.15.5:0/3043775638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fd806c000 0x7f3fd80ca3b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7f3fdf893640 1 -- 172.21.15.5:0/3043775638 >> 172.21.15.5:0/3043775638 conn(0x7f3fd80b0980 msgr2=0x7f3fd80ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:53.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7ff75d867640 1 -- 172.21.15.5:0/44555276 learned_addr learned my addr 172.21.15.5:0/44555276 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:53.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.298+0000 7ff75e068640 1 --2- 172.21.15.5:0/44555276 >> v2:172.21.15.154:3300/0 conn(0x7ff758158be0 0x7ff7580c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7ff75d066640 1 --2- 172.21.15.5:0/44555276 >> v2:172.21.15.5:3300/0 conn(0x7ff758157bc0 0x7ff75806c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7ff75c865640 1 -- 172.21.15.5:0/44555276 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 614401108 0 0) 0x7ff758071170 con 0x7ff758069430 2023-07-14T12:52:53.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7ff75c865640 1 -- 172.21.15.5:0/44555276 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff744003530 con 0x7ff758069430 2023-07-14T12:52:53.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7ff75e068640 1 -- 172.21.15.5:0/44555276 >> v2:172.21.15.5:3300/0 conn(0x7ff758157bc0 msgr2=0x7ff75806c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:53.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7ff75e068640 1 --2- 172.21.15.5:0/44555276 >> v2:172.21.15.5:3300/0 conn(0x7ff758157bc0 0x7ff75806c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7ff75e068640 1 -- 172.21.15.5:0/44555276 >> v1:172.21.15.154:6789/0 conn(0x7ff758069430 legacy=0x7ff758069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7ff75e068640 1 -- 172.21.15.5:0/44555276 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff758158100 con 0x7ff758158be0 2023-07-14T12:52:53.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7fa064ff9640 1 -- 172.21.15.5:0/702100137 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa05c003b50 con 0x7fa068069970 2023-07-14T12:52:53.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7f28e3b03640 1 -- 172.21.15.5:0/3985446839 wait complete. 2023-07-14T12:52:53.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f3fdf893640 1 -- 172.21.15.5:0/3043775638 shutdown_connections 2023-07-14T12:52:53.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f3fdf893640 1 -- 172.21.15.5:0/3043775638 wait complete. 2023-07-14T12:52:53.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7fa064ff9640 1 --2- 172.21.15.5:0/702100137 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa054066350 0x7fa054068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7fa064ff9640 1 -- 172.21.15.5:0/702100137 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa05c083990 con 0x7fa068069970 2023-07-14T12:52:53.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7fa064ff9640 1 --2- 172.21.15.5:0/702100137 >> [v2:172.21.15.5:6800/559368967,v1:172.21.15.5:6801/559368967] conn(0x7fa05406ec00 0x7fa054071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7fa064ff9640 1 -- 172.21.15.5:0/702100137 --> [v2:172.21.15.5:6800/559368967,v1:172.21.15.5:6801/559368967] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa0540716c0 con 0x7fa05406ec00 2023-07-14T12:52:53.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7fa064ff9640 1 -- 172.21.15.5:0/702100137 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa05c083d40 con 0x7fa068069970 2023-07-14T12:52:53.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.302+0000 7f9a864d8640 1 -- start start 2023-07-14T12:52:53.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f9a864d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a68003980 0x7f9a800b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f9a864d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a8014b460 0x7f9a80157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f9a864d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a8014a8c0 0x7f9a8014ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f9a864d8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8014b270 con 0x7f9a68003980 2023-07-14T12:52:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f9a864d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8014c7d0 con 0x7f9a8014a8c0 2023-07-14T12:52:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f9a864d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8014bbc0 con 0x7f9a8014b460 2023-07-14T12:52:53.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f28e3b03640 1 Processor -- start 2023-07-14T12:52:53.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f9a7f7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a8014b460 0x7f9a80157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f9a7f7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a8014b460 0x7f9a80157fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:54870/0 (socket says 172.21.15.5:54870) 2023-07-14T12:52:53.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f9a7f7fe640 1 -- 172.21.15.5:0/2899411532 learned_addr learned my addr 172.21.15.5:0/2899411532 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:53.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f9a84a75640 1 --2- 172.21.15.5:0/2899411532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a8014a8c0 0x7f9a8014ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7ff75e068640 1 --2- 172.21.15.5:0/44555276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff758158be0 0x7ff7580c9bf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff75806c900 tx=0x7ff75001d910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f07485f4223e5d50 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f9a7f7fe640 1 -- 172.21.15.5:0/2899411532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a8014a8c0 msgr2=0x7f9a8014ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f9a7f7fe640 1 --2- 172.21.15.5:0/2899411532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a8014a8c0 0x7f9a8014ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f9a7f7fe640 1 -- 172.21.15.5:0/2899411532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a68003980 msgr2=0x7f9a800b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f9a7f7fe640 1 --2- 172.21.15.5:0/2899411532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a68003980 0x7f9a800b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f9a7f7fe640 1 -- 172.21.15.5:0/2899411532 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a8014bea0 con 0x7f9a8014b460 2023-07-14T12:52:53.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f3fdf893640 1 Processor -- start 2023-07-14T12:52:53.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f28e3b03640 1 -- start start 2023-07-14T12:52:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7fa06c818640 1 --2- 172.21.15.5:0/702100137 >> [v2:172.21.15.5:6800/559368967,v1:172.21.15.5:6801/559368967] conn(0x7fa05406ec00 0x7fa054071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f09d9c08640 1 --2- 172.21.15.5:0/3546070717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09d40b42c0 0x7f09d406a9b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f09c40097c0 tx=0x7f09c401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e060c856629a831 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7ff75c865640 1 -- 172.21.15.5:0/44555276 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7500a69c0 con 0x7ff758158be0 2023-07-14T12:52:53.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7ff75c865640 1 -- 172.21.15.5:0/44555276 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7500a6b20 con 0x7ff758158be0 2023-07-14T12:52:53.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7ff75c865640 1 -- 172.21.15.5:0/44555276 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7500ae440 con 0x7ff758158be0 2023-07-14T12:52:53.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7fa0677fe640 1 --2- 172.21.15.5:0/702100137 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa054066350 0x7fa054068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f9a7f7fe640 1 --2- 172.21.15.5:0/2899411532 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a8014b460 0x7f9a80157fc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800fbb0 tx=0x7f9a78005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f3fdf893640 1 -- start start 2023-07-14T12:52:53.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f9a7cff9640 1 -- 172.21.15.5:0/2899411532 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a78005170 con 0x7f9a8014b460 2023-07-14T12:52:53.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f9a7cff9640 1 -- 172.21.15.5:0/2899411532 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7800d9e0 con 0x7f9a8014b460 2023-07-14T12:52:53.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f9a7cff9640 1 -- 172.21.15.5:0/2899411532 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7800dd70 con 0x7f9a8014b460 2023-07-14T12:52:53.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f9a864d8640 1 -- 172.21.15.5:0/2899411532 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a8014c180 con 0x7f9a8014b460 2023-07-14T12:52:53.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f9a864d8640 1 -- 172.21.15.5:0/2899411532 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a8014b8b0 con 0x7f9a8014b460 2023-07-14T12:52:53.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f3fdf893640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fd806b1e0 0x7f3fd80c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f28e3b03640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28c8004fe0 0x7f28dc14f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7ff75facb640 1 -- 172.21.15.5:0/44555276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff758158be0 msgr2=0x7ff7580c9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7ff75facb640 1 --2- 172.21.15.5:0/44555276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff758158be0 0x7ff7580c9bf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff75806c900 tx=0x7ff75001d910 comp rx=0 tx=0).stop 2023-07-14T12:52:53.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f3fdf893640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fd806c000 0x7f3fd80ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f3fdf893640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fd815bf80 0x7f3fd8159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f3fdf893640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd814ef10 con 0x7f3fd815bf80 2023-07-14T12:52:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f3fdf893640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd8157d80 con 0x7f3fd806c000 2023-07-14T12:52:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7f3fdf893640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd814f860 con 0x7f3fd806b1e0 2023-07-14T12:52:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f28e3b03640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28dc0c6fb0 0x7f28dc0c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7ff75facb640 1 -- 172.21.15.5:0/44555276 shutdown_connections 2023-07-14T12:52:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7ff75facb640 1 --2- 172.21.15.5:0/44555276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff758158be0 0x7ff7580c9bf0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7ff75facb640 1 --2- 172.21.15.5:0/44555276 >> v2:172.21.15.5:3300/0 conn(0x7ff758157bc0 0x7ff75806c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.306+0000 7ff75facb640 1 -- 172.21.15.5:0/44555276 >> 172.21.15.5:0/44555276 conn(0x7ff7580ce9d0 msgr2=0x7ff7580ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:53.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f28e3b03640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28dc0c3370 0x7f28dc0c37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f3fdd62f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fd806b1e0 0x7f3fd80c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f3fdce2e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fd806c000 0x7f3fd80ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f3fdce2e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fd806c000 0x7f3fd80ae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:45020/0 (socket says 172.21.15.5:45020) 2023-07-14T12:52:53.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f3fdce2e640 1 -- 172.21.15.5:0/2901563015 learned_addr learned my addr 172.21.15.5:0/2901563015 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:53.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f3fdd62f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fd806b1e0 0x7f3fd80c1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:54874/0 (socket says 172.21.15.5:54874) 2023-07-14T12:52:53.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f3fdde30640 1 --2- 172.21.15.5:0/2901563015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fd815bf80 0x7f3fd8159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f28e189f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28c8004fe0 0x7f28dc14f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f28e109e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28dc0c6fb0 0x7f28dc0c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f28e189f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28c8004fe0 0x7f28dc14f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:54886/0 (socket says 172.21.15.5:54886) 2023-07-14T12:52:53.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f28e109e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28dc0c6fb0 0x7f28dc0c5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:45022/0 (socket says 172.21.15.5:45022) 2023-07-14T12:52:53.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7fa0677fe640 1 --2- 172.21.15.5:0/702100137 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa054066350 0x7fa054068800 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa0681583e0 tx=0x7fa058009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f28e189f640 1 -- 172.21.15.5:0/1683813083 learned_addr learned my addr 172.21.15.5:0/1683813083 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:53.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f28e3b03640 1 -- 172.21.15.5:0/1683813083 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc0c3d20 con 0x7f28dc0c3370 2023-07-14T12:52:53.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7ff75facb640 1 -- 172.21.15.5:0/44555276 shutdown_connections 2023-07-14T12:52:53.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f09d9407640 1 -- 172.21.15.5:0/3546070717 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c40ab670 con 0x7f09d40b42c0 2023-07-14T12:52:53.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f09d9407640 1 -- 172.21.15.5:0/3546070717 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c40ab7d0 con 0x7f09d40b42c0 2023-07-14T12:52:53.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f09d9407640 1 -- 172.21.15.5:0/3546070717 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c40abb60 con 0x7f09d40b42c0 2023-07-14T12:52:53.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f3fdce2e640 1 -- 172.21.15.5:0/2901563015 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fd806b1e0 msgr2=0x7f3fd80c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f3fdce2e640 1 --2- 172.21.15.5:0/2901563015 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fd806b1e0 0x7f3fd80c1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f3fdce2e640 1 -- 172.21.15.5:0/2901563015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fd815bf80 msgr2=0x7f3fd8159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f3fdce2e640 1 --2- 172.21.15.5:0/2901563015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fd815bf80 0x7f3fd8159f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f3fdce2e640 1 -- 172.21.15.5:0/2901563015 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd0009b30 con 0x7f3fd806c000 2023-07-14T12:52:53.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f28e3b03640 1 -- 172.21.15.5:0/1683813083 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc1505d0 con 0x7f28dc0c6fb0 2023-07-14T12:52:53.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7fa06c818640 1 --2- 172.21.15.5:0/702100137 >> [v2:172.21.15.5:6800/559368967,v1:172.21.15.5:6801/559368967] conn(0x7fa05406ec00 0x7fa054071010 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f3fdce2e640 1 --2- 172.21.15.5:0/2901563015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fd806c000 0x7f3fd80ae070 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3fc800c390 tx=0x7f3fc800c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f9a864d8640 1 -- 172.21.15.5:0/2899411532 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9a60000fd0 con 0x7f9a8014b460 2023-07-14T12:52:53.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f28e20a0640 1 --2- 172.21.15.5:0/1683813083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28dc0c3370 0x7f28dc0c37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f28e3b03640 1 -- 172.21.15.5:0/1683813083 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc0c6860 con 0x7f28c8004fe0 2023-07-14T12:52:53.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f09db40b640 1 -- 172.21.15.5:0/3546070717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09d40b42c0 msgr2=0x7f09d406a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f09db40b640 1 --2- 172.21.15.5:0/3546070717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09d40b42c0 0x7f09d406a9b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f09c40097c0 tx=0x7f09c401c470 comp rx=0 tx=0).stop 2023-07-14T12:52:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f09db40b640 1 -- 172.21.15.5:0/3546070717 shutdown_connections 2023-07-14T12:52:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f09db40b640 1 --2- 172.21.15.5:0/3546070717 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09d40cee90 0x7f09d40d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f09db40b640 1 --2- 172.21.15.5:0/3546070717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09d40b42c0 0x7f09d406a9b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f09db40b640 1 -- 172.21.15.5:0/3546070717 >> 172.21.15.5:0/3546070717 conn(0x7f09d4069ea0 msgr2=0x7f09d406a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:53.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7ff75facb640 1 -- 172.21.15.5:0/44555276 wait complete. 2023-07-14T12:52:53.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f3fcdffb640 1 -- 172.21.15.5:0/2901563015 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc80052d0 con 0x7f3fd806c000 2023-07-14T12:52:53.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f3fcdffb640 1 -- 172.21.15.5:0/2901563015 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc8005430 con 0x7f3fd806c000 2023-07-14T12:52:53.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f3fcdffb640 1 -- 172.21.15.5:0/2901563015 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8003820 con 0x7f3fd806c000 2023-07-14T12:52:53.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f3fdf893640 1 -- 172.21.15.5:0/2901563015 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd80b26d0 con 0x7f3fd806c000 2023-07-14T12:52:53.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f3fdf893640 1 -- 172.21.15.5:0/2901563015 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd80b29b0 con 0x7f3fd806c000 2023-07-14T12:52:53.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f3fdf893640 1 -- 172.21.15.5:0/2901563015 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3fd80c8bc0 con 0x7f3fd806c000 2023-07-14T12:52:53.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f9a7cff9640 1 -- 172.21.15.5:0/2899411532 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9a78014470 con 0x7f9a8014b460 2023-07-14T12:52:53.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f28e109e640 1 -- 172.21.15.5:0/1683813083 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28c8004fe0 msgr2=0x7f28dc14f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f28e109e640 1 --2- 172.21.15.5:0/1683813083 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28c8004fe0 0x7f28dc14f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f28e109e640 1 -- 172.21.15.5:0/1683813083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28dc0c3370 msgr2=0x7f28dc0c37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f28e109e640 1 --2- 172.21.15.5:0/1683813083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28dc0c3370 0x7f28dc0c37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.310+0000 7f28e109e640 1 -- 172.21.15.5:0/1683813083 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28dc06b200 con 0x7f28dc0c6fb0 2023-07-14T12:52:53.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.314+0000 7f28e109e640 1 --2- 172.21.15.5:0/1683813083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28dc0c6fb0 0x7f28dc0c5760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f28d800d8e0 tx=0x7f28d800dda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.314+0000 7f09db40b640 1 -- 172.21.15.5:0/3546070717 shutdown_connections 2023-07-14T12:52:53.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.314+0000 7fa064ff9640 1 -- 172.21.15.5:0/702100137 <== osd.2 v2:172.21.15.5:6800/559368967 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa0540716c0 con 0x7fa05406ec00 2023-07-14T12:52:53.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.314+0000 7ff75facb640 1 Processor -- start 2023-07-14T12:52:53.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.314+0000 7f9a7cff9640 1 --2- 172.21.15.5:0/2899411532 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9a6c066350 0x7f9a6c068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.314+0000 7f9a7cff9640 1 -- 172.21.15.5:0/2899411532 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9a78084600 con 0x7f9a8014b460 2023-07-14T12:52:53.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.314+0000 7f9a7cff9640 1 --2- 172.21.15.5:0/2899411532 >> [v2:172.21.15.5:6824/4061664720,v1:172.21.15.5:6825/4061664720] conn(0x7f9a6c06ec00 0x7f9a6c071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.314+0000 7f9a7cff9640 1 -- 172.21.15.5:0/2899411532 --> [v2:172.21.15.5:6824/4061664720,v1:172.21.15.5:6825/4061664720] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a6c0716c0 con 0x7f9a6c06ec00 2023-07-14T12:52:53.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.314+0000 7f9a7cff9640 1 -- 172.21.15.5:0/2899411532 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a78086c20 con 0x7f9a8014b460 2023-07-14T12:52:53.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.314+0000 7f9a7ffff640 1 --2- 172.21.15.5:0/2899411532 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9a6c066350 0x7f9a6c068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.314+0000 7f28d27fc640 1 -- 172.21.15.5:0/1683813083 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d80075a0 con 0x7f28dc0c6fb0 2023-07-14T12:52:53.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.314+0000 7f28d27fc640 1 -- 172.21.15.5:0/1683813083 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d8007700 con 0x7f28dc0c6fb0 2023-07-14T12:52:53.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.314+0000 7f28d27fc640 1 -- 172.21.15.5:0/1683813083 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d8004a60 con 0x7f28dc0c6fb0 2023-07-14T12:52:53.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.314+0000 7f9a84a75640 1 --2- 172.21.15.5:0/2899411532 >> [v2:172.21.15.5:6824/4061664720,v1:172.21.15.5:6825/4061664720] conn(0x7f9a6c06ec00 0x7f9a6c071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.314+0000 7f9a7ffff640 1 --2- 172.21.15.5:0/2899411532 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9a6c066350 0x7f9a6c068800 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9a740af000 tx=0x7f9a74004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.314+0000 7f9a84a75640 1 --2- 172.21.15.5:0/2899411532 >> [v2:172.21.15.5:6824/4061664720,v1:172.21.15.5:6825/4061664720] conn(0x7f9a6c06ec00 0x7f9a6c071010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.314+0000 7f09db40b640 1 -- 172.21.15.5:0/3546070717 wait complete. 2023-07-14T12:52:53.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.314+0000 7f09db40b640 1 Processor -- start 2023-07-14T12:52:53.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.314+0000 7f28e3b03640 1 -- 172.21.15.5:0/1683813083 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28dc0c5fc0 con 0x7f28dc0c6fb0 2023-07-14T12:52:53.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.314+0000 7f09db40b640 1 -- start start 2023-07-14T12:52:53.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.314+0000 7f3fcdffb640 1 -- 172.21.15.5:0/2901563015 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3fc8003980 con 0x7f3fd806c000 2023-07-14T12:52:53.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.314+0000 7f28e3b03640 1 -- 172.21.15.5:0/1683813083 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28dc0c6580 con 0x7f28dc0c6fb0 2023-07-14T12:52:53.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7f9a7cff9640 1 -- 172.21.15.5:0/2899411532 <== osd.3 v2:172.21.15.5:6824/4061664720 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9a6c0716c0 con 0x7f9a6c06ec00 2023-07-14T12:52:53.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.314+0000 7ff75facb640 1 -- start start 2023-07-14T12:52:53.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7ff75facb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff758069430 0x7ff758156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7f28e3b03640 1 -- 172.21.15.5:0/1683813083 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f28dc069d80 con 0x7f28dc0c6fb0 2023-07-14T12:52:53.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7ff75facb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff758157bc0 0x7ff7580c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7ff75facb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff758158be0 0x7ff7581f63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7ff75facb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff758156990 con 0x7ff758158be0 2023-07-14T12:52:53.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7ff75facb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff758157340 con 0x7ff758069430 2023-07-14T12:52:53.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7ff75facb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7581f53d0 con 0x7ff758157bc0 2023-07-14T12:52:53.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7f09db40b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09d40b42c0 0x7f09d415d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7ff75d066640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff758157bc0 0x7ff7580c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7ff75d867640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff758069430 0x7ff758156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7ff75e068640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff758158be0 0x7ff7581f63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7ff75e068640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff758158be0 0x7ff7581f63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52728/0 (socket says 172.21.15.5:52728) 2023-07-14T12:52:53.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7ff75e068640 1 -- 172.21.15.5:0/357036317 learned_addr learned my addr 172.21.15.5:0/357036317 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:53.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7ff75d867640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff758069430 0x7ff758156450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:45038/0 (socket says 172.21.15.5:45038) 2023-07-14T12:52:53.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7f3fcdffb640 1 --2- 172.21.15.5:0/2901563015 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3fbc066350 0x7f3fbc068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7f3fcdffb640 1 -- 172.21.15.5:0/2901563015 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3fc8083570 con 0x7f3fd806c000 2023-07-14T12:52:53.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7f3fcdffb640 1 --2- 172.21.15.5:0/2901563015 >> [v2:172.21.15.154:6808/1270457700,v1:172.21.15.154:6810/1270457700] conn(0x7f3fbc06ec00 0x7f3fbc071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7f3fcdffb640 1 -- 172.21.15.5:0/2901563015 --> [v2:172.21.15.154:6808/1270457700,v1:172.21.15.154:6810/1270457700] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3fbc0716c0 con 0x7f3fbc06ec00 2023-07-14T12:52:53.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7f3fcdffb640 1 -- 172.21.15.5:0/2901563015 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3fc8083920 con 0x7f3fd806c000 2023-07-14T12:52:53.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7f09db40b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09d40b7a10 0x7f09d40cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7f09db40b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09d40cee90 0x7f09d4161cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7f09db40b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d415e490 con 0x7f09d40cee90 2023-07-14T12:52:53.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7f09db40b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d40cadd0 con 0x7f09d40b42c0 2023-07-14T12:52:53.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7f09db40b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d406e710 con 0x7f09d40b7a10 2023-07-14T12:52:53.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7f09d9c08640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09d40b7a10 0x7f09d40cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7f09d9c08640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09d40b7a10 0x7f09d40cb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:54912/0 (socket says 172.21.15.5:54912) 2023-07-14T12:52:53.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7f09d9c08640 1 -- 172.21.15.5:0/2386982966 learned_addr learned my addr 172.21.15.5:0/2386982966 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:53.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7f09d9c08640 1 -- 172.21.15.5:0/2386982966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09d40b42c0 msgr2=0x7f09d415d3b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T12:52:53.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7f09d9c08640 1 --2- 172.21.15.5:0/2386982966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09d40b42c0 0x7f09d415d3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7f09d9c08640 1 -- 172.21.15.5:0/2386982966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09d40cee90 msgr2=0x7f09d4161cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7f09d9c08640 1 --2- 172.21.15.5:0/2386982966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09d40cee90 0x7f09d4161cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7f09d9c08640 1 -- 172.21.15.5:0/2386982966 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09cc009a70 con 0x7f09d40b7a10 2023-07-14T12:52:53.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.322+0000 7f09d9c08640 1 --2- 172.21.15.5:0/2386982966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09d40b7a10 0x7f09d40cb590 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f09c40ad040 tx=0x7f09c401acb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.322+0000 7f09caffd640 1 -- 172.21.15.5:0/2386982966 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c40b58d0 con 0x7f09d40b7a10 2023-07-14T12:52:53.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.322+0000 7f09caffd640 1 -- 172.21.15.5:0/2386982966 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c40b5a30 con 0x7f09d40b7a10 2023-07-14T12:52:53.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.322+0000 7f09caffd640 1 -- 172.21.15.5:0/2386982966 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c40b5de0 con 0x7f09d40b7a10 2023-07-14T12:52:53.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.322+0000 7f09db40b640 1 -- 172.21.15.5:0/2386982966 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c4009420 con 0x7f09d40b7a10 2023-07-14T12:52:53.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.322+0000 7f09db40b640 1 -- 172.21.15.5:0/2386982966 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d40cb070 con 0x7f09d40b7a10 2023-07-14T12:52:53.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7ff75e068640 1 -- 172.21.15.5:0/357036317 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff758157bc0 msgr2=0x7ff7580c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7ff75e068640 1 --2- 172.21.15.5:0/357036317 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff758157bc0 0x7ff7580c4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7ff75e068640 1 -- 172.21.15.5:0/357036317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff758069430 msgr2=0x7ff758156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7ff75e068640 1 --2- 172.21.15.5:0/357036317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff758069430 0x7ff758156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7ff75e068640 1 -- 172.21.15.5:0/357036317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75000aa70 con 0x7ff758158be0 2023-07-14T12:52:53.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7ff75e068640 1 --2- 172.21.15.5:0/357036317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff758158be0 0x7ff7581f63f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff75001a520 tx=0x7ff75001a6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.318+0000 7f3fdd62f640 1 --2- 172.21.15.5:0/2901563015 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3fbc066350 0x7f3fbc068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.322+0000 7f3fdde30640 1 --2- 172.21.15.5:0/2901563015 >> [v2:172.21.15.154:6808/1270457700,v1:172.21.15.154:6810/1270457700] conn(0x7f3fbc06ec00 0x7f3fbc071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.322+0000 7f3fdd62f640 1 --2- 172.21.15.5:0/2901563015 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3fbc066350 0x7f3fbc068800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3fd80afcc0 tx=0x7f3fd4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.322+0000 7ff74e7fc640 1 -- 172.21.15.5:0/357036317 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7500be070 con 0x7ff758158be0 2023-07-14T12:52:53.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.322+0000 7ff74e7fc640 1 -- 172.21.15.5:0/357036317 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7500aea50 con 0x7ff758158be0 2023-07-14T12:52:53.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.322+0000 7ff74e7fc640 1 -- 172.21.15.5:0/357036317 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7500aede0 con 0x7ff758158be0 2023-07-14T12:52:53.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.322+0000 7f28d27fc640 1 -- 172.21.15.5:0/1683813083 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f28d8004bc0 con 0x7f28dc0c6fb0 2023-07-14T12:52:53.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.322+0000 7f28d27fc640 1 --2- 172.21.15.5:0/1683813083 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f28c0066380 0x7f28c0068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.322+0000 7f28d27fc640 1 -- 172.21.15.5:0/1683813083 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f28d8083b30 con 0x7f28dc0c6fb0 2023-07-14T12:52:53.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.322+0000 7f28d27fc640 1 --2- 172.21.15.5:0/1683813083 >> [v2:172.21.15.154:6809/3408721900,v1:172.21.15.154:6811/3408721900] conn(0x7f28c006ebb0 0x7f28c0070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.322+0000 7f28d27fc640 1 -- 172.21.15.5:0/1683813083 --> [v2:172.21.15.154:6809/3408721900,v1:172.21.15.154:6811/3408721900] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f28c0071670 con 0x7f28c006ebb0 2023-07-14T12:52:53.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.322+0000 7ff75facb640 1 -- 172.21.15.5:0/357036317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7581f75c0 con 0x7ff758158be0 2023-07-14T12:52:53.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.322+0000 7f28d27fc640 1 -- 172.21.15.5:0/1683813083 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28d8050fb0 con 0x7f28dc0c6fb0 2023-07-14T12:52:53.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.322+0000 7f28e189f640 1 --2- 172.21.15.5:0/1683813083 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f28c0066380 0x7f28c0068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.322+0000 7f28e20a0640 1 --2- 172.21.15.5:0/1683813083 >> [v2:172.21.15.154:6809/3408721900,v1:172.21.15.154:6811/3408721900] conn(0x7f28c006ebb0 0x7f28c0070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.322+0000 7f28e189f640 1 --2- 172.21.15.5:0/1683813083 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f28c0066380 0x7f28c0068830 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f28cc006fd0 tx=0x7f28cc0090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.322+0000 7f28e20a0640 1 --2- 172.21.15.5:0/1683813083 >> [v2:172.21.15.154:6809/3408721900,v1:172.21.15.154:6811/3408721900] conn(0x7f28c006ebb0 0x7f28c0070fc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.322+0000 7f09db40b640 1 -- 172.21.15.5:0/2386982966 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f09d40678d0 con 0x7f09d40b7a10 2023-07-14T12:52:53.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.322+0000 7ff75facb640 1 -- 172.21.15.5:0/357036317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7581f4e10 con 0x7ff758158be0 2023-07-14T12:52:53.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.322+0000 7ff73bfff640 1 -- 172.21.15.5:0/357036317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff734000fd0 con 0x7ff758158be0 2023-07-14T12:52:53.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.322+0000 7f3fdde30640 1 --2- 172.21.15.5:0/2901563015 >> [v2:172.21.15.154:6808/1270457700,v1:172.21.15.154:6810/1270457700] conn(0x7f3fbc06ec00 0x7f3fbc071010 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.322+0000 7f3fcdffb640 1 -- 172.21.15.5:0/2901563015 <== osd.7 v2:172.21.15.154:6808/1270457700 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3fbc0716c0 con 0x7f3fbc06ec00 2023-07-14T12:52:53.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.326+0000 7f28d27fc640 1 -- 172.21.15.5:0/1683813083 <== osd.4 v2:172.21.15.154:6809/3408721900 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f28c0071670 con 0x7f28c006ebb0 2023-07-14T12:52:53.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.326+0000 7f09caffd640 1 -- 172.21.15.5:0/2386982966 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f09c40bf410 con 0x7f09d40b7a10 2023-07-14T12:52:53.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.326+0000 7f09caffd640 1 --2- 172.21.15.5:0/2386982966 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f09b8066350 0x7f09b8068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.326+0000 7f09caffd640 1 -- 172.21.15.5:0/2386982966 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f09c411ebd0 con 0x7f09d40b7a10 2023-07-14T12:52:53.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.326+0000 7f09caffd640 1 --2- 172.21.15.5:0/2386982966 >> [v2:172.21.15.154:6800/3949375489,v1:172.21.15.154:6801/3949375489] conn(0x7f09b806eb80 0x7f09b8070f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.326+0000 7f09caffd640 1 -- 172.21.15.5:0/2386982966 --> [v2:172.21.15.154:6800/3949375489,v1:172.21.15.154:6801/3949375489] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f09b8071640 con 0x7f09b806eb80 2023-07-14T12:52:53.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.326+0000 7f09caffd640 1 -- 172.21.15.5:0/2386982966 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09c40ec030 con 0x7f09d40b7a10 2023-07-14T12:52:53.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.326+0000 7f09da409640 1 --2- 172.21.15.5:0/2386982966 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f09b8066350 0x7f09b8068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.330+0000 7f09da409640 1 --2- 172.21.15.5:0/2386982966 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f09b8066350 0x7f09b8068800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f09d0000c10 tx=0x7f09d00079d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.330+0000 7f09dac0a640 1 --2- 172.21.15.5:0/2386982966 >> [v2:172.21.15.154:6800/3949375489,v1:172.21.15.154:6801/3949375489] conn(0x7f09b806eb80 0x7f09b8070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.330+0000 7f257d2ca640 1 -- 172.21.15.5:0/661100838 --> [v2:172.21.15.5:6808/4141609580,v1:172.21.15.5:6810/4141609580] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f25780cc8c0 con 0x7f256406ec00 2023-07-14T12:52:53.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.330+0000 7f255f7fe640 1 -- 172.21.15.5:0/661100838 <== osd.1 v2:172.21.15.5:6808/4141609580 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2568009aa0 con 0x7f256406ec00 2023-07-14T12:52:53.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.330+0000 7f257d2ca640 1 -- 172.21.15.5:0/661100838 >> [v2:172.21.15.5:6808/4141609580,v1:172.21.15.5:6810/4141609580] conn(0x7f256406ec00 msgr2=0x7f2564071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.330+0000 7f257d2ca640 1 --2- 172.21.15.5:0/661100838 >> [v2:172.21.15.5:6808/4141609580,v1:172.21.15.5:6810/4141609580] conn(0x7f256406ec00 0x7f2564071010 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.330+0000 7f09dac0a640 1 --2- 172.21.15.5:0/2386982966 >> [v2:172.21.15.154:6800/3949375489,v1:172.21.15.154:6801/3949375489] conn(0x7f09b806eb80 0x7f09b8070f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.330+0000 7f257d2ca640 1 -- 172.21.15.5:0/661100838 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2564066350 msgr2=0x7f2564068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.330+0000 7f257d2ca640 1 --2- 172.21.15.5:0/661100838 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2564066350 0x7f2564068800 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f25780c3640 tx=0x7f256c009060 comp rx=0 tx=0).stop 2023-07-14T12:52:53.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.330+0000 7f257d2ca640 1 -- 172.21.15.5:0/661100838 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25780c1340 msgr2=0x7f25780b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.330+0000 7f5218974640 1 -- 172.21.15.5:0/1098662252 --> [v2:172.21.15.5:6809/3251687665,v1:172.21.15.5:6811/3251687665] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f521406f1e0 con 0x7f51f406ec00 2023-07-14T12:52:53.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.326+0000 7ff74e7fc640 1 -- 172.21.15.5:0/357036317 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff7500b5050 con 0x7ff758158be0 2023-07-14T12:52:53.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.326+0000 7ff74e7fc640 1 --2- 172.21.15.5:0/357036317 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff73c066350 0x7ff73c068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.330+0000 7ff74e7fc640 1 -- 172.21.15.5:0/357036317 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff75011e800 con 0x7ff758158be0 2023-07-14T12:52:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.330+0000 7ff74e7fc640 1 --2- 172.21.15.5:0/357036317 >> [v2:172.21.15.154:6824/1951324705,v1:172.21.15.154:6825/1951324705] conn(0x7ff73c06eb80 0x7ff73c070f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.330+0000 7ff74e7fc640 1 -- 172.21.15.5:0/357036317 --> [v2:172.21.15.154:6824/1951324705,v1:172.21.15.154:6825/1951324705] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff73c071640 con 0x7ff73c06eb80 2023-07-14T12:52:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.330+0000 7ff75d867640 1 --2- 172.21.15.5:0/357036317 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff73c066350 0x7ff73c068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.330+0000 7ff75d066640 1 --2- 172.21.15.5:0/357036317 >> [v2:172.21.15.154:6824/1951324705,v1:172.21.15.154:6825/1951324705] conn(0x7ff73c06eb80 0x7ff73c070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.330+0000 7ff75d066640 1 --2- 172.21.15.5:0/357036317 >> [v2:172.21.15.154:6824/1951324705,v1:172.21.15.154:6825/1951324705] conn(0x7ff73c06eb80 0x7ff73c070f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.330+0000 7ff75d867640 1 --2- 172.21.15.5:0/357036317 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff73c066350 0x7ff73c068800 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff754004b90 tx=0x7ff754006050 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.330+0000 7ff74e7fc640 1 -- 172.21.15.5:0/357036317 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7500ebda0 con 0x7ff758158be0 2023-07-14T12:52:53.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.330+0000 7f257d2ca640 1 --2- 172.21.15.5:0/661100838 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25780c1340 0x7f25780b27d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f25700af040 tx=0x7f25700194c0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.330+0000 7f25777fe640 1 -- 172.21.15.5:0/661100838 reap_dead start 2023-07-14T12:52:53.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.330+0000 7f257d2ca640 1 -- 172.21.15.5:0/661100838 shutdown_connections 2023-07-14T12:52:53.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.330+0000 7f09caffd640 1 -- 172.21.15.5:0/2386982966 <== osd.5 v2:172.21.15.154:6800/3949375489 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f09b8071640 con 0x7f09b806eb80 2023-07-14T12:52:53.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.330+0000 7f257d2ca640 1 -- 172.21.15.5:0/661100838 >> 172.21.15.5:0/661100838 conn(0x7f25780ce9d0 msgr2=0x7f25781572a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:53.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.330+0000 7f5202ffd640 1 -- 172.21.15.5:0/1098662252 <== osd.0 v2:172.21.15.5:6809/3251687665 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5204004040 con 0x7f51f406ec00 2023-07-14T12:52:53.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.334+0000 7f257d2ca640 1 -- 172.21.15.5:0/661100838 shutdown_connections 2023-07-14T12:52:53.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.334+0000 7f257d2ca640 1 -- 172.21.15.5:0/661100838 wait complete. 2023-07-14T12:52:53.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.334+0000 7ff74e7fc640 1 -- 172.21.15.5:0/357036317 <== osd.6 v2:172.21.15.154:6824/1951324705 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff73c071640 con 0x7ff73c06eb80 2023-07-14T12:52:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.334+0000 7f5218974640 1 -- 172.21.15.5:0/1098662252 >> [v2:172.21.15.5:6809/3251687665,v1:172.21.15.5:6811/3251687665] conn(0x7f51f406ec00 msgr2=0x7f51f4071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.334+0000 7f5218974640 1 --2- 172.21.15.5:0/1098662252 >> [v2:172.21.15.5:6809/3251687665,v1:172.21.15.5:6811/3251687665] conn(0x7f51f406ec00 0x7f51f4071010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.334+0000 7f5218974640 1 -- 172.21.15.5:0/1098662252 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f51f4066350 msgr2=0x7f51f4068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.334+0000 7f5218974640 1 --2- 172.21.15.5:0/1098662252 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f51f4066350 0x7f51f4068800 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f520c0073f0 tx=0x7f520c00b040 comp rx=0 tx=0).stop 2023-07-14T12:52:53.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.334+0000 7f5218974640 1 -- 172.21.15.5:0/1098662252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f521406c4d0 msgr2=0x7f5214152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.334+0000 7f5218974640 1 --2- 172.21.15.5:0/1098662252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f521406c4d0 0x7f5214152280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f520800c400 tx=0x7f520800c8c0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.334+0000 7f5212d9d640 1 -- 172.21.15.5:0/1098662252 reap_dead start 2023-07-14T12:52:53.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.334+0000 7f5218974640 1 -- 172.21.15.5:0/1098662252 shutdown_connections 2023-07-14T12:52:53.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.334+0000 7f5218974640 1 -- 172.21.15.5:0/1098662252 >> 172.21.15.5:0/1098662252 conn(0x7f52140ce9d0 msgr2=0x7f52140c8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:53.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.334+0000 7f5218974640 1 -- 172.21.15.5:0/1098662252 shutdown_connections 2023-07-14T12:52:53.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.334+0000 7f5218974640 1 -- 172.21.15.5:0/1098662252 wait complete. 2023-07-14T12:52:53.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.346+0000 7fa04e7fc640 1 -- 172.21.15.5:0/702100137 --> [v2:172.21.15.5:6800/559368967,v1:172.21.15.5:6801/559368967] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa0680c8710 con 0x7fa05406ec00 2023-07-14T12:52:53.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.346+0000 7fa064ff9640 1 -- 172.21.15.5:0/702100137 <== osd.2 v2:172.21.15.5:6800/559368967 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa0600a5b50 con 0x7fa05406ec00 2023-07-14T12:52:53.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.346+0000 7f9a864d8640 1 -- 172.21.15.5:0/2899411532 --> [v2:172.21.15.5:6824/4061664720,v1:172.21.15.5:6825/4061664720] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9a60002cc0 con 0x7f9a6c06ec00 2023-07-14T12:52:53.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.346+0000 7fa06e27b640 1 -- 172.21.15.5:0/702100137 >> [v2:172.21.15.5:6800/559368967,v1:172.21.15.5:6801/559368967] conn(0x7fa05406ec00 msgr2=0x7fa054071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.346+0000 7fa06e27b640 1 --2- 172.21.15.5:0/702100137 >> [v2:172.21.15.5:6800/559368967,v1:172.21.15.5:6801/559368967] conn(0x7fa05406ec00 0x7fa054071010 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.346+0000 7f9a7cff9640 1 -- 172.21.15.5:0/2899411532 <== osd.3 v2:172.21.15.5:6824/4061664720 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9a60002cc0 con 0x7f9a6c06ec00 2023-07-14T12:52:53.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.346+0000 7f9a667fc640 1 -- 172.21.15.5:0/2899411532 >> [v2:172.21.15.5:6824/4061664720,v1:172.21.15.5:6825/4061664720] conn(0x7f9a6c06ec00 msgr2=0x7f9a6c071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.346+0000 7f9a667fc640 1 --2- 172.21.15.5:0/2899411532 >> [v2:172.21.15.5:6824/4061664720,v1:172.21.15.5:6825/4061664720] conn(0x7f9a6c06ec00 0x7f9a6c071010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.350+0000 7f9a667fc640 1 -- 172.21.15.5:0/2899411532 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9a6c066350 msgr2=0x7f9a6c068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.350+0000 7f9a667fc640 1 --2- 172.21.15.5:0/2899411532 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9a6c066350 0x7f9a6c068800 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9a740af000 tx=0x7f9a74004740 comp rx=0 tx=0).stop 2023-07-14T12:52:53.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.350+0000 7f9a667fc640 1 -- 172.21.15.5:0/2899411532 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a8014b460 msgr2=0x7f9a80157fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.350+0000 7f9a667fc640 1 --2- 172.21.15.5:0/2899411532 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a8014b460 0x7f9a80157fc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800fbb0 tx=0x7f9a78005830 comp rx=0 tx=0).stop 2023-07-14T12:52:53.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.350+0000 7f9a84a75640 1 -- 172.21.15.5:0/2899411532 reap_dead start 2023-07-14T12:52:53.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.350+0000 7f9a667fc640 1 -- 172.21.15.5:0/2899411532 shutdown_connections 2023-07-14T12:52:53.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.350+0000 7f9a667fc640 1 -- 172.21.15.5:0/2899411532 >> 172.21.15.5:0/2899411532 conn(0x7f9a800ce980 msgr2=0x7f9a800ccdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:53.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.350+0000 7f9a667fc640 1 -- 172.21.15.5:0/2899411532 shutdown_connections 2023-07-14T12:52:53.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.350+0000 7f9a667fc640 1 -- 172.21.15.5:0/2899411532 wait complete. 2023-07-14T12:52:53.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.350+0000 7f3fdf893640 1 -- 172.21.15.5:0/2901563015 --> [v2:172.21.15.154:6808/1270457700,v1:172.21.15.154:6810/1270457700] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3fd80678d0 con 0x7f3fbc06ec00 2023-07-14T12:52:53.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.350+0000 7fa06e27b640 1 -- 172.21.15.5:0/702100137 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa054066350 msgr2=0x7fa054068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.350+0000 7fa06e27b640 1 --2- 172.21.15.5:0/702100137 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa054066350 0x7fa054068800 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa0681583e0 tx=0x7fa058009240 comp rx=0 tx=0).stop 2023-07-14T12:52:53.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.350+0000 7f3fcdffb640 1 -- 172.21.15.5:0/2901563015 <== osd.7 v2:172.21.15.154:6808/1270457700 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3fd80678d0 con 0x7f3fbc06ec00 2023-07-14T12:52:53.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.350+0000 7fa06e27b640 1 -- 172.21.15.5:0/702100137 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa068069970 msgr2=0x7fa06806f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.350+0000 7fa06e27b640 1 --2- 172.21.15.5:0/702100137 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa068069970 0x7fa06806f410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa05c000f70 tx=0x7fa05c00c870 comp rx=0 tx=0).stop 2023-07-14T12:52:53.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.350+0000 7fa06c818640 1 -- 172.21.15.5:0/702100137 reap_dead start 2023-07-14T12:52:53.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.350+0000 7fa06e27b640 1 -- 172.21.15.5:0/702100137 shutdown_connections 2023-07-14T12:52:53.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.350+0000 7fa06e27b640 1 -- 172.21.15.5:0/702100137 >> 172.21.15.5:0/702100137 conn(0x7fa0680ce980 msgr2=0x7fa0680ab8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:53.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.354+0000 7f3fdf893640 1 -- 172.21.15.5:0/2901563015 >> [v2:172.21.15.154:6808/1270457700,v1:172.21.15.154:6810/1270457700] conn(0x7f3fbc06ec00 msgr2=0x7f3fbc071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.354+0000 7f3fdf893640 1 --2- 172.21.15.5:0/2901563015 >> [v2:172.21.15.154:6808/1270457700,v1:172.21.15.154:6810/1270457700] conn(0x7f3fbc06ec00 0x7f3fbc071010 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.354+0000 7f28e3b03640 1 -- 172.21.15.5:0/1683813083 --> [v2:172.21.15.154:6809/3408721900,v1:172.21.15.154:6811/3408721900] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f28dc0ca310 con 0x7f28c006ebb0 2023-07-14T12:52:53.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.354+0000 7f3fdf893640 1 -- 172.21.15.5:0/2901563015 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3fbc066350 msgr2=0x7f3fbc068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.354+0000 7f3fdf893640 1 --2- 172.21.15.5:0/2901563015 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3fbc066350 0x7f3fbc068800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3fd80afcc0 tx=0x7f3fd4009040 comp rx=0 tx=0).stop 2023-07-14T12:52:53.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.354+0000 7f3fdf893640 1 -- 172.21.15.5:0/2901563015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fd806c000 msgr2=0x7f3fd80ae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.354+0000 7f3fdf893640 1 --2- 172.21.15.5:0/2901563015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fd806c000 0x7f3fd80ae070 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3fc800c390 tx=0x7f3fc800c850 comp rx=0 tx=0).stop 2023-07-14T12:52:53.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.354+0000 7fa06e27b640 1 -- 172.21.15.5:0/702100137 shutdown_connections 2023-07-14T12:52:53.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.354+0000 7f3fdde30640 1 -- 172.21.15.5:0/2901563015 reap_dead start 2023-07-14T12:52:53.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.354+0000 7fa06e27b640 1 -- 172.21.15.5:0/702100137 wait complete. 2023-07-14T12:52:53.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.354+0000 7f3fdf893640 1 -- 172.21.15.5:0/2901563015 shutdown_connections 2023-07-14T12:52:53.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.354+0000 7f3fdf893640 1 -- 172.21.15.5:0/2901563015 >> 172.21.15.5:0/2901563015 conn(0x7f3fd80b0980 msgr2=0x7f3fd8152680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:53.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.354+0000 7f3fdf893640 1 -- 172.21.15.5:0/2901563015 shutdown_connections 2023-07-14T12:52:53.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.354+0000 7f3fdf893640 1 -- 172.21.15.5:0/2901563015 wait complete. 2023-07-14T12:52:53.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.354+0000 7f28d27fc640 1 -- 172.21.15.5:0/1683813083 <== osd.4 v2:172.21.15.154:6809/3408721900 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f28d40b6040 con 0x7f28c006ebb0 2023-07-14T12:52:53.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.354+0000 7f09db40b640 1 -- 172.21.15.5:0/2386982966 --> [v2:172.21.15.154:6800/3949375489,v1:172.21.15.154:6801/3949375489] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f09d40cb260 con 0x7f09b806eb80 2023-07-14T12:52:53.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.354+0000 7f09caffd640 1 -- 172.21.15.5:0/2386982966 <== osd.5 v2:172.21.15.154:6800/3949375489 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f09d40cb260 con 0x7f09b806eb80 2023-07-14T12:52:53.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.354+0000 7f09db40b640 1 -- 172.21.15.5:0/2386982966 >> [v2:172.21.15.154:6800/3949375489,v1:172.21.15.154:6801/3949375489] conn(0x7f09b806eb80 msgr2=0x7f09b8070f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.354+0000 7f09db40b640 1 --2- 172.21.15.5:0/2386982966 >> [v2:172.21.15.154:6800/3949375489,v1:172.21.15.154:6801/3949375489] conn(0x7f09b806eb80 0x7f09b8070f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.354+0000 7f28e3b03640 1 -- 172.21.15.5:0/1683813083 >> [v2:172.21.15.154:6809/3408721900,v1:172.21.15.154:6811/3408721900] conn(0x7f28c006ebb0 msgr2=0x7f28c0070fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.354+0000 7f28e3b03640 1 --2- 172.21.15.5:0/1683813083 >> [v2:172.21.15.154:6809/3408721900,v1:172.21.15.154:6811/3408721900] conn(0x7f28c006ebb0 0x7f28c0070fc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.354+0000 7f09db40b640 1 -- 172.21.15.5:0/2386982966 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f09b8066350 msgr2=0x7f09b8068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.354+0000 7f09db40b640 1 --2- 172.21.15.5:0/2386982966 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f09b8066350 0x7f09b8068800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f09d0000c10 tx=0x7f09d00079d0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.354+0000 7f09db40b640 1 -- 172.21.15.5:0/2386982966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09d40b7a10 msgr2=0x7f09d40cb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.354+0000 7f09db40b640 1 --2- 172.21.15.5:0/2386982966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09d40b7a10 0x7f09d40cb590 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f09c40ad040 tx=0x7f09c401acb0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.354+0000 7f09dac0a640 1 -- 172.21.15.5:0/2386982966 reap_dead start 2023-07-14T12:52:53.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.358+0000 7f28e3b03640 1 -- 172.21.15.5:0/1683813083 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f28c0066380 msgr2=0x7f28c0068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.358+0000 7f28e3b03640 1 --2- 172.21.15.5:0/1683813083 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f28c0066380 0x7f28c0068830 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f28cc006fd0 tx=0x7f28cc0090e0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.358+0000 7f28e3b03640 1 -- 172.21.15.5:0/1683813083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28dc0c6fb0 msgr2=0x7f28dc0c5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.358+0000 7f28e3b03640 1 --2- 172.21.15.5:0/1683813083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28dc0c6fb0 0x7f28dc0c5760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f28d800d8e0 tx=0x7f28d800dda0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.358+0000 7f28e20a0640 1 -- 172.21.15.5:0/1683813083 reap_dead start 2023-07-14T12:52:53.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.358+0000 7f28e3b03640 1 -- 172.21.15.5:0/1683813083 shutdown_connections 2023-07-14T12:52:53.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.358+0000 7f28e3b03640 1 -- 172.21.15.5:0/1683813083 >> 172.21.15.5:0/1683813083 conn(0x7f28dc0ce9d0 msgr2=0x7f28dc0ca490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:53.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.358+0000 7f28e3b03640 1 -- 172.21.15.5:0/1683813083 shutdown_connections 2023-07-14T12:52:53.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.358+0000 7f28e3b03640 1 -- 172.21.15.5:0/1683813083 wait complete. 2023-07-14T12:52:53.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.362+0000 7ff73bfff640 1 -- 172.21.15.5:0/357036317 --> [v2:172.21.15.154:6824/1951324705,v1:172.21.15.154:6825/1951324705] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff734002cc0 con 0x7ff73c06eb80 2023-07-14T12:52:53.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.362+0000 7ff74e7fc640 1 -- 172.21.15.5:0/357036317 <== osd.6 v2:172.21.15.154:6824/1951324705 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff734002cc0 con 0x7ff73c06eb80 2023-07-14T12:52:53.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.362+0000 7ff73bfff640 1 -- 172.21.15.5:0/357036317 >> [v2:172.21.15.154:6824/1951324705,v1:172.21.15.154:6825/1951324705] conn(0x7ff73c06eb80 msgr2=0x7ff73c070f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.362+0000 7ff73bfff640 1 --2- 172.21.15.5:0/357036317 >> [v2:172.21.15.154:6824/1951324705,v1:172.21.15.154:6825/1951324705] conn(0x7ff73c06eb80 0x7ff73c070f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.362+0000 7ff73bfff640 1 -- 172.21.15.5:0/357036317 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff73c066350 msgr2=0x7ff73c068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.362+0000 7ff73bfff640 1 --2- 172.21.15.5:0/357036317 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff73c066350 0x7ff73c068800 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff754004b90 tx=0x7ff754006050 comp rx=0 tx=0).stop 2023-07-14T12:52:53.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.362+0000 7ff73bfff640 1 -- 172.21.15.5:0/357036317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff758158be0 msgr2=0x7ff7581f63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.362+0000 7ff73bfff640 1 --2- 172.21.15.5:0/357036317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff758158be0 0x7ff7581f63f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff75001a520 tx=0x7ff75001a6b0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.362+0000 7ff75e068640 1 -- 172.21.15.5:0/357036317 reap_dead start 2023-07-14T12:52:53.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.362+0000 7ff73bfff640 1 -- 172.21.15.5:0/357036317 shutdown_connections 2023-07-14T12:52:53.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.362+0000 7ff73bfff640 1 -- 172.21.15.5:0/357036317 >> 172.21.15.5:0/357036317 conn(0x7ff7580ce9d0 msgr2=0x7ff7580c37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:53.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.366+0000 7ff73bfff640 1 -- 172.21.15.5:0/357036317 shutdown_connections 2023-07-14T12:52:53.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.366+0000 7ff73bfff640 1 -- 172.21.15.5:0/357036317 wait complete. 2023-07-14T12:52:53.439 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2023-07-14T12:52:53.440 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-14T12:52:53.441 INFO:teuthology.orchestra.run.smithi005.stdout:55834574856 2023-07-14T12:52:53.441 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-14T12:52:53.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.378+0000 7f09db40b640 1 -- 172.21.15.5:0/2386982966 shutdown_connections 2023-07-14T12:52:53.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.378+0000 7f09db40b640 1 -- 172.21.15.5:0/2386982966 >> 172.21.15.5:0/2386982966 conn(0x7f09d4069ea0 msgr2=0x7f09d40ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:53.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.378+0000 7f09db40b640 1 -- 172.21.15.5:0/2386982966 shutdown_connections 2023-07-14T12:52:53.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.378+0000 7f09db40b640 1 -- 172.21.15.5:0/2386982966 wait complete. 2023-07-14T12:52:53.443 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-07-14T12:52:53.443 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-14T12:52:53.444 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-07-14T12:52:53.444 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-14T12:52:53.445 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-07-14T12:52:53.445 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-14T12:52:53.446 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-07-14T12:52:53.446 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-14T12:52:53.447 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2023-07-14T12:52:53.447 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-14T12:52:53.448 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-07-14T12:52:53.449 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-14T12:52:53.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.694+0000 7fc04c905640 1 Processor -- start 2023-07-14T12:52:53.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.694+0000 7fc04c905640 1 -- start start 2023-07-14T12:52:53.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.698+0000 7fc04c905640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc048157a30 0x7fc04806f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.698+0000 7fc04c905640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc04806f7d0 0x7fc0480cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.698+0000 7fc04c905640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc04806ae00 con 0x7fc0480cc950 2023-07-14T12:52:53.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.698+0000 7fc04c905640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0480c8a40 con 0x7fc048157a30 2023-07-14T12:52:53.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.698+0000 7fc04c905640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04806fbe0 con 0x7fc04806f7d0 2023-07-14T12:52:53.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.698+0000 7fc0477fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc048157a30 0x7fc04806f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.698+0000 7fc0477fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc048157a30 0x7fc04806f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52746/0 (socket says 172.21.15.5:52746) 2023-07-14T12:52:53.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.698+0000 7fc0477fe640 1 -- 172.21.15.5:0/3606896692 learned_addr learned my addr 172.21.15.5:0/3606896692 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:53.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.698+0000 7fc046ffd640 1 --2- 172.21.15.5:0/3606896692 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc04806f7d0 0x7fc0480cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.698+0000 7fc0477fe640 1 -- 172.21.15.5:0/3606896692 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc04806f7d0 msgr2=0x7fc0480cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:53.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.698+0000 7fc0477fe640 1 --2- 172.21.15.5:0/3606896692 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc04806f7d0 0x7fc0480cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.698+0000 7fc0477fe640 1 -- 172.21.15.5:0/3606896692 >> v1:172.21.15.154:6789/0 conn(0x7fc0480cc950 legacy=0x7fc04815b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:53.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.698+0000 7fc0477fe640 1 -- 172.21.15.5:0/3606896692 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0480cd0b0 con 0x7fc048157a30 2023-07-14T12:52:53.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.702+0000 7fc0477fe640 1 --2- 172.21.15.5:0/3606896692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc048157a30 0x7fc04806f290 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc03c008870 tx=0x7fc03c01e950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34eb366d28d83c16 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.702+0000 7fc0467fc640 1 -- 172.21.15.5:0/3606896692 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c0a79e0 con 0x7fc048157a30 2023-07-14T12:52:53.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.702+0000 7fc0467fc640 1 -- 172.21.15.5:0/3606896692 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03c0ab070 con 0x7fc048157a30 2023-07-14T12:52:53.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.702+0000 7fc0467fc640 1 -- 172.21.15.5:0/3606896692 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c0a79e0 con 0x7fc048157a30 2023-07-14T12:52:53.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.706+0000 7fc04c905640 1 -- 172.21.15.5:0/3606896692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc048157a30 msgr2=0x7fc04806f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.706+0000 7fc04c905640 1 --2- 172.21.15.5:0/3606896692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc048157a30 0x7fc04806f290 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc03c008870 tx=0x7fc03c01e950 comp rx=0 tx=0).stop 2023-07-14T12:52:53.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.706+0000 7fc04c905640 1 -- 172.21.15.5:0/3606896692 shutdown_connections 2023-07-14T12:52:53.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.706+0000 7fc04c905640 1 --2- 172.21.15.5:0/3606896692 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc04806f7d0 0x7fc0480cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.706+0000 7fc04c905640 1 --2- 172.21.15.5:0/3606896692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc048157a30 0x7fc04806f290 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.706+0000 7fc04c905640 1 -- 172.21.15.5:0/3606896692 >> 172.21.15.5:0/3606896692 conn(0x7fc0480cb540 msgr2=0x7fc0480cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:53.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.706+0000 7fc04c905640 1 -- 172.21.15.5:0/3606896692 shutdown_connections 2023-07-14T12:52:53.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.706+0000 7fb62a7d2640 1 Processor -- start 2023-07-14T12:52:53.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.706+0000 7fb62a7d2640 1 -- start start 2023-07-14T12:52:53.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.706+0000 7fb62a7d2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb624168da0 0x7fb62406b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.706+0000 7fb62a7d2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb62406f080 con 0x7fb624069430 2023-07-14T12:52:53.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.706+0000 7fb62a7d2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6240cd990 con 0x7fb624169b90 2023-07-14T12:52:53.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.706+0000 7fb62a7d2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb62406d0d0 con 0x7fb624168da0 2023-07-14T12:52:53.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.706+0000 7fb6297d0640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb624069430 0x7fb624069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38876/0 (socket says 172.21.15.5:38876) 2023-07-14T12:52:53.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.706+0000 7fb6297d0640 1 -- 172.21.15.5:0/695182335 learned_addr learned my addr 172.21.15.5:0/695182335 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:53.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.706+0000 7fb628fcf640 1 --2- 172.21.15.5:0/695182335 >> v2:172.21.15.154:3300/0 conn(0x7fb624168da0 0x7fb62406b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.706+0000 7fb61bfff640 1 -- 172.21.15.5:0/695182335 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2453268443 0 0) 0x7fb62406f080 con 0x7fb624069430 2023-07-14T12:52:53.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.706+0000 7fb61bfff640 1 -- 172.21.15.5:0/695182335 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb610003530 con 0x7fb624069430 2023-07-14T12:52:53.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.706+0000 7fb628fcf640 1 -- 172.21.15.5:0/695182335 >> v1:172.21.15.154:6789/0 conn(0x7fb624169b90 legacy=0x7fb6240cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.706+0000 7fb628fcf640 1 -- 172.21.15.5:0/695182335 >> v1:172.21.15.5:6789/0 conn(0x7fb624069430 legacy=0x7fb624069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.706+0000 7fb628fcf640 1 -- 172.21.15.5:0/695182335 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62406f2d0 con 0x7fb624168da0 2023-07-14T12:52:53.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.706+0000 7fc04c905640 1 -- 172.21.15.5:0/3606896692 wait complete. 2023-07-14T12:52:53.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.710+0000 7fc04c905640 1 Processor -- start 2023-07-14T12:52:53.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.710+0000 7fc04c905640 1 -- start start 2023-07-14T12:52:53.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.710+0000 7fc04c905640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc04806f7d0 0x7fc0481f4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.710+0000 7fc04c905640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0480cc950 0x7fc04814f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.710+0000 7fc0477fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc04806f7d0 0x7fc0481f4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.710+0000 7fc0477fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc04806f7d0 0x7fc0481f4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52748/0 (socket says 172.21.15.5:52748) 2023-07-14T12:52:53.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.710+0000 7fc0477fe640 1 -- 172.21.15.5:0/1607992148 learned_addr learned my addr 172.21.15.5:0/1607992148 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:53.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.710+0000 7fc04c905640 1 --2- 172.21.15.5:0/1607992148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc048157a30 0x7fc0481583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.710+0000 7fb628fcf640 1 --2- 172.21.15.5:0/695182335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb624168da0 0x7fb62406b150 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb614010ba0 tx=0x7fb614020980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d02e58f3e4fdded server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.710+0000 7fc046ffd640 1 --2- 172.21.15.5:0/1607992148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0480cc950 0x7fc04814f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.710+0000 7fb61bfff640 1 -- 172.21.15.5:0/695182335 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6140a9a70 con 0x7fb624168da0 2023-07-14T12:52:53.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.714+0000 7fc047fff640 1 --2- 172.21.15.5:0/1607992148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc048157a30 0x7fc0481583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.714+0000 7fc04c905640 1 -- 172.21.15.5:0/1607992148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0481f53e0 con 0x7fc04806f7d0 2023-07-14T12:52:53.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.714+0000 7fc04c905640 1 -- 172.21.15.5:0/1607992148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0481f7ef0 con 0x7fc048157a30 2023-07-14T12:52:53.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.714+0000 7fc04c905640 1 -- 172.21.15.5:0/1607992148 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0481f81d0 con 0x7fc0480cc950 2023-07-14T12:52:53.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.714+0000 7fb61bfff640 1 -- 172.21.15.5:0/695182335 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6140ad070 con 0x7fb624168da0 2023-07-14T12:52:53.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.714+0000 7fb62a7d2640 1 -- 172.21.15.5:0/695182335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb624168da0 msgr2=0x7fb62406b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.714+0000 7fb61bfff640 1 -- 172.21.15.5:0/695182335 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6140a9a70 con 0x7fb624168da0 2023-07-14T12:52:53.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.714+0000 7fb62a7d2640 1 --2- 172.21.15.5:0/695182335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb624168da0 0x7fb62406b150 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb614010ba0 tx=0x7fb614020980 comp rx=0 tx=0).stop 2023-07-14T12:52:53.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.714+0000 7fb62a7d2640 1 -- 172.21.15.5:0/695182335 shutdown_connections 2023-07-14T12:52:53.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.714+0000 7fb62a7d2640 1 --2- 172.21.15.5:0/695182335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb624168da0 0x7fb62406b150 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.714+0000 7fb62a7d2640 1 -- 172.21.15.5:0/695182335 >> 172.21.15.5:0/695182335 conn(0x7fb6240cdde0 msgr2=0x7fb6240ce1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:53.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.714+0000 7f9d34da9640 1 Processor -- start 2023-07-14T12:52:53.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.714+0000 7fb62a7d2640 1 -- 172.21.15.5:0/695182335 shutdown_connections 2023-07-14T12:52:53.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.714+0000 7fc0477fe640 1 -- 172.21.15.5:0/1607992148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0480cc950 msgr2=0x7fc04814f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.714+0000 7fc0477fe640 1 --2- 172.21.15.5:0/1607992148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0480cc950 0x7fc04814f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.714+0000 7fc0477fe640 1 -- 172.21.15.5:0/1607992148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc048157a30 msgr2=0x7fc0481583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.714+0000 7fc0477fe640 1 --2- 172.21.15.5:0/1607992148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc048157a30 0x7fc0481583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.714+0000 7fc0477fe640 1 -- 172.21.15.5:0/1607992148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03c008550 con 0x7fc04806f7d0 2023-07-14T12:52:53.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.714+0000 7fc046ffd640 1 --2- 172.21.15.5:0/1607992148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0480cc950 0x7fc04814f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:52:53.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.714+0000 7f9d34da9640 1 -- start start 2023-07-14T12:52:53.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.714+0000 7fc0477fe640 1 --2- 172.21.15.5:0/1607992148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc04806f7d0 0x7fc0481f4ea0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc03c01f1f0 tx=0x7fc03c01d190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.714+0000 7fc02ffff640 1 -- 172.21.15.5:0/1607992148 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c0a79e0 con 0x7fc04806f7d0 2023-07-14T12:52:53.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.714+0000 7fc02ffff640 1 -- 172.21.15.5:0/1607992148 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03c00b150 con 0x7fc04806f7d0 2023-07-14T12:52:53.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.714+0000 7fc02ffff640 1 -- 172.21.15.5:0/1607992148 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c00b2e0 con 0x7fc04806f7d0 2023-07-14T12:52:53.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.718+0000 7fc04c905640 1 -- 172.21.15.5:0/1607992148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0481f84b0 con 0x7fc04806f7d0 2023-07-14T12:52:53.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.718+0000 7fc04c905640 1 -- 172.21.15.5:0/1607992148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0480b3010 con 0x7fc04806f7d0 2023-07-14T12:52:53.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.714+0000 7fb62a7d2640 1 -- 172.21.15.5:0/695182335 wait complete. 2023-07-14T12:52:53.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.718+0000 7fb62a7d2640 1 Processor -- start 2023-07-14T12:52:53.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.718+0000 7fb62a7d2640 1 -- start start 2023-07-14T12:52:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.718+0000 7fb62a7d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb624069430 0x7fb62415fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.718+0000 7fb62a7d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb624169b90 0x7fb6240b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.718+0000 7fb62a7d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6240c0960 0x7fb6240c0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.718+0000 7fb6297d0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb624069430 0x7fb62415fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.718+0000 7fb6297d0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb624069430 0x7fb62415fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:45082/0 (socket says 172.21.15.5:45082) 2023-07-14T12:52:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.718+0000 7fb6297d0640 1 -- 172.21.15.5:0/857063603 learned_addr learned my addr 172.21.15.5:0/857063603 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.718+0000 7fb628fcf640 1 --2- 172.21.15.5:0/857063603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb624169b90 0x7fb6240b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.718+0000 7fb62a7d2640 1 -- 172.21.15.5:0/857063603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb624162590 con 0x7fb6240c0960 2023-07-14T12:52:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.718+0000 7fb62a7d2640 1 -- 172.21.15.5:0/857063603 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6240c6410 con 0x7fb624069430 2023-07-14T12:52:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.718+0000 7fb62a7d2640 1 -- 172.21.15.5:0/857063603 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6240bf540 con 0x7fb624169b90 2023-07-14T12:52:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.718+0000 7f9d34da9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9d300af8b0 0x7f9d300afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.718+0000 7f9d34da9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d300707f0 0x7f9d30070c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7fb6297d0640 1 -- 172.21.15.5:0/857063603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb624169b90 msgr2=0x7fb6240b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7fb6297d0640 1 --2- 172.21.15.5:0/857063603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb624169b90 0x7fb6240b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7fb6297d0640 1 -- 172.21.15.5:0/857063603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6240c0960 msgr2=0x7fb6240c0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7fb6297d0640 1 --2- 172.21.15.5:0/857063603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6240c0960 0x7fb6240c0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7fb6297d0640 1 -- 172.21.15.5:0/857063603 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb614010800 con 0x7fb624069430 2023-07-14T12:52:53.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7fb628fcf640 1 --2- 172.21.15.5:0/857063603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb624169b90 0x7fb6240b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:52:53.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.718+0000 7f9d34da9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d300cd7b0 con 0x7f9d3015fd60 2023-07-14T12:52:53.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.718+0000 7f9d34da9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d300b0290 con 0x7f9d300af8b0 2023-07-14T12:52:53.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.718+0000 7f9d34da9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3006c8b0 con 0x7f9d300707f0 2023-07-14T12:52:53.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7fb6297d0640 1 --2- 172.21.15.5:0/857063603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb624069430 0x7fb62415fd80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb62000bcc0 tx=0x7fb620009e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.718+0000 7f9d2effd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9d300af8b0 0x7f9d300afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.718+0000 7f9d2effd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9d300af8b0 0x7f9d300afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:45066/0 (socket says 172.21.15.5:45066) 2023-07-14T12:52:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.718+0000 7f9d2effd640 1 -- 172.21.15.5:0/2891503596 learned_addr learned my addr 172.21.15.5:0/2891503596 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7fb619ffb640 1 -- 172.21.15.5:0/857063603 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb620015470 con 0x7fb624069430 2023-07-14T12:52:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7fb619ffb640 1 -- 172.21.15.5:0/857063603 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6200155d0 con 0x7fb624069430 2023-07-14T12:52:53.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7fb619ffb640 1 -- 172.21.15.5:0/857063603 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb620015980 con 0x7fb624069430 2023-07-14T12:52:53.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.718+0000 7f9d2effd640 1 -- 172.21.15.5:0/2891503596 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d300707f0 msgr2=0x7f9d30070c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T12:52:53.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.718+0000 7f9d2effd640 1 --2- 172.21.15.5:0/2891503596 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d300707f0 0x7f9d30070c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7fbd91818640 1 Processor -- start 2023-07-14T12:52:53.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.718+0000 7f9d2effd640 1 -- 172.21.15.5:0/2891503596 >> v1:172.21.15.5:6789/0 conn(0x7f9d3015fd60 legacy=0x7f9d300cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:53.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.718+0000 7f9d2effd640 1 -- 172.21.15.5:0/2891503596 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3006d360 con 0x7f9d300af8b0 2023-07-14T12:52:53.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7fb62a7d2640 1 -- 172.21.15.5:0/857063603 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb624161fd0 con 0x7fb624069430 2023-07-14T12:52:53.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7fb62a7d2640 1 -- 172.21.15.5:0/857063603 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6240c60a0 con 0x7fb624069430 2023-07-14T12:52:53.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7f9d2effd640 1 --2- 172.21.15.5:0/2891503596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d300af8b0 0x7f9d300afd50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9d20009870 tx=0x7f9d2001c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55b514eb700ded16 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7f9d2e7fc640 1 -- 172.21.15.5:0/2891503596 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d200ab650 con 0x7f9d300af8b0 2023-07-14T12:52:53.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7f9d2e7fc640 1 -- 172.21.15.5:0/2891503596 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d200ab7b0 con 0x7f9d300af8b0 2023-07-14T12:52:53.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7f9d2e7fc640 1 -- 172.21.15.5:0/2891503596 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d200abb40 con 0x7f9d300af8b0 2023-07-14T12:52:53.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7fc02ffff640 1 -- 172.21.15.5:0/1607992148 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc03c00b440 con 0x7fc04806f7d0 2023-07-14T12:52:53.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7fc04c905640 1 -- 172.21.15.5:0/1607992148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0480678d0 con 0x7fc04806f7d0 2023-07-14T12:52:53.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7fc02ffff640 1 --2- 172.21.15.5:0/1607992148 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc0340662d0 0x7fc034068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7fc02ffff640 1 -- 172.21.15.5:0/1607992148 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc03c11dcc0 con 0x7fc04806f7d0 2023-07-14T12:52:53.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7fc046ffd640 1 --2- 172.21.15.5:0/1607992148 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc0340662d0 0x7fc034068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7f9d34da9640 1 -- 172.21.15.5:0/2891503596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d300af8b0 msgr2=0x7f9d300afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7f9d34da9640 1 --2- 172.21.15.5:0/2891503596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d300af8b0 0x7f9d300afd50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9d20009870 tx=0x7f9d2001c490 comp rx=0 tx=0).stop 2023-07-14T12:52:53.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7f9d34da9640 1 -- 172.21.15.5:0/2891503596 shutdown_connections 2023-07-14T12:52:53.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7f9d34da9640 1 --2- 172.21.15.5:0/2891503596 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d300707f0 0x7f9d30070c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7f9d34da9640 1 --2- 172.21.15.5:0/2891503596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d300af8b0 0x7f9d300afd50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7f9d34da9640 1 -- 172.21.15.5:0/2891503596 >> 172.21.15.5:0/2891503596 conn(0x7f9d300ca8b0 msgr2=0x7f9d300cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:53.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7f9d34da9640 1 -- 172.21.15.5:0/2891503596 shutdown_connections 2023-07-14T12:52:53.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.726+0000 7fc046ffd640 1 --2- 172.21.15.5:0/1607992148 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc0340662d0 0x7fc034068780 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc04815b080 tx=0x7fc0400098d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.726+0000 7fb62a7d2640 1 -- 172.21.15.5:0/857063603 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6240c5f00 con 0x7fb624069430 2023-07-14T12:52:53.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7fbd91818640 1 -- start start 2023-07-14T12:52:53.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7fbd91818640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbd840e6d20 0x7fbd840070b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7fbd91818640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd84036d50 0x7fbd84052820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7fbd91818640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd84054500 con 0x7fbd84050e80 2023-07-14T12:52:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7fbd91818640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd840547e0 con 0x7fbd840e6d20 2023-07-14T12:52:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.722+0000 7fbd91818640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8404f3b0 con 0x7fbd84036d50 2023-07-14T12:52:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.726+0000 7f9d34da9640 1 -- 172.21.15.5:0/2891503596 wait complete. 2023-07-14T12:52:53.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.726+0000 7fbd90816640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbd840e6d20 0x7fbd840070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.726+0000 7fbd90816640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbd840e6d20 0x7fbd840070b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:45098/0 (socket says 172.21.15.5:45098) 2023-07-14T12:52:53.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.726+0000 7fbd90816640 1 -- 172.21.15.5:0/1506042523 learned_addr learned my addr 172.21.15.5:0/1506042523 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:53.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.726+0000 7fbd91017640 1 --2- 172.21.15.5:0/1506042523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd84036d50 0x7fbd84052820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.726+0000 7fb619ffb640 1 -- 172.21.15.5:0/857063603 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb620012070 con 0x7fb624069430 2023-07-14T12:52:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.726+0000 7fb619ffb640 1 --2- 172.21.15.5:0/857063603 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb6080662d0 0x7fb608068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.726+0000 7f9d34da9640 1 Processor -- start 2023-07-14T12:52:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.726+0000 7fb619ffb640 1 -- 172.21.15.5:0/857063603 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb620083e50 con 0x7fb624069430 2023-07-14T12:52:53.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.726+0000 7fb628fcf640 1 --2- 172.21.15.5:0/857063603 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb6080662d0 0x7fb608068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.726+0000 7fbd90816640 1 -- 172.21.15.5:0/1506042523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd84036d50 msgr2=0x7fbd84052820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:53.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.726+0000 7fbd90816640 1 --2- 172.21.15.5:0/1506042523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd84036d50 0x7fbd84052820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.726+0000 7fbd90816640 1 -- 172.21.15.5:0/1506042523 >> v1:172.21.15.5:6789/0 conn(0x7fbd84050e80 legacy=0x7fbd84036640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:53.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.726+0000 7fbd90816640 1 -- 172.21.15.5:0/1506042523 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8404f690 con 0x7fbd840e6d20 2023-07-14T12:52:53.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.726+0000 7fb628fcf640 1 --2- 172.21.15.5:0/857063603 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb6080662d0 0x7fb608068780 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb6140b4000 tx=0x7fb6140ab070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.726+0000 7f9d34da9640 1 -- start start 2023-07-14T12:52:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f9d34da9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d300707f0 0x7f9d3015b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f71411c5640 1 Processor -- start 2023-07-14T12:52:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f9d34da9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d300af8b0 0x7f9d3014b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f9d2f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d300707f0 0x7f9d3015b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f9d2f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d300707f0 0x7f9d3015b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52764/0 (socket says 172.21.15.5:52764) 2023-07-14T12:52:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f9d34da9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d3015fd60 0x7f9d300b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f9d2effd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d300af8b0 0x7f9d3014b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f3794a76640 1 Processor -- start 2023-07-14T12:52:53.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f9d2effd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d300af8b0 0x7f9d3014b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:54950/0 (socket says 172.21.15.5:54950) 2023-07-14T12:52:53.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f9d34da9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d300c2210 con 0x7f9d300707f0 2023-07-14T12:52:53.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f9d34da9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3015c000 con 0x7f9d3015fd60 2023-07-14T12:52:53.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f9d34da9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d300b33c0 con 0x7f9d300af8b0 2023-07-14T12:52:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f9d2f7fe640 1 -- 172.21.15.5:0/3710044227 learned_addr learned my addr 172.21.15.5:0/3710044227 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f9d2ffff640 1 --2- 172.21.15.5:0/3710044227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d3015fd60 0x7f9d300b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f71411c5640 1 -- start start 2023-07-14T12:52:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f71411c5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f713c15fe60 0x7f713c070db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f71411c5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f713c0cad90 0x7f713c0cc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f71411c5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713c0cbdc0 con 0x7f713c0c9670 2023-07-14T12:52:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f71411c5640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f713c0cb840 con 0x7f713c0cad90 2023-07-14T12:52:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f71411c5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713c160230 con 0x7f713c15fe60 2023-07-14T12:52:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f9d2ffff640 1 -- 172.21.15.5:0/3710044227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d300af8b0 msgr2=0x7f9d3014b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f9d2ffff640 1 --2- 172.21.15.5:0/3710044227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d300af8b0 0x7f9d3014b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f9d2ffff640 1 -- 172.21.15.5:0/3710044227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d300707f0 msgr2=0x7f9d3015b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f9d2ffff640 1 --2- 172.21.15.5:0/3710044227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d300707f0 0x7f9d3015b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f9d2ffff640 1 -- 172.21.15.5:0/3710044227 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d200094d0 con 0x7f9d3015fd60 2023-07-14T12:52:53.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f3794a76640 1 -- start start 2023-07-14T12:52:53.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f713ad9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f713c15fe60 0x7f713c070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7fc1b5363640 1 Processor -- start 2023-07-14T12:52:53.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7fc1b5363640 1 -- start start 2023-07-14T12:52:53.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f713ad9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f713c15fe60 0x7f713c070db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:54960/0 (socket says 172.21.15.5:54960) 2023-07-14T12:52:53.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f713ad9d640 1 -- 172.21.15.5:0/3905045778 learned_addr learned my addr 172.21.15.5:0/3905045778 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:53.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f713b59e640 1 --2- 172.21.15.5:0/3905045778 >> v2:172.21.15.154:3300/0 conn(0x7f713c0cad90 0x7f713c0cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7fb619ffb640 1 -- 172.21.15.5:0/857063603 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb6240c5f00 con 0x7fb624069430 2023-07-14T12:52:53.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.730+0000 7f9d2ffff640 1 --2- 172.21.15.5:0/3710044227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d3015fd60 0x7f9d300b2e80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9d2400b410 tx=0x7f9d2400b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7f9d17fff640 1 -- 172.21.15.5:0/3710044227 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d24011830 con 0x7f9d3015fd60 2023-07-14T12:52:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7f9d17fff640 1 -- 172.21.15.5:0/3710044227 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d24011990 con 0x7f9d3015fd60 2023-07-14T12:52:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7f9d17fff640 1 -- 172.21.15.5:0/3710044227 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d24011d40 con 0x7f9d3015fd60 2023-07-14T12:52:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7f9d34da9640 1 -- 172.21.15.5:0/3710044227 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d300b3680 con 0x7f9d3015fd60 2023-07-14T12:52:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7f9d34da9640 1 -- 172.21.15.5:0/3710044227 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d300c2460 con 0x7f9d3015fd60 2023-07-14T12:52:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7f713ad9d640 1 -- 172.21.15.5:0/3905045778 >> v2:172.21.15.154:3300/0 conn(0x7f713c0cad90 msgr2=0x7f713c0cc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7f713ad9d640 1 --2- 172.21.15.5:0/3905045778 >> v2:172.21.15.154:3300/0 conn(0x7f713c0cad90 0x7f713c0cc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7f713ad9d640 1 -- 172.21.15.5:0/3905045778 >> v1:172.21.15.5:6789/0 conn(0x7f713c0c9670 legacy=0x7f713c0ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7f713ad9d640 1 -- 172.21.15.5:0/3905045778 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c0c9fc0 con 0x7f713c15fe60 2023-07-14T12:52:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7f3794a76640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f37900ce540 0x7f37901577d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7fc02ffff640 1 -- 172.21.15.5:0/1607992148 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc03c0eb3f0 con 0x7fc04806f7d0 2023-07-14T12:52:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7fc1b5363640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc1b00af8b0 0x7fc1b00afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7fc1b5363640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b015e290 con 0x7fc1b0159850 2023-07-14T12:52:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7fc1b5363640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b015a660 con 0x7fc1b00cd7e0 2023-07-14T12:52:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7fc1b5363640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b00b0290 con 0x7fc1b00af8b0 2023-07-14T12:52:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7fc1af7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc1b00cd7e0 0x7fc1b0159c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:58070/0 (socket says 172.21.15.5:58070) 2023-07-14T12:52:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7fc1af7fe640 1 -- 172.21.15.5:0/3963153946 learned_addr learned my addr 172.21.15.5:0/3963153946 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7fc1b4b62640 1 --2- 172.21.15.5:0/3963153946 >> v2:172.21.15.5:3300/0 conn(0x7fc1b00af8b0 0x7fc1b00afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7f9d34da9640 1 -- 172.21.15.5:0/3710044227 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d10005260 con 0x7f9d3015fd60 2023-07-14T12:52:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7f2cd93c4640 1 Processor -- start 2023-07-14T12:52:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7f2cd93c4640 1 -- start start 2023-07-14T12:52:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7f9d17fff640 1 -- 172.21.15.5:0/3710044227 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9d2401a400 con 0x7f9d3015fd60 2023-07-14T12:52:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7f713ad9d640 1 --2- 172.21.15.5:0/3905045778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f713c15fe60 0x7f713c070db0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f712c009870 tx=0x7f712c01c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d813e5d2a47460a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7fc1b4b62640 1 -- 172.21.15.5:0/3963153946 >> v1:172.21.15.154:6789/0 conn(0x7fc1b00cd7e0 legacy=0x7fc1b0159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7fc1b4b62640 1 -- 172.21.15.5:0/3963153946 >> v1:172.21.15.5:6789/0 conn(0x7fc1b0159850 legacy=0x7fc1b015db80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T12:52:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7fc1b4b62640 1 -- 172.21.15.5:0/3963153946 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b00ca4a0 con 0x7fc1b00af8b0 2023-07-14T12:52:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7f7139d9b640 1 -- 172.21.15.5:0/3905045778 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712c0ac620 con 0x7f713c15fe60 2023-07-14T12:52:53.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7f7139d9b640 1 -- 172.21.15.5:0/3905045778 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712c0ac780 con 0x7f713c15fe60 2023-07-14T12:52:53.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7f3794a76640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f379006f290 0x7f379006f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7f3794a76640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f379006ae00 con 0x7f37900cc410 2023-07-14T12:52:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7f3794a76640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37900c8a40 con 0x7f37900ce540 2023-07-14T12:52:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7f3794a76640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379006fbe0 con 0x7f379006f290 2023-07-14T12:52:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7f378effd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f379006f290 0x7f379006f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7f378effd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f379006f290 0x7f379006f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:54962/0 (socket says 172.21.15.5:54962) 2023-07-14T12:52:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7f378effd640 1 -- 172.21.15.5:0/2419066619 learned_addr learned my addr 172.21.15.5:0/2419066619 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7f378effd640 1 -- 172.21.15.5:0/2419066619 >> v2:172.21.15.5:3300/0 conn(0x7f37900ce540 msgr2=0x7f37901577d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T12:52:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7f378effd640 1 --2- 172.21.15.5:0/2419066619 >> v2:172.21.15.5:3300/0 conn(0x7f37900ce540 0x7f37901577d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7f378effd640 1 -- 172.21.15.5:0/2419066619 >> v1:172.21.15.154:6789/0 conn(0x7f37900cc410 legacy=0x7f37900cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.734+0000 7f378effd640 1 -- 172.21.15.5:0/2419066619 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379015e940 con 0x7f379006f290 2023-07-14T12:52:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7fbd90816640 1 --2- 172.21.15.5:0/1506042523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd840e6d20 0x7fbd840070b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbd80009870 tx=0x7fbd8001c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bea2480825e0595 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7fbd8b7fe640 1 -- 172.21.15.5:0/1506042523 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd800ab600 con 0x7fbd840e6d20 2023-07-14T12:52:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7fbd8b7fe640 1 -- 172.21.15.5:0/1506042523 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd800a7050 con 0x7fbd840e6d20 2023-07-14T12:52:53.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7fbd8b7fe640 1 -- 172.21.15.5:0/1506042523 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd800ab980 con 0x7fbd840e6d20 2023-07-14T12:52:53.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7f71411c5640 1 -- 172.21.15.5:0/3905045778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f713c15fe60 msgr2=0x7f713c070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7f71411c5640 1 --2- 172.21.15.5:0/3905045778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f713c15fe60 0x7f713c070db0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f712c009870 tx=0x7f712c01c460 comp rx=0 tx=0).stop 2023-07-14T12:52:53.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7f2cd3fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2ccc0dc250 0x7f2ccc036640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:58082/0 (socket says 172.21.15.5:58082) 2023-07-14T12:52:53.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7f9d17fff640 1 --2- 172.21.15.5:0/3710044227 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9d1c066350 0x7f9d1c068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7f9d17fff640 1 -- 172.21.15.5:0/3710044227 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9d24083b90 con 0x7f9d3015fd60 2023-07-14T12:52:53.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7f378effd640 1 --2- 172.21.15.5:0/2419066619 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f379006f290 0x7f379006f6a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3778009870 tx=0x7f377801c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=887c09e5ecede607 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7f9d2f7fe640 1 --2- 172.21.15.5:0/3710044227 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9d1c066350 0x7f9d1c068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7f2cd93c4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2ccc036d50 0x7f2ccc04f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7f71411c5640 1 -- 172.21.15.5:0/3905045778 shutdown_connections 2023-07-14T12:52:53.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7f71411c5640 1 --2- 172.21.15.5:0/3905045778 >> v2:172.21.15.154:3300/0 conn(0x7f713c0cad90 0x7f713c0cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7f71411c5640 1 --2- 172.21.15.5:0/3905045778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f713c15fe60 0x7f713c070db0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7f71411c5640 1 -- 172.21.15.5:0/3905045778 >> 172.21.15.5:0/3905045778 conn(0x7f713c0af840 msgr2=0x7f713c0afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:53.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7f2cd93c4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ccc04f750 0x7f2ccc005ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7f2cd3fff640 1 -- 172.21.15.5:0/1540711115 learned_addr learned my addr 172.21.15.5:0/1540711115 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:53.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7f2cd93c4640 1 -- 172.21.15.5:0/1540711115 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ccc0ded10 con 0x7f2ccc0dc250 2023-07-14T12:52:53.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7f2cd93c4640 1 -- 172.21.15.5:0/1540711115 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ccc0defd0 con 0x7f2ccc036d50 2023-07-14T12:52:53.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7f2cd93c4640 1 -- 172.21.15.5:0/1540711115 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc0df2b0 con 0x7f2ccc04f750 2023-07-14T12:52:53.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7f2cd37fe640 1 --2- 172.21.15.5:0/1540711115 >> v2:172.21.15.154:3300/0 conn(0x7f2ccc036d50 0x7f2ccc04f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7f378e7fc640 1 -- 172.21.15.5:0/2419066619 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37780ab620 con 0x7f379006f290 2023-07-14T12:52:53.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7f378e7fc640 1 -- 172.21.15.5:0/2419066619 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37780ab780 con 0x7f379006f290 2023-07-14T12:52:53.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7f378e7fc640 1 -- 172.21.15.5:0/2419066619 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37780abb10 con 0x7f379006f290 2023-07-14T12:52:53.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.738+0000 7f2cd8bc3640 1 --2- 172.21.15.5:0/1540711115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ccc04f750 0x7f2ccc005ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7f2cd37fe640 1 -- 172.21.15.5:0/1540711115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ccc04f750 msgr2=0x7f2ccc005ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:53.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7f2cd37fe640 1 --2- 172.21.15.5:0/1540711115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ccc04f750 0x7f2ccc005ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7f2cd37fe640 1 -- 172.21.15.5:0/1540711115 >> v1:172.21.15.154:6789/0 conn(0x7f2ccc0dc250 legacy=0x7f2ccc036640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7f2cd37fe640 1 -- 172.21.15.5:0/1540711115 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ccc0df590 con 0x7f2ccc036d50 2023-07-14T12:52:53.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7f9d2f7fe640 1 --2- 172.21.15.5:0/3710044227 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9d1c066350 0x7f9d1c068800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9d300c21a0 tx=0x7f9d28003e70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7fbd91818640 1 -- 172.21.15.5:0/1506042523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd840e6d20 msgr2=0x7fbd840070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7fbd91818640 1 --2- 172.21.15.5:0/1506042523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd840e6d20 0x7fbd840070b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbd80009870 tx=0x7fbd8001c460 comp rx=0 tx=0).stop 2023-07-14T12:52:53.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7f71411c5640 1 -- 172.21.15.5:0/3905045778 shutdown_connections 2023-07-14T12:52:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7fbd91818640 1 -- 172.21.15.5:0/1506042523 shutdown_connections 2023-07-14T12:52:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7fbd91818640 1 --2- 172.21.15.5:0/1506042523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd84036d50 0x7fbd84052820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7fbd91818640 1 --2- 172.21.15.5:0/1506042523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd840e6d20 0x7fbd840070b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7fbd91818640 1 -- 172.21.15.5:0/1506042523 >> 172.21.15.5:0/1506042523 conn(0x7fbd84051640 msgr2=0x7fbd84051a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7fc1b4b62640 1 --2- 172.21.15.5:0/3963153946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1b00af8b0 0x7fc1b00afd50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8009d90 tx=0x7fc1a801c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b1fb417106e24d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7f71411c5640 1 -- 172.21.15.5:0/3905045778 wait complete. 2023-07-14T12:52:53.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7fbd91818640 1 -- 172.21.15.5:0/1506042523 shutdown_connections 2023-07-14T12:52:53.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7fc1aeffd640 1 -- 172.21.15.5:0/3963153946 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a80a57f0 con 0x7fc1b00af8b0 2023-07-14T12:52:53.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7f3794a76640 1 -- 172.21.15.5:0/2419066619 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f379006f290 msgr2=0x7f379006f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7f3794a76640 1 --2- 172.21.15.5:0/2419066619 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f379006f290 0x7f379006f6a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3778009870 tx=0x7f377801c460 comp rx=0 tx=0).stop 2023-07-14T12:52:53.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7f3794a76640 1 -- 172.21.15.5:0/2419066619 shutdown_connections 2023-07-14T12:52:53.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7f3794a76640 1 --2- 172.21.15.5:0/2419066619 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f379006f290 0x7f379006f6a0 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3778009870 tx=0x7f377801c460 comp rx=0 tx=0).stop 2023-07-14T12:52:53.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7f3794a76640 1 --2- 172.21.15.5:0/2419066619 >> v2:172.21.15.5:3300/0 conn(0x7f37900ce540 0x7f37901577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7f3794a76640 1 -- 172.21.15.5:0/2419066619 >> 172.21.15.5:0/2419066619 conn(0x7f37900cb540 msgr2=0x7f37900cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:53.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7fc1aeffd640 1 -- 172.21.15.5:0/3963153946 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a80a5950 con 0x7fc1b00af8b0 2023-07-14T12:52:53.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7f9d17fff640 1 -- 172.21.15.5:0/3710044227 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9d240510a0 con 0x7f9d3015fd60 2023-07-14T12:52:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7fc1b5363640 1 -- 172.21.15.5:0/3963153946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1b00af8b0 msgr2=0x7fc1b00afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7fc1b5363640 1 --2- 172.21.15.5:0/3963153946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1b00af8b0 0x7fc1b00afd50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8009d90 tx=0x7fc1a801c770 comp rx=0 tx=0).stop 2023-07-14T12:52:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7fc1b5363640 1 -- 172.21.15.5:0/3963153946 shutdown_connections 2023-07-14T12:52:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7fc1b5363640 1 --2- 172.21.15.5:0/3963153946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1b00af8b0 0x7fc1b00afd50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7fc1b5363640 1 -- 172.21.15.5:0/3963153946 >> 172.21.15.5:0/3963153946 conn(0x7fc1b00ca8b0 msgr2=0x7fc1b00cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7fc1b5363640 1 -- 172.21.15.5:0/3963153946 shutdown_connections 2023-07-14T12:52:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7fbd91818640 1 -- 172.21.15.5:0/1506042523 wait complete. 2023-07-14T12:52:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7fbd91818640 1 Processor -- start 2023-07-14T12:52:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7f2cd37fe640 1 --2- 172.21.15.5:0/1540711115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ccc036d50 0x7f2ccc04f210 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2cc00097c0 tx=0x7f2cc001ce70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6daac4b41643fac server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7f71411c5640 1 Processor -- start 2023-07-14T12:52:53.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7f71411c5640 1 -- start start 2023-07-14T12:52:53.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7f3794a76640 1 -- 172.21.15.5:0/2419066619 shutdown_connections 2023-07-14T12:52:53.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7f71411c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f713c0c9670 0x7f713c1f90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7fbd91818640 1 -- start start 2023-07-14T12:52:53.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7fbd91818640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd84036d50 0x7fbd840ea600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7fbd91818640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd84050e80 0x7fbd840ec190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7f71411c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f713c0cad90 0x7f713c0c2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.742+0000 7fc1b5363640 1 -- 172.21.15.5:0/3963153946 wait complete. 2023-07-14T12:52:53.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7fc1b5363640 1 Processor -- start 2023-07-14T12:52:53.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7fbd90816640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd84036d50 0x7fbd840ea600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7fbd90816640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd84036d50 0x7fbd840ea600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:45118/0 (socket says 172.21.15.5:45118) 2023-07-14T12:52:53.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7fbd8bfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd84050e80 0x7fbd840ec190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7fbd8bfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd84050e80 0x7fbd840ec190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:54986/0 (socket says 172.21.15.5:54986) 2023-07-14T12:52:53.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7fbd90816640 1 -- 172.21.15.5:0/2103976962 learned_addr learned my addr 172.21.15.5:0/2103976962 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:53.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7f3794a76640 1 -- 172.21.15.5:0/2419066619 wait complete. 2023-07-14T12:52:53.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7fc1b5363640 1 -- start start 2023-07-14T12:52:53.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7f713a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f713c0cad90 0x7f713c0c2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7f713a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f713c0cad90 0x7f713c0c2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52782/0 (socket says 172.21.15.5:52782) 2023-07-14T12:52:53.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7f3794a76640 1 Processor -- start 2023-07-14T12:52:53.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7f2cd2ffd640 1 -- 172.21.15.5:0/1540711115 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc00a4ea0 con 0x7f2ccc036d50 2023-07-14T12:52:53.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7f2cd2ffd640 1 -- 172.21.15.5:0/1540711115 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc00a7050 con 0x7f2ccc036d50 2023-07-14T12:52:53.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7f2cd2ffd640 1 -- 172.21.15.5:0/1540711115 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc00ab820 con 0x7f2ccc036d50 2023-07-14T12:52:53.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7f713a59c640 1 -- 172.21.15.5:0/2683544775 learned_addr learned my addr 172.21.15.5:0/2683544775 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:53.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7f2cd93c4640 1 -- 172.21.15.5:0/1540711115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ccc036d50 msgr2=0x7f2ccc04f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7f2cd93c4640 1 --2- 172.21.15.5:0/1540711115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ccc036d50 0x7f2ccc04f210 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2cc00097c0 tx=0x7f2cc001ce70 comp rx=0 tx=0).stop 2023-07-14T12:52:53.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7f71411c5640 1 --2- 172.21.15.5:0/2683544775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f713c15fe60 0x7f713c15a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7fbd91818640 1 --2- 172.21.15.5:0/2103976962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd840e6d20 0x7fbd840dc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7f71411c5640 1 -- 172.21.15.5:0/2683544775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c1f95f0 con 0x7f713c0cad90 2023-07-14T12:52:53.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7f71411c5640 1 -- 172.21.15.5:0/2683544775 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0c32c0 con 0x7f713c0c9670 2023-07-14T12:52:53.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7f71411c5640 1 -- 172.21.15.5:0/2683544775 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713c15ae30 con 0x7f713c15fe60 2023-07-14T12:52:53.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7f713b59e640 1 --2- 172.21.15.5:0/2683544775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f713c15fe60 0x7f713c15a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fbd91017640 1 --2- 172.21.15.5:0/2103976962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd840e6d20 0x7fbd840dc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f713ad9d640 1 --2- 172.21.15.5:0/2683544775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f713c0c9670 0x7f713c1f90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fbd91818640 1 -- 172.21.15.5:0/2103976962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd840dbba0 con 0x7fbd840e6d20 2023-07-14T12:52:53.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fbd91818640 1 -- 172.21.15.5:0/2103976962 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd84048d60 con 0x7fbd84036d50 2023-07-14T12:52:53.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fbd91818640 1 -- 172.21.15.5:0/2103976962 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd840dc830 con 0x7fbd84050e80 2023-07-14T12:52:53.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.746+0000 7f3794a76640 1 -- start start 2023-07-14T12:52:53.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f3794a76640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37900cc410 0x7f3790165f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f3794a76640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37900ce540 0x7f37901558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f3794a76640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3790155e10 0x7f3790147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f3794a76640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3790149430 con 0x7f3790155e10 2023-07-14T12:52:53.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f3794a76640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3790156280 con 0x7f37900ce540 2023-07-14T12:52:53.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f3794a76640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3790149640 con 0x7f37900cc410 2023-07-14T12:52:53.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fc1b5363640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1b00cd7e0 0x7fc1b0156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fc1b5363640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1b0159850 0x7fc1b00b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fc1b5363640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1b01e4eb0 0x7fc1b01f3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f713b59e640 1 -- 172.21.15.5:0/2683544775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f713c0c9670 msgr2=0x7f713c1f90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f713b59e640 1 --2- 172.21.15.5:0/2683544775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f713c0c9670 0x7f713c1f90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f713b59e640 1 -- 172.21.15.5:0/2683544775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f713c0cad90 msgr2=0x7f713c0c2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f713b59e640 1 --2- 172.21.15.5:0/2683544775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f713c0cad90 0x7f713c0c2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f713b59e640 1 -- 172.21.15.5:0/2683544775 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712c0094d0 con 0x7f713c15fe60 2023-07-14T12:52:53.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f713b59e640 1 --2- 172.21.15.5:0/2683544775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f713c15fe60 0x7f713c15a8f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f713400ce30 tx=0x7f71340076c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fbd8bfff640 1 -- 172.21.15.5:0/2103976962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd84036d50 msgr2=0x7fbd840ea600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fbd8bfff640 1 --2- 172.21.15.5:0/2103976962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd84036d50 0x7fbd840ea600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fbd8bfff640 1 -- 172.21.15.5:0/2103976962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd840e6d20 msgr2=0x7fbd840dc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fbd8bfff640 1 --2- 172.21.15.5:0/2103976962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd840e6d20 0x7fbd840dc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fbd8bfff640 1 -- 172.21.15.5:0/2103976962 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd800094d0 con 0x7fbd84050e80 2023-07-14T12:52:53.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fc1af7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1b0159850 0x7fc1b00b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fc1af7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1b0159850 0x7fc1b00b33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:55006/0 (socket says 172.21.15.5:55006) 2023-07-14T12:52:53.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fc1af7fe640 1 -- 172.21.15.5:0/127096587 learned_addr learned my addr 172.21.15.5:0/127096587 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:53.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fc1b5363640 1 -- 172.21.15.5:0/127096587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b01e3140 con 0x7fc1b00cd7e0 2023-07-14T12:52:53.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f378f7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37900cc410 0x7f3790165f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fc1b4b62640 1 --2- 172.21.15.5:0/127096587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1b01e4eb0 0x7fc1b01f3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f378f7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37900cc410 0x7f3790165f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:55012/0 (socket says 172.21.15.5:55012) 2023-07-14T12:52:53.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f378f7fe640 1 -- 172.21.15.5:0/1560500894 learned_addr learned my addr 172.21.15.5:0/1560500894 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:53.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fc1b5363640 1 -- 172.21.15.5:0/127096587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b00b0d00 con 0x7fc1b01e4eb0 2023-07-14T12:52:53.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fbd8bfff640 1 --2- 172.21.15.5:0/2103976962 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd84050e80 0x7fbd840ec190 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400dca0 tx=0x7fbd7800c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fc1b5363640 1 -- 172.21.15.5:0/127096587 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b00b0f70 con 0x7fc1b0159850 2023-07-14T12:52:53.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f71237fe640 1 -- 172.21.15.5:0/2683544775 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7134011070 con 0x7f713c15fe60 2023-07-14T12:52:53.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f71237fe640 1 -- 172.21.15.5:0/2683544775 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713400c2e0 con 0x7f713c15fe60 2023-07-14T12:52:53.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f71237fe640 1 -- 172.21.15.5:0/2683544775 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713400a660 con 0x7f713c15fe60 2023-07-14T12:52:53.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f378ffff640 1 --2- 172.21.15.5:0/1560500894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3790155e10 0x7f3790147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fc1af7fe640 1 -- 172.21.15.5:0/127096587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1b01e4eb0 msgr2=0x7fc1b01f3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fc1af7fe640 1 --2- 172.21.15.5:0/127096587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1b01e4eb0 0x7fc1b01f3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fc1af7fe640 1 -- 172.21.15.5:0/127096587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1b00cd7e0 msgr2=0x7fc1b0156e50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T12:52:53.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fc1af7fe640 1 --2- 172.21.15.5:0/127096587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1b00cd7e0 0x7fc1b0156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fc1af7fe640 1 -- 172.21.15.5:0/127096587 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a8009a70 con 0x7fc1b0159850 2023-07-14T12:52:53.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f378effd640 1 --2- 172.21.15.5:0/1560500894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37900ce540 0x7f37901558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fc1af7fe640 1 --2- 172.21.15.5:0/127096587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1b0159850 0x7fc1b00b33e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc1a400c7b0 tx=0x7fc1a400cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fc1acff9640 1 -- 172.21.15.5:0/127096587 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a40074e0 con 0x7fc1b0159850 2023-07-14T12:52:53.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fc1acff9640 1 -- 172.21.15.5:0/127096587 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a4007640 con 0x7fc1b0159850 2023-07-14T12:52:53.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fc1acff9640 1 -- 172.21.15.5:0/127096587 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4004a30 con 0x7fc1b0159850 2023-07-14T12:52:53.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fbd897fa640 1 -- 172.21.15.5:0/2103976962 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd78003600 con 0x7fbd84050e80 2023-07-14T12:52:53.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fbd897fa640 1 -- 172.21.15.5:0/2103976962 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd78003760 con 0x7fbd84050e80 2023-07-14T12:52:53.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7fbd897fa640 1 -- 172.21.15.5:0/2103976962 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd78003b30 con 0x7fbd84050e80 2023-07-14T12:52:53.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f378effd640 1 -- 172.21.15.5:0/1560500894 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37900cc410 msgr2=0x7f3790165f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f378effd640 1 --2- 172.21.15.5:0/1560500894 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37900cc410 0x7f3790165f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f378effd640 1 -- 172.21.15.5:0/1560500894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3790155e10 msgr2=0x7f3790147020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f378effd640 1 --2- 172.21.15.5:0/1560500894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3790155e10 0x7f3790147020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f378effd640 1 -- 172.21.15.5:0/1560500894 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37780094d0 con 0x7f37900ce540 2023-07-14T12:52:53.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.754+0000 7fc1b5363640 1 -- 172.21.15.5:0/127096587 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b00b1250 con 0x7fc1b0159850 2023-07-14T12:52:53.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.754+0000 7fbd91818640 1 -- 172.21.15.5:0/2103976962 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd840499a0 con 0x7fbd84050e80 2023-07-14T12:52:53.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.754+0000 7f71411c5640 1 -- 172.21.15.5:0/2683544775 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713c0c3d90 con 0x7f713c15fe60 2023-07-14T12:52:53.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.754+0000 7f71411c5640 1 -- 172.21.15.5:0/2683544775 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713c0b0d00 con 0x7f713c15fe60 2023-07-14T12:52:53.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.754+0000 7fbd91818640 1 -- 172.21.15.5:0/2103976962 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd84049f60 con 0x7fbd84050e80 2023-07-14T12:52:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f2cd93c4640 1 -- 172.21.15.5:0/1540711115 shutdown_connections 2023-07-14T12:52:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f2cd93c4640 1 --2- 172.21.15.5:0/1540711115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ccc04f750 0x7f2ccc005ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f2cd93c4640 1 --2- 172.21.15.5:0/1540711115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ccc036d50 0x7f2ccc04f210 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f2cd93c4640 1 -- 172.21.15.5:0/1540711115 >> 172.21.15.5:0/1540711115 conn(0x7f2ccc051640 msgr2=0x7f2ccc051a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f2cd93c4640 1 -- 172.21.15.5:0/1540711115 shutdown_connections 2023-07-14T12:52:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.750+0000 7f2cd93c4640 1 -- 172.21.15.5:0/1540711115 wait complete. 2023-07-14T12:52:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.754+0000 7fc1b5363640 1 -- 172.21.15.5:0/127096587 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b00b3920 con 0x7fc1b0159850 2023-07-14T12:52:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.754+0000 7f2cd93c4640 1 Processor -- start 2023-07-14T12:52:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.754+0000 7f378effd640 1 --2- 172.21.15.5:0/1560500894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37900ce540 0x7f37901558d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f37780ac000 tx=0x7f377801aca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.754+0000 7f3787fff640 1 -- 172.21.15.5:0/1560500894 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37780abe00 con 0x7f37900ce540 2023-07-14T12:52:53.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.754+0000 7f3787fff640 1 -- 172.21.15.5:0/1560500894 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37780be430 con 0x7f37900ce540 2023-07-14T12:52:53.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.754+0000 7f3787fff640 1 -- 172.21.15.5:0/1560500894 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37780be7e0 con 0x7f37900ce540 2023-07-14T12:52:53.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.754+0000 7f71411c5640 1 -- 172.21.15.5:0/2683544775 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f713c0b0e90 con 0x7f713c15fe60 2023-07-14T12:52:53.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.754+0000 7f2cd93c4640 1 -- start start 2023-07-14T12:52:53.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.754+0000 7fc1b5363640 1 -- 172.21.15.5:0/127096587 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b00678d0 con 0x7fc1b0159850 2023-07-14T12:52:53.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.754+0000 7f3794a76640 1 -- 172.21.15.5:0/1560500894 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3790149920 con 0x7f37900ce540 2023-07-14T12:52:53.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.754+0000 7f3794a76640 1 -- 172.21.15.5:0/1560500894 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3790149ee0 con 0x7f37900ce540 2023-07-14T12:52:53.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.758+0000 7fbd76ffd640 1 -- 172.21.15.5:0/2103976962 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd840e8c70 con 0x7fbd84050e80 2023-07-14T12:52:53.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.758+0000 7fc1acff9640 1 -- 172.21.15.5:0/127096587 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc1a4004b90 con 0x7fc1b0159850 2023-07-14T12:52:53.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.754+0000 7f2cd93c4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ccc036d50 0x7f2ccc035030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.754+0000 7f2cd93c4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ccc04f750 0x7f2ccc0eca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.754+0000 7f2cd3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ccc036d50 0x7f2ccc035030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.754+0000 7f2cd3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ccc036d50 0x7f2ccc035030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:45160/0 (socket says 172.21.15.5:45160) 2023-07-14T12:52:53.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.758+0000 7f2cd93c4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ccc0dc250 0x7f2ccc04a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.758+0000 7f2cd93c4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc035570 con 0x7f2ccc04f750 2023-07-14T12:52:53.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.758+0000 7f2cd93c4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc04a240 con 0x7f2ccc036d50 2023-07-14T12:52:53.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.758+0000 7f2cd93c4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ccc036150 con 0x7f2ccc0dc250 2023-07-14T12:52:53.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.758+0000 7f2cd3fff640 1 -- 172.21.15.5:0/1891008354 learned_addr learned my addr 172.21.15.5:0/1891008354 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:53.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.758+0000 7f2cd8bc3640 1 --2- 172.21.15.5:0/1891008354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ccc0dc250 0x7f2ccc04a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.758+0000 7f3794a76640 1 -- 172.21.15.5:0/1560500894 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f379014a0d0 con 0x7f37900ce540 2023-07-14T12:52:53.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.758+0000 7fbd897fa640 1 -- 172.21.15.5:0/2103976962 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbd78003c90 con 0x7fbd84050e80 2023-07-14T12:52:53.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.758+0000 7f2cd8bc3640 1 -- 172.21.15.5:0/1891008354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ccc036d50 msgr2=0x7f2ccc035030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.758+0000 7f2cd8bc3640 1 --2- 172.21.15.5:0/1891008354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ccc036d50 0x7f2ccc035030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.758+0000 7f2cd8bc3640 1 -- 172.21.15.5:0/1891008354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ccc04f750 msgr2=0x7f2ccc0eca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:53.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.758+0000 7f2cd8bc3640 1 --2- 172.21.15.5:0/1891008354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ccc04f750 0x7f2ccc0eca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:53.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.758+0000 7f2cd8bc3640 1 -- 172.21.15.5:0/1891008354 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc0009420 con 0x7f2ccc0dc250 2023-07-14T12:52:53.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.758+0000 7f2cd3fff640 1 --2- 172.21.15.5:0/1891008354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ccc036d50 0x7f2ccc035030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:52:53.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.758+0000 7f2cd8bc3640 1 --2- 172.21.15.5:0/1891008354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ccc0dc250 0x7f2ccc04a6d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800d530 tx=0x7f2cc800d9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.758+0000 7fc1acff9640 1 --2- 172.21.15.5:0/127096587 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc19c0662a0 0x7fc19c068750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.758+0000 7fc1acff9640 1 -- 172.21.15.5:0/127096587 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc1a40835a0 con 0x7fc1b0159850 2023-07-14T12:52:53.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.758+0000 7f71237fe640 1 -- 172.21.15.5:0/2683544775 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f713400a7c0 con 0x7f713c15fe60 2023-07-14T12:52:53.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.758+0000 7fbd897fa640 1 --2- 172.21.15.5:0/2103976962 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fbd7c0664b0 0x7fbd7c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.758+0000 7fc1affff640 1 --2- 172.21.15.5:0/127096587 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc19c0662a0 0x7fc19c068750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.758+0000 7fbd897fa640 1 -- 172.21.15.5:0/2103976962 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbd78083210 con 0x7fbd84050e80 2023-07-14T12:52:53.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.758+0000 7fbd90816640 1 --2- 172.21.15.5:0/2103976962 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fbd7c0664b0 0x7fbd7c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.762+0000 7fbd90816640 1 --2- 172.21.15.5:0/2103976962 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fbd7c0664b0 0x7fbd7c068960 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbd80009870 tx=0x7fbd800a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.762+0000 7fc1affff640 1 --2- 172.21.15.5:0/127096587 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc19c0662a0 0x7fc19c068750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0001500 tx=0x7fc1a0007a60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.762+0000 7f71237fe640 1 --2- 172.21.15.5:0/2683544775 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7124066420 0x7f71240688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.762+0000 7f71237fe640 1 -- 172.21.15.5:0/2683544775 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7134083ff0 con 0x7f713c15fe60 2023-07-14T12:52:53.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.762+0000 7f713ad9d640 1 --2- 172.21.15.5:0/2683544775 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7124066420 0x7f71240688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.762+0000 7f3787fff640 1 -- 172.21.15.5:0/1560500894 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f37780be940 con 0x7f37900ce540 2023-07-14T12:52:53.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.762+0000 7f713ad9d640 1 --2- 172.21.15.5:0/2683544775 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7124066420 0x7f71240688d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f712c0ae000 tx=0x7f712c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.762+0000 7f71237fe640 1 -- 172.21.15.5:0/2683544775 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7134051590 con 0x7f713c15fe60 2023-07-14T12:52:53.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.762+0000 7f3787fff640 1 --2- 172.21.15.5:0/1560500894 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f37700662d0 0x7f3770068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.762+0000 7f3787fff640 1 -- 172.21.15.5:0/1560500894 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f377811e610 con 0x7f37900ce540 2023-07-14T12:52:53.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.762+0000 7f378f7fe640 1 --2- 172.21.15.5:0/1560500894 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f37700662d0 0x7f3770068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.766+0000 7f378f7fe640 1 --2- 172.21.15.5:0/1560500894 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f37700662d0 0x7f3770068780 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f37800098b0 tx=0x7f3780008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.766+0000 7f3787fff640 1 -- 172.21.15.5:0/1560500894 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f37780eba70 con 0x7f37900ce540 2023-07-14T12:52:53.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.766+0000 7f2cd0ff9640 1 -- 172.21.15.5:0/1891008354 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc80125f0 con 0x7f2ccc0dc250 2023-07-14T12:52:53.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.766+0000 7f2cd93c4640 1 -- 172.21.15.5:0/1891008354 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ccc052910 con 0x7f2ccc0dc250 2023-07-14T12:52:53.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.766+0000 7f2cd93c4640 1 -- 172.21.15.5:0/1891008354 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ccc049bf0 con 0x7f2ccc0dc250 2023-07-14T12:52:53.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.766+0000 7fc1acff9640 1 -- 172.21.15.5:0/127096587 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc1a4050a90 con 0x7fc1b0159850 2023-07-14T12:52:53.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.770+0000 7f2cbe7fc640 1 -- 172.21.15.5:0/1891008354 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb4005260 con 0x7f2ccc0dc250 2023-07-14T12:52:53.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.770+0000 7f2cd0ff9640 1 -- 172.21.15.5:0/1891008354 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc8012750 con 0x7f2ccc0dc250 2023-07-14T12:52:53.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.770+0000 7f2cd0ff9640 1 -- 172.21.15.5:0/1891008354 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8012ac0 con 0x7f2ccc0dc250 2023-07-14T12:52:53.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.770+0000 7fbd897fa640 1 -- 172.21.15.5:0/2103976962 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fbd78050720 con 0x7fbd84050e80 2023-07-14T12:52:53.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.774+0000 7f2cd0ff9640 1 -- 172.21.15.5:0/1891008354 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2cc8012c20 con 0x7f2ccc0dc250 2023-07-14T12:52:53.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.774+0000 7f2cd0ff9640 1 --2- 172.21.15.5:0/1891008354 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2cb8066280 0x7f2cb8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:53.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.778+0000 7f2cd0ff9640 1 -- 172.21.15.5:0/1891008354 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2cc8084bd0 con 0x7f2ccc0dc250 2023-07-14T12:52:53.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.778+0000 7f2cd3fff640 1 --2- 172.21.15.5:0/1891008354 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2cb8066280 0x7f2cb8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:53.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.778+0000 7f2cd3fff640 1 --2- 172.21.15.5:0/1891008354 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2cb8066280 0x7f2cb8068730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4071e40 tx=0x7f2cd404e760 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:53.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:53.778+0000 7f2cd0ff9640 1 -- 172.21.15.5:0/1891008354 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2cc80ae720 con 0x7f2ccc0dc250 2023-07-14T12:52:54.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.046+0000 7fb62a7d2640 1 -- 172.21.15.5:0/857063603 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb6240c5f00 con 0x7fb624069430 2023-07-14T12:52:54.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.050+0000 7fb619ffb640 1 -- 172.21.15.5:0/857063603 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb6240c5f00 con 0x7fb624069430 2023-07-14T12:52:54.077 INFO:teuthology.orchestra.run.smithi005.stdout:55834574852 2023-07-14T12:52:54.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.054+0000 7fb6077fe640 1 -- 172.21.15.5:0/857063603 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb6080662d0 msgr2=0x7fb608068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:54.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.054+0000 7fb6077fe640 1 --2- 172.21.15.5:0/857063603 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb6080662d0 0x7fb608068780 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb6140b4000 tx=0x7fb6140ab070 comp rx=0 tx=0).stop 2023-07-14T12:52:54.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.054+0000 7fb6077fe640 1 -- 172.21.15.5:0/857063603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb624069430 msgr2=0x7fb62415fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:54.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.054+0000 7fb6077fe640 1 --2- 172.21.15.5:0/857063603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb624069430 0x7fb62415fd80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb62000bcc0 tx=0x7fb620009e50 comp rx=0 tx=0).stop 2023-07-14T12:52:54.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.054+0000 7fb6077fe640 1 -- 172.21.15.5:0/857063603 shutdown_connections 2023-07-14T12:52:54.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.054+0000 7fb6077fe640 1 --2- 172.21.15.5:0/857063603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6240c0960 0x7fb6240c0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.054+0000 7fb6077fe640 1 --2- 172.21.15.5:0/857063603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb624169b90 0x7fb6240b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.054+0000 7fb6077fe640 1 --2- 172.21.15.5:0/857063603 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb6080662d0 0x7fb608068780 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.054+0000 7fb6077fe640 1 --2- 172.21.15.5:0/857063603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb624069430 0x7fb62415fd80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.054+0000 7fb6077fe640 1 -- 172.21.15.5:0/857063603 >> 172.21.15.5:0/857063603 conn(0x7fb6240cdde0 msgr2=0x7fb624072420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:54.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.054+0000 7fb6077fe640 1 -- 172.21.15.5:0/857063603 shutdown_connections 2023-07-14T12:52:54.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.054+0000 7fb6077fe640 1 -- 172.21.15.5:0/857063603 wait complete. 2023-07-14T12:52:54.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.070+0000 7fc04c905640 1 -- 172.21.15.5:0/1607992148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc0481f8310 con 0x7fc04806f7d0 2023-07-14T12:52:54.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.070+0000 7fc02ffff640 1 -- 172.21.15.5:0/1607992148 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc03c0ad020 con 0x7fc04806f7d0 2023-07-14T12:52:54.098 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2023-07-14T12:52:54.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.074+0000 7f9d34da9640 1 -- 172.21.15.5:0/3710044227 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9d10005510 con 0x7f9d3015fd60 2023-07-14T12:52:54.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.074+0000 7f9d17fff640 1 -- 172.21.15.5:0/3710044227 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9d24015090 con 0x7f9d3015fd60 2023-07-14T12:52:54.099 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-07-14T12:52:54.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.074+0000 7fc04c905640 1 -- 172.21.15.5:0/1607992148 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc0340662d0 msgr2=0x7fc034068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:54.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.074+0000 7fc04c905640 1 --2- 172.21.15.5:0/1607992148 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc0340662d0 0x7fc034068780 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc04815b080 tx=0x7fc0400098d0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.074+0000 7fc04c905640 1 -- 172.21.15.5:0/1607992148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc04806f7d0 msgr2=0x7fc0481f4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:54.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.074+0000 7fc04c905640 1 --2- 172.21.15.5:0/1607992148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc04806f7d0 0x7fc0481f4ea0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc03c01f1f0 tx=0x7fc03c01d190 comp rx=0 tx=0).stop 2023-07-14T12:52:54.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.074+0000 7fc04c905640 1 -- 172.21.15.5:0/1607992148 shutdown_connections 2023-07-14T12:52:54.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.074+0000 7fc04c905640 1 --2- 172.21.15.5:0/1607992148 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc0340662d0 0x7fc034068780 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.074+0000 7fc04c905640 1 --2- 172.21.15.5:0/1607992148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc048157a30 0x7fc0481583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.074+0000 7fc04c905640 1 --2- 172.21.15.5:0/1607992148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0480cc950 0x7fc04814f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.074+0000 7fc04c905640 1 --2- 172.21.15.5:0/1607992148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc04806f7d0 0x7fc0481f4ea0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.074+0000 7fc04c905640 1 -- 172.21.15.5:0/1607992148 >> 172.21.15.5:0/1607992148 conn(0x7fc0480cb540 msgr2=0x7fc04814cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:54.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.074+0000 7fc04c905640 1 -- 172.21.15.5:0/1607992148 shutdown_connections 2023-07-14T12:52:54.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.074+0000 7fc04c905640 1 -- 172.21.15.5:0/1607992148 wait complete. 2023-07-14T12:52:54.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.078+0000 7f9d34da9640 1 -- 172.21.15.5:0/3710044227 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9d1c066350 msgr2=0x7f9d1c068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:54.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.078+0000 7f9d34da9640 1 --2- 172.21.15.5:0/3710044227 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9d1c066350 0x7f9d1c068800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9d300c21a0 tx=0x7f9d28003e70 comp rx=0 tx=0).stop 2023-07-14T12:52:54.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.078+0000 7f9d34da9640 1 -- 172.21.15.5:0/3710044227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d3015fd60 msgr2=0x7f9d300b2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:54.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.078+0000 7f9d34da9640 1 --2- 172.21.15.5:0/3710044227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d3015fd60 0x7f9d300b2e80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9d2400b410 tx=0x7f9d2400b8d0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.082+0000 7f9d34da9640 1 -- 172.21.15.5:0/3710044227 shutdown_connections 2023-07-14T12:52:54.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.082+0000 7f9d34da9640 1 --2- 172.21.15.5:0/3710044227 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9d1c066350 0x7f9d1c068800 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.082+0000 7f9d34da9640 1 --2- 172.21.15.5:0/3710044227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d3015fd60 0x7f9d300b2e80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.082+0000 7f9d34da9640 1 --2- 172.21.15.5:0/3710044227 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9d300af8b0 0x7f9d3014b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.082+0000 7f9d34da9640 1 --2- 172.21.15.5:0/3710044227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d300707f0 0x7f9d3015b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.082+0000 7f9d34da9640 1 -- 172.21.15.5:0/3710044227 >> 172.21.15.5:0/3710044227 conn(0x7f9d300ca8b0 msgr2=0x7f9d300af100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:54.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.082+0000 7f9d34da9640 1 -- 172.21.15.5:0/3710044227 shutdown_connections 2023-07-14T12:52:54.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.082+0000 7f9d34da9640 1 -- 172.21.15.5:0/3710044227 wait complete. 2023-07-14T12:52:54.116 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.4 2023-07-14T12:52:54.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.094+0000 7f3794a76640 1 -- 172.21.15.5:0/1560500894 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f37900678d0 con 0x7f37900ce540 2023-07-14T12:52:54.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.094+0000 7fbd76ffd640 1 -- 172.21.15.5:0/2103976962 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbd84005390 con 0x7fbd84050e80 2023-07-14T12:52:54.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.094+0000 7f3787fff640 1 -- 172.21.15.5:0/1560500894 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f37780ef090 con 0x7f37900ce540 2023-07-14T12:52:54.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.094+0000 7fbd897fa640 1 -- 172.21.15.5:0/2103976962 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbd78053d40 con 0x7fbd84050e80 2023-07-14T12:52:54.122 INFO:teuthology.orchestra.run.smithi005.stdout:55834574852 2023-07-14T12:52:54.122 INFO:teuthology.orchestra.run.smithi005.stdout:55834574852 2023-07-14T12:52:54.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.098+0000 7fbd76ffd640 1 -- 172.21.15.5:0/2103976962 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fbd7c0664b0 msgr2=0x7fbd7c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:54.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.098+0000 7fbd76ffd640 1 --2- 172.21.15.5:0/2103976962 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fbd7c0664b0 0x7fbd7c068960 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbd80009870 tx=0x7fbd800a6000 comp rx=0 tx=0).stop 2023-07-14T12:52:54.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.098+0000 7fbd76ffd640 1 -- 172.21.15.5:0/2103976962 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd84050e80 msgr2=0x7fbd840ec190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:54.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.098+0000 7fbd76ffd640 1 --2- 172.21.15.5:0/2103976962 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd84050e80 0x7fbd840ec190 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400dca0 tx=0x7fbd7800c870 comp rx=0 tx=0).stop 2023-07-14T12:52:54.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.098+0000 7f71411c5640 1 -- 172.21.15.5:0/2683544775 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f713c04e020 con 0x7f713c15fe60 2023-07-14T12:52:54.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.098+0000 7fbd76ffd640 1 -- 172.21.15.5:0/2103976962 shutdown_connections 2023-07-14T12:52:54.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.098+0000 7fbd76ffd640 1 --2- 172.21.15.5:0/2103976962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd840e6d20 0x7fbd840dc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.098+0000 7fbd76ffd640 1 --2- 172.21.15.5:0/2103976962 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd84050e80 0x7fbd840ec190 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.098+0000 7fbd76ffd640 1 --2- 172.21.15.5:0/2103976962 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fbd7c0664b0 0x7fbd7c068960 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.098+0000 7fbd76ffd640 1 --2- 172.21.15.5:0/2103976962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd84036d50 0x7fbd840ea600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.098+0000 7fbd76ffd640 1 -- 172.21.15.5:0/2103976962 >> 172.21.15.5:0/2103976962 conn(0x7fbd84051640 msgr2=0x7fbd84034850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.098+0000 7fbd76ffd640 1 -- 172.21.15.5:0/2103976962 shutdown_connections 2023-07-14T12:52:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.098+0000 7f71237fe640 1 -- 172.21.15.5:0/2683544775 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f713401a070 con 0x7f713c15fe60 2023-07-14T12:52:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.098+0000 7f3794a76640 1 -- 172.21.15.5:0/1560500894 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f37700662d0 msgr2=0x7f3770068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.098+0000 7f3794a76640 1 --2- 172.21.15.5:0/1560500894 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f37700662d0 0x7f3770068780 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f37800098b0 tx=0x7f3780008040 comp rx=0 tx=0).stop 2023-07-14T12:52:54.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.098+0000 7f3794a76640 1 -- 172.21.15.5:0/1560500894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37900ce540 msgr2=0x7f37901558d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:54.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.098+0000 7f3794a76640 1 --2- 172.21.15.5:0/1560500894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37900ce540 0x7f37901558d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f37780ac000 tx=0x7f377801aca0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.098+0000 7fbd76ffd640 1 -- 172.21.15.5:0/2103976962 wait complete. 2023-07-14T12:52:54.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.098+0000 7f3794a76640 1 -- 172.21.15.5:0/1560500894 shutdown_connections 2023-07-14T12:52:54.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.098+0000 7f3794a76640 1 --2- 172.21.15.5:0/1560500894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3790155e10 0x7f3790147020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.098+0000 7f3794a76640 1 --2- 172.21.15.5:0/1560500894 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f37700662d0 0x7f3770068780 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.098+0000 7f3794a76640 1 --2- 172.21.15.5:0/1560500894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37900ce540 0x7f37901558d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.098+0000 7f3794a76640 1 --2- 172.21.15.5:0/1560500894 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37900cc410 0x7f3790165f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.098+0000 7f3794a76640 1 -- 172.21.15.5:0/1560500894 >> 172.21.15.5:0/1560500894 conn(0x7f37900cb540 msgr2=0x7f379006d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:54.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.098+0000 7f3794a76640 1 -- 172.21.15.5:0/1560500894 shutdown_connections 2023-07-14T12:52:54.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.098+0000 7f3794a76640 1 -- 172.21.15.5:0/1560500894 wait complete. 2023-07-14T12:52:54.131 INFO:teuthology.orchestra.run.smithi005.stdout:55834574852 2023-07-14T12:52:54.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.098+0000 7fc1b5363640 1 -- 172.21.15.5:0/127096587 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc1b01e3560 con 0x7fc1b0159850 2023-07-14T12:52:54.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.102+0000 7fc1acff9640 1 -- 172.21.15.5:0/127096587 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc1a400ce60 con 0x7fc1b0159850 2023-07-14T12:52:54.132 INFO:teuthology.orchestra.run.smithi005.stdout:55834574852 2023-07-14T12:52:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.102+0000 7f71411c5640 1 -- 172.21.15.5:0/2683544775 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7124066420 msgr2=0x7f71240688d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.102+0000 7f71411c5640 1 --2- 172.21.15.5:0/2683544775 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7124066420 0x7f71240688d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f712c0ae000 tx=0x7f712c0a7000 comp rx=0 tx=0).stop 2023-07-14T12:52:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.102+0000 7f71411c5640 1 -- 172.21.15.5:0/2683544775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f713c15fe60 msgr2=0x7f713c15a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.102+0000 7f71411c5640 1 --2- 172.21.15.5:0/2683544775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f713c15fe60 0x7f713c15a8f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f713400ce30 tx=0x7f71340076c0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.102+0000 7f71411c5640 1 -- 172.21.15.5:0/2683544775 shutdown_connections 2023-07-14T12:52:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.102+0000 7f71411c5640 1 --2- 172.21.15.5:0/2683544775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f713c15fe60 0x7f713c15a8f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.102+0000 7f71411c5640 1 --2- 172.21.15.5:0/2683544775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f713c0cad90 0x7f713c0c2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.102+0000 7f71411c5640 1 --2- 172.21.15.5:0/2683544775 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7124066420 0x7f71240688d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.102+0000 7f71411c5640 1 --2- 172.21.15.5:0/2683544775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f713c0c9670 0x7f713c1f90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.102+0000 7f71411c5640 1 -- 172.21.15.5:0/2683544775 >> 172.21.15.5:0/2683544775 conn(0x7f713c0af840 msgr2=0x7f713c0afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:54.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.102+0000 7f71411c5640 1 -- 172.21.15.5:0/2683544775 shutdown_connections 2023-07-14T12:52:54.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.102+0000 7f71411c5640 1 -- 172.21.15.5:0/2683544775 wait complete. 2023-07-14T12:52:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.102+0000 7fc1b5363640 1 -- 172.21.15.5:0/127096587 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc19c0662a0 msgr2=0x7fc19c068750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.102+0000 7fc1b5363640 1 --2- 172.21.15.5:0/127096587 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc19c0662a0 0x7fc19c068750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0001500 tx=0x7fc1a0007a60 comp rx=0 tx=0).stop 2023-07-14T12:52:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.106+0000 7fc1b5363640 1 -- 172.21.15.5:0/127096587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1b0159850 msgr2=0x7fc1b00b33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.106+0000 7fc1b5363640 1 --2- 172.21.15.5:0/127096587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1b0159850 0x7fc1b00b33e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc1a400c7b0 tx=0x7fc1a400cc70 comp rx=0 tx=0).stop 2023-07-14T12:52:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.106+0000 7fc1b5363640 1 -- 172.21.15.5:0/127096587 shutdown_connections 2023-07-14T12:52:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.106+0000 7fc1b5363640 1 --2- 172.21.15.5:0/127096587 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc19c0662a0 0x7fc19c068750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.106+0000 7fc1b5363640 1 --2- 172.21.15.5:0/127096587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1b01e4eb0 0x7fc1b01f3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.106+0000 7fc1b5363640 1 --2- 172.21.15.5:0/127096587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1b0159850 0x7fc1b00b33e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.106+0000 7fc1b5363640 1 --2- 172.21.15.5:0/127096587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1b00cd7e0 0x7fc1b0156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.106+0000 7fc1b5363640 1 -- 172.21.15.5:0/127096587 >> 172.21.15.5:0/127096587 conn(0x7fc1b00ca8b0 msgr2=0x7fc1b006fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.106+0000 7fc1b5363640 1 -- 172.21.15.5:0/127096587 shutdown_connections 2023-07-14T12:52:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.106+0000 7fc1b5363640 1 -- 172.21.15.5:0/127096587 wait complete. 2023-07-14T12:52:54.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.110+0000 7f2cbe7fc640 1 -- 172.21.15.5:0/1891008354 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f2cb40057e0 con 0x7f2ccc0dc250 2023-07-14T12:52:54.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.110+0000 7f2cd0ff9640 1 -- 172.21.15.5:0/1891008354 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2cc8052050 con 0x7f2ccc0dc250 2023-07-14T12:52:54.139 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2023-07-14T12:52:54.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.1 2023-07-14T12:52:54.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.114+0000 7f2cbe7fc640 1 -- 172.21.15.5:0/1891008354 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2cb8066280 msgr2=0x7f2cb8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:54.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.114+0000 7f2cbe7fc640 1 --2- 172.21.15.5:0/1891008354 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2cb8066280 0x7f2cb8068730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4071e40 tx=0x7f2cd404e760 comp rx=0 tx=0).stop 2023-07-14T12:52:54.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.114+0000 7f2cbe7fc640 1 -- 172.21.15.5:0/1891008354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ccc0dc250 msgr2=0x7f2ccc04a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:54.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.114+0000 7f2cbe7fc640 1 --2- 172.21.15.5:0/1891008354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ccc0dc250 0x7f2ccc04a6d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800d530 tx=0x7f2cc800d9f0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.114+0000 7f2cbe7fc640 1 -- 172.21.15.5:0/1891008354 shutdown_connections 2023-07-14T12:52:54.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.114+0000 7f2cbe7fc640 1 --2- 172.21.15.5:0/1891008354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ccc0dc250 0x7f2ccc04a6d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.114+0000 7f2cbe7fc640 1 --2- 172.21.15.5:0/1891008354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ccc04f750 0x7f2ccc0eca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.114+0000 7f2cbe7fc640 1 --2- 172.21.15.5:0/1891008354 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2cb8066280 0x7f2cb8068730 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.114+0000 7f2cbe7fc640 1 --2- 172.21.15.5:0/1891008354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ccc036d50 0x7f2ccc035030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:54.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.114+0000 7f2cbe7fc640 1 -- 172.21.15.5:0/1891008354 >> 172.21.15.5:0/1891008354 conn(0x7f2ccc051640 msgr2=0x7f2ccc0ddb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:54.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.114+0000 7f2cbe7fc640 1 -- 172.21.15.5:0/1891008354 shutdown_connections 2023-07-14T12:52:54.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:54.114+0000 7f2cbe7fc640 1 -- 172.21.15.5:0/1891008354 wait complete. 2023-07-14T12:52:54.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.0 2023-07-14T12:52:54.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.3 2023-07-14T12:52:54.164 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.5 2023-07-14T12:52:54.166 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.7 2023-07-14T12:52:54.167 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.2 2023-07-14T12:52:54.173 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.6 2023-07-14T12:52:55.117 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-14T12:52:55.140 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-14T12:52:55.153 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-14T12:52:55.159 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-14T12:52:55.165 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-14T12:52:55.168 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-14T12:52:55.168 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-14T12:52:55.173 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-14T12:52:55.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.298+0000 7f152d696640 1 Processor -- start 2023-07-14T12:52:55.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.298+0000 7f152d696640 1 -- start start 2023-07-14T12:52:55.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.298+0000 7f152d696640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f152806b700 0x7f15280ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.298+0000 7f152d696640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1528158fb0 con 0x7f15280c8300 2023-07-14T12:52:55.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.298+0000 7f152d696640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15280cb6a0 con 0x7f1528157990 2023-07-14T12:52:55.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.298+0000 7f152d696640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15280ca5f0 con 0x7f152806b700 2023-07-14T12:52:55.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.302+0000 7f1526ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1528157990 0x7f152806aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:58090/0 (socket says 172.21.15.5:58090) 2023-07-14T12:52:55.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.302+0000 7f1526ffd640 1 -- 172.21.15.5:0/788583326 learned_addr learned my addr 172.21.15.5:0/788583326 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:55.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.302+0000 7f1525ffb640 1 -- 172.21.15.5:0/788583326 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 817235970 0 0) 0x7f15280cb6a0 con 0x7f1528157990 2023-07-14T12:52:55.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.302+0000 7f1525ffb640 1 -- 172.21.15.5:0/788583326 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1510003530 con 0x7f1528157990 2023-07-14T12:52:55.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.302+0000 7f1525ffb640 1 -- 172.21.15.5:0/788583326 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1849142280 0 0) 0x7f1528158fb0 con 0x7f15280c8300 2023-07-14T12:52:55.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.302+0000 7f1525ffb640 1 -- 172.21.15.5:0/788583326 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15280cb6a0 con 0x7f15280c8300 2023-07-14T12:52:55.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.302+0000 7f1525ffb640 1 -- 172.21.15.5:0/788583326 <== mon.1 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1965896373 0 0) 0x7f1510003530 con 0x7f1528157990 2023-07-14T12:52:55.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.302+0000 7f1525ffb640 1 -- 172.21.15.5:0/788583326 >> v2:172.21.15.5:3300/0 conn(0x7f152806b700 msgr2=0x7f15280ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:55.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.302+0000 7f1525ffb640 1 --2- 172.21.15.5:0/788583326 >> v2:172.21.15.5:3300/0 conn(0x7f152806b700 0x7f15280ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.302+0000 7f1525ffb640 1 -- 172.21.15.5:0/788583326 >> v1:172.21.15.5:6789/0 conn(0x7f15280c8300 legacy=0x7f1528069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.302+0000 7f1525ffb640 1 -- 172.21.15.5:0/788583326 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152806bb80 con 0x7f1528157990 2023-07-14T12:52:55.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.302+0000 7f1525ffb640 1 -- 172.21.15.5:0/788583326 <== mon.1 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f1520001a00 con 0x7f1528157990 2023-07-14T12:52:55.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.306+0000 7f1525ffb640 1 -- 172.21.15.5:0/788583326 >> v1:172.21.15.154:6789/0 conn(0x7f1528157990 legacy=0x7f152806aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.306+0000 7f1525ffb640 1 --2- 172.21.15.5:0/788583326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1510003b10 0x7f1510003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.306+0000 7f1525ffb640 1 --2- 172.21.15.5:0/788583326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15100047d0 0x7f1510004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.306+0000 7f1526ffd640 1 --2- 172.21.15.5:0/788583326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1510003b10 0x7f1510003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.306+0000 7f15267fc640 1 --2- 172.21.15.5:0/788583326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15100047d0 0x7f1510004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.306+0000 7f1525ffb640 1 --2- 172.21.15.5:0/788583326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15100051f0 0x7f151000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.306+0000 7f1525ffb640 1 -- 172.21.15.5:0/788583326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15180010f0 con 0x7f15100051f0 2023-07-14T12:52:55.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.306+0000 7f1525ffb640 1 -- 172.21.15.5:0/788583326 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15280ca5f0 con 0x7f15100047d0 2023-07-14T12:52:55.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.306+0000 7f1525ffb640 1 -- 172.21.15.5:0/788583326 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f151000c230 con 0x7f1510003b10 2023-07-14T12:52:55.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.306+0000 7f1526ffd640 1 -- 172.21.15.5:0/788583326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15100047d0 msgr2=0x7f1510004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:55.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.306+0000 7f1526ffd640 1 --2- 172.21.15.5:0/788583326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15100047d0 0x7f1510004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.306+0000 7f1526ffd640 1 -- 172.21.15.5:0/788583326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15100051f0 msgr2=0x7f151000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:55.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.306+0000 7f15277fe640 1 --2- 172.21.15.5:0/788583326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15100051f0 0x7f151000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.306+0000 7f1526ffd640 1 --2- 172.21.15.5:0/788583326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15100051f0 0x7f151000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.310+0000 7f1526ffd640 1 -- 172.21.15.5:0/788583326 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1510003530 con 0x7f1510003b10 2023-07-14T12:52:55.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.314+0000 7f15277fe640 1 --2- 172.21.15.5:0/788583326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15100051f0 0x7f151000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:52:55.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.314+0000 7f15277fe640 1 -- 172.21.15.5:0/788583326 reap_dead start 2023-07-14T12:52:55.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.314+0000 7f1526ffd640 1 --2- 172.21.15.5:0/788583326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1510003b10 0x7f1510003ee0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f15200098e0 tx=0x7f1520020e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8df62b72018e84f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:55.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.314+0000 7f1525ffb640 1 -- 172.21.15.5:0/788583326 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15200092d0 con 0x7f1510003b10 2023-07-14T12:52:55.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.314+0000 7f1525ffb640 1 -- 172.21.15.5:0/788583326 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15200aa970 con 0x7f1510003b10 2023-07-14T12:52:55.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.314+0000 7f152d696640 1 -- 172.21.15.5:0/788583326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1510003b10 msgr2=0x7f1510003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.314+0000 7f152d696640 1 --2- 172.21.15.5:0/788583326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1510003b10 0x7f1510003ee0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f15200098e0 tx=0x7f1520020e40 comp rx=0 tx=0).stop 2023-07-14T12:52:55.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.314+0000 7f152d696640 1 -- 172.21.15.5:0/788583326 shutdown_connections 2023-07-14T12:52:55.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.314+0000 7f152d696640 1 --2- 172.21.15.5:0/788583326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1510003b10 0x7f1510003ee0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.314+0000 7f152d696640 1 -- 172.21.15.5:0/788583326 >> 172.21.15.5:0/788583326 conn(0x7f15280ce980 msgr2=0x7f15280ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:55.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.314+0000 7f152d696640 1 -- 172.21.15.5:0/788583326 shutdown_connections 2023-07-14T12:52:55.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.314+0000 7f152d696640 1 -- 172.21.15.5:0/788583326 wait complete. 2023-07-14T12:52:55.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.318+0000 7f152d696640 1 Processor -- start 2023-07-14T12:52:55.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.318+0000 7f152d696640 1 -- start start 2023-07-14T12:52:55.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.318+0000 7f152d696640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1510003b10 0x7f15280c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.322+0000 7f152d696640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1528152770 0x7f152814df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.322+0000 7f15267fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1528152770 0x7f152814df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.322+0000 7f15267fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1528152770 0x7f152814df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52834/0 (socket says 172.21.15.5:52834) 2023-07-14T12:52:55.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.322+0000 7f1526ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1510003b10 0x7f15280c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.322+0000 7f15267fc640 1 -- 172.21.15.5:0/1577643844 learned_addr learned my addr 172.21.15.5:0/1577643844 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:55.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.322+0000 7f152d696640 1 --2- 172.21.15.5:0/1577643844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15280b2bc0 0x7f15280b3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.322+0000 7f152d696640 1 -- 172.21.15.5:0/1577643844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15280b3570 con 0x7f1528152770 2023-07-14T12:52:55.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.322+0000 7f152d696640 1 -- 172.21.15.5:0/1577643844 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15280c1920 con 0x7f1510003b10 2023-07-14T12:52:55.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.322+0000 7f152d696640 1 -- 172.21.15.5:0/1577643844 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15280c7580 con 0x7f15280b2bc0 2023-07-14T12:52:55.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.322+0000 7f15267fc640 1 -- 172.21.15.5:0/1577643844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15280b2bc0 msgr2=0x7f15280b3030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T12:52:55.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.322+0000 7f15267fc640 1 --2- 172.21.15.5:0/1577643844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15280b2bc0 0x7f15280b3030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.322+0000 7f15267fc640 1 -- 172.21.15.5:0/1577643844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1510003b10 msgr2=0x7f15280c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.322+0000 7f15267fc640 1 --2- 172.21.15.5:0/1577643844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1510003b10 0x7f15280c67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.322+0000 7f15267fc640 1 -- 172.21.15.5:0/1577643844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15280c6d20 con 0x7f1528152770 2023-07-14T12:52:55.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.322+0000 7f15267fc640 1 --2- 172.21.15.5:0/1577643844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1528152770 0x7f152814df30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f151800f8c0 tx=0x7f151800fd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:55.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.326+0000 7f150f7fe640 1 -- 172.21.15.5:0/1577643844 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15180052e0 con 0x7f1528152770 2023-07-14T12:52:55.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.326+0000 7f150f7fe640 1 -- 172.21.15.5:0/1577643844 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1518005440 con 0x7f1528152770 2023-07-14T12:52:55.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.326+0000 7f150f7fe640 1 -- 172.21.15.5:0/1577643844 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151800d970 con 0x7f1528152770 2023-07-14T12:52:55.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.326+0000 7f152d696640 1 -- 172.21.15.5:0/1577643844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15280c6fc0 con 0x7f1528152770 2023-07-14T12:52:55.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.326+0000 7f152d696640 1 -- 172.21.15.5:0/1577643844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15280c15b0 con 0x7f1528152770 2023-07-14T12:52:55.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.330+0000 7f150f7fe640 1 -- 172.21.15.5:0/1577643844 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f151800dad0 con 0x7f1528152770 2023-07-14T12:52:55.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.330+0000 7f152d696640 1 -- 172.21.15.5:0/1577643844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15280678d0 con 0x7f1528152770 2023-07-14T12:52:55.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.330+0000 7f150f7fe640 1 --2- 172.21.15.5:0/1577643844 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f1514066300 0x7f15140687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.342+0000 7f150f7fe640 1 -- 172.21.15.5:0/1577643844 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1518083cb0 con 0x7f1528152770 2023-07-14T12:52:55.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.342+0000 7f150f7fe640 1 -- 172.21.15.5:0/1577643844 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f1518088390 con 0x7f1528152770 2023-07-14T12:52:55.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.342+0000 7f1526ffd640 1 --2- 172.21.15.5:0/1577643844 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f1514066300 0x7f15140687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.342+0000 7f1526ffd640 1 --2- 172.21.15.5:0/1577643844 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f1514066300 0x7f15140687b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f15200b0000 tx=0x7f15200ac070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:55.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.374+0000 7f210c359640 1 Processor -- start 2023-07-14T12:52:55.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.374+0000 7f210c359640 1 -- start start 2023-07-14T12:52:55.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.378+0000 7f210c359640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f20fc036670 0x7f20fc036ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.378+0000 7f210c359640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20fc037010 con 0x7f20fc03a4d0 2023-07-14T12:52:55.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.378+0000 7f210c359640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20fc04f240 con 0x7f20fc050fb0 2023-07-14T12:52:55.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.378+0000 7f210c359640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20fc04fa50 con 0x7f20fc036670 2023-07-14T12:52:55.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.378+0000 7f210a0f5640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f20fc03a4d0 0x7f20fc0543f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38932/0 (socket says 172.21.15.5:38932) 2023-07-14T12:52:55.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.378+0000 7f210a0f5640 1 -- 172.21.15.5:0/525309786 learned_addr learned my addr 172.21.15.5:0/525309786 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:55.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.378+0000 7f210a8f6640 1 --2- 172.21.15.5:0/525309786 >> v2:172.21.15.5:3300/0 conn(0x7f20fc036670 0x7f20fc036ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.378+0000 7f210a8f6640 1 -- 172.21.15.5:0/525309786 >> v1:172.21.15.154:6789/0 conn(0x7f20fc050fb0 legacy=0x7f20fc006910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.378+0000 7f210a8f6640 1 -- 172.21.15.5:0/525309786 >> v1:172.21.15.5:6789/0 conn(0x7f20fc03a4d0 legacy=0x7f20fc0543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.378+0000 7f210a8f6640 1 -- 172.21.15.5:0/525309786 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20fc04f490 con 0x7f20fc036670 2023-07-14T12:52:55.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.382+0000 7f9bc9b00640 1 Processor -- start 2023-07-14T12:52:55.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.382+0000 7f9bc9b00640 1 -- start start 2023-07-14T12:52:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.386+0000 7f210a8f6640 1 --2- 172.21.15.5:0/525309786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20fc036670 0x7f20fc036ad0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f20f40097c0 tx=0x7f20f401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91042f7c8f84cfc8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.386+0000 7f9bc9b00640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bc40c8300 0x7f9bc40ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.386+0000 7f9bc9b00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9bc406aff0 0x7f9bc406b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.386+0000 7f9bc9b00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc4158fb0 con 0x7f9bc40caed0 2023-07-14T12:52:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.386+0000 7f9bc9b00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc40c8770 con 0x7f9bc406aff0 2023-07-14T12:52:55.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.386+0000 7f9bc9b00640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc40ca5f0 con 0x7f9bc40c8300 2023-07-14T12:52:55.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.386+0000 7f21090f3640 1 -- 172.21.15.5:0/525309786 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f40ab600 con 0x7f20fc036670 2023-07-14T12:52:55.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.386+0000 7f21090f3640 1 -- 172.21.15.5:0/525309786 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f40a7050 con 0x7f20fc036670 2023-07-14T12:52:55.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.386+0000 7f21090f3640 1 -- 172.21.15.5:0/525309786 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f40ab980 con 0x7f20fc036670 2023-07-14T12:52:55.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.386+0000 7f9bc37fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9bc40caed0 0x7f9bc4157990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38946/0 (socket says 172.21.15.5:38946) 2023-07-14T12:52:55.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.386+0000 7f9bc37fe640 1 -- 172.21.15.5:0/3869069922 learned_addr learned my addr 172.21.15.5:0/3869069922 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:55.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.386+0000 7f9bc3fff640 1 --2- 172.21.15.5:0/3869069922 >> v2:172.21.15.5:3300/0 conn(0x7f9bc406aff0 0x7f9bc406b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.386+0000 7f210c359640 1 -- 172.21.15.5:0/525309786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20fc036670 msgr2=0x7f20fc036ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.386+0000 7f210c359640 1 --2- 172.21.15.5:0/525309786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20fc036670 0x7f20fc036ad0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f20f40097c0 tx=0x7f20f401c390 comp rx=0 tx=0).stop 2023-07-14T12:52:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.386+0000 7f210c359640 1 -- 172.21.15.5:0/525309786 shutdown_connections 2023-07-14T12:52:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.386+0000 7f210c359640 1 --2- 172.21.15.5:0/525309786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20fc036670 0x7f20fc036ad0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.386+0000 7f210c359640 1 -- 172.21.15.5:0/525309786 >> 172.21.15.5:0/525309786 conn(0x7f20fc051670 msgr2=0x7f20fc051a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.386+0000 7f7b20f05640 1 Processor -- start 2023-07-14T12:52:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.386+0000 7f7b20f05640 1 -- start start 2023-07-14T12:52:55.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.390+0000 7f7b20f05640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b1c070d50 0x7f7b1c1647b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.390+0000 7f7b20f05640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7b1c06b150 0x7f7b1c06b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.390+0000 7f7b20f05640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b1c163ff0 con 0x7f7b1c160370 2023-07-14T12:52:55.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.390+0000 7f7b20f05640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1c069bf0 con 0x7f7b1c06b150 2023-07-14T12:52:55.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.390+0000 7f7b20f05640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c069ed0 con 0x7f7b1c070d50 2023-07-14T12:52:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.390+0000 7f7b1affd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b1c070d50 0x7f7b1c1647b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.390+0000 7f7b1affd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b1c070d50 0x7f7b1c1647b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:55076/0 (socket says 172.21.15.5:55076) 2023-07-14T12:52:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.390+0000 7f7b1bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7b1c06b150 0x7f7b1c06b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.390+0000 7f7b1affd640 1 -- 172.21.15.5:0/535312613 learned_addr learned my addr 172.21.15.5:0/535312613 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.390+0000 7f7b1affd640 1 -- 172.21.15.5:0/535312613 >> v2:172.21.15.154:3300/0 conn(0x7f7b1c06b150 msgr2=0x7f7b1c06b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.390+0000 7f7b1affd640 1 --2- 172.21.15.5:0/535312613 >> v2:172.21.15.154:3300/0 conn(0x7f7b1c06b150 0x7f7b1c06b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.390+0000 7f7b1affd640 1 -- 172.21.15.5:0/535312613 >> v1:172.21.15.154:6789/0 conn(0x7f7b1c160370 legacy=0x7f7b1c069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.390+0000 7f7b1affd640 1 -- 172.21.15.5:0/535312613 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1c164290 con 0x7f7b1c070d50 2023-07-14T12:52:55.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.390+0000 7f7b1bfff640 1 --2- 172.21.15.5:0/535312613 >> v2:172.21.15.154:3300/0 conn(0x7f7b1c06b150 0x7f7b1c06b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:52:55.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.386+0000 7f9bc3fff640 1 -- 172.21.15.5:0/3869069922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bc40c8300 msgr2=0x7f9bc40ca0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T12:52:55.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.386+0000 7f9bc3fff640 1 --2- 172.21.15.5:0/3869069922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bc40c8300 0x7f9bc40ca0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.386+0000 7f9bc3fff640 1 -- 172.21.15.5:0/3869069922 >> v1:172.21.15.5:6789/0 conn(0x7f9bc40caed0 legacy=0x7f9bc4157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:55.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.386+0000 7f9bc3fff640 1 -- 172.21.15.5:0/3869069922 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc40cb6a0 con 0x7f9bc406aff0 2023-07-14T12:52:55.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.390+0000 7f210c359640 1 -- 172.21.15.5:0/525309786 shutdown_connections 2023-07-14T12:52:55.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.394+0000 7f9bc3fff640 1 --2- 172.21.15.5:0/3869069922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bc406aff0 0x7f9bc406b470 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc00bfd0 tx=0x7f9bbc01eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa109266c3b8d96a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:55.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.394+0000 7f9bc27fc640 1 -- 172.21.15.5:0/3869069922 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc00b2d0 con 0x7f9bc406aff0 2023-07-14T12:52:55.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.394+0000 7f9bc27fc640 1 -- 172.21.15.5:0/3869069922 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bbc0a7970 con 0x7f9bc406aff0 2023-07-14T12:52:55.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.394+0000 7f9bc27fc640 1 -- 172.21.15.5:0/3869069922 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc00b2d0 con 0x7f9bc406aff0 2023-07-14T12:52:55.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.394+0000 7f9bc9b00640 1 -- 172.21.15.5:0/3869069922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bc406aff0 msgr2=0x7f9bc406b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.394+0000 7f9bc9b00640 1 --2- 172.21.15.5:0/3869069922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bc406aff0 0x7f9bc406b470 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc00bfd0 tx=0x7f9bbc01eae0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.394+0000 7f9bc9b00640 1 -- 172.21.15.5:0/3869069922 shutdown_connections 2023-07-14T12:52:55.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.394+0000 7f9bc9b00640 1 --2- 172.21.15.5:0/3869069922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bc406aff0 0x7f9bc406b470 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.394+0000 7f9bc9b00640 1 --2- 172.21.15.5:0/3869069922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bc40c8300 0x7f9bc40ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.394+0000 7f9bc9b00640 1 -- 172.21.15.5:0/3869069922 >> 172.21.15.5:0/3869069922 conn(0x7f9bc40ce980 msgr2=0x7f9bc40ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:55.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.390+0000 7f210c359640 1 -- 172.21.15.5:0/525309786 wait complete. 2023-07-14T12:52:55.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.394+0000 7f210c359640 1 Processor -- start 2023-07-14T12:52:55.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.394+0000 7fd88de19640 1 Processor -- start 2023-07-14T12:52:55.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.394+0000 7f9bc9b00640 1 -- 172.21.15.5:0/3869069922 shutdown_connections 2023-07-14T12:52:55.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.394+0000 7f210c359640 1 -- start start 2023-07-14T12:52:55.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7f210c359640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20fc036670 0x7f20fc04bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.394+0000 7f7b1affd640 1 --2- 172.21.15.5:0/535312613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b1c070d50 0x7f7b1c1647b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7b10009870 tx=0x7f7b1001ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efd2efb843a87cf8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:55.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.394+0000 7f7b1a7fc640 1 -- 172.21.15.5:0/535312613 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b100ab610 con 0x7f7b1c070d50 2023-07-14T12:52:55.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.394+0000 7f7b1a7fc640 1 -- 172.21.15.5:0/535312613 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b100ab770 con 0x7f7b1c070d50 2023-07-14T12:52:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7f210c359640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20fc03a4d0 0x7f20fc1870d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7f210c359640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20fc050fb0 0x7f20fc035210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7f210a0f5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20fc036670 0x7f20fc04bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7f210a0f5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20fc036670 0x7f20fc04bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:55080/0 (socket says 172.21.15.5:55080) 2023-07-14T12:52:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7f21098f4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20fc03a4d0 0x7f20fc1870d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7f21098f4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20fc03a4d0 0x7f20fc1870d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:45200/0 (socket says 172.21.15.5:45200) 2023-07-14T12:52:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7f7b20f05640 1 -- 172.21.15.5:0/535312613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b1c070d50 msgr2=0x7f7b1c1647b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7f7b20f05640 1 --2- 172.21.15.5:0/535312613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b1c070d50 0x7f7b1c1647b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7b10009870 tx=0x7f7b1001ced0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.394+0000 7f9bc9b00640 1 -- 172.21.15.5:0/3869069922 wait complete. 2023-07-14T12:52:55.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.394+0000 7f7b1a7fc640 1 -- 172.21.15.5:0/535312613 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 0 0 0) 0x7f7b100abb00 con 0x7f7b1c070d50 2023-07-14T12:52:55.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7f9bc9b00640 1 Processor -- start 2023-07-14T12:52:55.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7f7b20f05640 1 -- 172.21.15.5:0/535312613 shutdown_connections 2023-07-14T12:52:55.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7f7b20f05640 1 --2- 172.21.15.5:0/535312613 >> v2:172.21.15.154:3300/0 conn(0x7f7b1c06b150 0x7f7b1c06b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.394+0000 7fd88de19640 1 -- start start 2023-07-14T12:52:55.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7f7b20f05640 1 --2- 172.21.15.5:0/535312613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b1c070d50 0x7f7b1c1647b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7f7b20f05640 1 -- 172.21.15.5:0/535312613 >> 172.21.15.5:0/535312613 conn(0x7f7b1c0cb4a0 msgr2=0x7f7b1c0cdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:55.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7fd88de19640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8880b7a10 0x7fd88806a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7fd88de19640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8880cf2e0 con 0x7fd8880b42c0 2023-07-14T12:52:55.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7fd88de19640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8880ccee0 con 0x7fd8880cee90 2023-07-14T12:52:55.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7fd88de19640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8880cff30 con 0x7fd8880b7a10 2023-07-14T12:52:55.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7f210a8f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20fc050fb0 0x7f20fc035210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7f210a8f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20fc050fb0 0x7f20fc035210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52866/0 (socket says 172.21.15.5:52866) 2023-07-14T12:52:55.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7f7b20f05640 1 -- 172.21.15.5:0/535312613 shutdown_connections 2023-07-14T12:52:55.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7f9bc9b00640 1 -- start start 2023-07-14T12:52:55.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7fd88ce17640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8880b7a10 0x7fd88806a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7fd88ce17640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8880b7a10 0x7fd88806a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:55090/0 (socket says 172.21.15.5:55090) 2023-07-14T12:52:55.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7fd887fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd8880cee90 0x7fd8880b3bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:58126/0 (socket says 172.21.15.5:58126) 2023-07-14T12:52:55.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7fd88ce17640 1 -- 172.21.15.5:0/1441424241 learned_addr learned my addr 172.21.15.5:0/1441424241 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:55.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7f210a0f5640 1 -- 172.21.15.5:0/2740606579 learned_addr learned my addr 172.21.15.5:0/2740606579 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:55.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7f7b20f05640 1 -- 172.21.15.5:0/535312613 wait complete. 2023-07-14T12:52:55.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7fd88ce17640 1 -- 172.21.15.5:0/1441424241 >> v1:172.21.15.154:6789/0 conn(0x7fd8880cee90 legacy=0x7fd8880b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7fd88ce17640 1 -- 172.21.15.5:0/1441424241 >> v1:172.21.15.5:6789/0 conn(0x7fd8880b42c0 legacy=0x7fd8880d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7fd88ce17640 1 -- 172.21.15.5:0/1441424241 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8880cc920 con 0x7fd8880b7a10 2023-07-14T12:52:55.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7f210c359640 1 -- 172.21.15.5:0/2740606579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc034df0 con 0x7f20fc050fb0 2023-07-14T12:52:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7f210c359640 1 -- 172.21.15.5:0/2740606579 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc04b190 con 0x7f20fc03a4d0 2023-07-14T12:52:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.398+0000 7f210c359640 1 -- 172.21.15.5:0/2740606579 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc04abd0 con 0x7f20fc036670 2023-07-14T12:52:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f9bc9b00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bc406aff0 0x7f9bc41533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f9bc9b00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bc40c8300 0x7f9bc4203ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f7b20f05640 1 Processor -- start 2023-07-14T12:52:55.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f210a0f5640 1 -- 172.21.15.5:0/2740606579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20fc03a4d0 msgr2=0x7f20fc1870d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f210a0f5640 1 --2- 172.21.15.5:0/2740606579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20fc03a4d0 0x7f20fc1870d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f210a0f5640 1 -- 172.21.15.5:0/2740606579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20fc050fb0 msgr2=0x7f20fc035210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f210a0f5640 1 --2- 172.21.15.5:0/2740606579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20fc050fb0 0x7f20fc035210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f210a0f5640 1 -- 172.21.15.5:0/2740606579 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f4009420 con 0x7f20fc036670 2023-07-14T12:52:55.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f9bc9b00640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bc40caed0 0x7f9bc40b2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f9bc2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bc40c8300 0x7f9bc4203ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f9bc2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bc40c8300 0x7f9bc4203ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:45216/0 (socket says 172.21.15.5:45216) 2023-07-14T12:52:55.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f21098f4640 1 --2- 172.21.15.5:0/2740606579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20fc03a4d0 0x7f20fc1870d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:52:55.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f9bc37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bc406aff0 0x7f9bc41533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f9bc37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bc406aff0 0x7f9bc41533e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52882/0 (socket says 172.21.15.5:52882) 2023-07-14T12:52:55.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f9bc2ffd640 1 -- 172.21.15.5:0/857540283 learned_addr learned my addr 172.21.15.5:0/857540283 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:55.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f210a8f6640 1 --2- 172.21.15.5:0/2740606579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20fc050fb0 0x7f20fc035210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:52:55.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f210a0f5640 1 --2- 172.21.15.5:0/2740606579 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20fc036670 0x7f20fc04bcc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f210402c430 tx=0x7f2104066890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:55.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f9bc9b00640 1 -- 172.21.15.5:0/857540283 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc4153920 con 0x7f9bc406aff0 2023-07-14T12:52:55.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f9bc9b00640 1 -- 172.21.15.5:0/857540283 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc4153bc0 con 0x7f9bc40c8300 2023-07-14T12:52:55.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f9bc3fff640 1 --2- 172.21.15.5:0/857540283 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bc40caed0 0x7f9bc40b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f9bc9b00640 1 -- 172.21.15.5:0/857540283 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc4153ea0 con 0x7f9bc40caed0 2023-07-14T12:52:55.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f20faffd640 1 -- 172.21.15.5:0/2740606579 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210406ae00 con 0x7f20fc036670 2023-07-14T12:52:55.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f20faffd640 1 -- 172.21.15.5:0/2740606579 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21040711c0 con 0x7f20fc036670 2023-07-14T12:52:55.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f20faffd640 1 -- 172.21.15.5:0/2740606579 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2104071570 con 0x7f20fc036670 2023-07-14T12:52:55.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f210c359640 1 -- 172.21.15.5:0/2740606579 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20fc04aeb0 con 0x7f20fc036670 2023-07-14T12:52:55.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f210c359640 1 -- 172.21.15.5:0/2740606579 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20fc04a810 con 0x7f20fc036670 2023-07-14T12:52:55.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f7b20f05640 1 -- start start 2023-07-14T12:52:55.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f7b20f05640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b1c06b150 0x7f7b1c0b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f9bc2ffd640 1 -- 172.21.15.5:0/857540283 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bc40caed0 msgr2=0x7f9bc40b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f9bc2ffd640 1 --2- 172.21.15.5:0/857540283 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bc40caed0 0x7f9bc40b2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f9bc2ffd640 1 -- 172.21.15.5:0/857540283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bc406aff0 msgr2=0x7f9bc41533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f9bc2ffd640 1 --2- 172.21.15.5:0/857540283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bc406aff0 0x7f9bc41533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.402+0000 7f9bc2ffd640 1 -- 172.21.15.5:0/857540283 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc00bc80 con 0x7f9bc40c8300 2023-07-14T12:52:55.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7f7b20f05640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b1c070d50 0x7f7b1c0b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7fd88ce17640 1 --2- 172.21.15.5:0/1441424241 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8880b7a10 0x7fd88806a9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd8780098a0 tx=0x7fd87801c550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3736f01912f33e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:55.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7f7b20f05640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b1c160370 0x7f7b1c0c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7f7b20f05640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c0c6f60 con 0x7f7b1c070d50 2023-07-14T12:52:55.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7f7b20f05640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c0c7200 con 0x7f7b1c06b150 2023-07-14T12:52:55.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7f7b20f05640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c0c74e0 con 0x7f7b1c160370 2023-07-14T12:52:55.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7fd8877fe640 1 -- 172.21.15.5:0/1441424241 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8780a9630 con 0x7fd8880b7a10 2023-07-14T12:52:55.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7fd8877fe640 1 -- 172.21.15.5:0/1441424241 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8780a9790 con 0x7fd8880b7a10 2023-07-14T12:52:55.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7fd8877fe640 1 -- 172.21.15.5:0/1441424241 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8780a9b60 con 0x7fd8880b7a10 2023-07-14T12:52:55.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7f9bc2ffd640 1 --2- 172.21.15.5:0/857540283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bc40c8300 0x7f9bc4203ac0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9bb400b4a0 tx=0x7f9bb400b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:55.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7f7b1affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b1c070d50 0x7f7b1c0b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7f7b1affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b1c070d50 0x7f7b1c0b21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52888/0 (socket says 172.21.15.5:52888) 2023-07-14T12:52:55.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7f7b1affd640 1 -- 172.21.15.5:0/1905458383 learned_addr learned my addr 172.21.15.5:0/1905458383 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:55.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1905458383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b1c06b150 0x7f7b1c0b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7f9babfff640 1 -- 172.21.15.5:0/857540283 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb4010610 con 0x7f9bc40c8300 2023-07-14T12:52:55.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7f9babfff640 1 -- 172.21.15.5:0/857540283 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb4010770 con 0x7f9bc40c8300 2023-07-14T12:52:55.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7f9babfff640 1 -- 172.21.15.5:0/857540283 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb4010b20 con 0x7f9bc40c8300 2023-07-14T12:52:55.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7f9bc9b00640 1 -- 172.21.15.5:0/857540283 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc40b1d80 con 0x7f9bc40c8300 2023-07-14T12:52:55.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7f210c359640 1 -- 172.21.15.5:0/2740606579 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20fc034870 con 0x7f20fc036670 2023-07-14T12:52:55.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7f7b1bfff640 1 --2- 172.21.15.5:0/1905458383 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b1c160370 0x7f7b1c0c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7f7b1affd640 1 -- 172.21.15.5:0/1905458383 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b1c160370 msgr2=0x7f7b1c0c4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1905458383 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b1c160370 0x7f7b1c0c4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7f7b1affd640 1 -- 172.21.15.5:0/1905458383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b1c06b150 msgr2=0x7f7b1c0b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1905458383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b1c06b150 0x7f7b1c0b1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7f7b1affd640 1 -- 172.21.15.5:0/1905458383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b14009a70 con 0x7f7b1c070d50 2023-07-14T12:52:55.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7f9bc9b00640 1 -- 172.21.15.5:0/857540283 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc4204000 con 0x7f9bc40c8300 2023-07-14T12:52:55.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7fd88de19640 1 -- 172.21.15.5:0/1441424241 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8880b7a10 msgr2=0x7fd88806a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7fd88de19640 1 --2- 172.21.15.5:0/1441424241 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8880b7a10 0x7fd88806a9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd8780098a0 tx=0x7fd87801c550 comp rx=0 tx=0).stop 2023-07-14T12:52:55.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7f9bc9b00640 1 -- 172.21.15.5:0/857540283 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bc40678d0 con 0x7f9bc40c8300 2023-07-14T12:52:55.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.410+0000 7f7b1affd640 1 --2- 172.21.15.5:0/1905458383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b1c070d50 0x7f7b1c0b21a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7b100ad040 tx=0x7f7b1001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:55.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.406+0000 7f20faffd640 1 -- 172.21.15.5:0/2740606579 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f21040716d0 con 0x7f20fc036670 2023-07-14T12:52:55.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.410+0000 7f20faffd640 1 --2- 172.21.15.5:0/2740606579 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f20e8066350 0x7f20e8068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.410+0000 7fd88de19640 1 -- 172.21.15.5:0/1441424241 shutdown_connections 2023-07-14T12:52:55.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.410+0000 7fd88de19640 1 --2- 172.21.15.5:0/1441424241 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8880b7a10 0x7fd88806a9b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.410+0000 7fd88de19640 1 -- 172.21.15.5:0/1441424241 >> 172.21.15.5:0/1441424241 conn(0x7fd888069ea0 msgr2=0x7fd88806a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:55.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.410+0000 7fd88de19640 1 -- 172.21.15.5:0/1441424241 shutdown_connections 2023-07-14T12:52:55.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.410+0000 7f9babfff640 1 -- 172.21.15.5:0/857540283 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9bb4010c80 con 0x7f9bc40c8300 2023-07-14T12:52:55.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.410+0000 7f9babfff640 1 --2- 172.21.15.5:0/857540283 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9bb0066350 0x7f9bb0068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.410+0000 7f9babfff640 1 -- 172.21.15.5:0/857540283 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9bb40833b0 con 0x7f9bc40c8300 2023-07-14T12:52:55.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.410+0000 7f20faffd640 1 -- 172.21.15.5:0/2740606579 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f21040fcc60 con 0x7f20fc036670 2023-07-14T12:52:55.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.410+0000 7f21098f4640 1 --2- 172.21.15.5:0/2740606579 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f20e8066350 0x7f20e8068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.410+0000 7f21098f4640 1 --2- 172.21.15.5:0/2740606579 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f20e8066350 0x7f20e8068800 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f20fc00c460 tx=0x7f2100009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:55.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.410+0000 7f9bc37fe640 1 --2- 172.21.15.5:0/857540283 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9bb0066350 0x7f9bb0068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.410+0000 7fd88de19640 1 -- 172.21.15.5:0/1441424241 wait complete. 2023-07-14T12:52:55.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.414+0000 7f7b03fff640 1 -- 172.21.15.5:0/1905458383 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b100be5f0 con 0x7f7b1c070d50 2023-07-14T12:52:55.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.414+0000 7f7b03fff640 1 -- 172.21.15.5:0/1905458383 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b100be770 con 0x7f7b1c070d50 2023-07-14T12:52:55.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.414+0000 7f7b03fff640 1 -- 172.21.15.5:0/1905458383 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b100beb20 con 0x7f7b1c070d50 2023-07-14T12:52:55.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.414+0000 7f7b20f05640 1 -- 172.21.15.5:0/1905458383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b100094d0 con 0x7f7b1c070d50 2023-07-14T12:52:55.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.414+0000 7f7b20f05640 1 -- 172.21.15.5:0/1905458383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1c1608c0 con 0x7f7b1c070d50 2023-07-14T12:52:55.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.414+0000 7f9bc37fe640 1 --2- 172.21.15.5:0/857540283 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9bb0066350 0x7f9bb0068800 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9bc415ace0 tx=0x7f9bb8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:55.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.414+0000 7fd88de19640 1 Processor -- start 2023-07-14T12:52:55.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.414+0000 7f7b20f05640 1 -- 172.21.15.5:0/1905458383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b1c0678d0 con 0x7f7b1c070d50 2023-07-14T12:52:55.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.414+0000 7fd88de19640 1 -- start start 2023-07-14T12:52:55.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.414+0000 7f20faffd640 1 -- 172.21.15.5:0/2740606579 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f20fc034870 con 0x7f20fc036670 2023-07-14T12:52:55.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.418+0000 7fd88de19640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8880b42c0 0x7fd888158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.418+0000 7fd88de19640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8880b7a10 0x7fd8880c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.418+0000 7f9babfff640 1 -- 172.21.15.5:0/857540283 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9bb40508a0 con 0x7f9bc40c8300 2023-07-14T12:52:55.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.418+0000 7fd88ce17640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8880b42c0 0x7fd888158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.418+0000 7fd88ce17640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8880b42c0 0x7fd888158ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:45242/0 (socket says 172.21.15.5:45242) 2023-07-14T12:52:55.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.418+0000 7fd88ce17640 1 -- 172.21.15.5:0/1517103561 learned_addr learned my addr 172.21.15.5:0/1517103561 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:55.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.418+0000 7fd88de19640 1 --2- 172.21.15.5:0/1517103561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8880cee90 0x7fd8880c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.418+0000 7fd887fff640 1 --2- 172.21.15.5:0/1517103561 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8880b7a10 0x7fd8880c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.418+0000 7fd88de19640 1 -- 172.21.15.5:0/1517103561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8880b6050 con 0x7fd8880cee90 2023-07-14T12:52:55.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.418+0000 7fd88de19640 1 -- 172.21.15.5:0/1517103561 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8880b6330 con 0x7fd8880b42c0 2023-07-14T12:52:55.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.418+0000 7fd88de19640 1 -- 172.21.15.5:0/1517103561 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8880cb950 con 0x7fd8880b7a10 2023-07-14T12:52:55.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.418+0000 7f7b03fff640 1 -- 172.21.15.5:0/1905458383 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7b100b43f0 con 0x7f7b1c070d50 2023-07-14T12:52:55.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.418+0000 7f7b03fff640 1 --2- 172.21.15.5:0/1905458383 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7b08066350 0x7f7b08068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.418+0000 7f7b03fff640 1 -- 172.21.15.5:0/1905458383 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7b1011eb20 con 0x7f7b1c070d50 2023-07-14T12:52:55.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.422+0000 7fd88d618640 1 --2- 172.21.15.5:0/1517103561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8880cee90 0x7fd8880c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.422+0000 7fd887fff640 1 -- 172.21.15.5:0/1517103561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8880b42c0 msgr2=0x7fd888158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.422+0000 7fd887fff640 1 --2- 172.21.15.5:0/1517103561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8880b42c0 0x7fd888158ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.422+0000 7fd887fff640 1 -- 172.21.15.5:0/1517103561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8880cee90 msgr2=0x7fd8880c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.422+0000 7fd887fff640 1 --2- 172.21.15.5:0/1517103561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8880cee90 0x7fd8880c9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.422+0000 7fd887fff640 1 -- 172.21.15.5:0/1517103561 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8780094d0 con 0x7fd8880b7a10 2023-07-14T12:52:55.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.422+0000 7fd887fff640 1 --2- 172.21.15.5:0/1517103561 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8880b7a10 0x7fd8880c9580 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd87c00c3c0 tx=0x7fd87c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:55.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.430+0000 7fd8857fa640 1 -- 172.21.15.5:0/1517103561 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87c0074e0 con 0x7fd8880b7a10 2023-07-14T12:52:55.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.430+0000 7fd8857fa640 1 -- 172.21.15.5:0/1517103561 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87c007640 con 0x7fd8880b7a10 2023-07-14T12:52:55.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.430+0000 7fd8857fa640 1 -- 172.21.15.5:0/1517103561 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87c004a10 con 0x7fd8880b7a10 2023-07-14T12:52:55.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.430+0000 7fd88de19640 1 -- 172.21.15.5:0/1517103561 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8880cbc30 con 0x7fd8880b7a10 2023-07-14T12:52:55.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.418+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1905458383 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7b08066350 0x7f7b08068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.422+0000 7f7b1b7fe640 1 --2- 172.21.15.5:0/1905458383 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7b08066350 0x7f7b08068800 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0098e0 tx=0x7f7b0c009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:55.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.430+0000 7fd88de19640 1 -- 172.21.15.5:0/1517103561 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8880cb570 con 0x7fd8880b7a10 2023-07-14T12:52:55.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.430+0000 7fd88de19640 1 -- 172.21.15.5:0/1517103561 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8880678d0 con 0x7fd8880b7a10 2023-07-14T12:52:55.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.434+0000 7fd8857fa640 1 -- 172.21.15.5:0/1517103561 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd87c004b70 con 0x7fd8880b7a10 2023-07-14T12:52:55.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.434+0000 7fd8857fa640 1 --2- 172.21.15.5:0/1517103561 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fd874066350 0x7fd874068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.434+0000 7fd8857fa640 1 -- 172.21.15.5:0/1517103561 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd87c083de0 con 0x7fd8880b7a10 2023-07-14T12:52:55.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.434+0000 7fd88ce17640 1 --2- 172.21.15.5:0/1517103561 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fd874066350 0x7fd874068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.434+0000 7fd88ce17640 1 --2- 172.21.15.5:0/1517103561 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fd874066350 0x7fd874068800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd8780097f0 tx=0x7fd8780b3040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:55.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.438+0000 7fd8857fa640 1 -- 172.21.15.5:0/1517103561 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd87c051240 con 0x7fd8880b7a10 2023-07-14T12:52:55.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.438+0000 7f7b03fff640 1 -- 172.21.15.5:0/1905458383 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7b100ec1e0 con 0x7f7b1c070d50 2023-07-14T12:52:55.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.458+0000 7f9737293640 1 Processor -- start 2023-07-14T12:52:55.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.458+0000 7f9737293640 1 -- start start 2023-07-14T12:52:55.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.458+0000 7f9737293640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9730069b40 0x7f9730166930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.458+0000 7f9737293640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97300cdac0 con 0x7f97300cb280 2023-07-14T12:52:55.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.458+0000 7f9737293640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973006baa0 con 0x7f973015bc30 2023-07-14T12:52:55.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.458+0000 7f9737293640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f973006c060 con 0x7f9730069b40 2023-07-14T12:52:55.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.462+0000 7f973502f640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f973015bc30 0x7f97300cd3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:58132/0 (socket says 172.21.15.5:58132) 2023-07-14T12:52:55.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.462+0000 7f973502f640 1 -- 172.21.15.5:0/3330350799 learned_addr learned my addr 172.21.15.5:0/3330350799 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:55.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.462+0000 7f9735830640 1 --2- 172.21.15.5:0/3330350799 >> v2:172.21.15.154:3300/0 conn(0x7f9730069b40 0x7f9730166930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.462+0000 7f9735830640 1 -- 172.21.15.5:0/3330350799 >> v1:172.21.15.154:6789/0 conn(0x7f973015bc30 legacy=0x7f97300cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.462+0000 7f9735830640 1 -- 172.21.15.5:0/3330350799 >> v1:172.21.15.5:6789/0 conn(0x7f97300cb280 legacy=0x7f9730069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.462+0000 7f9735830640 1 -- 172.21.15.5:0/3330350799 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973006bd80 con 0x7f9730069b40 2023-07-14T12:52:55.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.462+0000 7f9727fff640 1 -- 172.21.15.5:0/3330350799 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1803333747 0 0) 0x7f973006baa0 con 0x7f973015bc30 2023-07-14T12:52:55.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.470+0000 7f18dc6f9640 1 Processor -- start 2023-07-14T12:52:55.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.470+0000 7f9735830640 1 --2- 172.21.15.5:0/3330350799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9730069b40 0x7f9730166930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f97200097c0 tx=0x7f972001bf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=905e4c28fc3d5e7b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:55.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.470+0000 7f18dc6f9640 1 -- start start 2023-07-14T12:52:55.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.466+0000 7fc9b6b74640 1 Processor -- start 2023-07-14T12:52:55.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.466+0000 7fc9b6b74640 1 -- start start 2023-07-14T12:52:55.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.470+0000 7fc9b6b74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9b0160030 0x7fc9b006bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.470+0000 7fc9b6b74640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc9b00c98e0 0x7fc9b00c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.470+0000 7fc9b6b74640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b0160400 con 0x7fc9b0069430 2023-07-14T12:52:55.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.470+0000 7fc9b6b74640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b00ca250 con 0x7fc9b00c98e0 2023-07-14T12:52:55.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.470+0000 7fc9b6b74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b006aff0 con 0x7fc9b0160030 2023-07-14T12:52:55.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.470+0000 7fc9affff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc9b00c98e0 0x7fc9b00c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.470+0000 7fc9affff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc9b00c98e0 0x7fc9b00c9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:45262/0 (socket says 172.21.15.5:45262) 2023-07-14T12:52:55.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.470+0000 7fc9affff640 1 -- 172.21.15.5:0/2443138651 learned_addr learned my addr 172.21.15.5:0/2443138651 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:55.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.470+0000 7fc9affff640 1 -- 172.21.15.5:0/2443138651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9b0160030 msgr2=0x7fc9b006bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:55.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.470+0000 7fc9affff640 1 --2- 172.21.15.5:0/2443138651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9b0160030 0x7fc9b006bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.470+0000 7fc9affff640 1 -- 172.21.15.5:0/2443138651 >> v1:172.21.15.5:6789/0 conn(0x7fc9b0069430 legacy=0x7fc9b006eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.470+0000 7fc9affff640 1 -- 172.21.15.5:0/2443138651 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b00ca430 con 0x7fc9b00c98e0 2023-07-14T12:52:55.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.470+0000 7f9727fff640 1 -- 172.21.15.5:0/3330350799 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97200a56f0 con 0x7f9730069b40 2023-07-14T12:52:55.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.470+0000 7f9727fff640 1 -- 172.21.15.5:0/3330350799 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97200a5850 con 0x7f9730069b40 2023-07-14T12:52:55.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.470+0000 7f9727fff640 1 -- 172.21.15.5:0/3330350799 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97200a5be0 con 0x7f9730069b40 2023-07-14T12:52:55.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.470+0000 7f9737293640 1 -- 172.21.15.5:0/3330350799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9730069b40 msgr2=0x7f9730166930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.470+0000 7f9737293640 1 --2- 172.21.15.5:0/3330350799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9730069b40 0x7f9730166930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f97200097c0 tx=0x7f972001bf00 comp rx=0 tx=0).stop 2023-07-14T12:52:55.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.474+0000 7f9737293640 1 -- 172.21.15.5:0/3330350799 shutdown_connections 2023-07-14T12:52:55.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.474+0000 7f9737293640 1 --2- 172.21.15.5:0/3330350799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9730069b40 0x7f9730166930 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.474+0000 7f9737293640 1 -- 172.21.15.5:0/3330350799 >> 172.21.15.5:0/3330350799 conn(0x7f97300ce980 msgr2=0x7f97300ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:55.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.474+0000 7f9737293640 1 -- 172.21.15.5:0/3330350799 shutdown_connections 2023-07-14T12:52:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.470+0000 7f18dc6f9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f18cc03a9e0 0x7f18cc0e6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.474+0000 7f18dc6f9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18cc057440 0x7f18cc0578a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.474+0000 7f18dc6f9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18cc0386e0 con 0x7f18cc03adb0 2023-07-14T12:52:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.474+0000 7f18dc6f9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18cc0e6070 con 0x7f18cc057440 2023-07-14T12:52:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.474+0000 7f18dc6f9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18cc0e71e0 con 0x7f18cc03a9e0 2023-07-14T12:52:55.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.474+0000 7f18d9c94640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f18cc03adb0 0x7f18cc03bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38988/0 (socket says 172.21.15.5:38988) 2023-07-14T12:52:55.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.474+0000 7f18d9c94640 1 -- 172.21.15.5:0/1284341833 learned_addr learned my addr 172.21.15.5:0/1284341833 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:55.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.474+0000 7f18dac96640 1 --2- 172.21.15.5:0/1284341833 >> v2:172.21.15.5:3300/0 conn(0x7f18cc057440 0x7f18cc0578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.474+0000 7f18dac96640 1 -- 172.21.15.5:0/1284341833 >> v2:172.21.15.154:3300/0 conn(0x7f18cc03a9e0 msgr2=0x7f18cc0e6ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T12:52:55.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.474+0000 7f18dac96640 1 --2- 172.21.15.5:0/1284341833 >> v2:172.21.15.154:3300/0 conn(0x7f18cc03a9e0 0x7f18cc0e6ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.474+0000 7f18dac96640 1 -- 172.21.15.5:0/1284341833 >> v1:172.21.15.5:6789/0 conn(0x7f18cc03adb0 legacy=0x7f18cc03bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.474+0000 7f18dac96640 1 -- 172.21.15.5:0/1284341833 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc053520 con 0x7f18cc057440 2023-07-14T12:52:55.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.474+0000 7fc9affff640 1 --2- 172.21.15.5:0/2443138651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9b00c98e0 0x7fc9b00c9d10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009870 tx=0x7fc9b006fe10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ade0dc2dd3adeed8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:55.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.474+0000 7f9737293640 1 -- 172.21.15.5:0/3330350799 wait complete. 2023-07-14T12:52:55.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.478+0000 7f9737293640 1 Processor -- start 2023-07-14T12:52:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.474+0000 7fc9af7fe640 1 -- 172.21.15.5:0/2443138651 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a40aa670 con 0x7fc9b00c98e0 2023-07-14T12:52:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.474+0000 7fc9af7fe640 1 -- 172.21.15.5:0/2443138651 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a40aa7d0 con 0x7fc9b00c98e0 2023-07-14T12:52:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.474+0000 7fc9af7fe640 1 -- 172.21.15.5:0/2443138651 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a40aab60 con 0x7fc9b00c98e0 2023-07-14T12:52:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.478+0000 7fc9b6b74640 1 -- 172.21.15.5:0/2443138651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9b00c98e0 msgr2=0x7fc9b00c9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.478+0000 7fc9b6b74640 1 --2- 172.21.15.5:0/2443138651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9b00c98e0 0x7fc9b00c9d10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009870 tx=0x7fc9b006fe10 comp rx=0 tx=0).stop 2023-07-14T12:52:55.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.478+0000 7f9737293640 1 -- start start 2023-07-14T12:52:55.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.478+0000 7f9737293640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9730069b40 0x7f973015de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.478+0000 7fc9b6b74640 1 -- 172.21.15.5:0/2443138651 shutdown_connections 2023-07-14T12:52:55.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.478+0000 7fc9b6b74640 1 --2- 172.21.15.5:0/2443138651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9b00c98e0 0x7fc9b00c9d10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.478+0000 7fc9b6b74640 1 --2- 172.21.15.5:0/2443138651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9b0160030 0x7fc9b006bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.478+0000 7fc9b6b74640 1 -- 172.21.15.5:0/2443138651 >> 172.21.15.5:0/2443138651 conn(0x7fc9b00ce980 msgr2=0x7fc9b00ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:55.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.478+0000 7fc9b6b74640 1 -- 172.21.15.5:0/2443138651 shutdown_connections 2023-07-14T12:52:55.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.478+0000 7f9737293640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97300cb280 0x7f97300ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.478+0000 7f973502f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9730069b40 0x7f973015de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.478+0000 7f973502f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9730069b40 0x7f973015de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:55130/0 (socket says 172.21.15.5:55130) 2023-07-14T12:52:55.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.478+0000 7f973482e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97300cb280 0x7f97300ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.478+0000 7f973482e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97300cb280 0x7f97300ae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:45274/0 (socket says 172.21.15.5:45274) 2023-07-14T12:52:55.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.478+0000 7f18dac96640 1 --2- 172.21.15.5:0/1284341833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18cc057440 0x7f18cc0578a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f18cc0072a0 tx=0x7f18c401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c64b8a2bf9926e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:55.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.478+0000 7fc9b6b74640 1 -- 172.21.15.5:0/2443138651 wait complete. 2023-07-14T12:52:55.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.478+0000 7f9737293640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97302052d0 0x7f97300aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.478+0000 7fc9b6b74640 1 Processor -- start 2023-07-14T12:52:55.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.478+0000 7f973502f640 1 -- 172.21.15.5:0/358203522 learned_addr learned my addr 172.21.15.5:0/358203522 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:55.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7f9737293640 1 -- 172.21.15.5:0/358203522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97300c6cc0 con 0x7f97302052d0 2023-07-14T12:52:55.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7f9737293640 1 -- 172.21.15.5:0/358203522 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97300b3b90 con 0x7f97300cb280 2023-07-14T12:52:55.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7f9737293640 1 -- 172.21.15.5:0/358203522 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97300b2bc0 con 0x7f9730069b40 2023-07-14T12:52:55.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7f18d9493640 1 -- 172.21.15.5:0/1284341833 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c40ab600 con 0x7f18cc057440 2023-07-14T12:52:55.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7f18d9493640 1 -- 172.21.15.5:0/1284341833 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c40a7050 con 0x7f18cc057440 2023-07-14T12:52:55.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7f973482e640 1 -- 172.21.15.5:0/358203522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9730069b40 msgr2=0x7f973015de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7f973482e640 1 --2- 172.21.15.5:0/358203522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9730069b40 0x7f973015de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7f973482e640 1 -- 172.21.15.5:0/358203522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97302052d0 msgr2=0x7f97300aede0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T12:52:55.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7f9735830640 1 --2- 172.21.15.5:0/358203522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97302052d0 0x7f97300aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7f18dc6f9640 1 -- 172.21.15.5:0/1284341833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18cc057440 msgr2=0x7f18cc0578a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7f18dc6f9640 1 --2- 172.21.15.5:0/1284341833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18cc057440 0x7f18cc0578a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f18cc0072a0 tx=0x7f18c401c390 comp rx=0 tx=0).stop 2023-07-14T12:52:55.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7fc9b6b74640 1 -- start start 2023-07-14T12:52:55.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7fc9b6b74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9b0069430 0x7fc9b00a9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7fc9b6b74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9b00c98e0 0x7fc9b015eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7f18dc6f9640 1 -- 172.21.15.5:0/1284341833 shutdown_connections 2023-07-14T12:52:55.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7f18dc6f9640 1 --2- 172.21.15.5:0/1284341833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18cc057440 0x7f18cc0578a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7f18dc6f9640 1 --2- 172.21.15.5:0/1284341833 >> v2:172.21.15.154:3300/0 conn(0x7f18cc03a9e0 0x7f18cc0e6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7f18dc6f9640 1 -- 172.21.15.5:0/1284341833 >> 172.21.15.5:0/1284341833 conn(0x7f18cc058f60 msgr2=0x7f18cc059360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7fc9b6b74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9b0160030 0x7fc9b015f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7fc9b4910640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9b0069430 0x7fc9b00a9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7f973482e640 1 --2- 172.21.15.5:0/358203522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97302052d0 0x7f97300aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7f973482e640 1 -- 172.21.15.5:0/358203522 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9720009420 con 0x7f97300cb280 2023-07-14T12:52:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7f973502f640 1 --2- 172.21.15.5:0/358203522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9730069b40 0x7f973015de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:52:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7f18dc6f9640 1 -- 172.21.15.5:0/1284341833 shutdown_connections 2023-07-14T12:52:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7fc9b4910640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9b0069430 0x7fc9b00a9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:55138/0 (socket says 172.21.15.5:55138) 2023-07-14T12:52:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7fc9affff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9b00c98e0 0x7fc9b015eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7fc9affff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9b00c98e0 0x7fc9b015eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:45276/0 (socket says 172.21.15.5:45276) 2023-07-14T12:52:55.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7f9735830640 1 --2- 172.21.15.5:0/358203522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97302052d0 0x7f97300aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:52:55.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7f18dc6f9640 1 -- 172.21.15.5:0/1284341833 wait complete. 2023-07-14T12:52:55.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7f973482e640 1 --2- 172.21.15.5:0/358203522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97300cb280 0x7f97300ae8a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f972c00c430 tx=0x7f972c00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:55.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7fc9b4910640 1 -- 172.21.15.5:0/216859621 learned_addr learned my addr 172.21.15.5:0/216859621 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:55.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7fc9b6b74640 1 -- 172.21.15.5:0/216859621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b00a88b0 con 0x7fc9b0160030 2023-07-14T12:52:55.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7fc9b5111640 1 --2- 172.21.15.5:0/216859621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9b0160030 0x7fc9b015f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7fc9b6b74640 1 -- 172.21.15.5:0/216859621 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b0161980 con 0x7fc9b00c98e0 2023-07-14T12:52:55.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7fc9b6b74640 1 -- 172.21.15.5:0/216859621 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b0161c60 con 0x7fc9b0069430 2023-07-14T12:52:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7f9725ffb640 1 -- 172.21.15.5:0/358203522 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c0054e0 con 0x7f97300cb280 2023-07-14T12:52:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.482+0000 7f9725ffb640 1 -- 172.21.15.5:0/358203522 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972c003600 con 0x7f97300cb280 2023-07-14T12:52:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.486+0000 7fc9affff640 1 -- 172.21.15.5:0/216859621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9b0069430 msgr2=0x7fc9b00a9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.486+0000 7fc9affff640 1 --2- 172.21.15.5:0/216859621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9b0069430 0x7fc9b00a9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.486+0000 7fc9affff640 1 -- 172.21.15.5:0/216859621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9b0160030 msgr2=0x7fc9b015f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.486+0000 7fc9affff640 1 --2- 172.21.15.5:0/216859621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9b0160030 0x7fc9b015f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.486+0000 7fc9affff640 1 -- 172.21.15.5:0/216859621 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a40094d0 con 0x7fc9b00c98e0 2023-07-14T12:52:55.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.486+0000 7fc9affff640 1 --2- 172.21.15.5:0/216859621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9b00c98e0 0x7fc9b015eeb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40ab000 tx=0x7fc9a401ad50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:55.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.486+0000 7fc9ad7fa640 1 -- 172.21.15.5:0/216859621 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a40b3800 con 0x7fc9b00c98e0 2023-07-14T12:52:55.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.486+0000 7f9737293640 1 -- 172.21.15.5:0/358203522 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97300b2dd0 con 0x7f97300cb280 2023-07-14T12:52:55.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.486+0000 7f9737293640 1 -- 172.21.15.5:0/358203522 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97300b3390 con 0x7f97300cb280 2023-07-14T12:52:55.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.486+0000 7f18dc6f9640 1 Processor -- start 2023-07-14T12:52:55.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.486+0000 7fc9ad7fa640 1 -- 172.21.15.5:0/216859621 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a40b3960 con 0x7fc9b00c98e0 2023-07-14T12:52:55.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.486+0000 7fc9ad7fa640 1 -- 172.21.15.5:0/216859621 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a40b3d10 con 0x7fc9b00c98e0 2023-07-14T12:52:55.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.486+0000 7fc9b6b74640 1 -- 172.21.15.5:0/216859621 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b0161f40 con 0x7fc9b00c98e0 2023-07-14T12:52:55.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.486+0000 7fc9b6b74640 1 -- 172.21.15.5:0/216859621 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b00aa3d0 con 0x7fc9b00c98e0 2023-07-14T12:52:55.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.486+0000 7f9725ffb640 1 -- 172.21.15.5:0/358203522 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c0039b0 con 0x7f97300cb280 2023-07-14T12:52:55.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.486+0000 7f18dc6f9640 1 -- start start 2023-07-14T12:52:55.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.486+0000 7f18dc6f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18cc03a9e0 0x7f18cc0cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.490+0000 7f18dc6f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18cc03adb0 0x7f18cc0526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.490+0000 7f18da495640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18cc03a9e0 0x7f18cc0cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.490+0000 7f18da495640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18cc03a9e0 0x7f18cc0cfa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:55140/0 (socket says 172.21.15.5:55140) 2023-07-14T12:52:55.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.490+0000 7f9725ffb640 1 -- 172.21.15.5:0/358203522 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f972c003bd0 con 0x7f97300cb280 2023-07-14T12:52:55.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.490+0000 7f9725ffb640 1 --2- 172.21.15.5:0/358203522 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9714066380 0x7f9714068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.490+0000 7f9725ffb640 1 -- 172.21.15.5:0/358203522 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f972c0836b0 con 0x7f97300cb280 2023-07-14T12:52:55.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.490+0000 7f973502f640 1 --2- 172.21.15.5:0/358203522 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9714066380 0x7f9714068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.490+0000 7f18da495640 1 -- 172.21.15.5:0/3671456964 learned_addr learned my addr 172.21.15.5:0/3671456964 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.490+0000 7f18dc6f9640 1 --2- 172.21.15.5:0/3671456964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18cc057440 0x7f18cc0e5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.490+0000 7f18dc6f9640 1 -- 172.21.15.5:0/3671456964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc03eed0 con 0x7f18cc03adb0 2023-07-14T12:52:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.490+0000 7f18dc6f9640 1 -- 172.21.15.5:0/3671456964 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc03ebf0 con 0x7f18cc057440 2023-07-14T12:52:55.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.490+0000 7f18d9c94640 1 --2- 172.21.15.5:0/3671456964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18cc03adb0 0x7f18cc0526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.490+0000 7f18dc6f9640 1 -- 172.21.15.5:0/3671456964 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc051bd0 con 0x7f18cc03a9e0 2023-07-14T12:52:55.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.494+0000 7f9737293640 1 -- 172.21.15.5:0/358203522 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97300678d0 con 0x7f97300cb280 2023-07-14T12:52:55.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.494+0000 7f973502f640 1 --2- 172.21.15.5:0/358203522 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9714066380 0x7f9714068830 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f97280012f0 tx=0x7f9728004d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:55.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.494+0000 7f18dac96640 1 --2- 172.21.15.5:0/3671456964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18cc057440 0x7f18cc0e5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.494+0000 7f18da495640 1 -- 172.21.15.5:0/3671456964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18cc057440 msgr2=0x7f18cc0e5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.494+0000 7f18da495640 1 --2- 172.21.15.5:0/3671456964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18cc057440 0x7f18cc0e5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.494+0000 7f18da495640 1 -- 172.21.15.5:0/3671456964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18cc03adb0 msgr2=0x7f18cc0526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.494+0000 7f18da495640 1 --2- 172.21.15.5:0/3671456964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18cc03adb0 0x7f18cc0526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.494+0000 7f18da495640 1 -- 172.21.15.5:0/3671456964 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c4009420 con 0x7f18cc03a9e0 2023-07-14T12:52:55.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.490+0000 7fc9ad7fa640 1 -- 172.21.15.5:0/216859621 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc9a40c6440 con 0x7fc9b00c98e0 2023-07-14T12:52:55.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.494+0000 7fc9ad7fa640 1 --2- 172.21.15.5:0/216859621 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc998066400 0x7fc9980688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.494+0000 7fc9ad7fa640 1 -- 172.21.15.5:0/216859621 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc9a411eb40 con 0x7fc9b00c98e0 2023-07-14T12:52:55.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.494+0000 7f18da495640 1 --2- 172.21.15.5:0/3671456964 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18cc03a9e0 0x7f18cc0cfa60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f18d000b4a0 tx=0x7f18d000b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:55.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.494+0000 7f18caffd640 1 -- 172.21.15.5:0/3671456964 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0011830 con 0x7f18cc03a9e0 2023-07-14T12:52:55.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.494+0000 7fc9b4910640 1 --2- 172.21.15.5:0/216859621 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc998066400 0x7fc9980688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.494+0000 7f18dc6f9640 1 -- 172.21.15.5:0/3671456964 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18cc051eb0 con 0x7f18cc03a9e0 2023-07-14T12:52:55.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.494+0000 7f18dc6f9640 1 -- 172.21.15.5:0/3671456964 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18cc03e7f0 con 0x7f18cc03a9e0 2023-07-14T12:52:55.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.494+0000 7f18caffd640 1 -- 172.21.15.5:0/3671456964 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d0011990 con 0x7f18cc03a9e0 2023-07-14T12:52:55.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.494+0000 7fc9b4910640 1 --2- 172.21.15.5:0/216859621 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc998066400 0x7fc9980688b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc9a00099b0 tx=0x7fc9a0009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:55.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.494+0000 7f18caffd640 1 -- 172.21.15.5:0/3671456964 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0011d80 con 0x7f18cc03a9e0 2023-07-14T12:52:55.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.498+0000 7f18caffd640 1 -- 172.21.15.5:0/3671456964 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f18d001a400 con 0x7f18cc03a9e0 2023-07-14T12:52:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.498+0000 7fc996ffd640 1 -- 172.21.15.5:0/216859621 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc990005260 con 0x7fc9b00c98e0 2023-07-14T12:52:55.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.498+0000 7f18dc6f9640 1 -- 172.21.15.5:0/3671456964 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18bc005260 con 0x7f18cc03a9e0 2023-07-14T12:52:55.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.498+0000 7f18caffd640 1 --2- 172.21.15.5:0/3671456964 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f18b8066250 0x7f18b8068700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:55.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.498+0000 7f18caffd640 1 -- 172.21.15.5:0/3671456964 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f18d0083ef0 con 0x7f18cc03a9e0 2023-07-14T12:52:55.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.498+0000 7f18d9c94640 1 --2- 172.21.15.5:0/3671456964 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f18b8066250 0x7f18b8068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:55.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.498+0000 7f9725ffb640 1 -- 172.21.15.5:0/358203522 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f972c050bc0 con 0x7f97300cb280 2023-07-14T12:52:55.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.498+0000 7f18d9c94640 1 --2- 172.21.15.5:0/3671456964 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f18b8066250 0x7f18b8068700 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f18d4000b70 tx=0x7f18d408c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:55.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.506+0000 7fc9ad7fa640 1 -- 172.21.15.5:0/216859621 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc9a40ec060 con 0x7fc9b00c98e0 2023-07-14T12:52:55.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.506+0000 7f18caffd640 1 -- 172.21.15.5:0/3671456964 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f18d00512d0 con 0x7f18cc03a9e0 2023-07-14T12:52:55.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.674+0000 7f152d696640 1 -- 172.21.15.5:0/1577643844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f15280c1a60 con 0x7f1528152770 2023-07-14T12:52:55.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.674+0000 7f150f7fe640 1 -- 172.21.15.5:0/1577643844 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f15180512a0 con 0x7f1528152770 2023-07-14T12:52:55.702 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-07-14T12:52:55.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.678+0000 7f152d696640 1 -- 172.21.15.5:0/1577643844 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f1514066300 msgr2=0x7f15140687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.678+0000 7f152d696640 1 --2- 172.21.15.5:0/1577643844 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f1514066300 0x7f15140687b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f15200b0000 tx=0x7f15200ac070 comp rx=0 tx=0).stop 2023-07-14T12:52:55.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.678+0000 7f152d696640 1 -- 172.21.15.5:0/1577643844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1528152770 msgr2=0x7f152814df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.678+0000 7f152d696640 1 --2- 172.21.15.5:0/1577643844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1528152770 0x7f152814df30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f151800f8c0 tx=0x7f151800fd80 comp rx=0 tx=0).stop 2023-07-14T12:52:55.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.678+0000 7f152d696640 1 -- 172.21.15.5:0/1577643844 shutdown_connections 2023-07-14T12:52:55.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.678+0000 7f152d696640 1 --2- 172.21.15.5:0/1577643844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15280b2bc0 0x7f15280b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.678+0000 7f152d696640 1 --2- 172.21.15.5:0/1577643844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1528152770 0x7f152814df30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.678+0000 7f152d696640 1 --2- 172.21.15.5:0/1577643844 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f1514066300 0x7f15140687b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.678+0000 7f152d696640 1 --2- 172.21.15.5:0/1577643844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1510003b10 0x7f15280c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.678+0000 7f152d696640 1 -- 172.21.15.5:0/1577643844 >> 172.21.15.5:0/1577643844 conn(0x7f15280ce980 msgr2=0x7f152814f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:55.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.678+0000 7f152d696640 1 -- 172.21.15.5:0/1577643844 shutdown_connections 2023-07-14T12:52:55.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.678+0000 7f152d696640 1 -- 172.21.15.5:0/1577643844 wait complete. 2023-07-14T12:52:55.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-07-14T12:52:55.736 DEBUG:teuthology.parallel:result is None 2023-07-14T12:52:55.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.730+0000 7f9bc9b00640 1 -- 172.21.15.5:0/857540283 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9bc406c220 con 0x7f9bc40c8300 2023-07-14T12:52:55.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.730+0000 7f9babfff640 1 -- 172.21.15.5:0/857540283 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9bb4053ec0 con 0x7f9bc40c8300 2023-07-14T12:52:55.756 INFO:teuthology.orchestra.run.smithi005.stdout:55834574856 2023-07-14T12:52:55.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.734+0000 7f210c359640 1 -- 172.21.15.5:0/2740606579 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f20fc034870 con 0x7f20fc036670 2023-07-14T12:52:55.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.734+0000 7f9bc9b00640 1 -- 172.21.15.5:0/857540283 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9bb0066350 msgr2=0x7f9bb0068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.734+0000 7f9bc9b00640 1 --2- 172.21.15.5:0/857540283 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9bb0066350 0x7f9bb0068800 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9bc415ace0 tx=0x7f9bb8009040 comp rx=0 tx=0).stop 2023-07-14T12:52:55.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.734+0000 7f20faffd640 1 -- 172.21.15.5:0/2740606579 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f20fc034870 con 0x7f20fc036670 2023-07-14T12:52:55.762 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-07-14T12:52:55.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.734+0000 7f9bc9b00640 1 -- 172.21.15.5:0/857540283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bc40c8300 msgr2=0x7f9bc4203ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.734+0000 7f9bc9b00640 1 --2- 172.21.15.5:0/857540283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bc40c8300 0x7f9bc4203ac0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9bb400b4a0 tx=0x7f9bb400b960 comp rx=0 tx=0).stop 2023-07-14T12:52:55.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.734+0000 7f9bc9b00640 1 -- 172.21.15.5:0/857540283 shutdown_connections 2023-07-14T12:52:55.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.734+0000 7f9bc9b00640 1 --2- 172.21.15.5:0/857540283 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9bc40caed0 0x7f9bc40b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.734+0000 7f9bc9b00640 1 --2- 172.21.15.5:0/857540283 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9bb0066350 0x7f9bb0068800 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.734+0000 7f9bc9b00640 1 --2- 172.21.15.5:0/857540283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bc40c8300 0x7f9bc4203ac0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.734+0000 7f9bc9b00640 1 --2- 172.21.15.5:0/857540283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9bc406aff0 0x7f9bc41533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.734+0000 7f9bc9b00640 1 -- 172.21.15.5:0/857540283 >> 172.21.15.5:0/857540283 conn(0x7f9bc40ce980 msgr2=0x7f9bc40ccc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:55.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.738+0000 7f9bc9b00640 1 -- 172.21.15.5:0/857540283 shutdown_connections 2023-07-14T12:52:55.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.738+0000 7f9bc9b00640 1 -- 172.21.15.5:0/857540283 wait complete. 2023-07-14T12:52:55.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.754+0000 7fd88de19640 1 -- 172.21.15.5:0/1517103561 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd8880d0700 con 0x7fd8880b7a10 2023-07-14T12:52:55.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.754+0000 7fd8857fa640 1 -- 172.21.15.5:0/1517103561 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd87c054860 con 0x7fd8880b7a10 2023-07-14T12:52:55.782 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2023-07-14T12:52:55.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.758+0000 7fd88de19640 1 -- 172.21.15.5:0/1517103561 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fd874066350 msgr2=0x7fd874068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.758+0000 7fd88de19640 1 --2- 172.21.15.5:0/1517103561 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fd874066350 0x7fd874068800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd8780097f0 tx=0x7fd8780b3040 comp rx=0 tx=0).stop 2023-07-14T12:52:55.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.758+0000 7fd88de19640 1 -- 172.21.15.5:0/1517103561 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8880b7a10 msgr2=0x7fd8880c9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.758+0000 7fd88de19640 1 --2- 172.21.15.5:0/1517103561 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8880b7a10 0x7fd8880c9580 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd87c00c3c0 tx=0x7fd87c00c880 comp rx=0 tx=0).stop 2023-07-14T12:52:55.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.758+0000 7fd88de19640 1 -- 172.21.15.5:0/1517103561 shutdown_connections 2023-07-14T12:52:55.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.758+0000 7fd88de19640 1 --2- 172.21.15.5:0/1517103561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8880cee90 0x7fd8880c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.758+0000 7fd88de19640 1 --2- 172.21.15.5:0/1517103561 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8880b7a10 0x7fd8880c9580 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.758+0000 7fd88de19640 1 --2- 172.21.15.5:0/1517103561 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fd874066350 0x7fd874068800 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.758+0000 7fd88de19640 1 --2- 172.21.15.5:0/1517103561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8880b42c0 0x7fd888158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.758+0000 7fd88de19640 1 -- 172.21.15.5:0/1517103561 >> 172.21.15.5:0/1517103561 conn(0x7fd888069ea0 msgr2=0x7fd888166990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:55.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.758+0000 7fd88de19640 1 -- 172.21.15.5:0/1517103561 shutdown_connections 2023-07-14T12:52:55.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.758+0000 7fd88de19640 1 -- 172.21.15.5:0/1517103561 wait complete. 2023-07-14T12:52:55.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2023-07-14T12:52:55.794 DEBUG:teuthology.parallel:result is None 2023-07-14T12:52:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.766+0000 7f210c359640 1 -- 172.21.15.5:0/2740606579 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f20e8066350 msgr2=0x7f20e8068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.766+0000 7f210c359640 1 --2- 172.21.15.5:0/2740606579 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f20e8066350 0x7f20e8068800 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f20fc00c460 tx=0x7f2100009040 comp rx=0 tx=0).stop 2023-07-14T12:52:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.766+0000 7f210c359640 1 -- 172.21.15.5:0/2740606579 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20fc036670 msgr2=0x7f20fc04bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.766+0000 7f210c359640 1 --2- 172.21.15.5:0/2740606579 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20fc036670 0x7f20fc04bcc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f210402c430 tx=0x7f2104066890 comp rx=0 tx=0).stop 2023-07-14T12:52:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.766+0000 7f210c359640 1 -- 172.21.15.5:0/2740606579 shutdown_connections 2023-07-14T12:52:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.766+0000 7f210c359640 1 --2- 172.21.15.5:0/2740606579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20fc050fb0 0x7f20fc035210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.766+0000 7f210c359640 1 --2- 172.21.15.5:0/2740606579 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f20e8066350 0x7f20e8068800 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.766+0000 7f210c359640 1 --2- 172.21.15.5:0/2740606579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20fc03a4d0 0x7f20fc1870d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.766+0000 7f210c359640 1 --2- 172.21.15.5:0/2740606579 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20fc036670 0x7f20fc04bcc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.766+0000 7f210c359640 1 -- 172.21.15.5:0/2740606579 >> 172.21.15.5:0/2740606579 conn(0x7f20fc051670 msgr2=0x7f20fc0e0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:55.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.766+0000 7f210c359640 1 -- 172.21.15.5:0/2740606579 shutdown_connections 2023-07-14T12:52:55.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.766+0000 7f210c359640 1 -- 172.21.15.5:0/2740606579 wait complete. 2023-07-14T12:52:55.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.770+0000 7f7b20f05640 1 -- 172.21.15.5:0/1905458383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7b1c0c7620 con 0x7f7b1c070d50 2023-07-14T12:52:55.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.774+0000 7f7b03fff640 1 -- 172.21.15.5:0/1905458383 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7b1c0c7620 con 0x7f7b1c070d50 2023-07-14T12:52:55.799 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-07-14T12:52:55.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.774+0000 7f7b20f05640 1 -- 172.21.15.5:0/1905458383 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7b08066350 msgr2=0x7f7b08068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.774+0000 7f7b20f05640 1 --2- 172.21.15.5:0/1905458383 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7b08066350 0x7f7b08068800 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0098e0 tx=0x7f7b0c009060 comp rx=0 tx=0).stop 2023-07-14T12:52:55.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.774+0000 7f7b20f05640 1 -- 172.21.15.5:0/1905458383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b1c070d50 msgr2=0x7f7b1c0b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.774+0000 7f7b20f05640 1 --2- 172.21.15.5:0/1905458383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b1c070d50 0x7f7b1c0b21a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7b100ad040 tx=0x7f7b1001acb0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.778+0000 7f7b20f05640 1 -- 172.21.15.5:0/1905458383 shutdown_connections 2023-07-14T12:52:55.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.778+0000 7f7b20f05640 1 --2- 172.21.15.5:0/1905458383 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b1c160370 0x7f7b1c0c4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.778+0000 7f7b20f05640 1 --2- 172.21.15.5:0/1905458383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b1c070d50 0x7f7b1c0b21a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.778+0000 7f7b20f05640 1 --2- 172.21.15.5:0/1905458383 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7b08066350 0x7f7b08068800 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.778+0000 7f7b20f05640 1 --2- 172.21.15.5:0/1905458383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b1c06b150 0x7f7b1c0b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.778+0000 7f7b20f05640 1 -- 172.21.15.5:0/1905458383 >> 172.21.15.5:0/1905458383 conn(0x7f7b1c0cb4a0 msgr2=0x7f7b1c0ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:55.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.778+0000 7f7b20f05640 1 -- 172.21.15.5:0/1905458383 shutdown_connections 2023-07-14T12:52:55.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.778+0000 7f7b20f05640 1 -- 172.21.15.5:0/1905458383 wait complete. 2023-07-14T12:52:55.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.786+0000 7f9737293640 1 -- 172.21.15.5:0/358203522 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9730066080 con 0x7f97300cb280 2023-07-14T12:52:55.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.786+0000 7f9725ffb640 1 -- 172.21.15.5:0/358203522 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f972c017030 con 0x7f97300cb280 2023-07-14T12:52:55.812 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-07-14T12:52:55.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.790+0000 7f9737293640 1 -- 172.21.15.5:0/358203522 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9714066380 msgr2=0x7f9714068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.790+0000 7f9737293640 1 --2- 172.21.15.5:0/358203522 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9714066380 0x7f9714068830 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f97280012f0 tx=0x7f9728004d50 comp rx=0 tx=0).stop 2023-07-14T12:52:55.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.790+0000 7f9737293640 1 -- 172.21.15.5:0/358203522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97300cb280 msgr2=0x7f97300ae8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.790+0000 7f9737293640 1 --2- 172.21.15.5:0/358203522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97300cb280 0x7f97300ae8a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f972c00c430 tx=0x7f972c00c8f0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.790+0000 7f9737293640 1 -- 172.21.15.5:0/358203522 shutdown_connections 2023-07-14T12:52:55.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.790+0000 7f9737293640 1 --2- 172.21.15.5:0/358203522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97302052d0 0x7f97300aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.790+0000 7f9737293640 1 --2- 172.21.15.5:0/358203522 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9714066380 0x7f9714068830 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.790+0000 7f9737293640 1 --2- 172.21.15.5:0/358203522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97300cb280 0x7f97300ae8a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.790+0000 7f9737293640 1 --2- 172.21.15.5:0/358203522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9730069b40 0x7f973015de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.790+0000 7f9737293640 1 -- 172.21.15.5:0/358203522 >> 172.21.15.5:0/358203522 conn(0x7f97300ce980 msgr2=0x7f97300cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:55.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.790+0000 7f9737293640 1 -- 172.21.15.5:0/358203522 shutdown_connections 2023-07-14T12:52:55.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.790+0000 7f9737293640 1 -- 172.21.15.5:0/358203522 wait complete. 2023-07-14T12:52:55.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2023-07-14T12:52:55.823 DEBUG:teuthology.parallel:result is None 2023-07-14T12:52:55.830 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-07-14T12:52:55.830 DEBUG:teuthology.parallel:result is None 2023-07-14T12:52:55.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.814+0000 7fc996ffd640 1 -- 172.21.15.5:0/216859621 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc990005510 con 0x7fc9b00c98e0 2023-07-14T12:52:55.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-07-14T12:52:55.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.814+0000 7fc9ad7fa640 1 -- 172.21.15.5:0/216859621 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc9a40ef680 con 0x7fc9b00c98e0 2023-07-14T12:52:55.841 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2023-07-14T12:52:55.841 DEBUG:teuthology.parallel:result is None 2023-07-14T12:52:55.842 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-07-14T12:52:55.842 DEBUG:teuthology.parallel:result is None 2023-07-14T12:52:55.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.814+0000 7fc996ffd640 1 -- 172.21.15.5:0/216859621 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc998066400 msgr2=0x7fc9980688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.814+0000 7fc996ffd640 1 --2- 172.21.15.5:0/216859621 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc998066400 0x7fc9980688b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc9a00099b0 tx=0x7fc9a0009190 comp rx=0 tx=0).stop 2023-07-14T12:52:55.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.814+0000 7fc996ffd640 1 -- 172.21.15.5:0/216859621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9b00c98e0 msgr2=0x7fc9b015eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.814+0000 7fc996ffd640 1 --2- 172.21.15.5:0/216859621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9b00c98e0 0x7fc9b015eeb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40ab000 tx=0x7fc9a401ad50 comp rx=0 tx=0).stop 2023-07-14T12:52:55.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.814+0000 7fc996ffd640 1 -- 172.21.15.5:0/216859621 shutdown_connections 2023-07-14T12:52:55.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.814+0000 7fc996ffd640 1 --2- 172.21.15.5:0/216859621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9b0160030 0x7fc9b015f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.814+0000 7fc996ffd640 1 --2- 172.21.15.5:0/216859621 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc998066400 0x7fc9980688b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.814+0000 7fc996ffd640 1 --2- 172.21.15.5:0/216859621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9b00c98e0 0x7fc9b015eeb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.814+0000 7fc996ffd640 1 --2- 172.21.15.5:0/216859621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9b0069430 0x7fc9b00a9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.814+0000 7fc996ffd640 1 -- 172.21.15.5:0/216859621 >> 172.21.15.5:0/216859621 conn(0x7fc9b00ce980 msgr2=0x7fc9b006eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:55.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.814+0000 7fc996ffd640 1 -- 172.21.15.5:0/216859621 shutdown_connections 2023-07-14T12:52:55.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.814+0000 7fc996ffd640 1 -- 172.21.15.5:0/216859621 wait complete. 2023-07-14T12:52:55.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.826+0000 7f18dc6f9640 1 -- 172.21.15.5:0/3671456964 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f18bc005510 con 0x7f18cc03a9e0 2023-07-14T12:52:55.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.826+0000 7f18caffd640 1 -- 172.21.15.5:0/3671456964 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f18d0015020 con 0x7f18cc03a9e0 2023-07-14T12:52:55.852 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-07-14T12:52:55.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.830+0000 7f18dc6f9640 1 -- 172.21.15.5:0/3671456964 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f18b8066250 msgr2=0x7f18b8068700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.830+0000 7f18dc6f9640 1 --2- 172.21.15.5:0/3671456964 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f18b8066250 0x7f18b8068700 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f18d4000b70 tx=0x7f18d408c040 comp rx=0 tx=0).stop 2023-07-14T12:52:55.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.830+0000 7f18dc6f9640 1 -- 172.21.15.5:0/3671456964 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18cc03a9e0 msgr2=0x7f18cc0cfa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:55.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.830+0000 7f18dc6f9640 1 --2- 172.21.15.5:0/3671456964 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18cc03a9e0 0x7f18cc0cfa60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f18d000b4a0 tx=0x7f18d000b8a0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.830+0000 7f18dc6f9640 1 -- 172.21.15.5:0/3671456964 shutdown_connections 2023-07-14T12:52:55.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.830+0000 7f18dc6f9640 1 --2- 172.21.15.5:0/3671456964 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f18b8066250 0x7f18b8068700 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.830+0000 7f18dc6f9640 1 --2- 172.21.15.5:0/3671456964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18cc057440 0x7f18cc0e5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.830+0000 7f18dc6f9640 1 --2- 172.21.15.5:0/3671456964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18cc03adb0 0x7f18cc0526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.830+0000 7f18dc6f9640 1 --2- 172.21.15.5:0/3671456964 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18cc03a9e0 0x7f18cc0cfa60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:55.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.830+0000 7f18dc6f9640 1 -- 172.21.15.5:0/3671456964 >> 172.21.15.5:0/3671456964 conn(0x7f18cc058f60 msgr2=0x7f18cc039190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:55.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.830+0000 7f18dc6f9640 1 -- 172.21.15.5:0/3671456964 shutdown_connections 2023-07-14T12:52:55.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:55.830+0000 7f18dc6f9640 1 -- 172.21.15.5:0/3671456964 wait complete. 2023-07-14T12:52:55.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-07-14T12:52:55.862 DEBUG:teuthology.parallel:result is None 2023-07-14T12:52:55.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-07-14T12:52:55.875 DEBUG:teuthology.parallel:result is None 2023-07-14T12:52:55.875 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-14T12:52:55.875 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T12:52:56.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.034+0000 7f32cc4ca640 1 Processor -- start 2023-07-14T12:52:56.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.034+0000 7f32cc4ca640 1 -- start start 2023-07-14T12:52:56.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.034+0000 7f32cc4ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32c406a540 0x7f32c406a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:56.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.034+0000 7f32cc4ca640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f32c40cdcd0 0x7f32c40cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:56.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.034+0000 7f32cc4ca640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c406ae50 con 0x7f32c40cc980 2023-07-14T12:52:56.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.034+0000 7f32cc4ca640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c40cef10 con 0x7f32c40cdcd0 2023-07-14T12:52:56.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.034+0000 7f32cc4ca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c40cfaf0 con 0x7f32c406a540 2023-07-14T12:52:56.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.034+0000 7f32ca266640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32c406a540 0x7f32c406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:56.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.034+0000 7f32c9a65640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f32c40cdcd0 0x7f32c40cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:56.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.034+0000 7f32ca266640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32c406a540 0x7f32c406a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:55152/0 (socket says 172.21.15.5:55152) 2023-07-14T12:52:56.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.034+0000 7f32ca266640 1 -- 172.21.15.5:0/3298802625 learned_addr learned my addr 172.21.15.5:0/3298802625 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:56.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.034+0000 7f32caa67640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f32c40cc980 0x7f32c40cce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:58148/0 (socket says 172.21.15.5:58148) 2023-07-14T12:52:56.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.038+0000 7f32c9a65640 1 -- 172.21.15.5:0/3298802625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32c406a540 msgr2=0x7f32c406a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:56.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.038+0000 7f32c9a65640 1 --2- 172.21.15.5:0/3298802625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32c406a540 0x7f32c406a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:56.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.038+0000 7f32c9a65640 1 -- 172.21.15.5:0/3298802625 >> v1:172.21.15.154:6789/0 conn(0x7f32c40cc980 legacy=0x7f32c40cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:56.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.038+0000 7f32c9a65640 1 -- 172.21.15.5:0/3298802625 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c40cfdd0 con 0x7f32c40cdcd0 2023-07-14T12:52:56.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.038+0000 7f32ca266640 1 --2- 172.21.15.5:0/3298802625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32c406a540 0x7f32c406a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:52:56.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.038+0000 7f32c9264640 1 -- 172.21.15.5:0/3298802625 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1200765211 0 0) 0x7f32c406ae50 con 0x7f32c40cc980 2023-07-14T12:52:56.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.038+0000 7f32c9a65640 1 --2- 172.21.15.5:0/3298802625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32c40cdcd0 0x7f32c40cf2a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f32b40097c0 tx=0x7f32b401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75fa953e54cfe0d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:56.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.038+0000 7f32c9264640 1 -- 172.21.15.5:0/3298802625 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b40ab650 con 0x7f32c40cdcd0 2023-07-14T12:52:56.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.038+0000 7f32c9264640 1 -- 172.21.15.5:0/3298802625 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b40ab7b0 con 0x7f32c40cdcd0 2023-07-14T12:52:56.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.038+0000 7f32c9264640 1 -- 172.21.15.5:0/3298802625 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b40abb40 con 0x7f32c40cdcd0 2023-07-14T12:52:56.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.042+0000 7f32cc4ca640 1 -- 172.21.15.5:0/3298802625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32c40cdcd0 msgr2=0x7f32c40cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:56.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.042+0000 7f32cc4ca640 1 --2- 172.21.15.5:0/3298802625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32c40cdcd0 0x7f32c40cf2a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f32b40097c0 tx=0x7f32b401c450 comp rx=0 tx=0).stop 2023-07-14T12:52:56.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.042+0000 7f32cc4ca640 1 -- 172.21.15.5:0/3298802625 shutdown_connections 2023-07-14T12:52:56.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.042+0000 7f32cc4ca640 1 --2- 172.21.15.5:0/3298802625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32c40cdcd0 0x7f32c40cf2a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:56.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.042+0000 7f32cc4ca640 1 --2- 172.21.15.5:0/3298802625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32c406a540 0x7f32c406a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:56.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.042+0000 7f32cc4ca640 1 -- 172.21.15.5:0/3298802625 >> 172.21.15.5:0/3298802625 conn(0x7f32c4099490 msgr2=0x7f32c4089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:56.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.042+0000 7f32cc4ca640 1 -- 172.21.15.5:0/3298802625 shutdown_connections 2023-07-14T12:52:56.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.042+0000 7f32cc4ca640 1 -- 172.21.15.5:0/3298802625 wait complete. 2023-07-14T12:52:56.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.042+0000 7f32cc4ca640 1 Processor -- start 2023-07-14T12:52:56.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.042+0000 7f32cc4ca640 1 -- start start 2023-07-14T12:52:56.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.042+0000 7f32cc4ca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c406a540 0x7f32c4158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:56.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.042+0000 7f32cc4ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32c40cc980 0x7f32c40ad830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:56.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.042+0000 7f32cc4ca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32c40cdcd0 0x7f32c40add70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:56.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.042+0000 7f32cc4ca640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c415b400 con 0x7f32c406a540 2023-07-14T12:52:56.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.042+0000 7f32cc4ca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c4158990 con 0x7f32c40cdcd0 2023-07-14T12:52:56.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.042+0000 7f32cc4ca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c409ddd0 con 0x7f32c40cc980 2023-07-14T12:52:56.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.042+0000 7f32ca266640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c406a540 0x7f32c4158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:56.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.042+0000 7f32ca266640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c406a540 0x7f32c4158450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52924/0 (socket says 172.21.15.5:52924) 2023-07-14T12:52:56.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.042+0000 7f32ca266640 1 -- 172.21.15.5:0/2167429112 learned_addr learned my addr 172.21.15.5:0/2167429112 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:56.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.042+0000 7f32caa67640 1 --2- 172.21.15.5:0/2167429112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32c40cdcd0 0x7f32c40add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:56.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.042+0000 7f32c9a65640 1 --2- 172.21.15.5:0/2167429112 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32c40cc980 0x7f32c40ad830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:56.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.046+0000 7f32ca266640 1 -- 172.21.15.5:0/2167429112 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32c40cc980 msgr2=0x7f32c40ad830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:56.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.046+0000 7f32ca266640 1 --2- 172.21.15.5:0/2167429112 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32c40cc980 0x7f32c40ad830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:56.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.046+0000 7f32ca266640 1 -- 172.21.15.5:0/2167429112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32c40cdcd0 msgr2=0x7f32c40add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:56.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.046+0000 7f32ca266640 1 --2- 172.21.15.5:0/2167429112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32c40cdcd0 0x7f32c40add70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:56.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.046+0000 7f32ca266640 1 -- 172.21.15.5:0/2167429112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c0009480 con 0x7f32c406a540 2023-07-14T12:52:56.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.046+0000 7f32ca266640 1 --2- 172.21.15.5:0/2167429112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c406a540 0x7f32c4158450 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f32c000e980 tx=0x7f32c000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:56.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.046+0000 7f32baffd640 1 -- 172.21.15.5:0/2167429112 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c00059a0 con 0x7f32c406a540 2023-07-14T12:52:56.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.046+0000 7f32baffd640 1 -- 172.21.15.5:0/2167429112 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c0005b00 con 0x7f32c406a540 2023-07-14T12:52:56.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.046+0000 7f32cc4ca640 1 -- 172.21.15.5:0/2167429112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b4009420 con 0x7f32c406a540 2023-07-14T12:52:56.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.046+0000 7f32baffd640 1 -- 172.21.15.5:0/2167429112 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0005e90 con 0x7f32c406a540 2023-07-14T12:52:56.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.046+0000 7f32cc4ca640 1 -- 172.21.15.5:0/2167429112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c409daf0 con 0x7f32c406a540 2023-07-14T12:52:56.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.046+0000 7f32cc4ca640 1 -- 172.21.15.5:0/2167429112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c40725b0 con 0x7f32c406a540 2023-07-14T12:52:56.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.046+0000 7f32baffd640 1 -- 172.21.15.5:0/2167429112 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f32c000c9a0 con 0x7f32c406a540 2023-07-14T12:52:56.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.046+0000 7f32baffd640 1 --2- 172.21.15.5:0/2167429112 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f32a8066280 0x7f32a8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:56.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.046+0000 7f32baffd640 1 -- 172.21.15.5:0/2167429112 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f32c0084180 con 0x7f32c406a540 2023-07-14T12:52:56.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.050+0000 7f32c9a65640 1 --2- 172.21.15.5:0/2167429112 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f32a8066280 0x7f32a8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:56.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.050+0000 7f32c9a65640 1 --2- 172.21.15.5:0/2167429112 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f32a8066280 0x7f32a8068730 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f32b40af000 tx=0x7f32b40a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:56.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.050+0000 7f32baffd640 1 -- 172.21.15.5:0/2167429112 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f32c0051610 con 0x7f32c406a540 2023-07-14T12:52:56.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.202+0000 7f32cc4ca640 1 -- 172.21.15.5:0/2167429112 --> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f32c40cf7e0 con 0x7f32a8066280 2023-07-14T12:52:56.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.214+0000 7f32baffd640 1 -- 172.21.15.5:0/2167429112 <== mgr.4102 v2:172.21.15.154:6832/2736441655 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286649 (secure 0 0 0) 0x7f32b40ab920 con 0x7f32a8066280 2023-07-14T12:52:56.241 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:52:56.242 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T12:52:56.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.214+0000 7f32cc4ca640 1 -- 172.21.15.5:0/2167429112 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f32a8066280 msgr2=0x7f32a8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:56.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.214+0000 7f32cc4ca640 1 --2- 172.21.15.5:0/2167429112 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f32a8066280 0x7f32a8068730 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f32b40af000 tx=0x7f32b40a7000 comp rx=0 tx=0).stop 2023-07-14T12:52:56.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.214+0000 7f32cc4ca640 1 -- 172.21.15.5:0/2167429112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c406a540 msgr2=0x7f32c4158450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:56.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.214+0000 7f32cc4ca640 1 --2- 172.21.15.5:0/2167429112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c406a540 0x7f32c4158450 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f32c000e980 tx=0x7f32c000ee40 comp rx=0 tx=0).stop 2023-07-14T12:52:56.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.214+0000 7f32cc4ca640 1 -- 172.21.15.5:0/2167429112 shutdown_connections 2023-07-14T12:52:56.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.214+0000 7f32cc4ca640 1 --2- 172.21.15.5:0/2167429112 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f32a8066280 0x7f32a8068730 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:56.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.214+0000 7f32cc4ca640 1 --2- 172.21.15.5:0/2167429112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32c40cdcd0 0x7f32c40add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:56.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.214+0000 7f32cc4ca640 1 --2- 172.21.15.5:0/2167429112 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32c40cc980 0x7f32c40ad830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:56.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.214+0000 7f32cc4ca640 1 --2- 172.21.15.5:0/2167429112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32c406a540 0x7f32c4158450 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:56.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.214+0000 7f32cc4ca640 1 -- 172.21.15.5:0/2167429112 >> 172.21.15.5:0/2167429112 conn(0x7f32c4099490 msgr2=0x7f32c40b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:56.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.214+0000 7f32cc4ca640 1 -- 172.21.15.5:0/2167429112 shutdown_connections 2023-07-14T12:52:56.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.218+0000 7f32cc4ca640 1 -- 172.21.15.5:0/2167429112 wait complete. 2023-07-14T12:52:56.262 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-14T12:52:55.636543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235104,"kb_used_data":3104,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754739616,"statfs":{"total":773094113280,"available":772853366784,"internally_reserved":0,"allocated":3178496,"data_stored":1900214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.542264"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.334985+0000","last_change":"2023-07-14T12:52:47.109113+0000","last_active":"2023-07-14T12:52:49.334985+0000","last_peered":"2023-07-14T12:52:49.334985+0000","last_clean":"2023-07-14T12:52:49.334985+0000","last_became_active":"2023-07-14T12:52:47.107356+0000","last_became_peered":"2023-07-14T12:52:47.107356+0000","last_unstale":"2023-07-14T12:52:49.334985+0000","last_undegraded":"2023-07-14T12:52:49.334985+0000","last_fullsized":"2023-07-14T12:52:49.334985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:43.338222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578567+0000","last_change":"2023-07-14T12:52:47.119687+0000","last_active":"2023-07-14T12:52:48.578567+0000","last_peered":"2023-07-14T12:52:48.578567+0000","last_clean":"2023-07-14T12:52:48.578567+0000","last_became_active":"2023-07-14T12:52:47.119063+0000","last_became_peered":"2023-07-14T12:52:47.119063+0000","last_unstale":"2023-07-14T12:52:48.578567+0000","last_undegraded":"2023-07-14T12:52:48.578567+0000","last_fullsized":"2023-07-14T12:52:48.578567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:14:51.124935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.099281+0000","last_change":"2023-07-14T12:52:47.121019+0000","last_active":"2023-07-14T12:52:48.099281+0000","last_peered":"2023-07-14T12:52:48.099281+0000","last_clean":"2023-07-14T12:52:48.099281+0000","last_became_active":"2023-07-14T12:52:47.120756+0000","last_became_peered":"2023-07-14T12:52:47.120756+0000","last_unstale":"2023-07-14T12:52:48.099281+0000","last_undegraded":"2023-07-14T12:52:48.099281+0000","last_fullsized":"2023-07-14T12:52:48.099281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:21:01.355816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.235773+0000","last_change":"2023-07-14T12:52:47.114539+0000","last_active":"2023-07-14T12:52:49.235773+0000","last_peered":"2023-07-14T12:52:49.235773+0000","last_clean":"2023-07-14T12:52:49.235773+0000","last_became_active":"2023-07-14T12:52:47.114187+0000","last_became_peered":"2023-07-14T12:52:47.114187+0000","last_unstale":"2023-07-14T12:52:49.235773+0000","last_undegraded":"2023-07-14T12:52:49.235773+0000","last_fullsized":"2023-07-14T12:52:49.235773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:03:43.488480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.335846+0000","last_change":"2023-07-14T12:52:47.111120+0000","last_active":"2023-07-14T12:52:49.335846+0000","last_peered":"2023-07-14T12:52:49.335846+0000","last_clean":"2023-07-14T12:52:49.335846+0000","last_became_active":"2023-07-14T12:52:47.110781+0000","last_became_peered":"2023-07-14T12:52:47.110781+0000","last_unstale":"2023-07-14T12:52:49.335846+0000","last_undegraded":"2023-07-14T12:52:49.335846+0000","last_fullsized":"2023-07-14T12:52:49.335846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:30:03.280675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.098276+0000","last_change":"2023-07-14T12:52:47.111259+0000","last_active":"2023-07-14T12:52:48.098276+0000","last_peered":"2023-07-14T12:52:48.098276+0000","last_clean":"2023-07-14T12:52:48.098276+0000","last_became_active":"2023-07-14T12:52:47.111023+0000","last_became_peered":"2023-07-14T12:52:47.111023+0000","last_unstale":"2023-07-14T12:52:48.098276+0000","last_undegraded":"2023-07-14T12:52:48.098276+0000","last_fullsized":"2023-07-14T12:52:48.098276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:37:59.704093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.053045+0000","last_change":"2023-07-14T12:52:47.122189+0000","last_active":"2023-07-14T12:52:49.053045+0000","last_peered":"2023-07-14T12:52:49.053045+0000","last_clean":"2023-07-14T12:52:49.053045+0000","last_became_active":"2023-07-14T12:52:47.121465+0000","last_became_peered":"2023-07-14T12:52:47.121465+0000","last_unstale":"2023-07-14T12:52:49.053045+0000","last_undegraded":"2023-07-14T12:52:49.053045+0000","last_fullsized":"2023-07-14T12:52:49.053045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:18:16.031557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578201+0000","last_change":"2023-07-14T12:52:47.123614+0000","last_active":"2023-07-14T12:52:48.578201+0000","last_peered":"2023-07-14T12:52:48.578201+0000","last_clean":"2023-07-14T12:52:48.578201+0000","last_became_active":"2023-07-14T12:52:47.123147+0000","last_became_peered":"2023-07-14T12:52:47.123147+0000","last_unstale":"2023-07-14T12:52:48.578201+0000","last_undegraded":"2023-07-14T12:52:48.578201+0000","last_fullsized":"2023-07-14T12:52:48.578201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:08:09.613480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.335886+0000","last_change":"2023-07-14T12:52:47.123993+0000","last_active":"2023-07-14T12:52:49.335886+0000","last_peered":"2023-07-14T12:52:49.335886+0000","last_clean":"2023-07-14T12:52:49.335886+0000","last_became_active":"2023-07-14T12:52:47.123709+0000","last_became_peered":"2023-07-14T12:52:47.123709+0000","last_unstale":"2023-07-14T12:52:49.335886+0000","last_undegraded":"2023-07-14T12:52:49.335886+0000","last_fullsized":"2023-07-14T12:52:49.335886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:34.490036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578587+0000","last_change":"2023-07-14T12:52:47.112624+0000","last_active":"2023-07-14T12:52:48.578587+0000","last_peered":"2023-07-14T12:52:48.578587+0000","last_clean":"2023-07-14T12:52:48.578587+0000","last_became_active":"2023-07-14T12:52:47.112322+0000","last_became_peered":"2023-07-14T12:52:47.112322+0000","last_unstale":"2023-07-14T12:52:48.578587+0000","last_undegraded":"2023-07-14T12:52:48.578587+0000","last_fullsized":"2023-07-14T12:52:48.578587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:49:08.512214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.099239+0000","last_change":"2023-07-14T12:52:47.118589+0000","last_active":"2023-07-14T12:52:48.099239+0000","last_peered":"2023-07-14T12:52:48.099239+0000","last_clean":"2023-07-14T12:52:48.099239+0000","last_became_active":"2023-07-14T12:52:47.118256+0000","last_became_peered":"2023-07-14T12:52:47.118256+0000","last_unstale":"2023-07-14T12:52:48.099239+0000","last_undegraded":"2023-07-14T12:52:48.099239+0000","last_fullsized":"2023-07-14T12:52:48.099239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:49:39.248214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.334959+0000","last_change":"2023-07-14T12:52:47.118304+0000","last_active":"2023-07-14T12:52:49.334959+0000","last_peered":"2023-07-14T12:52:49.334959+0000","last_clean":"2023-07-14T12:52:49.334959+0000","last_became_active":"2023-07-14T12:52:47.117930+0000","last_became_peered":"2023-07-14T12:52:47.117930+0000","last_unstale":"2023-07-14T12:52:49.334959+0000","last_undegraded":"2023-07-14T12:52:49.334959+0000","last_fullsized":"2023-07-14T12:52:49.334959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:24.288374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.334811+0000","last_change":"2023-07-14T12:52:47.108380+0000","last_active":"2023-07-14T12:52:49.334811+0000","last_peered":"2023-07-14T12:52:49.334811+0000","last_clean":"2023-07-14T12:52:49.334811+0000","last_became_active":"2023-07-14T12:52:47.107936+0000","last_became_peered":"2023-07-14T12:52:47.107936+0000","last_unstale":"2023-07-14T12:52:49.334811+0000","last_undegraded":"2023-07-14T12:52:49.334811+0000","last_fullsized":"2023-07-14T12:52:49.334811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:03:43.488480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578347+0000","last_change":"2023-07-14T12:52:47.111677+0000","last_active":"2023-07-14T12:52:48.578347+0000","last_peered":"2023-07-14T12:52:48.578347+0000","last_clean":"2023-07-14T12:52:48.578347+0000","last_became_active":"2023-07-14T12:52:47.111411+0000","last_became_peered":"2023-07-14T12:52:47.111411+0000","last_unstale":"2023-07-14T12:52:48.578347+0000","last_undegraded":"2023-07-14T12:52:48.578347+0000","last_fullsized":"2023-07-14T12:52:48.578347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:45:22.385049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.053104+0000","last_change":"2023-07-14T12:52:47.122345+0000","last_active":"2023-07-14T12:52:49.053104+0000","last_peered":"2023-07-14T12:52:49.053104+0000","last_clean":"2023-07-14T12:52:49.053104+0000","last_became_active":"2023-07-14T12:52:47.121885+0000","last_became_peered":"2023-07-14T12:52:47.121885+0000","last_unstale":"2023-07-14T12:52:49.053104+0000","last_undegraded":"2023-07-14T12:52:49.053104+0000","last_fullsized":"2023-07-14T12:52:49.053104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:27:19.463584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.098097+0000","last_change":"2023-07-14T12:52:47.107126+0000","last_active":"2023-07-14T12:52:48.098097+0000","last_peered":"2023-07-14T12:52:48.098097+0000","last_clean":"2023-07-14T12:52:48.098097+0000","last_became_active":"2023-07-14T12:52:47.106204+0000","last_became_peered":"2023-07-14T12:52:47.106204+0000","last_unstale":"2023-07-14T12:52:48.098097+0000","last_undegraded":"2023-07-14T12:52:48.098097+0000","last_fullsized":"2023-07-14T12:52:48.098097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:46.115861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.335946+0000","last_change":"2023-07-14T12:52:47.109761+0000","last_active":"2023-07-14T12:52:49.335946+0000","last_peered":"2023-07-14T12:52:49.335946+0000","last_clean":"2023-07-14T12:52:49.335946+0000","last_became_active":"2023-07-14T12:52:47.109438+0000","last_became_peered":"2023-07-14T12:52:47.109438+0000","last_unstale":"2023-07-14T12:52:49.335946+0000","last_undegraded":"2023-07-14T12:52:49.335946+0000","last_fullsized":"2023-07-14T12:52:49.335946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:32:48.443355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.099133+0000","last_change":"2023-07-14T12:52:47.126985+0000","last_active":"2023-07-14T12:52:48.099133+0000","last_peered":"2023-07-14T12:52:48.099133+0000","last_clean":"2023-07-14T12:52:48.099133+0000","last_became_active":"2023-07-14T12:52:47.126696+0000","last_became_peered":"2023-07-14T12:52:47.126696+0000","last_unstale":"2023-07-14T12:52:48.099133+0000","last_undegraded":"2023-07-14T12:52:48.099133+0000","last_fullsized":"2023-07-14T12:52:48.099133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:45:39.014447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.335072+0000","last_change":"2023-07-14T12:52:47.115418+0000","last_active":"2023-07-14T12:52:49.335072+0000","last_peered":"2023-07-14T12:52:49.335072+0000","last_clean":"2023-07-14T12:52:49.335072+0000","last_became_active":"2023-07-14T12:52:47.115115+0000","last_became_peered":"2023-07-14T12:52:47.115115+0000","last_unstale":"2023-07-14T12:52:49.335072+0000","last_undegraded":"2023-07-14T12:52:49.335072+0000","last_fullsized":"2023-07-14T12:52:49.335072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:30.872502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.098316+0000","last_change":"2023-07-14T12:52:47.116335+0000","last_active":"2023-07-14T12:52:48.098316+0000","last_peered":"2023-07-14T12:52:48.098316+0000","last_clean":"2023-07-14T12:52:48.098316+0000","last_became_active":"2023-07-14T12:52:47.115763+0000","last_became_peered":"2023-07-14T12:52:47.115763+0000","last_unstale":"2023-07-14T12:52:48.098316+0000","last_undegraded":"2023-07-14T12:52:48.098316+0000","last_fullsized":"2023-07-14T12:52:48.098316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:30:03.280675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.053063+0000","last_change":"2023-07-14T12:52:47.124746+0000","last_active":"2023-07-14T12:52:49.053063+0000","last_peered":"2023-07-14T12:52:49.053063+0000","last_clean":"2023-07-14T12:52:49.053063+0000","last_became_active":"2023-07-14T12:52:47.124450+0000","last_became_peered":"2023-07-14T12:52:47.124450+0000","last_unstale":"2023-07-14T12:52:49.053063+0000","last_undegraded":"2023-07-14T12:52:49.053063+0000","last_fullsized":"2023-07-14T12:52:49.053063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:49:08.512214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.335118+0000","last_change":"2023-07-14T12:52:47.118958+0000","last_active":"2023-07-14T12:52:49.335118+0000","last_peered":"2023-07-14T12:52:49.335118+0000","last_clean":"2023-07-14T12:52:49.335118+0000","last_became_active":"2023-07-14T12:52:47.118640+0000","last_became_peered":"2023-07-14T12:52:47.118640+0000","last_unstale":"2023-07-14T12:52:49.335118+0000","last_undegraded":"2023-07-14T12:52:49.335118+0000","last_fullsized":"2023-07-14T12:52:49.335118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:01:37.466387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.096018+0000","last_change":"2023-07-14T12:52:47.112201+0000","last_active":"2023-07-14T12:52:48.096018+0000","last_peered":"2023-07-14T12:52:48.096018+0000","last_clean":"2023-07-14T12:52:48.096018+0000","last_became_active":"2023-07-14T12:52:47.111873+0000","last_became_peered":"2023-07-14T12:52:47.111873+0000","last_unstale":"2023-07-14T12:52:48.096018+0000","last_undegraded":"2023-07-14T12:52:48.096018+0000","last_fullsized":"2023-07-14T12:52:48.096018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:46.115861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.053227+0000","last_change":"2023-07-14T12:52:47.114122+0000","last_active":"2023-07-14T12:52:49.053227+0000","last_peered":"2023-07-14T12:52:49.053227+0000","last_clean":"2023-07-14T12:52:49.053227+0000","last_became_active":"2023-07-14T12:52:47.113796+0000","last_became_peered":"2023-07-14T12:52:47.113796+0000","last_unstale":"2023-07-14T12:52:49.053227+0000","last_undegraded":"2023-07-14T12:52:49.053227+0000","last_fullsized":"2023-07-14T12:52:49.053227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:06:17.091034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.559215+0000","last_change":"2023-07-14T12:52:47.116443+0000","last_active":"2023-07-14T12:52:48.559215+0000","last_peered":"2023-07-14T12:52:48.559215+0000","last_clean":"2023-07-14T12:52:48.559215+0000","last_became_active":"2023-07-14T12:52:47.116134+0000","last_became_peered":"2023-07-14T12:52:47.116134+0000","last_unstale":"2023-07-14T12:52:48.559215+0000","last_undegraded":"2023-07-14T12:52:48.559215+0000","last_fullsized":"2023-07-14T12:52:48.559215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:18:16.031557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.559236+0000","last_change":"2023-07-14T12:52:47.126857+0000","last_active":"2023-07-14T12:52:48.559236+0000","last_peered":"2023-07-14T12:52:48.559236+0000","last_clean":"2023-07-14T12:52:48.559236+0000","last_became_active":"2023-07-14T12:52:47.126551+0000","last_became_peered":"2023-07-14T12:52:47.126551+0000","last_unstale":"2023-07-14T12:52:48.559236+0000","last_undegraded":"2023-07-14T12:52:48.559236+0000","last_fullsized":"2023-07-14T12:52:48.559236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:49:08.512214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578420+0000","last_change":"2023-07-14T12:52:47.116313+0000","last_active":"2023-07-14T12:52:48.578420+0000","last_peered":"2023-07-14T12:52:48.578420+0000","last_clean":"2023-07-14T12:52:48.578420+0000","last_became_active":"2023-07-14T12:52:47.116052+0000","last_became_peered":"2023-07-14T12:52:47.116052+0000","last_unstale":"2023-07-14T12:52:48.578420+0000","last_undegraded":"2023-07-14T12:52:48.578420+0000","last_fullsized":"2023-07-14T12:52:48.578420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:20:39.785240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.559199+0000","last_change":"2023-07-14T12:52:47.113963+0000","last_active":"2023-07-14T12:52:48.559199+0000","last_peered":"2023-07-14T12:52:48.559199+0000","last_clean":"2023-07-14T12:52:48.559199+0000","last_became_active":"2023-07-14T12:52:47.113636+0000","last_became_peered":"2023-07-14T12:52:47.113636+0000","last_unstale":"2023-07-14T12:52:48.559199+0000","last_undegraded":"2023-07-14T12:52:48.559199+0000","last_fullsized":"2023-07-14T12:52:48.559199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:14:51.124935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.096450+0000","last_change":"2023-07-14T12:52:47.114586+0000","last_active":"2023-07-14T12:52:48.096450+0000","last_peered":"2023-07-14T12:52:48.096450+0000","last_clean":"2023-07-14T12:52:48.096450+0000","last_became_active":"2023-07-14T12:52:47.114296+0000","last_became_peered":"2023-07-14T12:52:47.114296+0000","last_unstale":"2023-07-14T12:52:48.096450+0000","last_undegraded":"2023-07-14T12:52:48.096450+0000","last_fullsized":"2023-07-14T12:52:48.096450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:34.490036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.099214+0000","last_change":"2023-07-14T12:52:47.118226+0000","last_active":"2023-07-14T12:52:48.099214+0000","last_peered":"2023-07-14T12:52:48.099214+0000","last_clean":"2023-07-14T12:52:48.099214+0000","last_became_active":"2023-07-14T12:52:47.117714+0000","last_became_peered":"2023-07-14T12:52:47.117714+0000","last_unstale":"2023-07-14T12:52:48.099214+0000","last_undegraded":"2023-07-14T12:52:48.099214+0000","last_fullsized":"2023-07-14T12:52:48.099214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:46:49.508817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.096018+0000","last_change":"2023-07-14T12:52:47.120308+0000","last_active":"2023-07-14T12:52:48.096018+0000","last_peered":"2023-07-14T12:52:48.096018+0000","last_clean":"2023-07-14T12:52:48.096018+0000","last_became_active":"2023-07-14T12:52:47.119847+0000","last_became_peered":"2023-07-14T12:52:47.119847+0000","last_unstale":"2023-07-14T12:52:48.096018+0000","last_undegraded":"2023-07-14T12:52:48.096018+0000","last_fullsized":"2023-07-14T12:52:48.096018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:50:56.655801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.235609+0000","last_change":"2023-07-14T12:52:47.127275+0000","last_active":"2023-07-14T12:52:49.235609+0000","last_peered":"2023-07-14T12:52:49.235609+0000","last_clean":"2023-07-14T12:52:49.235609+0000","last_became_active":"2023-07-14T12:52:47.126883+0000","last_became_peered":"2023-07-14T12:52:47.126883+0000","last_unstale":"2023-07-14T12:52:49.235609+0000","last_undegraded":"2023-07-14T12:52:49.235609+0000","last_fullsized":"2023-07-14T12:52:49.235609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:26:00.737284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.096706+0000","last_change":"2023-07-14T12:52:47.121988+0000","last_active":"2023-07-14T12:52:48.096706+0000","last_peered":"2023-07-14T12:52:48.096706+0000","last_clean":"2023-07-14T12:52:48.096706+0000","last_became_active":"2023-07-14T12:52:47.121687+0000","last_became_peered":"2023-07-14T12:52:47.121687+0000","last_unstale":"2023-07-14T12:52:48.096706+0000","last_undegraded":"2023-07-14T12:52:48.096706+0000","last_fullsized":"2023-07-14T12:52:48.096706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:14:51.124935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.053276+0000","last_change":"2023-07-14T12:52:46.094170+0000","last_active":"2023-07-14T12:52:49.053276+0000","last_peered":"2023-07-14T12:52:49.053276+0000","last_clean":"2023-07-14T12:52:49.053276+0000","last_became_active":"2023-07-14T12:52:46.093847+0000","last_became_peered":"2023-07-14T12:52:46.093847+0000","last_unstale":"2023-07-14T12:52:49.053276+0000","last_undegraded":"2023-07-14T12:52:49.053276+0000","last_fullsized":"2023-07-14T12:52:49.053276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:46:48.497711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578591+0000","last_change":"2023-07-14T12:52:47.117512+0000","last_active":"2023-07-14T12:52:48.578591+0000","last_peered":"2023-07-14T12:52:48.578591+0000","last_clean":"2023-07-14T12:52:48.578591+0000","last_became_active":"2023-07-14T12:52:47.117268+0000","last_became_peered":"2023-07-14T12:52:47.117268+0000","last_unstale":"2023-07-14T12:52:48.578591+0000","last_undegraded":"2023-07-14T12:52:48.578591+0000","last_fullsized":"2023-07-14T12:52:48.578591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:18:16.031557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.335126+0000","last_change":"2023-07-14T12:52:46.086633+0000","last_active":"2023-07-14T12:52:49.335126+0000","last_peered":"2023-07-14T12:52:49.335126+0000","last_clean":"2023-07-14T12:52:49.335126+0000","last_became_active":"2023-07-14T12:52:46.084673+0000","last_became_peered":"2023-07-14T12:52:46.084673+0000","last_unstale":"2023-07-14T12:52:49.335126+0000","last_undegraded":"2023-07-14T12:52:49.335126+0000","last_fullsized":"2023-07-14T12:52:49.335126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:23:36.193943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.336053+0000","last_change":"2023-07-14T12:52:47.111606+0000","last_active":"2023-07-14T12:52:49.336053+0000","last_peered":"2023-07-14T12:52:49.336053+0000","last_clean":"2023-07-14T12:52:49.336053+0000","last_became_active":"2023-07-14T12:52:47.111132+0000","last_became_peered":"2023-07-14T12:52:47.111132+0000","last_unstale":"2023-07-14T12:52:49.336053+0000","last_undegraded":"2023-07-14T12:52:49.336053+0000","last_fullsized":"2023-07-14T12:52:49.336053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:14:51.124935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.053223+0000","last_change":"2023-07-14T12:52:46.094259+0000","last_active":"2023-07-14T12:52:49.053223+0000","last_peered":"2023-07-14T12:52:49.053223+0000","last_clean":"2023-07-14T12:52:49.053223+0000","last_became_active":"2023-07-14T12:52:46.093946+0000","last_became_peered":"2023-07-14T12:52:46.093946+0000","last_unstale":"2023-07-14T12:52:49.053223+0000","last_undegraded":"2023-07-14T12:52:49.053223+0000","last_fullsized":"2023-07-14T12:52:49.053223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:49:38.237108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.097011+0000","last_change":"2023-07-14T12:52:47.109858+0000","last_active":"2023-07-14T12:52:48.097011+0000","last_peered":"2023-07-14T12:52:48.097011+0000","last_clean":"2023-07-14T12:52:48.097011+0000","last_became_active":"2023-07-14T12:52:47.109547+0000","last_became_peered":"2023-07-14T12:52:47.109547+0000","last_unstale":"2023-07-14T12:52:48.097011+0000","last_undegraded":"2023-07-14T12:52:48.097011+0000","last_fullsized":"2023-07-14T12:52:48.097011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:27:19.463584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.235838+0000","last_change":"2023-07-14T12:52:46.083042+0000","last_active":"2023-07-14T12:52:49.235838+0000","last_peered":"2023-07-14T12:52:49.235838+0000","last_clean":"2023-07-14T12:52:49.235838+0000","last_became_active":"2023-07-14T12:52:46.082506+0000","last_became_peered":"2023-07-14T12:52:46.082506+0000","last_unstale":"2023-07-14T12:52:49.235838+0000","last_undegraded":"2023-07-14T12:52:49.235838+0000","last_fullsized":"2023-07-14T12:52:49.235838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:29.861396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.053554+0000","last_change":"2023-07-14T12:52:46.088541+0000","last_active":"2023-07-14T12:52:49.053554+0000","last_peered":"2023-07-14T12:52:49.053554+0000","last_clean":"2023-07-14T12:52:49.053554+0000","last_became_active":"2023-07-14T12:52:46.088185+0000","last_became_peered":"2023-07-14T12:52:46.088185+0000","last_unstale":"2023-07-14T12:52:49.053554+0000","last_undegraded":"2023-07-14T12:52:49.053554+0000","last_fullsized":"2023-07-14T12:52:49.053554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:57.775215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578183+0000","last_change":"2023-07-14T12:52:47.115030+0000","last_active":"2023-07-14T12:52:48.578183+0000","last_peered":"2023-07-14T12:52:48.578183+0000","last_clean":"2023-07-14T12:52:48.578183+0000","last_became_active":"2023-07-14T12:52:47.114732+0000","last_became_peered":"2023-07-14T12:52:47.114732+0000","last_unstale":"2023-07-14T12:52:48.578183+0000","last_undegraded":"2023-07-14T12:52:48.578183+0000","last_fullsized":"2023-07-14T12:52:48.578183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:37:59.704093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.053486+0000","last_change":"2023-07-14T12:52:46.089168+0000","last_active":"2023-07-14T12:52:49.053486+0000","last_peered":"2023-07-14T12:52:49.053486+0000","last_clean":"2023-07-14T12:52:49.053486+0000","last_became_active":"2023-07-14T12:52:46.088899+0000","last_became_peered":"2023-07-14T12:52:46.088899+0000","last_unstale":"2023-07-14T12:52:49.053486+0000","last_undegraded":"2023-07-14T12:52:49.053486+0000","last_fullsized":"2023-07-14T12:52:49.053486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:21:00.344710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.098194+0000","last_change":"2023-07-14T12:52:47.113901+0000","last_active":"2023-07-14T12:52:48.098194+0000","last_peered":"2023-07-14T12:52:48.098194+0000","last_clean":"2023-07-14T12:52:48.098194+0000","last_became_active":"2023-07-14T12:52:47.113606+0000","last_became_peered":"2023-07-14T12:52:47.113606+0000","last_unstale":"2023-07-14T12:52:48.098194+0000","last_undegraded":"2023-07-14T12:52:48.098194+0000","last_fullsized":"2023-07-14T12:52:48.098194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:45:17.631684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.053233+0000","last_change":"2023-07-14T12:52:46.091961+0000","last_active":"2023-07-14T12:52:49.053233+0000","last_peered":"2023-07-14T12:52:49.053233+0000","last_clean":"2023-07-14T12:52:49.053233+0000","last_became_active":"2023-07-14T12:52:46.091673+0000","last_became_peered":"2023-07-14T12:52:46.091673+0000","last_unstale":"2023-07-14T12:52:49.053233+0000","last_undegraded":"2023-07-14T12:52:49.053233+0000","last_fullsized":"2023-07-14T12:52:49.053233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:45:38.003340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.235848+0000","last_change":"2023-07-14T12:52:47.120755+0000","last_active":"2023-07-14T12:52:49.235848+0000","last_peered":"2023-07-14T12:52:49.235848+0000","last_clean":"2023-07-14T12:52:49.235848+0000","last_became_active":"2023-07-14T12:52:47.120428+0000","last_became_peered":"2023-07-14T12:52:47.120428+0000","last_unstale":"2023-07-14T12:52:49.235848+0000","last_undegraded":"2023-07-14T12:52:49.235848+0000","last_fullsized":"2023-07-14T12:52:49.235848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:39:09.060324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578457+0000","last_change":"2023-07-14T12:52:46.081037+0000","last_active":"2023-07-14T12:52:48.578457+0000","last_peered":"2023-07-14T12:52:48.578457+0000","last_clean":"2023-07-14T12:52:48.578457+0000","last_became_active":"2023-07-14T12:52:46.080737+0000","last_became_peered":"2023-07-14T12:52:46.080737+0000","last_unstale":"2023-07-14T12:52:48.578457+0000","last_undegraded":"2023-07-14T12:52:48.578457+0000","last_fullsized":"2023-07-14T12:52:48.578457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:46:00.245475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.335654+0000","last_change":"2023-07-14T12:52:47.120358+0000","last_active":"2023-07-14T12:52:49.335654+0000","last_peered":"2023-07-14T12:52:49.335654+0000","last_clean":"2023-07-14T12:52:49.335654+0000","last_became_active":"2023-07-14T12:52:47.119985+0000","last_became_peered":"2023-07-14T12:52:47.119985+0000","last_unstale":"2023-07-14T12:52:49.335654+0000","last_undegraded":"2023-07-14T12:52:49.335654+0000","last_fullsized":"2023-07-14T12:52:49.335654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:45:17.631684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.096492+0000","last_change":"2023-07-14T12:52:46.085362+0000","last_active":"2023-07-14T12:52:48.096492+0000","last_peered":"2023-07-14T12:52:48.096492+0000","last_clean":"2023-07-14T12:52:48.096492+0000","last_became_active":"2023-07-14T12:52:46.084995+0000","last_became_peered":"2023-07-14T12:52:46.084995+0000","last_unstale":"2023-07-14T12:52:48.096492+0000","last_undegraded":"2023-07-14T12:52:48.096492+0000","last_fullsized":"2023-07-14T12:52:48.096492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:32:47.432248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.098831+0000","last_change":"2023-07-14T12:52:47.116159+0000","last_active":"2023-07-14T12:52:48.098831+0000","last_peered":"2023-07-14T12:52:48.098831+0000","last_clean":"2023-07-14T12:52:48.098831+0000","last_became_active":"2023-07-14T12:52:47.115435+0000","last_became_peered":"2023-07-14T12:52:47.115435+0000","last_unstale":"2023-07-14T12:52:48.098831+0000","last_undegraded":"2023-07-14T12:52:48.098831+0000","last_fullsized":"2023-07-14T12:52:48.098831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:18:16.031557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.235811+0000","last_change":"2023-07-14T12:52:46.093095+0000","last_active":"2023-07-14T12:52:49.235811+0000","last_peered":"2023-07-14T12:52:49.235811+0000","last_clean":"2023-07-14T12:52:49.235811+0000","last_became_active":"2023-07-14T12:52:46.092806+0000","last_became_peered":"2023-07-14T12:52:46.092806+0000","last_unstale":"2023-07-14T12:52:49.235811+0000","last_undegraded":"2023-07-14T12:52:49.235811+0000","last_fullsized":"2023-07-14T12:52:49.235811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:23.277268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.099359+0000","last_change":"2023-07-14T12:52:47.117743+0000","last_active":"2023-07-14T12:52:48.099359+0000","last_peered":"2023-07-14T12:52:48.099359+0000","last_clean":"2023-07-14T12:52:48.099359+0000","last_became_active":"2023-07-14T12:52:47.117463+0000","last_became_peered":"2023-07-14T12:52:47.117463+0000","last_unstale":"2023-07-14T12:52:48.099359+0000","last_undegraded":"2023-07-14T12:52:48.099359+0000","last_fullsized":"2023-07-14T12:52:48.099359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:24:10.521420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.098477+0000","last_change":"2023-07-14T12:52:46.084899+0000","last_active":"2023-07-14T12:52:48.098477+0000","last_peered":"2023-07-14T12:52:48.098477+0000","last_clean":"2023-07-14T12:52:48.098477+0000","last_became_active":"2023-07-14T12:52:46.084636+0000","last_became_peered":"2023-07-14T12:52:46.084636+0000","last_unstale":"2023-07-14T12:52:48.098477+0000","last_undegraded":"2023-07-14T12:52:48.098477+0000","last_fullsized":"2023-07-14T12:52:48.098477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:45:21.373943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.099117+0000","last_change":"2023-07-14T12:52:47.114756+0000","last_active":"2023-07-14T12:52:48.099117+0000","last_peered":"2023-07-14T12:52:48.099117+0000","last_clean":"2023-07-14T12:52:48.099117+0000","last_became_active":"2023-07-14T12:52:47.114480+0000","last_became_peered":"2023-07-14T12:52:47.114480+0000","last_unstale":"2023-07-14T12:52:48.099117+0000","last_undegraded":"2023-07-14T12:52:48.099117+0000","last_fullsized":"2023-07-14T12:52:48.099117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:06:17.091034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.096213+0000","last_change":"2023-07-14T12:52:46.090947+0000","last_active":"2023-07-14T12:52:48.096213+0000","last_peered":"2023-07-14T12:52:48.096213+0000","last_clean":"2023-07-14T12:52:48.096213+0000","last_became_active":"2023-07-14T12:52:46.090670+0000","last_became_peered":"2023-07-14T12:52:46.090670+0000","last_unstale":"2023-07-14T12:52:48.096213+0000","last_undegraded":"2023-07-14T12:52:48.096213+0000","last_fullsized":"2023-07-14T12:52:48.096213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:30:02.269569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.559266+0000","last_change":"2023-07-14T12:52:47.124181+0000","last_active":"2023-07-14T12:52:48.559266+0000","last_peered":"2023-07-14T12:52:48.559266+0000","last_clean":"2023-07-14T12:52:48.559266+0000","last_became_active":"2023-07-14T12:52:47.123815+0000","last_became_peered":"2023-07-14T12:52:47.123815+0000","last_unstale":"2023-07-14T12:52:48.559266+0000","last_undegraded":"2023-07-14T12:52:48.559266+0000","last_fullsized":"2023-07-14T12:52:48.559266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:27:19.463584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.053536+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T12:52:49.053536+0000","last_peered":"2023-07-14T12:52:49.053536+0000","last_clean":"2023-07-14T12:52:49.053536+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T12:52:49.053536+0000","last_undegraded":"2023-07-14T12:52:49.053536+0000","last_fullsized":"2023-07-14T12:52:49.053536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:22:41.635255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578324+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T12:52:48.578324+0000","last_peered":"2023-07-14T12:52:48.578324+0000","last_clean":"2023-07-14T12:52:48.578324+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T12:52:48.578324+0000","last_undegraded":"2023-07-14T12:52:48.578324+0000","last_fullsized":"2023-07-14T12:52:48.578324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:28.445614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.096574+0000","last_change":"2023-07-14T12:52:46.083051+0000","last_active":"2023-07-14T12:52:48.096574+0000","last_peered":"2023-07-14T12:52:48.096574+0000","last_clean":"2023-07-14T12:52:48.096574+0000","last_became_active":"2023-07-14T12:52:46.082304+0000","last_became_peered":"2023-07-14T12:52:46.082304+0000","last_unstale":"2023-07-14T12:52:48.096574+0000","last_undegraded":"2023-07-14T12:52:48.096574+0000","last_fullsized":"2023-07-14T12:52:48.096574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:20:38.774133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.235809+0000","last_change":"2023-07-14T12:52:47.122248+0000","last_active":"2023-07-14T12:52:49.235809+0000","last_peered":"2023-07-14T12:52:49.235809+0000","last_clean":"2023-07-14T12:52:49.235809+0000","last_became_active":"2023-07-14T12:52:47.121773+0000","last_became_peered":"2023-07-14T12:52:47.121773+0000","last_unstale":"2023-07-14T12:52:49.235809+0000","last_undegraded":"2023-07-14T12:52:49.235809+0000","last_fullsized":"2023-07-14T12:52:49.235809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:43.338222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.052830+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T12:52:49.052830+0000","last_peered":"2023-07-14T12:52:49.052830+0000","last_clean":"2023-07-14T12:52:49.052830+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T12:52:49.052830+0000","last_undegraded":"2023-07-14T12:52:49.052830+0000","last_fullsized":"2023-07-14T12:52:49.052830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:14:45.080513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.335425+0000","last_change":"2023-07-14T12:52:46.093346+0000","last_active":"2023-07-14T12:52:49.335425+0000","last_peered":"2023-07-14T12:52:49.335425+0000","last_clean":"2023-07-14T12:52:49.335425+0000","last_became_active":"2023-07-14T12:52:46.093008+0000","last_became_peered":"2023-07-14T12:52:46.093008+0000","last_unstale":"2023-07-14T12:52:49.335425+0000","last_undegraded":"2023-07-14T12:52:49.335425+0000","last_fullsized":"2023-07-14T12:52:49.335425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:45.104755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.335794+0000","last_change":"2023-07-14T12:52:47.120008+0000","last_active":"2023-07-14T12:52:49.335794+0000","last_peered":"2023-07-14T12:52:49.335794+0000","last_clean":"2023-07-14T12:52:49.335794+0000","last_became_active":"2023-07-14T12:52:47.119629+0000","last_became_peered":"2023-07-14T12:52:47.119629+0000","last_unstale":"2023-07-14T12:52:49.335794+0000","last_undegraded":"2023-07-14T12:52:49.335794+0000","last_fullsized":"2023-07-14T12:52:49.335794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:08:09.613480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.334631+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T12:52:49.334631+0000","last_peered":"2023-07-14T12:52:49.334631+0000","last_clean":"2023-07-14T12:52:49.334631+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T12:52:49.334631+0000","last_undegraded":"2023-07-14T12:52:49.334631+0000","last_fullsized":"2023-07-14T12:52:49.334631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:25:54.692862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.558708+0000","last_change":"2023-07-14T12:52:46.082644+0000","last_active":"2023-07-14T12:52:48.558708+0000","last_peered":"2023-07-14T12:52:48.558708+0000","last_clean":"2023-07-14T12:52:48.558708+0000","last_became_active":"2023-07-14T12:52:46.082010+0000","last_became_peered":"2023-07-14T12:52:46.082010+0000","last_unstale":"2023-07-14T12:52:48.558708+0000","last_undegraded":"2023-07-14T12:52:48.558708+0000","last_fullsized":"2023-07-14T12:52:48.558708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:08:08.602374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.559366+0000","last_change":"2023-07-14T12:52:47.112236+0000","last_active":"2023-07-14T12:52:48.559366+0000","last_peered":"2023-07-14T12:52:48.559366+0000","last_clean":"2023-07-14T12:52:48.559366+0000","last_became_active":"2023-07-14T12:52:47.111932+0000","last_became_peered":"2023-07-14T12:52:47.111932+0000","last_unstale":"2023-07-14T12:52:48.559366+0000","last_undegraded":"2023-07-14T12:52:48.559366+0000","last_fullsized":"2023-07-14T12:52:48.559366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:45:39.014447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578431+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T12:52:48.578431+0000","last_peered":"2023-07-14T12:52:48.578431+0000","last_clean":"2023-07-14T12:52:48.578431+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T12:52:48.578431+0000","last_undegraded":"2023-07-14T12:52:48.578431+0000","last_fullsized":"2023-07-14T12:52:48.578431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:32:42.398933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.098648+0000","last_change":"2023-07-14T12:52:46.093820+0000","last_active":"2023-07-14T12:52:48.098648+0000","last_peered":"2023-07-14T12:52:48.098648+0000","last_clean":"2023-07-14T12:52:48.098648+0000","last_became_active":"2023-07-14T12:52:46.093558+0000","last_became_peered":"2023-07-14T12:52:46.093558+0000","last_unstale":"2023-07-14T12:52:48.098648+0000","last_undegraded":"2023-07-14T12:52:48.098648+0000","last_fullsized":"2023-07-14T12:52:48.098648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:14:50.113829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.559046+0000","last_change":"2023-07-14T12:52:47.127415+0000","last_active":"2023-07-14T12:52:48.559046+0000","last_peered":"2023-07-14T12:52:48.559046+0000","last_clean":"2023-07-14T12:52:48.559046+0000","last_became_active":"2023-07-14T12:52:47.127167+0000","last_became_peered":"2023-07-14T12:52:47.127167+0000","last_unstale":"2023-07-14T12:52:48.559046+0000","last_undegraded":"2023-07-14T12:52:48.559046+0000","last_fullsized":"2023-07-14T12:52:48.559046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:32:48.443355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578740+0000","last_change":"2023-07-14T12:52:46.090967+0000","last_active":"2023-07-14T12:52:48.578740+0000","last_peered":"2023-07-14T12:52:48.578740+0000","last_clean":"2023-07-14T12:52:48.578740+0000","last_became_active":"2023-07-14T12:52:46.087916+0000","last_became_peered":"2023-07-14T12:52:46.087916+0000","last_unstale":"2023-07-14T12:52:48.578740+0000","last_undegraded":"2023-07-14T12:52:48.578740+0000","last_fullsized":"2023-07-14T12:52:48.578740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:45:38.003340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.559302+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T12:52:48.559302+0000","last_peered":"2023-07-14T12:52:48.559302+0000","last_clean":"2023-07-14T12:52:48.559302+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T12:52:48.559302+0000","last_undegraded":"2023-07-14T12:52:48.559302+0000","last_fullsized":"2023-07-14T12:52:48.559302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:06:11.046612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.559006+0000","last_change":"2023-07-14T12:52:47.112617+0000","last_active":"2023-07-14T12:52:48.559006+0000","last_peered":"2023-07-14T12:52:48.559006+0000","last_clean":"2023-07-14T12:52:48.559006+0000","last_became_active":"2023-07-14T12:52:47.112317+0000","last_became_peered":"2023-07-14T12:52:47.112317+0000","last_unstale":"2023-07-14T12:52:48.559006+0000","last_undegraded":"2023-07-14T12:52:48.559006+0000","last_fullsized":"2023-07-14T12:52:48.559006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:34.490036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.559048+0000","last_change":"2023-07-14T12:52:46.082409+0000","last_active":"2023-07-14T12:52:48.559048+0000","last_peered":"2023-07-14T12:52:48.559048+0000","last_clean":"2023-07-14T12:52:48.559048+0000","last_became_active":"2023-07-14T12:52:46.082027+0000","last_became_peered":"2023-07-14T12:52:46.082027+0000","last_unstale":"2023-07-14T12:52:48.559048+0000","last_undegraded":"2023-07-14T12:52:48.559048+0000","last_fullsized":"2023-07-14T12:52:48.559048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:20:38.774133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.053522+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T12:52:49.053522+0000","last_peered":"2023-07-14T12:52:49.053522+0000","last_clean":"2023-07-14T12:52:49.053522+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T12:52:49.053522+0000","last_undegraded":"2023-07-14T12:52:49.053522+0000","last_fullsized":"2023-07-14T12:52:49.053522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:24:04.476998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.335686+0000","last_change":"2023-07-14T12:52:47.118665+0000","last_active":"2023-07-14T12:52:49.335686+0000","last_peered":"2023-07-14T12:52:49.335686+0000","last_clean":"2023-07-14T12:52:49.335686+0000","last_became_active":"2023-07-14T12:52:47.118454+0000","last_became_peered":"2023-07-14T12:52:47.118454+0000","last_unstale":"2023-07-14T12:52:49.335686+0000","last_undegraded":"2023-07-14T12:52:49.335686+0000","last_fullsized":"2023-07-14T12:52:49.335686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:37:59.704093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.097139+0000","last_change":"2023-07-14T12:52:46.090135+0000","last_active":"2023-07-14T12:52:48.097139+0000","last_peered":"2023-07-14T12:52:48.097139+0000","last_clean":"2023-07-14T12:52:48.097139+0000","last_became_active":"2023-07-14T12:52:46.089807+0000","last_became_peered":"2023-07-14T12:52:46.089807+0000","last_unstale":"2023-07-14T12:52:48.097139+0000","last_undegraded":"2023-07-14T12:52:48.097139+0000","last_fullsized":"2023-07-14T12:52:48.097139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:46:00.245475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.559288+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T12:52:48.559288+0000","last_peered":"2023-07-14T12:52:48.559288+0000","last_clean":"2023-07-14T12:52:48.559288+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T12:52:48.559288+0000","last_undegraded":"2023-07-14T12:52:48.559288+0000","last_fullsized":"2023-07-14T12:52:48.559288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:45:55.212159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.096149+0000","last_change":"2023-07-14T12:52:47.114917+0000","last_active":"2023-07-14T12:52:48.096149+0000","last_peered":"2023-07-14T12:52:48.096149+0000","last_clean":"2023-07-14T12:52:48.096149+0000","last_became_active":"2023-07-14T12:52:47.114437+0000","last_became_peered":"2023-07-14T12:52:47.114437+0000","last_unstale":"2023-07-14T12:52:48.096149+0000","last_undegraded":"2023-07-14T12:52:48.096149+0000","last_fullsized":"2023-07-14T12:52:48.096149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:08:09.613480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.336066+0000","last_change":"2023-07-14T12:52:46.089258+0000","last_active":"2023-07-14T12:52:49.336066+0000","last_peered":"2023-07-14T12:52:49.336066+0000","last_clean":"2023-07-14T12:52:49.336066+0000","last_became_active":"2023-07-14T12:52:46.088621+0000","last_became_peered":"2023-07-14T12:52:46.088621+0000","last_unstale":"2023-07-14T12:52:49.336066+0000","last_undegraded":"2023-07-14T12:52:49.336066+0000","last_fullsized":"2023-07-14T12:52:49.336066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:20:38.774133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.236084+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T12:52:49.236084+0000","last_peered":"2023-07-14T12:52:49.236084+0000","last_clean":"2023-07-14T12:52:49.236084+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T12:52:49.236084+0000","last_undegraded":"2023-07-14T12:52:49.236084+0000","last_fullsized":"2023-07-14T12:52:49.236084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:05:33.923291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.098637+0000","last_change":"2023-07-14T12:52:47.108704+0000","last_active":"2023-07-14T12:52:48.098637+0000","last_peered":"2023-07-14T12:52:48.098637+0000","last_clean":"2023-07-14T12:52:48.098637+0000","last_became_active":"2023-07-14T12:52:47.108394+0000","last_became_peered":"2023-07-14T12:52:47.108394+0000","last_unstale":"2023-07-14T12:52:48.098637+0000","last_undegraded":"2023-07-14T12:52:48.098637+0000","last_fullsized":"2023-07-14T12:52:48.098637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:20:39.785240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.098558+0000","last_change":"2023-07-14T12:52:47.117094+0000","last_active":"2023-07-14T12:52:48.098558+0000","last_peered":"2023-07-14T12:52:48.098558+0000","last_clean":"2023-07-14T12:52:48.098558+0000","last_became_active":"2023-07-14T12:52:47.116803+0000","last_became_peered":"2023-07-14T12:52:47.116803+0000","last_unstale":"2023-07-14T12:52:48.098558+0000","last_undegraded":"2023-07-14T12:52:48.098558+0000","last_fullsized":"2023-07-14T12:52:48.098558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:32:48.443355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.099010+0000","last_change":"2023-07-14T12:52:46.084583+0000","last_active":"2023-07-14T12:52:48.099010+0000","last_peered":"2023-07-14T12:52:48.099010+0000","last_clean":"2023-07-14T12:52:48.099010+0000","last_became_active":"2023-07-14T12:52:46.083903+0000","last_became_peered":"2023-07-14T12:52:46.083903+0000","last_unstale":"2023-07-14T12:52:48.099010+0000","last_undegraded":"2023-07-14T12:52:48.099010+0000","last_fullsized":"2023-07-14T12:52:48.099010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:27:18.452478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.558918+0000","last_change":"2023-07-14T12:52:47.117195+0000","last_active":"2023-07-14T12:52:48.558918+0000","last_peered":"2023-07-14T12:52:48.558918+0000","last_clean":"2023-07-14T12:52:48.558918+0000","last_became_active":"2023-07-14T12:52:47.116928+0000","last_became_peered":"2023-07-14T12:52:47.116928+0000","last_unstale":"2023-07-14T12:52:48.558918+0000","last_undegraded":"2023-07-14T12:52:48.558918+0000","last_fullsized":"2023-07-14T12:52:48.558918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:45:22.385049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.053173+0000","last_change":"2023-07-14T12:52:46.094565+0000","last_active":"2023-07-14T12:52:49.053173+0000","last_peered":"2023-07-14T12:52:49.053173+0000","last_clean":"2023-07-14T12:52:49.053173+0000","last_became_active":"2023-07-14T12:52:46.094318+0000","last_became_peered":"2023-07-14T12:52:46.094318+0000","last_unstale":"2023-07-14T12:52:49.053173+0000","last_undegraded":"2023-07-14T12:52:49.053173+0000","last_fullsized":"2023-07-14T12:52:49.053173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:46:00.245475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578723+0000","last_change":"2023-07-14T12:52:46.086205+0000","last_active":"2023-07-14T12:52:48.578723+0000","last_peered":"2023-07-14T12:52:48.578723+0000","last_clean":"2023-07-14T12:52:48.578723+0000","last_became_active":"2023-07-14T12:52:46.085742+0000","last_became_peered":"2023-07-14T12:52:46.085742+0000","last_unstale":"2023-07-14T12:52:48.578723+0000","last_undegraded":"2023-07-14T12:52:48.578723+0000","last_fullsized":"2023-07-14T12:52:48.578723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:06:16.079927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.096154+0000","last_change":"2023-07-14T12:52:47.114145+0000","last_active":"2023-07-14T12:52:48.096154+0000","last_peered":"2023-07-14T12:52:48.096154+0000","last_clean":"2023-07-14T12:52:48.096154+0000","last_became_active":"2023-07-14T12:52:47.113888+0000","last_became_peered":"2023-07-14T12:52:47.113888+0000","last_unstale":"2023-07-14T12:52:48.096154+0000","last_undegraded":"2023-07-14T12:52:48.096154+0000","last_fullsized":"2023-07-14T12:52:48.096154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:37:59.704093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.336110+0000","last_change":"2023-07-14T12:52:46.088585+0000","last_active":"2023-07-14T12:52:49.336110+0000","last_peered":"2023-07-14T12:52:49.336110+0000","last_clean":"2023-07-14T12:52:49.336110+0000","last_became_active":"2023-07-14T12:52:46.088263+0000","last_became_peered":"2023-07-14T12:52:46.088263+0000","last_unstale":"2023-07-14T12:52:49.336110+0000","last_undegraded":"2023-07-14T12:52:49.336110+0000","last_fullsized":"2023-07-14T12:52:49.336110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:49:07.501108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.095955+0000","last_change":"2023-07-14T12:52:47.119037+0000","last_active":"2023-07-14T12:52:48.095955+0000","last_peered":"2023-07-14T12:52:48.095955+0000","last_clean":"2023-07-14T12:52:48.095955+0000","last_became_active":"2023-07-14T12:52:47.118770+0000","last_became_peered":"2023-07-14T12:52:47.118770+0000","last_unstale":"2023-07-14T12:52:48.095955+0000","last_undegraded":"2023-07-14T12:52:48.095955+0000","last_fullsized":"2023-07-14T12:52:48.095955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:01:37.466387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.236050+0000","last_change":"2023-07-14T12:52:47.112620+0000","last_active":"2023-07-14T12:52:49.236050+0000","last_peered":"2023-07-14T12:52:49.236050+0000","last_clean":"2023-07-14T12:52:49.236050+0000","last_became_active":"2023-07-14T12:52:47.112372+0000","last_became_peered":"2023-07-14T12:52:47.112372+0000","last_unstale":"2023-07-14T12:52:49.236050+0000","last_undegraded":"2023-07-14T12:52:49.236050+0000","last_fullsized":"2023-07-14T12:52:49.236050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:52:25.699239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.096094+0000","last_change":"2023-07-14T12:52:46.086638+0000","last_active":"2023-07-14T12:52:48.096094+0000","last_peered":"2023-07-14T12:52:48.096094+0000","last_clean":"2023-07-14T12:52:48.096094+0000","last_became_active":"2023-07-14T12:52:46.085797+0000","last_became_peered":"2023-07-14T12:52:46.085797+0000","last_unstale":"2023-07-14T12:52:48.096094+0000","last_undegraded":"2023-07-14T12:52:48.096094+0000","last_fullsized":"2023-07-14T12:52:48.096094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:45:16.620577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.335416+0000","last_change":"2023-07-14T12:52:47.114763+0000","last_active":"2023-07-14T12:52:49.335416+0000","last_peered":"2023-07-14T12:52:49.335416+0000","last_clean":"2023-07-14T12:52:49.335416+0000","last_became_active":"2023-07-14T12:52:47.114421+0000","last_became_peered":"2023-07-14T12:52:47.114421+0000","last_unstale":"2023-07-14T12:52:49.335416+0000","last_undegraded":"2023-07-14T12:52:49.335416+0000","last_fullsized":"2023-07-14T12:52:49.335416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:50:56.655801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.558895+0000","last_change":"2023-07-14T12:52:46.087077+0000","last_active":"2023-07-14T12:52:48.558895+0000","last_peered":"2023-07-14T12:52:48.558895+0000","last_clean":"2023-07-14T12:52:48.558895+0000","last_became_active":"2023-07-14T12:52:46.086797+0000","last_became_peered":"2023-07-14T12:52:46.086797+0000","last_unstale":"2023-07-14T12:52:48.558895+0000","last_undegraded":"2023-07-14T12:52:48.558895+0000","last_fullsized":"2023-07-14T12:52:48.558895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:30:02.269569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.096735+0000","last_change":"2023-07-14T12:52:47.118332+0000","last_active":"2023-07-14T12:52:48.096735+0000","last_peered":"2023-07-14T12:52:48.096735+0000","last_clean":"2023-07-14T12:52:48.096735+0000","last_became_active":"2023-07-14T12:52:47.118046+0000","last_became_peered":"2023-07-14T12:52:47.118046+0000","last_unstale":"2023-07-14T12:52:48.096735+0000","last_undegraded":"2023-07-14T12:52:48.096735+0000","last_fullsized":"2023-07-14T12:52:48.096735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:18:16.031557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.099026+0000","last_change":"2023-07-14T12:52:46.090684+0000","last_active":"2023-07-14T12:52:48.099026+0000","last_peered":"2023-07-14T12:52:48.099026+0000","last_clean":"2023-07-14T12:52:48.099026+0000","last_became_active":"2023-07-14T12:52:46.090365+0000","last_became_peered":"2023-07-14T12:52:46.090365+0000","last_unstale":"2023-07-14T12:52:48.099026+0000","last_undegraded":"2023-07-14T12:52:48.099026+0000","last_fullsized":"2023-07-14T12:52:48.099026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:46:00.245475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.335143+0000","last_change":"2023-07-14T12:52:47.115150+0000","last_active":"2023-07-14T12:52:49.335143+0000","last_peered":"2023-07-14T12:52:49.335143+0000","last_clean":"2023-07-14T12:52:49.335143+0000","last_became_active":"2023-07-14T12:52:47.114705+0000","last_became_peered":"2023-07-14T12:52:47.114705+0000","last_unstale":"2023-07-14T12:52:49.335143+0000","last_undegraded":"2023-07-14T12:52:49.335143+0000","last_fullsized":"2023-07-14T12:52:49.335143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:39:09.060324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.335881+0000","last_change":"2023-07-14T12:52:46.089673+0000","last_active":"2023-07-14T12:52:49.335881+0000","last_peered":"2023-07-14T12:52:49.335881+0000","last_clean":"2023-07-14T12:52:49.335881+0000","last_became_active":"2023-07-14T12:52:46.088813+0000","last_became_peered":"2023-07-14T12:52:46.088813+0000","last_unstale":"2023-07-14T12:52:49.335881+0000","last_undegraded":"2023-07-14T12:52:49.335881+0000","last_fullsized":"2023-07-14T12:52:49.335881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:45:21.373943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.098458+0000","last_change":"2023-07-14T12:52:47.110872+0000","last_active":"2023-07-14T12:52:48.098458+0000","last_peered":"2023-07-14T12:52:48.098458+0000","last_clean":"2023-07-14T12:52:48.098458+0000","last_became_active":"2023-07-14T12:52:47.110526+0000","last_became_peered":"2023-07-14T12:52:47.110526+0000","last_unstale":"2023-07-14T12:52:48.098458+0000","last_undegraded":"2023-07-14T12:52:48.098458+0000","last_fullsized":"2023-07-14T12:52:48.098458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:34.490036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578254+0000","last_change":"2023-07-14T12:52:46.090553+0000","last_active":"2023-07-14T12:52:48.578254+0000","last_peered":"2023-07-14T12:52:48.578254+0000","last_clean":"2023-07-14T12:52:48.578254+0000","last_became_active":"2023-07-14T12:52:46.090136+0000","last_became_peered":"2023-07-14T12:52:46.090136+0000","last_unstale":"2023-07-14T12:52:48.578254+0000","last_undegraded":"2023-07-14T12:52:48.578254+0000","last_fullsized":"2023-07-14T12:52:48.578254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:30:02.269569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.098839+0000","last_change":"2023-07-14T12:52:47.118033+0000","last_active":"2023-07-14T12:52:48.098839+0000","last_peered":"2023-07-14T12:52:48.098839+0000","last_clean":"2023-07-14T12:52:48.098839+0000","last_became_active":"2023-07-14T12:52:47.117334+0000","last_became_peered":"2023-07-14T12:52:47.117334+0000","last_unstale":"2023-07-14T12:52:48.098839+0000","last_undegraded":"2023-07-14T12:52:48.098839+0000","last_fullsized":"2023-07-14T12:52:48.098839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:49:08.512214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578602+0000","last_change":"2023-07-14T12:52:46.090568+0000","last_active":"2023-07-14T12:52:48.578602+0000","last_peered":"2023-07-14T12:52:48.578602+0000","last_clean":"2023-07-14T12:52:48.578602+0000","last_became_active":"2023-07-14T12:52:46.087626+0000","last_became_peered":"2023-07-14T12:52:46.087626+0000","last_unstale":"2023-07-14T12:52:48.578602+0000","last_undegraded":"2023-07-14T12:52:48.578602+0000","last_fullsized":"2023-07-14T12:52:48.578602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:27:18.452478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.096233+0000","last_change":"2023-07-14T12:52:47.126294+0000","last_active":"2023-07-14T12:52:48.096233+0000","last_peered":"2023-07-14T12:52:48.096233+0000","last_clean":"2023-07-14T12:52:48.096233+0000","last_became_active":"2023-07-14T12:52:47.125928+0000","last_became_peered":"2023-07-14T12:52:47.125928+0000","last_unstale":"2023-07-14T12:52:48.096233+0000","last_undegraded":"2023-07-14T12:52:48.096233+0000","last_fullsized":"2023-07-14T12:52:48.096233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:45:22.385049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.096853+0000","last_change":"2023-07-14T12:52:46.089467+0000","last_active":"2023-07-14T12:52:48.096853+0000","last_peered":"2023-07-14T12:52:48.096853+0000","last_clean":"2023-07-14T12:52:48.096853+0000","last_became_active":"2023-07-14T12:52:46.087179+0000","last_became_peered":"2023-07-14T12:52:46.087179+0000","last_unstale":"2023-07-14T12:52:48.096853+0000","last_undegraded":"2023-07-14T12:52:48.096853+0000","last_fullsized":"2023-07-14T12:52:48.096853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:49:07.501108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.098302+0000","last_change":"2023-07-14T12:52:47.118229+0000","last_active":"2023-07-14T12:52:48.098302+0000","last_peered":"2023-07-14T12:52:48.098302+0000","last_clean":"2023-07-14T12:52:48.098302+0000","last_became_active":"2023-07-14T12:52:47.117903+0000","last_became_peered":"2023-07-14T12:52:47.117903+0000","last_unstale":"2023-07-14T12:52:48.098302+0000","last_undegraded":"2023-07-14T12:52:48.098302+0000","last_fullsized":"2023-07-14T12:52:48.098302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:08:09.613480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.336101+0000","last_change":"2023-07-14T12:52:46.089959+0000","last_active":"2023-07-14T12:52:49.336101+0000","last_peered":"2023-07-14T12:52:49.336101+0000","last_clean":"2023-07-14T12:52:49.336101+0000","last_became_active":"2023-07-14T12:52:46.089119+0000","last_became_peered":"2023-07-14T12:52:46.089119+0000","last_unstale":"2023-07-14T12:52:49.336101+0000","last_undegraded":"2023-07-14T12:52:49.336101+0000","last_fullsized":"2023-07-14T12:52:49.336101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:18:15.020451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":864256,"data_stored":681747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":249856,"data_stored":90251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":91219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31288,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340552,"statfs":{"total":96636764160,"available":96604725248,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31280,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340560,"statfs":{"total":96636764160,"available":96604733440,"internally_reserved":0,"allocated":237568,"data_stored":88580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31284,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":835584,"data_stored":679530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T12:52:56.269 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T12:52:56.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.426+0000 7f62f06cb640 1 Processor -- start 2023-07-14T12:52:56.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.426+0000 7f62f06cb640 1 -- start start 2023-07-14T12:52:56.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.430+0000 7f62f06cb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f62e80b7c70 0x7f62e80d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:56.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.430+0000 7f62f06cb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62e815fd60 0x7f62e80d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:56.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.430+0000 7f62f06cb640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e80ccaf0 con 0x7f62e80d1850 2023-07-14T12:52:56.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.430+0000 7f62f06cb640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e80d1190 con 0x7f62e80b7c70 2023-07-14T12:52:56.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.430+0000 7f62f06cb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e8160600 con 0x7f62e815fd60 2023-07-14T12:52:56.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.430+0000 7f62edc66640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f62e80d1850 0x7f62e815f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39004/0 (socket says 172.21.15.5:39004) 2023-07-14T12:52:56.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.430+0000 7f62edc66640 1 -- 172.21.15.5:0/3822704997 learned_addr learned my addr 172.21.15.5:0/3822704997 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:56.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.430+0000 7f62ee467640 1 --2- 172.21.15.5:0/3822704997 >> v2:172.21.15.5:3300/0 conn(0x7f62e80b7c70 0x7f62e80d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:56.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.430+0000 7f62eec68640 1 --2- 172.21.15.5:0/3822704997 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62e815fd60 0x7f62e80d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:56.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.430+0000 7f62ee467640 1 -- 172.21.15.5:0/3822704997 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62e815fd60 msgr2=0x7f62e80d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:56.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.430+0000 7f62ee467640 1 --2- 172.21.15.5:0/3822704997 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62e815fd60 0x7f62e80d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:56.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.430+0000 7f62ee467640 1 -- 172.21.15.5:0/3822704997 >> v1:172.21.15.5:6789/0 conn(0x7f62e80d1850 legacy=0x7f62e815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:56.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.430+0000 7f62ee467640 1 -- 172.21.15.5:0/3822704997 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e8160320 con 0x7f62e80b7c70 2023-07-14T12:52:56.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.430+0000 7f62ed465640 1 -- 172.21.15.5:0/3822704997 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288445082 0 0) 0x7f62e80ccaf0 con 0x7f62e80d1850 2023-07-14T12:52:56.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.434+0000 7f62ee467640 1 --2- 172.21.15.5:0/3822704997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e80b7c70 0x7f62e80d0c50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f62e40097c0 tx=0x7f62e401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191236de9158132f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:56.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.434+0000 7f62ed465640 1 -- 172.21.15.5:0/3822704997 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e40ab670 con 0x7f62e80b7c70 2023-07-14T12:52:56.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.434+0000 7f62ed465640 1 -- 172.21.15.5:0/3822704997 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e40ab7d0 con 0x7f62e80b7c70 2023-07-14T12:52:56.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.434+0000 7f62ed465640 1 -- 172.21.15.5:0/3822704997 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e40abb60 con 0x7f62e80b7c70 2023-07-14T12:52:56.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.434+0000 7f62f06cb640 1 -- 172.21.15.5:0/3822704997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e80b7c70 msgr2=0x7f62e80d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:56.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.434+0000 7f62f06cb640 1 --2- 172.21.15.5:0/3822704997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e80b7c70 0x7f62e80d0c50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f62e40097c0 tx=0x7f62e401c450 comp rx=0 tx=0).stop 2023-07-14T12:52:56.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.434+0000 7f62f06cb640 1 -- 172.21.15.5:0/3822704997 shutdown_connections 2023-07-14T12:52:56.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.434+0000 7f62f06cb640 1 --2- 172.21.15.5:0/3822704997 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62e815fd60 0x7f62e80d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:56.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.434+0000 7f62f06cb640 1 --2- 172.21.15.5:0/3822704997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e80b7c70 0x7f62e80d0c50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:56.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.434+0000 7f62f06cb640 1 -- 172.21.15.5:0/3822704997 >> 172.21.15.5:0/3822704997 conn(0x7f62e80650b0 msgr2=0x7f62e80654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:56.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.434+0000 7f62f06cb640 1 -- 172.21.15.5:0/3822704997 shutdown_connections 2023-07-14T12:52:56.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.434+0000 7f62f06cb640 1 -- 172.21.15.5:0/3822704997 wait complete. 2023-07-14T12:52:56.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.434+0000 7f62f06cb640 1 Processor -- start 2023-07-14T12:52:56.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.434+0000 7f62f06cb640 1 -- start start 2023-07-14T12:52:56.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.434+0000 7f62f06cb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e80b7c70 0x7f62e814f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:56.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.434+0000 7f62f06cb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62e80d1850 0x7f62e8151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:56.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.434+0000 7f62f06cb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62e815fd60 0x7f62e8156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:56.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.434+0000 7f62f06cb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e8153660 con 0x7f62e80b7c70 2023-07-14T12:52:56.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.434+0000 7f62f06cb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e8152450 con 0x7f62e815fd60 2023-07-14T12:52:56.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.434+0000 7f62f06cb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e8152730 con 0x7f62e80d1850 2023-07-14T12:52:56.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.434+0000 7f62ee467640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e80b7c70 0x7f62e814f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:56.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.434+0000 7f62ee467640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e80b7c70 0x7f62e814f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52936/0 (socket says 172.21.15.5:52936) 2023-07-14T12:52:56.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.434+0000 7f62ee467640 1 -- 172.21.15.5:0/2965925309 learned_addr learned my addr 172.21.15.5:0/2965925309 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:56.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.438+0000 7f62ee467640 1 -- 172.21.15.5:0/2965925309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62e80d1850 msgr2=0x7f62e8151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:56.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.438+0000 7f62ee467640 1 --2- 172.21.15.5:0/2965925309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62e80d1850 0x7f62e8151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:56.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.438+0000 7f62ee467640 1 -- 172.21.15.5:0/2965925309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62e815fd60 msgr2=0x7f62e8156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:56.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.438+0000 7f62eec68640 1 --2- 172.21.15.5:0/2965925309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62e815fd60 0x7f62e8156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:56.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.438+0000 7f62ee467640 1 --2- 172.21.15.5:0/2965925309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62e815fd60 0x7f62e8156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:56.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.438+0000 7f62ee467640 1 -- 172.21.15.5:0/2965925309 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e4009420 con 0x7f62e80b7c70 2023-07-14T12:52:56.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.438+0000 7f62eec68640 1 --2- 172.21.15.5:0/2965925309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62e815fd60 0x7f62e8156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:52:56.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.438+0000 7f62ee467640 1 --2- 172.21.15.5:0/2965925309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e80b7c70 0x7f62e814f7d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f62e401a080 tx=0x7f62e401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:56.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.438+0000 7f62deffd640 1 -- 172.21.15.5:0/2965925309 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e4004220 con 0x7f62e80b7c70 2023-07-14T12:52:56.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.438+0000 7f62deffd640 1 -- 172.21.15.5:0/2965925309 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e40b9070 con 0x7f62e80b7c70 2023-07-14T12:52:56.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.438+0000 7f62deffd640 1 -- 172.21.15.5:0/2965925309 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e4003620 con 0x7f62e80b7c70 2023-07-14T12:52:56.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.438+0000 7f62f06cb640 1 -- 172.21.15.5:0/2965925309 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e8152a10 con 0x7f62e80b7c70 2023-07-14T12:52:56.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.438+0000 7f62f06cb640 1 -- 172.21.15.5:0/2965925309 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e814fd10 con 0x7f62e80b7c70 2023-07-14T12:52:56.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.438+0000 7f62f06cb640 1 -- 172.21.15.5:0/2965925309 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e80678d0 con 0x7f62e80b7c70 2023-07-14T12:52:56.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.438+0000 7f62deffd640 1 -- 172.21.15.5:0/2965925309 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f62e4003780 con 0x7f62e80b7c70 2023-07-14T12:52:56.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.438+0000 7f62deffd640 1 --2- 172.21.15.5:0/2965925309 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f62cc066280 0x7f62cc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:56.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.438+0000 7f62deffd640 1 -- 172.21.15.5:0/2965925309 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f62e40bb070 con 0x7f62e80b7c70 2023-07-14T12:52:56.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.442+0000 7f62edc66640 1 --2- 172.21.15.5:0/2965925309 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f62cc066280 0x7f62cc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:56.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.442+0000 7f62edc66640 1 --2- 172.21.15.5:0/2965925309 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f62cc066280 0x7f62cc068730 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f62e81667a0 tx=0x7f62d8007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:56.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.446+0000 7f62deffd640 1 -- 172.21.15.5:0/2965925309 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f62e40ebbd0 con 0x7f62e80b7c70 2023-07-14T12:52:56.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.594+0000 7f62f06cb640 1 -- 172.21.15.5:0/2965925309 --> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62e81537a0 con 0x7f62cc066280 2023-07-14T12:52:56.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.602+0000 7f62deffd640 1 -- 172.21.15.5:0/2965925309 <== mgr.4102 v2:172.21.15.154:6832/2736441655 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286649 (secure 0 0 0) 0x7f62d80070d0 con 0x7f62cc066280 2023-07-14T12:52:56.632 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:52:56.634 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T12:52:56.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.606+0000 7f62f06cb640 1 -- 172.21.15.5:0/2965925309 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f62cc066280 msgr2=0x7f62cc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:56.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.606+0000 7f62f06cb640 1 --2- 172.21.15.5:0/2965925309 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f62cc066280 0x7f62cc068730 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f62e81667a0 tx=0x7f62d8007970 comp rx=0 tx=0).stop 2023-07-14T12:52:56.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.606+0000 7f62f06cb640 1 -- 172.21.15.5:0/2965925309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e80b7c70 msgr2=0x7f62e814f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:56.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.606+0000 7f62f06cb640 1 --2- 172.21.15.5:0/2965925309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e80b7c70 0x7f62e814f7d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f62e401a080 tx=0x7f62e401ac90 comp rx=0 tx=0).stop 2023-07-14T12:52:56.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.606+0000 7f62f06cb640 1 -- 172.21.15.5:0/2965925309 shutdown_connections 2023-07-14T12:52:56.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.606+0000 7f62f06cb640 1 --2- 172.21.15.5:0/2965925309 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f62cc066280 0x7f62cc068730 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:56.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.606+0000 7f62f06cb640 1 --2- 172.21.15.5:0/2965925309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62e815fd60 0x7f62e8156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:56.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.606+0000 7f62f06cb640 1 --2- 172.21.15.5:0/2965925309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62e80d1850 0x7f62e8151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:56.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.606+0000 7f62f06cb640 1 --2- 172.21.15.5:0/2965925309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e80b7c70 0x7f62e814f7d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:56.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.606+0000 7f62f06cb640 1 -- 172.21.15.5:0/2965925309 >> 172.21.15.5:0/2965925309 conn(0x7f62e80650b0 msgr2=0x7f62e8065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:56.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.606+0000 7f62f06cb640 1 -- 172.21.15.5:0/2965925309 shutdown_connections 2023-07-14T12:52:56.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.606+0000 7f62f06cb640 1 -- 172.21.15.5:0/2965925309 wait complete. 2023-07-14T12:52:56.654 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-14T12:52:55.636543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235104,"kb_used_data":3104,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754739616,"statfs":{"total":773094113280,"available":772853366784,"internally_reserved":0,"allocated":3178496,"data_stored":1900214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.542264"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.334985+0000","last_change":"2023-07-14T12:52:47.109113+0000","last_active":"2023-07-14T12:52:49.334985+0000","last_peered":"2023-07-14T12:52:49.334985+0000","last_clean":"2023-07-14T12:52:49.334985+0000","last_became_active":"2023-07-14T12:52:47.107356+0000","last_became_peered":"2023-07-14T12:52:47.107356+0000","last_unstale":"2023-07-14T12:52:49.334985+0000","last_undegraded":"2023-07-14T12:52:49.334985+0000","last_fullsized":"2023-07-14T12:52:49.334985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:43.338222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578567+0000","last_change":"2023-07-14T12:52:47.119687+0000","last_active":"2023-07-14T12:52:48.578567+0000","last_peered":"2023-07-14T12:52:48.578567+0000","last_clean":"2023-07-14T12:52:48.578567+0000","last_became_active":"2023-07-14T12:52:47.119063+0000","last_became_peered":"2023-07-14T12:52:47.119063+0000","last_unstale":"2023-07-14T12:52:48.578567+0000","last_undegraded":"2023-07-14T12:52:48.578567+0000","last_fullsized":"2023-07-14T12:52:48.578567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:14:51.124935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.099281+0000","last_change":"2023-07-14T12:52:47.121019+0000","last_active":"2023-07-14T12:52:48.099281+0000","last_peered":"2023-07-14T12:52:48.099281+0000","last_clean":"2023-07-14T12:52:48.099281+0000","last_became_active":"2023-07-14T12:52:47.120756+0000","last_became_peered":"2023-07-14T12:52:47.120756+0000","last_unstale":"2023-07-14T12:52:48.099281+0000","last_undegraded":"2023-07-14T12:52:48.099281+0000","last_fullsized":"2023-07-14T12:52:48.099281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:21:01.355816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.235773+0000","last_change":"2023-07-14T12:52:47.114539+0000","last_active":"2023-07-14T12:52:49.235773+0000","last_peered":"2023-07-14T12:52:49.235773+0000","last_clean":"2023-07-14T12:52:49.235773+0000","last_became_active":"2023-07-14T12:52:47.114187+0000","last_became_peered":"2023-07-14T12:52:47.114187+0000","last_unstale":"2023-07-14T12:52:49.235773+0000","last_undegraded":"2023-07-14T12:52:49.235773+0000","last_fullsized":"2023-07-14T12:52:49.235773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:03:43.488480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.335846+0000","last_change":"2023-07-14T12:52:47.111120+0000","last_active":"2023-07-14T12:52:49.335846+0000","last_peered":"2023-07-14T12:52:49.335846+0000","last_clean":"2023-07-14T12:52:49.335846+0000","last_became_active":"2023-07-14T12:52:47.110781+0000","last_became_peered":"2023-07-14T12:52:47.110781+0000","last_unstale":"2023-07-14T12:52:49.335846+0000","last_undegraded":"2023-07-14T12:52:49.335846+0000","last_fullsized":"2023-07-14T12:52:49.335846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:30:03.280675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.098276+0000","last_change":"2023-07-14T12:52:47.111259+0000","last_active":"2023-07-14T12:52:48.098276+0000","last_peered":"2023-07-14T12:52:48.098276+0000","last_clean":"2023-07-14T12:52:48.098276+0000","last_became_active":"2023-07-14T12:52:47.111023+0000","last_became_peered":"2023-07-14T12:52:47.111023+0000","last_unstale":"2023-07-14T12:52:48.098276+0000","last_undegraded":"2023-07-14T12:52:48.098276+0000","last_fullsized":"2023-07-14T12:52:48.098276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:37:59.704093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.053045+0000","last_change":"2023-07-14T12:52:47.122189+0000","last_active":"2023-07-14T12:52:49.053045+0000","last_peered":"2023-07-14T12:52:49.053045+0000","last_clean":"2023-07-14T12:52:49.053045+0000","last_became_active":"2023-07-14T12:52:47.121465+0000","last_became_peered":"2023-07-14T12:52:47.121465+0000","last_unstale":"2023-07-14T12:52:49.053045+0000","last_undegraded":"2023-07-14T12:52:49.053045+0000","last_fullsized":"2023-07-14T12:52:49.053045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:18:16.031557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578201+0000","last_change":"2023-07-14T12:52:47.123614+0000","last_active":"2023-07-14T12:52:48.578201+0000","last_peered":"2023-07-14T12:52:48.578201+0000","last_clean":"2023-07-14T12:52:48.578201+0000","last_became_active":"2023-07-14T12:52:47.123147+0000","last_became_peered":"2023-07-14T12:52:47.123147+0000","last_unstale":"2023-07-14T12:52:48.578201+0000","last_undegraded":"2023-07-14T12:52:48.578201+0000","last_fullsized":"2023-07-14T12:52:48.578201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:08:09.613480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.335886+0000","last_change":"2023-07-14T12:52:47.123993+0000","last_active":"2023-07-14T12:52:49.335886+0000","last_peered":"2023-07-14T12:52:49.335886+0000","last_clean":"2023-07-14T12:52:49.335886+0000","last_became_active":"2023-07-14T12:52:47.123709+0000","last_became_peered":"2023-07-14T12:52:47.123709+0000","last_unstale":"2023-07-14T12:52:49.335886+0000","last_undegraded":"2023-07-14T12:52:49.335886+0000","last_fullsized":"2023-07-14T12:52:49.335886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:34.490036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578587+0000","last_change":"2023-07-14T12:52:47.112624+0000","last_active":"2023-07-14T12:52:48.578587+0000","last_peered":"2023-07-14T12:52:48.578587+0000","last_clean":"2023-07-14T12:52:48.578587+0000","last_became_active":"2023-07-14T12:52:47.112322+0000","last_became_peered":"2023-07-14T12:52:47.112322+0000","last_unstale":"2023-07-14T12:52:48.578587+0000","last_undegraded":"2023-07-14T12:52:48.578587+0000","last_fullsized":"2023-07-14T12:52:48.578587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:49:08.512214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.099239+0000","last_change":"2023-07-14T12:52:47.118589+0000","last_active":"2023-07-14T12:52:48.099239+0000","last_peered":"2023-07-14T12:52:48.099239+0000","last_clean":"2023-07-14T12:52:48.099239+0000","last_became_active":"2023-07-14T12:52:47.118256+0000","last_became_peered":"2023-07-14T12:52:47.118256+0000","last_unstale":"2023-07-14T12:52:48.099239+0000","last_undegraded":"2023-07-14T12:52:48.099239+0000","last_fullsized":"2023-07-14T12:52:48.099239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:49:39.248214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.334959+0000","last_change":"2023-07-14T12:52:47.118304+0000","last_active":"2023-07-14T12:52:49.334959+0000","last_peered":"2023-07-14T12:52:49.334959+0000","last_clean":"2023-07-14T12:52:49.334959+0000","last_became_active":"2023-07-14T12:52:47.117930+0000","last_became_peered":"2023-07-14T12:52:47.117930+0000","last_unstale":"2023-07-14T12:52:49.334959+0000","last_undegraded":"2023-07-14T12:52:49.334959+0000","last_fullsized":"2023-07-14T12:52:49.334959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:24.288374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.334811+0000","last_change":"2023-07-14T12:52:47.108380+0000","last_active":"2023-07-14T12:52:49.334811+0000","last_peered":"2023-07-14T12:52:49.334811+0000","last_clean":"2023-07-14T12:52:49.334811+0000","last_became_active":"2023-07-14T12:52:47.107936+0000","last_became_peered":"2023-07-14T12:52:47.107936+0000","last_unstale":"2023-07-14T12:52:49.334811+0000","last_undegraded":"2023-07-14T12:52:49.334811+0000","last_fullsized":"2023-07-14T12:52:49.334811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:03:43.488480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578347+0000","last_change":"2023-07-14T12:52:47.111677+0000","last_active":"2023-07-14T12:52:48.578347+0000","last_peered":"2023-07-14T12:52:48.578347+0000","last_clean":"2023-07-14T12:52:48.578347+0000","last_became_active":"2023-07-14T12:52:47.111411+0000","last_became_peered":"2023-07-14T12:52:47.111411+0000","last_unstale":"2023-07-14T12:52:48.578347+0000","last_undegraded":"2023-07-14T12:52:48.578347+0000","last_fullsized":"2023-07-14T12:52:48.578347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:45:22.385049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.053104+0000","last_change":"2023-07-14T12:52:47.122345+0000","last_active":"2023-07-14T12:52:49.053104+0000","last_peered":"2023-07-14T12:52:49.053104+0000","last_clean":"2023-07-14T12:52:49.053104+0000","last_became_active":"2023-07-14T12:52:47.121885+0000","last_became_peered":"2023-07-14T12:52:47.121885+0000","last_unstale":"2023-07-14T12:52:49.053104+0000","last_undegraded":"2023-07-14T12:52:49.053104+0000","last_fullsized":"2023-07-14T12:52:49.053104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:27:19.463584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.098097+0000","last_change":"2023-07-14T12:52:47.107126+0000","last_active":"2023-07-14T12:52:48.098097+0000","last_peered":"2023-07-14T12:52:48.098097+0000","last_clean":"2023-07-14T12:52:48.098097+0000","last_became_active":"2023-07-14T12:52:47.106204+0000","last_became_peered":"2023-07-14T12:52:47.106204+0000","last_unstale":"2023-07-14T12:52:48.098097+0000","last_undegraded":"2023-07-14T12:52:48.098097+0000","last_fullsized":"2023-07-14T12:52:48.098097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:46.115861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.335946+0000","last_change":"2023-07-14T12:52:47.109761+0000","last_active":"2023-07-14T12:52:49.335946+0000","last_peered":"2023-07-14T12:52:49.335946+0000","last_clean":"2023-07-14T12:52:49.335946+0000","last_became_active":"2023-07-14T12:52:47.109438+0000","last_became_peered":"2023-07-14T12:52:47.109438+0000","last_unstale":"2023-07-14T12:52:49.335946+0000","last_undegraded":"2023-07-14T12:52:49.335946+0000","last_fullsized":"2023-07-14T12:52:49.335946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:32:48.443355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.099133+0000","last_change":"2023-07-14T12:52:47.126985+0000","last_active":"2023-07-14T12:52:48.099133+0000","last_peered":"2023-07-14T12:52:48.099133+0000","last_clean":"2023-07-14T12:52:48.099133+0000","last_became_active":"2023-07-14T12:52:47.126696+0000","last_became_peered":"2023-07-14T12:52:47.126696+0000","last_unstale":"2023-07-14T12:52:48.099133+0000","last_undegraded":"2023-07-14T12:52:48.099133+0000","last_fullsized":"2023-07-14T12:52:48.099133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:45:39.014447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.335072+0000","last_change":"2023-07-14T12:52:47.115418+0000","last_active":"2023-07-14T12:52:49.335072+0000","last_peered":"2023-07-14T12:52:49.335072+0000","last_clean":"2023-07-14T12:52:49.335072+0000","last_became_active":"2023-07-14T12:52:47.115115+0000","last_became_peered":"2023-07-14T12:52:47.115115+0000","last_unstale":"2023-07-14T12:52:49.335072+0000","last_undegraded":"2023-07-14T12:52:49.335072+0000","last_fullsized":"2023-07-14T12:52:49.335072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:30.872502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.098316+0000","last_change":"2023-07-14T12:52:47.116335+0000","last_active":"2023-07-14T12:52:48.098316+0000","last_peered":"2023-07-14T12:52:48.098316+0000","last_clean":"2023-07-14T12:52:48.098316+0000","last_became_active":"2023-07-14T12:52:47.115763+0000","last_became_peered":"2023-07-14T12:52:47.115763+0000","last_unstale":"2023-07-14T12:52:48.098316+0000","last_undegraded":"2023-07-14T12:52:48.098316+0000","last_fullsized":"2023-07-14T12:52:48.098316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:30:03.280675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.053063+0000","last_change":"2023-07-14T12:52:47.124746+0000","last_active":"2023-07-14T12:52:49.053063+0000","last_peered":"2023-07-14T12:52:49.053063+0000","last_clean":"2023-07-14T12:52:49.053063+0000","last_became_active":"2023-07-14T12:52:47.124450+0000","last_became_peered":"2023-07-14T12:52:47.124450+0000","last_unstale":"2023-07-14T12:52:49.053063+0000","last_undegraded":"2023-07-14T12:52:49.053063+0000","last_fullsized":"2023-07-14T12:52:49.053063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:49:08.512214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.335118+0000","last_change":"2023-07-14T12:52:47.118958+0000","last_active":"2023-07-14T12:52:49.335118+0000","last_peered":"2023-07-14T12:52:49.335118+0000","last_clean":"2023-07-14T12:52:49.335118+0000","last_became_active":"2023-07-14T12:52:47.118640+0000","last_became_peered":"2023-07-14T12:52:47.118640+0000","last_unstale":"2023-07-14T12:52:49.335118+0000","last_undegraded":"2023-07-14T12:52:49.335118+0000","last_fullsized":"2023-07-14T12:52:49.335118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:01:37.466387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.096018+0000","last_change":"2023-07-14T12:52:47.112201+0000","last_active":"2023-07-14T12:52:48.096018+0000","last_peered":"2023-07-14T12:52:48.096018+0000","last_clean":"2023-07-14T12:52:48.096018+0000","last_became_active":"2023-07-14T12:52:47.111873+0000","last_became_peered":"2023-07-14T12:52:47.111873+0000","last_unstale":"2023-07-14T12:52:48.096018+0000","last_undegraded":"2023-07-14T12:52:48.096018+0000","last_fullsized":"2023-07-14T12:52:48.096018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:46.115861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.053227+0000","last_change":"2023-07-14T12:52:47.114122+0000","last_active":"2023-07-14T12:52:49.053227+0000","last_peered":"2023-07-14T12:52:49.053227+0000","last_clean":"2023-07-14T12:52:49.053227+0000","last_became_active":"2023-07-14T12:52:47.113796+0000","last_became_peered":"2023-07-14T12:52:47.113796+0000","last_unstale":"2023-07-14T12:52:49.053227+0000","last_undegraded":"2023-07-14T12:52:49.053227+0000","last_fullsized":"2023-07-14T12:52:49.053227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:06:17.091034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.559215+0000","last_change":"2023-07-14T12:52:47.116443+0000","last_active":"2023-07-14T12:52:48.559215+0000","last_peered":"2023-07-14T12:52:48.559215+0000","last_clean":"2023-07-14T12:52:48.559215+0000","last_became_active":"2023-07-14T12:52:47.116134+0000","last_became_peered":"2023-07-14T12:52:47.116134+0000","last_unstale":"2023-07-14T12:52:48.559215+0000","last_undegraded":"2023-07-14T12:52:48.559215+0000","last_fullsized":"2023-07-14T12:52:48.559215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:18:16.031557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.559236+0000","last_change":"2023-07-14T12:52:47.126857+0000","last_active":"2023-07-14T12:52:48.559236+0000","last_peered":"2023-07-14T12:52:48.559236+0000","last_clean":"2023-07-14T12:52:48.559236+0000","last_became_active":"2023-07-14T12:52:47.126551+0000","last_became_peered":"2023-07-14T12:52:47.126551+0000","last_unstale":"2023-07-14T12:52:48.559236+0000","last_undegraded":"2023-07-14T12:52:48.559236+0000","last_fullsized":"2023-07-14T12:52:48.559236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:49:08.512214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578420+0000","last_change":"2023-07-14T12:52:47.116313+0000","last_active":"2023-07-14T12:52:48.578420+0000","last_peered":"2023-07-14T12:52:48.578420+0000","last_clean":"2023-07-14T12:52:48.578420+0000","last_became_active":"2023-07-14T12:52:47.116052+0000","last_became_peered":"2023-07-14T12:52:47.116052+0000","last_unstale":"2023-07-14T12:52:48.578420+0000","last_undegraded":"2023-07-14T12:52:48.578420+0000","last_fullsized":"2023-07-14T12:52:48.578420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:20:39.785240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.559199+0000","last_change":"2023-07-14T12:52:47.113963+0000","last_active":"2023-07-14T12:52:48.559199+0000","last_peered":"2023-07-14T12:52:48.559199+0000","last_clean":"2023-07-14T12:52:48.559199+0000","last_became_active":"2023-07-14T12:52:47.113636+0000","last_became_peered":"2023-07-14T12:52:47.113636+0000","last_unstale":"2023-07-14T12:52:48.559199+0000","last_undegraded":"2023-07-14T12:52:48.559199+0000","last_fullsized":"2023-07-14T12:52:48.559199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:14:51.124935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.096450+0000","last_change":"2023-07-14T12:52:47.114586+0000","last_active":"2023-07-14T12:52:48.096450+0000","last_peered":"2023-07-14T12:52:48.096450+0000","last_clean":"2023-07-14T12:52:48.096450+0000","last_became_active":"2023-07-14T12:52:47.114296+0000","last_became_peered":"2023-07-14T12:52:47.114296+0000","last_unstale":"2023-07-14T12:52:48.096450+0000","last_undegraded":"2023-07-14T12:52:48.096450+0000","last_fullsized":"2023-07-14T12:52:48.096450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:34.490036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.099214+0000","last_change":"2023-07-14T12:52:47.118226+0000","last_active":"2023-07-14T12:52:48.099214+0000","last_peered":"2023-07-14T12:52:48.099214+0000","last_clean":"2023-07-14T12:52:48.099214+0000","last_became_active":"2023-07-14T12:52:47.117714+0000","last_became_peered":"2023-07-14T12:52:47.117714+0000","last_unstale":"2023-07-14T12:52:48.099214+0000","last_undegraded":"2023-07-14T12:52:48.099214+0000","last_fullsized":"2023-07-14T12:52:48.099214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:46:49.508817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.096018+0000","last_change":"2023-07-14T12:52:47.120308+0000","last_active":"2023-07-14T12:52:48.096018+0000","last_peered":"2023-07-14T12:52:48.096018+0000","last_clean":"2023-07-14T12:52:48.096018+0000","last_became_active":"2023-07-14T12:52:47.119847+0000","last_became_peered":"2023-07-14T12:52:47.119847+0000","last_unstale":"2023-07-14T12:52:48.096018+0000","last_undegraded":"2023-07-14T12:52:48.096018+0000","last_fullsized":"2023-07-14T12:52:48.096018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:50:56.655801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.235609+0000","last_change":"2023-07-14T12:52:47.127275+0000","last_active":"2023-07-14T12:52:49.235609+0000","last_peered":"2023-07-14T12:52:49.235609+0000","last_clean":"2023-07-14T12:52:49.235609+0000","last_became_active":"2023-07-14T12:52:47.126883+0000","last_became_peered":"2023-07-14T12:52:47.126883+0000","last_unstale":"2023-07-14T12:52:49.235609+0000","last_undegraded":"2023-07-14T12:52:49.235609+0000","last_fullsized":"2023-07-14T12:52:49.235609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:26:00.737284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.096706+0000","last_change":"2023-07-14T12:52:47.121988+0000","last_active":"2023-07-14T12:52:48.096706+0000","last_peered":"2023-07-14T12:52:48.096706+0000","last_clean":"2023-07-14T12:52:48.096706+0000","last_became_active":"2023-07-14T12:52:47.121687+0000","last_became_peered":"2023-07-14T12:52:47.121687+0000","last_unstale":"2023-07-14T12:52:48.096706+0000","last_undegraded":"2023-07-14T12:52:48.096706+0000","last_fullsized":"2023-07-14T12:52:48.096706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:14:51.124935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.053276+0000","last_change":"2023-07-14T12:52:46.094170+0000","last_active":"2023-07-14T12:52:49.053276+0000","last_peered":"2023-07-14T12:52:49.053276+0000","last_clean":"2023-07-14T12:52:49.053276+0000","last_became_active":"2023-07-14T12:52:46.093847+0000","last_became_peered":"2023-07-14T12:52:46.093847+0000","last_unstale":"2023-07-14T12:52:49.053276+0000","last_undegraded":"2023-07-14T12:52:49.053276+0000","last_fullsized":"2023-07-14T12:52:49.053276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:46:48.497711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578591+0000","last_change":"2023-07-14T12:52:47.117512+0000","last_active":"2023-07-14T12:52:48.578591+0000","last_peered":"2023-07-14T12:52:48.578591+0000","last_clean":"2023-07-14T12:52:48.578591+0000","last_became_active":"2023-07-14T12:52:47.117268+0000","last_became_peered":"2023-07-14T12:52:47.117268+0000","last_unstale":"2023-07-14T12:52:48.578591+0000","last_undegraded":"2023-07-14T12:52:48.578591+0000","last_fullsized":"2023-07-14T12:52:48.578591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:18:16.031557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.335126+0000","last_change":"2023-07-14T12:52:46.086633+0000","last_active":"2023-07-14T12:52:49.335126+0000","last_peered":"2023-07-14T12:52:49.335126+0000","last_clean":"2023-07-14T12:52:49.335126+0000","last_became_active":"2023-07-14T12:52:46.084673+0000","last_became_peered":"2023-07-14T12:52:46.084673+0000","last_unstale":"2023-07-14T12:52:49.335126+0000","last_undegraded":"2023-07-14T12:52:49.335126+0000","last_fullsized":"2023-07-14T12:52:49.335126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:23:36.193943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.336053+0000","last_change":"2023-07-14T12:52:47.111606+0000","last_active":"2023-07-14T12:52:49.336053+0000","last_peered":"2023-07-14T12:52:49.336053+0000","last_clean":"2023-07-14T12:52:49.336053+0000","last_became_active":"2023-07-14T12:52:47.111132+0000","last_became_peered":"2023-07-14T12:52:47.111132+0000","last_unstale":"2023-07-14T12:52:49.336053+0000","last_undegraded":"2023-07-14T12:52:49.336053+0000","last_fullsized":"2023-07-14T12:52:49.336053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:14:51.124935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.053223+0000","last_change":"2023-07-14T12:52:46.094259+0000","last_active":"2023-07-14T12:52:49.053223+0000","last_peered":"2023-07-14T12:52:49.053223+0000","last_clean":"2023-07-14T12:52:49.053223+0000","last_became_active":"2023-07-14T12:52:46.093946+0000","last_became_peered":"2023-07-14T12:52:46.093946+0000","last_unstale":"2023-07-14T12:52:49.053223+0000","last_undegraded":"2023-07-14T12:52:49.053223+0000","last_fullsized":"2023-07-14T12:52:49.053223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:49:38.237108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.097011+0000","last_change":"2023-07-14T12:52:47.109858+0000","last_active":"2023-07-14T12:52:48.097011+0000","last_peered":"2023-07-14T12:52:48.097011+0000","last_clean":"2023-07-14T12:52:48.097011+0000","last_became_active":"2023-07-14T12:52:47.109547+0000","last_became_peered":"2023-07-14T12:52:47.109547+0000","last_unstale":"2023-07-14T12:52:48.097011+0000","last_undegraded":"2023-07-14T12:52:48.097011+0000","last_fullsized":"2023-07-14T12:52:48.097011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:27:19.463584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.235838+0000","last_change":"2023-07-14T12:52:46.083042+0000","last_active":"2023-07-14T12:52:49.235838+0000","last_peered":"2023-07-14T12:52:49.235838+0000","last_clean":"2023-07-14T12:52:49.235838+0000","last_became_active":"2023-07-14T12:52:46.082506+0000","last_became_peered":"2023-07-14T12:52:46.082506+0000","last_unstale":"2023-07-14T12:52:49.235838+0000","last_undegraded":"2023-07-14T12:52:49.235838+0000","last_fullsized":"2023-07-14T12:52:49.235838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:29.861396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.053554+0000","last_change":"2023-07-14T12:52:46.088541+0000","last_active":"2023-07-14T12:52:49.053554+0000","last_peered":"2023-07-14T12:52:49.053554+0000","last_clean":"2023-07-14T12:52:49.053554+0000","last_became_active":"2023-07-14T12:52:46.088185+0000","last_became_peered":"2023-07-14T12:52:46.088185+0000","last_unstale":"2023-07-14T12:52:49.053554+0000","last_undegraded":"2023-07-14T12:52:49.053554+0000","last_fullsized":"2023-07-14T12:52:49.053554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:57.775215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578183+0000","last_change":"2023-07-14T12:52:47.115030+0000","last_active":"2023-07-14T12:52:48.578183+0000","last_peered":"2023-07-14T12:52:48.578183+0000","last_clean":"2023-07-14T12:52:48.578183+0000","last_became_active":"2023-07-14T12:52:47.114732+0000","last_became_peered":"2023-07-14T12:52:47.114732+0000","last_unstale":"2023-07-14T12:52:48.578183+0000","last_undegraded":"2023-07-14T12:52:48.578183+0000","last_fullsized":"2023-07-14T12:52:48.578183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:37:59.704093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.053486+0000","last_change":"2023-07-14T12:52:46.089168+0000","last_active":"2023-07-14T12:52:49.053486+0000","last_peered":"2023-07-14T12:52:49.053486+0000","last_clean":"2023-07-14T12:52:49.053486+0000","last_became_active":"2023-07-14T12:52:46.088899+0000","last_became_peered":"2023-07-14T12:52:46.088899+0000","last_unstale":"2023-07-14T12:52:49.053486+0000","last_undegraded":"2023-07-14T12:52:49.053486+0000","last_fullsized":"2023-07-14T12:52:49.053486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:21:00.344710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.098194+0000","last_change":"2023-07-14T12:52:47.113901+0000","last_active":"2023-07-14T12:52:48.098194+0000","last_peered":"2023-07-14T12:52:48.098194+0000","last_clean":"2023-07-14T12:52:48.098194+0000","last_became_active":"2023-07-14T12:52:47.113606+0000","last_became_peered":"2023-07-14T12:52:47.113606+0000","last_unstale":"2023-07-14T12:52:48.098194+0000","last_undegraded":"2023-07-14T12:52:48.098194+0000","last_fullsized":"2023-07-14T12:52:48.098194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:45:17.631684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.053233+0000","last_change":"2023-07-14T12:52:46.091961+0000","last_active":"2023-07-14T12:52:49.053233+0000","last_peered":"2023-07-14T12:52:49.053233+0000","last_clean":"2023-07-14T12:52:49.053233+0000","last_became_active":"2023-07-14T12:52:46.091673+0000","last_became_peered":"2023-07-14T12:52:46.091673+0000","last_unstale":"2023-07-14T12:52:49.053233+0000","last_undegraded":"2023-07-14T12:52:49.053233+0000","last_fullsized":"2023-07-14T12:52:49.053233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:45:38.003340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.235848+0000","last_change":"2023-07-14T12:52:47.120755+0000","last_active":"2023-07-14T12:52:49.235848+0000","last_peered":"2023-07-14T12:52:49.235848+0000","last_clean":"2023-07-14T12:52:49.235848+0000","last_became_active":"2023-07-14T12:52:47.120428+0000","last_became_peered":"2023-07-14T12:52:47.120428+0000","last_unstale":"2023-07-14T12:52:49.235848+0000","last_undegraded":"2023-07-14T12:52:49.235848+0000","last_fullsized":"2023-07-14T12:52:49.235848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:39:09.060324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578457+0000","last_change":"2023-07-14T12:52:46.081037+0000","last_active":"2023-07-14T12:52:48.578457+0000","last_peered":"2023-07-14T12:52:48.578457+0000","last_clean":"2023-07-14T12:52:48.578457+0000","last_became_active":"2023-07-14T12:52:46.080737+0000","last_became_peered":"2023-07-14T12:52:46.080737+0000","last_unstale":"2023-07-14T12:52:48.578457+0000","last_undegraded":"2023-07-14T12:52:48.578457+0000","last_fullsized":"2023-07-14T12:52:48.578457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:46:00.245475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.335654+0000","last_change":"2023-07-14T12:52:47.120358+0000","last_active":"2023-07-14T12:52:49.335654+0000","last_peered":"2023-07-14T12:52:49.335654+0000","last_clean":"2023-07-14T12:52:49.335654+0000","last_became_active":"2023-07-14T12:52:47.119985+0000","last_became_peered":"2023-07-14T12:52:47.119985+0000","last_unstale":"2023-07-14T12:52:49.335654+0000","last_undegraded":"2023-07-14T12:52:49.335654+0000","last_fullsized":"2023-07-14T12:52:49.335654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:45:17.631684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.096492+0000","last_change":"2023-07-14T12:52:46.085362+0000","last_active":"2023-07-14T12:52:48.096492+0000","last_peered":"2023-07-14T12:52:48.096492+0000","last_clean":"2023-07-14T12:52:48.096492+0000","last_became_active":"2023-07-14T12:52:46.084995+0000","last_became_peered":"2023-07-14T12:52:46.084995+0000","last_unstale":"2023-07-14T12:52:48.096492+0000","last_undegraded":"2023-07-14T12:52:48.096492+0000","last_fullsized":"2023-07-14T12:52:48.096492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:32:47.432248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.098831+0000","last_change":"2023-07-14T12:52:47.116159+0000","last_active":"2023-07-14T12:52:48.098831+0000","last_peered":"2023-07-14T12:52:48.098831+0000","last_clean":"2023-07-14T12:52:48.098831+0000","last_became_active":"2023-07-14T12:52:47.115435+0000","last_became_peered":"2023-07-14T12:52:47.115435+0000","last_unstale":"2023-07-14T12:52:48.098831+0000","last_undegraded":"2023-07-14T12:52:48.098831+0000","last_fullsized":"2023-07-14T12:52:48.098831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:18:16.031557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.235811+0000","last_change":"2023-07-14T12:52:46.093095+0000","last_active":"2023-07-14T12:52:49.235811+0000","last_peered":"2023-07-14T12:52:49.235811+0000","last_clean":"2023-07-14T12:52:49.235811+0000","last_became_active":"2023-07-14T12:52:46.092806+0000","last_became_peered":"2023-07-14T12:52:46.092806+0000","last_unstale":"2023-07-14T12:52:49.235811+0000","last_undegraded":"2023-07-14T12:52:49.235811+0000","last_fullsized":"2023-07-14T12:52:49.235811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:23.277268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.099359+0000","last_change":"2023-07-14T12:52:47.117743+0000","last_active":"2023-07-14T12:52:48.099359+0000","last_peered":"2023-07-14T12:52:48.099359+0000","last_clean":"2023-07-14T12:52:48.099359+0000","last_became_active":"2023-07-14T12:52:47.117463+0000","last_became_peered":"2023-07-14T12:52:47.117463+0000","last_unstale":"2023-07-14T12:52:48.099359+0000","last_undegraded":"2023-07-14T12:52:48.099359+0000","last_fullsized":"2023-07-14T12:52:48.099359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:24:10.521420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.098477+0000","last_change":"2023-07-14T12:52:46.084899+0000","last_active":"2023-07-14T12:52:48.098477+0000","last_peered":"2023-07-14T12:52:48.098477+0000","last_clean":"2023-07-14T12:52:48.098477+0000","last_became_active":"2023-07-14T12:52:46.084636+0000","last_became_peered":"2023-07-14T12:52:46.084636+0000","last_unstale":"2023-07-14T12:52:48.098477+0000","last_undegraded":"2023-07-14T12:52:48.098477+0000","last_fullsized":"2023-07-14T12:52:48.098477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:45:21.373943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.099117+0000","last_change":"2023-07-14T12:52:47.114756+0000","last_active":"2023-07-14T12:52:48.099117+0000","last_peered":"2023-07-14T12:52:48.099117+0000","last_clean":"2023-07-14T12:52:48.099117+0000","last_became_active":"2023-07-14T12:52:47.114480+0000","last_became_peered":"2023-07-14T12:52:47.114480+0000","last_unstale":"2023-07-14T12:52:48.099117+0000","last_undegraded":"2023-07-14T12:52:48.099117+0000","last_fullsized":"2023-07-14T12:52:48.099117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:06:17.091034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.096213+0000","last_change":"2023-07-14T12:52:46.090947+0000","last_active":"2023-07-14T12:52:48.096213+0000","last_peered":"2023-07-14T12:52:48.096213+0000","last_clean":"2023-07-14T12:52:48.096213+0000","last_became_active":"2023-07-14T12:52:46.090670+0000","last_became_peered":"2023-07-14T12:52:46.090670+0000","last_unstale":"2023-07-14T12:52:48.096213+0000","last_undegraded":"2023-07-14T12:52:48.096213+0000","last_fullsized":"2023-07-14T12:52:48.096213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:30:02.269569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.559266+0000","last_change":"2023-07-14T12:52:47.124181+0000","last_active":"2023-07-14T12:52:48.559266+0000","last_peered":"2023-07-14T12:52:48.559266+0000","last_clean":"2023-07-14T12:52:48.559266+0000","last_became_active":"2023-07-14T12:52:47.123815+0000","last_became_peered":"2023-07-14T12:52:47.123815+0000","last_unstale":"2023-07-14T12:52:48.559266+0000","last_undegraded":"2023-07-14T12:52:48.559266+0000","last_fullsized":"2023-07-14T12:52:48.559266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:27:19.463584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.053536+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T12:52:49.053536+0000","last_peered":"2023-07-14T12:52:49.053536+0000","last_clean":"2023-07-14T12:52:49.053536+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T12:52:49.053536+0000","last_undegraded":"2023-07-14T12:52:49.053536+0000","last_fullsized":"2023-07-14T12:52:49.053536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:22:41.635255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578324+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T12:52:48.578324+0000","last_peered":"2023-07-14T12:52:48.578324+0000","last_clean":"2023-07-14T12:52:48.578324+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T12:52:48.578324+0000","last_undegraded":"2023-07-14T12:52:48.578324+0000","last_fullsized":"2023-07-14T12:52:48.578324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:28.445614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.096574+0000","last_change":"2023-07-14T12:52:46.083051+0000","last_active":"2023-07-14T12:52:48.096574+0000","last_peered":"2023-07-14T12:52:48.096574+0000","last_clean":"2023-07-14T12:52:48.096574+0000","last_became_active":"2023-07-14T12:52:46.082304+0000","last_became_peered":"2023-07-14T12:52:46.082304+0000","last_unstale":"2023-07-14T12:52:48.096574+0000","last_undegraded":"2023-07-14T12:52:48.096574+0000","last_fullsized":"2023-07-14T12:52:48.096574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:20:38.774133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.235809+0000","last_change":"2023-07-14T12:52:47.122248+0000","last_active":"2023-07-14T12:52:49.235809+0000","last_peered":"2023-07-14T12:52:49.235809+0000","last_clean":"2023-07-14T12:52:49.235809+0000","last_became_active":"2023-07-14T12:52:47.121773+0000","last_became_peered":"2023-07-14T12:52:47.121773+0000","last_unstale":"2023-07-14T12:52:49.235809+0000","last_undegraded":"2023-07-14T12:52:49.235809+0000","last_fullsized":"2023-07-14T12:52:49.235809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:43.338222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.052830+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T12:52:49.052830+0000","last_peered":"2023-07-14T12:52:49.052830+0000","last_clean":"2023-07-14T12:52:49.052830+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T12:52:49.052830+0000","last_undegraded":"2023-07-14T12:52:49.052830+0000","last_fullsized":"2023-07-14T12:52:49.052830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:14:45.080513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.335425+0000","last_change":"2023-07-14T12:52:46.093346+0000","last_active":"2023-07-14T12:52:49.335425+0000","last_peered":"2023-07-14T12:52:49.335425+0000","last_clean":"2023-07-14T12:52:49.335425+0000","last_became_active":"2023-07-14T12:52:46.093008+0000","last_became_peered":"2023-07-14T12:52:46.093008+0000","last_unstale":"2023-07-14T12:52:49.335425+0000","last_undegraded":"2023-07-14T12:52:49.335425+0000","last_fullsized":"2023-07-14T12:52:49.335425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:45.104755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.335794+0000","last_change":"2023-07-14T12:52:47.120008+0000","last_active":"2023-07-14T12:52:49.335794+0000","last_peered":"2023-07-14T12:52:49.335794+0000","last_clean":"2023-07-14T12:52:49.335794+0000","last_became_active":"2023-07-14T12:52:47.119629+0000","last_became_peered":"2023-07-14T12:52:47.119629+0000","last_unstale":"2023-07-14T12:52:49.335794+0000","last_undegraded":"2023-07-14T12:52:49.335794+0000","last_fullsized":"2023-07-14T12:52:49.335794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:08:09.613480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.334631+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T12:52:49.334631+0000","last_peered":"2023-07-14T12:52:49.334631+0000","last_clean":"2023-07-14T12:52:49.334631+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T12:52:49.334631+0000","last_undegraded":"2023-07-14T12:52:49.334631+0000","last_fullsized":"2023-07-14T12:52:49.334631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:25:54.692862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.558708+0000","last_change":"2023-07-14T12:52:46.082644+0000","last_active":"2023-07-14T12:52:48.558708+0000","last_peered":"2023-07-14T12:52:48.558708+0000","last_clean":"2023-07-14T12:52:48.558708+0000","last_became_active":"2023-07-14T12:52:46.082010+0000","last_became_peered":"2023-07-14T12:52:46.082010+0000","last_unstale":"2023-07-14T12:52:48.558708+0000","last_undegraded":"2023-07-14T12:52:48.558708+0000","last_fullsized":"2023-07-14T12:52:48.558708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:08:08.602374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.559366+0000","last_change":"2023-07-14T12:52:47.112236+0000","last_active":"2023-07-14T12:52:48.559366+0000","last_peered":"2023-07-14T12:52:48.559366+0000","last_clean":"2023-07-14T12:52:48.559366+0000","last_became_active":"2023-07-14T12:52:47.111932+0000","last_became_peered":"2023-07-14T12:52:47.111932+0000","last_unstale":"2023-07-14T12:52:48.559366+0000","last_undegraded":"2023-07-14T12:52:48.559366+0000","last_fullsized":"2023-07-14T12:52:48.559366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:45:39.014447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578431+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T12:52:48.578431+0000","last_peered":"2023-07-14T12:52:48.578431+0000","last_clean":"2023-07-14T12:52:48.578431+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T12:52:48.578431+0000","last_undegraded":"2023-07-14T12:52:48.578431+0000","last_fullsized":"2023-07-14T12:52:48.578431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:32:42.398933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.098648+0000","last_change":"2023-07-14T12:52:46.093820+0000","last_active":"2023-07-14T12:52:48.098648+0000","last_peered":"2023-07-14T12:52:48.098648+0000","last_clean":"2023-07-14T12:52:48.098648+0000","last_became_active":"2023-07-14T12:52:46.093558+0000","last_became_peered":"2023-07-14T12:52:46.093558+0000","last_unstale":"2023-07-14T12:52:48.098648+0000","last_undegraded":"2023-07-14T12:52:48.098648+0000","last_fullsized":"2023-07-14T12:52:48.098648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:14:50.113829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.559046+0000","last_change":"2023-07-14T12:52:47.127415+0000","last_active":"2023-07-14T12:52:48.559046+0000","last_peered":"2023-07-14T12:52:48.559046+0000","last_clean":"2023-07-14T12:52:48.559046+0000","last_became_active":"2023-07-14T12:52:47.127167+0000","last_became_peered":"2023-07-14T12:52:47.127167+0000","last_unstale":"2023-07-14T12:52:48.559046+0000","last_undegraded":"2023-07-14T12:52:48.559046+0000","last_fullsized":"2023-07-14T12:52:48.559046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:32:48.443355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578740+0000","last_change":"2023-07-14T12:52:46.090967+0000","last_active":"2023-07-14T12:52:48.578740+0000","last_peered":"2023-07-14T12:52:48.578740+0000","last_clean":"2023-07-14T12:52:48.578740+0000","last_became_active":"2023-07-14T12:52:46.087916+0000","last_became_peered":"2023-07-14T12:52:46.087916+0000","last_unstale":"2023-07-14T12:52:48.578740+0000","last_undegraded":"2023-07-14T12:52:48.578740+0000","last_fullsized":"2023-07-14T12:52:48.578740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:45:38.003340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.559302+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T12:52:48.559302+0000","last_peered":"2023-07-14T12:52:48.559302+0000","last_clean":"2023-07-14T12:52:48.559302+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T12:52:48.559302+0000","last_undegraded":"2023-07-14T12:52:48.559302+0000","last_fullsized":"2023-07-14T12:52:48.559302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:06:11.046612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.559006+0000","last_change":"2023-07-14T12:52:47.112617+0000","last_active":"2023-07-14T12:52:48.559006+0000","last_peered":"2023-07-14T12:52:48.559006+0000","last_clean":"2023-07-14T12:52:48.559006+0000","last_became_active":"2023-07-14T12:52:47.112317+0000","last_became_peered":"2023-07-14T12:52:47.112317+0000","last_unstale":"2023-07-14T12:52:48.559006+0000","last_undegraded":"2023-07-14T12:52:48.559006+0000","last_fullsized":"2023-07-14T12:52:48.559006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:34.490036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.559048+0000","last_change":"2023-07-14T12:52:46.082409+0000","last_active":"2023-07-14T12:52:48.559048+0000","last_peered":"2023-07-14T12:52:48.559048+0000","last_clean":"2023-07-14T12:52:48.559048+0000","last_became_active":"2023-07-14T12:52:46.082027+0000","last_became_peered":"2023-07-14T12:52:46.082027+0000","last_unstale":"2023-07-14T12:52:48.559048+0000","last_undegraded":"2023-07-14T12:52:48.559048+0000","last_fullsized":"2023-07-14T12:52:48.559048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:20:38.774133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.053522+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T12:52:49.053522+0000","last_peered":"2023-07-14T12:52:49.053522+0000","last_clean":"2023-07-14T12:52:49.053522+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T12:52:49.053522+0000","last_undegraded":"2023-07-14T12:52:49.053522+0000","last_fullsized":"2023-07-14T12:52:49.053522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:24:04.476998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.335686+0000","last_change":"2023-07-14T12:52:47.118665+0000","last_active":"2023-07-14T12:52:49.335686+0000","last_peered":"2023-07-14T12:52:49.335686+0000","last_clean":"2023-07-14T12:52:49.335686+0000","last_became_active":"2023-07-14T12:52:47.118454+0000","last_became_peered":"2023-07-14T12:52:47.118454+0000","last_unstale":"2023-07-14T12:52:49.335686+0000","last_undegraded":"2023-07-14T12:52:49.335686+0000","last_fullsized":"2023-07-14T12:52:49.335686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:37:59.704093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.097139+0000","last_change":"2023-07-14T12:52:46.090135+0000","last_active":"2023-07-14T12:52:48.097139+0000","last_peered":"2023-07-14T12:52:48.097139+0000","last_clean":"2023-07-14T12:52:48.097139+0000","last_became_active":"2023-07-14T12:52:46.089807+0000","last_became_peered":"2023-07-14T12:52:46.089807+0000","last_unstale":"2023-07-14T12:52:48.097139+0000","last_undegraded":"2023-07-14T12:52:48.097139+0000","last_fullsized":"2023-07-14T12:52:48.097139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:46:00.245475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.559288+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T12:52:48.559288+0000","last_peered":"2023-07-14T12:52:48.559288+0000","last_clean":"2023-07-14T12:52:48.559288+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T12:52:48.559288+0000","last_undegraded":"2023-07-14T12:52:48.559288+0000","last_fullsized":"2023-07-14T12:52:48.559288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:45:55.212159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.096149+0000","last_change":"2023-07-14T12:52:47.114917+0000","last_active":"2023-07-14T12:52:48.096149+0000","last_peered":"2023-07-14T12:52:48.096149+0000","last_clean":"2023-07-14T12:52:48.096149+0000","last_became_active":"2023-07-14T12:52:47.114437+0000","last_became_peered":"2023-07-14T12:52:47.114437+0000","last_unstale":"2023-07-14T12:52:48.096149+0000","last_undegraded":"2023-07-14T12:52:48.096149+0000","last_fullsized":"2023-07-14T12:52:48.096149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:08:09.613480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.336066+0000","last_change":"2023-07-14T12:52:46.089258+0000","last_active":"2023-07-14T12:52:49.336066+0000","last_peered":"2023-07-14T12:52:49.336066+0000","last_clean":"2023-07-14T12:52:49.336066+0000","last_became_active":"2023-07-14T12:52:46.088621+0000","last_became_peered":"2023-07-14T12:52:46.088621+0000","last_unstale":"2023-07-14T12:52:49.336066+0000","last_undegraded":"2023-07-14T12:52:49.336066+0000","last_fullsized":"2023-07-14T12:52:49.336066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:20:38.774133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.236084+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T12:52:49.236084+0000","last_peered":"2023-07-14T12:52:49.236084+0000","last_clean":"2023-07-14T12:52:49.236084+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T12:52:49.236084+0000","last_undegraded":"2023-07-14T12:52:49.236084+0000","last_fullsized":"2023-07-14T12:52:49.236084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:05:33.923291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.098637+0000","last_change":"2023-07-14T12:52:47.108704+0000","last_active":"2023-07-14T12:52:48.098637+0000","last_peered":"2023-07-14T12:52:48.098637+0000","last_clean":"2023-07-14T12:52:48.098637+0000","last_became_active":"2023-07-14T12:52:47.108394+0000","last_became_peered":"2023-07-14T12:52:47.108394+0000","last_unstale":"2023-07-14T12:52:48.098637+0000","last_undegraded":"2023-07-14T12:52:48.098637+0000","last_fullsized":"2023-07-14T12:52:48.098637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:20:39.785240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.098558+0000","last_change":"2023-07-14T12:52:47.117094+0000","last_active":"2023-07-14T12:52:48.098558+0000","last_peered":"2023-07-14T12:52:48.098558+0000","last_clean":"2023-07-14T12:52:48.098558+0000","last_became_active":"2023-07-14T12:52:47.116803+0000","last_became_peered":"2023-07-14T12:52:47.116803+0000","last_unstale":"2023-07-14T12:52:48.098558+0000","last_undegraded":"2023-07-14T12:52:48.098558+0000","last_fullsized":"2023-07-14T12:52:48.098558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:32:48.443355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.099010+0000","last_change":"2023-07-14T12:52:46.084583+0000","last_active":"2023-07-14T12:52:48.099010+0000","last_peered":"2023-07-14T12:52:48.099010+0000","last_clean":"2023-07-14T12:52:48.099010+0000","last_became_active":"2023-07-14T12:52:46.083903+0000","last_became_peered":"2023-07-14T12:52:46.083903+0000","last_unstale":"2023-07-14T12:52:48.099010+0000","last_undegraded":"2023-07-14T12:52:48.099010+0000","last_fullsized":"2023-07-14T12:52:48.099010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:27:18.452478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.558918+0000","last_change":"2023-07-14T12:52:47.117195+0000","last_active":"2023-07-14T12:52:48.558918+0000","last_peered":"2023-07-14T12:52:48.558918+0000","last_clean":"2023-07-14T12:52:48.558918+0000","last_became_active":"2023-07-14T12:52:47.116928+0000","last_became_peered":"2023-07-14T12:52:47.116928+0000","last_unstale":"2023-07-14T12:52:48.558918+0000","last_undegraded":"2023-07-14T12:52:48.558918+0000","last_fullsized":"2023-07-14T12:52:48.558918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:45:22.385049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.053173+0000","last_change":"2023-07-14T12:52:46.094565+0000","last_active":"2023-07-14T12:52:49.053173+0000","last_peered":"2023-07-14T12:52:49.053173+0000","last_clean":"2023-07-14T12:52:49.053173+0000","last_became_active":"2023-07-14T12:52:46.094318+0000","last_became_peered":"2023-07-14T12:52:46.094318+0000","last_unstale":"2023-07-14T12:52:49.053173+0000","last_undegraded":"2023-07-14T12:52:49.053173+0000","last_fullsized":"2023-07-14T12:52:49.053173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:46:00.245475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578723+0000","last_change":"2023-07-14T12:52:46.086205+0000","last_active":"2023-07-14T12:52:48.578723+0000","last_peered":"2023-07-14T12:52:48.578723+0000","last_clean":"2023-07-14T12:52:48.578723+0000","last_became_active":"2023-07-14T12:52:46.085742+0000","last_became_peered":"2023-07-14T12:52:46.085742+0000","last_unstale":"2023-07-14T12:52:48.578723+0000","last_undegraded":"2023-07-14T12:52:48.578723+0000","last_fullsized":"2023-07-14T12:52:48.578723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:06:16.079927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.096154+0000","last_change":"2023-07-14T12:52:47.114145+0000","last_active":"2023-07-14T12:52:48.096154+0000","last_peered":"2023-07-14T12:52:48.096154+0000","last_clean":"2023-07-14T12:52:48.096154+0000","last_became_active":"2023-07-14T12:52:47.113888+0000","last_became_peered":"2023-07-14T12:52:47.113888+0000","last_unstale":"2023-07-14T12:52:48.096154+0000","last_undegraded":"2023-07-14T12:52:48.096154+0000","last_fullsized":"2023-07-14T12:52:48.096154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:37:59.704093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.336110+0000","last_change":"2023-07-14T12:52:46.088585+0000","last_active":"2023-07-14T12:52:49.336110+0000","last_peered":"2023-07-14T12:52:49.336110+0000","last_clean":"2023-07-14T12:52:49.336110+0000","last_became_active":"2023-07-14T12:52:46.088263+0000","last_became_peered":"2023-07-14T12:52:46.088263+0000","last_unstale":"2023-07-14T12:52:49.336110+0000","last_undegraded":"2023-07-14T12:52:49.336110+0000","last_fullsized":"2023-07-14T12:52:49.336110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:49:07.501108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.095955+0000","last_change":"2023-07-14T12:52:47.119037+0000","last_active":"2023-07-14T12:52:48.095955+0000","last_peered":"2023-07-14T12:52:48.095955+0000","last_clean":"2023-07-14T12:52:48.095955+0000","last_became_active":"2023-07-14T12:52:47.118770+0000","last_became_peered":"2023-07-14T12:52:47.118770+0000","last_unstale":"2023-07-14T12:52:48.095955+0000","last_undegraded":"2023-07-14T12:52:48.095955+0000","last_fullsized":"2023-07-14T12:52:48.095955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:01:37.466387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.236050+0000","last_change":"2023-07-14T12:52:47.112620+0000","last_active":"2023-07-14T12:52:49.236050+0000","last_peered":"2023-07-14T12:52:49.236050+0000","last_clean":"2023-07-14T12:52:49.236050+0000","last_became_active":"2023-07-14T12:52:47.112372+0000","last_became_peered":"2023-07-14T12:52:47.112372+0000","last_unstale":"2023-07-14T12:52:49.236050+0000","last_undegraded":"2023-07-14T12:52:49.236050+0000","last_fullsized":"2023-07-14T12:52:49.236050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:52:25.699239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.096094+0000","last_change":"2023-07-14T12:52:46.086638+0000","last_active":"2023-07-14T12:52:48.096094+0000","last_peered":"2023-07-14T12:52:48.096094+0000","last_clean":"2023-07-14T12:52:48.096094+0000","last_became_active":"2023-07-14T12:52:46.085797+0000","last_became_peered":"2023-07-14T12:52:46.085797+0000","last_unstale":"2023-07-14T12:52:48.096094+0000","last_undegraded":"2023-07-14T12:52:48.096094+0000","last_fullsized":"2023-07-14T12:52:48.096094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:45:16.620577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.335416+0000","last_change":"2023-07-14T12:52:47.114763+0000","last_active":"2023-07-14T12:52:49.335416+0000","last_peered":"2023-07-14T12:52:49.335416+0000","last_clean":"2023-07-14T12:52:49.335416+0000","last_became_active":"2023-07-14T12:52:47.114421+0000","last_became_peered":"2023-07-14T12:52:47.114421+0000","last_unstale":"2023-07-14T12:52:49.335416+0000","last_undegraded":"2023-07-14T12:52:49.335416+0000","last_fullsized":"2023-07-14T12:52:49.335416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:50:56.655801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.558895+0000","last_change":"2023-07-14T12:52:46.087077+0000","last_active":"2023-07-14T12:52:48.558895+0000","last_peered":"2023-07-14T12:52:48.558895+0000","last_clean":"2023-07-14T12:52:48.558895+0000","last_became_active":"2023-07-14T12:52:46.086797+0000","last_became_peered":"2023-07-14T12:52:46.086797+0000","last_unstale":"2023-07-14T12:52:48.558895+0000","last_undegraded":"2023-07-14T12:52:48.558895+0000","last_fullsized":"2023-07-14T12:52:48.558895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:30:02.269569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.096735+0000","last_change":"2023-07-14T12:52:47.118332+0000","last_active":"2023-07-14T12:52:48.096735+0000","last_peered":"2023-07-14T12:52:48.096735+0000","last_clean":"2023-07-14T12:52:48.096735+0000","last_became_active":"2023-07-14T12:52:47.118046+0000","last_became_peered":"2023-07-14T12:52:47.118046+0000","last_unstale":"2023-07-14T12:52:48.096735+0000","last_undegraded":"2023-07-14T12:52:48.096735+0000","last_fullsized":"2023-07-14T12:52:48.096735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:18:16.031557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.099026+0000","last_change":"2023-07-14T12:52:46.090684+0000","last_active":"2023-07-14T12:52:48.099026+0000","last_peered":"2023-07-14T12:52:48.099026+0000","last_clean":"2023-07-14T12:52:48.099026+0000","last_became_active":"2023-07-14T12:52:46.090365+0000","last_became_peered":"2023-07-14T12:52:46.090365+0000","last_unstale":"2023-07-14T12:52:48.099026+0000","last_undegraded":"2023-07-14T12:52:48.099026+0000","last_fullsized":"2023-07-14T12:52:48.099026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:46:00.245475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.335143+0000","last_change":"2023-07-14T12:52:47.115150+0000","last_active":"2023-07-14T12:52:49.335143+0000","last_peered":"2023-07-14T12:52:49.335143+0000","last_clean":"2023-07-14T12:52:49.335143+0000","last_became_active":"2023-07-14T12:52:47.114705+0000","last_became_peered":"2023-07-14T12:52:47.114705+0000","last_unstale":"2023-07-14T12:52:49.335143+0000","last_undegraded":"2023-07-14T12:52:49.335143+0000","last_fullsized":"2023-07-14T12:52:49.335143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:39:09.060324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.335881+0000","last_change":"2023-07-14T12:52:46.089673+0000","last_active":"2023-07-14T12:52:49.335881+0000","last_peered":"2023-07-14T12:52:49.335881+0000","last_clean":"2023-07-14T12:52:49.335881+0000","last_became_active":"2023-07-14T12:52:46.088813+0000","last_became_peered":"2023-07-14T12:52:46.088813+0000","last_unstale":"2023-07-14T12:52:49.335881+0000","last_undegraded":"2023-07-14T12:52:49.335881+0000","last_fullsized":"2023-07-14T12:52:49.335881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:45:21.373943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.098458+0000","last_change":"2023-07-14T12:52:47.110872+0000","last_active":"2023-07-14T12:52:48.098458+0000","last_peered":"2023-07-14T12:52:48.098458+0000","last_clean":"2023-07-14T12:52:48.098458+0000","last_became_active":"2023-07-14T12:52:47.110526+0000","last_became_peered":"2023-07-14T12:52:47.110526+0000","last_unstale":"2023-07-14T12:52:48.098458+0000","last_undegraded":"2023-07-14T12:52:48.098458+0000","last_fullsized":"2023-07-14T12:52:48.098458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:34.490036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578254+0000","last_change":"2023-07-14T12:52:46.090553+0000","last_active":"2023-07-14T12:52:48.578254+0000","last_peered":"2023-07-14T12:52:48.578254+0000","last_clean":"2023-07-14T12:52:48.578254+0000","last_became_active":"2023-07-14T12:52:46.090136+0000","last_became_peered":"2023-07-14T12:52:46.090136+0000","last_unstale":"2023-07-14T12:52:48.578254+0000","last_undegraded":"2023-07-14T12:52:48.578254+0000","last_fullsized":"2023-07-14T12:52:48.578254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:30:02.269569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.098839+0000","last_change":"2023-07-14T12:52:47.118033+0000","last_active":"2023-07-14T12:52:48.098839+0000","last_peered":"2023-07-14T12:52:48.098839+0000","last_clean":"2023-07-14T12:52:48.098839+0000","last_became_active":"2023-07-14T12:52:47.117334+0000","last_became_peered":"2023-07-14T12:52:47.117334+0000","last_unstale":"2023-07-14T12:52:48.098839+0000","last_undegraded":"2023-07-14T12:52:48.098839+0000","last_fullsized":"2023-07-14T12:52:48.098839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:49:08.512214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.578602+0000","last_change":"2023-07-14T12:52:46.090568+0000","last_active":"2023-07-14T12:52:48.578602+0000","last_peered":"2023-07-14T12:52:48.578602+0000","last_clean":"2023-07-14T12:52:48.578602+0000","last_became_active":"2023-07-14T12:52:46.087626+0000","last_became_peered":"2023-07-14T12:52:46.087626+0000","last_unstale":"2023-07-14T12:52:48.578602+0000","last_undegraded":"2023-07-14T12:52:48.578602+0000","last_fullsized":"2023-07-14T12:52:48.578602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:27:18.452478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.096233+0000","last_change":"2023-07-14T12:52:47.126294+0000","last_active":"2023-07-14T12:52:48.096233+0000","last_peered":"2023-07-14T12:52:48.096233+0000","last_clean":"2023-07-14T12:52:48.096233+0000","last_became_active":"2023-07-14T12:52:47.125928+0000","last_became_peered":"2023-07-14T12:52:47.125928+0000","last_unstale":"2023-07-14T12:52:48.096233+0000","last_undegraded":"2023-07-14T12:52:48.096233+0000","last_fullsized":"2023-07-14T12:52:48.096233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:45:22.385049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.096853+0000","last_change":"2023-07-14T12:52:46.089467+0000","last_active":"2023-07-14T12:52:48.096853+0000","last_peered":"2023-07-14T12:52:48.096853+0000","last_clean":"2023-07-14T12:52:48.096853+0000","last_became_active":"2023-07-14T12:52:46.087179+0000","last_became_peered":"2023-07-14T12:52:46.087179+0000","last_unstale":"2023-07-14T12:52:48.096853+0000","last_undegraded":"2023-07-14T12:52:48.096853+0000","last_fullsized":"2023-07-14T12:52:48.096853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:49:07.501108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:48.098302+0000","last_change":"2023-07-14T12:52:47.118229+0000","last_active":"2023-07-14T12:52:48.098302+0000","last_peered":"2023-07-14T12:52:48.098302+0000","last_clean":"2023-07-14T12:52:48.098302+0000","last_became_active":"2023-07-14T12:52:47.117903+0000","last_became_peered":"2023-07-14T12:52:47.117903+0000","last_unstale":"2023-07-14T12:52:48.098302+0000","last_undegraded":"2023-07-14T12:52:48.098302+0000","last_fullsized":"2023-07-14T12:52:48.098302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:46.057955+0000","last_clean_scrub_stamp":"2023-07-14T12:52:46.057955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:08:09.613480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-14T12:52:49.336101+0000","last_change":"2023-07-14T12:52:46.089959+0000","last_active":"2023-07-14T12:52:49.336101+0000","last_peered":"2023-07-14T12:52:49.336101+0000","last_clean":"2023-07-14T12:52:49.336101+0000","last_became_active":"2023-07-14T12:52:46.089119+0000","last_became_peered":"2023-07-14T12:52:46.089119+0000","last_unstale":"2023-07-14T12:52:49.336101+0000","last_undegraded":"2023-07-14T12:52:49.336101+0000","last_fullsized":"2023-07-14T12:52:49.336101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.046848+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.046848+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:18:15.020451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":864256,"data_stored":681747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":249856,"data_stored":90251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":91219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31288,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340552,"statfs":{"total":96636764160,"available":96604725248,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31280,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340560,"statfs":{"total":96636764160,"available":96604733440,"internally_reserved":0,"allocated":237568,"data_stored":88580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31284,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340556,"statfs":{"total":96636764160,"available":96604729344,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":835584,"data_stored":679530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T12:52:56.661 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-14T12:52:56.661 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-14T12:52:56.662 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-14T12:52:56.662 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-14T12:52:56.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.814+0000 7fac97e96640 1 Processor -- start 2023-07-14T12:52:56.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.814+0000 7fac97e96640 1 -- start start 2023-07-14T12:52:56.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.814+0000 7fac97e96640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac900cdcd0 0x7fac900cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:56.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.814+0000 7fac97e96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac900ca750 0x7fac900cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:56.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.814+0000 7fac97e96640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac900cfaf0 con 0x7fac9006a540 2023-07-14T12:52:56.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.814+0000 7fac97e96640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac900cef10 con 0x7fac900cdcd0 2023-07-14T12:52:56.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.814+0000 7fac97e96640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac900cfdd0 con 0x7fac900ca750 2023-07-14T12:52:56.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.814+0000 7fac95431640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac900cdcd0 0x7fac900cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:56.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.814+0000 7fac95c32640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fac9006a540 0x7fac9006a910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39016/0 (socket says 172.21.15.5:39016) 2023-07-14T12:52:56.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.814+0000 7fac95c32640 1 -- 172.21.15.5:0/3285352418 learned_addr learned my addr 172.21.15.5:0/3285352418 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:56.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.818+0000 7fac96433640 1 --2- 172.21.15.5:0/3285352418 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac900ca750 0x7fac900cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:56.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.818+0000 7fac95431640 1 -- 172.21.15.5:0/3285352418 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac900ca750 msgr2=0x7fac900cabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:56.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.818+0000 7fac95431640 1 --2- 172.21.15.5:0/3285352418 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac900ca750 0x7fac900cabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:56.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.818+0000 7fac95431640 1 -- 172.21.15.5:0/3285352418 >> v1:172.21.15.5:6789/0 conn(0x7fac9006a540 legacy=0x7fac9006a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:56.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.818+0000 7fac95431640 1 -- 172.21.15.5:0/3285352418 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac900d00b0 con 0x7fac900cdcd0 2023-07-14T12:52:56.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.818+0000 7fac94c30640 1 -- 172.21.15.5:0/3285352418 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3244609875 0 0) 0x7fac900cfaf0 con 0x7fac9006a540 2023-07-14T12:52:56.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.818+0000 7fac95431640 1 --2- 172.21.15.5:0/3285352418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac900cdcd0 0x7fac900cf2a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fac800097c0 tx=0x7fac8001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0516ac1812c9212 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:56.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.818+0000 7fac94c30640 1 -- 172.21.15.5:0/3285352418 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac800a8970 con 0x7fac900cdcd0 2023-07-14T12:52:56.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.818+0000 7fac94c30640 1 -- 172.21.15.5:0/3285352418 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac800a8ad0 con 0x7fac900cdcd0 2023-07-14T12:52:56.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.818+0000 7fac94c30640 1 -- 172.21.15.5:0/3285352418 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac800a8e60 con 0x7fac900cdcd0 2023-07-14T12:52:56.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.818+0000 7fac97e96640 1 -- 172.21.15.5:0/3285352418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac900cdcd0 msgr2=0x7fac900cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:56.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.818+0000 7fac97e96640 1 --2- 172.21.15.5:0/3285352418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac900cdcd0 0x7fac900cf2a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fac800097c0 tx=0x7fac8001ec70 comp rx=0 tx=0).stop 2023-07-14T12:52:56.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.822+0000 7fac97e96640 1 -- 172.21.15.5:0/3285352418 shutdown_connections 2023-07-14T12:52:56.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.822+0000 7fac97e96640 1 --2- 172.21.15.5:0/3285352418 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac900ca750 0x7fac900cabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:56.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.822+0000 7fac97e96640 1 --2- 172.21.15.5:0/3285352418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac900cdcd0 0x7fac900cf2a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:56.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.822+0000 7fac97e96640 1 -- 172.21.15.5:0/3285352418 >> 172.21.15.5:0/3285352418 conn(0x7fac90099490 msgr2=0x7fac90089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:56.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.822+0000 7fac97e96640 1 -- 172.21.15.5:0/3285352418 shutdown_connections 2023-07-14T12:52:56.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.822+0000 7fac97e96640 1 -- 172.21.15.5:0/3285352418 wait complete. 2023-07-14T12:52:56.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.822+0000 7fac97e96640 1 Processor -- start 2023-07-14T12:52:56.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.822+0000 7fac97e96640 1 -- start start 2023-07-14T12:52:56.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.822+0000 7fac97e96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac9006a540 0x7fac90150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:56.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.822+0000 7fac97e96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac900ca750 0x7fac900b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:56.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.822+0000 7fac97e96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac900cdcd0 0x7fac900b5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:56.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.822+0000 7fac97e96640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9014dd90 con 0x7fac900cdcd0 2023-07-14T12:52:56.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.822+0000 7fac97e96640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9014e630 con 0x7fac9006a540 2023-07-14T12:52:56.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.822+0000 7fac97e96640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac900b5b50 con 0x7fac900ca750 2023-07-14T12:52:56.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.822+0000 7fac96433640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac900cdcd0 0x7fac900b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:56.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.822+0000 7fac96433640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac900cdcd0 0x7fac900b5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52948/0 (socket says 172.21.15.5:52948) 2023-07-14T12:52:56.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.822+0000 7fac96433640 1 -- 172.21.15.5:0/2132540705 learned_addr learned my addr 172.21.15.5:0/2132540705 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:56.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.822+0000 7fac95431640 1 --2- 172.21.15.5:0/2132540705 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac900ca750 0x7fac900b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:56.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.822+0000 7fac95c32640 1 --2- 172.21.15.5:0/2132540705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac9006a540 0x7fac90150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:56.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.822+0000 7fac96433640 1 -- 172.21.15.5:0/2132540705 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac900ca750 msgr2=0x7fac900b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:56.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.822+0000 7fac96433640 1 --2- 172.21.15.5:0/2132540705 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac900ca750 0x7fac900b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:56.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.822+0000 7fac96433640 1 -- 172.21.15.5:0/2132540705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac9006a540 msgr2=0x7fac90150870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.822+0000 7fac96433640 1 --2- 172.21.15.5:0/2132540705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac9006a540 0x7fac90150870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.822+0000 7fac96433640 1 -- 172.21.15.5:0/2132540705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac80009420 con 0x7fac900cdcd0 2023-07-14T12:52:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.822+0000 7fac95c32640 1 --2- 172.21.15.5:0/2132540705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac9006a540 0x7fac90150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:52:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.822+0000 7fac96433640 1 --2- 172.21.15.5:0/2132540705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac900cdcd0 0x7fac900b5610 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fac8800efc0 tx=0x7fac8800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:56.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.826+0000 7fac867fc640 1 -- 172.21.15.5:0/2132540705 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac88014480 con 0x7fac900cdcd0 2023-07-14T12:52:56.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.826+0000 7fac867fc640 1 -- 172.21.15.5:0/2132540705 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8800f040 con 0x7fac900cdcd0 2023-07-14T12:52:56.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.826+0000 7fac867fc640 1 -- 172.21.15.5:0/2132540705 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac88014820 con 0x7fac900cdcd0 2023-07-14T12:52:56.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.826+0000 7fac97e96640 1 -- 172.21.15.5:0/2132540705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac900b5e20 con 0x7fac900cdcd0 2023-07-14T12:52:56.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.826+0000 7fac97e96640 1 -- 172.21.15.5:0/2132540705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac9014e2c0 con 0x7fac900cdcd0 2023-07-14T12:52:56.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.826+0000 7fac97e96640 1 -- 172.21.15.5:0/2132540705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac9014e480 con 0x7fac900cdcd0 2023-07-14T12:52:56.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.826+0000 7fac867fc640 1 -- 172.21.15.5:0/2132540705 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fac88014980 con 0x7fac900cdcd0 2023-07-14T12:52:56.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.826+0000 7fac867fc640 1 --2- 172.21.15.5:0/2132540705 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fac740662b0 0x7fac74068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:56.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.826+0000 7fac867fc640 1 -- 172.21.15.5:0/2132540705 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fac880848f0 con 0x7fac900cdcd0 2023-07-14T12:52:56.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.826+0000 7fac95c32640 1 --2- 172.21.15.5:0/2132540705 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fac740662b0 0x7fac74068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:56.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.830+0000 7fac95c32640 1 --2- 172.21.15.5:0/2132540705 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fac740662b0 0x7fac74068760 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fac901f4020 tx=0x7fac8c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:56.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:56.830+0000 7fac867fc640 1 -- 172.21.15.5:0/2132540705 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fac88051cd0 con 0x7fac900cdcd0 2023-07-14T12:52:57.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.022+0000 7fac97e96640 1 -- 172.21.15.5:0/2132540705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fac900d0640 con 0x7fac900cdcd0 2023-07-14T12:52:57.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.022+0000 7fac867fc640 1 -- 172.21.15.5:0/2132540705 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fac880552f0 con 0x7fac900cdcd0 2023-07-14T12:52:57.049 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:52:57.049 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-14T12:52:57.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.026+0000 7fac97e96640 1 -- 172.21.15.5:0/2132540705 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fac740662b0 msgr2=0x7fac74068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:57.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.026+0000 7fac97e96640 1 --2- 172.21.15.5:0/2132540705 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fac740662b0 0x7fac74068760 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fac901f4020 tx=0x7fac8c009040 comp rx=0 tx=0).stop 2023-07-14T12:52:57.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.026+0000 7fac97e96640 1 -- 172.21.15.5:0/2132540705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac900cdcd0 msgr2=0x7fac900b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:57.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.026+0000 7fac97e96640 1 --2- 172.21.15.5:0/2132540705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac900cdcd0 0x7fac900b5610 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fac8800efc0 tx=0x7fac8800c490 comp rx=0 tx=0).stop 2023-07-14T12:52:57.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.026+0000 7fac97e96640 1 -- 172.21.15.5:0/2132540705 shutdown_connections 2023-07-14T12:52:57.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.026+0000 7fac97e96640 1 --2- 172.21.15.5:0/2132540705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac900cdcd0 0x7fac900b5610 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:57.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.026+0000 7fac97e96640 1 --2- 172.21.15.5:0/2132540705 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac900ca750 0x7fac900b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:57.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.026+0000 7fac97e96640 1 --2- 172.21.15.5:0/2132540705 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fac740662b0 0x7fac74068760 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:57.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.026+0000 7fac97e96640 1 --2- 172.21.15.5:0/2132540705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac9006a540 0x7fac90150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:57.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.026+0000 7fac97e96640 1 -- 172.21.15.5:0/2132540705 >> 172.21.15.5:0/2132540705 conn(0x7fac90099490 msgr2=0x7fac900aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:57.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.026+0000 7fac97e96640 1 -- 172.21.15.5:0/2132540705 shutdown_connections 2023-07-14T12:52:57.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.026+0000 7fac97e96640 1 -- 172.21.15.5:0/2132540705 wait complete. 2023-07-14T12:52:57.070 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-14T12:52:57.071 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:52:57.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.186+0000 7fad762f9640 1 Processor -- start 2023-07-14T12:52:57.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.186+0000 7fad762f9640 1 -- start start 2023-07-14T12:52:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.190+0000 7fad762f9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fad700d06b0 0x7fad700b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.190+0000 7fad762f9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad700b2410 con 0x7fad700b1f70 2023-07-14T12:52:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.190+0000 7fad762f9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad700b26f0 con 0x7fad70145430 2023-07-14T12:52:57.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.190+0000 7fad762f9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad700b29d0 con 0x7fad700d06b0 2023-07-14T12:52:57.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.190+0000 7fad6ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fad700d06b0 0x7fad700b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:57.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.190+0000 7fad6ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fad700d06b0 0x7fad700b1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52952/0 (socket says 172.21.15.5:52952) 2023-07-14T12:52:57.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.190+0000 7fad6ffff640 1 -- 172.21.15.5:0/265966337 learned_addr learned my addr 172.21.15.5:0/265966337 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:57.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.190+0000 7fad6ffff640 1 -- 172.21.15.5:0/265966337 >> v1:172.21.15.154:6789/0 conn(0x7fad70145430 legacy=0x7fad700b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:57.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.190+0000 7fad6ffff640 1 -- 172.21.15.5:0/265966337 >> v1:172.21.15.5:6789/0 conn(0x7fad700b1f70 legacy=0x7fad700d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:57.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.190+0000 7fad6ffff640 1 -- 172.21.15.5:0/265966337 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad700b2cb0 con 0x7fad700d06b0 2023-07-14T12:52:57.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.190+0000 7fad6effd640 1 -- 172.21.15.5:0/265966337 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937108980 0 0) 0x7fad700b2410 con 0x7fad700b1f70 2023-07-14T12:52:57.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.194+0000 7fad6ffff640 1 --2- 172.21.15.5:0/265966337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad700d06b0 0x7fad700b1a30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fad60009870 tx=0x7fad6001cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92224ff7cd1420a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:57.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.194+0000 7fad6effd640 1 -- 172.21.15.5:0/265966337 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad600a95f0 con 0x7fad700d06b0 2023-07-14T12:52:57.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.194+0000 7fad6effd640 1 -- 172.21.15.5:0/265966337 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad600a9750 con 0x7fad700d06b0 2023-07-14T12:52:57.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.194+0000 7fad6effd640 1 -- 172.21.15.5:0/265966337 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad600a9ae0 con 0x7fad700d06b0 2023-07-14T12:52:57.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.194+0000 7fad762f9640 1 -- 172.21.15.5:0/265966337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad700d06b0 msgr2=0x7fad700b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:57.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.194+0000 7fad762f9640 1 --2- 172.21.15.5:0/265966337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad700d06b0 0x7fad700b1a30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fad60009870 tx=0x7fad6001cf70 comp rx=0 tx=0).stop 2023-07-14T12:52:57.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.194+0000 7fad762f9640 1 -- 172.21.15.5:0/265966337 shutdown_connections 2023-07-14T12:52:57.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.194+0000 7fad762f9640 1 --2- 172.21.15.5:0/265966337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad700d06b0 0x7fad700b1a30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:57.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.194+0000 7fad762f9640 1 -- 172.21.15.5:0/265966337 >> 172.21.15.5:0/265966337 conn(0x7fad700659d0 msgr2=0x7fad7009b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:57.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.194+0000 7fad762f9640 1 -- 172.21.15.5:0/265966337 shutdown_connections 2023-07-14T12:52:57.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.194+0000 7fad762f9640 1 -- 172.21.15.5:0/265966337 wait complete. 2023-07-14T12:52:57.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.194+0000 7fad762f9640 1 Processor -- start 2023-07-14T12:52:57.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.194+0000 7fad762f9640 1 -- start start 2023-07-14T12:52:57.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.198+0000 7fad762f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad700b1f70 0x7fad700c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:57.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.198+0000 7fad762f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad700d06b0 0x7fad700c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:57.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.198+0000 7fad762f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad700b0db0 0x7fad700b7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:57.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.198+0000 7fad762f9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad700c54b0 con 0x7fad700b1f70 2023-07-14T12:52:57.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.198+0000 7fad762f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7015ce30 con 0x7fad700b0db0 2023-07-14T12:52:57.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.198+0000 7fad762f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad700c4ff0 con 0x7fad700d06b0 2023-07-14T12:52:57.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.198+0000 7fad6ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad700b1f70 0x7fad700c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:57.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.198+0000 7fad6ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad700b1f70 0x7fad700c44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52954/0 (socket says 172.21.15.5:52954) 2023-07-14T12:52:57.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.198+0000 7fad6ffff640 1 -- 172.21.15.5:0/2161039568 learned_addr learned my addr 172.21.15.5:0/2161039568 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:57.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.198+0000 7fad6f7fe640 1 --2- 172.21.15.5:0/2161039568 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad700d06b0 0x7fad700c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:57.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.198+0000 7fad74896640 1 --2- 172.21.15.5:0/2161039568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad700b0db0 0x7fad700b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:57.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.198+0000 7fad6ffff640 1 -- 172.21.15.5:0/2161039568 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad700d06b0 msgr2=0x7fad700c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:57.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.198+0000 7fad6ffff640 1 --2- 172.21.15.5:0/2161039568 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad700d06b0 0x7fad700c49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:57.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.198+0000 7fad6ffff640 1 -- 172.21.15.5:0/2161039568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad700b0db0 msgr2=0x7fad700b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:57.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.198+0000 7fad6ffff640 1 --2- 172.21.15.5:0/2161039568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad700b0db0 0x7fad700b7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:57.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.198+0000 7fad6ffff640 1 -- 172.21.15.5:0/2161039568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad600094d0 con 0x7fad700b1f70 2023-07-14T12:52:57.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.198+0000 7fad6ffff640 1 --2- 172.21.15.5:0/2161039568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad700b1f70 0x7fad700c44b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fad600ab040 tx=0x7fad6001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:57.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.198+0000 7fad6cff9640 1 -- 172.21.15.5:0/2161039568 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad600b1800 con 0x7fad700b1f70 2023-07-14T12:52:57.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.198+0000 7fad6cff9640 1 -- 172.21.15.5:0/2161039568 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad600b1980 con 0x7fad700b1f70 2023-07-14T12:52:57.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.198+0000 7fad6cff9640 1 -- 172.21.15.5:0/2161039568 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad600b1d30 con 0x7fad700b1f70 2023-07-14T12:52:57.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.198+0000 7fad762f9640 1 -- 172.21.15.5:0/2161039568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad7015d5a0 con 0x7fad700b1f70 2023-07-14T12:52:57.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.198+0000 7fad762f9640 1 -- 172.21.15.5:0/2161039568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad700b5fa0 con 0x7fad700b1f70 2023-07-14T12:52:57.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.198+0000 7fad762f9640 1 -- 172.21.15.5:0/2161039568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad700678d0 con 0x7fad700b1f70 2023-07-14T12:52:57.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.198+0000 7fad6cff9640 1 -- 172.21.15.5:0/2161039568 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fad600c4450 con 0x7fad700b1f70 2023-07-14T12:52:57.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.202+0000 7fad6cff9640 1 --2- 172.21.15.5:0/2161039568 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fad5c066280 0x7fad5c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:57.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.202+0000 7fad6cff9640 1 -- 172.21.15.5:0/2161039568 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fad6011e9a0 con 0x7fad700b1f70 2023-07-14T12:52:57.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.202+0000 7fad6f7fe640 1 --2- 172.21.15.5:0/2161039568 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fad5c066280 0x7fad5c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:57.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.202+0000 7fad6f7fe640 1 --2- 172.21.15.5:0/2161039568 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fad5c066280 0x7fad5c068730 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fad700b7470 tx=0x7fad64009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:57.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.206+0000 7fad6cff9640 1 -- 172.21.15.5:0/2161039568 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fad600ebe10 con 0x7fad700b1f70 2023-07-14T12:52:57.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.362+0000 7fad762f9640 1 -- 172.21.15.5:0/2161039568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad7006ab70 con 0x7fad700b1f70 2023-07-14T12:52:57.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.362+0000 7fad6cff9640 1 -- 172.21.15.5:0/2161039568 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18231 (secure 0 0 0) 0x7fad600ef430 con 0x7fad700b1f70 2023-07-14T12:52:57.389 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:52:57.390 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":23,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:52:48.091483+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:52:44.223082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T12:52:45.469396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:52:57.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.366+0000 7fad762f9640 1 -- 172.21.15.5:0/2161039568 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fad5c066280 msgr2=0x7fad5c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:57.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.366+0000 7fad762f9640 1 --2- 172.21.15.5:0/2161039568 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fad5c066280 0x7fad5c068730 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fad700b7470 tx=0x7fad64009040 comp rx=0 tx=0).stop 2023-07-14T12:52:57.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.366+0000 7fad762f9640 1 -- 172.21.15.5:0/2161039568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad700b1f70 msgr2=0x7fad700c44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:57.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.366+0000 7fad762f9640 1 --2- 172.21.15.5:0/2161039568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad700b1f70 0x7fad700c44b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fad600ab040 tx=0x7fad6001ad50 comp rx=0 tx=0).stop 2023-07-14T12:52:57.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.366+0000 7fad762f9640 1 -- 172.21.15.5:0/2161039568 shutdown_connections 2023-07-14T12:52:57.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.366+0000 7fad762f9640 1 --2- 172.21.15.5:0/2161039568 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fad5c066280 0x7fad5c068730 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:57.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.366+0000 7fad762f9640 1 --2- 172.21.15.5:0/2161039568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad700b0db0 0x7fad700b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:57.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.366+0000 7fad762f9640 1 --2- 172.21.15.5:0/2161039568 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad700d06b0 0x7fad700c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:57.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.366+0000 7fad762f9640 1 --2- 172.21.15.5:0/2161039568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad700b1f70 0x7fad700c44b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:57.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.366+0000 7fad762f9640 1 -- 172.21.15.5:0/2161039568 >> 172.21.15.5:0/2161039568 conn(0x7fad700659d0 msgr2=0x7fad7006b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:57.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.366+0000 7fad762f9640 1 -- 172.21.15.5:0/2161039568 shutdown_connections 2023-07-14T12:52:57.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.366+0000 7fad762f9640 1 -- 172.21.15.5:0/2161039568 wait complete. 2023-07-14T12:52:57.410 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T12:52:44.223082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T12:52:45.469396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T12:52:57.411 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T12:52:57.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7c64ca640 1 Processor -- start 2023-07-14T12:52:57.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7c64ca640 1 -- start start 2023-07-14T12:52:57.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7c64ca640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff7c0159440 0x7ff7c00c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:57.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7c64ca640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c01532b0 con 0x7ff7c00aeb40 2023-07-14T12:52:57.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7c64ca640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c00ca6f0 con 0x7ff7c015cef0 2023-07-14T12:52:57.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7c64ca640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c015d360 con 0x7ff7c0159440 2023-07-14T12:52:57.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7bffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff7c00aeb40 0x7ff7c00aef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39038/0 (socket says 172.21.15.5:39038) 2023-07-14T12:52:57.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7bffff640 1 -- 172.21.15.5:0/3968428260 learned_addr learned my addr 172.21.15.5:0/3968428260 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:57.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7c4a67640 1 --2- 172.21.15.5:0/3968428260 >> v2:172.21.15.154:3300/0 conn(0x7ff7c0159440 0x7ff7c00c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:57.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7beffd640 1 -- 172.21.15.5:0/3968428260 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3602849996 0 0) 0x7ff7c01532b0 con 0x7ff7c00aeb40 2023-07-14T12:52:57.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7beffd640 1 -- 172.21.15.5:0/3968428260 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7a8003530 con 0x7ff7c00aeb40 2023-07-14T12:52:57.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7beffd640 1 -- 172.21.15.5:0/3968428260 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1973680370 0 0) 0x7ff7a8003530 con 0x7ff7c00aeb40 2023-07-14T12:52:57.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7beffd640 1 -- 172.21.15.5:0/3968428260 >> v2:172.21.15.154:3300/0 conn(0x7ff7c0159440 msgr2=0x7ff7c00c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:57.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7beffd640 1 --2- 172.21.15.5:0/3968428260 >> v2:172.21.15.154:3300/0 conn(0x7ff7c0159440 0x7ff7c00c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:57.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7beffd640 1 -- 172.21.15.5:0/3968428260 >> v1:172.21.15.154:6789/0 conn(0x7ff7c015cef0 legacy=0x7ff7c0158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:57.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7beffd640 1 -- 172.21.15.5:0/3968428260 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c01599d0 con 0x7ff7c00aeb40 2023-07-14T12:52:57.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7beffd640 1 -- 172.21.15.5:0/3968428260 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7ff7b0001680 con 0x7ff7c00aeb40 2023-07-14T12:52:57.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7beffd640 1 -- 172.21.15.5:0/3968428260 >> v1:172.21.15.5:6789/0 conn(0x7ff7c00aeb40 legacy=0x7ff7c00aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:57.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7beffd640 1 --2- 172.21.15.5:0/3968428260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7a8003980 0x7ff7a8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:57.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7beffd640 1 --2- 172.21.15.5:0/3968428260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7a80047d0 0x7ff7a8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:57.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7beffd640 1 --2- 172.21.15.5:0/3968428260 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7a8005180 0x7ff7a800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:57.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7beffd640 1 -- 172.21.15.5:0/3968428260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c015d360 con 0x7ff7a80047d0 2023-07-14T12:52:57.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7beffd640 1 -- 172.21.15.5:0/3968428260 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a800c000 con 0x7ff7a8003980 2023-07-14T12:52:57.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7beffd640 1 -- 172.21.15.5:0/3968428260 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a800c1c0 con 0x7ff7a8005180 2023-07-14T12:52:57.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7bf7fe640 1 --2- 172.21.15.5:0/3968428260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7a80047d0 0x7ff7a8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:57.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7bffff640 1 --2- 172.21.15.5:0/3968428260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7a8003980 0x7ff7a8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:57.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7c4a67640 1 --2- 172.21.15.5:0/3968428260 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7a8005180 0x7ff7a800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:57.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7bf7fe640 1 -- 172.21.15.5:0/3968428260 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7a8005180 msgr2=0x7ff7a800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:57.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7bf7fe640 1 --2- 172.21.15.5:0/3968428260 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7a8005180 0x7ff7a800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:57.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7bf7fe640 1 -- 172.21.15.5:0/3968428260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7a8003980 msgr2=0x7ff7a8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:57.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7bf7fe640 1 --2- 172.21.15.5:0/3968428260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7a8003980 0x7ff7a8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:57.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7bf7fe640 1 -- 172.21.15.5:0/3968428260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a8003530 con 0x7ff7a80047d0 2023-07-14T12:52:57.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.534+0000 7ff7c4a67640 1 -- 172.21.15.5:0/3968428260 reap_dead start 2023-07-14T12:52:57.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.538+0000 7ff7bf7fe640 1 --2- 172.21.15.5:0/3968428260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7a80047d0 0x7ff7a8004c40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4001780 tx=0x7ff7b401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9bd80f489c82612 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:57.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.538+0000 7ff7beffd640 1 -- 172.21.15.5:0/3968428260 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b40052d0 con 0x7ff7a80047d0 2023-07-14T12:52:57.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.538+0000 7ff7beffd640 1 -- 172.21.15.5:0/3968428260 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b40a7050 con 0x7ff7a80047d0 2023-07-14T12:52:57.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.538+0000 7ff7beffd640 1 -- 172.21.15.5:0/3968428260 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4003600 con 0x7ff7a80047d0 2023-07-14T12:52:57.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.538+0000 7ff7c64ca640 1 -- 172.21.15.5:0/3968428260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7a80047d0 msgr2=0x7ff7a8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:57.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.538+0000 7ff7c64ca640 1 --2- 172.21.15.5:0/3968428260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7a80047d0 0x7ff7a8004c40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4001780 tx=0x7ff7b401c400 comp rx=0 tx=0).stop 2023-07-14T12:52:57.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.538+0000 7ff7c64ca640 1 -- 172.21.15.5:0/3968428260 shutdown_connections 2023-07-14T12:52:57.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.538+0000 7ff7c64ca640 1 --2- 172.21.15.5:0/3968428260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7a80047d0 0x7ff7a8004c40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:57.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.538+0000 7ff7c64ca640 1 -- 172.21.15.5:0/3968428260 >> 172.21.15.5:0/3968428260 conn(0x7ff7c00cde90 msgr2=0x7ff7c00ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:57.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.538+0000 7ff7c64ca640 1 -- 172.21.15.5:0/3968428260 shutdown_connections 2023-07-14T12:52:57.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.538+0000 7ff7c64ca640 1 -- 172.21.15.5:0/3968428260 wait complete. 2023-07-14T12:52:57.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.542+0000 7ff7c64ca640 1 Processor -- start 2023-07-14T12:52:57.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.542+0000 7ff7c64ca640 1 -- start start 2023-07-14T12:52:57.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.542+0000 7ff7c64ca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7a80047d0 0x7ff7c014aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:57.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.542+0000 7ff7c64ca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7c01569a0 0x7ff7c00b2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:57.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.542+0000 7ff7c64ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7c00b2e50 0x7ff7c006c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:57.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.542+0000 7ff7c64ca640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c00b33b0 con 0x7ff7a80047d0 2023-07-14T12:52:57.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.542+0000 7ff7c64ca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c006fb30 con 0x7ff7c01569a0 2023-07-14T12:52:57.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.542+0000 7ff7c64ca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c006f200 con 0x7ff7c00b2e50 2023-07-14T12:52:57.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.542+0000 7ff7bffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7a80047d0 0x7ff7c014aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:57.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.542+0000 7ff7bffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7a80047d0 0x7ff7c014aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52966/0 (socket says 172.21.15.5:52966) 2023-07-14T12:52:57.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.542+0000 7ff7bffff640 1 -- 172.21.15.5:0/1965999668 learned_addr learned my addr 172.21.15.5:0/1965999668 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:57.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.542+0000 7ff7c4a67640 1 --2- 172.21.15.5:0/1965999668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7c00b2e50 0x7ff7c006c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:57.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.542+0000 7ff7bf7fe640 1 --2- 172.21.15.5:0/1965999668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7c01569a0 0x7ff7c00b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:57.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.542+0000 7ff7bffff640 1 -- 172.21.15.5:0/1965999668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7c00b2e50 msgr2=0x7ff7c006c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:57.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.542+0000 7ff7bffff640 1 --2- 172.21.15.5:0/1965999668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7c00b2e50 0x7ff7c006c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:57.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.542+0000 7ff7bffff640 1 -- 172.21.15.5:0/1965999668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7c01569a0 msgr2=0x7ff7c00b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:57.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.542+0000 7ff7bffff640 1 --2- 172.21.15.5:0/1965999668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7c01569a0 0x7ff7c00b2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:57.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.542+0000 7ff7bffff640 1 -- 172.21.15.5:0/1965999668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c006f4e0 con 0x7ff7a80047d0 2023-07-14T12:52:57.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.542+0000 7ff7c4a67640 1 --2- 172.21.15.5:0/1965999668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7c00b2e50 0x7ff7c006c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:52:57.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.542+0000 7ff7bf7fe640 1 --2- 172.21.15.5:0/1965999668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7c01569a0 0x7ff7c00b2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:52:57.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.542+0000 7ff7bffff640 1 --2- 172.21.15.5:0/1965999668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7a80047d0 0x7ff7c014aa70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0012490 tx=0x7ff7b0012950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:57.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.542+0000 7ff7bcff9640 1 -- 172.21.15.5:0/1965999668 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0014750 con 0x7ff7a80047d0 2023-07-14T12:52:57.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.542+0000 7ff7bcff9640 1 -- 172.21.15.5:0/1965999668 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b00148b0 con 0x7ff7a80047d0 2023-07-14T12:52:57.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.542+0000 7ff7bcff9640 1 -- 172.21.15.5:0/1965999668 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0014c60 con 0x7ff7a80047d0 2023-07-14T12:52:57.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.542+0000 7ff7c64ca640 1 -- 172.21.15.5:0/1965999668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c006f7c0 con 0x7ff7a80047d0 2023-07-14T12:52:57.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.546+0000 7ff7c64ca640 1 -- 172.21.15.5:0/1965999668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c00ae7e0 con 0x7ff7a80047d0 2023-07-14T12:52:57.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.546+0000 7ff7c64ca640 1 -- 172.21.15.5:0/1965999668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c00678d0 con 0x7ff7a80047d0 2023-07-14T12:52:57.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.546+0000 7ff7bcff9640 1 -- 172.21.15.5:0/1965999668 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff7b00153e0 con 0x7ff7a80047d0 2023-07-14T12:52:57.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.546+0000 7ff7bcff9640 1 --2- 172.21.15.5:0/1965999668 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff7ac0662b0 0x7ff7ac068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:57.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.546+0000 7ff7bcff9640 1 -- 172.21.15.5:0/1965999668 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff7b0086530 con 0x7ff7a80047d0 2023-07-14T12:52:57.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.546+0000 7ff7bf7fe640 1 --2- 172.21.15.5:0/1965999668 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff7ac0662b0 0x7ff7ac068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:57.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.546+0000 7ff7bf7fe640 1 --2- 172.21.15.5:0/1965999668 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff7ac0662b0 0x7ff7ac068760 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4001750 tx=0x7ff7b40011a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:57.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.550+0000 7ff7bcff9640 1 -- 172.21.15.5:0/1965999668 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff7b00539a0 con 0x7ff7a80047d0 2023-07-14T12:52:57.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.710+0000 7ff7c64ca640 1 -- 172.21.15.5:0/1965999668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff7c015c9c0 con 0x7ff7a80047d0 2023-07-14T12:52:57.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.710+0000 7ff7bcff9640 1 -- 172.21.15.5:0/1965999668 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff7b0056fc0 con 0x7ff7a80047d0 2023-07-14T12:52:57.736 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T12:52:57.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.710+0000 7ff7c64ca640 1 -- 172.21.15.5:0/1965999668 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff7ac0662b0 msgr2=0x7ff7ac068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:57.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.710+0000 7ff7c64ca640 1 --2- 172.21.15.5:0/1965999668 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff7ac0662b0 0x7ff7ac068760 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4001750 tx=0x7ff7b40011a0 comp rx=0 tx=0).stop 2023-07-14T12:52:57.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.710+0000 7ff7c64ca640 1 -- 172.21.15.5:0/1965999668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7a80047d0 msgr2=0x7ff7c014aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:57.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.710+0000 7ff7c64ca640 1 --2- 172.21.15.5:0/1965999668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7a80047d0 0x7ff7c014aa70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0012490 tx=0x7ff7b0012950 comp rx=0 tx=0).stop 2023-07-14T12:52:57.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.710+0000 7ff7c64ca640 1 -- 172.21.15.5:0/1965999668 shutdown_connections 2023-07-14T12:52:57.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.710+0000 7ff7c64ca640 1 --2- 172.21.15.5:0/1965999668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7c00b2e50 0x7ff7c006c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:57.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.710+0000 7ff7c64ca640 1 --2- 172.21.15.5:0/1965999668 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff7ac0662b0 0x7ff7ac068760 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:57.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.710+0000 7ff7c64ca640 1 --2- 172.21.15.5:0/1965999668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7c01569a0 0x7ff7c00b2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:57.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.710+0000 7ff7c64ca640 1 --2- 172.21.15.5:0/1965999668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7a80047d0 0x7ff7c014aa70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:57.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.710+0000 7ff7c64ca640 1 -- 172.21.15.5:0/1965999668 >> 172.21.15.5:0/1965999668 conn(0x7ff7c00cde90 msgr2=0x7ff7c00c8910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:57.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.710+0000 7ff7c64ca640 1 -- 172.21.15.5:0/1965999668 shutdown_connections 2023-07-14T12:52:57.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.710+0000 7ff7c64ca640 1 -- 172.21.15.5:0/1965999668 wait complete. 2023-07-14T12:52:57.757 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T12:52:57.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.890+0000 7fba5f696640 1 Processor -- start 2023-07-14T12:52:57.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.890+0000 7fba5f696640 1 -- start start 2023-07-14T12:52:57.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.890+0000 7fba5f696640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fba58069430 0x7fba580cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:57.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.890+0000 7fba5f696640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba580cb7d0 con 0x7fba5806d2d0 2023-07-14T12:52:57.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.890+0000 7fba5f696640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba5806c510 con 0x7fba58160030 2023-07-14T12:52:57.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.890+0000 7fba5f696640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba5806c7f0 con 0x7fba58069430 2023-07-14T12:52:57.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.894+0000 7fba5dc33640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fba5806d2d0 0x7fba5806d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39040/0 (socket says 172.21.15.5:39040) 2023-07-14T12:52:57.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.894+0000 7fba5dc33640 1 -- 172.21.15.5:0/1182542726 learned_addr learned my addr 172.21.15.5:0/1182542726 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:57.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.894+0000 7fba5d432640 1 --2- 172.21.15.5:0/1182542726 >> v2:172.21.15.154:3300/0 conn(0x7fba58069430 0x7fba580cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:57.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.894+0000 7fba4ffff640 1 -- 172.21.15.5:0/1182542726 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1377868878 0 0) 0x7fba580cb7d0 con 0x7fba5806d2d0 2023-07-14T12:52:57.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.894+0000 7fba4ffff640 1 -- 172.21.15.5:0/1182542726 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba44003530 con 0x7fba5806d2d0 2023-07-14T12:52:57.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.894+0000 7fba4ffff640 1 -- 172.21.15.5:0/1182542726 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1996944089 0 0) 0x7fba5806c510 con 0x7fba58160030 2023-07-14T12:52:57.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.894+0000 7fba4ffff640 1 -- 172.21.15.5:0/1182542726 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba580cb7d0 con 0x7fba58160030 2023-07-14T12:52:57.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.894+0000 7fba5d432640 1 -- 172.21.15.5:0/1182542726 >> v1:172.21.15.154:6789/0 conn(0x7fba58160030 legacy=0x7fba58069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:57.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.894+0000 7fba5d432640 1 -- 172.21.15.5:0/1182542726 >> v1:172.21.15.5:6789/0 conn(0x7fba5806d2d0 legacy=0x7fba5806d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:57.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.894+0000 7fba5d432640 1 -- 172.21.15.5:0/1182542726 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5806cad0 con 0x7fba58069430 2023-07-14T12:52:57.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.894+0000 7fba5d432640 1 --2- 172.21.15.5:0/1182542726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba58069430 0x7fba580cb0f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fba540097c0 tx=0x7fba5401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96109789de59d15d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:57.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.894+0000 7fba4ffff640 1 -- 172.21.15.5:0/1182542726 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba540ab600 con 0x7fba58069430 2023-07-14T12:52:57.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.898+0000 7fba4ffff640 1 -- 172.21.15.5:0/1182542726 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba540a7050 con 0x7fba58069430 2023-07-14T12:52:57.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.898+0000 7fba4ffff640 1 -- 172.21.15.5:0/1182542726 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba540ab980 con 0x7fba58069430 2023-07-14T12:52:57.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.898+0000 7fba5f696640 1 -- 172.21.15.5:0/1182542726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba58069430 msgr2=0x7fba580cb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:57.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.898+0000 7fba5f696640 1 --2- 172.21.15.5:0/1182542726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba58069430 0x7fba580cb0f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fba540097c0 tx=0x7fba5401c3c0 comp rx=0 tx=0).stop 2023-07-14T12:52:57.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.898+0000 7fba5f696640 1 -- 172.21.15.5:0/1182542726 shutdown_connections 2023-07-14T12:52:57.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.898+0000 7fba5f696640 1 --2- 172.21.15.5:0/1182542726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba58069430 0x7fba580cb0f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:57.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.898+0000 7fba5f696640 1 -- 172.21.15.5:0/1182542726 >> 172.21.15.5:0/1182542726 conn(0x7fba580b1840 msgr2=0x7fba580cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:57.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.898+0000 7fba5f696640 1 -- 172.21.15.5:0/1182542726 shutdown_connections 2023-07-14T12:52:57.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.898+0000 7fba5f696640 1 -- 172.21.15.5:0/1182542726 wait complete. 2023-07-14T12:52:57.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.898+0000 7fba5f696640 1 Processor -- start 2023-07-14T12:52:57.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.898+0000 7fba5f696640 1 -- start start 2023-07-14T12:52:57.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.898+0000 7fba5f696640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba58069430 0x7fba580b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:57.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.898+0000 7fba5f696640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba5806d2d0 0x7fba580c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:57.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.898+0000 7fba5f696640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba58160030 0x7fba580c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:57.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.898+0000 7fba5f696640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5815c930 con 0x7fba58160030 2023-07-14T12:52:57.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.898+0000 7fba5f696640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5815cc10 con 0x7fba58069430 2023-07-14T12:52:57.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.898+0000 7fba5f696640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5815cef0 con 0x7fba5806d2d0 2023-07-14T12:52:57.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.898+0000 7fba5dc33640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba58160030 0x7fba580c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:57.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.898+0000 7fba5dc33640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba58160030 0x7fba580c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52982/0 (socket says 172.21.15.5:52982) 2023-07-14T12:52:57.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.898+0000 7fba5dc33640 1 -- 172.21.15.5:0/1429695206 learned_addr learned my addr 172.21.15.5:0/1429695206 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:57.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.902+0000 7fba5cc31640 1 --2- 172.21.15.5:0/1429695206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba5806d2d0 0x7fba580c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:57.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.902+0000 7fba5d432640 1 --2- 172.21.15.5:0/1429695206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba58069430 0x7fba580b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:57.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.902+0000 7fba5dc33640 1 -- 172.21.15.5:0/1429695206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba5806d2d0 msgr2=0x7fba580c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:57.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.902+0000 7fba5dc33640 1 --2- 172.21.15.5:0/1429695206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba5806d2d0 0x7fba580c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:57.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.902+0000 7fba5dc33640 1 -- 172.21.15.5:0/1429695206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba58069430 msgr2=0x7fba580b1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:57.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.902+0000 7fba5dc33640 1 --2- 172.21.15.5:0/1429695206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba58069430 0x7fba580b1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:57.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.902+0000 7fba5dc33640 1 -- 172.21.15.5:0/1429695206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba54009420 con 0x7fba58160030 2023-07-14T12:52:57.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.902+0000 7fba5d432640 1 --2- 172.21.15.5:0/1429695206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba58069430 0x7fba580b1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:52:57.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.902+0000 7fba5dc33640 1 --2- 172.21.15.5:0/1429695206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba58160030 0x7fba580c8750 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fba5000caf0 tx=0x7fba5000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:57.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.902+0000 7fba4dffb640 1 -- 172.21.15.5:0/1429695206 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5000aca0 con 0x7fba58160030 2023-07-14T12:52:57.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.902+0000 7fba4dffb640 1 -- 172.21.15.5:0/1429695206 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5000ae00 con 0x7fba58160030 2023-07-14T12:52:57.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.902+0000 7fba4dffb640 1 -- 172.21.15.5:0/1429695206 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba50012620 con 0x7fba58160030 2023-07-14T12:52:57.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.902+0000 7fba5f696640 1 -- 172.21.15.5:0/1429695206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba5815d1d0 con 0x7fba58160030 2023-07-14T12:52:57.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.902+0000 7fba5f696640 1 -- 172.21.15.5:0/1429695206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba580b23f0 con 0x7fba58160030 2023-07-14T12:52:57.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.902+0000 7fba5f696640 1 -- 172.21.15.5:0/1429695206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba580678d0 con 0x7fba58160030 2023-07-14T12:52:57.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.902+0000 7fba4dffb640 1 -- 172.21.15.5:0/1429695206 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fba50007070 con 0x7fba58160030 2023-07-14T12:52:57.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.906+0000 7fba4dffb640 1 --2- 172.21.15.5:0/1429695206 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fba3c066280 0x7fba3c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:57.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.906+0000 7fba4dffb640 1 -- 172.21.15.5:0/1429695206 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fba50083c60 con 0x7fba58160030 2023-07-14T12:52:57.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.906+0000 7fba5d432640 1 --2- 172.21.15.5:0/1429695206 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fba3c066280 0x7fba3c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:57.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.906+0000 7fba5d432640 1 --2- 172.21.15.5:0/1429695206 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fba3c066280 0x7fba3c068730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fba540ad000 tx=0x7fba54008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:57.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:57.910+0000 7fba4dffb640 1 -- 172.21.15.5:0/1429695206 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fba50051170 con 0x7fba58160030 2023-07-14T12:52:58.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.062+0000 7fba5f696640 1 -- 172.21.15.5:0/1429695206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fba5815d680 con 0x7fba58160030 2023-07-14T12:52:58.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.062+0000 7fba4dffb640 1 -- 172.21.15.5:0/1429695206 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fba50017020 con 0x7fba58160030 2023-07-14T12:52:58.090 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T12:52:58.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.066+0000 7fba5f696640 1 -- 172.21.15.5:0/1429695206 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fba3c066280 msgr2=0x7fba3c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:58.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.066+0000 7fba5f696640 1 --2- 172.21.15.5:0/1429695206 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fba3c066280 0x7fba3c068730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fba540ad000 tx=0x7fba54008040 comp rx=0 tx=0).stop 2023-07-14T12:52:58.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.066+0000 7fba5f696640 1 -- 172.21.15.5:0/1429695206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba58160030 msgr2=0x7fba580c8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:58.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.066+0000 7fba5f696640 1 --2- 172.21.15.5:0/1429695206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba58160030 0x7fba580c8750 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fba5000caf0 tx=0x7fba5000a060 comp rx=0 tx=0).stop 2023-07-14T12:52:58.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.066+0000 7fba5f696640 1 -- 172.21.15.5:0/1429695206 shutdown_connections 2023-07-14T12:52:58.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.066+0000 7fba5f696640 1 --2- 172.21.15.5:0/1429695206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba58160030 0x7fba580c8750 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:58.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.066+0000 7fba5f696640 1 --2- 172.21.15.5:0/1429695206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba5806d2d0 0x7fba580c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:58.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.066+0000 7fba5f696640 1 --2- 172.21.15.5:0/1429695206 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fba3c066280 0x7fba3c068730 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:58.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.066+0000 7fba5f696640 1 --2- 172.21.15.5:0/1429695206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba58069430 0x7fba580b1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:58.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.066+0000 7fba5f696640 1 -- 172.21.15.5:0/1429695206 >> 172.21.15.5:0/1429695206 conn(0x7fba580b1840 msgr2=0x7fba580ccf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:58.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.066+0000 7fba5f696640 1 -- 172.21.15.5:0/1429695206 shutdown_connections 2023-07-14T12:52:58.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.066+0000 7fba5f696640 1 -- 172.21.15.5:0/1429695206 wait complete. 2023-07-14T12:52:58.111 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T12:52:58.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.230+0000 7f2185431640 1 Processor -- start 2023-07-14T12:52:58.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.230+0000 7f2185431640 1 -- start start 2023-07-14T12:52:58.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.234+0000 7f2185431640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f21800cc960 0x7f21800ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:58.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.234+0000 7f2185431640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f21800b1620 0x7f21800ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:58.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.234+0000 7f2185431640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21800cd270 con 0x7f2180160750 2023-07-14T12:52:58.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.234+0000 7f2185431640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21800cf710 con 0x7f21800cc960 2023-07-14T12:52:58.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.234+0000 7f2185431640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21800cf430 con 0x7f21800b1620 2023-07-14T12:52:58.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.234+0000 7f2184c30640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2180160750 0x7f21800b3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39046/0 (socket says 172.21.15.5:39046) 2023-07-14T12:52:58.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.234+0000 7f2184c30640 1 -- 172.21.15.5:0/2927868907 learned_addr learned my addr 172.21.15.5:0/2927868907 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:58.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.234+0000 7f217ffff640 1 --2- 172.21.15.5:0/2927868907 >> v2:172.21.15.5:3300/0 conn(0x7f21800cc960 0x7f21800ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:58.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.234+0000 7f217f7fe640 1 --2- 172.21.15.5:0/2927868907 >> v2:172.21.15.154:3300/0 conn(0x7f21800b1620 0x7f21800ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:58.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.234+0000 7f217effd640 1 -- 172.21.15.5:0/2927868907 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3549121451 0 0) 0x7f21800cd270 con 0x7f2180160750 2023-07-14T12:52:58.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.234+0000 7f217effd640 1 -- 172.21.15.5:0/2927868907 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2168003530 con 0x7f2180160750 2023-07-14T12:52:58.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.234+0000 7f217ffff640 1 -- 172.21.15.5:0/2927868907 >> v2:172.21.15.154:3300/0 conn(0x7f21800b1620 msgr2=0x7f21800ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:58.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.234+0000 7f217ffff640 1 --2- 172.21.15.5:0/2927868907 >> v2:172.21.15.154:3300/0 conn(0x7f21800b1620 0x7f21800ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:58.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.234+0000 7f217ffff640 1 -- 172.21.15.5:0/2927868907 >> v1:172.21.15.5:6789/0 conn(0x7f2180160750 legacy=0x7f21800b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:58.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.234+0000 7f217ffff640 1 -- 172.21.15.5:0/2927868907 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218015fc70 con 0x7f21800cc960 2023-07-14T12:52:58.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.238+0000 7f217ffff640 1 --2- 172.21.15.5:0/2927868907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21800cc960 0x7f21800ccd30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f218006ac10 tx=0x7f217001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a884638b7537e2df server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:58.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.238+0000 7f217effd640 1 -- 172.21.15.5:0/2927868907 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21700a7070 con 0x7f21800cc960 2023-07-14T12:52:58.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.238+0000 7f217effd640 1 -- 172.21.15.5:0/2927868907 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21700ab430 con 0x7f21800cc960 2023-07-14T12:52:58.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.238+0000 7f217effd640 1 -- 172.21.15.5:0/2927868907 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21700ab7a0 con 0x7f21800cc960 2023-07-14T12:52:58.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.238+0000 7f2185431640 1 -- 172.21.15.5:0/2927868907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21800cc960 msgr2=0x7f21800ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:58.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.238+0000 7f2185431640 1 --2- 172.21.15.5:0/2927868907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21800cc960 0x7f21800ccd30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f218006ac10 tx=0x7f217001c430 comp rx=0 tx=0).stop 2023-07-14T12:52:58.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.238+0000 7f2185431640 1 -- 172.21.15.5:0/2927868907 shutdown_connections 2023-07-14T12:52:58.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.238+0000 7f2185431640 1 --2- 172.21.15.5:0/2927868907 >> v2:172.21.15.154:3300/0 conn(0x7f21800b1620 0x7f21800ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:58.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.238+0000 7f2185431640 1 --2- 172.21.15.5:0/2927868907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21800cc960 0x7f21800ccd30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:58.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.238+0000 7f2185431640 1 -- 172.21.15.5:0/2927868907 >> 172.21.15.5:0/2927868907 conn(0x7f2180069f50 msgr2=0x7f218006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:58.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.238+0000 7f2185431640 1 -- 172.21.15.5:0/2927868907 shutdown_connections 2023-07-14T12:52:58.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.238+0000 7f2185431640 1 -- 172.21.15.5:0/2927868907 wait complete. 2023-07-14T12:52:58.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.238+0000 7f2185431640 1 Processor -- start 2023-07-14T12:52:58.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.238+0000 7f2185431640 1 -- start start 2023-07-14T12:52:58.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.242+0000 7f2185431640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21800b1620 0x7f2180155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:58.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.242+0000 7f2185431640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21800cc960 0x7f21800cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:58.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.242+0000 7f2185431640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2180160750 0x7f2180156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:58.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.242+0000 7f2185431640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21800cab80 con 0x7f21800cc960 2023-07-14T12:52:58.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.242+0000 7f2185431640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21800cbd10 con 0x7f21800b1620 2023-07-14T12:52:58.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.242+0000 7f2185431640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21800ca530 con 0x7f2180160750 2023-07-14T12:52:58.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.242+0000 7f217f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21800cc960 0x7f21800cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:58.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.242+0000 7f217f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21800cc960 0x7f21800cb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53010/0 (socket says 172.21.15.5:53010) 2023-07-14T12:52:58.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.242+0000 7f217f7fe640 1 -- 172.21.15.5:0/2663052093 learned_addr learned my addr 172.21.15.5:0/2663052093 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:58.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.242+0000 7f217f7fe640 1 -- 172.21.15.5:0/2663052093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2180160750 msgr2=0x7f2180156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:58.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.242+0000 7f217f7fe640 1 --2- 172.21.15.5:0/2663052093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2180160750 0x7f2180156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:58.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.242+0000 7f217f7fe640 1 -- 172.21.15.5:0/2663052093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21800b1620 msgr2=0x7f2180155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:58.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.242+0000 7f217f7fe640 1 --2- 172.21.15.5:0/2663052093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21800b1620 0x7f2180155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:58.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.242+0000 7f217f7fe640 1 -- 172.21.15.5:0/2663052093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2170009420 con 0x7f21800cc960 2023-07-14T12:52:58.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.242+0000 7f217f7fe640 1 --2- 172.21.15.5:0/2663052093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21800cc960 0x7f21800cb010 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f217400e930 tx=0x7f217400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:58.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.242+0000 7f217cff9640 1 -- 172.21.15.5:0/2663052093 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2174009690 con 0x7f21800cc960 2023-07-14T12:52:58.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.242+0000 7f217cff9640 1 -- 172.21.15.5:0/2663052093 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217400ca00 con 0x7f21800cc960 2023-07-14T12:52:58.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.242+0000 7f217cff9640 1 -- 172.21.15.5:0/2663052093 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217400cd70 con 0x7f21800cc960 2023-07-14T12:52:58.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.242+0000 7f2185431640 1 -- 172.21.15.5:0/2663052093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21800ca810 con 0x7f21800cc960 2023-07-14T12:52:58.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.242+0000 7f2185431640 1 -- 172.21.15.5:0/2663052093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21800cb550 con 0x7f21800cc960 2023-07-14T12:52:58.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.242+0000 7f2185431640 1 -- 172.21.15.5:0/2663052093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21800ca390 con 0x7f21800cc960 2023-07-14T12:52:58.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.242+0000 7f217cff9640 1 -- 172.21.15.5:0/2663052093 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2174013470 con 0x7f21800cc960 2023-07-14T12:52:58.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.246+0000 7f217cff9640 1 --2- 172.21.15.5:0/2663052093 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f216c066250 0x7f216c068700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:58.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.246+0000 7f217cff9640 1 -- 172.21.15.5:0/2663052093 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2174083ff0 con 0x7f21800cc960 2023-07-14T12:52:58.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.246+0000 7f217ffff640 1 --2- 172.21.15.5:0/2663052093 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f216c066250 0x7f216c068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:58.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.246+0000 7f217ffff640 1 --2- 172.21.15.5:0/2663052093 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f216c066250 0x7f216c068700 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f21700af000 tx=0x7f2170004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:58.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.250+0000 7f217cff9640 1 -- 172.21.15.5:0/2663052093 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f21800ca390 con 0x7f21800cc960 2023-07-14T12:52:58.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.402+0000 7f2185431640 1 -- 172.21.15.5:0/2663052093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f21800ca390 con 0x7f21800cc960 2023-07-14T12:52:58.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.402+0000 7f217cff9640 1 -- 172.21.15.5:0/2663052093 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2174017020 con 0x7f21800cc960 2023-07-14T12:52:58.430 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T12:52:58.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.406+0000 7f2185431640 1 -- 172.21.15.5:0/2663052093 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f216c066250 msgr2=0x7f216c068700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:58.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.406+0000 7f2185431640 1 --2- 172.21.15.5:0/2663052093 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f216c066250 0x7f216c068700 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f21700af000 tx=0x7f2170004740 comp rx=0 tx=0).stop 2023-07-14T12:52:58.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.406+0000 7f2185431640 1 -- 172.21.15.5:0/2663052093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21800cc960 msgr2=0x7f21800cb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:58.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.406+0000 7f2185431640 1 --2- 172.21.15.5:0/2663052093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21800cc960 0x7f21800cb010 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f217400e930 tx=0x7f217400edf0 comp rx=0 tx=0).stop 2023-07-14T12:52:58.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.406+0000 7f2185431640 1 -- 172.21.15.5:0/2663052093 shutdown_connections 2023-07-14T12:52:58.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.406+0000 7f2185431640 1 --2- 172.21.15.5:0/2663052093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2180160750 0x7f2180156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:58.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.406+0000 7f2185431640 1 --2- 172.21.15.5:0/2663052093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21800cc960 0x7f21800cb010 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:58.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.406+0000 7f2185431640 1 --2- 172.21.15.5:0/2663052093 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f216c066250 0x7f216c068700 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:58.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.406+0000 7f2185431640 1 --2- 172.21.15.5:0/2663052093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21800b1620 0x7f2180155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:58.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.406+0000 7f2185431640 1 -- 172.21.15.5:0/2663052093 >> 172.21.15.5:0/2663052093 conn(0x7f2180069f50 msgr2=0x7f218015d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:58.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.406+0000 7f2185431640 1 -- 172.21.15.5:0/2663052093 shutdown_connections 2023-07-14T12:52:58.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.406+0000 7f2185431640 1 -- 172.21.15.5:0/2663052093 wait complete. 2023-07-14T12:52:58.450 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T12:52:58.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.570+0000 7f2d5827b640 1 Processor -- start 2023-07-14T12:52:58.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.570+0000 7f2d5827b640 1 -- start start 2023-07-14T12:52:58.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.574+0000 7f2d5827b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2d5015b9c0 0x7f2d500c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:58.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.574+0000 7f2d5827b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d500c37e0 con 0x7f2d500cba60 2023-07-14T12:52:58.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.574+0000 7f2d5827b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d500c3ac0 con 0x7f2d501590a0 2023-07-14T12:52:58.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.574+0000 7f2d5827b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d500c3da0 con 0x7f2d5015b9c0 2023-07-14T12:52:58.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.574+0000 7f2d56818640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2d5015b9c0 0x7f2d500c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:58.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.574+0000 7f2d56017640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2d500cba60 0x7f2d500cbe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39048/0 (socket says 172.21.15.5:39048) 2023-07-14T12:52:58.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.574+0000 7f2d56017640 1 -- 172.21.15.5:0/1638900532 learned_addr learned my addr 172.21.15.5:0/1638900532 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:58.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.574+0000 7f2d56818640 1 -- 172.21.15.5:0/1638900532 >> v1:172.21.15.154:6789/0 conn(0x7f2d501590a0 legacy=0x7f2d50159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:58.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.574+0000 7f2d56818640 1 -- 172.21.15.5:0/1638900532 >> v1:172.21.15.5:6789/0 conn(0x7f2d500cba60 legacy=0x7f2d500cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:58.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.574+0000 7f2d56818640 1 -- 172.21.15.5:0/1638900532 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d500c4080 con 0x7f2d5015b9c0 2023-07-14T12:52:58.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.578+0000 7f2d56818640 1 --2- 172.21.15.5:0/1638900532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5015b9c0 0x7f2d500c3150 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2d48009d90 tx=0x7f2d4801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91dc7f6f7ef545e4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:58.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.578+0000 7f2d55015640 1 -- 172.21.15.5:0/1638900532 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d480a5920 con 0x7f2d5015b9c0 2023-07-14T12:52:58.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.578+0000 7f2d55015640 1 -- 172.21.15.5:0/1638900532 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d480a5a80 con 0x7f2d5015b9c0 2023-07-14T12:52:58.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.578+0000 7f2d55015640 1 -- 172.21.15.5:0/1638900532 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d480a5e10 con 0x7f2d5015b9c0 2023-07-14T12:52:58.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.578+0000 7f2d5827b640 1 -- 172.21.15.5:0/1638900532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5015b9c0 msgr2=0x7f2d500c3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:58.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.578+0000 7f2d5827b640 1 --2- 172.21.15.5:0/1638900532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5015b9c0 0x7f2d500c3150 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2d48009d90 tx=0x7f2d4801c880 comp rx=0 tx=0).stop 2023-07-14T12:52:58.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.578+0000 7f2d5827b640 1 -- 172.21.15.5:0/1638900532 shutdown_connections 2023-07-14T12:52:58.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.578+0000 7f2d5827b640 1 --2- 172.21.15.5:0/1638900532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5015b9c0 0x7f2d500c3150 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:58.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.578+0000 7f2d5827b640 1 -- 172.21.15.5:0/1638900532 >> 172.21.15.5:0/1638900532 conn(0x7f2d500cde90 msgr2=0x7f2d500ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:58.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.578+0000 7f2d5827b640 1 -- 172.21.15.5:0/1638900532 shutdown_connections 2023-07-14T12:52:58.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.578+0000 7f2d5827b640 1 -- 172.21.15.5:0/1638900532 wait complete. 2023-07-14T12:52:58.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.578+0000 7f2d5827b640 1 Processor -- start 2023-07-14T12:52:58.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.578+0000 7f2d5827b640 1 -- start start 2023-07-14T12:52:58.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.582+0000 7f2d5827b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d500cba60 0x7f2d5006c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:58.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.582+0000 7f2d5827b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d501590a0 0x7f2d500b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:58.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.582+0000 7f2d5827b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5015b9c0 0x7f2d500b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:58.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.582+0000 7f2d5827b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d50151da0 con 0x7f2d5015b9c0 2023-07-14T12:52:58.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.582+0000 7f2d5827b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d500b1f60 con 0x7f2d501590a0 2023-07-14T12:52:58.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.582+0000 7f2d5827b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d500b19a0 con 0x7f2d500cba60 2023-07-14T12:52:58.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.582+0000 7f2d56818640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5015b9c0 0x7f2d500b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:58.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.582+0000 7f2d56818640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5015b9c0 0x7f2d500b1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53028/0 (socket says 172.21.15.5:53028) 2023-07-14T12:52:58.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.582+0000 7f2d56818640 1 -- 172.21.15.5:0/3941632968 learned_addr learned my addr 172.21.15.5:0/3941632968 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:58.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.582+0000 7f2d55816640 1 --2- 172.21.15.5:0/3941632968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d501590a0 0x7f2d500b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:58.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.582+0000 7f2d56017640 1 --2- 172.21.15.5:0/3941632968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d500cba60 0x7f2d5006c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:58.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.582+0000 7f2d56818640 1 -- 172.21.15.5:0/3941632968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d500cba60 msgr2=0x7f2d5006c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:58.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.582+0000 7f2d56818640 1 --2- 172.21.15.5:0/3941632968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d500cba60 0x7f2d5006c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:58.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.582+0000 7f2d56818640 1 -- 172.21.15.5:0/3941632968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d501590a0 msgr2=0x7f2d500b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:58.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.582+0000 7f2d56818640 1 --2- 172.21.15.5:0/3941632968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d501590a0 0x7f2d500b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:58.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.582+0000 7f2d56818640 1 -- 172.21.15.5:0/3941632968 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d48009a70 con 0x7f2d5015b9c0 2023-07-14T12:52:58.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.582+0000 7f2d55816640 1 --2- 172.21.15.5:0/3941632968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d501590a0 0x7f2d500b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:52:58.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.582+0000 7f2d56017640 1 --2- 172.21.15.5:0/3941632968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d500cba60 0x7f2d5006c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:52:58.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.582+0000 7f2d56818640 1 --2- 172.21.15.5:0/3941632968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5015b9c0 0x7f2d500b1300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2d48009d90 tx=0x7f2d48019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:58.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.582+0000 7f2d46ffd640 1 -- 172.21.15.5:0/3941632968 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d480a5920 con 0x7f2d5015b9c0 2023-07-14T12:52:58.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.582+0000 7f2d46ffd640 1 -- 172.21.15.5:0/3941632968 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d480b7410 con 0x7f2d5015b9c0 2023-07-14T12:52:58.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.582+0000 7f2d46ffd640 1 -- 172.21.15.5:0/3941632968 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d480b77c0 con 0x7f2d5015b9c0 2023-07-14T12:52:58.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.582+0000 7f2d5827b640 1 -- 172.21.15.5:0/3941632968 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d500b1c80 con 0x7f2d5015b9c0 2023-07-14T12:52:58.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.582+0000 7f2d5827b640 1 -- 172.21.15.5:0/3941632968 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5014cd40 con 0x7f2d5015b9c0 2023-07-14T12:52:58.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.582+0000 7f2d5827b640 1 -- 172.21.15.5:0/3941632968 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d500714b0 con 0x7f2d5015b9c0 2023-07-14T12:52:58.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.582+0000 7f2d46ffd640 1 -- 172.21.15.5:0/3941632968 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2d480b4050 con 0x7f2d5015b9c0 2023-07-14T12:52:58.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.586+0000 7f2d46ffd640 1 --2- 172.21.15.5:0/3941632968 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2d340662b0 0x7f2d34068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:58.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.586+0000 7f2d46ffd640 1 -- 172.21.15.5:0/3941632968 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2d4811f560 con 0x7f2d5015b9c0 2023-07-14T12:52:58.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.586+0000 7f2d56017640 1 --2- 172.21.15.5:0/3941632968 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2d340662b0 0x7f2d34068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:58.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.586+0000 7f2d56017640 1 --2- 172.21.15.5:0/3941632968 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2d340662b0 0x7f2d34068760 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c005890 tx=0x7f2d4c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:58.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.586+0000 7f2d46ffd640 1 -- 172.21.15.5:0/3941632968 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2d480eca60 con 0x7f2d5015b9c0 2023-07-14T12:52:58.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.742+0000 7f2d5827b640 1 -- 172.21.15.5:0/3941632968 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2d5014c8c0 con 0x7f2d5015b9c0 2023-07-14T12:52:58.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.742+0000 7f2d46ffd640 1 -- 172.21.15.5:0/3941632968 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2d5014c8c0 con 0x7f2d5015b9c0 2023-07-14T12:52:58.767 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T12:52:58.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.742+0000 7f2d5827b640 1 -- 172.21.15.5:0/3941632968 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2d340662b0 msgr2=0x7f2d34068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:58.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.742+0000 7f2d5827b640 1 --2- 172.21.15.5:0/3941632968 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2d340662b0 0x7f2d34068760 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c005890 tx=0x7f2d4c009040 comp rx=0 tx=0).stop 2023-07-14T12:52:58.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.742+0000 7f2d5827b640 1 -- 172.21.15.5:0/3941632968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5015b9c0 msgr2=0x7f2d500b1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:58.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.742+0000 7f2d5827b640 1 --2- 172.21.15.5:0/3941632968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5015b9c0 0x7f2d500b1300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2d48009d90 tx=0x7f2d48019620 comp rx=0 tx=0).stop 2023-07-14T12:52:58.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.742+0000 7f2d5827b640 1 -- 172.21.15.5:0/3941632968 shutdown_connections 2023-07-14T12:52:58.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.742+0000 7f2d5827b640 1 --2- 172.21.15.5:0/3941632968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d5015b9c0 0x7f2d500b1300 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:58.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.742+0000 7f2d5827b640 1 --2- 172.21.15.5:0/3941632968 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2d340662b0 0x7f2d34068760 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:58.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.742+0000 7f2d5827b640 1 --2- 172.21.15.5:0/3941632968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d501590a0 0x7f2d500b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:58.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.742+0000 7f2d5827b640 1 --2- 172.21.15.5:0/3941632968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d500cba60 0x7f2d5006c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:58.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.742+0000 7f2d5827b640 1 -- 172.21.15.5:0/3941632968 >> 172.21.15.5:0/3941632968 conn(0x7f2d500cde90 msgr2=0x7f2d50072420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:58.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.742+0000 7f2d5827b640 1 -- 172.21.15.5:0/3941632968 shutdown_connections 2023-07-14T12:52:58.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.742+0000 7f2d5827b640 1 -- 172.21.15.5:0/3941632968 wait complete. 2023-07-14T12:52:58.788 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:52:58.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.906+0000 7fe52780b640 1 Processor -- start 2023-07-14T12:52:58.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.906+0000 7fe52780b640 1 -- start start 2023-07-14T12:52:58.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.906+0000 7fe52780b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe52015fd60 0x7fe5200d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:58.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.906+0000 7fe52780b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5200d1850 0x7fe5200d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:58.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.906+0000 7fe52780b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5200ccaf0 con 0x7fe5200b7c70 2023-07-14T12:52:58.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.906+0000 7fe52780b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5200d1190 con 0x7fe52015fd60 2023-07-14T12:52:58.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.906+0000 7fe52780b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe520160600 con 0x7fe5200d1850 2023-07-14T12:52:58.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.906+0000 7fe525da8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5200d1850 0x7fe5200d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:58.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.906+0000 7fe525da8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5200d1850 0x7fe5200d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:55268/0 (socket says 172.21.15.5:55268) 2023-07-14T12:52:58.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.906+0000 7fe525da8640 1 -- 172.21.15.5:0/2151804469 learned_addr learned my addr 172.21.15.5:0/2151804469 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:58.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.906+0000 7fe524da6640 1 --2- 172.21.15.5:0/2151804469 >> v2:172.21.15.154:3300/0 conn(0x7fe52015fd60 0x7fe5200d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:58.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.906+0000 7fe525da8640 1 -- 172.21.15.5:0/2151804469 >> v2:172.21.15.154:3300/0 conn(0x7fe52015fd60 msgr2=0x7fe5200d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:58.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.906+0000 7fe525da8640 1 --2- 172.21.15.5:0/2151804469 >> v2:172.21.15.154:3300/0 conn(0x7fe52015fd60 0x7fe5200d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:58.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.906+0000 7fe525da8640 1 -- 172.21.15.5:0/2151804469 >> v1:172.21.15.154:6789/0 conn(0x7fe5200b7c70 legacy=0x7fe52015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:58.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.906+0000 7fe525da8640 1 -- 172.21.15.5:0/2151804469 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe520160320 con 0x7fe5200d1850 2023-07-14T12:52:58.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.910+0000 7fe525da8640 1 --2- 172.21.15.5:0/2151804469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5200d1850 0x7fe5200d1da0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe518009e50 tx=0x7fe51801c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cee393a0c2573299 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:58.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.910+0000 7fe517fff640 1 -- 172.21.15.5:0/2151804469 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5180a58d0 con 0x7fe5200d1850 2023-07-14T12:52:58.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.910+0000 7fe517fff640 1 -- 172.21.15.5:0/2151804469 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5180a5a30 con 0x7fe5200d1850 2023-07-14T12:52:58.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.910+0000 7fe517fff640 1 -- 172.21.15.5:0/2151804469 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5180a5dc0 con 0x7fe5200d1850 2023-07-14T12:52:58.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.910+0000 7fe52780b640 1 -- 172.21.15.5:0/2151804469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5200d1850 msgr2=0x7fe5200d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.910+0000 7fe52780b640 1 --2- 172.21.15.5:0/2151804469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5200d1850 0x7fe5200d1da0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe518009e50 tx=0x7fe51801c9e0 comp rx=0 tx=0).stop 2023-07-14T12:52:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.910+0000 7fe52780b640 1 -- 172.21.15.5:0/2151804469 shutdown_connections 2023-07-14T12:52:58.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.910+0000 7fe52780b640 1 --2- 172.21.15.5:0/2151804469 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5200d1850 0x7fe5200d1da0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:58.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.910+0000 7fe52780b640 1 --2- 172.21.15.5:0/2151804469 >> v2:172.21.15.154:3300/0 conn(0x7fe52015fd60 0x7fe5200d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:58.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.910+0000 7fe52780b640 1 -- 172.21.15.5:0/2151804469 >> 172.21.15.5:0/2151804469 conn(0x7fe5200650b0 msgr2=0x7fe5200654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:58.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.910+0000 7fe52780b640 1 -- 172.21.15.5:0/2151804469 shutdown_connections 2023-07-14T12:52:58.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.910+0000 7fe52780b640 1 -- 172.21.15.5:0/2151804469 wait complete. 2023-07-14T12:52:58.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.914+0000 7fe52780b640 1 Processor -- start 2023-07-14T12:52:58.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.914+0000 7fe52780b640 1 -- start start 2023-07-14T12:52:58.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.914+0000 7fe52780b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5200b7c70 0x7fe5200c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:58.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.914+0000 7fe52780b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5200d1850 0x7fe5200cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:58.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.914+0000 7fe52780b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe52015fd60 0x7fe52015c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:58.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.914+0000 7fe52780b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5201560f0 con 0x7fe5200b7c70 2023-07-14T12:52:58.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.914+0000 7fe52780b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5200c9910 con 0x7fe52015fd60 2023-07-14T12:52:58.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.914+0000 7fe52780b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe520155280 con 0x7fe5200d1850 2023-07-14T12:52:58.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.914+0000 7fe5255a7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5200b7c70 0x7fe5200c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:58.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.914+0000 7fe5255a7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5200b7c70 0x7fe5200c93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53040/0 (socket says 172.21.15.5:53040) 2023-07-14T12:52:58.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.914+0000 7fe5255a7640 1 -- 172.21.15.5:0/1739934495 learned_addr learned my addr 172.21.15.5:0/1739934495 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:58.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.914+0000 7fe525da8640 1 --2- 172.21.15.5:0/1739934495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe52015fd60 0x7fe52015c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:58.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.914+0000 7fe524da6640 1 --2- 172.21.15.5:0/1739934495 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5200d1850 0x7fe5200cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:58.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.914+0000 7fe5255a7640 1 -- 172.21.15.5:0/1739934495 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5200d1850 msgr2=0x7fe5200cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:58.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.914+0000 7fe5255a7640 1 --2- 172.21.15.5:0/1739934495 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5200d1850 0x7fe5200cbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:58.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.914+0000 7fe5255a7640 1 -- 172.21.15.5:0/1739934495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe52015fd60 msgr2=0x7fe52015c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:58.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.914+0000 7fe5255a7640 1 --2- 172.21.15.5:0/1739934495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe52015fd60 0x7fe52015c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:58.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.914+0000 7fe5255a7640 1 -- 172.21.15.5:0/1739934495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe518009b30 con 0x7fe5200b7c70 2023-07-14T12:52:58.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.914+0000 7fe5255a7640 1 --2- 172.21.15.5:0/1739934495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5200b7c70 0x7fe5200c93d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe51c00c3c0 tx=0x7fe51c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:58.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.914+0000 7fe515ffb640 1 -- 172.21.15.5:0/1739934495 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c0052d0 con 0x7fe5200b7c70 2023-07-14T12:52:58.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.914+0000 7fe515ffb640 1 -- 172.21.15.5:0/1739934495 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51c005430 con 0x7fe5200b7c70 2023-07-14T12:52:58.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.914+0000 7fe515ffb640 1 -- 172.21.15.5:0/1739934495 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c003840 con 0x7fe5200b7c70 2023-07-14T12:52:58.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.914+0000 7fe52780b640 1 -- 172.21.15.5:0/1739934495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe520154cc0 con 0x7fe5200b7c70 2023-07-14T12:52:58.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.918+0000 7fe52780b640 1 -- 172.21.15.5:0/1739934495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe520155d80 con 0x7fe5200b7c70 2023-07-14T12:52:58.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.918+0000 7fe52780b640 1 -- 172.21.15.5:0/1739934495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5200678d0 con 0x7fe5200b7c70 2023-07-14T12:52:58.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.918+0000 7fe515ffb640 1 -- 172.21.15.5:0/1739934495 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe51c0039a0 con 0x7fe5200b7c70 2023-07-14T12:52:58.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.918+0000 7fe515ffb640 1 --2- 172.21.15.5:0/1739934495 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe504066280 0x7fe504068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:58.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.918+0000 7fe515ffb640 1 -- 172.21.15.5:0/1739934495 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe51c0831d0 con 0x7fe5200b7c70 2023-07-14T12:52:58.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.918+0000 7fe524da6640 1 --2- 172.21.15.5:0/1739934495 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe504066280 0x7fe504068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:58.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.922+0000 7fe524da6640 1 --2- 172.21.15.5:0/1739934495 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe504066280 0x7fe504068730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe5200cfa80 tx=0x7fe510009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:58.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:58.922+0000 7fe515ffb640 1 -- 172.21.15.5:0/1739934495 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe51c0506f0 con 0x7fe5200b7c70 2023-07-14T12:52:59.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.110+0000 7fe52780b640 1 -- 172.21.15.5:0/1739934495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5200cc370 con 0x7fe5200b7c70 2023-07-14T12:52:59.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.110+0000 7fe515ffb640 1 -- 172.21.15.5:0/1739934495 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4703 (secure 0 0 0) 0x7fe51c053d10 con 0x7fe5200b7c70 2023-07-14T12:52:59.138 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:52:59.139 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1953958881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1953958881},{"type":"v1","addr":"172.21.15.154:6837","nonce":1953958881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3138000501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3138000501},{"type":"v1","addr":"172.21.15.5:6834","nonce":3138000501}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1911549775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1911549775},{"type":"v1","addr":"172.21.15.5:6835","nonce":1911549775}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T12:52:46.473195+0000","modified":"2023-07-14T12:52:50.433872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6836/3154882793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3154882793},{"type":"v1","addr":"172.21.15.154:6836","nonce":3154882793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T12:52:59.139 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2023-07-14T12:52:59.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.114+0000 7fe52780b640 1 -- 172.21.15.5:0/1739934495 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe504066280 msgr2=0x7fe504068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:59.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.114+0000 7fe52780b640 1 --2- 172.21.15.5:0/1739934495 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe504066280 0x7fe504068730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe5200cfa80 tx=0x7fe510009190 comp rx=0 tx=0).stop 2023-07-14T12:52:59.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.114+0000 7fe52780b640 1 -- 172.21.15.5:0/1739934495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5200b7c70 msgr2=0x7fe5200c93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:59.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.114+0000 7fe52780b640 1 --2- 172.21.15.5:0/1739934495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5200b7c70 0x7fe5200c93d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe51c00c3c0 tx=0x7fe51c00c880 comp rx=0 tx=0).stop 2023-07-14T12:52:59.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.114+0000 7fe52780b640 1 -- 172.21.15.5:0/1739934495 shutdown_connections 2023-07-14T12:52:59.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.114+0000 7fe52780b640 1 --2- 172.21.15.5:0/1739934495 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe504066280 0x7fe504068730 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:59.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.114+0000 7fe52780b640 1 --2- 172.21.15.5:0/1739934495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe52015fd60 0x7fe52015c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:59.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.114+0000 7fe52780b640 1 --2- 172.21.15.5:0/1739934495 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5200d1850 0x7fe5200cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:59.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.114+0000 7fe52780b640 1 --2- 172.21.15.5:0/1739934495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5200b7c70 0x7fe5200c93d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.114+0000 7fe52780b640 1 -- 172.21.15.5:0/1739934495 >> 172.21.15.5:0/1739934495 conn(0x7fe5200650b0 msgr2=0x7fe5200b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.114+0000 7fe52780b640 1 -- 172.21.15.5:0/1739934495 shutdown_connections 2023-07-14T12:52:59.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.114+0000 7fe52780b640 1 -- 172.21.15.5:0/1739934495 wait complete. 2023-07-14T12:52:59.159 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:52:59.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.278+0000 7f176e32c640 1 Processor -- start 2023-07-14T12:52:59.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.278+0000 7f176e32c640 1 -- start start 2023-07-14T12:52:59.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.278+0000 7f176e32c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f176815fd60 0x7f17680d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:59.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.278+0000 7f176e32c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f17680d1850 0x7f17680d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:59.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.278+0000 7f176e32c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17680ccaf0 con 0x7f17680b7c70 2023-07-14T12:52:59.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.278+0000 7f176e32c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17680d1190 con 0x7f176815fd60 2023-07-14T12:52:59.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.278+0000 7f176e32c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1768160600 con 0x7f17680d1850 2023-07-14T12:52:59.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.278+0000 7f1767fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f17680b7c70 0x7f176815f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36062/0 (socket says 172.21.15.5:36062) 2023-07-14T12:52:59.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.278+0000 7f1767fff640 1 -- 172.21.15.5:0/3343292297 learned_addr learned my addr 172.21.15.5:0/3343292297 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:59.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.278+0000 7f17677fe640 1 --2- 172.21.15.5:0/3343292297 >> v2:172.21.15.5:3300/0 conn(0x7f176815fd60 0x7f17680d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:59.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.278+0000 7f176c8c9640 1 --2- 172.21.15.5:0/3343292297 >> v2:172.21.15.154:3300/0 conn(0x7f17680d1850 0x7f17680d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:59.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.278+0000 7f1766ffd640 1 -- 172.21.15.5:0/3343292297 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010805031 0 0) 0x7f17680ccaf0 con 0x7f17680b7c70 2023-07-14T12:52:59.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.278+0000 7f1766ffd640 1 -- 172.21.15.5:0/3343292297 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1750003530 con 0x7f17680b7c70 2023-07-14T12:52:59.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.278+0000 7f17677fe640 1 -- 172.21.15.5:0/3343292297 >> v2:172.21.15.154:3300/0 conn(0x7f17680d1850 msgr2=0x7f17680d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:59.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.278+0000 7f17677fe640 1 --2- 172.21.15.5:0/3343292297 >> v2:172.21.15.154:3300/0 conn(0x7f17680d1850 0x7f17680d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:59.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.278+0000 7f17677fe640 1 -- 172.21.15.5:0/3343292297 >> v1:172.21.15.5:6789/0 conn(0x7f17680b7c70 legacy=0x7f176815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:59.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.278+0000 7f17677fe640 1 -- 172.21.15.5:0/3343292297 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1768160320 con 0x7f176815fd60 2023-07-14T12:52:59.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.282+0000 7f17677fe640 1 --2- 172.21.15.5:0/3343292297 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f176815fd60 0x7f17680d0c50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f17680b4040 tx=0x7f175c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31df012f88125caf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:59.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.282+0000 7f1766ffd640 1 -- 172.21.15.5:0/3343292297 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c0a7070 con 0x7f176815fd60 2023-07-14T12:52:59.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.282+0000 7f1766ffd640 1 -- 172.21.15.5:0/3343292297 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175c0ab430 con 0x7f176815fd60 2023-07-14T12:52:59.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.282+0000 7f1766ffd640 1 -- 172.21.15.5:0/3343292297 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c0ab7c0 con 0x7f176815fd60 2023-07-14T12:52:59.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.282+0000 7f176e32c640 1 -- 172.21.15.5:0/3343292297 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f176815fd60 msgr2=0x7f17680d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:59.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.282+0000 7f176e32c640 1 --2- 172.21.15.5:0/3343292297 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f176815fd60 0x7f17680d0c50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f17680b4040 tx=0x7f175c01c410 comp rx=0 tx=0).stop 2023-07-14T12:52:59.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.282+0000 7f176e32c640 1 -- 172.21.15.5:0/3343292297 shutdown_connections 2023-07-14T12:52:59.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.282+0000 7f176e32c640 1 --2- 172.21.15.5:0/3343292297 >> v2:172.21.15.154:3300/0 conn(0x7f17680d1850 0x7f17680d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:59.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.282+0000 7f176e32c640 1 --2- 172.21.15.5:0/3343292297 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f176815fd60 0x7f17680d0c50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:59.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.282+0000 7f176e32c640 1 -- 172.21.15.5:0/3343292297 >> 172.21.15.5:0/3343292297 conn(0x7f17680650b0 msgr2=0x7f17680654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:59.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.282+0000 7f176e32c640 1 -- 172.21.15.5:0/3343292297 shutdown_connections 2023-07-14T12:52:59.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.282+0000 7f176e32c640 1 -- 172.21.15.5:0/3343292297 wait complete. 2023-07-14T12:52:59.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.282+0000 7f176e32c640 1 Processor -- start 2023-07-14T12:52:59.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.286+0000 7f176e32c640 1 -- start start 2023-07-14T12:52:59.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.286+0000 7f176e32c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17680b7c70 0x7f17680c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:59.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.286+0000 7f176e32c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17680d1850 0x7f1768153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:59.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.286+0000 7f176e32c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f176815fd60 0x7f17680ce510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:59.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.286+0000 7f176e32c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17680c5680 con 0x7f17680d1850 2023-07-14T12:52:59.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.286+0000 7f176e32c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17680c6530 con 0x7f176815fd60 2023-07-14T12:52:59.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.286+0000 7f176e32c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17680c6810 con 0x7f17680b7c70 2023-07-14T12:52:59.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.286+0000 7f17677fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17680d1850 0x7f1768153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:59.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.286+0000 7f17677fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17680d1850 0x7f1768153710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56580/0 (socket says 172.21.15.5:56580) 2023-07-14T12:52:59.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.286+0000 7f17677fe640 1 -- 172.21.15.5:0/4150608921 learned_addr learned my addr 172.21.15.5:0/4150608921 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:59.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.286+0000 7f1767fff640 1 --2- 172.21.15.5:0/4150608921 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17680b7c70 0x7f17680c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:59.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.286+0000 7f176c8c9640 1 --2- 172.21.15.5:0/4150608921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f176815fd60 0x7f17680ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:59.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.286+0000 7f17677fe640 1 -- 172.21.15.5:0/4150608921 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17680b7c70 msgr2=0x7f17680c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:59.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.286+0000 7f17677fe640 1 --2- 172.21.15.5:0/4150608921 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17680b7c70 0x7f17680c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:59.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.286+0000 7f17677fe640 1 -- 172.21.15.5:0/4150608921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f176815fd60 msgr2=0x7f17680ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:59.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.286+0000 7f17677fe640 1 --2- 172.21.15.5:0/4150608921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f176815fd60 0x7f17680ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:59.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.286+0000 7f17677fe640 1 -- 172.21.15.5:0/4150608921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c009420 con 0x7f17680d1850 2023-07-14T12:52:59.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.286+0000 7f17677fe640 1 --2- 172.21.15.5:0/4150608921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17680d1850 0x7f1768153710 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f175c01a040 tx=0x7f175c0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:59.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.286+0000 7f1764ff9640 1 -- 172.21.15.5:0/4150608921 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c0abe50 con 0x7f17680d1850 2023-07-14T12:52:59.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.286+0000 7f1764ff9640 1 -- 172.21.15.5:0/4150608921 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175c0bf450 con 0x7f17680d1850 2023-07-14T12:52:59.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.286+0000 7f1764ff9640 1 -- 172.21.15.5:0/4150608921 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c0bf800 con 0x7f17680d1850 2023-07-14T12:52:59.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.286+0000 7f176e32c640 1 -- 172.21.15.5:0/4150608921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17680c6af0 con 0x7f17680d1850 2023-07-14T12:52:59.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.286+0000 7f176e32c640 1 -- 172.21.15.5:0/4150608921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17680c70b0 con 0x7f17680d1850 2023-07-14T12:52:59.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.286+0000 7f176e32c640 1 -- 172.21.15.5:0/4150608921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17680c72a0 con 0x7f17680d1850 2023-07-14T12:52:59.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.290+0000 7f1764ff9640 1 -- 172.21.15.5:0/4150608921 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f175c0bf960 con 0x7f17680d1850 2023-07-14T12:52:59.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.290+0000 7f1764ff9640 1 --2- 172.21.15.5:0/4150608921 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f1754066280 0x7f1754068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:59.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.290+0000 7f1764ff9640 1 -- 172.21.15.5:0/4150608921 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f175c11e4d0 con 0x7f17680d1850 2023-07-14T12:52:59.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.290+0000 7f1767fff640 1 --2- 172.21.15.5:0/4150608921 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f1754066280 0x7f1754068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:59.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.290+0000 7f1767fff640 1 --2- 172.21.15.5:0/4150608921 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f1754066280 0x7f1754068730 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f17580011f0 tx=0x7f1758009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:59.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.294+0000 7f1764ff9640 1 -- 172.21.15.5:0/4150608921 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f175c0eb950 con 0x7f17680d1850 2023-07-14T12:52:59.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.450+0000 7f176e32c640 1 -- 172.21.15.5:0/4150608921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17680678d0 con 0x7f17680d1850 2023-07-14T12:52:59.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.450+0000 7f1764ff9640 1 -- 172.21.15.5:0/4150608921 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18231 (secure 0 0 0) 0x7f175c0eef70 con 0x7f17680d1850 2023-07-14T12:52:59.478 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:52:59.479 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":23,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:52:48.091483+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:52:44.223082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T12:52:45.469396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:52:59.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.454+0000 7f176e32c640 1 -- 172.21.15.5:0/4150608921 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f1754066280 msgr2=0x7f1754068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.454+0000 7f176e32c640 1 --2- 172.21.15.5:0/4150608921 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f1754066280 0x7f1754068730 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f17580011f0 tx=0x7f1758009040 comp rx=0 tx=0).stop 2023-07-14T12:52:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.454+0000 7f176e32c640 1 -- 172.21.15.5:0/4150608921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17680d1850 msgr2=0x7f1768153710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.454+0000 7f176e32c640 1 --2- 172.21.15.5:0/4150608921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17680d1850 0x7f1768153710 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f175c01a040 tx=0x7f175c0191b0 comp rx=0 tx=0).stop 2023-07-14T12:52:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.454+0000 7f176e32c640 1 -- 172.21.15.5:0/4150608921 shutdown_connections 2023-07-14T12:52:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.454+0000 7f176e32c640 1 --2- 172.21.15.5:0/4150608921 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f1754066280 0x7f1754068730 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.454+0000 7f176e32c640 1 --2- 172.21.15.5:0/4150608921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f176815fd60 0x7f17680ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:59.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.454+0000 7f176e32c640 1 --2- 172.21.15.5:0/4150608921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17680d1850 0x7f1768153710 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.454+0000 7f176e32c640 1 --2- 172.21.15.5:0/4150608921 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17680b7c70 0x7f17680c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.454+0000 7f176e32c640 1 -- 172.21.15.5:0/4150608921 >> 172.21.15.5:0/4150608921 conn(0x7f17680650b0 msgr2=0x7f17680cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.454+0000 7f176e32c640 1 -- 172.21.15.5:0/4150608921 shutdown_connections 2023-07-14T12:52:59.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.454+0000 7f176e32c640 1 -- 172.21.15.5:0/4150608921 wait complete. 2023-07-14T12:52:59.500 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T12:52:44.223082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T12:52:45.469396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T12:52:59.501 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T12:52:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.622+0000 7f935f07b640 1 Processor -- start 2023-07-14T12:52:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.622+0000 7f935f07b640 1 -- start start 2023-07-14T12:52:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.622+0000 7f935f07b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f935815c1b0 0x7f93580cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.622+0000 7f935f07b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93580ccf50 0x7f935806ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:59.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.622+0000 7f935f07b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93581609d0 con 0x7f935815bde0 2023-07-14T12:52:59.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.622+0000 7f935f07b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93580cd3f0 con 0x7f935815c1b0 2023-07-14T12:52:59.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.622+0000 7f935f07b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935806a670 con 0x7f93580ccf50 2023-07-14T12:52:59.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.622+0000 7f9357fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f935815c1b0 0x7f93580cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:59.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.622+0000 7f9357fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f935815c1b0 0x7f93580cca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56590/0 (socket says 172.21.15.5:56590) 2023-07-14T12:52:59.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.622+0000 7f9357fff640 1 -- 172.21.15.5:0/601790508 learned_addr learned my addr 172.21.15.5:0/601790508 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:59.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.622+0000 7f935ce17640 1 --1- 172.21.15.5:0/601790508 >> v1:172.21.15.154:6789/0 conn(0x7f935815bde0 0x7f935806b3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:50582/0 (socket says 172.21.15.5:50582) 2023-07-14T12:52:59.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.622+0000 7f935d618640 1 --2- 172.21.15.5:0/601790508 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93580ccf50 0x7f935806ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:59.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.622+0000 7f9357fff640 1 -- 172.21.15.5:0/601790508 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93580ccf50 msgr2=0x7f935806ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:52:59.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.622+0000 7f9357fff640 1 --2- 172.21.15.5:0/601790508 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93580ccf50 0x7f935806ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:59.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.622+0000 7f9357fff640 1 -- 172.21.15.5:0/601790508 >> v1:172.21.15.154:6789/0 conn(0x7f935815bde0 legacy=0x7f935806b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:59.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.622+0000 7f9357fff640 1 -- 172.21.15.5:0/601790508 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935806bb00 con 0x7f935815c1b0 2023-07-14T12:52:59.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.626+0000 7f9357fff640 1 --2- 172.21.15.5:0/601790508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f935815c1b0 0x7f93580cca10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9344006fd0 tx=0x7f934401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a1ba524d1b7fff server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:59.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.626+0000 7f93577fe640 1 -- 172.21.15.5:0/601790508 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93440ac630 con 0x7f935815c1b0 2023-07-14T12:52:59.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.626+0000 7f93577fe640 1 -- 172.21.15.5:0/601790508 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93440ac790 con 0x7f935815c1b0 2023-07-14T12:52:59.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.626+0000 7f93577fe640 1 -- 172.21.15.5:0/601790508 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93440acb20 con 0x7f935815c1b0 2023-07-14T12:52:59.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.626+0000 7f935f07b640 1 -- 172.21.15.5:0/601790508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f935815c1b0 msgr2=0x7f93580cca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:59.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.626+0000 7f935f07b640 1 --2- 172.21.15.5:0/601790508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f935815c1b0 0x7f93580cca10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9344006fd0 tx=0x7f934401c3d0 comp rx=0 tx=0).stop 2023-07-14T12:52:59.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.626+0000 7f935f07b640 1 -- 172.21.15.5:0/601790508 shutdown_connections 2023-07-14T12:52:59.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.626+0000 7f935f07b640 1 --2- 172.21.15.5:0/601790508 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93580ccf50 0x7f935806ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:59.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.626+0000 7f935f07b640 1 --2- 172.21.15.5:0/601790508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f935815c1b0 0x7f93580cca10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:59.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.626+0000 7f935f07b640 1 -- 172.21.15.5:0/601790508 >> 172.21.15.5:0/601790508 conn(0x7f93580659d0 msgr2=0x7f9358099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:59.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.626+0000 7f935f07b640 1 -- 172.21.15.5:0/601790508 shutdown_connections 2023-07-14T12:52:59.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.626+0000 7f935f07b640 1 -- 172.21.15.5:0/601790508 wait complete. 2023-07-14T12:52:59.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.630+0000 7f935f07b640 1 Processor -- start 2023-07-14T12:52:59.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.630+0000 7f935f07b640 1 -- start start 2023-07-14T12:52:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.630+0000 7f935f07b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93580ccf50 0x7f93580c5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.630+0000 7f935f07b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f935815bde0 0x7f9358155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.630+0000 7f935f07b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f935815c1b0 0x7f93580c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.630+0000 7f935f07b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93580b5d50 con 0x7f935815c1b0 2023-07-14T12:52:59.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.630+0000 7f935f07b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93580c50c0 con 0x7f93580ccf50 2023-07-14T12:52:59.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.630+0000 7f935f07b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93580b5790 con 0x7f935815bde0 2023-07-14T12:52:59.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.630+0000 7f935d618640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f935815c1b0 0x7f93580c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:59.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.630+0000 7f935d618640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f935815c1b0 0x7f93580c3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56600/0 (socket says 172.21.15.5:56600) 2023-07-14T12:52:59.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.630+0000 7f935d618640 1 -- 172.21.15.5:0/4156771145 learned_addr learned my addr 172.21.15.5:0/4156771145 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:52:59.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.630+0000 7f935ce17640 1 --2- 172.21.15.5:0/4156771145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93580ccf50 0x7f93580c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:59.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.630+0000 7f9357fff640 1 --2- 172.21.15.5:0/4156771145 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f935815bde0 0x7f9358155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:59.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.630+0000 7f935d618640 1 -- 172.21.15.5:0/4156771145 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f935815bde0 msgr2=0x7f9358155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:59.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.630+0000 7f935d618640 1 --2- 172.21.15.5:0/4156771145 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f935815bde0 0x7f9358155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:59.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.630+0000 7f935d618640 1 -- 172.21.15.5:0/4156771145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93580ccf50 msgr2=0x7f93580c5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:59.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.630+0000 7f935d618640 1 --2- 172.21.15.5:0/4156771145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93580ccf50 0x7f93580c5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:59.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.630+0000 7f935d618640 1 -- 172.21.15.5:0/4156771145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9344009480 con 0x7f935815c1b0 2023-07-14T12:52:59.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.630+0000 7f935d618640 1 --2- 172.21.15.5:0/4156771145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f935815c1b0 0x7f93580c3c10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9350009d30 tx=0x7f935000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:59.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.630+0000 7f93557fa640 1 -- 172.21.15.5:0/4156771145 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9350009ba0 con 0x7f935815c1b0 2023-07-14T12:52:59.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.630+0000 7f93557fa640 1 -- 172.21.15.5:0/4156771145 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935000f040 con 0x7f935815c1b0 2023-07-14T12:52:59.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.630+0000 7f93557fa640 1 -- 172.21.15.5:0/4156771145 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93500146c0 con 0x7f935815c1b0 2023-07-14T12:52:59.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.630+0000 7f935f07b640 1 -- 172.21.15.5:0/4156771145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93580b5a70 con 0x7f935815c1b0 2023-07-14T12:52:59.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.630+0000 7f935f07b640 1 -- 172.21.15.5:0/4156771145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93580c4240 con 0x7f935815c1b0 2023-07-14T12:52:59.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.634+0000 7f935f07b640 1 -- 172.21.15.5:0/4156771145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93580c7000 con 0x7f935815c1b0 2023-07-14T12:52:59.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.634+0000 7f93557fa640 1 -- 172.21.15.5:0/4156771145 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9350014820 con 0x7f935815c1b0 2023-07-14T12:52:59.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.634+0000 7f93557fa640 1 --2- 172.21.15.5:0/4156771145 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f933c0662d0 0x7f933c068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:59.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.634+0000 7f93557fa640 1 -- 172.21.15.5:0/4156771145 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f93500846f0 con 0x7f935815c1b0 2023-07-14T12:52:59.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.634+0000 7f935ce17640 1 --2- 172.21.15.5:0/4156771145 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f933c0662d0 0x7f933c068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:59.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.634+0000 7f935ce17640 1 --2- 172.21.15.5:0/4156771145 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f933c0662d0 0x7f933c068780 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f934c000fc0 tx=0x7f934c000f30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:59.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.638+0000 7f93557fa640 1 -- 172.21.15.5:0/4156771145 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9350051c00 con 0x7f935815c1b0 2023-07-14T12:52:59.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.794+0000 7f935f07b640 1 -- 172.21.15.5:0/4156771145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f93580678d0 con 0x7f935815c1b0 2023-07-14T12:52:59.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.794+0000 7f93557fa640 1 -- 172.21.15.5:0/4156771145 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9350055220 con 0x7f935815c1b0 2023-07-14T12:52:59.821 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T12:52:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.798+0000 7f935f07b640 1 -- 172.21.15.5:0/4156771145 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f933c0662d0 msgr2=0x7f933c068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.798+0000 7f935f07b640 1 --2- 172.21.15.5:0/4156771145 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f933c0662d0 0x7f933c068780 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f934c000fc0 tx=0x7f934c000f30 comp rx=0 tx=0).stop 2023-07-14T12:52:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.798+0000 7f935f07b640 1 -- 172.21.15.5:0/4156771145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f935815c1b0 msgr2=0x7f93580c3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.798+0000 7f935f07b640 1 --2- 172.21.15.5:0/4156771145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f935815c1b0 0x7f93580c3c10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9350009d30 tx=0x7f935000c490 comp rx=0 tx=0).stop 2023-07-14T12:52:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.798+0000 7f935f07b640 1 -- 172.21.15.5:0/4156771145 shutdown_connections 2023-07-14T12:52:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.798+0000 7f935f07b640 1 --2- 172.21.15.5:0/4156771145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f935815c1b0 0x7f93580c3c10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.798+0000 7f935f07b640 1 --2- 172.21.15.5:0/4156771145 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f935815bde0 0x7f9358155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:59.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.798+0000 7f935f07b640 1 --2- 172.21.15.5:0/4156771145 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f933c0662d0 0x7f933c068780 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:59.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.798+0000 7f935f07b640 1 --2- 172.21.15.5:0/4156771145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93580ccf50 0x7f93580c5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:59.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.798+0000 7f935f07b640 1 -- 172.21.15.5:0/4156771145 >> 172.21.15.5:0/4156771145 conn(0x7f93580659d0 msgr2=0x7f93580acc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:59.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.798+0000 7f935f07b640 1 -- 172.21.15.5:0/4156771145 shutdown_connections 2023-07-14T12:52:59.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.798+0000 7f935f07b640 1 -- 172.21.15.5:0/4156771145 wait complete. 2023-07-14T12:52:59.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T12:52:59.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.962+0000 7f997e634640 1 Processor -- start 2023-07-14T12:52:59.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.962+0000 7f997e634640 1 -- start start 2023-07-14T12:52:59.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.962+0000 7f997e634640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f997815b9c0 0x7f99780c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:59.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.962+0000 7f997e634640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99780c37e0 con 0x7f99781590a0 2023-07-14T12:52:59.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.966+0000 7f997e634640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99780c3ac0 con 0x7f99780cba60 2023-07-14T12:52:59.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.966+0000 7f997e634640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99780c3da0 con 0x7f997815b9c0 2023-07-14T12:52:59.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.966+0000 7f997cbd1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f997815b9c0 0x7f99780c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:59.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.966+0000 7f99777fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f99781590a0 0x7f9978159930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36066/0 (socket says 172.21.15.5:36066) 2023-07-14T12:52:59.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.966+0000 7f997cbd1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f997815b9c0 0x7f99780c3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56616/0 (socket says 172.21.15.5:56616) 2023-07-14T12:52:59.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.966+0000 7f99777fe640 1 -- 172.21.15.5:0/857930567 learned_addr learned my addr 172.21.15.5:0/857930567 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:52:59.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.966+0000 7f997cbd1640 1 -- 172.21.15.5:0/857930567 >> v1:172.21.15.154:6789/0 conn(0x7f99780cba60 legacy=0x7f99780cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:59.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.966+0000 7f997cbd1640 1 -- 172.21.15.5:0/857930567 >> v1:172.21.15.5:6789/0 conn(0x7f99781590a0 legacy=0x7f9978159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:59.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.966+0000 7f997cbd1640 1 -- 172.21.15.5:0/857930567 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99780c4080 con 0x7f997815b9c0 2023-07-14T12:52:59.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.966+0000 7f997cbd1640 1 --2- 172.21.15.5:0/857930567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f997815b9c0 0x7f99780c3150 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9970009d90 tx=0x7f997001d990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a086282d0d6e5d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:59.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.966+0000 7f9976ffd640 1 -- 172.21.15.5:0/857930567 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99700a6a50 con 0x7f997815b9c0 2023-07-14T12:52:59.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.966+0000 7f9976ffd640 1 -- 172.21.15.5:0/857930567 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99700a6bb0 con 0x7f997815b9c0 2023-07-14T12:52:59.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.966+0000 7f9976ffd640 1 -- 172.21.15.5:0/857930567 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99700ae440 con 0x7f997815b9c0 2023-07-14T12:52:59.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.970+0000 7f997e634640 1 -- 172.21.15.5:0/857930567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f997815b9c0 msgr2=0x7f99780c3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:59.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.970+0000 7f997e634640 1 --2- 172.21.15.5:0/857930567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f997815b9c0 0x7f99780c3150 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9970009d90 tx=0x7f997001d990 comp rx=0 tx=0).stop 2023-07-14T12:52:59.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.970+0000 7f997e634640 1 -- 172.21.15.5:0/857930567 shutdown_connections 2023-07-14T12:52:59.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.970+0000 7f997e634640 1 --2- 172.21.15.5:0/857930567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f997815b9c0 0x7f99780c3150 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:59.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.970+0000 7f997e634640 1 -- 172.21.15.5:0/857930567 >> 172.21.15.5:0/857930567 conn(0x7f99780cde90 msgr2=0x7f99780ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:59.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.970+0000 7f997e634640 1 -- 172.21.15.5:0/857930567 shutdown_connections 2023-07-14T12:52:59.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.970+0000 7f997e634640 1 -- 172.21.15.5:0/857930567 wait complete. 2023-07-14T12:53:00.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.970+0000 7f997e634640 1 Processor -- start 2023-07-14T12:53:00.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.970+0000 7f997e634640 1 -- start start 2023-07-14T12:53:00.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.970+0000 7f997e634640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99780cba60 0x7f997814d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:00.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.970+0000 7f997e634640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99781590a0 0x7f99780c9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:00.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.970+0000 7f997e634640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f997815b9c0 0x7f99780c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:00.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.970+0000 7f997e634640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99780b0e60 con 0x7f99781590a0 2023-07-14T12:53:00.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.970+0000 7f997e634640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99780b1140 con 0x7f997815b9c0 2023-07-14T12:53:00.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.970+0000 7f997e634640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99780b1420 con 0x7f99780cba60 2023-07-14T12:53:00.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.970+0000 7f99777fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99781590a0 0x7f99780c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:00.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.970+0000 7f99777fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99781590a0 0x7f99780c9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56618/0 (socket says 172.21.15.5:56618) 2023-07-14T12:53:00.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.970+0000 7f99777fe640 1 -- 172.21.15.5:0/2121266947 learned_addr learned my addr 172.21.15.5:0/2121266947 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:00.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.974+0000 7f9977fff640 1 --2- 172.21.15.5:0/2121266947 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99780cba60 0x7f997814d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:00.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.974+0000 7f997cbd1640 1 --2- 172.21.15.5:0/2121266947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f997815b9c0 0x7f99780c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:00.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.974+0000 7f99777fe640 1 -- 172.21.15.5:0/2121266947 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99780cba60 msgr2=0x7f997814d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:00.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.974+0000 7f99777fe640 1 --2- 172.21.15.5:0/2121266947 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99780cba60 0x7f997814d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:00.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.974+0000 7f99777fe640 1 -- 172.21.15.5:0/2121266947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f997815b9c0 msgr2=0x7f99780c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:00.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.974+0000 7f99777fe640 1 --2- 172.21.15.5:0/2121266947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f997815b9c0 0x7f99780c98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:00.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.974+0000 7f99777fe640 1 -- 172.21.15.5:0/2121266947 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9970009a70 con 0x7f99781590a0 2023-07-14T12:53:00.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.974+0000 7f99777fe640 1 --2- 172.21.15.5:0/2121266947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99781590a0 0x7f99780c9370 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f996c00c400 tx=0x7f996c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:00.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.974+0000 7f9974ff9640 1 -- 172.21.15.5:0/2121266947 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c005cf0 con 0x7f99781590a0 2023-07-14T12:53:00.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.974+0000 7f9974ff9640 1 -- 172.21.15.5:0/2121266947 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996c005e50 con 0x7f99781590a0 2023-07-14T12:53:00.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.974+0000 7f9974ff9640 1 -- 172.21.15.5:0/2121266947 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c0072d0 con 0x7f99781590a0 2023-07-14T12:53:00.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.974+0000 7f997e634640 1 -- 172.21.15.5:0/2121266947 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99780b1700 con 0x7f99781590a0 2023-07-14T12:53:00.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.974+0000 7f997e634640 1 -- 172.21.15.5:0/2121266947 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99780cb380 con 0x7f99781590a0 2023-07-14T12:53:00.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.974+0000 7f997e634640 1 -- 172.21.15.5:0/2121266947 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99780714b0 con 0x7f99781590a0 2023-07-14T12:53:00.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.974+0000 7f9974ff9640 1 -- 172.21.15.5:0/2121266947 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f996c007430 con 0x7f99781590a0 2023-07-14T12:53:00.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.974+0000 7f9974ff9640 1 --2- 172.21.15.5:0/2121266947 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9964066280 0x7f9964068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:00.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.974+0000 7f9974ff9640 1 -- 172.21.15.5:0/2121266947 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f996c083160 con 0x7f99781590a0 2023-07-14T12:53:00.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.978+0000 7f9977fff640 1 --2- 172.21.15.5:0/2121266947 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9964066280 0x7f9964068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:00.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.978+0000 7f9977fff640 1 --2- 172.21.15.5:0/2121266947 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9964066280 0x7f9964068730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9968007fd0 tx=0x7f9968009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:00.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:52:59.978+0000 7f9974ff9640 1 -- 172.21.15.5:0/2121266947 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f996c050720 con 0x7f99781590a0 2023-07-14T12:53:00.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.138+0000 7f997e634640 1 -- 172.21.15.5:0/2121266947 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f99780678d0 con 0x7f99781590a0 2023-07-14T12:53:00.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.138+0000 7f9974ff9640 1 -- 172.21.15.5:0/2121266947 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f996c053d40 con 0x7f99781590a0 2023-07-14T12:53:00.164 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T12:53:00.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.138+0000 7f997e634640 1 -- 172.21.15.5:0/2121266947 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9964066280 msgr2=0x7f9964068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:00.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.138+0000 7f997e634640 1 --2- 172.21.15.5:0/2121266947 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9964066280 0x7f9964068730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9968007fd0 tx=0x7f9968009040 comp rx=0 tx=0).stop 2023-07-14T12:53:00.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.138+0000 7f997e634640 1 -- 172.21.15.5:0/2121266947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99781590a0 msgr2=0x7f99780c9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:00.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.138+0000 7f997e634640 1 --2- 172.21.15.5:0/2121266947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99781590a0 0x7f99780c9370 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f996c00c400 tx=0x7f996c00c8c0 comp rx=0 tx=0).stop 2023-07-14T12:53:00.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.138+0000 7f997e634640 1 -- 172.21.15.5:0/2121266947 shutdown_connections 2023-07-14T12:53:00.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.138+0000 7f997e634640 1 --2- 172.21.15.5:0/2121266947 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9964066280 0x7f9964068730 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:00.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.138+0000 7f997e634640 1 --2- 172.21.15.5:0/2121266947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f997815b9c0 0x7f99780c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:00.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.138+0000 7f997e634640 1 --2- 172.21.15.5:0/2121266947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99781590a0 0x7f99780c9370 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:00.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.138+0000 7f997e634640 1 --2- 172.21.15.5:0/2121266947 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99780cba60 0x7f997814d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:00.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.138+0000 7f997e634640 1 -- 172.21.15.5:0/2121266947 >> 172.21.15.5:0/2121266947 conn(0x7f99780cde90 msgr2=0x7f99780ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:00.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.138+0000 7f997e634640 1 -- 172.21.15.5:0/2121266947 shutdown_connections 2023-07-14T12:53:00.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.138+0000 7f997e634640 1 -- 172.21.15.5:0/2121266947 wait complete. 2023-07-14T12:53:00.185 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T12:53:00.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.306+0000 7f4a2b3ad640 1 Processor -- start 2023-07-14T12:53:00.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.306+0000 7f4a2b3ad640 1 -- start start 2023-07-14T12:53:00.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.306+0000 7f4a2b3ad640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4a2415bde0 0x7f4a240d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:00.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.306+0000 7f4a2b3ad640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4a240d2300 0x7f4a240d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.306+0000 7f4a2b3ad640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a240b04c0 con 0x7f4a240d2fc0 2023-07-14T12:53:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.306+0000 7f4a2b3ad640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a2415c1b0 con 0x7f4a240d2300 2023-07-14T12:53:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.306+0000 7f4a2b3ad640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a240b1060 con 0x7f4a2415bde0 2023-07-14T12:53:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.306+0000 7f4a2994a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4a240d2300 0x7f4a240d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.306+0000 7f4a2994a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4a240d2300 0x7f4a240d2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56626/0 (socket says 172.21.15.5:56626) 2023-07-14T12:53:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.306+0000 7f4a2994a640 1 -- 172.21.15.5:0/3652850093 learned_addr learned my addr 172.21.15.5:0/3652850093 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.306+0000 7f4a29149640 1 --2- 172.21.15.5:0/3652850093 >> v2:172.21.15.154:3300/0 conn(0x7f4a2415bde0 0x7f4a240d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.306+0000 7f4a2994a640 1 -- 172.21.15.5:0/3652850093 >> v2:172.21.15.154:3300/0 conn(0x7f4a2415bde0 msgr2=0x7f4a240d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.306+0000 7f4a2994a640 1 --2- 172.21.15.5:0/3652850093 >> v2:172.21.15.154:3300/0 conn(0x7f4a2415bde0 0x7f4a240d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.306+0000 7f4a2994a640 1 -- 172.21.15.5:0/3652850093 >> v1:172.21.15.154:6789/0 conn(0x7f4a240d2fc0 legacy=0x7f4a240b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.306+0000 7f4a2994a640 1 -- 172.21.15.5:0/3652850093 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a240d2c80 con 0x7f4a240d2300 2023-07-14T12:53:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.310+0000 7f4a2994a640 1 --2- 172.21.15.5:0/3652850093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a240d2300 0x7f4a240d2740 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4a2408b210 tx=0x7f4a1c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a6a06fd245c150 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:00.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.310+0000 7f4a1bfff640 1 -- 172.21.15.5:0/3652850093 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c0a57a0 con 0x7f4a240d2300 2023-07-14T12:53:00.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.310+0000 7f4a1bfff640 1 -- 172.21.15.5:0/3652850093 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1c0a5900 con 0x7f4a240d2300 2023-07-14T12:53:00.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.310+0000 7f4a1bfff640 1 -- 172.21.15.5:0/3652850093 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c0a5c90 con 0x7f4a240d2300 2023-07-14T12:53:00.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.310+0000 7f4a2b3ad640 1 -- 172.21.15.5:0/3652850093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a240d2300 msgr2=0x7f4a240d2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:00.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.310+0000 7f4a2b3ad640 1 --2- 172.21.15.5:0/3652850093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a240d2300 0x7f4a240d2740 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4a2408b210 tx=0x7f4a1c01c9d0 comp rx=0 tx=0).stop 2023-07-14T12:53:00.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.310+0000 7f4a2b3ad640 1 -- 172.21.15.5:0/3652850093 shutdown_connections 2023-07-14T12:53:00.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.310+0000 7f4a2b3ad640 1 --2- 172.21.15.5:0/3652850093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a240d2300 0x7f4a240d2740 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:00.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.310+0000 7f4a2b3ad640 1 --2- 172.21.15.5:0/3652850093 >> v2:172.21.15.154:3300/0 conn(0x7f4a2415bde0 0x7f4a240d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:00.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.310+0000 7f4a2b3ad640 1 -- 172.21.15.5:0/3652850093 >> 172.21.15.5:0/3652850093 conn(0x7f4a240659d0 msgr2=0x7f4a2409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:00.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.310+0000 7f4a2b3ad640 1 -- 172.21.15.5:0/3652850093 shutdown_connections 2023-07-14T12:53:00.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.310+0000 7f4a2b3ad640 1 -- 172.21.15.5:0/3652850093 wait complete. 2023-07-14T12:53:00.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.314+0000 7f4a2b3ad640 1 Processor -- start 2023-07-14T12:53:00.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.314+0000 7f4a2b3ad640 1 -- start start 2023-07-14T12:53:00.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.314+0000 7f4a2b3ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a240d2300 0x7f4a240c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:00.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.314+0000 7f4a2b3ad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a240d2fc0 0x7f4a240cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:00.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.314+0000 7f4a2b3ad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a2415bde0 0x7f4a240cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:00.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.314+0000 7f4a2b3ad640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a240ca340 con 0x7f4a240d2fc0 2023-07-14T12:53:00.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.314+0000 7f4a2b3ad640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a24152910 con 0x7f4a240d2300 2023-07-14T12:53:00.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.314+0000 7f4a2b3ad640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a240b80e0 con 0x7f4a2415bde0 2023-07-14T12:53:00.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.314+0000 7f4a28948640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a240d2fc0 0x7f4a240cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:00.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.314+0000 7f4a28948640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a240d2fc0 0x7f4a240cb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56628/0 (socket says 172.21.15.5:56628) 2023-07-14T12:53:00.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.314+0000 7f4a28948640 1 -- 172.21.15.5:0/3430232470 learned_addr learned my addr 172.21.15.5:0/3430232470 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:00.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.314+0000 7f4a29149640 1 --2- 172.21.15.5:0/3430232470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a240d2300 0x7f4a240c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:00.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.314+0000 7f4a2994a640 1 --2- 172.21.15.5:0/3430232470 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a2415bde0 0x7f4a240cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:00.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.314+0000 7f4a28948640 1 -- 172.21.15.5:0/3430232470 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a2415bde0 msgr2=0x7f4a240cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:00.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.314+0000 7f4a28948640 1 --2- 172.21.15.5:0/3430232470 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a2415bde0 0x7f4a240cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:00.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.314+0000 7f4a28948640 1 -- 172.21.15.5:0/3430232470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a240d2300 msgr2=0x7f4a240c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:00.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.314+0000 7f4a28948640 1 --2- 172.21.15.5:0/3430232470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a240d2300 0x7f4a240c9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:00.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.314+0000 7f4a28948640 1 -- 172.21.15.5:0/3430232470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c009b30 con 0x7f4a240d2fc0 2023-07-14T12:53:00.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.314+0000 7f4a28948640 1 --2- 172.21.15.5:0/3430232470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a240d2fc0 0x7f4a240cb2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400c4d0 tx=0x7f4a1400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:00.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.314+0000 7f4a19ffb640 1 -- 172.21.15.5:0/3430232470 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a140052d0 con 0x7f4a240d2fc0 2023-07-14T12:53:00.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.314+0000 7f4a19ffb640 1 -- 172.21.15.5:0/3430232470 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a14005430 con 0x7f4a240d2fc0 2023-07-14T12:53:00.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.314+0000 7f4a19ffb640 1 -- 172.21.15.5:0/3430232470 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a14012830 con 0x7f4a240d2fc0 2023-07-14T12:53:00.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.314+0000 7f4a2b3ad640 1 -- 172.21.15.5:0/3430232470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a240ca530 con 0x7f4a240d2fc0 2023-07-14T12:53:00.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.314+0000 7f4a2b3ad640 1 -- 172.21.15.5:0/3430232470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a240caaf0 con 0x7f4a240d2fc0 2023-07-14T12:53:00.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.318+0000 7f4a2b3ad640 1 -- 172.21.15.5:0/3430232470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a24152a80 con 0x7f4a240d2fc0 2023-07-14T12:53:00.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.318+0000 7f4a19ffb640 1 -- 172.21.15.5:0/3430232470 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4a14012990 con 0x7f4a240d2fc0 2023-07-14T12:53:00.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.318+0000 7f4a19ffb640 1 --2- 172.21.15.5:0/3430232470 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4a080662b0 0x7f4a08068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:00.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.318+0000 7f4a19ffb640 1 -- 172.21.15.5:0/3430232470 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4a140837a0 con 0x7f4a240d2fc0 2023-07-14T12:53:00.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.318+0000 7f4a29149640 1 --2- 172.21.15.5:0/3430232470 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4a080662b0 0x7f4a08068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:00.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.322+0000 7f4a29149640 1 --2- 172.21.15.5:0/3430232470 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4a080662b0 0x7f4a08068760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4a20006fd0 tx=0x7f4a20008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:00.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.322+0000 7f4a19ffb640 1 -- 172.21.15.5:0/3430232470 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4a14050c90 con 0x7f4a240d2fc0 2023-07-14T12:53:00.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.478+0000 7f4a2b3ad640 1 -- 172.21.15.5:0/3430232470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4a240678d0 con 0x7f4a240d2fc0 2023-07-14T12:53:00.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.478+0000 7f4a19ffb640 1 -- 172.21.15.5:0/3430232470 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4a140542b0 con 0x7f4a240d2fc0 2023-07-14T12:53:00.505 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T12:53:00.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.478+0000 7f4a2b3ad640 1 -- 172.21.15.5:0/3430232470 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4a080662b0 msgr2=0x7f4a08068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:00.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.478+0000 7f4a2b3ad640 1 --2- 172.21.15.5:0/3430232470 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4a080662b0 0x7f4a08068760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4a20006fd0 tx=0x7f4a20008040 comp rx=0 tx=0).stop 2023-07-14T12:53:00.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.478+0000 7f4a2b3ad640 1 -- 172.21.15.5:0/3430232470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a240d2fc0 msgr2=0x7f4a240cb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:00.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.478+0000 7f4a2b3ad640 1 --2- 172.21.15.5:0/3430232470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a240d2fc0 0x7f4a240cb2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400c4d0 tx=0x7f4a1400c990 comp rx=0 tx=0).stop 2023-07-14T12:53:00.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.478+0000 7f4a2b3ad640 1 -- 172.21.15.5:0/3430232470 shutdown_connections 2023-07-14T12:53:00.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.478+0000 7f4a2b3ad640 1 --2- 172.21.15.5:0/3430232470 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a2415bde0 0x7f4a240cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:00.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.478+0000 7f4a2b3ad640 1 --2- 172.21.15.5:0/3430232470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a240d2fc0 0x7f4a240cb2f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:00.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.478+0000 7f4a2b3ad640 1 --2- 172.21.15.5:0/3430232470 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4a080662b0 0x7f4a08068760 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:00.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.478+0000 7f4a2b3ad640 1 --2- 172.21.15.5:0/3430232470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a240d2300 0x7f4a240c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:00.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.478+0000 7f4a2b3ad640 1 -- 172.21.15.5:0/3430232470 >> 172.21.15.5:0/3430232470 conn(0x7f4a240659d0 msgr2=0x7f4a240cf490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:00.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.478+0000 7f4a2b3ad640 1 -- 172.21.15.5:0/3430232470 shutdown_connections 2023-07-14T12:53:00.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.478+0000 7f4a2b3ad640 1 -- 172.21.15.5:0/3430232470 wait complete. 2023-07-14T12:53:00.525 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T12:53:00.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.646+0000 7f26e4a93640 1 Processor -- start 2023-07-14T12:53:00.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.646+0000 7f26e4a93640 1 -- start start 2023-07-14T12:53:00.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.646+0000 7f26e4a93640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f26e00d2fc0 0x7f26e00b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:00.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.646+0000 7f26e4a93640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f26e00d2300 0x7f26e00d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:00.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.646+0000 7f26e4a93640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e00b04c0 con 0x7f26e015bde0 2023-07-14T12:53:00.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.646+0000 7f26e4a93640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e015c1b0 con 0x7f26e00d2fc0 2023-07-14T12:53:00.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.646+0000 7f26e4a93640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e00d2c80 con 0x7f26e00d2300 2023-07-14T12:53:00.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.646+0000 7f26d7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f26e00d2fc0 0x7f26e00b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:00.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.646+0000 7f26d7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f26e00d2fc0 0x7f26e00b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56640/0 (socket says 172.21.15.5:56640) 2023-07-14T12:53:00.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.646+0000 7f26d7fff640 1 -- 172.21.15.5:0/2489593041 learned_addr learned my addr 172.21.15.5:0/2489593041 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:00.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.646+0000 7f26ded9d640 1 --2- 172.21.15.5:0/2489593041 >> v2:172.21.15.154:3300/0 conn(0x7f26e00d2300 0x7f26e00d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:00.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.646+0000 7f26d7fff640 1 -- 172.21.15.5:0/2489593041 >> v2:172.21.15.154:3300/0 conn(0x7f26e00d2300 msgr2=0x7f26e00d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:00.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.646+0000 7f26d7fff640 1 --2- 172.21.15.5:0/2489593041 >> v2:172.21.15.154:3300/0 conn(0x7f26e00d2300 0x7f26e00d2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:00.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.646+0000 7f26d7fff640 1 -- 172.21.15.5:0/2489593041 >> v1:172.21.15.154:6789/0 conn(0x7f26e015bde0 legacy=0x7f26e00d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:00.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.646+0000 7f26d7fff640 1 -- 172.21.15.5:0/2489593041 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e00d0aa0 con 0x7f26e00d2fc0 2023-07-14T12:53:00.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.646+0000 7f26ded9d640 1 --2- 172.21.15.5:0/2489593041 >> v2:172.21.15.154:3300/0 conn(0x7f26e00d2300 0x7f26e00d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:00.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.650+0000 7f26d7fff640 1 --2- 172.21.15.5:0/2489593041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26e00d2fc0 0x7f26e00b0950 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f26e008c820 tx=0x7f26c801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de13f66ee8e37d5f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:00.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.650+0000 7f26ddd9b640 1 -- 172.21.15.5:0/2489593041 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c80aa620 con 0x7f26e00d2fc0 2023-07-14T12:53:00.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.650+0000 7f26ddd9b640 1 -- 172.21.15.5:0/2489593041 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c80aa780 con 0x7f26e00d2fc0 2023-07-14T12:53:00.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.650+0000 7f26ddd9b640 1 -- 172.21.15.5:0/2489593041 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c80aab10 con 0x7f26e00d2fc0 2023-07-14T12:53:00.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.650+0000 7f26e4a93640 1 -- 172.21.15.5:0/2489593041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26e00d2fc0 msgr2=0x7f26e00b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:00.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.650+0000 7f26e4a93640 1 --2- 172.21.15.5:0/2489593041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26e00d2fc0 0x7f26e00b0950 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f26e008c820 tx=0x7f26c801c4c0 comp rx=0 tx=0).stop 2023-07-14T12:53:00.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.650+0000 7f26e4a93640 1 -- 172.21.15.5:0/2489593041 shutdown_connections 2023-07-14T12:53:00.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.650+0000 7f26e4a93640 1 --2- 172.21.15.5:0/2489593041 >> v2:172.21.15.154:3300/0 conn(0x7f26e00d2300 0x7f26e00d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:00.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.650+0000 7f26e4a93640 1 --2- 172.21.15.5:0/2489593041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26e00d2fc0 0x7f26e00b0950 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:00.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.650+0000 7f26e4a93640 1 -- 172.21.15.5:0/2489593041 >> 172.21.15.5:0/2489593041 conn(0x7f26e00659d0 msgr2=0x7f26e009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:00.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.650+0000 7f26e4a93640 1 -- 172.21.15.5:0/2489593041 shutdown_connections 2023-07-14T12:53:00.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.650+0000 7f26e4a93640 1 -- 172.21.15.5:0/2489593041 wait complete. 2023-07-14T12:53:00.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.654+0000 7f26e4a93640 1 Processor -- start 2023-07-14T12:53:00.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.654+0000 7f26e4a93640 1 -- start start 2023-07-14T12:53:00.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.654+0000 7f26e4a93640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26e00d2300 0x7f26e0152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:00.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.654+0000 7f26e4a93640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26e00d2fc0 0x7f26e00c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:00.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.654+0000 7f26e4a93640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26e015bde0 0x7f26e0159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:00.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.654+0000 7f26e4a93640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e01f4260 con 0x7f26e015bde0 2023-07-14T12:53:00.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.654+0000 7f26e4a93640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e01f4540 con 0x7f26e00d2fc0 2023-07-14T12:53:00.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.654+0000 7f26e4a93640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e01f4820 con 0x7f26e00d2300 2023-07-14T12:53:00.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.654+0000 7f26ded9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26e015bde0 0x7f26e0159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:00.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.654+0000 7f26ded9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26e015bde0 0x7f26e0159290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56646/0 (socket says 172.21.15.5:56646) 2023-07-14T12:53:00.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.654+0000 7f26ded9d640 1 -- 172.21.15.5:0/3891355706 learned_addr learned my addr 172.21.15.5:0/3891355706 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:00.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.654+0000 7f26d7fff640 1 --2- 172.21.15.5:0/3891355706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26e00d2fc0 0x7f26e00c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:00.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.654+0000 7f26de59c640 1 --2- 172.21.15.5:0/3891355706 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26e00d2300 0x7f26e0152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:00.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.654+0000 7f26ded9d640 1 -- 172.21.15.5:0/3891355706 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26e00d2300 msgr2=0x7f26e0152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:00.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.654+0000 7f26ded9d640 1 --2- 172.21.15.5:0/3891355706 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26e00d2300 0x7f26e0152180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.654+0000 7f26ded9d640 1 -- 172.21.15.5:0/3891355706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26e00d2fc0 msgr2=0x7f26e00c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.654+0000 7f26ded9d640 1 --2- 172.21.15.5:0/3891355706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26e00d2fc0 0x7f26e00c8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.654+0000 7f26ded9d640 1 -- 172.21.15.5:0/3891355706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c80094d0 con 0x7f26e015bde0 2023-07-14T12:53:00.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.654+0000 7f26d7fff640 1 --2- 172.21.15.5:0/3891355706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26e00d2fc0 0x7f26e00c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:00.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.654+0000 7f26de59c640 1 --2- 172.21.15.5:0/3891355706 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26e00d2300 0x7f26e0152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:00.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.654+0000 7f26ded9d640 1 --2- 172.21.15.5:0/3891355706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26e015bde0 0x7f26e0159290 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f26d800cef0 tx=0x7f26d800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:00.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.654+0000 7f26d6ffd640 1 -- 172.21.15.5:0/3891355706 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d800d840 con 0x7f26e015bde0 2023-07-14T12:53:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.654+0000 7f26d6ffd640 1 -- 172.21.15.5:0/3891355706 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d800d9c0 con 0x7f26e015bde0 2023-07-14T12:53:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.654+0000 7f26e4a93640 1 -- 172.21.15.5:0/3891355706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e01f4b00 con 0x7f26e015bde0 2023-07-14T12:53:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.654+0000 7f26d6ffd640 1 -- 172.21.15.5:0/3891355706 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d800dd70 con 0x7f26e015bde0 2023-07-14T12:53:00.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.654+0000 7f26e4a93640 1 -- 172.21.15.5:0/3891355706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e00c8c60 con 0x7f26e015bde0 2023-07-14T12:53:00.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.658+0000 7f26e4a93640 1 -- 172.21.15.5:0/3891355706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e01f4d40 con 0x7f26e015bde0 2023-07-14T12:53:00.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.658+0000 7f26d6ffd640 1 -- 172.21.15.5:0/3891355706 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f26d801e3b0 con 0x7f26e015bde0 2023-07-14T12:53:00.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.658+0000 7f26d6ffd640 1 --2- 172.21.15.5:0/3891355706 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f26c0066280 0x7f26c0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:00.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.658+0000 7f26d6ffd640 1 -- 172.21.15.5:0/3891355706 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f26d80847d0 con 0x7f26e015bde0 2023-07-14T12:53:00.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.658+0000 7f26de59c640 1 --2- 172.21.15.5:0/3891355706 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f26c0066280 0x7f26c0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:00.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.658+0000 7f26de59c640 1 --2- 172.21.15.5:0/3891355706 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f26c0066280 0x7f26c0068730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f26e015a3a0 tx=0x7f26d0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:00.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.662+0000 7f26d6ffd640 1 -- 172.21.15.5:0/3891355706 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f26e01f4d40 con 0x7f26e015bde0 2023-07-14T12:53:00.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.814+0000 7f26e4a93640 1 -- 172.21.15.5:0/3891355706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f26e01f4d40 con 0x7f26e015bde0 2023-07-14T12:53:00.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.814+0000 7f26d6ffd640 1 -- 172.21.15.5:0/3891355706 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f26d801a020 con 0x7f26e015bde0 2023-07-14T12:53:00.843 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T12:53:00.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.818+0000 7f26e4a93640 1 -- 172.21.15.5:0/3891355706 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f26c0066280 msgr2=0x7f26c0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:00.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.818+0000 7f26e4a93640 1 --2- 172.21.15.5:0/3891355706 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f26c0066280 0x7f26c0068730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f26e015a3a0 tx=0x7f26d0008040 comp rx=0 tx=0).stop 2023-07-14T12:53:00.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.818+0000 7f26e4a93640 1 -- 172.21.15.5:0/3891355706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26e015bde0 msgr2=0x7f26e0159290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:00.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.818+0000 7f26e4a93640 1 --2- 172.21.15.5:0/3891355706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26e015bde0 0x7f26e0159290 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f26d800cef0 tx=0x7f26d800a710 comp rx=0 tx=0).stop 2023-07-14T12:53:00.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.818+0000 7f26e4a93640 1 -- 172.21.15.5:0/3891355706 shutdown_connections 2023-07-14T12:53:00.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.818+0000 7f26e4a93640 1 --2- 172.21.15.5:0/3891355706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26e015bde0 0x7f26e0159290 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:00.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.818+0000 7f26e4a93640 1 --2- 172.21.15.5:0/3891355706 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f26c0066280 0x7f26c0068730 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:00.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.818+0000 7f26e4a93640 1 --2- 172.21.15.5:0/3891355706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26e00d2fc0 0x7f26e00c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:00.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.818+0000 7f26e4a93640 1 --2- 172.21.15.5:0/3891355706 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26e00d2300 0x7f26e0152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:00.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.818+0000 7f26e4a93640 1 -- 172.21.15.5:0/3891355706 >> 172.21.15.5:0/3891355706 conn(0x7f26e00659d0 msgr2=0x7f26e00cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:00.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.818+0000 7f26e4a93640 1 -- 172.21.15.5:0/3891355706 shutdown_connections 2023-07-14T12:53:00.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.818+0000 7f26e4a93640 1 -- 172.21.15.5:0/3891355706 wait complete. 2023-07-14T12:53:00.864 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:53:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.982+0000 7f6014093640 1 Processor -- start 2023-07-14T12:53:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.982+0000 7f6014093640 1 -- start start 2023-07-14T12:53:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.982+0000 7f6014093640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f600c160330 0x7f600c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.982+0000 7f6014093640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f600c0c17d0 con 0x7f600c0c0f80 2023-07-14T12:53:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.982+0000 7f6014093640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f600c0c14f0 con 0x7f600c0c8940 2023-07-14T12:53:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.982+0000 7f6014093640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f600c0cdd70 con 0x7f600c160330 2023-07-14T12:53:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.982+0000 7f6012630640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f600c0c0f80 0x7f600c0cd660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36068/0 (socket says 172.21.15.5:36068) 2023-07-14T12:53:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.982+0000 7f6012630640 1 -- 172.21.15.5:0/2482297607 learned_addr learned my addr 172.21.15.5:0/2482297607 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.982+0000 7f6011e2f640 1 --2- 172.21.15.5:0/2482297607 >> v2:172.21.15.154:3300/0 conn(0x7f600c160330 0x7f600c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.982+0000 7f6010e2d640 1 -- 172.21.15.5:0/2482297607 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223069308 0 0) 0x7f600c0c17d0 con 0x7f600c0c0f80 2023-07-14T12:53:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.982+0000 7f6010e2d640 1 -- 172.21.15.5:0/2482297607 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ff8003530 con 0x7f600c0c0f80 2023-07-14T12:53:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.986+0000 7f6011e2f640 1 -- 172.21.15.5:0/2482297607 >> v1:172.21.15.154:6789/0 conn(0x7f600c0c8940 legacy=0x7f600c0ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.986+0000 7f6011e2f640 1 -- 172.21.15.5:0/2482297607 >> v1:172.21.15.5:6789/0 conn(0x7f600c0c0f80 legacy=0x7f600c0cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.986+0000 7f6011e2f640 1 -- 172.21.15.5:0/2482297607 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600c0cac10 con 0x7f600c160330 2023-07-14T12:53:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.986+0000 7f6011e2f640 1 --2- 172.21.15.5:0/2482297607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f600c160330 0x7f600c0cb6f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f60080097c0 tx=0x7f600801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42b4deadd63c71ac server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.986+0000 7f6010e2d640 1 -- 172.21.15.5:0/2482297607 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60080a8970 con 0x7f600c160330 2023-07-14T12:53:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.986+0000 7f6010e2d640 1 -- 172.21.15.5:0/2482297607 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60080a8ad0 con 0x7f600c160330 2023-07-14T12:53:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.986+0000 7f6010e2d640 1 -- 172.21.15.5:0/2482297607 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60080a8e40 con 0x7f600c160330 2023-07-14T12:53:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.990+0000 7f6014093640 1 -- 172.21.15.5:0/2482297607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f600c160330 msgr2=0x7f600c0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.990+0000 7f6014093640 1 --2- 172.21.15.5:0/2482297607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f600c160330 0x7f600c0cb6f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f60080097c0 tx=0x7f600801ec70 comp rx=0 tx=0).stop 2023-07-14T12:53:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.990+0000 7f6014093640 1 -- 172.21.15.5:0/2482297607 shutdown_connections 2023-07-14T12:53:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.990+0000 7f6014093640 1 --2- 172.21.15.5:0/2482297607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f600c160330 0x7f600c0cb6f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.990+0000 7f6014093640 1 -- 172.21.15.5:0/2482297607 >> 172.21.15.5:0/2482297607 conn(0x7f600c0afcf0 msgr2=0x7f600c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.990+0000 7f6014093640 1 -- 172.21.15.5:0/2482297607 shutdown_connections 2023-07-14T12:53:01.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.990+0000 7f6014093640 1 -- 172.21.15.5:0/2482297607 wait complete. 2023-07-14T12:53:01.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.990+0000 7f6014093640 1 Processor -- start 2023-07-14T12:53:01.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.990+0000 7f6014093640 1 -- start start 2023-07-14T12:53:01.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.990+0000 7f6014093640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f600c0c0f80 0x7f600c1549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:01.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.990+0000 7f6014093640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f600c0c8940 0x7f600c161ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:01.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.990+0000 7f6014093640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f600c160330 0x7f600c161ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:01.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.990+0000 7f6014093640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600c162530 con 0x7f600c160330 2023-07-14T12:53:01.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.990+0000 7f6014093640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600c0c4ab0 con 0x7f600c0c8940 2023-07-14T12:53:01.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.990+0000 7f6014093640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600c162780 con 0x7f600c0c0f80 2023-07-14T12:53:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.990+0000 7f6012630640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f600c160330 0x7f600c161ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.990+0000 7f6012630640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f600c160330 0x7f600c161ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56650/0 (socket says 172.21.15.5:56650) 2023-07-14T12:53:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.990+0000 7f6012630640 1 -- 172.21.15.5:0/1738466240 learned_addr learned my addr 172.21.15.5:0/1738466240 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.990+0000 7f6011e2f640 1 --2- 172.21.15.5:0/1738466240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f600c0c0f80 0x7f600c1549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:01.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.990+0000 7f601162e640 1 --2- 172.21.15.5:0/1738466240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f600c0c8940 0x7f600c161ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:01.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.990+0000 7f6012630640 1 -- 172.21.15.5:0/1738466240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f600c0c0f80 msgr2=0x7f600c1549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:01.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.990+0000 7f6012630640 1 --2- 172.21.15.5:0/1738466240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f600c0c0f80 0x7f600c1549e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:01.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.990+0000 7f6012630640 1 -- 172.21.15.5:0/1738466240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f600c0c8940 msgr2=0x7f600c161ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:01.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.990+0000 7f6012630640 1 --2- 172.21.15.5:0/1738466240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f600c0c8940 0x7f600c161ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:01.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.990+0000 7f6012630640 1 -- 172.21.15.5:0/1738466240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6008009420 con 0x7f600c160330 2023-07-14T12:53:01.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.990+0000 7f6011e2f640 1 --2- 172.21.15.5:0/1738466240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f600c0c0f80 0x7f600c1549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:01.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.994+0000 7f6012630640 1 --2- 172.21.15.5:0/1738466240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f600c160330 0x7f600c161ff0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f600400cb40 tx=0x7f600400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:01.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.994+0000 7f60027fc640 1 -- 172.21.15.5:0/1738466240 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600400aca0 con 0x7f600c160330 2023-07-14T12:53:01.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.994+0000 7f60027fc640 1 -- 172.21.15.5:0/1738466240 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600400ae00 con 0x7f600c160330 2023-07-14T12:53:01.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.994+0000 7f60027fc640 1 -- 172.21.15.5:0/1738466240 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6004012620 con 0x7f600c160330 2023-07-14T12:53:01.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.994+0000 7f6014093640 1 -- 172.21.15.5:0/1738466240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f600c162a60 con 0x7f600c160330 2023-07-14T12:53:01.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.994+0000 7f6014093640 1 -- 172.21.15.5:0/1738466240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f600c0c5230 con 0x7f600c160330 2023-07-14T12:53:01.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.994+0000 7f6014093640 1 -- 172.21.15.5:0/1738466240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f600c0c5450 con 0x7f600c160330 2023-07-14T12:53:01.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.994+0000 7f60027fc640 1 -- 172.21.15.5:0/1738466240 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6004007070 con 0x7f600c160330 2023-07-14T12:53:01.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.994+0000 7f60027fc640 1 --2- 172.21.15.5:0/1738466240 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5ff0066280 0x7f5ff0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:01.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.994+0000 7f60027fc640 1 -- 172.21.15.5:0/1738466240 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6004083e10 con 0x7f600c160330 2023-07-14T12:53:01.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.994+0000 7f6011e2f640 1 --2- 172.21.15.5:0/1738466240 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5ff0066280 0x7f5ff0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:01.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.998+0000 7f6011e2f640 1 --2- 172.21.15.5:0/1738466240 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5ff0066280 0x7f5ff0068730 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f60080b2000 tx=0x7f60080aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:01.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:00.998+0000 7f60027fc640 1 -- 172.21.15.5:0/1738466240 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6004087030 con 0x7f600c160330 2023-07-14T12:53:01.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.186+0000 7f6014093640 1 -- 172.21.15.5:0/1738466240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f600c0678d0 con 0x7f600c160330 2023-07-14T12:53:01.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.186+0000 7f60027fc640 1 -- 172.21.15.5:0/1738466240 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4703 (secure 0 0 0) 0x7f6004017090 con 0x7f600c160330 2023-07-14T12:53:01.214 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:01.214 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1953958881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1953958881},{"type":"v1","addr":"172.21.15.154:6837","nonce":1953958881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3138000501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3138000501},{"type":"v1","addr":"172.21.15.5:6834","nonce":3138000501}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1911549775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1911549775},{"type":"v1","addr":"172.21.15.5:6835","nonce":1911549775}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T12:52:46.473195+0000","modified":"2023-07-14T12:52:50.433872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6836/3154882793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3154882793},{"type":"v1","addr":"172.21.15.154:6836","nonce":3154882793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T12:53:01.214 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2023-07-14T12:53:01.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.190+0000 7f6014093640 1 -- 172.21.15.5:0/1738466240 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5ff0066280 msgr2=0x7f5ff0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:01.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.190+0000 7f6014093640 1 --2- 172.21.15.5:0/1738466240 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5ff0066280 0x7f5ff0068730 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f60080b2000 tx=0x7f60080aa070 comp rx=0 tx=0).stop 2023-07-14T12:53:01.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.190+0000 7f6014093640 1 -- 172.21.15.5:0/1738466240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f600c160330 msgr2=0x7f600c161ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:01.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.190+0000 7f6014093640 1 --2- 172.21.15.5:0/1738466240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f600c160330 0x7f600c161ff0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f600400cb40 tx=0x7f600400a060 comp rx=0 tx=0).stop 2023-07-14T12:53:01.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.190+0000 7f6014093640 1 -- 172.21.15.5:0/1738466240 shutdown_connections 2023-07-14T12:53:01.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.190+0000 7f6014093640 1 --2- 172.21.15.5:0/1738466240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f600c160330 0x7f600c161ff0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:01.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.190+0000 7f6014093640 1 --2- 172.21.15.5:0/1738466240 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5ff0066280 0x7f5ff0068730 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:01.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.190+0000 7f6014093640 1 --2- 172.21.15.5:0/1738466240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f600c0c8940 0x7f600c161ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:01.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.190+0000 7f6014093640 1 --2- 172.21.15.5:0/1738466240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f600c0c0f80 0x7f600c1549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:01.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.190+0000 7f6014093640 1 -- 172.21.15.5:0/1738466240 >> 172.21.15.5:0/1738466240 conn(0x7f600c0afcf0 msgr2=0x7f600c0b0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:01.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.190+0000 7f6014093640 1 -- 172.21.15.5:0/1738466240 shutdown_connections 2023-07-14T12:53:01.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.190+0000 7f6014093640 1 -- 172.21.15.5:0/1738466240 wait complete. 2023-07-14T12:53:01.235 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:53:01.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.350+0000 7f0881a48640 1 Processor -- start 2023-07-14T12:53:01.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.350+0000 7f0881a48640 1 -- start start 2023-07-14T12:53:01.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.354+0000 7f0881a48640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f087c0b7c70 0x7f087c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:01.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.354+0000 7f0881a48640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f087c15fd60 0x7f087c0d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:01.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.354+0000 7f0881a48640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f087c0ccaf0 con 0x7f087c0d1850 2023-07-14T12:53:01.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.354+0000 7f0881a48640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f087c0d1190 con 0x7f087c15fd60 2023-07-14T12:53:01.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.354+0000 7f0881a48640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f087c160600 con 0x7f087c0b7c70 2023-07-14T12:53:01.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.354+0000 7f087b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f087c15fd60 0x7f087c0d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:01.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.354+0000 7f087b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f087c15fd60 0x7f087c0d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56658/0 (socket says 172.21.15.5:56658) 2023-07-14T12:53:01.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.354+0000 7f087b7fe640 1 -- 172.21.15.5:0/888238441 learned_addr learned my addr 172.21.15.5:0/888238441 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:01.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.354+0000 7f087b7fe640 1 -- 172.21.15.5:0/888238441 >> v2:172.21.15.154:3300/0 conn(0x7f087c0b7c70 msgr2=0x7f087c0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:01.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.354+0000 7f087affd640 1 --2- 172.21.15.5:0/888238441 >> v2:172.21.15.154:3300/0 conn(0x7f087c0b7c70 0x7f087c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:01.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.354+0000 7f087b7fe640 1 --2- 172.21.15.5:0/888238441 >> v2:172.21.15.154:3300/0 conn(0x7f087c0b7c70 0x7f087c0d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:01.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.354+0000 7f087b7fe640 1 -- 172.21.15.5:0/888238441 >> v1:172.21.15.154:6789/0 conn(0x7f087c0d1850 legacy=0x7f087c15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:01.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.354+0000 7f087b7fe640 1 -- 172.21.15.5:0/888238441 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087c160320 con 0x7f087c15fd60 2023-07-14T12:53:01.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.354+0000 7f087affd640 1 --2- 172.21.15.5:0/888238441 >> v2:172.21.15.154:3300/0 conn(0x7f087c0b7c70 0x7f087c0d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:01.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.354+0000 7f087b7fe640 1 --2- 172.21.15.5:0/888238441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f087c15fd60 0x7f087c0d1da0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f087c0b40a0 tx=0x7f087401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cfdf068536d5719 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:01.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.354+0000 7f087a7fc640 1 -- 172.21.15.5:0/888238441 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08740a5840 con 0x7f087c15fd60 2023-07-14T12:53:01.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.358+0000 7f087a7fc640 1 -- 172.21.15.5:0/888238441 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08740a59a0 con 0x7f087c15fd60 2023-07-14T12:53:01.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.358+0000 7f087a7fc640 1 -- 172.21.15.5:0/888238441 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08740a5d30 con 0x7f087c15fd60 2023-07-14T12:53:01.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.358+0000 7f0881a48640 1 -- 172.21.15.5:0/888238441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f087c15fd60 msgr2=0x7f087c0d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:01.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.358+0000 7f0881a48640 1 --2- 172.21.15.5:0/888238441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f087c15fd60 0x7f087c0d1da0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f087c0b40a0 tx=0x7f087401c960 comp rx=0 tx=0).stop 2023-07-14T12:53:01.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.358+0000 7f0881a48640 1 -- 172.21.15.5:0/888238441 shutdown_connections 2023-07-14T12:53:01.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.358+0000 7f0881a48640 1 --2- 172.21.15.5:0/888238441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f087c15fd60 0x7f087c0d1da0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:01.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.358+0000 7f0881a48640 1 --2- 172.21.15.5:0/888238441 >> v2:172.21.15.154:3300/0 conn(0x7f087c0b7c70 0x7f087c0d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:01.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.358+0000 7f0881a48640 1 -- 172.21.15.5:0/888238441 >> 172.21.15.5:0/888238441 conn(0x7f087c0650b0 msgr2=0x7f087c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:01.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.358+0000 7f0881a48640 1 -- 172.21.15.5:0/888238441 shutdown_connections 2023-07-14T12:53:01.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.358+0000 7f0881a48640 1 -- 172.21.15.5:0/888238441 wait complete. 2023-07-14T12:53:01.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.358+0000 7f0881a48640 1 Processor -- start 2023-07-14T12:53:01.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.358+0000 7f0881a48640 1 -- start start 2023-07-14T12:53:01.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.358+0000 7f0881a48640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f087c0b7c70 0x7f087c158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:01.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.358+0000 7f0881a48640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f087c0d1850 0x7f087c0c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:01.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.358+0000 7f0881a48640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f087c15fd60 0x7f087c14f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:01.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.358+0000 7f0881a48640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087c0c6620 con 0x7f087c15fd60 2023-07-14T12:53:01.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.358+0000 7f0881a48640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087c0c6dc0 con 0x7f087c0b7c70 2023-07-14T12:53:01.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.358+0000 7f0881a48640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087c1576a0 con 0x7f087c0d1850 2023-07-14T12:53:01.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.358+0000 7f087b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f087c15fd60 0x7f087c14f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:01.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.358+0000 7f087b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f087c15fd60 0x7f087c14f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56666/0 (socket says 172.21.15.5:56666) 2023-07-14T12:53:01.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.358+0000 7f087b7fe640 1 -- 172.21.15.5:0/1855827621 learned_addr learned my addr 172.21.15.5:0/1855827621 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:01.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.362+0000 7f087affd640 1 --2- 172.21.15.5:0/1855827621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f087c0b7c70 0x7f087c158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:01.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.362+0000 7f0873fff640 1 --2- 172.21.15.5:0/1855827621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f087c0d1850 0x7f087c0c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:01.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.362+0000 7f087b7fe640 1 -- 172.21.15.5:0/1855827621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f087c0d1850 msgr2=0x7f087c0c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:01.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.362+0000 7f087b7fe640 1 --2- 172.21.15.5:0/1855827621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f087c0d1850 0x7f087c0c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:01.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.362+0000 7f087b7fe640 1 -- 172.21.15.5:0/1855827621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f087c0b7c70 msgr2=0x7f087c158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:01.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.362+0000 7f087b7fe640 1 --2- 172.21.15.5:0/1855827621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f087c0b7c70 0x7f087c158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:01.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.362+0000 7f087b7fe640 1 -- 172.21.15.5:0/1855827621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0874009b30 con 0x7f087c15fd60 2023-07-14T12:53:01.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.362+0000 7f087b7fe640 1 --2- 172.21.15.5:0/1855827621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f087c15fd60 0x7f087c14f090 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f087401a590 tx=0x7f0874019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:01.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.362+0000 7f0878ff9640 1 -- 172.21.15.5:0/1855827621 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08740b8670 con 0x7f087c15fd60 2023-07-14T12:53:01.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.362+0000 7f0878ff9640 1 -- 172.21.15.5:0/1855827621 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08740b8810 con 0x7f087c15fd60 2023-07-14T12:53:01.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.362+0000 7f0878ff9640 1 -- 172.21.15.5:0/1855827621 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08740b8bc0 con 0x7f087c15fd60 2023-07-14T12:53:01.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.362+0000 7f0881a48640 1 -- 172.21.15.5:0/1855827621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f087c1593a0 con 0x7f087c15fd60 2023-07-14T12:53:01.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.362+0000 7f0881a48640 1 -- 172.21.15.5:0/1855827621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f087c0c6ae0 con 0x7f087c15fd60 2023-07-14T12:53:01.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.362+0000 7f0881a48640 1 -- 172.21.15.5:0/1855827621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f087c157810 con 0x7f087c15fd60 2023-07-14T12:53:01.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.362+0000 7f0878ff9640 1 -- 172.21.15.5:0/1855827621 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f08740b8d20 con 0x7f087c15fd60 2023-07-14T12:53:01.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.362+0000 7f0878ff9640 1 --2- 172.21.15.5:0/1855827621 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f085c066280 0x7f085c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:01.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.366+0000 7f0878ff9640 1 -- 172.21.15.5:0/1855827621 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f087411f1c0 con 0x7f087c15fd60 2023-07-14T12:53:01.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.366+0000 7f087affd640 1 --2- 172.21.15.5:0/1855827621 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f085c066280 0x7f085c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:01.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.366+0000 7f087affd640 1 --2- 172.21.15.5:0/1855827621 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f085c066280 0x7f085c068730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f086c006fd0 tx=0x7f086c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:01.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.370+0000 7f0878ff9640 1 -- 172.21.15.5:0/1855827621 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f08740ec650 con 0x7f087c15fd60 2023-07-14T12:53:01.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.526+0000 7f0881a48640 1 -- 172.21.15.5:0/1855827621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f087c157810 con 0x7f087c15fd60 2023-07-14T12:53:01.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.526+0000 7f0878ff9640 1 -- 172.21.15.5:0/1855827621 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18231 (secure 0 0 0) 0x7f08740efc70 con 0x7f087c15fd60 2023-07-14T12:53:01.553 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:01.554 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":23,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:52:48.091483+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:52:44.223082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T12:52:45.469396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:53:01.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.530+0000 7f0881a48640 1 -- 172.21.15.5:0/1855827621 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f085c066280 msgr2=0x7f085c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:01.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.530+0000 7f0881a48640 1 --2- 172.21.15.5:0/1855827621 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f085c066280 0x7f085c068730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f086c006fd0 tx=0x7f086c008040 comp rx=0 tx=0).stop 2023-07-14T12:53:01.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.530+0000 7f0881a48640 1 -- 172.21.15.5:0/1855827621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f087c15fd60 msgr2=0x7f087c14f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:01.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.530+0000 7f0881a48640 1 --2- 172.21.15.5:0/1855827621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f087c15fd60 0x7f087c14f090 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f087401a590 tx=0x7f0874019700 comp rx=0 tx=0).stop 2023-07-14T12:53:01.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.530+0000 7f0881a48640 1 -- 172.21.15.5:0/1855827621 shutdown_connections 2023-07-14T12:53:01.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.530+0000 7f0881a48640 1 --2- 172.21.15.5:0/1855827621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f087c15fd60 0x7f087c14f090 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:01.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.530+0000 7f0881a48640 1 --2- 172.21.15.5:0/1855827621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f087c0d1850 0x7f087c0c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:01.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.530+0000 7f0881a48640 1 --2- 172.21.15.5:0/1855827621 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f085c066280 0x7f085c068730 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:01.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.530+0000 7f0881a48640 1 --2- 172.21.15.5:0/1855827621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f087c0b7c70 0x7f087c158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:01.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.530+0000 7f0881a48640 1 -- 172.21.15.5:0/1855827621 >> 172.21.15.5:0/1855827621 conn(0x7f087c0650b0 msgr2=0x7f087c0b71a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:01.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.530+0000 7f0881a48640 1 -- 172.21.15.5:0/1855827621 shutdown_connections 2023-07-14T12:53:01.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.530+0000 7f0881a48640 1 -- 172.21.15.5:0/1855827621 wait complete. 2023-07-14T12:53:01.575 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:53:01.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.690+0000 7f36a38f9640 1 Processor -- start 2023-07-14T12:53:01.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f36a38f9640 1 -- start start 2023-07-14T12:53:01.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f36a38f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f369c0d06b0 0x7f369c0b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:01.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f36a38f9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369c0b2410 con 0x7f369c145430 2023-07-14T12:53:01.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f36a38f9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369c0b26f0 con 0x7f369c0b1f70 2023-07-14T12:53:01.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f36a38f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369c0b29d0 con 0x7f369c0d06b0 2023-07-14T12:53:01.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f36a0e94640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f369c145430 0x7f369c0b34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36078/0 (socket says 172.21.15.5:36078) 2023-07-14T12:53:01.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f36a0e94640 1 -- 172.21.15.5:0/1779110060 learned_addr learned my addr 172.21.15.5:0/1779110060 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:01.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f36a1695640 1 --2- 172.21.15.5:0/1779110060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f369c0d06b0 0x7f369c0b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:01.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f3693fff640 1 -- 172.21.15.5:0/1779110060 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821520734 0 0) 0x7f369c0b2410 con 0x7f369c145430 2023-07-14T12:53:01.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f3693fff640 1 -- 172.21.15.5:0/1779110060 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3688003530 con 0x7f369c145430 2023-07-14T12:53:01.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f3693fff640 1 -- 172.21.15.5:0/1779110060 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2138518175 0 0) 0x7f369c0b26f0 con 0x7f369c0b1f70 2023-07-14T12:53:01.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f3693fff640 1 -- 172.21.15.5:0/1779110060 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f369c0b2410 con 0x7f369c0b1f70 2023-07-14T12:53:01.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f3693fff640 1 -- 172.21.15.5:0/1779110060 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1004695985 0 0) 0x7f3688003530 con 0x7f369c145430 2023-07-14T12:53:01.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f3693fff640 1 -- 172.21.15.5:0/1779110060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f369c0d06b0 msgr2=0x7f369c0b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:01.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f3693fff640 1 --2- 172.21.15.5:0/1779110060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f369c0d06b0 0x7f369c0b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:01.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f3693fff640 1 -- 172.21.15.5:0/1779110060 >> v1:172.21.15.154:6789/0 conn(0x7f369c0b1f70 legacy=0x7f369c0d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:01.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f3693fff640 1 -- 172.21.15.5:0/1779110060 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c0b2cb0 con 0x7f369c145430 2023-07-14T12:53:01.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f3693fff640 1 -- 172.21.15.5:0/1779110060 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f368c001680 con 0x7f369c145430 2023-07-14T12:53:01.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f3693fff640 1 -- 172.21.15.5:0/1779110060 >> v1:172.21.15.5:6789/0 conn(0x7f369c145430 legacy=0x7f369c0b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:01.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f3693fff640 1 --2- 172.21.15.5:0/1779110060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3688003b40 0x7f3688003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:01.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f3693fff640 1 --2- 172.21.15.5:0/1779110060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f369c0d06b0 0x7f36880047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:01.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f3693fff640 1 --2- 172.21.15.5:0/1779110060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3688004d10 0x7f3688005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:01.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f3693fff640 1 -- 172.21.15.5:0/1779110060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369c0b29d0 con 0x7f3688003b40 2023-07-14T12:53:01.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f3693fff640 1 -- 172.21.15.5:0/1779110060 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368800ba40 con 0x7f3688004d10 2023-07-14T12:53:01.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f3693fff640 1 -- 172.21.15.5:0/1779110060 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368800bbb0 con 0x7f369c0d06b0 2023-07-14T12:53:01.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f36a1695640 1 --2- 172.21.15.5:0/1779110060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3688003b40 0x7f3688003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:01.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f36a0e94640 1 --2- 172.21.15.5:0/1779110060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f369c0d06b0 0x7f36880047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:01.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f36a1e96640 1 --2- 172.21.15.5:0/1779110060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3688004d10 0x7f3688005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:01.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f36a1695640 1 -- 172.21.15.5:0/1779110060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f369c0d06b0 msgr2=0x7f36880047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:01.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f36a1695640 1 --2- 172.21.15.5:0/1779110060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f369c0d06b0 0x7f36880047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:01.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f36a1695640 1 -- 172.21.15.5:0/1779110060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3688004d10 msgr2=0x7f3688005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:01.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f36a1695640 1 --2- 172.21.15.5:0/1779110060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3688004d10 0x7f3688005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:01.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.694+0000 7f36a1695640 1 -- 172.21.15.5:0/1779110060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3688003530 con 0x7f3688003b40 2023-07-14T12:53:01.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.698+0000 7f36a1695640 1 --2- 172.21.15.5:0/1779110060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3688003b40 0x7f3688003f30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3698009ae0 tx=0x7f369801d420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16c4031ee278bc2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:01.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.698+0000 7f3693fff640 1 -- 172.21.15.5:0/1779110060 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36980a5610 con 0x7f3688003b40 2023-07-14T12:53:01.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.698+0000 7f3693fff640 1 -- 172.21.15.5:0/1779110060 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36980a5770 con 0x7f3688003b40 2023-07-14T12:53:01.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.698+0000 7f3693fff640 1 -- 172.21.15.5:0/1779110060 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36980a5b20 con 0x7f3688003b40 2023-07-14T12:53:01.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.698+0000 7f36a38f9640 1 -- 172.21.15.5:0/1779110060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3688003b40 msgr2=0x7f3688003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:01.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.698+0000 7f36a38f9640 1 --2- 172.21.15.5:0/1779110060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3688003b40 0x7f3688003f30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3698009ae0 tx=0x7f369801d420 comp rx=0 tx=0).stop 2023-07-14T12:53:01.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.698+0000 7f36a1e96640 1 -- 172.21.15.5:0/1779110060 reap_dead start 2023-07-14T12:53:01.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.698+0000 7f36a38f9640 1 -- 172.21.15.5:0/1779110060 shutdown_connections 2023-07-14T12:53:01.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.698+0000 7f36a38f9640 1 -- 172.21.15.5:0/1779110060 >> 172.21.15.5:0/1779110060 conn(0x7f369c0659d0 msgr2=0x7f369c09b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:01.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.698+0000 7f36a38f9640 1 -- 172.21.15.5:0/1779110060 shutdown_connections 2023-07-14T12:53:01.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.698+0000 7f36a38f9640 1 -- 172.21.15.5:0/1779110060 wait complete. 2023-07-14T12:53:01.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.702+0000 7f36a38f9640 1 Processor -- start 2023-07-14T12:53:01.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.702+0000 7f36a38f9640 1 -- start start 2023-07-14T12:53:01.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.702+0000 7f36a38f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3688003b40 0x7f369c1f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:01.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.702+0000 7f36a38f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f369c0b6ad0 0x7f369c0b6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:01.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.702+0000 7f36a38f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f369c0c8050 0x7f369c0c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:01.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.702+0000 7f36a38f9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369c0b7460 con 0x7f3688003b40 2023-07-14T12:53:01.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.702+0000 7f36a38f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369c0b8250 con 0x7f369c0b6ad0 2023-07-14T12:53:01.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.702+0000 7f36a38f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369c0c8a00 con 0x7f369c0c8050 2023-07-14T12:53:01.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.702+0000 7f36a1695640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3688003b40 0x7f369c1f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:01.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.702+0000 7f36a1695640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3688003b40 0x7f369c1f4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56678/0 (socket says 172.21.15.5:56678) 2023-07-14T12:53:01.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.702+0000 7f36a1695640 1 -- 172.21.15.5:0/3903024996 learned_addr learned my addr 172.21.15.5:0/3903024996 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:01.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.702+0000 7f36a1695640 1 -- 172.21.15.5:0/3903024996 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f369c0c8050 msgr2=0x7f369c0c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:01.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.702+0000 7f36a0e94640 1 --2- 172.21.15.5:0/3903024996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f369c0b6ad0 0x7f369c0b6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:01.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.702+0000 7f36a1e96640 1 --2- 172.21.15.5:0/3903024996 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f369c0c8050 0x7f369c0c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:01.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.702+0000 7f36a1695640 1 --2- 172.21.15.5:0/3903024996 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f369c0c8050 0x7f369c0c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:01.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.702+0000 7f36a1695640 1 -- 172.21.15.5:0/3903024996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f369c0b6ad0 msgr2=0x7f369c0b6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:01.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.702+0000 7f36a1695640 1 --2- 172.21.15.5:0/3903024996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f369c0b6ad0 0x7f369c0b6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:01.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.702+0000 7f36a1695640 1 -- 172.21.15.5:0/3903024996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c0b7640 con 0x7f3688003b40 2023-07-14T12:53:01.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.702+0000 7f36a0e94640 1 --2- 172.21.15.5:0/3903024996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f369c0b6ad0 0x7f369c0b6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:01.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.702+0000 7f36a1e96640 1 --2- 172.21.15.5:0/3903024996 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f369c0c8050 0x7f369c0c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:01.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.702+0000 7f36a1695640 1 --2- 172.21.15.5:0/3903024996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3688003b40 0x7f369c1f4ab0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f369801cea0 tx=0x7f36980197c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:01.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.702+0000 7f3691ffb640 1 -- 172.21.15.5:0/3903024996 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369800f000 con 0x7f3688003b40 2023-07-14T12:53:01.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.702+0000 7f3691ffb640 1 -- 172.21.15.5:0/3903024996 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3698004020 con 0x7f3688003b40 2023-07-14T12:53:01.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.702+0000 7f3691ffb640 1 -- 172.21.15.5:0/3903024996 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36980043d0 con 0x7f3688003b40 2023-07-14T12:53:01.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.702+0000 7f36a38f9640 1 -- 172.21.15.5:0/3903024996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369c0b7920 con 0x7f3688003b40 2023-07-14T12:53:01.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.702+0000 7f36a38f9640 1 -- 172.21.15.5:0/3903024996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369c0b7ee0 con 0x7f3688003b40 2023-07-14T12:53:01.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.706+0000 7f36a38f9640 1 -- 172.21.15.5:0/3903024996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f369c0678d0 con 0x7f3688003b40 2023-07-14T12:53:01.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.706+0000 7f3691ffb640 1 -- 172.21.15.5:0/3903024996 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f36980b4070 con 0x7f3688003b40 2023-07-14T12:53:01.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.706+0000 7f3691ffb640 1 --2- 172.21.15.5:0/3903024996 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3680066280 0x7f3680068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:01.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.706+0000 7f3691ffb640 1 -- 172.21.15.5:0/3903024996 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f369811dc40 con 0x7f3688003b40 2023-07-14T12:53:01.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.706+0000 7f36a0e94640 1 --2- 172.21.15.5:0/3903024996 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3680066280 0x7f3680068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:01.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.706+0000 7f36a0e94640 1 --2- 172.21.15.5:0/3903024996 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3680066280 0x7f3680068730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f368c000f70 tx=0x7f368c000ee0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:01.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.710+0000 7f3691ffb640 1 -- 172.21.15.5:0/3903024996 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f36980eb0b0 con 0x7f3688003b40 2023-07-14T12:53:01.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.898+0000 7f36a38f9640 1 -- 172.21.15.5:0/3903024996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f369c0c8fb0 con 0x7f3688003b40 2023-07-14T12:53:01.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.898+0000 7f3691ffb640 1 -- 172.21.15.5:0/3903024996 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4703 (secure 0 0 0) 0x7f36980ee6d0 con 0x7f3688003b40 2023-07-14T12:53:01.925 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:01.925 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1953958881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1953958881},{"type":"v1","addr":"172.21.15.154:6837","nonce":1953958881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3138000501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3138000501},{"type":"v1","addr":"172.21.15.5:6834","nonce":3138000501}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1911549775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1911549775},{"type":"v1","addr":"172.21.15.5:6835","nonce":1911549775}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T12:52:46.473195+0000","modified":"2023-07-14T12:52:50.433872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6836/3154882793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3154882793},{"type":"v1","addr":"172.21.15.154:6836","nonce":3154882793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T12:53:01.925 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2023-07-14T12:53:01.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.898+0000 7f36a38f9640 1 -- 172.21.15.5:0/3903024996 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3680066280 msgr2=0x7f3680068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:01.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.898+0000 7f36a38f9640 1 --2- 172.21.15.5:0/3903024996 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3680066280 0x7f3680068730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f368c000f70 tx=0x7f368c000ee0 comp rx=0 tx=0).stop 2023-07-14T12:53:01.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.898+0000 7f36a38f9640 1 -- 172.21.15.5:0/3903024996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3688003b40 msgr2=0x7f369c1f4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:01.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.898+0000 7f36a38f9640 1 --2- 172.21.15.5:0/3903024996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3688003b40 0x7f369c1f4ab0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f369801cea0 tx=0x7f36980197c0 comp rx=0 tx=0).stop 2023-07-14T12:53:01.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.902+0000 7f36a38f9640 1 -- 172.21.15.5:0/3903024996 shutdown_connections 2023-07-14T12:53:01.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.902+0000 7f36a38f9640 1 --2- 172.21.15.5:0/3903024996 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f369c0c8050 0x7f369c0c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:01.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.902+0000 7f36a38f9640 1 --2- 172.21.15.5:0/3903024996 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3680066280 0x7f3680068730 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:01.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.902+0000 7f36a38f9640 1 --2- 172.21.15.5:0/3903024996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f369c0b6ad0 0x7f369c0b6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:01.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.902+0000 7f36a38f9640 1 --2- 172.21.15.5:0/3903024996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3688003b40 0x7f369c1f4ab0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:01.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.902+0000 7f36a38f9640 1 -- 172.21.15.5:0/3903024996 >> 172.21.15.5:0/3903024996 conn(0x7f369c0659d0 msgr2=0x7f369c15b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:01.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.902+0000 7f36a38f9640 1 -- 172.21.15.5:0/3903024996 shutdown_connections 2023-07-14T12:53:01.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:01.902+0000 7f36a38f9640 1 -- 172.21.15.5:0/3903024996 wait complete. 2023-07-14T12:53:02.348 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-14T12:52:46.473195+0000', 'modified': '2023-07-14T12:52:50.433872+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4300}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4300': {'gid': 4300, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.154:6836/3154882793', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 3154882793}, {'type': 'v1', 'addr': '172.21.15.154:6836', 'nonce': 3154882793}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-14T12:53:02.348 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-14T12:53:02.349 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-07-14T12:53:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.470+0000 7fceb0448640 1 Processor -- start 2023-07-14T12:53:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.470+0000 7fceb0448640 1 -- start start 2023-07-14T12:53:02.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.470+0000 7fceb0448640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcea8070b70 0x7fcea8070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:02.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.470+0000 7fceb0448640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcea806b1e0 0x7fcea80c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:02.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.470+0000 7fceb0448640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea80cac70 con 0x7fcea80c21f0 2023-07-14T12:53:02.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.470+0000 7fceb0448640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcea8071480 con 0x7fcea806b1e0 2023-07-14T12:53:02.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.470+0000 7fceb0448640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcea80ca060 con 0x7fcea8070b70 2023-07-14T12:53:02.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.470+0000 7fcead9e3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcea806b1e0 0x7fcea80c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:02.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.470+0000 7fcead9e3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcea806b1e0 0x7fcea80c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56680/0 (socket says 172.21.15.5:56680) 2023-07-14T12:53:02.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.470+0000 7fcead9e3640 1 -- 172.21.15.5:0/247970805 learned_addr learned my addr 172.21.15.5:0/247970805 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.470+0000 7fceae1e4640 1 --2- 172.21.15.5:0/247970805 >> v2:172.21.15.154:3300/0 conn(0x7fcea8070b70 0x7fcea8070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.470+0000 7fcead9e3640 1 -- 172.21.15.5:0/247970805 >> v2:172.21.15.154:3300/0 conn(0x7fcea8070b70 msgr2=0x7fcea8070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.470+0000 7fcead9e3640 1 --2- 172.21.15.5:0/247970805 >> v2:172.21.15.154:3300/0 conn(0x7fcea8070b70 0x7fcea8070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.470+0000 7fcead9e3640 1 -- 172.21.15.5:0/247970805 >> v1:172.21.15.154:6789/0 conn(0x7fcea80c21f0 legacy=0x7fcea80cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:02.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.470+0000 7fcead9e3640 1 -- 172.21.15.5:0/247970805 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea80ca340 con 0x7fcea806b1e0 2023-07-14T12:53:02.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.474+0000 7fcead9e3640 1 --2- 172.21.15.5:0/247970805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcea806b1e0 0x7fcea80c1cb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcea806f1f0 tx=0x7fce9801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5656f98876d65a1e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:02.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.474+0000 7fcead1e2640 1 -- 172.21.15.5:0/247970805 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce980aa430 con 0x7fcea806b1e0 2023-07-14T12:53:02.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.474+0000 7fcead1e2640 1 -- 172.21.15.5:0/247970805 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce980aa590 con 0x7fcea806b1e0 2023-07-14T12:53:02.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.474+0000 7fcead1e2640 1 -- 172.21.15.5:0/247970805 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce980aa920 con 0x7fcea806b1e0 2023-07-14T12:53:02.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.474+0000 7fceb0448640 1 -- 172.21.15.5:0/247970805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcea806b1e0 msgr2=0x7fcea80c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:02.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.474+0000 7fceb0448640 1 --2- 172.21.15.5:0/247970805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcea806b1e0 0x7fcea80c1cb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcea806f1f0 tx=0x7fce9801c4d0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.474+0000 7fceb0448640 1 -- 172.21.15.5:0/247970805 shutdown_connections 2023-07-14T12:53:02.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.474+0000 7fceb0448640 1 --2- 172.21.15.5:0/247970805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcea806b1e0 0x7fcea80c1cb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.474+0000 7fceb0448640 1 --2- 172.21.15.5:0/247970805 >> v2:172.21.15.154:3300/0 conn(0x7fcea8070b70 0x7fcea8070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.474+0000 7fceb0448640 1 -- 172.21.15.5:0/247970805 >> 172.21.15.5:0/247970805 conn(0x7fcea80afcf0 msgr2=0x7fcea80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:02.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.474+0000 7fceb0448640 1 -- 172.21.15.5:0/247970805 shutdown_connections 2023-07-14T12:53:02.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.474+0000 7fceb0448640 1 -- 172.21.15.5:0/247970805 wait complete. 2023-07-14T12:53:02.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.478+0000 7fceb0448640 1 Processor -- start 2023-07-14T12:53:02.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.478+0000 7fceb0448640 1 -- start start 2023-07-14T12:53:02.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.478+0000 7fceb0448640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcea806b1e0 0x7fcea8150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:02.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.478+0000 7fceb0448640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcea8070b70 0x7fcea80cd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:02.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.478+0000 7fceb0448640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcea80c21f0 0x7fcea814e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:02.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.478+0000 7fceb0448640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea80cdda0 con 0x7fcea80c21f0 2023-07-14T12:53:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.478+0000 7fceb0448640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea80b3930 con 0x7fcea8070b70 2023-07-14T12:53:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.478+0000 7fceb0448640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea80b3c10 con 0x7fcea806b1e0 2023-07-14T12:53:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.478+0000 7fceae9e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcea80c21f0 0x7fcea814e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.478+0000 7fceae9e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcea80c21f0 0x7fcea814e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56690/0 (socket says 172.21.15.5:56690) 2023-07-14T12:53:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.478+0000 7fceae9e5640 1 -- 172.21.15.5:0/2748736968 learned_addr learned my addr 172.21.15.5:0/2748736968 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.478+0000 7fcead9e3640 1 --2- 172.21.15.5:0/2748736968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcea8070b70 0x7fcea80cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.478+0000 7fceae1e4640 1 --2- 172.21.15.5:0/2748736968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcea806b1e0 0x7fcea8150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:02.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.478+0000 7fceae9e5640 1 -- 172.21.15.5:0/2748736968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcea806b1e0 msgr2=0x7fcea8150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:02.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.478+0000 7fceae9e5640 1 --2- 172.21.15.5:0/2748736968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcea806b1e0 0x7fcea8150e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.478+0000 7fceae9e5640 1 -- 172.21.15.5:0/2748736968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcea8070b70 msgr2=0x7fcea80cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.478+0000 7fceae9e5640 1 --2- 172.21.15.5:0/2748736968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcea8070b70 0x7fcea80cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.478+0000 7fceae9e5640 1 -- 172.21.15.5:0/2748736968 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce980094d0 con 0x7fcea80c21f0 2023-07-14T12:53:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.478+0000 7fceae9e5640 1 --2- 172.21.15.5:0/2748736968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcea80c21f0 0x7fcea814e560 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcea000c730 tx=0x7fcea000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.478+0000 7fce9effd640 1 -- 172.21.15.5:0/2748736968 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea0003b80 con 0x7fcea80c21f0 2023-07-14T12:53:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.478+0000 7fce9effd640 1 -- 172.21.15.5:0/2748736968 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea0003ce0 con 0x7fcea80c21f0 2023-07-14T12:53:02.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.478+0000 7fce9effd640 1 -- 172.21.15.5:0/2748736968 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea0005310 con 0x7fcea80c21f0 2023-07-14T12:53:02.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.478+0000 7fceb0448640 1 -- 172.21.15.5:0/2748736968 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea80aee10 con 0x7fcea80c21f0 2023-07-14T12:53:02.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.478+0000 7fceb0448640 1 -- 172.21.15.5:0/2748736968 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea814eaa0 con 0x7fcea80c21f0 2023-07-14T12:53:02.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.482+0000 7fce9effd640 1 -- 172.21.15.5:0/2748736968 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcea0005680 con 0x7fcea80c21f0 2023-07-14T12:53:02.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.482+0000 7fce9effd640 1 --2- 172.21.15.5:0/2748736968 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fce8c066280 0x7fce8c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:02.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.482+0000 7fce9effd640 1 -- 172.21.15.5:0/2748736968 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcea0083c10 con 0x7fcea80c21f0 2023-07-14T12:53:02.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.482+0000 7fceae1e4640 1 --2- 172.21.15.5:0/2748736968 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fce8c066280 0x7fce8c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:02.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.482+0000 7fceb37af000 1 Processor -- start 2023-07-14T12:53:02.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.482+0000 7fceb37af000 1 -- start start 2023-07-14T12:53:02.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.482+0000 7fceae1e4640 1 --2- 172.21.15.5:0/2748736968 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fce8c066280 0x7fce8c068730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcea4009b60 tx=0x7fcea4009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:02.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceb37af000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884fe2f80 0x55e884fe3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:02.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceb37af000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e884fe3890 0x55e884f993f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:02.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceb37af000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e884f99930 0x55e884f99d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:02.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceb37af000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e884e60900 con 0x55e884fe2f80 2023-07-14T12:53:02.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceb37af000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e884d9a8c0 con 0x55e884f99930 2023-07-14T12:53:02.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceb37af000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e884dee360 con 0x55e884fe3890 2023-07-14T12:53:02.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceae1e4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884fe2f80 0x55e884fe3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:02.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceae1e4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884fe2f80 0x55e884fe3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56702/0 (socket says 172.21.15.5:56702) 2023-07-14T12:53:02.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceae1e4640 1 -- 172.21.15.5:0/186732800 learned_addr learned my addr 172.21.15.5:0/186732800 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:02.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceae9e5640 1 --2- 172.21.15.5:0/186732800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e884f99930 0x55e884f99d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:02.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fcead9e3640 1 --2- 172.21.15.5:0/186732800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e884fe3890 0x55e884f993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:02.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceae1e4640 1 -- 172.21.15.5:0/186732800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e884fe3890 msgr2=0x55e884f993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:02.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceae1e4640 1 --2- 172.21.15.5:0/186732800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e884fe3890 0x55e884f993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceae1e4640 1 -- 172.21.15.5:0/186732800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e884f99930 msgr2=0x55e884f99d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:02.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceae1e4640 1 --2- 172.21.15.5:0/186732800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e884f99930 0x55e884f99d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceae1e4640 1 -- 172.21.15.5:0/186732800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e884ae3890 con 0x55e884fe2f80 2023-07-14T12:53:02.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceae9e5640 1 --2- 172.21.15.5:0/186732800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e884f99930 0x55e884f99d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:02.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceae1e4640 1 --2- 172.21.15.5:0/186732800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884fe2f80 0x55e884fe3350 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcea4011ec0 tx=0x7fcea4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b112f4f9e2d98117 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:02.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fce8bfff640 1 -- 172.21.15.5:0/186732800 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea401c040 con 0x55e884fe2f80 2023-07-14T12:53:02.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fce8bfff640 1 -- 172.21.15.5:0/186732800 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea4003830 con 0x55e884fe2f80 2023-07-14T12:53:02.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fce8bfff640 1 -- 172.21.15.5:0/186732800 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea4003ba0 con 0x55e884fe2f80 2023-07-14T12:53:02.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceb37af000 1 -- 172.21.15.5:0/186732800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884fe2f80 msgr2=0x55e884fe3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:02.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceb37af000 1 --2- 172.21.15.5:0/186732800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884fe2f80 0x55e884fe3350 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcea4011ec0 tx=0x7fcea4014000 comp rx=0 tx=0).stop 2023-07-14T12:53:02.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceb37af000 1 -- 172.21.15.5:0/186732800 shutdown_connections 2023-07-14T12:53:02.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceb37af000 1 --2- 172.21.15.5:0/186732800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e884f99930 0x55e884f99d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceb37af000 1 --2- 172.21.15.5:0/186732800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e884fe3890 0x55e884f993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceb37af000 1 --2- 172.21.15.5:0/186732800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884fe2f80 0x55e884fe3350 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceb37af000 1 -- 172.21.15.5:0/186732800 >> 172.21.15.5:0/186732800 conn(0x55e884f9fa90 msgr2=0x55e884f97cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:02.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceb37af000 1 -- 172.21.15.5:0/186732800 shutdown_connections 2023-07-14T12:53:02.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceb37af000 1 -- 172.21.15.5:0/186732800 wait complete. 2023-07-14T12:53:02.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceb37af000 1 -- start start 2023-07-14T12:53:02.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.486+0000 7fceb37af000 1 Processor -- start 2023-07-14T12:53:02.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fceb37af000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e884f99930 0x55e884fa4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:02.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fceb37af000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884fe2f80 0x55e884fa4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:02.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fceb37af000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e884fe3890 0x55e884fa53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:02.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fceb37af000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e884de7400 con 0x55e884fe2f80 2023-07-14T12:53:02.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fceb37af000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e884da3b60 con 0x55e884f99930 2023-07-14T12:53:02.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fceb37af000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e884da3800 con 0x55e884fe3890 2023-07-14T12:53:02.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fceb37af000 10 client.0 _ll_register_callbacks cb 0x55e884f852c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:53:02.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fcead9e3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884fe2f80 0x55e884fa4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:02.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fcead9e3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884fe2f80 0x55e884fa4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56712/0 (socket says 172.21.15.5:56712) 2023-07-14T12:53:02.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fcead9e3640 1 -- 172.21.15.5:0/1520274120 learned_addr learned my addr 172.21.15.5:0/1520274120 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:02.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fceae1e4640 1 --2- 172.21.15.5:0/1520274120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e884f99930 0x55e884fa4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:02.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fceae9e5640 1 --2- 172.21.15.5:0/1520274120 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e884fe3890 0x55e884fa53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:02.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fcead9e3640 1 -- 172.21.15.5:0/1520274120 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e884fe3890 msgr2=0x55e884fa53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:02.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fcead9e3640 1 --2- 172.21.15.5:0/1520274120 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e884fe3890 0x55e884fa53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fcead9e3640 1 -- 172.21.15.5:0/1520274120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e884f99930 msgr2=0x55e884fa4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:02.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fcead9e3640 1 --2- 172.21.15.5:0/1520274120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e884f99930 0x55e884fa4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fcead9e3640 1 -- 172.21.15.5:0/1520274120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea4011ba0 con 0x55e884fe2f80 2023-07-14T12:53:02.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fceae9e5640 1 --2- 172.21.15.5:0/1520274120 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e884fe3890 0x55e884fa53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:02.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fcead9e3640 1 --2- 172.21.15.5:0/1520274120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884fe2f80 0x55e884fa4ea0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fce98000c10 tx=0x7fce980046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd51ef9e27502eb4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:02.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fce897fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-07-14T12:53:02.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fce897fa640 1 -- 172.21.15.5:0/1520274120 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce980c2070 con 0x55e884fe2f80 2023-07-14T12:53:02.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fce897fa640 1 -- 172.21.15.5:0/1520274120 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fce980b8040 con 0x55e884fe2f80 2023-07-14T12:53:02.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fceb37af000 1 -- 172.21.15.5:0/1520274120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e884daeaa0 con 0x55e884fe2f80 2023-07-14T12:53:02.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fce897fa640 1 -- 172.21.15.5:0/1520274120 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce980aadc0 con 0x55e884fe2f80 2023-07-14T12:53:02.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fceb37af000 10 client.4680 fetch_fsmap learned FSMap version 8 2023-07-14T12:53:02.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fceb37af000 1 -- 172.21.15.5:0/1520274120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55e884dabd90 con 0x55e884fe2f80 2023-07-14T12:53:02.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fce897fa640 1 -- 172.21.15.5:0/1520274120 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e884daeaa0 con 0x55e884fe2f80 2023-07-14T12:53:02.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fce897fa640 1 -- 172.21.15.5:0/1520274120 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fce980c5030 con 0x55e884fe2f80 2023-07-14T12:53:02.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fceb37af000 10 client.4680 fetch_fsmap finished waiting for FSMap version 8 2023-07-14T12:53:02.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fceb37af000 10 client.4680 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-14T12:53:02.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fceb37af000 20 client.4680 populate_metadata read hostname 'smithi005' 2023-07-14T12:53:02.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fceb37af000 1 --2- 172.21.15.5:0/1520274120 >> [v2:172.21.15.154:6834/3154882793,v1:172.21.15.154:6836/3154882793] conn(0x55e884fa5cb0 0x55e884ff44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:02.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fceb37af000 4 client.4680 mds_command: new command op to 4300 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T12:53:02.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fceb37af000 1 -- 172.21.15.5:0/1520274120 --> [v2:172.21.15.154:6834/3154882793,v1:172.21.15.154:6836/3154882793] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e884e15f40 con 0x55e884fa5cb0 2023-07-14T12:53:02.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fceae1e4640 1 --2- 172.21.15.5:0/1520274120 >> [v2:172.21.15.154:6834/3154882793,v1:172.21.15.154:6836/3154882793] conn(0x55e884fa5cb0 0x55e884ff44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:02.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fceae1e4640 1 --2- 172.21.15.5:0/1520274120 >> [v2:172.21.15.154:6834/3154882793,v1:172.21.15.154:6836/3154882793] conn(0x55e884fa5cb0 0x55e884ff44d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ced798561d496f84 server_cookie=fdbd2c7426724d96 in_seq=0 out_seq=0 2023-07-14T12:53:02.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.490+0000 7fce897fa640 10 client.4680 ms_handle_connect on v2:172.21.15.154:6834/3154882793 2023-07-14T12:53:02.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.494+0000 7fce897fa640 1 -- 172.21.15.5:0/1520274120 <== mds.0 v2:172.21.15.154:6834/3154882793 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e884e15f40 con 0x55e884fa5cb0 2023-07-14T12:53:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.494+0000 7fce897fa640 10 client.4680 handle_command_reply: tid=0 2023-07-14T12:53:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.494+0000 7fceb37af000 1 client.4680 shutdown 2023-07-14T12:53:02.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.494+0000 7fceb37af000 1 -- 172.21.15.5:0/1520274120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884fe2f80 msgr2=0x55e884fa4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.494+0000 7fceb37af000 1 --2- 172.21.15.5:0/1520274120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884fe2f80 0x55e884fa4ea0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fce98000c10 tx=0x7fce980046d0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.494+0000 7fceb37af000 1 -- 172.21.15.5:0/1520274120 shutdown_connections 2023-07-14T12:53:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.494+0000 7fceb37af000 1 --2- 172.21.15.5:0/1520274120 >> [v2:172.21.15.154:6834/3154882793,v1:172.21.15.154:6836/3154882793] conn(0x55e884fa5cb0 0x55e884ff44d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.494+0000 7fceb37af000 1 --2- 172.21.15.5:0/1520274120 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e884fe3890 0x55e884fa53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.494+0000 7fceb37af000 1 --2- 172.21.15.5:0/1520274120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884fe2f80 0x55e884fa4ea0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.494+0000 7fce897fa640 0 client.4680 ms_handle_reset on v2:172.21.15.154:6834/3154882793 2023-07-14T12:53:02.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.494+0000 7fceb37af000 1 --2- 172.21.15.5:0/1520274120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e884f99930 0x55e884fa4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.494+0000 7fceb37af000 1 -- 172.21.15.5:0/1520274120 >> 172.21.15.5:0/1520274120 conn(0x55e884f9fa90 msgr2=0x55e884f983d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:02.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.494+0000 7fceb37af000 1 -- 172.21.15.5:0/1520274120 shutdown_connections 2023-07-14T12:53:02.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.494+0000 7fceb37af000 1 -- 172.21.15.5:0/1520274120 wait complete. 2023-07-14T12:53:02.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.494+0000 7fceb37af000 20 client.4680 trim_cache size 0 max 16384 2023-07-14T12:53:02.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fceb37af000 1 Processor -- start 2023-07-14T12:53:02.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fceb37af000 1 -- start start 2023-07-14T12:53:02.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fceb37af000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e884f99930 0x55e884ff54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:02.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fceb37af000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884fe2f80 0x55e884ff5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:02.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fceb37af000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e884fe3890 0x55e884fde240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:02.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fceb37af000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e884f9cf60 con 0x55e884fe2f80 2023-07-14T12:53:02.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fceb37af000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e884aa4940 con 0x55e884f99930 2023-07-14T12:53:02.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fceb37af000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e884deb400 con 0x55e884fe3890 2023-07-14T12:53:02.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fcead9e3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884fe2f80 0x55e884ff5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:02.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fcead9e3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884fe2f80 0x55e884ff5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56716/0 (socket says 172.21.15.5:56716) 2023-07-14T12:53:02.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fcead9e3640 1 -- 172.21.15.5:0/2100525389 learned_addr learned my addr 172.21.15.5:0/2100525389 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:02.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fceae1e4640 1 --2- 172.21.15.5:0/2100525389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e884f99930 0x55e884ff54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:02.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fcead9e3640 1 -- 172.21.15.5:0/2100525389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e884fe3890 msgr2=0x55e884fde240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:02.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fcead9e3640 1 --2- 172.21.15.5:0/2100525389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e884fe3890 0x55e884fde240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fcead9e3640 1 -- 172.21.15.5:0/2100525389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e884f99930 msgr2=0x55e884ff54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:02.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fcead9e3640 1 --2- 172.21.15.5:0/2100525389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e884f99930 0x55e884ff54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fcead9e3640 1 -- 172.21.15.5:0/2100525389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e884f9c000 con 0x55e884fe2f80 2023-07-14T12:53:02.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fceae1e4640 1 --2- 172.21.15.5:0/2100525389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e884f99930 0x55e884ff54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:02.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fcead9e3640 1 --2- 172.21.15.5:0/2100525389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884fe2f80 0x55e884ff5a20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fce9801ca40 tx=0x7fce98009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb56a7c8feeb2874 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:02.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fce9cff9640 1 -- 172.21.15.5:0/2100525389 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce980c2030 con 0x55e884fe2f80 2023-07-14T12:53:02.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fce9cff9640 1 -- 172.21.15.5:0/2100525389 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce980be510 con 0x55e884fe2f80 2023-07-14T12:53:02.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fce9cff9640 1 -- 172.21.15.5:0/2100525389 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce980be8f0 con 0x55e884fe2f80 2023-07-14T12:53:02.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fceb37af000 1 -- 172.21.15.5:0/2100525389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884fe2f80 msgr2=0x55e884ff5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:02.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fceb37af000 1 --2- 172.21.15.5:0/2100525389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884fe2f80 0x55e884ff5a20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fce9801ca40 tx=0x7fce98009240 comp rx=0 tx=0).stop 2023-07-14T12:53:02.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fceb37af000 1 -- 172.21.15.5:0/2100525389 shutdown_connections 2023-07-14T12:53:02.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fceb37af000 1 --2- 172.21.15.5:0/2100525389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e884fe3890 0x55e884fde240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fceb37af000 1 --2- 172.21.15.5:0/2100525389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884fe2f80 0x55e884ff5a20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fceb37af000 1 --2- 172.21.15.5:0/2100525389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e884f99930 0x55e884ff54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fceb37af000 1 -- 172.21.15.5:0/2100525389 >> 172.21.15.5:0/2100525389 conn(0x55e884f9fa90 msgr2=0x55e884f9ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:02.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fceb37af000 1 -- 172.21.15.5:0/2100525389 shutdown_connections 2023-07-14T12:53:02.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fceb37af000 1 -- 172.21.15.5:0/2100525389 wait complete. 2023-07-14T12:53:02.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.510+0000 7fceb37af000 1 -- start start 2023-07-14T12:53:02.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceb37af000 1 Processor -- start 2023-07-14T12:53:02.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceb37af000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884f99930 0x55e885040980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:02.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceb37af000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e884fe2f80 0x55e885040ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:02.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceb37af000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e884fe3890 0x55e884fe0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:02.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceb37af000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e884de9f60 con 0x55e884f99930 2023-07-14T12:53:02.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceb37af000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e884de4800 con 0x55e884fe2f80 2023-07-14T12:53:02.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceb37af000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e884f99450 con 0x55e884fe3890 2023-07-14T12:53:02.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceb37af000 10 client.0 _ll_register_callbacks cb 0x55e884f654b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:53:02.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceae1e4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884f99930 0x55e885040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:02.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceae1e4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884f99930 0x55e885040980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56722/0 (socket says 172.21.15.5:56722) 2023-07-14T12:53:02.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceae1e4640 1 -- 172.21.15.5:0/1671041389 learned_addr learned my addr 172.21.15.5:0/1671041389 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:02.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceae9e5640 1 --2- 172.21.15.5:0/1671041389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e884fe3890 0x55e884fe0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:02.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fcead9e3640 1 --2- 172.21.15.5:0/1671041389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e884fe2f80 0x55e885040ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceae1e4640 1 -- 172.21.15.5:0/1671041389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e884fe3890 msgr2=0x55e884fe0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceae1e4640 1 --2- 172.21.15.5:0/1671041389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e884fe3890 0x55e884fe0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceae1e4640 1 -- 172.21.15.5:0/1671041389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e884fe2f80 msgr2=0x55e885040ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceae1e4640 1 --2- 172.21.15.5:0/1671041389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e884fe2f80 0x55e885040ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceae1e4640 1 -- 172.21.15.5:0/1671041389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e884dabd90 con 0x55e884f99930 2023-07-14T12:53:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceae9e5640 1 --2- 172.21.15.5:0/1671041389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e884fe3890 0x55e884fe0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fcead9e3640 1 --2- 172.21.15.5:0/1671041389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e884fe2f80 0x55e885040ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceae1e4640 1 --2- 172.21.15.5:0/1671041389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884f99930 0x55e885040980 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcea4011750 tx=0x7fcea4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ced71be7dff4a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fce897fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-07-14T12:53:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fce897fa640 1 -- 172.21.15.5:0/1671041389 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea4032050 con 0x55e884f99930 2023-07-14T12:53:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceb37af000 1 -- 172.21.15.5:0/1671041389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e884de5d50 con 0x55e884f99930 2023-07-14T12:53:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fce897fa640 1 -- 172.21.15.5:0/1671041389 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcea40352c0 con 0x55e884f99930 2023-07-14T12:53:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fce897fa640 1 -- 172.21.15.5:0/1671041389 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcea4035480 con 0x55e884f99930 2023-07-14T12:53:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceb37af000 10 client.4686 fetch_fsmap learned FSMap version 8 2023-07-14T12:53:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceb37af000 1 -- 172.21.15.5:0/1671041389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55e884d92020 con 0x55e884f99930 2023-07-14T12:53:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fce897fa640 1 -- 172.21.15.5:0/1671041389 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e884de5d50 con 0x55e884f99930 2023-07-14T12:53:02.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fce897fa640 1 -- 172.21.15.5:0/1671041389 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fcea40357f0 con 0x55e884f99930 2023-07-14T12:53:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceb37af000 10 client.4686 fetch_fsmap finished waiting for FSMap version 8 2023-07-14T12:53:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceb37af000 10 client.4686 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-14T12:53:02.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceb37af000 20 client.4686 populate_metadata read hostname 'smithi005' 2023-07-14T12:53:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceb37af000 1 --2- 172.21.15.5:0/1671041389 >> [v2:172.21.15.154:6834/3154882793,v1:172.21.15.154:6836/3154882793] conn(0x55e884fe17d0 0x55e884fe1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceb37af000 4 client.4686 mds_command: new command op to 4300 tid=0[{"prefix": "status"}] 2023-07-14T12:53:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fceb37af000 1 -- 172.21.15.5:0/1671041389 --> [v2:172.21.15.154:6834/3154882793,v1:172.21.15.154:6836/3154882793] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e884de03e0 con 0x55e884fe17d0 2023-07-14T12:53:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.514+0000 7fcead9e3640 1 --2- 172.21.15.5:0/1671041389 >> [v2:172.21.15.154:6834/3154882793,v1:172.21.15.154:6836/3154882793] conn(0x55e884fe17d0 0x55e884fe1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fcead9e3640 1 --2- 172.21.15.5:0/1671041389 >> [v2:172.21.15.154:6834/3154882793,v1:172.21.15.154:6836/3154882793] conn(0x55e884fe17d0 0x55e884fe1ba0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e64ac976d6b99e1c server_cookie=fa2ca7d92ad0a420 in_seq=0 out_seq=0 2023-07-14T12:53:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fce897fa640 10 client.4686 ms_handle_connect on v2:172.21.15.154:6834/3154882793 2023-07-14T12:53:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fce897fa640 1 -- 172.21.15.5:0/1671041389 <== mds.0 v2:172.21.15.154:6834/3154882793 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55e884de03e0 con 0x55e884fe17d0 2023-07-14T12:53:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fce897fa640 10 client.4686 handle_command_reply: tid=0 2023-07-14T12:53:02.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fceb37af000 1 client.4686 shutdown 2023-07-14T12:53:02.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fceb37af000 1 -- 172.21.15.5:0/1671041389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884f99930 msgr2=0x55e885040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:02.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fceb37af000 1 --2- 172.21.15.5:0/1671041389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884f99930 0x55e885040980 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcea4011750 tx=0x7fcea4019000 comp rx=0 tx=0).stop 2023-07-14T12:53:02.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fceb37af000 1 -- 172.21.15.5:0/1671041389 shutdown_connections 2023-07-14T12:53:02.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fceb37af000 1 --2- 172.21.15.5:0/1671041389 >> [v2:172.21.15.154:6834/3154882793,v1:172.21.15.154:6836/3154882793] conn(0x55e884fe17d0 0x55e884fe1ba0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fceb37af000 1 --2- 172.21.15.5:0/1671041389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e884fe3890 0x55e884fe0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fceb37af000 1 --2- 172.21.15.5:0/1671041389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e884fe2f80 0x55e885040ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fce897fa640 0 client.4686 ms_handle_reset on v2:172.21.15.154:6834/3154882793 2023-07-14T12:53:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fceb37af000 1 --2- 172.21.15.5:0/1671041389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e884f99930 0x55e885040980 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fceb37af000 1 -- 172.21.15.5:0/1671041389 >> 172.21.15.5:0/1671041389 conn(0x55e884f9fa90 msgr2=0x55e884ff44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:02.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fceb37af000 1 -- 172.21.15.5:0/1671041389 shutdown_connections 2023-07-14T12:53:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fceb37af000 1 -- 172.21.15.5:0/1671041389 wait complete. 2023-07-14T12:53:02.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fceb37af000 20 client.4686 trim_cache size 0 max 16384 2023-07-14T12:53:02.557 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T12:53:02.557 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "22affb8d-e389-40f8-a764-dd40eb1759c8", 2023-07-14T12:53:02.557 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-07-14T12:53:02.558 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4300, 2023-07-14T12:53:02.558 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-07-14T12:53:02.558 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-07-14T12:53:02.558 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-07-14T12:53:02.558 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 15.098726847, 2023-07-14T12:53:02.558 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 8, 2023-07-14T12:53:02.558 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 23, 2023-07-14T12:53:02.558 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 23, 2023-07-14T12:53:02.559 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 21.326226263999999 2023-07-14T12:53:02.559 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T12:53:02.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fceb0448640 1 -- 172.21.15.5:0/2748736968 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fce8c066280 msgr2=0x7fce8c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fceb0448640 1 --2- 172.21.15.5:0/2748736968 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fce8c066280 0x7fce8c068730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcea4009b60 tx=0x7fcea4009190 comp rx=0 tx=0).stop 2023-07-14T12:53:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fceb0448640 1 -- 172.21.15.5:0/2748736968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcea80c21f0 msgr2=0x7fcea814e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fceb0448640 1 --2- 172.21.15.5:0/2748736968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcea80c21f0 0x7fcea814e560 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcea000c730 tx=0x7fcea000cbf0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fceb0448640 1 -- 172.21.15.5:0/2748736968 shutdown_connections 2023-07-14T12:53:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fceb0448640 1 --2- 172.21.15.5:0/2748736968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcea80c21f0 0x7fcea814e560 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fceb0448640 1 --2- 172.21.15.5:0/2748736968 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fce8c066280 0x7fce8c068730 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fceb0448640 1 --2- 172.21.15.5:0/2748736968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcea8070b70 0x7fcea80cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fceb0448640 1 --2- 172.21.15.5:0/2748736968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcea806b1e0 0x7fcea8150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:02.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fceb0448640 1 -- 172.21.15.5:0/2748736968 >> 172.21.15.5:0/2748736968 conn(0x7fcea80afcf0 msgr2=0x7fcea80ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:02.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fceb0448640 1 -- 172.21.15.5:0/2748736968 shutdown_connections 2023-07-14T12:53:02.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:02.518+0000 7fceb0448640 1 -- 172.21.15.5:0/2748736968 wait complete. 2023-07-14T12:53:02.563 INFO:teuthology.run_tasks:Running task kclient... 2023-07-14T12:53:02.586 INFO:tasks.kclient:Mounting kernel clients... 2023-07-14T12:53:02.586 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-07-14T12:53:02.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:02.587 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-07-14T12:53:02.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:02.598 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2023-07-14T12:53:02.666 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2023-07-14T12:53:02.668 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T12:53:02.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:02.669 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-07-14T12:53:02.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:02.723 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2023-07-14T12:53:02.790 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2023-07-14T12:53:02.791 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T12:53:02.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:02.792 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-07-14T12:53:02.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:02.804 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link delete ceph-brx 2023-07-14T12:53:02.873 INFO:teuthology.orchestra.run.smithi154.stderr:Cannot find device "ceph-brx" 2023-07-14T12:53:02.875 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T12:53:02.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:02.876 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-07-14T12:53:02.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:02.926 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link delete ceph-brx 2023-07-14T12:53:02.992 INFO:teuthology.orchestra.run.smithi154.stderr:Cannot find device "ceph-brx" 2023-07-14T12:53:02.994 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T12:53:02.994 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-07-14T12:53:02.995 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-14T12:53:02.995 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-14T12:53:02.995 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T12:53:03.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.114+0000 7f12455fa640 1 Processor -- start 2023-07-14T12:53:03.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.114+0000 7f12455fa640 1 -- start start 2023-07-14T12:53:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.118+0000 7f12455fa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12400b3c50 0x7f12400b4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.118+0000 7f12455fa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f124015bcb0 0x7f12400b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.118+0000 7f12455fa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12400b4aa0 con 0x7f12400b10c0 2023-07-14T12:53:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.118+0000 7f12455fa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12400ce750 con 0x7f124015bcb0 2023-07-14T12:53:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.118+0000 7f12455fa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12400cea30 con 0x7f12400b3c50 2023-07-14T12:53:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.118+0000 7f123e7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f124015bcb0 0x7f12400b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:03.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.118+0000 7f123e7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f124015bcb0 0x7f12400b4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56738/0 (socket says 172.21.15.5:56738) 2023-07-14T12:53:03.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.118+0000 7f123e7fc640 1 -- 172.21.15.5:0/1552592365 learned_addr learned my addr 172.21.15.5:0/1552592365 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:03.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.118+0000 7f123effd640 1 --2- 172.21.15.5:0/1552592365 >> v2:172.21.15.154:3300/0 conn(0x7f12400b3c50 0x7f12400b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:03.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.118+0000 7f123e7fc640 1 -- 172.21.15.5:0/1552592365 >> v2:172.21.15.154:3300/0 conn(0x7f12400b3c50 msgr2=0x7f12400b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:03.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.118+0000 7f123e7fc640 1 --2- 172.21.15.5:0/1552592365 >> v2:172.21.15.154:3300/0 conn(0x7f12400b3c50 0x7f12400b4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:03.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.118+0000 7f123e7fc640 1 -- 172.21.15.5:0/1552592365 >> v1:172.21.15.154:6789/0 conn(0x7f12400b10c0 legacy=0x7f124015f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:03.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.118+0000 7f123e7fc640 1 -- 172.21.15.5:0/1552592365 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12400ced10 con 0x7f124015bcb0 2023-07-14T12:53:03.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.122+0000 7f123e7fc640 1 --2- 172.21.15.5:0/1552592365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f124015bcb0 0x7f12400b4560 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f12400699c0 tx=0x7f123401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b28b856b01c38d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:03.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.122+0000 7f123dffb640 1 -- 172.21.15.5:0/1552592365 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12340ab600 con 0x7f124015bcb0 2023-07-14T12:53:03.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.122+0000 7f123dffb640 1 -- 172.21.15.5:0/1552592365 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12340a7050 con 0x7f124015bcb0 2023-07-14T12:53:03.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.122+0000 7f123dffb640 1 -- 172.21.15.5:0/1552592365 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12340ab980 con 0x7f124015bcb0 2023-07-14T12:53:03.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.122+0000 7f12455fa640 1 -- 172.21.15.5:0/1552592365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f124015bcb0 msgr2=0x7f12400b4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:03.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.122+0000 7f12455fa640 1 --2- 172.21.15.5:0/1552592365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f124015bcb0 0x7f12400b4560 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f12400699c0 tx=0x7f123401c470 comp rx=0 tx=0).stop 2023-07-14T12:53:03.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.122+0000 7f12455fa640 1 -- 172.21.15.5:0/1552592365 shutdown_connections 2023-07-14T12:53:03.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.122+0000 7f12455fa640 1 --2- 172.21.15.5:0/1552592365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f124015bcb0 0x7f12400b4560 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:03.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.122+0000 7f12455fa640 1 --2- 172.21.15.5:0/1552592365 >> v2:172.21.15.154:3300/0 conn(0x7f12400b3c50 0x7f12400b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:03.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.122+0000 7f12455fa640 1 -- 172.21.15.5:0/1552592365 >> 172.21.15.5:0/1552592365 conn(0x7f1240069e80 msgr2=0x7f124006a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:03.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.122+0000 7f12455fa640 1 -- 172.21.15.5:0/1552592365 shutdown_connections 2023-07-14T12:53:03.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.122+0000 7f12455fa640 1 -- 172.21.15.5:0/1552592365 wait complete. 2023-07-14T12:53:03.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.122+0000 7f12455fa640 1 Processor -- start 2023-07-14T12:53:03.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.126+0000 7f12455fa640 1 -- start start 2023-07-14T12:53:03.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.126+0000 7f12455fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12400b10c0 0x7f124014eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:03.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.126+0000 7f12455fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12400b3c50 0x7f124014f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:03.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.126+0000 7f12455fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f124015bcb0 0x7f124015a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:03.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.126+0000 7f12455fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1240148d80 con 0x7f12400b3c50 2023-07-14T12:53:03.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.126+0000 7f12455fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12400c9f50 con 0x7f124015bcb0 2023-07-14T12:53:03.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.126+0000 7f12455fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12400c9340 con 0x7f12400b10c0 2023-07-14T12:53:03.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.126+0000 7f123e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12400b3c50 0x7f124014f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:03.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.126+0000 7f123e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12400b3c50 0x7f124014f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56750/0 (socket says 172.21.15.5:56750) 2023-07-14T12:53:03.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.126+0000 7f123e7fc640 1 -- 172.21.15.5:0/3087583944 learned_addr learned my addr 172.21.15.5:0/3087583944 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:03.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.126+0000 7f123effd640 1 --2- 172.21.15.5:0/3087583944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12400b10c0 0x7f124014eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:03.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.126+0000 7f123f7fe640 1 --2- 172.21.15.5:0/3087583944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f124015bcb0 0x7f124015a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:03.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.126+0000 7f123e7fc640 1 -- 172.21.15.5:0/3087583944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12400b10c0 msgr2=0x7f124014eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:03.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.126+0000 7f123e7fc640 1 --2- 172.21.15.5:0/3087583944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12400b10c0 0x7f124014eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:03.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.126+0000 7f123e7fc640 1 -- 172.21.15.5:0/3087583944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f124015bcb0 msgr2=0x7f124015a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:03.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.126+0000 7f123e7fc640 1 --2- 172.21.15.5:0/3087583944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f124015bcb0 0x7f124015a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:03.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.126+0000 7f123e7fc640 1 -- 172.21.15.5:0/3087583944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12340094d0 con 0x7f12400b3c50 2023-07-14T12:53:03.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.126+0000 7f123effd640 1 --2- 172.21.15.5:0/3087583944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12400b10c0 0x7f124014eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:03.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.126+0000 7f123e7fc640 1 --2- 172.21.15.5:0/3087583944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12400b3c50 0x7f124014f430 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1234019080 tx=0x7f1234019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:03.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.126+0000 7f12277fe640 1 -- 172.21.15.5:0/3087583944 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12340b37d0 con 0x7f12400b3c50 2023-07-14T12:53:03.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.126+0000 7f12277fe640 1 -- 172.21.15.5:0/3087583944 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12340b3930 con 0x7f12400b3c50 2023-07-14T12:53:03.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.126+0000 7f12455fa640 1 -- 172.21.15.5:0/3087583944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12400c9620 con 0x7f12400b3c50 2023-07-14T12:53:03.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.126+0000 7f12277fe640 1 -- 172.21.15.5:0/3087583944 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12340b3ca0 con 0x7f12400b3c50 2023-07-14T12:53:03.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.126+0000 7f12455fa640 1 -- 172.21.15.5:0/3087583944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12400c9be0 con 0x7f12400b3c50 2023-07-14T12:53:03.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.126+0000 7f12455fa640 1 -- 172.21.15.5:0/3087583944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12400ca0c0 con 0x7f12400b3c50 2023-07-14T12:53:03.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.130+0000 7f12277fe640 1 -- 172.21.15.5:0/3087583944 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f12340b2070 con 0x7f12400b3c50 2023-07-14T12:53:03.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.130+0000 7f12277fe640 1 --2- 172.21.15.5:0/3087583944 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f122c066280 0x7f122c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:03.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.130+0000 7f12277fe640 1 -- 172.21.15.5:0/3087583944 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f123411e0e0 con 0x7f12400b3c50 2023-07-14T12:53:03.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.130+0000 7f123effd640 1 --2- 172.21.15.5:0/3087583944 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f122c066280 0x7f122c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:03.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.130+0000 7f123effd640 1 --2- 172.21.15.5:0/3087583944 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f122c066280 0x7f122c068730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f123000b9f0 tx=0x7f1230008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:03.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.134+0000 7f12277fe640 1 -- 172.21.15.5:0/3087583944 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f12340eb550 con 0x7f12400b3c50 2023-07-14T12:53:03.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.322+0000 7f12455fa640 1 -- 172.21.15.5:0/3087583944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f12400678d0 con 0x7f12400b3c50 2023-07-14T12:53:03.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.322+0000 7f12277fe640 1 -- 172.21.15.5:0/3087583944 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f12340eeb70 con 0x7f12400b3c50 2023-07-14T12:53:03.348 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T12:53:03.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.322+0000 7f12455fa640 1 -- 172.21.15.5:0/3087583944 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f122c066280 msgr2=0x7f122c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:03.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.322+0000 7f12455fa640 1 --2- 172.21.15.5:0/3087583944 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f122c066280 0x7f122c068730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f123000b9f0 tx=0x7f1230008040 comp rx=0 tx=0).stop 2023-07-14T12:53:03.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.322+0000 7f12455fa640 1 -- 172.21.15.5:0/3087583944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12400b3c50 msgr2=0x7f124014f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:03.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.322+0000 7f12455fa640 1 --2- 172.21.15.5:0/3087583944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12400b3c50 0x7f124014f430 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1234019080 tx=0x7f1234019210 comp rx=0 tx=0).stop 2023-07-14T12:53:03.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.322+0000 7f12455fa640 1 -- 172.21.15.5:0/3087583944 shutdown_connections 2023-07-14T12:53:03.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.322+0000 7f12455fa640 1 --2- 172.21.15.5:0/3087583944 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f122c066280 0x7f122c068730 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:03.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.322+0000 7f12455fa640 1 --2- 172.21.15.5:0/3087583944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f124015bcb0 0x7f124015a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:03.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.322+0000 7f12455fa640 1 --2- 172.21.15.5:0/3087583944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12400b3c50 0x7f124014f430 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:03.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.322+0000 7f12455fa640 1 --2- 172.21.15.5:0/3087583944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12400b10c0 0x7f124014eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:03.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.322+0000 7f12455fa640 1 -- 172.21.15.5:0/3087583944 >> 172.21.15.5:0/3087583944 conn(0x7f1240069e80 msgr2=0x7f12400b2450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:03.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.322+0000 7f12455fa640 1 -- 172.21.15.5:0/3087583944 shutdown_connections 2023-07-14T12:53:03.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:03.322+0000 7f12455fa640 1 -- 172.21.15.5:0/3087583944 wait complete. 2023-07-14T12:53:03.369 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-14T12:53:03.370 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T12:53:03.370 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-07-14T12:53:03.370 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-14T12:53:03.370 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-14T12:53:03.370 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-14T12:53:03.371 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-14T12:53:03.371 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T12:53:03.371 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T12:53:03.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:03.372 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-07-14T12:53:03.381 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T12:53:03.381 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T12:53:03.381 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T12:53:03.381 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:03.381 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-07-14T12:53:03.382 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:03.382 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T12:53:03.382 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:03.382 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2023-07-14T12:53:03.382 INFO:teuthology.orchestra.run.smithi005.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T12:53:03.382 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:03.382 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2023-07-14T12:53:03.383 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-14T12:53:03.383 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42333sec preferred_lft 42333sec 2023-07-14T12:53:03.383 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-07-14T12:53:03.383 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:03.383 INFO:teuthology.orchestra.run.smithi005.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T12:53:03.383 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:03.383 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2023-07-14T12:53:03.384 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T12:53:03.384 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:03.384 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2023-07-14T12:53:03.384 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-14T12:53:03.385 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:96:b6:fb:c6 brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:03.385 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-14T12:53:03.385 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:03.387 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-14T12:53:03.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:03.388 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-07-14T12:53:03.388 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-07-14T12:53:03.389 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add name ceph-brx type bridge 2023-07-14T12:53:03.389 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr flush dev ceph-brx 2023-07-14T12:53:03.390 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set ceph-brx up 2023-07-14T12:53:03.390 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-14T12:53:03.390 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-07-14T12:53:03.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:03.508 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T12:53:03.528 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-07-14T12:53:03.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:03.530 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-07-14T12:53:03.602 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-07-14T12:53:03.603 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T12:53:03.603 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-14T12:53:03.603 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-14T12:53:03.603 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-14T12:53:03.603 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T12:53:03.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:03.604 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-07-14T12:53:03.604 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-07-14T12:53:03.605 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-14T12:53:03.605 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-14T12:53:03.605 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-14T12:53:03.605 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-07-14T12:53:03.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:03.704 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-07-14T12:53:03.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:03.714 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2023-07-14T12:53:03.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:03.764 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-07-14T12:53:03.764 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-07-14T12:53:03.764 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T12:53:03.765 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-14T12:53:03.765 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-07-14T12:53:03.850 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-14T12:53:03.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:03.851 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-07-14T12:53:03.851 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-07-14T12:53:03.851 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-14T12:53:03.852 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-14T12:53:03.852 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-14T12:53:03.852 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-14T12:53:03.852 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-14T12:53:03.853 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-07-14T12:53:04.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:04.024 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-07-14T12:53:04.024 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-07-14T12:53:04.024 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-07-14T12:53:04.024 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.0 master ceph-brx 2023-07-14T12:53:04.025 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-07-14T12:53:04.067 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T12:53:04.068 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-14T12:53:04.123 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-14T12:53:04.123 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T12:53:04.123 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-14T12:53:04.174 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-14T12:53:04.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:04.175 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T12:53:04.277 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T12:53:04.277 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T12:53:04.278 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T12:53:04.385 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T12:53:04.385 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T12:53:04.386 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T12:53:04.386 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T12:53:04.386 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T12:53:04.397 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T12:53:04.398 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T12:53:04.398 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T12:53:04.398 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T12:53:04.398 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T12:53:04.398 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790" 2023-07-14T12:53:04.398 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790:/ 2023-07-14T12:53:04.399 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=22affb8d-e389-40f8-a764-dd40eb1759c8" will pass to kernel 2023-07-14T12:53:04.401 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T12:53:04.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:04.402 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-14T12:53:04.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:04.424 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T12:53:04.501 INFO:teuthology.orchestra.run.smithi005.stdout:client4493 2023-07-14T12:53:04.501 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:53:04.502 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T12:53:04.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:04.551 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T12:53:04.615 INFO:teuthology.orchestra.run.smithi005.stdout:client4493 2023-07-14T12:53:04.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:04.616 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T12:53:04.680 INFO:teuthology.orchestra.run.smithi005.stdout:client4493 2023-07-14T12:53:04.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:04.681 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/22affb8d-e389-40f8-a764-dd40eb1759c8.client4493/status') 2023-07-14T12:53:04.749 INFO:teuthology.orchestra.run.smithi005.stdout:instance: client.4493 (3)172.21.15.5:0/1081353985 2023-07-14T12:53:04.749 INFO:teuthology.orchestra.run.smithi005.stdout:blocklisted: false 2023-07-14T12:53:04.750 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records in 2023-07-14T12:53:04.750 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records out 2023-07-14T12:53:04.750 INFO:teuthology.orchestra.run.smithi005.stderr:69 bytes copied, 6.8159e-05 s, 1.0 MB/s 2023-07-14T12:53:04.751 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-07-14T12:53:04.751 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-14T12:53:04.752 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-14T12:53:04.752 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T12:53:04.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.910+0000 7f278ce34640 1 Processor -- start 2023-07-14T12:53:04.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.910+0000 7f278ce34640 1 -- start start 2023-07-14T12:53:04.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.910+0000 7f278ce34640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f278815f500 0x7f278806cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:04.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.910+0000 7f278ce34640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f278806ac50 0x7f27880ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:04.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.910+0000 7f278ce34640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27880cdc80 con 0x7f278806d430 2023-07-14T12:53:04.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.910+0000 7f278ce34640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f278806e4c0 con 0x7f278806ac50 2023-07-14T12:53:04.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.910+0000 7f278ce34640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f278806d940 con 0x7f278815f500 2023-07-14T12:53:04.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.914+0000 7f278659c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f278815f500 0x7f278806cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:04.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.914+0000 7f278659c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f278815f500 0x7f278806cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:43118/0 (socket says 172.21.15.5:43118) 2023-07-14T12:53:04.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.914+0000 7f278659c640 1 -- 172.21.15.5:0/3163967625 learned_addr learned my addr 172.21.15.5:0/3163967625 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:04.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.914+0000 7f2786d9d640 1 --2- 172.21.15.5:0/3163967625 >> v2:172.21.15.154:3300/0 conn(0x7f278806ac50 0x7f27880ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:04.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.914+0000 7f278659c640 1 -- 172.21.15.5:0/3163967625 >> v2:172.21.15.154:3300/0 conn(0x7f278806ac50 msgr2=0x7f27880ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:04.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.914+0000 7f278659c640 1 --2- 172.21.15.5:0/3163967625 >> v2:172.21.15.154:3300/0 conn(0x7f278806ac50 0x7f27880ce0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:04.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.914+0000 7f278659c640 1 -- 172.21.15.5:0/3163967625 >> v1:172.21.15.154:6789/0 conn(0x7f278806d430 legacy=0x7f278806a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:04.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.914+0000 7f278659c640 1 -- 172.21.15.5:0/3163967625 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278806dc20 con 0x7f278815f500 2023-07-14T12:53:04.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.914+0000 7f278559a640 1 -- 172.21.15.5:0/3163967625 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2123146330 0 0) 0x7f27880cdc80 con 0x7f278806d430 2023-07-14T12:53:04.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.914+0000 7f278659c640 1 --2- 172.21.15.5:0/3163967625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f278815f500 0x7f278806cef0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2778006fd0 tx=0x7f277801c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a780cb435357d7c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:04.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.918+0000 7f278559a640 1 -- 172.21.15.5:0/3163967625 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27780ab610 con 0x7f278815f500 2023-07-14T12:53:04.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.918+0000 7f278559a640 1 -- 172.21.15.5:0/3163967625 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27780ab770 con 0x7f278815f500 2023-07-14T12:53:04.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.918+0000 7f278559a640 1 -- 172.21.15.5:0/3163967625 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27780abb00 con 0x7f278815f500 2023-07-14T12:53:04.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.918+0000 7f278ce34640 1 -- 172.21.15.5:0/3163967625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f278815f500 msgr2=0x7f278806cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:04.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.918+0000 7f278ce34640 1 --2- 172.21.15.5:0/3163967625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f278815f500 0x7f278806cef0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2778006fd0 tx=0x7f277801c520 comp rx=0 tx=0).stop 2023-07-14T12:53:04.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.918+0000 7f278ce34640 1 -- 172.21.15.5:0/3163967625 shutdown_connections 2023-07-14T12:53:04.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.918+0000 7f278ce34640 1 --2- 172.21.15.5:0/3163967625 >> v2:172.21.15.154:3300/0 conn(0x7f278806ac50 0x7f27880ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:04.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.918+0000 7f278ce34640 1 --2- 172.21.15.5:0/3163967625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f278815f500 0x7f278806cef0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:04.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.918+0000 7f278ce34640 1 -- 172.21.15.5:0/3163967625 >> 172.21.15.5:0/3163967625 conn(0x7f27880659d0 msgr2=0x7f2788099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:04.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.918+0000 7f278ce34640 1 -- 172.21.15.5:0/3163967625 shutdown_connections 2023-07-14T12:53:04.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.918+0000 7f278ce34640 1 -- 172.21.15.5:0/3163967625 wait complete. 2023-07-14T12:53:04.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.918+0000 7f278ce34640 1 Processor -- start 2023-07-14T12:53:04.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.918+0000 7f278ce34640 1 -- start start 2023-07-14T12:53:04.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.918+0000 7f278ce34640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f278806ac50 0x7f278814bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:04.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.918+0000 7f278ce34640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f278806d430 0x7f27880ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:04.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.918+0000 7f278ce34640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f278815f500 0x7f27880b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:04.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.918+0000 7f278ce34640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2788156c20 con 0x7f278815f500 2023-07-14T12:53:04.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.918+0000 7f278ce34640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27880c4990 con 0x7f278806ac50 2023-07-14T12:53:04.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.918+0000 7f278ce34640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27880c4c30 con 0x7f278806d430 2023-07-14T12:53:04.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.922+0000 7f2786d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f278815f500 0x7f27880b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:04.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.922+0000 7f2786d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f278815f500 0x7f27880b4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56752/0 (socket says 172.21.15.5:56752) 2023-07-14T12:53:04.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.922+0000 7f2786d9d640 1 -- 172.21.15.5:0/1461057212 learned_addr learned my addr 172.21.15.5:0/1461057212 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:04.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.922+0000 7f2785d9b640 1 --2- 172.21.15.5:0/1461057212 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f278806d430 0x7f27880ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:04.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.922+0000 7f278659c640 1 --2- 172.21.15.5:0/1461057212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f278806ac50 0x7f278814bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:04.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.922+0000 7f2786d9d640 1 -- 172.21.15.5:0/1461057212 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f278806d430 msgr2=0x7f27880ad4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:04.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.922+0000 7f2786d9d640 1 --2- 172.21.15.5:0/1461057212 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f278806d430 0x7f27880ad4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:04.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.922+0000 7f2786d9d640 1 -- 172.21.15.5:0/1461057212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f278806ac50 msgr2=0x7f278814bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:04.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.922+0000 7f2786d9d640 1 --2- 172.21.15.5:0/1461057212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f278806ac50 0x7f278814bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:04.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.922+0000 7f2786d9d640 1 -- 172.21.15.5:0/1461057212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2778009480 con 0x7f278815f500 2023-07-14T12:53:04.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.922+0000 7f2786d9d640 1 --2- 172.21.15.5:0/1461057212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f278815f500 0x7f27880b4640 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f278000ef90 tx=0x7f278000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:04.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.922+0000 7f2776ffd640 1 -- 172.21.15.5:0/1461057212 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2780009ca0 con 0x7f278815f500 2023-07-14T12:53:04.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.922+0000 7f2776ffd640 1 -- 172.21.15.5:0/1461057212 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278000f040 con 0x7f278815f500 2023-07-14T12:53:04.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.922+0000 7f278ce34640 1 -- 172.21.15.5:0/1461057212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27880c4f10 con 0x7f278815f500 2023-07-14T12:53:04.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.922+0000 7f2776ffd640 1 -- 172.21.15.5:0/1461057212 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27800146c0 con 0x7f278815f500 2023-07-14T12:53:04.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.922+0000 7f278ce34640 1 -- 172.21.15.5:0/1461057212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27880c54d0 con 0x7f278815f500 2023-07-14T12:53:04.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.922+0000 7f278ce34640 1 -- 172.21.15.5:0/1461057212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27880c56f0 con 0x7f278815f500 2023-07-14T12:53:04.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.922+0000 7f2776ffd640 1 -- 172.21.15.5:0/1461057212 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2780014820 con 0x7f278815f500 2023-07-14T12:53:04.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.926+0000 7f2776ffd640 1 --2- 172.21.15.5:0/1461057212 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f27680662b0 0x7f2768068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:04.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.926+0000 7f2776ffd640 1 -- 172.21.15.5:0/1461057212 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2780084b70 con 0x7f278815f500 2023-07-14T12:53:04.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.926+0000 7f278659c640 1 --2- 172.21.15.5:0/1461057212 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f27680662b0 0x7f2768068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:04.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.926+0000 7f278659c640 1 --2- 172.21.15.5:0/1461057212 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f27680662b0 0x7f2768068760 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f27780af000 tx=0x7f27780a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:04.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:04.926+0000 7f2776ffd640 1 -- 172.21.15.5:0/1461057212 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2780052000 con 0x7f278815f500 2023-07-14T12:53:05.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:05.118+0000 7f278ce34640 1 -- 172.21.15.5:0/1461057212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f27880678d0 con 0x7f278815f500 2023-07-14T12:53:05.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:05.118+0000 7f2776ffd640 1 -- 172.21.15.5:0/1461057212 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2780018070 con 0x7f278815f500 2023-07-14T12:53:05.145 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T12:53:05.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:05.118+0000 7f278ce34640 1 -- 172.21.15.5:0/1461057212 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f27680662b0 msgr2=0x7f2768068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:05.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:05.118+0000 7f278ce34640 1 --2- 172.21.15.5:0/1461057212 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f27680662b0 0x7f2768068760 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f27780af000 tx=0x7f27780a7000 comp rx=0 tx=0).stop 2023-07-14T12:53:05.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:05.118+0000 7f278ce34640 1 -- 172.21.15.5:0/1461057212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f278815f500 msgr2=0x7f27880b4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:05.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:05.118+0000 7f278ce34640 1 --2- 172.21.15.5:0/1461057212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f278815f500 0x7f27880b4640 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f278000ef90 tx=0x7f278000c490 comp rx=0 tx=0).stop 2023-07-14T12:53:05.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:05.118+0000 7f278ce34640 1 -- 172.21.15.5:0/1461057212 shutdown_connections 2023-07-14T12:53:05.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:05.118+0000 7f278ce34640 1 --2- 172.21.15.5:0/1461057212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f278815f500 0x7f27880b4640 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:05.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:05.118+0000 7f278ce34640 1 --2- 172.21.15.5:0/1461057212 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f278806d430 0x7f27880ad4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:05.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:05.118+0000 7f278ce34640 1 --2- 172.21.15.5:0/1461057212 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f27680662b0 0x7f2768068760 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:05.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:05.118+0000 7f278ce34640 1 --2- 172.21.15.5:0/1461057212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f278806ac50 0x7f278814bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:05.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:05.118+0000 7f278ce34640 1 -- 172.21.15.5:0/1461057212 >> 172.21.15.5:0/1461057212 conn(0x7f27880659d0 msgr2=0x7f278815fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:05.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:05.118+0000 7f278ce34640 1 -- 172.21.15.5:0/1461057212 shutdown_connections 2023-07-14T12:53:05.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:05.118+0000 7f278ce34640 1 -- 172.21.15.5:0/1461057212 wait complete. 2023-07-14T12:53:05.165 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-14T12:53:05.166 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T12:53:05.166 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-07-14T12:53:05.166 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-07-14T12:53:05.166 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-14T12:53:05.166 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-14T12:53:05.167 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-14T12:53:05.167 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T12:53:05.167 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-07-14T12:53:05.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:05.168 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-07-14T12:53:05.179 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T12:53:05.179 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T12:53:05.179 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T12:53:05.180 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:05.180 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-07-14T12:53:05.180 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:05.180 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T12:53:05.181 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:05.181 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2023-07-14T12:53:05.181 INFO:teuthology.orchestra.run.smithi005.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T12:53:05.181 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:05.181 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2023-07-14T12:53:05.181 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-14T12:53:05.182 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42331sec preferred_lft 42331sec 2023-07-14T12:53:05.182 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-07-14T12:53:05.182 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:05.182 INFO:teuthology.orchestra.run.smithi005.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T12:53:05.182 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:05.182 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2023-07-14T12:53:05.182 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T12:53:05.183 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:05.183 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2023-07-14T12:53:05.183 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-14T12:53:05.183 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:96:b6:fb:c6 brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:05.183 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-14T12:53:05.184 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:05.184 INFO:teuthology.orchestra.run.smithi005.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T12:53:05.184 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:05.184 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T12:53:05.184 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:05.184 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-07-14T12:53:05.185 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:05.185 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T12:53:05.185 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T12:53:05.185 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-07-14T12:53:05.185 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:05.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:05.186 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T12:53:05.242 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-07-14T12:53:05.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:05.245 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-07-14T12:53:05.299 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-07-14T12:53:05.300 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T12:53:05.300 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-14T12:53:05.300 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-14T12:53:05.300 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-14T12:53:05.300 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T12:53:05.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:05.301 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-07-14T12:53:05.301 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-07-14T12:53:05.301 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-14T12:53:05.302 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-14T12:53:05.302 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-14T12:53:05.302 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-07-14T12:53:05.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:05.397 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-07-14T12:53:05.406 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-14T12:53:05.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:05.408 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2023-07-14T12:53:05.463 INFO:teuthology.orchestra.run.smithi005.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-07-14T12:53:05.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:05.464 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-07-14T12:53:05.465 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-07-14T12:53:05.465 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-14T12:53:05.465 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-07-14T12:53:05.466 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-07-14T12:53:05.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:05.552 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-14T12:53:05.621 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T12:53:05.621 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T12:53:05.621 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T12:53:05.621 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:05.622 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-07-14T12:53:05.622 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:05.622 INFO:teuthology.orchestra.run.smithi005.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T12:53:05.622 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether e6:0f:2a:a6:34:43 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-14T12:53:05.622 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-14T12:53:05.623 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:05.623 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::e40f:2aff:fea6:3443/64 scope link 2023-07-14T12:53:05.623 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:05.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:05.625 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-14T12:53:05.688 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T12:53:05.688 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T12:53:05.688 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T12:53:05.689 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:05.689 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-07-14T12:53:05.689 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:05.689 INFO:teuthology.orchestra.run.smithi005.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T12:53:05.689 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether e6:0f:2a:a6:34:43 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-14T12:53:05.689 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-14T12:53:05.689 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:05.689 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::e40f:2aff:fea6:3443/64 scope link 2023-07-14T12:53:05.690 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:05.691 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-07-14T12:53:05.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:05.691 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-07-14T12:53:05.692 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-07-14T12:53:05.692 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-07-14T12:53:05.692 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-14T12:53:05.692 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-07-14T12:53:05.693 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-07-14T12:53:05.693 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-07-14T12:53:05.693 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-07-14T12:53:05.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:05.839 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-07-14T12:53:05.839 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-07-14T12:53:05.839 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.1 up 2023-07-14T12:53:05.839 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.1 master ceph-brx 2023-07-14T12:53:05.840 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-07-14T12:53:05.882 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T12:53:05.882 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-07-14T12:53:05.935 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-07-14T12:53:05.935 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T12:53:05.935 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-07-14T12:53:05.986 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-14T12:53:05.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:05.986 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-14T12:53:06.078 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-14T12:53:06.078 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-07-14T12:53:06.078 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T12:53:06.093 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-14T12:53:06.094 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-07-14T12:53:06.094 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T12:53:06.094 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T12:53:06.094 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T12:53:06.105 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-14T12:53:06.105 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-07-14T12:53:06.105 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T12:53:06.105 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T12:53:06.106 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T12:53:06.106 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790" 2023-07-14T12:53:06.106 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790:/ 2023-07-14T12:53:06.106 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=22affb8d-e389-40f8-a764-dd40eb1759c8" will pass to kernel 2023-07-14T12:53:06.109 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T12:53:06.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:06.109 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-07-14T12:53:06.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:06.130 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T12:53:06.182 INFO:teuthology.orchestra.run.smithi005.stdout:client4502 2023-07-14T12:53:06.182 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:53:06.182 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T12:53:06.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:06.230 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T12:53:06.285 INFO:teuthology.orchestra.run.smithi005.stdout:client4502 2023-07-14T12:53:06.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:06.286 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T12:53:06.337 INFO:teuthology.orchestra.run.smithi005.stdout:client4502 2023-07-14T12:53:06.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:06.338 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/22affb8d-e389-40f8-a764-dd40eb1759c8.client4502/status') 2023-07-14T12:53:06.399 INFO:teuthology.orchestra.run.smithi005.stdout:instance: client.4502 (3)172.21.15.5:0/2469781835 2023-07-14T12:53:06.399 INFO:teuthology.orchestra.run.smithi005.stdout:blocklisted: false 2023-07-14T12:53:06.400 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records in 2023-07-14T12:53:06.400 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records out 2023-07-14T12:53:06.400 INFO:teuthology.orchestra.run.smithi005.stderr:69 bytes copied, 5.3263e-05 s, 1.3 MB/s 2023-07-14T12:53:06.401 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-07-14T12:53:06.401 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-14T12:53:06.402 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-14T12:53:06.402 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T12:53:06.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.558+0000 7f057067b640 1 Processor -- start 2023-07-14T12:53:06.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.558+0000 7f057067b640 1 -- start start 2023-07-14T12:53:06.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.562+0000 7f057067b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05680c9730 0x7f05681638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:06.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.562+0000 7f057067b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05680cc700 con 0x7f05680c8ad0 2023-07-14T12:53:06.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.562+0000 7f057067b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05680b0ff0 con 0x7f0568158ce0 2023-07-14T12:53:06.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.562+0000 7f057067b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0568070c80 con 0x7f05680c9730 2023-07-14T12:53:06.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.562+0000 7f056dc16640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f05680c8ad0 0x7f05680c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36084/0 (socket says 172.21.15.5:36084) 2023-07-14T12:53:06.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.562+0000 7f056dc16640 1 -- 172.21.15.5:0/9899966 learned_addr learned my addr 172.21.15.5:0/9899966 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:06.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.562+0000 7f056ec18640 1 --2- 172.21.15.5:0/9899966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05680c9730 0x7f05681638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:06.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.562+0000 7f056d415640 1 -- 172.21.15.5:0/9899966 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697535702 0 0) 0x7f05680cc700 con 0x7f05680c8ad0 2023-07-14T12:53:06.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.562+0000 7f056d415640 1 -- 172.21.15.5:0/9899966 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0554005740 con 0x7f05680c8ad0 2023-07-14T12:53:06.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.562+0000 7f056d415640 1 -- 172.21.15.5:0/9899966 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980305718 0 0) 0x7f05680b0ff0 con 0x7f0568158ce0 2023-07-14T12:53:06.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.562+0000 7f056d415640 1 -- 172.21.15.5:0/9899966 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05680cc700 con 0x7f0568158ce0 2023-07-14T12:53:06.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.562+0000 7f056ec18640 1 -- 172.21.15.5:0/9899966 >> v1:172.21.15.154:6789/0 conn(0x7f0568158ce0 legacy=0x7f0568070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:06.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.562+0000 7f056ec18640 1 -- 172.21.15.5:0/9899966 >> v1:172.21.15.5:6789/0 conn(0x7f05680c8ad0 legacy=0x7f05680c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:06.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.562+0000 7f056ec18640 1 -- 172.21.15.5:0/9899966 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05680cbdd0 con 0x7f05680c9730 2023-07-14T12:53:06.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.566+0000 7f056ec18640 1 --2- 172.21.15.5:0/9899966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05680c9730 0x7f05681638b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0560009dc0 tx=0x7f056001c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85fc031eb073d74b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:06.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.566+0000 7f056d415640 1 -- 172.21.15.5:0/9899966 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05600a6700 con 0x7f05680c9730 2023-07-14T12:53:06.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.566+0000 7f056d415640 1 -- 172.21.15.5:0/9899966 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05600a6860 con 0x7f05680c9730 2023-07-14T12:53:06.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.566+0000 7f056d415640 1 -- 172.21.15.5:0/9899966 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05600a6bf0 con 0x7f05680c9730 2023-07-14T12:53:06.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.566+0000 7f057067b640 1 -- 172.21.15.5:0/9899966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05680c9730 msgr2=0x7f05681638b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:06.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.566+0000 7f057067b640 1 --2- 172.21.15.5:0/9899966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05680c9730 0x7f05681638b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0560009dc0 tx=0x7f056001c820 comp rx=0 tx=0).stop 2023-07-14T12:53:06.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.566+0000 7f057067b640 1 -- 172.21.15.5:0/9899966 shutdown_connections 2023-07-14T12:53:06.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.566+0000 7f057067b640 1 --2- 172.21.15.5:0/9899966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05680c9730 0x7f05681638b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:06.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.566+0000 7f057067b640 1 -- 172.21.15.5:0/9899966 >> 172.21.15.5:0/9899966 conn(0x7f05680afcf0 msgr2=0x7f05680b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:06.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.566+0000 7f057067b640 1 -- 172.21.15.5:0/9899966 shutdown_connections 2023-07-14T12:53:06.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.566+0000 7f057067b640 1 -- 172.21.15.5:0/9899966 wait complete. 2023-07-14T12:53:06.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.566+0000 7f057067b640 1 Processor -- start 2023-07-14T12:53:06.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.566+0000 7f057067b640 1 -- start start 2023-07-14T12:53:06.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.566+0000 7f057067b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05680c8ad0 0x7f05681445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:06.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.566+0000 7f057067b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05680c9730 0x7f0568152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:06.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.566+0000 7f057067b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0568158ce0 0x7f05681534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:06.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.566+0000 7f057067b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05680afb00 con 0x7f0568158ce0 2023-07-14T12:53:06.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.566+0000 7f057067b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05680b1340 con 0x7f05680c9730 2023-07-14T12:53:06.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.566+0000 7f057067b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05680b15e0 con 0x7f05680c8ad0 2023-07-14T12:53:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.570+0000 7f056ec18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0568158ce0 0x7f05681534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.570+0000 7f056e417640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05680c8ad0 0x7f05681445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.570+0000 7f056ec18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0568158ce0 0x7f05681534c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56756/0 (socket says 172.21.15.5:56756) 2023-07-14T12:53:06.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.570+0000 7f056ec18640 1 -- 172.21.15.5:0/2526043544 learned_addr learned my addr 172.21.15.5:0/2526043544 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:06.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.570+0000 7f056dc16640 1 --2- 172.21.15.5:0/2526043544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05680c9730 0x7f0568152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:06.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.570+0000 7f056e417640 1 -- 172.21.15.5:0/2526043544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05680c9730 msgr2=0x7f0568152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:06.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.570+0000 7f056e417640 1 --2- 172.21.15.5:0/2526043544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05680c9730 0x7f0568152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:06.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.570+0000 7f056e417640 1 -- 172.21.15.5:0/2526043544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0568158ce0 msgr2=0x7f05681534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:06.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.570+0000 7f056e417640 1 --2- 172.21.15.5:0/2526043544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0568158ce0 0x7f05681534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:06.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.570+0000 7f056e417640 1 -- 172.21.15.5:0/2526043544 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0560009a70 con 0x7f05680c8ad0 2023-07-14T12:53:06.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.570+0000 7f056ec18640 1 --2- 172.21.15.5:0/2526043544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0568158ce0 0x7f05681534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:53:06.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.570+0000 7f056e417640 1 --2- 172.21.15.5:0/2526043544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05680c8ad0 0x7f05681445c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f056400c3c0 tx=0x7f056400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:06.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.570+0000 7f055effd640 1 -- 172.21.15.5:0/2526043544 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05640052d0 con 0x7f05680c8ad0 2023-07-14T12:53:06.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.570+0000 7f055effd640 1 -- 172.21.15.5:0/2526043544 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0564005430 con 0x7f05680c8ad0 2023-07-14T12:53:06.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.570+0000 7f055effd640 1 -- 172.21.15.5:0/2526043544 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0564003840 con 0x7f05680c8ad0 2023-07-14T12:53:06.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.570+0000 7f057067b640 1 -- 172.21.15.5:0/2526043544 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05680b18c0 con 0x7f05680c8ad0 2023-07-14T12:53:06.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.570+0000 7f057067b640 1 -- 172.21.15.5:0/2526043544 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05680b20c0 con 0x7f05680c8ad0 2023-07-14T12:53:06.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.570+0000 7f057067b640 1 -- 172.21.15.5:0/2526043544 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05680ca1a0 con 0x7f05680c8ad0 2023-07-14T12:53:06.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.570+0000 7f055effd640 1 -- 172.21.15.5:0/2526043544 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f05640039a0 con 0x7f05680c8ad0 2023-07-14T12:53:06.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.574+0000 7f055effd640 1 --2- 172.21.15.5:0/2526043544 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f054c066280 0x7f054c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:06.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.574+0000 7f055effd640 1 -- 172.21.15.5:0/2526043544 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0564083320 con 0x7f05680c8ad0 2023-07-14T12:53:06.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.574+0000 7f056dc16640 1 --2- 172.21.15.5:0/2526043544 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f054c066280 0x7f054c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:06.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.574+0000 7f056dc16640 1 --2- 172.21.15.5:0/2526043544 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f054c066280 0x7f054c068730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0568070790 tx=0x7f0558009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:06.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.578+0000 7f055effd640 1 -- 172.21.15.5:0/2526043544 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f05640508c0 con 0x7f05680c8ad0 2023-07-14T12:53:06.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.770+0000 7f057067b640 1 -- 172.21.15.5:0/2526043544 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f05680678d0 con 0x7f05680c8ad0 2023-07-14T12:53:06.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.770+0000 7f055effd640 1 -- 172.21.15.5:0/2526043544 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0564053ee0 con 0x7f05680c8ad0 2023-07-14T12:53:06.796 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T12:53:06.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.770+0000 7f057067b640 1 -- 172.21.15.5:0/2526043544 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f054c066280 msgr2=0x7f054c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:06.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.770+0000 7f057067b640 1 --2- 172.21.15.5:0/2526043544 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f054c066280 0x7f054c068730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0568070790 tx=0x7f0558009040 comp rx=0 tx=0).stop 2023-07-14T12:53:06.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.770+0000 7f057067b640 1 -- 172.21.15.5:0/2526043544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05680c8ad0 msgr2=0x7f05681445c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:06.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.770+0000 7f057067b640 1 --2- 172.21.15.5:0/2526043544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05680c8ad0 0x7f05681445c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f056400c3c0 tx=0x7f056400c880 comp rx=0 tx=0).stop 2023-07-14T12:53:06.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.770+0000 7f057067b640 1 -- 172.21.15.5:0/2526043544 shutdown_connections 2023-07-14T12:53:06.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.770+0000 7f057067b640 1 --2- 172.21.15.5:0/2526043544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0568158ce0 0x7f05681534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:06.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.770+0000 7f057067b640 1 --2- 172.21.15.5:0/2526043544 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f054c066280 0x7f054c068730 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:06.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.770+0000 7f057067b640 1 --2- 172.21.15.5:0/2526043544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05680c9730 0x7f0568152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:06.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.770+0000 7f057067b640 1 --2- 172.21.15.5:0/2526043544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05680c8ad0 0x7f05681445c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:06.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.770+0000 7f057067b640 1 -- 172.21.15.5:0/2526043544 >> 172.21.15.5:0/2526043544 conn(0x7f05680afcf0 msgr2=0x7f05680ac130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:06.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.770+0000 7f057067b640 1 -- 172.21.15.5:0/2526043544 shutdown_connections 2023-07-14T12:53:06.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:06.770+0000 7f057067b640 1 -- 172.21.15.5:0/2526043544 wait complete. 2023-07-14T12:53:06.816 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-14T12:53:06.817 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T12:53:06.817 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2023-07-14T12:53:06.817 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-14T12:53:06.817 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-14T12:53:06.817 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-14T12:53:06.818 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-14T12:53:06.818 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T12:53:06.818 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-14T12:53:06.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:06.819 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2023-07-14T12:53:06.829 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T12:53:06.829 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T12:53:06.829 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T12:53:06.829 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:06.829 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-07-14T12:53:06.830 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:06.830 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T12:53:06.830 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:06.830 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2023-07-14T12:53:06.830 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T12:53:06.830 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:06.830 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2023-07-14T12:53:06.830 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T12:53:06.831 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:06.831 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T12:53:06.831 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:06.831 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-14T12:53:06.831 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42333sec preferred_lft 42333sec 2023-07-14T12:53:06.831 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::ec4:7aff:fe88:7761/64 scope link 2023-07-14T12:53:06.831 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:06.832 INFO:teuthology.orchestra.run.smithi154.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-14T12:53:06.832 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 02:42:31:b3:6b:04 brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:06.832 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-14T12:53:06.832 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:06.833 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-14T12:53:06.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:06.833 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-07-14T12:53:06.834 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-07-14T12:53:06.834 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link add name ceph-brx type bridge 2023-07-14T12:53:06.834 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip addr flush dev ceph-brx 2023-07-14T12:53:06.834 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set ceph-brx up 2023-07-14T12:53:06.834 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-14T12:53:06.835 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-07-14T12:53:06.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:06.961 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T12:53:06.981 INFO:teuthology.orchestra.run.smithi154.stdout:1 2023-07-14T12:53:06.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:06.983 DEBUG:teuthology.orchestra.run.smithi154:> route 2023-07-14T12:53:07.062 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2023-07-14T12:53:07.063 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T12:53:07.063 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-14T12:53:07.063 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-14T12:53:07.063 INFO:teuthology.orchestra.run.smithi154.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-14T12:53:07.064 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-14T12:53:07.064 INFO:teuthology.orchestra.run.smithi154.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-14T12:53:07.064 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-14T12:53:07.064 INFO:teuthology.orchestra.run.smithi154.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-14T12:53:07.064 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T12:53:07.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:07.065 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-07-14T12:53:07.065 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-07-14T12:53:07.065 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-14T12:53:07.066 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-14T12:53:07.066 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-14T12:53:07.066 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-07-14T12:53:07.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:07.158 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-07-14T12:53:07.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:07.168 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list-id 2023-07-14T12:53:07.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:07.222 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-07-14T12:53:07.223 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-07-14T12:53:07.223 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-14T12:53:07.223 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-07-14T12:53:07.223 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-07-14T12:53:07.310 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-07-14T12:53:07.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:07.311 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-07-14T12:53:07.311 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-07-14T12:53:07.312 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-07-14T12:53:07.312 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-14T12:53:07.312 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-07-14T12:53:07.313 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-07-14T12:53:07.313 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-07-14T12:53:07.313 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-07-14T12:53:07.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:07.473 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-07-14T12:53:07.473 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-07-14T12:53:07.473 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2023-07-14T12:53:07.474 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set dev brx.0 master ceph-brx 2023-07-14T12:53:07.474 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-07-14T12:53:07.517 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T12:53:07.518 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-14T12:53:07.569 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-14T12:53:07.569 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T12:53:07.570 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-14T12:53:07.620 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-14T12:53:07.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:07.621 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-14T12:53:07.723 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-14T12:53:07.723 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-14T12:53:07.723 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-07-14T12:53:07.824 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-14T12:53:07.824 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-14T12:53:07.824 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-07-14T12:53:07.824 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T12:53:07.824 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T12:53:07.835 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-14T12:53:07.835 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-14T12:53:07.835 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-07-14T12:53:07.836 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T12:53:07.836 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T12:53:07.836 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790" 2023-07-14T12:53:07.836 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790:/ 2023-07-14T12:53:07.836 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=22affb8d-e389-40f8-a764-dd40eb1759c8" will pass to kernel 2023-07-14T12:53:07.838 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T12:53:07.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:07.839 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-14T12:53:07.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:07.860 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T12:53:07.916 INFO:teuthology.orchestra.run.smithi154.stdout:client4704 2023-07-14T12:53:07.917 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:53:07.917 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T12:53:07.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:07.966 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T12:53:08.023 INFO:teuthology.orchestra.run.smithi154.stdout:client4704 2023-07-14T12:53:08.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:08.025 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T12:53:08.080 INFO:teuthology.orchestra.run.smithi154.stdout:client4704 2023-07-14T12:53:08.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:08.081 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/22affb8d-e389-40f8-a764-dd40eb1759c8.client4704/status') 2023-07-14T12:53:08.146 INFO:teuthology.orchestra.run.smithi154.stdout:instance: client.4704 (3)172.21.15.154:0/3462633231 2023-07-14T12:53:08.146 INFO:teuthology.orchestra.run.smithi154.stdout:blocklisted: false 2023-07-14T12:53:08.146 INFO:teuthology.orchestra.run.smithi154.stderr:0+1 records in 2023-07-14T12:53:08.147 INFO:teuthology.orchestra.run.smithi154.stderr:0+1 records out 2023-07-14T12:53:08.147 INFO:teuthology.orchestra.run.smithi154.stderr:71 bytes copied, 5.1968e-05 s, 1.4 MB/s 2023-07-14T12:53:08.148 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-07-14T12:53:08.148 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-14T12:53:08.148 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-14T12:53:08.149 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T12:53:08.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.278+0000 7f7f8a39d640 1 Processor -- start 2023-07-14T12:53:08.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.278+0000 7f7f8a39d640 1 -- start start 2023-07-14T12:53:08.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.278+0000 7f7f8a39d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7f840b7c70 0x7f7f840d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:08.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.278+0000 7f7f8a39d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f840ccaf0 con 0x7f7f840d1850 2023-07-14T12:53:08.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.278+0000 7f7f8a39d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f84160320 con 0x7f7f8415fd60 2023-07-14T12:53:08.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.278+0000 7f7f8a39d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f840d1190 con 0x7f7f840b7c70 2023-07-14T12:53:08.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.278+0000 7f7f837fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7f840d1850 0x7f7f8415f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36088/0 (socket says 172.21.15.5:36088) 2023-07-14T12:53:08.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.278+0000 7f7f837fe640 1 -- 172.21.15.5:0/743232786 learned_addr learned my addr 172.21.15.5:0/743232786 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:08.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.278+0000 7f7f83fff640 1 --2- 172.21.15.5:0/743232786 >> v2:172.21.15.154:3300/0 conn(0x7f7f840b7c70 0x7f7f840d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:08.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.278+0000 7f7f82ffd640 1 -- 172.21.15.5:0/743232786 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 398562401 0 0) 0x7f7f840ccaf0 con 0x7f7f840d1850 2023-07-14T12:53:08.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.278+0000 7f7f82ffd640 1 -- 172.21.15.5:0/743232786 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f6c003530 con 0x7f7f840d1850 2023-07-14T12:53:08.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.278+0000 7f7f83fff640 1 -- 172.21.15.5:0/743232786 >> v1:172.21.15.154:6789/0 conn(0x7f7f8415fd60 legacy=0x7f7f840d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:08.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.278+0000 7f7f83fff640 1 -- 172.21.15.5:0/743232786 >> v1:172.21.15.5:6789/0 conn(0x7f7f840d1850 legacy=0x7f7f8415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:08.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.278+0000 7f7f83fff640 1 -- 172.21.15.5:0/743232786 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f840ccd90 con 0x7f7f840b7c70 2023-07-14T12:53:08.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.282+0000 7f7f83fff640 1 --2- 172.21.15.5:0/743232786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f840b7c70 0x7f7f840d0c50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7f740097c0 tx=0x7f7f7401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7695ddf0f819c7f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:08.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.282+0000 7f7f82ffd640 1 -- 172.21.15.5:0/743232786 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f740a8050 con 0x7f7f840b7c70 2023-07-14T12:53:08.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.282+0000 7f7f82ffd640 1 -- 172.21.15.5:0/743232786 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f740ac5f0 con 0x7f7f840b7c70 2023-07-14T12:53:08.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.282+0000 7f7f82ffd640 1 -- 172.21.15.5:0/743232786 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f740ac980 con 0x7f7f840b7c70 2023-07-14T12:53:08.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.282+0000 7f7f8a39d640 1 -- 172.21.15.5:0/743232786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f840b7c70 msgr2=0x7f7f840d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:08.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.282+0000 7f7f8a39d640 1 --2- 172.21.15.5:0/743232786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f840b7c70 0x7f7f840d0c50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7f740097c0 tx=0x7f7f7401c480 comp rx=0 tx=0).stop 2023-07-14T12:53:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.282+0000 7f7f8a39d640 1 -- 172.21.15.5:0/743232786 shutdown_connections 2023-07-14T12:53:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.282+0000 7f7f8a39d640 1 --2- 172.21.15.5:0/743232786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f840b7c70 0x7f7f840d0c50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.282+0000 7f7f8a39d640 1 -- 172.21.15.5:0/743232786 >> 172.21.15.5:0/743232786 conn(0x7f7f840650b0 msgr2=0x7f7f840654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.282+0000 7f7f8a39d640 1 -- 172.21.15.5:0/743232786 shutdown_connections 2023-07-14T12:53:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.282+0000 7f7f8a39d640 1 -- 172.21.15.5:0/743232786 wait complete. 2023-07-14T12:53:08.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.286+0000 7f7f8a39d640 1 Processor -- start 2023-07-14T12:53:08.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.286+0000 7f7f8a39d640 1 -- start start 2023-07-14T12:53:08.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.286+0000 7f7f8a39d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f840b7c70 0x7f7f840b6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:08.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.286+0000 7f7f8a39d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f840d1850 0x7f7f8414d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:08.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.286+0000 7f7f8a39d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f8415fd60 0x7f7f840ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:08.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.286+0000 7f7f8a39d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f840b6a80 con 0x7f7f8415fd60 2023-07-14T12:53:08.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.286+0000 7f7f8a39d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f840b7450 con 0x7f7f840d1850 2023-07-14T12:53:08.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.286+0000 7f7f8a39d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f840b5e70 con 0x7f7f840b7c70 2023-07-14T12:53:08.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.286+0000 7f7f8893a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f8415fd60 0x7f7f840ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:08.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.286+0000 7f7f8893a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f8415fd60 0x7f7f840ca4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56758/0 (socket says 172.21.15.5:56758) 2023-07-14T12:53:08.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.286+0000 7f7f8893a640 1 -- 172.21.15.5:0/472943638 learned_addr learned my addr 172.21.15.5:0/472943638 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:08.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.286+0000 7f7f837fe640 1 --2- 172.21.15.5:0/472943638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f840d1850 0x7f7f8414d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:08.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.286+0000 7f7f83fff640 1 --2- 172.21.15.5:0/472943638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f840b7c70 0x7f7f840b6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:08.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.286+0000 7f7f8893a640 1 -- 172.21.15.5:0/472943638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f840b7c70 msgr2=0x7f7f840b6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:08.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.286+0000 7f7f8893a640 1 --2- 172.21.15.5:0/472943638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f840b7c70 0x7f7f840b6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:08.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.286+0000 7f7f8893a640 1 -- 172.21.15.5:0/472943638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f840d1850 msgr2=0x7f7f8414d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:08.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.286+0000 7f7f8893a640 1 --2- 172.21.15.5:0/472943638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f840d1850 0x7f7f8414d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:08.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.286+0000 7f7f8893a640 1 -- 172.21.15.5:0/472943638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f74009420 con 0x7f7f8415fd60 2023-07-14T12:53:08.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.286+0000 7f7f8893a640 1 --2- 172.21.15.5:0/472943638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f8415fd60 0x7f7f840ca4b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c00c770 tx=0x7f7f7c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:08.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.286+0000 7f7f80ff9640 1 -- 172.21.15.5:0/472943638 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c003b80 con 0x7f7f8415fd60 2023-07-14T12:53:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.286+0000 7f7f80ff9640 1 -- 172.21.15.5:0/472943638 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7c003ce0 con 0x7f7f8415fd60 2023-07-14T12:53:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.286+0000 7f7f80ff9640 1 -- 172.21.15.5:0/472943638 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c00aa90 con 0x7f7f8415fd60 2023-07-14T12:53:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.290+0000 7f7f8a39d640 1 -- 172.21.15.5:0/472943638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f840b6150 con 0x7f7f8415fd60 2023-07-14T12:53:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.290+0000 7f7f8a39d640 1 -- 172.21.15.5:0/472943638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f840b6710 con 0x7f7f8415fd60 2023-07-14T12:53:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.290+0000 7f7f8a39d640 1 -- 172.21.15.5:0/472943638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f840b6c30 con 0x7f7f8415fd60 2023-07-14T12:53:08.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.290+0000 7f7f80ff9640 1 -- 172.21.15.5:0/472943638 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7f7c00abf0 con 0x7f7f8415fd60 2023-07-14T12:53:08.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.290+0000 7f7f80ff9640 1 --2- 172.21.15.5:0/472943638 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7f700662b0 0x7f7f70068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:08.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.290+0000 7f7f80ff9640 1 -- 172.21.15.5:0/472943638 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7f7c083a50 con 0x7f7f8415fd60 2023-07-14T12:53:08.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.290+0000 7f7f83fff640 1 --2- 172.21.15.5:0/472943638 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7f700662b0 0x7f7f70068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:08.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.294+0000 7f7f83fff640 1 --2- 172.21.15.5:0/472943638 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7f700662b0 0x7f7f70068760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7f740ae000 tx=0x7f7f740a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:08.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.294+0000 7f7f80ff9640 1 -- 172.21.15.5:0/472943638 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7f840b6c30 con 0x7f7f8415fd60 2023-07-14T12:53:08.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.482+0000 7f7f8a39d640 1 -- 172.21.15.5:0/472943638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7f840678d0 con 0x7f7f8415fd60 2023-07-14T12:53:08.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.486+0000 7f7f80ff9640 1 -- 172.21.15.5:0/472943638 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7f7c050ef0 con 0x7f7f8415fd60 2023-07-14T12:53:08.511 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T12:53:08.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.486+0000 7f7f8a39d640 1 -- 172.21.15.5:0/472943638 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7f700662b0 msgr2=0x7f7f70068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:08.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.486+0000 7f7f8a39d640 1 --2- 172.21.15.5:0/472943638 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7f700662b0 0x7f7f70068760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7f740ae000 tx=0x7f7f740a7000 comp rx=0 tx=0).stop 2023-07-14T12:53:08.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.486+0000 7f7f8a39d640 1 -- 172.21.15.5:0/472943638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f8415fd60 msgr2=0x7f7f840ca4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:08.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.486+0000 7f7f8a39d640 1 --2- 172.21.15.5:0/472943638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f8415fd60 0x7f7f840ca4b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c00c770 tx=0x7f7f7c00cc30 comp rx=0 tx=0).stop 2023-07-14T12:53:08.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.486+0000 7f7f8a39d640 1 -- 172.21.15.5:0/472943638 shutdown_connections 2023-07-14T12:53:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.486+0000 7f7f8a39d640 1 --2- 172.21.15.5:0/472943638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f8415fd60 0x7f7f840ca4b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.486+0000 7f7f8a39d640 1 --2- 172.21.15.5:0/472943638 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7f700662b0 0x7f7f70068760 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.486+0000 7f7f8a39d640 1 --2- 172.21.15.5:0/472943638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f840d1850 0x7f7f8414d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.486+0000 7f7f8a39d640 1 --2- 172.21.15.5:0/472943638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f840b7c70 0x7f7f840b6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.486+0000 7f7f8a39d640 1 -- 172.21.15.5:0/472943638 >> 172.21.15.5:0/472943638 conn(0x7f7f840650b0 msgr2=0x7f7f840d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.486+0000 7f7f8a39d640 1 -- 172.21.15.5:0/472943638 shutdown_connections 2023-07-14T12:53:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:08.486+0000 7f7f8a39d640 1 -- 172.21.15.5:0/472943638 wait complete. 2023-07-14T12:53:08.532 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-14T12:53:08.532 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T12:53:08.532 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2023-07-14T12:53:08.532 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-07-14T12:53:08.533 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-14T12:53:08.533 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-14T12:53:08.533 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-14T12:53:08.533 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T12:53:08.533 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-07-14T12:53:08.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:08.534 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2023-07-14T12:53:08.543 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T12:53:08.544 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T12:53:08.544 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T12:53:08.544 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:08.544 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-07-14T12:53:08.544 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:08.545 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T12:53:08.545 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:08.545 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2023-07-14T12:53:08.545 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T12:53:08.545 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:08.545 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2023-07-14T12:53:08.545 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T12:53:08.545 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:08.546 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T12:53:08.546 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:08.546 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-14T12:53:08.546 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42331sec preferred_lft 42331sec 2023-07-14T12:53:08.546 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::ec4:7aff:fe88:7761/64 scope link 2023-07-14T12:53:08.546 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:08.546 INFO:teuthology.orchestra.run.smithi154.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-14T12:53:08.547 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 02:42:31:b3:6b:04 brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:08.547 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-14T12:53:08.547 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:08.547 INFO:teuthology.orchestra.run.smithi154.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T12:53:08.547 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:08.547 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T12:53:08.547 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:08.547 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-07-14T12:53:08.548 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:08.548 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T12:53:08.548 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-14T12:53:08.548 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-07-14T12:53:08.548 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:08.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:08.549 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T12:53:08.616 INFO:teuthology.orchestra.run.smithi154.stdout:1 2023-07-14T12:53:08.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:08.618 DEBUG:teuthology.orchestra.run.smithi154:> route 2023-07-14T12:53:08.672 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2023-07-14T12:53:08.672 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T12:53:08.672 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-14T12:53:08.672 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-14T12:53:08.672 INFO:teuthology.orchestra.run.smithi154.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-14T12:53:08.673 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-14T12:53:08.673 INFO:teuthology.orchestra.run.smithi154.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-14T12:53:08.673 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-14T12:53:08.673 INFO:teuthology.orchestra.run.smithi154.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-14T12:53:08.673 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T12:53:08.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:08.674 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-07-14T12:53:08.674 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-07-14T12:53:08.674 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-14T12:53:08.675 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-14T12:53:08.675 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-14T12:53:08.675 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-07-14T12:53:08.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:08.766 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-07-14T12:53:08.776 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-14T12:53:08.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:08.777 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list-id 2023-07-14T12:53:08.825 INFO:teuthology.orchestra.run.smithi154.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-07-14T12:53:08.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:08.826 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-07-14T12:53:08.827 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-07-14T12:53:08.827 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-14T12:53:08.827 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-07-14T12:53:08.827 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-07-14T12:53:08.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:08.909 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-14T12:53:08.973 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T12:53:08.974 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T12:53:08.974 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T12:53:08.974 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:08.974 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-07-14T12:53:08.974 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:08.974 INFO:teuthology.orchestra.run.smithi154.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T12:53:08.975 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:e2:13:15:5e:a7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-14T12:53:08.975 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-14T12:53:08.975 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:08.975 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::8e2:13ff:fe15:5ea7/64 scope link tentative 2023-07-14T12:53:08.975 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:08.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:08.976 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-14T12:53:09.038 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T12:53:09.038 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T12:53:09.038 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T12:53:09.038 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:09.039 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-07-14T12:53:09.039 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:09.039 INFO:teuthology.orchestra.run.smithi154.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T12:53:09.039 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:e2:13:15:5e:a7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-14T12:53:09.039 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-14T12:53:09.039 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:09.039 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::8e2:13ff:fe15:5ea7/64 scope link tentative 2023-07-14T12:53:09.039 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:09.041 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-07-14T12:53:09.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:09.041 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-07-14T12:53:09.042 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-07-14T12:53:09.042 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-07-14T12:53:09.042 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-14T12:53:09.042 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-07-14T12:53:09.043 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-07-14T12:53:09.043 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-07-14T12:53:09.043 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-07-14T12:53:09.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:09.179 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-07-14T12:53:09.179 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-07-14T12:53:09.180 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.1 up 2023-07-14T12:53:09.180 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set dev brx.1 master ceph-brx 2023-07-14T12:53:09.181 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-07-14T12:53:09.222 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T12:53:09.222 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-07-14T12:53:09.277 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-07-14T12:53:09.278 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T12:53:09.278 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-07-14T12:53:09.328 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-14T12:53:09.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:09.328 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-14T12:53:09.418 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-14T12:53:09.419 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-07-14T12:53:09.419 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-07-14T12:53:09.433 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-14T12:53:09.433 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-07-14T12:53:09.434 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-07-14T12:53:09.434 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T12:53:09.434 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T12:53:09.442 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-14T12:53:09.442 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-07-14T12:53:09.442 INFO:teuthology.orchestra.run.smithi154.stdout:invalid new device string format 2023-07-14T12:53:09.442 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T12:53:09.442 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T12:53:09.442 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790" 2023-07-14T12:53:09.442 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790:/ 2023-07-14T12:53:09.443 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=22affb8d-e389-40f8-a764-dd40eb1759c8" will pass to kernel 2023-07-14T12:53:09.446 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T12:53:09.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:09.447 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-07-14T12:53:09.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:09.468 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T12:53:09.523 INFO:teuthology.orchestra.run.smithi154.stdout:client4514 2023-07-14T12:53:09.524 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:53:09.524 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T12:53:09.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:09.580 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T12:53:09.632 INFO:teuthology.orchestra.run.smithi154.stdout:client4514 2023-07-14T12:53:09.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:09.633 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T12:53:09.688 INFO:teuthology.orchestra.run.smithi154.stdout:client4514 2023-07-14T12:53:09.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:09.689 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/22affb8d-e389-40f8-a764-dd40eb1759c8.client4514/status') 2023-07-14T12:53:09.753 INFO:teuthology.orchestra.run.smithi154.stdout:instance: client.4514 (3)192.168.0.2:0/2703814713 2023-07-14T12:53:09.754 INFO:teuthology.orchestra.run.smithi154.stdout:blocklisted: false 2023-07-14T12:53:09.754 INFO:teuthology.orchestra.run.smithi154.stderr:0+1 records in 2023-07-14T12:53:09.754 INFO:teuthology.orchestra.run.smithi154.stderr:0+1 records out 2023-07-14T12:53:09.754 INFO:teuthology.orchestra.run.smithi154.stderr:69 bytes copied, 5.2436e-05 s, 1.3 MB/s 2023-07-14T12:53:09.755 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-07-14T12:53:09.772 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:53:09.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.902+0000 7fb55d7fa640 1 Processor -- start 2023-07-14T12:53:09.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.902+0000 7fb55d7fa640 1 -- start start 2023-07-14T12:53:09.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.902+0000 7fb55d7fa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb5580b3c50 0x7fb5580b4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:09.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.902+0000 7fb55d7fa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb55815bcb0 0x7fb5580b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:09.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.902+0000 7fb55d7fa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5580b4aa0 con 0x7fb5580b10c0 2023-07-14T12:53:09.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.902+0000 7fb55d7fa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5580ce750 con 0x7fb55815bcb0 2023-07-14T12:53:09.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.902+0000 7fb55d7fa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5580cea30 con 0x7fb5580b3c50 2023-07-14T12:53:09.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.902+0000 7fb5567fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb55815bcb0 0x7fb5580b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:09.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.902+0000 7fb5567fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb55815bcb0 0x7fb5580b4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55584/0 (socket says 172.21.15.5:55584) 2023-07-14T12:53:09.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.902+0000 7fb5567fc640 1 -- 172.21.15.5:0/3161872546 learned_addr learned my addr 172.21.15.5:0/3161872546 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:09.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.902+0000 7fb5577fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb5580b10c0 0x7fb55815f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59360/0 (socket says 172.21.15.5:59360) 2023-07-14T12:53:09.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.902+0000 7fb556ffd640 1 --2- 172.21.15.5:0/3161872546 >> v2:172.21.15.154:3300/0 conn(0x7fb5580b3c50 0x7fb5580b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:09.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.902+0000 7fb5567fc640 1 -- 172.21.15.5:0/3161872546 >> v2:172.21.15.154:3300/0 conn(0x7fb5580b3c50 msgr2=0x7fb5580b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:09.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.902+0000 7fb5567fc640 1 --2- 172.21.15.5:0/3161872546 >> v2:172.21.15.154:3300/0 conn(0x7fb5580b3c50 0x7fb5580b4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:09.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.902+0000 7fb5567fc640 1 -- 172.21.15.5:0/3161872546 >> v1:172.21.15.5:6789/0 conn(0x7fb5580b10c0 legacy=0x7fb55815f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:09.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.902+0000 7fb5567fc640 1 -- 172.21.15.5:0/3161872546 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5580ced10 con 0x7fb55815bcb0 2023-07-14T12:53:09.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.902+0000 7fb555ffb640 1 -- 172.21.15.5:0/3161872546 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1168269915 0 0) 0x7fb5580b4aa0 con 0x7fb5580b10c0 2023-07-14T12:53:09.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.906+0000 7fb5567fc640 1 --2- 172.21.15.5:0/3161872546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb55815bcb0 0x7fb5580b4560 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb5580699c0 tx=0x7fb54c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b57160c177bde2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:09.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.906+0000 7fb555ffb640 1 -- 172.21.15.5:0/3161872546 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c0ab600 con 0x7fb55815bcb0 2023-07-14T12:53:09.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.906+0000 7fb555ffb640 1 -- 172.21.15.5:0/3161872546 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54c0a7050 con 0x7fb55815bcb0 2023-07-14T12:53:09.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.906+0000 7fb555ffb640 1 -- 172.21.15.5:0/3161872546 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c0ab980 con 0x7fb55815bcb0 2023-07-14T12:53:09.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.906+0000 7fb55d7fa640 1 -- 172.21.15.5:0/3161872546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb55815bcb0 msgr2=0x7fb5580b4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:09.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.906+0000 7fb55d7fa640 1 --2- 172.21.15.5:0/3161872546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb55815bcb0 0x7fb5580b4560 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb5580699c0 tx=0x7fb54c01c470 comp rx=0 tx=0).stop 2023-07-14T12:53:09.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.906+0000 7fb55d7fa640 1 -- 172.21.15.5:0/3161872546 shutdown_connections 2023-07-14T12:53:09.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.906+0000 7fb55d7fa640 1 --2- 172.21.15.5:0/3161872546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb55815bcb0 0x7fb5580b4560 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:09.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.906+0000 7fb55d7fa640 1 --2- 172.21.15.5:0/3161872546 >> v2:172.21.15.154:3300/0 conn(0x7fb5580b3c50 0x7fb5580b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:09.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.906+0000 7fb55d7fa640 1 -- 172.21.15.5:0/3161872546 >> 172.21.15.5:0/3161872546 conn(0x7fb558069e80 msgr2=0x7fb55806a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:09.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.906+0000 7fb55d7fa640 1 -- 172.21.15.5:0/3161872546 shutdown_connections 2023-07-14T12:53:09.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.906+0000 7fb55d7fa640 1 -- 172.21.15.5:0/3161872546 wait complete. 2023-07-14T12:53:09.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.910+0000 7fb55d7fa640 1 Processor -- start 2023-07-14T12:53:09.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.910+0000 7fb55d7fa640 1 -- start start 2023-07-14T12:53:09.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.910+0000 7fb55d7fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5580b10c0 0x7fb5581545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:09.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.910+0000 7fb55d7fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5580b3c50 0x7fb55815cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:09.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.910+0000 7fb55d7fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb55815bcb0 0x7fb5580b2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:09.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.910+0000 7fb55d7fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb558154b00 con 0x7fb5580b3c50 2023-07-14T12:53:09.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.910+0000 7fb55d7fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5580b5b40 con 0x7fb55815bcb0 2023-07-14T12:53:09.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.910+0000 7fb55d7fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5580b5e20 con 0x7fb5580b10c0 2023-07-14T12:53:09.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.910+0000 7fb5567fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5580b3c50 0x7fb55815cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:09.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.910+0000 7fb5567fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5580b3c50 0x7fb55815cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55586/0 (socket says 172.21.15.5:55586) 2023-07-14T12:53:09.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.910+0000 7fb5567fc640 1 -- 172.21.15.5:0/3946084384 learned_addr learned my addr 172.21.15.5:0/3946084384 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:09.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.910+0000 7fb5567fc640 1 -- 172.21.15.5:0/3946084384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5580b10c0 msgr2=0x7fb5581545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:09.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.910+0000 7fb5567fc640 1 --2- 172.21.15.5:0/3946084384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5580b10c0 0x7fb5581545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:09.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.910+0000 7fb5567fc640 1 -- 172.21.15.5:0/3946084384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb55815bcb0 msgr2=0x7fb5580b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:09.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.910+0000 7fb5577fe640 1 --2- 172.21.15.5:0/3946084384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb55815bcb0 0x7fb5580b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:09.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.910+0000 7fb5567fc640 1 --2- 172.21.15.5:0/3946084384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb55815bcb0 0x7fb5580b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:09.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.910+0000 7fb5567fc640 1 -- 172.21.15.5:0/3946084384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c0094d0 con 0x7fb5580b3c50 2023-07-14T12:53:09.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.910+0000 7fb5577fe640 1 --2- 172.21.15.5:0/3946084384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb55815bcb0 0x7fb5580b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:09.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.910+0000 7fb5567fc640 1 --2- 172.21.15.5:0/3946084384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5580b3c50 0x7fb55815cf70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb54c01a0a0 tx=0x7fb54c019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:09.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.910+0000 7fb53f7fe640 1 -- 172.21.15.5:0/3946084384 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c004030 con 0x7fb5580b3c50 2023-07-14T12:53:09.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.910+0000 7fb53f7fe640 1 -- 172.21.15.5:0/3946084384 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54c004190 con 0x7fb5580b3c50 2023-07-14T12:53:09.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.910+0000 7fb55d7fa640 1 -- 172.21.15.5:0/3946084384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5580b65c0 con 0x7fb5580b3c50 2023-07-14T12:53:09.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.910+0000 7fb53f7fe640 1 -- 172.21.15.5:0/3946084384 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c004520 con 0x7fb5580b3c50 2023-07-14T12:53:09.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.910+0000 7fb55d7fa640 1 -- 172.21.15.5:0/3946084384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55815d4b0 con 0x7fb5580b3c50 2023-07-14T12:53:09.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.910+0000 7fb55d7fa640 1 -- 172.21.15.5:0/3946084384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5580678d0 con 0x7fb5580b3c50 2023-07-14T12:53:09.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.914+0000 7fb53f7fe640 1 -- 172.21.15.5:0/3946084384 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb54c003620 con 0x7fb5580b3c50 2023-07-14T12:53:09.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.914+0000 7fb53f7fe640 1 --2- 172.21.15.5:0/3946084384 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb5440662b0 0x7fb544068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:09.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.914+0000 7fb53f7fe640 1 -- 172.21.15.5:0/3946084384 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb54c11df60 con 0x7fb5580b3c50 2023-07-14T12:53:09.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.914+0000 7fb556ffd640 1 --2- 172.21.15.5:0/3946084384 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb5440662b0 0x7fb544068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:09.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.914+0000 7fb556ffd640 1 --2- 172.21.15.5:0/3946084384 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb5440662b0 0x7fb544068760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb548006aa0 tx=0x7fb548006a30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:09.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:09.918+0000 7fb53f7fe640 1 -- 172.21.15.5:0/3946084384 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb54c0eb470 con 0x7fb5580b3c50 2023-07-14T12:53:10.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.074+0000 7fb55d7fa640 1 -- 172.21.15.5:0/3946084384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5580b6a70 con 0x7fb5580b3c50 2023-07-14T12:53:10.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.078+0000 7fb53f7fe640 1 -- 172.21.15.5:0/3946084384 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18231 (secure 0 0 0) 0x7fb54c0eea90 con 0x7fb5580b3c50 2023-07-14T12:53:10.103 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:10.104 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":23,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:52:48.091483+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:52:44.223082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T12:52:45.469396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:53:10.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.078+0000 7fb55d7fa640 1 -- 172.21.15.5:0/3946084384 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb5440662b0 msgr2=0x7fb544068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:10.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.078+0000 7fb55d7fa640 1 --2- 172.21.15.5:0/3946084384 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb5440662b0 0x7fb544068760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb548006aa0 tx=0x7fb548006a30 comp rx=0 tx=0).stop 2023-07-14T12:53:10.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.078+0000 7fb55d7fa640 1 -- 172.21.15.5:0/3946084384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5580b3c50 msgr2=0x7fb55815cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:10.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.078+0000 7fb55d7fa640 1 --2- 172.21.15.5:0/3946084384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5580b3c50 0x7fb55815cf70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb54c01a0a0 tx=0x7fb54c019210 comp rx=0 tx=0).stop 2023-07-14T12:53:10.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.078+0000 7fb55d7fa640 1 -- 172.21.15.5:0/3946084384 shutdown_connections 2023-07-14T12:53:10.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.078+0000 7fb55d7fa640 1 --2- 172.21.15.5:0/3946084384 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb5440662b0 0x7fb544068760 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.078+0000 7fb55d7fa640 1 --2- 172.21.15.5:0/3946084384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb55815bcb0 0x7fb5580b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.078+0000 7fb55d7fa640 1 --2- 172.21.15.5:0/3946084384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5580b3c50 0x7fb55815cf70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.078+0000 7fb55d7fa640 1 --2- 172.21.15.5:0/3946084384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5580b10c0 0x7fb5581545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.078+0000 7fb55d7fa640 1 -- 172.21.15.5:0/3946084384 >> 172.21.15.5:0/3946084384 conn(0x7fb558069e80 msgr2=0x7fb5580b1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:10.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.078+0000 7fb55d7fa640 1 -- 172.21.15.5:0/3946084384 shutdown_connections 2023-07-14T12:53:10.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.078+0000 7fb55d7fa640 1 -- 172.21.15.5:0/3946084384 wait complete. 2023-07-14T12:53:10.127 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T12:52:44.223082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T12:52:45.469396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T12:53:10.128 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T12:53:10.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.246+0000 7f477ab3d640 1 Processor -- start 2023-07-14T12:53:10.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.246+0000 7f477ab3d640 1 -- start start 2023-07-14T12:53:10.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.250+0000 7f477ab3d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47740cc960 0x7f47740ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:10.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.250+0000 7f477ab3d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f47740b1620 0x7f47740ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:10.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.250+0000 7f477ab3d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4774160750 0x7f47740b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:10.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.250+0000 7f477ab3d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47740cf710 con 0x7f47740b1620 2023-07-14T12:53:10.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.250+0000 7f477ab3d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47740cd270 con 0x7f4774160750 2023-07-14T12:53:10.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.250+0000 7f477ab3d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47740cf430 con 0x7f47740cc960 2023-07-14T12:53:10.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.250+0000 7f477933a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f47740b1620 0x7f47740ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:10.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.250+0000 7f477933a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f47740b1620 0x7f47740ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55600/0 (socket says 172.21.15.5:55600) 2023-07-14T12:53:10.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.250+0000 7f477933a640 1 -- 172.21.15.5:0/1709522279 learned_addr learned my addr 172.21.15.5:0/1709522279 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:10.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.250+0000 7f477a33c640 1 --2- 172.21.15.5:0/1709522279 >> v2:172.21.15.154:3300/0 conn(0x7f4774160750 0x7f47740b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:10.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.250+0000 7f4779b3b640 1 --2- 172.21.15.5:0/1709522279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47740cc960 0x7f47740ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:10.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.250+0000 7f477933a640 1 -- 172.21.15.5:0/1709522279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47740cc960 msgr2=0x7f47740ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:10.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.250+0000 7f477933a640 1 --2- 172.21.15.5:0/1709522279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47740cc960 0x7f47740ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.250+0000 7f477933a640 1 -- 172.21.15.5:0/1709522279 >> v2:172.21.15.154:3300/0 conn(0x7f4774160750 msgr2=0x7f47740b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:10.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.250+0000 7f477933a640 1 --2- 172.21.15.5:0/1709522279 >> v2:172.21.15.154:3300/0 conn(0x7f4774160750 0x7f47740b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.250+0000 7f477933a640 1 -- 172.21.15.5:0/1709522279 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477415fc70 con 0x7f47740b1620 2023-07-14T12:53:10.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.254+0000 7f477933a640 1 --2- 172.21.15.5:0/1709522279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47740b1620 0x7f47740ce950 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f477408b5d0 tx=0x7f476401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0feeb401c16d22 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:10.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.254+0000 7f4778b39640 1 -- 172.21.15.5:0/1709522279 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47640aa5f0 con 0x7f47740b1620 2023-07-14T12:53:10.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.254+0000 7f4778b39640 1 -- 172.21.15.5:0/1709522279 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47640aa750 con 0x7f47740b1620 2023-07-14T12:53:10.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.254+0000 7f4778b39640 1 -- 172.21.15.5:0/1709522279 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47640aaae0 con 0x7f47740b1620 2023-07-14T12:53:10.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.254+0000 7f477ab3d640 1 -- 172.21.15.5:0/1709522279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47740b1620 msgr2=0x7f47740ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:10.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.254+0000 7f477ab3d640 1 --2- 172.21.15.5:0/1709522279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47740b1620 0x7f47740ce950 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f477408b5d0 tx=0x7f476401c4d0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.254+0000 7f477ab3d640 1 -- 172.21.15.5:0/1709522279 shutdown_connections 2023-07-14T12:53:10.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.254+0000 7f477ab3d640 1 --2- 172.21.15.5:0/1709522279 >> v2:172.21.15.154:3300/0 conn(0x7f4774160750 0x7f47740b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.254+0000 7f477ab3d640 1 --2- 172.21.15.5:0/1709522279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47740b1620 0x7f47740ce950 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.254+0000 7f477ab3d640 1 --2- 172.21.15.5:0/1709522279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47740cc960 0x7f47740ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.254+0000 7f477ab3d640 1 -- 172.21.15.5:0/1709522279 >> 172.21.15.5:0/1709522279 conn(0x7f4774069f50 msgr2=0x7f477406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:10.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.254+0000 7f477ab3d640 1 -- 172.21.15.5:0/1709522279 shutdown_connections 2023-07-14T12:53:10.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.254+0000 7f477ab3d640 1 -- 172.21.15.5:0/1709522279 wait complete. 2023-07-14T12:53:10.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.254+0000 7f477ab3d640 1 Processor -- start 2023-07-14T12:53:10.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.254+0000 7f477ab3d640 1 -- start start 2023-07-14T12:53:10.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.254+0000 7f477ab3d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47740b1620 0x7f47740c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:10.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.254+0000 7f477ab3d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47740cc960 0x7f477415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:10.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.258+0000 7f477ab3d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4774160750 0x7f477415b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:10.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.258+0000 7f477ab3d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47741540a0 con 0x7f47740b1620 2023-07-14T12:53:10.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.258+0000 7f477ab3d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4774153140 con 0x7f4774160750 2023-07-14T12:53:10.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.258+0000 7f477ab3d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4774153420 con 0x7f47740cc960 2023-07-14T12:53:10.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.258+0000 7f4779b3b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47740b1620 0x7f47740c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:10.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.258+0000 7f4779b3b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47740b1620 0x7f47740c5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55608/0 (socket says 172.21.15.5:55608) 2023-07-14T12:53:10.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.258+0000 7f4779b3b640 1 -- 172.21.15.5:0/3923849060 learned_addr learned my addr 172.21.15.5:0/3923849060 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:10.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.258+0000 7f477933a640 1 --2- 172.21.15.5:0/3923849060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47740cc960 0x7f477415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:10.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.258+0000 7f477a33c640 1 --2- 172.21.15.5:0/3923849060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4774160750 0x7f477415b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:10.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.258+0000 7f4779b3b640 1 -- 172.21.15.5:0/3923849060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47740cc960 msgr2=0x7f477415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:10.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.258+0000 7f4779b3b640 1 --2- 172.21.15.5:0/3923849060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47740cc960 0x7f477415b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.258+0000 7f4779b3b640 1 -- 172.21.15.5:0/3923849060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4774160750 msgr2=0x7f477415b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:10.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.258+0000 7f4779b3b640 1 --2- 172.21.15.5:0/3923849060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4774160750 0x7f477415b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.258+0000 7f4779b3b640 1 -- 172.21.15.5:0/3923849060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47640094d0 con 0x7f47740b1620 2023-07-14T12:53:10.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.258+0000 7f477933a640 1 --2- 172.21.15.5:0/3923849060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47740cc960 0x7f477415b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:53:10.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.258+0000 7f4779b3b640 1 --2- 172.21.15.5:0/3923849060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47740b1620 0x7f47740c5cf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f477000d800 tx=0x7f477000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:10.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.258+0000 7f476a7fc640 1 -- 172.21.15.5:0/3923849060 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477000b6c0 con 0x7f47740b1620 2023-07-14T12:53:10.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.258+0000 7f476a7fc640 1 -- 172.21.15.5:0/3923849060 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477000b820 con 0x7f47740b1620 2023-07-14T12:53:10.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.258+0000 7f476a7fc640 1 -- 172.21.15.5:0/3923849060 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477000bb90 con 0x7f47740b1620 2023-07-14T12:53:10.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.258+0000 7f477ab3d640 1 -- 172.21.15.5:0/3923849060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4774153700 con 0x7f47740b1620 2023-07-14T12:53:10.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.258+0000 7f477ab3d640 1 -- 172.21.15.5:0/3923849060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4774153cc0 con 0x7f47740b1620 2023-07-14T12:53:10.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.258+0000 7f477ab3d640 1 -- 172.21.15.5:0/3923849060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f477404e020 con 0x7f47740b1620 2023-07-14T12:53:10.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.258+0000 7f476a7fc640 1 -- 172.21.15.5:0/3923849060 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f477000bcf0 con 0x7f47740b1620 2023-07-14T12:53:10.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.262+0000 7f476a7fc640 1 --2- 172.21.15.5:0/3923849060 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4758066280 0x7f4758068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:10.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.262+0000 7f476a7fc640 1 -- 172.21.15.5:0/3923849060 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f47700841f0 con 0x7f47740b1620 2023-07-14T12:53:10.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.262+0000 7f477933a640 1 --2- 172.21.15.5:0/3923849060 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4758066280 0x7f4758068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:10.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.262+0000 7f477933a640 1 --2- 172.21.15.5:0/3923849060 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4758066280 0x7f4758068730 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f47640ae000 tx=0x7f47640b5040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:10.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.266+0000 7f476a7fc640 1 -- 172.21.15.5:0/3923849060 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4770055110 con 0x7f47740b1620 2023-07-14T12:53:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.418+0000 7f477ab3d640 1 -- 172.21.15.5:0/3923849060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f47740cfad0 con 0x7f47740b1620 2023-07-14T12:53:10.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.422+0000 7f476a7fc640 1 -- 172.21.15.5:0/3923849060 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4770054ca0 con 0x7f47740b1620 2023-07-14T12:53:10.448 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T12:53:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.422+0000 7f477ab3d640 1 -- 172.21.15.5:0/3923849060 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4758066280 msgr2=0x7f4758068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.422+0000 7f477ab3d640 1 --2- 172.21.15.5:0/3923849060 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4758066280 0x7f4758068730 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f47640ae000 tx=0x7f47640b5040 comp rx=0 tx=0).stop 2023-07-14T12:53:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.422+0000 7f477ab3d640 1 -- 172.21.15.5:0/3923849060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47740b1620 msgr2=0x7f47740c5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:10.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.422+0000 7f477ab3d640 1 --2- 172.21.15.5:0/3923849060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47740b1620 0x7f47740c5cf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f477000d800 tx=0x7f477000dcc0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.422+0000 7f477ab3d640 1 -- 172.21.15.5:0/3923849060 shutdown_connections 2023-07-14T12:53:10.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.422+0000 7f477ab3d640 1 --2- 172.21.15.5:0/3923849060 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4758066280 0x7f4758068730 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.422+0000 7f477ab3d640 1 --2- 172.21.15.5:0/3923849060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4774160750 0x7f477415b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.422+0000 7f477ab3d640 1 --2- 172.21.15.5:0/3923849060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47740cc960 0x7f477415b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.422+0000 7f477ab3d640 1 --2- 172.21.15.5:0/3923849060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47740b1620 0x7f47740c5cf0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.422+0000 7f477ab3d640 1 -- 172.21.15.5:0/3923849060 >> 172.21.15.5:0/3923849060 conn(0x7f4774069f50 msgr2=0x7f47740b6410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.422+0000 7f477ab3d640 1 -- 172.21.15.5:0/3923849060 shutdown_connections 2023-07-14T12:53:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.422+0000 7f477ab3d640 1 -- 172.21.15.5:0/3923849060 wait complete. 2023-07-14T12:53:10.468 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T12:53:10.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.589+0000 7f2ac8740640 1 Processor -- start 2023-07-14T12:53:10.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.589+0000 7f2ac8740640 1 -- start start 2023-07-14T12:53:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.589+0000 7f2ac8740640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ac006a540 0x7f2ac006a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.589+0000 7f2ac8740640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ac00cf2e0 0x7f2ac00cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.589+0000 7f2ac8740640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac00cb7a0 con 0x7f2ac00cc9c0 2023-07-14T12:53:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.589+0000 7f2ac8740640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac00d0920 con 0x7f2ac006a540 2023-07-14T12:53:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.589+0000 7f2ac8740640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac015bfd0 con 0x7f2ac00cf2e0 2023-07-14T12:53:10.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.589+0000 7f2ac64dc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ac006a540 0x7f2ac006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.589+0000 7f2ac64dc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ac006a540 0x7f2ac006a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55620/0 (socket says 172.21.15.5:55620) 2023-07-14T12:53:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.589+0000 7f2ac64dc640 1 -- 172.21.15.5:0/4033037382 learned_addr learned my addr 172.21.15.5:0/4033037382 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.589+0000 7f2ac64dc640 1 -- 172.21.15.5:0/4033037382 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ac00cf2e0 msgr2=0x7f2ac00cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:10.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.589+0000 7f2ac5cdb640 1 --2- 172.21.15.5:0/4033037382 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ac00cf2e0 0x7f2ac00cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:10.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.589+0000 7f2ac64dc640 1 --2- 172.21.15.5:0/4033037382 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ac00cf2e0 0x7f2ac00cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.589+0000 7f2ac64dc640 1 -- 172.21.15.5:0/4033037382 >> v1:172.21.15.154:6789/0 conn(0x7f2ac00cc9c0 legacy=0x7f2ac00cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:10.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.589+0000 7f2ac64dc640 1 -- 172.21.15.5:0/4033037382 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac006ae50 con 0x7f2ac006a540 2023-07-14T12:53:10.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.589+0000 7f2ac5cdb640 1 --2- 172.21.15.5:0/4033037382 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ac00cf2e0 0x7f2ac00cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:10.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.593+0000 7f2ac64dc640 1 --2- 172.21.15.5:0/4033037382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ac006a540 0x7f2ac006a910 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2abc009870 tx=0x7f2abc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=795783975ba45501 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:10.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.593+0000 7f2ac54da640 1 -- 172.21.15.5:0/4033037382 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc0aa5f0 con 0x7f2ac006a540 2023-07-14T12:53:10.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.593+0000 7f2ac54da640 1 -- 172.21.15.5:0/4033037382 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2abc0aa750 con 0x7f2ac006a540 2023-07-14T12:53:10.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.593+0000 7f2ac54da640 1 -- 172.21.15.5:0/4033037382 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc0aaae0 con 0x7f2ac006a540 2023-07-14T12:53:10.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.593+0000 7f2ac8740640 1 -- 172.21.15.5:0/4033037382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ac006a540 msgr2=0x7f2ac006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:10.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.593+0000 7f2ac8740640 1 --2- 172.21.15.5:0/4033037382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ac006a540 0x7f2ac006a910 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2abc009870 tx=0x7f2abc01c4d0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.593+0000 7f2ac8740640 1 -- 172.21.15.5:0/4033037382 shutdown_connections 2023-07-14T12:53:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.593+0000 7f2ac8740640 1 --2- 172.21.15.5:0/4033037382 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ac00cf2e0 0x7f2ac00cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.593+0000 7f2ac8740640 1 --2- 172.21.15.5:0/4033037382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ac006a540 0x7f2ac006a910 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.593+0000 7f2ac8740640 1 -- 172.21.15.5:0/4033037382 >> 172.21.15.5:0/4033037382 conn(0x7f2ac0099490 msgr2=0x7f2ac0089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.593+0000 7f2ac8740640 1 -- 172.21.15.5:0/4033037382 shutdown_connections 2023-07-14T12:53:10.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.593+0000 7f2ac8740640 1 -- 172.21.15.5:0/4033037382 wait complete. 2023-07-14T12:53:10.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.597+0000 7f2ac8740640 1 Processor -- start 2023-07-14T12:53:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.597+0000 7f2ac8740640 1 -- start start 2023-07-14T12:53:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.597+0000 7f2ac8740640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ac006a540 0x7f2ac015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.597+0000 7f2ac8740640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ac00cc9c0 0x7f2ac0157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.597+0000 7f2ac8740640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ac00cf2e0 0x7f2ac006e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:10.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.597+0000 7f2ac8740640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac0157bd0 con 0x7f2ac006a540 2023-07-14T12:53:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.597+0000 7f2ac8740640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac015eae0 con 0x7f2ac00cc9c0 2023-07-14T12:53:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.597+0000 7f2ac8740640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac015ef70 con 0x7f2ac00cf2e0 2023-07-14T12:53:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.597+0000 7f2ac64dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ac006a540 0x7f2ac015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.597+0000 7f2ac64dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ac006a540 0x7f2ac015d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55630/0 (socket says 172.21.15.5:55630) 2023-07-14T12:53:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.597+0000 7f2ac64dc640 1 -- 172.21.15.5:0/871622224 learned_addr learned my addr 172.21.15.5:0/871622224 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.597+0000 7f2ac5cdb640 1 --2- 172.21.15.5:0/871622224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ac00cc9c0 0x7f2ac0157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:10.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.597+0000 7f2ac6cdd640 1 --2- 172.21.15.5:0/871622224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ac00cf2e0 0x7f2ac006e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.597+0000 7f2ac64dc640 1 -- 172.21.15.5:0/871622224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ac00cf2e0 msgr2=0x7f2ac006e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.597+0000 7f2ac64dc640 1 --2- 172.21.15.5:0/871622224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ac00cf2e0 0x7f2ac006e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.597+0000 7f2ac64dc640 1 -- 172.21.15.5:0/871622224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ac00cc9c0 msgr2=0x7f2ac0157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:10.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.597+0000 7f2ac64dc640 1 --2- 172.21.15.5:0/871622224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ac00cc9c0 0x7f2ac0157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.597+0000 7f2ac64dc640 1 -- 172.21.15.5:0/871622224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2abc0094d0 con 0x7f2ac006a540 2023-07-14T12:53:10.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.597+0000 7f2ac5cdb640 1 --2- 172.21.15.5:0/871622224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ac00cc9c0 0x7f2ac0157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.597+0000 7f2ac64dc640 1 --2- 172.21.15.5:0/871622224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ac006a540 0x7f2ac015d7d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0ac040 tx=0x7f2abc01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.597+0000 7f2ab6ffd640 1 -- 172.21.15.5:0/871622224 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc0b3800 con 0x7f2ac006a540 2023-07-14T12:53:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.597+0000 7f2ab6ffd640 1 -- 172.21.15.5:0/871622224 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2abc0b3980 con 0x7f2ac006a540 2023-07-14T12:53:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.597+0000 7f2ab6ffd640 1 -- 172.21.15.5:0/871622224 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc0b3d30 con 0x7f2ac006a540 2023-07-14T12:53:10.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.597+0000 7f2ac8740640 1 -- 172.21.15.5:0/871622224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac015ded0 con 0x7f2ac006a540 2023-07-14T12:53:10.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.597+0000 7f2ac8740640 1 -- 172.21.15.5:0/871622224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac015e490 con 0x7f2ac006a540 2023-07-14T12:53:10.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.597+0000 7f2ac8740640 1 -- 172.21.15.5:0/871622224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac01f5240 con 0x7f2ac006a540 2023-07-14T12:53:10.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.601+0000 7f2ab6ffd640 1 -- 172.21.15.5:0/871622224 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2abc0b2380 con 0x7f2ac006a540 2023-07-14T12:53:10.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.601+0000 7f2ab6ffd640 1 --2- 172.21.15.5:0/871622224 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2aa40662b0 0x7f2aa4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:10.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.601+0000 7f2ab6ffd640 1 -- 172.21.15.5:0/871622224 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2abc0a7070 con 0x7f2ac006a540 2023-07-14T12:53:10.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.601+0000 7f2ac5cdb640 1 --2- 172.21.15.5:0/871622224 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2aa40662b0 0x7f2aa4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:10.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.601+0000 7f2ac5cdb640 1 --2- 172.21.15.5:0/871622224 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2aa40662b0 0x7f2aa4068760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2ac006f120 tx=0x7f2ab0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:10.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.605+0000 7f2ab6ffd640 1 -- 172.21.15.5:0/871622224 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2abc0eb8e0 con 0x7f2ac006a540 2023-07-14T12:53:10.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.761+0000 7f2ac8740640 1 -- 172.21.15.5:0/871622224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2ac00678d0 con 0x7f2ac006a540 2023-07-14T12:53:10.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.761+0000 7f2ab6ffd640 1 -- 172.21.15.5:0/871622224 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2abc0eef00 con 0x7f2ac006a540 2023-07-14T12:53:10.790 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T12:53:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.765+0000 7f2ac8740640 1 -- 172.21.15.5:0/871622224 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2aa40662b0 msgr2=0x7f2aa4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:10.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.765+0000 7f2ac8740640 1 --2- 172.21.15.5:0/871622224 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2aa40662b0 0x7f2aa4068760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2ac006f120 tx=0x7f2ab0008040 comp rx=0 tx=0).stop 2023-07-14T12:53:10.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.765+0000 7f2ac8740640 1 -- 172.21.15.5:0/871622224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ac006a540 msgr2=0x7f2ac015d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:10.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.765+0000 7f2ac8740640 1 --2- 172.21.15.5:0/871622224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ac006a540 0x7f2ac015d7d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0ac040 tx=0x7f2abc01ad10 comp rx=0 tx=0).stop 2023-07-14T12:53:10.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.765+0000 7f2ac8740640 1 -- 172.21.15.5:0/871622224 shutdown_connections 2023-07-14T12:53:10.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.765+0000 7f2ac8740640 1 --2- 172.21.15.5:0/871622224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ac00cf2e0 0x7f2ac006e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.765+0000 7f2ac8740640 1 --2- 172.21.15.5:0/871622224 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2aa40662b0 0x7f2aa4068760 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.765+0000 7f2ac8740640 1 --2- 172.21.15.5:0/871622224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ac00cc9c0 0x7f2ac0157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.765+0000 7f2ac8740640 1 --2- 172.21.15.5:0/871622224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ac006a540 0x7f2ac015d7d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.765+0000 7f2ac8740640 1 -- 172.21.15.5:0/871622224 >> 172.21.15.5:0/871622224 conn(0x7f2ac0099490 msgr2=0x7f2ac015b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:10.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.765+0000 7f2ac8740640 1 -- 172.21.15.5:0/871622224 shutdown_connections 2023-07-14T12:53:10.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.765+0000 7f2ac8740640 1 -- 172.21.15.5:0/871622224 wait complete. 2023-07-14T12:53:10.810 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T12:53:10.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.929+0000 7f6895bfa640 1 Processor -- start 2023-07-14T12:53:10.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.929+0000 7f6895bfa640 1 -- start start 2023-07-14T12:53:10.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.929+0000 7f6895bfa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f689015f690 0x7f68900b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:10.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.929+0000 7f6895bfa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f689006c040 con 0x7f689006a440 2023-07-14T12:53:10.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.929+0000 7f6895bfa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6890160600 con 0x7f68901453a0 2023-07-14T12:53:10.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.929+0000 7f6895bfa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6890160170 con 0x7f689015f690 2023-07-14T12:53:10.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.929+0000 7f688ffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f689006a440 0x7f689006c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59376/0 (socket says 172.21.15.5:59376) 2023-07-14T12:53:10.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.929+0000 7f688ffff640 1 -- 172.21.15.5:0/3118071707 learned_addr learned my addr 172.21.15.5:0/3118071707 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:10.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.929+0000 7f688f7fe640 1 --2- 172.21.15.5:0/3118071707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f689015f690 0x7f68900b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:10.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.929+0000 7f688e7fc640 1 -- 172.21.15.5:0/3118071707 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2835692572 0 0) 0x7f689006c040 con 0x7f689006a440 2023-07-14T12:53:10.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.933+0000 7f688e7fc640 1 -- 172.21.15.5:0/3118071707 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6878003530 con 0x7f689006a440 2023-07-14T12:53:10.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.933+0000 7f688e7fc640 1 -- 172.21.15.5:0/3118071707 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1876886468 0 0) 0x7f6878003530 con 0x7f689006a440 2023-07-14T12:53:10.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.933+0000 7f688e7fc640 1 -- 172.21.15.5:0/3118071707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f689015f690 msgr2=0x7f68900b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:10.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.933+0000 7f688e7fc640 1 --2- 172.21.15.5:0/3118071707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f689015f690 0x7f68900b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.933+0000 7f688e7fc640 1 -- 172.21.15.5:0/3118071707 >> v1:172.21.15.154:6789/0 conn(0x7f68901453a0 legacy=0x7f689015fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:10.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.933+0000 7f688e7fc640 1 -- 172.21.15.5:0/3118071707 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6890160360 con 0x7f689006a440 2023-07-14T12:53:10.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.933+0000 7f688e7fc640 1 -- 172.21.15.5:0/3118071707 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f6888001a00 con 0x7f689006a440 2023-07-14T12:53:10.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.933+0000 7f688e7fc640 1 -- 172.21.15.5:0/3118071707 >> v1:172.21.15.5:6789/0 conn(0x7f689006a440 legacy=0x7f689006c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:10.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.933+0000 7f688e7fc640 1 --2- 172.21.15.5:0/3118071707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68780039b0 0x7f6878003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.933+0000 7f688e7fc640 1 --2- 172.21.15.5:0/3118071707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68780047d0 0x7f6878004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.933+0000 7f688e7fc640 1 --2- 172.21.15.5:0/3118071707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f689015f690 0x7f6878005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.933+0000 7f688e7fc640 1 -- 172.21.15.5:0/3118071707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687800bb20 con 0x7f68780039b0 2023-07-14T12:53:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.933+0000 7f688e7fc640 1 -- 172.21.15.5:0/3118071707 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687800bc90 con 0x7f68780047d0 2023-07-14T12:53:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.933+0000 7f688e7fc640 1 -- 172.21.15.5:0/3118071707 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687800be50 con 0x7f689015f690 2023-07-14T12:53:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.933+0000 7f688f7fe640 1 --2- 172.21.15.5:0/3118071707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68780039b0 0x7f6878003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.933+0000 7f688ffff640 1 --2- 172.21.15.5:0/3118071707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f689015f690 0x7f6878005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.933+0000 7f688effd640 1 --2- 172.21.15.5:0/3118071707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68780047d0 0x7f6878004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.933+0000 7f688f7fe640 1 -- 172.21.15.5:0/3118071707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f689015f690 msgr2=0x7f6878005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.933+0000 7f688f7fe640 1 --2- 172.21.15.5:0/3118071707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f689015f690 0x7f6878005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.933+0000 7f688f7fe640 1 -- 172.21.15.5:0/3118071707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68780047d0 msgr2=0x7f6878004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.933+0000 7f688f7fe640 1 --2- 172.21.15.5:0/3118071707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68780047d0 0x7f6878004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.933+0000 7f688f7fe640 1 -- 172.21.15.5:0/3118071707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6878003530 con 0x7f68780039b0 2023-07-14T12:53:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.933+0000 7f688effd640 1 --2- 172.21.15.5:0/3118071707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68780047d0 0x7f6878004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:10.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.937+0000 7f688f7fe640 1 --2- 172.21.15.5:0/3118071707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68780039b0 0x7f6878003dc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6880009ab0 tx=0x7f688001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea458d17cf5191bb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.937+0000 7f688e7fc640 1 -- 172.21.15.5:0/3118071707 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68800a6410 con 0x7f68780039b0 2023-07-14T12:53:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.937+0000 7f688e7fc640 1 -- 172.21.15.5:0/3118071707 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68800a6570 con 0x7f68780039b0 2023-07-14T12:53:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.937+0000 7f688e7fc640 1 -- 172.21.15.5:0/3118071707 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68800a6920 con 0x7f68780039b0 2023-07-14T12:53:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.937+0000 7f6895bfa640 1 -- 172.21.15.5:0/3118071707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68780039b0 msgr2=0x7f6878003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.937+0000 7f6895bfa640 1 --2- 172.21.15.5:0/3118071707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68780039b0 0x7f6878003dc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6880009ab0 tx=0x7f688001c920 comp rx=0 tx=0).stop 2023-07-14T12:53:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.937+0000 7f688ffff640 1 -- 172.21.15.5:0/3118071707 reap_dead start 2023-07-14T12:53:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.937+0000 7f6895bfa640 1 -- 172.21.15.5:0/3118071707 shutdown_connections 2023-07-14T12:53:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.937+0000 7f6895bfa640 1 -- 172.21.15.5:0/3118071707 >> 172.21.15.5:0/3118071707 conn(0x7f68900b1210 msgr2=0x7f68900ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.937+0000 7f6895bfa640 1 -- 172.21.15.5:0/3118071707 shutdown_connections 2023-07-14T12:53:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.937+0000 7f6895bfa640 1 -- 172.21.15.5:0/3118071707 wait complete. 2023-07-14T12:53:10.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.937+0000 7f6895bfa640 1 Processor -- start 2023-07-14T12:53:10.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.937+0000 7f6895bfa640 1 -- start start 2023-07-14T12:53:10.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.937+0000 7f6895bfa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68780039b0 0x7f689015e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:10.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.937+0000 7f6895bfa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68901438c0 0x7f6890143d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:10.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.941+0000 7f6895bfa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68900c5ea0 0x7f68900c6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:10.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.941+0000 7f6895bfa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6890144270 con 0x7f68780039b0 2023-07-14T12:53:10.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.941+0000 7f6895bfa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68900c6b60 con 0x7f68901438c0 2023-07-14T12:53:10.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.941+0000 7f6895bfa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68900c6e40 con 0x7f68900c5ea0 2023-07-14T12:53:10.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.941+0000 7f688f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68780039b0 0x7f689015e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:10.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.941+0000 7f688f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68780039b0 0x7f689015e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55640/0 (socket says 172.21.15.5:55640) 2023-07-14T12:53:10.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.941+0000 7f688f7fe640 1 -- 172.21.15.5:0/1610848247 learned_addr learned my addr 172.21.15.5:0/1610848247 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:10.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.941+0000 7f688effd640 1 --2- 172.21.15.5:0/1610848247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68901438c0 0x7f6890143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:10.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.941+0000 7f688ffff640 1 --2- 172.21.15.5:0/1610848247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68900c5ea0 0x7f68900c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:10.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.941+0000 7f688f7fe640 1 -- 172.21.15.5:0/1610848247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68900c5ea0 msgr2=0x7f68900c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:10.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.941+0000 7f688f7fe640 1 --2- 172.21.15.5:0/1610848247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68900c5ea0 0x7f68900c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.941+0000 7f688f7fe640 1 -- 172.21.15.5:0/1610848247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68901438c0 msgr2=0x7f6890143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:10.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.941+0000 7f688f7fe640 1 --2- 172.21.15.5:0/1610848247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68901438c0 0x7f6890143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.941+0000 7f688f7fe640 1 -- 172.21.15.5:0/1610848247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68900c7120 con 0x7f68780039b0 2023-07-14T12:53:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.941+0000 7f688f7fe640 1 --2- 172.21.15.5:0/1610848247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68780039b0 0x7f689015e170 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6880009ab0 tx=0x7f6878005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.941+0000 7f6877fff640 1 -- 172.21.15.5:0/1610848247 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68800b5070 con 0x7f68780039b0 2023-07-14T12:53:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.941+0000 7f6877fff640 1 -- 172.21.15.5:0/1610848247 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688000f000 con 0x7f68780039b0 2023-07-14T12:53:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.941+0000 7f6877fff640 1 -- 172.21.15.5:0/1610848247 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6880004020 con 0x7f68780039b0 2023-07-14T12:53:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.941+0000 7f6895bfa640 1 -- 172.21.15.5:0/1610848247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68900c7400 con 0x7f68780039b0 2023-07-14T12:53:10.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.941+0000 7f6895bfa640 1 -- 172.21.15.5:0/1610848247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68900c6860 con 0x7f68780039b0 2023-07-14T12:53:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.941+0000 7f6895bfa640 1 -- 172.21.15.5:0/1610848247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68900acbe0 con 0x7f68780039b0 2023-07-14T12:53:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.941+0000 7f6877fff640 1 -- 172.21.15.5:0/1610848247 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f68800b9070 con 0x7f68780039b0 2023-07-14T12:53:10.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.945+0000 7f6877fff640 1 --2- 172.21.15.5:0/1610848247 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f687c066280 0x7f687c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:10.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.945+0000 7f6877fff640 1 -- 172.21.15.5:0/1610848247 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f688011d870 con 0x7f68780039b0 2023-07-14T12:53:10.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.945+0000 7f688effd640 1 --2- 172.21.15.5:0/1610848247 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f687c066280 0x7f687c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:10.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.945+0000 7f688effd640 1 --2- 172.21.15.5:0/1610848247 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f687c066280 0x7f687c068730 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6884007fd0 tx=0x7f6884009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:10.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:10.945+0000 7f6877fff640 1 -- 172.21.15.5:0/1610848247 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f68800eae20 con 0x7f68780039b0 2023-07-14T12:53:11.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.101+0000 7f6895bfa640 1 -- 172.21.15.5:0/1610848247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f68900678d0 con 0x7f68780039b0 2023-07-14T12:53:11.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.101+0000 7f6877fff640 1 -- 172.21.15.5:0/1610848247 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f68800ee440 con 0x7f68780039b0 2023-07-14T12:53:11.129 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T12:53:11.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.101+0000 7f6895bfa640 1 -- 172.21.15.5:0/1610848247 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f687c066280 msgr2=0x7f687c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:11.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.101+0000 7f6895bfa640 1 --2- 172.21.15.5:0/1610848247 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f687c066280 0x7f687c068730 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6884007fd0 tx=0x7f6884009040 comp rx=0 tx=0).stop 2023-07-14T12:53:11.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.101+0000 7f6895bfa640 1 -- 172.21.15.5:0/1610848247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68780039b0 msgr2=0x7f689015e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:11.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.101+0000 7f6895bfa640 1 --2- 172.21.15.5:0/1610848247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68780039b0 0x7f689015e170 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6880009ab0 tx=0x7f6878005800 comp rx=0 tx=0).stop 2023-07-14T12:53:11.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.105+0000 7f6895bfa640 1 -- 172.21.15.5:0/1610848247 shutdown_connections 2023-07-14T12:53:11.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.105+0000 7f6895bfa640 1 --2- 172.21.15.5:0/1610848247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68900c5ea0 0x7f68900c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:11.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.105+0000 7f6895bfa640 1 --2- 172.21.15.5:0/1610848247 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f687c066280 0x7f687c068730 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:11.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.105+0000 7f6895bfa640 1 --2- 172.21.15.5:0/1610848247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68901438c0 0x7f6890143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:11.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.105+0000 7f6895bfa640 1 --2- 172.21.15.5:0/1610848247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68780039b0 0x7f689015e170 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:11.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.105+0000 7f6895bfa640 1 -- 172.21.15.5:0/1610848247 >> 172.21.15.5:0/1610848247 conn(0x7f68900b1210 msgr2=0x7f68900b1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:11.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.105+0000 7f6895bfa640 1 -- 172.21.15.5:0/1610848247 shutdown_connections 2023-07-14T12:53:11.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.105+0000 7f6895bfa640 1 -- 172.21.15.5:0/1610848247 wait complete. 2023-07-14T12:53:11.152 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T12:53:11.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.273+0000 7f698afe9640 1 Processor -- start 2023-07-14T12:53:11.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.273+0000 7f698afe9640 1 -- start start 2023-07-14T12:53:11.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.273+0000 7f698afe9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f69840cf2e0 0x7f69840cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:11.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.273+0000 7f698afe9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69840d0920 con 0x7f69840ca790 2023-07-14T12:53:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.273+0000 7f698afe9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f698415bfd0 con 0x7f698406a540 2023-07-14T12:53:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.273+0000 7f698afe9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69840cfd10 con 0x7f69840cf2e0 2023-07-14T12:53:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.273+0000 7f6983fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f69840cf2e0 0x7f69840cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:11.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.273+0000 7f6983fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f69840cf2e0 0x7f69840cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55646/0 (socket says 172.21.15.5:55646) 2023-07-14T12:53:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.273+0000 7f6983fff640 1 -- 172.21.15.5:0/2792486461 learned_addr learned my addr 172.21.15.5:0/2792486461 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.273+0000 7f6983fff640 1 -- 172.21.15.5:0/2792486461 >> v1:172.21.15.154:6789/0 conn(0x7f698406a540 legacy=0x7f698406a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:11.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.273+0000 7f6983fff640 1 -- 172.21.15.5:0/2792486461 >> v1:172.21.15.5:6789/0 conn(0x7f69840ca790 legacy=0x7f69840cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.273+0000 7f69837fe640 1 -- 172.21.15.5:0/2792486461 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325791799 0 0) 0x7f69840d0920 con 0x7f69840ca790 2023-07-14T12:53:11.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.273+0000 7f6983fff640 1 -- 172.21.15.5:0/2792486461 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69840cfff0 con 0x7f69840cf2e0 2023-07-14T12:53:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.277+0000 7f6983fff640 1 --2- 172.21.15.5:0/2792486461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69840cf2e0 0x7f69840cf710 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f69700098a0 tx=0x7f697001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf3d254991d0c5e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.277+0000 7f69837fe640 1 -- 172.21.15.5:0/2792486461 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69700ab600 con 0x7f69840cf2e0 2023-07-14T12:53:11.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.277+0000 7f69837fe640 1 -- 172.21.15.5:0/2792486461 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69700ab760 con 0x7f69840cf2e0 2023-07-14T12:53:11.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.277+0000 7f69837fe640 1 -- 172.21.15.5:0/2792486461 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69700abaf0 con 0x7f69840cf2e0 2023-07-14T12:53:11.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.277+0000 7f698afe9640 1 -- 172.21.15.5:0/2792486461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69840cf2e0 msgr2=0x7f69840cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:11.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.277+0000 7f698afe9640 1 --2- 172.21.15.5:0/2792486461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69840cf2e0 0x7f69840cf710 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f69700098a0 tx=0x7f697001c4f0 comp rx=0 tx=0).stop 2023-07-14T12:53:11.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.277+0000 7f698afe9640 1 -- 172.21.15.5:0/2792486461 shutdown_connections 2023-07-14T12:53:11.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.277+0000 7f698afe9640 1 --2- 172.21.15.5:0/2792486461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69840cf2e0 0x7f69840cf710 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:11.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.277+0000 7f698afe9640 1 -- 172.21.15.5:0/2792486461 >> 172.21.15.5:0/2792486461 conn(0x7f6984099490 msgr2=0x7f6984089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.277+0000 7f698afe9640 1 -- 172.21.15.5:0/2792486461 shutdown_connections 2023-07-14T12:53:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.277+0000 7f698afe9640 1 -- 172.21.15.5:0/2792486461 wait complete. 2023-07-14T12:53:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.281+0000 7f698afe9640 1 Processor -- start 2023-07-14T12:53:11.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.281+0000 7f698afe9640 1 -- start start 2023-07-14T12:53:11.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.281+0000 7f698afe9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f698406a540 0x7f698414d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:11.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.281+0000 7f698afe9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69840ca790 0x7f69840b0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:11.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.281+0000 7f698afe9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69840cf2e0 0x7f69840b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:11.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.281+0000 7f698afe9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69840c4d80 con 0x7f69840cf2e0 2023-07-14T12:53:11.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.281+0000 7f698afe9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69840c5020 con 0x7f698406a540 2023-07-14T12:53:11.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.281+0000 7f698afe9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69840c5300 con 0x7f69840ca790 2023-07-14T12:53:11.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.281+0000 7f6989586640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69840cf2e0 0x7f69840b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:11.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.281+0000 7f6989586640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69840cf2e0 0x7f69840b0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55650/0 (socket says 172.21.15.5:55650) 2023-07-14T12:53:11.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.281+0000 7f6989586640 1 -- 172.21.15.5:0/3817183419 learned_addr learned my addr 172.21.15.5:0/3817183419 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:11.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.281+0000 7f6983fff640 1 --2- 172.21.15.5:0/3817183419 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69840ca790 0x7f69840b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:11.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.281+0000 7f6988d85640 1 --2- 172.21.15.5:0/3817183419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f698406a540 0x7f698414d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:11.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.281+0000 7f6989586640 1 -- 172.21.15.5:0/3817183419 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69840ca790 msgr2=0x7f69840b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:11.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.281+0000 7f6989586640 1 --2- 172.21.15.5:0/3817183419 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69840ca790 0x7f69840b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:11.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.281+0000 7f6989586640 1 -- 172.21.15.5:0/3817183419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f698406a540 msgr2=0x7f698414d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:11.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.281+0000 7f6989586640 1 --2- 172.21.15.5:0/3817183419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f698406a540 0x7f698414d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:11.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.281+0000 7f6989586640 1 -- 172.21.15.5:0/3817183419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69700094d0 con 0x7f69840cf2e0 2023-07-14T12:53:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.281+0000 7f6988d85640 1 --2- 172.21.15.5:0/3817183419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f698406a540 0x7f698414d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.281+0000 7f6989586640 1 --2- 172.21.15.5:0/3817183419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69840cf2e0 0x7f69840b0ea0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f697c002240 tx=0x7f697c00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.281+0000 7f69817fa640 1 -- 172.21.15.5:0/3817183419 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c003db0 con 0x7f69840cf2e0 2023-07-14T12:53:11.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.281+0000 7f69817fa640 1 -- 172.21.15.5:0/3817183419 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697c00ce30 con 0x7f69840cf2e0 2023-07-14T12:53:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.281+0000 7f69817fa640 1 -- 172.21.15.5:0/3817183419 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c005270 con 0x7f69840cf2e0 2023-07-14T12:53:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.281+0000 7f698afe9640 1 -- 172.21.15.5:0/3817183419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69840c55e0 con 0x7f69840cf2e0 2023-07-14T12:53:11.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.281+0000 7f698afe9640 1 -- 172.21.15.5:0/3817183419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698414df00 con 0x7f69840cf2e0 2023-07-14T12:53:11.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.281+0000 7f698afe9640 1 -- 172.21.15.5:0/3817183419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69840c5b00 con 0x7f69840cf2e0 2023-07-14T12:53:11.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.285+0000 7f69817fa640 1 -- 172.21.15.5:0/3817183419 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f697c0053d0 con 0x7f69840cf2e0 2023-07-14T12:53:11.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.285+0000 7f69817fa640 1 --2- 172.21.15.5:0/3817183419 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f6968066250 0x7f6968068700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:11.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.285+0000 7f69817fa640 1 -- 172.21.15.5:0/3817183419 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f697c083540 con 0x7f69840cf2e0 2023-07-14T12:53:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.285+0000 7f6988d85640 1 --2- 172.21.15.5:0/3817183419 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f6968066250 0x7f6968068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:11.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.285+0000 7f6988d85640 1 --2- 172.21.15.5:0/3817183419 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f6968066250 0x7f6968068700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6978000f70 tx=0x7f6978009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:11.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.289+0000 7f69817fa640 1 -- 172.21.15.5:0/3817183419 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f69840c5b00 con 0x7f69840cf2e0 2023-07-14T12:53:11.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.445+0000 7f698afe9640 1 -- 172.21.15.5:0/3817183419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f69840c5b00 con 0x7f69840cf2e0 2023-07-14T12:53:11.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.445+0000 7f69817fa640 1 -- 172.21.15.5:0/3817183419 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f697c017020 con 0x7f69840cf2e0 2023-07-14T12:53:11.475 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T12:53:11.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.449+0000 7f698afe9640 1 -- 172.21.15.5:0/3817183419 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f6968066250 msgr2=0x7f6968068700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:11.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.449+0000 7f698afe9640 1 --2- 172.21.15.5:0/3817183419 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f6968066250 0x7f6968068700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6978000f70 tx=0x7f6978009040 comp rx=0 tx=0).stop 2023-07-14T12:53:11.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.449+0000 7f698afe9640 1 -- 172.21.15.5:0/3817183419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69840cf2e0 msgr2=0x7f69840b0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:11.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.449+0000 7f698afe9640 1 --2- 172.21.15.5:0/3817183419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69840cf2e0 0x7f69840b0ea0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f697c002240 tx=0x7f697c00cbe0 comp rx=0 tx=0).stop 2023-07-14T12:53:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.449+0000 7f698afe9640 1 -- 172.21.15.5:0/3817183419 shutdown_connections 2023-07-14T12:53:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.449+0000 7f698afe9640 1 --2- 172.21.15.5:0/3817183419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69840cf2e0 0x7f69840b0ea0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:11.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.449+0000 7f698afe9640 1 --2- 172.21.15.5:0/3817183419 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69840ca790 0x7f69840b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.449+0000 7f698afe9640 1 --2- 172.21.15.5:0/3817183419 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f6968066250 0x7f6968068700 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.449+0000 7f698afe9640 1 --2- 172.21.15.5:0/3817183419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f698406a540 0x7f698414d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.449+0000 7f698afe9640 1 -- 172.21.15.5:0/3817183419 >> 172.21.15.5:0/3817183419 conn(0x7f6984099490 msgr2=0x7f6984089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.449+0000 7f698afe9640 1 -- 172.21.15.5:0/3817183419 shutdown_connections 2023-07-14T12:53:11.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.449+0000 7f698afe9640 1 -- 172.21.15.5:0/3817183419 wait complete. 2023-07-14T12:53:11.495 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:53:11.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.613+0000 7fe8f767b640 1 Processor -- start 2023-07-14T12:53:11.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.613+0000 7fe8f767b640 1 -- start start 2023-07-14T12:53:11.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.613+0000 7fe8f767b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe8f00b7c70 0x7fe8f00d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:11.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.613+0000 7fe8f767b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8f00d1850 0x7fe8f015f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:11.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.613+0000 7fe8f767b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8f00ccaf0 con 0x7fe8f00d1300 2023-07-14T12:53:11.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.613+0000 7fe8f767b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8f00d1190 con 0x7fe8f00b7c70 2023-07-14T12:53:11.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.613+0000 7fe8f767b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f0160600 con 0x7fe8f00d1850 2023-07-14T12:53:11.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.613+0000 7fe8f4c16640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8f00d1850 0x7fe8f015f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.613+0000 7fe8f4c16640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8f00d1850 0x7fe8f015f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:50776/0 (socket says 172.21.15.5:50776) 2023-07-14T12:53:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.613+0000 7fe8f4c16640 1 -- 172.21.15.5:0/2695661214 learned_addr learned my addr 172.21.15.5:0/2695661214 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.613+0000 7fe8f5417640 1 --2- 172.21.15.5:0/2695661214 >> v2:172.21.15.154:3300/0 conn(0x7fe8f00b7c70 0x7fe8f00d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.613+0000 7fe8e7fff640 1 -- 172.21.15.5:0/2695661214 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 664362916 0 0) 0x7fe8f00ccaf0 con 0x7fe8f00d1300 2023-07-14T12:53:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.613+0000 7fe8e7fff640 1 -- 172.21.15.5:0/2695661214 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8dc003530 con 0x7fe8f00d1300 2023-07-14T12:53:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.613+0000 7fe8f4c16640 1 -- 172.21.15.5:0/2695661214 >> v2:172.21.15.154:3300/0 conn(0x7fe8f00b7c70 msgr2=0x7fe8f00d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.613+0000 7fe8f4c16640 1 --2- 172.21.15.5:0/2695661214 >> v2:172.21.15.154:3300/0 conn(0x7fe8f00b7c70 0x7fe8f00d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.613+0000 7fe8f4c16640 1 -- 172.21.15.5:0/2695661214 >> v1:172.21.15.154:6789/0 conn(0x7fe8f00d1300 legacy=0x7fe8f00d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.613+0000 7fe8f4c16640 1 -- 172.21.15.5:0/2695661214 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f0160320 con 0x7fe8f00d1850 2023-07-14T12:53:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.617+0000 7fe8f4c16640 1 --2- 172.21.15.5:0/2695661214 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8f00d1850 0x7fe8f015f650 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0009870 tx=0x7fe8e001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58ff167fc24162e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.617+0000 7fe8e7fff640 1 -- 172.21.15.5:0/2695661214 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e00ab620 con 0x7fe8f00d1850 2023-07-14T12:53:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.617+0000 7fe8e7fff640 1 -- 172.21.15.5:0/2695661214 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e00ab780 con 0x7fe8f00d1850 2023-07-14T12:53:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.617+0000 7fe8e7fff640 1 -- 172.21.15.5:0/2695661214 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e00abaf0 con 0x7fe8f00d1850 2023-07-14T12:53:11.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.617+0000 7fe8f767b640 1 -- 172.21.15.5:0/2695661214 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8f00d1850 msgr2=0x7fe8f015f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.617+0000 7fe8f767b640 1 --2- 172.21.15.5:0/2695661214 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8f00d1850 0x7fe8f015f650 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0009870 tx=0x7fe8e001c510 comp rx=0 tx=0).stop 2023-07-14T12:53:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.617+0000 7fe8f767b640 1 -- 172.21.15.5:0/2695661214 shutdown_connections 2023-07-14T12:53:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.617+0000 7fe8f767b640 1 --2- 172.21.15.5:0/2695661214 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8f00d1850 0x7fe8f015f650 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:11.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.617+0000 7fe8f767b640 1 --2- 172.21.15.5:0/2695661214 >> v2:172.21.15.154:3300/0 conn(0x7fe8f00b7c70 0x7fe8f00d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.617+0000 7fe8f767b640 1 -- 172.21.15.5:0/2695661214 >> 172.21.15.5:0/2695661214 conn(0x7fe8f00650b0 msgr2=0x7fe8f00654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.617+0000 7fe8f767b640 1 -- 172.21.15.5:0/2695661214 shutdown_connections 2023-07-14T12:53:11.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.617+0000 7fe8f767b640 1 -- 172.21.15.5:0/2695661214 wait complete. 2023-07-14T12:53:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.621+0000 7fe8f767b640 1 Processor -- start 2023-07-14T12:53:11.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.621+0000 7fe8f767b640 1 -- start start 2023-07-14T12:53:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.621+0000 7fe8f767b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8f00b7c70 0x7fe8f01f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.621+0000 7fe8f767b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8f00d1300 0x7fe8f01530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.621+0000 7fe8f767b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8f00d1850 0x7fe8f0150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.621+0000 7fe8f767b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f015b840 con 0x7fe8f00d1300 2023-07-14T12:53:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.621+0000 7fe8f767b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f0151490 con 0x7fe8f00b7c70 2023-07-14T12:53:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.621+0000 7fe8f767b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f015acc0 con 0x7fe8f00d1850 2023-07-14T12:53:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.621+0000 7fe8f4c16640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8f00d1300 0x7fe8f01530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:11.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.621+0000 7fe8f4c16640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8f00d1300 0x7fe8f01530a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55660/0 (socket says 172.21.15.5:55660) 2023-07-14T12:53:11.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.621+0000 7fe8f4c16640 1 -- 172.21.15.5:0/3863418825 learned_addr learned my addr 172.21.15.5:0/3863418825 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:11.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.621+0000 7fe8f5417640 1 --2- 172.21.15.5:0/3863418825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8f00b7c70 0x7fe8f01f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:11.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.621+0000 7fe8f5c18640 1 --2- 172.21.15.5:0/3863418825 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8f00d1850 0x7fe8f0150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:11.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.621+0000 7fe8f4c16640 1 -- 172.21.15.5:0/3863418825 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8f00d1850 msgr2=0x7fe8f0150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:11.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.621+0000 7fe8f4c16640 1 --2- 172.21.15.5:0/3863418825 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8f00d1850 0x7fe8f0150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:11.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.621+0000 7fe8f4c16640 1 -- 172.21.15.5:0/3863418825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8f00b7c70 msgr2=0x7fe8f01f4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:11.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.621+0000 7fe8f4c16640 1 --2- 172.21.15.5:0/3863418825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8f00b7c70 0x7fe8f01f4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:11.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.621+0000 7fe8f4c16640 1 -- 172.21.15.5:0/3863418825 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e00094d0 con 0x7fe8f00d1300 2023-07-14T12:53:11.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.621+0000 7fe8f4c16640 1 --2- 172.21.15.5:0/3863418825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8f00d1300 0x7fe8f01530a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe8e001abc0 tx=0x7fe8e00192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:11.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.621+0000 7fe8e5ffb640 1 -- 172.21.15.5:0/3863418825 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e00abd00 con 0x7fe8f00d1300 2023-07-14T12:53:11.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.621+0000 7fe8e5ffb640 1 -- 172.21.15.5:0/3863418825 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e00abe60 con 0x7fe8f00d1300 2023-07-14T12:53:11.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.621+0000 7fe8e5ffb640 1 -- 172.21.15.5:0/3863418825 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0004220 con 0x7fe8f00d1300 2023-07-14T12:53:11.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.621+0000 7fe8f767b640 1 -- 172.21.15.5:0/3863418825 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f015afa0 con 0x7fe8f00d1300 2023-07-14T12:53:11.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.621+0000 7fe8f767b640 1 -- 172.21.15.5:0/3863418825 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f015b560 con 0x7fe8f00d1300 2023-07-14T12:53:11.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.625+0000 7fe8f767b640 1 -- 172.21.15.5:0/3863418825 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8f00cf6b0 con 0x7fe8f00d1300 2023-07-14T12:53:11.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.625+0000 7fe8e5ffb640 1 -- 172.21.15.5:0/3863418825 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe8e0004380 con 0x7fe8f00d1300 2023-07-14T12:53:11.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.625+0000 7fe8e5ffb640 1 --2- 172.21.15.5:0/3863418825 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe8d4066280 0x7fe8d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.625+0000 7fe8e5ffb640 1 -- 172.21.15.5:0/3863418825 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe8e011e760 con 0x7fe8f00d1300 2023-07-14T12:53:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.625+0000 7fe8f5417640 1 --2- 172.21.15.5:0/3863418825 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe8d4066280 0x7fe8d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.625+0000 7fe8f5417640 1 --2- 172.21.15.5:0/3863418825 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe8d4066280 0x7fe8d4068730 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec009ac0 tx=0x7fe8ec009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:11.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.629+0000 7fe8e5ffb640 1 -- 172.21.15.5:0/3863418825 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe8e00ebbf0 con 0x7fe8f00d1300 2023-07-14T12:53:11.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.785+0000 7fe8f767b640 1 -- 172.21.15.5:0/3863418825 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8f00678d0 con 0x7fe8f00d1300 2023-07-14T12:53:11.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.785+0000 7fe8e5ffb640 1 -- 172.21.15.5:0/3863418825 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18231 (secure 0 0 0) 0x7fe8e00ef210 con 0x7fe8f00d1300 2023-07-14T12:53:11.815 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:11.815 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":23,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:52:48.091483+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:52:44.223082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T12:52:45.469396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:53:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.789+0000 7fe8f767b640 1 -- 172.21.15.5:0/3863418825 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe8d4066280 msgr2=0x7fe8d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.789+0000 7fe8f767b640 1 --2- 172.21.15.5:0/3863418825 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe8d4066280 0x7fe8d4068730 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec009ac0 tx=0x7fe8ec009190 comp rx=0 tx=0).stop 2023-07-14T12:53:11.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.789+0000 7fe8f767b640 1 -- 172.21.15.5:0/3863418825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8f00d1300 msgr2=0x7fe8f01530a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:11.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.789+0000 7fe8f767b640 1 --2- 172.21.15.5:0/3863418825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8f00d1300 0x7fe8f01530a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe8e001abc0 tx=0x7fe8e00192b0 comp rx=0 tx=0).stop 2023-07-14T12:53:11.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.789+0000 7fe8f767b640 1 -- 172.21.15.5:0/3863418825 shutdown_connections 2023-07-14T12:53:11.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.789+0000 7fe8f767b640 1 --2- 172.21.15.5:0/3863418825 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8f00d1850 0x7fe8f0150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:11.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.789+0000 7fe8f767b640 1 --2- 172.21.15.5:0/3863418825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8f00d1300 0x7fe8f01530a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.789+0000 7fe8f767b640 1 --2- 172.21.15.5:0/3863418825 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe8d4066280 0x7fe8d4068730 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.789+0000 7fe8f767b640 1 --2- 172.21.15.5:0/3863418825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8f00b7c70 0x7fe8f01f4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.789+0000 7fe8f767b640 1 -- 172.21.15.5:0/3863418825 >> 172.21.15.5:0/3863418825 conn(0x7fe8f00650b0 msgr2=0x7fe8f00d2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.789+0000 7fe8f767b640 1 -- 172.21.15.5:0/3863418825 shutdown_connections 2023-07-14T12:53:11.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.789+0000 7fe8f767b640 1 -- 172.21.15.5:0/3863418825 wait complete. 2023-07-14T12:53:11.836 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T12:52:44.223082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T12:52:45.469396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T12:53:11.837 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T12:53:11.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.961+0000 7ff5ece0b640 1 Processor -- start 2023-07-14T12:53:11.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.961+0000 7ff5ece0b640 1 -- start start 2023-07-14T12:53:11.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.965+0000 7ff5ece0b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff5e80aeb40 0x7ff5e815cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:11.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.965+0000 7ff5ece0b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff5e80aef10 0x7ff5e8158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:11.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.965+0000 7ff5ece0b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e81532b0 con 0x7ff5e8159270 2023-07-14T12:53:11.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.965+0000 7ff5ece0b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e80ca6f0 con 0x7ff5e80aef10 2023-07-14T12:53:11.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.965+0000 7ff5ece0b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e81599d0 con 0x7ff5e80aeb40 2023-07-14T12:53:11.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.965+0000 7ff5dffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff5e80aef10 0x7ff5e8158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:11.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.965+0000 7ff5e6d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff5e8159270 0x7ff5e80c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59388/0 (socket says 172.21.15.5:59388) 2023-07-14T12:53:11.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.965+0000 7ff5dffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff5e80aef10 0x7ff5e8158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55674/0 (socket says 172.21.15.5:55674) 2023-07-14T12:53:11.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.965+0000 7ff5e6d9d640 1 -- 172.21.15.5:0/4260766499 learned_addr learned my addr 172.21.15.5:0/4260766499 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.965+0000 7ff5e659c640 1 --2- 172.21.15.5:0/4260766499 >> v2:172.21.15.154:3300/0 conn(0x7ff5e80aeb40 0x7ff5e815cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.965+0000 7ff5dffff640 1 -- 172.21.15.5:0/4260766499 >> v2:172.21.15.154:3300/0 conn(0x7ff5e80aeb40 msgr2=0x7ff5e815cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.965+0000 7ff5dffff640 1 --2- 172.21.15.5:0/4260766499 >> v2:172.21.15.154:3300/0 conn(0x7ff5e80aeb40 0x7ff5e815cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.965+0000 7ff5dffff640 1 -- 172.21.15.5:0/4260766499 >> v1:172.21.15.5:6789/0 conn(0x7ff5e8159270 legacy=0x7ff5e80c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.965+0000 7ff5e5d9b640 1 -- 172.21.15.5:0/4260766499 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1853860287 0 0) 0x7ff5e81532b0 con 0x7ff5e8159270 2023-07-14T12:53:11.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.965+0000 7ff5dffff640 1 -- 172.21.15.5:0/4260766499 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e8159cb0 con 0x7ff5e80aef10 2023-07-14T12:53:11.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.965+0000 7ff5dffff640 1 --2- 172.21.15.5:0/4260766499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e80aef10 0x7ff5e8158d30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8071ad0 tx=0x7ff5d001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d35202520f0f64 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:11.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.969+0000 7ff5e5d9b640 1 -- 172.21.15.5:0/4260766499 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d00ac600 con 0x7ff5e80aef10 2023-07-14T12:53:11.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.969+0000 7ff5e5d9b640 1 -- 172.21.15.5:0/4260766499 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d00a8050 con 0x7ff5e80aef10 2023-07-14T12:53:11.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.969+0000 7ff5e5d9b640 1 -- 172.21.15.5:0/4260766499 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d00ac980 con 0x7ff5e80aef10 2023-07-14T12:53:11.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.969+0000 7ff5ece0b640 1 -- 172.21.15.5:0/4260766499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e80aef10 msgr2=0x7ff5e8158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:11.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.969+0000 7ff5ece0b640 1 --2- 172.21.15.5:0/4260766499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e80aef10 0x7ff5e8158d30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8071ad0 tx=0x7ff5d001c3a0 comp rx=0 tx=0).stop 2023-07-14T12:53:11.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.969+0000 7ff5ece0b640 1 -- 172.21.15.5:0/4260766499 shutdown_connections 2023-07-14T12:53:11.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.969+0000 7ff5ece0b640 1 --2- 172.21.15.5:0/4260766499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e80aef10 0x7ff5e8158d30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:11.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.969+0000 7ff5ece0b640 1 --2- 172.21.15.5:0/4260766499 >> v2:172.21.15.154:3300/0 conn(0x7ff5e80aeb40 0x7ff5e815cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:11.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.969+0000 7ff5ece0b640 1 -- 172.21.15.5:0/4260766499 >> 172.21.15.5:0/4260766499 conn(0x7ff5e80cde90 msgr2=0x7ff5e80ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:11.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.969+0000 7ff5ece0b640 1 -- 172.21.15.5:0/4260766499 shutdown_connections 2023-07-14T12:53:11.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.969+0000 7ff5ece0b640 1 -- 172.21.15.5:0/4260766499 wait complete. 2023-07-14T12:53:11.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.969+0000 7ff5ece0b640 1 Processor -- start 2023-07-14T12:53:11.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.969+0000 7ff5ece0b640 1 -- start start 2023-07-14T12:53:11.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.969+0000 7ff5ece0b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e80aeb40 0x7ff5e814fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:11.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.969+0000 7ff5ece0b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5e80aef10 0x7ff5e81509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:12.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.969+0000 7ff5ece0b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5e8159270 0x7ff5e8150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:12.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.969+0000 7ff5ece0b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e8153970 con 0x7ff5e80aeb40 2023-07-14T12:53:12.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.969+0000 7ff5ece0b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e8070110 con 0x7ff5e8159270 2023-07-14T12:53:12.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.969+0000 7ff5ece0b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e80703f0 con 0x7ff5e80aef10 2023-07-14T12:53:12.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.969+0000 7ff5e659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e80aeb40 0x7ff5e814fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:12.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.969+0000 7ff5e659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e80aeb40 0x7ff5e814fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55688/0 (socket says 172.21.15.5:55688) 2023-07-14T12:53:12.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.969+0000 7ff5e659c640 1 -- 172.21.15.5:0/2116262392 learned_addr learned my addr 172.21.15.5:0/2116262392 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:12.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.973+0000 7ff5e659c640 1 -- 172.21.15.5:0/2116262392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5e80aef10 msgr2=0x7ff5e81509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:12.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.973+0000 7ff5e659c640 1 --2- 172.21.15.5:0/2116262392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5e80aef10 0x7ff5e81509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:12.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.973+0000 7ff5e659c640 1 -- 172.21.15.5:0/2116262392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5e8159270 msgr2=0x7ff5e8150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:12.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.973+0000 7ff5e6d9d640 1 --2- 172.21.15.5:0/2116262392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5e8159270 0x7ff5e8150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:12.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.973+0000 7ff5e659c640 1 --2- 172.21.15.5:0/2116262392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5e8159270 0x7ff5e8150f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:12.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.973+0000 7ff5e659c640 1 -- 172.21.15.5:0/2116262392 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d0009420 con 0x7ff5e80aeb40 2023-07-14T12:53:12.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.973+0000 7ff5e6d9d640 1 --2- 172.21.15.5:0/2116262392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5e8159270 0x7ff5e8150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:12.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.973+0000 7ff5e659c640 1 --2- 172.21.15.5:0/2116262392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e80aeb40 0x7ff5e814fc30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800e930 tx=0x7ff5d800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:12.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.973+0000 7ff5deffd640 1 -- 172.21.15.5:0/2116262392 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8009690 con 0x7ff5e80aeb40 2023-07-14T12:53:12.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.973+0000 7ff5deffd640 1 -- 172.21.15.5:0/2116262392 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d800ca00 con 0x7ff5e80aeb40 2023-07-14T12:53:12.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.973+0000 7ff5deffd640 1 -- 172.21.15.5:0/2116262392 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d800cd70 con 0x7ff5e80aeb40 2023-07-14T12:53:12.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.973+0000 7ff5ece0b640 1 -- 172.21.15.5:0/2116262392 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e80706d0 con 0x7ff5e80aeb40 2023-07-14T12:53:12.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.973+0000 7ff5ece0b640 1 -- 172.21.15.5:0/2116262392 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e8150170 con 0x7ff5e80aeb40 2023-07-14T12:53:12.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.973+0000 7ff5ece0b640 1 -- 172.21.15.5:0/2116262392 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e80ae490 con 0x7ff5e80aeb40 2023-07-14T12:53:12.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.973+0000 7ff5deffd640 1 -- 172.21.15.5:0/2116262392 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff5d8013470 con 0x7ff5e80aeb40 2023-07-14T12:53:12.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.973+0000 7ff5deffd640 1 --2- 172.21.15.5:0/2116262392 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff5c8066280 0x7ff5c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:12.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.973+0000 7ff5deffd640 1 -- 172.21.15.5:0/2116262392 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff5d8083ef0 con 0x7ff5e80aeb40 2023-07-14T12:53:12.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.977+0000 7ff5dffff640 1 --2- 172.21.15.5:0/2116262392 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff5c8066280 0x7ff5c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:12.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.977+0000 7ff5dffff640 1 --2- 172.21.15.5:0/2116262392 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff5c8066280 0x7ff5c8068730 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00ae000 tx=0x7ff5d0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:12.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:11.977+0000 7ff5deffd640 1 -- 172.21.15.5:0/2116262392 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff5d80514c0 con 0x7ff5e80aeb40 2023-07-14T12:53:12.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.133+0000 7ff5ece0b640 1 -- 172.21.15.5:0/2116262392 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff5e8153be0 con 0x7ff5e80aeb40 2023-07-14T12:53:12.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.133+0000 7ff5deffd640 1 -- 172.21.15.5:0/2116262392 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff5d80170a0 con 0x7ff5e80aeb40 2023-07-14T12:53:12.162 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T12:53:12.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.137+0000 7ff5ece0b640 1 -- 172.21.15.5:0/2116262392 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff5c8066280 msgr2=0x7ff5c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.137+0000 7ff5ece0b640 1 --2- 172.21.15.5:0/2116262392 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff5c8066280 0x7ff5c8068730 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00ae000 tx=0x7ff5d0008040 comp rx=0 tx=0).stop 2023-07-14T12:53:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.137+0000 7ff5ece0b640 1 -- 172.21.15.5:0/2116262392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e80aeb40 msgr2=0x7ff5e814fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.137+0000 7ff5ece0b640 1 --2- 172.21.15.5:0/2116262392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e80aeb40 0x7ff5e814fc30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800e930 tx=0x7ff5d800edf0 comp rx=0 tx=0).stop 2023-07-14T12:53:12.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.137+0000 7ff5ece0b640 1 -- 172.21.15.5:0/2116262392 shutdown_connections 2023-07-14T12:53:12.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.137+0000 7ff5ece0b640 1 --2- 172.21.15.5:0/2116262392 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff5c8066280 0x7ff5c8068730 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:12.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.137+0000 7ff5ece0b640 1 --2- 172.21.15.5:0/2116262392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5e8159270 0x7ff5e8150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:12.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.137+0000 7ff5ece0b640 1 --2- 172.21.15.5:0/2116262392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5e80aef10 0x7ff5e81509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:12.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.137+0000 7ff5ece0b640 1 --2- 172.21.15.5:0/2116262392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e80aeb40 0x7ff5e814fc30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:12.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.137+0000 7ff5ece0b640 1 -- 172.21.15.5:0/2116262392 >> 172.21.15.5:0/2116262392 conn(0x7ff5e80cde90 msgr2=0x7ff5e80ad8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:12.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.137+0000 7ff5ece0b640 1 -- 172.21.15.5:0/2116262392 shutdown_connections 2023-07-14T12:53:12.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.137+0000 7ff5ece0b640 1 -- 172.21.15.5:0/2116262392 wait complete. 2023-07-14T12:53:12.183 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T12:53:12.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.305+0000 7fc7baa48640 1 Processor -- start 2023-07-14T12:53:12.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.305+0000 7fc7baa48640 1 -- start start 2023-07-14T12:53:12.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.305+0000 7fc7baa48640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc7b415cef0 0x7fc7b4158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:12.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.305+0000 7fc7baa48640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc7b4159270 0x7fc7b40c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:12.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.305+0000 7fc7baa48640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b41532b0 con 0x7fc7b40aeb40 2023-07-14T12:53:12.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.305+0000 7fc7baa48640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b415d360 con 0x7fc7b415cef0 2023-07-14T12:53:12.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.305+0000 7fc7baa48640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b40ca6f0 con 0x7fc7b4159270 2023-07-14T12:53:12.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.305+0000 7fc7b37fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc7b415cef0 0x7fc7b4158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.305+0000 7fc7b37fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc7b415cef0 0x7fc7b4158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55704/0 (socket says 172.21.15.5:55704) 2023-07-14T12:53:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.305+0000 7fc7b37fe640 1 -- 172.21.15.5:0/523666147 learned_addr learned my addr 172.21.15.5:0/523666147 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.305+0000 7fc7b3fff640 1 --1- 172.21.15.5:0/523666147 >> v1:172.21.15.5:6789/0 conn(0x7fc7b40aeb40 0x7fc7b40aef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59402/0 (socket says 172.21.15.5:59402) 2023-07-14T12:53:12.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.305+0000 7fc7b37fe640 1 -- 172.21.15.5:0/523666147 >> v2:172.21.15.154:3300/0 conn(0x7fc7b4159270 msgr2=0x7fc7b40c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:12.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.305+0000 7fc7b37fe640 1 --2- 172.21.15.5:0/523666147 >> v2:172.21.15.154:3300/0 conn(0x7fc7b4159270 0x7fc7b40c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:12.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.305+0000 7fc7b37fe640 1 -- 172.21.15.5:0/523666147 >> v1:172.21.15.5:6789/0 conn(0x7fc7b40aeb40 legacy=0x7fc7b40aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:12.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.305+0000 7fc7b37fe640 1 -- 172.21.15.5:0/523666147 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b41599d0 con 0x7fc7b415cef0 2023-07-14T12:53:12.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.309+0000 7fc7b37fe640 1 --2- 172.21.15.5:0/523666147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7b415cef0 0x7fc7b4158d30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40c8690 tx=0x7fc7a801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff065adbf88e47e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:12.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.309+0000 7fc7b2ffd640 1 -- 172.21.15.5:0/523666147 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a80aa430 con 0x7fc7b415cef0 2023-07-14T12:53:12.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.309+0000 7fc7b2ffd640 1 -- 172.21.15.5:0/523666147 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a80aa590 con 0x7fc7b415cef0 2023-07-14T12:53:12.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.309+0000 7fc7b2ffd640 1 -- 172.21.15.5:0/523666147 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a80aa920 con 0x7fc7b415cef0 2023-07-14T12:53:12.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.309+0000 7fc7baa48640 1 -- 172.21.15.5:0/523666147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7b415cef0 msgr2=0x7fc7b4158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:12.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.309+0000 7fc7baa48640 1 --2- 172.21.15.5:0/523666147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7b415cef0 0x7fc7b4158d30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40c8690 tx=0x7fc7a801c4d0 comp rx=0 tx=0).stop 2023-07-14T12:53:12.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.309+0000 7fc7baa48640 1 -- 172.21.15.5:0/523666147 shutdown_connections 2023-07-14T12:53:12.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.309+0000 7fc7baa48640 1 --2- 172.21.15.5:0/523666147 >> v2:172.21.15.154:3300/0 conn(0x7fc7b4159270 0x7fc7b40c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:12.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.309+0000 7fc7baa48640 1 --2- 172.21.15.5:0/523666147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7b415cef0 0x7fc7b4158d30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:12.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.309+0000 7fc7baa48640 1 -- 172.21.15.5:0/523666147 >> 172.21.15.5:0/523666147 conn(0x7fc7b40cde90 msgr2=0x7fc7b40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:12.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.309+0000 7fc7baa48640 1 -- 172.21.15.5:0/523666147 shutdown_connections 2023-07-14T12:53:12.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.309+0000 7fc7baa48640 1 -- 172.21.15.5:0/523666147 wait complete. 2023-07-14T12:53:12.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.313+0000 7fc7baa48640 1 Processor -- start 2023-07-14T12:53:12.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.313+0000 7fc7baa48640 1 -- start start 2023-07-14T12:53:12.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.313+0000 7fc7baa48640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7b40aeb40 0x7fc7b415afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:12.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.313+0000 7fc7baa48640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7b4159270 0x7fc7b41569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:12.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.313+0000 7fc7baa48640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7b415cef0 0x7fc7b4146950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:12.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.313+0000 7fc7baa48640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b41571f0 con 0x7fc7b4159270 2023-07-14T12:53:12.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.313+0000 7fc7baa48640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b41574d0 con 0x7fc7b40aeb40 2023-07-14T12:53:12.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.313+0000 7fc7baa48640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b41577b0 con 0x7fc7b415cef0 2023-07-14T12:53:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.313+0000 7fc7b37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7b4159270 0x7fc7b41569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.313+0000 7fc7b37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7b4159270 0x7fc7b41569a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55718/0 (socket says 172.21.15.5:55718) 2023-07-14T12:53:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.313+0000 7fc7b37fe640 1 -- 172.21.15.5:0/2720564327 learned_addr learned my addr 172.21.15.5:0/2720564327 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.313+0000 7fc7b3fff640 1 --2- 172.21.15.5:0/2720564327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7b40aeb40 0x7fc7b415afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.313+0000 7fc7b8fe5640 1 --2- 172.21.15.5:0/2720564327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7b415cef0 0x7fc7b4146950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.313+0000 7fc7b37fe640 1 -- 172.21.15.5:0/2720564327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7b415cef0 msgr2=0x7fc7b4146950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.313+0000 7fc7b37fe640 1 --2- 172.21.15.5:0/2720564327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7b415cef0 0x7fc7b4146950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:12.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.313+0000 7fc7b37fe640 1 -- 172.21.15.5:0/2720564327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7b40aeb40 msgr2=0x7fc7b415afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.313+0000 7fc7b37fe640 1 --2- 172.21.15.5:0/2720564327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7b40aeb40 0x7fc7b415afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.313+0000 7fc7b37fe640 1 -- 172.21.15.5:0/2720564327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a80094d0 con 0x7fc7b4159270 2023-07-14T12:53:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.313+0000 7fc7b37fe640 1 --2- 172.21.15.5:0/2720564327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7b4159270 0x7fc7b41569a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc7a80190e0 tx=0x7fc7a801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:12.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.313+0000 7fc7b0ff9640 1 -- 172.21.15.5:0/2720564327 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a80b3800 con 0x7fc7b4159270 2023-07-14T12:53:12.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.313+0000 7fc7b0ff9640 1 -- 172.21.15.5:0/2720564327 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a80b3960 con 0x7fc7b4159270 2023-07-14T12:53:12.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.313+0000 7fc7b0ff9640 1 -- 172.21.15.5:0/2720564327 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a80b3cf0 con 0x7fc7b4159270 2023-07-14T12:53:12.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.313+0000 7fc7baa48640 1 -- 172.21.15.5:0/2720564327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b4157a90 con 0x7fc7b4159270 2023-07-14T12:53:12.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.313+0000 7fc7baa48640 1 -- 172.21.15.5:0/2720564327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b4156ee0 con 0x7fc7b4159270 2023-07-14T12:53:12.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.313+0000 7fc7baa48640 1 -- 172.21.15.5:0/2720564327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b40678d0 con 0x7fc7b4159270 2023-07-14T12:53:12.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.317+0000 7fc7b0ff9640 1 -- 172.21.15.5:0/2720564327 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc7b40c9610 con 0x7fc7b4159270 2023-07-14T12:53:12.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.317+0000 7fc7b0ff9640 1 --2- 172.21.15.5:0/2720564327 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc7a00662b0 0x7fc7a0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:12.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.317+0000 7fc7b0ff9640 1 -- 172.21.15.5:0/2720564327 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc7a811e000 con 0x7fc7b4159270 2023-07-14T12:53:12.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.317+0000 7fc7b3fff640 1 --2- 172.21.15.5:0/2720564327 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc7a00662b0 0x7fc7a0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:12.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.317+0000 7fc7b3fff640 1 --2- 172.21.15.5:0/2720564327 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc7a00662b0 0x7fc7a0068760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4000f70 tx=0x7fc7a4007c90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:12.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.321+0000 7fc7b0ff9640 1 -- 172.21.15.5:0/2720564327 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc7a80eb530 con 0x7fc7b4159270 2023-07-14T12:53:12.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.473+0000 7fc7baa48640 1 -- 172.21.15.5:0/2720564327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc7b4157f40 con 0x7fc7b4159270 2023-07-14T12:53:12.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.477+0000 7fc7b0ff9640 1 -- 172.21.15.5:0/2720564327 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc7a80c30a0 con 0x7fc7b4159270 2023-07-14T12:53:12.503 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T12:53:12.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.477+0000 7fc7baa48640 1 -- 172.21.15.5:0/2720564327 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc7a00662b0 msgr2=0x7fc7a0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:12.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.477+0000 7fc7baa48640 1 --2- 172.21.15.5:0/2720564327 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc7a00662b0 0x7fc7a0068760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4000f70 tx=0x7fc7a4007c90 comp rx=0 tx=0).stop 2023-07-14T12:53:12.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.477+0000 7fc7baa48640 1 -- 172.21.15.5:0/2720564327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7b4159270 msgr2=0x7fc7b41569a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:12.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.477+0000 7fc7baa48640 1 --2- 172.21.15.5:0/2720564327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7b4159270 0x7fc7b41569a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc7a80190e0 tx=0x7fc7a801ad10 comp rx=0 tx=0).stop 2023-07-14T12:53:12.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.477+0000 7fc7baa48640 1 -- 172.21.15.5:0/2720564327 shutdown_connections 2023-07-14T12:53:12.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.477+0000 7fc7baa48640 1 --2- 172.21.15.5:0/2720564327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7b415cef0 0x7fc7b4146950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:12.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.477+0000 7fc7baa48640 1 --2- 172.21.15.5:0/2720564327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7b4159270 0x7fc7b41569a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:12.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.477+0000 7fc7baa48640 1 --2- 172.21.15.5:0/2720564327 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc7a00662b0 0x7fc7a0068760 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:12.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.477+0000 7fc7baa48640 1 --2- 172.21.15.5:0/2720564327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7b40aeb40 0x7fc7b415afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:12.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.477+0000 7fc7baa48640 1 -- 172.21.15.5:0/2720564327 >> 172.21.15.5:0/2720564327 conn(0x7fc7b40cde90 msgr2=0x7fc7b40cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:12.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.477+0000 7fc7baa48640 1 -- 172.21.15.5:0/2720564327 shutdown_connections 2023-07-14T12:53:12.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.477+0000 7fc7baa48640 1 -- 172.21.15.5:0/2720564327 wait complete. 2023-07-14T12:53:12.526 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T12:53:12.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.649+0000 7f3dbe5fa640 1 Processor -- start 2023-07-14T12:53:12.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.649+0000 7f3dbe5fa640 1 -- start start 2023-07-14T12:53:12.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.649+0000 7f3dbe5fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3db80aeb40 0x7f3db815cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:12.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.649+0000 7f3dbe5fa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db81532b0 con 0x7f3db8159440 2023-07-14T12:53:12.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.649+0000 7f3dbe5fa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db80ca6f0 con 0x7f3db80aef10 2023-07-14T12:53:12.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.649+0000 7f3dbe5fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db81599d0 con 0x7f3db80aeb40 2023-07-14T12:53:12.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3dbcb97640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3db8159440 0x7f3db80c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59416/0 (socket says 172.21.15.5:59416) 2023-07-14T12:53:12.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3dbcb97640 1 -- 172.21.15.5:0/468763142 learned_addr learned my addr 172.21.15.5:0/468763142 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:12.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3db7fff640 1 --2- 172.21.15.5:0/468763142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3db80aeb40 0x7f3db815cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:12.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3db6ffd640 1 -- 172.21.15.5:0/468763142 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587886086 0 0) 0x7f3db81532b0 con 0x7f3db8159440 2023-07-14T12:53:12.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3db6ffd640 1 -- 172.21.15.5:0/468763142 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3da0005740 con 0x7f3db8159440 2023-07-14T12:53:12.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3db6ffd640 1 -- 172.21.15.5:0/468763142 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187097153 0 0) 0x7f3db80ca6f0 con 0x7f3db80aef10 2023-07-14T12:53:12.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3db6ffd640 1 -- 172.21.15.5:0/468763142 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3db81532b0 con 0x7f3db80aef10 2023-07-14T12:53:12.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3db6ffd640 1 -- 172.21.15.5:0/468763142 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3032128658 0 0) 0x7f3da0005740 con 0x7f3db8159440 2023-07-14T12:53:12.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3db6ffd640 1 -- 172.21.15.5:0/468763142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3db80aeb40 msgr2=0x7f3db815cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:12.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3db6ffd640 1 --2- 172.21.15.5:0/468763142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3db80aeb40 0x7f3db815cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:12.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3db6ffd640 1 -- 172.21.15.5:0/468763142 >> v1:172.21.15.154:6789/0 conn(0x7f3db80aef10 legacy=0x7f3db8158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:12.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3db6ffd640 1 -- 172.21.15.5:0/468763142 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db8159cb0 con 0x7f3db8159440 2023-07-14T12:53:12.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3db6ffd640 1 -- 172.21.15.5:0/468763142 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f3db0001a00 con 0x7f3db8159440 2023-07-14T12:53:12.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3db6ffd640 1 -- 172.21.15.5:0/468763142 >> v1:172.21.15.5:6789/0 conn(0x7f3db8159440 legacy=0x7f3db80c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:12.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3db6ffd640 1 --2- 172.21.15.5:0/468763142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3db80aeb40 0x7f3da0005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:12.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3db6ffd640 1 --2- 172.21.15.5:0/468763142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3da00062b0 0x7f3da00069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:12.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3db6ffd640 1 --2- 172.21.15.5:0/468763142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3da0006f20 0x7f3da0007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:12.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3db6ffd640 1 -- 172.21.15.5:0/468763142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db81599d0 con 0x7f3da00062b0 2023-07-14T12:53:12.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3db6ffd640 1 -- 172.21.15.5:0/468763142 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da000dd30 con 0x7f3da0006f20 2023-07-14T12:53:12.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3db6ffd640 1 -- 172.21.15.5:0/468763142 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da000dec0 con 0x7f3db80aeb40 2023-07-14T12:53:12.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3db77fe640 1 --2- 172.21.15.5:0/468763142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3da00062b0 0x7f3da00069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:12.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3dbcb97640 1 --2- 172.21.15.5:0/468763142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3da0006f20 0x7f3da0007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:12.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3db7fff640 1 --2- 172.21.15.5:0/468763142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3db80aeb40 0x7f3da0005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:12.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3db77fe640 1 -- 172.21.15.5:0/468763142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3db80aeb40 msgr2=0x7f3da0005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:12.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3db77fe640 1 --2- 172.21.15.5:0/468763142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3db80aeb40 0x7f3da0005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:12.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3db77fe640 1 -- 172.21.15.5:0/468763142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3da0006f20 msgr2=0x7f3da0007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:12.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3db77fe640 1 --2- 172.21.15.5:0/468763142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3da0006f20 0x7f3da0007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:12.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3db77fe640 1 -- 172.21.15.5:0/468763142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da0005740 con 0x7f3da00062b0 2023-07-14T12:53:12.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.653+0000 7f3db7fff640 1 --2- 172.21.15.5:0/468763142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3db80aeb40 0x7f3da0005d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:12.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.657+0000 7f3db77fe640 1 --2- 172.21.15.5:0/468763142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3da00062b0 0x7f3da00069e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0018f0 tx=0x7f3dac01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16b89ff10b6c803 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:12.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.657+0000 7f3db6ffd640 1 -- 172.21.15.5:0/468763142 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac0052d0 con 0x7f3da00062b0 2023-07-14T12:53:12.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.657+0000 7f3db6ffd640 1 -- 172.21.15.5:0/468763142 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dac0a7050 con 0x7f3da00062b0 2023-07-14T12:53:12.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.657+0000 7f3db6ffd640 1 -- 172.21.15.5:0/468763142 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac003600 con 0x7f3da00062b0 2023-07-14T12:53:12.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.657+0000 7f3dbe5fa640 1 -- 172.21.15.5:0/468763142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3da00062b0 msgr2=0x7f3da00069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:12.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.657+0000 7f3dbe5fa640 1 --2- 172.21.15.5:0/468763142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3da00062b0 0x7f3da00069e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0018f0 tx=0x7f3dac01c510 comp rx=0 tx=0).stop 2023-07-14T12:53:12.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.657+0000 7f3dbcb97640 1 -- 172.21.15.5:0/468763142 reap_dead start 2023-07-14T12:53:12.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.657+0000 7f3dbe5fa640 1 -- 172.21.15.5:0/468763142 shutdown_connections 2023-07-14T12:53:12.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.657+0000 7f3dbe5fa640 1 -- 172.21.15.5:0/468763142 >> 172.21.15.5:0/468763142 conn(0x7f3db80cde90 msgr2=0x7f3db80ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:12.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.657+0000 7f3dbe5fa640 1 -- 172.21.15.5:0/468763142 shutdown_connections 2023-07-14T12:53:12.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.657+0000 7f3dbe5fa640 1 -- 172.21.15.5:0/468763142 wait complete. 2023-07-14T12:53:12.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.657+0000 7f3dbe5fa640 1 Processor -- start 2023-07-14T12:53:12.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.657+0000 7f3dbe5fa640 1 -- start start 2023-07-14T12:53:12.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.661+0000 7f3dbe5fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3da00062b0 0x7f3db80c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:12.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.661+0000 7f3dbe5fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3db806c900 0x7f3db81499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:12.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.661+0000 7f3dbe5fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3db80c6690 0x7f3db80c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.661+0000 7f3dbe5fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db80c7e00 con 0x7f3db806c900 2023-07-14T12:53:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.661+0000 7f3dbe5fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db80c6200 con 0x7f3db80c6690 2023-07-14T12:53:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.661+0000 7f3dbe5fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db80c55f0 con 0x7f3da00062b0 2023-07-14T12:53:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.661+0000 7f3db77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3db806c900 0x7f3db81499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.661+0000 7f3db77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3db806c900 0x7f3db81499b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55740/0 (socket says 172.21.15.5:55740) 2023-07-14T12:53:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.661+0000 7f3db77fe640 1 -- 172.21.15.5:0/260268421 learned_addr learned my addr 172.21.15.5:0/260268421 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.661+0000 7f3dbcb97640 1 --2- 172.21.15.5:0/260268421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3db80c6690 0x7f3db80c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.661+0000 7f3db7fff640 1 --2- 172.21.15.5:0/260268421 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3da00062b0 0x7f3db80c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:12.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.661+0000 7f3db77fe640 1 -- 172.21.15.5:0/260268421 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3da00062b0 msgr2=0x7f3db80c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:12.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.661+0000 7f3db77fe640 1 --2- 172.21.15.5:0/260268421 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3da00062b0 0x7f3db80c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:12.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.661+0000 7f3db77fe640 1 -- 172.21.15.5:0/260268421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3db80c6690 msgr2=0x7f3db80c6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:12.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.661+0000 7f3db77fe640 1 --2- 172.21.15.5:0/260268421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3db80c6690 0x7f3db80c6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:12.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.661+0000 7f3db77fe640 1 -- 172.21.15.5:0/260268421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db80c58d0 con 0x7f3db806c900 2023-07-14T12:53:12.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.661+0000 7f3dbcb97640 1 --2- 172.21.15.5:0/260268421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3db80c6690 0x7f3db80c6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:12.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.661+0000 7f3db77fe640 1 --2- 172.21.15.5:0/260268421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3db806c900 0x7f3db81499b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0018f0 tx=0x7f3da0007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.661+0000 7f3db4ff9640 1 -- 172.21.15.5:0/260268421 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac0069e0 con 0x7f3db806c900 2023-07-14T12:53:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.661+0000 7f3db4ff9640 1 -- 172.21.15.5:0/260268421 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dac006b40 con 0x7f3db806c900 2023-07-14T12:53:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.661+0000 7f3db4ff9640 1 -- 172.21.15.5:0/260268421 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac007030 con 0x7f3db806c900 2023-07-14T12:53:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.661+0000 7f3dbe5fa640 1 -- 172.21.15.5:0/260268421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db80c5bb0 con 0x7f3db806c900 2023-07-14T12:53:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.661+0000 7f3dbe5fa640 1 -- 172.21.15.5:0/260268421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db806cd70 con 0x7f3db806c900 2023-07-14T12:53:12.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.661+0000 7f3dbe5fa640 1 -- 172.21.15.5:0/260268421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db80678d0 con 0x7f3db806c900 2023-07-14T12:53:12.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.665+0000 7f3db4ff9640 1 -- 172.21.15.5:0/260268421 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3dac007190 con 0x7f3db806c900 2023-07-14T12:53:12.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.665+0000 7f3db4ff9640 1 --2- 172.21.15.5:0/260268421 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3da4066280 0x7f3da4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:12.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.665+0000 7f3db4ff9640 1 -- 172.21.15.5:0/260268421 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3dac11de20 con 0x7f3db806c900 2023-07-14T12:53:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.665+0000 7f3db7fff640 1 --2- 172.21.15.5:0/260268421 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3da4066280 0x7f3da4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.665+0000 7f3db7fff640 1 --2- 172.21.15.5:0/260268421 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3da4066280 0x7f3da4068730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3da80099d0 tx=0x7f3da8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.669+0000 7f3db4ff9640 1 -- 172.21.15.5:0/260268421 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3dac0eb210 con 0x7f3db806c900 2023-07-14T12:53:12.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.825+0000 7f3dbe5fa640 1 -- 172.21.15.5:0/260268421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3db80678d0 con 0x7f3db806c900 2023-07-14T12:53:12.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.825+0000 7f3db4ff9640 1 -- 172.21.15.5:0/260268421 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3dac0ee830 con 0x7f3db806c900 2023-07-14T12:53:12.854 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T12:53:12.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.829+0000 7f3dbe5fa640 1 -- 172.21.15.5:0/260268421 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3da4066280 msgr2=0x7f3da4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:12.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.829+0000 7f3dbe5fa640 1 --2- 172.21.15.5:0/260268421 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3da4066280 0x7f3da4068730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3da80099d0 tx=0x7f3da8008040 comp rx=0 tx=0).stop 2023-07-14T12:53:12.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.829+0000 7f3dbe5fa640 1 -- 172.21.15.5:0/260268421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3db806c900 msgr2=0x7f3db81499b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:12.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.829+0000 7f3dbe5fa640 1 --2- 172.21.15.5:0/260268421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3db806c900 0x7f3db81499b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0018f0 tx=0x7f3da0007a10 comp rx=0 tx=0).stop 2023-07-14T12:53:12.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.829+0000 7f3dbe5fa640 1 -- 172.21.15.5:0/260268421 shutdown_connections 2023-07-14T12:53:12.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.829+0000 7f3dbe5fa640 1 --2- 172.21.15.5:0/260268421 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3da4066280 0x7f3da4068730 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:12.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.829+0000 7f3dbe5fa640 1 --2- 172.21.15.5:0/260268421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3db80c6690 0x7f3db80c6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:12.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.829+0000 7f3dbe5fa640 1 --2- 172.21.15.5:0/260268421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3db806c900 0x7f3db81499b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:12.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.829+0000 7f3dbe5fa640 1 --2- 172.21.15.5:0/260268421 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3da00062b0 0x7f3db80c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:12.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.829+0000 7f3dbe5fa640 1 -- 172.21.15.5:0/260268421 >> 172.21.15.5:0/260268421 conn(0x7f3db80cde90 msgr2=0x7f3db80c88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:12.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.829+0000 7f3dbe5fa640 1 -- 172.21.15.5:0/260268421 shutdown_connections 2023-07-14T12:53:12.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.829+0000 7f3dbe5fa640 1 -- 172.21.15.5:0/260268421 wait complete. 2023-07-14T12:53:12.875 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T12:53:13.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.997+0000 7fe846137640 1 Processor -- start 2023-07-14T12:53:13.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.997+0000 7fe846137640 1 -- start start 2023-07-14T12:53:13.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.997+0000 7fe846137640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe840069430 0x7fe8400cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:13.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.997+0000 7fe846137640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe840160030 0x7fe840069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:13.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.997+0000 7fe846137640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe840070330 0x7fe8400707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:13.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.997+0000 7fe846137640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe840069d40 con 0x7fe840070330 2023-07-14T12:53:13.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.997+0000 7fe846137640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8400cb7d0 con 0x7fe840160030 2023-07-14T12:53:13.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.997+0000 7fe846137640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84006c510 con 0x7fe840069430 2023-07-14T12:53:13.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.997+0000 7fe83ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe840070330 0x7fe8400707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:13.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.997+0000 7fe83ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe840070330 0x7fe8400707b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55744/0 (socket says 172.21.15.5:55744) 2023-07-14T12:53:13.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.997+0000 7fe83ffff640 1 -- 172.21.15.5:0/3049279068 learned_addr learned my addr 172.21.15.5:0/3049279068 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:13.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.997+0000 7fe83effd640 1 --2- 172.21.15.5:0/3049279068 >> v2:172.21.15.154:3300/0 conn(0x7fe840160030 0x7fe840069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:13.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.997+0000 7fe83f7fe640 1 --2- 172.21.15.5:0/3049279068 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe840069430 0x7fe8400cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:13.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.997+0000 7fe83ffff640 1 -- 172.21.15.5:0/3049279068 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe840069430 msgr2=0x7fe8400cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:13.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.997+0000 7fe83ffff640 1 --2- 172.21.15.5:0/3049279068 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe840069430 0x7fe8400cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.997+0000 7fe83ffff640 1 -- 172.21.15.5:0/3049279068 >> v2:172.21.15.154:3300/0 conn(0x7fe840160030 msgr2=0x7fe840069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:13.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.997+0000 7fe83ffff640 1 --2- 172.21.15.5:0/3049279068 >> v2:172.21.15.154:3300/0 conn(0x7fe840160030 0x7fe840069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.997+0000 7fe83ffff640 1 -- 172.21.15.5:0/3049279068 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84006c7f0 con 0x7fe840070330 2023-07-14T12:53:13.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:12.997+0000 7fe83effd640 1 --2- 172.21.15.5:0/3049279068 >> v2:172.21.15.154:3300/0 conn(0x7fe840160030 0x7fe840069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:13.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.001+0000 7fe83ffff640 1 --2- 172.21.15.5:0/3049279068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe840070330 0x7fe8400707b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe840066260 tx=0x7fe83801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588cc519218e674d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:13.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.001+0000 7fe83e7fc640 1 -- 172.21.15.5:0/3049279068 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8380a56b0 con 0x7fe840070330 2023-07-14T12:53:13.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.001+0000 7fe83e7fc640 1 -- 172.21.15.5:0/3049279068 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8380a5810 con 0x7fe840070330 2023-07-14T12:53:13.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.001+0000 7fe83e7fc640 1 -- 172.21.15.5:0/3049279068 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8380a5ba0 con 0x7fe840070330 2023-07-14T12:53:13.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.001+0000 7fe846137640 1 -- 172.21.15.5:0/3049279068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe840070330 msgr2=0x7fe8400707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:13.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.001+0000 7fe846137640 1 --2- 172.21.15.5:0/3049279068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe840070330 0x7fe8400707b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe840066260 tx=0x7fe83801c910 comp rx=0 tx=0).stop 2023-07-14T12:53:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.001+0000 7fe846137640 1 -- 172.21.15.5:0/3049279068 shutdown_connections 2023-07-14T12:53:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.001+0000 7fe846137640 1 --2- 172.21.15.5:0/3049279068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe840070330 0x7fe8400707b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.001+0000 7fe846137640 1 --2- 172.21.15.5:0/3049279068 >> v2:172.21.15.154:3300/0 conn(0x7fe840160030 0x7fe840069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.001+0000 7fe846137640 1 --2- 172.21.15.5:0/3049279068 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe840069430 0x7fe8400cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.001+0000 7fe846137640 1 -- 172.21.15.5:0/3049279068 >> 172.21.15.5:0/3049279068 conn(0x7fe8400b1840 msgr2=0x7fe8400cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:13.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.001+0000 7fe846137640 1 -- 172.21.15.5:0/3049279068 shutdown_connections 2023-07-14T12:53:13.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.001+0000 7fe846137640 1 -- 172.21.15.5:0/3049279068 wait complete. 2023-07-14T12:53:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.001+0000 7fe846137640 1 Processor -- start 2023-07-14T12:53:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.001+0000 7fe846137640 1 -- start start 2023-07-14T12:53:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.005+0000 7fe846137640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe840069430 0x7fe84015c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:13.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.005+0000 7fe846137640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe840070330 0x7fe840155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:13.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.005+0000 7fe846137640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe840160030 0x7fe840155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:13.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.005+0000 7fe846137640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8400cd870 con 0x7fe840069430 2023-07-14T12:53:13.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.005+0000 7fe846137640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8400cdb10 con 0x7fe840160030 2023-07-14T12:53:13.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.005+0000 7fe846137640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8400cddf0 con 0x7fe840070330 2023-07-14T12:53:13.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.005+0000 7fe83f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe840069430 0x7fe84015c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:13.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.005+0000 7fe83f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe840069430 0x7fe84015c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55760/0 (socket says 172.21.15.5:55760) 2023-07-14T12:53:13.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.005+0000 7fe83f7fe640 1 -- 172.21.15.5:0/2077551197 learned_addr learned my addr 172.21.15.5:0/2077551197 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:13.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.005+0000 7fe83f7fe640 1 -- 172.21.15.5:0/2077551197 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe840070330 msgr2=0x7fe840155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:13.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.005+0000 7fe83f7fe640 1 --2- 172.21.15.5:0/2077551197 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe840070330 0x7fe840155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.005+0000 7fe83f7fe640 1 -- 172.21.15.5:0/2077551197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe840160030 msgr2=0x7fe840155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:13.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.005+0000 7fe83ffff640 1 --2- 172.21.15.5:0/2077551197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe840160030 0x7fe840155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:13.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.005+0000 7fe83f7fe640 1 --2- 172.21.15.5:0/2077551197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe840160030 0x7fe840155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.005+0000 7fe83f7fe640 1 -- 172.21.15.5:0/2077551197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe838009b30 con 0x7fe840069430 2023-07-14T12:53:13.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.005+0000 7fe83ffff640 1 --2- 172.21.15.5:0/2077551197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe840160030 0x7fe840155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.005+0000 7fe83f7fe640 1 --2- 172.21.15.5:0/2077551197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe840069430 0x7fe84015c840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe83000d800 tx=0x7fe83000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.005+0000 7fe827fff640 1 -- 172.21.15.5:0/2077551197 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8300096a0 con 0x7fe840069430 2023-07-14T12:53:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.005+0000 7fe827fff640 1 -- 172.21.15.5:0/2077551197 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe830009800 con 0x7fe840069430 2023-07-14T12:53:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.005+0000 7fe827fff640 1 -- 172.21.15.5:0/2077551197 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe830009990 con 0x7fe840069430 2023-07-14T12:53:13.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.005+0000 7fe846137640 1 -- 172.21.15.5:0/2077551197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8400ce0d0 con 0x7fe840069430 2023-07-14T12:53:13.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.005+0000 7fe846137640 1 -- 172.21.15.5:0/2077551197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe840155790 con 0x7fe840069430 2023-07-14T12:53:13.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.005+0000 7fe846137640 1 -- 172.21.15.5:0/2077551197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe840069a00 con 0x7fe840069430 2023-07-14T12:53:13.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.009+0000 7fe827fff640 1 -- 172.21.15.5:0/2077551197 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe830009af0 con 0x7fe840069430 2023-07-14T12:53:13.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.009+0000 7fe827fff640 1 --2- 172.21.15.5:0/2077551197 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe82c066280 0x7fe82c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:13.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.009+0000 7fe827fff640 1 -- 172.21.15.5:0/2077551197 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe830084260 con 0x7fe840069430 2023-07-14T12:53:13.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.009+0000 7fe83effd640 1 --2- 172.21.15.5:0/2077551197 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe82c066280 0x7fe82c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:13.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.009+0000 7fe83effd640 1 --2- 172.21.15.5:0/2077551197 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe82c066280 0x7fe82c068730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe834006f10 tx=0x7fe834008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:13.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.013+0000 7fe827fff640 1 -- 172.21.15.5:0/2077551197 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe830051640 con 0x7fe840069430 2023-07-14T12:53:13.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.165+0000 7fe846137640 1 -- 172.21.15.5:0/2077551197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe8400678d0 con 0x7fe840069430 2023-07-14T12:53:13.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.165+0000 7fe827fff640 1 -- 172.21.15.5:0/2077551197 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe830054c60 con 0x7fe840069430 2023-07-14T12:53:13.193 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T12:53:13.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.165+0000 7fe846137640 1 -- 172.21.15.5:0/2077551197 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe82c066280 msgr2=0x7fe82c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:13.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.165+0000 7fe846137640 1 --2- 172.21.15.5:0/2077551197 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe82c066280 0x7fe82c068730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe834006f10 tx=0x7fe834008040 comp rx=0 tx=0).stop 2023-07-14T12:53:13.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.165+0000 7fe846137640 1 -- 172.21.15.5:0/2077551197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe840069430 msgr2=0x7fe84015c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:13.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.165+0000 7fe846137640 1 --2- 172.21.15.5:0/2077551197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe840069430 0x7fe84015c840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe83000d800 tx=0x7fe83000dcc0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.165+0000 7fe846137640 1 -- 172.21.15.5:0/2077551197 shutdown_connections 2023-07-14T12:53:13.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.165+0000 7fe846137640 1 --2- 172.21.15.5:0/2077551197 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe82c066280 0x7fe82c068730 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.165+0000 7fe846137640 1 --2- 172.21.15.5:0/2077551197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe840160030 0x7fe840155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.165+0000 7fe846137640 1 --2- 172.21.15.5:0/2077551197 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe840070330 0x7fe840155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.165+0000 7fe846137640 1 --2- 172.21.15.5:0/2077551197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe840069430 0x7fe84015c840 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.165+0000 7fe846137640 1 -- 172.21.15.5:0/2077551197 >> 172.21.15.5:0/2077551197 conn(0x7fe8400b1840 msgr2=0x7fe8400b1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:13.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.165+0000 7fe846137640 1 -- 172.21.15.5:0/2077551197 shutdown_connections 2023-07-14T12:53:13.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.165+0000 7fe846137640 1 -- 172.21.15.5:0/2077551197 wait complete. 2023-07-14T12:53:13.214 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:53:13.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.333+0000 7f8d9f693640 1 Processor -- start 2023-07-14T12:53:13.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.333+0000 7f8d9f693640 1 -- start start 2023-07-14T12:53:13.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.333+0000 7f8d9f693640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8d980c9730 0x7f8d981638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:13.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.333+0000 7f8d9f693640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d980cc700 con 0x7f8d98158ce0 2023-07-14T12:53:13.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.333+0000 7f8d9f693640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d980b0ff0 con 0x7f8d980c8ad0 2023-07-14T12:53:13.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.333+0000 7f8d9f693640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d98070c80 con 0x7f8d980c9730 2023-07-14T12:53:13.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d9d42f640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8d98158ce0 0x7f8d98070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59430/0 (socket says 172.21.15.5:59430) 2023-07-14T12:53:13.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d9d42f640 1 -- 172.21.15.5:0/4008774863 learned_addr learned my addr 172.21.15.5:0/4008774863 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:13.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d9dc30640 1 --2- 172.21.15.5:0/4008774863 >> v2:172.21.15.154:3300/0 conn(0x7f8d980c9730 0x7f8d981638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:13.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d8ffff640 1 -- 172.21.15.5:0/4008774863 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1785224829 0 0) 0x7f8d980cc700 con 0x7f8d98158ce0 2023-07-14T12:53:13.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d8ffff640 1 -- 172.21.15.5:0/4008774863 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d84005740 con 0x7f8d98158ce0 2023-07-14T12:53:13.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d8ffff640 1 -- 172.21.15.5:0/4008774863 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797217071 0 0) 0x7f8d980b0ff0 con 0x7f8d980c8ad0 2023-07-14T12:53:13.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d8ffff640 1 -- 172.21.15.5:0/4008774863 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d980cc700 con 0x7f8d980c8ad0 2023-07-14T12:53:13.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d8ffff640 1 -- 172.21.15.5:0/4008774863 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3586825350 0 0) 0x7f8d84005740 con 0x7f8d98158ce0 2023-07-14T12:53:13.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d8ffff640 1 -- 172.21.15.5:0/4008774863 >> v2:172.21.15.154:3300/0 conn(0x7f8d980c9730 msgr2=0x7f8d981638b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:13.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d8ffff640 1 --2- 172.21.15.5:0/4008774863 >> v2:172.21.15.154:3300/0 conn(0x7f8d980c9730 0x7f8d981638b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d8ffff640 1 -- 172.21.15.5:0/4008774863 >> v1:172.21.15.154:6789/0 conn(0x7f8d980c8ad0 legacy=0x7f8d980c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:13.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d8ffff640 1 -- 172.21.15.5:0/4008774863 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d980cbdd0 con 0x7f8d98158ce0 2023-07-14T12:53:13.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d8ffff640 1 -- 172.21.15.5:0/4008774863 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f8d94001680 con 0x7f8d98158ce0 2023-07-14T12:53:13.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d8ffff640 1 -- 172.21.15.5:0/4008774863 >> v1:172.21.15.5:6789/0 conn(0x7f8d98158ce0 legacy=0x7f8d98070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:13.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d8ffff640 1 --2- 172.21.15.5:0/4008774863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d84005d20 0x7f8d84006110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:13.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d8ffff640 1 --2- 172.21.15.5:0/4008774863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d840069e0 0x7f8d84006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:13.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d8ffff640 1 --2- 172.21.15.5:0/4008774863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d84007400 0x7f8d8400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:13.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d8ffff640 1 -- 172.21.15.5:0/4008774863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d98070c80 con 0x7f8d84007400 2023-07-14T12:53:13.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d8ffff640 1 -- 172.21.15.5:0/4008774863 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8400e340 con 0x7f8d84005d20 2023-07-14T12:53:13.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d8ffff640 1 -- 172.21.15.5:0/4008774863 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8400e500 con 0x7f8d840069e0 2023-07-14T12:53:13.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d9dc30640 1 --2- 172.21.15.5:0/4008774863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d84007400 0x7f8d8400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:13.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d9cc2e640 1 --2- 172.21.15.5:0/4008774863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d840069e0 0x7f8d84006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:13.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d9d42f640 1 --2- 172.21.15.5:0/4008774863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d84005d20 0x7f8d84006110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:13.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d9dc30640 1 -- 172.21.15.5:0/4008774863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d840069e0 msgr2=0x7f8d84006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:13.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d9dc30640 1 --2- 172.21.15.5:0/4008774863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d840069e0 0x7f8d84006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d9dc30640 1 -- 172.21.15.5:0/4008774863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d84005d20 msgr2=0x7f8d84006110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:13.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d9dc30640 1 --2- 172.21.15.5:0/4008774863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d84005d20 0x7f8d84006110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.337+0000 7f8d9dc30640 1 -- 172.21.15.5:0/4008774863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d84005740 con 0x7f8d84007400 2023-07-14T12:53:13.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.341+0000 7f8d9dc30640 1 -- 172.21.15.5:0/4008774863 reap_dead start 2023-07-14T12:53:13.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.341+0000 7f8d9dc30640 1 --2- 172.21.15.5:0/4008774863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d84007400 0x7f8d8400dba0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8d90009f90 tx=0x7f8d9001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8970f9688a845b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:13.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.341+0000 7f8d8ffff640 1 -- 172.21.15.5:0/4008774863 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d90003ba0 con 0x7f8d84007400 2023-07-14T12:53:13.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.341+0000 7f8d8ffff640 1 -- 172.21.15.5:0/4008774863 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9000f040 con 0x7f8d84007400 2023-07-14T12:53:13.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.341+0000 7f8d8ffff640 1 -- 172.21.15.5:0/4008774863 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d900a5830 con 0x7f8d84007400 2023-07-14T12:53:13.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.341+0000 7f8d9f693640 1 -- 172.21.15.5:0/4008774863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d84007400 msgr2=0x7f8d8400dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:13.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.341+0000 7f8d9f693640 1 --2- 172.21.15.5:0/4008774863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d84007400 0x7f8d8400dba0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8d90009f90 tx=0x7f8d9001cc30 comp rx=0 tx=0).stop 2023-07-14T12:53:13.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.341+0000 7f8d9f693640 1 -- 172.21.15.5:0/4008774863 shutdown_connections 2023-07-14T12:53:13.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.341+0000 7f8d9f693640 1 --2- 172.21.15.5:0/4008774863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d84007400 0x7f8d8400dba0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.341+0000 7f8d9f693640 1 -- 172.21.15.5:0/4008774863 >> 172.21.15.5:0/4008774863 conn(0x7f8d980afcf0 msgr2=0x7f8d980b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:13.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.341+0000 7f8d9f693640 1 -- 172.21.15.5:0/4008774863 shutdown_connections 2023-07-14T12:53:13.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.341+0000 7f8d9f693640 1 -- 172.21.15.5:0/4008774863 wait complete. 2023-07-14T12:53:13.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.341+0000 7f8d9f693640 1 Processor -- start 2023-07-14T12:53:13.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.341+0000 7f8d9f693640 1 -- start start 2023-07-14T12:53:13.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.345+0000 7f8d9f693640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d84007400 0x7f8d980c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:13.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.345+0000 7f8d9f693640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d98150130 0x7f8d98159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:13.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.345+0000 7f8d9f693640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d98157240 0x7f8d9814f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:13.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.345+0000 7f8d9f693640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d980c7fd0 con 0x7f8d84007400 2023-07-14T12:53:13.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.345+0000 7f8d9f693640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d98159770 con 0x7f8d98157240 2023-07-14T12:53:13.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.345+0000 7f8d9f693640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d980b2400 con 0x7f8d98150130 2023-07-14T12:53:13.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.345+0000 7f8d9d42f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d84007400 0x7f8d980c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:13.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.345+0000 7f8d9d42f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d84007400 0x7f8d980c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55790/0 (socket says 172.21.15.5:55790) 2023-07-14T12:53:13.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.345+0000 7f8d9d42f640 1 -- 172.21.15.5:0/1945017271 learned_addr learned my addr 172.21.15.5:0/1945017271 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:13.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.345+0000 7f8d9cc2e640 1 --2- 172.21.15.5:0/1945017271 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d98150130 0x7f8d98159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:13.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.345+0000 7f8d9dc30640 1 --2- 172.21.15.5:0/1945017271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d98157240 0x7f8d9814f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:13.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.345+0000 7f8d9d42f640 1 -- 172.21.15.5:0/1945017271 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d98150130 msgr2=0x7f8d98159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:13.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.345+0000 7f8d9d42f640 1 --2- 172.21.15.5:0/1945017271 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d98150130 0x7f8d98159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.345+0000 7f8d9d42f640 1 -- 172.21.15.5:0/1945017271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d98157240 msgr2=0x7f8d9814f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:13.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.345+0000 7f8d9d42f640 1 --2- 172.21.15.5:0/1945017271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d98157240 0x7f8d9814f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.345+0000 7f8d9d42f640 1 -- 172.21.15.5:0/1945017271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d980b26e0 con 0x7f8d84007400 2023-07-14T12:53:13.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.345+0000 7f8d9dc30640 1 --2- 172.21.15.5:0/1945017271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d98157240 0x7f8d9814f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:13.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.345+0000 7f8d9d42f640 1 --2- 172.21.15.5:0/1945017271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d84007400 0x7f8d980c7a90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8d94004f00 tx=0x7f8d94007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:13.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.345+0000 7f8d8dffb640 1 -- 172.21.15.5:0/1945017271 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d94001050 con 0x7f8d84007400 2023-07-14T12:53:13.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.345+0000 7f8d8dffb640 1 -- 172.21.15.5:0/1945017271 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9400f7b0 con 0x7f8d84007400 2023-07-14T12:53:13.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.345+0000 7f8d8dffb640 1 -- 172.21.15.5:0/1945017271 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9400fb40 con 0x7f8d84007400 2023-07-14T12:53:13.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.345+0000 7f8d9f693640 1 -- 172.21.15.5:0/1945017271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d980b29c0 con 0x7f8d84007400 2023-07-14T12:53:13.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.345+0000 7f8d9f693640 1 -- 172.21.15.5:0/1945017271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d98157670 con 0x7f8d84007400 2023-07-14T12:53:13.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.345+0000 7f8d9f693640 1 -- 172.21.15.5:0/1945017271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d980ca1a0 con 0x7f8d84007400 2023-07-14T12:53:13.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.345+0000 7f8d8dffb640 1 -- 172.21.15.5:0/1945017271 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8d9400fca0 con 0x7f8d84007400 2023-07-14T12:53:13.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.349+0000 7f8d8dffb640 1 --2- 172.21.15.5:0/1945017271 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f8d7c066280 0x7f8d7c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:13.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.349+0000 7f8d8dffb640 1 -- 172.21.15.5:0/1945017271 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8d94083e30 con 0x7f8d84007400 2023-07-14T12:53:13.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.349+0000 7f8d9cc2e640 1 --2- 172.21.15.5:0/1945017271 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f8d7c066280 0x7f8d7c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:13.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.349+0000 7f8d9cc2e640 1 --2- 172.21.15.5:0/1945017271 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f8d7c066280 0x7f8d7c068730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8d880010f0 tx=0x7f8d88009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:13.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.353+0000 7f8d8dffb640 1 -- 172.21.15.5:0/1945017271 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f8d940512a0 con 0x7f8d84007400 2023-07-14T12:53:13.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.509+0000 7f8d9f693640 1 -- 172.21.15.5:0/1945017271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d980678d0 con 0x7f8d84007400 2023-07-14T12:53:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.509+0000 7f8d8dffb640 1 -- 172.21.15.5:0/1945017271 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18231 (secure 0 0 0) 0x7f8d940548c0 con 0x7f8d84007400 2023-07-14T12:53:13.537 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:13.538 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":23,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:52:48.091483+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:52:44.223082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T12:52:45.469396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:53:13.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.513+0000 7f8d9f693640 1 -- 172.21.15.5:0/1945017271 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f8d7c066280 msgr2=0x7f8d7c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:13.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.513+0000 7f8d9f693640 1 --2- 172.21.15.5:0/1945017271 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f8d7c066280 0x7f8d7c068730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8d880010f0 tx=0x7f8d88009040 comp rx=0 tx=0).stop 2023-07-14T12:53:13.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.513+0000 7f8d9f693640 1 -- 172.21.15.5:0/1945017271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d84007400 msgr2=0x7f8d980c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:13.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.513+0000 7f8d9f693640 1 --2- 172.21.15.5:0/1945017271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d84007400 0x7f8d980c7a90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8d94004f00 tx=0x7f8d94007430 comp rx=0 tx=0).stop 2023-07-14T12:53:13.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.513+0000 7f8d9f693640 1 -- 172.21.15.5:0/1945017271 shutdown_connections 2023-07-14T12:53:13.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.513+0000 7f8d9f693640 1 --2- 172.21.15.5:0/1945017271 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f8d7c066280 0x7f8d7c068730 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.513+0000 7f8d9f693640 1 --2- 172.21.15.5:0/1945017271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d98157240 0x7f8d9814f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.513+0000 7f8d9f693640 1 --2- 172.21.15.5:0/1945017271 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d98150130 0x7f8d98159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.513+0000 7f8d9f693640 1 --2- 172.21.15.5:0/1945017271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d84007400 0x7f8d980c7a90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.513+0000 7f8d9f693640 1 -- 172.21.15.5:0/1945017271 >> 172.21.15.5:0/1945017271 conn(0x7f8d980afcf0 msgr2=0x7f8d98150dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:13.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.513+0000 7f8d9f693640 1 -- 172.21.15.5:0/1945017271 shutdown_connections 2023-07-14T12:53:13.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.513+0000 7f8d9f693640 1 -- 172.21.15.5:0/1945017271 wait complete. 2023-07-14T12:53:13.559 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T12:52:44.223082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T12:52:45.469396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T12:53:13.560 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T12:53:13.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa825d3640 1 Processor -- start 2023-07-14T12:53:13.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa825d3640 1 -- start start 2023-07-14T12:53:13.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa825d3640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faa7c069430 0x7faa7c069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:13.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa825d3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7c159d70 con 0x7faa7c0af2b0 2023-07-14T12:53:13.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa825d3640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7c069d40 con 0x7faa7c070f30 2023-07-14T12:53:13.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa825d3640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa7c0c9c60 con 0x7faa7c069430 2023-07-14T12:53:13.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa80b70640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faa7c0af2b0 0x7faa7c15a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59436/0 (socket says 172.21.15.5:59436) 2023-07-14T12:53:13.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa80b70640 1 -- 172.21.15.5:0/3457448107 learned_addr learned my addr 172.21.15.5:0/3457448107 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:13.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa7bfff640 1 --2- 172.21.15.5:0/3457448107 >> v2:172.21.15.154:3300/0 conn(0x7faa7c069430 0x7faa7c069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:13.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa7affd640 1 -- 172.21.15.5:0/3457448107 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1395990074 0 0) 0x7faa740014a0 con 0x7faa7c0af2b0 2023-07-14T12:53:13.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa7affd640 1 -- 172.21.15.5:0/3457448107 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa64003530 con 0x7faa7c0af2b0 2023-07-14T12:53:13.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa7affd640 1 -- 172.21.15.5:0/3457448107 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679110445 0 0) 0x7faa7c069d40 con 0x7faa7c070f30 2023-07-14T12:53:13.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa7affd640 1 -- 172.21.15.5:0/3457448107 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa740014a0 con 0x7faa7c070f30 2023-07-14T12:53:13.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa7affd640 1 -- 172.21.15.5:0/3457448107 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 602095616 0 0) 0x7faa64003530 con 0x7faa7c0af2b0 2023-07-14T12:53:13.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa7affd640 1 -- 172.21.15.5:0/3457448107 >> v2:172.21.15.154:3300/0 conn(0x7faa7c069430 msgr2=0x7faa7c069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:13.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa7affd640 1 --2- 172.21.15.5:0/3457448107 >> v2:172.21.15.154:3300/0 conn(0x7faa7c069430 0x7faa7c069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa7affd640 1 -- 172.21.15.5:0/3457448107 >> v1:172.21.15.154:6789/0 conn(0x7faa7c070f30 legacy=0x7faa7c0ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:13.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa7affd640 1 -- 172.21.15.5:0/3457448107 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7c0c9f40 con 0x7faa7c0af2b0 2023-07-14T12:53:13.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa7affd640 1 -- 172.21.15.5:0/3457448107 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7faa74001b90 con 0x7faa7c0af2b0 2023-07-14T12:53:13.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa7affd640 1 -- 172.21.15.5:0/3457448107 >> v1:172.21.15.5:6789/0 conn(0x7faa7c0af2b0 legacy=0x7faa7c15a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:13.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa7affd640 1 --2- 172.21.15.5:0/3457448107 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa64003b60 0x7faa64003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:13.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa7affd640 1 --2- 172.21.15.5:0/3457448107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa640047d0 0x7faa64004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:13.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa7affd640 1 --2- 172.21.15.5:0/3457448107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa64005180 0x7faa6400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:13.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa7affd640 1 -- 172.21.15.5:0/3457448107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c0c9c60 con 0x7faa64005180 2023-07-14T12:53:13.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa7affd640 1 -- 172.21.15.5:0/3457448107 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6400c060 con 0x7faa640047d0 2023-07-14T12:53:13.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa7affd640 1 -- 172.21.15.5:0/3457448107 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6400c1f0 con 0x7faa64003b60 2023-07-14T12:53:13.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa80b70640 1 --2- 172.21.15.5:0/3457448107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa64005180 0x7faa6400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:13.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa7bfff640 1 --2- 172.21.15.5:0/3457448107 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa64003b60 0x7faa64003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:13.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.681+0000 7faa7b7fe640 1 --2- 172.21.15.5:0/3457448107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa640047d0 0x7faa64004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:13.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.685+0000 7faa80b70640 1 -- 172.21.15.5:0/3457448107 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa64003b60 msgr2=0x7faa64003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:13.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.685+0000 7faa80b70640 1 --2- 172.21.15.5:0/3457448107 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa64003b60 0x7faa64003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.685+0000 7faa80b70640 1 -- 172.21.15.5:0/3457448107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa640047d0 msgr2=0x7faa64004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:13.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.685+0000 7faa80b70640 1 --2- 172.21.15.5:0/3457448107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa640047d0 0x7faa64004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.685+0000 7faa80b70640 1 -- 172.21.15.5:0/3457448107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa64003530 con 0x7faa64005180 2023-07-14T12:53:13.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.685+0000 7faa80b70640 1 -- 172.21.15.5:0/3457448107 reap_dead start 2023-07-14T12:53:13.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.685+0000 7faa80b70640 1 --2- 172.21.15.5:0/3457448107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa64005180 0x7faa6400b990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7faa7400a6c0 tx=0x7faa7401f900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9865f50e39e1a98f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:13.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.685+0000 7faa7affd640 1 -- 172.21.15.5:0/3457448107 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa740072d0 con 0x7faa64005180 2023-07-14T12:53:13.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.685+0000 7faa7affd640 1 -- 172.21.15.5:0/3457448107 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa74007430 con 0x7faa64005180 2023-07-14T12:53:13.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.685+0000 7faa7affd640 1 -- 172.21.15.5:0/3457448107 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa740077e0 con 0x7faa64005180 2023-07-14T12:53:13.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.685+0000 7faa825d3640 1 -- 172.21.15.5:0/3457448107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa64005180 msgr2=0x7faa6400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:13.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.685+0000 7faa825d3640 1 --2- 172.21.15.5:0/3457448107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa64005180 0x7faa6400b990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7faa7400a6c0 tx=0x7faa7401f900 comp rx=0 tx=0).stop 2023-07-14T12:53:13.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.685+0000 7faa825d3640 1 -- 172.21.15.5:0/3457448107 shutdown_connections 2023-07-14T12:53:13.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.685+0000 7faa825d3640 1 --2- 172.21.15.5:0/3457448107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa64005180 0x7faa6400b990 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.685+0000 7faa825d3640 1 -- 172.21.15.5:0/3457448107 >> 172.21.15.5:0/3457448107 conn(0x7faa7c0cde90 msgr2=0x7faa7c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:13.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.685+0000 7faa825d3640 1 -- 172.21.15.5:0/3457448107 shutdown_connections 2023-07-14T12:53:13.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.685+0000 7faa825d3640 1 -- 172.21.15.5:0/3457448107 wait complete. 2023-07-14T12:53:13.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.689+0000 7faa825d3640 1 Processor -- start 2023-07-14T12:53:13.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.689+0000 7faa825d3640 1 -- start start 2023-07-14T12:53:13.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.689+0000 7faa825d3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa64005180 0x7faa7c0b3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:13.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.689+0000 7faa825d3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa7c14aba0 0x7faa7c14b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:13.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.689+0000 7faa825d3640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa7c1f0480 0x7faa7c1f08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:13.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.689+0000 7faa825d3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c14b640 con 0x7faa64005180 2023-07-14T12:53:13.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.689+0000 7faa825d3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c14b920 con 0x7faa7c14aba0 2023-07-14T12:53:13.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.689+0000 7faa825d3640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c14bc00 con 0x7faa7c1f0480 2023-07-14T12:53:13.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.689+0000 7faa7bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa64005180 0x7faa7c0b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:13.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.689+0000 7faa7bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa64005180 0x7faa7c0b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55804/0 (socket says 172.21.15.5:55804) 2023-07-14T12:53:13.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.689+0000 7faa7bfff640 1 -- 172.21.15.5:0/1292537000 learned_addr learned my addr 172.21.15.5:0/1292537000 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:13.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.689+0000 7faa7b7fe640 1 --2- 172.21.15.5:0/1292537000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa7c14aba0 0x7faa7c14b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:13.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.689+0000 7faa80b70640 1 --2- 172.21.15.5:0/1292537000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa7c1f0480 0x7faa7c1f08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:13.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.689+0000 7faa7bfff640 1 -- 172.21.15.5:0/1292537000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa7c1f0480 msgr2=0x7faa7c1f08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:13.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.689+0000 7faa7bfff640 1 --2- 172.21.15.5:0/1292537000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa7c1f0480 0x7faa7c1f08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.689+0000 7faa7bfff640 1 -- 172.21.15.5:0/1292537000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa7c14aba0 msgr2=0x7faa7c14b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:13.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.689+0000 7faa7bfff640 1 --2- 172.21.15.5:0/1292537000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa7c14aba0 0x7faa7c14b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.689+0000 7faa7bfff640 1 -- 172.21.15.5:0/1292537000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7c14bee0 con 0x7faa64005180 2023-07-14T12:53:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.689+0000 7faa7b7fe640 1 --2- 172.21.15.5:0/1292537000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa7c14aba0 0x7faa7c14b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.689+0000 7faa7bfff640 1 --2- 172.21.15.5:0/1292537000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa64005180 0x7faa7c0b3790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7faa6c011960 tx=0x7faa6c011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.689+0000 7faa78ff9640 1 -- 172.21.15.5:0/1292537000 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c00faf0 con 0x7faa64005180 2023-07-14T12:53:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.693+0000 7faa78ff9640 1 -- 172.21.15.5:0/1292537000 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6c00fc50 con 0x7faa64005180 2023-07-14T12:53:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.693+0000 7faa78ff9640 1 -- 172.21.15.5:0/1292537000 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c014440 con 0x7faa64005180 2023-07-14T12:53:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.693+0000 7faa825d3640 1 -- 172.21.15.5:0/1292537000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa7c0c2dd0 con 0x7faa64005180 2023-07-14T12:53:13.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.693+0000 7faa825d3640 1 -- 172.21.15.5:0/1292537000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa7c14ff50 con 0x7faa64005180 2023-07-14T12:53:13.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.693+0000 7faa825d3640 1 -- 172.21.15.5:0/1292537000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa7c0678d0 con 0x7faa64005180 2023-07-14T12:53:13.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.693+0000 7faa78ff9640 1 -- 172.21.15.5:0/1292537000 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faa6c0145a0 con 0x7faa64005180 2023-07-14T12:53:13.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.693+0000 7faa78ff9640 1 --2- 172.21.15.5:0/1292537000 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7faa68066280 0x7faa68068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:13.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.693+0000 7faa78ff9640 1 -- 172.21.15.5:0/1292537000 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faa6c0845a0 con 0x7faa64005180 2023-07-14T12:53:13.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.693+0000 7faa7b7fe640 1 --2- 172.21.15.5:0/1292537000 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7faa68066280 0x7faa68068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:13.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.697+0000 7faa7b7fe640 1 --2- 172.21.15.5:0/1292537000 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7faa68066280 0x7faa68068730 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7faa7c1f44e0 tx=0x7faa70009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:13.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.697+0000 7faa78ff9640 1 -- 172.21.15.5:0/1292537000 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7faa6c051980 con 0x7faa64005180 2023-07-14T12:53:13.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.853+0000 7faa825d3640 1 -- 172.21.15.5:0/1292537000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faa7c0aeb80 con 0x7faa64005180 2023-07-14T12:53:13.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.853+0000 7faa78ff9640 1 -- 172.21.15.5:0/1292537000 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7faa6c054fa0 con 0x7faa64005180 2023-07-14T12:53:13.880 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T12:53:13.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.853+0000 7faa825d3640 1 -- 172.21.15.5:0/1292537000 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7faa68066280 msgr2=0x7faa68068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:13.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.853+0000 7faa825d3640 1 --2- 172.21.15.5:0/1292537000 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7faa68066280 0x7faa68068730 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7faa7c1f44e0 tx=0x7faa70009040 comp rx=0 tx=0).stop 2023-07-14T12:53:13.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.853+0000 7faa825d3640 1 -- 172.21.15.5:0/1292537000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa64005180 msgr2=0x7faa7c0b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:13.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.853+0000 7faa825d3640 1 --2- 172.21.15.5:0/1292537000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa64005180 0x7faa7c0b3790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7faa6c011960 tx=0x7faa6c011e20 comp rx=0 tx=0).stop 2023-07-14T12:53:13.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.853+0000 7faa825d3640 1 -- 172.21.15.5:0/1292537000 shutdown_connections 2023-07-14T12:53:13.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.853+0000 7faa825d3640 1 --2- 172.21.15.5:0/1292537000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa7c1f0480 0x7faa7c1f08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.853+0000 7faa825d3640 1 --2- 172.21.15.5:0/1292537000 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7faa68066280 0x7faa68068730 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.853+0000 7faa825d3640 1 --2- 172.21.15.5:0/1292537000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa7c14aba0 0x7faa7c14b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.853+0000 7faa825d3640 1 --2- 172.21.15.5:0/1292537000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa64005180 0x7faa7c0b3790 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:13.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.853+0000 7faa825d3640 1 -- 172.21.15.5:0/1292537000 >> 172.21.15.5:0/1292537000 conn(0x7faa7c0cde90 msgr2=0x7faa7c1582c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:13.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.853+0000 7faa825d3640 1 -- 172.21.15.5:0/1292537000 shutdown_connections 2023-07-14T12:53:13.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:13.853+0000 7faa825d3640 1 -- 172.21.15.5:0/1292537000 wait complete. 2023-07-14T12:53:13.902 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T12:53:14.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.021+0000 7f7d9254b640 1 Processor -- start 2023-07-14T12:53:14.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.021+0000 7f7d9254b640 1 -- start start 2023-07-14T12:53:14.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.025+0000 7f7d9254b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7d8c0b1620 0x7f7d8c0ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:14.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.025+0000 7f7d9254b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7d8c160750 0x7f7d8c15c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:14.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.025+0000 7f7d9254b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d8c0cf430 con 0x7f7d8c0cc960 2023-07-14T12:53:14.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.025+0000 7f7d9254b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d8c0cf710 con 0x7f7d8c0b1620 2023-07-14T12:53:14.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.025+0000 7f7d9254b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d8c15fc70 con 0x7f7d8c160750 2023-07-14T12:53:14.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.025+0000 7f7d90d48640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7d8c0b1620 0x7f7d8c0ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:14.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.025+0000 7f7d90d48640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7d8c0b1620 0x7f7d8c0ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55818/0 (socket says 172.21.15.5:55818) 2023-07-14T12:53:14.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.025+0000 7f7d90d48640 1 -- 172.21.15.5:0/3267642340 learned_addr learned my addr 172.21.15.5:0/3267642340 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.025+0000 7f7d91d4a640 1 --2- 172.21.15.5:0/3267642340 >> v2:172.21.15.154:3300/0 conn(0x7f7d8c160750 0x7f7d8c15c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.025+0000 7f7d90d48640 1 -- 172.21.15.5:0/3267642340 >> v2:172.21.15.154:3300/0 conn(0x7f7d8c160750 msgr2=0x7f7d8c15c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.025+0000 7f7d90d48640 1 --2- 172.21.15.5:0/3267642340 >> v2:172.21.15.154:3300/0 conn(0x7f7d8c160750 0x7f7d8c15c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.025+0000 7f7d90d48640 1 -- 172.21.15.5:0/3267642340 >> v1:172.21.15.154:6789/0 conn(0x7f7d8c0cc960 legacy=0x7f7d8c0ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.025+0000 7f7d90d48640 1 -- 172.21.15.5:0/3267642340 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8c15ff50 con 0x7f7d8c0b1620 2023-07-14T12:53:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.025+0000 7f7d91d4a640 1 --2- 172.21.15.5:0/3267642340 >> v2:172.21.15.154:3300/0 conn(0x7f7d8c160750 0x7f7d8c15c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:14.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.029+0000 7f7d90d48640 1 --2- 172.21.15.5:0/3267642340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8c0b1620 0x7f7d8c0ce950 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0b4c50 tx=0x7f7d7c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=748bab56290e48a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:14.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.029+0000 7f7d83fff640 1 -- 172.21.15.5:0/3267642340 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c0aa650 con 0x7f7d8c0b1620 2023-07-14T12:53:14.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.029+0000 7f7d83fff640 1 -- 172.21.15.5:0/3267642340 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7c0aa7b0 con 0x7f7d8c0b1620 2023-07-14T12:53:14.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.029+0000 7f7d83fff640 1 -- 172.21.15.5:0/3267642340 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c0aab40 con 0x7f7d8c0b1620 2023-07-14T12:53:14.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.029+0000 7f7d9254b640 1 -- 172.21.15.5:0/3267642340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8c0b1620 msgr2=0x7f7d8c0ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:14.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.029+0000 7f7d9254b640 1 --2- 172.21.15.5:0/3267642340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8c0b1620 0x7f7d8c0ce950 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0b4c50 tx=0x7f7d7c01c4d0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.029+0000 7f7d9254b640 1 -- 172.21.15.5:0/3267642340 shutdown_connections 2023-07-14T12:53:14.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.029+0000 7f7d9254b640 1 --2- 172.21.15.5:0/3267642340 >> v2:172.21.15.154:3300/0 conn(0x7f7d8c160750 0x7f7d8c15c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.029+0000 7f7d9254b640 1 --2- 172.21.15.5:0/3267642340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8c0b1620 0x7f7d8c0ce950 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.029+0000 7f7d9254b640 1 -- 172.21.15.5:0/3267642340 >> 172.21.15.5:0/3267642340 conn(0x7f7d8c069f50 msgr2=0x7f7d8c06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.029+0000 7f7d9254b640 1 -- 172.21.15.5:0/3267642340 shutdown_connections 2023-07-14T12:53:14.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.029+0000 7f7d9254b640 1 -- 172.21.15.5:0/3267642340 wait complete. 2023-07-14T12:53:14.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.029+0000 7f7d9254b640 1 Processor -- start 2023-07-14T12:53:14.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.029+0000 7f7d9254b640 1 -- start start 2023-07-14T12:53:14.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.029+0000 7f7d9254b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d8c0b1620 0x7f7d8c0b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:14.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.029+0000 7f7d9254b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8c0cc960 0x7f7d8c0c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:14.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.029+0000 7f7d9254b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d8c160750 0x7f7d8c0c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:14.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.029+0000 7f7d9254b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c0c88d0 con 0x7f7d8c0cc960 2023-07-14T12:53:14.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.029+0000 7f7d9254b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c0c7cc0 con 0x7f7d8c160750 2023-07-14T12:53:14.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.029+0000 7f7d9254b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c0c7fa0 con 0x7f7d8c0b1620 2023-07-14T12:53:14.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.033+0000 7f7d90d48640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8c0cc960 0x7f7d8c0c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:14.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.033+0000 7f7d90d48640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8c0cc960 0x7f7d8c0c9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55832/0 (socket says 172.21.15.5:55832) 2023-07-14T12:53:14.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.033+0000 7f7d90d48640 1 -- 172.21.15.5:0/2677847682 learned_addr learned my addr 172.21.15.5:0/2677847682 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:14.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.033+0000 7f7d91d4a640 1 --2- 172.21.15.5:0/2677847682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d8c160750 0x7f7d8c0c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:14.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.033+0000 7f7d91549640 1 --2- 172.21.15.5:0/2677847682 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d8c0b1620 0x7f7d8c0b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:14.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.033+0000 7f7d90d48640 1 -- 172.21.15.5:0/2677847682 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d8c0b1620 msgr2=0x7f7d8c0b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.033+0000 7f7d90d48640 1 --2- 172.21.15.5:0/2677847682 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d8c0b1620 0x7f7d8c0b2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.033+0000 7f7d90d48640 1 -- 172.21.15.5:0/2677847682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d8c160750 msgr2=0x7f7d8c0c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.033+0000 7f7d90d48640 1 --2- 172.21.15.5:0/2677847682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d8c160750 0x7f7d8c0c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.033+0000 7f7d90d48640 1 -- 172.21.15.5:0/2677847682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7c0094d0 con 0x7f7d8c0cc960 2023-07-14T12:53:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.033+0000 7f7d91d4a640 1 --2- 172.21.15.5:0/2677847682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d8c160750 0x7f7d8c0c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.033+0000 7f7d91549640 1 --2- 172.21.15.5:0/2677847682 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d8c0b1620 0x7f7d8c0b2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.033+0000 7f7d90d48640 1 --2- 172.21.15.5:0/2677847682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8c0cc960 0x7f7d8c0c9290 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c0190e0 tx=0x7f7d7c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:14.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.033+0000 7f7d81ffb640 1 -- 172.21.15.5:0/2677847682 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c0b38c0 con 0x7f7d8c0cc960 2023-07-14T12:53:14.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.033+0000 7f7d81ffb640 1 -- 172.21.15.5:0/2677847682 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7c0b3a40 con 0x7f7d8c0cc960 2023-07-14T12:53:14.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.033+0000 7f7d81ffb640 1 -- 172.21.15.5:0/2677847682 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c0b3df0 con 0x7f7d8c0cc960 2023-07-14T12:53:14.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.033+0000 7f7d9254b640 1 -- 172.21.15.5:0/2677847682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d8c0c8280 con 0x7f7d8c0cc960 2023-07-14T12:53:14.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.033+0000 7f7d9254b640 1 -- 172.21.15.5:0/2677847682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d8c0c7900 con 0x7f7d8c0cc960 2023-07-14T12:53:14.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.033+0000 7f7d9254b640 1 -- 172.21.15.5:0/2677847682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d8c0c8a80 con 0x7f7d8c0cc960 2023-07-14T12:53:14.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.033+0000 7f7d81ffb640 1 -- 172.21.15.5:0/2677847682 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7d7c0a9430 con 0x7f7d8c0cc960 2023-07-14T12:53:14.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.037+0000 7f7d81ffb640 1 --2- 172.21.15.5:0/2677847682 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7d70066280 0x7f7d70068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:14.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.037+0000 7f7d81ffb640 1 -- 172.21.15.5:0/2677847682 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7d7c11ec30 con 0x7f7d8c0cc960 2023-07-14T12:53:14.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.037+0000 7f7d91549640 1 --2- 172.21.15.5:0/2677847682 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7d70066280 0x7f7d70068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:14.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.037+0000 7f7d91549640 1 --2- 172.21.15.5:0/2677847682 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7d70066280 0x7f7d70068730 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7d88000f70 tx=0x7f7d88009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:14.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.041+0000 7f7d81ffb640 1 -- 172.21.15.5:0/2677847682 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7d8c0c8a80 con 0x7f7d8c0cc960 2023-07-14T12:53:14.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.193+0000 7f7d9254b640 1 -- 172.21.15.5:0/2677847682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7d8c04e020 con 0x7f7d8c0cc960 2023-07-14T12:53:14.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.193+0000 7f7d81ffb640 1 -- 172.21.15.5:0/2677847682 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7d7c0ec0a0 con 0x7f7d8c0cc960 2023-07-14T12:53:14.222 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T12:53:14.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.197+0000 7f7d9254b640 1 -- 172.21.15.5:0/2677847682 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7d70066280 msgr2=0x7f7d70068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:14.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.197+0000 7f7d9254b640 1 --2- 172.21.15.5:0/2677847682 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7d70066280 0x7f7d70068730 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7d88000f70 tx=0x7f7d88009040 comp rx=0 tx=0).stop 2023-07-14T12:53:14.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.197+0000 7f7d9254b640 1 -- 172.21.15.5:0/2677847682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8c0cc960 msgr2=0x7f7d8c0c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:14.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.197+0000 7f7d9254b640 1 --2- 172.21.15.5:0/2677847682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8c0cc960 0x7f7d8c0c9290 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c0190e0 tx=0x7f7d7c01ad10 comp rx=0 tx=0).stop 2023-07-14T12:53:14.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.197+0000 7f7d9254b640 1 -- 172.21.15.5:0/2677847682 shutdown_connections 2023-07-14T12:53:14.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.197+0000 7f7d9254b640 1 --2- 172.21.15.5:0/2677847682 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7d70066280 0x7f7d70068730 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.197+0000 7f7d9254b640 1 --2- 172.21.15.5:0/2677847682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d8c160750 0x7f7d8c0c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.197+0000 7f7d9254b640 1 --2- 172.21.15.5:0/2677847682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8c0cc960 0x7f7d8c0c9290 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.197+0000 7f7d9254b640 1 --2- 172.21.15.5:0/2677847682 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d8c0b1620 0x7f7d8c0b2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.197+0000 7f7d9254b640 1 -- 172.21.15.5:0/2677847682 >> 172.21.15.5:0/2677847682 conn(0x7f7d8c069f50 msgr2=0x7f7d8c0ccd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:14.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.197+0000 7f7d9254b640 1 -- 172.21.15.5:0/2677847682 shutdown_connections 2023-07-14T12:53:14.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.197+0000 7f7d9254b640 1 -- 172.21.15.5:0/2677847682 wait complete. 2023-07-14T12:53:14.243 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T12:53:14.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.361+0000 7fc472e5c640 1 Processor -- start 2023-07-14T12:53:14.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.361+0000 7fc472e5c640 1 -- start start 2023-07-14T12:53:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.361+0000 7fc472e5c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc46c15cef0 0x7fc46c158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.365+0000 7fc472e5c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc46c159270 0x7fc46c0c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.365+0000 7fc472e5c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc46c1532b0 con 0x7fc46c0aeb40 2023-07-14T12:53:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.365+0000 7fc472e5c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc46c15d360 con 0x7fc46c159270 2023-07-14T12:53:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.365+0000 7fc472e5c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c0ca6f0 con 0x7fc46c15cef0 2023-07-14T12:53:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.365+0000 7fc470bf8640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc46c0aeb40 0x7fc46c0aef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59438/0 (socket says 172.21.15.5:59438) 2023-07-14T12:53:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.365+0000 7fc470bf8640 1 -- 172.21.15.5:0/1889565527 learned_addr learned my addr 172.21.15.5:0/1889565527 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:14.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.365+0000 7fc4713f9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc46c159270 0x7fc46c0c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:14.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.365+0000 7fc46bfff640 1 --2- 172.21.15.5:0/1889565527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc46c15cef0 0x7fc46c158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:14.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.365+0000 7fc4713f9640 1 -- 172.21.15.5:0/1889565527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc46c15cef0 msgr2=0x7fc46c158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:14.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.365+0000 7fc4713f9640 1 --2- 172.21.15.5:0/1889565527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc46c15cef0 0x7fc46c158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.365+0000 7fc4713f9640 1 -- 172.21.15.5:0/1889565527 >> v1:172.21.15.5:6789/0 conn(0x7fc46c0aeb40 legacy=0x7fc46c0aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:14.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.365+0000 7fc4713f9640 1 -- 172.21.15.5:0/1889565527 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46c1599d0 con 0x7fc46c159270 2023-07-14T12:53:14.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.365+0000 7fc46b7fe640 1 -- 172.21.15.5:0/1889565527 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183591098 0 0) 0x7fc46c1532b0 con 0x7fc46c0aeb40 2023-07-14T12:53:14.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.365+0000 7fc4713f9640 1 --2- 172.21.15.5:0/1889565527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc46c159270 0x7fc46c0c88c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc464009d90 tx=0x7fc46401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b292a796aa3d7ba server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:14.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.365+0000 7fc46b7fe640 1 -- 172.21.15.5:0/1889565527 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4640a59e0 con 0x7fc46c159270 2023-07-14T12:53:14.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.369+0000 7fc46b7fe640 1 -- 172.21.15.5:0/1889565527 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4640a5b40 con 0x7fc46c159270 2023-07-14T12:53:14.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.369+0000 7fc46b7fe640 1 -- 172.21.15.5:0/1889565527 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4640ad440 con 0x7fc46c159270 2023-07-14T12:53:14.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.369+0000 7fc472e5c640 1 -- 172.21.15.5:0/1889565527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc46c159270 msgr2=0x7fc46c0c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:14.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.369+0000 7fc472e5c640 1 --2- 172.21.15.5:0/1889565527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc46c159270 0x7fc46c0c88c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc464009d90 tx=0x7fc46401c920 comp rx=0 tx=0).stop 2023-07-14T12:53:14.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.369+0000 7fc472e5c640 1 -- 172.21.15.5:0/1889565527 shutdown_connections 2023-07-14T12:53:14.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.369+0000 7fc472e5c640 1 --2- 172.21.15.5:0/1889565527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc46c159270 0x7fc46c0c88c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.369+0000 7fc472e5c640 1 --2- 172.21.15.5:0/1889565527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc46c15cef0 0x7fc46c158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.369+0000 7fc472e5c640 1 -- 172.21.15.5:0/1889565527 >> 172.21.15.5:0/1889565527 conn(0x7fc46c0cde90 msgr2=0x7fc46c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:14.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.369+0000 7fc472e5c640 1 -- 172.21.15.5:0/1889565527 shutdown_connections 2023-07-14T12:53:14.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.369+0000 7fc472e5c640 1 -- 172.21.15.5:0/1889565527 wait complete. 2023-07-14T12:53:14.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.369+0000 7fc472e5c640 1 Processor -- start 2023-07-14T12:53:14.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.369+0000 7fc472e5c640 1 -- start start 2023-07-14T12:53:14.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.369+0000 7fc472e5c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc46c0aeb40 0x7fc46c155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:14.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.369+0000 7fc472e5c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc46c159270 0x7fc46c070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:14.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.369+0000 7fc472e5c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc46c15cef0 0x7fc46c06fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:14.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.369+0000 7fc472e5c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c153020 con 0x7fc46c0aeb40 2023-07-14T12:53:14.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.369+0000 7fc472e5c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c06f400 con 0x7fc46c15cef0 2023-07-14T12:53:14.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.369+0000 7fc472e5c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c0ac3a0 con 0x7fc46c159270 2023-07-14T12:53:14.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.369+0000 7fc470bf8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc46c0aeb40 0x7fc46c155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:14.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.369+0000 7fc470bf8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc46c0aeb40 0x7fc46c155760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55854/0 (socket says 172.21.15.5:55854) 2023-07-14T12:53:14.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.369+0000 7fc470bf8640 1 -- 172.21.15.5:0/3228490259 learned_addr learned my addr 172.21.15.5:0/3228490259 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:14.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.373+0000 7fc46bfff640 1 --2- 172.21.15.5:0/3228490259 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc46c159270 0x7fc46c070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:14.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.373+0000 7fc4713f9640 1 --2- 172.21.15.5:0/3228490259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc46c15cef0 0x7fc46c06fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:14.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.373+0000 7fc470bf8640 1 -- 172.21.15.5:0/3228490259 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc46c159270 msgr2=0x7fc46c070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:14.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.373+0000 7fc470bf8640 1 --2- 172.21.15.5:0/3228490259 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc46c159270 0x7fc46c070be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.373+0000 7fc470bf8640 1 -- 172.21.15.5:0/3228490259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc46c15cef0 msgr2=0x7fc46c06fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.373+0000 7fc470bf8640 1 --2- 172.21.15.5:0/3228490259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc46c15cef0 0x7fc46c06fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.373+0000 7fc470bf8640 1 -- 172.21.15.5:0/3228490259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc464009a70 con 0x7fc46c0aeb40 2023-07-14T12:53:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.373+0000 7fc46bfff640 1 --2- 172.21.15.5:0/3228490259 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc46c159270 0x7fc46c070be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.373+0000 7fc4713f9640 1 --2- 172.21.15.5:0/3228490259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc46c15cef0 0x7fc46c06fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.373+0000 7fc470bf8640 1 --2- 172.21.15.5:0/3228490259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc46c0aeb40 0x7fc46c155760 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc46000c520 tx=0x7fc46000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.373+0000 7fc4697fa640 1 -- 172.21.15.5:0/3228490259 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4600074e0 con 0x7fc46c0aeb40 2023-07-14T12:53:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.373+0000 7fc4697fa640 1 -- 172.21.15.5:0/3228490259 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc460007640 con 0x7fc46c0aeb40 2023-07-14T12:53:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.373+0000 7fc4697fa640 1 -- 172.21.15.5:0/3228490259 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4600049f0 con 0x7fc46c0aeb40 2023-07-14T12:53:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.373+0000 7fc472e5c640 1 -- 172.21.15.5:0/3228490259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc46c152780 con 0x7fc46c0aeb40 2023-07-14T12:53:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.373+0000 7fc472e5c640 1 -- 172.21.15.5:0/3228490259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc46c152d40 con 0x7fc46c0aeb40 2023-07-14T12:53:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.373+0000 7fc472e5c640 1 -- 172.21.15.5:0/3228490259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc46c0ceb60 con 0x7fc46c0aeb40 2023-07-14T12:53:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.373+0000 7fc4697fa640 1 -- 172.21.15.5:0/3228490259 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc460004b50 con 0x7fc46c0aeb40 2023-07-14T12:53:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.373+0000 7fc4697fa640 1 --2- 172.21.15.5:0/3228490259 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc4500662b0 0x7fc450068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.373+0000 7fc4697fa640 1 -- 172.21.15.5:0/3228490259 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc460082dc0 con 0x7fc46c0aeb40 2023-07-14T12:53:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.377+0000 7fc46bfff640 1 --2- 172.21.15.5:0/3228490259 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc4500662b0 0x7fc450068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.377+0000 7fc46bfff640 1 --2- 172.21.15.5:0/3228490259 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc4500662b0 0x7fc450068760 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc46c0708b0 tx=0x7fc458008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:14.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.377+0000 7fc4697fa640 1 -- 172.21.15.5:0/3228490259 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc460050380 con 0x7fc46c0aeb40 2023-07-14T12:53:14.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.533+0000 7fc472e5c640 1 -- 172.21.15.5:0/3228490259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc46c0678d0 con 0x7fc46c0aeb40 2023-07-14T12:53:14.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.533+0000 7fc4697fa640 1 -- 172.21.15.5:0/3228490259 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc460018020 con 0x7fc46c0aeb40 2023-07-14T12:53:14.561 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T12:53:14.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.533+0000 7fc472e5c640 1 -- 172.21.15.5:0/3228490259 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc4500662b0 msgr2=0x7fc450068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:14.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.533+0000 7fc472e5c640 1 --2- 172.21.15.5:0/3228490259 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc4500662b0 0x7fc450068760 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc46c0708b0 tx=0x7fc458008040 comp rx=0 tx=0).stop 2023-07-14T12:53:14.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.533+0000 7fc472e5c640 1 -- 172.21.15.5:0/3228490259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc46c0aeb40 msgr2=0x7fc46c155760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:14.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.533+0000 7fc472e5c640 1 --2- 172.21.15.5:0/3228490259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc46c0aeb40 0x7fc46c155760 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc46000c520 tx=0x7fc46000c9e0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.537+0000 7fc472e5c640 1 -- 172.21.15.5:0/3228490259 shutdown_connections 2023-07-14T12:53:14.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.537+0000 7fc472e5c640 1 --2- 172.21.15.5:0/3228490259 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc4500662b0 0x7fc450068760 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.537+0000 7fc472e5c640 1 --2- 172.21.15.5:0/3228490259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc46c15cef0 0x7fc46c06fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.537+0000 7fc472e5c640 1 --2- 172.21.15.5:0/3228490259 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc46c159270 0x7fc46c070be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.537+0000 7fc472e5c640 1 --2- 172.21.15.5:0/3228490259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc46c0aeb40 0x7fc46c155760 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.537+0000 7fc472e5c640 1 -- 172.21.15.5:0/3228490259 >> 172.21.15.5:0/3228490259 conn(0x7fc46c0cde90 msgr2=0x7fc46c0acf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:14.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.537+0000 7fc472e5c640 1 -- 172.21.15.5:0/3228490259 shutdown_connections 2023-07-14T12:53:14.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.537+0000 7fc472e5c640 1 -- 172.21.15.5:0/3228490259 wait complete. 2023-07-14T12:53:14.582 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T12:53:14.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.701+0000 7fca2260b640 1 Processor -- start 2023-07-14T12:53:14.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.701+0000 7fca2260b640 1 -- start start 2023-07-14T12:53:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.701+0000 7fca2260b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fca1c0cb0f0 0x7fca1c069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:14.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.701+0000 7fca2260b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c06d2d0 0x7fca1c06d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:14.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.701+0000 7fca2260b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca1c0cb570 con 0x7fca1c069430 2023-07-14T12:53:14.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.701+0000 7fca2260b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca1c069d40 con 0x7fca1c0cb0f0 2023-07-14T12:53:14.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.701+0000 7fca2260b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1c0cb7d0 con 0x7fca1c06d2d0 2023-07-14T12:53:14.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.701+0000 7fca1bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fca1c069430 0x7fca1c160030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59450/0 (socket says 172.21.15.5:59450) 2023-07-14T12:53:14.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.701+0000 7fca1bfff640 1 -- 172.21.15.5:0/4216535625 learned_addr learned my addr 172.21.15.5:0/4216535625 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:14.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.705+0000 7fca20ba8640 1 --2- 172.21.15.5:0/4216535625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c06d2d0 0x7fca1c06d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.705+0000 7fca13fff640 1 --2- 172.21.15.5:0/4216535625 >> v2:172.21.15.154:3300/0 conn(0x7fca1c0cb0f0 0x7fca1c069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.705+0000 7fca1b7fe640 1 -- 172.21.15.5:0/4216535625 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3689658151 0 0) 0x7fca1c0cb570 con 0x7fca1c069430 2023-07-14T12:53:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.705+0000 7fca1b7fe640 1 -- 172.21.15.5:0/4216535625 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca08003530 con 0x7fca1c069430 2023-07-14T12:53:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.705+0000 7fca20ba8640 1 -- 172.21.15.5:0/4216535625 >> v2:172.21.15.154:3300/0 conn(0x7fca1c0cb0f0 msgr2=0x7fca1c069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.705+0000 7fca20ba8640 1 --2- 172.21.15.5:0/4216535625 >> v2:172.21.15.154:3300/0 conn(0x7fca1c0cb0f0 0x7fca1c069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.705+0000 7fca1b7fe640 1 -- 172.21.15.5:0/4216535625 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2549430268 0 0) 0x7fca08003530 con 0x7fca1c069430 2023-07-14T12:53:14.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.705+0000 7fca20ba8640 1 -- 172.21.15.5:0/4216535625 >> v1:172.21.15.5:6789/0 conn(0x7fca1c069430 legacy=0x7fca1c160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:14.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.705+0000 7fca20ba8640 1 -- 172.21.15.5:0/4216535625 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1c06c510 con 0x7fca1c06d2d0 2023-07-14T12:53:14.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.705+0000 7fca20ba8640 1 --2- 172.21.15.5:0/4216535625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c06d2d0 0x7fca1c06d730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fca14009d90 tx=0x7fca1401c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ef4bcf72f72ae0b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:14.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.709+0000 7fca1b7fe640 1 -- 172.21.15.5:0/4216535625 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0c001680 con 0x7fca1c06d2d0 2023-07-14T12:53:14.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.709+0000 7fca1b7fe640 1 -- 172.21.15.5:0/4216535625 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca140a55b0 con 0x7fca1c06d2d0 2023-07-14T12:53:14.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.709+0000 7fca1b7fe640 1 -- 172.21.15.5:0/4216535625 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca140a5920 con 0x7fca1c06d2d0 2023-07-14T12:53:14.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.709+0000 7fca2260b640 1 -- 172.21.15.5:0/4216535625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c06d2d0 msgr2=0x7fca1c06d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:14.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.709+0000 7fca2260b640 1 --2- 172.21.15.5:0/4216535625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c06d2d0 0x7fca1c06d730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fca14009d90 tx=0x7fca1401c7b0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.709+0000 7fca2260b640 1 -- 172.21.15.5:0/4216535625 shutdown_connections 2023-07-14T12:53:14.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.709+0000 7fca2260b640 1 --2- 172.21.15.5:0/4216535625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c06d2d0 0x7fca1c06d730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.709+0000 7fca2260b640 1 --2- 172.21.15.5:0/4216535625 >> v2:172.21.15.154:3300/0 conn(0x7fca1c0cb0f0 0x7fca1c069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.709+0000 7fca2260b640 1 -- 172.21.15.5:0/4216535625 >> 172.21.15.5:0/4216535625 conn(0x7fca1c0b1840 msgr2=0x7fca1c0cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:14.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.709+0000 7fca2260b640 1 -- 172.21.15.5:0/4216535625 shutdown_connections 2023-07-14T12:53:14.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.709+0000 7fca2260b640 1 -- 172.21.15.5:0/4216535625 wait complete. 2023-07-14T12:53:14.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.709+0000 7fca2260b640 1 Processor -- start 2023-07-14T12:53:14.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.709+0000 7fca2260b640 1 -- start start 2023-07-14T12:53:14.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.709+0000 7fca2260b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c069430 0x7fca1c15e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:14.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.709+0000 7fca2260b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca1c06d2d0 0x7fca1c0b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:14.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.709+0000 7fca2260b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca1c0cb0f0 0x7fca1c157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:14.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.709+0000 7fca2260b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1c0c8280 con 0x7fca1c0cb0f0 2023-07-14T12:53:14.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.709+0000 7fca2260b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1c0c7670 con 0x7fca1c06d2d0 2023-07-14T12:53:14.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.709+0000 7fca2260b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1c0c7950 con 0x7fca1c069430 2023-07-14T12:53:14.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.709+0000 7fca20ba8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca1c0cb0f0 0x7fca1c157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:14.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.709+0000 7fca20ba8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca1c0cb0f0 0x7fca1c157480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55858/0 (socket says 172.21.15.5:55858) 2023-07-14T12:53:14.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.709+0000 7fca20ba8640 1 -- 172.21.15.5:0/2546321937 learned_addr learned my addr 172.21.15.5:0/2546321937 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:14.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.709+0000 7fca1bfff640 1 --2- 172.21.15.5:0/2546321937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c069430 0x7fca1c15e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:14.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.709+0000 7fca13fff640 1 --2- 172.21.15.5:0/2546321937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca1c06d2d0 0x7fca1c0b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:14.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.713+0000 7fca20ba8640 1 -- 172.21.15.5:0/2546321937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c069430 msgr2=0x7fca1c15e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:14.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.713+0000 7fca20ba8640 1 --2- 172.21.15.5:0/2546321937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c069430 0x7fca1c15e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.713+0000 7fca20ba8640 1 -- 172.21.15.5:0/2546321937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca1c06d2d0 msgr2=0x7fca1c0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:14.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.713+0000 7fca20ba8640 1 --2- 172.21.15.5:0/2546321937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca1c06d2d0 0x7fca1c0b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.713+0000 7fca20ba8640 1 -- 172.21.15.5:0/2546321937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca14009a70 con 0x7fca1c0cb0f0 2023-07-14T12:53:14.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.713+0000 7fca20ba8640 1 --2- 172.21.15.5:0/2546321937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca1c0cb0f0 0x7fca1c157480 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fca1401ae60 tx=0x7fca14019550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:14.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.713+0000 7fca197fa640 1 -- 172.21.15.5:0/2546321937 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca14009450 con 0x7fca1c0cb0f0 2023-07-14T12:53:14.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.713+0000 7fca197fa640 1 -- 172.21.15.5:0/2546321937 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca140a5930 con 0x7fca1c0cb0f0 2023-07-14T12:53:14.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.713+0000 7fca197fa640 1 -- 172.21.15.5:0/2546321937 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca140a5cc0 con 0x7fca1c0cb0f0 2023-07-14T12:53:14.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.713+0000 7fca2260b640 1 -- 172.21.15.5:0/2546321937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca1c0c7c30 con 0x7fca1c0cb0f0 2023-07-14T12:53:14.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.713+0000 7fca2260b640 1 -- 172.21.15.5:0/2546321937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca1c0c8df0 con 0x7fca1c0cb0f0 2023-07-14T12:53:14.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.713+0000 7fca2260b640 1 -- 172.21.15.5:0/2546321937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca1c0c8430 con 0x7fca1c0cb0f0 2023-07-14T12:53:14.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.713+0000 7fca197fa640 1 -- 172.21.15.5:0/2546321937 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fca140b4070 con 0x7fca1c0cb0f0 2023-07-14T12:53:14.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.717+0000 7fca197fa640 1 --2- 172.21.15.5:0/2546321937 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc9fc066280 0x7fc9fc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:14.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.717+0000 7fca197fa640 1 -- 172.21.15.5:0/2546321937 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fca1411e150 con 0x7fca1c0cb0f0 2023-07-14T12:53:14.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.717+0000 7fca1bfff640 1 --2- 172.21.15.5:0/2546321937 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc9fc066280 0x7fc9fc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:14.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.717+0000 7fca1bfff640 1 --2- 172.21.15.5:0/2546321937 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc9fc066280 0x7fc9fc068730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fca0c007a10 tx=0x7fca0c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:14.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.721+0000 7fca197fa640 1 -- 172.21.15.5:0/2546321937 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fca1c0c8430 con 0x7fca1c0cb0f0 2023-07-14T12:53:14.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.877+0000 7fca2260b640 1 -- 172.21.15.5:0/2546321937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fca1c0678d0 con 0x7fca1c0cb0f0 2023-07-14T12:53:14.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.877+0000 7fca197fa640 1 -- 172.21.15.5:0/2546321937 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fca140eefc0 con 0x7fca1c0cb0f0 2023-07-14T12:53:14.904 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T12:53:14.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.877+0000 7fca2260b640 1 -- 172.21.15.5:0/2546321937 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc9fc066280 msgr2=0x7fc9fc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:14.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.877+0000 7fca2260b640 1 --2- 172.21.15.5:0/2546321937 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc9fc066280 0x7fc9fc068730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fca0c007a10 tx=0x7fca0c009040 comp rx=0 tx=0).stop 2023-07-14T12:53:14.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.877+0000 7fca2260b640 1 -- 172.21.15.5:0/2546321937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca1c0cb0f0 msgr2=0x7fca1c157480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:14.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.877+0000 7fca2260b640 1 --2- 172.21.15.5:0/2546321937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca1c0cb0f0 0x7fca1c157480 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fca1401ae60 tx=0x7fca14019550 comp rx=0 tx=0).stop 2023-07-14T12:53:14.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.877+0000 7fca2260b640 1 -- 172.21.15.5:0/2546321937 shutdown_connections 2023-07-14T12:53:14.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.877+0000 7fca2260b640 1 --2- 172.21.15.5:0/2546321937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca1c0cb0f0 0x7fca1c157480 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.877+0000 7fca2260b640 1 --2- 172.21.15.5:0/2546321937 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc9fc066280 0x7fc9fc068730 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.877+0000 7fca2260b640 1 --2- 172.21.15.5:0/2546321937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca1c06d2d0 0x7fca1c0b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.877+0000 7fca2260b640 1 --2- 172.21.15.5:0/2546321937 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca1c069430 0x7fca1c15e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:14.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.877+0000 7fca2260b640 1 -- 172.21.15.5:0/2546321937 >> 172.21.15.5:0/2546321937 conn(0x7fca1c0b1840 msgr2=0x7fca1c15aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:14.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.877+0000 7fca2260b640 1 -- 172.21.15.5:0/2546321937 shutdown_connections 2023-07-14T12:53:14.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:14.877+0000 7fca2260b640 1 -- 172.21.15.5:0/2546321937 wait complete. 2023-07-14T12:53:14.926 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:53:15.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.041+0000 7f3e32540640 1 Processor -- start 2023-07-14T12:53:15.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.041+0000 7f3e32540640 1 -- start start 2023-07-14T12:53:15.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.045+0000 7f3e32540640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e2c06b1e0 0x7f3e2c0c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:15.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.045+0000 7f3e32540640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3e2c0c21f0 0x7f3e2c0cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:15.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.045+0000 7f3e32540640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e2c0cac70 con 0x7f3e2c070b70 2023-07-14T12:53:15.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.045+0000 7f3e32540640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e2c0ca060 con 0x7f3e2c0c21f0 2023-07-14T12:53:15.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.045+0000 7f3e32540640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c0ca340 con 0x7f3e2c06b1e0 2023-07-14T12:53:15.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.045+0000 7f3e30add640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3e2c0c21f0 0x7f3e2c0cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:15.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.045+0000 7f3e30add640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3e2c0c21f0 0x7f3e2c0cb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55874/0 (socket says 172.21.15.5:55874) 2023-07-14T12:53:15.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.045+0000 7f3e30add640 1 -- 172.21.15.5:0/2775635650 learned_addr learned my addr 172.21.15.5:0/2775635650 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:15.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.045+0000 7f3e2b7fe640 1 --2- 172.21.15.5:0/2775635650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e2c06b1e0 0x7f3e2c0c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:15.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.045+0000 7f3e30add640 1 -- 172.21.15.5:0/2775635650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e2c06b1e0 msgr2=0x7f3e2c0c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:15.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.045+0000 7f3e30add640 1 --2- 172.21.15.5:0/2775635650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e2c06b1e0 0x7f3e2c0c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.045+0000 7f3e30add640 1 -- 172.21.15.5:0/2775635650 >> v1:172.21.15.154:6789/0 conn(0x7f3e2c070b70 legacy=0x7f3e2c070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:15.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.045+0000 7f3e30add640 1 -- 172.21.15.5:0/2775635650 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e2c0ca620 con 0x7f3e2c0c21f0 2023-07-14T12:53:15.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.045+0000 7f3e2b7fe640 1 --2- 172.21.15.5:0/2775635650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e2c06b1e0 0x7f3e2c0c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:15.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.049+0000 7f3e30add640 1 --2- 172.21.15.5:0/2775635650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e2c0c21f0 0x7f3e2c0cb100 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3e24009e50 tx=0x7f3e2401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e2726df803764c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:15.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.049+0000 7f3e2affd640 1 -- 172.21.15.5:0/2775635650 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e240a57b0 con 0x7f3e2c0c21f0 2023-07-14T12:53:15.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.049+0000 7f3e2affd640 1 -- 172.21.15.5:0/2775635650 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e240a5910 con 0x7f3e2c0c21f0 2023-07-14T12:53:15.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.049+0000 7f3e2affd640 1 -- 172.21.15.5:0/2775635650 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e240a5ca0 con 0x7f3e2c0c21f0 2023-07-14T12:53:15.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.049+0000 7f3e32540640 1 -- 172.21.15.5:0/2775635650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e2c0c21f0 msgr2=0x7f3e2c0cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:15.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.049+0000 7f3e32540640 1 --2- 172.21.15.5:0/2775635650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e2c0c21f0 0x7f3e2c0cb100 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3e24009e50 tx=0x7f3e2401c910 comp rx=0 tx=0).stop 2023-07-14T12:53:15.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.049+0000 7f3e32540640 1 -- 172.21.15.5:0/2775635650 shutdown_connections 2023-07-14T12:53:15.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.049+0000 7f3e32540640 1 --2- 172.21.15.5:0/2775635650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e2c0c21f0 0x7f3e2c0cb100 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.049+0000 7f3e32540640 1 --2- 172.21.15.5:0/2775635650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e2c06b1e0 0x7f3e2c0c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.049+0000 7f3e32540640 1 -- 172.21.15.5:0/2775635650 >> 172.21.15.5:0/2775635650 conn(0x7f3e2c0afcf0 msgr2=0x7f3e2c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:15.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.049+0000 7f3e32540640 1 -- 172.21.15.5:0/2775635650 shutdown_connections 2023-07-14T12:53:15.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.049+0000 7f3e32540640 1 -- 172.21.15.5:0/2775635650 wait complete. 2023-07-14T12:53:15.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.049+0000 7f3e32540640 1 Processor -- start 2023-07-14T12:53:15.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.049+0000 7f3e32540640 1 -- start start 2023-07-14T12:53:15.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.053+0000 7f3e32540640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e2c06b1e0 0x7f3e2c154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:15.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.053+0000 7f3e32540640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e2c070b70 0x7f3e2c158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:15.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.053+0000 7f3e32540640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e2c0c21f0 0x7f3e2c158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:15.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.053+0000 7f3e32540640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c1f5790 con 0x7f3e2c06b1e0 2023-07-14T12:53:15.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.053+0000 7f3e32540640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c14e350 con 0x7f3e2c0c21f0 2023-07-14T12:53:15.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.053+0000 7f3e32540640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c1f59e0 con 0x7f3e2c070b70 2023-07-14T12:53:15.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.053+0000 7f3e2bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e2c06b1e0 0x7f3e2c154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:15.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.053+0000 7f3e2bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e2c06b1e0 0x7f3e2c154a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55876/0 (socket says 172.21.15.5:55876) 2023-07-14T12:53:15.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.053+0000 7f3e2bfff640 1 -- 172.21.15.5:0/1222837119 learned_addr learned my addr 172.21.15.5:0/1222837119 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:15.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.053+0000 7f3e2bfff640 1 -- 172.21.15.5:0/1222837119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e2c070b70 msgr2=0x7f3e2c158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:15.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.053+0000 7f3e2bfff640 1 --2- 172.21.15.5:0/1222837119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e2c070b70 0x7f3e2c158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.053+0000 7f3e2bfff640 1 -- 172.21.15.5:0/1222837119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e2c0c21f0 msgr2=0x7f3e2c158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:15.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.053+0000 7f3e2bfff640 1 --2- 172.21.15.5:0/1222837119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e2c0c21f0 0x7f3e2c158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.053+0000 7f3e2bfff640 1 -- 172.21.15.5:0/1222837119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e24009b30 con 0x7f3e2c06b1e0 2023-07-14T12:53:15.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.053+0000 7f3e2bfff640 1 --2- 172.21.15.5:0/1222837119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e2c06b1e0 0x7f3e2c154a50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00c480 tx=0x7f3e1c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:15.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.053+0000 7f3e28ff9640 1 -- 172.21.15.5:0/1222837119 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c012830 con 0x7f3e2c06b1e0 2023-07-14T12:53:15.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.053+0000 7f3e28ff9640 1 -- 172.21.15.5:0/1222837119 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1c0129b0 con 0x7f3e2c06b1e0 2023-07-14T12:53:15.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.053+0000 7f3e28ff9640 1 -- 172.21.15.5:0/1222837119 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c012d60 con 0x7f3e2c06b1e0 2023-07-14T12:53:15.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.053+0000 7f3e32540640 1 -- 172.21.15.5:0/1222837119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e2c1f5cc0 con 0x7f3e2c06b1e0 2023-07-14T12:53:15.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.053+0000 7f3e32540640 1 -- 172.21.15.5:0/1222837119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e2c1f6280 con 0x7f3e2c06b1e0 2023-07-14T12:53:15.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.053+0000 7f3e32540640 1 -- 172.21.15.5:0/1222837119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e2c1f64a0 con 0x7f3e2c06b1e0 2023-07-14T12:53:15.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.053+0000 7f3e28ff9640 1 -- 172.21.15.5:0/1222837119 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3e1c01c460 con 0x7f3e2c06b1e0 2023-07-14T12:53:15.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.057+0000 7f3e28ff9640 1 --2- 172.21.15.5:0/1222837119 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3e18066280 0x7f3e18068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:15.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.057+0000 7f3e28ff9640 1 -- 172.21.15.5:0/1222837119 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3e1c083c80 con 0x7f3e2c06b1e0 2023-07-14T12:53:15.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.057+0000 7f3e2b7fe640 1 --2- 172.21.15.5:0/1222837119 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3e18066280 0x7f3e18068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:15.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.057+0000 7f3e2b7fe640 1 --2- 172.21.15.5:0/1222837119 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3e18066280 0x7f3e18068730 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0b12f0 tx=0x7f3e20008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:15.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.061+0000 7f3e28ff9640 1 -- 172.21.15.5:0/1222837119 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3e1c0510f0 con 0x7f3e2c06b1e0 2023-07-14T12:53:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.217+0000 7f3e32540640 1 -- 172.21.15.5:0/1222837119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e2c0678d0 con 0x7f3e2c06b1e0 2023-07-14T12:53:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.217+0000 7f3e28ff9640 1 -- 172.21.15.5:0/1222837119 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18231 (secure 0 0 0) 0x7f3e1c054710 con 0x7f3e2c06b1e0 2023-07-14T12:53:15.245 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:15.245 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":23,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:52:48.091483+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:52:44.223082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T12:52:45.469396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:53:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.217+0000 7f3e32540640 1 -- 172.21.15.5:0/1222837119 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3e18066280 msgr2=0x7f3e18068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.217+0000 7f3e32540640 1 --2- 172.21.15.5:0/1222837119 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3e18066280 0x7f3e18068730 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0b12f0 tx=0x7f3e20008040 comp rx=0 tx=0).stop 2023-07-14T12:53:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.217+0000 7f3e32540640 1 -- 172.21.15.5:0/1222837119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e2c06b1e0 msgr2=0x7f3e2c154a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.217+0000 7f3e32540640 1 --2- 172.21.15.5:0/1222837119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e2c06b1e0 0x7f3e2c154a50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00c480 tx=0x7f3e1c00c940 comp rx=0 tx=0).stop 2023-07-14T12:53:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.217+0000 7f3e32540640 1 -- 172.21.15.5:0/1222837119 shutdown_connections 2023-07-14T12:53:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.217+0000 7f3e32540640 1 --2- 172.21.15.5:0/1222837119 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3e18066280 0x7f3e18068730 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.217+0000 7f3e32540640 1 --2- 172.21.15.5:0/1222837119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e2c0c21f0 0x7f3e2c158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.217+0000 7f3e32540640 1 --2- 172.21.15.5:0/1222837119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e2c070b70 0x7f3e2c158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.217+0000 7f3e32540640 1 --2- 172.21.15.5:0/1222837119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e2c06b1e0 0x7f3e2c154a50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.217+0000 7f3e32540640 1 -- 172.21.15.5:0/1222837119 >> 172.21.15.5:0/1222837119 conn(0x7f3e2c0afcf0 msgr2=0x7f3e2c148d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.217+0000 7f3e32540640 1 -- 172.21.15.5:0/1222837119 shutdown_connections 2023-07-14T12:53:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.217+0000 7f3e32540640 1 -- 172.21.15.5:0/1222837119 wait complete. 2023-07-14T12:53:15.266 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T12:52:44.223082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T12:52:45.469396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T12:53:15.267 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T12:53:15.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.385+0000 7fcdff8f9640 1 Processor -- start 2023-07-14T12:53:15.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.385+0000 7fcdff8f9640 1 -- start start 2023-07-14T12:53:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.385+0000 7fcdff8f9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcdf80c3ac0 0x7fcdf80c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.385+0000 7fcdff8f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdf80cd120 0x7fcdf80cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.385+0000 7fcdff8f9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf80695b0 con 0x7fcdf80af2b0 2023-07-14T12:53:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.385+0000 7fcdff8f9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf8069890 con 0x7fcdf80c3ac0 2023-07-14T12:53:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.385+0000 7fcdff8f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf8069b70 con 0x7fcdf80cd120 2023-07-14T12:53:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.385+0000 7fcdfd695640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcdf80c3ac0 0x7fcdf80c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.389+0000 7fcdfd695640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcdf80c3ac0 0x7fcdf80c2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55886/0 (socket says 172.21.15.5:55886) 2023-07-14T12:53:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.389+0000 7fcdfd695640 1 -- 172.21.15.5:0/2428982264 learned_addr learned my addr 172.21.15.5:0/2428982264 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.389+0000 7fcdfde96640 1 --2- 172.21.15.5:0/2428982264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdf80cd120 0x7fcdf80cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.389+0000 7fcdfd695640 1 -- 172.21.15.5:0/2428982264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdf80cd120 msgr2=0x7fcdf80cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.389+0000 7fcdfd695640 1 --2- 172.21.15.5:0/2428982264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdf80cd120 0x7fcdf80cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.389+0000 7fcdfd695640 1 -- 172.21.15.5:0/2428982264 >> v1:172.21.15.154:6789/0 conn(0x7fcdf80af2b0 legacy=0x7fcdf80ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:15.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.389+0000 7fcdfd695640 1 -- 172.21.15.5:0/2428982264 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf8069e50 con 0x7fcdf80c3ac0 2023-07-14T12:53:15.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.389+0000 7fcdfde96640 1 --2- 172.21.15.5:0/2428982264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdf80cd120 0x7fcdf80cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:15.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.389+0000 7fcdfd695640 1 --2- 172.21.15.5:0/2428982264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdf80c3ac0 0x7fcdf80c2d30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4009870 tx=0x7fcdf401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a91d8b0d00da042 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:15.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.389+0000 7fcdeffff640 1 -- 172.21.15.5:0/2428982264 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40aa430 con 0x7fcdf80c3ac0 2023-07-14T12:53:15.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.389+0000 7fcdeffff640 1 -- 172.21.15.5:0/2428982264 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf40aa590 con 0x7fcdf80c3ac0 2023-07-14T12:53:15.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.389+0000 7fcdeffff640 1 -- 172.21.15.5:0/2428982264 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40aa920 con 0x7fcdf80c3ac0 2023-07-14T12:53:15.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.393+0000 7fcdff8f9640 1 -- 172.21.15.5:0/2428982264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdf80c3ac0 msgr2=0x7fcdf80c2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:15.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.393+0000 7fcdff8f9640 1 --2- 172.21.15.5:0/2428982264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdf80c3ac0 0x7fcdf80c2d30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4009870 tx=0x7fcdf401c4b0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.393+0000 7fcdff8f9640 1 -- 172.21.15.5:0/2428982264 shutdown_connections 2023-07-14T12:53:15.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.393+0000 7fcdff8f9640 1 --2- 172.21.15.5:0/2428982264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdf80cd120 0x7fcdf80cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.393+0000 7fcdff8f9640 1 --2- 172.21.15.5:0/2428982264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdf80c3ac0 0x7fcdf80c2d30 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.393+0000 7fcdff8f9640 1 -- 172.21.15.5:0/2428982264 >> 172.21.15.5:0/2428982264 conn(0x7fcdf80cde90 msgr2=0x7fcdf80ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:15.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.393+0000 7fcdff8f9640 1 -- 172.21.15.5:0/2428982264 shutdown_connections 2023-07-14T12:53:15.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.393+0000 7fcdff8f9640 1 -- 172.21.15.5:0/2428982264 wait complete. 2023-07-14T12:53:15.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.393+0000 7fcdff8f9640 1 Processor -- start 2023-07-14T12:53:15.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.393+0000 7fcdff8f9640 1 -- start start 2023-07-14T12:53:15.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.393+0000 7fcdff8f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdf80af2b0 0x7fcdf8142f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:15.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.393+0000 7fcdff8f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdf80c3ac0 0x7fcdf80c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:15.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.393+0000 7fcdff8f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdf80cd120 0x7fcdf8158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:15.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.393+0000 7fcdff8f9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf80c8980 con 0x7fcdf80cd120 2023-07-14T12:53:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.393+0000 7fcdff8f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf80c8050 con 0x7fcdf80af2b0 2023-07-14T12:53:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.393+0000 7fcdff8f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf80c8330 con 0x7fcdf80c3ac0 2023-07-14T12:53:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.393+0000 7fcdfde96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdf80cd120 0x7fcdf8158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.393+0000 7fcdfd695640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdf80af2b0 0x7fcdf8142f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.393+0000 7fcdfde96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdf80cd120 0x7fcdf8158b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55900/0 (socket says 172.21.15.5:55900) 2023-07-14T12:53:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.393+0000 7fcdfde96640 1 -- 172.21.15.5:0/4094186172 learned_addr learned my addr 172.21.15.5:0/4094186172 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.393+0000 7fcdfce94640 1 --2- 172.21.15.5:0/4094186172 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdf80c3ac0 0x7fcdf80c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.393+0000 7fcdfde96640 1 -- 172.21.15.5:0/4094186172 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdf80c3ac0 msgr2=0x7fcdf80c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.393+0000 7fcdfde96640 1 --2- 172.21.15.5:0/4094186172 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdf80c3ac0 0x7fcdf80c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.393+0000 7fcdfde96640 1 -- 172.21.15.5:0/4094186172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdf80af2b0 msgr2=0x7fcdf8142f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.393+0000 7fcdfde96640 1 --2- 172.21.15.5:0/4094186172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdf80af2b0 0x7fcdf8142f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.393+0000 7fcdfde96640 1 -- 172.21.15.5:0/4094186172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf40094d0 con 0x7fcdf80cd120 2023-07-14T12:53:15.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.393+0000 7fcdfce94640 1 --2- 172.21.15.5:0/4094186172 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdf80c3ac0 0x7fcdf80c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.397+0000 7fcdfde96640 1 --2- 172.21.15.5:0/4094186172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdf80cd120 0x7fcdf8158b60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0007df0 tx=0x7fcdf000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.397+0000 7fcdedffb640 1 -- 172.21.15.5:0/4094186172 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf00039a0 con 0x7fcdf80cd120 2023-07-14T12:53:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.397+0000 7fcdedffb640 1 -- 172.21.15.5:0/4094186172 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf000f040 con 0x7fcdf80cd120 2023-07-14T12:53:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.397+0000 7fcdedffb640 1 -- 172.21.15.5:0/4094186172 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf0003d40 con 0x7fcdf80cd120 2023-07-14T12:53:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.397+0000 7fcdff8f9640 1 -- 172.21.15.5:0/4094186172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf80c8610 con 0x7fcdf80cd120 2023-07-14T12:53:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.397+0000 7fcdff8f9640 1 -- 172.21.15.5:0/4094186172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf80c7c70 con 0x7fcdf80cd120 2023-07-14T12:53:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.397+0000 7fcdff8f9640 1 -- 172.21.15.5:0/4094186172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf80c8af0 con 0x7fcdf80cd120 2023-07-14T12:53:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.397+0000 7fcdedffb640 1 -- 172.21.15.5:0/4094186172 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcdf0004030 con 0x7fcdf80cd120 2023-07-14T12:53:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.397+0000 7fcdedffb640 1 --2- 172.21.15.5:0/4094186172 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fcddc066280 0x7fcddc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.397+0000 7fcdedffb640 1 -- 172.21.15.5:0/4094186172 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcdf0083ff0 con 0x7fcdf80cd120 2023-07-14T12:53:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.397+0000 7fcdfd695640 1 --2- 172.21.15.5:0/4094186172 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fcddc066280 0x7fcddc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.401+0000 7fcdfd695640 1 --2- 172.21.15.5:0/4094186172 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fcddc066280 0x7fcddc068730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40ae000 tx=0x7fcdf40b5040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.401+0000 7fcdedffb640 1 -- 172.21.15.5:0/4094186172 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fcdf00514e0 con 0x7fcdf80cd120 2023-07-14T12:53:15.479 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:53:15.483 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:53:15.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.561+0000 7fcdff8f9640 1 -- 172.21.15.5:0/4094186172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcdf80678d0 con 0x7fcdf80cd120 2023-07-14T12:53:15.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.561+0000 7fcdedffb640 1 -- 172.21.15.5:0/4094186172 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcdf001a020 con 0x7fcdf80cd120 2023-07-14T12:53:15.589 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T12:53:15.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.561+0000 7fcdff8f9640 1 -- 172.21.15.5:0/4094186172 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fcddc066280 msgr2=0x7fcddc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:15.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.561+0000 7fcdff8f9640 1 --2- 172.21.15.5:0/4094186172 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fcddc066280 0x7fcddc068730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40ae000 tx=0x7fcdf40b5040 comp rx=0 tx=0).stop 2023-07-14T12:53:15.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.561+0000 7fcdff8f9640 1 -- 172.21.15.5:0/4094186172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdf80cd120 msgr2=0x7fcdf8158b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:15.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.561+0000 7fcdff8f9640 1 --2- 172.21.15.5:0/4094186172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdf80cd120 0x7fcdf8158b60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0007df0 tx=0x7fcdf000d4a0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.561+0000 7fcdff8f9640 1 -- 172.21.15.5:0/4094186172 shutdown_connections 2023-07-14T12:53:15.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.561+0000 7fcdff8f9640 1 --2- 172.21.15.5:0/4094186172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdf80cd120 0x7fcdf8158b60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.561+0000 7fcdff8f9640 1 --2- 172.21.15.5:0/4094186172 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdf80c3ac0 0x7fcdf80c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.561+0000 7fcdff8f9640 1 --2- 172.21.15.5:0/4094186172 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fcddc066280 0x7fcddc068730 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.561+0000 7fcdff8f9640 1 --2- 172.21.15.5:0/4094186172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdf80af2b0 0x7fcdf8142f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.561+0000 7fcdff8f9640 1 -- 172.21.15.5:0/4094186172 >> 172.21.15.5:0/4094186172 conn(0x7fcdf80cde90 msgr2=0x7fcdf8162fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:15.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.561+0000 7fcdff8f9640 1 -- 172.21.15.5:0/4094186172 shutdown_connections 2023-07-14T12:53:15.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.561+0000 7fcdff8f9640 1 -- 172.21.15.5:0/4094186172 wait complete. 2023-07-14T12:53:15.609 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T12:53:15.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.729+0000 7fa487ffa640 1 Processor -- start 2023-07-14T12:53:15.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.729+0000 7fa487ffa640 1 -- start start 2023-07-14T12:53:15.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.729+0000 7fa487ffa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa480069430 0x7fa480069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:15.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.729+0000 7fa487ffa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa480070f30 0x7fa4800ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:15.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.729+0000 7fa487ffa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa4800af2b0 0x7fa48015a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:15.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.729+0000 7fa487ffa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa480159d70 con 0x7fa4800af2b0 2023-07-14T12:53:15.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.729+0000 7fa487ffa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa480069d40 con 0x7fa480070f30 2023-07-14T12:53:15.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.729+0000 7fa487ffa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4800c9c60 con 0x7fa480069430 2023-07-14T12:53:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.729+0000 7fa486597640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa4800af2b0 0x7fa48015a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.729+0000 7fa486597640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa4800af2b0 0x7fa48015a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55914/0 (socket says 172.21.15.5:55914) 2023-07-14T12:53:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.729+0000 7fa486597640 1 -- 172.21.15.5:0/270501594 learned_addr learned my addr 172.21.15.5:0/270501594 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:15.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.729+0000 7fa485d96640 1 --2- 172.21.15.5:0/270501594 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa480069430 0x7fa480069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:15.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.729+0000 7fa485595640 1 --2- 172.21.15.5:0/270501594 >> v2:172.21.15.154:3300/0 conn(0x7fa480070f30 0x7fa4800ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:15.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.729+0000 7fa486597640 1 -- 172.21.15.5:0/270501594 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa480069430 msgr2=0x7fa480069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:15.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.729+0000 7fa486597640 1 --2- 172.21.15.5:0/270501594 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa480069430 0x7fa480069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.729+0000 7fa486597640 1 -- 172.21.15.5:0/270501594 >> v2:172.21.15.154:3300/0 conn(0x7fa480070f30 msgr2=0x7fa4800ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:15.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.729+0000 7fa486597640 1 --2- 172.21.15.5:0/270501594 >> v2:172.21.15.154:3300/0 conn(0x7fa480070f30 0x7fa4800ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.729+0000 7fa486597640 1 -- 172.21.15.5:0/270501594 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4800c9f40 con 0x7fa4800af2b0 2023-07-14T12:53:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.733+0000 7fa486597640 1 --2- 172.21.15.5:0/270501594 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4800af2b0 0x7fa48015a1f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa48006ed50 tx=0x7fa47801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73ded9f6882bbe1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:15.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.733+0000 7fa484d94640 1 -- 172.21.15.5:0/270501594 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4780a5760 con 0x7fa4800af2b0 2023-07-14T12:53:15.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.733+0000 7fa484d94640 1 -- 172.21.15.5:0/270501594 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4780a58c0 con 0x7fa4800af2b0 2023-07-14T12:53:15.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.733+0000 7fa484d94640 1 -- 172.21.15.5:0/270501594 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4780a5c50 con 0x7fa4800af2b0 2023-07-14T12:53:15.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.733+0000 7fa487ffa640 1 -- 172.21.15.5:0/270501594 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4800af2b0 msgr2=0x7fa48015a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:15.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.733+0000 7fa487ffa640 1 --2- 172.21.15.5:0/270501594 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4800af2b0 0x7fa48015a1f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa48006ed50 tx=0x7fa47801c9d0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.733+0000 7fa487ffa640 1 -- 172.21.15.5:0/270501594 shutdown_connections 2023-07-14T12:53:15.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.733+0000 7fa487ffa640 1 --2- 172.21.15.5:0/270501594 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4800af2b0 0x7fa48015a1f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.733+0000 7fa487ffa640 1 --2- 172.21.15.5:0/270501594 >> v2:172.21.15.154:3300/0 conn(0x7fa480070f30 0x7fa4800ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.733+0000 7fa487ffa640 1 --2- 172.21.15.5:0/270501594 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa480069430 0x7fa480069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.733+0000 7fa487ffa640 1 -- 172.21.15.5:0/270501594 >> 172.21.15.5:0/270501594 conn(0x7fa4800cde90 msgr2=0x7fa4800ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:15.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.733+0000 7fa487ffa640 1 -- 172.21.15.5:0/270501594 shutdown_connections 2023-07-14T12:53:15.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.733+0000 7fa487ffa640 1 -- 172.21.15.5:0/270501594 wait complete. 2023-07-14T12:53:15.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.737+0000 7fa487ffa640 1 Processor -- start 2023-07-14T12:53:15.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.737+0000 7fa487ffa640 1 -- start start 2023-07-14T12:53:15.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.737+0000 7fa487ffa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa480069430 0x7fa4800c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:15.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.737+0000 7fa487ffa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa480070f30 0x7fa48006ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:15.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.737+0000 7fa487ffa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4800af2b0 0x7fa4800c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:15.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.737+0000 7fa487ffa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa480158590 con 0x7fa480069430 2023-07-14T12:53:15.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.737+0000 7fa487ffa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48006c5a0 con 0x7fa4800af2b0 2023-07-14T12:53:15.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.737+0000 7fa487ffa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa480158da0 con 0x7fa480070f30 2023-07-14T12:53:15.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.737+0000 7fa485d96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa480069430 0x7fa4800c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:15.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.737+0000 7fa485d96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa480069430 0x7fa4800c2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55920/0 (socket says 172.21.15.5:55920) 2023-07-14T12:53:15.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.737+0000 7fa485d96640 1 -- 172.21.15.5:0/1191870896 learned_addr learned my addr 172.21.15.5:0/1191870896 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:15.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.737+0000 7fa485595640 1 --2- 172.21.15.5:0/1191870896 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa480070f30 0x7fa48006ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:15.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.737+0000 7fa486597640 1 --2- 172.21.15.5:0/1191870896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4800af2b0 0x7fa4800c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:15.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.737+0000 7fa485d96640 1 -- 172.21.15.5:0/1191870896 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa480070f30 msgr2=0x7fa48006ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:15.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.737+0000 7fa485d96640 1 --2- 172.21.15.5:0/1191870896 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa480070f30 0x7fa48006ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.737+0000 7fa485d96640 1 -- 172.21.15.5:0/1191870896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4800af2b0 msgr2=0x7fa4800c3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:15.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.737+0000 7fa485d96640 1 --2- 172.21.15.5:0/1191870896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4800af2b0 0x7fa4800c3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.737+0000 7fa485d96640 1 -- 172.21.15.5:0/1191870896 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa478009b30 con 0x7fa480069430 2023-07-14T12:53:15.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.737+0000 7fa485d96640 1 --2- 172.21.15.5:0/1191870896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa480069430 0x7fa4800c2d30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00e8a0 tx=0x7fa47c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:15.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.737+0000 7fa4767fc640 1 -- 172.21.15.5:0/1191870896 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c009510 con 0x7fa480069430 2023-07-14T12:53:15.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.737+0000 7fa4767fc640 1 -- 172.21.15.5:0/1191870896 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47c00c940 con 0x7fa480069430 2023-07-14T12:53:15.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.737+0000 7fa4767fc640 1 -- 172.21.15.5:0/1191870896 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c00ccb0 con 0x7fa480069430 2023-07-14T12:53:15.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.741+0000 7fa487ffa640 1 -- 172.21.15.5:0/1191870896 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4801587e0 con 0x7fa480069430 2023-07-14T12:53:15.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.741+0000 7fa487ffa640 1 -- 172.21.15.5:0/1191870896 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48006c230 con 0x7fa480069430 2023-07-14T12:53:15.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.741+0000 7fa487ffa640 1 -- 172.21.15.5:0/1191870896 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4800678d0 con 0x7fa480069430 2023-07-14T12:53:15.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.741+0000 7fa4767fc640 1 -- 172.21.15.5:0/1191870896 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa47c013470 con 0x7fa480069430 2023-07-14T12:53:15.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.741+0000 7fa4767fc640 1 --2- 172.21.15.5:0/1191870896 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa464066280 0x7fa464068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:15.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.741+0000 7fa4767fc640 1 -- 172.21.15.5:0/1191870896 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa47c083e30 con 0x7fa480069430 2023-07-14T12:53:15.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.741+0000 7fa485595640 1 --2- 172.21.15.5:0/1191870896 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa464066280 0x7fa464068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:15.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.745+0000 7fa485595640 1 --2- 172.21.15.5:0/1191870896 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa464066280 0x7fa464068730 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa48006d2a0 tx=0x7fa470009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:15.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.745+0000 7fa4767fc640 1 -- 172.21.15.5:0/1191870896 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa47c0512c0 con 0x7fa480069430 2023-07-14T12:53:15.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.901+0000 7fa487ffa640 1 -- 172.21.15.5:0/1191870896 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa4800aeb80 con 0x7fa480069430 2023-07-14T12:53:15.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.901+0000 7fa4767fc640 1 -- 172.21.15.5:0/1191870896 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa47c0170a0 con 0x7fa480069430 2023-07-14T12:53:15.929 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T12:53:15.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.901+0000 7fa487ffa640 1 -- 172.21.15.5:0/1191870896 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa464066280 msgr2=0x7fa464068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:15.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.901+0000 7fa487ffa640 1 --2- 172.21.15.5:0/1191870896 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa464066280 0x7fa464068730 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa48006d2a0 tx=0x7fa470009190 comp rx=0 tx=0).stop 2023-07-14T12:53:15.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.901+0000 7fa487ffa640 1 -- 172.21.15.5:0/1191870896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa480069430 msgr2=0x7fa4800c2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:15.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.901+0000 7fa487ffa640 1 --2- 172.21.15.5:0/1191870896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa480069430 0x7fa4800c2d30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00e8a0 tx=0x7fa47c00eca0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.901+0000 7fa487ffa640 1 -- 172.21.15.5:0/1191870896 shutdown_connections 2023-07-14T12:53:15.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.901+0000 7fa487ffa640 1 --2- 172.21.15.5:0/1191870896 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa464066280 0x7fa464068730 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.901+0000 7fa487ffa640 1 --2- 172.21.15.5:0/1191870896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4800af2b0 0x7fa4800c3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.901+0000 7fa487ffa640 1 --2- 172.21.15.5:0/1191870896 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa480070f30 0x7fa48006ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.905+0000 7fa487ffa640 1 --2- 172.21.15.5:0/1191870896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa480069430 0x7fa4800c2d30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.905+0000 7fa487ffa640 1 -- 172.21.15.5:0/1191870896 >> 172.21.15.5:0/1191870896 conn(0x7fa4800cde90 msgr2=0x7fa480158f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:15.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.905+0000 7fa487ffa640 1 -- 172.21.15.5:0/1191870896 shutdown_connections 2023-07-14T12:53:15.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:15.905+0000 7fa487ffa640 1 -- 172.21.15.5:0/1191870896 wait complete. 2023-07-14T12:53:15.950 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T12:53:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.069+0000 7f720bbfa640 1 Processor -- start 2023-07-14T12:53:16.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.069+0000 7f720bbfa640 1 -- start start 2023-07-14T12:53:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.069+0000 7f720bbfa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f720406a540 0x7f720406a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:16.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.069+0000 7f720bbfa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f72040cf710 0x7f72040cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:16.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.069+0000 7f720bbfa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72040cb7a0 con 0x7f72040cf2e0 2023-07-14T12:53:16.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.069+0000 7f720bbfa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72040d0920 con 0x7f72040cf710 2023-07-14T12:53:16.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.069+0000 7f720bbfa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f720415bfd0 con 0x7f720406a540 2023-07-14T12:53:16.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.069+0000 7f7209195640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f72040cf2e0 0x7f72040cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59452/0 (socket says 172.21.15.5:59452) 2023-07-14T12:53:16.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.069+0000 7f7209195640 1 -- 172.21.15.5:0/698293196 learned_addr learned my addr 172.21.15.5:0/698293196 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:16.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.073+0000 7f7209996640 1 --2- 172.21.15.5:0/698293196 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f720406a540 0x7f720406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:16.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.073+0000 7f720a197640 1 --2- 172.21.15.5:0/698293196 >> v2:172.21.15.5:3300/0 conn(0x7f72040cf710 0x7f72040cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:16.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.073+0000 7f7208994640 1 -- 172.21.15.5:0/698293196 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493206322 0 0) 0x7f72040cb7a0 con 0x7f72040cf2e0 2023-07-14T12:53:16.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.073+0000 7f7208994640 1 -- 172.21.15.5:0/698293196 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71f0003530 con 0x7f72040cf2e0 2023-07-14T12:53:16.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.073+0000 7f7209996640 1 -- 172.21.15.5:0/698293196 >> v2:172.21.15.5:3300/0 conn(0x7f72040cf710 msgr2=0x7f72040cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:16.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.073+0000 7f7209996640 1 --2- 172.21.15.5:0/698293196 >> v2:172.21.15.5:3300/0 conn(0x7f72040cf710 0x7f72040cd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:16.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.073+0000 7f7209996640 1 -- 172.21.15.5:0/698293196 >> v1:172.21.15.5:6789/0 conn(0x7f72040cf2e0 legacy=0x7f72040cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:16.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.073+0000 7f7209996640 1 -- 172.21.15.5:0/698293196 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720406ae50 con 0x7f720406a540 2023-07-14T12:53:16.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.073+0000 7f7209996640 1 --2- 172.21.15.5:0/698293196 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f720406a540 0x7f720406a910 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f72000097c0 tx=0x7f720001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ede1b6adc3bd5ccb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:16.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.077+0000 7f7208994640 1 -- 172.21.15.5:0/698293196 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72000ab600 con 0x7f720406a540 2023-07-14T12:53:16.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.077+0000 7f7208994640 1 -- 172.21.15.5:0/698293196 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72000a7050 con 0x7f720406a540 2023-07-14T12:53:16.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.077+0000 7f7208994640 1 -- 172.21.15.5:0/698293196 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72000ab980 con 0x7f720406a540 2023-07-14T12:53:16.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.077+0000 7f720bbfa640 1 -- 172.21.15.5:0/698293196 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f720406a540 msgr2=0x7f720406a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:16.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.077+0000 7f720bbfa640 1 --2- 172.21.15.5:0/698293196 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f720406a540 0x7f720406a910 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f72000097c0 tx=0x7f720001c480 comp rx=0 tx=0).stop 2023-07-14T12:53:16.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.077+0000 7f720bbfa640 1 -- 172.21.15.5:0/698293196 shutdown_connections 2023-07-14T12:53:16.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.077+0000 7f720bbfa640 1 --2- 172.21.15.5:0/698293196 >> v2:172.21.15.5:3300/0 conn(0x7f72040cf710 0x7f72040cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:16.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.077+0000 7f720bbfa640 1 --2- 172.21.15.5:0/698293196 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f720406a540 0x7f720406a910 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.077+0000 7f720bbfa640 1 -- 172.21.15.5:0/698293196 >> 172.21.15.5:0/698293196 conn(0x7f7204099490 msgr2=0x7f7204089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.077+0000 7f720bbfa640 1 -- 172.21.15.5:0/698293196 shutdown_connections 2023-07-14T12:53:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.077+0000 7f720bbfa640 1 -- 172.21.15.5:0/698293196 wait complete. 2023-07-14T12:53:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.077+0000 7f720bbfa640 1 Processor -- start 2023-07-14T12:53:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.077+0000 7f720bbfa640 1 -- start start 2023-07-14T12:53:16.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.077+0000 7f720bbfa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f720406a540 0x7f720414e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:16.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.077+0000 7f720bbfa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72040cf2e0 0x7f72040af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:16.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.077+0000 7f720bbfa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72040cf710 0x7f72040af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:16.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.077+0000 7f720bbfa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72041512d0 con 0x7f72040cf710 2023-07-14T12:53:16.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.077+0000 7f720bbfa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720415adc0 con 0x7f720406a540 2023-07-14T12:53:16.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.077+0000 7f720bbfa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f720414e610 con 0x7f72040cf2e0 2023-07-14T12:53:16.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.077+0000 7f720a197640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72040cf710 0x7f72040af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:16.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.077+0000 7f720a197640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72040cf710 0x7f72040af6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55930/0 (socket says 172.21.15.5:55930) 2023-07-14T12:53:16.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.077+0000 7f720a197640 1 -- 172.21.15.5:0/2326505452 learned_addr learned my addr 172.21.15.5:0/2326505452 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:16.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.081+0000 7f7209195640 1 --2- 172.21.15.5:0/2326505452 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72040cf2e0 0x7f72040af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:16.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.081+0000 7f7209996640 1 --2- 172.21.15.5:0/2326505452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f720406a540 0x7f720414e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:16.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.081+0000 7f720a197640 1 -- 172.21.15.5:0/2326505452 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72040cf2e0 msgr2=0x7f72040af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:16.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.081+0000 7f720a197640 1 --2- 172.21.15.5:0/2326505452 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72040cf2e0 0x7f72040af1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:16.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.081+0000 7f720a197640 1 -- 172.21.15.5:0/2326505452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f720406a540 msgr2=0x7f720414e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:16.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.081+0000 7f720a197640 1 --2- 172.21.15.5:0/2326505452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f720406a540 0x7f720414e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:16.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.081+0000 7f720a197640 1 -- 172.21.15.5:0/2326505452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7200009420 con 0x7f72040cf710 2023-07-14T12:53:16.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.081+0000 7f7209195640 1 --2- 172.21.15.5:0/2326505452 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72040cf2e0 0x7f72040af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:16.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.081+0000 7f7209996640 1 --2- 172.21.15.5:0/2326505452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f720406a540 0x7f720414e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:16.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.081+0000 7f720a197640 1 --2- 172.21.15.5:0/2326505452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72040cf710 0x7f72040af6e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f71fc00efc0 tx=0x7f71fc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:16.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.081+0000 7f71fa7fc640 1 -- 172.21.15.5:0/2326505452 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc009ba0 con 0x7f72040cf710 2023-07-14T12:53:16.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.081+0000 7f71fa7fc640 1 -- 172.21.15.5:0/2326505452 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71fc00f040 con 0x7f72040cf710 2023-07-14T12:53:16.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.081+0000 7f71fa7fc640 1 -- 172.21.15.5:0/2326505452 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc0146c0 con 0x7f72040cf710 2023-07-14T12:53:16.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.081+0000 7f720bbfa640 1 -- 172.21.15.5:0/2326505452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f720415aae0 con 0x7f72040cf710 2023-07-14T12:53:16.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.081+0000 7f720bbfa640 1 -- 172.21.15.5:0/2326505452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7204150f60 con 0x7f72040cf710 2023-07-14T12:53:16.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.081+0000 7f720bbfa640 1 -- 172.21.15.5:0/2326505452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7204151440 con 0x7f72040cf710 2023-07-14T12:53:16.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.081+0000 7f71fa7fc640 1 -- 172.21.15.5:0/2326505452 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f71fc014820 con 0x7f72040cf710 2023-07-14T12:53:16.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.081+0000 7f71fa7fc640 1 --2- 172.21.15.5:0/2326505452 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f71e80662b0 0x7f71e8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:16.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.081+0000 7f71fa7fc640 1 -- 172.21.15.5:0/2326505452 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f71fc084860 con 0x7f72040cf710 2023-07-14T12:53:16.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.085+0000 7f7209996640 1 --2- 172.21.15.5:0/2326505452 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f71e80662b0 0x7f71e8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:16.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.085+0000 7f7209996640 1 --2- 172.21.15.5:0/2326505452 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f71e80662b0 0x7f71e8068760 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f72000ad000 tx=0x7f7200008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:16.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.085+0000 7f71fa7fc640 1 -- 172.21.15.5:0/2326505452 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f71fc051cd0 con 0x7f72040cf710 2023-07-14T12:53:16.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.241+0000 7f720bbfa640 1 -- 172.21.15.5:0/2326505452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f72040678d0 con 0x7f72040cf710 2023-07-14T12:53:16.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.241+0000 7f71fa7fc640 1 -- 172.21.15.5:0/2326505452 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f71fc0552f0 con 0x7f72040cf710 2023-07-14T12:53:16.270 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T12:53:16.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.245+0000 7f720bbfa640 1 -- 172.21.15.5:0/2326505452 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f71e80662b0 msgr2=0x7f71e8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:16.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.245+0000 7f720bbfa640 1 --2- 172.21.15.5:0/2326505452 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f71e80662b0 0x7f71e8068760 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f72000ad000 tx=0x7f7200008040 comp rx=0 tx=0).stop 2023-07-14T12:53:16.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.245+0000 7f720bbfa640 1 -- 172.21.15.5:0/2326505452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72040cf710 msgr2=0x7f72040af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:16.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.245+0000 7f720bbfa640 1 --2- 172.21.15.5:0/2326505452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72040cf710 0x7f72040af6e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f71fc00efc0 tx=0x7f71fc00c490 comp rx=0 tx=0).stop 2023-07-14T12:53:16.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.245+0000 7f720bbfa640 1 -- 172.21.15.5:0/2326505452 shutdown_connections 2023-07-14T12:53:16.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.245+0000 7f720bbfa640 1 --2- 172.21.15.5:0/2326505452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72040cf710 0x7f72040af6e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:16.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.245+0000 7f720bbfa640 1 --2- 172.21.15.5:0/2326505452 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72040cf2e0 0x7f72040af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:16.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.245+0000 7f720bbfa640 1 --2- 172.21.15.5:0/2326505452 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f71e80662b0 0x7f71e8068760 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:16.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.245+0000 7f720bbfa640 1 --2- 172.21.15.5:0/2326505452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f720406a540 0x7f720414e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:16.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.245+0000 7f720bbfa640 1 -- 172.21.15.5:0/2326505452 >> 172.21.15.5:0/2326505452 conn(0x7f7204099490 msgr2=0x7f72040ad820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:16.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.245+0000 7f720bbfa640 1 -- 172.21.15.5:0/2326505452 shutdown_connections 2023-07-14T12:53:16.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.245+0000 7f720bbfa640 1 -- 172.21.15.5:0/2326505452 wait complete. 2023-07-14T12:53:16.291 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T12:53:16.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.409+0000 7fbb2226d640 1 Processor -- start 2023-07-14T12:53:16.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.409+0000 7fbb2226d640 1 -- start start 2023-07-14T12:53:16.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb2226d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbb1c0aeb40 0x7fbb1c15cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:16.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb2226d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb1c1532b0 con 0x7fbb1c0aef10 2023-07-14T12:53:16.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb2226d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb1c0ca6f0 con 0x7fbb1c159440 2023-07-14T12:53:16.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb2226d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb1c1599d0 con 0x7fbb1c0aeb40 2023-07-14T12:53:16.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb1b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbb1c0aef10 0x7fbb1c158d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59466/0 (socket says 172.21.15.5:59466) 2023-07-14T12:53:16.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb1b7fe640 1 -- 172.21.15.5:0/470372022 learned_addr learned my addr 172.21.15.5:0/470372022 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:16.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb1bfff640 1 --2- 172.21.15.5:0/470372022 >> v2:172.21.15.154:3300/0 conn(0x7fbb1c0aeb40 0x7fbb1c15cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:16.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb1affd640 1 -- 172.21.15.5:0/470372022 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 57073900 0 0) 0x7fbb1c1532b0 con 0x7fbb1c0aef10 2023-07-14T12:53:16.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb1affd640 1 -- 172.21.15.5:0/470372022 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb04005740 con 0x7fbb1c0aef10 2023-07-14T12:53:16.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb1affd640 1 -- 172.21.15.5:0/470372022 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1589879123 0 0) 0x7fbb04005740 con 0x7fbb1c0aef10 2023-07-14T12:53:16.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb1affd640 1 -- 172.21.15.5:0/470372022 >> v2:172.21.15.154:3300/0 conn(0x7fbb1c0aeb40 msgr2=0x7fbb1c15cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:16.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb1affd640 1 --2- 172.21.15.5:0/470372022 >> v2:172.21.15.154:3300/0 conn(0x7fbb1c0aeb40 0x7fbb1c15cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:16.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb1affd640 1 -- 172.21.15.5:0/470372022 >> v1:172.21.15.154:6789/0 conn(0x7fbb1c159440 legacy=0x7fbb1c0c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:16.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb1affd640 1 -- 172.21.15.5:0/470372022 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1c159cb0 con 0x7fbb1c0aef10 2023-07-14T12:53:16.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb1affd640 1 -- 172.21.15.5:0/470372022 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7fbb10001680 con 0x7fbb1c0aef10 2023-07-14T12:53:16.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb1affd640 1 -- 172.21.15.5:0/470372022 >> v1:172.21.15.5:6789/0 conn(0x7fbb1c0aef10 legacy=0x7fbb1c158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:16.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb1affd640 1 --2- 172.21.15.5:0/470372022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb04005b90 0x7fbb04005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:16.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb1affd640 1 --2- 172.21.15.5:0/470372022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb040064e0 0x7fbb040069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:16.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb1affd640 1 --2- 172.21.15.5:0/470372022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb040071c0 0x7fbb0400ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:16.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb1affd640 1 -- 172.21.15.5:0/470372022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c1599d0 con 0x7fbb040071c0 2023-07-14T12:53:16.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb1affd640 1 -- 172.21.15.5:0/470372022 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb040104e0 con 0x7fbb040064e0 2023-07-14T12:53:16.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb1affd640 1 -- 172.21.15.5:0/470372022 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb040106a0 con 0x7fbb04005b90 2023-07-14T12:53:16.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb2080a640 1 --2- 172.21.15.5:0/470372022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb040071c0 0x7fbb0400ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:16.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb1b7fe640 1 --2- 172.21.15.5:0/470372022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb040064e0 0x7fbb040069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:16.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb1bfff640 1 --2- 172.21.15.5:0/470372022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb04005b90 0x7fbb04005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:16.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb2080a640 1 -- 172.21.15.5:0/470372022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb04005b90 msgr2=0x7fbb04005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:16.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb2080a640 1 --2- 172.21.15.5:0/470372022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb04005b90 0x7fbb04005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:16.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb2080a640 1 -- 172.21.15.5:0/470372022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb040064e0 msgr2=0x7fbb040069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:16.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb2080a640 1 --2- 172.21.15.5:0/470372022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb040064e0 0x7fbb040069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:16.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.413+0000 7fbb2080a640 1 -- 172.21.15.5:0/470372022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb04005740 con 0x7fbb040071c0 2023-07-14T12:53:16.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.417+0000 7fbb2080a640 1 -- 172.21.15.5:0/470372022 reap_dead start 2023-07-14T12:53:16.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.417+0000 7fbb2080a640 1 --2- 172.21.15.5:0/470372022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb040071c0 0x7fbb0400ffa0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbb14001e70 tx=0x7fbb1401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18d6c57a9523200a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:16.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.417+0000 7fbb1affd640 1 -- 172.21.15.5:0/470372022 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb14003b80 con 0x7fbb040071c0 2023-07-14T12:53:16.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.417+0000 7fbb1affd640 1 -- 172.21.15.5:0/470372022 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb14003d00 con 0x7fbb040071c0 2023-07-14T12:53:16.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.417+0000 7fbb1affd640 1 -- 172.21.15.5:0/470372022 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb14005310 con 0x7fbb040071c0 2023-07-14T12:53:16.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.417+0000 7fbb2226d640 1 -- 172.21.15.5:0/470372022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb040071c0 msgr2=0x7fbb0400ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:16.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.417+0000 7fbb2226d640 1 --2- 172.21.15.5:0/470372022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb040071c0 0x7fbb0400ffa0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbb14001e70 tx=0x7fbb1401c760 comp rx=0 tx=0).stop 2023-07-14T12:53:16.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.417+0000 7fbb2226d640 1 -- 172.21.15.5:0/470372022 shutdown_connections 2023-07-14T12:53:16.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.417+0000 7fbb2226d640 1 --2- 172.21.15.5:0/470372022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb040071c0 0x7fbb0400ffa0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:16.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.417+0000 7fbb2226d640 1 -- 172.21.15.5:0/470372022 >> 172.21.15.5:0/470372022 conn(0x7fbb1c0cde90 msgr2=0x7fbb1c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:16.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.417+0000 7fbb2226d640 1 -- 172.21.15.5:0/470372022 shutdown_connections 2023-07-14T12:53:16.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.417+0000 7fbb2226d640 1 -- 172.21.15.5:0/470372022 wait complete. 2023-07-14T12:53:16.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.417+0000 7fbb2226d640 1 Processor -- start 2023-07-14T12:53:16.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.417+0000 7fbb2226d640 1 -- start start 2023-07-14T12:53:16.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.421+0000 7fbb2226d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb040071c0 0x7fbb1c06f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:16.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.421+0000 7fbb2226d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb1c070fe0 0x7fbb1c1ec890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:16.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.421+0000 7fbb2226d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb1c1ecdd0 0x7fbb1c15b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:16.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.421+0000 7fbb2226d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c06f9d0 con 0x7fbb1c1ecdd0 2023-07-14T12:53:16.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.421+0000 7fbb2226d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c14e340 con 0x7fbb040071c0 2023-07-14T12:53:16.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.421+0000 7fbb2226d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c14e620 con 0x7fbb1c070fe0 2023-07-14T12:53:16.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.421+0000 7fbb2080a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb1c1ecdd0 0x7fbb1c15b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:16.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.421+0000 7fbb2080a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb1c1ecdd0 0x7fbb1c15b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55948/0 (socket says 172.21.15.5:55948) 2023-07-14T12:53:16.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.421+0000 7fbb2080a640 1 -- 172.21.15.5:0/3032182637 learned_addr learned my addr 172.21.15.5:0/3032182637 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:16.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.421+0000 7fbb1b7fe640 1 --2- 172.21.15.5:0/3032182637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb1c070fe0 0x7fbb1c1ec890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:16.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.421+0000 7fbb1bfff640 1 --2- 172.21.15.5:0/3032182637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb040071c0 0x7fbb1c06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:16.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.421+0000 7fbb2080a640 1 -- 172.21.15.5:0/3032182637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb1c070fe0 msgr2=0x7fbb1c1ec890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:16.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.421+0000 7fbb2080a640 1 --2- 172.21.15.5:0/3032182637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb1c070fe0 0x7fbb1c1ec890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:16.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.421+0000 7fbb2080a640 1 -- 172.21.15.5:0/3032182637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb040071c0 msgr2=0x7fbb1c06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:16.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.421+0000 7fbb2080a640 1 --2- 172.21.15.5:0/3032182637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb040071c0 0x7fbb1c06f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:16.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.421+0000 7fbb2080a640 1 -- 172.21.15.5:0/3032182637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1c14e900 con 0x7fbb1c1ecdd0 2023-07-14T12:53:16.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.421+0000 7fbb2080a640 1 --2- 172.21.15.5:0/3032182637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb1c1ecdd0 0x7fbb1c15b050 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbb1401d000 tx=0x7fbb04007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:16.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.421+0000 7fbb18ff9640 1 -- 172.21.15.5:0/3032182637 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb14003b80 con 0x7fbb1c1ecdd0 2023-07-14T12:53:16.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.421+0000 7fbb18ff9640 1 -- 172.21.15.5:0/3032182637 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb14007dc0 con 0x7fbb1c1ecdd0 2023-07-14T12:53:16.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.421+0000 7fbb18ff9640 1 -- 172.21.15.5:0/3032182637 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb14006d60 con 0x7fbb1c1ecdd0 2023-07-14T12:53:16.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.421+0000 7fbb2226d640 1 -- 172.21.15.5:0/3032182637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb1c14ebe0 con 0x7fbb1c1ecdd0 2023-07-14T12:53:16.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.421+0000 7fbb2226d640 1 -- 172.21.15.5:0/3032182637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1c06f770 con 0x7fbb1c1ecdd0 2023-07-14T12:53:16.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.421+0000 7fbb2226d640 1 -- 172.21.15.5:0/3032182637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb1c14ee00 con 0x7fbb1c1ecdd0 2023-07-14T12:53:16.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.425+0000 7fbb18ff9640 1 -- 172.21.15.5:0/3032182637 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbb14007030 con 0x7fbb1c1ecdd0 2023-07-14T12:53:16.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.425+0000 7fbb18ff9640 1 --2- 172.21.15.5:0/3032182637 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fbb080662b0 0x7fbb08068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:16.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.425+0000 7fbb18ff9640 1 -- 172.21.15.5:0/3032182637 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbb1411d090 con 0x7fbb1c1ecdd0 2023-07-14T12:53:16.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.425+0000 7fbb1bfff640 1 --2- 172.21.15.5:0/3032182637 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fbb080662b0 0x7fbb08068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:16.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.425+0000 7fbb1bfff640 1 --2- 172.21.15.5:0/3032182637 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fbb080662b0 0x7fbb08068760 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009aa0 tx=0x7fbb0c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:16.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.429+0000 7fbb18ff9640 1 -- 172.21.15.5:0/3032182637 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fbb140ea470 con 0x7fbb1c1ecdd0 2023-07-14T12:53:16.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.581+0000 7fbb2226d640 1 -- 172.21.15.5:0/3032182637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbb1c0678d0 con 0x7fbb1c1ecdd0 2023-07-14T12:53:16.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.581+0000 7fbb18ff9640 1 -- 172.21.15.5:0/3032182637 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbb140eda90 con 0x7fbb1c1ecdd0 2023-07-14T12:53:16.610 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T12:53:16.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.585+0000 7fbb2226d640 1 -- 172.21.15.5:0/3032182637 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fbb080662b0 msgr2=0x7fbb08068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:16.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.585+0000 7fbb2226d640 1 --2- 172.21.15.5:0/3032182637 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fbb080662b0 0x7fbb08068760 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009aa0 tx=0x7fbb0c008040 comp rx=0 tx=0).stop 2023-07-14T12:53:16.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.585+0000 7fbb2226d640 1 -- 172.21.15.5:0/3032182637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb1c1ecdd0 msgr2=0x7fbb1c15b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:16.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.585+0000 7fbb2226d640 1 --2- 172.21.15.5:0/3032182637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb1c1ecdd0 0x7fbb1c15b050 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbb1401d000 tx=0x7fbb04007a10 comp rx=0 tx=0).stop 2023-07-14T12:53:16.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.585+0000 7fbb2226d640 1 -- 172.21.15.5:0/3032182637 shutdown_connections 2023-07-14T12:53:16.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.585+0000 7fbb2226d640 1 --2- 172.21.15.5:0/3032182637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb1c1ecdd0 0x7fbb1c15b050 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:16.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.585+0000 7fbb2226d640 1 --2- 172.21.15.5:0/3032182637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb1c070fe0 0x7fbb1c1ec890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:16.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.585+0000 7fbb2226d640 1 --2- 172.21.15.5:0/3032182637 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fbb080662b0 0x7fbb08068760 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:16.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.585+0000 7fbb2226d640 1 --2- 172.21.15.5:0/3032182637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb040071c0 0x7fbb1c06f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:16.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.585+0000 7fbb2226d640 1 -- 172.21.15.5:0/3032182637 >> 172.21.15.5:0/3032182637 conn(0x7fbb1c0cde90 msgr2=0x7fbb1c0c8880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:16.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.585+0000 7fbb2226d640 1 -- 172.21.15.5:0/3032182637 shutdown_connections 2023-07-14T12:53:16.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.585+0000 7fbb2226d640 1 -- 172.21.15.5:0/3032182637 wait complete. 2023-07-14T12:53:16.644 INFO:tasks.cephfs_test_runner:Starting test: test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test concurrent snap creates in same file-system without db issues 2023-07-14T12:53:16.644 INFO:tasks.cephfs_test_runner:test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-14T12:53:16.645 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-07-14T12:53:16.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.761+0000 7f96cd4f9640 1 Processor -- start 2023-07-14T12:53:16.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.761+0000 7f96cd4f9640 1 -- start start 2023-07-14T12:53:16.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.761+0000 7f96cd4f9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f96c80c9730 0x7f96c81638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:16.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.761+0000 7f96cd4f9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c80cc700 con 0x7f96c80c8ad0 2023-07-14T12:53:16.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.761+0000 7f96cd4f9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c80b0ff0 con 0x7f96c8158ce0 2023-07-14T12:53:16.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.761+0000 7f96cd4f9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c8070c80 con 0x7f96c80c9730 2023-07-14T12:53:16.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.761+0000 7f96bffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f96c80c8ad0 0x7f96c80c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59472/0 (socket says 172.21.15.5:59472) 2023-07-14T12:53:16.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.761+0000 7f96bffff640 1 -- 172.21.15.5:0/3213150796 learned_addr learned my addr 172.21.15.5:0/3213150796 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:16.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.761+0000 7f96c77fe640 1 --2- 172.21.15.5:0/3213150796 >> v2:172.21.15.154:3300/0 conn(0x7f96c80c9730 0x7f96c81638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:16.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.761+0000 7f96c67fc640 1 -- 172.21.15.5:0/3213150796 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095190672 0 0) 0x7f96c80cc700 con 0x7f96c80c8ad0 2023-07-14T12:53:16.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.761+0000 7f96c67fc640 1 -- 172.21.15.5:0/3213150796 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96b4003530 con 0x7f96c80c8ad0 2023-07-14T12:53:16.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.765+0000 7f96c77fe640 1 -- 172.21.15.5:0/3213150796 >> v1:172.21.15.154:6789/0 conn(0x7f96c8158ce0 legacy=0x7f96c8070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:16.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.765+0000 7f96c67fc640 1 -- 172.21.15.5:0/3213150796 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377394984 0 0) 0x7f96c80b0ff0 con 0x7f96c8158ce0 2023-07-14T12:53:16.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.765+0000 7f96c77fe640 1 -- 172.21.15.5:0/3213150796 >> v1:172.21.15.5:6789/0 conn(0x7f96c80c8ad0 legacy=0x7f96c80c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:16.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.765+0000 7f96c77fe640 1 -- 172.21.15.5:0/3213150796 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c80cbdd0 con 0x7f96c80c9730 2023-07-14T12:53:16.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.765+0000 7f96c77fe640 1 --2- 172.21.15.5:0/3213150796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96c80c9730 0x7f96c81638b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f96c0009d90 tx=0x7f96c001c640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21d08b087d6e2ff1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:16.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.765+0000 7f96c67fc640 1 -- 172.21.15.5:0/3213150796 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b0001680 con 0x7f96c80c9730 2023-07-14T12:53:16.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.765+0000 7f96c67fc640 1 -- 172.21.15.5:0/3213150796 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c00a8430 con 0x7f96c80c9730 2023-07-14T12:53:16.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.765+0000 7f96c67fc640 1 -- 172.21.15.5:0/3213150796 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c00a87c0 con 0x7f96c80c9730 2023-07-14T12:53:16.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.769+0000 7f96cd4f9640 1 -- 172.21.15.5:0/3213150796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96c80c9730 msgr2=0x7f96c81638b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:16.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.769+0000 7f96cd4f9640 1 --2- 172.21.15.5:0/3213150796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96c80c9730 0x7f96c81638b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f96c0009d90 tx=0x7f96c001c640 comp rx=0 tx=0).stop 2023-07-14T12:53:16.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.769+0000 7f96cd4f9640 1 -- 172.21.15.5:0/3213150796 shutdown_connections 2023-07-14T12:53:16.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.769+0000 7f96cd4f9640 1 --2- 172.21.15.5:0/3213150796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96c80c9730 0x7f96c81638b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:16.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.769+0000 7f96cd4f9640 1 -- 172.21.15.5:0/3213150796 >> 172.21.15.5:0/3213150796 conn(0x7f96c80afcf0 msgr2=0x7f96c80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:16.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.769+0000 7f96cd4f9640 1 -- 172.21.15.5:0/3213150796 shutdown_connections 2023-07-14T12:53:16.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.769+0000 7f96cd4f9640 1 -- 172.21.15.5:0/3213150796 wait complete. 2023-07-14T12:53:16.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.769+0000 7f96cd4f9640 1 Processor -- start 2023-07-14T12:53:16.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.769+0000 7f96cd4f9640 1 -- start start 2023-07-14T12:53:16.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.769+0000 7f96cd4f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96c80c8ad0 0x7f96c8149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:16.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.769+0000 7f96cd4f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96c80c9730 0x7f96c815b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:16.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.769+0000 7f96cd4f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96c8158ce0 0x7f96c80adb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:16.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.769+0000 7f96cd4f9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c8159f70 con 0x7f96c80c9730 2023-07-14T12:53:16.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.769+0000 7f96cd4f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c815a250 con 0x7f96c8158ce0 2023-07-14T12:53:16.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.769+0000 7f96cd4f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c815a530 con 0x7f96c80c8ad0 2023-07-14T12:53:16.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.769+0000 7f96bffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96c80c9730 0x7f96c815b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:16.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.769+0000 7f96bffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96c80c9730 0x7f96c815b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55956/0 (socket says 172.21.15.5:55956) 2023-07-14T12:53:16.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.769+0000 7f96bffff640 1 -- 172.21.15.5:0/442363423 learned_addr learned my addr 172.21.15.5:0/442363423 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:16.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.769+0000 7f96c6ffd640 1 --2- 172.21.15.5:0/442363423 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96c80c8ad0 0x7f96c8149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:16.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.769+0000 7f96c77fe640 1 --2- 172.21.15.5:0/442363423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96c8158ce0 0x7f96c80adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.769+0000 7f96bffff640 1 -- 172.21.15.5:0/442363423 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96c80c8ad0 msgr2=0x7f96c8149b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.769+0000 7f96bffff640 1 --2- 172.21.15.5:0/442363423 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96c80c8ad0 0x7f96c8149b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.769+0000 7f96bffff640 1 -- 172.21.15.5:0/442363423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96c8158ce0 msgr2=0x7f96c80adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.769+0000 7f96bffff640 1 --2- 172.21.15.5:0/442363423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96c8158ce0 0x7f96c80adb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.769+0000 7f96bffff640 1 -- 172.21.15.5:0/442363423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c0009a70 con 0x7f96c80c9730 2023-07-14T12:53:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.769+0000 7f96c77fe640 1 --2- 172.21.15.5:0/442363423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96c8158ce0 0x7f96c80adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:16.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.769+0000 7f96bffff640 1 --2- 172.21.15.5:0/442363423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96c80c9730 0x7f96c815b010 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f96b000c7a0 tx=0x7f96b000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:16.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.773+0000 7f96bf7fe640 1 -- 172.21.15.5:0/442363423 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b00074e0 con 0x7f96c80c9730 2023-07-14T12:53:16.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.773+0000 7f96bf7fe640 1 -- 172.21.15.5:0/442363423 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b0007660 con 0x7f96c80c9730 2023-07-14T12:53:16.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.773+0000 7f96cd4f9640 1 -- 172.21.15.5:0/442363423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c815a810 con 0x7f96c80c9730 2023-07-14T12:53:16.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.773+0000 7f96bf7fe640 1 -- 172.21.15.5:0/442363423 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b0004a30 con 0x7f96c80c9730 2023-07-14T12:53:16.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.773+0000 7f96cd4f9640 1 -- 172.21.15.5:0/442363423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c8159bf0 con 0x7f96c80c9730 2023-07-14T12:53:16.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.773+0000 7f96cd4f9640 1 -- 172.21.15.5:0/442363423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c80678d0 con 0x7f96c80c9730 2023-07-14T12:53:16.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.773+0000 7f96bf7fe640 1 -- 172.21.15.5:0/442363423 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f96b0004c50 con 0x7f96c80c9730 2023-07-14T12:53:16.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.773+0000 7f96bf7fe640 1 --2- 172.21.15.5:0/442363423 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f96a8066280 0x7f96a8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:16.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.773+0000 7f96bf7fe640 1 -- 172.21.15.5:0/442363423 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f96b0083510 con 0x7f96c80c9730 2023-07-14T12:53:16.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.773+0000 7f96c6ffd640 1 --2- 172.21.15.5:0/442363423 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f96a8066280 0x7f96a8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:16.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.777+0000 7f96c6ffd640 1 --2- 172.21.15.5:0/442363423 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f96a8066280 0x7f96a8068730 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f96b8007fd0 tx=0x7f96b8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:16.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.777+0000 7f96bf7fe640 1 -- 172.21.15.5:0/442363423 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f96b0050ad0 con 0x7f96c80c9730 2023-07-14T12:53:17.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:16.985+0000 7f96cd4f9640 1 -- 172.21.15.5:0/442363423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7f96c815acc0 con 0x7f96c80c9730 2023-07-14T12:53:17.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.505+0000 7f96bf7fe640 1 -- 172.21.15.5:0/442363423 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v56) v1 ==== 161+0+0 (secure 0 0 0) 0x7f96b00540f0 con 0x7f96c80c9730 2023-07-14T12:53:17.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.509+0000 7f96cd4f9640 1 -- 172.21.15.5:0/442363423 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f96a8066280 msgr2=0x7f96a8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:17.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.509+0000 7f96cd4f9640 1 --2- 172.21.15.5:0/442363423 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f96a8066280 0x7f96a8068730 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f96b8007fd0 tx=0x7f96b8009040 comp rx=0 tx=0).stop 2023-07-14T12:53:17.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.509+0000 7f96cd4f9640 1 -- 172.21.15.5:0/442363423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96c80c9730 msgr2=0x7f96c815b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:17.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.509+0000 7f96cd4f9640 1 --2- 172.21.15.5:0/442363423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96c80c9730 0x7f96c815b010 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f96b000c7a0 tx=0x7f96b000cc60 comp rx=0 tx=0).stop 2023-07-14T12:53:17.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.509+0000 7f96cd4f9640 1 -- 172.21.15.5:0/442363423 shutdown_connections 2023-07-14T12:53:17.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.509+0000 7f96cd4f9640 1 --2- 172.21.15.5:0/442363423 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f96a8066280 0x7f96a8068730 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:17.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.509+0000 7f96cd4f9640 1 --2- 172.21.15.5:0/442363423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96c8158ce0 0x7f96c80adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:17.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.509+0000 7f96cd4f9640 1 --2- 172.21.15.5:0/442363423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96c80c9730 0x7f96c815b010 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:17.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.509+0000 7f96cd4f9640 1 --2- 172.21.15.5:0/442363423 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96c80c8ad0 0x7f96c8149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:17.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.509+0000 7f96cd4f9640 1 -- 172.21.15.5:0/442363423 >> 172.21.15.5:0/442363423 conn(0x7f96c80afcf0 msgr2=0x7f96c81560b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:17.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.509+0000 7f96cd4f9640 1 -- 172.21.15.5:0/442363423 shutdown_connections 2023-07-14T12:53:17.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.509+0000 7f96cd4f9640 1 -- 172.21.15.5:0/442363423 wait complete. 2023-07-14T12:53:17.558 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-14T12:53:17.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.681+0000 7fc30e511640 1 Processor -- start 2023-07-14T12:53:17.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.681+0000 7fc30e511640 1 -- start start 2023-07-14T12:53:17.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.681+0000 7fc30e511640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc308070f30 0x7fc3080ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:17.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.681+0000 7fc30e511640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc3080af2b0 0x7fc30815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:17.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.681+0000 7fc30e511640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc308159d70 con 0x7fc308069430 2023-07-14T12:53:17.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.681+0000 7fc30e511640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3080c9c60 con 0x7fc3080af2b0 2023-07-14T12:53:17.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.681+0000 7fc30e511640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3080c9f40 con 0x7fc308070f30 2023-07-14T12:53:17.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.681+0000 7fc3077fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc308070f30 0x7fc3080ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:17.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.681+0000 7fc3077fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc308070f30 0x7fc3080ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:51030/0 (socket says 172.21.15.5:51030) 2023-07-14T12:53:17.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.681+0000 7fc307fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc308069430 0x7fc308069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:37304/0 (socket says 172.21.15.5:37304) 2023-07-14T12:53:17.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.681+0000 7fc3077fe640 1 -- 172.21.15.5:0/1918039743 learned_addr learned my addr 172.21.15.5:0/1918039743 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:17.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.681+0000 7fc30caae640 1 --2- 172.21.15.5:0/1918039743 >> v2:172.21.15.154:3300/0 conn(0x7fc3080af2b0 0x7fc30815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:17.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.681+0000 7fc306ffd640 1 -- 172.21.15.5:0/1918039743 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223968934 0 0) 0x7fc2f8001120 con 0x7fc308069430 2023-07-14T12:53:17.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.681+0000 7fc3077fe640 1 -- 172.21.15.5:0/1918039743 >> v2:172.21.15.154:3300/0 conn(0x7fc3080af2b0 msgr2=0x7fc30815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:17.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.681+0000 7fc3077fe640 1 --2- 172.21.15.5:0/1918039743 >> v2:172.21.15.154:3300/0 conn(0x7fc3080af2b0 0x7fc30815a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:17.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.681+0000 7fc3077fe640 1 -- 172.21.15.5:0/1918039743 >> v1:172.21.15.154:6789/0 conn(0x7fc308069430 legacy=0x7fc308069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:17.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.681+0000 7fc3077fe640 1 -- 172.21.15.5:0/1918039743 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3080ca220 con 0x7fc308070f30 2023-07-14T12:53:17.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.685+0000 7fc3077fe640 1 --2- 172.21.15.5:0/1918039743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc308070f30 0x7fc3080ad6f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc009870 tx=0x7fc2fc01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44dbd6e7e685e2a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:17.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.685+0000 7fc306ffd640 1 -- 172.21.15.5:0/1918039743 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc0a9400 con 0x7fc308070f30 2023-07-14T12:53:17.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.685+0000 7fc306ffd640 1 -- 172.21.15.5:0/1918039743 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2fc0a9560 con 0x7fc308070f30 2023-07-14T12:53:17.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.685+0000 7fc306ffd640 1 -- 172.21.15.5:0/1918039743 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc0a98f0 con 0x7fc308070f30 2023-07-14T12:53:17.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.685+0000 7fc30e511640 1 -- 172.21.15.5:0/1918039743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc308070f30 msgr2=0x7fc3080ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:17.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.685+0000 7fc30e511640 1 --2- 172.21.15.5:0/1918039743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc308070f30 0x7fc3080ad6f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc009870 tx=0x7fc2fc01c540 comp rx=0 tx=0).stop 2023-07-14T12:53:17.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.685+0000 7fc30e511640 1 -- 172.21.15.5:0/1918039743 shutdown_connections 2023-07-14T12:53:17.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.685+0000 7fc30e511640 1 --2- 172.21.15.5:0/1918039743 >> v2:172.21.15.154:3300/0 conn(0x7fc3080af2b0 0x7fc30815a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:17.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.685+0000 7fc30e511640 1 --2- 172.21.15.5:0/1918039743 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc308070f30 0x7fc3080ad6f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:17.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.685+0000 7fc30e511640 1 -- 172.21.15.5:0/1918039743 >> 172.21.15.5:0/1918039743 conn(0x7fc3080cde90 msgr2=0x7fc3080ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:17.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.685+0000 7fc30e511640 1 -- 172.21.15.5:0/1918039743 shutdown_connections 2023-07-14T12:53:17.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.685+0000 7fc30e511640 1 -- 172.21.15.5:0/1918039743 wait complete. 2023-07-14T12:53:17.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.689+0000 7fc30e511640 1 Processor -- start 2023-07-14T12:53:17.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.689+0000 7fc30e511640 1 -- start start 2023-07-14T12:53:17.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.689+0000 7fc30e511640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc308069430 0x7fc308155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:17.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.689+0000 7fc30e511640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc308070f30 0x7fc3080cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:17.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.689+0000 7fc30e511640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3080af2b0 0x7fc3080c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:17.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.689+0000 7fc30e511640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3080ccc30 con 0x7fc308070f30 2023-07-14T12:53:17.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.689+0000 7fc30e511640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3081564f0 con 0x7fc3080af2b0 2023-07-14T12:53:17.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.689+0000 7fc30e511640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30806c0d0 con 0x7fc308069430 2023-07-14T12:53:17.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.689+0000 7fc3077fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc308070f30 0x7fc3080cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:17.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.689+0000 7fc3077fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc308070f30 0x7fc3080cc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55966/0 (socket says 172.21.15.5:55966) 2023-07-14T12:53:17.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.689+0000 7fc3077fe640 1 -- 172.21.15.5:0/1906745060 learned_addr learned my addr 172.21.15.5:0/1906745060 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:17.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.689+0000 7fc307fff640 1 --2- 172.21.15.5:0/1906745060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc308069430 0x7fc308155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:17.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.689+0000 7fc30caae640 1 --2- 172.21.15.5:0/1906745060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3080af2b0 0x7fc3080c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:17.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.689+0000 7fc3077fe640 1 -- 172.21.15.5:0/1906745060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc308069430 msgr2=0x7fc308155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:17.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.689+0000 7fc3077fe640 1 --2- 172.21.15.5:0/1906745060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc308069430 0x7fc308155fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:17.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.689+0000 7fc3077fe640 1 -- 172.21.15.5:0/1906745060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3080af2b0 msgr2=0x7fc3080c77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:17.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.689+0000 7fc3077fe640 1 --2- 172.21.15.5:0/1906745060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3080af2b0 0x7fc3080c77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:17.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.689+0000 7fc3077fe640 1 -- 172.21.15.5:0/1906745060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2fc0094d0 con 0x7fc308070f30 2023-07-14T12:53:17.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.689+0000 7fc3077fe640 1 --2- 172.21.15.5:0/1906745060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc308070f30 0x7fc3080cc450 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc01a170 tx=0x7fc2fc01ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:17.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.689+0000 7fc304ff9640 1 -- 172.21.15.5:0/1906745060 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc0a9400 con 0x7fc308070f30 2023-07-14T12:53:17.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.689+0000 7fc304ff9640 1 -- 172.21.15.5:0/1906745060 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2fc004220 con 0x7fc308070f30 2023-07-14T12:53:17.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.689+0000 7fc304ff9640 1 -- 172.21.15.5:0/1906745060 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc003620 con 0x7fc308070f30 2023-07-14T12:53:17.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.689+0000 7fc30e511640 1 -- 172.21.15.5:0/1906745060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3080cc990 con 0x7fc308070f30 2023-07-14T12:53:17.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.689+0000 7fc30e511640 1 -- 172.21.15.5:0/1906745060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc30806ba80 con 0x7fc308070f30 2023-07-14T12:53:17.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.693+0000 7fc30e511640 1 -- 172.21.15.5:0/1906745060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3080678d0 con 0x7fc308070f30 2023-07-14T12:53:17.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.693+0000 7fc304ff9640 1 -- 172.21.15.5:0/1906745060 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc2fc0b9070 con 0x7fc308070f30 2023-07-14T12:53:17.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.693+0000 7fc304ff9640 1 --2- 172.21.15.5:0/1906745060 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc2f4066280 0x7fc2f4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:17.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.693+0000 7fc304ff9640 1 -- 172.21.15.5:0/1906745060 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc2fc11e0a0 con 0x7fc308070f30 2023-07-14T12:53:17.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.693+0000 7fc307fff640 1 --2- 172.21.15.5:0/1906745060 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc2f4066280 0x7fc2f4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:17.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.693+0000 7fc307fff640 1 --2- 172.21.15.5:0/1906745060 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc2f4066280 0x7fc2f4068730 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8000f70 tx=0x7fc2f8007d10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:17.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.697+0000 7fc304ff9640 1 -- 172.21.15.5:0/1906745060 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc2fc0eb510 con 0x7fc308070f30 2023-07-14T12:53:17.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.853+0000 7fc30e511640 1 -- 172.21.15.5:0/1906745060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc30806c210 con 0x7fc308070f30 2023-07-14T12:53:17.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.857+0000 7fc304ff9640 1 -- 172.21.15.5:0/1906745060 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc2fc0eeb30 con 0x7fc308070f30 2023-07-14T12:53:17.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.861+0000 7fc30e511640 1 -- 172.21.15.5:0/1906745060 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc2f4066280 msgr2=0x7fc2f4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:17.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.861+0000 7fc30e511640 1 --2- 172.21.15.5:0/1906745060 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc2f4066280 0x7fc2f4068730 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8000f70 tx=0x7fc2f8007d10 comp rx=0 tx=0).stop 2023-07-14T12:53:17.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.861+0000 7fc30e511640 1 -- 172.21.15.5:0/1906745060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc308070f30 msgr2=0x7fc3080cc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:17.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.861+0000 7fc30e511640 1 --2- 172.21.15.5:0/1906745060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc308070f30 0x7fc3080cc450 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc01a170 tx=0x7fc2fc01ad80 comp rx=0 tx=0).stop 2023-07-14T12:53:17.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.861+0000 7fc30e511640 1 -- 172.21.15.5:0/1906745060 shutdown_connections 2023-07-14T12:53:17.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.861+0000 7fc30e511640 1 --2- 172.21.15.5:0/1906745060 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc2f4066280 0x7fc2f4068730 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:17.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.861+0000 7fc30e511640 1 --2- 172.21.15.5:0/1906745060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3080af2b0 0x7fc3080c77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:17.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.861+0000 7fc30e511640 1 --2- 172.21.15.5:0/1906745060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc308070f30 0x7fc3080cc450 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:17.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.861+0000 7fc30e511640 1 --2- 172.21.15.5:0/1906745060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc308069430 0x7fc308155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:17.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.861+0000 7fc30e511640 1 -- 172.21.15.5:0/1906745060 >> 172.21.15.5:0/1906745060 conn(0x7fc3080cde90 msgr2=0x7fc308157890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:17.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.861+0000 7fc30e511640 1 -- 172.21.15.5:0/1906745060 shutdown_connections 2023-07-14T12:53:17.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:17.861+0000 7fc30e511640 1 -- 172.21.15.5:0/1906745060 wait complete. 2023-07-14T12:53:17.907 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T12:53:17.908 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T12:53:17.969 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T12:53:18.016 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T12:53:18.017 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:53:18.017 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T12:53:18.026 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:53:18.026 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T12:53:18.075 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:53:18.075 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T12:53:18.132 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:53:18.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.289+0000 7ff191374640 1 Processor -- start 2023-07-14T12:53:18.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.289+0000 7ff191374640 1 -- start start 2023-07-14T12:53:18.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.289+0000 7ff191374640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff18c15f500 0x7ff18c06cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:18.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.289+0000 7ff191374640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff18c0cdc80 con 0x7ff18c06ac50 2023-07-14T12:53:18.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.289+0000 7ff191374640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff18c06e4c0 con 0x7ff18c06d430 2023-07-14T12:53:18.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.289+0000 7ff191374640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff18c06d940 con 0x7ff18c15f500 2023-07-14T12:53:18.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.293+0000 7ff18affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff18c15f500 0x7ff18c06cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:18.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.293+0000 7ff18affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff18c15f500 0x7ff18c06cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55970/0 (socket says 172.21.15.5:55970) 2023-07-14T12:53:18.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.293+0000 7ff18affd640 1 -- 172.21.15.5:0/1191111211 learned_addr learned my addr 172.21.15.5:0/1191111211 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:18.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.293+0000 7ff18b7fe640 1 --1- 172.21.15.5:0/1191111211 >> v1:172.21.15.5:6789/0 conn(0x7ff18c06ac50 0x7ff18c0ce0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59480/0 (socket says 172.21.15.5:59480) 2023-07-14T12:53:18.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.293+0000 7ff18affd640 1 -- 172.21.15.5:0/1191111211 >> v1:172.21.15.154:6789/0 conn(0x7ff18c06d430 legacy=0x7ff18c06a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:18.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.293+0000 7ff18affd640 1 -- 172.21.15.5:0/1191111211 >> v1:172.21.15.5:6789/0 conn(0x7ff18c06ac50 legacy=0x7ff18c0ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:18.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.293+0000 7ff18affd640 1 -- 172.21.15.5:0/1191111211 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c06dc20 con 0x7ff18c15f500 2023-07-14T12:53:18.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.293+0000 7ff18a7fc640 1 -- 172.21.15.5:0/1191111211 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2592085666 0 0) 0x7ff18c0cdc80 con 0x7ff18c06ac50 2023-07-14T12:53:18.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.293+0000 7ff18affd640 1 --2- 172.21.15.5:0/1191111211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff18c15f500 0x7ff18c06cef0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff17c006fd0 tx=0x7ff17c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aa75af3d7ec8a1e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:18.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.293+0000 7ff18a7fc640 1 -- 172.21.15.5:0/1191111211 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c0ab610 con 0x7ff18c15f500 2023-07-14T12:53:18.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.293+0000 7ff18a7fc640 1 -- 172.21.15.5:0/1191111211 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17c0ab770 con 0x7ff18c15f500 2023-07-14T12:53:18.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.293+0000 7ff18a7fc640 1 -- 172.21.15.5:0/1191111211 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c0abb00 con 0x7ff18c15f500 2023-07-14T12:53:18.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.297+0000 7ff191374640 1 -- 172.21.15.5:0/1191111211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff18c15f500 msgr2=0x7ff18c06cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:18.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.297+0000 7ff191374640 1 --2- 172.21.15.5:0/1191111211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff18c15f500 0x7ff18c06cef0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff17c006fd0 tx=0x7ff17c01c520 comp rx=0 tx=0).stop 2023-07-14T12:53:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.297+0000 7ff191374640 1 -- 172.21.15.5:0/1191111211 shutdown_connections 2023-07-14T12:53:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.297+0000 7ff191374640 1 --2- 172.21.15.5:0/1191111211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff18c15f500 0x7ff18c06cef0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.297+0000 7ff191374640 1 -- 172.21.15.5:0/1191111211 >> 172.21.15.5:0/1191111211 conn(0x7ff18c0659d0 msgr2=0x7ff18c099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.297+0000 7ff191374640 1 -- 172.21.15.5:0/1191111211 shutdown_connections 2023-07-14T12:53:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.297+0000 7ff191374640 1 -- 172.21.15.5:0/1191111211 wait complete. 2023-07-14T12:53:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.297+0000 7ff191374640 1 Processor -- start 2023-07-14T12:53:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.297+0000 7ff191374640 1 -- start start 2023-07-14T12:53:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.297+0000 7ff191374640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff18c06ac50 0x7ff18c155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.297+0000 7ff191374640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff18c06d430 0x7ff18c0cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.297+0000 7ff191374640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff18c15f500 0x7ff18c0b3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.297+0000 7ff191374640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c0cc180 con 0x7ff18c06d430 2023-07-14T12:53:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.297+0000 7ff191374640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c0b42d0 con 0x7ff18c15f500 2023-07-14T12:53:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.297+0000 7ff191374640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c0b45b0 con 0x7ff18c06ac50 2023-07-14T12:53:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.297+0000 7ff183fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff18c06d430 0x7ff18c0cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.297+0000 7ff183fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff18c06d430 0x7ff18c0cc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55974/0 (socket says 172.21.15.5:55974) 2023-07-14T12:53:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.297+0000 7ff183fff640 1 -- 172.21.15.5:0/99026191 learned_addr learned my addr 172.21.15.5:0/99026191 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.297+0000 7ff18b7fe640 1 --2- 172.21.15.5:0/99026191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff18c15f500 0x7ff18c0b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.297+0000 7ff18affd640 1 --2- 172.21.15.5:0/99026191 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff18c06ac50 0x7ff18c155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:18.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.301+0000 7ff183fff640 1 -- 172.21.15.5:0/99026191 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff18c06ac50 msgr2=0x7ff18c155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:18.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.301+0000 7ff183fff640 1 --2- 172.21.15.5:0/99026191 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff18c06ac50 0x7ff18c155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:18.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.301+0000 7ff183fff640 1 -- 172.21.15.5:0/99026191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff18c15f500 msgr2=0x7ff18c0b3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:18.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.301+0000 7ff183fff640 1 --2- 172.21.15.5:0/99026191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff18c15f500 0x7ff18c0b3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:18.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.301+0000 7ff183fff640 1 -- 172.21.15.5:0/99026191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c009480 con 0x7ff18c06d430 2023-07-14T12:53:18.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.301+0000 7ff18affd640 1 --2- 172.21.15.5:0/99026191 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff18c06ac50 0x7ff18c155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:18.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.301+0000 7ff18b7fe640 1 --2- 172.21.15.5:0/99026191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff18c15f500 0x7ff18c0b3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:18.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.301+0000 7ff183fff640 1 --2- 172.21.15.5:0/99026191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff18c06d430 0x7ff18c0cc5a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff17400c4d0 tx=0x7ff17400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:18.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.301+0000 7ff1837fe640 1 -- 172.21.15.5:0/99026191 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1740052d0 con 0x7ff18c06d430 2023-07-14T12:53:18.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.301+0000 7ff1837fe640 1 -- 172.21.15.5:0/99026191 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff174005430 con 0x7ff18c06d430 2023-07-14T12:53:18.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.301+0000 7ff1837fe640 1 -- 172.21.15.5:0/99026191 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff174012830 con 0x7ff18c06d430 2023-07-14T12:53:18.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.301+0000 7ff191374640 1 -- 172.21.15.5:0/99026191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff18c0cbda0 con 0x7ff18c06d430 2023-07-14T12:53:18.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.301+0000 7ff191374640 1 -- 172.21.15.5:0/99026191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff18c156120 con 0x7ff18c06d430 2023-07-14T12:53:18.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.301+0000 7ff191374640 1 -- 172.21.15.5:0/99026191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff18c0b47f0 con 0x7ff18c06d430 2023-07-14T12:53:18.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.301+0000 7ff1837fe640 1 -- 172.21.15.5:0/99026191 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff174012990 con 0x7ff18c06d430 2023-07-14T12:53:18.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.301+0000 7ff1837fe640 1 --2- 172.21.15.5:0/99026191 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff16c066280 0x7ff16c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:18.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.301+0000 7ff1837fe640 1 -- 172.21.15.5:0/99026191 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff174083870 con 0x7ff18c06d430 2023-07-14T12:53:18.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.305+0000 7ff18affd640 1 --2- 172.21.15.5:0/99026191 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff16c066280 0x7ff16c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:18.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.305+0000 7ff18affd640 1 --2- 172.21.15.5:0/99026191 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff16c066280 0x7ff16c068730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0af000 tx=0x7ff17c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:18.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.305+0000 7ff1837fe640 1 -- 172.21.15.5:0/99026191 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff18c0b47f0 con 0x7ff18c06d430 2023-07-14T12:53:18.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.465+0000 7ff191374640 1 -- 172.21.15.5:0/99026191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff18c0cc2c0 con 0x7ff18c06d430 2023-07-14T12:53:18.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.465+0000 7ff1837fe640 1 -- 172.21.15.5:0/99026191 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18231 (secure 0 0 0) 0x7ff18c0cc2c0 con 0x7ff18c06d430 2023-07-14T12:53:18.494 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:18.494 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":23,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:52:48.091483+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:52:44.223082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T12:52:45.469396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:53:18.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.469+0000 7ff191374640 1 -- 172.21.15.5:0/99026191 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff16c066280 msgr2=0x7ff16c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:18.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.469+0000 7ff191374640 1 --2- 172.21.15.5:0/99026191 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff16c066280 0x7ff16c068730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0af000 tx=0x7ff17c0a7000 comp rx=0 tx=0).stop 2023-07-14T12:53:18.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.469+0000 7ff191374640 1 -- 172.21.15.5:0/99026191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff18c06d430 msgr2=0x7ff18c0cc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:18.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.469+0000 7ff191374640 1 --2- 172.21.15.5:0/99026191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff18c06d430 0x7ff18c0cc5a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff17400c4d0 tx=0x7ff17400c990 comp rx=0 tx=0).stop 2023-07-14T12:53:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.469+0000 7ff191374640 1 -- 172.21.15.5:0/99026191 shutdown_connections 2023-07-14T12:53:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.469+0000 7ff191374640 1 --2- 172.21.15.5:0/99026191 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff16c066280 0x7ff16c068730 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.469+0000 7ff191374640 1 --2- 172.21.15.5:0/99026191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff18c15f500 0x7ff18c0b3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.469+0000 7ff191374640 1 --2- 172.21.15.5:0/99026191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff18c06d430 0x7ff18c0cc5a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.469+0000 7ff191374640 1 --2- 172.21.15.5:0/99026191 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff18c06ac50 0x7ff18c155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.469+0000 7ff191374640 1 -- 172.21.15.5:0/99026191 >> 172.21.15.5:0/99026191 conn(0x7ff18c0659d0 msgr2=0x7ff18c0aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.469+0000 7ff191374640 1 -- 172.21.15.5:0/99026191 shutdown_connections 2023-07-14T12:53:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.469+0000 7ff191374640 1 -- 172.21.15.5:0/99026191 wait complete. 2023-07-14T12:53:18.516 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T12:52:44.223082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T12:52:45.469396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T12:53:18.517 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T12:53:18.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.637+0000 7f9e69c0b640 1 Processor -- start 2023-07-14T12:53:18.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.637+0000 7f9e69c0b640 1 -- start start 2023-07-14T12:53:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.641+0000 7f9e69c0b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9e64159440 0x7f9e640c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.641+0000 7f9e69c0b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e641532b0 con 0x7f9e640aeb40 2023-07-14T12:53:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.641+0000 7f9e69c0b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e640ca6f0 con 0x7f9e6415cef0 2023-07-14T12:53:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.641+0000 7f9e69c0b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6415d360 con 0x7f9e64159440 2023-07-14T12:53:18.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.641+0000 7f9e637fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9e640aeb40 0x7f9e640aef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59484/0 (socket says 172.21.15.5:59484) 2023-07-14T12:53:18.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.641+0000 7f9e637fe640 1 -- 172.21.15.5:0/3744307264 learned_addr learned my addr 172.21.15.5:0/3744307264 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:18.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.641+0000 7f9e63fff640 1 --2- 172.21.15.5:0/3744307264 >> v2:172.21.15.154:3300/0 conn(0x7f9e64159440 0x7f9e640c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:18.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.641+0000 7f9e627fc640 1 -- 172.21.15.5:0/3744307264 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2262950362 0 0) 0x7f9e641532b0 con 0x7f9e640aeb40 2023-07-14T12:53:18.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.641+0000 7f9e627fc640 1 -- 172.21.15.5:0/3744307264 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e4c003530 con 0x7f9e640aeb40 2023-07-14T12:53:18.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.641+0000 7f9e627fc640 1 -- 172.21.15.5:0/3744307264 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 958913929 0 0) 0x7f9e640ca6f0 con 0x7f9e6415cef0 2023-07-14T12:53:18.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.641+0000 7f9e627fc640 1 -- 172.21.15.5:0/3744307264 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e641532b0 con 0x7f9e6415cef0 2023-07-14T12:53:18.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.641+0000 7f9e63fff640 1 -- 172.21.15.5:0/3744307264 >> v1:172.21.15.154:6789/0 conn(0x7f9e6415cef0 legacy=0x7f9e64158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:18.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.641+0000 7f9e63fff640 1 -- 172.21.15.5:0/3744307264 >> v1:172.21.15.5:6789/0 conn(0x7f9e640aeb40 legacy=0x7f9e640aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:18.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.641+0000 7f9e63fff640 1 -- 172.21.15.5:0/3744307264 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e641599d0 con 0x7f9e64159440 2023-07-14T12:53:18.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.645+0000 7f9e63fff640 1 --2- 172.21.15.5:0/3744307264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e64159440 0x7f9e640c88c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c009d90 tx=0x7f9e5c01c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b41cb3d8c0595e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:18.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.645+0000 7f9e627fc640 1 -- 172.21.15.5:0/3744307264 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e54001680 con 0x7f9e64159440 2023-07-14T12:53:18.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.645+0000 7f9e627fc640 1 -- 172.21.15.5:0/3744307264 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5c0a55e0 con 0x7f9e64159440 2023-07-14T12:53:18.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.645+0000 7f9e627fc640 1 -- 172.21.15.5:0/3744307264 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c0a5970 con 0x7f9e64159440 2023-07-14T12:53:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.645+0000 7f9e69c0b640 1 -- 172.21.15.5:0/3744307264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e64159440 msgr2=0x7f9e640c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.645+0000 7f9e69c0b640 1 --2- 172.21.15.5:0/3744307264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e64159440 0x7f9e640c88c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c009d90 tx=0x7f9e5c01c760 comp rx=0 tx=0).stop 2023-07-14T12:53:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.645+0000 7f9e69c0b640 1 -- 172.21.15.5:0/3744307264 shutdown_connections 2023-07-14T12:53:18.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.645+0000 7f9e69c0b640 1 --2- 172.21.15.5:0/3744307264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e64159440 0x7f9e640c88c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:18.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.645+0000 7f9e69c0b640 1 -- 172.21.15.5:0/3744307264 >> 172.21.15.5:0/3744307264 conn(0x7f9e640cde90 msgr2=0x7f9e640ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:18.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.645+0000 7f9e69c0b640 1 -- 172.21.15.5:0/3744307264 shutdown_connections 2023-07-14T12:53:18.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.645+0000 7f9e69c0b640 1 -- 172.21.15.5:0/3744307264 wait complete. 2023-07-14T12:53:18.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.645+0000 7f9e69c0b640 1 Processor -- start 2023-07-14T12:53:18.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.645+0000 7f9e69c0b640 1 -- start start 2023-07-14T12:53:18.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.645+0000 7f9e69c0b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e640aeb40 0x7f9e6414d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:18.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.645+0000 7f9e69c0b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e64159440 0x7f9e6414f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:18.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.645+0000 7f9e69c0b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e6415cef0 0x7f9e6414fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:18.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.645+0000 7f9e69c0b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e64150890 con 0x7f9e64159440 2023-07-14T12:53:18.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.645+0000 7f9e69c0b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e641569a0 con 0x7f9e6415cef0 2023-07-14T12:53:18.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.645+0000 7f9e69c0b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e64070810 con 0x7f9e640aeb40 2023-07-14T12:53:18.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.649+0000 7f9e62ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e64159440 0x7f9e6414f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:18.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.649+0000 7f9e62ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e64159440 0x7f9e6414f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55980/0 (socket says 172.21.15.5:55980) 2023-07-14T12:53:18.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.649+0000 7f9e62ffd640 1 -- 172.21.15.5:0/1169647313 learned_addr learned my addr 172.21.15.5:0/1169647313 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.649+0000 7f9e63fff640 1 --2- 172.21.15.5:0/1169647313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e6415cef0 0x7f9e6414fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.649+0000 7f9e637fe640 1 --2- 172.21.15.5:0/1169647313 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e640aeb40 0x7f9e6414d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.649+0000 7f9e62ffd640 1 -- 172.21.15.5:0/1169647313 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e640aeb40 msgr2=0x7f9e6414d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.649+0000 7f9e62ffd640 1 --2- 172.21.15.5:0/1169647313 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e640aeb40 0x7f9e6414d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.649+0000 7f9e62ffd640 1 -- 172.21.15.5:0/1169647313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e6415cef0 msgr2=0x7f9e6414fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.649+0000 7f9e62ffd640 1 --2- 172.21.15.5:0/1169647313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e6415cef0 0x7f9e6414fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.649+0000 7f9e62ffd640 1 -- 172.21.15.5:0/1169647313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e5c009a70 con 0x7f9e64159440 2023-07-14T12:53:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.649+0000 7f9e63fff640 1 --2- 172.21.15.5:0/1169647313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e6415cef0 0x7f9e6414fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.649+0000 7f9e62ffd640 1 --2- 172.21.15.5:0/1169647313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e64159440 0x7f9e6414f8f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9e5800c430 tx=0x7f9e5800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.649+0000 7f9e4bfff640 1 -- 172.21.15.5:0/1169647313 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e580052d0 con 0x7f9e64159440 2023-07-14T12:53:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.649+0000 7f9e4bfff640 1 -- 172.21.15.5:0/1169647313 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e58005450 con 0x7f9e64159440 2023-07-14T12:53:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.649+0000 7f9e4bfff640 1 -- 172.21.15.5:0/1169647313 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e58003840 con 0x7f9e64159440 2023-07-14T12:53:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.649+0000 7f9e69c0b640 1 -- 172.21.15.5:0/1169647313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e64070af0 con 0x7f9e64159440 2023-07-14T12:53:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.649+0000 7f9e69c0b640 1 -- 172.21.15.5:0/1169647313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e640710b0 con 0x7f9e64159440 2023-07-14T12:53:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.649+0000 7f9e69c0b640 1 -- 172.21.15.5:0/1169647313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e640678d0 con 0x7f9e64159440 2023-07-14T12:53:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.649+0000 7f9e4bfff640 1 -- 172.21.15.5:0/1169647313 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9e580039a0 con 0x7f9e64159440 2023-07-14T12:53:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.653+0000 7f9e4bfff640 1 --2- 172.21.15.5:0/1169647313 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9e50066280 0x7f9e50068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.653+0000 7f9e4bfff640 1 -- 172.21.15.5:0/1169647313 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9e58083390 con 0x7f9e64159440 2023-07-14T12:53:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.653+0000 7f9e637fe640 1 --2- 172.21.15.5:0/1169647313 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9e50066280 0x7f9e50068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.653+0000 7f9e637fe640 1 --2- 172.21.15.5:0/1169647313 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9e50066280 0x7f9e50068730 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9e641f7b00 tx=0x7f9e54001940 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:18.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.657+0000 7f9e4bfff640 1 -- 172.21.15.5:0/1169647313 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9e58050800 con 0x7f9e64159440 2023-07-14T12:53:18.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.809+0000 7f9e69c0b640 1 -- 172.21.15.5:0/1169647313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9e640c36a0 con 0x7f9e64159440 2023-07-14T12:53:18.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.809+0000 7f9e4bfff640 1 -- 172.21.15.5:0/1169647313 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9e58053e20 con 0x7f9e64159440 2023-07-14T12:53:18.839 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T12:53:18.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.813+0000 7f9e69c0b640 1 -- 172.21.15.5:0/1169647313 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9e50066280 msgr2=0x7f9e50068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:18.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.813+0000 7f9e69c0b640 1 --2- 172.21.15.5:0/1169647313 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9e50066280 0x7f9e50068730 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9e641f7b00 tx=0x7f9e54001940 comp rx=0 tx=0).stop 2023-07-14T12:53:18.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.813+0000 7f9e69c0b640 1 -- 172.21.15.5:0/1169647313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e64159440 msgr2=0x7f9e6414f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:18.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.813+0000 7f9e69c0b640 1 --2- 172.21.15.5:0/1169647313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e64159440 0x7f9e6414f8f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9e5800c430 tx=0x7f9e5800c8f0 comp rx=0 tx=0).stop 2023-07-14T12:53:18.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.813+0000 7f9e69c0b640 1 -- 172.21.15.5:0/1169647313 shutdown_connections 2023-07-14T12:53:18.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.813+0000 7f9e69c0b640 1 --2- 172.21.15.5:0/1169647313 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9e50066280 0x7f9e50068730 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:18.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.813+0000 7f9e69c0b640 1 --2- 172.21.15.5:0/1169647313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e6415cef0 0x7f9e6414fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:18.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.813+0000 7f9e69c0b640 1 --2- 172.21.15.5:0/1169647313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e64159440 0x7f9e6414f8f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:18.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.813+0000 7f9e69c0b640 1 --2- 172.21.15.5:0/1169647313 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e640aeb40 0x7f9e6414d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:18.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.813+0000 7f9e69c0b640 1 -- 172.21.15.5:0/1169647313 >> 172.21.15.5:0/1169647313 conn(0x7f9e640cde90 msgr2=0x7f9e64152810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:18.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.813+0000 7f9e69c0b640 1 -- 172.21.15.5:0/1169647313 shutdown_connections 2023-07-14T12:53:18.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.813+0000 7f9e69c0b640 1 -- 172.21.15.5:0/1169647313 wait complete. 2023-07-14T12:53:18.860 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T12:53:19.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.977+0000 7ff3b2174640 1 Processor -- start 2023-07-14T12:53:19.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.977+0000 7ff3b2174640 1 -- start start 2023-07-14T12:53:19.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.981+0000 7ff3b2174640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff3ac0cf2e0 0x7ff3ac0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:19.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.981+0000 7ff3b2174640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3ac0ca790 0x7ff3ac0cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:19.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.981+0000 7ff3b2174640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3ac0d0920 con 0x7ff3ac06a540 2023-07-14T12:53:19.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.981+0000 7ff3b2174640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3ac15bfd0 con 0x7ff3ac0cf2e0 2023-07-14T12:53:19.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.981+0000 7ff3b2174640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac0cfd10 con 0x7ff3ac0ca790 2023-07-14T12:53:19.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.981+0000 7ff3ab7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff3ac06a540 0x7ff3ac06a910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59494/0 (socket says 172.21.15.5:59494) 2023-07-14T12:53:19.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.981+0000 7ff3ab7fe640 1 -- 172.21.15.5:0/3461246358 learned_addr learned my addr 172.21.15.5:0/3461246358 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:19.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.981+0000 7ff3aaffd640 1 --2- 172.21.15.5:0/3461246358 >> v2:172.21.15.154:3300/0 conn(0x7ff3ac0cf2e0 0x7ff3ac0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:19.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.981+0000 7ff3abfff640 1 --2- 172.21.15.5:0/3461246358 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3ac0ca790 0x7ff3ac0cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:19.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.981+0000 7ff3aa7fc640 1 -- 172.21.15.5:0/3461246358 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245789962 0 0) 0x7ff3ac0d0920 con 0x7ff3ac06a540 2023-07-14T12:53:19.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.981+0000 7ff3aa7fc640 1 -- 172.21.15.5:0/3461246358 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff394003530 con 0x7ff3ac06a540 2023-07-14T12:53:19.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.981+0000 7ff3aaffd640 1 -- 172.21.15.5:0/3461246358 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3ac0ca790 msgr2=0x7ff3ac0cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:19.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.981+0000 7ff3aaffd640 1 --2- 172.21.15.5:0/3461246358 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3ac0ca790 0x7ff3ac0cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.981+0000 7ff3aaffd640 1 -- 172.21.15.5:0/3461246358 >> v1:172.21.15.5:6789/0 conn(0x7ff3ac06a540 legacy=0x7ff3ac06a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:19.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.981+0000 7ff3aaffd640 1 -- 172.21.15.5:0/3461246358 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ac0cfff0 con 0x7ff3ac0cf2e0 2023-07-14T12:53:19.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.981+0000 7ff3abfff640 1 --2- 172.21.15.5:0/3461246358 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3ac0ca790 0x7ff3ac0cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:53:19.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.985+0000 7ff3aaffd640 1 --2- 172.21.15.5:0/3461246358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3ac0cf2e0 0x7ff3ac0cf710 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff3a00097c0 tx=0x7ff3a001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be84af9878389c32 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:19.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.985+0000 7ff3aa7fc640 1 -- 172.21.15.5:0/3461246358 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a00ab650 con 0x7ff3ac0cf2e0 2023-07-14T12:53:19.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.985+0000 7ff3aa7fc640 1 -- 172.21.15.5:0/3461246358 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a00ab7b0 con 0x7ff3ac0cf2e0 2023-07-14T12:53:19.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.985+0000 7ff3aa7fc640 1 -- 172.21.15.5:0/3461246358 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a00abb40 con 0x7ff3ac0cf2e0 2023-07-14T12:53:19.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.985+0000 7ff3b2174640 1 -- 172.21.15.5:0/3461246358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3ac0cf2e0 msgr2=0x7ff3ac0cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:19.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.985+0000 7ff3b2174640 1 --2- 172.21.15.5:0/3461246358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3ac0cf2e0 0x7ff3ac0cf710 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff3a00097c0 tx=0x7ff3a001c450 comp rx=0 tx=0).stop 2023-07-14T12:53:19.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.985+0000 7ff3b2174640 1 -- 172.21.15.5:0/3461246358 shutdown_connections 2023-07-14T12:53:19.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.985+0000 7ff3b2174640 1 --2- 172.21.15.5:0/3461246358 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3ac0ca790 0x7ff3ac0cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.985+0000 7ff3b2174640 1 --2- 172.21.15.5:0/3461246358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3ac0cf2e0 0x7ff3ac0cf710 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.985+0000 7ff3b2174640 1 -- 172.21.15.5:0/3461246358 >> 172.21.15.5:0/3461246358 conn(0x7ff3ac099490 msgr2=0x7ff3ac089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:19.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.985+0000 7ff3b2174640 1 -- 172.21.15.5:0/3461246358 shutdown_connections 2023-07-14T12:53:19.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.985+0000 7ff3b2174640 1 -- 172.21.15.5:0/3461246358 wait complete. 2023-07-14T12:53:19.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.985+0000 7ff3b2174640 1 Processor -- start 2023-07-14T12:53:19.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.985+0000 7ff3b2174640 1 -- start start 2023-07-14T12:53:19.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.989+0000 7ff3b2174640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3ac06a540 0x7ff3ac155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:19.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.989+0000 7ff3b2174640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3ac0ca790 0x7ff3ac0b0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:19.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.989+0000 7ff3b2174640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3ac0cf2e0 0x7ff3ac149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:19.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.989+0000 7ff3b2174640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac154470 con 0x7ff3ac0cf2e0 2023-07-14T12:53:19.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.989+0000 7ff3b2174640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac154750 con 0x7ff3ac0ca790 2023-07-14T12:53:19.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.989+0000 7ff3b2174640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac154a30 con 0x7ff3ac06a540 2023-07-14T12:53:19.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.989+0000 7ff3abfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3ac0cf2e0 0x7ff3ac149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:19.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.989+0000 7ff3abfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3ac0cf2e0 0x7ff3ac149ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55996/0 (socket says 172.21.15.5:55996) 2023-07-14T12:53:19.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.989+0000 7ff3abfff640 1 -- 172.21.15.5:0/350219152 learned_addr learned my addr 172.21.15.5:0/350219152 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:19.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.989+0000 7ff3ab7fe640 1 --2- 172.21.15.5:0/350219152 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3ac06a540 0x7ff3ac155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:19.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.989+0000 7ff3aaffd640 1 --2- 172.21.15.5:0/350219152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3ac0ca790 0x7ff3ac0b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:19.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.989+0000 7ff3abfff640 1 -- 172.21.15.5:0/350219152 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3ac06a540 msgr2=0x7ff3ac155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:19.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.989+0000 7ff3abfff640 1 --2- 172.21.15.5:0/350219152 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3ac06a540 0x7ff3ac155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.989+0000 7ff3abfff640 1 -- 172.21.15.5:0/350219152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3ac0ca790 msgr2=0x7ff3ac0b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:19.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.989+0000 7ff3abfff640 1 --2- 172.21.15.5:0/350219152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3ac0ca790 0x7ff3ac0b0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.989+0000 7ff3abfff640 1 -- 172.21.15.5:0/350219152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a4009a70 con 0x7ff3ac0cf2e0 2023-07-14T12:53:19.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.989+0000 7ff3ab7fe640 1 --2- 172.21.15.5:0/350219152 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3ac06a540 0x7ff3ac155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:19.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.989+0000 7ff3aaffd640 1 --2- 172.21.15.5:0/350219152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3ac0ca790 0x7ff3ac0b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:19.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.989+0000 7ff3abfff640 1 --2- 172.21.15.5:0/350219152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3ac0cf2e0 0x7ff3ac149ef0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff3a400efc0 tx=0x7ff3a4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:19.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.989+0000 7ff393fff640 1 -- 172.21.15.5:0/350219152 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4009d70 con 0x7ff3ac0cf2e0 2023-07-14T12:53:19.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.989+0000 7ff393fff640 1 -- 172.21.15.5:0/350219152 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a400f040 con 0x7ff3ac0cf2e0 2023-07-14T12:53:19.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.989+0000 7ff393fff640 1 -- 172.21.15.5:0/350219152 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a40039a0 con 0x7ff3ac0cf2e0 2023-07-14T12:53:19.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.989+0000 7ff3b2174640 1 -- 172.21.15.5:0/350219152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a0009420 con 0x7ff3ac0cf2e0 2023-07-14T12:53:19.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.989+0000 7ff3b2174640 1 -- 172.21.15.5:0/350219152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3ac154ff0 con 0x7ff3ac0cf2e0 2023-07-14T12:53:19.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.989+0000 7ff3b2174640 1 -- 172.21.15.5:0/350219152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3ac0678d0 con 0x7ff3ac0cf2e0 2023-07-14T12:53:19.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.993+0000 7ff393fff640 1 -- 172.21.15.5:0/350219152 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff3a40144a0 con 0x7ff3ac0cf2e0 2023-07-14T12:53:19.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.993+0000 7ff393fff640 1 --2- 172.21.15.5:0/350219152 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff398066280 0x7ff398068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:19.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.993+0000 7ff393fff640 1 -- 172.21.15.5:0/350219152 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff3a40849b0 con 0x7ff3ac0cf2e0 2023-07-14T12:53:19.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.993+0000 7ff3ab7fe640 1 --2- 172.21.15.5:0/350219152 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff398066280 0x7ff398068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:19.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.993+0000 7ff3ab7fe640 1 --2- 172.21.15.5:0/350219152 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff398066280 0x7ff398068730 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff39c0011f0 tx=0x7ff39c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:19.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:18.997+0000 7ff393fff640 1 -- 172.21.15.5:0/350219152 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff3a40558c0 con 0x7ff3ac0cf2e0 2023-07-14T12:53:19.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.153+0000 7ff3b2174640 1 -- 172.21.15.5:0/350219152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff3ac1551b0 con 0x7ff3ac0cf2e0 2023-07-14T12:53:19.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.153+0000 7ff393fff640 1 -- 172.21.15.5:0/350219152 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff3a4018020 con 0x7ff3ac0cf2e0 2023-07-14T12:53:19.183 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T12:53:19.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.157+0000 7ff3b2174640 1 -- 172.21.15.5:0/350219152 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff398066280 msgr2=0x7ff398068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:19.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.157+0000 7ff3b2174640 1 --2- 172.21.15.5:0/350219152 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff398066280 0x7ff398068730 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff39c0011f0 tx=0x7ff39c009040 comp rx=0 tx=0).stop 2023-07-14T12:53:19.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.157+0000 7ff3b2174640 1 -- 172.21.15.5:0/350219152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3ac0cf2e0 msgr2=0x7ff3ac149ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:19.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.157+0000 7ff3b2174640 1 --2- 172.21.15.5:0/350219152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3ac0cf2e0 0x7ff3ac149ef0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff3a400efc0 tx=0x7ff3a4009f90 comp rx=0 tx=0).stop 2023-07-14T12:53:19.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.157+0000 7ff3b2174640 1 -- 172.21.15.5:0/350219152 shutdown_connections 2023-07-14T12:53:19.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.157+0000 7ff3b2174640 1 --2- 172.21.15.5:0/350219152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3ac0cf2e0 0x7ff3ac149ef0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.157+0000 7ff3b2174640 1 --2- 172.21.15.5:0/350219152 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff398066280 0x7ff398068730 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.157+0000 7ff3b2174640 1 --2- 172.21.15.5:0/350219152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3ac0ca790 0x7ff3ac0b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.157+0000 7ff3b2174640 1 --2- 172.21.15.5:0/350219152 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3ac06a540 0x7ff3ac155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.157+0000 7ff3b2174640 1 -- 172.21.15.5:0/350219152 >> 172.21.15.5:0/350219152 conn(0x7ff3ac099490 msgr2=0x7ff3ac0ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:19.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.157+0000 7ff3b2174640 1 -- 172.21.15.5:0/350219152 shutdown_connections 2023-07-14T12:53:19.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.157+0000 7ff3b2174640 1 -- 172.21.15.5:0/350219152 wait complete. 2023-07-14T12:53:19.204 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T12:53:19.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.321+0000 7fc607c6d640 1 Processor -- start 2023-07-14T12:53:19.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.321+0000 7fc607c6d640 1 -- start start 2023-07-14T12:53:19.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.325+0000 7fc607c6d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc600069430 0x7fc600069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:19.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.325+0000 7fc607c6d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc600070f30 0x7fc6000ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:19.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.325+0000 7fc607c6d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc600159d70 con 0x7fc6000af2b0 2023-07-14T12:53:19.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.325+0000 7fc607c6d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc600069d40 con 0x7fc600070f30 2023-07-14T12:53:19.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.325+0000 7fc607c6d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6000c9c60 con 0x7fc600069430 2023-07-14T12:53:19.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.325+0000 7fc605208640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc600070f30 0x7fc6000ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:19.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.325+0000 7fc605208640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc600070f30 0x7fc6000ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41914/0 (socket says 172.21.15.5:41914) 2023-07-14T12:53:19.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.325+0000 7fc605208640 1 -- 172.21.15.5:0/1754867364 learned_addr learned my addr 172.21.15.5:0/1754867364 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:19.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.325+0000 7fc60620a640 1 --1- 172.21.15.5:0/1754867364 >> v1:172.21.15.5:6789/0 conn(0x7fc6000af2b0 0x7fc60015a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47074/0 (socket says 172.21.15.5:47074) 2023-07-14T12:53:19.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.325+0000 7fc605a09640 1 --2- 172.21.15.5:0/1754867364 >> v2:172.21.15.154:3300/0 conn(0x7fc600069430 0x7fc600069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:19.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.325+0000 7fc605208640 1 -- 172.21.15.5:0/1754867364 >> v2:172.21.15.154:3300/0 conn(0x7fc600069430 msgr2=0x7fc600069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:19.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.325+0000 7fc605208640 1 --2- 172.21.15.5:0/1754867364 >> v2:172.21.15.154:3300/0 conn(0x7fc600069430 0x7fc600069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.325+0000 7fc605208640 1 -- 172.21.15.5:0/1754867364 >> v1:172.21.15.5:6789/0 conn(0x7fc6000af2b0 legacy=0x7fc60015a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:19.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.325+0000 7fc605208640 1 -- 172.21.15.5:0/1754867364 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6000c9f40 con 0x7fc600070f30 2023-07-14T12:53:19.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.325+0000 7fc604a07640 1 -- 172.21.15.5:0/1754867364 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 818816629 0 0) 0x7fc5f80014a0 con 0x7fc6000af2b0 2023-07-14T12:53:19.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.329+0000 7fc605208640 1 --2- 172.21.15.5:0/1754867364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc600070f30 0x7fc6000ad6f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc600071910 tx=0x7fc5f001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3da31e4a49d1f39 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:19.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.329+0000 7fc604a07640 1 -- 172.21.15.5:0/1754867364 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f00aa660 con 0x7fc600070f30 2023-07-14T12:53:19.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.329+0000 7fc604a07640 1 -- 172.21.15.5:0/1754867364 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f00aa7c0 con 0x7fc600070f30 2023-07-14T12:53:19.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.329+0000 7fc604a07640 1 -- 172.21.15.5:0/1754867364 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f00aab50 con 0x7fc600070f30 2023-07-14T12:53:19.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.329+0000 7fc607c6d640 1 -- 172.21.15.5:0/1754867364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc600070f30 msgr2=0x7fc6000ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:19.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.329+0000 7fc607c6d640 1 --2- 172.21.15.5:0/1754867364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc600070f30 0x7fc6000ad6f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc600071910 tx=0x7fc5f001c500 comp rx=0 tx=0).stop 2023-07-14T12:53:19.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.329+0000 7fc607c6d640 1 -- 172.21.15.5:0/1754867364 shutdown_connections 2023-07-14T12:53:19.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.329+0000 7fc607c6d640 1 --2- 172.21.15.5:0/1754867364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc600070f30 0x7fc6000ad6f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.329+0000 7fc607c6d640 1 --2- 172.21.15.5:0/1754867364 >> v2:172.21.15.154:3300/0 conn(0x7fc600069430 0x7fc600069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.329+0000 7fc607c6d640 1 -- 172.21.15.5:0/1754867364 >> 172.21.15.5:0/1754867364 conn(0x7fc6000cde90 msgr2=0x7fc6000ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:19.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.329+0000 7fc607c6d640 1 -- 172.21.15.5:0/1754867364 shutdown_connections 2023-07-14T12:53:19.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.329+0000 7fc607c6d640 1 -- 172.21.15.5:0/1754867364 wait complete. 2023-07-14T12:53:19.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.329+0000 7fc607c6d640 1 Processor -- start 2023-07-14T12:53:19.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.329+0000 7fc607c6d640 1 -- start start 2023-07-14T12:53:19.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.333+0000 7fc607c6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc600069430 0x7fc60014c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:19.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.333+0000 7fc607c6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc600070f30 0x7fc600153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:19.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.333+0000 7fc607c6d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6000af2b0 0x7fc6001537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:19.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.333+0000 7fc607c6d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6000c2dd0 con 0x7fc600069430 2023-07-14T12:53:19.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.333+0000 7fc607c6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6000c3040 con 0x7fc600070f30 2023-07-14T12:53:19.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.333+0000 7fc607c6d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6000c3320 con 0x7fc6000af2b0 2023-07-14T12:53:19.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.333+0000 7fc605a09640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc600069430 0x7fc60014c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:19.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.333+0000 7fc605a09640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc600069430 0x7fc60014c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41928/0 (socket says 172.21.15.5:41928) 2023-07-14T12:53:19.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.333+0000 7fc605a09640 1 -- 172.21.15.5:0/2591458808 learned_addr learned my addr 172.21.15.5:0/2591458808 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:19.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.333+0000 7fc60620a640 1 --2- 172.21.15.5:0/2591458808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6000af2b0 0x7fc6001537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:19.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.333+0000 7fc605208640 1 --2- 172.21.15.5:0/2591458808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc600070f30 0x7fc600153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:19.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.333+0000 7fc605a09640 1 -- 172.21.15.5:0/2591458808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6000af2b0 msgr2=0x7fc6001537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:19.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.333+0000 7fc605a09640 1 --2- 172.21.15.5:0/2591458808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6000af2b0 0x7fc6001537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.333+0000 7fc605a09640 1 -- 172.21.15.5:0/2591458808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc600070f30 msgr2=0x7fc600153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:19.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.333+0000 7fc605a09640 1 --2- 172.21.15.5:0/2591458808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc600070f30 0x7fc600153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.333+0000 7fc605a09640 1 -- 172.21.15.5:0/2591458808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f00094d0 con 0x7fc600069430 2023-07-14T12:53:19.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.333+0000 7fc605a09640 1 --2- 172.21.15.5:0/2591458808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc600069430 0x7fc60014c310 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc00e870 tx=0x7fc5fc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:19.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.333+0000 7fc5f67fc640 1 -- 172.21.15.5:0/2591458808 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc009510 con 0x7fc600069430 2023-07-14T12:53:19.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.333+0000 7fc5f67fc640 1 -- 172.21.15.5:0/2591458808 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5fc00eec0 con 0x7fc600069430 2023-07-14T12:53:19.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.333+0000 7fc607c6d640 1 -- 172.21.15.5:0/2591458808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6000c3600 con 0x7fc600069430 2023-07-14T12:53:19.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.333+0000 7fc5f67fc640 1 -- 172.21.15.5:0/2591458808 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc00cb40 con 0x7fc600069430 2023-07-14T12:53:19.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.333+0000 7fc607c6d640 1 -- 172.21.15.5:0/2591458808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6001550a0 con 0x7fc600069430 2023-07-14T12:53:19.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.333+0000 7fc607c6d640 1 -- 172.21.15.5:0/2591458808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6000678d0 con 0x7fc600069430 2023-07-14T12:53:19.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.333+0000 7fc5f67fc640 1 -- 172.21.15.5:0/2591458808 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc5fc00cca0 con 0x7fc600069430 2023-07-14T12:53:19.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.337+0000 7fc5f67fc640 1 --2- 172.21.15.5:0/2591458808 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc5e4066280 0x7fc5e4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:19.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.337+0000 7fc5f67fc640 1 -- 172.21.15.5:0/2591458808 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc5fc083e50 con 0x7fc600069430 2023-07-14T12:53:19.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.337+0000 7fc605208640 1 --2- 172.21.15.5:0/2591458808 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc5e4066280 0x7fc5e4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:19.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.337+0000 7fc605208640 1 --2- 172.21.15.5:0/2591458808 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc5e4066280 0x7fc5e4068730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00ae000 tx=0x7fc5f00a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:19.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.341+0000 7fc5f67fc640 1 -- 172.21.15.5:0/2591458808 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc5fc0512c0 con 0x7fc600069430 2023-07-14T12:53:19.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.497+0000 7fc607c6d640 1 -- 172.21.15.5:0/2591458808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc6000aeb80 con 0x7fc600069430 2023-07-14T12:53:19.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.497+0000 7fc5f67fc640 1 -- 172.21.15.5:0/2591458808 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc5fc017020 con 0x7fc600069430 2023-07-14T12:53:19.524 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T12:53:19.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.497+0000 7fc607c6d640 1 -- 172.21.15.5:0/2591458808 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc5e4066280 msgr2=0x7fc5e4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:19.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.497+0000 7fc607c6d640 1 --2- 172.21.15.5:0/2591458808 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc5e4066280 0x7fc5e4068730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00ae000 tx=0x7fc5f00a7000 comp rx=0 tx=0).stop 2023-07-14T12:53:19.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.497+0000 7fc607c6d640 1 -- 172.21.15.5:0/2591458808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc600069430 msgr2=0x7fc60014c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:19.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.497+0000 7fc607c6d640 1 --2- 172.21.15.5:0/2591458808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc600069430 0x7fc60014c310 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc00e870 tx=0x7fc5fc00ec70 comp rx=0 tx=0).stop 2023-07-14T12:53:19.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.497+0000 7fc607c6d640 1 -- 172.21.15.5:0/2591458808 shutdown_connections 2023-07-14T12:53:19.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.497+0000 7fc607c6d640 1 --2- 172.21.15.5:0/2591458808 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6000af2b0 0x7fc6001537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.497+0000 7fc607c6d640 1 --2- 172.21.15.5:0/2591458808 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc5e4066280 0x7fc5e4068730 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.497+0000 7fc607c6d640 1 --2- 172.21.15.5:0/2591458808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc600070f30 0x7fc600153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.497+0000 7fc607c6d640 1 --2- 172.21.15.5:0/2591458808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc600069430 0x7fc60014c310 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.497+0000 7fc607c6d640 1 -- 172.21.15.5:0/2591458808 >> 172.21.15.5:0/2591458808 conn(0x7fc6000cde90 msgr2=0x7fc60006c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:19.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.497+0000 7fc607c6d640 1 -- 172.21.15.5:0/2591458808 shutdown_connections 2023-07-14T12:53:19.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.497+0000 7fc607c6d640 1 -- 172.21.15.5:0/2591458808 wait complete. 2023-07-14T12:53:19.544 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T12:53:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.665+0000 7ff369c7b640 1 Processor -- start 2023-07-14T12:53:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.665+0000 7ff369c7b640 1 -- start start 2023-07-14T12:53:19.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.665+0000 7ff369c7b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3641590a0 0x7ff3640c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:19.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.665+0000 7ff369c7b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff36415b9c0 0x7ff364159930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:19.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.665+0000 7ff369c7b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3640c37e0 con 0x7ff3640cba60 2023-07-14T12:53:19.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.665+0000 7ff369c7b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3640c3ac0 con 0x7ff36415b9c0 2023-07-14T12:53:19.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.665+0000 7ff369c7b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3640c3da0 con 0x7ff3641590a0 2023-07-14T12:53:19.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.665+0000 7ff363fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff36415b9c0 0x7ff364159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:19.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.665+0000 7ff363fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff36415b9c0 0x7ff364159930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41930/0 (socket says 172.21.15.5:41930) 2023-07-14T12:53:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.665+0000 7ff363fff640 1 -- 172.21.15.5:0/1401646646 learned_addr learned my addr 172.21.15.5:0/1401646646 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.665+0000 7ff362ffd640 1 --2- 172.21.15.5:0/1401646646 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3641590a0 0x7ff3640c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.665+0000 7ff363fff640 1 -- 172.21.15.5:0/1401646646 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3641590a0 msgr2=0x7ff3640c3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.665+0000 7ff363fff640 1 --2- 172.21.15.5:0/1401646646 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3641590a0 0x7ff3640c3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.665+0000 7ff363fff640 1 -- 172.21.15.5:0/1401646646 >> v1:172.21.15.154:6789/0 conn(0x7ff3640cba60 legacy=0x7ff3640cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.665+0000 7ff363fff640 1 -- 172.21.15.5:0/1401646646 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3640c4080 con 0x7ff36415b9c0 2023-07-14T12:53:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.669+0000 7ff363fff640 1 --2- 172.21.15.5:0/1401646646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff36415b9c0 0x7ff364159930 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff35c009e50 tx=0x7ff35c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311351c6926eec84 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:19.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.669+0000 7ff3627fc640 1 -- 172.21.15.5:0/1401646646 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c0a57e0 con 0x7ff36415b9c0 2023-07-14T12:53:19.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.669+0000 7ff3627fc640 1 -- 172.21.15.5:0/1401646646 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35c0a5940 con 0x7ff36415b9c0 2023-07-14T12:53:19.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.669+0000 7ff3627fc640 1 -- 172.21.15.5:0/1401646646 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c0a5cd0 con 0x7ff36415b9c0 2023-07-14T12:53:19.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.669+0000 7ff369c7b640 1 -- 172.21.15.5:0/1401646646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff36415b9c0 msgr2=0x7ff364159930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:19.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.669+0000 7ff369c7b640 1 --2- 172.21.15.5:0/1401646646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff36415b9c0 0x7ff364159930 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff35c009e50 tx=0x7ff35c01c900 comp rx=0 tx=0).stop 2023-07-14T12:53:19.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.669+0000 7ff369c7b640 1 -- 172.21.15.5:0/1401646646 shutdown_connections 2023-07-14T12:53:19.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.669+0000 7ff369c7b640 1 --2- 172.21.15.5:0/1401646646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff36415b9c0 0x7ff364159930 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.669+0000 7ff369c7b640 1 --2- 172.21.15.5:0/1401646646 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3641590a0 0x7ff3640c3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.669+0000 7ff369c7b640 1 -- 172.21.15.5:0/1401646646 >> 172.21.15.5:0/1401646646 conn(0x7ff3640cde90 msgr2=0x7ff3640ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:19.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.669+0000 7ff369c7b640 1 -- 172.21.15.5:0/1401646646 shutdown_connections 2023-07-14T12:53:19.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.669+0000 7ff369c7b640 1 -- 172.21.15.5:0/1401646646 wait complete. 2023-07-14T12:53:19.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.669+0000 7ff369c7b640 1 Processor -- start 2023-07-14T12:53:19.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.673+0000 7ff369c7b640 1 -- start start 2023-07-14T12:53:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.673+0000 7ff369c7b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3640cba60 0x7ff3640c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.673+0000 7ff369c7b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3641590a0 0x7ff3640b3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.673+0000 7ff369c7b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff36415b9c0 0x7ff3641557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.673+0000 7ff369c7b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3640c89e0 con 0x7ff36415b9c0 2023-07-14T12:53:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.673+0000 7ff369c7b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3640c6180 con 0x7ff3641590a0 2023-07-14T12:53:19.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.673+0000 7ff369c7b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3640c6460 con 0x7ff3640cba60 2023-07-14T12:53:19.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.673+0000 7ff363fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff36415b9c0 0x7ff3641557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:19.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.673+0000 7ff363fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff36415b9c0 0x7ff3641557f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41932/0 (socket says 172.21.15.5:41932) 2023-07-14T12:53:19.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.673+0000 7ff363fff640 1 -- 172.21.15.5:0/617619984 learned_addr learned my addr 172.21.15.5:0/617619984 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:19.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.673+0000 7ff3637fe640 1 --2- 172.21.15.5:0/617619984 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3640cba60 0x7ff3640c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:19.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.673+0000 7ff362ffd640 1 --2- 172.21.15.5:0/617619984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3641590a0 0x7ff3640b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:19.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.673+0000 7ff363fff640 1 -- 172.21.15.5:0/617619984 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3640cba60 msgr2=0x7ff3640c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:19.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.673+0000 7ff363fff640 1 --2- 172.21.15.5:0/617619984 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3640cba60 0x7ff3640c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.673+0000 7ff363fff640 1 -- 172.21.15.5:0/617619984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3641590a0 msgr2=0x7ff3640b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:19.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.673+0000 7ff363fff640 1 --2- 172.21.15.5:0/617619984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3641590a0 0x7ff3640b3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.673+0000 7ff363fff640 1 -- 172.21.15.5:0/617619984 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35c009b30 con 0x7ff36415b9c0 2023-07-14T12:53:19.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.673+0000 7ff363fff640 1 --2- 172.21.15.5:0/617619984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff36415b9c0 0x7ff3641557f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff35c0af040 tx=0x7ff35c0196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:19.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.673+0000 7ff34bfff640 1 -- 172.21.15.5:0/617619984 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c0b8880 con 0x7ff36415b9c0 2023-07-14T12:53:19.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.673+0000 7ff34bfff640 1 -- 172.21.15.5:0/617619984 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35c0b8a00 con 0x7ff36415b9c0 2023-07-14T12:53:19.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.673+0000 7ff369c7b640 1 -- 172.21.15.5:0/617619984 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3640c6740 con 0x7ff36415b9c0 2023-07-14T12:53:19.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.673+0000 7ff34bfff640 1 -- 172.21.15.5:0/617619984 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c0b8db0 con 0x7ff36415b9c0 2023-07-14T12:53:19.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.673+0000 7ff369c7b640 1 -- 172.21.15.5:0/617619984 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3640c6d00 con 0x7ff36415b9c0 2023-07-14T12:53:19.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.673+0000 7ff369c7b640 1 -- 172.21.15.5:0/617619984 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3640714b0 con 0x7ff36415b9c0 2023-07-14T12:53:19.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.677+0000 7ff34bfff640 1 -- 172.21.15.5:0/617619984 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff35c0b6440 con 0x7ff36415b9c0 2023-07-14T12:53:19.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.677+0000 7ff34bfff640 1 --2- 172.21.15.5:0/617619984 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff350066280 0x7ff350068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:19.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.677+0000 7ff34bfff640 1 -- 172.21.15.5:0/617619984 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff35c11f610 con 0x7ff36415b9c0 2023-07-14T12:53:19.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.677+0000 7ff3637fe640 1 --2- 172.21.15.5:0/617619984 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff350066280 0x7ff350068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:19.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.677+0000 7ff3637fe640 1 --2- 172.21.15.5:0/617619984 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff350066280 0x7ff350068730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff364159b10 tx=0x7ff354009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:19.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.681+0000 7ff34bfff640 1 -- 172.21.15.5:0/617619984 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff35c0ecab0 con 0x7ff36415b9c0 2023-07-14T12:53:19.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.837+0000 7ff369c7b640 1 -- 172.21.15.5:0/617619984 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff3640678d0 con 0x7ff36415b9c0 2023-07-14T12:53:19.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.837+0000 7ff34bfff640 1 -- 172.21.15.5:0/617619984 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff35c009510 con 0x7ff36415b9c0 2023-07-14T12:53:19.866 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T12:53:19.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.841+0000 7ff369c7b640 1 -- 172.21.15.5:0/617619984 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff350066280 msgr2=0x7ff350068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:19.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.841+0000 7ff369c7b640 1 --2- 172.21.15.5:0/617619984 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff350066280 0x7ff350068730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff364159b10 tx=0x7ff354009040 comp rx=0 tx=0).stop 2023-07-14T12:53:19.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.841+0000 7ff369c7b640 1 -- 172.21.15.5:0/617619984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff36415b9c0 msgr2=0x7ff3641557f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:19.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.841+0000 7ff369c7b640 1 --2- 172.21.15.5:0/617619984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff36415b9c0 0x7ff3641557f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff35c0af040 tx=0x7ff35c0196a0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.841+0000 7ff369c7b640 1 -- 172.21.15.5:0/617619984 shutdown_connections 2023-07-14T12:53:19.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.841+0000 7ff369c7b640 1 --2- 172.21.15.5:0/617619984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff36415b9c0 0x7ff3641557f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.841+0000 7ff369c7b640 1 --2- 172.21.15.5:0/617619984 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff350066280 0x7ff350068730 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.841+0000 7ff369c7b640 1 --2- 172.21.15.5:0/617619984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3641590a0 0x7ff3640b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.841+0000 7ff369c7b640 1 --2- 172.21.15.5:0/617619984 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3640cba60 0x7ff3640c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:19.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.841+0000 7ff369c7b640 1 -- 172.21.15.5:0/617619984 >> 172.21.15.5:0/617619984 conn(0x7ff3640cde90 msgr2=0x7ff3640cbe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:19.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.841+0000 7ff369c7b640 1 -- 172.21.15.5:0/617619984 shutdown_connections 2023-07-14T12:53:19.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:19.841+0000 7ff369c7b640 1 -- 172.21.15.5:0/617619984 wait complete. 2023-07-14T12:53:19.887 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T12:53:20.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.005+0000 7f2b0359e640 1 Processor -- start 2023-07-14T12:53:20.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.005+0000 7f2b0359e640 1 -- start start 2023-07-14T12:53:20.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.005+0000 7f2b0359e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b040b7d90 0x7f2b040cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:20.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.005+0000 7f2b0359e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2b040d13f0 0x7f2b040ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:20.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.005+0000 7f2b0359e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b040d0f60 con 0x7f2b0415f3f0 2023-07-14T12:53:20.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.005+0000 7f2b0359e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b040d0390 con 0x7f2b040d13f0 2023-07-14T12:53:20.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.005+0000 7f2b0359e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b040d0630 con 0x7f2b040b7d90 2023-07-14T12:53:20.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.005+0000 7f2b02d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2b040d13f0 0x7f2b040ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:20.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.005+0000 7f2b0259c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2b0415f3f0 0x7f2b040b7680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47080/0 (socket says 172.21.15.5:47080) 2023-07-14T12:53:20.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.005+0000 7f2b0259c640 1 -- 172.21.15.5:0/939158651 learned_addr learned my addr 172.21.15.5:0/939158651 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:20.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.005+0000 7f2afbfff640 1 --2- 172.21.15.5:0/939158651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b040b7d90 0x7f2b040cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:20.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.005+0000 7f2b02d9d640 1 -- 172.21.15.5:0/939158651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b040b7d90 msgr2=0x7f2b040cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:20.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.005+0000 7f2b02d9d640 1 --2- 172.21.15.5:0/939158651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b040b7d90 0x7f2b040cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:20.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.005+0000 7f2b02d9d640 1 -- 172.21.15.5:0/939158651 >> v1:172.21.15.5:6789/0 conn(0x7f2b0415f3f0 legacy=0x7f2b040b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:20.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.005+0000 7f2b02d9d640 1 -- 172.21.15.5:0/939158651 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b040d0910 con 0x7f2b040d13f0 2023-07-14T12:53:20.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.005+0000 7f2b01d9b640 1 -- 172.21.15.5:0/939158651 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609890946 0 0) 0x7f2b040d0f60 con 0x7f2b0415f3f0 2023-07-14T12:53:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.005+0000 7f2afbfff640 1 --2- 172.21.15.5:0/939158651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b040b7d90 0x7f2b040cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.009+0000 7f2b02d9d640 1 --2- 172.21.15.5:0/939158651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b040d13f0 0x7f2b040ccee0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2afc009d90 tx=0x7f2afc01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f64cdb3686681008 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.009+0000 7f2b01d9b640 1 -- 172.21.15.5:0/939158651 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc0a5800 con 0x7f2b040d13f0 2023-07-14T12:53:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.009+0000 7f2b01d9b640 1 -- 172.21.15.5:0/939158651 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2afc0a5960 con 0x7f2b040d13f0 2023-07-14T12:53:20.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.009+0000 7f2b01d9b640 1 -- 172.21.15.5:0/939158651 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc0a5cf0 con 0x7f2b040d13f0 2023-07-14T12:53:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.009+0000 7f2b0359e640 1 -- 172.21.15.5:0/939158651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b040d13f0 msgr2=0x7f2b040ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.009+0000 7f2b0359e640 1 --2- 172.21.15.5:0/939158651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b040d13f0 0x7f2b040ccee0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2afc009d90 tx=0x7f2afc01c8c0 comp rx=0 tx=0).stop 2023-07-14T12:53:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.009+0000 7f2b0359e640 1 -- 172.21.15.5:0/939158651 shutdown_connections 2023-07-14T12:53:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.009+0000 7f2b0359e640 1 --2- 172.21.15.5:0/939158651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b040d13f0 0x7f2b040ccee0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.009+0000 7f2b0359e640 1 --2- 172.21.15.5:0/939158651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b040b7d90 0x7f2b040cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:20.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.009+0000 7f2b0359e640 1 -- 172.21.15.5:0/939158651 >> 172.21.15.5:0/939158651 conn(0x7f2b04069f50 msgr2=0x7f2b0406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:20.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.009+0000 7f2b0359e640 1 -- 172.21.15.5:0/939158651 shutdown_connections 2023-07-14T12:53:20.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.009+0000 7f2b0359e640 1 -- 172.21.15.5:0/939158651 wait complete. 2023-07-14T12:53:20.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.013+0000 7f2b0359e640 1 Processor -- start 2023-07-14T12:53:20.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.013+0000 7f2b0359e640 1 -- start start 2023-07-14T12:53:20.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.013+0000 7f2b0359e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b040b7d90 0x7f2b04158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:20.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.013+0000 7f2b0359e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b040d13f0 0x7f2b040cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:20.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.013+0000 7f2b0359e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b0415f3f0 0x7f2b04156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:20.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.013+0000 7f2b0359e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b04161b70 con 0x7f2b0415f3f0 2023-07-14T12:53:20.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.013+0000 7f2b0359e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0415fa60 con 0x7f2b040b7d90 2023-07-14T12:53:20.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.013+0000 7f2b0359e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b040ca460 con 0x7f2b040d13f0 2023-07-14T12:53:20.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.013+0000 7f2b02d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b0415f3f0 0x7f2b04156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:20.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.013+0000 7f2b02d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b0415f3f0 0x7f2b04156690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41942/0 (socket says 172.21.15.5:41942) 2023-07-14T12:53:20.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.013+0000 7f2b02d9d640 1 -- 172.21.15.5:0/3275029694 learned_addr learned my addr 172.21.15.5:0/3275029694 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:20.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.013+0000 7f2afbfff640 1 --2- 172.21.15.5:0/3275029694 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b040d13f0 0x7f2b040cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:20.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.013+0000 7f2b0259c640 1 --2- 172.21.15.5:0/3275029694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b040b7d90 0x7f2b04158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:20.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.013+0000 7f2b02d9d640 1 -- 172.21.15.5:0/3275029694 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b040d13f0 msgr2=0x7f2b040cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:20.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.013+0000 7f2b02d9d640 1 --2- 172.21.15.5:0/3275029694 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b040d13f0 0x7f2b040cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:20.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.013+0000 7f2b02d9d640 1 -- 172.21.15.5:0/3275029694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b040b7d90 msgr2=0x7f2b04158340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:20.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.013+0000 7f2b02d9d640 1 --2- 172.21.15.5:0/3275029694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b040b7d90 0x7f2b04158340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:20.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.013+0000 7f2b02d9d640 1 -- 172.21.15.5:0/3275029694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc009a70 con 0x7f2b0415f3f0 2023-07-14T12:53:20.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.013+0000 7f2afbfff640 1 --2- 172.21.15.5:0/3275029694 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b040d13f0 0x7f2b040cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:20.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.013+0000 7f2b0259c640 1 --2- 172.21.15.5:0/3275029694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b040b7d90 0x7f2b04158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:20.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.013+0000 7f2b02d9d640 1 --2- 172.21.15.5:0/3275029694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b0415f3f0 0x7f2b04156690 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2afc01a4f0 tx=0x7f2afc019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:20.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.013+0000 7f2afaffd640 1 -- 172.21.15.5:0/3275029694 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc003ba0 con 0x7f2b0415f3f0 2023-07-14T12:53:20.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.013+0000 7f2afaffd640 1 -- 172.21.15.5:0/3275029694 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2afc003d00 con 0x7f2b0415f3f0 2023-07-14T12:53:20.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.013+0000 7f2b0359e640 1 -- 172.21.15.5:0/3275029694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b040ca740 con 0x7f2b0415f3f0 2023-07-14T12:53:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.013+0000 7f2afaffd640 1 -- 172.21.15.5:0/3275029694 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc0ad850 con 0x7f2b0415f3f0 2023-07-14T12:53:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.013+0000 7f2b0359e640 1 -- 172.21.15.5:0/3275029694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0415ff90 con 0x7f2b0415f3f0 2023-07-14T12:53:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.017+0000 7f2b0359e640 1 -- 172.21.15.5:0/3275029694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b041601b0 con 0x7f2b0415f3f0 2023-07-14T12:53:20.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.017+0000 7f2afaffd640 1 -- 172.21.15.5:0/3275029694 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2afc0b4070 con 0x7f2b0415f3f0 2023-07-14T12:53:20.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.017+0000 7f2afaffd640 1 --2- 172.21.15.5:0/3275029694 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2ae4066280 0x7f2ae4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:20.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.017+0000 7f2afaffd640 1 -- 172.21.15.5:0/3275029694 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2afc11e9f0 con 0x7f2b0415f3f0 2023-07-14T12:53:20.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.017+0000 7f2b0259c640 1 --2- 172.21.15.5:0/3275029694 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2ae4066280 0x7f2ae4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:20.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.017+0000 7f2b0259c640 1 --2- 172.21.15.5:0/3275029694 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2ae4066280 0x7f2ae4068730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2af4000f70 tx=0x7f2af4007cd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:20.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.021+0000 7f2afaffd640 1 -- 172.21.15.5:0/3275029694 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2afc0ebf80 con 0x7f2b0415f3f0 2023-07-14T12:53:20.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.189+0000 7f2b0359e640 1 -- 172.21.15.5:0/3275029694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2b040678d0 con 0x7f2b0415f3f0 2023-07-14T12:53:20.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.193+0000 7f2afaffd640 1 -- 172.21.15.5:0/3275029694 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2afc0f3e60 con 0x7f2b0415f3f0 2023-07-14T12:53:20.219 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-07-14T12:53:20.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.193+0000 7f2b0359e640 1 -- 172.21.15.5:0/3275029694 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2ae4066280 msgr2=0x7f2ae4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:20.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.193+0000 7f2b0359e640 1 --2- 172.21.15.5:0/3275029694 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2ae4066280 0x7f2ae4068730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2af4000f70 tx=0x7f2af4007cd0 comp rx=0 tx=0).stop 2023-07-14T12:53:20.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.193+0000 7f2b0359e640 1 -- 172.21.15.5:0/3275029694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b0415f3f0 msgr2=0x7f2b04156690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:20.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.193+0000 7f2b0359e640 1 --2- 172.21.15.5:0/3275029694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b0415f3f0 0x7f2b04156690 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2afc01a4f0 tx=0x7f2afc019660 comp rx=0 tx=0).stop 2023-07-14T12:53:20.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.193+0000 7f2b0359e640 1 -- 172.21.15.5:0/3275029694 shutdown_connections 2023-07-14T12:53:20.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.193+0000 7f2b0359e640 1 --2- 172.21.15.5:0/3275029694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b0415f3f0 0x7f2b04156690 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:20.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.193+0000 7f2b0359e640 1 --2- 172.21.15.5:0/3275029694 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b040d13f0 0x7f2b040cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:20.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.193+0000 7f2b0359e640 1 --2- 172.21.15.5:0/3275029694 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2ae4066280 0x7f2ae4068730 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:20.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.193+0000 7f2b0359e640 1 --2- 172.21.15.5:0/3275029694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b040b7d90 0x7f2b04158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:20.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.193+0000 7f2b0359e640 1 -- 172.21.15.5:0/3275029694 >> 172.21.15.5:0/3275029694 conn(0x7f2b04069f50 msgr2=0x7f2b040d1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:20.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.193+0000 7f2b0359e640 1 -- 172.21.15.5:0/3275029694 shutdown_connections 2023-07-14T12:53:20.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.193+0000 7f2b0359e640 1 -- 172.21.15.5:0/3275029694 wait complete. 2023-07-14T12:53:20.240 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-14T12:53:20.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:20.241 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-07-14T12:53:20.327 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-07-14T12:53:20.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:20.327 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-14T12:53:20.344 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:53:20.345 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T12:53:20.354 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:53:20.355 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T12:53:20.406 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:53:20.407 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T12:53:20.458 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:53:20.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.577+0000 7fa78e034640 1 Processor -- start 2023-07-14T12:53:20.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.577+0000 7fa78e034640 1 -- start start 2023-07-14T12:53:20.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.577+0000 7fa78e034640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa7880d06b0 0x7fa7880b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:20.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.577+0000 7fa78e034640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa788145430 0x7fa7880b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:20.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.577+0000 7fa78e034640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7880b2410 con 0x7fa7880b1f70 2023-07-14T12:53:20.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.577+0000 7fa78e034640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7880b26f0 con 0x7fa7880d06b0 2023-07-14T12:53:20.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.577+0000 7fa78e034640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7880b29d0 con 0x7fa788145430 2023-07-14T12:53:20.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.577+0000 7fa7877fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa7880d06b0 0x7fa7880b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:20.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.577+0000 7fa7877fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa7880d06b0 0x7fa7880b1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41948/0 (socket says 172.21.15.5:41948) 2023-07-14T12:53:20.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.577+0000 7fa7877fe640 1 -- 172.21.15.5:0/3319619201 learned_addr learned my addr 172.21.15.5:0/3319619201 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:20.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.577+0000 7fa786ffd640 1 --2- 172.21.15.5:0/3319619201 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa788145430 0x7fa7880b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:20.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.577+0000 7fa7877fe640 1 -- 172.21.15.5:0/3319619201 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa788145430 msgr2=0x7fa7880b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:20.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.577+0000 7fa7877fe640 1 --2- 172.21.15.5:0/3319619201 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa788145430 0x7fa7880b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:20.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.577+0000 7fa7877fe640 1 -- 172.21.15.5:0/3319619201 >> v1:172.21.15.154:6789/0 conn(0x7fa7880b1f70 legacy=0x7fa7880d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:20.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.577+0000 7fa7877fe640 1 -- 172.21.15.5:0/3319619201 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7880b2cb0 con 0x7fa7880d06b0 2023-07-14T12:53:20.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.581+0000 7fa7877fe640 1 --2- 172.21.15.5:0/3319619201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7880d06b0 0x7fa7880b1a30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa778009870 tx=0x7fa77801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a0fb091afe42d00 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:20.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.581+0000 7fa7867fc640 1 -- 172.21.15.5:0/3319619201 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7780a95f0 con 0x7fa7880d06b0 2023-07-14T12:53:20.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.581+0000 7fa7867fc640 1 -- 172.21.15.5:0/3319619201 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7780a9750 con 0x7fa7880d06b0 2023-07-14T12:53:20.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.581+0000 7fa7867fc640 1 -- 172.21.15.5:0/3319619201 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7780a9ae0 con 0x7fa7880d06b0 2023-07-14T12:53:20.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.581+0000 7fa78e034640 1 -- 172.21.15.5:0/3319619201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7880d06b0 msgr2=0x7fa7880b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:20.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.581+0000 7fa78e034640 1 --2- 172.21.15.5:0/3319619201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7880d06b0 0x7fa7880b1a30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa778009870 tx=0x7fa77801c510 comp rx=0 tx=0).stop 2023-07-14T12:53:20.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.581+0000 7fa78e034640 1 -- 172.21.15.5:0/3319619201 shutdown_connections 2023-07-14T12:53:20.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.581+0000 7fa78e034640 1 --2- 172.21.15.5:0/3319619201 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa788145430 0x7fa7880b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:20.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.581+0000 7fa78e034640 1 --2- 172.21.15.5:0/3319619201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7880d06b0 0x7fa7880b1a30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:20.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.581+0000 7fa78e034640 1 -- 172.21.15.5:0/3319619201 >> 172.21.15.5:0/3319619201 conn(0x7fa7880659d0 msgr2=0x7fa78809b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:20.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.581+0000 7fa78e034640 1 -- 172.21.15.5:0/3319619201 shutdown_connections 2023-07-14T12:53:20.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.581+0000 7fa78e034640 1 -- 172.21.15.5:0/3319619201 wait complete. 2023-07-14T12:53:20.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.585+0000 7fa78e034640 1 Processor -- start 2023-07-14T12:53:20.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.585+0000 7fa78e034640 1 -- start start 2023-07-14T12:53:20.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.585+0000 7fa78e034640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7880b1f70 0x7fa78815a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:20.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.585+0000 7fa78e034640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7880d06b0 0x7fa7880c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:20.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.585+0000 7fa78e034640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7880cc1d0 0x7fa78815e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:20.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.585+0000 7fa78e034640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78815ba10 con 0x7fa7880b1f70 2023-07-14T12:53:20.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.585+0000 7fa78e034640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7880b6d80 con 0x7fa7880d06b0 2023-07-14T12:53:20.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.585+0000 7fa78e034640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78815ea40 con 0x7fa7880cc1d0 2023-07-14T12:53:20.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.585+0000 7fa7877fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7880b1f70 0x7fa78815a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:20.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.585+0000 7fa7877fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7880b1f70 0x7fa78815a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41960/0 (socket says 172.21.15.5:41960) 2023-07-14T12:53:20.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.585+0000 7fa7877fe640 1 -- 172.21.15.5:0/1389822454 learned_addr learned my addr 172.21.15.5:0/1389822454 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:20.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.585+0000 7fa786ffd640 1 --2- 172.21.15.5:0/1389822454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7880d06b0 0x7fa7880c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:20.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.585+0000 7fa787fff640 1 --2- 172.21.15.5:0/1389822454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7880cc1d0 0x7fa78815e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:20.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.585+0000 7fa7877fe640 1 -- 172.21.15.5:0/1389822454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7880cc1d0 msgr2=0x7fa78815e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:20.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.585+0000 7fa7877fe640 1 --2- 172.21.15.5:0/1389822454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7880cc1d0 0x7fa78815e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:20.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.585+0000 7fa7877fe640 1 -- 172.21.15.5:0/1389822454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7880d06b0 msgr2=0x7fa7880c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:20.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.585+0000 7fa7877fe640 1 --2- 172.21.15.5:0/1389822454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7880d06b0 0x7fa7880c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:20.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.585+0000 7fa7877fe640 1 -- 172.21.15.5:0/1389822454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7780094d0 con 0x7fa7880b1f70 2023-07-14T12:53:20.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.585+0000 7fa7877fe640 1 --2- 172.21.15.5:0/1389822454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7880b1f70 0x7fa78815a8b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa7780ab040 tx=0x7fa77801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:20.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.585+0000 7fa76ffff640 1 -- 172.21.15.5:0/1389822454 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7780a95f0 con 0x7fa7880b1f70 2023-07-14T12:53:20.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.585+0000 7fa76ffff640 1 -- 172.21.15.5:0/1389822454 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7780b1820 con 0x7fa7880b1f70 2023-07-14T12:53:20.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.585+0000 7fa76ffff640 1 -- 172.21.15.5:0/1389822454 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7780b1bd0 con 0x7fa7880b1f70 2023-07-14T12:53:20.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.585+0000 7fa78e034640 1 -- 172.21.15.5:0/1389822454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa78815ae90 con 0x7fa7880b1f70 2023-07-14T12:53:20.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.589+0000 7fa78e034640 1 -- 172.21.15.5:0/1389822454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa78815b450 con 0x7fa7880b1f70 2023-07-14T12:53:20.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.589+0000 7fa78e034640 1 -- 172.21.15.5:0/1389822454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa788072e70 con 0x7fa7880b1f70 2023-07-14T12:53:20.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.589+0000 7fa76ffff640 1 -- 172.21.15.5:0/1389822454 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa7780b1d30 con 0x7fa7880b1f70 2023-07-14T12:53:20.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.589+0000 7fa76ffff640 1 --2- 172.21.15.5:0/1389822454 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa7740662b0 0x7fa774068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:20.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.589+0000 7fa76ffff640 1 -- 172.21.15.5:0/1389822454 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa77811e8d0 con 0x7fa7880b1f70 2023-07-14T12:53:20.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.589+0000 7fa786ffd640 1 --2- 172.21.15.5:0/1389822454 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa7740662b0 0x7fa774068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:20.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.593+0000 7fa786ffd640 1 --2- 172.21.15.5:0/1389822454 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa7740662b0 0x7fa774068760 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa78815bd50 tx=0x7fa77c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:20.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.593+0000 7fa76ffff640 1 -- 172.21.15.5:0/1389822454 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa7780ebdf0 con 0x7fa7880b1f70 2023-07-14T12:53:20.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.749+0000 7fa78e034640 1 -- 172.21.15.5:0/1389822454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7880678d0 con 0x7fa7880b1f70 2023-07-14T12:53:20.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.753+0000 7fa76ffff640 1 -- 172.21.15.5:0/1389822454 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18231 (secure 0 0 0) 0x7fa7780c1020 con 0x7fa7880b1f70 2023-07-14T12:53:20.780 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:20.780 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":23,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:52:48.091483+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:52:44.223082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T12:52:45.469396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:53:20.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.753+0000 7fa78e034640 1 -- 172.21.15.5:0/1389822454 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa7740662b0 msgr2=0x7fa774068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:20.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.753+0000 7fa78e034640 1 --2- 172.21.15.5:0/1389822454 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa7740662b0 0x7fa774068760 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa78815bd50 tx=0x7fa77c008040 comp rx=0 tx=0).stop 2023-07-14T12:53:20.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.753+0000 7fa78e034640 1 -- 172.21.15.5:0/1389822454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7880b1f70 msgr2=0x7fa78815a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:20.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.753+0000 7fa78e034640 1 --2- 172.21.15.5:0/1389822454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7880b1f70 0x7fa78815a8b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa7780ab040 tx=0x7fa77801ad50 comp rx=0 tx=0).stop 2023-07-14T12:53:20.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.753+0000 7fa78e034640 1 -- 172.21.15.5:0/1389822454 shutdown_connections 2023-07-14T12:53:20.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.753+0000 7fa78e034640 1 --2- 172.21.15.5:0/1389822454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7880cc1d0 0x7fa78815e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:20.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.753+0000 7fa78e034640 1 --2- 172.21.15.5:0/1389822454 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa7740662b0 0x7fa774068760 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:20.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.753+0000 7fa78e034640 1 --2- 172.21.15.5:0/1389822454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7880d06b0 0x7fa7880c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:20.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.753+0000 7fa78e034640 1 --2- 172.21.15.5:0/1389822454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7880b1f70 0x7fa78815a8b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:20.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.753+0000 7fa78e034640 1 -- 172.21.15.5:0/1389822454 >> 172.21.15.5:0/1389822454 conn(0x7fa7880659d0 msgr2=0x7fa78806b560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:20.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.753+0000 7fa78e034640 1 -- 172.21.15.5:0/1389822454 shutdown_connections 2023-07-14T12:53:20.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.753+0000 7fa78e034640 1 -- 172.21.15.5:0/1389822454 wait complete. 2023-07-14T12:53:20.801 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T12:52:44.223082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T12:52:45.469396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T12:53:20.803 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T12:53:20.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.921+0000 7fcd86911640 1 Processor -- start 2023-07-14T12:53:20.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.921+0000 7fcd86911640 1 -- start start 2023-07-14T12:53:20.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd86911640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd8006db00 0x7fcd800ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:20.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd86911640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd800cb6a0 con 0x7fcd8015beb0 2023-07-14T12:53:20.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd86911640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd8006d020 con 0x7fcd800b0760 2023-07-14T12:53:20.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd86911640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd800cb4b0 con 0x7fcd8006db00 2023-07-14T12:53:20.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd7ffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcd8015beb0 0x7fcd800cada0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47082/0 (socket says 172.21.15.5:47082) 2023-07-14T12:53:20.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd7ffff640 1 -- 172.21.15.5:0/2341717620 learned_addr learned my addr 172.21.15.5:0/2341717620 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:20.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd7f7fe640 1 --2- 172.21.15.5:0/2341717620 >> v2:172.21.15.154:3300/0 conn(0x7fcd8006db00 0x7fcd800ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:20.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd7effd640 1 -- 172.21.15.5:0/2341717620 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 913331038 0 0) 0x7fcd800cb6a0 con 0x7fcd8015beb0 2023-07-14T12:53:20.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd7effd640 1 -- 172.21.15.5:0/2341717620 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd68003530 con 0x7fcd8015beb0 2023-07-14T12:53:20.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd7effd640 1 -- 172.21.15.5:0/2341717620 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1169107455 0 0) 0x7fcd68003530 con 0x7fcd8015beb0 2023-07-14T12:53:20.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd7effd640 1 -- 172.21.15.5:0/2341717620 >> v2:172.21.15.154:3300/0 conn(0x7fcd8006db00 msgr2=0x7fcd800ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:20.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd7effd640 1 --2- 172.21.15.5:0/2341717620 >> v2:172.21.15.154:3300/0 conn(0x7fcd8006db00 0x7fcd800ca0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:20.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd7effd640 1 -- 172.21.15.5:0/2341717620 >> v1:172.21.15.154:6789/0 conn(0x7fcd800b0760 legacy=0x7fcd8015f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:20.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd7effd640 1 -- 172.21.15.5:0/2341717620 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8006d300 con 0x7fcd8015beb0 2023-07-14T12:53:20.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd7effd640 1 -- 172.21.15.5:0/2341717620 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7fcd70001680 con 0x7fcd8015beb0 2023-07-14T12:53:20.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd7effd640 1 -- 172.21.15.5:0/2341717620 >> v1:172.21.15.5:6789/0 conn(0x7fcd8015beb0 legacy=0x7fcd800cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:20.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd7effd640 1 --2- 172.21.15.5:0/2341717620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd68003980 0x7fcd68003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:20.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd7effd640 1 --2- 172.21.15.5:0/2341717620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd68004370 0x7fcd68004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:20.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd7effd640 1 --2- 172.21.15.5:0/2341717620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd680050d0 0x7fcd6800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:20.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd7effd640 1 -- 172.21.15.5:0/2341717620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6800bfd0 con 0x7fcd68003980 2023-07-14T12:53:20.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd7effd640 1 -- 172.21.15.5:0/2341717620 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6800c140 con 0x7fcd68004370 2023-07-14T12:53:20.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd7effd640 1 -- 172.21.15.5:0/2341717620 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6800c300 con 0x7fcd680050d0 2023-07-14T12:53:20.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd7ffff640 1 --2- 172.21.15.5:0/2341717620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd68003980 0x7fcd68003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:20.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd7f7fe640 1 --2- 172.21.15.5:0/2341717620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd68004370 0x7fcd68004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:20.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd84eae640 1 --2- 172.21.15.5:0/2341717620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd680050d0 0x7fcd6800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:20.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd7ffff640 1 -- 172.21.15.5:0/2341717620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd680050d0 msgr2=0x7fcd6800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:20.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd7ffff640 1 --2- 172.21.15.5:0/2341717620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd680050d0 0x7fcd6800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:20.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd7ffff640 1 -- 172.21.15.5:0/2341717620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd68004370 msgr2=0x7fcd68004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:20.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd7ffff640 1 --2- 172.21.15.5:0/2341717620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd68004370 0x7fcd68004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:20.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd7ffff640 1 -- 172.21.15.5:0/2341717620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd68003530 con 0x7fcd68003980 2023-07-14T12:53:20.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd84eae640 1 --2- 172.21.15.5:0/2341717620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd680050d0 0x7fcd6800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:20.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.925+0000 7fcd84eae640 1 -- 172.21.15.5:0/2341717620 reap_dead start 2023-07-14T12:53:20.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.929+0000 7fcd7ffff640 1 --2- 172.21.15.5:0/2341717620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd68003980 0x7fcd68003d50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcd7000c210 tx=0x7fcd7001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e1b6d949d3f4c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:20.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.929+0000 7fcd7effd640 1 -- 172.21.15.5:0/2341717620 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd70005ae0 con 0x7fcd68003980 2023-07-14T12:53:20.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.929+0000 7fcd7effd640 1 -- 172.21.15.5:0/2341717620 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd70005c60 con 0x7fcd68003980 2023-07-14T12:53:20.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.929+0000 7fcd7effd640 1 -- 172.21.15.5:0/2341717620 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd700a5a80 con 0x7fcd68003980 2023-07-14T12:53:20.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.929+0000 7fcd86911640 1 -- 172.21.15.5:0/2341717620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd68003980 msgr2=0x7fcd68003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:20.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.929+0000 7fcd86911640 1 --2- 172.21.15.5:0/2341717620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd68003980 0x7fcd68003d50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcd7000c210 tx=0x7fcd7001cc30 comp rx=0 tx=0).stop 2023-07-14T12:53:20.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.929+0000 7fcd86911640 1 -- 172.21.15.5:0/2341717620 shutdown_connections 2023-07-14T12:53:20.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.929+0000 7fcd86911640 1 --2- 172.21.15.5:0/2341717620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd68003980 0x7fcd68003d50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:20.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.929+0000 7fcd86911640 1 -- 172.21.15.5:0/2341717620 >> 172.21.15.5:0/2341717620 conn(0x7fcd8006c2f0 msgr2=0x7fcd800aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:20.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.929+0000 7fcd86911640 1 -- 172.21.15.5:0/2341717620 shutdown_connections 2023-07-14T12:53:20.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.929+0000 7fcd86911640 1 -- 172.21.15.5:0/2341717620 wait complete. 2023-07-14T12:53:20.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.929+0000 7fcd86911640 1 Processor -- start 2023-07-14T12:53:20.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.933+0000 7fcd86911640 1 -- start start 2023-07-14T12:53:20.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.933+0000 7fcd86911640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd68003980 0x7fcd800ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:20.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.933+0000 7fcd86911640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd800ad240 0x7fcd801e7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:20.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.933+0000 7fcd86911640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd800704b0 0x7fcd801e7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:20.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.933+0000 7fcd86911640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd801f47d0 con 0x7fcd800ad240 2023-07-14T12:53:20.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.933+0000 7fcd86911640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd800acdb0 con 0x7fcd800704b0 2023-07-14T12:53:20.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.933+0000 7fcd86911640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd800ac1a0 con 0x7fcd68003980 2023-07-14T12:53:20.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.933+0000 7fcd7f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd800ad240 0x7fcd801e7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:20.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.933+0000 7fcd7ffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd68003980 0x7fcd800ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:20.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.933+0000 7fcd7f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd800ad240 0x7fcd801e7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41978/0 (socket says 172.21.15.5:41978) 2023-07-14T12:53:20.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.933+0000 7fcd7f7fe640 1 -- 172.21.15.5:0/3040421427 learned_addr learned my addr 172.21.15.5:0/3040421427 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:20.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.933+0000 7fcd84eae640 1 --2- 172.21.15.5:0/3040421427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd800704b0 0x7fcd801e7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:20.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.933+0000 7fcd7f7fe640 1 -- 172.21.15.5:0/3040421427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd68003980 msgr2=0x7fcd800ab8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:20.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.933+0000 7fcd7f7fe640 1 --2- 172.21.15.5:0/3040421427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd68003980 0x7fcd800ab8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:20.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.933+0000 7fcd7f7fe640 1 -- 172.21.15.5:0/3040421427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd800704b0 msgr2=0x7fcd801e7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:20.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.933+0000 7fcd7f7fe640 1 --2- 172.21.15.5:0/3040421427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd800704b0 0x7fcd801e7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:20.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.933+0000 7fcd7f7fe640 1 -- 172.21.15.5:0/3040421427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd800ac480 con 0x7fcd800ad240 2023-07-14T12:53:20.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.933+0000 7fcd7f7fe640 1 --2- 172.21.15.5:0/3040421427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd800ad240 0x7fcd801e7870 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcd740119b0 tx=0x7fcd74011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:20.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.933+0000 7fcd7cff9640 1 -- 172.21.15.5:0/3040421427 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd74004240 con 0x7fcd800ad240 2023-07-14T12:53:20.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.933+0000 7fcd7cff9640 1 -- 172.21.15.5:0/3040421427 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd740043a0 con 0x7fcd800ad240 2023-07-14T12:53:20.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.933+0000 7fcd7cff9640 1 -- 172.21.15.5:0/3040421427 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7400fb00 con 0x7fcd800ad240 2023-07-14T12:53:20.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.933+0000 7fcd86911640 1 -- 172.21.15.5:0/3040421427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd800ac760 con 0x7fcd800ad240 2023-07-14T12:53:20.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.933+0000 7fcd86911640 1 -- 172.21.15.5:0/3040421427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd800abde0 con 0x7fcd800ad240 2023-07-14T12:53:20.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.933+0000 7fcd86911640 1 -- 172.21.15.5:0/3040421427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd800678d0 con 0x7fcd800ad240 2023-07-14T12:53:20.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.937+0000 7fcd7cff9640 1 -- 172.21.15.5:0/3040421427 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcd7400fc60 con 0x7fcd800ad240 2023-07-14T12:53:20.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.937+0000 7fcd7cff9640 1 --2- 172.21.15.5:0/3040421427 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fcd6c0662b0 0x7fcd6c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:20.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.937+0000 7fcd7cff9640 1 -- 172.21.15.5:0/3040421427 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcd74084330 con 0x7fcd800ad240 2023-07-14T12:53:20.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.937+0000 7fcd7ffff640 1 --2- 172.21.15.5:0/3040421427 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fcd6c0662b0 0x7fcd6c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:20.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.937+0000 7fcd7ffff640 1 --2- 172.21.15.5:0/3040421427 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fcd6c0662b0 0x7fcd6c068760 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcd700ab000 tx=0x7fcd700b1040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:20.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:20.941+0000 7fcd7cff9640 1 -- 172.21.15.5:0/3040421427 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fcd74051850 con 0x7fcd800ad240 2023-07-14T12:53:21.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.097+0000 7fcd86911640 1 -- 172.21.15.5:0/3040421427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd800acef0 con 0x7fcd800ad240 2023-07-14T12:53:21.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.097+0000 7fcd7cff9640 1 -- 172.21.15.5:0/3040421427 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd74054e70 con 0x7fcd800ad240 2023-07-14T12:53:21.125 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T12:53:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.097+0000 7fcd86911640 1 -- 172.21.15.5:0/3040421427 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fcd6c0662b0 msgr2=0x7fcd6c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:21.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.097+0000 7fcd86911640 1 --2- 172.21.15.5:0/3040421427 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fcd6c0662b0 0x7fcd6c068760 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcd700ab000 tx=0x7fcd700b1040 comp rx=0 tx=0).stop 2023-07-14T12:53:21.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.097+0000 7fcd86911640 1 -- 172.21.15.5:0/3040421427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd800ad240 msgr2=0x7fcd801e7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:21.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.097+0000 7fcd86911640 1 --2- 172.21.15.5:0/3040421427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd800ad240 0x7fcd801e7870 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcd740119b0 tx=0x7fcd74011e70 comp rx=0 tx=0).stop 2023-07-14T12:53:21.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.097+0000 7fcd86911640 1 -- 172.21.15.5:0/3040421427 shutdown_connections 2023-07-14T12:53:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.097+0000 7fcd86911640 1 --2- 172.21.15.5:0/3040421427 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fcd6c0662b0 0x7fcd6c068760 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.097+0000 7fcd86911640 1 --2- 172.21.15.5:0/3040421427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd800704b0 0x7fcd801e7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.097+0000 7fcd86911640 1 --2- 172.21.15.5:0/3040421427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd800ad240 0x7fcd801e7870 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.097+0000 7fcd86911640 1 --2- 172.21.15.5:0/3040421427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd68003980 0x7fcd800ab8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.097+0000 7fcd86911640 1 -- 172.21.15.5:0/3040421427 >> 172.21.15.5:0/3040421427 conn(0x7fcd8006c2f0 msgr2=0x7fcd800cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.097+0000 7fcd86911640 1 -- 172.21.15.5:0/3040421427 shutdown_connections 2023-07-14T12:53:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.097+0000 7fcd86911640 1 -- 172.21.15.5:0/3040421427 wait complete. 2023-07-14T12:53:21.145 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T12:53:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.265+0000 7fd70e711640 1 Processor -- start 2023-07-14T12:53:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.265+0000 7fd70e711640 1 -- start start 2023-07-14T12:53:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.265+0000 7fd70e711640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd70806a540 0x7fd70806a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.265+0000 7fd70e711640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd7080cf710 0x7fd7080cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.265+0000 7fd70e711640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7080cb7a0 con 0x7fd7080cf2e0 2023-07-14T12:53:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.265+0000 7fd70e711640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7080d0920 con 0x7fd70806a540 2023-07-14T12:53:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.265+0000 7fd70e711640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70815bfd0 con 0x7fd7080cf710 2023-07-14T12:53:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.265+0000 7fd707fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd70806a540 0x7fd70806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.265+0000 7fd707fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd70806a540 0x7fd70806a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41990/0 (socket says 172.21.15.5:41990) 2023-07-14T12:53:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.265+0000 7fd707fff640 1 -- 172.21.15.5:0/3958320145 learned_addr learned my addr 172.21.15.5:0/3958320145 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.269+0000 7fd70ccae640 1 --2- 172.21.15.5:0/3958320145 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd7080cf710 0x7fd7080cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.269+0000 7fd707fff640 1 -- 172.21.15.5:0/3958320145 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd7080cf710 msgr2=0x7fd7080cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.269+0000 7fd707fff640 1 --2- 172.21.15.5:0/3958320145 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd7080cf710 0x7fd7080cd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.269+0000 7fd707fff640 1 -- 172.21.15.5:0/3958320145 >> v1:172.21.15.5:6789/0 conn(0x7fd7080cf2e0 legacy=0x7fd7080cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.269+0000 7fd707fff640 1 -- 172.21.15.5:0/3958320145 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70806ae50 con 0x7fd70806a540 2023-07-14T12:53:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.269+0000 7fd706ffd640 1 -- 172.21.15.5:0/3958320145 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2211355181 0 0) 0x7fd7080cb7a0 con 0x7fd7080cf2e0 2023-07-14T12:53:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.269+0000 7fd707fff640 1 --2- 172.21.15.5:0/3958320145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd70806a540 0x7fd70806a910 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8009870 tx=0x7fd6f801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd31b56d2074098 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.269+0000 7fd706ffd640 1 -- 172.21.15.5:0/3958320145 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f80ab620 con 0x7fd70806a540 2023-07-14T12:53:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.269+0000 7fd706ffd640 1 -- 172.21.15.5:0/3958320145 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f80ab780 con 0x7fd70806a540 2023-07-14T12:53:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.269+0000 7fd706ffd640 1 -- 172.21.15.5:0/3958320145 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f80abb10 con 0x7fd70806a540 2023-07-14T12:53:21.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.269+0000 7fd70e711640 1 -- 172.21.15.5:0/3958320145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd70806a540 msgr2=0x7fd70806a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.269+0000 7fd70e711640 1 --2- 172.21.15.5:0/3958320145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd70806a540 0x7fd70806a910 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8009870 tx=0x7fd6f801c510 comp rx=0 tx=0).stop 2023-07-14T12:53:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.269+0000 7fd70e711640 1 -- 172.21.15.5:0/3958320145 shutdown_connections 2023-07-14T12:53:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.269+0000 7fd70e711640 1 --2- 172.21.15.5:0/3958320145 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd7080cf710 0x7fd7080cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.269+0000 7fd70e711640 1 --2- 172.21.15.5:0/3958320145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd70806a540 0x7fd70806a910 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.269+0000 7fd70e711640 1 -- 172.21.15.5:0/3958320145 >> 172.21.15.5:0/3958320145 conn(0x7fd708099490 msgr2=0x7fd708089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.269+0000 7fd70e711640 1 -- 172.21.15.5:0/3958320145 shutdown_connections 2023-07-14T12:53:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.273+0000 7fd70e711640 1 -- 172.21.15.5:0/3958320145 wait complete. 2023-07-14T12:53:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.273+0000 7fd70e711640 1 Processor -- start 2023-07-14T12:53:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.273+0000 7fd70e711640 1 -- start start 2023-07-14T12:53:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.273+0000 7fd70e711640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd70806a540 0x7fd708158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.273+0000 7fd70e711640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7080cf2e0 0x7fd708147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.273+0000 7fd70e711640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7080cf710 0x7fd70815a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:21.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.273+0000 7fd70e711640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70814afb0 con 0x7fd7080cf2e0 2023-07-14T12:53:21.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.273+0000 7fd70e711640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7080b55e0 con 0x7fd7080cf710 2023-07-14T12:53:21.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.273+0000 7fd70e711640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7080b58c0 con 0x7fd70806a540 2023-07-14T12:53:21.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.273+0000 7fd7077fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7080cf2e0 0x7fd708147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:21.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.273+0000 7fd707fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd70806a540 0x7fd708158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:21.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.273+0000 7fd7077fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7080cf2e0 0x7fd708147ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41992/0 (socket says 172.21.15.5:41992) 2023-07-14T12:53:21.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.273+0000 7fd7077fe640 1 -- 172.21.15.5:0/1055261349 learned_addr learned my addr 172.21.15.5:0/1055261349 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:21.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.273+0000 7fd70ccae640 1 --2- 172.21.15.5:0/1055261349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7080cf710 0x7fd70815a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:21.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.273+0000 7fd7077fe640 1 -- 172.21.15.5:0/1055261349 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd70806a540 msgr2=0x7fd708158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:21.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.273+0000 7fd7077fe640 1 --2- 172.21.15.5:0/1055261349 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd70806a540 0x7fd708158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.273+0000 7fd7077fe640 1 -- 172.21.15.5:0/1055261349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7080cf710 msgr2=0x7fd70815a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:21.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.273+0000 7fd7077fe640 1 --2- 172.21.15.5:0/1055261349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7080cf710 0x7fd70815a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.273+0000 7fd7077fe640 1 -- 172.21.15.5:0/1055261349 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f80094d0 con 0x7fd7080cf2e0 2023-07-14T12:53:21.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.273+0000 7fd7077fe640 1 --2- 172.21.15.5:0/1055261349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7080cf2e0 0x7fd708147ed0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc00c3f0 tx=0x7fd6fc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:21.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.273+0000 7fd704ff9640 1 -- 172.21.15.5:0/1055261349 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc0054e0 con 0x7fd7080cf2e0 2023-07-14T12:53:21.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.277+0000 7fd704ff9640 1 -- 172.21.15.5:0/1055261349 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6fc003600 con 0x7fd7080cf2e0 2023-07-14T12:53:21.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.277+0000 7fd704ff9640 1 -- 172.21.15.5:0/1055261349 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc003990 con 0x7fd7080cf2e0 2023-07-14T12:53:21.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.277+0000 7fd70e711640 1 -- 172.21.15.5:0/1055261349 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7080b5ba0 con 0x7fd7080cf2e0 2023-07-14T12:53:21.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.277+0000 7fd70e711640 1 -- 172.21.15.5:0/1055261349 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd708148410 con 0x7fd7080cf2e0 2023-07-14T12:53:21.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.277+0000 7fd70e711640 1 -- 172.21.15.5:0/1055261349 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd70815f420 con 0x7fd7080cf2e0 2023-07-14T12:53:21.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.277+0000 7fd704ff9640 1 -- 172.21.15.5:0/1055261349 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd6fc003af0 con 0x7fd7080cf2e0 2023-07-14T12:53:21.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.277+0000 7fd704ff9640 1 --2- 172.21.15.5:0/1055261349 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fd6f4066280 0x7fd6f4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:21.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.277+0000 7fd704ff9640 1 -- 172.21.15.5:0/1055261349 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd6fc083320 con 0x7fd7080cf2e0 2023-07-14T12:53:21.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.277+0000 7fd707fff640 1 --2- 172.21.15.5:0/1055261349 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fd6f4066280 0x7fd6f4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:21.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.281+0000 7fd707fff640 1 --2- 172.21.15.5:0/1055261349 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fd6f4066280 0x7fd6f4068730 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80af000 tx=0x7fd6f80b6040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:21.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.281+0000 7fd704ff9640 1 -- 172.21.15.5:0/1055261349 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd6fc0507b0 con 0x7fd7080cf2e0 2023-07-14T12:53:21.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.437+0000 7fd70e711640 1 -- 172.21.15.5:0/1055261349 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd7080678d0 con 0x7fd7080cf2e0 2023-07-14T12:53:21.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.437+0000 7fd704ff9640 1 -- 172.21.15.5:0/1055261349 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd6fc053dd0 con 0x7fd7080cf2e0 2023-07-14T12:53:21.465 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T12:53:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.437+0000 7fd70e711640 1 -- 172.21.15.5:0/1055261349 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fd6f4066280 msgr2=0x7fd6f4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.437+0000 7fd70e711640 1 --2- 172.21.15.5:0/1055261349 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fd6f4066280 0x7fd6f4068730 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80af000 tx=0x7fd6f80b6040 comp rx=0 tx=0).stop 2023-07-14T12:53:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.437+0000 7fd70e711640 1 -- 172.21.15.5:0/1055261349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7080cf2e0 msgr2=0x7fd708147ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.437+0000 7fd70e711640 1 --2- 172.21.15.5:0/1055261349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7080cf2e0 0x7fd708147ed0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc00c3f0 tx=0x7fd6fc00c8b0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.437+0000 7fd70e711640 1 -- 172.21.15.5:0/1055261349 shutdown_connections 2023-07-14T12:53:21.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.437+0000 7fd70e711640 1 --2- 172.21.15.5:0/1055261349 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fd6f4066280 0x7fd6f4068730 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.437+0000 7fd70e711640 1 --2- 172.21.15.5:0/1055261349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7080cf710 0x7fd70815a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.437+0000 7fd70e711640 1 --2- 172.21.15.5:0/1055261349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7080cf2e0 0x7fd708147ed0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.437+0000 7fd70e711640 1 --2- 172.21.15.5:0/1055261349 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd70806a540 0x7fd708158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.437+0000 7fd70e711640 1 -- 172.21.15.5:0/1055261349 >> 172.21.15.5:0/1055261349 conn(0x7fd708099490 msgr2=0x7fd708089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:21.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.441+0000 7fd70e711640 1 -- 172.21.15.5:0/1055261349 shutdown_connections 2023-07-14T12:53:21.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.441+0000 7fd70e711640 1 -- 172.21.15.5:0/1055261349 wait complete. 2023-07-14T12:53:21.486 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T12:53:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.605+0000 7fd81c111640 1 Processor -- start 2023-07-14T12:53:21.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.609+0000 7fd81c111640 1 -- start start 2023-07-14T12:53:21.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.609+0000 7fd81c111640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd81415cef0 0x7fd814158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:21.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.609+0000 7fd81c111640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd814159270 0x7fd8140c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:21.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.609+0000 7fd81c111640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8141532b0 con 0x7fd8140aeb40 2023-07-14T12:53:21.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.609+0000 7fd81c111640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd81415d360 con 0x7fd81415cef0 2023-07-14T12:53:21.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.609+0000 7fd81c111640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8140ca6f0 con 0x7fd814159270 2023-07-14T12:53:21.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.609+0000 7fd8196ac640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd81415cef0 0x7fd814158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:21.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.609+0000 7fd819ead640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd8140aeb40 0x7fd8140aef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47110/0 (socket says 172.21.15.5:47110) 2023-07-14T12:53:21.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.609+0000 7fd819ead640 1 -- 172.21.15.5:0/3991423927 learned_addr learned my addr 172.21.15.5:0/3991423927 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:21.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.609+0000 7fd81a6ae640 1 --2- 172.21.15.5:0/3991423927 >> v2:172.21.15.154:3300/0 conn(0x7fd814159270 0x7fd8140c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:21.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.609+0000 7fd8196ac640 1 -- 172.21.15.5:0/3991423927 >> v2:172.21.15.154:3300/0 conn(0x7fd814159270 msgr2=0x7fd8140c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:21.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.609+0000 7fd8196ac640 1 --2- 172.21.15.5:0/3991423927 >> v2:172.21.15.154:3300/0 conn(0x7fd814159270 0x7fd8140c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.609+0000 7fd8196ac640 1 -- 172.21.15.5:0/3991423927 >> v1:172.21.15.5:6789/0 conn(0x7fd8140aeb40 legacy=0x7fd8140aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:21.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.609+0000 7fd818eab640 1 -- 172.21.15.5:0/3991423927 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2447501459 0 0) 0x7fd8141532b0 con 0x7fd8140aeb40 2023-07-14T12:53:21.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.609+0000 7fd8196ac640 1 -- 172.21.15.5:0/3991423927 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8141599d0 con 0x7fd81415cef0 2023-07-14T12:53:21.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.613+0000 7fd8196ac640 1 --2- 172.21.15.5:0/3991423927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd81415cef0 0x7fd814158d30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd8140c8690 tx=0x7fd80401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe436a09fec39bd6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:21.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.613+0000 7fd818eab640 1 -- 172.21.15.5:0/3991423927 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8040a7070 con 0x7fd81415cef0 2023-07-14T12:53:21.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.613+0000 7fd818eab640 1 -- 172.21.15.5:0/3991423927 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8040ab430 con 0x7fd81415cef0 2023-07-14T12:53:21.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.613+0000 7fd818eab640 1 -- 172.21.15.5:0/3991423927 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8040ab7c0 con 0x7fd81415cef0 2023-07-14T12:53:21.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.613+0000 7fd81c111640 1 -- 172.21.15.5:0/3991423927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd81415cef0 msgr2=0x7fd814158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:21.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.613+0000 7fd81c111640 1 --2- 172.21.15.5:0/3991423927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd81415cef0 0x7fd814158d30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd8140c8690 tx=0x7fd80401c430 comp rx=0 tx=0).stop 2023-07-14T12:53:21.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.613+0000 7fd81c111640 1 -- 172.21.15.5:0/3991423927 shutdown_connections 2023-07-14T12:53:21.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.613+0000 7fd81c111640 1 --2- 172.21.15.5:0/3991423927 >> v2:172.21.15.154:3300/0 conn(0x7fd814159270 0x7fd8140c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.613+0000 7fd81c111640 1 --2- 172.21.15.5:0/3991423927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd81415cef0 0x7fd814158d30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.613+0000 7fd81c111640 1 -- 172.21.15.5:0/3991423927 >> 172.21.15.5:0/3991423927 conn(0x7fd8140cde90 msgr2=0x7fd8140ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:21.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.613+0000 7fd81c111640 1 -- 172.21.15.5:0/3991423927 shutdown_connections 2023-07-14T12:53:21.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.613+0000 7fd81c111640 1 -- 172.21.15.5:0/3991423927 wait complete. 2023-07-14T12:53:21.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.613+0000 7fd81c111640 1 Processor -- start 2023-07-14T12:53:21.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.613+0000 7fd81c111640 1 -- start start 2023-07-14T12:53:21.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.617+0000 7fd81c111640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8140aeb40 0x7fd814165920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:21.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.617+0000 7fd81c111640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd814159270 0x7fd814157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:21.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.617+0000 7fd81c111640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd81415cef0 0x7fd81414edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:21.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.617+0000 7fd81c111640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd814166120 con 0x7fd8140aeb40 2023-07-14T12:53:21.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.617+0000 7fd81c111640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd814166930 con 0x7fd81415cef0 2023-07-14T12:53:21.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.617+0000 7fd81c111640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd814166370 con 0x7fd814159270 2023-07-14T12:53:21.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.617+0000 7fd819ead640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8140aeb40 0x7fd814165920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:21.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.617+0000 7fd819ead640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8140aeb40 0x7fd814165920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41996/0 (socket says 172.21.15.5:41996) 2023-07-14T12:53:21.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.617+0000 7fd819ead640 1 -- 172.21.15.5:0/763169513 learned_addr learned my addr 172.21.15.5:0/763169513 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:21.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.617+0000 7fd81a6ae640 1 --2- 172.21.15.5:0/763169513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd81415cef0 0x7fd81414edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:21.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.617+0000 7fd8196ac640 1 --2- 172.21.15.5:0/763169513 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd814159270 0x7fd814157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:21.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.617+0000 7fd819ead640 1 -- 172.21.15.5:0/763169513 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd814159270 msgr2=0x7fd814157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.617+0000 7fd819ead640 1 --2- 172.21.15.5:0/763169513 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd814159270 0x7fd814157d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.617+0000 7fd819ead640 1 -- 172.21.15.5:0/763169513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd81415cef0 msgr2=0x7fd81414edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.617+0000 7fd819ead640 1 --2- 172.21.15.5:0/763169513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd81415cef0 0x7fd81414edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.617+0000 7fd819ead640 1 -- 172.21.15.5:0/763169513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd804009420 con 0x7fd8140aeb40 2023-07-14T12:53:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.617+0000 7fd81a6ae640 1 --2- 172.21.15.5:0/763169513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd81415cef0 0x7fd81414edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.617+0000 7fd819ead640 1 --2- 172.21.15.5:0/763169513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8140aeb40 0x7fd814165920 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd8100011f0 tx=0x7fd81000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.617+0000 7fd80a7fc640 1 -- 172.21.15.5:0/763169513 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8100074e0 con 0x7fd8140aeb40 2023-07-14T12:53:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.617+0000 7fd80a7fc640 1 -- 172.21.15.5:0/763169513 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd810007640 con 0x7fd8140aeb40 2023-07-14T12:53:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.617+0000 7fd81c111640 1 -- 172.21.15.5:0/763169513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd814166650 con 0x7fd8140aeb40 2023-07-14T12:53:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.617+0000 7fd80a7fc640 1 -- 172.21.15.5:0/763169513 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd810004a10 con 0x7fd8140aeb40 2023-07-14T12:53:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.617+0000 7fd81c111640 1 -- 172.21.15.5:0/763169513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd814157830 con 0x7fd8140aeb40 2023-07-14T12:53:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.617+0000 7fd81c111640 1 -- 172.21.15.5:0/763169513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8141573b0 con 0x7fd8140aeb40 2023-07-14T12:53:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.617+0000 7fd80a7fc640 1 -- 172.21.15.5:0/763169513 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd810004b70 con 0x7fd8140aeb40 2023-07-14T12:53:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.621+0000 7fd80a7fc640 1 --2- 172.21.15.5:0/763169513 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fd7f80662b0 0x7fd7f8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:21.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.621+0000 7fd80a7fc640 1 -- 172.21.15.5:0/763169513 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd810083280 con 0x7fd8140aeb40 2023-07-14T12:53:21.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.621+0000 7fd8196ac640 1 --2- 172.21.15.5:0/763169513 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fd7f80662b0 0x7fd7f8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:21.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.621+0000 7fd8196ac640 1 --2- 172.21.15.5:0/763169513 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fd7f80662b0 0x7fd7f8068760 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd8040af000 tx=0x7fd8040b6040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:21.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.625+0000 7fd80a7fc640 1 -- 172.21.15.5:0/763169513 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd8141573b0 con 0x7fd8140aeb40 2023-07-14T12:53:21.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.777+0000 7fd81c111640 1 -- 172.21.15.5:0/763169513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd8141573b0 con 0x7fd8140aeb40 2023-07-14T12:53:21.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.781+0000 7fd80a7fc640 1 -- 172.21.15.5:0/763169513 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd8141573b0 con 0x7fd8140aeb40 2023-07-14T12:53:21.808 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T12:53:21.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.781+0000 7fd81c111640 1 -- 172.21.15.5:0/763169513 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fd7f80662b0 msgr2=0x7fd7f8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:21.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.781+0000 7fd81c111640 1 --2- 172.21.15.5:0/763169513 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fd7f80662b0 0x7fd7f8068760 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd8040af000 tx=0x7fd8040b6040 comp rx=0 tx=0).stop 2023-07-14T12:53:21.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.781+0000 7fd81c111640 1 -- 172.21.15.5:0/763169513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8140aeb40 msgr2=0x7fd814165920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:21.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.781+0000 7fd81c111640 1 --2- 172.21.15.5:0/763169513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8140aeb40 0x7fd814165920 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd8100011f0 tx=0x7fd81000c9b0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.781+0000 7fd81c111640 1 -- 172.21.15.5:0/763169513 shutdown_connections 2023-07-14T12:53:21.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.781+0000 7fd81c111640 1 --2- 172.21.15.5:0/763169513 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fd7f80662b0 0x7fd7f8068760 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.781+0000 7fd81c111640 1 --2- 172.21.15.5:0/763169513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd81415cef0 0x7fd81414edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.781+0000 7fd81c111640 1 --2- 172.21.15.5:0/763169513 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd814159270 0x7fd814157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.781+0000 7fd81c111640 1 --2- 172.21.15.5:0/763169513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8140aeb40 0x7fd814165920 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.781+0000 7fd81c111640 1 -- 172.21.15.5:0/763169513 >> 172.21.15.5:0/763169513 conn(0x7fd8140cde90 msgr2=0x7fd814152a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:21.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.781+0000 7fd81c111640 1 -- 172.21.15.5:0/763169513 shutdown_connections 2023-07-14T12:53:21.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.781+0000 7fd81c111640 1 -- 172.21.15.5:0/763169513 wait complete. 2023-07-14T12:53:21.829 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T12:53:21.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.949+0000 7f3d0eaca640 1 Processor -- start 2023-07-14T12:53:21.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.949+0000 7f3d0eaca640 1 -- start start 2023-07-14T12:53:21.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.949+0000 7f3d0eaca640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3d0815cef0 0x7f3d08158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:21.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.949+0000 7f3d0eaca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d08159270 0x7f3d080c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:21.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.949+0000 7f3d0eaca640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d081532b0 con 0x7f3d080aeb40 2023-07-14T12:53:21.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.949+0000 7f3d0eaca640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d0815d360 con 0x7f3d0815cef0 2023-07-14T12:53:21.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.949+0000 7f3d0eaca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d080ca6f0 con 0x7f3d08159270 2023-07-14T12:53:21.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.949+0000 7f3d0c866640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3d080aeb40 0x7f3d080aef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47122/0 (socket says 172.21.15.5:47122) 2023-07-14T12:53:21.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.949+0000 7f3d0c866640 1 -- 172.21.15.5:0/4175159690 learned_addr learned my addr 172.21.15.5:0/4175159690 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:21.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.949+0000 7f3d0d067640 1 --2- 172.21.15.5:0/4175159690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d08159270 0x7f3d080c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:21.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.949+0000 7f3cfffff640 1 --2- 172.21.15.5:0/4175159690 >> v2:172.21.15.154:3300/0 conn(0x7f3d0815cef0 0x7f3d08158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:21.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.949+0000 7f3cff7fe640 1 -- 172.21.15.5:0/4175159690 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3470418699 0 0) 0x7f3d081532b0 con 0x7f3d080aeb40 2023-07-14T12:53:21.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.949+0000 7f3cff7fe640 1 -- 172.21.15.5:0/4175159690 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cf0003530 con 0x7f3d080aeb40 2023-07-14T12:53:21.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.949+0000 7f3d0d067640 1 -- 172.21.15.5:0/4175159690 >> v2:172.21.15.154:3300/0 conn(0x7f3d0815cef0 msgr2=0x7f3d08158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:21.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.949+0000 7f3d0d067640 1 --2- 172.21.15.5:0/4175159690 >> v2:172.21.15.154:3300/0 conn(0x7f3d0815cef0 0x7f3d08158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.949+0000 7f3d0d067640 1 -- 172.21.15.5:0/4175159690 >> v1:172.21.15.5:6789/0 conn(0x7f3d080aeb40 legacy=0x7f3d080aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:21.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.949+0000 7f3cff7fe640 1 -- 172.21.15.5:0/4175159690 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2288076924 0 0) 0x7f3cf0003530 con 0x7f3d080aeb40 2023-07-14T12:53:21.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.949+0000 7f3d0d067640 1 -- 172.21.15.5:0/4175159690 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d081599d0 con 0x7f3d08159270 2023-07-14T12:53:21.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.953+0000 7f3d0d067640 1 --2- 172.21.15.5:0/4175159690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d08159270 0x7f3d080c88c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3d00009d90 tx=0x7f3d0001c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21dd0412e2f94ae1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:21.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.953+0000 7f3cff7fe640 1 -- 172.21.15.5:0/4175159690 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d04001680 con 0x7f3d08159270 2023-07-14T12:53:21.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.953+0000 7f3cff7fe640 1 -- 172.21.15.5:0/4175159690 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d000a5640 con 0x7f3d08159270 2023-07-14T12:53:21.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.953+0000 7f3cff7fe640 1 -- 172.21.15.5:0/4175159690 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d000a59b0 con 0x7f3d08159270 2023-07-14T12:53:21.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.953+0000 7f3d0eaca640 1 -- 172.21.15.5:0/4175159690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d08159270 msgr2=0x7f3d080c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:21.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.953+0000 7f3d0eaca640 1 --2- 172.21.15.5:0/4175159690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d08159270 0x7f3d080c88c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3d00009d90 tx=0x7f3d0001c840 comp rx=0 tx=0).stop 2023-07-14T12:53:21.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.953+0000 7f3d0eaca640 1 -- 172.21.15.5:0/4175159690 shutdown_connections 2023-07-14T12:53:21.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.953+0000 7f3d0eaca640 1 --2- 172.21.15.5:0/4175159690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d08159270 0x7f3d080c88c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.953+0000 7f3d0eaca640 1 --2- 172.21.15.5:0/4175159690 >> v2:172.21.15.154:3300/0 conn(0x7f3d0815cef0 0x7f3d08158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.953+0000 7f3d0eaca640 1 -- 172.21.15.5:0/4175159690 >> 172.21.15.5:0/4175159690 conn(0x7f3d080cde90 msgr2=0x7f3d080ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:21.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.953+0000 7f3d0eaca640 1 -- 172.21.15.5:0/4175159690 shutdown_connections 2023-07-14T12:53:21.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.953+0000 7f3d0eaca640 1 -- 172.21.15.5:0/4175159690 wait complete. 2023-07-14T12:53:21.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.957+0000 7f3d0eaca640 1 Processor -- start 2023-07-14T12:53:21.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.957+0000 7f3d0eaca640 1 -- start start 2023-07-14T12:53:21.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.957+0000 7f3d0eaca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d080aeb40 0x7f3d08145190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:21.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.957+0000 7f3d0eaca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d08159270 0x7f3d08148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.957+0000 7f3d0eaca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d0815cef0 0x7f3d081f56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.957+0000 7f3d0eaca640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d080c3d30 con 0x7f3d080aeb40 2023-07-14T12:53:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.957+0000 7f3d0eaca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d08156db0 con 0x7f3d08159270 2023-07-14T12:53:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.957+0000 7f3d0eaca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d081485f0 con 0x7f3d0815cef0 2023-07-14T12:53:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.957+0000 7f3d0c866640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d080aeb40 0x7f3d08145190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.957+0000 7f3d0c866640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d080aeb40 0x7f3d08145190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42010/0 (socket says 172.21.15.5:42010) 2023-07-14T12:53:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.957+0000 7f3d0c866640 1 -- 172.21.15.5:0/3674132326 learned_addr learned my addr 172.21.15.5:0/3674132326 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.957+0000 7f3d0d067640 1 --2- 172.21.15.5:0/3674132326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d0815cef0 0x7f3d081f56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.957+0000 7f3cfffff640 1 --2- 172.21.15.5:0/3674132326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d08159270 0x7f3d08148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.957+0000 7f3d0c866640 1 -- 172.21.15.5:0/3674132326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d0815cef0 msgr2=0x7f3d081f56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.957+0000 7f3d0c866640 1 --2- 172.21.15.5:0/3674132326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d0815cef0 0x7f3d081f56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.957+0000 7f3d0c866640 1 -- 172.21.15.5:0/3674132326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d08159270 msgr2=0x7f3d08148f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.957+0000 7f3d0c866640 1 --2- 172.21.15.5:0/3674132326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d08159270 0x7f3d08148f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.957+0000 7f3d0c866640 1 -- 172.21.15.5:0/3674132326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d00009a70 con 0x7f3d080aeb40 2023-07-14T12:53:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.957+0000 7f3d0c866640 1 --2- 172.21.15.5:0/3674132326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d080aeb40 0x7f3d08145190 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400c760 tx=0x7f3d0400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:21.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.957+0000 7f3cfd7fa640 1 -- 172.21.15.5:0/3674132326 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d04005ae0 con 0x7f3d080aeb40 2023-07-14T12:53:21.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.957+0000 7f3cfd7fa640 1 -- 172.21.15.5:0/3674132326 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d04005c40 con 0x7f3d080aeb40 2023-07-14T12:53:21.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.957+0000 7f3cfd7fa640 1 -- 172.21.15.5:0/3674132326 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d04007070 con 0x7f3d080aeb40 2023-07-14T12:53:21.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.957+0000 7f3d0eaca640 1 -- 172.21.15.5:0/3674132326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d081488d0 con 0x7f3d080aeb40 2023-07-14T12:53:21.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.957+0000 7f3d0eaca640 1 -- 172.21.15.5:0/3674132326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d081494c0 con 0x7f3d080aeb40 2023-07-14T12:53:21.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.961+0000 7f3d0eaca640 1 -- 172.21.15.5:0/3674132326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d080678d0 con 0x7f3d080aeb40 2023-07-14T12:53:21.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.961+0000 7f3cfd7fa640 1 -- 172.21.15.5:0/3674132326 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3d040071d0 con 0x7f3d080aeb40 2023-07-14T12:53:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.961+0000 7f3cfd7fa640 1 --2- 172.21.15.5:0/3674132326 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3cf4066280 0x7f3cf4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.961+0000 7f3cfd7fa640 1 -- 172.21.15.5:0/3674132326 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3d04083ca0 con 0x7f3d080aeb40 2023-07-14T12:53:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.961+0000 7f3cfffff640 1 --2- 172.21.15.5:0/3674132326 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3cf4066280 0x7f3cf4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.961+0000 7f3cfffff640 1 --2- 172.21.15.5:0/3674132326 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3cf4066280 0x7f3cf4068730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3d080c37c0 tx=0x7f3cf8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:21.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:21.965+0000 7f3cfd7fa640 1 -- 172.21.15.5:0/3674132326 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3d04054b10 con 0x7f3d080aeb40 2023-07-14T12:53:22.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.121+0000 7f3d0eaca640 1 -- 172.21.15.5:0/3674132326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3d0815c6c0 con 0x7f3d080aeb40 2023-07-14T12:53:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.121+0000 7f3cfd7fa640 1 -- 172.21.15.5:0/3674132326 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3d040546a0 con 0x7f3d080aeb40 2023-07-14T12:53:22.150 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T12:53:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.125+0000 7f3d0eaca640 1 -- 172.21.15.5:0/3674132326 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3cf4066280 msgr2=0x7f3cf4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.125+0000 7f3d0eaca640 1 --2- 172.21.15.5:0/3674132326 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3cf4066280 0x7f3cf4068730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3d080c37c0 tx=0x7f3cf8008040 comp rx=0 tx=0).stop 2023-07-14T12:53:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.125+0000 7f3d0eaca640 1 -- 172.21.15.5:0/3674132326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d080aeb40 msgr2=0x7f3d08145190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.125+0000 7f3d0eaca640 1 --2- 172.21.15.5:0/3674132326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d080aeb40 0x7f3d08145190 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400c760 tx=0x7f3d0400cc20 comp rx=0 tx=0).stop 2023-07-14T12:53:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.125+0000 7f3d0eaca640 1 -- 172.21.15.5:0/3674132326 shutdown_connections 2023-07-14T12:53:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.125+0000 7f3d0eaca640 1 --2- 172.21.15.5:0/3674132326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d0815cef0 0x7f3d081f56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.125+0000 7f3d0eaca640 1 --2- 172.21.15.5:0/3674132326 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3cf4066280 0x7f3cf4068730 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.125+0000 7f3d0eaca640 1 --2- 172.21.15.5:0/3674132326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d08159270 0x7f3d08148f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.125+0000 7f3d0eaca640 1 --2- 172.21.15.5:0/3674132326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d080aeb40 0x7f3d08145190 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:22.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.125+0000 7f3d0eaca640 1 -- 172.21.15.5:0/3674132326 >> 172.21.15.5:0/3674132326 conn(0x7f3d080cde90 msgr2=0x7f3d080cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:22.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.125+0000 7f3d0eaca640 1 -- 172.21.15.5:0/3674132326 shutdown_connections 2023-07-14T12:53:22.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.125+0000 7f3d0eaca640 1 -- 172.21.15.5:0/3674132326 wait complete. 2023-07-14T12:53:22.171 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T12:53:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.289+0000 7f4371ffa640 1 Processor -- start 2023-07-14T12:53:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.289+0000 7f4371ffa640 1 -- start start 2023-07-14T12:53:22.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.289+0000 7f4371ffa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f436c0cb780 0x7f436c0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:22.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.289+0000 7f4371ffa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f436c06f900 con 0x7f436c15b7c0 2023-07-14T12:53:22.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.289+0000 7f4371ffa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f436c15bb90 con 0x7f436c06b8f0 2023-07-14T12:53:22.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.289+0000 7f4371ffa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f436c0cdce0 con 0x7f436c0cb780 2023-07-14T12:53:22.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.289+0000 7f436b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f436c15b7c0 0x7f436c06b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47128/0 (socket says 172.21.15.5:47128) 2023-07-14T12:53:22.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.289+0000 7f436b7fe640 1 -- 172.21.15.5:0/146098203 learned_addr learned my addr 172.21.15.5:0/146098203 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:22.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.293+0000 7f436a7fc640 1 -- 172.21.15.5:0/146098203 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2189215827 0 0) 0x7f436c06f900 con 0x7f436c15b7c0 2023-07-14T12:53:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.293+0000 7f436a7fc640 1 -- 172.21.15.5:0/146098203 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4354003530 con 0x7f436c15b7c0 2023-07-14T12:53:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.293+0000 7f436affd640 1 --2- 172.21.15.5:0/146098203 >> v2:172.21.15.154:3300/0 conn(0x7f436c0cb780 0x7f436c0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.293+0000 7f436a7fc640 1 -- 172.21.15.5:0/146098203 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 878357833 0 0) 0x7f4354003530 con 0x7f436c15b7c0 2023-07-14T12:53:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.293+0000 7f436a7fc640 1 -- 172.21.15.5:0/146098203 >> v2:172.21.15.154:3300/0 conn(0x7f436c0cb780 msgr2=0x7f436c0cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.293+0000 7f436a7fc640 1 --2- 172.21.15.5:0/146098203 >> v2:172.21.15.154:3300/0 conn(0x7f436c0cb780 0x7f436c0cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:22.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.293+0000 7f436a7fc640 1 -- 172.21.15.5:0/146098203 >> v1:172.21.15.154:6789/0 conn(0x7f436c06b8f0 legacy=0x7f436c0cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:22.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.293+0000 7f436a7fc640 1 -- 172.21.15.5:0/146098203 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436c0cd720 con 0x7f436c15b7c0 2023-07-14T12:53:22.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.293+0000 7f436a7fc640 1 -- 172.21.15.5:0/146098203 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f435c001680 con 0x7f436c15b7c0 2023-07-14T12:53:22.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.293+0000 7f436a7fc640 1 -- 172.21.15.5:0/146098203 >> v1:172.21.15.5:6789/0 conn(0x7f436c15b7c0 legacy=0x7f436c06b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:22.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.293+0000 7f436a7fc640 1 --2- 172.21.15.5:0/146098203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4354003980 0x7f4354003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:22.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.293+0000 7f436a7fc640 1 --2- 172.21.15.5:0/146098203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43540047d0 0x7f4354004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:22.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.293+0000 7f436a7fc640 1 --2- 172.21.15.5:0/146098203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4354005180 0x7f435400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:22.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.293+0000 7f436a7fc640 1 -- 172.21.15.5:0/146098203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436c0cdce0 con 0x7f4354005180 2023-07-14T12:53:22.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.293+0000 7f436a7fc640 1 -- 172.21.15.5:0/146098203 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435400e2a0 con 0x7f43540047d0 2023-07-14T12:53:22.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.293+0000 7f436a7fc640 1 -- 172.21.15.5:0/146098203 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435400e460 con 0x7f4354003980 2023-07-14T12:53:22.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.293+0000 7f436bfff640 1 --2- 172.21.15.5:0/146098203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4354005180 0x7f435400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:22.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.293+0000 7f436affd640 1 --2- 172.21.15.5:0/146098203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43540047d0 0x7f4354004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:22.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.293+0000 7f436b7fe640 1 --2- 172.21.15.5:0/146098203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4354003980 0x7f4354003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:22.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.293+0000 7f436bfff640 1 -- 172.21.15.5:0/146098203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4354003980 msgr2=0x7f4354003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:22.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.293+0000 7f436bfff640 1 --2- 172.21.15.5:0/146098203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4354003980 0x7f4354003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:22.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.293+0000 7f436bfff640 1 -- 172.21.15.5:0/146098203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43540047d0 msgr2=0x7f4354004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:22.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.293+0000 7f436bfff640 1 --2- 172.21.15.5:0/146098203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43540047d0 0x7f4354004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:22.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.293+0000 7f436bfff640 1 -- 172.21.15.5:0/146098203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4354003530 con 0x7f4354005180 2023-07-14T12:53:22.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.293+0000 7f436b7fe640 1 --2- 172.21.15.5:0/146098203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4354003980 0x7f4354003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:22.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.293+0000 7f436bfff640 1 -- 172.21.15.5:0/146098203 reap_dead start 2023-07-14T12:53:22.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.297+0000 7f436bfff640 1 --2- 172.21.15.5:0/146098203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4354005180 0x7f435400dba0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f43640044b0 tx=0x7f436401c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2014761fbe9824a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:22.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.297+0000 7f436a7fc640 1 -- 172.21.15.5:0/146098203 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43640a9680 con 0x7f4354005180 2023-07-14T12:53:22.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.297+0000 7f436a7fc640 1 -- 172.21.15.5:0/146098203 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43640a9800 con 0x7f4354005180 2023-07-14T12:53:22.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.297+0000 7f436a7fc640 1 -- 172.21.15.5:0/146098203 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43640a9bb0 con 0x7f4354005180 2023-07-14T12:53:22.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.297+0000 7f4371ffa640 1 -- 172.21.15.5:0/146098203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4354005180 msgr2=0x7f435400dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:22.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.297+0000 7f4371ffa640 1 --2- 172.21.15.5:0/146098203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4354005180 0x7f435400dba0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f43640044b0 tx=0x7f436401c680 comp rx=0 tx=0).stop 2023-07-14T12:53:22.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.297+0000 7f4371ffa640 1 -- 172.21.15.5:0/146098203 shutdown_connections 2023-07-14T12:53:22.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.297+0000 7f4371ffa640 1 --2- 172.21.15.5:0/146098203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4354005180 0x7f435400dba0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:22.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.297+0000 7f4371ffa640 1 -- 172.21.15.5:0/146098203 >> 172.21.15.5:0/146098203 conn(0x7f436c0afcf0 msgr2=0x7f436c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:22.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.297+0000 7f4371ffa640 1 -- 172.21.15.5:0/146098203 shutdown_connections 2023-07-14T12:53:22.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.297+0000 7f4371ffa640 1 -- 172.21.15.5:0/146098203 wait complete. 2023-07-14T12:53:22.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.297+0000 7f4371ffa640 1 Processor -- start 2023-07-14T12:53:22.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.297+0000 7f4371ffa640 1 -- start start 2023-07-14T12:53:22.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.297+0000 7f4371ffa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4354005180 0x7f436c154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:22.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.297+0000 7f4371ffa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f436c0b1e30 0x7f436c0c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:22.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.297+0000 7f4371ffa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f436c0c4800 0x7f436c0c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:22.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.297+0000 7f4371ffa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436c1549d0 con 0x7f436c0c4800 2023-07-14T12:53:22.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.297+0000 7f4371ffa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436c0c67e0 con 0x7f436c0b1e30 2023-07-14T12:53:22.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.297+0000 7f4371ffa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436c0c2480 con 0x7f4354005180 2023-07-14T12:53:22.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.301+0000 7f436bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f436c0c4800 0x7f436c0c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:22.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.301+0000 7f436bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f436c0c4800 0x7f436c0c72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42026/0 (socket says 172.21.15.5:42026) 2023-07-14T12:53:22.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.301+0000 7f436bfff640 1 -- 172.21.15.5:0/1450667993 learned_addr learned my addr 172.21.15.5:0/1450667993 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:22.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.301+0000 7f436affd640 1 --2- 172.21.15.5:0/1450667993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f436c0b1e30 0x7f436c0c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:22.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.301+0000 7f436b7fe640 1 --2- 172.21.15.5:0/1450667993 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4354005180 0x7f436c154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:22.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.301+0000 7f436bfff640 1 -- 172.21.15.5:0/1450667993 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4354005180 msgr2=0x7f436c154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:22.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.301+0000 7f436bfff640 1 --2- 172.21.15.5:0/1450667993 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4354005180 0x7f436c154490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:22.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.301+0000 7f436bfff640 1 -- 172.21.15.5:0/1450667993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f436c0b1e30 msgr2=0x7f436c0c5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:22.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.301+0000 7f436bfff640 1 --2- 172.21.15.5:0/1450667993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f436c0b1e30 0x7f436c0c5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:22.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.301+0000 7f436bfff640 1 -- 172.21.15.5:0/1450667993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436c0c6500 con 0x7f436c0c4800 2023-07-14T12:53:22.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.301+0000 7f436bfff640 1 --2- 172.21.15.5:0/1450667993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f436c0c4800 0x7f436c0c72d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f436400a030 tx=0x7f4354005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:22.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.301+0000 7f4353fff640 1 -- 172.21.15.5:0/1450667993 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43640b4470 con 0x7f436c0c4800 2023-07-14T12:53:22.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.301+0000 7f4353fff640 1 -- 172.21.15.5:0/1450667993 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43640b45d0 con 0x7f436c0c4800 2023-07-14T12:53:22.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.301+0000 7f4353fff640 1 -- 172.21.15.5:0/1450667993 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43640b4960 con 0x7f436c0c4800 2023-07-14T12:53:22.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.301+0000 7f4371ffa640 1 -- 172.21.15.5:0/1450667993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f436c0c1e30 con 0x7f436c0c4800 2023-07-14T12:53:22.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.301+0000 7f4371ffa640 1 -- 172.21.15.5:0/1450667993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f436c0c6180 con 0x7f436c0c4800 2023-07-14T12:53:22.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.301+0000 7f4371ffa640 1 -- 172.21.15.5:0/1450667993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f436c0c1c90 con 0x7f436c0c4800 2023-07-14T12:53:22.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.301+0000 7f4353fff640 1 -- 172.21.15.5:0/1450667993 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f43640b4ac0 con 0x7f436c0c4800 2023-07-14T12:53:22.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.305+0000 7f4353fff640 1 --2- 172.21.15.5:0/1450667993 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f43580662b0 0x7f4358068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:22.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.305+0000 7f4353fff640 1 -- 172.21.15.5:0/1450667993 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f436411eac0 con 0x7f436c0c4800 2023-07-14T12:53:22.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.305+0000 7f436b7fe640 1 --2- 172.21.15.5:0/1450667993 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f43580662b0 0x7f4358068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:22.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.305+0000 7f436b7fe640 1 --2- 172.21.15.5:0/1450667993 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f43580662b0 0x7f4358068760 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f435c000c10 tx=0x7f435c007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:22.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.309+0000 7f4353fff640 1 -- 172.21.15.5:0/1450667993 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f436c0c1c90 con 0x7f436c0c4800 2023-07-14T12:53:22.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.473+0000 7f4371ffa640 1 -- 172.21.15.5:0/1450667993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f436c06f570 con 0x7f436c0c4800 2023-07-14T12:53:22.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.473+0000 7f4353fff640 1 -- 172.21.15.5:0/1450667993 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f436c06f570 con 0x7f436c0c4800 2023-07-14T12:53:22.502 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-07-14T12:53:22.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.477+0000 7f4371ffa640 1 -- 172.21.15.5:0/1450667993 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f43580662b0 msgr2=0x7f4358068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:22.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.477+0000 7f4371ffa640 1 --2- 172.21.15.5:0/1450667993 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f43580662b0 0x7f4358068760 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f435c000c10 tx=0x7f435c007040 comp rx=0 tx=0).stop 2023-07-14T12:53:22.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.477+0000 7f4371ffa640 1 -- 172.21.15.5:0/1450667993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f436c0c4800 msgr2=0x7f436c0c72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:22.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.477+0000 7f4371ffa640 1 --2- 172.21.15.5:0/1450667993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f436c0c4800 0x7f436c0c72d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f436400a030 tx=0x7f4354005800 comp rx=0 tx=0).stop 2023-07-14T12:53:22.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.477+0000 7f4371ffa640 1 -- 172.21.15.5:0/1450667993 shutdown_connections 2023-07-14T12:53:22.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.477+0000 7f4371ffa640 1 --2- 172.21.15.5:0/1450667993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f436c0c4800 0x7f436c0c72d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:22.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.477+0000 7f4371ffa640 1 --2- 172.21.15.5:0/1450667993 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f43580662b0 0x7f4358068760 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:22.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.477+0000 7f4371ffa640 1 --2- 172.21.15.5:0/1450667993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f436c0b1e30 0x7f436c0c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:22.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.477+0000 7f4371ffa640 1 --2- 172.21.15.5:0/1450667993 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4354005180 0x7f436c154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:22.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.477+0000 7f4371ffa640 1 -- 172.21.15.5:0/1450667993 >> 172.21.15.5:0/1450667993 conn(0x7f436c0afcf0 msgr2=0x7f436c0ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:22.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.477+0000 7f4371ffa640 1 -- 172.21.15.5:0/1450667993 shutdown_connections 2023-07-14T12:53:22.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.477+0000 7f4371ffa640 1 -- 172.21.15.5:0/1450667993 wait complete. 2023-07-14T12:53:22.523 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-14T12:53:22.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:22.524 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-07-14T12:53:22.602 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2023-07-14T12:53:22.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:22.603 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-14T12:53:22.616 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:53:22.616 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T12:53:22.625 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:53:22.626 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T12:53:22.679 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:53:22.679 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T12:53:22.731 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:53:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.889+0000 7f96b6b03640 1 Processor -- start 2023-07-14T12:53:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.889+0000 7f96b6b03640 1 -- start start 2023-07-14T12:53:22.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.893+0000 7f96b6b03640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f96b00c8ad0 0x7f96b00c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:22.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.893+0000 7f96b6b03640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b00c99c0 con 0x7f96b00c9560 2023-07-14T12:53:22.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.893+0000 7f96b6b03640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b00cc700 con 0x7f96b0158ce0 2023-07-14T12:53:22.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.893+0000 7f96b6b03640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b00b0ff0 con 0x7f96b00c8ad0 2023-07-14T12:53:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.893+0000 7f96affff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f96b00c8ad0 0x7f96b00c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.893+0000 7f96b50a0640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f96b00c9560 0x7f96b00ccb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47138/0 (socket says 172.21.15.5:47138) 2023-07-14T12:53:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.893+0000 7f96b50a0640 1 -- 172.21.15.5:0/3715707235 learned_addr learned my addr 172.21.15.5:0/3715707235 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.893+0000 7f96affff640 1 -- 172.21.15.5:0/3715707235 >> v1:172.21.15.154:6789/0 conn(0x7f96b0158ce0 legacy=0x7f96b0070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:22.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.893+0000 7f96affff640 1 -- 172.21.15.5:0/3715707235 >> v1:172.21.15.5:6789/0 conn(0x7f96b00c9560 legacy=0x7f96b00ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:22.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.893+0000 7f96affff640 1 -- 172.21.15.5:0/3715707235 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b0070c80 con 0x7f96b00c8ad0 2023-07-14T12:53:22.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.893+0000 7f96af7fe640 1 -- 172.21.15.5:0/3715707235 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945254299 0 0) 0x7f96b00c99c0 con 0x7f96b00c9560 2023-07-14T12:53:22.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.893+0000 7f96affff640 1 --2- 172.21.15.5:0/3715707235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96b00c8ad0 0x7f96b00c9020 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f969c0097c0 tx=0x7f969c01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e752f7a852ebcd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:22.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.893+0000 7f96af7fe640 1 -- 172.21.15.5:0/3715707235 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c0ab600 con 0x7f96b00c8ad0 2023-07-14T12:53:22.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.893+0000 7f96af7fe640 1 -- 172.21.15.5:0/3715707235 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969c0a7050 con 0x7f96b00c8ad0 2023-07-14T12:53:22.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.897+0000 7f96af7fe640 1 -- 172.21.15.5:0/3715707235 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c0ab980 con 0x7f96b00c8ad0 2023-07-14T12:53:22.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.897+0000 7f96b6b03640 1 -- 172.21.15.5:0/3715707235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96b00c8ad0 msgr2=0x7f96b00c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:22.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.897+0000 7f96b6b03640 1 --2- 172.21.15.5:0/3715707235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96b00c8ad0 0x7f96b00c9020 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f969c0097c0 tx=0x7f969c01c330 comp rx=0 tx=0).stop 2023-07-14T12:53:22.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.897+0000 7f96b6b03640 1 -- 172.21.15.5:0/3715707235 shutdown_connections 2023-07-14T12:53:22.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.897+0000 7f96b6b03640 1 --2- 172.21.15.5:0/3715707235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96b00c8ad0 0x7f96b00c9020 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:22.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.897+0000 7f96b6b03640 1 -- 172.21.15.5:0/3715707235 >> 172.21.15.5:0/3715707235 conn(0x7f96b00afcf0 msgr2=0x7f96b00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:22.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.897+0000 7f96b6b03640 1 -- 172.21.15.5:0/3715707235 shutdown_connections 2023-07-14T12:53:22.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.897+0000 7f96b6b03640 1 -- 172.21.15.5:0/3715707235 wait complete. 2023-07-14T12:53:22.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.897+0000 7f96b6b03640 1 Processor -- start 2023-07-14T12:53:22.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.897+0000 7f96b6b03640 1 -- start start 2023-07-14T12:53:22.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.897+0000 7f96b6b03640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96b00c8ad0 0x7f96b00c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:22.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.897+0000 7f96b6b03640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96b00c9560 0x7f96b00ada20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:22.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.897+0000 7f96b6b03640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96b0158ce0 0x7f96b00c0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:22.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.897+0000 7f96b6b03640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b01501a0 con 0x7f96b00c9560 2023-07-14T12:53:22.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.897+0000 7f96b6b03640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b00adf60 con 0x7f96b0158ce0 2023-07-14T12:53:22.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.897+0000 7f96b6b03640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b00aeda0 con 0x7f96b00c8ad0 2023-07-14T12:53:22.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.897+0000 7f96affff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96b00c9560 0x7f96b00ada20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:22.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.897+0000 7f96affff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96b00c9560 0x7f96b00ada20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42054/0 (socket says 172.21.15.5:42054) 2023-07-14T12:53:22.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.897+0000 7f96affff640 1 -- 172.21.15.5:0/992502003 learned_addr learned my addr 172.21.15.5:0/992502003 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:22.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.901+0000 7f96affff640 1 -- 172.21.15.5:0/992502003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96b00c8ad0 msgr2=0x7f96b00c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:22.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.901+0000 7f96b50a0640 1 --2- 172.21.15.5:0/992502003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96b0158ce0 0x7f96b00c0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:22.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.901+0000 7f96b489f640 1 --2- 172.21.15.5:0/992502003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96b00c8ad0 0x7f96b00c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:22.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.901+0000 7f96affff640 1 --2- 172.21.15.5:0/992502003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96b00c8ad0 0x7f96b00c79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:22.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.901+0000 7f96affff640 1 -- 172.21.15.5:0/992502003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96b0158ce0 msgr2=0x7f96b00c0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:22.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.901+0000 7f96affff640 1 --2- 172.21.15.5:0/992502003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96b0158ce0 0x7f96b00c0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:22.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.901+0000 7f96affff640 1 -- 172.21.15.5:0/992502003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969c009420 con 0x7f96b00c9560 2023-07-14T12:53:22.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.901+0000 7f96b50a0640 1 --2- 172.21.15.5:0/992502003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96b0158ce0 0x7f96b00c0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:22.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.901+0000 7f96b489f640 1 --2- 172.21.15.5:0/992502003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96b00c8ad0 0x7f96b00c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:22.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.901+0000 7f96affff640 1 --2- 172.21.15.5:0/992502003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96b00c9560 0x7f96b00ada20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f969c0097c0 tx=0x7f969c0190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:22.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.901+0000 7f96ad7fa640 1 -- 172.21.15.5:0/992502003 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c0b4610 con 0x7f96b00c9560 2023-07-14T12:53:22.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.901+0000 7f96ad7fa640 1 -- 172.21.15.5:0/992502003 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969c0b4790 con 0x7f96b00c9560 2023-07-14T12:53:22.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.901+0000 7f96b6b03640 1 -- 172.21.15.5:0/992502003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b00c1510 con 0x7f96b00c9560 2023-07-14T12:53:22.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.901+0000 7f96ad7fa640 1 -- 172.21.15.5:0/992502003 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c0b4b40 con 0x7f96b00c9560 2023-07-14T12:53:22.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.901+0000 7f96b6b03640 1 -- 172.21.15.5:0/992502003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b00ae470 con 0x7f96b00c9560 2023-07-14T12:53:22.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.901+0000 7f96b6b03640 1 -- 172.21.15.5:0/992502003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b00ca1a0 con 0x7f96b00c9560 2023-07-14T12:53:22.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.901+0000 7f96ad7fa640 1 -- 172.21.15.5:0/992502003 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f969c0b2040 con 0x7f96b00c9560 2023-07-14T12:53:22.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.905+0000 7f96ad7fa640 1 --2- 172.21.15.5:0/992502003 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9694066280 0x7f9694068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:22.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.905+0000 7f96ad7fa640 1 -- 172.21.15.5:0/992502003 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f969c11df10 con 0x7f96b00c9560 2023-07-14T12:53:22.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.905+0000 7f96b489f640 1 --2- 172.21.15.5:0/992502003 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9694066280 0x7f9694068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:22.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.905+0000 7f96b489f640 1 --2- 172.21.15.5:0/992502003 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9694066280 0x7f9694068730 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f96a4000f70 tx=0x7f96a4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:22.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:22.909+0000 7f96ad7fa640 1 -- 172.21.15.5:0/992502003 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f969c0eb370 con 0x7f96b00c9560 2023-07-14T12:53:23.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.065+0000 7f96b6b03640 1 -- 172.21.15.5:0/992502003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96b00678d0 con 0x7f96b00c9560 2023-07-14T12:53:23.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.065+0000 7f96ad7fa640 1 -- 172.21.15.5:0/992502003 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18231 (secure 0 0 0) 0x7f969c0c2090 con 0x7f96b00c9560 2023-07-14T12:53:23.093 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:23.093 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":23,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:52:48.091483+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:52:44.223082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T12:52:45.469396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:53:23.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.065+0000 7f96b6b03640 1 -- 172.21.15.5:0/992502003 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9694066280 msgr2=0x7f9694068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:23.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.065+0000 7f96b6b03640 1 --2- 172.21.15.5:0/992502003 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9694066280 0x7f9694068730 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f96a4000f70 tx=0x7f96a4009040 comp rx=0 tx=0).stop 2023-07-14T12:53:23.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.065+0000 7f96b6b03640 1 -- 172.21.15.5:0/992502003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96b00c9560 msgr2=0x7f96b00ada20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:23.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.065+0000 7f96b6b03640 1 --2- 172.21.15.5:0/992502003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96b00c9560 0x7f96b00ada20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f969c0097c0 tx=0x7f969c0190d0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.069+0000 7f96b6b03640 1 -- 172.21.15.5:0/992502003 shutdown_connections 2023-07-14T12:53:23.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.069+0000 7f96b6b03640 1 --2- 172.21.15.5:0/992502003 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9694066280 0x7f9694068730 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.069+0000 7f96b6b03640 1 --2- 172.21.15.5:0/992502003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96b0158ce0 0x7f96b00c0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.069+0000 7f96b6b03640 1 --2- 172.21.15.5:0/992502003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96b00c9560 0x7f96b00ada20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.069+0000 7f96b6b03640 1 --2- 172.21.15.5:0/992502003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96b00c8ad0 0x7f96b00c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.069+0000 7f96b6b03640 1 -- 172.21.15.5:0/992502003 >> 172.21.15.5:0/992502003 conn(0x7f96b00afcf0 msgr2=0x7f96b006ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:23.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.069+0000 7f96b6b03640 1 -- 172.21.15.5:0/992502003 shutdown_connections 2023-07-14T12:53:23.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.069+0000 7f96b6b03640 1 -- 172.21.15.5:0/992502003 wait complete. 2023-07-14T12:53:23.115 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T12:52:44.223082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T12:52:45.469396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T12:53:23.116 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T12:53:23.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.233+0000 7f5baceaf640 1 Processor -- start 2023-07-14T12:53:23.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.233+0000 7f5baceaf640 1 -- start start 2023-07-14T12:53:23.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.237+0000 7f5baceaf640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5ba80cc960 0x7f5ba80ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:23.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.237+0000 7f5baceaf640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ba80b1620 0x7f5ba80ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:23.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.237+0000 7f5baceaf640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ba8160750 0x7f5ba80b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:23.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.237+0000 7f5baceaf640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba80cf710 con 0x7f5ba80b1620 2023-07-14T12:53:23.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.237+0000 7f5baceaf640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba80cd270 con 0x7f5ba80cc960 2023-07-14T12:53:23.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.237+0000 7f5baceaf640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba80cf430 con 0x7f5ba8160750 2023-07-14T12:53:23.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.237+0000 7f5ba6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ba80b1620 0x7f5ba80ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:23.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.237+0000 7f5ba6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ba80b1620 0x7f5ba80ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42068/0 (socket says 172.21.15.5:42068) 2023-07-14T12:53:23.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.237+0000 7f5ba6ffd640 1 -- 172.21.15.5:0/1993898932 learned_addr learned my addr 172.21.15.5:0/1993898932 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.237+0000 7f5ba77fe640 1 --2- 172.21.15.5:0/1993898932 >> v2:172.21.15.154:3300/0 conn(0x7f5ba80cc960 0x7f5ba80ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.237+0000 7f5ba7fff640 1 --2- 172.21.15.5:0/1993898932 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ba8160750 0x7f5ba80b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.237+0000 7f5ba6ffd640 1 -- 172.21.15.5:0/1993898932 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ba8160750 msgr2=0x7f5ba80b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:23.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.237+0000 7f5ba6ffd640 1 --2- 172.21.15.5:0/1993898932 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ba8160750 0x7f5ba80b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.237+0000 7f5ba6ffd640 1 -- 172.21.15.5:0/1993898932 >> v2:172.21.15.154:3300/0 conn(0x7f5ba80cc960 msgr2=0x7f5ba80ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:23.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.237+0000 7f5ba6ffd640 1 --2- 172.21.15.5:0/1993898932 >> v2:172.21.15.154:3300/0 conn(0x7f5ba80cc960 0x7f5ba80ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.237+0000 7f5ba6ffd640 1 -- 172.21.15.5:0/1993898932 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba815fc70 con 0x7f5ba80b1620 2023-07-14T12:53:23.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.241+0000 7f5ba6ffd640 1 --2- 172.21.15.5:0/1993898932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba80b1620 0x7f5ba80ce950 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5ba80cc930 tx=0x7f5b9c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b905465f2e8c0115 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:23.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.241+0000 7f5ba67fc640 1 -- 172.21.15.5:0/1993898932 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c0aa5f0 con 0x7f5ba80b1620 2023-07-14T12:53:23.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.241+0000 7f5ba67fc640 1 -- 172.21.15.5:0/1993898932 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9c0aa750 con 0x7f5ba80b1620 2023-07-14T12:53:23.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.241+0000 7f5ba67fc640 1 -- 172.21.15.5:0/1993898932 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c0aaae0 con 0x7f5ba80b1620 2023-07-14T12:53:23.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.241+0000 7f5baceaf640 1 -- 172.21.15.5:0/1993898932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba80b1620 msgr2=0x7f5ba80ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:23.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.241+0000 7f5baceaf640 1 --2- 172.21.15.5:0/1993898932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba80b1620 0x7f5ba80ce950 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5ba80cc930 tx=0x7f5b9c01c4d0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.241+0000 7f5baceaf640 1 -- 172.21.15.5:0/1993898932 shutdown_connections 2023-07-14T12:53:23.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.241+0000 7f5baceaf640 1 --2- 172.21.15.5:0/1993898932 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ba8160750 0x7f5ba80b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.241+0000 7f5baceaf640 1 --2- 172.21.15.5:0/1993898932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba80b1620 0x7f5ba80ce950 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.241+0000 7f5baceaf640 1 --2- 172.21.15.5:0/1993898932 >> v2:172.21.15.154:3300/0 conn(0x7f5ba80cc960 0x7f5ba80ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.241+0000 7f5baceaf640 1 -- 172.21.15.5:0/1993898932 >> 172.21.15.5:0/1993898932 conn(0x7f5ba8069f50 msgr2=0x7f5ba806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:23.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.241+0000 7f5baceaf640 1 -- 172.21.15.5:0/1993898932 shutdown_connections 2023-07-14T12:53:23.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.241+0000 7f5baceaf640 1 -- 172.21.15.5:0/1993898932 wait complete. 2023-07-14T12:53:23.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.241+0000 7f5baceaf640 1 Processor -- start 2023-07-14T12:53:23.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.241+0000 7f5baceaf640 1 -- start start 2023-07-14T12:53:23.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.245+0000 7f5baceaf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba80b1620 0x7f5ba8154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:23.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.245+0000 7f5baceaf640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ba80cc960 0x7f5ba81557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:23.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.245+0000 7f5baceaf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ba8160750 0x7f5ba81566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:23.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.245+0000 7f5baceaf640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba81532e0 con 0x7f5ba80b1620 2023-07-14T12:53:23.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.245+0000 7f5baceaf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba81535c0 con 0x7f5ba8160750 2023-07-14T12:53:23.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.245+0000 7f5baceaf640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba81538a0 con 0x7f5ba80cc960 2023-07-14T12:53:23.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.245+0000 7f5ba77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba80b1620 0x7f5ba8154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:23.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.245+0000 7f5ba77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba80b1620 0x7f5ba8154f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42072/0 (socket says 172.21.15.5:42072) 2023-07-14T12:53:23.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.245+0000 7f5ba77fe640 1 -- 172.21.15.5:0/3492955402 learned_addr learned my addr 172.21.15.5:0/3492955402 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:23.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.245+0000 7f5ba7fff640 1 --2- 172.21.15.5:0/3492955402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ba8160750 0x7f5ba81566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:23.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.245+0000 7f5ba6ffd640 1 --2- 172.21.15.5:0/3492955402 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ba80cc960 0x7f5ba81557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:23.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.245+0000 7f5ba77fe640 1 -- 172.21.15.5:0/3492955402 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ba80cc960 msgr2=0x7f5ba81557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:23.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.245+0000 7f5ba77fe640 1 --2- 172.21.15.5:0/3492955402 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ba80cc960 0x7f5ba81557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.245+0000 7f5ba77fe640 1 -- 172.21.15.5:0/3492955402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ba8160750 msgr2=0x7f5ba81566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:23.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.245+0000 7f5ba77fe640 1 --2- 172.21.15.5:0/3492955402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ba8160750 0x7f5ba81566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.245+0000 7f5ba77fe640 1 -- 172.21.15.5:0/3492955402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9c0094d0 con 0x7f5ba80b1620 2023-07-14T12:53:23.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.245+0000 7f5ba77fe640 1 --2- 172.21.15.5:0/3492955402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba80b1620 0x7f5ba8154f70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5b9800d800 tx=0x7f5b9800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:23.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.245+0000 7f5b8ffff640 1 -- 172.21.15.5:0/3492955402 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9800b6c0 con 0x7f5ba80b1620 2023-07-14T12:53:23.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.245+0000 7f5b8ffff640 1 -- 172.21.15.5:0/3492955402 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9800b820 con 0x7f5ba80b1620 2023-07-14T12:53:23.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.245+0000 7f5baceaf640 1 -- 172.21.15.5:0/3492955402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba8153b80 con 0x7f5ba80b1620 2023-07-14T12:53:23.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.245+0000 7f5b8ffff640 1 -- 172.21.15.5:0/3492955402 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9800bb90 con 0x7f5ba80b1620 2023-07-14T12:53:23.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.245+0000 7f5baceaf640 1 -- 172.21.15.5:0/3492955402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba815a910 con 0x7f5ba80b1620 2023-07-14T12:53:23.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.245+0000 7f5baceaf640 1 -- 172.21.15.5:0/3492955402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba804e020 con 0x7f5ba80b1620 2023-07-14T12:53:23.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.245+0000 7f5b8ffff640 1 -- 172.21.15.5:0/3492955402 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5b9800bcf0 con 0x7f5ba80b1620 2023-07-14T12:53:23.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.249+0000 7f5b8ffff640 1 --2- 172.21.15.5:0/3492955402 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5b94066280 0x7f5b94068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:23.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.249+0000 7f5b8ffff640 1 -- 172.21.15.5:0/3492955402 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5b98084250 con 0x7f5ba80b1620 2023-07-14T12:53:23.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.249+0000 7f5ba6ffd640 1 --2- 172.21.15.5:0/3492955402 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5b94066280 0x7f5b94068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:23.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.249+0000 7f5ba6ffd640 1 --2- 172.21.15.5:0/3492955402 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5b94066280 0x7f5b94068730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c0ae000 tx=0x7f5b9c0b5040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:23.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.253+0000 7f5b8ffff640 1 -- 172.21.15.5:0/3492955402 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f5b98055170 con 0x7f5ba80b1620 2023-07-14T12:53:23.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.405+0000 7f5baceaf640 1 -- 172.21.15.5:0/3492955402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ba80cfad0 con 0x7f5ba80b1620 2023-07-14T12:53:23.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.405+0000 7f5b8ffff640 1 -- 172.21.15.5:0/3492955402 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5b98054d00 con 0x7f5ba80b1620 2023-07-14T12:53:23.435 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T12:53:23.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.409+0000 7f5baceaf640 1 -- 172.21.15.5:0/3492955402 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5b94066280 msgr2=0x7f5b94068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:23.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.409+0000 7f5baceaf640 1 --2- 172.21.15.5:0/3492955402 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5b94066280 0x7f5b94068730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c0ae000 tx=0x7f5b9c0b5040 comp rx=0 tx=0).stop 2023-07-14T12:53:23.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.409+0000 7f5baceaf640 1 -- 172.21.15.5:0/3492955402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba80b1620 msgr2=0x7f5ba8154f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:23.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.409+0000 7f5baceaf640 1 --2- 172.21.15.5:0/3492955402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba80b1620 0x7f5ba8154f70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5b9800d800 tx=0x7f5b9800dcc0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.409+0000 7f5baceaf640 1 -- 172.21.15.5:0/3492955402 shutdown_connections 2023-07-14T12:53:23.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.409+0000 7f5baceaf640 1 --2- 172.21.15.5:0/3492955402 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5b94066280 0x7f5b94068730 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.409+0000 7f5baceaf640 1 --2- 172.21.15.5:0/3492955402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ba8160750 0x7f5ba81566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.409+0000 7f5baceaf640 1 --2- 172.21.15.5:0/3492955402 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ba80cc960 0x7f5ba81557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.409+0000 7f5baceaf640 1 --2- 172.21.15.5:0/3492955402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba80b1620 0x7f5ba8154f70 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.409+0000 7f5baceaf640 1 -- 172.21.15.5:0/3492955402 >> 172.21.15.5:0/3492955402 conn(0x7f5ba8069f50 msgr2=0x7f5ba80d0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:23.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.409+0000 7f5baceaf640 1 -- 172.21.15.5:0/3492955402 shutdown_connections 2023-07-14T12:53:23.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.409+0000 7f5baceaf640 1 -- 172.21.15.5:0/3492955402 wait complete. 2023-07-14T12:53:23.455 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T12:53:23.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.577+0000 7fb42c09c640 1 Processor -- start 2023-07-14T12:53:23.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.577+0000 7fb42c09c640 1 -- start start 2023-07-14T12:53:23.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.577+0000 7fb42c09c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb424069430 0x7fb424069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:23.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.577+0000 7fb42c09c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb424070f30 0x7fb4240ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:23.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.577+0000 7fb42c09c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb424159d70 con 0x7fb4240af2b0 2023-07-14T12:53:23.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.577+0000 7fb42c09c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb424069d40 con 0x7fb424069430 2023-07-14T12:53:23.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.577+0000 7fb42c09c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4240c9c60 con 0x7fb424070f30 2023-07-14T12:53:23.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.577+0000 7fb429e38640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb424069430 0x7fb424069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:23.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.577+0000 7fb42a639640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb4240af2b0 0x7fb42415a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47144/0 (socket says 172.21.15.5:47144) 2023-07-14T12:53:23.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.577+0000 7fb42a639640 1 -- 172.21.15.5:0/581025004 learned_addr learned my addr 172.21.15.5:0/581025004 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:23.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.577+0000 7fb429637640 1 --2- 172.21.15.5:0/581025004 >> v2:172.21.15.154:3300/0 conn(0x7fb424070f30 0x7fb4240ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:23.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.577+0000 7fb429e38640 1 -- 172.21.15.5:0/581025004 >> v2:172.21.15.154:3300/0 conn(0x7fb424070f30 msgr2=0x7fb4240ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:23.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.577+0000 7fb429e38640 1 --2- 172.21.15.5:0/581025004 >> v2:172.21.15.154:3300/0 conn(0x7fb424070f30 0x7fb4240ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.577+0000 7fb429e38640 1 -- 172.21.15.5:0/581025004 >> v1:172.21.15.5:6789/0 conn(0x7fb4240af2b0 legacy=0x7fb42415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:23.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.577+0000 7fb428e36640 1 -- 172.21.15.5:0/581025004 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2199569561 0 0) 0x7fb41c0014a0 con 0x7fb4240af2b0 2023-07-14T12:53:23.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.577+0000 7fb429e38640 1 -- 172.21.15.5:0/581025004 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4240c9f40 con 0x7fb424069430 2023-07-14T12:53:23.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.581+0000 7fb429e38640 1 --2- 172.21.15.5:0/581025004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb424069430 0x7fb424069800 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb4240c9830 tx=0x7fb42001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=263ca4f615f23ba1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:23.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.581+0000 7fb428e36640 1 -- 172.21.15.5:0/581025004 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4200ab600 con 0x7fb424069430 2023-07-14T12:53:23.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.581+0000 7fb428e36640 1 -- 172.21.15.5:0/581025004 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4200a7050 con 0x7fb424069430 2023-07-14T12:53:23.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.581+0000 7fb428e36640 1 -- 172.21.15.5:0/581025004 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4200ab980 con 0x7fb424069430 2023-07-14T12:53:23.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.581+0000 7fb42c09c640 1 -- 172.21.15.5:0/581025004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb424069430 msgr2=0x7fb424069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:23.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.581+0000 7fb42c09c640 1 --2- 172.21.15.5:0/581025004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb424069430 0x7fb424069800 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb4240c9830 tx=0x7fb42001c460 comp rx=0 tx=0).stop 2023-07-14T12:53:23.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.581+0000 7fb42c09c640 1 -- 172.21.15.5:0/581025004 shutdown_connections 2023-07-14T12:53:23.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.581+0000 7fb42c09c640 1 --2- 172.21.15.5:0/581025004 >> v2:172.21.15.154:3300/0 conn(0x7fb424070f30 0x7fb4240ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.581+0000 7fb42c09c640 1 --2- 172.21.15.5:0/581025004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb424069430 0x7fb424069800 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.581+0000 7fb42c09c640 1 -- 172.21.15.5:0/581025004 >> 172.21.15.5:0/581025004 conn(0x7fb4240cde90 msgr2=0x7fb4240ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:23.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.581+0000 7fb42c09c640 1 -- 172.21.15.5:0/581025004 shutdown_connections 2023-07-14T12:53:23.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.581+0000 7fb42c09c640 1 -- 172.21.15.5:0/581025004 wait complete. 2023-07-14T12:53:23.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.585+0000 7fb42c09c640 1 Processor -- start 2023-07-14T12:53:23.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.585+0000 7fb42c09c640 1 -- start start 2023-07-14T12:53:23.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.585+0000 7fb42c09c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb424069430 0x7fb42413e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:23.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.585+0000 7fb42c09c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb424070f30 0x7fb42406bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:23.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.585+0000 7fb42c09c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4240af2b0 0x7fb42406c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:23.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.585+0000 7fb42c09c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4240b3920 con 0x7fb424070f30 2023-07-14T12:53:23.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.585+0000 7fb42c09c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4240b1980 con 0x7fb424069430 2023-07-14T12:53:23.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.585+0000 7fb42c09c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4240b2d70 con 0x7fb4240af2b0 2023-07-14T12:53:23.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.585+0000 7fb429637640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb424070f30 0x7fb42406bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:23.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.585+0000 7fb429637640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb424070f30 0x7fb42406bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42090/0 (socket says 172.21.15.5:42090) 2023-07-14T12:53:23.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.585+0000 7fb429637640 1 -- 172.21.15.5:0/2327817534 learned_addr learned my addr 172.21.15.5:0/2327817534 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:23.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.585+0000 7fb42a639640 1 --2- 172.21.15.5:0/2327817534 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4240af2b0 0x7fb42406c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:23.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.585+0000 7fb429e38640 1 --2- 172.21.15.5:0/2327817534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb424069430 0x7fb42413e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:23.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.585+0000 7fb429637640 1 -- 172.21.15.5:0/2327817534 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4240af2b0 msgr2=0x7fb42406c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:23.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.585+0000 7fb429637640 1 --2- 172.21.15.5:0/2327817534 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4240af2b0 0x7fb42406c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.585+0000 7fb429637640 1 -- 172.21.15.5:0/2327817534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb424069430 msgr2=0x7fb42413e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:23.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.585+0000 7fb429637640 1 --2- 172.21.15.5:0/2327817534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb424069430 0x7fb42413e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.585+0000 7fb429637640 1 -- 172.21.15.5:0/2327817534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb420009420 con 0x7fb424070f30 2023-07-14T12:53:23.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.585+0000 7fb42a639640 1 --2- 172.21.15.5:0/2327817534 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4240af2b0 0x7fb42406c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:23.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.585+0000 7fb429637640 1 --2- 172.21.15.5:0/2327817534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb424070f30 0x7fb42406bdd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb41400d5f0 tx=0x7fb41400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:23.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.585+0000 7fb41a7fc640 1 -- 172.21.15.5:0/2327817534 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4140125f0 con 0x7fb424070f30 2023-07-14T12:53:23.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.585+0000 7fb41a7fc640 1 -- 172.21.15.5:0/2327817534 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb414012750 con 0x7fb424070f30 2023-07-14T12:53:23.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.585+0000 7fb41a7fc640 1 -- 172.21.15.5:0/2327817534 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb414012ae0 con 0x7fb424070f30 2023-07-14T12:53:23.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.585+0000 7fb42c09c640 1 -- 172.21.15.5:0/2327817534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb42413e9a0 con 0x7fb424070f30 2023-07-14T12:53:23.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.585+0000 7fb42c09c640 1 -- 172.21.15.5:0/2327817534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4240b3260 con 0x7fb424070f30 2023-07-14T12:53:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.585+0000 7fb42c09c640 1 -- 172.21.15.5:0/2327817534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb424141c40 con 0x7fb424070f30 2023-07-14T12:53:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.589+0000 7fb41a7fc640 1 -- 172.21.15.5:0/2327817534 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb414012c40 con 0x7fb424070f30 2023-07-14T12:53:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.589+0000 7fb41a7fc640 1 --2- 172.21.15.5:0/2327817534 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb408066280 0x7fb408068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.589+0000 7fb41a7fc640 1 -- 172.21.15.5:0/2327817534 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb414084270 con 0x7fb424070f30 2023-07-14T12:53:23.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.589+0000 7fb429e38640 1 --2- 172.21.15.5:0/2327817534 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb408066280 0x7fb408068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:23.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.589+0000 7fb429e38640 1 --2- 172.21.15.5:0/2327817534 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb408066280 0x7fb408068730 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb4200ad000 tx=0x7fb4200a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:23.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.593+0000 7fb41a7fc640 1 -- 172.21.15.5:0/2327817534 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb4140516e0 con 0x7fb424070f30 2023-07-14T12:53:23.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.749+0000 7fb42c09c640 1 -- 172.21.15.5:0/2327817534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb4240678d0 con 0x7fb424070f30 2023-07-14T12:53:23.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.749+0000 7fb41a7fc640 1 -- 172.21.15.5:0/2327817534 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb414054d00 con 0x7fb424070f30 2023-07-14T12:53:23.778 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T12:53:23.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.753+0000 7fb42c09c640 1 -- 172.21.15.5:0/2327817534 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb408066280 msgr2=0x7fb408068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:23.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.753+0000 7fb42c09c640 1 --2- 172.21.15.5:0/2327817534 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb408066280 0x7fb408068730 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb4200ad000 tx=0x7fb4200a6000 comp rx=0 tx=0).stop 2023-07-14T12:53:23.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.753+0000 7fb42c09c640 1 -- 172.21.15.5:0/2327817534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb424070f30 msgr2=0x7fb42406bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:23.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.753+0000 7fb42c09c640 1 --2- 172.21.15.5:0/2327817534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb424070f30 0x7fb42406bdd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb41400d5f0 tx=0x7fb41400dab0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.753+0000 7fb42c09c640 1 -- 172.21.15.5:0/2327817534 shutdown_connections 2023-07-14T12:53:23.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.753+0000 7fb42c09c640 1 --2- 172.21.15.5:0/2327817534 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4240af2b0 0x7fb42406c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.753+0000 7fb42c09c640 1 --2- 172.21.15.5:0/2327817534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb424070f30 0x7fb42406bdd0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.753+0000 7fb42c09c640 1 --2- 172.21.15.5:0/2327817534 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb408066280 0x7fb408068730 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.753+0000 7fb42c09c640 1 --2- 172.21.15.5:0/2327817534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb424069430 0x7fb42413e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.753+0000 7fb42c09c640 1 -- 172.21.15.5:0/2327817534 >> 172.21.15.5:0/2327817534 conn(0x7fb4240cde90 msgr2=0x7fb42415a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:23.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.753+0000 7fb42c09c640 1 -- 172.21.15.5:0/2327817534 shutdown_connections 2023-07-14T12:53:23.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.753+0000 7fb42c09c640 1 -- 172.21.15.5:0/2327817534 wait complete. 2023-07-14T12:53:23.799 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T12:53:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.917+0000 7f19064cb640 1 Processor -- start 2023-07-14T12:53:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.917+0000 7f19064cb640 1 -- start start 2023-07-14T12:53:23.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f19064cb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f190015cef0 0x7f1900158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:23.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f19064cb640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19001532b0 con 0x7f1900159270 2023-07-14T12:53:23.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f19064cb640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19000ca6f0 con 0x7f19000aeb40 2023-07-14T12:53:23.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f19064cb640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f190015d360 con 0x7f190015cef0 2023-07-14T12:53:23.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f1904a68640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1900159270 0x7f19000c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47160/0 (socket says 172.21.15.5:47160) 2023-07-14T12:53:23.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f1904a68640 1 -- 172.21.15.5:0/1984273312 learned_addr learned my addr 172.21.15.5:0/1984273312 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:23.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f18ff7fe640 1 --2- 172.21.15.5:0/1984273312 >> v2:172.21.15.154:3300/0 conn(0x7f190015cef0 0x7f1900158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:23.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f18feffd640 1 -- 172.21.15.5:0/1984273312 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 6702585 0 0) 0x7f19001532b0 con 0x7f1900159270 2023-07-14T12:53:23.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f18feffd640 1 -- 172.21.15.5:0/1984273312 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18e8003530 con 0x7f1900159270 2023-07-14T12:53:23.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f18feffd640 1 -- 172.21.15.5:0/1984273312 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1955699707 0 0) 0x7f19000ca6f0 con 0x7f19000aeb40 2023-07-14T12:53:23.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f18feffd640 1 -- 172.21.15.5:0/1984273312 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19001532b0 con 0x7f19000aeb40 2023-07-14T12:53:23.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f18feffd640 1 -- 172.21.15.5:0/1984273312 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 696576283 0 0) 0x7f18e8003530 con 0x7f1900159270 2023-07-14T12:53:23.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f18feffd640 1 -- 172.21.15.5:0/1984273312 >> v2:172.21.15.154:3300/0 conn(0x7f190015cef0 msgr2=0x7f1900158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:23.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f18feffd640 1 --2- 172.21.15.5:0/1984273312 >> v2:172.21.15.154:3300/0 conn(0x7f190015cef0 0x7f1900158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f18feffd640 1 -- 172.21.15.5:0/1984273312 >> v1:172.21.15.154:6789/0 conn(0x7f19000aeb40 legacy=0x7f19000aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:23.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f18feffd640 1 -- 172.21.15.5:0/1984273312 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19001599d0 con 0x7f1900159270 2023-07-14T12:53:23.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f18feffd640 1 -- 172.21.15.5:0/1984273312 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f18f8001a00 con 0x7f1900159270 2023-07-14T12:53:23.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f18feffd640 1 -- 172.21.15.5:0/1984273312 >> v1:172.21.15.5:6789/0 conn(0x7f1900159270 legacy=0x7f19000c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:23.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f18feffd640 1 --2- 172.21.15.5:0/1984273312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e8003b60 0x7f18e8003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:23.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f18feffd640 1 --2- 172.21.15.5:0/1984273312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18e80047d0 0x7f18e8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:23.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f18feffd640 1 --2- 172.21.15.5:0/1984273312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18e8005180 0x7f18e800ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:23.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f18feffd640 1 -- 172.21.15.5:0/1984273312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f190015d360 con 0x7f18e8003b60 2023-07-14T12:53:23.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f18feffd640 1 -- 172.21.15.5:0/1984273312 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e80104e0 con 0x7f18e8005180 2023-07-14T12:53:23.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f18feffd640 1 -- 172.21.15.5:0/1984273312 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e8010620 con 0x7f18e80047d0 2023-07-14T12:53:23.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f18fffff640 1 --2- 172.21.15.5:0/1984273312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e8003b60 0x7f18e8003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:23.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f18ff7fe640 1 --2- 172.21.15.5:0/1984273312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18e80047d0 0x7f18e8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:23.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f1904a68640 1 --2- 172.21.15.5:0/1984273312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18e8005180 0x7f18e800ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:23.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f18fffff640 1 -- 172.21.15.5:0/1984273312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18e80047d0 msgr2=0x7f18e8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:23.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f18fffff640 1 --2- 172.21.15.5:0/1984273312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18e80047d0 0x7f18e8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f18fffff640 1 -- 172.21.15.5:0/1984273312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18e8005180 msgr2=0x7f18e800ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:23.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f18fffff640 1 --2- 172.21.15.5:0/1984273312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18e8005180 0x7f18e800ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f18fffff640 1 -- 172.21.15.5:0/1984273312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e8003530 con 0x7f18e8003b60 2023-07-14T12:53:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.921+0000 7f1904a68640 1 -- 172.21.15.5:0/1984273312 reap_dead start 2023-07-14T12:53:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.925+0000 7f18fffff640 1 --2- 172.21.15.5:0/1984273312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e8003b60 0x7f18e8003f50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f18f00018f0 tx=0x7f18f001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc24de2e005d3599 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.925+0000 7f18feffd640 1 -- 172.21.15.5:0/1984273312 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f00052d0 con 0x7f18e8003b60 2023-07-14T12:53:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.925+0000 7f18feffd640 1 -- 172.21.15.5:0/1984273312 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f0005450 con 0x7f18e8003b60 2023-07-14T12:53:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.925+0000 7f18feffd640 1 -- 172.21.15.5:0/1984273312 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f0003840 con 0x7f18e8003b60 2023-07-14T12:53:23.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.925+0000 7f19064cb640 1 -- 172.21.15.5:0/1984273312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e8003b60 msgr2=0x7f18e8003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.925+0000 7f19064cb640 1 --2- 172.21.15.5:0/1984273312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e8003b60 0x7f18e8003f50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f18f00018f0 tx=0x7f18f001c530 comp rx=0 tx=0).stop 2023-07-14T12:53:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.925+0000 7f19064cb640 1 -- 172.21.15.5:0/1984273312 shutdown_connections 2023-07-14T12:53:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.925+0000 7f19064cb640 1 --2- 172.21.15.5:0/1984273312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e8003b60 0x7f18e8003f50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.925+0000 7f19064cb640 1 -- 172.21.15.5:0/1984273312 >> 172.21.15.5:0/1984273312 conn(0x7f19000cde90 msgr2=0x7f19000ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.925+0000 7f19064cb640 1 -- 172.21.15.5:0/1984273312 shutdown_connections 2023-07-14T12:53:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.925+0000 7f19064cb640 1 -- 172.21.15.5:0/1984273312 wait complete. 2023-07-14T12:53:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.925+0000 7f19064cb640 1 Processor -- start 2023-07-14T12:53:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.925+0000 7f19064cb640 1 -- start start 2023-07-14T12:53:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.929+0000 7f19064cb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e8003b60 0x7f19001477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.929+0000 7f19064cb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19000ae720 0x7f1900150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:23.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.929+0000 7f19064cb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1900150550 0x7f190006b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:23.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.929+0000 7f19064cb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19001509d0 con 0x7f18e8003b60 2023-07-14T12:53:23.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.929+0000 7f19064cb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19000c6cb0 con 0x7f1900150550 2023-07-14T12:53:23.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.929+0000 7f19064cb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19000c6f90 con 0x7f19000ae720 2023-07-14T12:53:23.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.929+0000 7f18fffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e8003b60 0x7f19001477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:23.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.929+0000 7f18fffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e8003b60 0x7f19001477f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42116/0 (socket says 172.21.15.5:42116) 2023-07-14T12:53:23.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.929+0000 7f18fffff640 1 -- 172.21.15.5:0/1461818904 learned_addr learned my addr 172.21.15.5:0/1461818904 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:23.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.929+0000 7f1904a68640 1 --2- 172.21.15.5:0/1461818904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1900150550 0x7f190006b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:23.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.929+0000 7f18ff7fe640 1 --2- 172.21.15.5:0/1461818904 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19000ae720 0x7f1900150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:23.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.929+0000 7f18fffff640 1 -- 172.21.15.5:0/1461818904 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19000ae720 msgr2=0x7f1900150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:23.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.929+0000 7f18fffff640 1 --2- 172.21.15.5:0/1461818904 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19000ae720 0x7f1900150010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.929+0000 7f18fffff640 1 -- 172.21.15.5:0/1461818904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1900150550 msgr2=0x7f190006b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:23.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.929+0000 7f18fffff640 1 --2- 172.21.15.5:0/1461818904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1900150550 0x7f190006b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:23.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.929+0000 7f18fffff640 1 -- 172.21.15.5:0/1461818904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19000c7270 con 0x7f18e8003b60 2023-07-14T12:53:23.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.929+0000 7f18fffff640 1 --2- 172.21.15.5:0/1461818904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e8003b60 0x7f19001477f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f18f001c360 tx=0x7f18e8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:23.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.929+0000 7f18fcff9640 1 -- 172.21.15.5:0/1461818904 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f00050d0 con 0x7f18e8003b60 2023-07-14T12:53:23.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.929+0000 7f18fcff9640 1 -- 172.21.15.5:0/1461818904 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f0005250 con 0x7f18e8003b60 2023-07-14T12:53:23.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.929+0000 7f19064cb640 1 -- 172.21.15.5:0/1461818904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19000c7550 con 0x7f18e8003b60 2023-07-14T12:53:23.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.929+0000 7f18fcff9640 1 -- 172.21.15.5:0/1461818904 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f0003e20 con 0x7f18e8003b60 2023-07-14T12:53:23.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.929+0000 7f19064cb640 1 -- 172.21.15.5:0/1461818904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1900147d30 con 0x7f18e8003b60 2023-07-14T12:53:23.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.929+0000 7f19064cb640 1 -- 172.21.15.5:0/1461818904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19000c7790 con 0x7f18e8003b60 2023-07-14T12:53:23.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.929+0000 7f18fcff9640 1 -- 172.21.15.5:0/1461818904 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f18f00067e0 con 0x7f18e8003b60 2023-07-14T12:53:23.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.933+0000 7f18fcff9640 1 --2- 172.21.15.5:0/1461818904 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f18ec0662b0 0x7f18ec068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:23.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.933+0000 7f18fcff9640 1 -- 172.21.15.5:0/1461818904 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f18f011d420 con 0x7f18e8003b60 2023-07-14T12:53:23.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.933+0000 7f18ff7fe640 1 --2- 172.21.15.5:0/1461818904 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f18ec0662b0 0x7f18ec068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:23.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.933+0000 7f18ff7fe640 1 --2- 172.21.15.5:0/1461818904 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f18ec0662b0 0x7f18ec068760 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f19000c58d0 tx=0x7f18f4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:23.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:23.937+0000 7f18fcff9640 1 -- 172.21.15.5:0/1461818904 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f18f00ea770 con 0x7f18e8003b60 2023-07-14T12:53:24.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.093+0000 7f19064cb640 1 -- 172.21.15.5:0/1461818904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f190006b0f0 con 0x7f18e8003b60 2023-07-14T12:53:24.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.093+0000 7f18fcff9640 1 -- 172.21.15.5:0/1461818904 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f18f00edd90 con 0x7f18e8003b60 2023-07-14T12:53:24.121 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T12:53:24.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.093+0000 7f19064cb640 1 -- 172.21.15.5:0/1461818904 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f18ec0662b0 msgr2=0x7f18ec068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:24.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.093+0000 7f19064cb640 1 --2- 172.21.15.5:0/1461818904 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f18ec0662b0 0x7f18ec068760 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f19000c58d0 tx=0x7f18f4008040 comp rx=0 tx=0).stop 2023-07-14T12:53:24.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.093+0000 7f19064cb640 1 -- 172.21.15.5:0/1461818904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e8003b60 msgr2=0x7f19001477f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:24.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.093+0000 7f19064cb640 1 --2- 172.21.15.5:0/1461818904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e8003b60 0x7f19001477f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f18f001c360 tx=0x7f18e8005800 comp rx=0 tx=0).stop 2023-07-14T12:53:24.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.093+0000 7f19064cb640 1 -- 172.21.15.5:0/1461818904 shutdown_connections 2023-07-14T12:53:24.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.093+0000 7f19064cb640 1 --2- 172.21.15.5:0/1461818904 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f18ec0662b0 0x7f18ec068760 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:24.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.093+0000 7f19064cb640 1 --2- 172.21.15.5:0/1461818904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1900150550 0x7f190006b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:24.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.093+0000 7f19064cb640 1 --2- 172.21.15.5:0/1461818904 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19000ae720 0x7f1900150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:24.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.093+0000 7f19064cb640 1 --2- 172.21.15.5:0/1461818904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e8003b60 0x7f19001477f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:24.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.093+0000 7f19064cb640 1 -- 172.21.15.5:0/1461818904 >> 172.21.15.5:0/1461818904 conn(0x7f19000cde90 msgr2=0x7f1900151b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:24.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.093+0000 7f19064cb640 1 -- 172.21.15.5:0/1461818904 shutdown_connections 2023-07-14T12:53:24.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.093+0000 7f19064cb640 1 -- 172.21.15.5:0/1461818904 wait complete. 2023-07-14T12:53:24.142 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T12:53:24.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.261+0000 7f70ea5fa640 1 Processor -- start 2023-07-14T12:53:24.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.261+0000 7f70ea5fa640 1 -- start start 2023-07-14T12:53:24.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.261+0000 7f70ea5fa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f70e4069430 0x7f70e4069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:24.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.261+0000 7f70ea5fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70e40af2b0 0x7f70e415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:24.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.261+0000 7f70ea5fa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e4159d70 con 0x7f70e4070f30 2023-07-14T12:53:24.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.261+0000 7f70ea5fa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e4069d40 con 0x7f70e4069430 2023-07-14T12:53:24.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.261+0000 7f70ea5fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e40c9c60 con 0x7f70e40af2b0 2023-07-14T12:53:24.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.261+0000 7f70e8b97640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70e40af2b0 0x7f70e415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:24.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.261+0000 7f70e8b97640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70e40af2b0 0x7f70e415a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:33254/0 (socket says 172.21.15.5:33254) 2023-07-14T12:53:24.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.261+0000 7f70e8b97640 1 -- 172.21.15.5:0/3438618399 learned_addr learned my addr 172.21.15.5:0/3438618399 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:24.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.261+0000 7f70e3fff640 1 --2- 172.21.15.5:0/3438618399 >> v2:172.21.15.154:3300/0 conn(0x7f70e4069430 0x7f70e4069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:24.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.261+0000 7f70e8b97640 1 -- 172.21.15.5:0/3438618399 >> v2:172.21.15.154:3300/0 conn(0x7f70e4069430 msgr2=0x7f70e4069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:24.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.261+0000 7f70e8b97640 1 --2- 172.21.15.5:0/3438618399 >> v2:172.21.15.154:3300/0 conn(0x7f70e4069430 0x7f70e4069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:24.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.261+0000 7f70e8b97640 1 -- 172.21.15.5:0/3438618399 >> v1:172.21.15.154:6789/0 conn(0x7f70e4070f30 legacy=0x7f70e40ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:24.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.261+0000 7f70e8b97640 1 -- 172.21.15.5:0/3438618399 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e40c9f40 con 0x7f70e40af2b0 2023-07-14T12:53:24.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.265+0000 7f70e8b97640 1 --2- 172.21.15.5:0/3438618399 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70e40af2b0 0x7f70e415a1f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f70dc009e50 tx=0x7f70dc01ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1713cc5bcd7a670 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:24.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.265+0000 7f70e2ffd640 1 -- 172.21.15.5:0/3438618399 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc0a57f0 con 0x7f70e40af2b0 2023-07-14T12:53:24.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.265+0000 7f70e2ffd640 1 -- 172.21.15.5:0/3438618399 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70dc0a5950 con 0x7f70e40af2b0 2023-07-14T12:53:24.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.265+0000 7f70e2ffd640 1 -- 172.21.15.5:0/3438618399 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc0a5ce0 con 0x7f70e40af2b0 2023-07-14T12:53:24.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.265+0000 7f70ea5fa640 1 -- 172.21.15.5:0/3438618399 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70e40af2b0 msgr2=0x7f70e415a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:24.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.265+0000 7f70ea5fa640 1 --2- 172.21.15.5:0/3438618399 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70e40af2b0 0x7f70e415a1f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f70dc009e50 tx=0x7f70dc01ca10 comp rx=0 tx=0).stop 2023-07-14T12:53:24.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.265+0000 7f70ea5fa640 1 -- 172.21.15.5:0/3438618399 shutdown_connections 2023-07-14T12:53:24.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.265+0000 7f70ea5fa640 1 --2- 172.21.15.5:0/3438618399 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70e40af2b0 0x7f70e415a1f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:24.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.265+0000 7f70ea5fa640 1 --2- 172.21.15.5:0/3438618399 >> v2:172.21.15.154:3300/0 conn(0x7f70e4069430 0x7f70e4069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:24.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.265+0000 7f70ea5fa640 1 -- 172.21.15.5:0/3438618399 >> 172.21.15.5:0/3438618399 conn(0x7f70e40cde90 msgr2=0x7f70e40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:24.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.265+0000 7f70ea5fa640 1 -- 172.21.15.5:0/3438618399 shutdown_connections 2023-07-14T12:53:24.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.265+0000 7f70ea5fa640 1 -- 172.21.15.5:0/3438618399 wait complete. 2023-07-14T12:53:24.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.269+0000 7f70ea5fa640 1 Processor -- start 2023-07-14T12:53:24.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.269+0000 7f70ea5fa640 1 -- start start 2023-07-14T12:53:24.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.269+0000 7f70ea5fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70e4069430 0x7f70e4150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:24.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.269+0000 7f70ea5fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70e4070f30 0x7f70e414eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.269+0000 7f70ea5fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70e40af2b0 0x7f70e40ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.269+0000 7f70ea5fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e41508d0 con 0x7f70e4070f30 2023-07-14T12:53:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.269+0000 7f70ea5fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e40c5e50 con 0x7f70e4069430 2023-07-14T12:53:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.269+0000 7f70ea5fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e40ac170 con 0x7f70e40af2b0 2023-07-14T12:53:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.269+0000 7f70e37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70e4070f30 0x7f70e414eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.269+0000 7f70e37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70e4070f30 0x7f70e414eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42118/0 (socket says 172.21.15.5:42118) 2023-07-14T12:53:24.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.269+0000 7f70e37fe640 1 -- 172.21.15.5:0/2084145293 learned_addr learned my addr 172.21.15.5:0/2084145293 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:24.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.269+0000 7f70e3fff640 1 --2- 172.21.15.5:0/2084145293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70e4069430 0x7f70e4150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:24.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.269+0000 7f70e8b97640 1 --2- 172.21.15.5:0/2084145293 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70e40af2b0 0x7f70e40ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:24.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.269+0000 7f70e37fe640 1 -- 172.21.15.5:0/2084145293 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70e40af2b0 msgr2=0x7f70e40ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:24.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.269+0000 7f70e37fe640 1 --2- 172.21.15.5:0/2084145293 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70e40af2b0 0x7f70e40ab890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:24.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.269+0000 7f70e37fe640 1 -- 172.21.15.5:0/2084145293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70e4069430 msgr2=0x7f70e4150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:24.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.269+0000 7f70e37fe640 1 --2- 172.21.15.5:0/2084145293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70e4069430 0x7f70e4150390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:24.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.269+0000 7f70e37fe640 1 -- 172.21.15.5:0/2084145293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70dc009b30 con 0x7f70e4070f30 2023-07-14T12:53:24.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.269+0000 7f70e8b97640 1 --2- 172.21.15.5:0/2084145293 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70e40af2b0 0x7f70e40ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:24.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.269+0000 7f70e37fe640 1 --2- 172.21.15.5:0/2084145293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70e4070f30 0x7f70e414eff0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f70d800c3c0 tx=0x7f70d800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:24.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.269+0000 7f70e0ff9640 1 -- 172.21.15.5:0/2084145293 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d80052d0 con 0x7f70e4070f30 2023-07-14T12:53:24.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.269+0000 7f70e0ff9640 1 -- 172.21.15.5:0/2084145293 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d8005430 con 0x7f70e4070f30 2023-07-14T12:53:24.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.269+0000 7f70ea5fa640 1 -- 172.21.15.5:0/2084145293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e40ac450 con 0x7f70e4070f30 2023-07-14T12:53:24.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.269+0000 7f70e0ff9640 1 -- 172.21.15.5:0/2084145293 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d8003840 con 0x7f70e4070f30 2023-07-14T12:53:24.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.269+0000 7f70ea5fa640 1 -- 172.21.15.5:0/2084145293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e40aca10 con 0x7f70e4070f30 2023-07-14T12:53:24.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.273+0000 7f70ea5fa640 1 -- 172.21.15.5:0/2084145293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e40678d0 con 0x7f70e4070f30 2023-07-14T12:53:24.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.273+0000 7f70e0ff9640 1 -- 172.21.15.5:0/2084145293 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f70d80039a0 con 0x7f70e4070f30 2023-07-14T12:53:24.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.273+0000 7f70e0ff9640 1 --2- 172.21.15.5:0/2084145293 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f70d0066280 0x7f70d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:24.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.273+0000 7f70e0ff9640 1 -- 172.21.15.5:0/2084145293 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f70d80830e0 con 0x7f70e4070f30 2023-07-14T12:53:24.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.273+0000 7f70e3fff640 1 --2- 172.21.15.5:0/2084145293 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f70d0066280 0x7f70d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:24.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.273+0000 7f70e3fff640 1 --2- 172.21.15.5:0/2084145293 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f70d0066280 0x7f70d0068730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009ac0 tx=0x7f70d4009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:24.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.277+0000 7f70e0ff9640 1 -- 172.21.15.5:0/2084145293 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f70d8050570 con 0x7f70e4070f30 2023-07-14T12:53:24.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.433+0000 7f70ea5fa640 1 -- 172.21.15.5:0/2084145293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f70e4159d70 con 0x7f70e4070f30 2023-07-14T12:53:24.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.433+0000 7f70e0ff9640 1 -- 172.21.15.5:0/2084145293 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f70e4159d70 con 0x7f70e4070f30 2023-07-14T12:53:24.461 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T12:53:24.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.433+0000 7f70ea5fa640 1 -- 172.21.15.5:0/2084145293 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f70d0066280 msgr2=0x7f70d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:24.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.433+0000 7f70ea5fa640 1 --2- 172.21.15.5:0/2084145293 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f70d0066280 0x7f70d0068730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009ac0 tx=0x7f70d4009190 comp rx=0 tx=0).stop 2023-07-14T12:53:24.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.433+0000 7f70ea5fa640 1 -- 172.21.15.5:0/2084145293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70e4070f30 msgr2=0x7f70e414eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:24.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.433+0000 7f70ea5fa640 1 --2- 172.21.15.5:0/2084145293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70e4070f30 0x7f70e414eff0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f70d800c3c0 tx=0x7f70d800c880 comp rx=0 tx=0).stop 2023-07-14T12:53:24.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.433+0000 7f70ea5fa640 1 -- 172.21.15.5:0/2084145293 shutdown_connections 2023-07-14T12:53:24.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.433+0000 7f70ea5fa640 1 --2- 172.21.15.5:0/2084145293 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70e40af2b0 0x7f70e40ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:24.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.433+0000 7f70ea5fa640 1 --2- 172.21.15.5:0/2084145293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70e4070f30 0x7f70e414eff0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:24.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.433+0000 7f70ea5fa640 1 --2- 172.21.15.5:0/2084145293 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f70d0066280 0x7f70d0068730 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:24.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.433+0000 7f70ea5fa640 1 --2- 172.21.15.5:0/2084145293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70e4069430 0x7f70e4150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:24.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.433+0000 7f70ea5fa640 1 -- 172.21.15.5:0/2084145293 >> 172.21.15.5:0/2084145293 conn(0x7f70e40cde90 msgr2=0x7f70e406b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:24.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.433+0000 7f70ea5fa640 1 -- 172.21.15.5:0/2084145293 shutdown_connections 2023-07-14T12:53:24.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.433+0000 7f70ea5fa640 1 -- 172.21.15.5:0/2084145293 wait complete. 2023-07-14T12:53:24.481 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T12:53:24.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.597+0000 7fc0ad32c640 1 Processor -- start 2023-07-14T12:53:24.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.597+0000 7fc0ad32c640 1 -- start start 2023-07-14T12:53:24.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.601+0000 7fc0ad32c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc0a8070b70 0x7fc0a8070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:24.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.601+0000 7fc0ad32c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0a80cb100 0x7fc0a80cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:24.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.601+0000 7fc0ad32c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a80cac70 con 0x7fc0a806b1e0 2023-07-14T12:53:24.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.601+0000 7fc0ad32c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a80cbaa0 con 0x7fc0a8070b70 2023-07-14T12:53:24.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.601+0000 7fc0ad32c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a8071480 con 0x7fc0a80cb100 2023-07-14T12:53:24.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.601+0000 7fc0a77fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0a80cb100 0x7fc0a80cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:24.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.601+0000 7fc0a6ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc0a8070b70 0x7fc0a8070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:24.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.601+0000 7fc09ffff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc0a806b1e0 0x7fc0a80c1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:44182/0 (socket says 172.21.15.5:44182) 2023-07-14T12:53:24.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.601+0000 7fc09ffff640 1 -- 172.21.15.5:0/1042720608 learned_addr learned my addr 172.21.15.5:0/1042720608 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:24.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.601+0000 7fc0a77fe640 1 -- 172.21.15.5:0/1042720608 >> v2:172.21.15.154:3300/0 conn(0x7fc0a8070b70 msgr2=0x7fc0a8070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:24.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.601+0000 7fc0a77fe640 1 --2- 172.21.15.5:0/1042720608 >> v2:172.21.15.154:3300/0 conn(0x7fc0a8070b70 0x7fc0a8070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:24.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.601+0000 7fc0a77fe640 1 -- 172.21.15.5:0/1042720608 >> v1:172.21.15.154:6789/0 conn(0x7fc0a806b1e0 legacy=0x7fc0a80c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:24.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.601+0000 7fc0a77fe640 1 -- 172.21.15.5:0/1042720608 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a80ca060 con 0x7fc0a80cb100 2023-07-14T12:53:24.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.605+0000 7fc0a77fe640 1 --2- 172.21.15.5:0/1042720608 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0a80cb100 0x7fc0a80cb560 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009d90 tx=0x7fc0a001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81529f67297618f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:24.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.605+0000 7fc0a67fc640 1 -- 172.21.15.5:0/1042720608 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a00a59e0 con 0x7fc0a80cb100 2023-07-14T12:53:24.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.605+0000 7fc0a67fc640 1 -- 172.21.15.5:0/1042720608 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a00a5b40 con 0x7fc0a80cb100 2023-07-14T12:53:24.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.605+0000 7fc0a67fc640 1 -- 172.21.15.5:0/1042720608 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a00ad440 con 0x7fc0a80cb100 2023-07-14T12:53:24.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.605+0000 7fc0ad32c640 1 -- 172.21.15.5:0/1042720608 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0a80cb100 msgr2=0x7fc0a80cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:24.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.605+0000 7fc0ad32c640 1 --2- 172.21.15.5:0/1042720608 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0a80cb100 0x7fc0a80cb560 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009d90 tx=0x7fc0a001c920 comp rx=0 tx=0).stop 2023-07-14T12:53:24.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.605+0000 7fc0ad32c640 1 -- 172.21.15.5:0/1042720608 shutdown_connections 2023-07-14T12:53:24.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.605+0000 7fc0ad32c640 1 --2- 172.21.15.5:0/1042720608 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0a80cb100 0x7fc0a80cb560 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:24.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.605+0000 7fc0ad32c640 1 --2- 172.21.15.5:0/1042720608 >> v2:172.21.15.154:3300/0 conn(0x7fc0a8070b70 0x7fc0a8070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:24.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.605+0000 7fc0ad32c640 1 -- 172.21.15.5:0/1042720608 >> 172.21.15.5:0/1042720608 conn(0x7fc0a80afcf0 msgr2=0x7fc0a80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:24.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.605+0000 7fc0ad32c640 1 -- 172.21.15.5:0/1042720608 shutdown_connections 2023-07-14T12:53:24.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.605+0000 7fc0ad32c640 1 -- 172.21.15.5:0/1042720608 wait complete. 2023-07-14T12:53:24.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.605+0000 7fc0ad32c640 1 Processor -- start 2023-07-14T12:53:24.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.605+0000 7fc0ad32c640 1 -- start start 2023-07-14T12:53:24.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.609+0000 7fc0ad32c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0a806b1e0 0x7fc0a80aaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:24.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.609+0000 7fc0ad32c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0a8070b70 0x7fc0a814ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:24.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.609+0000 7fc0ad32c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0a80cb100 0x7fc0a80a7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.609+0000 7fc0ad32c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a814f260 con 0x7fc0a80cb100 2023-07-14T12:53:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.609+0000 7fc0ad32c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a80a7ce0 con 0x7fc0a8070b70 2023-07-14T12:53:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.609+0000 7fc0ad32c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a80a7fc0 con 0x7fc0a806b1e0 2023-07-14T12:53:24.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.609+0000 7fc0a77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0a80cb100 0x7fc0a80a7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:24.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.609+0000 7fc0a77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0a80cb100 0x7fc0a80a7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42122/0 (socket says 172.21.15.5:42122) 2023-07-14T12:53:24.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.609+0000 7fc0a77fe640 1 -- 172.21.15.5:0/1117322885 learned_addr learned my addr 172.21.15.5:0/1117322885 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:24.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.609+0000 7fc0a6ffd640 1 --2- 172.21.15.5:0/1117322885 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0a806b1e0 0x7fc0a80aaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:24.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.609+0000 7fc09ffff640 1 --2- 172.21.15.5:0/1117322885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0a8070b70 0x7fc0a814ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:24.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.609+0000 7fc0a77fe640 1 -- 172.21.15.5:0/1117322885 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0a806b1e0 msgr2=0x7fc0a80aaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:24.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.609+0000 7fc0a77fe640 1 --2- 172.21.15.5:0/1117322885 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0a806b1e0 0x7fc0a80aaeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:24.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.609+0000 7fc0a77fe640 1 -- 172.21.15.5:0/1117322885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0a8070b70 msgr2=0x7fc0a814ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:24.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.609+0000 7fc0a77fe640 1 --2- 172.21.15.5:0/1117322885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0a8070b70 0x7fc0a814ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:24.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.609+0000 7fc0a77fe640 1 -- 172.21.15.5:0/1117322885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a0009a70 con 0x7fc0a80cb100 2023-07-14T12:53:24.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.609+0000 7fc09ffff640 1 --2- 172.21.15.5:0/1117322885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0a8070b70 0x7fc0a814ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:24.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.609+0000 7fc0a77fe640 1 --2- 172.21.15.5:0/1117322885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0a80cb100 0x7fc0a80a7490 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc0a001afd0 tx=0x7fc0a00196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:24.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.609+0000 7fc09f7fe640 1 -- 172.21.15.5:0/1117322885 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a00add90 con 0x7fc0a80cb100 2023-07-14T12:53:24.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.609+0000 7fc09f7fe640 1 -- 172.21.15.5:0/1117322885 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a0009450 con 0x7fc0a80cb100 2023-07-14T12:53:24.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.609+0000 7fc09f7fe640 1 -- 172.21.15.5:0/1117322885 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a00b9670 con 0x7fc0a80cb100 2023-07-14T12:53:24.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.609+0000 7fc0ad32c640 1 -- 172.21.15.5:0/1117322885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a80a82a0 con 0x7fc0a80cb100 2023-07-14T12:53:24.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.609+0000 7fc0ad32c640 1 -- 172.21.15.5:0/1117322885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a80a8860 con 0x7fc0a80cb100 2023-07-14T12:53:24.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.609+0000 7fc0ad32c640 1 -- 172.21.15.5:0/1117322885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a80c1ea0 con 0x7fc0a80cb100 2023-07-14T12:53:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.609+0000 7fc09f7fe640 1 -- 172.21.15.5:0/1117322885 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc0a00b97d0 con 0x7fc0a80cb100 2023-07-14T12:53:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.613+0000 7fc09f7fe640 1 --2- 172.21.15.5:0/1117322885 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc088066280 0x7fc088068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:24.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.613+0000 7fc09f7fe640 1 -- 172.21.15.5:0/1117322885 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc0a011f590 con 0x7fc0a80cb100 2023-07-14T12:53:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.613+0000 7fc0a6ffd640 1 --2- 172.21.15.5:0/1117322885 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc088066280 0x7fc088068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.613+0000 7fc0a6ffd640 1 --2- 172.21.15.5:0/1117322885 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc088066280 0x7fc088068730 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc098009af0 tx=0x7fc098008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:24.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.617+0000 7fc09f7fe640 1 -- 172.21.15.5:0/1117322885 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc0a00ecb20 con 0x7fc0a80cb100 2023-07-14T12:53:24.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.785+0000 7fc0ad32c640 1 -- 172.21.15.5:0/1117322885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc0a80678d0 con 0x7fc0a80cb100 2023-07-14T12:53:24.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.785+0000 7fc09f7fe640 1 -- 172.21.15.5:0/1117322885 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc0a00f0140 con 0x7fc0a80cb100 2023-07-14T12:53:24.812 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-07-14T12:53:24.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.785+0000 7fc0ad32c640 1 -- 172.21.15.5:0/1117322885 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc088066280 msgr2=0x7fc088068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:24.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.785+0000 7fc0ad32c640 1 --2- 172.21.15.5:0/1117322885 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc088066280 0x7fc088068730 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc098009af0 tx=0x7fc098008040 comp rx=0 tx=0).stop 2023-07-14T12:53:24.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.785+0000 7fc0ad32c640 1 -- 172.21.15.5:0/1117322885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0a80cb100 msgr2=0x7fc0a80a7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:24.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.785+0000 7fc0ad32c640 1 --2- 172.21.15.5:0/1117322885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0a80cb100 0x7fc0a80a7490 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc0a001afd0 tx=0x7fc0a00196c0 comp rx=0 tx=0).stop 2023-07-14T12:53:24.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.785+0000 7fc0ad32c640 1 -- 172.21.15.5:0/1117322885 shutdown_connections 2023-07-14T12:53:24.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.785+0000 7fc0ad32c640 1 --2- 172.21.15.5:0/1117322885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0a80cb100 0x7fc0a80a7490 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:24.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.785+0000 7fc0ad32c640 1 --2- 172.21.15.5:0/1117322885 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc088066280 0x7fc088068730 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:24.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.785+0000 7fc0ad32c640 1 --2- 172.21.15.5:0/1117322885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0a8070b70 0x7fc0a814ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:24.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.785+0000 7fc0ad32c640 1 --2- 172.21.15.5:0/1117322885 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0a806b1e0 0x7fc0a80aaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:24.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.785+0000 7fc0ad32c640 1 -- 172.21.15.5:0/1117322885 >> 172.21.15.5:0/1117322885 conn(0x7fc0a80afcf0 msgr2=0x7fc0a80ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:24.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.785+0000 7fc0ad32c640 1 -- 172.21.15.5:0/1117322885 shutdown_connections 2023-07-14T12:53:24.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:24.785+0000 7fc0ad32c640 1 -- 172.21.15.5:0/1117322885 wait complete. 2023-07-14T12:53:24.832 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-07-14T12:53:24.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:24.833 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-07-14T12:53:24.883 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-07-14T12:53:24.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:24.884 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-14T12:53:24.893 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:53:24.894 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T12:53:24.903 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:53:24.904 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T12:53:24.958 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T12:53:24.958 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T12:53:25.010 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:53:25.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.125+0000 7f8840bdf640 1 Processor -- start 2023-07-14T12:53:25.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.125+0000 7f8840bdf640 1 -- start start 2023-07-14T12:53:25.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.125+0000 7f8840bdf640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f883c0b7c70 0x7f883c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:25.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.125+0000 7f8840bdf640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f883c15fd60 0x7f883c0d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:25.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.125+0000 7f8840bdf640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f883c0ccaf0 con 0x7f883c0d1850 2023-07-14T12:53:25.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.125+0000 7f8840bdf640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883c0d1190 con 0x7f883c15fd60 2023-07-14T12:53:25.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.125+0000 7f8840bdf640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883c160600 con 0x7f883c0b7c70 2023-07-14T12:53:25.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.125+0000 7f883ad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f883c15fd60 0x7f883c0d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:25.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.125+0000 7f883ad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f883c15fd60 0x7f883c0d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42124/0 (socket says 172.21.15.5:42124) 2023-07-14T12:53:25.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.125+0000 7f883ad9d640 1 -- 172.21.15.5:0/1529183337 learned_addr learned my addr 172.21.15.5:0/1529183337 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:25.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.125+0000 7f883a59c640 1 --2- 172.21.15.5:0/1529183337 >> v2:172.21.15.154:3300/0 conn(0x7f883c0b7c70 0x7f883c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:25.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.125+0000 7f883ad9d640 1 -- 172.21.15.5:0/1529183337 >> v2:172.21.15.154:3300/0 conn(0x7f883c0b7c70 msgr2=0x7f883c0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:25.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.125+0000 7f883ad9d640 1 --2- 172.21.15.5:0/1529183337 >> v2:172.21.15.154:3300/0 conn(0x7f883c0b7c70 0x7f883c0d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:25.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.125+0000 7f883ad9d640 1 -- 172.21.15.5:0/1529183337 >> v1:172.21.15.154:6789/0 conn(0x7f883c0d1850 legacy=0x7f883c15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:25.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.125+0000 7f883ad9d640 1 -- 172.21.15.5:0/1529183337 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c160320 con 0x7f883c15fd60 2023-07-14T12:53:25.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.125+0000 7f883a59c640 1 --2- 172.21.15.5:0/1529183337 >> v2:172.21.15.154:3300/0 conn(0x7f883c0b7c70 0x7f883c0d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:25.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.129+0000 7f883ad9d640 1 --2- 172.21.15.5:0/1529183337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883c15fd60 0x7f883c0d1da0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f883c0b40a0 tx=0x7f883401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e560a4a4423340d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:25.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.129+0000 7f8839d9b640 1 -- 172.21.15.5:0/1529183337 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88340a5840 con 0x7f883c15fd60 2023-07-14T12:53:25.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.129+0000 7f8839d9b640 1 -- 172.21.15.5:0/1529183337 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88340a59a0 con 0x7f883c15fd60 2023-07-14T12:53:25.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.129+0000 7f8839d9b640 1 -- 172.21.15.5:0/1529183337 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88340a5d30 con 0x7f883c15fd60 2023-07-14T12:53:25.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.129+0000 7f8840bdf640 1 -- 172.21.15.5:0/1529183337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883c15fd60 msgr2=0x7f883c0d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:25.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.129+0000 7f8840bdf640 1 --2- 172.21.15.5:0/1529183337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883c15fd60 0x7f883c0d1da0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f883c0b40a0 tx=0x7f883401c960 comp rx=0 tx=0).stop 2023-07-14T12:53:25.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.129+0000 7f8840bdf640 1 -- 172.21.15.5:0/1529183337 shutdown_connections 2023-07-14T12:53:25.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.129+0000 7f8840bdf640 1 --2- 172.21.15.5:0/1529183337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883c15fd60 0x7f883c0d1da0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:25.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.129+0000 7f8840bdf640 1 --2- 172.21.15.5:0/1529183337 >> v2:172.21.15.154:3300/0 conn(0x7f883c0b7c70 0x7f883c0d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:25.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.129+0000 7f8840bdf640 1 -- 172.21.15.5:0/1529183337 >> 172.21.15.5:0/1529183337 conn(0x7f883c0650b0 msgr2=0x7f883c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:25.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.129+0000 7f8840bdf640 1 -- 172.21.15.5:0/1529183337 shutdown_connections 2023-07-14T12:53:25.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.129+0000 7f8840bdf640 1 -- 172.21.15.5:0/1529183337 wait complete. 2023-07-14T12:53:25.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.133+0000 7f8840bdf640 1 Processor -- start 2023-07-14T12:53:25.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.133+0000 7f8840bdf640 1 -- start start 2023-07-14T12:53:25.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.133+0000 7f8840bdf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f883c0b7c70 0x7f883c158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:25.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.133+0000 7f8840bdf640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f883c0d1850 0x7f883c0c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:25.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.133+0000 7f8840bdf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883c15fd60 0x7f883c14f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:25.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.133+0000 7f8840bdf640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c0c6620 con 0x7f883c15fd60 2023-07-14T12:53:25.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.133+0000 7f8840bdf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c0c6dc0 con 0x7f883c0b7c70 2023-07-14T12:53:25.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.133+0000 7f8840bdf640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883c1576a0 con 0x7f883c0d1850 2023-07-14T12:53:25.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.133+0000 7f883ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883c15fd60 0x7f883c14f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:25.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.133+0000 7f883ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883c15fd60 0x7f883c14f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42128/0 (socket says 172.21.15.5:42128) 2023-07-14T12:53:25.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.133+0000 7f883ad9d640 1 -- 172.21.15.5:0/3779407630 learned_addr learned my addr 172.21.15.5:0/3779407630 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:25.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.133+0000 7f883a59c640 1 --2- 172.21.15.5:0/3779407630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f883c0b7c70 0x7f883c158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:25.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.133+0000 7f8833fff640 1 --2- 172.21.15.5:0/3779407630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f883c0d1850 0x7f883c0c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:25.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.133+0000 7f883ad9d640 1 -- 172.21.15.5:0/3779407630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f883c0d1850 msgr2=0x7f883c0c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:25.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.133+0000 7f883ad9d640 1 --2- 172.21.15.5:0/3779407630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f883c0d1850 0x7f883c0c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:25.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.133+0000 7f883ad9d640 1 -- 172.21.15.5:0/3779407630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f883c0b7c70 msgr2=0x7f883c158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:25.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.133+0000 7f883ad9d640 1 --2- 172.21.15.5:0/3779407630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f883c0b7c70 0x7f883c158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:25.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.133+0000 7f883ad9d640 1 -- 172.21.15.5:0/3779407630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8834009b30 con 0x7f883c15fd60 2023-07-14T12:53:25.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.133+0000 7f883ad9d640 1 --2- 172.21.15.5:0/3779407630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883c15fd60 0x7f883c14f090 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f883401a590 tx=0x7f8834019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:25.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.133+0000 7f8832ffd640 1 -- 172.21.15.5:0/3779407630 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88340b8670 con 0x7f883c15fd60 2023-07-14T12:53:25.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.133+0000 7f8832ffd640 1 -- 172.21.15.5:0/3779407630 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88340b8810 con 0x7f883c15fd60 2023-07-14T12:53:25.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.133+0000 7f8832ffd640 1 -- 172.21.15.5:0/3779407630 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88340b8bc0 con 0x7f883c15fd60 2023-07-14T12:53:25.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.133+0000 7f8840bdf640 1 -- 172.21.15.5:0/3779407630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f883c1593a0 con 0x7f883c15fd60 2023-07-14T12:53:25.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.133+0000 7f8840bdf640 1 -- 172.21.15.5:0/3779407630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f883c0c6ae0 con 0x7f883c15fd60 2023-07-14T12:53:25.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.137+0000 7f8840bdf640 1 -- 172.21.15.5:0/3779407630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883c157810 con 0x7f883c15fd60 2023-07-14T12:53:25.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.137+0000 7f8832ffd640 1 -- 172.21.15.5:0/3779407630 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f88340b8d20 con 0x7f883c15fd60 2023-07-14T12:53:25.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.137+0000 7f8832ffd640 1 --2- 172.21.15.5:0/3779407630 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f881c066280 0x7f881c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:25.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.137+0000 7f8832ffd640 1 -- 172.21.15.5:0/3779407630 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f883411f120 con 0x7f883c15fd60 2023-07-14T12:53:25.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.137+0000 7f883a59c640 1 --2- 172.21.15.5:0/3779407630 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f881c066280 0x7f881c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:25.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.137+0000 7f883a59c640 1 --2- 172.21.15.5:0/3779407630 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f881c066280 0x7f881c068730 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f882c006fd0 tx=0x7f882c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:25.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.141+0000 7f8832ffd640 1 -- 172.21.15.5:0/3779407630 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f88340ec630 con 0x7f883c15fd60 2023-07-14T12:53:25.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.301+0000 7f8840bdf640 1 -- 172.21.15.5:0/3779407630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f883c157810 con 0x7f883c15fd60 2023-07-14T12:53:25.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.301+0000 7f8832ffd640 1 -- 172.21.15.5:0/3779407630 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18231 (secure 0 0 0) 0x7f88340efc50 con 0x7f883c15fd60 2023-07-14T12:53:25.329 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:25.329 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":23,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:52:48.091483+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:52:44.223082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T12:52:45.469396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:53:25.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.301+0000 7f8840bdf640 1 -- 172.21.15.5:0/3779407630 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f881c066280 msgr2=0x7f881c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:25.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.301+0000 7f8840bdf640 1 --2- 172.21.15.5:0/3779407630 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f881c066280 0x7f881c068730 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f882c006fd0 tx=0x7f882c008040 comp rx=0 tx=0).stop 2023-07-14T12:53:25.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.301+0000 7f8840bdf640 1 -- 172.21.15.5:0/3779407630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883c15fd60 msgr2=0x7f883c14f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:25.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.301+0000 7f8840bdf640 1 --2- 172.21.15.5:0/3779407630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883c15fd60 0x7f883c14f090 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f883401a590 tx=0x7f8834019700 comp rx=0 tx=0).stop 2023-07-14T12:53:25.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.301+0000 7f8840bdf640 1 -- 172.21.15.5:0/3779407630 shutdown_connections 2023-07-14T12:53:25.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.301+0000 7f8840bdf640 1 --2- 172.21.15.5:0/3779407630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f883c15fd60 0x7f883c14f090 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:25.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.301+0000 7f8840bdf640 1 --2- 172.21.15.5:0/3779407630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f883c0d1850 0x7f883c0c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:25.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.301+0000 7f8840bdf640 1 --2- 172.21.15.5:0/3779407630 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f881c066280 0x7f881c068730 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:25.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.301+0000 7f8840bdf640 1 --2- 172.21.15.5:0/3779407630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f883c0b7c70 0x7f883c158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:25.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.301+0000 7f8840bdf640 1 -- 172.21.15.5:0/3779407630 >> 172.21.15.5:0/3779407630 conn(0x7f883c0650b0 msgr2=0x7f883c0b71a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:25.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.301+0000 7f8840bdf640 1 -- 172.21.15.5:0/3779407630 shutdown_connections 2023-07-14T12:53:25.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.301+0000 7f8840bdf640 1 -- 172.21.15.5:0/3779407630 wait complete. 2023-07-14T12:53:25.350 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T12:52:44.223082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T12:52:45.469396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T12:53:25.351 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T12:53:25.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.469+0000 7f86cac34640 1 Processor -- start 2023-07-14T12:53:25.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.469+0000 7f86cac34640 1 -- start start 2023-07-14T12:53:25.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.473+0000 7f86cac34640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86c40af2b0 0x7f86c415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:25.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.473+0000 7f86cac34640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c4159d70 con 0x7f86c4070f30 2023-07-14T12:53:25.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.473+0000 7f86cac34640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c40c9c60 con 0x7f86c4069430 2023-07-14T12:53:25.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.473+0000 7f86cac34640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c40c9f40 con 0x7f86c40af2b0 2023-07-14T12:53:25.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.473+0000 7f86c3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f86c4070f30 0x7f86c40ad6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47166/0 (socket says 172.21.15.5:47166) 2023-07-14T12:53:25.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.473+0000 7f86c3fff640 1 -- 172.21.15.5:0/796312581 learned_addr learned my addr 172.21.15.5:0/796312581 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:25.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.473+0000 7f86c91d1640 1 --2- 172.21.15.5:0/796312581 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86c40af2b0 0x7f86c415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:25.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.473+0000 7f86c37fe640 1 -- 172.21.15.5:0/796312581 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2704269361 0 0) 0x7f86b0001120 con 0x7f86c4070f30 2023-07-14T12:53:25.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.473+0000 7f86c37fe640 1 -- 172.21.15.5:0/796312581 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86b4003530 con 0x7f86c4070f30 2023-07-14T12:53:25.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.473+0000 7f86c37fe640 1 -- 172.21.15.5:0/796312581 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1140116569 0 0) 0x7f86c40c9c60 con 0x7f86c4069430 2023-07-14T12:53:25.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.473+0000 7f86c37fe640 1 -- 172.21.15.5:0/796312581 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86b0001120 con 0x7f86c4069430 2023-07-14T12:53:25.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.473+0000 7f86c91d1640 1 -- 172.21.15.5:0/796312581 >> v1:172.21.15.154:6789/0 conn(0x7f86c4069430 legacy=0x7f86c4069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.473+0000 7f86c91d1640 1 -- 172.21.15.5:0/796312581 >> v1:172.21.15.5:6789/0 conn(0x7f86c4070f30 legacy=0x7f86c40ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.473+0000 7f86c37fe640 1 -- 172.21.15.5:0/796312581 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1481702716 0 0) 0x7f86b4003530 con 0x7f86c4070f30 2023-07-14T12:53:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.473+0000 7f86c91d1640 1 -- 172.21.15.5:0/796312581 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c40ca220 con 0x7f86c40af2b0 2023-07-14T12:53:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.477+0000 7f86c91d1640 1 --2- 172.21.15.5:0/796312581 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86c40af2b0 0x7f86c415a1f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f86bc009dc0 tx=0x7f86bc01c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21be070efe8b5d3f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.477+0000 7f86c37fe640 1 -- 172.21.15.5:0/796312581 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b0001810 con 0x7f86c40af2b0 2023-07-14T12:53:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.477+0000 7f86c37fe640 1 -- 172.21.15.5:0/796312581 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc0a56f0 con 0x7f86c40af2b0 2023-07-14T12:53:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.477+0000 7f86c37fe640 1 -- 172.21.15.5:0/796312581 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0a5a80 con 0x7f86c40af2b0 2023-07-14T12:53:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.477+0000 7f86cac34640 1 -- 172.21.15.5:0/796312581 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86c40af2b0 msgr2=0x7f86c415a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.477+0000 7f86cac34640 1 --2- 172.21.15.5:0/796312581 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86c40af2b0 0x7f86c415a1f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f86bc009dc0 tx=0x7f86bc01c890 comp rx=0 tx=0).stop 2023-07-14T12:53:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.477+0000 7f86cac34640 1 -- 172.21.15.5:0/796312581 shutdown_connections 2023-07-14T12:53:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.477+0000 7f86cac34640 1 --2- 172.21.15.5:0/796312581 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86c40af2b0 0x7f86c415a1f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.477+0000 7f86cac34640 1 -- 172.21.15.5:0/796312581 >> 172.21.15.5:0/796312581 conn(0x7f86c40cde90 msgr2=0x7f86c40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.477+0000 7f86cac34640 1 -- 172.21.15.5:0/796312581 shutdown_connections 2023-07-14T12:53:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.477+0000 7f86cac34640 1 -- 172.21.15.5:0/796312581 wait complete. 2023-07-14T12:53:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.477+0000 7f86cac34640 1 Processor -- start 2023-07-14T12:53:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.481+0000 7f86cac34640 1 -- start start 2023-07-14T12:53:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.481+0000 7f86cac34640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86c4069430 0x7f86c414cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.481+0000 7f86cac34640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86c4070f30 0x7f86c40b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.481+0000 7f86cac34640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c40af2b0 0x7f86c40cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.481+0000 7f86cac34640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c4153ff0 con 0x7f86c40af2b0 2023-07-14T12:53:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.481+0000 7f86cac34640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c40b3410 con 0x7f86c4069430 2023-07-14T12:53:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.481+0000 7f86cac34640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c414d110 con 0x7f86c4070f30 2023-07-14T12:53:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.481+0000 7f86c91d1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c40af2b0 0x7f86c40cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.481+0000 7f86c91d1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c40af2b0 0x7f86c40cbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42132/0 (socket says 172.21.15.5:42132) 2023-07-14T12:53:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.481+0000 7f86c91d1640 1 -- 172.21.15.5:0/3915405691 learned_addr learned my addr 172.21.15.5:0/3915405691 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:25.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.481+0000 7f86c3fff640 1 --2- 172.21.15.5:0/3915405691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86c4070f30 0x7f86c40b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.481+0000 7f86c89d0640 1 --2- 172.21.15.5:0/3915405691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86c4069430 0x7f86c414cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.481+0000 7f86c91d1640 1 -- 172.21.15.5:0/3915405691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86c4070f30 msgr2=0x7f86c40b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.481+0000 7f86c91d1640 1 --2- 172.21.15.5:0/3915405691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86c4070f30 0x7f86c40b2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.481+0000 7f86c91d1640 1 -- 172.21.15.5:0/3915405691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86c4069430 msgr2=0x7f86c414cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.481+0000 7f86c91d1640 1 --2- 172.21.15.5:0/3915405691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86c4069430 0x7f86c414cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.481+0000 7f86c91d1640 1 -- 172.21.15.5:0/3915405691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86bc009a70 con 0x7f86c40af2b0 2023-07-14T12:53:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.481+0000 7f86c91d1640 1 --2- 172.21.15.5:0/3915405691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c40af2b0 0x7f86c40cbf00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f86bc098490 tx=0x7f86bc019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:25.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.481+0000 7f86c17fa640 1 -- 172.21.15.5:0/3915405691 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0b9860 con 0x7f86c40af2b0 2023-07-14T12:53:25.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.481+0000 7f86c17fa640 1 -- 172.21.15.5:0/3915405691 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc0b99c0 con 0x7f86c40af2b0 2023-07-14T12:53:25.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.481+0000 7f86c17fa640 1 -- 172.21.15.5:0/3915405691 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0b9d50 con 0x7f86c40af2b0 2023-07-14T12:53:25.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.481+0000 7f86cac34640 1 -- 172.21.15.5:0/3915405691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c414d3f0 con 0x7f86c40af2b0 2023-07-14T12:53:25.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.481+0000 7f86cac34640 1 -- 172.21.15.5:0/3915405691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c414d9b0 con 0x7f86c40af2b0 2023-07-14T12:53:25.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.481+0000 7f86cac34640 1 -- 172.21.15.5:0/3915405691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c40678d0 con 0x7f86c40af2b0 2023-07-14T12:53:25.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.485+0000 7f86c17fa640 1 -- 172.21.15.5:0/3915405691 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f86bc0c4460 con 0x7f86c40af2b0 2023-07-14T12:53:25.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.485+0000 7f86c17fa640 1 --2- 172.21.15.5:0/3915405691 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f86a80662b0 0x7f86a8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:25.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.485+0000 7f86c17fa640 1 -- 172.21.15.5:0/3915405691 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f86bc11ed40 con 0x7f86c40af2b0 2023-07-14T12:53:25.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.485+0000 7f86c89d0640 1 --2- 172.21.15.5:0/3915405691 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f86a80662b0 0x7f86a8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:25.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.485+0000 7f86c89d0640 1 --2- 172.21.15.5:0/3915405691 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f86a80662b0 0x7f86a8068760 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f86b80011f0 tx=0x7f86b8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:25.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.489+0000 7f86c17fa640 1 -- 172.21.15.5:0/3915405691 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f86bc0ec260 con 0x7f86c40af2b0 2023-07-14T12:53:25.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.645+0000 7f86cac34640 1 -- 172.21.15.5:0/3915405691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f86c40aeb80 con 0x7f86c40af2b0 2023-07-14T12:53:25.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.645+0000 7f86c17fa640 1 -- 172.21.15.5:0/3915405691 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f86bc0ef880 con 0x7f86c40af2b0 2023-07-14T12:53:25.674 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T12:53:25.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.649+0000 7f86cac34640 1 -- 172.21.15.5:0/3915405691 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f86a80662b0 msgr2=0x7f86a8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:25.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.649+0000 7f86cac34640 1 --2- 172.21.15.5:0/3915405691 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f86a80662b0 0x7f86a8068760 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f86b80011f0 tx=0x7f86b8009040 comp rx=0 tx=0).stop 2023-07-14T12:53:25.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.649+0000 7f86cac34640 1 -- 172.21.15.5:0/3915405691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c40af2b0 msgr2=0x7f86c40cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:25.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.649+0000 7f86cac34640 1 --2- 172.21.15.5:0/3915405691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c40af2b0 0x7f86c40cbf00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f86bc098490 tx=0x7f86bc019630 comp rx=0 tx=0).stop 2023-07-14T12:53:25.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.649+0000 7f86cac34640 1 -- 172.21.15.5:0/3915405691 shutdown_connections 2023-07-14T12:53:25.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.649+0000 7f86cac34640 1 --2- 172.21.15.5:0/3915405691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c40af2b0 0x7f86c40cbf00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:25.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.649+0000 7f86cac34640 1 --2- 172.21.15.5:0/3915405691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86c4070f30 0x7f86c40b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:25.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.649+0000 7f86cac34640 1 --2- 172.21.15.5:0/3915405691 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f86a80662b0 0x7f86a8068760 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:25.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.649+0000 7f86cac34640 1 --2- 172.21.15.5:0/3915405691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86c4069430 0x7f86c414cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:25.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.649+0000 7f86cac34640 1 -- 172.21.15.5:0/3915405691 >> 172.21.15.5:0/3915405691 conn(0x7f86c40cde90 msgr2=0x7f86c4152490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:25.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.649+0000 7f86cac34640 1 -- 172.21.15.5:0/3915405691 shutdown_connections 2023-07-14T12:53:25.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.649+0000 7f86cac34640 1 -- 172.21.15.5:0/3915405691 wait complete. 2023-07-14T12:53:25.695 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T12:53:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.817+0000 7fb682537640 1 Processor -- start 2023-07-14T12:53:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.817+0000 7fb682537640 1 -- start start 2023-07-14T12:53:25.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.817+0000 7fb682537640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb67c0cba60 0x7fb67c0c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:25.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.817+0000 7fb682537640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb67c1590a0 0x7fb67c159930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.817+0000 7fb682537640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb67c0c37e0 con 0x7fb67c15b9c0 2023-07-14T12:53:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.817+0000 7fb682537640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb67c0c3ac0 con 0x7fb67c0cba60 2023-07-14T12:53:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.817+0000 7fb682537640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c0c3da0 con 0x7fb67c1590a0 2023-07-14T12:53:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.817+0000 7fb67bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb67c0cba60 0x7fb67c0c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.817+0000 7fb67b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb67c15b9c0 0x7fb67c0cbe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47168/0 (socket says 172.21.15.5:47168) 2023-07-14T12:53:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.817+0000 7fb67b7fe640 1 -- 172.21.15.5:0/1337407012 learned_addr learned my addr 172.21.15.5:0/1337407012 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.817+0000 7fb680ad4640 1 --2- 172.21.15.5:0/1337407012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb67c1590a0 0x7fb67c159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.817+0000 7fb67bfff640 1 -- 172.21.15.5:0/1337407012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb67c1590a0 msgr2=0x7fb67c159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.817+0000 7fb67bfff640 1 --2- 172.21.15.5:0/1337407012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb67c1590a0 0x7fb67c159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.817+0000 7fb67bfff640 1 -- 172.21.15.5:0/1337407012 >> v1:172.21.15.5:6789/0 conn(0x7fb67c15b9c0 legacy=0x7fb67c0cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.817+0000 7fb67bfff640 1 -- 172.21.15.5:0/1337407012 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67c0c4080 con 0x7fb67c0cba60 2023-07-14T12:53:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.817+0000 7fb67affd640 1 -- 172.21.15.5:0/1337407012 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234501080 0 0) 0x7fb67c0c37e0 con 0x7fb67c15b9c0 2023-07-14T12:53:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.817+0000 7fb680ad4640 1 --2- 172.21.15.5:0/1337407012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb67c1590a0 0x7fb67c159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:25.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.821+0000 7fb67bfff640 1 --2- 172.21.15.5:0/1337407012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb67c0cba60 0x7fb67c0c3150 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0097c0 tx=0x7fb66c01c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a022ec98292eeaa server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:25.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.821+0000 7fb67affd640 1 -- 172.21.15.5:0/1337407012 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c0ab600 con 0x7fb67c0cba60 2023-07-14T12:53:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.821+0000 7fb67affd640 1 -- 172.21.15.5:0/1337407012 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66c0a7050 con 0x7fb67c0cba60 2023-07-14T12:53:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.821+0000 7fb67affd640 1 -- 172.21.15.5:0/1337407012 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c0ab980 con 0x7fb67c0cba60 2023-07-14T12:53:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.821+0000 7fb682537640 1 -- 172.21.15.5:0/1337407012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb67c0cba60 msgr2=0x7fb67c0c3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.821+0000 7fb682537640 1 --2- 172.21.15.5:0/1337407012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb67c0cba60 0x7fb67c0c3150 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0097c0 tx=0x7fb66c01c320 comp rx=0 tx=0).stop 2023-07-14T12:53:25.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.821+0000 7fb682537640 1 -- 172.21.15.5:0/1337407012 shutdown_connections 2023-07-14T12:53:25.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.821+0000 7fb682537640 1 --2- 172.21.15.5:0/1337407012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb67c1590a0 0x7fb67c159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:25.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.821+0000 7fb682537640 1 --2- 172.21.15.5:0/1337407012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb67c0cba60 0x7fb67c0c3150 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:25.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.821+0000 7fb682537640 1 -- 172.21.15.5:0/1337407012 >> 172.21.15.5:0/1337407012 conn(0x7fb67c0cde90 msgr2=0x7fb67c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:25.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.821+0000 7fb682537640 1 -- 172.21.15.5:0/1337407012 shutdown_connections 2023-07-14T12:53:25.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.821+0000 7fb682537640 1 -- 172.21.15.5:0/1337407012 wait complete. 2023-07-14T12:53:25.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.821+0000 7fb682537640 1 Processor -- start 2023-07-14T12:53:25.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.825+0000 7fb682537640 1 -- start start 2023-07-14T12:53:25.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.825+0000 7fb682537640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb67c0cba60 0x7fb67c0b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:25.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.825+0000 7fb682537640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb67c1590a0 0x7fb67c0b3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:25.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.825+0000 7fb682537640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb67c15b9c0 0x7fb67c14e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:25.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.825+0000 7fb682537640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c0b33f0 con 0x7fb67c15b9c0 2023-07-14T12:53:25.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.825+0000 7fb682537640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c14e710 con 0x7fb67c0cba60 2023-07-14T12:53:25.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.825+0000 7fb682537640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c0b2ac0 con 0x7fb67c1590a0 2023-07-14T12:53:25.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.825+0000 7fb680ad4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb67c15b9c0 0x7fb67c14e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:25.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.825+0000 7fb680ad4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb67c15b9c0 0x7fb67c14e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42150/0 (socket says 172.21.15.5:42150) 2023-07-14T12:53:25.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.825+0000 7fb680ad4640 1 -- 172.21.15.5:0/3644163854 learned_addr learned my addr 172.21.15.5:0/3644163854 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:25.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.825+0000 7fb67b7fe640 1 --2- 172.21.15.5:0/3644163854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb67c1590a0 0x7fb67c0b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:25.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.825+0000 7fb67bfff640 1 --2- 172.21.15.5:0/3644163854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb67c0cba60 0x7fb67c0b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:25.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.825+0000 7fb680ad4640 1 -- 172.21.15.5:0/3644163854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb67c1590a0 msgr2=0x7fb67c0b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:25.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.825+0000 7fb680ad4640 1 --2- 172.21.15.5:0/3644163854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb67c1590a0 0x7fb67c0b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:25.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.825+0000 7fb680ad4640 1 -- 172.21.15.5:0/3644163854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb67c0cba60 msgr2=0x7fb67c0b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:25.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.825+0000 7fb680ad4640 1 --2- 172.21.15.5:0/3644163854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb67c0cba60 0x7fb67c0b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:25.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.825+0000 7fb680ad4640 1 -- 172.21.15.5:0/3644163854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66c009420 con 0x7fb67c15b9c0 2023-07-14T12:53:25.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.825+0000 7fb67bfff640 1 --2- 172.21.15.5:0/3644163854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb67c0cba60 0x7fb67c0b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:25.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.825+0000 7fb680ad4640 1 --2- 172.21.15.5:0/3644163854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb67c15b9c0 0x7fb67c14e1d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb674007e10 tx=0x7fb67400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:25.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.825+0000 7fb678ff9640 1 -- 172.21.15.5:0/3644163854 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb674003ba0 con 0x7fb67c15b9c0 2023-07-14T12:53:25.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.825+0000 7fb678ff9640 1 -- 172.21.15.5:0/3644163854 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67400f040 con 0x7fb67c15b9c0 2023-07-14T12:53:25.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.825+0000 7fb678ff9640 1 -- 172.21.15.5:0/3644163854 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67400de80 con 0x7fb67c15b9c0 2023-07-14T12:53:25.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.825+0000 7fb682537640 1 -- 172.21.15.5:0/3644163854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb67c0b2da0 con 0x7fb67c15b9c0 2023-07-14T12:53:25.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.825+0000 7fb682537640 1 -- 172.21.15.5:0/3644163854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb67c0b13e0 con 0x7fb67c15b9c0 2023-07-14T12:53:25.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.825+0000 7fb682537640 1 -- 172.21.15.5:0/3644163854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb67c0714b0 con 0x7fb67c15b9c0 2023-07-14T12:53:25.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.829+0000 7fb678ff9640 1 -- 172.21.15.5:0/3644163854 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb674004030 con 0x7fb67c15b9c0 2023-07-14T12:53:25.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.829+0000 7fb678ff9640 1 --2- 172.21.15.5:0/3644163854 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb668066280 0x7fb668068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:25.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.829+0000 7fb678ff9640 1 -- 172.21.15.5:0/3644163854 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb674083ff0 con 0x7fb67c15b9c0 2023-07-14T12:53:25.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.829+0000 7fb67bfff640 1 --2- 172.21.15.5:0/3644163854 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb668066280 0x7fb668068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:25.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.829+0000 7fb67bfff640 1 --2- 172.21.15.5:0/3644163854 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb668066280 0x7fb668068730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0ad000 tx=0x7fb66c0a4f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:25.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.833+0000 7fb678ff9640 1 -- 172.21.15.5:0/3644163854 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb674051480 con 0x7fb67c15b9c0 2023-07-14T12:53:26.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.985+0000 7fb682537640 1 -- 172.21.15.5:0/3644163854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb67c0678d0 con 0x7fb67c15b9c0 2023-07-14T12:53:26.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.985+0000 7fb678ff9640 1 -- 172.21.15.5:0/3644163854 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb67401a0a0 con 0x7fb67c15b9c0 2023-07-14T12:53:26.014 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T12:53:26.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.989+0000 7fb682537640 1 -- 172.21.15.5:0/3644163854 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb668066280 msgr2=0x7fb668068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:26.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.989+0000 7fb682537640 1 --2- 172.21.15.5:0/3644163854 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb668066280 0x7fb668068730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0ad000 tx=0x7fb66c0a4f90 comp rx=0 tx=0).stop 2023-07-14T12:53:26.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.989+0000 7fb682537640 1 -- 172.21.15.5:0/3644163854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb67c15b9c0 msgr2=0x7fb67c14e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:26.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.989+0000 7fb682537640 1 --2- 172.21.15.5:0/3644163854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb67c15b9c0 0x7fb67c14e1d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb674007e10 tx=0x7fb67400d4a0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.989+0000 7fb682537640 1 -- 172.21.15.5:0/3644163854 shutdown_connections 2023-07-14T12:53:26.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.989+0000 7fb682537640 1 --2- 172.21.15.5:0/3644163854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb67c15b9c0 0x7fb67c14e1d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.989+0000 7fb682537640 1 --2- 172.21.15.5:0/3644163854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb67c1590a0 0x7fb67c0b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.989+0000 7fb682537640 1 --2- 172.21.15.5:0/3644163854 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb668066280 0x7fb668068730 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.989+0000 7fb682537640 1 --2- 172.21.15.5:0/3644163854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb67c0cba60 0x7fb67c0b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.989+0000 7fb682537640 1 -- 172.21.15.5:0/3644163854 >> 172.21.15.5:0/3644163854 conn(0x7fb67c0cde90 msgr2=0x7fb67c0cbe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.989+0000 7fb682537640 1 -- 172.21.15.5:0/3644163854 shutdown_connections 2023-07-14T12:53:26.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:25.989+0000 7fb682537640 1 -- 172.21.15.5:0/3644163854 wait complete. 2023-07-14T12:53:26.035 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T12:53:26.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.157+0000 7fbecc0f9640 1 Processor -- start 2023-07-14T12:53:26.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.157+0000 7fbecc0f9640 1 -- start start 2023-07-14T12:53:26.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.157+0000 7fbecc0f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbec4070f30 0x7fbec40ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:26.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.157+0000 7fbecc0f9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbec40af2b0 0x7fbec415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:26.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.157+0000 7fbecc0f9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec4159d70 con 0x7fbec4069430 2023-07-14T12:53:26.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.157+0000 7fbecc0f9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbec40c9c60 con 0x7fbec40af2b0 2023-07-14T12:53:26.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.157+0000 7fbecc0f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec40c9f40 con 0x7fbec4070f30 2023-07-14T12:53:26.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.157+0000 7fbec9694640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbec4070f30 0x7fbec40ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:26.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.157+0000 7fbeca696640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbec40af2b0 0x7fbec415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:26.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.157+0000 7fbec9694640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbec4070f30 0x7fbec40ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:33322/0 (socket says 172.21.15.5:33322) 2023-07-14T12:53:26.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.157+0000 7fbec9694640 1 -- 172.21.15.5:0/2004122536 learned_addr learned my addr 172.21.15.5:0/2004122536 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:26.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.157+0000 7fbec9e95640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbec4069430 0x7fbec4069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:44208/0 (socket says 172.21.15.5:44208) 2023-07-14T12:53:26.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.157+0000 7fbec9694640 1 -- 172.21.15.5:0/2004122536 >> v2:172.21.15.154:3300/0 conn(0x7fbec40af2b0 msgr2=0x7fbec415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:26.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.157+0000 7fbec9694640 1 --2- 172.21.15.5:0/2004122536 >> v2:172.21.15.154:3300/0 conn(0x7fbec40af2b0 0x7fbec415a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.157+0000 7fbec8e93640 1 -- 172.21.15.5:0/2004122536 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14559786 0 0) 0x7fbec0001120 con 0x7fbec4069430 2023-07-14T12:53:26.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.157+0000 7fbec9694640 1 -- 172.21.15.5:0/2004122536 >> v1:172.21.15.154:6789/0 conn(0x7fbec4069430 legacy=0x7fbec4069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:26.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.157+0000 7fbec9694640 1 -- 172.21.15.5:0/2004122536 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec40ca220 con 0x7fbec4070f30 2023-07-14T12:53:26.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.161+0000 7fbec9694640 1 --2- 172.21.15.5:0/2004122536 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbec4070f30 0x7fbec40ad6f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4009870 tx=0x7fbeb401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cf0d7bb5c061dc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:26.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.161+0000 7fbec8e93640 1 -- 172.21.15.5:0/2004122536 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb40a9400 con 0x7fbec4070f30 2023-07-14T12:53:26.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.161+0000 7fbec8e93640 1 -- 172.21.15.5:0/2004122536 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb40a9560 con 0x7fbec4070f30 2023-07-14T12:53:26.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.161+0000 7fbec8e93640 1 -- 172.21.15.5:0/2004122536 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb40a98f0 con 0x7fbec4070f30 2023-07-14T12:53:26.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.161+0000 7fbecc0f9640 1 -- 172.21.15.5:0/2004122536 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbec4070f30 msgr2=0x7fbec40ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:26.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.161+0000 7fbecc0f9640 1 --2- 172.21.15.5:0/2004122536 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbec4070f30 0x7fbec40ad6f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4009870 tx=0x7fbeb401c540 comp rx=0 tx=0).stop 2023-07-14T12:53:26.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.161+0000 7fbecc0f9640 1 -- 172.21.15.5:0/2004122536 shutdown_connections 2023-07-14T12:53:26.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.161+0000 7fbecc0f9640 1 --2- 172.21.15.5:0/2004122536 >> v2:172.21.15.154:3300/0 conn(0x7fbec40af2b0 0x7fbec415a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.161+0000 7fbecc0f9640 1 --2- 172.21.15.5:0/2004122536 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbec4070f30 0x7fbec40ad6f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.161+0000 7fbecc0f9640 1 -- 172.21.15.5:0/2004122536 >> 172.21.15.5:0/2004122536 conn(0x7fbec40cde90 msgr2=0x7fbec40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:26.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.161+0000 7fbecc0f9640 1 -- 172.21.15.5:0/2004122536 shutdown_connections 2023-07-14T12:53:26.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.161+0000 7fbecc0f9640 1 -- 172.21.15.5:0/2004122536 wait complete. 2023-07-14T12:53:26.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.165+0000 7fbecc0f9640 1 Processor -- start 2023-07-14T12:53:26.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.165+0000 7fbecc0f9640 1 -- start start 2023-07-14T12:53:26.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.165+0000 7fbecc0f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbec4069430 0x7fbec414d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:26.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.165+0000 7fbecc0f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbec4070f30 0x7fbec414c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:26.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.165+0000 7fbecc0f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbec40af2b0 0x7fbec406c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:26.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.165+0000 7fbecc0f9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec414dc30 con 0x7fbec40af2b0 2023-07-14T12:53:26.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.165+0000 7fbecc0f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec414de60 con 0x7fbec4070f30 2023-07-14T12:53:26.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.165+0000 7fbecc0f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec40b0e60 con 0x7fbec4069430 2023-07-14T12:53:26.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.165+0000 7fbeca696640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbec40af2b0 0x7fbec406c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:26.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.165+0000 7fbec9694640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbec4070f30 0x7fbec414c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:26.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.165+0000 7fbec9e95640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbec4069430 0x7fbec414d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:26.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.165+0000 7fbec9694640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbec4070f30 0x7fbec414c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:44076/0 (socket says 172.21.15.5:44076) 2023-07-14T12:53:26.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.165+0000 7fbec9694640 1 -- 172.21.15.5:0/2048984088 learned_addr learned my addr 172.21.15.5:0/2048984088 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:26.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.165+0000 7fbeca696640 1 -- 172.21.15.5:0/2048984088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbec4069430 msgr2=0x7fbec414d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:26.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.165+0000 7fbeca696640 1 --2- 172.21.15.5:0/2048984088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbec4069430 0x7fbec414d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.165+0000 7fbeca696640 1 -- 172.21.15.5:0/2048984088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbec4070f30 msgr2=0x7fbec414c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:26.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.165+0000 7fbeca696640 1 --2- 172.21.15.5:0/2048984088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbec4070f30 0x7fbec414c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.165+0000 7fbeca696640 1 -- 172.21.15.5:0/2048984088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb40094d0 con 0x7fbec40af2b0 2023-07-14T12:53:26.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.165+0000 7fbec9694640 1 --2- 172.21.15.5:0/2048984088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbec4070f30 0x7fbec414c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:53:26.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.165+0000 7fbeca696640 1 --2- 172.21.15.5:0/2048984088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbec40af2b0 0x7fbec406c270 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbebc00efc0 tx=0x7fbebc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:26.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.165+0000 7fbeba7fc640 1 -- 172.21.15.5:0/2048984088 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc009c00 con 0x7fbec40af2b0 2023-07-14T12:53:26.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.165+0000 7fbeba7fc640 1 -- 172.21.15.5:0/2048984088 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc00f040 con 0x7fbec40af2b0 2023-07-14T12:53:26.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.165+0000 7fbeba7fc640 1 -- 172.21.15.5:0/2048984088 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc0146c0 con 0x7fbec40af2b0 2023-07-14T12:53:26.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.165+0000 7fbecc0f9640 1 -- 172.21.15.5:0/2048984088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec40b1140 con 0x7fbec40af2b0 2023-07-14T12:53:26.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.165+0000 7fbecc0f9640 1 -- 172.21.15.5:0/2048984088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec40b1700 con 0x7fbec40af2b0 2023-07-14T12:53:26.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.169+0000 7fbecc0f9640 1 -- 172.21.15.5:0/2048984088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec40b18f0 con 0x7fbec40af2b0 2023-07-14T12:53:26.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.169+0000 7fbeba7fc640 1 -- 172.21.15.5:0/2048984088 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbebc014820 con 0x7fbec40af2b0 2023-07-14T12:53:26.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.169+0000 7fbeba7fc640 1 --2- 172.21.15.5:0/2048984088 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fbea8066280 0x7fbea8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:26.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.169+0000 7fbeba7fc640 1 -- 172.21.15.5:0/2048984088 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbebc084b90 con 0x7fbec40af2b0 2023-07-14T12:53:26.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.169+0000 7fbec9e95640 1 --2- 172.21.15.5:0/2048984088 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fbea8066280 0x7fbea8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:26.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.169+0000 7fbec9e95640 1 --2- 172.21.15.5:0/2048984088 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fbea8066280 0x7fbea8068730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbec0000f70 tx=0x7fbec0007df0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:26.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.173+0000 7fbeba7fc640 1 -- 172.21.15.5:0/2048984088 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fbebc052020 con 0x7fbec40af2b0 2023-07-14T12:53:26.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.329+0000 7fbecc0f9640 1 -- 172.21.15.5:0/2048984088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbec40678d0 con 0x7fbec40af2b0 2023-07-14T12:53:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.329+0000 7fbeba7fc640 1 -- 172.21.15.5:0/2048984088 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbebc018020 con 0x7fbec40af2b0 2023-07-14T12:53:26.356 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T12:53:26.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.329+0000 7fbecc0f9640 1 -- 172.21.15.5:0/2048984088 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fbea8066280 msgr2=0x7fbea8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:26.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.329+0000 7fbecc0f9640 1 --2- 172.21.15.5:0/2048984088 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fbea8066280 0x7fbea8068730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbec0000f70 tx=0x7fbec0007df0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.329+0000 7fbecc0f9640 1 -- 172.21.15.5:0/2048984088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbec40af2b0 msgr2=0x7fbec406c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:26.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.329+0000 7fbecc0f9640 1 --2- 172.21.15.5:0/2048984088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbec40af2b0 0x7fbec406c270 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbebc00efc0 tx=0x7fbebc00c490 comp rx=0 tx=0).stop 2023-07-14T12:53:26.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.329+0000 7fbecc0f9640 1 -- 172.21.15.5:0/2048984088 shutdown_connections 2023-07-14T12:53:26.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.329+0000 7fbecc0f9640 1 --2- 172.21.15.5:0/2048984088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbec40af2b0 0x7fbec406c270 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.329+0000 7fbecc0f9640 1 --2- 172.21.15.5:0/2048984088 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fbea8066280 0x7fbea8068730 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.329+0000 7fbecc0f9640 1 --2- 172.21.15.5:0/2048984088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbec4070f30 0x7fbec414c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.329+0000 7fbecc0f9640 1 --2- 172.21.15.5:0/2048984088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbec4069430 0x7fbec414d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.329+0000 7fbecc0f9640 1 -- 172.21.15.5:0/2048984088 >> 172.21.15.5:0/2048984088 conn(0x7fbec40cde90 msgr2=0x7fbec40ccab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:26.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.329+0000 7fbecc0f9640 1 -- 172.21.15.5:0/2048984088 shutdown_connections 2023-07-14T12:53:26.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.329+0000 7fbecc0f9640 1 -- 172.21.15.5:0/2048984088 wait complete. 2023-07-14T12:53:26.377 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T12:53:26.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.497+0000 7f21da3fa640 1 Processor -- start 2023-07-14T12:53:26.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.497+0000 7f21da3fa640 1 -- start start 2023-07-14T12:53:26.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.497+0000 7f21da3fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21d4069430 0x7f21d4069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:26.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.497+0000 7f21da3fa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f21d40af2b0 0x7f21d415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:26.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.497+0000 7f21da3fa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d4159d70 con 0x7f21d4070f30 2023-07-14T12:53:26.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.497+0000 7f21da3fa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d4069d40 con 0x7f21d40af2b0 2023-07-14T12:53:26.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.497+0000 7f21da3fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d40c9c60 con 0x7f21d4069430 2023-07-14T12:53:26.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.497+0000 7f21d3fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21d4069430 0x7f21d4069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:26.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.497+0000 7f21d3fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21d4069430 0x7f21d4069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:33334/0 (socket says 172.21.15.5:33334) 2023-07-14T12:53:26.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.497+0000 7f21d3fff640 1 -- 172.21.15.5:0/1598231366 learned_addr learned my addr 172.21.15.5:0/1598231366 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:26.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.497+0000 7f21d8997640 1 --2- 172.21.15.5:0/1598231366 >> v2:172.21.15.154:3300/0 conn(0x7f21d40af2b0 0x7f21d415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:26.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.497+0000 7f21d3fff640 1 -- 172.21.15.5:0/1598231366 >> v2:172.21.15.154:3300/0 conn(0x7f21d40af2b0 msgr2=0x7f21d415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:26.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.497+0000 7f21d3fff640 1 --2- 172.21.15.5:0/1598231366 >> v2:172.21.15.154:3300/0 conn(0x7f21d40af2b0 0x7f21d415a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.497+0000 7f21d3fff640 1 -- 172.21.15.5:0/1598231366 >> v1:172.21.15.154:6789/0 conn(0x7f21d4070f30 legacy=0x7f21d40ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:26.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.497+0000 7f21d3fff640 1 -- 172.21.15.5:0/1598231366 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d40c9f40 con 0x7f21d4069430 2023-07-14T12:53:26.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.501+0000 7f21d3fff640 1 --2- 172.21.15.5:0/1598231366 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21d4069430 0x7f21d4069800 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009870 tx=0x7f21c401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecdb0dc78f62d742 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:26.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.501+0000 7f21d2ffd640 1 -- 172.21.15.5:0/1598231366 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c40ab650 con 0x7f21d4069430 2023-07-14T12:53:26.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.501+0000 7f21d2ffd640 1 -- 172.21.15.5:0/1598231366 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c40ab7b0 con 0x7f21d4069430 2023-07-14T12:53:26.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.501+0000 7f21d2ffd640 1 -- 172.21.15.5:0/1598231366 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c40abb40 con 0x7f21d4069430 2023-07-14T12:53:26.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.501+0000 7f21da3fa640 1 -- 172.21.15.5:0/1598231366 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21d4069430 msgr2=0x7f21d4069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:26.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.501+0000 7f21da3fa640 1 --2- 172.21.15.5:0/1598231366 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21d4069430 0x7f21d4069800 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009870 tx=0x7f21c401c540 comp rx=0 tx=0).stop 2023-07-14T12:53:26.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.501+0000 7f21da3fa640 1 -- 172.21.15.5:0/1598231366 shutdown_connections 2023-07-14T12:53:26.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.501+0000 7f21da3fa640 1 --2- 172.21.15.5:0/1598231366 >> v2:172.21.15.154:3300/0 conn(0x7f21d40af2b0 0x7f21d415a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.501+0000 7f21da3fa640 1 --2- 172.21.15.5:0/1598231366 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21d4069430 0x7f21d4069800 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.501+0000 7f21da3fa640 1 -- 172.21.15.5:0/1598231366 >> 172.21.15.5:0/1598231366 conn(0x7f21d40cde90 msgr2=0x7f21d40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:26.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.501+0000 7f21da3fa640 1 -- 172.21.15.5:0/1598231366 shutdown_connections 2023-07-14T12:53:26.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.501+0000 7f21da3fa640 1 -- 172.21.15.5:0/1598231366 wait complete. 2023-07-14T12:53:26.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.505+0000 7f21da3fa640 1 Processor -- start 2023-07-14T12:53:26.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.505+0000 7f21da3fa640 1 -- start start 2023-07-14T12:53:26.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.505+0000 7f21da3fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d4069430 0x7f21d40b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:26.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.505+0000 7f21da3fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d4070f30 0x7f21d40b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.505+0000 7f21da3fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21d40af2b0 0x7f21d414d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.505+0000 7f21da3fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d40b2350 con 0x7f21d4069430 2023-07-14T12:53:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.505+0000 7f21da3fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d40b3b20 con 0x7f21d4070f30 2023-07-14T12:53:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.505+0000 7f21da3fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d40b3e00 con 0x7f21d40af2b0 2023-07-14T12:53:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.505+0000 7f21d3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d4069430 0x7f21d40b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.505+0000 7f21d3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d4069430 0x7f21d40b2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42176/0 (socket says 172.21.15.5:42176) 2023-07-14T12:53:26.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.505+0000 7f21d3fff640 1 -- 172.21.15.5:0/3386150686 learned_addr learned my addr 172.21.15.5:0/3386150686 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:26.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.505+0000 7f21d3fff640 1 -- 172.21.15.5:0/3386150686 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21d40af2b0 msgr2=0x7f21d414d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:26.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.505+0000 7f21d3fff640 1 --2- 172.21.15.5:0/3386150686 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21d40af2b0 0x7f21d414d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.505+0000 7f21d3fff640 1 -- 172.21.15.5:0/3386150686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d4070f30 msgr2=0x7f21d40b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:26.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.505+0000 7f21d3fff640 1 --2- 172.21.15.5:0/3386150686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d4070f30 0x7f21d40b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.505+0000 7f21d3fff640 1 -- 172.21.15.5:0/3386150686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c40094d0 con 0x7f21d4069430 2023-07-14T12:53:26.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.505+0000 7f21d3fff640 1 --2- 172.21.15.5:0/3386150686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d4069430 0x7f21d40b2f70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f21c40ad040 tx=0x7f21c401ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:26.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.505+0000 7f21d0ff9640 1 -- 172.21.15.5:0/3386150686 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c40be5f0 con 0x7f21d4069430 2023-07-14T12:53:26.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.505+0000 7f21d0ff9640 1 -- 172.21.15.5:0/3386150686 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c40be770 con 0x7f21d4069430 2023-07-14T12:53:26.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.505+0000 7f21da3fa640 1 -- 172.21.15.5:0/3386150686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d40b1870 con 0x7f21d4069430 2023-07-14T12:53:26.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.505+0000 7f21d0ff9640 1 -- 172.21.15.5:0/3386150686 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c40beb20 con 0x7f21d4069430 2023-07-14T12:53:26.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.505+0000 7f21da3fa640 1 -- 172.21.15.5:0/3386150686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d40b1e30 con 0x7f21d4069430 2023-07-14T12:53:26.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.509+0000 7f21da3fa640 1 -- 172.21.15.5:0/3386150686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d40678d0 con 0x7f21d4069430 2023-07-14T12:53:26.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.509+0000 7f21d0ff9640 1 -- 172.21.15.5:0/3386150686 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f21c40b43f0 con 0x7f21d4069430 2023-07-14T12:53:26.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.509+0000 7f21d0ff9640 1 --2- 172.21.15.5:0/3386150686 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f21c0066280 0x7f21c0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:26.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.509+0000 7f21d0ff9640 1 -- 172.21.15.5:0/3386150686 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f21c411e1c0 con 0x7f21d4069430 2023-07-14T12:53:26.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.509+0000 7f21d37fe640 1 --2- 172.21.15.5:0/3386150686 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f21c0066280 0x7f21c0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:26.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.509+0000 7f21d37fe640 1 --2- 172.21.15.5:0/3386150686 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f21c0066280 0x7f21c0068730 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f21c8000f70 tx=0x7f21c80079e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:26.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.513+0000 7f21d0ff9640 1 -- 172.21.15.5:0/3386150686 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f21c40eb6d0 con 0x7f21d4069430 2023-07-14T12:53:26.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.669+0000 7f21da3fa640 1 -- 172.21.15.5:0/3386150686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f21d40b2020 con 0x7f21d4069430 2023-07-14T12:53:26.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.673+0000 7f21d0ff9640 1 -- 172.21.15.5:0/3386150686 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f21c40eecf0 con 0x7f21d4069430 2023-07-14T12:53:26.700 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T12:53:26.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.673+0000 7f21da3fa640 1 -- 172.21.15.5:0/3386150686 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f21c0066280 msgr2=0x7f21c0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:26.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.673+0000 7f21da3fa640 1 --2- 172.21.15.5:0/3386150686 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f21c0066280 0x7f21c0068730 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f21c8000f70 tx=0x7f21c80079e0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.673+0000 7f21da3fa640 1 -- 172.21.15.5:0/3386150686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d4069430 msgr2=0x7f21d40b2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:26.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.673+0000 7f21da3fa640 1 --2- 172.21.15.5:0/3386150686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d4069430 0x7f21d40b2f70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f21c40ad040 tx=0x7f21c401ad80 comp rx=0 tx=0).stop 2023-07-14T12:53:26.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.673+0000 7f21da3fa640 1 -- 172.21.15.5:0/3386150686 shutdown_connections 2023-07-14T12:53:26.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.673+0000 7f21da3fa640 1 --2- 172.21.15.5:0/3386150686 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21d40af2b0 0x7f21d414d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.673+0000 7f21da3fa640 1 --2- 172.21.15.5:0/3386150686 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f21c0066280 0x7f21c0068730 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.673+0000 7f21da3fa640 1 --2- 172.21.15.5:0/3386150686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d4070f30 0x7f21d40b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.673+0000 7f21da3fa640 1 --2- 172.21.15.5:0/3386150686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21d4069430 0x7f21d40b2f70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.673+0000 7f21da3fa640 1 -- 172.21.15.5:0/3386150686 >> 172.21.15.5:0/3386150686 conn(0x7f21d40cde90 msgr2=0x7f21d41582e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:26.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.673+0000 7f21da3fa640 1 -- 172.21.15.5:0/3386150686 shutdown_connections 2023-07-14T12:53:26.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.673+0000 7f21da3fa640 1 -- 172.21.15.5:0/3386150686 wait complete. 2023-07-14T12:53:26.721 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T12:53:26.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f3728e0b640 1 Processor -- start 2023-07-14T12:53:26.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f3728e0b640 1 -- start start 2023-07-14T12:53:26.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f3728e0b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3724070b70 0x7f3724070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:26.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f3728e0b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37240cac70 con 0x7f372406b1e0 2023-07-14T12:53:26.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f3728e0b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3724071480 con 0x7f37240cb100 2023-07-14T12:53:26.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f3728e0b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37240ca060 con 0x7f3724070b70 2023-07-14T12:53:26.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f371bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f372406b1e0 0x7f37240c1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47172/0 (socket says 172.21.15.5:47172) 2023-07-14T12:53:26.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f371bfff640 1 -- 172.21.15.5:0/3530911544 learned_addr learned my addr 172.21.15.5:0/3530911544 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:26.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f372259c640 1 --2- 172.21.15.5:0/3530911544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3724070b70 0x7f3724070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:26.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f3721d9b640 1 -- 172.21.15.5:0/3530911544 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191397622 0 0) 0x7f37240cac70 con 0x7f372406b1e0 2023-07-14T12:53:26.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f3721d9b640 1 -- 172.21.15.5:0/3530911544 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3710003530 con 0x7f372406b1e0 2023-07-14T12:53:26.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f3721d9b640 1 -- 172.21.15.5:0/3530911544 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2191993193 0 0) 0x7f3724071480 con 0x7f37240cb100 2023-07-14T12:53:26.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f3721d9b640 1 -- 172.21.15.5:0/3530911544 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37240cac70 con 0x7f37240cb100 2023-07-14T12:53:26.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f3721d9b640 1 -- 172.21.15.5:0/3530911544 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2110678769 0 0) 0x7f3710003530 con 0x7f372406b1e0 2023-07-14T12:53:26.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f3721d9b640 1 -- 172.21.15.5:0/3530911544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3724070b70 msgr2=0x7f3724070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:26.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f3721d9b640 1 --2- 172.21.15.5:0/3530911544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3724070b70 0x7f3724070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f3721d9b640 1 -- 172.21.15.5:0/3530911544 >> v1:172.21.15.154:6789/0 conn(0x7f37240cb100 legacy=0x7f37241642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:26.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f3721d9b640 1 -- 172.21.15.5:0/3530911544 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37240ca340 con 0x7f372406b1e0 2023-07-14T12:53:26.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f3721d9b640 1 -- 172.21.15.5:0/3530911544 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f370c001680 con 0x7f372406b1e0 2023-07-14T12:53:26.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f3721d9b640 1 -- 172.21.15.5:0/3530911544 >> v1:172.21.15.5:6789/0 conn(0x7f372406b1e0 legacy=0x7f37240c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:26.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f3721d9b640 1 --2- 172.21.15.5:0/3530911544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3710003b40 0x7f3710003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:26.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f3721d9b640 1 --2- 172.21.15.5:0/3530911544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3724070b70 0x7f37100047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:26.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f3721d9b640 1 --2- 172.21.15.5:0/3530911544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3710004d10 0x7f3710005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:26.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f3721d9b640 1 -- 172.21.15.5:0/3530911544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37240ca060 con 0x7f3710003b40 2023-07-14T12:53:26.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f3721d9b640 1 -- 172.21.15.5:0/3530911544 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371000bb20 con 0x7f3710004d10 2023-07-14T12:53:26.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f3721d9b640 1 -- 172.21.15.5:0/3530911544 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371000bc90 con 0x7f3724070b70 2023-07-14T12:53:26.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f372259c640 1 --2- 172.21.15.5:0/3530911544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3710003b40 0x7f3710003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:26.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f371bfff640 1 --2- 172.21.15.5:0/3530911544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3724070b70 0x7f37100047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:26.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f3722d9d640 1 --2- 172.21.15.5:0/3530911544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3710004d10 0x7f3710005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:26.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f372259c640 1 -- 172.21.15.5:0/3530911544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3724070b70 msgr2=0x7f37100047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:26.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f372259c640 1 --2- 172.21.15.5:0/3530911544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3724070b70 0x7f37100047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f372259c640 1 -- 172.21.15.5:0/3530911544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3710004d10 msgr2=0x7f3710005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:26.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f372259c640 1 --2- 172.21.15.5:0/3530911544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3710004d10 0x7f3710005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f372259c640 1 -- 172.21.15.5:0/3530911544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3710003530 con 0x7f3710003b40 2023-07-14T12:53:26.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.841+0000 7f3722d9d640 1 --2- 172.21.15.5:0/3530911544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3710004d10 0x7f3710005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:26.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.845+0000 7f372259c640 1 --2- 172.21.15.5:0/3530911544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3710003b40 0x7f3710003f30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3714009ab0 tx=0x7f371401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ce49bf255ebc64 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:26.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.845+0000 7f3721d9b640 1 -- 172.21.15.5:0/3530911544 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37140a64f0 con 0x7f3710003b40 2023-07-14T12:53:26.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.845+0000 7f3721d9b640 1 -- 172.21.15.5:0/3530911544 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37140a6650 con 0x7f3710003b40 2023-07-14T12:53:26.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.845+0000 7f3721d9b640 1 -- 172.21.15.5:0/3530911544 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37140a6a00 con 0x7f3710003b40 2023-07-14T12:53:26.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.845+0000 7f3728e0b640 1 -- 172.21.15.5:0/3530911544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3710003b40 msgr2=0x7f3710003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:26.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.845+0000 7f3728e0b640 1 --2- 172.21.15.5:0/3530911544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3710003b40 0x7f3710003f30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3714009ab0 tx=0x7f371401ca00 comp rx=0 tx=0).stop 2023-07-14T12:53:26.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.845+0000 7f3722d9d640 1 -- 172.21.15.5:0/3530911544 reap_dead start 2023-07-14T12:53:26.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.845+0000 7f3728e0b640 1 -- 172.21.15.5:0/3530911544 shutdown_connections 2023-07-14T12:53:26.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.845+0000 7f3728e0b640 1 -- 172.21.15.5:0/3530911544 >> 172.21.15.5:0/3530911544 conn(0x7f37240afcf0 msgr2=0x7f37240b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:26.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.845+0000 7f3728e0b640 1 -- 172.21.15.5:0/3530911544 shutdown_connections 2023-07-14T12:53:26.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.845+0000 7f3728e0b640 1 -- 172.21.15.5:0/3530911544 wait complete. 2023-07-14T12:53:26.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.849+0000 7f3728e0b640 1 Processor -- start 2023-07-14T12:53:26.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.849+0000 7f3728e0b640 1 -- start start 2023-07-14T12:53:26.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.849+0000 7f3728e0b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3710003b40 0x7f372415cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:26.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.849+0000 7f3728e0b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3724151200 0x7f37241f44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:26.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.849+0000 7f3728e0b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37240b1ac0 0x7f37240b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:26.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.849+0000 7f3728e0b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37241f9010 con 0x7f37240b1ac0 2023-07-14T12:53:26.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.849+0000 7f3728e0b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37240b2470 con 0x7f3724151200 2023-07-14T12:53:26.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.849+0000 7f3728e0b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372415d480 con 0x7f3710003b40 2023-07-14T12:53:26.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.849+0000 7f3722d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37240b1ac0 0x7f37240b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:26.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.849+0000 7f372259c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3710003b40 0x7f372415cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:26.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.849+0000 7f372259c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3710003b40 0x7f372415cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:33364/0 (socket says 172.21.15.5:33364) 2023-07-14T12:53:26.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.849+0000 7f372259c640 1 -- 172.21.15.5:0/3391878006 learned_addr learned my addr 172.21.15.5:0/3391878006 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:26.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.849+0000 7f3722d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37240b1ac0 0x7f37240b1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42206/0 (socket says 172.21.15.5:42206) 2023-07-14T12:53:26.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.849+0000 7f371bfff640 1 --2- 172.21.15.5:0/3391878006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3724151200 0x7f37241f44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:26.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.849+0000 7f3722d9d640 1 -- 172.21.15.5:0/3391878006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3710003b40 msgr2=0x7f372415cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:26.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.849+0000 7f3722d9d640 1 --2- 172.21.15.5:0/3391878006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3710003b40 0x7f372415cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.849+0000 7f3722d9d640 1 -- 172.21.15.5:0/3391878006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3724151200 msgr2=0x7f37241f44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:26.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.849+0000 7f3722d9d640 1 --2- 172.21.15.5:0/3391878006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3724151200 0x7f37241f44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:26.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.849+0000 7f3722d9d640 1 -- 172.21.15.5:0/3391878006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37241f8140 con 0x7f37240b1ac0 2023-07-14T12:53:26.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.849+0000 7f3722d9d640 1 --2- 172.21.15.5:0/3391878006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37240b1ac0 0x7f37240b1f30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f372406f3a0 tx=0x7f371c00d830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:26.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.849+0000 7f371affd640 1 -- 172.21.15.5:0/3391878006 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c00b070 con 0x7f37240b1ac0 2023-07-14T12:53:26.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.849+0000 7f371affd640 1 -- 172.21.15.5:0/3391878006 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371c003980 con 0x7f37240b1ac0 2023-07-14T12:53:26.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.849+0000 7f371affd640 1 -- 172.21.15.5:0/3391878006 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c003d30 con 0x7f37240b1ac0 2023-07-14T12:53:26.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.849+0000 7f3728e0b640 1 -- 172.21.15.5:0/3391878006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37241f4a10 con 0x7f37240b1ac0 2023-07-14T12:53:26.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.849+0000 7f3728e0b640 1 -- 172.21.15.5:0/3391878006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37241f8670 con 0x7f37240b1ac0 2023-07-14T12:53:26.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.853+0000 7f3728e0b640 1 -- 172.21.15.5:0/3391878006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37240cbd30 con 0x7f37240b1ac0 2023-07-14T12:53:26.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.853+0000 7f371affd640 1 -- 172.21.15.5:0/3391878006 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f371c005070 con 0x7f37240b1ac0 2023-07-14T12:53:26.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.853+0000 7f371affd640 1 --2- 172.21.15.5:0/3391878006 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3704066280 0x7f3704068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:26.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.853+0000 7f371affd640 1 -- 172.21.15.5:0/3391878006 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f371c082b50 con 0x7f37240b1ac0 2023-07-14T12:53:26.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.853+0000 7f372259c640 1 --2- 172.21.15.5:0/3391878006 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3704066280 0x7f3704068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:26.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.853+0000 7f372259c640 1 --2- 172.21.15.5:0/3391878006 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3704066280 0x7f3704068730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3714000c10 tx=0x7f37140046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:26.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:26.857+0000 7f371affd640 1 -- 172.21.15.5:0/3391878006 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f371c050030 con 0x7f37240b1ac0 2023-07-14T12:53:27.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.025+0000 7f3728e0b640 1 -- 172.21.15.5:0/3391878006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f372406f580 con 0x7f37240b1ac0 2023-07-14T12:53:27.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.025+0000 7f371affd640 1 -- 172.21.15.5:0/3391878006 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f371c018080 con 0x7f37240b1ac0 2023-07-14T12:53:27.053 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-07-14T12:53:27.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.025+0000 7f3728e0b640 1 -- 172.21.15.5:0/3391878006 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3704066280 msgr2=0x7f3704068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:27.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.025+0000 7f3728e0b640 1 --2- 172.21.15.5:0/3391878006 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3704066280 0x7f3704068730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3714000c10 tx=0x7f37140046d0 comp rx=0 tx=0).stop 2023-07-14T12:53:27.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.025+0000 7f3728e0b640 1 -- 172.21.15.5:0/3391878006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37240b1ac0 msgr2=0x7f37240b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:27.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.025+0000 7f3728e0b640 1 --2- 172.21.15.5:0/3391878006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37240b1ac0 0x7f37240b1f30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f372406f3a0 tx=0x7f371c00d830 comp rx=0 tx=0).stop 2023-07-14T12:53:27.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.025+0000 7f3728e0b640 1 -- 172.21.15.5:0/3391878006 shutdown_connections 2023-07-14T12:53:27.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.025+0000 7f3728e0b640 1 --2- 172.21.15.5:0/3391878006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37240b1ac0 0x7f37240b1f30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:27.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.025+0000 7f3728e0b640 1 --2- 172.21.15.5:0/3391878006 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f3704066280 0x7f3704068730 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:27.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.025+0000 7f3728e0b640 1 --2- 172.21.15.5:0/3391878006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3724151200 0x7f37241f44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:27.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.025+0000 7f3728e0b640 1 --2- 172.21.15.5:0/3391878006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3710003b40 0x7f372415cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:27.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.025+0000 7f3728e0b640 1 -- 172.21.15.5:0/3391878006 >> 172.21.15.5:0/3391878006 conn(0x7f37240afcf0 msgr2=0x7f3724153aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:27.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.025+0000 7f3728e0b640 1 -- 172.21.15.5:0/3391878006 shutdown_connections 2023-07-14T12:53:27.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.025+0000 7f3728e0b640 1 -- 172.21.15.5:0/3391878006 wait complete. 2023-07-14T12:53:27.073 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-07-14T12:53:27.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:27.075 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-07-14T12:53:27.160 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2023-07-14T12:53:27.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:27.161 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-14T12:53:27.171 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-14T12:53:27.172 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:53:27.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.289+0000 7fb72689c640 1 Processor -- start 2023-07-14T12:53:27.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.289+0000 7fb72689c640 1 -- start start 2023-07-14T12:53:27.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.289+0000 7fb72689c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb72015fd60 0x7fb7200d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:27.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.289+0000 7fb72689c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7200ccaf0 con 0x7fb7200b7c70 2023-07-14T12:53:27.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.289+0000 7fb72689c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb720160320 con 0x7fb7200d1850 2023-07-14T12:53:27.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.289+0000 7fb72689c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7200d1190 con 0x7fb72015fd60 2023-07-14T12:53:27.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.289+0000 7fb71ffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb7200b7c70 0x7fb72015f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47184/0 (socket says 172.21.15.5:47184) 2023-07-14T12:53:27.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.289+0000 7fb71ffff640 1 -- 172.21.15.5:0/659793026 learned_addr learned my addr 172.21.15.5:0/659793026 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:27.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.289+0000 7fb71f7fe640 1 --2- 172.21.15.5:0/659793026 >> v2:172.21.15.5:3300/0 conn(0x7fb72015fd60 0x7fb7200d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:27.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.289+0000 7fb71effd640 1 -- 172.21.15.5:0/659793026 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676543552 0 0) 0x7fb7200ccaf0 con 0x7fb7200b7c70 2023-07-14T12:53:27.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.289+0000 7fb71effd640 1 -- 172.21.15.5:0/659793026 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb708003530 con 0x7fb7200b7c70 2023-07-14T12:53:27.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.289+0000 7fb71f7fe640 1 -- 172.21.15.5:0/659793026 >> v1:172.21.15.154:6789/0 conn(0x7fb7200d1850 legacy=0x7fb7200d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:27.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.289+0000 7fb71f7fe640 1 -- 172.21.15.5:0/659793026 >> v1:172.21.15.5:6789/0 conn(0x7fb7200b7c70 legacy=0x7fb72015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:27.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.289+0000 7fb71f7fe640 1 -- 172.21.15.5:0/659793026 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7200ccd90 con 0x7fb72015fd60 2023-07-14T12:53:27.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.293+0000 7fb71f7fe640 1 --2- 172.21.15.5:0/659793026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72015fd60 0x7fb7200d0c50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb7140097c0 tx=0x7fb71401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e31ed5826ee3c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:27.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.293+0000 7fb71effd640 1 -- 172.21.15.5:0/659793026 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7140a8050 con 0x7fb72015fd60 2023-07-14T12:53:27.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.293+0000 7fb71effd640 1 -- 172.21.15.5:0/659793026 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7140ac5f0 con 0x7fb72015fd60 2023-07-14T12:53:27.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.293+0000 7fb71effd640 1 -- 172.21.15.5:0/659793026 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7140ac960 con 0x7fb72015fd60 2023-07-14T12:53:27.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.293+0000 7fb72689c640 1 -- 172.21.15.5:0/659793026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72015fd60 msgr2=0x7fb7200d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:27.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.293+0000 7fb72689c640 1 --2- 172.21.15.5:0/659793026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72015fd60 0x7fb7200d0c50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb7140097c0 tx=0x7fb71401c480 comp rx=0 tx=0).stop 2023-07-14T12:53:27.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.293+0000 7fb72689c640 1 -- 172.21.15.5:0/659793026 shutdown_connections 2023-07-14T12:53:27.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.293+0000 7fb72689c640 1 --2- 172.21.15.5:0/659793026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72015fd60 0x7fb7200d0c50 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:27.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.293+0000 7fb72689c640 1 -- 172.21.15.5:0/659793026 >> 172.21.15.5:0/659793026 conn(0x7fb7200650b0 msgr2=0x7fb7200654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:27.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.293+0000 7fb72689c640 1 -- 172.21.15.5:0/659793026 shutdown_connections 2023-07-14T12:53:27.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.293+0000 7fb72689c640 1 -- 172.21.15.5:0/659793026 wait complete. 2023-07-14T12:53:27.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.293+0000 7fb72689c640 1 Processor -- start 2023-07-14T12:53:27.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.297+0000 7fb72689c640 1 -- start start 2023-07-14T12:53:27.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.297+0000 7fb72689c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7200b7c70 0x7fb7200c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:27.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.297+0000 7fb72689c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7200d1850 0x7fb7200b6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:27.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.297+0000 7fb72689c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72015fd60 0x7fb7200b6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:27.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.297+0000 7fb72689c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7200b71d0 con 0x7fb72015fd60 2023-07-14T12:53:27.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.297+0000 7fb72689c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb720156970 con 0x7fb7200b7c70 2023-07-14T12:53:27.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.297+0000 7fb72689c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7201566d0 con 0x7fb7200d1850 2023-07-14T12:53:27.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.297+0000 7fb71ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7200b7c70 0x7fb7200c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:27.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.297+0000 7fb71ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7200b7c70 0x7fb7200c63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:44120/0 (socket says 172.21.15.5:44120) 2023-07-14T12:53:27.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.297+0000 7fb71ffff640 1 -- 172.21.15.5:0/3002532539 learned_addr learned my addr 172.21.15.5:0/3002532539 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:27.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.297+0000 7fb724e39640 1 --2- 172.21.15.5:0/3002532539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72015fd60 0x7fb7200b6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:27.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.297+0000 7fb71f7fe640 1 --2- 172.21.15.5:0/3002532539 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7200d1850 0x7fb7200b6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:27.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.297+0000 7fb724e39640 1 -- 172.21.15.5:0/3002532539 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7200d1850 msgr2=0x7fb7200b6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:27.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.297+0000 7fb724e39640 1 --2- 172.21.15.5:0/3002532539 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7200d1850 0x7fb7200b6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:27.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.297+0000 7fb724e39640 1 -- 172.21.15.5:0/3002532539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7200b7c70 msgr2=0x7fb7200c63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:27.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.297+0000 7fb724e39640 1 --2- 172.21.15.5:0/3002532539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7200b7c70 0x7fb7200c63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:27.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.297+0000 7fb724e39640 1 -- 172.21.15.5:0/3002532539 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb714009420 con 0x7fb72015fd60 2023-07-14T12:53:27.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.297+0000 7fb71ffff640 1 --2- 172.21.15.5:0/3002532539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7200b7c70 0x7fb7200c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:53:27.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.297+0000 7fb724e39640 1 --2- 172.21.15.5:0/3002532539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72015fd60 0x7fb7200b6c90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb71800c700 tx=0x7fb71800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:27.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.297+0000 7fb71cff9640 1 -- 172.21.15.5:0/3002532539 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb718003b80 con 0x7fb72015fd60 2023-07-14T12:53:27.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.297+0000 7fb71cff9640 1 -- 172.21.15.5:0/3002532539 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb718003ce0 con 0x7fb72015fd60 2023-07-14T12:53:27.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.297+0000 7fb71cff9640 1 -- 172.21.15.5:0/3002532539 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb718005310 con 0x7fb72015fd60 2023-07-14T12:53:27.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.297+0000 7fb72689c640 1 -- 172.21.15.5:0/3002532539 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7200b5c70 con 0x7fb72015fd60 2023-07-14T12:53:27.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.297+0000 7fb72689c640 1 -- 172.21.15.5:0/3002532539 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7200b6230 con 0x7fb72015fd60 2023-07-14T12:53:27.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.297+0000 7fb72689c640 1 -- 172.21.15.5:0/3002532539 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7200678d0 con 0x7fb72015fd60 2023-07-14T12:53:27.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.301+0000 7fb71cff9640 1 -- 172.21.15.5:0/3002532539 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb718005470 con 0x7fb72015fd60 2023-07-14T12:53:27.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.301+0000 7fb71cff9640 1 --2- 172.21.15.5:0/3002532539 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb70c066280 0x7fb70c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:27.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.301+0000 7fb71cff9640 1 -- 172.21.15.5:0/3002532539 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb7180838b0 con 0x7fb72015fd60 2023-07-14T12:53:27.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.301+0000 7fb71ffff640 1 --2- 172.21.15.5:0/3002532539 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb70c066280 0x7fb70c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:27.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.301+0000 7fb71ffff640 1 --2- 172.21.15.5:0/3002532539 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb70c066280 0x7fb70c068730 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb7100011f0 tx=0x7fb710009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:27.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.305+0000 7fb71cff9640 1 -- 172.21.15.5:0/3002532539 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb718050d90 con 0x7fb72015fd60 2023-07-14T12:53:27.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.497+0000 7fb72689c640 1 -- 172.21.15.5:0/3002532539 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7200d2fd0 con 0x7fb72015fd60 2023-07-14T12:53:27.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.497+0000 7fb71cff9640 1 -- 172.21.15.5:0/3002532539 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4703 (secure 0 0 0) 0x7fb7180543b0 con 0x7fb72015fd60 2023-07-14T12:53:27.525 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:27.525 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1953958881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1953958881},{"type":"v1","addr":"172.21.15.154:6837","nonce":1953958881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3138000501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3138000501},{"type":"v1","addr":"172.21.15.5:6834","nonce":3138000501}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1911549775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1911549775},{"type":"v1","addr":"172.21.15.5:6835","nonce":1911549775}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T12:52:46.473195+0000","modified":"2023-07-14T12:52:50.433872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6836/3154882793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3154882793},{"type":"v1","addr":"172.21.15.154:6836","nonce":3154882793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T12:53:27.526 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2023-07-14T12:53:27.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.497+0000 7fb72689c640 1 -- 172.21.15.5:0/3002532539 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb70c066280 msgr2=0x7fb70c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:27.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.497+0000 7fb72689c640 1 --2- 172.21.15.5:0/3002532539 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb70c066280 0x7fb70c068730 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb7100011f0 tx=0x7fb710009040 comp rx=0 tx=0).stop 2023-07-14T12:53:27.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.497+0000 7fb72689c640 1 -- 172.21.15.5:0/3002532539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72015fd60 msgr2=0x7fb7200b6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:27.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.497+0000 7fb72689c640 1 --2- 172.21.15.5:0/3002532539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72015fd60 0x7fb7200b6c90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb71800c700 tx=0x7fb71800cbc0 comp rx=0 tx=0).stop 2023-07-14T12:53:27.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.497+0000 7fb72689c640 1 -- 172.21.15.5:0/3002532539 shutdown_connections 2023-07-14T12:53:27.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.497+0000 7fb72689c640 1 --2- 172.21.15.5:0/3002532539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb72015fd60 0x7fb7200b6c90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:27.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.497+0000 7fb72689c640 1 --2- 172.21.15.5:0/3002532539 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7200d1850 0x7fb7200b6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:27.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.497+0000 7fb72689c640 1 --2- 172.21.15.5:0/3002532539 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb70c066280 0x7fb70c068730 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:27.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.497+0000 7fb72689c640 1 --2- 172.21.15.5:0/3002532539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7200b7c70 0x7fb7200c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:27.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.497+0000 7fb72689c640 1 -- 172.21.15.5:0/3002532539 >> 172.21.15.5:0/3002532539 conn(0x7fb7200650b0 msgr2=0x7fb720156e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:27.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.501+0000 7fb72689c640 1 -- 172.21.15.5:0/3002532539 shutdown_connections 2023-07-14T12:53:27.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.501+0000 7fb72689c640 1 -- 172.21.15.5:0/3002532539 wait complete. 2023-07-14T12:53:27.546 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:53:27.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.665+0000 7fb1bd2de640 1 Processor -- start 2023-07-14T12:53:27.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.665+0000 7fb1bd2de640 1 -- start start 2023-07-14T12:53:27.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.665+0000 7fb1bd2de640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb1b815f3f0 0x7fb1b80b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:27.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.665+0000 7fb1bd2de640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1b80d13f0 0x7fb1b80b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:27.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.665+0000 7fb1bd2de640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b80d0f60 con 0x7fb1b80cc9a0 2023-07-14T12:53:27.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.665+0000 7fb1bd2de640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1b80cd4e0 con 0x7fb1b815f3f0 2023-07-14T12:53:27.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.665+0000 7fb1bd2de640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b80d0390 con 0x7fb1b80d13f0 2023-07-14T12:53:27.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.669+0000 7fb1bcadd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb1b80cc9a0 0x7fb1b80ccdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47188/0 (socket says 172.21.15.5:47188) 2023-07-14T12:53:27.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.669+0000 7fb1bcadd640 1 -- 172.21.15.5:0/3078808810 learned_addr learned my addr 172.21.15.5:0/3078808810 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:27.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.669+0000 7fb1b7fff640 1 --2- 172.21.15.5:0/3078808810 >> v2:172.21.15.154:3300/0 conn(0x7fb1b815f3f0 0x7fb1b80b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:27.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.669+0000 7fb1b77fe640 1 --2- 172.21.15.5:0/3078808810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1b80d13f0 0x7fb1b80b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:27.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.669+0000 7fb1b6ffd640 1 -- 172.21.15.5:0/3078808810 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4233914833 0 0) 0x7fb1b80d0f60 con 0x7fb1b80cc9a0 2023-07-14T12:53:27.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.669+0000 7fb1b6ffd640 1 -- 172.21.15.5:0/3078808810 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1a0003530 con 0x7fb1b80cc9a0 2023-07-14T12:53:27.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.669+0000 7fb1b7fff640 1 -- 172.21.15.5:0/3078808810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1b80d13f0 msgr2=0x7fb1b80b7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:27.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.669+0000 7fb1b7fff640 1 --2- 172.21.15.5:0/3078808810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1b80d13f0 0x7fb1b80b7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:27.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.669+0000 7fb1b7fff640 1 -- 172.21.15.5:0/3078808810 >> v1:172.21.15.5:6789/0 conn(0x7fb1b80cc9a0 legacy=0x7fb1b80ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:27.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.669+0000 7fb1b6ffd640 1 -- 172.21.15.5:0/3078808810 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2793861202 0 0) 0x7fb1a0003530 con 0x7fb1b80cc9a0 2023-07-14T12:53:27.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.669+0000 7fb1b7fff640 1 -- 172.21.15.5:0/3078808810 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b80d0630 con 0x7fb1b815f3f0 2023-07-14T12:53:27.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.669+0000 7fb1b77fe640 1 --2- 172.21.15.5:0/3078808810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1b80d13f0 0x7fb1b80b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:53:27.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.669+0000 7fb1b7fff640 1 --2- 172.21.15.5:0/3078808810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1b815f3f0 0x7fb1b80b7680 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb1a80097c0 tx=0x7fb1a801c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e1591fd5bf2a4f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:27.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.673+0000 7fb1b6ffd640 1 -- 172.21.15.5:0/3078808810 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b0001a00 con 0x7fb1b815f3f0 2023-07-14T12:53:27.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.673+0000 7fb1b6ffd640 1 -- 172.21.15.5:0/3078808810 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a80a7050 con 0x7fb1b815f3f0 2023-07-14T12:53:27.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.673+0000 7fb1b6ffd640 1 -- 172.21.15.5:0/3078808810 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a80ab620 con 0x7fb1b815f3f0 2023-07-14T12:53:27.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.673+0000 7fb1bd2de640 1 -- 172.21.15.5:0/3078808810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1b815f3f0 msgr2=0x7fb1b80b7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:27.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.673+0000 7fb1bd2de640 1 --2- 172.21.15.5:0/3078808810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1b815f3f0 0x7fb1b80b7680 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb1a80097c0 tx=0x7fb1a801c310 comp rx=0 tx=0).stop 2023-07-14T12:53:27.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.673+0000 7fb1bd2de640 1 -- 172.21.15.5:0/3078808810 shutdown_connections 2023-07-14T12:53:27.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.673+0000 7fb1bd2de640 1 --2- 172.21.15.5:0/3078808810 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1b80d13f0 0x7fb1b80b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:27.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.673+0000 7fb1bd2de640 1 --2- 172.21.15.5:0/3078808810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1b815f3f0 0x7fb1b80b7680 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:27.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.673+0000 7fb1bd2de640 1 -- 172.21.15.5:0/3078808810 >> 172.21.15.5:0/3078808810 conn(0x7fb1b8069f50 msgr2=0x7fb1b806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:27.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.673+0000 7fb1bd2de640 1 -- 172.21.15.5:0/3078808810 shutdown_connections 2023-07-14T12:53:27.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.673+0000 7fb1bd2de640 1 -- 172.21.15.5:0/3078808810 wait complete. 2023-07-14T12:53:27.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.673+0000 7fb1bd2de640 1 Processor -- start 2023-07-14T12:53:27.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.673+0000 7fb1bd2de640 1 -- start start 2023-07-14T12:53:27.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.673+0000 7fb1bd2de640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1b80cc9a0 0x7fb1b814ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:27.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.673+0000 7fb1bd2de640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1b80d13f0 0x7fb1b8157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:27.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.673+0000 7fb1bd2de640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b815f3f0 0x7fb1b81589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:27.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.673+0000 7fb1bd2de640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b81583e0 con 0x7fb1b815f3f0 2023-07-14T12:53:27.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.673+0000 7fb1bd2de640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b814f280 con 0x7fb1b80d13f0 2023-07-14T12:53:27.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.673+0000 7fb1bd2de640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b8157b40 con 0x7fb1b80cc9a0 2023-07-14T12:53:27.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.677+0000 7fb1bcadd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b815f3f0 0x7fb1b81589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:27.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.677+0000 7fb1bcadd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b815f3f0 0x7fb1b81589f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42228/0 (socket says 172.21.15.5:42228) 2023-07-14T12:53:27.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.677+0000 7fb1bcadd640 1 -- 172.21.15.5:0/3318502827 learned_addr learned my addr 172.21.15.5:0/3318502827 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:27.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.677+0000 7fb1b77fe640 1 --2- 172.21.15.5:0/3318502827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1b80d13f0 0x7fb1b8157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:27.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.677+0000 7fb1b7fff640 1 --2- 172.21.15.5:0/3318502827 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1b80cc9a0 0x7fb1b814ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:27.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.677+0000 7fb1bcadd640 1 -- 172.21.15.5:0/3318502827 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1b80cc9a0 msgr2=0x7fb1b814ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:27.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.677+0000 7fb1bcadd640 1 --2- 172.21.15.5:0/3318502827 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1b80cc9a0 0x7fb1b814ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:27.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.677+0000 7fb1bcadd640 1 -- 172.21.15.5:0/3318502827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1b80d13f0 msgr2=0x7fb1b8157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:27.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.677+0000 7fb1bcadd640 1 --2- 172.21.15.5:0/3318502827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1b80d13f0 0x7fb1b8157180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:27.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.677+0000 7fb1bcadd640 1 -- 172.21.15.5:0/3318502827 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac009420 con 0x7fb1b815f3f0 2023-07-14T12:53:27.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.677+0000 7fb1bcadd640 1 --2- 172.21.15.5:0/3318502827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b815f3f0 0x7fb1b81589f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0001f80 tx=0x7fb1b000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:27.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.677+0000 7fb1b4ff9640 1 -- 172.21.15.5:0/3318502827 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b0012400 con 0x7fb1b815f3f0 2023-07-14T12:53:27.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.677+0000 7fb1b4ff9640 1 -- 172.21.15.5:0/3318502827 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b0012560 con 0x7fb1b815f3f0 2023-07-14T12:53:27.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.677+0000 7fb1b4ff9640 1 -- 172.21.15.5:0/3318502827 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b0012910 con 0x7fb1b815f3f0 2023-07-14T12:53:27.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.677+0000 7fb1bd2de640 1 -- 172.21.15.5:0/3318502827 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a8009420 con 0x7fb1b815f3f0 2023-07-14T12:53:27.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.677+0000 7fb1bd2de640 1 -- 172.21.15.5:0/3318502827 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b8158100 con 0x7fb1b815f3f0 2023-07-14T12:53:27.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.677+0000 7fb1bd2de640 1 -- 172.21.15.5:0/3318502827 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b80678d0 con 0x7fb1b815f3f0 2023-07-14T12:53:27.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.677+0000 7fb1b4ff9640 1 -- 172.21.15.5:0/3318502827 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb1b0012a70 con 0x7fb1b815f3f0 2023-07-14T12:53:27.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.681+0000 7fb1b4ff9640 1 --2- 172.21.15.5:0/3318502827 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb1a40662b0 0x7fb1a4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:27.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.681+0000 7fb1b4ff9640 1 -- 172.21.15.5:0/3318502827 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb1b0084380 con 0x7fb1b815f3f0 2023-07-14T12:53:27.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.681+0000 7fb1b7fff640 1 --2- 172.21.15.5:0/3318502827 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb1a40662b0 0x7fb1a4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:27.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.681+0000 7fb1b7fff640 1 --2- 172.21.15.5:0/3318502827 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb1a40662b0 0x7fb1a4068760 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb1a80ad000 tx=0x7fb1a80a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:27.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.681+0000 7fb1b4ff9640 1 -- 172.21.15.5:0/3318502827 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb1b0051870 con 0x7fb1b815f3f0 2023-07-14T12:53:27.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.837+0000 7fb1bd2de640 1 -- 172.21.15.5:0/3318502827 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1b80b1a20 con 0x7fb1b815f3f0 2023-07-14T12:53:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.841+0000 7fb1b4ff9640 1 -- 172.21.15.5:0/3318502827 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18326 (secure 0 0 0) 0x7fb1b0054e90 con 0x7fb1b815f3f0 2023-07-14T12:53:27.868 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:27.868 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:53:27.546504+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:52:44.223082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T12:52:45.469396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:53:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.841+0000 7fb1bd2de640 1 -- 172.21.15.5:0/3318502827 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb1a40662b0 msgr2=0x7fb1a4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.841+0000 7fb1bd2de640 1 --2- 172.21.15.5:0/3318502827 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb1a40662b0 0x7fb1a4068760 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb1a80ad000 tx=0x7fb1a80a6000 comp rx=0 tx=0).stop 2023-07-14T12:53:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.841+0000 7fb1bd2de640 1 -- 172.21.15.5:0/3318502827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b815f3f0 msgr2=0x7fb1b81589f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.841+0000 7fb1bd2de640 1 --2- 172.21.15.5:0/3318502827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b815f3f0 0x7fb1b81589f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0001f80 tx=0x7fb1b000a430 comp rx=0 tx=0).stop 2023-07-14T12:53:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.841+0000 7fb1bd2de640 1 -- 172.21.15.5:0/3318502827 shutdown_connections 2023-07-14T12:53:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.841+0000 7fb1bd2de640 1 --2- 172.21.15.5:0/3318502827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b815f3f0 0x7fb1b81589f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.841+0000 7fb1bd2de640 1 --2- 172.21.15.5:0/3318502827 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb1a40662b0 0x7fb1a4068760 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.841+0000 7fb1bd2de640 1 --2- 172.21.15.5:0/3318502827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1b80d13f0 0x7fb1b8157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.841+0000 7fb1bd2de640 1 --2- 172.21.15.5:0/3318502827 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1b80cc9a0 0x7fb1b814ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.841+0000 7fb1bd2de640 1 -- 172.21.15.5:0/3318502827 >> 172.21.15.5:0/3318502827 conn(0x7fb1b8069f50 msgr2=0x7fb1b815e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.841+0000 7fb1bd2de640 1 -- 172.21.15.5:0/3318502827 shutdown_connections 2023-07-14T12:53:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:27.841+0000 7fb1bd2de640 1 -- 172.21.15.5:0/3318502827 wait complete. 2023-07-14T12:53:27.889 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T12:52:44.223082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T12:52:45.469396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T12:53:27.890 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T12:53:28.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.009+0000 7f2ed0eca640 1 Processor -- start 2023-07-14T12:53:28.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.013+0000 7f2ed0eca640 1 -- start start 2023-07-14T12:53:28.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.013+0000 7f2ed0eca640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ecc070f30 0x7f2ecc0ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:28.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.013+0000 7f2ed0eca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ecc0af2b0 0x7f2ecc15a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:28.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.013+0000 7f2ed0eca640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ecc159d70 con 0x7f2ecc069430 2023-07-14T12:53:28.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.013+0000 7f2ed0eca640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ecc0c9c60 con 0x7f2ecc070f30 2023-07-14T12:53:28.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.013+0000 7f2ed0eca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc0c9f40 con 0x7f2ecc0af2b0 2023-07-14T12:53:28.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.013+0000 7f2ec3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ecc070f30 0x7f2ecc0ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:28.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.013+0000 7f2ec3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ecc070f30 0x7f2ecc0ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42232/0 (socket says 172.21.15.5:42232) 2023-07-14T12:53:28.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.013+0000 7f2ec3fff640 1 -- 172.21.15.5:0/2638608861 learned_addr learned my addr 172.21.15.5:0/2638608861 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:28.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.013+0000 7f2ecad9d640 1 --2- 172.21.15.5:0/2638608861 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ecc0af2b0 0x7f2ecc15a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:28.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.013+0000 7f2ec3fff640 1 -- 172.21.15.5:0/2638608861 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ecc0af2b0 msgr2=0x7f2ecc15a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:28.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.013+0000 7f2ec3fff640 1 --2- 172.21.15.5:0/2638608861 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ecc0af2b0 0x7f2ecc15a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.013+0000 7f2ec3fff640 1 -- 172.21.15.5:0/2638608861 >> v1:172.21.15.154:6789/0 conn(0x7f2ecc069430 legacy=0x7f2ecc069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:28.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.013+0000 7f2ec9d9b640 1 -- 172.21.15.5:0/2638608861 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2283140148 0 0) 0x7f2ebc001120 con 0x7f2ecc069430 2023-07-14T12:53:28.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.013+0000 7f2ec3fff640 1 -- 172.21.15.5:0/2638608861 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ecc0ca220 con 0x7f2ecc070f30 2023-07-14T12:53:28.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.017+0000 7f2ec3fff640 1 --2- 172.21.15.5:0/2638608861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ecc070f30 0x7f2ecc0ad6f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4009870 tx=0x7f2eb401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de7c0343c5ada31 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:28.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.017+0000 7f2ec9d9b640 1 -- 172.21.15.5:0/2638608861 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb40a9400 con 0x7f2ecc070f30 2023-07-14T12:53:28.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.017+0000 7f2ec9d9b640 1 -- 172.21.15.5:0/2638608861 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb40a9560 con 0x7f2ecc070f30 2023-07-14T12:53:28.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.017+0000 7f2ec9d9b640 1 -- 172.21.15.5:0/2638608861 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb40a98f0 con 0x7f2ecc070f30 2023-07-14T12:53:28.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.017+0000 7f2ed0eca640 1 -- 172.21.15.5:0/2638608861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ecc070f30 msgr2=0x7f2ecc0ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:28.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.017+0000 7f2ed0eca640 1 --2- 172.21.15.5:0/2638608861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ecc070f30 0x7f2ecc0ad6f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4009870 tx=0x7f2eb401c540 comp rx=0 tx=0).stop 2023-07-14T12:53:28.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.017+0000 7f2ed0eca640 1 -- 172.21.15.5:0/2638608861 shutdown_connections 2023-07-14T12:53:28.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.017+0000 7f2ed0eca640 1 --2- 172.21.15.5:0/2638608861 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ecc0af2b0 0x7f2ecc15a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.017+0000 7f2ed0eca640 1 --2- 172.21.15.5:0/2638608861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ecc070f30 0x7f2ecc0ad6f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.017+0000 7f2ed0eca640 1 -- 172.21.15.5:0/2638608861 >> 172.21.15.5:0/2638608861 conn(0x7f2ecc0cde90 msgr2=0x7f2ecc0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:28.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.017+0000 7f2ed0eca640 1 -- 172.21.15.5:0/2638608861 shutdown_connections 2023-07-14T12:53:28.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.017+0000 7f2ed0eca640 1 -- 172.21.15.5:0/2638608861 wait complete. 2023-07-14T12:53:28.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.017+0000 7f2ed0eca640 1 Processor -- start 2023-07-14T12:53:28.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.017+0000 7f2ed0eca640 1 -- start start 2023-07-14T12:53:28.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.021+0000 7f2ed0eca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ecc069430 0x7f2ecc14d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:28.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.021+0000 7f2ed0eca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ecc070f30 0x7f2ecc0cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:28.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.021+0000 7f2ed0eca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ecc0af2b0 0x7f2ecc0cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:28.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.021+0000 7f2ed0eca640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc0c51d0 con 0x7f2ecc070f30 2023-07-14T12:53:28.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.021+0000 7f2ed0eca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc156500 con 0x7f2ecc069430 2023-07-14T12:53:28.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.021+0000 7f2ed0eca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc155980 con 0x7f2ecc0af2b0 2023-07-14T12:53:28.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.021+0000 7f2ec3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ecc070f30 0x7f2ecc0cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:28.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.021+0000 7f2ec3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ecc070f30 0x7f2ecc0cb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42240/0 (socket says 172.21.15.5:42240) 2023-07-14T12:53:28.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.021+0000 7f2ec3fff640 1 -- 172.21.15.5:0/2638172522 learned_addr learned my addr 172.21.15.5:0/2638172522 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:28.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.021+0000 7f2ecad9d640 1 --2- 172.21.15.5:0/2638172522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ecc0af2b0 0x7f2ecc0cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:28.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.021+0000 7f2ec3fff640 1 -- 172.21.15.5:0/2638172522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ecc0af2b0 msgr2=0x7f2ecc0cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:28.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.021+0000 7f2ec3fff640 1 --2- 172.21.15.5:0/2638172522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ecc0af2b0 0x7f2ecc0cb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.021+0000 7f2ec3fff640 1 -- 172.21.15.5:0/2638172522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ecc069430 msgr2=0x7f2ecc14d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:28.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.021+0000 7f2eca59c640 1 --2- 172.21.15.5:0/2638172522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ecc069430 0x7f2ecc14d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:28.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.021+0000 7f2ec3fff640 1 --2- 172.21.15.5:0/2638172522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ecc069430 0x7f2ecc14d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.021+0000 7f2ec3fff640 1 -- 172.21.15.5:0/2638172522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb40094d0 con 0x7f2ecc070f30 2023-07-14T12:53:28.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.021+0000 7f2ecad9d640 1 --2- 172.21.15.5:0/2638172522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ecc0af2b0 0x7f2ecc0cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:28.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.021+0000 7f2eca59c640 1 --2- 172.21.15.5:0/2638172522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ecc069430 0x7f2ecc14d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:28.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.021+0000 7f2ec3fff640 1 --2- 172.21.15.5:0/2638172522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ecc070f30 0x7f2ecc0cb1f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2eb401a170 tx=0x7f2eb40046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:28.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.021+0000 7f2ec2ffd640 1 -- 172.21.15.5:0/2638172522 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb40a9400 con 0x7f2ecc070f30 2023-07-14T12:53:28.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.021+0000 7f2ec2ffd640 1 -- 172.21.15.5:0/2638172522 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb4004020 con 0x7f2ecc070f30 2023-07-14T12:53:28.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.021+0000 7f2ed0eca640 1 -- 172.21.15.5:0/2638172522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ecc155c60 con 0x7f2ecc070f30 2023-07-14T12:53:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.021+0000 7f2ec2ffd640 1 -- 172.21.15.5:0/2638172522 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb4004390 con 0x7f2ecc070f30 2023-07-14T12:53:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.021+0000 7f2ed0eca640 1 -- 172.21.15.5:0/2638172522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ecc156220 con 0x7f2ecc070f30 2023-07-14T12:53:28.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.021+0000 7f2ed0eca640 1 -- 172.21.15.5:0/2638172522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ecc0678d0 con 0x7f2ecc070f30 2023-07-14T12:53:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.025+0000 7f2ec2ffd640 1 -- 172.21.15.5:0/2638172522 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2eb4003620 con 0x7f2ecc070f30 2023-07-14T12:53:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.025+0000 7f2ec2ffd640 1 --2- 172.21.15.5:0/2638172522 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2eac0662b0 0x7f2eac068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:28.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.025+0000 7f2ec2ffd640 1 -- 172.21.15.5:0/2638172522 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2eb411e4e0 con 0x7f2ecc070f30 2023-07-14T12:53:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.025+0000 7f2eca59c640 1 --2- 172.21.15.5:0/2638172522 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2eac0662b0 0x7f2eac068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.025+0000 7f2eca59c640 1 --2- 172.21.15.5:0/2638172522 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2eac0662b0 0x7f2eac068760 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc000f70 tx=0x7f2ebc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:28.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.029+0000 7f2ec2ffd640 1 -- 172.21.15.5:0/2638172522 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2eb40eb7f0 con 0x7f2ecc070f30 2023-07-14T12:53:28.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.181+0000 7f2ed0eca640 1 -- 172.21.15.5:0/2638172522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2ecc0aeb80 con 0x7f2ecc070f30 2023-07-14T12:53:28.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.181+0000 7f2ec2ffd640 1 -- 172.21.15.5:0/2638172522 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2eb40a6020 con 0x7f2ecc070f30 2023-07-14T12:53:28.211 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T12:53:28.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.185+0000 7f2ed0eca640 1 -- 172.21.15.5:0/2638172522 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2eac0662b0 msgr2=0x7f2eac068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:28.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.185+0000 7f2ed0eca640 1 --2- 172.21.15.5:0/2638172522 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2eac0662b0 0x7f2eac068760 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc000f70 tx=0x7f2ebc009040 comp rx=0 tx=0).stop 2023-07-14T12:53:28.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.185+0000 7f2ed0eca640 1 -- 172.21.15.5:0/2638172522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ecc070f30 msgr2=0x7f2ecc0cb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:28.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.185+0000 7f2ed0eca640 1 --2- 172.21.15.5:0/2638172522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ecc070f30 0x7f2ecc0cb1f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2eb401a170 tx=0x7f2eb40046d0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.185+0000 7f2ed0eca640 1 -- 172.21.15.5:0/2638172522 shutdown_connections 2023-07-14T12:53:28.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.185+0000 7f2ed0eca640 1 --2- 172.21.15.5:0/2638172522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ecc0af2b0 0x7f2ecc0cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.185+0000 7f2ed0eca640 1 --2- 172.21.15.5:0/2638172522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ecc070f30 0x7f2ecc0cb1f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.185+0000 7f2ed0eca640 1 --2- 172.21.15.5:0/2638172522 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2eac0662b0 0x7f2eac068760 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.185+0000 7f2ed0eca640 1 --2- 172.21.15.5:0/2638172522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ecc069430 0x7f2ecc14d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.185+0000 7f2ed0eca640 1 -- 172.21.15.5:0/2638172522 >> 172.21.15.5:0/2638172522 conn(0x7f2ecc0cde90 msgr2=0x7f2ecc153aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:28.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.185+0000 7f2ed0eca640 1 -- 172.21.15.5:0/2638172522 shutdown_connections 2023-07-14T12:53:28.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.185+0000 7f2ed0eca640 1 -- 172.21.15.5:0/2638172522 wait complete. 2023-07-14T12:53:28.231 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T12:53:28.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.353+0000 7faa0389c640 1 Processor -- start 2023-07-14T12:53:28.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.353+0000 7faa0389c640 1 -- start start 2023-07-14T12:53:28.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.353+0000 7faa0389c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa9fc0cdd10 0x7fa9fc0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:28.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.353+0000 7faa0389c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9fc0d0820 0x7fa9fc0accf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:28.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.353+0000 7faa0389c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9fc0b0450 con 0x7fa9fc0b1770 2023-07-14T12:53:28.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.353+0000 7faa0389c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9fc0ce620 con 0x7fa9fc0cdd10 2023-07-14T12:53:28.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.353+0000 7faa0389c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc0b06d0 con 0x7fa9fc0d0820 2023-07-14T12:53:28.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.353+0000 7faa01e39640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9fc0d0820 0x7fa9fc0accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:28.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.353+0000 7faa00e37640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa9fc0b1770 0x7fa9fc0d0110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:44254/0 (socket says 172.21.15.5:44254) 2023-07-14T12:53:28.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.353+0000 7faa00e37640 1 -- 172.21.15.5:0/1526852981 learned_addr learned my addr 172.21.15.5:0/1526852981 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:28.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.353+0000 7faa01638640 1 --2- 172.21.15.5:0/1526852981 >> v2:172.21.15.154:3300/0 conn(0x7fa9fc0cdd10 0x7fa9fc0ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:28.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.353+0000 7fa9f3fff640 1 -- 172.21.15.5:0/1526852981 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1180390673 0 0) 0x7fa9fc0b0450 con 0x7fa9fc0b1770 2023-07-14T12:53:28.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.353+0000 7fa9f3fff640 1 -- 172.21.15.5:0/1526852981 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9e8003530 con 0x7fa9fc0b1770 2023-07-14T12:53:28.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.353+0000 7faa01e39640 1 -- 172.21.15.5:0/1526852981 >> v2:172.21.15.154:3300/0 conn(0x7fa9fc0cdd10 msgr2=0x7fa9fc0ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:28.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.353+0000 7faa01e39640 1 --2- 172.21.15.5:0/1526852981 >> v2:172.21.15.154:3300/0 conn(0x7fa9fc0cdd10 0x7fa9fc0ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.353+0000 7faa01e39640 1 -- 172.21.15.5:0/1526852981 >> v1:172.21.15.154:6789/0 conn(0x7fa9fc0b1770 legacy=0x7fa9fc0d0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:28.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.353+0000 7faa01e39640 1 -- 172.21.15.5:0/1526852981 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9fc0b09b0 con 0x7fa9fc0d0820 2023-07-14T12:53:28.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.353+0000 7faa01638640 1 --2- 172.21.15.5:0/1526852981 >> v2:172.21.15.154:3300/0 conn(0x7fa9fc0cdd10 0x7fa9fc0ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:53:28.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.357+0000 7faa01e39640 1 --2- 172.21.15.5:0/1526852981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9fc0d0820 0x7fa9fc0accf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009d90 tx=0x7fa9f401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b103b4201053aac server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:28.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.357+0000 7fa9f3fff640 1 -- 172.21.15.5:0/1526852981 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f40a59e0 con 0x7fa9fc0d0820 2023-07-14T12:53:28.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.357+0000 7fa9f3fff640 1 -- 172.21.15.5:0/1526852981 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f40a5b40 con 0x7fa9fc0d0820 2023-07-14T12:53:28.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.357+0000 7fa9f3fff640 1 -- 172.21.15.5:0/1526852981 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f40ad440 con 0x7fa9fc0d0820 2023-07-14T12:53:28.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.357+0000 7faa0389c640 1 -- 172.21.15.5:0/1526852981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9fc0d0820 msgr2=0x7fa9fc0accf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:28.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.357+0000 7faa0389c640 1 --2- 172.21.15.5:0/1526852981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9fc0d0820 0x7fa9fc0accf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009d90 tx=0x7fa9f401c920 comp rx=0 tx=0).stop 2023-07-14T12:53:28.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.357+0000 7faa0389c640 1 -- 172.21.15.5:0/1526852981 shutdown_connections 2023-07-14T12:53:28.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.357+0000 7faa0389c640 1 --2- 172.21.15.5:0/1526852981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9fc0d0820 0x7fa9fc0accf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.357+0000 7faa0389c640 1 --2- 172.21.15.5:0/1526852981 >> v2:172.21.15.154:3300/0 conn(0x7fa9fc0cdd10 0x7fa9fc0ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.357+0000 7faa0389c640 1 -- 172.21.15.5:0/1526852981 >> 172.21.15.5:0/1526852981 conn(0x7fa9fc099490 msgr2=0x7fa9fc089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:28.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.357+0000 7faa0389c640 1 -- 172.21.15.5:0/1526852981 shutdown_connections 2023-07-14T12:53:28.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.357+0000 7faa0389c640 1 -- 172.21.15.5:0/1526852981 wait complete. 2023-07-14T12:53:28.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.361+0000 7faa0389c640 1 Processor -- start 2023-07-14T12:53:28.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.361+0000 7faa0389c640 1 -- start start 2023-07-14T12:53:28.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.361+0000 7faa0389c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9fc0b1770 0x7fa9fc06c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:28.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.361+0000 7faa0389c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9fc0cdd10 0x7fa9fc1474d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:28.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.361+0000 7faa0389c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9fc0d0820 0x7fa9fc151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:28.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.361+0000 7faa0389c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc06ad50 con 0x7fa9fc0b1770 2023-07-14T12:53:28.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.361+0000 7faa0389c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc14bef0 con 0x7fa9fc0cdd10 2023-07-14T12:53:28.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.361+0000 7faa0389c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc06a540 con 0x7fa9fc0d0820 2023-07-14T12:53:28.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.361+0000 7faa01638640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9fc0b1770 0x7fa9fc06c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:28.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.361+0000 7faa01638640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9fc0b1770 0x7fa9fc06c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42244/0 (socket says 172.21.15.5:42244) 2023-07-14T12:53:28.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.361+0000 7faa01638640 1 -- 172.21.15.5:0/2779344052 learned_addr learned my addr 172.21.15.5:0/2779344052 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:28.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.361+0000 7faa00e37640 1 --2- 172.21.15.5:0/2779344052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9fc0cdd10 0x7fa9fc1474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:28.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.361+0000 7faa01e39640 1 --2- 172.21.15.5:0/2779344052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9fc0d0820 0x7fa9fc151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:28.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.361+0000 7faa01638640 1 -- 172.21.15.5:0/2779344052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9fc0d0820 msgr2=0x7fa9fc151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:28.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.361+0000 7faa01638640 1 --2- 172.21.15.5:0/2779344052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9fc0d0820 0x7fa9fc151020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.361+0000 7faa01638640 1 -- 172.21.15.5:0/2779344052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9fc0cdd10 msgr2=0x7fa9fc1474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:28.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.361+0000 7faa01638640 1 --2- 172.21.15.5:0/2779344052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9fc0cdd10 0x7fa9fc1474d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.361+0000 7faa01638640 1 -- 172.21.15.5:0/2779344052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f8009420 con 0x7fa9fc0b1770 2023-07-14T12:53:28.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.361+0000 7faa01638640 1 --2- 172.21.15.5:0/2779344052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9fc0b1770 0x7fa9fc06c140 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa9f800ec10 tx=0x7fa9f800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:28.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.361+0000 7fa9f1ffb640 1 -- 172.21.15.5:0/2779344052 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f800cbd0 con 0x7fa9fc0b1770 2023-07-14T12:53:28.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.361+0000 7fa9f1ffb640 1 -- 172.21.15.5:0/2779344052 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f800cd30 con 0x7fa9fc0b1770 2023-07-14T12:53:28.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.361+0000 7fa9f1ffb640 1 -- 172.21.15.5:0/2779344052 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8013690 con 0x7fa9fc0b1770 2023-07-14T12:53:28.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.361+0000 7faa0389c640 1 -- 172.21.15.5:0/2779344052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f4009a70 con 0x7fa9fc0b1770 2023-07-14T12:53:28.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.361+0000 7faa0389c640 1 -- 172.21.15.5:0/2779344052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9fc06a790 con 0x7fa9fc0b1770 2023-07-14T12:53:28.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.365+0000 7faa0389c640 1 -- 172.21.15.5:0/2779344052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9fc0678d0 con 0x7fa9fc0b1770 2023-07-14T12:53:28.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.365+0000 7fa9f1ffb640 1 -- 172.21.15.5:0/2779344052 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa9f80137f0 con 0x7fa9fc0b1770 2023-07-14T12:53:28.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.365+0000 7fa9f1ffb640 1 --2- 172.21.15.5:0/2779344052 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa9e0066280 0x7fa9e0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:28.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.365+0000 7fa9f1ffb640 1 -- 172.21.15.5:0/2779344052 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa9f8083fc0 con 0x7fa9fc0b1770 2023-07-14T12:53:28.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.365+0000 7faa00e37640 1 --2- 172.21.15.5:0/2779344052 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa9e0066280 0x7fa9e0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:28.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.365+0000 7faa00e37640 1 --2- 172.21.15.5:0/2779344052 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa9e0066280 0x7fa9e0068730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc1f70b0 tx=0x7fa9ec007d40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:28.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.369+0000 7fa9f1ffb640 1 -- 172.21.15.5:0/2779344052 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa9f80514a0 con 0x7fa9fc0b1770 2023-07-14T12:53:28.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.529+0000 7faa0389c640 1 -- 172.21.15.5:0/2779344052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa9fc0affa0 con 0x7fa9fc0b1770 2023-07-14T12:53:28.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.529+0000 7fa9f1ffb640 1 -- 172.21.15.5:0/2779344052 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa9f80170a0 con 0x7fa9fc0b1770 2023-07-14T12:53:28.559 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T12:53:28.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.533+0000 7faa0389c640 1 -- 172.21.15.5:0/2779344052 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa9e0066280 msgr2=0x7fa9e0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:28.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.533+0000 7faa0389c640 1 --2- 172.21.15.5:0/2779344052 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa9e0066280 0x7fa9e0068730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc1f70b0 tx=0x7fa9ec007d40 comp rx=0 tx=0).stop 2023-07-14T12:53:28.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.533+0000 7faa0389c640 1 -- 172.21.15.5:0/2779344052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9fc0b1770 msgr2=0x7fa9fc06c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:28.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.533+0000 7faa0389c640 1 --2- 172.21.15.5:0/2779344052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9fc0b1770 0x7fa9fc06c140 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa9f800ec10 tx=0x7fa9f800c520 comp rx=0 tx=0).stop 2023-07-14T12:53:28.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.533+0000 7faa0389c640 1 -- 172.21.15.5:0/2779344052 shutdown_connections 2023-07-14T12:53:28.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.533+0000 7faa0389c640 1 --2- 172.21.15.5:0/2779344052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9fc0d0820 0x7fa9fc151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.533+0000 7faa0389c640 1 --2- 172.21.15.5:0/2779344052 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa9e0066280 0x7fa9e0068730 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.533+0000 7faa0389c640 1 --2- 172.21.15.5:0/2779344052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9fc0cdd10 0x7fa9fc1474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.533+0000 7faa0389c640 1 --2- 172.21.15.5:0/2779344052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9fc0b1770 0x7fa9fc06c140 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.533+0000 7faa0389c640 1 -- 172.21.15.5:0/2779344052 >> 172.21.15.5:0/2779344052 conn(0x7fa9fc099490 msgr2=0x7fa9fc0af1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:28.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.533+0000 7faa0389c640 1 -- 172.21.15.5:0/2779344052 shutdown_connections 2023-07-14T12:53:28.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.533+0000 7faa0389c640 1 -- 172.21.15.5:0/2779344052 wait complete. 2023-07-14T12:53:28.579 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T12:53:28.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.697+0000 7f8b9b248640 1 Processor -- start 2023-07-14T12:53:28.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.697+0000 7f8b9b248640 1 -- start start 2023-07-14T12:53:28.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.701+0000 7f8b9b248640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8b94069430 0x7f8b94069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:28.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.701+0000 7f8b9b248640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b94070f30 0x7f8b940ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:28.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.701+0000 7f8b9b248640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b94159d70 con 0x7f8b940af2b0 2023-07-14T12:53:28.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.701+0000 7f8b9b248640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b94069d40 con 0x7f8b94069430 2023-07-14T12:53:28.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.701+0000 7f8b9b248640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b940c9c60 con 0x7f8b94070f30 2023-07-14T12:53:28.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.701+0000 7f8b997e5640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8b940af2b0 0x7f8b9415a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47204/0 (socket says 172.21.15.5:47204) 2023-07-14T12:53:28.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.701+0000 7f8b997e5640 1 -- 172.21.15.5:0/281266239 learned_addr learned my addr 172.21.15.5:0/281266239 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:28.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.701+0000 7f8b93fff640 1 --2- 172.21.15.5:0/281266239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b94070f30 0x7f8b940ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:28.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.701+0000 7f8b98fe4640 1 --2- 172.21.15.5:0/281266239 >> v2:172.21.15.154:3300/0 conn(0x7f8b94069430 0x7f8b94069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:28.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.701+0000 7f8b937fe640 1 -- 172.21.15.5:0/281266239 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038529015 0 0) 0x7f8b8c0014a0 con 0x7f8b940af2b0 2023-07-14T12:53:28.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.701+0000 7f8b937fe640 1 -- 172.21.15.5:0/281266239 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b84003530 con 0x7f8b940af2b0 2023-07-14T12:53:28.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.701+0000 7f8b93fff640 1 -- 172.21.15.5:0/281266239 >> v2:172.21.15.154:3300/0 conn(0x7f8b94069430 msgr2=0x7f8b94069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:28.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.701+0000 7f8b93fff640 1 --2- 172.21.15.5:0/281266239 >> v2:172.21.15.154:3300/0 conn(0x7f8b94069430 0x7f8b94069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.701+0000 7f8b93fff640 1 -- 172.21.15.5:0/281266239 >> v1:172.21.15.5:6789/0 conn(0x7f8b940af2b0 legacy=0x7f8b9415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:28.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.701+0000 7f8b93fff640 1 -- 172.21.15.5:0/281266239 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b940c9f40 con 0x7f8b94070f30 2023-07-14T12:53:28.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.701+0000 7f8b98fe4640 1 --2- 172.21.15.5:0/281266239 >> v2:172.21.15.154:3300/0 conn(0x7f8b94069430 0x7f8b94069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:53:28.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.705+0000 7f8b93fff640 1 --2- 172.21.15.5:0/281266239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b94070f30 0x7f8b940ad6f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8b800097c0 tx=0x7f8b8001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83c4c84d49639ff6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:28.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.705+0000 7f8b937fe640 1 -- 172.21.15.5:0/281266239 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b800ab680 con 0x7f8b94070f30 2023-07-14T12:53:28.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.705+0000 7f8b937fe640 1 -- 172.21.15.5:0/281266239 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b800ab7e0 con 0x7f8b94070f30 2023-07-14T12:53:28.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.705+0000 7f8b937fe640 1 -- 172.21.15.5:0/281266239 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b800abb70 con 0x7f8b94070f30 2023-07-14T12:53:28.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.705+0000 7f8b9b248640 1 -- 172.21.15.5:0/281266239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b94070f30 msgr2=0x7f8b940ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:28.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.705+0000 7f8b9b248640 1 --2- 172.21.15.5:0/281266239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b94070f30 0x7f8b940ad6f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8b800097c0 tx=0x7f8b8001c480 comp rx=0 tx=0).stop 2023-07-14T12:53:28.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.705+0000 7f8b9b248640 1 -- 172.21.15.5:0/281266239 shutdown_connections 2023-07-14T12:53:28.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.705+0000 7f8b9b248640 1 --2- 172.21.15.5:0/281266239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b94070f30 0x7f8b940ad6f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.705+0000 7f8b9b248640 1 --2- 172.21.15.5:0/281266239 >> v2:172.21.15.154:3300/0 conn(0x7f8b94069430 0x7f8b94069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.705+0000 7f8b9b248640 1 -- 172.21.15.5:0/281266239 >> 172.21.15.5:0/281266239 conn(0x7f8b940cde90 msgr2=0x7f8b940ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:28.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.705+0000 7f8b9b248640 1 -- 172.21.15.5:0/281266239 shutdown_connections 2023-07-14T12:53:28.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.705+0000 7f8b9b248640 1 -- 172.21.15.5:0/281266239 wait complete. 2023-07-14T12:53:28.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.705+0000 7f8b9b248640 1 Processor -- start 2023-07-14T12:53:28.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.705+0000 7f8b9b248640 1 -- start start 2023-07-14T12:53:28.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.705+0000 7f8b9b248640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b94069430 0x7f8b940c3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:28.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.705+0000 7f8b9b248640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b94070f30 0x7f8b940b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:28.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.705+0000 7f8b9b248640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b940af2b0 0x7f8b940b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:28.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.705+0000 7f8b9b248640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b940ac360 con 0x7f8b94069430 2023-07-14T12:53:28.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.705+0000 7f8b9b248640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b940b3b40 con 0x7f8b94070f30 2023-07-14T12:53:28.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.705+0000 7f8b9b248640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b940b1c60 con 0x7f8b940af2b0 2023-07-14T12:53:28.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.709+0000 7f8b98fe4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b94069430 0x7f8b940c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:28.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.709+0000 7f8b98fe4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b94069430 0x7f8b940c3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42248/0 (socket says 172.21.15.5:42248) 2023-07-14T12:53:28.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.709+0000 7f8b98fe4640 1 -- 172.21.15.5:0/2409936007 learned_addr learned my addr 172.21.15.5:0/2409936007 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:28.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.709+0000 7f8b997e5640 1 --2- 172.21.15.5:0/2409936007 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b940af2b0 0x7f8b940b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:28.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.709+0000 7f8b93fff640 1 --2- 172.21.15.5:0/2409936007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b94070f30 0x7f8b940b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:28.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.709+0000 7f8b98fe4640 1 -- 172.21.15.5:0/2409936007 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b940af2b0 msgr2=0x7f8b940b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:28.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.709+0000 7f8b98fe4640 1 --2- 172.21.15.5:0/2409936007 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b940af2b0 0x7f8b940b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.709+0000 7f8b98fe4640 1 -- 172.21.15.5:0/2409936007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b94070f30 msgr2=0x7f8b940b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:28.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.709+0000 7f8b98fe4640 1 --2- 172.21.15.5:0/2409936007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b94070f30 0x7f8b940b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.709+0000 7f8b98fe4640 1 -- 172.21.15.5:0/2409936007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b88009420 con 0x7f8b94069430 2023-07-14T12:53:28.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.709+0000 7f8b93fff640 1 --2- 172.21.15.5:0/2409936007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b94070f30 0x7f8b940b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:28.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.709+0000 7f8b98fe4640 1 --2- 172.21.15.5:0/2409936007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b94069430 0x7f8b940c3200 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8b8800e9b0 tx=0x7f8b8800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:28.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.709+0000 7f8b917fa640 1 -- 172.21.15.5:0/2409936007 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8800c9a0 con 0x7f8b94069430 2023-07-14T12:53:28.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.709+0000 7f8b917fa640 1 -- 172.21.15.5:0/2409936007 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8800cb00 con 0x7f8b94069430 2023-07-14T12:53:28.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.709+0000 7f8b9b248640 1 -- 172.21.15.5:0/2409936007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b80009420 con 0x7f8b94069430 2023-07-14T12:53:28.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.709+0000 7f8b917fa640 1 -- 172.21.15.5:0/2409936007 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8800ce90 con 0x7f8b94069430 2023-07-14T12:53:28.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.709+0000 7f8b9b248640 1 -- 172.21.15.5:0/2409936007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b940abd10 con 0x7f8b94069430 2023-07-14T12:53:28.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.709+0000 7f8b9b248640 1 -- 172.21.15.5:0/2409936007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b940678d0 con 0x7f8b94069430 2023-07-14T12:53:28.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.709+0000 7f8b917fa640 1 -- 172.21.15.5:0/2409936007 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8b88013470 con 0x7f8b94069430 2023-07-14T12:53:28.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.713+0000 7f8b917fa640 1 --2- 172.21.15.5:0/2409936007 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f8b78066280 0x7f8b78068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:28.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.713+0000 7f8b917fa640 1 -- 172.21.15.5:0/2409936007 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8b88084480 con 0x7f8b94069430 2023-07-14T12:53:28.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.713+0000 7f8b93fff640 1 --2- 172.21.15.5:0/2409936007 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f8b78066280 0x7f8b78068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:28.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.713+0000 7f8b93fff640 1 --2- 172.21.15.5:0/2409936007 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f8b78066280 0x7f8b78068730 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8b800af000 tx=0x7f8b800a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:28.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.713+0000 7f8b917fa640 1 -- 172.21.15.5:0/2409936007 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f8b88055230 con 0x7f8b94069430 2023-07-14T12:53:28.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.869+0000 7f8b9b248640 1 -- 172.21.15.5:0/2409936007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8b940c2fe0 con 0x7f8b94069430 2023-07-14T12:53:28.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.869+0000 7f8b917fa640 1 -- 172.21.15.5:0/2409936007 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8b88054dc0 con 0x7f8b94069430 2023-07-14T12:53:28.897 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T12:53:28.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.869+0000 7f8b9b248640 1 -- 172.21.15.5:0/2409936007 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f8b78066280 msgr2=0x7f8b78068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:28.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.869+0000 7f8b9b248640 1 --2- 172.21.15.5:0/2409936007 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f8b78066280 0x7f8b78068730 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8b800af000 tx=0x7f8b800a7000 comp rx=0 tx=0).stop 2023-07-14T12:53:28.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.869+0000 7f8b9b248640 1 -- 172.21.15.5:0/2409936007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b94069430 msgr2=0x7f8b940c3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:28.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.869+0000 7f8b9b248640 1 --2- 172.21.15.5:0/2409936007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b94069430 0x7f8b940c3200 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8b8800e9b0 tx=0x7f8b8800ee70 comp rx=0 tx=0).stop 2023-07-14T12:53:28.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.869+0000 7f8b9b248640 1 -- 172.21.15.5:0/2409936007 shutdown_connections 2023-07-14T12:53:28.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.869+0000 7f8b9b248640 1 --2- 172.21.15.5:0/2409936007 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b940af2b0 0x7f8b940b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.869+0000 7f8b9b248640 1 --2- 172.21.15.5:0/2409936007 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f8b78066280 0x7f8b78068730 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.869+0000 7f8b9b248640 1 --2- 172.21.15.5:0/2409936007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b94070f30 0x7f8b940b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.869+0000 7f8b9b248640 1 --2- 172.21.15.5:0/2409936007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b94069430 0x7f8b940c3200 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:28.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.869+0000 7f8b9b248640 1 -- 172.21.15.5:0/2409936007 >> 172.21.15.5:0/2409936007 conn(0x7f8b940cde90 msgr2=0x7f8b940cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:28.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.869+0000 7f8b9b248640 1 -- 172.21.15.5:0/2409936007 shutdown_connections 2023-07-14T12:53:28.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:28.869+0000 7f8b9b248640 1 -- 172.21.15.5:0/2409936007 wait complete. 2023-07-14T12:53:28.918 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T12:53:29.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.037+0000 7f5002dfa640 1 Processor -- start 2023-07-14T12:53:29.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.037+0000 7f5002dfa640 1 -- start start 2023-07-14T12:53:29.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.037+0000 7f5002dfa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ffc15bde0 0x7f4ffc0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:29.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.037+0000 7f5002dfa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4ffc0d2fc0 0x7f4ffc0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:29.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.037+0000 7f5002dfa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ffc0b04c0 con 0x7f4ffc0d2300 2023-07-14T12:53:29.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.037+0000 7f5002dfa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ffc15c1b0 con 0x7f4ffc0d2fc0 2023-07-14T12:53:29.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.037+0000 7f5002dfa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc0d0aa0 con 0x7f4ffc15bde0 2023-07-14T12:53:29.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.041+0000 7f5000b96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ffc15bde0 0x7f4ffc0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:29.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.041+0000 7f4ffbfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4ffc0d2fc0 0x7f4ffc0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:29.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.041+0000 7f5000b96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ffc15bde0 0x7f4ffc0d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:33874/0 (socket says 172.21.15.5:33874) 2023-07-14T12:53:29.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.041+0000 7f5001397640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4ffc0d2300 0x7f4ffc0cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:42292/0 (socket says 172.21.15.5:42292) 2023-07-14T12:53:29.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.041+0000 7f5000b96640 1 -- 172.21.15.5:0/1662290670 learned_addr learned my addr 172.21.15.5:0/1662290670 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:29.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.041+0000 7f5000b96640 1 -- 172.21.15.5:0/1662290670 >> v2:172.21.15.154:3300/0 conn(0x7f4ffc0d2fc0 msgr2=0x7f4ffc0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:29.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.041+0000 7f5000b96640 1 --2- 172.21.15.5:0/1662290670 >> v2:172.21.15.154:3300/0 conn(0x7f4ffc0d2fc0 0x7f4ffc0b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:29.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.041+0000 7f5000b96640 1 -- 172.21.15.5:0/1662290670 >> v1:172.21.15.154:6789/0 conn(0x7f4ffc0d2300 legacy=0x7f4ffc0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:29.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.041+0000 7f4ffb7fe640 1 -- 172.21.15.5:0/1662290670 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1728522250 0 0) 0x7f4ffc0b04c0 con 0x7f4ffc0d2300 2023-07-14T12:53:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.041+0000 7f5000b96640 1 -- 172.21.15.5:0/1662290670 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc0afb90 con 0x7f4ffc15bde0 2023-07-14T12:53:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.041+0000 7f5000b96640 1 --2- 172.21.15.5:0/1662290670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ffc15bde0 0x7f4ffc0d0270 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0006fd0 tx=0x7f4ff001c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e473a074b48bbba5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.045+0000 7f4ffb7fe640 1 -- 172.21.15.5:0/1662290670 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff00aa680 con 0x7f4ffc15bde0 2023-07-14T12:53:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.045+0000 7f4ffb7fe640 1 -- 172.21.15.5:0/1662290670 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff00aa7e0 con 0x7f4ffc15bde0 2023-07-14T12:53:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.045+0000 7f4ffb7fe640 1 -- 172.21.15.5:0/1662290670 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff00aab70 con 0x7f4ffc15bde0 2023-07-14T12:53:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.045+0000 7f5002dfa640 1 -- 172.21.15.5:0/1662290670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ffc15bde0 msgr2=0x7f4ffc0d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.045+0000 7f5002dfa640 1 --2- 172.21.15.5:0/1662290670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ffc15bde0 0x7f4ffc0d0270 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0006fd0 tx=0x7f4ff001c520 comp rx=0 tx=0).stop 2023-07-14T12:53:29.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.045+0000 7f5002dfa640 1 -- 172.21.15.5:0/1662290670 shutdown_connections 2023-07-14T12:53:29.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.045+0000 7f5002dfa640 1 --2- 172.21.15.5:0/1662290670 >> v2:172.21.15.154:3300/0 conn(0x7f4ffc0d2fc0 0x7f4ffc0b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:29.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.045+0000 7f5002dfa640 1 --2- 172.21.15.5:0/1662290670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ffc15bde0 0x7f4ffc0d0270 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:29.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.045+0000 7f5002dfa640 1 -- 172.21.15.5:0/1662290670 >> 172.21.15.5:0/1662290670 conn(0x7f4ffc0659d0 msgr2=0x7f4ffc09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:29.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.045+0000 7f5002dfa640 1 -- 172.21.15.5:0/1662290670 shutdown_connections 2023-07-14T12:53:29.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.045+0000 7f5002dfa640 1 -- 172.21.15.5:0/1662290670 wait complete. 2023-07-14T12:53:29.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.045+0000 7f5002dfa640 1 Processor -- start 2023-07-14T12:53:29.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.045+0000 7f5002dfa640 1 -- start start 2023-07-14T12:53:29.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.045+0000 7f5002dfa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ffc0d2300 0x7f4ffc0b2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:29.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.045+0000 7f5002dfa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ffc0d2fc0 0x7f4ffc155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:29.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.045+0000 7f5002dfa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ffc15bde0 0x7f4ffc0b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:29.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.045+0000 7f5002dfa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc0b3080 con 0x7f4ffc15bde0 2023-07-14T12:53:29.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.045+0000 7f5002dfa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc0b3360 con 0x7f4ffc0d2300 2023-07-14T12:53:29.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.045+0000 7f5002dfa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc0b3640 con 0x7f4ffc0d2fc0 2023-07-14T12:53:29.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.045+0000 7f5001397640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ffc15bde0 0x7f4ffc0b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:29.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.045+0000 7f5001397640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ffc15bde0 0x7f4ffc0b11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44498/0 (socket says 172.21.15.5:44498) 2023-07-14T12:53:29.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.045+0000 7f5001397640 1 -- 172.21.15.5:0/3813795698 learned_addr learned my addr 172.21.15.5:0/3813795698 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:29.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.049+0000 7f5000b96640 1 --2- 172.21.15.5:0/3813795698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ffc0d2300 0x7f4ffc0b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:29.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.049+0000 7f4ffbfff640 1 --2- 172.21.15.5:0/3813795698 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ffc0d2fc0 0x7f4ffc155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:29.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.049+0000 7f5001397640 1 -- 172.21.15.5:0/3813795698 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ffc0d2fc0 msgr2=0x7f4ffc155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:29.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.049+0000 7f5001397640 1 --2- 172.21.15.5:0/3813795698 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ffc0d2fc0 0x7f4ffc155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:29.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.049+0000 7f5001397640 1 -- 172.21.15.5:0/3813795698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ffc0d2300 msgr2=0x7f4ffc0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:29.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.049+0000 7f5001397640 1 --2- 172.21.15.5:0/3813795698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ffc0d2300 0x7f4ffc0b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:29.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.049+0000 7f5001397640 1 -- 172.21.15.5:0/3813795698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff0009480 con 0x7f4ffc15bde0 2023-07-14T12:53:29.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.049+0000 7f5001397640 1 --2- 172.21.15.5:0/3813795698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ffc15bde0 0x7f4ffc0b11f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4ff400c780 tx=0x7f4ff400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:29.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.049+0000 7f4ff97fa640 1 -- 172.21.15.5:0/3813795698 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff400ce90 con 0x7f4ffc15bde0 2023-07-14T12:53:29.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.049+0000 7f4ff97fa640 1 -- 172.21.15.5:0/3813795698 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff400a640 con 0x7f4ffc15bde0 2023-07-14T12:53:29.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.049+0000 7f5002dfa640 1 -- 172.21.15.5:0/3813795698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ffc0b3920 con 0x7f4ffc15bde0 2023-07-14T12:53:29.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.049+0000 7f4ff97fa640 1 -- 172.21.15.5:0/3813795698 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff400a9d0 con 0x7f4ffc15bde0 2023-07-14T12:53:29.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.049+0000 7f5002dfa640 1 -- 172.21.15.5:0/3813795698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ffc0b4100 con 0x7f4ffc15bde0 2023-07-14T12:53:29.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.049+0000 7f5002dfa640 1 -- 172.21.15.5:0/3813795698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ffc0678d0 con 0x7f4ffc15bde0 2023-07-14T12:53:29.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.049+0000 7f4ff97fa640 1 -- 172.21.15.5:0/3813795698 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4ff400ab30 con 0x7f4ffc15bde0 2023-07-14T12:53:29.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.049+0000 7f4ff97fa640 1 --2- 172.21.15.5:0/3813795698 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4fe0066280 0x7f4fe0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:29.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.049+0000 7f4ff97fa640 1 -- 172.21.15.5:0/3813795698 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4ff4083580 con 0x7f4ffc15bde0 2023-07-14T12:53:29.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.053+0000 7f5000b96640 1 --2- 172.21.15.5:0/3813795698 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4fe0066280 0x7f4fe0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:29.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.053+0000 7f5000b96640 1 --2- 172.21.15.5:0/3813795698 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4fe0066280 0x7f4fe0068730 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00ae000 tx=0x7f4ff00a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:29.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.053+0000 7f4ff97fa640 1 -- 172.21.15.5:0/3813795698 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4ff40509d0 con 0x7f4ffc15bde0 2023-07-14T12:53:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.209+0000 7f5002dfa640 1 -- 172.21.15.5:0/3813795698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ffc0c5c20 con 0x7f4ffc15bde0 2023-07-14T12:53:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.209+0000 7f4ff97fa640 1 -- 172.21.15.5:0/3813795698 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ff4053ff0 con 0x7f4ffc15bde0 2023-07-14T12:53:29.238 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T12:53:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.213+0000 7f5002dfa640 1 -- 172.21.15.5:0/3813795698 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4fe0066280 msgr2=0x7f4fe0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:29.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.213+0000 7f5002dfa640 1 --2- 172.21.15.5:0/3813795698 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4fe0066280 0x7f4fe0068730 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00ae000 tx=0x7f4ff00a7000 comp rx=0 tx=0).stop 2023-07-14T12:53:29.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.213+0000 7f5002dfa640 1 -- 172.21.15.5:0/3813795698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ffc15bde0 msgr2=0x7f4ffc0b11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:29.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.213+0000 7f5002dfa640 1 --2- 172.21.15.5:0/3813795698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ffc15bde0 0x7f4ffc0b11f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4ff400c780 tx=0x7f4ff400cc40 comp rx=0 tx=0).stop 2023-07-14T12:53:29.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.213+0000 7f5002dfa640 1 -- 172.21.15.5:0/3813795698 shutdown_connections 2023-07-14T12:53:29.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.213+0000 7f5002dfa640 1 --2- 172.21.15.5:0/3813795698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ffc15bde0 0x7f4ffc0b11f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:29.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.213+0000 7f5002dfa640 1 --2- 172.21.15.5:0/3813795698 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ffc0d2fc0 0x7f4ffc155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:29.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.213+0000 7f5002dfa640 1 --2- 172.21.15.5:0/3813795698 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4fe0066280 0x7f4fe0068730 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:29.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.213+0000 7f5002dfa640 1 --2- 172.21.15.5:0/3813795698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ffc0d2300 0x7f4ffc0b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:29.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.213+0000 7f5002dfa640 1 -- 172.21.15.5:0/3813795698 >> 172.21.15.5:0/3813795698 conn(0x7f4ffc0659d0 msgr2=0x7f4ffc0b51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:29.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.213+0000 7f5002dfa640 1 -- 172.21.15.5:0/3813795698 shutdown_connections 2023-07-14T12:53:29.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.213+0000 7f5002dfa640 1 -- 172.21.15.5:0/3813795698 wait complete. 2023-07-14T12:53:29.259 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:53:29.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.377+0000 7f216e900640 1 Processor -- start 2023-07-14T12:53:29.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.377+0000 7f216e900640 1 -- start start 2023-07-14T12:53:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.377+0000 7f216e900640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f21680b7c70 0x7f21680d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.377+0000 7f216e900640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f216815fd60 0x7f21680d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.377+0000 7f216e900640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21680ccaf0 con 0x7f21680d1850 2023-07-14T12:53:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.377+0000 7f216e900640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21680d1190 con 0x7f21680b7c70 2023-07-14T12:53:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.377+0000 7f216e900640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2168160600 con 0x7f216815fd60 2023-07-14T12:53:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.377+0000 7f2167fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f21680b7c70 0x7f21680d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.377+0000 7f21677fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f21680d1850 0x7f216815f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60678/0 (socket says 172.21.15.5:60678) 2023-07-14T12:53:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.377+0000 7f21677fe640 1 -- 172.21.15.5:0/1947113537 learned_addr learned my addr 172.21.15.5:0/1947113537 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.377+0000 7f216ce9d640 1 --2- 172.21.15.5:0/1947113537 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f216815fd60 0x7f21680d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.377+0000 7f2166ffd640 1 -- 172.21.15.5:0/1947113537 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2892817491 0 0) 0x7f21680ccaf0 con 0x7f21680d1850 2023-07-14T12:53:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.377+0000 7f2166ffd640 1 -- 172.21.15.5:0/1947113537 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2150003530 con 0x7f21680d1850 2023-07-14T12:53:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.377+0000 7f2167fff640 1 -- 172.21.15.5:0/1947113537 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f216815fd60 msgr2=0x7f21680d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.377+0000 7f2167fff640 1 --2- 172.21.15.5:0/1947113537 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f216815fd60 0x7f21680d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.377+0000 7f2167fff640 1 -- 172.21.15.5:0/1947113537 >> v1:172.21.15.5:6789/0 conn(0x7f21680d1850 legacy=0x7f216815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.377+0000 7f2167fff640 1 -- 172.21.15.5:0/1947113537 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2168160320 con 0x7f21680b7c70 2023-07-14T12:53:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.377+0000 7f216ce9d640 1 --2- 172.21.15.5:0/1947113537 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f216815fd60 0x7f21680d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.381+0000 7f2167fff640 1 --2- 172.21.15.5:0/1947113537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21680b7c70 0x7f21680d0c50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f21580097c0 tx=0x7f215801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97316d9fff64f6e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.381+0000 7f2166ffd640 1 -- 172.21.15.5:0/1947113537 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21580ab670 con 0x7f21680b7c70 2023-07-14T12:53:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.381+0000 7f2166ffd640 1 -- 172.21.15.5:0/1947113537 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21580ab7d0 con 0x7f21680b7c70 2023-07-14T12:53:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.381+0000 7f2166ffd640 1 -- 172.21.15.5:0/1947113537 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21580abb60 con 0x7f21680b7c70 2023-07-14T12:53:29.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.381+0000 7f216e900640 1 -- 172.21.15.5:0/1947113537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21680b7c70 msgr2=0x7f21680d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:29.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.381+0000 7f216e900640 1 --2- 172.21.15.5:0/1947113537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21680b7c70 0x7f21680d0c50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f21580097c0 tx=0x7f215801c450 comp rx=0 tx=0).stop 2023-07-14T12:53:29.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.381+0000 7f216e900640 1 -- 172.21.15.5:0/1947113537 shutdown_connections 2023-07-14T12:53:29.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.381+0000 7f216e900640 1 --2- 172.21.15.5:0/1947113537 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f216815fd60 0x7f21680d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:29.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.381+0000 7f216e900640 1 --2- 172.21.15.5:0/1947113537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21680b7c70 0x7f21680d0c50 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:29.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.381+0000 7f216e900640 1 -- 172.21.15.5:0/1947113537 >> 172.21.15.5:0/1947113537 conn(0x7f21680650b0 msgr2=0x7f21680654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:29.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.381+0000 7f216e900640 1 -- 172.21.15.5:0/1947113537 shutdown_connections 2023-07-14T12:53:29.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.381+0000 7f216e900640 1 -- 172.21.15.5:0/1947113537 wait complete. 2023-07-14T12:53:29.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.385+0000 7f216e900640 1 Processor -- start 2023-07-14T12:53:29.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.385+0000 7f216e900640 1 -- start start 2023-07-14T12:53:29.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.385+0000 7f216e900640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21680b7c70 0x7f21681577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:29.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.385+0000 7f216e900640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21680d1850 0x7f216815acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:29.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.385+0000 7f216e900640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f216815fd60 0x7f21680b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:29.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.385+0000 7f216e900640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216814dc20 con 0x7f21680d1850 2023-07-14T12:53:29.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.385+0000 7f216e900640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2168157db0 con 0x7f216815fd60 2023-07-14T12:53:29.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.385+0000 7f216e900640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2168151390 con 0x7f21680b7c70 2023-07-14T12:53:29.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.385+0000 7f21677fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21680d1850 0x7f216815acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:29.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.385+0000 7f21677fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21680d1850 0x7f216815acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44510/0 (socket says 172.21.15.5:44510) 2023-07-14T12:53:29.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.385+0000 7f21677fe640 1 -- 172.21.15.5:0/2546826482 learned_addr learned my addr 172.21.15.5:0/2546826482 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:29.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.385+0000 7f21677fe640 1 -- 172.21.15.5:0/2546826482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21680b7c70 msgr2=0x7f21681577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:29.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.385+0000 7f21677fe640 1 --2- 172.21.15.5:0/2546826482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21680b7c70 0x7f21681577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:29.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.385+0000 7f21677fe640 1 -- 172.21.15.5:0/2546826482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f216815fd60 msgr2=0x7f21680b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:29.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.385+0000 7f21677fe640 1 --2- 172.21.15.5:0/2546826482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f216815fd60 0x7f21680b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:29.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.385+0000 7f21677fe640 1 -- 172.21.15.5:0/2546826482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2158009420 con 0x7f21680d1850 2023-07-14T12:53:29.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.385+0000 7f21677fe640 1 --2- 172.21.15.5:0/2546826482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21680d1850 0x7f216815acc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f215c00c420 tx=0x7f215c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:29.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.385+0000 7f2164ff9640 1 -- 172.21.15.5:0/2546826482 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c005cf0 con 0x7f21680d1850 2023-07-14T12:53:29.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.385+0000 7f2164ff9640 1 -- 172.21.15.5:0/2546826482 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215c005e50 con 0x7f21680d1850 2023-07-14T12:53:29.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.385+0000 7f216e900640 1 -- 172.21.15.5:0/2546826482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2168151670 con 0x7f21680d1850 2023-07-14T12:53:29.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.385+0000 7f2164ff9640 1 -- 172.21.15.5:0/2546826482 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c0072d0 con 0x7f21680d1850 2023-07-14T12:53:29.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.385+0000 7f216e900640 1 -- 172.21.15.5:0/2546826482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216815b200 con 0x7f21680d1850 2023-07-14T12:53:29.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.389+0000 7f216e900640 1 -- 172.21.15.5:0/2546826482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21680678d0 con 0x7f21680d1850 2023-07-14T12:53:29.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.389+0000 7f2164ff9640 1 -- 172.21.15.5:0/2546826482 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f215c007430 con 0x7f21680d1850 2023-07-14T12:53:29.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.389+0000 7f2164ff9640 1 --2- 172.21.15.5:0/2546826482 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2154066280 0x7f2154068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:29.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.389+0000 7f2164ff9640 1 -- 172.21.15.5:0/2546826482 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f215c083370 con 0x7f21680d1850 2023-07-14T12:53:29.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.389+0000 7f2167fff640 1 --2- 172.21.15.5:0/2546826482 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2154066280 0x7f2154068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:29.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.389+0000 7f2167fff640 1 --2- 172.21.15.5:0/2546826482 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2154066280 0x7f2154068730 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f21580af000 tx=0x7f2158008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:29.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.393+0000 7f2164ff9640 1 -- 172.21.15.5:0/2546826482 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f215c0507c0 con 0x7f21680d1850 2023-07-14T12:53:29.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.581+0000 7f216e900640 1 -- 172.21.15.5:0/2546826482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21680c5bb0 con 0x7f21680d1850 2023-07-14T12:53:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.581+0000 7f2164ff9640 1 -- 172.21.15.5:0/2546826482 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4703 (secure 0 0 0) 0x7f215c053de0 con 0x7f21680d1850 2023-07-14T12:53:29.609 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:29.610 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1953958881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1953958881},{"type":"v1","addr":"172.21.15.154:6837","nonce":1953958881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3138000501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3138000501},{"type":"v1","addr":"172.21.15.5:6834","nonce":3138000501}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1911549775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1911549775},{"type":"v1","addr":"172.21.15.5:6835","nonce":1911549775}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T12:52:46.473195+0000","modified":"2023-07-14T12:52:50.433872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6836/3154882793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3154882793},{"type":"v1","addr":"172.21.15.154:6836","nonce":3154882793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T12:53:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2023-07-14T12:53:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.585+0000 7f216e900640 1 -- 172.21.15.5:0/2546826482 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2154066280 msgr2=0x7f2154068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.585+0000 7f216e900640 1 --2- 172.21.15.5:0/2546826482 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2154066280 0x7f2154068730 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f21580af000 tx=0x7f2158008040 comp rx=0 tx=0).stop 2023-07-14T12:53:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.585+0000 7f216e900640 1 -- 172.21.15.5:0/2546826482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21680d1850 msgr2=0x7f216815acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.585+0000 7f216e900640 1 --2- 172.21.15.5:0/2546826482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21680d1850 0x7f216815acc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f215c00c420 tx=0x7f215c00c8e0 comp rx=0 tx=0).stop 2023-07-14T12:53:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.585+0000 7f216e900640 1 -- 172.21.15.5:0/2546826482 shutdown_connections 2023-07-14T12:53:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.585+0000 7f216e900640 1 --2- 172.21.15.5:0/2546826482 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2154066280 0x7f2154068730 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.585+0000 7f216e900640 1 --2- 172.21.15.5:0/2546826482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f216815fd60 0x7f21680b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.585+0000 7f216e900640 1 --2- 172.21.15.5:0/2546826482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21680d1850 0x7f216815acc0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.585+0000 7f216e900640 1 --2- 172.21.15.5:0/2546826482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21680b7c70 0x7f21681577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.585+0000 7f216e900640 1 -- 172.21.15.5:0/2546826482 >> 172.21.15.5:0/2546826482 conn(0x7f21680650b0 msgr2=0x7f216815f370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.585+0000 7f216e900640 1 -- 172.21.15.5:0/2546826482 shutdown_connections 2023-07-14T12:53:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.585+0000 7f216e900640 1 -- 172.21.15.5:0/2546826482 wait complete. 2023-07-14T12:53:29.631 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:53:29.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.745+0000 7effc8d37640 1 Processor -- start 2023-07-14T12:53:29.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.749+0000 7effc8d37640 1 -- start start 2023-07-14T12:53:29.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.749+0000 7effc8d37640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effc406b1e0 0x7effc40c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:29.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.749+0000 7effc8d37640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc40cac70 con 0x7effc40c21f0 2023-07-14T12:53:29.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.749+0000 7effc8d37640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc40ca060 con 0x7effc4070b70 2023-07-14T12:53:29.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.749+0000 7effc8d37640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc40ca340 con 0x7effc406b1e0 2023-07-14T12:53:29.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.749+0000 7effc2d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7effc40c21f0 0x7effc40cb100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60686/0 (socket says 172.21.15.5:60686) 2023-07-14T12:53:29.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.749+0000 7effc2d9d640 1 -- 172.21.15.5:0/1631292756 learned_addr learned my addr 172.21.15.5:0/1631292756 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:29.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.749+0000 7effbbfff640 1 --2- 172.21.15.5:0/1631292756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effc406b1e0 0x7effc40c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:29.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.749+0000 7effc1d9b640 1 -- 172.21.15.5:0/1631292756 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999153744 0 0) 0x7effc40cac70 con 0x7effc40c21f0 2023-07-14T12:53:29.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.749+0000 7effc1d9b640 1 -- 172.21.15.5:0/1631292756 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effb0003530 con 0x7effc40c21f0 2023-07-14T12:53:29.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.749+0000 7effc1d9b640 1 -- 172.21.15.5:0/1631292756 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1161783927 0 0) 0x7effc40ca060 con 0x7effc4070b70 2023-07-14T12:53:29.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.749+0000 7effc1d9b640 1 -- 172.21.15.5:0/1631292756 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effc40cac70 con 0x7effc4070b70 2023-07-14T12:53:29.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.749+0000 7effbbfff640 1 -- 172.21.15.5:0/1631292756 >> v1:172.21.15.154:6789/0 conn(0x7effc4070b70 legacy=0x7effc4070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:29.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.749+0000 7effbbfff640 1 -- 172.21.15.5:0/1631292756 >> v1:172.21.15.5:6789/0 conn(0x7effc40c21f0 legacy=0x7effc40cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:29.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.749+0000 7effbbfff640 1 -- 172.21.15.5:0/1631292756 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc40ca620 con 0x7effc406b1e0 2023-07-14T12:53:29.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.753+0000 7effbbfff640 1 --2- 172.21.15.5:0/1631292756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effc406b1e0 0x7effc40c1cb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7effac0097f0 tx=0x7effac01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3daa63b004483a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:29.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.753+0000 7effc1d9b640 1 -- 172.21.15.5:0/1631292756 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac0ab600 con 0x7effc406b1e0 2023-07-14T12:53:29.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.753+0000 7effc1d9b640 1 -- 172.21.15.5:0/1631292756 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac0ab760 con 0x7effc406b1e0 2023-07-14T12:53:29.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.753+0000 7effc1d9b640 1 -- 172.21.15.5:0/1631292756 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac0abaf0 con 0x7effc406b1e0 2023-07-14T12:53:29.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.753+0000 7effc8d37640 1 -- 172.21.15.5:0/1631292756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effc406b1e0 msgr2=0x7effc40c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:29.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.753+0000 7effc8d37640 1 --2- 172.21.15.5:0/1631292756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effc406b1e0 0x7effc40c1cb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7effac0097f0 tx=0x7effac01c400 comp rx=0 tx=0).stop 2023-07-14T12:53:29.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.753+0000 7effc8d37640 1 -- 172.21.15.5:0/1631292756 shutdown_connections 2023-07-14T12:53:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.753+0000 7effc8d37640 1 --2- 172.21.15.5:0/1631292756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effc406b1e0 0x7effc40c1cb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.753+0000 7effc8d37640 1 -- 172.21.15.5:0/1631292756 >> 172.21.15.5:0/1631292756 conn(0x7effc40afcf0 msgr2=0x7effc40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.753+0000 7effc8d37640 1 -- 172.21.15.5:0/1631292756 shutdown_connections 2023-07-14T12:53:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.753+0000 7effc8d37640 1 -- 172.21.15.5:0/1631292756 wait complete. 2023-07-14T12:53:29.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.753+0000 7effc8d37640 1 Processor -- start 2023-07-14T12:53:29.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.757+0000 7effc8d37640 1 -- start start 2023-07-14T12:53:29.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.757+0000 7effc8d37640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effc406b1e0 0x7effc4153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:29.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.757+0000 7effc8d37640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc4070b70 0x7effc4155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:29.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.757+0000 7effc8d37640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effc40c21f0 0x7effc41472b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:29.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.757+0000 7effc8d37640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc41580e0 con 0x7effc4070b70 2023-07-14T12:53:29.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.757+0000 7effc8d37640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc4156940 con 0x7effc40c21f0 2023-07-14T12:53:29.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.757+0000 7effc8d37640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc4156c20 con 0x7effc406b1e0 2023-07-14T12:53:29.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.757+0000 7effbbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc4070b70 0x7effc4155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:29.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.757+0000 7effbbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc4070b70 0x7effc4155ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44522/0 (socket says 172.21.15.5:44522) 2023-07-14T12:53:29.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.757+0000 7effbbfff640 1 -- 172.21.15.5:0/435008187 learned_addr learned my addr 172.21.15.5:0/435008187 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:29.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.757+0000 7effc2d9d640 1 --2- 172.21.15.5:0/435008187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effc40c21f0 0x7effc41472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:29.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.757+0000 7effc259c640 1 --2- 172.21.15.5:0/435008187 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effc406b1e0 0x7effc4153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:29.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.757+0000 7effbbfff640 1 -- 172.21.15.5:0/435008187 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effc406b1e0 msgr2=0x7effc4153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:29.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.757+0000 7effbbfff640 1 --2- 172.21.15.5:0/435008187 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effc406b1e0 0x7effc4153b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:29.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.757+0000 7effbbfff640 1 -- 172.21.15.5:0/435008187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effc40c21f0 msgr2=0x7effc41472b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:29.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.757+0000 7effbbfff640 1 --2- 172.21.15.5:0/435008187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effc40c21f0 0x7effc41472b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:29.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.757+0000 7effbbfff640 1 -- 172.21.15.5:0/435008187 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac009420 con 0x7effc4070b70 2023-07-14T12:53:29.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.757+0000 7effbbfff640 1 --2- 172.21.15.5:0/435008187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc4070b70 0x7effc4155ec0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7effac019010 tx=0x7effac01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:29.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.757+0000 7effbaffd640 1 -- 172.21.15.5:0/435008187 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac0bf610 con 0x7effc4070b70 2023-07-14T12:53:29.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.757+0000 7effbaffd640 1 -- 172.21.15.5:0/435008187 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac0bf790 con 0x7effc4070b70 2023-07-14T12:53:29.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.757+0000 7effbaffd640 1 -- 172.21.15.5:0/435008187 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac0bfb40 con 0x7effc4070b70 2023-07-14T12:53:29.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.757+0000 7effc8d37640 1 -- 172.21.15.5:0/435008187 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc4158380 con 0x7effc4070b70 2023-07-14T12:53:29.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.757+0000 7effc8d37640 1 -- 172.21.15.5:0/435008187 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc4158940 con 0x7effc4070b70 2023-07-14T12:53:29.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.757+0000 7effc8d37640 1 -- 172.21.15.5:0/435008187 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc4158b30 con 0x7effc4070b70 2023-07-14T12:53:29.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.761+0000 7effbaffd640 1 -- 172.21.15.5:0/435008187 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7effac0b5400 con 0x7effc4070b70 2023-07-14T12:53:29.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.761+0000 7effbaffd640 1 --2- 172.21.15.5:0/435008187 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7effa40662b0 0x7effa4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:29.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.761+0000 7effbaffd640 1 -- 172.21.15.5:0/435008187 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7effac11e7c0 con 0x7effc4070b70 2023-07-14T12:53:29.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.761+0000 7effc259c640 1 --2- 172.21.15.5:0/435008187 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7effa40662b0 0x7effa4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:29.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.761+0000 7effc259c640 1 --2- 172.21.15.5:0/435008187 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7effa40662b0 0x7effa4068760 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7effb40011f0 tx=0x7effb4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:29.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.765+0000 7effbaffd640 1 -- 172.21.15.5:0/435008187 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7effac0ebd30 con 0x7effc4070b70 2023-07-14T12:53:29.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.921+0000 7effc8d37640 1 -- 172.21.15.5:0/435008187 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effc40678d0 con 0x7effc4070b70 2023-07-14T12:53:29.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.921+0000 7effbaffd640 1 -- 172.21.15.5:0/435008187 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18326 (secure 0 0 0) 0x7effac0ef350 con 0x7effc4070b70 2023-07-14T12:53:29.950 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:29.950 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:53:27.546504+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:52:44.223082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T12:52:45.469396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:53:29.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.925+0000 7effc8d37640 1 -- 172.21.15.5:0/435008187 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7effa40662b0 msgr2=0x7effa4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:29.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.925+0000 7effc8d37640 1 --2- 172.21.15.5:0/435008187 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7effa40662b0 0x7effa4068760 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7effb40011f0 tx=0x7effb4009040 comp rx=0 tx=0).stop 2023-07-14T12:53:29.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.925+0000 7effc8d37640 1 -- 172.21.15.5:0/435008187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc4070b70 msgr2=0x7effc4155ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:29.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.925+0000 7effc8d37640 1 --2- 172.21.15.5:0/435008187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc4070b70 0x7effc4155ec0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7effac019010 tx=0x7effac01ac40 comp rx=0 tx=0).stop 2023-07-14T12:53:29.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.925+0000 7effc8d37640 1 -- 172.21.15.5:0/435008187 shutdown_connections 2023-07-14T12:53:29.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.925+0000 7effc8d37640 1 --2- 172.21.15.5:0/435008187 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7effa40662b0 0x7effa4068760 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:29.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.925+0000 7effc8d37640 1 --2- 172.21.15.5:0/435008187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effc40c21f0 0x7effc41472b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:29.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.925+0000 7effc8d37640 1 --2- 172.21.15.5:0/435008187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc4070b70 0x7effc4155ec0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:29.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.925+0000 7effc8d37640 1 --2- 172.21.15.5:0/435008187 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effc406b1e0 0x7effc4153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:29.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.925+0000 7effc8d37640 1 -- 172.21.15.5:0/435008187 >> 172.21.15.5:0/435008187 conn(0x7effc40afcf0 msgr2=0x7effc40b1500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:29.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.925+0000 7effc8d37640 1 -- 172.21.15.5:0/435008187 shutdown_connections 2023-07-14T12:53:29.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:29.925+0000 7effc8d37640 1 -- 172.21.15.5:0/435008187 wait complete. 2023-07-14T12:53:29.971 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-14T12:53:29.972 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:53:30.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb3e6d640 1 Processor -- start 2023-07-14T12:53:30.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb3e6d640 1 -- start start 2023-07-14T12:53:30.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb3e6d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1fac0ad6b0 0x7f1fac0d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb3e6d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fac0aee80 con 0x7f1fac0cdcd0 2023-07-14T12:53:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb3e6d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fac0adde0 con 0x7f1fac0af640 2023-07-14T12:53:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb3e6d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fac0d0ab0 con 0x7f1fac0ad6b0 2023-07-14T12:53:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb1c09640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1fac0cdcd0 0x7f1fac0ce0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60700/0 (socket says 172.21.15.5:60700) 2023-07-14T12:53:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb1c09640 1 -- 172.21.15.5:0/746643779 learned_addr learned my addr 172.21.15.5:0/746643779 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:30.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb1408640 1 --2- 172.21.15.5:0/746643779 >> v2:172.21.15.154:3300/0 conn(0x7f1fac0ad6b0 0x7f1fac0d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:30.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb0c07640 1 -- 172.21.15.5:0/746643779 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3115091860 0 0) 0x7f1fac0aee80 con 0x7f1fac0cdcd0 2023-07-14T12:53:30.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb0c07640 1 -- 172.21.15.5:0/746643779 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f98003530 con 0x7f1fac0cdcd0 2023-07-14T12:53:30.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb0c07640 1 -- 172.21.15.5:0/746643779 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134152672 0 0) 0x7f1fac0adde0 con 0x7f1fac0af640 2023-07-14T12:53:30.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb0c07640 1 -- 172.21.15.5:0/746643779 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fac0aee80 con 0x7f1fac0af640 2023-07-14T12:53:30.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb0c07640 1 -- 172.21.15.5:0/746643779 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1277775946 0 0) 0x7f1f98003530 con 0x7f1fac0cdcd0 2023-07-14T12:53:30.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb0c07640 1 -- 172.21.15.5:0/746643779 >> v2:172.21.15.154:3300/0 conn(0x7f1fac0ad6b0 msgr2=0x7f1fac0d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:30.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb0c07640 1 --2- 172.21.15.5:0/746643779 >> v2:172.21.15.154:3300/0 conn(0x7f1fac0ad6b0 0x7f1fac0d0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:30.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb0c07640 1 -- 172.21.15.5:0/746643779 >> v1:172.21.15.154:6789/0 conn(0x7f1fac0af640 legacy=0x7f1fac0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:30.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb0c07640 1 -- 172.21.15.5:0/746643779 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fac0ae0c0 con 0x7f1fac0cdcd0 2023-07-14T12:53:30.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb0c07640 1 -- 172.21.15.5:0/746643779 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f1fa8001800 con 0x7f1fac0cdcd0 2023-07-14T12:53:30.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb0c07640 1 -- 172.21.15.5:0/746643779 >> v1:172.21.15.5:6789/0 conn(0x7f1fac0cdcd0 legacy=0x7f1fac0ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:30.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb0c07640 1 --2- 172.21.15.5:0/746643779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f98003b60 0x7f1f98003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:30.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb0c07640 1 --2- 172.21.15.5:0/746643779 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f980047d0 0x7f1f98004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:30.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb0c07640 1 --2- 172.21.15.5:0/746643779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f98005180 0x7f1f9800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:30.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb0c07640 1 -- 172.21.15.5:0/746643779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac0d0ab0 con 0x7f1f98003b60 2023-07-14T12:53:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb0c07640 1 -- 172.21.15.5:0/746643779 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9800c060 con 0x7f1f98005180 2023-07-14T12:53:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb0c07640 1 -- 172.21.15.5:0/746643779 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9800c1f0 con 0x7f1f980047d0 2023-07-14T12:53:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb1c09640 1 --2- 172.21.15.5:0/746643779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f98003b60 0x7f1f98003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb1408640 1 --2- 172.21.15.5:0/746643779 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f980047d0 0x7f1f98004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb240a640 1 --2- 172.21.15.5:0/746643779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f98005180 0x7f1f9800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb1c09640 1 -- 172.21.15.5:0/746643779 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f980047d0 msgr2=0x7f1f98004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:30.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb1c09640 1 --2- 172.21.15.5:0/746643779 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f980047d0 0x7f1f98004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:30.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb1c09640 1 -- 172.21.15.5:0/746643779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f98005180 msgr2=0x7f1f9800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:30.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb1c09640 1 --2- 172.21.15.5:0/746643779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f98005180 0x7f1f9800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:30.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb1c09640 1 -- 172.21.15.5:0/746643779 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f98003530 con 0x7f1f98003b60 2023-07-14T12:53:30.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.089+0000 7f1fb240a640 1 -- 172.21.15.5:0/746643779 reap_dead start 2023-07-14T12:53:30.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.093+0000 7f1fb1c09640 1 --2- 172.21.15.5:0/746643779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f98003b60 0x7f1f98003f50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8007f80 tx=0x7f1fa801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea5e5d2c08fc915 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:30.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.093+0000 7f1fb0c07640 1 -- 172.21.15.5:0/746643779 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8007270 con 0x7f1f98003b60 2023-07-14T12:53:30.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.093+0000 7f1fb0c07640 1 -- 172.21.15.5:0/746643779 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa80073f0 con 0x7f1f98003b60 2023-07-14T12:53:30.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.093+0000 7f1fb0c07640 1 -- 172.21.15.5:0/746643779 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa80057b0 con 0x7f1f98003b60 2023-07-14T12:53:30.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.093+0000 7f1fb3e6d640 1 -- 172.21.15.5:0/746643779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f98003b60 msgr2=0x7f1f98003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:30.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.093+0000 7f1fb3e6d640 1 --2- 172.21.15.5:0/746643779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f98003b60 0x7f1f98003f50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8007f80 tx=0x7f1fa801cab0 comp rx=0 tx=0).stop 2023-07-14T12:53:30.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.093+0000 7f1fb3e6d640 1 -- 172.21.15.5:0/746643779 shutdown_connections 2023-07-14T12:53:30.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.093+0000 7f1fb3e6d640 1 --2- 172.21.15.5:0/746643779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f98003b60 0x7f1f98003f50 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:30.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.093+0000 7f1fb3e6d640 1 -- 172.21.15.5:0/746643779 >> 172.21.15.5:0/746643779 conn(0x7f1fac099490 msgr2=0x7f1fac089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.093+0000 7f1fb3e6d640 1 -- 172.21.15.5:0/746643779 shutdown_connections 2023-07-14T12:53:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.093+0000 7f1fb3e6d640 1 -- 172.21.15.5:0/746643779 wait complete. 2023-07-14T12:53:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.097+0000 7f1fb3e6d640 1 Processor -- start 2023-07-14T12:53:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.097+0000 7f1fb3e6d640 1 -- start start 2023-07-14T12:53:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.097+0000 7f1fb3e6d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f98003b60 0x7f1fac09d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.097+0000 7f1fb3e6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fac155200 0x7f1fac158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:30.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.097+0000 7f1fb3e6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fac09aaf0 0x7f1fac09b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:30.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.097+0000 7f1fb3e6d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac099e00 con 0x7f1fac155200 2023-07-14T12:53:30.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.097+0000 7f1fb3e6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac09dca0 con 0x7f1fac09aaf0 2023-07-14T12:53:30.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.097+0000 7f1fb3e6d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac09a010 con 0x7f1f98003b60 2023-07-14T12:53:30.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.097+0000 7f1fb1408640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fac155200 0x7f1fac158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:30.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.097+0000 7f1fb1408640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fac155200 0x7f1fac158d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44532/0 (socket says 172.21.15.5:44532) 2023-07-14T12:53:30.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.097+0000 7f1fb1408640 1 -- 172.21.15.5:0/3522214559 learned_addr learned my addr 172.21.15.5:0/3522214559 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:30.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.097+0000 7f1fb1c09640 1 --2- 172.21.15.5:0/3522214559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f98003b60 0x7f1fac09d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:30.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.097+0000 7f1fb240a640 1 --2- 172.21.15.5:0/3522214559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fac09aaf0 0x7f1fac09b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:30.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.097+0000 7f1fb1408640 1 -- 172.21.15.5:0/3522214559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f98003b60 msgr2=0x7f1fac09d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:30.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.097+0000 7f1fb1408640 1 --2- 172.21.15.5:0/3522214559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f98003b60 0x7f1fac09d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:30.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.097+0000 7f1fb1408640 1 -- 172.21.15.5:0/3522214559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fac09aaf0 msgr2=0x7f1fac09b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:30.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.097+0000 7f1fb1408640 1 --2- 172.21.15.5:0/3522214559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fac09aaf0 0x7f1fac09b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:30.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.097+0000 7f1fb1408640 1 -- 172.21.15.5:0/3522214559 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fac09a2f0 con 0x7f1fac155200 2023-07-14T12:53:30.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.097+0000 7f1fb240a640 1 --2- 172.21.15.5:0/3522214559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fac09aaf0 0x7f1fac09b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:30.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.097+0000 7f1fb1408640 1 --2- 172.21.15.5:0/3522214559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fac155200 0x7f1fac158d00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c011aa0 tx=0x7f1f9c011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:30.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.097+0000 7f1fa27fc640 1 -- 172.21.15.5:0/3522214559 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c00fb80 con 0x7f1fac155200 2023-07-14T12:53:30.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.097+0000 7f1fa27fc640 1 -- 172.21.15.5:0/3522214559 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9c00fce0 con 0x7f1fac155200 2023-07-14T12:53:30.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.097+0000 7f1fa27fc640 1 -- 172.21.15.5:0/3522214559 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c014680 con 0x7f1fac155200 2023-07-14T12:53:30.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.097+0000 7f1fb3e6d640 1 -- 172.21.15.5:0/3522214559 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fac09a5d0 con 0x7f1fac155200 2023-07-14T12:53:30.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.097+0000 7f1fb3e6d640 1 -- 172.21.15.5:0/3522214559 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fac155670 con 0x7f1fac155200 2023-07-14T12:53:30.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.101+0000 7f1fb3e6d640 1 -- 172.21.15.5:0/3522214559 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fac0678d0 con 0x7f1fac155200 2023-07-14T12:53:30.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.101+0000 7f1fa27fc640 1 -- 172.21.15.5:0/3522214559 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1f9c0147e0 con 0x7f1fac155200 2023-07-14T12:53:30.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.101+0000 7f1fa27fc640 1 --2- 172.21.15.5:0/3522214559 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f1f90066280 0x7f1f90068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:30.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.101+0000 7f1fa27fc640 1 -- 172.21.15.5:0/3522214559 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1f9c0846c0 con 0x7f1fac155200 2023-07-14T12:53:30.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.101+0000 7f1fb1c09640 1 --2- 172.21.15.5:0/3522214559 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f1f90066280 0x7f1f90068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:30.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.101+0000 7f1fb1c09640 1 --2- 172.21.15.5:0/3522214559 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f1f90066280 0x7f1f90068730 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1fa80ab000 tx=0x7f1fa80a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:30.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.105+0000 7f1fa27fc640 1 -- 172.21.15.5:0/3522214559 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f1f9c051af0 con 0x7f1fac155200 2023-07-14T12:53:30.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.293+0000 7f1fb3e6d640 1 -- 172.21.15.5:0/3522214559 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1fac159fd0 con 0x7f1fac155200 2023-07-14T12:53:30.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.293+0000 7f1fa27fc640 1 -- 172.21.15.5:0/3522214559 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4703 (secure 0 0 0) 0x7f1f9c055110 con 0x7f1fac155200 2023-07-14T12:53:30.322 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:30.322 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1953958881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1953958881},{"type":"v1","addr":"172.21.15.154:6837","nonce":1953958881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3138000501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3138000501},{"type":"v1","addr":"172.21.15.5:6834","nonce":3138000501}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1911549775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1911549775},{"type":"v1","addr":"172.21.15.5:6835","nonce":1911549775}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T12:52:46.473195+0000","modified":"2023-07-14T12:52:50.433872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6836/3154882793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3154882793},{"type":"v1","addr":"172.21.15.154:6836","nonce":3154882793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T12:53:30.323 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2023-07-14T12:53:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.297+0000 7f1fb3e6d640 1 -- 172.21.15.5:0/3522214559 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f1f90066280 msgr2=0x7f1f90068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.297+0000 7f1fb3e6d640 1 --2- 172.21.15.5:0/3522214559 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f1f90066280 0x7f1f90068730 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1fa80ab000 tx=0x7f1fa80a7070 comp rx=0 tx=0).stop 2023-07-14T12:53:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.297+0000 7f1fb3e6d640 1 -- 172.21.15.5:0/3522214559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fac155200 msgr2=0x7f1fac158d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.297+0000 7f1fb3e6d640 1 --2- 172.21.15.5:0/3522214559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fac155200 0x7f1fac158d00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c011aa0 tx=0x7f1f9c011f60 comp rx=0 tx=0).stop 2023-07-14T12:53:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.297+0000 7f1fb3e6d640 1 -- 172.21.15.5:0/3522214559 shutdown_connections 2023-07-14T12:53:30.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.297+0000 7f1fb3e6d640 1 --2- 172.21.15.5:0/3522214559 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f1f90066280 0x7f1f90068730 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:30.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.297+0000 7f1fb3e6d640 1 --2- 172.21.15.5:0/3522214559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fac09aaf0 0x7f1fac09b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:30.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.297+0000 7f1fb3e6d640 1 --2- 172.21.15.5:0/3522214559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fac155200 0x7f1fac158d00 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:30.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.297+0000 7f1fb3e6d640 1 --2- 172.21.15.5:0/3522214559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f98003b60 0x7f1fac09d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:30.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.297+0000 7f1fb3e6d640 1 -- 172.21.15.5:0/3522214559 >> 172.21.15.5:0/3522214559 conn(0x7f1fac099490 msgr2=0x7f1fac06d510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:30.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.297+0000 7f1fb3e6d640 1 -- 172.21.15.5:0/3522214559 shutdown_connections 2023-07-14T12:53:30.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.297+0000 7f1fb3e6d640 1 -- 172.21.15.5:0/3522214559 wait complete. 2023-07-14T12:53:30.343 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:53:30.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.461+0000 7f06c98de640 1 Processor -- start 2023-07-14T12:53:30.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.461+0000 7f06c98de640 1 -- start start 2023-07-14T12:53:30.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.461+0000 7f06c98de640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06c415f3f0 0x7f06c40b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:30.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.461+0000 7f06c98de640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c40b8020 con 0x7f06c40b7bc0 2023-07-14T12:53:30.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.461+0000 7f06c98de640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c40d0f60 con 0x7f06c40d13f0 2023-07-14T12:53:30.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.461+0000 7f06c98de640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c40d0390 con 0x7f06c415f3f0 2023-07-14T12:53:30.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.461+0000 7f06c88dc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06c415f3f0 0x7f06c40b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:30.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.461+0000 7f06c90dd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f06c40b7bc0 0x7f06c40b5010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60704/0 (socket says 172.21.15.5:60704) 2023-07-14T12:53:30.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.461+0000 7f06c90dd640 1 -- 172.21.15.5:0/2513982809 learned_addr learned my addr 172.21.15.5:0/2513982809 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:30.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.461+0000 7f06c88dc640 1 -- 172.21.15.5:0/2513982809 >> v1:172.21.15.154:6789/0 conn(0x7f06c40d13f0 legacy=0x7f06c40cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:30.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.461+0000 7f06c88dc640 1 -- 172.21.15.5:0/2513982809 >> v1:172.21.15.5:6789/0 conn(0x7f06c40b7bc0 legacy=0x7f06c40b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:30.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.461+0000 7f06c88dc640 1 -- 172.21.15.5:0/2513982809 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c40d0630 con 0x7f06c415f3f0 2023-07-14T12:53:30.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.461+0000 7f06c37fe640 1 -- 172.21.15.5:0/2513982809 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627869164 0 0) 0x7f06c40b8020 con 0x7f06c40b7bc0 2023-07-14T12:53:30.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.465+0000 7f06c88dc640 1 --2- 172.21.15.5:0/2513982809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06c415f3f0 0x7f06c40b7680 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f06b80097c0 tx=0x7f06b801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19aab856c7ae2a21 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:30.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.465+0000 7f06c37fe640 1 -- 172.21.15.5:0/2513982809 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b80ab600 con 0x7f06c415f3f0 2023-07-14T12:53:30.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.465+0000 7f06c37fe640 1 -- 172.21.15.5:0/2513982809 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b80a7050 con 0x7f06c415f3f0 2023-07-14T12:53:30.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.465+0000 7f06c37fe640 1 -- 172.21.15.5:0/2513982809 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b80ab980 con 0x7f06c415f3f0 2023-07-14T12:53:30.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.465+0000 7f06c98de640 1 -- 172.21.15.5:0/2513982809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06c415f3f0 msgr2=0x7f06c40b7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:30.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.465+0000 7f06c98de640 1 --2- 172.21.15.5:0/2513982809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06c415f3f0 0x7f06c40b7680 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f06b80097c0 tx=0x7f06b801c3f0 comp rx=0 tx=0).stop 2023-07-14T12:53:30.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.465+0000 7f06c98de640 1 -- 172.21.15.5:0/2513982809 shutdown_connections 2023-07-14T12:53:30.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.465+0000 7f06c98de640 1 --2- 172.21.15.5:0/2513982809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06c415f3f0 0x7f06c40b7680 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:30.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.465+0000 7f06c98de640 1 -- 172.21.15.5:0/2513982809 >> 172.21.15.5:0/2513982809 conn(0x7f06c4069f50 msgr2=0x7f06c406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:30.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.465+0000 7f06c98de640 1 -- 172.21.15.5:0/2513982809 shutdown_connections 2023-07-14T12:53:30.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.465+0000 7f06c98de640 1 -- 172.21.15.5:0/2513982809 wait complete. 2023-07-14T12:53:30.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.465+0000 7f06c98de640 1 Processor -- start 2023-07-14T12:53:30.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.469+0000 7f06c98de640 1 -- start start 2023-07-14T12:53:30.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.469+0000 7f06c98de640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06c40b7bc0 0x7f06c414d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:30.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.469+0000 7f06c98de640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06c40d13f0 0x7f06c41550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:30.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.469+0000 7f06c98de640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c415f3f0 0x7f06c40cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:30.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.469+0000 7f06c98de640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c414d9f0 con 0x7f06c40b7bc0 2023-07-14T12:53:30.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.469+0000 7f06c98de640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c4155b80 con 0x7f06c415f3f0 2023-07-14T12:53:30.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.469+0000 7f06c98de640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c4155e60 con 0x7f06c40d13f0 2023-07-14T12:53:30.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.469+0000 7f06c88dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06c40b7bc0 0x7f06c414d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:30.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.469+0000 7f06c88dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06c40b7bc0 0x7f06c414d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44550/0 (socket says 172.21.15.5:44550) 2023-07-14T12:53:30.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.469+0000 7f06c88dc640 1 -- 172.21.15.5:0/2882732887 learned_addr learned my addr 172.21.15.5:0/2882732887 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:30.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.469+0000 7f06c90dd640 1 --2- 172.21.15.5:0/2882732887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c415f3f0 0x7f06c40cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:30.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.469+0000 7f06c3fff640 1 --2- 172.21.15.5:0/2882732887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06c40d13f0 0x7f06c41550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:30.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.469+0000 7f06c88dc640 1 -- 172.21.15.5:0/2882732887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06c40d13f0 msgr2=0x7f06c41550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:30.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.469+0000 7f06c88dc640 1 --2- 172.21.15.5:0/2882732887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06c40d13f0 0x7f06c41550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:30.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.469+0000 7f06c88dc640 1 -- 172.21.15.5:0/2882732887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c415f3f0 msgr2=0x7f06c40cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:30.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.469+0000 7f06c88dc640 1 --2- 172.21.15.5:0/2882732887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c415f3f0 0x7f06c40cb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:30.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.469+0000 7f06c88dc640 1 -- 172.21.15.5:0/2882732887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b8009420 con 0x7f06c40b7bc0 2023-07-14T12:53:30.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.469+0000 7f06c88dc640 1 --2- 172.21.15.5:0/2882732887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06c40b7bc0 0x7f06c414d4b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f06b80ae040 tx=0x7f06b801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:30.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.469+0000 7f06c17fa640 1 -- 172.21.15.5:0/2882732887 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b80b7650 con 0x7f06c40b7bc0 2023-07-14T12:53:30.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.469+0000 7f06c17fa640 1 -- 172.21.15.5:0/2882732887 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b80b77d0 con 0x7f06c40b7bc0 2023-07-14T12:53:30.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.469+0000 7f06c98de640 1 -- 172.21.15.5:0/2882732887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c4156140 con 0x7f06c40b7bc0 2023-07-14T12:53:30.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.469+0000 7f06c17fa640 1 -- 172.21.15.5:0/2882732887 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b80b7b80 con 0x7f06c40b7bc0 2023-07-14T12:53:30.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.469+0000 7f06c98de640 1 -- 172.21.15.5:0/2882732887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c4156700 con 0x7f06c40b7bc0 2023-07-14T12:53:30.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.469+0000 7f06c98de640 1 -- 172.21.15.5:0/2882732887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c40678d0 con 0x7f06c40b7bc0 2023-07-14T12:53:30.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.473+0000 7f06c17fa640 1 -- 172.21.15.5:0/2882732887 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f06b80b7ce0 con 0x7f06c40b7bc0 2023-07-14T12:53:30.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.473+0000 7f06c17fa640 1 --2- 172.21.15.5:0/2882732887 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f06a8066280 0x7f06a8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:30.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.473+0000 7f06c17fa640 1 -- 172.21.15.5:0/2882732887 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f06b811e700 con 0x7f06c40b7bc0 2023-07-14T12:53:30.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.473+0000 7f06c3fff640 1 --2- 172.21.15.5:0/2882732887 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f06a8066280 0x7f06a8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:30.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.473+0000 7f06c3fff640 1 --2- 172.21.15.5:0/2882732887 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f06a8066280 0x7f06a8068730 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f06c40b2920 tx=0x7f06b0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:30.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.477+0000 7f06c17fa640 1 -- 172.21.15.5:0/2882732887 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f06b80ebaa0 con 0x7f06c40b7bc0 2023-07-14T12:53:30.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.669+0000 7f06c98de640 1 -- 172.21.15.5:0/2882732887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06c41568f0 con 0x7f06c40b7bc0 2023-07-14T12:53:30.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.669+0000 7f06c17fa640 1 -- 172.21.15.5:0/2882732887 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4703 (secure 0 0 0) 0x7f06b80ef0c0 con 0x7f06c40b7bc0 2023-07-14T12:53:30.698 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:30.699 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1953958881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1953958881},{"type":"v1","addr":"172.21.15.154:6837","nonce":1953958881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3138000501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3138000501},{"type":"v1","addr":"172.21.15.5:6834","nonce":3138000501}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1911549775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1911549775},{"type":"v1","addr":"172.21.15.5:6835","nonce":1911549775}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T12:52:46.473195+0000","modified":"2023-07-14T12:52:50.433872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6836/3154882793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3154882793},{"type":"v1","addr":"172.21.15.154:6836","nonce":3154882793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T12:53:30.699 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2023-07-14T12:53:30.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.673+0000 7f06c98de640 1 -- 172.21.15.5:0/2882732887 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f06a8066280 msgr2=0x7f06a8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:30.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.673+0000 7f06c98de640 1 --2- 172.21.15.5:0/2882732887 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f06a8066280 0x7f06a8068730 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f06c40b2920 tx=0x7f06b0009040 comp rx=0 tx=0).stop 2023-07-14T12:53:30.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.673+0000 7f06c98de640 1 -- 172.21.15.5:0/2882732887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06c40b7bc0 msgr2=0x7f06c414d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:30.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.673+0000 7f06c98de640 1 --2- 172.21.15.5:0/2882732887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06c40b7bc0 0x7f06c414d4b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f06b80ae040 tx=0x7f06b801ac30 comp rx=0 tx=0).stop 2023-07-14T12:53:30.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.673+0000 7f06c98de640 1 -- 172.21.15.5:0/2882732887 shutdown_connections 2023-07-14T12:53:30.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.673+0000 7f06c98de640 1 --2- 172.21.15.5:0/2882732887 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f06a8066280 0x7f06a8068730 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:30.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.673+0000 7f06c98de640 1 --2- 172.21.15.5:0/2882732887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c415f3f0 0x7f06c40cb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:30.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.673+0000 7f06c98de640 1 --2- 172.21.15.5:0/2882732887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06c40d13f0 0x7f06c41550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:30.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.673+0000 7f06c98de640 1 --2- 172.21.15.5:0/2882732887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06c40b7bc0 0x7f06c414d4b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:30.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.673+0000 7f06c98de640 1 -- 172.21.15.5:0/2882732887 >> 172.21.15.5:0/2882732887 conn(0x7f06c4069f50 msgr2=0x7f06c4156f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:30.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.673+0000 7f06c98de640 1 -- 172.21.15.5:0/2882732887 shutdown_connections 2023-07-14T12:53:30.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.673+0000 7f06c98de640 1 -- 172.21.15.5:0/2882732887 wait complete. 2023-07-14T12:53:30.720 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:53:30.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.837+0000 7f28724ca640 1 Processor -- start 2023-07-14T12:53:30.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.837+0000 7f28724ca640 1 -- start start 2023-07-14T12:53:30.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.837+0000 7f28724ca640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f286c158ce0 0x7f286c070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:30.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.837+0000 7f28724ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f286c0c8ad0 0x7f286c0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:30.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.837+0000 7f28724ca640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f286c0c9560 0x7f286c0cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:30.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.837+0000 7f28724ca640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f286c0c99e0 con 0x7f286c0c9560 2023-07-14T12:53:30.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.837+0000 7f28724ca640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f286c0cc700 con 0x7f286c158ce0 2023-07-14T12:53:30.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.837+0000 7f28724ca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286c0b0ff0 con 0x7f286c0c8ad0 2023-07-14T12:53:30.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.837+0000 7f2870a67640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f286c0c9560 0x7f286c0cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:30.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.837+0000 7f2870a67640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f286c0c9560 0x7f286c0cab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44562/0 (socket says 172.21.15.5:44562) 2023-07-14T12:53:30.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.837+0000 7f2870a67640 1 -- 172.21.15.5:0/305940831 learned_addr learned my addr 172.21.15.5:0/305940831 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:30.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.841+0000 7f286bfff640 1 --2- 172.21.15.5:0/305940831 >> v2:172.21.15.154:3300/0 conn(0x7f286c158ce0 0x7f286c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:30.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.841+0000 7f286b7fe640 1 --2- 172.21.15.5:0/305940831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f286c0c8ad0 0x7f286c0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:30.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.841+0000 7f2870a67640 1 -- 172.21.15.5:0/305940831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f286c0c8ad0 msgr2=0x7f286c0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:30.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.841+0000 7f2870a67640 1 --2- 172.21.15.5:0/305940831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f286c0c8ad0 0x7f286c0c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:30.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.841+0000 7f2870a67640 1 -- 172.21.15.5:0/305940831 >> v2:172.21.15.154:3300/0 conn(0x7f286c158ce0 msgr2=0x7f286c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:30.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.841+0000 7f2870a67640 1 --2- 172.21.15.5:0/305940831 >> v2:172.21.15.154:3300/0 conn(0x7f286c158ce0 0x7f286c070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:30.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.841+0000 7f2870a67640 1 -- 172.21.15.5:0/305940831 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c070c80 con 0x7f286c0c9560 2023-07-14T12:53:30.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.841+0000 7f2870a67640 1 --2- 172.21.15.5:0/305940831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f286c0c9560 0x7f286c0cab00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f286c071be0 tx=0x7f286401ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dde61dd6e5d02d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:30.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.841+0000 7f286affd640 1 -- 172.21.15.5:0/305940831 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28640a7830 con 0x7f286c0c9560 2023-07-14T12:53:30.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.841+0000 7f286affd640 1 -- 172.21.15.5:0/305940831 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28640a7990 con 0x7f286c0c9560 2023-07-14T12:53:30.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.841+0000 7f286affd640 1 -- 172.21.15.5:0/305940831 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28640a7d20 con 0x7f286c0c9560 2023-07-14T12:53:30.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.845+0000 7f28724ca640 1 -- 172.21.15.5:0/305940831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f286c0c9560 msgr2=0x7f286c0cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:30.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.845+0000 7f28724ca640 1 --2- 172.21.15.5:0/305940831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f286c0c9560 0x7f286c0cab00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f286c071be0 tx=0x7f286401ea90 comp rx=0 tx=0).stop 2023-07-14T12:53:30.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.845+0000 7f28724ca640 1 -- 172.21.15.5:0/305940831 shutdown_connections 2023-07-14T12:53:30.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.845+0000 7f28724ca640 1 --2- 172.21.15.5:0/305940831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f286c0c9560 0x7f286c0cab00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:30.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.845+0000 7f28724ca640 1 --2- 172.21.15.5:0/305940831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f286c0c8ad0 0x7f286c0c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:30.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.845+0000 7f28724ca640 1 --2- 172.21.15.5:0/305940831 >> v2:172.21.15.154:3300/0 conn(0x7f286c158ce0 0x7f286c070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:30.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.845+0000 7f28724ca640 1 -- 172.21.15.5:0/305940831 >> 172.21.15.5:0/305940831 conn(0x7f286c0afcf0 msgr2=0x7f286c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:30.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.845+0000 7f28724ca640 1 -- 172.21.15.5:0/305940831 shutdown_connections 2023-07-14T12:53:30.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.845+0000 7f28724ca640 1 -- 172.21.15.5:0/305940831 wait complete. 2023-07-14T12:53:30.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.845+0000 7f28724ca640 1 Processor -- start 2023-07-14T12:53:30.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.845+0000 7f28724ca640 1 -- start start 2023-07-14T12:53:30.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.845+0000 7f28724ca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f286c0c8ad0 0x7f286c0c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:30.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.845+0000 7f28724ca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f286c0c9560 0x7f286c0ade50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:30.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.845+0000 7f28724ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f286c158ce0 0x7f286c0c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:30.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.845+0000 7f28724ca640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286c151cd0 con 0x7f286c0c9560 2023-07-14T12:53:30.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.845+0000 7f28724ca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286c151fb0 con 0x7f286c0c8ad0 2023-07-14T12:53:30.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.845+0000 7f28724ca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286c152290 con 0x7f286c158ce0 2023-07-14T12:53:30.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.845+0000 7f286bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f286c0c8ad0 0x7f286c0c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:30.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.845+0000 7f286bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f286c0c8ad0 0x7f286c0c60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:44080/0 (socket says 172.21.15.5:44080) 2023-07-14T12:53:30.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.845+0000 7f286b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f286c0c9560 0x7f286c0ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:30.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.845+0000 7f286bfff640 1 -- 172.21.15.5:0/1388862022 learned_addr learned my addr 172.21.15.5:0/1388862022 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:30.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.845+0000 7f2870a67640 1 --2- 172.21.15.5:0/1388862022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f286c158ce0 0x7f286c0c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:30.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.849+0000 7f286b7fe640 1 -- 172.21.15.5:0/1388862022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f286c158ce0 msgr2=0x7f286c0c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:30.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.849+0000 7f286b7fe640 1 --2- 172.21.15.5:0/1388862022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f286c158ce0 0x7f286c0c1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:30.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.849+0000 7f286b7fe640 1 -- 172.21.15.5:0/1388862022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f286c0c8ad0 msgr2=0x7f286c0c60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:30.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.849+0000 7f286b7fe640 1 --2- 172.21.15.5:0/1388862022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f286c0c8ad0 0x7f286c0c60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:30.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.849+0000 7f286b7fe640 1 -- 172.21.15.5:0/1388862022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2864009b30 con 0x7f286c0c9560 2023-07-14T12:53:30.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.849+0000 7f286b7fe640 1 --2- 172.21.15.5:0/1388862022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f286c0c9560 0x7f286c0ade50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f286000d5d0 tx=0x7f286000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:30.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.849+0000 7f2868ff9640 1 -- 172.21.15.5:0/1388862022 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28600125f0 con 0x7f286c0c9560 2023-07-14T12:53:30.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.849+0000 7f2868ff9640 1 -- 172.21.15.5:0/1388862022 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2860012750 con 0x7f286c0c9560 2023-07-14T12:53:30.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.849+0000 7f28724ca640 1 -- 172.21.15.5:0/1388862022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f286c152570 con 0x7f286c0c9560 2023-07-14T12:53:30.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.849+0000 7f2868ff9640 1 -- 172.21.15.5:0/1388862022 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860012ae0 con 0x7f286c0c9560 2023-07-14T12:53:30.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.849+0000 7f28724ca640 1 -- 172.21.15.5:0/1388862022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f286c0c6620 con 0x7f286c0c9560 2023-07-14T12:53:30.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.849+0000 7f28724ca640 1 -- 172.21.15.5:0/1388862022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f286c0ca1a0 con 0x7f286c0c9560 2023-07-14T12:53:30.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.849+0000 7f2868ff9640 1 -- 172.21.15.5:0/1388862022 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2860012c40 con 0x7f286c0c9560 2023-07-14T12:53:30.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.849+0000 7f2868ff9640 1 --2- 172.21.15.5:0/1388862022 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f28580662b0 0x7f2858068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:30.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.849+0000 7f2868ff9640 1 -- 172.21.15.5:0/1388862022 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f28600840a0 con 0x7f286c0c9560 2023-07-14T12:53:30.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.849+0000 7f286bfff640 1 --2- 172.21.15.5:0/1388862022 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f28580662b0 0x7f2858068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:30.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.853+0000 7f286bfff640 1 --2- 172.21.15.5:0/1388862022 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f28580662b0 0x7f2858068760 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f285c0079f0 tx=0x7f285c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:30.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:30.853+0000 7f2868ff9640 1 -- 172.21.15.5:0/1388862022 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2860051500 con 0x7f286c0c9560 2023-07-14T12:53:31.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.009+0000 7f28724ca640 1 -- 172.21.15.5:0/1388862022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f286c0678d0 con 0x7f286c0c9560 2023-07-14T12:53:31.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.013+0000 7f2868ff9640 1 -- 172.21.15.5:0/1388862022 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18326 (secure 0 0 0) 0x7f2860054b20 con 0x7f286c0c9560 2023-07-14T12:53:31.039 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:31.039 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:53:27.546504+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:52:44.223082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-14T12:52:45.469396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:53:31.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.013+0000 7f28724ca640 1 -- 172.21.15.5:0/1388862022 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f28580662b0 msgr2=0x7f2858068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:31.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.013+0000 7f28724ca640 1 --2- 172.21.15.5:0/1388862022 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f28580662b0 0x7f2858068760 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f285c0079f0 tx=0x7f285c008040 comp rx=0 tx=0).stop 2023-07-14T12:53:31.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.013+0000 7f28724ca640 1 -- 172.21.15.5:0/1388862022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f286c0c9560 msgr2=0x7f286c0ade50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:31.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.013+0000 7f28724ca640 1 --2- 172.21.15.5:0/1388862022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f286c0c9560 0x7f286c0ade50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f286000d5d0 tx=0x7f286000da90 comp rx=0 tx=0).stop 2023-07-14T12:53:31.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.013+0000 7f28724ca640 1 -- 172.21.15.5:0/1388862022 shutdown_connections 2023-07-14T12:53:31.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.013+0000 7f28724ca640 1 --2- 172.21.15.5:0/1388862022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f286c158ce0 0x7f286c0c1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:31.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.013+0000 7f28724ca640 1 --2- 172.21.15.5:0/1388862022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f286c0c9560 0x7f286c0ade50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:31.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.013+0000 7f28724ca640 1 --2- 172.21.15.5:0/1388862022 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f28580662b0 0x7f2858068760 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:31.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.013+0000 7f28724ca640 1 --2- 172.21.15.5:0/1388862022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f286c0c8ad0 0x7f286c0c60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:31.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.013+0000 7f28724ca640 1 -- 172.21.15.5:0/1388862022 >> 172.21.15.5:0/1388862022 conn(0x7f286c0afcf0 msgr2=0x7f286c070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:31.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.013+0000 7f28724ca640 1 -- 172.21.15.5:0/1388862022 shutdown_connections 2023-07-14T12:53:31.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.013+0000 7f28724ca640 1 -- 172.21.15.5:0/1388862022 wait complete. 2023-07-14T12:53:31.060 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-14T12:53:31.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.177+0000 7fe449737640 1 Processor -- start 2023-07-14T12:53:31.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.177+0000 7fe449737640 1 -- start start 2023-07-14T12:53:31.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.177+0000 7fe449737640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe4440c8ad0 0x7fe4440c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:31.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.177+0000 7fe449737640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4440c99c0 con 0x7fe4440c9560 2023-07-14T12:53:31.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.177+0000 7fe449737640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4440cc700 con 0x7fe444158ce0 2023-07-14T12:53:31.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.177+0000 7fe449737640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4440b0ff0 con 0x7fe4440c8ad0 2023-07-14T12:53:31.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.177+0000 7fe4437fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe4440c9560 0x7fe4440ccb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60716/0 (socket says 172.21.15.5:60716) 2023-07-14T12:53:31.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.177+0000 7fe4437fe640 1 -- 172.21.15.5:0/4054836026 learned_addr learned my addr 172.21.15.5:0/4054836026 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:31.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.181+0000 7fe43bfff640 1 --2- 172.21.15.5:0/4054836026 >> v2:172.21.15.154:3300/0 conn(0x7fe4440c8ad0 0x7fe4440c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:31.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.181+0000 7fe4427fc640 1 -- 172.21.15.5:0/4054836026 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427711129 0 0) 0x7fe4440c99c0 con 0x7fe4440c9560 2023-07-14T12:53:31.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.181+0000 7fe4427fc640 1 -- 172.21.15.5:0/4054836026 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe430003530 con 0x7fe4440c9560 2023-07-14T12:53:31.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.181+0000 7fe4427fc640 1 -- 172.21.15.5:0/4054836026 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3961530367 0 0) 0x7fe430003530 con 0x7fe4440c9560 2023-07-14T12:53:31.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.181+0000 7fe4427fc640 1 -- 172.21.15.5:0/4054836026 >> v2:172.21.15.154:3300/0 conn(0x7fe4440c8ad0 msgr2=0x7fe4440c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.181+0000 7fe4427fc640 1 --2- 172.21.15.5:0/4054836026 >> v2:172.21.15.154:3300/0 conn(0x7fe4440c8ad0 0x7fe4440c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.181+0000 7fe4427fc640 1 -- 172.21.15.5:0/4054836026 >> v1:172.21.15.154:6789/0 conn(0x7fe444158ce0 legacy=0x7fe444070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.181+0000 7fe4427fc640 1 -- 172.21.15.5:0/4054836026 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe444070c80 con 0x7fe4440c9560 2023-07-14T12:53:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.181+0000 7fe4427fc640 1 -- 172.21.15.5:0/4054836026 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7fe43c001a00 con 0x7fe4440c9560 2023-07-14T12:53:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.181+0000 7fe4427fc640 1 -- 172.21.15.5:0/4054836026 >> v1:172.21.15.5:6789/0 conn(0x7fe4440c9560 legacy=0x7fe4440ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.181+0000 7fe4427fc640 1 --2- 172.21.15.5:0/4054836026 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe430003980 0x7fe430003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.181+0000 7fe4427fc640 1 --2- 172.21.15.5:0/4054836026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4300047d0 0x7fe430004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.181+0000 7fe4427fc640 1 --2- 172.21.15.5:0/4054836026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe430005180 0x7fe43000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.181+0000 7fe4427fc640 1 -- 172.21.15.5:0/4054836026 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4440b0ff0 con 0x7fe4300047d0 2023-07-14T12:53:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.181+0000 7fe4427fc640 1 -- 172.21.15.5:0/4054836026 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43000c110 con 0x7fe430005180 2023-07-14T12:53:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.181+0000 7fe4427fc640 1 -- 172.21.15.5:0/4054836026 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43000c2d0 con 0x7fe430003980 2023-07-14T12:53:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.181+0000 7fe43bfff640 1 --2- 172.21.15.5:0/4054836026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4300047d0 0x7fe430004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.181+0000 7fe442ffd640 1 --2- 172.21.15.5:0/4054836026 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe430003980 0x7fe430003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:31.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.181+0000 7fe4437fe640 1 --2- 172.21.15.5:0/4054836026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe430005180 0x7fe43000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:31.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.181+0000 7fe43bfff640 1 -- 172.21.15.5:0/4054836026 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe430003980 msgr2=0x7fe430003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:31.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.181+0000 7fe43bfff640 1 --2- 172.21.15.5:0/4054836026 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe430003980 0x7fe430003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:31.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.181+0000 7fe43bfff640 1 -- 172.21.15.5:0/4054836026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe430005180 msgr2=0x7fe43000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:31.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.181+0000 7fe43bfff640 1 --2- 172.21.15.5:0/4054836026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe430005180 0x7fe43000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:31.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.181+0000 7fe43bfff640 1 -- 172.21.15.5:0/4054836026 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe430003530 con 0x7fe4300047d0 2023-07-14T12:53:31.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.181+0000 7fe4437fe640 1 -- 172.21.15.5:0/4054836026 reap_dead start 2023-07-14T12:53:31.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.185+0000 7fe43bfff640 1 --2- 172.21.15.5:0/4054836026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4300047d0 0x7fe430004c40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe42c009670 tx=0x7fe42c01ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ed90247f701528 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:31.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.185+0000 7fe4427fc640 1 -- 172.21.15.5:0/4054836026 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c0a7700 con 0x7fe4300047d0 2023-07-14T12:53:31.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.185+0000 7fe4427fc640 1 -- 172.21.15.5:0/4054836026 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42c0a7860 con 0x7fe4300047d0 2023-07-14T12:53:31.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.185+0000 7fe4427fc640 1 -- 172.21.15.5:0/4054836026 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c0a7c10 con 0x7fe4300047d0 2023-07-14T12:53:31.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.185+0000 7fe449737640 1 -- 172.21.15.5:0/4054836026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4300047d0 msgr2=0x7fe430004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:31.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.185+0000 7fe449737640 1 --2- 172.21.15.5:0/4054836026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4300047d0 0x7fe430004c40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe42c009670 tx=0x7fe42c01ec10 comp rx=0 tx=0).stop 2023-07-14T12:53:31.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.185+0000 7fe449737640 1 -- 172.21.15.5:0/4054836026 shutdown_connections 2023-07-14T12:53:31.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.185+0000 7fe449737640 1 --2- 172.21.15.5:0/4054836026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4300047d0 0x7fe430004c40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:31.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.185+0000 7fe449737640 1 -- 172.21.15.5:0/4054836026 >> 172.21.15.5:0/4054836026 conn(0x7fe4440afcf0 msgr2=0x7fe4440b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:31.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.185+0000 7fe449737640 1 -- 172.21.15.5:0/4054836026 shutdown_connections 2023-07-14T12:53:31.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.185+0000 7fe449737640 1 -- 172.21.15.5:0/4054836026 wait complete. 2023-07-14T12:53:31.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.185+0000 7fe449737640 1 Processor -- start 2023-07-14T12:53:31.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.185+0000 7fe449737640 1 -- start start 2023-07-14T12:53:31.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.189+0000 7fe449737640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4300047d0 0x7fe444145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:31.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.189+0000 7fe449737640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe44415b830 0x7fe444146850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:31.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.189+0000 7fe449737640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe44415bca0 0x7fe444146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:31.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.189+0000 7fe449737640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4440ab8a0 con 0x7fe44415b830 2023-07-14T12:53:31.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.189+0000 7fe449737640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4440abb80 con 0x7fe4300047d0 2023-07-14T12:53:31.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.189+0000 7fe449737640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4440abe60 con 0x7fe44415bca0 2023-07-14T12:53:31.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.189+0000 7fe43bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe44415b830 0x7fe444146850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:31.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.189+0000 7fe43bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe44415b830 0x7fe444146850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44596/0 (socket says 172.21.15.5:44596) 2023-07-14T12:53:31.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.189+0000 7fe43bfff640 1 -- 172.21.15.5:0/3306433970 learned_addr learned my addr 172.21.15.5:0/3306433970 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:31.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.189+0000 7fe442ffd640 1 --2- 172.21.15.5:0/3306433970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4300047d0 0x7fe444145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:31.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.189+0000 7fe43bfff640 1 -- 172.21.15.5:0/3306433970 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe44415bca0 msgr2=0x7fe444146d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:31.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.189+0000 7fe43bfff640 1 --2- 172.21.15.5:0/3306433970 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe44415bca0 0x7fe444146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:31.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.189+0000 7fe43bfff640 1 -- 172.21.15.5:0/3306433970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4300047d0 msgr2=0x7fe444145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:31.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.189+0000 7fe43bfff640 1 --2- 172.21.15.5:0/3306433970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4300047d0 0x7fe444145ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:31.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.189+0000 7fe43bfff640 1 -- 172.21.15.5:0/3306433970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4440ac140 con 0x7fe44415b830 2023-07-14T12:53:31.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.189+0000 7fe442ffd640 1 --2- 172.21.15.5:0/3306433970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4300047d0 0x7fe444145ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:31.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.189+0000 7fe43bfff640 1 --2- 172.21.15.5:0/3306433970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe44415b830 0x7fe444146850 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0b2040 tx=0x7fe4440cbb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:31.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.189+0000 7fe43b7fe640 1 -- 172.21.15.5:0/3306433970 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c0a7c90 con 0x7fe44415b830 2023-07-14T12:53:31.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.189+0000 7fe43b7fe640 1 -- 172.21.15.5:0/3306433970 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42c0a7df0 con 0x7fe44415b830 2023-07-14T12:53:31.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.189+0000 7fe43b7fe640 1 -- 172.21.15.5:0/3306433970 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c004240 con 0x7fe44415b830 2023-07-14T12:53:31.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.189+0000 7fe449737640 1 -- 172.21.15.5:0/3306433970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4440ac420 con 0x7fe44415b830 2023-07-14T12:53:31.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.189+0000 7fe449737640 1 -- 172.21.15.5:0/3306433970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4440c7f20 con 0x7fe44415b830 2023-07-14T12:53:31.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.189+0000 7fe449737640 1 -- 172.21.15.5:0/3306433970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4440ac5e0 con 0x7fe44415b830 2023-07-14T12:53:31.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.189+0000 7fe43b7fe640 1 -- 172.21.15.5:0/3306433970 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe42c0043a0 con 0x7fe44415b830 2023-07-14T12:53:31.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.193+0000 7fe43b7fe640 1 --2- 172.21.15.5:0/3306433970 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe4240662b0 0x7fe424068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:31.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.193+0000 7fe43b7fe640 1 -- 172.21.15.5:0/3306433970 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe42c11d330 con 0x7fe44415b830 2023-07-14T12:53:31.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.193+0000 7fe442ffd640 1 --2- 172.21.15.5:0/3306433970 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe4240662b0 0x7fe424068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:31.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.193+0000 7fe442ffd640 1 --2- 172.21.15.5:0/3306433970 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe4240662b0 0x7fe424068760 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe434007fd0 tx=0x7fe434009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:31.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.197+0000 7fe43b7fe640 1 -- 172.21.15.5:0/3306433970 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe42c0ea6d0 con 0x7fe44415b830 2023-07-14T12:53:31.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.385+0000 7fe449737640 1 -- 172.21.15.5:0/3306433970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe4440678d0 con 0x7fe44415b830 2023-07-14T12:53:31.412 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-07-14T12:53:31.385+0000 7f17b1648640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-14T12:53:31.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.389+0000 7fe43b7fe640 1 -- 172.21.15.5:0/3306433970 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe42c0edcf0 con 0x7fe44415b830 2023-07-14T12:53:31.418 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-14T12:53:31.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.393+0000 7fe449737640 1 -- 172.21.15.5:0/3306433970 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe4240662b0 msgr2=0x7fe424068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:31.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.393+0000 7fe449737640 1 --2- 172.21.15.5:0/3306433970 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe4240662b0 0x7fe424068760 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe434007fd0 tx=0x7fe434009040 comp rx=0 tx=0).stop 2023-07-14T12:53:31.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.393+0000 7fe449737640 1 -- 172.21.15.5:0/3306433970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe44415b830 msgr2=0x7fe444146850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:31.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.393+0000 7fe449737640 1 --2- 172.21.15.5:0/3306433970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe44415b830 0x7fe444146850 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0b2040 tx=0x7fe4440cbb10 comp rx=0 tx=0).stop 2023-07-14T12:53:31.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.393+0000 7fe449737640 1 -- 172.21.15.5:0/3306433970 shutdown_connections 2023-07-14T12:53:31.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.393+0000 7fe449737640 1 --2- 172.21.15.5:0/3306433970 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe44415bca0 0x7fe444146d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:31.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.393+0000 7fe449737640 1 --2- 172.21.15.5:0/3306433970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe44415b830 0x7fe444146850 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:31.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.393+0000 7fe449737640 1 --2- 172.21.15.5:0/3306433970 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe4240662b0 0x7fe424068760 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:31.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.393+0000 7fe449737640 1 --2- 172.21.15.5:0/3306433970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4300047d0 0x7fe444145ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:31.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.393+0000 7fe449737640 1 -- 172.21.15.5:0/3306433970 >> 172.21.15.5:0/3306433970 conn(0x7fe4440afcf0 msgr2=0x7fe4440cb310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:31.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.393+0000 7fe449737640 1 -- 172.21.15.5:0/3306433970 shutdown_connections 2023-07-14T12:53:31.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.393+0000 7fe449737640 1 -- 172.21.15.5:0/3306433970 wait complete. 2023-07-14T12:53:31.431 INFO:tasks.ceph.mds.d.smithi154.stderr: -6767> 2023-07-14T12:52:52.191+0000 7f767d59b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T12:53:31.439 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-14T12:53:31.483 INFO:tasks.ceph.mds.d.smithi154.stdout:starting mds.d at 2023-07-14T12:53:31.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.557+0000 7fb195276640 1 Processor -- start 2023-07-14T12:53:31.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.557+0000 7fb195276640 1 -- start start 2023-07-14T12:53:31.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.557+0000 7fb195276640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb1900af8b0 0x7fb1900afc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:31.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.557+0000 7fb195276640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb1900c8db0 0x7fb1900c9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:31.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.557+0000 7fb195276640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1900703a0 con 0x7fb19015c2a0 2023-07-14T12:53:31.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.557+0000 7fb195276640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19015ce20 con 0x7fb1900c8db0 2023-07-14T12:53:31.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.557+0000 7fb195276640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1900b01c0 con 0x7fb1900af8b0 2023-07-14T12:53:31.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.557+0000 7fb18f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb19015c2a0 0x7fb19015c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60724/0 (socket says 172.21.15.5:60724) 2023-07-14T12:53:31.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.557+0000 7fb194a75640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb1900c8db0 0x7fb1900c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:31.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.557+0000 7fb18f7fe640 1 -- 172.21.15.5:0/2094215922 learned_addr learned my addr 172.21.15.5:0/2094215922 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:31.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.557+0000 7fb18ffff640 1 --2- 172.21.15.5:0/2094215922 >> v2:172.21.15.154:3300/0 conn(0x7fb1900af8b0 0x7fb1900afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:31.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.561+0000 7fb194a75640 1 -- 172.21.15.5:0/2094215922 >> v2:172.21.15.154:3300/0 conn(0x7fb1900af8b0 msgr2=0x7fb1900afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:31.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.561+0000 7fb194a75640 1 --2- 172.21.15.5:0/2094215922 >> v2:172.21.15.154:3300/0 conn(0x7fb1900af8b0 0x7fb1900afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:31.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.561+0000 7fb194a75640 1 -- 172.21.15.5:0/2094215922 >> v1:172.21.15.5:6789/0 conn(0x7fb19015c2a0 legacy=0x7fb19015c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:31.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.561+0000 7fb194a75640 1 -- 172.21.15.5:0/2094215922 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19015d010 con 0x7fb1900c8db0 2023-07-14T12:53:31.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.561+0000 7fb18effd640 1 -- 172.21.15.5:0/2094215922 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127644381 0 0) 0x7fb184001120 con 0x7fb19015c2a0 2023-07-14T12:53:31.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.561+0000 7fb194a75640 1 --2- 172.21.15.5:0/2094215922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1900c8db0 0x7fb1900c9230 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb1900cb980 tx=0x7fb18801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f927060afd6331e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:31.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.561+0000 7fb18effd640 1 -- 172.21.15.5:0/2094215922 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1880a7e00 con 0x7fb1900c8db0 2023-07-14T12:53:31.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.561+0000 7fb18effd640 1 -- 172.21.15.5:0/2094215922 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1880af440 con 0x7fb1900c8db0 2023-07-14T12:53:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.561+0000 7fb18effd640 1 -- 172.21.15.5:0/2094215922 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1880af7d0 con 0x7fb1900c8db0 2023-07-14T12:53:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.561+0000 7fb195276640 1 -- 172.21.15.5:0/2094215922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1900c8db0 msgr2=0x7fb1900c9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:31.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.561+0000 7fb195276640 1 --2- 172.21.15.5:0/2094215922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1900c8db0 0x7fb1900c9230 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb1900cb980 tx=0x7fb18801ed10 comp rx=0 tx=0).stop 2023-07-14T12:53:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.565+0000 7fb195276640 1 -- 172.21.15.5:0/2094215922 shutdown_connections 2023-07-14T12:53:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.565+0000 7fb195276640 1 --2- 172.21.15.5:0/2094215922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1900c8db0 0x7fb1900c9230 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.565+0000 7fb195276640 1 --2- 172.21.15.5:0/2094215922 >> v2:172.21.15.154:3300/0 conn(0x7fb1900af8b0 0x7fb1900afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.565+0000 7fb195276640 1 -- 172.21.15.5:0/2094215922 >> 172.21.15.5:0/2094215922 conn(0x7fb1900ca8b0 msgr2=0x7fb1900cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.565+0000 7fb195276640 1 -- 172.21.15.5:0/2094215922 shutdown_connections 2023-07-14T12:53:31.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.565+0000 7fb195276640 1 -- 172.21.15.5:0/2094215922 wait complete. 2023-07-14T12:53:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.565+0000 7fb195276640 1 Processor -- start 2023-07-14T12:53:31.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.565+0000 7fb195276640 1 -- start start 2023-07-14T12:53:31.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.565+0000 7fb195276640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1900af8b0 0x7fb190147bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:31.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.565+0000 7fb195276640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1900c8db0 0x7fb1900c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:31.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.565+0000 7fb195276640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb19015c2a0 0x7fb19015acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:31.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.565+0000 7fb195276640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1900b3a10 con 0x7fb19015c2a0 2023-07-14T12:53:31.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.565+0000 7fb195276640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1900b2e00 con 0x7fb1900af8b0 2023-07-14T12:53:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.565+0000 7fb195276640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1900b30e0 con 0x7fb1900c8db0 2023-07-14T12:53:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.565+0000 7fb194a75640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb19015c2a0 0x7fb19015acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.565+0000 7fb194a75640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb19015c2a0 0x7fb19015acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44624/0 (socket says 172.21.15.5:44624) 2023-07-14T12:53:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.565+0000 7fb194a75640 1 -- 172.21.15.5:0/2479696670 learned_addr learned my addr 172.21.15.5:0/2479696670 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.565+0000 7fb18ffff640 1 --2- 172.21.15.5:0/2479696670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1900af8b0 0x7fb190147bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:31.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.565+0000 7fb18f7fe640 1 --2- 172.21.15.5:0/2479696670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1900c8db0 0x7fb1900c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:31.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.565+0000 7fb194a75640 1 -- 172.21.15.5:0/2479696670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1900c8db0 msgr2=0x7fb1900c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:31.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.565+0000 7fb194a75640 1 --2- 172.21.15.5:0/2479696670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1900c8db0 0x7fb1900c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:31.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.565+0000 7fb194a75640 1 -- 172.21.15.5:0/2479696670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1900af8b0 msgr2=0x7fb190147bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:31.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.565+0000 7fb194a75640 1 --2- 172.21.15.5:0/2479696670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1900af8b0 0x7fb190147bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:31.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.565+0000 7fb194a75640 1 -- 172.21.15.5:0/2479696670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb188009a70 con 0x7fb19015c2a0 2023-07-14T12:53:31.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.569+0000 7fb194a75640 1 --2- 172.21.15.5:0/2479696670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb19015c2a0 0x7fb19015acc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb18801b980 tx=0x7fb18801bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:31.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.569+0000 7fb18cff9640 1 -- 172.21.15.5:0/2479696670 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb188003ba0 con 0x7fb19015c2a0 2023-07-14T12:53:31.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.569+0000 7fb195276640 1 -- 172.21.15.5:0/2479696670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1900b33c0 con 0x7fb19015c2a0 2023-07-14T12:53:31.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.569+0000 7fb195276640 1 -- 172.21.15.5:0/2479696670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb190148100 con 0x7fb19015c2a0 2023-07-14T12:53:31.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.569+0000 7fb18cff9640 1 -- 172.21.15.5:0/2479696670 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb188009450 con 0x7fb19015c2a0 2023-07-14T12:53:31.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.569+0000 7fb18cff9640 1 -- 172.21.15.5:0/2479696670 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb188004030 con 0x7fb19015c2a0 2023-07-14T12:53:31.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.569+0000 7fb195276640 1 -- 172.21.15.5:0/2479696670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1900b3bc0 con 0x7fb19015c2a0 2023-07-14T12:53:31.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.569+0000 7fb18cff9640 1 -- 172.21.15.5:0/2479696670 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb1880b6050 con 0x7fb19015c2a0 2023-07-14T12:53:31.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.573+0000 7fb18cff9640 1 --2- 172.21.15.5:0/2479696670 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb17c066280 0x7fb17c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:31.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.573+0000 7fb18cff9640 1 -- 172.21.15.5:0/2479696670 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fb188120ac0 con 0x7fb19015c2a0 2023-07-14T12:53:31.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.573+0000 7fb18ffff640 1 --2- 172.21.15.5:0/2479696670 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb17c066280 0x7fb17c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:31.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.573+0000 7fb18ffff640 1 --2- 172.21.15.5:0/2479696670 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb17c066280 0x7fb17c068730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb180009ac0 tx=0x7fb180009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:31.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.577+0000 7fb18cff9640 1 -- 172.21.15.5:0/2479696670 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb1900b3bc0 con 0x7fb19015c2a0 2023-07-14T12:53:31.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:31.765+0000 7fb195276640 1 -- 172.21.15.5:0/2479696670 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb1900b3bc0 con 0x7fb19015c2a0 2023-07-14T12:53:32.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.393+0000 7fb18cff9640 1 -- 172.21.15.5:0/2479696670 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb1900b3bc0 con 0x7fb19015c2a0 2023-07-14T12:53:32.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.393+0000 7fb195276640 1 -- 172.21.15.5:0/2479696670 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb17c066280 msgr2=0x7fb17c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:32.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.393+0000 7fb195276640 1 --2- 172.21.15.5:0/2479696670 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb17c066280 0x7fb17c068730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb180009ac0 tx=0x7fb180009190 comp rx=0 tx=0).stop 2023-07-14T12:53:32.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.393+0000 7fb195276640 1 -- 172.21.15.5:0/2479696670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb19015c2a0 msgr2=0x7fb19015acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:32.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.393+0000 7fb195276640 1 --2- 172.21.15.5:0/2479696670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb19015c2a0 0x7fb19015acc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb18801b980 tx=0x7fb18801bb10 comp rx=0 tx=0).stop 2023-07-14T12:53:32.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.393+0000 7fb195276640 1 -- 172.21.15.5:0/2479696670 shutdown_connections 2023-07-14T12:53:32.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.393+0000 7fb195276640 1 --2- 172.21.15.5:0/2479696670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb19015c2a0 0x7fb19015acc0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:32.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.393+0000 7fb195276640 1 --2- 172.21.15.5:0/2479696670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1900c8db0 0x7fb1900c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:32.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.393+0000 7fb195276640 1 --2- 172.21.15.5:0/2479696670 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fb17c066280 0x7fb17c068730 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:32.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.393+0000 7fb195276640 1 --2- 172.21.15.5:0/2479696670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1900af8b0 0x7fb190147bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:32.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.393+0000 7fb195276640 1 -- 172.21.15.5:0/2479696670 >> 172.21.15.5:0/2479696670 conn(0x7fb1900ca8b0 msgr2=0x7fb1900cac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:32.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.393+0000 7fb195276640 1 -- 172.21.15.5:0/2479696670 shutdown_connections 2023-07-14T12:53:32.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.393+0000 7fb195276640 1 -- 172.21.15.5:0/2479696670 wait complete. 2023-07-14T12:53:32.446 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-14T12:53:32.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.573+0000 7fd8c1e96640 1 Processor -- start 2023-07-14T12:53:32.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.573+0000 7fd8c1e96640 1 -- start start 2023-07-14T12:53:32.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.573+0000 7fd8c1e96640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd8bc0d29d0 0x7fd8bc0b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:32.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.573+0000 7fd8c1e96640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd8bc0d0230 0x7fd8bc0b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:32.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.573+0000 7fd8c1e96640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8bc0b0230 con 0x7fd8bc15f320 2023-07-14T12:53:32.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.573+0000 7fd8c1e96640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8bc0d0a60 con 0x7fd8bc0d0230 2023-07-14T12:53:32.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.573+0000 7fd8c1e96640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8bc0af9d0 con 0x7fd8bc0d29d0 2023-07-14T12:53:32.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.573+0000 7fd8bbfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd8bc0d0230 0x7fd8bc0b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:32.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.573+0000 7fd8bbfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd8bc0d0230 0x7fd8bc0b0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44638/0 (socket says 172.21.15.5:44638) 2023-07-14T12:53:32.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.573+0000 7fd8bbfff640 1 -- 172.21.15.5:0/4024426 learned_addr learned my addr 172.21.15.5:0/4024426 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:32.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.573+0000 7fd8baffd640 1 --2- 172.21.15.5:0/4024426 >> v2:172.21.15.154:3300/0 conn(0x7fd8bc0d29d0 0x7fd8bc0b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:32.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.573+0000 7fd8bbfff640 1 -- 172.21.15.5:0/4024426 >> v2:172.21.15.154:3300/0 conn(0x7fd8bc0d29d0 msgr2=0x7fd8bc0b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:32.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.573+0000 7fd8bbfff640 1 --2- 172.21.15.5:0/4024426 >> v2:172.21.15.154:3300/0 conn(0x7fd8bc0d29d0 0x7fd8bc0b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:32.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.573+0000 7fd8bbfff640 1 -- 172.21.15.5:0/4024426 >> v1:172.21.15.154:6789/0 conn(0x7fd8bc15f320 legacy=0x7fd8bc0d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:32.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.573+0000 7fd8bbfff640 1 -- 172.21.15.5:0/4024426 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8bc0d0780 con 0x7fd8bc0d0230 2023-07-14T12:53:32.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.577+0000 7fd8bbfff640 1 --2- 172.21.15.5:0/4024426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8bc0d0230 0x7fd8bc0b0c00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc0cfd70 tx=0x7fd8b401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd1eb5196196a4e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:32.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.577+0000 7fd8ba7fc640 1 -- 172.21.15.5:0/4024426 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b40a5780 con 0x7fd8bc0d0230 2023-07-14T12:53:32.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.577+0000 7fd8ba7fc640 1 -- 172.21.15.5:0/4024426 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b40a58e0 con 0x7fd8bc0d0230 2023-07-14T12:53:32.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.577+0000 7fd8ba7fc640 1 -- 172.21.15.5:0/4024426 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b40a5c70 con 0x7fd8bc0d0230 2023-07-14T12:53:32.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.577+0000 7fd8c1e96640 1 -- 172.21.15.5:0/4024426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8bc0d0230 msgr2=0x7fd8bc0b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:32.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.577+0000 7fd8c1e96640 1 --2- 172.21.15.5:0/4024426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8bc0d0230 0x7fd8bc0b0c00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc0cfd70 tx=0x7fd8b401c9d0 comp rx=0 tx=0).stop 2023-07-14T12:53:32.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.577+0000 7fd8c1e96640 1 -- 172.21.15.5:0/4024426 shutdown_connections 2023-07-14T12:53:32.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.577+0000 7fd8c1e96640 1 --2- 172.21.15.5:0/4024426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8bc0d0230 0x7fd8bc0b0c00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:32.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.577+0000 7fd8c1e96640 1 --2- 172.21.15.5:0/4024426 >> v2:172.21.15.154:3300/0 conn(0x7fd8bc0d29d0 0x7fd8bc0b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:32.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.577+0000 7fd8c1e96640 1 -- 172.21.15.5:0/4024426 >> 172.21.15.5:0/4024426 conn(0x7fd8bc0659d0 msgr2=0x7fd8bc09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:32.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.577+0000 7fd8c1e96640 1 -- 172.21.15.5:0/4024426 shutdown_connections 2023-07-14T12:53:32.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.577+0000 7fd8c1e96640 1 -- 172.21.15.5:0/4024426 wait complete. 2023-07-14T12:53:32.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.577+0000 7fd8c1e96640 1 Processor -- start 2023-07-14T12:53:32.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.581+0000 7fd8c1e96640 1 -- start start 2023-07-14T12:53:32.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.581+0000 7fd8c1e96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8bc0d0230 0x7fd8bc14e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:32.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.581+0000 7fd8c1e96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8bc0d29d0 0x7fd8bc0c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:32.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.581+0000 7fd8c1e96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8bc15f320 0x7fd8bc14ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:32.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.581+0000 7fd8c1e96640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc14fcb0 con 0x7fd8bc15f320 2023-07-14T12:53:32.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.581+0000 7fd8c1e96640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc0c6a70 con 0x7fd8bc0d29d0 2023-07-14T12:53:32.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.581+0000 7fd8c1e96640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc0c6d50 con 0x7fd8bc0d0230 2023-07-14T12:53:32.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.581+0000 7fd8bbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8bc15f320 0x7fd8bc14ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:32.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.581+0000 7fd8bbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8bc15f320 0x7fd8bc14ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44642/0 (socket says 172.21.15.5:44642) 2023-07-14T12:53:32.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.581+0000 7fd8bbfff640 1 -- 172.21.15.5:0/4088663213 learned_addr learned my addr 172.21.15.5:0/4088663213 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:32.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.581+0000 7fd8baffd640 1 --2- 172.21.15.5:0/4088663213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8bc0d29d0 0x7fd8bc0c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:32.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.581+0000 7fd8bb7fe640 1 --2- 172.21.15.5:0/4088663213 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8bc0d0230 0x7fd8bc14e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:32.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.581+0000 7fd8bbfff640 1 -- 172.21.15.5:0/4088663213 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8bc0d0230 msgr2=0x7fd8bc14e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:32.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.581+0000 7fd8bbfff640 1 --2- 172.21.15.5:0/4088663213 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8bc0d0230 0x7fd8bc14e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:32.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.581+0000 7fd8bbfff640 1 -- 172.21.15.5:0/4088663213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8bc0d29d0 msgr2=0x7fd8bc0c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:32.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.581+0000 7fd8bbfff640 1 --2- 172.21.15.5:0/4088663213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8bc0d29d0 0x7fd8bc0c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:32.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.581+0000 7fd8bbfff640 1 -- 172.21.15.5:0/4088663213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b4009b30 con 0x7fd8bc15f320 2023-07-14T12:53:32.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.581+0000 7fd8bbfff640 1 --2- 172.21.15.5:0/4088663213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8bc15f320 0x7fd8bc14ffc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd8b40195e0 tx=0x7fd8b4019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:32.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.581+0000 7fd8a3fff640 1 -- 172.21.15.5:0/4088663213 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b40b8670 con 0x7fd8bc15f320 2023-07-14T12:53:32.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.581+0000 7fd8a3fff640 1 -- 172.21.15.5:0/4088663213 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b40b87d0 con 0x7fd8bc15f320 2023-07-14T12:53:32.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.581+0000 7fd8a3fff640 1 -- 172.21.15.5:0/4088663213 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b40b8b60 con 0x7fd8bc15f320 2023-07-14T12:53:32.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.581+0000 7fd8c1e96640 1 -- 172.21.15.5:0/4088663213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8bc0c7030 con 0x7fd8bc15f320 2023-07-14T12:53:32.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.581+0000 7fd8c1e96640 1 -- 172.21.15.5:0/4088663213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8bc0c75f0 con 0x7fd8bc15f320 2023-07-14T12:53:32.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.581+0000 7fd8c1e96640 1 -- 172.21.15.5:0/4088663213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8bc0c8de0 con 0x7fd8bc15f320 2023-07-14T12:53:32.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.585+0000 7fd8a3fff640 1 -- 172.21.15.5:0/4088663213 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd8b40b8cc0 con 0x7fd8bc15f320 2023-07-14T12:53:32.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.585+0000 7fd8a3fff640 1 --2- 172.21.15.5:0/4088663213 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fd8a80662b0 0x7fd8a8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:32.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.585+0000 7fd8a3fff640 1 -- 172.21.15.5:0/4088663213 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fd8b411f200 con 0x7fd8bc15f320 2023-07-14T12:53:32.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.585+0000 7fd8bb7fe640 1 --2- 172.21.15.5:0/4088663213 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fd8a80662b0 0x7fd8a8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:32.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.585+0000 7fd8bb7fe640 1 --2- 172.21.15.5:0/4088663213 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fd8a80662b0 0x7fd8a8068760 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac007fd0 tx=0x7fd8ac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:32.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.589+0000 7fd8a3fff640 1 -- 172.21.15.5:0/4088663213 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd8b40ec7b0 con 0x7fd8bc15f320 2023-07-14T12:53:32.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:32.745+0000 7fd8c1e96640 1 -- 172.21.15.5:0/4088663213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd8bc0678d0 con 0x7fd8bc15f320 2023-07-14T12:53:33.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.581+0000 7fd8a3fff640 1 -- 172.21.15.5:0/4088663213 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd8b40bc0d0 con 0x7fd8bc15f320 2023-07-14T12:53:33.609 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-07-14T12:53:33.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.585+0000 7fd8c1e96640 1 -- 172.21.15.5:0/4088663213 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fd8a80662b0 msgr2=0x7fd8a8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:33.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.585+0000 7fd8c1e96640 1 --2- 172.21.15.5:0/4088663213 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fd8a80662b0 0x7fd8a8068760 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac007fd0 tx=0x7fd8ac009040 comp rx=0 tx=0).stop 2023-07-14T12:53:33.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.585+0000 7fd8c1e96640 1 -- 172.21.15.5:0/4088663213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8bc15f320 msgr2=0x7fd8bc14ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:33.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.585+0000 7fd8c1e96640 1 --2- 172.21.15.5:0/4088663213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8bc15f320 0x7fd8bc14ffc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd8b40195e0 tx=0x7fd8b4019770 comp rx=0 tx=0).stop 2023-07-14T12:53:33.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.585+0000 7fd8c1e96640 1 -- 172.21.15.5:0/4088663213 shutdown_connections 2023-07-14T12:53:33.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.585+0000 7fd8c1e96640 1 --2- 172.21.15.5:0/4088663213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8bc15f320 0x7fd8bc14ffc0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:33.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.585+0000 7fd8c1e96640 1 --2- 172.21.15.5:0/4088663213 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fd8a80662b0 0x7fd8a8068760 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:33.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.585+0000 7fd8c1e96640 1 --2- 172.21.15.5:0/4088663213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8bc0d29d0 0x7fd8bc0c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:33.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.585+0000 7fd8c1e96640 1 --2- 172.21.15.5:0/4088663213 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8bc0d0230 0x7fd8bc14e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:33.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.585+0000 7fd8c1e96640 1 -- 172.21.15.5:0/4088663213 >> 172.21.15.5:0/4088663213 conn(0x7fd8bc0659d0 msgr2=0x7fd8bc0d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:33.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.585+0000 7fd8c1e96640 1 -- 172.21.15.5:0/4088663213 shutdown_connections 2023-07-14T12:53:33.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.585+0000 7fd8c1e96640 1 -- 172.21.15.5:0/4088663213 wait complete. 2023-07-14T12:53:33.636 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-14T12:53:33.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8ec3df640 1 Processor -- start 2023-07-14T12:53:33.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8ec3df640 1 -- start start 2023-07-14T12:53:33.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8ec3df640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe8e4159440 0x7fe8e40c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:33.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8ec3df640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e41532b0 con 0x7fe8e40aeb40 2023-07-14T12:53:33.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8ec3df640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e40ca6f0 con 0x7fe8e415cef0 2023-07-14T12:53:33.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8ec3df640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e415d360 con 0x7fe8e4159440 2023-07-14T12:53:33.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8ea17b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe8e40aeb40 0x7fe8e40aef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60728/0 (socket says 172.21.15.5:60728) 2023-07-14T12:53:33.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8ea17b640 1 -- 172.21.15.5:0/3481951102 learned_addr learned my addr 172.21.15.5:0/3481951102 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8ea97c640 1 --2- 172.21.15.5:0/3481951102 >> v2:172.21.15.154:3300/0 conn(0x7fe8e4159440 0x7fe8e40c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8e9179640 1 -- 172.21.15.5:0/3481951102 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673534806 0 0) 0x7fe8e41532b0 con 0x7fe8e40aeb40 2023-07-14T12:53:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8e9179640 1 -- 172.21.15.5:0/3481951102 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8d0003530 con 0x7fe8e40aeb40 2023-07-14T12:53:33.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8e9179640 1 -- 172.21.15.5:0/3481951102 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505241774 0 0) 0x7fe8e40ca6f0 con 0x7fe8e415cef0 2023-07-14T12:53:33.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8e9179640 1 -- 172.21.15.5:0/3481951102 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8e41532b0 con 0x7fe8e415cef0 2023-07-14T12:53:33.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8e9179640 1 -- 172.21.15.5:0/3481951102 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3450326944 0 0) 0x7fe8d0003530 con 0x7fe8e40aeb40 2023-07-14T12:53:33.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8e9179640 1 -- 172.21.15.5:0/3481951102 >> v2:172.21.15.154:3300/0 conn(0x7fe8e4159440 msgr2=0x7fe8e40c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:33.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8e9179640 1 --2- 172.21.15.5:0/3481951102 >> v2:172.21.15.154:3300/0 conn(0x7fe8e4159440 0x7fe8e40c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:33.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8e9179640 1 -- 172.21.15.5:0/3481951102 >> v1:172.21.15.154:6789/0 conn(0x7fe8e415cef0 legacy=0x7fe8e4158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:33.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8e9179640 1 -- 172.21.15.5:0/3481951102 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e41599d0 con 0x7fe8e40aeb40 2023-07-14T12:53:33.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8e9179640 1 -- 172.21.15.5:0/3481951102 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7fe8e0001680 con 0x7fe8e40aeb40 2023-07-14T12:53:33.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8ea97c640 1 --2- 172.21.15.5:0/3481951102 >> v2:172.21.15.154:3300/0 conn(0x7fe8e4159440 0x7fe8e40c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:53:33.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8e9179640 1 -- 172.21.15.5:0/3481951102 >> v1:172.21.15.5:6789/0 conn(0x7fe8e40aeb40 legacy=0x7fe8e40aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:33.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8e9179640 1 --2- 172.21.15.5:0/3481951102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8d0003b60 0x7fe8d0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:33.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8e9179640 1 --2- 172.21.15.5:0/3481951102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8d00047d0 0x7fe8d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:33.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8e9179640 1 --2- 172.21.15.5:0/3481951102 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8d0005180 0x7fe8d000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:33.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8e9179640 1 -- 172.21.15.5:0/3481951102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e415d360 con 0x7fe8d0003b60 2023-07-14T12:53:33.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8e9179640 1 -- 172.21.15.5:0/3481951102 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d000e270 con 0x7fe8d00047d0 2023-07-14T12:53:33.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8e9179640 1 -- 172.21.15.5:0/3481951102 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d000e400 con 0x7fe8d0005180 2023-07-14T12:53:33.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8ea17b640 1 --2- 172.21.15.5:0/3481951102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8d0003b60 0x7fe8d0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:33.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8e997a640 1 --2- 172.21.15.5:0/3481951102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8d00047d0 0x7fe8d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:33.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8ea17b640 1 -- 172.21.15.5:0/3481951102 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8d0005180 msgr2=0x7fe8d000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:33.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8ea17b640 1 --2- 172.21.15.5:0/3481951102 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8d0005180 0x7fe8d000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:33.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8ea17b640 1 -- 172.21.15.5:0/3481951102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8d00047d0 msgr2=0x7fe8d0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:33.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8ea17b640 1 --2- 172.21.15.5:0/3481951102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8d00047d0 0x7fe8d0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:33.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8ea17b640 1 -- 172.21.15.5:0/3481951102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d0003530 con 0x7fe8d0003b60 2023-07-14T12:53:33.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8ea97c640 1 -- 172.21.15.5:0/3481951102 reap_dead start 2023-07-14T12:53:33.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.761+0000 7fe8e997a640 1 --2- 172.21.15.5:0/3481951102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8d00047d0 0x7fe8d0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:33.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.765+0000 7fe8ea17b640 1 --2- 172.21.15.5:0/3481951102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8d0003b60 0x7fe8d0003f50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0001ec0 tx=0x7fe8e001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c239b779addb0d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:33.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.765+0000 7fe8e9179640 1 -- 172.21.15.5:0/3481951102 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0005ae0 con 0x7fe8d0003b60 2023-07-14T12:53:33.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.765+0000 7fe8e9179640 1 -- 172.21.15.5:0/3481951102 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e0005c40 con 0x7fe8d0003b60 2023-07-14T12:53:33.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.765+0000 7fe8e9179640 1 -- 172.21.15.5:0/3481951102 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0007290 con 0x7fe8d0003b60 2023-07-14T12:53:33.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.765+0000 7fe8ec3df640 1 -- 172.21.15.5:0/3481951102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8d0003b60 msgr2=0x7fe8d0003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:33.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.765+0000 7fe8ec3df640 1 --2- 172.21.15.5:0/3481951102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8d0003b60 0x7fe8d0003f50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0001ec0 tx=0x7fe8e001ca90 comp rx=0 tx=0).stop 2023-07-14T12:53:33.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.765+0000 7fe8ec3df640 1 -- 172.21.15.5:0/3481951102 shutdown_connections 2023-07-14T12:53:33.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.765+0000 7fe8ec3df640 1 --2- 172.21.15.5:0/3481951102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8d0003b60 0x7fe8d0003f50 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:33.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.765+0000 7fe8ec3df640 1 -- 172.21.15.5:0/3481951102 >> 172.21.15.5:0/3481951102 conn(0x7fe8e40cde90 msgr2=0x7fe8e40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:33.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.765+0000 7fe8ec3df640 1 -- 172.21.15.5:0/3481951102 shutdown_connections 2023-07-14T12:53:33.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.765+0000 7fe8ec3df640 1 -- 172.21.15.5:0/3481951102 wait complete. 2023-07-14T12:53:33.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.769+0000 7fe8ec3df640 1 Processor -- start 2023-07-14T12:53:33.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.769+0000 7fe8ec3df640 1 -- start start 2023-07-14T12:53:33.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.769+0000 7fe8ec3df640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8d0003b60 0x7fe8e4146780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:33.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.769+0000 7fe8ec3df640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e4156da0 0x7fe8e4157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:33.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.769+0000 7fe8ec3df640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8e4155100 0x7fe8e41555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:33.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.769+0000 7fe8ec3df640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e41563b0 con 0x7fe8e4156da0 2023-07-14T12:53:33.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.769+0000 7fe8ec3df640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e4157750 con 0x7fe8e4155100 2023-07-14T12:53:33.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.769+0000 7fe8ec3df640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e4155df0 con 0x7fe8d0003b60 2023-07-14T12:53:33.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.769+0000 7fe8e997a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e4156da0 0x7fe8e4157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:33.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.769+0000 7fe8e997a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e4156da0 0x7fe8e4157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44654/0 (socket says 172.21.15.5:44654) 2023-07-14T12:53:33.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.769+0000 7fe8e997a640 1 -- 172.21.15.5:0/2586377456 learned_addr learned my addr 172.21.15.5:0/2586377456 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:33.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.769+0000 7fe8ea97c640 1 --2- 172.21.15.5:0/2586377456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8e4155100 0x7fe8e41555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:33.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.769+0000 7fe8ea17b640 1 --2- 172.21.15.5:0/2586377456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8d0003b60 0x7fe8e4146780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:33.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.769+0000 7fe8e997a640 1 -- 172.21.15.5:0/2586377456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8d0003b60 msgr2=0x7fe8e4146780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:33.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.769+0000 7fe8e997a640 1 --2- 172.21.15.5:0/2586377456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8d0003b60 0x7fe8e4146780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:33.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.769+0000 7fe8e997a640 1 -- 172.21.15.5:0/2586377456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8e4155100 msgr2=0x7fe8e41555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:33.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.769+0000 7fe8e997a640 1 --2- 172.21.15.5:0/2586377456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8e4155100 0x7fe8e41555a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:33.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.769+0000 7fe8e997a640 1 -- 172.21.15.5:0/2586377456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e41560d0 con 0x7fe8e4156da0 2023-07-14T12:53:33.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.769+0000 7fe8e997a640 1 --2- 172.21.15.5:0/2586377456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e4156da0 0x7fe8e4157210 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400d7d0 tx=0x7fe8d400d8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:33.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.769+0000 7fe8daffd640 1 -- 172.21.15.5:0/2586377456 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4007020 con 0x7fe8e4156da0 2023-07-14T12:53:33.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.769+0000 7fe8daffd640 1 -- 172.21.15.5:0/2586377456 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d4007180 con 0x7fe8e4156da0 2023-07-14T12:53:33.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.769+0000 7fe8daffd640 1 -- 172.21.15.5:0/2586377456 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4007530 con 0x7fe8e4156da0 2023-07-14T12:53:33.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.769+0000 7fe8ec3df640 1 -- 172.21.15.5:0/2586377456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e4144620 con 0x7fe8e4156da0 2023-07-14T12:53:33.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.773+0000 7fe8ec3df640 1 -- 172.21.15.5:0/2586377456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e4155ae0 con 0x7fe8e4156da0 2023-07-14T12:53:33.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.773+0000 7fe8ec3df640 1 -- 172.21.15.5:0/2586377456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e4144480 con 0x7fe8e4156da0 2023-07-14T12:53:33.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.773+0000 7fe8daffd640 1 -- 172.21.15.5:0/2586377456 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe8d40067e0 con 0x7fe8e4156da0 2023-07-14T12:53:33.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.773+0000 7fe8daffd640 1 --2- 172.21.15.5:0/2586377456 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe8c8066280 0x7fe8c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:33.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.773+0000 7fe8daffd640 1 -- 172.21.15.5:0/2586377456 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5768+0+0 (secure 0 0 0) 0x7fe8d40838b0 con 0x7fe8e4156da0 2023-07-14T12:53:33.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.773+0000 7fe8ea17b640 1 --2- 172.21.15.5:0/2586377456 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe8c8066280 0x7fe8c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:33.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.777+0000 7fe8ea17b640 1 --2- 172.21.15.5:0/2586377456 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe8c8066280 0x7fe8c8068730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00ab000 tx=0x7fe8e00a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:33.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.777+0000 7fe8daffd640 1 -- 172.21.15.5:0/2586377456 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe8e4144480 con 0x7fe8e4156da0 2023-07-14T12:53:33.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:33.933+0000 7fe8ec3df640 1 -- 172.21.15.5:0/2586377456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe8e4144480 con 0x7fe8e4156da0 2023-07-14T12:53:34.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.589+0000 7fe8daffd640 1 -- 172.21.15.5:0/2586377456 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe8e4144480 con 0x7fe8e4156da0 2023-07-14T12:53:34.617 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-07-14T12:53:34.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.593+0000 7fe8ec3df640 1 -- 172.21.15.5:0/2586377456 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe8c8066280 msgr2=0x7fe8c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:34.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.593+0000 7fe8ec3df640 1 --2- 172.21.15.5:0/2586377456 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe8c8066280 0x7fe8c8068730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00ab000 tx=0x7fe8e00a7070 comp rx=0 tx=0).stop 2023-07-14T12:53:34.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.593+0000 7fe8ec3df640 1 -- 172.21.15.5:0/2586377456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e4156da0 msgr2=0x7fe8e4157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:34.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.593+0000 7fe8ec3df640 1 --2- 172.21.15.5:0/2586377456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e4156da0 0x7fe8e4157210 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400d7d0 tx=0x7fe8d400d8c0 comp rx=0 tx=0).stop 2023-07-14T12:53:34.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.593+0000 7fe8ec3df640 1 -- 172.21.15.5:0/2586377456 shutdown_connections 2023-07-14T12:53:34.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.593+0000 7fe8ec3df640 1 --2- 172.21.15.5:0/2586377456 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe8c8066280 0x7fe8c8068730 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:34.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.593+0000 7fe8ec3df640 1 --2- 172.21.15.5:0/2586377456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8e4155100 0x7fe8e41555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:34.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.593+0000 7fe8ec3df640 1 --2- 172.21.15.5:0/2586377456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e4156da0 0x7fe8e4157210 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:34.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.593+0000 7fe8ec3df640 1 --2- 172.21.15.5:0/2586377456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8d0003b60 0x7fe8e4146780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:34.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.593+0000 7fe8ec3df640 1 -- 172.21.15.5:0/2586377456 >> 172.21.15.5:0/2586377456 conn(0x7fe8e40cde90 msgr2=0x7fe8e4158300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:34.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.593+0000 7fe8ec3df640 1 -- 172.21.15.5:0/2586377456 shutdown_connections 2023-07-14T12:53:34.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.593+0000 7fe8ec3df640 1 -- 172.21.15.5:0/2586377456 wait complete. 2023-07-14T12:53:34.645 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-14T12:53:34.645 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-14T12:53:34.646 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-14T12:53:34.646 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T12:53:34.646 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-14T12:53:34.646 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-14T12:53:34.647 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-14T12:53:34.647 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T12:53:34.647 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-14T12:53:34.647 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-14T12:53:34.648 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-14T12:53:34.648 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T12:53:34.648 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-14T12:53:34.648 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-14T12:53:34.649 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-14T12:53:34.649 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T12:53:34.658 INFO:tasks.ceph.mds.a:Stopped 2023-07-14T12:53:34.658 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-14T12:53:34.659 INFO:tasks.ceph.mds.c:Stopped 2023-07-14T12:53:34.659 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-14T12:53:34.663 INFO:tasks.ceph.mds.d:Stopped 2023-07-14T12:53:34.664 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-14T12:53:34.665 INFO:tasks.ceph.mds.b:Stopped 2023-07-14T12:53:34.665 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-14T12:53:34.706 INFO:tasks.ceph.mds.a:Started 2023-07-14T12:53:34.706 DEBUG:teuthology.parallel:result is None 2023-07-14T12:53:34.707 INFO:tasks.ceph.mds.c:Started 2023-07-14T12:53:34.708 DEBUG:teuthology.parallel:result is None 2023-07-14T12:53:34.712 INFO:tasks.ceph.mds.d:Started 2023-07-14T12:53:34.712 DEBUG:teuthology.parallel:result is None 2023-07-14T12:53:34.715 INFO:tasks.ceph.mds.b:Started 2023-07-14T12:53:34.715 DEBUG:teuthology.parallel:result is None 2023-07-14T12:53:34.716 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-14T12:53:34.795 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-07-14T12:53:34.797 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-07-14T12:53:34.804 INFO:tasks.ceph.mds.b.smithi154.stdout:starting mds.b at 2023-07-14T12:53:34.804 INFO:tasks.ceph.mds.d.smithi154.stdout:starting mds.d at 2023-07-14T12:53:34.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.837+0000 7f5ed5b74640 1 Processor -- start 2023-07-14T12:53:34.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.837+0000 7f5ed5b74640 1 -- start start 2023-07-14T12:53:34.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.841+0000 7f5ed5b74640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5ed0070b70 0x7f5ed0070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:34.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.841+0000 7f5ed5b74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed006b1e0 0x7f5ed00c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:34.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.841+0000 7f5ed5b74640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed00cac70 con 0x7f5ed00c21f0 2023-07-14T12:53:34.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.841+0000 7f5ed5b74640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed0071480 con 0x7f5ed0070b70 2023-07-14T12:53:34.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.841+0000 7f5ed5b74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00ca060 con 0x7f5ed006b1e0 2023-07-14T12:53:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.841+0000 7f5eceffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed006b1e0 0x7f5ed00c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.841+0000 7f5ecf7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5ed0070b70 0x7f5ed0070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.841+0000 7f5eceffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed006b1e0 0x7f5ed00c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:34030/0 (socket says 172.21.15.5:34030) 2023-07-14T12:53:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.841+0000 7f5eceffd640 1 -- 172.21.15.5:0/2164239534 learned_addr learned my addr 172.21.15.5:0/2164239534 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.841+0000 7f5ecffff640 1 --1- 172.21.15.5:0/2164239534 >> v1:172.21.15.154:6789/0 conn(0x7f5ed00c21f0 0x7f5ed00cb100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:42344/0 (socket says 172.21.15.5:42344) 2023-07-14T12:53:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.841+0000 7f5eceffd640 1 -- 172.21.15.5:0/2164239534 >> v2:172.21.15.154:3300/0 conn(0x7f5ed0070b70 msgr2=0x7f5ed0070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.841+0000 7f5eceffd640 1 --2- 172.21.15.5:0/2164239534 >> v2:172.21.15.154:3300/0 conn(0x7f5ed0070b70 0x7f5ed0070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:34.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.841+0000 7f5eceffd640 1 -- 172.21.15.5:0/2164239534 >> v1:172.21.15.154:6789/0 conn(0x7f5ed00c21f0 legacy=0x7f5ed00cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:34.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.841+0000 7f5eceffd640 1 -- 172.21.15.5:0/2164239534 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed00ca340 con 0x7f5ed006b1e0 2023-07-14T12:53:34.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.841+0000 7f5ece7fc640 1 -- 172.21.15.5:0/2164239534 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1891886649 0 0) 0x7f5ed00cac70 con 0x7f5ed00c21f0 2023-07-14T12:53:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.845+0000 7f5eceffd640 1 --2- 172.21.15.5:0/2164239534 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed006b1e0 0x7f5ed00c1cb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4009870 tx=0x7f5ec401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e153807edce9a69 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.845+0000 7f5ece7fc640 1 -- 172.21.15.5:0/2164239534 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec40a6040 con 0x7f5ed006b1e0 2023-07-14T12:53:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.845+0000 7f5ece7fc640 1 -- 172.21.15.5:0/2164239534 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec40aa600 con 0x7f5ed006b1e0 2023-07-14T12:53:34.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.845+0000 7f5ece7fc640 1 -- 172.21.15.5:0/2164239534 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec40aa990 con 0x7f5ed006b1e0 2023-07-14T12:53:34.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.845+0000 7f5ed5b74640 1 -- 172.21.15.5:0/2164239534 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed006b1e0 msgr2=0x7f5ed00c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:34.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.845+0000 7f5ed5b74640 1 --2- 172.21.15.5:0/2164239534 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed006b1e0 0x7f5ed00c1cb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4009870 tx=0x7f5ec401c4a0 comp rx=0 tx=0).stop 2023-07-14T12:53:34.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.845+0000 7f5ed5b74640 1 -- 172.21.15.5:0/2164239534 shutdown_connections 2023-07-14T12:53:34.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.845+0000 7f5ed5b74640 1 --2- 172.21.15.5:0/2164239534 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed006b1e0 0x7f5ed00c1cb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:34.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.845+0000 7f5ed5b74640 1 --2- 172.21.15.5:0/2164239534 >> v2:172.21.15.154:3300/0 conn(0x7f5ed0070b70 0x7f5ed0070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:34.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.845+0000 7f5ed5b74640 1 -- 172.21.15.5:0/2164239534 >> 172.21.15.5:0/2164239534 conn(0x7f5ed00afcf0 msgr2=0x7f5ed00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:34.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.845+0000 7f5ed5b74640 1 -- 172.21.15.5:0/2164239534 shutdown_connections 2023-07-14T12:53:34.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.845+0000 7f5ed5b74640 1 -- 172.21.15.5:0/2164239534 wait complete. 2023-07-14T12:53:34.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.845+0000 7f5ed5b74640 1 Processor -- start 2023-07-14T12:53:34.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.845+0000 7f5ed5b74640 1 -- start start 2023-07-14T12:53:34.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.849+0000 7f5ed5b74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ed006b1e0 0x7f5ed00a7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:34.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.849+0000 7f5ed5b74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed0070b70 0x7f5ed00ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:34.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.849+0000 7f5ed5b74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed00c21f0 0x7f5ed0154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:34.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.849+0000 7f5ed5b74640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00a9270 con 0x7f5ed0070b70 2023-07-14T12:53:34.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.849+0000 7f5ed5b74640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00a9700 con 0x7f5ed006b1e0 2023-07-14T12:53:34.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.849+0000 7f5ed5b74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00a8660 con 0x7f5ed00c21f0 2023-07-14T12:53:34.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.849+0000 7f5eceffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed0070b70 0x7f5ed00ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:34.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.849+0000 7f5ecf7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ed006b1e0 0x7f5ed00a7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:34.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.849+0000 7f5eceffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed0070b70 0x7f5ed00ccad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44704/0 (socket says 172.21.15.5:44704) 2023-07-14T12:53:34.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.849+0000 7f5eceffd640 1 -- 172.21.15.5:0/2209929840 learned_addr learned my addr 172.21.15.5:0/2209929840 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:34.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.849+0000 7f5ecffff640 1 --2- 172.21.15.5:0/2209929840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed00c21f0 0x7f5ed0154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:34.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.849+0000 7f5ecf7fe640 1 -- 172.21.15.5:0/2209929840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed00c21f0 msgr2=0x7f5ed0154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:34.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.849+0000 7f5ecf7fe640 1 --2- 172.21.15.5:0/2209929840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed00c21f0 0x7f5ed0154a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:34.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.849+0000 7f5ecf7fe640 1 -- 172.21.15.5:0/2209929840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed0070b70 msgr2=0x7f5ed00ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:34.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.849+0000 7f5ecf7fe640 1 --2- 172.21.15.5:0/2209929840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed0070b70 0x7f5ed00ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:34.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.849+0000 7f5ecf7fe640 1 -- 172.21.15.5:0/2209929840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec40094d0 con 0x7f5ed006b1e0 2023-07-14T12:53:34.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.849+0000 7f5eceffd640 1 --2- 172.21.15.5:0/2209929840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed0070b70 0x7f5ed00ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:53:34.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.849+0000 7f5ecf7fe640 1 --2- 172.21.15.5:0/2209929840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ed006b1e0 0x7f5ed00a7cf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5ec000e870 tx=0x7f5ec000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:34.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.849+0000 7f5eb7fff640 1 -- 172.21.15.5:0/2209929840 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec00095d0 con 0x7f5ed006b1e0 2023-07-14T12:53:34.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.849+0000 7f5eb7fff640 1 -- 172.21.15.5:0/2209929840 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec000c940 con 0x7f5ed006b1e0 2023-07-14T12:53:34.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.849+0000 7f5ed5b74640 1 -- 172.21.15.5:0/2209929840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed00a8940 con 0x7f5ed006b1e0 2023-07-14T12:53:34.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.849+0000 7f5eb7fff640 1 -- 172.21.15.5:0/2209929840 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec000ccb0 con 0x7f5ed006b1e0 2023-07-14T12:53:34.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.849+0000 7f5ed5b74640 1 -- 172.21.15.5:0/2209929840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed00a8f00 con 0x7f5ed006b1e0 2023-07-14T12:53:34.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.849+0000 7f5ed5b74640 1 -- 172.21.15.5:0/2209929840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed00678d0 con 0x7f5ed006b1e0 2023-07-14T12:53:34.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.853+0000 7f5eb7fff640 1 -- 172.21.15.5:0/2209929840 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5ec003b080 con 0x7f5ed006b1e0 2023-07-14T12:53:34.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.853+0000 7f5eb7fff640 1 --2- 172.21.15.5:0/2209929840 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5ebc0662b0 0x7f5ebc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:34.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.853+0000 7f5eb7fff640 1 -- 172.21.15.5:0/2209929840 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f5ec0083e10 con 0x7f5ed006b1e0 2023-07-14T12:53:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.853+0000 7f5eceffd640 1 --2- 172.21.15.5:0/2209929840 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5ebc0662b0 0x7f5ebc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.853+0000 7f5eceffd640 1 --2- 172.21.15.5:0/2209929840 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5ebc0662b0 0x7f5ebc068760 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4009870 tx=0x7f5ec40b5040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:34.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:34.857+0000 7f5eb7fff640 1 -- 172.21.15.5:0/2209929840 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f5ec0051640 con 0x7f5ed006b1e0 2023-07-14T12:53:35.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:35.021+0000 7f5ed5b74640 1 -- 172.21.15.5:0/2209929840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5ed00afad0 con 0x7f5ed006b1e0 2023-07-14T12:53:36.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.441+0000 7f5eb7fff640 1 -- 172.21.15.5:0/2209929840 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5ec0054c60 con 0x7f5ed006b1e0 2023-07-14T12:53:36.471 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2023-07-14T12:53:36.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.445+0000 7f5ed5b74640 1 -- 172.21.15.5:0/2209929840 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5ebc0662b0 msgr2=0x7f5ebc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:36.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.445+0000 7f5ed5b74640 1 --2- 172.21.15.5:0/2209929840 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5ebc0662b0 0x7f5ebc068760 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4009870 tx=0x7f5ec40b5040 comp rx=0 tx=0).stop 2023-07-14T12:53:36.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.445+0000 7f5ed5b74640 1 -- 172.21.15.5:0/2209929840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ed006b1e0 msgr2=0x7f5ed00a7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:36.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.445+0000 7f5ed5b74640 1 --2- 172.21.15.5:0/2209929840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ed006b1e0 0x7f5ed00a7cf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5ec000e870 tx=0x7f5ec000ed30 comp rx=0 tx=0).stop 2023-07-14T12:53:36.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.445+0000 7f5ed5b74640 1 -- 172.21.15.5:0/2209929840 shutdown_connections 2023-07-14T12:53:36.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.445+0000 7f5ed5b74640 1 --2- 172.21.15.5:0/2209929840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed00c21f0 0x7f5ed0154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:36.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.445+0000 7f5ed5b74640 1 --2- 172.21.15.5:0/2209929840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed0070b70 0x7f5ed00ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:36.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.445+0000 7f5ed5b74640 1 --2- 172.21.15.5:0/2209929840 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5ebc0662b0 0x7f5ebc068760 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:36.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.445+0000 7f5ed5b74640 1 --2- 172.21.15.5:0/2209929840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ed006b1e0 0x7f5ed00a7cf0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:36.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.445+0000 7f5ed5b74640 1 -- 172.21.15.5:0/2209929840 >> 172.21.15.5:0/2209929840 conn(0x7f5ed00afcf0 msgr2=0x7f5ed01593a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:36.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.445+0000 7f5ed5b74640 1 -- 172.21.15.5:0/2209929840 shutdown_connections 2023-07-14T12:53:36.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.445+0000 7f5ed5b74640 1 -- 172.21.15.5:0/2209929840 wait complete. 2023-07-14T12:53:36.498 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-14T12:53:36.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.625+0000 7f5918ee6640 1 Processor -- start 2023-07-14T12:53:36.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.625+0000 7f5918ee6640 1 -- start start 2023-07-14T12:53:36.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.625+0000 7f5918ee6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5914160450 0x7f591406e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:36.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.625+0000 7f5918ee6640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59140c9c30 con 0x7f5914069430 2023-07-14T12:53:36.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.625+0000 7f5918ee6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f591415bfd0 con 0x7f591415bc00 2023-07-14T12:53:36.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.625+0000 7f5918ee6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59140c96b0 con 0x7f5914160450 2023-07-14T12:53:36.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.625+0000 7f5912d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5914069430 0x7f5914069830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60758/0 (socket says 172.21.15.5:60758) 2023-07-14T12:53:36.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.625+0000 7f5912d9d640 1 -- 172.21.15.5:0/348899478 learned_addr learned my addr 172.21.15.5:0/348899478 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:36.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.625+0000 7f590bfff640 1 --2- 172.21.15.5:0/348899478 >> v2:172.21.15.154:3300/0 conn(0x7f5914160450 0x7f591406e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:36.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.625+0000 7f5911d9b640 1 -- 172.21.15.5:0/348899478 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2808392836 0 0) 0x7f59140c9c30 con 0x7f5914069430 2023-07-14T12:53:36.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.625+0000 7f5911d9b640 1 -- 172.21.15.5:0/348899478 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5900003530 con 0x7f5914069430 2023-07-14T12:53:36.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.625+0000 7f590bfff640 1 -- 172.21.15.5:0/348899478 >> v1:172.21.15.154:6789/0 conn(0x7f591415bc00 legacy=0x7f59140ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:36.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.625+0000 7f590bfff640 1 -- 172.21.15.5:0/348899478 >> v1:172.21.15.5:6789/0 conn(0x7f5914069430 legacy=0x7f5914069830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:36.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.625+0000 7f5911d9b640 1 -- 172.21.15.5:0/348899478 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1420266795 0 0) 0x7f5900003530 con 0x7f5914069430 2023-07-14T12:53:36.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.625+0000 7f590bfff640 1 -- 172.21.15.5:0/348899478 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59140cf910 con 0x7f5914160450 2023-07-14T12:53:36.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.629+0000 7f590bfff640 1 --2- 172.21.15.5:0/348899478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5914160450 0x7f591406e690 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0097c0 tx=0x7f58fc01c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=280a9af1805b0aae server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:36.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.629+0000 7f5911d9b640 1 -- 172.21.15.5:0/348899478 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c001a00 con 0x7f5914160450 2023-07-14T12:53:36.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.629+0000 7f5911d9b640 1 -- 172.21.15.5:0/348899478 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58fc0a7050 con 0x7f5914160450 2023-07-14T12:53:36.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.629+0000 7f5911d9b640 1 -- 172.21.15.5:0/348899478 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc0ab620 con 0x7f5914160450 2023-07-14T12:53:36.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.629+0000 7f5918ee6640 1 -- 172.21.15.5:0/348899478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5914160450 msgr2=0x7f591406e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:36.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.629+0000 7f5918ee6640 1 --2- 172.21.15.5:0/348899478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5914160450 0x7f591406e690 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0097c0 tx=0x7f58fc01c370 comp rx=0 tx=0).stop 2023-07-14T12:53:36.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.629+0000 7f5918ee6640 1 -- 172.21.15.5:0/348899478 shutdown_connections 2023-07-14T12:53:36.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.629+0000 7f5918ee6640 1 --2- 172.21.15.5:0/348899478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5914160450 0x7f591406e690 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:36.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.629+0000 7f5918ee6640 1 -- 172.21.15.5:0/348899478 >> 172.21.15.5:0/348899478 conn(0x7f59140b1840 msgr2=0x7f59140cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:36.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.629+0000 7f5918ee6640 1 -- 172.21.15.5:0/348899478 shutdown_connections 2023-07-14T12:53:36.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.629+0000 7f5918ee6640 1 -- 172.21.15.5:0/348899478 wait complete. 2023-07-14T12:53:36.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.633+0000 7f5918ee6640 1 Processor -- start 2023-07-14T12:53:36.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.633+0000 7f5918ee6640 1 -- start start 2023-07-14T12:53:36.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.633+0000 7f5918ee6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5914069430 0x7f591415c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:36.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.633+0000 7f5918ee6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f591415bc00 0x7f591415c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:36.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.633+0000 7f5918ee6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5914160450 0x7f5914144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:36.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.633+0000 7f5918ee6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59140b4a60 con 0x7f5914069430 2023-07-14T12:53:36.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.633+0000 7f5918ee6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5914152b60 con 0x7f591415bc00 2023-07-14T12:53:36.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.633+0000 7f5918ee6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59141525a0 con 0x7f5914160450 2023-07-14T12:53:36.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.633+0000 7f591259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5914069430 0x7f591415c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:36.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.633+0000 7f591259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5914069430 0x7f591415c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44712/0 (socket says 172.21.15.5:44712) 2023-07-14T12:53:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.633+0000 7f591259c640 1 -- 172.21.15.5:0/2477743183 learned_addr learned my addr 172.21.15.5:0/2477743183 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.633+0000 7f591259c640 1 -- 172.21.15.5:0/2477743183 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5914160450 msgr2=0x7f5914144b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.633+0000 7f591259c640 1 --2- 172.21.15.5:0/2477743183 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5914160450 0x7f5914144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.633+0000 7f591259c640 1 -- 172.21.15.5:0/2477743183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f591415bc00 msgr2=0x7f591415c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.633+0000 7f591259c640 1 --2- 172.21.15.5:0/2477743183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f591415bc00 0x7f591415c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:36.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.633+0000 7f591259c640 1 -- 172.21.15.5:0/2477743183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc009420 con 0x7f5914069430 2023-07-14T12:53:36.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.633+0000 7f591259c640 1 --2- 172.21.15.5:0/2477743183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5914069430 0x7f591415c1a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f590400c530 tx=0x7f590400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:36.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.633+0000 7f590affd640 1 -- 172.21.15.5:0/2477743183 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5904005220 con 0x7f5914069430 2023-07-14T12:53:36.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.633+0000 7f590affd640 1 -- 172.21.15.5:0/2477743183 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5904005380 con 0x7f5914069430 2023-07-14T12:53:36.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.633+0000 7f590affd640 1 -- 172.21.15.5:0/2477743183 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5904007270 con 0x7f5914069430 2023-07-14T12:53:36.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.633+0000 7f5918ee6640 1 -- 172.21.15.5:0/2477743183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5914152880 con 0x7f5914069430 2023-07-14T12:53:36.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.633+0000 7f5918ee6640 1 -- 172.21.15.5:0/2477743183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59140b2330 con 0x7f5914069430 2023-07-14T12:53:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.633+0000 7f5918ee6640 1 -- 172.21.15.5:0/2477743183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59140b1eb0 con 0x7f5914069430 2023-07-14T12:53:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.637+0000 7f590affd640 1 -- 172.21.15.5:0/2477743183 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f59040073d0 con 0x7f5914069430 2023-07-14T12:53:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.637+0000 7f590affd640 1 --2- 172.21.15.5:0/2477743183 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f58f4066280 0x7f58f4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.637+0000 7f590affd640 1 -- 172.21.15.5:0/2477743183 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f59040832f0 con 0x7f5914069430 2023-07-14T12:53:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.637+0000 7f590bfff640 1 --2- 172.21.15.5:0/2477743183 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f58f4066280 0x7f58f4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.637+0000 7f590bfff640 1 --2- 172.21.15.5:0/2477743183 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f58f4066280 0x7f58f4068730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0ad000 tx=0x7f58fc004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:36.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.641+0000 7f590affd640 1 -- 172.21.15.5:0/2477743183 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f59140b1eb0 con 0x7f5914069430 2023-07-14T12:53:36.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.849+0000 7f5918ee6640 1 -- 172.21.15.5:0/2477743183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f59140b1eb0 con 0x7f5914069430 2023-07-14T12:53:36.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.849+0000 7f590affd640 1 -- 172.21.15.5:0/2477743183 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f59140b1eb0 con 0x7f5914069430 2023-07-14T12:53:36.878 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:36.878 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T12:53:36.878 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2023-07-14T12:53:36.879 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:36.879 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2023-07-14T12:53:36.879 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkGNTsMRAA5T/zjdynxEKmoNAAK0cChw==", 2023-07-14T12:53:36.879 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T12:53:36.879 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T12:53:36.879 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T12:53:36.879 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T12:53:36.880 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T12:53:36.880 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:36.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T12:53:36.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:36.880 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2023-07-14T12:53:36.880 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkqXNAAxAAb7bzXyE8cSS0A3Rz2de6TA==", 2023-07-14T12:53:36.880 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T12:53:36.881 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T12:53:36.881 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T12:53:36.881 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T12:53:36.881 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T12:53:36.881 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:36.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T12:53:36.881 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:36.881 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2023-07-14T12:53:36.882 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFk6NGUORAA+5odxrAlCCXYGc64nzFWwQ==", 2023-07-14T12:53:36.882 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T12:53:36.882 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T12:53:36.882 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T12:53:36.882 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T12:53:36.882 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T12:53:36.882 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:36.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T12:53:36.883 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:36.883 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2023-07-14T12:53:36.883 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkGh/BChAA5p9amLIC6ORC0JJov0bSVg==", 2023-07-14T12:53:36.883 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T12:53:36.883 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T12:53:36.883 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T12:53:36.883 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T12:53:36.884 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T12:53:36.884 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:36.884 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T12:53:36.884 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:36.884 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2023-07-14T12:53:36.884 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDlRLFkJ6MULhAAxExAqekc/gWudYBJ2sY4MQ==", 2023-07-14T12:53:36.884 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T12:53:36.885 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T12:53:36.885 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T12:53:36.885 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T12:53:36.885 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:36.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T12:53:36.885 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:36.885 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2023-07-14T12:53:36.886 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDoRLFksXGBNRAAFtHZt5OQw0aB6k3CkxOzZQ==", 2023-07-14T12:53:36.886 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T12:53:36.886 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T12:53:36.886 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T12:53:36.886 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T12:53:36.886 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:36.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T12:53:36.886 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:36.887 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2023-07-14T12:53:36.887 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDsRLFkaUH0ARAAkqgsKPX1dTSZQjn0cRxxRQ==", 2023-07-14T12:53:36.887 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T12:53:36.887 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T12:53:36.887 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T12:53:36.887 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T12:53:36.887 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:36.888 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T12:53:36.888 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:36.888 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2023-07-14T12:53:36.888 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDvRLFkvElJCRAAnox5LKwobP/1Qaf5d9UsjA==", 2023-07-14T12:53:36.888 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T12:53:36.888 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T12:53:36.888 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T12:53:36.888 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T12:53:36.889 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:36.889 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T12:53:36.889 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:36.889 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2023-07-14T12:53:36.889 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD1RLFkMNyyDxAA19dJkhhuSpcgVPQEyxb3lg==", 2023-07-14T12:53:36.889 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T12:53:36.889 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T12:53:36.890 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T12:53:36.890 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T12:53:36.890 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:36.890 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T12:53:36.890 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:36.890 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2023-07-14T12:53:36.890 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD4RLFkR8mTFhAAP5qUgUJI23XOvVAnNCSgRQ==", 2023-07-14T12:53:36.890 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T12:53:36.891 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T12:53:36.891 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T12:53:36.891 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T12:53:36.891 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:36.891 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T12:53:36.891 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:36.891 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2023-07-14T12:53:36.892 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD7RLFkpWL9HBAAo8MfszRnB4sHsDPPcRjCAg==", 2023-07-14T12:53:36.892 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T12:53:36.892 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T12:53:36.892 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T12:53:36.892 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T12:53:36.892 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:36.892 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T12:53:36.892 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:36.893 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2023-07-14T12:53:36.893 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD+RLFkL5cRIxAAF/4ndtYf0oiH3uhhDKnQQg==", 2023-07-14T12:53:36.893 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T12:53:36.893 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T12:53:36.893 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T12:53:36.893 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T12:53:36.893 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:36.894 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T12:53:36.894 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:36.894 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2023-07-14T12:53:36.894 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkCav/DhAA6SOiONAbTcWCnUZXcm7BcQ==", 2023-07-14T12:53:36.894 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T12:53:36.894 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T12:53:36.894 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T12:53:36.894 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T12:53:36.895 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T12:53:36.895 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:36.895 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T12:53:36.895 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:36.895 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2023-07-14T12:53:36.895 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkgS/hGBAAevMD2/lfNuaeV74w0Xj0Zw==", 2023-07-14T12:53:36.895 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T12:53:36.895 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T12:53:36.896 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T12:53:36.896 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T12:53:36.896 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T12:53:36.896 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:36.896 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T12:53:36.896 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:36.896 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2023-07-14T12:53:36.897 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkeBs4FRAAJ/UjIEKDajVyDb7PejPqAw==", 2023-07-14T12:53:36.897 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T12:53:36.897 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T12:53:36.897 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T12:53:36.897 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T12:53:36.897 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T12:53:36.897 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:36.897 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T12:53:36.898 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:36.898 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2023-07-14T12:53:36.898 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkSkDiHhAAV86wIrAVz3o/PI2CaBC44w==", 2023-07-14T12:53:36.898 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T12:53:36.898 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T12:53:36.898 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T12:53:36.898 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T12:53:36.898 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T12:53:36.899 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:36.899 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T12:53:36.899 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:36.899 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2023-07-14T12:53:36.899 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkk5IcFRAAThI0P1N8LsRetmwhHqSvdQ==", 2023-07-14T12:53:36.899 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T12:53:36.899 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T12:53:36.899 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T12:53:36.900 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T12:53:36.900 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T12:53:36.900 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:36.900 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T12:53:36.900 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:36.900 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-mds", 2023-07-14T12:53:36.900 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAERbFkUkvJJxAAHJc9GCLr6aFS3czM7f0V5g==", 2023-07-14T12:53:36.901 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T12:53:36.901 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-mds" 2023-07-14T12:53:36.901 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:36.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T12:53:36.901 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:36.901 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-mgr", 2023-07-14T12:53:36.901 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAERbFk+FTJJxAAXLvBkc7szfDYX34QdxLxRQ==", 2023-07-14T12:53:36.901 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T12:53:36.902 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-mgr" 2023-07-14T12:53:36.902 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:36.902 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T12:53:36.902 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:36.902 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-osd", 2023-07-14T12:53:36.902 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAERbFkT13JJxAA9dLys4Hdn2L7iq4fNh9KIg==", 2023-07-14T12:53:36.902 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T12:53:36.902 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-osd" 2023-07-14T12:53:36.903 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:36.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T12:53:36.903 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:36.903 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rbd", 2023-07-14T12:53:36.903 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAERbFk2GXJJxAABmPCOCnW8HIZovgH+AqOfQ==", 2023-07-14T12:53:36.903 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T12:53:36.903 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rbd" 2023-07-14T12:53:36.904 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:36.904 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T12:53:36.904 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:36.904 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-07-14T12:53:36.904 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAERbFkVW7JJxAAXruEDDf4A+te7y00lIvKmQ==", 2023-07-14T12:53:36.904 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T12:53:36.904 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-07-14T12:53:36.904 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:36.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T12:53:36.905 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:36.905 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rgw", 2023-07-14T12:53:36.905 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQAERbFkIXfJJxAAg0DupHdMHkZCeTS6D8OZdA==", 2023-07-14T12:53:36.905 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T12:53:36.905 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rgw" 2023-07-14T12:53:36.905 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:36.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T12:53:36.906 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:36.906 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2023-07-14T12:53:36.906 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkugeXLRAAEVAnLk/dldtqrpkdzQI3SA==", 2023-07-14T12:53:36.906 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T12:53:36.906 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T12:53:36.906 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-07-14T12:53:36.906 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T12:53:36.907 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:36.907 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T12:53:36.907 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:36.907 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2023-07-14T12:53:36.907 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkSvp/KRAAwvjYlrZYNeGbhCiDrTmnrA==", 2023-07-14T12:53:36.907 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T12:53:36.907 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T12:53:36.907 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-07-14T12:53:36.908 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T12:53:36.908 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:36.908 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:36.908 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-07-14T12:53:36.908 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T12:53:36.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.853+0000 7f5918ee6640 1 -- 172.21.15.5:0/2477743183 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f58f4066280 msgr2=0x7f58f4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:36.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.853+0000 7f5918ee6640 1 --2- 172.21.15.5:0/2477743183 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f58f4066280 0x7f58f4068730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0ad000 tx=0x7f58fc004740 comp rx=0 tx=0).stop 2023-07-14T12:53:36.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.853+0000 7f5918ee6640 1 -- 172.21.15.5:0/2477743183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5914069430 msgr2=0x7f591415c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:36.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.853+0000 7f5918ee6640 1 --2- 172.21.15.5:0/2477743183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5914069430 0x7f591415c1a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f590400c530 tx=0x7f590400c9f0 comp rx=0 tx=0).stop 2023-07-14T12:53:36.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.853+0000 7f5918ee6640 1 -- 172.21.15.5:0/2477743183 shutdown_connections 2023-07-14T12:53:36.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.853+0000 7f5918ee6640 1 --2- 172.21.15.5:0/2477743183 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5914160450 0x7f5914144b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:36.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.853+0000 7f5918ee6640 1 --2- 172.21.15.5:0/2477743183 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f58f4066280 0x7f58f4068730 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:36.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.853+0000 7f5918ee6640 1 --2- 172.21.15.5:0/2477743183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f591415bc00 0x7f591415c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:36.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.853+0000 7f5918ee6640 1 --2- 172.21.15.5:0/2477743183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5914069430 0x7f591415c1a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:36.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.853+0000 7f5918ee6640 1 -- 172.21.15.5:0/2477743183 >> 172.21.15.5:0/2477743183 conn(0x7f59140b1840 msgr2=0x7f59140ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:36.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.853+0000 7f5918ee6640 1 -- 172.21.15.5:0/2477743183 shutdown_connections 2023-07-14T12:53:36.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:36.853+0000 7f5918ee6640 1 -- 172.21.15.5:0/2477743183 wait complete. 2023-07-14T12:53:36.912 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-07-14T12:53:37.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.029+0000 7f8c0bd00640 1 Processor -- start 2023-07-14T12:53:37.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.029+0000 7f8c0bd00640 1 -- start start 2023-07-14T12:53:37.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c0bd00640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c040c0f80 0x7f8c040cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:37.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c0bd00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c040c17d0 con 0x7f8c04160330 2023-07-14T12:53:37.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c0bd00640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c040c14f0 con 0x7f8c040c8940 2023-07-14T12:53:37.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c0bd00640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c040cdd70 con 0x7f8c040c0f80 2023-07-14T12:53:37.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c09a9c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8c04160330 0x7f8c040ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60762/0 (socket says 172.21.15.5:60762) 2023-07-14T12:53:37.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c09a9c640 1 -- 172.21.15.5:0/2381284038 learned_addr learned my addr 172.21.15.5:0/2381284038 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:37.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c0a29d640 1 --2- 172.21.15.5:0/2381284038 >> v2:172.21.15.154:3300/0 conn(0x7f8c040c0f80 0x7f8c040cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:37.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c08a9a640 1 -- 172.21.15.5:0/2381284038 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 318011191 0 0) 0x7f8c040c17d0 con 0x7f8c04160330 2023-07-14T12:53:37.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c08a9a640 1 -- 172.21.15.5:0/2381284038 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bf0003530 con 0x7f8c04160330 2023-07-14T12:53:37.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c08a9a640 1 -- 172.21.15.5:0/2381284038 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2848080385 0 0) 0x7f8c040c14f0 con 0x7f8c040c8940 2023-07-14T12:53:37.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c08a9a640 1 -- 172.21.15.5:0/2381284038 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c040c17d0 con 0x7f8c040c8940 2023-07-14T12:53:37.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c08a9a640 1 -- 172.21.15.5:0/2381284038 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4141458876 0 0) 0x7f8bf0003530 con 0x7f8c04160330 2023-07-14T12:53:37.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c08a9a640 1 -- 172.21.15.5:0/2381284038 >> v2:172.21.15.154:3300/0 conn(0x7f8c040c0f80 msgr2=0x7f8c040cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:37.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c08a9a640 1 --2- 172.21.15.5:0/2381284038 >> v2:172.21.15.154:3300/0 conn(0x7f8c040c0f80 0x7f8c040cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:37.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c08a9a640 1 -- 172.21.15.5:0/2381284038 >> v1:172.21.15.154:6789/0 conn(0x7f8c040c8940 legacy=0x7f8c040cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:37.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c08a9a640 1 -- 172.21.15.5:0/2381284038 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c040cac10 con 0x7f8c04160330 2023-07-14T12:53:37.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c08a9a640 1 -- 172.21.15.5:0/2381284038 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f8c00001680 con 0x7f8c04160330 2023-07-14T12:53:37.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c08a9a640 1 -- 172.21.15.5:0/2381284038 >> v1:172.21.15.5:6789/0 conn(0x7f8c04160330 legacy=0x7f8c040ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:37.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c08a9a640 1 --2- 172.21.15.5:0/2381284038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf0003b10 0x7f8bf0003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:37.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c08a9a640 1 --2- 172.21.15.5:0/2381284038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf00047d0 0x7f8bf0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:37.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c08a9a640 1 --2- 172.21.15.5:0/2381284038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf0005180 0x7f8bf000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:37.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c08a9a640 1 -- 172.21.15.5:0/2381284038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040cdd70 con 0x7f8bf00047d0 2023-07-14T12:53:37.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c08a9a640 1 -- 172.21.15.5:0/2381284038 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf000bf80 con 0x7f8bf0005180 2023-07-14T12:53:37.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c08a9a640 1 -- 172.21.15.5:0/2381284038 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf000c110 con 0x7f8bf0003b10 2023-07-14T12:53:37.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c0929b640 1 --2- 172.21.15.5:0/2381284038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf00047d0 0x7f8bf0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:37.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c0a29d640 1 --2- 172.21.15.5:0/2381284038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf0005180 0x7f8bf000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:37.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c09a9c640 1 --2- 172.21.15.5:0/2381284038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf0003b10 0x7f8bf0003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:37.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c0929b640 1 -- 172.21.15.5:0/2381284038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf0003b10 msgr2=0x7f8bf0003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:37.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c0929b640 1 --2- 172.21.15.5:0/2381284038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf0003b10 0x7f8bf0003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:37.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c0929b640 1 -- 172.21.15.5:0/2381284038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf0005180 msgr2=0x7f8bf000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:37.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c0929b640 1 --2- 172.21.15.5:0/2381284038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf0005180 0x7f8bf000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:37.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c0929b640 1 -- 172.21.15.5:0/2381284038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf0003530 con 0x7f8bf00047d0 2023-07-14T12:53:37.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.033+0000 7f8c0a29d640 1 -- 172.21.15.5:0/2381284038 reap_dead start 2023-07-14T12:53:37.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.037+0000 7f8c0929b640 1 --2- 172.21.15.5:0/2381284038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf00047d0 0x7f8bf0004c40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8bf40018d0 tx=0x7f8bf401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d55ab68c17a5d3ce server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:37.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.037+0000 7f8c08a9a640 1 -- 172.21.15.5:0/2381284038 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c00007ea0 con 0x7f8bf00047d0 2023-07-14T12:53:37.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.037+0000 7f8c08a9a640 1 -- 172.21.15.5:0/2381284038 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf40a7070 con 0x7f8bf00047d0 2023-07-14T12:53:37.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.037+0000 7f8c08a9a640 1 -- 172.21.15.5:0/2381284038 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4003600 con 0x7f8bf00047d0 2023-07-14T12:53:37.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.037+0000 7f8c0bd00640 1 -- 172.21.15.5:0/2381284038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf00047d0 msgr2=0x7f8bf0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:37.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.037+0000 7f8c0bd00640 1 --2- 172.21.15.5:0/2381284038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf00047d0 0x7f8bf0004c40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8bf40018d0 tx=0x7f8bf401c500 comp rx=0 tx=0).stop 2023-07-14T12:53:37.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.037+0000 7f8c0bd00640 1 -- 172.21.15.5:0/2381284038 shutdown_connections 2023-07-14T12:53:37.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.037+0000 7f8c0bd00640 1 --2- 172.21.15.5:0/2381284038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf00047d0 0x7f8bf0004c40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:37.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.037+0000 7f8c0bd00640 1 -- 172.21.15.5:0/2381284038 >> 172.21.15.5:0/2381284038 conn(0x7f8c040afcf0 msgr2=0x7f8c040b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:37.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.037+0000 7f8c0bd00640 1 -- 172.21.15.5:0/2381284038 shutdown_connections 2023-07-14T12:53:37.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.037+0000 7f8c0bd00640 1 -- 172.21.15.5:0/2381284038 wait complete. 2023-07-14T12:53:37.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.037+0000 7f8c0bd00640 1 Processor -- start 2023-07-14T12:53:37.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.041+0000 7f8c0bd00640 1 -- start start 2023-07-14T12:53:37.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.041+0000 7f8c0bd00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf00047d0 0x7f8c040c2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:37.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.041+0000 7f8c0bd00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c040c5490 0x7f8c041481a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:37.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.041+0000 7f8c0bd00640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c040c5900 0x7f8c041486e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:37.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.041+0000 7f8c0bd00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040c47a0 con 0x7f8c040c5490 2023-07-14T12:53:37.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.041+0000 7f8c0bd00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040c3700 con 0x7f8bf00047d0 2023-07-14T12:53:37.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.041+0000 7f8c0bd00640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040c39e0 con 0x7f8c040c5900 2023-07-14T12:53:37.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.041+0000 7f8c0929b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c040c5490 0x7f8c041481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:37.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.041+0000 7f8c0929b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c040c5490 0x7f8c041481a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44730/0 (socket says 172.21.15.5:44730) 2023-07-14T12:53:37.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.041+0000 7f8c0929b640 1 -- 172.21.15.5:0/413187112 learned_addr learned my addr 172.21.15.5:0/413187112 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:37.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.041+0000 7f8c09a9c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf00047d0 0x7f8c040c2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:37.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.041+0000 7f8c0a29d640 1 --2- 172.21.15.5:0/413187112 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c040c5900 0x7f8c041486e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:37.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.041+0000 7f8c0929b640 1 -- 172.21.15.5:0/413187112 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c040c5900 msgr2=0x7f8c041486e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:37.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.041+0000 7f8c0929b640 1 --2- 172.21.15.5:0/413187112 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c040c5900 0x7f8c041486e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:37.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.041+0000 7f8c0929b640 1 -- 172.21.15.5:0/413187112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf00047d0 msgr2=0x7f8c040c2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:37.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.041+0000 7f8c0929b640 1 --2- 172.21.15.5:0/413187112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf00047d0 0x7f8c040c2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:37.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.041+0000 7f8c0929b640 1 -- 172.21.15.5:0/413187112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c040c3cc0 con 0x7f8c040c5490 2023-07-14T12:53:37.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.041+0000 7f8c0929b640 1 --2- 172.21.15.5:0/413187112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c040c5490 0x7f8c041481a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8bf40ae040 tx=0x7f8bf0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:37.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.041+0000 7f8bfa7fc640 1 -- 172.21.15.5:0/413187112 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40069e0 con 0x7f8c040c5490 2023-07-14T12:53:37.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.041+0000 7f8bfa7fc640 1 -- 172.21.15.5:0/413187112 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf4006b40 con 0x7f8c040c5490 2023-07-14T12:53:37.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.041+0000 7f8c0bd00640 1 -- 172.21.15.5:0/413187112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c040c3fa0 con 0x7f8c040c5490 2023-07-14T12:53:37.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.041+0000 7f8bfa7fc640 1 -- 172.21.15.5:0/413187112 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4007030 con 0x7f8c040c5490 2023-07-14T12:53:37.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.041+0000 7f8c0bd00640 1 -- 172.21.15.5:0/413187112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c040c3310 con 0x7f8c040c5490 2023-07-14T12:53:37.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.041+0000 7f8c0bd00640 1 -- 172.21.15.5:0/413187112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c040678d0 con 0x7f8c040c5490 2023-07-14T12:53:37.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.045+0000 7f8bfa7fc640 1 -- 172.21.15.5:0/413187112 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8bf40b2040 con 0x7f8c040c5490 2023-07-14T12:53:37.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.045+0000 7f8bfa7fc640 1 --2- 172.21.15.5:0/413187112 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f8be80662b0 0x7f8be8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:37.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.045+0000 7f8bfa7fc640 1 -- 172.21.15.5:0/413187112 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8bf411c450 con 0x7f8c040c5490 2023-07-14T12:53:37.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.045+0000 7f8c09a9c640 1 --2- 172.21.15.5:0/413187112 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f8be80662b0 0x7f8be8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:37.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.045+0000 7f8c09a9c640 1 --2- 172.21.15.5:0/413187112 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f8be80662b0 0x7f8be8068760 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8c00000c10 tx=0x7f8c00001e10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:37.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.049+0000 7f8bfa7fc640 1 -- 172.21.15.5:0/413187112 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f8bf40e9c30 con 0x7f8c040c5490 2023-07-14T12:53:37.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.257+0000 7f8c0bd00640 1 -- 172.21.15.5:0/413187112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f8c040adde0 con 0x7f8c040c5490 2023-07-14T12:53:37.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.261+0000 7f8bfa7fc640 1 -- 172.21.15.5:0/413187112 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8bf40ed250 con 0x7f8c040c5490 2023-07-14T12:53:37.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.265+0000 7f8c0bd00640 1 -- 172.21.15.5:0/413187112 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f8be80662b0 msgr2=0x7f8be8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:37.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.265+0000 7f8c0bd00640 1 --2- 172.21.15.5:0/413187112 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f8be80662b0 0x7f8be8068760 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8c00000c10 tx=0x7f8c00001e10 comp rx=0 tx=0).stop 2023-07-14T12:53:37.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.265+0000 7f8c0bd00640 1 -- 172.21.15.5:0/413187112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c040c5490 msgr2=0x7f8c041481a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:37.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.265+0000 7f8c0bd00640 1 --2- 172.21.15.5:0/413187112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c040c5490 0x7f8c041481a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8bf40ae040 tx=0x7f8bf0005800 comp rx=0 tx=0).stop 2023-07-14T12:53:37.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.265+0000 7f8c0bd00640 1 -- 172.21.15.5:0/413187112 shutdown_connections 2023-07-14T12:53:37.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.265+0000 7f8c0bd00640 1 --2- 172.21.15.5:0/413187112 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c040c5900 0x7f8c041486e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:37.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.265+0000 7f8c0bd00640 1 --2- 172.21.15.5:0/413187112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c040c5490 0x7f8c041481a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:37.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.265+0000 7f8c0bd00640 1 --2- 172.21.15.5:0/413187112 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f8be80662b0 0x7f8be8068760 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:37.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.265+0000 7f8c0bd00640 1 --2- 172.21.15.5:0/413187112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf00047d0 0x7f8c040c2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:37.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.265+0000 7f8c0bd00640 1 -- 172.21.15.5:0/413187112 >> 172.21.15.5:0/413187112 conn(0x7f8c040afcf0 msgr2=0x7f8c0406f330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:37.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.265+0000 7f8c0bd00640 1 -- 172.21.15.5:0/413187112 shutdown_connections 2023-07-14T12:53:37.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.265+0000 7f8c0bd00640 1 -- 172.21.15.5:0/413187112 wait complete. 2023-07-14T12:53:37.311 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-07-14T12:53:37.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.429+0000 7f0a429c4640 1 Processor -- start 2023-07-14T12:53:37.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.429+0000 7f0a429c4640 1 -- start start 2023-07-14T12:53:37.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.429+0000 7f0a429c4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a3c15f3f0 0x7f0a3c0b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:37.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.429+0000 7f0a429c4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0a3c0d13f0 0x7f0a3c0b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:37.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.429+0000 7f0a429c4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a3c0d0f60 con 0x7f0a3c0cc9a0 2023-07-14T12:53:37.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.429+0000 7f0a429c4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a3c0cd4e0 con 0x7f0a3c0d13f0 2023-07-14T12:53:37.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.429+0000 7f0a429c4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c0d0390 con 0x7f0a3c15f3f0 2023-07-14T12:53:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.429+0000 7f0a419c2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a3c15f3f0 0x7f0a3c0b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.429+0000 7f0a411c1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0a3c0d13f0 0x7f0a3c0b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.429+0000 7f0a421c3640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0a3c0cc9a0 0x7f0a3c0ccdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:42370/0 (socket says 172.21.15.5:42370) 2023-07-14T12:53:37.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.429+0000 7f0a411c1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0a3c0d13f0 0x7f0a3c0b7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:44326/0 (socket says 172.21.15.5:44326) 2023-07-14T12:53:37.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.429+0000 7f0a421c3640 1 -- 172.21.15.5:0/1693483214 learned_addr learned my addr 172.21.15.5:0/1693483214 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:37.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.429+0000 7f0a411c1640 1 -- 172.21.15.5:0/1693483214 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a3c15f3f0 msgr2=0x7f0a3c0b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:37.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.429+0000 7f0a411c1640 1 --2- 172.21.15.5:0/1693483214 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a3c15f3f0 0x7f0a3c0b7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:37.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.429+0000 7f0a411c1640 1 -- 172.21.15.5:0/1693483214 >> v1:172.21.15.154:6789/0 conn(0x7f0a3c0cc9a0 legacy=0x7f0a3c0ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:37.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.429+0000 7f0a411c1640 1 -- 172.21.15.5:0/1693483214 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c0d0630 con 0x7f0a3c0d13f0 2023-07-14T12:53:37.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.429+0000 7f0a419c2640 1 --2- 172.21.15.5:0/1693483214 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a3c15f3f0 0x7f0a3c0b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:53:37.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.429+0000 7f0a409c0640 1 -- 172.21.15.5:0/1693483214 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036571614 0 0) 0x7f0a3c0d0f60 con 0x7f0a3c0cc9a0 2023-07-14T12:53:37.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.433+0000 7f0a411c1640 1 --2- 172.21.15.5:0/1693483214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a3c0d13f0 0x7f0a3c0b7bc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c0097c0 tx=0x7f0a2c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb870098ea57d87c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:37.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.433+0000 7f0a409c0640 1 -- 172.21.15.5:0/1693483214 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c0ab600 con 0x7f0a3c0d13f0 2023-07-14T12:53:37.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.433+0000 7f0a409c0640 1 -- 172.21.15.5:0/1693483214 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2c0a7050 con 0x7f0a3c0d13f0 2023-07-14T12:53:37.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.433+0000 7f0a409c0640 1 -- 172.21.15.5:0/1693483214 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c0ab980 con 0x7f0a3c0d13f0 2023-07-14T12:53:37.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.433+0000 7f0a429c4640 1 -- 172.21.15.5:0/1693483214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a3c0d13f0 msgr2=0x7f0a3c0b7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:37.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.433+0000 7f0a429c4640 1 --2- 172.21.15.5:0/1693483214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a3c0d13f0 0x7f0a3c0b7bc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c0097c0 tx=0x7f0a2c01c3f0 comp rx=0 tx=0).stop 2023-07-14T12:53:37.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.433+0000 7f0a429c4640 1 -- 172.21.15.5:0/1693483214 shutdown_connections 2023-07-14T12:53:37.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.433+0000 7f0a429c4640 1 --2- 172.21.15.5:0/1693483214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a3c0d13f0 0x7f0a3c0b7bc0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:37.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.433+0000 7f0a429c4640 1 --2- 172.21.15.5:0/1693483214 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a3c15f3f0 0x7f0a3c0b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:37.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.433+0000 7f0a429c4640 1 -- 172.21.15.5:0/1693483214 >> 172.21.15.5:0/1693483214 conn(0x7f0a3c069f50 msgr2=0x7f0a3c06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:37.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.433+0000 7f0a429c4640 1 -- 172.21.15.5:0/1693483214 shutdown_connections 2023-07-14T12:53:37.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.433+0000 7f0a429c4640 1 -- 172.21.15.5:0/1693483214 wait complete. 2023-07-14T12:53:37.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.437+0000 7f0a429c4640 1 Processor -- start 2023-07-14T12:53:37.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.437+0000 7f0a429c4640 1 -- start start 2023-07-14T12:53:37.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.437+0000 7f0a429c4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a3c0cc9a0 0x7f0a3c0c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:37.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.437+0000 7f0a429c4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a3c0d13f0 0x7f0a3c152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:37.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.437+0000 7f0a429c4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a3c15f3f0 0x7f0a3c15b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:37.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.437+0000 7f0a429c4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c153060 con 0x7f0a3c0d13f0 2023-07-14T12:53:37.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.437+0000 7f0a429c4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c153340 con 0x7f0a3c0cc9a0 2023-07-14T12:53:37.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.437+0000 7f0a429c4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c153620 con 0x7f0a3c15f3f0 2023-07-14T12:53:37.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.437+0000 7f0a411c1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a3c0d13f0 0x7f0a3c152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:37.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.437+0000 7f0a411c1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a3c0d13f0 0x7f0a3c152070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44732/0 (socket says 172.21.15.5:44732) 2023-07-14T12:53:37.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.437+0000 7f0a411c1640 1 -- 172.21.15.5:0/1698112147 learned_addr learned my addr 172.21.15.5:0/1698112147 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:37.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.437+0000 7f0a419c2640 1 --2- 172.21.15.5:0/1698112147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a3c0cc9a0 0x7f0a3c0c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:37.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.437+0000 7f0a421c3640 1 --2- 172.21.15.5:0/1698112147 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a3c15f3f0 0x7f0a3c15b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:37.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.437+0000 7f0a411c1640 1 -- 172.21.15.5:0/1698112147 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a3c15f3f0 msgr2=0x7f0a3c15b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:37.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.437+0000 7f0a411c1640 1 --2- 172.21.15.5:0/1698112147 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a3c15f3f0 0x7f0a3c15b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:37.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.437+0000 7f0a411c1640 1 -- 172.21.15.5:0/1698112147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a3c0cc9a0 msgr2=0x7f0a3c0c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:37.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.437+0000 7f0a411c1640 1 --2- 172.21.15.5:0/1698112147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a3c0cc9a0 0x7f0a3c0c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:37.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.437+0000 7f0a411c1640 1 -- 172.21.15.5:0/1698112147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a38009420 con 0x7f0a3c0d13f0 2023-07-14T12:53:37.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.437+0000 7f0a411c1640 1 --2- 172.21.15.5:0/1698112147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a3c0d13f0 0x7f0a3c152070 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c01a020 tx=0x7f0a2c019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:37.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.437+0000 7f0a327fc640 1 -- 172.21.15.5:0/1698112147 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c0b4400 con 0x7f0a3c0d13f0 2023-07-14T12:53:37.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.437+0000 7f0a327fc640 1 -- 172.21.15.5:0/1698112147 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2c0b4560 con 0x7f0a3c0d13f0 2023-07-14T12:53:37.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.437+0000 7f0a327fc640 1 -- 172.21.15.5:0/1698112147 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c0b4910 con 0x7f0a3c0d13f0 2023-07-14T12:53:37.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.437+0000 7f0a429c4640 1 -- 172.21.15.5:0/1698112147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a2c009420 con 0x7f0a3c0d13f0 2023-07-14T12:53:37.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.437+0000 7f0a429c4640 1 -- 172.21.15.5:0/1698112147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a3c153be0 con 0x7f0a3c0d13f0 2023-07-14T12:53:37.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.441+0000 7f0a429c4640 1 -- 172.21.15.5:0/1698112147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a3c153dd0 con 0x7f0a3c0d13f0 2023-07-14T12:53:37.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.441+0000 7f0a327fc640 1 -- 172.21.15.5:0/1698112147 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0a2c0b2040 con 0x7f0a3c0d13f0 2023-07-14T12:53:37.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.441+0000 7f0a327fc640 1 --2- 172.21.15.5:0/1698112147 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f0a20066280 0x7f0a20068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:37.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.441+0000 7f0a327fc640 1 -- 172.21.15.5:0/1698112147 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0a2c11d4d0 con 0x7f0a3c0d13f0 2023-07-14T12:53:37.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.441+0000 7f0a419c2640 1 --2- 172.21.15.5:0/1698112147 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f0a20066280 0x7f0a20068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:37.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.441+0000 7f0a419c2640 1 --2- 172.21.15.5:0/1698112147 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f0a20066280 0x7f0a20068730 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009c50 tx=0x7f0a38009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:37.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.445+0000 7f0a327fc640 1 -- 172.21.15.5:0/1698112147 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f0a2c0eacb0 con 0x7f0a3c0d13f0 2023-07-14T12:53:37.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.657+0000 7f0a429c4640 1 -- 172.21.15.5:0/1698112147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f0a3c0678d0 con 0x7f0a3c0d13f0 2023-07-14T12:53:37.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.665+0000 7f0a327fc640 1 -- 172.21.15.5:0/1698112147 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0a2c0ee2d0 con 0x7f0a3c0d13f0 2023-07-14T12:53:37.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.665+0000 7f0a429c4640 1 -- 172.21.15.5:0/1698112147 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f0a20066280 msgr2=0x7f0a20068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:37.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.665+0000 7f0a429c4640 1 --2- 172.21.15.5:0/1698112147 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f0a20066280 0x7f0a20068730 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009c50 tx=0x7f0a38009190 comp rx=0 tx=0).stop 2023-07-14T12:53:37.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.665+0000 7f0a429c4640 1 -- 172.21.15.5:0/1698112147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a3c0d13f0 msgr2=0x7f0a3c152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:37.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.665+0000 7f0a429c4640 1 --2- 172.21.15.5:0/1698112147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a3c0d13f0 0x7f0a3c152070 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c01a020 tx=0x7f0a2c019190 comp rx=0 tx=0).stop 2023-07-14T12:53:37.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.665+0000 7f0a429c4640 1 -- 172.21.15.5:0/1698112147 shutdown_connections 2023-07-14T12:53:37.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.665+0000 7f0a429c4640 1 --2- 172.21.15.5:0/1698112147 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a3c15f3f0 0x7f0a3c15b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:37.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.665+0000 7f0a429c4640 1 --2- 172.21.15.5:0/1698112147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a3c0d13f0 0x7f0a3c152070 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:37.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.665+0000 7f0a429c4640 1 --2- 172.21.15.5:0/1698112147 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f0a20066280 0x7f0a20068730 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:37.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.665+0000 7f0a429c4640 1 --2- 172.21.15.5:0/1698112147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a3c0cc9a0 0x7f0a3c0c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:37.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.665+0000 7f0a429c4640 1 -- 172.21.15.5:0/1698112147 >> 172.21.15.5:0/1698112147 conn(0x7f0a3c069f50 msgr2=0x7f0a3c06a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:37.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.665+0000 7f0a429c4640 1 -- 172.21.15.5:0/1698112147 shutdown_connections 2023-07-14T12:53:37.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.665+0000 7f0a429c4640 1 -- 172.21.15.5:0/1698112147 wait complete. 2023-07-14T12:53:37.712 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-07-14T12:53:37.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.829+0000 7ff150c68640 1 Processor -- start 2023-07-14T12:53:37.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.829+0000 7ff150c68640 1 -- start start 2023-07-14T12:53:37.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.829+0000 7ff150c68640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff14c15f3f0 0x7ff14c0b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:37.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.829+0000 7ff150c68640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff14c0d13f0 0x7ff14c0b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:37.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.829+0000 7ff150c68640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff14c0cc9a0 0x7ff14c0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:37.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.829+0000 7ff150c68640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14c0d0f60 con 0x7ff14c0cc9a0 2023-07-14T12:53:37.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.829+0000 7ff150c68640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14c0d0390 con 0x7ff14c0d13f0 2023-07-14T12:53:37.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.829+0000 7ff150c68640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c0d0630 con 0x7ff14c15f3f0 2023-07-14T12:53:37.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.829+0000 7ff14bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff14c0cc9a0 0x7ff14c0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:37.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.829+0000 7ff14bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff14c0cc9a0 0x7ff14c0ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44734/0 (socket says 172.21.15.5:44734) 2023-07-14T12:53:37.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.829+0000 7ff14bfff640 1 -- 172.21.15.5:0/2113234551 learned_addr learned my addr 172.21.15.5:0/2113234551 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:37.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.829+0000 7ff14affd640 1 --2- 172.21.15.5:0/2113234551 >> v2:172.21.15.154:3300/0 conn(0x7ff14c0d13f0 0x7ff14c0b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:37.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.829+0000 7ff14b7fe640 1 --2- 172.21.15.5:0/2113234551 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff14c15f3f0 0x7ff14c0b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:37.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.829+0000 7ff14bfff640 1 -- 172.21.15.5:0/2113234551 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff14c15f3f0 msgr2=0x7ff14c0b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:37.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.829+0000 7ff14bfff640 1 --2- 172.21.15.5:0/2113234551 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff14c15f3f0 0x7ff14c0b7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:37.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.829+0000 7ff14bfff640 1 -- 172.21.15.5:0/2113234551 >> v2:172.21.15.154:3300/0 conn(0x7ff14c0d13f0 msgr2=0x7ff14c0b7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:37.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.829+0000 7ff14bfff640 1 --2- 172.21.15.5:0/2113234551 >> v2:172.21.15.154:3300/0 conn(0x7ff14c0d13f0 0x7ff14c0b7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:37.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.829+0000 7ff14bfff640 1 -- 172.21.15.5:0/2113234551 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c0d0910 con 0x7ff14c0cc9a0 2023-07-14T12:53:37.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.829+0000 7ff14b7fe640 1 --2- 172.21.15.5:0/2113234551 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff14c15f3f0 0x7ff14c0b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:37.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.829+0000 7ff14affd640 1 --2- 172.21.15.5:0/2113234551 >> v2:172.21.15.154:3300/0 conn(0x7ff14c0d13f0 0x7ff14c0b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:37.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.833+0000 7ff14bfff640 1 --2- 172.21.15.5:0/2113234551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff14c0cc9a0 0x7ff14c0ccdd0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff14c066090 tx=0x7ff14401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4cde8d001ab78f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:37.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.833+0000 7ff14a7fc640 1 -- 172.21.15.5:0/2113234551 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1440a5640 con 0x7ff14c0cc9a0 2023-07-14T12:53:37.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.833+0000 7ff14a7fc640 1 -- 172.21.15.5:0/2113234551 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1440a57a0 con 0x7ff14c0cc9a0 2023-07-14T12:53:37.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.833+0000 7ff14a7fc640 1 -- 172.21.15.5:0/2113234551 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1440a5b30 con 0x7ff14c0cc9a0 2023-07-14T12:53:37.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.833+0000 7ff150c68640 1 -- 172.21.15.5:0/2113234551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff14c0cc9a0 msgr2=0x7ff14c0ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:37.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.833+0000 7ff150c68640 1 --2- 172.21.15.5:0/2113234551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff14c0cc9a0 0x7ff14c0ccdd0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff14c066090 tx=0x7ff14401c940 comp rx=0 tx=0).stop 2023-07-14T12:53:37.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.833+0000 7ff150c68640 1 -- 172.21.15.5:0/2113234551 shutdown_connections 2023-07-14T12:53:37.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.833+0000 7ff150c68640 1 --2- 172.21.15.5:0/2113234551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff14c0cc9a0 0x7ff14c0ccdd0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:37.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.833+0000 7ff150c68640 1 --2- 172.21.15.5:0/2113234551 >> v2:172.21.15.154:3300/0 conn(0x7ff14c0d13f0 0x7ff14c0b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:37.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.833+0000 7ff150c68640 1 --2- 172.21.15.5:0/2113234551 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff14c15f3f0 0x7ff14c0b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:37.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.833+0000 7ff150c68640 1 -- 172.21.15.5:0/2113234551 >> 172.21.15.5:0/2113234551 conn(0x7ff14c069f50 msgr2=0x7ff14c06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:37.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.833+0000 7ff150c68640 1 -- 172.21.15.5:0/2113234551 shutdown_connections 2023-07-14T12:53:37.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.833+0000 7ff150c68640 1 -- 172.21.15.5:0/2113234551 wait complete. 2023-07-14T12:53:37.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.837+0000 7ff150c68640 1 Processor -- start 2023-07-14T12:53:37.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.837+0000 7ff150c68640 1 -- start start 2023-07-14T12:53:37.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.837+0000 7ff150c68640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff14c0cc9a0 0x7ff14c0ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:37.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.837+0000 7ff150c68640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff14c0d13f0 0x7ff14c150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:37.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.837+0000 7ff150c68640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff14c15f3f0 0x7ff14c1511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:37.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.837+0000 7ff150c68640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c1f81e0 con 0x7ff14c0cc9a0 2023-07-14T12:53:37.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.837+0000 7ff150c68640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c1f84c0 con 0x7ff14c0d13f0 2023-07-14T12:53:37.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.837+0000 7ff150c68640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c1f87a0 con 0x7ff14c15f3f0 2023-07-14T12:53:37.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.837+0000 7ff14b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff14c0cc9a0 0x7ff14c0ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:37.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.837+0000 7ff14b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff14c0cc9a0 0x7ff14c0ca7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44742/0 (socket says 172.21.15.5:44742) 2023-07-14T12:53:37.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.837+0000 7ff14b7fe640 1 -- 172.21.15.5:0/4036788685 learned_addr learned my addr 172.21.15.5:0/4036788685 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:37.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.837+0000 7ff14affd640 1 --2- 172.21.15.5:0/4036788685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff14c0d13f0 0x7ff14c150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:37.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.837+0000 7ff14bfff640 1 --2- 172.21.15.5:0/4036788685 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff14c15f3f0 0x7ff14c1511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:37.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.837+0000 7ff14b7fe640 1 -- 172.21.15.5:0/4036788685 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff14c15f3f0 msgr2=0x7ff14c1511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:37.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.837+0000 7ff14b7fe640 1 --2- 172.21.15.5:0/4036788685 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff14c15f3f0 0x7ff14c1511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:37.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.837+0000 7ff14b7fe640 1 -- 172.21.15.5:0/4036788685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff14c0d13f0 msgr2=0x7ff14c150240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:37.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.837+0000 7ff14b7fe640 1 --2- 172.21.15.5:0/4036788685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff14c0d13f0 0x7ff14c150240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:37.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.837+0000 7ff14b7fe640 1 -- 172.21.15.5:0/4036788685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff144009b30 con 0x7ff14c0cc9a0 2023-07-14T12:53:37.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.837+0000 7ff14bfff640 1 --2- 172.21.15.5:0/4036788685 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff14c15f3f0 0x7ff14c1511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:37.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.837+0000 7ff14b7fe640 1 --2- 172.21.15.5:0/4036788685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff14c0cc9a0 0x7ff14c0ca7e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff13c00c7f0 tx=0x7ff13c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:37.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.837+0000 7ff133fff640 1 -- 172.21.15.5:0/4036788685 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c007820 con 0x7ff14c0cc9a0 2023-07-14T12:53:37.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.837+0000 7ff133fff640 1 -- 172.21.15.5:0/4036788685 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13c007980 con 0x7ff14c0cc9a0 2023-07-14T12:53:37.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.837+0000 7ff133fff640 1 -- 172.21.15.5:0/4036788685 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c007d30 con 0x7ff14c0cc9a0 2023-07-14T12:53:37.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.837+0000 7ff150c68640 1 -- 172.21.15.5:0/4036788685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14c1f8a80 con 0x7ff14c0cc9a0 2023-07-14T12:53:37.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.837+0000 7ff150c68640 1 -- 172.21.15.5:0/4036788685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14c1f7e90 con 0x7ff14c0cc9a0 2023-07-14T12:53:37.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.841+0000 7ff150c68640 1 -- 172.21.15.5:0/4036788685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff14c0678d0 con 0x7ff14c0cc9a0 2023-07-14T12:53:37.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.841+0000 7ff133fff640 1 -- 172.21.15.5:0/4036788685 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff13c0113f0 con 0x7ff14c0cc9a0 2023-07-14T12:53:37.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.841+0000 7ff133fff640 1 --2- 172.21.15.5:0/4036788685 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff138066280 0x7ff138068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:37.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.841+0000 7ff133fff640 1 -- 172.21.15.5:0/4036788685 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff13c083d40 con 0x7ff14c0cc9a0 2023-07-14T12:53:37.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.841+0000 7ff14affd640 1 --2- 172.21.15.5:0/4036788685 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff138066280 0x7ff138068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:37.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.841+0000 7ff14affd640 1 --2- 172.21.15.5:0/4036788685 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff138066280 0x7ff138068730 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0b7440 tx=0x7ff140008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:37.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:37.845+0000 7ff133fff640 1 -- 172.21.15.5:0/4036788685 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff13c051520 con 0x7ff14c0cc9a0 2023-07-14T12:53:38.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.053+0000 7ff150c68640 1 -- 172.21.15.5:0/4036788685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7ff14c1f4910 con 0x7ff14c0cc9a0 2023-07-14T12:53:38.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.057+0000 7ff133fff640 1 -- 172.21.15.5:0/4036788685 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff13c01f0a0 con 0x7ff14c0cc9a0 2023-07-14T12:53:38.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.061+0000 7ff150c68640 1 -- 172.21.15.5:0/4036788685 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff138066280 msgr2=0x7ff138068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:38.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.061+0000 7ff150c68640 1 --2- 172.21.15.5:0/4036788685 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff138066280 0x7ff138068730 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0b7440 tx=0x7ff140008040 comp rx=0 tx=0).stop 2023-07-14T12:53:38.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.061+0000 7ff150c68640 1 -- 172.21.15.5:0/4036788685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff14c0cc9a0 msgr2=0x7ff14c0ca7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:38.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.061+0000 7ff150c68640 1 --2- 172.21.15.5:0/4036788685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff14c0cc9a0 0x7ff14c0ca7e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff13c00c7f0 tx=0x7ff13c00ccb0 comp rx=0 tx=0).stop 2023-07-14T12:53:38.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.061+0000 7ff150c68640 1 -- 172.21.15.5:0/4036788685 shutdown_connections 2023-07-14T12:53:38.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.061+0000 7ff150c68640 1 --2- 172.21.15.5:0/4036788685 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff14c15f3f0 0x7ff14c1511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:38.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.061+0000 7ff150c68640 1 --2- 172.21.15.5:0/4036788685 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff138066280 0x7ff138068730 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:38.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.061+0000 7ff150c68640 1 --2- 172.21.15.5:0/4036788685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff14c0d13f0 0x7ff14c150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:38.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.061+0000 7ff150c68640 1 --2- 172.21.15.5:0/4036788685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff14c0cc9a0 0x7ff14c0ca7e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:38.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.061+0000 7ff150c68640 1 -- 172.21.15.5:0/4036788685 >> 172.21.15.5:0/4036788685 conn(0x7ff14c069f50 msgr2=0x7ff14c0b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:38.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.061+0000 7ff150c68640 1 -- 172.21.15.5:0/4036788685 shutdown_connections 2023-07-14T12:53:38.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.061+0000 7ff150c68640 1 -- 172.21.15.5:0/4036788685 wait complete. 2023-07-14T12:53:38.108 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-07-14T12:53:38.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.225+0000 7fe6d1167640 1 Processor -- start 2023-07-14T12:53:38.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.225+0000 7fe6d1167640 1 -- start start 2023-07-14T12:53:38.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.225+0000 7fe6d1167640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe6cc06a670 0x7fe6cc15d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:38.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.225+0000 7fe6d1167640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6cc06aac0 0x7fe6cc15daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:38.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.225+0000 7fe6d1167640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6cc0695d0 con 0x7fe6cc159a00 2023-07-14T12:53:38.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.225+0000 7fe6d1167640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6cc06e720 con 0x7fe6cc06a670 2023-07-14T12:53:38.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.225+0000 7fe6d1167640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc0698b0 con 0x7fe6cc06aac0 2023-07-14T12:53:38.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.225+0000 7fe6cad9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe6cc159a00 0x7fe6cc06e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60766/0 (socket says 172.21.15.5:60766) 2023-07-14T12:53:38.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.225+0000 7fe6cad9d640 1 -- 172.21.15.5:0/3324479025 learned_addr learned my addr 172.21.15.5:0/3324479025 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:38.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.225+0000 7fe6c3fff640 1 --2- 172.21.15.5:0/3324479025 >> v2:172.21.15.154:3300/0 conn(0x7fe6cc06a670 0x7fe6cc15d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:38.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.225+0000 7fe6cb59e640 1 --2- 172.21.15.5:0/3324479025 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6cc06aac0 0x7fe6cc15daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:38.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.229+0000 7fe6ca59c640 1 -- 172.21.15.5:0/3324479025 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008117821 0 0) 0x7fe6cc0695d0 con 0x7fe6cc159a00 2023-07-14T12:53:38.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.229+0000 7fe6ca59c640 1 -- 172.21.15.5:0/3324479025 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6b8003530 con 0x7fe6cc159a00 2023-07-14T12:53:38.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.229+0000 7fe6cb59e640 1 -- 172.21.15.5:0/3324479025 >> v2:172.21.15.154:3300/0 conn(0x7fe6cc06a670 msgr2=0x7fe6cc15d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:38.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.229+0000 7fe6ca59c640 1 -- 172.21.15.5:0/3324479025 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1823682949 0 0) 0x7fe6b8003530 con 0x7fe6cc159a00 2023-07-14T12:53:38.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.229+0000 7fe6cb59e640 1 --2- 172.21.15.5:0/3324479025 >> v2:172.21.15.154:3300/0 conn(0x7fe6cc06a670 0x7fe6cc15d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:38.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.229+0000 7fe6cb59e640 1 -- 172.21.15.5:0/3324479025 >> v1:172.21.15.5:6789/0 conn(0x7fe6cc159a00 legacy=0x7fe6cc06e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:38.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.229+0000 7fe6cb59e640 1 -- 172.21.15.5:0/3324479025 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6cc069b90 con 0x7fe6cc06aac0 2023-07-14T12:53:38.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.229+0000 7fe6c3fff640 1 --2- 172.21.15.5:0/3324479025 >> v2:172.21.15.154:3300/0 conn(0x7fe6cc06a670 0x7fe6cc15d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:53:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.229+0000 7fe6cb59e640 1 --2- 172.21.15.5:0/3324479025 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6cc06aac0 0x7fe6cc15daf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4009d90 tx=0x7fe6c401c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba2227cbc83fb116 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:38.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.229+0000 7fe6ca59c640 1 -- 172.21.15.5:0/3324479025 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc001680 con 0x7fe6cc06aac0 2023-07-14T12:53:38.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.229+0000 7fe6ca59c640 1 -- 172.21.15.5:0/3324479025 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c40a5640 con 0x7fe6cc06aac0 2023-07-14T12:53:38.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.229+0000 7fe6ca59c640 1 -- 172.21.15.5:0/3324479025 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c40a59d0 con 0x7fe6cc06aac0 2023-07-14T12:53:38.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.233+0000 7fe6d1167640 1 -- 172.21.15.5:0/3324479025 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6cc06aac0 msgr2=0x7fe6cc15daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:38.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.233+0000 7fe6d1167640 1 --2- 172.21.15.5:0/3324479025 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6cc06aac0 0x7fe6cc15daf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4009d90 tx=0x7fe6c401c840 comp rx=0 tx=0).stop 2023-07-14T12:53:38.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.233+0000 7fe6d1167640 1 -- 172.21.15.5:0/3324479025 shutdown_connections 2023-07-14T12:53:38.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.233+0000 7fe6d1167640 1 --2- 172.21.15.5:0/3324479025 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6cc06aac0 0x7fe6cc15daf0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:38.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.233+0000 7fe6d1167640 1 --2- 172.21.15.5:0/3324479025 >> v2:172.21.15.154:3300/0 conn(0x7fe6cc06a670 0x7fe6cc15d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:38.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.233+0000 7fe6d1167640 1 -- 172.21.15.5:0/3324479025 >> 172.21.15.5:0/3324479025 conn(0x7fe6cc0b1300 msgr2=0x7fe6cc0ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:38.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.233+0000 7fe6d1167640 1 -- 172.21.15.5:0/3324479025 shutdown_connections 2023-07-14T12:53:38.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.233+0000 7fe6d1167640 1 -- 172.21.15.5:0/3324479025 wait complete. 2023-07-14T12:53:38.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.233+0000 7fe6d1167640 1 Processor -- start 2023-07-14T12:53:38.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.233+0000 7fe6d1167640 1 -- start start 2023-07-14T12:53:38.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.233+0000 7fe6d1167640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6cc06a670 0x7fe6cc141d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:38.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.233+0000 7fe6d1167640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6cc06aac0 0x7fe6cc150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:38.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.233+0000 7fe6d1167640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6cc159a00 0x7fe6cc0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:38.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.233+0000 7fe6d1167640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc142290 con 0x7fe6cc06aac0 2023-07-14T12:53:38.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.233+0000 7fe6d1167640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc15c520 con 0x7fe6cc06a670 2023-07-14T12:53:38.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.233+0000 7fe6d1167640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc15c800 con 0x7fe6cc159a00 2023-07-14T12:53:38.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.233+0000 7fe6c3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6cc06aac0 0x7fe6cc150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.233+0000 7fe6c3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6cc06aac0 0x7fe6cc150d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44752/0 (socket says 172.21.15.5:44752) 2023-07-14T12:53:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.233+0000 7fe6c3fff640 1 -- 172.21.15.5:0/557705166 learned_addr learned my addr 172.21.15.5:0/557705166 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:38.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.237+0000 7fe6cad9d640 1 --2- 172.21.15.5:0/557705166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6cc06a670 0x7fe6cc141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:38.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.237+0000 7fe6cb59e640 1 --2- 172.21.15.5:0/557705166 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6cc159a00 0x7fe6cc0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:38.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.237+0000 7fe6c3fff640 1 -- 172.21.15.5:0/557705166 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6cc159a00 msgr2=0x7fe6cc0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:38.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.237+0000 7fe6c3fff640 1 --2- 172.21.15.5:0/557705166 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6cc159a00 0x7fe6cc0b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:38.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.237+0000 7fe6c3fff640 1 -- 172.21.15.5:0/557705166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6cc06a670 msgr2=0x7fe6cc141d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.237+0000 7fe6c3fff640 1 --2- 172.21.15.5:0/557705166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6cc06a670 0x7fe6cc141d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.237+0000 7fe6c3fff640 1 -- 172.21.15.5:0/557705166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b4009420 con 0x7fe6cc06aac0 2023-07-14T12:53:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.237+0000 7fe6c3fff640 1 --2- 172.21.15.5:0/557705166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6cc06aac0 0x7fe6cc150d40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400ebe0 tx=0x7fe6b400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.237+0000 7fe6c37fe640 1 -- 172.21.15.5:0/557705166 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b400eee0 con 0x7fe6cc06aac0 2023-07-14T12:53:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.237+0000 7fe6c37fe640 1 -- 172.21.15.5:0/557705166 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b400cc30 con 0x7fe6cc06aac0 2023-07-14T12:53:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.237+0000 7fe6d1167640 1 -- 172.21.15.5:0/557705166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6c4009a70 con 0x7fe6cc06aac0 2023-07-14T12:53:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.237+0000 7fe6c37fe640 1 -- 172.21.15.5:0/557705166 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4013470 con 0x7fe6cc06aac0 2023-07-14T12:53:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.237+0000 7fe6d1167640 1 -- 172.21.15.5:0/557705166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6cc162bb0 con 0x7fe6cc06aac0 2023-07-14T12:53:38.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.237+0000 7fe6d1167640 1 -- 172.21.15.5:0/557705166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6cc0678d0 con 0x7fe6cc06aac0 2023-07-14T12:53:38.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.237+0000 7fe6c37fe640 1 -- 172.21.15.5:0/557705166 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe6b40135d0 con 0x7fe6cc06aac0 2023-07-14T12:53:38.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.237+0000 7fe6c37fe640 1 --2- 172.21.15.5:0/557705166 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe6ac066280 0x7fe6ac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.237+0000 7fe6c37fe640 1 -- 172.21.15.5:0/557705166 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe6b40841d0 con 0x7fe6cc06aac0 2023-07-14T12:53:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.241+0000 7fe6cad9d640 1 --2- 172.21.15.5:0/557705166 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe6ac066280 0x7fe6ac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:38.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.241+0000 7fe6cad9d640 1 --2- 172.21.15.5:0/557705166 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe6ac066280 0x7fe6ac068730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc001b00 tx=0x7fe6bc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:38.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.241+0000 7fe6c37fe640 1 -- 172.21.15.5:0/557705166 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe6b4055310 con 0x7fe6cc06aac0 2023-07-14T12:53:38.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.449+0000 7fe6d1167640 1 -- 172.21.15.5:0/557705166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fe6cc0cbf30 con 0x7fe6cc06aac0 2023-07-14T12:53:38.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.457+0000 7fe6c37fe640 1 -- 172.21.15.5:0/557705166 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe6b4054ea0 con 0x7fe6cc06aac0 2023-07-14T12:53:38.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.457+0000 7fe6d1167640 1 -- 172.21.15.5:0/557705166 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe6ac066280 msgr2=0x7fe6ac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:38.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.457+0000 7fe6d1167640 1 --2- 172.21.15.5:0/557705166 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe6ac066280 0x7fe6ac068730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc001b00 tx=0x7fe6bc009040 comp rx=0 tx=0).stop 2023-07-14T12:53:38.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.457+0000 7fe6d1167640 1 -- 172.21.15.5:0/557705166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6cc06aac0 msgr2=0x7fe6cc150d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:38.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.457+0000 7fe6d1167640 1 --2- 172.21.15.5:0/557705166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6cc06aac0 0x7fe6cc150d40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400ebe0 tx=0x7fe6b400c520 comp rx=0 tx=0).stop 2023-07-14T12:53:38.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.457+0000 7fe6d1167640 1 -- 172.21.15.5:0/557705166 shutdown_connections 2023-07-14T12:53:38.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.457+0000 7fe6d1167640 1 --2- 172.21.15.5:0/557705166 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6cc159a00 0x7fe6cc0b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:38.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.457+0000 7fe6d1167640 1 --2- 172.21.15.5:0/557705166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6cc06aac0 0x7fe6cc150d40 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:38.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.457+0000 7fe6d1167640 1 --2- 172.21.15.5:0/557705166 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe6ac066280 0x7fe6ac068730 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:38.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.457+0000 7fe6d1167640 1 --2- 172.21.15.5:0/557705166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6cc06a670 0x7fe6cc141d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:38.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.457+0000 7fe6d1167640 1 -- 172.21.15.5:0/557705166 >> 172.21.15.5:0/557705166 conn(0x7fe6cc0b1300 msgr2=0x7fe6cc0cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:38.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.457+0000 7fe6d1167640 1 -- 172.21.15.5:0/557705166 shutdown_connections 2023-07-14T12:53:38.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.457+0000 7fe6d1167640 1 -- 172.21.15.5:0/557705166 wait complete. 2023-07-14T12:53:38.504 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-07-14T12:53:38.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.621+0000 7fab41434640 1 Processor -- start 2023-07-14T12:53:38.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.621+0000 7fab41434640 1 -- start start 2023-07-14T12:53:38.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.621+0000 7fab41434640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab3c158ce0 0x7fab3c070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:38.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.621+0000 7fab41434640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fab3c0c9730 0x7fab3c0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:38.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.621+0000 7fab41434640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab3c0cc700 con 0x7fab3c0c8ad0 2023-07-14T12:53:38.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.621+0000 7fab41434640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab3c0b0ff0 con 0x7fab3c0c9730 2023-07-14T12:53:38.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.621+0000 7fab41434640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c070c80 con 0x7fab3c158ce0 2023-07-14T12:53:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.625+0000 7fab33fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fab3c0c8ad0 0x7fab3c0c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60778/0 (socket says 172.21.15.5:60778) 2023-07-14T12:53:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.625+0000 7fab33fff640 1 -- 172.21.15.5:0/2908487249 learned_addr learned my addr 172.21.15.5:0/2908487249 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.625+0000 7fab3b7fe640 1 --2- 172.21.15.5:0/2908487249 >> v2:172.21.15.5:3300/0 conn(0x7fab3c0c9730 0x7fab3c0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.625+0000 7fab3affd640 1 --2- 172.21.15.5:0/2908487249 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab3c158ce0 0x7fab3c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.625+0000 7fab3b7fe640 1 -- 172.21.15.5:0/2908487249 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab3c158ce0 msgr2=0x7fab3c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.625+0000 7fab3b7fe640 1 --2- 172.21.15.5:0/2908487249 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab3c158ce0 0x7fab3c070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.625+0000 7fab3b7fe640 1 -- 172.21.15.5:0/2908487249 >> v1:172.21.15.5:6789/0 conn(0x7fab3c0c8ad0 legacy=0x7fab3c0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.625+0000 7fab3b7fe640 1 -- 172.21.15.5:0/2908487249 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3c0cbdd0 con 0x7fab3c0c9730 2023-07-14T12:53:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.625+0000 7fab3b7fe640 1 --2- 172.21.15.5:0/2908487249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab3c0c9730 0x7fab3c0ccb90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fab34009d90 tx=0x7fab3401c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5135df5a8adf398f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.625+0000 7fab3a7fc640 1 -- 172.21.15.5:0/2908487249 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340a57d0 con 0x7fab3c0c9730 2023-07-14T12:53:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.625+0000 7fab3a7fc640 1 -- 172.21.15.5:0/2908487249 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab340a5930 con 0x7fab3c0c9730 2023-07-14T12:53:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.625+0000 7fab3a7fc640 1 -- 172.21.15.5:0/2908487249 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340a5cc0 con 0x7fab3c0c9730 2023-07-14T12:53:38.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.629+0000 7fab41434640 1 -- 172.21.15.5:0/2908487249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab3c0c9730 msgr2=0x7fab3c0ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:38.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.629+0000 7fab41434640 1 --2- 172.21.15.5:0/2908487249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab3c0c9730 0x7fab3c0ccb90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fab34009d90 tx=0x7fab3401c800 comp rx=0 tx=0).stop 2023-07-14T12:53:38.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.629+0000 7fab41434640 1 -- 172.21.15.5:0/2908487249 shutdown_connections 2023-07-14T12:53:38.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.629+0000 7fab41434640 1 --2- 172.21.15.5:0/2908487249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab3c0c9730 0x7fab3c0ccb90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:38.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.629+0000 7fab41434640 1 --2- 172.21.15.5:0/2908487249 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab3c158ce0 0x7fab3c070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:38.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.629+0000 7fab41434640 1 -- 172.21.15.5:0/2908487249 >> 172.21.15.5:0/2908487249 conn(0x7fab3c0afcf0 msgr2=0x7fab3c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:38.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.629+0000 7fab41434640 1 -- 172.21.15.5:0/2908487249 shutdown_connections 2023-07-14T12:53:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.629+0000 7fab41434640 1 -- 172.21.15.5:0/2908487249 wait complete. 2023-07-14T12:53:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.629+0000 7fab41434640 1 Processor -- start 2023-07-14T12:53:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.629+0000 7fab41434640 1 -- start start 2023-07-14T12:53:38.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.629+0000 7fab41434640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab3c0c8ad0 0x7fab3c0ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:38.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.629+0000 7fab41434640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab3c0c9730 0x7fab3c1648c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:38.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.629+0000 7fab41434640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab3c158ce0 0x7fab3c164e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:38.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.629+0000 7fab41434640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c0b2750 con 0x7fab3c158ce0 2023-07-14T12:53:38.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.629+0000 7fab41434640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c0b2d10 con 0x7fab3c0c8ad0 2023-07-14T12:53:38.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.629+0000 7fab41434640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c0acb10 con 0x7fab3c0c9730 2023-07-14T12:53:38.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.629+0000 7fab3b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab3c158ce0 0x7fab3c164e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:38.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.629+0000 7fab3b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab3c158ce0 0x7fab3c164e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44760/0 (socket says 172.21.15.5:44760) 2023-07-14T12:53:38.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.629+0000 7fab3b7fe640 1 -- 172.21.15.5:0/1270351648 learned_addr learned my addr 172.21.15.5:0/1270351648 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:38.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.629+0000 7fab3affd640 1 --2- 172.21.15.5:0/1270351648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab3c0c8ad0 0x7fab3c0ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:38.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.629+0000 7fab3b7fe640 1 -- 172.21.15.5:0/1270351648 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab3c0c9730 msgr2=0x7fab3c1648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:38.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.629+0000 7fab3b7fe640 1 --2- 172.21.15.5:0/1270351648 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab3c0c9730 0x7fab3c1648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:38.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.629+0000 7fab3b7fe640 1 -- 172.21.15.5:0/1270351648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab3c0c8ad0 msgr2=0x7fab3c0ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:38.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.629+0000 7fab3b7fe640 1 --2- 172.21.15.5:0/1270351648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab3c0c8ad0 0x7fab3c0ac5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:38.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.629+0000 7fab3b7fe640 1 -- 172.21.15.5:0/1270351648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab34009a70 con 0x7fab3c158ce0 2023-07-14T12:53:38.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.629+0000 7fab3b7fe640 1 --2- 172.21.15.5:0/1270351648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab3c158ce0 0x7fab3c164e00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fab340b0040 tx=0x7fab340195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:38.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.633+0000 7fab337fe640 1 -- 172.21.15.5:0/1270351648 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340b9860 con 0x7fab3c158ce0 2023-07-14T12:53:38.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.633+0000 7fab337fe640 1 -- 172.21.15.5:0/1270351648 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab340b99c0 con 0x7fab3c158ce0 2023-07-14T12:53:38.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.633+0000 7fab337fe640 1 -- 172.21.15.5:0/1270351648 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340b9d30 con 0x7fab3c158ce0 2023-07-14T12:53:38.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.633+0000 7fab41434640 1 -- 172.21.15.5:0/1270351648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab3c0acda0 con 0x7fab3c158ce0 2023-07-14T12:53:38.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.633+0000 7fab41434640 1 -- 172.21.15.5:0/1270351648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab3c0b29a0 con 0x7fab3c158ce0 2023-07-14T12:53:38.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.633+0000 7fab41434640 1 -- 172.21.15.5:0/1270351648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab3c0ca1a0 con 0x7fab3c158ce0 2023-07-14T12:53:38.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.633+0000 7fab337fe640 1 -- 172.21.15.5:0/1270351648 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fab340ad440 con 0x7fab3c158ce0 2023-07-14T12:53:38.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.633+0000 7fab337fe640 1 --2- 172.21.15.5:0/1270351648 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fab1c066280 0x7fab1c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:38.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.633+0000 7fab337fe640 1 -- 172.21.15.5:0/1270351648 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fab3411ee40 con 0x7fab3c158ce0 2023-07-14T12:53:38.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.633+0000 7fab3affd640 1 --2- 172.21.15.5:0/1270351648 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fab1c066280 0x7fab1c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:38.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.637+0000 7fab3affd640 1 --2- 172.21.15.5:0/1270351648 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fab1c066280 0x7fab1c068730 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fab2c0096f0 tx=0x7fab2c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:38.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.637+0000 7fab337fe640 1 -- 172.21.15.5:0/1270351648 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fab340ec570 con 0x7fab3c158ce0 2023-07-14T12:53:38.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.849+0000 7fab41434640 1 -- 172.21.15.5:0/1270351648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fab3c0678d0 con 0x7fab3c158ce0 2023-07-14T12:53:38.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.853+0000 7fab337fe640 1 -- 172.21.15.5:0/1270351648 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7fab340efb90 con 0x7fab3c158ce0 2023-07-14T12:53:38.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.857+0000 7fab41434640 1 -- 172.21.15.5:0/1270351648 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fab1c066280 msgr2=0x7fab1c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:38.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.857+0000 7fab41434640 1 --2- 172.21.15.5:0/1270351648 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fab1c066280 0x7fab1c068730 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fab2c0096f0 tx=0x7fab2c008040 comp rx=0 tx=0).stop 2023-07-14T12:53:38.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.857+0000 7fab41434640 1 -- 172.21.15.5:0/1270351648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab3c158ce0 msgr2=0x7fab3c164e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:38.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.857+0000 7fab41434640 1 --2- 172.21.15.5:0/1270351648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab3c158ce0 0x7fab3c164e00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fab340b0040 tx=0x7fab340195a0 comp rx=0 tx=0).stop 2023-07-14T12:53:38.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.857+0000 7fab41434640 1 -- 172.21.15.5:0/1270351648 shutdown_connections 2023-07-14T12:53:38.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.857+0000 7fab41434640 1 --2- 172.21.15.5:0/1270351648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab3c158ce0 0x7fab3c164e00 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:38.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.857+0000 7fab41434640 1 --2- 172.21.15.5:0/1270351648 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab3c0c9730 0x7fab3c1648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:38.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.857+0000 7fab41434640 1 --2- 172.21.15.5:0/1270351648 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fab1c066280 0x7fab1c068730 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:38.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.857+0000 7fab41434640 1 --2- 172.21.15.5:0/1270351648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab3c0c8ad0 0x7fab3c0ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:38.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.857+0000 7fab41434640 1 -- 172.21.15.5:0/1270351648 >> 172.21.15.5:0/1270351648 conn(0x7fab3c0afcf0 msgr2=0x7fab3c0ae320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:38.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.857+0000 7fab41434640 1 -- 172.21.15.5:0/1270351648 shutdown_connections 2023-07-14T12:53:38.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:38.857+0000 7fab41434640 1 -- 172.21.15.5:0/1270351648 wait complete. 2023-07-14T12:53:38.904 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-07-14T12:53:39.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.021+0000 7f12231db640 1 Processor -- start 2023-07-14T12:53:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.021+0000 7f12231db640 1 -- start start 2023-07-14T12:53:39.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.021+0000 7f12231db640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f121c0c9730 0x7f121c1638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.021+0000 7f12231db640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f121c0cc700 con 0x7f121c158ce0 2023-07-14T12:53:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.021+0000 7f12231db640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f121c0b0ff0 con 0x7f121c0c8ad0 2023-07-14T12:53:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.021+0000 7f12231db640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121c070c80 con 0x7f121c0c9730 2023-07-14T12:53:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.025+0000 7f1220f77640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f121c158ce0 0x7f121c070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58384/0 (socket says 172.21.15.5:58384) 2023-07-14T12:53:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.025+0000 7f1220f77640 1 -- 172.21.15.5:0/70145635 learned_addr learned my addr 172.21.15.5:0/70145635 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.025+0000 7f1221778640 1 --2- 172.21.15.5:0/70145635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f121c0c9730 0x7f121c1638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.025+0000 7f121b7fe640 1 -- 172.21.15.5:0/70145635 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651258612 0 0) 0x7f121c0cc700 con 0x7f121c158ce0 2023-07-14T12:53:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.025+0000 7f121b7fe640 1 -- 172.21.15.5:0/70145635 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f120c003530 con 0x7f121c158ce0 2023-07-14T12:53:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.025+0000 7f1221778640 1 -- 172.21.15.5:0/70145635 >> v1:172.21.15.154:6789/0 conn(0x7f121c0c8ad0 legacy=0x7f121c0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.025+0000 7f121b7fe640 1 -- 172.21.15.5:0/70145635 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3647446680 0 0) 0x7f121c0b0ff0 con 0x7f121c0c8ad0 2023-07-14T12:53:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.025+0000 7f1221778640 1 -- 172.21.15.5:0/70145635 >> v1:172.21.15.5:6789/0 conn(0x7f121c158ce0 legacy=0x7f121c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.025+0000 7f1221778640 1 -- 172.21.15.5:0/70145635 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121c0cbdd0 con 0x7f121c0c9730 2023-07-14T12:53:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.025+0000 7f1221778640 1 --2- 172.21.15.5:0/70145635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f121c0c9730 0x7f121c1638b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1214009dc0 tx=0x7f121401c660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47268e024bd16228 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.029+0000 7f121b7fe640 1 -- 172.21.15.5:0/70145635 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1210001680 con 0x7f121c0c9730 2023-07-14T12:53:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.029+0000 7f121b7fe640 1 -- 172.21.15.5:0/70145635 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12140a6510 con 0x7f121c0c9730 2023-07-14T12:53:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.029+0000 7f121b7fe640 1 -- 172.21.15.5:0/70145635 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12140a68a0 con 0x7f121c0c9730 2023-07-14T12:53:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.029+0000 7f12231db640 1 -- 172.21.15.5:0/70145635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f121c0c9730 msgr2=0x7f121c1638b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.029+0000 7f12231db640 1 --2- 172.21.15.5:0/70145635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f121c0c9730 0x7f121c1638b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1214009dc0 tx=0x7f121401c660 comp rx=0 tx=0).stop 2023-07-14T12:53:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.029+0000 7f12231db640 1 -- 172.21.15.5:0/70145635 shutdown_connections 2023-07-14T12:53:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.029+0000 7f12231db640 1 --2- 172.21.15.5:0/70145635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f121c0c9730 0x7f121c1638b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.029+0000 7f12231db640 1 -- 172.21.15.5:0/70145635 >> 172.21.15.5:0/70145635 conn(0x7f121c0afcf0 msgr2=0x7f121c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.029+0000 7f12231db640 1 -- 172.21.15.5:0/70145635 shutdown_connections 2023-07-14T12:53:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.029+0000 7f12231db640 1 -- 172.21.15.5:0/70145635 wait complete. 2023-07-14T12:53:39.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.029+0000 7f12231db640 1 Processor -- start 2023-07-14T12:53:39.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.029+0000 7f12231db640 1 -- start start 2023-07-14T12:53:39.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.029+0000 7f12231db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f121c0c8ad0 0x7f121c144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:39.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.029+0000 7f12231db640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f121c0c9730 0x7f121c15bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:39.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.029+0000 7f12231db640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f121c158ce0 0x7f121c149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:39.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.029+0000 7f12231db640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121c145a40 con 0x7f121c0c8ad0 2023-07-14T12:53:39.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.029+0000 7f12231db640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121c145760 con 0x7f121c158ce0 2023-07-14T12:53:39.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.029+0000 7f12231db640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121c15af00 con 0x7f121c0c9730 2023-07-14T12:53:39.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.033+0000 7f1220f77640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f121c0c8ad0 0x7f121c144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:39.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.033+0000 7f1220f77640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f121c0c8ad0 0x7f121c144ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50574/0 (socket says 172.21.15.5:50574) 2023-07-14T12:53:39.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.033+0000 7f1220f77640 1 -- 172.21.15.5:0/1290891653 learned_addr learned my addr 172.21.15.5:0/1290891653 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:39.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.033+0000 7f1221778640 1 --2- 172.21.15.5:0/1290891653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f121c158ce0 0x7f121c149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.033+0000 7f121bfff640 1 --2- 172.21.15.5:0/1290891653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f121c0c9730 0x7f121c15bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.033+0000 7f1220f77640 1 -- 172.21.15.5:0/1290891653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f121c0c9730 msgr2=0x7f121c15bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.033+0000 7f1220f77640 1 --2- 172.21.15.5:0/1290891653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f121c0c9730 0x7f121c15bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.033+0000 7f1220f77640 1 -- 172.21.15.5:0/1290891653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f121c158ce0 msgr2=0x7f121c149be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.033+0000 7f1220f77640 1 --2- 172.21.15.5:0/1290891653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f121c158ce0 0x7f121c149be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.033+0000 7f1220f77640 1 -- 172.21.15.5:0/1290891653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1214009a70 con 0x7f121c0c8ad0 2023-07-14T12:53:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.033+0000 7f1220f77640 1 --2- 172.21.15.5:0/1290891653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f121c0c8ad0 0x7f121c144ba0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f121000c700 tx=0x7f121000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.033+0000 7f12197fa640 1 -- 172.21.15.5:0/1290891653 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12100074e0 con 0x7f121c0c8ad0 2023-07-14T12:53:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.033+0000 7f12197fa640 1 -- 172.21.15.5:0/1290891653 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1210007660 con 0x7f121c0c8ad0 2023-07-14T12:53:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.033+0000 7f12197fa640 1 -- 172.21.15.5:0/1290891653 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1210004a30 con 0x7f121c0c8ad0 2023-07-14T12:53:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.033+0000 7f12231db640 1 -- 172.21.15.5:0/1290891653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f121c15b1e0 con 0x7f121c0c8ad0 2023-07-14T12:53:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.033+0000 7f12231db640 1 -- 172.21.15.5:0/1290891653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f121c1450e0 con 0x7f121c0c8ad0 2023-07-14T12:53:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.033+0000 7f12231db640 1 -- 172.21.15.5:0/1290891653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f121c0678d0 con 0x7f121c0c8ad0 2023-07-14T12:53:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.033+0000 7f12197fa640 1 -- 172.21.15.5:0/1290891653 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1210004b90 con 0x7f121c0c8ad0 2023-07-14T12:53:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.037+0000 7f12197fa640 1 --2- 172.21.15.5:0/1290891653 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f12000662b0 0x7f1200068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.037+0000 7f12197fa640 1 -- 172.21.15.5:0/1290891653 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1210082ff0 con 0x7f121c0c8ad0 2023-07-14T12:53:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.037+0000 7f121bfff640 1 --2- 172.21.15.5:0/1290891653 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f12000662b0 0x7f1200068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.037+0000 7f121bfff640 1 --2- 172.21.15.5:0/1290891653 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f12000662b0 0x7f1200068760 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f121c0c84d0 tx=0x7f1208009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:39.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.037+0000 7f12197fa640 1 -- 172.21.15.5:0/1290891653 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f1210050720 con 0x7f121c0c8ad0 2023-07-14T12:53:39.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.253+0000 7f12231db640 1 -- 172.21.15.5:0/1290891653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f121c0ca120 con 0x7f121c0c8ad0 2023-07-14T12:53:39.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.257+0000 7f12197fa640 1 -- 172.21.15.5:0/1290891653 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1210018020 con 0x7f121c0c8ad0 2023-07-14T12:53:39.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.257+0000 7f12231db640 1 -- 172.21.15.5:0/1290891653 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f12000662b0 msgr2=0x7f1200068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:39.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.257+0000 7f12231db640 1 --2- 172.21.15.5:0/1290891653 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f12000662b0 0x7f1200068760 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f121c0c84d0 tx=0x7f1208009040 comp rx=0 tx=0).stop 2023-07-14T12:53:39.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.257+0000 7f12231db640 1 -- 172.21.15.5:0/1290891653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f121c0c8ad0 msgr2=0x7f121c144ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:39.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.257+0000 7f12231db640 1 --2- 172.21.15.5:0/1290891653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f121c0c8ad0 0x7f121c144ba0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f121000c700 tx=0x7f121000cbc0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.261+0000 7f12231db640 1 -- 172.21.15.5:0/1290891653 shutdown_connections 2023-07-14T12:53:39.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.261+0000 7f12231db640 1 --2- 172.21.15.5:0/1290891653 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f12000662b0 0x7f1200068760 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.261+0000 7f12231db640 1 --2- 172.21.15.5:0/1290891653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f121c158ce0 0x7f121c149be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.261+0000 7f12231db640 1 --2- 172.21.15.5:0/1290891653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f121c0c9730 0x7f121c15bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.261+0000 7f12231db640 1 --2- 172.21.15.5:0/1290891653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f121c0c8ad0 0x7f121c144ba0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.261+0000 7f12231db640 1 -- 172.21.15.5:0/1290891653 >> 172.21.15.5:0/1290891653 conn(0x7f121c0afcf0 msgr2=0x7f121c0af390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:39.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.261+0000 7f12231db640 1 -- 172.21.15.5:0/1290891653 shutdown_connections 2023-07-14T12:53:39.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.261+0000 7f12231db640 1 -- 172.21.15.5:0/1290891653 wait complete. 2023-07-14T12:53:39.306 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:53:39.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.421+0000 7fe7c119f640 1 Processor -- start 2023-07-14T12:53:39.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.421+0000 7fe7c119f640 1 -- start start 2023-07-14T12:53:39.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.421+0000 7fe7c119f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe7bc070b70 0x7fe7bc070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:39.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.421+0000 7fe7c119f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe7bc06b1e0 0x7fe7bc0c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:39.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.421+0000 7fe7c119f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7bc0c21f0 0x7fe7bc0cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:39.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.421+0000 7fe7c119f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7bc0cac70 con 0x7fe7bc070b70 2023-07-14T12:53:39.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.421+0000 7fe7c119f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7bc071480 con 0x7fe7bc06b1e0 2023-07-14T12:53:39.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.421+0000 7fe7c119f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc0ca060 con 0x7fe7bc0c21f0 2023-07-14T12:53:39.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.425+0000 7fe7bad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe7bc070b70 0x7fe7bc070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:39.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.425+0000 7fe7bad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe7bc070b70 0x7fe7bc070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50586/0 (socket says 172.21.15.5:50586) 2023-07-14T12:53:39.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.425+0000 7fe7bad9d640 1 -- 172.21.15.5:0/3832252490 learned_addr learned my addr 172.21.15.5:0/3832252490 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:39.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.425+0000 7fe7bad9d640 1 -- 172.21.15.5:0/3832252490 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7bc0c21f0 msgr2=0x7fe7bc0cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:39.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.425+0000 7fe7bad9d640 1 --2- 172.21.15.5:0/3832252490 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7bc0c21f0 0x7fe7bc0cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.425+0000 7fe7bad9d640 1 -- 172.21.15.5:0/3832252490 >> v2:172.21.15.154:3300/0 conn(0x7fe7bc06b1e0 msgr2=0x7fe7bc0c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:39.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.425+0000 7fe7b3fff640 1 --2- 172.21.15.5:0/3832252490 >> v2:172.21.15.154:3300/0 conn(0x7fe7bc06b1e0 0x7fe7bc0c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:39.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.425+0000 7fe7bad9d640 1 --2- 172.21.15.5:0/3832252490 >> v2:172.21.15.154:3300/0 conn(0x7fe7bc06b1e0 0x7fe7bc0c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.425+0000 7fe7bad9d640 1 -- 172.21.15.5:0/3832252490 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc0ca340 con 0x7fe7bc070b70 2023-07-14T12:53:39.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.425+0000 7fe7b3fff640 1 --2- 172.21.15.5:0/3832252490 >> v2:172.21.15.154:3300/0 conn(0x7fe7bc06b1e0 0x7fe7bc0c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:39.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.425+0000 7fe7bad9d640 1 --2- 172.21.15.5:0/3832252490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7bc070b70 0x7fe7bc070f40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc06f380 tx=0x7fe7ac01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53cbb090743c57d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:39.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.425+0000 7fe7ba59c640 1 -- 172.21.15.5:0/3832252490 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac0aa430 con 0x7fe7bc070b70 2023-07-14T12:53:39.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.425+0000 7fe7ba59c640 1 -- 172.21.15.5:0/3832252490 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac0aa590 con 0x7fe7bc070b70 2023-07-14T12:53:39.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.425+0000 7fe7ba59c640 1 -- 172.21.15.5:0/3832252490 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac0aa920 con 0x7fe7bc070b70 2023-07-14T12:53:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.429+0000 7fe7c119f640 1 -- 172.21.15.5:0/3832252490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7bc070b70 msgr2=0x7fe7bc070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.429+0000 7fe7c119f640 1 --2- 172.21.15.5:0/3832252490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7bc070b70 0x7fe7bc070f40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc06f380 tx=0x7fe7ac01c4f0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.429+0000 7fe7c119f640 1 -- 172.21.15.5:0/3832252490 shutdown_connections 2023-07-14T12:53:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.429+0000 7fe7c119f640 1 --2- 172.21.15.5:0/3832252490 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7bc0c21f0 0x7fe7bc0cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.429+0000 7fe7c119f640 1 --2- 172.21.15.5:0/3832252490 >> v2:172.21.15.154:3300/0 conn(0x7fe7bc06b1e0 0x7fe7bc0c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.429+0000 7fe7c119f640 1 --2- 172.21.15.5:0/3832252490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7bc070b70 0x7fe7bc070f40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.429+0000 7fe7c119f640 1 -- 172.21.15.5:0/3832252490 >> 172.21.15.5:0/3832252490 conn(0x7fe7bc0afcf0 msgr2=0x7fe7bc0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:39.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.429+0000 7fe7c119f640 1 -- 172.21.15.5:0/3832252490 shutdown_connections 2023-07-14T12:53:39.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.429+0000 7fe7c119f640 1 -- 172.21.15.5:0/3832252490 wait complete. 2023-07-14T12:53:39.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.429+0000 7fe7c119f640 1 Processor -- start 2023-07-14T12:53:39.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.429+0000 7fe7c119f640 1 -- start start 2023-07-14T12:53:39.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.429+0000 7fe7c119f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7bc06b1e0 0x7fe7bc143640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:39.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.429+0000 7fe7c119f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7bc070b70 0x7fe7bc0cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:39.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.429+0000 7fe7c119f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7bc0c21f0 0x7fe7bc0cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:39.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.429+0000 7fe7c119f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc0c81c0 con 0x7fe7bc0c21f0 2023-07-14T12:53:39.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.429+0000 7fe7c119f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc0b25e0 con 0x7fe7bc070b70 2023-07-14T12:53:39.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.429+0000 7fe7c119f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc0b28c0 con 0x7fe7bc06b1e0 2023-07-14T12:53:39.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.429+0000 7fe7bb59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7bc0c21f0 0x7fe7bc0cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:39.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.429+0000 7fe7bb59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7bc0c21f0 0x7fe7bc0cc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50590/0 (socket says 172.21.15.5:50590) 2023-07-14T12:53:39.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.429+0000 7fe7bb59e640 1 -- 172.21.15.5:0/2517607584 learned_addr learned my addr 172.21.15.5:0/2517607584 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:39.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.429+0000 7fe7b3fff640 1 --2- 172.21.15.5:0/2517607584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7bc070b70 0x7fe7bc0cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:39.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.429+0000 7fe7bad9d640 1 --2- 172.21.15.5:0/2517607584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7bc06b1e0 0x7fe7bc143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:39.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.433+0000 7fe7bb59e640 1 -- 172.21.15.5:0/2517607584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7bc06b1e0 msgr2=0x7fe7bc143640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:39.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.433+0000 7fe7bb59e640 1 --2- 172.21.15.5:0/2517607584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7bc06b1e0 0x7fe7bc143640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.433+0000 7fe7bb59e640 1 -- 172.21.15.5:0/2517607584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7bc070b70 msgr2=0x7fe7bc0cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:39.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.433+0000 7fe7bb59e640 1 --2- 172.21.15.5:0/2517607584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7bc070b70 0x7fe7bc0cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.433+0000 7fe7bb59e640 1 -- 172.21.15.5:0/2517607584 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac0094d0 con 0x7fe7bc0c21f0 2023-07-14T12:53:39.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.433+0000 7fe7bad9d640 1 --2- 172.21.15.5:0/2517607584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7bc06b1e0 0x7fe7bc143640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:39.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.433+0000 7fe7b3fff640 1 --2- 172.21.15.5:0/2517607584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7bc070b70 0x7fe7bc0cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:39.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.433+0000 7fe7bb59e640 1 --2- 172.21.15.5:0/2517607584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7bc0c21f0 0x7fe7bc0cc550 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe7b400b9e0 tx=0x7fe7b400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:39.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.433+0000 7fe7b37fe640 1 -- 172.21.15.5:0/2517607584 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b400cb20 con 0x7fe7bc0c21f0 2023-07-14T12:53:39.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.433+0000 7fe7b37fe640 1 -- 172.21.15.5:0/2517607584 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b400cca0 con 0x7fe7bc0c21f0 2023-07-14T12:53:39.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.433+0000 7fe7b37fe640 1 -- 172.21.15.5:0/2517607584 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4014680 con 0x7fe7bc0c21f0 2023-07-14T12:53:39.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.433+0000 7fe7c119f640 1 -- 172.21.15.5:0/2517607584 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7bc0b2ba0 con 0x7fe7bc0c21f0 2023-07-14T12:53:39.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.433+0000 7fe7c119f640 1 -- 172.21.15.5:0/2517607584 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7bc0b3160 con 0x7fe7bc0c21f0 2023-07-14T12:53:39.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.433+0000 7fe7c119f640 1 -- 172.21.15.5:0/2517607584 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7bc0b3380 con 0x7fe7bc0c21f0 2023-07-14T12:53:39.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.433+0000 7fe7b37fe640 1 -- 172.21.15.5:0/2517607584 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe7b401d3b0 con 0x7fe7bc0c21f0 2023-07-14T12:53:39.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.433+0000 7fe7b37fe640 1 --2- 172.21.15.5:0/2517607584 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe79c066280 0x7fe79c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:39.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.433+0000 7fe7b37fe640 1 -- 172.21.15.5:0/2517607584 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe7b4083940 con 0x7fe7bc0c21f0 2023-07-14T12:53:39.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.433+0000 7fe7bad9d640 1 --2- 172.21.15.5:0/2517607584 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe79c066280 0x7fe79c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:39.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.437+0000 7fe7bad9d640 1 --2- 172.21.15.5:0/2517607584 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe79c066280 0x7fe79c068730 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac0ae000 tx=0x7fe7ac0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:39.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.437+0000 7fe7b37fe640 1 -- 172.21.15.5:0/2517607584 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe7b4051070 con 0x7fe7bc0c21f0 2023-07-14T12:53:39.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.593+0000 7fe7c119f640 1 -- 172.21.15.5:0/2517607584 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7bc0678d0 con 0x7fe7bc0c21f0 2023-07-14T12:53:39.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.593+0000 7fe7b37fe640 1 -- 172.21.15.5:0/2517607584 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+14591 (secure 0 0 0) 0x7fe7b4019090 con 0x7fe7bc0c21f0 2023-07-14T12:53:39.622 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:39.622 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":33,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:53:36.441090+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:53:39.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.597+0000 7fe7c119f640 1 -- 172.21.15.5:0/2517607584 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe79c066280 msgr2=0x7fe79c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:39.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.597+0000 7fe7c119f640 1 --2- 172.21.15.5:0/2517607584 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe79c066280 0x7fe79c068730 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac0ae000 tx=0x7fe7ac0a7000 comp rx=0 tx=0).stop 2023-07-14T12:53:39.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.597+0000 7fe7c119f640 1 -- 172.21.15.5:0/2517607584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7bc0c21f0 msgr2=0x7fe7bc0cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:39.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.597+0000 7fe7c119f640 1 --2- 172.21.15.5:0/2517607584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7bc0c21f0 0x7fe7bc0cc550 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe7b400b9e0 tx=0x7fe7b400bea0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.597+0000 7fe7c119f640 1 -- 172.21.15.5:0/2517607584 shutdown_connections 2023-07-14T12:53:39.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.597+0000 7fe7c119f640 1 --2- 172.21.15.5:0/2517607584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7bc0c21f0 0x7fe7bc0cc550 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.597+0000 7fe7c119f640 1 --2- 172.21.15.5:0/2517607584 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fe79c066280 0x7fe79c068730 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.597+0000 7fe7c119f640 1 --2- 172.21.15.5:0/2517607584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7bc070b70 0x7fe7bc0cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.597+0000 7fe7c119f640 1 --2- 172.21.15.5:0/2517607584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7bc06b1e0 0x7fe7bc143640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.597+0000 7fe7c119f640 1 -- 172.21.15.5:0/2517607584 >> 172.21.15.5:0/2517607584 conn(0x7fe7bc0afcf0 msgr2=0x7fe7bc158fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:39.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.597+0000 7fe7c119f640 1 -- 172.21.15.5:0/2517607584 shutdown_connections 2023-07-14T12:53:39.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.597+0000 7fe7c119f640 1 -- 172.21.15.5:0/2517607584 wait complete. 2023-07-14T12:53:39.643 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T12:53:39.644 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T12:53:39.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.765+0000 7f5f28b74640 1 Processor -- start 2023-07-14T12:53:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.765+0000 7f5f28b74640 1 -- start start 2023-07-14T12:53:39.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.765+0000 7f5f28b74640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f240aeb40 0x7f5f2415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.765+0000 7f5f28b74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f24159440 0x7f5f240c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.765+0000 7f5f28b74640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f241532b0 con 0x7f5f240aef10 2023-07-14T12:53:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.765+0000 7f5f28b74640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f240ca6f0 con 0x7f5f240aeb40 2023-07-14T12:53:39.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.765+0000 7f5f28b74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f241599d0 con 0x7f5f24159440 2023-07-14T12:53:39.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.765+0000 7f5f2259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f240aeb40 0x7f5f2415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:39.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.765+0000 7f5f1bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5f240aef10 0x7f5f24158d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58392/0 (socket says 172.21.15.5:58392) 2023-07-14T12:53:39.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.765+0000 7f5f1bfff640 1 -- 172.21.15.5:0/2353339585 learned_addr learned my addr 172.21.15.5:0/2353339585 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:39.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.765+0000 7f5f22d9d640 1 --2- 172.21.15.5:0/2353339585 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f24159440 0x7f5f240c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:39.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.765+0000 7f5f2259c640 1 -- 172.21.15.5:0/2353339585 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f24159440 msgr2=0x7f5f240c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:39.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.765+0000 7f5f2259c640 1 --2- 172.21.15.5:0/2353339585 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f24159440 0x7f5f240c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.765+0000 7f5f2259c640 1 -- 172.21.15.5:0/2353339585 >> v1:172.21.15.5:6789/0 conn(0x7f5f240aef10 legacy=0x7f5f24158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:39.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.765+0000 7f5f2259c640 1 -- 172.21.15.5:0/2353339585 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f24159cb0 con 0x7f5f240aeb40 2023-07-14T12:53:39.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.765+0000 7f5f21d9b640 1 -- 172.21.15.5:0/2353339585 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1557515998 0 0) 0x7f5f241532b0 con 0x7f5f240aef10 2023-07-14T12:53:39.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.769+0000 7f5f2259c640 1 --2- 172.21.15.5:0/2353339585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f240aeb40 0x7f5f2415cef0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5f1400ba60 tx=0x7f5f1401ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82148dfe9e9c980a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:39.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.769+0000 7f5f21d9b640 1 -- 172.21.15.5:0/2353339585 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f140a7b60 con 0x7f5f240aeb40 2023-07-14T12:53:39.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.769+0000 7f5f21d9b640 1 -- 172.21.15.5:0/2353339585 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f140a7cc0 con 0x7f5f240aeb40 2023-07-14T12:53:39.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.769+0000 7f5f21d9b640 1 -- 172.21.15.5:0/2353339585 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f140af660 con 0x7f5f240aeb40 2023-07-14T12:53:39.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.769+0000 7f5f28b74640 1 -- 172.21.15.5:0/2353339585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f240aeb40 msgr2=0x7f5f2415cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:39.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.769+0000 7f5f28b74640 1 --2- 172.21.15.5:0/2353339585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f240aeb40 0x7f5f2415cef0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5f1400ba60 tx=0x7f5f1401ea90 comp rx=0 tx=0).stop 2023-07-14T12:53:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.769+0000 7f5f28b74640 1 -- 172.21.15.5:0/2353339585 shutdown_connections 2023-07-14T12:53:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.769+0000 7f5f28b74640 1 --2- 172.21.15.5:0/2353339585 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f24159440 0x7f5f240c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.769+0000 7f5f28b74640 1 --2- 172.21.15.5:0/2353339585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f240aeb40 0x7f5f2415cef0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.769+0000 7f5f28b74640 1 -- 172.21.15.5:0/2353339585 >> 172.21.15.5:0/2353339585 conn(0x7f5f240cde90 msgr2=0x7f5f240ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.769+0000 7f5f28b74640 1 -- 172.21.15.5:0/2353339585 shutdown_connections 2023-07-14T12:53:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.769+0000 7f5f28b74640 1 -- 172.21.15.5:0/2353339585 wait complete. 2023-07-14T12:53:39.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.769+0000 7f5f28b74640 1 Processor -- start 2023-07-14T12:53:39.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.773+0000 7f5f28b74640 1 -- start start 2023-07-14T12:53:39.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.773+0000 7f5f28b74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f240aeb40 0x7f5f2414cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:39.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.773+0000 7f5f28b74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f240aef10 0x7f5f240b1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:39.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.773+0000 7f5f28b74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f24159440 0x7f5f2414d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:39.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.773+0000 7f5f28b74640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f240707d0 con 0x7f5f240aeb40 2023-07-14T12:53:39.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.773+0000 7f5f28b74640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f24070210 con 0x7f5f240aef10 2023-07-14T12:53:39.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.773+0000 7f5f28b74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f240704f0 con 0x7f5f24159440 2023-07-14T12:53:39.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.773+0000 7f5f2259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f240aeb40 0x7f5f2414cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:39.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.773+0000 7f5f2259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f240aeb40 0x7f5f2414cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50614/0 (socket says 172.21.15.5:50614) 2023-07-14T12:53:39.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.773+0000 7f5f2259c640 1 -- 172.21.15.5:0/1674556806 learned_addr learned my addr 172.21.15.5:0/1674556806 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:39.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.773+0000 7f5f22d9d640 1 --2- 172.21.15.5:0/1674556806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f24159440 0x7f5f2414d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:39.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.773+0000 7f5f1bfff640 1 --2- 172.21.15.5:0/1674556806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f240aef10 0x7f5f240b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:39.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.773+0000 7f5f2259c640 1 -- 172.21.15.5:0/1674556806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f24159440 msgr2=0x7f5f2414d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:39.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.773+0000 7f5f2259c640 1 --2- 172.21.15.5:0/1674556806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f24159440 0x7f5f2414d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.773+0000 7f5f2259c640 1 -- 172.21.15.5:0/1674556806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f240aef10 msgr2=0x7f5f240b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:39.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.773+0000 7f5f2259c640 1 --2- 172.21.15.5:0/1674556806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f240aef10 0x7f5f240b1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.773+0000 7f5f2259c640 1 -- 172.21.15.5:0/1674556806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1400b6c0 con 0x7f5f240aeb40 2023-07-14T12:53:39.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.773+0000 7f5f22d9d640 1 --2- 172.21.15.5:0/1674556806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f24159440 0x7f5f2414d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:39.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.773+0000 7f5f1bfff640 1 --2- 172.21.15.5:0/1674556806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f240aef10 0x7f5f240b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:39.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.773+0000 7f5f2259c640 1 --2- 172.21.15.5:0/1674556806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f240aeb40 0x7f5f2414cd00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5f140b2040 tx=0x7f5f1401b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:39.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.773+0000 7f5f1affd640 1 -- 172.21.15.5:0/1674556806 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f140a7b60 con 0x7f5f240aeb40 2023-07-14T12:53:39.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.773+0000 7f5f1affd640 1 -- 172.21.15.5:0/1674556806 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f140b9410 con 0x7f5f240aeb40 2023-07-14T12:53:39.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.773+0000 7f5f1affd640 1 -- 172.21.15.5:0/1674556806 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f140b97e0 con 0x7f5f240aeb40 2023-07-14T12:53:39.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.773+0000 7f5f28b74640 1 -- 172.21.15.5:0/1674556806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f24153df0 con 0x7f5f240aeb40 2023-07-14T12:53:39.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.773+0000 7f5f28b74640 1 -- 172.21.15.5:0/1674556806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f24070fe0 con 0x7f5f240aeb40 2023-07-14T12:53:39.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.773+0000 7f5f28b74640 1 -- 172.21.15.5:0/1674556806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f240678d0 con 0x7f5f240aeb40 2023-07-14T12:53:39.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.777+0000 7f5f1affd640 1 -- 172.21.15.5:0/1674556806 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5f140b6050 con 0x7f5f240aeb40 2023-07-14T12:53:39.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.777+0000 7f5f1affd640 1 --2- 172.21.15.5:0/1674556806 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5f04066280 0x7f5f04068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:39.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.777+0000 7f5f1affd640 1 -- 172.21.15.5:0/1674556806 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5f14120cd0 con 0x7f5f240aeb40 2023-07-14T12:53:39.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.777+0000 7f5f1bfff640 1 --2- 172.21.15.5:0/1674556806 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5f04066280 0x7f5f04068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:39.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.777+0000 7f5f1bfff640 1 --2- 172.21.15.5:0/1674556806 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5f04066280 0x7f5f04068730 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c007fd0 tx=0x7f5f0c007c20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:39.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.781+0000 7f5f1affd640 1 -- 172.21.15.5:0/1674556806 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f5f140ee530 con 0x7f5f240aeb40 2023-07-14T12:53:39.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.937+0000 7f5f28b74640 1 -- 172.21.15.5:0/1674556806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5f240ce400 con 0x7f5f240aeb40 2023-07-14T12:53:39.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.937+0000 7f5f1affd640 1 -- 172.21.15.5:0/1674556806 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5f140b4020 con 0x7f5f240aeb40 2023-07-14T12:53:39.965 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T12:53:39.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.937+0000 7f5f28b74640 1 -- 172.21.15.5:0/1674556806 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5f04066280 msgr2=0x7f5f04068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:39.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.937+0000 7f5f28b74640 1 --2- 172.21.15.5:0/1674556806 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5f04066280 0x7f5f04068730 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c007fd0 tx=0x7f5f0c007c20 comp rx=0 tx=0).stop 2023-07-14T12:53:39.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.937+0000 7f5f28b74640 1 -- 172.21.15.5:0/1674556806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f240aeb40 msgr2=0x7f5f2414cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:39.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.937+0000 7f5f28b74640 1 --2- 172.21.15.5:0/1674556806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f240aeb40 0x7f5f2414cd00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5f140b2040 tx=0x7f5f1401b830 comp rx=0 tx=0).stop 2023-07-14T12:53:39.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.937+0000 7f5f28b74640 1 -- 172.21.15.5:0/1674556806 shutdown_connections 2023-07-14T12:53:39.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.937+0000 7f5f28b74640 1 --2- 172.21.15.5:0/1674556806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f24159440 0x7f5f2414d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.937+0000 7f5f28b74640 1 --2- 172.21.15.5:0/1674556806 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5f04066280 0x7f5f04068730 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.937+0000 7f5f28b74640 1 --2- 172.21.15.5:0/1674556806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f240aef10 0x7f5f240b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.937+0000 7f5f28b74640 1 --2- 172.21.15.5:0/1674556806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f240aeb40 0x7f5f2414cd00 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:39.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.937+0000 7f5f28b74640 1 -- 172.21.15.5:0/1674556806 >> 172.21.15.5:0/1674556806 conn(0x7f5f240cde90 msgr2=0x7f5f240c3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:39.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.937+0000 7f5f28b74640 1 -- 172.21.15.5:0/1674556806 shutdown_connections 2023-07-14T12:53:39.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:39.937+0000 7f5f28b74640 1 -- 172.21.15.5:0/1674556806 wait complete. 2023-07-14T12:53:39.986 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T12:53:40.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.105+0000 7f681f693640 1 Processor -- start 2023-07-14T12:53:40.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.105+0000 7f681f693640 1 -- start start 2023-07-14T12:53:40.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.105+0000 7f681f693640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f681815bde0 0x7f68180d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:40.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.105+0000 7f681f693640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f68180d2300 0x7f68180d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:40.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.105+0000 7f681f693640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68180b04c0 con 0x7f68180d2fc0 2023-07-14T12:53:40.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.105+0000 7f681f693640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68180d2ce0 con 0x7f68180d2300 2023-07-14T12:53:40.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.105+0000 7f681f693640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f681815c1b0 con 0x7f681815bde0 2023-07-14T12:53:40.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.105+0000 7f681dc30640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f68180d2300 0x7f68180d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:40.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.105+0000 7f681dc30640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f68180d2300 0x7f68180d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50628/0 (socket says 172.21.15.5:50628) 2023-07-14T12:53:40.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.105+0000 7f681dc30640 1 -- 172.21.15.5:0/2894421598 learned_addr learned my addr 172.21.15.5:0/2894421598 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:40.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.105+0000 7f681d42f640 1 --2- 172.21.15.5:0/2894421598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f681815bde0 0x7f68180d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:40.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.105+0000 7f681dc30640 1 -- 172.21.15.5:0/2894421598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f681815bde0 msgr2=0x7f68180d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:40.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.105+0000 7f681dc30640 1 --2- 172.21.15.5:0/2894421598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f681815bde0 0x7f68180d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:40.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.105+0000 7f681dc30640 1 -- 172.21.15.5:0/2894421598 >> v1:172.21.15.154:6789/0 conn(0x7f68180d2fc0 legacy=0x7f68180b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:40.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.105+0000 7f681dc30640 1 -- 172.21.15.5:0/2894421598 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68180b1060 con 0x7f68180d2300 2023-07-14T12:53:40.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.109+0000 7f681dc30640 1 --2- 172.21.15.5:0/2894421598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68180d2300 0x7f68180d27a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6810009e50 tx=0x7f681001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8f7aee0b61f678 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:40.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.109+0000 7f680ffff640 1 -- 172.21.15.5:0/2894421598 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68100a57f0 con 0x7f68180d2300 2023-07-14T12:53:40.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.109+0000 7f680ffff640 1 -- 172.21.15.5:0/2894421598 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68100a5950 con 0x7f68180d2300 2023-07-14T12:53:40.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.109+0000 7f680ffff640 1 -- 172.21.15.5:0/2894421598 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68100a5ce0 con 0x7f68180d2300 2023-07-14T12:53:40.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.109+0000 7f681f693640 1 -- 172.21.15.5:0/2894421598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68180d2300 msgr2=0x7f68180d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:40.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.109+0000 7f681f693640 1 --2- 172.21.15.5:0/2894421598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68180d2300 0x7f68180d27a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6810009e50 tx=0x7f681001ca10 comp rx=0 tx=0).stop 2023-07-14T12:53:40.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.109+0000 7f681f693640 1 -- 172.21.15.5:0/2894421598 shutdown_connections 2023-07-14T12:53:40.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.109+0000 7f681f693640 1 --2- 172.21.15.5:0/2894421598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68180d2300 0x7f68180d27a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:40.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.109+0000 7f681f693640 1 --2- 172.21.15.5:0/2894421598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f681815bde0 0x7f68180d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:40.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.109+0000 7f681f693640 1 -- 172.21.15.5:0/2894421598 >> 172.21.15.5:0/2894421598 conn(0x7f68180659d0 msgr2=0x7f681809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:40.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.109+0000 7f681f693640 1 -- 172.21.15.5:0/2894421598 shutdown_connections 2023-07-14T12:53:40.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.109+0000 7f681f693640 1 -- 172.21.15.5:0/2894421598 wait complete. 2023-07-14T12:53:40.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.113+0000 7f681f693640 1 Processor -- start 2023-07-14T12:53:40.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.113+0000 7f681f693640 1 -- start start 2023-07-14T12:53:40.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.113+0000 7f681f693640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68180d2300 0x7f681814e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:40.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.113+0000 7f681f693640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68180d2fc0 0x7f681814c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:40.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.113+0000 7f681f693640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f681815bde0 0x7f68180cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:40.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.113+0000 7f681f693640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681814dfa0 con 0x7f68180d2fc0 2023-07-14T12:53:40.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.113+0000 7f681f693640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681815a660 con 0x7f68180d2300 2023-07-14T12:53:40.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.113+0000 7f681f693640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f681814d0d0 con 0x7f681815bde0 2023-07-14T12:53:40.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.113+0000 7f681cc2e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68180d2fc0 0x7f681814c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:40.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.113+0000 7f681cc2e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68180d2fc0 0x7f681814c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50630/0 (socket says 172.21.15.5:50630) 2023-07-14T12:53:40.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.113+0000 7f681cc2e640 1 -- 172.21.15.5:0/1746751171 learned_addr learned my addr 172.21.15.5:0/1746751171 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:40.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.113+0000 7f681d42f640 1 --2- 172.21.15.5:0/1746751171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68180d2300 0x7f681814e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:40.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.113+0000 7f681dc30640 1 --2- 172.21.15.5:0/1746751171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f681815bde0 0x7f68180cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:40.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.113+0000 7f681cc2e640 1 -- 172.21.15.5:0/1746751171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f681815bde0 msgr2=0x7f68180cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:40.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.113+0000 7f681cc2e640 1 --2- 172.21.15.5:0/1746751171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f681815bde0 0x7f68180cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:40.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.113+0000 7f681cc2e640 1 -- 172.21.15.5:0/1746751171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68180d2300 msgr2=0x7f681814e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:40.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.113+0000 7f681cc2e640 1 --2- 172.21.15.5:0/1746751171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68180d2300 0x7f681814e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:40.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.113+0000 7f681cc2e640 1 -- 172.21.15.5:0/1746751171 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6810009b30 con 0x7f68180d2fc0 2023-07-14T12:53:40.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.113+0000 7f681d42f640 1 --2- 172.21.15.5:0/1746751171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68180d2300 0x7f681814e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:40.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.113+0000 7f681dc30640 1 --2- 172.21.15.5:0/1746751171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f681815bde0 0x7f68180cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:40.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.113+0000 7f681cc2e640 1 --2- 172.21.15.5:0/1746751171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68180d2fc0 0x7f681814c8a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f680800c530 tx=0x7f680800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:40.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.113+0000 7f680dffb640 1 -- 172.21.15.5:0/1746751171 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808005220 con 0x7f68180d2fc0 2023-07-14T12:53:40.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.113+0000 7f680dffb640 1 -- 172.21.15.5:0/1746751171 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6808005380 con 0x7f68180d2fc0 2023-07-14T12:53:40.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.113+0000 7f680dffb640 1 -- 172.21.15.5:0/1746751171 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808007270 con 0x7f68180d2fc0 2023-07-14T12:53:40.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.113+0000 7f681f693640 1 -- 172.21.15.5:0/1746751171 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f681814e900 con 0x7f68180d2fc0 2023-07-14T12:53:40.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.113+0000 7f681f693640 1 -- 172.21.15.5:0/1746751171 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f681814d600 con 0x7f68180d2fc0 2023-07-14T12:53:40.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.117+0000 7f681f693640 1 -- 172.21.15.5:0/1746751171 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f681814e0e0 con 0x7f68180d2fc0 2023-07-14T12:53:40.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.117+0000 7f680dffb640 1 -- 172.21.15.5:0/1746751171 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f68080073d0 con 0x7f68180d2fc0 2023-07-14T12:53:40.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.117+0000 7f680dffb640 1 --2- 172.21.15.5:0/1746751171 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f67fc0662b0 0x7f67fc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:40.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.117+0000 7f680dffb640 1 -- 172.21.15.5:0/1746751171 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6808083330 con 0x7f68180d2fc0 2023-07-14T12:53:40.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.117+0000 7f681d42f640 1 --2- 172.21.15.5:0/1746751171 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f67fc0662b0 0x7f67fc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:40.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.117+0000 7f681d42f640 1 --2- 172.21.15.5:0/1746751171 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f67fc0662b0 0x7f67fc068760 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6818071130 tx=0x7f6814008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:40.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.121+0000 7f680dffb640 1 -- 172.21.15.5:0/1746751171 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f681814e0e0 con 0x7f68180d2fc0 2023-07-14T12:53:40.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.277+0000 7f681f693640 1 -- 172.21.15.5:0/1746751171 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f681814e0e0 con 0x7f68180d2fc0 2023-07-14T12:53:40.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.277+0000 7f680dffb640 1 -- 172.21.15.5:0/1746751171 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v33) v1 ==== 92+0+10 (secure 0 0 0) 0x7f681814e0e0 con 0x7f68180d2fc0 2023-07-14T12:53:40.304 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T12:53:40.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.277+0000 7f681f693640 1 -- 172.21.15.5:0/1746751171 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f67fc0662b0 msgr2=0x7f67fc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:40.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.277+0000 7f681f693640 1 --2- 172.21.15.5:0/1746751171 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f67fc0662b0 0x7f67fc068760 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6818071130 tx=0x7f6814008040 comp rx=0 tx=0).stop 2023-07-14T12:53:40.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.277+0000 7f681f693640 1 -- 172.21.15.5:0/1746751171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68180d2fc0 msgr2=0x7f681814c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:40.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.277+0000 7f681f693640 1 --2- 172.21.15.5:0/1746751171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68180d2fc0 0x7f681814c8a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f680800c530 tx=0x7f680800c9f0 comp rx=0 tx=0).stop 2023-07-14T12:53:40.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.277+0000 7f681f693640 1 -- 172.21.15.5:0/1746751171 shutdown_connections 2023-07-14T12:53:40.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.277+0000 7f681f693640 1 --2- 172.21.15.5:0/1746751171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f681815bde0 0x7f68180cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:40.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.277+0000 7f681f693640 1 --2- 172.21.15.5:0/1746751171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68180d2fc0 0x7f681814c8a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:40.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.277+0000 7f681f693640 1 --2- 172.21.15.5:0/1746751171 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f67fc0662b0 0x7f67fc068760 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:40.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.277+0000 7f681f693640 1 --2- 172.21.15.5:0/1746751171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68180d2300 0x7f681814e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:40.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.277+0000 7f681f693640 1 -- 172.21.15.5:0/1746751171 >> 172.21.15.5:0/1746751171 conn(0x7f68180659d0 msgr2=0x7f681806afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:40.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.277+0000 7f681f693640 1 -- 172.21.15.5:0/1746751171 shutdown_connections 2023-07-14T12:53:40.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.277+0000 7f681f693640 1 -- 172.21.15.5:0/1746751171 wait complete. 2023-07-14T12:53:40.325 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-14T12:53:40.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.441+0000 7f52f1511640 1 Processor -- start 2023-07-14T12:53:40.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.441+0000 7f52f1511640 1 -- start start 2023-07-14T12:53:40.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.441+0000 7f52f1511640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52ec0cdcd0 0x7f52ec0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:40.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.441+0000 7f52f1511640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f52ec0ca750 0x7f52ec0cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:40.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.441+0000 7f52f1511640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52ec0cfaf0 con 0x7f52ec06a540 2023-07-14T12:53:40.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.441+0000 7f52f1511640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52ec0cef10 con 0x7f52ec0ca750 2023-07-14T12:53:40.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.441+0000 7f52f1511640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec0cfdd0 con 0x7f52ec0cdcd0 2023-07-14T12:53:40.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52eaffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f52ec06a540 0x7f52ec06a910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58404/0 (socket says 172.21.15.5:58404) 2023-07-14T12:53:40.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52eaffd640 1 -- 172.21.15.5:0/3104881591 learned_addr learned my addr 172.21.15.5:0/3104881591 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:40.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52eb7fe640 1 --2- 172.21.15.5:0/3104881591 >> v2:172.21.15.154:3300/0 conn(0x7f52ec0ca750 0x7f52ec0cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:40.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52e3fff640 1 --2- 172.21.15.5:0/3104881591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52ec0cdcd0 0x7f52ec0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:40.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52ea7fc640 1 -- 172.21.15.5:0/3104881591 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2072424006 0 0) 0x7f52ec0cfaf0 con 0x7f52ec06a540 2023-07-14T12:53:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52ea7fc640 1 -- 172.21.15.5:0/3104881591 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52d8003530 con 0x7f52ec06a540 2023-07-14T12:53:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52ea7fc640 1 -- 172.21.15.5:0/3104881591 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 670816887 0 0) 0x7f52d8003530 con 0x7f52ec06a540 2023-07-14T12:53:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52ea7fc640 1 -- 172.21.15.5:0/3104881591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52ec0cdcd0 msgr2=0x7f52ec0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52ea7fc640 1 --2- 172.21.15.5:0/3104881591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52ec0cdcd0 0x7f52ec0cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52ea7fc640 1 -- 172.21.15.5:0/3104881591 >> v2:172.21.15.154:3300/0 conn(0x7f52ec0ca750 msgr2=0x7f52ec0cabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52ea7fc640 1 --2- 172.21.15.5:0/3104881591 >> v2:172.21.15.154:3300/0 conn(0x7f52ec0ca750 0x7f52ec0cabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:40.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52ea7fc640 1 -- 172.21.15.5:0/3104881591 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ec0d00b0 con 0x7f52ec06a540 2023-07-14T12:53:40.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52ea7fc640 1 -- 172.21.15.5:0/3104881591 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f52dc001800 con 0x7f52ec06a540 2023-07-14T12:53:40.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52ea7fc640 1 -- 172.21.15.5:0/3104881591 >> v1:172.21.15.5:6789/0 conn(0x7f52ec06a540 legacy=0x7f52ec06a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:40.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52ea7fc640 1 --2- 172.21.15.5:0/3104881591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d8003980 0x7f52d8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:40.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52ea7fc640 1 --2- 172.21.15.5:0/3104881591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52d80043b0 0x7f52d8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:40.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52ea7fc640 1 --2- 172.21.15.5:0/3104881591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52ec0cdcd0 0x7f52d8004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:40.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52ea7fc640 1 -- 172.21.15.5:0/3104881591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec0cef10 con 0x7f52d8003980 2023-07-14T12:53:40.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52ea7fc640 1 -- 172.21.15.5:0/3104881591 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec0cfdd0 con 0x7f52d80043b0 2023-07-14T12:53:40.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52ea7fc640 1 -- 172.21.15.5:0/3104881591 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d800b990 con 0x7f52ec0cdcd0 2023-07-14T12:53:40.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52eaffd640 1 --2- 172.21.15.5:0/3104881591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d8003980 0x7f52d8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:40.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52e3fff640 1 --2- 172.21.15.5:0/3104881591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52d80043b0 0x7f52d8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:40.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52eb7fe640 1 --2- 172.21.15.5:0/3104881591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52ec0cdcd0 0x7f52d8004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:40.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52eaffd640 1 -- 172.21.15.5:0/3104881591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52ec0cdcd0 msgr2=0x7f52d8004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:40.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52eaffd640 1 --2- 172.21.15.5:0/3104881591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52ec0cdcd0 0x7f52d8004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:40.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52eaffd640 1 -- 172.21.15.5:0/3104881591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52d80043b0 msgr2=0x7f52d8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:40.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52eaffd640 1 --2- 172.21.15.5:0/3104881591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52d80043b0 0x7f52d8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:40.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.445+0000 7f52eaffd640 1 -- 172.21.15.5:0/3104881591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d8003530 con 0x7f52d8003980 2023-07-14T12:53:40.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.449+0000 7f52eaffd640 1 --2- 172.21.15.5:0/3104881591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d8003980 0x7f52d8003d90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f52dc00c240 tx=0x7f52dc01cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba5334827006179 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:40.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.449+0000 7f52ea7fc640 1 -- 172.21.15.5:0/3104881591 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc0a5910 con 0x7f52d8003980 2023-07-14T12:53:40.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.449+0000 7f52ea7fc640 1 -- 172.21.15.5:0/3104881591 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52dc0a5a70 con 0x7f52d8003980 2023-07-14T12:53:40.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.449+0000 7f52ea7fc640 1 -- 172.21.15.5:0/3104881591 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc0a5e40 con 0x7f52d8003980 2023-07-14T12:53:40.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.449+0000 7f52f1511640 1 -- 172.21.15.5:0/3104881591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d8003980 msgr2=0x7f52d8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:40.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.449+0000 7f52f1511640 1 --2- 172.21.15.5:0/3104881591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52d8003980 0x7f52d8003d90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f52dc00c240 tx=0x7f52dc01cc30 comp rx=0 tx=0).stop 2023-07-14T12:53:40.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.449+0000 7f52eb7fe640 1 -- 172.21.15.5:0/3104881591 reap_dead start 2023-07-14T12:53:40.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.449+0000 7f52f1511640 1 -- 172.21.15.5:0/3104881591 shutdown_connections 2023-07-14T12:53:40.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.449+0000 7f52f1511640 1 -- 172.21.15.5:0/3104881591 >> 172.21.15.5:0/3104881591 conn(0x7f52ec099490 msgr2=0x7f52ec089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:40.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.449+0000 7f52f1511640 1 -- 172.21.15.5:0/3104881591 shutdown_connections 2023-07-14T12:53:40.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.449+0000 7f52f1511640 1 -- 172.21.15.5:0/3104881591 wait complete. 2023-07-14T12:53:40.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.449+0000 7f52f1511640 1 Processor -- start 2023-07-14T12:53:40.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.449+0000 7f52f1511640 1 -- start start 2023-07-14T12:53:40.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.453+0000 7f52f1511640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52d8003980 0x7f52ec15cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:40.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.453+0000 7f52f1511640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52ec06d510 0x7f52ec06d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:40.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.453+0000 7f52f1511640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52ec1f4710 0x7f52ec1f4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:40.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.453+0000 7f52f1511640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec06e080 con 0x7f52ec06d510 2023-07-14T12:53:40.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.453+0000 7f52f1511640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec1f7760 con 0x7f52ec1f4710 2023-07-14T12:53:40.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.453+0000 7f52f1511640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec1f7a40 con 0x7f52d8003980 2023-07-14T12:53:40.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.453+0000 7f52e3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52ec06d510 0x7f52ec06d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:40.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.453+0000 7f52e3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52ec06d510 0x7f52ec06d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50654/0 (socket says 172.21.15.5:50654) 2023-07-14T12:53:40.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.453+0000 7f52e3fff640 1 -- 172.21.15.5:0/1456351291 learned_addr learned my addr 172.21.15.5:0/1456351291 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:40.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.453+0000 7f52eaffd640 1 --2- 172.21.15.5:0/1456351291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52d8003980 0x7f52ec15cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:40.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.453+0000 7f52eb7fe640 1 --2- 172.21.15.5:0/1456351291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52ec1f4710 0x7f52ec1f4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:40.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.453+0000 7f52e3fff640 1 -- 172.21.15.5:0/1456351291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52d8003980 msgr2=0x7f52ec15cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:40.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.453+0000 7f52e3fff640 1 --2- 172.21.15.5:0/1456351291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52d8003980 0x7f52ec15cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:40.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.453+0000 7f52e3fff640 1 -- 172.21.15.5:0/1456351291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52ec1f4710 msgr2=0x7f52ec1f4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:40.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.453+0000 7f52e3fff640 1 --2- 172.21.15.5:0/1456351291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52ec1f4710 0x7f52ec1f4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:40.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.453+0000 7f52e3fff640 1 -- 172.21.15.5:0/1456351291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ec1f7d20 con 0x7f52ec06d510 2023-07-14T12:53:40.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.453+0000 7f52e3fff640 1 --2- 172.21.15.5:0/1456351291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52ec06d510 0x7f52ec06d980 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f52d4011960 tx=0x7f52d4011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:40.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.453+0000 7f52e37fe640 1 -- 172.21.15.5:0/1456351291 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d400faf0 con 0x7f52ec06d510 2023-07-14T12:53:40.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.453+0000 7f52e37fe640 1 -- 172.21.15.5:0/1456351291 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d400fc50 con 0x7f52ec06d510 2023-07-14T12:53:40.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.453+0000 7f52e37fe640 1 -- 172.21.15.5:0/1456351291 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d4014440 con 0x7f52ec06d510 2023-07-14T12:53:40.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.453+0000 7f52f1511640 1 -- 172.21.15.5:0/1456351291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52ec1f8000 con 0x7f52ec06d510 2023-07-14T12:53:40.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.453+0000 7f52f1511640 1 -- 172.21.15.5:0/1456351291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ec15c5c0 con 0x7f52ec06d510 2023-07-14T12:53:40.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.453+0000 7f52f1511640 1 -- 172.21.15.5:0/1456351291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52ec1f8190 con 0x7f52ec06d510 2023-07-14T12:53:40.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.453+0000 7f52e37fe640 1 -- 172.21.15.5:0/1456351291 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f52d40145a0 con 0x7f52ec06d510 2023-07-14T12:53:40.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.457+0000 7f52e37fe640 1 --2- 172.21.15.5:0/1456351291 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f52cc066280 0x7f52cc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:40.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.457+0000 7f52e37fe640 1 -- 172.21.15.5:0/1456351291 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f52d4084280 con 0x7f52ec06d510 2023-07-14T12:53:40.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.457+0000 7f52eaffd640 1 --2- 172.21.15.5:0/1456351291 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f52cc066280 0x7f52cc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:40.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.457+0000 7f52eaffd640 1 --2- 172.21.15.5:0/1456351291 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f52cc066280 0x7f52cc068730 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f52dc0aa000 tx=0x7f52dc0b0040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:40.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.461+0000 7f52e37fe640 1 -- 172.21.15.5:0/1456351291 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f52d40519b0 con 0x7f52ec06d510 2023-07-14T12:53:40.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.621+0000 7f52f1511640 1 -- 172.21.15.5:0/1456351291 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f52ec0678d0 con 0x7f52ec06d510 2023-07-14T12:53:40.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.621+0000 7f52e37fe640 1 -- 172.21.15.5:0/1456351291 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v33) v1 ==== 84+0+126 (secure 0 0 0) 0x7f52d4054fd0 con 0x7f52ec06d510 2023-07-14T12:53:40.651 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:40.651 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-07-14T12:53:40.651 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:40.651 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-07-14T12:53:40.652 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-07-14T12:53:40.652 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T12:53:40.652 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:40.652 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 2, 2023-07-14T12:53:40.652 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": "rbd" 2023-07-14T12:53:40.653 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:40.653 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-07-14T12:53:40.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.625+0000 7f52f1511640 1 -- 172.21.15.5:0/1456351291 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f52cc066280 msgr2=0x7f52cc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:40.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.625+0000 7f52f1511640 1 --2- 172.21.15.5:0/1456351291 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f52cc066280 0x7f52cc068730 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f52dc0aa000 tx=0x7f52dc0b0040 comp rx=0 tx=0).stop 2023-07-14T12:53:40.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.625+0000 7f52f1511640 1 -- 172.21.15.5:0/1456351291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52ec06d510 msgr2=0x7f52ec06d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:40.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.625+0000 7f52f1511640 1 --2- 172.21.15.5:0/1456351291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52ec06d510 0x7f52ec06d980 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f52d4011960 tx=0x7f52d4011e20 comp rx=0 tx=0).stop 2023-07-14T12:53:40.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.625+0000 7f52f1511640 1 -- 172.21.15.5:0/1456351291 shutdown_connections 2023-07-14T12:53:40.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.625+0000 7f52f1511640 1 --2- 172.21.15.5:0/1456351291 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f52cc066280 0x7f52cc068730 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:40.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.625+0000 7f52f1511640 1 --2- 172.21.15.5:0/1456351291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52ec1f4710 0x7f52ec1f4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:40.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.625+0000 7f52f1511640 1 --2- 172.21.15.5:0/1456351291 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52ec06d510 0x7f52ec06d980 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:40.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.625+0000 7f52f1511640 1 --2- 172.21.15.5:0/1456351291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52d8003980 0x7f52ec15cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:40.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.625+0000 7f52f1511640 1 -- 172.21.15.5:0/1456351291 >> 172.21.15.5:0/1456351291 conn(0x7f52ec099490 msgr2=0x7f52ec162120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:40.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.625+0000 7f52f1511640 1 -- 172.21.15.5:0/1456351291 shutdown_connections 2023-07-14T12:53:40.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.625+0000 7f52f1511640 1 -- 172.21.15.5:0/1456351291 wait complete. 2023-07-14T12:53:40.672 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-14T12:53:40.672 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-14T12:53:40.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.793+0000 7f2e8139f640 1 Processor -- start 2023-07-14T12:53:40.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.793+0000 7f2e8139f640 1 -- start start 2023-07-14T12:53:40.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.793+0000 7f2e8139f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e7c070f30 0x7f2e7c0ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:40.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.793+0000 7f2e8139f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e7c0af2b0 0x7f2e7c15a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:40.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.793+0000 7f2e8139f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e7c159d70 con 0x7f2e7c069430 2023-07-14T12:53:40.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.793+0000 7f2e8139f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7c0c9c60 con 0x7f2e7c0af2b0 2023-07-14T12:53:40.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.793+0000 7f2e8139f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c0c9f40 con 0x7f2e7c070f30 2023-07-14T12:53:40.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.793+0000 7f2e7affd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2e7c069430 0x7f2e7c069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58416/0 (socket says 172.21.15.5:58416) 2023-07-14T12:53:40.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.793+0000 7f2e7affd640 1 -- 172.21.15.5:0/3239499700 learned_addr learned my addr 172.21.15.5:0/3239499700 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:40.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.793+0000 7f2e7b7fe640 1 --2- 172.21.15.5:0/3239499700 >> v2:172.21.15.5:3300/0 conn(0x7f2e7c0af2b0 0x7f2e7c15a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:40.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.793+0000 7f2e73fff640 1 --2- 172.21.15.5:0/3239499700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e7c070f30 0x7f2e7c0ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:40.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.793+0000 7f2e7b7fe640 1 -- 172.21.15.5:0/3239499700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e7c070f30 msgr2=0x7f2e7c0ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:40.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.793+0000 7f2e7b7fe640 1 --2- 172.21.15.5:0/3239499700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e7c070f30 0x7f2e7c0ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:40.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.793+0000 7f2e7b7fe640 1 -- 172.21.15.5:0/3239499700 >> v1:172.21.15.5:6789/0 conn(0x7f2e7c069430 legacy=0x7f2e7c069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:40.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.793+0000 7f2e7b7fe640 1 -- 172.21.15.5:0/3239499700 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7c0ca220 con 0x7f2e7c0af2b0 2023-07-14T12:53:40.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.793+0000 7f2e7a7fc640 1 -- 172.21.15.5:0/3239499700 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182188069 0 0) 0x7f2e6c001120 con 0x7f2e7c069430 2023-07-14T12:53:40.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.797+0000 7f2e7b7fe640 1 --2- 172.21.15.5:0/3239499700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e7c0af2b0 0x7f2e7c15a1f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2e74009d90 tx=0x7f2e7401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0d39f7e0801be5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:40.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.797+0000 7f2e7a7fc640 1 -- 172.21.15.5:0/3239499700 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e740a5920 con 0x7f2e7c0af2b0 2023-07-14T12:53:40.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.797+0000 7f2e7a7fc640 1 -- 172.21.15.5:0/3239499700 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e740a5a80 con 0x7f2e7c0af2b0 2023-07-14T12:53:40.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.797+0000 7f2e7a7fc640 1 -- 172.21.15.5:0/3239499700 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e740a5e10 con 0x7f2e7c0af2b0 2023-07-14T12:53:40.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.797+0000 7f2e8139f640 1 -- 172.21.15.5:0/3239499700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e7c0af2b0 msgr2=0x7f2e7c15a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:40.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.797+0000 7f2e8139f640 1 --2- 172.21.15.5:0/3239499700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e7c0af2b0 0x7f2e7c15a1f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2e74009d90 tx=0x7f2e7401c950 comp rx=0 tx=0).stop 2023-07-14T12:53:40.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.797+0000 7f2e8139f640 1 -- 172.21.15.5:0/3239499700 shutdown_connections 2023-07-14T12:53:40.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.797+0000 7f2e8139f640 1 --2- 172.21.15.5:0/3239499700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e7c0af2b0 0x7f2e7c15a1f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:40.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.797+0000 7f2e8139f640 1 --2- 172.21.15.5:0/3239499700 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e7c070f30 0x7f2e7c0ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:40.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.797+0000 7f2e8139f640 1 -- 172.21.15.5:0/3239499700 >> 172.21.15.5:0/3239499700 conn(0x7f2e7c0cde90 msgr2=0x7f2e7c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:40.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.797+0000 7f2e8139f640 1 -- 172.21.15.5:0/3239499700 shutdown_connections 2023-07-14T12:53:40.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.797+0000 7f2e8139f640 1 -- 172.21.15.5:0/3239499700 wait complete. 2023-07-14T12:53:40.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.801+0000 7f2e8139f640 1 Processor -- start 2023-07-14T12:53:40.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.801+0000 7f2e8139f640 1 -- start start 2023-07-14T12:53:40.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.801+0000 7f2e8139f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e7c069430 0x7f2e7c13d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:40.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.801+0000 7f2e8139f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e7c070f30 0x7f2e7c150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:40.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.801+0000 7f2e8139f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e7c0af2b0 0x7f2e7c0b3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:40.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.801+0000 7f2e8139f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c156310 con 0x7f2e7c0af2b0 2023-07-14T12:53:40.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.801+0000 7f2e8139f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c155700 con 0x7f2e7c070f30 2023-07-14T12:53:40.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.801+0000 7f2e8139f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c1559e0 con 0x7f2e7c069430 2023-07-14T12:53:40.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.801+0000 7f2e7b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e7c0af2b0 0x7f2e7c0b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:40.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.801+0000 7f2e7b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e7c0af2b0 0x7f2e7c0b3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50674/0 (socket says 172.21.15.5:50674) 2023-07-14T12:53:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.801+0000 7f2e7b7fe640 1 -- 172.21.15.5:0/1029779239 learned_addr learned my addr 172.21.15.5:0/1029779239 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.801+0000 7f2e73fff640 1 --2- 172.21.15.5:0/1029779239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e7c070f30 0x7f2e7c150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.801+0000 7f2e7affd640 1 --2- 172.21.15.5:0/1029779239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e7c069430 0x7f2e7c13d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.801+0000 7f2e7b7fe640 1 -- 172.21.15.5:0/1029779239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e7c069430 msgr2=0x7f2e7c13d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:40.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.801+0000 7f2e7b7fe640 1 --2- 172.21.15.5:0/1029779239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e7c069430 0x7f2e7c13d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:40.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.801+0000 7f2e7b7fe640 1 -- 172.21.15.5:0/1029779239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e7c070f30 msgr2=0x7f2e7c150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:40.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.801+0000 7f2e7b7fe640 1 --2- 172.21.15.5:0/1029779239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e7c070f30 0x7f2e7c150110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.801+0000 7f2e7b7fe640 1 -- 172.21.15.5:0/1029779239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e74009a70 con 0x7f2e7c0af2b0 2023-07-14T12:53:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.801+0000 7f2e7affd640 1 --2- 172.21.15.5:0/1029779239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e7c069430 0x7f2e7c13d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.801+0000 7f2e7b7fe640 1 --2- 172.21.15.5:0/1029779239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e7c0af2b0 0x7f2e7c0b3410 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2e740b0040 tx=0x7f2e740196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.801+0000 7f2e737fe640 1 -- 172.21.15.5:0/1029779239 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e740b8890 con 0x7f2e7c0af2b0 2023-07-14T12:53:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.801+0000 7f2e737fe640 1 -- 172.21.15.5:0/1029779239 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e740b89f0 con 0x7f2e7c0af2b0 2023-07-14T12:53:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.801+0000 7f2e737fe640 1 -- 172.21.15.5:0/1029779239 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e740b8de0 con 0x7f2e7c0af2b0 2023-07-14T12:53:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.801+0000 7f2e8139f640 1 -- 172.21.15.5:0/1029779239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e7c155cc0 con 0x7f2e7c0af2b0 2023-07-14T12:53:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.801+0000 7f2e8139f640 1 -- 172.21.15.5:0/1029779239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e7c13dd70 con 0x7f2e7c0af2b0 2023-07-14T12:53:40.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.805+0000 7f2e8139f640 1 -- 172.21.15.5:0/1029779239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e7c0678d0 con 0x7f2e7c0af2b0 2023-07-14T12:53:40.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.805+0000 7f2e737fe640 1 -- 172.21.15.5:0/1029779239 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2e740b4040 con 0x7f2e7c0af2b0 2023-07-14T12:53:40.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.805+0000 7f2e737fe640 1 --2- 172.21.15.5:0/1029779239 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2e5c066280 0x7f2e5c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:40.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.805+0000 7f2e737fe640 1 -- 172.21.15.5:0/1029779239 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2e7411ebf0 con 0x7f2e7c0af2b0 2023-07-14T12:53:40.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.805+0000 7f2e7affd640 1 --2- 172.21.15.5:0/1029779239 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2e5c066280 0x7f2e5c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:40.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.809+0000 7f2e7affd640 1 --2- 172.21.15.5:0/1029779239 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2e5c066280 0x7f2e5c068730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c000f70 tx=0x7f2e6c007cd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:40.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.809+0000 7f2e737fe640 1 -- 172.21.15.5:0/1029779239 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2e740ec320 con 0x7f2e7c0af2b0 2023-07-14T12:53:40.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:40.965+0000 7f2e8139f640 1 -- 172.21.15.5:0/1029779239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2e7c0cce20 con 0x7f2e7c0af2b0 2023-07-14T12:53:41.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.621+0000 7f2e737fe640 1 -- 172.21.15.5:0/1029779239 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v34) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2e740b2020 con 0x7f2e7c0af2b0 2023-07-14T12:53:41.651 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-07-14T12:53:41.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.629+0000 7f2e8139f640 1 -- 172.21.15.5:0/1029779239 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2e5c066280 msgr2=0x7f2e5c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:41.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.629+0000 7f2e8139f640 1 --2- 172.21.15.5:0/1029779239 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2e5c066280 0x7f2e5c068730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c000f70 tx=0x7f2e6c007cd0 comp rx=0 tx=0).stop 2023-07-14T12:53:41.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.629+0000 7f2e8139f640 1 -- 172.21.15.5:0/1029779239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e7c0af2b0 msgr2=0x7f2e7c0b3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:41.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.629+0000 7f2e8139f640 1 --2- 172.21.15.5:0/1029779239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e7c0af2b0 0x7f2e7c0b3410 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2e740b0040 tx=0x7f2e740196f0 comp rx=0 tx=0).stop 2023-07-14T12:53:41.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.629+0000 7f2e8139f640 1 -- 172.21.15.5:0/1029779239 shutdown_connections 2023-07-14T12:53:41.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.629+0000 7f2e8139f640 1 --2- 172.21.15.5:0/1029779239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e7c0af2b0 0x7f2e7c0b3410 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:41.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.629+0000 7f2e8139f640 1 --2- 172.21.15.5:0/1029779239 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2e5c066280 0x7f2e5c068730 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:41.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.629+0000 7f2e8139f640 1 --2- 172.21.15.5:0/1029779239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e7c070f30 0x7f2e7c150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:41.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.629+0000 7f2e8139f640 1 --2- 172.21.15.5:0/1029779239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e7c069430 0x7f2e7c13d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:41.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.629+0000 7f2e8139f640 1 -- 172.21.15.5:0/1029779239 >> 172.21.15.5:0/1029779239 conn(0x7f2e7c0cde90 msgr2=0x7f2e7c0cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:41.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.629+0000 7f2e8139f640 1 -- 172.21.15.5:0/1029779239 shutdown_connections 2023-07-14T12:53:41.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.629+0000 7f2e8139f640 1 -- 172.21.15.5:0/1029779239 wait complete. 2023-07-14T12:53:41.683 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-14T12:53:41.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.809+0000 7f5c70fad640 1 Processor -- start 2023-07-14T12:53:41.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.809+0000 7f5c70fad640 1 -- start start 2023-07-14T12:53:41.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.813+0000 7f5c70fad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c6c06a100 0x7f5c6c06fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:41.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.813+0000 7f5c70fad640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5c6c06d650 0x7f5c6c15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:41.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.813+0000 7f5c70fad640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c6c15f6a0 con 0x7f5c6c06ff80 2023-07-14T12:53:41.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.813+0000 7f5c70fad640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c6c0703d0 con 0x7f5c6c06d650 2023-07-14T12:53:41.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.813+0000 7f5c70fad640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c160220 con 0x7f5c6c06a100 2023-07-14T12:53:41.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.813+0000 7f5c6ad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5c6c06d650 0x7f5c6c15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:41.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.813+0000 7f5c6ad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5c6c06d650 0x7f5c6c15c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50680/0 (socket says 172.21.15.5:50680) 2023-07-14T12:53:41.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.813+0000 7f5c6ad9d640 1 -- 172.21.15.5:0/305251657 learned_addr learned my addr 172.21.15.5:0/305251657 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:41.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.813+0000 7f5c6a59c640 1 --2- 172.21.15.5:0/305251657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c6c06a100 0x7f5c6c06fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:41.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.813+0000 7f5c6ad9d640 1 -- 172.21.15.5:0/305251657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c6c06a100 msgr2=0x7f5c6c06fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:41.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.813+0000 7f5c6ad9d640 1 --2- 172.21.15.5:0/305251657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c6c06a100 0x7f5c6c06fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:41.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.813+0000 7f5c6ad9d640 1 -- 172.21.15.5:0/305251657 >> v1:172.21.15.5:6789/0 conn(0x7f5c6c06ff80 legacy=0x7f5c6c06cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:41.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.813+0000 7f5c6ad9d640 1 -- 172.21.15.5:0/305251657 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6c06a4d0 con 0x7f5c6c06d650 2023-07-14T12:53:41.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.813+0000 7f5c6ad9d640 1 --2- 172.21.15.5:0/305251657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c6c06d650 0x7f5c6c15c0b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5c64009e50 tx=0x7f5c6401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=778afb82ace27fbc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:41.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.817+0000 7f5c69d9b640 1 -- 172.21.15.5:0/305251657 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c640a5820 con 0x7f5c6c06d650 2023-07-14T12:53:41.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.817+0000 7f5c69d9b640 1 -- 172.21.15.5:0/305251657 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c640a5980 con 0x7f5c6c06d650 2023-07-14T12:53:41.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.817+0000 7f5c69d9b640 1 -- 172.21.15.5:0/305251657 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c640a5d10 con 0x7f5c6c06d650 2023-07-14T12:53:41.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.817+0000 7f5c70fad640 1 -- 172.21.15.5:0/305251657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c6c06d650 msgr2=0x7f5c6c15c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:41.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.817+0000 7f5c70fad640 1 --2- 172.21.15.5:0/305251657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c6c06d650 0x7f5c6c15c0b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5c64009e50 tx=0x7f5c6401c960 comp rx=0 tx=0).stop 2023-07-14T12:53:41.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.817+0000 7f5c70fad640 1 -- 172.21.15.5:0/305251657 shutdown_connections 2023-07-14T12:53:41.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.817+0000 7f5c70fad640 1 --2- 172.21.15.5:0/305251657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c6c06d650 0x7f5c6c15c0b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:41.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.817+0000 7f5c70fad640 1 --2- 172.21.15.5:0/305251657 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c6c06a100 0x7f5c6c06fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:41.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.817+0000 7f5c70fad640 1 -- 172.21.15.5:0/305251657 >> 172.21.15.5:0/305251657 conn(0x7f5c6c0b0490 msgr2=0x7f5c6c0b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:41.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.817+0000 7f5c70fad640 1 -- 172.21.15.5:0/305251657 shutdown_connections 2023-07-14T12:53:41.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.817+0000 7f5c70fad640 1 -- 172.21.15.5:0/305251657 wait complete. 2023-07-14T12:53:41.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.817+0000 7f5c70fad640 1 Processor -- start 2023-07-14T12:53:41.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.817+0000 7f5c70fad640 1 -- start start 2023-07-14T12:53:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.817+0000 7f5c70fad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c6c06a100 0x7f5c6c1612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.817+0000 7f5c70fad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c6c06d650 0x7f5c6c1f7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.817+0000 7f5c70fad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c6c06ff80 0x7f5c6c1621b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.817+0000 7f5c70fad640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c159e50 con 0x7f5c6c06ff80 2023-07-14T12:53:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.817+0000 7f5c70fad640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c1f82c0 con 0x7f5c6c06a100 2023-07-14T12:53:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.817+0000 7f5c70fad640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c1f85a0 con 0x7f5c6c06d650 2023-07-14T12:53:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.821+0000 7f5c6ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c6c06ff80 0x7f5c6c1621b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.821+0000 7f5c6ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c6c06ff80 0x7f5c6c1621b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50682/0 (socket says 172.21.15.5:50682) 2023-07-14T12:53:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.821+0000 7f5c6ad9d640 1 -- 172.21.15.5:0/2323576345 learned_addr learned my addr 172.21.15.5:0/2323576345 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.821+0000 7f5c6a59c640 1 --2- 172.21.15.5:0/2323576345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c6c06a100 0x7f5c6c1612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:41.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.821+0000 7f5c63fff640 1 --2- 172.21.15.5:0/2323576345 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c6c06d650 0x7f5c6c1f7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.821+0000 7f5c6ad9d640 1 -- 172.21.15.5:0/2323576345 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c6c06d650 msgr2=0x7f5c6c1f7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.821+0000 7f5c6ad9d640 1 --2- 172.21.15.5:0/2323576345 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c6c06d650 0x7f5c6c1f7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.821+0000 7f5c6ad9d640 1 -- 172.21.15.5:0/2323576345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c6c06a100 msgr2=0x7f5c6c1612b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.821+0000 7f5c6ad9d640 1 --2- 172.21.15.5:0/2323576345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c6c06a100 0x7f5c6c1612b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.821+0000 7f5c6ad9d640 1 -- 172.21.15.5:0/2323576345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c64009b30 con 0x7f5c6c06ff80 2023-07-14T12:53:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.821+0000 7f5c6ad9d640 1 --2- 172.21.15.5:0/2323576345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c6c06ff80 0x7f5c6c1621b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5c6401a590 tx=0x7f5c64019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.821+0000 7f5c62ffd640 1 -- 172.21.15.5:0/2323576345 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c640b8670 con 0x7f5c6c06ff80 2023-07-14T12:53:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.821+0000 7f5c62ffd640 1 -- 172.21.15.5:0/2323576345 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c640b87d0 con 0x7f5c6c06ff80 2023-07-14T12:53:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.821+0000 7f5c70fad640 1 -- 172.21.15.5:0/2323576345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c6c15a0c0 con 0x7f5c6c06ff80 2023-07-14T12:53:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.821+0000 7f5c62ffd640 1 -- 172.21.15.5:0/2323576345 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c640b8b40 con 0x7f5c6c06ff80 2023-07-14T12:53:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.821+0000 7f5c70fad640 1 -- 172.21.15.5:0/2323576345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c6c1f8880 con 0x7f5c6c06ff80 2023-07-14T12:53:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.821+0000 7f5c70fad640 1 -- 172.21.15.5:0/2323576345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c6c0678d0 con 0x7f5c6c06ff80 2023-07-14T12:53:41.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.821+0000 7f5c62ffd640 1 -- 172.21.15.5:0/2323576345 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5c640b8ca0 con 0x7f5c6c06ff80 2023-07-14T12:53:41.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.825+0000 7f5c62ffd640 1 --2- 172.21.15.5:0/2323576345 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5c4c066280 0x7f5c4c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:41.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.825+0000 7f5c62ffd640 1 -- 172.21.15.5:0/2323576345 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f5c6411f0b0 con 0x7f5c6c06ff80 2023-07-14T12:53:41.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.825+0000 7f5c6a59c640 1 --2- 172.21.15.5:0/2323576345 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5c4c066280 0x7f5c4c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:41.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.825+0000 7f5c6a59c640 1 --2- 172.21.15.5:0/2323576345 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5c4c066280 0x7f5c4c068730 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c0079c0 tx=0x7f5c5c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:41.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.829+0000 7f5c62ffd640 1 -- 172.21.15.5:0/2323576345 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f5c640ec720 con 0x7f5c6c06ff80 2023-07-14T12:53:42.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:41.981+0000 7f5c70fad640 1 -- 172.21.15.5:0/2323576345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5c6c15c380 con 0x7f5c6c06ff80 2023-07-14T12:53:42.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.633+0000 7f5c62ffd640 1 -- 172.21.15.5:0/2323576345 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v35) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5c640efd40 con 0x7f5c6c06ff80 2023-07-14T12:53:42.849 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-07-14T12:53:42.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.641+0000 7f5c70fad640 1 -- 172.21.15.5:0/2323576345 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5c4c066280 msgr2=0x7f5c4c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:42.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.641+0000 7f5c70fad640 1 --2- 172.21.15.5:0/2323576345 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5c4c066280 0x7f5c4c068730 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c0079c0 tx=0x7f5c5c008040 comp rx=0 tx=0).stop 2023-07-14T12:53:42.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.641+0000 7f5c70fad640 1 -- 172.21.15.5:0/2323576345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c6c06ff80 msgr2=0x7f5c6c1621b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:42.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.641+0000 7f5c70fad640 1 --2- 172.21.15.5:0/2323576345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c6c06ff80 0x7f5c6c1621b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5c6401a590 tx=0x7f5c64019700 comp rx=0 tx=0).stop 2023-07-14T12:53:42.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.641+0000 7f5c70fad640 1 -- 172.21.15.5:0/2323576345 shutdown_connections 2023-07-14T12:53:42.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.641+0000 7f5c70fad640 1 --2- 172.21.15.5:0/2323576345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c6c06ff80 0x7f5c6c1621b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:42.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.641+0000 7f5c70fad640 1 --2- 172.21.15.5:0/2323576345 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c6c06d650 0x7f5c6c1f7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:42.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.641+0000 7f5c70fad640 1 --2- 172.21.15.5:0/2323576345 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5c4c066280 0x7f5c4c068730 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:42.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.641+0000 7f5c70fad640 1 --2- 172.21.15.5:0/2323576345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c6c06a100 0x7f5c6c1612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:42.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.641+0000 7f5c70fad640 1 -- 172.21.15.5:0/2323576345 >> 172.21.15.5:0/2323576345 conn(0x7f5c6c0b0490 msgr2=0x7f5c6c0cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:42.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.649+0000 7f5c70fad640 1 -- 172.21.15.5:0/2323576345 shutdown_connections 2023-07-14T12:53:42.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.649+0000 7f5c70fad640 1 -- 172.21.15.5:0/2323576345 wait complete. 2023-07-14T12:53:42.851 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-14T12:53:43.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.977+0000 7f87e1b9d640 1 Processor -- start 2023-07-14T12:53:43.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.977+0000 7f87e1b9d640 1 -- start start 2023-07-14T12:53:43.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.977+0000 7f87e1b9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f87dc159440 0x7f87dc0c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:43.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.977+0000 7f87e1b9d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87dc1532b0 con 0x7f87dc15cef0 2023-07-14T12:53:43.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.977+0000 7f87e1b9d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87dc0ca6f0 con 0x7f87dc0aeb40 2023-07-14T12:53:43.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.977+0000 7f87e1b9d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87dc15d360 con 0x7f87dc159440 2023-07-14T12:53:43.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.977+0000 7f87daffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f87dc15cef0 0x7f87dc158d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58438/0 (socket says 172.21.15.5:58438) 2023-07-14T12:53:43.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.977+0000 7f87daffd640 1 -- 172.21.15.5:0/965123408 learned_addr learned my addr 172.21.15.5:0/965123408 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:43.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.977+0000 7f87dbfff640 1 --2- 172.21.15.5:0/965123408 >> v2:172.21.15.154:3300/0 conn(0x7f87dc159440 0x7f87dc0c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:43.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.977+0000 7f87da7fc640 1 -- 172.21.15.5:0/965123408 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676468519 0 0) 0x7f87dc1532b0 con 0x7f87dc15cef0 2023-07-14T12:53:43.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.977+0000 7f87da7fc640 1 -- 172.21.15.5:0/965123408 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87c4005740 con 0x7f87dc15cef0 2023-07-14T12:53:43.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.977+0000 7f87da7fc640 1 -- 172.21.15.5:0/965123408 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034280784 0 0) 0x7f87dc0ca6f0 con 0x7f87dc0aeb40 2023-07-14T12:53:43.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.977+0000 7f87da7fc640 1 -- 172.21.15.5:0/965123408 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87dc1532b0 con 0x7f87dc0aeb40 2023-07-14T12:53:43.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.977+0000 7f87dbfff640 1 -- 172.21.15.5:0/965123408 >> v1:172.21.15.154:6789/0 conn(0x7f87dc0aeb40 legacy=0x7f87dc0aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:43.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.977+0000 7f87dbfff640 1 -- 172.21.15.5:0/965123408 >> v1:172.21.15.5:6789/0 conn(0x7f87dc15cef0 legacy=0x7f87dc158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:43.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.977+0000 7f87dbfff640 1 -- 172.21.15.5:0/965123408 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87dc1599d0 con 0x7f87dc159440 2023-07-14T12:53:43.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.981+0000 7f87dbfff640 1 --2- 172.21.15.5:0/965123408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc159440 0x7f87dc0c88c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f87d4009d90 tx=0x7f87d401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e48b68ef67025ea6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:43.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.981+0000 7f87da7fc640 1 -- 172.21.15.5:0/965123408 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d40a59e0 con 0x7f87dc159440 2023-07-14T12:53:43.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.981+0000 7f87da7fc640 1 -- 172.21.15.5:0/965123408 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d40a5b40 con 0x7f87dc159440 2023-07-14T12:53:43.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.981+0000 7f87da7fc640 1 -- 172.21.15.5:0/965123408 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d40ad440 con 0x7f87dc159440 2023-07-14T12:53:43.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.981+0000 7f87e1b9d640 1 -- 172.21.15.5:0/965123408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc159440 msgr2=0x7f87dc0c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:43.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.981+0000 7f87e1b9d640 1 --2- 172.21.15.5:0/965123408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc159440 0x7f87dc0c88c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f87d4009d90 tx=0x7f87d401c920 comp rx=0 tx=0).stop 2023-07-14T12:53:43.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.981+0000 7f87e1b9d640 1 -- 172.21.15.5:0/965123408 shutdown_connections 2023-07-14T12:53:43.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.981+0000 7f87e1b9d640 1 --2- 172.21.15.5:0/965123408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc159440 0x7f87dc0c88c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:43.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.981+0000 7f87e1b9d640 1 -- 172.21.15.5:0/965123408 >> 172.21.15.5:0/965123408 conn(0x7f87dc0cde90 msgr2=0x7f87dc0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:43.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.981+0000 7f87e1b9d640 1 -- 172.21.15.5:0/965123408 shutdown_connections 2023-07-14T12:53:43.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.981+0000 7f87e1b9d640 1 -- 172.21.15.5:0/965123408 wait complete. 2023-07-14T12:53:43.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.985+0000 7f87e1b9d640 1 Processor -- start 2023-07-14T12:53:43.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.985+0000 7f87e1b9d640 1 -- start start 2023-07-14T12:53:43.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.985+0000 7f87e1b9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87dc0aeb40 0x7f87dc157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:43.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.985+0000 7f87e1b9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87dc159440 0x7f87dc14d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:43.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.985+0000 7f87e1b9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc15cef0 0x7f87dc06f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:43.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.985+0000 7f87e1b9d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc0b35b0 con 0x7f87dc0aeb40 2023-07-14T12:53:43.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.985+0000 7f87e1b9d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc0b2930 con 0x7f87dc15cef0 2023-07-14T12:53:43.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.985+0000 7f87e1b9d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc0b2c10 con 0x7f87dc159440 2023-07-14T12:53:43.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.985+0000 7f87db7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87dc0aeb40 0x7f87dc157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:43.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.985+0000 7f87db7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87dc0aeb40 0x7f87dc157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50686/0 (socket says 172.21.15.5:50686) 2023-07-14T12:53:43.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.985+0000 7f87db7fe640 1 -- 172.21.15.5:0/174663433 learned_addr learned my addr 172.21.15.5:0/174663433 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:43.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.985+0000 7f87daffd640 1 --2- 172.21.15.5:0/174663433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87dc159440 0x7f87dc14d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:43.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.985+0000 7f87dbfff640 1 --2- 172.21.15.5:0/174663433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc15cef0 0x7f87dc06f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:43.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.985+0000 7f87db7fe640 1 -- 172.21.15.5:0/174663433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87dc159440 msgr2=0x7f87dc14d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:43.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.985+0000 7f87db7fe640 1 --2- 172.21.15.5:0/174663433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87dc159440 0x7f87dc14d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:43.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.985+0000 7f87db7fe640 1 -- 172.21.15.5:0/174663433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc15cef0 msgr2=0x7f87dc06f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:43.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.985+0000 7f87db7fe640 1 --2- 172.21.15.5:0/174663433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc15cef0 0x7f87dc06f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:43.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.985+0000 7f87db7fe640 1 -- 172.21.15.5:0/174663433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d4009a70 con 0x7f87dc0aeb40 2023-07-14T12:53:43.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.985+0000 7f87db7fe640 1 --2- 172.21.15.5:0/174663433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87dc0aeb40 0x7f87dc157f30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f87cc00c490 tx=0x7f87cc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:43.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.985+0000 7f87c3fff640 1 -- 172.21.15.5:0/174663433 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc0052d0 con 0x7f87dc0aeb40 2023-07-14T12:53:43.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.989+0000 7f87c3fff640 1 -- 172.21.15.5:0/174663433 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87cc005430 con 0x7f87dc0aeb40 2023-07-14T12:53:43.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.989+0000 7f87e1b9d640 1 -- 172.21.15.5:0/174663433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87dc0b2ef0 con 0x7f87dc0aeb40 2023-07-14T12:53:43.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.989+0000 7f87c3fff640 1 -- 172.21.15.5:0/174663433 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc012870 con 0x7f87dc0aeb40 2023-07-14T12:53:43.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.989+0000 7f87e1b9d640 1 -- 172.21.15.5:0/174663433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87dc158470 con 0x7f87dc0aeb40 2023-07-14T12:53:43.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.989+0000 7f87e1b9d640 1 -- 172.21.15.5:0/174663433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87dc0678d0 con 0x7f87dc0aeb40 2023-07-14T12:53:43.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.989+0000 7f87c3fff640 1 -- 172.21.15.5:0/174663433 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f87cc0129d0 con 0x7f87dc0aeb40 2023-07-14T12:53:43.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.989+0000 7f87c3fff640 1 --2- 172.21.15.5:0/174663433 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f87c8066280 0x7f87c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:43.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.989+0000 7f87c3fff640 1 -- 172.21.15.5:0/174663433 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f87cc0838a0 con 0x7f87dc0aeb40 2023-07-14T12:53:43.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.989+0000 7f87daffd640 1 --2- 172.21.15.5:0/174663433 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f87c8066280 0x7f87c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:43.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.993+0000 7f87daffd640 1 --2- 172.21.15.5:0/174663433 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f87c8066280 0x7f87c8068730 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f87dc151590 tx=0x7f87d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:43.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:42.993+0000 7f87c3fff640 1 -- 172.21.15.5:0/174663433 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f87cc050d80 con 0x7f87dc0aeb40 2023-07-14T12:53:43.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.181+0000 7f87e1b9d640 1 -- 172.21.15.5:0/174663433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f87dc0c36a0 con 0x7f87dc0aeb40 2023-07-14T12:53:43.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.645+0000 7f87c3fff640 1 -- 172.21.15.5:0/174663433 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f87cc0543a0 con 0x7f87dc0aeb40 2023-07-14T12:53:43.680 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 5 and data pool 6 2023-07-14T12:53:43.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.657+0000 7f87e1b9d640 1 -- 172.21.15.5:0/174663433 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f87c8066280 msgr2=0x7f87c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:43.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.657+0000 7f87e1b9d640 1 --2- 172.21.15.5:0/174663433 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f87c8066280 0x7f87c8068730 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f87dc151590 tx=0x7f87d0009040 comp rx=0 tx=0).stop 2023-07-14T12:53:43.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.657+0000 7f87e1b9d640 1 -- 172.21.15.5:0/174663433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87dc0aeb40 msgr2=0x7f87dc157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:43.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.657+0000 7f87e1b9d640 1 --2- 172.21.15.5:0/174663433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87dc0aeb40 0x7f87dc157f30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f87cc00c490 tx=0x7f87cc00c950 comp rx=0 tx=0).stop 2023-07-14T12:53:43.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.657+0000 7f87e1b9d640 1 -- 172.21.15.5:0/174663433 shutdown_connections 2023-07-14T12:53:43.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.657+0000 7f87e1b9d640 1 --2- 172.21.15.5:0/174663433 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f87c8066280 0x7f87c8068730 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:43.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.657+0000 7f87e1b9d640 1 --2- 172.21.15.5:0/174663433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87dc15cef0 0x7f87dc06f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:43.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.657+0000 7f87e1b9d640 1 --2- 172.21.15.5:0/174663433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87dc159440 0x7f87dc14d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:43.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.657+0000 7f87e1b9d640 1 --2- 172.21.15.5:0/174663433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87dc0aeb40 0x7f87dc157f30 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:43.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.657+0000 7f87e1b9d640 1 -- 172.21.15.5:0/174663433 >> 172.21.15.5:0/174663433 conn(0x7f87dc0cde90 msgr2=0x7f87dc0ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.657+0000 7f87e1b9d640 1 -- 172.21.15.5:0/174663433 shutdown_connections 2023-07-14T12:53:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.657+0000 7f87e1b9d640 1 -- 172.21.15.5:0/174663433 wait complete. 2023-07-14T12:53:43.722 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:53:43.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.845+0000 7f464bcd8640 1 Processor -- start 2023-07-14T12:53:43.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.845+0000 7f464bcd8640 1 -- start start 2023-07-14T12:53:43.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.845+0000 7f464bcd8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4644160330 0x7f46440cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:43.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.845+0000 7f464bcd8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f46440c8940 0x7f46440ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:43.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.845+0000 7f464bcd8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46440c17d0 con 0x7f46440c0f80 2023-07-14T12:53:43.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.845+0000 7f464bcd8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46440c14f0 con 0x7f46440c8940 2023-07-14T12:53:43.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.845+0000 7f464bcd8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46440cac10 con 0x7f4644160330 2023-07-14T12:53:43.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.845+0000 7f4649273640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f46440c8940 0x7f46440ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:43.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.845+0000 7f4649273640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f46440c8940 0x7f46440ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50692/0 (socket says 172.21.15.5:50692) 2023-07-14T12:53:43.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.845+0000 7f4649273640 1 -- 172.21.15.5:0/273490864 learned_addr learned my addr 172.21.15.5:0/273490864 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:43.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.845+0000 7f4649a74640 1 --2- 172.21.15.5:0/273490864 >> v2:172.21.15.154:3300/0 conn(0x7f4644160330 0x7f46440cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:43.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.845+0000 7f4649273640 1 -- 172.21.15.5:0/273490864 >> v2:172.21.15.154:3300/0 conn(0x7f4644160330 msgr2=0x7f46440cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:43.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.845+0000 7f4649273640 1 --2- 172.21.15.5:0/273490864 >> v2:172.21.15.154:3300/0 conn(0x7f4644160330 0x7f46440cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:43.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.845+0000 7f4649273640 1 -- 172.21.15.5:0/273490864 >> v1:172.21.15.154:6789/0 conn(0x7f46440c0f80 legacy=0x7f46440cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:43.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.845+0000 7f4649273640 1 -- 172.21.15.5:0/273490864 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46440caef0 con 0x7f46440c8940 2023-07-14T12:53:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.849+0000 7f4649273640 1 --2- 172.21.15.5:0/273490864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46440c8940 0x7f46440ccf50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4644066260 tx=0x7f463401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57a1b39d13d020c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:43.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.849+0000 7f4648a72640 1 -- 172.21.15.5:0/273490864 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46340a89f0 con 0x7f46440c8940 2023-07-14T12:53:43.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.849+0000 7f4648a72640 1 -- 172.21.15.5:0/273490864 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46340a8b50 con 0x7f46440c8940 2023-07-14T12:53:43.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.849+0000 7f4648a72640 1 -- 172.21.15.5:0/273490864 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46340b0440 con 0x7f46440c8940 2023-07-14T12:53:43.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.849+0000 7f464bcd8640 1 -- 172.21.15.5:0/273490864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46440c8940 msgr2=0x7f46440ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:43.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.849+0000 7f464bcd8640 1 --2- 172.21.15.5:0/273490864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46440c8940 0x7f46440ccf50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4644066260 tx=0x7f463401ecf0 comp rx=0 tx=0).stop 2023-07-14T12:53:43.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.849+0000 7f464bcd8640 1 -- 172.21.15.5:0/273490864 shutdown_connections 2023-07-14T12:53:43.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.849+0000 7f464bcd8640 1 --2- 172.21.15.5:0/273490864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46440c8940 0x7f46440ccf50 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:43.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.849+0000 7f464bcd8640 1 --2- 172.21.15.5:0/273490864 >> v2:172.21.15.154:3300/0 conn(0x7f4644160330 0x7f46440cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:43.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.849+0000 7f464bcd8640 1 -- 172.21.15.5:0/273490864 >> 172.21.15.5:0/273490864 conn(0x7f46440afcf0 msgr2=0x7f46440b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:43.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.849+0000 7f464bcd8640 1 -- 172.21.15.5:0/273490864 shutdown_connections 2023-07-14T12:53:43.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.849+0000 7f464bcd8640 1 -- 172.21.15.5:0/273490864 wait complete. 2023-07-14T12:53:43.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.853+0000 7f464bcd8640 1 Processor -- start 2023-07-14T12:53:43.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.853+0000 7f464bcd8640 1 -- start start 2023-07-14T12:53:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.853+0000 7f464bcd8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46440c0f80 0x7f4644150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.853+0000 7f464bcd8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46440c8940 0x7f46441f6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.853+0000 7f464bcd8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4644160330 0x7f46440c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.853+0000 7f464bcd8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4644161a10 con 0x7f46440c8940 2023-07-14T12:53:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.853+0000 7f464bcd8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4644150c50 con 0x7f4644160330 2023-07-14T12:53:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.853+0000 7f464bcd8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46441f6740 con 0x7f46440c0f80 2023-07-14T12:53:43.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.853+0000 7f4649273640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46440c8940 0x7f46441f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:43.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.853+0000 7f4649273640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46440c8940 0x7f46441f6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50700/0 (socket says 172.21.15.5:50700) 2023-07-14T12:53:43.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.853+0000 7f4649273640 1 -- 172.21.15.5:0/3408590903 learned_addr learned my addr 172.21.15.5:0/3408590903 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:43.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.853+0000 7f4649a74640 1 --2- 172.21.15.5:0/3408590903 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46440c0f80 0x7f4644150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:43.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.853+0000 7f464a275640 1 --2- 172.21.15.5:0/3408590903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4644160330 0x7f46440c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:43.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.853+0000 7f4649273640 1 -- 172.21.15.5:0/3408590903 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46440c0f80 msgr2=0x7f4644150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:43.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.853+0000 7f4649273640 1 --2- 172.21.15.5:0/3408590903 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46440c0f80 0x7f4644150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:43.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.853+0000 7f4649273640 1 -- 172.21.15.5:0/3408590903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4644160330 msgr2=0x7f46440c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:43.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.853+0000 7f4649273640 1 --2- 172.21.15.5:0/3408590903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4644160330 0x7f46440c7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:43.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.853+0000 7f4649273640 1 -- 172.21.15.5:0/3408590903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46340094d0 con 0x7f46440c8940 2023-07-14T12:53:43.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.853+0000 7f4649273640 1 --2- 172.21.15.5:0/3408590903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46440c8940 0x7f46441f6200 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f463401b900 tx=0x7f463401ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:43.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.853+0000 7f463a7fc640 1 -- 172.21.15.5:0/3408590903 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46340b1e00 con 0x7f46440c8940 2023-07-14T12:53:43.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.853+0000 7f463a7fc640 1 -- 172.21.15.5:0/3408590903 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46340b9410 con 0x7f46440c8940 2023-07-14T12:53:43.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.853+0000 7f464bcd8640 1 -- 172.21.15.5:0/3408590903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4644161bf0 con 0x7f46440c8940 2023-07-14T12:53:43.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.853+0000 7f463a7fc640 1 -- 172.21.15.5:0/3408590903 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46340b97c0 con 0x7f46440c8940 2023-07-14T12:53:43.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.853+0000 7f464bcd8640 1 -- 172.21.15.5:0/3408590903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46441621b0 con 0x7f46440c8940 2023-07-14T12:53:43.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.857+0000 7f464bcd8640 1 -- 172.21.15.5:0/3408590903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4644160700 con 0x7f46440c8940 2023-07-14T12:53:43.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.857+0000 7f463a7fc640 1 -- 172.21.15.5:0/3408590903 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f46340b7040 con 0x7f46440c8940 2023-07-14T12:53:43.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.857+0000 7f463a7fc640 1 --2- 172.21.15.5:0/3408590903 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4628066280 0x7f4628068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:43.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.857+0000 7f463a7fc640 1 -- 172.21.15.5:0/3408590903 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4634121790 con 0x7f46440c8940 2023-07-14T12:53:43.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.857+0000 7f4649a74640 1 --2- 172.21.15.5:0/3408590903 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4628066280 0x7f4628068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:43.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.857+0000 7f4649a74640 1 --2- 172.21.15.5:0/3408590903 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4628066280 0x7f4628068730 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4640009b60 tx=0x7f4640009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:43.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:43.861+0000 7f463a7fc640 1 -- 172.21.15.5:0/3408590903 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f46340eeca0 con 0x7f46440c8940 2023-07-14T12:53:44.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.025+0000 7f464bcd8640 1 -- 172.21.15.5:0/3408590903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46440cb1a0 con 0x7f46440c8940 2023-07-14T12:53:44.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.029+0000 7f463a7fc640 1 -- 172.21.15.5:0/3408590903 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18316 (secure 0 0 0) 0x7f46340f22c0 con 0x7f46440c8940 2023-07-14T12:53:44.056 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:44.056 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":36,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:53:43.186140+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:53:41.014568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-14T12:53:42.032063+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:53:44.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.029+0000 7f464bcd8640 1 -- 172.21.15.5:0/3408590903 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4628066280 msgr2=0x7f4628068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:44.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.029+0000 7f464bcd8640 1 --2- 172.21.15.5:0/3408590903 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4628066280 0x7f4628068730 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4640009b60 tx=0x7f4640009190 comp rx=0 tx=0).stop 2023-07-14T12:53:44.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.029+0000 7f464bcd8640 1 -- 172.21.15.5:0/3408590903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46440c8940 msgr2=0x7f46441f6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:44.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.029+0000 7f464bcd8640 1 --2- 172.21.15.5:0/3408590903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46440c8940 0x7f46441f6200 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f463401b900 tx=0x7f463401ba90 comp rx=0 tx=0).stop 2023-07-14T12:53:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.029+0000 7f464bcd8640 1 -- 172.21.15.5:0/3408590903 shutdown_connections 2023-07-14T12:53:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.029+0000 7f464bcd8640 1 --2- 172.21.15.5:0/3408590903 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f4628066280 0x7f4628068730 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.029+0000 7f464bcd8640 1 --2- 172.21.15.5:0/3408590903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4644160330 0x7f46440c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.029+0000 7f464bcd8640 1 --2- 172.21.15.5:0/3408590903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46440c8940 0x7f46441f6200 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.029+0000 7f464bcd8640 1 --2- 172.21.15.5:0/3408590903 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46440c0f80 0x7f4644150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.029+0000 7f464bcd8640 1 -- 172.21.15.5:0/3408590903 >> 172.21.15.5:0/3408590903 conn(0x7f46440afcf0 msgr2=0x7f46440b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:44.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.029+0000 7f464bcd8640 1 -- 172.21.15.5:0/3408590903 shutdown_connections 2023-07-14T12:53:44.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.029+0000 7f464bcd8640 1 -- 172.21.15.5:0/3408590903 wait complete. 2023-07-14T12:53:44.077 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:53:44.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.193+0000 7ff687140640 1 Processor -- start 2023-07-14T12:53:44.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.193+0000 7ff687140640 1 -- start start 2023-07-14T12:53:44.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.193+0000 7ff687140640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff680158ce0 0x7ff680070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:44.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.193+0000 7ff687140640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff6800c8ad0 0x7ff6800c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:44.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.193+0000 7ff687140640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6800c9560 0x7ff6800cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:44.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.193+0000 7ff687140640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6800c99e0 con 0x7ff6800c8ad0 2023-07-14T12:53:44.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.193+0000 7ff687140640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6800cc700 con 0x7ff680158ce0 2023-07-14T12:53:44.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.193+0000 7ff687140640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800b0ff0 con 0x7ff6800c9560 2023-07-14T12:53:44.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.193+0000 7ff67ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff6800c8ad0 0x7ff6800c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:44.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.193+0000 7ff67ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff6800c8ad0 0x7ff6800c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50712/0 (socket says 172.21.15.5:50712) 2023-07-14T12:53:44.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.193+0000 7ff67ffff640 1 -- 172.21.15.5:0/2973774686 learned_addr learned my addr 172.21.15.5:0/2973774686 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:44.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.193+0000 7ff6856dd640 1 --2- 172.21.15.5:0/2973774686 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6800c9560 0x7ff6800cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:44.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.193+0000 7ff684edc640 1 --2- 172.21.15.5:0/2973774686 >> v2:172.21.15.154:3300/0 conn(0x7ff680158ce0 0x7ff680070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:44.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.193+0000 7ff67ffff640 1 -- 172.21.15.5:0/2973774686 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6800c9560 msgr2=0x7ff6800cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:44.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.193+0000 7ff67ffff640 1 --2- 172.21.15.5:0/2973774686 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6800c9560 0x7ff6800cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:44.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.193+0000 7ff67ffff640 1 -- 172.21.15.5:0/2973774686 >> v2:172.21.15.154:3300/0 conn(0x7ff680158ce0 msgr2=0x7ff680070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:44.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.193+0000 7ff67ffff640 1 --2- 172.21.15.5:0/2973774686 >> v2:172.21.15.154:3300/0 conn(0x7ff680158ce0 0x7ff680070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:44.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.193+0000 7ff67ffff640 1 -- 172.21.15.5:0/2973774686 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff680070c80 con 0x7ff6800c8ad0 2023-07-14T12:53:44.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.197+0000 7ff67ffff640 1 --2- 172.21.15.5:0/2973774686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6800c8ad0 0x7ff6800c9020 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff680071be0 tx=0x7ff66c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8cccfa0d9b0374 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:44.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.197+0000 7ff67f7fe640 1 -- 172.21.15.5:0/2973774686 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c0ab600 con 0x7ff6800c8ad0 2023-07-14T12:53:44.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.197+0000 7ff67f7fe640 1 -- 172.21.15.5:0/2973774686 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66c0a7050 con 0x7ff6800c8ad0 2023-07-14T12:53:44.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.197+0000 7ff67f7fe640 1 -- 172.21.15.5:0/2973774686 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c0ab980 con 0x7ff6800c8ad0 2023-07-14T12:53:44.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.197+0000 7ff687140640 1 -- 172.21.15.5:0/2973774686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6800c8ad0 msgr2=0x7ff6800c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:44.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.197+0000 7ff687140640 1 --2- 172.21.15.5:0/2973774686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6800c8ad0 0x7ff6800c9020 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff680071be0 tx=0x7ff66c01c3b0 comp rx=0 tx=0).stop 2023-07-14T12:53:44.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.197+0000 7ff687140640 1 -- 172.21.15.5:0/2973774686 shutdown_connections 2023-07-14T12:53:44.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.197+0000 7ff687140640 1 --2- 172.21.15.5:0/2973774686 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6800c9560 0x7ff6800cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:44.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.197+0000 7ff687140640 1 --2- 172.21.15.5:0/2973774686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6800c8ad0 0x7ff6800c9020 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:44.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.197+0000 7ff687140640 1 --2- 172.21.15.5:0/2973774686 >> v2:172.21.15.154:3300/0 conn(0x7ff680158ce0 0x7ff680070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:44.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.197+0000 7ff687140640 1 -- 172.21.15.5:0/2973774686 >> 172.21.15.5:0/2973774686 conn(0x7ff6800afcf0 msgr2=0x7ff6800b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:44.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.197+0000 7ff687140640 1 -- 172.21.15.5:0/2973774686 shutdown_connections 2023-07-14T12:53:44.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.197+0000 7ff687140640 1 -- 172.21.15.5:0/2973774686 wait complete. 2023-07-14T12:53:44.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.201+0000 7ff687140640 1 Processor -- start 2023-07-14T12:53:44.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.201+0000 7ff687140640 1 -- start start 2023-07-14T12:53:44.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.201+0000 7ff687140640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6800c8ad0 0x7ff680146950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:44.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.201+0000 7ff687140640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6800c9560 0x7ff6801462b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:44.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.201+0000 7ff687140640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff680158ce0 0x7ff6800af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:44.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.201+0000 7ff687140640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800ae1e0 con 0x7ff6800c8ad0 2023-07-14T12:53:44.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.201+0000 7ff687140640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6801467f0 con 0x7ff680158ce0 2023-07-14T12:53:44.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.201+0000 7ff687140640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6801471d0 con 0x7ff6800c9560 2023-07-14T12:53:44.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.201+0000 7ff684edc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6800c8ad0 0x7ff680146950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:44.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.201+0000 7ff684edc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6800c8ad0 0x7ff680146950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50718/0 (socket says 172.21.15.5:50718) 2023-07-14T12:53:44.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.201+0000 7ff684edc640 1 -- 172.21.15.5:0/2039803567 learned_addr learned my addr 172.21.15.5:0/2039803567 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:44.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.201+0000 7ff67ffff640 1 --2- 172.21.15.5:0/2039803567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6800c9560 0x7ff6801462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:44.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.201+0000 7ff6856dd640 1 --2- 172.21.15.5:0/2039803567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff680158ce0 0x7ff6800af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:44.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.201+0000 7ff684edc640 1 -- 172.21.15.5:0/2039803567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6800c9560 msgr2=0x7ff6801462b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:44.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.201+0000 7ff684edc640 1 --2- 172.21.15.5:0/2039803567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6800c9560 0x7ff6801462b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:44.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.201+0000 7ff684edc640 1 -- 172.21.15.5:0/2039803567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff680158ce0 msgr2=0x7ff6800af2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:44.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.201+0000 7ff684edc640 1 --2- 172.21.15.5:0/2039803567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff680158ce0 0x7ff6800af2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:44.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.201+0000 7ff684edc640 1 -- 172.21.15.5:0/2039803567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66c0094d0 con 0x7ff6800c8ad0 2023-07-14T12:53:44.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.201+0000 7ff6856dd640 1 --2- 172.21.15.5:0/2039803567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff680158ce0 0x7ff6800af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:44.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.201+0000 7ff684edc640 1 --2- 172.21.15.5:0/2039803567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6800c8ad0 0x7ff680146950 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff67400d830 tx=0x7ff67400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:44.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.201+0000 7ff67d7fa640 1 -- 172.21.15.5:0/2039803567 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67400b6c0 con 0x7ff6800c8ad0 2023-07-14T12:53:44.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.201+0000 7ff67d7fa640 1 -- 172.21.15.5:0/2039803567 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67400b820 con 0x7ff6800c8ad0 2023-07-14T12:53:44.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.201+0000 7ff687140640 1 -- 172.21.15.5:0/2039803567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6800af810 con 0x7ff6800c8ad0 2023-07-14T12:53:44.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.201+0000 7ff67d7fa640 1 -- 172.21.15.5:0/2039803567 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67400bb90 con 0x7ff6800c8ad0 2023-07-14T12:53:44.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.201+0000 7ff687140640 1 -- 172.21.15.5:0/2039803567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6800afa40 con 0x7ff6800c8ad0 2023-07-14T12:53:44.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.205+0000 7ff687140640 1 -- 172.21.15.5:0/2039803567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6800ca1a0 con 0x7ff6800c8ad0 2023-07-14T12:53:44.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.205+0000 7ff67d7fa640 1 -- 172.21.15.5:0/2039803567 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff67401e460 con 0x7ff6800c8ad0 2023-07-14T12:53:44.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.205+0000 7ff67d7fa640 1 --2- 172.21.15.5:0/2039803567 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff664066280 0x7ff664068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:44.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.205+0000 7ff67d7fa640 1 -- 172.21.15.5:0/2039803567 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff6740842b0 con 0x7ff6800c8ad0 2023-07-14T12:53:44.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.205+0000 7ff67ffff640 1 --2- 172.21.15.5:0/2039803567 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff664066280 0x7ff664068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:44.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.205+0000 7ff67ffff640 1 --2- 172.21.15.5:0/2039803567 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff664066280 0x7ff664068730 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0ad000 tx=0x7ff66c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:44.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.209+0000 7ff67d7fa640 1 -- 172.21.15.5:0/2039803567 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff674051720 con 0x7ff6800c8ad0 2023-07-14T12:53:44.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.365+0000 7ff687140640 1 -- 172.21.15.5:0/2039803567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6800678d0 con 0x7ff6800c8ad0 2023-07-14T12:53:44.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.365+0000 7ff67d7fa640 1 -- 172.21.15.5:0/2039803567 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18316 (secure 0 0 0) 0x7ff674054d40 con 0x7ff6800c8ad0 2023-07-14T12:53:44.395 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:44.396 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":36,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:53:43.186140+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:53:41.014568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-14T12:53:42.032063+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:53:44.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.369+0000 7ff687140640 1 -- 172.21.15.5:0/2039803567 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff664066280 msgr2=0x7ff664068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:44.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.369+0000 7ff687140640 1 --2- 172.21.15.5:0/2039803567 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff664066280 0x7ff664068730 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0ad000 tx=0x7ff66c008040 comp rx=0 tx=0).stop 2023-07-14T12:53:44.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.369+0000 7ff687140640 1 -- 172.21.15.5:0/2039803567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6800c8ad0 msgr2=0x7ff680146950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:44.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.369+0000 7ff687140640 1 --2- 172.21.15.5:0/2039803567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6800c8ad0 0x7ff680146950 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff67400d830 tx=0x7ff67400dcf0 comp rx=0 tx=0).stop 2023-07-14T12:53:44.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.369+0000 7ff687140640 1 -- 172.21.15.5:0/2039803567 shutdown_connections 2023-07-14T12:53:44.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.369+0000 7ff687140640 1 --2- 172.21.15.5:0/2039803567 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff664066280 0x7ff664068730 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:44.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.369+0000 7ff687140640 1 --2- 172.21.15.5:0/2039803567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff680158ce0 0x7ff6800af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:44.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.369+0000 7ff687140640 1 --2- 172.21.15.5:0/2039803567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6800c9560 0x7ff6801462b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:44.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.369+0000 7ff687140640 1 --2- 172.21.15.5:0/2039803567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6800c8ad0 0x7ff680146950 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:44.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.369+0000 7ff687140640 1 -- 172.21.15.5:0/2039803567 >> 172.21.15.5:0/2039803567 conn(0x7ff6800afcf0 msgr2=0x7ff68014e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:44.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.369+0000 7ff687140640 1 -- 172.21.15.5:0/2039803567 shutdown_connections 2023-07-14T12:53:44.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.369+0000 7ff687140640 1 -- 172.21.15.5:0/2039803567 wait complete. 2023-07-14T12:53:44.416 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-14T12:53:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.537+0000 7f59dbb96640 1 Processor -- start 2023-07-14T12:53:44.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.537+0000 7f59dbb96640 1 -- start start 2023-07-14T12:53:44.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.537+0000 7f59dbb96640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f59d40c3ac0 0x7f59d40c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:44.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.537+0000 7f59dbb96640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d40695b0 con 0x7f59d40af2b0 2023-07-14T12:53:44.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.537+0000 7f59dbb96640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d4069890 con 0x7f59d40cd120 2023-07-14T12:53:44.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.537+0000 7f59dbb96640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d4069b70 con 0x7f59d40c3ac0 2023-07-14T12:53:44.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.537+0000 7f59d9131640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f59d40af2b0 0x7f59d40ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58448/0 (socket says 172.21.15.5:58448) 2023-07-14T12:53:44.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.537+0000 7f59d9131640 1 -- 172.21.15.5:0/4099868052 learned_addr learned my addr 172.21.15.5:0/4099868052 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:44.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.537+0000 7f59d9932640 1 --2- 172.21.15.5:0/4099868052 >> v2:172.21.15.154:3300/0 conn(0x7f59d40c3ac0 0x7f59d40c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:44.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.537+0000 7f59d8930640 1 -- 172.21.15.5:0/4099868052 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2405141647 0 0) 0x7f59d40695b0 con 0x7f59d40af2b0 2023-07-14T12:53:44.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.537+0000 7f59d8930640 1 -- 172.21.15.5:0/4099868052 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59c0003530 con 0x7f59d40af2b0 2023-07-14T12:53:44.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.537+0000 7f59d9932640 1 -- 172.21.15.5:0/4099868052 >> v1:172.21.15.154:6789/0 conn(0x7f59d40cd120 legacy=0x7f59d40cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:44.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.537+0000 7f59d8930640 1 -- 172.21.15.5:0/4099868052 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 766110159 0 0) 0x7f59d4069890 con 0x7f59d40cd120 2023-07-14T12:53:44.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.537+0000 7f59d9932640 1 -- 172.21.15.5:0/4099868052 >> v1:172.21.15.5:6789/0 conn(0x7f59d40af2b0 legacy=0x7f59d40ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:44.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.537+0000 7f59d9932640 1 -- 172.21.15.5:0/4099868052 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d4069e50 con 0x7f59d40c3ac0 2023-07-14T12:53:44.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.541+0000 7f59d9932640 1 --2- 172.21.15.5:0/4099868052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59d40c3ac0 0x7f59d40c2d30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f59d00097c0 tx=0x7f59d001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c84aa5fd988811b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:44.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.541+0000 7f59d8930640 1 -- 172.21.15.5:0/4099868052 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d00a6040 con 0x7f59d40c3ac0 2023-07-14T12:53:44.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.541+0000 7f59d8930640 1 -- 172.21.15.5:0/4099868052 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d00aa600 con 0x7f59d40c3ac0 2023-07-14T12:53:44.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.541+0000 7f59d8930640 1 -- 172.21.15.5:0/4099868052 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d00aa990 con 0x7f59d40c3ac0 2023-07-14T12:53:44.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.541+0000 7f59dbb96640 1 -- 172.21.15.5:0/4099868052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59d40c3ac0 msgr2=0x7f59d40c2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:44.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.541+0000 7f59dbb96640 1 --2- 172.21.15.5:0/4099868052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59d40c3ac0 0x7f59d40c2d30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f59d00097c0 tx=0x7f59d001c480 comp rx=0 tx=0).stop 2023-07-14T12:53:44.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.541+0000 7f59dbb96640 1 -- 172.21.15.5:0/4099868052 shutdown_connections 2023-07-14T12:53:44.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.541+0000 7f59dbb96640 1 --2- 172.21.15.5:0/4099868052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59d40c3ac0 0x7f59d40c2d30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:44.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.541+0000 7f59dbb96640 1 -- 172.21.15.5:0/4099868052 >> 172.21.15.5:0/4099868052 conn(0x7f59d40cde90 msgr2=0x7f59d40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:44.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.541+0000 7f59dbb96640 1 -- 172.21.15.5:0/4099868052 shutdown_connections 2023-07-14T12:53:44.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.541+0000 7f59dbb96640 1 -- 172.21.15.5:0/4099868052 wait complete. 2023-07-14T12:53:44.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.545+0000 7f59dbb96640 1 Processor -- start 2023-07-14T12:53:44.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.545+0000 7f59dbb96640 1 -- start start 2023-07-14T12:53:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.545+0000 7f59dbb96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f59d40af2b0 0x7f59d4152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.545+0000 7f59dbb96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59d40c3ac0 0x7f59d4157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.545+0000 7f59dbb96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59d40cd120 0x7f59d4149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.545+0000 7f59dbb96640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d41fb060 con 0x7f59d40cd120 2023-07-14T12:53:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.545+0000 7f59dbb96640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d41fb340 con 0x7f59d40c3ac0 2023-07-14T12:53:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.545+0000 7f59dbb96640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d41fb620 con 0x7f59d40af2b0 2023-07-14T12:53:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.545+0000 7f59da133640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59d40cd120 0x7f59d4149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:44.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.545+0000 7f59da133640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59d40cd120 0x7f59d4149730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50726/0 (socket says 172.21.15.5:50726) 2023-07-14T12:53:44.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.545+0000 7f59da133640 1 -- 172.21.15.5:0/2933810456 learned_addr learned my addr 172.21.15.5:0/2933810456 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:44.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.545+0000 7f59d9131640 1 --2- 172.21.15.5:0/2933810456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59d40c3ac0 0x7f59d4157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:44.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.545+0000 7f59d9932640 1 --2- 172.21.15.5:0/2933810456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f59d40af2b0 0x7f59d4152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:44.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.545+0000 7f59da133640 1 -- 172.21.15.5:0/2933810456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f59d40af2b0 msgr2=0x7f59d4152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:44.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.545+0000 7f59da133640 1 --2- 172.21.15.5:0/2933810456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f59d40af2b0 0x7f59d4152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:44.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.545+0000 7f59da133640 1 -- 172.21.15.5:0/2933810456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59d40c3ac0 msgr2=0x7f59d4157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:44.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.545+0000 7f59da133640 1 --2- 172.21.15.5:0/2933810456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59d40c3ac0 0x7f59d4157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:44.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.545+0000 7f59da133640 1 -- 172.21.15.5:0/2933810456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d0009420 con 0x7f59d40cd120 2023-07-14T12:53:44.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.545+0000 7f59d9131640 1 --2- 172.21.15.5:0/2933810456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59d40c3ac0 0x7f59d4157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:44.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.545+0000 7f59da133640 1 --2- 172.21.15.5:0/2933810456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59d40cd120 0x7f59d4149730 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f59cc002240 tx=0x7f59cc00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:44.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.545+0000 7f59ca7fc640 1 -- 172.21.15.5:0/2933810456 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc003db0 con 0x7f59d40cd120 2023-07-14T12:53:44.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.545+0000 7f59ca7fc640 1 -- 172.21.15.5:0/2933810456 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59cc00ce30 con 0x7f59d40cd120 2023-07-14T12:53:44.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.545+0000 7f59ca7fc640 1 -- 172.21.15.5:0/2933810456 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc005270 con 0x7f59d40cd120 2023-07-14T12:53:44.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.545+0000 7f59dbb96640 1 -- 172.21.15.5:0/2933810456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d41fb900 con 0x7f59d40cd120 2023-07-14T12:53:44.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.545+0000 7f59dbb96640 1 -- 172.21.15.5:0/2933810456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d414d520 con 0x7f59d40cd120 2023-07-14T12:53:44.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.545+0000 7f59dbb96640 1 -- 172.21.15.5:0/2933810456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d41fbe20 con 0x7f59d40cd120 2023-07-14T12:53:44.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.549+0000 7f59ca7fc640 1 -- 172.21.15.5:0/2933810456 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f59cc0053d0 con 0x7f59d40cd120 2023-07-14T12:53:44.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.549+0000 7f59ca7fc640 1 --2- 172.21.15.5:0/2933810456 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f59b8066280 0x7f59b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:44.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.549+0000 7f59ca7fc640 1 -- 172.21.15.5:0/2933810456 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f59cc0834d0 con 0x7f59d40cd120 2023-07-14T12:53:44.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.549+0000 7f59d9932640 1 --2- 172.21.15.5:0/2933810456 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f59b8066280 0x7f59b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:44.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.549+0000 7f59d9932640 1 --2- 172.21.15.5:0/2933810456 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f59b8066280 0x7f59b8068730 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f59d00ae000 tx=0x7f59d00a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:44.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.553+0000 7f59ca7fc640 1 -- 172.21.15.5:0/2933810456 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f59d41fbe20 con 0x7f59d40cd120 2023-07-14T12:53:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:44.745+0000 7f59dbb96640 1 -- 172.21.15.5:0/2933810456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f59d41fbe20 con 0x7f59d40cd120 2023-07-14T12:53:45.530 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:53:45.535 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:53:45.625 INFO:tasks.ceph.mds.c.smithi005.stderr:2023-07-14T12:53:45.597+0000 7f0da052f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T12:53:45.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.669+0000 7f59ca7fc640 1 -- 172.21.15.5:0/2933810456 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f59d41fbe20 con 0x7f59d40cd120 2023-07-14T12:53:45.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.673+0000 7f59dbb96640 1 -- 172.21.15.5:0/2933810456 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f59b8066280 msgr2=0x7f59b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:45.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.673+0000 7f59dbb96640 1 --2- 172.21.15.5:0/2933810456 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f59b8066280 0x7f59b8068730 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f59d00ae000 tx=0x7f59d00a7000 comp rx=0 tx=0).stop 2023-07-14T12:53:45.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.673+0000 7f59dbb96640 1 -- 172.21.15.5:0/2933810456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59d40cd120 msgr2=0x7f59d4149730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:45.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.673+0000 7f59dbb96640 1 --2- 172.21.15.5:0/2933810456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59d40cd120 0x7f59d4149730 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f59cc002240 tx=0x7f59cc00cbe0 comp rx=0 tx=0).stop 2023-07-14T12:53:45.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.673+0000 7f59dbb96640 1 -- 172.21.15.5:0/2933810456 shutdown_connections 2023-07-14T12:53:45.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.673+0000 7f59dbb96640 1 --2- 172.21.15.5:0/2933810456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59d40cd120 0x7f59d4149730 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:45.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.673+0000 7f59dbb96640 1 --2- 172.21.15.5:0/2933810456 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f59b8066280 0x7f59b8068730 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:45.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.673+0000 7f59dbb96640 1 --2- 172.21.15.5:0/2933810456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59d40c3ac0 0x7f59d4157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:45.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.673+0000 7f59dbb96640 1 --2- 172.21.15.5:0/2933810456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f59d40af2b0 0x7f59d4152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:45.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.673+0000 7f59dbb96640 1 -- 172.21.15.5:0/2933810456 >> 172.21.15.5:0/2933810456 conn(0x7f59d40cde90 msgr2=0x7f59d4070820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:45.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.673+0000 7f59dbb96640 1 -- 172.21.15.5:0/2933810456 shutdown_connections 2023-07-14T12:53:45.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.673+0000 7f59dbb96640 1 -- 172.21.15.5:0/2933810456 wait complete. 2023-07-14T12:53:45.722 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-14T12:53:45.723 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-14T12:53:45.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.889+0000 7fa356d40640 1 Processor -- start 2023-07-14T12:53:45.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.889+0000 7fa356d40640 1 -- start start 2023-07-14T12:53:45.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.889+0000 7fa356d40640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa350159440 0x7fa3500c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:45.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.889+0000 7fa356d40640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3501532b0 con 0x7fa35015cef0 2023-07-14T12:53:45.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.889+0000 7fa356d40640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3500ca6f0 con 0x7fa3500aeb40 2023-07-14T12:53:45.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.889+0000 7fa356d40640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa35015d360 con 0x7fa350159440 2023-07-14T12:53:45.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.889+0000 7fa3552dd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa350159440 0x7fa3500c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:45.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.889+0000 7fa34ffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa35015cef0 0x7fa350158d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58460/0 (socket says 172.21.15.5:58460) 2023-07-14T12:53:45.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.889+0000 7fa34ffff640 1 -- 172.21.15.5:0/3659230345 learned_addr learned my addr 172.21.15.5:0/3659230345 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:45.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.889+0000 7fa3552dd640 1 -- 172.21.15.5:0/3659230345 >> v1:172.21.15.154:6789/0 conn(0x7fa3500aeb40 legacy=0x7fa3500aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:45.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.889+0000 7fa3552dd640 1 -- 172.21.15.5:0/3659230345 >> v1:172.21.15.5:6789/0 conn(0x7fa35015cef0 legacy=0x7fa350158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:45.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.889+0000 7fa3552dd640 1 -- 172.21.15.5:0/3659230345 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3501599d0 con 0x7fa350159440 2023-07-14T12:53:45.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.889+0000 7fa34f7fe640 1 -- 172.21.15.5:0/3659230345 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3884880851 0 0) 0x7fa3501532b0 con 0x7fa35015cef0 2023-07-14T12:53:45.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.893+0000 7fa3552dd640 1 --2- 172.21.15.5:0/3659230345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa350159440 0x7fa3500c88c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa348009d90 tx=0x7fa34801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d087cdcbc92bdf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:45.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.893+0000 7fa34f7fe640 1 -- 172.21.15.5:0/3659230345 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3480a59e0 con 0x7fa350159440 2023-07-14T12:53:45.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.893+0000 7fa34f7fe640 1 -- 172.21.15.5:0/3659230345 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3480a5b40 con 0x7fa350159440 2023-07-14T12:53:45.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.893+0000 7fa34f7fe640 1 -- 172.21.15.5:0/3659230345 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3480ad440 con 0x7fa350159440 2023-07-14T12:53:45.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.893+0000 7fa356d40640 1 -- 172.21.15.5:0/3659230345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa350159440 msgr2=0x7fa3500c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:45.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.893+0000 7fa356d40640 1 --2- 172.21.15.5:0/3659230345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa350159440 0x7fa3500c88c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa348009d90 tx=0x7fa34801c920 comp rx=0 tx=0).stop 2023-07-14T12:53:45.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.893+0000 7fa356d40640 1 -- 172.21.15.5:0/3659230345 shutdown_connections 2023-07-14T12:53:45.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.893+0000 7fa356d40640 1 --2- 172.21.15.5:0/3659230345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa350159440 0x7fa3500c88c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:45.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.893+0000 7fa356d40640 1 -- 172.21.15.5:0/3659230345 >> 172.21.15.5:0/3659230345 conn(0x7fa3500cde90 msgr2=0x7fa3500ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:45.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.893+0000 7fa356d40640 1 -- 172.21.15.5:0/3659230345 shutdown_connections 2023-07-14T12:53:45.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.893+0000 7fa356d40640 1 -- 172.21.15.5:0/3659230345 wait complete. 2023-07-14T12:53:45.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.893+0000 7fa356d40640 1 Processor -- start 2023-07-14T12:53:45.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.893+0000 7fa356d40640 1 -- start start 2023-07-14T12:53:45.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.897+0000 7fa356d40640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3500aeb40 0x7fa350157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:45.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.897+0000 7fa356d40640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa350159440 0x7fa35014cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:45.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.897+0000 7fa356d40640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa35015cef0 0x7fa35006c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:45.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.897+0000 7fa356d40640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa350157450 con 0x7fa3500aeb40 2023-07-14T12:53:45.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.897+0000 7fa356d40640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35014d280 con 0x7fa35015cef0 2023-07-14T12:53:45.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.897+0000 7fa356d40640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa350070fb0 con 0x7fa350159440 2023-07-14T12:53:45.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.897+0000 7fa354adc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3500aeb40 0x7fa350157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:45.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.897+0000 7fa354adc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3500aeb40 0x7fa350157ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50748/0 (socket says 172.21.15.5:50748) 2023-07-14T12:53:45.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.897+0000 7fa354adc640 1 -- 172.21.15.5:0/3859342311 learned_addr learned my addr 172.21.15.5:0/3859342311 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:45.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.897+0000 7fa34ffff640 1 --2- 172.21.15.5:0/3859342311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa350159440 0x7fa35014cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:45.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.897+0000 7fa3552dd640 1 --2- 172.21.15.5:0/3859342311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa35015cef0 0x7fa35006c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:45.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.897+0000 7fa354adc640 1 -- 172.21.15.5:0/3859342311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa350159440 msgr2=0x7fa35014cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:45.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.897+0000 7fa354adc640 1 --2- 172.21.15.5:0/3859342311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa350159440 0x7fa35014cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:45.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.897+0000 7fa354adc640 1 -- 172.21.15.5:0/3859342311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa35015cef0 msgr2=0x7fa35006c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:45.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.897+0000 7fa354adc640 1 --2- 172.21.15.5:0/3859342311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa35015cef0 0x7fa35006c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:45.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.897+0000 7fa354adc640 1 -- 172.21.15.5:0/3859342311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa348009a70 con 0x7fa3500aeb40 2023-07-14T12:53:45.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.897+0000 7fa354adc640 1 --2- 172.21.15.5:0/3859342311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3500aeb40 0x7fa350157ec0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa34400c500 tx=0x7fa34400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:45.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.897+0000 7fa34d7fa640 1 -- 172.21.15.5:0/3859342311 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa344005220 con 0x7fa3500aeb40 2023-07-14T12:53:45.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.897+0000 7fa34d7fa640 1 -- 172.21.15.5:0/3859342311 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa344005380 con 0x7fa3500aeb40 2023-07-14T12:53:45.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.897+0000 7fa356d40640 1 -- 172.21.15.5:0/3859342311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3501576c0 con 0x7fa3500aeb40 2023-07-14T12:53:45.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.897+0000 7fa34d7fa640 1 -- 172.21.15.5:0/3859342311 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa344007270 con 0x7fa3500aeb40 2023-07-14T12:53:45.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.897+0000 7fa356d40640 1 -- 172.21.15.5:0/3859342311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa350071290 con 0x7fa3500aeb40 2023-07-14T12:53:45.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.897+0000 7fa356d40640 1 -- 172.21.15.5:0/3859342311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3500678d0 con 0x7fa3500aeb40 2023-07-14T12:53:45.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.901+0000 7fa34d7fa640 1 -- 172.21.15.5:0/3859342311 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa3440073d0 con 0x7fa3500aeb40 2023-07-14T12:53:45.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.901+0000 7fa34d7fa640 1 --2- 172.21.15.5:0/3859342311 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa334066280 0x7fa334068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:45.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.901+0000 7fa34d7fa640 1 -- 172.21.15.5:0/3859342311 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa344083550 con 0x7fa3500aeb40 2023-07-14T12:53:45.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.901+0000 7fa34ffff640 1 --2- 172.21.15.5:0/3859342311 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa334066280 0x7fa334068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:45.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.901+0000 7fa34ffff640 1 --2- 172.21.15.5:0/3859342311 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa334066280 0x7fa334068730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa33c000f70 tx=0x7fa33c007240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:45.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:45.905+0000 7fa34d7fa640 1 -- 172.21.15.5:0/3859342311 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa3440509f0 con 0x7fa3500aeb40 2023-07-14T12:53:46.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.093+0000 7fa356d40640 1 -- 172.21.15.5:0/3859342311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa350157b70 con 0x7fa3500aeb40 2023-07-14T12:53:46.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.677+0000 7fa34d7fa640 1 -- 172.21.15.5:0/3859342311 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa344054010 con 0x7fa3500aeb40 2023-07-14T12:53:46.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.681+0000 7fa356d40640 1 -- 172.21.15.5:0/3859342311 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa334066280 msgr2=0x7fa334068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.681+0000 7fa356d40640 1 --2- 172.21.15.5:0/3859342311 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa334066280 0x7fa334068730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa33c000f70 tx=0x7fa33c007240 comp rx=0 tx=0).stop 2023-07-14T12:53:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.681+0000 7fa356d40640 1 -- 172.21.15.5:0/3859342311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3500aeb40 msgr2=0x7fa350157ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.681+0000 7fa356d40640 1 --2- 172.21.15.5:0/3859342311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3500aeb40 0x7fa350157ec0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa34400c500 tx=0x7fa34400c9c0 comp rx=0 tx=0).stop 2023-07-14T12:53:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.681+0000 7fa356d40640 1 -- 172.21.15.5:0/3859342311 shutdown_connections 2023-07-14T12:53:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.681+0000 7fa356d40640 1 --2- 172.21.15.5:0/3859342311 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fa334066280 0x7fa334068730 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:46.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.681+0000 7fa356d40640 1 --2- 172.21.15.5:0/3859342311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa35015cef0 0x7fa35006c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:46.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.681+0000 7fa356d40640 1 --2- 172.21.15.5:0/3859342311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa350159440 0x7fa35014cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:46.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.681+0000 7fa356d40640 1 --2- 172.21.15.5:0/3859342311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3500aeb40 0x7fa350157ec0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:46.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.681+0000 7fa356d40640 1 -- 172.21.15.5:0/3859342311 >> 172.21.15.5:0/3859342311 conn(0x7fa3500cde90 msgr2=0x7fa3500aef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:46.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.681+0000 7fa356d40640 1 -- 172.21.15.5:0/3859342311 shutdown_connections 2023-07-14T12:53:46.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.681+0000 7fa356d40640 1 -- 172.21.15.5:0/3859342311 wait complete. 2023-07-14T12:53:46.731 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-14T12:53:46.731 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:53:46.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.853+0000 7f7e1620b640 1 Processor -- start 2023-07-14T12:53:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.853+0000 7f7e1620b640 1 -- start start 2023-07-14T12:53:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.853+0000 7f7e1620b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7e100c8ad0 0x7f7e100c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.853+0000 7f7e1620b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e100c99c0 con 0x7f7e100c9560 2023-07-14T12:53:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.853+0000 7f7e1620b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e100cc700 con 0x7f7e10158ce0 2023-07-14T12:53:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.853+0000 7f7e1620b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e100b0ff0 con 0x7f7e100c8ad0 2023-07-14T12:53:46.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.857+0000 7f7e0ffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7e100c9560 0x7f7e100ccb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58474/0 (socket says 172.21.15.5:58474) 2023-07-14T12:53:46.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.857+0000 7f7e0ffff640 1 -- 172.21.15.5:0/466648600 learned_addr learned my addr 172.21.15.5:0/466648600 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:46.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.857+0000 7f7e0effd640 1 --2- 172.21.15.5:0/466648600 >> v2:172.21.15.154:3300/0 conn(0x7f7e100c8ad0 0x7f7e100c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:46.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.857+0000 7f7e0e7fc640 1 -- 172.21.15.5:0/466648600 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 864738368 0 0) 0x7f7e100c99c0 con 0x7f7e100c9560 2023-07-14T12:53:46.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.857+0000 7f7e0e7fc640 1 -- 172.21.15.5:0/466648600 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7df8003530 con 0x7f7e100c9560 2023-07-14T12:53:46.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.857+0000 7f7e0effd640 1 -- 172.21.15.5:0/466648600 >> v1:172.21.15.154:6789/0 conn(0x7f7e10158ce0 legacy=0x7f7e10070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:46.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.857+0000 7f7e0e7fc640 1 -- 172.21.15.5:0/466648600 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4161025668 0 0) 0x7f7df8003530 con 0x7f7e100c9560 2023-07-14T12:53:46.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.857+0000 7f7e0effd640 1 -- 172.21.15.5:0/466648600 >> v1:172.21.15.5:6789/0 conn(0x7f7e100c9560 legacy=0x7f7e100ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:46.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.857+0000 7f7e0effd640 1 -- 172.21.15.5:0/466648600 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e10070c80 con 0x7f7e100c8ad0 2023-07-14T12:53:46.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.857+0000 7f7e0effd640 1 --2- 172.21.15.5:0/466648600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e100c8ad0 0x7f7e100c9020 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7e040097c0 tx=0x7f7e0401c250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21906d971bd49860 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:46.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.861+0000 7f7e0e7fc640 1 -- 172.21.15.5:0/466648600 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e08001a00 con 0x7f7e100c8ad0 2023-07-14T12:53:46.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.861+0000 7f7e0e7fc640 1 -- 172.21.15.5:0/466648600 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e040a7050 con 0x7f7e100c8ad0 2023-07-14T12:53:46.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.861+0000 7f7e0e7fc640 1 -- 172.21.15.5:0/466648600 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e040ab620 con 0x7f7e100c8ad0 2023-07-14T12:53:46.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.861+0000 7f7e1620b640 1 -- 172.21.15.5:0/466648600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e100c8ad0 msgr2=0x7f7e100c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:46.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.861+0000 7f7e1620b640 1 --2- 172.21.15.5:0/466648600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e100c8ad0 0x7f7e100c9020 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7e040097c0 tx=0x7f7e0401c250 comp rx=0 tx=0).stop 2023-07-14T12:53:46.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.861+0000 7f7e1620b640 1 -- 172.21.15.5:0/466648600 shutdown_connections 2023-07-14T12:53:46.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.861+0000 7f7e1620b640 1 --2- 172.21.15.5:0/466648600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e100c8ad0 0x7f7e100c9020 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.861+0000 7f7e1620b640 1 -- 172.21.15.5:0/466648600 >> 172.21.15.5:0/466648600 conn(0x7f7e100afcf0 msgr2=0x7f7e100b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.861+0000 7f7e1620b640 1 -- 172.21.15.5:0/466648600 shutdown_connections 2023-07-14T12:53:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.861+0000 7f7e1620b640 1 -- 172.21.15.5:0/466648600 wait complete. 2023-07-14T12:53:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.861+0000 7f7e1620b640 1 Processor -- start 2023-07-14T12:53:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.861+0000 7f7e1620b640 1 -- start start 2023-07-14T12:53:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.861+0000 7f7e1620b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e100c8ad0 0x7f7e100c3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.861+0000 7f7e1620b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e100c9560 0x7f7e10159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.861+0000 7f7e1620b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e10158ce0 0x7f7e1013e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.861+0000 7f7e1620b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e10151f30 con 0x7f7e10158ce0 2023-07-14T12:53:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.861+0000 7f7e1620b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1015bec0 con 0x7f7e100c9560 2023-07-14T12:53:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.861+0000 7f7e1620b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1015b2b0 con 0x7f7e100c8ad0 2023-07-14T12:53:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.861+0000 7f7e0ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e10158ce0 0x7f7e1013e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.861+0000 7f7e0ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e10158ce0 0x7f7e1013e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50760/0 (socket says 172.21.15.5:50760) 2023-07-14T12:53:46.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.861+0000 7f7e0ffff640 1 -- 172.21.15.5:0/11843528 learned_addr learned my addr 172.21.15.5:0/11843528 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:46.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.865+0000 7f7e0f7fe640 1 --2- 172.21.15.5:0/11843528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e100c8ad0 0x7f7e100c3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:46.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.865+0000 7f7e0ffff640 1 -- 172.21.15.5:0/11843528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e100c8ad0 msgr2=0x7f7e100c3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:46.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.865+0000 7f7e0effd640 1 --2- 172.21.15.5:0/11843528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e100c9560 0x7f7e10159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:46.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.865+0000 7f7e0ffff640 1 --2- 172.21.15.5:0/11843528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e100c8ad0 0x7f7e100c3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:46.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.865+0000 7f7e0ffff640 1 -- 172.21.15.5:0/11843528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e100c9560 msgr2=0x7f7e10159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:46.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.865+0000 7f7e0ffff640 1 --2- 172.21.15.5:0/11843528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e100c9560 0x7f7e10159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:46.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.865+0000 7f7e0ffff640 1 -- 172.21.15.5:0/11843528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e04009420 con 0x7f7e10158ce0 2023-07-14T12:53:46.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.865+0000 7f7e0effd640 1 --2- 172.21.15.5:0/11843528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e100c9560 0x7f7e10159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:46.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.865+0000 7f7e0f7fe640 1 --2- 172.21.15.5:0/11843528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e100c8ad0 0x7f7e100c3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:46.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.865+0000 7f7e0ffff640 1 --2- 172.21.15.5:0/11843528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e10158ce0 0x7f7e1013e520 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800cc70 tx=0x7f7e0800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:46.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.865+0000 7f7df7fff640 1 -- 172.21.15.5:0/11843528 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0800ce80 con 0x7f7e10158ce0 2023-07-14T12:53:46.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.865+0000 7f7df7fff640 1 -- 172.21.15.5:0/11843528 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e08012400 con 0x7f7e10158ce0 2023-07-14T12:53:46.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.865+0000 7f7df7fff640 1 -- 172.21.15.5:0/11843528 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e08012770 con 0x7f7e10158ce0 2023-07-14T12:53:46.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.865+0000 7f7e1620b640 1 -- 172.21.15.5:0/11843528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e1015b590 con 0x7f7e10158ce0 2023-07-14T12:53:46.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.865+0000 7f7e1620b640 1 -- 172.21.15.5:0/11843528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1015bb50 con 0x7f7e10158ce0 2023-07-14T12:53:46.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.865+0000 7f7e1620b640 1 -- 172.21.15.5:0/11843528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e100ca1a0 con 0x7f7e10158ce0 2023-07-14T12:53:46.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.865+0000 7f7df7fff640 1 -- 172.21.15.5:0/11843528 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7e080128d0 con 0x7f7e10158ce0 2023-07-14T12:53:46.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.869+0000 7f7df7fff640 1 --2- 172.21.15.5:0/11843528 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7dfc066280 0x7f7dfc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:46.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.869+0000 7f7df7fff640 1 -- 172.21.15.5:0/11843528 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e08084550 con 0x7f7e10158ce0 2023-07-14T12:53:46.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.869+0000 7f7e0f7fe640 1 --2- 172.21.15.5:0/11843528 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7dfc066280 0x7f7dfc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:46.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.869+0000 7f7e0f7fe640 1 --2- 172.21.15.5:0/11843528 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7dfc066280 0x7f7dfc068730 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7e00000f70 tx=0x7f7e00009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:46.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:46.873+0000 7f7df7fff640 1 -- 172.21.15.5:0/11843528 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7e08051930 con 0x7f7e10158ce0 2023-07-14T12:53:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.061+0000 7f7e1620b640 1 -- 172.21.15.5:0/11843528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e100678d0 con 0x7f7e10158ce0 2023-07-14T12:53:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.061+0000 7f7df7fff640 1 -- 172.21.15.5:0/11843528 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4706 (secure 0 0 0) 0x7f7e08054f50 con 0x7f7e10158ce0 2023-07-14T12:53:47.091 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:47.091 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1121417572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1121417572},{"type":"v1","addr":"172.21.15.5:6833","nonce":1121417572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/1826988320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1826988320},{"type":"v1","addr":"172.21.15.154:6836","nonce":1826988320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5074,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3683900517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3683900517},{"type":"v1","addr":"172.21.15.154:6837","nonce":3683900517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T12:53:43.186604+0000","modified":"2023-07-14T12:53:46.672007+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5133},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5133":{"gid":5133,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6835/601029596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":601029596},{"type":"v1","addr":"172.21.15.5:6835","nonce":601029596}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-14T12:53:47.091 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 16 2023-07-14T12:53:47.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.065+0000 7f7e1620b640 1 -- 172.21.15.5:0/11843528 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7dfc066280 msgr2=0x7f7dfc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:47.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.065+0000 7f7e1620b640 1 --2- 172.21.15.5:0/11843528 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7dfc066280 0x7f7dfc068730 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7e00000f70 tx=0x7f7e00009040 comp rx=0 tx=0).stop 2023-07-14T12:53:47.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.065+0000 7f7e1620b640 1 -- 172.21.15.5:0/11843528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e10158ce0 msgr2=0x7f7e1013e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:47.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.065+0000 7f7e1620b640 1 --2- 172.21.15.5:0/11843528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e10158ce0 0x7f7e1013e520 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800cc70 tx=0x7f7e0800a430 comp rx=0 tx=0).stop 2023-07-14T12:53:47.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.065+0000 7f7e1620b640 1 -- 172.21.15.5:0/11843528 shutdown_connections 2023-07-14T12:53:47.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.065+0000 7f7e1620b640 1 --2- 172.21.15.5:0/11843528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e10158ce0 0x7f7e1013e520 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:47.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.065+0000 7f7e1620b640 1 --2- 172.21.15.5:0/11843528 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f7dfc066280 0x7f7dfc068730 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:47.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.065+0000 7f7e1620b640 1 --2- 172.21.15.5:0/11843528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e100c9560 0x7f7e10159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:47.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.065+0000 7f7e1620b640 1 --2- 172.21.15.5:0/11843528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e100c8ad0 0x7f7e100c3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:47.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.065+0000 7f7e1620b640 1 -- 172.21.15.5:0/11843528 >> 172.21.15.5:0/11843528 conn(0x7f7e100afcf0 msgr2=0x7f7e1006b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:47.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.065+0000 7f7e1620b640 1 -- 172.21.15.5:0/11843528 shutdown_connections 2023-07-14T12:53:47.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.065+0000 7f7e1620b640 1 -- 172.21.15.5:0/11843528 wait complete. 2023-07-14T12:53:47.112 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:53:47.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.229+0000 7f8c3759e640 1 Processor -- start 2023-07-14T12:53:47.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.229+0000 7f8c3759e640 1 -- start start 2023-07-14T12:53:47.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.229+0000 7f8c3759e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c380b7d90 0x7f8c380cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:47.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.229+0000 7f8c3759e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c380d13f0 0x7f8c380ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:47.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.229+0000 7f8c3759e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c380d0f60 con 0x7f8c3815f3f0 2023-07-14T12:53:47.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.229+0000 7f8c3759e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c380d0390 con 0x7f8c380b7d90 2023-07-14T12:53:47.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.229+0000 7f8c3759e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c380d0630 con 0x7f8c380d13f0 2023-07-14T12:53:47.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.229+0000 7f8c35d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c380b7d90 0x7f8c380cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:47.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.229+0000 7f8c36d9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c380d13f0 0x7f8c380ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:47.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.229+0000 7f8c35d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c380b7d90 0x7f8c380cc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:59970/0 (socket says 172.21.15.5:59970) 2023-07-14T12:53:47.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.229+0000 7f8c35d9b640 1 -- 172.21.15.5:0/1184426761 learned_addr learned my addr 172.21.15.5:0/1184426761 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:47.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.229+0000 7f8c35d9b640 1 -- 172.21.15.5:0/1184426761 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c380d13f0 msgr2=0x7f8c380ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:47.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.229+0000 7f8c35d9b640 1 --2- 172.21.15.5:0/1184426761 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c380d13f0 0x7f8c380ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:47.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.229+0000 7f8c35d9b640 1 -- 172.21.15.5:0/1184426761 >> v1:172.21.15.154:6789/0 conn(0x7f8c3815f3f0 legacy=0x7f8c380b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:47.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.229+0000 7f8c35d9b640 1 -- 172.21.15.5:0/1184426761 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c380d0910 con 0x7f8c380b7d90 2023-07-14T12:53:47.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.233+0000 7f8c35d9b640 1 --2- 172.21.15.5:0/1184426761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c380b7d90 0x7f8c380cc9a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c009870 tx=0x7f8c2c01c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdc36ba0da9455f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:47.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.233+0000 7f8c3559a640 1 -- 172.21.15.5:0/1184426761 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c0ab600 con 0x7f8c380b7d90 2023-07-14T12:53:47.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.233+0000 7f8c3559a640 1 -- 172.21.15.5:0/1184426761 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2c0a7050 con 0x7f8c380b7d90 2023-07-14T12:53:47.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.233+0000 7f8c3559a640 1 -- 172.21.15.5:0/1184426761 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c0ab980 con 0x7f8c380b7d90 2023-07-14T12:53:47.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.233+0000 7f8c3759e640 1 -- 172.21.15.5:0/1184426761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c380b7d90 msgr2=0x7f8c380cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:47.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.233+0000 7f8c3759e640 1 --2- 172.21.15.5:0/1184426761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c380b7d90 0x7f8c380cc9a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c009870 tx=0x7f8c2c01c4b0 comp rx=0 tx=0).stop 2023-07-14T12:53:47.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.233+0000 7f8c3759e640 1 -- 172.21.15.5:0/1184426761 shutdown_connections 2023-07-14T12:53:47.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.233+0000 7f8c3759e640 1 --2- 172.21.15.5:0/1184426761 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c380d13f0 0x7f8c380ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:47.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.233+0000 7f8c3759e640 1 --2- 172.21.15.5:0/1184426761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c380b7d90 0x7f8c380cc9a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:47.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.233+0000 7f8c3759e640 1 -- 172.21.15.5:0/1184426761 >> 172.21.15.5:0/1184426761 conn(0x7f8c38069f50 msgr2=0x7f8c3806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:47.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.233+0000 7f8c3759e640 1 -- 172.21.15.5:0/1184426761 shutdown_connections 2023-07-14T12:53:47.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.233+0000 7f8c3759e640 1 -- 172.21.15.5:0/1184426761 wait complete. 2023-07-14T12:53:47.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.237+0000 7f8c3759e640 1 Processor -- start 2023-07-14T12:53:47.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.237+0000 7f8c3759e640 1 -- start start 2023-07-14T12:53:47.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.237+0000 7f8c3759e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c380b7d90 0x7f8c38150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:47.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.237+0000 7f8c3759e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c380d13f0 0x7f8c3814f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:47.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.237+0000 7f8c3759e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c3815f3f0 0x7f8c3815c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:47.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.237+0000 7f8c3759e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3815edd0 con 0x7f8c380d13f0 2023-07-14T12:53:47.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.237+0000 7f8c3759e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c38150690 con 0x7f8c380b7d90 2023-07-14T12:53:47.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.237+0000 7f8c3759e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3815e810 con 0x7f8c3815f3f0 2023-07-14T12:53:47.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.237+0000 7f8c35d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c380d13f0 0x7f8c3814f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:47.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.237+0000 7f8c35d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c380d13f0 0x7f8c3814f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50766/0 (socket says 172.21.15.5:50766) 2023-07-14T12:53:47.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.237+0000 7f8c35d9b640 1 -- 172.21.15.5:0/3829715190 learned_addr learned my addr 172.21.15.5:0/3829715190 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:47.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.237+0000 7f8c3659c640 1 --2- 172.21.15.5:0/3829715190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c380b7d90 0x7f8c38150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:47.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.237+0000 7f8c36d9d640 1 --2- 172.21.15.5:0/3829715190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c3815f3f0 0x7f8c3815c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:47.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.237+0000 7f8c35d9b640 1 -- 172.21.15.5:0/3829715190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c3815f3f0 msgr2=0x7f8c3815c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:47.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.237+0000 7f8c35d9b640 1 --2- 172.21.15.5:0/3829715190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c3815f3f0 0x7f8c3815c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:47.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.237+0000 7f8c35d9b640 1 -- 172.21.15.5:0/3829715190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c380b7d90 msgr2=0x7f8c38150150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:47.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.237+0000 7f8c35d9b640 1 --2- 172.21.15.5:0/3829715190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c380b7d90 0x7f8c38150150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:47.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.237+0000 7f8c35d9b640 1 -- 172.21.15.5:0/3829715190 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c0094d0 con 0x7f8c380d13f0 2023-07-14T12:53:47.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.237+0000 7f8c35d9b640 1 --2- 172.21.15.5:0/3829715190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c380d13f0 0x7f8c3814f9b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c01a0e0 tx=0x7f8c2c019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:47.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.237+0000 7f8c26ffd640 1 -- 172.21.15.5:0/3829715190 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c0b4440 con 0x7f8c380d13f0 2023-07-14T12:53:47.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.237+0000 7f8c26ffd640 1 -- 172.21.15.5:0/3829715190 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2c0b45a0 con 0x7f8c380d13f0 2023-07-14T12:53:47.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.237+0000 7f8c26ffd640 1 -- 172.21.15.5:0/3829715190 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c0b4930 con 0x7f8c380d13f0 2023-07-14T12:53:47.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.237+0000 7f8c3759e640 1 -- 172.21.15.5:0/3829715190 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3815eaf0 con 0x7f8c380d13f0 2023-07-14T12:53:47.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.237+0000 7f8c3759e640 1 -- 172.21.15.5:0/3829715190 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3814fef0 con 0x7f8c380d13f0 2023-07-14T12:53:47.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.241+0000 7f8c3759e640 1 -- 172.21.15.5:0/3829715190 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c38153760 con 0x7f8c380d13f0 2023-07-14T12:53:47.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.241+0000 7f8c26ffd640 1 -- 172.21.15.5:0/3829715190 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8c2c0b2070 con 0x7f8c380d13f0 2023-07-14T12:53:47.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.241+0000 7f8c26ffd640 1 --2- 172.21.15.5:0/3829715190 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f8c18066280 0x7f8c18068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:47.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.241+0000 7f8c26ffd640 1 -- 172.21.15.5:0/3829715190 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8c2c11db40 con 0x7f8c380d13f0 2023-07-14T12:53:47.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.241+0000 7f8c3659c640 1 --2- 172.21.15.5:0/3829715190 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f8c18066280 0x7f8c18068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:47.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.241+0000 7f8c3659c640 1 --2- 172.21.15.5:0/3829715190 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f8c18066280 0x7f8c18068730 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8c28007fd0 tx=0x7f8c28009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:47.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.245+0000 7f8c26ffd640 1 -- 172.21.15.5:0/3829715190 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f8c38153760 con 0x7f8c380d13f0 2023-07-14T12:53:47.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.401+0000 7f8c3759e640 1 -- 172.21.15.5:0/3829715190 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c38153760 con 0x7f8c380d13f0 2023-07-14T12:53:47.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.401+0000 7f8c26ffd640 1 -- 172.21.15.5:0/3829715190 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18303 (secure 0 0 0) 0x7f8c38153760 con 0x7f8c380d13f0 2023-07-14T12:53:47.429 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:47.429 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":37,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T12:53:44.652056+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:53:41.014568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-14T12:53:42.032063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:53:47.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.401+0000 7f8c3759e640 1 -- 172.21.15.5:0/3829715190 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f8c18066280 msgr2=0x7f8c18068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:47.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.401+0000 7f8c3759e640 1 --2- 172.21.15.5:0/3829715190 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f8c18066280 0x7f8c18068730 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8c28007fd0 tx=0x7f8c28009040 comp rx=0 tx=0).stop 2023-07-14T12:53:47.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.401+0000 7f8c3759e640 1 -- 172.21.15.5:0/3829715190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c380d13f0 msgr2=0x7f8c3814f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:47.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.401+0000 7f8c3759e640 1 --2- 172.21.15.5:0/3829715190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c380d13f0 0x7f8c3814f9b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c01a0e0 tx=0x7f8c2c019250 comp rx=0 tx=0).stop 2023-07-14T12:53:47.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.401+0000 7f8c3759e640 1 -- 172.21.15.5:0/3829715190 shutdown_connections 2023-07-14T12:53:47.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.401+0000 7f8c3759e640 1 --2- 172.21.15.5:0/3829715190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8c3815f3f0 0x7f8c3815c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:47.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.401+0000 7f8c3759e640 1 --2- 172.21.15.5:0/3829715190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c380d13f0 0x7f8c3814f9b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:47.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.401+0000 7f8c3759e640 1 --2- 172.21.15.5:0/3829715190 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f8c18066280 0x7f8c18068730 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:47.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.401+0000 7f8c3759e640 1 --2- 172.21.15.5:0/3829715190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c380b7d90 0x7f8c38150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:47.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.401+0000 7f8c3759e640 1 -- 172.21.15.5:0/3829715190 >> 172.21.15.5:0/3829715190 conn(0x7f8c38069f50 msgr2=0x7f8c380b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:47.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.401+0000 7f8c3759e640 1 -- 172.21.15.5:0/3829715190 shutdown_connections 2023-07-14T12:53:47.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.401+0000 7f8c3759e640 1 -- 172.21.15.5:0/3829715190 wait complete. 2023-07-14T12:53:47.450 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-14T12:53:47.451 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T12:53:47.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.565+0000 7f0a8a1d2640 1 Processor -- start 2023-07-14T12:53:47.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.565+0000 7f0a8a1d2640 1 -- start start 2023-07-14T12:53:47.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.569+0000 7f0a8a1d2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0a8406c430 0x7f0a840b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:47.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.569+0000 7f0a8a1d2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a840b24f0 con 0x7f0a8406e160 2023-07-14T12:53:47.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.569+0000 7f0a8a1d2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a840b27d0 con 0x7f0a840ae1f0 2023-07-14T12:53:47.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.569+0000 7f0a8a1d2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a840b2ab0 con 0x7f0a8406c430 2023-07-14T12:53:47.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.569+0000 7f0a7bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0a8406c430 0x7f0a840b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:47.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.569+0000 7f0a83fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0a8406e160 0x7f0a84069430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58488/0 (socket says 172.21.15.5:58488) 2023-07-14T12:53:47.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.569+0000 7f0a7bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0a8406c430 0x7f0a840b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50778/0 (socket says 172.21.15.5:50778) 2023-07-14T12:53:47.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.569+0000 7f0a83fff640 1 -- 172.21.15.5:0/3270090578 learned_addr learned my addr 172.21.15.5:0/3270090578 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:47.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.569+0000 7f0a7bfff640 1 -- 172.21.15.5:0/3270090578 >> v1:172.21.15.154:6789/0 conn(0x7f0a840ae1f0 legacy=0x7f0a8406bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:47.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.569+0000 7f0a7bfff640 1 -- 172.21.15.5:0/3270090578 >> v1:172.21.15.5:6789/0 conn(0x7f0a8406e160 legacy=0x7f0a84069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:47.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.569+0000 7f0a7bfff640 1 -- 172.21.15.5:0/3270090578 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a840b2d90 con 0x7f0a8406c430 2023-07-14T12:53:47.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.573+0000 7f0a7bfff640 1 --2- 172.21.15.5:0/3270090578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a8406c430 0x7f0a840b1e60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c0097c0 tx=0x7f0a6c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18678b948a5bb11c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:47.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.573+0000 7f0a82ffd640 1 -- 172.21.15.5:0/3270090578 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c0a7070 con 0x7f0a8406c430 2023-07-14T12:53:47.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.573+0000 7f0a82ffd640 1 -- 172.21.15.5:0/3270090578 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6c0ab430 con 0x7f0a8406c430 2023-07-14T12:53:47.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.573+0000 7f0a82ffd640 1 -- 172.21.15.5:0/3270090578 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c0ab7c0 con 0x7f0a8406c430 2023-07-14T12:53:47.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.573+0000 7f0a8a1d2640 1 -- 172.21.15.5:0/3270090578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a8406c430 msgr2=0x7f0a840b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:47.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.573+0000 7f0a8a1d2640 1 --2- 172.21.15.5:0/3270090578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a8406c430 0x7f0a840b1e60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c0097c0 tx=0x7f0a6c01c410 comp rx=0 tx=0).stop 2023-07-14T12:53:47.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.573+0000 7f0a8a1d2640 1 -- 172.21.15.5:0/3270090578 shutdown_connections 2023-07-14T12:53:47.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.573+0000 7f0a8a1d2640 1 --2- 172.21.15.5:0/3270090578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a8406c430 0x7f0a840b1e60 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:47.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.573+0000 7f0a8a1d2640 1 -- 172.21.15.5:0/3270090578 >> 172.21.15.5:0/3270090578 conn(0x7f0a840b1300 msgr2=0x7f0a840ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:47.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.573+0000 7f0a8a1d2640 1 -- 172.21.15.5:0/3270090578 shutdown_connections 2023-07-14T12:53:47.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.573+0000 7f0a8a1d2640 1 -- 172.21.15.5:0/3270090578 wait complete. 2023-07-14T12:53:47.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.573+0000 7f0a8a1d2640 1 Processor -- start 2023-07-14T12:53:47.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.573+0000 7f0a8a1d2640 1 -- start start 2023-07-14T12:53:47.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.573+0000 7f0a8a1d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a8406c430 0x7f0a8413db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:47.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.573+0000 7f0a8a1d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a8406e160 0x7f0a840cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:47.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.577+0000 7f0a8a1d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a840ae1f0 0x7f0a84140a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:47.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.577+0000 7f0a8a1d2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a840cdac0 con 0x7f0a8406e160 2023-07-14T12:53:47.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.577+0000 7f0a8a1d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8415b370 con 0x7f0a840ae1f0 2023-07-14T12:53:47.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.577+0000 7f0a8a1d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a84144970 con 0x7f0a8406c430 2023-07-14T12:53:47.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.577+0000 7f0a7bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a8406e160 0x7f0a840cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:47.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.577+0000 7f0a7bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a8406e160 0x7f0a840cdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50788/0 (socket says 172.21.15.5:50788) 2023-07-14T12:53:47.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.577+0000 7f0a7bfff640 1 -- 172.21.15.5:0/1662605786 learned_addr learned my addr 172.21.15.5:0/1662605786 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:47.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.577+0000 7f0a837fe640 1 --2- 172.21.15.5:0/1662605786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a8406c430 0x7f0a8413db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:47.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.577+0000 7f0a83fff640 1 --2- 172.21.15.5:0/1662605786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a840ae1f0 0x7f0a84140a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:47.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.577+0000 7f0a7bfff640 1 -- 172.21.15.5:0/1662605786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a8406c430 msgr2=0x7f0a8413db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:47.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.577+0000 7f0a7bfff640 1 --2- 172.21.15.5:0/1662605786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a8406c430 0x7f0a8413db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:47.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.577+0000 7f0a7bfff640 1 -- 172.21.15.5:0/1662605786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a840ae1f0 msgr2=0x7f0a84140a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:47.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.577+0000 7f0a7bfff640 1 --2- 172.21.15.5:0/1662605786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a840ae1f0 0x7f0a84140a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:47.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.577+0000 7f0a7bfff640 1 -- 172.21.15.5:0/1662605786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6c009420 con 0x7f0a8406e160 2023-07-14T12:53:47.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.577+0000 7f0a83fff640 1 --2- 172.21.15.5:0/1662605786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a840ae1f0 0x7f0a84140a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:47.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.577+0000 7f0a7bfff640 1 --2- 172.21.15.5:0/1662605786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a8406e160 0x7f0a840cdee0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c01a040 tx=0x7f0a6c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:47.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.577+0000 7f0a80ff9640 1 -- 172.21.15.5:0/1662605786 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c0b5810 con 0x7f0a8406e160 2023-07-14T12:53:47.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.577+0000 7f0a80ff9640 1 -- 172.21.15.5:0/1662605786 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6c0b5970 con 0x7f0a8406e160 2023-07-14T12:53:47.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.577+0000 7f0a80ff9640 1 -- 172.21.15.5:0/1662605786 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c0b5d20 con 0x7f0a8406e160 2023-07-14T12:53:47.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.577+0000 7f0a8a1d2640 1 -- 172.21.15.5:0/1662605786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a840b3710 con 0x7f0a8406e160 2023-07-14T12:53:47.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.577+0000 7f0a8a1d2640 1 -- 172.21.15.5:0/1662605786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a84144690 con 0x7f0a8406e160 2023-07-14T12:53:47.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.577+0000 7f0a8a1d2640 1 -- 172.21.15.5:0/1662605786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a840cdc00 con 0x7f0a8406e160 2023-07-14T12:53:47.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.577+0000 7f0a80ff9640 1 -- 172.21.15.5:0/1662605786 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0a6c0b4390 con 0x7f0a8406e160 2023-07-14T12:53:47.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.581+0000 7f0a80ff9640 1 --2- 172.21.15.5:0/1662605786 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f0a640662b0 0x7f0a64068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:47.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.581+0000 7f0a80ff9640 1 -- 172.21.15.5:0/1662605786 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0a6c11e2a0 con 0x7f0a8406e160 2023-07-14T12:53:47.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.581+0000 7f0a837fe640 1 --2- 172.21.15.5:0/1662605786 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f0a640662b0 0x7f0a64068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:47.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.581+0000 7f0a837fe640 1 --2- 172.21.15.5:0/1662605786 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f0a640662b0 0x7f0a64068760 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0a74001680 tx=0x7f0a74009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:47.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.585+0000 7f0a80ff9640 1 -- 172.21.15.5:0/1662605786 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f0a840cdc00 con 0x7f0a8406e160 2023-07-14T12:53:47.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.737+0000 7f0a8a1d2640 1 -- 172.21.15.5:0/1662605786 --> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0a840b3590 con 0x7f0a640662b0 2023-07-14T12:53:47.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.749+0000 7f0a80ff9640 1 -- 172.21.15.5:0/1662605786 <== mgr.4102 v2:172.21.15.154:6832/2736441655 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305419 (secure 0 0 0) 0x7f0a74001c60 con 0x7f0a640662b0 2023-07-14T12:53:47.778 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:47.782 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T12:53:47.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.753+0000 7f0a8a1d2640 1 -- 172.21.15.5:0/1662605786 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f0a640662b0 msgr2=0x7f0a64068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:47.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.753+0000 7f0a8a1d2640 1 --2- 172.21.15.5:0/1662605786 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f0a640662b0 0x7f0a64068760 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0a74001680 tx=0x7f0a74009040 comp rx=0 tx=0).stop 2023-07-14T12:53:47.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.753+0000 7f0a8a1d2640 1 -- 172.21.15.5:0/1662605786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a8406e160 msgr2=0x7f0a840cdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:47.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.753+0000 7f0a8a1d2640 1 --2- 172.21.15.5:0/1662605786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a8406e160 0x7f0a840cdee0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c01a040 tx=0x7f0a6c01ac50 comp rx=0 tx=0).stop 2023-07-14T12:53:47.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.753+0000 7f0a8a1d2640 1 -- 172.21.15.5:0/1662605786 shutdown_connections 2023-07-14T12:53:47.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.753+0000 7f0a8a1d2640 1 --2- 172.21.15.5:0/1662605786 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f0a640662b0 0x7f0a64068760 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:47.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.753+0000 7f0a8a1d2640 1 --2- 172.21.15.5:0/1662605786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a840ae1f0 0x7f0a84140a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:47.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.753+0000 7f0a8a1d2640 1 --2- 172.21.15.5:0/1662605786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a8406e160 0x7f0a840cdee0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:47.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.753+0000 7f0a8a1d2640 1 --2- 172.21.15.5:0/1662605786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a8406c430 0x7f0a8413db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:47.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.753+0000 7f0a8a1d2640 1 -- 172.21.15.5:0/1662605786 >> 172.21.15.5:0/1662605786 conn(0x7f0a840b1300 msgr2=0x7f0a84069430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:47.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.753+0000 7f0a8a1d2640 1 -- 172.21.15.5:0/1662605786 shutdown_connections 2023-07-14T12:53:47.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.753+0000 7f0a8a1d2640 1 -- 172.21.15.5:0/1662605786 wait complete. 2023-07-14T12:53:47.799 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2023-07-14T12:53:47.648589+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236160,"kb_used_data":4160,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754738560,"statfs":{"total":773094113280,"available":772852285440,"internally_reserved":0,"allocated":4259840,"data_stored":2418530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001233"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.645328+0000","last_change":"2023-07-14T12:53:42.645328+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.645328+0000","last_undegraded":"2023-07-14T12:53:42.645328+0000","last_fullsized":"2023-07-14T12:53:42.645328+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.643328+0000","last_change":"2023-07-14T12:53:42.643328+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.643328+0000","last_undegraded":"2023-07-14T12:53:42.643328+0000","last_fullsized":"2023-07-14T12:53:42.643328+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.647318+0000","last_change":"2023-07-14T12:53:42.647318+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647318+0000","last_undegraded":"2023-07-14T12:53:42.647318+0000","last_fullsized":"2023-07-14T12:53:42.647318+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.653927+0000","last_change":"2023-07-14T12:53:42.653927+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.653927+0000","last_undegraded":"2023-07-14T12:53:42.653927+0000","last_fullsized":"2023-07-14T12:53:42.653927+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.648793+0000","last_change":"2023-07-14T12:53:42.648793+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.648793+0000","last_undegraded":"2023-07-14T12:53:42.648793+0000","last_fullsized":"2023-07-14T12:53:42.648793+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641297+0000","last_change":"2023-07-14T12:53:42.641297+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641297+0000","last_undegraded":"2023-07-14T12:53:42.641297+0000","last_fullsized":"2023-07-14T12:53:42.641297+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.647261+0000","last_change":"2023-07-14T12:53:42.647261+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647261+0000","last_undegraded":"2023-07-14T12:53:42.647261+0000","last_fullsized":"2023-07-14T12:53:42.647261+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641654+0000","last_change":"2023-07-14T12:53:42.641654+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641654+0000","last_undegraded":"2023-07-14T12:53:42.641654+0000","last_fullsized":"2023-07-14T12:53:42.641654+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646767+0000","last_change":"2023-07-14T12:53:42.646767+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646767+0000","last_undegraded":"2023-07-14T12:53:42.646767+0000","last_fullsized":"2023-07-14T12:53:42.646767+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.644432+0000","last_change":"2023-07-14T12:53:42.644432+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.644432+0000","last_undegraded":"2023-07-14T12:53:42.644432+0000","last_fullsized":"2023-07-14T12:53:42.644432+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.645761+0000","last_change":"2023-07-14T12:53:42.645761+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.645761+0000","last_undegraded":"2023-07-14T12:53:42.645761+0000","last_fullsized":"2023-07-14T12:53:42.645761+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646179+0000","last_change":"2023-07-14T12:53:42.646179+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646179+0000","last_undegraded":"2023-07-14T12:53:42.646179+0000","last_fullsized":"2023-07-14T12:53:42.646179+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.645077+0000","last_change":"2023-07-14T12:53:42.645077+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.645077+0000","last_undegraded":"2023-07-14T12:53:42.645077+0000","last_fullsized":"2023-07-14T12:53:42.645077+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.652178+0000","last_change":"2023-07-14T12:53:42.652178+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.652178+0000","last_undegraded":"2023-07-14T12:53:42.652178+0000","last_fullsized":"2023-07-14T12:53:42.652178+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646675+0000","last_change":"2023-07-14T12:53:42.646675+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646675+0000","last_undegraded":"2023-07-14T12:53:42.646675+0000","last_fullsized":"2023-07-14T12:53:42.646675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646909+0000","last_change":"2023-07-14T12:53:42.646909+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646909+0000","last_undegraded":"2023-07-14T12:53:42.646909+0000","last_fullsized":"2023-07-14T12:53:42.646909+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.649953+0000","last_change":"2023-07-14T12:53:42.649953+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.649953+0000","last_undegraded":"2023-07-14T12:53:42.649953+0000","last_fullsized":"2023-07-14T12:53:42.649953+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.655629+0000","last_change":"2023-07-14T12:53:42.655629+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.655629+0000","last_undegraded":"2023-07-14T12:53:42.655629+0000","last_fullsized":"2023-07-14T12:53:42.655629+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.649331+0000","last_change":"2023-07-14T12:53:42.649331+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.649331+0000","last_undegraded":"2023-07-14T12:53:42.649331+0000","last_fullsized":"2023-07-14T12:53:42.649331+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.653939+0000","last_change":"2023-07-14T12:53:42.653939+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.653939+0000","last_undegraded":"2023-07-14T12:53:42.653939+0000","last_fullsized":"2023-07-14T12:53:42.653939+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.645901+0000","last_change":"2023-07-14T12:53:42.645901+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.645901+0000","last_undegraded":"2023-07-14T12:53:42.645901+0000","last_fullsized":"2023-07-14T12:53:42.645901+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.650211+0000","last_change":"2023-07-14T12:53:42.650211+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.650211+0000","last_undegraded":"2023-07-14T12:53:42.650211+0000","last_fullsized":"2023-07-14T12:53:42.650211+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646973+0000","last_change":"2023-07-14T12:53:42.646973+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646973+0000","last_undegraded":"2023-07-14T12:53:42.646973+0000","last_fullsized":"2023-07-14T12:53:42.646973+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.647811+0000","last_change":"2023-07-14T12:53:42.647811+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647811+0000","last_undegraded":"2023-07-14T12:53:42.647811+0000","last_fullsized":"2023-07-14T12:53:42.647811+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.655683+0000","last_change":"2023-07-14T12:53:42.655683+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.655683+0000","last_undegraded":"2023-07-14T12:53:42.655683+0000","last_fullsized":"2023-07-14T12:53:42.655683+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641334+0000","last_change":"2023-07-14T12:53:42.641334+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641334+0000","last_undegraded":"2023-07-14T12:53:42.641334+0000","last_fullsized":"2023-07-14T12:53:42.641334+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.653521+0000","last_change":"2023-07-14T12:53:42.653521+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.653521+0000","last_undegraded":"2023-07-14T12:53:42.653521+0000","last_fullsized":"2023-07-14T12:53:42.653521+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.643829+0000","last_change":"2023-07-14T12:53:42.643829+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.643829+0000","last_undegraded":"2023-07-14T12:53:42.643829+0000","last_fullsized":"2023-07-14T12:53:42.643829+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.656441+0000","last_change":"2023-07-14T12:53:42.656441+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.656441+0000","last_undegraded":"2023-07-14T12:53:42.656441+0000","last_fullsized":"2023-07-14T12:53:42.656441+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.654938+0000","last_change":"2023-07-14T12:53:42.654938+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.654938+0000","last_undegraded":"2023-07-14T12:53:42.654938+0000","last_fullsized":"2023-07-14T12:53:42.654938+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646446+0000","last_change":"2023-07-14T12:53:42.646446+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646446+0000","last_undegraded":"2023-07-14T12:53:42.646446+0000","last_fullsized":"2023-07-14T12:53:42.646446+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641645+0000","last_change":"2023-07-14T12:53:42.641645+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641645+0000","last_undegraded":"2023-07-14T12:53:42.641645+0000","last_fullsized":"2023-07-14T12:53:42.641645+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.648006+0000","last_change":"2023-07-14T12:53:42.648006+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.648006+0000","last_undegraded":"2023-07-14T12:53:42.648006+0000","last_fullsized":"2023-07-14T12:53:42.648006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":6,"reported_epoch":35,"state":"active","last_fresh":"2023-07-14T12:53:42.667572+0000","last_change":"2023-07-14T12:53:42.667507+0000","last_active":"2023-07-14T12:53:42.667572+0000","last_peered":"2023-07-14T12:53:42.667572+0000","last_clean":"2023-07-14T12:53:41.617889+0000","last_became_active":"2023-07-14T12:53:42.667507+0000","last_became_peered":"2023-07-14T12:53:42.667507+0000","last_unstale":"2023-07-14T12:53:42.667572+0000","last_undegraded":"2023-07-14T12:53:42.667572+0000","last_fullsized":"2023-07-14T12:53:42.667572+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:11:49.413274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641265+0000","last_change":"2023-07-14T12:53:42.641265+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641265+0000","last_undegraded":"2023-07-14T12:53:42.641265+0000","last_fullsized":"2023-07-14T12:53:42.641265+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.657800+0000","last_change":"2023-07-14T12:53:42.655513+0000","last_active":"2023-07-14T12:53:42.657800+0000","last_peered":"2023-07-14T12:53:42.657800+0000","last_clean":"2023-07-14T12:53:42.657800+0000","last_became_active":"2023-07-14T12:53:42.655190+0000","last_became_peered":"2023-07-14T12:53:42.655190+0000","last_unstale":"2023-07-14T12:53:42.657800+0000","last_undegraded":"2023-07-14T12:53:42.657800+0000","last_fullsized":"2023-07-14T12:53:42.657800+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:54:58.557794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.652195+0000","last_change":"2023-07-14T12:53:42.652195+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.652195+0000","last_undegraded":"2023-07-14T12:53:42.652195+0000","last_fullsized":"2023-07-14T12:53:42.652195+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.656321+0000","last_change":"2023-07-14T12:53:42.653922+0000","last_active":"2023-07-14T12:53:42.656321+0000","last_peered":"2023-07-14T12:53:42.656321+0000","last_clean":"2023-07-14T12:53:42.656321+0000","last_became_active":"2023-07-14T12:53:42.653620+0000","last_became_peered":"2023-07-14T12:53:42.653620+0000","last_unstale":"2023-07-14T12:53:42.656321+0000","last_undegraded":"2023-07-14T12:53:42.656321+0000","last_fullsized":"2023-07-14T12:53:42.656321+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:24:16.458619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.644784+0000","last_change":"2023-07-14T12:53:42.644784+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.644784+0000","last_undegraded":"2023-07-14T12:53:42.644784+0000","last_fullsized":"2023-07-14T12:53:42.644784+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.662383+0000","last_change":"2023-07-14T12:53:42.662383+0000","last_active":"2023-07-14T12:53:42.662383+0000","last_peered":"2023-07-14T12:53:42.662383+0000","last_clean":"2023-07-14T12:53:42.662383+0000","last_became_active":"2023-07-14T12:53:42.661905+0000","last_became_peered":"2023-07-14T12:53:42.661905+0000","last_unstale":"2023-07-14T12:53:42.662383+0000","last_undegraded":"2023-07-14T12:53:42.662383+0000","last_fullsized":"2023-07-14T12:53:42.662383+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:51:46.389062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.647247+0000","last_change":"2023-07-14T12:53:42.647247+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647247+0000","last_undegraded":"2023-07-14T12:53:42.647247+0000","last_fullsized":"2023-07-14T12:53:42.647247+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.665624+0000","last_change":"2023-07-14T12:53:42.657326+0000","last_active":"2023-07-14T12:53:42.665624+0000","last_peered":"2023-07-14T12:53:42.665624+0000","last_clean":"2023-07-14T12:53:42.665624+0000","last_became_active":"2023-07-14T12:53:42.657059+0000","last_became_peered":"2023-07-14T12:53:42.657059+0000","last_unstale":"2023-07-14T12:53:42.665624+0000","last_undegraded":"2023-07-14T12:53:42.665624+0000","last_fullsized":"2023-07-14T12:53:42.665624+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:10:00.345386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646250+0000","last_change":"2023-07-14T12:53:42.646250+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646250+0000","last_undegraded":"2023-07-14T12:53:42.646250+0000","last_fullsized":"2023-07-14T12:53:42.646250+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2023-07-14T12:53:42.647277+0000","last_change":"2023-07-14T12:53:42.647277+0000","last_active":"2023-07-14T12:53:41.617889+0000","last_peered":"2023-07-14T12:53:41.617889+0000","last_clean":"2023-07-14T12:53:41.617889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647277+0000","last_undegraded":"2023-07-14T12:53:42.647277+0000","last_fullsized":"2023-07-14T12:53:42.647277+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:00:36.016042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.651300+0000","last_change":"2023-07-14T12:53:42.651300+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.651300+0000","last_undegraded":"2023-07-14T12:53:42.651300+0000","last_fullsized":"2023-07-14T12:53:42.651300+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660743+0000","last_change":"2023-07-14T12:53:42.658632+0000","last_active":"2023-07-14T12:53:42.660743+0000","last_peered":"2023-07-14T12:53:42.660743+0000","last_clean":"2023-07-14T12:53:42.660743+0000","last_became_active":"2023-07-14T12:53:42.658028+0000","last_became_peered":"2023-07-14T12:53:42.658028+0000","last_unstale":"2023-07-14T12:53:42.660743+0000","last_undegraded":"2023-07-14T12:53:42.660743+0000","last_fullsized":"2023-07-14T12:53:42.660743+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:51:24.463331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.643163+0000","last_change":"2023-07-14T12:53:42.643163+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.643163+0000","last_undegraded":"2023-07-14T12:53:42.643163+0000","last_fullsized":"2023-07-14T12:53:42.643163+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.662716+0000","last_change":"2023-07-14T12:53:42.662716+0000","last_active":"2023-07-14T12:53:42.662716+0000","last_peered":"2023-07-14T12:53:42.662716+0000","last_clean":"2023-07-14T12:53:42.662716+0000","last_became_active":"2023-07-14T12:53:42.662457+0000","last_became_peered":"2023-07-14T12:53:42.662457+0000","last_unstale":"2023-07-14T12:53:42.662716+0000","last_undegraded":"2023-07-14T12:53:42.662716+0000","last_fullsized":"2023-07-14T12:53:42.662716+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:41:10.324376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.647161+0000","last_change":"2023-07-14T12:53:42.647161+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647161+0000","last_undegraded":"2023-07-14T12:53:42.647161+0000","last_fullsized":"2023-07-14T12:53:42.647161+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660203+0000","last_change":"2023-07-14T12:53:42.652006+0000","last_active":"2023-07-14T12:53:42.660203+0000","last_peered":"2023-07-14T12:53:42.660203+0000","last_clean":"2023-07-14T12:53:42.660203+0000","last_became_active":"2023-07-14T12:53:42.651707+0000","last_became_peered":"2023-07-14T12:53:42.651707+0000","last_unstale":"2023-07-14T12:53:42.660203+0000","last_undegraded":"2023-07-14T12:53:42.660203+0000","last_fullsized":"2023-07-14T12:53:42.660203+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:42:51.155287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.648691+0000","last_change":"2023-07-14T12:53:42.648691+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.648691+0000","last_undegraded":"2023-07-14T12:53:42.648691+0000","last_fullsized":"2023-07-14T12:53:42.648691+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.665705+0000","last_change":"2023-07-14T12:53:42.658082+0000","last_active":"2023-07-14T12:53:42.665705+0000","last_peered":"2023-07-14T12:53:42.665705+0000","last_clean":"2023-07-14T12:53:42.665705+0000","last_became_active":"2023-07-14T12:53:42.657825+0000","last_became_peered":"2023-07-14T12:53:42.657825+0000","last_unstale":"2023-07-14T12:53:42.665705+0000","last_undegraded":"2023-07-14T12:53:42.665705+0000","last_fullsized":"2023-07-14T12:53:42.665705+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:05:35.674248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.642551+0000","last_change":"2023-07-14T12:53:42.642551+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642551+0000","last_undegraded":"2023-07-14T12:53:42.642551+0000","last_fullsized":"2023-07-14T12:53:42.642551+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.665659+0000","last_change":"2023-07-14T12:53:42.657223+0000","last_active":"2023-07-14T12:53:42.665659+0000","last_peered":"2023-07-14T12:53:42.665659+0000","last_clean":"2023-07-14T12:53:42.665659+0000","last_became_active":"2023-07-14T12:53:42.656948+0000","last_became_peered":"2023-07-14T12:53:42.656948+0000","last_unstale":"2023-07-14T12:53:42.665659+0000","last_undegraded":"2023-07-14T12:53:42.665659+0000","last_fullsized":"2023-07-14T12:53:42.665659+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:49:01.863497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.651585+0000","last_change":"2023-07-14T12:53:42.651585+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.651585+0000","last_undegraded":"2023-07-14T12:53:42.651585+0000","last_fullsized":"2023-07-14T12:53:42.651585+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.661334+0000","last_change":"2023-07-14T12:53:42.661334+0000","last_active":"2023-07-14T12:53:42.661334+0000","last_peered":"2023-07-14T12:53:42.661334+0000","last_clean":"2023-07-14T12:53:42.661334+0000","last_became_active":"2023-07-14T12:53:42.661016+0000","last_became_peered":"2023-07-14T12:53:42.661016+0000","last_unstale":"2023-07-14T12:53:42.661334+0000","last_undegraded":"2023-07-14T12:53:42.661334+0000","last_fullsized":"2023-07-14T12:53:42.661334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:37:03.360811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.644304+0000","last_change":"2023-07-14T12:53:42.644304+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.644304+0000","last_undegraded":"2023-07-14T12:53:42.644304+0000","last_fullsized":"2023-07-14T12:53:42.644304+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660875+0000","last_change":"2023-07-14T12:53:42.656742+0000","last_active":"2023-07-14T12:53:42.660875+0000","last_peered":"2023-07-14T12:53:42.660875+0000","last_clean":"2023-07-14T12:53:42.660875+0000","last_became_active":"2023-07-14T12:53:42.656469+0000","last_became_peered":"2023-07-14T12:53:42.656469+0000","last_unstale":"2023-07-14T12:53:42.660875+0000","last_undegraded":"2023-07-14T12:53:42.660875+0000","last_fullsized":"2023-07-14T12:53:42.660875+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:54:25.442469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641323+0000","last_change":"2023-07-14T12:53:42.641323+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641323+0000","last_undegraded":"2023-07-14T12:53:42.641323+0000","last_fullsized":"2023-07-14T12:53:42.641323+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660733+0000","last_change":"2023-07-14T12:53:42.658001+0000","last_active":"2023-07-14T12:53:42.660733+0000","last_peered":"2023-07-14T12:53:42.660733+0000","last_clean":"2023-07-14T12:53:42.660733+0000","last_became_active":"2023-07-14T12:53:42.657716+0000","last_became_peered":"2023-07-14T12:53:42.657716+0000","last_unstale":"2023-07-14T12:53:42.660733+0000","last_undegraded":"2023-07-14T12:53:42.660733+0000","last_fullsized":"2023-07-14T12:53:42.660733+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:32:41.548062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646506+0000","last_change":"2023-07-14T12:53:42.646506+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646506+0000","last_undegraded":"2023-07-14T12:53:42.646506+0000","last_fullsized":"2023-07-14T12:53:42.646506+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.663319+0000","last_change":"2023-07-14T12:53:42.660268+0000","last_active":"2023-07-14T12:53:42.663319+0000","last_peered":"2023-07-14T12:53:42.663319+0000","last_clean":"2023-07-14T12:53:42.663319+0000","last_became_active":"2023-07-14T12:53:42.659539+0000","last_became_peered":"2023-07-14T12:53:42.659539+0000","last_unstale":"2023-07-14T12:53:42.663319+0000","last_undegraded":"2023-07-14T12:53:42.663319+0000","last_fullsized":"2023-07-14T12:53:42.663319+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:06:22.699849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.642688+0000","last_change":"2023-07-14T12:53:42.642688+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642688+0000","last_undegraded":"2023-07-14T12:53:42.642688+0000","last_fullsized":"2023-07-14T12:53:42.642688+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.658419+0000","last_change":"2023-07-14T12:53:42.658419+0000","last_active":"2023-07-14T12:53:42.658419+0000","last_peered":"2023-07-14T12:53:42.658419+0000","last_clean":"2023-07-14T12:53:42.658419+0000","last_became_active":"2023-07-14T12:53:42.658144+0000","last_became_peered":"2023-07-14T12:53:42.658144+0000","last_unstale":"2023-07-14T12:53:42.658419+0000","last_undegraded":"2023-07-14T12:53:42.658419+0000","last_fullsized":"2023-07-14T12:53:42.658419+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:25:03.006737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.642357+0000","last_change":"2023-07-14T12:53:42.642357+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642357+0000","last_undegraded":"2023-07-14T12:53:42.642357+0000","last_fullsized":"2023-07-14T12:53:42.642357+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.665798+0000","last_change":"2023-07-14T12:53:42.658432+0000","last_active":"2023-07-14T12:53:42.665798+0000","last_peered":"2023-07-14T12:53:42.665798+0000","last_clean":"2023-07-14T12:53:42.665798+0000","last_became_active":"2023-07-14T12:53:42.658113+0000","last_became_peered":"2023-07-14T12:53:42.658113+0000","last_unstale":"2023-07-14T12:53:42.665798+0000","last_undegraded":"2023-07-14T12:53:42.665798+0000","last_fullsized":"2023-07-14T12:53:42.665798+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:34:28.613892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.645275+0000","last_change":"2023-07-14T12:53:42.645275+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.645275+0000","last_undegraded":"2023-07-14T12:53:42.645275+0000","last_fullsized":"2023-07-14T12:53:42.645275+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2023-07-14T12:53:42.650520+0000","last_change":"2023-07-14T12:53:42.650520+0000","last_active":"2023-07-14T12:53:41.617889+0000","last_peered":"2023-07-14T12:53:41.617889+0000","last_clean":"2023-07-14T12:53:41.617889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.650520+0000","last_undegraded":"2023-07-14T12:53:42.650520+0000","last_fullsized":"2023-07-14T12:53:42.650520+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:11:50.985338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.652789+0000","last_change":"2023-07-14T12:53:42.652789+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.652789+0000","last_undegraded":"2023-07-14T12:53:42.652789+0000","last_fullsized":"2023-07-14T12:53:42.652789+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.659898+0000","last_change":"2023-07-14T12:53:42.655980+0000","last_active":"2023-07-14T12:53:42.659898+0000","last_peered":"2023-07-14T12:53:42.659898+0000","last_clean":"2023-07-14T12:53:42.659898+0000","last_became_active":"2023-07-14T12:53:42.655637+0000","last_became_peered":"2023-07-14T12:53:42.655637+0000","last_unstale":"2023-07-14T12:53:42.659898+0000","last_undegraded":"2023-07-14T12:53:42.659898+0000","last_fullsized":"2023-07-14T12:53:42.659898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:47:09.919080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.643100+0000","last_change":"2023-07-14T12:53:42.643100+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.643100+0000","last_undegraded":"2023-07-14T12:53:42.643100+0000","last_fullsized":"2023-07-14T12:53:42.643100+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.656343+0000","last_change":"2023-07-14T12:53:42.653617+0000","last_active":"2023-07-14T12:53:42.656343+0000","last_peered":"2023-07-14T12:53:42.656343+0000","last_clean":"2023-07-14T12:53:42.656343+0000","last_became_active":"2023-07-14T12:53:42.653328+0000","last_became_peered":"2023-07-14T12:53:42.653328+0000","last_unstale":"2023-07-14T12:53:42.656343+0000","last_undegraded":"2023-07-14T12:53:42.656343+0000","last_fullsized":"2023-07-14T12:53:42.656343+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:05:35.674248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646351+0000","last_change":"2023-07-14T12:53:42.646351+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646351+0000","last_undegraded":"2023-07-14T12:53:42.646351+0000","last_fullsized":"2023-07-14T12:53:42.646351+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.659875+0000","last_change":"2023-07-14T12:53:42.657937+0000","last_active":"2023-07-14T12:53:42.659875+0000","last_peered":"2023-07-14T12:53:42.659875+0000","last_clean":"2023-07-14T12:53:42.659875+0000","last_became_active":"2023-07-14T12:53:42.657616+0000","last_became_peered":"2023-07-14T12:53:42.657616+0000","last_unstale":"2023-07-14T12:53:42.659875+0000","last_undegraded":"2023-07-14T12:53:42.659875+0000","last_fullsized":"2023-07-14T12:53:42.659875+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:18:16.836950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641768+0000","last_change":"2023-07-14T12:53:42.641768+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641768+0000","last_undegraded":"2023-07-14T12:53:42.641768+0000","last_fullsized":"2023-07-14T12:53:42.641768+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2023-07-14T12:53:42.644109+0000","last_change":"2023-07-14T12:53:42.644109+0000","last_active":"2023-07-14T12:53:41.617889+0000","last_peered":"2023-07-14T12:53:41.617889+0000","last_clean":"2023-07-14T12:53:41.617889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.644109+0000","last_undegraded":"2023-07-14T12:53:42.644109+0000","last_fullsized":"2023-07-14T12:53:42.644109+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:03:35.822921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.644543+0000","last_change":"2023-07-14T12:53:42.644543+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.644543+0000","last_undegraded":"2023-07-14T12:53:42.644543+0000","last_fullsized":"2023-07-14T12:53:42.644543+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.662449+0000","last_change":"2023-07-14T12:53:42.662449+0000","last_active":"2023-07-14T12:53:42.662449+0000","last_peered":"2023-07-14T12:53:42.662449+0000","last_clean":"2023-07-14T12:53:42.662449+0000","last_became_active":"2023-07-14T12:53:42.662185+0000","last_became_peered":"2023-07-14T12:53:42.662185+0000","last_unstale":"2023-07-14T12:53:42.662449+0000","last_undegraded":"2023-07-14T12:53:42.662449+0000","last_fullsized":"2023-07-14T12:53:42.662449+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:57:04.405858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.642204+0000","last_change":"2023-07-14T12:53:42.642204+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642204+0000","last_undegraded":"2023-07-14T12:53:42.642204+0000","last_fullsized":"2023-07-14T12:53:42.642204+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660146+0000","last_change":"2023-07-14T12:53:42.658170+0000","last_active":"2023-07-14T12:53:42.660146+0000","last_peered":"2023-07-14T12:53:42.660146+0000","last_clean":"2023-07-14T12:53:42.660146+0000","last_became_active":"2023-07-14T12:53:42.657884+0000","last_became_peered":"2023-07-14T12:53:42.657884+0000","last_unstale":"2023-07-14T12:53:42.660146+0000","last_undegraded":"2023-07-14T12:53:42.660146+0000","last_fullsized":"2023-07-14T12:53:42.660146+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:21:16.785019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.644851+0000","last_change":"2023-07-14T12:53:42.644851+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.644851+0000","last_undegraded":"2023-07-14T12:53:42.644851+0000","last_fullsized":"2023-07-14T12:53:42.644851+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660164+0000","last_change":"2023-07-14T12:53:42.660164+0000","last_active":"2023-07-14T12:53:42.660164+0000","last_peered":"2023-07-14T12:53:42.660164+0000","last_clean":"2023-07-14T12:53:42.660164+0000","last_became_active":"2023-07-14T12:53:42.659871+0000","last_became_peered":"2023-07-14T12:53:42.659871+0000","last_unstale":"2023-07-14T12:53:42.660164+0000","last_undegraded":"2023-07-14T12:53:42.660164+0000","last_fullsized":"2023-07-14T12:53:42.660164+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:07:40.835216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.648387+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T12:53:42.648387+0000","last_peered":"2023-07-14T12:53:42.648387+0000","last_clean":"2023-07-14T12:53:42.648387+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T12:53:42.648387+0000","last_undegraded":"2023-07-14T12:53:42.648387+0000","last_fullsized":"2023-07-14T12:53:42.648387+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:57:27.397166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.649724+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T12:53:42.649724+0000","last_peered":"2023-07-14T12:53:42.649724+0000","last_clean":"2023-07-14T12:53:42.649724+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T12:53:42.649724+0000","last_undegraded":"2023-07-14T12:53:42.649724+0000","last_fullsized":"2023-07-14T12:53:42.649724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:59:34.411686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.642930+0000","last_change":"2023-07-14T12:53:42.642930+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642930+0000","last_undegraded":"2023-07-14T12:53:42.642930+0000","last_fullsized":"2023-07-14T12:53:42.642930+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.665588+0000","last_change":"2023-07-14T12:53:42.656339+0000","last_active":"2023-07-14T12:53:42.665588+0000","last_peered":"2023-07-14T12:53:42.665588+0000","last_clean":"2023-07-14T12:53:42.665588+0000","last_became_active":"2023-07-14T12:53:42.656049+0000","last_became_peered":"2023-07-14T12:53:42.656049+0000","last_unstale":"2023-07-14T12:53:42.665588+0000","last_undegraded":"2023-07-14T12:53:42.665588+0000","last_fullsized":"2023-07-14T12:53:42.665588+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:59:26.261812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.648243+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T12:53:42.648243+0000","last_peered":"2023-07-14T12:53:42.648243+0000","last_clean":"2023-07-14T12:53:42.648243+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T12:53:42.648243+0000","last_undegraded":"2023-07-14T12:53:42.648243+0000","last_fullsized":"2023-07-14T12:53:42.648243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:08:04.171298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.648143+0000","last_change":"2023-07-14T12:53:42.648143+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.648143+0000","last_undegraded":"2023-07-14T12:53:42.648143+0000","last_fullsized":"2023-07-14T12:53:42.648143+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2023-07-14T12:53:42.642176+0000","last_change":"2023-07-14T12:53:42.642176+0000","last_active":"2023-07-14T12:53:41.617889+0000","last_peered":"2023-07-14T12:53:41.617889+0000","last_clean":"2023-07-14T12:53:41.617889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642176+0000","last_undegraded":"2023-07-14T12:53:42.642176+0000","last_fullsized":"2023-07-14T12:53:42.642176+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:36:03.975351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.641868+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T12:53:42.641868+0000","last_peered":"2023-07-14T12:53:42.641868+0000","last_clean":"2023-07-14T12:53:42.641868+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T12:53:42.641868+0000","last_undegraded":"2023-07-14T12:53:42.641868+0000","last_fullsized":"2023-07-14T12:53:42.641868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:57:08.591309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.642814+0000","last_change":"2023-07-14T12:53:42.642814+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642814+0000","last_undegraded":"2023-07-14T12:53:42.642814+0000","last_fullsized":"2023-07-14T12:53:42.642814+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.659051+0000","last_change":"2023-07-14T12:53:42.656054+0000","last_active":"2023-07-14T12:53:42.659051+0000","last_peered":"2023-07-14T12:53:42.659051+0000","last_clean":"2023-07-14T12:53:42.659051+0000","last_became_active":"2023-07-14T12:53:42.655428+0000","last_became_peered":"2023-07-14T12:53:42.655428+0000","last_unstale":"2023-07-14T12:53:42.659051+0000","last_undegraded":"2023-07-14T12:53:42.659051+0000","last_fullsized":"2023-07-14T12:53:42.659051+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:05:06.666472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.650043+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T12:53:42.650043+0000","last_peered":"2023-07-14T12:53:42.650043+0000","last_clean":"2023-07-14T12:53:42.650043+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T12:53:42.650043+0000","last_undegraded":"2023-07-14T12:53:42.650043+0000","last_fullsized":"2023-07-14T12:53:42.650043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:56:02.801501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641542+0000","last_change":"2023-07-14T12:53:42.641542+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641542+0000","last_undegraded":"2023-07-14T12:53:42.641542+0000","last_fullsized":"2023-07-14T12:53:42.641542+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2023-07-14T12:53:42.642286+0000","last_change":"2023-07-14T12:53:42.642286+0000","last_active":"2023-07-14T12:53:41.617889+0000","last_peered":"2023-07-14T12:53:41.617889+0000","last_clean":"2023-07-14T12:53:41.617889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642286+0000","last_undegraded":"2023-07-14T12:53:42.642286+0000","last_fullsized":"2023-07-14T12:53:42.642286+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:45:42.882459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.637991+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T12:53:42.637991+0000","last_peered":"2023-07-14T12:53:42.637991+0000","last_clean":"2023-07-14T12:53:42.637991+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T12:53:42.637991+0000","last_undegraded":"2023-07-14T12:53:42.637991+0000","last_fullsized":"2023-07-14T12:53:42.637991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:42:21.174513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.643440+0000","last_change":"2023-07-14T12:53:42.643440+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.643440+0000","last_undegraded":"2023-07-14T12:53:42.643440+0000","last_fullsized":"2023-07-14T12:53:42.643440+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.665626+0000","last_change":"2023-07-14T12:53:42.663256+0000","last_active":"2023-07-14T12:53:42.665626+0000","last_peered":"2023-07-14T12:53:42.665626+0000","last_clean":"2023-07-14T12:53:42.665626+0000","last_became_active":"2023-07-14T12:53:42.662980+0000","last_became_peered":"2023-07-14T12:53:42.662980+0000","last_unstale":"2023-07-14T12:53:42.665626+0000","last_undegraded":"2023-07-14T12:53:42.665626+0000","last_fullsized":"2023-07-14T12:53:42.665626+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:50:23.974743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.650868+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T12:53:42.650868+0000","last_peered":"2023-07-14T12:53:42.650868+0000","last_clean":"2023-07-14T12:53:42.650868+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T12:53:42.650868+0000","last_undegraded":"2023-07-14T12:53:42.650868+0000","last_fullsized":"2023-07-14T12:53:42.650868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:41:09.149951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.651720+0000","last_change":"2023-07-14T12:53:42.651720+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.651720+0000","last_undegraded":"2023-07-14T12:53:42.651720+0000","last_fullsized":"2023-07-14T12:53:42.651720+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.662266+0000","last_change":"2023-07-14T12:53:42.662266+0000","last_active":"2023-07-14T12:53:42.662266+0000","last_peered":"2023-07-14T12:53:42.662266+0000","last_clean":"2023-07-14T12:53:42.662266+0000","last_became_active":"2023-07-14T12:53:42.661972+0000","last_became_peered":"2023-07-14T12:53:42.661972+0000","last_unstale":"2023-07-14T12:53:42.662266+0000","last_undegraded":"2023-07-14T12:53:42.662266+0000","last_fullsized":"2023-07-14T12:53:42.662266+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:05:09.874552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.637878+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T12:53:42.637878+0000","last_peered":"2023-07-14T12:53:42.637878+0000","last_clean":"2023-07-14T12:53:42.637878+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T12:53:42.637878+0000","last_undegraded":"2023-07-14T12:53:42.637878+0000","last_fullsized":"2023-07-14T12:53:42.637878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:50:30.387747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.647952+0000","last_change":"2023-07-14T12:53:42.647952+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647952+0000","last_undegraded":"2023-07-14T12:53:42.647952+0000","last_fullsized":"2023-07-14T12:53:42.647952+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660149+0000","last_change":"2023-07-14T12:53:42.651999+0000","last_active":"2023-07-14T12:53:42.660149+0000","last_peered":"2023-07-14T12:53:42.660149+0000","last_clean":"2023-07-14T12:53:42.660149+0000","last_became_active":"2023-07-14T12:53:42.651673+0000","last_became_peered":"2023-07-14T12:53:42.651673+0000","last_unstale":"2023-07-14T12:53:42.660149+0000","last_undegraded":"2023-07-14T12:53:42.660149+0000","last_fullsized":"2023-07-14T12:53:42.660149+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:46:08.798453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.657386+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T12:53:42.657386+0000","last_peered":"2023-07-14T12:53:42.657386+0000","last_clean":"2023-07-14T12:53:42.657386+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T12:53:42.657386+0000","last_undegraded":"2023-07-14T12:53:42.657386+0000","last_fullsized":"2023-07-14T12:53:42.657386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:07:17.227547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":978944,"data_stored":745347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.68799999999999994}]},{"osd":1,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.621},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.60599999999999998}]},{"osd":2,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.70299999999999996}]},{"osd":3,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.67400000000000004}]},{"osd":4,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.47999999999999998}]},{"osd":5,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.45100000000000001}]},{"osd":6,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.59099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":385024,"data_stored":154979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.66200000000000003}]},{"osd":1,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.751},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.70999999999999996}]},{"osd":2,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.51100000000000001}]},{"osd":3,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.56399999999999995}]},{"osd":4,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.626},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.72699999999999998}]},{"osd":7,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.76900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":385024,"data_stored":154979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.77200000000000002}]},{"osd":1,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.70399999999999996}]},{"osd":2,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.80400000000000005}]},{"osd":3,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.71799999999999997}]},{"osd":4,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.746},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.73499999999999999}]},{"osd":6,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.623},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.60199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":385024,"data_stored":154979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.57199999999999995}]},{"osd":1,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.69899999999999995}]},{"osd":2,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.497},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.53800000000000003}]},{"osd":3,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.76400000000000001}]},{"osd":6,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.72899999999999998}]},{"osd":7,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.622}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":385024,"data_stored":154979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.46400000000000002}]},{"osd":1,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.60199999999999998}]},{"osd":7,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.64300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":380928,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.377},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.51100000000000001}]},{"osd":1,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.46200000000000002}]},{"osd":3,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.70899999999999996}]},{"osd":5,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.2269999999999999,"5min":2.2269999999999999,"15min":2.2269999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.76100000000000001}]},{"osd":6,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.84399999999999997}]},{"osd":7,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.72499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":385024,"data_stored":154979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.45600000000000002}]},{"osd":2,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.435}]},{"osd":3,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.38600000000000001}]},{"osd":4,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.68300000000000005}]},{"osd":5,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.60899999999999999}]},{"osd":6,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.63200000000000001}]},{"osd":7,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.66900000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":974848,"data_stored":744328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.46700000000000003}]},{"osd":2,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.434}]},{"osd":3,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.48299999999999998}]},{"osd":4,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.90600000000000003}]},{"osd":5,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.85999999999999999}]},{"osd":6,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.875}]},{"osd":7,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.77500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T12:53:47.808 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T12:53:47.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.957+0000 7fc99ddd2640 1 Processor -- start 2023-07-14T12:53:47.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.957+0000 7fc99ddd2640 1 -- start start 2023-07-14T12:53:47.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.957+0000 7fc99ddd2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc998158ce0 0x7fc998070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:47.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.957+0000 7fc99ddd2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9980c9730 0x7fc9980ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:47.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.957+0000 7fc99ddd2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9980cc700 con 0x7fc9980c8ad0 2023-07-14T12:53:47.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.957+0000 7fc99ddd2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9980b0ff0 con 0x7fc998158ce0 2023-07-14T12:53:47.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.957+0000 7fc99ddd2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc998070c80 con 0x7fc9980c9730 2023-07-14T12:53:47.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.957+0000 7fc9977fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc998158ce0 0x7fc998070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:47.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.957+0000 7fc9977fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc998158ce0 0x7fc998070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50804/0 (socket says 172.21.15.5:50804) 2023-07-14T12:53:47.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.957+0000 7fc9977fe640 1 -- 172.21.15.5:0/538292238 learned_addr learned my addr 172.21.15.5:0/538292238 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:47.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.961+0000 7fc9977fe640 1 -- 172.21.15.5:0/538292238 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9980c9730 msgr2=0x7fc9980ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:47.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.961+0000 7fc9977fe640 1 --2- 172.21.15.5:0/538292238 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9980c9730 0x7fc9980ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:47.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.961+0000 7fc9977fe640 1 -- 172.21.15.5:0/538292238 >> v1:172.21.15.154:6789/0 conn(0x7fc9980c8ad0 legacy=0x7fc9980c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:47.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.961+0000 7fc9977fe640 1 -- 172.21.15.5:0/538292238 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9980cbdd0 con 0x7fc998158ce0 2023-07-14T12:53:47.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.961+0000 7fc9977fe640 1 --2- 172.21.15.5:0/538292238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc998158ce0 0x7fc998070450 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc98800bb10 tx=0x7fc98801eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6370360b2a18ee6c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:47.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.961+0000 7fc9967fc640 1 -- 172.21.15.5:0/538292238 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9880a7b30 con 0x7fc998158ce0 2023-07-14T12:53:47.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.961+0000 7fc9967fc640 1 -- 172.21.15.5:0/538292238 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9880a7c90 con 0x7fc998158ce0 2023-07-14T12:53:47.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.961+0000 7fc9967fc640 1 -- 172.21.15.5:0/538292238 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9880af440 con 0x7fc998158ce0 2023-07-14T12:53:47.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.965+0000 7fc99ddd2640 1 -- 172.21.15.5:0/538292238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc998158ce0 msgr2=0x7fc998070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:47.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.965+0000 7fc99ddd2640 1 --2- 172.21.15.5:0/538292238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc998158ce0 0x7fc998070450 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc98800bb10 tx=0x7fc98801eaa0 comp rx=0 tx=0).stop 2023-07-14T12:53:47.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.965+0000 7fc99ddd2640 1 -- 172.21.15.5:0/538292238 shutdown_connections 2023-07-14T12:53:47.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.965+0000 7fc99ddd2640 1 --2- 172.21.15.5:0/538292238 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9980c9730 0x7fc9980ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:47.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.965+0000 7fc99ddd2640 1 --2- 172.21.15.5:0/538292238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc998158ce0 0x7fc998070450 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:47.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.965+0000 7fc99ddd2640 1 -- 172.21.15.5:0/538292238 >> 172.21.15.5:0/538292238 conn(0x7fc9980afcf0 msgr2=0x7fc9980b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:47.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.965+0000 7fc99ddd2640 1 -- 172.21.15.5:0/538292238 shutdown_connections 2023-07-14T12:53:47.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.965+0000 7fc99ddd2640 1 -- 172.21.15.5:0/538292238 wait complete. 2023-07-14T12:53:47.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.965+0000 7fc99ddd2640 1 Processor -- start 2023-07-14T12:53:47.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.965+0000 7fc99ddd2640 1 -- start start 2023-07-14T12:53:47.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.965+0000 7fc99ddd2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9980c8ad0 0x7fc9981445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:47.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.965+0000 7fc99ddd2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9980c9730 0x7fc99814d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:47.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.965+0000 7fc99ddd2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc998158ce0 0x7fc9980c2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:47.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.965+0000 7fc99ddd2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc998144b00 con 0x7fc998158ce0 2023-07-14T12:53:47.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.965+0000 7fc99ddd2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc998155f90 con 0x7fc9980c9730 2023-07-14T12:53:47.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.965+0000 7fc99ddd2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc998160f80 con 0x7fc9980c8ad0 2023-07-14T12:53:47.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.965+0000 7fc997fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc998158ce0 0x7fc9980c2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:47.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.965+0000 7fc997fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc998158ce0 0x7fc9980c2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50818/0 (socket says 172.21.15.5:50818) 2023-07-14T12:53:48.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.965+0000 7fc997fff640 1 -- 172.21.15.5:0/276225699 learned_addr learned my addr 172.21.15.5:0/276225699 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:48.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.965+0000 7fc9977fe640 1 --2- 172.21.15.5:0/276225699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9980c8ad0 0x7fc9981445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:48.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.965+0000 7fc996ffd640 1 --2- 172.21.15.5:0/276225699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9980c9730 0x7fc99814d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:48.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.965+0000 7fc997fff640 1 -- 172.21.15.5:0/276225699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9980c8ad0 msgr2=0x7fc9981445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:48.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.965+0000 7fc997fff640 1 --2- 172.21.15.5:0/276225699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9980c8ad0 0x7fc9981445c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:48.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.965+0000 7fc997fff640 1 -- 172.21.15.5:0/276225699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9980c9730 msgr2=0x7fc99814d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:48.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.965+0000 7fc997fff640 1 --2- 172.21.15.5:0/276225699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9980c9730 0x7fc99814d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:48.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.965+0000 7fc997fff640 1 -- 172.21.15.5:0/276225699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98800b770 con 0x7fc998158ce0 2023-07-14T12:53:48.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.969+0000 7fc997fff640 1 --2- 172.21.15.5:0/276225699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc998158ce0 0x7fc9980c2300 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc99000b9e0 tx=0x7fc99000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:48.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.969+0000 7fc97ffff640 1 -- 172.21.15.5:0/276225699 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99000cb20 con 0x7fc998158ce0 2023-07-14T12:53:48.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.969+0000 7fc97ffff640 1 -- 172.21.15.5:0/276225699 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99000cca0 con 0x7fc998158ce0 2023-07-14T12:53:48.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.969+0000 7fc97ffff640 1 -- 172.21.15.5:0/276225699 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990014680 con 0x7fc998158ce0 2023-07-14T12:53:48.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.969+0000 7fc99ddd2640 1 -- 172.21.15.5:0/276225699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc998161260 con 0x7fc998158ce0 2023-07-14T12:53:48.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.969+0000 7fc99ddd2640 1 -- 172.21.15.5:0/276225699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc998161820 con 0x7fc998158ce0 2023-07-14T12:53:48.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.969+0000 7fc99ddd2640 1 -- 172.21.15.5:0/276225699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9980ca1a0 con 0x7fc998158ce0 2023-07-14T12:53:48.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.969+0000 7fc97ffff640 1 -- 172.21.15.5:0/276225699 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc99001d3b0 con 0x7fc998158ce0 2023-07-14T12:53:48.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.969+0000 7fc97ffff640 1 --2- 172.21.15.5:0/276225699 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc984066280 0x7fc984068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:48.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.969+0000 7fc97ffff640 1 -- 172.21.15.5:0/276225699 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc990083b50 con 0x7fc998158ce0 2023-07-14T12:53:48.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.969+0000 7fc9977fe640 1 --2- 172.21.15.5:0/276225699 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc984066280 0x7fc984068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:48.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.973+0000 7fc9977fe640 1 --2- 172.21.15.5:0/276225699 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc984066280 0x7fc984068730 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc9880b1000 tx=0x7fc9880a9070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:48.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:47.973+0000 7fc97ffff640 1 -- 172.21.15.5:0/276225699 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc990051070 con 0x7fc998158ce0 2023-07-14T12:53:48.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.129+0000 7fc99ddd2640 1 -- 172.21.15.5:0/276225699 --> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc9981590b0 con 0x7fc984066280 2023-07-14T12:53:48.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.137+0000 7fc97ffff640 1 -- 172.21.15.5:0/276225699 <== mgr.4102 v2:172.21.15.154:6832/2736441655 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305419 (secure 0 0 0) 0x7fc9880af440 con 0x7fc984066280 2023-07-14T12:53:48.169 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:48.170 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T12:53:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.141+0000 7fc99ddd2640 1 -- 172.21.15.5:0/276225699 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc984066280 msgr2=0x7fc984068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.141+0000 7fc99ddd2640 1 --2- 172.21.15.5:0/276225699 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc984066280 0x7fc984068730 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc9880b1000 tx=0x7fc9880a9070 comp rx=0 tx=0).stop 2023-07-14T12:53:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.141+0000 7fc99ddd2640 1 -- 172.21.15.5:0/276225699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc998158ce0 msgr2=0x7fc9980c2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.141+0000 7fc99ddd2640 1 --2- 172.21.15.5:0/276225699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc998158ce0 0x7fc9980c2300 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc99000b9e0 tx=0x7fc99000bea0 comp rx=0 tx=0).stop 2023-07-14T12:53:48.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.141+0000 7fc99ddd2640 1 -- 172.21.15.5:0/276225699 shutdown_connections 2023-07-14T12:53:48.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.141+0000 7fc99ddd2640 1 --2- 172.21.15.5:0/276225699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc998158ce0 0x7fc9980c2300 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:48.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.141+0000 7fc99ddd2640 1 --2- 172.21.15.5:0/276225699 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7fc984066280 0x7fc984068730 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:48.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.141+0000 7fc99ddd2640 1 --2- 172.21.15.5:0/276225699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9980c9730 0x7fc99814d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:48.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.141+0000 7fc99ddd2640 1 --2- 172.21.15.5:0/276225699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9980c8ad0 0x7fc9981445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:48.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.141+0000 7fc99ddd2640 1 -- 172.21.15.5:0/276225699 >> 172.21.15.5:0/276225699 conn(0x7fc9980afcf0 msgr2=0x7fc99814de80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:48.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.141+0000 7fc99ddd2640 1 -- 172.21.15.5:0/276225699 shutdown_connections 2023-07-14T12:53:48.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.141+0000 7fc99ddd2640 1 -- 172.21.15.5:0/276225699 wait complete. 2023-07-14T12:53:48.189 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2023-07-14T12:53:47.648589+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236160,"kb_used_data":4160,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754738560,"statfs":{"total":773094113280,"available":772852285440,"internally_reserved":0,"allocated":4259840,"data_stored":2418530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001233"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.645328+0000","last_change":"2023-07-14T12:53:42.645328+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.645328+0000","last_undegraded":"2023-07-14T12:53:42.645328+0000","last_fullsized":"2023-07-14T12:53:42.645328+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.643328+0000","last_change":"2023-07-14T12:53:42.643328+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.643328+0000","last_undegraded":"2023-07-14T12:53:42.643328+0000","last_fullsized":"2023-07-14T12:53:42.643328+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.647318+0000","last_change":"2023-07-14T12:53:42.647318+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647318+0000","last_undegraded":"2023-07-14T12:53:42.647318+0000","last_fullsized":"2023-07-14T12:53:42.647318+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.653927+0000","last_change":"2023-07-14T12:53:42.653927+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.653927+0000","last_undegraded":"2023-07-14T12:53:42.653927+0000","last_fullsized":"2023-07-14T12:53:42.653927+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.648793+0000","last_change":"2023-07-14T12:53:42.648793+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.648793+0000","last_undegraded":"2023-07-14T12:53:42.648793+0000","last_fullsized":"2023-07-14T12:53:42.648793+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641297+0000","last_change":"2023-07-14T12:53:42.641297+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641297+0000","last_undegraded":"2023-07-14T12:53:42.641297+0000","last_fullsized":"2023-07-14T12:53:42.641297+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.647261+0000","last_change":"2023-07-14T12:53:42.647261+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647261+0000","last_undegraded":"2023-07-14T12:53:42.647261+0000","last_fullsized":"2023-07-14T12:53:42.647261+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641654+0000","last_change":"2023-07-14T12:53:42.641654+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641654+0000","last_undegraded":"2023-07-14T12:53:42.641654+0000","last_fullsized":"2023-07-14T12:53:42.641654+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646767+0000","last_change":"2023-07-14T12:53:42.646767+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646767+0000","last_undegraded":"2023-07-14T12:53:42.646767+0000","last_fullsized":"2023-07-14T12:53:42.646767+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.644432+0000","last_change":"2023-07-14T12:53:42.644432+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.644432+0000","last_undegraded":"2023-07-14T12:53:42.644432+0000","last_fullsized":"2023-07-14T12:53:42.644432+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.645761+0000","last_change":"2023-07-14T12:53:42.645761+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.645761+0000","last_undegraded":"2023-07-14T12:53:42.645761+0000","last_fullsized":"2023-07-14T12:53:42.645761+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646179+0000","last_change":"2023-07-14T12:53:42.646179+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646179+0000","last_undegraded":"2023-07-14T12:53:42.646179+0000","last_fullsized":"2023-07-14T12:53:42.646179+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.645077+0000","last_change":"2023-07-14T12:53:42.645077+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.645077+0000","last_undegraded":"2023-07-14T12:53:42.645077+0000","last_fullsized":"2023-07-14T12:53:42.645077+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.652178+0000","last_change":"2023-07-14T12:53:42.652178+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.652178+0000","last_undegraded":"2023-07-14T12:53:42.652178+0000","last_fullsized":"2023-07-14T12:53:42.652178+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646675+0000","last_change":"2023-07-14T12:53:42.646675+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646675+0000","last_undegraded":"2023-07-14T12:53:42.646675+0000","last_fullsized":"2023-07-14T12:53:42.646675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646909+0000","last_change":"2023-07-14T12:53:42.646909+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646909+0000","last_undegraded":"2023-07-14T12:53:42.646909+0000","last_fullsized":"2023-07-14T12:53:42.646909+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.649953+0000","last_change":"2023-07-14T12:53:42.649953+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.649953+0000","last_undegraded":"2023-07-14T12:53:42.649953+0000","last_fullsized":"2023-07-14T12:53:42.649953+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.655629+0000","last_change":"2023-07-14T12:53:42.655629+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.655629+0000","last_undegraded":"2023-07-14T12:53:42.655629+0000","last_fullsized":"2023-07-14T12:53:42.655629+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.649331+0000","last_change":"2023-07-14T12:53:42.649331+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.649331+0000","last_undegraded":"2023-07-14T12:53:42.649331+0000","last_fullsized":"2023-07-14T12:53:42.649331+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.653939+0000","last_change":"2023-07-14T12:53:42.653939+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.653939+0000","last_undegraded":"2023-07-14T12:53:42.653939+0000","last_fullsized":"2023-07-14T12:53:42.653939+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.645901+0000","last_change":"2023-07-14T12:53:42.645901+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.645901+0000","last_undegraded":"2023-07-14T12:53:42.645901+0000","last_fullsized":"2023-07-14T12:53:42.645901+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.650211+0000","last_change":"2023-07-14T12:53:42.650211+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.650211+0000","last_undegraded":"2023-07-14T12:53:42.650211+0000","last_fullsized":"2023-07-14T12:53:42.650211+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646973+0000","last_change":"2023-07-14T12:53:42.646973+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646973+0000","last_undegraded":"2023-07-14T12:53:42.646973+0000","last_fullsized":"2023-07-14T12:53:42.646973+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.647811+0000","last_change":"2023-07-14T12:53:42.647811+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647811+0000","last_undegraded":"2023-07-14T12:53:42.647811+0000","last_fullsized":"2023-07-14T12:53:42.647811+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.655683+0000","last_change":"2023-07-14T12:53:42.655683+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.655683+0000","last_undegraded":"2023-07-14T12:53:42.655683+0000","last_fullsized":"2023-07-14T12:53:42.655683+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641334+0000","last_change":"2023-07-14T12:53:42.641334+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641334+0000","last_undegraded":"2023-07-14T12:53:42.641334+0000","last_fullsized":"2023-07-14T12:53:42.641334+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.653521+0000","last_change":"2023-07-14T12:53:42.653521+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.653521+0000","last_undegraded":"2023-07-14T12:53:42.653521+0000","last_fullsized":"2023-07-14T12:53:42.653521+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.643829+0000","last_change":"2023-07-14T12:53:42.643829+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.643829+0000","last_undegraded":"2023-07-14T12:53:42.643829+0000","last_fullsized":"2023-07-14T12:53:42.643829+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.656441+0000","last_change":"2023-07-14T12:53:42.656441+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.656441+0000","last_undegraded":"2023-07-14T12:53:42.656441+0000","last_fullsized":"2023-07-14T12:53:42.656441+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.654938+0000","last_change":"2023-07-14T12:53:42.654938+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.654938+0000","last_undegraded":"2023-07-14T12:53:42.654938+0000","last_fullsized":"2023-07-14T12:53:42.654938+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646446+0000","last_change":"2023-07-14T12:53:42.646446+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646446+0000","last_undegraded":"2023-07-14T12:53:42.646446+0000","last_fullsized":"2023-07-14T12:53:42.646446+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641645+0000","last_change":"2023-07-14T12:53:42.641645+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641645+0000","last_undegraded":"2023-07-14T12:53:42.641645+0000","last_fullsized":"2023-07-14T12:53:42.641645+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.648006+0000","last_change":"2023-07-14T12:53:42.648006+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.648006+0000","last_undegraded":"2023-07-14T12:53:42.648006+0000","last_fullsized":"2023-07-14T12:53:42.648006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":6,"reported_epoch":35,"state":"active","last_fresh":"2023-07-14T12:53:42.667572+0000","last_change":"2023-07-14T12:53:42.667507+0000","last_active":"2023-07-14T12:53:42.667572+0000","last_peered":"2023-07-14T12:53:42.667572+0000","last_clean":"2023-07-14T12:53:41.617889+0000","last_became_active":"2023-07-14T12:53:42.667507+0000","last_became_peered":"2023-07-14T12:53:42.667507+0000","last_unstale":"2023-07-14T12:53:42.667572+0000","last_undegraded":"2023-07-14T12:53:42.667572+0000","last_fullsized":"2023-07-14T12:53:42.667572+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:11:49.413274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641265+0000","last_change":"2023-07-14T12:53:42.641265+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641265+0000","last_undegraded":"2023-07-14T12:53:42.641265+0000","last_fullsized":"2023-07-14T12:53:42.641265+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.657800+0000","last_change":"2023-07-14T12:53:42.655513+0000","last_active":"2023-07-14T12:53:42.657800+0000","last_peered":"2023-07-14T12:53:42.657800+0000","last_clean":"2023-07-14T12:53:42.657800+0000","last_became_active":"2023-07-14T12:53:42.655190+0000","last_became_peered":"2023-07-14T12:53:42.655190+0000","last_unstale":"2023-07-14T12:53:42.657800+0000","last_undegraded":"2023-07-14T12:53:42.657800+0000","last_fullsized":"2023-07-14T12:53:42.657800+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:54:58.557794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.652195+0000","last_change":"2023-07-14T12:53:42.652195+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.652195+0000","last_undegraded":"2023-07-14T12:53:42.652195+0000","last_fullsized":"2023-07-14T12:53:42.652195+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.656321+0000","last_change":"2023-07-14T12:53:42.653922+0000","last_active":"2023-07-14T12:53:42.656321+0000","last_peered":"2023-07-14T12:53:42.656321+0000","last_clean":"2023-07-14T12:53:42.656321+0000","last_became_active":"2023-07-14T12:53:42.653620+0000","last_became_peered":"2023-07-14T12:53:42.653620+0000","last_unstale":"2023-07-14T12:53:42.656321+0000","last_undegraded":"2023-07-14T12:53:42.656321+0000","last_fullsized":"2023-07-14T12:53:42.656321+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:24:16.458619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.644784+0000","last_change":"2023-07-14T12:53:42.644784+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.644784+0000","last_undegraded":"2023-07-14T12:53:42.644784+0000","last_fullsized":"2023-07-14T12:53:42.644784+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.662383+0000","last_change":"2023-07-14T12:53:42.662383+0000","last_active":"2023-07-14T12:53:42.662383+0000","last_peered":"2023-07-14T12:53:42.662383+0000","last_clean":"2023-07-14T12:53:42.662383+0000","last_became_active":"2023-07-14T12:53:42.661905+0000","last_became_peered":"2023-07-14T12:53:42.661905+0000","last_unstale":"2023-07-14T12:53:42.662383+0000","last_undegraded":"2023-07-14T12:53:42.662383+0000","last_fullsized":"2023-07-14T12:53:42.662383+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:51:46.389062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.647247+0000","last_change":"2023-07-14T12:53:42.647247+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647247+0000","last_undegraded":"2023-07-14T12:53:42.647247+0000","last_fullsized":"2023-07-14T12:53:42.647247+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.665624+0000","last_change":"2023-07-14T12:53:42.657326+0000","last_active":"2023-07-14T12:53:42.665624+0000","last_peered":"2023-07-14T12:53:42.665624+0000","last_clean":"2023-07-14T12:53:42.665624+0000","last_became_active":"2023-07-14T12:53:42.657059+0000","last_became_peered":"2023-07-14T12:53:42.657059+0000","last_unstale":"2023-07-14T12:53:42.665624+0000","last_undegraded":"2023-07-14T12:53:42.665624+0000","last_fullsized":"2023-07-14T12:53:42.665624+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:10:00.345386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646250+0000","last_change":"2023-07-14T12:53:42.646250+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646250+0000","last_undegraded":"2023-07-14T12:53:42.646250+0000","last_fullsized":"2023-07-14T12:53:42.646250+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2023-07-14T12:53:42.647277+0000","last_change":"2023-07-14T12:53:42.647277+0000","last_active":"2023-07-14T12:53:41.617889+0000","last_peered":"2023-07-14T12:53:41.617889+0000","last_clean":"2023-07-14T12:53:41.617889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647277+0000","last_undegraded":"2023-07-14T12:53:42.647277+0000","last_fullsized":"2023-07-14T12:53:42.647277+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:00:36.016042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.651300+0000","last_change":"2023-07-14T12:53:42.651300+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.651300+0000","last_undegraded":"2023-07-14T12:53:42.651300+0000","last_fullsized":"2023-07-14T12:53:42.651300+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660743+0000","last_change":"2023-07-14T12:53:42.658632+0000","last_active":"2023-07-14T12:53:42.660743+0000","last_peered":"2023-07-14T12:53:42.660743+0000","last_clean":"2023-07-14T12:53:42.660743+0000","last_became_active":"2023-07-14T12:53:42.658028+0000","last_became_peered":"2023-07-14T12:53:42.658028+0000","last_unstale":"2023-07-14T12:53:42.660743+0000","last_undegraded":"2023-07-14T12:53:42.660743+0000","last_fullsized":"2023-07-14T12:53:42.660743+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:51:24.463331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.643163+0000","last_change":"2023-07-14T12:53:42.643163+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.643163+0000","last_undegraded":"2023-07-14T12:53:42.643163+0000","last_fullsized":"2023-07-14T12:53:42.643163+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.662716+0000","last_change":"2023-07-14T12:53:42.662716+0000","last_active":"2023-07-14T12:53:42.662716+0000","last_peered":"2023-07-14T12:53:42.662716+0000","last_clean":"2023-07-14T12:53:42.662716+0000","last_became_active":"2023-07-14T12:53:42.662457+0000","last_became_peered":"2023-07-14T12:53:42.662457+0000","last_unstale":"2023-07-14T12:53:42.662716+0000","last_undegraded":"2023-07-14T12:53:42.662716+0000","last_fullsized":"2023-07-14T12:53:42.662716+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:41:10.324376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.647161+0000","last_change":"2023-07-14T12:53:42.647161+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647161+0000","last_undegraded":"2023-07-14T12:53:42.647161+0000","last_fullsized":"2023-07-14T12:53:42.647161+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660203+0000","last_change":"2023-07-14T12:53:42.652006+0000","last_active":"2023-07-14T12:53:42.660203+0000","last_peered":"2023-07-14T12:53:42.660203+0000","last_clean":"2023-07-14T12:53:42.660203+0000","last_became_active":"2023-07-14T12:53:42.651707+0000","last_became_peered":"2023-07-14T12:53:42.651707+0000","last_unstale":"2023-07-14T12:53:42.660203+0000","last_undegraded":"2023-07-14T12:53:42.660203+0000","last_fullsized":"2023-07-14T12:53:42.660203+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:42:51.155287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.648691+0000","last_change":"2023-07-14T12:53:42.648691+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.648691+0000","last_undegraded":"2023-07-14T12:53:42.648691+0000","last_fullsized":"2023-07-14T12:53:42.648691+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.665705+0000","last_change":"2023-07-14T12:53:42.658082+0000","last_active":"2023-07-14T12:53:42.665705+0000","last_peered":"2023-07-14T12:53:42.665705+0000","last_clean":"2023-07-14T12:53:42.665705+0000","last_became_active":"2023-07-14T12:53:42.657825+0000","last_became_peered":"2023-07-14T12:53:42.657825+0000","last_unstale":"2023-07-14T12:53:42.665705+0000","last_undegraded":"2023-07-14T12:53:42.665705+0000","last_fullsized":"2023-07-14T12:53:42.665705+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:05:35.674248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.642551+0000","last_change":"2023-07-14T12:53:42.642551+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642551+0000","last_undegraded":"2023-07-14T12:53:42.642551+0000","last_fullsized":"2023-07-14T12:53:42.642551+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.665659+0000","last_change":"2023-07-14T12:53:42.657223+0000","last_active":"2023-07-14T12:53:42.665659+0000","last_peered":"2023-07-14T12:53:42.665659+0000","last_clean":"2023-07-14T12:53:42.665659+0000","last_became_active":"2023-07-14T12:53:42.656948+0000","last_became_peered":"2023-07-14T12:53:42.656948+0000","last_unstale":"2023-07-14T12:53:42.665659+0000","last_undegraded":"2023-07-14T12:53:42.665659+0000","last_fullsized":"2023-07-14T12:53:42.665659+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:49:01.863497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.651585+0000","last_change":"2023-07-14T12:53:42.651585+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.651585+0000","last_undegraded":"2023-07-14T12:53:42.651585+0000","last_fullsized":"2023-07-14T12:53:42.651585+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.661334+0000","last_change":"2023-07-14T12:53:42.661334+0000","last_active":"2023-07-14T12:53:42.661334+0000","last_peered":"2023-07-14T12:53:42.661334+0000","last_clean":"2023-07-14T12:53:42.661334+0000","last_became_active":"2023-07-14T12:53:42.661016+0000","last_became_peered":"2023-07-14T12:53:42.661016+0000","last_unstale":"2023-07-14T12:53:42.661334+0000","last_undegraded":"2023-07-14T12:53:42.661334+0000","last_fullsized":"2023-07-14T12:53:42.661334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:37:03.360811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.644304+0000","last_change":"2023-07-14T12:53:42.644304+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.644304+0000","last_undegraded":"2023-07-14T12:53:42.644304+0000","last_fullsized":"2023-07-14T12:53:42.644304+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660875+0000","last_change":"2023-07-14T12:53:42.656742+0000","last_active":"2023-07-14T12:53:42.660875+0000","last_peered":"2023-07-14T12:53:42.660875+0000","last_clean":"2023-07-14T12:53:42.660875+0000","last_became_active":"2023-07-14T12:53:42.656469+0000","last_became_peered":"2023-07-14T12:53:42.656469+0000","last_unstale":"2023-07-14T12:53:42.660875+0000","last_undegraded":"2023-07-14T12:53:42.660875+0000","last_fullsized":"2023-07-14T12:53:42.660875+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:54:25.442469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641323+0000","last_change":"2023-07-14T12:53:42.641323+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641323+0000","last_undegraded":"2023-07-14T12:53:42.641323+0000","last_fullsized":"2023-07-14T12:53:42.641323+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660733+0000","last_change":"2023-07-14T12:53:42.658001+0000","last_active":"2023-07-14T12:53:42.660733+0000","last_peered":"2023-07-14T12:53:42.660733+0000","last_clean":"2023-07-14T12:53:42.660733+0000","last_became_active":"2023-07-14T12:53:42.657716+0000","last_became_peered":"2023-07-14T12:53:42.657716+0000","last_unstale":"2023-07-14T12:53:42.660733+0000","last_undegraded":"2023-07-14T12:53:42.660733+0000","last_fullsized":"2023-07-14T12:53:42.660733+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:32:41.548062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646506+0000","last_change":"2023-07-14T12:53:42.646506+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646506+0000","last_undegraded":"2023-07-14T12:53:42.646506+0000","last_fullsized":"2023-07-14T12:53:42.646506+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.663319+0000","last_change":"2023-07-14T12:53:42.660268+0000","last_active":"2023-07-14T12:53:42.663319+0000","last_peered":"2023-07-14T12:53:42.663319+0000","last_clean":"2023-07-14T12:53:42.663319+0000","last_became_active":"2023-07-14T12:53:42.659539+0000","last_became_peered":"2023-07-14T12:53:42.659539+0000","last_unstale":"2023-07-14T12:53:42.663319+0000","last_undegraded":"2023-07-14T12:53:42.663319+0000","last_fullsized":"2023-07-14T12:53:42.663319+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:06:22.699849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.642688+0000","last_change":"2023-07-14T12:53:42.642688+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642688+0000","last_undegraded":"2023-07-14T12:53:42.642688+0000","last_fullsized":"2023-07-14T12:53:42.642688+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.658419+0000","last_change":"2023-07-14T12:53:42.658419+0000","last_active":"2023-07-14T12:53:42.658419+0000","last_peered":"2023-07-14T12:53:42.658419+0000","last_clean":"2023-07-14T12:53:42.658419+0000","last_became_active":"2023-07-14T12:53:42.658144+0000","last_became_peered":"2023-07-14T12:53:42.658144+0000","last_unstale":"2023-07-14T12:53:42.658419+0000","last_undegraded":"2023-07-14T12:53:42.658419+0000","last_fullsized":"2023-07-14T12:53:42.658419+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:25:03.006737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.642357+0000","last_change":"2023-07-14T12:53:42.642357+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642357+0000","last_undegraded":"2023-07-14T12:53:42.642357+0000","last_fullsized":"2023-07-14T12:53:42.642357+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.665798+0000","last_change":"2023-07-14T12:53:42.658432+0000","last_active":"2023-07-14T12:53:42.665798+0000","last_peered":"2023-07-14T12:53:42.665798+0000","last_clean":"2023-07-14T12:53:42.665798+0000","last_became_active":"2023-07-14T12:53:42.658113+0000","last_became_peered":"2023-07-14T12:53:42.658113+0000","last_unstale":"2023-07-14T12:53:42.665798+0000","last_undegraded":"2023-07-14T12:53:42.665798+0000","last_fullsized":"2023-07-14T12:53:42.665798+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:34:28.613892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.645275+0000","last_change":"2023-07-14T12:53:42.645275+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.645275+0000","last_undegraded":"2023-07-14T12:53:42.645275+0000","last_fullsized":"2023-07-14T12:53:42.645275+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2023-07-14T12:53:42.650520+0000","last_change":"2023-07-14T12:53:42.650520+0000","last_active":"2023-07-14T12:53:41.617889+0000","last_peered":"2023-07-14T12:53:41.617889+0000","last_clean":"2023-07-14T12:53:41.617889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.650520+0000","last_undegraded":"2023-07-14T12:53:42.650520+0000","last_fullsized":"2023-07-14T12:53:42.650520+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:11:50.985338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.652789+0000","last_change":"2023-07-14T12:53:42.652789+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.652789+0000","last_undegraded":"2023-07-14T12:53:42.652789+0000","last_fullsized":"2023-07-14T12:53:42.652789+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.659898+0000","last_change":"2023-07-14T12:53:42.655980+0000","last_active":"2023-07-14T12:53:42.659898+0000","last_peered":"2023-07-14T12:53:42.659898+0000","last_clean":"2023-07-14T12:53:42.659898+0000","last_became_active":"2023-07-14T12:53:42.655637+0000","last_became_peered":"2023-07-14T12:53:42.655637+0000","last_unstale":"2023-07-14T12:53:42.659898+0000","last_undegraded":"2023-07-14T12:53:42.659898+0000","last_fullsized":"2023-07-14T12:53:42.659898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:47:09.919080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.643100+0000","last_change":"2023-07-14T12:53:42.643100+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.643100+0000","last_undegraded":"2023-07-14T12:53:42.643100+0000","last_fullsized":"2023-07-14T12:53:42.643100+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.656343+0000","last_change":"2023-07-14T12:53:42.653617+0000","last_active":"2023-07-14T12:53:42.656343+0000","last_peered":"2023-07-14T12:53:42.656343+0000","last_clean":"2023-07-14T12:53:42.656343+0000","last_became_active":"2023-07-14T12:53:42.653328+0000","last_became_peered":"2023-07-14T12:53:42.653328+0000","last_unstale":"2023-07-14T12:53:42.656343+0000","last_undegraded":"2023-07-14T12:53:42.656343+0000","last_fullsized":"2023-07-14T12:53:42.656343+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:05:35.674248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646351+0000","last_change":"2023-07-14T12:53:42.646351+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646351+0000","last_undegraded":"2023-07-14T12:53:42.646351+0000","last_fullsized":"2023-07-14T12:53:42.646351+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.659875+0000","last_change":"2023-07-14T12:53:42.657937+0000","last_active":"2023-07-14T12:53:42.659875+0000","last_peered":"2023-07-14T12:53:42.659875+0000","last_clean":"2023-07-14T12:53:42.659875+0000","last_became_active":"2023-07-14T12:53:42.657616+0000","last_became_peered":"2023-07-14T12:53:42.657616+0000","last_unstale":"2023-07-14T12:53:42.659875+0000","last_undegraded":"2023-07-14T12:53:42.659875+0000","last_fullsized":"2023-07-14T12:53:42.659875+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:18:16.836950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641768+0000","last_change":"2023-07-14T12:53:42.641768+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641768+0000","last_undegraded":"2023-07-14T12:53:42.641768+0000","last_fullsized":"2023-07-14T12:53:42.641768+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2023-07-14T12:53:42.644109+0000","last_change":"2023-07-14T12:53:42.644109+0000","last_active":"2023-07-14T12:53:41.617889+0000","last_peered":"2023-07-14T12:53:41.617889+0000","last_clean":"2023-07-14T12:53:41.617889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.644109+0000","last_undegraded":"2023-07-14T12:53:42.644109+0000","last_fullsized":"2023-07-14T12:53:42.644109+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:03:35.822921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.644543+0000","last_change":"2023-07-14T12:53:42.644543+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.644543+0000","last_undegraded":"2023-07-14T12:53:42.644543+0000","last_fullsized":"2023-07-14T12:53:42.644543+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.662449+0000","last_change":"2023-07-14T12:53:42.662449+0000","last_active":"2023-07-14T12:53:42.662449+0000","last_peered":"2023-07-14T12:53:42.662449+0000","last_clean":"2023-07-14T12:53:42.662449+0000","last_became_active":"2023-07-14T12:53:42.662185+0000","last_became_peered":"2023-07-14T12:53:42.662185+0000","last_unstale":"2023-07-14T12:53:42.662449+0000","last_undegraded":"2023-07-14T12:53:42.662449+0000","last_fullsized":"2023-07-14T12:53:42.662449+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:57:04.405858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.642204+0000","last_change":"2023-07-14T12:53:42.642204+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642204+0000","last_undegraded":"2023-07-14T12:53:42.642204+0000","last_fullsized":"2023-07-14T12:53:42.642204+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660146+0000","last_change":"2023-07-14T12:53:42.658170+0000","last_active":"2023-07-14T12:53:42.660146+0000","last_peered":"2023-07-14T12:53:42.660146+0000","last_clean":"2023-07-14T12:53:42.660146+0000","last_became_active":"2023-07-14T12:53:42.657884+0000","last_became_peered":"2023-07-14T12:53:42.657884+0000","last_unstale":"2023-07-14T12:53:42.660146+0000","last_undegraded":"2023-07-14T12:53:42.660146+0000","last_fullsized":"2023-07-14T12:53:42.660146+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:21:16.785019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.644851+0000","last_change":"2023-07-14T12:53:42.644851+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.644851+0000","last_undegraded":"2023-07-14T12:53:42.644851+0000","last_fullsized":"2023-07-14T12:53:42.644851+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660164+0000","last_change":"2023-07-14T12:53:42.660164+0000","last_active":"2023-07-14T12:53:42.660164+0000","last_peered":"2023-07-14T12:53:42.660164+0000","last_clean":"2023-07-14T12:53:42.660164+0000","last_became_active":"2023-07-14T12:53:42.659871+0000","last_became_peered":"2023-07-14T12:53:42.659871+0000","last_unstale":"2023-07-14T12:53:42.660164+0000","last_undegraded":"2023-07-14T12:53:42.660164+0000","last_fullsized":"2023-07-14T12:53:42.660164+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:07:40.835216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.648387+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T12:53:42.648387+0000","last_peered":"2023-07-14T12:53:42.648387+0000","last_clean":"2023-07-14T12:53:42.648387+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T12:53:42.648387+0000","last_undegraded":"2023-07-14T12:53:42.648387+0000","last_fullsized":"2023-07-14T12:53:42.648387+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:57:27.397166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.649724+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T12:53:42.649724+0000","last_peered":"2023-07-14T12:53:42.649724+0000","last_clean":"2023-07-14T12:53:42.649724+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T12:53:42.649724+0000","last_undegraded":"2023-07-14T12:53:42.649724+0000","last_fullsized":"2023-07-14T12:53:42.649724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:59:34.411686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.642930+0000","last_change":"2023-07-14T12:53:42.642930+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642930+0000","last_undegraded":"2023-07-14T12:53:42.642930+0000","last_fullsized":"2023-07-14T12:53:42.642930+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.665588+0000","last_change":"2023-07-14T12:53:42.656339+0000","last_active":"2023-07-14T12:53:42.665588+0000","last_peered":"2023-07-14T12:53:42.665588+0000","last_clean":"2023-07-14T12:53:42.665588+0000","last_became_active":"2023-07-14T12:53:42.656049+0000","last_became_peered":"2023-07-14T12:53:42.656049+0000","last_unstale":"2023-07-14T12:53:42.665588+0000","last_undegraded":"2023-07-14T12:53:42.665588+0000","last_fullsized":"2023-07-14T12:53:42.665588+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:59:26.261812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.648243+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T12:53:42.648243+0000","last_peered":"2023-07-14T12:53:42.648243+0000","last_clean":"2023-07-14T12:53:42.648243+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T12:53:42.648243+0000","last_undegraded":"2023-07-14T12:53:42.648243+0000","last_fullsized":"2023-07-14T12:53:42.648243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:08:04.171298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.648143+0000","last_change":"2023-07-14T12:53:42.648143+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.648143+0000","last_undegraded":"2023-07-14T12:53:42.648143+0000","last_fullsized":"2023-07-14T12:53:42.648143+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2023-07-14T12:53:42.642176+0000","last_change":"2023-07-14T12:53:42.642176+0000","last_active":"2023-07-14T12:53:41.617889+0000","last_peered":"2023-07-14T12:53:41.617889+0000","last_clean":"2023-07-14T12:53:41.617889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642176+0000","last_undegraded":"2023-07-14T12:53:42.642176+0000","last_fullsized":"2023-07-14T12:53:42.642176+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:36:03.975351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.641868+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T12:53:42.641868+0000","last_peered":"2023-07-14T12:53:42.641868+0000","last_clean":"2023-07-14T12:53:42.641868+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T12:53:42.641868+0000","last_undegraded":"2023-07-14T12:53:42.641868+0000","last_fullsized":"2023-07-14T12:53:42.641868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:57:08.591309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.642814+0000","last_change":"2023-07-14T12:53:42.642814+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642814+0000","last_undegraded":"2023-07-14T12:53:42.642814+0000","last_fullsized":"2023-07-14T12:53:42.642814+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.659051+0000","last_change":"2023-07-14T12:53:42.656054+0000","last_active":"2023-07-14T12:53:42.659051+0000","last_peered":"2023-07-14T12:53:42.659051+0000","last_clean":"2023-07-14T12:53:42.659051+0000","last_became_active":"2023-07-14T12:53:42.655428+0000","last_became_peered":"2023-07-14T12:53:42.655428+0000","last_unstale":"2023-07-14T12:53:42.659051+0000","last_undegraded":"2023-07-14T12:53:42.659051+0000","last_fullsized":"2023-07-14T12:53:42.659051+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:05:06.666472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.650043+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T12:53:42.650043+0000","last_peered":"2023-07-14T12:53:42.650043+0000","last_clean":"2023-07-14T12:53:42.650043+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T12:53:42.650043+0000","last_undegraded":"2023-07-14T12:53:42.650043+0000","last_fullsized":"2023-07-14T12:53:42.650043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:56:02.801501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641542+0000","last_change":"2023-07-14T12:53:42.641542+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641542+0000","last_undegraded":"2023-07-14T12:53:42.641542+0000","last_fullsized":"2023-07-14T12:53:42.641542+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2023-07-14T12:53:42.642286+0000","last_change":"2023-07-14T12:53:42.642286+0000","last_active":"2023-07-14T12:53:41.617889+0000","last_peered":"2023-07-14T12:53:41.617889+0000","last_clean":"2023-07-14T12:53:41.617889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642286+0000","last_undegraded":"2023-07-14T12:53:42.642286+0000","last_fullsized":"2023-07-14T12:53:42.642286+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:45:42.882459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.637991+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T12:53:42.637991+0000","last_peered":"2023-07-14T12:53:42.637991+0000","last_clean":"2023-07-14T12:53:42.637991+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T12:53:42.637991+0000","last_undegraded":"2023-07-14T12:53:42.637991+0000","last_fullsized":"2023-07-14T12:53:42.637991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:42:21.174513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.643440+0000","last_change":"2023-07-14T12:53:42.643440+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.643440+0000","last_undegraded":"2023-07-14T12:53:42.643440+0000","last_fullsized":"2023-07-14T12:53:42.643440+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.665626+0000","last_change":"2023-07-14T12:53:42.663256+0000","last_active":"2023-07-14T12:53:42.665626+0000","last_peered":"2023-07-14T12:53:42.665626+0000","last_clean":"2023-07-14T12:53:42.665626+0000","last_became_active":"2023-07-14T12:53:42.662980+0000","last_became_peered":"2023-07-14T12:53:42.662980+0000","last_unstale":"2023-07-14T12:53:42.665626+0000","last_undegraded":"2023-07-14T12:53:42.665626+0000","last_fullsized":"2023-07-14T12:53:42.665626+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:50:23.974743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.650868+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T12:53:42.650868+0000","last_peered":"2023-07-14T12:53:42.650868+0000","last_clean":"2023-07-14T12:53:42.650868+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T12:53:42.650868+0000","last_undegraded":"2023-07-14T12:53:42.650868+0000","last_fullsized":"2023-07-14T12:53:42.650868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:41:09.149951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.651720+0000","last_change":"2023-07-14T12:53:42.651720+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.651720+0000","last_undegraded":"2023-07-14T12:53:42.651720+0000","last_fullsized":"2023-07-14T12:53:42.651720+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.662266+0000","last_change":"2023-07-14T12:53:42.662266+0000","last_active":"2023-07-14T12:53:42.662266+0000","last_peered":"2023-07-14T12:53:42.662266+0000","last_clean":"2023-07-14T12:53:42.662266+0000","last_became_active":"2023-07-14T12:53:42.661972+0000","last_became_peered":"2023-07-14T12:53:42.661972+0000","last_unstale":"2023-07-14T12:53:42.662266+0000","last_undegraded":"2023-07-14T12:53:42.662266+0000","last_fullsized":"2023-07-14T12:53:42.662266+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:05:09.874552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.637878+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T12:53:42.637878+0000","last_peered":"2023-07-14T12:53:42.637878+0000","last_clean":"2023-07-14T12:53:42.637878+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T12:53:42.637878+0000","last_undegraded":"2023-07-14T12:53:42.637878+0000","last_fullsized":"2023-07-14T12:53:42.637878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:50:30.387747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.647952+0000","last_change":"2023-07-14T12:53:42.647952+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647952+0000","last_undegraded":"2023-07-14T12:53:42.647952+0000","last_fullsized":"2023-07-14T12:53:42.647952+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660149+0000","last_change":"2023-07-14T12:53:42.651999+0000","last_active":"2023-07-14T12:53:42.660149+0000","last_peered":"2023-07-14T12:53:42.660149+0000","last_clean":"2023-07-14T12:53:42.660149+0000","last_became_active":"2023-07-14T12:53:42.651673+0000","last_became_peered":"2023-07-14T12:53:42.651673+0000","last_unstale":"2023-07-14T12:53:42.660149+0000","last_undegraded":"2023-07-14T12:53:42.660149+0000","last_fullsized":"2023-07-14T12:53:42.660149+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:46:08.798453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.657386+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T12:53:42.657386+0000","last_peered":"2023-07-14T12:53:42.657386+0000","last_clean":"2023-07-14T12:53:42.657386+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T12:53:42.657386+0000","last_undegraded":"2023-07-14T12:53:42.657386+0000","last_fullsized":"2023-07-14T12:53:42.657386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:07:17.227547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":978944,"data_stored":745347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.68799999999999994}]},{"osd":1,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.621},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.60599999999999998}]},{"osd":2,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.70299999999999996}]},{"osd":3,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.67400000000000004}]},{"osd":4,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.47999999999999998}]},{"osd":5,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.45100000000000001}]},{"osd":6,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.59099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":385024,"data_stored":154979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.66200000000000003}]},{"osd":1,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.751},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.70999999999999996}]},{"osd":2,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.51100000000000001}]},{"osd":3,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.56399999999999995}]},{"osd":4,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.626},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.72699999999999998}]},{"osd":7,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.76900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":385024,"data_stored":154979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.77200000000000002}]},{"osd":1,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.70399999999999996}]},{"osd":2,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.80400000000000005}]},{"osd":3,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.71799999999999997}]},{"osd":4,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.746},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.73499999999999999}]},{"osd":6,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.623},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.60199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":385024,"data_stored":154979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.57199999999999995}]},{"osd":1,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.69899999999999995}]},{"osd":2,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.497},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.53800000000000003}]},{"osd":3,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.76400000000000001}]},{"osd":6,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.72899999999999998}]},{"osd":7,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.622}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":385024,"data_stored":154979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.46400000000000002}]},{"osd":1,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.60199999999999998}]},{"osd":7,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.64300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":380928,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.377},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.51100000000000001}]},{"osd":1,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.46200000000000002}]},{"osd":3,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.70899999999999996}]},{"osd":5,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.2269999999999999,"5min":2.2269999999999999,"15min":2.2269999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.76100000000000001}]},{"osd":6,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.84399999999999997}]},{"osd":7,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.72499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":385024,"data_stored":154979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.45600000000000002}]},{"osd":2,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.435}]},{"osd":3,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.38600000000000001}]},{"osd":4,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.68300000000000005}]},{"osd":5,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.60899999999999999}]},{"osd":6,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.63200000000000001}]},{"osd":7,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.66900000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":974848,"data_stored":744328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.46700000000000003}]},{"osd":2,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.434}]},{"osd":3,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.48299999999999998}]},{"osd":4,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.90600000000000003}]},{"osd":5,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.85999999999999999}]},{"osd":6,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.875}]},{"osd":7,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.77500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T12:53:48.196 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T12:53:48.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.349+0000 7f45e646d640 1 Processor -- start 2023-07-14T12:53:48.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.349+0000 7f45e646d640 1 -- start start 2023-07-14T12:53:48.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.353+0000 7f45e646d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f45e006b1e0 0x7f45e00c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:48.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.353+0000 7f45e646d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e00cac70 con 0x7f45e0070b70 2023-07-14T12:53:48.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.353+0000 7f45e646d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e00ca060 con 0x7f45e00c21f0 2023-07-14T12:53:48.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.353+0000 7f45e646d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e00ca340 con 0x7f45e006b1e0 2023-07-14T12:53:48.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.353+0000 7f45df7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f45e006b1e0 0x7f45e00c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:48.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.353+0000 7f45dffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f45e0070b70 0x7f45e0070f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58494/0 (socket says 172.21.15.5:58494) 2023-07-14T12:53:48.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.353+0000 7f45dffff640 1 -- 172.21.15.5:0/3087400039 learned_addr learned my addr 172.21.15.5:0/3087400039 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:48.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.353+0000 7f45df7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f45e006b1e0 0x7f45e00c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50826/0 (socket says 172.21.15.5:50826) 2023-07-14T12:53:48.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.353+0000 7f45df7fe640 1 -- 172.21.15.5:0/3087400039 >> v1:172.21.15.154:6789/0 conn(0x7f45e00c21f0 legacy=0x7f45e00cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:48.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.353+0000 7f45df7fe640 1 -- 172.21.15.5:0/3087400039 >> v1:172.21.15.5:6789/0 conn(0x7f45e0070b70 legacy=0x7f45e0070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:48.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.353+0000 7f45df7fe640 1 -- 172.21.15.5:0/3087400039 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e00ca620 con 0x7f45e006b1e0 2023-07-14T12:53:48.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.353+0000 7f45deffd640 1 -- 172.21.15.5:0/3087400039 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3985053550 0 0) 0x7f45e00cac70 con 0x7f45e0070b70 2023-07-14T12:53:48.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.357+0000 7f45df7fe640 1 --2- 172.21.15.5:0/3087400039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45e006b1e0 0x7f45e00c1cb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f45d40097c0 tx=0x7f45d401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6bf877415d6610 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:48.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.357+0000 7f45deffd640 1 -- 172.21.15.5:0/3087400039 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d40ab610 con 0x7f45e006b1e0 2023-07-14T12:53:48.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.357+0000 7f45deffd640 1 -- 172.21.15.5:0/3087400039 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d40ab770 con 0x7f45e006b1e0 2023-07-14T12:53:48.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.357+0000 7f45deffd640 1 -- 172.21.15.5:0/3087400039 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d40abb00 con 0x7f45e006b1e0 2023-07-14T12:53:48.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.357+0000 7f45e646d640 1 -- 172.21.15.5:0/3087400039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45e006b1e0 msgr2=0x7f45e00c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:48.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.357+0000 7f45e646d640 1 --2- 172.21.15.5:0/3087400039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45e006b1e0 0x7f45e00c1cb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f45d40097c0 tx=0x7f45d401c410 comp rx=0 tx=0).stop 2023-07-14T12:53:48.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.357+0000 7f45e646d640 1 -- 172.21.15.5:0/3087400039 shutdown_connections 2023-07-14T12:53:48.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.357+0000 7f45e646d640 1 --2- 172.21.15.5:0/3087400039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45e006b1e0 0x7f45e00c1cb0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:48.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.357+0000 7f45e646d640 1 -- 172.21.15.5:0/3087400039 >> 172.21.15.5:0/3087400039 conn(0x7f45e00afcf0 msgr2=0x7f45e00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:48.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.357+0000 7f45e646d640 1 -- 172.21.15.5:0/3087400039 shutdown_connections 2023-07-14T12:53:48.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.357+0000 7f45e646d640 1 -- 172.21.15.5:0/3087400039 wait complete. 2023-07-14T12:53:48.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.357+0000 7f45e646d640 1 Processor -- start 2023-07-14T12:53:48.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.357+0000 7f45e646d640 1 -- start start 2023-07-14T12:53:48.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.361+0000 7f45e646d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45e006b1e0 0x7f45e01590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:48.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.361+0000 7f45e646d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45e0070b70 0x7f45e014cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:48.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.361+0000 7f45e646d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45e00c21f0 0x7f45e01fc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:48.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.361+0000 7f45e646d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e0154190 con 0x7f45e006b1e0 2023-07-14T12:53:48.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.361+0000 7f45e646d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e0154470 con 0x7f45e00c21f0 2023-07-14T12:53:48.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.361+0000 7f45e646d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e00ccf90 con 0x7f45e0070b70 2023-07-14T12:53:48.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.361+0000 7f45dffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45e006b1e0 0x7f45e01590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:48.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.361+0000 7f45dffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45e006b1e0 0x7f45e01590c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50830/0 (socket says 172.21.15.5:50830) 2023-07-14T12:53:48.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.361+0000 7f45dffff640 1 -- 172.21.15.5:0/2413488150 learned_addr learned my addr 172.21.15.5:0/2413488150 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:48.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.361+0000 7f45df7fe640 1 --2- 172.21.15.5:0/2413488150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45e0070b70 0x7f45e014cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:48.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.361+0000 7f45e4a0a640 1 --2- 172.21.15.5:0/2413488150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45e00c21f0 0x7f45e01fc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:48.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.361+0000 7f45dffff640 1 -- 172.21.15.5:0/2413488150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45e0070b70 msgr2=0x7f45e014cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:48.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.361+0000 7f45dffff640 1 --2- 172.21.15.5:0/2413488150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45e0070b70 0x7f45e014cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:48.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.361+0000 7f45dffff640 1 -- 172.21.15.5:0/2413488150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45e00c21f0 msgr2=0x7f45e01fc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:48.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.361+0000 7f45dffff640 1 --2- 172.21.15.5:0/2413488150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45e00c21f0 0x7f45e01fc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:48.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.361+0000 7f45dffff640 1 -- 172.21.15.5:0/2413488150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d4009420 con 0x7f45e006b1e0 2023-07-14T12:53:48.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.361+0000 7f45e4a0a640 1 --2- 172.21.15.5:0/2413488150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45e00c21f0 0x7f45e01fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:48.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.361+0000 7f45df7fe640 1 --2- 172.21.15.5:0/2413488150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45e0070b70 0x7f45e014cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:48.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.361+0000 7f45dffff640 1 --2- 172.21.15.5:0/2413488150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45e006b1e0 0x7f45e01590c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f45d00011f0 tx=0x7f45d000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:48.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.361+0000 7f45dcff9640 1 -- 172.21.15.5:0/2413488150 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d00074e0 con 0x7f45e006b1e0 2023-07-14T12:53:48.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.361+0000 7f45dcff9640 1 -- 172.21.15.5:0/2413488150 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d0007640 con 0x7f45e006b1e0 2023-07-14T12:53:48.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.361+0000 7f45dcff9640 1 -- 172.21.15.5:0/2413488150 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d0004a10 con 0x7f45e006b1e0 2023-07-14T12:53:48.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.361+0000 7f45e646d640 1 -- 172.21.15.5:0/2413488150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e00cd270 con 0x7f45e006b1e0 2023-07-14T12:53:48.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.361+0000 7f45e646d640 1 -- 172.21.15.5:0/2413488150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e014d4a0 con 0x7f45e006b1e0 2023-07-14T12:53:48.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.361+0000 7f45e646d640 1 -- 172.21.15.5:0/2413488150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e00cd4b0 con 0x7f45e006b1e0 2023-07-14T12:53:48.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.361+0000 7f45dcff9640 1 -- 172.21.15.5:0/2413488150 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f45d0004b70 con 0x7f45e006b1e0 2023-07-14T12:53:48.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.365+0000 7f45dcff9640 1 --2- 172.21.15.5:0/2413488150 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f45cc0662b0 0x7f45cc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:48.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.365+0000 7f45dcff9640 1 -- 172.21.15.5:0/2413488150 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f45d0082f80 con 0x7f45e006b1e0 2023-07-14T12:53:48.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.365+0000 7f45df7fe640 1 --2- 172.21.15.5:0/2413488150 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f45cc0662b0 0x7f45cc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:48.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.365+0000 7f45df7fe640 1 --2- 172.21.15.5:0/2413488150 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f45cc0662b0 0x7f45cc068760 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f45d40af000 tx=0x7f45d40a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:48.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.369+0000 7f45dcff9640 1 -- 172.21.15.5:0/2413488150 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f45e00cd4b0 con 0x7f45e006b1e0 2023-07-14T12:53:48.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.521+0000 7f45e646d640 1 -- 172.21.15.5:0/2413488150 --> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f45e0153f80 con 0x7f45cc0662b0 2023-07-14T12:53:48.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.529+0000 7f45dcff9640 1 -- 172.21.15.5:0/2413488150 <== mgr.4102 v2:172.21.15.154:6832/2736441655 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305419 (secure 0 0 0) 0x7f45e0153f80 con 0x7f45cc0662b0 2023-07-14T12:53:48.558 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:48.560 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T12:53:48.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.533+0000 7f45e646d640 1 -- 172.21.15.5:0/2413488150 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f45cc0662b0 msgr2=0x7f45cc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:48.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.533+0000 7f45e646d640 1 --2- 172.21.15.5:0/2413488150 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f45cc0662b0 0x7f45cc068760 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f45d40af000 tx=0x7f45d40a7000 comp rx=0 tx=0).stop 2023-07-14T12:53:48.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.533+0000 7f45e646d640 1 -- 172.21.15.5:0/2413488150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45e006b1e0 msgr2=0x7f45e01590c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:48.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.533+0000 7f45e646d640 1 --2- 172.21.15.5:0/2413488150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45e006b1e0 0x7f45e01590c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f45d00011f0 tx=0x7f45d000c9b0 comp rx=0 tx=0).stop 2023-07-14T12:53:48.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.533+0000 7f45e646d640 1 -- 172.21.15.5:0/2413488150 shutdown_connections 2023-07-14T12:53:48.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.533+0000 7f45e646d640 1 --2- 172.21.15.5:0/2413488150 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f45cc0662b0 0x7f45cc068760 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:48.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.533+0000 7f45e646d640 1 --2- 172.21.15.5:0/2413488150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45e00c21f0 0x7f45e01fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:48.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.533+0000 7f45e646d640 1 --2- 172.21.15.5:0/2413488150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45e0070b70 0x7f45e014cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:48.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.533+0000 7f45e646d640 1 --2- 172.21.15.5:0/2413488150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45e006b1e0 0x7f45e01590c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:48.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.533+0000 7f45e646d640 1 -- 172.21.15.5:0/2413488150 >> 172.21.15.5:0/2413488150 conn(0x7f45e00afcf0 msgr2=0x7f45e00b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:48.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.533+0000 7f45e646d640 1 -- 172.21.15.5:0/2413488150 shutdown_connections 2023-07-14T12:53:48.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.533+0000 7f45e646d640 1 -- 172.21.15.5:0/2413488150 wait complete. 2023-07-14T12:53:48.579 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2023-07-14T12:53:47.648589+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236160,"kb_used_data":4160,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754738560,"statfs":{"total":773094113280,"available":772852285440,"internally_reserved":0,"allocated":4259840,"data_stored":2418530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001233"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.645328+0000","last_change":"2023-07-14T12:53:42.645328+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.645328+0000","last_undegraded":"2023-07-14T12:53:42.645328+0000","last_fullsized":"2023-07-14T12:53:42.645328+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.643328+0000","last_change":"2023-07-14T12:53:42.643328+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.643328+0000","last_undegraded":"2023-07-14T12:53:42.643328+0000","last_fullsized":"2023-07-14T12:53:42.643328+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.647318+0000","last_change":"2023-07-14T12:53:42.647318+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647318+0000","last_undegraded":"2023-07-14T12:53:42.647318+0000","last_fullsized":"2023-07-14T12:53:42.647318+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.653927+0000","last_change":"2023-07-14T12:53:42.653927+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.653927+0000","last_undegraded":"2023-07-14T12:53:42.653927+0000","last_fullsized":"2023-07-14T12:53:42.653927+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.648793+0000","last_change":"2023-07-14T12:53:42.648793+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.648793+0000","last_undegraded":"2023-07-14T12:53:42.648793+0000","last_fullsized":"2023-07-14T12:53:42.648793+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641297+0000","last_change":"2023-07-14T12:53:42.641297+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641297+0000","last_undegraded":"2023-07-14T12:53:42.641297+0000","last_fullsized":"2023-07-14T12:53:42.641297+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.647261+0000","last_change":"2023-07-14T12:53:42.647261+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647261+0000","last_undegraded":"2023-07-14T12:53:42.647261+0000","last_fullsized":"2023-07-14T12:53:42.647261+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641654+0000","last_change":"2023-07-14T12:53:42.641654+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641654+0000","last_undegraded":"2023-07-14T12:53:42.641654+0000","last_fullsized":"2023-07-14T12:53:42.641654+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646767+0000","last_change":"2023-07-14T12:53:42.646767+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646767+0000","last_undegraded":"2023-07-14T12:53:42.646767+0000","last_fullsized":"2023-07-14T12:53:42.646767+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.644432+0000","last_change":"2023-07-14T12:53:42.644432+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.644432+0000","last_undegraded":"2023-07-14T12:53:42.644432+0000","last_fullsized":"2023-07-14T12:53:42.644432+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.645761+0000","last_change":"2023-07-14T12:53:42.645761+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.645761+0000","last_undegraded":"2023-07-14T12:53:42.645761+0000","last_fullsized":"2023-07-14T12:53:42.645761+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646179+0000","last_change":"2023-07-14T12:53:42.646179+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646179+0000","last_undegraded":"2023-07-14T12:53:42.646179+0000","last_fullsized":"2023-07-14T12:53:42.646179+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.645077+0000","last_change":"2023-07-14T12:53:42.645077+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.645077+0000","last_undegraded":"2023-07-14T12:53:42.645077+0000","last_fullsized":"2023-07-14T12:53:42.645077+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.652178+0000","last_change":"2023-07-14T12:53:42.652178+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.652178+0000","last_undegraded":"2023-07-14T12:53:42.652178+0000","last_fullsized":"2023-07-14T12:53:42.652178+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646675+0000","last_change":"2023-07-14T12:53:42.646675+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646675+0000","last_undegraded":"2023-07-14T12:53:42.646675+0000","last_fullsized":"2023-07-14T12:53:42.646675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646909+0000","last_change":"2023-07-14T12:53:42.646909+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646909+0000","last_undegraded":"2023-07-14T12:53:42.646909+0000","last_fullsized":"2023-07-14T12:53:42.646909+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.649953+0000","last_change":"2023-07-14T12:53:42.649953+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.649953+0000","last_undegraded":"2023-07-14T12:53:42.649953+0000","last_fullsized":"2023-07-14T12:53:42.649953+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.655629+0000","last_change":"2023-07-14T12:53:42.655629+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.655629+0000","last_undegraded":"2023-07-14T12:53:42.655629+0000","last_fullsized":"2023-07-14T12:53:42.655629+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.649331+0000","last_change":"2023-07-14T12:53:42.649331+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.649331+0000","last_undegraded":"2023-07-14T12:53:42.649331+0000","last_fullsized":"2023-07-14T12:53:42.649331+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.653939+0000","last_change":"2023-07-14T12:53:42.653939+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.653939+0000","last_undegraded":"2023-07-14T12:53:42.653939+0000","last_fullsized":"2023-07-14T12:53:42.653939+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.645901+0000","last_change":"2023-07-14T12:53:42.645901+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.645901+0000","last_undegraded":"2023-07-14T12:53:42.645901+0000","last_fullsized":"2023-07-14T12:53:42.645901+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.650211+0000","last_change":"2023-07-14T12:53:42.650211+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.650211+0000","last_undegraded":"2023-07-14T12:53:42.650211+0000","last_fullsized":"2023-07-14T12:53:42.650211+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646973+0000","last_change":"2023-07-14T12:53:42.646973+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646973+0000","last_undegraded":"2023-07-14T12:53:42.646973+0000","last_fullsized":"2023-07-14T12:53:42.646973+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.647811+0000","last_change":"2023-07-14T12:53:42.647811+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647811+0000","last_undegraded":"2023-07-14T12:53:42.647811+0000","last_fullsized":"2023-07-14T12:53:42.647811+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.655683+0000","last_change":"2023-07-14T12:53:42.655683+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.655683+0000","last_undegraded":"2023-07-14T12:53:42.655683+0000","last_fullsized":"2023-07-14T12:53:42.655683+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641334+0000","last_change":"2023-07-14T12:53:42.641334+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641334+0000","last_undegraded":"2023-07-14T12:53:42.641334+0000","last_fullsized":"2023-07-14T12:53:42.641334+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.653521+0000","last_change":"2023-07-14T12:53:42.653521+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.653521+0000","last_undegraded":"2023-07-14T12:53:42.653521+0000","last_fullsized":"2023-07-14T12:53:42.653521+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.643829+0000","last_change":"2023-07-14T12:53:42.643829+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.643829+0000","last_undegraded":"2023-07-14T12:53:42.643829+0000","last_fullsized":"2023-07-14T12:53:42.643829+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.656441+0000","last_change":"2023-07-14T12:53:42.656441+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.656441+0000","last_undegraded":"2023-07-14T12:53:42.656441+0000","last_fullsized":"2023-07-14T12:53:42.656441+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.654938+0000","last_change":"2023-07-14T12:53:42.654938+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.654938+0000","last_undegraded":"2023-07-14T12:53:42.654938+0000","last_fullsized":"2023-07-14T12:53:42.654938+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646446+0000","last_change":"2023-07-14T12:53:42.646446+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646446+0000","last_undegraded":"2023-07-14T12:53:42.646446+0000","last_fullsized":"2023-07-14T12:53:42.646446+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641645+0000","last_change":"2023-07-14T12:53:42.641645+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641645+0000","last_undegraded":"2023-07-14T12:53:42.641645+0000","last_fullsized":"2023-07-14T12:53:42.641645+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.648006+0000","last_change":"2023-07-14T12:53:42.648006+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.648006+0000","last_undegraded":"2023-07-14T12:53:42.648006+0000","last_fullsized":"2023-07-14T12:53:42.648006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":6,"reported_epoch":35,"state":"active","last_fresh":"2023-07-14T12:53:42.667572+0000","last_change":"2023-07-14T12:53:42.667507+0000","last_active":"2023-07-14T12:53:42.667572+0000","last_peered":"2023-07-14T12:53:42.667572+0000","last_clean":"2023-07-14T12:53:41.617889+0000","last_became_active":"2023-07-14T12:53:42.667507+0000","last_became_peered":"2023-07-14T12:53:42.667507+0000","last_unstale":"2023-07-14T12:53:42.667572+0000","last_undegraded":"2023-07-14T12:53:42.667572+0000","last_fullsized":"2023-07-14T12:53:42.667572+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:11:49.413274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641265+0000","last_change":"2023-07-14T12:53:42.641265+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641265+0000","last_undegraded":"2023-07-14T12:53:42.641265+0000","last_fullsized":"2023-07-14T12:53:42.641265+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.657800+0000","last_change":"2023-07-14T12:53:42.655513+0000","last_active":"2023-07-14T12:53:42.657800+0000","last_peered":"2023-07-14T12:53:42.657800+0000","last_clean":"2023-07-14T12:53:42.657800+0000","last_became_active":"2023-07-14T12:53:42.655190+0000","last_became_peered":"2023-07-14T12:53:42.655190+0000","last_unstale":"2023-07-14T12:53:42.657800+0000","last_undegraded":"2023-07-14T12:53:42.657800+0000","last_fullsized":"2023-07-14T12:53:42.657800+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:54:58.557794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.652195+0000","last_change":"2023-07-14T12:53:42.652195+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.652195+0000","last_undegraded":"2023-07-14T12:53:42.652195+0000","last_fullsized":"2023-07-14T12:53:42.652195+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.656321+0000","last_change":"2023-07-14T12:53:42.653922+0000","last_active":"2023-07-14T12:53:42.656321+0000","last_peered":"2023-07-14T12:53:42.656321+0000","last_clean":"2023-07-14T12:53:42.656321+0000","last_became_active":"2023-07-14T12:53:42.653620+0000","last_became_peered":"2023-07-14T12:53:42.653620+0000","last_unstale":"2023-07-14T12:53:42.656321+0000","last_undegraded":"2023-07-14T12:53:42.656321+0000","last_fullsized":"2023-07-14T12:53:42.656321+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:24:16.458619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.644784+0000","last_change":"2023-07-14T12:53:42.644784+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.644784+0000","last_undegraded":"2023-07-14T12:53:42.644784+0000","last_fullsized":"2023-07-14T12:53:42.644784+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.662383+0000","last_change":"2023-07-14T12:53:42.662383+0000","last_active":"2023-07-14T12:53:42.662383+0000","last_peered":"2023-07-14T12:53:42.662383+0000","last_clean":"2023-07-14T12:53:42.662383+0000","last_became_active":"2023-07-14T12:53:42.661905+0000","last_became_peered":"2023-07-14T12:53:42.661905+0000","last_unstale":"2023-07-14T12:53:42.662383+0000","last_undegraded":"2023-07-14T12:53:42.662383+0000","last_fullsized":"2023-07-14T12:53:42.662383+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:51:46.389062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.647247+0000","last_change":"2023-07-14T12:53:42.647247+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647247+0000","last_undegraded":"2023-07-14T12:53:42.647247+0000","last_fullsized":"2023-07-14T12:53:42.647247+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.665624+0000","last_change":"2023-07-14T12:53:42.657326+0000","last_active":"2023-07-14T12:53:42.665624+0000","last_peered":"2023-07-14T12:53:42.665624+0000","last_clean":"2023-07-14T12:53:42.665624+0000","last_became_active":"2023-07-14T12:53:42.657059+0000","last_became_peered":"2023-07-14T12:53:42.657059+0000","last_unstale":"2023-07-14T12:53:42.665624+0000","last_undegraded":"2023-07-14T12:53:42.665624+0000","last_fullsized":"2023-07-14T12:53:42.665624+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:10:00.345386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646250+0000","last_change":"2023-07-14T12:53:42.646250+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646250+0000","last_undegraded":"2023-07-14T12:53:42.646250+0000","last_fullsized":"2023-07-14T12:53:42.646250+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2023-07-14T12:53:42.647277+0000","last_change":"2023-07-14T12:53:42.647277+0000","last_active":"2023-07-14T12:53:41.617889+0000","last_peered":"2023-07-14T12:53:41.617889+0000","last_clean":"2023-07-14T12:53:41.617889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647277+0000","last_undegraded":"2023-07-14T12:53:42.647277+0000","last_fullsized":"2023-07-14T12:53:42.647277+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:00:36.016042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.651300+0000","last_change":"2023-07-14T12:53:42.651300+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.651300+0000","last_undegraded":"2023-07-14T12:53:42.651300+0000","last_fullsized":"2023-07-14T12:53:42.651300+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660743+0000","last_change":"2023-07-14T12:53:42.658632+0000","last_active":"2023-07-14T12:53:42.660743+0000","last_peered":"2023-07-14T12:53:42.660743+0000","last_clean":"2023-07-14T12:53:42.660743+0000","last_became_active":"2023-07-14T12:53:42.658028+0000","last_became_peered":"2023-07-14T12:53:42.658028+0000","last_unstale":"2023-07-14T12:53:42.660743+0000","last_undegraded":"2023-07-14T12:53:42.660743+0000","last_fullsized":"2023-07-14T12:53:42.660743+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:51:24.463331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.643163+0000","last_change":"2023-07-14T12:53:42.643163+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.643163+0000","last_undegraded":"2023-07-14T12:53:42.643163+0000","last_fullsized":"2023-07-14T12:53:42.643163+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.662716+0000","last_change":"2023-07-14T12:53:42.662716+0000","last_active":"2023-07-14T12:53:42.662716+0000","last_peered":"2023-07-14T12:53:42.662716+0000","last_clean":"2023-07-14T12:53:42.662716+0000","last_became_active":"2023-07-14T12:53:42.662457+0000","last_became_peered":"2023-07-14T12:53:42.662457+0000","last_unstale":"2023-07-14T12:53:42.662716+0000","last_undegraded":"2023-07-14T12:53:42.662716+0000","last_fullsized":"2023-07-14T12:53:42.662716+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:41:10.324376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.647161+0000","last_change":"2023-07-14T12:53:42.647161+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647161+0000","last_undegraded":"2023-07-14T12:53:42.647161+0000","last_fullsized":"2023-07-14T12:53:42.647161+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660203+0000","last_change":"2023-07-14T12:53:42.652006+0000","last_active":"2023-07-14T12:53:42.660203+0000","last_peered":"2023-07-14T12:53:42.660203+0000","last_clean":"2023-07-14T12:53:42.660203+0000","last_became_active":"2023-07-14T12:53:42.651707+0000","last_became_peered":"2023-07-14T12:53:42.651707+0000","last_unstale":"2023-07-14T12:53:42.660203+0000","last_undegraded":"2023-07-14T12:53:42.660203+0000","last_fullsized":"2023-07-14T12:53:42.660203+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:42:51.155287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.648691+0000","last_change":"2023-07-14T12:53:42.648691+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.648691+0000","last_undegraded":"2023-07-14T12:53:42.648691+0000","last_fullsized":"2023-07-14T12:53:42.648691+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.665705+0000","last_change":"2023-07-14T12:53:42.658082+0000","last_active":"2023-07-14T12:53:42.665705+0000","last_peered":"2023-07-14T12:53:42.665705+0000","last_clean":"2023-07-14T12:53:42.665705+0000","last_became_active":"2023-07-14T12:53:42.657825+0000","last_became_peered":"2023-07-14T12:53:42.657825+0000","last_unstale":"2023-07-14T12:53:42.665705+0000","last_undegraded":"2023-07-14T12:53:42.665705+0000","last_fullsized":"2023-07-14T12:53:42.665705+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:05:35.674248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.642551+0000","last_change":"2023-07-14T12:53:42.642551+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642551+0000","last_undegraded":"2023-07-14T12:53:42.642551+0000","last_fullsized":"2023-07-14T12:53:42.642551+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.665659+0000","last_change":"2023-07-14T12:53:42.657223+0000","last_active":"2023-07-14T12:53:42.665659+0000","last_peered":"2023-07-14T12:53:42.665659+0000","last_clean":"2023-07-14T12:53:42.665659+0000","last_became_active":"2023-07-14T12:53:42.656948+0000","last_became_peered":"2023-07-14T12:53:42.656948+0000","last_unstale":"2023-07-14T12:53:42.665659+0000","last_undegraded":"2023-07-14T12:53:42.665659+0000","last_fullsized":"2023-07-14T12:53:42.665659+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:49:01.863497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.651585+0000","last_change":"2023-07-14T12:53:42.651585+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.651585+0000","last_undegraded":"2023-07-14T12:53:42.651585+0000","last_fullsized":"2023-07-14T12:53:42.651585+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.661334+0000","last_change":"2023-07-14T12:53:42.661334+0000","last_active":"2023-07-14T12:53:42.661334+0000","last_peered":"2023-07-14T12:53:42.661334+0000","last_clean":"2023-07-14T12:53:42.661334+0000","last_became_active":"2023-07-14T12:53:42.661016+0000","last_became_peered":"2023-07-14T12:53:42.661016+0000","last_unstale":"2023-07-14T12:53:42.661334+0000","last_undegraded":"2023-07-14T12:53:42.661334+0000","last_fullsized":"2023-07-14T12:53:42.661334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:37:03.360811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.644304+0000","last_change":"2023-07-14T12:53:42.644304+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.644304+0000","last_undegraded":"2023-07-14T12:53:42.644304+0000","last_fullsized":"2023-07-14T12:53:42.644304+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660875+0000","last_change":"2023-07-14T12:53:42.656742+0000","last_active":"2023-07-14T12:53:42.660875+0000","last_peered":"2023-07-14T12:53:42.660875+0000","last_clean":"2023-07-14T12:53:42.660875+0000","last_became_active":"2023-07-14T12:53:42.656469+0000","last_became_peered":"2023-07-14T12:53:42.656469+0000","last_unstale":"2023-07-14T12:53:42.660875+0000","last_undegraded":"2023-07-14T12:53:42.660875+0000","last_fullsized":"2023-07-14T12:53:42.660875+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:54:25.442469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641323+0000","last_change":"2023-07-14T12:53:42.641323+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641323+0000","last_undegraded":"2023-07-14T12:53:42.641323+0000","last_fullsized":"2023-07-14T12:53:42.641323+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660733+0000","last_change":"2023-07-14T12:53:42.658001+0000","last_active":"2023-07-14T12:53:42.660733+0000","last_peered":"2023-07-14T12:53:42.660733+0000","last_clean":"2023-07-14T12:53:42.660733+0000","last_became_active":"2023-07-14T12:53:42.657716+0000","last_became_peered":"2023-07-14T12:53:42.657716+0000","last_unstale":"2023-07-14T12:53:42.660733+0000","last_undegraded":"2023-07-14T12:53:42.660733+0000","last_fullsized":"2023-07-14T12:53:42.660733+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:32:41.548062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646506+0000","last_change":"2023-07-14T12:53:42.646506+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646506+0000","last_undegraded":"2023-07-14T12:53:42.646506+0000","last_fullsized":"2023-07-14T12:53:42.646506+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.663319+0000","last_change":"2023-07-14T12:53:42.660268+0000","last_active":"2023-07-14T12:53:42.663319+0000","last_peered":"2023-07-14T12:53:42.663319+0000","last_clean":"2023-07-14T12:53:42.663319+0000","last_became_active":"2023-07-14T12:53:42.659539+0000","last_became_peered":"2023-07-14T12:53:42.659539+0000","last_unstale":"2023-07-14T12:53:42.663319+0000","last_undegraded":"2023-07-14T12:53:42.663319+0000","last_fullsized":"2023-07-14T12:53:42.663319+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:06:22.699849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.642688+0000","last_change":"2023-07-14T12:53:42.642688+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642688+0000","last_undegraded":"2023-07-14T12:53:42.642688+0000","last_fullsized":"2023-07-14T12:53:42.642688+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.658419+0000","last_change":"2023-07-14T12:53:42.658419+0000","last_active":"2023-07-14T12:53:42.658419+0000","last_peered":"2023-07-14T12:53:42.658419+0000","last_clean":"2023-07-14T12:53:42.658419+0000","last_became_active":"2023-07-14T12:53:42.658144+0000","last_became_peered":"2023-07-14T12:53:42.658144+0000","last_unstale":"2023-07-14T12:53:42.658419+0000","last_undegraded":"2023-07-14T12:53:42.658419+0000","last_fullsized":"2023-07-14T12:53:42.658419+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:25:03.006737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.642357+0000","last_change":"2023-07-14T12:53:42.642357+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642357+0000","last_undegraded":"2023-07-14T12:53:42.642357+0000","last_fullsized":"2023-07-14T12:53:42.642357+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.665798+0000","last_change":"2023-07-14T12:53:42.658432+0000","last_active":"2023-07-14T12:53:42.665798+0000","last_peered":"2023-07-14T12:53:42.665798+0000","last_clean":"2023-07-14T12:53:42.665798+0000","last_became_active":"2023-07-14T12:53:42.658113+0000","last_became_peered":"2023-07-14T12:53:42.658113+0000","last_unstale":"2023-07-14T12:53:42.665798+0000","last_undegraded":"2023-07-14T12:53:42.665798+0000","last_fullsized":"2023-07-14T12:53:42.665798+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:34:28.613892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.645275+0000","last_change":"2023-07-14T12:53:42.645275+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.645275+0000","last_undegraded":"2023-07-14T12:53:42.645275+0000","last_fullsized":"2023-07-14T12:53:42.645275+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2023-07-14T12:53:42.650520+0000","last_change":"2023-07-14T12:53:42.650520+0000","last_active":"2023-07-14T12:53:41.617889+0000","last_peered":"2023-07-14T12:53:41.617889+0000","last_clean":"2023-07-14T12:53:41.617889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.650520+0000","last_undegraded":"2023-07-14T12:53:42.650520+0000","last_fullsized":"2023-07-14T12:53:42.650520+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:11:50.985338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.652789+0000","last_change":"2023-07-14T12:53:42.652789+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.652789+0000","last_undegraded":"2023-07-14T12:53:42.652789+0000","last_fullsized":"2023-07-14T12:53:42.652789+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.659898+0000","last_change":"2023-07-14T12:53:42.655980+0000","last_active":"2023-07-14T12:53:42.659898+0000","last_peered":"2023-07-14T12:53:42.659898+0000","last_clean":"2023-07-14T12:53:42.659898+0000","last_became_active":"2023-07-14T12:53:42.655637+0000","last_became_peered":"2023-07-14T12:53:42.655637+0000","last_unstale":"2023-07-14T12:53:42.659898+0000","last_undegraded":"2023-07-14T12:53:42.659898+0000","last_fullsized":"2023-07-14T12:53:42.659898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:47:09.919080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.643100+0000","last_change":"2023-07-14T12:53:42.643100+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.643100+0000","last_undegraded":"2023-07-14T12:53:42.643100+0000","last_fullsized":"2023-07-14T12:53:42.643100+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.656343+0000","last_change":"2023-07-14T12:53:42.653617+0000","last_active":"2023-07-14T12:53:42.656343+0000","last_peered":"2023-07-14T12:53:42.656343+0000","last_clean":"2023-07-14T12:53:42.656343+0000","last_became_active":"2023-07-14T12:53:42.653328+0000","last_became_peered":"2023-07-14T12:53:42.653328+0000","last_unstale":"2023-07-14T12:53:42.656343+0000","last_undegraded":"2023-07-14T12:53:42.656343+0000","last_fullsized":"2023-07-14T12:53:42.656343+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:05:35.674248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646351+0000","last_change":"2023-07-14T12:53:42.646351+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646351+0000","last_undegraded":"2023-07-14T12:53:42.646351+0000","last_fullsized":"2023-07-14T12:53:42.646351+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.659875+0000","last_change":"2023-07-14T12:53:42.657937+0000","last_active":"2023-07-14T12:53:42.659875+0000","last_peered":"2023-07-14T12:53:42.659875+0000","last_clean":"2023-07-14T12:53:42.659875+0000","last_became_active":"2023-07-14T12:53:42.657616+0000","last_became_peered":"2023-07-14T12:53:42.657616+0000","last_unstale":"2023-07-14T12:53:42.659875+0000","last_undegraded":"2023-07-14T12:53:42.659875+0000","last_fullsized":"2023-07-14T12:53:42.659875+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:18:16.836950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641768+0000","last_change":"2023-07-14T12:53:42.641768+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641768+0000","last_undegraded":"2023-07-14T12:53:42.641768+0000","last_fullsized":"2023-07-14T12:53:42.641768+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2023-07-14T12:53:42.644109+0000","last_change":"2023-07-14T12:53:42.644109+0000","last_active":"2023-07-14T12:53:41.617889+0000","last_peered":"2023-07-14T12:53:41.617889+0000","last_clean":"2023-07-14T12:53:41.617889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.644109+0000","last_undegraded":"2023-07-14T12:53:42.644109+0000","last_fullsized":"2023-07-14T12:53:42.644109+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:03:35.822921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.644543+0000","last_change":"2023-07-14T12:53:42.644543+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.644543+0000","last_undegraded":"2023-07-14T12:53:42.644543+0000","last_fullsized":"2023-07-14T12:53:42.644543+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.662449+0000","last_change":"2023-07-14T12:53:42.662449+0000","last_active":"2023-07-14T12:53:42.662449+0000","last_peered":"2023-07-14T12:53:42.662449+0000","last_clean":"2023-07-14T12:53:42.662449+0000","last_became_active":"2023-07-14T12:53:42.662185+0000","last_became_peered":"2023-07-14T12:53:42.662185+0000","last_unstale":"2023-07-14T12:53:42.662449+0000","last_undegraded":"2023-07-14T12:53:42.662449+0000","last_fullsized":"2023-07-14T12:53:42.662449+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:57:04.405858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.642204+0000","last_change":"2023-07-14T12:53:42.642204+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642204+0000","last_undegraded":"2023-07-14T12:53:42.642204+0000","last_fullsized":"2023-07-14T12:53:42.642204+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660146+0000","last_change":"2023-07-14T12:53:42.658170+0000","last_active":"2023-07-14T12:53:42.660146+0000","last_peered":"2023-07-14T12:53:42.660146+0000","last_clean":"2023-07-14T12:53:42.660146+0000","last_became_active":"2023-07-14T12:53:42.657884+0000","last_became_peered":"2023-07-14T12:53:42.657884+0000","last_unstale":"2023-07-14T12:53:42.660146+0000","last_undegraded":"2023-07-14T12:53:42.660146+0000","last_fullsized":"2023-07-14T12:53:42.660146+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:21:16.785019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.644851+0000","last_change":"2023-07-14T12:53:42.644851+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.644851+0000","last_undegraded":"2023-07-14T12:53:42.644851+0000","last_fullsized":"2023-07-14T12:53:42.644851+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660164+0000","last_change":"2023-07-14T12:53:42.660164+0000","last_active":"2023-07-14T12:53:42.660164+0000","last_peered":"2023-07-14T12:53:42.660164+0000","last_clean":"2023-07-14T12:53:42.660164+0000","last_became_active":"2023-07-14T12:53:42.659871+0000","last_became_peered":"2023-07-14T12:53:42.659871+0000","last_unstale":"2023-07-14T12:53:42.660164+0000","last_undegraded":"2023-07-14T12:53:42.660164+0000","last_fullsized":"2023-07-14T12:53:42.660164+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:07:40.835216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.648387+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T12:53:42.648387+0000","last_peered":"2023-07-14T12:53:42.648387+0000","last_clean":"2023-07-14T12:53:42.648387+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T12:53:42.648387+0000","last_undegraded":"2023-07-14T12:53:42.648387+0000","last_fullsized":"2023-07-14T12:53:42.648387+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:57:27.397166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.649724+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T12:53:42.649724+0000","last_peered":"2023-07-14T12:53:42.649724+0000","last_clean":"2023-07-14T12:53:42.649724+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T12:53:42.649724+0000","last_undegraded":"2023-07-14T12:53:42.649724+0000","last_fullsized":"2023-07-14T12:53:42.649724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:59:34.411686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.642930+0000","last_change":"2023-07-14T12:53:42.642930+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642930+0000","last_undegraded":"2023-07-14T12:53:42.642930+0000","last_fullsized":"2023-07-14T12:53:42.642930+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.665588+0000","last_change":"2023-07-14T12:53:42.656339+0000","last_active":"2023-07-14T12:53:42.665588+0000","last_peered":"2023-07-14T12:53:42.665588+0000","last_clean":"2023-07-14T12:53:42.665588+0000","last_became_active":"2023-07-14T12:53:42.656049+0000","last_became_peered":"2023-07-14T12:53:42.656049+0000","last_unstale":"2023-07-14T12:53:42.665588+0000","last_undegraded":"2023-07-14T12:53:42.665588+0000","last_fullsized":"2023-07-14T12:53:42.665588+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:59:26.261812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.648243+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T12:53:42.648243+0000","last_peered":"2023-07-14T12:53:42.648243+0000","last_clean":"2023-07-14T12:53:42.648243+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T12:53:42.648243+0000","last_undegraded":"2023-07-14T12:53:42.648243+0000","last_fullsized":"2023-07-14T12:53:42.648243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:08:04.171298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.648143+0000","last_change":"2023-07-14T12:53:42.648143+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.648143+0000","last_undegraded":"2023-07-14T12:53:42.648143+0000","last_fullsized":"2023-07-14T12:53:42.648143+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2023-07-14T12:53:42.642176+0000","last_change":"2023-07-14T12:53:42.642176+0000","last_active":"2023-07-14T12:53:41.617889+0000","last_peered":"2023-07-14T12:53:41.617889+0000","last_clean":"2023-07-14T12:53:41.617889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642176+0000","last_undegraded":"2023-07-14T12:53:42.642176+0000","last_fullsized":"2023-07-14T12:53:42.642176+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:36:03.975351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.641868+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T12:53:42.641868+0000","last_peered":"2023-07-14T12:53:42.641868+0000","last_clean":"2023-07-14T12:53:42.641868+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T12:53:42.641868+0000","last_undegraded":"2023-07-14T12:53:42.641868+0000","last_fullsized":"2023-07-14T12:53:42.641868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:57:08.591309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.642814+0000","last_change":"2023-07-14T12:53:42.642814+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642814+0000","last_undegraded":"2023-07-14T12:53:42.642814+0000","last_fullsized":"2023-07-14T12:53:42.642814+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.659051+0000","last_change":"2023-07-14T12:53:42.656054+0000","last_active":"2023-07-14T12:53:42.659051+0000","last_peered":"2023-07-14T12:53:42.659051+0000","last_clean":"2023-07-14T12:53:42.659051+0000","last_became_active":"2023-07-14T12:53:42.655428+0000","last_became_peered":"2023-07-14T12:53:42.655428+0000","last_unstale":"2023-07-14T12:53:42.659051+0000","last_undegraded":"2023-07-14T12:53:42.659051+0000","last_fullsized":"2023-07-14T12:53:42.659051+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:05:06.666472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.650043+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T12:53:42.650043+0000","last_peered":"2023-07-14T12:53:42.650043+0000","last_clean":"2023-07-14T12:53:42.650043+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T12:53:42.650043+0000","last_undegraded":"2023-07-14T12:53:42.650043+0000","last_fullsized":"2023-07-14T12:53:42.650043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:56:02.801501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641542+0000","last_change":"2023-07-14T12:53:42.641542+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641542+0000","last_undegraded":"2023-07-14T12:53:42.641542+0000","last_fullsized":"2023-07-14T12:53:42.641542+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2023-07-14T12:53:42.642286+0000","last_change":"2023-07-14T12:53:42.642286+0000","last_active":"2023-07-14T12:53:41.617889+0000","last_peered":"2023-07-14T12:53:41.617889+0000","last_clean":"2023-07-14T12:53:41.617889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642286+0000","last_undegraded":"2023-07-14T12:53:42.642286+0000","last_fullsized":"2023-07-14T12:53:42.642286+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:45:42.882459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.637991+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T12:53:42.637991+0000","last_peered":"2023-07-14T12:53:42.637991+0000","last_clean":"2023-07-14T12:53:42.637991+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T12:53:42.637991+0000","last_undegraded":"2023-07-14T12:53:42.637991+0000","last_fullsized":"2023-07-14T12:53:42.637991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:42:21.174513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.643440+0000","last_change":"2023-07-14T12:53:42.643440+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.643440+0000","last_undegraded":"2023-07-14T12:53:42.643440+0000","last_fullsized":"2023-07-14T12:53:42.643440+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.665626+0000","last_change":"2023-07-14T12:53:42.663256+0000","last_active":"2023-07-14T12:53:42.665626+0000","last_peered":"2023-07-14T12:53:42.665626+0000","last_clean":"2023-07-14T12:53:42.665626+0000","last_became_active":"2023-07-14T12:53:42.662980+0000","last_became_peered":"2023-07-14T12:53:42.662980+0000","last_unstale":"2023-07-14T12:53:42.665626+0000","last_undegraded":"2023-07-14T12:53:42.665626+0000","last_fullsized":"2023-07-14T12:53:42.665626+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:50:23.974743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.650868+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T12:53:42.650868+0000","last_peered":"2023-07-14T12:53:42.650868+0000","last_clean":"2023-07-14T12:53:42.650868+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T12:53:42.650868+0000","last_undegraded":"2023-07-14T12:53:42.650868+0000","last_fullsized":"2023-07-14T12:53:42.650868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:41:09.149951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.651720+0000","last_change":"2023-07-14T12:53:42.651720+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.651720+0000","last_undegraded":"2023-07-14T12:53:42.651720+0000","last_fullsized":"2023-07-14T12:53:42.651720+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.662266+0000","last_change":"2023-07-14T12:53:42.662266+0000","last_active":"2023-07-14T12:53:42.662266+0000","last_peered":"2023-07-14T12:53:42.662266+0000","last_clean":"2023-07-14T12:53:42.662266+0000","last_became_active":"2023-07-14T12:53:42.661972+0000","last_became_peered":"2023-07-14T12:53:42.661972+0000","last_unstale":"2023-07-14T12:53:42.662266+0000","last_undegraded":"2023-07-14T12:53:42.662266+0000","last_fullsized":"2023-07-14T12:53:42.662266+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:05:09.874552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.637878+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T12:53:42.637878+0000","last_peered":"2023-07-14T12:53:42.637878+0000","last_clean":"2023-07-14T12:53:42.637878+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T12:53:42.637878+0000","last_undegraded":"2023-07-14T12:53:42.637878+0000","last_fullsized":"2023-07-14T12:53:42.637878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:50:30.387747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.647952+0000","last_change":"2023-07-14T12:53:42.647952+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647952+0000","last_undegraded":"2023-07-14T12:53:42.647952+0000","last_fullsized":"2023-07-14T12:53:42.647952+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660149+0000","last_change":"2023-07-14T12:53:42.651999+0000","last_active":"2023-07-14T12:53:42.660149+0000","last_peered":"2023-07-14T12:53:42.660149+0000","last_clean":"2023-07-14T12:53:42.660149+0000","last_became_active":"2023-07-14T12:53:42.651673+0000","last_became_peered":"2023-07-14T12:53:42.651673+0000","last_unstale":"2023-07-14T12:53:42.660149+0000","last_undegraded":"2023-07-14T12:53:42.660149+0000","last_fullsized":"2023-07-14T12:53:42.660149+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:46:08.798453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.657386+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T12:53:42.657386+0000","last_peered":"2023-07-14T12:53:42.657386+0000","last_clean":"2023-07-14T12:53:42.657386+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T12:53:42.657386+0000","last_undegraded":"2023-07-14T12:53:42.657386+0000","last_fullsized":"2023-07-14T12:53:42.657386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:07:17.227547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":978944,"data_stored":745347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.68799999999999994}]},{"osd":1,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.621},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.60599999999999998}]},{"osd":2,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.70299999999999996}]},{"osd":3,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.67400000000000004}]},{"osd":4,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.47999999999999998}]},{"osd":5,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.45100000000000001}]},{"osd":6,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.59099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":385024,"data_stored":154979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.66200000000000003}]},{"osd":1,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.751},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.70999999999999996}]},{"osd":2,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.51100000000000001}]},{"osd":3,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.56399999999999995}]},{"osd":4,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.626},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.72699999999999998}]},{"osd":7,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.76900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":385024,"data_stored":154979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.77200000000000002}]},{"osd":1,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.70399999999999996}]},{"osd":2,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.80400000000000005}]},{"osd":3,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.71799999999999997}]},{"osd":4,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.746},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.73499999999999999}]},{"osd":6,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.623},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.60199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":385024,"data_stored":154979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.57199999999999995}]},{"osd":1,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.69899999999999995}]},{"osd":2,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.497},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.53800000000000003}]},{"osd":3,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.76400000000000001}]},{"osd":6,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.72899999999999998}]},{"osd":7,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.622}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":385024,"data_stored":154979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.46400000000000002}]},{"osd":1,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.60199999999999998}]},{"osd":7,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.64300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":380928,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.377},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.51100000000000001}]},{"osd":1,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.46200000000000002}]},{"osd":3,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.70899999999999996}]},{"osd":5,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.2269999999999999,"5min":2.2269999999999999,"15min":2.2269999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.76100000000000001}]},{"osd":6,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.84399999999999997}]},{"osd":7,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.72499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":385024,"data_stored":154979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.45600000000000002}]},{"osd":2,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.435}]},{"osd":3,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.38600000000000001}]},{"osd":4,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.68300000000000005}]},{"osd":5,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.60899999999999999}]},{"osd":6,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.63200000000000001}]},{"osd":7,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.66900000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":974848,"data_stored":744328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.46700000000000003}]},{"osd":2,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.434}]},{"osd":3,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.48299999999999998}]},{"osd":4,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.90600000000000003}]},{"osd":5,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.85999999999999999}]},{"osd":6,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.875}]},{"osd":7,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.77500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T12:53:48.586 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2023-07-14T12:53:48.586 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.645328+0000', 'last_change': '2023-07-14T12:53:42.645328+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.645328+0000', 'last_undegraded': '2023-07-14T12:53:42.645328+0000', 'last_fullsized': '2023-07-14T12:53:42.645328+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T12:53:48.587 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2023-07-14T12:53:48.587 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.643328+0000', 'last_change': '2023-07-14T12:53:42.643328+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.643328+0000', 'last_undegraded': '2023-07-14T12:53:42.643328+0000', 'last_fullsized': '2023-07-14T12:53:42.643328+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T12:53:48.587 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2023-07-14T12:53:48.588 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.647318+0000', 'last_change': '2023-07-14T12:53:42.647318+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.647318+0000', 'last_undegraded': '2023-07-14T12:53:42.647318+0000', 'last_fullsized': '2023-07-14T12:53:42.647318+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T12:53:48.588 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2023-07-14T12:53:48.589 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.653927+0000', 'last_change': '2023-07-14T12:53:42.653927+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.653927+0000', 'last_undegraded': '2023-07-14T12:53:42.653927+0000', 'last_fullsized': '2023-07-14T12:53:42.653927+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T12:53:48.589 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2023-07-14T12:53:48.589 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.648793+0000', 'last_change': '2023-07-14T12:53:42.648793+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.648793+0000', 'last_undegraded': '2023-07-14T12:53:42.648793+0000', 'last_fullsized': '2023-07-14T12:53:42.648793+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T12:53:48.590 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2023-07-14T12:53:48.590 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.641297+0000', 'last_change': '2023-07-14T12:53:42.641297+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.641297+0000', 'last_undegraded': '2023-07-14T12:53:42.641297+0000', 'last_fullsized': '2023-07-14T12:53:42.641297+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T12:53:48.590 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2023-07-14T12:53:48.591 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.647261+0000', 'last_change': '2023-07-14T12:53:42.647261+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.647261+0000', 'last_undegraded': '2023-07-14T12:53:42.647261+0000', 'last_fullsized': '2023-07-14T12:53:42.647261+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T12:53:48.591 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2023-07-14T12:53:48.591 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.641654+0000', 'last_change': '2023-07-14T12:53:42.641654+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.641654+0000', 'last_undegraded': '2023-07-14T12:53:42.641654+0000', 'last_fullsized': '2023-07-14T12:53:42.641654+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T12:53:48.592 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2023-07-14T12:53:48.592 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.646767+0000', 'last_change': '2023-07-14T12:53:42.646767+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.646767+0000', 'last_undegraded': '2023-07-14T12:53:42.646767+0000', 'last_fullsized': '2023-07-14T12:53:42.646767+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T12:53:48.592 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2023-07-14T12:53:48.593 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.644432+0000', 'last_change': '2023-07-14T12:53:42.644432+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.644432+0000', 'last_undegraded': '2023-07-14T12:53:42.644432+0000', 'last_fullsized': '2023-07-14T12:53:42.644432+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T12:53:48.593 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2023-07-14T12:53:48.593 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.645761+0000', 'last_change': '2023-07-14T12:53:42.645761+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.645761+0000', 'last_undegraded': '2023-07-14T12:53:42.645761+0000', 'last_fullsized': '2023-07-14T12:53:42.645761+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T12:53:48.593 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2023-07-14T12:53:48.594 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.646179+0000', 'last_change': '2023-07-14T12:53:42.646179+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.646179+0000', 'last_undegraded': '2023-07-14T12:53:42.646179+0000', 'last_fullsized': '2023-07-14T12:53:42.646179+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T12:53:48.594 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2023-07-14T12:53:48.594 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.645077+0000', 'last_change': '2023-07-14T12:53:42.645077+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.645077+0000', 'last_undegraded': '2023-07-14T12:53:42.645077+0000', 'last_fullsized': '2023-07-14T12:53:42.645077+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T12:53:48.595 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2023-07-14T12:53:48.595 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.652178+0000', 'last_change': '2023-07-14T12:53:42.652178+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.652178+0000', 'last_undegraded': '2023-07-14T12:53:42.652178+0000', 'last_fullsized': '2023-07-14T12:53:42.652178+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T12:53:48.595 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2023-07-14T12:53:48.596 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.646675+0000', 'last_change': '2023-07-14T12:53:42.646675+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.646675+0000', 'last_undegraded': '2023-07-14T12:53:42.646675+0000', 'last_fullsized': '2023-07-14T12:53:42.646675+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T12:53:48.596 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2023-07-14T12:53:48.596 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.646909+0000', 'last_change': '2023-07-14T12:53:42.646909+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.646909+0000', 'last_undegraded': '2023-07-14T12:53:42.646909+0000', 'last_fullsized': '2023-07-14T12:53:42.646909+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T12:53:48.597 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2023-07-14T12:53:48.597 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.649953+0000', 'last_change': '2023-07-14T12:53:42.649953+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.649953+0000', 'last_undegraded': '2023-07-14T12:53:42.649953+0000', 'last_fullsized': '2023-07-14T12:53:42.649953+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T12:53:48.597 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2023-07-14T12:53:48.598 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.655629+0000', 'last_change': '2023-07-14T12:53:42.655629+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.655629+0000', 'last_undegraded': '2023-07-14T12:53:42.655629+0000', 'last_fullsized': '2023-07-14T12:53:42.655629+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T12:53:48.598 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2023-07-14T12:53:48.598 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.649331+0000', 'last_change': '2023-07-14T12:53:42.649331+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.649331+0000', 'last_undegraded': '2023-07-14T12:53:42.649331+0000', 'last_fullsized': '2023-07-14T12:53:42.649331+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T12:53:48.599 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2023-07-14T12:53:48.599 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.653939+0000', 'last_change': '2023-07-14T12:53:42.653939+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.653939+0000', 'last_undegraded': '2023-07-14T12:53:42.653939+0000', 'last_fullsized': '2023-07-14T12:53:42.653939+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T12:53:48.599 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2023-07-14T12:53:48.600 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.645901+0000', 'last_change': '2023-07-14T12:53:42.645901+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.645901+0000', 'last_undegraded': '2023-07-14T12:53:42.645901+0000', 'last_fullsized': '2023-07-14T12:53:42.645901+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T12:53:48.600 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2023-07-14T12:53:48.600 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.650211+0000', 'last_change': '2023-07-14T12:53:42.650211+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.650211+0000', 'last_undegraded': '2023-07-14T12:53:42.650211+0000', 'last_fullsized': '2023-07-14T12:53:42.650211+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T12:53:48.601 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2023-07-14T12:53:48.601 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.646973+0000', 'last_change': '2023-07-14T12:53:42.646973+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.646973+0000', 'last_undegraded': '2023-07-14T12:53:42.646973+0000', 'last_fullsized': '2023-07-14T12:53:42.646973+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T12:53:48.601 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2023-07-14T12:53:48.601 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.647811+0000', 'last_change': '2023-07-14T12:53:42.647811+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.647811+0000', 'last_undegraded': '2023-07-14T12:53:42.647811+0000', 'last_fullsized': '2023-07-14T12:53:42.647811+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T12:53:48.602 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2023-07-14T12:53:48.602 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.655683+0000', 'last_change': '2023-07-14T12:53:42.655683+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.655683+0000', 'last_undegraded': '2023-07-14T12:53:42.655683+0000', 'last_fullsized': '2023-07-14T12:53:42.655683+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T12:53:48.602 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2023-07-14T12:53:48.603 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.641334+0000', 'last_change': '2023-07-14T12:53:42.641334+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.641334+0000', 'last_undegraded': '2023-07-14T12:53:42.641334+0000', 'last_fullsized': '2023-07-14T12:53:42.641334+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T12:53:48.603 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2023-07-14T12:53:48.603 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.653521+0000', 'last_change': '2023-07-14T12:53:42.653521+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.653521+0000', 'last_undegraded': '2023-07-14T12:53:42.653521+0000', 'last_fullsized': '2023-07-14T12:53:42.653521+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T12:53:48.604 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2023-07-14T12:53:48.604 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.643829+0000', 'last_change': '2023-07-14T12:53:42.643829+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.643829+0000', 'last_undegraded': '2023-07-14T12:53:42.643829+0000', 'last_fullsized': '2023-07-14T12:53:42.643829+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T12:53:48.604 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2023-07-14T12:53:48.605 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.656441+0000', 'last_change': '2023-07-14T12:53:42.656441+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.656441+0000', 'last_undegraded': '2023-07-14T12:53:42.656441+0000', 'last_fullsized': '2023-07-14T12:53:42.656441+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T12:53:48.605 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2023-07-14T12:53:48.605 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.654938+0000', 'last_change': '2023-07-14T12:53:42.654938+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.654938+0000', 'last_undegraded': '2023-07-14T12:53:42.654938+0000', 'last_fullsized': '2023-07-14T12:53:42.654938+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T12:53:48.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2023-07-14T12:53:48.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.646446+0000', 'last_change': '2023-07-14T12:53:42.646446+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.646446+0000', 'last_undegraded': '2023-07-14T12:53:42.646446+0000', 'last_fullsized': '2023-07-14T12:53:42.646446+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T12:53:48.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2023-07-14T12:53:48.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.641645+0000', 'last_change': '2023-07-14T12:53:42.641645+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.641645+0000', 'last_undegraded': '2023-07-14T12:53:42.641645+0000', 'last_fullsized': '2023-07-14T12:53:42.641645+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T12:53:48.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-07-14T12:53:48.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.648006+0000', 'last_change': '2023-07-14T12:53:42.648006+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.648006+0000', 'last_undegraded': '2023-07-14T12:53:42.648006+0000', 'last_fullsized': '2023-07-14T12:53:42.648006+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T12:53:48.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-07-14T12:53:48.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 6, 'reported_epoch': 35, 'state': 'active', 'last_fresh': '2023-07-14T12:53:42.667572+0000', 'last_change': '2023-07-14T12:53:42.667507+0000', 'last_active': '2023-07-14T12:53:42.667572+0000', 'last_peered': '2023-07-14T12:53:42.667572+0000', 'last_clean': '2023-07-14T12:53:41.617889+0000', 'last_became_active': '2023-07-14T12:53:42.667507+0000', 'last_became_peered': '2023-07-14T12:53:42.667507+0000', 'last_unstale': '2023-07-14T12:53:42.667572+0000', 'last_undegraded': '2023-07-14T12:53:42.667572+0000', 'last_fullsized': '2023-07-14T12:53:42.667572+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:41.617889+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:41.617889+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:41.617889+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-07-15T15:11:49.413274+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': ['6', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T12:53:48.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-07-14T12:53:48.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.641265+0000', 'last_change': '2023-07-14T12:53:42.641265+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.641265+0000', 'last_undegraded': '2023-07-14T12:53:42.641265+0000', 'last_fullsized': '2023-07-14T12:53:42.641265+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T12:53:48.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-07-14T12:53:48.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.652195+0000', 'last_change': '2023-07-14T12:53:42.652195+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.652195+0000', 'last_undegraded': '2023-07-14T12:53:42.652195+0000', 'last_fullsized': '2023-07-14T12:53:42.652195+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T12:53:48.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-07-14T12:53:48.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.644784+0000', 'last_change': '2023-07-14T12:53:42.644784+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.644784+0000', 'last_undegraded': '2023-07-14T12:53:42.644784+0000', 'last_fullsized': '2023-07-14T12:53:42.644784+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T12:53:48.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-07-14T12:53:48.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.647247+0000', 'last_change': '2023-07-14T12:53:42.647247+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.647247+0000', 'last_undegraded': '2023-07-14T12:53:42.647247+0000', 'last_fullsized': '2023-07-14T12:53:42.647247+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T12:53:48.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-07-14T12:53:48.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.646250+0000', 'last_change': '2023-07-14T12:53:42.646250+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.646250+0000', 'last_undegraded': '2023-07-14T12:53:42.646250+0000', 'last_fullsized': '2023-07-14T12:53:42.646250+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T12:53:48.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-07-14T12:53:48.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 35, 'state': 'creating+activating', 'last_fresh': '2023-07-14T12:53:42.647277+0000', 'last_change': '2023-07-14T12:53:42.647277+0000', 'last_active': '2023-07-14T12:53:41.617889+0000', 'last_peered': '2023-07-14T12:53:41.617889+0000', 'last_clean': '2023-07-14T12:53:41.617889+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.647277+0000', 'last_undegraded': '2023-07-14T12:53:42.647277+0000', 'last_fullsized': '2023-07-14T12:53:42.647277+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:41.617889+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:41.617889+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:41.617889+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-07-15T20:00:36.016042+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': ['7', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T12:53:48.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-07-14T12:53:48.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.651300+0000', 'last_change': '2023-07-14T12:53:42.651300+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.651300+0000', 'last_undegraded': '2023-07-14T12:53:42.651300+0000', 'last_fullsized': '2023-07-14T12:53:42.651300+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T12:53:48.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-07-14T12:53:48.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.643163+0000', 'last_change': '2023-07-14T12:53:42.643163+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.643163+0000', 'last_undegraded': '2023-07-14T12:53:42.643163+0000', 'last_fullsized': '2023-07-14T12:53:42.643163+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T12:53:48.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-07-14T12:53:48.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.647161+0000', 'last_change': '2023-07-14T12:53:42.647161+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.647161+0000', 'last_undegraded': '2023-07-14T12:53:42.647161+0000', 'last_fullsized': '2023-07-14T12:53:42.647161+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T12:53:48.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-07-14T12:53:48.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.648691+0000', 'last_change': '2023-07-14T12:53:42.648691+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.648691+0000', 'last_undegraded': '2023-07-14T12:53:42.648691+0000', 'last_fullsized': '2023-07-14T12:53:42.648691+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T12:53:48.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-07-14T12:53:48.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.642551+0000', 'last_change': '2023-07-14T12:53:42.642551+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.642551+0000', 'last_undegraded': '2023-07-14T12:53:42.642551+0000', 'last_fullsized': '2023-07-14T12:53:42.642551+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T12:53:48.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-07-14T12:53:48.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.651585+0000', 'last_change': '2023-07-14T12:53:42.651585+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.651585+0000', 'last_undegraded': '2023-07-14T12:53:42.651585+0000', 'last_fullsized': '2023-07-14T12:53:42.651585+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T12:53:48.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-07-14T12:53:48.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.644304+0000', 'last_change': '2023-07-14T12:53:42.644304+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.644304+0000', 'last_undegraded': '2023-07-14T12:53:42.644304+0000', 'last_fullsized': '2023-07-14T12:53:42.644304+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T12:53:48.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-07-14T12:53:48.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.641323+0000', 'last_change': '2023-07-14T12:53:42.641323+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.641323+0000', 'last_undegraded': '2023-07-14T12:53:42.641323+0000', 'last_fullsized': '2023-07-14T12:53:42.641323+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T12:53:48.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-07-14T12:53:48.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.646506+0000', 'last_change': '2023-07-14T12:53:42.646506+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.646506+0000', 'last_undegraded': '2023-07-14T12:53:42.646506+0000', 'last_fullsized': '2023-07-14T12:53:42.646506+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T12:53:48.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-07-14T12:53:48.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.642688+0000', 'last_change': '2023-07-14T12:53:42.642688+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.642688+0000', 'last_undegraded': '2023-07-14T12:53:42.642688+0000', 'last_fullsized': '2023-07-14T12:53:42.642688+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T12:53:48.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-07-14T12:53:48.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.642357+0000', 'last_change': '2023-07-14T12:53:42.642357+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.642357+0000', 'last_undegraded': '2023-07-14T12:53:42.642357+0000', 'last_fullsized': '2023-07-14T12:53:42.642357+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T12:53:48.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-07-14T12:53:48.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.645275+0000', 'last_change': '2023-07-14T12:53:42.645275+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.645275+0000', 'last_undegraded': '2023-07-14T12:53:42.645275+0000', 'last_fullsized': '2023-07-14T12:53:42.645275+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T12:53:48.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-07-14T12:53:48.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 35, 'state': 'creating+activating', 'last_fresh': '2023-07-14T12:53:42.650520+0000', 'last_change': '2023-07-14T12:53:42.650520+0000', 'last_active': '2023-07-14T12:53:41.617889+0000', 'last_peered': '2023-07-14T12:53:41.617889+0000', 'last_clean': '2023-07-14T12:53:41.617889+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.650520+0000', 'last_undegraded': '2023-07-14T12:53:42.650520+0000', 'last_fullsized': '2023-07-14T12:53:42.650520+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:41.617889+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:41.617889+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:41.617889+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-07-16T00:11:50.985338+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': ['4', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T12:53:48.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-07-14T12:53:48.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.652789+0000', 'last_change': '2023-07-14T12:53:42.652789+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.652789+0000', 'last_undegraded': '2023-07-14T12:53:42.652789+0000', 'last_fullsized': '2023-07-14T12:53:42.652789+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T12:53:48.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-07-14T12:53:48.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.643100+0000', 'last_change': '2023-07-14T12:53:42.643100+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.643100+0000', 'last_undegraded': '2023-07-14T12:53:42.643100+0000', 'last_fullsized': '2023-07-14T12:53:42.643100+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T12:53:48.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-07-14T12:53:48.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.646351+0000', 'last_change': '2023-07-14T12:53:42.646351+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.646351+0000', 'last_undegraded': '2023-07-14T12:53:42.646351+0000', 'last_fullsized': '2023-07-14T12:53:42.646351+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T12:53:48.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-07-14T12:53:48.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.641768+0000', 'last_change': '2023-07-14T12:53:42.641768+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.641768+0000', 'last_undegraded': '2023-07-14T12:53:42.641768+0000', 'last_fullsized': '2023-07-14T12:53:42.641768+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T12:53:48.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-07-14T12:53:48.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 35, 'state': 'creating+activating', 'last_fresh': '2023-07-14T12:53:42.644109+0000', 'last_change': '2023-07-14T12:53:42.644109+0000', 'last_active': '2023-07-14T12:53:41.617889+0000', 'last_peered': '2023-07-14T12:53:41.617889+0000', 'last_clean': '2023-07-14T12:53:41.617889+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.644109+0000', 'last_undegraded': '2023-07-14T12:53:42.644109+0000', 'last_fullsized': '2023-07-14T12:53:42.644109+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:41.617889+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:41.617889+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:41.617889+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-07-15T21:03:35.822921+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': ['2', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T12:53:48.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-07-14T12:53:48.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.644543+0000', 'last_change': '2023-07-14T12:53:42.644543+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.644543+0000', 'last_undegraded': '2023-07-14T12:53:42.644543+0000', 'last_fullsized': '2023-07-14T12:53:42.644543+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T12:53:48.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-07-14T12:53:48.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.642204+0000', 'last_change': '2023-07-14T12:53:42.642204+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.642204+0000', 'last_undegraded': '2023-07-14T12:53:42.642204+0000', 'last_fullsized': '2023-07-14T12:53:42.642204+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T12:53:48.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-07-14T12:53:48.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.644851+0000', 'last_change': '2023-07-14T12:53:42.644851+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.644851+0000', 'last_undegraded': '2023-07-14T12:53:42.644851+0000', 'last_fullsized': '2023-07-14T12:53:42.644851+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T12:53:48.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-07-14T12:53:48.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.642930+0000', 'last_change': '2023-07-14T12:53:42.642930+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.642930+0000', 'last_undegraded': '2023-07-14T12:53:42.642930+0000', 'last_fullsized': '2023-07-14T12:53:42.642930+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T12:53:48.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-07-14T12:53:48.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.648143+0000', 'last_change': '2023-07-14T12:53:42.648143+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.648143+0000', 'last_undegraded': '2023-07-14T12:53:42.648143+0000', 'last_fullsized': '2023-07-14T12:53:42.648143+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T12:53:48.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-07-14T12:53:48.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 35, 'state': 'creating+activating', 'last_fresh': '2023-07-14T12:53:42.642176+0000', 'last_change': '2023-07-14T12:53:42.642176+0000', 'last_active': '2023-07-14T12:53:41.617889+0000', 'last_peered': '2023-07-14T12:53:41.617889+0000', 'last_clean': '2023-07-14T12:53:41.617889+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.642176+0000', 'last_undegraded': '2023-07-14T12:53:42.642176+0000', 'last_fullsized': '2023-07-14T12:53:42.642176+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:41.617889+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:41.617889+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:41.617889+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-07-15T15:36:03.975351+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': ['2', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T12:53:48.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-07-14T12:53:48.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.642814+0000', 'last_change': '2023-07-14T12:53:42.642814+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.642814+0000', 'last_undegraded': '2023-07-14T12:53:42.642814+0000', 'last_fullsized': '2023-07-14T12:53:42.642814+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T12:53:48.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-07-14T12:53:48.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.641542+0000', 'last_change': '2023-07-14T12:53:42.641542+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.641542+0000', 'last_undegraded': '2023-07-14T12:53:42.641542+0000', 'last_fullsized': '2023-07-14T12:53:42.641542+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T12:53:48.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-07-14T12:53:48.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 35, 'state': 'creating+activating', 'last_fresh': '2023-07-14T12:53:42.642286+0000', 'last_change': '2023-07-14T12:53:42.642286+0000', 'last_active': '2023-07-14T12:53:41.617889+0000', 'last_peered': '2023-07-14T12:53:41.617889+0000', 'last_clean': '2023-07-14T12:53:41.617889+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.642286+0000', 'last_undegraded': '2023-07-14T12:53:42.642286+0000', 'last_fullsized': '2023-07-14T12:53:42.642286+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:41.617889+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:41.617889+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:41.617889+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-07-15T16:45:42.882459+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': ['0', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T12:53:48.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-07-14T12:53:48.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.643440+0000', 'last_change': '2023-07-14T12:53:42.643440+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.643440+0000', 'last_undegraded': '2023-07-14T12:53:42.643440+0000', 'last_fullsized': '2023-07-14T12:53:42.643440+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T12:53:48.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-07-14T12:53:48.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.651720+0000', 'last_change': '2023-07-14T12:53:42.651720+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.651720+0000', 'last_undegraded': '2023-07-14T12:53:42.651720+0000', 'last_fullsized': '2023-07-14T12:53:42.651720+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T12:53:48.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-07-14T12:53:48.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-14T12:53:42.647952+0000', 'last_change': '2023-07-14T12:53:42.647952+0000', 'last_active': '2023-07-14T12:53:42.626197+0000', 'last_peered': '2023-07-14T12:53:42.626197+0000', 'last_clean': '2023-07-14T12:53:42.626197+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T12:53:42.647952+0000', 'last_undegraded': '2023-07-14T12:53:42.647952+0000', 'last_fullsized': '2023-07-14T12:53:42.647952+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'last_clean_scrub_stamp': '2023-07-14T12:53:42.626197+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T12:53:48.632 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-14T12:53:48.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.745+0000 7f9c54448640 1 Processor -- start 2023-07-14T12:53:48.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.745+0000 7f9c54448640 1 -- start start 2023-07-14T12:53:48.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.749+0000 7f9c54448640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9c4c0d06b0 0x7f9c4c0b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:48.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.749+0000 7f9c54448640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9c4c145430 0x7f9c4c0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:48.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.749+0000 7f9c54448640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c4c0b1f70 0x7f9c4c0d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:48.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.749+0000 7f9c54448640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c4c0b2410 con 0x7f9c4c0d06b0 2023-07-14T12:53:48.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.749+0000 7f9c54448640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c4c0b26f0 con 0x7f9c4c145430 2023-07-14T12:53:48.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.749+0000 7f9c54448640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c0b29d0 con 0x7f9c4c0b1f70 2023-07-14T12:53:48.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.749+0000 7f9c521e4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9c4c0d06b0 0x7f9c4c0b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:48.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.749+0000 7f9c521e4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9c4c0d06b0 0x7f9c4c0b1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50832/0 (socket says 172.21.15.5:50832) 2023-07-14T12:53:48.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.749+0000 7f9c521e4640 1 -- 172.21.15.5:0/1052174691 learned_addr learned my addr 172.21.15.5:0/1052174691 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:48.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.749+0000 7f9c529e5640 1 --2- 172.21.15.5:0/1052174691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c4c0b1f70 0x7f9c4c0d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:48.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.749+0000 7f9c519e3640 1 --2- 172.21.15.5:0/1052174691 >> v2:172.21.15.154:3300/0 conn(0x7f9c4c145430 0x7f9c4c0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:48.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.749+0000 7f9c521e4640 1 -- 172.21.15.5:0/1052174691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c4c0b1f70 msgr2=0x7f9c4c0d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:48.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.749+0000 7f9c521e4640 1 --2- 172.21.15.5:0/1052174691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c4c0b1f70 0x7f9c4c0d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:48.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.749+0000 7f9c521e4640 1 -- 172.21.15.5:0/1052174691 >> v2:172.21.15.154:3300/0 conn(0x7f9c4c145430 msgr2=0x7f9c4c0b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:48.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.749+0000 7f9c521e4640 1 --2- 172.21.15.5:0/1052174691 >> v2:172.21.15.154:3300/0 conn(0x7f9c4c145430 0x7f9c4c0b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:48.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.749+0000 7f9c521e4640 1 -- 172.21.15.5:0/1052174691 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c0b2cb0 con 0x7f9c4c0d06b0 2023-07-14T12:53:48.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.749+0000 7f9c519e3640 1 --2- 172.21.15.5:0/1052174691 >> v2:172.21.15.154:3300/0 conn(0x7f9c4c145430 0x7f9c4c0b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:48.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.753+0000 7f9c521e4640 1 --2- 172.21.15.5:0/1052174691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c4c0d06b0 0x7f9c4c0b1a30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c08b230 tx=0x7f9c4801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2947fb7bc4815d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:48.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.753+0000 7f9c511e2640 1 -- 172.21.15.5:0/1052174691 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c480aa610 con 0x7f9c4c0d06b0 2023-07-14T12:53:48.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.753+0000 7f9c511e2640 1 -- 172.21.15.5:0/1052174691 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c480a6040 con 0x7f9c4c0d06b0 2023-07-14T12:53:48.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.753+0000 7f9c511e2640 1 -- 172.21.15.5:0/1052174691 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c480aa990 con 0x7f9c4c0d06b0 2023-07-14T12:53:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.753+0000 7f9c54448640 1 -- 172.21.15.5:0/1052174691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c4c0d06b0 msgr2=0x7f9c4c0b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.753+0000 7f9c54448640 1 --2- 172.21.15.5:0/1052174691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c4c0d06b0 0x7f9c4c0b1a30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c08b230 tx=0x7f9c4801c4d0 comp rx=0 tx=0).stop 2023-07-14T12:53:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.753+0000 7f9c54448640 1 -- 172.21.15.5:0/1052174691 shutdown_connections 2023-07-14T12:53:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.753+0000 7f9c54448640 1 --2- 172.21.15.5:0/1052174691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c4c0b1f70 0x7f9c4c0d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.753+0000 7f9c54448640 1 --2- 172.21.15.5:0/1052174691 >> v2:172.21.15.154:3300/0 conn(0x7f9c4c145430 0x7f9c4c0b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.753+0000 7f9c54448640 1 --2- 172.21.15.5:0/1052174691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c4c0d06b0 0x7f9c4c0b1a30 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:48.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.753+0000 7f9c54448640 1 -- 172.21.15.5:0/1052174691 >> 172.21.15.5:0/1052174691 conn(0x7f9c4c0659d0 msgr2=0x7f9c4c09b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:48.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.753+0000 7f9c54448640 1 -- 172.21.15.5:0/1052174691 shutdown_connections 2023-07-14T12:53:48.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.753+0000 7f9c54448640 1 -- 172.21.15.5:0/1052174691 wait complete. 2023-07-14T12:53:48.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.753+0000 7f9c54448640 1 Processor -- start 2023-07-14T12:53:48.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.753+0000 7f9c54448640 1 -- start start 2023-07-14T12:53:48.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.757+0000 7f9c54448640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c4c0b1f70 0x7f9c4c159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:48.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.757+0000 7f9c54448640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c4c0d06b0 0x7f9c4c0b7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:48.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.757+0000 7f9c54448640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c4c158e30 0x7f9c4c157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:48.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.757+0000 7f9c54448640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c0b8190 con 0x7f9c4c0d06b0 2023-07-14T12:53:48.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.757+0000 7f9c54448640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c159b10 con 0x7f9c4c158e30 2023-07-14T12:53:48.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.757+0000 7f9c54448640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c157dd0 con 0x7f9c4c0b1f70 2023-07-14T12:53:48.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.757+0000 7f9c519e3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c4c0d06b0 0x7f9c4c0b7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:48.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.757+0000 7f9c519e3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c4c0d06b0 0x7f9c4c0b7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50848/0 (socket says 172.21.15.5:50848) 2023-07-14T12:53:48.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.757+0000 7f9c519e3640 1 -- 172.21.15.5:0/3956655540 learned_addr learned my addr 172.21.15.5:0/3956655540 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:48.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.757+0000 7f9c521e4640 1 --2- 172.21.15.5:0/3956655540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c4c0b1f70 0x7f9c4c159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:48.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.757+0000 7f9c529e5640 1 --2- 172.21.15.5:0/3956655540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c4c158e30 0x7f9c4c157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:48.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.757+0000 7f9c519e3640 1 -- 172.21.15.5:0/3956655540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c4c0b1f70 msgr2=0x7f9c4c159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:48.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.757+0000 7f9c519e3640 1 --2- 172.21.15.5:0/3956655540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c4c0b1f70 0x7f9c4c159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:48.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.757+0000 7f9c519e3640 1 -- 172.21.15.5:0/3956655540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c4c158e30 msgr2=0x7f9c4c157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:48.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.757+0000 7f9c519e3640 1 --2- 172.21.15.5:0/3956655540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c4c158e30 0x7f9c4c157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:48.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.757+0000 7f9c519e3640 1 -- 172.21.15.5:0/3956655540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c480094d0 con 0x7f9c4c0d06b0 2023-07-14T12:53:48.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.757+0000 7f9c519e3640 1 --2- 172.21.15.5:0/3956655540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c4c0d06b0 0x7f9c4c0b7c50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c00e810 tx=0x7f9c3c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:48.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.757+0000 7f9c42ffd640 1 -- 172.21.15.5:0/3956655540 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c00c870 con 0x7f9c4c0d06b0 2023-07-14T12:53:48.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.757+0000 7f9c42ffd640 1 -- 172.21.15.5:0/3956655540 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3c00c9d0 con 0x7f9c4c0d06b0 2023-07-14T12:53:48.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.757+0000 7f9c54448640 1 -- 172.21.15.5:0/3956655540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c4c157bb0 con 0x7f9c4c0d06b0 2023-07-14T12:53:48.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.757+0000 7f9c42ffd640 1 -- 172.21.15.5:0/3956655540 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c00cd60 con 0x7f9c4c0d06b0 2023-07-14T12:53:48.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.757+0000 7f9c54448640 1 -- 172.21.15.5:0/3956655540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c4c158350 con 0x7f9c4c0d06b0 2023-07-14T12:53:48.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.757+0000 7f9c54448640 1 -- 172.21.15.5:0/3956655540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4c072e70 con 0x7f9c4c0d06b0 2023-07-14T12:53:48.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.757+0000 7f9c42ffd640 1 -- 172.21.15.5:0/3956655540 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9c3c013410 con 0x7f9c4c0d06b0 2023-07-14T12:53:48.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.761+0000 7f9c42ffd640 1 --2- 172.21.15.5:0/3956655540 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9c300662d0 0x7f9c30068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:48.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.761+0000 7f9c42ffd640 1 -- 172.21.15.5:0/3956655540 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9c3c0839e0 con 0x7f9c4c0d06b0 2023-07-14T12:53:48.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.761+0000 7f9c521e4640 1 --2- 172.21.15.5:0/3956655540 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9c300662d0 0x7f9c30068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:48.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.761+0000 7f9c521e4640 1 --2- 172.21.15.5:0/3956655540 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9c300662d0 0x7f9c30068780 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9c480ae000 tx=0x7f9c480a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:48.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.765+0000 7f9c42ffd640 1 -- 172.21.15.5:0/3956655540 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9c3c050f40 con 0x7f9c4c0d06b0 2023-07-14T12:53:49.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.977+0000 7f9c54448640 1 -- 172.21.15.5:0/3956655540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9c4c0678d0 con 0x7f9c4c0d06b0 2023-07-14T12:53:49.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.977+0000 7f9c42ffd640 1 -- 172.21.15.5:0/3956655540 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1662 (secure 0 0 0) 0x7f9c3c009480 con 0x7f9c4c0d06b0 2023-07-14T12:53:49.006 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:49.007 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":88,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":37,"num_osds":8,"num_up_osds":8,"osd_up_since":1689339152,"num_in_osds":8,"osd_in_since":1689339143,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":35},{"state_name":"creating+activating","count":5},{"state_name":"active","count":1}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":241827840,"bytes_avail":772852285440,"bytes_total":773094113280,"inactive_pgs_ratio":0.65714287757873535},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5133}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-07-14T12:53:33.645844+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-14T12:53:49.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.981+0000 7f9c54448640 1 -- 172.21.15.5:0/3956655540 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9c300662d0 msgr2=0x7f9c30068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:49.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.981+0000 7f9c54448640 1 --2- 172.21.15.5:0/3956655540 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9c300662d0 0x7f9c30068780 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9c480ae000 tx=0x7f9c480a7000 comp rx=0 tx=0).stop 2023-07-14T12:53:49.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.981+0000 7f9c54448640 1 -- 172.21.15.5:0/3956655540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c4c0d06b0 msgr2=0x7f9c4c0b7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:49.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.981+0000 7f9c54448640 1 --2- 172.21.15.5:0/3956655540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c4c0d06b0 0x7f9c4c0b7c50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c00e810 tx=0x7f9c3c00ecd0 comp rx=0 tx=0).stop 2023-07-14T12:53:49.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.981+0000 7f9c54448640 1 -- 172.21.15.5:0/3956655540 shutdown_connections 2023-07-14T12:53:49.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.981+0000 7f9c54448640 1 --2- 172.21.15.5:0/3956655540 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9c300662d0 0x7f9c30068780 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:49.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.981+0000 7f9c54448640 1 --2- 172.21.15.5:0/3956655540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c4c158e30 0x7f9c4c157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:49.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.981+0000 7f9c54448640 1 --2- 172.21.15.5:0/3956655540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c4c0d06b0 0x7f9c4c0b7c50 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:49.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.981+0000 7f9c54448640 1 --2- 172.21.15.5:0/3956655540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9c4c0b1f70 0x7f9c4c159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:49.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.981+0000 7f9c54448640 1 -- 172.21.15.5:0/3956655540 >> 172.21.15.5:0/3956655540 conn(0x7f9c4c0659d0 msgr2=0x7f9c4c15b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:49.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.981+0000 7f9c54448640 1 -- 172.21.15.5:0/3956655540 shutdown_connections 2023-07-14T12:53:49.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:48.981+0000 7f9c54448640 1 -- 172.21.15.5:0/3956655540 wait complete. 2023-07-14T12:53:49.027 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-14T12:53:49.028 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T12:53:49.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.145+0000 7f2c8f834640 1 Processor -- start 2023-07-14T12:53:49.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.145+0000 7f2c8f834640 1 -- start start 2023-07-14T12:53:49.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.145+0000 7f2c8f834640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2c8815fd60 0x7f2c880d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:49.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.145+0000 7f2c8f834640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2c880d1850 0x7f2c880d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:49.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.145+0000 7f2c8f834640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c880ccaf0 con 0x7f2c880b7c70 2023-07-14T12:53:49.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.145+0000 7f2c8f834640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c880d1190 con 0x7f2c880d1850 2023-07-14T12:53:49.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.145+0000 7f2c8f834640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c88160600 con 0x7f2c8815fd60 2023-07-14T12:53:49.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.145+0000 7f2c8d5d0640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2c880b7c70 0x7f2c8815f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33080/0 (socket says 172.21.15.5:33080) 2023-07-14T12:53:49.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.145+0000 7f2c8d5d0640 1 -- 172.21.15.5:0/2833316407 learned_addr learned my addr 172.21.15.5:0/2833316407 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:49.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.145+0000 7f2c8ddd1640 1 --2- 172.21.15.5:0/2833316407 >> v2:172.21.15.5:3300/0 conn(0x7f2c880d1850 0x7f2c880d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:49.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.145+0000 7f2c8cdcf640 1 --2- 172.21.15.5:0/2833316407 >> v2:172.21.15.154:3300/0 conn(0x7f2c8815fd60 0x7f2c880d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:49.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.145+0000 7f2c7ffff640 1 -- 172.21.15.5:0/2833316407 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2253699924 0 0) 0x7f2c880ccaf0 con 0x7f2c880b7c70 2023-07-14T12:53:49.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.145+0000 7f2c7ffff640 1 -- 172.21.15.5:0/2833316407 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c74003530 con 0x7f2c880b7c70 2023-07-14T12:53:49.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.145+0000 7f2c8ddd1640 1 -- 172.21.15.5:0/2833316407 >> v2:172.21.15.154:3300/0 conn(0x7f2c8815fd60 msgr2=0x7f2c880d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:49.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.145+0000 7f2c8ddd1640 1 --2- 172.21.15.5:0/2833316407 >> v2:172.21.15.154:3300/0 conn(0x7f2c8815fd60 0x7f2c880d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:49.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.145+0000 7f2c8ddd1640 1 -- 172.21.15.5:0/2833316407 >> v1:172.21.15.5:6789/0 conn(0x7f2c880b7c70 legacy=0x7f2c8815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:49.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.145+0000 7f2c8ddd1640 1 -- 172.21.15.5:0/2833316407 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c88160320 con 0x7f2c880d1850 2023-07-14T12:53:49.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.149+0000 7f2c8ddd1640 1 --2- 172.21.15.5:0/2833316407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c880d1850 0x7f2c880d1da0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2c880b1180 tx=0x7f2c8001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c42f5cf6f609ce server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:49.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.149+0000 7f2c7ffff640 1 -- 172.21.15.5:0/2833316407 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c800a59c0 con 0x7f2c880d1850 2023-07-14T12:53:49.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.149+0000 7f2c7ffff640 1 -- 172.21.15.5:0/2833316407 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c800a5b20 con 0x7f2c880d1850 2023-07-14T12:53:49.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.149+0000 7f2c7ffff640 1 -- 172.21.15.5:0/2833316407 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c800ad440 con 0x7f2c880d1850 2023-07-14T12:53:49.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.149+0000 7f2c8f834640 1 -- 172.21.15.5:0/2833316407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c880d1850 msgr2=0x7f2c880d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:49.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.149+0000 7f2c8f834640 1 --2- 172.21.15.5:0/2833316407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c880d1850 0x7f2c880d1da0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2c880b1180 tx=0x7f2c8001c8e0 comp rx=0 tx=0).stop 2023-07-14T12:53:49.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.149+0000 7f2c8f834640 1 -- 172.21.15.5:0/2833316407 shutdown_connections 2023-07-14T12:53:49.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.149+0000 7f2c8f834640 1 --2- 172.21.15.5:0/2833316407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c880d1850 0x7f2c880d1da0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:49.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.149+0000 7f2c8f834640 1 --2- 172.21.15.5:0/2833316407 >> v2:172.21.15.154:3300/0 conn(0x7f2c8815fd60 0x7f2c880d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:49.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.149+0000 7f2c8f834640 1 -- 172.21.15.5:0/2833316407 >> 172.21.15.5:0/2833316407 conn(0x7f2c880650b0 msgr2=0x7f2c880654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:49.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.149+0000 7f2c8f834640 1 -- 172.21.15.5:0/2833316407 shutdown_connections 2023-07-14T12:53:49.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.149+0000 7f2c8f834640 1 -- 172.21.15.5:0/2833316407 wait complete. 2023-07-14T12:53:49.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.153+0000 7f2c8f834640 1 Processor -- start 2023-07-14T12:53:49.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.153+0000 7f2c8f834640 1 -- start start 2023-07-14T12:53:49.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.153+0000 7f2c8f834640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c880b7c70 0x7f2c8814c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:49.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.153+0000 7f2c8f834640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c880d1850 0x7f2c880c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:49.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.153+0000 7f2c8f834640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c8815fd60 0x7f2c880c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:49.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.153+0000 7f2c8f834640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c880cc0b0 con 0x7f2c880d1850 2023-07-14T12:53:49.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.153+0000 7f2c8f834640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c880b5760 con 0x7f2c880b7c70 2023-07-14T12:53:49.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.153+0000 7f2c8f834640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c880b5130 con 0x7f2c8815fd60 2023-07-14T12:53:49.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.153+0000 7f2c8cdcf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c880d1850 0x7f2c880c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:49.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.153+0000 7f2c8cdcf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c880d1850 0x7f2c880c6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38654/0 (socket says 172.21.15.5:38654) 2023-07-14T12:53:49.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.153+0000 7f2c8cdcf640 1 -- 172.21.15.5:0/2272202979 learned_addr learned my addr 172.21.15.5:0/2272202979 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:49.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.153+0000 7f2c8d5d0640 1 --2- 172.21.15.5:0/2272202979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c880b7c70 0x7f2c8814c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:49.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.153+0000 7f2c8ddd1640 1 --2- 172.21.15.5:0/2272202979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c8815fd60 0x7f2c880c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:49.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.153+0000 7f2c8cdcf640 1 -- 172.21.15.5:0/2272202979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c8815fd60 msgr2=0x7f2c880c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:49.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.153+0000 7f2c8cdcf640 1 --2- 172.21.15.5:0/2272202979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c8815fd60 0x7f2c880c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:49.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.153+0000 7f2c8cdcf640 1 -- 172.21.15.5:0/2272202979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c880b7c70 msgr2=0x7f2c8814c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:49.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.153+0000 7f2c8cdcf640 1 --2- 172.21.15.5:0/2272202979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c880b7c70 0x7f2c8814c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:49.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.153+0000 7f2c8cdcf640 1 -- 172.21.15.5:0/2272202979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c80009a70 con 0x7f2c880d1850 2023-07-14T12:53:49.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.153+0000 7f2c8ddd1640 1 --2- 172.21.15.5:0/2272202979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c8815fd60 0x7f2c880c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:49.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.153+0000 7f2c8cdcf640 1 --2- 172.21.15.5:0/2272202979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c880d1850 0x7f2c880c6840 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800e930 tx=0x7f2c7800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:49.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.153+0000 7f2c7dffb640 1 -- 172.21.15.5:0/2272202979 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c78009690 con 0x7f2c880d1850 2023-07-14T12:53:49.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.153+0000 7f2c7dffb640 1 -- 172.21.15.5:0/2272202979 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7800ca00 con 0x7f2c880d1850 2023-07-14T12:53:49.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.153+0000 7f2c7dffb640 1 -- 172.21.15.5:0/2272202979 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7800cd70 con 0x7f2c880d1850 2023-07-14T12:53:49.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.153+0000 7f2c8f834640 1 -- 172.21.15.5:0/2272202979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c880cc300 con 0x7f2c880d1850 2023-07-14T12:53:49.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.153+0000 7f2c8f834640 1 -- 172.21.15.5:0/2272202979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c880b53f0 con 0x7f2c880d1850 2023-07-14T12:53:49.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.153+0000 7f2c8f834640 1 -- 172.21.15.5:0/2272202979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c880b58d0 con 0x7f2c880d1850 2023-07-14T12:53:49.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.157+0000 7f2c7dffb640 1 -- 172.21.15.5:0/2272202979 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2c78013470 con 0x7f2c880d1850 2023-07-14T12:53:49.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.157+0000 7f2c7dffb640 1 --2- 172.21.15.5:0/2272202979 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2c6c0662b0 0x7f2c6c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:49.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.157+0000 7f2c7dffb640 1 -- 172.21.15.5:0/2272202979 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2c78083f10 con 0x7f2c880d1850 2023-07-14T12:53:49.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.157+0000 7f2c8d5d0640 1 --2- 172.21.15.5:0/2272202979 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2c6c0662b0 0x7f2c6c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:49.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.157+0000 7f2c8d5d0640 1 --2- 172.21.15.5:0/2272202979 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2c6c0662b0 0x7f2c6c068760 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2c840011f0 tx=0x7f2c84009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.161+0000 7f2c7dffb640 1 -- 172.21.15.5:0/2272202979 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2c78051450 con 0x7f2c880d1850 2023-07-14T12:53:49.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.313+0000 7f2c8f834640 1 -- 172.21.15.5:0/2272202979 --> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2c880678d0 con 0x7f2c6c0662b0 2023-07-14T12:53:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.325+0000 7f2c7dffb640 1 -- 172.21.15.5:0/2272202979 <== mgr.4102 v2:172.21.15.154:6832/2736441655 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305419 (secure 0 0 0) 0x7f2c880678d0 con 0x7f2c6c0662b0 2023-07-14T12:53:49.352 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:49.353 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T12:53:49.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.325+0000 7f2c8f834640 1 -- 172.21.15.5:0/2272202979 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2c6c0662b0 msgr2=0x7f2c6c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:49.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.325+0000 7f2c8f834640 1 --2- 172.21.15.5:0/2272202979 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2c6c0662b0 0x7f2c6c068760 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2c840011f0 tx=0x7f2c84009040 comp rx=0 tx=0).stop 2023-07-14T12:53:49.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.325+0000 7f2c8f834640 1 -- 172.21.15.5:0/2272202979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c880d1850 msgr2=0x7f2c880c6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:49.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.325+0000 7f2c8f834640 1 --2- 172.21.15.5:0/2272202979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c880d1850 0x7f2c880c6840 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800e930 tx=0x7f2c7800edf0 comp rx=0 tx=0).stop 2023-07-14T12:53:49.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.325+0000 7f2c8f834640 1 -- 172.21.15.5:0/2272202979 shutdown_connections 2023-07-14T12:53:49.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.325+0000 7f2c8f834640 1 --2- 172.21.15.5:0/2272202979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c8815fd60 0x7f2c880c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:49.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.325+0000 7f2c8f834640 1 --2- 172.21.15.5:0/2272202979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c880d1850 0x7f2c880c6840 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:49.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.325+0000 7f2c8f834640 1 --2- 172.21.15.5:0/2272202979 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f2c6c0662b0 0x7f2c6c068760 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:49.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.325+0000 7f2c8f834640 1 --2- 172.21.15.5:0/2272202979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c880b7c70 0x7f2c8814c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:49.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.325+0000 7f2c8f834640 1 -- 172.21.15.5:0/2272202979 >> 172.21.15.5:0/2272202979 conn(0x7f2c880650b0 msgr2=0x7f2c880cfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:49.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.325+0000 7f2c8f834640 1 -- 172.21.15.5:0/2272202979 shutdown_connections 2023-07-14T12:53:49.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:49.325+0000 7f2c8f834640 1 -- 172.21.15.5:0/2272202979 wait complete. 2023-07-14T12:53:49.372 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2023-07-14T12:53:47.648589+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236160,"kb_used_data":4160,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754738560,"statfs":{"total":773094113280,"available":772852285440,"internally_reserved":0,"allocated":4259840,"data_stored":2418530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001233"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.645328+0000","last_change":"2023-07-14T12:53:42.645328+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.645328+0000","last_undegraded":"2023-07-14T12:53:42.645328+0000","last_fullsized":"2023-07-14T12:53:42.645328+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.643328+0000","last_change":"2023-07-14T12:53:42.643328+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.643328+0000","last_undegraded":"2023-07-14T12:53:42.643328+0000","last_fullsized":"2023-07-14T12:53:42.643328+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.647318+0000","last_change":"2023-07-14T12:53:42.647318+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647318+0000","last_undegraded":"2023-07-14T12:53:42.647318+0000","last_fullsized":"2023-07-14T12:53:42.647318+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.653927+0000","last_change":"2023-07-14T12:53:42.653927+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.653927+0000","last_undegraded":"2023-07-14T12:53:42.653927+0000","last_fullsized":"2023-07-14T12:53:42.653927+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.648793+0000","last_change":"2023-07-14T12:53:42.648793+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.648793+0000","last_undegraded":"2023-07-14T12:53:42.648793+0000","last_fullsized":"2023-07-14T12:53:42.648793+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641297+0000","last_change":"2023-07-14T12:53:42.641297+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641297+0000","last_undegraded":"2023-07-14T12:53:42.641297+0000","last_fullsized":"2023-07-14T12:53:42.641297+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.647261+0000","last_change":"2023-07-14T12:53:42.647261+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647261+0000","last_undegraded":"2023-07-14T12:53:42.647261+0000","last_fullsized":"2023-07-14T12:53:42.647261+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641654+0000","last_change":"2023-07-14T12:53:42.641654+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641654+0000","last_undegraded":"2023-07-14T12:53:42.641654+0000","last_fullsized":"2023-07-14T12:53:42.641654+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646767+0000","last_change":"2023-07-14T12:53:42.646767+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646767+0000","last_undegraded":"2023-07-14T12:53:42.646767+0000","last_fullsized":"2023-07-14T12:53:42.646767+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.644432+0000","last_change":"2023-07-14T12:53:42.644432+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.644432+0000","last_undegraded":"2023-07-14T12:53:42.644432+0000","last_fullsized":"2023-07-14T12:53:42.644432+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.645761+0000","last_change":"2023-07-14T12:53:42.645761+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.645761+0000","last_undegraded":"2023-07-14T12:53:42.645761+0000","last_fullsized":"2023-07-14T12:53:42.645761+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646179+0000","last_change":"2023-07-14T12:53:42.646179+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646179+0000","last_undegraded":"2023-07-14T12:53:42.646179+0000","last_fullsized":"2023-07-14T12:53:42.646179+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.645077+0000","last_change":"2023-07-14T12:53:42.645077+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.645077+0000","last_undegraded":"2023-07-14T12:53:42.645077+0000","last_fullsized":"2023-07-14T12:53:42.645077+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.652178+0000","last_change":"2023-07-14T12:53:42.652178+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.652178+0000","last_undegraded":"2023-07-14T12:53:42.652178+0000","last_fullsized":"2023-07-14T12:53:42.652178+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646675+0000","last_change":"2023-07-14T12:53:42.646675+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646675+0000","last_undegraded":"2023-07-14T12:53:42.646675+0000","last_fullsized":"2023-07-14T12:53:42.646675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646909+0000","last_change":"2023-07-14T12:53:42.646909+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646909+0000","last_undegraded":"2023-07-14T12:53:42.646909+0000","last_fullsized":"2023-07-14T12:53:42.646909+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.649953+0000","last_change":"2023-07-14T12:53:42.649953+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.649953+0000","last_undegraded":"2023-07-14T12:53:42.649953+0000","last_fullsized":"2023-07-14T12:53:42.649953+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.655629+0000","last_change":"2023-07-14T12:53:42.655629+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.655629+0000","last_undegraded":"2023-07-14T12:53:42.655629+0000","last_fullsized":"2023-07-14T12:53:42.655629+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.649331+0000","last_change":"2023-07-14T12:53:42.649331+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.649331+0000","last_undegraded":"2023-07-14T12:53:42.649331+0000","last_fullsized":"2023-07-14T12:53:42.649331+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.653939+0000","last_change":"2023-07-14T12:53:42.653939+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.653939+0000","last_undegraded":"2023-07-14T12:53:42.653939+0000","last_fullsized":"2023-07-14T12:53:42.653939+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.645901+0000","last_change":"2023-07-14T12:53:42.645901+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.645901+0000","last_undegraded":"2023-07-14T12:53:42.645901+0000","last_fullsized":"2023-07-14T12:53:42.645901+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.650211+0000","last_change":"2023-07-14T12:53:42.650211+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.650211+0000","last_undegraded":"2023-07-14T12:53:42.650211+0000","last_fullsized":"2023-07-14T12:53:42.650211+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646973+0000","last_change":"2023-07-14T12:53:42.646973+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646973+0000","last_undegraded":"2023-07-14T12:53:42.646973+0000","last_fullsized":"2023-07-14T12:53:42.646973+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.647811+0000","last_change":"2023-07-14T12:53:42.647811+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647811+0000","last_undegraded":"2023-07-14T12:53:42.647811+0000","last_fullsized":"2023-07-14T12:53:42.647811+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.655683+0000","last_change":"2023-07-14T12:53:42.655683+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.655683+0000","last_undegraded":"2023-07-14T12:53:42.655683+0000","last_fullsized":"2023-07-14T12:53:42.655683+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641334+0000","last_change":"2023-07-14T12:53:42.641334+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641334+0000","last_undegraded":"2023-07-14T12:53:42.641334+0000","last_fullsized":"2023-07-14T12:53:42.641334+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.653521+0000","last_change":"2023-07-14T12:53:42.653521+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.653521+0000","last_undegraded":"2023-07-14T12:53:42.653521+0000","last_fullsized":"2023-07-14T12:53:42.653521+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.643829+0000","last_change":"2023-07-14T12:53:42.643829+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.643829+0000","last_undegraded":"2023-07-14T12:53:42.643829+0000","last_fullsized":"2023-07-14T12:53:42.643829+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.656441+0000","last_change":"2023-07-14T12:53:42.656441+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.656441+0000","last_undegraded":"2023-07-14T12:53:42.656441+0000","last_fullsized":"2023-07-14T12:53:42.656441+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.654938+0000","last_change":"2023-07-14T12:53:42.654938+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.654938+0000","last_undegraded":"2023-07-14T12:53:42.654938+0000","last_fullsized":"2023-07-14T12:53:42.654938+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646446+0000","last_change":"2023-07-14T12:53:42.646446+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646446+0000","last_undegraded":"2023-07-14T12:53:42.646446+0000","last_fullsized":"2023-07-14T12:53:42.646446+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641645+0000","last_change":"2023-07-14T12:53:42.641645+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641645+0000","last_undegraded":"2023-07-14T12:53:42.641645+0000","last_fullsized":"2023-07-14T12:53:42.641645+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.648006+0000","last_change":"2023-07-14T12:53:42.648006+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.648006+0000","last_undegraded":"2023-07-14T12:53:42.648006+0000","last_fullsized":"2023-07-14T12:53:42.648006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":6,"reported_epoch":35,"state":"active","last_fresh":"2023-07-14T12:53:42.667572+0000","last_change":"2023-07-14T12:53:42.667507+0000","last_active":"2023-07-14T12:53:42.667572+0000","last_peered":"2023-07-14T12:53:42.667572+0000","last_clean":"2023-07-14T12:53:41.617889+0000","last_became_active":"2023-07-14T12:53:42.667507+0000","last_became_peered":"2023-07-14T12:53:42.667507+0000","last_unstale":"2023-07-14T12:53:42.667572+0000","last_undegraded":"2023-07-14T12:53:42.667572+0000","last_fullsized":"2023-07-14T12:53:42.667572+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:11:49.413274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641265+0000","last_change":"2023-07-14T12:53:42.641265+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641265+0000","last_undegraded":"2023-07-14T12:53:42.641265+0000","last_fullsized":"2023-07-14T12:53:42.641265+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.657800+0000","last_change":"2023-07-14T12:53:42.655513+0000","last_active":"2023-07-14T12:53:42.657800+0000","last_peered":"2023-07-14T12:53:42.657800+0000","last_clean":"2023-07-14T12:53:42.657800+0000","last_became_active":"2023-07-14T12:53:42.655190+0000","last_became_peered":"2023-07-14T12:53:42.655190+0000","last_unstale":"2023-07-14T12:53:42.657800+0000","last_undegraded":"2023-07-14T12:53:42.657800+0000","last_fullsized":"2023-07-14T12:53:42.657800+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:54:58.557794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.652195+0000","last_change":"2023-07-14T12:53:42.652195+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.652195+0000","last_undegraded":"2023-07-14T12:53:42.652195+0000","last_fullsized":"2023-07-14T12:53:42.652195+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.656321+0000","last_change":"2023-07-14T12:53:42.653922+0000","last_active":"2023-07-14T12:53:42.656321+0000","last_peered":"2023-07-14T12:53:42.656321+0000","last_clean":"2023-07-14T12:53:42.656321+0000","last_became_active":"2023-07-14T12:53:42.653620+0000","last_became_peered":"2023-07-14T12:53:42.653620+0000","last_unstale":"2023-07-14T12:53:42.656321+0000","last_undegraded":"2023-07-14T12:53:42.656321+0000","last_fullsized":"2023-07-14T12:53:42.656321+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:24:16.458619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.644784+0000","last_change":"2023-07-14T12:53:42.644784+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.644784+0000","last_undegraded":"2023-07-14T12:53:42.644784+0000","last_fullsized":"2023-07-14T12:53:42.644784+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.662383+0000","last_change":"2023-07-14T12:53:42.662383+0000","last_active":"2023-07-14T12:53:42.662383+0000","last_peered":"2023-07-14T12:53:42.662383+0000","last_clean":"2023-07-14T12:53:42.662383+0000","last_became_active":"2023-07-14T12:53:42.661905+0000","last_became_peered":"2023-07-14T12:53:42.661905+0000","last_unstale":"2023-07-14T12:53:42.662383+0000","last_undegraded":"2023-07-14T12:53:42.662383+0000","last_fullsized":"2023-07-14T12:53:42.662383+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:51:46.389062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.647247+0000","last_change":"2023-07-14T12:53:42.647247+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647247+0000","last_undegraded":"2023-07-14T12:53:42.647247+0000","last_fullsized":"2023-07-14T12:53:42.647247+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.665624+0000","last_change":"2023-07-14T12:53:42.657326+0000","last_active":"2023-07-14T12:53:42.665624+0000","last_peered":"2023-07-14T12:53:42.665624+0000","last_clean":"2023-07-14T12:53:42.665624+0000","last_became_active":"2023-07-14T12:53:42.657059+0000","last_became_peered":"2023-07-14T12:53:42.657059+0000","last_unstale":"2023-07-14T12:53:42.665624+0000","last_undegraded":"2023-07-14T12:53:42.665624+0000","last_fullsized":"2023-07-14T12:53:42.665624+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:10:00.345386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646250+0000","last_change":"2023-07-14T12:53:42.646250+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646250+0000","last_undegraded":"2023-07-14T12:53:42.646250+0000","last_fullsized":"2023-07-14T12:53:42.646250+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2023-07-14T12:53:42.647277+0000","last_change":"2023-07-14T12:53:42.647277+0000","last_active":"2023-07-14T12:53:41.617889+0000","last_peered":"2023-07-14T12:53:41.617889+0000","last_clean":"2023-07-14T12:53:41.617889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647277+0000","last_undegraded":"2023-07-14T12:53:42.647277+0000","last_fullsized":"2023-07-14T12:53:42.647277+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:00:36.016042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":["7","4"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.651300+0000","last_change":"2023-07-14T12:53:42.651300+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.651300+0000","last_undegraded":"2023-07-14T12:53:42.651300+0000","last_fullsized":"2023-07-14T12:53:42.651300+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660743+0000","last_change":"2023-07-14T12:53:42.658632+0000","last_active":"2023-07-14T12:53:42.660743+0000","last_peered":"2023-07-14T12:53:42.660743+0000","last_clean":"2023-07-14T12:53:42.660743+0000","last_became_active":"2023-07-14T12:53:42.658028+0000","last_became_peered":"2023-07-14T12:53:42.658028+0000","last_unstale":"2023-07-14T12:53:42.660743+0000","last_undegraded":"2023-07-14T12:53:42.660743+0000","last_fullsized":"2023-07-14T12:53:42.660743+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:51:24.463331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.643163+0000","last_change":"2023-07-14T12:53:42.643163+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.643163+0000","last_undegraded":"2023-07-14T12:53:42.643163+0000","last_fullsized":"2023-07-14T12:53:42.643163+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.662716+0000","last_change":"2023-07-14T12:53:42.662716+0000","last_active":"2023-07-14T12:53:42.662716+0000","last_peered":"2023-07-14T12:53:42.662716+0000","last_clean":"2023-07-14T12:53:42.662716+0000","last_became_active":"2023-07-14T12:53:42.662457+0000","last_became_peered":"2023-07-14T12:53:42.662457+0000","last_unstale":"2023-07-14T12:53:42.662716+0000","last_undegraded":"2023-07-14T12:53:42.662716+0000","last_fullsized":"2023-07-14T12:53:42.662716+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:41:10.324376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.647161+0000","last_change":"2023-07-14T12:53:42.647161+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647161+0000","last_undegraded":"2023-07-14T12:53:42.647161+0000","last_fullsized":"2023-07-14T12:53:42.647161+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660203+0000","last_change":"2023-07-14T12:53:42.652006+0000","last_active":"2023-07-14T12:53:42.660203+0000","last_peered":"2023-07-14T12:53:42.660203+0000","last_clean":"2023-07-14T12:53:42.660203+0000","last_became_active":"2023-07-14T12:53:42.651707+0000","last_became_peered":"2023-07-14T12:53:42.651707+0000","last_unstale":"2023-07-14T12:53:42.660203+0000","last_undegraded":"2023-07-14T12:53:42.660203+0000","last_fullsized":"2023-07-14T12:53:42.660203+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:42:51.155287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.648691+0000","last_change":"2023-07-14T12:53:42.648691+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.648691+0000","last_undegraded":"2023-07-14T12:53:42.648691+0000","last_fullsized":"2023-07-14T12:53:42.648691+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.665705+0000","last_change":"2023-07-14T12:53:42.658082+0000","last_active":"2023-07-14T12:53:42.665705+0000","last_peered":"2023-07-14T12:53:42.665705+0000","last_clean":"2023-07-14T12:53:42.665705+0000","last_became_active":"2023-07-14T12:53:42.657825+0000","last_became_peered":"2023-07-14T12:53:42.657825+0000","last_unstale":"2023-07-14T12:53:42.665705+0000","last_undegraded":"2023-07-14T12:53:42.665705+0000","last_fullsized":"2023-07-14T12:53:42.665705+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:05:35.674248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.642551+0000","last_change":"2023-07-14T12:53:42.642551+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642551+0000","last_undegraded":"2023-07-14T12:53:42.642551+0000","last_fullsized":"2023-07-14T12:53:42.642551+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.665659+0000","last_change":"2023-07-14T12:53:42.657223+0000","last_active":"2023-07-14T12:53:42.665659+0000","last_peered":"2023-07-14T12:53:42.665659+0000","last_clean":"2023-07-14T12:53:42.665659+0000","last_became_active":"2023-07-14T12:53:42.656948+0000","last_became_peered":"2023-07-14T12:53:42.656948+0000","last_unstale":"2023-07-14T12:53:42.665659+0000","last_undegraded":"2023-07-14T12:53:42.665659+0000","last_fullsized":"2023-07-14T12:53:42.665659+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:49:01.863497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.651585+0000","last_change":"2023-07-14T12:53:42.651585+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.651585+0000","last_undegraded":"2023-07-14T12:53:42.651585+0000","last_fullsized":"2023-07-14T12:53:42.651585+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.661334+0000","last_change":"2023-07-14T12:53:42.661334+0000","last_active":"2023-07-14T12:53:42.661334+0000","last_peered":"2023-07-14T12:53:42.661334+0000","last_clean":"2023-07-14T12:53:42.661334+0000","last_became_active":"2023-07-14T12:53:42.661016+0000","last_became_peered":"2023-07-14T12:53:42.661016+0000","last_unstale":"2023-07-14T12:53:42.661334+0000","last_undegraded":"2023-07-14T12:53:42.661334+0000","last_fullsized":"2023-07-14T12:53:42.661334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:37:03.360811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.644304+0000","last_change":"2023-07-14T12:53:42.644304+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.644304+0000","last_undegraded":"2023-07-14T12:53:42.644304+0000","last_fullsized":"2023-07-14T12:53:42.644304+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660875+0000","last_change":"2023-07-14T12:53:42.656742+0000","last_active":"2023-07-14T12:53:42.660875+0000","last_peered":"2023-07-14T12:53:42.660875+0000","last_clean":"2023-07-14T12:53:42.660875+0000","last_became_active":"2023-07-14T12:53:42.656469+0000","last_became_peered":"2023-07-14T12:53:42.656469+0000","last_unstale":"2023-07-14T12:53:42.660875+0000","last_undegraded":"2023-07-14T12:53:42.660875+0000","last_fullsized":"2023-07-14T12:53:42.660875+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:54:25.442469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641323+0000","last_change":"2023-07-14T12:53:42.641323+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641323+0000","last_undegraded":"2023-07-14T12:53:42.641323+0000","last_fullsized":"2023-07-14T12:53:42.641323+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660733+0000","last_change":"2023-07-14T12:53:42.658001+0000","last_active":"2023-07-14T12:53:42.660733+0000","last_peered":"2023-07-14T12:53:42.660733+0000","last_clean":"2023-07-14T12:53:42.660733+0000","last_became_active":"2023-07-14T12:53:42.657716+0000","last_became_peered":"2023-07-14T12:53:42.657716+0000","last_unstale":"2023-07-14T12:53:42.660733+0000","last_undegraded":"2023-07-14T12:53:42.660733+0000","last_fullsized":"2023-07-14T12:53:42.660733+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:32:41.548062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646506+0000","last_change":"2023-07-14T12:53:42.646506+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646506+0000","last_undegraded":"2023-07-14T12:53:42.646506+0000","last_fullsized":"2023-07-14T12:53:42.646506+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.663319+0000","last_change":"2023-07-14T12:53:42.660268+0000","last_active":"2023-07-14T12:53:42.663319+0000","last_peered":"2023-07-14T12:53:42.663319+0000","last_clean":"2023-07-14T12:53:42.663319+0000","last_became_active":"2023-07-14T12:53:42.659539+0000","last_became_peered":"2023-07-14T12:53:42.659539+0000","last_unstale":"2023-07-14T12:53:42.663319+0000","last_undegraded":"2023-07-14T12:53:42.663319+0000","last_fullsized":"2023-07-14T12:53:42.663319+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:06:22.699849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.642688+0000","last_change":"2023-07-14T12:53:42.642688+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642688+0000","last_undegraded":"2023-07-14T12:53:42.642688+0000","last_fullsized":"2023-07-14T12:53:42.642688+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.658419+0000","last_change":"2023-07-14T12:53:42.658419+0000","last_active":"2023-07-14T12:53:42.658419+0000","last_peered":"2023-07-14T12:53:42.658419+0000","last_clean":"2023-07-14T12:53:42.658419+0000","last_became_active":"2023-07-14T12:53:42.658144+0000","last_became_peered":"2023-07-14T12:53:42.658144+0000","last_unstale":"2023-07-14T12:53:42.658419+0000","last_undegraded":"2023-07-14T12:53:42.658419+0000","last_fullsized":"2023-07-14T12:53:42.658419+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:25:03.006737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.642357+0000","last_change":"2023-07-14T12:53:42.642357+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642357+0000","last_undegraded":"2023-07-14T12:53:42.642357+0000","last_fullsized":"2023-07-14T12:53:42.642357+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.665798+0000","last_change":"2023-07-14T12:53:42.658432+0000","last_active":"2023-07-14T12:53:42.665798+0000","last_peered":"2023-07-14T12:53:42.665798+0000","last_clean":"2023-07-14T12:53:42.665798+0000","last_became_active":"2023-07-14T12:53:42.658113+0000","last_became_peered":"2023-07-14T12:53:42.658113+0000","last_unstale":"2023-07-14T12:53:42.665798+0000","last_undegraded":"2023-07-14T12:53:42.665798+0000","last_fullsized":"2023-07-14T12:53:42.665798+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:34:28.613892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.645275+0000","last_change":"2023-07-14T12:53:42.645275+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.645275+0000","last_undegraded":"2023-07-14T12:53:42.645275+0000","last_fullsized":"2023-07-14T12:53:42.645275+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2023-07-14T12:53:42.650520+0000","last_change":"2023-07-14T12:53:42.650520+0000","last_active":"2023-07-14T12:53:41.617889+0000","last_peered":"2023-07-14T12:53:41.617889+0000","last_clean":"2023-07-14T12:53:41.617889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.650520+0000","last_undegraded":"2023-07-14T12:53:42.650520+0000","last_fullsized":"2023-07-14T12:53:42.650520+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:11:50.985338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.652789+0000","last_change":"2023-07-14T12:53:42.652789+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.652789+0000","last_undegraded":"2023-07-14T12:53:42.652789+0000","last_fullsized":"2023-07-14T12:53:42.652789+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.659898+0000","last_change":"2023-07-14T12:53:42.655980+0000","last_active":"2023-07-14T12:53:42.659898+0000","last_peered":"2023-07-14T12:53:42.659898+0000","last_clean":"2023-07-14T12:53:42.659898+0000","last_became_active":"2023-07-14T12:53:42.655637+0000","last_became_peered":"2023-07-14T12:53:42.655637+0000","last_unstale":"2023-07-14T12:53:42.659898+0000","last_undegraded":"2023-07-14T12:53:42.659898+0000","last_fullsized":"2023-07-14T12:53:42.659898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:47:09.919080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.643100+0000","last_change":"2023-07-14T12:53:42.643100+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.643100+0000","last_undegraded":"2023-07-14T12:53:42.643100+0000","last_fullsized":"2023-07-14T12:53:42.643100+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.656343+0000","last_change":"2023-07-14T12:53:42.653617+0000","last_active":"2023-07-14T12:53:42.656343+0000","last_peered":"2023-07-14T12:53:42.656343+0000","last_clean":"2023-07-14T12:53:42.656343+0000","last_became_active":"2023-07-14T12:53:42.653328+0000","last_became_peered":"2023-07-14T12:53:42.653328+0000","last_unstale":"2023-07-14T12:53:42.656343+0000","last_undegraded":"2023-07-14T12:53:42.656343+0000","last_fullsized":"2023-07-14T12:53:42.656343+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:05:35.674248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.646351+0000","last_change":"2023-07-14T12:53:42.646351+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.646351+0000","last_undegraded":"2023-07-14T12:53:42.646351+0000","last_fullsized":"2023-07-14T12:53:42.646351+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.659875+0000","last_change":"2023-07-14T12:53:42.657937+0000","last_active":"2023-07-14T12:53:42.659875+0000","last_peered":"2023-07-14T12:53:42.659875+0000","last_clean":"2023-07-14T12:53:42.659875+0000","last_became_active":"2023-07-14T12:53:42.657616+0000","last_became_peered":"2023-07-14T12:53:42.657616+0000","last_unstale":"2023-07-14T12:53:42.659875+0000","last_undegraded":"2023-07-14T12:53:42.659875+0000","last_fullsized":"2023-07-14T12:53:42.659875+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:18:16.836950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641768+0000","last_change":"2023-07-14T12:53:42.641768+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641768+0000","last_undegraded":"2023-07-14T12:53:42.641768+0000","last_fullsized":"2023-07-14T12:53:42.641768+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2023-07-14T12:53:42.644109+0000","last_change":"2023-07-14T12:53:42.644109+0000","last_active":"2023-07-14T12:53:41.617889+0000","last_peered":"2023-07-14T12:53:41.617889+0000","last_clean":"2023-07-14T12:53:41.617889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.644109+0000","last_undegraded":"2023-07-14T12:53:42.644109+0000","last_fullsized":"2023-07-14T12:53:42.644109+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:03:35.822921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.644543+0000","last_change":"2023-07-14T12:53:42.644543+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.644543+0000","last_undegraded":"2023-07-14T12:53:42.644543+0000","last_fullsized":"2023-07-14T12:53:42.644543+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.662449+0000","last_change":"2023-07-14T12:53:42.662449+0000","last_active":"2023-07-14T12:53:42.662449+0000","last_peered":"2023-07-14T12:53:42.662449+0000","last_clean":"2023-07-14T12:53:42.662449+0000","last_became_active":"2023-07-14T12:53:42.662185+0000","last_became_peered":"2023-07-14T12:53:42.662185+0000","last_unstale":"2023-07-14T12:53:42.662449+0000","last_undegraded":"2023-07-14T12:53:42.662449+0000","last_fullsized":"2023-07-14T12:53:42.662449+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:57:04.405858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.642204+0000","last_change":"2023-07-14T12:53:42.642204+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642204+0000","last_undegraded":"2023-07-14T12:53:42.642204+0000","last_fullsized":"2023-07-14T12:53:42.642204+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660146+0000","last_change":"2023-07-14T12:53:42.658170+0000","last_active":"2023-07-14T12:53:42.660146+0000","last_peered":"2023-07-14T12:53:42.660146+0000","last_clean":"2023-07-14T12:53:42.660146+0000","last_became_active":"2023-07-14T12:53:42.657884+0000","last_became_peered":"2023-07-14T12:53:42.657884+0000","last_unstale":"2023-07-14T12:53:42.660146+0000","last_undegraded":"2023-07-14T12:53:42.660146+0000","last_fullsized":"2023-07-14T12:53:42.660146+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:21:16.785019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.644851+0000","last_change":"2023-07-14T12:53:42.644851+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.644851+0000","last_undegraded":"2023-07-14T12:53:42.644851+0000","last_fullsized":"2023-07-14T12:53:42.644851+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660164+0000","last_change":"2023-07-14T12:53:42.660164+0000","last_active":"2023-07-14T12:53:42.660164+0000","last_peered":"2023-07-14T12:53:42.660164+0000","last_clean":"2023-07-14T12:53:42.660164+0000","last_became_active":"2023-07-14T12:53:42.659871+0000","last_became_peered":"2023-07-14T12:53:42.659871+0000","last_unstale":"2023-07-14T12:53:42.660164+0000","last_undegraded":"2023-07-14T12:53:42.660164+0000","last_fullsized":"2023-07-14T12:53:42.660164+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:07:40.835216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.648387+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T12:53:42.648387+0000","last_peered":"2023-07-14T12:53:42.648387+0000","last_clean":"2023-07-14T12:53:42.648387+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T12:53:42.648387+0000","last_undegraded":"2023-07-14T12:53:42.648387+0000","last_fullsized":"2023-07-14T12:53:42.648387+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:57:27.397166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.649724+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T12:53:42.649724+0000","last_peered":"2023-07-14T12:53:42.649724+0000","last_clean":"2023-07-14T12:53:42.649724+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T12:53:42.649724+0000","last_undegraded":"2023-07-14T12:53:42.649724+0000","last_fullsized":"2023-07-14T12:53:42.649724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:59:34.411686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.642930+0000","last_change":"2023-07-14T12:53:42.642930+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642930+0000","last_undegraded":"2023-07-14T12:53:42.642930+0000","last_fullsized":"2023-07-14T12:53:42.642930+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.665588+0000","last_change":"2023-07-14T12:53:42.656339+0000","last_active":"2023-07-14T12:53:42.665588+0000","last_peered":"2023-07-14T12:53:42.665588+0000","last_clean":"2023-07-14T12:53:42.665588+0000","last_became_active":"2023-07-14T12:53:42.656049+0000","last_became_peered":"2023-07-14T12:53:42.656049+0000","last_unstale":"2023-07-14T12:53:42.665588+0000","last_undegraded":"2023-07-14T12:53:42.665588+0000","last_fullsized":"2023-07-14T12:53:42.665588+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:59:26.261812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.648243+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T12:53:42.648243+0000","last_peered":"2023-07-14T12:53:42.648243+0000","last_clean":"2023-07-14T12:53:42.648243+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T12:53:42.648243+0000","last_undegraded":"2023-07-14T12:53:42.648243+0000","last_fullsized":"2023-07-14T12:53:42.648243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:08:04.171298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.648143+0000","last_change":"2023-07-14T12:53:42.648143+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.648143+0000","last_undegraded":"2023-07-14T12:53:42.648143+0000","last_fullsized":"2023-07-14T12:53:42.648143+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2023-07-14T12:53:42.642176+0000","last_change":"2023-07-14T12:53:42.642176+0000","last_active":"2023-07-14T12:53:41.617889+0000","last_peered":"2023-07-14T12:53:41.617889+0000","last_clean":"2023-07-14T12:53:41.617889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642176+0000","last_undegraded":"2023-07-14T12:53:42.642176+0000","last_fullsized":"2023-07-14T12:53:42.642176+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:36:03.975351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.641868+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T12:53:42.641868+0000","last_peered":"2023-07-14T12:53:42.641868+0000","last_clean":"2023-07-14T12:53:42.641868+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T12:53:42.641868+0000","last_undegraded":"2023-07-14T12:53:42.641868+0000","last_fullsized":"2023-07-14T12:53:42.641868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:57:08.591309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.642814+0000","last_change":"2023-07-14T12:53:42.642814+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642814+0000","last_undegraded":"2023-07-14T12:53:42.642814+0000","last_fullsized":"2023-07-14T12:53:42.642814+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.659051+0000","last_change":"2023-07-14T12:53:42.656054+0000","last_active":"2023-07-14T12:53:42.659051+0000","last_peered":"2023-07-14T12:53:42.659051+0000","last_clean":"2023-07-14T12:53:42.659051+0000","last_became_active":"2023-07-14T12:53:42.655428+0000","last_became_peered":"2023-07-14T12:53:42.655428+0000","last_unstale":"2023-07-14T12:53:42.659051+0000","last_undegraded":"2023-07-14T12:53:42.659051+0000","last_fullsized":"2023-07-14T12:53:42.659051+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:05:06.666472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.650043+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T12:53:42.650043+0000","last_peered":"2023-07-14T12:53:42.650043+0000","last_clean":"2023-07-14T12:53:42.650043+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T12:53:42.650043+0000","last_undegraded":"2023-07-14T12:53:42.650043+0000","last_fullsized":"2023-07-14T12:53:42.650043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:56:02.801501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.641542+0000","last_change":"2023-07-14T12:53:42.641542+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.641542+0000","last_undegraded":"2023-07-14T12:53:42.641542+0000","last_fullsized":"2023-07-14T12:53:42.641542+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2023-07-14T12:53:42.642286+0000","last_change":"2023-07-14T12:53:42.642286+0000","last_active":"2023-07-14T12:53:41.617889+0000","last_peered":"2023-07-14T12:53:41.617889+0000","last_clean":"2023-07-14T12:53:41.617889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.642286+0000","last_undegraded":"2023-07-14T12:53:42.642286+0000","last_fullsized":"2023-07-14T12:53:42.642286+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:45:42.882459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.637991+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T12:53:42.637991+0000","last_peered":"2023-07-14T12:53:42.637991+0000","last_clean":"2023-07-14T12:53:42.637991+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T12:53:42.637991+0000","last_undegraded":"2023-07-14T12:53:42.637991+0000","last_fullsized":"2023-07-14T12:53:42.637991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:42:21.174513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.643440+0000","last_change":"2023-07-14T12:53:42.643440+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.643440+0000","last_undegraded":"2023-07-14T12:53:42.643440+0000","last_fullsized":"2023-07-14T12:53:42.643440+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.665626+0000","last_change":"2023-07-14T12:53:42.663256+0000","last_active":"2023-07-14T12:53:42.665626+0000","last_peered":"2023-07-14T12:53:42.665626+0000","last_clean":"2023-07-14T12:53:42.665626+0000","last_became_active":"2023-07-14T12:53:42.662980+0000","last_became_peered":"2023-07-14T12:53:42.662980+0000","last_unstale":"2023-07-14T12:53:42.665626+0000","last_undegraded":"2023-07-14T12:53:42.665626+0000","last_fullsized":"2023-07-14T12:53:42.665626+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:50:23.974743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.650868+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T12:53:42.650868+0000","last_peered":"2023-07-14T12:53:42.650868+0000","last_clean":"2023-07-14T12:53:42.650868+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T12:53:42.650868+0000","last_undegraded":"2023-07-14T12:53:42.650868+0000","last_fullsized":"2023-07-14T12:53:42.650868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:41:09.149951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.651720+0000","last_change":"2023-07-14T12:53:42.651720+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.651720+0000","last_undegraded":"2023-07-14T12:53:42.651720+0000","last_fullsized":"2023-07-14T12:53:42.651720+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.662266+0000","last_change":"2023-07-14T12:53:42.662266+0000","last_active":"2023-07-14T12:53:42.662266+0000","last_peered":"2023-07-14T12:53:42.662266+0000","last_clean":"2023-07-14T12:53:42.662266+0000","last_became_active":"2023-07-14T12:53:42.661972+0000","last_became_peered":"2023-07-14T12:53:42.661972+0000","last_unstale":"2023-07-14T12:53:42.662266+0000","last_undegraded":"2023-07-14T12:53:42.662266+0000","last_fullsized":"2023-07-14T12:53:42.662266+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:05:09.874552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.637878+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T12:53:42.637878+0000","last_peered":"2023-07-14T12:53:42.637878+0000","last_clean":"2023-07-14T12:53:42.637878+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T12:53:42.637878+0000","last_undegraded":"2023-07-14T12:53:42.637878+0000","last_fullsized":"2023-07-14T12:53:42.637878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:50:30.387747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-14T12:53:42.647952+0000","last_change":"2023-07-14T12:53:42.647952+0000","last_active":"2023-07-14T12:53:42.626197+0000","last_peered":"2023-07-14T12:53:42.626197+0000","last_clean":"2023-07-14T12:53:42.626197+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T12:53:42.647952+0000","last_undegraded":"2023-07-14T12:53:42.647952+0000","last_fullsized":"2023-07-14T12:53:42.647952+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.660149+0000","last_change":"2023-07-14T12:53:42.651999+0000","last_active":"2023-07-14T12:53:42.660149+0000","last_peered":"2023-07-14T12:53:42.660149+0000","last_clean":"2023-07-14T12:53:42.660149+0000","last_became_active":"2023-07-14T12:53:42.651673+0000","last_became_peered":"2023-07-14T12:53:42.651673+0000","last_unstale":"2023-07-14T12:53:42.660149+0000","last_undegraded":"2023-07-14T12:53:42.660149+0000","last_fullsized":"2023-07-14T12:53:42.660149+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:46:08.798453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-14T12:53:42.657386+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T12:53:42.657386+0000","last_peered":"2023-07-14T12:53:42.657386+0000","last_clean":"2023-07-14T12:53:42.657386+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T12:53:42.657386+0000","last_undegraded":"2023-07-14T12:53:42.657386+0000","last_fullsized":"2023-07-14T12:53:42.657386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:07:17.227547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":978944,"data_stored":745347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.68799999999999994}]},{"osd":1,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.621},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.60599999999999998}]},{"osd":2,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.70299999999999996}]},{"osd":3,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.67400000000000004}]},{"osd":4,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.47999999999999998}]},{"osd":5,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.45100000000000001}]},{"osd":6,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.59099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":385024,"data_stored":154979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.66200000000000003}]},{"osd":1,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.751},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.70999999999999996}]},{"osd":2,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.51100000000000001}]},{"osd":3,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.56399999999999995}]},{"osd":4,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.626},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.72699999999999998}]},{"osd":7,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.76900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":385024,"data_stored":154979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.77200000000000002}]},{"osd":1,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.70399999999999996}]},{"osd":2,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.80400000000000005}]},{"osd":3,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.71799999999999997}]},{"osd":4,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.746},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.73499999999999999}]},{"osd":6,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.623},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.60199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":385024,"data_stored":154979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.57199999999999995}]},{"osd":1,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.69899999999999995}]},{"osd":2,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.497},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.53800000000000003}]},{"osd":3,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.76400000000000001}]},{"osd":6,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.72899999999999998}]},{"osd":7,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.622}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":385024,"data_stored":154979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.46400000000000002}]},{"osd":1,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.60199999999999998}]},{"osd":7,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.64300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":380928,"data_stored":153960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.377},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.51100000000000001}]},{"osd":1,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.46200000000000002}]},{"osd":3,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.70899999999999996}]},{"osd":5,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.2269999999999999,"5min":2.2269999999999999,"15min":2.2269999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.76100000000000001}]},{"osd":6,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.84399999999999997}]},{"osd":7,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.72499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":385024,"data_stored":154979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.45600000000000002}]},{"osd":2,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.435}]},{"osd":3,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.38600000000000001}]},{"osd":4,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.68300000000000005}]},{"osd":5,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.60899999999999999}]},{"osd":6,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.63200000000000001}]},{"osd":7,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.66900000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":974848,"data_stored":744328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.46700000000000003}]},{"osd":2,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.434}]},{"osd":3,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.48299999999999998}]},{"osd":4,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.90600000000000003}]},{"osd":5,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.85999999999999999}]},{"osd":6,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.875}]},{"osd":7,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.77500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T12:53:52.380 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T12:53:52.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.513+0000 7f514aa7b640 1 Processor -- start 2023-07-14T12:53:52.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.513+0000 7f514aa7b640 1 -- start start 2023-07-14T12:53:52.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.513+0000 7f514aa7b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f514415f500 0x7f514406cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:52.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.513+0000 7f514aa7b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51440cdc80 con 0x7f514406d430 2023-07-14T12:53:52.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.513+0000 7f514aa7b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514406e4c0 con 0x7f514406ac50 2023-07-14T12:53:52.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.513+0000 7f514aa7b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514406d940 con 0x7f514415f500 2023-07-14T12:53:52.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.513+0000 7f5143fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f514406d430 0x7f514406a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33084/0 (socket says 172.21.15.5:33084) 2023-07-14T12:53:52.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.513+0000 7f5143fff640 1 -- 172.21.15.5:0/901623168 learned_addr learned my addr 172.21.15.5:0/901623168 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:52.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.513+0000 7f5148817640 1 --2- 172.21.15.5:0/901623168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f514415f500 0x7f514406cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:52.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.513+0000 7f51437fe640 1 -- 172.21.15.5:0/901623168 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3080217621 0 0) 0x7f51440cdc80 con 0x7f514406d430 2023-07-14T12:53:52.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.513+0000 7f51437fe640 1 -- 172.21.15.5:0/901623168 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5134003530 con 0x7f514406d430 2023-07-14T12:53:52.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.513+0000 7f51437fe640 1 -- 172.21.15.5:0/901623168 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4272159319 0 0) 0x7f5134003530 con 0x7f514406d430 2023-07-14T12:53:52.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.513+0000 7f51437fe640 1 -- 172.21.15.5:0/901623168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f514415f500 msgr2=0x7f514406cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:52.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.513+0000 7f51437fe640 1 --2- 172.21.15.5:0/901623168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f514415f500 0x7f514406cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:52.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.513+0000 7f51437fe640 1 -- 172.21.15.5:0/901623168 >> v1:172.21.15.154:6789/0 conn(0x7f514406ac50 legacy=0x7f51440ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:52.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.513+0000 7f51437fe640 1 -- 172.21.15.5:0/901623168 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514406dc20 con 0x7f514406d430 2023-07-14T12:53:52.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.513+0000 7f51437fe640 1 -- 172.21.15.5:0/901623168 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f5130001680 con 0x7f514406d430 2023-07-14T12:53:52.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.513+0000 7f51437fe640 1 -- 172.21.15.5:0/901623168 >> v1:172.21.15.5:6789/0 conn(0x7f514406d430 legacy=0x7f514406a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:52.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.513+0000 7f51437fe640 1 --2- 172.21.15.5:0/901623168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51340039b0 0x7f5134003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:52.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.513+0000 7f51437fe640 1 --2- 172.21.15.5:0/901623168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f514415f500 0x7f51340047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:52.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.513+0000 7f51437fe640 1 --2- 172.21.15.5:0/901623168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5134004d10 0x7f5134005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:52.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.513+0000 7f51437fe640 1 -- 172.21.15.5:0/901623168 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514406d940 con 0x7f5134004d10 2023-07-14T12:53:52.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.513+0000 7f51437fe640 1 -- 172.21.15.5:0/901623168 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513400b990 con 0x7f51340039b0 2023-07-14T12:53:52.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.513+0000 7f51437fe640 1 -- 172.21.15.5:0/901623168 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f513400bb00 con 0x7f514415f500 2023-07-14T12:53:52.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.513+0000 7f5149018640 1 --2- 172.21.15.5:0/901623168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5134004d10 0x7f5134005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:52.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.513+0000 7f5148817640 1 --2- 172.21.15.5:0/901623168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51340039b0 0x7f5134003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:52.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.513+0000 7f5143fff640 1 --2- 172.21.15.5:0/901623168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f514415f500 0x7f51340047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:52.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.517+0000 7f5149018640 1 -- 172.21.15.5:0/901623168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f514415f500 msgr2=0x7f51340047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:52.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.517+0000 7f5149018640 1 --2- 172.21.15.5:0/901623168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f514415f500 0x7f51340047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:52.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.517+0000 7f5149018640 1 -- 172.21.15.5:0/901623168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51340039b0 msgr2=0x7f5134003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:52.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.517+0000 7f5149018640 1 --2- 172.21.15.5:0/901623168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51340039b0 0x7f5134003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:52.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.517+0000 7f5149018640 1 -- 172.21.15.5:0/901623168 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514406dc20 con 0x7f5134004d10 2023-07-14T12:53:52.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.517+0000 7f5149018640 1 --2- 172.21.15.5:0/901623168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5134004d10 0x7f5134005180 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5144065e80 tx=0x7f513c01c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b104f7b4363378cc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:52.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.517+0000 7f51437fe640 1 -- 172.21.15.5:0/901623168 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c0a66d0 con 0x7f5134004d10 2023-07-14T12:53:52.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.517+0000 7f51437fe640 1 -- 172.21.15.5:0/901623168 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c0a6830 con 0x7f5134004d10 2023-07-14T12:53:52.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.517+0000 7f51437fe640 1 -- 172.21.15.5:0/901623168 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c0a6be0 con 0x7f5134004d10 2023-07-14T12:53:52.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.517+0000 7f514aa7b640 1 -- 172.21.15.5:0/901623168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5134004d10 msgr2=0x7f5134005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:52.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.517+0000 7f514aa7b640 1 --2- 172.21.15.5:0/901623168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5134004d10 0x7f5134005180 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5144065e80 tx=0x7f513c01c770 comp rx=0 tx=0).stop 2023-07-14T12:53:52.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.517+0000 7f5149018640 1 -- 172.21.15.5:0/901623168 reap_dead start 2023-07-14T12:53:52.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.517+0000 7f514aa7b640 1 -- 172.21.15.5:0/901623168 shutdown_connections 2023-07-14T12:53:52.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.517+0000 7f514aa7b640 1 -- 172.21.15.5:0/901623168 >> 172.21.15.5:0/901623168 conn(0x7f51440659d0 msgr2=0x7f5144099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:52.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.517+0000 7f514aa7b640 1 -- 172.21.15.5:0/901623168 shutdown_connections 2023-07-14T12:53:52.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.517+0000 7f514aa7b640 1 -- 172.21.15.5:0/901623168 wait complete. 2023-07-14T12:53:52.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.521+0000 7f514aa7b640 1 Processor -- start 2023-07-14T12:53:52.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.521+0000 7f514aa7b640 1 -- start start 2023-07-14T12:53:52.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.521+0000 7f514aa7b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5134004d10 0x7f5144156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:52.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.521+0000 7f514aa7b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51440cd1e0 0x7f514415c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:52.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.521+0000 7f514aa7b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f514415cad0 0x7f51441f4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:52.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.521+0000 7f514aa7b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51440cc0d0 con 0x7f514415cad0 2023-07-14T12:53:52.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.521+0000 7f514aa7b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514415cf40 con 0x7f51440cd1e0 2023-07-14T12:53:52.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.521+0000 7f514aa7b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51440cd610 con 0x7f5134004d10 2023-07-14T12:53:52.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.521+0000 7f5149018640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f514415cad0 0x7f51441f4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:52.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.521+0000 7f5149018640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f514415cad0 0x7f51441f4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38686/0 (socket says 172.21.15.5:38686) 2023-07-14T12:53:52.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.521+0000 7f5149018640 1 -- 172.21.15.5:0/3911672914 learned_addr learned my addr 172.21.15.5:0/3911672914 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:52.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.521+0000 7f5143fff640 1 --2- 172.21.15.5:0/3911672914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51440cd1e0 0x7f514415c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:52.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.521+0000 7f5148817640 1 --2- 172.21.15.5:0/3911672914 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5134004d10 0x7f5144156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:52.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.521+0000 7f5149018640 1 -- 172.21.15.5:0/3911672914 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5134004d10 msgr2=0x7f5144156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:52.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.521+0000 7f5149018640 1 --2- 172.21.15.5:0/3911672914 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5134004d10 0x7f5144156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:52.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.521+0000 7f5149018640 1 -- 172.21.15.5:0/3911672914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51440cd1e0 msgr2=0x7f514415c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:52.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.521+0000 7f5149018640 1 --2- 172.21.15.5:0/3911672914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51440cd1e0 0x7f514415c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:52.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.521+0000 7f5149018640 1 -- 172.21.15.5:0/3911672914 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51441f2410 con 0x7f514415cad0 2023-07-14T12:53:52.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.521+0000 7f5149018640 1 --2- 172.21.15.5:0/3911672914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f514415cad0 0x7f51441f4c00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f513c01cc50 tx=0x7f5134005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.525+0000 7f51417fa640 1 -- 172.21.15.5:0/3911672914 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c0a6ba0 con 0x7f514415cad0 2023-07-14T12:53:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.525+0000 7f51417fa640 1 -- 172.21.15.5:0/3911672914 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c0a6d00 con 0x7f514415cad0 2023-07-14T12:53:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.525+0000 7f51417fa640 1 -- 172.21.15.5:0/3911672914 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c003b80 con 0x7f514415cad0 2023-07-14T12:53:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.525+0000 7f514aa7b640 1 -- 172.21.15.5:0/3911672914 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51440cb730 con 0x7f514415cad0 2023-07-14T12:53:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.525+0000 7f514aa7b640 1 -- 172.21.15.5:0/3911672914 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51440cbcf0 con 0x7f514415cad0 2023-07-14T12:53:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.525+0000 7f514aa7b640 1 -- 172.21.15.5:0/3911672914 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51440cc210 con 0x7f514415cad0 2023-07-14T12:53:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.525+0000 7f51417fa640 1 -- 172.21.15.5:0/3911672914 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f513c003ce0 con 0x7f514415cad0 2023-07-14T12:53:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.525+0000 7f51417fa640 1 --2- 172.21.15.5:0/3911672914 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5128066280 0x7f5128068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.525+0000 7f51417fa640 1 -- 172.21.15.5:0/3911672914 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f513c0aa070 con 0x7f514415cad0 2023-07-14T12:53:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.525+0000 7f5148817640 1 --2- 172.21.15.5:0/3911672914 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5128066280 0x7f5128068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.529+0000 7f5148817640 1 --2- 172.21.15.5:0/3911672914 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5128066280 0x7f5128068730 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5138009bc0 tx=0x7f5138006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:52.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.529+0000 7f51417fa640 1 -- 172.21.15.5:0/3911672914 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f51440cc210 con 0x7f514415cad0 2023-07-14T12:53:52.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.681+0000 7f514aa7b640 1 -- 172.21.15.5:0/3911672914 --> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f514406e1e0 con 0x7f5128066280 2023-07-14T12:53:52.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.693+0000 7f51417fa640 1 -- 172.21.15.5:0/3911672914 <== mgr.4102 v2:172.21.15.154:6832/2736441655 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310901 (secure 0 0 0) 0x7f5138014c10 con 0x7f5128066280 2023-07-14T12:53:52.722 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:52.723 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T12:53:52.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.693+0000 7f514aa7b640 1 -- 172.21.15.5:0/3911672914 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5128066280 msgr2=0x7f5128068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:52.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.693+0000 7f514aa7b640 1 --2- 172.21.15.5:0/3911672914 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5128066280 0x7f5128068730 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5138009bc0 tx=0x7f5138006f90 comp rx=0 tx=0).stop 2023-07-14T12:53:52.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.693+0000 7f514aa7b640 1 -- 172.21.15.5:0/3911672914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f514415cad0 msgr2=0x7f51441f4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:52.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.693+0000 7f514aa7b640 1 --2- 172.21.15.5:0/3911672914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f514415cad0 0x7f51441f4c00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f513c01cc50 tx=0x7f5134005800 comp rx=0 tx=0).stop 2023-07-14T12:53:52.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.693+0000 7f514aa7b640 1 -- 172.21.15.5:0/3911672914 shutdown_connections 2023-07-14T12:53:52.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.693+0000 7f514aa7b640 1 --2- 172.21.15.5:0/3911672914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f514415cad0 0x7f51441f4c00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:52.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.693+0000 7f514aa7b640 1 --2- 172.21.15.5:0/3911672914 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f5128066280 0x7f5128068730 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:52.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.693+0000 7f514aa7b640 1 --2- 172.21.15.5:0/3911672914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51440cd1e0 0x7f514415c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:52.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.693+0000 7f514aa7b640 1 --2- 172.21.15.5:0/3911672914 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5134004d10 0x7f5144156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:52.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.693+0000 7f514aa7b640 1 -- 172.21.15.5:0/3911672914 >> 172.21.15.5:0/3911672914 conn(0x7f51440659d0 msgr2=0x7f51440aedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:52.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.693+0000 7f514aa7b640 1 -- 172.21.15.5:0/3911672914 shutdown_connections 2023-07-14T12:53:52.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.693+0000 7f514aa7b640 1 -- 172.21.15.5:0/3911672914 wait complete. 2023-07-14T12:53:52.742 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2023-07-14T12:53:51.649621+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236512,"kb_used_data":4512,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754738208,"statfs":{"total":773094113280,"available":772851924992,"internally_reserved":0,"allocated":4620288,"data_stored":2586526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.006938"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.066184+0000","last_change":"2023-07-14T12:53:43.669328+0000","last_active":"2023-07-14T12:53:45.066184+0000","last_peered":"2023-07-14T12:53:45.066184+0000","last_clean":"2023-07-14T12:53:45.066184+0000","last_became_active":"2023-07-14T12:53:43.668994+0000","last_became_peered":"2023-07-14T12:53:43.668994+0000","last_unstale":"2023-07-14T12:53:45.066184+0000","last_undegraded":"2023-07-14T12:53:45.066184+0000","last_fullsized":"2023-07-14T12:53:45.066184+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:52:31.221949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.065828+0000","last_change":"2023-07-14T12:53:43.658952+0000","last_active":"2023-07-14T12:53:45.065828+0000","last_peered":"2023-07-14T12:53:45.065828+0000","last_clean":"2023-07-14T12:53:45.065828+0000","last_became_active":"2023-07-14T12:53:43.658668+0000","last_became_peered":"2023-07-14T12:53:43.658668+0000","last_unstale":"2023-07-14T12:53:45.065828+0000","last_undegraded":"2023-07-14T12:53:45.065828+0000","last_fullsized":"2023-07-14T12:53:45.065828+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:08:58.783429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.066458+0000","last_change":"2023-07-14T12:53:43.680938+0000","last_active":"2023-07-14T12:53:45.066458+0000","last_peered":"2023-07-14T12:53:45.066458+0000","last_clean":"2023-07-14T12:53:45.066458+0000","last_became_active":"2023-07-14T12:53:43.680549+0000","last_became_peered":"2023-07-14T12:53:43.680549+0000","last_unstale":"2023-07-14T12:53:45.066458+0000","last_undegraded":"2023-07-14T12:53:45.066458+0000","last_fullsized":"2023-07-14T12:53:45.066458+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:10:01.353694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.662611+0000","last_change":"2023-07-14T12:53:43.674078+0000","last_active":"2023-07-14T12:53:44.662611+0000","last_peered":"2023-07-14T12:53:44.662611+0000","last_clean":"2023-07-14T12:53:44.662611+0000","last_became_active":"2023-07-14T12:53:43.673808+0000","last_became_peered":"2023-07-14T12:53:43.673808+0000","last_unstale":"2023-07-14T12:53:44.662611+0000","last_undegraded":"2023-07-14T12:53:44.662611+0000","last_fullsized":"2023-07-14T12:53:44.662611+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:26:34.621464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.662698+0000","last_change":"2023-07-14T12:53:43.660668+0000","last_active":"2023-07-14T12:53:44.662698+0000","last_peered":"2023-07-14T12:53:44.662698+0000","last_clean":"2023-07-14T12:53:44.662698+0000","last_became_active":"2023-07-14T12:53:43.660398+0000","last_became_peered":"2023-07-14T12:53:43.660398+0000","last_unstale":"2023-07-14T12:53:44.662698+0000","last_undegraded":"2023-07-14T12:53:44.662698+0000","last_fullsized":"2023-07-14T12:53:44.662698+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:20:27.339967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.058733+0000","last_change":"2023-07-14T12:53:43.662364+0000","last_active":"2023-07-14T12:53:45.058733+0000","last_peered":"2023-07-14T12:53:45.058733+0000","last_clean":"2023-07-14T12:53:45.058733+0000","last_became_active":"2023-07-14T12:53:43.662096+0000","last_became_peered":"2023-07-14T12:53:43.662096+0000","last_unstale":"2023-07-14T12:53:45.058733+0000","last_undegraded":"2023-07-14T12:53:45.058733+0000","last_fullsized":"2023-07-14T12:53:45.058733+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:05:10.882859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.785775+0000","last_change":"2023-07-14T12:53:43.681789+0000","last_active":"2023-07-14T12:53:44.785775+0000","last_peered":"2023-07-14T12:53:44.785775+0000","last_clean":"2023-07-14T12:53:44.785775+0000","last_became_active":"2023-07-14T12:53:43.679792+0000","last_became_peered":"2023-07-14T12:53:43.679792+0000","last_unstale":"2023-07-14T12:53:44.785775+0000","last_undegraded":"2023-07-14T12:53:44.785775+0000","last_fullsized":"2023-07-14T12:53:44.785775+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:39:40.528063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.065627+0000","last_change":"2023-07-14T12:53:43.681619+0000","last_active":"2023-07-14T12:53:45.065627+0000","last_peered":"2023-07-14T12:53:45.065627+0000","last_clean":"2023-07-14T12:53:45.065627+0000","last_became_active":"2023-07-14T12:53:43.681318+0000","last_became_peered":"2023-07-14T12:53:43.681318+0000","last_unstale":"2023-07-14T12:53:45.065627+0000","last_undegraded":"2023-07-14T12:53:45.065627+0000","last_fullsized":"2023-07-14T12:53:45.065627+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:58:36.257696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.066684+0000","last_change":"2023-07-14T12:53:43.680935+0000","last_active":"2023-07-14T12:53:45.066684+0000","last_peered":"2023-07-14T12:53:45.066684+0000","last_clean":"2023-07-14T12:53:45.066684+0000","last_became_active":"2023-07-14T12:53:43.680531+0000","last_became_peered":"2023-07-14T12:53:43.680531+0000","last_unstale":"2023-07-14T12:53:45.066684+0000","last_undegraded":"2023-07-14T12:53:45.066684+0000","last_fullsized":"2023-07-14T12:53:45.066684+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:06.783962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.786459+0000","last_change":"2023-07-14T12:53:43.681508+0000","last_active":"2023-07-14T12:53:44.786459+0000","last_peered":"2023-07-14T12:53:44.786459+0000","last_clean":"2023-07-14T12:53:44.786459+0000","last_became_active":"2023-07-14T12:53:43.681050+0000","last_became_peered":"2023-07-14T12:53:43.681050+0000","last_unstale":"2023-07-14T12:53:44.786459+0000","last_undegraded":"2023-07-14T12:53:44.786459+0000","last_fullsized":"2023-07-14T12:53:44.786459+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:15.216382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.786286+0000","last_change":"2023-07-14T12:53:43.685488+0000","last_active":"2023-07-14T12:53:44.786286+0000","last_peered":"2023-07-14T12:53:44.786286+0000","last_clean":"2023-07-14T12:53:44.786286+0000","last_became_active":"2023-07-14T12:53:43.685195+0000","last_became_peered":"2023-07-14T12:53:43.685195+0000","last_unstale":"2023-07-14T12:53:44.786286+0000","last_undegraded":"2023-07-14T12:53:44.786286+0000","last_fullsized":"2023-07-14T12:53:44.786286+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:17:02.665455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.066409+0000","last_change":"2023-07-14T12:53:43.659894+0000","last_active":"2023-07-14T12:53:45.066409+0000","last_peered":"2023-07-14T12:53:45.066409+0000","last_clean":"2023-07-14T12:53:45.066409+0000","last_became_active":"2023-07-14T12:53:43.659602+0000","last_became_peered":"2023-07-14T12:53:43.659602+0000","last_unstale":"2023-07-14T12:53:45.066409+0000","last_undegraded":"2023-07-14T12:53:45.066409+0000","last_fullsized":"2023-07-14T12:53:45.066409+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:49:02.871805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.786155+0000","last_change":"2023-07-14T12:53:43.681647+0000","last_active":"2023-07-14T12:53:44.786155+0000","last_peered":"2023-07-14T12:53:44.786155+0000","last_clean":"2023-07-14T12:53:44.786155+0000","last_became_active":"2023-07-14T12:53:43.678958+0000","last_became_peered":"2023-07-14T12:53:43.678958+0000","last_unstale":"2023-07-14T12:53:44.786155+0000","last_undegraded":"2023-07-14T12:53:44.786155+0000","last_fullsized":"2023-07-14T12:53:44.786155+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:27:21.922219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.667639+0000","last_change":"2023-07-14T12:53:43.659218+0000","last_active":"2023-07-14T12:53:44.667639+0000","last_peered":"2023-07-14T12:53:44.667639+0000","last_clean":"2023-07-14T12:53:44.667639+0000","last_became_active":"2023-07-14T12:53:43.658926+0000","last_became_peered":"2023-07-14T12:53:43.658926+0000","last_unstale":"2023-07-14T12:53:44.667639+0000","last_undegraded":"2023-07-14T12:53:44.667639+0000","last_fullsized":"2023-07-14T12:53:44.667639+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:42:46.079984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.785746+0000","last_change":"2023-07-14T12:53:43.680088+0000","last_active":"2023-07-14T12:53:44.785746+0000","last_peered":"2023-07-14T12:53:44.785746+0000","last_clean":"2023-07-14T12:53:44.785746+0000","last_became_active":"2023-07-14T12:53:43.679455+0000","last_became_peered":"2023-07-14T12:53:43.679455+0000","last_unstale":"2023-07-14T12:53:44.785746+0000","last_undegraded":"2023-07-14T12:53:44.785746+0000","last_fullsized":"2023-07-14T12:53:44.785746+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:42:53.854464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.066843+0000","last_change":"2023-07-14T12:53:43.682464+0000","last_active":"2023-07-14T12:53:45.066843+0000","last_peered":"2023-07-14T12:53:45.066843+0000","last_clean":"2023-07-14T12:53:45.066843+0000","last_became_active":"2023-07-14T12:53:43.682170+0000","last_became_peered":"2023-07-14T12:53:43.682170+0000","last_unstale":"2023-07-14T12:53:45.066843+0000","last_undegraded":"2023-07-14T12:53:45.066843+0000","last_fullsized":"2023-07-14T12:53:45.066843+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:29:22.549111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.067365+0000","last_change":"2023-07-14T12:53:43.681524+0000","last_active":"2023-07-14T12:53:45.067365+0000","last_peered":"2023-07-14T12:53:45.067365+0000","last_clean":"2023-07-14T12:53:45.067365+0000","last_became_active":"2023-07-14T12:53:43.681316+0000","last_became_peered":"2023-07-14T12:53:43.681316+0000","last_unstale":"2023-07-14T12:53:45.067365+0000","last_undegraded":"2023-07-14T12:53:45.067365+0000","last_fullsized":"2023-07-14T12:53:45.067365+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:45:41.276628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.067070+0000","last_change":"2023-07-14T12:53:43.674741+0000","last_active":"2023-07-14T12:53:45.067070+0000","last_peered":"2023-07-14T12:53:45.067070+0000","last_clean":"2023-07-14T12:53:45.067070+0000","last_became_active":"2023-07-14T12:53:43.674394+0000","last_became_peered":"2023-07-14T12:53:43.674394+0000","last_unstale":"2023-07-14T12:53:45.067070+0000","last_undegraded":"2023-07-14T12:53:45.067070+0000","last_fullsized":"2023-07-14T12:53:45.067070+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:26:47.604850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.662929+0000","last_change":"2023-07-14T12:53:43.662856+0000","last_active":"2023-07-14T12:53:44.662929+0000","last_peered":"2023-07-14T12:53:44.662929+0000","last_clean":"2023-07-14T12:53:44.662929+0000","last_became_active":"2023-07-14T12:53:43.662559+0000","last_became_peered":"2023-07-14T12:53:43.662559+0000","last_unstale":"2023-07-14T12:53:44.662929+0000","last_undegraded":"2023-07-14T12:53:44.662929+0000","last_fullsized":"2023-07-14T12:53:44.662929+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:04:16.709771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.066958+0000","last_change":"2023-07-14T12:53:43.675079+0000","last_active":"2023-07-14T12:53:45.066958+0000","last_peered":"2023-07-14T12:53:45.066958+0000","last_clean":"2023-07-14T12:53:45.066958+0000","last_became_active":"2023-07-14T12:53:43.674727+0000","last_became_peered":"2023-07-14T12:53:43.674727+0000","last_unstale":"2023-07-14T12:53:45.066958+0000","last_undegraded":"2023-07-14T12:53:45.066958+0000","last_fullsized":"2023-07-14T12:53:45.066958+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:55:13.469748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.785887+0000","last_change":"2023-07-14T12:53:43.681414+0000","last_active":"2023-07-14T12:53:44.785887+0000","last_peered":"2023-07-14T12:53:44.785887+0000","last_clean":"2023-07-14T12:53:44.785887+0000","last_became_active":"2023-07-14T12:53:43.678227+0000","last_became_peered":"2023-07-14T12:53:43.678227+0000","last_unstale":"2023-07-14T12:53:44.785887+0000","last_undegraded":"2023-07-14T12:53:44.785887+0000","last_fullsized":"2023-07-14T12:53:44.785887+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:29:22.549111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.668351+0000","last_change":"2023-07-14T12:53:43.669878+0000","last_active":"2023-07-14T12:53:44.668351+0000","last_peered":"2023-07-14T12:53:44.668351+0000","last_clean":"2023-07-14T12:53:44.668351+0000","last_became_active":"2023-07-14T12:53:43.669429+0000","last_became_peered":"2023-07-14T12:53:43.669429+0000","last_unstale":"2023-07-14T12:53:44.668351+0000","last_undegraded":"2023-07-14T12:53:44.668351+0000","last_fullsized":"2023-07-14T12:53:44.668351+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:46:18.040014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.067893+0000","last_change":"2023-07-14T12:53:43.661179+0000","last_active":"2023-07-14T12:53:45.067893+0000","last_peered":"2023-07-14T12:53:45.067893+0000","last_clean":"2023-07-14T12:53:45.067893+0000","last_became_active":"2023-07-14T12:53:43.660842+0000","last_became_peered":"2023-07-14T12:53:43.660842+0000","last_unstale":"2023-07-14T12:53:45.067893+0000","last_undegraded":"2023-07-14T12:53:45.067893+0000","last_fullsized":"2023-07-14T12:53:45.067893+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:11:45.617389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.662584+0000","last_change":"2023-07-14T12:53:43.667186+0000","last_active":"2023-07-14T12:53:44.662584+0000","last_peered":"2023-07-14T12:53:44.662584+0000","last_clean":"2023-07-14T12:53:44.662584+0000","last_became_active":"2023-07-14T12:53:43.666917+0000","last_became_peered":"2023-07-14T12:53:43.666917+0000","last_unstale":"2023-07-14T12:53:44.662584+0000","last_undegraded":"2023-07-14T12:53:44.662584+0000","last_fullsized":"2023-07-14T12:53:44.662584+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:45:24.830241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.067464+0000","last_change":"2023-07-14T12:53:43.667012+0000","last_active":"2023-07-14T12:53:45.067464+0000","last_peered":"2023-07-14T12:53:45.067464+0000","last_clean":"2023-07-14T12:53:45.067464+0000","last_became_active":"2023-07-14T12:53:43.666755+0000","last_became_peered":"2023-07-14T12:53:43.666755+0000","last_unstale":"2023-07-14T12:53:45.067464+0000","last_undegraded":"2023-07-14T12:53:45.067464+0000","last_fullsized":"2023-07-14T12:53:45.067464+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:53:35.145023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.058906+0000","last_change":"2023-07-14T12:53:43.679038+0000","last_active":"2023-07-14T12:53:45.058906+0000","last_peered":"2023-07-14T12:53:45.058906+0000","last_clean":"2023-07-14T12:53:45.058906+0000","last_became_active":"2023-07-14T12:53:43.678574+0000","last_became_peered":"2023-07-14T12:53:43.678574+0000","last_unstale":"2023-07-14T12:53:45.058906+0000","last_undegraded":"2023-07-14T12:53:45.058906+0000","last_fullsized":"2023-07-14T12:53:45.058906+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:52:31.221949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.067078+0000","last_change":"2023-07-14T12:53:43.656952+0000","last_active":"2023-07-14T12:53:45.067078+0000","last_peered":"2023-07-14T12:53:45.067078+0000","last_clean":"2023-07-14T12:53:45.067078+0000","last_became_active":"2023-07-14T12:53:43.655102+0000","last_became_peered":"2023-07-14T12:53:43.655102+0000","last_unstale":"2023-07-14T12:53:45.067078+0000","last_undegraded":"2023-07-14T12:53:45.067078+0000","last_fullsized":"2023-07-14T12:53:45.067078+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:05:07.674780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.786179+0000","last_change":"2023-07-14T12:53:43.679014+0000","last_active":"2023-07-14T12:53:44.786179+0000","last_peered":"2023-07-14T12:53:44.786179+0000","last_clean":"2023-07-14T12:53:44.786179+0000","last_became_active":"2023-07-14T12:53:43.678320+0000","last_became_peered":"2023-07-14T12:53:43.678320+0000","last_unstale":"2023-07-14T12:53:44.786179+0000","last_undegraded":"2023-07-14T12:53:44.786179+0000","last_fullsized":"2023-07-14T12:53:44.786179+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:53:30.944358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.066956+0000","last_change":"2023-07-14T12:53:43.666021+0000","last_active":"2023-07-14T12:53:45.066956+0000","last_peered":"2023-07-14T12:53:45.066956+0000","last_clean":"2023-07-14T12:53:45.066956+0000","last_became_active":"2023-07-14T12:53:43.665765+0000","last_became_peered":"2023-07-14T12:53:43.665765+0000","last_unstale":"2023-07-14T12:53:45.066956+0000","last_undegraded":"2023-07-14T12:53:45.066956+0000","last_fullsized":"2023-07-14T12:53:45.066956+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:36:20.454677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.066778+0000","last_change":"2023-07-14T12:53:43.672502+0000","last_active":"2023-07-14T12:53:45.066778+0000","last_peered":"2023-07-14T12:53:45.066778+0000","last_clean":"2023-07-14T12:53:45.066778+0000","last_became_active":"2023-07-14T12:53:43.672202+0000","last_became_peered":"2023-07-14T12:53:43.672202+0000","last_unstale":"2023-07-14T12:53:45.066778+0000","last_undegraded":"2023-07-14T12:53:45.066778+0000","last_fullsized":"2023-07-14T12:53:45.066778+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:54:59.566102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.067929+0000","last_change":"2023-07-14T12:53:43.667052+0000","last_active":"2023-07-14T12:53:45.067929+0000","last_peered":"2023-07-14T12:53:45.067929+0000","last_clean":"2023-07-14T12:53:45.067929+0000","last_became_active":"2023-07-14T12:53:43.666762+0000","last_became_peered":"2023-07-14T12:53:43.666762+0000","last_unstale":"2023-07-14T12:53:45.067929+0000","last_undegraded":"2023-07-14T12:53:45.067929+0000","last_fullsized":"2023-07-14T12:53:45.067929+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:30:54.454849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.058694+0000","last_change":"2023-07-14T12:53:43.662991+0000","last_active":"2023-07-14T12:53:45.058694+0000","last_peered":"2023-07-14T12:53:45.058694+0000","last_clean":"2023-07-14T12:53:45.058694+0000","last_became_active":"2023-07-14T12:53:43.662612+0000","last_became_peered":"2023-07-14T12:53:43.662612+0000","last_unstale":"2023-07-14T12:53:45.058694+0000","last_undegraded":"2023-07-14T12:53:45.058694+0000","last_fullsized":"2023-07-14T12:53:45.058694+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:41:11.332684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.067359+0000","last_change":"2023-07-14T12:53:43.681167+0000","last_active":"2023-07-14T12:53:45.067359+0000","last_peered":"2023-07-14T12:53:45.067359+0000","last_clean":"2023-07-14T12:53:45.067359+0000","last_became_active":"2023-07-14T12:53:43.680856+0000","last_became_peered":"2023-07-14T12:53:43.680856+0000","last_unstale":"2023-07-14T12:53:45.067359+0000","last_undegraded":"2023-07-14T12:53:45.067359+0000","last_fullsized":"2023-07-14T12:53:45.067359+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:08.156410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"36'4","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.067588+0000","last_change":"2023-07-14T12:53:42.667866+0000","last_active":"2023-07-14T12:53:45.067588+0000","last_peered":"2023-07-14T12:53:45.067588+0000","last_clean":"2023-07-14T12:53:45.067588+0000","last_became_active":"2023-07-14T12:53:42.667507+0000","last_became_peered":"2023-07-14T12:53:42.667507+0000","last_unstale":"2023-07-14T12:53:45.067588+0000","last_undegraded":"2023-07-14T12:53:45.067588+0000","last_fullsized":"2023-07-14T12:53:45.067588+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:25:54.167144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.059012+0000","last_change":"2023-07-14T12:53:43.682194+0000","last_active":"2023-07-14T12:53:45.059012+0000","last_peered":"2023-07-14T12:53:45.059012+0000","last_clean":"2023-07-14T12:53:45.059012+0000","last_became_active":"2023-07-14T12:53:43.681913+0000","last_became_peered":"2023-07-14T12:53:43.681913+0000","last_unstale":"2023-07-14T12:53:45.059012+0000","last_undegraded":"2023-07-14T12:53:45.059012+0000","last_fullsized":"2023-07-14T12:53:45.059012+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:11:22.841913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.066522+0000","last_change":"2023-07-14T12:53:42.655513+0000","last_active":"2023-07-14T12:53:45.066522+0000","last_peered":"2023-07-14T12:53:45.066522+0000","last_clean":"2023-07-14T12:53:45.066522+0000","last_became_active":"2023-07-14T12:53:42.655190+0000","last_became_peered":"2023-07-14T12:53:42.655190+0000","last_unstale":"2023-07-14T12:53:45.066522+0000","last_undegraded":"2023-07-14T12:53:45.066522+0000","last_fullsized":"2023-07-14T12:53:45.066522+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:57:04.405858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.668264+0000","last_change":"2023-07-14T12:53:43.659123+0000","last_active":"2023-07-14T12:53:44.668264+0000","last_peered":"2023-07-14T12:53:44.668264+0000","last_clean":"2023-07-14T12:53:44.668264+0000","last_became_active":"2023-07-14T12:53:43.658720+0000","last_became_peered":"2023-07-14T12:53:43.658720+0000","last_unstale":"2023-07-14T12:53:44.668264+0000","last_undegraded":"2023-07-14T12:53:44.668264+0000","last_fullsized":"2023-07-14T12:53:44.668264+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:31:01.882782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.059085+0000","last_change":"2023-07-14T12:53:42.653922+0000","last_active":"2023-07-14T12:53:45.059085+0000","last_peered":"2023-07-14T12:53:45.059085+0000","last_clean":"2023-07-14T12:53:45.059085+0000","last_became_active":"2023-07-14T12:53:42.653620+0000","last_became_peered":"2023-07-14T12:53:42.653620+0000","last_unstale":"2023-07-14T12:53:45.059085+0000","last_undegraded":"2023-07-14T12:53:45.059085+0000","last_fullsized":"2023-07-14T12:53:45.059085+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:09:04.679027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.066182+0000","last_change":"2023-07-14T12:53:43.662685+0000","last_active":"2023-07-14T12:53:45.066182+0000","last_peered":"2023-07-14T12:53:45.066182+0000","last_clean":"2023-07-14T12:53:45.066182+0000","last_became_active":"2023-07-14T12:53:43.658881+0000","last_became_peered":"2023-07-14T12:53:43.658881+0000","last_unstale":"2023-07-14T12:53:45.066182+0000","last_undegraded":"2023-07-14T12:53:45.066182+0000","last_fullsized":"2023-07-14T12:53:45.066182+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:57:38.063423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.668032+0000","last_change":"2023-07-14T12:53:42.662383+0000","last_active":"2023-07-14T12:53:44.668032+0000","last_peered":"2023-07-14T12:53:44.668032+0000","last_clean":"2023-07-14T12:53:44.668032+0000","last_became_active":"2023-07-14T12:53:42.661905+0000","last_became_peered":"2023-07-14T12:53:42.661905+0000","last_unstale":"2023-07-14T12:53:44.668032+0000","last_undegraded":"2023-07-14T12:53:44.668032+0000","last_fullsized":"2023-07-14T12:53:44.668032+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:53:29.936051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.065605+0000","last_change":"2023-07-14T12:53:43.664207+0000","last_active":"2023-07-14T12:53:45.065605+0000","last_peered":"2023-07-14T12:53:45.065605+0000","last_clean":"2023-07-14T12:53:45.065605+0000","last_became_active":"2023-07-14T12:53:43.663925+0000","last_became_peered":"2023-07-14T12:53:43.663925+0000","last_unstale":"2023-07-14T12:53:45.065605+0000","last_undegraded":"2023-07-14T12:53:45.065605+0000","last_fullsized":"2023-07-14T12:53:45.065605+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:32:42.556370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.785806+0000","last_change":"2023-07-14T12:53:42.657326+0000","last_active":"2023-07-14T12:53:44.785806+0000","last_peered":"2023-07-14T12:53:44.785806+0000","last_clean":"2023-07-14T12:53:44.785806+0000","last_became_active":"2023-07-14T12:53:42.657059+0000","last_became_peered":"2023-07-14T12:53:42.657059+0000","last_unstale":"2023-07-14T12:53:44.785806+0000","last_undegraded":"2023-07-14T12:53:44.785806+0000","last_fullsized":"2023-07-14T12:53:44.785806+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:46.902515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.785935+0000","last_change":"2023-07-14T12:53:43.679170+0000","last_active":"2023-07-14T12:53:44.785935+0000","last_peered":"2023-07-14T12:53:44.785935+0000","last_clean":"2023-07-14T12:53:44.785935+0000","last_became_active":"2023-07-14T12:53:43.678214+0000","last_became_peered":"2023-07-14T12:53:43.678214+0000","last_unstale":"2023-07-14T12:53:44.785935+0000","last_undegraded":"2023-07-14T12:53:44.785935+0000","last_fullsized":"2023-07-14T12:53:44.785935+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:45:41.276628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.067731+0000","last_change":"2023-07-14T12:53:42.664539+0000","last_active":"2023-07-14T12:53:45.067731+0000","last_peered":"2023-07-14T12:53:45.067731+0000","last_clean":"2023-07-14T12:53:45.067731+0000","last_became_active":"2023-07-14T12:53:42.664220+0000","last_became_peered":"2023-07-14T12:53:42.664220+0000","last_unstale":"2023-07-14T12:53:45.067731+0000","last_undegraded":"2023-07-14T12:53:45.067731+0000","last_fullsized":"2023-07-14T12:53:45.067731+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:14.208074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.668063+0000","last_change":"2023-07-14T12:53:43.681415+0000","last_active":"2023-07-14T12:53:44.668063+0000","last_peered":"2023-07-14T12:53:44.668063+0000","last_clean":"2023-07-14T12:53:44.668063+0000","last_became_active":"2023-07-14T12:53:43.681145+0000","last_became_peered":"2023-07-14T12:53:43.681145+0000","last_unstale":"2023-07-14T12:53:44.668063+0000","last_undegraded":"2023-07-14T12:53:44.668063+0000","last_fullsized":"2023-07-14T12:53:44.668063+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:17:02.665455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.058859+0000","last_change":"2023-07-14T12:53:42.658632+0000","last_active":"2023-07-14T12:53:45.058859+0000","last_peered":"2023-07-14T12:53:45.058859+0000","last_clean":"2023-07-14T12:53:45.058859+0000","last_became_active":"2023-07-14T12:53:42.658028+0000","last_became_peered":"2023-07-14T12:53:42.658028+0000","last_unstale":"2023-07-14T12:53:45.058859+0000","last_undegraded":"2023-07-14T12:53:45.058859+0000","last_fullsized":"2023-07-14T12:53:45.058859+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:11:50.985338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.065822+0000","last_change":"2023-07-14T12:53:43.670021+0000","last_active":"2023-07-14T12:53:45.065822+0000","last_peered":"2023-07-14T12:53:45.065822+0000","last_clean":"2023-07-14T12:53:45.065822+0000","last_became_active":"2023-07-14T12:53:43.669774+0000","last_became_peered":"2023-07-14T12:53:43.669774+0000","last_unstale":"2023-07-14T12:53:45.065822+0000","last_undegraded":"2023-07-14T12:53:45.065822+0000","last_fullsized":"2023-07-14T12:53:45.065822+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:10:01.306279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.667614+0000","last_change":"2023-07-14T12:53:42.662716+0000","last_active":"2023-07-14T12:53:44.667614+0000","last_peered":"2023-07-14T12:53:44.667614+0000","last_clean":"2023-07-14T12:53:44.667614+0000","last_became_active":"2023-07-14T12:53:42.662457+0000","last_became_peered":"2023-07-14T12:53:42.662457+0000","last_unstale":"2023-07-14T12:53:44.667614+0000","last_undegraded":"2023-07-14T12:53:44.667614+0000","last_fullsized":"2023-07-14T12:53:44.667614+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:07.148103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.662901+0000","last_change":"2023-07-14T12:53:43.674346+0000","last_active":"2023-07-14T12:53:44.662901+0000","last_peered":"2023-07-14T12:53:44.662901+0000","last_clean":"2023-07-14T12:53:44.662901+0000","last_became_active":"2023-07-14T12:53:43.674067+0000","last_became_peered":"2023-07-14T12:53:43.674067+0000","last_unstale":"2023-07-14T12:53:44.662901+0000","last_undegraded":"2023-07-14T12:53:44.662901+0000","last_fullsized":"2023-07-14T12:53:44.662901+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:37:08.815447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.066306+0000","last_change":"2023-07-14T12:53:42.652006+0000","last_active":"2023-07-14T12:53:45.066306+0000","last_peered":"2023-07-14T12:53:45.066306+0000","last_clean":"2023-07-14T12:53:45.066306+0000","last_became_active":"2023-07-14T12:53:42.651707+0000","last_became_peered":"2023-07-14T12:53:42.651707+0000","last_unstale":"2023-07-14T12:53:45.066306+0000","last_undegraded":"2023-07-14T12:53:45.066306+0000","last_fullsized":"2023-07-14T12:53:45.066306+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:55:12.728260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.067384+0000","last_change":"2023-07-14T12:53:43.664589+0000","last_active":"2023-07-14T12:53:45.067384+0000","last_peered":"2023-07-14T12:53:45.067384+0000","last_clean":"2023-07-14T12:53:45.067384+0000","last_became_active":"2023-07-14T12:53:43.664272+0000","last_became_peered":"2023-07-14T12:53:43.664272+0000","last_unstale":"2023-07-14T12:53:45.067384+0000","last_undegraded":"2023-07-14T12:53:45.067384+0000","last_fullsized":"2023-07-14T12:53:45.067384+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:27:21.922219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.786541+0000","last_change":"2023-07-14T12:53:42.658082+0000","last_active":"2023-07-14T12:53:44.786541+0000","last_peered":"2023-07-14T12:53:44.786541+0000","last_clean":"2023-07-14T12:53:44.786541+0000","last_became_active":"2023-07-14T12:53:42.657825+0000","last_became_peered":"2023-07-14T12:53:42.657825+0000","last_unstale":"2023-07-14T12:53:44.786541+0000","last_undegraded":"2023-07-14T12:53:44.786541+0000","last_fullsized":"2023-07-14T12:53:44.786541+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:14:42.247633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.066510+0000","last_change":"2023-07-14T12:53:43.661006+0000","last_active":"2023-07-14T12:53:45.066510+0000","last_peered":"2023-07-14T12:53:45.066510+0000","last_clean":"2023-07-14T12:53:45.066510+0000","last_became_active":"2023-07-14T12:53:43.660694+0000","last_became_peered":"2023-07-14T12:53:43.660694+0000","last_unstale":"2023-07-14T12:53:45.066510+0000","last_undegraded":"2023-07-14T12:53:45.066510+0000","last_fullsized":"2023-07-14T12:53:45.066510+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:00:37.024350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.786438+0000","last_change":"2023-07-14T12:53:42.657223+0000","last_active":"2023-07-14T12:53:44.786438+0000","last_peered":"2023-07-14T12:53:44.786438+0000","last_clean":"2023-07-14T12:53:44.786438+0000","last_became_active":"2023-07-14T12:53:42.656948+0000","last_became_peered":"2023-07-14T12:53:42.656948+0000","last_unstale":"2023-07-14T12:53:44.786438+0000","last_undegraded":"2023-07-14T12:53:44.786438+0000","last_fullsized":"2023-07-14T12:53:44.786438+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:31:00.874475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.668144+0000","last_change":"2023-07-14T12:53:43.676139+0000","last_active":"2023-07-14T12:53:44.668144+0000","last_peered":"2023-07-14T12:53:44.668144+0000","last_clean":"2023-07-14T12:53:44.668144+0000","last_became_active":"2023-07-14T12:53:43.675861+0000","last_became_peered":"2023-07-14T12:53:43.675861+0000","last_unstale":"2023-07-14T12:53:44.668144+0000","last_undegraded":"2023-07-14T12:53:44.668144+0000","last_fullsized":"2023-07-14T12:53:44.668144+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:58:24.575878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.066046+0000","last_change":"2023-07-14T12:53:42.661334+0000","last_active":"2023-07-14T12:53:45.066046+0000","last_peered":"2023-07-14T12:53:45.066046+0000","last_clean":"2023-07-14T12:53:45.066046+0000","last_became_active":"2023-07-14T12:53:42.661016+0000","last_became_peered":"2023-07-14T12:53:42.661016+0000","last_unstale":"2023-07-14T12:53:45.066046+0000","last_undegraded":"2023-07-14T12:53:45.066046+0000","last_fullsized":"2023-07-14T12:53:45.066046+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:51:46.389062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.065735+0000","last_change":"2023-07-14T12:53:43.680443+0000","last_active":"2023-07-14T12:53:45.065735+0000","last_peered":"2023-07-14T12:53:45.065735+0000","last_clean":"2023-07-14T12:53:45.065735+0000","last_became_active":"2023-07-14T12:53:43.680008+0000","last_became_peered":"2023-07-14T12:53:43.680008+0000","last_unstale":"2023-07-14T12:53:45.065735+0000","last_undegraded":"2023-07-14T12:53:45.065735+0000","last_fullsized":"2023-07-14T12:53:45.065735+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:24:17.466926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.066147+0000","last_change":"2023-07-14T12:53:42.656742+0000","last_active":"2023-07-14T12:53:45.066147+0000","last_peered":"2023-07-14T12:53:45.066147+0000","last_clean":"2023-07-14T12:53:45.066147+0000","last_became_active":"2023-07-14T12:53:42.656469+0000","last_became_peered":"2023-07-14T12:53:42.656469+0000","last_unstale":"2023-07-14T12:53:45.066147+0000","last_undegraded":"2023-07-14T12:53:45.066147+0000","last_fullsized":"2023-07-14T12:53:45.066147+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:11:50.985338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.065699+0000","last_change":"2023-07-14T12:53:43.666565+0000","last_active":"2023-07-14T12:53:45.065699+0000","last_peered":"2023-07-14T12:53:45.065699+0000","last_clean":"2023-07-14T12:53:45.065699+0000","last_became_active":"2023-07-14T12:53:43.666249+0000","last_became_peered":"2023-07-14T12:53:43.666249+0000","last_unstale":"2023-07-14T12:53:45.065699+0000","last_undegraded":"2023-07-14T12:53:45.065699+0000","last_fullsized":"2023-07-14T12:53:45.065699+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:42:11.762615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.058749+0000","last_change":"2023-07-14T12:53:42.658001+0000","last_active":"2023-07-14T12:53:45.058749+0000","last_peered":"2023-07-14T12:53:45.058749+0000","last_clean":"2023-07-14T12:53:45.058749+0000","last_became_active":"2023-07-14T12:53:42.657716+0000","last_became_peered":"2023-07-14T12:53:42.657716+0000","last_unstale":"2023-07-14T12:53:45.058749+0000","last_undegraded":"2023-07-14T12:53:45.058749+0000","last_fullsized":"2023-07-14T12:53:45.058749+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:51:46.389062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.067569+0000","last_change":"2023-07-14T12:53:43.662760+0000","last_active":"2023-07-14T12:53:45.067569+0000","last_peered":"2023-07-14T12:53:45.067569+0000","last_clean":"2023-07-14T12:53:45.067569+0000","last_became_active":"2023-07-14T12:53:43.662438+0000","last_became_peered":"2023-07-14T12:53:43.662438+0000","last_unstale":"2023-07-14T12:53:45.067569+0000","last_undegraded":"2023-07-14T12:53:45.067569+0000","last_fullsized":"2023-07-14T12:53:45.067569+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:58:24.575878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.066649+0000","last_change":"2023-07-14T12:53:42.660268+0000","last_active":"2023-07-14T12:53:45.066649+0000","last_peered":"2023-07-14T12:53:45.066649+0000","last_clean":"2023-07-14T12:53:45.066649+0000","last_became_active":"2023-07-14T12:53:42.659539+0000","last_became_peered":"2023-07-14T12:53:42.659539+0000","last_unstale":"2023-07-14T12:53:45.066649+0000","last_undegraded":"2023-07-14T12:53:45.066649+0000","last_fullsized":"2023-07-14T12:53:45.066649+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:02:11.377501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.066015+0000","last_change":"2023-07-14T12:53:43.669926+0000","last_active":"2023-07-14T12:53:45.066015+0000","last_peered":"2023-07-14T12:53:45.066015+0000","last_clean":"2023-07-14T12:53:45.066015+0000","last_became_active":"2023-07-14T12:53:43.669212+0000","last_became_peered":"2023-07-14T12:53:43.669212+0000","last_unstale":"2023-07-14T12:53:45.066015+0000","last_undegraded":"2023-07-14T12:53:45.066015+0000","last_fullsized":"2023-07-14T12:53:45.066015+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:41:11.332684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"36'8","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.066774+0000","last_change":"2023-07-14T12:53:42.658419+0000","last_active":"2023-07-14T12:53:45.066774+0000","last_peered":"2023-07-14T12:53:45.066774+0000","last_clean":"2023-07-14T12:53:45.066774+0000","last_became_active":"2023-07-14T12:53:42.658144+0000","last_became_peered":"2023-07-14T12:53:42.658144+0000","last_unstale":"2023-07-14T12:53:45.066774+0000","last_undegraded":"2023-07-14T12:53:45.066774+0000","last_fullsized":"2023-07-14T12:53:45.066774+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:46.902515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.066025+0000","last_change":"2023-07-14T12:53:43.654441+0000","last_active":"2023-07-14T12:53:45.066025+0000","last_peered":"2023-07-14T12:53:45.066025+0000","last_clean":"2023-07-14T12:53:45.066025+0000","last_became_active":"2023-07-14T12:53:43.654141+0000","last_became_peered":"2023-07-14T12:53:43.654141+0000","last_unstale":"2023-07-14T12:53:45.066025+0000","last_undegraded":"2023-07-14T12:53:45.066025+0000","last_fullsized":"2023-07-14T12:53:45.066025+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:05:10.882859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.786627+0000","last_change":"2023-07-14T12:53:42.658432+0000","last_active":"2023-07-14T12:53:44.786627+0000","last_peered":"2023-07-14T12:53:44.786627+0000","last_clean":"2023-07-14T12:53:44.786627+0000","last_became_active":"2023-07-14T12:53:42.658113+0000","last_became_peered":"2023-07-14T12:53:42.658113+0000","last_unstale":"2023-07-14T12:53:44.786627+0000","last_undegraded":"2023-07-14T12:53:44.786627+0000","last_fullsized":"2023-07-14T12:53:44.786627+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:46:17.031707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.786349+0000","last_change":"2023-07-14T12:53:43.680409+0000","last_active":"2023-07-14T12:53:44.786349+0000","last_peered":"2023-07-14T12:53:44.786349+0000","last_clean":"2023-07-14T12:53:44.786349+0000","last_became_active":"2023-07-14T12:53:43.678446+0000","last_became_peered":"2023-07-14T12:53:43.678446+0000","last_unstale":"2023-07-14T12:53:44.786349+0000","last_undegraded":"2023-07-14T12:53:44.786349+0000","last_fullsized":"2023-07-14T12:53:44.786349+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:42:46.079984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.668353+0000","last_change":"2023-07-14T12:53:42.666345+0000","last_active":"2023-07-14T12:53:44.668353+0000","last_peered":"2023-07-14T12:53:44.668353+0000","last_clean":"2023-07-14T12:53:44.668353+0000","last_became_active":"2023-07-14T12:53:42.666058+0000","last_became_peered":"2023-07-14T12:53:42.666058+0000","last_unstale":"2023-07-14T12:53:44.668353+0000","last_undegraded":"2023-07-14T12:53:44.668353+0000","last_fullsized":"2023-07-14T12:53:44.668353+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:14:42.247633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.668275+0000","last_change":"2023-07-14T12:53:43.671109+0000","last_active":"2023-07-14T12:53:44.668275+0000","last_peered":"2023-07-14T12:53:44.668275+0000","last_clean":"2023-07-14T12:53:44.668275+0000","last_became_active":"2023-07-14T12:53:43.670817+0000","last_became_peered":"2023-07-14T12:53:43.670817+0000","last_unstale":"2023-07-14T12:53:44.668275+0000","last_undegraded":"2023-07-14T12:53:44.668275+0000","last_fullsized":"2023-07-14T12:53:44.668275+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:15.216382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.662979+0000","last_change":"2023-07-14T12:53:42.655980+0000","last_active":"2023-07-14T12:53:44.662979+0000","last_peered":"2023-07-14T12:53:44.662979+0000","last_clean":"2023-07-14T12:53:44.662979+0000","last_became_active":"2023-07-14T12:53:42.655637+0000","last_became_peered":"2023-07-14T12:53:42.655637+0000","last_unstale":"2023-07-14T12:53:44.662979+0000","last_undegraded":"2023-07-14T12:53:44.662979+0000","last_fullsized":"2023-07-14T12:53:44.662979+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:19:49.020040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.663051+0000","last_change":"2023-07-14T12:53:43.664999+0000","last_active":"2023-07-14T12:53:44.663051+0000","last_peered":"2023-07-14T12:53:44.663051+0000","last_clean":"2023-07-14T12:53:44.663051+0000","last_became_active":"2023-07-14T12:53:43.664604+0000","last_became_peered":"2023-07-14T12:53:43.664604+0000","last_unstale":"2023-07-14T12:53:44.663051+0000","last_undegraded":"2023-07-14T12:53:44.663051+0000","last_fullsized":"2023-07-14T12:53:44.663051+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:01:45.168557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.059076+0000","last_change":"2023-07-14T12:53:42.653617+0000","last_active":"2023-07-14T12:53:45.059076+0000","last_peered":"2023-07-14T12:53:45.059076+0000","last_clean":"2023-07-14T12:53:45.059076+0000","last_became_active":"2023-07-14T12:53:42.653328+0000","last_became_peered":"2023-07-14T12:53:42.653328+0000","last_unstale":"2023-07-14T12:53:45.059076+0000","last_undegraded":"2023-07-14T12:53:45.059076+0000","last_fullsized":"2023-07-14T12:53:45.059076+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:44:36.966748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.067795+0000","last_change":"2023-07-14T12:53:43.667171+0000","last_active":"2023-07-14T12:53:45.067795+0000","last_peered":"2023-07-14T12:53:45.067795+0000","last_clean":"2023-07-14T12:53:45.067795+0000","last_became_active":"2023-07-14T12:53:43.666858+0000","last_became_peered":"2023-07-14T12:53:43.666858+0000","last_unstale":"2023-07-14T12:53:45.067795+0000","last_undegraded":"2023-07-14T12:53:45.067795+0000","last_fullsized":"2023-07-14T12:53:45.067795+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:14:43.255940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.662722+0000","last_change":"2023-07-14T12:53:42.657937+0000","last_active":"2023-07-14T12:53:44.662722+0000","last_peered":"2023-07-14T12:53:44.662722+0000","last_clean":"2023-07-14T12:53:44.662722+0000","last_became_active":"2023-07-14T12:53:42.657616+0000","last_became_peered":"2023-07-14T12:53:42.657616+0000","last_unstale":"2023-07-14T12:53:44.662722+0000","last_undegraded":"2023-07-14T12:53:44.662722+0000","last_fullsized":"2023-07-14T12:53:44.662722+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:03:53.773183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.066376+0000","last_change":"2023-07-14T12:53:43.663368+0000","last_active":"2023-07-14T12:53:45.066376+0000","last_peered":"2023-07-14T12:53:45.066376+0000","last_clean":"2023-07-14T12:53:45.066376+0000","last_became_active":"2023-07-14T12:53:43.663016+0000","last_became_peered":"2023-07-14T12:53:43.663016+0000","last_unstale":"2023-07-14T12:53:45.066376+0000","last_undegraded":"2023-07-14T12:53:45.066376+0000","last_fullsized":"2023-07-14T12:53:45.066376+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:34:29.622199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.662595+0000","last_change":"2023-07-14T12:53:42.664165+0000","last_active":"2023-07-14T12:53:44.662595+0000","last_peered":"2023-07-14T12:53:44.662595+0000","last_clean":"2023-07-14T12:53:44.662595+0000","last_became_active":"2023-07-14T12:53:42.663793+0000","last_became_peered":"2023-07-14T12:53:42.663793+0000","last_unstale":"2023-07-14T12:53:44.662595+0000","last_undegraded":"2023-07-14T12:53:44.662595+0000","last_fullsized":"2023-07-14T12:53:44.662595+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:34:51.173828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.785748+0000","last_change":"2023-07-14T12:53:43.681788+0000","last_active":"2023-07-14T12:53:44.785748+0000","last_peered":"2023-07-14T12:53:44.785748+0000","last_clean":"2023-07-14T12:53:44.785748+0000","last_became_active":"2023-07-14T12:53:43.678614+0000","last_became_peered":"2023-07-14T12:53:43.678614+0000","last_unstale":"2023-07-14T12:53:44.785748+0000","last_undegraded":"2023-07-14T12:53:44.785748+0000","last_fullsized":"2023-07-14T12:53:44.785748+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:23:37.905208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.067987+0000","last_change":"2023-07-14T12:53:42.662449+0000","last_active":"2023-07-14T12:53:45.067987+0000","last_peered":"2023-07-14T12:53:45.067987+0000","last_clean":"2023-07-14T12:53:45.067987+0000","last_became_active":"2023-07-14T12:53:42.662185+0000","last_became_peered":"2023-07-14T12:53:42.662185+0000","last_unstale":"2023-07-14T12:53:45.067987+0000","last_undegraded":"2023-07-14T12:53:45.067987+0000","last_fullsized":"2023-07-14T12:53:45.067987+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:33:45.738194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.066004+0000","last_change":"2023-07-14T12:53:43.669915+0000","last_active":"2023-07-14T12:53:45.066004+0000","last_peered":"2023-07-14T12:53:45.066004+0000","last_clean":"2023-07-14T12:53:45.066004+0000","last_became_active":"2023-07-14T12:53:43.669551+0000","last_became_peered":"2023-07-14T12:53:43.669551+0000","last_unstale":"2023-07-14T12:53:45.066004+0000","last_undegraded":"2023-07-14T12:53:45.066004+0000","last_fullsized":"2023-07-14T12:53:45.066004+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:09:53.825125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.662652+0000","last_change":"2023-07-14T12:53:42.658170+0000","last_active":"2023-07-14T12:53:44.662652+0000","last_peered":"2023-07-14T12:53:44.662652+0000","last_clean":"2023-07-14T12:53:44.662652+0000","last_became_active":"2023-07-14T12:53:42.657884+0000","last_became_peered":"2023-07-14T12:53:42.657884+0000","last_unstale":"2023-07-14T12:53:44.662652+0000","last_undegraded":"2023-07-14T12:53:44.662652+0000","last_fullsized":"2023-07-14T12:53:44.662652+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:15:54.513287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.786422+0000","last_change":"2023-07-14T12:53:43.680836+0000","last_active":"2023-07-14T12:53:44.786422+0000","last_peered":"2023-07-14T12:53:44.786422+0000","last_clean":"2023-07-14T12:53:44.786422+0000","last_became_active":"2023-07-14T12:53:43.680522+0000","last_became_peered":"2023-07-14T12:53:43.680522+0000","last_unstale":"2023-07-14T12:53:44.786422+0000","last_undegraded":"2023-07-14T12:53:44.786422+0000","last_fullsized":"2023-07-14T12:53:44.786422+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:58:24.575878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.067521+0000","last_change":"2023-07-14T12:53:42.660164+0000","last_active":"2023-07-14T12:53:45.067521+0000","last_peered":"2023-07-14T12:53:45.067521+0000","last_clean":"2023-07-14T12:53:45.067521+0000","last_became_active":"2023-07-14T12:53:42.659871+0000","last_became_peered":"2023-07-14T12:53:42.659871+0000","last_unstale":"2023-07-14T12:53:45.067521+0000","last_undegraded":"2023-07-14T12:53:45.067521+0000","last_fullsized":"2023-07-14T12:53:45.067521+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:42:45.071676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":201,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.067839+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T12:53:45.067839+0000","last_peered":"2023-07-14T12:53:45.067839+0000","last_clean":"2023-07-14T12:53:45.067839+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T12:53:45.067839+0000","last_undegraded":"2023-07-14T12:53:45.067839+0000","last_fullsized":"2023-07-14T12:53:45.067839+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:45:09.179484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.786010+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T12:53:44.786010+0000","last_peered":"2023-07-14T12:53:44.786010+0000","last_clean":"2023-07-14T12:53:44.786010+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T12:53:44.786010+0000","last_undegraded":"2023-07-14T12:53:44.786010+0000","last_fullsized":"2023-07-14T12:53:44.786010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:49:05.543746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.058927+0000","last_change":"2023-07-14T12:53:43.681967+0000","last_active":"2023-07-14T12:53:45.058927+0000","last_peered":"2023-07-14T12:53:45.058927+0000","last_clean":"2023-07-14T12:53:45.058927+0000","last_became_active":"2023-07-14T12:53:43.681710+0000","last_became_peered":"2023-07-14T12:53:43.681710+0000","last_unstale":"2023-07-14T12:53:45.058927+0000","last_undegraded":"2023-07-14T12:53:45.058927+0000","last_fullsized":"2023-07-14T12:53:45.058927+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:57:38.063423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.786651+0000","last_change":"2023-07-14T12:53:42.656339+0000","last_active":"2023-07-14T12:53:44.786651+0000","last_peered":"2023-07-14T12:53:44.786651+0000","last_clean":"2023-07-14T12:53:44.786651+0000","last_became_active":"2023-07-14T12:53:42.656049+0000","last_became_peered":"2023-07-14T12:53:42.656049+0000","last_unstale":"2023-07-14T12:53:44.786651+0000","last_undegraded":"2023-07-14T12:53:44.786651+0000","last_fullsized":"2023-07-14T12:53:44.786651+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:11:44.609082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.067103+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T12:53:45.067103+0000","last_peered":"2023-07-14T12:53:45.067103+0000","last_clean":"2023-07-14T12:53:45.067103+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T12:53:45.067103+0000","last_undegraded":"2023-07-14T12:53:45.067103+0000","last_fullsized":"2023-07-14T12:53:45.067103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:19:24.911402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.067556+0000","last_change":"2023-07-14T12:53:43.666579+0000","last_active":"2023-07-14T12:53:45.067556+0000","last_peered":"2023-07-14T12:53:45.067556+0000","last_clean":"2023-07-14T12:53:45.067556+0000","last_became_active":"2023-07-14T12:53:43.666278+0000","last_became_peered":"2023-07-14T12:53:43.666278+0000","last_unstale":"2023-07-14T12:53:45.067556+0000","last_undegraded":"2023-07-14T12:53:45.067556+0000","last_fullsized":"2023-07-14T12:53:45.067556+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:53:30.944358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"37'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.663102+0000","last_change":"2023-07-14T12:53:42.665691+0000","last_active":"2023-07-14T12:53:44.663102+0000","last_peered":"2023-07-14T12:53:44.663102+0000","last_clean":"2023-07-14T12:53:44.663102+0000","last_became_active":"2023-07-14T12:53:42.665364+0000","last_became_peered":"2023-07-14T12:53:42.665364+0000","last_unstale":"2023-07-14T12:53:44.663102+0000","last_undegraded":"2023-07-14T12:53:44.663102+0000","last_fullsized":"2023-07-14T12:53:44.663102+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:08:44.279240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.662505+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T12:53:44.662505+0000","last_peered":"2023-07-14T12:53:44.662505+0000","last_clean":"2023-07-14T12:53:44.662505+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T12:53:44.662505+0000","last_undegraded":"2023-07-14T12:53:44.662505+0000","last_fullsized":"2023-07-14T12:53:44.662505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:31:31.239010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.065963+0000","last_change":"2023-07-14T12:53:43.671797+0000","last_active":"2023-07-14T12:53:45.065963+0000","last_peered":"2023-07-14T12:53:45.065963+0000","last_clean":"2023-07-14T12:53:45.065963+0000","last_became_active":"2023-07-14T12:53:43.671462+0000","last_became_peered":"2023-07-14T12:53:43.671462+0000","last_unstale":"2023-07-14T12:53:45.065963+0000","last_undegraded":"2023-07-14T12:53:45.065963+0000","last_fullsized":"2023-07-14T12:53:45.065963+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:34:13.027204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.066361+0000","last_change":"2023-07-14T12:53:42.656054+0000","last_active":"2023-07-14T12:53:45.066361+0000","last_peered":"2023-07-14T12:53:45.066361+0000","last_clean":"2023-07-14T12:53:45.066361+0000","last_became_active":"2023-07-14T12:53:42.655428+0000","last_became_peered":"2023-07-14T12:53:42.655428+0000","last_unstale":"2023-07-14T12:53:45.066361+0000","last_undegraded":"2023-07-14T12:53:45.066361+0000","last_fullsized":"2023-07-14T12:53:45.066361+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:59:26.261812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.785967+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T12:53:44.785967+0000","last_peered":"2023-07-14T12:53:44.785967+0000","last_clean":"2023-07-14T12:53:44.785967+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T12:53:44.785967+0000","last_undegraded":"2023-07-14T12:53:44.785967+0000","last_fullsized":"2023-07-14T12:53:44.785967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:19:24.911402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.065853+0000","last_change":"2023-07-14T12:53:43.666053+0000","last_active":"2023-07-14T12:53:45.065853+0000","last_peered":"2023-07-14T12:53:45.065853+0000","last_clean":"2023-07-14T12:53:45.065853+0000","last_became_active":"2023-07-14T12:53:43.665741+0000","last_became_peered":"2023-07-14T12:53:43.665741+0000","last_unstale":"2023-07-14T12:53:45.065853+0000","last_undegraded":"2023-07-14T12:53:45.065853+0000","last_fullsized":"2023-07-14T12:53:45.065853+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:05:36.682555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.066605+0000","last_change":"2023-07-14T12:53:42.662494+0000","last_active":"2023-07-14T12:53:45.066605+0000","last_peered":"2023-07-14T12:53:45.066605+0000","last_clean":"2023-07-14T12:53:45.066605+0000","last_became_active":"2023-07-14T12:53:42.662275+0000","last_became_peered":"2023-07-14T12:53:42.662275+0000","last_unstale":"2023-07-14T12:53:45.066605+0000","last_undegraded":"2023-07-14T12:53:45.066605+0000","last_fullsized":"2023-07-14T12:53:45.066605+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:25:03.006737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.059068+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T12:53:45.059068+0000","last_peered":"2023-07-14T12:53:45.059068+0000","last_clean":"2023-07-14T12:53:45.059068+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T12:53:45.059068+0000","last_undegraded":"2023-07-14T12:53:45.059068+0000","last_fullsized":"2023-07-14T12:53:45.059068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:52:10.080840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.058985+0000","last_change":"2023-07-14T12:53:43.661948+0000","last_active":"2023-07-14T12:53:45.058985+0000","last_peered":"2023-07-14T12:53:45.058985+0000","last_clean":"2023-07-14T12:53:45.058985+0000","last_became_active":"2023-07-14T12:53:43.661681+0000","last_became_peered":"2023-07-14T12:53:43.661681+0000","last_unstale":"2023-07-14T12:53:45.058985+0000","last_undegraded":"2023-07-14T12:53:45.058985+0000","last_fullsized":"2023-07-14T12:53:45.058985+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:55:13.736567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.066838+0000","last_change":"2023-07-14T12:53:42.663256+0000","last_active":"2023-07-14T12:53:45.066838+0000","last_peered":"2023-07-14T12:53:45.066838+0000","last_clean":"2023-07-14T12:53:45.066838+0000","last_became_active":"2023-07-14T12:53:42.662980+0000","last_became_peered":"2023-07-14T12:53:42.662980+0000","last_unstale":"2023-07-14T12:53:45.066838+0000","last_undegraded":"2023-07-14T12:53:45.066838+0000","last_fullsized":"2023-07-14T12:53:45.066838+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:45:42.882459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.067713+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T12:53:45.067713+0000","last_peered":"2023-07-14T12:53:45.067713+0000","last_clean":"2023-07-14T12:53:45.067713+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T12:53:45.067713+0000","last_undegraded":"2023-07-14T12:53:45.067713+0000","last_fullsized":"2023-07-14T12:53:45.067713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:29:59.270118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.667762+0000","last_change":"2023-07-14T12:53:43.670417+0000","last_active":"2023-07-14T12:53:44.667762+0000","last_peered":"2023-07-14T12:53:44.667762+0000","last_clean":"2023-07-14T12:53:44.667762+0000","last_became_active":"2023-07-14T12:53:43.670168+0000","last_became_peered":"2023-07-14T12:53:43.670168+0000","last_unstale":"2023-07-14T12:53:44.667762+0000","last_undegraded":"2023-07-14T12:53:44.667762+0000","last_fullsized":"2023-07-14T12:53:44.667762+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:27:21.922219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:44.667708+0000","last_change":"2023-07-14T12:53:42.662266+0000","last_active":"2023-07-14T12:53:44.667708+0000","last_peered":"2023-07-14T12:53:44.667708+0000","last_clean":"2023-07-14T12:53:44.667708+0000","last_became_active":"2023-07-14T12:53:42.661972+0000","last_became_peered":"2023-07-14T12:53:42.661972+0000","last_unstale":"2023-07-14T12:53:44.667708+0000","last_undegraded":"2023-07-14T12:53:44.667708+0000","last_fullsized":"2023-07-14T12:53:44.667708+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:45:40.268321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.058989+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T12:53:45.058989+0000","last_peered":"2023-07-14T12:53:45.058989+0000","last_clean":"2023-07-14T12:53:45.058989+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T12:53:45.058989+0000","last_undegraded":"2023-07-14T12:53:45.058989+0000","last_fullsized":"2023-07-14T12:53:45.058989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:45:44.988157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.067543+0000","last_change":"2023-07-14T12:53:43.665177+0000","last_active":"2023-07-14T12:53:45.067543+0000","last_peered":"2023-07-14T12:53:45.067543+0000","last_clean":"2023-07-14T12:53:45.067543+0000","last_became_active":"2023-07-14T12:53:43.664893+0000","last_became_peered":"2023-07-14T12:53:43.664893+0000","last_unstale":"2023-07-14T12:53:45.067543+0000","last_undegraded":"2023-07-14T12:53:45.067543+0000","last_fullsized":"2023-07-14T12:53:45.067543+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:42.626197+0000","last_clean_scrub_stamp":"2023-07-14T12:53:42.626197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:17:02.665455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.065648+0000","last_change":"2023-07-14T12:53:42.651999+0000","last_active":"2023-07-14T12:53:45.065648+0000","last_peered":"2023-07-14T12:53:45.065648+0000","last_clean":"2023-07-14T12:53:45.065648+0000","last_became_active":"2023-07-14T12:53:42.651673+0000","last_became_peered":"2023-07-14T12:53:42.651673+0000","last_unstale":"2023-07-14T12:53:45.065648+0000","last_undegraded":"2023-07-14T12:53:45.065648+0000","last_fullsized":"2023-07-14T12:53:45.065648+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:53:41.617889+0000","last_clean_scrub_stamp":"2023-07-14T12:53:41.617889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:07:40.835216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-14T12:53:45.067702+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T12:53:45.067702+0000","last_peered":"2023-07-14T12:53:45.067702+0000","last_clean":"2023-07-14T12:53:45.067702+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T12:53:45.067702+0000","last_undegraded":"2023-07-14T12:53:45.067702+0000","last_fullsized":"2023-07-14T12:53:45.067702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:23:37.869208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":1032192,"data_stored":767390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.68799999999999994}]},{"osd":1,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.621},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.60599999999999998}]},{"osd":2,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.70299999999999996}]},{"osd":3,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.67400000000000004}]},{"osd":4,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.47999999999999998}]},{"osd":5,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.45100000000000001}]},{"osd":6,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.59099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":175970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.873},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.89100000000000001}]},{"osd":1,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.627},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.745}]},{"osd":2,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.81799999999999995}]},{"osd":3,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.77200000000000002}]},{"osd":4,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.96699999999999997}]},{"osd":5,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.93899999999999995}]},{"osd":7,"last update":"Fri Jul 14 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.79700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":430080,"data_stored":175500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.624},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.69599999999999995}]},{"osd":1,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.66600000000000004}]},{"osd":2,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.68200000000000005}]},{"osd":3,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.50600000000000001}]},{"osd":4,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.71999999999999997}]},{"osd":6,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.64500000000000002}]},{"osd":7,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.751}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":430080,"data_stored":175992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.627}]},{"osd":1,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.65600000000000003}]},{"osd":2,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.70599999999999996}]},{"osd":3,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.71799999999999997}]},{"osd":5,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.52400000000000002}]},{"osd":6,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.67000000000000004}]},{"osd":7,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.60399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":438272,"data_stored":176986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.317},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.44400000000000001}]},{"osd":1,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.746}]},{"osd":5,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.79900000000000004}]},{"osd":6,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.81999999999999995}]},{"osd":7,"last update":"Fri Jul 14 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.82999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":412,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":421888,"data_stored":174439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.377},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.51100000000000001}]},{"osd":1,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.46200000000000002}]},{"osd":3,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.70899999999999996}]},{"osd":5,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.2269999999999999,"5min":2.2269999999999999,"15min":2.2269999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.76100000000000001}]},{"osd":6,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.84399999999999997}]},{"osd":7,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.1669999999999998,"5min":2.1669999999999998,"15min":2.1669999999999998},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.72499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":425984,"data_stored":175478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.39100000000000001}]},{"osd":2,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.44400000000000001}]},{"osd":3,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.52400000000000002}]},{"osd":4,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.69699999999999995}]},{"osd":5,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.62},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.72199999999999998}]},{"osd":6,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.85499999999999998}]},{"osd":7,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.79000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":1015808,"data_stored":764771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.47199999999999998}]},{"osd":2,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.503}]},{"osd":4,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":0.95099999999999996}]},{"osd":5,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.93500000000000005}]},{"osd":6,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.80600000000000005}]},{"osd":7,"last update":"Fri Jul 14 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.90600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T12:53:52.749 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-14T12:53:52.750 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-14T12:53:52.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.909+0000 7f53f9419640 1 Processor -- start 2023-07-14T12:53:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.909+0000 7f53f9419640 1 -- start start 2023-07-14T12:53:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53f9419640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53f40ce500 0x7f53f40b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53f9419640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f40ce980 con 0x7f53f415bcd0 2023-07-14T12:53:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53f9419640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f40d18f0 con 0x7f53f40b4360 2023-07-14T12:53:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53f9419640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f406c570 con 0x7f53f40ce500 2023-07-14T12:53:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53f2ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f53f415bcd0 0x7f53f40b3c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33088/0 (socket says 172.21.15.5:33088) 2023-07-14T12:53:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53f2ffd640 1 -- 172.21.15.5:0/2040343483 learned_addr learned my addr 172.21.15.5:0/2040343483 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:52.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53f27fc640 1 -- 172.21.15.5:0/2040343483 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3614140295 0 0) 0x7f53f40ce980 con 0x7f53f415bcd0 2023-07-14T12:53:52.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53f27fc640 1 -- 172.21.15.5:0/2040343483 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53e0003530 con 0x7f53f415bcd0 2023-07-14T12:53:52.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53ebfff640 1 --2- 172.21.15.5:0/2040343483 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53f40ce500 0x7f53f40b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:52.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53f27fc640 1 -- 172.21.15.5:0/2040343483 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1283122516 0 0) 0x7f53e0003530 con 0x7f53f415bcd0 2023-07-14T12:53:52.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53f27fc640 1 -- 172.21.15.5:0/2040343483 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53f40ce500 msgr2=0x7f53f40b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:52.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53f27fc640 1 --2- 172.21.15.5:0/2040343483 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53f40ce500 0x7f53f40b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:52.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53f27fc640 1 -- 172.21.15.5:0/2040343483 >> v1:172.21.15.154:6789/0 conn(0x7f53f40b4360 legacy=0x7f53f40b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:52.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53f27fc640 1 -- 172.21.15.5:0/2040343483 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f40cc950 con 0x7f53f415bcd0 2023-07-14T12:53:52.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53f27fc640 1 -- 172.21.15.5:0/2040343483 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f53e4001680 con 0x7f53f415bcd0 2023-07-14T12:53:52.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53f27fc640 1 -- 172.21.15.5:0/2040343483 >> v1:172.21.15.5:6789/0 conn(0x7f53f415bcd0 legacy=0x7f53f40b3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:52.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53f27fc640 1 --2- 172.21.15.5:0/2040343483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53e00039b0 0x7f53e0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:52.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53f27fc640 1 --2- 172.21.15.5:0/2040343483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53e00047d0 0x7f53e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:52.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53f27fc640 1 --2- 172.21.15.5:0/2040343483 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53e0005180 0x7f53e000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:52.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53f27fc640 1 -- 172.21.15.5:0/2040343483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f406c570 con 0x7f53e00047d0 2023-07-14T12:53:52.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53f27fc640 1 -- 172.21.15.5:0/2040343483 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e000bed0 con 0x7f53e00039b0 2023-07-14T12:53:52.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53f27fc640 1 -- 172.21.15.5:0/2040343483 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e000c090 con 0x7f53e0005180 2023-07-14T12:53:52.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53ebfff640 1 --2- 172.21.15.5:0/2040343483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53e00047d0 0x7f53e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:52.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53f2ffd640 1 --2- 172.21.15.5:0/2040343483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53e00039b0 0x7f53e0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:52.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53f37fe640 1 --2- 172.21.15.5:0/2040343483 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53e0005180 0x7f53e000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:52.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53ebfff640 1 -- 172.21.15.5:0/2040343483 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53e0005180 msgr2=0x7f53e000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:52.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53ebfff640 1 --2- 172.21.15.5:0/2040343483 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53e0005180 0x7f53e000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:52.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53ebfff640 1 -- 172.21.15.5:0/2040343483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53e00039b0 msgr2=0x7f53e0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:52.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53ebfff640 1 --2- 172.21.15.5:0/2040343483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53e00039b0 0x7f53e0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:52.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.913+0000 7f53ebfff640 1 -- 172.21.15.5:0/2040343483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e0003530 con 0x7f53e00047d0 2023-07-14T12:53:52.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.917+0000 7f53ebfff640 1 --2- 172.21.15.5:0/2040343483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53e00047d0 0x7f53e0004c40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f53dc009ae0 tx=0x7f53dc01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2ed1236e8e61d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:52.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.917+0000 7f53f27fc640 1 -- 172.21.15.5:0/2040343483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f40cd120 con 0x7f53e00047d0 2023-07-14T12:53:52.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.917+0000 7f53f27fc640 1 -- 172.21.15.5:0/2040343483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53dc0a5610 con 0x7f53e00047d0 2023-07-14T12:53:52.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.917+0000 7f53f27fc640 1 -- 172.21.15.5:0/2040343483 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc0a59c0 con 0x7f53e00047d0 2023-07-14T12:53:52.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.917+0000 7f53f9419640 1 -- 172.21.15.5:0/2040343483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53e00047d0 msgr2=0x7f53e0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:52.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.917+0000 7f53f9419640 1 --2- 172.21.15.5:0/2040343483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53e00047d0 0x7f53e0004c40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f53dc009ae0 tx=0x7f53dc01ca20 comp rx=0 tx=0).stop 2023-07-14T12:53:52.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.917+0000 7f53f37fe640 1 -- 172.21.15.5:0/2040343483 reap_dead start 2023-07-14T12:53:52.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.917+0000 7f53f9419640 1 -- 172.21.15.5:0/2040343483 shutdown_connections 2023-07-14T12:53:52.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.917+0000 7f53f9419640 1 -- 172.21.15.5:0/2040343483 >> 172.21.15.5:0/2040343483 conn(0x7f53f406ab10 msgr2=0x7f53f40cec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:52.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.917+0000 7f53f9419640 1 -- 172.21.15.5:0/2040343483 shutdown_connections 2023-07-14T12:53:52.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.917+0000 7f53f9419640 1 -- 172.21.15.5:0/2040343483 wait complete. 2023-07-14T12:53:52.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.917+0000 7f53f9419640 1 Processor -- start 2023-07-14T12:53:52.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.917+0000 7f53f9419640 1 -- start start 2023-07-14T12:53:52.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.921+0000 7f53f9419640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53e00047d0 0x7f53f4165050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:52.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.921+0000 7f53f9419640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53f4154b60 0x7f53f415c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:52.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.921+0000 7f53f9419640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53f4155090 0x7f53f4153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:52.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.921+0000 7f53f9419640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f415fa60 con 0x7f53e00047d0 2023-07-14T12:53:52.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.921+0000 7f53f9419640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f40b3430 con 0x7f53f4154b60 2023-07-14T12:53:52.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.921+0000 7f53f9419640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f40b2e70 con 0x7f53f4155090 2023-07-14T12:53:52.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.921+0000 7f53f2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53e00047d0 0x7f53f4165050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:52.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.921+0000 7f53f2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53e00047d0 0x7f53f4165050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38710/0 (socket says 172.21.15.5:38710) 2023-07-14T12:53:52.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.921+0000 7f53f2ffd640 1 -- 172.21.15.5:0/750632852 learned_addr learned my addr 172.21.15.5:0/750632852 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:52.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.921+0000 7f53ebfff640 1 --2- 172.21.15.5:0/750632852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53f4154b60 0x7f53f415c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:52.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.921+0000 7f53f37fe640 1 --2- 172.21.15.5:0/750632852 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53f4155090 0x7f53f4153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:52.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.921+0000 7f53f2ffd640 1 -- 172.21.15.5:0/750632852 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53f4155090 msgr2=0x7f53f4153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:52.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.921+0000 7f53f2ffd640 1 --2- 172.21.15.5:0/750632852 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53f4155090 0x7f53f4153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:52.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.921+0000 7f53f2ffd640 1 -- 172.21.15.5:0/750632852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53f4154b60 msgr2=0x7f53f415c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:52.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.921+0000 7f53f2ffd640 1 --2- 172.21.15.5:0/750632852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53f4154b60 0x7f53f415c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:52.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.921+0000 7f53f2ffd640 1 -- 172.21.15.5:0/750632852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f40b3150 con 0x7f53e00047d0 2023-07-14T12:53:52.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.921+0000 7f53f37fe640 1 --2- 172.21.15.5:0/750632852 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53f4155090 0x7f53f4153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:52.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.921+0000 7f53f2ffd640 1 --2- 172.21.15.5:0/750632852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53e00047d0 0x7f53f4165050 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f53e4000fc0 tx=0x7f53e40077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:52.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.921+0000 7f53eb7fe640 1 -- 172.21.15.5:0/750632852 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e400f930 con 0x7f53e00047d0 2023-07-14T12:53:52.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.921+0000 7f53eb7fe640 1 -- 172.21.15.5:0/750632852 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e400fab0 con 0x7f53e00047d0 2023-07-14T12:53:52.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.921+0000 7f53f9419640 1 -- 172.21.15.5:0/750632852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f415f680 con 0x7f53e00047d0 2023-07-14T12:53:52.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.921+0000 7f53eb7fe640 1 -- 172.21.15.5:0/750632852 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e400fe60 con 0x7f53e00047d0 2023-07-14T12:53:52.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.921+0000 7f53f9419640 1 -- 172.21.15.5:0/750632852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f4165590 con 0x7f53e00047d0 2023-07-14T12:53:52.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.921+0000 7f53f9419640 1 -- 172.21.15.5:0/750632852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f4165780 con 0x7f53e00047d0 2023-07-14T12:53:52.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.925+0000 7f53eb7fe640 1 -- 172.21.15.5:0/750632852 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f53e401d460 con 0x7f53e00047d0 2023-07-14T12:53:52.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.925+0000 7f53eb7fe640 1 --2- 172.21.15.5:0/750632852 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f53d4066280 0x7f53d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:52.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.925+0000 7f53eb7fe640 1 -- 172.21.15.5:0/750632852 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f53e4083f00 con 0x7f53e00047d0 2023-07-14T12:53:52.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.925+0000 7f53ebfff640 1 --2- 172.21.15.5:0/750632852 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f53d4066280 0x7f53d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:52.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.925+0000 7f53ebfff640 1 --2- 172.21.15.5:0/750632852 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f53d4066280 0x7f53d4068730 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f53dc009ae0 tx=0x7f53dc0046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:52.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:52.929+0000 7f53eb7fe640 1 -- 172.21.15.5:0/750632852 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f53f4165780 con 0x7f53e00047d0 2023-07-14T12:53:53.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.137+0000 7f53f9419640 1 -- 172.21.15.5:0/750632852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f53f4165780 con 0x7f53e00047d0 2023-07-14T12:53:53.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.145+0000 7f53eb7fe640 1 -- 172.21.15.5:0/750632852 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f53f4165780 con 0x7f53e00047d0 2023-07-14T12:53:53.172 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-07-14T12:53:53.172 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDkRLFkCav/DhAA6SOiONAbTcWCnUZXcm7BcQ== 2023-07-14T12:53:53.172 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2023-07-14T12:53:53.173 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2023-07-14T12:53:53.173 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-14T12:53:53.173 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2023-07-14T12:53:53.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.145+0000 7f53f9419640 1 -- 172.21.15.5:0/750632852 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f53d4066280 msgr2=0x7f53d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:53.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.145+0000 7f53f9419640 1 --2- 172.21.15.5:0/750632852 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f53d4066280 0x7f53d4068730 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f53dc009ae0 tx=0x7f53dc0046d0 comp rx=0 tx=0).stop 2023-07-14T12:53:53.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.145+0000 7f53f9419640 1 -- 172.21.15.5:0/750632852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53e00047d0 msgr2=0x7f53f4165050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:53.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.145+0000 7f53f9419640 1 --2- 172.21.15.5:0/750632852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53e00047d0 0x7f53f4165050 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f53e4000fc0 tx=0x7f53e40077a0 comp rx=0 tx=0).stop 2023-07-14T12:53:53.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.145+0000 7f53f9419640 1 -- 172.21.15.5:0/750632852 shutdown_connections 2023-07-14T12:53:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.145+0000 7f53f9419640 1 --2- 172.21.15.5:0/750632852 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53f4155090 0x7f53f4153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.145+0000 7f53f9419640 1 --2- 172.21.15.5:0/750632852 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f53d4066280 0x7f53d4068730 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.145+0000 7f53f9419640 1 --2- 172.21.15.5:0/750632852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53f4154b60 0x7f53f415c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.145+0000 7f53f9419640 1 --2- 172.21.15.5:0/750632852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53e00047d0 0x7f53f4165050 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.145+0000 7f53f9419640 1 -- 172.21.15.5:0/750632852 >> 172.21.15.5:0/750632852 conn(0x7f53f406ab10 msgr2=0x7f53f4166c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.145+0000 7f53f9419640 1 -- 172.21.15.5:0/750632852 shutdown_connections 2023-07-14T12:53:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.145+0000 7f53f9419640 1 -- 172.21.15.5:0/750632852 wait complete. 2023-07-14T12:53:53.193 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:53:53.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.309+0000 7f9fab40b640 1 Processor -- start 2023-07-14T12:53:53.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.309+0000 7f9fab40b640 1 -- start start 2023-07-14T12:53:53.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.309+0000 7f9fab40b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9fa40c8ad0 0x7f9fa40c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:53.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.309+0000 7f9fab40b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa40c99c0 con 0x7f9fa40c9560 2023-07-14T12:53:53.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.309+0000 7f9fab40b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa40cc700 con 0x7f9fa4158ce0 2023-07-14T12:53:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.309+0000 7f9fab40b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa40b0ff0 con 0x7f9fa40c8ad0 2023-07-14T12:53:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.309+0000 7f9fa89a6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9fa40c8ad0 0x7f9fa40c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.309+0000 7f9fa89a6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9fa40c8ad0 0x7f9fa40c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38714/0 (socket says 172.21.15.5:38714) 2023-07-14T12:53:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.309+0000 7f9fa89a6640 1 -- 172.21.15.5:0/1379767328 learned_addr learned my addr 172.21.15.5:0/1379767328 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.309+0000 7f9fa89a6640 1 -- 172.21.15.5:0/1379767328 >> v1:172.21.15.154:6789/0 conn(0x7f9fa4158ce0 legacy=0x7f9fa4070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.309+0000 7f9fa89a6640 1 -- 172.21.15.5:0/1379767328 >> v1:172.21.15.5:6789/0 conn(0x7f9fa40c9560 legacy=0x7f9fa40ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.309+0000 7f9fa89a6640 1 -- 172.21.15.5:0/1379767328 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa4070c80 con 0x7f9fa40c8ad0 2023-07-14T12:53:53.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.313+0000 7f9fa89a6640 1 --2- 172.21.15.5:0/1379767328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa40c8ad0 0x7f9fa40c9020 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9f94009870 tx=0x7f9f9401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5dca142786ae37 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:53.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.313+0000 7f9f9bfff640 1 -- 172.21.15.5:0/1379767328 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f940ab5f0 con 0x7f9fa40c8ad0 2023-07-14T12:53:53.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.313+0000 7f9f9bfff640 1 -- 172.21.15.5:0/1379767328 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f940ab750 con 0x7f9fa40c8ad0 2023-07-14T12:53:53.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.313+0000 7f9f9bfff640 1 -- 172.21.15.5:0/1379767328 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f940abae0 con 0x7f9fa40c8ad0 2023-07-14T12:53:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.313+0000 7f9fab40b640 1 -- 172.21.15.5:0/1379767328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa40c8ad0 msgr2=0x7f9fa40c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.313+0000 7f9fab40b640 1 --2- 172.21.15.5:0/1379767328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa40c8ad0 0x7f9fa40c9020 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9f94009870 tx=0x7f9f9401c3f0 comp rx=0 tx=0).stop 2023-07-14T12:53:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.313+0000 7f9fab40b640 1 -- 172.21.15.5:0/1379767328 shutdown_connections 2023-07-14T12:53:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.313+0000 7f9fab40b640 1 --2- 172.21.15.5:0/1379767328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa40c8ad0 0x7f9fa40c9020 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.313+0000 7f9fab40b640 1 -- 172.21.15.5:0/1379767328 >> 172.21.15.5:0/1379767328 conn(0x7f9fa40afcf0 msgr2=0x7f9fa40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.313+0000 7f9fab40b640 1 -- 172.21.15.5:0/1379767328 shutdown_connections 2023-07-14T12:53:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.313+0000 7f9fab40b640 1 -- 172.21.15.5:0/1379767328 wait complete. 2023-07-14T12:53:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.317+0000 7f9fab40b640 1 Processor -- start 2023-07-14T12:53:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.317+0000 7f9fab40b640 1 -- start start 2023-07-14T12:53:53.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.317+0000 7f9fab40b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa40c8ad0 0x7f9fa4143540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.317+0000 7f9fab40b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa40c9560 0x7f9fa4144380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.317+0000 7f9fab40b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fa4158ce0 0x7f9fa41448c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.317+0000 7f9fab40b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa414e420 con 0x7f9fa40c9560 2023-07-14T12:53:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.317+0000 7f9fab40b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa414daf0 con 0x7f9fa4158ce0 2023-07-14T12:53:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.317+0000 7f9fab40b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa414ddd0 con 0x7f9fa40c8ad0 2023-07-14T12:53:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.317+0000 7f9fa89a6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa40c9560 0x7f9fa4144380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.317+0000 7f9fa89a6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa40c9560 0x7f9fa4144380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38728/0 (socket says 172.21.15.5:38728) 2023-07-14T12:53:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.317+0000 7f9fa89a6640 1 -- 172.21.15.5:0/1919824955 learned_addr learned my addr 172.21.15.5:0/1919824955 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:53.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.317+0000 7f9fa99a8640 1 --2- 172.21.15.5:0/1919824955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fa4158ce0 0x7f9fa41448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:53.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.317+0000 7f9fa91a7640 1 --2- 172.21.15.5:0/1919824955 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa40c8ad0 0x7f9fa4143540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:53.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.317+0000 7f9fa89a6640 1 -- 172.21.15.5:0/1919824955 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa40c8ad0 msgr2=0x7f9fa4143540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:53.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.317+0000 7f9fa89a6640 1 --2- 172.21.15.5:0/1919824955 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa40c8ad0 0x7f9fa4143540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:53.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.317+0000 7f9fa89a6640 1 -- 172.21.15.5:0/1919824955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fa4158ce0 msgr2=0x7f9fa41448c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:53.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.317+0000 7f9fa89a6640 1 --2- 172.21.15.5:0/1919824955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fa4158ce0 0x7f9fa41448c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:53.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.317+0000 7f9fa89a6640 1 -- 172.21.15.5:0/1919824955 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f940094d0 con 0x7f9fa40c9560 2023-07-14T12:53:53.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.317+0000 7f9fa91a7640 1 --2- 172.21.15.5:0/1919824955 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa40c8ad0 0x7f9fa4143540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:53.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.317+0000 7f9fa89a6640 1 --2- 172.21.15.5:0/1919824955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa40c9560 0x7f9fa4144380 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9f94019000 tx=0x7f9f9401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:53.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.317+0000 7f9f99ffb640 1 -- 172.21.15.5:0/1919824955 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f940b4800 con 0x7f9fa40c9560 2023-07-14T12:53:53.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.317+0000 7f9f99ffb640 1 -- 172.21.15.5:0/1919824955 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f940b4980 con 0x7f9fa40c9560 2023-07-14T12:53:53.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.317+0000 7f9f99ffb640 1 -- 172.21.15.5:0/1919824955 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f940b4d30 con 0x7f9fa40c9560 2023-07-14T12:53:53.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.317+0000 7f9fab40b640 1 -- 172.21.15.5:0/1919824955 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa414e0b0 con 0x7f9fa40c9560 2023-07-14T12:53:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.321+0000 7f9fab40b640 1 -- 172.21.15.5:0/1919824955 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa414e8b0 con 0x7f9fa40c9560 2023-07-14T12:53:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.321+0000 7f9fab40b640 1 -- 172.21.15.5:0/1919824955 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa40ca1a0 con 0x7f9fa40c9560 2023-07-14T12:53:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.321+0000 7f9f99ffb640 1 -- 172.21.15.5:0/1919824955 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9f940c7440 con 0x7f9fa40c9560 2023-07-14T12:53:53.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.321+0000 7f9f99ffb640 1 --2- 172.21.15.5:0/1919824955 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9f880662b0 0x7f9f88068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.321+0000 7f9f99ffb640 1 -- 172.21.15.5:0/1919824955 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9f940a8050 con 0x7f9fa40c9560 2023-07-14T12:53:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.321+0000 7f9fa91a7640 1 --2- 172.21.15.5:0/1919824955 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9f880662b0 0x7f9f88068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:53.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.321+0000 7f9fa91a7640 1 --2- 172.21.15.5:0/1919824955 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9f880662b0 0x7f9f88068760 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0000f70 tx=0x7f9fa0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:53.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.325+0000 7f9f99ffb640 1 -- 172.21.15.5:0/1919824955 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9f940ebbe0 con 0x7f9fa40c9560 2023-07-14T12:53:53.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.509+0000 7f9fab40b640 1 -- 172.21.15.5:0/1919824955 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9fa414e240 con 0x7f9fa40c9560 2023-07-14T12:53:53.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.509+0000 7f9f99ffb640 1 -- 172.21.15.5:0/1919824955 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4706 (secure 0 0 0) 0x7f9f940ab5b0 con 0x7f9fa40c9560 2023-07-14T12:53:53.540 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T12:53:53.541 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1121417572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1121417572},{"type":"v1","addr":"172.21.15.5:6833","nonce":1121417572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/1826988320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1826988320},{"type":"v1","addr":"172.21.15.154:6836","nonce":1826988320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5074,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3683900517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3683900517},{"type":"v1","addr":"172.21.15.154:6837","nonce":3683900517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T12:53:43.186604+0000","modified":"2023-07-14T12:53:46.672007+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5133},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5133":{"gid":5133,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6835/601029596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":601029596},{"type":"v1","addr":"172.21.15.5:6835","nonce":601029596}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-14T12:53:53.542 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 16 2023-07-14T12:53:53.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.513+0000 7f9fab40b640 1 -- 172.21.15.5:0/1919824955 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9f880662b0 msgr2=0x7f9f88068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:53.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.513+0000 7f9fab40b640 1 --2- 172.21.15.5:0/1919824955 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9f880662b0 0x7f9f88068760 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0000f70 tx=0x7f9fa0009040 comp rx=0 tx=0).stop 2023-07-14T12:53:53.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.513+0000 7f9fab40b640 1 -- 172.21.15.5:0/1919824955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa40c9560 msgr2=0x7f9fa4144380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:53.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.513+0000 7f9fab40b640 1 --2- 172.21.15.5:0/1919824955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa40c9560 0x7f9fa4144380 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9f94019000 tx=0x7f9f9401ac30 comp rx=0 tx=0).stop 2023-07-14T12:53:53.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.513+0000 7f9fab40b640 1 -- 172.21.15.5:0/1919824955 shutdown_connections 2023-07-14T12:53:53.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.513+0000 7f9fab40b640 1 --2- 172.21.15.5:0/1919824955 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f9f880662b0 0x7f9f88068760 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:53.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.513+0000 7f9fab40b640 1 --2- 172.21.15.5:0/1919824955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fa4158ce0 0x7f9fa41448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:53.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.513+0000 7f9fab40b640 1 --2- 172.21.15.5:0/1919824955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa40c9560 0x7f9fa4144380 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:53.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.513+0000 7f9fab40b640 1 --2- 172.21.15.5:0/1919824955 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fa40c8ad0 0x7f9fa4143540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:53.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.513+0000 7f9fab40b640 1 -- 172.21.15.5:0/1919824955 >> 172.21.15.5:0/1919824955 conn(0x7f9fa40afcf0 msgr2=0x7f9fa406ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:53.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.513+0000 7f9fab40b640 1 -- 172.21.15.5:0/1919824955 shutdown_connections 2023-07-14T12:53:53.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:53.513+0000 7f9fab40b640 1 -- 172.21.15.5:0/1919824955 wait complete. 2023-07-14T12:53:53.963 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-14T12:53:43.186604+0000', 'modified': '2023-07-14T12:53:46.672007+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5133}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5133': {'gid': 5133, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.5:6835/601029596', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6834', 'nonce': 601029596}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 601029596}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-14T12:53:53.963 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-14T12:53:53.964 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-14T12:53:54.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.085+0000 7f94ddffa640 1 Processor -- start 2023-07-14T12:53:54.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.085+0000 7f94ddffa640 1 -- start start 2023-07-14T12:53:54.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.085+0000 7f94ddffa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f94d813ed20 0x7f94d806a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:54.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.085+0000 7f94ddffa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f94d806c430 0x7f94d813f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:54.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.085+0000 7f94ddffa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d806add0 con 0x7f94d806de30 2023-07-14T12:53:54.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.085+0000 7f94ddffa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d806a470 con 0x7f94d813ed20 2023-07-14T12:53:54.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.085+0000 7f94ddffa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d80697f0 con 0x7f94d806c430 2023-07-14T12:53:54.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.085+0000 7f94d77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f94d813ed20 0x7f94d806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:54.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.085+0000 7f94d77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f94d813ed20 0x7f94d806a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38744/0 (socket says 172.21.15.5:38744) 2023-07-14T12:53:54.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.085+0000 7f94d77fe640 1 -- 172.21.15.5:0/204798401 learned_addr learned my addr 172.21.15.5:0/204798401 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:54.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.085+0000 7f94d7fff640 1 --2- 172.21.15.5:0/204798401 >> v2:172.21.15.154:3300/0 conn(0x7f94d806c430 0x7f94d813f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:54.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.085+0000 7f94d77fe640 1 -- 172.21.15.5:0/204798401 >> v2:172.21.15.154:3300/0 conn(0x7f94d806c430 msgr2=0x7f94d813f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:54.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.085+0000 7f94d77fe640 1 --2- 172.21.15.5:0/204798401 >> v2:172.21.15.154:3300/0 conn(0x7f94d806c430 0x7f94d813f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.085+0000 7f94d77fe640 1 -- 172.21.15.5:0/204798401 >> v1:172.21.15.154:6789/0 conn(0x7f94d806de30 legacy=0x7f94d806bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:54.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.085+0000 7f94d77fe640 1 -- 172.21.15.5:0/204798401 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d8069ad0 con 0x7f94d813ed20 2023-07-14T12:53:54.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.089+0000 7f94d77fe640 1 --2- 172.21.15.5:0/204798401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94d813ed20 0x7f94d806a890 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f94d8153380 tx=0x7f94c801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c8997ca8876a75 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:54.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.089+0000 7f94d67fc640 1 -- 172.21.15.5:0/204798401 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c80a7070 con 0x7f94d813ed20 2023-07-14T12:53:54.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.089+0000 7f94d67fc640 1 -- 172.21.15.5:0/204798401 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c80ab430 con 0x7f94d813ed20 2023-07-14T12:53:54.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.089+0000 7f94d67fc640 1 -- 172.21.15.5:0/204798401 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c80ab7c0 con 0x7f94d813ed20 2023-07-14T12:53:54.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.089+0000 7f94ddffa640 1 -- 172.21.15.5:0/204798401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94d813ed20 msgr2=0x7f94d806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:54.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.089+0000 7f94ddffa640 1 --2- 172.21.15.5:0/204798401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94d813ed20 0x7f94d806a890 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f94d8153380 tx=0x7f94c801c430 comp rx=0 tx=0).stop 2023-07-14T12:53:54.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.089+0000 7f94ddffa640 1 -- 172.21.15.5:0/204798401 shutdown_connections 2023-07-14T12:53:54.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.089+0000 7f94ddffa640 1 --2- 172.21.15.5:0/204798401 >> v2:172.21.15.154:3300/0 conn(0x7f94d806c430 0x7f94d813f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.089+0000 7f94ddffa640 1 --2- 172.21.15.5:0/204798401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94d813ed20 0x7f94d806a890 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.089+0000 7f94ddffa640 1 -- 172.21.15.5:0/204798401 >> 172.21.15.5:0/204798401 conn(0x7f94d80b1300 msgr2=0x7f94d80ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:54.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.089+0000 7f94ddffa640 1 -- 172.21.15.5:0/204798401 shutdown_connections 2023-07-14T12:53:54.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.089+0000 7f94ddffa640 1 -- 172.21.15.5:0/204798401 wait complete. 2023-07-14T12:53:54.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.093+0000 7f94ddffa640 1 Processor -- start 2023-07-14T12:53:54.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.093+0000 7f94ddffa640 1 -- start start 2023-07-14T12:53:54.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.093+0000 7f94ddffa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94d806c430 0x7f94d813e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:54.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.093+0000 7f94ddffa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94d806de30 0x7f94d80ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:54.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.093+0000 7f94ddffa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94d813ed20 0x7f94d80ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:54.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.093+0000 7f94ddffa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d80cd1a0 con 0x7f94d806de30 2023-07-14T12:53:54.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.093+0000 7f94ddffa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d80cc260 con 0x7f94d813ed20 2023-07-14T12:53:54.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.093+0000 7f94ddffa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d81597e0 con 0x7f94d806c430 2023-07-14T12:53:54.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.093+0000 7f94d6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94d806de30 0x7f94d80ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:54.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.093+0000 7f94d6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94d806de30 0x7f94d80ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38750/0 (socket says 172.21.15.5:38750) 2023-07-14T12:53:54.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.093+0000 7f94d6ffd640 1 -- 172.21.15.5:0/4283383791 learned_addr learned my addr 172.21.15.5:0/4283383791 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:54.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.093+0000 7f94d77fe640 1 --2- 172.21.15.5:0/4283383791 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94d806c430 0x7f94d813e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:54.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.093+0000 7f94d7fff640 1 --2- 172.21.15.5:0/4283383791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94d813ed20 0x7f94d80ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:54.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.093+0000 7f94d6ffd640 1 -- 172.21.15.5:0/4283383791 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94d806c430 msgr2=0x7f94d813e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:54.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.093+0000 7f94d6ffd640 1 --2- 172.21.15.5:0/4283383791 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94d806c430 0x7f94d813e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.093+0000 7f94d6ffd640 1 -- 172.21.15.5:0/4283383791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94d813ed20 msgr2=0x7f94d80ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:54.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.093+0000 7f94d6ffd640 1 --2- 172.21.15.5:0/4283383791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94d813ed20 0x7f94d80ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.093+0000 7f94d6ffd640 1 -- 172.21.15.5:0/4283383791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c80094d0 con 0x7f94d806de30 2023-07-14T12:53:54.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.093+0000 7f94d7fff640 1 --2- 172.21.15.5:0/4283383791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94d813ed20 0x7f94d80ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:54.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.093+0000 7f94d6ffd640 1 --2- 172.21.15.5:0/4283383791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94d806de30 0x7f94d80ac8e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f94cc00b410 tx=0x7f94cc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:54.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.093+0000 7f94bffff640 1 -- 172.21.15.5:0/4283383791 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc004020 con 0x7f94d806de30 2023-07-14T12:53:54.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.093+0000 7f94bffff640 1 -- 172.21.15.5:0/4283383791 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94cc004180 con 0x7f94d806de30 2023-07-14T12:53:54.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.093+0000 7f94bffff640 1 -- 172.21.15.5:0/4283383791 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc011630 con 0x7f94d806de30 2023-07-14T12:53:54.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.093+0000 7f94ddffa640 1 -- 172.21.15.5:0/4283383791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d80cb4a0 con 0x7f94d806de30 2023-07-14T12:53:54.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.093+0000 7f94ddffa640 1 -- 172.21.15.5:0/4283383791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d80cba60 con 0x7f94d806de30 2023-07-14T12:53:54.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.097+0000 7f94bffff640 1 -- 172.21.15.5:0/4283383791 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f94cc011790 con 0x7f94d806de30 2023-07-14T12:53:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.097+0000 7f94bffff640 1 --2- 172.21.15.5:0/4283383791 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f94c40662d0 0x7f94c4068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.097+0000 7f94bffff640 1 -- 172.21.15.5:0/4283383791 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f94cc083a20 con 0x7f94d806de30 2023-07-14T12:53:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.097+0000 7f94e1360000 1 Processor -- start 2023-07-14T12:53:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.097+0000 7f94e1360000 1 -- start start 2023-07-14T12:53:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.097+0000 7f94d77fe640 1 --2- 172.21.15.5:0/4283383791 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f94c40662d0 0x7f94c4068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:54.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94d77fe640 1 --2- 172.21.15.5:0/4283383791 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f94c40662d0 0x7f94c4068780 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f94c80af000 tx=0x7f94c8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:54.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94e1360000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca24ffdf80 0x55ca24ffe350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:54.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94e1360000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ca24ffe890 0x55ca24fb43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:54.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94e1360000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24fb4930 0x55ca24fb4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:54.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94e1360000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca24e7b900 con 0x55ca24fb4930 2023-07-14T12:53:54.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94e1360000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca24db58c0 con 0x55ca24ffdf80 2023-07-14T12:53:54.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94e1360000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca24e09360 con 0x55ca24ffe890 2023-07-14T12:53:54.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94d7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24fb4930 0x55ca24fb4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:54.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94d7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24fb4930 0x55ca24fb4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38760/0 (socket says 172.21.15.5:38760) 2023-07-14T12:53:54.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94d7fff640 1 -- 172.21.15.5:0/1454222616 learned_addr learned my addr 172.21.15.5:0/1454222616 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:54.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94d77fe640 1 --2- 172.21.15.5:0/1454222616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca24ffdf80 0x55ca24ffe350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:54.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94d6ffd640 1 --2- 172.21.15.5:0/1454222616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ca24ffe890 0x55ca24fb43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:54.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94d7fff640 1 -- 172.21.15.5:0/1454222616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ca24ffe890 msgr2=0x55ca24fb43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:54.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94d7fff640 1 --2- 172.21.15.5:0/1454222616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ca24ffe890 0x55ca24fb43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94d7fff640 1 -- 172.21.15.5:0/1454222616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca24ffdf80 msgr2=0x55ca24ffe350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:54.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94d7fff640 1 --2- 172.21.15.5:0/1454222616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca24ffdf80 0x55ca24ffe350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94d7fff640 1 -- 172.21.15.5:0/1454222616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca24afe890 con 0x55ca24fb4930 2023-07-14T12:53:54.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94d7fff640 1 --2- 172.21.15.5:0/1454222616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24fb4930 0x55ca24fb4d00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f94d00073e0 tx=0x7f94d00078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c825c0cd2cb9e6e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:54.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94bd7fa640 1 -- 172.21.15.5:0/1454222616 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d00147e0 con 0x55ca24fb4930 2023-07-14T12:53:54.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94bd7fa640 1 -- 172.21.15.5:0/1454222616 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d000f050 con 0x55ca24fb4930 2023-07-14T12:53:54.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94bd7fa640 1 -- 172.21.15.5:0/1454222616 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0014b80 con 0x55ca24fb4930 2023-07-14T12:53:54.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94e1360000 1 -- 172.21.15.5:0/1454222616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24fb4930 msgr2=0x55ca24fb4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:54.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94e1360000 1 --2- 172.21.15.5:0/1454222616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24fb4930 0x55ca24fb4d00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f94d00073e0 tx=0x7f94d00078a0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94e1360000 1 -- 172.21.15.5:0/1454222616 shutdown_connections 2023-07-14T12:53:54.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94e1360000 1 --2- 172.21.15.5:0/1454222616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24fb4930 0x55ca24fb4d00 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94e1360000 1 --2- 172.21.15.5:0/1454222616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ca24ffe890 0x55ca24fb43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94e1360000 1 --2- 172.21.15.5:0/1454222616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca24ffdf80 0x55ca24ffe350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94e1360000 1 -- 172.21.15.5:0/1454222616 >> 172.21.15.5:0/1454222616 conn(0x55ca24fbaa90 msgr2=0x55ca24fb2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94e1360000 1 -- 172.21.15.5:0/1454222616 shutdown_connections 2023-07-14T12:53:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94e1360000 1 -- 172.21.15.5:0/1454222616 wait complete. 2023-07-14T12:53:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94e1360000 1 -- start start 2023-07-14T12:53:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.101+0000 7f94e1360000 1 Processor -- start 2023-07-14T12:53:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94e1360000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca24fb4930 0x55ca250050b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94e1360000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24ffdf80 0x55ca250055f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94e1360000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ca24ffe890 0x55ca24fbf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94e1360000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca24e02400 con 0x55ca24ffdf80 2023-07-14T12:53:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94e1360000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca24dbeb60 con 0x55ca24fb4930 2023-07-14T12:53:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94e1360000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca24dbe800 con 0x55ca24ffe890 2023-07-14T12:53:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94e1360000 10 client.0 _ll_register_callbacks cb 0x55ca24fa02c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:53:54.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94d6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24ffdf80 0x55ca250055f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:54.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94d77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca24fb4930 0x55ca250050b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:54.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94d6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24ffdf80 0x55ca250055f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38776/0 (socket says 172.21.15.5:38776) 2023-07-14T12:53:54.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94d6ffd640 1 -- 172.21.15.5:0/3757947915 learned_addr learned my addr 172.21.15.5:0/3757947915 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:54.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94d7fff640 1 --2- 172.21.15.5:0/3757947915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ca24ffe890 0x55ca24fbf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:54.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94d6ffd640 1 -- 172.21.15.5:0/3757947915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ca24ffe890 msgr2=0x55ca24fbf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:54.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94d6ffd640 1 --2- 172.21.15.5:0/3757947915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ca24ffe890 0x55ca24fbf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94d6ffd640 1 -- 172.21.15.5:0/3757947915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca24fb4930 msgr2=0x55ca250050b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94d6ffd640 1 --2- 172.21.15.5:0/3757947915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca24fb4930 0x55ca250050b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94d6ffd640 1 -- 172.21.15.5:0/3757947915 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d0009ce0 con 0x55ca24ffdf80 2023-07-14T12:53:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94d77fe640 1 --2- 172.21.15.5:0/3757947915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca24fb4930 0x55ca250050b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:53:54.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94d6ffd640 1 --2- 172.21.15.5:0/3757947915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24ffdf80 0x55ca250055f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f94cc054ad0 tx=0x7f94cc052ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c1add385f33772 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:54.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-07-14T12:53:54.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94b67fc640 1 -- 172.21.15.5:0/3757947915 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc081070 con 0x55ca24ffdf80 2023-07-14T12:53:54.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94e1360000 1 -- 172.21.15.5:0/3757947915 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca24dc9aa0 con 0x55ca24ffdf80 2023-07-14T12:53:54.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94b67fc640 1 -- 172.21.15.5:0/3757947915 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f94cc050930 con 0x55ca24ffdf80 2023-07-14T12:53:54.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94b67fc640 1 -- 172.21.15.5:0/3757947915 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94cc06c300 con 0x55ca24ffdf80 2023-07-14T12:53:54.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94e1360000 10 client.5343 fetch_fsmap learned FSMap version 16 2023-07-14T12:53:54.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94e1360000 1 -- 172.21.15.5:0/3757947915 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55ca24dc6d90 con 0x55ca24ffdf80 2023-07-14T12:53:54.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94b67fc640 1 -- 172.21.15.5:0/3757947915 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ca24dc9aa0 con 0x55ca24ffdf80 2023-07-14T12:53:54.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94b67fc640 1 -- 172.21.15.5:0/3757947915 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f94cc050af0 con 0x55ca24ffdf80 2023-07-14T12:53:54.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94e1360000 10 client.5343 fetch_fsmap finished waiting for FSMap version 16 2023-07-14T12:53:54.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94e1360000 10 client.5343 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T12:53:54.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94e1360000 20 client.5343 populate_metadata read hostname 'smithi005' 2023-07-14T12:53:54.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94e1360000 1 --2- 172.21.15.5:0/3757947915 >> [v2:172.21.15.5:6834/601029596,v1:172.21.15.5:6835/601029596] conn(0x55ca24fc0310 0x55ca24fc06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:54.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94e1360000 4 client.5343 mds_command: new command op to 5133 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T12:53:54.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94e1360000 1 -- 172.21.15.5:0/3757947915 --> [v2:172.21.15.5:6834/601029596,v1:172.21.15.5:6835/601029596] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ca24e30f40 con 0x55ca24fc0310 2023-07-14T12:53:54.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94d77fe640 1 --2- 172.21.15.5:0/3757947915 >> [v2:172.21.15.5:6834/601029596,v1:172.21.15.5:6835/601029596] conn(0x55ca24fc0310 0x55ca24fc06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:54.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94d77fe640 1 --2- 172.21.15.5:0/3757947915 >> [v2:172.21.15.5:6834/601029596,v1:172.21.15.5:6835/601029596] conn(0x55ca24fc0310 0x55ca24fc06e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47ebddc37caa7562 server_cookie=419461ebe3011a70 in_seq=0 out_seq=0 2023-07-14T12:53:54.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94b67fc640 10 client.5343 ms_handle_connect on v2:172.21.15.5:6834/601029596 2023-07-14T12:53:54.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94b67fc640 1 -- 172.21.15.5:0/3757947915 <== mds.0 v2:172.21.15.5:6834/601029596 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ca24e30f40 con 0x55ca24fc0310 2023-07-14T12:53:54.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.105+0000 7f94b67fc640 10 client.5343 handle_command_reply: tid=0 2023-07-14T12:53:54.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.109+0000 7f94e1360000 1 client.5343 shutdown 2023-07-14T12:53:54.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.109+0000 7f94e1360000 1 -- 172.21.15.5:0/3757947915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24ffdf80 msgr2=0x55ca250055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:54.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.109+0000 7f94e1360000 1 --2- 172.21.15.5:0/3757947915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24ffdf80 0x55ca250055f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f94cc054ad0 tx=0x7f94cc052ee0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.109+0000 7f94e1360000 1 -- 172.21.15.5:0/3757947915 shutdown_connections 2023-07-14T12:53:54.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.109+0000 7f94e1360000 1 --2- 172.21.15.5:0/3757947915 >> [v2:172.21.15.5:6834/601029596,v1:172.21.15.5:6835/601029596] conn(0x55ca24fc0310 0x55ca24fc06e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.109+0000 7f94e1360000 1 --2- 172.21.15.5:0/3757947915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ca24ffe890 0x55ca24fbf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.109+0000 7f94e1360000 1 --2- 172.21.15.5:0/3757947915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24ffdf80 0x55ca250055f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.109+0000 7f94e1360000 1 --2- 172.21.15.5:0/3757947915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca24fb4930 0x55ca250050b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.109+0000 7f94b67fc640 0 client.5343 ms_handle_reset on v2:172.21.15.5:6834/601029596 2023-07-14T12:53:54.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.109+0000 7f94e1360000 1 -- 172.21.15.5:0/3757947915 >> 172.21.15.5:0/3757947915 conn(0x55ca24fbaa90 msgr2=0x55ca24fb33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:54.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.109+0000 7f94e1360000 1 -- 172.21.15.5:0/3757947915 shutdown_connections 2023-07-14T12:53:54.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.109+0000 7f94e1360000 1 -- 172.21.15.5:0/3757947915 wait complete. 2023-07-14T12:53:54.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.109+0000 7f94e1360000 20 client.5343 trim_cache size 0 max 16384 2023-07-14T12:53:54.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.121+0000 7f94e1360000 1 Processor -- start 2023-07-14T12:53:54.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.121+0000 7f94e1360000 1 -- start start 2023-07-14T12:53:54.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94e1360000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ca24fb4930 0x55ca25057520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:54.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94e1360000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca24ffdf80 0x55ca25057a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:54.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94e1360000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24ffe890 0x55ca25057fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:54.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94e1360000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca24abf940 con 0x55ca24ffe890 2023-07-14T12:53:54.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94e1360000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca2500b130 con 0x55ca24ffdf80 2023-07-14T12:53:54.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94e1360000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca2500bb30 con 0x55ca24fb4930 2023-07-14T12:53:54.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94d7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24ffe890 0x55ca25057fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:54.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94d7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24ffe890 0x55ca25057fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38782/0 (socket says 172.21.15.5:38782) 2023-07-14T12:53:54.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94d7fff640 1 -- 172.21.15.5:0/1180418328 learned_addr learned my addr 172.21.15.5:0/1180418328 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:54.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94d6ffd640 1 --2- 172.21.15.5:0/1180418328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca24ffdf80 0x55ca25057a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:54.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94d77fe640 1 --2- 172.21.15.5:0/1180418328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ca24fb4930 0x55ca25057520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:54.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94d7fff640 1 -- 172.21.15.5:0/1180418328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ca24fb4930 msgr2=0x55ca25057520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:54.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94d7fff640 1 --2- 172.21.15.5:0/1180418328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ca24fb4930 0x55ca25057520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94d7fff640 1 -- 172.21.15.5:0/1180418328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca24ffdf80 msgr2=0x55ca25057a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:54.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94d7fff640 1 --2- 172.21.15.5:0/1180418328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca24ffdf80 0x55ca25057a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94d7fff640 1 -- 172.21.15.5:0/1180418328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca24fb7000 con 0x55ca24ffe890 2023-07-14T12:53:54.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94d7fff640 1 --2- 172.21.15.5:0/1180418328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24ffe890 0x55ca25057fa0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f94d0000f90 tx=0x7f94d0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32129095f95bc76 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:54.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94bdffb640 1 -- 172.21.15.5:0/1180418328 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0023040 con 0x55ca24ffe890 2023-07-14T12:53:54.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94bdffb640 1 -- 172.21.15.5:0/1180418328 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d00145e0 con 0x55ca24ffe890 2023-07-14T12:53:54.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94bdffb640 1 -- 172.21.15.5:0/1180418328 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0014990 con 0x55ca24ffe890 2023-07-14T12:53:54.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94e1360000 1 -- 172.21.15.5:0/1180418328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24ffe890 msgr2=0x55ca25057fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:54.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94e1360000 1 --2- 172.21.15.5:0/1180418328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24ffe890 0x55ca25057fa0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f94d0000f90 tx=0x7f94d0014000 comp rx=0 tx=0).stop 2023-07-14T12:53:54.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94e1360000 1 -- 172.21.15.5:0/1180418328 shutdown_connections 2023-07-14T12:53:54.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94e1360000 1 --2- 172.21.15.5:0/1180418328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24ffe890 0x55ca25057fa0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94e1360000 1 --2- 172.21.15.5:0/1180418328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca24ffdf80 0x55ca25057a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94e1360000 1 --2- 172.21.15.5:0/1180418328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ca24fb4930 0x55ca25057520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94e1360000 1 -- 172.21.15.5:0/1180418328 >> 172.21.15.5:0/1180418328 conn(0x55ca24fbaa90 msgr2=0x55ca24fb9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:54.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94e1360000 1 -- 172.21.15.5:0/1180418328 shutdown_connections 2023-07-14T12:53:54.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94e1360000 1 -- 172.21.15.5:0/1180418328 wait complete. 2023-07-14T12:53:54.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94e1360000 1 -- start start 2023-07-14T12:53:54.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.125+0000 7f94e1360000 1 Processor -- start 2023-07-14T12:53:54.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94e1360000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24fb4930 0x55ca2505bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:54.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94e1360000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca24ffdf80 0x55ca2505c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:54.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94e1360000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ca24ffe890 0x55ca25002440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:54.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94e1360000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca24d9fb00 con 0x55ca24fb4930 2023-07-14T12:53:54.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94e1360000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca24fb4450 con 0x55ca24ffdf80 2023-07-14T12:53:54.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94e1360000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca24e06400 con 0x55ca24ffe890 2023-07-14T12:53:54.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94e1360000 10 client.0 _ll_register_callbacks cb 0x55ca24f804b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:53:54.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94d77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24fb4930 0x55ca2505bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:54.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94d77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24fb4930 0x55ca2505bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38788/0 (socket says 172.21.15.5:38788) 2023-07-14T12:53:54.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94d77fe640 1 -- 172.21.15.5:0/3311745704 learned_addr learned my addr 172.21.15.5:0/3311745704 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:54.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94d6ffd640 1 --2- 172.21.15.5:0/3311745704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca24ffdf80 0x55ca2505c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:54.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94d7fff640 1 --2- 172.21.15.5:0/3311745704 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ca24ffe890 0x55ca25002440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:54.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94d77fe640 1 -- 172.21.15.5:0/3311745704 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ca24ffe890 msgr2=0x55ca25002440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:54.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94d77fe640 1 --2- 172.21.15.5:0/3311745704 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ca24ffe890 0x55ca25002440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94d77fe640 1 -- 172.21.15.5:0/3311745704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca24ffdf80 msgr2=0x55ca2505c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:54.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94d77fe640 1 --2- 172.21.15.5:0/3311745704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca24ffdf80 0x55ca2505c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94d77fe640 1 -- 172.21.15.5:0/3311745704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca24afe890 con 0x55ca24fb4930 2023-07-14T12:53:54.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94d77fe640 1 --2- 172.21.15.5:0/3311745704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24fb4930 0x55ca2505bb60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f94c801c470 tx=0x7f94c80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc5ea83b838cc54 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:54.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-07-14T12:53:54.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94b67fc640 1 -- 172.21.15.5:0/3311745704 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c80cb040 con 0x55ca24fb4930 2023-07-14T12:53:54.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94e1360000 1 -- 172.21.15.5:0/3311745704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca24e00d50 con 0x55ca24fb4930 2023-07-14T12:53:54.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94b67fc640 1 -- 172.21.15.5:0/3311745704 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f94c80cb320 con 0x55ca24fb4930 2023-07-14T12:53:54.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94b67fc640 1 -- 172.21.15.5:0/3311745704 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94c80cb4e0 con 0x55ca24fb4930 2023-07-14T12:53:54.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94e1360000 10 client.5349 fetch_fsmap learned FSMap version 16 2023-07-14T12:53:54.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94e1360000 1 -- 172.21.15.5:0/3311745704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55ca24dad020 con 0x55ca24fb4930 2023-07-14T12:53:54.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94b67fc640 1 -- 172.21.15.5:0/3311745704 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ca24e00d50 con 0x55ca24fb4930 2023-07-14T12:53:54.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94b67fc640 1 -- 172.21.15.5:0/3311745704 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f94c80c2040 con 0x55ca24fb4930 2023-07-14T12:53:54.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94e1360000 10 client.5349 fetch_fsmap finished waiting for FSMap version 16 2023-07-14T12:53:54.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94e1360000 10 client.5349 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T12:53:54.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94e1360000 20 client.5349 populate_metadata read hostname 'smithi005' 2023-07-14T12:53:54.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94e1360000 1 --2- 172.21.15.5:0/3311745704 >> [v2:172.21.15.5:6834/601029596,v1:172.21.15.5:6835/601029596] conn(0x55ca250629c0 0x55ca25064da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:54.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94e1360000 4 client.5349 mds_command: new command op to 5133 tid=0[{"prefix": "status"}] 2023-07-14T12:53:54.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94e1360000 1 -- 172.21.15.5:0/3311745704 --> [v2:172.21.15.5:6834/601029596,v1:172.21.15.5:6835/601029596] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ca24dfb3e0 con 0x55ca250629c0 2023-07-14T12:53:54.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94d6ffd640 1 --2- 172.21.15.5:0/3311745704 >> [v2:172.21.15.5:6834/601029596,v1:172.21.15.5:6835/601029596] conn(0x55ca250629c0 0x55ca25064da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:54.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94d6ffd640 1 --2- 172.21.15.5:0/3311745704 >> [v2:172.21.15.5:6834/601029596,v1:172.21.15.5:6835/601029596] conn(0x55ca250629c0 0x55ca25064da0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37a8fa1e0ed66310 server_cookie=4ae67874164380f5 in_seq=0 out_seq=0 2023-07-14T12:53:54.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94b67fc640 10 client.5349 ms_handle_connect on v2:172.21.15.5:6834/601029596 2023-07-14T12:53:54.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94b67fc640 1 -- 172.21.15.5:0/3311745704 <== mds.0 v2:172.21.15.5:6834/601029596 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55ca24dfb3e0 con 0x55ca250629c0 2023-07-14T12:53:54.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94b67fc640 10 client.5349 handle_command_reply: tid=0 2023-07-14T12:53:54.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94e1360000 1 client.5349 shutdown 2023-07-14T12:53:54.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94e1360000 1 -- 172.21.15.5:0/3311745704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24fb4930 msgr2=0x55ca2505bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:54.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.129+0000 7f94e1360000 1 --2- 172.21.15.5:0/3311745704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24fb4930 0x55ca2505bb60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f94c801c470 tx=0x7f94c80046d0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.133+0000 7f94e1360000 1 -- 172.21.15.5:0/3311745704 shutdown_connections 2023-07-14T12:53:54.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.133+0000 7f94e1360000 1 --2- 172.21.15.5:0/3311745704 >> [v2:172.21.15.5:6834/601029596,v1:172.21.15.5:6835/601029596] conn(0x55ca250629c0 0x55ca25064da0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.133+0000 7f94e1360000 1 --2- 172.21.15.5:0/3311745704 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ca24ffe890 0x55ca25002440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.133+0000 7f94e1360000 1 --2- 172.21.15.5:0/3311745704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ca24ffdf80 0x55ca2505c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.133+0000 7f94b67fc640 0 client.5349 ms_handle_reset on v2:172.21.15.5:6834/601029596 2023-07-14T12:53:54.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.133+0000 7f94e1360000 1 --2- 172.21.15.5:0/3311745704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ca24fb4930 0x55ca2505bb60 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.133+0000 7f94e1360000 1 -- 172.21.15.5:0/3311745704 >> 172.21.15.5:0/3311745704 conn(0x55ca24fbaa90 msgr2=0x55ca24ffc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:54.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.133+0000 7f94e1360000 1 -- 172.21.15.5:0/3311745704 shutdown_connections 2023-07-14T12:53:54.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.133+0000 7f94e1360000 1 -- 172.21.15.5:0/3311745704 wait complete. 2023-07-14T12:53:54.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.133+0000 7f94e1360000 20 client.5349 trim_cache size 0 max 16384 2023-07-14T12:53:54.177 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T12:53:54.178 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "22affb8d-e389-40f8-a764-dd40eb1759c8", 2023-07-14T12:53:54.178 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-07-14T12:53:54.178 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 5133, 2023-07-14T12:53:54.179 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-07-14T12:53:54.179 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-07-14T12:53:54.179 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-07-14T12:53:54.179 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 10.496799504, 2023-07-14T12:53:54.180 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 16, 2023-07-14T12:53:54.180 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 37, 2023-07-14T12:53:54.180 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 37, 2023-07-14T12:53:54.180 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 19.356665615000001 2023-07-14T12:53:54.180 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T12:53:54.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.133+0000 7f94ddffa640 1 -- 172.21.15.5:0/4283383791 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f94c40662d0 msgr2=0x7f94c4068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:54.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.133+0000 7f94ddffa640 1 --2- 172.21.15.5:0/4283383791 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f94c40662d0 0x7f94c4068780 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f94c80af000 tx=0x7f94c8008040 comp rx=0 tx=0).stop 2023-07-14T12:53:54.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.133+0000 7f94ddffa640 1 -- 172.21.15.5:0/4283383791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94d806de30 msgr2=0x7f94d80ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:54.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.133+0000 7f94ddffa640 1 --2- 172.21.15.5:0/4283383791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94d806de30 0x7f94d80ac8e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f94cc00b410 tx=0x7f94cc00b8d0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.133+0000 7f94ddffa640 1 -- 172.21.15.5:0/4283383791 shutdown_connections 2023-07-14T12:53:54.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.133+0000 7f94ddffa640 1 --2- 172.21.15.5:0/4283383791 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f94c40662d0 0x7f94c4068780 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.133+0000 7f94ddffa640 1 --2- 172.21.15.5:0/4283383791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94d813ed20 0x7f94d80ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.133+0000 7f94ddffa640 1 --2- 172.21.15.5:0/4283383791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94d806de30 0x7f94d80ac8e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.133+0000 7f94ddffa640 1 --2- 172.21.15.5:0/4283383791 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94d806c430 0x7f94d813e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.133+0000 7f94ddffa640 1 -- 172.21.15.5:0/4283383791 >> 172.21.15.5:0/4283383791 conn(0x7f94d80b1300 msgr2=0x7f94d80aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:54.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.133+0000 7f94ddffa640 1 -- 172.21.15.5:0/4283383791 shutdown_connections 2023-07-14T12:53:54.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.133+0000 7f94ddffa640 1 -- 172.21.15.5:0/4283383791 wait complete. 2023-07-14T12:53:54.184 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T12:53:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.301+0000 7f877079f640 1 Processor -- start 2023-07-14T12:53:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.301+0000 7f877079f640 1 -- start start 2023-07-14T12:53:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.301+0000 7f877079f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f87680b7c70 0x7f87680d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.301+0000 7f877079f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87680d1850 0x7f876815f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.301+0000 7f877079f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f87680d1300 0x7f876815fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.301+0000 7f877079f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87680d1190 con 0x7f87680b7c70 2023-07-14T12:53:54.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.301+0000 7f877079f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8768160600 con 0x7f87680d1300 2023-07-14T12:53:54.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.301+0000 7f877079f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87681600d0 con 0x7f87680d1850 2023-07-14T12:53:54.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.301+0000 7f876e53b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f87680b7c70 0x7f87680d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:54.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.301+0000 7f876e53b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f87680b7c70 0x7f87680d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38792/0 (socket says 172.21.15.5:38792) 2023-07-14T12:53:54.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.301+0000 7f876e53b640 1 -- 172.21.15.5:0/3290250072 learned_addr learned my addr 172.21.15.5:0/3290250072 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:54.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.301+0000 7f876dd3a640 1 --2- 172.21.15.5:0/3290250072 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87680d1850 0x7f876815f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:54.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.301+0000 7f876ed3c640 1 --2- 172.21.15.5:0/3290250072 >> v2:172.21.15.154:3300/0 conn(0x7f87680d1300 0x7f876815fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:54.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.301+0000 7f876e53b640 1 -- 172.21.15.5:0/3290250072 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87680d1850 msgr2=0x7f876815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:54.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.301+0000 7f876e53b640 1 --2- 172.21.15.5:0/3290250072 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87680d1850 0x7f876815f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.301+0000 7f876e53b640 1 -- 172.21.15.5:0/3290250072 >> v2:172.21.15.154:3300/0 conn(0x7f87680d1300 msgr2=0x7f876815fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:54.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.301+0000 7f876e53b640 1 --2- 172.21.15.5:0/3290250072 >> v2:172.21.15.154:3300/0 conn(0x7f87680d1300 0x7f876815fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.301+0000 7f876e53b640 1 -- 172.21.15.5:0/3290250072 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87680ccaf0 con 0x7f87680b7c70 2023-07-14T12:53:54.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.301+0000 7f876ed3c640 1 --2- 172.21.15.5:0/3290250072 >> v2:172.21.15.154:3300/0 conn(0x7f87680d1300 0x7f876815fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:53:54.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.305+0000 7f876e53b640 1 --2- 172.21.15.5:0/3290250072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87680b7c70 0x7f87680d0c50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8768069e40 tx=0x7f876401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e5d60bc8f801507 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:54.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.305+0000 7f876d539640 1 -- 172.21.15.5:0/3290250072 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87640ac600 con 0x7f87680b7c70 2023-07-14T12:53:54.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.305+0000 7f876d539640 1 -- 172.21.15.5:0/3290250072 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87640a8050 con 0x7f87680b7c70 2023-07-14T12:53:54.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.305+0000 7f876d539640 1 -- 172.21.15.5:0/3290250072 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87640ac980 con 0x7f87680b7c70 2023-07-14T12:53:54.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.305+0000 7f877079f640 1 -- 172.21.15.5:0/3290250072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87680b7c70 msgr2=0x7f87680d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:54.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.305+0000 7f877079f640 1 --2- 172.21.15.5:0/3290250072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87680b7c70 0x7f87680d0c50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8768069e40 tx=0x7f876401c4d0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.305+0000 7f877079f640 1 -- 172.21.15.5:0/3290250072 shutdown_connections 2023-07-14T12:53:54.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.305+0000 7f877079f640 1 --2- 172.21.15.5:0/3290250072 >> v2:172.21.15.154:3300/0 conn(0x7f87680d1300 0x7f876815fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.305+0000 7f877079f640 1 --2- 172.21.15.5:0/3290250072 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87680d1850 0x7f876815f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.305+0000 7f877079f640 1 --2- 172.21.15.5:0/3290250072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87680b7c70 0x7f87680d0c50 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.305+0000 7f877079f640 1 -- 172.21.15.5:0/3290250072 >> 172.21.15.5:0/3290250072 conn(0x7f87680650b0 msgr2=0x7f87680654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:54.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.305+0000 7f877079f640 1 -- 172.21.15.5:0/3290250072 shutdown_connections 2023-07-14T12:53:54.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.305+0000 7f877079f640 1 -- 172.21.15.5:0/3290250072 wait complete. 2023-07-14T12:53:54.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.309+0000 7f877079f640 1 Processor -- start 2023-07-14T12:53:54.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.309+0000 7f877079f640 1 -- start start 2023-07-14T12:53:54.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.309+0000 7f877079f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87680b7c70 0x7f876815e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:54.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.309+0000 7f877079f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87680d1300 0x7f87680b2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:54.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.309+0000 7f877079f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87680d1850 0x7f87680b2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:54.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.309+0000 7f877079f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876815eb00 con 0x7f87680d1850 2023-07-14T12:53:54.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.309+0000 7f877079f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8768158b70 con 0x7f87680b7c70 2023-07-14T12:53:54.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.309+0000 7f877079f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8768158d50 con 0x7f87680d1300 2023-07-14T12:53:54.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.309+0000 7f876ed3c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87680d1850 0x7f87680b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:54.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.309+0000 7f876ed3c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87680d1850 0x7f87680b2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38804/0 (socket says 172.21.15.5:38804) 2023-07-14T12:53:54.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.309+0000 7f876ed3c640 1 -- 172.21.15.5:0/846519290 learned_addr learned my addr 172.21.15.5:0/846519290 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:54.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.309+0000 7f876e53b640 1 --2- 172.21.15.5:0/846519290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87680b7c70 0x7f876815e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:54.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.309+0000 7f876dd3a640 1 --2- 172.21.15.5:0/846519290 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87680d1300 0x7f87680b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:54.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.309+0000 7f876ed3c640 1 -- 172.21.15.5:0/846519290 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87680d1300 msgr2=0x7f87680b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:54.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.309+0000 7f876ed3c640 1 --2- 172.21.15.5:0/846519290 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87680d1300 0x7f87680b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.309+0000 7f876ed3c640 1 -- 172.21.15.5:0/846519290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87680b7c70 msgr2=0x7f876815e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:54.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.309+0000 7f876ed3c640 1 --2- 172.21.15.5:0/846519290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87680b7c70 0x7f876815e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.309+0000 7f876ed3c640 1 -- 172.21.15.5:0/846519290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87640094d0 con 0x7f87680d1850 2023-07-14T12:53:54.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.309+0000 7f876ed3c640 1 --2- 172.21.15.5:0/846519290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87680d1850 0x7f87680b2570 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8760009fa0 tx=0x7f876000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:54.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.309+0000 7f875effd640 1 -- 172.21.15.5:0/846519290 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8760003ba0 con 0x7f87680d1850 2023-07-14T12:53:54.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.309+0000 7f875effd640 1 -- 172.21.15.5:0/846519290 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876000f040 con 0x7f87680d1850 2023-07-14T12:53:54.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.309+0000 7f875effd640 1 -- 172.21.15.5:0/846519290 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8760004030 con 0x7f87680d1850 2023-07-14T12:53:54.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.309+0000 7f877079f640 1 -- 172.21.15.5:0/846519290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87680b5fd0 con 0x7f87680d1850 2023-07-14T12:53:54.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.309+0000 7f877079f640 1 -- 172.21.15.5:0/846519290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8768158fa0 con 0x7f87680d1850 2023-07-14T12:53:54.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.309+0000 7f877079f640 1 -- 172.21.15.5:0/846519290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87680678d0 con 0x7f87680d1850 2023-07-14T12:53:54.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.313+0000 7f875effd640 1 -- 172.21.15.5:0/846519290 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8760004190 con 0x7f87680d1850 2023-07-14T12:53:54.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.313+0000 7f875effd640 1 --2- 172.21.15.5:0/846519290 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f874c0662b0 0x7f874c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:54.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.313+0000 7f875effd640 1 -- 172.21.15.5:0/846519290 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8760084060 con 0x7f87680d1850 2023-07-14T12:53:54.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.313+0000 7f876e53b640 1 --2- 172.21.15.5:0/846519290 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f874c0662b0 0x7f874c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:54.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.313+0000 7f876e53b640 1 --2- 172.21.15.5:0/846519290 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f874c0662b0 0x7f874c068760 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f87640ae000 tx=0x7f8764008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.317+0000 7f875effd640 1 -- 172.21.15.5:0/846519290 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f8760051570 con 0x7f87680d1850 2023-07-14T12:53:54.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.505+0000 7f877079f640 1 -- 172.21.15.5:0/846519290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f87680655b0 con 0x7f87680d1850 2023-07-14T12:53:54.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.505+0000 7f875effd640 1 -- 172.21.15.5:0/846519290 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8760054b90 con 0x7f87680d1850 2023-07-14T12:53:54.533 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T12:53:54.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.505+0000 7f877079f640 1 -- 172.21.15.5:0/846519290 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f874c0662b0 msgr2=0x7f874c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:54.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.505+0000 7f877079f640 1 --2- 172.21.15.5:0/846519290 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f874c0662b0 0x7f874c068760 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f87640ae000 tx=0x7f8764008040 comp rx=0 tx=0).stop 2023-07-14T12:53:54.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.505+0000 7f877079f640 1 -- 172.21.15.5:0/846519290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87680d1850 msgr2=0x7f87680b2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:54.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.505+0000 7f877079f640 1 --2- 172.21.15.5:0/846519290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87680d1850 0x7f87680b2570 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8760009fa0 tx=0x7f876000d560 comp rx=0 tx=0).stop 2023-07-14T12:53:54.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.505+0000 7f877079f640 1 -- 172.21.15.5:0/846519290 shutdown_connections 2023-07-14T12:53:54.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.505+0000 7f877079f640 1 --2- 172.21.15.5:0/846519290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87680d1850 0x7f87680b2570 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.505+0000 7f877079f640 1 --2- 172.21.15.5:0/846519290 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87680d1300 0x7f87680b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.505+0000 7f877079f640 1 --2- 172.21.15.5:0/846519290 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f874c0662b0 0x7f874c068760 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.505+0000 7f877079f640 1 --2- 172.21.15.5:0/846519290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87680b7c70 0x7f876815e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:54.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.505+0000 7f877079f640 1 -- 172.21.15.5:0/846519290 >> 172.21.15.5:0/846519290 conn(0x7f87680650b0 msgr2=0x7f87680cfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:54.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.505+0000 7f877079f640 1 -- 172.21.15.5:0/846519290 shutdown_connections 2023-07-14T12:53:54.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:54.505+0000 7f877079f640 1 -- 172.21.15.5:0/846519290 wait complete. 2023-07-14T12:53:54.553 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-14T12:53:54.554 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T12:53:54.554 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-07-14T12:53:54.554 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-14T12:53:54.555 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-14T12:53:54.555 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-14T12:53:54.556 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-14T12:53:54.556 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T12:53:54.556 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T12:53:54.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:54.557 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-07-14T12:53:54.567 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T12:53:54.567 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T12:53:54.567 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T12:53:54.567 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:54.568 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-07-14T12:53:54.568 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:54.568 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T12:53:54.568 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:54.568 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2023-07-14T12:53:54.568 INFO:teuthology.orchestra.run.smithi005.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T12:53:54.568 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:54.569 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2023-07-14T12:53:54.569 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-14T12:53:54.569 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42282sec preferred_lft 42282sec 2023-07-14T12:53:54.569 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-07-14T12:53:54.569 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:54.569 INFO:teuthology.orchestra.run.smithi005.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T12:53:54.569 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:54.570 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2023-07-14T12:53:54.570 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T12:53:54.570 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:54.570 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2023-07-14T12:53:54.570 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-14T12:53:54.570 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:96:b6:fb:c6 brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:54.570 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-14T12:53:54.570 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:54.571 INFO:teuthology.orchestra.run.smithi005.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T12:53:54.571 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-14T12:53:54.571 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T12:53:54.571 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:54.571 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-14T12:53:54.571 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:54.571 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T12:53:54.571 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T12:53:54.572 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-14T12:53:54.572 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:54.572 INFO:teuthology.orchestra.run.smithi005.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T12:53:54.572 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-14T12:53:54.572 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-14T12:53:54.572 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:53:54.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:54.574 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T12:53:54.635 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-07-14T12:53:54.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:54.637 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-07-14T12:53:54.688 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-07-14T12:53:54.689 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T12:53:54.689 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-14T12:53:54.689 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-14T12:53:54.689 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-14T12:53:54.689 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T12:53:54.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:54.690 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-07-14T12:53:54.690 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-07-14T12:53:54.691 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-14T12:53:54.691 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-14T12:53:54.691 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-14T12:53:54.691 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-07-14T12:53:54.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:54.785 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-07-14T12:53:54.795 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-14T12:53:54.796 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-14T12:53:54.796 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T12:53:54.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:54.797 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-07-14T12:53:54.865 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T12:53:54.865 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-14T12:53:54.915 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-14T12:53:54.915 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T12:53:54.916 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-14T12:53:54.971 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-14T12:53:54.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:54.972 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T12:53:55.067 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T12:53:55.067 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T12:53:55.067 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T12:53:55.082 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T12:53:55.082 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T12:53:55.082 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T12:53:55.083 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T12:53:55.083 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T12:53:55.092 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T12:53:55.093 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T12:53:55.093 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T12:53:55.093 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T12:53:55.093 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T12:53:55.093 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790" 2023-07-14T12:53:55.093 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790:/ 2023-07-14T12:53:55.093 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=22affb8d-e389-40f8-a764-dd40eb1759c8" will pass to kernel 2023-07-14T12:53:55.097 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T12:53:55.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:55.097 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-14T12:53:55.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:55.120 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T12:53:55.183 INFO:teuthology.orchestra.run.smithi005.stdout:client5263 2023-07-14T12:53:55.184 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T12:53:55.185 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T12:53:55.236 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-14T12:53:55.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.393+0000 7ff805df6640 1 Processor -- start 2023-07-14T12:53:55.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.393+0000 7ff805df6640 1 -- start start 2023-07-14T12:53:55.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.397+0000 7ff805df6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff800160450 0x7ff80006e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:55.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.397+0000 7ff805df6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff800069430 0x7ff800069830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:55.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.397+0000 7ff805df6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8000c9c30 con 0x7ff80015bc00 2023-07-14T12:53:55.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.397+0000 7ff805df6640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8000c96b0 con 0x7ff800160450 2023-07-14T12:53:55.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.397+0000 7ff805df6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff80015bfd0 con 0x7ff800069430 2023-07-14T12:53:55.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.397+0000 7ff7feffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff800160450 0x7ff80006e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:55.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.397+0000 7ff7feffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff800160450 0x7ff80006e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38812/0 (socket says 172.21.15.5:38812) 2023-07-14T12:53:55.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.397+0000 7ff7feffd640 1 -- 172.21.15.5:0/2269465628 learned_addr learned my addr 172.21.15.5:0/2269465628 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:55.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.397+0000 7ff7fffff640 1 --2- 172.21.15.5:0/2269465628 >> v2:172.21.15.154:3300/0 conn(0x7ff800069430 0x7ff800069830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:55.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.397+0000 7ff7feffd640 1 -- 172.21.15.5:0/2269465628 >> v2:172.21.15.154:3300/0 conn(0x7ff800069430 msgr2=0x7ff800069830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:55.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.397+0000 7ff7feffd640 1 --2- 172.21.15.5:0/2269465628 >> v2:172.21.15.154:3300/0 conn(0x7ff800069430 0x7ff800069830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:55.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.397+0000 7ff7feffd640 1 -- 172.21.15.5:0/2269465628 >> v1:172.21.15.154:6789/0 conn(0x7ff80015bc00 legacy=0x7ff8000ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:55.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.397+0000 7ff7feffd640 1 -- 172.21.15.5:0/2269465628 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff800069d70 con 0x7ff800160450 2023-07-14T12:53:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.397+0000 7ff7feffd640 1 --2- 172.21.15.5:0/2269465628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff800160450 0x7ff80006e690 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff8000ce4e0 tx=0x7ff7f401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed7c4a133ff979a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.401+0000 7ff7fe7fc640 1 -- 172.21.15.5:0/2269465628 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f40aa430 con 0x7ff800160450 2023-07-14T12:53:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.401+0000 7ff7fe7fc640 1 -- 172.21.15.5:0/2269465628 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f40aa590 con 0x7ff800160450 2023-07-14T12:53:55.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.401+0000 7ff7fe7fc640 1 -- 172.21.15.5:0/2269465628 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f40aa920 con 0x7ff800160450 2023-07-14T12:53:55.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.401+0000 7ff805df6640 1 -- 172.21.15.5:0/2269465628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff800160450 msgr2=0x7ff80006e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:55.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.401+0000 7ff805df6640 1 --2- 172.21.15.5:0/2269465628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff800160450 0x7ff80006e690 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff8000ce4e0 tx=0x7ff7f401c4d0 comp rx=0 tx=0).stop 2023-07-14T12:53:55.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.401+0000 7ff805df6640 1 -- 172.21.15.5:0/2269465628 shutdown_connections 2023-07-14T12:53:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.401+0000 7ff805df6640 1 --2- 172.21.15.5:0/2269465628 >> v2:172.21.15.154:3300/0 conn(0x7ff800069430 0x7ff800069830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.401+0000 7ff805df6640 1 --2- 172.21.15.5:0/2269465628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff800160450 0x7ff80006e690 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.401+0000 7ff805df6640 1 -- 172.21.15.5:0/2269465628 >> 172.21.15.5:0/2269465628 conn(0x7ff8000b1840 msgr2=0x7ff8000cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.401+0000 7ff805df6640 1 -- 172.21.15.5:0/2269465628 shutdown_connections 2023-07-14T12:53:55.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.401+0000 7ff805df6640 1 -- 172.21.15.5:0/2269465628 wait complete. 2023-07-14T12:53:55.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.401+0000 7ff805df6640 1 Processor -- start 2023-07-14T12:53:55.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.401+0000 7ff805df6640 1 -- start start 2023-07-14T12:53:55.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.401+0000 7ff805df6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff800069430 0x7ff80006cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:55.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.401+0000 7ff805df6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff80015bc00 0x7ff80014f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:55.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.401+0000 7ff805df6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff800160450 0x7ff80014f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:55.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.401+0000 7ff805df6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8000c7a40 con 0x7ff800069430 2023-07-14T12:53:55.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.401+0000 7ff805df6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8000c88a0 con 0x7ff800160450 2023-07-14T12:53:55.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.401+0000 7ff805df6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8000c7c90 con 0x7ff80015bc00 2023-07-14T12:53:55.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.401+0000 7ff7ff7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff800069430 0x7ff80006cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:55.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.401+0000 7ff7ff7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff800069430 0x7ff80006cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38826/0 (socket says 172.21.15.5:38826) 2023-07-14T12:53:55.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.401+0000 7ff7ff7fe640 1 -- 172.21.15.5:0/3744856893 learned_addr learned my addr 172.21.15.5:0/3744856893 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:55.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.405+0000 7ff7feffd640 1 --2- 172.21.15.5:0/3744856893 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff80015bc00 0x7ff80014f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:55.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.405+0000 7ff7fffff640 1 --2- 172.21.15.5:0/3744856893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff800160450 0x7ff80014f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:55.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.405+0000 7ff7ff7fe640 1 -- 172.21.15.5:0/3744856893 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff80015bc00 msgr2=0x7ff80014f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:55.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.405+0000 7ff7ff7fe640 1 --2- 172.21.15.5:0/3744856893 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff80015bc00 0x7ff80014f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:55.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.405+0000 7ff7ff7fe640 1 -- 172.21.15.5:0/3744856893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff800160450 msgr2=0x7ff80014f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:55.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.405+0000 7ff7ff7fe640 1 --2- 172.21.15.5:0/3744856893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff800160450 0x7ff80014f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:55.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.405+0000 7ff7ff7fe640 1 -- 172.21.15.5:0/3744856893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f40094d0 con 0x7ff800069430 2023-07-14T12:53:55.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.405+0000 7ff7ff7fe640 1 --2- 172.21.15.5:0/3744856893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff800069430 0x7ff80006cc30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff7f000c500 tx=0x7ff7f000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:55.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.405+0000 7ff7e7fff640 1 -- 172.21.15.5:0/3744856893 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0005220 con 0x7ff800069430 2023-07-14T12:53:55.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.405+0000 7ff7e7fff640 1 -- 172.21.15.5:0/3744856893 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f0005380 con 0x7ff800069430 2023-07-14T12:53:55.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.405+0000 7ff7e7fff640 1 -- 172.21.15.5:0/3744856893 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0007270 con 0x7ff800069430 2023-07-14T12:53:55.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.405+0000 7ff805df6640 1 -- 172.21.15.5:0/3744856893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8000c7f70 con 0x7ff800069430 2023-07-14T12:53:55.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.405+0000 7ff805df6640 1 -- 172.21.15.5:0/3744856893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8000c8530 con 0x7ff800069430 2023-07-14T12:53:55.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.405+0000 7ff805df6640 1 -- 172.21.15.5:0/3744856893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8000678d0 con 0x7ff800069430 2023-07-14T12:53:55.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.405+0000 7ff7e7fff640 1 -- 172.21.15.5:0/3744856893 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff7f00073d0 con 0x7ff800069430 2023-07-14T12:53:55.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.405+0000 7ff7e7fff640 1 --2- 172.21.15.5:0/3744856893 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff7ec066280 0x7ff7ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:55.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.409+0000 7ff7e7fff640 1 -- 172.21.15.5:0/3744856893 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff7f00834c0 con 0x7ff800069430 2023-07-14T12:53:55.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.409+0000 7ff7feffd640 1 --2- 172.21.15.5:0/3744856893 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff7ec066280 0x7ff7ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:55.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.409+0000 7ff7feffd640 1 --2- 172.21.15.5:0/3744856893 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff7ec066280 0x7ff7ec068730 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff7f40ae000 tx=0x7ff7f40b5040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:55.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.409+0000 7ff7e7fff640 1 -- 172.21.15.5:0/3744856893 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff7f0050a00 con 0x7ff800069430 2023-07-14T12:53:55.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.589+0000 7ff805df6640 1 -- 172.21.15.5:0/3744856893 --> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff80006ebd0 con 0x7ff7ec066280 2023-07-14T12:53:55.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.589+0000 7ff7e7fff640 1 -- 172.21.15.5:0/3744856893 <== mgr.4102 v2:172.21.15.154:6832/2736441655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff7f40aa880 con 0x7ff7ec066280 2023-07-14T12:53:55.618 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-07-14T12:53:55.618 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T12:53:55.618 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs" 2023-07-14T12:53:55.618 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T12:53:55.619 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-07-14T12:53:55.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.593+0000 7ff805df6640 1 -- 172.21.15.5:0/3744856893 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff7ec066280 msgr2=0x7ff7ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:55.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.593+0000 7ff805df6640 1 --2- 172.21.15.5:0/3744856893 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff7ec066280 0x7ff7ec068730 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff7f40ae000 tx=0x7ff7f40b5040 comp rx=0 tx=0).stop 2023-07-14T12:53:55.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.593+0000 7ff805df6640 1 -- 172.21.15.5:0/3744856893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff800069430 msgr2=0x7ff80006cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:55.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.593+0000 7ff805df6640 1 --2- 172.21.15.5:0/3744856893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff800069430 0x7ff80006cc30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff7f000c500 tx=0x7ff7f000c9c0 comp rx=0 tx=0).stop 2023-07-14T12:53:55.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.593+0000 7ff805df6640 1 -- 172.21.15.5:0/3744856893 shutdown_connections 2023-07-14T12:53:55.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.593+0000 7ff805df6640 1 --2- 172.21.15.5:0/3744856893 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff7ec066280 0x7ff7ec068730 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:55.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.593+0000 7ff805df6640 1 --2- 172.21.15.5:0/3744856893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff800160450 0x7ff80014f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:55.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.593+0000 7ff805df6640 1 --2- 172.21.15.5:0/3744856893 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff80015bc00 0x7ff80014f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:55.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.593+0000 7ff805df6640 1 --2- 172.21.15.5:0/3744856893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff800069430 0x7ff80006cc30 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:55.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.593+0000 7ff805df6640 1 -- 172.21.15.5:0/3744856893 >> 172.21.15.5:0/3744856893 conn(0x7ff8000b1840 msgr2=0x7ff80015adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:55.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.593+0000 7ff805df6640 1 -- 172.21.15.5:0/3744856893 shutdown_connections 2023-07-14T12:53:55.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.593+0000 7ff805df6640 1 -- 172.21.15.5:0/3744856893 wait complete. 2023-07-14T12:53:55.639 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-14T12:53:55.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.757+0000 7f08c8782640 1 Processor -- start 2023-07-14T12:53:55.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.757+0000 7f08c8782640 1 -- start start 2023-07-14T12:53:55.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.761+0000 7f08c8782640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08c0159a70 0x7f08c00ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:55.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.761+0000 7f08c8782640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f08c015e060 0x7f08c0070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:55.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.761+0000 7f08c8782640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c00cbe50 con 0x7f08c0070e60 2023-07-14T12:53:55.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.761+0000 7f08c8782640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c00cd660 con 0x7f08c0159a70 2023-07-14T12:53:55.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.761+0000 7f08c8782640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c00cc0a0 con 0x7f08c015e060 2023-07-14T12:53:55.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.761+0000 7f08c651e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f08c0159a70 0x7f08c00ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:55.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.761+0000 7f08c6d1f640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f08c0070e60 0x7f08c00c85a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33100/0 (socket says 172.21.15.5:33100) 2023-07-14T12:53:55.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.761+0000 7f08c6d1f640 1 -- 172.21.15.5:0/1418432616 learned_addr learned my addr 172.21.15.5:0/1418432616 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:55.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.761+0000 7f08c5d1d640 1 --2- 172.21.15.5:0/1418432616 >> v2:172.21.15.154:3300/0 conn(0x7f08c015e060 0x7f08c0070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:55.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.761+0000 7f08c651e640 1 -- 172.21.15.5:0/1418432616 >> v2:172.21.15.154:3300/0 conn(0x7f08c015e060 msgr2=0x7f08c0070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:55.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.761+0000 7f08c651e640 1 --2- 172.21.15.5:0/1418432616 >> v2:172.21.15.154:3300/0 conn(0x7f08c015e060 0x7f08c0070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:55.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.761+0000 7f08c651e640 1 -- 172.21.15.5:0/1418432616 >> v1:172.21.15.5:6789/0 conn(0x7f08c0070e60 legacy=0x7f08c00c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:55.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.761+0000 7f08c651e640 1 -- 172.21.15.5:0/1418432616 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c00cc380 con 0x7f08c0159a70 2023-07-14T12:53:55.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.761+0000 7f08c551c640 1 -- 172.21.15.5:0/1418432616 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074156148 0 0) 0x7f08c00cbe50 con 0x7f08c0070e60 2023-07-14T12:53:55.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.761+0000 7f08c5d1d640 1 --2- 172.21.15.5:0/1418432616 >> v2:172.21.15.154:3300/0 conn(0x7f08c015e060 0x7f08c0070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:53:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.761+0000 7f08c651e640 1 --2- 172.21.15.5:0/1418432616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08c0159a70 0x7f08c00ccff0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f08c006d6c0 tx=0x7f08bc01c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f540005aa7d877 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.761+0000 7f08c551c640 1 -- 172.21.15.5:0/1418432616 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc0ab600 con 0x7f08c0159a70 2023-07-14T12:53:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.761+0000 7f08c551c640 1 -- 172.21.15.5:0/1418432616 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08bc0a7050 con 0x7f08c0159a70 2023-07-14T12:53:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.761+0000 7f08c551c640 1 -- 172.21.15.5:0/1418432616 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc0ab980 con 0x7f08c0159a70 2023-07-14T12:53:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.765+0000 7f08c8782640 1 -- 172.21.15.5:0/1418432616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08c0159a70 msgr2=0x7f08c00ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.765+0000 7f08c8782640 1 --2- 172.21.15.5:0/1418432616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08c0159a70 0x7f08c00ccff0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f08c006d6c0 tx=0x7f08bc01c310 comp rx=0 tx=0).stop 2023-07-14T12:53:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.765+0000 7f08c8782640 1 -- 172.21.15.5:0/1418432616 shutdown_connections 2023-07-14T12:53:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.765+0000 7f08c8782640 1 --2- 172.21.15.5:0/1418432616 >> v2:172.21.15.154:3300/0 conn(0x7f08c015e060 0x7f08c0070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.765+0000 7f08c8782640 1 --2- 172.21.15.5:0/1418432616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08c0159a70 0x7f08c00ccff0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.765+0000 7f08c8782640 1 -- 172.21.15.5:0/1418432616 >> 172.21.15.5:0/1418432616 conn(0x7f08c00afac0 msgr2=0x7f08c00afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:55.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.765+0000 7f08c8782640 1 -- 172.21.15.5:0/1418432616 shutdown_connections 2023-07-14T12:53:55.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.765+0000 7f08c8782640 1 -- 172.21.15.5:0/1418432616 wait complete. 2023-07-14T12:53:55.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.765+0000 7f08c8782640 1 Processor -- start 2023-07-14T12:53:55.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.765+0000 7f08c8782640 1 -- start start 2023-07-14T12:53:55.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.765+0000 7f08c8782640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08c0070e60 0x7f08c0156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:55.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.765+0000 7f08c8782640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08c0159a70 0x7f08c006be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:55.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.765+0000 7f08c8782640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08c015e060 0x7f08c0162b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:55.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.765+0000 7f08c8782640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c006d150 con 0x7f08c015e060 2023-07-14T12:53:55.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.765+0000 7f08c8782640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c006c8b0 con 0x7f08c0159a70 2023-07-14T12:53:55.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.765+0000 7f08c8782640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c006cb90 con 0x7f08c0070e60 2023-07-14T12:53:55.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.765+0000 7f08c6d1f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08c015e060 0x7f08c0162b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:55.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.765+0000 7f08c6d1f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08c015e060 0x7f08c0162b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38852/0 (socket says 172.21.15.5:38852) 2023-07-14T12:53:55.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.765+0000 7f08c6d1f640 1 -- 172.21.15.5:0/2676085319 learned_addr learned my addr 172.21.15.5:0/2676085319 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:55.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.765+0000 7f08c651e640 1 --2- 172.21.15.5:0/2676085319 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08c0070e60 0x7f08c0156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:55.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.765+0000 7f08c5d1d640 1 --2- 172.21.15.5:0/2676085319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08c0159a70 0x7f08c006be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:55.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.769+0000 7f08c6d1f640 1 -- 172.21.15.5:0/2676085319 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08c0070e60 msgr2=0x7f08c0156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:55.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.769+0000 7f08c6d1f640 1 --2- 172.21.15.5:0/2676085319 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08c0070e60 0x7f08c0156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:55.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.769+0000 7f08c6d1f640 1 -- 172.21.15.5:0/2676085319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08c0159a70 msgr2=0x7f08c006be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:55.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.769+0000 7f08c6d1f640 1 --2- 172.21.15.5:0/2676085319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08c0159a70 0x7f08c006be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:55.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.769+0000 7f08c6d1f640 1 -- 172.21.15.5:0/2676085319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc009420 con 0x7f08c015e060 2023-07-14T12:53:55.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.769+0000 7f08c6d1f640 1 --2- 172.21.15.5:0/2676085319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08c015e060 0x7f08c0162b70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f08b8001570 tx=0x7f08b800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:55.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.769+0000 7f08b6ffd640 1 -- 172.21.15.5:0/2676085319 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b800a640 con 0x7f08c015e060 2023-07-14T12:53:55.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.769+0000 7f08b6ffd640 1 -- 172.21.15.5:0/2676085319 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b800a7c0 con 0x7f08c015e060 2023-07-14T12:53:55.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.769+0000 7f08b6ffd640 1 -- 172.21.15.5:0/2676085319 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b800ab70 con 0x7f08c015e060 2023-07-14T12:53:55.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.769+0000 7f08c8782640 1 -- 172.21.15.5:0/2676085319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c006ce70 con 0x7f08c015e060 2023-07-14T12:53:55.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.769+0000 7f08c8782640 1 -- 172.21.15.5:0/2676085319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c0156550 con 0x7f08c015e060 2023-07-14T12:53:55.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.769+0000 7f08c8782640 1 -- 172.21.15.5:0/2676085319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c00c58c0 con 0x7f08c015e060 2023-07-14T12:53:55.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.769+0000 7f08b6ffd640 1 -- 172.21.15.5:0/2676085319 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f08b800acd0 con 0x7f08c015e060 2023-07-14T12:53:55.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.769+0000 7f08b6ffd640 1 --2- 172.21.15.5:0/2676085319 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f08a4066280 0x7f08a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:55.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.769+0000 7f08b6ffd640 1 -- 172.21.15.5:0/2676085319 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f08b8083370 con 0x7f08c015e060 2023-07-14T12:53:55.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.773+0000 7f08c651e640 1 --2- 172.21.15.5:0/2676085319 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f08a4066280 0x7f08a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:55.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.773+0000 7f08c651e640 1 --2- 172.21.15.5:0/2676085319 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f08a4066280 0x7f08a4068730 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f08bc0ad000 tx=0x7f08bc0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:55.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.777+0000 7f08b6ffd640 1 -- 172.21.15.5:0/2676085319 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f08c00c58c0 con 0x7f08c015e060 2023-07-14T12:53:55.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:55.965+0000 7f08c8782640 1 -- 172.21.15.5:0/2676085319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f08c00c5ca0 con 0x7f08c015e060 2023-07-14T12:53:56.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.437+0000 7f08b6ffd640 1 -- 172.21.15.5:0/2676085319 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 6) v1 ==== 85675+0+0 (secure 0 0 0) 0x7f08b8050b40 con 0x7f08c015e060 2023-07-14T12:53:56.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.437+0000 7f08b6ffd640 1 -- 172.21.15.5:0/2676085319 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v6) v1 ==== 92+0+0 (secure 0 0 0) 0x7f08b80711a0 con 0x7f08c015e060 2023-07-14T12:53:56.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.441+0000 7f08c8782640 1 -- 172.21.15.5:0/2676085319 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f08a4066280 msgr2=0x7f08a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:56.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.441+0000 7f08c8782640 1 --2- 172.21.15.5:0/2676085319 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f08a4066280 0x7f08a4068730 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f08bc0ad000 tx=0x7f08bc0a6000 comp rx=0 tx=0).stop 2023-07-14T12:53:56.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.441+0000 7f08c8782640 1 -- 172.21.15.5:0/2676085319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08c015e060 msgr2=0x7f08c0162b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:56.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.441+0000 7f08c8782640 1 --2- 172.21.15.5:0/2676085319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08c015e060 0x7f08c0162b70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f08b8001570 tx=0x7f08b800cca0 comp rx=0 tx=0).stop 2023-07-14T12:53:56.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.441+0000 7f08c8782640 1 -- 172.21.15.5:0/2676085319 shutdown_connections 2023-07-14T12:53:56.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.441+0000 7f08c8782640 1 --2- 172.21.15.5:0/2676085319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f08c015e060 0x7f08c0162b70 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:56.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.441+0000 7f08c8782640 1 --2- 172.21.15.5:0/2676085319 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f08a4066280 0x7f08a4068730 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:56.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.441+0000 7f08c8782640 1 --2- 172.21.15.5:0/2676085319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08c0159a70 0x7f08c006be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:56.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.441+0000 7f08c8782640 1 --2- 172.21.15.5:0/2676085319 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f08c0070e60 0x7f08c0156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:56.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.441+0000 7f08c8782640 1 -- 172.21.15.5:0/2676085319 >> 172.21.15.5:0/2676085319 conn(0x7f08c00afac0 msgr2=0x7f08c00b3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:56.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.441+0000 7f08c8782640 1 -- 172.21.15.5:0/2676085319 shutdown_connections 2023-07-14T12:53:56.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.441+0000 7f08c8782640 1 -- 172.21.15.5:0/2676085319 wait complete. 2023-07-14T12:53:56.492 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-14T12:53:56.639 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:53:56.613+0000 7f6e0fc1a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T12:53:56.652 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:53:56.625+0000 7f74893d4180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T12:53:56.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.625+0000 7ff59f0cb640 1 Processor -- start 2023-07-14T12:53:56.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.625+0000 7ff59f0cb640 1 -- start start 2023-07-14T12:53:56.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.625+0000 7ff59f0cb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff5980d2fc0 0x7ff5980b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:56.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.625+0000 7ff59f0cb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff5980d2300 0x7ff5980d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:56.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.625+0000 7ff59f0cb640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5980b04c0 con 0x7ff59815bde0 2023-07-14T12:53:56.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.625+0000 7ff59f0cb640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff59815c1b0 con 0x7ff5980d2300 2023-07-14T12:53:56.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.625+0000 7ff59f0cb640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5980d2c80 con 0x7ff5980d2fc0 2023-07-14T12:53:56.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.625+0000 7ff59d668640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff5980d2300 0x7ff5980d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:56.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.625+0000 7ff59d668640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff5980d2300 0x7ff5980d2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38880/0 (socket says 172.21.15.5:38880) 2023-07-14T12:53:56.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.625+0000 7ff59d668640 1 -- 172.21.15.5:0/200917579 learned_addr learned my addr 172.21.15.5:0/200917579 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:56.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.625+0000 7ff597fff640 1 --2- 172.21.15.5:0/200917579 >> v2:172.21.15.154:3300/0 conn(0x7ff5980d2fc0 0x7ff5980b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:56.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.629+0000 7ff59d668640 1 -- 172.21.15.5:0/200917579 >> v2:172.21.15.154:3300/0 conn(0x7ff5980d2fc0 msgr2=0x7ff5980b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:56.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.629+0000 7ff59d668640 1 --2- 172.21.15.5:0/200917579 >> v2:172.21.15.154:3300/0 conn(0x7ff5980d2fc0 0x7ff5980b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:56.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.629+0000 7ff59d668640 1 -- 172.21.15.5:0/200917579 >> v1:172.21.15.154:6789/0 conn(0x7ff59815bde0 legacy=0x7ff5980d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:56.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.629+0000 7ff59d668640 1 -- 172.21.15.5:0/200917579 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5980d0aa0 con 0x7ff5980d2300 2023-07-14T12:53:56.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.629+0000 7ff59d668640 1 --2- 172.21.15.5:0/200917579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5980d2300 0x7ff5980d2740 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff59808c600 tx=0x7ff59001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf147d1bf81b6ab server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:56.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.629+0000 7ff5977fe640 1 -- 172.21.15.5:0/200917579 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5900a5890 con 0x7ff5980d2300 2023-07-14T12:53:56.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.629+0000 7ff5977fe640 1 -- 172.21.15.5:0/200917579 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5900a59f0 con 0x7ff5980d2300 2023-07-14T12:53:56.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.629+0000 7ff5977fe640 1 -- 172.21.15.5:0/200917579 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5900a5d80 con 0x7ff5980d2300 2023-07-14T12:53:56.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.633+0000 7ff59f0cb640 1 -- 172.21.15.5:0/200917579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5980d2300 msgr2=0x7ff5980d2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:56.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.633+0000 7ff59f0cb640 1 --2- 172.21.15.5:0/200917579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5980d2300 0x7ff5980d2740 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff59808c600 tx=0x7ff59001c9d0 comp rx=0 tx=0).stop 2023-07-14T12:53:56.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.633+0000 7ff59f0cb640 1 -- 172.21.15.5:0/200917579 shutdown_connections 2023-07-14T12:53:56.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.633+0000 7ff59f0cb640 1 --2- 172.21.15.5:0/200917579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5980d2300 0x7ff5980d2740 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:56.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.633+0000 7ff59f0cb640 1 --2- 172.21.15.5:0/200917579 >> v2:172.21.15.154:3300/0 conn(0x7ff5980d2fc0 0x7ff5980b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:56.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.633+0000 7ff59f0cb640 1 -- 172.21.15.5:0/200917579 >> 172.21.15.5:0/200917579 conn(0x7ff5980659d0 msgr2=0x7ff59809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:56.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.633+0000 7ff59f0cb640 1 -- 172.21.15.5:0/200917579 shutdown_connections 2023-07-14T12:53:56.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.633+0000 7ff59f0cb640 1 -- 172.21.15.5:0/200917579 wait complete. 2023-07-14T12:53:56.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.633+0000 7ff59f0cb640 1 Processor -- start 2023-07-14T12:53:56.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.633+0000 7ff59f0cb640 1 -- start start 2023-07-14T12:53:56.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.633+0000 7ff59f0cb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5980d2300 0x7ff598154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:56.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.633+0000 7ff59f0cb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5980d2fc0 0x7ff5980cee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:56.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.633+0000 7ff59f0cb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff59815bde0 0x7ff5980cf380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:56.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.633+0000 7ff59f0cb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59815dc10 con 0x7ff5980d2300 2023-07-14T12:53:56.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.633+0000 7ff59f0cb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59815def0 con 0x7ff59815bde0 2023-07-14T12:53:56.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.633+0000 7ff59f0cb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59815e1d0 con 0x7ff5980d2fc0 2023-07-14T12:53:56.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.633+0000 7ff59ce67640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5980d2300 0x7ff598154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:56.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.633+0000 7ff59ce67640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5980d2300 0x7ff598154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38896/0 (socket says 172.21.15.5:38896) 2023-07-14T12:53:56.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.633+0000 7ff59ce67640 1 -- 172.21.15.5:0/2559954826 learned_addr learned my addr 172.21.15.5:0/2559954826 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:56.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.633+0000 7ff59d668640 1 --2- 172.21.15.5:0/2559954826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff59815bde0 0x7ff5980cf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:56.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.633+0000 7ff597fff640 1 --2- 172.21.15.5:0/2559954826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5980d2fc0 0x7ff5980cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:56.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.637+0000 7ff59ce67640 1 -- 172.21.15.5:0/2559954826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5980d2fc0 msgr2=0x7ff5980cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:56.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.637+0000 7ff59ce67640 1 --2- 172.21.15.5:0/2559954826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5980d2fc0 0x7ff5980cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:56.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.637+0000 7ff59ce67640 1 -- 172.21.15.5:0/2559954826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff59815bde0 msgr2=0x7ff5980cf380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:56.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.637+0000 7ff59ce67640 1 --2- 172.21.15.5:0/2559954826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff59815bde0 0x7ff5980cf380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:56.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.637+0000 7ff59ce67640 1 -- 172.21.15.5:0/2559954826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff590009b30 con 0x7ff5980d2300 2023-07-14T12:53:56.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.637+0000 7ff59d668640 1 --2- 172.21.15.5:0/2559954826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff59815bde0 0x7ff5980cf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:53:56.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.637+0000 7ff59ce67640 1 --2- 172.21.15.5:0/2559954826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5980d2300 0x7ff598154080 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00c450 tx=0x7ff58c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:56.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.637+0000 7ff5957fa640 1 -- 172.21.15.5:0/2559954826 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c0052d0 con 0x7ff5980d2300 2023-07-14T12:53:56.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.637+0000 7ff5957fa640 1 -- 172.21.15.5:0/2559954826 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58c005430 con 0x7ff5980d2300 2023-07-14T12:53:56.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.637+0000 7ff5957fa640 1 -- 172.21.15.5:0/2559954826 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c003890 con 0x7ff5980d2300 2023-07-14T12:53:56.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.637+0000 7ff59f0cb640 1 -- 172.21.15.5:0/2559954826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5980b1a60 con 0x7ff5980d2300 2023-07-14T12:53:56.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.637+0000 7ff59f0cb640 1 -- 172.21.15.5:0/2559954826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5981545c0 con 0x7ff5980d2300 2023-07-14T12:53:56.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.637+0000 7ff59f0cb640 1 -- 172.21.15.5:0/2559954826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5980b1c80 con 0x7ff5980d2300 2023-07-14T12:53:56.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.637+0000 7ff5957fa640 1 -- 172.21.15.5:0/2559954826 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 85675+0+0 (secure 0 0 0) 0x7ff58c0039f0 con 0x7ff5980d2300 2023-07-14T12:53:56.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.637+0000 7ff5957fa640 1 --2- 172.21.15.5:0/2559954826 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff57c0662d0 0x7ff57c068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:56.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.641+0000 7ff5957fa640 1 -- 172.21.15.5:0/2559954826 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff58c083720 con 0x7ff5980d2300 2023-07-14T12:53:56.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.641+0000 7ff597fff640 1 -- 172.21.15.5:0/2559954826 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff57c0662d0 msgr2=0x7ff57c068780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/2736441655 2023-07-14T12:53:56.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.641+0000 7ff597fff640 1 --2- 172.21.15.5:0/2559954826 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff57c0662d0 0x7ff57c068780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T12:53:56.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.645+0000 7ff5957fa640 1 -- 172.21.15.5:0/2559954826 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff58c050ce0 con 0x7ff5980d2300 2023-07-14T12:53:56.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.805+0000 7ff59f0cb640 1 -- 172.21.15.5:0/2559954826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7ff5980678d0 con 0x7ff5980d2300 2023-07-14T12:53:56.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.809+0000 7ff5957fa640 1 -- 172.21.15.5:0/2559954826 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v11)=0 v11) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff58c054300 con 0x7ff5980d2300 2023-07-14T12:53:56.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.813+0000 7ff59f0cb640 1 -- 172.21.15.5:0/2559954826 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff57c0662d0 msgr2=0x7ff57c068780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T12:53:56.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.813+0000 7ff59f0cb640 1 --2- 172.21.15.5:0/2559954826 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff57c0662d0 0x7ff57c068780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:56.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.813+0000 7ff59f0cb640 1 -- 172.21.15.5:0/2559954826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5980d2300 msgr2=0x7ff598154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:56.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.813+0000 7ff59f0cb640 1 --2- 172.21.15.5:0/2559954826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5980d2300 0x7ff598154080 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00c450 tx=0x7ff58c00c910 comp rx=0 tx=0).stop 2023-07-14T12:53:56.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.813+0000 7ff59f0cb640 1 -- 172.21.15.5:0/2559954826 shutdown_connections 2023-07-14T12:53:56.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.813+0000 7ff59f0cb640 1 --2- 172.21.15.5:0/2559954826 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7ff57c0662d0 0x7ff57c068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:56.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.813+0000 7ff59f0cb640 1 --2- 172.21.15.5:0/2559954826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff59815bde0 0x7ff5980cf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:56.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.813+0000 7ff59f0cb640 1 --2- 172.21.15.5:0/2559954826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5980d2fc0 0x7ff5980cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:56.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.813+0000 7ff59f0cb640 1 --2- 172.21.15.5:0/2559954826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5980d2300 0x7ff598154080 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:56.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.813+0000 7ff59f0cb640 1 -- 172.21.15.5:0/2559954826 >> 172.21.15.5:0/2559954826 conn(0x7ff5980659d0 msgr2=0x7ff5980cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:56.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.813+0000 7ff59f0cb640 1 -- 172.21.15.5:0/2559954826 shutdown_connections 2023-07-14T12:53:56.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.813+0000 7ff59f0cb640 1 -- 172.21.15.5:0/2559954826 wait complete. 2023-07-14T12:53:56.860 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-14T12:53:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.981+0000 7f154a103640 1 Processor -- start 2023-07-14T12:53:57.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.981+0000 7f154a103640 1 -- start start 2023-07-14T12:53:57.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.981+0000 7f154a103640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f154415bde0 0x7f15440d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:57.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.981+0000 7f154a103640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15440b04c0 con 0x7f15440d2300 2023-07-14T12:53:57.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.981+0000 7f154a103640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15440b1060 con 0x7f15440d2fc0 2023-07-14T12:53:57.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.981+0000 7f154a103640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f154415c1b0 con 0x7f154415bde0 2023-07-14T12:53:57.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.981+0000 7f1543fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f15440d2300 0x7f15440cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33114/0 (socket says 172.21.15.5:33114) 2023-07-14T12:53:57.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.981+0000 7f1543fff640 1 -- 172.21.15.5:0/2503828105 learned_addr learned my addr 172.21.15.5:0/2503828105 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:57.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.981+0000 7f15437fe640 1 --2- 172.21.15.5:0/2503828105 >> v2:172.21.15.154:3300/0 conn(0x7f154415bde0 0x7f15440d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:57.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.981+0000 7f15427fc640 1 -- 172.21.15.5:0/2503828105 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 548322488 0 0) 0x7f15440b04c0 con 0x7f15440d2300 2023-07-14T12:53:57.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.985+0000 7f15427fc640 1 -- 172.21.15.5:0/2503828105 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f152c003530 con 0x7f15440d2300 2023-07-14T12:53:57.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.985+0000 7f15427fc640 1 -- 172.21.15.5:0/2503828105 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 536290874 0 0) 0x7f15440b1060 con 0x7f15440d2fc0 2023-07-14T12:53:57.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.985+0000 7f15427fc640 1 -- 172.21.15.5:0/2503828105 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15440b04c0 con 0x7f15440d2fc0 2023-07-14T12:53:57.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.985+0000 7f15437fe640 1 -- 172.21.15.5:0/2503828105 >> v1:172.21.15.154:6789/0 conn(0x7f15440d2fc0 legacy=0x7f15440b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:57.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.985+0000 7f15437fe640 1 -- 172.21.15.5:0/2503828105 >> v1:172.21.15.5:6789/0 conn(0x7f15440d2300 legacy=0x7f15440cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:57.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.985+0000 7f15427fc640 1 -- 172.21.15.5:0/2503828105 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4195380238 0 0) 0x7f152c003530 con 0x7f15440d2300 2023-07-14T12:53:57.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.985+0000 7f15437fe640 1 -- 172.21.15.5:0/2503828105 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15440d0aa0 con 0x7f154415bde0 2023-07-14T12:53:57.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.989+0000 7f15437fe640 1 --2- 172.21.15.5:0/2503828105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f154415bde0 0x7f15440d0270 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f15340097a0 tx=0x7f153401c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cca630dc331dfc4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:57.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.989+0000 7f15427fc640 1 -- 172.21.15.5:0/2503828105 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c001a00 con 0x7f154415bde0 2023-07-14T12:53:57.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.989+0000 7f15427fc640 1 -- 172.21.15.5:0/2503828105 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15340a7050 con 0x7f154415bde0 2023-07-14T12:53:57.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.989+0000 7f15427fc640 1 -- 172.21.15.5:0/2503828105 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15340ab620 con 0x7f154415bde0 2023-07-14T12:53:57.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.989+0000 7f154a103640 1 -- 172.21.15.5:0/2503828105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f154415bde0 msgr2=0x7f15440d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:57.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.989+0000 7f154a103640 1 --2- 172.21.15.5:0/2503828105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f154415bde0 0x7f15440d0270 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f15340097a0 tx=0x7f153401c380 comp rx=0 tx=0).stop 2023-07-14T12:53:57.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.989+0000 7f154a103640 1 -- 172.21.15.5:0/2503828105 shutdown_connections 2023-07-14T12:53:57.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.989+0000 7f154a103640 1 --2- 172.21.15.5:0/2503828105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f154415bde0 0x7f15440d0270 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:57.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.989+0000 7f154a103640 1 -- 172.21.15.5:0/2503828105 >> 172.21.15.5:0/2503828105 conn(0x7f15440659d0 msgr2=0x7f154409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:57.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.989+0000 7f154a103640 1 -- 172.21.15.5:0/2503828105 shutdown_connections 2023-07-14T12:53:57.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.989+0000 7f154a103640 1 -- 172.21.15.5:0/2503828105 wait complete. 2023-07-14T12:53:57.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.993+0000 7f154a103640 1 Processor -- start 2023-07-14T12:53:57.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.993+0000 7f154a103640 1 -- start start 2023-07-14T12:53:57.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.993+0000 7f154a103640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15440d2300 0x7f154414ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:57.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.993+0000 7f154a103640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15440d2fc0 0x7f1544152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:57.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.993+0000 7f154a103640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f154415bde0 0x7f1544153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:57.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.993+0000 7f154a103640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1544158a90 con 0x7f154415bde0 2023-07-14T12:53:57.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.993+0000 7f154a103640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154414e300 con 0x7f15440d2fc0 2023-07-14T12:53:57.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.993+0000 7f154a103640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1544152060 con 0x7f15440d2300 2023-07-14T12:53:57.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.993+0000 7f1543fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f154415bde0 0x7f1544153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:57.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.993+0000 7f1543fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f154415bde0 0x7f1544153b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38906/0 (socket says 172.21.15.5:38906) 2023-07-14T12:53:57.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.993+0000 7f1543fff640 1 -- 172.21.15.5:0/3576472211 learned_addr learned my addr 172.21.15.5:0/3576472211 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:57.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.993+0000 7f15437fe640 1 --2- 172.21.15.5:0/3576472211 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15440d2300 0x7f154414ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:57.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.993+0000 7f1542ffd640 1 --2- 172.21.15.5:0/3576472211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15440d2fc0 0x7f1544152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:57.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.993+0000 7f1543fff640 1 -- 172.21.15.5:0/3576472211 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15440d2300 msgr2=0x7f154414ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:57.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.993+0000 7f1543fff640 1 --2- 172.21.15.5:0/3576472211 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15440d2300 0x7f154414ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:57.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.993+0000 7f1543fff640 1 -- 172.21.15.5:0/3576472211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15440d2fc0 msgr2=0x7f1544152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:57.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.993+0000 7f1543fff640 1 --2- 172.21.15.5:0/3576472211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15440d2fc0 0x7f1544152da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:57.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.993+0000 7f1543fff640 1 -- 172.21.15.5:0/3576472211 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15340093b0 con 0x7f154415bde0 2023-07-14T12:53:57.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.993+0000 7f1543fff640 1 --2- 172.21.15.5:0/3576472211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f154415bde0 0x7f1544153b20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f153c002010 tx=0x7f153c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:57.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.993+0000 7f152bfff640 1 -- 172.21.15.5:0/3576472211 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c012400 con 0x7f154415bde0 2023-07-14T12:53:57.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.993+0000 7f152bfff640 1 -- 172.21.15.5:0/3576472211 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153c012580 con 0x7f154415bde0 2023-07-14T12:53:57.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.993+0000 7f154a103640 1 -- 172.21.15.5:0/3576472211 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1544152340 con 0x7f154415bde0 2023-07-14T12:53:57.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.993+0000 7f152bfff640 1 -- 172.21.15.5:0/3576472211 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c012930 con 0x7f154415bde0 2023-07-14T12:53:57.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.993+0000 7f154a103640 1 -- 172.21.15.5:0/3576472211 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1544158660 con 0x7f154415bde0 2023-07-14T12:53:57.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.993+0000 7f154a103640 1 -- 172.21.15.5:0/3576472211 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1544158bd0 con 0x7f154415bde0 2023-07-14T12:53:57.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.997+0000 7f152bfff640 1 -- 172.21.15.5:0/3576472211 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 85675+0+0 (secure 0 0 0) 0x7f153c012a90 con 0x7f154415bde0 2023-07-14T12:53:57.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.997+0000 7f152bfff640 1 --2- 172.21.15.5:0/3576472211 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f15300662d0 0x7f1530068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:57.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.997+0000 7f152bfff640 1 -- 172.21.15.5:0/3576472211 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f153c0844a0 con 0x7f154415bde0 2023-07-14T12:53:57.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.997+0000 7f15437fe640 1 -- 172.21.15.5:0/3576472211 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f15300662d0 msgr2=0x7f1530068780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/2736441655 2023-07-14T12:53:57.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:56.997+0000 7f15437fe640 1 --2- 172.21.15.5:0/3576472211 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f15300662d0 0x7f1530068780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T12:53:57.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.001+0000 7f152bfff640 1 -- 172.21.15.5:0/3576472211 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f1544158bd0 con 0x7f154415bde0 2023-07-14T12:53:57.058 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:53:57.029+0000 7f6e0fc1a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T12:53:57.102 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:53:57.073+0000 7f74893d4180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T12:53:57.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.161+0000 7f154a103640 1 -- 172.21.15.5:0/3576472211 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f1544158bd0 con 0x7f154415bde0 2023-07-14T12:53:57.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.165+0000 7f152bfff640 1 -- 172.21.15.5:0/3576472211 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v12)=0 v12) v1 ==== 133+0+0 (secure 0 0 0) 0x7f1544158bd0 con 0x7f154415bde0 2023-07-14T12:53:57.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.165+0000 7f154a103640 1 -- 172.21.15.5:0/3576472211 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f15300662d0 msgr2=0x7f1530068780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T12:53:57.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.165+0000 7f154a103640 1 --2- 172.21.15.5:0/3576472211 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f15300662d0 0x7f1530068780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:57.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.165+0000 7f154a103640 1 -- 172.21.15.5:0/3576472211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f154415bde0 msgr2=0x7f1544153b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:57.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.165+0000 7f154a103640 1 --2- 172.21.15.5:0/3576472211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f154415bde0 0x7f1544153b20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f153c002010 tx=0x7f153c00a430 comp rx=0 tx=0).stop 2023-07-14T12:53:57.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.165+0000 7f154a103640 1 -- 172.21.15.5:0/3576472211 shutdown_connections 2023-07-14T12:53:57.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.165+0000 7f154a103640 1 --2- 172.21.15.5:0/3576472211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f154415bde0 0x7f1544153b20 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:57.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.165+0000 7f154a103640 1 --2- 172.21.15.5:0/3576472211 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f15300662d0 0x7f1530068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:57.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.165+0000 7f154a103640 1 --2- 172.21.15.5:0/3576472211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15440d2fc0 0x7f1544152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:57.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.165+0000 7f154a103640 1 --2- 172.21.15.5:0/3576472211 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15440d2300 0x7f154414ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:57.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.165+0000 7f154a103640 1 -- 172.21.15.5:0/3576472211 >> 172.21.15.5:0/3576472211 conn(0x7f15440659d0 msgr2=0x7f15440b0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:57.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.165+0000 7f154a103640 1 -- 172.21.15.5:0/3576472211 shutdown_connections 2023-07-14T12:53:57.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.165+0000 7f154a103640 1 -- 172.21.15.5:0/3576472211 wait complete. 2023-07-14T12:53:57.209 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:53:57.181+0000 7f6e0fc1a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T12:53:57.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:57.216 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-14T12:53:57.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:53:57.237 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir0) 2023-07-14T12:53:57.265 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:53:57.237+0000 7f74893d4180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T12:53:57.278 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir0 1M 2023-07-14T12:53:57.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.441+0000 7f2048bfa640 1 Processor -- start 2023-07-14T12:53:57.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.441+0000 7f2048bfa640 1 -- start start 2023-07-14T12:53:57.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.445+0000 7f2048bfa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f204415bde0 0x7f20440d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:57.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.445+0000 7f2048bfa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20440d2fc0 0x7f20440b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:57.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.445+0000 7f2048bfa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20440b04c0 con 0x7f20440d2300 2023-07-14T12:53:57.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.445+0000 7f2048bfa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f204415c1b0 con 0x7f204415bde0 2023-07-14T12:53:57.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.445+0000 7f2048bfa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20440d0aa0 con 0x7f20440d2fc0 2023-07-14T12:53:57.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.445+0000 7f2042d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f20440d2300 0x7f20440cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33120/0 (socket says 172.21.15.5:33120) 2023-07-14T12:53:57.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.445+0000 7f2042d9d640 1 -- 172.21.15.5:0/1319035730 learned_addr learned my addr 172.21.15.5:0/1319035730 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:53:57.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.445+0000 7f204259c640 1 --2- 172.21.15.5:0/1319035730 >> v2:172.21.15.154:3300/0 conn(0x7f204415bde0 0x7f20440d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:57.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.445+0000 7f203bfff640 1 --2- 172.21.15.5:0/1319035730 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20440d2fc0 0x7f20440b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:57.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.445+0000 7f203bfff640 1 -- 172.21.15.5:0/1319035730 >> v2:172.21.15.154:3300/0 conn(0x7f204415bde0 msgr2=0x7f20440d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:53:57.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.445+0000 7f203bfff640 1 --2- 172.21.15.5:0/1319035730 >> v2:172.21.15.154:3300/0 conn(0x7f204415bde0 0x7f20440d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:57.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.445+0000 7f203bfff640 1 -- 172.21.15.5:0/1319035730 >> v1:172.21.15.5:6789/0 conn(0x7f20440d2300 legacy=0x7f20440cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:57.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.445+0000 7f203bfff640 1 -- 172.21.15.5:0/1319035730 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20440afb90 con 0x7f20440d2fc0 2023-07-14T12:53:57.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.445+0000 7f2041d9b640 1 -- 172.21.15.5:0/1319035730 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2850025822 0 0) 0x7f20440b04c0 con 0x7f20440d2300 2023-07-14T12:53:57.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.445+0000 7f204259c640 1 --2- 172.21.15.5:0/1319035730 >> v2:172.21.15.154:3300/0 conn(0x7f204415bde0 0x7f20440d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:53:57.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.449+0000 7f203bfff640 1 --2- 172.21.15.5:0/1319035730 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20440d2fc0 0x7f20440b0950 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f202c0097c0 tx=0x7f202c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42006670488a36ac server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:57.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.449+0000 7f2041d9b640 1 -- 172.21.15.5:0/1319035730 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202c0ab680 con 0x7f20440d2fc0 2023-07-14T12:53:57.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.449+0000 7f2041d9b640 1 -- 172.21.15.5:0/1319035730 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f202c0ab7e0 con 0x7f20440d2fc0 2023-07-14T12:53:57.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.449+0000 7f2041d9b640 1 -- 172.21.15.5:0/1319035730 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202c0abb70 con 0x7f20440d2fc0 2023-07-14T12:53:57.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.449+0000 7f2048bfa640 1 -- 172.21.15.5:0/1319035730 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20440d2fc0 msgr2=0x7f20440b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:57.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.449+0000 7f2048bfa640 1 --2- 172.21.15.5:0/1319035730 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20440d2fc0 0x7f20440b0950 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f202c0097c0 tx=0x7f202c01c480 comp rx=0 tx=0).stop 2023-07-14T12:53:57.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.449+0000 7f2048bfa640 1 -- 172.21.15.5:0/1319035730 shutdown_connections 2023-07-14T12:53:57.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.449+0000 7f2048bfa640 1 --2- 172.21.15.5:0/1319035730 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20440d2fc0 0x7f20440b0950 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:57.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.449+0000 7f2048bfa640 1 --2- 172.21.15.5:0/1319035730 >> v2:172.21.15.154:3300/0 conn(0x7f204415bde0 0x7f20440d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:57.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.449+0000 7f2048bfa640 1 -- 172.21.15.5:0/1319035730 >> 172.21.15.5:0/1319035730 conn(0x7f20440659d0 msgr2=0x7f204409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:57.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.449+0000 7f2048bfa640 1 -- 172.21.15.5:0/1319035730 shutdown_connections 2023-07-14T12:53:57.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.449+0000 7f2048bfa640 1 -- 172.21.15.5:0/1319035730 wait complete. 2023-07-14T12:53:57.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.453+0000 7f2048bfa640 1 Processor -- start 2023-07-14T12:53:57.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.453+0000 7f2048bfa640 1 -- start start 2023-07-14T12:53:57.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.453+0000 7f2048bfa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20440d2300 0x7f20440c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:57.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.453+0000 7f2048bfa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20440d2fc0 0x7f2044151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:57.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.453+0000 7f2048bfa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f204415bde0 0x7f20440cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:57.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.453+0000 7f2048bfa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20440b4220 con 0x7f20440d2300 2023-07-14T12:53:57.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.453+0000 7f2048bfa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20440c63e0 con 0x7f20440d2fc0 2023-07-14T12:53:57.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.453+0000 7f2048bfa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2044151d80 con 0x7f204415bde0 2023-07-14T12:53:57.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.453+0000 7f204259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20440d2300 0x7f20440c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:57.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.453+0000 7f204259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20440d2300 0x7f20440c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38922/0 (socket says 172.21.15.5:38922) 2023-07-14T12:53:57.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.453+0000 7f204259c640 1 -- 172.21.15.5:0/3144288873 learned_addr learned my addr 172.21.15.5:0/3144288873 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:53:57.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.453+0000 7f203bfff640 1 --2- 172.21.15.5:0/3144288873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20440d2fc0 0x7f2044151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:57.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.453+0000 7f2042d9d640 1 --2- 172.21.15.5:0/3144288873 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f204415bde0 0x7f20440cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:57.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.453+0000 7f204259c640 1 -- 172.21.15.5:0/3144288873 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f204415bde0 msgr2=0x7f20440cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:57.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.453+0000 7f204259c640 1 --2- 172.21.15.5:0/3144288873 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f204415bde0 0x7f20440cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:57.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.453+0000 7f204259c640 1 -- 172.21.15.5:0/3144288873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20440d2fc0 msgr2=0x7f2044151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:57.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.453+0000 7f204259c640 1 --2- 172.21.15.5:0/3144288873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20440d2fc0 0x7f2044151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:57.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.453+0000 7f204259c640 1 -- 172.21.15.5:0/3144288873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20340093b0 con 0x7f20440d2300 2023-07-14T12:53:57.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.453+0000 7f204259c640 1 --2- 172.21.15.5:0/3144288873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20440d2300 0x7f20440c5ea0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f203400ebe0 tx=0x7f203400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:57.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.453+0000 7f203affd640 1 -- 172.21.15.5:0/3144288873 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2034009760 con 0x7f20440d2300 2023-07-14T12:53:57.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.453+0000 7f203affd640 1 -- 172.21.15.5:0/3144288873 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203400cc30 con 0x7f20440d2300 2023-07-14T12:53:57.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.453+0000 7f2048bfa640 1 -- 172.21.15.5:0/3144288873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202c009420 con 0x7f20440d2300 2023-07-14T12:53:57.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.453+0000 7f203affd640 1 -- 172.21.15.5:0/3144288873 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203400eee0 con 0x7f20440d2300 2023-07-14T12:53:57.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.453+0000 7f2048bfa640 1 -- 172.21.15.5:0/3144288873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20440b3880 con 0x7f20440d2300 2023-07-14T12:53:57.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.457+0000 7f2048bfa640 1 -- 172.21.15.5:0/3144288873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20440678d0 con 0x7f20440d2300 2023-07-14T12:53:57.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.457+0000 7f203affd640 1 -- 172.21.15.5:0/3144288873 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 6) v1 ==== 85675+0+0 (secure 0 0 0) 0x7f20340059a0 con 0x7f20440d2300 2023-07-14T12:53:57.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.457+0000 7f203affd640 1 --2- 172.21.15.5:0/3144288873 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f20240662d0 0x7f2024068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:57.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.457+0000 7f203affd640 1 -- 172.21.15.5:0/3144288873 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f20340841c0 con 0x7f20440d2300 2023-07-14T12:53:57.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.457+0000 7f203bfff640 1 -- 172.21.15.5:0/3144288873 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f20240662d0 msgr2=0x7f2024068780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/2736441655 2023-07-14T12:53:57.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.457+0000 7f203bfff640 1 --2- 172.21.15.5:0/3144288873 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f20240662d0 0x7f2024068780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T12:53:57.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.465+0000 7f203affd640 1 -- 172.21.15.5:0/3144288873 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f20340516e0 con 0x7f20440d2300 2023-07-14T12:53:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.641+0000 7f2048bfa640 1 -- 172.21.15.5:0/3144288873 --> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f20440d2b70 con 0x7f20240662d0 2023-07-14T12:53:57.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.661+0000 7f203bfff640 1 -- 172.21.15.5:0/3144288873 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f20240662d0 msgr2=0x7f2024068780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/2736441655 2023-07-14T12:53:57.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:57.661+0000 7f203bfff640 1 --2- 172.21.15.5:0/3144288873 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f20240662d0 0x7f2024068780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-14T12:53:57.689 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:53:57.661+0000 7f6e0fc1a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T12:53:57.747 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:53:57.721+0000 7f6e0fc1a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T12:53:57.784 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:53:57.757+0000 7f74893d4180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T12:53:57.803 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:53:57.777+0000 7f6e0fc1a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T12:53:57.846 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:53:57.817+0000 7f74893d4180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T12:53:57.888 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:53:57.861+0000 7f6e0fc1a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T12:53:57.905 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:53:57.877+0000 7f74893d4180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T12:53:57.946 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:53:57.917+0000 7f6e0fc1a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T12:53:57.995 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:53:57.965+0000 7f74893d4180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T12:53:58.029 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:53:58.001+0000 7f6e0fc1a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T12:53:58.054 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:53:58.025+0000 7f74893d4180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T12:53:58.085 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:53:58.057+0000 7f6e0fc1a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T12:53:58.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:58.065+0000 7f203bfff640 1 -- 172.21.15.5:0/3144288873 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f20240662d0 msgr2=0x7f2024068780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/2736441655 2023-07-14T12:53:58.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:58.065+0000 7f203bfff640 1 --2- 172.21.15.5:0/3144288873 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f20240662d0 0x7f2024068780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-14T12:53:58.142 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:53:58.113+0000 7f74893d4180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T12:53:58.201 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:53:58.173+0000 7f74893d4180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T12:53:58.226 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:53:58.201+0000 7f6e0fc1a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T12:53:58.284 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:53:58.257+0000 7f6e0fc1a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T12:53:58.351 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:53:58.321+0000 7f74893d4180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T12:53:58.411 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:53:58.385+0000 7f74893d4180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T12:53:58.524 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T12:53:58.525 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T12:53:58.525 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2023-07-14T12:53:58.532 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:53:58.505+0000 7f6e0fc1a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T12:53:58.661 INFO:tasks.ceph.mgr.y.smithi005.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T12:53:58.661 INFO:tasks.ceph.mgr.y.smithi005.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T12:53:58.662 INFO:tasks.ceph.mgr.y.smithi005.stderr: from numpy import show_config as show_numpy_config 2023-07-14T12:53:58.665 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:53:58.637+0000 7f6e0fc1a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T12:53:58.669 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:53:58.641+0000 7f74893d4180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T12:53:58.792 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:53:58.765+0000 7f6e0fc1a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T12:53:58.812 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:53:58.785+0000 7f74893d4180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T12:53:58.864 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:53:58.837+0000 7f6e0fc1a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T12:53:58.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:58.869+0000 7f203bfff640 1 -- 172.21.15.5:0/3144288873 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f20240662d0 msgr2=0x7f2024068780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/2736441655 2023-07-14T12:53:58.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:53:58.869+0000 7f203bfff640 1 --2- 172.21.15.5:0/3144288873 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f20240662d0 0x7f2024068780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-14T12:53:58.943 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:53:58.913+0000 7f74893d4180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T12:53:58.997 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:53:58.969+0000 7f6e0fc1a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T12:53:59.017 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:53:58.989+0000 7f74893d4180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T12:53:59.157 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:53:59.129+0000 7f74893d4180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T12:53:59.532 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:53:59.505+0000 7f6e0fc1a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T12:53:59.616 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:53:59.589+0000 7f6e0fc1a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T12:53:59.725 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:53:59.697+0000 7f74893d4180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T12:53:59.767 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:53:59.741+0000 7f6e0fc1a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T12:53:59.815 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:53:59.785+0000 7f74893d4180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T12:53:59.851 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:53:59.825+0000 7f6e0fc1a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T12:53:59.970 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:53:59.941+0000 7f74893d4180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T12:54:00.058 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:54:00.029+0000 7f74893d4180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T12:54:00.123 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:54:00.097+0000 7f6e0fc1a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T12:54:00.183 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:54:00.157+0000 7f6e0fc1a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T12:54:00.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:00.169+0000 7f203affd640 1 -- 172.21.15.5:0/3144288873 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 7) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f2034051ab0 con 0x7f20440d2300 2023-07-14T12:54:00.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:00.169+0000 7f203affd640 1 -- 172.21.15.5:0/3144288873 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f20240662d0 msgr2=0x7f2024068780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T12:54:00.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:00.169+0000 7f203affd640 1 --2- 172.21.15.5:0/3144288873 >> [v2:172.21.15.154:6832/2736441655,v1:172.21.15.154:6833/2736441655] conn(0x7f20240662d0 0x7f2024068780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:00.333 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:54:00.305+0000 7f6d8ed81640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:54:00.333 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:54:00.305+0000 7f6d8ed81640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:54:00.333 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:54:00.305+0000 7f6d8ed81640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:54:00.333 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:54:00.305+0000 7f6d8ed81640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:54:00.333 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:54:00.305+0000 7f6d8ed81640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:54:00.334 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:54:00.305+0000 7f6d91586640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:54:00.334 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:54:00.305+0000 7f6d91586640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:54:00.334 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:54:00.305+0000 7f6d91586640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:54:00.334 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:54:00.305+0000 7f6d91586640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:54:00.334 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:54:00.305+0000 7f6d91586640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:54:00.363 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:54:00.333+0000 7f74893d4180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T12:54:00.425 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T12:54:00.397+0000 7f74893d4180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T12:54:01.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.173+0000 7f203affd640 1 -- 172.21.15.5:0/3144288873 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mgrmap(e 8) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f203401f170 con 0x7f20440d2300 2023-07-14T12:54:01.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.173+0000 7f203affd640 1 --2- 172.21.15.5:0/3144288873 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f2024033d90 0x7f20240707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:01.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.173+0000 7f203affd640 1 -- 172.21.15.5:0/3144288873 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f2024034160 con 0x7f2024033d90 2023-07-14T12:54:01.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.177+0000 7f203bfff640 1 --2- 172.21.15.5:0/3144288873 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f2024033d90 0x7f20240707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:01.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.177+0000 7f203bfff640 1 --2- 172.21.15.5:0/3144288873 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f2024033d90 0x7f20240707a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f202c0af000 tx=0x7f202c0a7000 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:01.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.265+0000 7f203affd640 1 -- 172.21.15.5:0/3144288873 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f2024034160 con 0x7f2024033d90 2023-07-14T12:54:01.294 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule set for path /snap_test_dir1/dir0 2023-07-14T12:54:01.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.265+0000 7f2048bfa640 1 -- 172.21.15.5:0/3144288873 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f2024033d90 msgr2=0x7f20240707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:01.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.265+0000 7f2048bfa640 1 --2- 172.21.15.5:0/3144288873 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f2024033d90 0x7f20240707a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f202c0af000 tx=0x7f202c0a7000 comp rx=0 tx=0).stop 2023-07-14T12:54:01.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.265+0000 7f2048bfa640 1 -- 172.21.15.5:0/3144288873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20440d2300 msgr2=0x7f20440c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:01.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.265+0000 7f2048bfa640 1 --2- 172.21.15.5:0/3144288873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20440d2300 0x7f20440c5ea0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f203400ebe0 tx=0x7f203400c520 comp rx=0 tx=0).stop 2023-07-14T12:54:01.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.265+0000 7f2042d9d640 1 -- 172.21.15.5:0/3144288873 reap_dead start 2023-07-14T12:54:01.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.265+0000 7f2048bfa640 1 -- 172.21.15.5:0/3144288873 shutdown_connections 2023-07-14T12:54:01.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.265+0000 7f2048bfa640 1 -- 172.21.15.5:0/3144288873 >> 172.21.15.5:0/3144288873 conn(0x7f20440659d0 msgr2=0x7f20440b71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:01.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.265+0000 7f2048bfa640 1 -- 172.21.15.5:0/3144288873 shutdown_connections 2023-07-14T12:54:01.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.265+0000 7f2048bfa640 1 -- 172.21.15.5:0/3144288873 wait complete. 2023-07-14T12:54:01.315 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir0 2023-07-14T12:54:01.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:54:01.317 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir1) 2023-07-14T12:54:01.329 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir1 1M 2023-07-14T12:54:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.497+0000 7fbaf28f9640 1 Processor -- start 2023-07-14T12:54:01.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.497+0000 7fbaf28f9640 1 -- start start 2023-07-14T12:54:01.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.497+0000 7fbaf28f9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbaec0aeb40 0x7fbaec15cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:01.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.497+0000 7fbaf28f9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbaec159440 0x7fbaec0c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:01.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.497+0000 7fbaf28f9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaec1532b0 con 0x7fbaec0aef10 2023-07-14T12:54:01.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.497+0000 7fbaf28f9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaec0ca6f0 con 0x7fbaec159440 2023-07-14T12:54:01.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.497+0000 7fbaf28f9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaec1599d0 con 0x7fbaec0aeb40 2023-07-14T12:54:01.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.497+0000 7fbaf0e96640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbaec159440 0x7fbaec0c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:01.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.497+0000 7fbaf0e96640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbaec159440 0x7fbaec0c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60954/0 (socket says 172.21.15.5:60954) 2023-07-14T12:54:01.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.497+0000 7fbaf0e96640 1 -- 172.21.15.5:0/3330992077 learned_addr learned my addr 172.21.15.5:0/3330992077 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:01.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.497+0000 7fbaebfff640 1 --2- 172.21.15.5:0/3330992077 >> v2:172.21.15.154:3300/0 conn(0x7fbaec0aeb40 0x7fbaec15cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:01.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.497+0000 7fbaf0e96640 1 -- 172.21.15.5:0/3330992077 >> v2:172.21.15.154:3300/0 conn(0x7fbaec0aeb40 msgr2=0x7fbaec15cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:54:01.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.497+0000 7fbaf0e96640 1 --2- 172.21.15.5:0/3330992077 >> v2:172.21.15.154:3300/0 conn(0x7fbaec0aeb40 0x7fbaec15cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:01.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.497+0000 7fbaf0e96640 1 -- 172.21.15.5:0/3330992077 >> v1:172.21.15.5:6789/0 conn(0x7fbaec0aef10 legacy=0x7fbaec158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:01.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.497+0000 7fbaf0e96640 1 -- 172.21.15.5:0/3330992077 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaec159cb0 con 0x7fbaec159440 2023-07-14T12:54:01.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.497+0000 7fbaebfff640 1 --2- 172.21.15.5:0/3330992077 >> v2:172.21.15.154:3300/0 conn(0x7fbaec0aeb40 0x7fbaec15cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:54:01.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.501+0000 7fbaf0e96640 1 --2- 172.21.15.5:0/3330992077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaec159440 0x7fbaec0c88c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbaec071ad0 tx=0x7fbae401eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e969d044a0c093 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:01.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.501+0000 7fbaeaffd640 1 -- 172.21.15.5:0/3330992077 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae40a79f0 con 0x7fbaec159440 2023-07-14T12:54:01.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.501+0000 7fbaeaffd640 1 -- 172.21.15.5:0/3330992077 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae40a7b50 con 0x7fbaec159440 2023-07-14T12:54:01.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.501+0000 7fbaeaffd640 1 -- 172.21.15.5:0/3330992077 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae40af3f0 con 0x7fbaec159440 2023-07-14T12:54:01.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.501+0000 7fbaf28f9640 1 -- 172.21.15.5:0/3330992077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaec159440 msgr2=0x7fbaec0c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:01.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.501+0000 7fbaf28f9640 1 --2- 172.21.15.5:0/3330992077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaec159440 0x7fbaec0c88c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbaec071ad0 tx=0x7fbae401eb20 comp rx=0 tx=0).stop 2023-07-14T12:54:01.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.501+0000 7fbaf28f9640 1 -- 172.21.15.5:0/3330992077 shutdown_connections 2023-07-14T12:54:01.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.501+0000 7fbaf28f9640 1 --2- 172.21.15.5:0/3330992077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaec159440 0x7fbaec0c88c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:01.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.501+0000 7fbaf28f9640 1 --2- 172.21.15.5:0/3330992077 >> v2:172.21.15.154:3300/0 conn(0x7fbaec0aeb40 0x7fbaec15cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:01.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.501+0000 7fbaf28f9640 1 -- 172.21.15.5:0/3330992077 >> 172.21.15.5:0/3330992077 conn(0x7fbaec0cde90 msgr2=0x7fbaec0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:01.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.501+0000 7fbaf28f9640 1 -- 172.21.15.5:0/3330992077 shutdown_connections 2023-07-14T12:54:01.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.501+0000 7fbaf28f9640 1 -- 172.21.15.5:0/3330992077 wait complete. 2023-07-14T12:54:01.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.505+0000 7fbaf28f9640 1 Processor -- start 2023-07-14T12:54:01.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.505+0000 7fbaf28f9640 1 -- start start 2023-07-14T12:54:01.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.505+0000 7fbaf28f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbaec0aeb40 0x7fbaec14da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:01.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.505+0000 7fbaf28f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbaec0aef10 0x7fbaec06ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:01.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.505+0000 7fbaf28f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaec159440 0x7fbaec1579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:01.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.505+0000 7fbaf28f9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec163010 con 0x7fbaec159440 2023-07-14T12:54:01.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.505+0000 7fbaf28f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec162770 con 0x7fbaec0aef10 2023-07-14T12:54:01.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.505+0000 7fbaf28f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec162a50 con 0x7fbaec0aeb40 2023-07-14T12:54:01.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.505+0000 7fbaf0e96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaec159440 0x7fbaec1579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:01.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.505+0000 7fbaf0e96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaec159440 0x7fbaec1579f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60964/0 (socket says 172.21.15.5:60964) 2023-07-14T12:54:01.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.505+0000 7fbaf0e96640 1 -- 172.21.15.5:0/79577150 learned_addr learned my addr 172.21.15.5:0/79577150 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:01.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.505+0000 7fbaeb7fe640 1 --2- 172.21.15.5:0/79577150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbaec0aef10 0x7fbaec06ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:01.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.505+0000 7fbaebfff640 1 --2- 172.21.15.5:0/79577150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbaec0aeb40 0x7fbaec14da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:01.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.505+0000 7fbaf0e96640 1 -- 172.21.15.5:0/79577150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbaec0aeb40 msgr2=0x7fbaec14da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:01.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.505+0000 7fbaf0e96640 1 --2- 172.21.15.5:0/79577150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbaec0aeb40 0x7fbaec14da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:01.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.505+0000 7fbaf0e96640 1 -- 172.21.15.5:0/79577150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbaec0aef10 msgr2=0x7fbaec06ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:01.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.505+0000 7fbaf0e96640 1 --2- 172.21.15.5:0/79577150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbaec0aef10 0x7fbaec06ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:01.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.505+0000 7fbaf0e96640 1 -- 172.21.15.5:0/79577150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae4009b30 con 0x7fbaec159440 2023-07-14T12:54:01.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.505+0000 7fbaebfff640 1 --2- 172.21.15.5:0/79577150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbaec0aeb40 0x7fbaec14da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:54:01.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.505+0000 7fbaeb7fe640 1 --2- 172.21.15.5:0/79577150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbaec0aef10 0x7fbaec06ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:54:01.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.505+0000 7fbaf0e96640 1 --2- 172.21.15.5:0/79577150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaec159440 0x7fbaec1579f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbae401b730 tx=0x7fbae401b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:01.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.505+0000 7fbae8ff9640 1 -- 172.21.15.5:0/79577150 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae40a79f0 con 0x7fbaec159440 2023-07-14T12:54:01.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.505+0000 7fbae8ff9640 1 -- 172.21.15.5:0/79577150 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae400e150 con 0x7fbaec159440 2023-07-14T12:54:01.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.505+0000 7fbae8ff9640 1 -- 172.21.15.5:0/79577150 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae4009510 con 0x7fbaec159440 2023-07-14T12:54:01.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.505+0000 7fbaf28f9640 1 -- 172.21.15.5:0/79577150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaec162d30 con 0x7fbaec159440 2023-07-14T12:54:01.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.505+0000 7fbaf28f9640 1 -- 172.21.15.5:0/79577150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaec14df50 con 0x7fbaec159440 2023-07-14T12:54:01.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.505+0000 7fbaf28f9640 1 -- 172.21.15.5:0/79577150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaec0c64a0 con 0x7fbaec159440 2023-07-14T12:54:01.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.509+0000 7fbae8ff9640 1 -- 172.21.15.5:0/79577150 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fbaec0c9610 con 0x7fbaec159440 2023-07-14T12:54:01.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.509+0000 7fbae8ff9640 1 --2- 172.21.15.5:0/79577150 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fbad8066150 0x7fbad8068600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:01.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.509+0000 7fbae8ff9640 1 -- 172.21.15.5:0/79577150 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fbae411dbb0 con 0x7fbaec159440 2023-07-14T12:54:01.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.509+0000 7fbaebfff640 1 --2- 172.21.15.5:0/79577150 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fbad8066150 0x7fbad8068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:01.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.509+0000 7fbaebfff640 1 --2- 172.21.15.5:0/79577150 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fbad8066150 0x7fbad8068600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbadc009970 tx=0x7fbadc008040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:01.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.513+0000 7fbae8ff9640 1 -- 172.21.15.5:0/79577150 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fbaec0c64a0 con 0x7fbaec159440 2023-07-14T12:54:01.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.685+0000 7fbaf28f9640 1 -- 172.21.15.5:0/79577150 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbaec15c9d0 con 0x7fbad8066150 2023-07-14T12:54:01.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.753+0000 7fbae8ff9640 1 -- 172.21.15.5:0/79577150 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fbadc010870 con 0x7fbad8066150 2023-07-14T12:54:01.784 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule set for path /snap_test_dir1/dir1 2023-07-14T12:54:01.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.757+0000 7fbaf28f9640 1 -- 172.21.15.5:0/79577150 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fbad8066150 msgr2=0x7fbad8068600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:01.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.757+0000 7fbaf28f9640 1 --2- 172.21.15.5:0/79577150 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fbad8066150 0x7fbad8068600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbadc009970 tx=0x7fbadc008040 comp rx=0 tx=0).stop 2023-07-14T12:54:01.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.757+0000 7fbaf28f9640 1 -- 172.21.15.5:0/79577150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaec159440 msgr2=0x7fbaec1579f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:01.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.757+0000 7fbaf28f9640 1 --2- 172.21.15.5:0/79577150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaec159440 0x7fbaec1579f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbae401b730 tx=0x7fbae401b8c0 comp rx=0 tx=0).stop 2023-07-14T12:54:01.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.757+0000 7fbaf28f9640 1 -- 172.21.15.5:0/79577150 shutdown_connections 2023-07-14T12:54:01.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.757+0000 7fbaf28f9640 1 --2- 172.21.15.5:0/79577150 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fbad8066150 0x7fbad8068600 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:01.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.757+0000 7fbaf28f9640 1 --2- 172.21.15.5:0/79577150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbaec159440 0x7fbaec1579f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:01.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.757+0000 7fbaf28f9640 1 --2- 172.21.15.5:0/79577150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbaec0aef10 0x7fbaec06ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:01.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.757+0000 7fbaf28f9640 1 --2- 172.21.15.5:0/79577150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbaec0aeb40 0x7fbaec14da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:01.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.757+0000 7fbaf28f9640 1 -- 172.21.15.5:0/79577150 >> 172.21.15.5:0/79577150 conn(0x7fbaec0cde90 msgr2=0x7fbaec15a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:01.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.757+0000 7fbaf28f9640 1 -- 172.21.15.5:0/79577150 shutdown_connections 2023-07-14T12:54:01.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.757+0000 7fbaf28f9640 1 -- 172.21.15.5:0/79577150 wait complete. 2023-07-14T12:54:01.805 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir1 2023-07-14T12:54:01.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:54:01.805 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir2) 2023-07-14T12:54:01.816 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir2 1M 2023-07-14T12:54:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.981+0000 7f83bd0d8640 1 Processor -- start 2023-07-14T12:54:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.981+0000 7f83bd0d8640 1 -- start start 2023-07-14T12:54:02.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.981+0000 7f83bd0d8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f83b815f690 0x7f83b80b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:02.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.981+0000 7f83bd0d8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83b81453a0 0x7f83b815fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:02.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.981+0000 7f83bd0d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83b806c4d0 0x7f83b806c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:02.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.981+0000 7f83bd0d8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b806c040 con 0x7f83b81453a0 2023-07-14T12:54:02.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.981+0000 7f83bd0d8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b8160600 con 0x7f83b815f690 2023-07-14T12:54:02.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.981+0000 7f83bd0d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b8160360 con 0x7f83b806c4d0 2023-07-14T12:54:02.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.981+0000 7f83affff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83b81453a0 0x7f83b815fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:02.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.981+0000 7f83affff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83b81453a0 0x7f83b815fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60968/0 (socket says 172.21.15.5:60968) 2023-07-14T12:54:02.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.981+0000 7f83affff640 1 -- 172.21.15.5:0/782323535 learned_addr learned my addr 172.21.15.5:0/782323535 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:02.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.981+0000 7f83b759e640 1 --2- 172.21.15.5:0/782323535 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83b806c4d0 0x7f83b806c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:02.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.981+0000 7f83b6d9d640 1 --2- 172.21.15.5:0/782323535 >> v2:172.21.15.154:3300/0 conn(0x7f83b815f690 0x7f83b80b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:02.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.981+0000 7f83affff640 1 -- 172.21.15.5:0/782323535 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83b806c4d0 msgr2=0x7f83b806c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:54:02.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.981+0000 7f83affff640 1 --2- 172.21.15.5:0/782323535 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83b806c4d0 0x7f83b806c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:02.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.981+0000 7f83affff640 1 -- 172.21.15.5:0/782323535 >> v2:172.21.15.154:3300/0 conn(0x7f83b815f690 msgr2=0x7f83b80b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:54:02.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.981+0000 7f83affff640 1 --2- 172.21.15.5:0/782323535 >> v2:172.21.15.154:3300/0 conn(0x7f83b815f690 0x7f83b80b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:02.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.981+0000 7f83affff640 1 -- 172.21.15.5:0/782323535 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b806b9f0 con 0x7f83b81453a0 2023-07-14T12:54:02.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.985+0000 7f83affff640 1 --2- 172.21.15.5:0/782323535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83b81453a0 0x7f83b815fa60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f83b80aba90 tx=0x7f83a001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568cbe8a0a311144 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:02.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.985+0000 7f83b659c640 1 -- 172.21.15.5:0/782323535 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a00ac640 con 0x7f83b81453a0 2023-07-14T12:54:02.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.985+0000 7f83b659c640 1 -- 172.21.15.5:0/782323535 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a00ac7a0 con 0x7f83b81453a0 2023-07-14T12:54:02.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.985+0000 7f83b659c640 1 -- 172.21.15.5:0/782323535 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a00acb30 con 0x7f83b81453a0 2023-07-14T12:54:02.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.985+0000 7f83bd0d8640 1 -- 172.21.15.5:0/782323535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83b81453a0 msgr2=0x7f83b815fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:02.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.985+0000 7f83bd0d8640 1 --2- 172.21.15.5:0/782323535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83b81453a0 0x7f83b815fa60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f83b80aba90 tx=0x7f83a001c440 comp rx=0 tx=0).stop 2023-07-14T12:54:02.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.985+0000 7f83bd0d8640 1 -- 172.21.15.5:0/782323535 shutdown_connections 2023-07-14T12:54:02.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.985+0000 7f83bd0d8640 1 --2- 172.21.15.5:0/782323535 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83b806c4d0 0x7f83b806c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:02.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.985+0000 7f83bd0d8640 1 --2- 172.21.15.5:0/782323535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83b81453a0 0x7f83b815fa60 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:02.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.985+0000 7f83bd0d8640 1 --2- 172.21.15.5:0/782323535 >> v2:172.21.15.154:3300/0 conn(0x7f83b815f690 0x7f83b80b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:02.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.985+0000 7f83bd0d8640 1 -- 172.21.15.5:0/782323535 >> 172.21.15.5:0/782323535 conn(0x7f83b80b1210 msgr2=0x7f83b80ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:02.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.985+0000 7f83bd0d8640 1 -- 172.21.15.5:0/782323535 shutdown_connections 2023-07-14T12:54:02.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.985+0000 7f83bd0d8640 1 -- 172.21.15.5:0/782323535 wait complete. 2023-07-14T12:54:02.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.989+0000 7f83bd0d8640 1 Processor -- start 2023-07-14T12:54:02.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.989+0000 7f83bd0d8640 1 -- start start 2023-07-14T12:54:02.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.989+0000 7f83bd0d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83b806c4d0 0x7f83b81582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:02.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.989+0000 7f83bd0d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83b81453a0 0x7f83b8143160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:02.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.989+0000 7f83bd0d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83b815f690 0x7f83b81436a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:02.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.989+0000 7f83bd0d8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b815aa90 con 0x7f83b806c4d0 2023-07-14T12:54:02.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.989+0000 7f83bd0d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b8158be0 con 0x7f83b815f690 2023-07-14T12:54:02.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.989+0000 7f83bd0d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b8158ec0 con 0x7f83b81453a0 2023-07-14T12:54:02.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.989+0000 7f83b6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83b806c4d0 0x7f83b81582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:02.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.989+0000 7f83b6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83b806c4d0 0x7f83b81582e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60980/0 (socket says 172.21.15.5:60980) 2023-07-14T12:54:02.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.989+0000 7f83b6d9d640 1 -- 172.21.15.5:0/313442086 learned_addr learned my addr 172.21.15.5:0/313442086 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:02.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.989+0000 7f83affff640 1 --2- 172.21.15.5:0/313442086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83b81453a0 0x7f83b8143160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:02.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.989+0000 7f83b759e640 1 --2- 172.21.15.5:0/313442086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83b815f690 0x7f83b81436a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:02.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.989+0000 7f83b6d9d640 1 -- 172.21.15.5:0/313442086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83b81453a0 msgr2=0x7f83b8143160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:02.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.989+0000 7f83b6d9d640 1 --2- 172.21.15.5:0/313442086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83b81453a0 0x7f83b8143160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:02.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.989+0000 7f83b6d9d640 1 -- 172.21.15.5:0/313442086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83b815f690 msgr2=0x7f83b81436a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:02.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.989+0000 7f83b6d9d640 1 --2- 172.21.15.5:0/313442086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83b815f690 0x7f83b81436a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:02.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.989+0000 7f83b6d9d640 1 -- 172.21.15.5:0/313442086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a00094d0 con 0x7f83b806c4d0 2023-07-14T12:54:02.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.989+0000 7f83b6d9d640 1 --2- 172.21.15.5:0/313442086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83b806c4d0 0x7f83b81582e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f83a800e930 tx=0x7f83a800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:02.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.989+0000 7f83af7fe640 1 -- 172.21.15.5:0/313442086 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a8009690 con 0x7f83b806c4d0 2023-07-14T12:54:02.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.989+0000 7f83af7fe640 1 -- 172.21.15.5:0/313442086 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a800ca00 con 0x7f83b806c4d0 2023-07-14T12:54:02.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.989+0000 7f83bd0d8640 1 -- 172.21.15.5:0/313442086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b81591a0 con 0x7f83b806c4d0 2023-07-14T12:54:02.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.989+0000 7f83af7fe640 1 -- 172.21.15.5:0/313442086 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a800cd70 con 0x7f83b806c4d0 2023-07-14T12:54:02.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.989+0000 7f83bd0d8640 1 -- 172.21.15.5:0/313442086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b8158820 con 0x7f83b806c4d0 2023-07-14T12:54:02.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.993+0000 7f83bd0d8640 1 -- 172.21.15.5:0/313442086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b80678d0 con 0x7f83b806c4d0 2023-07-14T12:54:02.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.993+0000 7f83af7fe640 1 -- 172.21.15.5:0/313442086 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f83a8013470 con 0x7f83b806c4d0 2023-07-14T12:54:02.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.993+0000 7f83af7fe640 1 --2- 172.21.15.5:0/313442086 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f8398066120 0x7f83980685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:02.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.993+0000 7f83af7fe640 1 -- 172.21.15.5:0/313442086 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f83a8083d00 con 0x7f83b806c4d0 2023-07-14T12:54:02.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.993+0000 7f83affff640 1 --2- 172.21.15.5:0/313442086 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f8398066120 0x7f83980685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:02.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.993+0000 7f83affff640 1 --2- 172.21.15.5:0/313442086 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f8398066120 0x7f83980685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f83a00ae000 tx=0x7f83a0008040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:02.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:01.997+0000 7f83af7fe640 1 -- 172.21.15.5:0/313442086 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f83a8051480 con 0x7f83b806c4d0 2023-07-14T12:54:02.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.173+0000 7f83bd0d8640 1 -- 172.21.15.5:0/313442086 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f83b8159030 con 0x7f8398066120 2023-07-14T12:54:02.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.221+0000 7f83af7fe640 1 -- 172.21.15.5:0/313442086 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f83a8051850 con 0x7f83b806c4d0 2023-07-14T12:54:02.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.241+0000 7f83af7fe640 1 -- 172.21.15.5:0/313442086 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f83b8159030 con 0x7f8398066120 2023-07-14T12:54:02.269 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule set for path /snap_test_dir1/dir2 2023-07-14T12:54:02.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.241+0000 7f83bd0d8640 1 -- 172.21.15.5:0/313442086 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f8398066120 msgr2=0x7f83980685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:02.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.241+0000 7f83bd0d8640 1 --2- 172.21.15.5:0/313442086 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f8398066120 0x7f83980685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f83a00ae000 tx=0x7f83a0008040 comp rx=0 tx=0).stop 2023-07-14T12:54:02.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.241+0000 7f83bd0d8640 1 -- 172.21.15.5:0/313442086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83b806c4d0 msgr2=0x7f83b81582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:02.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.241+0000 7f83bd0d8640 1 --2- 172.21.15.5:0/313442086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83b806c4d0 0x7f83b81582e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f83a800e930 tx=0x7f83a800edf0 comp rx=0 tx=0).stop 2023-07-14T12:54:02.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.241+0000 7f83bd0d8640 1 -- 172.21.15.5:0/313442086 shutdown_connections 2023-07-14T12:54:02.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.241+0000 7f83bd0d8640 1 --2- 172.21.15.5:0/313442086 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f8398066120 0x7f83980685d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:02.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.241+0000 7f83bd0d8640 1 --2- 172.21.15.5:0/313442086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83b815f690 0x7f83b81436a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:02.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.241+0000 7f83bd0d8640 1 --2- 172.21.15.5:0/313442086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f83b81453a0 0x7f83b8143160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:02.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.241+0000 7f83bd0d8640 1 --2- 172.21.15.5:0/313442086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83b806c4d0 0x7f83b81582e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:02.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.241+0000 7f83bd0d8640 1 -- 172.21.15.5:0/313442086 >> 172.21.15.5:0/313442086 conn(0x7f83b80b1210 msgr2=0x7f83b80b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:02.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.241+0000 7f83bd0d8640 1 -- 172.21.15.5:0/313442086 shutdown_connections 2023-07-14T12:54:02.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.241+0000 7f83bd0d8640 1 -- 172.21.15.5:0/313442086 wait complete. 2023-07-14T12:54:02.290 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir2 2023-07-14T12:54:02.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:54:02.291 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir3) 2023-07-14T12:54:02.302 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir3 1M 2023-07-14T12:54:02.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.465+0000 7f42a643a640 1 Processor -- start 2023-07-14T12:54:02.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.465+0000 7f42a643a640 1 -- start start 2023-07-14T12:54:02.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.465+0000 7f42a643a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f42a00d03f0 0x7f42a00ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.465+0000 7f42a643a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f42a00b11b0 0x7f42a00aece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.465+0000 7f42a643a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a00ceaa0 con 0x7f42a015bb10 2023-07-14T12:54:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.465+0000 7f42a643a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a00ce690 con 0x7f42a00b11b0 2023-07-14T12:54:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.465+0000 7f42a643a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a00d1fb0 con 0x7f42a00d03f0 2023-07-14T12:54:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.465+0000 7f42a5438640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f42a015bb10 0x7f42a00cfce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52102/0 (socket says 172.21.15.5:52102) 2023-07-14T12:54:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.465+0000 7f42a5438640 1 -- 172.21.15.5:0/3126100929 learned_addr learned my addr 172.21.15.5:0/3126100929 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:54:02.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.465+0000 7f42a5c39640 1 --2- 172.21.15.5:0/3126100929 >> v2:172.21.15.5:3300/0 conn(0x7f42a00b11b0 0x7f42a00aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.465+0000 7f42a4c37640 1 --2- 172.21.15.5:0/3126100929 >> v2:172.21.15.154:3300/0 conn(0x7f42a00d03f0 0x7f42a00ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.465+0000 7f42a5c39640 1 -- 172.21.15.5:0/3126100929 >> v2:172.21.15.154:3300/0 conn(0x7f42a00d03f0 msgr2=0x7f42a00ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:54:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.465+0000 7f42a5c39640 1 --2- 172.21.15.5:0/3126100929 >> v2:172.21.15.154:3300/0 conn(0x7f42a00d03f0 0x7f42a00ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.465+0000 7f42a5c39640 1 -- 172.21.15.5:0/3126100929 >> v1:172.21.15.5:6789/0 conn(0x7f42a015bb10 legacy=0x7f42a00cfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:02.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.465+0000 7f42a5c39640 1 -- 172.21.15.5:0/3126100929 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a00ced80 con 0x7f42a00b11b0 2023-07-14T12:54:02.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.469+0000 7f42a5c39640 1 --2- 172.21.15.5:0/3126100929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42a00b11b0 0x7f42a00aece0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f42a006c650 tx=0x7f429801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97667084af32fc4a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:02.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.469+0000 7f4297fff640 1 -- 172.21.15.5:0/3126100929 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42980a5910 con 0x7f42a00b11b0 2023-07-14T12:54:02.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.469+0000 7f4297fff640 1 -- 172.21.15.5:0/3126100929 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42980a5a70 con 0x7f42a00b11b0 2023-07-14T12:54:02.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.469+0000 7f4297fff640 1 -- 172.21.15.5:0/3126100929 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42980a5e00 con 0x7f42a00b11b0 2023-07-14T12:54:02.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.469+0000 7f42a643a640 1 -- 172.21.15.5:0/3126100929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42a00b11b0 msgr2=0x7f42a00aece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:02.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.469+0000 7f42a643a640 1 --2- 172.21.15.5:0/3126100929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42a00b11b0 0x7f42a00aece0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f42a006c650 tx=0x7f429801c850 comp rx=0 tx=0).stop 2023-07-14T12:54:02.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.469+0000 7f42a643a640 1 -- 172.21.15.5:0/3126100929 shutdown_connections 2023-07-14T12:54:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.469+0000 7f42a643a640 1 --2- 172.21.15.5:0/3126100929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42a00b11b0 0x7f42a00aece0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.469+0000 7f42a643a640 1 --2- 172.21.15.5:0/3126100929 >> v2:172.21.15.154:3300/0 conn(0x7f42a00d03f0 0x7f42a00ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.469+0000 7f42a643a640 1 -- 172.21.15.5:0/3126100929 >> 172.21.15.5:0/3126100929 conn(0x7f42a009b480 msgr2=0x7f42a00d2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.469+0000 7f42a643a640 1 -- 172.21.15.5:0/3126100929 shutdown_connections 2023-07-14T12:54:02.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.469+0000 7f42a643a640 1 -- 172.21.15.5:0/3126100929 wait complete. 2023-07-14T12:54:02.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.473+0000 7f42a643a640 1 Processor -- start 2023-07-14T12:54:02.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.473+0000 7f42a643a640 1 -- start start 2023-07-14T12:54:02.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.473+0000 7f42a643a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42a00b11b0 0x7f42a01f7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:02.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.473+0000 7f42a643a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42a00d03f0 0x7f42a014f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:02.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.473+0000 7f42a643a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42a015bb10 0x7f42a014f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:02.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.473+0000 7f42a643a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a014de20 con 0x7f42a00b11b0 2023-07-14T12:54:02.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.473+0000 7f42a643a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a014e100 con 0x7f42a015bb10 2023-07-14T12:54:02.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.473+0000 7f42a643a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a01568e0 con 0x7f42a00d03f0 2023-07-14T12:54:02.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.473+0000 7f42a5438640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42a00b11b0 0x7f42a01f7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:02.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.473+0000 7f42a5438640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42a00b11b0 0x7f42a01f7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32774/0 (socket says 172.21.15.5:32774) 2023-07-14T12:54:02.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.473+0000 7f42a5438640 1 -- 172.21.15.5:0/1248874565 learned_addr learned my addr 172.21.15.5:0/1248874565 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:02.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.473+0000 7f42a4c37640 1 --2- 172.21.15.5:0/1248874565 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42a00d03f0 0x7f42a014f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:02.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.473+0000 7f42a5c39640 1 --2- 172.21.15.5:0/1248874565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42a015bb10 0x7f42a014f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:02.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.473+0000 7f42a5438640 1 -- 172.21.15.5:0/1248874565 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42a00d03f0 msgr2=0x7f42a014f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:02.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.473+0000 7f42a5438640 1 --2- 172.21.15.5:0/1248874565 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42a00d03f0 0x7f42a014f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:02.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.473+0000 7f42a5438640 1 -- 172.21.15.5:0/1248874565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42a015bb10 msgr2=0x7f42a014f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:02.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.473+0000 7f42a5438640 1 --2- 172.21.15.5:0/1248874565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42a015bb10 0x7f42a014f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:02.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.473+0000 7f42a5438640 1 -- 172.21.15.5:0/1248874565 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4298009a70 con 0x7f42a00b11b0 2023-07-14T12:54:02.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.473+0000 7f42a5438640 1 --2- 172.21.15.5:0/1248874565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42a00b11b0 0x7f42a01f7d00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f429c00c400 tx=0x7f429c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:02.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.473+0000 7f4295ffb640 1 -- 172.21.15.5:0/1248874565 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c005cf0 con 0x7f42a00b11b0 2023-07-14T12:54:02.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.473+0000 7f4295ffb640 1 -- 172.21.15.5:0/1248874565 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429c005e50 con 0x7f42a00b11b0 2023-07-14T12:54:02.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.473+0000 7f4295ffb640 1 -- 172.21.15.5:0/1248874565 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c0072d0 con 0x7f42a00b11b0 2023-07-14T12:54:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.473+0000 7f42a643a640 1 -- 172.21.15.5:0/1248874565 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a0156bc0 con 0x7f42a00b11b0 2023-07-14T12:54:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.473+0000 7f42a643a640 1 -- 172.21.15.5:0/1248874565 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a014d2a0 con 0x7f42a00b11b0 2023-07-14T12:54:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.477+0000 7f42a643a640 1 -- 172.21.15.5:0/1248874565 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a0156740 con 0x7f42a00b11b0 2023-07-14T12:54:02.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.477+0000 7f4295ffb640 1 -- 172.21.15.5:0/1248874565 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f429c007430 con 0x7f42a00b11b0 2023-07-14T12:54:02.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.477+0000 7f4295ffb640 1 --2- 172.21.15.5:0/1248874565 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4284066480 0x7f4284068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:02.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.477+0000 7f4295ffb640 1 -- 172.21.15.5:0/1248874565 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f429c0836f0 con 0x7f42a00b11b0 2023-07-14T12:54:02.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.477+0000 7f42a4c37640 1 --2- 172.21.15.5:0/1248874565 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4284066480 0x7f4284068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:02.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.477+0000 7f42a4c37640 1 --2- 172.21.15.5:0/1248874565 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4284066480 0x7f4284068930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f42a01f71c0 tx=0x7f4290008040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:02.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.481+0000 7f4295ffb640 1 -- 172.21.15.5:0/1248874565 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f42a0156740 con 0x7f42a00b11b0 2023-07-14T12:54:02.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.653+0000 7f42a643a640 1 -- 172.21.15.5:0/1248874565 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f42a015bee0 con 0x7f4284066480 2023-07-14T12:54:02.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.713+0000 7f4295ffb640 1 -- 172.21.15.5:0/1248874565 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f429000f830 con 0x7f4284066480 2023-07-14T12:54:02.741 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule set for path /snap_test_dir1/dir3 2023-07-14T12:54:02.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.713+0000 7f42a643a640 1 -- 172.21.15.5:0/1248874565 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4284066480 msgr2=0x7f4284068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:02.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.713+0000 7f42a643a640 1 --2- 172.21.15.5:0/1248874565 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4284066480 0x7f4284068930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f42a01f71c0 tx=0x7f4290008040 comp rx=0 tx=0).stop 2023-07-14T12:54:02.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.713+0000 7f42a643a640 1 -- 172.21.15.5:0/1248874565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42a00b11b0 msgr2=0x7f42a01f7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:02.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.713+0000 7f42a643a640 1 --2- 172.21.15.5:0/1248874565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42a00b11b0 0x7f42a01f7d00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f429c00c400 tx=0x7f429c00c8c0 comp rx=0 tx=0).stop 2023-07-14T12:54:02.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.713+0000 7f42a643a640 1 -- 172.21.15.5:0/1248874565 shutdown_connections 2023-07-14T12:54:02.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.713+0000 7f42a643a640 1 --2- 172.21.15.5:0/1248874565 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4284066480 0x7f4284068930 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:02.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.713+0000 7f42a643a640 1 --2- 172.21.15.5:0/1248874565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42a015bb10 0x7f42a014f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:02.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.713+0000 7f42a643a640 1 --2- 172.21.15.5:0/1248874565 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42a00d03f0 0x7f42a014f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:02.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.713+0000 7f42a643a640 1 --2- 172.21.15.5:0/1248874565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42a00b11b0 0x7f42a01f7d00 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:02.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.713+0000 7f42a643a640 1 -- 172.21.15.5:0/1248874565 >> 172.21.15.5:0/1248874565 conn(0x7f42a009b480 msgr2=0x7f42a01559b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:02.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.713+0000 7f42a643a640 1 -- 172.21.15.5:0/1248874565 shutdown_connections 2023-07-14T12:54:02.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.713+0000 7f42a643a640 1 -- 172.21.15.5:0/1248874565 wait complete. 2023-07-14T12:54:02.762 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir3 2023-07-14T12:54:02.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:54:02.763 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir4) 2023-07-14T12:54:02.774 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir4 1M 2023-07-14T12:54:02.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.933+0000 7f358feec640 1 Processor -- start 2023-07-14T12:54:02.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.933+0000 7f358feec640 1 -- start start 2023-07-14T12:54:02.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.937+0000 7f358feec640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3588070f30 0x7f35880ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:02.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.937+0000 7f358feec640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35880af2b0 0x7f358815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:02.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.937+0000 7f358feec640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3588159d70 con 0x7f3588069430 2023-07-14T12:54:02.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.937+0000 7f358feec640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35880c9c60 con 0x7f3588070f30 2023-07-14T12:54:02.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.937+0000 7f358feec640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35880c9f40 con 0x7f35880af2b0 2023-07-14T12:54:02.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.937+0000 7f358dc88640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3588069430 0x7f3588069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52112/0 (socket says 172.21.15.5:52112) 2023-07-14T12:54:02.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.937+0000 7f358dc88640 1 -- 172.21.15.5:0/3935397844 learned_addr learned my addr 172.21.15.5:0/3935397844 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:54:02.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.937+0000 7f358d487640 1 --2- 172.21.15.5:0/3935397844 >> v2:172.21.15.154:3300/0 conn(0x7f3588070f30 0x7f35880ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:02.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.937+0000 7f358e489640 1 --2- 172.21.15.5:0/3935397844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35880af2b0 0x7f358815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:02.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.937+0000 7f358cc86640 1 -- 172.21.15.5:0/3935397844 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2790760133 0 0) 0x7f3584001120 con 0x7f3588069430 2023-07-14T12:54:02.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.937+0000 7f358cc86640 1 -- 172.21.15.5:0/3935397844 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3574003530 con 0x7f3588069430 2023-07-14T12:54:02.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.937+0000 7f358d487640 1 -- 172.21.15.5:0/3935397844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35880af2b0 msgr2=0x7f358815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:54:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.937+0000 7f358d487640 1 --2- 172.21.15.5:0/3935397844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35880af2b0 0x7f358815a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.937+0000 7f358d487640 1 -- 172.21.15.5:0/3935397844 >> v1:172.21.15.5:6789/0 conn(0x7f3588069430 legacy=0x7f3588069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.937+0000 7f358d487640 1 -- 172.21.15.5:0/3935397844 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35880ca220 con 0x7f3588070f30 2023-07-14T12:54:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.941+0000 7f358d487640 1 --2- 172.21.15.5:0/3935397844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3588070f30 0x7f35880ad6f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f35780097c0 tx=0x7f357801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dae1329f8203b19c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.941+0000 7f358cc86640 1 -- 172.21.15.5:0/3935397844 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35780ab680 con 0x7f3588070f30 2023-07-14T12:54:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.941+0000 7f358cc86640 1 -- 172.21.15.5:0/3935397844 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35780ab7e0 con 0x7f3588070f30 2023-07-14T12:54:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.941+0000 7f358cc86640 1 -- 172.21.15.5:0/3935397844 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35780abb70 con 0x7f3588070f30 2023-07-14T12:54:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.941+0000 7f358feec640 1 -- 172.21.15.5:0/3935397844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3588070f30 msgr2=0x7f35880ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:02.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.941+0000 7f358feec640 1 --2- 172.21.15.5:0/3935397844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3588070f30 0x7f35880ad6f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f35780097c0 tx=0x7f357801c480 comp rx=0 tx=0).stop 2023-07-14T12:54:02.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.941+0000 7f358feec640 1 -- 172.21.15.5:0/3935397844 shutdown_connections 2023-07-14T12:54:02.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.941+0000 7f358feec640 1 --2- 172.21.15.5:0/3935397844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35880af2b0 0x7f358815a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:02.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.941+0000 7f358feec640 1 --2- 172.21.15.5:0/3935397844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3588070f30 0x7f35880ad6f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:02.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.941+0000 7f358feec640 1 -- 172.21.15.5:0/3935397844 >> 172.21.15.5:0/3935397844 conn(0x7f35880cde90 msgr2=0x7f35880ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:02.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.941+0000 7f358feec640 1 -- 172.21.15.5:0/3935397844 shutdown_connections 2023-07-14T12:54:02.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.941+0000 7f358feec640 1 -- 172.21.15.5:0/3935397844 wait complete. 2023-07-14T12:54:02.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.941+0000 7f358feec640 1 Processor -- start 2023-07-14T12:54:02.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.941+0000 7f358feec640 1 -- start start 2023-07-14T12:54:02.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.945+0000 7f358feec640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3588069430 0x7f35880ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.945+0000 7f358feec640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3588070f30 0x7f35881f4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.945+0000 7f358feec640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35880af2b0 0x7f35880ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.945+0000 7f358feec640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35881f4b30 con 0x7f35880af2b0 2023-07-14T12:54:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.945+0000 7f358feec640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35881f4e10 con 0x7f3588069430 2023-07-14T12:54:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.945+0000 7f358feec640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35881f50f0 con 0x7f3588070f30 2023-07-14T12:54:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.945+0000 7f358e489640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35880af2b0 0x7f35880ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.945+0000 7f358e489640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35880af2b0 0x7f35880ab890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32790/0 (socket says 172.21.15.5:32790) 2023-07-14T12:54:02.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.945+0000 7f358e489640 1 -- 172.21.15.5:0/3370691563 learned_addr learned my addr 172.21.15.5:0/3370691563 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.945+0000 7f358dc88640 1 --2- 172.21.15.5:0/3370691563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3588069430 0x7f35880ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.945+0000 7f358d487640 1 --2- 172.21.15.5:0/3370691563 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3588070f30 0x7f35881f4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.945+0000 7f358e489640 1 -- 172.21.15.5:0/3370691563 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3588070f30 msgr2=0x7f35881f4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.945+0000 7f358e489640 1 --2- 172.21.15.5:0/3370691563 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3588070f30 0x7f35881f4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.945+0000 7f358e489640 1 -- 172.21.15.5:0/3370691563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3588069430 msgr2=0x7f35880ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.945+0000 7f358e489640 1 --2- 172.21.15.5:0/3370691563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3588069430 0x7f35880ca740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:02.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.945+0000 7f358e489640 1 -- 172.21.15.5:0/3370691563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3578009420 con 0x7f35880af2b0 2023-07-14T12:54:02.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.945+0000 7f358d487640 1 --2- 172.21.15.5:0/3370691563 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3588070f30 0x7f35881f4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:54:02.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.945+0000 7f358e489640 1 --2- 172.21.15.5:0/3370691563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35880af2b0 0x7f35880ab890 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f358000efc0 tx=0x7f358000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:02.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.945+0000 7f357e7fc640 1 -- 172.21.15.5:0/3370691563 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3580014480 con 0x7f35880af2b0 2023-07-14T12:54:02.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.945+0000 7f357e7fc640 1 -- 172.21.15.5:0/3370691563 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358000f040 con 0x7f35880af2b0 2023-07-14T12:54:02.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.945+0000 7f357e7fc640 1 -- 172.21.15.5:0/3370691563 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3580014820 con 0x7f35880af2b0 2023-07-14T12:54:02.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.945+0000 7f358feec640 1 -- 172.21.15.5:0/3370691563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35880c5fa0 con 0x7f35880af2b0 2023-07-14T12:54:02.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.945+0000 7f358feec640 1 -- 172.21.15.5:0/3370691563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35881f4760 con 0x7f35880af2b0 2023-07-14T12:54:02.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.945+0000 7f358feec640 1 -- 172.21.15.5:0/3370691563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35880c5dd0 con 0x7f35880af2b0 2023-07-14T12:54:02.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.949+0000 7f357e7fc640 1 -- 172.21.15.5:0/3370691563 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f3580014980 con 0x7f35880af2b0 2023-07-14T12:54:02.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.949+0000 7f357e7fc640 1 --2- 172.21.15.5:0/3370691563 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f356c066480 0x7f356c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:02.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.949+0000 7f357e7fc640 1 -- 172.21.15.5:0/3370691563 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f3580084ef0 con 0x7f35880af2b0 2023-07-14T12:54:02.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.949+0000 7f358dc88640 1 --2- 172.21.15.5:0/3370691563 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f356c066480 0x7f356c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:02.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.949+0000 7f358dc88640 1 --2- 172.21.15.5:0/3370691563 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f356c066480 0x7f356c068930 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3584001280 tx=0x7f3584009040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:02.953+0000 7f357e7fc640 1 -- 172.21.15.5:0/3370691563 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3580051e60 con 0x7f35880af2b0 2023-07-14T12:54:03.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.125+0000 7f358feec640 1 -- 172.21.15.5:0/3370691563 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3588157710 con 0x7f356c066480 2023-07-14T12:54:03.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.181+0000 7f357e7fc640 1 -- 172.21.15.5:0/3370691563 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f3584001c80 con 0x7f356c066480 2023-07-14T12:54:03.209 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule set for path /snap_test_dir1/dir4 2023-07-14T12:54:03.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.181+0000 7f358feec640 1 -- 172.21.15.5:0/3370691563 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f356c066480 msgr2=0x7f356c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:03.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.181+0000 7f358feec640 1 --2- 172.21.15.5:0/3370691563 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f356c066480 0x7f356c068930 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3584001280 tx=0x7f3584009040 comp rx=0 tx=0).stop 2023-07-14T12:54:03.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.181+0000 7f358feec640 1 -- 172.21.15.5:0/3370691563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35880af2b0 msgr2=0x7f35880ab890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:03.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.181+0000 7f358feec640 1 --2- 172.21.15.5:0/3370691563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35880af2b0 0x7f35880ab890 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f358000efc0 tx=0x7f358000c490 comp rx=0 tx=0).stop 2023-07-14T12:54:03.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.181+0000 7f358feec640 1 -- 172.21.15.5:0/3370691563 shutdown_connections 2023-07-14T12:54:03.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.181+0000 7f358feec640 1 --2- 172.21.15.5:0/3370691563 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f356c066480 0x7f356c068930 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:03.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.181+0000 7f358feec640 1 --2- 172.21.15.5:0/3370691563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35880af2b0 0x7f35880ab890 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:03.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.181+0000 7f358feec640 1 --2- 172.21.15.5:0/3370691563 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3588070f30 0x7f35881f4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:03.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.181+0000 7f358feec640 1 --2- 172.21.15.5:0/3370691563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3588069430 0x7f35880ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:03.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.181+0000 7f358feec640 1 -- 172.21.15.5:0/3370691563 >> 172.21.15.5:0/3370691563 conn(0x7f35880cde90 msgr2=0x7f35880acca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:03.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.181+0000 7f358feec640 1 -- 172.21.15.5:0/3370691563 shutdown_connections 2023-07-14T12:54:03.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.181+0000 7f358feec640 1 -- 172.21.15.5:0/3370691563 wait complete. 2023-07-14T12:54:03.229 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir4 2023-07-14T12:54:03.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:54:03.230 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir5) 2023-07-14T12:54:03.241 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir5 1M 2023-07-14T12:54:03.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.405+0000 7f263307b640 1 Processor -- start 2023-07-14T12:54:03.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.409+0000 7f263307b640 1 -- start start 2023-07-14T12:54:03.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.409+0000 7f263307b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f262c15beb0 0x7f262c0cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:03.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.409+0000 7f263307b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f262c06db00 0x7f262c0ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:03.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.409+0000 7f263307b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f262c0cb6a0 con 0x7f262c0b0760 2023-07-14T12:54:03.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.409+0000 7f263307b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f262c06d020 con 0x7f262c06db00 2023-07-14T12:54:03.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.409+0000 7f263307b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262c06d300 con 0x7f262c15beb0 2023-07-14T12:54:03.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.409+0000 7f262bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f262c06db00 0x7f262c0ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:03.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.409+0000 7f2631618640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f262c0b0760 0x7f262c0cbf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:52306/0 (socket says 172.21.15.5:52306) 2023-07-14T12:54:03.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.409+0000 7f2630e17640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f262c15beb0 0x7f262c0cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:03.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.409+0000 7f2631618640 1 -- 172.21.15.5:0/4058095102 learned_addr learned my addr 172.21.15.5:0/4058095102 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:54:03.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.409+0000 7f262b7fe640 1 -- 172.21.15.5:0/4058095102 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912921530 0 0) 0x7f262c0cb6a0 con 0x7f262c0b0760 2023-07-14T12:54:03.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.409+0000 7f2630e17640 1 -- 172.21.15.5:0/4058095102 >> v2:172.21.15.154:3300/0 conn(0x7f262c06db00 msgr2=0x7f262c0ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:54:03.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.409+0000 7f2630e17640 1 --2- 172.21.15.5:0/4058095102 >> v2:172.21.15.154:3300/0 conn(0x7f262c06db00 0x7f262c0ca0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:03.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.409+0000 7f2630e17640 1 -- 172.21.15.5:0/4058095102 >> v1:172.21.15.154:6789/0 conn(0x7f262c0b0760 legacy=0x7f262c0cbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:03.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.409+0000 7f2630e17640 1 -- 172.21.15.5:0/4058095102 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262c06d5e0 con 0x7f262c15beb0 2023-07-14T12:54:03.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.409+0000 7f262bfff640 1 --2- 172.21.15.5:0/4058095102 >> v2:172.21.15.154:3300/0 conn(0x7f262c06db00 0x7f262c0ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:54:03.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.413+0000 7f2630e17640 1 --2- 172.21.15.5:0/4058095102 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f262c15beb0 0x7f262c0cada0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f26200097c0 tx=0x7f262001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6b5a8d9c5ed259f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:03.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.413+0000 7f262b7fe640 1 -- 172.21.15.5:0/4058095102 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26200ab600 con 0x7f262c15beb0 2023-07-14T12:54:03.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.413+0000 7f262b7fe640 1 -- 172.21.15.5:0/4058095102 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26200a7050 con 0x7f262c15beb0 2023-07-14T12:54:03.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.413+0000 7f262b7fe640 1 -- 172.21.15.5:0/4058095102 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26200ab980 con 0x7f262c15beb0 2023-07-14T12:54:03.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.413+0000 7f263307b640 1 -- 172.21.15.5:0/4058095102 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f262c15beb0 msgr2=0x7f262c0cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:03.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.413+0000 7f263307b640 1 --2- 172.21.15.5:0/4058095102 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f262c15beb0 0x7f262c0cada0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f26200097c0 tx=0x7f262001c3f0 comp rx=0 tx=0).stop 2023-07-14T12:54:03.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.413+0000 7f263307b640 1 -- 172.21.15.5:0/4058095102 shutdown_connections 2023-07-14T12:54:03.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.413+0000 7f263307b640 1 --2- 172.21.15.5:0/4058095102 >> v2:172.21.15.154:3300/0 conn(0x7f262c06db00 0x7f262c0ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:03.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.413+0000 7f263307b640 1 --2- 172.21.15.5:0/4058095102 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f262c15beb0 0x7f262c0cada0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:03.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.413+0000 7f263307b640 1 -- 172.21.15.5:0/4058095102 >> 172.21.15.5:0/4058095102 conn(0x7f262c06c2f0 msgr2=0x7f262c0aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:03.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.413+0000 7f263307b640 1 -- 172.21.15.5:0/4058095102 shutdown_connections 2023-07-14T12:54:03.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.413+0000 7f263307b640 1 -- 172.21.15.5:0/4058095102 wait complete. 2023-07-14T12:54:03.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.413+0000 7f263307b640 1 Processor -- start 2023-07-14T12:54:03.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.417+0000 7f263307b640 1 -- start start 2023-07-14T12:54:03.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.417+0000 7f263307b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262c06db00 0x7f262c0c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:03.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.417+0000 7f263307b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f262c0b0760 0x7f262c1488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:03.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.417+0000 7f263307b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f262c15beb0 0x7f262c151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:03.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.417+0000 7f263307b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c0c3ad0 con 0x7f262c06db00 2023-07-14T12:54:03.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.417+0000 7f263307b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c0c44a0 con 0x7f262c15beb0 2023-07-14T12:54:03.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.417+0000 7f263307b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262c0c34c0 con 0x7f262c0b0760 2023-07-14T12:54:03.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.417+0000 7f2630e17640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262c06db00 0x7f262c0c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:03.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.417+0000 7f2630e17640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262c06db00 0x7f262c0c3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32796/0 (socket says 172.21.15.5:32796) 2023-07-14T12:54:03.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.417+0000 7f2630e17640 1 -- 172.21.15.5:0/1895717111 learned_addr learned my addr 172.21.15.5:0/1895717111 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:03.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.417+0000 7f2631618640 1 --2- 172.21.15.5:0/1895717111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f262c15beb0 0x7f262c151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:03.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.417+0000 7f262bfff640 1 --2- 172.21.15.5:0/1895717111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f262c0b0760 0x7f262c1488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:03.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.417+0000 7f2630e17640 1 -- 172.21.15.5:0/1895717111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f262c0b0760 msgr2=0x7f262c1488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:03.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.417+0000 7f2630e17640 1 --2- 172.21.15.5:0/1895717111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f262c0b0760 0x7f262c1488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:03.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.417+0000 7f2630e17640 1 -- 172.21.15.5:0/1895717111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f262c15beb0 msgr2=0x7f262c151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:03.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.417+0000 7f2630e17640 1 --2- 172.21.15.5:0/1895717111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f262c15beb0 0x7f262c151ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:03.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.417+0000 7f2630e17640 1 -- 172.21.15.5:0/1895717111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2618009420 con 0x7f262c06db00 2023-07-14T12:54:03.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.417+0000 7f262bfff640 1 --2- 172.21.15.5:0/1895717111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f262c0b0760 0x7f262c1488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:54:03.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.417+0000 7f2631618640 1 --2- 172.21.15.5:0/1895717111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f262c15beb0 0x7f262c151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:54:03.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.417+0000 7f2630e17640 1 --2- 172.21.15.5:0/1895717111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262c06db00 0x7f262c0c3f60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f262001aaa0 tx=0x7f2620019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:03.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.417+0000 7f26297fa640 1 -- 172.21.15.5:0/1895717111 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2620006e20 con 0x7f262c06db00 2023-07-14T12:54:03.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.417+0000 7f26297fa640 1 -- 172.21.15.5:0/1895717111 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2620004020 con 0x7f262c06db00 2023-07-14T12:54:03.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.417+0000 7f26297fa640 1 -- 172.21.15.5:0/1895717111 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2620004390 con 0x7f262c06db00 2023-07-14T12:54:03.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.417+0000 7f263307b640 1 -- 172.21.15.5:0/1895717111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2620009420 con 0x7f262c06db00 2023-07-14T12:54:03.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.417+0000 7f263307b640 1 -- 172.21.15.5:0/1895717111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262c152c30 con 0x7f262c06db00 2023-07-14T12:54:03.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.417+0000 7f263307b640 1 -- 172.21.15.5:0/1895717111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f262c0678d0 con 0x7f262c06db00 2023-07-14T12:54:03.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.421+0000 7f26297fa640 1 -- 172.21.15.5:0/1895717111 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f26200b2050 con 0x7f262c06db00 2023-07-14T12:54:03.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.421+0000 7f26297fa640 1 --2- 172.21.15.5:0/1895717111 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f2610066480 0x7f2610068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:03.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.421+0000 7f26297fa640 1 -- 172.21.15.5:0/1895717111 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f262011e300 con 0x7f262c06db00 2023-07-14T12:54:03.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.421+0000 7f262bfff640 1 --2- 172.21.15.5:0/1895717111 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f2610066480 0x7f2610068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:03.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.421+0000 7f262bfff640 1 --2- 172.21.15.5:0/1895717111 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f2610066480 0x7f2610068930 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f262c0b1ac0 tx=0x7f2618009190 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:03.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.425+0000 7f26297fa640 1 -- 172.21.15.5:0/1895717111 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f26200eb320 con 0x7f262c06db00 2023-07-14T12:54:03.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.597+0000 7f263307b640 1 -- 172.21.15.5:0/1895717111 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f262c0c3c10 con 0x7f2610066480 2023-07-14T12:54:03.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.657+0000 7f26297fa640 1 -- 172.21.15.5:0/1895717111 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f2618004040 con 0x7f2610066480 2023-07-14T12:54:03.687 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule set for path /snap_test_dir1/dir5 2023-07-14T12:54:03.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.661+0000 7f263307b640 1 -- 172.21.15.5:0/1895717111 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f2610066480 msgr2=0x7f2610068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:03.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.661+0000 7f263307b640 1 --2- 172.21.15.5:0/1895717111 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f2610066480 0x7f2610068930 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f262c0b1ac0 tx=0x7f2618009190 comp rx=0 tx=0).stop 2023-07-14T12:54:03.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.661+0000 7f263307b640 1 -- 172.21.15.5:0/1895717111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262c06db00 msgr2=0x7f262c0c3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:03.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.661+0000 7f263307b640 1 --2- 172.21.15.5:0/1895717111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262c06db00 0x7f262c0c3f60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f262001aaa0 tx=0x7f2620019190 comp rx=0 tx=0).stop 2023-07-14T12:54:03.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.661+0000 7f263307b640 1 -- 172.21.15.5:0/1895717111 shutdown_connections 2023-07-14T12:54:03.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.661+0000 7f263307b640 1 --2- 172.21.15.5:0/1895717111 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f2610066480 0x7f2610068930 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:03.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.661+0000 7f263307b640 1 --2- 172.21.15.5:0/1895717111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f262c15beb0 0x7f262c151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:03.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.661+0000 7f263307b640 1 --2- 172.21.15.5:0/1895717111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f262c0b0760 0x7f262c1488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:03.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.661+0000 7f263307b640 1 --2- 172.21.15.5:0/1895717111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f262c06db00 0x7f262c0c3f60 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:03.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.661+0000 7f263307b640 1 -- 172.21.15.5:0/1895717111 >> 172.21.15.5:0/1895717111 conn(0x7f262c06c2f0 msgr2=0x7f262c1512d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:03.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.661+0000 7f263307b640 1 -- 172.21.15.5:0/1895717111 shutdown_connections 2023-07-14T12:54:03.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.661+0000 7f263307b640 1 -- 172.21.15.5:0/1895717111 wait complete. 2023-07-14T12:54:03.708 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir5 2023-07-14T12:54:03.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:54:03.709 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir6) 2023-07-14T12:54:03.719 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir6 1M 2023-07-14T12:54:03.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.889+0000 7f2cdcc9c640 1 Processor -- start 2023-07-14T12:54:03.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.889+0000 7f2cdcc9c640 1 -- start start 2023-07-14T12:54:03.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.889+0000 7f2cdcc9c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2cd806a540 0x7f2cd806a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:03.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.889+0000 7f2cdcc9c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cd80cf710 0x7f2cd80cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:03.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.889+0000 7f2cdcc9c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd80cb7a0 con 0x7f2cd80cf2e0 2023-07-14T12:54:03.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.889+0000 7f2cdcc9c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd80d0920 con 0x7f2cd806a540 2023-07-14T12:54:03.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.889+0000 7f2cdcc9c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd815bfd0 con 0x7f2cd80cf710 2023-07-14T12:54:03.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.889+0000 7f2cd659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2cd806a540 0x7f2cd806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:03.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.889+0000 7f2cd659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2cd806a540 0x7f2cd806a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32810/0 (socket says 172.21.15.5:32810) 2023-07-14T12:54:03.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.889+0000 7f2cd659c640 1 -- 172.21.15.5:0/2427961154 learned_addr learned my addr 172.21.15.5:0/2427961154 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:03.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.889+0000 7f2cd6d9d640 1 --2- 172.21.15.5:0/2427961154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cd80cf710 0x7f2cd80cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:03.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.889+0000 7f2cd659c640 1 -- 172.21.15.5:0/2427961154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cd80cf710 msgr2=0x7f2cd80cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:54:03.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.889+0000 7f2cd659c640 1 --2- 172.21.15.5:0/2427961154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cd80cf710 0x7f2cd80cd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:03.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.889+0000 7f2cd659c640 1 -- 172.21.15.5:0/2427961154 >> v1:172.21.15.154:6789/0 conn(0x7f2cd80cf2e0 legacy=0x7f2cd80cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:03.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.889+0000 7f2cd659c640 1 -- 172.21.15.5:0/2427961154 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd806ae50 con 0x7f2cd806a540 2023-07-14T12:54:03.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.893+0000 7f2cd659c640 1 --2- 172.21.15.5:0/2427961154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cd806a540 0x7f2cd806a910 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009870 tx=0x7f2cc801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663bc462a2c6dd15 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:03.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.893+0000 7f2cd5d9b640 1 -- 172.21.15.5:0/2427961154 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc80ab620 con 0x7f2cd806a540 2023-07-14T12:54:03.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.893+0000 7f2cd5d9b640 1 -- 172.21.15.5:0/2427961154 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc80ab780 con 0x7f2cd806a540 2023-07-14T12:54:03.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.893+0000 7f2cd5d9b640 1 -- 172.21.15.5:0/2427961154 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc80abb10 con 0x7f2cd806a540 2023-07-14T12:54:03.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.893+0000 7f2cdcc9c640 1 -- 172.21.15.5:0/2427961154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cd806a540 msgr2=0x7f2cd806a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:03.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.893+0000 7f2cdcc9c640 1 --2- 172.21.15.5:0/2427961154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cd806a540 0x7f2cd806a910 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009870 tx=0x7f2cc801c510 comp rx=0 tx=0).stop 2023-07-14T12:54:03.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.893+0000 7f2cdcc9c640 1 -- 172.21.15.5:0/2427961154 shutdown_connections 2023-07-14T12:54:03.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.893+0000 7f2cdcc9c640 1 --2- 172.21.15.5:0/2427961154 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cd80cf710 0x7f2cd80cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:03.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.893+0000 7f2cdcc9c640 1 --2- 172.21.15.5:0/2427961154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cd806a540 0x7f2cd806a910 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:03.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.893+0000 7f2cdcc9c640 1 -- 172.21.15.5:0/2427961154 >> 172.21.15.5:0/2427961154 conn(0x7f2cd8099490 msgr2=0x7f2cd8089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:03.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.893+0000 7f2cdcc9c640 1 -- 172.21.15.5:0/2427961154 shutdown_connections 2023-07-14T12:54:03.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.893+0000 7f2cdcc9c640 1 -- 172.21.15.5:0/2427961154 wait complete. 2023-07-14T12:54:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.893+0000 7f2cdcc9c640 1 Processor -- start 2023-07-14T12:54:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.897+0000 7f2cdcc9c640 1 -- start start 2023-07-14T12:54:03.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.897+0000 7f2cdcc9c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cd806a540 0x7f2cd8157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.897+0000 7f2cdcc9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cd80cf2e0 0x7f2cd814aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.897+0000 7f2cdcc9c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cd80cf710 0x7f2cd815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.897+0000 7f2cdcc9c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd814af90 con 0x7f2cd80cf2e0 2023-07-14T12:54:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.897+0000 7f2cdcc9c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd80b0060 con 0x7f2cd80cf710 2023-07-14T12:54:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.897+0000 7f2cdcc9c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd80b0bd0 con 0x7f2cd806a540 2023-07-14T12:54:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.897+0000 7f2ccffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cd80cf2e0 0x7f2cd814aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.897+0000 7f2ccffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cd80cf2e0 0x7f2cd814aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32826/0 (socket says 172.21.15.5:32826) 2023-07-14T12:54:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.897+0000 7f2cd659c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cd806a540 0x7f2cd8157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:03.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.897+0000 7f2ccffff640 1 -- 172.21.15.5:0/3722740525 learned_addr learned my addr 172.21.15.5:0/3722740525 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:03.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.897+0000 7f2cd6d9d640 1 --2- 172.21.15.5:0/3722740525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cd80cf710 0x7f2cd815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.897+0000 7f2ccffff640 1 -- 172.21.15.5:0/3722740525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cd806a540 msgr2=0x7f2cd8157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.897+0000 7f2ccffff640 1 --2- 172.21.15.5:0/3722740525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cd806a540 0x7f2cd8157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.897+0000 7f2ccffff640 1 -- 172.21.15.5:0/3722740525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cd80cf710 msgr2=0x7f2cd815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.897+0000 7f2ccffff640 1 --2- 172.21.15.5:0/3722740525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cd80cf710 0x7f2cd815a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.897+0000 7f2ccffff640 1 -- 172.21.15.5:0/3722740525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc80094d0 con 0x7f2cd80cf2e0 2023-07-14T12:54:03.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.897+0000 7f2cd6d9d640 1 --2- 172.21.15.5:0/3722740525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cd80cf710 0x7f2cd815a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:54:03.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.897+0000 7f2ccffff640 1 --2- 172.21.15.5:0/3722740525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cd80cf2e0 0x7f2cd814aa50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2cc000c390 tx=0x7f2cc000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:03.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.897+0000 7f2cceffd640 1 -- 172.21.15.5:0/3722740525 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc00052d0 con 0x7f2cd80cf2e0 2023-07-14T12:54:03.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.897+0000 7f2cceffd640 1 -- 172.21.15.5:0/3722740525 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc0005430 con 0x7f2cd80cf2e0 2023-07-14T12:54:03.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.897+0000 7f2cceffd640 1 -- 172.21.15.5:0/3722740525 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0003820 con 0x7f2cd80cf2e0 2023-07-14T12:54:03.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.897+0000 7f2cdcc9c640 1 -- 172.21.15.5:0/3722740525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd815a720 con 0x7f2cd80cf2e0 2023-07-14T12:54:03.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.897+0000 7f2cdcc9c640 1 -- 172.21.15.5:0/3722740525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd80b0580 con 0x7f2cd80cf2e0 2023-07-14T12:54:03.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.897+0000 7f2cdcc9c640 1 -- 172.21.15.5:0/3722740525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd80678d0 con 0x7f2cd80cf2e0 2023-07-14T12:54:03.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.901+0000 7f2cceffd640 1 -- 172.21.15.5:0/3722740525 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f2cc0003980 con 0x7f2cd80cf2e0 2023-07-14T12:54:03.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.901+0000 7f2cceffd640 1 --2- 172.21.15.5:0/3722740525 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f2cb8066480 0x7f2cb8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:03.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.901+0000 7f2cceffd640 1 -- 172.21.15.5:0/3722740525 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f2cc0083690 con 0x7f2cd80cf2e0 2023-07-14T12:54:03.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.901+0000 7f2cd659c640 1 --2- 172.21.15.5:0/3722740525 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f2cb8066480 0x7f2cb8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:03.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.901+0000 7f2cd659c640 1 --2- 172.21.15.5:0/3722740525 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f2cb8066480 0x7f2cb8068930 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80af000 tx=0x7f2cc80b6040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:03.905+0000 7f2cceffd640 1 -- 172.21.15.5:0/3722740525 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2cc0050870 con 0x7f2cd80cf2e0 2023-07-14T12:54:04.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.077+0000 7f2cdcc9c640 1 -- 172.21.15.5:0/3722740525 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f2cd80d05b0 con 0x7f2cb8066480 2023-07-14T12:54:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.141+0000 7f2cceffd640 1 -- 172.21.15.5:0/3722740525 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f2cc80ab5a0 con 0x7f2cb8066480 2023-07-14T12:54:04.169 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule set for path /snap_test_dir1/dir6 2023-07-14T12:54:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.141+0000 7f2cdcc9c640 1 -- 172.21.15.5:0/3722740525 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f2cb8066480 msgr2=0x7f2cb8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.141+0000 7f2cdcc9c640 1 --2- 172.21.15.5:0/3722740525 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f2cb8066480 0x7f2cb8068930 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80af000 tx=0x7f2cc80b6040 comp rx=0 tx=0).stop 2023-07-14T12:54:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.141+0000 7f2cdcc9c640 1 -- 172.21.15.5:0/3722740525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cd80cf2e0 msgr2=0x7f2cd814aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.141+0000 7f2cdcc9c640 1 --2- 172.21.15.5:0/3722740525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cd80cf2e0 0x7f2cd814aa50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2cc000c390 tx=0x7f2cc000c850 comp rx=0 tx=0).stop 2023-07-14T12:54:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.141+0000 7f2cdcc9c640 1 -- 172.21.15.5:0/3722740525 shutdown_connections 2023-07-14T12:54:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.141+0000 7f2cdcc9c640 1 --2- 172.21.15.5:0/3722740525 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f2cb8066480 0x7f2cb8068930 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.141+0000 7f2cdcc9c640 1 --2- 172.21.15.5:0/3722740525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cd80cf710 0x7f2cd815a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.141+0000 7f2cdcc9c640 1 --2- 172.21.15.5:0/3722740525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cd80cf2e0 0x7f2cd814aa50 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.141+0000 7f2cdcc9c640 1 --2- 172.21.15.5:0/3722740525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cd806a540 0x7f2cd8157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.141+0000 7f2cdcc9c640 1 -- 172.21.15.5:0/3722740525 >> 172.21.15.5:0/3722740525 conn(0x7f2cd8099490 msgr2=0x7f2cd8089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.145+0000 7f2cdcc9c640 1 -- 172.21.15.5:0/3722740525 shutdown_connections 2023-07-14T12:54:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.145+0000 7f2cdcc9c640 1 -- 172.21.15.5:0/3722740525 wait complete. 2023-07-14T12:54:04.190 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir6 2023-07-14T12:54:04.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:54:04.191 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir7) 2023-07-14T12:54:04.202 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir7 1M 2023-07-14T12:54:04.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.365+0000 7fac77c6d640 1 Processor -- start 2023-07-14T12:54:04.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.365+0000 7fac77c6d640 1 -- start start 2023-07-14T12:54:04.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.365+0000 7fac77c6d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fac7015f690 0x7fac700b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:04.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.365+0000 7fac77c6d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac7006a440 0x7fac7006c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:04.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.365+0000 7fac77c6d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac7006c040 con 0x7fac701453a0 2023-07-14T12:54:04.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.365+0000 7fac77c6d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac70160170 con 0x7fac7006a440 2023-07-14T12:54:04.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.365+0000 7fac77c6d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac70160600 con 0x7fac7015f690 2023-07-14T12:54:04.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.365+0000 7fac7620a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac7006a440 0x7fac7006c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:04.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.365+0000 7fac7620a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac7006a440 0x7fac7006c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32832/0 (socket says 172.21.15.5:32832) 2023-07-14T12:54:04.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.365+0000 7fac7620a640 1 -- 172.21.15.5:0/4107835392 learned_addr learned my addr 172.21.15.5:0/4107835392 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:04.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.365+0000 7fac75a09640 1 --2- 172.21.15.5:0/4107835392 >> v2:172.21.15.154:3300/0 conn(0x7fac7015f690 0x7fac700b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:04.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.365+0000 7fac7620a640 1 -- 172.21.15.5:0/4107835392 >> v2:172.21.15.154:3300/0 conn(0x7fac7015f690 msgr2=0x7fac700b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:54:04.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.365+0000 7fac7620a640 1 --2- 172.21.15.5:0/4107835392 >> v2:172.21.15.154:3300/0 conn(0x7fac7015f690 0x7fac700b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:04.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.365+0000 7fac7620a640 1 -- 172.21.15.5:0/4107835392 >> v1:172.21.15.154:6789/0 conn(0x7fac701453a0 legacy=0x7fac7015fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:04.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.365+0000 7fac7620a640 1 -- 172.21.15.5:0/4107835392 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac70160360 con 0x7fac7006a440 2023-07-14T12:54:04.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.369+0000 7fac7620a640 1 --2- 172.21.15.5:0/4107835392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac7006a440 0x7fac7006c4d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fac700aba90 tx=0x7fac6801c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0fc5aefab90427 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:04.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.369+0000 7fac74a07640 1 -- 172.21.15.5:0/4107835392 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac680a6480 con 0x7fac7006a440 2023-07-14T12:54:04.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.369+0000 7fac74a07640 1 -- 172.21.15.5:0/4107835392 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac680a65e0 con 0x7fac7006a440 2023-07-14T12:54:04.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.369+0000 7fac74a07640 1 -- 172.21.15.5:0/4107835392 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac680a6970 con 0x7fac7006a440 2023-07-14T12:54:04.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.369+0000 7fac77c6d640 1 -- 172.21.15.5:0/4107835392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac7006a440 msgr2=0x7fac7006c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:04.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.369+0000 7fac77c6d640 1 --2- 172.21.15.5:0/4107835392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac7006a440 0x7fac7006c4d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fac700aba90 tx=0x7fac6801c6a0 comp rx=0 tx=0).stop 2023-07-14T12:54:04.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.369+0000 7fac77c6d640 1 -- 172.21.15.5:0/4107835392 shutdown_connections 2023-07-14T12:54:04.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.369+0000 7fac77c6d640 1 --2- 172.21.15.5:0/4107835392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac7006a440 0x7fac7006c4d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:04.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.369+0000 7fac77c6d640 1 --2- 172.21.15.5:0/4107835392 >> v2:172.21.15.154:3300/0 conn(0x7fac7015f690 0x7fac700b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:04.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.369+0000 7fac77c6d640 1 -- 172.21.15.5:0/4107835392 >> 172.21.15.5:0/4107835392 conn(0x7fac700b1210 msgr2=0x7fac700ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:04.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.369+0000 7fac77c6d640 1 -- 172.21.15.5:0/4107835392 shutdown_connections 2023-07-14T12:54:04.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.369+0000 7fac77c6d640 1 -- 172.21.15.5:0/4107835392 wait complete. 2023-07-14T12:54:04.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.373+0000 7fac77c6d640 1 Processor -- start 2023-07-14T12:54:04.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.373+0000 7fac77c6d640 1 -- start start 2023-07-14T12:54:04.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.373+0000 7fac77c6d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac7006a440 0x7fac7013d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:04.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.373+0000 7fac77c6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac701453a0 0x7fac70160740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:04.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.373+0000 7fac77c6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac7015f690 0x7fac70160c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:04.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.373+0000 7fac77c6d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac701420c0 con 0x7fac701453a0 2023-07-14T12:54:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.373+0000 7fac77c6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7013d790 con 0x7fac7015f690 2023-07-14T12:54:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.373+0000 7fac77c6d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7015d190 con 0x7fac7006a440 2023-07-14T12:54:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.373+0000 7fac75208640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac701453a0 0x7fac70160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.373+0000 7fac75208640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac701453a0 0x7fac70160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32834/0 (socket says 172.21.15.5:32834) 2023-07-14T12:54:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.373+0000 7fac75208640 1 -- 172.21.15.5:0/1732236467 learned_addr learned my addr 172.21.15.5:0/1732236467 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.373+0000 7fac75a09640 1 --2- 172.21.15.5:0/1732236467 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac7006a440 0x7fac7013d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.373+0000 7fac7620a640 1 --2- 172.21.15.5:0/1732236467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac7015f690 0x7fac70160c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:04.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.373+0000 7fac75208640 1 -- 172.21.15.5:0/1732236467 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac7006a440 msgr2=0x7fac7013d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:04.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.373+0000 7fac75208640 1 --2- 172.21.15.5:0/1732236467 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac7006a440 0x7fac7013d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:04.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.373+0000 7fac75208640 1 -- 172.21.15.5:0/1732236467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac7015f690 msgr2=0x7fac70160c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:04.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.373+0000 7fac75208640 1 --2- 172.21.15.5:0/1732236467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac7015f690 0x7fac70160c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:04.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.373+0000 7fac75208640 1 -- 172.21.15.5:0/1732236467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac68009b30 con 0x7fac701453a0 2023-07-14T12:54:04.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.373+0000 7fac75208640 1 --2- 172.21.15.5:0/1732236467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac701453a0 0x7fac70160740 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fac6000c3c0 tx=0x7fac6000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:04.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.373+0000 7fac667fc640 1 -- 172.21.15.5:0/1732236467 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac600052d0 con 0x7fac701453a0 2023-07-14T12:54:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.373+0000 7fac667fc640 1 -- 172.21.15.5:0/1732236467 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac60005430 con 0x7fac701453a0 2023-07-14T12:54:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.373+0000 7fac77c6d640 1 -- 172.21.15.5:0/1732236467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac7015d470 con 0x7fac701453a0 2023-07-14T12:54:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.373+0000 7fac667fc640 1 -- 172.21.15.5:0/1732236467 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac60003840 con 0x7fac701453a0 2023-07-14T12:54:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.373+0000 7fac77c6d640 1 -- 172.21.15.5:0/1732236467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac7015da30 con 0x7fac701453a0 2023-07-14T12:54:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.373+0000 7fac77c6d640 1 -- 172.21.15.5:0/1732236467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac70142230 con 0x7fac701453a0 2023-07-14T12:54:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.377+0000 7fac667fc640 1 -- 172.21.15.5:0/1732236467 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fac600039a0 con 0x7fac701453a0 2023-07-14T12:54:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.377+0000 7fac667fc640 1 --2- 172.21.15.5:0/1732236467 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fac540664b0 0x7fac54068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.377+0000 7fac667fc640 1 -- 172.21.15.5:0/1732236467 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fac600835c0 con 0x7fac701453a0 2023-07-14T12:54:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.377+0000 7fac75a09640 1 --2- 172.21.15.5:0/1732236467 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fac540664b0 0x7fac54068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.377+0000 7fac75a09640 1 --2- 172.21.15.5:0/1732236467 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fac540664b0 0x7fac54068960 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fac6c007a60 tx=0x7fac6c008040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:04.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.381+0000 7fac667fc640 1 -- 172.21.15.5:0/1732236467 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fac70142230 con 0x7fac701453a0 2023-07-14T12:54:04.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.553+0000 7fac77c6d640 1 -- 172.21.15.5:0/1732236467 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fac7006ad80 con 0x7fac540664b0 2023-07-14T12:54:04.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.625+0000 7fac667fc640 1 -- 172.21.15.5:0/1732236467 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fac6c010990 con 0x7fac540664b0 2023-07-14T12:54:04.653 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule set for path /snap_test_dir1/dir7 2023-07-14T12:54:04.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.625+0000 7fac77c6d640 1 -- 172.21.15.5:0/1732236467 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fac540664b0 msgr2=0x7fac54068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:04.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.625+0000 7fac77c6d640 1 --2- 172.21.15.5:0/1732236467 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fac540664b0 0x7fac54068960 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fac6c007a60 tx=0x7fac6c008040 comp rx=0 tx=0).stop 2023-07-14T12:54:04.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.625+0000 7fac77c6d640 1 -- 172.21.15.5:0/1732236467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac701453a0 msgr2=0x7fac70160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:04.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.625+0000 7fac77c6d640 1 --2- 172.21.15.5:0/1732236467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac701453a0 0x7fac70160740 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fac6000c3c0 tx=0x7fac6000c880 comp rx=0 tx=0).stop 2023-07-14T12:54:04.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.625+0000 7fac77c6d640 1 -- 172.21.15.5:0/1732236467 shutdown_connections 2023-07-14T12:54:04.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.625+0000 7fac77c6d640 1 --2- 172.21.15.5:0/1732236467 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fac540664b0 0x7fac54068960 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:04.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.625+0000 7fac77c6d640 1 --2- 172.21.15.5:0/1732236467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac7015f690 0x7fac70160c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:04.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.625+0000 7fac77c6d640 1 --2- 172.21.15.5:0/1732236467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac701453a0 0x7fac70160740 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:04.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.625+0000 7fac77c6d640 1 --2- 172.21.15.5:0/1732236467 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac7006a440 0x7fac7013d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:04.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.625+0000 7fac77c6d640 1 -- 172.21.15.5:0/1732236467 >> 172.21.15.5:0/1732236467 conn(0x7fac700b1210 msgr2=0x7fac700afdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:04.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.625+0000 7fac77c6d640 1 -- 172.21.15.5:0/1732236467 shutdown_connections 2023-07-14T12:54:04.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.625+0000 7fac77c6d640 1 -- 172.21.15.5:0/1732236467 wait complete. 2023-07-14T12:54:04.674 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir7 2023-07-14T12:54:04.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:54:04.675 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir8) 2023-07-14T12:54:04.686 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir8 1M 2023-07-14T12:54:04.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.849+0000 7f232da0b640 1 Processor -- start 2023-07-14T12:54:04.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.849+0000 7f232da0b640 1 -- start start 2023-07-14T12:54:04.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.849+0000 7f232da0b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23280d2fc0 0x7f23280b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:04.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.849+0000 7f232da0b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23280b04c0 con 0x7f23280d2300 2023-07-14T12:54:04.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.849+0000 7f232da0b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23280d0aa0 con 0x7f232815bde0 2023-07-14T12:54:04.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.849+0000 7f232da0b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232815c1b0 con 0x7f23280d2fc0 2023-07-14T12:54:04.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.849+0000 7f23277fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f23280d2300 0x7f23280cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52118/0 (socket says 172.21.15.5:52118) 2023-07-14T12:54:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.849+0000 7f23277fe640 1 -- 172.21.15.5:0/2241535835 learned_addr learned my addr 172.21.15.5:0/2241535835 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:54:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.849+0000 7f231ffff640 1 --2- 172.21.15.5:0/2241535835 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23280d2fc0 0x7f23280b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.849+0000 7f23267fc640 1 -- 172.21.15.5:0/2241535835 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3091522570 0 0) 0x7f23280b04c0 con 0x7f23280d2300 2023-07-14T12:54:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.849+0000 7f23267fc640 1 -- 172.21.15.5:0/2241535835 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2314003530 con 0x7f23280d2300 2023-07-14T12:54:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.849+0000 7f23267fc640 1 -- 172.21.15.5:0/2241535835 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363117858 0 0) 0x7f23280d0aa0 con 0x7f232815bde0 2023-07-14T12:54:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.849+0000 7f23267fc640 1 -- 172.21.15.5:0/2241535835 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23280b04c0 con 0x7f232815bde0 2023-07-14T12:54:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.849+0000 7f23267fc640 1 -- 172.21.15.5:0/2241535835 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3353053020 0 0) 0x7f2314003530 con 0x7f23280d2300 2023-07-14T12:54:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.849+0000 7f23267fc640 1 -- 172.21.15.5:0/2241535835 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23280d2fc0 msgr2=0x7f23280b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:54:04.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.849+0000 7f23267fc640 1 --2- 172.21.15.5:0/2241535835 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23280d2fc0 0x7f23280b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:04.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.849+0000 7f23267fc640 1 -- 172.21.15.5:0/2241535835 >> v1:172.21.15.154:6789/0 conn(0x7f232815bde0 legacy=0x7f23280d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:04.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.849+0000 7f23267fc640 1 -- 172.21.15.5:0/2241535835 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23280afb90 con 0x7f23280d2300 2023-07-14T12:54:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.849+0000 7f23267fc640 1 -- 172.21.15.5:0/2241535835 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f2320001a00 con 0x7f23280d2300 2023-07-14T12:54:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.853+0000 7f23267fc640 1 -- 172.21.15.5:0/2241535835 >> v1:172.21.15.5:6789/0 conn(0x7f23280d2300 legacy=0x7f23280cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.853+0000 7f23267fc640 1 --2- 172.21.15.5:0/2241535835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2314003b40 0x7f2314003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.853+0000 7f23267fc640 1 --2- 172.21.15.5:0/2241535835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23140047d0 0x7f2314004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.853+0000 7f23267fc640 1 --2- 172.21.15.5:0/2241535835 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23280d2fc0 0x7f2314005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.853+0000 7f23267fc640 1 -- 172.21.15.5:0/2241535835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232815c1b0 con 0x7f2314003b40 2023-07-14T12:54:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.853+0000 7f23267fc640 1 -- 172.21.15.5:0/2241535835 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231400ba40 con 0x7f23140047d0 2023-07-14T12:54:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.853+0000 7f23267fc640 1 -- 172.21.15.5:0/2241535835 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231400bbb0 con 0x7f23280d2fc0 2023-07-14T12:54:04.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.853+0000 7f2326ffd640 1 --2- 172.21.15.5:0/2241535835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2314003b40 0x7f2314003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:04.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.853+0000 7f231ffff640 1 --2- 172.21.15.5:0/2241535835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23140047d0 0x7f2314004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:04.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.853+0000 7f23277fe640 1 --2- 172.21.15.5:0/2241535835 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23280d2fc0 0x7f2314005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:04.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.853+0000 7f2326ffd640 1 -- 172.21.15.5:0/2241535835 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23280d2fc0 msgr2=0x7f2314005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:54:04.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.853+0000 7f2326ffd640 1 --2- 172.21.15.5:0/2241535835 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23280d2fc0 0x7f2314005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:04.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.853+0000 7f2326ffd640 1 -- 172.21.15.5:0/2241535835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23140047d0 msgr2=0x7f2314004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:54:04.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.853+0000 7f2326ffd640 1 --2- 172.21.15.5:0/2241535835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23140047d0 0x7f2314004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:04.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.853+0000 7f2326ffd640 1 -- 172.21.15.5:0/2241535835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2314003530 con 0x7f2314003b40 2023-07-14T12:54:04.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.853+0000 7f2326ffd640 1 --2- 172.21.15.5:0/2241535835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2314003b40 0x7f2314003f30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2318001930 tx=0x7f231801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b3ebe30fbaafcc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:04.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.853+0000 7f23267fc640 1 -- 172.21.15.5:0/2241535835 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23180052d0 con 0x7f2314003b40 2023-07-14T12:54:04.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.853+0000 7f23267fc640 1 -- 172.21.15.5:0/2241535835 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2318005430 con 0x7f2314003b40 2023-07-14T12:54:04.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.853+0000 7f23267fc640 1 -- 172.21.15.5:0/2241535835 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2318003870 con 0x7f2314003b40 2023-07-14T12:54:04.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.857+0000 7f232da0b640 1 -- 172.21.15.5:0/2241535835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2314003b40 msgr2=0x7f2314003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:04.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.857+0000 7f232da0b640 1 --2- 172.21.15.5:0/2241535835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2314003b40 0x7f2314003f30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2318001930 tx=0x7f231801c560 comp rx=0 tx=0).stop 2023-07-14T12:54:04.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.857+0000 7f23277fe640 1 -- 172.21.15.5:0/2241535835 reap_dead start 2023-07-14T12:54:04.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.857+0000 7f232da0b640 1 -- 172.21.15.5:0/2241535835 shutdown_connections 2023-07-14T12:54:04.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.857+0000 7f232da0b640 1 -- 172.21.15.5:0/2241535835 >> 172.21.15.5:0/2241535835 conn(0x7f23280659d0 msgr2=0x7f232809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:04.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.857+0000 7f232da0b640 1 -- 172.21.15.5:0/2241535835 shutdown_connections 2023-07-14T12:54:04.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.857+0000 7f232da0b640 1 -- 172.21.15.5:0/2241535835 wait complete. 2023-07-14T12:54:04.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.857+0000 7f232da0b640 1 Processor -- start 2023-07-14T12:54:04.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.857+0000 7f232da0b640 1 -- start start 2023-07-14T12:54:04.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.857+0000 7f232da0b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2314003b40 0x7f2328150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:04.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.857+0000 7f232da0b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23280ce6d0 0x7f23280b6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:04.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.857+0000 7f232da0b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23281659d0 0x7f2328165e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:04.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.857+0000 7f232da0b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2328166380 con 0x7f23280ce6d0 2023-07-14T12:54:04.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.857+0000 7f232da0b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232815ffa0 con 0x7f2314003b40 2023-07-14T12:54:04.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.857+0000 7f232da0b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23280b7410 con 0x7f23281659d0 2023-07-14T12:54:04.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.857+0000 7f231ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23280ce6d0 0x7f23280b6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:04.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.857+0000 7f231ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23280ce6d0 0x7f23280b6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32852/0 (socket says 172.21.15.5:32852) 2023-07-14T12:54:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.857+0000 7f231ffff640 1 -- 172.21.15.5:0/2803920432 learned_addr learned my addr 172.21.15.5:0/2803920432 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.857+0000 7f2326ffd640 1 --2- 172.21.15.5:0/2803920432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2314003b40 0x7f2328150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.857+0000 7f23277fe640 1 --2- 172.21.15.5:0/2803920432 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23281659d0 0x7f2328165e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.861+0000 7f231ffff640 1 -- 172.21.15.5:0/2803920432 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23281659d0 msgr2=0x7f2328165e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.861+0000 7f231ffff640 1 --2- 172.21.15.5:0/2803920432 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23281659d0 0x7f2328165e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:04.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.861+0000 7f231ffff640 1 -- 172.21.15.5:0/2803920432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2314003b40 msgr2=0x7f2328150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.861+0000 7f231ffff640 1 --2- 172.21.15.5:0/2803920432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2314003b40 0x7f2328150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.861+0000 7f231ffff640 1 -- 172.21.15.5:0/2803920432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232815f950 con 0x7f23280ce6d0 2023-07-14T12:54:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.861+0000 7f231ffff640 1 --2- 172.21.15.5:0/2803920432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23280ce6d0 0x7f23280b6b10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2310011a00 tx=0x7f2310011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.861+0000 7f2324ff9640 1 -- 172.21.15.5:0/2803920432 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231000fb50 con 0x7f23280ce6d0 2023-07-14T12:54:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.861+0000 7f2324ff9640 1 -- 172.21.15.5:0/2803920432 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231000fcb0 con 0x7f23280ce6d0 2023-07-14T12:54:04.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.861+0000 7f232da0b640 1 -- 172.21.15.5:0/2803920432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232815fc30 con 0x7f23280ce6d0 2023-07-14T12:54:04.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.861+0000 7f2324ff9640 1 -- 172.21.15.5:0/2803920432 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310014440 con 0x7f23280ce6d0 2023-07-14T12:54:04.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.861+0000 7f232da0b640 1 -- 172.21.15.5:0/2803920432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23280b7050 con 0x7f23280ce6d0 2023-07-14T12:54:04.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.861+0000 7f232da0b640 1 -- 172.21.15.5:0/2803920432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232815f7b0 con 0x7f23280ce6d0 2023-07-14T12:54:04.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.861+0000 7f2324ff9640 1 -- 172.21.15.5:0/2803920432 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f23100145a0 con 0x7f23280ce6d0 2023-07-14T12:54:04.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.861+0000 7f2324ff9640 1 --2- 172.21.15.5:0/2803920432 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f23080664b0 0x7f2308068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:04.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.865+0000 7f2324ff9640 1 -- 172.21.15.5:0/2803920432 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f23100849c0 con 0x7f23280ce6d0 2023-07-14T12:54:04.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.865+0000 7f2326ffd640 1 --2- 172.21.15.5:0/2803920432 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f23080664b0 0x7f2308068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:04.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.865+0000 7f2326ffd640 1 --2- 172.21.15.5:0/2803920432 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f23080664b0 0x7f2308068960 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f23180ad000 tx=0x7f23180a7000 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:04.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:04.869+0000 7f2324ff9640 1 -- 172.21.15.5:0/2803920432 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f232815f7b0 con 0x7f23280ce6d0 2023-07-14T12:54:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.037+0000 7f232da0b640 1 -- 172.21.15.5:0/2803920432 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f2328167870 con 0x7f23080664b0 2023-07-14T12:54:05.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.101+0000 7f2324ff9640 1 -- 172.21.15.5:0/2803920432 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f23180ba070 con 0x7f23080664b0 2023-07-14T12:54:05.128 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule set for path /snap_test_dir1/dir8 2023-07-14T12:54:05.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.101+0000 7f232da0b640 1 -- 172.21.15.5:0/2803920432 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f23080664b0 msgr2=0x7f2308068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:05.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.101+0000 7f232da0b640 1 --2- 172.21.15.5:0/2803920432 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f23080664b0 0x7f2308068960 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f23180ad000 tx=0x7f23180a7000 comp rx=0 tx=0).stop 2023-07-14T12:54:05.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.101+0000 7f232da0b640 1 -- 172.21.15.5:0/2803920432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23280ce6d0 msgr2=0x7f23280b6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:05.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.101+0000 7f232da0b640 1 --2- 172.21.15.5:0/2803920432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23280ce6d0 0x7f23280b6b10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2310011a00 tx=0x7f2310011ec0 comp rx=0 tx=0).stop 2023-07-14T12:54:05.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.101+0000 7f232da0b640 1 -- 172.21.15.5:0/2803920432 shutdown_connections 2023-07-14T12:54:05.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.101+0000 7f232da0b640 1 --2- 172.21.15.5:0/2803920432 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f23080664b0 0x7f2308068960 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:05.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.101+0000 7f232da0b640 1 --2- 172.21.15.5:0/2803920432 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23281659d0 0x7f2328165e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:05.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.101+0000 7f232da0b640 1 --2- 172.21.15.5:0/2803920432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23280ce6d0 0x7f23280b6b10 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:05.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.101+0000 7f232da0b640 1 --2- 172.21.15.5:0/2803920432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2314003b40 0x7f2328150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:05.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.101+0000 7f232da0b640 1 -- 172.21.15.5:0/2803920432 >> 172.21.15.5:0/2803920432 conn(0x7f23280659d0 msgr2=0x7f23280cd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:05.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.101+0000 7f232da0b640 1 -- 172.21.15.5:0/2803920432 shutdown_connections 2023-07-14T12:54:05.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.101+0000 7f232da0b640 1 -- 172.21.15.5:0/2803920432 wait complete. 2023-07-14T12:54:05.149 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir8 2023-07-14T12:54:05.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:54:05.150 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir9) 2023-07-14T12:54:05.162 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir9 1M 2023-07-14T12:54:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.325+0000 7f2560700640 1 Processor -- start 2023-07-14T12:54:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.325+0000 7f2560700640 1 -- start start 2023-07-14T12:54:05.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.325+0000 7f2560700640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f255815bde0 0x7f25580d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:05.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.325+0000 7f2560700640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25580d2300 0x7f25580d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:05.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.325+0000 7f2560700640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25580b04c0 con 0x7f25580d2fc0 2023-07-14T12:54:05.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.325+0000 7f2560700640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f255815c1b0 con 0x7f255815bde0 2023-07-14T12:54:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.325+0000 7f2560700640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25580d2cc0 con 0x7f25580d2300 2023-07-14T12:54:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.325+0000 7f255e49c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f255815bde0 0x7f25580d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.325+0000 7f255e49c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f255815bde0 0x7f25580d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32862/0 (socket says 172.21.15.5:32862) 2023-07-14T12:54:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.325+0000 7f255e49c640 1 -- 172.21.15.5:0/938930208 learned_addr learned my addr 172.21.15.5:0/938930208 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.325+0000 7f255ec9d640 1 --2- 172.21.15.5:0/938930208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25580d2300 0x7f25580d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.325+0000 7f255e49c640 1 -- 172.21.15.5:0/938930208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25580d2300 msgr2=0x7f25580d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:54:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.325+0000 7f255e49c640 1 --2- 172.21.15.5:0/938930208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25580d2300 0x7f25580d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.325+0000 7f255e49c640 1 -- 172.21.15.5:0/938930208 >> v1:172.21.15.5:6789/0 conn(0x7f25580d2fc0 legacy=0x7f25580b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.325+0000 7f255e49c640 1 -- 172.21.15.5:0/938930208 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25580b1060 con 0x7f255815bde0 2023-07-14T12:54:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.329+0000 7f255e49c640 1 --2- 172.21.15.5:0/938930208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f255815bde0 0x7f25580d0270 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2554006fd0 tx=0x7f255401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58429288943b9616 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:05.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.329+0000 7f255d49a640 1 -- 172.21.15.5:0/938930208 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25540a7070 con 0x7f255815bde0 2023-07-14T12:54:05.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.329+0000 7f255d49a640 1 -- 172.21.15.5:0/938930208 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25540ab430 con 0x7f255815bde0 2023-07-14T12:54:05.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.329+0000 7f255d49a640 1 -- 172.21.15.5:0/938930208 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25540ab7c0 con 0x7f255815bde0 2023-07-14T12:54:05.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.329+0000 7f2560700640 1 -- 172.21.15.5:0/938930208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f255815bde0 msgr2=0x7f25580d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.329+0000 7f2560700640 1 --2- 172.21.15.5:0/938930208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f255815bde0 0x7f25580d0270 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2554006fd0 tx=0x7f255401c520 comp rx=0 tx=0).stop 2023-07-14T12:54:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.329+0000 7f2560700640 1 -- 172.21.15.5:0/938930208 shutdown_connections 2023-07-14T12:54:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.329+0000 7f2560700640 1 --2- 172.21.15.5:0/938930208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25580d2300 0x7f25580d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.329+0000 7f2560700640 1 --2- 172.21.15.5:0/938930208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f255815bde0 0x7f25580d0270 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:05.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.329+0000 7f2560700640 1 -- 172.21.15.5:0/938930208 >> 172.21.15.5:0/938930208 conn(0x7f25580659d0 msgr2=0x7f255809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:05.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.329+0000 7f2560700640 1 -- 172.21.15.5:0/938930208 shutdown_connections 2023-07-14T12:54:05.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.329+0000 7f2560700640 1 -- 172.21.15.5:0/938930208 wait complete. 2023-07-14T12:54:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.333+0000 7f2560700640 1 Processor -- start 2023-07-14T12:54:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.333+0000 7f2560700640 1 -- start start 2023-07-14T12:54:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.333+0000 7f2560700640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25580d2300 0x7f255814e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.333+0000 7f2560700640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25580d2fc0 0x7f2558153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.333+0000 7f2560700640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f255815bde0 0x7f25580b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:05.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.333+0000 7f2560700640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25580c8f40 con 0x7f25580d2fc0 2023-07-14T12:54:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.333+0000 7f2560700640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25581540d0 con 0x7f255815bde0 2023-07-14T12:54:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.333+0000 7f2560700640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2558153830 con 0x7f25580d2300 2023-07-14T12:54:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.333+0000 7f255dc9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25580d2fc0 0x7f2558153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.333+0000 7f255dc9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25580d2fc0 0x7f2558153130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32864/0 (socket says 172.21.15.5:32864) 2023-07-14T12:54:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.333+0000 7f255dc9b640 1 -- 172.21.15.5:0/3294329400 learned_addr learned my addr 172.21.15.5:0/3294329400 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.333+0000 7f255e49c640 1 --2- 172.21.15.5:0/3294329400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25580d2300 0x7f255814e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.333+0000 7f255ec9d640 1 --2- 172.21.15.5:0/3294329400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f255815bde0 0x7f25580b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:05.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.333+0000 7f255dc9b640 1 -- 172.21.15.5:0/3294329400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25580d2300 msgr2=0x7f255814e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.333+0000 7f255dc9b640 1 --2- 172.21.15.5:0/3294329400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25580d2300 0x7f255814e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.333+0000 7f255dc9b640 1 -- 172.21.15.5:0/3294329400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f255815bde0 msgr2=0x7f25580b7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.333+0000 7f255dc9b640 1 --2- 172.21.15.5:0/3294329400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f255815bde0 0x7f25580b7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.333+0000 7f255dc9b640 1 -- 172.21.15.5:0/3294329400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2554009480 con 0x7f25580d2fc0 2023-07-14T12:54:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.333+0000 7f255e49c640 1 --2- 172.21.15.5:0/3294329400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25580d2300 0x7f255814e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:54:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.333+0000 7f255dc9b640 1 --2- 172.21.15.5:0/3294329400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25580d2fc0 0x7f2558153130 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f254800c390 tx=0x7f254800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.333+0000 7f254effd640 1 -- 172.21.15.5:0/3294329400 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25480052d0 con 0x7f25580d2fc0 2023-07-14T12:54:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.333+0000 7f254effd640 1 -- 172.21.15.5:0/3294329400 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2548005430 con 0x7f25580d2fc0 2023-07-14T12:54:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.333+0000 7f254effd640 1 -- 172.21.15.5:0/3294329400 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2548003820 con 0x7f25580d2fc0 2023-07-14T12:54:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.333+0000 7f2560700640 1 -- 172.21.15.5:0/3294329400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2558153b10 con 0x7f25580d2fc0 2023-07-14T12:54:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.333+0000 7f2560700640 1 -- 172.21.15.5:0/3294329400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25580c6040 con 0x7f25580d2fc0 2023-07-14T12:54:05.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.337+0000 7f2560700640 1 -- 172.21.15.5:0/3294329400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25580c5ea0 con 0x7f25580d2fc0 2023-07-14T12:54:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.337+0000 7f254effd640 1 -- 172.21.15.5:0/3294329400 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f2548003980 con 0x7f25580d2fc0 2023-07-14T12:54:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.337+0000 7f254effd640 1 --2- 172.21.15.5:0/3294329400 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f253c066480 0x7f253c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.337+0000 7f254effd640 1 -- 172.21.15.5:0/3294329400 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f2548083690 con 0x7f25580d2fc0 2023-07-14T12:54:05.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.337+0000 7f255e49c640 1 --2- 172.21.15.5:0/3294329400 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f253c066480 0x7f253c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:05.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.337+0000 7f255e49c640 1 --2- 172.21.15.5:0/3294329400 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f253c066480 0x7f253c068930 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f25540af000 tx=0x7f25540a7000 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:05.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.341+0000 7f254effd640 1 -- 172.21.15.5:0/3294329400 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f25580c5ea0 con 0x7f25580d2fc0 2023-07-14T12:54:05.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.517+0000 7f2560700640 1 -- 172.21.15.5:0/3294329400 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f25580d07b0 con 0x7f253c066480 2023-07-14T12:54:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.577+0000 7f254effd640 1 -- 172.21.15.5:0/3294329400 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f2554003620 con 0x7f253c066480 2023-07-14T12:54:05.607 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule set for path /snap_test_dir1/dir9 2023-07-14T12:54:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.581+0000 7f2560700640 1 -- 172.21.15.5:0/3294329400 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f253c066480 msgr2=0x7f253c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.581+0000 7f2560700640 1 --2- 172.21.15.5:0/3294329400 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f253c066480 0x7f253c068930 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f25540af000 tx=0x7f25540a7000 comp rx=0 tx=0).stop 2023-07-14T12:54:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.581+0000 7f2560700640 1 -- 172.21.15.5:0/3294329400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25580d2fc0 msgr2=0x7f2558153130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.581+0000 7f2560700640 1 --2- 172.21.15.5:0/3294329400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25580d2fc0 0x7f2558153130 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f254800c390 tx=0x7f254800c850 comp rx=0 tx=0).stop 2023-07-14T12:54:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.581+0000 7f2560700640 1 -- 172.21.15.5:0/3294329400 shutdown_connections 2023-07-14T12:54:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.581+0000 7f2560700640 1 --2- 172.21.15.5:0/3294329400 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f253c066480 0x7f253c068930 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.581+0000 7f2560700640 1 --2- 172.21.15.5:0/3294329400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f255815bde0 0x7f25580b7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.581+0000 7f2560700640 1 --2- 172.21.15.5:0/3294329400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25580d2fc0 0x7f2558153130 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.581+0000 7f2560700640 1 --2- 172.21.15.5:0/3294329400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25580d2300 0x7f255814e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.581+0000 7f2560700640 1 -- 172.21.15.5:0/3294329400 >> 172.21.15.5:0/3294329400 conn(0x7f25580659d0 msgr2=0x7f25580cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.581+0000 7f2560700640 1 -- 172.21.15.5:0/3294329400 shutdown_connections 2023-07-14T12:54:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.581+0000 7f2560700640 1 -- 172.21.15.5:0/3294329400 wait complete. 2023-07-14T12:54:05.627 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir9 2023-07-14T12:54:05.628 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir0 1M 2023-07-14T12:54:05.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.749+0000 7f3f00acb640 1 Processor -- start 2023-07-14T12:54:05.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.749+0000 7f3f00acb640 1 -- start start 2023-07-14T12:54:05.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.749+0000 7f3f00acb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3efc069430 0x7f3efc069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:05.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.749+0000 7f3f00acb640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3efc159d70 con 0x7f3efc0af2b0 2023-07-14T12:54:05.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.749+0000 7f3f00acb640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3efc069d40 con 0x7f3efc070f30 2023-07-14T12:54:05.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.749+0000 7f3f00acb640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3efc0c9c60 con 0x7f3efc069430 2023-07-14T12:54:05.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.749+0000 7f3efa59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3efc069430 0x7f3efc069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:05.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.749+0000 7f3efa59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3efc069430 0x7f3efc069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32874/0 (socket says 172.21.15.5:32874) 2023-07-14T12:54:05.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.749+0000 7f3efa59c640 1 -- 172.21.15.5:0/2347578310 learned_addr learned my addr 172.21.15.5:0/2347578310 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:05.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.753+0000 7f3efa59c640 1 -- 172.21.15.5:0/2347578310 >> v1:172.21.15.154:6789/0 conn(0x7f3efc070f30 legacy=0x7f3efc0ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:05.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.753+0000 7f3efa59c640 1 -- 172.21.15.5:0/2347578310 >> v1:172.21.15.5:6789/0 conn(0x7f3efc0af2b0 legacy=0x7f3efc15a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:05.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.753+0000 7f3efa59c640 1 -- 172.21.15.5:0/2347578310 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3efc0c9f40 con 0x7f3efc069430 2023-07-14T12:54:05.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.753+0000 7f3efa59c640 1 --2- 172.21.15.5:0/2347578310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3efc069430 0x7f3efc069800 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3eec009870 tx=0x7f3eec01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57e200620dbaecd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:05.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.753+0000 7f3ef959a640 1 -- 172.21.15.5:0/2347578310 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec0ab650 con 0x7f3efc069430 2023-07-14T12:54:05.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.753+0000 7f3ef959a640 1 -- 172.21.15.5:0/2347578310 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eec0ab7b0 con 0x7f3efc069430 2023-07-14T12:54:05.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.753+0000 7f3ef959a640 1 -- 172.21.15.5:0/2347578310 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec0abb40 con 0x7f3efc069430 2023-07-14T12:54:05.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.753+0000 7f3f00acb640 1 -- 172.21.15.5:0/2347578310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3efc069430 msgr2=0x7f3efc069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:05.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.753+0000 7f3f00acb640 1 --2- 172.21.15.5:0/2347578310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3efc069430 0x7f3efc069800 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3eec009870 tx=0x7f3eec01c540 comp rx=0 tx=0).stop 2023-07-14T12:54:05.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.757+0000 7f3f00acb640 1 -- 172.21.15.5:0/2347578310 shutdown_connections 2023-07-14T12:54:05.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.757+0000 7f3f00acb640 1 --2- 172.21.15.5:0/2347578310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3efc069430 0x7f3efc069800 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:05.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.757+0000 7f3f00acb640 1 -- 172.21.15.5:0/2347578310 >> 172.21.15.5:0/2347578310 conn(0x7f3efc0cde90 msgr2=0x7f3efc0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:05.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.757+0000 7f3f00acb640 1 -- 172.21.15.5:0/2347578310 shutdown_connections 2023-07-14T12:54:05.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.757+0000 7f3f00acb640 1 -- 172.21.15.5:0/2347578310 wait complete. 2023-07-14T12:54:05.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.757+0000 7f3f00acb640 1 Processor -- start 2023-07-14T12:54:05.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.757+0000 7f3f00acb640 1 -- start start 2023-07-14T12:54:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.757+0000 7f3f00acb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3efc069430 0x7f3efc14e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.757+0000 7f3f00acb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3efc070f30 0x7f3efc0ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.757+0000 7f3f00acb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3efc0af2b0 0x7f3efc0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:05.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.757+0000 7f3f00acb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc0cbdb0 con 0x7f3efc069430 2023-07-14T12:54:05.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.757+0000 7f3f00acb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc0cc030 con 0x7f3efc0af2b0 2023-07-14T12:54:05.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.757+0000 7f3f00acb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc0cc310 con 0x7f3efc070f30 2023-07-14T12:54:05.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.757+0000 7f3efa59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3efc069430 0x7f3efc14e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:05.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.757+0000 7f3efa59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3efc069430 0x7f3efc14e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32890/0 (socket says 172.21.15.5:32890) 2023-07-14T12:54:05.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.757+0000 7f3efa59c640 1 -- 172.21.15.5:0/4233853707 learned_addr learned my addr 172.21.15.5:0/4233853707 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:05.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.757+0000 7f3efad9d640 1 --2- 172.21.15.5:0/4233853707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3efc0af2b0 0x7f3efc0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.757+0000 7f3ef9d9b640 1 --2- 172.21.15.5:0/4233853707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3efc070f30 0x7f3efc0ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.757+0000 7f3efa59c640 1 -- 172.21.15.5:0/4233853707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3efc070f30 msgr2=0x7f3efc0ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.757+0000 7f3efa59c640 1 --2- 172.21.15.5:0/4233853707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3efc070f30 0x7f3efc0ab890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.757+0000 7f3efa59c640 1 -- 172.21.15.5:0/4233853707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3efc0af2b0 msgr2=0x7f3efc0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.757+0000 7f3efa59c640 1 --2- 172.21.15.5:0/4233853707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3efc0af2b0 0x7f3efc0abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.757+0000 7f3efa59c640 1 -- 172.21.15.5:0/4233853707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec0094d0 con 0x7f3efc069430 2023-07-14T12:54:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.757+0000 7f3ef9d9b640 1 --2- 172.21.15.5:0/4233853707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3efc070f30 0x7f3efc0ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:54:05.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.757+0000 7f3efa59c640 1 --2- 172.21.15.5:0/4233853707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3efc069430 0x7f3efc14e940 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3eec0ad040 tx=0x7f3eec01ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:05.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.761+0000 7f3eeaffd640 1 -- 172.21.15.5:0/4233853707 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec0b4800 con 0x7f3efc069430 2023-07-14T12:54:05.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.761+0000 7f3eeaffd640 1 -- 172.21.15.5:0/4233853707 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eec0b4980 con 0x7f3efc069430 2023-07-14T12:54:05.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.761+0000 7f3f00acb640 1 -- 172.21.15.5:0/4233853707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3efc0cc5f0 con 0x7f3efc069430 2023-07-14T12:54:05.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.761+0000 7f3eeaffd640 1 -- 172.21.15.5:0/4233853707 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec0b4d30 con 0x7f3efc069430 2023-07-14T12:54:05.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.761+0000 7f3f00acb640 1 -- 172.21.15.5:0/4233853707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3efc14ee80 con 0x7f3efc069430 2023-07-14T12:54:05.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.761+0000 7f3f00acb640 1 -- 172.21.15.5:0/4233853707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3efc0678d0 con 0x7f3efc069430 2023-07-14T12:54:05.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.761+0000 7f3eeaffd640 1 -- 172.21.15.5:0/4233853707 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f3eec0b3380 con 0x7f3efc069430 2023-07-14T12:54:05.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.761+0000 7f3eeaffd640 1 --2- 172.21.15.5:0/4233853707 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f3edc066480 0x7f3edc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:05.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.761+0000 7f3eeaffd640 1 -- 172.21.15.5:0/4233853707 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f3eec11e870 con 0x7f3efc069430 2023-07-14T12:54:05.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.761+0000 7f3ef9d9b640 1 --2- 172.21.15.5:0/4233853707 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f3edc066480 0x7f3edc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:05.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.761+0000 7f3ef9d9b640 1 --2- 172.21.15.5:0/4233853707 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f3edc066480 0x7f3edc068930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0b4060 tx=0x7f3ef0009040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:05.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.765+0000 7f3eeaffd640 1 -- 172.21.15.5:0/4233853707 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3eec0ebb70 con 0x7f3efc069430 2023-07-14T12:54:05.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.941+0000 7f3f00acb640 1 -- 172.21.15.5:0/4233853707 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3efc157710 con 0x7f3edc066480 2023-07-14T12:54:06.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.989+0000 7f3eeaffd640 1 -- 172.21.15.5:0/4233853707 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f3ef0001ca0 con 0x7f3edc066480 2023-07-14T12:54:06.019 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule activated for path /snap_test_dir1/dir0 2023-07-14T12:54:06.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.993+0000 7f3f00acb640 1 -- 172.21.15.5:0/4233853707 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f3edc066480 msgr2=0x7f3edc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:06.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.993+0000 7f3f00acb640 1 --2- 172.21.15.5:0/4233853707 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f3edc066480 0x7f3edc068930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0b4060 tx=0x7f3ef0009040 comp rx=0 tx=0).stop 2023-07-14T12:54:06.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.993+0000 7f3f00acb640 1 -- 172.21.15.5:0/4233853707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3efc069430 msgr2=0x7f3efc14e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:06.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.993+0000 7f3f00acb640 1 --2- 172.21.15.5:0/4233853707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3efc069430 0x7f3efc14e940 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3eec0ad040 tx=0x7f3eec01ad80 comp rx=0 tx=0).stop 2023-07-14T12:54:06.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.993+0000 7f3f00acb640 1 -- 172.21.15.5:0/4233853707 shutdown_connections 2023-07-14T12:54:06.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.993+0000 7f3f00acb640 1 --2- 172.21.15.5:0/4233853707 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f3edc066480 0x7f3edc068930 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:06.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.993+0000 7f3f00acb640 1 --2- 172.21.15.5:0/4233853707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3efc0af2b0 0x7f3efc0abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:06.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.993+0000 7f3f00acb640 1 --2- 172.21.15.5:0/4233853707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3efc070f30 0x7f3efc0ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:06.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.993+0000 7f3f00acb640 1 --2- 172.21.15.5:0/4233853707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3efc069430 0x7f3efc14e940 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:06.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.993+0000 7f3f00acb640 1 -- 172.21.15.5:0/4233853707 >> 172.21.15.5:0/4233853707 conn(0x7f3efc0cde90 msgr2=0x7f3efc0ada60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:06.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.993+0000 7f3f00acb640 1 -- 172.21.15.5:0/4233853707 shutdown_connections 2023-07-14T12:54:06.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:05.993+0000 7f3f00acb640 1 -- 172.21.15.5:0/4233853707 wait complete. 2023-07-14T12:54:06.040 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir0 2023-07-14T12:54:06.041 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir1 1M 2023-07-14T12:54:06.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.161+0000 7fe67bc26640 1 Processor -- start 2023-07-14T12:54:06.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.161+0000 7fe67bc26640 1 -- start start 2023-07-14T12:54:06.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.161+0000 7fe67bc26640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe6740cf2e0 0x7fe6740cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:06.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.161+0000 7fe67bc26640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6740d0920 con 0x7fe67406a540 2023-07-14T12:54:06.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.161+0000 7fe67bc26640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe67415bfd0 con 0x7fe6740ca790 2023-07-14T12:54:06.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.161+0000 7fe67bc26640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6740cfd10 con 0x7fe6740cf2e0 2023-07-14T12:54:06.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.165+0000 7fe6799c2640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe67406a540 0x7fe67406a910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52134/0 (socket says 172.21.15.5:52134) 2023-07-14T12:54:06.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.165+0000 7fe6799c2640 1 -- 172.21.15.5:0/252549174 learned_addr learned my addr 172.21.15.5:0/252549174 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:54:06.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.161+0000 7fe6791c1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe6740cf2e0 0x7fe6740cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:06.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.165+0000 7fe6791c1640 1 -- 172.21.15.5:0/252549174 >> v1:172.21.15.154:6789/0 conn(0x7fe6740ca790 legacy=0x7fe6740cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:06.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.165+0000 7fe6791c1640 1 -- 172.21.15.5:0/252549174 >> v1:172.21.15.5:6789/0 conn(0x7fe67406a540 legacy=0x7fe67406a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:06.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.165+0000 7fe6791c1640 1 -- 172.21.15.5:0/252549174 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6740cfff0 con 0x7fe6740cf2e0 2023-07-14T12:54:06.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.165+0000 7fe6791c1640 1 --2- 172.21.15.5:0/252549174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6740cf2e0 0x7fe6740cf710 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe6640097f0 tx=0x7fe66401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16107761cdda009d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:06.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.165+0000 7fe6789c0640 1 -- 172.21.15.5:0/252549174 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6640ad660 con 0x7fe6740cf2e0 2023-07-14T12:54:06.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.165+0000 7fe6789c0640 1 -- 172.21.15.5:0/252549174 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6640ad7c0 con 0x7fe6740cf2e0 2023-07-14T12:54:06.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.165+0000 7fe6789c0640 1 -- 172.21.15.5:0/252549174 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6640adb50 con 0x7fe6740cf2e0 2023-07-14T12:54:06.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.169+0000 7fe67bc26640 1 -- 172.21.15.5:0/252549174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6740cf2e0 msgr2=0x7fe6740cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:06.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.169+0000 7fe67bc26640 1 --2- 172.21.15.5:0/252549174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6740cf2e0 0x7fe6740cf710 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe6640097f0 tx=0x7fe66401c450 comp rx=0 tx=0).stop 2023-07-14T12:54:06.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.169+0000 7fe67bc26640 1 -- 172.21.15.5:0/252549174 shutdown_connections 2023-07-14T12:54:06.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.169+0000 7fe67bc26640 1 --2- 172.21.15.5:0/252549174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6740cf2e0 0x7fe6740cf710 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:06.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.169+0000 7fe67bc26640 1 -- 172.21.15.5:0/252549174 >> 172.21.15.5:0/252549174 conn(0x7fe674099490 msgr2=0x7fe674089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:06.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.169+0000 7fe67bc26640 1 -- 172.21.15.5:0/252549174 shutdown_connections 2023-07-14T12:54:06.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.169+0000 7fe67bc26640 1 -- 172.21.15.5:0/252549174 wait complete. 2023-07-14T12:54:06.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.169+0000 7fe67bc26640 1 Processor -- start 2023-07-14T12:54:06.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.169+0000 7fe67bc26640 1 -- start start 2023-07-14T12:54:06.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.169+0000 7fe67bc26640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe67406a540 0x7fe6740c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:06.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.169+0000 7fe67bc26640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6740ca790 0x7fe674151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:06.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.169+0000 7fe67bc26640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6740cf2e0 0x7fe6740cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:06.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.169+0000 7fe67bc26640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe674154bc0 con 0x7fe6740cf2e0 2023-07-14T12:54:06.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.169+0000 7fe67bc26640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6741548e0 con 0x7fe67406a540 2023-07-14T12:54:06.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.169+0000 7fe67bc26640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe674152a80 con 0x7fe6740ca790 2023-07-14T12:54:06.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.169+0000 7fe67a1c3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6740cf2e0 0x7fe6740cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:06.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.169+0000 7fe6799c2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe67406a540 0x7fe6740c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:06.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.169+0000 7fe67a1c3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6740cf2e0 0x7fe6740cca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32910/0 (socket says 172.21.15.5:32910) 2023-07-14T12:54:06.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.169+0000 7fe67a1c3640 1 -- 172.21.15.5:0/3031999956 learned_addr learned my addr 172.21.15.5:0/3031999956 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:06.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.169+0000 7fe6791c1640 1 --2- 172.21.15.5:0/3031999956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6740ca790 0x7fe674151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:06.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.169+0000 7fe67a1c3640 1 -- 172.21.15.5:0/3031999956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6740ca790 msgr2=0x7fe674151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:06.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.169+0000 7fe67a1c3640 1 --2- 172.21.15.5:0/3031999956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6740ca790 0x7fe674151540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:06.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.169+0000 7fe67a1c3640 1 -- 172.21.15.5:0/3031999956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe67406a540 msgr2=0x7fe6740c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:06.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.169+0000 7fe67a1c3640 1 --2- 172.21.15.5:0/3031999956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe67406a540 0x7fe6740c3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:06.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.169+0000 7fe67a1c3640 1 -- 172.21.15.5:0/3031999956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe664009420 con 0x7fe6740cf2e0 2023-07-14T12:54:06.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.173+0000 7fe67a1c3640 1 --2- 172.21.15.5:0/3031999956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6740cf2e0 0x7fe6740cca10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00c730 tx=0x7fe66c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:06.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.173+0000 7fe66a7fc640 1 -- 172.21.15.5:0/3031999956 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c003b80 con 0x7fe6740cf2e0 2023-07-14T12:54:06.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.173+0000 7fe66a7fc640 1 -- 172.21.15.5:0/3031999956 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66c003ce0 con 0x7fe6740cf2e0 2023-07-14T12:54:06.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.173+0000 7fe66a7fc640 1 -- 172.21.15.5:0/3031999956 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c00aa30 con 0x7fe6740cf2e0 2023-07-14T12:54:06.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.173+0000 7fe67bc26640 1 -- 172.21.15.5:0/3031999956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe674152d60 con 0x7fe6740cf2e0 2023-07-14T12:54:06.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.173+0000 7fe67bc26640 1 -- 172.21.15.5:0/3031999956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6740c4430 con 0x7fe6740cf2e0 2023-07-14T12:54:06.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.173+0000 7fe67bc26640 1 -- 172.21.15.5:0/3031999956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe674154d70 con 0x7fe6740cf2e0 2023-07-14T12:54:06.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.173+0000 7fe66a7fc640 1 -- 172.21.15.5:0/3031999956 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fe66c00ab90 con 0x7fe6740cf2e0 2023-07-14T12:54:06.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.173+0000 7fe66a7fc640 1 --2- 172.21.15.5:0/3031999956 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fe658066480 0x7fe658068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:06.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.173+0000 7fe66a7fc640 1 -- 172.21.15.5:0/3031999956 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fe66c084920 con 0x7fe6740cf2e0 2023-07-14T12:54:06.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.177+0000 7fe6799c2640 1 --2- 172.21.15.5:0/3031999956 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fe658066480 0x7fe658068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:06.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.177+0000 7fe6799c2640 1 --2- 172.21.15.5:0/3031999956 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fe658066480 0x7fe658068930 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe670005890 tx=0x7fe670009040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:06.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.177+0000 7fe66a7fc640 1 -- 172.21.15.5:0/3031999956 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe66c051ad0 con 0x7fe6740cf2e0 2023-07-14T12:54:06.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.353+0000 7fe67bc26640 1 -- 172.21.15.5:0/3031999956 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6740cee70 con 0x7fe658066480 2023-07-14T12:54:06.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.405+0000 7fe66a7fc640 1 -- 172.21.15.5:0/3031999956 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fe670001470 con 0x7fe658066480 2023-07-14T12:54:06.435 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule activated for path /snap_test_dir1/dir1 2023-07-14T12:54:06.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.409+0000 7fe67bc26640 1 -- 172.21.15.5:0/3031999956 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fe658066480 msgr2=0x7fe658068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:06.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.409+0000 7fe67bc26640 1 --2- 172.21.15.5:0/3031999956 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fe658066480 0x7fe658068930 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe670005890 tx=0x7fe670009040 comp rx=0 tx=0).stop 2023-07-14T12:54:06.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.409+0000 7fe67bc26640 1 -- 172.21.15.5:0/3031999956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6740cf2e0 msgr2=0x7fe6740cca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:06.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.409+0000 7fe67bc26640 1 --2- 172.21.15.5:0/3031999956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6740cf2e0 0x7fe6740cca10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00c730 tx=0x7fe66c00cbf0 comp rx=0 tx=0).stop 2023-07-14T12:54:06.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.409+0000 7fe67bc26640 1 -- 172.21.15.5:0/3031999956 shutdown_connections 2023-07-14T12:54:06.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.409+0000 7fe67bc26640 1 --2- 172.21.15.5:0/3031999956 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fe658066480 0x7fe658068930 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:06.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.409+0000 7fe67bc26640 1 --2- 172.21.15.5:0/3031999956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6740cf2e0 0x7fe6740cca10 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:06.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.409+0000 7fe67bc26640 1 --2- 172.21.15.5:0/3031999956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6740ca790 0x7fe674151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:06.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.409+0000 7fe67bc26640 1 --2- 172.21.15.5:0/3031999956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe67406a540 0x7fe6740c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:06.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.409+0000 7fe67bc26640 1 -- 172.21.15.5:0/3031999956 >> 172.21.15.5:0/3031999956 conn(0x7fe674099490 msgr2=0x7fe6740ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:06.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.409+0000 7fe67bc26640 1 -- 172.21.15.5:0/3031999956 shutdown_connections 2023-07-14T12:54:06.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.409+0000 7fe67bc26640 1 -- 172.21.15.5:0/3031999956 wait complete. 2023-07-14T12:54:06.456 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir1 2023-07-14T12:54:06.457 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir2 1M 2023-07-14T12:54:06.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.577+0000 7f1e914d8640 1 Processor -- start 2023-07-14T12:54:06.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.577+0000 7f1e914d8640 1 -- start start 2023-07-14T12:54:06.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e914d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e8c15bba0 0x7f1e8c0c4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:06.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e914d8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e8c15bf70 con 0x7f1e8c0ad450 2023-07-14T12:54:06.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e914d8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e8c1600e0 con 0x7f1e8c0c2d30 2023-07-14T12:54:06.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e914d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c0c4d00 con 0x7f1e8c15bba0 2023-07-14T12:54:06.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e8b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1e8c0ad450 0x7f1e8c0ad930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52150/0 (socket says 172.21.15.5:52150) 2023-07-14T12:54:06.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e8b7fe640 1 -- 172.21.15.5:0/3325367549 learned_addr learned my addr 172.21.15.5:0/3325367549 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:54:06.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e8affd640 1 --2- 172.21.15.5:0/3325367549 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e8c15bba0 0x7f1e8c0c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:06.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e8a7fc640 1 -- 172.21.15.5:0/3325367549 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1248765880 0 0) 0x7f1e8c15bf70 con 0x7f1e8c0ad450 2023-07-14T12:54:06.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e8a7fc640 1 -- 172.21.15.5:0/3325367549 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e78003530 con 0x7f1e8c0ad450 2023-07-14T12:54:06.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e8a7fc640 1 -- 172.21.15.5:0/3325367549 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 890529228 0 0) 0x7f1e78003530 con 0x7f1e8c0ad450 2023-07-14T12:54:06.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e8a7fc640 1 -- 172.21.15.5:0/3325367549 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e8c15bba0 msgr2=0x7f1e8c0c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:54:06.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e8a7fc640 1 --2- 172.21.15.5:0/3325367549 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e8c15bba0 0x7f1e8c0c4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:06.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e8a7fc640 1 -- 172.21.15.5:0/3325367549 >> v1:172.21.15.154:6789/0 conn(0x7f1e8c0c2d30 legacy=0x7f1e8c0acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:06.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e8a7fc640 1 -- 172.21.15.5:0/3325367549 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8c160570 con 0x7f1e8c0ad450 2023-07-14T12:54:06.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e8a7fc640 1 -- 172.21.15.5:0/3325367549 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f1e84001a00 con 0x7f1e8c0ad450 2023-07-14T12:54:06.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e8a7fc640 1 -- 172.21.15.5:0/3325367549 >> v1:172.21.15.5:6789/0 conn(0x7f1e8c0ad450 legacy=0x7f1e8c0ad930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:06.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e8a7fc640 1 --2- 172.21.15.5:0/3325367549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e780039b0 0x7f1e78003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e8a7fc640 1 --2- 172.21.15.5:0/3325367549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e780047d0 0x7f1e78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e8a7fc640 1 --2- 172.21.15.5:0/3325367549 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e8c15bba0 0x7f1e780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e8a7fc640 1 -- 172.21.15.5:0/3325367549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c0c4d00 con 0x7f1e780039b0 2023-07-14T12:54:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e8a7fc640 1 -- 172.21.15.5:0/3325367549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7800bac0 con 0x7f1e780047d0 2023-07-14T12:54:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e8a7fc640 1 -- 172.21.15.5:0/3325367549 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7800bc80 con 0x7f1e8c15bba0 2023-07-14T12:54:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e8affd640 1 --2- 172.21.15.5:0/3325367549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e780039b0 0x7f1e78003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e8b7fe640 1 --2- 172.21.15.5:0/3325367549 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e8c15bba0 0x7f1e780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e83fff640 1 --2- 172.21.15.5:0/3325367549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e780047d0 0x7f1e78004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e8affd640 1 -- 172.21.15.5:0/3325367549 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e8c15bba0 msgr2=0x7f1e780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:54:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e8affd640 1 --2- 172.21.15.5:0/3325367549 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e8c15bba0 0x7f1e780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e8affd640 1 -- 172.21.15.5:0/3325367549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e780047d0 msgr2=0x7f1e78004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:54:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e8affd640 1 --2- 172.21.15.5:0/3325367549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e780047d0 0x7f1e78004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e8affd640 1 -- 172.21.15.5:0/3325367549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e78003530 con 0x7f1e780039b0 2023-07-14T12:54:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.581+0000 7f1e83fff640 1 --2- 172.21.15.5:0/3325367549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e780047d0 0x7f1e78004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:54:06.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.585+0000 7f1e8affd640 1 --2- 172.21.15.5:0/3325367549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e780039b0 0x7f1e78003d80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c009ae0 tx=0x7f1e7c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfea6d636fc05b4f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:06.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.585+0000 7f1e8a7fc640 1 -- 172.21.15.5:0/3325367549 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c0a5530 con 0x7f1e780039b0 2023-07-14T12:54:06.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.585+0000 7f1e8a7fc640 1 -- 172.21.15.5:0/3325367549 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7c0a5690 con 0x7f1e780039b0 2023-07-14T12:54:06.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.585+0000 7f1e8a7fc640 1 -- 172.21.15.5:0/3325367549 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c0a5a40 con 0x7f1e780039b0 2023-07-14T12:54:06.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.585+0000 7f1e914d8640 1 -- 172.21.15.5:0/3325367549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e780039b0 msgr2=0x7f1e78003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:06.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.585+0000 7f1e914d8640 1 --2- 172.21.15.5:0/3325367549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e780039b0 0x7f1e78003d80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c009ae0 tx=0x7f1e7c01c960 comp rx=0 tx=0).stop 2023-07-14T12:54:06.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.585+0000 7f1e8b7fe640 1 -- 172.21.15.5:0/3325367549 reap_dead start 2023-07-14T12:54:06.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.585+0000 7f1e914d8640 1 -- 172.21.15.5:0/3325367549 shutdown_connections 2023-07-14T12:54:06.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.585+0000 7f1e914d8640 1 -- 172.21.15.5:0/3325367549 >> 172.21.15.5:0/3325367549 conn(0x7f1e8c0cde90 msgr2=0x7f1e8c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:06.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.585+0000 7f1e914d8640 1 -- 172.21.15.5:0/3325367549 shutdown_connections 2023-07-14T12:54:06.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.585+0000 7f1e914d8640 1 -- 172.21.15.5:0/3325367549 wait complete. 2023-07-14T12:54:06.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.589+0000 7f1e914d8640 1 Processor -- start 2023-07-14T12:54:06.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.589+0000 7f1e914d8640 1 -- start start 2023-07-14T12:54:06.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.589+0000 7f1e914d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e780039b0 0x7f1e8c0ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.589+0000 7f1e914d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e8c15d1d0 0x7f1e8c15d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.589+0000 7f1e914d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e8c157f20 0x7f1e8c15de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.589+0000 7f1e914d8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c15cd40 con 0x7f1e8c157f20 2023-07-14T12:54:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.589+0000 7f1e914d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c0cd0b0 con 0x7f1e8c15d1d0 2023-07-14T12:54:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.589+0000 7f1e914d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c15c130 con 0x7f1e780039b0 2023-07-14T12:54:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.589+0000 7f1e8b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e8c157f20 0x7f1e8c15de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.589+0000 7f1e8b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e8c157f20 0x7f1e8c15de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32922/0 (socket says 172.21.15.5:32922) 2023-07-14T12:54:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.589+0000 7f1e8b7fe640 1 -- 172.21.15.5:0/3700113736 learned_addr learned my addr 172.21.15.5:0/3700113736 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.589+0000 7f1e83fff640 1 --2- 172.21.15.5:0/3700113736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e8c15d1d0 0x7f1e8c15d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.589+0000 7f1e8affd640 1 --2- 172.21.15.5:0/3700113736 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e780039b0 0x7f1e8c0ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.589+0000 7f1e8b7fe640 1 -- 172.21.15.5:0/3700113736 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e780039b0 msgr2=0x7f1e8c0ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.589+0000 7f1e8b7fe640 1 --2- 172.21.15.5:0/3700113736 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e780039b0 0x7f1e8c0ccb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.589+0000 7f1e8b7fe640 1 -- 172.21.15.5:0/3700113736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e8c15d1d0 msgr2=0x7f1e8c15d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.589+0000 7f1e8b7fe640 1 --2- 172.21.15.5:0/3700113736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e8c15d1d0 0x7f1e8c15d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.589+0000 7f1e8b7fe640 1 -- 172.21.15.5:0/3700113736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8c15c410 con 0x7f1e8c157f20 2023-07-14T12:54:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.589+0000 7f1e8b7fe640 1 --2- 172.21.15.5:0/3700113736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e8c157f20 0x7f1e8c15de80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1e84000f90 tx=0x7f1e84007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.589+0000 7f1e837fe640 1 -- 172.21.15.5:0/3700113736 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e84013600 con 0x7f1e8c157f20 2023-07-14T12:54:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.589+0000 7f1e837fe640 1 -- 172.21.15.5:0/3700113736 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e84013780 con 0x7f1e8c157f20 2023-07-14T12:54:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.589+0000 7f1e837fe640 1 -- 172.21.15.5:0/3700113736 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e84013b30 con 0x7f1e8c157f20 2023-07-14T12:54:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.589+0000 7f1e914d8640 1 -- 172.21.15.5:0/3700113736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e8c15c6f0 con 0x7f1e8c157f20 2023-07-14T12:54:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.589+0000 7f1e914d8640 1 -- 172.21.15.5:0/3700113736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e8c148bc0 con 0x7f1e8c157f20 2023-07-14T12:54:06.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.593+0000 7f1e914d8640 1 -- 172.21.15.5:0/3700113736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e8c15ceb0 con 0x7f1e8c157f20 2023-07-14T12:54:06.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.593+0000 7f1e837fe640 1 -- 172.21.15.5:0/3700113736 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f1e84013c90 con 0x7f1e8c157f20 2023-07-14T12:54:06.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.593+0000 7f1e837fe640 1 --2- 172.21.15.5:0/3700113736 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f1e6c066480 0x7f1e6c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:06.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.593+0000 7f1e837fe640 1 -- 172.21.15.5:0/3700113736 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f1e84084040 con 0x7f1e8c157f20 2023-07-14T12:54:06.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.593+0000 7f1e8affd640 1 --2- 172.21.15.5:0/3700113736 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f1e6c066480 0x7f1e6c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:06.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.593+0000 7f1e8affd640 1 --2- 172.21.15.5:0/3700113736 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f1e6c066480 0x7f1e6c068930 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c0af000 tx=0x7f1e7c0046d0 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:06.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.597+0000 7f1e837fe640 1 -- 172.21.15.5:0/3700113736 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f1e84051170 con 0x7f1e8c157f20 2023-07-14T12:54:06.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.777+0000 7f1e914d8640 1 -- 172.21.15.5:0/3700113736 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e8c15fd70 con 0x7f1e6c066480 2023-07-14T12:54:06.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.837+0000 7f1e837fe640 1 -- 172.21.15.5:0/3700113736 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f1e7c00f080 con 0x7f1e6c066480 2023-07-14T12:54:06.865 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule activated for path /snap_test_dir1/dir2 2023-07-14T12:54:06.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.837+0000 7f1e914d8640 1 -- 172.21.15.5:0/3700113736 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f1e6c066480 msgr2=0x7f1e6c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:06.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.837+0000 7f1e914d8640 1 --2- 172.21.15.5:0/3700113736 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f1e6c066480 0x7f1e6c068930 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c0af000 tx=0x7f1e7c0046d0 comp rx=0 tx=0).stop 2023-07-14T12:54:06.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.837+0000 7f1e914d8640 1 -- 172.21.15.5:0/3700113736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e8c157f20 msgr2=0x7f1e8c15de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:06.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.837+0000 7f1e914d8640 1 --2- 172.21.15.5:0/3700113736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e8c157f20 0x7f1e8c15de80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1e84000f90 tx=0x7f1e84007800 comp rx=0 tx=0).stop 2023-07-14T12:54:06.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.837+0000 7f1e914d8640 1 -- 172.21.15.5:0/3700113736 shutdown_connections 2023-07-14T12:54:06.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.837+0000 7f1e914d8640 1 --2- 172.21.15.5:0/3700113736 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f1e6c066480 0x7f1e6c068930 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:06.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.837+0000 7f1e914d8640 1 --2- 172.21.15.5:0/3700113736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e8c157f20 0x7f1e8c15de80 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:06.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.837+0000 7f1e914d8640 1 --2- 172.21.15.5:0/3700113736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e8c15d1d0 0x7f1e8c15d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:06.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.837+0000 7f1e914d8640 1 --2- 172.21.15.5:0/3700113736 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e780039b0 0x7f1e8c0ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:06.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.837+0000 7f1e914d8640 1 -- 172.21.15.5:0/3700113736 >> 172.21.15.5:0/3700113736 conn(0x7f1e8c0cde90 msgr2=0x7f1e8c159b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:06.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.837+0000 7f1e914d8640 1 -- 172.21.15.5:0/3700113736 shutdown_connections 2023-07-14T12:54:06.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:06.837+0000 7f1e914d8640 1 -- 172.21.15.5:0/3700113736 wait complete. 2023-07-14T12:54:06.886 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir2 2023-07-14T12:54:06.886 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir3 1M 2023-07-14T12:54:07.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.009+0000 7fd55a87b640 1 Processor -- start 2023-07-14T12:54:07.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.009+0000 7fd55a87b640 1 -- start start 2023-07-14T12:54:07.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.009+0000 7fd55a87b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd55406a440 0x7fd5540b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:07.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.009+0000 7fd55a87b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd55406c040 con 0x7fd5541453a0 2023-07-14T12:54:07.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.009+0000 7fd55a87b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd554160600 con 0x7fd55415f690 2023-07-14T12:54:07.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.009+0000 7fd55a87b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd554160170 con 0x7fd55406a440 2023-07-14T12:54:07.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.009+0000 7fd5537fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd55406a440 0x7fd5540b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:07.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.009+0000 7fd5537fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd55406a440 0x7fd5540b1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32936/0 (socket says 172.21.15.5:32936) 2023-07-14T12:54:07.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.009+0000 7fd5537fe640 1 -- 172.21.15.5:0/629345885 learned_addr learned my addr 172.21.15.5:0/629345885 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:07.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.009+0000 7fd5537fe640 1 -- 172.21.15.5:0/629345885 >> v1:172.21.15.154:6789/0 conn(0x7fd55415f690 legacy=0x7fd55415fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:54:07.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.009+0000 7fd5537fe640 1 -- 172.21.15.5:0/629345885 >> v1:172.21.15.5:6789/0 conn(0x7fd5541453a0 legacy=0x7fd55406c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:07.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.009+0000 7fd5537fe640 1 -- 172.21.15.5:0/629345885 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd554160360 con 0x7fd55406a440 2023-07-14T12:54:07.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.013+0000 7fd5537fe640 1 --2- 172.21.15.5:0/629345885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd55406a440 0x7fd5540b1890 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd548009870 tx=0x7fd54801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59def98314238ba6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:07.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.013+0000 7fd552ffd640 1 -- 172.21.15.5:0/629345885 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5480a8050 con 0x7fd55406a440 2023-07-14T12:54:07.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.013+0000 7fd552ffd640 1 -- 172.21.15.5:0/629345885 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5480ac5f0 con 0x7fd55406a440 2023-07-14T12:54:07.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.013+0000 7fd552ffd640 1 -- 172.21.15.5:0/629345885 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5480ac980 con 0x7fd55406a440 2023-07-14T12:54:07.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.013+0000 7fd55a87b640 1 -- 172.21.15.5:0/629345885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd55406a440 msgr2=0x7fd5540b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:07.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.013+0000 7fd55a87b640 1 --2- 172.21.15.5:0/629345885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd55406a440 0x7fd5540b1890 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd548009870 tx=0x7fd54801c480 comp rx=0 tx=0).stop 2023-07-14T12:54:07.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.013+0000 7fd55a87b640 1 -- 172.21.15.5:0/629345885 shutdown_connections 2023-07-14T12:54:07.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.013+0000 7fd55a87b640 1 --2- 172.21.15.5:0/629345885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd55406a440 0x7fd5540b1890 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:07.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.013+0000 7fd55a87b640 1 -- 172.21.15.5:0/629345885 >> 172.21.15.5:0/629345885 conn(0x7fd5540b1210 msgr2=0x7fd5540ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:07.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.013+0000 7fd55a87b640 1 -- 172.21.15.5:0/629345885 shutdown_connections 2023-07-14T12:54:07.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.013+0000 7fd55a87b640 1 -- 172.21.15.5:0/629345885 wait complete. 2023-07-14T12:54:07.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.017+0000 7fd55a87b640 1 Processor -- start 2023-07-14T12:54:07.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.017+0000 7fd55a87b640 1 -- start start 2023-07-14T12:54:07.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.017+0000 7fd55a87b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd55406a440 0x7fd55415c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:07.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.017+0000 7fd55a87b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5541453a0 0x7fd5541f7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:07.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.017+0000 7fd55a87b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd55415f690 0x7fd55413eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:07.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.017+0000 7fd55a87b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55415d4b0 con 0x7fd5541453a0 2023-07-14T12:54:07.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.017+0000 7fd55a87b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5540cd550 con 0x7fd55415f690 2023-07-14T12:54:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.017+0000 7fd55a87b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd55415c930 con 0x7fd55406a440 2023-07-14T12:54:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.017+0000 7fd5537fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5541453a0 0x7fd5541f7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.017+0000 7fd5537fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5541453a0 0x7fd5541f7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32952/0 (socket says 172.21.15.5:32952) 2023-07-14T12:54:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.017+0000 7fd5537fe640 1 -- 172.21.15.5:0/3546548014 learned_addr learned my addr 172.21.15.5:0/3546548014 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.017+0000 7fd558e18640 1 --2- 172.21.15.5:0/3546548014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd55415f690 0x7fd55413eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.017+0000 7fd553fff640 1 --2- 172.21.15.5:0/3546548014 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd55406a440 0x7fd55415c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.017+0000 7fd5537fe640 1 -- 172.21.15.5:0/3546548014 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd55406a440 msgr2=0x7fd55415c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:07.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.017+0000 7fd5537fe640 1 --2- 172.21.15.5:0/3546548014 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd55406a440 0x7fd55415c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:07.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.017+0000 7fd5537fe640 1 -- 172.21.15.5:0/3546548014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd55415f690 msgr2=0x7fd55413eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:07.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.017+0000 7fd5537fe640 1 --2- 172.21.15.5:0/3546548014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd55415f690 0x7fd55413eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:07.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.017+0000 7fd5537fe640 1 -- 172.21.15.5:0/3546548014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5480094d0 con 0x7fd5541453a0 2023-07-14T12:54:07.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.017+0000 7fd558e18640 1 --2- 172.21.15.5:0/3546548014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd55415f690 0x7fd55413eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:54:07.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.017+0000 7fd5537fe640 1 --2- 172.21.15.5:0/3546548014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5541453a0 0x7fd5541f7de0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd5480af040 tx=0x7fd548019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:07.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.017+0000 7fd550ff9640 1 -- 172.21.15.5:0/3546548014 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5480b5650 con 0x7fd5541453a0 2023-07-14T12:54:07.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.017+0000 7fd550ff9640 1 -- 172.21.15.5:0/3546548014 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5480b57b0 con 0x7fd5541453a0 2023-07-14T12:54:07.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.017+0000 7fd55a87b640 1 -- 172.21.15.5:0/3546548014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd55415cc10 con 0x7fd5541453a0 2023-07-14T12:54:07.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.017+0000 7fd550ff9640 1 -- 172.21.15.5:0/3546548014 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5480b5b60 con 0x7fd5541453a0 2023-07-14T12:54:07.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.017+0000 7fd55a87b640 1 -- 172.21.15.5:0/3546548014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd55415d1d0 con 0x7fd5541453a0 2023-07-14T12:54:07.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.017+0000 7fd55a87b640 1 -- 172.21.15.5:0/3546548014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5540678d0 con 0x7fd5541453a0 2023-07-14T12:54:07.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.021+0000 7fd550ff9640 1 -- 172.21.15.5:0/3546548014 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fd5480b3070 con 0x7fd5541453a0 2023-07-14T12:54:07.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.021+0000 7fd550ff9640 1 --2- 172.21.15.5:0/3546548014 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fd5400664b0 0x7fd540068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:07.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.021+0000 7fd550ff9640 1 -- 172.21.15.5:0/3546548014 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fd54811def0 con 0x7fd5541453a0 2023-07-14T12:54:07.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.021+0000 7fd553fff640 1 --2- 172.21.15.5:0/3546548014 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fd5400664b0 0x7fd540068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:07.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.021+0000 7fd553fff640 1 --2- 172.21.15.5:0/3546548014 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fd5400664b0 0x7fd540068960 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd544000f70 tx=0x7fd544009040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:07.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.025+0000 7fd550ff9640 1 -- 172.21.15.5:0/3546548014 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd5480eae70 con 0x7fd5541453a0 2023-07-14T12:54:07.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.209+0000 7fd55a87b640 1 -- 172.21.15.5:0/3546548014 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd55406ad80 con 0x7fd5400664b0 2023-07-14T12:54:07.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.261+0000 7fd550ff9640 1 -- 172.21.15.5:0/3546548014 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fd544001370 con 0x7fd5400664b0 2023-07-14T12:54:07.291 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule activated for path /snap_test_dir1/dir3 2023-07-14T12:54:07.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.265+0000 7fd55a87b640 1 -- 172.21.15.5:0/3546548014 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fd5400664b0 msgr2=0x7fd540068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:07.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.265+0000 7fd55a87b640 1 --2- 172.21.15.5:0/3546548014 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fd5400664b0 0x7fd540068960 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd544000f70 tx=0x7fd544009040 comp rx=0 tx=0).stop 2023-07-14T12:54:07.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.265+0000 7fd55a87b640 1 -- 172.21.15.5:0/3546548014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5541453a0 msgr2=0x7fd5541f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:07.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.265+0000 7fd55a87b640 1 --2- 172.21.15.5:0/3546548014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5541453a0 0x7fd5541f7de0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd5480af040 tx=0x7fd548019220 comp rx=0 tx=0).stop 2023-07-14T12:54:07.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.265+0000 7fd55a87b640 1 -- 172.21.15.5:0/3546548014 shutdown_connections 2023-07-14T12:54:07.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.265+0000 7fd55a87b640 1 --2- 172.21.15.5:0/3546548014 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fd5400664b0 0x7fd540068960 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:07.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.265+0000 7fd55a87b640 1 --2- 172.21.15.5:0/3546548014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd55415f690 0x7fd55413eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:07.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.265+0000 7fd55a87b640 1 --2- 172.21.15.5:0/3546548014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5541453a0 0x7fd5541f7de0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:07.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.265+0000 7fd55a87b640 1 --2- 172.21.15.5:0/3546548014 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd55406a440 0x7fd55415c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:07.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.265+0000 7fd55a87b640 1 -- 172.21.15.5:0/3546548014 >> 172.21.15.5:0/3546548014 conn(0x7fd5540b1210 msgr2=0x7fd5540705a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:07.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.265+0000 7fd55a87b640 1 -- 172.21.15.5:0/3546548014 shutdown_connections 2023-07-14T12:54:07.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.265+0000 7fd55a87b640 1 -- 172.21.15.5:0/3546548014 wait complete. 2023-07-14T12:54:07.311 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir3 2023-07-14T12:54:07.312 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir4 1M 2023-07-14T12:54:07.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.433+0000 7f4ff57c5640 1 Processor -- start 2023-07-14T12:54:07.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.433+0000 7f4ff57c5640 1 -- start start 2023-07-14T12:54:07.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.433+0000 7f4ff57c5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4ff00d2fc0 0x7f4ff00b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:07.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.433+0000 7f4ff57c5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff00b04c0 con 0x7f4ff00d2300 2023-07-14T12:54:07.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.433+0000 7f4ff57c5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff00d0aa0 con 0x7f4ff015bde0 2023-07-14T12:54:07.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.433+0000 7f4ff57c5640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff015c1b0 con 0x7f4ff00d2fc0 2023-07-14T12:54:07.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.433+0000 7f4fef7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4ff00d2300 0x7f4ff00cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52168/0 (socket says 172.21.15.5:52168) 2023-07-14T12:54:07.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.433+0000 7f4fef7fe640 1 -- 172.21.15.5:0/3180387492 learned_addr learned my addr 172.21.15.5:0/3180387492 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:54:07.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.433+0000 7f4fe7fff640 1 --2- 172.21.15.5:0/3180387492 >> v2:172.21.15.154:3300/0 conn(0x7f4ff00d2fc0 0x7f4ff00b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:07.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.437+0000 7f4fee7fc640 1 -- 172.21.15.5:0/3180387492 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1657577918 0 0) 0x7f4ff00b04c0 con 0x7f4ff00d2300 2023-07-14T12:54:07.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.437+0000 7f4fee7fc640 1 -- 172.21.15.5:0/3180387492 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fdc003530 con 0x7f4ff00d2300 2023-07-14T12:54:07.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.437+0000 7f4fee7fc640 1 -- 172.21.15.5:0/3180387492 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4194526163 0 0) 0x7f4ff00d0aa0 con 0x7f4ff015bde0 2023-07-14T12:54:07.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.437+0000 7f4fee7fc640 1 -- 172.21.15.5:0/3180387492 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ff00b04c0 con 0x7f4ff015bde0 2023-07-14T12:54:07.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.437+0000 7f4fe7fff640 1 -- 172.21.15.5:0/3180387492 >> v1:172.21.15.154:6789/0 conn(0x7f4ff015bde0 legacy=0x7f4ff00d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:07.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.437+0000 7f4fe7fff640 1 -- 172.21.15.5:0/3180387492 >> v1:172.21.15.5:6789/0 conn(0x7f4ff00d2300 legacy=0x7f4ff00cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:07.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.437+0000 7f4fe7fff640 1 -- 172.21.15.5:0/3180387492 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff00afb90 con 0x7f4ff00d2fc0 2023-07-14T12:54:07.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.437+0000 7f4fe7fff640 1 --2- 172.21.15.5:0/3180387492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ff00d2fc0 0x7f4ff00b0950 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4fd80097c0 tx=0x7f4fd801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0f6a71bbed31957 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.441+0000 7f4fee7fc640 1 -- 172.21.15.5:0/3180387492 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd80ab680 con 0x7f4ff00d2fc0 2023-07-14T12:54:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.441+0000 7f4fee7fc640 1 -- 172.21.15.5:0/3180387492 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd80ab7e0 con 0x7f4ff00d2fc0 2023-07-14T12:54:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.441+0000 7f4fee7fc640 1 -- 172.21.15.5:0/3180387492 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd80abb70 con 0x7f4ff00d2fc0 2023-07-14T12:54:07.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.441+0000 7f4ff57c5640 1 -- 172.21.15.5:0/3180387492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ff00d2fc0 msgr2=0x7f4ff00b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:07.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.441+0000 7f4ff57c5640 1 --2- 172.21.15.5:0/3180387492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ff00d2fc0 0x7f4ff00b0950 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4fd80097c0 tx=0x7f4fd801c480 comp rx=0 tx=0).stop 2023-07-14T12:54:07.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.441+0000 7f4ff57c5640 1 -- 172.21.15.5:0/3180387492 shutdown_connections 2023-07-14T12:54:07.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.441+0000 7f4ff57c5640 1 --2- 172.21.15.5:0/3180387492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ff00d2fc0 0x7f4ff00b0950 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:07.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.441+0000 7f4ff57c5640 1 -- 172.21.15.5:0/3180387492 >> 172.21.15.5:0/3180387492 conn(0x7f4ff00659d0 msgr2=0x7f4ff009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:07.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.441+0000 7f4ff57c5640 1 -- 172.21.15.5:0/3180387492 shutdown_connections 2023-07-14T12:54:07.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.441+0000 7f4ff57c5640 1 -- 172.21.15.5:0/3180387492 wait complete. 2023-07-14T12:54:07.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.445+0000 7f4ff57c5640 1 Processor -- start 2023-07-14T12:54:07.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.445+0000 7f4ff57c5640 1 -- start start 2023-07-14T12:54:07.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.445+0000 7f4ff57c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ff00d2300 0x7f4ff00b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:07.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.445+0000 7f4ff57c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ff00d2fc0 0x7f4ff01520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:07.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.445+0000 7f4ff57c5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ff015bde0 0x7f4ff0152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:07.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.445+0000 7f4ff57c5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff014afb0 con 0x7f4ff00d2300 2023-07-14T12:54:07.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.445+0000 7f4ff57c5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff014bb30 con 0x7f4ff00d2fc0 2023-07-14T12:54:07.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.445+0000 7f4ff57c5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff014b200 con 0x7f4ff015bde0 2023-07-14T12:54:07.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.445+0000 7f4feeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ff00d2300 0x7f4ff00b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:07.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.445+0000 7f4feeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ff00d2300 0x7f4ff00b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32958/0 (socket says 172.21.15.5:32958) 2023-07-14T12:54:07.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.445+0000 7f4feeffd640 1 -- 172.21.15.5:0/185763822 learned_addr learned my addr 172.21.15.5:0/185763822 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:07.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.445+0000 7f4fef7fe640 1 --2- 172.21.15.5:0/185763822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ff015bde0 0x7f4ff0152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:07.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.445+0000 7f4fe7fff640 1 --2- 172.21.15.5:0/185763822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ff00d2fc0 0x7f4ff01520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:07.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.445+0000 7f4feeffd640 1 -- 172.21.15.5:0/185763822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ff015bde0 msgr2=0x7f4ff0152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:07.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.445+0000 7f4feeffd640 1 --2- 172.21.15.5:0/185763822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ff015bde0 0x7f4ff0152630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:07.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.445+0000 7f4feeffd640 1 -- 172.21.15.5:0/185763822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ff00d2fc0 msgr2=0x7f4ff01520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:07.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.445+0000 7f4feeffd640 1 --2- 172.21.15.5:0/185763822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ff00d2fc0 0x7f4ff01520f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:07.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.445+0000 7f4feeffd640 1 -- 172.21.15.5:0/185763822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd8009420 con 0x7f4ff00d2300 2023-07-14T12:54:07.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.445+0000 7f4feeffd640 1 --2- 172.21.15.5:0/185763822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ff00d2300 0x7f4ff00b1200 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4fe000c4d0 tx=0x7f4fe000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:07.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.445+0000 7f4fe77fe640 1 -- 172.21.15.5:0/185763822 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe00052d0 con 0x7f4ff00d2300 2023-07-14T12:54:07.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.445+0000 7f4fe77fe640 1 -- 172.21.15.5:0/185763822 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe0005430 con 0x7f4ff00d2300 2023-07-14T12:54:07.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.445+0000 7f4fe77fe640 1 -- 172.21.15.5:0/185763822 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0003850 con 0x7f4ff00d2300 2023-07-14T12:54:07.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.445+0000 7f4ff57c5640 1 -- 172.21.15.5:0/185763822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff014b4e0 con 0x7f4ff00d2300 2023-07-14T12:54:07.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.449+0000 7f4ff57c5640 1 -- 172.21.15.5:0/185763822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff00b1740 con 0x7f4ff00d2300 2023-07-14T12:54:07.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.449+0000 7f4ff57c5640 1 -- 172.21.15.5:0/185763822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff00678d0 con 0x7f4ff00d2300 2023-07-14T12:54:07.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.449+0000 7f4fe77fe640 1 -- 172.21.15.5:0/185763822 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f4fe00039b0 con 0x7f4ff00d2300 2023-07-14T12:54:07.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.449+0000 7f4fe77fe640 1 --2- 172.21.15.5:0/185763822 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4fd0066480 0x7f4fd0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:07.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.449+0000 7f4fe77fe640 1 -- 172.21.15.5:0/185763822 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f4fe0083dc0 con 0x7f4ff00d2300 2023-07-14T12:54:07.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.449+0000 7f4fe7fff640 1 --2- 172.21.15.5:0/185763822 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4fd0066480 0x7f4fd0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:07.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.453+0000 7f4fe7fff640 1 --2- 172.21.15.5:0/185763822 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4fd0066480 0x7f4fd0068930 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4fd80af000 tx=0x7f4fd80a7000 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:07.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.453+0000 7f4fe77fe640 1 -- 172.21.15.5:0/185763822 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4fe0050ed0 con 0x7f4ff00d2300 2023-07-14T12:54:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.629+0000 7f4ff57c5640 1 -- 172.21.15.5:0/185763822 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ff00b0e90 con 0x7f4fd0066480 2023-07-14T12:54:07.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.681+0000 7f4fe77fe640 1 -- 172.21.15.5:0/185763822 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f4fd80ab600 con 0x7f4fd0066480 2023-07-14T12:54:07.711 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule activated for path /snap_test_dir1/dir4 2023-07-14T12:54:07.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.685+0000 7f4ff57c5640 1 -- 172.21.15.5:0/185763822 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4fd0066480 msgr2=0x7f4fd0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:07.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.685+0000 7f4ff57c5640 1 --2- 172.21.15.5:0/185763822 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4fd0066480 0x7f4fd0068930 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4fd80af000 tx=0x7f4fd80a7000 comp rx=0 tx=0).stop 2023-07-14T12:54:07.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.685+0000 7f4ff57c5640 1 -- 172.21.15.5:0/185763822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ff00d2300 msgr2=0x7f4ff00b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:07.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.685+0000 7f4ff57c5640 1 --2- 172.21.15.5:0/185763822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ff00d2300 0x7f4ff00b1200 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4fe000c4d0 tx=0x7f4fe000c990 comp rx=0 tx=0).stop 2023-07-14T12:54:07.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.685+0000 7f4ff57c5640 1 -- 172.21.15.5:0/185763822 shutdown_connections 2023-07-14T12:54:07.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.685+0000 7f4ff57c5640 1 --2- 172.21.15.5:0/185763822 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4fd0066480 0x7f4fd0068930 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:07.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.685+0000 7f4ff57c5640 1 --2- 172.21.15.5:0/185763822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ff015bde0 0x7f4ff0152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:07.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.685+0000 7f4ff57c5640 1 --2- 172.21.15.5:0/185763822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ff00d2fc0 0x7f4ff01520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:07.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.685+0000 7f4ff57c5640 1 --2- 172.21.15.5:0/185763822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ff00d2300 0x7f4ff00b1200 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:07.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.685+0000 7f4ff57c5640 1 -- 172.21.15.5:0/185763822 >> 172.21.15.5:0/185763822 conn(0x7f4ff00659d0 msgr2=0x7f4ff00af190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:07.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.685+0000 7f4ff57c5640 1 -- 172.21.15.5:0/185763822 shutdown_connections 2023-07-14T12:54:07.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.685+0000 7f4ff57c5640 1 -- 172.21.15.5:0/185763822 wait complete. 2023-07-14T12:54:07.733 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir4 2023-07-14T12:54:07.734 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir5 1M 2023-07-14T12:54:07.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.853+0000 7fa713dd2640 1 Processor -- start 2023-07-14T12:54:07.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.853+0000 7fa713dd2640 1 -- start start 2023-07-14T12:54:07.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.857+0000 7fa713dd2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa70c15cef0 0x7fa70c158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:07.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.857+0000 7fa713dd2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa70c1532b0 con 0x7fa70c159270 2023-07-14T12:54:07.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.857+0000 7fa713dd2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa70c0ca6f0 con 0x7fa70c0aeb40 2023-07-14T12:54:07.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.857+0000 7fa713dd2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c15d360 con 0x7fa70c15cef0 2023-07-14T12:54:07.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.857+0000 7fa71236f640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa70c159270 0x7fa70c0c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52176/0 (socket says 172.21.15.5:52176) 2023-07-14T12:54:07.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.857+0000 7fa71236f640 1 -- 172.21.15.5:0/170556328 learned_addr learned my addr 172.21.15.5:0/170556328 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:54:07.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.857+0000 7fa71136d640 1 --2- 172.21.15.5:0/170556328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa70c15cef0 0x7fa70c158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:07.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.857+0000 7fa710b6c640 1 -- 172.21.15.5:0/170556328 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 519988416 0 0) 0x7fa70c1532b0 con 0x7fa70c159270 2023-07-14T12:54:07.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.857+0000 7fa710b6c640 1 -- 172.21.15.5:0/170556328 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6f8003530 con 0x7fa70c159270 2023-07-14T12:54:07.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.857+0000 7fa710b6c640 1 -- 172.21.15.5:0/170556328 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1230653437 0 0) 0x7fa70c0ca6f0 con 0x7fa70c0aeb40 2023-07-14T12:54:07.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.857+0000 7fa710b6c640 1 -- 172.21.15.5:0/170556328 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa70c1532b0 con 0x7fa70c0aeb40 2023-07-14T12:54:07.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.857+0000 7fa71136d640 1 -- 172.21.15.5:0/170556328 >> v1:172.21.15.154:6789/0 conn(0x7fa70c0aeb40 legacy=0x7fa70c0aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:07.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.857+0000 7fa71136d640 1 -- 172.21.15.5:0/170556328 >> v1:172.21.15.5:6789/0 conn(0x7fa70c159270 legacy=0x7fa70c0c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:07.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.857+0000 7fa71136d640 1 -- 172.21.15.5:0/170556328 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70c1599d0 con 0x7fa70c15cef0 2023-07-14T12:54:07.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.861+0000 7fa71136d640 1 --2- 172.21.15.5:0/170556328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa70c15cef0 0x7fa70c158d30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0097f0 tx=0x7fa6fc01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f356beb83aaf5693 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:07.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.861+0000 7fa710b6c640 1 -- 172.21.15.5:0/170556328 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc0aa5f0 con 0x7fa70c15cef0 2023-07-14T12:54:07.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.861+0000 7fa710b6c640 1 -- 172.21.15.5:0/170556328 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6fc0aa750 con 0x7fa70c15cef0 2023-07-14T12:54:07.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.861+0000 7fa710b6c640 1 -- 172.21.15.5:0/170556328 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc0aaac0 con 0x7fa70c15cef0 2023-07-14T12:54:07.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.861+0000 7fa713dd2640 1 -- 172.21.15.5:0/170556328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa70c15cef0 msgr2=0x7fa70c158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:07.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.861+0000 7fa713dd2640 1 --2- 172.21.15.5:0/170556328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa70c15cef0 0x7fa70c158d30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0097f0 tx=0x7fa6fc01c490 comp rx=0 tx=0).stop 2023-07-14T12:54:07.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.861+0000 7fa713dd2640 1 -- 172.21.15.5:0/170556328 shutdown_connections 2023-07-14T12:54:07.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.861+0000 7fa713dd2640 1 --2- 172.21.15.5:0/170556328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa70c15cef0 0x7fa70c158d30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:07.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.861+0000 7fa713dd2640 1 -- 172.21.15.5:0/170556328 >> 172.21.15.5:0/170556328 conn(0x7fa70c0cde90 msgr2=0x7fa70c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:07.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.861+0000 7fa713dd2640 1 -- 172.21.15.5:0/170556328 shutdown_connections 2023-07-14T12:54:07.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.861+0000 7fa713dd2640 1 -- 172.21.15.5:0/170556328 wait complete. 2023-07-14T12:54:07.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.861+0000 7fa713dd2640 1 Processor -- start 2023-07-14T12:54:07.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.865+0000 7fa713dd2640 1 -- start start 2023-07-14T12:54:07.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.865+0000 7fa713dd2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa70c0aeb40 0x7fa70c14fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:07.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.865+0000 7fa713dd2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa70c159270 0x7fa70c156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:07.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.865+0000 7fa713dd2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa70c15cef0 0x7fa70c06c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:07.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.865+0000 7fa713dd2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c150350 con 0x7fa70c15cef0 2023-07-14T12:54:07.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.865+0000 7fa713dd2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c1579e0 con 0x7fa70c0aeb40 2023-07-14T12:54:07.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.865+0000 7fa713dd2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c157cc0 con 0x7fa70c159270 2023-07-14T12:54:07.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.865+0000 7fa71236f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa70c15cef0 0x7fa70c06c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:07.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.865+0000 7fa71236f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa70c15cef0 0x7fa70c06c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32964/0 (socket says 172.21.15.5:32964) 2023-07-14T12:54:07.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.865+0000 7fa71236f640 1 -- 172.21.15.5:0/4180436414 learned_addr learned my addr 172.21.15.5:0/4180436414 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:07.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.865+0000 7fa71136d640 1 --2- 172.21.15.5:0/4180436414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa70c159270 0x7fa70c156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:07.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.865+0000 7fa711b6e640 1 --2- 172.21.15.5:0/4180436414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa70c0aeb40 0x7fa70c14fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:07.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.865+0000 7fa71236f640 1 -- 172.21.15.5:0/4180436414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa70c159270 msgr2=0x7fa70c156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:07.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.865+0000 7fa71236f640 1 --2- 172.21.15.5:0/4180436414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa70c159270 0x7fa70c156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:07.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.865+0000 7fa71236f640 1 -- 172.21.15.5:0/4180436414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa70c0aeb40 msgr2=0x7fa70c14fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:07.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.865+0000 7fa71236f640 1 --2- 172.21.15.5:0/4180436414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa70c0aeb40 0x7fa70c14fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:07.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.865+0000 7fa71236f640 1 -- 172.21.15.5:0/4180436414 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6fc009420 con 0x7fa70c15cef0 2023-07-14T12:54:07.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.865+0000 7fa71236f640 1 --2- 172.21.15.5:0/4180436414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa70c15cef0 0x7fa70c06c060 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa70400cba0 tx=0x7fa70400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:07.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.865+0000 7fa7027fc640 1 -- 172.21.15.5:0/4180436414 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70400ace0 con 0x7fa70c15cef0 2023-07-14T12:54:07.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.865+0000 7fa7027fc640 1 -- 172.21.15.5:0/4180436414 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70400ae40 con 0x7fa70c15cef0 2023-07-14T12:54:07.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.865+0000 7fa7027fc640 1 -- 172.21.15.5:0/4180436414 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa704012620 con 0x7fa70c15cef0 2023-07-14T12:54:07.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.865+0000 7fa713dd2640 1 -- 172.21.15.5:0/4180436414 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa70c157fa0 con 0x7fa70c15cef0 2023-07-14T12:54:07.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.865+0000 7fa713dd2640 1 -- 172.21.15.5:0/4180436414 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70c1507b0 con 0x7fa70c15cef0 2023-07-14T12:54:07.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.865+0000 7fa713dd2640 1 -- 172.21.15.5:0/4180436414 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa70c1587a0 con 0x7fa70c15cef0 2023-07-14T12:54:07.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.869+0000 7fa7027fc640 1 -- 172.21.15.5:0/4180436414 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fa704007070 con 0x7fa70c15cef0 2023-07-14T12:54:07.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.869+0000 7fa7027fc640 1 --2- 172.21.15.5:0/4180436414 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fa6f0066480 0x7fa6f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:07.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.869+0000 7fa7027fc640 1 -- 172.21.15.5:0/4180436414 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fa704084140 con 0x7fa70c15cef0 2023-07-14T12:54:07.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.869+0000 7fa711b6e640 1 --2- 172.21.15.5:0/4180436414 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fa6f0066480 0x7fa6f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:07.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.869+0000 7fa711b6e640 1 --2- 172.21.15.5:0/4180436414 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fa6f0066480 0x7fa6f0068930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa7080017c0 tx=0x7fa708009040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:07.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:07.873+0000 7fa7027fc640 1 -- 172.21.15.5:0/4180436414 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa704051320 con 0x7fa70c15cef0 2023-07-14T12:54:08.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.049+0000 7fa713dd2640 1 -- 172.21.15.5:0/4180436414 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa70c15c9d0 con 0x7fa6f0066480 2023-07-14T12:54:08.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.101+0000 7fa7027fc640 1 -- 172.21.15.5:0/4180436414 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fa708001460 con 0x7fa6f0066480 2023-07-14T12:54:08.128 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule activated for path /snap_test_dir1/dir5 2023-07-14T12:54:08.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.101+0000 7fa713dd2640 1 -- 172.21.15.5:0/4180436414 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fa6f0066480 msgr2=0x7fa6f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:08.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.101+0000 7fa713dd2640 1 --2- 172.21.15.5:0/4180436414 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fa6f0066480 0x7fa6f0068930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa7080017c0 tx=0x7fa708009040 comp rx=0 tx=0).stop 2023-07-14T12:54:08.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.101+0000 7fa713dd2640 1 -- 172.21.15.5:0/4180436414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa70c15cef0 msgr2=0x7fa70c06c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:08.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.101+0000 7fa713dd2640 1 --2- 172.21.15.5:0/4180436414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa70c15cef0 0x7fa70c06c060 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa70400cba0 tx=0x7fa70400a430 comp rx=0 tx=0).stop 2023-07-14T12:54:08.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.101+0000 7fa713dd2640 1 -- 172.21.15.5:0/4180436414 shutdown_connections 2023-07-14T12:54:08.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.101+0000 7fa713dd2640 1 --2- 172.21.15.5:0/4180436414 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fa6f0066480 0x7fa6f0068930 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:08.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.101+0000 7fa713dd2640 1 --2- 172.21.15.5:0/4180436414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa70c15cef0 0x7fa70c06c060 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:08.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.101+0000 7fa713dd2640 1 --2- 172.21.15.5:0/4180436414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa70c159270 0x7fa70c156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:08.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.101+0000 7fa713dd2640 1 --2- 172.21.15.5:0/4180436414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa70c0aeb40 0x7fa70c14fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:08.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.101+0000 7fa713dd2640 1 -- 172.21.15.5:0/4180436414 >> 172.21.15.5:0/4180436414 conn(0x7fa70c0cde90 msgr2=0x7fa70c1524d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:08.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.101+0000 7fa713dd2640 1 -- 172.21.15.5:0/4180436414 shutdown_connections 2023-07-14T12:54:08.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.101+0000 7fa713dd2640 1 -- 172.21.15.5:0/4180436414 wait complete. 2023-07-14T12:54:08.148 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir5 2023-07-14T12:54:08.149 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir6 1M 2023-07-14T12:54:08.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.269+0000 7f7eab782640 1 Processor -- start 2023-07-14T12:54:08.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.269+0000 7f7eab782640 1 -- start start 2023-07-14T12:54:08.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.269+0000 7f7eab782640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7ea40aeb40 0x7f7ea415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:08.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.269+0000 7f7eab782640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea41532b0 con 0x7f7ea40aef10 2023-07-14T12:54:08.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.269+0000 7f7eab782640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea40ca6f0 con 0x7f7ea4159440 2023-07-14T12:54:08.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.269+0000 7f7eab782640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ea41599d0 con 0x7f7ea40aeb40 2023-07-14T12:54:08.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.269+0000 7f7ea8d1d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7ea40aef10 0x7f7ea4158d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52186/0 (socket says 172.21.15.5:52186) 2023-07-14T12:54:08.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.269+0000 7f7ea8d1d640 1 -- 172.21.15.5:0/4148374278 learned_addr learned my addr 172.21.15.5:0/4148374278 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:54:08.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.273+0000 7f7ea951e640 1 --2- 172.21.15.5:0/4148374278 >> v2:172.21.15.154:3300/0 conn(0x7f7ea40aeb40 0x7f7ea415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:08.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.273+0000 7f7e9bfff640 1 -- 172.21.15.5:0/4148374278 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927330748 0 0) 0x7f7ea41532b0 con 0x7f7ea40aef10 2023-07-14T12:54:08.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.273+0000 7f7e9bfff640 1 -- 172.21.15.5:0/4148374278 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e90005740 con 0x7f7ea40aef10 2023-07-14T12:54:08.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.273+0000 7f7e9bfff640 1 -- 172.21.15.5:0/4148374278 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3650071433 0 0) 0x7f7e90005740 con 0x7f7ea40aef10 2023-07-14T12:54:08.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.273+0000 7f7e9bfff640 1 -- 172.21.15.5:0/4148374278 >> v2:172.21.15.154:3300/0 conn(0x7f7ea40aeb40 msgr2=0x7f7ea415cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:54:08.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.273+0000 7f7e9bfff640 1 --2- 172.21.15.5:0/4148374278 >> v2:172.21.15.154:3300/0 conn(0x7f7ea40aeb40 0x7f7ea415cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:08.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.273+0000 7f7e9bfff640 1 -- 172.21.15.5:0/4148374278 >> v1:172.21.15.154:6789/0 conn(0x7f7ea4159440 legacy=0x7f7ea40c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:08.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.273+0000 7f7e9bfff640 1 -- 172.21.15.5:0/4148374278 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea4159cb0 con 0x7f7ea40aef10 2023-07-14T12:54:08.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.273+0000 7f7e9bfff640 1 -- 172.21.15.5:0/4148374278 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f7e94001680 con 0x7f7ea40aef10 2023-07-14T12:54:08.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.273+0000 7f7e9bfff640 1 -- 172.21.15.5:0/4148374278 >> v1:172.21.15.5:6789/0 conn(0x7f7ea40aef10 legacy=0x7f7ea4158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:08.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.273+0000 7f7e9bfff640 1 --2- 172.21.15.5:0/4148374278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e90005b90 0x7f7e90005f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:08.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.273+0000 7f7e9bfff640 1 --2- 172.21.15.5:0/4148374278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e90006580 0x7f7e90006a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.273+0000 7f7e9bfff640 1 --2- 172.21.15.5:0/4148374278 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e900072e0 0x7f7e9000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.273+0000 7f7e9bfff640 1 -- 172.21.15.5:0/4148374278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea41599d0 con 0x7f7e90006580 2023-07-14T12:54:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.273+0000 7f7e9bfff640 1 -- 172.21.15.5:0/4148374278 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9000e210 con 0x7f7e90005b90 2023-07-14T12:54:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.273+0000 7f7e9bfff640 1 -- 172.21.15.5:0/4148374278 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9000e3d0 con 0x7f7e900072e0 2023-07-14T12:54:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.273+0000 7f7ea8d1d640 1 --2- 172.21.15.5:0/4148374278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e90006580 0x7f7e90006a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.273+0000 7f7ea9d1f640 1 --2- 172.21.15.5:0/4148374278 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e900072e0 0x7f7e9000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.273+0000 7f7ea951e640 1 --2- 172.21.15.5:0/4148374278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e90005b90 0x7f7e90005f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.273+0000 7f7ea8d1d640 1 -- 172.21.15.5:0/4148374278 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e900072e0 msgr2=0x7f7e9000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:54:08.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.273+0000 7f7ea8d1d640 1 --2- 172.21.15.5:0/4148374278 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e900072e0 0x7f7e9000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:08.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.273+0000 7f7ea8d1d640 1 -- 172.21.15.5:0/4148374278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e90005b90 msgr2=0x7f7e90005f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:54:08.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.273+0000 7f7ea8d1d640 1 --2- 172.21.15.5:0/4148374278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e90005b90 0x7f7e90005f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:08.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.273+0000 7f7ea8d1d640 1 -- 172.21.15.5:0/4148374278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e90005740 con 0x7f7e90006580 2023-07-14T12:54:08.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.273+0000 7f7ea9d1f640 1 -- 172.21.15.5:0/4148374278 reap_dead start 2023-07-14T12:54:08.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.277+0000 7f7ea8d1d640 1 --2- 172.21.15.5:0/4148374278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e90006580 0x7f7e90006a40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7e9400c210 tx=0x7f7e9401cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a50e420281e912b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:08.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.277+0000 7f7e9bfff640 1 -- 172.21.15.5:0/4148374278 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e940a5b00 con 0x7f7e90006580 2023-07-14T12:54:08.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.277+0000 7f7e9bfff640 1 -- 172.21.15.5:0/4148374278 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e940a5c80 con 0x7f7e90006580 2023-07-14T12:54:08.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.277+0000 7f7e9bfff640 1 -- 172.21.15.5:0/4148374278 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e94005b20 con 0x7f7e90006580 2023-07-14T12:54:08.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.277+0000 7f7eab782640 1 -- 172.21.15.5:0/4148374278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e90006580 msgr2=0x7f7e90006a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:08.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.277+0000 7f7eab782640 1 --2- 172.21.15.5:0/4148374278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e90006580 0x7f7e90006a40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7e9400c210 tx=0x7f7e9401cc00 comp rx=0 tx=0).stop 2023-07-14T12:54:08.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.277+0000 7f7eab782640 1 -- 172.21.15.5:0/4148374278 shutdown_connections 2023-07-14T12:54:08.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.277+0000 7f7eab782640 1 --2- 172.21.15.5:0/4148374278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e90006580 0x7f7e90006a40 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:08.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.277+0000 7f7eab782640 1 -- 172.21.15.5:0/4148374278 >> 172.21.15.5:0/4148374278 conn(0x7f7ea40cde90 msgr2=0x7f7ea40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:08.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.277+0000 7f7eab782640 1 -- 172.21.15.5:0/4148374278 shutdown_connections 2023-07-14T12:54:08.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.277+0000 7f7eab782640 1 -- 172.21.15.5:0/4148374278 wait complete. 2023-07-14T12:54:08.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.277+0000 7f7eab782640 1 Processor -- start 2023-07-14T12:54:08.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.277+0000 7f7eab782640 1 -- start start 2023-07-14T12:54:08.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.281+0000 7f7eab782640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e90006580 0x7f7ea41f4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:08.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.281+0000 7f7eab782640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ea41498d0 0x7f7ea406b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:08.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.281+0000 7f7eab782640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ea4149d40 0x7f7ea4157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:08.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.281+0000 7f7eab782640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea41f49d0 con 0x7f7ea4149d40 2023-07-14T12:54:08.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.281+0000 7f7eab782640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea41f43c0 con 0x7f7e90006580 2023-07-14T12:54:08.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.281+0000 7f7eab782640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea4070cb0 con 0x7f7ea41498d0 2023-07-14T12:54:08.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.281+0000 7f7ea9d1f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ea4149d40 0x7f7ea4157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:08.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.281+0000 7f7ea9d1f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ea4149d40 0x7f7ea4157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32996/0 (socket says 172.21.15.5:32996) 2023-07-14T12:54:08.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.281+0000 7f7ea9d1f640 1 -- 172.21.15.5:0/1293042415 learned_addr learned my addr 172.21.15.5:0/1293042415 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:08.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.281+0000 7f7ea951e640 1 --2- 172.21.15.5:0/1293042415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e90006580 0x7f7ea41f4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:08.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.281+0000 7f7ea8d1d640 1 --2- 172.21.15.5:0/1293042415 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ea41498d0 0x7f7ea406b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:08.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.281+0000 7f7ea9d1f640 1 -- 172.21.15.5:0/1293042415 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ea41498d0 msgr2=0x7f7ea406b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:08.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.281+0000 7f7ea9d1f640 1 --2- 172.21.15.5:0/1293042415 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ea41498d0 0x7f7ea406b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:08.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.281+0000 7f7ea9d1f640 1 -- 172.21.15.5:0/1293042415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e90006580 msgr2=0x7f7ea41f4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:08.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.281+0000 7f7ea9d1f640 1 --2- 172.21.15.5:0/1293042415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e90006580 0x7f7ea41f4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.281+0000 7f7ea9d1f640 1 -- 172.21.15.5:0/1293042415 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea4070f90 con 0x7f7ea4149d40 2023-07-14T12:54:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.281+0000 7f7ea9d1f640 1 --2- 172.21.15.5:0/1293042415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ea4149d40 0x7f7ea4157f10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7ea40cbf60 tx=0x7f7e9c011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.281+0000 7f7e99ffb640 1 -- 172.21.15.5:0/1293042415 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c006d70 con 0x7f7ea4149d40 2023-07-14T12:54:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.281+0000 7f7e99ffb640 1 -- 172.21.15.5:0/1293042415 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9c003980 con 0x7f7ea4149d40 2023-07-14T12:54:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.281+0000 7f7e99ffb640 1 -- 172.21.15.5:0/1293042415 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c003d30 con 0x7f7ea4149d40 2023-07-14T12:54:08.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.281+0000 7f7eab782640 1 -- 172.21.15.5:0/1293042415 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea41f4660 con 0x7f7ea4149d40 2023-07-14T12:54:08.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.281+0000 7f7eab782640 1 -- 172.21.15.5:0/1293042415 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea406b730 con 0x7f7ea4149d40 2023-07-14T12:54:08.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.281+0000 7f7eab782640 1 -- 172.21.15.5:0/1293042415 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea415c3f0 con 0x7f7ea4149d40 2023-07-14T12:54:08.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.281+0000 7f7e99ffb640 1 -- 172.21.15.5:0/1293042415 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f7e9c0050d0 con 0x7f7ea4149d40 2023-07-14T12:54:08.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.285+0000 7f7e99ffb640 1 --2- 172.21.15.5:0/1293042415 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f7e880664b0 0x7f7e88068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:08.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.285+0000 7f7e99ffb640 1 -- 172.21.15.5:0/1293042415 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f7e9c086000 con 0x7f7ea4149d40 2023-07-14T12:54:08.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.285+0000 7f7ea951e640 1 --2- 172.21.15.5:0/1293042415 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f7e880664b0 0x7f7e88068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:08.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.285+0000 7f7ea951e640 1 --2- 172.21.15.5:0/1293042415 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f7e880664b0 0x7f7e88068960 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7ea40684f0 tx=0x7f7ea0009190 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:08.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.289+0000 7f7e99ffb640 1 -- 172.21.15.5:0/1293042415 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7ea415c3f0 con 0x7f7ea4149d40 2023-07-14T12:54:08.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.469+0000 7f7eab782640 1 -- 172.21.15.5:0/1293042415 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ea415c6f0 con 0x7f7e880664b0 2023-07-14T12:54:08.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.525+0000 7f7e99ffb640 1 -- 172.21.15.5:0/1293042415 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f7ea0019070 con 0x7f7e880664b0 2023-07-14T12:54:08.553 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule activated for path /snap_test_dir1/dir6 2023-07-14T12:54:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.525+0000 7f7eab782640 1 -- 172.21.15.5:0/1293042415 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f7e880664b0 msgr2=0x7f7e88068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.525+0000 7f7eab782640 1 --2- 172.21.15.5:0/1293042415 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f7e880664b0 0x7f7e88068960 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7ea40684f0 tx=0x7f7ea0009190 comp rx=0 tx=0).stop 2023-07-14T12:54:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.525+0000 7f7eab782640 1 -- 172.21.15.5:0/1293042415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ea4149d40 msgr2=0x7f7ea4157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.525+0000 7f7eab782640 1 --2- 172.21.15.5:0/1293042415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ea4149d40 0x7f7ea4157f10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7ea40cbf60 tx=0x7f7e9c011b60 comp rx=0 tx=0).stop 2023-07-14T12:54:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.525+0000 7f7eab782640 1 -- 172.21.15.5:0/1293042415 shutdown_connections 2023-07-14T12:54:08.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.525+0000 7f7eab782640 1 --2- 172.21.15.5:0/1293042415 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f7e880664b0 0x7f7e88068960 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:08.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.525+0000 7f7eab782640 1 --2- 172.21.15.5:0/1293042415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ea4149d40 0x7f7ea4157f10 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:08.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.525+0000 7f7eab782640 1 --2- 172.21.15.5:0/1293042415 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ea41498d0 0x7f7ea406b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:08.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.525+0000 7f7eab782640 1 --2- 172.21.15.5:0/1293042415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e90006580 0x7f7ea41f4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:08.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.525+0000 7f7eab782640 1 -- 172.21.15.5:0/1293042415 >> 172.21.15.5:0/1293042415 conn(0x7f7ea40cde90 msgr2=0x7f7ea40c96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:08.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.525+0000 7f7eab782640 1 -- 172.21.15.5:0/1293042415 shutdown_connections 2023-07-14T12:54:08.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.525+0000 7f7eab782640 1 -- 172.21.15.5:0/1293042415 wait complete. 2023-07-14T12:54:08.574 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir6 2023-07-14T12:54:08.574 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir7 1M 2023-07-14T12:54:08.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.693+0000 7f717d3e9640 1 Processor -- start 2023-07-14T12:54:08.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.693+0000 7f717d3e9640 1 -- start start 2023-07-14T12:54:08.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.697+0000 7f717d3e9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f717806a540 0x7f717806a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:08.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.697+0000 7f717d3e9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71780cf710 0x7f71780cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:08.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.697+0000 7f717d3e9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71780cb7a0 con 0x7f71780cf2e0 2023-07-14T12:54:08.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.697+0000 7f717d3e9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71780d0920 con 0x7f717806a540 2023-07-14T12:54:08.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.697+0000 7f717d3e9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717815bfd0 con 0x7f71780cf710 2023-07-14T12:54:08.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.697+0000 7f7176ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f717806a540 0x7f717806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:08.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.697+0000 7f7176ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f717806a540 0x7f717806a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33010/0 (socket says 172.21.15.5:33010) 2023-07-14T12:54:08.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.697+0000 7f7176ffd640 1 -- 172.21.15.5:0/3940054428 learned_addr learned my addr 172.21.15.5:0/3940054428 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:08.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.697+0000 7f71777fe640 1 --2- 172.21.15.5:0/3940054428 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71780cf710 0x7f71780cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:08.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.697+0000 7f7176ffd640 1 -- 172.21.15.5:0/3940054428 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71780cf710 msgr2=0x7f71780cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:54:08.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.697+0000 7f7176ffd640 1 --2- 172.21.15.5:0/3940054428 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71780cf710 0x7f71780cd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:08.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.697+0000 7f7176ffd640 1 -- 172.21.15.5:0/3940054428 >> v1:172.21.15.5:6789/0 conn(0x7f71780cf2e0 legacy=0x7f71780cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:08.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.697+0000 7f7176ffd640 1 -- 172.21.15.5:0/3940054428 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717806ae50 con 0x7f717806a540 2023-07-14T12:54:08.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.697+0000 7f7176ffd640 1 --2- 172.21.15.5:0/3940054428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f717806a540 0x7f717806a910 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7168009870 tx=0x7f716801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586fab0834ce2b45 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:08.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.701+0000 7f71767fc640 1 -- 172.21.15.5:0/3940054428 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71680ab620 con 0x7f717806a540 2023-07-14T12:54:08.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.701+0000 7f71767fc640 1 -- 172.21.15.5:0/3940054428 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71680ab780 con 0x7f717806a540 2023-07-14T12:54:08.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.701+0000 7f71767fc640 1 -- 172.21.15.5:0/3940054428 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71680abb10 con 0x7f717806a540 2023-07-14T12:54:08.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.701+0000 7f717d3e9640 1 -- 172.21.15.5:0/3940054428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f717806a540 msgr2=0x7f717806a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:08.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.701+0000 7f717d3e9640 1 --2- 172.21.15.5:0/3940054428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f717806a540 0x7f717806a910 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7168009870 tx=0x7f716801c510 comp rx=0 tx=0).stop 2023-07-14T12:54:08.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.701+0000 7f717d3e9640 1 -- 172.21.15.5:0/3940054428 shutdown_connections 2023-07-14T12:54:08.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.701+0000 7f717d3e9640 1 --2- 172.21.15.5:0/3940054428 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71780cf710 0x7f71780cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:08.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.701+0000 7f717d3e9640 1 --2- 172.21.15.5:0/3940054428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f717806a540 0x7f717806a910 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:08.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.701+0000 7f717d3e9640 1 -- 172.21.15.5:0/3940054428 >> 172.21.15.5:0/3940054428 conn(0x7f7178099490 msgr2=0x7f7178089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:08.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.701+0000 7f717d3e9640 1 -- 172.21.15.5:0/3940054428 shutdown_connections 2023-07-14T12:54:08.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.701+0000 7f717d3e9640 1 -- 172.21.15.5:0/3940054428 wait complete. 2023-07-14T12:54:08.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.701+0000 7f717d3e9640 1 Processor -- start 2023-07-14T12:54:08.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.701+0000 7f717d3e9640 1 -- start start 2023-07-14T12:54:08.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.701+0000 7f717d3e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f717806a540 0x7f7178157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:08.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.701+0000 7f717d3e9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71780cf2e0 0x7f717814aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:08.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.701+0000 7f717d3e9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71780cf710 0x7f717815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:08.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.701+0000 7f717d3e9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717814af90 con 0x7f717806a540 2023-07-14T12:54:08.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.701+0000 7f717d3e9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71780b0060 con 0x7f71780cf710 2023-07-14T12:54:08.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.701+0000 7f717d3e9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71780b0bd0 con 0x7f71780cf2e0 2023-07-14T12:54:08.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.701+0000 7f7176ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f717806a540 0x7f7178157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:08.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.701+0000 7f7176ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f717806a540 0x7f7178157380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33012/0 (socket says 172.21.15.5:33012) 2023-07-14T12:54:08.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.701+0000 7f7176ffd640 1 -- 172.21.15.5:0/3148077347 learned_addr learned my addr 172.21.15.5:0/3148077347 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:08.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.705+0000 7f716ffff640 1 --2- 172.21.15.5:0/3148077347 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71780cf2e0 0x7f717814aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:08.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.705+0000 7f71777fe640 1 --2- 172.21.15.5:0/3148077347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71780cf710 0x7f717815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:08.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.705+0000 7f7176ffd640 1 -- 172.21.15.5:0/3148077347 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71780cf2e0 msgr2=0x7f717814aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:08.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.705+0000 7f7176ffd640 1 --2- 172.21.15.5:0/3148077347 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71780cf2e0 0x7f717814aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:08.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.705+0000 7f7176ffd640 1 -- 172.21.15.5:0/3148077347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71780cf710 msgr2=0x7f717815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:08.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.705+0000 7f7176ffd640 1 --2- 172.21.15.5:0/3148077347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71780cf710 0x7f717815a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:08.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.705+0000 7f7176ffd640 1 -- 172.21.15.5:0/3148077347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71680094d0 con 0x7f717806a540 2023-07-14T12:54:08.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.705+0000 7f7176ffd640 1 --2- 172.21.15.5:0/3148077347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f717806a540 0x7f7178157380 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f71680ad040 tx=0x7f716801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:08.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.705+0000 7f716f7fe640 1 -- 172.21.15.5:0/3148077347 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71680be3f0 con 0x7f717806a540 2023-07-14T12:54:08.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.705+0000 7f716f7fe640 1 -- 172.21.15.5:0/3148077347 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71680be570 con 0x7f717806a540 2023-07-14T12:54:08.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.705+0000 7f717d3e9640 1 -- 172.21.15.5:0/3148077347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717815a720 con 0x7f717806a540 2023-07-14T12:54:08.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.705+0000 7f716f7fe640 1 -- 172.21.15.5:0/3148077347 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71680be920 con 0x7f717806a540 2023-07-14T12:54:08.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.705+0000 7f717d3e9640 1 -- 172.21.15.5:0/3148077347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71780b0580 con 0x7f717806a540 2023-07-14T12:54:08.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.705+0000 7f717d3e9640 1 -- 172.21.15.5:0/3148077347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71780678d0 con 0x7f717806a540 2023-07-14T12:54:08.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.705+0000 7f716f7fe640 1 -- 172.21.15.5:0/3148077347 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f71680bea80 con 0x7f717806a540 2023-07-14T12:54:08.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.705+0000 7f716f7fe640 1 --2- 172.21.15.5:0/3148077347 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f7158066480 0x7f7158068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:08.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.705+0000 7f716f7fe640 1 -- 172.21.15.5:0/3148077347 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f716811e840 con 0x7f717806a540 2023-07-14T12:54:08.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.709+0000 7f716ffff640 1 --2- 172.21.15.5:0/3148077347 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f7158066480 0x7f7158068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:08.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.709+0000 7f716ffff640 1 --2- 172.21.15.5:0/3148077347 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f7158066480 0x7f7158068930 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f71780b61b0 tx=0x7f7160009040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:08.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.709+0000 7f716f7fe640 1 -- 172.21.15.5:0/3148077347 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f71680eb8e0 con 0x7f717806a540 2023-07-14T12:54:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.885+0000 7f717d3e9640 1 -- 172.21.15.5:0/3148077347 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f71780d05b0 con 0x7f7158066480 2023-07-14T12:54:08.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.945+0000 7f716f7fe640 1 -- 172.21.15.5:0/3148077347 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f71600050d0 con 0x7f7158066480 2023-07-14T12:54:08.973 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule activated for path /snap_test_dir1/dir7 2023-07-14T12:54:08.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.945+0000 7f717d3e9640 1 -- 172.21.15.5:0/3148077347 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f7158066480 msgr2=0x7f7158068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:08.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.945+0000 7f717d3e9640 1 --2- 172.21.15.5:0/3148077347 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f7158066480 0x7f7158068930 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f71780b61b0 tx=0x7f7160009040 comp rx=0 tx=0).stop 2023-07-14T12:54:08.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.945+0000 7f717d3e9640 1 -- 172.21.15.5:0/3148077347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f717806a540 msgr2=0x7f7178157380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:08.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.945+0000 7f717d3e9640 1 --2- 172.21.15.5:0/3148077347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f717806a540 0x7f7178157380 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f71680ad040 tx=0x7f716801ad50 comp rx=0 tx=0).stop 2023-07-14T12:54:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.945+0000 7f717d3e9640 1 -- 172.21.15.5:0/3148077347 shutdown_connections 2023-07-14T12:54:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.945+0000 7f717d3e9640 1 --2- 172.21.15.5:0/3148077347 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f7158066480 0x7f7158068930 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.945+0000 7f717d3e9640 1 --2- 172.21.15.5:0/3148077347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71780cf710 0x7f717815a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.945+0000 7f717d3e9640 1 --2- 172.21.15.5:0/3148077347 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71780cf2e0 0x7f717814aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.945+0000 7f717d3e9640 1 --2- 172.21.15.5:0/3148077347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f717806a540 0x7f7178157380 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.945+0000 7f717d3e9640 1 -- 172.21.15.5:0/3148077347 >> 172.21.15.5:0/3148077347 conn(0x7f7178099490 msgr2=0x7f7178089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.945+0000 7f717d3e9640 1 -- 172.21.15.5:0/3148077347 shutdown_connections 2023-07-14T12:54:08.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:08.945+0000 7f717d3e9640 1 -- 172.21.15.5:0/3148077347 wait complete. 2023-07-14T12:54:08.994 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir7 2023-07-14T12:54:08.995 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir8 1M 2023-07-14T12:54:09.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.117+0000 7f273546a640 1 Processor -- start 2023-07-14T12:54:09.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.117+0000 7f273546a640 1 -- start start 2023-07-14T12:54:09.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.117+0000 7f273546a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27300af2b0 0x7f273015a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:09.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.117+0000 7f273546a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2730159d70 con 0x7f2730069430 2023-07-14T12:54:09.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.117+0000 7f273546a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27300c9c60 con 0x7f2730070f30 2023-07-14T12:54:09.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.117+0000 7f273546a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27300c9f40 con 0x7f27300af2b0 2023-07-14T12:54:09.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.117+0000 7f272effd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2730069430 0x7f2730069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:38414/0 (socket says 172.21.15.5:38414) 2023-07-14T12:54:09.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.117+0000 7f272effd640 1 -- 172.21.15.5:0/615160768 learned_addr learned my addr 172.21.15.5:0/615160768 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T12:54:09.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.117+0000 7f272f7fe640 1 --2- 172.21.15.5:0/615160768 >> v2:172.21.15.5:3300/0 conn(0x7f27300af2b0 0x7f273015a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:09.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.117+0000 7f272f7fe640 1 -- 172.21.15.5:0/615160768 >> v1:172.21.15.154:6789/0 conn(0x7f2730070f30 legacy=0x7f27300ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:09.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.117+0000 7f272f7fe640 1 -- 172.21.15.5:0/615160768 >> v1:172.21.15.5:6789/0 conn(0x7f2730069430 legacy=0x7f2730069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:09.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.117+0000 7f272f7fe640 1 -- 172.21.15.5:0/615160768 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27300ca220 con 0x7f27300af2b0 2023-07-14T12:54:09.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.121+0000 7f272f7fe640 1 --2- 172.21.15.5:0/615160768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27300af2b0 0x7f273015a1f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2728009d90 tx=0x7f272801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7683d0b9b5eb4594 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:09.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.121+0000 7f272dffb640 1 -- 172.21.15.5:0/615160768 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27280a5920 con 0x7f27300af2b0 2023-07-14T12:54:09.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.121+0000 7f272dffb640 1 -- 172.21.15.5:0/615160768 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27280a5a80 con 0x7f27300af2b0 2023-07-14T12:54:09.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.121+0000 7f272dffb640 1 -- 172.21.15.5:0/615160768 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27280a5e10 con 0x7f27300af2b0 2023-07-14T12:54:09.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.121+0000 7f273546a640 1 -- 172.21.15.5:0/615160768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27300af2b0 msgr2=0x7f273015a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:09.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.121+0000 7f273546a640 1 --2- 172.21.15.5:0/615160768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27300af2b0 0x7f273015a1f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2728009d90 tx=0x7f272801c950 comp rx=0 tx=0).stop 2023-07-14T12:54:09.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.121+0000 7f273546a640 1 -- 172.21.15.5:0/615160768 shutdown_connections 2023-07-14T12:54:09.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.121+0000 7f273546a640 1 --2- 172.21.15.5:0/615160768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27300af2b0 0x7f273015a1f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:09.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.121+0000 7f273546a640 1 -- 172.21.15.5:0/615160768 >> 172.21.15.5:0/615160768 conn(0x7f27300cde90 msgr2=0x7f27300ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:09.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.121+0000 7f273546a640 1 -- 172.21.15.5:0/615160768 shutdown_connections 2023-07-14T12:54:09.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.121+0000 7f273546a640 1 -- 172.21.15.5:0/615160768 wait complete. 2023-07-14T12:54:09.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.125+0000 7f273546a640 1 Processor -- start 2023-07-14T12:54:09.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.125+0000 7f273546a640 1 -- start start 2023-07-14T12:54:09.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.125+0000 7f273546a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2730069430 0x7f27300c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:09.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.125+0000 7f273546a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2730070f30 0x7f27300b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:09.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.125+0000 7f273546a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27300af2b0 0x7f27300b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:09.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.125+0000 7f273546a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27300c51d0 con 0x7f2730069430 2023-07-14T12:54:09.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.125+0000 7f273546a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2730153800 con 0x7f27300af2b0 2023-07-14T12:54:09.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.125+0000 7f273546a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2730153ae0 con 0x7f2730070f30 2023-07-14T12:54:09.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.125+0000 7f272effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2730069430 0x7f27300c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:09.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.125+0000 7f272effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2730069430 0x7f27300c7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58800/0 (socket says 172.21.15.5:58800) 2023-07-14T12:54:09.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.125+0000 7f272effd640 1 -- 172.21.15.5:0/1038340337 learned_addr learned my addr 172.21.15.5:0/1038340337 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:09.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.125+0000 7f272f7fe640 1 --2- 172.21.15.5:0/1038340337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27300af2b0 0x7f27300b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:09.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.125+0000 7f272e7fc640 1 --2- 172.21.15.5:0/1038340337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2730070f30 0x7f27300b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:09.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.125+0000 7f272effd640 1 -- 172.21.15.5:0/1038340337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2730070f30 msgr2=0x7f27300b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:09.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.125+0000 7f272effd640 1 --2- 172.21.15.5:0/1038340337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2730070f30 0x7f27300b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:09.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.125+0000 7f272effd640 1 -- 172.21.15.5:0/1038340337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27300af2b0 msgr2=0x7f27300b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:09.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.125+0000 7f272effd640 1 --2- 172.21.15.5:0/1038340337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27300af2b0 0x7f27300b3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:09.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.125+0000 7f272effd640 1 -- 172.21.15.5:0/1038340337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2728009a70 con 0x7f2730069430 2023-07-14T12:54:09.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.125+0000 7f272effd640 1 --2- 172.21.15.5:0/1038340337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2730069430 0x7f27300c7d80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f272000c400 tx=0x7f272000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:09.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.125+0000 7f27177fe640 1 -- 172.21.15.5:0/1038340337 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2720005cf0 con 0x7f2730069430 2023-07-14T12:54:09.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.125+0000 7f27177fe640 1 -- 172.21.15.5:0/1038340337 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2720005e50 con 0x7f2730069430 2023-07-14T12:54:09.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.125+0000 7f273546a640 1 -- 172.21.15.5:0/1038340337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2730153dc0 con 0x7f2730069430 2023-07-14T12:54:09.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.125+0000 7f27177fe640 1 -- 172.21.15.5:0/1038340337 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27200072d0 con 0x7f2730069430 2023-07-14T12:54:09.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.125+0000 7f273546a640 1 -- 172.21.15.5:0/1038340337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2730154380 con 0x7f2730069430 2023-07-14T12:54:09.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.125+0000 7f273546a640 1 -- 172.21.15.5:0/1038340337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27300678d0 con 0x7f2730069430 2023-07-14T12:54:09.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.129+0000 7f27177fe640 1 -- 172.21.15.5:0/1038340337 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f2720007430 con 0x7f2730069430 2023-07-14T12:54:09.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.129+0000 7f27177fe640 1 --2- 172.21.15.5:0/1038340337 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f271c066480 0x7f271c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:09.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.129+0000 7f27177fe640 1 -- 172.21.15.5:0/1038340337 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f2720083520 con 0x7f2730069430 2023-07-14T12:54:09.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.129+0000 7f272e7fc640 1 --2- 172.21.15.5:0/1038340337 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f271c066480 0x7f271c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:09.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.129+0000 7f272e7fc640 1 --2- 172.21.15.5:0/1038340337 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f271c066480 0x7f271c068930 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f27300b3c50 tx=0x7f2724009040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:09.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.133+0000 7f27177fe640 1 -- 172.21.15.5:0/1038340337 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2720050650 con 0x7f2730069430 2023-07-14T12:54:09.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.309+0000 7f273546a640 1 -- 172.21.15.5:0/1038340337 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f273014eca0 con 0x7f271c066480 2023-07-14T12:54:09.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.361+0000 7f27177fe640 1 -- 172.21.15.5:0/1038340337 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f273014eca0 con 0x7f271c066480 2023-07-14T12:54:09.390 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule activated for path /snap_test_dir1/dir8 2023-07-14T12:54:09.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.365+0000 7f273546a640 1 -- 172.21.15.5:0/1038340337 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f271c066480 msgr2=0x7f271c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:09.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.365+0000 7f273546a640 1 --2- 172.21.15.5:0/1038340337 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f271c066480 0x7f271c068930 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f27300b3c50 tx=0x7f2724009040 comp rx=0 tx=0).stop 2023-07-14T12:54:09.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.365+0000 7f273546a640 1 -- 172.21.15.5:0/1038340337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2730069430 msgr2=0x7f27300c7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:09.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.365+0000 7f273546a640 1 --2- 172.21.15.5:0/1038340337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2730069430 0x7f27300c7d80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f272000c400 tx=0x7f272000c8c0 comp rx=0 tx=0).stop 2023-07-14T12:54:09.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.365+0000 7f273546a640 1 -- 172.21.15.5:0/1038340337 shutdown_connections 2023-07-14T12:54:09.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.365+0000 7f273546a640 1 --2- 172.21.15.5:0/1038340337 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f271c066480 0x7f271c068930 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:09.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.365+0000 7f273546a640 1 --2- 172.21.15.5:0/1038340337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27300af2b0 0x7f27300b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:09.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.365+0000 7f273546a640 1 --2- 172.21.15.5:0/1038340337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2730070f30 0x7f27300b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:09.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.365+0000 7f273546a640 1 --2- 172.21.15.5:0/1038340337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2730069430 0x7f27300c7d80 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:09.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.365+0000 7f273546a640 1 -- 172.21.15.5:0/1038340337 >> 172.21.15.5:0/1038340337 conn(0x7f27300cde90 msgr2=0x7f2730158db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:09.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.365+0000 7f273546a640 1 -- 172.21.15.5:0/1038340337 shutdown_connections 2023-07-14T12:54:09.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.365+0000 7f273546a640 1 -- 172.21.15.5:0/1038340337 wait complete. 2023-07-14T12:54:09.411 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir8 2023-07-14T12:54:09.411 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir9 1M 2023-07-14T12:54:09.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.533+0000 7f5ee7493640 1 Processor -- start 2023-07-14T12:54:09.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.533+0000 7f5ee7493640 1 -- start start 2023-07-14T12:54:09.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.533+0000 7f5ee7493640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ee00cdd10 0x7f5ee00ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:09.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.533+0000 7f5ee7493640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ee00b1770 0x7f5ee00d0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:09.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.533+0000 7f5ee7493640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee00d0ad0 con 0x7f5ee00d0650 2023-07-14T12:54:09.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.533+0000 7f5ee7493640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee00b0450 con 0x7f5ee00cdd10 2023-07-14T12:54:09.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.533+0000 7f5ee7493640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee00ce620 con 0x7f5ee00b1770 2023-07-14T12:54:09.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.533+0000 7f5ee522f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ee00cdd10 0x7f5ee00ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:09.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.533+0000 7f5ee522f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ee00cdd10 0x7f5ee00ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58810/0 (socket says 172.21.15.5:58810) 2023-07-14T12:54:09.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.533+0000 7f5ee522f640 1 -- 172.21.15.5:0/357050239 learned_addr learned my addr 172.21.15.5:0/357050239 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:09.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.533+0000 7f5ee4a2e640 1 --2- 172.21.15.5:0/357050239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ee00b1770 0x7f5ee00d0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:09.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.537+0000 7f5ee522f640 1 -- 172.21.15.5:0/357050239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ee00b1770 msgr2=0x7f5ee00d0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:54:09.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.537+0000 7f5ee522f640 1 --2- 172.21.15.5:0/357050239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ee00b1770 0x7f5ee00d0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:09.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.537+0000 7f5ee522f640 1 -- 172.21.15.5:0/357050239 >> v1:172.21.15.5:6789/0 conn(0x7f5ee00d0650 legacy=0x7f5ee00ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:09.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.537+0000 7f5ee522f640 1 -- 172.21.15.5:0/357050239 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee00b06d0 con 0x7f5ee00cdd10 2023-07-14T12:54:09.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.537+0000 7f5ee4a2e640 1 --2- 172.21.15.5:0/357050239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ee00b1770 0x7f5ee00d0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:54:09.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.537+0000 7f5ee522f640 1 --2- 172.21.15.5:0/357050239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee00cdd10 0x7f5ee00ce0e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009870 tx=0x7f5edc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1b15e05c09963f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:09.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.537+0000 7f5ed7fff640 1 -- 172.21.15.5:0/357050239 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc0a7070 con 0x7f5ee00cdd10 2023-07-14T12:54:09.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.537+0000 7f5ed7fff640 1 -- 172.21.15.5:0/357050239 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5edc0ab430 con 0x7f5ee00cdd10 2023-07-14T12:54:09.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.537+0000 7f5ed7fff640 1 -- 172.21.15.5:0/357050239 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc0ab7c0 con 0x7f5ee00cdd10 2023-07-14T12:54:09.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.537+0000 7f5ee7493640 1 -- 172.21.15.5:0/357050239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee00cdd10 msgr2=0x7f5ee00ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:09.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.537+0000 7f5ee7493640 1 --2- 172.21.15.5:0/357050239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee00cdd10 0x7f5ee00ce0e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009870 tx=0x7f5edc01c510 comp rx=0 tx=0).stop 2023-07-14T12:54:09.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.541+0000 7f5ee7493640 1 -- 172.21.15.5:0/357050239 shutdown_connections 2023-07-14T12:54:09.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.541+0000 7f5ee7493640 1 --2- 172.21.15.5:0/357050239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ee00b1770 0x7f5ee00d0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:09.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.541+0000 7f5ee7493640 1 --2- 172.21.15.5:0/357050239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee00cdd10 0x7f5ee00ce0e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:09.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.541+0000 7f5ee7493640 1 -- 172.21.15.5:0/357050239 >> 172.21.15.5:0/357050239 conn(0x7f5ee0099490 msgr2=0x7f5ee0089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:09.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.541+0000 7f5ee7493640 1 -- 172.21.15.5:0/357050239 shutdown_connections 2023-07-14T12:54:09.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.541+0000 7f5ee7493640 1 -- 172.21.15.5:0/357050239 wait complete. 2023-07-14T12:54:09.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.541+0000 7f5ee7493640 1 Processor -- start 2023-07-14T12:54:09.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.541+0000 7f5ee7493640 1 -- start start 2023-07-14T12:54:09.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.541+0000 7f5ee7493640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ee00b1770 0x7f5ee006b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:09.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.541+0000 7f5ee7493640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ee00cdd10 0x7f5ee0151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:09.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.541+0000 7f5ee7493640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee00d0650 0x7f5ee00cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:09.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.541+0000 7f5ee7493640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee006a540 con 0x7f5ee00d0650 2023-07-14T12:54:09.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.541+0000 7f5ee7493640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee014ef00 con 0x7f5ee00cdd10 2023-07-14T12:54:09.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.541+0000 7f5ee7493640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee00cc500 con 0x7f5ee00b1770 2023-07-14T12:54:09.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.541+0000 7f5ee5a30640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee00d0650 0x7f5ee00cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:09.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.541+0000 7f5ee5a30640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee00d0650 0x7f5ee00cbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58822/0 (socket says 172.21.15.5:58822) 2023-07-14T12:54:09.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.541+0000 7f5ee5a30640 1 -- 172.21.15.5:0/790699142 learned_addr learned my addr 172.21.15.5:0/790699142 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T12:54:09.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.541+0000 7f5ee522f640 1 --2- 172.21.15.5:0/790699142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ee00b1770 0x7f5ee006b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:09.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.541+0000 7f5ee5a30640 1 -- 172.21.15.5:0/790699142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ee00b1770 msgr2=0x7f5ee006b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:09.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.541+0000 7f5ee4a2e640 1 --2- 172.21.15.5:0/790699142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ee00cdd10 0x7f5ee0151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:09.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.541+0000 7f5ee5a30640 1 --2- 172.21.15.5:0/790699142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ee00b1770 0x7f5ee006b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:09.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.541+0000 7f5ee5a30640 1 -- 172.21.15.5:0/790699142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ee00cdd10 msgr2=0x7f5ee0151f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:09.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.541+0000 7f5ee5a30640 1 --2- 172.21.15.5:0/790699142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ee00cdd10 0x7f5ee0151f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:09.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.541+0000 7f5ee5a30640 1 -- 172.21.15.5:0/790699142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc0094d0 con 0x7f5ee00d0650 2023-07-14T12:54:09.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.541+0000 7f5ee522f640 1 --2- 172.21.15.5:0/790699142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ee00b1770 0x7f5ee006b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:54:09.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.541+0000 7f5ee4a2e640 1 --2- 172.21.15.5:0/790699142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ee00cdd10 0x7f5ee0151f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:54:09.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.541+0000 7f5ee5a30640 1 --2- 172.21.15.5:0/790699142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee00d0650 0x7f5ee00cbad0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800c770 tx=0x7f5ed800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:09.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.545+0000 7f5ed5ffb640 1 -- 172.21.15.5:0/790699142 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8003b80 con 0x7f5ee00d0650 2023-07-14T12:54:09.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.545+0000 7f5ed5ffb640 1 -- 172.21.15.5:0/790699142 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed8003ce0 con 0x7f5ee00d0650 2023-07-14T12:54:09.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.545+0000 7f5ed5ffb640 1 -- 172.21.15.5:0/790699142 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed800aa30 con 0x7f5ee00d0650 2023-07-14T12:54:09.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.545+0000 7f5ee7493640 1 -- 172.21.15.5:0/790699142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee006a750 con 0x7f5ee00d0650 2023-07-14T12:54:09.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.545+0000 7f5ee7493640 1 -- 172.21.15.5:0/790699142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee006ad10 con 0x7f5ee00d0650 2023-07-14T12:54:09.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.545+0000 7f5ee7493640 1 -- 172.21.15.5:0/790699142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee006af30 con 0x7f5ee00d0650 2023-07-14T12:54:09.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.545+0000 7f5ed5ffb640 1 -- 172.21.15.5:0/790699142 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f5ed800ab90 con 0x7f5ee00d0650 2023-07-14T12:54:09.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.545+0000 7f5ed5ffb640 1 --2- 172.21.15.5:0/790699142 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f5ec4066480 0x7f5ec4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:09.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.545+0000 7f5ed5ffb640 1 -- 172.21.15.5:0/790699142 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f5ed8083e20 con 0x7f5ee00d0650 2023-07-14T12:54:09.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.545+0000 7f5ee522f640 1 --2- 172.21.15.5:0/790699142 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f5ec4066480 0x7f5ec4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:09.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.549+0000 7f5ee522f640 1 --2- 172.21.15.5:0/790699142 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f5ec4066480 0x7f5ec4068930 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5edc0af000 tx=0x7f5edc008040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:09.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.549+0000 7f5ed5ffb640 1 -- 172.21.15.5:0/790699142 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f5ed8050f20 con 0x7f5ee00d0650 2023-07-14T12:54:09.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.721+0000 7f5ee7493640 1 -- 172.21.15.5:0/790699142 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ee00b1250 con 0x7f5ec4066480 2023-07-14T12:54:09.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.785+0000 7f5ed5ffb640 1 -- 172.21.15.5:0/790699142 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f5edc0ba0d0 con 0x7f5ec4066480 2023-07-14T12:54:09.815 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule activated for path /snap_test_dir1/dir9 2023-07-14T12:54:09.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.789+0000 7f5ee7493640 1 -- 172.21.15.5:0/790699142 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f5ec4066480 msgr2=0x7f5ec4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:09.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.789+0000 7f5ee7493640 1 --2- 172.21.15.5:0/790699142 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f5ec4066480 0x7f5ec4068930 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5edc0af000 tx=0x7f5edc008040 comp rx=0 tx=0).stop 2023-07-14T12:54:09.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.789+0000 7f5ee7493640 1 -- 172.21.15.5:0/790699142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee00d0650 msgr2=0x7f5ee00cbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:09.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.789+0000 7f5ee7493640 1 --2- 172.21.15.5:0/790699142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee00d0650 0x7f5ee00cbad0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800c770 tx=0x7f5ed800cc30 comp rx=0 tx=0).stop 2023-07-14T12:54:09.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.789+0000 7f5ee7493640 1 -- 172.21.15.5:0/790699142 shutdown_connections 2023-07-14T12:54:09.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.789+0000 7f5ee7493640 1 --2- 172.21.15.5:0/790699142 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f5ec4066480 0x7f5ec4068930 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:09.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.789+0000 7f5ee7493640 1 --2- 172.21.15.5:0/790699142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ee00d0650 0x7f5ee00cbad0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:09.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.789+0000 7f5ee7493640 1 --2- 172.21.15.5:0/790699142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ee00cdd10 0x7f5ee0151f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:09.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.789+0000 7f5ee7493640 1 --2- 172.21.15.5:0/790699142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ee00b1770 0x7f5ee006b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:09.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.789+0000 7f5ee7493640 1 -- 172.21.15.5:0/790699142 >> 172.21.15.5:0/790699142 conn(0x7f5ee0099490 msgr2=0x7f5ee00af120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:09.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.789+0000 7f5ee7493640 1 -- 172.21.15.5:0/790699142 shutdown_connections 2023-07-14T12:54:09.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T12:54:09.789+0000 7f5ee7493640 1 -- 172.21.15.5:0/790699142 wait complete. 2023-07-14T12:54:09.835 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir9 2023-07-14T12:54:15.603 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:54:15.607 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:54:45.675 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:54:45.679 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:55:00.142 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:55:00.111+0000 7f6d7f562640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:55:00.142 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:55:00.111+0000 7f6d7f562640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:55:00.143 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:55:00.111+0000 7f6d7f562640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:55:00.143 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:55:00.111+0000 7f6d7f562640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:55:00.143 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:55:00.111+0000 7f6d7f562640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:55:15.740 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:55:15.747 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:55:45.804 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:55:45.808 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:56:15.861 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:56:15.868 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:56:45.925 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:56:45.930 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:57:15.985 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:57:15.990 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:57:46.049 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:57:46.053 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:58:00.257 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:58:00.228+0000 7f6d88d75640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:58:00.258 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:58:00.228+0000 7f6d88d75640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:58:00.258 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:58:00.228+0000 7f6d88d75640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:58:00.258 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:58:00.228+0000 7f6d88d75640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:58:00.259 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T12:58:00.228+0000 7f6d88d75640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:58:16.113 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:58:16.118 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:58:46.194 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:58:46.199 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:59:16.249 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:59:16.254 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:59:46.319 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T12:59:46.323 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:00:00.215 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:00:00.186+0000 7f6d7dd5f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:00:00.216 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:00:00.186+0000 7f6d7dd5f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:00:00.216 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:00:00.186+0000 7f6d7dd5f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:00:00.216 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:00:00.186+0000 7f6d7dd5f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:00:00.216 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:00:00.186+0000 7f6d7dd5f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:00:16.378 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:00:16.382 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:00:46.442 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:00:46.447 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:01:16.501 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:01:16.505 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:01:46.572 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:01:46.577 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:02:00.578 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:02:00.548+0000 7f6d81566640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:02:00.578 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:02:00.548+0000 7f6d81566640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:02:00.578 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:02:00.548+0000 7f6d81566640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:02:00.578 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:02:00.548+0000 7f6d81566640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:02:00.578 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:02:00.548+0000 7f6d81566640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:02:16.629 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:02:16.633 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:02:46.692 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:02:46.696 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:03:16.755 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:03:16.760 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:03:46.821 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:03:46.826 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:04:16.900 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:04:16.904 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:04:46.991 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:04:46.996 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:05:17.060 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:05:17.064 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:05:19.837 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir0 1M 2023-07-14T13:05:19.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.967+0000 7f17cec34640 1 Processor -- start 2023-07-14T13:05:19.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.967+0000 7f17cec34640 1 -- start start 2023-07-14T13:05:19.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17cec34640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f17c815b9c0 0x7f17c80c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:20.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17cec34640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c80c37e0 con 0x7f17c80cba60 2023-07-14T13:05:20.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17cec34640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c80c3ac0 con 0x7f17c81590a0 2023-07-14T13:05:20.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17cec34640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c80c3da0 con 0x7f17c815b9c0 2023-07-14T13:05:20.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17cc9d0640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f17c80cba60 0x7f17c80cbe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49364/0 (socket says 172.21.15.5:49364) 2023-07-14T13:05:20.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17cc9d0640 1 -- 172.21.15.5:0/1535788603 learned_addr learned my addr 172.21.15.5:0/1535788603 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:20.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17cd1d1640 1 --2- 172.21.15.5:0/1535788603 >> v2:172.21.15.154:3300/0 conn(0x7f17c815b9c0 0x7f17c80c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:20.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17c77fe640 1 -- 172.21.15.5:0/1535788603 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1444941805 0 0) 0x7f17c80c37e0 con 0x7f17c80cba60 2023-07-14T13:05:20.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17c77fe640 1 -- 172.21.15.5:0/1535788603 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17b8003530 con 0x7f17c80cba60 2023-07-14T13:05:20.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17c77fe640 1 -- 172.21.15.5:0/1535788603 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1535392263 0 0) 0x7f17b8003530 con 0x7f17c80cba60 2023-07-14T13:05:20.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17c77fe640 1 -- 172.21.15.5:0/1535788603 >> v2:172.21.15.154:3300/0 conn(0x7f17c815b9c0 msgr2=0x7f17c80c3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:20.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17c77fe640 1 --2- 172.21.15.5:0/1535788603 >> v2:172.21.15.154:3300/0 conn(0x7f17c815b9c0 0x7f17c80c3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:20.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17c77fe640 1 -- 172.21.15.5:0/1535788603 >> v1:172.21.15.154:6789/0 conn(0x7f17c81590a0 legacy=0x7f17c8159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:20.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17c77fe640 1 -- 172.21.15.5:0/1535788603 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c80c4080 con 0x7f17c80cba60 2023-07-14T13:05:20.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17c77fe640 1 -- 172.21.15.5:0/1535788603 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f17bc001680 con 0x7f17c80cba60 2023-07-14T13:05:20.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17c77fe640 1 -- 172.21.15.5:0/1535788603 >> v1:172.21.15.5:6789/0 conn(0x7f17c80cba60 legacy=0x7f17c80cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:20.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17c77fe640 1 --2- 172.21.15.5:0/1535788603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17b8003980 0x7f17b8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:20.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17c77fe640 1 --2- 172.21.15.5:0/1535788603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17b80047d0 0x7f17b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:20.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17c77fe640 1 --2- 172.21.15.5:0/1535788603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17b8005180 0x7f17b800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:20.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17c77fe640 1 -- 172.21.15.5:0/1535788603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c80c3da0 con 0x7f17b80047d0 2023-07-14T13:05:20.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17c77fe640 1 -- 172.21.15.5:0/1535788603 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b800e2a0 con 0x7f17b8003980 2023-07-14T13:05:20.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17c77fe640 1 -- 172.21.15.5:0/1535788603 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b800e460 con 0x7f17b8005180 2023-07-14T13:05:20.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17c7fff640 1 --2- 172.21.15.5:0/1535788603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17b80047d0 0x7f17b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:20.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17cc9d0640 1 --2- 172.21.15.5:0/1535788603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17b8003980 0x7f17b8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:20.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17cd1d1640 1 --2- 172.21.15.5:0/1535788603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17b8005180 0x7f17b800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:20.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17c7fff640 1 -- 172.21.15.5:0/1535788603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17b8005180 msgr2=0x7f17b800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:20.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17c7fff640 1 --2- 172.21.15.5:0/1535788603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17b8005180 0x7f17b800dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:20.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17c7fff640 1 -- 172.21.15.5:0/1535788603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17b8003980 msgr2=0x7f17b8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:20.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17c7fff640 1 --2- 172.21.15.5:0/1535788603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17b8003980 0x7f17b8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:20.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17c7fff640 1 -- 172.21.15.5:0/1535788603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b8003530 con 0x7f17b80047d0 2023-07-14T13:05:20.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.971+0000 7f17cd1d1640 1 -- 172.21.15.5:0/1535788603 reap_dead start 2023-07-14T13:05:20.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.975+0000 7f17c7fff640 1 --2- 172.21.15.5:0/1535788603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17b80047d0 0x7f17b8004c40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f17b4001780 tx=0x7f17b401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1161ea6221410c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:20.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.975+0000 7f17c77fe640 1 -- 172.21.15.5:0/1535788603 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b40a4ea0 con 0x7f17b80047d0 2023-07-14T13:05:20.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.975+0000 7f17c77fe640 1 -- 172.21.15.5:0/1535788603 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b40a7050 con 0x7f17b80047d0 2023-07-14T13:05:20.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.975+0000 7f17c77fe640 1 -- 172.21.15.5:0/1535788603 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b4003600 con 0x7f17b80047d0 2023-07-14T13:05:20.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.975+0000 7f17cec34640 1 -- 172.21.15.5:0/1535788603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17b80047d0 msgr2=0x7f17b8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:20.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.975+0000 7f17cec34640 1 --2- 172.21.15.5:0/1535788603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17b80047d0 0x7f17b8004c40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f17b4001780 tx=0x7f17b401c3a0 comp rx=0 tx=0).stop 2023-07-14T13:05:20.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.975+0000 7f17cec34640 1 -- 172.21.15.5:0/1535788603 shutdown_connections 2023-07-14T13:05:20.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.975+0000 7f17cec34640 1 --2- 172.21.15.5:0/1535788603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17b80047d0 0x7f17b8004c40 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:20.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.975+0000 7f17cec34640 1 -- 172.21.15.5:0/1535788603 >> 172.21.15.5:0/1535788603 conn(0x7f17c80cde90 msgr2=0x7f17c80ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:20.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.975+0000 7f17cec34640 1 -- 172.21.15.5:0/1535788603 shutdown_connections 2023-07-14T13:05:20.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.975+0000 7f17cec34640 1 -- 172.21.15.5:0/1535788603 wait complete. 2023-07-14T13:05:20.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.979+0000 7f17cec34640 1 Processor -- start 2023-07-14T13:05:20.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.979+0000 7f17cec34640 1 -- start start 2023-07-14T13:05:20.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.979+0000 7f17cec34640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17b80047d0 0x7f17c814d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:20.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.979+0000 7f17cec34640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17c80b2de0 0x7f17c80b3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:20.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.979+0000 7f17cec34640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17c81e8090 0x7f17c81e8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:20.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.979+0000 7f17cec34640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c80b3790 con 0x7f17b80047d0 2023-07-14T13:05:20.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.979+0000 7f17cec34640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c81e5c80 con 0x7f17c81e8090 2023-07-14T13:05:20.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.979+0000 7f17cec34640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c81e6aa0 con 0x7f17c80b2de0 2023-07-14T13:05:20.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.979+0000 7f17cc9d0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17b80047d0 0x7f17c814d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:20.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.979+0000 7f17cc9d0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17b80047d0 0x7f17c814d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50156/0 (socket says 172.21.15.5:50156) 2023-07-14T13:05:20.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.979+0000 7f17cc9d0640 1 -- 172.21.15.5:0/3992591176 learned_addr learned my addr 172.21.15.5:0/3992591176 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:20.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.979+0000 7f17cd1d1640 1 --2- 172.21.15.5:0/3992591176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17c81e8090 0x7f17c81e8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:20.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.979+0000 7f17c7fff640 1 --2- 172.21.15.5:0/3992591176 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17c80b2de0 0x7f17c80b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:20.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.979+0000 7f17cc9d0640 1 -- 172.21.15.5:0/3992591176 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17c80b2de0 msgr2=0x7f17c80b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:20.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.979+0000 7f17cc9d0640 1 --2- 172.21.15.5:0/3992591176 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17c80b2de0 0x7f17c80b3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:20.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.979+0000 7f17cc9d0640 1 -- 172.21.15.5:0/3992591176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17c81e8090 msgr2=0x7f17c81e8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:20.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.979+0000 7f17cc9d0640 1 --2- 172.21.15.5:0/3992591176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17c81e8090 0x7f17c81e8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:20.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.979+0000 7f17cc9d0640 1 -- 172.21.15.5:0/3992591176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c81e5f20 con 0x7f17b80047d0 2023-07-14T13:05:20.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.979+0000 7f17c7fff640 1 --2- 172.21.15.5:0/3992591176 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17c80b2de0 0x7f17c80b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:05:20.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.979+0000 7f17cc9d0640 1 --2- 172.21.15.5:0/3992591176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17b80047d0 0x7f17c814d9a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0011f0 tx=0x7f17bc007350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:20.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.979+0000 7f17c57fa640 1 -- 172.21.15.5:0/3992591176 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc011580 con 0x7f17b80047d0 2023-07-14T13:05:20.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.979+0000 7f17c57fa640 1 -- 172.21.15.5:0/3992591176 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17bc011720 con 0x7f17b80047d0 2023-07-14T13:05:20.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.979+0000 7f17c57fa640 1 -- 172.21.15.5:0/3992591176 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc011ad0 con 0x7f17b80047d0 2023-07-14T13:05:20.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.979+0000 7f17cec34640 1 -- 172.21.15.5:0/3992591176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c81e6200 con 0x7f17b80047d0 2023-07-14T13:05:20.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.979+0000 7f17cec34640 1 -- 172.21.15.5:0/3992591176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c81e67c0 con 0x7f17b80047d0 2023-07-14T13:05:20.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.979+0000 7f17cec34640 1 -- 172.21.15.5:0/3992591176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c80714b0 con 0x7f17b80047d0 2023-07-14T13:05:20.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.983+0000 7f17c57fa640 1 -- 172.21.15.5:0/3992591176 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f17bc011c30 con 0x7f17b80047d0 2023-07-14T13:05:20.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.983+0000 7f17c57fa640 1 --2- 172.21.15.5:0/3992591176 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f17ac066480 0x7f17ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:20.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.983+0000 7f17c57fa640 1 -- 172.21.15.5:0/3992591176 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f17bc0841c0 con 0x7f17b80047d0 2023-07-14T13:05:20.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.983+0000 7f17c7fff640 1 --2- 172.21.15.5:0/3992591176 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f17ac066480 0x7f17ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:20.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.983+0000 7f17c7fff640 1 --2- 172.21.15.5:0/3992591176 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f17ac066480 0x7f17ac068930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f17b4001750 tx=0x7f17b40011a0 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:20.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:19.987+0000 7f17c57fa640 1 -- 172.21.15.5:0/3992591176 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f17bc0512b0 con 0x7f17b80047d0 2023-07-14T13:05:20.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.163+0000 7f17cec34640 1 -- 172.21.15.5:0/3992591176 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f17c8151cc0 con 0x7f17ac066480 2023-07-14T13:05:20.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.231+0000 7f17c57fa640 1 -- 172.21.15.5:0/3992591176 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f17c8151cc0 con 0x7f17ac066480 2023-07-14T13:05:20.260 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule deactivated for path /snap_test_dir1/dir0 2023-07-14T13:05:20.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.231+0000 7f17cec34640 1 -- 172.21.15.5:0/3992591176 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f17ac066480 msgr2=0x7f17ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:20.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.231+0000 7f17cec34640 1 --2- 172.21.15.5:0/3992591176 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f17ac066480 0x7f17ac068930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f17b4001750 tx=0x7f17b40011a0 comp rx=0 tx=0).stop 2023-07-14T13:05:20.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.231+0000 7f17cec34640 1 -- 172.21.15.5:0/3992591176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17b80047d0 msgr2=0x7f17c814d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:20.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.231+0000 7f17cec34640 1 --2- 172.21.15.5:0/3992591176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17b80047d0 0x7f17c814d9a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0011f0 tx=0x7f17bc007350 comp rx=0 tx=0).stop 2023-07-14T13:05:20.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.231+0000 7f17cec34640 1 -- 172.21.15.5:0/3992591176 shutdown_connections 2023-07-14T13:05:20.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.231+0000 7f17cec34640 1 --2- 172.21.15.5:0/3992591176 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f17ac066480 0x7f17ac068930 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:20.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.231+0000 7f17cec34640 1 --2- 172.21.15.5:0/3992591176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17c81e8090 0x7f17c81e8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:20.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.231+0000 7f17cec34640 1 --2- 172.21.15.5:0/3992591176 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17c80b2de0 0x7f17c80b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:20.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.231+0000 7f17cec34640 1 --2- 172.21.15.5:0/3992591176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17b80047d0 0x7f17c814d9a0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:20.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.231+0000 7f17cec34640 1 -- 172.21.15.5:0/3992591176 >> 172.21.15.5:0/3992591176 conn(0x7f17c80cde90 msgr2=0x7f17c8153a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:20.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.231+0000 7f17cec34640 1 -- 172.21.15.5:0/3992591176 shutdown_connections 2023-07-14T13:05:20.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.231+0000 7f17cec34640 1 -- 172.21.15.5:0/3992591176 wait complete. 2023-07-14T13:05:20.281 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir0 2023-07-14T13:05:20.282 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir1 1M 2023-07-14T13:05:20.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.399+0000 7f915da48640 1 Processor -- start 2023-07-14T13:05:20.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.403+0000 7f915da48640 1 -- start start 2023-07-14T13:05:20.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.403+0000 7f915da48640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91580cdd10 0x7f91580ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:20.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.403+0000 7f915da48640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91580b1770 0x7f91580d0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:20.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.403+0000 7f915da48640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91580d0ad0 con 0x7f91580d0650 2023-07-14T13:05:20.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.403+0000 7f915da48640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91580b0450 con 0x7f91580cdd10 2023-07-14T13:05:20.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.403+0000 7f915da48640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91580ce620 con 0x7f91580b1770 2023-07-14T13:05:20.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.403+0000 7f9156ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91580cdd10 0x7f91580ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:20.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.403+0000 7f9156ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f91580cdd10 0x7f91580ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50160/0 (socket says 172.21.15.5:50160) 2023-07-14T13:05:20.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.403+0000 7f9156ffd640 1 -- 172.21.15.5:0/1876762965 learned_addr learned my addr 172.21.15.5:0/1876762965 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:20.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.403+0000 7f914ffff640 1 --2- 172.21.15.5:0/1876762965 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91580b1770 0x7f91580d0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:20.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.403+0000 7f9156ffd640 1 -- 172.21.15.5:0/1876762965 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91580b1770 msgr2=0x7f91580d0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:20.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.403+0000 7f9156ffd640 1 --2- 172.21.15.5:0/1876762965 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91580b1770 0x7f91580d0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:20.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.403+0000 7f9156ffd640 1 -- 172.21.15.5:0/1876762965 >> v1:172.21.15.154:6789/0 conn(0x7f91580d0650 legacy=0x7f91580ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:20.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.403+0000 7f9156ffd640 1 -- 172.21.15.5:0/1876762965 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91580b06d0 con 0x7f91580cdd10 2023-07-14T13:05:20.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.407+0000 7f9156ffd640 1 --2- 172.21.15.5:0/1876762965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91580cdd10 0x7f91580ce0e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f9148009870 tx=0x7f914801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceeb97c2dec60c1b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:20.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.407+0000 7f91567fc640 1 -- 172.21.15.5:0/1876762965 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91480a7070 con 0x7f91580cdd10 2023-07-14T13:05:20.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.407+0000 7f91567fc640 1 -- 172.21.15.5:0/1876762965 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91480ab430 con 0x7f91580cdd10 2023-07-14T13:05:20.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.407+0000 7f91567fc640 1 -- 172.21.15.5:0/1876762965 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91480ab7c0 con 0x7f91580cdd10 2023-07-14T13:05:20.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.407+0000 7f915da48640 1 -- 172.21.15.5:0/1876762965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91580cdd10 msgr2=0x7f91580ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:20.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.407+0000 7f915da48640 1 --2- 172.21.15.5:0/1876762965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91580cdd10 0x7f91580ce0e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f9148009870 tx=0x7f914801c510 comp rx=0 tx=0).stop 2023-07-14T13:05:20.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.407+0000 7f915da48640 1 -- 172.21.15.5:0/1876762965 shutdown_connections 2023-07-14T13:05:20.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.407+0000 7f915da48640 1 --2- 172.21.15.5:0/1876762965 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91580b1770 0x7f91580d0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:20.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.407+0000 7f915da48640 1 --2- 172.21.15.5:0/1876762965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91580cdd10 0x7f91580ce0e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:20.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.407+0000 7f915da48640 1 -- 172.21.15.5:0/1876762965 >> 172.21.15.5:0/1876762965 conn(0x7f9158099490 msgr2=0x7f9158089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:20.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.407+0000 7f915da48640 1 -- 172.21.15.5:0/1876762965 shutdown_connections 2023-07-14T13:05:20.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.407+0000 7f915da48640 1 -- 172.21.15.5:0/1876762965 wait complete. 2023-07-14T13:05:20.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.407+0000 7f915da48640 1 Processor -- start 2023-07-14T13:05:20.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.407+0000 7f915da48640 1 -- start start 2023-07-14T13:05:20.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.411+0000 7f915da48640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91580b1770 0x7f915814c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:20.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.411+0000 7f915da48640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91580cdd10 0x7f91580b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:20.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.411+0000 7f915da48640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91580d0650 0x7f91580b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:20.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.411+0000 7f915da48640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91581f4f60 con 0x7f91580cdd10 2023-07-14T13:05:20.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.411+0000 7f915da48640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91581f5240 con 0x7f91580d0650 2023-07-14T13:05:20.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.411+0000 7f915da48640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91581f5520 con 0x7f91580b1770 2023-07-14T13:05:20.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.411+0000 7f914ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91580cdd10 0x7f91580b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:20.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.411+0000 7f914ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91580cdd10 0x7f91580b2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50176/0 (socket says 172.21.15.5:50176) 2023-07-14T13:05:20.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.411+0000 7f914ffff640 1 -- 172.21.15.5:0/882939990 learned_addr learned my addr 172.21.15.5:0/882939990 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:20.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.411+0000 7f9156ffd640 1 --2- 172.21.15.5:0/882939990 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91580b1770 0x7f915814c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:20.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.411+0000 7f91577fe640 1 --2- 172.21.15.5:0/882939990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91580d0650 0x7f91580b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:20.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.411+0000 7f914ffff640 1 -- 172.21.15.5:0/882939990 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91580b1770 msgr2=0x7f915814c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:20.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.411+0000 7f914ffff640 1 --2- 172.21.15.5:0/882939990 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91580b1770 0x7f915814c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:20.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.411+0000 7f914ffff640 1 -- 172.21.15.5:0/882939990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91580d0650 msgr2=0x7f91580b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:20.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.411+0000 7f914ffff640 1 --2- 172.21.15.5:0/882939990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91580d0650 0x7f91580b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:20.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.411+0000 7f914ffff640 1 -- 172.21.15.5:0/882939990 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91480094d0 con 0x7f91580cdd10 2023-07-14T13:05:20.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.411+0000 7f91577fe640 1 --2- 172.21.15.5:0/882939990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91580d0650 0x7f91580b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:05:20.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.411+0000 7f9156ffd640 1 --2- 172.21.15.5:0/882939990 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91580b1770 0x7f915814c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:05:20.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.411+0000 7f914ffff640 1 --2- 172.21.15.5:0/882939990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91580cdd10 0x7f91580b2f70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f914000e870 tx=0x7f914000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:20.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.411+0000 7f9154ff9640 1 -- 172.21.15.5:0/882939990 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9140009510 con 0x7f91580cdd10 2023-07-14T13:05:20.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.411+0000 7f9154ff9640 1 -- 172.21.15.5:0/882939990 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914000eec0 con 0x7f91580cdd10 2023-07-14T13:05:20.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.411+0000 7f9154ff9640 1 -- 172.21.15.5:0/882939990 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914000cb40 con 0x7f91580cdd10 2023-07-14T13:05:20.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.411+0000 7f915da48640 1 -- 172.21.15.5:0/882939990 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91581f5800 con 0x7f91580cdd10 2023-07-14T13:05:20.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.411+0000 7f915da48640 1 -- 172.21.15.5:0/882939990 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f915814c680 con 0x7f91580cdd10 2023-07-14T13:05:20.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.411+0000 7f915da48640 1 -- 172.21.15.5:0/882939990 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91580678d0 con 0x7f91580cdd10 2023-07-14T13:05:20.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.415+0000 7f9154ff9640 1 -- 172.21.15.5:0/882939990 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f914000cca0 con 0x7f91580cdd10 2023-07-14T13:05:20.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.415+0000 7f9154ff9640 1 --2- 172.21.15.5:0/882939990 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f9138066480 0x7f9138068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:20.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.415+0000 7f9154ff9640 1 -- 172.21.15.5:0/882939990 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f9140084280 con 0x7f91580cdd10 2023-07-14T13:05:20.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.415+0000 7f9156ffd640 1 --2- 172.21.15.5:0/882939990 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f9138066480 0x7f9138068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:20.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.415+0000 7f9156ffd640 1 --2- 172.21.15.5:0/882939990 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f9138066480 0x7f9138068930 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f91480af000 tx=0x7f9148008040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:20.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.419+0000 7f9154ff9640 1 -- 172.21.15.5:0/882939990 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f91400513d0 con 0x7f91580cdd10 2023-07-14T13:05:20.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.595+0000 7f915da48640 1 -- 172.21.15.5:0/882939990 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f91580b1250 con 0x7f9138066480 2023-07-14T13:05:20.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.663+0000 7f9154ff9640 1 -- 172.21.15.5:0/882939990 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f91480bb0d0 con 0x7f9138066480 2023-07-14T13:05:20.692 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule deactivated for path /snap_test_dir1/dir1 2023-07-14T13:05:20.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.663+0000 7f915da48640 1 -- 172.21.15.5:0/882939990 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f9138066480 msgr2=0x7f9138068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:20.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.663+0000 7f915da48640 1 --2- 172.21.15.5:0/882939990 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f9138066480 0x7f9138068930 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f91480af000 tx=0x7f9148008040 comp rx=0 tx=0).stop 2023-07-14T13:05:20.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.663+0000 7f915da48640 1 -- 172.21.15.5:0/882939990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91580cdd10 msgr2=0x7f91580b2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:20.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.663+0000 7f915da48640 1 --2- 172.21.15.5:0/882939990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91580cdd10 0x7f91580b2f70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f914000e870 tx=0x7f914000ec70 comp rx=0 tx=0).stop 2023-07-14T13:05:20.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.663+0000 7f915da48640 1 -- 172.21.15.5:0/882939990 shutdown_connections 2023-07-14T13:05:20.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.663+0000 7f915da48640 1 --2- 172.21.15.5:0/882939990 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f9138066480 0x7f9138068930 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:20.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.663+0000 7f915da48640 1 --2- 172.21.15.5:0/882939990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91580d0650 0x7f91580b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:20.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.663+0000 7f915da48640 1 --2- 172.21.15.5:0/882939990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91580cdd10 0x7f91580b2f70 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:20.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.663+0000 7f915da48640 1 --2- 172.21.15.5:0/882939990 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91580b1770 0x7f915814c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:20.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.663+0000 7f915da48640 1 -- 172.21.15.5:0/882939990 >> 172.21.15.5:0/882939990 conn(0x7f9158099490 msgr2=0x7f91580af120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:20.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.663+0000 7f915da48640 1 -- 172.21.15.5:0/882939990 shutdown_connections 2023-07-14T13:05:20.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.663+0000 7f915da48640 1 -- 172.21.15.5:0/882939990 wait complete. 2023-07-14T13:05:20.713 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir1 2023-07-14T13:05:20.713 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir2 1M 2023-07-14T13:05:20.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.831+0000 7f7b1d9fa640 1 Processor -- start 2023-07-14T13:05:20.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.831+0000 7f7b1d9fa640 1 -- start start 2023-07-14T13:05:20.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.831+0000 7f7b1d9fa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7b1806a540 0x7f7b1806a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:20.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.831+0000 7f7b1d9fa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7b180cf2e0 0x7f7b180cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:20.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.831+0000 7f7b1d9fa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b180cb7a0 con 0x7f7b180cc9c0 2023-07-14T13:05:20.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.831+0000 7f7b1d9fa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b180d0920 con 0x7f7b180cf2e0 2023-07-14T13:05:20.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.831+0000 7f7b1d9fa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1815bfd0 con 0x7f7b1806a540 2023-07-14T13:05:20.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.831+0000 7f7b0ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7b180cf2e0 0x7f7b180cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:20.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.831+0000 7f7b0ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7b180cf2e0 0x7f7b180cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50178/0 (socket says 172.21.15.5:50178) 2023-07-14T13:05:20.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.831+0000 7f7b0ffff640 1 -- 172.21.15.5:0/792793165 learned_addr learned my addr 172.21.15.5:0/792793165 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:20.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.835+0000 7f7b16ffd640 1 --2- 172.21.15.5:0/792793165 >> v2:172.21.15.154:3300/0 conn(0x7f7b1806a540 0x7f7b1806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:20.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.835+0000 7f7b0ffff640 1 -- 172.21.15.5:0/792793165 >> v2:172.21.15.154:3300/0 conn(0x7f7b1806a540 msgr2=0x7f7b1806a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:20.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.835+0000 7f7b0ffff640 1 --2- 172.21.15.5:0/792793165 >> v2:172.21.15.154:3300/0 conn(0x7f7b1806a540 0x7f7b1806a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:20.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.835+0000 7f7b0ffff640 1 -- 172.21.15.5:0/792793165 >> v1:172.21.15.154:6789/0 conn(0x7f7b180cc9c0 legacy=0x7f7b180cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:20.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.835+0000 7f7b0ffff640 1 -- 172.21.15.5:0/792793165 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1806ae50 con 0x7f7b180cf2e0 2023-07-14T13:05:20.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.835+0000 7f7b0ffff640 1 --2- 172.21.15.5:0/792793165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b180cf2e0 0x7f7b180cf710 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7b00009870 tx=0x7f7b0001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c9aca62da78c1a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:20.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.835+0000 7f7b167fc640 1 -- 172.21.15.5:0/792793165 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b000aa430 con 0x7f7b180cf2e0 2023-07-14T13:05:20.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.835+0000 7f7b167fc640 1 -- 172.21.15.5:0/792793165 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b000aa590 con 0x7f7b180cf2e0 2023-07-14T13:05:20.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.835+0000 7f7b167fc640 1 -- 172.21.15.5:0/792793165 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b000aa920 con 0x7f7b180cf2e0 2023-07-14T13:05:20.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.835+0000 7f7b1d9fa640 1 -- 172.21.15.5:0/792793165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b180cf2e0 msgr2=0x7f7b180cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:20.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.839+0000 7f7b1d9fa640 1 --2- 172.21.15.5:0/792793165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b180cf2e0 0x7f7b180cf710 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7b00009870 tx=0x7f7b0001c4d0 comp rx=0 tx=0).stop 2023-07-14T13:05:20.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.839+0000 7f7b1d9fa640 1 -- 172.21.15.5:0/792793165 shutdown_connections 2023-07-14T13:05:20.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.839+0000 7f7b1d9fa640 1 --2- 172.21.15.5:0/792793165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b180cf2e0 0x7f7b180cf710 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:20.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.839+0000 7f7b1d9fa640 1 --2- 172.21.15.5:0/792793165 >> v2:172.21.15.154:3300/0 conn(0x7f7b1806a540 0x7f7b1806a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:20.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.839+0000 7f7b1d9fa640 1 -- 172.21.15.5:0/792793165 >> 172.21.15.5:0/792793165 conn(0x7f7b18099490 msgr2=0x7f7b18089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:20.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.839+0000 7f7b1d9fa640 1 -- 172.21.15.5:0/792793165 shutdown_connections 2023-07-14T13:05:20.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.839+0000 7f7b1d9fa640 1 -- 172.21.15.5:0/792793165 wait complete. 2023-07-14T13:05:20.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.839+0000 7f7b1d9fa640 1 Processor -- start 2023-07-14T13:05:20.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.839+0000 7f7b1d9fa640 1 -- start start 2023-07-14T13:05:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.839+0000 7f7b1d9fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b1806a540 0x7f7b1815c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.839+0000 7f7b1d9fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b180cc9c0 0x7f7b1814ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.839+0000 7f7b1d9fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b180cf2e0 0x7f7b180ad460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.839+0000 7f7b1d9fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b18159770 con 0x7f7b180cf2e0 2023-07-14T13:05:20.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.839+0000 7f7b1d9fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b181533a0 con 0x7f7b1806a540 2023-07-14T13:05:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.839+0000 7f7b1d9fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b18153640 con 0x7f7b180cc9c0 2023-07-14T13:05:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.839+0000 7f7b16ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b1806a540 0x7f7b1815c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.839+0000 7f7b177fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b180cf2e0 0x7f7b180ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.839+0000 7f7b16ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b1806a540 0x7f7b1815c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:45290/0 (socket says 172.21.15.5:45290) 2023-07-14T13:05:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.839+0000 7f7b16ffd640 1 -- 172.21.15.5:0/157619381 learned_addr learned my addr 172.21.15.5:0/157619381 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:20.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.839+0000 7f7b0ffff640 1 --2- 172.21.15.5:0/157619381 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b180cc9c0 0x7f7b1814ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:20.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.839+0000 7f7b16ffd640 1 -- 172.21.15.5:0/157619381 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b180cc9c0 msgr2=0x7f7b1814ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:20.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.839+0000 7f7b16ffd640 1 --2- 172.21.15.5:0/157619381 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b180cc9c0 0x7f7b1814ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.839+0000 7f7b16ffd640 1 -- 172.21.15.5:0/157619381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b180cf2e0 msgr2=0x7f7b180ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.839+0000 7f7b16ffd640 1 --2- 172.21.15.5:0/157619381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b180cf2e0 0x7f7b180ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.839+0000 7f7b16ffd640 1 -- 172.21.15.5:0/157619381 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b000094d0 con 0x7f7b1806a540 2023-07-14T13:05:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.839+0000 7f7b177fe640 1 --2- 172.21.15.5:0/157619381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b180cf2e0 0x7f7b180ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.839+0000 7f7b16ffd640 1 --2- 172.21.15.5:0/157619381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b1806a540 0x7f7b1815c1a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7b0800e870 tx=0x7f7b0800ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.843+0000 7f7b14ff9640 1 -- 172.21.15.5:0/157619381 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b08009510 con 0x7f7b1806a540 2023-07-14T13:05:20.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.843+0000 7f7b14ff9640 1 -- 172.21.15.5:0/157619381 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0800eec0 con 0x7f7b1806a540 2023-07-14T13:05:20.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.843+0000 7f7b14ff9640 1 -- 172.21.15.5:0/157619381 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0800cb40 con 0x7f7b1806a540 2023-07-14T13:05:20.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.843+0000 7f7b1d9fa640 1 -- 172.21.15.5:0/157619381 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b18153920 con 0x7f7b1806a540 2023-07-14T13:05:20.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.843+0000 7f7b1d9fa640 1 -- 172.21.15.5:0/157619381 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1814f450 con 0x7f7b1806a540 2023-07-14T13:05:20.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.843+0000 7f7b1d9fa640 1 -- 172.21.15.5:0/157619381 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b180678d0 con 0x7f7b1806a540 2023-07-14T13:05:20.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.843+0000 7f7b14ff9640 1 -- 172.21.15.5:0/157619381 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f7b0800cca0 con 0x7f7b1806a540 2023-07-14T13:05:20.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.843+0000 7f7b14ff9640 1 --2- 172.21.15.5:0/157619381 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f7af8066480 0x7f7af8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:20.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.843+0000 7f7b14ff9640 1 -- 172.21.15.5:0/157619381 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f7b08084230 con 0x7f7b1806a540 2023-07-14T13:05:20.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.843+0000 7f7b0ffff640 1 --2- 172.21.15.5:0/157619381 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f7af8066480 0x7f7af8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:20.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.847+0000 7f7b0ffff640 1 --2- 172.21.15.5:0/157619381 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f7af8066480 0x7f7af8068930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7b000ae000 tx=0x7f7b000b5040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:20.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:20.847+0000 7f7b14ff9640 1 -- 172.21.15.5:0/157619381 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7b080513d0 con 0x7f7b1806a540 2023-07-14T13:05:21.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.023+0000 7f7b1d9fa640 1 -- 172.21.15.5:0/157619381 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b180d05b0 con 0x7f7af8066480 2023-07-14T13:05:21.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.083+0000 7f7b14ff9640 1 -- 172.21.15.5:0/157619381 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f7b000aa800 con 0x7f7af8066480 2023-07-14T13:05:21.115 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule deactivated for path /snap_test_dir1/dir2 2023-07-14T13:05:21.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.087+0000 7f7b1d9fa640 1 -- 172.21.15.5:0/157619381 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f7af8066480 msgr2=0x7f7af8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.087+0000 7f7b1d9fa640 1 --2- 172.21.15.5:0/157619381 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f7af8066480 0x7f7af8068930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7b000ae000 tx=0x7f7b000b5040 comp rx=0 tx=0).stop 2023-07-14T13:05:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.087+0000 7f7b1d9fa640 1 -- 172.21.15.5:0/157619381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b1806a540 msgr2=0x7f7b1815c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.087+0000 7f7b1d9fa640 1 --2- 172.21.15.5:0/157619381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b1806a540 0x7f7b1815c1a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7b0800e870 tx=0x7f7b0800ec70 comp rx=0 tx=0).stop 2023-07-14T13:05:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.087+0000 7f7b1d9fa640 1 -- 172.21.15.5:0/157619381 shutdown_connections 2023-07-14T13:05:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.087+0000 7f7b1d9fa640 1 --2- 172.21.15.5:0/157619381 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f7af8066480 0x7f7af8068930 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.087+0000 7f7b1d9fa640 1 --2- 172.21.15.5:0/157619381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7b180cf2e0 0x7f7b180ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.087+0000 7f7b1d9fa640 1 --2- 172.21.15.5:0/157619381 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b180cc9c0 0x7f7b1814ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.087+0000 7f7b1d9fa640 1 --2- 172.21.15.5:0/157619381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b1806a540 0x7f7b1815c1a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.087+0000 7f7b1d9fa640 1 -- 172.21.15.5:0/157619381 >> 172.21.15.5:0/157619381 conn(0x7f7b18099490 msgr2=0x7f7b180accf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.087+0000 7f7b1d9fa640 1 -- 172.21.15.5:0/157619381 shutdown_connections 2023-07-14T13:05:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.087+0000 7f7b1d9fa640 1 -- 172.21.15.5:0/157619381 wait complete. 2023-07-14T13:05:21.135 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir2 2023-07-14T13:05:21.136 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir3 1M 2023-07-14T13:05:21.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.255+0000 7f89ec86a640 1 Processor -- start 2023-07-14T13:05:21.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.255+0000 7f89ec86a640 1 -- start start 2023-07-14T13:05:21.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.255+0000 7f89ec86a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89e8069430 0x7f89e8069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:21.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.255+0000 7f89ec86a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f89e80af2b0 0x7f89e815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:21.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.255+0000 7f89ec86a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e8159d70 con 0x7f89e8070f30 2023-07-14T13:05:21.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.255+0000 7f89ec86a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e8069d40 con 0x7f89e80af2b0 2023-07-14T13:05:21.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.255+0000 7f89ec86a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e80c9c60 con 0x7f89e8069430 2023-07-14T13:05:21.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.255+0000 7f89e6d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f89e80af2b0 0x7f89e815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:21.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.255+0000 7f89e6d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f89e80af2b0 0x7f89e815a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50202/0 (socket says 172.21.15.5:50202) 2023-07-14T13:05:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.255+0000 7f89e6d9d640 1 -- 172.21.15.5:0/3525358886 learned_addr learned my addr 172.21.15.5:0/3525358886 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.255+0000 7f89e659c640 1 --2- 172.21.15.5:0/3525358886 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89e8069430 0x7f89e8069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.255+0000 7f89e6d9d640 1 -- 172.21.15.5:0/3525358886 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89e8069430 msgr2=0x7f89e8069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.255+0000 7f89e6d9d640 1 --2- 172.21.15.5:0/3525358886 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89e8069430 0x7f89e8069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.255+0000 7f89e6d9d640 1 -- 172.21.15.5:0/3525358886 >> v1:172.21.15.154:6789/0 conn(0x7f89e8070f30 legacy=0x7f89e80ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:21.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.255+0000 7f89e6d9d640 1 -- 172.21.15.5:0/3525358886 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e80c9f40 con 0x7f89e80af2b0 2023-07-14T13:05:21.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.259+0000 7f89e6d9d640 1 --2- 172.21.15.5:0/3525358886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e80af2b0 0x7f89e815a1f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f89e0009e50 tx=0x7f89e001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8b1c93b9d8ada server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.259+0000 7f89e559a640 1 -- 172.21.15.5:0/3525358886 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e00a57f0 con 0x7f89e80af2b0 2023-07-14T13:05:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.259+0000 7f89e559a640 1 -- 172.21.15.5:0/3525358886 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e00a5950 con 0x7f89e80af2b0 2023-07-14T13:05:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.259+0000 7f89e559a640 1 -- 172.21.15.5:0/3525358886 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e00a5ce0 con 0x7f89e80af2b0 2023-07-14T13:05:21.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.259+0000 7f89ec86a640 1 -- 172.21.15.5:0/3525358886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e80af2b0 msgr2=0x7f89e815a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:21.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.259+0000 7f89ec86a640 1 --2- 172.21.15.5:0/3525358886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e80af2b0 0x7f89e815a1f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f89e0009e50 tx=0x7f89e001ca10 comp rx=0 tx=0).stop 2023-07-14T13:05:21.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.259+0000 7f89ec86a640 1 -- 172.21.15.5:0/3525358886 shutdown_connections 2023-07-14T13:05:21.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.259+0000 7f89ec86a640 1 --2- 172.21.15.5:0/3525358886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e80af2b0 0x7f89e815a1f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:21.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.259+0000 7f89ec86a640 1 --2- 172.21.15.5:0/3525358886 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89e8069430 0x7f89e8069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:21.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.259+0000 7f89ec86a640 1 -- 172.21.15.5:0/3525358886 >> 172.21.15.5:0/3525358886 conn(0x7f89e80cde90 msgr2=0x7f89e80ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:21.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.259+0000 7f89ec86a640 1 -- 172.21.15.5:0/3525358886 shutdown_connections 2023-07-14T13:05:21.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.259+0000 7f89ec86a640 1 -- 172.21.15.5:0/3525358886 wait complete. 2023-07-14T13:05:21.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.263+0000 7f89ec86a640 1 Processor -- start 2023-07-14T13:05:21.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.263+0000 7f89ec86a640 1 -- start start 2023-07-14T13:05:21.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.263+0000 7f89ec86a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e8069430 0x7f89e813cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.263+0000 7f89ec86a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89e8070f30 0x7f89e814f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.263+0000 7f89ec86a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89e80af2b0 0x7f89e80b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.263+0000 7f89ec86a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e813d130 con 0x7f89e8069430 2023-07-14T13:05:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.263+0000 7f89ec86a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e814ec90 con 0x7f89e8070f30 2023-07-14T13:05:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.263+0000 7f89ec86a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e814e360 con 0x7f89e80af2b0 2023-07-14T13:05:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.263+0000 7f89e659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e8069430 0x7f89e813cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.263+0000 7f89e659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e8069430 0x7f89e813cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50206/0 (socket says 172.21.15.5:50206) 2023-07-14T13:05:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.263+0000 7f89e659c640 1 -- 172.21.15.5:0/710127539 learned_addr learned my addr 172.21.15.5:0/710127539 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.263+0000 7f89e6d9d640 1 --2- 172.21.15.5:0/710127539 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89e80af2b0 0x7f89e80b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.263+0000 7f89e5d9b640 1 --2- 172.21.15.5:0/710127539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89e8070f30 0x7f89e814f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.263+0000 7f89e659c640 1 -- 172.21.15.5:0/710127539 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89e80af2b0 msgr2=0x7f89e80b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.263+0000 7f89e659c640 1 --2- 172.21.15.5:0/710127539 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89e80af2b0 0x7f89e80b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.263+0000 7f89e659c640 1 -- 172.21.15.5:0/710127539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89e8070f30 msgr2=0x7f89e814f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.263+0000 7f89e659c640 1 --2- 172.21.15.5:0/710127539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89e8070f30 0x7f89e814f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.263+0000 7f89e659c640 1 -- 172.21.15.5:0/710127539 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e0009b30 con 0x7f89e8069430 2023-07-14T13:05:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.263+0000 7f89e659c640 1 --2- 172.21.15.5:0/710127539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e8069430 0x7f89e813cb20 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f89d800e870 tx=0x7f89d800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.263+0000 7f89d6ffd640 1 -- 172.21.15.5:0/710127539 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d8009510 con 0x7f89e8069430 2023-07-14T13:05:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.263+0000 7f89d6ffd640 1 -- 172.21.15.5:0/710127539 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d800eec0 con 0x7f89e8069430 2023-07-14T13:05:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.263+0000 7f89ec86a640 1 -- 172.21.15.5:0/710127539 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e814e640 con 0x7f89e8069430 2023-07-14T13:05:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.263+0000 7f89d6ffd640 1 -- 172.21.15.5:0/710127539 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d800cb40 con 0x7f89e8069430 2023-07-14T13:05:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.263+0000 7f89ec86a640 1 -- 172.21.15.5:0/710127539 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e8069ab0 con 0x7f89e8069430 2023-07-14T13:05:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.263+0000 7f89ec86a640 1 -- 172.21.15.5:0/710127539 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e80678d0 con 0x7f89e8069430 2023-07-14T13:05:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.267+0000 7f89d6ffd640 1 -- 172.21.15.5:0/710127539 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f89d800cca0 con 0x7f89e8069430 2023-07-14T13:05:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.267+0000 7f89d6ffd640 1 --2- 172.21.15.5:0/710127539 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f89c8066480 0x7f89c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.267+0000 7f89d6ffd640 1 -- 172.21.15.5:0/710127539 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f89d80841e0 con 0x7f89e8069430 2023-07-14T13:05:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.267+0000 7f89e5d9b640 1 --2- 172.21.15.5:0/710127539 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f89c8066480 0x7f89c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.267+0000 7f89e5d9b640 1 --2- 172.21.15.5:0/710127539 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f89c8066480 0x7f89c8068930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f89e813d060 tx=0x7f89dc009040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.271+0000 7f89d6ffd640 1 -- 172.21.15.5:0/710127539 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f89d8051410 con 0x7f89e8069430 2023-07-14T13:05:21.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.447+0000 7f89ec86a640 1 -- 172.21.15.5:0/710127539 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f89e8157710 con 0x7f89c8066480 2023-07-14T13:05:21.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.507+0000 7f89d6ffd640 1 -- 172.21.15.5:0/710127539 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f89dc001450 con 0x7f89c8066480 2023-07-14T13:05:21.537 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule deactivated for path /snap_test_dir1/dir3 2023-07-14T13:05:21.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.507+0000 7f89ec86a640 1 -- 172.21.15.5:0/710127539 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f89c8066480 msgr2=0x7f89c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:21.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.507+0000 7f89ec86a640 1 --2- 172.21.15.5:0/710127539 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f89c8066480 0x7f89c8068930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f89e813d060 tx=0x7f89dc009040 comp rx=0 tx=0).stop 2023-07-14T13:05:21.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.507+0000 7f89ec86a640 1 -- 172.21.15.5:0/710127539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e8069430 msgr2=0x7f89e813cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:21.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.507+0000 7f89ec86a640 1 --2- 172.21.15.5:0/710127539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e8069430 0x7f89e813cb20 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f89d800e870 tx=0x7f89d800ec70 comp rx=0 tx=0).stop 2023-07-14T13:05:21.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.507+0000 7f89ec86a640 1 -- 172.21.15.5:0/710127539 shutdown_connections 2023-07-14T13:05:21.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.507+0000 7f89ec86a640 1 --2- 172.21.15.5:0/710127539 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f89c8066480 0x7f89c8068930 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:21.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.507+0000 7f89ec86a640 1 --2- 172.21.15.5:0/710127539 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89e80af2b0 0x7f89e80b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:21.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.507+0000 7f89ec86a640 1 --2- 172.21.15.5:0/710127539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89e8070f30 0x7f89e814f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:21.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.507+0000 7f89ec86a640 1 --2- 172.21.15.5:0/710127539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e8069430 0x7f89e813cb20 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:21.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.507+0000 7f89ec86a640 1 -- 172.21.15.5:0/710127539 >> 172.21.15.5:0/710127539 conn(0x7f89e80cde90 msgr2=0x7f89e806f060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:21.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.507+0000 7f89ec86a640 1 -- 172.21.15.5:0/710127539 shutdown_connections 2023-07-14T13:05:21.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.507+0000 7f89ec86a640 1 -- 172.21.15.5:0/710127539 wait complete. 2023-07-14T13:05:21.557 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir3 2023-07-14T13:05:21.558 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir4 1M 2023-07-14T13:05:21.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.675+0000 7f4b3a92c640 1 Processor -- start 2023-07-14T13:05:21.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.675+0000 7f4b3a92c640 1 -- start start 2023-07-14T13:05:21.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.679+0000 7f4b3a92c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4b3415cef0 0x7f4b34158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:21.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.679+0000 7f4b3a92c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b34159270 0x7f4b340c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:21.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.679+0000 7f4b3a92c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b341532b0 con 0x7f4b340aeb40 2023-07-14T13:05:21.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.679+0000 7f4b3a92c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b3415d360 con 0x7f4b34159270 2023-07-14T13:05:21.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.679+0000 7f4b3a92c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b340ca6f0 con 0x7f4b3415cef0 2023-07-14T13:05:21.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.679+0000 7f4b38ec9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b34159270 0x7f4b340c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:21.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.679+0000 7f4b38ec9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b34159270 0x7f4b340c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50216/0 (socket says 172.21.15.5:50216) 2023-07-14T13:05:21.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.679+0000 7f4b38ec9640 1 -- 172.21.15.5:0/2936129301 learned_addr learned my addr 172.21.15.5:0/2936129301 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:21.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.679+0000 7f4b337fe640 1 --2- 172.21.15.5:0/2936129301 >> v2:172.21.15.154:3300/0 conn(0x7f4b3415cef0 0x7f4b34158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:21.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.679+0000 7f4b38ec9640 1 -- 172.21.15.5:0/2936129301 >> v2:172.21.15.154:3300/0 conn(0x7f4b3415cef0 msgr2=0x7f4b34158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:21.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.679+0000 7f4b38ec9640 1 --2- 172.21.15.5:0/2936129301 >> v2:172.21.15.154:3300/0 conn(0x7f4b3415cef0 0x7f4b34158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:21.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.679+0000 7f4b38ec9640 1 -- 172.21.15.5:0/2936129301 >> v1:172.21.15.154:6789/0 conn(0x7f4b340aeb40 legacy=0x7f4b340aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:21.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.679+0000 7f4b38ec9640 1 -- 172.21.15.5:0/2936129301 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b341599d0 con 0x7f4b34159270 2023-07-14T13:05:21.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.679+0000 7f4b337fe640 1 --2- 172.21.15.5:0/2936129301 >> v2:172.21.15.154:3300/0 conn(0x7f4b3415cef0 0x7f4b34158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:05:21.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.683+0000 7f4b38ec9640 1 --2- 172.21.15.5:0/2936129301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b34159270 0x7f4b340c88c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4b340cee90 tx=0x7f4b2c01ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46761bc5ce5b6676 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:21.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.683+0000 7f4b32ffd640 1 -- 172.21.15.5:0/2936129301 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c0a7a80 con 0x7f4b34159270 2023-07-14T13:05:21.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.683+0000 7f4b32ffd640 1 -- 172.21.15.5:0/2936129301 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2c0a7be0 con 0x7f4b34159270 2023-07-14T13:05:21.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.683+0000 7f4b32ffd640 1 -- 172.21.15.5:0/2936129301 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c0af3f0 con 0x7f4b34159270 2023-07-14T13:05:21.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.683+0000 7f4b3a92c640 1 -- 172.21.15.5:0/2936129301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b34159270 msgr2=0x7f4b340c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:21.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.683+0000 7f4b3a92c640 1 --2- 172.21.15.5:0/2936129301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b34159270 0x7f4b340c88c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4b340cee90 tx=0x7f4b2c01ebb0 comp rx=0 tx=0).stop 2023-07-14T13:05:21.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.683+0000 7f4b3a92c640 1 -- 172.21.15.5:0/2936129301 shutdown_connections 2023-07-14T13:05:21.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.683+0000 7f4b3a92c640 1 --2- 172.21.15.5:0/2936129301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b34159270 0x7f4b340c88c0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:21.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.683+0000 7f4b3a92c640 1 --2- 172.21.15.5:0/2936129301 >> v2:172.21.15.154:3300/0 conn(0x7f4b3415cef0 0x7f4b34158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:21.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.683+0000 7f4b3a92c640 1 -- 172.21.15.5:0/2936129301 >> 172.21.15.5:0/2936129301 conn(0x7f4b340cde90 msgr2=0x7f4b340ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:21.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.683+0000 7f4b3a92c640 1 -- 172.21.15.5:0/2936129301 shutdown_connections 2023-07-14T13:05:21.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.683+0000 7f4b3a92c640 1 -- 172.21.15.5:0/2936129301 wait complete. 2023-07-14T13:05:21.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.683+0000 7f4b3a92c640 1 Processor -- start 2023-07-14T13:05:21.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.683+0000 7f4b3a92c640 1 -- start start 2023-07-14T13:05:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.687+0000 7f4b3a92c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b340aeb40 0x7f4b340ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.687+0000 7f4b3a92c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b34159270 0x7f4b3414e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.687+0000 7f4b3a92c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b3415cef0 0x7f4b340ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.687+0000 7f4b3a92c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340b3240 con 0x7f4b340aeb40 2023-07-14T13:05:21.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.687+0000 7f4b3a92c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340b3520 con 0x7f4b3415cef0 2023-07-14T13:05:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.687+0000 7f4b3a92c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340b3800 con 0x7f4b34159270 2023-07-14T13:05:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.687+0000 7f4b33fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b340aeb40 0x7f4b340ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.687+0000 7f4b33fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b340aeb40 0x7f4b340ab890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50218/0 (socket says 172.21.15.5:50218) 2023-07-14T13:05:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.687+0000 7f4b33fff640 1 -- 172.21.15.5:0/427661576 learned_addr learned my addr 172.21.15.5:0/427661576 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.687+0000 7f4b38ec9640 1 --2- 172.21.15.5:0/427661576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b3415cef0 0x7f4b340ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.687+0000 7f4b337fe640 1 --2- 172.21.15.5:0/427661576 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b34159270 0x7f4b3414e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:21.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.687+0000 7f4b33fff640 1 -- 172.21.15.5:0/427661576 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b34159270 msgr2=0x7f4b3414e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:21.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.687+0000 7f4b33fff640 1 --2- 172.21.15.5:0/427661576 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b34159270 0x7f4b3414e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:21.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.687+0000 7f4b33fff640 1 -- 172.21.15.5:0/427661576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b3415cef0 msgr2=0x7f4b340ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:21.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.687+0000 7f4b33fff640 1 --2- 172.21.15.5:0/427661576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b3415cef0 0x7f4b340ad8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:21.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.687+0000 7f4b33fff640 1 -- 172.21.15.5:0/427661576 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c009b30 con 0x7f4b340aeb40 2023-07-14T13:05:21.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.687+0000 7f4b38ec9640 1 --2- 172.21.15.5:0/427661576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b3415cef0 0x7f4b340ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:05:21.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.687+0000 7f4b33fff640 1 --2- 172.21.15.5:0/427661576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b340aeb40 0x7f4b340ab890 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4b2400c500 tx=0x7f4b2400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:21.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.687+0000 7f4b30ff9640 1 -- 172.21.15.5:0/427661576 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b24005220 con 0x7f4b340aeb40 2023-07-14T13:05:21.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.687+0000 7f4b30ff9640 1 -- 172.21.15.5:0/427661576 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b24005380 con 0x7f4b340aeb40 2023-07-14T13:05:21.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.687+0000 7f4b3a92c640 1 -- 172.21.15.5:0/427661576 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b340b3ae0 con 0x7f4b340aeb40 2023-07-14T13:05:21.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.687+0000 7f4b30ff9640 1 -- 172.21.15.5:0/427661576 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b24007270 con 0x7f4b340aeb40 2023-07-14T13:05:21.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.687+0000 7f4b3a92c640 1 -- 172.21.15.5:0/427661576 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b3414e610 con 0x7f4b340aeb40 2023-07-14T13:05:21.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.687+0000 7f4b3a92c640 1 -- 172.21.15.5:0/427661576 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b340678d0 con 0x7f4b340aeb40 2023-07-14T13:05:21.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.687+0000 7f4b30ff9640 1 -- 172.21.15.5:0/427661576 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f4b240073d0 con 0x7f4b340aeb40 2023-07-14T13:05:21.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.691+0000 7f4b30ff9640 1 --2- 172.21.15.5:0/427661576 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4b20066480 0x7f4b20068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:21.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.691+0000 7f4b30ff9640 1 -- 172.21.15.5:0/427661576 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f4b24083b70 con 0x7f4b340aeb40 2023-07-14T13:05:21.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.691+0000 7f4b337fe640 1 --2- 172.21.15.5:0/427661576 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4b20066480 0x7f4b20068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:21.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.691+0000 7f4b337fe640 1 --2- 172.21.15.5:0/427661576 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4b20066480 0x7f4b20068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4b340cc500 tx=0x7f4b28008040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:21.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.695+0000 7f4b30ff9640 1 -- 172.21.15.5:0/427661576 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4b24050bc0 con 0x7f4b340aeb40 2023-07-14T13:05:21.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.867+0000 7f4b3a92c640 1 -- 172.21.15.5:0/427661576 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b340b3030 con 0x7f4b20066480 2023-07-14T13:05:21.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.931+0000 7f4b30ff9640 1 -- 172.21.15.5:0/427661576 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f4b340b3030 con 0x7f4b20066480 2023-07-14T13:05:21.963 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule deactivated for path /snap_test_dir1/dir4 2023-07-14T13:05:21.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.935+0000 7f4b3a92c640 1 -- 172.21.15.5:0/427661576 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4b20066480 msgr2=0x7f4b20068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:21.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.935+0000 7f4b3a92c640 1 --2- 172.21.15.5:0/427661576 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4b20066480 0x7f4b20068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4b340cc500 tx=0x7f4b28008040 comp rx=0 tx=0).stop 2023-07-14T13:05:21.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.935+0000 7f4b3a92c640 1 -- 172.21.15.5:0/427661576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b340aeb40 msgr2=0x7f4b340ab890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:21.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.935+0000 7f4b3a92c640 1 --2- 172.21.15.5:0/427661576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b340aeb40 0x7f4b340ab890 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4b2400c500 tx=0x7f4b2400c9c0 comp rx=0 tx=0).stop 2023-07-14T13:05:21.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.935+0000 7f4b3a92c640 1 -- 172.21.15.5:0/427661576 shutdown_connections 2023-07-14T13:05:21.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.935+0000 7f4b3a92c640 1 --2- 172.21.15.5:0/427661576 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4b20066480 0x7f4b20068930 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:21.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.935+0000 7f4b3a92c640 1 --2- 172.21.15.5:0/427661576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b3415cef0 0x7f4b340ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:21.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.935+0000 7f4b3a92c640 1 --2- 172.21.15.5:0/427661576 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b34159270 0x7f4b3414e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:21.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.935+0000 7f4b3a92c640 1 --2- 172.21.15.5:0/427661576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b340aeb40 0x7f4b340ab890 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:21.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.935+0000 7f4b3a92c640 1 -- 172.21.15.5:0/427661576 >> 172.21.15.5:0/427661576 conn(0x7f4b340cde90 msgr2=0x7f4b34152a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:21.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.935+0000 7f4b3a92c640 1 -- 172.21.15.5:0/427661576 shutdown_connections 2023-07-14T13:05:21.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:21.935+0000 7f4b3a92c640 1 -- 172.21.15.5:0/427661576 wait complete. 2023-07-14T13:05:21.984 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir4 2023-07-14T13:05:21.985 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir5 1M 2023-07-14T13:05:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.103+0000 7fdeedf82640 1 Processor -- start 2023-07-14T13:05:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.103+0000 7fdeedf82640 1 -- start start 2023-07-14T13:05:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.103+0000 7fdeedf82640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdee81453a0 0x7fdee80b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.103+0000 7fdeedf82640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee806c040 con 0x7fdee815f690 2023-07-14T13:05:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.103+0000 7fdeedf82640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee8160600 con 0x7fdee806a440 2023-07-14T13:05:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.103+0000 7fdeedf82640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdee8160170 con 0x7fdee81453a0 2023-07-14T13:05:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.103+0000 7fdee77fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdee815f690 0x7fdee815fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49370/0 (socket says 172.21.15.5:49370) 2023-07-14T13:05:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.103+0000 7fdee77fe640 1 -- 172.21.15.5:0/2104818391 learned_addr learned my addr 172.21.15.5:0/2104818391 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.107+0000 7fdee7fff640 1 --2- 172.21.15.5:0/2104818391 >> v2:172.21.15.5:3300/0 conn(0x7fdee81453a0 0x7fdee80b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.107+0000 7fdee7fff640 1 -- 172.21.15.5:0/2104818391 >> v1:172.21.15.154:6789/0 conn(0x7fdee806a440 legacy=0x7fdee806c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.107+0000 7fdee7fff640 1 -- 172.21.15.5:0/2104818391 >> v1:172.21.15.5:6789/0 conn(0x7fdee815f690 legacy=0x7fdee815fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.107+0000 7fdee7fff640 1 -- 172.21.15.5:0/2104818391 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee8160360 con 0x7fdee81453a0 2023-07-14T13:05:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.107+0000 7fdee7fff640 1 --2- 172.21.15.5:0/2104818391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdee81453a0 0x7fdee80b1890 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009d90 tx=0x7fdee001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92329501a4e13870 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.107+0000 7fdee67fc640 1 -- 172.21.15.5:0/2104818391 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee00a5860 con 0x7fdee81453a0 2023-07-14T13:05:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.107+0000 7fdee67fc640 1 -- 172.21.15.5:0/2104818391 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee00a59c0 con 0x7fdee81453a0 2023-07-14T13:05:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.107+0000 7fdee67fc640 1 -- 172.21.15.5:0/2104818391 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee00a5d50 con 0x7fdee81453a0 2023-07-14T13:05:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.111+0000 7fdeedf82640 1 -- 172.21.15.5:0/2104818391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdee81453a0 msgr2=0x7fdee80b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.111+0000 7fdeedf82640 1 --2- 172.21.15.5:0/2104818391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdee81453a0 0x7fdee80b1890 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009d90 tx=0x7fdee001c890 comp rx=0 tx=0).stop 2023-07-14T13:05:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.111+0000 7fdeedf82640 1 -- 172.21.15.5:0/2104818391 shutdown_connections 2023-07-14T13:05:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.111+0000 7fdeedf82640 1 --2- 172.21.15.5:0/2104818391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdee81453a0 0x7fdee80b1890 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.111+0000 7fdeedf82640 1 -- 172.21.15.5:0/2104818391 >> 172.21.15.5:0/2104818391 conn(0x7fdee80b1210 msgr2=0x7fdee80ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.111+0000 7fdeedf82640 1 -- 172.21.15.5:0/2104818391 shutdown_connections 2023-07-14T13:05:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.111+0000 7fdeedf82640 1 -- 172.21.15.5:0/2104818391 wait complete. 2023-07-14T13:05:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.111+0000 7fdeedf82640 1 Processor -- start 2023-07-14T13:05:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.111+0000 7fdeedf82640 1 -- start start 2023-07-14T13:05:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.111+0000 7fdeedf82640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee806a440 0x7fdee8154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.111+0000 7fdeedf82640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee81453a0 0x7fdee815b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.111+0000 7fdeedf82640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdee815f690 0x7fdee81f3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.111+0000 7fdeedf82640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee815d7b0 con 0x7fdee815f690 2023-07-14T13:05:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.111+0000 7fdeedf82640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee815da90 con 0x7fdee806a440 2023-07-14T13:05:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.111+0000 7fdeedf82640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee815dd70 con 0x7fdee81453a0 2023-07-14T13:05:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.111+0000 7fdee77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee806a440 0x7fdee8154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.111+0000 7fdee7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdee815f690 0x7fdee81f3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.111+0000 7fdee7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdee815f690 0x7fdee81f3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50246/0 (socket says 172.21.15.5:50246) 2023-07-14T13:05:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.111+0000 7fdee7fff640 1 -- 172.21.15.5:0/2061486576 learned_addr learned my addr 172.21.15.5:0/2061486576 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.111+0000 7fdee6ffd640 1 --2- 172.21.15.5:0/2061486576 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee81453a0 0x7fdee815b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.111+0000 7fdee7fff640 1 -- 172.21.15.5:0/2061486576 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee81453a0 msgr2=0x7fdee815b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.111+0000 7fdee7fff640 1 --2- 172.21.15.5:0/2061486576 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee81453a0 0x7fdee815b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.111+0000 7fdee7fff640 1 -- 172.21.15.5:0/2061486576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee806a440 msgr2=0x7fdee8154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.111+0000 7fdee7fff640 1 --2- 172.21.15.5:0/2061486576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee806a440 0x7fdee8154c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.111+0000 7fdee7fff640 1 -- 172.21.15.5:0/2061486576 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee0009a70 con 0x7fdee815f690 2023-07-14T13:05:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.115+0000 7fdee7fff640 1 --2- 172.21.15.5:0/2061486576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdee815f690 0x7fdee81f3ed0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fdee001a4c0 tx=0x7fdee0019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.115+0000 7fdecffff640 1 -- 172.21.15.5:0/2061486576 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee00b9860 con 0x7fdee815f690 2023-07-14T13:05:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.115+0000 7fdecffff640 1 -- 172.21.15.5:0/2061486576 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee00b99c0 con 0x7fdee815f690 2023-07-14T13:05:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.115+0000 7fdecffff640 1 -- 172.21.15.5:0/2061486576 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee00b9d50 con 0x7fdee815f690 2023-07-14T13:05:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.115+0000 7fdeedf82640 1 -- 172.21.15.5:0/2061486576 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee815e050 con 0x7fdee815f690 2023-07-14T13:05:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.115+0000 7fdeedf82640 1 -- 172.21.15.5:0/2061486576 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee8155140 con 0x7fdee815f690 2023-07-14T13:05:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.115+0000 7fdeedf82640 1 -- 172.21.15.5:0/2061486576 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdee80678d0 con 0x7fdee815f690 2023-07-14T13:05:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.115+0000 7fdecffff640 1 -- 172.21.15.5:0/2061486576 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fdee00ad440 con 0x7fdee815f690 2023-07-14T13:05:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.115+0000 7fdecffff640 1 --2- 172.21.15.5:0/2061486576 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fded4066480 0x7fded4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.115+0000 7fdecffff640 1 -- 172.21.15.5:0/2061486576 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fdee011f6e0 con 0x7fdee815f690 2023-07-14T13:05:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.115+0000 7fdee77fe640 1 --2- 172.21.15.5:0/2061486576 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fded4066480 0x7fded4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.119+0000 7fdee77fe640 1 --2- 172.21.15.5:0/2061486576 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fded4066480 0x7fded4068930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fded8005890 tx=0x7fded8009040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.119+0000 7fdecffff640 1 -- 172.21.15.5:0/2061486576 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fdee00ec890 con 0x7fdee815f690 2023-07-14T13:05:22.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.299+0000 7fdeedf82640 1 -- 172.21.15.5:0/2061486576 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fdee806ad50 con 0x7fded4066480 2023-07-14T13:05:22.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.363+0000 7fdecffff640 1 -- 172.21.15.5:0/2061486576 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fdee806ad50 con 0x7fded4066480 2023-07-14T13:05:22.394 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule deactivated for path /snap_test_dir1/dir5 2023-07-14T13:05:22.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.367+0000 7fdeedf82640 1 -- 172.21.15.5:0/2061486576 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fded4066480 msgr2=0x7fded4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:22.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.367+0000 7fdeedf82640 1 --2- 172.21.15.5:0/2061486576 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fded4066480 0x7fded4068930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fded8005890 tx=0x7fded8009040 comp rx=0 tx=0).stop 2023-07-14T13:05:22.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.367+0000 7fdeedf82640 1 -- 172.21.15.5:0/2061486576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdee815f690 msgr2=0x7fdee81f3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:22.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.367+0000 7fdeedf82640 1 --2- 172.21.15.5:0/2061486576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdee815f690 0x7fdee81f3ed0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fdee001a4c0 tx=0x7fdee0019630 comp rx=0 tx=0).stop 2023-07-14T13:05:22.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.367+0000 7fdeedf82640 1 -- 172.21.15.5:0/2061486576 shutdown_connections 2023-07-14T13:05:22.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.367+0000 7fdeedf82640 1 --2- 172.21.15.5:0/2061486576 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fded4066480 0x7fded4068930 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:22.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.367+0000 7fdeedf82640 1 --2- 172.21.15.5:0/2061486576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdee815f690 0x7fdee81f3ed0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:22.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.367+0000 7fdeedf82640 1 --2- 172.21.15.5:0/2061486576 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee81453a0 0x7fdee815b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:22.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.367+0000 7fdeedf82640 1 --2- 172.21.15.5:0/2061486576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee806a440 0x7fdee8154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:22.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.367+0000 7fdeedf82640 1 -- 172.21.15.5:0/2061486576 >> 172.21.15.5:0/2061486576 conn(0x7fdee80b1210 msgr2=0x7fdee80b1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:22.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.367+0000 7fdeedf82640 1 -- 172.21.15.5:0/2061486576 shutdown_connections 2023-07-14T13:05:22.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.367+0000 7fdeedf82640 1 -- 172.21.15.5:0/2061486576 wait complete. 2023-07-14T13:05:22.415 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir5 2023-07-14T13:05:22.415 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir6 1M 2023-07-14T13:05:22.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.535+0000 7f6411ad8640 1 Processor -- start 2023-07-14T13:05:22.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.535+0000 7f6411ad8640 1 -- start start 2023-07-14T13:05:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.535+0000 7f6411ad8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f640c0aeb40 0x7f640c15cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.535+0000 7f6411ad8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f640c159440 0x7f640c0c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.535+0000 7f6411ad8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640c1532b0 con 0x7f640c0aef10 2023-07-14T13:05:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.535+0000 7f6411ad8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f640c0ca6f0 con 0x7f640c0aeb40 2023-07-14T13:05:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.535+0000 7f6411ad8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640c1599d0 con 0x7f640c159440 2023-07-14T13:05:22.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.535+0000 7f640affd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f640c0aef10 0x7f640c158d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49386/0 (socket says 172.21.15.5:49386) 2023-07-14T13:05:22.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.535+0000 7f640affd640 1 -- 172.21.15.5:0/4222417870 learned_addr learned my addr 172.21.15.5:0/4222417870 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:22.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.535+0000 7f640bfff640 1 --2- 172.21.15.5:0/4222417870 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f640c159440 0x7f640c0c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:22.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.535+0000 7f640b7fe640 1 --2- 172.21.15.5:0/4222417870 >> v2:172.21.15.154:3300/0 conn(0x7f640c0aeb40 0x7f640c15cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:22.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.535+0000 7f640a7fc640 1 -- 172.21.15.5:0/4222417870 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2926291580 0 0) 0x7f640c1532b0 con 0x7f640c0aef10 2023-07-14T13:05:22.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.535+0000 7f640a7fc640 1 -- 172.21.15.5:0/4222417870 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63f4003530 con 0x7f640c0aef10 2023-07-14T13:05:22.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.535+0000 7f640bfff640 1 -- 172.21.15.5:0/4222417870 >> v2:172.21.15.154:3300/0 conn(0x7f640c0aeb40 msgr2=0x7f640c15cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:22.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.535+0000 7f640a7fc640 1 -- 172.21.15.5:0/4222417870 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2563381700 0 0) 0x7f63f4003530 con 0x7f640c0aef10 2023-07-14T13:05:22.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.535+0000 7f640bfff640 1 --2- 172.21.15.5:0/4222417870 >> v2:172.21.15.154:3300/0 conn(0x7f640c0aeb40 0x7f640c15cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:22.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.535+0000 7f640bfff640 1 -- 172.21.15.5:0/4222417870 >> v1:172.21.15.5:6789/0 conn(0x7f640c0aef10 legacy=0x7f640c158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:22.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.535+0000 7f640bfff640 1 -- 172.21.15.5:0/4222417870 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640c159cb0 con 0x7f640c159440 2023-07-14T13:05:22.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.535+0000 7f640b7fe640 1 --2- 172.21.15.5:0/4222417870 >> v2:172.21.15.154:3300/0 conn(0x7f640c0aeb40 0x7f640c15cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:22.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.539+0000 7f640bfff640 1 --2- 172.21.15.5:0/4222417870 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f640c159440 0x7f640c0c88c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6404009d90 tx=0x7f640401c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff62c0b95b2efd9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:22.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.539+0000 7f640a7fc640 1 -- 172.21.15.5:0/4222417870 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6400001680 con 0x7f640c159440 2023-07-14T13:05:22.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.539+0000 7f640a7fc640 1 -- 172.21.15.5:0/4222417870 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64040a55b0 con 0x7f640c159440 2023-07-14T13:05:22.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.539+0000 7f640a7fc640 1 -- 172.21.15.5:0/4222417870 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64040a5920 con 0x7f640c159440 2023-07-14T13:05:22.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.539+0000 7f6411ad8640 1 -- 172.21.15.5:0/4222417870 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f640c159440 msgr2=0x7f640c0c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:22.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.539+0000 7f6411ad8640 1 --2- 172.21.15.5:0/4222417870 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f640c159440 0x7f640c0c88c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6404009d90 tx=0x7f640401c7b0 comp rx=0 tx=0).stop 2023-07-14T13:05:22.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.539+0000 7f6411ad8640 1 -- 172.21.15.5:0/4222417870 shutdown_connections 2023-07-14T13:05:22.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.539+0000 7f6411ad8640 1 --2- 172.21.15.5:0/4222417870 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f640c159440 0x7f640c0c88c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:22.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.539+0000 7f6411ad8640 1 --2- 172.21.15.5:0/4222417870 >> v2:172.21.15.154:3300/0 conn(0x7f640c0aeb40 0x7f640c15cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:22.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.539+0000 7f6411ad8640 1 -- 172.21.15.5:0/4222417870 >> 172.21.15.5:0/4222417870 conn(0x7f640c0cde90 msgr2=0x7f640c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:22.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.539+0000 7f6411ad8640 1 -- 172.21.15.5:0/4222417870 shutdown_connections 2023-07-14T13:05:22.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.539+0000 7f6411ad8640 1 -- 172.21.15.5:0/4222417870 wait complete. 2023-07-14T13:05:22.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.543+0000 7f6411ad8640 1 Processor -- start 2023-07-14T13:05:22.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.543+0000 7f6411ad8640 1 -- start start 2023-07-14T13:05:22.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.543+0000 7f6411ad8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640c0aeb40 0x7f640c1f3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:22.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.543+0000 7f6411ad8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f640c0aef10 0x7f640c15af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:22.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.543+0000 7f6411ad8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f640c159440 0x7f640c15b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:22.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.543+0000 7f6411ad8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640c070380 con 0x7f640c159440 2023-07-14T13:05:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.543+0000 7f6411ad8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640c1f4370 con 0x7f640c0aeb40 2023-07-14T13:05:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.543+0000 7f6411ad8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640c0705d0 con 0x7f640c0aef10 2023-07-14T13:05:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.543+0000 7f640bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f640c159440 0x7f640c15b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.543+0000 7f640bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f640c159440 0x7f640c15b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50258/0 (socket says 172.21.15.5:50258) 2023-07-14T13:05:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.543+0000 7f640bfff640 1 -- 172.21.15.5:0/3944068386 learned_addr learned my addr 172.21.15.5:0/3944068386 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.543+0000 7f640b7fe640 1 --2- 172.21.15.5:0/3944068386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640c0aeb40 0x7f640c1f3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.543+0000 7f640affd640 1 --2- 172.21.15.5:0/3944068386 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f640c0aef10 0x7f640c15af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.543+0000 7f640bfff640 1 -- 172.21.15.5:0/3944068386 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f640c0aef10 msgr2=0x7f640c15af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:22.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.543+0000 7f640bfff640 1 --2- 172.21.15.5:0/3944068386 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f640c0aef10 0x7f640c15af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:22.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.543+0000 7f640bfff640 1 -- 172.21.15.5:0/3944068386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640c0aeb40 msgr2=0x7f640c1f3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:22.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.543+0000 7f640bfff640 1 --2- 172.21.15.5:0/3944068386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640c0aeb40 0x7f640c1f3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:22.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.543+0000 7f640bfff640 1 -- 172.21.15.5:0/3944068386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63fc009420 con 0x7f640c159440 2023-07-14T13:05:22.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.543+0000 7f640b7fe640 1 --2- 172.21.15.5:0/3944068386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640c0aeb40 0x7f640c1f3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:05:22.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.543+0000 7f640bfff640 1 --2- 172.21.15.5:0/3944068386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f640c159440 0x7f640c15b4b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f640401ae60 tx=0x7f6404019550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:22.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.543+0000 7f63f3fff640 1 -- 172.21.15.5:0/3944068386 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6404007000 con 0x7f640c159440 2023-07-14T13:05:22.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.543+0000 7f63f3fff640 1 -- 172.21.15.5:0/3944068386 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6404009450 con 0x7f640c159440 2023-07-14T13:05:22.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.543+0000 7f6411ad8640 1 -- 172.21.15.5:0/3944068386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6404009a70 con 0x7f640c159440 2023-07-14T13:05:22.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.543+0000 7f63f3fff640 1 -- 172.21.15.5:0/3944068386 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64040ad870 con 0x7f640c159440 2023-07-14T13:05:22.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.543+0000 7f6411ad8640 1 -- 172.21.15.5:0/3944068386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f640c070b90 con 0x7f640c159440 2023-07-14T13:05:22.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.547+0000 7f6411ad8640 1 -- 172.21.15.5:0/3944068386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f640c0af340 con 0x7f640c159440 2023-07-14T13:05:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.547+0000 7f63f3fff640 1 -- 172.21.15.5:0/3944068386 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f64040b4070 con 0x7f640c159440 2023-07-14T13:05:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.547+0000 7f63f3fff640 1 --2- 172.21.15.5:0/3944068386 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f63f80664b0 0x7f63f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.547+0000 7f63f3fff640 1 -- 172.21.15.5:0/3944068386 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f640411eed0 con 0x7f640c159440 2023-07-14T13:05:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.547+0000 7f640b7fe640 1 --2- 172.21.15.5:0/3944068386 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f63f80664b0 0x7f63f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.547+0000 7f640b7fe640 1 --2- 172.21.15.5:0/3944068386 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f63f80664b0 0x7f63f8068960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f63fc009d40 tx=0x7f63fc008040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:22.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.551+0000 7f63f3fff640 1 -- 172.21.15.5:0/3944068386 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f64040ebf10 con 0x7f640c159440 2023-07-14T13:05:22.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.727+0000 7f6411ad8640 1 -- 172.21.15.5:0/3944068386 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f640c15c9d0 con 0x7f63f80664b0 2023-07-14T13:05:22.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.791+0000 7f63f3fff640 1 -- 172.21.15.5:0/3944068386 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f63fc009990 con 0x7f63f80664b0 2023-07-14T13:05:22.821 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule deactivated for path /snap_test_dir1/dir6 2023-07-14T13:05:22.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.791+0000 7f6411ad8640 1 -- 172.21.15.5:0/3944068386 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f63f80664b0 msgr2=0x7f63f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:22.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.791+0000 7f6411ad8640 1 --2- 172.21.15.5:0/3944068386 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f63f80664b0 0x7f63f8068960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f63fc009d40 tx=0x7f63fc008040 comp rx=0 tx=0).stop 2023-07-14T13:05:22.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.791+0000 7f6411ad8640 1 -- 172.21.15.5:0/3944068386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f640c159440 msgr2=0x7f640c15b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:22.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.791+0000 7f6411ad8640 1 --2- 172.21.15.5:0/3944068386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f640c159440 0x7f640c15b4b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f640401ae60 tx=0x7f6404019550 comp rx=0 tx=0).stop 2023-07-14T13:05:22.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.791+0000 7f6411ad8640 1 -- 172.21.15.5:0/3944068386 shutdown_connections 2023-07-14T13:05:22.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.791+0000 7f6411ad8640 1 --2- 172.21.15.5:0/3944068386 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f63f80664b0 0x7f63f8068960 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:22.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.791+0000 7f6411ad8640 1 --2- 172.21.15.5:0/3944068386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f640c159440 0x7f640c15b4b0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:22.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.791+0000 7f6411ad8640 1 --2- 172.21.15.5:0/3944068386 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f640c0aef10 0x7f640c15af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:22.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.791+0000 7f6411ad8640 1 --2- 172.21.15.5:0/3944068386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640c0aeb40 0x7f640c1f3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:22.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.791+0000 7f6411ad8640 1 -- 172.21.15.5:0/3944068386 >> 172.21.15.5:0/3944068386 conn(0x7f640c0cde90 msgr2=0x7f640c152810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:22.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.791+0000 7f6411ad8640 1 -- 172.21.15.5:0/3944068386 shutdown_connections 2023-07-14T13:05:22.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.791+0000 7f6411ad8640 1 -- 172.21.15.5:0/3944068386 wait complete. 2023-07-14T13:05:22.841 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir6 2023-07-14T13:05:22.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir7 1M 2023-07-14T13:05:22.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.963+0000 7fb249096640 1 Processor -- start 2023-07-14T13:05:22.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.963+0000 7fb249096640 1 -- start start 2023-07-14T13:05:22.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.963+0000 7fb249096640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb2441453a0 0x7fb2440b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:22.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.963+0000 7fb249096640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb24406c040 con 0x7fb24415f690 2023-07-14T13:05:22.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.963+0000 7fb249096640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb244160600 con 0x7fb24406a440 2023-07-14T13:05:22.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.963+0000 7fb249096640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb244160170 con 0x7fb2441453a0 2023-07-14T13:05:22.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.963+0000 7fb242d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb24415f690 0x7fb24415fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49388/0 (socket says 172.21.15.5:49388) 2023-07-14T13:05:22.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.963+0000 7fb242d9d640 1 -- 172.21.15.5:0/1664443058 learned_addr learned my addr 172.21.15.5:0/1664443058 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:22.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.963+0000 7fb24359e640 1 --2- 172.21.15.5:0/1664443058 >> v2:172.21.15.5:3300/0 conn(0x7fb2441453a0 0x7fb2440b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:22.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.963+0000 7fb24359e640 1 -- 172.21.15.5:0/1664443058 >> v1:172.21.15.154:6789/0 conn(0x7fb24406a440 legacy=0x7fb24406c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:22.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.963+0000 7fb24359e640 1 -- 172.21.15.5:0/1664443058 >> v1:172.21.15.5:6789/0 conn(0x7fb24415f690 legacy=0x7fb24415fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:22.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.963+0000 7fb24359e640 1 -- 172.21.15.5:0/1664443058 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb244160360 con 0x7fb2441453a0 2023-07-14T13:05:22.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.963+0000 7fb241d9b640 1 -- 172.21.15.5:0/1664443058 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3118964669 0 0) 0x7fb244160600 con 0x7fb24406a440 2023-07-14T13:05:22.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.967+0000 7fb24359e640 1 --2- 172.21.15.5:0/1664443058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2441453a0 0x7fb2440b1890 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009d90 tx=0x7fb23c01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574268313484d2ea server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:22.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.967+0000 7fb241d9b640 1 -- 172.21.15.5:0/1664443058 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c0a5950 con 0x7fb2441453a0 2023-07-14T13:05:22.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.967+0000 7fb241d9b640 1 -- 172.21.15.5:0/1664443058 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23c0a5ab0 con 0x7fb2441453a0 2023-07-14T13:05:22.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.967+0000 7fb241d9b640 1 -- 172.21.15.5:0/1664443058 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c0a5e40 con 0x7fb2441453a0 2023-07-14T13:05:22.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.967+0000 7fb249096640 1 -- 172.21.15.5:0/1664443058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2441453a0 msgr2=0x7fb2440b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:22.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.967+0000 7fb249096640 1 --2- 172.21.15.5:0/1664443058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2441453a0 0x7fb2440b1890 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009d90 tx=0x7fb23c01c890 comp rx=0 tx=0).stop 2023-07-14T13:05:22.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.967+0000 7fb249096640 1 -- 172.21.15.5:0/1664443058 shutdown_connections 2023-07-14T13:05:22.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.967+0000 7fb249096640 1 --2- 172.21.15.5:0/1664443058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2441453a0 0x7fb2440b1890 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:22.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.967+0000 7fb249096640 1 -- 172.21.15.5:0/1664443058 >> 172.21.15.5:0/1664443058 conn(0x7fb2440b1210 msgr2=0x7fb2440ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:22.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.967+0000 7fb249096640 1 -- 172.21.15.5:0/1664443058 shutdown_connections 2023-07-14T13:05:23.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.967+0000 7fb249096640 1 -- 172.21.15.5:0/1664443058 wait complete. 2023-07-14T13:05:23.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.971+0000 7fb249096640 1 Processor -- start 2023-07-14T13:05:23.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.971+0000 7fb249096640 1 -- start start 2023-07-14T13:05:23.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.971+0000 7fb249096640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb24406a440 0x7fb24415c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:23.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.971+0000 7fb249096640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2441453a0 0x7fb244143330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:23.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.971+0000 7fb249096640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb24415f690 0x7fb24413b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:23.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.971+0000 7fb249096640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24415b680 con 0x7fb2441453a0 2023-07-14T13:05:23.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.971+0000 7fb249096640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb244143870 con 0x7fb24415f690 2023-07-14T13:05:23.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.971+0000 7fb249096640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb244160960 con 0x7fb24406a440 2023-07-14T13:05:23.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.971+0000 7fb24259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2441453a0 0x7fb244143330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:23.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.971+0000 7fb24259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2441453a0 0x7fb244143330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50276/0 (socket says 172.21.15.5:50276) 2023-07-14T13:05:23.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.971+0000 7fb24259c640 1 -- 172.21.15.5:0/2920086111 learned_addr learned my addr 172.21.15.5:0/2920086111 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:23.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.971+0000 7fb24359e640 1 --2- 172.21.15.5:0/2920086111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb24415f690 0x7fb24413b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:23.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.971+0000 7fb242d9d640 1 --2- 172.21.15.5:0/2920086111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb24406a440 0x7fb24415c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:23.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.971+0000 7fb24259c640 1 -- 172.21.15.5:0/2920086111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb24406a440 msgr2=0x7fb24415c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:23.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.971+0000 7fb24259c640 1 --2- 172.21.15.5:0/2920086111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb24406a440 0x7fb24415c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:23.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.971+0000 7fb24259c640 1 -- 172.21.15.5:0/2920086111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb24415f690 msgr2=0x7fb24413b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:23.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.971+0000 7fb24259c640 1 --2- 172.21.15.5:0/2920086111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb24415f690 0x7fb24413b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:23.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.971+0000 7fb24259c640 1 -- 172.21.15.5:0/2920086111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c009a70 con 0x7fb2441453a0 2023-07-14T13:05:23.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.971+0000 7fb242d9d640 1 --2- 172.21.15.5:0/2920086111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb24406a440 0x7fb24415c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:05:23.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.971+0000 7fb24259c640 1 --2- 172.21.15.5:0/2920086111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2441453a0 0x7fb244143330 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb238001ec0 tx=0x7fb23800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:23.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.971+0000 7fb22b7fe640 1 -- 172.21.15.5:0/2920086111 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2380054e0 con 0x7fb2441453a0 2023-07-14T13:05:23.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.971+0000 7fb22b7fe640 1 -- 172.21.15.5:0/2920086111 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb238003600 con 0x7fb2441453a0 2023-07-14T13:05:23.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.971+0000 7fb22b7fe640 1 -- 172.21.15.5:0/2920086111 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2380039b0 con 0x7fb2441453a0 2023-07-14T13:05:23.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.971+0000 7fb249096640 1 -- 172.21.15.5:0/2920086111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb24413b9d0 con 0x7fb2441453a0 2023-07-14T13:05:23.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.971+0000 7fb249096640 1 -- 172.21.15.5:0/2920086111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb24415ca50 con 0x7fb2441453a0 2023-07-14T13:05:23.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.975+0000 7fb249096640 1 -- 172.21.15.5:0/2920086111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2440678d0 con 0x7fb2441453a0 2023-07-14T13:05:23.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.975+0000 7fb22b7fe640 1 -- 172.21.15.5:0/2920086111 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fb238003b10 con 0x7fb2441453a0 2023-07-14T13:05:23.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.975+0000 7fb22b7fe640 1 --2- 172.21.15.5:0/2920086111 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fb230066480 0x7fb230068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:23.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.975+0000 7fb22b7fe640 1 -- 172.21.15.5:0/2920086111 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fb238083870 con 0x7fb2441453a0 2023-07-14T13:05:23.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.975+0000 7fb242d9d640 1 --2- 172.21.15.5:0/2920086111 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fb230066480 0x7fb230068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:23.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.975+0000 7fb242d9d640 1 --2- 172.21.15.5:0/2920086111 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fb230066480 0x7fb230068930 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb234000f70 tx=0x7fb234009040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:23.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:22.979+0000 7fb22b7fe640 1 -- 172.21.15.5:0/2920086111 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb2380508d0 con 0x7fb2441453a0 2023-07-14T13:05:23.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.155+0000 7fb249096640 1 -- 172.21.15.5:0/2920086111 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb24406ad80 con 0x7fb230066480 2023-07-14T13:05:23.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.219+0000 7fb22b7fe640 1 -- 172.21.15.5:0/2920086111 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fb234001390 con 0x7fb230066480 2023-07-14T13:05:23.249 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule deactivated for path /snap_test_dir1/dir7 2023-07-14T13:05:23.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.219+0000 7fb249096640 1 -- 172.21.15.5:0/2920086111 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fb230066480 msgr2=0x7fb230068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:23.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.219+0000 7fb249096640 1 --2- 172.21.15.5:0/2920086111 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fb230066480 0x7fb230068930 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb234000f70 tx=0x7fb234009040 comp rx=0 tx=0).stop 2023-07-14T13:05:23.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.219+0000 7fb249096640 1 -- 172.21.15.5:0/2920086111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2441453a0 msgr2=0x7fb244143330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:23.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.219+0000 7fb249096640 1 --2- 172.21.15.5:0/2920086111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2441453a0 0x7fb244143330 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb238001ec0 tx=0x7fb23800c8e0 comp rx=0 tx=0).stop 2023-07-14T13:05:23.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.219+0000 7fb249096640 1 -- 172.21.15.5:0/2920086111 shutdown_connections 2023-07-14T13:05:23.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.219+0000 7fb249096640 1 --2- 172.21.15.5:0/2920086111 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fb230066480 0x7fb230068930 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:23.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.219+0000 7fb249096640 1 --2- 172.21.15.5:0/2920086111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb24415f690 0x7fb24413b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:23.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.219+0000 7fb249096640 1 --2- 172.21.15.5:0/2920086111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2441453a0 0x7fb244143330 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:23.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.219+0000 7fb249096640 1 --2- 172.21.15.5:0/2920086111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb24406a440 0x7fb24415c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:23.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.219+0000 7fb249096640 1 -- 172.21.15.5:0/2920086111 >> 172.21.15.5:0/2920086111 conn(0x7fb2440b1210 msgr2=0x7fb24406fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:23.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.219+0000 7fb249096640 1 -- 172.21.15.5:0/2920086111 shutdown_connections 2023-07-14T13:05:23.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.219+0000 7fb249096640 1 -- 172.21.15.5:0/2920086111 wait complete. 2023-07-14T13:05:23.270 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir7 2023-07-14T13:05:23.270 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir8 1M 2023-07-14T13:05:23.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.391+0000 7f82e8700640 1 Processor -- start 2023-07-14T13:05:23.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.391+0000 7f82e8700640 1 -- start start 2023-07-14T13:05:23.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.391+0000 7f82e8700640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f82e015cef0 0x7f82e0158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:23.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.391+0000 7f82e8700640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e01532b0 con 0x7f82e00aeb40 2023-07-14T13:05:23.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.391+0000 7f82e8700640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e00ca6f0 con 0x7f82e0159270 2023-07-14T13:05:23.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.391+0000 7f82e8700640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e015d360 con 0x7f82e015cef0 2023-07-14T13:05:23.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.391+0000 7f82e649c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f82e00aeb40 0x7f82e00aef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49394/0 (socket says 172.21.15.5:49394) 2023-07-14T13:05:23.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.391+0000 7f82e649c640 1 -- 172.21.15.5:0/2263548496 learned_addr learned my addr 172.21.15.5:0/2263548496 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:23.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.391+0000 7f82e5c9b640 1 --2- 172.21.15.5:0/2263548496 >> v2:172.21.15.154:3300/0 conn(0x7f82e015cef0 0x7f82e0158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:23.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.391+0000 7f82e549a640 1 -- 172.21.15.5:0/2263548496 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 179736300 0 0) 0x7f82e01532b0 con 0x7f82e00aeb40 2023-07-14T13:05:23.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.391+0000 7f82e549a640 1 -- 172.21.15.5:0/2263548496 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82cc005740 con 0x7f82e00aeb40 2023-07-14T13:05:23.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.391+0000 7f82e549a640 1 -- 172.21.15.5:0/2263548496 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2665787091 0 0) 0x7f82e00ca6f0 con 0x7f82e0159270 2023-07-14T13:05:23.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.391+0000 7f82e549a640 1 -- 172.21.15.5:0/2263548496 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82e01532b0 con 0x7f82e0159270 2023-07-14T13:05:23.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.391+0000 7f82e549a640 1 -- 172.21.15.5:0/2263548496 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3678998641 0 0) 0x7f82cc005740 con 0x7f82e00aeb40 2023-07-14T13:05:23.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.391+0000 7f82e5c9b640 1 -- 172.21.15.5:0/2263548496 >> v1:172.21.15.154:6789/0 conn(0x7f82e0159270 legacy=0x7f82e00c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:23.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.391+0000 7f82e5c9b640 1 -- 172.21.15.5:0/2263548496 >> v1:172.21.15.5:6789/0 conn(0x7f82e00aeb40 legacy=0x7f82e00aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:23.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.391+0000 7f82e5c9b640 1 -- 172.21.15.5:0/2263548496 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e01599d0 con 0x7f82e015cef0 2023-07-14T13:05:23.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.395+0000 7f82e5c9b640 1 --2- 172.21.15.5:0/2263548496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82e015cef0 0x7f82e0158d30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f82d00097c0 tx=0x7f82d001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4feeac8a3d49d67a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:23.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.395+0000 7f82e549a640 1 -- 172.21.15.5:0/2263548496 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc001680 con 0x7f82e015cef0 2023-07-14T13:05:23.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.395+0000 7f82e549a640 1 -- 172.21.15.5:0/2263548496 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d00a7050 con 0x7f82e015cef0 2023-07-14T13:05:23.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.395+0000 7f82e549a640 1 -- 172.21.15.5:0/2263548496 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d00ab620 con 0x7f82e015cef0 2023-07-14T13:05:23.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.395+0000 7f82e8700640 1 -- 172.21.15.5:0/2263548496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82e015cef0 msgr2=0x7f82e0158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:23.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.395+0000 7f82e8700640 1 --2- 172.21.15.5:0/2263548496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82e015cef0 0x7f82e0158d30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f82d00097c0 tx=0x7f82d001c370 comp rx=0 tx=0).stop 2023-07-14T13:05:23.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.395+0000 7f82e8700640 1 -- 172.21.15.5:0/2263548496 shutdown_connections 2023-07-14T13:05:23.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.395+0000 7f82e8700640 1 --2- 172.21.15.5:0/2263548496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82e015cef0 0x7f82e0158d30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:23.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.395+0000 7f82e8700640 1 -- 172.21.15.5:0/2263548496 >> 172.21.15.5:0/2263548496 conn(0x7f82e00cde90 msgr2=0x7f82e00ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:23.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.395+0000 7f82e8700640 1 -- 172.21.15.5:0/2263548496 shutdown_connections 2023-07-14T13:05:23.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.395+0000 7f82e8700640 1 -- 172.21.15.5:0/2263548496 wait complete. 2023-07-14T13:05:23.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.399+0000 7f82e8700640 1 Processor -- start 2023-07-14T13:05:23.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.399+0000 7f82e8700640 1 -- start start 2023-07-14T13:05:23.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.399+0000 7f82e8700640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82e00aeb40 0x7f82e0144130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:23.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.399+0000 7f82e8700640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82e0159270 0x7f82e00c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:23.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.399+0000 7f82e8700640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82e015cef0 0x7f82e006f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:23.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.399+0000 7f82e8700640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e006c460 con 0x7f82e0159270 2023-07-14T13:05:23.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.399+0000 7f82e8700640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e0157b10 con 0x7f82e00aeb40 2023-07-14T13:05:23.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.399+0000 7f82e8700640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e006be10 con 0x7f82e015cef0 2023-07-14T13:05:23.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.399+0000 7f82e5c9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82e0159270 0x7f82e00c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:23.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.399+0000 7f82e5c9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82e0159270 0x7f82e00c3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50280/0 (socket says 172.21.15.5:50280) 2023-07-14T13:05:23.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.399+0000 7f82e5c9b640 1 -- 172.21.15.5:0/2293748031 learned_addr learned my addr 172.21.15.5:0/2293748031 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:23.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.399+0000 7f82e649c640 1 --2- 172.21.15.5:0/2293748031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82e00aeb40 0x7f82e0144130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:23.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.399+0000 7f82e6c9d640 1 --2- 172.21.15.5:0/2293748031 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82e015cef0 0x7f82e006f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:23.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.399+0000 7f82e5c9b640 1 -- 172.21.15.5:0/2293748031 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82e015cef0 msgr2=0x7f82e006f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:23.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.399+0000 7f82e5c9b640 1 --2- 172.21.15.5:0/2293748031 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82e015cef0 0x7f82e006f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:23.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.399+0000 7f82e5c9b640 1 -- 172.21.15.5:0/2293748031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82e00aeb40 msgr2=0x7f82e0144130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:23.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.399+0000 7f82e5c9b640 1 --2- 172.21.15.5:0/2293748031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82e00aeb40 0x7f82e0144130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:23.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.399+0000 7f82e5c9b640 1 -- 172.21.15.5:0/2293748031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d0009420 con 0x7f82e0159270 2023-07-14T13:05:23.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.399+0000 7f82e5c9b640 1 --2- 172.21.15.5:0/2293748031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82e0159270 0x7f82e00c3360 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f82d00ae040 tx=0x7f82d0019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:23.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.399+0000 7f82d6ffd640 1 -- 172.21.15.5:0/2293748031 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d00abe70 con 0x7f82e0159270 2023-07-14T13:05:23.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.399+0000 7f82d6ffd640 1 -- 172.21.15.5:0/2293748031 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d0004020 con 0x7f82e0159270 2023-07-14T13:05:23.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.399+0000 7f82d6ffd640 1 -- 172.21.15.5:0/2293748031 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d0004390 con 0x7f82e0159270 2023-07-14T13:05:23.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.399+0000 7f82e8700640 1 -- 172.21.15.5:0/2293748031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e006c0f0 con 0x7f82e0159270 2023-07-14T13:05:23.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.399+0000 7f82e8700640 1 -- 172.21.15.5:0/2293748031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e01586e0 con 0x7f82e0159270 2023-07-14T13:05:23.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.403+0000 7f82e8700640 1 -- 172.21.15.5:0/2293748031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e006bc70 con 0x7f82e0159270 2023-07-14T13:05:23.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.403+0000 7f82d6ffd640 1 -- 172.21.15.5:0/2293748031 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f82d00b2040 con 0x7f82e0159270 2023-07-14T13:05:23.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.403+0000 7f82d6ffd640 1 --2- 172.21.15.5:0/2293748031 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f82c40664b0 0x7f82c4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:23.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.403+0000 7f82d6ffd640 1 -- 172.21.15.5:0/2293748031 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f82d011d060 con 0x7f82e0159270 2023-07-14T13:05:23.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.403+0000 7f82e649c640 1 --2- 172.21.15.5:0/2293748031 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f82c40664b0 0x7f82c4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:23.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.403+0000 7f82e649c640 1 --2- 172.21.15.5:0/2293748031 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f82c40664b0 0x7f82c4068960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f82dc000f70 tx=0x7f82dc0016c0 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:23.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.407+0000 7f82d6ffd640 1 -- 172.21.15.5:0/2293748031 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f82e006bc70 con 0x7f82e0159270 2023-07-14T13:05:23.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.583+0000 7f82e8700640 1 -- 172.21.15.5:0/2293748031 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f82e015c9d0 con 0x7f82c40664b0 2023-07-14T13:05:23.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.647+0000 7f82d6ffd640 1 -- 172.21.15.5:0/2293748031 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f82dc00fa90 con 0x7f82c40664b0 2023-07-14T13:05:23.677 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule deactivated for path /snap_test_dir1/dir8 2023-07-14T13:05:23.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.647+0000 7f82e8700640 1 -- 172.21.15.5:0/2293748031 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f82c40664b0 msgr2=0x7f82c4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:23.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.647+0000 7f82e8700640 1 --2- 172.21.15.5:0/2293748031 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f82c40664b0 0x7f82c4068960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f82dc000f70 tx=0x7f82dc0016c0 comp rx=0 tx=0).stop 2023-07-14T13:05:23.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.647+0000 7f82e8700640 1 -- 172.21.15.5:0/2293748031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82e0159270 msgr2=0x7f82e00c3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:23.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.647+0000 7f82e8700640 1 --2- 172.21.15.5:0/2293748031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82e0159270 0x7f82e00c3360 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f82d00ae040 tx=0x7f82d0019110 comp rx=0 tx=0).stop 2023-07-14T13:05:23.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.647+0000 7f82e8700640 1 -- 172.21.15.5:0/2293748031 shutdown_connections 2023-07-14T13:05:23.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.647+0000 7f82e8700640 1 --2- 172.21.15.5:0/2293748031 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f82c40664b0 0x7f82c4068960 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:23.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.647+0000 7f82e8700640 1 --2- 172.21.15.5:0/2293748031 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82e015cef0 0x7f82e006f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:23.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.647+0000 7f82e8700640 1 --2- 172.21.15.5:0/2293748031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82e0159270 0x7f82e00c3360 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:23.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.647+0000 7f82e8700640 1 --2- 172.21.15.5:0/2293748031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82e00aeb40 0x7f82e0144130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:23.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.647+0000 7f82e8700640 1 -- 172.21.15.5:0/2293748031 >> 172.21.15.5:0/2293748031 conn(0x7f82e00cde90 msgr2=0x7f82e00ae360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:23.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.647+0000 7f82e8700640 1 -- 172.21.15.5:0/2293748031 shutdown_connections 2023-07-14T13:05:23.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.647+0000 7f82e8700640 1 -- 172.21.15.5:0/2293748031 wait complete. 2023-07-14T13:05:23.697 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir8 2023-07-14T13:05:23.697 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir9 1M 2023-07-14T13:05:23.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.815+0000 7fcb66dd2640 1 Processor -- start 2023-07-14T13:05:23.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.815+0000 7fcb66dd2640 1 -- start start 2023-07-14T13:05:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.819+0000 7fcb66dd2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb600aeb40 0x7fcb6015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.819+0000 7fcb66dd2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcb60159440 0x7fcb600c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.819+0000 7fcb66dd2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb601532b0 con 0x7fcb600aef10 2023-07-14T13:05:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.819+0000 7fcb66dd2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb600ca6f0 con 0x7fcb60159440 2023-07-14T13:05:23.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.819+0000 7fcb66dd2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb601599d0 con 0x7fcb600aeb40 2023-07-14T13:05:23.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.819+0000 7fcb6536f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcb60159440 0x7fcb600c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:23.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.819+0000 7fcb6536f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcb60159440 0x7fcb600c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50282/0 (socket says 172.21.15.5:50282) 2023-07-14T13:05:23.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.819+0000 7fcb6536f640 1 -- 172.21.15.5:0/1236789523 learned_addr learned my addr 172.21.15.5:0/1236789523 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:23.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.819+0000 7fcb64b6e640 1 --2- 172.21.15.5:0/1236789523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb600aeb40 0x7fcb6015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:23.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.819+0000 7fcb6536f640 1 -- 172.21.15.5:0/1236789523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb600aeb40 msgr2=0x7fcb6015cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:23.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.819+0000 7fcb6536f640 1 --2- 172.21.15.5:0/1236789523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb600aeb40 0x7fcb6015cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:23.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.819+0000 7fcb6536f640 1 -- 172.21.15.5:0/1236789523 >> v1:172.21.15.154:6789/0 conn(0x7fcb600aef10 legacy=0x7fcb60158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:23.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.819+0000 7fcb6536f640 1 -- 172.21.15.5:0/1236789523 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb60159cb0 con 0x7fcb60159440 2023-07-14T13:05:23.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.819+0000 7fcb5f7fe640 1 -- 172.21.15.5:0/1236789523 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3669555422 0 0) 0x7fcb601532b0 con 0x7fcb600aef10 2023-07-14T13:05:23.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.823+0000 7fcb6536f640 1 --2- 172.21.15.5:0/1236789523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb60159440 0x7fcb600c88c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fcb58009e50 tx=0x7fcb5801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d11e067ed00651f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:23.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.823+0000 7fcb5f7fe640 1 -- 172.21.15.5:0/1236789523 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb580a5810 con 0x7fcb60159440 2023-07-14T13:05:23.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.823+0000 7fcb5f7fe640 1 -- 172.21.15.5:0/1236789523 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb580a5970 con 0x7fcb60159440 2023-07-14T13:05:23.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.823+0000 7fcb5f7fe640 1 -- 172.21.15.5:0/1236789523 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb580a5d00 con 0x7fcb60159440 2023-07-14T13:05:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.823+0000 7fcb66dd2640 1 -- 172.21.15.5:0/1236789523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb60159440 msgr2=0x7fcb600c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.823+0000 7fcb66dd2640 1 --2- 172.21.15.5:0/1236789523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb60159440 0x7fcb600c88c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fcb58009e50 tx=0x7fcb5801c950 comp rx=0 tx=0).stop 2023-07-14T13:05:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.823+0000 7fcb66dd2640 1 -- 172.21.15.5:0/1236789523 shutdown_connections 2023-07-14T13:05:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.823+0000 7fcb66dd2640 1 --2- 172.21.15.5:0/1236789523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb60159440 0x7fcb600c88c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:23.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.823+0000 7fcb66dd2640 1 --2- 172.21.15.5:0/1236789523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb600aeb40 0x7fcb6015cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:23.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.823+0000 7fcb66dd2640 1 -- 172.21.15.5:0/1236789523 >> 172.21.15.5:0/1236789523 conn(0x7fcb600cde90 msgr2=0x7fcb600ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:23.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.823+0000 7fcb66dd2640 1 -- 172.21.15.5:0/1236789523 shutdown_connections 2023-07-14T13:05:23.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.823+0000 7fcb66dd2640 1 -- 172.21.15.5:0/1236789523 wait complete. 2023-07-14T13:05:23.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.823+0000 7fcb66dd2640 1 Processor -- start 2023-07-14T13:05:23.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.823+0000 7fcb66dd2640 1 -- start start 2023-07-14T13:05:23.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.827+0000 7fcb66dd2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb600aeb40 0x7fcb60155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:23.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.827+0000 7fcb66dd2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb600aef10 0x7fcb601556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:23.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.827+0000 7fcb66dd2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb60159440 0x7fcb6014efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:23.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.827+0000 7fcb66dd2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb60155c10 con 0x7fcb600aef10 2023-07-14T13:05:23.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.827+0000 7fcb66dd2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6006f060 con 0x7fcb60159440 2023-07-14T13:05:23.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.827+0000 7fcb66dd2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb60155e10 con 0x7fcb600aeb40 2023-07-14T13:05:23.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.827+0000 7fcb5ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb600aef10 0x7fcb601556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:23.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.827+0000 7fcb5ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb600aef10 0x7fcb601556d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50284/0 (socket says 172.21.15.5:50284) 2023-07-14T13:05:23.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.827+0000 7fcb5ffff640 1 -- 172.21.15.5:0/3082459265 learned_addr learned my addr 172.21.15.5:0/3082459265 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:23.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.827+0000 7fcb64b6e640 1 --2- 172.21.15.5:0/3082459265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb600aeb40 0x7fcb60155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:23.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.827+0000 7fcb6536f640 1 --2- 172.21.15.5:0/3082459265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb60159440 0x7fcb6014efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:23.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.827+0000 7fcb5ffff640 1 -- 172.21.15.5:0/3082459265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb600aeb40 msgr2=0x7fcb60155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:23.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.827+0000 7fcb5ffff640 1 --2- 172.21.15.5:0/3082459265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb600aeb40 0x7fcb60155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:23.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.827+0000 7fcb5ffff640 1 -- 172.21.15.5:0/3082459265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb60159440 msgr2=0x7fcb6014efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:23.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.827+0000 7fcb5ffff640 1 --2- 172.21.15.5:0/3082459265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb60159440 0x7fcb6014efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:23.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.827+0000 7fcb5ffff640 1 -- 172.21.15.5:0/3082459265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb58009b30 con 0x7fcb600aef10 2023-07-14T13:05:23.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.827+0000 7fcb5ffff640 1 --2- 172.21.15.5:0/3082459265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb600aef10 0x7fcb601556d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c00c500 tx=0x7fcb4c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:23.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.827+0000 7fcb5d7fa640 1 -- 172.21.15.5:0/3082459265 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c003600 con 0x7fcb600aef10 2023-07-14T13:05:23.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.827+0000 7fcb5d7fa640 1 -- 172.21.15.5:0/3082459265 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c003760 con 0x7fcb600aef10 2023-07-14T13:05:23.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.827+0000 7fcb66dd2640 1 -- 172.21.15.5:0/3082459265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb601560f0 con 0x7fcb600aef10 2023-07-14T13:05:23.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.827+0000 7fcb5d7fa640 1 -- 172.21.15.5:0/3082459265 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c003b10 con 0x7fcb600aef10 2023-07-14T13:05:23.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.827+0000 7fcb66dd2640 1 -- 172.21.15.5:0/3082459265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6006f2b0 con 0x7fcb600aef10 2023-07-14T13:05:23.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.827+0000 7fcb66dd2640 1 -- 172.21.15.5:0/3082459265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb600678d0 con 0x7fcb600aef10 2023-07-14T13:05:23.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.827+0000 7fcb5d7fa640 1 -- 172.21.15.5:0/3082459265 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fcb4c003c70 con 0x7fcb600aef10 2023-07-14T13:05:23.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.831+0000 7fcb5d7fa640 1 --2- 172.21.15.5:0/3082459265 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fcb44066480 0x7fcb44068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:23.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.831+0000 7fcb5d7fa640 1 -- 172.21.15.5:0/3082459265 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fcb4c083680 con 0x7fcb600aef10 2023-07-14T13:05:23.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.831+0000 7fcb64b6e640 1 --2- 172.21.15.5:0/3082459265 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fcb44066480 0x7fcb44068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:23.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.831+0000 7fcb64b6e640 1 --2- 172.21.15.5:0/3082459265 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fcb44066480 0x7fcb44068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcb54009b60 tx=0x7fcb54009190 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:23.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:23.835+0000 7fcb5d7fa640 1 -- 172.21.15.5:0/3082459265 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fcb4c050a10 con 0x7fcb600aef10 2023-07-14T13:05:24.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.011+0000 7fcb66dd2640 1 -- 172.21.15.5:0/3082459265 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb6015c9d0 con 0x7fcb44066480 2023-07-14T13:05:24.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.071+0000 7fcb5d7fa640 1 -- 172.21.15.5:0/3082459265 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fcb54011ac0 con 0x7fcb44066480 2023-07-14T13:05:24.101 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule deactivated for path /snap_test_dir1/dir9 2023-07-14T13:05:24.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.071+0000 7fcb66dd2640 1 -- 172.21.15.5:0/3082459265 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fcb44066480 msgr2=0x7fcb44068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:24.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.071+0000 7fcb66dd2640 1 --2- 172.21.15.5:0/3082459265 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fcb44066480 0x7fcb44068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcb54009b60 tx=0x7fcb54009190 comp rx=0 tx=0).stop 2023-07-14T13:05:24.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.071+0000 7fcb66dd2640 1 -- 172.21.15.5:0/3082459265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb600aef10 msgr2=0x7fcb601556d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:24.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.071+0000 7fcb66dd2640 1 --2- 172.21.15.5:0/3082459265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb600aef10 0x7fcb601556d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c00c500 tx=0x7fcb4c00c9c0 comp rx=0 tx=0).stop 2023-07-14T13:05:24.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.071+0000 7fcb66dd2640 1 -- 172.21.15.5:0/3082459265 shutdown_connections 2023-07-14T13:05:24.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.071+0000 7fcb66dd2640 1 --2- 172.21.15.5:0/3082459265 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fcb44066480 0x7fcb44068930 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:24.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.071+0000 7fcb66dd2640 1 --2- 172.21.15.5:0/3082459265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb60159440 0x7fcb6014efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:24.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.071+0000 7fcb66dd2640 1 --2- 172.21.15.5:0/3082459265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb600aef10 0x7fcb601556d0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:24.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.071+0000 7fcb66dd2640 1 --2- 172.21.15.5:0/3082459265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb600aeb40 0x7fcb60155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:24.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.071+0000 7fcb66dd2640 1 -- 172.21.15.5:0/3082459265 >> 172.21.15.5:0/3082459265 conn(0x7fcb600cde90 msgr2=0x7fcb600ad9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:24.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.071+0000 7fcb66dd2640 1 -- 172.21.15.5:0/3082459265 shutdown_connections 2023-07-14T13:05:24.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.071+0000 7fcb66dd2640 1 -- 172.21.15.5:0/3082459265 wait complete. 2023-07-14T13:05:24.122 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir9 2023-07-14T13:05:24.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:24.123 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-07-14T13:05:24.135 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_55_01_UTC 2023-07-14T13:05:24.136 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:24.136 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:24.136 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:24.136 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:24.137 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:24.137 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_01_01_UTC 2023-07-14T13:05:24.137 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:24.137 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_03_00_UTC 2023-07-14T13:05:24.138 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:24.138 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:24.139 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-14-12_55_01_UTC', 'scheduled-2023-07-14-12_56_00_UTC', 'scheduled-2023-07-14-12_57_00_UTC', 'scheduled-2023-07-14-12_58_00_UTC', 'scheduled-2023-07-14-12_59_00_UTC', 'scheduled-2023-07-14-13_00_00_UTC', 'scheduled-2023-07-14-13_01_01_UTC', 'scheduled-2023-07-14-13_02_00_UTC', 'scheduled-2023-07-14-13_03_00_UTC', 'scheduled-2023-07-14-13_04_00_UTC', 'scheduled-2023-07-14-13_05_00_UTC'] 2023-07-14T13:05:24.140 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir0 2023-07-14T13:05:24.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.299+0000 7ff4d9bfa640 1 Processor -- start 2023-07-14T13:05:24.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.299+0000 7ff4d9bfa640 1 -- start start 2023-07-14T13:05:24.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.299+0000 7ff4d9bfa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4d40aeb40 0x7ff4d415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:24.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.299+0000 7ff4d9bfa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff4d4159440 0x7ff4d40c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:24.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.299+0000 7ff4d9bfa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d41532b0 con 0x7ff4d40aef10 2023-07-14T13:05:24.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.299+0000 7ff4d9bfa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d40ca6f0 con 0x7ff4d4159440 2023-07-14T13:05:24.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.299+0000 7ff4d9bfa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d41599d0 con 0x7ff4d40aeb40 2023-07-14T13:05:24.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.299+0000 7ff4d3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff4d4159440 0x7ff4d40c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:24.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.299+0000 7ff4d3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff4d4159440 0x7ff4d40c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50298/0 (socket says 172.21.15.5:50298) 2023-07-14T13:05:24.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.299+0000 7ff4d3fff640 1 -- 172.21.15.5:0/140443634 learned_addr learned my addr 172.21.15.5:0/140443634 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:24.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.299+0000 7ff4d37fe640 1 --2- 172.21.15.5:0/140443634 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4d40aeb40 0x7ff4d415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:24.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.299+0000 7ff4d3fff640 1 -- 172.21.15.5:0/140443634 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4d40aeb40 msgr2=0x7ff4d415cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:24.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.299+0000 7ff4d3fff640 1 --2- 172.21.15.5:0/140443634 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4d40aeb40 0x7ff4d415cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:24.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.299+0000 7ff4d3fff640 1 -- 172.21.15.5:0/140443634 >> v1:172.21.15.154:6789/0 conn(0x7ff4d40aef10 legacy=0x7ff4d4158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:24.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.299+0000 7ff4d3fff640 1 -- 172.21.15.5:0/140443634 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d4159cb0 con 0x7ff4d4159440 2023-07-14T13:05:24.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.303+0000 7ff4d3fff640 1 --2- 172.21.15.5:0/140443634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4d4159440 0x7ff4d40c88c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc009e50 tx=0x7ff4cc01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e951bd7d459b7e98 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:24.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.303+0000 7ff4d27fc640 1 -- 172.21.15.5:0/140443634 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc0a5810 con 0x7ff4d4159440 2023-07-14T13:05:24.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.303+0000 7ff4d27fc640 1 -- 172.21.15.5:0/140443634 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4cc0a5970 con 0x7ff4d4159440 2023-07-14T13:05:24.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.303+0000 7ff4d27fc640 1 -- 172.21.15.5:0/140443634 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc0a5d00 con 0x7ff4d4159440 2023-07-14T13:05:24.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.303+0000 7ff4d9bfa640 1 -- 172.21.15.5:0/140443634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4d4159440 msgr2=0x7ff4d40c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:24.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.303+0000 7ff4d9bfa640 1 --2- 172.21.15.5:0/140443634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4d4159440 0x7ff4d40c88c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc009e50 tx=0x7ff4cc01c950 comp rx=0 tx=0).stop 2023-07-14T13:05:24.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.303+0000 7ff4d9bfa640 1 -- 172.21.15.5:0/140443634 shutdown_connections 2023-07-14T13:05:24.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.303+0000 7ff4d9bfa640 1 --2- 172.21.15.5:0/140443634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4d4159440 0x7ff4d40c88c0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:24.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.303+0000 7ff4d9bfa640 1 --2- 172.21.15.5:0/140443634 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4d40aeb40 0x7ff4d415cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:24.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.303+0000 7ff4d9bfa640 1 -- 172.21.15.5:0/140443634 >> 172.21.15.5:0/140443634 conn(0x7ff4d40cde90 msgr2=0x7ff4d40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:24.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.303+0000 7ff4d9bfa640 1 -- 172.21.15.5:0/140443634 shutdown_connections 2023-07-14T13:05:24.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.303+0000 7ff4d9bfa640 1 -- 172.21.15.5:0/140443634 wait complete. 2023-07-14T13:05:24.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.307+0000 7ff4d9bfa640 1 Processor -- start 2023-07-14T13:05:24.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.307+0000 7ff4d9bfa640 1 -- start start 2023-07-14T13:05:24.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.307+0000 7ff4d9bfa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4d40aeb40 0x7ff4d40acd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:24.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.307+0000 7ff4d9bfa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4d40aef10 0x7ff4d406fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:24.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.307+0000 7ff4d9bfa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4d4159440 0x7ff4d414f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:24.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.307+0000 7ff4d9bfa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d4153ca0 con 0x7ff4d40aef10 2023-07-14T13:05:24.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.307+0000 7ff4d9bfa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d406ffb0 con 0x7ff4d40aeb40 2023-07-14T13:05:24.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.307+0000 7ff4d9bfa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d4070250 con 0x7ff4d4159440 2023-07-14T13:05:24.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.307+0000 7ff4d2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4d40aef10 0x7ff4d406fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:24.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.307+0000 7ff4d2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4d40aef10 0x7ff4d406fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50306/0 (socket says 172.21.15.5:50306) 2023-07-14T13:05:24.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.307+0000 7ff4d2ffd640 1 -- 172.21.15.5:0/3212511279 learned_addr learned my addr 172.21.15.5:0/3212511279 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:24.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.307+0000 7ff4d37fe640 1 --2- 172.21.15.5:0/3212511279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4d40aeb40 0x7ff4d40acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:24.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.307+0000 7ff4d3fff640 1 --2- 172.21.15.5:0/3212511279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4d4159440 0x7ff4d414f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:24.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.307+0000 7ff4d2ffd640 1 -- 172.21.15.5:0/3212511279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4d4159440 msgr2=0x7ff4d414f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:24.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.307+0000 7ff4d2ffd640 1 --2- 172.21.15.5:0/3212511279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4d4159440 0x7ff4d414f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:24.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.307+0000 7ff4d2ffd640 1 -- 172.21.15.5:0/3212511279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4d40aeb40 msgr2=0x7ff4d40acd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:24.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.307+0000 7ff4d2ffd640 1 --2- 172.21.15.5:0/3212511279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4d40aeb40 0x7ff4d40acd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.307+0000 7ff4d2ffd640 1 -- 172.21.15.5:0/3212511279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4cc009b30 con 0x7ff4d40aef10 2023-07-14T13:05:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.307+0000 7ff4d2ffd640 1 --2- 172.21.15.5:0/3212511279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4d40aef10 0x7ff4d406fa70 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff4c800c500 tx=0x7ff4c800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.307+0000 7ff4bbfff640 1 -- 172.21.15.5:0/3212511279 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c8005220 con 0x7ff4d40aef10 2023-07-14T13:05:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.307+0000 7ff4bbfff640 1 -- 172.21.15.5:0/3212511279 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c8005380 con 0x7ff4d40aef10 2023-07-14T13:05:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.307+0000 7ff4bbfff640 1 -- 172.21.15.5:0/3212511279 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c8007270 con 0x7ff4d40aef10 2023-07-14T13:05:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.307+0000 7ff4d9bfa640 1 -- 172.21.15.5:0/3212511279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d4070530 con 0x7ff4d40aef10 2023-07-14T13:05:24.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.311+0000 7ff4d9bfa640 1 -- 172.21.15.5:0/3212511279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d4070af0 con 0x7ff4d40aef10 2023-07-14T13:05:24.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.311+0000 7ff4d9bfa640 1 -- 172.21.15.5:0/3212511279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d40678d0 con 0x7ff4d40aef10 2023-07-14T13:05:24.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.311+0000 7ff4bbfff640 1 -- 172.21.15.5:0/3212511279 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7ff4c80073d0 con 0x7ff4d40aef10 2023-07-14T13:05:24.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.311+0000 7ff4bbfff640 1 --2- 172.21.15.5:0/3212511279 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7ff4c0066480 0x7ff4c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:24.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.311+0000 7ff4bbfff640 1 -- 172.21.15.5:0/3212511279 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7ff4c8083470 con 0x7ff4d40aef10 2023-07-14T13:05:24.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.311+0000 7ff4d37fe640 1 --2- 172.21.15.5:0/3212511279 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7ff4c0066480 0x7ff4c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:24.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.311+0000 7ff4d37fe640 1 --2- 172.21.15.5:0/3212511279 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7ff4c0066480 0x7ff4c0068930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4009b60 tx=0x7ff4c4009190 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:24.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.315+0000 7ff4bbfff640 1 -- 172.21.15.5:0/3212511279 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff4c8050620 con 0x7ff4d40aef10 2023-07-14T13:05:24.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.491+0000 7ff4d9bfa640 1 -- 172.21.15.5:0/3212511279 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff4d415c9d0 con 0x7ff4c0066480 2023-07-14T13:05:24.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.499+0000 7ff4bbfff640 1 -- 172.21.15.5:0/3212511279 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7ff4c4011ac0 con 0x7ff4c0066480 2023-07-14T13:05:24.530 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:05:24.530 INFO:teuthology.orchestra.run.smithi005.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T12:54:01", "first": "2023-07-14T12:55:01", "last": "2023-07-14T13:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-14T13:05:24.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.503+0000 7ff4d9bfa640 1 -- 172.21.15.5:0/3212511279 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7ff4c0066480 msgr2=0x7ff4c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:24.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.503+0000 7ff4d9bfa640 1 --2- 172.21.15.5:0/3212511279 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7ff4c0066480 0x7ff4c0068930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4009b60 tx=0x7ff4c4009190 comp rx=0 tx=0).stop 2023-07-14T13:05:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.503+0000 7ff4d9bfa640 1 -- 172.21.15.5:0/3212511279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4d40aef10 msgr2=0x7ff4d406fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.503+0000 7ff4d9bfa640 1 --2- 172.21.15.5:0/3212511279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4d40aef10 0x7ff4d406fa70 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff4c800c500 tx=0x7ff4c800c9c0 comp rx=0 tx=0).stop 2023-07-14T13:05:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.503+0000 7ff4d9bfa640 1 -- 172.21.15.5:0/3212511279 shutdown_connections 2023-07-14T13:05:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.503+0000 7ff4d9bfa640 1 --2- 172.21.15.5:0/3212511279 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7ff4c0066480 0x7ff4c0068930 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.503+0000 7ff4d9bfa640 1 --2- 172.21.15.5:0/3212511279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4d4159440 0x7ff4d414f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.503+0000 7ff4d9bfa640 1 --2- 172.21.15.5:0/3212511279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4d40aef10 0x7ff4d406fa70 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.503+0000 7ff4d9bfa640 1 --2- 172.21.15.5:0/3212511279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4d40aeb40 0x7ff4d40acd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.503+0000 7ff4d9bfa640 1 -- 172.21.15.5:0/3212511279 >> 172.21.15.5:0/3212511279 conn(0x7ff4d40cde90 msgr2=0x7ff4d4072420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.503+0000 7ff4d9bfa640 1 -- 172.21.15.5:0/3212511279 shutdown_connections 2023-07-14T13:05:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.503+0000 7ff4d9bfa640 1 -- 172.21.15.5:0/3212511279 wait complete. 2023-07-14T13:05:24.551 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T12:54:01", "first": "2023-07-14T12:55:01", "last": "2023-07-14T13:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-14T13:05:24.551 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir0', 'rel_path': '/snap_test_dir1/dir0', 'schedule': '1M', 'retention': {}, 'start': '2023-07-14T00:00:00', 'created': '2023-07-14T12:54:01', 'first': '2023-07-14T12:55:01', 'last': '2023-07-14T13:05:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-14T13:05:24.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:24.552 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-07-14T13:05:24.562 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_55_00_UTC 2023-07-14T13:05:24.562 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:24.563 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:24.563 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:24.563 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:24.563 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:24.563 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_01_01_UTC 2023-07-14T13:05:24.563 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:24.563 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_03_00_UTC 2023-07-14T13:05:24.564 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:24.564 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:24.565 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-14-12_55_00_UTC', 'scheduled-2023-07-14-12_56_00_UTC', 'scheduled-2023-07-14-12_57_00_UTC', 'scheduled-2023-07-14-12_58_00_UTC', 'scheduled-2023-07-14-12_59_00_UTC', 'scheduled-2023-07-14-13_00_00_UTC', 'scheduled-2023-07-14-13_01_01_UTC', 'scheduled-2023-07-14-13_02_00_UTC', 'scheduled-2023-07-14-13_03_00_UTC', 'scheduled-2023-07-14-13_04_00_UTC', 'scheduled-2023-07-14-13_05_00_UTC'] 2023-07-14T13:05:24.565 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir1 2023-07-14T13:05:24.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.723+0000 7fbba3537640 1 Processor -- start 2023-07-14T13:05:24.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.727+0000 7fbba3537640 1 -- start start 2023-07-14T13:05:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.727+0000 7fbba3537640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbb9c15bde0 0x7fbb9c06b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:24.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.727+0000 7fbba3537640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb9c15c1b0 0x7fbb9c0cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:24.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.727+0000 7fbba3537640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb9c1609d0 con 0x7fbb9c0ccf50 2023-07-14T13:05:24.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.727+0000 7fbba3537640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb9c0cd3f0 con 0x7fbb9c15bde0 2023-07-14T13:05:24.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.727+0000 7fbba3537640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c06a670 con 0x7fbb9c15c1b0 2023-07-14T13:05:24.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.727+0000 7fbba12d3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbb9c15bde0 0x7fbb9c06b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:24.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.727+0000 7fbba12d3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbb9c15bde0 0x7fbb9c06b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50316/0 (socket says 172.21.15.5:50316) 2023-07-14T13:05:24.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.727+0000 7fbba12d3640 1 -- 172.21.15.5:0/1417503496 learned_addr learned my addr 172.21.15.5:0/1417503496 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:24.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.727+0000 7fbba0ad2640 1 --2- 172.21.15.5:0/1417503496 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb9c15c1b0 0x7fbb9c0cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:24.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.727+0000 7fbba12d3640 1 -- 172.21.15.5:0/1417503496 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb9c15c1b0 msgr2=0x7fbb9c0cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:24.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.727+0000 7fbba12d3640 1 --2- 172.21.15.5:0/1417503496 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb9c15c1b0 0x7fbb9c0cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:24.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.727+0000 7fbba12d3640 1 -- 172.21.15.5:0/1417503496 >> v1:172.21.15.5:6789/0 conn(0x7fbb9c0ccf50 legacy=0x7fbb9c06ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:24.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.727+0000 7fbba12d3640 1 -- 172.21.15.5:0/1417503496 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c06a910 con 0x7fbb9c15bde0 2023-07-14T13:05:24.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.731+0000 7fbba12d3640 1 --2- 172.21.15.5:0/1417503496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb9c15bde0 0x7fbb9c06b3f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fbb98006fd0 tx=0x7fbb9801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19809670ac27ab7a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:24.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.731+0000 7fbb93fff640 1 -- 172.21.15.5:0/1417503496 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb980ac630 con 0x7fbb9c15bde0 2023-07-14T13:05:24.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.731+0000 7fbb93fff640 1 -- 172.21.15.5:0/1417503496 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb980ac790 con 0x7fbb9c15bde0 2023-07-14T13:05:24.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.731+0000 7fbb93fff640 1 -- 172.21.15.5:0/1417503496 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb980acb20 con 0x7fbb9c15bde0 2023-07-14T13:05:24.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.731+0000 7fbba3537640 1 -- 172.21.15.5:0/1417503496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb9c15bde0 msgr2=0x7fbb9c06b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:24.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.731+0000 7fbba3537640 1 --2- 172.21.15.5:0/1417503496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb9c15bde0 0x7fbb9c06b3f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fbb98006fd0 tx=0x7fbb9801c3d0 comp rx=0 tx=0).stop 2023-07-14T13:05:24.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.731+0000 7fbba3537640 1 -- 172.21.15.5:0/1417503496 shutdown_connections 2023-07-14T13:05:24.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.731+0000 7fbba3537640 1 --2- 172.21.15.5:0/1417503496 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb9c15c1b0 0x7fbb9c0cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:24.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.731+0000 7fbba3537640 1 --2- 172.21.15.5:0/1417503496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb9c15bde0 0x7fbb9c06b3f0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:24.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.731+0000 7fbba3537640 1 -- 172.21.15.5:0/1417503496 >> 172.21.15.5:0/1417503496 conn(0x7fbb9c0659d0 msgr2=0x7fbb9c099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:24.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.731+0000 7fbba3537640 1 -- 172.21.15.5:0/1417503496 shutdown_connections 2023-07-14T13:05:24.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.731+0000 7fbba3537640 1 -- 172.21.15.5:0/1417503496 wait complete. 2023-07-14T13:05:24.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.731+0000 7fbba3537640 1 Processor -- start 2023-07-14T13:05:24.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.731+0000 7fbba3537640 1 -- start start 2023-07-14T13:05:24.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.735+0000 7fbba3537640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb9c0ccf50 0x7fbb9c0cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:24.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.735+0000 7fbba3537640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb9c15bde0 0x7fbb9c0ad7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:24.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.735+0000 7fbba3537640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb9c15c1b0 0x7fbb9c0d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:24.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.735+0000 7fbba3537640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c0c67a0 con 0x7fbb9c15c1b0 2023-07-14T13:05:24.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.735+0000 7fbba3537640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c0b6000 con 0x7fbb9c0ccf50 2023-07-14T13:05:24.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.735+0000 7fbba3537640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c157330 con 0x7fbb9c15bde0 2023-07-14T13:05:24.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.735+0000 7fbba1ad4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb9c15c1b0 0x7fbb9c0d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:24.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.735+0000 7fbba1ad4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb9c15c1b0 0x7fbb9c0d03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50330/0 (socket says 172.21.15.5:50330) 2023-07-14T13:05:24.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.735+0000 7fbba1ad4640 1 -- 172.21.15.5:0/636633023 learned_addr learned my addr 172.21.15.5:0/636633023 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:24.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.735+0000 7fbba12d3640 1 --2- 172.21.15.5:0/636633023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb9c0ccf50 0x7fbb9c0cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:24.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.735+0000 7fbba0ad2640 1 --2- 172.21.15.5:0/636633023 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb9c15bde0 0x7fbb9c0ad7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:24.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.735+0000 7fbba1ad4640 1 -- 172.21.15.5:0/636633023 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb9c15bde0 msgr2=0x7fbb9c0ad7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:24.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.735+0000 7fbba1ad4640 1 --2- 172.21.15.5:0/636633023 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb9c15bde0 0x7fbb9c0ad7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:24.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.735+0000 7fbba1ad4640 1 -- 172.21.15.5:0/636633023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb9c0ccf50 msgr2=0x7fbb9c0cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:24.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.735+0000 7fbba1ad4640 1 --2- 172.21.15.5:0/636633023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb9c0ccf50 0x7fbb9c0cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:24.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.735+0000 7fbba1ad4640 1 -- 172.21.15.5:0/636633023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb98009480 con 0x7fbb9c15c1b0 2023-07-14T13:05:24.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.735+0000 7fbba0ad2640 1 --2- 172.21.15.5:0/636633023 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb9c15bde0 0x7fbb9c0ad7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:05:24.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.735+0000 7fbba12d3640 1 --2- 172.21.15.5:0/636633023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb9c0ccf50 0x7fbb9c0cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:05:24.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.735+0000 7fbba1ad4640 1 --2- 172.21.15.5:0/636633023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb9c15c1b0 0x7fbb9c0d03b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbb9400c730 tx=0x7fbb9400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:24.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.735+0000 7fbb91ffb640 1 -- 172.21.15.5:0/636633023 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb94003b80 con 0x7fbb9c15c1b0 2023-07-14T13:05:24.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.735+0000 7fbb91ffb640 1 -- 172.21.15.5:0/636633023 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb94003ce0 con 0x7fbb9c15c1b0 2023-07-14T13:05:24.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.735+0000 7fbb91ffb640 1 -- 172.21.15.5:0/636633023 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9400aa30 con 0x7fbb9c15c1b0 2023-07-14T13:05:24.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.735+0000 7fbba3537640 1 -- 172.21.15.5:0/636633023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb9c0c61e0 con 0x7fbb9c15c1b0 2023-07-14T13:05:24.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.735+0000 7fbba3537640 1 -- 172.21.15.5:0/636633023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb9c0b5ae0 con 0x7fbb9c15c1b0 2023-07-14T13:05:24.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.735+0000 7fbba3537640 1 -- 172.21.15.5:0/636633023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb9c0b5940 con 0x7fbb9c15c1b0 2023-07-14T13:05:24.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.735+0000 7fbb91ffb640 1 -- 172.21.15.5:0/636633023 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fbb9400ab90 con 0x7fbb9c15c1b0 2023-07-14T13:05:24.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.739+0000 7fbb91ffb640 1 --2- 172.21.15.5:0/636633023 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fbb80066480 0x7fbb80068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:24.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.739+0000 7fbb91ffb640 1 -- 172.21.15.5:0/636633023 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fbb94083ff0 con 0x7fbb9c15c1b0 2023-07-14T13:05:24.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.739+0000 7fbba12d3640 1 --2- 172.21.15.5:0/636633023 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fbb80066480 0x7fbb80068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:24.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.739+0000 7fbba12d3640 1 --2- 172.21.15.5:0/636633023 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fbb80066480 0x7fbb80068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbb980ae000 tx=0x7fbb98009040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:24.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.743+0000 7fbb91ffb640 1 -- 172.21.15.5:0/636633023 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fbb940b4720 con 0x7fbb9c15c1b0 2023-07-14T13:05:24.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.915+0000 7fbba3537640 1 -- 172.21.15.5:0/636633023 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbb9c06dae0 con 0x7fbb80066480 2023-07-14T13:05:24.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.923+0000 7fbb91ffb640 1 -- 172.21.15.5:0/636633023 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fbb980bc0d0 con 0x7fbb80066480 2023-07-14T13:05:24.955 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:05:24.956 INFO:teuthology.orchestra.run.smithi005.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T12:54:01", "first": "2023-07-14T12:55:00", "last": "2023-07-14T13:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-14T13:05:24.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.927+0000 7fbba3537640 1 -- 172.21.15.5:0/636633023 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fbb80066480 msgr2=0x7fbb80068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:24.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.927+0000 7fbba3537640 1 --2- 172.21.15.5:0/636633023 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fbb80066480 0x7fbb80068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbb980ae000 tx=0x7fbb98009040 comp rx=0 tx=0).stop 2023-07-14T13:05:24.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.927+0000 7fbba3537640 1 -- 172.21.15.5:0/636633023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb9c15c1b0 msgr2=0x7fbb9c0d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:24.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.927+0000 7fbba3537640 1 --2- 172.21.15.5:0/636633023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb9c15c1b0 0x7fbb9c0d03b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbb9400c730 tx=0x7fbb9400cbf0 comp rx=0 tx=0).stop 2023-07-14T13:05:24.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.927+0000 7fbba3537640 1 -- 172.21.15.5:0/636633023 shutdown_connections 2023-07-14T13:05:24.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.927+0000 7fbba3537640 1 --2- 172.21.15.5:0/636633023 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fbb80066480 0x7fbb80068930 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:24.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.927+0000 7fbba3537640 1 --2- 172.21.15.5:0/636633023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb9c15c1b0 0x7fbb9c0d03b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:24.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.927+0000 7fbba3537640 1 --2- 172.21.15.5:0/636633023 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbb9c15bde0 0x7fbb9c0ad7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:24.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.927+0000 7fbba3537640 1 --2- 172.21.15.5:0/636633023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb9c0ccf50 0x7fbb9c0cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:24.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.927+0000 7fbba3537640 1 -- 172.21.15.5:0/636633023 >> 172.21.15.5:0/636633023 conn(0x7fbb9c0659d0 msgr2=0x7fbb9c0acc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:24.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.927+0000 7fbba3537640 1 -- 172.21.15.5:0/636633023 shutdown_connections 2023-07-14T13:05:24.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:24.927+0000 7fbba3537640 1 -- 172.21.15.5:0/636633023 wait complete. 2023-07-14T13:05:24.976 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T12:54:01", "first": "2023-07-14T12:55:00", "last": "2023-07-14T13:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-14T13:05:24.977 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir1', 'rel_path': '/snap_test_dir1/dir1', 'schedule': '1M', 'retention': {}, 'start': '2023-07-14T00:00:00', 'created': '2023-07-14T12:54:01', 'first': '2023-07-14T12:55:00', 'last': '2023-07-14T13:05:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-14T13:05:24.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:24.977 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-07-14T13:05:24.987 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_55_00_UTC 2023-07-14T13:05:24.988 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:24.988 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:24.988 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:24.988 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:24.988 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:24.989 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_01_00_UTC 2023-07-14T13:05:24.989 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:24.989 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_03_00_UTC 2023-07-14T13:05:24.989 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:24.989 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:24.990 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-14-12_55_00_UTC', 'scheduled-2023-07-14-12_56_00_UTC', 'scheduled-2023-07-14-12_57_00_UTC', 'scheduled-2023-07-14-12_58_00_UTC', 'scheduled-2023-07-14-12_59_00_UTC', 'scheduled-2023-07-14-13_00_00_UTC', 'scheduled-2023-07-14-13_01_00_UTC', 'scheduled-2023-07-14-13_02_00_UTC', 'scheduled-2023-07-14-13_03_00_UTC', 'scheduled-2023-07-14-13_04_00_UTC', 'scheduled-2023-07-14-13_05_00_UTC'] 2023-07-14T13:05:24.991 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir2 2023-07-14T13:05:25.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.147+0000 7fee2fb37640 1 Processor -- start 2023-07-14T13:05:25.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.147+0000 7fee2fb37640 1 -- start start 2023-07-14T13:05:25.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.147+0000 7fee2fb37640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fee28069430 0x7fee28069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:25.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.147+0000 7fee2fb37640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee280af2b0 0x7fee2815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:25.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.147+0000 7fee2fb37640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee28159d70 con 0x7fee28070f30 2023-07-14T13:05:25.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.147+0000 7fee2fb37640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee28069d40 con 0x7fee28069430 2023-07-14T13:05:25.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.147+0000 7fee2fb37640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee280c9c60 con 0x7fee280af2b0 2023-07-14T13:05:25.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.151+0000 7fee2d8d3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fee28069430 0x7fee28069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:25.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.151+0000 7fee2d8d3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fee28069430 0x7fee28069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50332/0 (socket says 172.21.15.5:50332) 2023-07-14T13:05:25.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.151+0000 7fee2d8d3640 1 -- 172.21.15.5:0/2273913909 learned_addr learned my addr 172.21.15.5:0/2273913909 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:25.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.151+0000 7fee2e0d4640 1 --2- 172.21.15.5:0/2273913909 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee280af2b0 0x7fee2815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:25.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.151+0000 7fee2d8d3640 1 -- 172.21.15.5:0/2273913909 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee280af2b0 msgr2=0x7fee2815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:25.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.151+0000 7fee2d8d3640 1 --2- 172.21.15.5:0/2273913909 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee280af2b0 0x7fee2815a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:25.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.151+0000 7fee2d8d3640 1 -- 172.21.15.5:0/2273913909 >> v1:172.21.15.5:6789/0 conn(0x7fee28070f30 legacy=0x7fee280ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:25.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.151+0000 7fee2d8d3640 1 -- 172.21.15.5:0/2273913909 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee280c9f40 con 0x7fee28069430 2023-07-14T13:05:25.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.151+0000 7fee2d8d3640 1 --2- 172.21.15.5:0/2273913909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee28069430 0x7fee28069800 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fee24009870 tx=0x7fee2401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec1077b0aa37f1f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:25.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.151+0000 7fee2c8d1640 1 -- 172.21.15.5:0/2273913909 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee240ab650 con 0x7fee28069430 2023-07-14T13:05:25.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.151+0000 7fee2c8d1640 1 -- 172.21.15.5:0/2273913909 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee240ab7b0 con 0x7fee28069430 2023-07-14T13:05:25.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.151+0000 7fee2c8d1640 1 -- 172.21.15.5:0/2273913909 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee240abb40 con 0x7fee28069430 2023-07-14T13:05:25.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.155+0000 7fee2fb37640 1 -- 172.21.15.5:0/2273913909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee28069430 msgr2=0x7fee28069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:25.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.155+0000 7fee2fb37640 1 --2- 172.21.15.5:0/2273913909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee28069430 0x7fee28069800 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fee24009870 tx=0x7fee2401c540 comp rx=0 tx=0).stop 2023-07-14T13:05:25.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.155+0000 7fee2fb37640 1 -- 172.21.15.5:0/2273913909 shutdown_connections 2023-07-14T13:05:25.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.155+0000 7fee2fb37640 1 --2- 172.21.15.5:0/2273913909 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee280af2b0 0x7fee2815a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:25.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.155+0000 7fee2fb37640 1 --2- 172.21.15.5:0/2273913909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee28069430 0x7fee28069800 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:25.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.155+0000 7fee2fb37640 1 -- 172.21.15.5:0/2273913909 >> 172.21.15.5:0/2273913909 conn(0x7fee280cde90 msgr2=0x7fee280ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:25.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.155+0000 7fee2fb37640 1 -- 172.21.15.5:0/2273913909 shutdown_connections 2023-07-14T13:05:25.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.155+0000 7fee2fb37640 1 -- 172.21.15.5:0/2273913909 wait complete. 2023-07-14T13:05:25.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.155+0000 7fee2fb37640 1 Processor -- start 2023-07-14T13:05:25.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.155+0000 7fee2fb37640 1 -- start start 2023-07-14T13:05:25.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.155+0000 7fee2fb37640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee28069430 0x7fee28150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:25.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.155+0000 7fee2fb37640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee28070f30 0x7fee280cb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:25.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.155+0000 7fee2fb37640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee280af2b0 0x7fee280cb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:25.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.155+0000 7fee2fb37640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee281530e0 con 0x7fee28070f30 2023-07-14T13:05:25.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.155+0000 7fee2fb37640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee28155550 con 0x7fee280af2b0 2023-07-14T13:05:25.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.155+0000 7fee2fb37640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee28155830 con 0x7fee28069430 2023-07-14T13:05:25.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.155+0000 7fee2d0d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee28070f30 0x7fee280cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:25.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.155+0000 7fee2d8d3640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee28069430 0x7fee28150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:25.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.155+0000 7fee2d0d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee28070f30 0x7fee280cb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50336/0 (socket says 172.21.15.5:50336) 2023-07-14T13:05:25.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.155+0000 7fee2d0d2640 1 -- 172.21.15.5:0/2883000719 learned_addr learned my addr 172.21.15.5:0/2883000719 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:25.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.155+0000 7fee2e0d4640 1 --2- 172.21.15.5:0/2883000719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee280af2b0 0x7fee280cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:25.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.159+0000 7fee2d0d2640 1 -- 172.21.15.5:0/2883000719 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee28069430 msgr2=0x7fee28150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:25.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.159+0000 7fee2d0d2640 1 --2- 172.21.15.5:0/2883000719 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee28069430 0x7fee28150bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:25.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.159+0000 7fee2d0d2640 1 -- 172.21.15.5:0/2883000719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee280af2b0 msgr2=0x7fee280cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:25.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.159+0000 7fee2d0d2640 1 --2- 172.21.15.5:0/2883000719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee280af2b0 0x7fee280cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:25.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.159+0000 7fee2d0d2640 1 -- 172.21.15.5:0/2883000719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee240094d0 con 0x7fee28070f30 2023-07-14T13:05:25.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.159+0000 7fee2d0d2640 1 --2- 172.21.15.5:0/2883000719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee28070f30 0x7fee280cb230 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fee1800c500 tx=0x7fee1800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:25.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.159+0000 7fee1e7fc640 1 -- 172.21.15.5:0/2883000719 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee18005220 con 0x7fee28070f30 2023-07-14T13:05:25.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.159+0000 7fee1e7fc640 1 -- 172.21.15.5:0/2883000719 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee18005380 con 0x7fee28070f30 2023-07-14T13:05:25.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.159+0000 7fee1e7fc640 1 -- 172.21.15.5:0/2883000719 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee18007270 con 0x7fee28070f30 2023-07-14T13:05:25.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.159+0000 7fee2fb37640 1 -- 172.21.15.5:0/2883000719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee28155b10 con 0x7fee28070f30 2023-07-14T13:05:25.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.159+0000 7fee2fb37640 1 -- 172.21.15.5:0/2883000719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee28151110 con 0x7fee28070f30 2023-07-14T13:05:25.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.159+0000 7fee2fb37640 1 -- 172.21.15.5:0/2883000719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee280678d0 con 0x7fee28070f30 2023-07-14T13:05:25.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.159+0000 7fee1e7fc640 1 -- 172.21.15.5:0/2883000719 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fee180073d0 con 0x7fee28070f30 2023-07-14T13:05:25.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.159+0000 7fee1e7fc640 1 --2- 172.21.15.5:0/2883000719 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fee0c066480 0x7fee0c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:25.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.159+0000 7fee1e7fc640 1 -- 172.21.15.5:0/2883000719 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fee18083890 con 0x7fee28070f30 2023-07-14T13:05:25.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.159+0000 7fee2d8d3640 1 --2- 172.21.15.5:0/2883000719 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fee0c066480 0x7fee0c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:25.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.163+0000 7fee2d8d3640 1 --2- 172.21.15.5:0/2883000719 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fee0c066480 0x7fee0c068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fee240af000 tx=0x7fee240b6040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:25.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.163+0000 7fee1e7fc640 1 -- 172.21.15.5:0/2883000719 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fee18050990 con 0x7fee28070f30 2023-07-14T13:05:25.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.339+0000 7fee2fb37640 1 -- 172.21.15.5:0/2883000719 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fee281556c0 con 0x7fee0c066480 2023-07-14T13:05:25.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.347+0000 7fee1e7fc640 1 -- 172.21.15.5:0/2883000719 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fee281556c0 con 0x7fee0c066480 2023-07-14T13:05:25.378 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:05:25.379 INFO:teuthology.orchestra.run.smithi005.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T12:54:02", "first": "2023-07-14T12:55:00", "last": "2023-07-14T13:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-14T13:05:25.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.351+0000 7fee2fb37640 1 -- 172.21.15.5:0/2883000719 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fee0c066480 msgr2=0x7fee0c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:25.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.351+0000 7fee2fb37640 1 --2- 172.21.15.5:0/2883000719 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fee0c066480 0x7fee0c068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fee240af000 tx=0x7fee240b6040 comp rx=0 tx=0).stop 2023-07-14T13:05:25.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.351+0000 7fee2fb37640 1 -- 172.21.15.5:0/2883000719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee28070f30 msgr2=0x7fee280cb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:25.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.351+0000 7fee2fb37640 1 --2- 172.21.15.5:0/2883000719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee28070f30 0x7fee280cb230 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fee1800c500 tx=0x7fee1800c9c0 comp rx=0 tx=0).stop 2023-07-14T13:05:25.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.351+0000 7fee2fb37640 1 -- 172.21.15.5:0/2883000719 shutdown_connections 2023-07-14T13:05:25.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.351+0000 7fee2fb37640 1 --2- 172.21.15.5:0/2883000719 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fee0c066480 0x7fee0c068930 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:25.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.351+0000 7fee2fb37640 1 --2- 172.21.15.5:0/2883000719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee280af2b0 0x7fee280cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:25.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.351+0000 7fee2fb37640 1 --2- 172.21.15.5:0/2883000719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee28070f30 0x7fee280cb230 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:25.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.351+0000 7fee2fb37640 1 --2- 172.21.15.5:0/2883000719 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee28069430 0x7fee28150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:25.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.351+0000 7fee2fb37640 1 -- 172.21.15.5:0/2883000719 >> 172.21.15.5:0/2883000719 conn(0x7fee280cde90 msgr2=0x7fee280c34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:25.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.351+0000 7fee2fb37640 1 -- 172.21.15.5:0/2883000719 shutdown_connections 2023-07-14T13:05:25.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.351+0000 7fee2fb37640 1 -- 172.21.15.5:0/2883000719 wait complete. 2023-07-14T13:05:25.398 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T12:54:02", "first": "2023-07-14T12:55:00", "last": "2023-07-14T13:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-14T13:05:25.399 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir2', 'rel_path': '/snap_test_dir1/dir2', 'schedule': '1M', 'retention': {}, 'start': '2023-07-14T00:00:00', 'created': '2023-07-14T12:54:02', 'first': '2023-07-14T12:55:00', 'last': '2023-07-14T13:05:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-14T13:05:25.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:25.400 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-07-14T13:05:25.410 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_55_00_UTC 2023-07-14T13:05:25.411 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:25.411 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:25.411 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:25.411 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:25.411 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:25.411 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_01_01_UTC 2023-07-14T13:05:25.412 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:25.412 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_03_00_UTC 2023-07-14T13:05:25.412 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:25.412 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:25.413 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-14-12_55_00_UTC', 'scheduled-2023-07-14-12_56_00_UTC', 'scheduled-2023-07-14-12_57_00_UTC', 'scheduled-2023-07-14-12_58_00_UTC', 'scheduled-2023-07-14-12_59_00_UTC', 'scheduled-2023-07-14-13_00_00_UTC', 'scheduled-2023-07-14-13_01_01_UTC', 'scheduled-2023-07-14-13_02_00_UTC', 'scheduled-2023-07-14-13_03_00_UTC', 'scheduled-2023-07-14-13_04_00_UTC', 'scheduled-2023-07-14-13_05_00_UTC'] 2023-07-14T13:05:25.413 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir3 2023-07-14T13:05:25.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.575+0000 7f7786bd2640 1 Processor -- start 2023-07-14T13:05:25.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.575+0000 7f7786bd2640 1 -- start start 2023-07-14T13:05:25.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.575+0000 7f7786bd2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77800aeb40 0x7f778015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:25.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.575+0000 7f7786bd2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77800aef10 0x7f7780158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:25.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.575+0000 7f7786bd2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77801532b0 con 0x7f7780159270 2023-07-14T13:05:25.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.575+0000 7f7786bd2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77800ca6f0 con 0x7f77800aef10 2023-07-14T13:05:25.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.575+0000 7f7786bd2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77801599d0 con 0x7f77800aeb40 2023-07-14T13:05:25.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.575+0000 7f777ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77800aef10 0x7f7780158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:25.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.575+0000 7f777ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77800aef10 0x7f7780158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50340/0 (socket says 172.21.15.5:50340) 2023-07-14T13:05:25.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.575+0000 7f777ffff640 1 -- 172.21.15.5:0/3054838266 learned_addr learned my addr 172.21.15.5:0/3054838266 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:25.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.579+0000 7f778496e640 1 --2- 172.21.15.5:0/3054838266 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77800aeb40 0x7f778015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:25.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.579+0000 7f777ffff640 1 -- 172.21.15.5:0/3054838266 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77800aeb40 msgr2=0x7f778015cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:25.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.579+0000 7f777ffff640 1 --2- 172.21.15.5:0/3054838266 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77800aeb40 0x7f778015cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:25.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.579+0000 7f777ffff640 1 -- 172.21.15.5:0/3054838266 >> v1:172.21.15.5:6789/0 conn(0x7f7780159270 legacy=0x7f77800c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:25.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.579+0000 7f777ffff640 1 -- 172.21.15.5:0/3054838266 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7780159cb0 con 0x7f77800aef10 2023-07-14T13:05:25.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.579+0000 7f777ffff640 1 --2- 172.21.15.5:0/3054838266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77800aef10 0x7f7780158d30 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f776c009870 tx=0x7f776c01e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c09177921b8444 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:25.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.579+0000 7f777f7fe640 1 -- 172.21.15.5:0/3054838266 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c0a8660 con 0x7f77800aef10 2023-07-14T13:05:25.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.579+0000 7f777f7fe640 1 -- 172.21.15.5:0/3054838266 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776c0a87c0 con 0x7f77800aef10 2023-07-14T13:05:25.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.579+0000 7f777f7fe640 1 -- 172.21.15.5:0/3054838266 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c0a8b50 con 0x7f77800aef10 2023-07-14T13:05:25.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.579+0000 7f7786bd2640 1 -- 172.21.15.5:0/3054838266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77800aef10 msgr2=0x7f7780158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:25.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.579+0000 7f7786bd2640 1 --2- 172.21.15.5:0/3054838266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77800aef10 0x7f7780158d30 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f776c009870 tx=0x7f776c01e690 comp rx=0 tx=0).stop 2023-07-14T13:05:25.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.583+0000 7f7786bd2640 1 -- 172.21.15.5:0/3054838266 shutdown_connections 2023-07-14T13:05:25.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.583+0000 7f7786bd2640 1 --2- 172.21.15.5:0/3054838266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77800aef10 0x7f7780158d30 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:25.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.583+0000 7f7786bd2640 1 --2- 172.21.15.5:0/3054838266 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77800aeb40 0x7f778015cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:25.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.583+0000 7f7786bd2640 1 -- 172.21.15.5:0/3054838266 >> 172.21.15.5:0/3054838266 conn(0x7f77800cde90 msgr2=0x7f77800ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:25.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.583+0000 7f7786bd2640 1 -- 172.21.15.5:0/3054838266 shutdown_connections 2023-07-14T13:05:25.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.583+0000 7f7786bd2640 1 -- 172.21.15.5:0/3054838266 wait complete. 2023-07-14T13:05:25.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.583+0000 7f7786bd2640 1 Processor -- start 2023-07-14T13:05:25.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.583+0000 7f7786bd2640 1 -- start start 2023-07-14T13:05:25.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.583+0000 7f7786bd2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77800aeb40 0x7f778006c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:25.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.583+0000 7f7786bd2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77800aef10 0x7f778014e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:25.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.583+0000 7f7786bd2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7780159270 0x7f77800b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:25.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.583+0000 7f7786bd2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778006c400 con 0x7f77800aef10 2023-07-14T13:05:25.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.583+0000 7f7786bd2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77800b38b0 con 0x7f7780159270 2023-07-14T13:05:25.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.583+0000 7f7786bd2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778006b7f0 con 0x7f77800aeb40 2023-07-14T13:05:25.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.583+0000 7f777ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77800aef10 0x7f778014e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:25.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.583+0000 7f777ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77800aef10 0x7f778014e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50356/0 (socket says 172.21.15.5:50356) 2023-07-14T13:05:25.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.583+0000 7f777ffff640 1 -- 172.21.15.5:0/4177734796 learned_addr learned my addr 172.21.15.5:0/4177734796 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:25.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.583+0000 7f778496e640 1 --2- 172.21.15.5:0/4177734796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77800aeb40 0x7f778006c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:25.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.583+0000 7f778516f640 1 --2- 172.21.15.5:0/4177734796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7780159270 0x7f77800b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:25.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.583+0000 7f777ffff640 1 -- 172.21.15.5:0/4177734796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77800aeb40 msgr2=0x7f778006c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:25.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.583+0000 7f777ffff640 1 --2- 172.21.15.5:0/4177734796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77800aeb40 0x7f778006c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:25.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.583+0000 7f777ffff640 1 -- 172.21.15.5:0/4177734796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7780159270 msgr2=0x7f77800b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:25.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.583+0000 7f777ffff640 1 --2- 172.21.15.5:0/4177734796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7780159270 0x7f77800b19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:25.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.583+0000 7f777ffff640 1 -- 172.21.15.5:0/4177734796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c0094d0 con 0x7f77800aef10 2023-07-14T13:05:25.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.583+0000 7f778516f640 1 --2- 172.21.15.5:0/4177734796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7780159270 0x7f77800b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:05:25.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.587+0000 7f777ffff640 1 --2- 172.21.15.5:0/4177734796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77800aef10 0x7f778014e920 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f776c01cd40 tx=0x7f776c01b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.587+0000 7f777d7fa640 1 -- 172.21.15.5:0/4177734796 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c0a8660 con 0x7f77800aef10 2023-07-14T13:05:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.587+0000 7f777d7fa640 1 -- 172.21.15.5:0/4177734796 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776c0b3860 con 0x7f77800aef10 2023-07-14T13:05:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.587+0000 7f777d7fa640 1 -- 172.21.15.5:0/4177734796 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c0b3c10 con 0x7f77800aef10 2023-07-14T13:05:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.587+0000 7f7786bd2640 1 -- 172.21.15.5:0/4177734796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f778006bad0 con 0x7f77800aef10 2023-07-14T13:05:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.587+0000 7f7786bd2640 1 -- 172.21.15.5:0/4177734796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f778006c090 con 0x7f77800aef10 2023-07-14T13:05:25.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.587+0000 7f7786bd2640 1 -- 172.21.15.5:0/4177734796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f778006c250 con 0x7f77800aef10 2023-07-14T13:05:25.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.587+0000 7f777d7fa640 1 -- 172.21.15.5:0/4177734796 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f776c0bd450 con 0x7f77800aef10 2023-07-14T13:05:25.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.587+0000 7f777d7fa640 1 --2- 172.21.15.5:0/4177734796 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f7764066480 0x7f7764068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:25.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.587+0000 7f777d7fa640 1 -- 172.21.15.5:0/4177734796 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f776c11e490 con 0x7f77800aef10 2023-07-14T13:05:25.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.587+0000 7f778496e640 1 --2- 172.21.15.5:0/4177734796 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f7764066480 0x7f7764068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:25.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.591+0000 7f778496e640 1 --2- 172.21.15.5:0/4177734796 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f7764066480 0x7f7764068930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f777400b9d0 tx=0x7f7774008040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:25.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.591+0000 7f777d7fa640 1 -- 172.21.15.5:0/4177734796 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f776c0eb4d0 con 0x7f77800aef10 2023-07-14T13:05:25.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.767+0000 7f7786bd2640 1 -- 172.21.15.5:0/4177734796 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7780159670 con 0x7f7764066480 2023-07-14T13:05:25.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.779+0000 7f777d7fa640 1 -- 172.21.15.5:0/4177734796 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f777400f860 con 0x7f7764066480 2023-07-14T13:05:25.807 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:05:25.808 INFO:teuthology.orchestra.run.smithi005.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T12:54:02", "first": "2023-07-14T12:55:00", "last": "2023-07-14T13:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-14T13:05:25.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.779+0000 7f7786bd2640 1 -- 172.21.15.5:0/4177734796 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f7764066480 msgr2=0x7f7764068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:25.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.779+0000 7f7786bd2640 1 --2- 172.21.15.5:0/4177734796 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f7764066480 0x7f7764068930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f777400b9d0 tx=0x7f7774008040 comp rx=0 tx=0).stop 2023-07-14T13:05:25.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.779+0000 7f7786bd2640 1 -- 172.21.15.5:0/4177734796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77800aef10 msgr2=0x7f778014e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:25.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.779+0000 7f7786bd2640 1 --2- 172.21.15.5:0/4177734796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77800aef10 0x7f778014e920 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f776c01cd40 tx=0x7f776c01b430 comp rx=0 tx=0).stop 2023-07-14T13:05:25.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.779+0000 7f7786bd2640 1 -- 172.21.15.5:0/4177734796 shutdown_connections 2023-07-14T13:05:25.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.779+0000 7f7786bd2640 1 --2- 172.21.15.5:0/4177734796 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f7764066480 0x7f7764068930 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:25.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.779+0000 7f7786bd2640 1 --2- 172.21.15.5:0/4177734796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7780159270 0x7f77800b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:25.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.779+0000 7f7786bd2640 1 --2- 172.21.15.5:0/4177734796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77800aef10 0x7f778014e920 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:25.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.779+0000 7f7786bd2640 1 --2- 172.21.15.5:0/4177734796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77800aeb40 0x7f778006c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:25.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.779+0000 7f7786bd2640 1 -- 172.21.15.5:0/4177734796 >> 172.21.15.5:0/4177734796 conn(0x7f77800cde90 msgr2=0x7f77800c3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:25.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.779+0000 7f7786bd2640 1 -- 172.21.15.5:0/4177734796 shutdown_connections 2023-07-14T13:05:25.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.779+0000 7f7786bd2640 1 -- 172.21.15.5:0/4177734796 wait complete. 2023-07-14T13:05:25.828 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T12:54:02", "first": "2023-07-14T12:55:00", "last": "2023-07-14T13:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-14T13:05:25.828 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir3', 'rel_path': '/snap_test_dir1/dir3', 'schedule': '1M', 'retention': {}, 'start': '2023-07-14T00:00:00', 'created': '2023-07-14T12:54:02', 'first': '2023-07-14T12:55:00', 'last': '2023-07-14T13:05:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-14T13:05:25.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:25.829 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-07-14T13:05:25.839 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_55_00_UTC 2023-07-14T13:05:25.839 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:25.840 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:25.840 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:25.840 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:25.840 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:25.840 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_01_00_UTC 2023-07-14T13:05:25.840 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:25.840 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_03_00_UTC 2023-07-14T13:05:25.840 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:25.841 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:25.841 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-14-12_55_00_UTC', 'scheduled-2023-07-14-12_56_00_UTC', 'scheduled-2023-07-14-12_57_00_UTC', 'scheduled-2023-07-14-12_58_00_UTC', 'scheduled-2023-07-14-12_59_00_UTC', 'scheduled-2023-07-14-13_00_00_UTC', 'scheduled-2023-07-14-13_01_00_UTC', 'scheduled-2023-07-14-13_02_00_UTC', 'scheduled-2023-07-14-13_03_00_UTC', 'scheduled-2023-07-14-13_04_00_UTC', 'scheduled-2023-07-14-13_05_00_UTC'] 2023-07-14T13:05:25.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir4 2023-07-14T13:05:26.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.999+0000 7f0936bf6640 1 Processor -- start 2023-07-14T13:05:26.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.999+0000 7f0936bf6640 1 -- start start 2023-07-14T13:05:26.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.999+0000 7f0936bf6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0930159440 0x7f09300c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:26.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:25.999+0000 7f0936bf6640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09301532b0 con 0x7f09300aeb40 2023-07-14T13:05:26.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f0936bf6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09300ca6f0 con 0x7f093015cef0 2023-07-14T13:05:26.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f0936bf6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093015d360 con 0x7f0930159440 2023-07-14T13:05:26.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f0934992640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f09300aeb40 0x7f09300aef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49428/0 (socket says 172.21.15.5:49428) 2023-07-14T13:05:26.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f0934992640 1 -- 172.21.15.5:0/2222669444 learned_addr learned my addr 172.21.15.5:0/2222669444 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:26.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f0935193640 1 --2- 172.21.15.5:0/2222669444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0930159440 0x7f09300c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:26.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f092f7fe640 1 -- 172.21.15.5:0/2222669444 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3960080319 0 0) 0x7f09301532b0 con 0x7f09300aeb40 2023-07-14T13:05:26.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f092f7fe640 1 -- 172.21.15.5:0/2222669444 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0920003530 con 0x7f09300aeb40 2023-07-14T13:05:26.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f092f7fe640 1 -- 172.21.15.5:0/2222669444 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3631004859 0 0) 0x7f09300ca6f0 con 0x7f093015cef0 2023-07-14T13:05:26.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f092f7fe640 1 -- 172.21.15.5:0/2222669444 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09301532b0 con 0x7f093015cef0 2023-07-14T13:05:26.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f092f7fe640 1 -- 172.21.15.5:0/2222669444 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2315819002 0 0) 0x7f0920003530 con 0x7f09300aeb40 2023-07-14T13:05:26.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f092f7fe640 1 -- 172.21.15.5:0/2222669444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0930159440 msgr2=0x7f09300c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:26.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f092f7fe640 1 --2- 172.21.15.5:0/2222669444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0930159440 0x7f09300c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:26.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f092f7fe640 1 -- 172.21.15.5:0/2222669444 >> v1:172.21.15.154:6789/0 conn(0x7f093015cef0 legacy=0x7f0930158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:26.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f092f7fe640 1 -- 172.21.15.5:0/2222669444 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09301599d0 con 0x7f09300aeb40 2023-07-14T13:05:26.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f092f7fe640 1 -- 172.21.15.5:0/2222669444 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f0924001680 con 0x7f09300aeb40 2023-07-14T13:05:26.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f0935193640 1 --2- 172.21.15.5:0/2222669444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0930159440 0x7f09300c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:26.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f092f7fe640 1 -- 172.21.15.5:0/2222669444 >> v1:172.21.15.5:6789/0 conn(0x7f09300aeb40 legacy=0x7f09300aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:26.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f092f7fe640 1 --2- 172.21.15.5:0/2222669444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0920003b40 0x7f0920003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:26.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f092f7fe640 1 --2- 172.21.15.5:0/2222669444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09200047d0 0x7f0920004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:26.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f092f7fe640 1 --2- 172.21.15.5:0/2222669444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0930159440 0x7f0920005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:26.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f092f7fe640 1 -- 172.21.15.5:0/2222669444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093015d360 con 0x7f09200047d0 2023-07-14T13:05:26.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f092f7fe640 1 -- 172.21.15.5:0/2222669444 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092000b9f0 con 0x7f0920003b40 2023-07-14T13:05:26.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f092f7fe640 1 -- 172.21.15.5:0/2222669444 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f092000bbb0 con 0x7f0930159440 2023-07-14T13:05:26.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f092ffff640 1 --2- 172.21.15.5:0/2222669444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09200047d0 0x7f0920004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:26.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f0934992640 1 --2- 172.21.15.5:0/2222669444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0920003b40 0x7f0920003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:26.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f0935193640 1 --2- 172.21.15.5:0/2222669444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0930159440 0x7f0920005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:26.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f092ffff640 1 -- 172.21.15.5:0/2222669444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0930159440 msgr2=0x7f0920005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:26.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f092ffff640 1 --2- 172.21.15.5:0/2222669444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0930159440 0x7f0920005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:26.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f092ffff640 1 -- 172.21.15.5:0/2222669444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0920003b40 msgr2=0x7f0920003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:26.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f092ffff640 1 --2- 172.21.15.5:0/2222669444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0920003b40 0x7f0920003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:26.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.003+0000 7f092ffff640 1 -- 172.21.15.5:0/2222669444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0928009a70 con 0x7f09200047d0 2023-07-14T13:05:26.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.007+0000 7f092ffff640 1 --2- 172.21.15.5:0/2222669444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09200047d0 0x7f0920004c40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f091c0018d0 tx=0x7f091c01ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba022e4f6256dd78 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:26.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.007+0000 7f092f7fe640 1 -- 172.21.15.5:0/2222669444 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c0052d0 con 0x7f09200047d0 2023-07-14T13:05:26.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.007+0000 7f092f7fe640 1 -- 172.21.15.5:0/2222669444 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091c005450 con 0x7f09200047d0 2023-07-14T13:05:26.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.007+0000 7f092f7fe640 1 -- 172.21.15.5:0/2222669444 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c0a8870 con 0x7f09200047d0 2023-07-14T13:05:26.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.007+0000 7f0936bf6640 1 -- 172.21.15.5:0/2222669444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09200047d0 msgr2=0x7f0920004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:26.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.007+0000 7f0936bf6640 1 --2- 172.21.15.5:0/2222669444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09200047d0 0x7f0920004c40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f091c0018d0 tx=0x7f091c01ec10 comp rx=0 tx=0).stop 2023-07-14T13:05:26.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.007+0000 7f0935193640 1 -- 172.21.15.5:0/2222669444 reap_dead start 2023-07-14T13:05:26.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.007+0000 7f0936bf6640 1 -- 172.21.15.5:0/2222669444 shutdown_connections 2023-07-14T13:05:26.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.007+0000 7f0936bf6640 1 -- 172.21.15.5:0/2222669444 >> 172.21.15.5:0/2222669444 conn(0x7f09300cde90 msgr2=0x7f09300ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:26.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.007+0000 7f0936bf6640 1 -- 172.21.15.5:0/2222669444 shutdown_connections 2023-07-14T13:05:26.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.007+0000 7f0936bf6640 1 -- 172.21.15.5:0/2222669444 wait complete. 2023-07-14T13:05:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.007+0000 7f0936bf6640 1 Processor -- start 2023-07-14T13:05:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.007+0000 7f0936bf6640 1 -- start start 2023-07-14T13:05:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.011+0000 7f0936bf6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09200047d0 0x7f0930070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.011+0000 7f0936bf6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f093006f060 0x7f093006b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.011+0000 7f0936bf6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f093006b730 0x7f0930157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.011+0000 7f0936bf6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09301f4740 con 0x7f093006f060 2023-07-14T13:05:26.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.011+0000 7f0936bf6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093006f560 con 0x7f09200047d0 2023-07-14T13:05:26.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.011+0000 7f0936bf6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093006f840 con 0x7f093006b730 2023-07-14T13:05:26.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.011+0000 7f092ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f093006f060 0x7f093006b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:26.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.011+0000 7f092ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f093006f060 0x7f093006b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50382/0 (socket says 172.21.15.5:50382) 2023-07-14T13:05:26.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.011+0000 7f092ffff640 1 -- 172.21.15.5:0/214446421 learned_addr learned my addr 172.21.15.5:0/214446421 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:26.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.011+0000 7f0934992640 1 --2- 172.21.15.5:0/214446421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09200047d0 0x7f0930070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:26.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.011+0000 7f0935193640 1 --2- 172.21.15.5:0/214446421 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f093006b730 0x7f0930157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:26.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.011+0000 7f092ffff640 1 -- 172.21.15.5:0/214446421 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f093006b730 msgr2=0x7f0930157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:26.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.011+0000 7f092ffff640 1 --2- 172.21.15.5:0/214446421 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f093006b730 0x7f0930157b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:26.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.011+0000 7f092ffff640 1 -- 172.21.15.5:0/214446421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09200047d0 msgr2=0x7f0930070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:26.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.011+0000 7f092ffff640 1 --2- 172.21.15.5:0/214446421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09200047d0 0x7f0930070dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:26.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.011+0000 7f092ffff640 1 -- 172.21.15.5:0/214446421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093006fb20 con 0x7f093006f060 2023-07-14T13:05:26.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.011+0000 7f0934992640 1 --2- 172.21.15.5:0/214446421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09200047d0 0x7f0930070dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:05:26.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.011+0000 7f092ffff640 1 --2- 172.21.15.5:0/214446421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f093006f060 0x7f093006b1f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f091c0018d0 tx=0x7f0920005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:26.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.011+0000 7f092d7fa640 1 -- 172.21.15.5:0/214446421 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c0a8d60 con 0x7f093006f060 2023-07-14T13:05:26.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.011+0000 7f092d7fa640 1 -- 172.21.15.5:0/214446421 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091c0050d0 con 0x7f093006f060 2023-07-14T13:05:26.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.011+0000 7f092d7fa640 1 -- 172.21.15.5:0/214446421 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c003600 con 0x7f093006f060 2023-07-14T13:05:26.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.011+0000 7f0936bf6640 1 -- 172.21.15.5:0/214446421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f093006fe00 con 0x7f093006f060 2023-07-14T13:05:26.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.011+0000 7f0936bf6640 1 -- 172.21.15.5:0/214446421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0930158060 con 0x7f093006f060 2023-07-14T13:05:26.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.011+0000 7f0936bf6640 1 -- 172.21.15.5:0/214446421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09300678d0 con 0x7f093006f060 2023-07-14T13:05:26.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.011+0000 7f092d7fa640 1 -- 172.21.15.5:0/214446421 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f091c003760 con 0x7f093006f060 2023-07-14T13:05:26.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.015+0000 7f092d7fa640 1 --2- 172.21.15.5:0/214446421 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f09140664a0 0x7f0914068950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:26.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.015+0000 7f092d7fa640 1 -- 172.21.15.5:0/214446421 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f091c120fd0 con 0x7f093006f060 2023-07-14T13:05:26.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.015+0000 7f0934992640 1 --2- 172.21.15.5:0/214446421 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f09140664a0 0x7f0914068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:26.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.015+0000 7f0934992640 1 --2- 172.21.15.5:0/214446421 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f09140664a0 0x7f0914068950 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0924001ec0 tx=0x7f0924009040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:26.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.019+0000 7f092d7fa640 1 -- 172.21.15.5:0/214446421 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f091c0ee010 con 0x7f093006f060 2023-07-14T13:05:26.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.191+0000 7f0936bf6640 1 -- 172.21.15.5:0/214446421 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f093015c410 con 0x7f09140664a0 2023-07-14T13:05:26.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.199+0000 7f092d7fa640 1 -- 172.21.15.5:0/214446421 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f0924000ee0 con 0x7f09140664a0 2023-07-14T13:05:26.231 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:05:26.231 INFO:teuthology.orchestra.run.smithi005.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T12:54:03", "first": "2023-07-14T12:55:00", "last": "2023-07-14T13:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-14T13:05:26.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.203+0000 7f0936bf6640 1 -- 172.21.15.5:0/214446421 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f09140664a0 msgr2=0x7f0914068950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:26.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.203+0000 7f0936bf6640 1 --2- 172.21.15.5:0/214446421 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f09140664a0 0x7f0914068950 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0924001ec0 tx=0x7f0924009040 comp rx=0 tx=0).stop 2023-07-14T13:05:26.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.203+0000 7f0936bf6640 1 -- 172.21.15.5:0/214446421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f093006f060 msgr2=0x7f093006b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:26.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.203+0000 7f0936bf6640 1 --2- 172.21.15.5:0/214446421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f093006f060 0x7f093006b1f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f091c0018d0 tx=0x7f0920005800 comp rx=0 tx=0).stop 2023-07-14T13:05:26.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.203+0000 7f0936bf6640 1 -- 172.21.15.5:0/214446421 shutdown_connections 2023-07-14T13:05:26.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.203+0000 7f0936bf6640 1 --2- 172.21.15.5:0/214446421 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f09140664a0 0x7f0914068950 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:26.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.203+0000 7f0936bf6640 1 --2- 172.21.15.5:0/214446421 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f093006b730 0x7f0930157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:26.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.203+0000 7f0936bf6640 1 --2- 172.21.15.5:0/214446421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f093006f060 0x7f093006b1f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:26.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.203+0000 7f0936bf6640 1 --2- 172.21.15.5:0/214446421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09200047d0 0x7f0930070dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:26.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.203+0000 7f0936bf6640 1 -- 172.21.15.5:0/214446421 >> 172.21.15.5:0/214446421 conn(0x7f09300cde90 msgr2=0x7f09300c8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:26.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.203+0000 7f0936bf6640 1 -- 172.21.15.5:0/214446421 shutdown_connections 2023-07-14T13:05:26.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.203+0000 7f0936bf6640 1 -- 172.21.15.5:0/214446421 wait complete. 2023-07-14T13:05:26.251 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T12:54:03", "first": "2023-07-14T12:55:00", "last": "2023-07-14T13:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-14T13:05:26.252 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir4', 'rel_path': '/snap_test_dir1/dir4', 'schedule': '1M', 'retention': {}, 'start': '2023-07-14T00:00:00', 'created': '2023-07-14T12:54:03', 'first': '2023-07-14T12:55:00', 'last': '2023-07-14T13:05:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-14T13:05:26.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:26.253 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-07-14T13:05:26.262 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_55_00_UTC 2023-07-14T13:05:26.263 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:26.263 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:26.263 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:26.263 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:26.263 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:26.263 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_01_01_UTC 2023-07-14T13:05:26.264 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:26.264 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_03_00_UTC 2023-07-14T13:05:26.264 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:26.264 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:26.265 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-14-12_55_00_UTC', 'scheduled-2023-07-14-12_56_00_UTC', 'scheduled-2023-07-14-12_57_00_UTC', 'scheduled-2023-07-14-12_58_00_UTC', 'scheduled-2023-07-14-12_59_00_UTC', 'scheduled-2023-07-14-13_00_00_UTC', 'scheduled-2023-07-14-13_01_01_UTC', 'scheduled-2023-07-14-13_02_00_UTC', 'scheduled-2023-07-14-13_03_00_UTC', 'scheduled-2023-07-14-13_04_00_UTC', 'scheduled-2023-07-14-13_05_00_UTC'] 2023-07-14T13:05:26.265 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir5 2023-07-14T13:05:26.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.427+0000 7fba2120b640 1 Processor -- start 2023-07-14T13:05:26.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.427+0000 7fba2120b640 1 -- start start 2023-07-14T13:05:26.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.431+0000 7fba2120b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c069430 0x7fba1c069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:26.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.431+0000 7fba2120b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fba1c070f30 0x7fba1c0ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:26.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.431+0000 7fba2120b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1c159d70 con 0x7fba1c0af2b0 2023-07-14T13:05:26.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.431+0000 7fba2120b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1c069d40 con 0x7fba1c070f30 2023-07-14T13:05:26.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.431+0000 7fba2120b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c0c9c60 con 0x7fba1c069430 2023-07-14T13:05:26.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.431+0000 7fba13fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fba1c070f30 0x7fba1c0ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:26.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.431+0000 7fba13fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fba1c070f30 0x7fba1c0ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50390/0 (socket says 172.21.15.5:50390) 2023-07-14T13:05:26.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.431+0000 7fba13fff640 1 -- 172.21.15.5:0/301512561 learned_addr learned my addr 172.21.15.5:0/301512561 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:26.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.431+0000 7fba13fff640 1 -- 172.21.15.5:0/301512561 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c069430 msgr2=0x7fba1c069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:26.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.431+0000 7fba1ad9d640 1 --2- 172.21.15.5:0/301512561 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c069430 0x7fba1c069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:26.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.431+0000 7fba13fff640 1 --2- 172.21.15.5:0/301512561 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c069430 0x7fba1c069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:26.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.431+0000 7fba13fff640 1 -- 172.21.15.5:0/301512561 >> v1:172.21.15.5:6789/0 conn(0x7fba1c0af2b0 legacy=0x7fba1c15a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:26.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.431+0000 7fba13fff640 1 -- 172.21.15.5:0/301512561 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1c0c9f40 con 0x7fba1c070f30 2023-07-14T13:05:26.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.431+0000 7fba1ad9d640 1 --2- 172.21.15.5:0/301512561 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c069430 0x7fba1c069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:05:26.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.435+0000 7fba13fff640 1 --2- 172.21.15.5:0/301512561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba1c070f30 0x7fba1c0ad6f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fba04009870 tx=0x7fba0401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12adc0814fbc3ebf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:26.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.435+0000 7fba1a59c640 1 -- 172.21.15.5:0/301512561 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba040a9400 con 0x7fba1c070f30 2023-07-14T13:05:26.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.435+0000 7fba1a59c640 1 -- 172.21.15.5:0/301512561 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba040a9560 con 0x7fba1c070f30 2023-07-14T13:05:26.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.435+0000 7fba1a59c640 1 -- 172.21.15.5:0/301512561 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba040a98f0 con 0x7fba1c070f30 2023-07-14T13:05:26.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.435+0000 7fba2120b640 1 -- 172.21.15.5:0/301512561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba1c070f30 msgr2=0x7fba1c0ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:26.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.435+0000 7fba2120b640 1 --2- 172.21.15.5:0/301512561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba1c070f30 0x7fba1c0ad6f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fba04009870 tx=0x7fba0401c540 comp rx=0 tx=0).stop 2023-07-14T13:05:26.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.435+0000 7fba2120b640 1 -- 172.21.15.5:0/301512561 shutdown_connections 2023-07-14T13:05:26.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.435+0000 7fba2120b640 1 --2- 172.21.15.5:0/301512561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba1c070f30 0x7fba1c0ad6f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:26.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.435+0000 7fba2120b640 1 --2- 172.21.15.5:0/301512561 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c069430 0x7fba1c069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:26.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.435+0000 7fba2120b640 1 -- 172.21.15.5:0/301512561 >> 172.21.15.5:0/301512561 conn(0x7fba1c0cde90 msgr2=0x7fba1c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:26.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.435+0000 7fba2120b640 1 -- 172.21.15.5:0/301512561 shutdown_connections 2023-07-14T13:05:26.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.435+0000 7fba2120b640 1 -- 172.21.15.5:0/301512561 wait complete. 2023-07-14T13:05:26.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.435+0000 7fba2120b640 1 Processor -- start 2023-07-14T13:05:26.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.435+0000 7fba2120b640 1 -- start start 2023-07-14T13:05:26.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.439+0000 7fba2120b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba1c069430 0x7fba1c157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:26.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.439+0000 7fba2120b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c070f30 0x7fba1c0b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:26.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.439+0000 7fba2120b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba1c0af2b0 0x7fba1c1f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:26.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.439+0000 7fba2120b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c1529a0 con 0x7fba1c069430 2023-07-14T13:05:26.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.439+0000 7fba2120b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c151d90 con 0x7fba1c0af2b0 2023-07-14T13:05:26.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.439+0000 7fba2120b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c152070 con 0x7fba1c070f30 2023-07-14T13:05:26.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.439+0000 7fba1ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba1c069430 0x7fba1c157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:26.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.439+0000 7fba1ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba1c069430 0x7fba1c157be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50392/0 (socket says 172.21.15.5:50392) 2023-07-14T13:05:26.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.439+0000 7fba1ad9d640 1 -- 172.21.15.5:0/944178755 learned_addr learned my addr 172.21.15.5:0/944178755 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:26.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.439+0000 7fba13fff640 1 --2- 172.21.15.5:0/944178755 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c070f30 0x7fba1c0b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:26.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.439+0000 7fba1b59e640 1 --2- 172.21.15.5:0/944178755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba1c0af2b0 0x7fba1c1f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:26.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.439+0000 7fba1ad9d640 1 -- 172.21.15.5:0/944178755 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c070f30 msgr2=0x7fba1c0b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:26.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.439+0000 7fba1ad9d640 1 --2- 172.21.15.5:0/944178755 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c070f30 0x7fba1c0b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:26.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.439+0000 7fba1ad9d640 1 -- 172.21.15.5:0/944178755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba1c0af2b0 msgr2=0x7fba1c1f57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:26.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.439+0000 7fba1ad9d640 1 --2- 172.21.15.5:0/944178755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba1c0af2b0 0x7fba1c1f57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:26.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.439+0000 7fba1ad9d640 1 -- 172.21.15.5:0/944178755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba040094d0 con 0x7fba1c069430 2023-07-14T13:05:26.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.439+0000 7fba1ad9d640 1 --2- 172.21.15.5:0/944178755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba1c069430 0x7fba1c157be0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00c7f0 tx=0x7fba0c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:26.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.439+0000 7fba137fe640 1 -- 172.21.15.5:0/944178755 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c007820 con 0x7fba1c069430 2023-07-14T13:05:26.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.439+0000 7fba137fe640 1 -- 172.21.15.5:0/944178755 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0c007980 con 0x7fba1c069430 2023-07-14T13:05:26.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.439+0000 7fba2120b640 1 -- 172.21.15.5:0/944178755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba1c152350 con 0x7fba1c069430 2023-07-14T13:05:26.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.439+0000 7fba137fe640 1 -- 172.21.15.5:0/944178755 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c007d30 con 0x7fba1c069430 2023-07-14T13:05:26.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.439+0000 7fba2120b640 1 -- 172.21.15.5:0/944178755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1c158120 con 0x7fba1c069430 2023-07-14T13:05:26.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.439+0000 7fba2120b640 1 -- 172.21.15.5:0/944178755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba1c158370 con 0x7fba1c069430 2023-07-14T13:05:26.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.439+0000 7fba137fe640 1 -- 172.21.15.5:0/944178755 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fba0c0113f0 con 0x7fba1c069430 2023-07-14T13:05:26.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.443+0000 7fba137fe640 1 --2- 172.21.15.5:0/944178755 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fb9fc066480 0x7fb9fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:26.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.443+0000 7fba137fe640 1 -- 172.21.15.5:0/944178755 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fba0c084590 con 0x7fba1c069430 2023-07-14T13:05:26.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.443+0000 7fba13fff640 1 --2- 172.21.15.5:0/944178755 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fb9fc066480 0x7fb9fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:26.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.443+0000 7fba13fff640 1 --2- 172.21.15.5:0/944178755 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fb9fc066480 0x7fb9fc068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fba040ae000 tx=0x7fba04008040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:26.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.447+0000 7fba137fe640 1 -- 172.21.15.5:0/944178755 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fba0c051630 con 0x7fba1c069430 2023-07-14T13:05:26.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.619+0000 7fba2120b640 1 -- 172.21.15.5:0/944178755 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fba1c0ca500 con 0x7fb9fc066480 2023-07-14T13:05:26.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.627+0000 7fba137fe640 1 -- 172.21.15.5:0/944178755 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fba040a9890 con 0x7fb9fc066480 2023-07-14T13:05:26.659 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:05:26.660 INFO:teuthology.orchestra.run.smithi005.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T12:54:03", "first": "2023-07-14T12:55:00", "last": "2023-07-14T13:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-14T13:05:26.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.631+0000 7fba2120b640 1 -- 172.21.15.5:0/944178755 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fb9fc066480 msgr2=0x7fb9fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:26.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.631+0000 7fba2120b640 1 --2- 172.21.15.5:0/944178755 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fb9fc066480 0x7fb9fc068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fba040ae000 tx=0x7fba04008040 comp rx=0 tx=0).stop 2023-07-14T13:05:26.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.631+0000 7fba2120b640 1 -- 172.21.15.5:0/944178755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba1c069430 msgr2=0x7fba1c157be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:26.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.631+0000 7fba2120b640 1 --2- 172.21.15.5:0/944178755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba1c069430 0x7fba1c157be0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00c7f0 tx=0x7fba0c00ccb0 comp rx=0 tx=0).stop 2023-07-14T13:05:26.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.631+0000 7fba2120b640 1 -- 172.21.15.5:0/944178755 shutdown_connections 2023-07-14T13:05:26.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.631+0000 7fba2120b640 1 --2- 172.21.15.5:0/944178755 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fb9fc066480 0x7fb9fc068930 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:26.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.631+0000 7fba2120b640 1 --2- 172.21.15.5:0/944178755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba1c0af2b0 0x7fba1c1f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:26.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.631+0000 7fba2120b640 1 --2- 172.21.15.5:0/944178755 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba1c070f30 0x7fba1c0b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:26.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.631+0000 7fba2120b640 1 --2- 172.21.15.5:0/944178755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba1c069430 0x7fba1c157be0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:26.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.631+0000 7fba2120b640 1 -- 172.21.15.5:0/944178755 >> 172.21.15.5:0/944178755 conn(0x7fba1c0cde90 msgr2=0x7fba1c0cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:26.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.631+0000 7fba2120b640 1 -- 172.21.15.5:0/944178755 shutdown_connections 2023-07-14T13:05:26.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.631+0000 7fba2120b640 1 -- 172.21.15.5:0/944178755 wait complete. 2023-07-14T13:05:26.681 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T12:54:03", "first": "2023-07-14T12:55:00", "last": "2023-07-14T13:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-14T13:05:26.682 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir5', 'rel_path': '/snap_test_dir1/dir5', 'schedule': '1M', 'retention': {}, 'start': '2023-07-14T00:00:00', 'created': '2023-07-14T12:54:03', 'first': '2023-07-14T12:55:00', 'last': '2023-07-14T13:05:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-14T13:05:26.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:26.683 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-07-14T13:05:26.694 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_55_00_UTC 2023-07-14T13:05:26.694 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:26.695 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:26.695 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:26.695 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:26.696 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:26.696 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_01_01_UTC 2023-07-14T13:05:26.696 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:26.696 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_03_01_UTC 2023-07-14T13:05:26.697 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:26.697 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:26.698 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-14-12_55_00_UTC', 'scheduled-2023-07-14-12_56_00_UTC', 'scheduled-2023-07-14-12_57_00_UTC', 'scheduled-2023-07-14-12_58_00_UTC', 'scheduled-2023-07-14-12_59_00_UTC', 'scheduled-2023-07-14-13_00_00_UTC', 'scheduled-2023-07-14-13_01_01_UTC', 'scheduled-2023-07-14-13_02_00_UTC', 'scheduled-2023-07-14-13_03_01_UTC', 'scheduled-2023-07-14-13_04_00_UTC', 'scheduled-2023-07-14-13_05_00_UTC'] 2023-07-14T13:05:26.699 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir6 2023-07-14T13:05:26.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.855+0000 7f31c9737640 1 Processor -- start 2023-07-14T13:05:26.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.855+0000 7f31c9737640 1 -- start start 2023-07-14T13:05:26.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.859+0000 7f31c9737640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31c40aeb40 0x7f31c415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:26.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.859+0000 7f31c9737640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f31c40aef10 0x7f31c4158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:26.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.859+0000 7f31c9737640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c41532b0 con 0x7f31c4159270 2023-07-14T13:05:26.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.859+0000 7f31c9737640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c40ca6f0 con 0x7f31c40aef10 2023-07-14T13:05:26.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.859+0000 7f31c9737640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c41599d0 con 0x7f31c40aeb40 2023-07-14T13:05:26.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.859+0000 7f31c2ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31c40aeb40 0x7f31c415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:26.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.859+0000 7f31c2ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31c40aeb40 0x7f31c415cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:41826/0 (socket says 172.21.15.5:41826) 2023-07-14T13:05:26.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.859+0000 7f31c2ffd640 1 -- 172.21.15.5:0/106953865 learned_addr learned my addr 172.21.15.5:0/106953865 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:26.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.859+0000 7f31c37fe640 1 --1- 172.21.15.5:0/106953865 >> v1:172.21.15.154:6789/0 conn(0x7f31c4159270 0x7f31c40c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:42252/0 (socket says 172.21.15.5:42252) 2023-07-14T13:05:26.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.859+0000 7f31bbfff640 1 --2- 172.21.15.5:0/106953865 >> v2:172.21.15.154:3300/0 conn(0x7f31c40aef10 0x7f31c4158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:26.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.859+0000 7f31c27fc640 1 -- 172.21.15.5:0/106953865 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98387113 0 0) 0x7f31c41532b0 con 0x7f31c4159270 2023-07-14T13:05:26.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.859+0000 7f31bbfff640 1 -- 172.21.15.5:0/106953865 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31c40aeb40 msgr2=0x7f31c415cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:26.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.859+0000 7f31bbfff640 1 --2- 172.21.15.5:0/106953865 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31c40aeb40 0x7f31c415cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:26.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.859+0000 7f31bbfff640 1 -- 172.21.15.5:0/106953865 >> v1:172.21.15.154:6789/0 conn(0x7f31c4159270 legacy=0x7f31c40c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:26.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.859+0000 7f31bbfff640 1 -- 172.21.15.5:0/106953865 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c4159cb0 con 0x7f31c40aef10 2023-07-14T13:05:26.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.859+0000 7f31c2ffd640 1 --2- 172.21.15.5:0/106953865 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31c40aeb40 0x7f31c415cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:26.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.863+0000 7f31bbfff640 1 --2- 172.21.15.5:0/106953865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31c40aef10 0x7f31c4158d30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0097c0 tx=0x7f31ac01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51f806be1d268799 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:26.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.863+0000 7f31c27fc640 1 -- 172.21.15.5:0/106953865 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac0ac620 con 0x7f31c40aef10 2023-07-14T13:05:26.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.863+0000 7f31c27fc640 1 -- 172.21.15.5:0/106953865 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ac0ac780 con 0x7f31c40aef10 2023-07-14T13:05:26.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.863+0000 7f31c27fc640 1 -- 172.21.15.5:0/106953865 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac0acb10 con 0x7f31c40aef10 2023-07-14T13:05:26.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.863+0000 7f31c9737640 1 -- 172.21.15.5:0/106953865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31c40aef10 msgr2=0x7f31c4158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:26.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.863+0000 7f31c9737640 1 --2- 172.21.15.5:0/106953865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31c40aef10 0x7f31c4158d30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0097c0 tx=0x7f31ac01c3c0 comp rx=0 tx=0).stop 2023-07-14T13:05:26.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.863+0000 7f31c9737640 1 -- 172.21.15.5:0/106953865 shutdown_connections 2023-07-14T13:05:26.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.863+0000 7f31c9737640 1 --2- 172.21.15.5:0/106953865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31c40aef10 0x7f31c4158d30 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:26.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.863+0000 7f31c9737640 1 --2- 172.21.15.5:0/106953865 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31c40aeb40 0x7f31c415cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:26.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.863+0000 7f31c9737640 1 -- 172.21.15.5:0/106953865 >> 172.21.15.5:0/106953865 conn(0x7f31c40cde90 msgr2=0x7f31c40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:26.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.863+0000 7f31c9737640 1 -- 172.21.15.5:0/106953865 shutdown_connections 2023-07-14T13:05:26.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.863+0000 7f31c9737640 1 -- 172.21.15.5:0/106953865 wait complete. 2023-07-14T13:05:26.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.863+0000 7f31c9737640 1 Processor -- start 2023-07-14T13:05:26.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.863+0000 7f31c9737640 1 -- start start 2023-07-14T13:05:26.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.863+0000 7f31c9737640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31c40aeb40 0x7f31c4155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:26.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.867+0000 7f31c9737640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31c40aef10 0x7f31c406b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:26.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.867+0000 7f31c9737640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31c4159270 0x7f31c41532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:26.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.867+0000 7f31c9737640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c406c830 con 0x7f31c40aeb40 2023-07-14T13:05:26.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.867+0000 7f31c9737640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c406bbb0 con 0x7f31c40aef10 2023-07-14T13:05:26.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.867+0000 7f31c9737640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c406be90 con 0x7f31c4159270 2023-07-14T13:05:26.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.867+0000 7f31c2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31c40aeb40 0x7f31c4155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:26.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.867+0000 7f31c2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31c40aeb40 0x7f31c4155a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50404/0 (socket says 172.21.15.5:50404) 2023-07-14T13:05:26.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.867+0000 7f31c2ffd640 1 -- 172.21.15.5:0/4010906247 learned_addr learned my addr 172.21.15.5:0/4010906247 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:26.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.867+0000 7f31bbfff640 1 --2- 172.21.15.5:0/4010906247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31c40aef10 0x7f31c406b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:26.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.867+0000 7f31c37fe640 1 --2- 172.21.15.5:0/4010906247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31c4159270 0x7f31c41532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:26.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.867+0000 7f31c2ffd640 1 -- 172.21.15.5:0/4010906247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31c4159270 msgr2=0x7f31c41532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:26.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.867+0000 7f31c2ffd640 1 --2- 172.21.15.5:0/4010906247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31c4159270 0x7f31c41532b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:26.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.867+0000 7f31c2ffd640 1 -- 172.21.15.5:0/4010906247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31c40aef10 msgr2=0x7f31c406b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:26.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.867+0000 7f31c2ffd640 1 --2- 172.21.15.5:0/4010906247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31c40aef10 0x7f31c406b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:26.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.867+0000 7f31c2ffd640 1 -- 172.21.15.5:0/4010906247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b400b770 con 0x7f31c40aeb40 2023-07-14T13:05:26.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.867+0000 7f31c37fe640 1 --2- 172.21.15.5:0/4010906247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31c4159270 0x7f31c41532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:05:26.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.867+0000 7f31c2ffd640 1 --2- 172.21.15.5:0/4010906247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31c40aeb40 0x7f31c4155a20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f31b400ed70 tx=0x7f31b400d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:26.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.867+0000 7f31bb7fe640 1 -- 172.21.15.5:0/4010906247 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b4010850 con 0x7f31c40aeb40 2023-07-14T13:05:26.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.867+0000 7f31bb7fe640 1 -- 172.21.15.5:0/4010906247 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b40109b0 con 0x7f31c40aeb40 2023-07-14T13:05:26.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.867+0000 7f31bb7fe640 1 -- 172.21.15.5:0/4010906247 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b4010d20 con 0x7f31c40aeb40 2023-07-14T13:05:26.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.867+0000 7f31c9737640 1 -- 172.21.15.5:0/4010906247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31ac009420 con 0x7f31c40aeb40 2023-07-14T13:05:26.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.867+0000 7f31c9737640 1 -- 172.21.15.5:0/4010906247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c406c450 con 0x7f31c40aeb40 2023-07-14T13:05:26.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.867+0000 7f31c9737640 1 -- 172.21.15.5:0/4010906247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c40678d0 con 0x7f31c40aeb40 2023-07-14T13:05:26.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.867+0000 7f31bb7fe640 1 -- 172.21.15.5:0/4010906247 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f31b400f3d0 con 0x7f31c40aeb40 2023-07-14T13:05:26.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.871+0000 7f31bb7fe640 1 --2- 172.21.15.5:0/4010906247 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f31a4066480 0x7f31a4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:26.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.871+0000 7f31bb7fe640 1 -- 172.21.15.5:0/4010906247 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f31b40848d0 con 0x7f31c40aeb40 2023-07-14T13:05:26.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.871+0000 7f31bbfff640 1 --2- 172.21.15.5:0/4010906247 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f31a4066480 0x7f31a4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:26.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.871+0000 7f31bbfff640 1 --2- 172.21.15.5:0/4010906247 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f31a4066480 0x7f31a4068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0ae000 tx=0x7f31ac008040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:26.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:26.871+0000 7f31bb7fe640 1 -- 172.21.15.5:0/4010906247 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f31b4051890 con 0x7f31c40aeb40 2023-07-14T13:05:27.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.047+0000 7f31c9737640 1 -- 172.21.15.5:0/4010906247 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f31c41552e0 con 0x7f31a4066480 2023-07-14T13:05:27.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.055+0000 7f31bb7fe640 1 -- 172.21.15.5:0/4010906247 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f31c41552e0 con 0x7f31a4066480 2023-07-14T13:05:27.087 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:05:27.087 INFO:teuthology.orchestra.run.smithi005.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T12:54:04", "first": "2023-07-14T12:55:00", "last": "2023-07-14T13:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-14T13:05:27.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.059+0000 7f31c9737640 1 -- 172.21.15.5:0/4010906247 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f31a4066480 msgr2=0x7f31a4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:27.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.059+0000 7f31c9737640 1 --2- 172.21.15.5:0/4010906247 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f31a4066480 0x7f31a4068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0ae000 tx=0x7f31ac008040 comp rx=0 tx=0).stop 2023-07-14T13:05:27.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.059+0000 7f31c9737640 1 -- 172.21.15.5:0/4010906247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31c40aeb40 msgr2=0x7f31c4155a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:27.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.059+0000 7f31c9737640 1 --2- 172.21.15.5:0/4010906247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31c40aeb40 0x7f31c4155a20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f31b400ed70 tx=0x7f31b400d720 comp rx=0 tx=0).stop 2023-07-14T13:05:27.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.059+0000 7f31c9737640 1 -- 172.21.15.5:0/4010906247 shutdown_connections 2023-07-14T13:05:27.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.059+0000 7f31c9737640 1 --2- 172.21.15.5:0/4010906247 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f31a4066480 0x7f31a4068930 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:27.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.059+0000 7f31c9737640 1 --2- 172.21.15.5:0/4010906247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31c4159270 0x7f31c41532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:27.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.059+0000 7f31c9737640 1 --2- 172.21.15.5:0/4010906247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31c40aef10 0x7f31c406b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:27.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.059+0000 7f31c9737640 1 --2- 172.21.15.5:0/4010906247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31c40aeb40 0x7f31c4155a20 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:27.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.059+0000 7f31c9737640 1 -- 172.21.15.5:0/4010906247 >> 172.21.15.5:0/4010906247 conn(0x7f31c40cde90 msgr2=0x7f31c40c3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:27.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.059+0000 7f31c9737640 1 -- 172.21.15.5:0/4010906247 shutdown_connections 2023-07-14T13:05:27.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.059+0000 7f31c9737640 1 -- 172.21.15.5:0/4010906247 wait complete. 2023-07-14T13:05:27.108 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T12:54:04", "first": "2023-07-14T12:55:00", "last": "2023-07-14T13:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-14T13:05:27.108 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir6', 'rel_path': '/snap_test_dir1/dir6', 'schedule': '1M', 'retention': {}, 'start': '2023-07-14T00:00:00', 'created': '2023-07-14T12:54:04', 'first': '2023-07-14T12:55:00', 'last': '2023-07-14T13:05:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-14T13:05:27.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:27.109 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-07-14T13:05:27.119 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_55_00_UTC 2023-07-14T13:05:27.120 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:27.120 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:27.120 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:27.120 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:27.120 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:27.120 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_01_01_UTC 2023-07-14T13:05:27.121 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:27.121 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_03_00_UTC 2023-07-14T13:05:27.121 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:27.121 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:27.122 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-14-12_55_00_UTC', 'scheduled-2023-07-14-12_56_00_UTC', 'scheduled-2023-07-14-12_57_00_UTC', 'scheduled-2023-07-14-12_58_00_UTC', 'scheduled-2023-07-14-12_59_00_UTC', 'scheduled-2023-07-14-13_00_00_UTC', 'scheduled-2023-07-14-13_01_01_UTC', 'scheduled-2023-07-14-13_02_00_UTC', 'scheduled-2023-07-14-13_03_00_UTC', 'scheduled-2023-07-14-13_04_00_UTC', 'scheduled-2023-07-14-13_05_00_UTC'] 2023-07-14T13:05:27.122 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir7 2023-07-14T13:05:27.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.279+0000 7f58cce93640 1 Processor -- start 2023-07-14T13:05:27.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.279+0000 7f58cce93640 1 -- start start 2023-07-14T13:05:27.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.283+0000 7f58cce93640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f58c8069430 0x7f58c8069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.283+0000 7f58cce93640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58c8070f30 0x7f58c80ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.283+0000 7f58cce93640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c8159d70 con 0x7f58c80af2b0 2023-07-14T13:05:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.283+0000 7f58cce93640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c8069d40 con 0x7f58c8069430 2023-07-14T13:05:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.283+0000 7f58cce93640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c80c9c60 con 0x7f58c8070f30 2023-07-14T13:05:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.283+0000 7f58c659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f58c8069430 0x7f58c8069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.283+0000 7f58c659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f58c8069430 0x7f58c8069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50416/0 (socket says 172.21.15.5:50416) 2023-07-14T13:05:27.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.283+0000 7f58c659c640 1 -- 172.21.15.5:0/3915407701 learned_addr learned my addr 172.21.15.5:0/3915407701 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:27.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.283+0000 7f58c5d9b640 1 --2- 172.21.15.5:0/3915407701 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58c8070f30 0x7f58c80ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:27.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.283+0000 7f58c659c640 1 -- 172.21.15.5:0/3915407701 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58c8070f30 msgr2=0x7f58c80ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:27.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.283+0000 7f58c659c640 1 --2- 172.21.15.5:0/3915407701 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58c8070f30 0x7f58c80ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:27.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.283+0000 7f58c659c640 1 -- 172.21.15.5:0/3915407701 >> v1:172.21.15.154:6789/0 conn(0x7f58c80af2b0 legacy=0x7f58c815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:27.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.283+0000 7f58c659c640 1 -- 172.21.15.5:0/3915407701 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c80c9f40 con 0x7f58c8069430 2023-07-14T13:05:27.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.287+0000 7f58c659c640 1 --2- 172.21.15.5:0/3915407701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58c8069430 0x7f58c8069800 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009870 tx=0x7f58b801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c363ab507b94e90 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:27.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.287+0000 7f58c559a640 1 -- 172.21.15.5:0/3915407701 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b80ab650 con 0x7f58c8069430 2023-07-14T13:05:27.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.287+0000 7f58c559a640 1 -- 172.21.15.5:0/3915407701 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b80ab7b0 con 0x7f58c8069430 2023-07-14T13:05:27.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.287+0000 7f58c559a640 1 -- 172.21.15.5:0/3915407701 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b80abb40 con 0x7f58c8069430 2023-07-14T13:05:27.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.287+0000 7f58cce93640 1 -- 172.21.15.5:0/3915407701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58c8069430 msgr2=0x7f58c8069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:27.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.287+0000 7f58cce93640 1 --2- 172.21.15.5:0/3915407701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58c8069430 0x7f58c8069800 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009870 tx=0x7f58b801c540 comp rx=0 tx=0).stop 2023-07-14T13:05:27.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.287+0000 7f58cce93640 1 -- 172.21.15.5:0/3915407701 shutdown_connections 2023-07-14T13:05:27.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.287+0000 7f58cce93640 1 --2- 172.21.15.5:0/3915407701 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58c8070f30 0x7f58c80ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:27.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.287+0000 7f58cce93640 1 --2- 172.21.15.5:0/3915407701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58c8069430 0x7f58c8069800 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:27.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.287+0000 7f58cce93640 1 -- 172.21.15.5:0/3915407701 >> 172.21.15.5:0/3915407701 conn(0x7f58c80cde90 msgr2=0x7f58c80ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:27.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.287+0000 7f58cce93640 1 -- 172.21.15.5:0/3915407701 shutdown_connections 2023-07-14T13:05:27.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.287+0000 7f58cce93640 1 -- 172.21.15.5:0/3915407701 wait complete. 2023-07-14T13:05:27.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.287+0000 7f58cce93640 1 Processor -- start 2023-07-14T13:05:27.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.287+0000 7f58cce93640 1 -- start start 2023-07-14T13:05:27.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.291+0000 7f58cce93640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58c8069430 0x7f58c814e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:27.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.291+0000 7f58cce93640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58c8070f30 0x7f58c8153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:27.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.291+0000 7f58cce93640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58c80af2b0 0x7f58c8154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:27.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.291+0000 7f58cce93640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c8152540 con 0x7f58c8070f30 2023-07-14T13:05:27.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.291+0000 7f58cce93640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c814e9f0 con 0x7f58c8069430 2023-07-14T13:05:27.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.291+0000 7f58cce93640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c8151930 con 0x7f58c80af2b0 2023-07-14T13:05:27.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.291+0000 7f58c5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58c8070f30 0x7f58c8153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:27.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.291+0000 7f58c5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58c8070f30 0x7f58c8153b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50418/0 (socket says 172.21.15.5:50418) 2023-07-14T13:05:27.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.291+0000 7f58c5d9b640 1 -- 172.21.15.5:0/894637477 learned_addr learned my addr 172.21.15.5:0/894637477 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:27.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.291+0000 7f58c659c640 1 --2- 172.21.15.5:0/894637477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58c8069430 0x7f58c814e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:27.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.291+0000 7f58c6d9d640 1 --2- 172.21.15.5:0/894637477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58c80af2b0 0x7f58c8154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:27.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.291+0000 7f58c5d9b640 1 -- 172.21.15.5:0/894637477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58c80af2b0 msgr2=0x7f58c8154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:27.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.291+0000 7f58c5d9b640 1 --2- 172.21.15.5:0/894637477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58c80af2b0 0x7f58c8154070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:27.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.291+0000 7f58c5d9b640 1 -- 172.21.15.5:0/894637477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58c8069430 msgr2=0x7f58c814e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:27.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.291+0000 7f58c5d9b640 1 --2- 172.21.15.5:0/894637477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58c8069430 0x7f58c814e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:27.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.291+0000 7f58c5d9b640 1 -- 172.21.15.5:0/894637477 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b80094d0 con 0x7f58c8070f30 2023-07-14T13:05:27.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.291+0000 7f58c5d9b640 1 --2- 172.21.15.5:0/894637477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58c8070f30 0x7f58c8153b30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f58bc00d800 tx=0x7f58bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:27.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.291+0000 7f58b6ffd640 1 -- 172.21.15.5:0/894637477 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc00b6c0 con 0x7f58c8070f30 2023-07-14T13:05:27.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.291+0000 7f58b6ffd640 1 -- 172.21.15.5:0/894637477 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58bc00b860 con 0x7f58c8070f30 2023-07-14T13:05:27.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.291+0000 7f58cce93640 1 -- 172.21.15.5:0/894637477 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c8151c10 con 0x7f58c8070f30 2023-07-14T13:05:27.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.291+0000 7f58b6ffd640 1 -- 172.21.15.5:0/894637477 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc00bc10 con 0x7f58c8070f30 2023-07-14T13:05:27.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.291+0000 7f58cce93640 1 -- 172.21.15.5:0/894637477 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c81521d0 con 0x7f58c8070f30 2023-07-14T13:05:27.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.291+0000 7f58cce93640 1 -- 172.21.15.5:0/894637477 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c80678d0 con 0x7f58c8070f30 2023-07-14T13:05:27.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.291+0000 7f58b6ffd640 1 -- 172.21.15.5:0/894637477 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f58bc01e460 con 0x7f58c8070f30 2023-07-14T13:05:27.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.295+0000 7f58b6ffd640 1 --2- 172.21.15.5:0/894637477 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f58a8066480 0x7f58a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:27.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.295+0000 7f58b6ffd640 1 -- 172.21.15.5:0/894637477 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f58bc0846e0 con 0x7f58c8070f30 2023-07-14T13:05:27.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.295+0000 7f58c659c640 1 --2- 172.21.15.5:0/894637477 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f58a8066480 0x7f58a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:27.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.295+0000 7f58c659c640 1 --2- 172.21.15.5:0/894637477 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f58a8066480 0x7f58a8068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f58b80af000 tx=0x7f58b80b6040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:27.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.299+0000 7f58b6ffd640 1 -- 172.21.15.5:0/894637477 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f58bc051860 con 0x7f58c8070f30 2023-07-14T13:05:27.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.471+0000 7f58cce93640 1 -- 172.21.15.5:0/894637477 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f58c80adc30 con 0x7f58a8066480 2023-07-14T13:05:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.479+0000 7f58b6ffd640 1 -- 172.21.15.5:0/894637477 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f58b80ab920 con 0x7f58a8066480 2023-07-14T13:05:27.509 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:05:27.509 INFO:teuthology.orchestra.run.smithi005.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T12:54:04", "first": "2023-07-14T12:55:00", "last": "2023-07-14T13:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-14T13:05:27.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.479+0000 7f58cce93640 1 -- 172.21.15.5:0/894637477 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f58a8066480 msgr2=0x7f58a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:27.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.479+0000 7f58cce93640 1 --2- 172.21.15.5:0/894637477 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f58a8066480 0x7f58a8068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f58b80af000 tx=0x7f58b80b6040 comp rx=0 tx=0).stop 2023-07-14T13:05:27.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.479+0000 7f58cce93640 1 -- 172.21.15.5:0/894637477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58c8070f30 msgr2=0x7f58c8153b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:27.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.479+0000 7f58cce93640 1 --2- 172.21.15.5:0/894637477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58c8070f30 0x7f58c8153b30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f58bc00d800 tx=0x7f58bc00dcc0 comp rx=0 tx=0).stop 2023-07-14T13:05:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.479+0000 7f58cce93640 1 -- 172.21.15.5:0/894637477 shutdown_connections 2023-07-14T13:05:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.479+0000 7f58cce93640 1 --2- 172.21.15.5:0/894637477 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f58a8066480 0x7f58a8068930 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.479+0000 7f58cce93640 1 --2- 172.21.15.5:0/894637477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58c80af2b0 0x7f58c8154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.479+0000 7f58cce93640 1 --2- 172.21.15.5:0/894637477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58c8070f30 0x7f58c8153b30 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.479+0000 7f58cce93640 1 --2- 172.21.15.5:0/894637477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58c8069430 0x7f58c814e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.479+0000 7f58cce93640 1 -- 172.21.15.5:0/894637477 >> 172.21.15.5:0/894637477 conn(0x7f58c80cde90 msgr2=0x7f58c8157ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.483+0000 7f58cce93640 1 -- 172.21.15.5:0/894637477 shutdown_connections 2023-07-14T13:05:27.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.483+0000 7f58cce93640 1 -- 172.21.15.5:0/894637477 wait complete. 2023-07-14T13:05:27.530 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T12:54:04", "first": "2023-07-14T12:55:00", "last": "2023-07-14T13:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-14T13:05:27.531 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir7', 'rel_path': '/snap_test_dir1/dir7', 'schedule': '1M', 'retention': {}, 'start': '2023-07-14T00:00:00', 'created': '2023-07-14T12:54:04', 'first': '2023-07-14T12:55:00', 'last': '2023-07-14T13:05:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-14T13:05:27.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:27.531 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-07-14T13:05:27.541 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_55_00_UTC 2023-07-14T13:05:27.542 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:27.542 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:27.542 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:27.542 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:27.542 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:27.543 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_01_01_UTC 2023-07-14T13:05:27.543 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:27.543 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_03_00_UTC 2023-07-14T13:05:27.543 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:27.543 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:27.544 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-14-12_55_00_UTC', 'scheduled-2023-07-14-12_56_00_UTC', 'scheduled-2023-07-14-12_57_00_UTC', 'scheduled-2023-07-14-12_58_00_UTC', 'scheduled-2023-07-14-12_59_00_UTC', 'scheduled-2023-07-14-13_00_00_UTC', 'scheduled-2023-07-14-13_01_01_UTC', 'scheduled-2023-07-14-13_02_00_UTC', 'scheduled-2023-07-14-13_03_00_UTC', 'scheduled-2023-07-14-13_04_00_UTC', 'scheduled-2023-07-14-13_05_00_UTC'] 2023-07-14T13:05:27.544 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir8 2023-07-14T13:05:27.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.707+0000 7fe91c9fa640 1 Processor -- start 2023-07-14T13:05:27.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.707+0000 7fe91c9fa640 1 -- start start 2023-07-14T13:05:27.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.707+0000 7fe91c9fa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe91815bde0 0x7fe9180d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:27.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.707+0000 7fe91c9fa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9180b04c0 con 0x7fe9180d2300 2023-07-14T13:05:27.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.707+0000 7fe91c9fa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9180b1060 con 0x7fe9180d2fc0 2023-07-14T13:05:27.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.707+0000 7fe91c9fa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe91815c1b0 con 0x7fe91815bde0 2023-07-14T13:05:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.707+0000 7fe916d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe9180d2300 0x7fe9180cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49456/0 (socket says 172.21.15.5:49456) 2023-07-14T13:05:27.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.707+0000 7fe916d9d640 1 -- 172.21.15.5:0/450955178 learned_addr learned my addr 172.21.15.5:0/450955178 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:27.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.707+0000 7fe91659c640 1 --2- 172.21.15.5:0/450955178 >> v2:172.21.15.154:3300/0 conn(0x7fe91815bde0 0x7fe9180d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:27.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.707+0000 7fe915d9b640 1 -- 172.21.15.5:0/450955178 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 972371528 0 0) 0x7fe9180b04c0 con 0x7fe9180d2300 2023-07-14T13:05:27.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.707+0000 7fe915d9b640 1 -- 172.21.15.5:0/450955178 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe904003530 con 0x7fe9180d2300 2023-07-14T13:05:27.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.707+0000 7fe915d9b640 1 -- 172.21.15.5:0/450955178 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994657440 0 0) 0x7fe9180b1060 con 0x7fe9180d2fc0 2023-07-14T13:05:27.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.707+0000 7fe915d9b640 1 -- 172.21.15.5:0/450955178 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9180b04c0 con 0x7fe9180d2fc0 2023-07-14T13:05:27.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.707+0000 7fe91659c640 1 -- 172.21.15.5:0/450955178 >> v1:172.21.15.154:6789/0 conn(0x7fe9180d2fc0 legacy=0x7fe9180b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:27.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.711+0000 7fe91659c640 1 -- 172.21.15.5:0/450955178 >> v1:172.21.15.5:6789/0 conn(0x7fe9180d2300 legacy=0x7fe9180cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:27.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.711+0000 7fe91659c640 1 -- 172.21.15.5:0/450955178 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9180d0aa0 con 0x7fe91815bde0 2023-07-14T13:05:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.711+0000 7fe91659c640 1 --2- 172.21.15.5:0/450955178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe91815bde0 0x7fe9180d0270 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe9080097a0 tx=0x7fe90801c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a34d4e5c43746f4a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.711+0000 7fe915d9b640 1 -- 172.21.15.5:0/450955178 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9080ab660 con 0x7fe91815bde0 2023-07-14T13:05:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.711+0000 7fe915d9b640 1 -- 172.21.15.5:0/450955178 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9080ab7c0 con 0x7fe91815bde0 2023-07-14T13:05:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.711+0000 7fe915d9b640 1 -- 172.21.15.5:0/450955178 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9080abb50 con 0x7fe91815bde0 2023-07-14T13:05:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.711+0000 7fe91c9fa640 1 -- 172.21.15.5:0/450955178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe91815bde0 msgr2=0x7fe9180d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.711+0000 7fe91c9fa640 1 --2- 172.21.15.5:0/450955178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe91815bde0 0x7fe9180d0270 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe9080097a0 tx=0x7fe90801c460 comp rx=0 tx=0).stop 2023-07-14T13:05:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.711+0000 7fe91c9fa640 1 -- 172.21.15.5:0/450955178 shutdown_connections 2023-07-14T13:05:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.711+0000 7fe91c9fa640 1 --2- 172.21.15.5:0/450955178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe91815bde0 0x7fe9180d0270 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.711+0000 7fe91c9fa640 1 -- 172.21.15.5:0/450955178 >> 172.21.15.5:0/450955178 conn(0x7fe9180659d0 msgr2=0x7fe91809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.711+0000 7fe91c9fa640 1 -- 172.21.15.5:0/450955178 shutdown_connections 2023-07-14T13:05:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.711+0000 7fe91c9fa640 1 -- 172.21.15.5:0/450955178 wait complete. 2023-07-14T13:05:27.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.715+0000 7fe91c9fa640 1 Processor -- start 2023-07-14T13:05:27.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.715+0000 7fe91c9fa640 1 -- start start 2023-07-14T13:05:27.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.715+0000 7fe91c9fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9180d2300 0x7fe918150b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:27.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.715+0000 7fe91c9fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9180d2fc0 0x7fe9180b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:27.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.715+0000 7fe91c9fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe91815bde0 0x7fe9180b7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:27.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.715+0000 7fe91c9fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91815e4a0 con 0x7fe91815bde0 2023-07-14T13:05:27.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.715+0000 7fe91c9fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91815e780 con 0x7fe9180d2300 2023-07-14T13:05:27.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.715+0000 7fe91c9fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91815ea60 con 0x7fe9180d2fc0 2023-07-14T13:05:27.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.715+0000 7fe916d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe91815bde0 0x7fe9180b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:27.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.715+0000 7fe916d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe91815bde0 0x7fe9180b7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50426/0 (socket says 172.21.15.5:50426) 2023-07-14T13:05:27.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.715+0000 7fe916d9d640 1 -- 172.21.15.5:0/3892535817 learned_addr learned my addr 172.21.15.5:0/3892535817 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:27.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.715+0000 7fe91659c640 1 --2- 172.21.15.5:0/3892535817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9180d2300 0x7fe918150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:27.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.715+0000 7fe90ffff640 1 --2- 172.21.15.5:0/3892535817 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9180d2fc0 0x7fe9180b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:27.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.715+0000 7fe916d9d640 1 -- 172.21.15.5:0/3892535817 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9180d2fc0 msgr2=0x7fe9180b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:27.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.715+0000 7fe916d9d640 1 --2- 172.21.15.5:0/3892535817 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9180d2fc0 0x7fe9180b6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:27.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.715+0000 7fe916d9d640 1 -- 172.21.15.5:0/3892535817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9180d2300 msgr2=0x7fe918150b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:27.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.715+0000 7fe916d9d640 1 --2- 172.21.15.5:0/3892535817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9180d2300 0x7fe918150b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:27.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.715+0000 7fe916d9d640 1 -- 172.21.15.5:0/3892535817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9080093b0 con 0x7fe91815bde0 2023-07-14T13:05:27.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.715+0000 7fe916d9d640 1 --2- 172.21.15.5:0/3892535817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe91815bde0 0x7fe9180b7190 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fe91000cba0 tx=0x7fe91000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:27.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.719+0000 7fe90effd640 1 -- 172.21.15.5:0/3892535817 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91000ace0 con 0x7fe91815bde0 2023-07-14T13:05:27.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.719+0000 7fe90effd640 1 -- 172.21.15.5:0/3892535817 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91000ae40 con 0x7fe91815bde0 2023-07-14T13:05:27.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.719+0000 7fe90effd640 1 -- 172.21.15.5:0/3892535817 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910012620 con 0x7fe91815bde0 2023-07-14T13:05:27.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.719+0000 7fe91c9fa640 1 -- 172.21.15.5:0/3892535817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe91815ed40 con 0x7fe91815bde0 2023-07-14T13:05:27.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.719+0000 7fe91c9fa640 1 -- 172.21.15.5:0/3892535817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe91815d770 con 0x7fe91815bde0 2023-07-14T13:05:27.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.719+0000 7fe91c9fa640 1 -- 172.21.15.5:0/3892535817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9180c94d0 con 0x7fe91815bde0 2023-07-14T13:05:27.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.719+0000 7fe90effd640 1 -- 172.21.15.5:0/3892535817 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fe910007070 con 0x7fe91815bde0 2023-07-14T13:05:27.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.719+0000 7fe90effd640 1 --2- 172.21.15.5:0/3892535817 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fe8f8066480 0x7fe8f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:27.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.719+0000 7fe90effd640 1 -- 172.21.15.5:0/3892535817 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fe910084180 con 0x7fe91815bde0 2023-07-14T13:05:27.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.719+0000 7fe91659c640 1 --2- 172.21.15.5:0/3892535817 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fe8f8066480 0x7fe8f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:27.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.723+0000 7fe91659c640 1 --2- 172.21.15.5:0/3892535817 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fe8f8066480 0x7fe8f8068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe9080af000 tx=0x7fe9080a7000 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:27.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.723+0000 7fe90effd640 1 -- 172.21.15.5:0/3892535817 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe9180c94d0 con 0x7fe91815bde0 2023-07-14T13:05:27.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.899+0000 7fe91c9fa640 1 -- 172.21.15.5:0/3892535817 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe91815e8f0 con 0x7fe8f8066480 2023-07-14T13:05:27.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.907+0000 7fe90effd640 1 -- 172.21.15.5:0/3892535817 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fe91815e8f0 con 0x7fe8f8066480 2023-07-14T13:05:27.939 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:05:27.939 INFO:teuthology.orchestra.run.smithi005.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T12:54:05", "first": "2023-07-14T12:55:00", "last": "2023-07-14T13:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-14T13:05:27.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.911+0000 7fe91c9fa640 1 -- 172.21.15.5:0/3892535817 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fe8f8066480 msgr2=0x7fe8f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:27.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.911+0000 7fe91c9fa640 1 --2- 172.21.15.5:0/3892535817 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fe8f8066480 0x7fe8f8068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe9080af000 tx=0x7fe9080a7000 comp rx=0 tx=0).stop 2023-07-14T13:05:27.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.911+0000 7fe91c9fa640 1 -- 172.21.15.5:0/3892535817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe91815bde0 msgr2=0x7fe9180b7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:27.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.911+0000 7fe91c9fa640 1 --2- 172.21.15.5:0/3892535817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe91815bde0 0x7fe9180b7190 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fe91000cba0 tx=0x7fe91000a430 comp rx=0 tx=0).stop 2023-07-14T13:05:27.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.911+0000 7fe91c9fa640 1 -- 172.21.15.5:0/3892535817 shutdown_connections 2023-07-14T13:05:27.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.911+0000 7fe91c9fa640 1 --2- 172.21.15.5:0/3892535817 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fe8f8066480 0x7fe8f8068930 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:27.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.911+0000 7fe91c9fa640 1 --2- 172.21.15.5:0/3892535817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe91815bde0 0x7fe9180b7190 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:27.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.911+0000 7fe91c9fa640 1 --2- 172.21.15.5:0/3892535817 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9180d2fc0 0x7fe9180b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:27.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.911+0000 7fe91c9fa640 1 --2- 172.21.15.5:0/3892535817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9180d2300 0x7fe918150b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:27.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.911+0000 7fe91c9fa640 1 -- 172.21.15.5:0/3892535817 >> 172.21.15.5:0/3892535817 conn(0x7fe9180659d0 msgr2=0x7fe9180b7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:27.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.911+0000 7fe91c9fa640 1 -- 172.21.15.5:0/3892535817 shutdown_connections 2023-07-14T13:05:27.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:27.911+0000 7fe91c9fa640 1 -- 172.21.15.5:0/3892535817 wait complete. 2023-07-14T13:05:27.959 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T12:54:05", "first": "2023-07-14T12:55:00", "last": "2023-07-14T13:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-14T13:05:27.960 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir8', 'rel_path': '/snap_test_dir1/dir8', 'schedule': '1M', 'retention': {}, 'start': '2023-07-14T00:00:00', 'created': '2023-07-14T12:54:05', 'first': '2023-07-14T12:55:00', 'last': '2023-07-14T13:05:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-14T13:05:27.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:27.961 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-07-14T13:05:27.971 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_55_00_UTC 2023-07-14T13:05:27.971 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:27.971 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:27.972 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:27.972 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:27.972 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:27.972 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_01_00_UTC 2023-07-14T13:05:27.972 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:27.972 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_03_00_UTC 2023-07-14T13:05:27.973 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:27.973 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:27.974 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-14-12_55_00_UTC', 'scheduled-2023-07-14-12_56_00_UTC', 'scheduled-2023-07-14-12_57_00_UTC', 'scheduled-2023-07-14-12_58_00_UTC', 'scheduled-2023-07-14-12_59_00_UTC', 'scheduled-2023-07-14-13_00_00_UTC', 'scheduled-2023-07-14-13_01_00_UTC', 'scheduled-2023-07-14-13_02_00_UTC', 'scheduled-2023-07-14-13_03_00_UTC', 'scheduled-2023-07-14-13_04_00_UTC', 'scheduled-2023-07-14-13_05_00_UTC'] 2023-07-14T13:05:27.974 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir9 2023-07-14T13:05:28.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.131+0000 7faf7d00b640 1 Processor -- start 2023-07-14T13:05:28.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.131+0000 7faf7d00b640 1 -- start start 2023-07-14T13:05:28.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.131+0000 7faf7d00b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faf78069430 0x7faf78069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:28.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.131+0000 7faf7d00b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf780af2b0 0x7faf7815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:28.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.131+0000 7faf7d00b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf78159d70 con 0x7faf78070f30 2023-07-14T13:05:28.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.131+0000 7faf7d00b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf78069d40 con 0x7faf78069430 2023-07-14T13:05:28.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.131+0000 7faf7d00b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf780c9c60 con 0x7faf780af2b0 2023-07-14T13:05:28.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.135+0000 7faf6ffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faf78070f30 0x7faf780ad6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49464/0 (socket says 172.21.15.5:49464) 2023-07-14T13:05:28.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.135+0000 7faf6ffff640 1 -- 172.21.15.5:0/2617579458 learned_addr learned my addr 172.21.15.5:0/2617579458 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:28.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.135+0000 7faf76d9d640 1 --2- 172.21.15.5:0/2617579458 >> v2:172.21.15.154:3300/0 conn(0x7faf78069430 0x7faf78069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:28.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.135+0000 7faf7759e640 1 --2- 172.21.15.5:0/2617579458 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf780af2b0 0x7faf7815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:28.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.135+0000 7faf7659c640 1 -- 172.21.15.5:0/2617579458 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1481910177 0 0) 0x7faf60001120 con 0x7faf78070f30 2023-07-14T13:05:28.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.135+0000 7faf7659c640 1 -- 172.21.15.5:0/2617579458 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf64003530 con 0x7faf78070f30 2023-07-14T13:05:28.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.135+0000 7faf7659c640 1 -- 172.21.15.5:0/2617579458 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1122283576 0 0) 0x7faf64003530 con 0x7faf78070f30 2023-07-14T13:05:28.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.135+0000 7faf76d9d640 1 -- 172.21.15.5:0/2617579458 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf780af2b0 msgr2=0x7faf7815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:28.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.135+0000 7faf76d9d640 1 --2- 172.21.15.5:0/2617579458 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf780af2b0 0x7faf7815a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:28.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.135+0000 7faf76d9d640 1 -- 172.21.15.5:0/2617579458 >> v1:172.21.15.5:6789/0 conn(0x7faf78070f30 legacy=0x7faf780ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:28.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.135+0000 7faf76d9d640 1 -- 172.21.15.5:0/2617579458 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf780c9f40 con 0x7faf78069430 2023-07-14T13:05:28.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.135+0000 7faf76d9d640 1 --2- 172.21.15.5:0/2617579458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf78069430 0x7faf78069800 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faf680097c0 tx=0x7faf6801c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c065999d9afd55de server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:28.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.139+0000 7faf7659c640 1 -- 172.21.15.5:0/2617579458 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf60001810 con 0x7faf78069430 2023-07-14T13:05:28.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.139+0000 7faf7659c640 1 -- 172.21.15.5:0/2617579458 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf680a7050 con 0x7faf78069430 2023-07-14T13:05:28.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.139+0000 7faf7659c640 1 -- 172.21.15.5:0/2617579458 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf680ab620 con 0x7faf78069430 2023-07-14T13:05:28.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.139+0000 7faf7d00b640 1 -- 172.21.15.5:0/2617579458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf78069430 msgr2=0x7faf78069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:28.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.139+0000 7faf7d00b640 1 --2- 172.21.15.5:0/2617579458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf78069430 0x7faf78069800 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faf680097c0 tx=0x7faf6801c3a0 comp rx=0 tx=0).stop 2023-07-14T13:05:28.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.139+0000 7faf7d00b640 1 -- 172.21.15.5:0/2617579458 shutdown_connections 2023-07-14T13:05:28.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.139+0000 7faf7d00b640 1 --2- 172.21.15.5:0/2617579458 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf780af2b0 0x7faf7815a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:28.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.139+0000 7faf7d00b640 1 --2- 172.21.15.5:0/2617579458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf78069430 0x7faf78069800 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:28.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.139+0000 7faf7d00b640 1 -- 172.21.15.5:0/2617579458 >> 172.21.15.5:0/2617579458 conn(0x7faf780cde90 msgr2=0x7faf780ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:28.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.139+0000 7faf7d00b640 1 -- 172.21.15.5:0/2617579458 shutdown_connections 2023-07-14T13:05:28.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.139+0000 7faf7d00b640 1 -- 172.21.15.5:0/2617579458 wait complete. 2023-07-14T13:05:28.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.139+0000 7faf7d00b640 1 Processor -- start 2023-07-14T13:05:28.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.139+0000 7faf7d00b640 1 -- start start 2023-07-14T13:05:28.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.143+0000 7faf7d00b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf78069430 0x7faf78145970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:28.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.143+0000 7faf7d00b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf78070f30 0x7faf780c6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:28.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.143+0000 7faf7d00b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf780af2b0 0x7faf780cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:28.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.143+0000 7faf7d00b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf78145eb0 con 0x7faf78069430 2023-07-14T13:05:28.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.143+0000 7faf7d00b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf780c6c40 con 0x7faf78070f30 2023-07-14T13:05:28.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.143+0000 7faf7d00b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf780c6f20 con 0x7faf780af2b0 2023-07-14T13:05:28.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.143+0000 7faf76d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf78069430 0x7faf78145970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:28.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.143+0000 7faf76d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf78069430 0x7faf78145970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50438/0 (socket says 172.21.15.5:50438) 2023-07-14T13:05:28.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.143+0000 7faf76d9d640 1 -- 172.21.15.5:0/1164121774 learned_addr learned my addr 172.21.15.5:0/1164121774 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:28.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.143+0000 7faf7759e640 1 --2- 172.21.15.5:0/1164121774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf780af2b0 0x7faf780cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:28.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.143+0000 7faf6ffff640 1 --2- 172.21.15.5:0/1164121774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf78070f30 0x7faf780c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:28.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.143+0000 7faf76d9d640 1 -- 172.21.15.5:0/1164121774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf780af2b0 msgr2=0x7faf780cb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:28.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.143+0000 7faf76d9d640 1 --2- 172.21.15.5:0/1164121774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf780af2b0 0x7faf780cb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:28.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.143+0000 7faf76d9d640 1 -- 172.21.15.5:0/1164121774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf78070f30 msgr2=0x7faf780c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:28.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.143+0000 7faf76d9d640 1 --2- 172.21.15.5:0/1164121774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf78070f30 0x7faf780c6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:28.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.143+0000 7faf76d9d640 1 -- 172.21.15.5:0/1164121774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf68009420 con 0x7faf78069430 2023-07-14T13:05:28.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.143+0000 7faf76d9d640 1 --2- 172.21.15.5:0/1164121774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf78069430 0x7faf78145970 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7faf680ae040 tx=0x7faf6801abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:28.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.143+0000 7faf6f7fe640 1 -- 172.21.15.5:0/1164121774 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf680abea0 con 0x7faf78069430 2023-07-14T13:05:28.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.143+0000 7faf6f7fe640 1 -- 172.21.15.5:0/1164121774 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf680b7450 con 0x7faf78069430 2023-07-14T13:05:28.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.143+0000 7faf6f7fe640 1 -- 172.21.15.5:0/1164121774 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf680b7820 con 0x7faf78069430 2023-07-14T13:05:28.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.143+0000 7faf7d00b640 1 -- 172.21.15.5:0/1164121774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf780c7200 con 0x7faf78069430 2023-07-14T13:05:28.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.143+0000 7faf7d00b640 1 -- 172.21.15.5:0/1164121774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf780c77c0 con 0x7faf78069430 2023-07-14T13:05:28.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.143+0000 7faf7d00b640 1 -- 172.21.15.5:0/1164121774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf780c79b0 con 0x7faf78069430 2023-07-14T13:05:28.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.143+0000 7faf6f7fe640 1 -- 172.21.15.5:0/1164121774 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7faf680b7980 con 0x7faf78069430 2023-07-14T13:05:28.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.147+0000 7faf6f7fe640 1 --2- 172.21.15.5:0/1164121774 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7faf58066480 0x7faf58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:28.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.147+0000 7faf6f7fe640 1 -- 172.21.15.5:0/1164121774 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7faf6811ea30 con 0x7faf78069430 2023-07-14T13:05:28.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.147+0000 7faf6ffff640 1 --2- 172.21.15.5:0/1164121774 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7faf58066480 0x7faf58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:28.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.147+0000 7faf6ffff640 1 --2- 172.21.15.5:0/1164121774 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7faf58066480 0x7faf58068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faf60001060 tx=0x7faf60009040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:28.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.151+0000 7faf6f7fe640 1 -- 172.21.15.5:0/1164121774 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7faf680eb910 con 0x7faf78069430 2023-07-14T13:05:28.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.323+0000 7faf7d00b640 1 -- 172.21.15.5:0/1164121774 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faf78157710 con 0x7faf58066480 2023-07-14T13:05:28.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.331+0000 7faf6f7fe640 1 -- 172.21.15.5:0/1164121774 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7faf600058e0 con 0x7faf58066480 2023-07-14T13:05:28.362 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:05:28.362 INFO:teuthology.orchestra.run.smithi005.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T12:54:05", "first": "2023-07-14T12:55:00", "last": "2023-07-14T13:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-14T13:05:28.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.335+0000 7faf7d00b640 1 -- 172.21.15.5:0/1164121774 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7faf58066480 msgr2=0x7faf58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:28.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.335+0000 7faf7d00b640 1 --2- 172.21.15.5:0/1164121774 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7faf58066480 0x7faf58068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faf60001060 tx=0x7faf60009040 comp rx=0 tx=0).stop 2023-07-14T13:05:28.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.335+0000 7faf7d00b640 1 -- 172.21.15.5:0/1164121774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf78069430 msgr2=0x7faf78145970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:28.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.335+0000 7faf7d00b640 1 --2- 172.21.15.5:0/1164121774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf78069430 0x7faf78145970 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7faf680ae040 tx=0x7faf6801abe0 comp rx=0 tx=0).stop 2023-07-14T13:05:28.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.335+0000 7faf7d00b640 1 -- 172.21.15.5:0/1164121774 shutdown_connections 2023-07-14T13:05:28.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.335+0000 7faf7d00b640 1 --2- 172.21.15.5:0/1164121774 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7faf58066480 0x7faf58068930 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:28.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.335+0000 7faf7d00b640 1 --2- 172.21.15.5:0/1164121774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf780af2b0 0x7faf780cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:28.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.335+0000 7faf7d00b640 1 --2- 172.21.15.5:0/1164121774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf78070f30 0x7faf780c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:28.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.335+0000 7faf7d00b640 1 --2- 172.21.15.5:0/1164121774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf78069430 0x7faf78145970 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:28.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.335+0000 7faf7d00b640 1 -- 172.21.15.5:0/1164121774 >> 172.21.15.5:0/1164121774 conn(0x7faf780cde90 msgr2=0x7faf780adbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:28.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.335+0000 7faf7d00b640 1 -- 172.21.15.5:0/1164121774 shutdown_connections 2023-07-14T13:05:28.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.335+0000 7faf7d00b640 1 -- 172.21.15.5:0/1164121774 wait complete. 2023-07-14T13:05:28.382 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T12:54:05", "first": "2023-07-14T12:55:00", "last": "2023-07-14T13:05:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-14T13:05:28.383 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir9', 'rel_path': '/snap_test_dir1/dir9', 'schedule': '1M', 'retention': {}, 'start': '2023-07-14T00:00:00', 'created': '2023-07-14T12:54:05', 'first': '2023-07-14T12:55:00', 'last': '2023-07-14T13:05:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-14T13:05:28.383 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir0 1M 2023-07-14T13:05:28.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.503+0000 7fc87cd98640 1 Processor -- start 2023-07-14T13:05:28.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.503+0000 7fc87cd98640 1 -- start start 2023-07-14T13:05:28.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.503+0000 7fc87cd98640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8780cfd90 0x7fc8780cc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:28.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.503+0000 7fc87cd98640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc87815bfa0 con 0x7fc8780b5010 2023-07-14T13:05:28.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.503+0000 7fc87cd98640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8780ccdf0 con 0x7fc8780cebd0 2023-07-14T13:05:28.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.503+0000 7fc87cd98640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8780cd0d0 con 0x7fc8780cfd90 2023-07-14T13:05:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.503+0000 7fc877fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc8780b5010 0x7fc8780cde90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49468/0 (socket says 172.21.15.5:49468) 2023-07-14T13:05:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.503+0000 7fc877fff640 1 -- 172.21.15.5:0/2038369603 learned_addr learned my addr 172.21.15.5:0/2038369603 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.503+0000 7fc8777fe640 1 --2- 172.21.15.5:0/2038369603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8780cfd90 0x7fc8780cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.503+0000 7fc8767fc640 1 -- 172.21.15.5:0/2038369603 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594123287 0 0) 0x7fc8700014a0 con 0x7fc8780b5010 2023-07-14T13:05:28.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.503+0000 7fc8767fc640 1 -- 172.21.15.5:0/2038369603 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc860003530 con 0x7fc8780b5010 2023-07-14T13:05:28.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.503+0000 7fc8767fc640 1 -- 172.21.15.5:0/2038369603 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1062781097 0 0) 0x7fc8780ccdf0 con 0x7fc8780cebd0 2023-07-14T13:05:28.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.503+0000 7fc8767fc640 1 -- 172.21.15.5:0/2038369603 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8700014a0 con 0x7fc8780cebd0 2023-07-14T13:05:28.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.503+0000 7fc8767fc640 1 -- 172.21.15.5:0/2038369603 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1054807783 0 0) 0x7fc860003530 con 0x7fc8780b5010 2023-07-14T13:05:28.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.503+0000 7fc8767fc640 1 -- 172.21.15.5:0/2038369603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8780cfd90 msgr2=0x7fc8780cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:28.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.503+0000 7fc8767fc640 1 --2- 172.21.15.5:0/2038369603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8780cfd90 0x7fc8780cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:28.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.503+0000 7fc8767fc640 1 -- 172.21.15.5:0/2038369603 >> v1:172.21.15.154:6789/0 conn(0x7fc8780cebd0 legacy=0x7fc8780d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:28.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.503+0000 7fc8767fc640 1 -- 172.21.15.5:0/2038369603 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8780cd3b0 con 0x7fc8780b5010 2023-07-14T13:05:28.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.503+0000 7fc8767fc640 1 -- 172.21.15.5:0/2038369603 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7fc870001b90 con 0x7fc8780b5010 2023-07-14T13:05:28.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.503+0000 7fc8767fc640 1 -- 172.21.15.5:0/2038369603 >> v1:172.21.15.5:6789/0 conn(0x7fc8780b5010 legacy=0x7fc8780cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:28.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.503+0000 7fc8767fc640 1 --2- 172.21.15.5:0/2038369603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc860003b40 0x7fc860003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:28.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.507+0000 7fc8767fc640 1 --2- 172.21.15.5:0/2038369603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8600047d0 0x7fc860004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:28.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.507+0000 7fc8767fc640 1 --2- 172.21.15.5:0/2038369603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8780cfd90 0x7fc860005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:28.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.507+0000 7fc8767fc640 1 -- 172.21.15.5:0/2038369603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8780cd0d0 con 0x7fc8600047d0 2023-07-14T13:05:28.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.507+0000 7fc8767fc640 1 -- 172.21.15.5:0/2038369603 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86000ba70 con 0x7fc860003b40 2023-07-14T13:05:28.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.507+0000 7fc8767fc640 1 -- 172.21.15.5:0/2038369603 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86000bc30 con 0x7fc8780cfd90 2023-07-14T13:05:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.507+0000 7fc876ffd640 1 --2- 172.21.15.5:0/2038369603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8600047d0 0x7fc860004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.507+0000 7fc8777fe640 1 --2- 172.21.15.5:0/2038369603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc860003b40 0x7fc860003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.507+0000 7fc876ffd640 1 -- 172.21.15.5:0/2038369603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8780cfd90 msgr2=0x7fc860005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.507+0000 7fc876ffd640 1 --2- 172.21.15.5:0/2038369603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8780cfd90 0x7fc860005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:28.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.507+0000 7fc876ffd640 1 -- 172.21.15.5:0/2038369603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc860003b40 msgr2=0x7fc860003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.507+0000 7fc876ffd640 1 --2- 172.21.15.5:0/2038369603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc860003b40 0x7fc860003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:28.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.507+0000 7fc876ffd640 1 -- 172.21.15.5:0/2038369603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc860003530 con 0x7fc8600047d0 2023-07-14T13:05:28.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.507+0000 7fc876ffd640 1 --2- 172.21.15.5:0/2038369603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8600047d0 0x7fc860004c40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc86c0018d0 tx=0x7fc86c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814d764003eb8d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:28.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.507+0000 7fc8767fc640 1 -- 172.21.15.5:0/2038369603 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c0052d0 con 0x7fc8600047d0 2023-07-14T13:05:28.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.507+0000 7fc8767fc640 1 -- 172.21.15.5:0/2038369603 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86c005450 con 0x7fc8600047d0 2023-07-14T13:05:28.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.507+0000 7fc8767fc640 1 -- 172.21.15.5:0/2038369603 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c003840 con 0x7fc8600047d0 2023-07-14T13:05:28.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.511+0000 7fc87cd98640 1 -- 172.21.15.5:0/2038369603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8600047d0 msgr2=0x7fc860004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:28.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.511+0000 7fc87cd98640 1 --2- 172.21.15.5:0/2038369603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8600047d0 0x7fc860004c40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc86c0018d0 tx=0x7fc86c01c530 comp rx=0 tx=0).stop 2023-07-14T13:05:28.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.511+0000 7fc877fff640 1 -- 172.21.15.5:0/2038369603 reap_dead start 2023-07-14T13:05:28.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.511+0000 7fc87cd98640 1 -- 172.21.15.5:0/2038369603 shutdown_connections 2023-07-14T13:05:28.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.511+0000 7fc87cd98640 1 -- 172.21.15.5:0/2038369603 >> 172.21.15.5:0/2038369603 conn(0x7fc87809b490 msgr2=0x7fc8780d21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:28.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.511+0000 7fc87cd98640 1 -- 172.21.15.5:0/2038369603 shutdown_connections 2023-07-14T13:05:28.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.511+0000 7fc87cd98640 1 -- 172.21.15.5:0/2038369603 wait complete. 2023-07-14T13:05:28.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.511+0000 7fc87cd98640 1 Processor -- start 2023-07-14T13:05:28.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.511+0000 7fc87cd98640 1 -- start start 2023-07-14T13:05:28.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.511+0000 7fc87cd98640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8600047d0 0x7fc8781576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:28.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.511+0000 7fc87cd98640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc878156280 0x7fc8781566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:28.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.511+0000 7fc87cd98640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8780d2070 0x7fc8780d24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:28.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.511+0000 7fc87cd98640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8780d2a20 con 0x7fc8780d2070 2023-07-14T13:05:28.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.511+0000 7fc87cd98640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc878157be0 con 0x7fc878156280 2023-07-14T13:05:28.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.511+0000 7fc87cd98640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87815c960 con 0x7fc8600047d0 2023-07-14T13:05:28.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.511+0000 7fc877fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8780d2070 0x7fc8780d24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:28.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.511+0000 7fc8777fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8600047d0 0x7fc8781576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:28.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.511+0000 7fc876ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc878156280 0x7fc8781566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:28.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.511+0000 7fc877fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8780d2070 0x7fc8780d24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50458/0 (socket says 172.21.15.5:50458) 2023-07-14T13:05:28.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.511+0000 7fc877fff640 1 -- 172.21.15.5:0/2921782512 learned_addr learned my addr 172.21.15.5:0/2921782512 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:28.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.511+0000 7fc877fff640 1 -- 172.21.15.5:0/2921782512 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8600047d0 msgr2=0x7fc8781576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:28.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.511+0000 7fc877fff640 1 --2- 172.21.15.5:0/2921782512 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8600047d0 0x7fc8781576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:28.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.515+0000 7fc877fff640 1 -- 172.21.15.5:0/2921782512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc878156280 msgr2=0x7fc8781566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:28.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.515+0000 7fc877fff640 1 --2- 172.21.15.5:0/2921782512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc878156280 0x7fc8781566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:28.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.515+0000 7fc877fff640 1 -- 172.21.15.5:0/2921782512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87815cc40 con 0x7fc8780d2070 2023-07-14T13:05:28.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.515+0000 7fc877fff640 1 --2- 172.21.15.5:0/2921782512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8780d2070 0x7fc8780d24e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc87808a610 tx=0x7fc87000ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:28.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.515+0000 7fc85ffff640 1 -- 172.21.15.5:0/2921782512 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc870004d70 con 0x7fc8780d2070 2023-07-14T13:05:28.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.515+0000 7fc85ffff640 1 -- 172.21.15.5:0/2921782512 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc870007070 con 0x7fc8780d2070 2023-07-14T13:05:28.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.515+0000 7fc85ffff640 1 -- 172.21.15.5:0/2921782512 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8700073e0 con 0x7fc8780d2070 2023-07-14T13:05:28.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.515+0000 7fc87cd98640 1 -- 172.21.15.5:0/2921782512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc87815cf20 con 0x7fc8780d2070 2023-07-14T13:05:28.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.515+0000 7fc87cd98640 1 -- 172.21.15.5:0/2921782512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc87815d4e0 con 0x7fc8780d2070 2023-07-14T13:05:28.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.515+0000 7fc87cd98640 1 -- 172.21.15.5:0/2921782512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc87804e020 con 0x7fc8780d2070 2023-07-14T13:05:28.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.515+0000 7fc85ffff640 1 -- 172.21.15.5:0/2921782512 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fc870007540 con 0x7fc8780d2070 2023-07-14T13:05:28.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.515+0000 7fc85ffff640 1 --2- 172.21.15.5:0/2921782512 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fc864066480 0x7fc864068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:28.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.515+0000 7fc85ffff640 1 -- 172.21.15.5:0/2921782512 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fc870082f50 con 0x7fc8780d2070 2023-07-14T13:05:28.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.515+0000 7fc8777fe640 1 --2- 172.21.15.5:0/2921782512 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fc864066480 0x7fc864068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:28.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.519+0000 7fc8777fe640 1 --2- 172.21.15.5:0/2921782512 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fc864066480 0x7fc864068930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc8680099f0 tx=0x7fc868008040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:28.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.519+0000 7fc85ffff640 1 -- 172.21.15.5:0/2921782512 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc87004ff90 con 0x7fc8780d2070 2023-07-14T13:05:28.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.695+0000 7fc87cd98640 1 -- 172.21.15.5:0/2921782512 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8780d3080 con 0x7fc864066480 2023-07-14T13:05:28.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.783+0000 7fc85ffff640 1 -- 172.21.15.5:0/2921782512 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fc8680149d0 con 0x7fc864066480 2023-07-14T13:05:28.812 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule removed for path /snap_test_dir1/dir0 2023-07-14T13:05:28.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.783+0000 7fc87cd98640 1 -- 172.21.15.5:0/2921782512 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fc864066480 msgr2=0x7fc864068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:28.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.783+0000 7fc87cd98640 1 --2- 172.21.15.5:0/2921782512 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fc864066480 0x7fc864068930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc8680099f0 tx=0x7fc868008040 comp rx=0 tx=0).stop 2023-07-14T13:05:28.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.783+0000 7fc87cd98640 1 -- 172.21.15.5:0/2921782512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8780d2070 msgr2=0x7fc8780d24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:28.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.783+0000 7fc87cd98640 1 --2- 172.21.15.5:0/2921782512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8780d2070 0x7fc8780d24e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc87808a610 tx=0x7fc87000ca70 comp rx=0 tx=0).stop 2023-07-14T13:05:28.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.783+0000 7fc87cd98640 1 -- 172.21.15.5:0/2921782512 shutdown_connections 2023-07-14T13:05:28.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.783+0000 7fc87cd98640 1 --2- 172.21.15.5:0/2921782512 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fc864066480 0x7fc864068930 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:28.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.783+0000 7fc87cd98640 1 --2- 172.21.15.5:0/2921782512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8780d2070 0x7fc8780d24e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:28.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.783+0000 7fc87cd98640 1 --2- 172.21.15.5:0/2921782512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc878156280 0x7fc8781566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:28.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.783+0000 7fc87cd98640 1 --2- 172.21.15.5:0/2921782512 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8600047d0 0x7fc8781576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:28.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.783+0000 7fc87cd98640 1 -- 172.21.15.5:0/2921782512 >> 172.21.15.5:0/2921782512 conn(0x7fc87809b490 msgr2=0x7fc878166950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:28.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.783+0000 7fc87cd98640 1 -- 172.21.15.5:0/2921782512 shutdown_connections 2023-07-14T13:05:28.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:28.783+0000 7fc87cd98640 1 -- 172.21.15.5:0/2921782512 wait complete. 2023-07-14T13:05:28.833 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir0 2023-07-14T13:05:28.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:28.834 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-07-14T13:05:28.844 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_55_01_UTC 2023-07-14T13:05:28.844 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:28.844 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:28.844 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:28.844 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:28.845 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:28.845 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_01_01_UTC 2023-07-14T13:05:28.845 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:28.845 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_03_00_UTC 2023-07-14T13:05:28.845 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:28.845 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:28.846 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-14-12_55_01_UTC 2023-07-14T13:05:28.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:28.847 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-14-12_55_01_UTC) 2023-07-14T13:05:28.903 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:28.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:28.903 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-14-12_56_00_UTC) 2023-07-14T13:05:28.966 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:28.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:28.967 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-14-12_57_00_UTC) 2023-07-14T13:05:29.022 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:29.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:29.023 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-14-12_58_00_UTC) 2023-07-14T13:05:29.078 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:29.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:29.078 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-14-12_59_00_UTC) 2023-07-14T13:05:29.134 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:29.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:29.135 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-14-13_00_00_UTC) 2023-07-14T13:05:29.189 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-14-13_01_01_UTC 2023-07-14T13:05:29.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:29.190 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-14-13_01_01_UTC) 2023-07-14T13:05:29.246 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:29.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:29.246 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-14-13_02_00_UTC) 2023-07-14T13:05:29.301 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-14-13_03_00_UTC 2023-07-14T13:05:29.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:29.302 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-14-13_03_00_UTC) 2023-07-14T13:05:29.358 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:29.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:29.358 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-14-13_04_00_UTC) 2023-07-14T13:05:29.413 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:29.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:29.414 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-14-13_05_00_UTC) 2023-07-14T13:05:29.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:29.470 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0) 2023-07-14T13:05:29.523 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir1 1M 2023-07-14T13:05:29.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.687+0000 7f9cf049c640 1 Processor -- start 2023-07-14T13:05:29.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.687+0000 7f9cf049c640 1 -- start start 2023-07-14T13:05:29.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.691+0000 7f9cf049c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ce8069430 0x7f9ce8069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:29.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.691+0000 7f9cf049c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce8159d70 con 0x7f9ce8070f30 2023-07-14T13:05:29.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.691+0000 7f9cf049c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce8069d40 con 0x7f9ce80af2b0 2023-07-14T13:05:29.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.691+0000 7f9cf049c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce80c9c60 con 0x7f9ce8069430 2023-07-14T13:05:29.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.691+0000 7f9ceda37640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9ce8070f30 0x7f9ce80ad6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33758/0 (socket says 172.21.15.5:33758) 2023-07-14T13:05:29.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.691+0000 7f9ceda37640 1 -- 172.21.15.5:0/1018050461 learned_addr learned my addr 172.21.15.5:0/1018050461 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:29.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.691+0000 7f9cee238640 1 --2- 172.21.15.5:0/1018050461 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ce8069430 0x7f9ce8069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:29.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.691+0000 7f9ced236640 1 -- 172.21.15.5:0/1018050461 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425107950 0 0) 0x7f9cd8001120 con 0x7f9ce8070f30 2023-07-14T13:05:29.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.691+0000 7f9ced236640 1 -- 172.21.15.5:0/1018050461 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cd4003530 con 0x7f9ce8070f30 2023-07-14T13:05:29.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.691+0000 7f9cee238640 1 -- 172.21.15.5:0/1018050461 >> v1:172.21.15.154:6789/0 conn(0x7f9ce80af2b0 legacy=0x7f9ce815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:29.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.691+0000 7f9ced236640 1 -- 172.21.15.5:0/1018050461 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645166949 0 0) 0x7f9ce8069d40 con 0x7f9ce80af2b0 2023-07-14T13:05:29.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.691+0000 7f9cee238640 1 -- 172.21.15.5:0/1018050461 >> v1:172.21.15.5:6789/0 conn(0x7f9ce8070f30 legacy=0x7f9ce80ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:29.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.691+0000 7f9cee238640 1 -- 172.21.15.5:0/1018050461 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce80c9f40 con 0x7f9ce8069430 2023-07-14T13:05:29.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.695+0000 7f9cee238640 1 --2- 172.21.15.5:0/1018050461 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ce8069430 0x7f9ce8069800 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40097f0 tx=0x7f9ce401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abe4aab53376b4d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:29.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.695+0000 7f9ced236640 1 -- 172.21.15.5:0/1018050461 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce40ac630 con 0x7f9ce8069430 2023-07-14T13:05:29.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.695+0000 7f9ced236640 1 -- 172.21.15.5:0/1018050461 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce40ac790 con 0x7f9ce8069430 2023-07-14T13:05:29.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.695+0000 7f9ced236640 1 -- 172.21.15.5:0/1018050461 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce40acb00 con 0x7f9ce8069430 2023-07-14T13:05:29.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.695+0000 7f9cf049c640 1 -- 172.21.15.5:0/1018050461 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ce8069430 msgr2=0x7f9ce8069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:29.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.695+0000 7f9cf049c640 1 --2- 172.21.15.5:0/1018050461 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ce8069430 0x7f9ce8069800 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40097f0 tx=0x7f9ce401c4c0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.695+0000 7f9cf049c640 1 -- 172.21.15.5:0/1018050461 shutdown_connections 2023-07-14T13:05:29.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.695+0000 7f9cf049c640 1 --2- 172.21.15.5:0/1018050461 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ce8069430 0x7f9ce8069800 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.695+0000 7f9cf049c640 1 -- 172.21.15.5:0/1018050461 >> 172.21.15.5:0/1018050461 conn(0x7f9ce80cde90 msgr2=0x7f9ce80ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:29.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.695+0000 7f9cf049c640 1 -- 172.21.15.5:0/1018050461 shutdown_connections 2023-07-14T13:05:29.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.695+0000 7f9cf049c640 1 -- 172.21.15.5:0/1018050461 wait complete. 2023-07-14T13:05:29.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.695+0000 7f9cf049c640 1 Processor -- start 2023-07-14T13:05:29.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.695+0000 7f9cf049c640 1 -- start start 2023-07-14T13:05:29.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.699+0000 7f9cf049c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ce8069430 0x7f9ce8152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:29.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.699+0000 7f9cf049c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ce8070f30 0x7f9ce80c3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:29.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.699+0000 7f9cf049c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ce80af2b0 0x7f9ce80c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:29.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.699+0000 7f9cf049c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce80c4b00 con 0x7f9ce80af2b0 2023-07-14T13:05:29.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.699+0000 7f9cf049c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce8156b90 con 0x7f9ce8069430 2023-07-14T13:05:29.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.699+0000 7f9cf049c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce8156e70 con 0x7f9ce8070f30 2023-07-14T13:05:29.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.699+0000 7f9ceea39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ce80af2b0 0x7f9ce80c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:29.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.699+0000 7f9ceea39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ce80af2b0 0x7f9ce80c3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41334/0 (socket says 172.21.15.5:41334) 2023-07-14T13:05:29.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.699+0000 7f9ceea39640 1 -- 172.21.15.5:0/704140873 learned_addr learned my addr 172.21.15.5:0/704140873 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:29.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.699+0000 7f9ceda37640 1 --2- 172.21.15.5:0/704140873 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ce8070f30 0x7f9ce80c3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:29.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.699+0000 7f9cee238640 1 --2- 172.21.15.5:0/704140873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ce8069430 0x7f9ce8152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:29.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.699+0000 7f9ceea39640 1 -- 172.21.15.5:0/704140873 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ce8070f30 msgr2=0x7f9ce80c3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:29.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.699+0000 7f9ceea39640 1 --2- 172.21.15.5:0/704140873 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ce8070f30 0x7f9ce80c3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.699+0000 7f9ceea39640 1 -- 172.21.15.5:0/704140873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ce8069430 msgr2=0x7f9ce8152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:29.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.699+0000 7f9ceea39640 1 --2- 172.21.15.5:0/704140873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ce8069430 0x7f9ce8152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.699+0000 7f9ceea39640 1 -- 172.21.15.5:0/704140873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce4009420 con 0x7f9ce80af2b0 2023-07-14T13:05:29.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.699+0000 7f9ceea39640 1 --2- 172.21.15.5:0/704140873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ce80af2b0 0x7f9ce80c3e90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0001570 tx=0x7f9ce000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:29.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.699+0000 7f9cdeffd640 1 -- 172.21.15.5:0/704140873 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce0003db0 con 0x7f9ce80af2b0 2023-07-14T13:05:29.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.699+0000 7f9cdeffd640 1 -- 172.21.15.5:0/704140873 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce0005070 con 0x7f9ce80af2b0 2023-07-14T13:05:29.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.699+0000 7f9cf049c640 1 -- 172.21.15.5:0/704140873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce80ab930 con 0x7f9ce80af2b0 2023-07-14T13:05:29.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.699+0000 7f9cdeffd640 1 -- 172.21.15.5:0/704140873 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce0005420 con 0x7f9ce80af2b0 2023-07-14T13:05:29.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.699+0000 7f9cf049c640 1 -- 172.21.15.5:0/704140873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce80abef0 con 0x7f9ce80af2b0 2023-07-14T13:05:29.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.699+0000 7f9cf049c640 1 -- 172.21.15.5:0/704140873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce80cd1f0 con 0x7f9ce80af2b0 2023-07-14T13:05:29.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.703+0000 7f9cdeffd640 1 -- 172.21.15.5:0/704140873 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f9ce0005580 con 0x7f9ce80af2b0 2023-07-14T13:05:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.703+0000 7f9cdeffd640 1 --2- 172.21.15.5:0/704140873 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f9ccc066480 0x7f9ccc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.703+0000 7f9cdeffd640 1 -- 172.21.15.5:0/704140873 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f9ce0083980 con 0x7f9ce80af2b0 2023-07-14T13:05:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.703+0000 7f9cee238640 1 --2- 172.21.15.5:0/704140873 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f9ccc066480 0x7f9ccc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.703+0000 7f9cee238640 1 --2- 172.21.15.5:0/704140873 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f9ccc066480 0x7f9ccc068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40ae000 tx=0x7f9ce40a7000 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:29.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.707+0000 7f9cdeffd640 1 -- 172.21.15.5:0/704140873 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9ce0050bc0 con 0x7f9ce80af2b0 2023-07-14T13:05:29.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.883+0000 7f9cf049c640 1 -- 172.21.15.5:0/704140873 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ce80af6f0 con 0x7f9ccc066480 2023-07-14T13:05:29.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.963+0000 7f9cdeffd640 1 -- 172.21.15.5:0/704140873 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f9ce40ac610 con 0x7f9ccc066480 2023-07-14T13:05:29.994 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule removed for path /snap_test_dir1/dir1 2023-07-14T13:05:29.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.967+0000 7f9cf049c640 1 -- 172.21.15.5:0/704140873 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f9ccc066480 msgr2=0x7f9ccc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:29.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.967+0000 7f9cf049c640 1 --2- 172.21.15.5:0/704140873 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f9ccc066480 0x7f9ccc068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40ae000 tx=0x7f9ce40a7000 comp rx=0 tx=0).stop 2023-07-14T13:05:29.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.967+0000 7f9cf049c640 1 -- 172.21.15.5:0/704140873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ce80af2b0 msgr2=0x7f9ce80c3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:29.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.967+0000 7f9cf049c640 1 --2- 172.21.15.5:0/704140873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ce80af2b0 0x7f9ce80c3e90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0001570 tx=0x7f9ce000cd20 comp rx=0 tx=0).stop 2023-07-14T13:05:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.967+0000 7f9cf049c640 1 -- 172.21.15.5:0/704140873 shutdown_connections 2023-07-14T13:05:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.967+0000 7f9cf049c640 1 --2- 172.21.15.5:0/704140873 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f9ccc066480 0x7f9ccc068930 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.967+0000 7f9cf049c640 1 --2- 172.21.15.5:0/704140873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ce80af2b0 0x7f9ce80c3e90 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.967+0000 7f9cf049c640 1 --2- 172.21.15.5:0/704140873 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ce8070f30 0x7f9ce80c3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.967+0000 7f9cf049c640 1 --2- 172.21.15.5:0/704140873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ce8069430 0x7f9ce8152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.967+0000 7f9cf049c640 1 -- 172.21.15.5:0/704140873 >> 172.21.15.5:0/704140873 conn(0x7f9ce80cde90 msgr2=0x7f9ce8153bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:29.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.967+0000 7f9cf049c640 1 -- 172.21.15.5:0/704140873 shutdown_connections 2023-07-14T13:05:29.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:29.967+0000 7f9cf049c640 1 -- 172.21.15.5:0/704140873 wait complete. 2023-07-14T13:05:30.015 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir1 2023-07-14T13:05:30.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:30.016 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-07-14T13:05:30.025 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_55_00_UTC 2023-07-14T13:05:30.026 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:30.026 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:30.026 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:30.026 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:30.026 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:30.026 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_01_01_UTC 2023-07-14T13:05:30.026 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:30.027 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_03_00_UTC 2023-07-14T13:05:30.027 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:30.027 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:30.028 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-14-12_55_00_UTC 2023-07-14T13:05:30.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:30.028 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-14-12_55_00_UTC) 2023-07-14T13:05:30.090 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:30.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:30.091 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-14-12_56_00_UTC) 2023-07-14T13:05:30.146 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:30.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:30.147 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-14-12_57_00_UTC) 2023-07-14T13:05:30.201 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:30.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:30.203 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-14-12_58_00_UTC) 2023-07-14T13:05:30.262 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:30.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:30.263 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-14-12_59_00_UTC) 2023-07-14T13:05:30.319 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:30.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:30.320 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-14-13_00_00_UTC) 2023-07-14T13:05:30.378 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-14-13_01_01_UTC 2023-07-14T13:05:30.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:30.379 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-14-13_01_01_UTC) 2023-07-14T13:05:30.435 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:30.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:30.436 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-14-13_02_00_UTC) 2023-07-14T13:05:30.499 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-14-13_03_00_UTC 2023-07-14T13:05:30.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:30.500 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-14-13_03_00_UTC) 2023-07-14T13:05:30.561 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:30.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:30.562 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-14-13_04_00_UTC) 2023-07-14T13:05:30.618 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:30.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:30.619 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-14-13_05_00_UTC) 2023-07-14T13:05:30.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:30.675 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1) 2023-07-14T13:05:30.736 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir2 1M 2023-07-14T13:05:30.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.943+0000 7fcd8a51e640 1 Processor -- start 2023-07-14T13:05:30.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.943+0000 7fcd8a51e640 1 -- start start 2023-07-14T13:05:30.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.943+0000 7fcd8a51e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd840cf2e0 0x7fcd840cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:30.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.943+0000 7fcd8a51e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd840ca790 0x7fcd840cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:30.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.943+0000 7fcd8a51e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd840d0920 con 0x7fcd8406a540 2023-07-14T13:05:30.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.943+0000 7fcd8a51e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd8415bfd0 con 0x7fcd840cf2e0 2023-07-14T13:05:30.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.943+0000 7fcd8a51e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd840cfd10 con 0x7fcd840ca790 2023-07-14T13:05:30.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.947+0000 7fcd83fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcd8406a540 0x7fcd8406a910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33762/0 (socket says 172.21.15.5:33762) 2023-07-14T13:05:30.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.947+0000 7fcd83fff640 1 -- 172.21.15.5:0/3032262586 learned_addr learned my addr 172.21.15.5:0/3032262586 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:30.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.947+0000 7fcd837fe640 1 --2- 172.21.15.5:0/3032262586 >> v2:172.21.15.154:3300/0 conn(0x7fcd840cf2e0 0x7fcd840cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:30.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.947+0000 7fcd88abb640 1 --2- 172.21.15.5:0/3032262586 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd840ca790 0x7fcd840cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:30.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.947+0000 7fcd82ffd640 1 -- 172.21.15.5:0/3032262586 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4146086185 0 0) 0x7fcd840d0920 con 0x7fcd8406a540 2023-07-14T13:05:30.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.947+0000 7fcd82ffd640 1 -- 172.21.15.5:0/3032262586 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd6c003530 con 0x7fcd8406a540 2023-07-14T13:05:30.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.947+0000 7fcd88abb640 1 -- 172.21.15.5:0/3032262586 >> v2:172.21.15.154:3300/0 conn(0x7fcd840cf2e0 msgr2=0x7fcd840cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:30.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.947+0000 7fcd88abb640 1 --2- 172.21.15.5:0/3032262586 >> v2:172.21.15.154:3300/0 conn(0x7fcd840cf2e0 0x7fcd840cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:30.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.947+0000 7fcd88abb640 1 -- 172.21.15.5:0/3032262586 >> v1:172.21.15.5:6789/0 conn(0x7fcd8406a540 legacy=0x7fcd8406a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:30.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.947+0000 7fcd88abb640 1 -- 172.21.15.5:0/3032262586 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd840cfff0 con 0x7fcd840ca790 2023-07-14T13:05:30.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.947+0000 7fcd88abb640 1 --2- 172.21.15.5:0/3032262586 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd840ca790 0x7fcd840cac00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c009d90 tx=0x7fcd7c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0318c00c8fac3ce server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:30.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.947+0000 7fcd82ffd640 1 -- 172.21.15.5:0/3032262586 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c0a59e0 con 0x7fcd840ca790 2023-07-14T13:05:30.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.947+0000 7fcd82ffd640 1 -- 172.21.15.5:0/3032262586 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7c0a5b40 con 0x7fcd840ca790 2023-07-14T13:05:30.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.947+0000 7fcd82ffd640 1 -- 172.21.15.5:0/3032262586 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c0ad440 con 0x7fcd840ca790 2023-07-14T13:05:30.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.951+0000 7fcd8a51e640 1 -- 172.21.15.5:0/3032262586 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd840ca790 msgr2=0x7fcd840cac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:30.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.951+0000 7fcd8a51e640 1 --2- 172.21.15.5:0/3032262586 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd840ca790 0x7fcd840cac00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c009d90 tx=0x7fcd7c01c920 comp rx=0 tx=0).stop 2023-07-14T13:05:30.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.951+0000 7fcd8a51e640 1 -- 172.21.15.5:0/3032262586 shutdown_connections 2023-07-14T13:05:30.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.951+0000 7fcd8a51e640 1 --2- 172.21.15.5:0/3032262586 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd840ca790 0x7fcd840cac00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:30.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.951+0000 7fcd8a51e640 1 --2- 172.21.15.5:0/3032262586 >> v2:172.21.15.154:3300/0 conn(0x7fcd840cf2e0 0x7fcd840cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:30.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.951+0000 7fcd8a51e640 1 -- 172.21.15.5:0/3032262586 >> 172.21.15.5:0/3032262586 conn(0x7fcd84099490 msgr2=0x7fcd84089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:30.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.951+0000 7fcd8a51e640 1 -- 172.21.15.5:0/3032262586 shutdown_connections 2023-07-14T13:05:30.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.951+0000 7fcd8a51e640 1 -- 172.21.15.5:0/3032262586 wait complete. 2023-07-14T13:05:30.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.951+0000 7fcd8a51e640 1 Processor -- start 2023-07-14T13:05:30.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.951+0000 7fcd8a51e640 1 -- start start 2023-07-14T13:05:30.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.951+0000 7fcd8a51e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd8406a540 0x7fcd8414c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:30.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.951+0000 7fcd8a51e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd840ca790 0x7fcd8415b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:30.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.951+0000 7fcd8a51e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd840cf2e0 0x7fcd8415a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:30.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.951+0000 7fcd8a51e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd84154760 con 0x7fcd8406a540 2023-07-14T13:05:30.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.951+0000 7fcd8a51e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd84154a40 con 0x7fcd840ca790 2023-07-14T13:05:30.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.951+0000 7fcd8a51e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd84154d20 con 0x7fcd840cf2e0 2023-07-14T13:05:30.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.951+0000 7fcd83fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd8406a540 0x7fcd8414c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:30.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.951+0000 7fcd83fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd8406a540 0x7fcd8414c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41340/0 (socket says 172.21.15.5:41340) 2023-07-14T13:05:30.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.951+0000 7fcd83fff640 1 -- 172.21.15.5:0/2067631852 learned_addr learned my addr 172.21.15.5:0/2067631852 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:30.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.951+0000 7fcd88abb640 1 --2- 172.21.15.5:0/2067631852 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd840cf2e0 0x7fcd8415a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:30.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.951+0000 7fcd837fe640 1 --2- 172.21.15.5:0/2067631852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd840ca790 0x7fcd8415b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:30.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.955+0000 7fcd83fff640 1 -- 172.21.15.5:0/2067631852 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd840cf2e0 msgr2=0x7fcd8415a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:30.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.955+0000 7fcd83fff640 1 --2- 172.21.15.5:0/2067631852 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd840cf2e0 0x7fcd8415a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:30.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.955+0000 7fcd83fff640 1 -- 172.21.15.5:0/2067631852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd840ca790 msgr2=0x7fcd8415b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:30.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.955+0000 7fcd83fff640 1 --2- 172.21.15.5:0/2067631852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd840ca790 0x7fcd8415b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:30.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.955+0000 7fcd83fff640 1 -- 172.21.15.5:0/2067631852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c009a70 con 0x7fcd8406a540 2023-07-14T13:05:30.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.955+0000 7fcd83fff640 1 --2- 172.21.15.5:0/2067631852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd8406a540 0x7fcd8414c490 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400c3c0 tx=0x7fcd7400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:30.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.955+0000 7fcd80ff9640 1 -- 172.21.15.5:0/2067631852 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd74005cf0 con 0x7fcd8406a540 2023-07-14T13:05:30.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.955+0000 7fcd80ff9640 1 -- 172.21.15.5:0/2067631852 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd74005e50 con 0x7fcd8406a540 2023-07-14T13:05:30.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.955+0000 7fcd80ff9640 1 -- 172.21.15.5:0/2067631852 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd740072f0 con 0x7fcd8406a540 2023-07-14T13:05:30.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.955+0000 7fcd8a51e640 1 -- 172.21.15.5:0/2067631852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd84155000 con 0x7fcd8406a540 2023-07-14T13:05:30.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.955+0000 7fcd8a51e640 1 -- 172.21.15.5:0/2067631852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd8414c9d0 con 0x7fcd8406a540 2023-07-14T13:05:30.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.955+0000 7fcd8a51e640 1 -- 172.21.15.5:0/2067631852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd840678d0 con 0x7fcd8406a540 2023-07-14T13:05:30.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.955+0000 7fcd80ff9640 1 -- 172.21.15.5:0/2067631852 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fcd74007450 con 0x7fcd8406a540 2023-07-14T13:05:30.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.955+0000 7fcd80ff9640 1 --2- 172.21.15.5:0/2067631852 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fcd70066480 0x7fcd70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:30.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.959+0000 7fcd80ff9640 1 -- 172.21.15.5:0/2067631852 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fcd74083940 con 0x7fcd8406a540 2023-07-14T13:05:30.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.959+0000 7fcd837fe640 1 --2- 172.21.15.5:0/2067631852 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fcd70066480 0x7fcd70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:30.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.959+0000 7fcd837fe640 1 --2- 172.21.15.5:0/2067631852 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fcd70066480 0x7fcd70068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcd841537e0 tx=0x7fcd78009190 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:30.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:30.963+0000 7fcd80ff9640 1 -- 172.21.15.5:0/2067631852 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fcd740508b0 con 0x7fcd8406a540 2023-07-14T13:05:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:31.135+0000 7fcd8a51e640 1 -- 172.21.15.5:0/2067631852 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd840cee70 con 0x7fcd70066480 2023-07-14T13:05:31.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:31.207+0000 7fcd80ff9640 1 -- 172.21.15.5:0/2067631852 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fcd78011a30 con 0x7fcd70066480 2023-07-14T13:05:31.237 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule removed for path /snap_test_dir1/dir2 2023-07-14T13:05:31.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:31.211+0000 7fcd8a51e640 1 -- 172.21.15.5:0/2067631852 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fcd70066480 msgr2=0x7fcd70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:31.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:31.211+0000 7fcd8a51e640 1 --2- 172.21.15.5:0/2067631852 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fcd70066480 0x7fcd70068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcd841537e0 tx=0x7fcd78009190 comp rx=0 tx=0).stop 2023-07-14T13:05:31.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:31.211+0000 7fcd8a51e640 1 -- 172.21.15.5:0/2067631852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd8406a540 msgr2=0x7fcd8414c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:31.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:31.211+0000 7fcd8a51e640 1 --2- 172.21.15.5:0/2067631852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd8406a540 0x7fcd8414c490 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400c3c0 tx=0x7fcd7400c880 comp rx=0 tx=0).stop 2023-07-14T13:05:31.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:31.211+0000 7fcd8a51e640 1 -- 172.21.15.5:0/2067631852 shutdown_connections 2023-07-14T13:05:31.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:31.211+0000 7fcd8a51e640 1 --2- 172.21.15.5:0/2067631852 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fcd70066480 0x7fcd70068930 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:31.211+0000 7fcd8a51e640 1 --2- 172.21.15.5:0/2067631852 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcd840cf2e0 0x7fcd8415a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:31.211+0000 7fcd8a51e640 1 --2- 172.21.15.5:0/2067631852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd840ca790 0x7fcd8415b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:31.211+0000 7fcd8a51e640 1 --2- 172.21.15.5:0/2067631852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd8406a540 0x7fcd8414c490 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:31.211+0000 7fcd8a51e640 1 -- 172.21.15.5:0/2067631852 >> 172.21.15.5:0/2067631852 conn(0x7fcd84099490 msgr2=0x7fcd8406ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:31.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:31.211+0000 7fcd8a51e640 1 -- 172.21.15.5:0/2067631852 shutdown_connections 2023-07-14T13:05:31.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:31.211+0000 7fcd8a51e640 1 -- 172.21.15.5:0/2067631852 wait complete. 2023-07-14T13:05:31.258 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir2 2023-07-14T13:05:31.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:31.259 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-07-14T13:05:31.269 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_55_00_UTC 2023-07-14T13:05:31.270 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:31.270 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:31.270 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:31.270 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:31.270 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:31.270 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_01_00_UTC 2023-07-14T13:05:31.270 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:31.271 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_03_00_UTC 2023-07-14T13:05:31.271 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:31.271 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:31.272 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-14-12_55_00_UTC 2023-07-14T13:05:31.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:31.272 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-14-12_55_00_UTC) 2023-07-14T13:05:31.336 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:31.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:31.336 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-14-12_56_00_UTC) 2023-07-14T13:05:31.398 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:31.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:31.399 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-14-12_57_00_UTC) 2023-07-14T13:05:31.455 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:31.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:31.456 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-14-12_58_00_UTC) 2023-07-14T13:05:31.515 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:31.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:31.516 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-14-12_59_00_UTC) 2023-07-14T13:05:31.569 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:31.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:31.570 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-14-13_00_00_UTC) 2023-07-14T13:05:31.630 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-14-13_01_00_UTC 2023-07-14T13:05:31.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:31.631 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-14-13_01_00_UTC) 2023-07-14T13:05:31.686 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:31.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:31.688 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-14-13_02_00_UTC) 2023-07-14T13:05:31.762 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-14-13_03_00_UTC 2023-07-14T13:05:31.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:31.763 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-14-13_03_00_UTC) 2023-07-14T13:05:31.822 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:31.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:31.823 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-14-13_04_00_UTC) 2023-07-14T13:05:31.878 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:31.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:31.879 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-14-13_05_00_UTC) 2023-07-14T13:05:31.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:31.953 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2) 2023-07-14T13:05:32.006 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir3 1M 2023-07-14T13:05:32.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.163+0000 7ffa6bddb640 1 Processor -- start 2023-07-14T13:05:32.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.163+0000 7ffa6bddb640 1 -- start start 2023-07-14T13:05:32.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa6bddb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa640aeb40 0x7ffa6415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:32.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa6bddb640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa641532b0 con 0x7ffa64159440 2023-07-14T13:05:32.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa6bddb640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa640ca6f0 con 0x7ffa640aef10 2023-07-14T13:05:32.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa6bddb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa641599d0 con 0x7ffa640aeb40 2023-07-14T13:05:32.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa6a378640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ffa64159440 0x7ffa640c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33776/0 (socket says 172.21.15.5:33776) 2023-07-14T13:05:32.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa6a378640 1 -- 172.21.15.5:0/836106084 learned_addr learned my addr 172.21.15.5:0/836106084 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:32.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa69b77640 1 --2- 172.21.15.5:0/836106084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa640aeb40 0x7ffa6415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:32.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa68b75640 1 -- 172.21.15.5:0/836106084 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 706330470 0 0) 0x7ffa641532b0 con 0x7ffa64159440 2023-07-14T13:05:32.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa68b75640 1 -- 172.21.15.5:0/836106084 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa50003530 con 0x7ffa64159440 2023-07-14T13:05:32.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa68b75640 1 -- 172.21.15.5:0/836106084 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2239655785 0 0) 0x7ffa640ca6f0 con 0x7ffa640aef10 2023-07-14T13:05:32.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa68b75640 1 -- 172.21.15.5:0/836106084 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa641532b0 con 0x7ffa640aef10 2023-07-14T13:05:32.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa68b75640 1 -- 172.21.15.5:0/836106084 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1226866399 0 0) 0x7ffa50003530 con 0x7ffa64159440 2023-07-14T13:05:32.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa68b75640 1 -- 172.21.15.5:0/836106084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa640aeb40 msgr2=0x7ffa6415cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:32.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa68b75640 1 --2- 172.21.15.5:0/836106084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa640aeb40 0x7ffa6415cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:32.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa68b75640 1 -- 172.21.15.5:0/836106084 >> v1:172.21.15.154:6789/0 conn(0x7ffa640aef10 legacy=0x7ffa64158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:32.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa68b75640 1 -- 172.21.15.5:0/836106084 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa64159cb0 con 0x7ffa64159440 2023-07-14T13:05:32.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa68b75640 1 -- 172.21.15.5:0/836106084 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7ffa5c001a00 con 0x7ffa64159440 2023-07-14T13:05:32.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa68b75640 1 -- 172.21.15.5:0/836106084 >> v1:172.21.15.5:6789/0 conn(0x7ffa64159440 legacy=0x7ffa640c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:32.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa68b75640 1 --2- 172.21.15.5:0/836106084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa50003b40 0x7ffa50003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:32.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa68b75640 1 --2- 172.21.15.5:0/836106084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa500047d0 0x7ffa50004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:32.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa68b75640 1 --2- 172.21.15.5:0/836106084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa50005180 0x7ffa5000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:32.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa68b75640 1 -- 172.21.15.5:0/836106084 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa641599d0 con 0x7ffa50003b40 2023-07-14T13:05:32.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa68b75640 1 -- 172.21.15.5:0/836106084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5000e1f0 con 0x7ffa50005180 2023-07-14T13:05:32.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa68b75640 1 -- 172.21.15.5:0/836106084 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5000e3b0 con 0x7ffa500047d0 2023-07-14T13:05:32.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa69b77640 1 --2- 172.21.15.5:0/836106084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa640aeb40 0x7ffa6415cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:32.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa69376640 1 --2- 172.21.15.5:0/836106084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa500047d0 0x7ffa50004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:32.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa6a378640 1 --2- 172.21.15.5:0/836106084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa50005180 0x7ffa5000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:32.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa69b77640 1 --2- 172.21.15.5:0/836106084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa50003b40 0x7ffa50003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:32.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa69b77640 1 -- 172.21.15.5:0/836106084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa500047d0 msgr2=0x7ffa50004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:32.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa69b77640 1 --2- 172.21.15.5:0/836106084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa500047d0 0x7ffa50004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:32.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa69b77640 1 -- 172.21.15.5:0/836106084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa50005180 msgr2=0x7ffa5000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:32.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa69b77640 1 --2- 172.21.15.5:0/836106084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa50005180 0x7ffa5000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:32.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.167+0000 7ffa69b77640 1 -- 172.21.15.5:0/836106084 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa50003530 con 0x7ffa50003b40 2023-07-14T13:05:32.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.171+0000 7ffa69b77640 1 --2- 172.21.15.5:0/836106084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa50003b40 0x7ffa50003f30 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ffa640cb960 tx=0x7ffa6001ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480e46ec226d9b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:32.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.171+0000 7ffa68b75640 1 -- 172.21.15.5:0/836106084 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa60004030 con 0x7ffa50003b40 2023-07-14T13:05:32.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.171+0000 7ffa68b75640 1 -- 172.21.15.5:0/836106084 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa60004190 con 0x7ffa50003b40 2023-07-14T13:05:32.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.171+0000 7ffa68b75640 1 -- 172.21.15.5:0/836106084 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa60004520 con 0x7ffa50003b40 2023-07-14T13:05:32.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.171+0000 7ffa6bddb640 1 -- 172.21.15.5:0/836106084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa50003b40 msgr2=0x7ffa50003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:32.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.171+0000 7ffa6bddb640 1 --2- 172.21.15.5:0/836106084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa50003b40 0x7ffa50003f30 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ffa640cb960 tx=0x7ffa6001ca60 comp rx=0 tx=0).stop 2023-07-14T13:05:32.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.171+0000 7ffa6a378640 1 -- 172.21.15.5:0/836106084 reap_dead start 2023-07-14T13:05:32.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.171+0000 7ffa6bddb640 1 -- 172.21.15.5:0/836106084 shutdown_connections 2023-07-14T13:05:32.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.171+0000 7ffa6bddb640 1 -- 172.21.15.5:0/836106084 >> 172.21.15.5:0/836106084 conn(0x7ffa640cde90 msgr2=0x7ffa640ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:32.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.171+0000 7ffa6bddb640 1 -- 172.21.15.5:0/836106084 shutdown_connections 2023-07-14T13:05:32.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.171+0000 7ffa6bddb640 1 -- 172.21.15.5:0/836106084 wait complete. 2023-07-14T13:05:32.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.175+0000 7ffa6bddb640 1 Processor -- start 2023-07-14T13:05:32.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.175+0000 7ffa6bddb640 1 -- start start 2023-07-14T13:05:32.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.175+0000 7ffa6bddb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa50003b40 0x7ffa640b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:32.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.175+0000 7ffa6bddb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa640700b0 0x7ffa64070520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:32.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.175+0000 7ffa6bddb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa641401d0 0x7ffa64140640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:32.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.175+0000 7ffa6bddb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa64070a60 con 0x7ffa641401d0 2023-07-14T13:05:32.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.175+0000 7ffa6bddb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6413e0d0 con 0x7ffa50003b40 2023-07-14T13:05:32.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.175+0000 7ffa6bddb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa640b0dc0 con 0x7ffa640700b0 2023-07-14T13:05:32.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.175+0000 7ffa6a378640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa641401d0 0x7ffa64140640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:32.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.175+0000 7ffa69b77640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa50003b40 0x7ffa640b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:32.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.175+0000 7ffa6a378640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa641401d0 0x7ffa64140640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41356/0 (socket says 172.21.15.5:41356) 2023-07-14T13:05:32.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.175+0000 7ffa6a378640 1 -- 172.21.15.5:0/3079479302 learned_addr learned my addr 172.21.15.5:0/3079479302 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:32.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.175+0000 7ffa69376640 1 --2- 172.21.15.5:0/3079479302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa640700b0 0x7ffa64070520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:32.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.175+0000 7ffa6a378640 1 -- 172.21.15.5:0/3079479302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa640700b0 msgr2=0x7ffa64070520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:32.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.175+0000 7ffa6a378640 1 --2- 172.21.15.5:0/3079479302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa640700b0 0x7ffa64070520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:32.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.175+0000 7ffa6a378640 1 -- 172.21.15.5:0/3079479302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa50003b40 msgr2=0x7ffa640b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:32.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.175+0000 7ffa6a378640 1 --2- 172.21.15.5:0/3079479302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa50003b40 0x7ffa640b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:32.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.175+0000 7ffa6a378640 1 -- 172.21.15.5:0/3079479302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa64140f20 con 0x7ffa641401d0 2023-07-14T13:05:32.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.175+0000 7ffa6a378640 1 --2- 172.21.15.5:0/3079479302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa641401d0 0x7ffa64140640 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c000f90 tx=0x7ffa5c007670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:32.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.175+0000 7ffa5a7fc640 1 -- 172.21.15.5:0/3079479302 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c0133f0 con 0x7ffa641401d0 2023-07-14T13:05:32.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.175+0000 7ffa5a7fc640 1 -- 172.21.15.5:0/3079479302 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5c013550 con 0x7ffa641401d0 2023-07-14T13:05:32.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.175+0000 7ffa6bddb640 1 -- 172.21.15.5:0/3079479302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6413e320 con 0x7ffa641401d0 2023-07-14T13:05:32.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.175+0000 7ffa5a7fc640 1 -- 172.21.15.5:0/3079479302 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c013900 con 0x7ffa641401d0 2023-07-14T13:05:32.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.175+0000 7ffa6bddb640 1 -- 172.21.15.5:0/3079479302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6413e8e0 con 0x7ffa641401d0 2023-07-14T13:05:32.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.175+0000 7ffa6bddb640 1 -- 172.21.15.5:0/3079479302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa640678d0 con 0x7ffa641401d0 2023-07-14T13:05:32.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.179+0000 7ffa5a7fc640 1 -- 172.21.15.5:0/3079479302 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7ffa5c013a60 con 0x7ffa641401d0 2023-07-14T13:05:32.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.179+0000 7ffa5a7fc640 1 --2- 172.21.15.5:0/3079479302 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7ffa480664b0 0x7ffa48068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:32.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.179+0000 7ffa5a7fc640 1 -- 172.21.15.5:0/3079479302 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6901+0+0 (secure 0 0 0) 0x7ffa5c084390 con 0x7ffa641401d0 2023-07-14T13:05:32.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.179+0000 7ffa69b77640 1 --2- 172.21.15.5:0/3079479302 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7ffa480664b0 0x7ffa48068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:32.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.179+0000 7ffa69b77640 1 --2- 172.21.15.5:0/3079479302 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7ffa480664b0 0x7ffa48068960 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffa600ad000 tx=0x7ffa600046d0 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:32.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.183+0000 7ffa5a7fc640 1 -- 172.21.15.5:0/3079479302 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ffa5c051230 con 0x7ffa641401d0 2023-07-14T13:05:32.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.359+0000 7ffa6bddb640 1 -- 172.21.15.5:0/3079479302 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa6415c9d0 con 0x7ffa480664b0 2023-07-14T13:05:32.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.427+0000 7ffa5a7fc640 1 -- 172.21.15.5:0/3079479302 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7ffa6000f000 con 0x7ffa480664b0 2023-07-14T13:05:32.459 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule removed for path /snap_test_dir1/dir3 2023-07-14T13:05:32.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.431+0000 7ffa6bddb640 1 -- 172.21.15.5:0/3079479302 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7ffa480664b0 msgr2=0x7ffa48068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:32.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.431+0000 7ffa6bddb640 1 --2- 172.21.15.5:0/3079479302 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7ffa480664b0 0x7ffa48068960 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffa600ad000 tx=0x7ffa600046d0 comp rx=0 tx=0).stop 2023-07-14T13:05:32.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.431+0000 7ffa6bddb640 1 -- 172.21.15.5:0/3079479302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa641401d0 msgr2=0x7ffa64140640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:32.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.431+0000 7ffa6bddb640 1 --2- 172.21.15.5:0/3079479302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa641401d0 0x7ffa64140640 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c000f90 tx=0x7ffa5c007670 comp rx=0 tx=0).stop 2023-07-14T13:05:32.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.431+0000 7ffa6bddb640 1 -- 172.21.15.5:0/3079479302 shutdown_connections 2023-07-14T13:05:32.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.431+0000 7ffa6bddb640 1 --2- 172.21.15.5:0/3079479302 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7ffa480664b0 0x7ffa48068960 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:32.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.431+0000 7ffa6bddb640 1 --2- 172.21.15.5:0/3079479302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa641401d0 0x7ffa64140640 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:32.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.431+0000 7ffa6bddb640 1 --2- 172.21.15.5:0/3079479302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa640700b0 0x7ffa64070520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:32.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.431+0000 7ffa6bddb640 1 --2- 172.21.15.5:0/3079479302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa50003b40 0x7ffa640b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:32.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.431+0000 7ffa6bddb640 1 -- 172.21.15.5:0/3079479302 >> 172.21.15.5:0/3079479302 conn(0x7ffa640cde90 msgr2=0x7ffa640c88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:32.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.431+0000 7ffa6bddb640 1 -- 172.21.15.5:0/3079479302 shutdown_connections 2023-07-14T13:05:32.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:32.431+0000 7ffa6bddb640 1 -- 172.21.15.5:0/3079479302 wait complete. 2023-07-14T13:05:32.479 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir3 2023-07-14T13:05:32.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:32.480 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-07-14T13:05:32.490 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_55_00_UTC 2023-07-14T13:05:32.490 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:32.490 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:32.490 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:32.491 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:32.491 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:32.491 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_01_01_UTC 2023-07-14T13:05:32.491 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:32.491 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_03_00_UTC 2023-07-14T13:05:32.491 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:32.491 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:32.492 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-14-12_55_00_UTC 2023-07-14T13:05:32.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:32.493 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-14-12_55_00_UTC) 2023-07-14T13:05:32.555 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:32.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:32.555 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-14-12_56_00_UTC) 2023-07-14T13:05:32.614 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:32.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:32.615 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-14-12_57_00_UTC) 2023-07-14T13:05:32.670 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:32.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:32.671 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-14-12_58_00_UTC) 2023-07-14T13:05:32.745 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:32.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:32.746 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-14-12_59_00_UTC) 2023-07-14T13:05:32.802 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:32.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:32.803 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-14-13_00_00_UTC) 2023-07-14T13:05:32.858 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-14-13_01_01_UTC 2023-07-14T13:05:32.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:32.858 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-14-13_01_01_UTC) 2023-07-14T13:05:32.914 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:32.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:32.915 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-14-13_02_00_UTC) 2023-07-14T13:05:32.970 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-14-13_03_00_UTC 2023-07-14T13:05:32.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:32.970 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-14-13_03_00_UTC) 2023-07-14T13:05:33.025 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:33.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:33.026 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-14-13_04_00_UTC) 2023-07-14T13:05:33.082 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:33.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:33.083 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-14-13_05_00_UTC) 2023-07-14T13:05:33.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:33.138 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3) 2023-07-14T13:05:33.190 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir4 1M 2023-07-14T13:05:33.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.367+0000 7fac907d2640 1 Processor -- start 2023-07-14T13:05:33.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.367+0000 7fac907d2640 1 -- start start 2023-07-14T13:05:33.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.367+0000 7fac907d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac88159440 0x7fac880c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:33.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.367+0000 7fac907d2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac881532b0 con 0x7fac880aeb40 2023-07-14T13:05:33.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.367+0000 7fac907d2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac880ca6f0 con 0x7fac8815cef0 2023-07-14T13:05:33.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.367+0000 7fac907d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8815d360 con 0x7fac88159440 2023-07-14T13:05:33.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.367+0000 7fac8e56e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fac880aeb40 0x7fac880aef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33778/0 (socket says 172.21.15.5:33778) 2023-07-14T13:05:33.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.367+0000 7fac8e56e640 1 -- 172.21.15.5:0/2905744185 learned_addr learned my addr 172.21.15.5:0/2905744185 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:33.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.371+0000 7fac8ed6f640 1 --2- 172.21.15.5:0/2905744185 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac88159440 0x7fac880c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:33.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.371+0000 7fac8d56c640 1 -- 172.21.15.5:0/2905744185 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3409891075 0 0) 0x7fac881532b0 con 0x7fac880aeb40 2023-07-14T13:05:33.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.371+0000 7fac8d56c640 1 -- 172.21.15.5:0/2905744185 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac74005740 con 0x7fac880aeb40 2023-07-14T13:05:33.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.371+0000 7fac8d56c640 1 -- 172.21.15.5:0/2905744185 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2757350745 0 0) 0x7fac880ca6f0 con 0x7fac8815cef0 2023-07-14T13:05:33.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.371+0000 7fac8d56c640 1 -- 172.21.15.5:0/2905744185 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac881532b0 con 0x7fac8815cef0 2023-07-14T13:05:33.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.371+0000 7fac8ed6f640 1 -- 172.21.15.5:0/2905744185 >> v1:172.21.15.154:6789/0 conn(0x7fac8815cef0 legacy=0x7fac88158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:33.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.371+0000 7fac8ed6f640 1 -- 172.21.15.5:0/2905744185 >> v1:172.21.15.5:6789/0 conn(0x7fac880aeb40 legacy=0x7fac880aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:33.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.371+0000 7fac8ed6f640 1 -- 172.21.15.5:0/2905744185 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac881599d0 con 0x7fac88159440 2023-07-14T13:05:33.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.371+0000 7fac8ed6f640 1 --2- 172.21.15.5:0/2905744185 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac88159440 0x7fac880c88c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fac80009dc0 tx=0x7fac8001c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f313f77efb6f532f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:33.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.371+0000 7fac8d56c640 1 -- 172.21.15.5:0/2905744185 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac800a5a00 con 0x7fac88159440 2023-07-14T13:05:33.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.371+0000 7fac8d56c640 1 -- 172.21.15.5:0/2905744185 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac800a5b60 con 0x7fac88159440 2023-07-14T13:05:33.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.371+0000 7fac8d56c640 1 -- 172.21.15.5:0/2905744185 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac800ad440 con 0x7fac88159440 2023-07-14T13:05:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.375+0000 7fac907d2640 1 -- 172.21.15.5:0/2905744185 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac88159440 msgr2=0x7fac880c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.375+0000 7fac907d2640 1 --2- 172.21.15.5:0/2905744185 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac88159440 0x7fac880c88c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fac80009dc0 tx=0x7fac8001c940 comp rx=0 tx=0).stop 2023-07-14T13:05:33.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.375+0000 7fac907d2640 1 -- 172.21.15.5:0/2905744185 shutdown_connections 2023-07-14T13:05:33.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.375+0000 7fac907d2640 1 --2- 172.21.15.5:0/2905744185 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac88159440 0x7fac880c88c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:33.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.375+0000 7fac907d2640 1 -- 172.21.15.5:0/2905744185 >> 172.21.15.5:0/2905744185 conn(0x7fac880cde90 msgr2=0x7fac880ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:33.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.375+0000 7fac907d2640 1 -- 172.21.15.5:0/2905744185 shutdown_connections 2023-07-14T13:05:33.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.375+0000 7fac907d2640 1 -- 172.21.15.5:0/2905744185 wait complete. 2023-07-14T13:05:33.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.375+0000 7fac907d2640 1 Processor -- start 2023-07-14T13:05:33.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.375+0000 7fac907d2640 1 -- start start 2023-07-14T13:05:33.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.375+0000 7fac907d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac880aeb40 0x7fac88158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:33.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.375+0000 7fac907d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac88159440 0x7fac8813efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:33.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.375+0000 7fac907d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac8815cef0 0x7fac88148460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:33.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.375+0000 7fac907d2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac881465d0 con 0x7fac88159440 2023-07-14T13:05:33.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.375+0000 7fac907d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8806bc00 con 0x7fac880aeb40 2023-07-14T13:05:33.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.375+0000 7fac907d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8806bec0 con 0x7fac8815cef0 2023-07-14T13:05:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.375+0000 7fac8dd6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac88159440 0x7fac8813efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.375+0000 7fac8dd6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac88159440 0x7fac8813efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41362/0 (socket says 172.21.15.5:41362) 2023-07-14T13:05:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.375+0000 7fac8e56e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac880aeb40 0x7fac88158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.375+0000 7fac8dd6d640 1 -- 172.21.15.5:0/3938553697 learned_addr learned my addr 172.21.15.5:0/3938553697 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.375+0000 7fac8ed6f640 1 --2- 172.21.15.5:0/3938553697 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac8815cef0 0x7fac88148460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.379+0000 7fac8dd6d640 1 -- 172.21.15.5:0/3938553697 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac8815cef0 msgr2=0x7fac88148460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.379+0000 7fac8dd6d640 1 --2- 172.21.15.5:0/3938553697 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac8815cef0 0x7fac88148460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.379+0000 7fac8dd6d640 1 -- 172.21.15.5:0/3938553697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac880aeb40 msgr2=0x7fac88158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.379+0000 7fac8dd6d640 1 --2- 172.21.15.5:0/3938553697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac880aeb40 0x7fac88158150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:33.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.379+0000 7fac8dd6d640 1 -- 172.21.15.5:0/3938553697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac80009a70 con 0x7fac88159440 2023-07-14T13:05:33.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.379+0000 7fac8e56e640 1 --2- 172.21.15.5:0/3938553697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac880aeb40 0x7fac88158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:33.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.379+0000 7fac8dd6d640 1 --2- 172.21.15.5:0/3938553697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac88159440 0x7fac8813efe0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fac7800c430 tx=0x7fac7800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:33.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.379+0000 7fac7effd640 1 -- 172.21.15.5:0/3938553697 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac780052d0 con 0x7fac88159440 2023-07-14T13:05:33.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.379+0000 7fac7effd640 1 -- 172.21.15.5:0/3938553697 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac78005450 con 0x7fac88159440 2023-07-14T13:05:33.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.379+0000 7fac7effd640 1 -- 172.21.15.5:0/3938553697 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac78003840 con 0x7fac88159440 2023-07-14T13:05:33.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.379+0000 7fac907d2640 1 -- 172.21.15.5:0/3938553697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8806c1a0 con 0x7fac88159440 2023-07-14T13:05:33.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.379+0000 7fac907d2640 1 -- 172.21.15.5:0/3938553697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8806c760 con 0x7fac88159440 2023-07-14T13:05:33.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.379+0000 7fac907d2640 1 -- 172.21.15.5:0/3938553697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac881566a0 con 0x7fac88159440 2023-07-14T13:05:33.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.379+0000 7fac7effd640 1 -- 172.21.15.5:0/3938553697 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fac780039a0 con 0x7fac88159440 2023-07-14T13:05:33.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.379+0000 7fac7effd640 1 --2- 172.21.15.5:0/3938553697 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fac6c066480 0x7fac6c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:33.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.379+0000 7fac7effd640 1 -- 172.21.15.5:0/3938553697 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6933+0+0 (secure 0 0 0) 0x7fac78083930 con 0x7fac88159440 2023-07-14T13:05:33.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.383+0000 7fac8e56e640 1 --2- 172.21.15.5:0/3938553697 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fac6c066480 0x7fac6c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:33.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.383+0000 7fac8e56e640 1 --2- 172.21.15.5:0/3938553697 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fac6c066480 0x7fac6c068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fac84007fd0 tx=0x7fac84007d60 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:33.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.383+0000 7fac7effd640 1 -- 172.21.15.5:0/3938553697 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fac78050910 con 0x7fac88159440 2023-07-14T13:05:33.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.559+0000 7fac907d2640 1 -- 172.21.15.5:0/3938553697 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fac8815c6f0 con 0x7fac6c066480 2023-07-14T13:05:33.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.647+0000 7fac7effd640 1 -- 172.21.15.5:0/3938553697 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fac84007690 con 0x7fac6c066480 2023-07-14T13:05:33.676 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule removed for path /snap_test_dir1/dir4 2023-07-14T13:05:33.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.647+0000 7fac907d2640 1 -- 172.21.15.5:0/3938553697 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fac6c066480 msgr2=0x7fac6c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.647+0000 7fac907d2640 1 --2- 172.21.15.5:0/3938553697 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fac6c066480 0x7fac6c068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fac84007fd0 tx=0x7fac84007d60 comp rx=0 tx=0).stop 2023-07-14T13:05:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.647+0000 7fac907d2640 1 -- 172.21.15.5:0/3938553697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac88159440 msgr2=0x7fac8813efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.647+0000 7fac907d2640 1 --2- 172.21.15.5:0/3938553697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac88159440 0x7fac8813efe0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fac7800c430 tx=0x7fac7800c8f0 comp rx=0 tx=0).stop 2023-07-14T13:05:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.647+0000 7fac907d2640 1 -- 172.21.15.5:0/3938553697 shutdown_connections 2023-07-14T13:05:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.647+0000 7fac907d2640 1 --2- 172.21.15.5:0/3938553697 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fac6c066480 0x7fac6c068930 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.647+0000 7fac907d2640 1 --2- 172.21.15.5:0/3938553697 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac8815cef0 0x7fac88148460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:33.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.647+0000 7fac907d2640 1 --2- 172.21.15.5:0/3938553697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac88159440 0x7fac8813efe0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:33.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.647+0000 7fac907d2640 1 --2- 172.21.15.5:0/3938553697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac880aeb40 0x7fac88158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:33.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.647+0000 7fac907d2640 1 -- 172.21.15.5:0/3938553697 >> 172.21.15.5:0/3938553697 conn(0x7fac880cde90 msgr2=0x7fac880aef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:33.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.647+0000 7fac907d2640 1 -- 172.21.15.5:0/3938553697 shutdown_connections 2023-07-14T13:05:33.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:33.647+0000 7fac907d2640 1 -- 172.21.15.5:0/3938553697 wait complete. 2023-07-14T13:05:33.696 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir4 2023-07-14T13:05:33.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:33.697 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-07-14T13:05:33.708 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_55_00_UTC 2023-07-14T13:05:33.708 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:33.708 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:33.708 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:33.708 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:33.708 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:33.709 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_01_00_UTC 2023-07-14T13:05:33.709 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:33.709 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_03_00_UTC 2023-07-14T13:05:33.709 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:33.709 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:33.710 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-14-12_55_00_UTC 2023-07-14T13:05:33.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:33.710 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-14-12_55_00_UTC) 2023-07-14T13:05:33.779 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:33.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:33.780 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-14-12_56_00_UTC) 2023-07-14T13:05:33.842 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:33.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:33.843 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-14-12_57_00_UTC) 2023-07-14T13:05:33.902 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:33.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:33.903 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-14-12_58_00_UTC) 2023-07-14T13:05:33.958 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:33.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:33.958 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-14-12_59_00_UTC) 2023-07-14T13:05:34.014 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:34.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:34.014 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-14-13_00_00_UTC) 2023-07-14T13:05:34.070 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-14-13_01_00_UTC 2023-07-14T13:05:34.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:34.071 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-14-13_01_00_UTC) 2023-07-14T13:05:34.126 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:34.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:34.126 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-14-13_02_00_UTC) 2023-07-14T13:05:34.181 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-14-13_03_00_UTC 2023-07-14T13:05:34.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:34.182 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-14-13_03_00_UTC) 2023-07-14T13:05:34.238 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:34.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:34.239 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-14-13_04_00_UTC) 2023-07-14T13:05:34.294 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:34.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:34.295 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-14-13_05_00_UTC) 2023-07-14T13:05:34.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:34.350 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4) 2023-07-14T13:05:34.402 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir5 1M 2023-07-14T13:05:34.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.563+0000 7fea7359e640 1 Processor -- start 2023-07-14T13:05:34.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.563+0000 7fea7359e640 1 -- start start 2023-07-14T13:05:34.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.563+0000 7fea7359e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea7415cbb0 0x7fea740cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:34.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.563+0000 7fea7359e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fea740cc970 0x7fea740ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:34.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.563+0000 7fea7359e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea74158f00 con 0x7fea7406c160 2023-07-14T13:05:34.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.563+0000 7fea7359e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea740ca3a0 con 0x7fea740cc970 2023-07-14T13:05:34.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.563+0000 7fea7359e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7406f060 con 0x7fea7415cbb0 2023-07-14T13:05:34.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.563+0000 7fea72d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fea740cc970 0x7fea740ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:34.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.563+0000 7fea7259c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fea7406c160 0x7fea7406c530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33780/0 (socket says 172.21.15.5:33780) 2023-07-14T13:05:34.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.563+0000 7fea7259c640 1 -- 172.21.15.5:0/2916351793 learned_addr learned my addr 172.21.15.5:0/2916351793 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:34.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.563+0000 7fea6bfff640 1 --2- 172.21.15.5:0/2916351793 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea7415cbb0 0x7fea740cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:34.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.563+0000 7fea72d9d640 1 -- 172.21.15.5:0/2916351793 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea7415cbb0 msgr2=0x7fea740cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:34.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.563+0000 7fea72d9d640 1 --2- 172.21.15.5:0/2916351793 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea7415cbb0 0x7fea740cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:34.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.563+0000 7fea72d9d640 1 -- 172.21.15.5:0/2916351793 >> v1:172.21.15.5:6789/0 conn(0x7fea7406c160 legacy=0x7fea7406c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:34.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.563+0000 7fea72d9d640 1 -- 172.21.15.5:0/2916351793 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea741591e0 con 0x7fea740cc970 2023-07-14T13:05:34.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.563+0000 7fea6bfff640 1 --2- 172.21.15.5:0/2916351793 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea7415cbb0 0x7fea740cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:05:34.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.567+0000 7fea72d9d640 1 --2- 172.21.15.5:0/2916351793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea740cc970 0x7fea740ccdf0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fea6c009d90 tx=0x7fea6c01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dcc360d3cb0f908 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:34.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.567+0000 7fea71d9b640 1 -- 172.21.15.5:0/2916351793 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c0a5860 con 0x7fea740cc970 2023-07-14T13:05:34.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.567+0000 7fea71d9b640 1 -- 172.21.15.5:0/2916351793 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6c0a59c0 con 0x7fea740cc970 2023-07-14T13:05:34.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.567+0000 7fea71d9b640 1 -- 172.21.15.5:0/2916351793 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c0a5d50 con 0x7fea740cc970 2023-07-14T13:05:34.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.567+0000 7fea7359e640 1 -- 172.21.15.5:0/2916351793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea740cc970 msgr2=0x7fea740ccdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:34.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.567+0000 7fea7359e640 1 --2- 172.21.15.5:0/2916351793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea740cc970 0x7fea740ccdf0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fea6c009d90 tx=0x7fea6c01c890 comp rx=0 tx=0).stop 2023-07-14T13:05:34.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.567+0000 7fea7359e640 1 -- 172.21.15.5:0/2916351793 shutdown_connections 2023-07-14T13:05:34.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.567+0000 7fea7359e640 1 --2- 172.21.15.5:0/2916351793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea740cc970 0x7fea740ccdf0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:34.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.567+0000 7fea7359e640 1 --2- 172.21.15.5:0/2916351793 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea7415cbb0 0x7fea740cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:34.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.567+0000 7fea7359e640 1 -- 172.21.15.5:0/2916351793 >> 172.21.15.5:0/2916351793 conn(0x7fea740ca800 msgr2=0x7fea740cac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:34.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.567+0000 7fea7359e640 1 -- 172.21.15.5:0/2916351793 shutdown_connections 2023-07-14T13:05:34.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.567+0000 7fea7359e640 1 -- 172.21.15.5:0/2916351793 wait complete. 2023-07-14T13:05:34.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.571+0000 7fea7359e640 1 Processor -- start 2023-07-14T13:05:34.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.571+0000 7fea7359e640 1 -- start start 2023-07-14T13:05:34.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.571+0000 7fea7359e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea7406c160 0x7fea7414fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:34.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.571+0000 7fea7359e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea740cc970 0x7fea740c1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:34.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.571+0000 7fea7359e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea7415cbb0 0x7fea7415af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:34.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.571+0000 7fea7359e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea74158610 con 0x7fea740cc970 2023-07-14T13:05:34.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.571+0000 7fea7359e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea74159c90 con 0x7fea7406c160 2023-07-14T13:05:34.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.571+0000 7fea7359e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea74159ee0 con 0x7fea7415cbb0 2023-07-14T13:05:34.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.571+0000 7fea6bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea740cc970 0x7fea740c1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:34.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.571+0000 7fea6bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea740cc970 0x7fea740c1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41388/0 (socket says 172.21.15.5:41388) 2023-07-14T13:05:34.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.571+0000 7fea6bfff640 1 -- 172.21.15.5:0/3972303624 learned_addr learned my addr 172.21.15.5:0/3972303624 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:34.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.571+0000 7fea7259c640 1 --2- 172.21.15.5:0/3972303624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea7406c160 0x7fea7414fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:34.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.571+0000 7fea72d9d640 1 --2- 172.21.15.5:0/3972303624 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea7415cbb0 0x7fea7415af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:34.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.571+0000 7fea6bfff640 1 -- 172.21.15.5:0/3972303624 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea7415cbb0 msgr2=0x7fea7415af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:34.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.571+0000 7fea6bfff640 1 --2- 172.21.15.5:0/3972303624 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea7415cbb0 0x7fea7415af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:34.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.571+0000 7fea6bfff640 1 -- 172.21.15.5:0/3972303624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea7406c160 msgr2=0x7fea7414fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:34.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.571+0000 7fea6bfff640 1 --2- 172.21.15.5:0/3972303624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea7406c160 0x7fea7414fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:34.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.571+0000 7fea6bfff640 1 -- 172.21.15.5:0/3972303624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6c009a70 con 0x7fea740cc970 2023-07-14T13:05:34.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.571+0000 7fea6bfff640 1 --2- 172.21.15.5:0/3972303624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea740cc970 0x7fea740c1d20 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00c7f0 tx=0x7fea5c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:34.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.571+0000 7fea6affd640 1 -- 172.21.15.5:0/3972303624 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c007820 con 0x7fea740cc970 2023-07-14T13:05:34.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.571+0000 7fea6affd640 1 -- 172.21.15.5:0/3972303624 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5c007980 con 0x7fea740cc970 2023-07-14T13:05:34.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.571+0000 7fea6affd640 1 -- 172.21.15.5:0/3972303624 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c007d30 con 0x7fea740cc970 2023-07-14T13:05:34.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.571+0000 7fea7359e640 1 -- 172.21.15.5:0/3972303624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea7415a1c0 con 0x7fea740cc970 2023-07-14T13:05:34.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.571+0000 7fea7359e640 1 -- 172.21.15.5:0/3972303624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea7415a780 con 0x7fea740cc970 2023-07-14T13:05:34.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.575+0000 7fea7359e640 1 -- 172.21.15.5:0/3972303624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea7404e020 con 0x7fea740cc970 2023-07-14T13:05:34.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.575+0000 7fea6affd640 1 -- 172.21.15.5:0/3972303624 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fea5c0113f0 con 0x7fea740cc970 2023-07-14T13:05:34.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.575+0000 7fea6affd640 1 --2- 172.21.15.5:0/3972303624 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fea540664b0 0x7fea54068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:34.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.575+0000 7fea6affd640 1 -- 172.21.15.5:0/3972303624 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 7061+0+0 (secure 0 0 0) 0x7fea5c084920 con 0x7fea740cc970 2023-07-14T13:05:34.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.575+0000 7fea7259c640 1 --2- 172.21.15.5:0/3972303624 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fea540664b0 0x7fea54068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:34.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.575+0000 7fea7259c640 1 --2- 172.21.15.5:0/3972303624 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fea540664b0 0x7fea54068960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fea64005890 tx=0x7fea64009040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:34.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.579+0000 7fea6affd640 1 -- 172.21.15.5:0/3972303624 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fea5c051610 con 0x7fea740cc970 2023-07-14T13:05:34.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.767+0000 7fea7359e640 1 -- 172.21.15.5:0/3972303624 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fea74158bd0 con 0x7fea540664b0 2023-07-14T13:05:34.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.903+0000 7fea6affd640 1 -- 172.21.15.5:0/3972303624 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fea64001ce0 con 0x7fea540664b0 2023-07-14T13:05:34.934 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule removed for path /snap_test_dir1/dir5 2023-07-14T13:05:34.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.907+0000 7fea7359e640 1 -- 172.21.15.5:0/3972303624 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fea540664b0 msgr2=0x7fea54068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:34.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.907+0000 7fea7359e640 1 --2- 172.21.15.5:0/3972303624 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fea540664b0 0x7fea54068960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fea64005890 tx=0x7fea64009040 comp rx=0 tx=0).stop 2023-07-14T13:05:34.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.907+0000 7fea7359e640 1 -- 172.21.15.5:0/3972303624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea740cc970 msgr2=0x7fea740c1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:34.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.907+0000 7fea7359e640 1 --2- 172.21.15.5:0/3972303624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea740cc970 0x7fea740c1d20 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00c7f0 tx=0x7fea5c00ccb0 comp rx=0 tx=0).stop 2023-07-14T13:05:34.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.907+0000 7fea7359e640 1 -- 172.21.15.5:0/3972303624 shutdown_connections 2023-07-14T13:05:34.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.907+0000 7fea7359e640 1 --2- 172.21.15.5:0/3972303624 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fea540664b0 0x7fea54068960 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:34.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.907+0000 7fea7359e640 1 --2- 172.21.15.5:0/3972303624 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea7415cbb0 0x7fea7415af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:34.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.907+0000 7fea7359e640 1 --2- 172.21.15.5:0/3972303624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea740cc970 0x7fea740c1d20 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:34.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.907+0000 7fea7359e640 1 --2- 172.21.15.5:0/3972303624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea7406c160 0x7fea7414fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:34.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.907+0000 7fea7359e640 1 -- 172.21.15.5:0/3972303624 >> 172.21.15.5:0/3972303624 conn(0x7fea740ca800 msgr2=0x7fea740c8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:34.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.907+0000 7fea7359e640 1 -- 172.21.15.5:0/3972303624 shutdown_connections 2023-07-14T13:05:34.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:34.907+0000 7fea7359e640 1 -- 172.21.15.5:0/3972303624 wait complete. 2023-07-14T13:05:34.954 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir5 2023-07-14T13:05:34.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:34.955 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-07-14T13:05:34.965 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_55_00_UTC 2023-07-14T13:05:34.965 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:34.965 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:34.966 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:34.966 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:34.966 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:34.966 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_01_01_UTC 2023-07-14T13:05:34.966 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:34.966 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_03_00_UTC 2023-07-14T13:05:34.967 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:34.967 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:34.968 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-14-12_55_00_UTC 2023-07-14T13:05:34.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:34.969 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-14-12_55_00_UTC) 2023-07-14T13:05:35.026 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:35.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:35.027 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-14-12_56_00_UTC) 2023-07-14T13:05:35.081 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:35.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:35.082 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-14-12_57_00_UTC) 2023-07-14T13:05:35.138 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:35.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:35.140 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-14-12_58_00_UTC) 2023-07-14T13:05:35.198 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:35.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:35.199 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-14-12_59_00_UTC) 2023-07-14T13:05:35.254 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:35.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:35.254 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-14-13_00_00_UTC) 2023-07-14T13:05:35.315 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-14-13_01_01_UTC 2023-07-14T13:05:35.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:35.315 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-14-13_01_01_UTC) 2023-07-14T13:05:35.375 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:35.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:35.376 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-14-13_02_00_UTC) 2023-07-14T13:05:35.438 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-14-13_03_00_UTC 2023-07-14T13:05:35.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:35.439 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-14-13_03_00_UTC) 2023-07-14T13:05:35.494 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:35.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:35.494 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-14-13_04_00_UTC) 2023-07-14T13:05:35.553 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:35.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:35.554 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-14-13_05_00_UTC) 2023-07-14T13:05:35.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:35.610 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5) 2023-07-14T13:05:35.667 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir6 1M 2023-07-14T13:05:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.839+0000 7fd642596640 1 Processor -- start 2023-07-14T13:05:35.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.839+0000 7fd642596640 1 -- start start 2023-07-14T13:05:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.843+0000 7fd642596640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd63c0aeb40 0x7fd63c15cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.843+0000 7fd642596640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd63c0aef10 0x7fd63c158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.843+0000 7fd642596640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd63c159270 0x7fd63c0c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.843+0000 7fd642596640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63c1532b0 con 0x7fd63c0aeb40 2023-07-14T13:05:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.843+0000 7fd642596640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63c0ca6f0 con 0x7fd63c0aef10 2023-07-14T13:05:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.843+0000 7fd642596640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c1599d0 con 0x7fd63c159270 2023-07-14T13:05:35.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.843+0000 7fd63bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd63c0aeb40 0x7fd63c15cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:35.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.843+0000 7fd63bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd63c0aeb40 0x7fd63c15cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41392/0 (socket says 172.21.15.5:41392) 2023-07-14T13:05:35.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.843+0000 7fd63bfff640 1 -- 172.21.15.5:0/3874630576 learned_addr learned my addr 172.21.15.5:0/3874630576 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:35.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.843+0000 7fd640b33640 1 --2- 172.21.15.5:0/3874630576 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd63c159270 0x7fd63c0c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:35.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.843+0000 7fd63b7fe640 1 --2- 172.21.15.5:0/3874630576 >> v2:172.21.15.154:3300/0 conn(0x7fd63c0aef10 0x7fd63c158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:35.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.843+0000 7fd63bfff640 1 -- 172.21.15.5:0/3874630576 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd63c159270 msgr2=0x7fd63c0c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:35.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.843+0000 7fd63bfff640 1 --2- 172.21.15.5:0/3874630576 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd63c159270 0x7fd63c0c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:35.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.843+0000 7fd63bfff640 1 -- 172.21.15.5:0/3874630576 >> v2:172.21.15.154:3300/0 conn(0x7fd63c0aef10 msgr2=0x7fd63c158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:35.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.843+0000 7fd63bfff640 1 --2- 172.21.15.5:0/3874630576 >> v2:172.21.15.154:3300/0 conn(0x7fd63c0aef10 0x7fd63c158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:35.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.843+0000 7fd63bfff640 1 -- 172.21.15.5:0/3874630576 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63c159cb0 con 0x7fd63c0aeb40 2023-07-14T13:05:35.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.847+0000 7fd63bfff640 1 --2- 172.21.15.5:0/3874630576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd63c0aeb40 0x7fd63c15cef0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd63c0cee90 tx=0x7fd62c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc18630c19e5af0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:35.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.847+0000 7fd63affd640 1 -- 172.21.15.5:0/3874630576 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c0ab600 con 0x7fd63c0aeb40 2023-07-14T13:05:35.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.847+0000 7fd63affd640 1 -- 172.21.15.5:0/3874630576 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62c0ab760 con 0x7fd63c0aeb40 2023-07-14T13:05:35.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.847+0000 7fd63affd640 1 -- 172.21.15.5:0/3874630576 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c0abaf0 con 0x7fd63c0aeb40 2023-07-14T13:05:35.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.847+0000 7fd642596640 1 -- 172.21.15.5:0/3874630576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd63c0aeb40 msgr2=0x7fd63c15cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:35.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.847+0000 7fd642596640 1 --2- 172.21.15.5:0/3874630576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd63c0aeb40 0x7fd63c15cef0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd63c0cee90 tx=0x7fd62c01c440 comp rx=0 tx=0).stop 2023-07-14T13:05:35.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.847+0000 7fd642596640 1 -- 172.21.15.5:0/3874630576 shutdown_connections 2023-07-14T13:05:35.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.847+0000 7fd642596640 1 --2- 172.21.15.5:0/3874630576 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd63c159270 0x7fd63c0c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:35.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.847+0000 7fd642596640 1 --2- 172.21.15.5:0/3874630576 >> v2:172.21.15.154:3300/0 conn(0x7fd63c0aef10 0x7fd63c158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:35.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.847+0000 7fd642596640 1 --2- 172.21.15.5:0/3874630576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd63c0aeb40 0x7fd63c15cef0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:35.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.847+0000 7fd642596640 1 -- 172.21.15.5:0/3874630576 >> 172.21.15.5:0/3874630576 conn(0x7fd63c0cde90 msgr2=0x7fd63c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:35.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.847+0000 7fd642596640 1 -- 172.21.15.5:0/3874630576 shutdown_connections 2023-07-14T13:05:35.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.847+0000 7fd642596640 1 -- 172.21.15.5:0/3874630576 wait complete. 2023-07-14T13:05:35.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.847+0000 7fd642596640 1 Processor -- start 2023-07-14T13:05:35.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.847+0000 7fd642596640 1 -- start start 2023-07-14T13:05:35.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.851+0000 7fd642596640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd63c0aeb40 0x7fd63c0b3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:35.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.851+0000 7fd642596640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd63c0aef10 0x7fd63c14e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:35.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.851+0000 7fd642596640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd63c159270 0x7fd63c14ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:35.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.851+0000 7fd642596640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c150060 con 0x7fd63c159270 2023-07-14T13:05:35.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.851+0000 7fd642596640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c0b0dc0 con 0x7fd63c0aeb40 2023-07-14T13:05:35.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.851+0000 7fd642596640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c14fd80 con 0x7fd63c0aef10 2023-07-14T13:05:35.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.851+0000 7fd640b33640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd63c159270 0x7fd63c14ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:35.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.851+0000 7fd63b7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd63c0aef10 0x7fd63c14e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:35.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.851+0000 7fd640b33640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd63c159270 0x7fd63c14ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41404/0 (socket says 172.21.15.5:41404) 2023-07-14T13:05:35.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.851+0000 7fd640b33640 1 -- 172.21.15.5:0/1450672502 learned_addr learned my addr 172.21.15.5:0/1450672502 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:35.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.851+0000 7fd63bfff640 1 --2- 172.21.15.5:0/1450672502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd63c0aeb40 0x7fd63c0b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:35.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.851+0000 7fd640b33640 1 -- 172.21.15.5:0/1450672502 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd63c0aef10 msgr2=0x7fd63c14e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:35.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.851+0000 7fd640b33640 1 --2- 172.21.15.5:0/1450672502 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd63c0aef10 0x7fd63c14e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:35.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.851+0000 7fd640b33640 1 -- 172.21.15.5:0/1450672502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd63c0aeb40 msgr2=0x7fd63c0b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:35.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.851+0000 7fd640b33640 1 --2- 172.21.15.5:0/1450672502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd63c0aeb40 0x7fd63c0b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:35.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.851+0000 7fd640b33640 1 -- 172.21.15.5:0/1450672502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62c0094d0 con 0x7fd63c159270 2023-07-14T13:05:35.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.851+0000 7fd640b33640 1 --2- 172.21.15.5:0/1450672502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd63c159270 0x7fd63c14ee20 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd634007e60 tx=0x7fd63400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:35.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.851+0000 7fd638ff9640 1 -- 172.21.15.5:0/1450672502 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd634014420 con 0x7fd63c159270 2023-07-14T13:05:35.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.851+0000 7fd638ff9640 1 -- 172.21.15.5:0/1450672502 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6340145a0 con 0x7fd63c159270 2023-07-14T13:05:35.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.851+0000 7fd638ff9640 1 -- 172.21.15.5:0/1450672502 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd634014950 con 0x7fd63c159270 2023-07-14T13:05:35.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.851+0000 7fd642596640 1 -- 172.21.15.5:0/1450672502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd63c06ba60 con 0x7fd63c159270 2023-07-14T13:05:35.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.851+0000 7fd642596640 1 -- 172.21.15.5:0/1450672502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd63c06c020 con 0x7fd63c159270 2023-07-14T13:05:35.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.851+0000 7fd642596640 1 -- 172.21.15.5:0/1450672502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd63c06b8c0 con 0x7fd63c159270 2023-07-14T13:05:35.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.851+0000 7fd638ff9640 1 -- 172.21.15.5:0/1450672502 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fd634014ab0 con 0x7fd63c159270 2023-07-14T13:05:35.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.855+0000 7fd638ff9640 1 --2- 172.21.15.5:0/1450672502 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fd628066480 0x7fd628068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:35.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.855+0000 7fd638ff9640 1 -- 172.21.15.5:0/1450672502 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 7409+0+0 (secure 0 0 0) 0x7fd634084d70 con 0x7fd63c159270 2023-07-14T13:05:35.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.855+0000 7fd63bfff640 1 --2- 172.21.15.5:0/1450672502 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fd628066480 0x7fd628068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:35.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.855+0000 7fd63bfff640 1 --2- 172.21.15.5:0/1450672502 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fd628066480 0x7fd628068930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0af000 tx=0x7fd62c0b6040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:35.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:35.859+0000 7fd638ff9640 1 -- 172.21.15.5:0/1450672502 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd63c06b8c0 con 0x7fd63c159270 2023-07-14T13:05:36.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:36.059+0000 7fd642596640 1 -- 172.21.15.5:0/1450672502 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd63c159670 con 0x7fd628066480 2023-07-14T13:05:36.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:36.187+0000 7fd638ff9640 1 -- 172.21.15.5:0/1450672502 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fd62c0ab8d0 con 0x7fd628066480 2023-07-14T13:05:36.218 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule removed for path /snap_test_dir1/dir6 2023-07-14T13:05:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:36.191+0000 7fd642596640 1 -- 172.21.15.5:0/1450672502 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fd628066480 msgr2=0x7fd628068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:36.191+0000 7fd642596640 1 --2- 172.21.15.5:0/1450672502 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fd628066480 0x7fd628068930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0af000 tx=0x7fd62c0b6040 comp rx=0 tx=0).stop 2023-07-14T13:05:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:36.191+0000 7fd642596640 1 -- 172.21.15.5:0/1450672502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd63c159270 msgr2=0x7fd63c14ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:36.191+0000 7fd642596640 1 --2- 172.21.15.5:0/1450672502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd63c159270 0x7fd63c14ee20 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd634007e60 tx=0x7fd63400e4b0 comp rx=0 tx=0).stop 2023-07-14T13:05:36.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:36.191+0000 7fd642596640 1 -- 172.21.15.5:0/1450672502 shutdown_connections 2023-07-14T13:05:36.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:36.191+0000 7fd642596640 1 --2- 172.21.15.5:0/1450672502 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fd628066480 0x7fd628068930 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:36.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:36.191+0000 7fd642596640 1 --2- 172.21.15.5:0/1450672502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd63c159270 0x7fd63c14ee20 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:36.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:36.191+0000 7fd642596640 1 --2- 172.21.15.5:0/1450672502 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd63c0aef10 0x7fd63c14e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:36.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:36.191+0000 7fd642596640 1 --2- 172.21.15.5:0/1450672502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd63c0aeb40 0x7fd63c0b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:36.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:36.191+0000 7fd642596640 1 -- 172.21.15.5:0/1450672502 >> 172.21.15.5:0/1450672502 conn(0x7fd63c0cde90 msgr2=0x7fd63c0cb320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:36.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:36.195+0000 7fd642596640 1 -- 172.21.15.5:0/1450672502 shutdown_connections 2023-07-14T13:05:36.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:36.195+0000 7fd642596640 1 -- 172.21.15.5:0/1450672502 wait complete. 2023-07-14T13:05:36.258 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir6 2023-07-14T13:05:36.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:36.258 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-07-14T13:05:36.273 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_55_00_UTC 2023-07-14T13:05:36.273 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:36.273 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:36.274 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:36.274 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:36.274 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:36.274 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_01_01_UTC 2023-07-14T13:05:36.274 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:36.274 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_03_01_UTC 2023-07-14T13:05:36.274 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:36.274 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:36.275 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-14-12_55_00_UTC 2023-07-14T13:05:36.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:36.276 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-14-12_55_00_UTC) 2023-07-14T13:05:36.339 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:36.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:36.340 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-14-12_56_00_UTC) 2023-07-14T13:05:36.398 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:36.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:36.399 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-14-12_57_00_UTC) 2023-07-14T13:05:36.458 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:36.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:36.459 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-14-12_58_00_UTC) 2023-07-14T13:05:36.513 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:36.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:36.514 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-14-12_59_00_UTC) 2023-07-14T13:05:36.569 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:36.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:36.570 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-14-13_00_00_UTC) 2023-07-14T13:05:36.626 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-14-13_01_01_UTC 2023-07-14T13:05:36.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:36.626 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-14-13_01_01_UTC) 2023-07-14T13:05:36.745 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:36.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:36.746 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-14-13_02_00_UTC) 2023-07-14T13:05:36.786 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-14-13_03_01_UTC 2023-07-14T13:05:36.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:36.787 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-14-13_03_01_UTC) 2023-07-14T13:05:36.842 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:36.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:36.843 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-14-13_04_00_UTC) 2023-07-14T13:05:36.897 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:36.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:36.898 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-14-13_05_00_UTC) 2023-07-14T13:05:36.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:36.958 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6) 2023-07-14T13:05:37.010 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir7 1M 2023-07-14T13:05:37.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.170+0000 7fdccf096640 1 Processor -- start 2023-07-14T13:05:37.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.170+0000 7fdccf096640 1 -- start start 2023-07-14T13:05:37.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.170+0000 7fdccf096640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdcc815f690 0x7fdcc80b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:37.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.170+0000 7fdccf096640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc806c040 con 0x7fdcc806a440 2023-07-14T13:05:37.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.170+0000 7fdccf096640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc8160600 con 0x7fdcc81453a0 2023-07-14T13:05:37.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.170+0000 7fdccf096640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc8160170 con 0x7fdcc815f690 2023-07-14T13:05:37.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.170+0000 7fdccd633640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdcc806a440 0x7fdcc806c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33792/0 (socket says 172.21.15.5:33792) 2023-07-14T13:05:37.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.170+0000 7fdccd633640 1 -- 172.21.15.5:0/485516302 learned_addr learned my addr 172.21.15.5:0/485516302 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:37.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.170+0000 7fdccce32640 1 --2- 172.21.15.5:0/485516302 >> v2:172.21.15.154:3300/0 conn(0x7fdcc815f690 0x7fdcc80b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:37.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.170+0000 7fdcc77fe640 1 -- 172.21.15.5:0/485516302 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1282239298 0 0) 0x7fdcc806c040 con 0x7fdcc806a440 2023-07-14T13:05:37.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.170+0000 7fdcc77fe640 1 -- 172.21.15.5:0/485516302 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcb8003530 con 0x7fdcc806a440 2023-07-14T13:05:37.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.170+0000 7fdcc77fe640 1 -- 172.21.15.5:0/485516302 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717897878 0 0) 0x7fdcc8160600 con 0x7fdcc81453a0 2023-07-14T13:05:37.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.170+0000 7fdcc77fe640 1 -- 172.21.15.5:0/485516302 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcc806c040 con 0x7fdcc81453a0 2023-07-14T13:05:37.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.170+0000 7fdccce32640 1 -- 172.21.15.5:0/485516302 >> v1:172.21.15.154:6789/0 conn(0x7fdcc81453a0 legacy=0x7fdcc815fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:37.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.170+0000 7fdccce32640 1 -- 172.21.15.5:0/485516302 >> v1:172.21.15.5:6789/0 conn(0x7fdcc806a440 legacy=0x7fdcc806c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:37.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.170+0000 7fdcc77fe640 1 -- 172.21.15.5:0/485516302 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2941395810 0 0) 0x7fdcb8003530 con 0x7fdcc806a440 2023-07-14T13:05:37.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.170+0000 7fdccce32640 1 -- 172.21.15.5:0/485516302 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc8160360 con 0x7fdcc815f690 2023-07-14T13:05:37.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.174+0000 7fdccce32640 1 --2- 172.21.15.5:0/485516302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcc815f690 0x7fdcc80b1890 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0097c0 tx=0x7fdcbc01c250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e64d473a1dd88d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:37.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.174+0000 7fdcc77fe640 1 -- 172.21.15.5:0/485516302 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0001a00 con 0x7fdcc815f690 2023-07-14T13:05:37.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.174+0000 7fdcc77fe640 1 -- 172.21.15.5:0/485516302 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc0a7050 con 0x7fdcc815f690 2023-07-14T13:05:37.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.174+0000 7fdcc77fe640 1 -- 172.21.15.5:0/485516302 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc0ab620 con 0x7fdcc815f690 2023-07-14T13:05:37.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.174+0000 7fdccf096640 1 -- 172.21.15.5:0/485516302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcc815f690 msgr2=0x7fdcc80b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:37.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.174+0000 7fdccf096640 1 --2- 172.21.15.5:0/485516302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcc815f690 0x7fdcc80b1890 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0097c0 tx=0x7fdcbc01c250 comp rx=0 tx=0).stop 2023-07-14T13:05:37.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.174+0000 7fdccf096640 1 -- 172.21.15.5:0/485516302 shutdown_connections 2023-07-14T13:05:37.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.174+0000 7fdccf096640 1 --2- 172.21.15.5:0/485516302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcc815f690 0x7fdcc80b1890 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:37.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.174+0000 7fdccf096640 1 -- 172.21.15.5:0/485516302 >> 172.21.15.5:0/485516302 conn(0x7fdcc80b1210 msgr2=0x7fdcc80ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:37.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.174+0000 7fdccf096640 1 -- 172.21.15.5:0/485516302 shutdown_connections 2023-07-14T13:05:37.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.174+0000 7fdccf096640 1 -- 172.21.15.5:0/485516302 wait complete. 2023-07-14T13:05:37.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.178+0000 7fdccf096640 1 Processor -- start 2023-07-14T13:05:37.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.178+0000 7fdccf096640 1 -- start start 2023-07-14T13:05:37.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.178+0000 7fdccf096640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcc806a440 0x7fdcc8140f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:37.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.178+0000 7fdccf096640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcc81453a0 0x7fdcc813ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:37.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.178+0000 7fdccf096640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdcc815f690 0x7fdcc815abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:37.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.178+0000 7fdccf096640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc815c580 con 0x7fdcc81453a0 2023-07-14T13:05:37.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.178+0000 7fdccf096640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc813b690 con 0x7fdcc806a440 2023-07-14T13:05:37.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.178+0000 7fdccf096640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc813b970 con 0x7fdcc815f690 2023-07-14T13:05:37.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.178+0000 7fdcc7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcc81453a0 0x7fdcc813ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:37.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.178+0000 7fdcc7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcc81453a0 0x7fdcc813ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41410/0 (socket says 172.21.15.5:41410) 2023-07-14T13:05:37.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.178+0000 7fdcc7fff640 1 -- 172.21.15.5:0/6878726 learned_addr learned my addr 172.21.15.5:0/6878726 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:37.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.178+0000 7fdccce32640 1 --2- 172.21.15.5:0/6878726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcc806a440 0x7fdcc8140f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:37.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.178+0000 7fdccd633640 1 --2- 172.21.15.5:0/6878726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdcc815f690 0x7fdcc815abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:37.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.178+0000 7fdcc7fff640 1 -- 172.21.15.5:0/6878726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdcc815f690 msgr2=0x7fdcc815abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:37.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.178+0000 7fdcc7fff640 1 --2- 172.21.15.5:0/6878726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdcc815f690 0x7fdcc815abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:37.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.178+0000 7fdcc7fff640 1 -- 172.21.15.5:0/6878726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcc806a440 msgr2=0x7fdcc8140f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:37.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.178+0000 7fdcc7fff640 1 --2- 172.21.15.5:0/6878726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcc806a440 0x7fdcc8140f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:37.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.178+0000 7fdcc7fff640 1 -- 172.21.15.5:0/6878726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcbc009420 con 0x7fdcc81453a0 2023-07-14T13:05:37.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.178+0000 7fdccce32640 1 --2- 172.21.15.5:0/6878726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcc806a440 0x7fdcc8140f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:05:37.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.178+0000 7fdcc7fff640 1 --2- 172.21.15.5:0/6878726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcc81453a0 0x7fdcc813ac10 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400c430 tx=0x7fdcb400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:37.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.178+0000 7fdcc57fa640 1 -- 172.21.15.5:0/6878726 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb40052d0 con 0x7fdcc81453a0 2023-07-14T13:05:37.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.178+0000 7fdcc57fa640 1 -- 172.21.15.5:0/6878726 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb4005450 con 0x7fdcc81453a0 2023-07-14T13:05:37.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.178+0000 7fdccf096640 1 -- 172.21.15.5:0/6878726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc815c7d0 con 0x7fdcc81453a0 2023-07-14T13:05:37.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.178+0000 7fdcc57fa640 1 -- 172.21.15.5:0/6878726 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4003840 con 0x7fdcc81453a0 2023-07-14T13:05:37.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.178+0000 7fdccf096640 1 -- 172.21.15.5:0/6878726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc815b980 con 0x7fdcc81453a0 2023-07-14T13:05:37.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.178+0000 7fdccf096640 1 -- 172.21.15.5:0/6878726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc80678d0 con 0x7fdcc81453a0 2023-07-14T13:05:37.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.182+0000 7fdcc57fa640 1 -- 172.21.15.5:0/6878726 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fdcb40039a0 con 0x7fdcc81453a0 2023-07-14T13:05:37.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.182+0000 7fdcc57fa640 1 --2- 172.21.15.5:0/6878726 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fdcac066480 0x7fdcac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:37.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.182+0000 7fdcc57fa640 1 -- 172.21.15.5:0/6878726 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7237+0+0 (secure 0 0 0) 0x7fdcb4083c10 con 0x7fdcc81453a0 2023-07-14T13:05:37.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.182+0000 7fdccce32640 1 --2- 172.21.15.5:0/6878726 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fdcac066480 0x7fdcac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:37.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.182+0000 7fdccce32640 1 --2- 172.21.15.5:0/6878726 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fdcac066480 0x7fdcac068930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0ad000 tx=0x7fdcbc008040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:37.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.186+0000 7fdcc57fa640 1 -- 172.21.15.5:0/6878726 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fdcb40508e0 con 0x7fdcc81453a0 2023-07-14T13:05:37.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.358+0000 7fdccf096640 1 -- 172.21.15.5:0/6878726 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fdcc806ad80 con 0x7fdcac066480 2023-07-14T13:05:37.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.434+0000 7fdcc57fa640 1 -- 172.21.15.5:0/6878726 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fdcbc0ab6e0 con 0x7fdcac066480 2023-07-14T13:05:37.464 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule removed for path /snap_test_dir1/dir7 2023-07-14T13:05:37.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.434+0000 7fdccf096640 1 -- 172.21.15.5:0/6878726 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fdcac066480 msgr2=0x7fdcac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:37.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.434+0000 7fdccf096640 1 --2- 172.21.15.5:0/6878726 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fdcac066480 0x7fdcac068930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0ad000 tx=0x7fdcbc008040 comp rx=0 tx=0).stop 2023-07-14T13:05:37.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.434+0000 7fdccf096640 1 -- 172.21.15.5:0/6878726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcc81453a0 msgr2=0x7fdcc813ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:37.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.434+0000 7fdccf096640 1 --2- 172.21.15.5:0/6878726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcc81453a0 0x7fdcc813ac10 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400c430 tx=0x7fdcb400c8f0 comp rx=0 tx=0).stop 2023-07-14T13:05:37.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.434+0000 7fdccf096640 1 -- 172.21.15.5:0/6878726 shutdown_connections 2023-07-14T13:05:37.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.434+0000 7fdccf096640 1 --2- 172.21.15.5:0/6878726 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fdcac066480 0x7fdcac068930 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:37.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.434+0000 7fdccf096640 1 --2- 172.21.15.5:0/6878726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdcc815f690 0x7fdcc815abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:37.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.434+0000 7fdccf096640 1 --2- 172.21.15.5:0/6878726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdcc81453a0 0x7fdcc813ac10 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:37.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.434+0000 7fdccf096640 1 --2- 172.21.15.5:0/6878726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcc806a440 0x7fdcc8140f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:37.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.434+0000 7fdccf096640 1 -- 172.21.15.5:0/6878726 >> 172.21.15.5:0/6878726 conn(0x7fdcc80b1210 msgr2=0x7fdcc80b3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:37.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.434+0000 7fdccf096640 1 -- 172.21.15.5:0/6878726 shutdown_connections 2023-07-14T13:05:37.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:37.434+0000 7fdccf096640 1 -- 172.21.15.5:0/6878726 wait complete. 2023-07-14T13:05:37.485 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir7 2023-07-14T13:05:37.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:37.485 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-07-14T13:05:37.496 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_55_00_UTC 2023-07-14T13:05:37.496 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:37.496 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:37.496 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:37.497 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:37.497 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:37.497 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_01_01_UTC 2023-07-14T13:05:37.497 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:37.497 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_03_00_UTC 2023-07-14T13:05:37.498 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:37.498 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:37.499 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-14-12_55_00_UTC 2023-07-14T13:05:37.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:37.501 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-14-12_55_00_UTC) 2023-07-14T13:05:37.562 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:37.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:37.563 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-14-12_56_00_UTC) 2023-07-14T13:05:37.618 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:37.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:37.619 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-14-12_57_00_UTC) 2023-07-14T13:05:37.705 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:37.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:37.705 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-14-12_58_00_UTC) 2023-07-14T13:05:37.765 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:37.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:37.767 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-14-12_59_00_UTC) 2023-07-14T13:05:37.821 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:37.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:37.822 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-14-13_00_00_UTC) 2023-07-14T13:05:37.877 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-14-13_01_01_UTC 2023-07-14T13:05:37.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:37.878 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-14-13_01_01_UTC) 2023-07-14T13:05:37.934 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:37.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:37.935 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-14-13_02_00_UTC) 2023-07-14T13:05:37.990 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-14-13_03_00_UTC 2023-07-14T13:05:37.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:37.991 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-14-13_03_00_UTC) 2023-07-14T13:05:38.045 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:38.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:38.046 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-14-13_04_00_UTC) 2023-07-14T13:05:38.102 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:38.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:38.103 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-14-13_05_00_UTC) 2023-07-14T13:05:38.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:38.159 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7) 2023-07-14T13:05:38.218 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir8 1M 2023-07-14T13:05:38.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.386+0000 7f00e59db640 1 Processor -- start 2023-07-14T13:05:38.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.386+0000 7f00e59db640 1 -- start start 2023-07-14T13:05:38.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.386+0000 7f00e59db640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f00e015bde0 0x7f00e00d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:38.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.386+0000 7f00e59db640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f00e00d2300 0x7f00e00d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:38.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.386+0000 7f00e59db640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e00b04c0 con 0x7f00e00d2fc0 2023-07-14T13:05:38.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.386+0000 7f00e59db640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e015c1b0 con 0x7f00e00d2300 2023-07-14T13:05:38.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.386+0000 7f00e59db640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e00b1060 con 0x7f00e015bde0 2023-07-14T13:05:38.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.386+0000 7f00d7fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f00e00d2fc0 0x7f00e00b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33804/0 (socket says 172.21.15.5:33804) 2023-07-14T13:05:38.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.386+0000 7f00d7fff640 1 -- 172.21.15.5:0/3331792318 learned_addr learned my addr 172.21.15.5:0/3331792318 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:38.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.386+0000 7f00df7fe640 1 --2- 172.21.15.5:0/3331792318 >> v2:172.21.15.5:3300/0 conn(0x7f00e00d2300 0x7f00e00d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:38.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.386+0000 7f00deffd640 1 --2- 172.21.15.5:0/3331792318 >> v2:172.21.15.154:3300/0 conn(0x7f00e015bde0 0x7f00e00d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:38.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.386+0000 7f00df7fe640 1 -- 172.21.15.5:0/3331792318 >> v2:172.21.15.154:3300/0 conn(0x7f00e015bde0 msgr2=0x7f00e00d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:38.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.386+0000 7f00df7fe640 1 --2- 172.21.15.5:0/3331792318 >> v2:172.21.15.154:3300/0 conn(0x7f00e015bde0 0x7f00e00d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:38.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.386+0000 7f00df7fe640 1 -- 172.21.15.5:0/3331792318 >> v1:172.21.15.5:6789/0 conn(0x7f00e00d2fc0 legacy=0x7f00e00b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:38.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.386+0000 7f00df7fe640 1 -- 172.21.15.5:0/3331792318 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e00d2c80 con 0x7f00e00d2300 2023-07-14T13:05:38.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.386+0000 7f00deffd640 1 --2- 172.21.15.5:0/3331792318 >> v2:172.21.15.154:3300/0 conn(0x7f00e015bde0 0x7f00e00d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:05:38.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.386+0000 7f00de7fc640 1 -- 172.21.15.5:0/3331792318 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1723568446 0 0) 0x7f00e00b04c0 con 0x7f00e00d2fc0 2023-07-14T13:05:38.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.390+0000 7f00df7fe640 1 --2- 172.21.15.5:0/3331792318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00e00d2300 0x7f00e00d2740 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f00e008b210 tx=0x7f00d801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b69cb16cf818d903 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:38.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.390+0000 7f00de7fc640 1 -- 172.21.15.5:0/3331792318 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d80a58e0 con 0x7f00e00d2300 2023-07-14T13:05:38.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.390+0000 7f00de7fc640 1 -- 172.21.15.5:0/3331792318 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d80a5a40 con 0x7f00e00d2300 2023-07-14T13:05:38.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.390+0000 7f00de7fc640 1 -- 172.21.15.5:0/3331792318 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d80a5dd0 con 0x7f00e00d2300 2023-07-14T13:05:38.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.390+0000 7f00e59db640 1 -- 172.21.15.5:0/3331792318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00e00d2300 msgr2=0x7f00e00d2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:38.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.390+0000 7f00e59db640 1 --2- 172.21.15.5:0/3331792318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00e00d2300 0x7f00e00d2740 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f00e008b210 tx=0x7f00d801c910 comp rx=0 tx=0).stop 2023-07-14T13:05:38.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.390+0000 7f00e59db640 1 -- 172.21.15.5:0/3331792318 shutdown_connections 2023-07-14T13:05:38.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.390+0000 7f00e59db640 1 --2- 172.21.15.5:0/3331792318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00e00d2300 0x7f00e00d2740 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:38.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.390+0000 7f00e59db640 1 --2- 172.21.15.5:0/3331792318 >> v2:172.21.15.154:3300/0 conn(0x7f00e015bde0 0x7f00e00d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:38.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.390+0000 7f00e59db640 1 -- 172.21.15.5:0/3331792318 >> 172.21.15.5:0/3331792318 conn(0x7f00e00659d0 msgr2=0x7f00e009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:38.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.390+0000 7f00e59db640 1 -- 172.21.15.5:0/3331792318 shutdown_connections 2023-07-14T13:05:38.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.390+0000 7f00e59db640 1 -- 172.21.15.5:0/3331792318 wait complete. 2023-07-14T13:05:38.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.394+0000 7f00e59db640 1 Processor -- start 2023-07-14T13:05:38.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.394+0000 7f00e59db640 1 -- start start 2023-07-14T13:05:38.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.394+0000 7f00e59db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00e00d2300 0x7f00e014f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:38.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.394+0000 7f00e59db640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00e00d2fc0 0x7f00e00b6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:38.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.394+0000 7f00e59db640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00e015bde0 0x7f00e00b7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:38.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.394+0000 7f00e59db640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e0151420 con 0x7f00e00d2300 2023-07-14T13:05:38.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.394+0000 7f00e59db640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e00cf560 con 0x7f00e015bde0 2023-07-14T13:05:38.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.394+0000 7f00e59db640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e0150f90 con 0x7f00e00d2fc0 2023-07-14T13:05:38.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.394+0000 7f00deffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00e00d2300 0x7f00e014f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:38.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.394+0000 7f00deffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00e00d2300 0x7f00e014f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41434/0 (socket says 172.21.15.5:41434) 2023-07-14T13:05:38.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.394+0000 7f00deffd640 1 -- 172.21.15.5:0/3950599943 learned_addr learned my addr 172.21.15.5:0/3950599943 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:38.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.394+0000 7f00df7fe640 1 --2- 172.21.15.5:0/3950599943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00e015bde0 0x7f00e00b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:38.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.394+0000 7f00d7fff640 1 --2- 172.21.15.5:0/3950599943 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00e00d2fc0 0x7f00e00b6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:38.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.394+0000 7f00deffd640 1 -- 172.21.15.5:0/3950599943 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00e00d2fc0 msgr2=0x7f00e00b6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:38.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.394+0000 7f00deffd640 1 --2- 172.21.15.5:0/3950599943 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00e00d2fc0 0x7f00e00b6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:38.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.394+0000 7f00deffd640 1 -- 172.21.15.5:0/3950599943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00e015bde0 msgr2=0x7f00e00b7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:38.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.394+0000 7f00deffd640 1 --2- 172.21.15.5:0/3950599943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00e015bde0 0x7f00e00b7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:38.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.394+0000 7f00deffd640 1 -- 172.21.15.5:0/3950599943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d8009a70 con 0x7f00e00d2300 2023-07-14T13:05:38.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.394+0000 7f00deffd640 1 --2- 172.21.15.5:0/3950599943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00e00d2300 0x7f00e014f960 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f00d000c820 tx=0x7f00d000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:38.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.394+0000 7f00dcff9640 1 -- 172.21.15.5:0/3950599943 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d0005ba0 con 0x7f00e00d2300 2023-07-14T13:05:38.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.394+0000 7f00dcff9640 1 -- 172.21.15.5:0/3950599943 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d0005d00 con 0x7f00e00d2300 2023-07-14T13:05:38.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.394+0000 7f00dcff9640 1 -- 172.21.15.5:0/3950599943 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d0007a50 con 0x7f00e00d2300 2023-07-14T13:05:38.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.394+0000 7f00e59db640 1 -- 172.21.15.5:0/3950599943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e014fea0 con 0x7f00e00d2300 2023-07-14T13:05:38.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.398+0000 7f00e59db640 1 -- 172.21.15.5:0/3950599943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e0150c20 con 0x7f00e00d2300 2023-07-14T13:05:38.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.398+0000 7f00e59db640 1 -- 172.21.15.5:0/3950599943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e00cf9f0 con 0x7f00e00d2300 2023-07-14T13:05:38.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.398+0000 7f00dcff9640 1 -- 172.21.15.5:0/3950599943 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f00d0007bb0 con 0x7f00e00d2300 2023-07-14T13:05:38.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.398+0000 7f00dcff9640 1 --2- 172.21.15.5:0/3950599943 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f00c00664b0 0x7f00c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:38.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.398+0000 7f00dcff9640 1 -- 172.21.15.5:0/3950599943 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f00d0084300 con 0x7f00e00d2300 2023-07-14T13:05:38.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.398+0000 7f00d7fff640 1 --2- 172.21.15.5:0/3950599943 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f00c00664b0 0x7f00c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:38.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.398+0000 7f00d7fff640 1 --2- 172.21.15.5:0/3950599943 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f00c00664b0 0x7f00c0068960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f00e00cf330 tx=0x7f00c8007d60 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:38.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.402+0000 7f00dcff9640 1 -- 172.21.15.5:0/3950599943 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f00d0051140 con 0x7f00e00d2300 2023-07-14T13:05:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.578+0000 7f00e59db640 1 -- 172.21.15.5:0/3950599943 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f00e0150aa0 con 0x7f00c00664b0 2023-07-14T13:05:38.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.654+0000 7f00dcff9640 1 -- 172.21.15.5:0/3950599943 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f00c8004c80 con 0x7f00c00664b0 2023-07-14T13:05:38.686 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule removed for path /snap_test_dir1/dir8 2023-07-14T13:05:38.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.658+0000 7f00e59db640 1 -- 172.21.15.5:0/3950599943 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f00c00664b0 msgr2=0x7f00c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:38.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.658+0000 7f00e59db640 1 --2- 172.21.15.5:0/3950599943 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f00c00664b0 0x7f00c0068960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f00e00cf330 tx=0x7f00c8007d60 comp rx=0 tx=0).stop 2023-07-14T13:05:38.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.658+0000 7f00e59db640 1 -- 172.21.15.5:0/3950599943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00e00d2300 msgr2=0x7f00e014f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:38.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.658+0000 7f00e59db640 1 --2- 172.21.15.5:0/3950599943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00e00d2300 0x7f00e014f960 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f00d000c820 tx=0x7f00d000cce0 comp rx=0 tx=0).stop 2023-07-14T13:05:38.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.658+0000 7f00e59db640 1 -- 172.21.15.5:0/3950599943 shutdown_connections 2023-07-14T13:05:38.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.658+0000 7f00e59db640 1 --2- 172.21.15.5:0/3950599943 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f00c00664b0 0x7f00c0068960 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:38.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.658+0000 7f00e59db640 1 --2- 172.21.15.5:0/3950599943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00e015bde0 0x7f00e00b7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:38.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.658+0000 7f00e59db640 1 --2- 172.21.15.5:0/3950599943 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00e00d2fc0 0x7f00e00b6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:38.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.658+0000 7f00e59db640 1 --2- 172.21.15.5:0/3950599943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00e00d2300 0x7f00e014f960 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:38.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.658+0000 7f00e59db640 1 -- 172.21.15.5:0/3950599943 >> 172.21.15.5:0/3950599943 conn(0x7f00e00659d0 msgr2=0x7f00e015ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:38.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.658+0000 7f00e59db640 1 -- 172.21.15.5:0/3950599943 shutdown_connections 2023-07-14T13:05:38.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:38.658+0000 7f00e59db640 1 -- 172.21.15.5:0/3950599943 wait complete. 2023-07-14T13:05:38.713 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir8 2023-07-14T13:05:38.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:38.714 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-07-14T13:05:38.725 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_55_00_UTC 2023-07-14T13:05:38.725 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:38.726 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:38.726 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:38.726 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:38.726 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:38.726 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_01_01_UTC 2023-07-14T13:05:38.726 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:38.726 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_03_00_UTC 2023-07-14T13:05:38.727 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:38.727 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:38.727 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-14-12_55_00_UTC 2023-07-14T13:05:38.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:38.728 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-14-12_55_00_UTC) 2023-07-14T13:05:38.795 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:38.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:38.797 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-14-12_56_00_UTC) 2023-07-14T13:05:38.854 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:38.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:38.855 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-14-12_57_00_UTC) 2023-07-14T13:05:38.909 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:38.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:38.910 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-14-12_58_00_UTC) 2023-07-14T13:05:38.966 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:38.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:38.967 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-14-12_59_00_UTC) 2023-07-14T13:05:39.022 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:39.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:39.023 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-14-13_00_00_UTC) 2023-07-14T13:05:39.079 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-14-13_01_01_UTC 2023-07-14T13:05:39.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:39.080 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-14-13_01_01_UTC) 2023-07-14T13:05:39.137 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:39.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:39.138 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-14-13_02_00_UTC) 2023-07-14T13:05:39.207 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-14-13_03_00_UTC 2023-07-14T13:05:39.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:39.208 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-14-13_03_00_UTC) 2023-07-14T13:05:39.266 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:39.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:39.267 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-14-13_04_00_UTC) 2023-07-14T13:05:39.327 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:39.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:39.328 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-14-13_05_00_UTC) 2023-07-14T13:05:39.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:39.386 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8) 2023-07-14T13:05:39.439 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir9 1M 2023-07-14T13:05:39.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.606+0000 7fefbf7c5640 1 Processor -- start 2023-07-14T13:05:39.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.606+0000 7fefbf7c5640 1 -- start start 2023-07-14T13:05:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.610+0000 7fefbf7c5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fefb806a540 0x7fefb806a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.610+0000 7fefbf7c5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefb80cf2e0 0x7fefb80cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.610+0000 7fefbf7c5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fefb80cc9c0 0x7fefb80cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.610+0000 7fefbf7c5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb80d0920 con 0x7fefb806a540 2023-07-14T13:05:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.610+0000 7fefbf7c5640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb815bfd0 con 0x7fefb80cc9c0 2023-07-14T13:05:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.610+0000 7fefbf7c5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb806ae50 con 0x7fefb80cf2e0 2023-07-14T13:05:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.610+0000 7fefbd561640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fefb806a540 0x7fefb806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.610+0000 7fefbd561640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fefb806a540 0x7fefb806a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33272/0 (socket says 172.21.15.5:33272) 2023-07-14T13:05:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.610+0000 7fefbd561640 1 -- 172.21.15.5:0/2673939253 learned_addr learned my addr 172.21.15.5:0/2673939253 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.610+0000 7fefbdd62640 1 --2- 172.21.15.5:0/2673939253 >> v2:172.21.15.154:3300/0 conn(0x7fefb80cc9c0 0x7fefb80cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.610+0000 7fefbcd60640 1 --2- 172.21.15.5:0/2673939253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefb80cf2e0 0x7fefb80cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.610+0000 7fefbd561640 1 -- 172.21.15.5:0/2673939253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefb80cf2e0 msgr2=0x7fefb80cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.610+0000 7fefbd561640 1 --2- 172.21.15.5:0/2673939253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefb80cf2e0 0x7fefb80cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.610+0000 7fefbd561640 1 -- 172.21.15.5:0/2673939253 >> v2:172.21.15.154:3300/0 conn(0x7fefb80cc9c0 msgr2=0x7fefb80cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.610+0000 7fefbd561640 1 --2- 172.21.15.5:0/2673939253 >> v2:172.21.15.154:3300/0 conn(0x7fefb80cc9c0 0x7fefb80cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.610+0000 7fefbd561640 1 -- 172.21.15.5:0/2673939253 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb80cfd10 con 0x7fefb806a540 2023-07-14T13:05:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.610+0000 7fefbdd62640 1 --2- 172.21.15.5:0/2673939253 >> v2:172.21.15.154:3300/0 conn(0x7fefb80cc9c0 0x7fefb80cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:05:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.610+0000 7fefbd561640 1 --2- 172.21.15.5:0/2673939253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefb806a540 0x7fefb806a910 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fefb80cc780 tx=0x7fefb401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1b116199b9a1d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.614+0000 7fefaffff640 1 -- 172.21.15.5:0/2673939253 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb40aa5f0 con 0x7fefb806a540 2023-07-14T13:05:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.614+0000 7fefaffff640 1 -- 172.21.15.5:0/2673939253 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb40aa750 con 0x7fefb806a540 2023-07-14T13:05:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.614+0000 7fefaffff640 1 -- 172.21.15.5:0/2673939253 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb40aaae0 con 0x7fefb806a540 2023-07-14T13:05:39.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.614+0000 7fefbf7c5640 1 -- 172.21.15.5:0/2673939253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefb806a540 msgr2=0x7fefb806a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:39.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.614+0000 7fefbf7c5640 1 --2- 172.21.15.5:0/2673939253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefb806a540 0x7fefb806a910 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fefb80cc780 tx=0x7fefb401c4d0 comp rx=0 tx=0).stop 2023-07-14T13:05:39.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.614+0000 7fefbf7c5640 1 -- 172.21.15.5:0/2673939253 shutdown_connections 2023-07-14T13:05:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.614+0000 7fefbf7c5640 1 --2- 172.21.15.5:0/2673939253 >> v2:172.21.15.154:3300/0 conn(0x7fefb80cc9c0 0x7fefb80cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.614+0000 7fefbf7c5640 1 --2- 172.21.15.5:0/2673939253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefb80cf2e0 0x7fefb80cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.614+0000 7fefbf7c5640 1 --2- 172.21.15.5:0/2673939253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefb806a540 0x7fefb806a910 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.614+0000 7fefbf7c5640 1 -- 172.21.15.5:0/2673939253 >> 172.21.15.5:0/2673939253 conn(0x7fefb8099490 msgr2=0x7fefb8089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.614+0000 7fefbf7c5640 1 -- 172.21.15.5:0/2673939253 shutdown_connections 2023-07-14T13:05:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.614+0000 7fefbf7c5640 1 -- 172.21.15.5:0/2673939253 wait complete. 2023-07-14T13:05:39.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.614+0000 7fefbf7c5640 1 Processor -- start 2023-07-14T13:05:39.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.614+0000 7fefbf7c5640 1 -- start start 2023-07-14T13:05:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.614+0000 7fefbf7c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefb806a540 0x7fefb81531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.614+0000 7fefbf7c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefb80cc9c0 0x7fefb8159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.614+0000 7fefbf7c5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefb80cf2e0 0x7fefb815a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.614+0000 7fefbf7c5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb8153a20 con 0x7fefb80cc9c0 2023-07-14T13:05:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.614+0000 7fefbf7c5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb8153d00 con 0x7fefb806a540 2023-07-14T13:05:39.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.614+0000 7fefbf7c5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb8153fe0 con 0x7fefb80cf2e0 2023-07-14T13:05:39.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.614+0000 7fefbcd60640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefb80cc9c0 0x7fefb8159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:39.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.614+0000 7fefbcd60640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefb80cc9c0 0x7fefb8159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33278/0 (socket says 172.21.15.5:33278) 2023-07-14T13:05:39.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.614+0000 7fefbd561640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefb806a540 0x7fefb81531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:39.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.614+0000 7fefbcd60640 1 -- 172.21.15.5:0/1798004015 learned_addr learned my addr 172.21.15.5:0/1798004015 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:39.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.618+0000 7fefbdd62640 1 --2- 172.21.15.5:0/1798004015 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefb80cf2e0 0x7fefb815a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.618+0000 7fefbcd60640 1 -- 172.21.15.5:0/1798004015 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefb80cf2e0 msgr2=0x7fefb815a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.618+0000 7fefbcd60640 1 --2- 172.21.15.5:0/1798004015 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefb80cf2e0 0x7fefb815a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.618+0000 7fefbcd60640 1 -- 172.21.15.5:0/1798004015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefb806a540 msgr2=0x7fefb81531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.618+0000 7fefbcd60640 1 --2- 172.21.15.5:0/1798004015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefb806a540 0x7fefb81531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.618+0000 7fefbcd60640 1 -- 172.21.15.5:0/1798004015 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb40094d0 con 0x7fefb80cc9c0 2023-07-14T13:05:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.618+0000 7fefbcd60640 1 --2- 172.21.15.5:0/1798004015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefb80cc9c0 0x7fefb8159c10 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fefa800d5f0 tx=0x7fefa800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.618+0000 7fefadffb640 1 -- 172.21.15.5:0/1798004015 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa80125f0 con 0x7fefb80cc9c0 2023-07-14T13:05:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.618+0000 7fefadffb640 1 -- 172.21.15.5:0/1798004015 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa8012750 con 0x7fefb80cc9c0 2023-07-14T13:05:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.618+0000 7fefadffb640 1 -- 172.21.15.5:0/1798004015 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa8012ae0 con 0x7fefb80cc9c0 2023-07-14T13:05:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.618+0000 7fefbf7c5640 1 -- 172.21.15.5:0/1798004015 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb81542c0 con 0x7fefb80cc9c0 2023-07-14T13:05:39.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.618+0000 7fefbf7c5640 1 -- 172.21.15.5:0/1798004015 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb8153730 con 0x7fefb80cc9c0 2023-07-14T13:05:39.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.618+0000 7fefbf7c5640 1 -- 172.21.15.5:0/1798004015 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb80678d0 con 0x7fefb80cc9c0 2023-07-14T13:05:39.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.618+0000 7fefadffb640 1 -- 172.21.15.5:0/1798004015 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fefa8012c40 con 0x7fefb80cc9c0 2023-07-14T13:05:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.622+0000 7fefadffb640 1 --2- 172.21.15.5:0/1798004015 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fef9c066480 0x7fef9c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.622+0000 7fefadffb640 1 -- 172.21.15.5:0/1798004015 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 7029+0+0 (secure 0 0 0) 0x7fefa8084900 con 0x7fefb80cc9c0 2023-07-14T13:05:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.622+0000 7fefbd561640 1 --2- 172.21.15.5:0/1798004015 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fef9c066480 0x7fef9c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.622+0000 7fefbd561640 1 --2- 172.21.15.5:0/1798004015 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fef9c066480 0x7fef9c068930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fefb40ae000 tx=0x7fefb40b5040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:39.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.626+0000 7fefadffb640 1 -- 172.21.15.5:0/1798004015 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fefa8051740 con 0x7fefb80cc9c0 2023-07-14T13:05:39.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.854+0000 7fefbf7c5640 1 -- 172.21.15.5:0/1798004015 --> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fefb80cd780 con 0x7fef9c066480 2023-07-14T13:05:39.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.946+0000 7fefadffb640 1 -- 172.21.15.5:0/1798004015 <== mgr.5376 v2:172.21.15.154:6832/2192122532 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fefb40aa570 con 0x7fef9c066480 2023-07-14T13:05:39.977 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule removed for path /snap_test_dir1/dir9 2023-07-14T13:05:39.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.946+0000 7fefbf7c5640 1 -- 172.21.15.5:0/1798004015 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fef9c066480 msgr2=0x7fef9c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:39.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.946+0000 7fefbf7c5640 1 --2- 172.21.15.5:0/1798004015 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fef9c066480 0x7fef9c068930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fefb40ae000 tx=0x7fefb40b5040 comp rx=0 tx=0).stop 2023-07-14T13:05:39.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.946+0000 7fefbf7c5640 1 -- 172.21.15.5:0/1798004015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefb80cc9c0 msgr2=0x7fefb8159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:39.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.946+0000 7fefbf7c5640 1 --2- 172.21.15.5:0/1798004015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefb80cc9c0 0x7fefb8159c10 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fefa800d5f0 tx=0x7fefa800dab0 comp rx=0 tx=0).stop 2023-07-14T13:05:39.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.946+0000 7fefbf7c5640 1 -- 172.21.15.5:0/1798004015 shutdown_connections 2023-07-14T13:05:39.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.946+0000 7fefbf7c5640 1 --2- 172.21.15.5:0/1798004015 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fef9c066480 0x7fef9c068930 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:39.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.946+0000 7fefbf7c5640 1 --2- 172.21.15.5:0/1798004015 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fefb80cf2e0 0x7fefb815a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:39.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.946+0000 7fefbf7c5640 1 --2- 172.21.15.5:0/1798004015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefb80cc9c0 0x7fefb8159c10 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:39.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.946+0000 7fefbf7c5640 1 --2- 172.21.15.5:0/1798004015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefb806a540 0x7fefb81531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:39.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.946+0000 7fefbf7c5640 1 -- 172.21.15.5:0/1798004015 >> 172.21.15.5:0/1798004015 conn(0x7fefb8099490 msgr2=0x7fefb80acf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:39.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.946+0000 7fefbf7c5640 1 -- 172.21.15.5:0/1798004015 shutdown_connections 2023-07-14T13:05:39.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:39.946+0000 7fefbf7c5640 1 -- 172.21.15.5:0/1798004015 wait complete. 2023-07-14T13:05:39.998 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir9 2023-07-14T13:05:39.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:39.998 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-07-14T13:05:40.008 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_55_00_UTC 2023-07-14T13:05:40.009 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:40.009 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:40.009 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:40.009 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:40.009 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:40.009 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_01_00_UTC 2023-07-14T13:05:40.009 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:40.010 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_03_00_UTC 2023-07-14T13:05:40.010 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:40.010 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:40.011 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-14-12_55_00_UTC 2023-07-14T13:05:40.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:40.011 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-14-12_55_00_UTC) 2023-07-14T13:05:40.070 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-14-12_56_00_UTC 2023-07-14T13:05:40.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:40.070 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-14-12_56_00_UTC) 2023-07-14T13:05:40.130 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-14-12_57_00_UTC 2023-07-14T13:05:40.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:40.131 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-14-12_57_00_UTC) 2023-07-14T13:05:40.186 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-14-12_58_00_UTC 2023-07-14T13:05:40.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:40.187 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-14-12_58_00_UTC) 2023-07-14T13:05:40.241 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-14-12_59_00_UTC 2023-07-14T13:05:40.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:40.242 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-14-12_59_00_UTC) 2023-07-14T13:05:40.297 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-14-13_00_00_UTC 2023-07-14T13:05:40.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:40.298 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-14-13_00_00_UTC) 2023-07-14T13:05:40.354 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-14-13_01_00_UTC 2023-07-14T13:05:40.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:40.355 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-14-13_01_00_UTC) 2023-07-14T13:05:40.410 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-14-13_02_00_UTC 2023-07-14T13:05:40.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:40.411 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-14-13_02_00_UTC) 2023-07-14T13:05:40.466 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-14-13_03_00_UTC 2023-07-14T13:05:40.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:40.467 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-14-13_03_00_UTC) 2023-07-14T13:05:40.522 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-14-13_04_00_UTC 2023-07-14T13:05:40.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:40.523 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-14-13_04_00_UTC) 2023-07-14T13:05:40.578 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-14-13_05_00_UTC 2023-07-14T13:05:40.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:40.579 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-14-13_05_00_UTC) 2023-07-14T13:05:40.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:40.636 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9) 2023-07-14T13:05:40.704 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-14T13:05:40.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.862+0000 7f70f13fa640 1 Processor -- start 2023-07-14T13:05:40.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.862+0000 7f70f13fa640 1 -- start start 2023-07-14T13:05:40.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.862+0000 7f70f13fa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f70ec159500 0x7f70ec0cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:40.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.862+0000 7f70f13fa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70ec0b08d0 con 0x7f70ec0cd670 2023-07-14T13:05:40.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.862+0000 7f70f13fa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70ec159cb0 con 0x7f70ec156560 2023-07-14T13:05:40.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.862+0000 7f70f13fa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70ec1599d0 con 0x7f70ec159500 2023-07-14T13:05:40.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.862+0000 7f70e3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f70ec0cd670 0x7f70ec158df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43772/0 (socket says 172.21.15.5:43772) 2023-07-14T13:05:40.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.862+0000 7f70e3fff640 1 -- 172.21.15.5:0/4159536209 learned_addr learned my addr 172.21.15.5:0/4159536209 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:40.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.862+0000 7f70eb7fe640 1 --2- 172.21.15.5:0/4159536209 >> v2:172.21.15.5:3300/0 conn(0x7f70ec159500 0x7f70ec0cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.862+0000 7f70eb7fe640 1 -- 172.21.15.5:0/4159536209 >> v1:172.21.15.154:6789/0 conn(0x7f70ec156560 legacy=0x7f70ec0ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.862+0000 7f70eb7fe640 1 -- 172.21.15.5:0/4159536209 >> v1:172.21.15.5:6789/0 conn(0x7f70ec0cd670 legacy=0x7f70ec158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.866+0000 7f70eb7fe640 1 -- 172.21.15.5:0/4159536209 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec0ca900 con 0x7f70ec159500 2023-07-14T13:05:40.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.866+0000 7f70eb7fe640 1 --2- 172.21.15.5:0/4159536209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70ec159500 0x7f70ec0cb3e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009d90 tx=0x7f70e401eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8750de957f48aad server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:40.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.866+0000 7f70ea7fc640 1 -- 172.21.15.5:0/4159536209 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e40a7c20 con 0x7f70ec159500 2023-07-14T13:05:40.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.866+0000 7f70ea7fc640 1 -- 172.21.15.5:0/4159536209 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e40a7d80 con 0x7f70ec159500 2023-07-14T13:05:40.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.866+0000 7f70ea7fc640 1 -- 172.21.15.5:0/4159536209 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e40af660 con 0x7f70ec159500 2023-07-14T13:05:40.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.866+0000 7f70f13fa640 1 -- 172.21.15.5:0/4159536209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70ec159500 msgr2=0x7f70ec0cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:40.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.866+0000 7f70f13fa640 1 --2- 172.21.15.5:0/4159536209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70ec159500 0x7f70ec0cb3e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009d90 tx=0x7f70e401eb30 comp rx=0 tx=0).stop 2023-07-14T13:05:40.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.866+0000 7f70f13fa640 1 -- 172.21.15.5:0/4159536209 shutdown_connections 2023-07-14T13:05:40.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.866+0000 7f70f13fa640 1 --2- 172.21.15.5:0/4159536209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70ec159500 0x7f70ec0cb3e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:40.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.866+0000 7f70f13fa640 1 -- 172.21.15.5:0/4159536209 >> 172.21.15.5:0/4159536209 conn(0x7f70ec0afac0 msgr2=0x7f70ec0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:40.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.866+0000 7f70f13fa640 1 -- 172.21.15.5:0/4159536209 shutdown_connections 2023-07-14T13:05:40.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.866+0000 7f70f13fa640 1 -- 172.21.15.5:0/4159536209 wait complete. 2023-07-14T13:05:40.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.870+0000 7f70f13fa640 1 Processor -- start 2023-07-14T13:05:40.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.870+0000 7f70f13fa640 1 -- start start 2023-07-14T13:05:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.870+0000 7f70f13fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70ec0cd670 0x7f70ec0b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.870+0000 7f70f13fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70ec156560 0x7f70ec15b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.870+0000 7f70f13fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70ec159500 0x7f70ec159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.870+0000 7f70f13fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec15b3d0 con 0x7f70ec156560 2023-07-14T13:05:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.870+0000 7f70f13fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec15bd30 con 0x7f70ec159500 2023-07-14T13:05:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.870+0000 7f70f13fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec15a750 con 0x7f70ec0cd670 2023-07-14T13:05:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.870+0000 7f70e3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70ec156560 0x7f70ec15b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.870+0000 7f70e3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70ec156560 0x7f70ec15b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33292/0 (socket says 172.21.15.5:33292) 2023-07-14T13:05:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.870+0000 7f70e3fff640 1 -- 172.21.15.5:0/1833410693 learned_addr learned my addr 172.21.15.5:0/1833410693 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.870+0000 7f70eb7fe640 1 --2- 172.21.15.5:0/1833410693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70ec159500 0x7f70ec159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.870+0000 7f70e3fff640 1 -- 172.21.15.5:0/1833410693 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70ec0cd670 msgr2=0x7f70ec0b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:40.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.870+0000 7f70eaffd640 1 --2- 172.21.15.5:0/1833410693 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70ec0cd670 0x7f70ec0b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:40.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.870+0000 7f70e3fff640 1 --2- 172.21.15.5:0/1833410693 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70ec0cd670 0x7f70ec0b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:40.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.870+0000 7f70e3fff640 1 -- 172.21.15.5:0/1833410693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70ec159500 msgr2=0x7f70ec159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:40.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.870+0000 7f70e3fff640 1 --2- 172.21.15.5:0/1833410693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70ec159500 0x7f70ec159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:40.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.870+0000 7f70e3fff640 1 -- 172.21.15.5:0/1833410693 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e4009a70 con 0x7f70ec156560 2023-07-14T13:05:40.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.870+0000 7f70eb7fe640 1 --2- 172.21.15.5:0/1833410693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70ec159500 0x7f70ec159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:05:40.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.870+0000 7f70eaffd640 1 --2- 172.21.15.5:0/1833410693 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70ec0cd670 0x7f70ec0b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:05:40.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.870+0000 7f70e3fff640 1 --2- 172.21.15.5:0/1833410693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70ec156560 0x7f70ec15b7f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f70d400c500 tx=0x7f70d400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.870+0000 7f70e37fe640 1 -- 172.21.15.5:0/1833410693 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d4005cf0 con 0x7f70ec156560 2023-07-14T13:05:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.870+0000 7f70e37fe640 1 -- 172.21.15.5:0/1833410693 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d4005e50 con 0x7f70ec156560 2023-07-14T13:05:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.870+0000 7f70f13fa640 1 -- 172.21.15.5:0/1833410693 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70ec15aa30 con 0x7f70ec156560 2023-07-14T13:05:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.870+0000 7f70e37fe640 1 -- 172.21.15.5:0/1833410693 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d40072f0 con 0x7f70ec156560 2023-07-14T13:05:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.870+0000 7f70f13fa640 1 -- 172.21.15.5:0/1833410693 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70ec15aff0 con 0x7f70ec156560 2023-07-14T13:05:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.874+0000 7f70f13fa640 1 -- 172.21.15.5:0/1833410693 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70ec0678d0 con 0x7f70ec156560 2023-07-14T13:05:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.874+0000 7f70e37fe640 1 -- 172.21.15.5:0/1833410693 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f70d4007450 con 0x7f70ec156560 2023-07-14T13:05:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.874+0000 7f70e37fe640 1 --2- 172.21.15.5:0/1833410693 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f70cc066480 0x7f70cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.874+0000 7f70e37fe640 1 -- 172.21.15.5:0/1833410693 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 7921+0+0 (secure 0 0 0) 0x7f70d4083cd0 con 0x7f70ec156560 2023-07-14T13:05:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.874+0000 7f70eaffd640 1 --2- 172.21.15.5:0/1833410693 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f70cc066480 0x7f70cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.874+0000 7f70eaffd640 1 --2- 172.21.15.5:0/1833410693 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f70cc066480 0x7f70cc068930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f70dc000f70 tx=0x7f70dc009040 comp rx=0 tx=0).ready entity=mgr.5376 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:40.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:40.878+0000 7f70e37fe640 1 -- 172.21.15.5:0/1833410693 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f70d4050820 con 0x7f70ec156560 2023-07-14T13:05:41.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:41.122+0000 7f70f13fa640 1 -- 172.21.15.5:0/1833410693 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f70ec0ca310 con 0x7f70ec156560 2023-07-14T13:05:41.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:41.674+0000 7f70e37fe640 1 -- 172.21.15.5:0/1833410693 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 17) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f70d4050bf0 con 0x7f70ec156560 2023-07-14T13:05:41.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:41.674+0000 7f70e37fe640 1 -- 172.21.15.5:0/1833410693 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v17) v1 ==== 93+0+0 (secure 0 0 0) 0x7f70d406be00 con 0x7f70ec156560 2023-07-14T13:05:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:41.678+0000 7f70f13fa640 1 -- 172.21.15.5:0/1833410693 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f70cc066480 msgr2=0x7f70cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:41.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:41.678+0000 7f70f13fa640 1 --2- 172.21.15.5:0/1833410693 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f70cc066480 0x7f70cc068930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f70dc000f70 tx=0x7f70dc009040 comp rx=0 tx=0).stop 2023-07-14T13:05:41.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:41.678+0000 7f70f13fa640 1 -- 172.21.15.5:0/1833410693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70ec156560 msgr2=0x7f70ec15b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:41.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:41.678+0000 7f70f13fa640 1 --2- 172.21.15.5:0/1833410693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70ec156560 0x7f70ec15b7f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f70d400c500 tx=0x7f70d400c9c0 comp rx=0 tx=0).stop 2023-07-14T13:05:41.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:41.678+0000 7f70f13fa640 1 -- 172.21.15.5:0/1833410693 shutdown_connections 2023-07-14T13:05:41.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:41.678+0000 7f70f13fa640 1 --2- 172.21.15.5:0/1833410693 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f70cc066480 0x7f70cc068930 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:41.678+0000 7f70f13fa640 1 --2- 172.21.15.5:0/1833410693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70ec159500 0x7f70ec159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:41.678+0000 7f70f13fa640 1 --2- 172.21.15.5:0/1833410693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70ec156560 0x7f70ec15b7f0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:41.678+0000 7f70f13fa640 1 --2- 172.21.15.5:0/1833410693 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70ec0cd670 0x7f70ec0b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:41.678+0000 7f70f13fa640 1 -- 172.21.15.5:0/1833410693 >> 172.21.15.5:0/1833410693 conn(0x7f70ec0afac0 msgr2=0x7f70ec0ad930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:41.678+0000 7f70f13fa640 1 -- 172.21.15.5:0/1833410693 shutdown_connections 2023-07-14T13:05:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:41.678+0000 7f70f13fa640 1 -- 172.21.15.5:0/1833410693 wait complete. 2023-07-14T13:05:41.730 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T13:05:41.731 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:05:41.778 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:05:41.887 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T13:05:41.888 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:05:41.888 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:05:41.917 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:05:41.918 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:05:41.970 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:05:41.974 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:41.945+0000 7ff6e5a2c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:05:41.982 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:05:41.950+0000 7f67f5d5a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:05:42.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.094+0000 7f47be700640 1 Processor -- start 2023-07-14T13:05:42.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.094+0000 7f47be700640 1 -- start start 2023-07-14T13:05:42.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.098+0000 7f47be700640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47b80d1850 0x7f47b80d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:42.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.098+0000 7f47be700640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b80ccaf0 con 0x7f47b80b7c70 2023-07-14T13:05:42.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.098+0000 7f47be700640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b8160320 con 0x7f47b815fd60 2023-07-14T13:05:42.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.098+0000 7f47be700640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b80d1190 con 0x7f47b80d1850 2023-07-14T13:05:42.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.098+0000 7f47b7fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f47b80b7c70 0x7f47b815f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43778/0 (socket says 172.21.15.5:43778) 2023-07-14T13:05:42.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.098+0000 7f47b7fff640 1 -- 172.21.15.5:0/1386978644 learned_addr learned my addr 172.21.15.5:0/1386978644 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:42.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.098+0000 7f47bcc9d640 1 --2- 172.21.15.5:0/1386978644 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47b80d1850 0x7f47b80d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.098+0000 7f47b77fe640 1 -- 172.21.15.5:0/1386978644 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 856572664 0 0) 0x7f47b80ccaf0 con 0x7f47b80b7c70 2023-07-14T13:05:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.098+0000 7f47b77fe640 1 -- 172.21.15.5:0/1386978644 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47a4003530 con 0x7f47b80b7c70 2023-07-14T13:05:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.098+0000 7f47b77fe640 1 -- 172.21.15.5:0/1386978644 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4245604957 0 0) 0x7f47b8160320 con 0x7f47b815fd60 2023-07-14T13:05:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.098+0000 7f47b77fe640 1 -- 172.21.15.5:0/1386978644 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47b80ccaf0 con 0x7f47b815fd60 2023-07-14T13:05:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.098+0000 7f47bcc9d640 1 -- 172.21.15.5:0/1386978644 >> v1:172.21.15.154:6789/0 conn(0x7f47b815fd60 legacy=0x7f47b80d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.098+0000 7f47bcc9d640 1 -- 172.21.15.5:0/1386978644 >> v1:172.21.15.5:6789/0 conn(0x7f47b80b7c70 legacy=0x7f47b815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.098+0000 7f47b77fe640 1 -- 172.21.15.5:0/1386978644 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 822536650 0 0) 0x7f47a4003530 con 0x7f47b80b7c70 2023-07-14T13:05:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.098+0000 7f47bcc9d640 1 -- 172.21.15.5:0/1386978644 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b80ccd90 con 0x7f47b80d1850 2023-07-14T13:05:42.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.102+0000 7f47bcc9d640 1 --2- 172.21.15.5:0/1386978644 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47b80d1850 0x7f47b80d0c50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009dc0 tx=0x7f47b001c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7588e78f08476f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:42.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.102+0000 7f47b77fe640 1 -- 172.21.15.5:0/1386978644 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a8001680 con 0x7f47b80d1850 2023-07-14T13:05:42.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.102+0000 7f47b77fe640 1 -- 172.21.15.5:0/1386978644 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b00a55e0 con 0x7f47b80d1850 2023-07-14T13:05:42.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.102+0000 7f47b77fe640 1 -- 172.21.15.5:0/1386978644 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b00a5970 con 0x7f47b80d1850 2023-07-14T13:05:42.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.102+0000 7f47be700640 1 -- 172.21.15.5:0/1386978644 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47b80d1850 msgr2=0x7f47b80d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:42.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.102+0000 7f47be700640 1 --2- 172.21.15.5:0/1386978644 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47b80d1850 0x7f47b80d0c50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009dc0 tx=0x7f47b001c890 comp rx=0 tx=0).stop 2023-07-14T13:05:42.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.102+0000 7f47be700640 1 -- 172.21.15.5:0/1386978644 shutdown_connections 2023-07-14T13:05:42.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.102+0000 7f47be700640 1 --2- 172.21.15.5:0/1386978644 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47b80d1850 0x7f47b80d0c50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:42.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.102+0000 7f47be700640 1 -- 172.21.15.5:0/1386978644 >> 172.21.15.5:0/1386978644 conn(0x7f47b80650b0 msgr2=0x7f47b80654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:42.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.102+0000 7f47be700640 1 -- 172.21.15.5:0/1386978644 shutdown_connections 2023-07-14T13:05:42.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.102+0000 7f47be700640 1 -- 172.21.15.5:0/1386978644 wait complete. 2023-07-14T13:05:42.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.102+0000 7f47be700640 1 Processor -- start 2023-07-14T13:05:42.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.106+0000 7f47be700640 1 -- start start 2023-07-14T13:05:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.106+0000 7f47be700640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47b80b7c70 0x7f47b80b6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.106+0000 7f47be700640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47b80d1850 0x7f47b815c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:42.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.106+0000 7f47be700640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47b815fd60 0x7f47b814a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:42.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.106+0000 7f47be700640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b815c630 con 0x7f47b80b7c70 2023-07-14T13:05:42.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.106+0000 7f47be700640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b814a990 con 0x7f47b80d1850 2023-07-14T13:05:42.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.106+0000 7f47be700640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b815c860 con 0x7f47b815fd60 2023-07-14T13:05:42.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.106+0000 7f47b7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47b80b7c70 0x7f47b80b6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:42.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.106+0000 7f47b7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47b80b7c70 0x7f47b80b6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33320/0 (socket says 172.21.15.5:33320) 2023-07-14T13:05:42.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.106+0000 7f47b7fff640 1 -- 172.21.15.5:0/3433344849 learned_addr learned my addr 172.21.15.5:0/3433344849 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:42.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.106+0000 7f47bcc9d640 1 --2- 172.21.15.5:0/3433344849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47b815fd60 0x7f47b814a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:42.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.106+0000 7f47affff640 1 --2- 172.21.15.5:0/3433344849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47b80d1850 0x7f47b815c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:42.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.106+0000 7f47b7fff640 1 -- 172.21.15.5:0/3433344849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47b815fd60 msgr2=0x7f47b814a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:42.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.106+0000 7f47b7fff640 1 --2- 172.21.15.5:0/3433344849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47b815fd60 0x7f47b814a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:42.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.106+0000 7f47b7fff640 1 -- 172.21.15.5:0/3433344849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47b80d1850 msgr2=0x7f47b815c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:42.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.106+0000 7f47b7fff640 1 --2- 172.21.15.5:0/3433344849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47b80d1850 0x7f47b815c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:42.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.106+0000 7f47b7fff640 1 -- 172.21.15.5:0/3433344849 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b0009a70 con 0x7f47b80b7c70 2023-07-14T13:05:42.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.106+0000 7f47b7fff640 1 --2- 172.21.15.5:0/3433344849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47b80b7c70 0x7f47b80b6c00 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f47a800c780 tx=0x7f47a800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:42.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.106+0000 7f47b57fa640 1 -- 172.21.15.5:0/3433344849 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a8005ae0 con 0x7f47b80b7c70 2023-07-14T13:05:42.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.106+0000 7f47b57fa640 1 -- 172.21.15.5:0/3433344849 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a8005c40 con 0x7f47b80b7c70 2023-07-14T13:05:42.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.106+0000 7f47b57fa640 1 -- 172.21.15.5:0/3433344849 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a8007070 con 0x7f47b80b7c70 2023-07-14T13:05:42.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.106+0000 7f47be700640 1 -- 172.21.15.5:0/3433344849 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b815cb40 con 0x7f47b80b7c70 2023-07-14T13:05:42.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.106+0000 7f47be700640 1 -- 172.21.15.5:0/3433344849 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b815d100 con 0x7f47b80b7c70 2023-07-14T13:05:42.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.106+0000 7f47be700640 1 -- 172.21.15.5:0/3433344849 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b80678d0 con 0x7f47b80b7c70 2023-07-14T13:05:42.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.110+0000 7f47b57fa640 1 -- 172.21.15.5:0/3433344849 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f47a80071f0 con 0x7f47b80b7c70 2023-07-14T13:05:42.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.110+0000 7f47b57fa640 1 --2- 172.21.15.5:0/3433344849 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4798066430 0x7f47980688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:42.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.110+0000 7f47b57fa640 1 -- 172.21.15.5:0/3433344849 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7397+0+0 (secure 0 0 0) 0x7f47a8083b80 con 0x7f47b80b7c70 2023-07-14T13:05:42.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.110+0000 7f47affff640 1 -- 172.21.15.5:0/3433344849 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4798066430 msgr2=0x7f47980688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/2192122532 2023-07-14T13:05:42.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.110+0000 7f47affff640 1 --2- 172.21.15.5:0/3433344849 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4798066430 0x7f47980688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:05:42.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.114+0000 7f47b57fa640 1 -- 172.21.15.5:0/3433344849 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f47a80509a0 con 0x7f47b80b7c70 2023-07-14T13:05:42.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.270+0000 7f47be700640 1 -- 172.21.15.5:0/3433344849 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47b80d04e0 con 0x7f47b80b7c70 2023-07-14T13:05:42.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.274+0000 7f47b57fa640 1 -- 172.21.15.5:0/3433344849 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+20283 (secure 0 0 0) 0x7f47a8053fc0 con 0x7f47b80b7c70 2023-07-14T13:05:42.305 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:05:42.305 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":52,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:05:41.639294+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:53:41.014568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-14T12:53:42.032063+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":220,"snap_epoch":52,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2b","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/3341947062":"2023-07-15T12:54:00.161685+0000","172.21.15.154:0/3140351861":"2023-07-15T12:54:00.161685+0000","172.21.15.154:6833/2736441655":"2023-07-15T12:54:00.161685+0000","172.21.15.154:0/1533499204":"2023-07-15T12:54:00.161685+0000","172.21.15.154:6832/2736441655":"2023-07-15T12:54:00.161685+0000","172.21.15.154:0/844038179":"2023-07-15T12:54:00.161685+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1},{"begin":6,"length":1},{"begin":8,"length":1},{"begin":10,"length":1},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":1},{"begin":18,"length":1},{"begin":20,"length":1},{"begin":22,"length":1},{"begin":24,"length":1},{"begin":26,"length":1},{"begin":28,"length":1},{"begin":30,"length":1},{"begin":33,"length":1},{"begin":35,"length":1},{"begin":37,"length":1},{"begin":39,"length":1},{"begin":41,"length":2},{"begin":44,"length":1},{"begin":46,"length":1},{"begin":48,"length":1},{"begin":50,"length":1},{"begin":52,"length":1},{"begin":54,"length":1},{"begin":56,"length":1},{"begin":58,"length":1},{"begin":60,"length":1},{"begin":63,"length":1},{"begin":65,"length":1},{"begin":67,"length":1},{"begin":69,"length":1},{"begin":71,"length":1},{"begin":73,"length":1},{"begin":75,"length":1},{"begin":77,"length":1},{"begin":79,"length":1},{"begin":81,"length":1},{"begin":83,"length":1},{"begin":85,"length":1},{"begin":87,"length":1},{"begin":89,"length":1},{"begin":91,"length":2},{"begin":94,"length":1},{"begin":96,"length":1},{"begin":98,"length":1},{"begin":100,"length":1},{"begin":103,"length":1},{"begin":105,"length":2},{"begin":109,"length":1},{"begin":111,"length":1},{"begin":166,"length":55}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":8,"length":1},{"begin":20,"length":1},{"begin":30,"length":1},{"begin":41,"length":2},{"begin":52,"length":1},{"begin":63,"length":1},{"begin":73,"length":1},{"begin":83,"length":1},{"begin":96,"length":1},{"begin":103,"length":1},{"begin":210,"length":11}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:05:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.274+0000 7f47be700640 1 -- 172.21.15.5:0/3433344849 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4798066430 msgr2=0x7f47980688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:05:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.274+0000 7f47be700640 1 --2- 172.21.15.5:0/3433344849 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4798066430 0x7f47980688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.274+0000 7f47be700640 1 -- 172.21.15.5:0/3433344849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47b80b7c70 msgr2=0x7f47b80b6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.274+0000 7f47be700640 1 --2- 172.21.15.5:0/3433344849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47b80b7c70 0x7f47b80b6c00 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f47a800c780 tx=0x7f47a800cc40 comp rx=0 tx=0).stop 2023-07-14T13:05:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.274+0000 7f47be700640 1 -- 172.21.15.5:0/3433344849 shutdown_connections 2023-07-14T13:05:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.274+0000 7f47be700640 1 --2- 172.21.15.5:0/3433344849 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4798066430 0x7f47980688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.274+0000 7f47be700640 1 --2- 172.21.15.5:0/3433344849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47b815fd60 0x7f47b814a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.274+0000 7f47be700640 1 --2- 172.21.15.5:0/3433344849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47b80d1850 0x7f47b815c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.274+0000 7f47be700640 1 --2- 172.21.15.5:0/3433344849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47b80b7c70 0x7f47b80b6c00 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.274+0000 7f47be700640 1 -- 172.21.15.5:0/3433344849 >> 172.21.15.5:0/3433344849 conn(0x7f47b80650b0 msgr2=0x7f47b8065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.274+0000 7f47be700640 1 -- 172.21.15.5:0/3433344849 shutdown_connections 2023-07-14T13:05:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.274+0000 7f47be700640 1 -- 172.21.15.5:0/3433344849 wait complete. 2023-07-14T13:05:42.327 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T12:53:41.014568+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T12:53:42.032063+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 220, 'snap_epoch': 52, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:05:42.328 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:05:42.392 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:42.365+0000 7ff6e5a2c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:05:42.430 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:05:42.398+0000 7f67f5d5a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:05:42.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.446+0000 7f277aa48640 1 Processor -- start 2023-07-14T13:05:42.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.446+0000 7f277aa48640 1 -- start start 2023-07-14T13:05:42.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.450+0000 7f277aa48640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f27740d2fc0 0x7f27740b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:42.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.450+0000 7f277aa48640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27740d2300 0x7f27740d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:42.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.450+0000 7f277aa48640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27740b04c0 con 0x7f277415bde0 2023-07-14T13:05:42.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.450+0000 7f277aa48640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f277415c1b0 con 0x7f27740d2300 2023-07-14T13:05:42.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.450+0000 7f277aa48640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27740d2c80 con 0x7f27740d2fc0 2023-07-14T13:05:42.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.450+0000 7f2778fe5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27740d2300 0x7f27740d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:42.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.450+0000 7f2778fe5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27740d2300 0x7f27740d2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33324/0 (socket says 172.21.15.5:33324) 2023-07-14T13:05:42.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.450+0000 7f2778fe5640 1 -- 172.21.15.5:0/3563428805 learned_addr learned my addr 172.21.15.5:0/3563428805 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:42.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.450+0000 7f27737fe640 1 --2- 172.21.15.5:0/3563428805 >> v2:172.21.15.154:3300/0 conn(0x7f27740d2fc0 0x7f27740b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:42.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.450+0000 7f2778fe5640 1 -- 172.21.15.5:0/3563428805 >> v2:172.21.15.154:3300/0 conn(0x7f27740d2fc0 msgr2=0x7f27740b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:42.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.450+0000 7f2778fe5640 1 --2- 172.21.15.5:0/3563428805 >> v2:172.21.15.154:3300/0 conn(0x7f27740d2fc0 0x7f27740b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:42.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.450+0000 7f2778fe5640 1 -- 172.21.15.5:0/3563428805 >> v1:172.21.15.154:6789/0 conn(0x7f277415bde0 legacy=0x7f27740d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:42.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.450+0000 7f2778fe5640 1 -- 172.21.15.5:0/3563428805 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27740d0aa0 con 0x7f27740d2300 2023-07-14T13:05:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.454+0000 7f2778fe5640 1 --2- 172.21.15.5:0/3563428805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27740d2300 0x7f27740d2740 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f277408c600 tx=0x7f276c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d07a2cdac86941b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.454+0000 7f2772ffd640 1 -- 172.21.15.5:0/3563428805 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276c0a5890 con 0x7f27740d2300 2023-07-14T13:05:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.454+0000 7f2772ffd640 1 -- 172.21.15.5:0/3563428805 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276c0a59f0 con 0x7f27740d2300 2023-07-14T13:05:42.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.454+0000 7f2772ffd640 1 -- 172.21.15.5:0/3563428805 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276c0a5d80 con 0x7f27740d2300 2023-07-14T13:05:42.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.454+0000 7f277aa48640 1 -- 172.21.15.5:0/3563428805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27740d2300 msgr2=0x7f27740d2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:42.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.454+0000 7f277aa48640 1 --2- 172.21.15.5:0/3563428805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27740d2300 0x7f27740d2740 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f277408c600 tx=0x7f276c01c9d0 comp rx=0 tx=0).stop 2023-07-14T13:05:42.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.454+0000 7f277aa48640 1 -- 172.21.15.5:0/3563428805 shutdown_connections 2023-07-14T13:05:42.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.454+0000 7f277aa48640 1 --2- 172.21.15.5:0/3563428805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27740d2300 0x7f27740d2740 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:42.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.454+0000 7f277aa48640 1 --2- 172.21.15.5:0/3563428805 >> v2:172.21.15.154:3300/0 conn(0x7f27740d2fc0 0x7f27740b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:42.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.454+0000 7f277aa48640 1 -- 172.21.15.5:0/3563428805 >> 172.21.15.5:0/3563428805 conn(0x7f27740659d0 msgr2=0x7f277409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:42.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.454+0000 7f277aa48640 1 -- 172.21.15.5:0/3563428805 shutdown_connections 2023-07-14T13:05:42.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.454+0000 7f277aa48640 1 -- 172.21.15.5:0/3563428805 wait complete. 2023-07-14T13:05:42.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.454+0000 7f277aa48640 1 Processor -- start 2023-07-14T13:05:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.454+0000 7f277aa48640 1 -- start start 2023-07-14T13:05:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.458+0000 7f277aa48640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27740d2300 0x7f27741541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:42.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.458+0000 7f277aa48640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27740d2fc0 0x7f27740b71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:42.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.458+0000 7f277aa48640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f277415bde0 0x7f27740cee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:42.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.458+0000 7f277aa48640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27741546e0 con 0x7f277415bde0 2023-07-14T13:05:42.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.458+0000 7f277aa48640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277415d370 con 0x7f27740d2fc0 2023-07-14T13:05:42.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.458+0000 7f277aa48640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277415c760 con 0x7f27740d2300 2023-07-14T13:05:42.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.458+0000 7f2778fe5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f277415bde0 0x7f27740cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:42.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.458+0000 7f2773fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27740d2300 0x7f27741541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:42.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.458+0000 7f2773fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27740d2300 0x7f27741541a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:55630/0 (socket says 172.21.15.5:55630) 2023-07-14T13:05:42.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.458+0000 7f2773fff640 1 -- 172.21.15.5:0/1594748675 learned_addr learned my addr 172.21.15.5:0/1594748675 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:42.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.458+0000 7f27737fe640 1 --2- 172.21.15.5:0/1594748675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27740d2fc0 0x7f27740b71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:42.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.458+0000 7f2773fff640 1 -- 172.21.15.5:0/1594748675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27740d2fc0 msgr2=0x7f27740b71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:42.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.458+0000 7f2773fff640 1 --2- 172.21.15.5:0/1594748675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27740d2fc0 0x7f27740b71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:42.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.458+0000 7f2773fff640 1 -- 172.21.15.5:0/1594748675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f277415bde0 msgr2=0x7f27740cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:42.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.458+0000 7f2773fff640 1 --2- 172.21.15.5:0/1594748675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f277415bde0 0x7f27740cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:42.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.458+0000 7f2773fff640 1 -- 172.21.15.5:0/1594748675 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276c009b30 con 0x7f27740d2300 2023-07-14T13:05:42.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.458+0000 7f2778fe5640 1 --2- 172.21.15.5:0/1594748675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f277415bde0 0x7f27740cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:42.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.458+0000 7f2773fff640 1 --2- 172.21.15.5:0/1594748675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27740d2300 0x7f27741541a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f276400c450 tx=0x7f276400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:42.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.458+0000 7f2770ff9640 1 -- 172.21.15.5:0/1594748675 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2764012830 con 0x7f27740d2300 2023-07-14T13:05:42.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.458+0000 7f2770ff9640 1 -- 172.21.15.5:0/1594748675 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2764012990 con 0x7f27740d2300 2023-07-14T13:05:42.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.458+0000 7f2770ff9640 1 -- 172.21.15.5:0/1594748675 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2764012d00 con 0x7f27740d2300 2023-07-14T13:05:42.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.458+0000 7f277aa48640 1 -- 172.21.15.5:0/1594748675 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f277415ca40 con 0x7f27740d2300 2023-07-14T13:05:42.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.458+0000 7f277aa48640 1 -- 172.21.15.5:0/1594748675 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f277415d000 con 0x7f27740d2300 2023-07-14T13:05:42.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.458+0000 7f277aa48640 1 -- 172.21.15.5:0/1594748675 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27740678d0 con 0x7f27740d2300 2023-07-14T13:05:42.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.458+0000 7f2770ff9640 1 -- 172.21.15.5:0/1594748675 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 17) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f27640050d0 con 0x7f27740d2300 2023-07-14T13:05:42.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.462+0000 7f2770ff9640 1 --2- 172.21.15.5:0/1594748675 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f2760066430 0x7f27600688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:42.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.462+0000 7f2770ff9640 1 -- 172.21.15.5:0/1594748675 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7397+0+0 (secure 0 0 0) 0x7f2764083c90 con 0x7f27740d2300 2023-07-14T13:05:42.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.462+0000 7f27737fe640 1 -- 172.21.15.5:0/1594748675 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f2760066430 msgr2=0x7f27600688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/2192122532 2023-07-14T13:05:42.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.462+0000 7f27737fe640 1 --2- 172.21.15.5:0/1594748675 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f2760066430 0x7f27600688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:05:42.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.466+0000 7f2770ff9640 1 -- 172.21.15.5:0/1594748675 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2764050a90 con 0x7f27740d2300 2023-07-14T13:05:42.542 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:42.513+0000 7ff6e5a2c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:05:42.590 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:05:42.558+0000 7f67f5d5a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:05:42.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.622+0000 7f277aa48640 1 -- 172.21.15.5:0/1594748675 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f277415d4b0 con 0x7f27740d2300 2023-07-14T13:05:42.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.622+0000 7f2770ff9640 1 -- 172.21.15.5:0/1594748675 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2764012e60 con 0x7f27740d2300 2023-07-14T13:05:42.653 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:05:42.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.626+0000 7f277aa48640 1 -- 172.21.15.5:0/1594748675 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f2760066430 msgr2=0x7f27600688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:05:42.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.626+0000 7f277aa48640 1 --2- 172.21.15.5:0/1594748675 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f2760066430 0x7f27600688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:42.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.626+0000 7f277aa48640 1 -- 172.21.15.5:0/1594748675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27740d2300 msgr2=0x7f27741541a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:42.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.626+0000 7f277aa48640 1 --2- 172.21.15.5:0/1594748675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27740d2300 0x7f27741541a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f276400c450 tx=0x7f276400c910 comp rx=0 tx=0).stop 2023-07-14T13:05:42.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.626+0000 7f277aa48640 1 -- 172.21.15.5:0/1594748675 shutdown_connections 2023-07-14T13:05:42.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.626+0000 7f277aa48640 1 --2- 172.21.15.5:0/1594748675 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f2760066430 0x7f27600688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:42.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.626+0000 7f277aa48640 1 --2- 172.21.15.5:0/1594748675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f277415bde0 0x7f27740cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:42.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.626+0000 7f277aa48640 1 --2- 172.21.15.5:0/1594748675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27740d2fc0 0x7f27740b71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:42.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.626+0000 7f277aa48640 1 --2- 172.21.15.5:0/1594748675 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27740d2300 0x7f27741541a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:42.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.626+0000 7f277aa48640 1 -- 172.21.15.5:0/1594748675 >> 172.21.15.5:0/1594748675 conn(0x7f27740659d0 msgr2=0x7f27740cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:42.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.626+0000 7f277aa48640 1 -- 172.21.15.5:0/1594748675 shutdown_connections 2023-07-14T13:05:42.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.626+0000 7f277aa48640 1 -- 172.21.15.5:0/1594748675 wait complete. 2023-07-14T13:05:42.676 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:05:42.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.794+0000 7f40d11ad640 1 Processor -- start 2023-07-14T13:05:42.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.794+0000 7f40d11ad640 1 -- start start 2023-07-14T13:05:42.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.794+0000 7f40d11ad640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f40cc15bde0 0x7f40cc0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:42.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.794+0000 7f40d11ad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc0d2300 0x7f40cc0d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:42.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.794+0000 7f40d11ad640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40cc0b04c0 con 0x7f40cc0d2fc0 2023-07-14T13:05:42.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.794+0000 7f40d11ad640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40cc15c1b0 con 0x7f40cc15bde0 2023-07-14T13:05:42.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.794+0000 7f40d11ad640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0d2cc0 con 0x7f40cc0d2300 2023-07-14T13:05:42.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.794+0000 7f40c3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f40cc0d2fc0 0x7f40cc0b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43792/0 (socket says 172.21.15.5:43792) 2023-07-14T13:05:42.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.794+0000 7f40c3fff640 1 -- 172.21.15.5:0/3112105496 learned_addr learned my addr 172.21.15.5:0/3112105496 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:42.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.794+0000 7f40cad9d640 1 --2- 172.21.15.5:0/3112105496 >> v2:172.21.15.154:3300/0 conn(0x7f40cc15bde0 0x7f40cc0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:42.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.794+0000 7f40cb59e640 1 --2- 172.21.15.5:0/3112105496 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc0d2300 0x7f40cc0d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:42.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.794+0000 7f40ca59c640 1 -- 172.21.15.5:0/3112105496 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1486938370 0 0) 0x7f40cc0b04c0 con 0x7f40cc0d2fc0 2023-07-14T13:05:42.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.794+0000 7f40ca59c640 1 -- 172.21.15.5:0/3112105496 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40b8003530 con 0x7f40cc0d2fc0 2023-07-14T13:05:42.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.794+0000 7f40cad9d640 1 -- 172.21.15.5:0/3112105496 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc0d2300 msgr2=0x7f40cc0d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:42.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.794+0000 7f40cad9d640 1 --2- 172.21.15.5:0/3112105496 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc0d2300 0x7f40cc0d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:42.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.794+0000 7f40cad9d640 1 -- 172.21.15.5:0/3112105496 >> v1:172.21.15.5:6789/0 conn(0x7f40cc0d2fc0 legacy=0x7f40cc0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:42.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.794+0000 7f40cad9d640 1 -- 172.21.15.5:0/3112105496 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc0b1060 con 0x7f40cc15bde0 2023-07-14T13:05:42.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.794+0000 7f40cb59e640 1 --2- 172.21.15.5:0/3112105496 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc0d2300 0x7f40cc0d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:42.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.798+0000 7f40cad9d640 1 --2- 172.21.15.5:0/3112105496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40cc15bde0 0x7f40cc0d0270 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f40bc0097a0 tx=0x7f40bc01c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72d9f69a3c341637 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:42.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.798+0000 7f40ca59c640 1 -- 172.21.15.5:0/3112105496 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc0ab600 con 0x7f40cc15bde0 2023-07-14T13:05:42.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.798+0000 7f40ca59c640 1 -- 172.21.15.5:0/3112105496 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40bc0a7050 con 0x7f40cc15bde0 2023-07-14T13:05:42.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.798+0000 7f40ca59c640 1 -- 172.21.15.5:0/3112105496 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc0ab960 con 0x7f40cc15bde0 2023-07-14T13:05:42.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.798+0000 7f40d11ad640 1 -- 172.21.15.5:0/3112105496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40cc15bde0 msgr2=0x7f40cc0d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:42.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.798+0000 7f40d11ad640 1 --2- 172.21.15.5:0/3112105496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40cc15bde0 0x7f40cc0d0270 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f40bc0097a0 tx=0x7f40bc01c460 comp rx=0 tx=0).stop 2023-07-14T13:05:42.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.798+0000 7f40d11ad640 1 -- 172.21.15.5:0/3112105496 shutdown_connections 2023-07-14T13:05:42.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.798+0000 7f40d11ad640 1 --2- 172.21.15.5:0/3112105496 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc0d2300 0x7f40cc0d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:42.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.798+0000 7f40d11ad640 1 --2- 172.21.15.5:0/3112105496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40cc15bde0 0x7f40cc0d0270 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:42.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.798+0000 7f40d11ad640 1 -- 172.21.15.5:0/3112105496 >> 172.21.15.5:0/3112105496 conn(0x7f40cc0659d0 msgr2=0x7f40cc09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:42.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.798+0000 7f40d11ad640 1 -- 172.21.15.5:0/3112105496 shutdown_connections 2023-07-14T13:05:42.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.802+0000 7f40d11ad640 1 -- 172.21.15.5:0/3112105496 wait complete. 2023-07-14T13:05:42.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.802+0000 7f40d11ad640 1 Processor -- start 2023-07-14T13:05:42.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.802+0000 7f40d11ad640 1 -- start start 2023-07-14T13:05:42.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.806+0000 7f40d11ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40cc0d2300 0x7f40cc156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:42.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.806+0000 7f40d11ad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc0d2fc0 0x7f40cc0b2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:42.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.806+0000 7f40d11ad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40cc15bde0 0x7f40cc147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:42.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.806+0000 7f40d11ad640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0b15d0 con 0x7f40cc15bde0 2023-07-14T13:05:42.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.806+0000 7f40d11ad640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0b18b0 con 0x7f40cc0d2300 2023-07-14T13:05:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.806+0000 7f40d11ad640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc0b1b90 con 0x7f40cc0d2fc0 2023-07-14T13:05:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.806+0000 7f40cb59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40cc15bde0 0x7f40cc147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.806+0000 7f40cb59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40cc15bde0 0x7f40cc147480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33342/0 (socket says 172.21.15.5:33342) 2023-07-14T13:05:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.806+0000 7f40c3fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc0d2fc0 0x7f40cc0b2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.806+0000 7f40cad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40cc0d2300 0x7f40cc156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:42.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.806+0000 7f40cb59e640 1 -- 172.21.15.5:0/1976390489 learned_addr learned my addr 172.21.15.5:0/1976390489 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:42.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.806+0000 7f40cb59e640 1 -- 172.21.15.5:0/1976390489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc0d2fc0 msgr2=0x7f40cc0b2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:42.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.806+0000 7f40cb59e640 1 --2- 172.21.15.5:0/1976390489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc0d2fc0 0x7f40cc0b2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:42.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.806+0000 7f40cb59e640 1 -- 172.21.15.5:0/1976390489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40cc0d2300 msgr2=0x7f40cc156f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:42.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.806+0000 7f40cb59e640 1 --2- 172.21.15.5:0/1976390489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40cc0d2300 0x7f40cc156f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:42.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.806+0000 7f40cb59e640 1 -- 172.21.15.5:0/1976390489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c4009a70 con 0x7f40cc15bde0 2023-07-14T13:05:42.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.806+0000 7f40cb59e640 1 --2- 172.21.15.5:0/1976390489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40cc15bde0 0x7f40cc147480 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f40c400efc0 tx=0x7f40c400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:42.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.806+0000 7f40c37fe640 1 -- 172.21.15.5:0/1976390489 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4009cd0 con 0x7f40cc15bde0 2023-07-14T13:05:42.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.806+0000 7f40c37fe640 1 -- 172.21.15.5:0/1976390489 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c400f040 con 0x7f40cc15bde0 2023-07-14T13:05:42.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.806+0000 7f40c37fe640 1 -- 172.21.15.5:0/1976390489 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c40039a0 con 0x7f40cc15bde0 2023-07-14T13:05:42.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.806+0000 7f40d11ad640 1 -- 172.21.15.5:0/1976390489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40bc0093b0 con 0x7f40cc15bde0 2023-07-14T13:05:42.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.806+0000 7f40d11ad640 1 -- 172.21.15.5:0/1976390489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40cc0b2150 con 0x7f40cc15bde0 2023-07-14T13:05:42.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.806+0000 7f40d11ad640 1 -- 172.21.15.5:0/1976390489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40cc0b2370 con 0x7f40cc15bde0 2023-07-14T13:05:42.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.810+0000 7f40c37fe640 1 -- 172.21.15.5:0/1976390489 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f40c4014480 con 0x7f40cc15bde0 2023-07-14T13:05:42.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.810+0000 7f40c37fe640 1 --2- 172.21.15.5:0/1976390489 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f40ac066430 0x7f40ac0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:42.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.810+0000 7f40c37fe640 1 -- 172.21.15.5:0/1976390489 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7397+0+0 (secure 0 0 0) 0x7f40c4085250 con 0x7f40cc15bde0 2023-07-14T13:05:42.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.810+0000 7f40cad9d640 1 -- 172.21.15.5:0/1976390489 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f40ac066430 msgr2=0x7f40ac0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/2192122532 2023-07-14T13:05:42.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.810+0000 7f40cad9d640 1 --2- 172.21.15.5:0/1976390489 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f40ac066430 0x7f40ac0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:05:42.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.814+0000 7f40c37fe640 1 -- 172.21.15.5:0/1976390489 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f40c4051e10 con 0x7f40cc15bde0 2023-07-14T13:05:43.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.970+0000 7f40d11ad640 1 -- 172.21.15.5:0/1976390489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f40cc0678d0 con 0x7f40cc15bde0 2023-07-14T13:05:43.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.970+0000 7f40c37fe640 1 -- 172.21.15.5:0/1976390489 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v52) v1 ==== 92+0+10 (secure 0 0 0) 0x7f40c4055430 con 0x7f40cc15bde0 2023-07-14T13:05:43.001 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:05:43.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.970+0000 7f40d11ad640 1 -- 172.21.15.5:0/1976390489 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f40ac066430 msgr2=0x7f40ac0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:05:43.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.970+0000 7f40d11ad640 1 --2- 172.21.15.5:0/1976390489 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f40ac066430 0x7f40ac0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.970+0000 7f40d11ad640 1 -- 172.21.15.5:0/1976390489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40cc15bde0 msgr2=0x7f40cc147480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:43.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.970+0000 7f40d11ad640 1 --2- 172.21.15.5:0/1976390489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40cc15bde0 0x7f40cc147480 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f40c400efc0 tx=0x7f40c400c490 comp rx=0 tx=0).stop 2023-07-14T13:05:43.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.970+0000 7f40d11ad640 1 -- 172.21.15.5:0/1976390489 shutdown_connections 2023-07-14T13:05:43.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.970+0000 7f40d11ad640 1 --2- 172.21.15.5:0/1976390489 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f40ac066430 0x7f40ac0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.970+0000 7f40d11ad640 1 --2- 172.21.15.5:0/1976390489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40cc15bde0 0x7f40cc147480 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.970+0000 7f40d11ad640 1 --2- 172.21.15.5:0/1976390489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f40cc0d2fc0 0x7f40cc0b2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.970+0000 7f40d11ad640 1 --2- 172.21.15.5:0/1976390489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40cc0d2300 0x7f40cc156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.970+0000 7f40d11ad640 1 -- 172.21.15.5:0/1976390489 >> 172.21.15.5:0/1976390489 conn(0x7f40cc0659d0 msgr2=0x7f40cc0cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:43.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.970+0000 7f40d11ad640 1 -- 172.21.15.5:0/1976390489 shutdown_connections 2023-07-14T13:05:43.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:42.970+0000 7f40d11ad640 1 -- 172.21.15.5:0/1976390489 wait complete. 2023-07-14T13:05:43.022 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T13:05:43.025 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:42.997+0000 7ff6e5a2c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:05:43.083 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:43.057+0000 7ff6e5a2c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:05:43.110 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:05:43.078+0000 7f67f5d5a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:05:43.139 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:43.113+0000 7ff6e5a2c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:05:43.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.138+0000 7f6bd519f640 1 Processor -- start 2023-07-14T13:05:43.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.138+0000 7f6bd519f640 1 -- start start 2023-07-14T13:05:43.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.142+0000 7f6bd519f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6bd00d2fc0 0x7f6bd00b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:43.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.142+0000 7f6bd519f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd00b04c0 con 0x7f6bd00d2300 2023-07-14T13:05:43.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.142+0000 7f6bd519f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd00d0aa0 con 0x7f6bd015bde0 2023-07-14T13:05:43.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.142+0000 7f6bd519f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd015c1b0 con 0x7f6bd00d2fc0 2023-07-14T13:05:43.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.142+0000 7f6bce59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6bd00d2fc0 0x7f6bd00b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:43.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.142+0000 7f6bce59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6bd00d2fc0 0x7f6bd00b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:51356/0 (socket says 172.21.15.5:51356) 2023-07-14T13:05:43.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.142+0000 7f6bce59c640 1 -- 172.21.15.5:0/3441271953 learned_addr learned my addr 172.21.15.5:0/3441271953 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:43.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.142+0000 7f6bce59c640 1 -- 172.21.15.5:0/3441271953 >> v1:172.21.15.154:6789/0 conn(0x7f6bd015bde0 legacy=0x7f6bd00d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:43.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.142+0000 7f6bce59c640 1 -- 172.21.15.5:0/3441271953 >> v1:172.21.15.5:6789/0 conn(0x7f6bd00d2300 legacy=0x7f6bd00cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:43.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.142+0000 7f6bce59c640 1 -- 172.21.15.5:0/3441271953 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd00afb90 con 0x7f6bd00d2fc0 2023-07-14T13:05:43.175 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:05:43.146+0000 7f67f5d5a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:05:43.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.146+0000 7f6bce59c640 1 --2- 172.21.15.5:0/3441271953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bd00d2fc0 0x7f6bd00b0950 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4009870 tx=0x7f6bc401c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f5a17a48a2661a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:43.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.146+0000 7f6bcdd9b640 1 -- 172.21.15.5:0/3441271953 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc40aa660 con 0x7f6bd00d2fc0 2023-07-14T13:05:43.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.146+0000 7f6bcdd9b640 1 -- 172.21.15.5:0/3441271953 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc40aa7c0 con 0x7f6bd00d2fc0 2023-07-14T13:05:43.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.146+0000 7f6bcdd9b640 1 -- 172.21.15.5:0/3441271953 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc40aab50 con 0x7f6bd00d2fc0 2023-07-14T13:05:43.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.146+0000 7f6bd519f640 1 -- 172.21.15.5:0/3441271953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bd00d2fc0 msgr2=0x7f6bd00b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:43.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.146+0000 7f6bd519f640 1 --2- 172.21.15.5:0/3441271953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bd00d2fc0 0x7f6bd00b0950 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4009870 tx=0x7f6bc401c500 comp rx=0 tx=0).stop 2023-07-14T13:05:43.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.146+0000 7f6bd519f640 1 -- 172.21.15.5:0/3441271953 shutdown_connections 2023-07-14T13:05:43.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.146+0000 7f6bd519f640 1 --2- 172.21.15.5:0/3441271953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bd00d2fc0 0x7f6bd00b0950 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.146+0000 7f6bd519f640 1 -- 172.21.15.5:0/3441271953 >> 172.21.15.5:0/3441271953 conn(0x7f6bd00659d0 msgr2=0x7f6bd009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:43.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.146+0000 7f6bd519f640 1 -- 172.21.15.5:0/3441271953 shutdown_connections 2023-07-14T13:05:43.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.146+0000 7f6bd519f640 1 -- 172.21.15.5:0/3441271953 wait complete. 2023-07-14T13:05:43.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.150+0000 7f6bd519f640 1 Processor -- start 2023-07-14T13:05:43.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.150+0000 7f6bd519f640 1 -- start start 2023-07-14T13:05:43.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.150+0000 7f6bd519f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bd00d2300 0x7f6bd015ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:43.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.150+0000 7f6bd519f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bd00d2fc0 0x7f6bd014da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:43.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.150+0000 7f6bd519f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bd015bde0 0x7f6bd006afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:43.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.150+0000 7f6bd519f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd00ce4b0 con 0x7f6bd015bde0 2023-07-14T13:05:43.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.150+0000 7f6bd519f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd00b73c0 con 0x7f6bd00d2300 2023-07-14T13:05:43.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.150+0000 7f6bd519f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd00b76a0 con 0x7f6bd00d2fc0 2023-07-14T13:05:43.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.150+0000 7f6bcf59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bd015bde0 0x7f6bd006afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:43.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.150+0000 7f6bce59c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bd00d2fc0 0x7f6bd014da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:43.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.150+0000 7f6bce59c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bd00d2fc0 0x7f6bd014da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:55650/0 (socket says 172.21.15.5:55650) 2023-07-14T13:05:43.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.150+0000 7f6bced9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bd00d2300 0x7f6bd015ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:43.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.150+0000 7f6bcf59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bd015bde0 0x7f6bd006afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33358/0 (socket says 172.21.15.5:33358) 2023-07-14T13:05:43.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.150+0000 7f6bce59c640 1 -- 172.21.15.5:0/2687023932 learned_addr learned my addr 172.21.15.5:0/2687023932 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:43.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.150+0000 7f6bce59c640 1 -- 172.21.15.5:0/2687023932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bd00d2300 msgr2=0x7f6bd015ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:43.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.150+0000 7f6bce59c640 1 --2- 172.21.15.5:0/2687023932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bd00d2300 0x7f6bd015ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.150+0000 7f6bce59c640 1 -- 172.21.15.5:0/2687023932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bd015bde0 msgr2=0x7f6bd006afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:43.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.150+0000 7f6bce59c640 1 --2- 172.21.15.5:0/2687023932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bd015bde0 0x7f6bd006afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.150+0000 7f6bce59c640 1 -- 172.21.15.5:0/2687023932 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc40094d0 con 0x7f6bd00d2fc0 2023-07-14T13:05:43.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.154+0000 7f6bce59c640 1 --2- 172.21.15.5:0/2687023932 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bd00d2fc0 0x7f6bd014da40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4019110 tx=0x7f6bc401ad40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:43.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.154+0000 7f6bb77fe640 1 -- 172.21.15.5:0/2687023932 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc40b38c0 con 0x7f6bd00d2fc0 2023-07-14T13:05:43.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.154+0000 7f6bb77fe640 1 -- 172.21.15.5:0/2687023932 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc40b3a40 con 0x7f6bd00d2fc0 2023-07-14T13:05:43.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.154+0000 7f6bb77fe640 1 -- 172.21.15.5:0/2687023932 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc40b3df0 con 0x7f6bd00d2fc0 2023-07-14T13:05:43.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.154+0000 7f6bd519f640 1 -- 172.21.15.5:0/2687023932 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd00b7980 con 0x7f6bd00d2fc0 2023-07-14T13:05:43.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.154+0000 7f6bd519f640 1 -- 172.21.15.5:0/2687023932 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd00ce0f0 con 0x7f6bd00d2fc0 2023-07-14T13:05:43.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.154+0000 7f6bd519f640 1 -- 172.21.15.5:0/2687023932 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd00678d0 con 0x7f6bd00d2fc0 2023-07-14T13:05:43.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.154+0000 7f6bb77fe640 1 -- 172.21.15.5:0/2687023932 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 17) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f6bc40059a0 con 0x7f6bd00d2fc0 2023-07-14T13:05:43.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.154+0000 7f6bb77fe640 1 --2- 172.21.15.5:0/2687023932 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f6bbc066480 0x7f6bbc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:43.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.154+0000 7f6bb77fe640 1 -- 172.21.15.5:0/2687023932 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7397+0+0 (secure 0 0 0) 0x7f6bc40a6040 con 0x7f6bd00d2fc0 2023-07-14T13:05:43.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.154+0000 7f6bced9d640 1 -- 172.21.15.5:0/2687023932 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f6bbc066480 msgr2=0x7f6bbc068930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/2192122532 2023-07-14T13:05:43.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.154+0000 7f6bced9d640 1 --2- 172.21.15.5:0/2687023932 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f6bbc066480 0x7f6bbc068930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:05:43.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.158+0000 7f6bb77fe640 1 -- 172.21.15.5:0/2687023932 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6bc40ec890 con 0x7f6bd00d2fc0 2023-07-14T13:05:43.228 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:43.201+0000 7ff6e5a2c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:05:43.236 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:05:43.206+0000 7f67f5d5a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:05:43.284 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:43.257+0000 7ff6e5a2c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:05:43.327 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:05:43.298+0000 7f67f5d5a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:05:43.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.314+0000 7f6bd519f640 1 -- 172.21.15.5:0/2687023932 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6bd00b77e0 con 0x7f6bd00d2fc0 2023-07-14T13:05:43.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.314+0000 7f6bb77fe640 1 -- 172.21.15.5:0/2687023932 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v52) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6bd00b77e0 con 0x7f6bd00d2fc0 2023-07-14T13:05:43.345 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T13:05:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.314+0000 7f6bd519f640 1 -- 172.21.15.5:0/2687023932 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f6bbc066480 msgr2=0x7f6bbc068930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:05:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.314+0000 7f6bd519f640 1 --2- 172.21.15.5:0/2687023932 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f6bbc066480 0x7f6bbc068930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.314+0000 7f6bd519f640 1 -- 172.21.15.5:0/2687023932 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bd00d2fc0 msgr2=0x7f6bd014da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.314+0000 7f6bd519f640 1 --2- 172.21.15.5:0/2687023932 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bd00d2fc0 0x7f6bd014da40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4019110 tx=0x7f6bc401ad40 comp rx=0 tx=0).stop 2023-07-14T13:05:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.314+0000 7f6bd519f640 1 -- 172.21.15.5:0/2687023932 shutdown_connections 2023-07-14T13:05:43.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.314+0000 7f6bd519f640 1 --2- 172.21.15.5:0/2687023932 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f6bbc066480 0x7f6bbc068930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.314+0000 7f6bd519f640 1 --2- 172.21.15.5:0/2687023932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bd015bde0 0x7f6bd006afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.314+0000 7f6bd519f640 1 --2- 172.21.15.5:0/2687023932 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bd00d2fc0 0x7f6bd014da40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.314+0000 7f6bd519f640 1 --2- 172.21.15.5:0/2687023932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bd00d2300 0x7f6bd015ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.314+0000 7f6bd519f640 1 -- 172.21.15.5:0/2687023932 >> 172.21.15.5:0/2687023932 conn(0x7f6bd00659d0 msgr2=0x7f6bd015b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:43.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.314+0000 7f6bd519f640 1 -- 172.21.15.5:0/2687023932 shutdown_connections 2023-07-14T13:05:43.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.314+0000 7f6bd519f640 1 -- 172.21.15.5:0/2687023932 wait complete. 2023-07-14T13:05:43.367 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T13:05:43.369 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:43.341+0000 7ff6e5a2c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:05:43.389 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:05:43.358+0000 7f67f5d5a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:05:43.424 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:43.397+0000 7ff6e5a2c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:05:43.479 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:05:43.450+0000 7f67f5d5a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:05:43.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.486+0000 7f12bc9fa640 1 Processor -- start 2023-07-14T13:05:43.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.486+0000 7f12bc9fa640 1 -- start start 2023-07-14T13:05:43.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.486+0000 7f12bc9fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12b80d2fc0 0x7f12b80b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:43.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.486+0000 7f12bc9fa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f12b80d2300 0x7f12b80d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:43.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.486+0000 7f12bc9fa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b80b04c0 con 0x7f12b815bde0 2023-07-14T13:05:43.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.486+0000 7f12bc9fa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b80d2ce0 con 0x7f12b80d2300 2023-07-14T13:05:43.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.486+0000 7f12bc9fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b815c1b0 con 0x7f12b80d2fc0 2023-07-14T13:05:43.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.486+0000 7f12b6d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f12b80d2300 0x7f12b80d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:43.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.486+0000 7f12b6d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f12b80d2300 0x7f12b80d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33372/0 (socket says 172.21.15.5:33372) 2023-07-14T13:05:43.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.486+0000 7f12b6d9d640 1 -- 172.21.15.5:0/1197306164 learned_addr learned my addr 172.21.15.5:0/1197306164 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:43.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.486+0000 7f12b5d9b640 1 --2- 172.21.15.5:0/1197306164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12b80d2fc0 0x7f12b80b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:43.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.486+0000 7f12b6d9d640 1 -- 172.21.15.5:0/1197306164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12b80d2fc0 msgr2=0x7f12b80b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:43.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.486+0000 7f12b6d9d640 1 --2- 172.21.15.5:0/1197306164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12b80d2fc0 0x7f12b80b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.486+0000 7f12b6d9d640 1 -- 172.21.15.5:0/1197306164 >> v1:172.21.15.154:6789/0 conn(0x7f12b815bde0 legacy=0x7f12b80d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:43.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.486+0000 7f12b6d9d640 1 -- 172.21.15.5:0/1197306164 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b80d0aa0 con 0x7f12b80d2300 2023-07-14T13:05:43.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.486+0000 7f12b5d9b640 1 --2- 172.21.15.5:0/1197306164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12b80d2fc0 0x7f12b80b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:43.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.490+0000 7f12b6d9d640 1 --2- 172.21.15.5:0/1197306164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b80d2300 0x7f12b80d27a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f12b0009e50 tx=0x7f12b001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d6b1a2daf9393c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:43.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.490+0000 7f12b559a640 1 -- 172.21.15.5:0/1197306164 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b00a58e0 con 0x7f12b80d2300 2023-07-14T13:05:43.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.490+0000 7f12b559a640 1 -- 172.21.15.5:0/1197306164 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b00a5a40 con 0x7f12b80d2300 2023-07-14T13:05:43.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.490+0000 7f12b559a640 1 -- 172.21.15.5:0/1197306164 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b00a5dd0 con 0x7f12b80d2300 2023-07-14T13:05:43.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.494+0000 7f12bc9fa640 1 -- 172.21.15.5:0/1197306164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b80d2300 msgr2=0x7f12b80d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:43.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.494+0000 7f12bc9fa640 1 --2- 172.21.15.5:0/1197306164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b80d2300 0x7f12b80d27a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f12b0009e50 tx=0x7f12b001ca10 comp rx=0 tx=0).stop 2023-07-14T13:05:43.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.494+0000 7f12bc9fa640 1 -- 172.21.15.5:0/1197306164 shutdown_connections 2023-07-14T13:05:43.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.494+0000 7f12bc9fa640 1 --2- 172.21.15.5:0/1197306164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b80d2300 0x7f12b80d27a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.494+0000 7f12bc9fa640 1 --2- 172.21.15.5:0/1197306164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12b80d2fc0 0x7f12b80b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.494+0000 7f12bc9fa640 1 -- 172.21.15.5:0/1197306164 >> 172.21.15.5:0/1197306164 conn(0x7f12b80659d0 msgr2=0x7f12b809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:43.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.494+0000 7f12bc9fa640 1 -- 172.21.15.5:0/1197306164 shutdown_connections 2023-07-14T13:05:43.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.494+0000 7f12bc9fa640 1 -- 172.21.15.5:0/1197306164 wait complete. 2023-07-14T13:05:43.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.494+0000 7f12bc9fa640 1 Processor -- start 2023-07-14T13:05:43.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.494+0000 7f12bc9fa640 1 -- start start 2023-07-14T13:05:43.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.494+0000 7f12bc9fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12b80d2300 0x7f12b80b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:43.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.494+0000 7f12bc9fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12b80d2fc0 0x7f12b814ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:43.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.494+0000 7f12bc9fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b815bde0 0x7f12b81593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:43.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.494+0000 7f12bc9fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b80b1390 con 0x7f12b815bde0 2023-07-14T13:05:43.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.494+0000 7f12bc9fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b80b1650 con 0x7f12b80d2300 2023-07-14T13:05:43.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.494+0000 7f12bc9fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b80b1930 con 0x7f12b80d2fc0 2023-07-14T13:05:43.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.498+0000 7f12b6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b815bde0 0x7f12b81593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:43.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.498+0000 7f12b659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12b80d2300 0x7f12b80b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:43.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.498+0000 7f12b5d9b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12b80d2fc0 0x7f12b814ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:43.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.498+0000 7f12b6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b815bde0 0x7f12b81593c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33386/0 (socket says 172.21.15.5:33386) 2023-07-14T13:05:43.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.498+0000 7f12b6d9d640 1 -- 172.21.15.5:0/3325385574 learned_addr learned my addr 172.21.15.5:0/3325385574 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:43.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.498+0000 7f12b5d9b640 1 -- 172.21.15.5:0/3325385574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12b80d2300 msgr2=0x7f12b80b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:43.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.498+0000 7f12b5d9b640 1 --2- 172.21.15.5:0/3325385574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12b80d2300 0x7f12b80b2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.498+0000 7f12b5d9b640 1 -- 172.21.15.5:0/3325385574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b815bde0 msgr2=0x7f12b81593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:43.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.498+0000 7f12b5d9b640 1 --2- 172.21.15.5:0/3325385574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b815bde0 0x7f12b81593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.498+0000 7f12b5d9b640 1 -- 172.21.15.5:0/3325385574 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ac009420 con 0x7f12b80d2fc0 2023-07-14T13:05:43.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.498+0000 7f12b659c640 1 --2- 172.21.15.5:0/3325385574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12b80d2300 0x7f12b80b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:43.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.498+0000 7f12b5d9b640 1 --2- 172.21.15.5:0/3325385574 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12b80d2fc0 0x7f12b814ccd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f12ac00e8e0 tx=0x7f12ac00eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:43.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.498+0000 7f12a6ffd640 1 -- 172.21.15.5:0/3325385574 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac00c8e0 con 0x7f12b80d2fc0 2023-07-14T13:05:43.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.498+0000 7f12a6ffd640 1 -- 172.21.15.5:0/3325385574 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ac00ca40 con 0x7f12b80d2fc0 2023-07-14T13:05:43.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.498+0000 7f12a6ffd640 1 -- 172.21.15.5:0/3325385574 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac00cdf0 con 0x7f12b80d2fc0 2023-07-14T13:05:43.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.498+0000 7f12bc9fa640 1 -- 172.21.15.5:0/3325385574 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b0009b30 con 0x7f12b80d2fc0 2023-07-14T13:05:43.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.498+0000 7f12bc9fa640 1 -- 172.21.15.5:0/3325385574 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b80b1ef0 con 0x7f12b80d2fc0 2023-07-14T13:05:43.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.498+0000 7f12bc9fa640 1 -- 172.21.15.5:0/3325385574 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b80678d0 con 0x7f12b80d2fc0 2023-07-14T13:05:43.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.498+0000 7f12a6ffd640 1 -- 172.21.15.5:0/3325385574 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 17) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f12ac013470 con 0x7f12b80d2fc0 2023-07-14T13:05:43.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.502+0000 7f12a6ffd640 1 --2- 172.21.15.5:0/3325385574 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f1298066430 0x7f12980688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:43.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.502+0000 7f12a6ffd640 1 -- 172.21.15.5:0/3325385574 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7397+0+0 (secure 0 0 0) 0x7f12ac084750 con 0x7f12b80d2fc0 2023-07-14T13:05:43.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.502+0000 7f12b659c640 1 -- 172.21.15.5:0/3325385574 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f1298066430 msgr2=0x7f12980688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/2192122532 2023-07-14T13:05:43.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.502+0000 7f12b659c640 1 --2- 172.21.15.5:0/3325385574 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f1298066430 0x7f12980688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:05:43.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.506+0000 7f12a6ffd640 1 -- 172.21.15.5:0/3325385574 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f12ac0514d0 con 0x7f12b80d2fc0 2023-07-14T13:05:43.543 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:05:43.510+0000 7f67f5d5a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:05:43.567 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:43.541+0000 7ff6e5a2c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:05:43.626 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:43.597+0000 7ff6e5a2c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:05:43.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.658+0000 7f12bc9fa640 1 -- 172.21.15.5:0/3325385574 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f12b80ce920 con 0x7f12b80d2fc0 2023-07-14T13:05:43.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.662+0000 7f12a6ffd640 1 -- 172.21.15.5:0/3325385574 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v52) v1 ==== 100+0+11 (secure 0 0 0) 0x7f12ac054af0 con 0x7f12b80d2fc0 2023-07-14T13:05:43.692 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T13:05:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.662+0000 7f12bc9fa640 1 -- 172.21.15.5:0/3325385574 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f1298066430 msgr2=0x7f12980688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:05:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.662+0000 7f12bc9fa640 1 --2- 172.21.15.5:0/3325385574 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f1298066430 0x7f12980688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.662+0000 7f12bc9fa640 1 -- 172.21.15.5:0/3325385574 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12b80d2fc0 msgr2=0x7f12b814ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.662+0000 7f12bc9fa640 1 --2- 172.21.15.5:0/3325385574 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12b80d2fc0 0x7f12b814ccd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f12ac00e8e0 tx=0x7f12ac00eda0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.662+0000 7f12bc9fa640 1 -- 172.21.15.5:0/3325385574 shutdown_connections 2023-07-14T13:05:43.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.662+0000 7f12bc9fa640 1 --2- 172.21.15.5:0/3325385574 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f1298066430 0x7f12980688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.662+0000 7f12bc9fa640 1 --2- 172.21.15.5:0/3325385574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12b815bde0 0x7f12b81593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.662+0000 7f12bc9fa640 1 --2- 172.21.15.5:0/3325385574 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12b80d2fc0 0x7f12b814ccd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.662+0000 7f12bc9fa640 1 --2- 172.21.15.5:0/3325385574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12b80d2300 0x7f12b80b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.662+0000 7f12bc9fa640 1 -- 172.21.15.5:0/3325385574 >> 172.21.15.5:0/3325385574 conn(0x7f12b80659d0 msgr2=0x7f12b80b3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:43.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.662+0000 7f12bc9fa640 1 -- 172.21.15.5:0/3325385574 shutdown_connections 2023-07-14T13:05:43.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.662+0000 7f12bc9fa640 1 -- 172.21.15.5:0/3325385574 wait complete. 2023-07-14T13:05:43.696 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:05:43.662+0000 7f67f5d5a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:05:43.716 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T13:05:43.762 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:05:43.730+0000 7f67f5d5a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:05:43.870 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:05:43.871 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:05:43.871 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:05:43.879 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:43.849+0000 7ff6e5a2c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:05:43.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.874+0000 7fd441d11640 1 Processor -- start 2023-07-14T13:05:43.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.874+0000 7fd441d11640 1 -- start start 2023-07-14T13:05:43.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.874+0000 7fd441d11640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd43c0d06b0 0x7fd43c0b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:43.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.874+0000 7fd441d11640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd43c145430 0x7fd43c0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:43.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.874+0000 7fd441d11640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd43c0b1f70 0x7fd43c0d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:43.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.874+0000 7fd43b7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd43c0d06b0 0x7fd43c0b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:43.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.874+0000 7fd43b7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd43c0d06b0 0x7fd43c0b1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:51372/0 (socket says 172.21.15.5:51372) 2023-07-14T13:05:43.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.874+0000 7fd43b7fe640 1 -- 172.21.15.5:0/1341822083 learned_addr learned my addr 172.21.15.5:0/1341822083 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:43.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.874+0000 7fd43affd640 1 --2- 172.21.15.5:0/1341822083 >> v2:172.21.15.5:3300/0 conn(0x7fd43c145430 0x7fd43c0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:43.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.878+0000 7fd43bfff640 1 --2- 172.21.15.5:0/1341822083 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd43c0b1f70 0x7fd43c0d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:43.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.878+0000 7fd441d11640 1 -- 172.21.15.5:0/1341822083 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43c0b2410 con 0x7fd43c145430 2023-07-14T13:05:43.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.878+0000 7fd441d11640 1 -- 172.21.15.5:0/1341822083 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43c0b26f0 con 0x7fd43c0d06b0 2023-07-14T13:05:43.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.878+0000 7fd441d11640 1 -- 172.21.15.5:0/1341822083 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0b29d0 con 0x7fd43c0b1f70 2023-07-14T13:05:43.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.878+0000 7fd43b7fe640 1 -- 172.21.15.5:0/1341822083 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd43c0b1f70 msgr2=0x7fd43c0d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:43.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.878+0000 7fd43b7fe640 1 --2- 172.21.15.5:0/1341822083 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd43c0b1f70 0x7fd43c0d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.878+0000 7fd43b7fe640 1 -- 172.21.15.5:0/1341822083 >> v2:172.21.15.5:3300/0 conn(0x7fd43c145430 msgr2=0x7fd43c0b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:43.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.878+0000 7fd43b7fe640 1 --2- 172.21.15.5:0/1341822083 >> v2:172.21.15.5:3300/0 conn(0x7fd43c145430 0x7fd43c0b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.878+0000 7fd43b7fe640 1 -- 172.21.15.5:0/1341822083 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c0b2cb0 con 0x7fd43c0d06b0 2023-07-14T13:05:43.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.878+0000 7fd43affd640 1 --2- 172.21.15.5:0/1341822083 >> v2:172.21.15.5:3300/0 conn(0x7fd43c145430 0x7fd43c0b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.882+0000 7fd43b7fe640 1 --2- 172.21.15.5:0/1341822083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd43c0d06b0 0x7fd43c0b1a30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd43c08b420 tx=0x7fd42c01c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5b310f727751a8f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.882+0000 7fd43a7fc640 1 -- 172.21.15.5:0/1341822083 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0aa610 con 0x7fd43c0d06b0 2023-07-14T13:05:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.882+0000 7fd43a7fc640 1 -- 172.21.15.5:0/1341822083 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c0a6040 con 0x7fd43c0d06b0 2023-07-14T13:05:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.882+0000 7fd43a7fc640 1 -- 172.21.15.5:0/1341822083 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0aa990 con 0x7fd43c0d06b0 2023-07-14T13:05:43.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.886+0000 7fd441d11640 1 -- 172.21.15.5:0/1341822083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd43c0d06b0 msgr2=0x7fd43c0b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.886+0000 7fd441d11640 1 --2- 172.21.15.5:0/1341822083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd43c0d06b0 0x7fd43c0b1a30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd43c08b420 tx=0x7fd42c01c4d0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.886+0000 7fd441d11640 1 -- 172.21.15.5:0/1341822083 shutdown_connections 2023-07-14T13:05:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.886+0000 7fd441d11640 1 --2- 172.21.15.5:0/1341822083 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd43c0b1f70 0x7fd43c0d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.886+0000 7fd441d11640 1 --2- 172.21.15.5:0/1341822083 >> v2:172.21.15.5:3300/0 conn(0x7fd43c145430 0x7fd43c0b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.886+0000 7fd441d11640 1 --2- 172.21.15.5:0/1341822083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd43c0d06b0 0x7fd43c0b1a30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.886+0000 7fd441d11640 1 -- 172.21.15.5:0/1341822083 >> 172.21.15.5:0/1341822083 conn(0x7fd43c0659d0 msgr2=0x7fd43c09b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:43.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.886+0000 7fd441d11640 1 -- 172.21.15.5:0/1341822083 shutdown_connections 2023-07-14T13:05:43.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.886+0000 7fd441d11640 1 -- 172.21.15.5:0/1341822083 wait complete. 2023-07-14T13:05:43.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.890+0000 7fd441d11640 1 Processor -- start 2023-07-14T13:05:43.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.890+0000 7fd441d11640 1 -- start start 2023-07-14T13:05:43.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.890+0000 7fd441d11640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd43c0b1f70 0x7fd43c15b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:43.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.890+0000 7fd441d11640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd43c0d06b0 0x7fd43c157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:43.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.890+0000 7fd441d11640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd43c157ec0 0x7fd43c0c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:43.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.890+0000 7fd441d11640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0b6be0 con 0x7fd43c0b1f70 2023-07-14T13:05:43.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.890+0000 7fd441d11640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0b7eb0 con 0x7fd43c0d06b0 2023-07-14T13:05:43.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.890+0000 7fd441d11640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0b6ea0 con 0x7fd43c157ec0 2023-07-14T13:05:43.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.890+0000 7fd43affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd43c0d06b0 0x7fd43c157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.890+0000 7fd43affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd43c0d06b0 0x7fd43c157980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:51382/0 (socket says 172.21.15.5:51382) 2023-07-14T13:05:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.890+0000 7fd43affd640 1 -- 172.21.15.5:0/2333905963 learned_addr learned my addr 172.21.15.5:0/2333905963 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.890+0000 7fd43bfff640 1 --2- 172.21.15.5:0/2333905963 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd43c157ec0 0x7fd43c0c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.890+0000 7fd43b7fe640 1 --2- 172.21.15.5:0/2333905963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd43c0b1f70 0x7fd43c15b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.890+0000 7fd43affd640 1 -- 172.21.15.5:0/2333905963 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd43c157ec0 msgr2=0x7fd43c0c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:43.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.890+0000 7fd43affd640 1 --2- 172.21.15.5:0/2333905963 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd43c157ec0 0x7fd43c0c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.890+0000 7fd43affd640 1 -- 172.21.15.5:0/2333905963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd43c0b1f70 msgr2=0x7fd43c15b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:43.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.890+0000 7fd43affd640 1 --2- 172.21.15.5:0/2333905963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd43c0b1f70 0x7fd43c15b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:43.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.890+0000 7fd43affd640 1 -- 172.21.15.5:0/2333905963 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd430009420 con 0x7fd43c0d06b0 2023-07-14T13:05:43.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.890+0000 7fd43affd640 1 --2- 172.21.15.5:0/2333905963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd43c0d06b0 0x7fd43c157980 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd43000ebe0 tx=0x7fd43000c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.894+0000 7fd423fff640 1 -- 172.21.15.5:0/2333905963 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43000eee0 con 0x7fd43c0d06b0 2023-07-14T13:05:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.894+0000 7fd423fff640 1 -- 172.21.15.5:0/2333905963 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43000cc30 con 0x7fd43c0d06b0 2023-07-14T13:05:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.894+0000 7fd423fff640 1 -- 172.21.15.5:0/2333905963 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd430013470 con 0x7fd43c0d06b0 2023-07-14T13:05:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.894+0000 7fd441d11640 1 -- 172.21.15.5:0/2333905963 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd42c0094d0 con 0x7fd43c0d06b0 2023-07-14T13:05:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.894+0000 7fd441d11640 1 -- 172.21.15.5:0/2333905963 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd43c0b7460 con 0x7fd43c0d06b0 2023-07-14T13:05:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.894+0000 7fd423fff640 1 -- 172.21.15.5:0/2333905963 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) v1 ==== 85829+0+0 (secure 0 0 0) 0x7fd4300135d0 con 0x7fd43c0d06b0 2023-07-14T13:05:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.898+0000 7fd423fff640 1 --2- 172.21.15.5:0/2333905963 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fd428066480 0x7fd428068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.898+0000 7fd423fff640 1 -- 172.21.15.5:0/2333905963 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7397+0+0 (secure 0 0 0) 0x7fd4300847b0 con 0x7fd43c0d06b0 2023-07-14T13:05:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.898+0000 7fd43b7fe640 1 -- 172.21.15.5:0/2333905963 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fd428066480 msgr2=0x7fd428068930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/2192122532 2023-07-14T13:05:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.898+0000 7fd43b7fe640 1 --2- 172.21.15.5:0/2333905963 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fd428066480 0x7fd428068930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:05:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.898+0000 7fd441d11640 1 -- 172.21.15.5:0/2333905963 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd43c072e50 con 0x7fd43c0d06b0 2023-07-14T13:05:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:43.902+0000 7fd423fff640 1 -- 172.21.15.5:0/2333905963 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd430051550 con 0x7fd43c0d06b0 2023-07-14T13:05:44.014 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:43.985+0000 7ff6e5a2c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:05:44.018 INFO:tasks.ceph.mgr.y.smithi005.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:05:44.018 INFO:tasks.ceph.mgr.y.smithi005.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:05:44.018 INFO:tasks.ceph.mgr.y.smithi005.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:05:44.027 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:05:43.998+0000 7f67f5d5a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:05:44.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.102+0000 7fd43b7fe640 1 -- 172.21.15.5:0/2333905963 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fd428066480 msgr2=0x7fd428068930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/2192122532 2023-07-14T13:05:44.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.102+0000 7fd43b7fe640 1 --2- 172.21.15.5:0/2333905963 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fd428066480 0x7fd428068930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-14T13:05:44.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.102+0000 7fd441d11640 1 -- 172.21.15.5:0/2333905963 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd43c0678d0 con 0x7fd43c0d06b0 2023-07-14T13:05:44.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.106+0000 7fd423fff640 1 -- 172.21.15.5:0/2333905963 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v52) v1 ==== 80+0+359 (secure 0 0 0) 0x7fd430021020 con 0x7fd43c0d06b0 2023-07-14T13:05:44.136 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/3341947062 2023-07-15T12:54:00.161685+0000 2023-07-14T13:05:44.136 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/3140351861 2023-07-15T12:54:00.161685+0000 2023-07-14T13:05:44.136 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:6833/2736441655 2023-07-15T12:54:00.161685+0000 2023-07-14T13:05:44.136 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/1533499204 2023-07-15T12:54:00.161685+0000 2023-07-14T13:05:44.137 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:6832/2736441655 2023-07-15T12:54:00.161685+0000 2023-07-14T13:05:44.137 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/844038179 2023-07-15T12:54:00.161685+0000 2023-07-14T13:05:44.137 INFO:teuthology.orchestra.run.smithi005.stderr:listed 6 entries 2023-07-14T13:05:44.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.106+0000 7fd441d11640 1 -- 172.21.15.5:0/2333905963 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fd428066480 msgr2=0x7fd428068930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:05:44.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.106+0000 7fd441d11640 1 --2- 172.21.15.5:0/2333905963 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fd428066480 0x7fd428068930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.106+0000 7fd441d11640 1 -- 172.21.15.5:0/2333905963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd43c0d06b0 msgr2=0x7fd43c157980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:44.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.106+0000 7fd441d11640 1 --2- 172.21.15.5:0/2333905963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd43c0d06b0 0x7fd43c157980 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd43000ebe0 tx=0x7fd43000c520 comp rx=0 tx=0).stop 2023-07-14T13:05:44.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.106+0000 7fd441d11640 1 -- 172.21.15.5:0/2333905963 shutdown_connections 2023-07-14T13:05:44.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.106+0000 7fd441d11640 1 --2- 172.21.15.5:0/2333905963 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fd428066480 0x7fd428068930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.106+0000 7fd441d11640 1 --2- 172.21.15.5:0/2333905963 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd43c157ec0 0x7fd43c0c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.106+0000 7fd441d11640 1 --2- 172.21.15.5:0/2333905963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd43c0d06b0 0x7fd43c157980 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.106+0000 7fd441d11640 1 --2- 172.21.15.5:0/2333905963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd43c0b1f70 0x7fd43c15b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.106+0000 7fd441d11640 1 -- 172.21.15.5:0/2333905963 >> 172.21.15.5:0/2333905963 conn(0x7fd43c0659d0 msgr2=0x7fd43c15fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:44.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.106+0000 7fd441d11640 1 -- 172.21.15.5:0/2333905963 shutdown_connections 2023-07-14T13:05:44.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.106+0000 7fd441d11640 1 -- 172.21.15.5:0/2333905963 wait complete. 2023-07-14T13:05:44.140 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:44.109+0000 7ff6e5a2c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:05:44.157 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-14T13:05:44.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:44.158 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-14T13:05:44.172 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:05:44.142+0000 7f67f5d5a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:05:44.210 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:44.181+0000 7ff6e5a2c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:05:44.215 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-07-14T13:05:44.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:05:44.216 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-14T13:05:44.273 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:05:44.274 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:05:44.283 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:05:44.283 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:05:44.284 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:05:44.308 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:05:44.278+0000 7f67f5d5a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:05:44.318 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:05:44.318 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:05:44.319 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:05:44.335 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:05:44.336 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:05:44.346 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:44.317+0000 7ff6e5a2c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:05:44.386 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:05:44.354+0000 7f67f5d5a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:05:44.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.478+0000 7f44744ca640 1 Processor -- start 2023-07-14T13:05:44.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.478+0000 7f44744ca640 1 -- start start 2023-07-14T13:05:44.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.478+0000 7f44744ca640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f446c158ce0 0x7f446c070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.478+0000 7f44744ca640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f446c0cc700 con 0x7f446c0c9730 2023-07-14T13:05:44.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.478+0000 7f44744ca640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f446c0b0ff0 con 0x7f446c0c8ad0 2023-07-14T13:05:44.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.478+0000 7f44744ca640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446c070c80 con 0x7f446c158ce0 2023-07-14T13:05:44.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.478+0000 7f4472266640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f446c158ce0 0x7f446c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:44.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.478+0000 7f4472266640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f446c158ce0 0x7f446c070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33418/0 (socket says 172.21.15.5:33418) 2023-07-14T13:05:44.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.478+0000 7f4472266640 1 -- 172.21.15.5:0/345905104 learned_addr learned my addr 172.21.15.5:0/345905104 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:44.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.478+0000 7f4472a67640 1 --1- 172.21.15.5:0/345905104 >> v1:172.21.15.5:6789/0 conn(0x7f446c0c9730 0x7f446c0ccb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43816/0 (socket says 172.21.15.5:43816) 2023-07-14T13:05:44.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.478+0000 7f4472266640 1 -- 172.21.15.5:0/345905104 >> v1:172.21.15.154:6789/0 conn(0x7f446c0c8ad0 legacy=0x7f446c0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:44.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.478+0000 7f4472266640 1 -- 172.21.15.5:0/345905104 >> v1:172.21.15.5:6789/0 conn(0x7f446c0c9730 legacy=0x7f446c0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:44.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.478+0000 7f4472266640 1 -- 172.21.15.5:0/345905104 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c0cbdd0 con 0x7f446c158ce0 2023-07-14T13:05:44.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.482+0000 7f4472266640 1 --2- 172.21.15.5:0/345905104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446c158ce0 0x7f446c070450 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4468009870 tx=0x7f446801e600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b78b66936406a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:44.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.482+0000 7f4471264640 1 -- 172.21.15.5:0/345905104 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44680ac680 con 0x7f446c158ce0 2023-07-14T13:05:44.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.482+0000 7f4471264640 1 -- 172.21.15.5:0/345905104 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44680ac7e0 con 0x7f446c158ce0 2023-07-14T13:05:44.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.482+0000 7f4471264640 1 -- 172.21.15.5:0/345905104 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44680acb70 con 0x7f446c158ce0 2023-07-14T13:05:44.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.482+0000 7f44744ca640 1 -- 172.21.15.5:0/345905104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446c158ce0 msgr2=0x7f446c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:44.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.482+0000 7f44744ca640 1 --2- 172.21.15.5:0/345905104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446c158ce0 0x7f446c070450 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4468009870 tx=0x7f446801e600 comp rx=0 tx=0).stop 2023-07-14T13:05:44.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.482+0000 7f44744ca640 1 -- 172.21.15.5:0/345905104 shutdown_connections 2023-07-14T13:05:44.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.482+0000 7f44744ca640 1 --2- 172.21.15.5:0/345905104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446c158ce0 0x7f446c070450 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.482+0000 7f44744ca640 1 -- 172.21.15.5:0/345905104 >> 172.21.15.5:0/345905104 conn(0x7f446c0afcf0 msgr2=0x7f446c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:44.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.482+0000 7f44744ca640 1 -- 172.21.15.5:0/345905104 shutdown_connections 2023-07-14T13:05:44.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.482+0000 7f44744ca640 1 -- 172.21.15.5:0/345905104 wait complete. 2023-07-14T13:05:44.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.486+0000 7f44744ca640 1 Processor -- start 2023-07-14T13:05:44.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.486+0000 7f44744ca640 1 -- start start 2023-07-14T13:05:44.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.486+0000 7f44744ca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f446c0c8ad0 0x7f446c0c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.486+0000 7f44744ca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446c0c9730 0x7f446c15b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.486+0000 7f44744ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f446c158ce0 0x7f446c150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.486+0000 7f44744ca640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0c82e0 con 0x7f446c0c9730 2023-07-14T13:05:44.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.486+0000 7f44744ca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c160f60 con 0x7f446c0c8ad0 2023-07-14T13:05:44.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.486+0000 7f44744ca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0c5770 con 0x7f446c158ce0 2023-07-14T13:05:44.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.486+0000 7f4471a65640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446c0c9730 0x7f446c15b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:44.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.486+0000 7f4472266640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f446c0c8ad0 0x7f446c0c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:44.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.486+0000 7f4471a65640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446c0c9730 0x7f446c15b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33432/0 (socket says 172.21.15.5:33432) 2023-07-14T13:05:44.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.486+0000 7f4471a65640 1 -- 172.21.15.5:0/2625828429 learned_addr learned my addr 172.21.15.5:0/2625828429 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:44.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.486+0000 7f4472a67640 1 --2- 172.21.15.5:0/2625828429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f446c158ce0 0x7f446c150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:44.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.486+0000 7f4471a65640 1 -- 172.21.15.5:0/2625828429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f446c158ce0 msgr2=0x7f446c150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:44.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.486+0000 7f4471a65640 1 --2- 172.21.15.5:0/2625828429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f446c158ce0 0x7f446c150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.486+0000 7f4471a65640 1 -- 172.21.15.5:0/2625828429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f446c0c8ad0 msgr2=0x7f446c0c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:44.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.486+0000 7f4471a65640 1 --2- 172.21.15.5:0/2625828429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f446c0c8ad0 0x7f446c0c5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.486+0000 7f4471a65640 1 -- 172.21.15.5:0/2625828429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44680094d0 con 0x7f446c0c9730 2023-07-14T13:05:44.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.486+0000 7f4471a65640 1 --2- 172.21.15.5:0/2625828429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446c0c9730 0x7f446c15b770 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f445c00c530 tx=0x7f445c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:44.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.486+0000 7f4462ffd640 1 -- 172.21.15.5:0/2625828429 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c005220 con 0x7f446c0c9730 2023-07-14T13:05:44.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.486+0000 7f4462ffd640 1 -- 172.21.15.5:0/2625828429 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445c005380 con 0x7f446c0c9730 2023-07-14T13:05:44.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.486+0000 7f44744ca640 1 -- 172.21.15.5:0/2625828429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446c0c7a40 con 0x7f446c0c9730 2023-07-14T13:05:44.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.486+0000 7f4462ffd640 1 -- 172.21.15.5:0/2625828429 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c007270 con 0x7f446c0c9730 2023-07-14T13:05:44.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.486+0000 7f44744ca640 1 -- 172.21.15.5:0/2625828429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446c0c8000 con 0x7f446c0c9730 2023-07-14T13:05:44.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.490+0000 7f44744ca640 1 -- 172.21.15.5:0/2625828429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f446c0678d0 con 0x7f446c0c9730 2023-07-14T13:05:44.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.490+0000 7f4462ffd640 1 -- 172.21.15.5:0/2625828429 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f445c0073d0 con 0x7f446c0c9730 2023-07-14T13:05:44.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.490+0000 7f4462ffd640 1 --2- 172.21.15.5:0/2625828429 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4450066460 0x7f4450068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.490+0000 7f4462ffd640 1 -- 172.21.15.5:0/2625828429 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7397+0+0 (secure 0 0 0) 0x7f445c083d10 con 0x7f446c0c9730 2023-07-14T13:05:44.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.490+0000 7f4472266640 1 -- 172.21.15.5:0/2625828429 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4450066460 msgr2=0x7f4450068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/2192122532 2023-07-14T13:05:44.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.490+0000 7f4472266640 1 --2- 172.21.15.5:0/2625828429 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4450066460 0x7f4450068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:05:44.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.494+0000 7f4462ffd640 1 -- 172.21.15.5:0/2625828429 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f445c089020 con 0x7f446c0c9730 2023-07-14T13:05:44.537 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:05:44.506+0000 7f67f5d5a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:05:44.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.694+0000 7f4472266640 1 -- 172.21.15.5:0/2625828429 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4450066460 msgr2=0x7f4450068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/2192122532 2023-07-14T13:05:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.694+0000 7f4472266640 1 --2- 172.21.15.5:0/2625828429 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4450066460 0x7f4450068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-14T13:05:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.694+0000 7f44744ca640 1 -- 172.21.15.5:0/2625828429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f446c0ca120 con 0x7f446c0c9730 2023-07-14T13:05:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.694+0000 7f4462ffd640 1 -- 172.21.15.5:0/2625828429 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4706 (secure 0 0 0) 0x7f445c050a70 con 0x7f446c0c9730 2023-07-14T13:05:44.727 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:05:44.727 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1121417572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1121417572},{"type":"v1","addr":"172.21.15.5:6833","nonce":1121417572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/1826988320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1826988320},{"type":"v1","addr":"172.21.15.154:6836","nonce":1826988320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5074,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3683900517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3683900517},{"type":"v1","addr":"172.21.15.154:6837","nonce":3683900517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T12:53:43.186604+0000","modified":"2023-07-14T12:53:46.672007+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5133},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5133":{"gid":5133,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6835/601029596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":601029596},{"type":"v1","addr":"172.21.15.5:6835","nonce":601029596}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-14T13:05:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 16 2023-07-14T13:05:44.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.698+0000 7f44744ca640 1 -- 172.21.15.5:0/2625828429 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4450066460 msgr2=0x7f4450068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:05:44.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.698+0000 7f44744ca640 1 --2- 172.21.15.5:0/2625828429 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4450066460 0x7f4450068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.698+0000 7f44744ca640 1 -- 172.21.15.5:0/2625828429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446c0c9730 msgr2=0x7f446c15b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:44.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.698+0000 7f44744ca640 1 --2- 172.21.15.5:0/2625828429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446c0c9730 0x7f446c15b770 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f445c00c530 tx=0x7f445c00c9f0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.698+0000 7f44744ca640 1 -- 172.21.15.5:0/2625828429 shutdown_connections 2023-07-14T13:05:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.698+0000 7f44744ca640 1 --2- 172.21.15.5:0/2625828429 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f4450066460 0x7f4450068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.698+0000 7f44744ca640 1 --2- 172.21.15.5:0/2625828429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f446c158ce0 0x7f446c150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.698+0000 7f44744ca640 1 --2- 172.21.15.5:0/2625828429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f446c0c9730 0x7f446c15b770 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.698+0000 7f44744ca640 1 --2- 172.21.15.5:0/2625828429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f446c0c8ad0 0x7f446c0c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.698+0000 7f44744ca640 1 -- 172.21.15.5:0/2625828429 >> 172.21.15.5:0/2625828429 conn(0x7f446c0afcf0 msgr2=0x7f446c0c9000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:44.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.698+0000 7f44744ca640 1 -- 172.21.15.5:0/2625828429 shutdown_connections 2023-07-14T13:05:44.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.698+0000 7f44744ca640 1 -- 172.21.15.5:0/2625828429 wait complete. 2023-07-14T13:05:44.749 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:05:44.888 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:44.861+0000 7ff6e5a2c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:05:44.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.906+0000 7f5e1946a640 1 Processor -- start 2023-07-14T13:05:44.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.906+0000 7f5e1946a640 1 -- start start 2023-07-14T13:05:44.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.906+0000 7f5e1946a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e140b7c70 0x7f5e140d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.906+0000 7f5e1946a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5e1415fd60 0x7f5e140d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.906+0000 7f5e1946a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e140ccaf0 con 0x7f5e140d1850 2023-07-14T13:05:44.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.906+0000 7f5e1946a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e140d1190 con 0x7f5e1415fd60 2023-07-14T13:05:44.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.906+0000 7f5e1946a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e14160600 con 0x7f5e140b7c70 2023-07-14T13:05:44.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.906+0000 7f5e137fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5e1415fd60 0x7f5e140d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:44.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.906+0000 7f5e137fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5e1415fd60 0x7f5e140d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33436/0 (socket says 172.21.15.5:33436) 2023-07-14T13:05:44.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.906+0000 7f5e137fe640 1 -- 172.21.15.5:0/3706005119 learned_addr learned my addr 172.21.15.5:0/3706005119 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:44.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.906+0000 7f5e12ffd640 1 --2- 172.21.15.5:0/3706005119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e140b7c70 0x7f5e140d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:44.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.906+0000 7f5e137fe640 1 -- 172.21.15.5:0/3706005119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e140b7c70 msgr2=0x7f5e140d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:44.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.906+0000 7f5e137fe640 1 --2- 172.21.15.5:0/3706005119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e140b7c70 0x7f5e140d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.906+0000 7f5e137fe640 1 -- 172.21.15.5:0/3706005119 >> v1:172.21.15.5:6789/0 conn(0x7f5e140d1850 legacy=0x7f5e1415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:44.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.906+0000 7f5e137fe640 1 -- 172.21.15.5:0/3706005119 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e14160320 con 0x7f5e1415fd60 2023-07-14T13:05:44.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.910+0000 7f5e137fe640 1 --2- 172.21.15.5:0/3706005119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e1415fd60 0x7f5e140d1da0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c009e80 tx=0x7f5e0c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07f4dd449a35139 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:44.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.910+0000 7f5e127fc640 1 -- 172.21.15.5:0/3706005119 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c0a58a0 con 0x7f5e1415fd60 2023-07-14T13:05:44.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.910+0000 7f5e127fc640 1 -- 172.21.15.5:0/3706005119 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0c0a5a00 con 0x7f5e1415fd60 2023-07-14T13:05:44.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.910+0000 7f5e127fc640 1 -- 172.21.15.5:0/3706005119 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c0a5d90 con 0x7f5e1415fd60 2023-07-14T13:05:44.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.910+0000 7f5e1946a640 1 -- 172.21.15.5:0/3706005119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e1415fd60 msgr2=0x7f5e140d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:44.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.910+0000 7f5e1946a640 1 --2- 172.21.15.5:0/3706005119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e1415fd60 0x7f5e140d1da0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c009e80 tx=0x7f5e0c01c9c0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.910+0000 7f5e1946a640 1 -- 172.21.15.5:0/3706005119 shutdown_connections 2023-07-14T13:05:44.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.910+0000 7f5e1946a640 1 --2- 172.21.15.5:0/3706005119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e1415fd60 0x7f5e140d1da0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.910+0000 7f5e1946a640 1 --2- 172.21.15.5:0/3706005119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e140b7c70 0x7f5e140d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.910+0000 7f5e1946a640 1 -- 172.21.15.5:0/3706005119 >> 172.21.15.5:0/3706005119 conn(0x7f5e140650b0 msgr2=0x7f5e140654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:44.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.910+0000 7f5e1946a640 1 -- 172.21.15.5:0/3706005119 shutdown_connections 2023-07-14T13:05:44.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.910+0000 7f5e1946a640 1 -- 172.21.15.5:0/3706005119 wait complete. 2023-07-14T13:05:44.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.914+0000 7f5e1946a640 1 Processor -- start 2023-07-14T13:05:44.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.914+0000 7f5e1946a640 1 -- start start 2023-07-14T13:05:44.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.914+0000 7f5e1946a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e140b7c70 0x7f5e1414c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.914+0000 7f5e1946a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e140d1850 0x7f5e14156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.914+0000 7f5e1946a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e1415fd60 0x7f5e14156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.914+0000 7f5e1946a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e140b52a0 con 0x7f5e140d1850 2023-07-14T13:05:44.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.914+0000 7f5e1946a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1415efd0 con 0x7f5e1415fd60 2023-07-14T13:05:44.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.914+0000 7f5e1946a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1415c0f0 con 0x7f5e140b7c70 2023-07-14T13:05:44.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.914+0000 7f5e0bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e140d1850 0x7f5e14156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:44.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.914+0000 7f5e0bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e140d1850 0x7f5e14156810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33450/0 (socket says 172.21.15.5:33450) 2023-07-14T13:05:44.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.914+0000 7f5e0bfff640 1 -- 172.21.15.5:0/2047829423 learned_addr learned my addr 172.21.15.5:0/2047829423 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:44.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.914+0000 7f5e137fe640 1 --2- 172.21.15.5:0/2047829423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e1415fd60 0x7f5e14156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:44.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.914+0000 7f5e12ffd640 1 --2- 172.21.15.5:0/2047829423 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e140b7c70 0x7f5e1414c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:44.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.914+0000 7f5e0bfff640 1 -- 172.21.15.5:0/2047829423 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e140b7c70 msgr2=0x7f5e1414c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:44.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.914+0000 7f5e0bfff640 1 --2- 172.21.15.5:0/2047829423 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e140b7c70 0x7f5e1414c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.914+0000 7f5e0bfff640 1 -- 172.21.15.5:0/2047829423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e1415fd60 msgr2=0x7f5e14156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:44.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.914+0000 7f5e0bfff640 1 --2- 172.21.15.5:0/2047829423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e1415fd60 0x7f5e14156d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.914+0000 7f5e0bfff640 1 -- 172.21.15.5:0/2047829423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0c009b30 con 0x7f5e140d1850 2023-07-14T13:05:44.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.914+0000 7f5e0bfff640 1 --2- 172.21.15.5:0/2047829423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e140d1850 0x7f5e14156810 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00c3c0 tx=0x7f5dfc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:44.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.914+0000 7f5e0b7fe640 1 -- 172.21.15.5:0/2047829423 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc0052d0 con 0x7f5e140d1850 2023-07-14T13:05:44.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.914+0000 7f5e0b7fe640 1 -- 172.21.15.5:0/2047829423 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dfc005430 con 0x7f5e140d1850 2023-07-14T13:05:44.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.914+0000 7f5e1946a640 1 -- 172.21.15.5:0/2047829423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e1415c340 con 0x7f5e140d1850 2023-07-14T13:05:44.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.914+0000 7f5e0b7fe640 1 -- 172.21.15.5:0/2047829423 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc003840 con 0x7f5e140d1850 2023-07-14T13:05:44.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.914+0000 7f5e1946a640 1 -- 172.21.15.5:0/2047829423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1415c900 con 0x7f5e140d1850 2023-07-14T13:05:44.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.918+0000 7f5e1946a640 1 -- 172.21.15.5:0/2047829423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e140678d0 con 0x7f5e140d1850 2023-07-14T13:05:44.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.918+0000 7f5e0b7fe640 1 -- 172.21.15.5:0/2047829423 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f5dfc0039a0 con 0x7f5e140d1850 2023-07-14T13:05:44.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.918+0000 7f5e0b7fe640 1 --2- 172.21.15.5:0/2047829423 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f5df4066430 0x7f5df40688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.918+0000 7f5e0b7fe640 1 -- 172.21.15.5:0/2047829423 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7397+0+0 (secure 0 0 0) 0x7f5dfc083a20 con 0x7f5e140d1850 2023-07-14T13:05:44.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.918+0000 7f5e12ffd640 1 -- 172.21.15.5:0/2047829423 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f5df4066430 msgr2=0x7f5df40688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/2192122532 2023-07-14T13:05:44.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.918+0000 7f5e12ffd640 1 --2- 172.21.15.5:0/2047829423 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f5df4066430 0x7f5df40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:05:44.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:44.926+0000 7f5e0b7fe640 1 -- 172.21.15.5:0/2047829423 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f5dfc0507a0 con 0x7f5e140d1850 2023-07-14T13:05:44.973 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:44.945+0000 7ff6e5a2c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:05:45.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.086+0000 7f5e1946a640 1 -- 172.21.15.5:0/2047829423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e140d2ce0 con 0x7f5e140d1850 2023-07-14T13:05:45.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.086+0000 7f5e0b7fe640 1 -- 172.21.15.5:0/2047829423 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+20283 (secure 0 0 0) 0x7f5dfc053dc0 con 0x7f5e140d1850 2023-07-14T13:05:45.119 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:05:45.119 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":52,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:05:41.639294+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:53:41.014568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-14T12:53:42.032063+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":220,"snap_epoch":52,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2b","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/3341947062":"2023-07-15T12:54:00.161685+0000","172.21.15.154:0/3140351861":"2023-07-15T12:54:00.161685+0000","172.21.15.154:6833/2736441655":"2023-07-15T12:54:00.161685+0000","172.21.15.154:0/1533499204":"2023-07-15T12:54:00.161685+0000","172.21.15.154:6832/2736441655":"2023-07-15T12:54:00.161685+0000","172.21.15.154:0/844038179":"2023-07-15T12:54:00.161685+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1},{"begin":6,"length":1},{"begin":8,"length":1},{"begin":10,"length":1},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":1},{"begin":18,"length":1},{"begin":20,"length":1},{"begin":22,"length":1},{"begin":24,"length":1},{"begin":26,"length":1},{"begin":28,"length":1},{"begin":30,"length":1},{"begin":33,"length":1},{"begin":35,"length":1},{"begin":37,"length":1},{"begin":39,"length":1},{"begin":41,"length":2},{"begin":44,"length":1},{"begin":46,"length":1},{"begin":48,"length":1},{"begin":50,"length":1},{"begin":52,"length":1},{"begin":54,"length":1},{"begin":56,"length":1},{"begin":58,"length":1},{"begin":60,"length":1},{"begin":63,"length":1},{"begin":65,"length":1},{"begin":67,"length":1},{"begin":69,"length":1},{"begin":71,"length":1},{"begin":73,"length":1},{"begin":75,"length":1},{"begin":77,"length":1},{"begin":79,"length":1},{"begin":81,"length":1},{"begin":83,"length":1},{"begin":85,"length":1},{"begin":87,"length":1},{"begin":89,"length":1},{"begin":91,"length":2},{"begin":94,"length":1},{"begin":96,"length":1},{"begin":98,"length":1},{"begin":100,"length":1},{"begin":103,"length":1},{"begin":105,"length":2},{"begin":109,"length":1},{"begin":111,"length":1},{"begin":166,"length":55}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":8,"length":1},{"begin":20,"length":1},{"begin":30,"length":1},{"begin":41,"length":2},{"begin":52,"length":1},{"begin":63,"length":1},{"begin":73,"length":1},{"begin":83,"length":1},{"begin":96,"length":1},{"begin":103,"length":1},{"begin":210,"length":11}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:05:45.120 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:45.093+0000 7ff6e5a2c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:05:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.090+0000 7f5e1946a640 1 -- 172.21.15.5:0/2047829423 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f5df4066430 msgr2=0x7f5df40688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:05:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.090+0000 7f5e1946a640 1 --2- 172.21.15.5:0/2047829423 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f5df4066430 0x7f5df40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.090+0000 7f5e1946a640 1 -- 172.21.15.5:0/2047829423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e140d1850 msgr2=0x7f5e14156810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.090+0000 7f5e1946a640 1 --2- 172.21.15.5:0/2047829423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e140d1850 0x7f5e14156810 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00c3c0 tx=0x7f5dfc00c880 comp rx=0 tx=0).stop 2023-07-14T13:05:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.090+0000 7f5e1946a640 1 -- 172.21.15.5:0/2047829423 shutdown_connections 2023-07-14T13:05:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.090+0000 7f5e1946a640 1 --2- 172.21.15.5:0/2047829423 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7f5df4066430 0x7f5df40688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.090+0000 7f5e1946a640 1 --2- 172.21.15.5:0/2047829423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e1415fd60 0x7f5e14156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.090+0000 7f5e1946a640 1 --2- 172.21.15.5:0/2047829423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e140d1850 0x7f5e14156810 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.090+0000 7f5e1946a640 1 --2- 172.21.15.5:0/2047829423 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e140b7c70 0x7f5e1414c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.090+0000 7f5e1946a640 1 -- 172.21.15.5:0/2047829423 >> 172.21.15.5:0/2047829423 conn(0x7f5e140650b0 msgr2=0x7f5e140cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.090+0000 7f5e1946a640 1 -- 172.21.15.5:0/2047829423 shutdown_connections 2023-07-14T13:05:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.090+0000 7f5e1946a640 1 -- 172.21.15.5:0/2047829423 wait complete. 2023-07-14T13:05:45.127 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:05:45.098+0000 7f67f5d5a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:05:45.141 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T12:53:41.014568+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T12:53:42.032063+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 220, 'snap_epoch': 52, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:05:45.142 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:05:45.203 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:45.177+0000 7ff6e5a2c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:05:45.217 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:05:45.186+0000 7f67f5d5a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:05:45.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.258+0000 7fddbd512640 1 Processor -- start 2023-07-14T13:05:45.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.258+0000 7fddbd512640 1 -- start start 2023-07-14T13:05:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.262+0000 7fddbd512640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fddb80cc960 0x7fddb80ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.262+0000 7fddbd512640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddb8160750 0x7fddb815c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.262+0000 7fddbd512640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb80cd270 con 0x7fddb80b1620 2023-07-14T13:05:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.262+0000 7fddbd512640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb80cf710 con 0x7fddb80cc960 2023-07-14T13:05:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.262+0000 7fddbd512640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80cf430 con 0x7fddb8160750 2023-07-14T13:05:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.262+0000 7fddb77fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fddb80b1620 0x7fddb80ce950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43830/0 (socket says 172.21.15.5:43830) 2023-07-14T13:05:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.262+0000 7fddb77fe640 1 -- 172.21.15.5:0/1618342567 learned_addr learned my addr 172.21.15.5:0/1618342567 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.262+0000 7fddb7fff640 1 --2- 172.21.15.5:0/1618342567 >> v2:172.21.15.154:3300/0 conn(0x7fddb80cc960 0x7fddb80ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.262+0000 7fddbcd11640 1 --2- 172.21.15.5:0/1618342567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddb8160750 0x7fddb815c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:45.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.262+0000 7fddb6ffd640 1 -- 172.21.15.5:0/1618342567 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566732204 0 0) 0x7fddb80cd270 con 0x7fddb80b1620 2023-07-14T13:05:45.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.262+0000 7fddb6ffd640 1 -- 172.21.15.5:0/1618342567 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdda0003530 con 0x7fddb80b1620 2023-07-14T13:05:45.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.262+0000 7fddb7fff640 1 -- 172.21.15.5:0/1618342567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddb8160750 msgr2=0x7fddb815c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:45.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.262+0000 7fddb7fff640 1 --2- 172.21.15.5:0/1618342567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddb8160750 0x7fddb815c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.262+0000 7fddb7fff640 1 -- 172.21.15.5:0/1618342567 >> v1:172.21.15.5:6789/0 conn(0x7fddb80b1620 legacy=0x7fddb80ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:45.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.262+0000 7fddb7fff640 1 -- 172.21.15.5:0/1618342567 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb815fc70 con 0x7fddb80cc960 2023-07-14T13:05:45.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.266+0000 7fddb7fff640 1 --2- 172.21.15.5:0/1618342567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddb80cc960 0x7fddb80ccd30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdda80097c0 tx=0x7fdda801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccc3b21d54b9f78e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.266+0000 7fddb6ffd640 1 -- 172.21.15.5:0/1618342567 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda80ab650 con 0x7fddb80cc960 2023-07-14T13:05:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.266+0000 7fddb6ffd640 1 -- 172.21.15.5:0/1618342567 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda80ab7b0 con 0x7fddb80cc960 2023-07-14T13:05:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.266+0000 7fddb6ffd640 1 -- 172.21.15.5:0/1618342567 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda80abb40 con 0x7fddb80cc960 2023-07-14T13:05:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.266+0000 7fddbd512640 1 -- 172.21.15.5:0/1618342567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddb80cc960 msgr2=0x7fddb80ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.266+0000 7fddbd512640 1 --2- 172.21.15.5:0/1618342567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddb80cc960 0x7fddb80ccd30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdda80097c0 tx=0x7fdda801c450 comp rx=0 tx=0).stop 2023-07-14T13:05:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.266+0000 7fddbd512640 1 -- 172.21.15.5:0/1618342567 shutdown_connections 2023-07-14T13:05:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.266+0000 7fddbd512640 1 --2- 172.21.15.5:0/1618342567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddb8160750 0x7fddb815c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.266+0000 7fddbd512640 1 --2- 172.21.15.5:0/1618342567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddb80cc960 0x7fddb80ccd30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.266+0000 7fddbd512640 1 -- 172.21.15.5:0/1618342567 >> 172.21.15.5:0/1618342567 conn(0x7fddb8069f50 msgr2=0x7fddb806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.266+0000 7fddbd512640 1 -- 172.21.15.5:0/1618342567 shutdown_connections 2023-07-14T13:05:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.266+0000 7fddbd512640 1 -- 172.21.15.5:0/1618342567 wait complete. 2023-07-14T13:05:45.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.266+0000 7fddbd512640 1 Processor -- start 2023-07-14T13:05:45.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.266+0000 7fddbd512640 1 -- start start 2023-07-14T13:05:45.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.270+0000 7fddbd512640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddb80b1620 0x7fddb81525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:45.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.270+0000 7fddbd512640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddb80cc960 0x7fddb80c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:45.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.270+0000 7fddbd512640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddb8160750 0x7fddb80c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:45.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.270+0000 7fddbd512640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80c71d0 con 0x7fddb8160750 2023-07-14T13:05:45.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.270+0000 7fddbd512640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80c68a0 con 0x7fddb80cc960 2023-07-14T13:05:45.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.270+0000 7fddbd512640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80c6b80 con 0x7fddb80b1620 2023-07-14T13:05:45.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.270+0000 7fddbcd11640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddb8160750 0x7fddb80c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:45.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.270+0000 7fddbcd11640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddb8160750 0x7fddb80c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33456/0 (socket says 172.21.15.5:33456) 2023-07-14T13:05:45.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.270+0000 7fddbcd11640 1 -- 172.21.15.5:0/1884927393 learned_addr learned my addr 172.21.15.5:0/1884927393 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:45.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.270+0000 7fddb77fe640 1 --2- 172.21.15.5:0/1884927393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddb80cc960 0x7fddb80c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:45.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.270+0000 7fddb7fff640 1 --2- 172.21.15.5:0/1884927393 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddb80b1620 0x7fddb81525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:45.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.270+0000 7fddbcd11640 1 -- 172.21.15.5:0/1884927393 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddb80b1620 msgr2=0x7fddb81525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:45.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.270+0000 7fddbcd11640 1 --2- 172.21.15.5:0/1884927393 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddb80b1620 0x7fddb81525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.270+0000 7fddbcd11640 1 -- 172.21.15.5:0/1884927393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddb80cc960 msgr2=0x7fddb80c7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:45.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.270+0000 7fddbcd11640 1 --2- 172.21.15.5:0/1884927393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddb80cc960 0x7fddb80c7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.270+0000 7fddbcd11640 1 -- 172.21.15.5:0/1884927393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda8009420 con 0x7fddb8160750 2023-07-14T13:05:45.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.270+0000 7fddbcd11640 1 --2- 172.21.15.5:0/1884927393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddb8160750 0x7fddb80c8310 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fddb000efc0 tx=0x7fddb000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:45.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.270+0000 7fddb4ff9640 1 -- 172.21.15.5:0/1884927393 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb0009ba0 con 0x7fddb8160750 2023-07-14T13:05:45.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.270+0000 7fddb4ff9640 1 -- 172.21.15.5:0/1884927393 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb000f040 con 0x7fddb8160750 2023-07-14T13:05:45.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.270+0000 7fddb4ff9640 1 -- 172.21.15.5:0/1884927393 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb00146c0 con 0x7fddb8160750 2023-07-14T13:05:45.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.270+0000 7fddbd512640 1 -- 172.21.15.5:0/1884927393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb80c6e60 con 0x7fddb8160750 2023-07-14T13:05:45.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.270+0000 7fddbd512640 1 -- 172.21.15.5:0/1884927393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb8153f00 con 0x7fddb8160750 2023-07-14T13:05:45.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.270+0000 7fddbd512640 1 -- 172.21.15.5:0/1884927393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb81594c0 con 0x7fddb8160750 2023-07-14T13:05:45.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.274+0000 7fddb4ff9640 1 -- 172.21.15.5:0/1884927393 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 85829+0+0 (secure 0 0 0) 0x7fddb0014820 con 0x7fddb8160750 2023-07-14T13:05:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.274+0000 7fddb4ff9640 1 --2- 172.21.15.5:0/1884927393 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fdda4066430 0x7fdda40688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.274+0000 7fddb4ff9640 1 -- 172.21.15.5:0/1884927393 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7397+0+0 (secure 0 0 0) 0x7fddb00850d0 con 0x7fddb8160750 2023-07-14T13:05:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.274+0000 7fddb7fff640 1 -- 172.21.15.5:0/1884927393 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fdda4066430 msgr2=0x7fdda40688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/2192122532 2023-07-14T13:05:45.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.274+0000 7fddb7fff640 1 --2- 172.21.15.5:0/1884927393 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fdda4066430 0x7fdda40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:05:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.278+0000 7fddb4ff9640 1 -- 172.21.15.5:0/1884927393 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fddb81594c0 con 0x7fddb8160750 2023-07-14T13:05:45.378 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:05:45.346+0000 7f67f5d5a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:05:45.466 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:05:45.434+0000 7f67f5d5a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:05:45.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.434+0000 7fddbd512640 1 -- 172.21.15.5:0/1884927393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fddb81594c0 con 0x7fddb8160750 2023-07-14T13:05:45.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.434+0000 7fddb4ff9640 1 -- 172.21.15.5:0/1884927393 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7fddb81594c0 con 0x7fddb8160750 2023-07-14T13:05:45.467 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:05:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.438+0000 7fddbd512640 1 -- 172.21.15.5:0/1884927393 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fdda4066430 msgr2=0x7fdda40688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:05:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.438+0000 7fddbd512640 1 --2- 172.21.15.5:0/1884927393 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fdda4066430 0x7fdda40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.438+0000 7fddbd512640 1 -- 172.21.15.5:0/1884927393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddb8160750 msgr2=0x7fddb80c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.438+0000 7fddbd512640 1 --2- 172.21.15.5:0/1884927393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddb8160750 0x7fddb80c8310 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fddb000efc0 tx=0x7fddb000c490 comp rx=0 tx=0).stop 2023-07-14T13:05:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.438+0000 7fddbd512640 1 -- 172.21.15.5:0/1884927393 shutdown_connections 2023-07-14T13:05:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.438+0000 7fddbd512640 1 --2- 172.21.15.5:0/1884927393 >> [v2:172.21.15.154:6832/2192122532,v1:172.21.15.154:6833/2192122532] conn(0x7fdda4066430 0x7fdda40688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.438+0000 7fddbd512640 1 --2- 172.21.15.5:0/1884927393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fddb8160750 0x7fddb80c8310 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.438+0000 7fddbd512640 1 --2- 172.21.15.5:0/1884927393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddb80cc960 0x7fddb80c7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.438+0000 7fddbd512640 1 --2- 172.21.15.5:0/1884927393 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddb80b1620 0x7fddb81525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.438+0000 7fddbd512640 1 -- 172.21.15.5:0/1884927393 >> 172.21.15.5:0/1884927393 conn(0x7fddb8069f50 msgr2=0x7fddb8158390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:45.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.438+0000 7fddbd512640 1 -- 172.21.15.5:0/1884927393 shutdown_connections 2023-07-14T13:05:45.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.438+0000 7fddbd512640 1 -- 172.21.15.5:0/1884927393 wait complete. 2023-07-14T13:05:45.474 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:45.445+0000 7ff6e5a2c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:05:45.489 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:05:45.534 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:45.505+0000 7ff6e5a2c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:05:45.620 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:45.593+0000 7ff66db8a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:05:45.621 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:45.593+0000 7ff66db8a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:05:45.621 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:45.593+0000 7ff66db8a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:05:45.621 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:45.593+0000 7ff66db8a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:05:45.621 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:45.593+0000 7ff66db8a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:05:45.622 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:45.593+0000 7ff67038f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:05:45.622 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:45.593+0000 7ff67038f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:05:45.622 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:45.593+0000 7ff67038f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:05:45.622 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:45.593+0000 7ff67038f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:05:45.622 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:05:45.593+0000 7ff67038f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:05:45.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.622+0000 7fdba0893640 1 Processor -- start 2023-07-14T13:05:45.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.622+0000 7fdba0893640 1 -- start start 2023-07-14T13:05:45.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.626+0000 7fdba0893640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb9c15bde0 0x7fdb9c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:45.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.626+0000 7fdba0893640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdb9c0d2fc0 0x7fdb9c0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:45.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.626+0000 7fdba0893640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb9c0b04c0 con 0x7fdb9c0d2300 2023-07-14T13:05:45.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.626+0000 7fdba0893640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb9c15c1b0 con 0x7fdb9c0d2fc0 2023-07-14T13:05:45.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.626+0000 7fdba0893640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c0d0aa0 con 0x7fdb9c15bde0 2023-07-14T13:05:45.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.626+0000 7fdb99d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdb9c0d2fc0 0x7fdb9c0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:45.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.626+0000 7fdb99d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdb9c0d2fc0 0x7fdb9c0b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33468/0 (socket says 172.21.15.5:33468) 2023-07-14T13:05:45.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.626+0000 7fdb99d9b640 1 -- 172.21.15.5:0/836977516 learned_addr learned my addr 172.21.15.5:0/836977516 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:45.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.626+0000 7fdb9a59c640 1 --2- 172.21.15.5:0/836977516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb9c15bde0 0x7fdb9c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:45.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.626+0000 7fdb99d9b640 1 -- 172.21.15.5:0/836977516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb9c15bde0 msgr2=0x7fdb9c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:45.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.626+0000 7fdb99d9b640 1 --2- 172.21.15.5:0/836977516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb9c15bde0 0x7fdb9c0d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.626+0000 7fdb99d9b640 1 -- 172.21.15.5:0/836977516 >> v1:172.21.15.5:6789/0 conn(0x7fdb9c0d2300 legacy=0x7fdb9c0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:45.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.626+0000 7fdb99d9b640 1 -- 172.21.15.5:0/836977516 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c0afb90 con 0x7fdb9c0d2fc0 2023-07-14T13:05:45.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.626+0000 7fdb9a59c640 1 --2- 172.21.15.5:0/836977516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb9c15bde0 0x7fdb9c0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:05:45.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.626+0000 7fdb99d9b640 1 --2- 172.21.15.5:0/836977516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb9c0d2fc0 0x7fdb9c0b0950 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fdb90009870 tx=0x7fdb9001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15bc04567e91dc73 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:45.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.630+0000 7fdb9959a640 1 -- 172.21.15.5:0/836977516 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb900a9400 con 0x7fdb9c0d2fc0 2023-07-14T13:05:45.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.630+0000 7fdb9959a640 1 -- 172.21.15.5:0/836977516 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb900a9560 con 0x7fdb9c0d2fc0 2023-07-14T13:05:45.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.630+0000 7fdb9959a640 1 -- 172.21.15.5:0/836977516 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb900a98f0 con 0x7fdb9c0d2fc0 2023-07-14T13:05:45.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.630+0000 7fdba0893640 1 -- 172.21.15.5:0/836977516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb9c0d2fc0 msgr2=0x7fdb9c0b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:45.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.630+0000 7fdba0893640 1 --2- 172.21.15.5:0/836977516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb9c0d2fc0 0x7fdb9c0b0950 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fdb90009870 tx=0x7fdb9001c540 comp rx=0 tx=0).stop 2023-07-14T13:05:45.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.630+0000 7fdba0893640 1 -- 172.21.15.5:0/836977516 shutdown_connections 2023-07-14T13:05:45.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.630+0000 7fdba0893640 1 --2- 172.21.15.5:0/836977516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb9c0d2fc0 0x7fdb9c0b0950 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.630+0000 7fdba0893640 1 --2- 172.21.15.5:0/836977516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb9c15bde0 0x7fdb9c0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.630+0000 7fdba0893640 1 -- 172.21.15.5:0/836977516 >> 172.21.15.5:0/836977516 conn(0x7fdb9c0659d0 msgr2=0x7fdb9c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:45.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.630+0000 7fdba0893640 1 -- 172.21.15.5:0/836977516 shutdown_connections 2023-07-14T13:05:45.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.630+0000 7fdba0893640 1 -- 172.21.15.5:0/836977516 wait complete. 2023-07-14T13:05:45.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.630+0000 7fdba0893640 1 Processor -- start 2023-07-14T13:05:45.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.630+0000 7fdba0893640 1 -- start start 2023-07-14T13:05:45.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.634+0000 7fdba0893640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb9c0d2300 0x7fdb9c0c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:45.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.634+0000 7fdba0893640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb9c0d2fc0 0x7fdb9c15ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:45.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.634+0000 7fdba0893640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb9c15bde0 0x7fdb9c150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:45.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.634+0000 7fdba0893640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c0c5ea0 con 0x7fdb9c0d2fc0 2023-07-14T13:05:45.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.634+0000 7fdba0893640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c15f190 con 0x7fdb9c0d2300 2023-07-14T13:05:45.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.634+0000 7fdba0893640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c0c87e0 con 0x7fdb9c15bde0 2023-07-14T13:05:45.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.634+0000 7fdb99d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb9c0d2fc0 0x7fdb9c15ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:45.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.634+0000 7fdb99d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb9c0d2fc0 0x7fdb9c15ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33484/0 (socket says 172.21.15.5:33484) 2023-07-14T13:05:45.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.634+0000 7fdb99d9b640 1 -- 172.21.15.5:0/1391026722 learned_addr learned my addr 172.21.15.5:0/1391026722 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:45.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.634+0000 7fdb9ad9d640 1 --2- 172.21.15.5:0/1391026722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb9c15bde0 0x7fdb9c150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:45.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.634+0000 7fdb9a59c640 1 --2- 172.21.15.5:0/1391026722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb9c0d2300 0x7fdb9c0c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:45.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.634+0000 7fdb99d9b640 1 -- 172.21.15.5:0/1391026722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb9c15bde0 msgr2=0x7fdb9c150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:45.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.634+0000 7fdb99d9b640 1 --2- 172.21.15.5:0/1391026722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb9c15bde0 0x7fdb9c150950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.634+0000 7fdb99d9b640 1 -- 172.21.15.5:0/1391026722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb9c0d2300 msgr2=0x7fdb9c0c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:45.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.634+0000 7fdb99d9b640 1 --2- 172.21.15.5:0/1391026722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb9c0d2300 0x7fdb9c0c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.634+0000 7fdb99d9b640 1 -- 172.21.15.5:0/1391026722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb900094d0 con 0x7fdb9c0d2fc0 2023-07-14T13:05:45.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.634+0000 7fdb99d9b640 1 --2- 172.21.15.5:0/1391026722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb9c0d2fc0 0x7fdb9c15ec50 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fdb9001a170 tx=0x7fdb9001ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:45.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.634+0000 7fdb8affd640 1 -- 172.21.15.5:0/1391026722 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb900a9400 con 0x7fdb9c0d2fc0 2023-07-14T13:05:45.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.634+0000 7fdb8affd640 1 -- 172.21.15.5:0/1391026722 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb900b1800 con 0x7fdb9c0d2fc0 2023-07-14T13:05:45.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.634+0000 7fdb8affd640 1 -- 172.21.15.5:0/1391026722 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb900b1b70 con 0x7fdb9c0d2fc0 2023-07-14T13:05:45.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.634+0000 7fdba0893640 1 -- 172.21.15.5:0/1391026722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb9c0c8ac0 con 0x7fdb9c0d2fc0 2023-07-14T13:05:45.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.634+0000 7fdba0893640 1 -- 172.21.15.5:0/1391026722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb9c0c63d0 con 0x7fdb9c0d2fc0 2023-07-14T13:05:45.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.634+0000 7fdba0893640 1 -- 172.21.15.5:0/1391026722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb9c0c65c0 con 0x7fdb9c0d2fc0 2023-07-14T13:05:45.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.634+0000 7fdb8affd640 1 -- 172.21.15.5:0/1391026722 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fdb900ba3a0 con 0x7fdb9c0d2fc0 2023-07-14T13:05:45.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.638+0000 7fdb8affd640 1 -- 172.21.15.5:0/1391026722 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7640+0+0 (secure 0 0 0) 0x7fdb9011e0a0 con 0x7fdb9c0d2fc0 2023-07-14T13:05:45.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.642+0000 7fdb8affd640 1 -- 172.21.15.5:0/1391026722 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fdb900eb510 con 0x7fdb9c0d2fc0 2023-07-14T13:05:45.780 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:05:45.750+0000 7f67f5d5a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:05:45.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.802+0000 7fdba0893640 1 -- 172.21.15.5:0/1391026722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdb9c0c8cb0 con 0x7fdb9c0d2fc0 2023-07-14T13:05:45.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.802+0000 7fdb8affd640 1 -- 172.21.15.5:0/1391026722 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v53) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdb900a6030 con 0x7fdb9c0d2fc0 2023-07-14T13:05:45.834 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:05:45.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.802+0000 7fdba0893640 1 -- 172.21.15.5:0/1391026722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb9c0d2fc0 msgr2=0x7fdb9c15ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:45.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.802+0000 7fdba0893640 1 --2- 172.21.15.5:0/1391026722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb9c0d2fc0 0x7fdb9c15ec50 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fdb9001a170 tx=0x7fdb9001ad80 comp rx=0 tx=0).stop 2023-07-14T13:05:45.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.802+0000 7fdba0893640 1 -- 172.21.15.5:0/1391026722 shutdown_connections 2023-07-14T13:05:45.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.802+0000 7fdba0893640 1 --2- 172.21.15.5:0/1391026722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb9c15bde0 0x7fdb9c150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.802+0000 7fdba0893640 1 --2- 172.21.15.5:0/1391026722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb9c0d2fc0 0x7fdb9c15ec50 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.802+0000 7fdba0893640 1 --2- 172.21.15.5:0/1391026722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb9c0d2300 0x7fdb9c0c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.802+0000 7fdba0893640 1 -- 172.21.15.5:0/1391026722 >> 172.21.15.5:0/1391026722 conn(0x7fdb9c0659d0 msgr2=0x7fdb9c0b71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:45.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.806+0000 7fdba0893640 1 -- 172.21.15.5:0/1391026722 shutdown_connections 2023-07-14T13:05:45.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.806+0000 7fdba0893640 1 -- 172.21.15.5:0/1391026722 wait complete. 2023-07-14T13:05:45.845 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:05:45.814+0000 7f67f5d5a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:05:45.855 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T13:05:46.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.970+0000 7f925abad640 1 Processor -- start 2023-07-14T13:05:46.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.970+0000 7f925abad640 1 -- start start 2023-07-14T13:05:46.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.970+0000 7f925abad640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f925406a540 0x7f925406a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:46.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.970+0000 7f925abad640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f92540cf2e0 0x7f92540cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:46.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.970+0000 7f925abad640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92540cb7a0 con 0x7f92540cc9c0 2023-07-14T13:05:46.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.970+0000 7f925abad640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92540d0920 con 0x7f92540cf2e0 2023-07-14T13:05:46.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.970+0000 7f925abad640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f925415bfd0 con 0x7f925406a540 2023-07-14T13:05:46.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.970+0000 7f9253fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f92540cf2e0 0x7f92540cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:46.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.970+0000 7f9253fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f92540cf2e0 0x7f92540cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33494/0 (socket says 172.21.15.5:33494) 2023-07-14T13:05:46.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.970+0000 7f9253fff640 1 -- 172.21.15.5:0/1197376843 learned_addr learned my addr 172.21.15.5:0/1197376843 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:46.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.974+0000 7f9258949640 1 --2- 172.21.15.5:0/1197376843 >> v2:172.21.15.154:3300/0 conn(0x7f925406a540 0x7f925406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:46.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.974+0000 7f9253fff640 1 -- 172.21.15.5:0/1197376843 >> v2:172.21.15.154:3300/0 conn(0x7f925406a540 msgr2=0x7f925406a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:46.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.974+0000 7f9253fff640 1 --2- 172.21.15.5:0/1197376843 >> v2:172.21.15.154:3300/0 conn(0x7f925406a540 0x7f925406a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:46.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.974+0000 7f9253fff640 1 -- 172.21.15.5:0/1197376843 >> v1:172.21.15.154:6789/0 conn(0x7f92540cc9c0 legacy=0x7f92540cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:46.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.974+0000 7f9253fff640 1 -- 172.21.15.5:0/1197376843 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925406ae50 con 0x7f92540cf2e0 2023-07-14T13:05:46.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.974+0000 7f9253fff640 1 --2- 172.21.15.5:0/1197376843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92540cf2e0 0x7f92540cf710 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9240009870 tx=0x7f924001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d049faba113af8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:46.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.974+0000 7f92537fe640 1 -- 172.21.15.5:0/1197376843 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92400aa430 con 0x7f92540cf2e0 2023-07-14T13:05:46.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.974+0000 7f92537fe640 1 -- 172.21.15.5:0/1197376843 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92400aa590 con 0x7f92540cf2e0 2023-07-14T13:05:46.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.974+0000 7f92537fe640 1 -- 172.21.15.5:0/1197376843 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92400aa920 con 0x7f92540cf2e0 2023-07-14T13:05:46.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.974+0000 7f925abad640 1 -- 172.21.15.5:0/1197376843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92540cf2e0 msgr2=0x7f92540cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:46.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.974+0000 7f925abad640 1 --2- 172.21.15.5:0/1197376843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92540cf2e0 0x7f92540cf710 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9240009870 tx=0x7f924001c4d0 comp rx=0 tx=0).stop 2023-07-14T13:05:46.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.978+0000 7f925abad640 1 -- 172.21.15.5:0/1197376843 shutdown_connections 2023-07-14T13:05:46.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.978+0000 7f925abad640 1 --2- 172.21.15.5:0/1197376843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92540cf2e0 0x7f92540cf710 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:46.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.978+0000 7f925abad640 1 --2- 172.21.15.5:0/1197376843 >> v2:172.21.15.154:3300/0 conn(0x7f925406a540 0x7f925406a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:46.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.978+0000 7f925abad640 1 -- 172.21.15.5:0/1197376843 >> 172.21.15.5:0/1197376843 conn(0x7f9254099490 msgr2=0x7f9254089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:46.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.978+0000 7f925abad640 1 -- 172.21.15.5:0/1197376843 shutdown_connections 2023-07-14T13:05:46.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.978+0000 7f925abad640 1 -- 172.21.15.5:0/1197376843 wait complete. 2023-07-14T13:05:46.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.978+0000 7f925abad640 1 Processor -- start 2023-07-14T13:05:46.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.978+0000 7f925abad640 1 -- start start 2023-07-14T13:05:46.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.978+0000 7f925abad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f925406a540 0x7f925415c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:46.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.978+0000 7f925abad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92540cc9c0 0x7f925414ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:46.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.978+0000 7f925abad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f92540cf2e0 0x7f92540ad460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:46.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.978+0000 7f925abad640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9254159770 con 0x7f925406a540 2023-07-14T13:05:46.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.978+0000 7f925abad640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92541533a0 con 0x7f92540cc9c0 2023-07-14T13:05:46.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.978+0000 7f925abad640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9254153640 con 0x7f92540cf2e0 2023-07-14T13:05:46.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.978+0000 7f9258949640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f925406a540 0x7f925415c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:46.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.978+0000 7f9258949640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f925406a540 0x7f925415c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33508/0 (socket says 172.21.15.5:33508) 2023-07-14T13:05:46.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.978+0000 7f9258949640 1 -- 172.21.15.5:0/3672744190 learned_addr learned my addr 172.21.15.5:0/3672744190 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:46.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.978+0000 7f9253fff640 1 --2- 172.21.15.5:0/3672744190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92540cc9c0 0x7f925414ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:46.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.978+0000 7f925914a640 1 --2- 172.21.15.5:0/3672744190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f92540cf2e0 0x7f92540ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:46.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.978+0000 7f9258949640 1 -- 172.21.15.5:0/3672744190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f92540cf2e0 msgr2=0x7f92540ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:46.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.978+0000 7f9258949640 1 --2- 172.21.15.5:0/3672744190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f92540cf2e0 0x7f92540ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:46.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.978+0000 7f9258949640 1 -- 172.21.15.5:0/3672744190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92540cc9c0 msgr2=0x7f925414ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:46.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.978+0000 7f9258949640 1 --2- 172.21.15.5:0/3672744190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92540cc9c0 0x7f925414ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:46.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.978+0000 7f9258949640 1 -- 172.21.15.5:0/3672744190 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92400094d0 con 0x7f925406a540 2023-07-14T13:05:46.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.982+0000 7f9258949640 1 --2- 172.21.15.5:0/3672744190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f925406a540 0x7f925415c1a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f924800d5f0 tx=0x7f924800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:46.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.982+0000 7f92517fa640 1 -- 172.21.15.5:0/3672744190 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92480125f0 con 0x7f925406a540 2023-07-14T13:05:46.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.982+0000 7f92517fa640 1 -- 172.21.15.5:0/3672744190 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9248012750 con 0x7f925406a540 2023-07-14T13:05:46.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.982+0000 7f92517fa640 1 -- 172.21.15.5:0/3672744190 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9248012ae0 con 0x7f925406a540 2023-07-14T13:05:46.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.982+0000 7f925abad640 1 -- 172.21.15.5:0/3672744190 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9254153920 con 0x7f925406a540 2023-07-14T13:05:46.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.982+0000 7f925abad640 1 -- 172.21.15.5:0/3672744190 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f925414f450 con 0x7f925406a540 2023-07-14T13:05:46.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.982+0000 7f925abad640 1 -- 172.21.15.5:0/3672744190 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92540678d0 con 0x7f925406a540 2023-07-14T13:05:46.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.982+0000 7f92517fa640 1 -- 172.21.15.5:0/3672744190 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f9248012c40 con 0x7f925406a540 2023-07-14T13:05:46.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.982+0000 7f92517fa640 1 -- 172.21.15.5:0/3672744190 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7640+0+0 (secure 0 0 0) 0x7f9248084290 con 0x7f925406a540 2023-07-14T13:05:46.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:45.986+0000 7f92517fa640 1 -- 172.21.15.5:0/3672744190 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f92480514f0 con 0x7f925406a540 2023-07-14T13:05:46.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.142+0000 7f925abad640 1 -- 172.21.15.5:0/3672744190 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f92540ce020 con 0x7f925406a540 2023-07-14T13:05:46.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.142+0000 7f92517fa640 1 -- 172.21.15.5:0/3672744190 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9248007380 con 0x7f925406a540 2023-07-14T13:05:46.177 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T13:05:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.146+0000 7f925abad640 1 -- 172.21.15.5:0/3672744190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f925406a540 msgr2=0x7f925415c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.146+0000 7f925abad640 1 --2- 172.21.15.5:0/3672744190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f925406a540 0x7f925415c1a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f924800d5f0 tx=0x7f924800dab0 comp rx=0 tx=0).stop 2023-07-14T13:05:46.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.146+0000 7f925abad640 1 -- 172.21.15.5:0/3672744190 shutdown_connections 2023-07-14T13:05:46.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.146+0000 7f925abad640 1 --2- 172.21.15.5:0/3672744190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f92540cf2e0 0x7f92540ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:46.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.146+0000 7f925abad640 1 --2- 172.21.15.5:0/3672744190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92540cc9c0 0x7f925414ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:46.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.146+0000 7f925abad640 1 --2- 172.21.15.5:0/3672744190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f925406a540 0x7f925415c1a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.146+0000 7f925abad640 1 -- 172.21.15.5:0/3672744190 >> 172.21.15.5:0/3672744190 conn(0x7f9254099490 msgr2=0x7f92540accf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.146+0000 7f925abad640 1 -- 172.21.15.5:0/3672744190 shutdown_connections 2023-07-14T13:05:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.146+0000 7f925abad640 1 -- 172.21.15.5:0/3672744190 wait complete. 2023-07-14T13:05:46.196 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T13:05:46.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.310+0000 7f61d4782640 1 Processor -- start 2023-07-14T13:05:46.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.310+0000 7f61d4782640 1 -- start start 2023-07-14T13:05:46.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.314+0000 7f61d4782640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61cc0aeb40 0x7f61cc15cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:46.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.314+0000 7f61d4782640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61cc159440 0x7f61cc0c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:46.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.314+0000 7f61d4782640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61cc1532b0 con 0x7f61cc0aef10 2023-07-14T13:05:46.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.314+0000 7f61d4782640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61cc0ca6f0 con 0x7f61cc0aeb40 2023-07-14T13:05:46.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.314+0000 7f61d4782640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc1599d0 con 0x7f61cc159440 2023-07-14T13:05:46.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.314+0000 7f61d1d1d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f61cc0aef10 0x7f61cc158d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43854/0 (socket says 172.21.15.5:43854) 2023-07-14T13:05:46.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.314+0000 7f61d1d1d640 1 -- 172.21.15.5:0/1362804729 learned_addr learned my addr 172.21.15.5:0/1362804729 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:46.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.314+0000 7f61d251e640 1 --2- 172.21.15.5:0/1362804729 >> v2:172.21.15.154:3300/0 conn(0x7f61cc0aeb40 0x7f61cc15cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:46.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.314+0000 7f61d2d1f640 1 --2- 172.21.15.5:0/1362804729 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61cc159440 0x7f61cc0c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:46.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.314+0000 7f61d151c640 1 -- 172.21.15.5:0/1362804729 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012309037 0 0) 0x7f61cc1532b0 con 0x7f61cc0aef10 2023-07-14T13:05:46.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.314+0000 7f61d151c640 1 -- 172.21.15.5:0/1362804729 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61b8005740 con 0x7f61cc0aef10 2023-07-14T13:05:46.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.314+0000 7f61d251e640 1 -- 172.21.15.5:0/1362804729 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61cc159440 msgr2=0x7f61cc0c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:46.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.314+0000 7f61d251e640 1 --2- 172.21.15.5:0/1362804729 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61cc159440 0x7f61cc0c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:46.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.314+0000 7f61d251e640 1 -- 172.21.15.5:0/1362804729 >> v1:172.21.15.5:6789/0 conn(0x7f61cc0aef10 legacy=0x7f61cc158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:46.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.314+0000 7f61d251e640 1 -- 172.21.15.5:0/1362804729 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc159cb0 con 0x7f61cc0aeb40 2023-07-14T13:05:46.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.318+0000 7f61d251e640 1 --2- 172.21.15.5:0/1362804729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61cc0aeb40 0x7f61cc15cef0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f61c80097c0 tx=0x7f61c801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=546ebf8994081773 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:46.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.318+0000 7f61d151c640 1 -- 172.21.15.5:0/1362804729 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c80ac620 con 0x7f61cc0aeb40 2023-07-14T13:05:46.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.318+0000 7f61d151c640 1 -- 172.21.15.5:0/1362804729 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c80ac780 con 0x7f61cc0aeb40 2023-07-14T13:05:46.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.318+0000 7f61d151c640 1 -- 172.21.15.5:0/1362804729 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c80acb10 con 0x7f61cc0aeb40 2023-07-14T13:05:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.318+0000 7f61d4782640 1 -- 172.21.15.5:0/1362804729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61cc0aeb40 msgr2=0x7f61cc15cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.318+0000 7f61d4782640 1 --2- 172.21.15.5:0/1362804729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61cc0aeb40 0x7f61cc15cef0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f61c80097c0 tx=0x7f61c801c3c0 comp rx=0 tx=0).stop 2023-07-14T13:05:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.318+0000 7f61d4782640 1 -- 172.21.15.5:0/1362804729 shutdown_connections 2023-07-14T13:05:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.318+0000 7f61d4782640 1 --2- 172.21.15.5:0/1362804729 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61cc159440 0x7f61cc0c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.318+0000 7f61d4782640 1 --2- 172.21.15.5:0/1362804729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61cc0aeb40 0x7f61cc15cef0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.318+0000 7f61d4782640 1 -- 172.21.15.5:0/1362804729 >> 172.21.15.5:0/1362804729 conn(0x7f61cc0cde90 msgr2=0x7f61cc0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.318+0000 7f61d4782640 1 -- 172.21.15.5:0/1362804729 shutdown_connections 2023-07-14T13:05:46.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.318+0000 7f61d4782640 1 -- 172.21.15.5:0/1362804729 wait complete. 2023-07-14T13:05:46.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.318+0000 7f61d4782640 1 Processor -- start 2023-07-14T13:05:46.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.322+0000 7f61d4782640 1 -- start start 2023-07-14T13:05:46.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.322+0000 7f61d4782640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61cc0aeb40 0x7f61cc141400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.322+0000 7f61d4782640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61cc0aef10 0x7f61cc070c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.322+0000 7f61d4782640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61cc159440 0x7f61cc157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.322+0000 7f61d4782640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc1f8570 con 0x7f61cc0aef10 2023-07-14T13:05:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.322+0000 7f61d4782640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc141940 con 0x7f61cc159440 2023-07-14T13:05:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.322+0000 7f61d4782640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc1f78f0 con 0x7f61cc0aeb40 2023-07-14T13:05:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.322+0000 7f61d1d1d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61cc0aef10 0x7f61cc070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:46.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.322+0000 7f61d1d1d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61cc0aef10 0x7f61cc070c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33518/0 (socket says 172.21.15.5:33518) 2023-07-14T13:05:46.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.322+0000 7f61d1d1d640 1 -- 172.21.15.5:0/1310096832 learned_addr learned my addr 172.21.15.5:0/1310096832 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:46.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.322+0000 7f61d251e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61cc0aeb40 0x7f61cc141400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.322+0000 7f61d2d1f640 1 --2- 172.21.15.5:0/1310096832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61cc159440 0x7f61cc157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:46.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.322+0000 7f61d1d1d640 1 -- 172.21.15.5:0/1310096832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61cc0aeb40 msgr2=0x7f61cc141400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:46.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.322+0000 7f61d1d1d640 1 --2- 172.21.15.5:0/1310096832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61cc0aeb40 0x7f61cc141400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:46.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.322+0000 7f61d1d1d640 1 -- 172.21.15.5:0/1310096832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61cc159440 msgr2=0x7f61cc157040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:46.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.322+0000 7f61d1d1d640 1 --2- 172.21.15.5:0/1310096832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61cc159440 0x7f61cc157040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:46.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.322+0000 7f61d1d1d640 1 -- 172.21.15.5:0/1310096832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c8009420 con 0x7f61cc0aef10 2023-07-14T13:05:46.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.322+0000 7f61d1d1d640 1 --2- 172.21.15.5:0/1310096832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61cc0aef10 0x7f61cc070c10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00c4d0 tx=0x7f61bc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:46.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.322+0000 7f61c2ffd640 1 -- 172.21.15.5:0/1310096832 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc005cf0 con 0x7f61cc0aef10 2023-07-14T13:05:46.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.322+0000 7f61c2ffd640 1 -- 172.21.15.5:0/1310096832 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc005e50 con 0x7f61cc0aef10 2023-07-14T13:05:46.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.322+0000 7f61c2ffd640 1 -- 172.21.15.5:0/1310096832 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc007270 con 0x7f61cc0aef10 2023-07-14T13:05:46.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.322+0000 7f61d4782640 1 -- 172.21.15.5:0/1310096832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61cc1f7bd0 con 0x7f61cc0aef10 2023-07-14T13:05:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.322+0000 7f61d4782640 1 -- 172.21.15.5:0/1310096832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61cc1f8190 con 0x7f61cc0aef10 2023-07-14T13:05:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.322+0000 7f61d4782640 1 -- 172.21.15.5:0/1310096832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61cc1f86b0 con 0x7f61cc0aef10 2023-07-14T13:05:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.326+0000 7f61c2ffd640 1 -- 172.21.15.5:0/1310096832 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f61bc0073d0 con 0x7f61cc0aef10 2023-07-14T13:05:46.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.326+0000 7f61c2ffd640 1 -- 172.21.15.5:0/1310096832 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7640+0+0 (secure 0 0 0) 0x7f61bc083470 con 0x7f61cc0aef10 2023-07-14T13:05:46.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.330+0000 7f61c2ffd640 1 -- 172.21.15.5:0/1310096832 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f61bc0506d0 con 0x7f61cc0aef10 2023-07-14T13:05:46.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.482+0000 7f61d4782640 1 -- 172.21.15.5:0/1310096832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f61cc0678d0 con 0x7f61cc0aef10 2023-07-14T13:05:46.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.482+0000 7f61c2ffd640 1 -- 172.21.15.5:0/1310096832 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7f61bc053cf0 con 0x7f61cc0aef10 2023-07-14T13:05:46.514 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T13:05:46.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.486+0000 7f61d4782640 1 -- 172.21.15.5:0/1310096832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61cc0aef10 msgr2=0x7f61cc070c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.486+0000 7f61d4782640 1 --2- 172.21.15.5:0/1310096832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61cc0aef10 0x7f61cc070c10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00c4d0 tx=0x7f61bc00c990 comp rx=0 tx=0).stop 2023-07-14T13:05:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.486+0000 7f61d4782640 1 -- 172.21.15.5:0/1310096832 shutdown_connections 2023-07-14T13:05:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.486+0000 7f61d4782640 1 --2- 172.21.15.5:0/1310096832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61cc159440 0x7f61cc157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.486+0000 7f61d4782640 1 --2- 172.21.15.5:0/1310096832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61cc0aef10 0x7f61cc070c10 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.486+0000 7f61d4782640 1 --2- 172.21.15.5:0/1310096832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61cc0aeb40 0x7f61cc141400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.486+0000 7f61d4782640 1 -- 172.21.15.5:0/1310096832 >> 172.21.15.5:0/1310096832 conn(0x7f61cc0cde90 msgr2=0x7f61cc0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:46.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.486+0000 7f61d4782640 1 -- 172.21.15.5:0/1310096832 shutdown_connections 2023-07-14T13:05:46.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.486+0000 7f61d4782640 1 -- 172.21.15.5:0/1310096832 wait complete. 2023-07-14T13:05:46.534 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:05:46.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.650+0000 7f117799f640 1 Processor -- start 2023-07-14T13:05:46.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.650+0000 7f117799f640 1 -- start start 2023-07-14T13:05:46.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.650+0000 7f117799f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f11700cb760 0x7f1170166860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:46.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.650+0000 7f117799f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11700cfaf0 con 0x7f11700cdcd0 2023-07-14T13:05:46.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.650+0000 7f117799f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11700cfdd0 con 0x7f117006a540 2023-07-14T13:05:46.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.650+0000 7f117799f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11700cef10 con 0x7f11700cb760 2023-07-14T13:05:46.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.654+0000 7f1174f3a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f11700cdcd0 0x7f11700cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43860/0 (socket says 172.21.15.5:43860) 2023-07-14T13:05:46.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.654+0000 7f1174f3a640 1 -- 172.21.15.5:0/1369332926 learned_addr learned my addr 172.21.15.5:0/1369332926 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:46.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.654+0000 7f1175f3c640 1 --2- 172.21.15.5:0/1369332926 >> v2:172.21.15.5:3300/0 conn(0x7f11700cb760 0x7f1170166860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:46.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.654+0000 7f1175f3c640 1 -- 172.21.15.5:0/1369332926 >> v1:172.21.15.154:6789/0 conn(0x7f117006a540 legacy=0x7f117006a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:46.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.654+0000 7f1175f3c640 1 -- 172.21.15.5:0/1369332926 >> v1:172.21.15.5:6789/0 conn(0x7f11700cdcd0 legacy=0x7f11700cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:46.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.654+0000 7f1167fff640 1 -- 172.21.15.5:0/1369332926 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3381668031 0 0) 0x7f11700cfaf0 con 0x7f11700cdcd0 2023-07-14T13:05:46.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.654+0000 7f1175f3c640 1 -- 172.21.15.5:0/1369332926 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11700d00b0 con 0x7f11700cb760 2023-07-14T13:05:46.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.654+0000 7f1175f3c640 1 --2- 172.21.15.5:0/1369332926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11700cb760 0x7f1170166860 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1168009d90 tx=0x7f116801f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e6d76dc2fa5272 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:46.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.654+0000 7f1167fff640 1 -- 172.21.15.5:0/1369332926 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11680af600 con 0x7f11700cb760 2023-07-14T13:05:46.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.654+0000 7f1167fff640 1 -- 172.21.15.5:0/1369332926 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11680ab050 con 0x7f11700cb760 2023-07-14T13:05:46.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.654+0000 7f1167fff640 1 -- 172.21.15.5:0/1369332926 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11680af980 con 0x7f11700cb760 2023-07-14T13:05:46.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.658+0000 7f117799f640 1 -- 172.21.15.5:0/1369332926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11700cb760 msgr2=0x7f1170166860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:46.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.658+0000 7f117799f640 1 --2- 172.21.15.5:0/1369332926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11700cb760 0x7f1170166860 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1168009d90 tx=0x7f116801f130 comp rx=0 tx=0).stop 2023-07-14T13:05:46.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.658+0000 7f117799f640 1 -- 172.21.15.5:0/1369332926 shutdown_connections 2023-07-14T13:05:46.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.658+0000 7f117799f640 1 --2- 172.21.15.5:0/1369332926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11700cb760 0x7f1170166860 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:46.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.658+0000 7f117799f640 1 -- 172.21.15.5:0/1369332926 >> 172.21.15.5:0/1369332926 conn(0x7f1170099490 msgr2=0x7f1170089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:46.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.658+0000 7f117799f640 1 -- 172.21.15.5:0/1369332926 shutdown_connections 2023-07-14T13:05:46.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.658+0000 7f117799f640 1 -- 172.21.15.5:0/1369332926 wait complete. 2023-07-14T13:05:46.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.658+0000 7f117799f640 1 Processor -- start 2023-07-14T13:05:46.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.658+0000 7f117799f640 1 -- start start 2023-07-14T13:05:46.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.658+0000 7f117799f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f117006a540 0x7f11701517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:46.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.658+0000 7f117799f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11700cb760 0x7f117015c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:46.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.658+0000 7f117799f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11700cdcd0 0x7f1170159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:46.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.658+0000 7f117799f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117015d980 con 0x7f11700cdcd0 2023-07-14T13:05:46.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.658+0000 7f117799f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117015cd70 con 0x7f117006a540 2023-07-14T13:05:46.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.658+0000 7f117799f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117015d050 con 0x7f11700cb760 2023-07-14T13:05:46.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.658+0000 7f1175f3c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11700cdcd0 0x7f1170159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:46.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.658+0000 7f1175f3c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11700cdcd0 0x7f1170159a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33532/0 (socket says 172.21.15.5:33532) 2023-07-14T13:05:46.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.658+0000 7f1175f3c640 1 -- 172.21.15.5:0/2547869889 learned_addr learned my addr 172.21.15.5:0/2547869889 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:46.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.658+0000 7f117573b640 1 --2- 172.21.15.5:0/2547869889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f117006a540 0x7f11701517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:46.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.658+0000 7f1174f3a640 1 --2- 172.21.15.5:0/2547869889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11700cb760 0x7f117015c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:46.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.662+0000 7f1175f3c640 1 -- 172.21.15.5:0/2547869889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11700cb760 msgr2=0x7f117015c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:46.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.662+0000 7f1175f3c640 1 --2- 172.21.15.5:0/2547869889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11700cb760 0x7f117015c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:46.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.662+0000 7f1175f3c640 1 -- 172.21.15.5:0/2547869889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f117006a540 msgr2=0x7f11701517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:46.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.662+0000 7f1175f3c640 1 --2- 172.21.15.5:0/2547869889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f117006a540 0x7f11701517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:46.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.662+0000 7f1175f3c640 1 -- 172.21.15.5:0/2547869889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1168009a70 con 0x7f11700cdcd0 2023-07-14T13:05:46.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.662+0000 7f1175f3c640 1 --2- 172.21.15.5:0/2547869889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11700cdcd0 0x7f1170159a20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f116801cd60 tx=0x7f116801bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:46.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.662+0000 7f1165ffb640 1 -- 172.21.15.5:0/2547869889 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1168003ba0 con 0x7f11700cdcd0 2023-07-14T13:05:46.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.662+0000 7f1165ffb640 1 -- 172.21.15.5:0/2547869889 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1168003d00 con 0x7f11700cdcd0 2023-07-14T13:05:46.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.662+0000 7f117799f640 1 -- 172.21.15.5:0/2547869889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f117015d330 con 0x7f11700cdcd0 2023-07-14T13:05:46.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.662+0000 7f1165ffb640 1 -- 172.21.15.5:0/2547869889 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1168004230 con 0x7f11700cdcd0 2023-07-14T13:05:46.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.662+0000 7f117799f640 1 -- 172.21.15.5:0/2547869889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11700c6880 con 0x7f11700cdcd0 2023-07-14T13:05:46.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.662+0000 7f117799f640 1 -- 172.21.15.5:0/2547869889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11700678d0 con 0x7f11700cdcd0 2023-07-14T13:05:46.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.662+0000 7f1165ffb640 1 -- 172.21.15.5:0/2547869889 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f1168004390 con 0x7f11700cdcd0 2023-07-14T13:05:46.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.662+0000 7f1165ffb640 1 --2- 172.21.15.5:0/2547869889 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f11540660d0 0x7f1154068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:46.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.666+0000 7f1165ffb640 1 -- 172.21.15.5:0/2547869889 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7640+0+0 (secure 0 0 0) 0x7f1168122780 con 0x7f11700cdcd0 2023-07-14T13:05:46.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.666+0000 7f117573b640 1 --2- 172.21.15.5:0/2547869889 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f11540660d0 0x7f1154068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:46.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.666+0000 7f117573b640 1 --2- 172.21.15.5:0/2547869889 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f11540660d0 0x7f1154068580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f116c000fc0 tx=0x7f116c009040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:46.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.670+0000 7f1165ffb640 1 -- 172.21.15.5:0/2547869889 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f11680efba0 con 0x7f11700cdcd0 2023-07-14T13:05:46.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.854+0000 7f117799f640 1 -- 172.21.15.5:0/2547869889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1170070f50 con 0x7f11700cdcd0 2023-07-14T13:05:46.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.854+0000 7f1165ffb640 1 -- 172.21.15.5:0/2547869889 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4706 (secure 0 0 0) 0x7f11680c7090 con 0x7f11700cdcd0 2023-07-14T13:05:46.887 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:05:46.887 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1121417572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1121417572},{"type":"v1","addr":"172.21.15.5:6833","nonce":1121417572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/1826988320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1826988320},{"type":"v1","addr":"172.21.15.154:6836","nonce":1826988320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5074,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3683900517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3683900517},{"type":"v1","addr":"172.21.15.154:6837","nonce":3683900517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T12:53:43.186604+0000","modified":"2023-07-14T12:53:46.672007+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5133},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5133":{"gid":5133,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6835/601029596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":601029596},{"type":"v1","addr":"172.21.15.5:6835","nonce":601029596}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-14T13:05:46.887 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 16 2023-07-14T13:05:46.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.858+0000 7f117799f640 1 -- 172.21.15.5:0/2547869889 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f11540660d0 msgr2=0x7f1154068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.858+0000 7f117799f640 1 --2- 172.21.15.5:0/2547869889 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f11540660d0 0x7f1154068580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f116c000fc0 tx=0x7f116c009040 comp rx=0 tx=0).stop 2023-07-14T13:05:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.858+0000 7f117799f640 1 -- 172.21.15.5:0/2547869889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11700cdcd0 msgr2=0x7f1170159a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.858+0000 7f117799f640 1 --2- 172.21.15.5:0/2547869889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11700cdcd0 0x7f1170159a20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f116801cd60 tx=0x7f116801bed0 comp rx=0 tx=0).stop 2023-07-14T13:05:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.858+0000 7f117799f640 1 -- 172.21.15.5:0/2547869889 shutdown_connections 2023-07-14T13:05:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.858+0000 7f117799f640 1 --2- 172.21.15.5:0/2547869889 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f11540660d0 0x7f1154068580 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.858+0000 7f117799f640 1 --2- 172.21.15.5:0/2547869889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11700cdcd0 0x7f1170159a20 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.858+0000 7f117799f640 1 --2- 172.21.15.5:0/2547869889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11700cb760 0x7f117015c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.858+0000 7f117799f640 1 --2- 172.21.15.5:0/2547869889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f117006a540 0x7f11701517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.858+0000 7f117799f640 1 -- 172.21.15.5:0/2547869889 >> 172.21.15.5:0/2547869889 conn(0x7f1170099490 msgr2=0x7f117006d510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.858+0000 7f117799f640 1 -- 172.21.15.5:0/2547869889 shutdown_connections 2023-07-14T13:05:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:46.858+0000 7f117799f640 1 -- 172.21.15.5:0/2547869889 wait complete. 2023-07-14T13:05:46.908 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:05:47.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.022+0000 7f17b779f640 1 Processor -- start 2023-07-14T13:05:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.022+0000 7f17b779f640 1 -- start start 2023-07-14T13:05:47.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.022+0000 7f17b779f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17b00b7c70 0x7f17b00d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:47.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.022+0000 7f17b779f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f17b00d1850 0x7f17b015f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:47.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.022+0000 7f17b779f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f17b00d1300 0x7f17b015fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:47.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.022+0000 7f17b779f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b00d1190 con 0x7f17b00d1300 2023-07-14T13:05:47.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.022+0000 7f17b779f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b0160600 con 0x7f17b00d1850 2023-07-14T13:05:47.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.022+0000 7f17b779f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b01600d0 con 0x7f17b00b7c70 2023-07-14T13:05:47.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.022+0000 7f17b5d3c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f17b00d1300 0x7f17b015fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:47.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.022+0000 7f17b5d3c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f17b00d1300 0x7f17b015fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33538/0 (socket says 172.21.15.5:33538) 2023-07-14T13:05:47.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.022+0000 7f17b5d3c640 1 -- 172.21.15.5:0/2115104831 learned_addr learned my addr 172.21.15.5:0/2115104831 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:47.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.022+0000 7f17b4d3a640 1 --2- 172.21.15.5:0/2115104831 >> v2:172.21.15.154:3300/0 conn(0x7f17b00d1850 0x7f17b015f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:47.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.022+0000 7f17b553b640 1 --2- 172.21.15.5:0/2115104831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17b00b7c70 0x7f17b00d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:47.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.022+0000 7f17b5d3c640 1 -- 172.21.15.5:0/2115104831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17b00b7c70 msgr2=0x7f17b00d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:47.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.022+0000 7f17b5d3c640 1 --2- 172.21.15.5:0/2115104831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17b00b7c70 0x7f17b00d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:47.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.022+0000 7f17b5d3c640 1 -- 172.21.15.5:0/2115104831 >> v2:172.21.15.154:3300/0 conn(0x7f17b00d1850 msgr2=0x7f17b015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.022+0000 7f17b5d3c640 1 --2- 172.21.15.5:0/2115104831 >> v2:172.21.15.154:3300/0 conn(0x7f17b00d1850 0x7f17b015f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.022+0000 7f17b5d3c640 1 -- 172.21.15.5:0/2115104831 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b00ccaf0 con 0x7f17b00d1300 2023-07-14T13:05:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.026+0000 7f17b5d3c640 1 --2- 172.21.15.5:0/2115104831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17b00d1300 0x7f17b015fb90 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f17b0069dc0 tx=0x7f17a801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1ca043dc4c807d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.026+0000 7f17a7fff640 1 -- 172.21.15.5:0/2115104831 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a80a5730 con 0x7f17b00d1300 2023-07-14T13:05:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.026+0000 7f17a7fff640 1 -- 172.21.15.5:0/2115104831 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a80a5890 con 0x7f17b00d1300 2023-07-14T13:05:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.026+0000 7f17a7fff640 1 -- 172.21.15.5:0/2115104831 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a80a5c20 con 0x7f17b00d1300 2023-07-14T13:05:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.026+0000 7f17b779f640 1 -- 172.21.15.5:0/2115104831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17b00d1300 msgr2=0x7f17b015fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.026+0000 7f17b779f640 1 --2- 172.21.15.5:0/2115104831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17b00d1300 0x7f17b015fb90 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f17b0069dc0 tx=0x7f17a801c9a0 comp rx=0 tx=0).stop 2023-07-14T13:05:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.026+0000 7f17b779f640 1 -- 172.21.15.5:0/2115104831 shutdown_connections 2023-07-14T13:05:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.026+0000 7f17b779f640 1 --2- 172.21.15.5:0/2115104831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17b00d1300 0x7f17b015fb90 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:47.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.026+0000 7f17b779f640 1 --2- 172.21.15.5:0/2115104831 >> v2:172.21.15.154:3300/0 conn(0x7f17b00d1850 0x7f17b015f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:47.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.026+0000 7f17b779f640 1 --2- 172.21.15.5:0/2115104831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17b00b7c70 0x7f17b00d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:47.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.026+0000 7f17b779f640 1 -- 172.21.15.5:0/2115104831 >> 172.21.15.5:0/2115104831 conn(0x7f17b00650b0 msgr2=0x7f17b00654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:47.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.026+0000 7f17b779f640 1 -- 172.21.15.5:0/2115104831 shutdown_connections 2023-07-14T13:05:47.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.026+0000 7f17b779f640 1 -- 172.21.15.5:0/2115104831 wait complete. 2023-07-14T13:05:47.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.030+0000 7f17b779f640 1 Processor -- start 2023-07-14T13:05:47.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.030+0000 7f17b779f640 1 -- start start 2023-07-14T13:05:47.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.030+0000 7f17b779f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17b00b7c70 0x7f17b0158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:47.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.030+0000 7f17b779f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17b00d1300 0x7f17b00b2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:47.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.030+0000 7f17b779f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17b00d1850 0x7f17b00b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:47.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.030+0000 7f17b779f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b0158ad0 con 0x7f17b00b7c70 2023-07-14T13:05:47.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.030+0000 7f17b779f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b00c71b0 con 0x7f17b00d1300 2023-07-14T13:05:47.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.030+0000 7f17b779f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b00b25b0 con 0x7f17b00d1850 2023-07-14T13:05:47.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.030+0000 7f17b553b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17b00b7c70 0x7f17b0158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:47.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.030+0000 7f17b553b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17b00b7c70 0x7f17b0158590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33546/0 (socket says 172.21.15.5:33546) 2023-07-14T13:05:47.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.030+0000 7f17b553b640 1 -- 172.21.15.5:0/1558110624 learned_addr learned my addr 172.21.15.5:0/1558110624 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:47.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.030+0000 7f17b4d3a640 1 --2- 172.21.15.5:0/1558110624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17b00d1300 0x7f17b00b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:47.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.030+0000 7f17b553b640 1 -- 172.21.15.5:0/1558110624 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17b00d1850 msgr2=0x7f17b00b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:47.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.030+0000 7f17b553b640 1 --2- 172.21.15.5:0/1558110624 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17b00d1850 0x7f17b00b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:47.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.030+0000 7f17b553b640 1 -- 172.21.15.5:0/1558110624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17b00d1300 msgr2=0x7f17b00b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:47.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.030+0000 7f17b553b640 1 --2- 172.21.15.5:0/1558110624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17b00d1300 0x7f17b00b2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:47.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.030+0000 7f17b553b640 1 -- 172.21.15.5:0/1558110624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a8009b30 con 0x7f17b00b7c70 2023-07-14T13:05:47.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.030+0000 7f17b553b640 1 --2- 172.21.15.5:0/1558110624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17b00b7c70 0x7f17b0158590 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f17ac00e930 tx=0x7f17ac00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:47.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.030+0000 7f17a5ffb640 1 -- 172.21.15.5:0/1558110624 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ac009690 con 0x7f17b00b7c70 2023-07-14T13:05:47.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.030+0000 7f17a5ffb640 1 -- 172.21.15.5:0/1558110624 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ac00ca00 con 0x7f17b00b7c70 2023-07-14T13:05:47.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.030+0000 7f17a5ffb640 1 -- 172.21.15.5:0/1558110624 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ac00cd70 con 0x7f17b00b7c70 2023-07-14T13:05:47.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.030+0000 7f17b779f640 1 -- 172.21.15.5:0/1558110624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b00c5e30 con 0x7f17b00b7c70 2023-07-14T13:05:47.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.030+0000 7f17b779f640 1 -- 172.21.15.5:0/1558110624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b00c63f0 con 0x7f17b00b7c70 2023-07-14T13:05:47.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.034+0000 7f17b779f640 1 -- 172.21.15.5:0/1558110624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b00678d0 con 0x7f17b00b7c70 2023-07-14T13:05:47.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.034+0000 7f17a5ffb640 1 -- 172.21.15.5:0/1558110624 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f17ac013470 con 0x7f17b00b7c70 2023-07-14T13:05:47.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.034+0000 7f17a5ffb640 1 --2- 172.21.15.5:0/1558110624 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f17940660d0 0x7f1794068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:47.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.034+0000 7f17a5ffb640 1 -- 172.21.15.5:0/1558110624 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7640+0+0 (secure 0 0 0) 0x7f17ac084270 con 0x7f17b00b7c70 2023-07-14T13:05:47.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.034+0000 7f17b4d3a640 1 --2- 172.21.15.5:0/1558110624 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f17940660d0 0x7f1794068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:47.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.034+0000 7f17b4d3a640 1 --2- 172.21.15.5:0/1558110624 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f17940660d0 0x7f1794068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f17b015c780 tx=0x7f17a0008040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:47.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.038+0000 7f17a5ffb640 1 -- 172.21.15.5:0/1558110624 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f17ac0513f0 con 0x7f17b00b7c70 2023-07-14T13:05:47.147 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:05:47.152 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:05:47.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.198+0000 7f17b779f640 1 -- 172.21.15.5:0/1558110624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17b00730b0 con 0x7f17b00b7c70 2023-07-14T13:05:47.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.198+0000 7f17a5ffb640 1 -- 172.21.15.5:0/1558110624 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+20638 (secure 0 0 0) 0x7f17ac017090 con 0x7f17b00b7c70 2023-07-14T13:05:47.231 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:05:47.231 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":53,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:05:45.508832+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:53:41.014568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-14T12:53:42.032063+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":53,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2b","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/3808907773":"2023-07-15T13:05:45.508796+0000","172.21.15.154:6833/2192122532":"2023-07-15T13:05:45.508796+0000","172.21.15.154:6832/2736441655":"2023-07-15T12:54:00.161685+0000","172.21.15.154:0/844038179":"2023-07-15T12:54:00.161685+0000","172.21.15.154:0/1533499204":"2023-07-15T12:54:00.161685+0000","172.21.15.154:0/1617499779":"2023-07-15T13:05:45.508796+0000","172.21.15.154:0/3140351861":"2023-07-15T12:54:00.161685+0000","172.21.15.154:0/3341947062":"2023-07-15T12:54:00.161685+0000","172.21.15.154:0/3036549385":"2023-07-15T13:05:45.508796+0000","172.21.15.154:0/512250962":"2023-07-15T13:05:45.508796+0000","172.21.15.154:0/778089833":"2023-07-15T13:05:45.508796+0000","172.21.15.154:6833/2736441655":"2023-07-15T12:54:00.161685+0000","172.21.15.154:0/2751604382":"2023-07-15T13:05:45.508796+0000","172.21.15.154:0/2587551624":"2023-07-15T13:05:45.508796+0000","172.21.15.154:6832/2192122532":"2023-07-15T13:05:45.508796+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1},{"begin":6,"length":1},{"begin":8,"length":1},{"begin":10,"length":1},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":1},{"begin":18,"length":1},{"begin":20,"length":1},{"begin":22,"length":1},{"begin":24,"length":1},{"begin":26,"length":1},{"begin":28,"length":1},{"begin":30,"length":1},{"begin":33,"length":1},{"begin":35,"length":1},{"begin":37,"length":1},{"begin":39,"length":1},{"begin":41,"length":2},{"begin":44,"length":1},{"begin":46,"length":1},{"begin":48,"length":1},{"begin":50,"length":1},{"begin":52,"length":1},{"begin":54,"length":1},{"begin":56,"length":1},{"begin":58,"length":1},{"begin":60,"length":1},{"begin":63,"length":1},{"begin":65,"length":1},{"begin":67,"length":1},{"begin":69,"length":1},{"begin":71,"length":1},{"begin":73,"length":1},{"begin":75,"length":1},{"begin":77,"length":1},{"begin":79,"length":1},{"begin":81,"length":1},{"begin":83,"length":1},{"begin":85,"length":1},{"begin":87,"length":1},{"begin":89,"length":1},{"begin":91,"length":2},{"begin":94,"length":1},{"begin":96,"length":1},{"begin":98,"length":1},{"begin":100,"length":1},{"begin":103,"length":1},{"begin":105,"length":3},{"begin":109,"length":1},{"begin":111,"length":1},{"begin":166,"length":56}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:05:47.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.202+0000 7f17b779f640 1 -- 172.21.15.5:0/1558110624 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f17940660d0 msgr2=0x7f1794068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:47.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.202+0000 7f17b779f640 1 --2- 172.21.15.5:0/1558110624 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f17940660d0 0x7f1794068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f17b015c780 tx=0x7f17a0008040 comp rx=0 tx=0).stop 2023-07-14T13:05:47.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.202+0000 7f17b779f640 1 -- 172.21.15.5:0/1558110624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17b00b7c70 msgr2=0x7f17b0158590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:47.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.202+0000 7f17b779f640 1 --2- 172.21.15.5:0/1558110624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17b00b7c70 0x7f17b0158590 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f17ac00e930 tx=0x7f17ac00edf0 comp rx=0 tx=0).stop 2023-07-14T13:05:47.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.202+0000 7f17b779f640 1 -- 172.21.15.5:0/1558110624 shutdown_connections 2023-07-14T13:05:47.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.202+0000 7f17b779f640 1 --2- 172.21.15.5:0/1558110624 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f17940660d0 0x7f1794068580 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:47.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.202+0000 7f17b779f640 1 --2- 172.21.15.5:0/1558110624 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f17b00d1850 0x7f17b00b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:47.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.202+0000 7f17b779f640 1 --2- 172.21.15.5:0/1558110624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17b00d1300 0x7f17b00b2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:47.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.202+0000 7f17b779f640 1 --2- 172.21.15.5:0/1558110624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17b00b7c70 0x7f17b0158590 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:47.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.202+0000 7f17b779f640 1 -- 172.21.15.5:0/1558110624 >> 172.21.15.5:0/1558110624 conn(0x7f17b00650b0 msgr2=0x7f17b00b5130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:47.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.202+0000 7f17b779f640 1 -- 172.21.15.5:0/1558110624 shutdown_connections 2023-07-14T13:05:47.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.202+0000 7f17b779f640 1 -- 172.21.15.5:0/1558110624 wait complete. 2023-07-14T13:05:47.252 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-14T13:05:47.253 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:05:47.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.410+0000 7f0d7a4d8640 1 Processor -- start 2023-07-14T13:05:47.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.410+0000 7f0d7a4d8640 1 -- start start 2023-07-14T13:05:47.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.410+0000 7f0d7a4d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d7415f970 0x7f0d7415fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:47.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.410+0000 7f0d7a4d8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0d740c8e70 0x7f0d740c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:47.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.414+0000 7f0d7a4d8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d740cb080 con 0x7f0d7415bdf0 2023-07-14T13:05:47.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.414+0000 7f0d7a4d8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d74160300 con 0x7f0d740c8e70 2023-07-14T13:05:47.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.414+0000 7f0d7a4d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d740cb2e0 con 0x7f0d7415f970 2023-07-14T13:05:47.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.414+0000 7f0d78a75640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0d740c8e70 0x7f0d740c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:47.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.414+0000 7f0d78a75640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0d740c8e70 0x7f0d740c92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33558/0 (socket says 172.21.15.5:33558) 2023-07-14T13:05:47.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.414+0000 7f0d78a75640 1 -- 172.21.15.5:0/1024197109 learned_addr learned my addr 172.21.15.5:0/1024197109 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:47.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.414+0000 7f0d737fe640 1 --2- 172.21.15.5:0/1024197109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d7415f970 0x7f0d7415fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:47.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.414+0000 7f0d78a75640 1 -- 172.21.15.5:0/1024197109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d7415f970 msgr2=0x7f0d7415fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:47.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.414+0000 7f0d78a75640 1 --2- 172.21.15.5:0/1024197109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d7415f970 0x7f0d7415fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:47.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.414+0000 7f0d78a75640 1 -- 172.21.15.5:0/1024197109 >> v1:172.21.15.154:6789/0 conn(0x7f0d7415bdf0 legacy=0x7f0d740ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:47.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.414+0000 7f0d78a75640 1 -- 172.21.15.5:0/1024197109 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d740cb5c0 con 0x7f0d740c8e70 2023-07-14T13:05:47.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.414+0000 7f0d78a75640 1 --2- 172.21.15.5:0/1024197109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d740c8e70 0x7f0d740c92f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c009e50 tx=0x7f0d6c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ace817b6c0c9ba server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:47.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.414+0000 7f0d72ffd640 1 -- 172.21.15.5:0/1024197109 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c0a5810 con 0x7f0d740c8e70 2023-07-14T13:05:47.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.414+0000 7f0d72ffd640 1 -- 172.21.15.5:0/1024197109 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6c0a5970 con 0x7f0d740c8e70 2023-07-14T13:05:47.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.414+0000 7f0d72ffd640 1 -- 172.21.15.5:0/1024197109 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c0a5d00 con 0x7f0d740c8e70 2023-07-14T13:05:47.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.418+0000 7f0d7a4d8640 1 -- 172.21.15.5:0/1024197109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d740c8e70 msgr2=0x7f0d740c92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:47.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.418+0000 7f0d7a4d8640 1 --2- 172.21.15.5:0/1024197109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d740c8e70 0x7f0d740c92f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c009e50 tx=0x7f0d6c01c950 comp rx=0 tx=0).stop 2023-07-14T13:05:47.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.418+0000 7f0d7a4d8640 1 -- 172.21.15.5:0/1024197109 shutdown_connections 2023-07-14T13:05:47.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.418+0000 7f0d7a4d8640 1 --2- 172.21.15.5:0/1024197109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d740c8e70 0x7f0d740c92f0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:47.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.418+0000 7f0d7a4d8640 1 --2- 172.21.15.5:0/1024197109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d7415f970 0x7f0d7415fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:47.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.418+0000 7f0d7a4d8640 1 -- 172.21.15.5:0/1024197109 >> 172.21.15.5:0/1024197109 conn(0x7f0d740afcf0 msgr2=0x7f0d740b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:47.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.418+0000 7f0d7a4d8640 1 -- 172.21.15.5:0/1024197109 shutdown_connections 2023-07-14T13:05:47.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.418+0000 7f0d7a4d8640 1 -- 172.21.15.5:0/1024197109 wait complete. 2023-07-14T13:05:47.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.418+0000 7f0d7a4d8640 1 Processor -- start 2023-07-14T13:05:47.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.418+0000 7f0d7a4d8640 1 -- start start 2023-07-14T13:05:47.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.418+0000 7f0d7a4d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d740c8e70 0x7f0d7415ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:47.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.418+0000 7f0d7a4d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d7415bdf0 0x7f0d740b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:47.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.418+0000 7f0d7a4d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d7415f970 0x7f0d740b1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:47.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.418+0000 7f0d7a4d8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d740b2bd0 con 0x7f0d740c8e70 2023-07-14T13:05:47.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.418+0000 7f0d7a4d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d740b2ff0 con 0x7f0d7415f970 2023-07-14T13:05:47.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.418+0000 7f0d7a4d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d740b1f50 con 0x7f0d7415bdf0 2023-07-14T13:05:47.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.418+0000 7f0d73fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d740c8e70 0x7f0d7415ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:47.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.418+0000 7f0d73fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d740c8e70 0x7f0d7415ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33574/0 (socket says 172.21.15.5:33574) 2023-07-14T13:05:47.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.418+0000 7f0d73fff640 1 -- 172.21.15.5:0/2203223573 learned_addr learned my addr 172.21.15.5:0/2203223573 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:47.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.418+0000 7f0d737fe640 1 --2- 172.21.15.5:0/2203223573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d7415bdf0 0x7f0d740b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:47.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.418+0000 7f0d78a75640 1 --2- 172.21.15.5:0/2203223573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d7415f970 0x7f0d740b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:47.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.422+0000 7f0d73fff640 1 -- 172.21.15.5:0/2203223573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d7415bdf0 msgr2=0x7f0d740b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:47.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.422+0000 7f0d73fff640 1 --2- 172.21.15.5:0/2203223573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d7415bdf0 0x7f0d740b11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:47.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.422+0000 7f0d73fff640 1 -- 172.21.15.5:0/2203223573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d7415f970 msgr2=0x7f0d740b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:47.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.422+0000 7f0d73fff640 1 --2- 172.21.15.5:0/2203223573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d7415f970 0x7f0d740b1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:47.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.422+0000 7f0d73fff640 1 -- 172.21.15.5:0/2203223573 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6c009b30 con 0x7f0d740c8e70 2023-07-14T13:05:47.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.422+0000 7f0d73fff640 1 --2- 172.21.15.5:0/2203223573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d740c8e70 0x7f0d7415ed80 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0d6400c530 tx=0x7f0d6400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:47.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.422+0000 7f0d70ff9640 1 -- 172.21.15.5:0/2203223573 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d64005220 con 0x7f0d740c8e70 2023-07-14T13:05:47.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.422+0000 7f0d70ff9640 1 -- 172.21.15.5:0/2203223573 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d64005380 con 0x7f0d740c8e70 2023-07-14T13:05:47.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.422+0000 7f0d70ff9640 1 -- 172.21.15.5:0/2203223573 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d64007270 con 0x7f0d740c8e70 2023-07-14T13:05:47.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.422+0000 7f0d7a4d8640 1 -- 172.21.15.5:0/2203223573 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d740b2230 con 0x7f0d740c8e70 2023-07-14T13:05:47.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.422+0000 7f0d7a4d8640 1 -- 172.21.15.5:0/2203223573 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d740b27f0 con 0x7f0d740c8e70 2023-07-14T13:05:47.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.422+0000 7f0d7a4d8640 1 -- 172.21.15.5:0/2203223573 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d740b2e40 con 0x7f0d740c8e70 2023-07-14T13:05:47.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.422+0000 7f0d70ff9640 1 -- 172.21.15.5:0/2203223573 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f0d640073d0 con 0x7f0d740c8e70 2023-07-14T13:05:47.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.426+0000 7f0d70ff9640 1 --2- 172.21.15.5:0/2203223573 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f0d600660d0 0x7f0d60068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:47.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.426+0000 7f0d70ff9640 1 -- 172.21.15.5:0/2203223573 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7640+0+0 (secure 0 0 0) 0x7f0d64083730 con 0x7f0d740c8e70 2023-07-14T13:05:47.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.426+0000 7f0d737fe640 1 --2- 172.21.15.5:0/2203223573 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f0d600660d0 0x7f0d60068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:47.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.426+0000 7f0d737fe640 1 --2- 172.21.15.5:0/2203223573 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f0d600660d0 0x7f0d60068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0d740cbfa0 tx=0x7f0d68009190 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:47.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.430+0000 7f0d70ff9640 1 -- 172.21.15.5:0/2203223573 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f0d64050970 con 0x7f0d740c8e70 2023-07-14T13:05:47.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.618+0000 7f0d7a4d8640 1 -- 172.21.15.5:0/2203223573 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d740678d0 con 0x7f0d740c8e70 2023-07-14T13:05:47.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.618+0000 7f0d70ff9640 1 -- 172.21.15.5:0/2203223573 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4706 (secure 0 0 0) 0x7f0d64053f90 con 0x7f0d740c8e70 2023-07-14T13:05:47.650 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:05:47.650 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1121417572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1121417572},{"type":"v1","addr":"172.21.15.5:6833","nonce":1121417572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/1826988320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1826988320},{"type":"v1","addr":"172.21.15.154:6836","nonce":1826988320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5074,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3683900517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3683900517},{"type":"v1","addr":"172.21.15.154:6837","nonce":3683900517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T12:53:43.186604+0000","modified":"2023-07-14T12:53:46.672007+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5133},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5133":{"gid":5133,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6835/601029596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":601029596},{"type":"v1","addr":"172.21.15.5:6835","nonce":601029596}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-14T13:05:47.651 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 16 2023-07-14T13:05:47.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.622+0000 7f0d7a4d8640 1 -- 172.21.15.5:0/2203223573 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f0d600660d0 msgr2=0x7f0d60068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:47.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.622+0000 7f0d7a4d8640 1 --2- 172.21.15.5:0/2203223573 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f0d600660d0 0x7f0d60068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0d740cbfa0 tx=0x7f0d68009190 comp rx=0 tx=0).stop 2023-07-14T13:05:47.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.622+0000 7f0d7a4d8640 1 -- 172.21.15.5:0/2203223573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d740c8e70 msgr2=0x7f0d7415ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:47.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.622+0000 7f0d7a4d8640 1 --2- 172.21.15.5:0/2203223573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d740c8e70 0x7f0d7415ed80 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0d6400c530 tx=0x7f0d6400c9f0 comp rx=0 tx=0).stop 2023-07-14T13:05:47.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.622+0000 7f0d7a4d8640 1 -- 172.21.15.5:0/2203223573 shutdown_connections 2023-07-14T13:05:47.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.622+0000 7f0d7a4d8640 1 --2- 172.21.15.5:0/2203223573 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f0d600660d0 0x7f0d60068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:47.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.622+0000 7f0d7a4d8640 1 --2- 172.21.15.5:0/2203223573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d7415f970 0x7f0d740b1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:47.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.622+0000 7f0d7a4d8640 1 --2- 172.21.15.5:0/2203223573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d7415bdf0 0x7f0d740b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:47.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.622+0000 7f0d7a4d8640 1 --2- 172.21.15.5:0/2203223573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d740c8e70 0x7f0d7415ed80 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:47.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.622+0000 7f0d7a4d8640 1 -- 172.21.15.5:0/2203223573 >> 172.21.15.5:0/2203223573 conn(0x7f0d740afcf0 msgr2=0x7f0d740ab8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:47.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.622+0000 7f0d7a4d8640 1 -- 172.21.15.5:0/2203223573 shutdown_connections 2023-07-14T13:05:47.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.622+0000 7f0d7a4d8640 1 -- 172.21.15.5:0/2203223573 wait complete. 2023-07-14T13:05:47.671 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:05:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.786+0000 7f47b3096640 1 Processor -- start 2023-07-14T13:05:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.786+0000 7f47b3096640 1 -- start start 2023-07-14T13:05:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.786+0000 7f47b3096640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f47ac069430 0x7f47ac069830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.786+0000 7f47b3096640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47ac0c9c30 con 0x7f47ac160450 2023-07-14T13:05:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.786+0000 7f47b3096640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47ac15bfd0 con 0x7f47ac15bc00 2023-07-14T13:05:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.786+0000 7f47b3096640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47ac0c96b0 con 0x7f47ac069430 2023-07-14T13:05:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.786+0000 7f47abfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f47ac160450 0x7f47ac06e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43874/0 (socket says 172.21.15.5:43874) 2023-07-14T13:05:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.786+0000 7f47abfff640 1 -- 172.21.15.5:0/2933800364 learned_addr learned my addr 172.21.15.5:0/2933800364 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:47.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.786+0000 7f47b1633640 1 --2- 172.21.15.5:0/2933800364 >> v2:172.21.15.154:3300/0 conn(0x7f47ac069430 0x7f47ac069830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.790+0000 7f47ab7fe640 1 -- 172.21.15.5:0/2933800364 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2109711632 0 0) 0x7f47ac0c9c30 con 0x7f47ac160450 2023-07-14T13:05:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.790+0000 7f47ab7fe640 1 -- 172.21.15.5:0/2933800364 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f479c003530 con 0x7f47ac160450 2023-07-14T13:05:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.790+0000 7f47b1633640 1 -- 172.21.15.5:0/2933800364 >> v1:172.21.15.154:6789/0 conn(0x7f47ac15bc00 legacy=0x7f47ac0ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.790+0000 7f47b1633640 1 -- 172.21.15.5:0/2933800364 >> v1:172.21.15.5:6789/0 conn(0x7f47ac160450 legacy=0x7f47ac06e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.790+0000 7f47b1633640 1 -- 172.21.15.5:0/2933800364 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ac069d70 con 0x7f47ac069430 2023-07-14T13:05:47.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.790+0000 7f47b1633640 1 --2- 172.21.15.5:0/2933800364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47ac069430 0x7f47ac069830 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f47a4009d90 tx=0x7f47a401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56a844f927f34b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:47.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.790+0000 7f47ab7fe640 1 -- 172.21.15.5:0/2933800364 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a40a59e0 con 0x7f47ac069430 2023-07-14T13:05:47.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.790+0000 7f47ab7fe640 1 -- 172.21.15.5:0/2933800364 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a40a5b40 con 0x7f47ac069430 2023-07-14T13:05:47.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.790+0000 7f47ab7fe640 1 -- 172.21.15.5:0/2933800364 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a40ad440 con 0x7f47ac069430 2023-07-14T13:05:47.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.794+0000 7f47b3096640 1 -- 172.21.15.5:0/2933800364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47ac069430 msgr2=0x7f47ac069830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:47.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.794+0000 7f47b3096640 1 --2- 172.21.15.5:0/2933800364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47ac069430 0x7f47ac069830 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f47a4009d90 tx=0x7f47a401c920 comp rx=0 tx=0).stop 2023-07-14T13:05:47.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.794+0000 7f47b3096640 1 -- 172.21.15.5:0/2933800364 shutdown_connections 2023-07-14T13:05:47.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.794+0000 7f47b3096640 1 --2- 172.21.15.5:0/2933800364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47ac069430 0x7f47ac069830 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:47.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.794+0000 7f47b3096640 1 -- 172.21.15.5:0/2933800364 >> 172.21.15.5:0/2933800364 conn(0x7f47ac0b1840 msgr2=0x7f47ac0cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:47.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.794+0000 7f47b3096640 1 -- 172.21.15.5:0/2933800364 shutdown_connections 2023-07-14T13:05:47.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.794+0000 7f47b3096640 1 -- 172.21.15.5:0/2933800364 wait complete. 2023-07-14T13:05:47.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.794+0000 7f47b3096640 1 Processor -- start 2023-07-14T13:05:47.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.794+0000 7f47b3096640 1 -- start start 2023-07-14T13:05:47.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.794+0000 7f47b3096640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47ac069430 0x7f47ac15a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:47.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.794+0000 7f47b3096640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47ac15bc00 0x7f47ac147a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:47.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.794+0000 7f47b3096640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47ac160450 0x7f47ac147fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:47.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.794+0000 7f47b3096640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac06cf40 con 0x7f47ac160450 2023-07-14T13:05:47.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.794+0000 7f47b3096640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac06d190 con 0x7f47ac069430 2023-07-14T13:05:47.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.794+0000 7f47b3096640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac06d470 con 0x7f47ac15bc00 2023-07-14T13:05:47.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.794+0000 7f47b1633640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47ac160450 0x7f47ac147fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:47.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.794+0000 7f47b1633640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47ac160450 0x7f47ac147fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33582/0 (socket says 172.21.15.5:33582) 2023-07-14T13:05:47.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.794+0000 7f47b1633640 1 -- 172.21.15.5:0/2590811483 learned_addr learned my addr 172.21.15.5:0/2590811483 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:47.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.794+0000 7f47abfff640 1 --2- 172.21.15.5:0/2590811483 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47ac15bc00 0x7f47ac147a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:47.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.794+0000 7f47b0e32640 1 --2- 172.21.15.5:0/2590811483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47ac069430 0x7f47ac15a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:47.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.794+0000 7f47b1633640 1 -- 172.21.15.5:0/2590811483 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47ac15bc00 msgr2=0x7f47ac147a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:47.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.794+0000 7f47b1633640 1 --2- 172.21.15.5:0/2590811483 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47ac15bc00 0x7f47ac147a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:47.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.794+0000 7f47b1633640 1 -- 172.21.15.5:0/2590811483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47ac069430 msgr2=0x7f47ac15a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:47.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.794+0000 7f47b1633640 1 --2- 172.21.15.5:0/2590811483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47ac069430 0x7f47ac15a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:47.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.794+0000 7f47b1633640 1 -- 172.21.15.5:0/2590811483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a4009a70 con 0x7f47ac160450 2023-07-14T13:05:47.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.794+0000 7f47abfff640 1 --2- 172.21.15.5:0/2590811483 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47ac15bc00 0x7f47ac147a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:05:47.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.798+0000 7f47b1633640 1 --2- 172.21.15.5:0/2590811483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47ac160450 0x7f47ac147fc0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f47a40b0040 tx=0x7f47a40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:47.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.798+0000 7f47a97fa640 1 -- 172.21.15.5:0/2590811483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a40add90 con 0x7f47ac160450 2023-07-14T13:05:47.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.798+0000 7f47a97fa640 1 -- 172.21.15.5:0/2590811483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a4009450 con 0x7f47ac160450 2023-07-14T13:05:47.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.798+0000 7f47a97fa640 1 -- 172.21.15.5:0/2590811483 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a40b9690 con 0x7f47ac160450 2023-07-14T13:05:47.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.798+0000 7f47b3096640 1 -- 172.21.15.5:0/2590811483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47ac06d750 con 0x7f47ac160450 2023-07-14T13:05:47.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.798+0000 7f47b3096640 1 -- 172.21.15.5:0/2590811483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47ac06dd10 con 0x7f47ac160450 2023-07-14T13:05:47.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.798+0000 7f47b3096640 1 -- 172.21.15.5:0/2590811483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47ac06df00 con 0x7f47ac160450 2023-07-14T13:05:47.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.798+0000 7f47a97fa640 1 -- 172.21.15.5:0/2590811483 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f47a40b97f0 con 0x7f47ac160450 2023-07-14T13:05:47.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.798+0000 7f47a97fa640 1 --2- 172.21.15.5:0/2590811483 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f47900663a0 0x7f4790068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:47.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.798+0000 7f47a97fa640 1 -- 172.21.15.5:0/2590811483 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7640+0+0 (secure 0 0 0) 0x7f47a411fc70 con 0x7f47ac160450 2023-07-14T13:05:47.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.798+0000 7f47b0e32640 1 --2- 172.21.15.5:0/2590811483 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f47900663a0 0x7f4790068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:47.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.802+0000 7f47b0e32640 1 --2- 172.21.15.5:0/2590811483 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f47900663a0 0x7f4790068850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f47a0000f70 tx=0x7f47a0009040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:47.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.802+0000 7f47a97fa640 1 -- 172.21.15.5:0/2590811483 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f47a40ecb70 con 0x7f47ac160450 2023-07-14T13:05:48.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.990+0000 7f47b3096640 1 -- 172.21.15.5:0/2590811483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47ac0678d0 con 0x7f47ac160450 2023-07-14T13:05:48.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.990+0000 7f47a97fa640 1 -- 172.21.15.5:0/2590811483 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4706 (secure 0 0 0) 0x7f47a40f0190 con 0x7f47ac160450 2023-07-14T13:05:48.023 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:05:48.023 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1121417572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1121417572},{"type":"v1","addr":"172.21.15.5:6833","nonce":1121417572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/1826988320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1826988320},{"type":"v1","addr":"172.21.15.154:6836","nonce":1826988320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5074,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3683900517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3683900517},{"type":"v1","addr":"172.21.15.154:6837","nonce":3683900517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T12:53:43.186604+0000","modified":"2023-07-14T12:53:46.672007+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5133},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5133":{"gid":5133,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.5:6835/601029596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":601029596},{"type":"v1","addr":"172.21.15.5:6835","nonce":601029596}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-14T13:05:48.023 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 16 2023-07-14T13:05:48.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.994+0000 7f47b3096640 1 -- 172.21.15.5:0/2590811483 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f47900663a0 msgr2=0x7f4790068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:48.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.994+0000 7f47b3096640 1 --2- 172.21.15.5:0/2590811483 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f47900663a0 0x7f4790068850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f47a0000f70 tx=0x7f47a0009040 comp rx=0 tx=0).stop 2023-07-14T13:05:48.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.994+0000 7f47b3096640 1 -- 172.21.15.5:0/2590811483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47ac160450 msgr2=0x7f47ac147fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:48.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.994+0000 7f47b3096640 1 --2- 172.21.15.5:0/2590811483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47ac160450 0x7f47ac147fc0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f47a40b0040 tx=0x7f47a40196c0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.994+0000 7f47b3096640 1 -- 172.21.15.5:0/2590811483 shutdown_connections 2023-07-14T13:05:48.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.994+0000 7f47b3096640 1 --2- 172.21.15.5:0/2590811483 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f47900663a0 0x7f4790068850 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.994+0000 7f47b3096640 1 --2- 172.21.15.5:0/2590811483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47ac160450 0x7f47ac147fc0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.994+0000 7f47b3096640 1 --2- 172.21.15.5:0/2590811483 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47ac15bc00 0x7f47ac147a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.994+0000 7f47b3096640 1 --2- 172.21.15.5:0/2590811483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47ac069430 0x7f47ac15a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.994+0000 7f47b3096640 1 -- 172.21.15.5:0/2590811483 >> 172.21.15.5:0/2590811483 conn(0x7f47ac0b1840 msgr2=0x7f47ac0aebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:48.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.994+0000 7f47b3096640 1 -- 172.21.15.5:0/2590811483 shutdown_connections 2023-07-14T13:05:48.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:47.994+0000 7f47b3096640 1 -- 172.21.15.5:0/2590811483 wait complete. 2023-07-14T13:05:48.044 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:05:48.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.154+0000 7fb8abdad640 1 Processor -- start 2023-07-14T13:05:48.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.158+0000 7fb8abdad640 1 -- start start 2023-07-14T13:05:48.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.158+0000 7fb8abdad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8a406a540 0x7fb8a406a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:48.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.158+0000 7fb8abdad640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb8a40ce0f0 0x7fb8a40ce570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:48.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.158+0000 7fb8abdad640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a40cdc80 con 0x7fb8a415f500 2023-07-14T13:05:48.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.158+0000 7fb8abdad640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a406aed0 con 0x7fb8a40ce0f0 2023-07-14T13:05:48.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.158+0000 7fb8abdad640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a406e4c0 con 0x7fb8a406a540 2023-07-14T13:05:48.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.158+0000 7fb8aa34a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb8a40ce0f0 0x7fb8a40ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:48.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.158+0000 7fb8a9b49640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb8a415f500 0x7fb8a406cef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43880/0 (socket says 172.21.15.5:43880) 2023-07-14T13:05:48.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.158+0000 7fb8a9b49640 1 -- 172.21.15.5:0/520250096 learned_addr learned my addr 172.21.15.5:0/520250096 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:48.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.158+0000 7fb8a9348640 1 --2- 172.21.15.5:0/520250096 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8a406a540 0x7fb8a406a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:48.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.158+0000 7fb8aa34a640 1 -- 172.21.15.5:0/520250096 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8a406a540 msgr2=0x7fb8a406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:48.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.158+0000 7fb8aa34a640 1 --2- 172.21.15.5:0/520250096 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8a406a540 0x7fb8a406a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.158+0000 7fb8aa34a640 1 -- 172.21.15.5:0/520250096 >> v1:172.21.15.5:6789/0 conn(0x7fb8a415f500 legacy=0x7fb8a406cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:48.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.158+0000 7fb8aa34a640 1 -- 172.21.15.5:0/520250096 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a406d940 con 0x7fb8a40ce0f0 2023-07-14T13:05:48.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.158+0000 7fb8a8b47640 1 -- 172.21.15.5:0/520250096 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3093115220 0 0) 0x7fb8a40cdc80 con 0x7fb8a415f500 2023-07-14T13:05:48.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.162+0000 7fb8aa34a640 1 --2- 172.21.15.5:0/520250096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a40ce0f0 0x7fb8a40ce570 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009d90 tx=0x7fb89c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0aa88af9548aae server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:48.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.162+0000 7fb8a8b47640 1 -- 172.21.15.5:0/520250096 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c0a5900 con 0x7fb8a40ce0f0 2023-07-14T13:05:48.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.162+0000 7fb8a8b47640 1 -- 172.21.15.5:0/520250096 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89c0a5a60 con 0x7fb8a40ce0f0 2023-07-14T13:05:48.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.162+0000 7fb8a8b47640 1 -- 172.21.15.5:0/520250096 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c0a5df0 con 0x7fb8a40ce0f0 2023-07-14T13:05:48.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.162+0000 7fb8abdad640 1 -- 172.21.15.5:0/520250096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a40ce0f0 msgr2=0x7fb8a40ce570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:48.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.162+0000 7fb8abdad640 1 --2- 172.21.15.5:0/520250096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a40ce0f0 0x7fb8a40ce570 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009d90 tx=0x7fb89c01c950 comp rx=0 tx=0).stop 2023-07-14T13:05:48.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.162+0000 7fb8abdad640 1 -- 172.21.15.5:0/520250096 shutdown_connections 2023-07-14T13:05:48.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.162+0000 7fb8abdad640 1 --2- 172.21.15.5:0/520250096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a40ce0f0 0x7fb8a40ce570 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.162+0000 7fb8abdad640 1 --2- 172.21.15.5:0/520250096 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8a406a540 0x7fb8a406a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.162+0000 7fb8abdad640 1 -- 172.21.15.5:0/520250096 >> 172.21.15.5:0/520250096 conn(0x7fb8a40659d0 msgr2=0x7fb8a4099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:48.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.162+0000 7fb8abdad640 1 -- 172.21.15.5:0/520250096 shutdown_connections 2023-07-14T13:05:48.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.162+0000 7fb8abdad640 1 -- 172.21.15.5:0/520250096 wait complete. 2023-07-14T13:05:48.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.162+0000 7fb8abdad640 1 Processor -- start 2023-07-14T13:05:48.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.162+0000 7fb8abdad640 1 -- start start 2023-07-14T13:05:48.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.166+0000 7fb8abdad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8a406a540 0x7fb8a414d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:48.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.166+0000 7fb8abdad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a40ce0f0 0x7fb8a40b5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:48.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.166+0000 7fb8abdad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8a415f500 0x7fb8a4153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:48.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.166+0000 7fb8abdad640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40b5f70 con 0x7fb8a40ce0f0 2023-07-14T13:05:48.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.166+0000 7fb8abdad640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a4154330 con 0x7fb8a406a540 2023-07-14T13:05:48.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.166+0000 7fb8abdad640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a415e750 con 0x7fb8a415f500 2023-07-14T13:05:48.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.166+0000 7fb8a9348640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a40ce0f0 0x7fb8a40b5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:48.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.166+0000 7fb8a9348640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a40ce0f0 0x7fb8a40b5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33602/0 (socket says 172.21.15.5:33602) 2023-07-14T13:05:48.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.166+0000 7fb8a9348640 1 -- 172.21.15.5:0/1319479877 learned_addr learned my addr 172.21.15.5:0/1319479877 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:48.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.166+0000 7fb8aa34a640 1 --2- 172.21.15.5:0/1319479877 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8a415f500 0x7fb8a4153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:48.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.166+0000 7fb8a9b49640 1 --2- 172.21.15.5:0/1319479877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8a406a540 0x7fb8a414d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:48.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.166+0000 7fb8a9348640 1 -- 172.21.15.5:0/1319479877 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8a415f500 msgr2=0x7fb8a4153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:48.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.166+0000 7fb8a9348640 1 --2- 172.21.15.5:0/1319479877 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8a415f500 0x7fb8a4153df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.166+0000 7fb8a9348640 1 -- 172.21.15.5:0/1319479877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8a406a540 msgr2=0x7fb8a414d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:48.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.166+0000 7fb8a9348640 1 --2- 172.21.15.5:0/1319479877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8a406a540 0x7fb8a414d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.166+0000 7fb8a9348640 1 -- 172.21.15.5:0/1319479877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c009a70 con 0x7fb8a40ce0f0 2023-07-14T13:05:48.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.166+0000 7fb8a9b49640 1 --2- 172.21.15.5:0/1319479877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8a406a540 0x7fb8a414d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:05:48.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.166+0000 7fb8a9348640 1 --2- 172.21.15.5:0/1319479877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a40ce0f0 0x7fb8a40b5a30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb89400d620 tx=0x7fb89400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:48.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.166+0000 7fb89a7fc640 1 -- 172.21.15.5:0/1319479877 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89400b620 con 0x7fb8a40ce0f0 2023-07-14T13:05:48.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.166+0000 7fb89a7fc640 1 -- 172.21.15.5:0/1319479877 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89400b780 con 0x7fb8a40ce0f0 2023-07-14T13:05:48.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.166+0000 7fb8abdad640 1 -- 172.21.15.5:0/1319479877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a415e470 con 0x7fb8a40ce0f0 2023-07-14T13:05:48.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.166+0000 7fb89a7fc640 1 -- 172.21.15.5:0/1319479877 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89400bb10 con 0x7fb8a40ce0f0 2023-07-14T13:05:48.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.166+0000 7fb8abdad640 1 -- 172.21.15.5:0/1319479877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a41535f0 con 0x7fb8a40ce0f0 2023-07-14T13:05:48.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.166+0000 7fb8abdad640 1 -- 172.21.15.5:0/1319479877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a40678d0 con 0x7fb8a40ce0f0 2023-07-14T13:05:48.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.166+0000 7fb89a7fc640 1 -- 172.21.15.5:0/1319479877 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb89400bc70 con 0x7fb8a40ce0f0 2023-07-14T13:05:48.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.170+0000 7fb89a7fc640 1 --2- 172.21.15.5:0/1319479877 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fb8880663a0 0x7fb888068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:48.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.170+0000 7fb89a7fc640 1 -- 172.21.15.5:0/1319479877 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7640+0+0 (secure 0 0 0) 0x7fb8940849f0 con 0x7fb8a40ce0f0 2023-07-14T13:05:48.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.170+0000 7fb8a9b49640 1 --2- 172.21.15.5:0/1319479877 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fb8880663a0 0x7fb888068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:48.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.170+0000 7fb8a9b49640 1 --2- 172.21.15.5:0/1319479877 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fb8880663a0 0x7fb888068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0001370 tx=0x7fb8a0009040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:48.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.174+0000 7fb89a7fc640 1 -- 172.21.15.5:0/1319479877 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb894051730 con 0x7fb8a40ce0f0 2023-07-14T13:05:48.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.330+0000 7fb8abdad640 1 -- 172.21.15.5:0/1319479877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8a40ca2d0 con 0x7fb8a40ce0f0 2023-07-14T13:05:48.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.334+0000 7fb89a7fc640 1 -- 172.21.15.5:0/1319479877 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+20638 (secure 0 0 0) 0x7fb894007380 con 0x7fb8a40ce0f0 2023-07-14T13:05:48.365 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:05:48.365 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":53,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:05:45.508832+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:53:41.014568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-14T12:53:42.032063+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":53,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2b","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/3808907773":"2023-07-15T13:05:45.508796+0000","172.21.15.154:6833/2192122532":"2023-07-15T13:05:45.508796+0000","172.21.15.154:6832/2736441655":"2023-07-15T12:54:00.161685+0000","172.21.15.154:0/844038179":"2023-07-15T12:54:00.161685+0000","172.21.15.154:0/1533499204":"2023-07-15T12:54:00.161685+0000","172.21.15.154:0/1617499779":"2023-07-15T13:05:45.508796+0000","172.21.15.154:0/3140351861":"2023-07-15T12:54:00.161685+0000","172.21.15.154:0/3341947062":"2023-07-15T12:54:00.161685+0000","172.21.15.154:0/3036549385":"2023-07-15T13:05:45.508796+0000","172.21.15.154:0/512250962":"2023-07-15T13:05:45.508796+0000","172.21.15.154:0/778089833":"2023-07-15T13:05:45.508796+0000","172.21.15.154:6833/2736441655":"2023-07-15T12:54:00.161685+0000","172.21.15.154:0/2751604382":"2023-07-15T13:05:45.508796+0000","172.21.15.154:0/2587551624":"2023-07-15T13:05:45.508796+0000","172.21.15.154:6832/2192122532":"2023-07-15T13:05:45.508796+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1},{"begin":6,"length":1},{"begin":8,"length":1},{"begin":10,"length":1},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":1},{"begin":18,"length":1},{"begin":20,"length":1},{"begin":22,"length":1},{"begin":24,"length":1},{"begin":26,"length":1},{"begin":28,"length":1},{"begin":30,"length":1},{"begin":33,"length":1},{"begin":35,"length":1},{"begin":37,"length":1},{"begin":39,"length":1},{"begin":41,"length":2},{"begin":44,"length":1},{"begin":46,"length":1},{"begin":48,"length":1},{"begin":50,"length":1},{"begin":52,"length":1},{"begin":54,"length":1},{"begin":56,"length":1},{"begin":58,"length":1},{"begin":60,"length":1},{"begin":63,"length":1},{"begin":65,"length":1},{"begin":67,"length":1},{"begin":69,"length":1},{"begin":71,"length":1},{"begin":73,"length":1},{"begin":75,"length":1},{"begin":77,"length":1},{"begin":79,"length":1},{"begin":81,"length":1},{"begin":83,"length":1},{"begin":85,"length":1},{"begin":87,"length":1},{"begin":89,"length":1},{"begin":91,"length":2},{"begin":94,"length":1},{"begin":96,"length":1},{"begin":98,"length":1},{"begin":100,"length":1},{"begin":103,"length":1},{"begin":105,"length":3},{"begin":109,"length":1},{"begin":111,"length":1},{"begin":166,"length":56}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:05:48.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.334+0000 7fb8abdad640 1 -- 172.21.15.5:0/1319479877 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fb8880663a0 msgr2=0x7fb888068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:48.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.334+0000 7fb8abdad640 1 --2- 172.21.15.5:0/1319479877 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fb8880663a0 0x7fb888068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0001370 tx=0x7fb8a0009040 comp rx=0 tx=0).stop 2023-07-14T13:05:48.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.334+0000 7fb8abdad640 1 -- 172.21.15.5:0/1319479877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a40ce0f0 msgr2=0x7fb8a40b5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:48.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.334+0000 7fb8abdad640 1 --2- 172.21.15.5:0/1319479877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a40ce0f0 0x7fb8a40b5a30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb89400d620 tx=0x7fb89400dae0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.334+0000 7fb8abdad640 1 -- 172.21.15.5:0/1319479877 shutdown_connections 2023-07-14T13:05:48.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.334+0000 7fb8abdad640 1 --2- 172.21.15.5:0/1319479877 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fb8880663a0 0x7fb888068850 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.334+0000 7fb8abdad640 1 --2- 172.21.15.5:0/1319479877 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8a415f500 0x7fb8a4153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.334+0000 7fb8abdad640 1 --2- 172.21.15.5:0/1319479877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a40ce0f0 0x7fb8a40b5a30 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.334+0000 7fb8abdad640 1 --2- 172.21.15.5:0/1319479877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8a406a540 0x7fb8a414d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.334+0000 7fb8abdad640 1 -- 172.21.15.5:0/1319479877 >> 172.21.15.5:0/1319479877 conn(0x7fb8a40659d0 msgr2=0x7fb8a40cf5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:48.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.334+0000 7fb8abdad640 1 -- 172.21.15.5:0/1319479877 shutdown_connections 2023-07-14T13:05:48.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.334+0000 7fb8abdad640 1 -- 172.21.15.5:0/1319479877 wait complete. 2023-07-14T13:05:48.386 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-14T13:05:48.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.498+0000 7f11e81e9640 1 Processor -- start 2023-07-14T13:05:48.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.498+0000 7f11e81e9640 1 -- start start 2023-07-14T13:05:48.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.498+0000 7f11e81e9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f11e0158ce0 0x7f11e0070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:48.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.502+0000 7f11e81e9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11e00c8ad0 0x7f11e00c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:48.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.502+0000 7f11e81e9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f11e00c9560 0x7f11e00cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:48.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.502+0000 7f11e81e9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e00c99e0 con 0x7f11e0158ce0 2023-07-14T13:05:48.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.502+0000 7f11e81e9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e00cc700 con 0x7f11e00c9560 2023-07-14T13:05:48.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.502+0000 7f11e81e9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e00b0ff0 con 0x7f11e00c8ad0 2023-07-14T13:05:48.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.502+0000 7f11e5f85640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f11e0158ce0 0x7f11e0070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:48.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.502+0000 7f11e5f85640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f11e0158ce0 0x7f11e0070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33614/0 (socket says 172.21.15.5:33614) 2023-07-14T13:05:48.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.502+0000 7f11e5f85640 1 -- 172.21.15.5:0/690408466 learned_addr learned my addr 172.21.15.5:0/690408466 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:48.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.502+0000 7f11e5784640 1 --2- 172.21.15.5:0/690408466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11e00c8ad0 0x7f11e00c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:48.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.502+0000 7f11e6786640 1 --2- 172.21.15.5:0/690408466 >> v2:172.21.15.154:3300/0 conn(0x7f11e00c9560 0x7f11e00cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:48.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.502+0000 7f11e5f85640 1 -- 172.21.15.5:0/690408466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11e00c8ad0 msgr2=0x7f11e00c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:48.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.502+0000 7f11e5f85640 1 --2- 172.21.15.5:0/690408466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11e00c8ad0 0x7f11e00c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.502+0000 7f11e5f85640 1 -- 172.21.15.5:0/690408466 >> v2:172.21.15.154:3300/0 conn(0x7f11e00c9560 msgr2=0x7f11e00cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:48.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.502+0000 7f11e5f85640 1 --2- 172.21.15.5:0/690408466 >> v2:172.21.15.154:3300/0 conn(0x7f11e00c9560 0x7f11e00cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.502+0000 7f11e5f85640 1 -- 172.21.15.5:0/690408466 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e0070c80 con 0x7f11e0158ce0 2023-07-14T13:05:48.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.502+0000 7f11e6786640 1 --2- 172.21.15.5:0/690408466 >> v2:172.21.15.154:3300/0 conn(0x7f11e00c9560 0x7f11e00cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:05:48.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.502+0000 7f11e5784640 1 --2- 172.21.15.5:0/690408466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11e00c8ad0 0x7f11e00c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:05:48.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.502+0000 7f11e5f85640 1 --2- 172.21.15.5:0/690408466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e0158ce0 0x7f11e0070450 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f11e00c17e0 tx=0x7f11dc01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4269643c20c2f810 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:48.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.502+0000 7f11e4f83640 1 -- 172.21.15.5:0/690408466 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc0ab600 con 0x7f11e0158ce0 2023-07-14T13:05:48.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.506+0000 7f11e4f83640 1 -- 172.21.15.5:0/690408466 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11dc0a7050 con 0x7f11e0158ce0 2023-07-14T13:05:48.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.506+0000 7f11e4f83640 1 -- 172.21.15.5:0/690408466 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc0ab980 con 0x7f11e0158ce0 2023-07-14T13:05:48.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.506+0000 7f11e81e9640 1 -- 172.21.15.5:0/690408466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e0158ce0 msgr2=0x7f11e0070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:48.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.506+0000 7f11e81e9640 1 --2- 172.21.15.5:0/690408466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e0158ce0 0x7f11e0070450 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f11e00c17e0 tx=0x7f11dc01c3b0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.506+0000 7f11e81e9640 1 -- 172.21.15.5:0/690408466 shutdown_connections 2023-07-14T13:05:48.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.506+0000 7f11e81e9640 1 --2- 172.21.15.5:0/690408466 >> v2:172.21.15.154:3300/0 conn(0x7f11e00c9560 0x7f11e00cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.506+0000 7f11e81e9640 1 --2- 172.21.15.5:0/690408466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11e00c8ad0 0x7f11e00c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.506+0000 7f11e81e9640 1 --2- 172.21.15.5:0/690408466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e0158ce0 0x7f11e0070450 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.506+0000 7f11e81e9640 1 -- 172.21.15.5:0/690408466 >> 172.21.15.5:0/690408466 conn(0x7f11e00afcf0 msgr2=0x7f11e00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:48.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.506+0000 7f11e81e9640 1 -- 172.21.15.5:0/690408466 shutdown_connections 2023-07-14T13:05:48.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.506+0000 7f11e81e9640 1 -- 172.21.15.5:0/690408466 wait complete. 2023-07-14T13:05:48.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.506+0000 7f11e81e9640 1 Processor -- start 2023-07-14T13:05:48.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.506+0000 7f11e81e9640 1 -- start start 2023-07-14T13:05:48.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.506+0000 7f11e81e9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11e00c8ad0 0x7f11e0146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:48.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.506+0000 7f11e81e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e00c9560 0x7f11e014e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:48.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.506+0000 7f11e81e9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11e0158ce0 0x7f11e014eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:48.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.506+0000 7f11e81e9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e0161dd0 con 0x7f11e00c9560 2023-07-14T13:05:48.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.506+0000 7f11e81e9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e0161360 con 0x7f11e00c8ad0 2023-07-14T13:05:48.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.506+0000 7f11e81e9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e014f500 con 0x7f11e0158ce0 2023-07-14T13:05:48.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.506+0000 7f11e5784640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e00c9560 0x7f11e014e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:48.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.506+0000 7f11e5784640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e00c9560 0x7f11e014e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33628/0 (socket says 172.21.15.5:33628) 2023-07-14T13:05:48.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.506+0000 7f11e5784640 1 -- 172.21.15.5:0/1856449600 learned_addr learned my addr 172.21.15.5:0/1856449600 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:48.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.510+0000 7f11e6786640 1 --2- 172.21.15.5:0/1856449600 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11e0158ce0 0x7f11e014eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:48.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.510+0000 7f11e5f85640 1 --2- 172.21.15.5:0/1856449600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11e00c8ad0 0x7f11e0146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:48.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.510+0000 7f11e5784640 1 -- 172.21.15.5:0/1856449600 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11e0158ce0 msgr2=0x7f11e014eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:48.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.510+0000 7f11e5784640 1 --2- 172.21.15.5:0/1856449600 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11e0158ce0 0x7f11e014eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.510+0000 7f11e5784640 1 -- 172.21.15.5:0/1856449600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11e00c8ad0 msgr2=0x7f11e0146ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:48.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.510+0000 7f11e5784640 1 --2- 172.21.15.5:0/1856449600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11e00c8ad0 0x7f11e0146ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.510+0000 7f11e5784640 1 -- 172.21.15.5:0/1856449600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11dc0094d0 con 0x7f11e00c9560 2023-07-14T13:05:48.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.510+0000 7f11e5784640 1 --2- 172.21.15.5:0/1856449600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e00c9560 0x7f11e014e990 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f11d000c7f0 tx=0x7f11d000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:48.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.510+0000 7f11d67fc640 1 -- 172.21.15.5:0/1856449600 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d0007820 con 0x7f11e00c9560 2023-07-14T13:05:48.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.510+0000 7f11d67fc640 1 -- 172.21.15.5:0/1856449600 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d0007980 con 0x7f11e00c9560 2023-07-14T13:05:48.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.510+0000 7f11d67fc640 1 -- 172.21.15.5:0/1856449600 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d0007d30 con 0x7f11e00c9560 2023-07-14T13:05:48.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.510+0000 7f11e81e9640 1 -- 172.21.15.5:0/1856449600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e014f7e0 con 0x7f11e00c9560 2023-07-14T13:05:48.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.510+0000 7f11e81e9640 1 -- 172.21.15.5:0/1856449600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e01471e0 con 0x7f11e00c9560 2023-07-14T13:05:48.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.510+0000 7f11e81e9640 1 -- 172.21.15.5:0/1856449600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e00ca1a0 con 0x7f11e00c9560 2023-07-14T13:05:48.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.510+0000 7f11d67fc640 1 -- 172.21.15.5:0/1856449600 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f11d00113f0 con 0x7f11e00c9560 2023-07-14T13:05:48.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.510+0000 7f11d67fc640 1 --2- 172.21.15.5:0/1856449600 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f11c40663a0 0x7f11c4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:48.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.510+0000 7f11d67fc640 1 -- 172.21.15.5:0/1856449600 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7640+0+0 (secure 0 0 0) 0x7f11d00849b0 con 0x7f11e00c9560 2023-07-14T13:05:48.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.514+0000 7f11e5f85640 1 --2- 172.21.15.5:0/1856449600 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f11c40663a0 0x7f11c4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:48.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.514+0000 7f11e5f85640 1 --2- 172.21.15.5:0/1856449600 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f11c40663a0 0x7f11c4068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f11dc0ad000 tx=0x7f11dc008040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:48.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.514+0000 7f11d67fc640 1 -- 172.21.15.5:0/1856449600 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f11d0051540 con 0x7f11e00c9560 2023-07-14T13:05:48.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.706+0000 7f11e81e9640 1 -- 172.21.15.5:0/1856449600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f11e00678d0 con 0x7f11e00c9560 2023-07-14T13:05:48.740 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-07-14T13:05:48.710+0000 7f17b1648640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-14T13:05:48.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.714+0000 7f11d67fc640 1 -- 172.21.15.5:0/1856449600 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f11d0054b60 con 0x7f11e00c9560 2023-07-14T13:05:48.747 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-14T13:05:48.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.718+0000 7f11e81e9640 1 -- 172.21.15.5:0/1856449600 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f11c40663a0 msgr2=0x7f11c4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:48.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.718+0000 7f11e81e9640 1 --2- 172.21.15.5:0/1856449600 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f11c40663a0 0x7f11c4068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f11dc0ad000 tx=0x7f11dc008040 comp rx=0 tx=0).stop 2023-07-14T13:05:48.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.718+0000 7f11e81e9640 1 -- 172.21.15.5:0/1856449600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e00c9560 msgr2=0x7f11e014e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:48.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.718+0000 7f11e81e9640 1 --2- 172.21.15.5:0/1856449600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e00c9560 0x7f11e014e990 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f11d000c7f0 tx=0x7f11d000ccb0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.718+0000 7f11e81e9640 1 -- 172.21.15.5:0/1856449600 shutdown_connections 2023-07-14T13:05:48.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.718+0000 7f11e81e9640 1 --2- 172.21.15.5:0/1856449600 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f11c40663a0 0x7f11c4068850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.718+0000 7f11e81e9640 1 --2- 172.21.15.5:0/1856449600 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11e0158ce0 0x7f11e014eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.718+0000 7f11e81e9640 1 --2- 172.21.15.5:0/1856449600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e00c9560 0x7f11e014e990 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.718+0000 7f11e81e9640 1 --2- 172.21.15.5:0/1856449600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11e00c8ad0 0x7f11e0146ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.718+0000 7f11e81e9640 1 -- 172.21.15.5:0/1856449600 >> 172.21.15.5:0/1856449600 conn(0x7f11e00afcf0 msgr2=0x7f11e0070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:48.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.718+0000 7f11e81e9640 1 -- 172.21.15.5:0/1856449600 shutdown_connections 2023-07-14T13:05:48.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.718+0000 7f11e81e9640 1 -- 172.21.15.5:0/1856449600 wait complete. 2023-07-14T13:05:48.769 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-14T13:05:48.811 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-07-14T13:05:48.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.886+0000 7fd21d3fa640 1 Processor -- start 2023-07-14T13:05:48.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.886+0000 7fd21d3fa640 1 -- start start 2023-07-14T13:05:48.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.886+0000 7fd21d3fa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd218159a70 0x7fd2180ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:48.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.886+0000 7fd21d3fa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2180cbe50 con 0x7fd218071030 2023-07-14T13:05:48.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.886+0000 7fd21d3fa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2180cd660 con 0x7fd21815e060 2023-07-14T13:05:48.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.886+0000 7fd21d3fa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2180cc0a0 con 0x7fd218159a70 2023-07-14T13:05:48.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.886+0000 7fd216ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd218159a70 0x7fd2180ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:48.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.886+0000 7fd216ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd218159a70 0x7fd2180ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33656/0 (socket says 172.21.15.5:33656) 2023-07-14T13:05:48.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.886+0000 7fd216ffd640 1 -- 172.21.15.5:0/2752103595 learned_addr learned my addr 172.21.15.5:0/2752103595 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:48.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.886+0000 7fd216ffd640 1 -- 172.21.15.5:0/2752103595 >> v1:172.21.15.154:6789/0 conn(0x7fd21815e060 legacy=0x7fd218070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:48.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.886+0000 7fd216ffd640 1 -- 172.21.15.5:0/2752103595 >> v1:172.21.15.5:6789/0 conn(0x7fd218071030 legacy=0x7fd2180c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:48.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.886+0000 7fd216ffd640 1 -- 172.21.15.5:0/2752103595 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2180cc380 con 0x7fd218159a70 2023-07-14T13:05:48.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.890+0000 7fd216ffd640 1 --2- 172.21.15.5:0/2752103595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd218159a70 0x7fd2180ccff0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd208009870 tx=0x7fd20801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10916c81b48ff494 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:48.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.890+0000 7fd2167fc640 1 -- 172.21.15.5:0/2752103595 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2080ac630 con 0x7fd218159a70 2023-07-14T13:05:48.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.890+0000 7fd2167fc640 1 -- 172.21.15.5:0/2752103595 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2080ac790 con 0x7fd218159a70 2023-07-14T13:05:48.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.890+0000 7fd2167fc640 1 -- 172.21.15.5:0/2752103595 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2080acb20 con 0x7fd218159a70 2023-07-14T13:05:48.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.890+0000 7fd21d3fa640 1 -- 172.21.15.5:0/2752103595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd218159a70 msgr2=0x7fd2180ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:48.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.890+0000 7fd21d3fa640 1 --2- 172.21.15.5:0/2752103595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd218159a70 0x7fd2180ccff0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd208009870 tx=0x7fd20801c3b0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.890+0000 7fd21d3fa640 1 -- 172.21.15.5:0/2752103595 shutdown_connections 2023-07-14T13:05:48.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.890+0000 7fd21d3fa640 1 --2- 172.21.15.5:0/2752103595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd218159a70 0x7fd2180ccff0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.890+0000 7fd21d3fa640 1 -- 172.21.15.5:0/2752103595 >> 172.21.15.5:0/2752103595 conn(0x7fd2180afac0 msgr2=0x7fd2180afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:48.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.890+0000 7fd21d3fa640 1 -- 172.21.15.5:0/2752103595 shutdown_connections 2023-07-14T13:05:48.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.890+0000 7fd21d3fa640 1 -- 172.21.15.5:0/2752103595 wait complete. 2023-07-14T13:05:48.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.894+0000 7fd21d3fa640 1 Processor -- start 2023-07-14T13:05:48.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.894+0000 7fd21d3fa640 1 -- start start 2023-07-14T13:05:48.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.894+0000 7fd21d3fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd218071030 0x7fd218145b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:48.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.894+0000 7fd21d3fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd218159a70 0x7fd21815c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:48.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.894+0000 7fd21d3fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd21815e060 0x7fd218145350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:48.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.894+0000 7fd21d3fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21815cf10 con 0x7fd218159a70 2023-07-14T13:05:48.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.894+0000 7fd21d3fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21815ae30 con 0x7fd21815e060 2023-07-14T13:05:48.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.894+0000 7fd21d3fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21815b110 con 0x7fd218071030 2023-07-14T13:05:48.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.894+0000 7fd20ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd218159a70 0x7fd21815c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:48.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.894+0000 7fd20ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd218159a70 0x7fd21815c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33666/0 (socket says 172.21.15.5:33666) 2023-07-14T13:05:48.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.894+0000 7fd20ffff640 1 -- 172.21.15.5:0/2272104307 learned_addr learned my addr 172.21.15.5:0/2272104307 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:48.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.894+0000 7fd2177fe640 1 --2- 172.21.15.5:0/2272104307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd21815e060 0x7fd218145350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:48.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.894+0000 7fd216ffd640 1 --2- 172.21.15.5:0/2272104307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd218071030 0x7fd218145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:48.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.894+0000 7fd20ffff640 1 -- 172.21.15.5:0/2272104307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd218071030 msgr2=0x7fd218145b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:48.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.894+0000 7fd20ffff640 1 --2- 172.21.15.5:0/2272104307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd218071030 0x7fd218145b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.894+0000 7fd20ffff640 1 -- 172.21.15.5:0/2272104307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd21815e060 msgr2=0x7fd218145350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:48.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.894+0000 7fd20ffff640 1 --2- 172.21.15.5:0/2272104307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd21815e060 0x7fd218145350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:48.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.894+0000 7fd20ffff640 1 -- 172.21.15.5:0/2272104307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2080094d0 con 0x7fd218159a70 2023-07-14T13:05:48.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.894+0000 7fd20ffff640 1 --2- 172.21.15.5:0/2272104307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd218159a70 0x7fd21815c910 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd20000b410 tx=0x7fd20000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:48.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.894+0000 7fd20f7fe640 1 -- 172.21.15.5:0/2272104307 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd200004020 con 0x7fd218159a70 2023-07-14T13:05:48.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.894+0000 7fd20f7fe640 1 -- 172.21.15.5:0/2272104307 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd200004180 con 0x7fd218159a70 2023-07-14T13:05:48.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.894+0000 7fd20f7fe640 1 -- 172.21.15.5:0/2272104307 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd200011630 con 0x7fd218159a70 2023-07-14T13:05:48.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.894+0000 7fd21d3fa640 1 -- 172.21.15.5:0/2272104307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2180b17c0 con 0x7fd218159a70 2023-07-14T13:05:48.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.894+0000 7fd21d3fa640 1 -- 172.21.15.5:0/2272104307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd21815b3f0 con 0x7fd218159a70 2023-07-14T13:05:48.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.894+0000 7fd21d3fa640 1 -- 172.21.15.5:0/2272104307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2180678d0 con 0x7fd218159a70 2023-07-14T13:05:48.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.898+0000 7fd20f7fe640 1 -- 172.21.15.5:0/2272104307 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd200011790 con 0x7fd218159a70 2023-07-14T13:05:48.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.898+0000 7fd20f7fe640 1 --2- 172.21.15.5:0/2272104307 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fd1f80663a0 0x7fd1f8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:48.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.898+0000 7fd20f7fe640 1 -- 172.21.15.5:0/2272104307 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 7682+0+0 (secure 0 0 0) 0x7fd2000841b0 con 0x7fd218159a70 2023-07-14T13:05:48.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.898+0000 7fd216ffd640 1 --2- 172.21.15.5:0/2272104307 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fd1f80663a0 0x7fd1f8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:48.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.898+0000 7fd216ffd640 1 --2- 172.21.15.5:0/2272104307 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fd1f80663a0 0x7fd1f8068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd2080ae000 tx=0x7fd208009040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:48.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:48.902+0000 7fd20f7fe640 1 -- 172.21.15.5:0/2272104307 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd200050eb0 con 0x7fd218159a70 2023-07-14T13:05:49.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.086+0000 7fd21d3fa640 1 -- 172.21.15.5:0/2272104307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd21806d1d0 con 0x7fd218159a70 2023-07-14T13:05:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.722+0000 7fd20f7fe640 1 -- 172.21.15.5:0/2272104307 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd2000544d0 con 0x7fd218159a70 2023-07-14T13:05:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.722+0000 7fd21d3fa640 1 -- 172.21.15.5:0/2272104307 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fd1f80663a0 msgr2=0x7fd1f8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.722+0000 7fd21d3fa640 1 --2- 172.21.15.5:0/2272104307 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fd1f80663a0 0x7fd1f8068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd2080ae000 tx=0x7fd208009040 comp rx=0 tx=0).stop 2023-07-14T13:05:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.722+0000 7fd21d3fa640 1 -- 172.21.15.5:0/2272104307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd218159a70 msgr2=0x7fd21815c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.722+0000 7fd21d3fa640 1 --2- 172.21.15.5:0/2272104307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd218159a70 0x7fd21815c910 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd20000b410 tx=0x7fd20000b8d0 comp rx=0 tx=0).stop 2023-07-14T13:05:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.722+0000 7fd21d3fa640 1 -- 172.21.15.5:0/2272104307 shutdown_connections 2023-07-14T13:05:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.722+0000 7fd21d3fa640 1 --2- 172.21.15.5:0/2272104307 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fd1f80663a0 0x7fd1f8068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.722+0000 7fd21d3fa640 1 --2- 172.21.15.5:0/2272104307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd21815e060 0x7fd218145350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.722+0000 7fd21d3fa640 1 --2- 172.21.15.5:0/2272104307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd218159a70 0x7fd21815c910 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.722+0000 7fd21d3fa640 1 --2- 172.21.15.5:0/2272104307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd218071030 0x7fd218145b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.722+0000 7fd21d3fa640 1 -- 172.21.15.5:0/2272104307 >> 172.21.15.5:0/2272104307 conn(0x7fd2180afac0 msgr2=0x7fd218150700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.722+0000 7fd21d3fa640 1 -- 172.21.15.5:0/2272104307 shutdown_connections 2023-07-14T13:05:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.722+0000 7fd21d3fa640 1 -- 172.21.15.5:0/2272104307 wait complete. 2023-07-14T13:05:49.778 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-14T13:05:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.938+0000 7f2adb937640 1 Processor -- start 2023-07-14T13:05:49.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.938+0000 7f2adb937640 1 -- start start 2023-07-14T13:05:49.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.938+0000 7f2adb937640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2ad40c3ac0 0x7f2ad40c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:49.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.938+0000 7f2adb937640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ad40af2b0 0x7f2ad40ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:49.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.938+0000 7f2adb937640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad40ca540 con 0x7f2ad40cd120 2023-07-14T13:05:49.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.938+0000 7f2adb937640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad40695b0 con 0x7f2ad40af2b0 2023-07-14T13:05:49.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.938+0000 7f2adb937640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad4069890 con 0x7f2ad40c3ac0 2023-07-14T13:05:49.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.942+0000 7f2ad8ed2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ad40af2b0 0x7f2ad40ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:49.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.942+0000 7f2ad8ed2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ad40af2b0 0x7f2ad40ca000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35228/0 (socket says 172.21.15.5:35228) 2023-07-14T13:05:49.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.942+0000 7f2ad8ed2640 1 -- 172.21.15.5:0/3931495782 learned_addr learned my addr 172.21.15.5:0/3931495782 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:49.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.942+0000 7f2ad8ed2640 1 -- 172.21.15.5:0/3931495782 >> v2:172.21.15.154:3300/0 conn(0x7f2ad40c3ac0 msgr2=0x7f2ad40c2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:49.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.942+0000 7f2ad8ed2640 1 --2- 172.21.15.5:0/3931495782 >> v2:172.21.15.154:3300/0 conn(0x7f2ad40c3ac0 0x7f2ad40c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:49.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.942+0000 7f2ad8ed2640 1 -- 172.21.15.5:0/3931495782 >> v1:172.21.15.154:6789/0 conn(0x7f2ad40cd120 legacy=0x7f2ad40cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:49.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.942+0000 7f2ad8ed2640 1 -- 172.21.15.5:0/3931495782 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad4069b70 con 0x7f2ad40af2b0 2023-07-14T13:05:49.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.942+0000 7f2ad8ed2640 1 --2- 172.21.15.5:0/3931495782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ad40af2b0 0x7f2ad40ca000 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40cef90 tx=0x7f2ac401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74703d2617bddeaa server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:49.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.942+0000 7f2acbfff640 1 -- 172.21.15.5:0/3931495782 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac40a6040 con 0x7f2ad40af2b0 2023-07-14T13:05:49.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.942+0000 7f2acbfff640 1 -- 172.21.15.5:0/3931495782 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac40aa600 con 0x7f2ad40af2b0 2023-07-14T13:05:49.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.942+0000 7f2acbfff640 1 -- 172.21.15.5:0/3931495782 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac40aa990 con 0x7f2ad40af2b0 2023-07-14T13:05:49.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.946+0000 7f2adb937640 1 -- 172.21.15.5:0/3931495782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ad40af2b0 msgr2=0x7f2ad40ca000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:49.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.946+0000 7f2adb937640 1 --2- 172.21.15.5:0/3931495782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ad40af2b0 0x7f2ad40ca000 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40cef90 tx=0x7f2ac401c4c0 comp rx=0 tx=0).stop 2023-07-14T13:05:49.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.946+0000 7f2adb937640 1 -- 172.21.15.5:0/3931495782 shutdown_connections 2023-07-14T13:05:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.946+0000 7f2adb937640 1 --2- 172.21.15.5:0/3931495782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ad40af2b0 0x7f2ad40ca000 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.946+0000 7f2adb937640 1 --2- 172.21.15.5:0/3931495782 >> v2:172.21.15.154:3300/0 conn(0x7f2ad40c3ac0 0x7f2ad40c2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.946+0000 7f2adb937640 1 -- 172.21.15.5:0/3931495782 >> 172.21.15.5:0/3931495782 conn(0x7f2ad40cde90 msgr2=0x7f2ad40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.946+0000 7f2adb937640 1 -- 172.21.15.5:0/3931495782 shutdown_connections 2023-07-14T13:05:49.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.946+0000 7f2adb937640 1 -- 172.21.15.5:0/3931495782 wait complete. 2023-07-14T13:05:49.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.946+0000 7f2adb937640 1 Processor -- start 2023-07-14T13:05:49.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.946+0000 7f2adb937640 1 -- start start 2023-07-14T13:05:49.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.946+0000 7f2adb937640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad40af2b0 0x7f2ad414f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:49.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.946+0000 7f2adb937640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad40c3ac0 0x7f2ad4152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:49.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.946+0000 7f2adb937640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ad40cd120 0x7f2ad41531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:49.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.946+0000 7f2adb937640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad4153700 con 0x7f2ad40cd120 2023-07-14T13:05:49.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.946+0000 7f2adb937640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad4155460 con 0x7f2ad40c3ac0 2023-07-14T13:05:49.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.946+0000 7f2adb937640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad4155740 con 0x7f2ad40af2b0 2023-07-14T13:05:49.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.946+0000 7f2ad9ed4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ad40cd120 0x7f2ad41531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.946+0000 7f2ad9ed4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ad40cd120 0x7f2ad41531c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35238/0 (socket says 172.21.15.5:35238) 2023-07-14T13:05:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.946+0000 7f2ad9ed4640 1 -- 172.21.15.5:0/161993661 learned_addr learned my addr 172.21.15.5:0/161993661 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.946+0000 7f2ad8ed2640 1 --2- 172.21.15.5:0/161993661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad40c3ac0 0x7f2ad4152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.946+0000 7f2ad96d3640 1 --2- 172.21.15.5:0/161993661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad40af2b0 0x7f2ad414f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.946+0000 7f2ad9ed4640 1 -- 172.21.15.5:0/161993661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad40af2b0 msgr2=0x7f2ad414f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.946+0000 7f2ad9ed4640 1 --2- 172.21.15.5:0/161993661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad40af2b0 0x7f2ad414f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:49.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.946+0000 7f2ad9ed4640 1 -- 172.21.15.5:0/161993661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad40c3ac0 msgr2=0x7f2ad4152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.946+0000 7f2ad9ed4640 1 --2- 172.21.15.5:0/161993661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad40c3ac0 0x7f2ad4152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.946+0000 7f2ad9ed4640 1 -- 172.21.15.5:0/161993661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac40094d0 con 0x7f2ad40cd120 2023-07-14T13:05:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.946+0000 7f2ad96d3640 1 --2- 172.21.15.5:0/161993661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad40af2b0 0x7f2ad414f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:05:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.950+0000 7f2ad9ed4640 1 --2- 172.21.15.5:0/161993661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ad40cd120 0x7f2ad41531c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2acc00b990 tx=0x7f2acc00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.950+0000 7f2ac9ffb640 1 -- 172.21.15.5:0/161993661 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc00cba0 con 0x7f2ad40cd120 2023-07-14T13:05:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.950+0000 7f2ac9ffb640 1 -- 172.21.15.5:0/161993661 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2acc00cd00 con 0x7f2ad40cd120 2023-07-14T13:05:49.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.950+0000 7f2ac9ffb640 1 -- 172.21.15.5:0/161993661 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc014680 con 0x7f2ad40cd120 2023-07-14T13:05:49.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.950+0000 7f2adb937640 1 -- 172.21.15.5:0/161993661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad4155a20 con 0x7f2ad40cd120 2023-07-14T13:05:49.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.950+0000 7f2adb937640 1 -- 172.21.15.5:0/161993661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad4155fe0 con 0x7f2ad40cd120 2023-07-14T13:05:49.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.950+0000 7f2adb937640 1 -- 172.21.15.5:0/161993661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad41561d0 con 0x7f2ad40cd120 2023-07-14T13:05:49.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.950+0000 7f2ac9ffb640 1 -- 172.21.15.5:0/161993661 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2acc0147e0 con 0x7f2ad40cd120 2023-07-14T13:05:49.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.950+0000 7f2ac9ffb640 1 --2- 172.21.15.5:0/161993661 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f2ab80663a0 0x7f2ab8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:49.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.950+0000 7f2ac9ffb640 1 -- 172.21.15.5:0/161993661 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 7682+0+0 (secure 0 0 0) 0x7f2acc084470 con 0x7f2ad40cd120 2023-07-14T13:05:49.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.950+0000 7f2ad96d3640 1 --2- 172.21.15.5:0/161993661 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f2ab80663a0 0x7f2ab8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:49.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.954+0000 7f2ad96d3640 1 --2- 172.21.15.5:0/161993661 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f2ab80663a0 0x7f2ab8068850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0006fd0 tx=0x7f2ad0008040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:49.954+0000 7f2ac9ffb640 1 -- 172.21.15.5:0/161993661 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2acc051190 con 0x7f2ad40cd120 2023-07-14T13:05:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.114+0000 7f2adb937640 1 -- 172.21.15.5:0/161993661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2ad40678d0 con 0x7f2ad40cd120 2023-07-14T13:05:50.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.654+0000 7f2ac9ffb640 1 -- 172.21.15.5:0/161993661 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v55) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2acc019070 con 0x7f2ad40cd120 2023-07-14T13:05:50.684 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-07-14T13:05:50.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.654+0000 7f2adb937640 1 -- 172.21.15.5:0/161993661 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f2ab80663a0 msgr2=0x7f2ab8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:50.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.654+0000 7f2adb937640 1 --2- 172.21.15.5:0/161993661 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f2ab80663a0 0x7f2ab8068850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0006fd0 tx=0x7f2ad0008040 comp rx=0 tx=0).stop 2023-07-14T13:05:50.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.654+0000 7f2adb937640 1 -- 172.21.15.5:0/161993661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ad40cd120 msgr2=0x7f2ad41531c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:50.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.654+0000 7f2adb937640 1 --2- 172.21.15.5:0/161993661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ad40cd120 0x7f2ad41531c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2acc00b990 tx=0x7f2acc00be50 comp rx=0 tx=0).stop 2023-07-14T13:05:50.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.654+0000 7f2adb937640 1 -- 172.21.15.5:0/161993661 shutdown_connections 2023-07-14T13:05:50.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.654+0000 7f2adb937640 1 --2- 172.21.15.5:0/161993661 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f2ab80663a0 0x7f2ab8068850 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:50.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.654+0000 7f2adb937640 1 --2- 172.21.15.5:0/161993661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ad40cd120 0x7f2ad41531c0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:50.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.654+0000 7f2adb937640 1 --2- 172.21.15.5:0/161993661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ad40c3ac0 0x7f2ad4152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:50.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.654+0000 7f2adb937640 1 --2- 172.21.15.5:0/161993661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ad40af2b0 0x7f2ad414f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:50.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.654+0000 7f2adb937640 1 -- 172.21.15.5:0/161993661 >> 172.21.15.5:0/161993661 conn(0x7f2ad40cde90 msgr2=0x7f2ad40ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:50.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.658+0000 7f2adb937640 1 -- 172.21.15.5:0/161993661 shutdown_connections 2023-07-14T13:05:50.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.658+0000 7f2adb937640 1 -- 172.21.15.5:0/161993661 wait complete. 2023-07-14T13:05:50.719 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-14T13:05:50.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.838+0000 7fe676818640 1 Processor -- start 2023-07-14T13:05:50.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.838+0000 7fe676818640 1 -- start start 2023-07-14T13:05:50.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.838+0000 7fe676818640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe67015bde0 0x7fe6700d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:50.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.838+0000 7fe676818640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe6700d2300 0x7fe6700d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:50.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.838+0000 7fe676818640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6700b04c0 con 0x7fe6700d2fc0 2023-07-14T13:05:50.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.838+0000 7fe676818640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe67015c1b0 con 0x7fe6700d2300 2023-07-14T13:05:50.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.838+0000 7fe676818640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6700b1060 con 0x7fe67015bde0 2023-07-14T13:05:50.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.838+0000 7fe674db5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe6700d2300 0x7fe6700d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:50.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.838+0000 7fe674db5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe6700d2300 0x7fe6700d2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35248/0 (socket says 172.21.15.5:35248) 2023-07-14T13:05:50.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.838+0000 7fe674db5640 1 -- 172.21.15.5:0/1838538398 learned_addr learned my addr 172.21.15.5:0/1838538398 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:50.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.838+0000 7fe66ffff640 1 --2- 172.21.15.5:0/1838538398 >> v2:172.21.15.154:3300/0 conn(0x7fe67015bde0 0x7fe6700d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:50.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.842+0000 7fe674db5640 1 -- 172.21.15.5:0/1838538398 >> v2:172.21.15.154:3300/0 conn(0x7fe67015bde0 msgr2=0x7fe6700d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:50.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.842+0000 7fe674db5640 1 --2- 172.21.15.5:0/1838538398 >> v2:172.21.15.154:3300/0 conn(0x7fe67015bde0 0x7fe6700d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:50.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.842+0000 7fe674db5640 1 -- 172.21.15.5:0/1838538398 >> v1:172.21.15.154:6789/0 conn(0x7fe6700d2fc0 legacy=0x7fe6700b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:50.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.842+0000 7fe674db5640 1 -- 172.21.15.5:0/1838538398 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6700d2c80 con 0x7fe6700d2300 2023-07-14T13:05:50.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.842+0000 7fe674db5640 1 --2- 172.21.15.5:0/1838538398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700d2300 0x7fe6700d2740 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe67008b210 tx=0x7fe66801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c87806035e18a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:50.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.842+0000 7fe66effd640 1 -- 172.21.15.5:0/1838538398 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6680a57a0 con 0x7fe6700d2300 2023-07-14T13:05:50.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.842+0000 7fe66effd640 1 -- 172.21.15.5:0/1838538398 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6680a5900 con 0x7fe6700d2300 2023-07-14T13:05:50.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.842+0000 7fe66effd640 1 -- 172.21.15.5:0/1838538398 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6680a5c90 con 0x7fe6700d2300 2023-07-14T13:05:50.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.846+0000 7fe676818640 1 -- 172.21.15.5:0/1838538398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700d2300 msgr2=0x7fe6700d2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:50.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.846+0000 7fe676818640 1 --2- 172.21.15.5:0/1838538398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700d2300 0x7fe6700d2740 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe67008b210 tx=0x7fe66801c9d0 comp rx=0 tx=0).stop 2023-07-14T13:05:50.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.846+0000 7fe676818640 1 -- 172.21.15.5:0/1838538398 shutdown_connections 2023-07-14T13:05:50.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.846+0000 7fe676818640 1 --2- 172.21.15.5:0/1838538398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700d2300 0x7fe6700d2740 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:50.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.846+0000 7fe676818640 1 --2- 172.21.15.5:0/1838538398 >> v2:172.21.15.154:3300/0 conn(0x7fe67015bde0 0x7fe6700d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:50.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.846+0000 7fe676818640 1 -- 172.21.15.5:0/1838538398 >> 172.21.15.5:0/1838538398 conn(0x7fe6700659d0 msgr2=0x7fe67009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:50.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.846+0000 7fe676818640 1 -- 172.21.15.5:0/1838538398 shutdown_connections 2023-07-14T13:05:50.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.846+0000 7fe676818640 1 -- 172.21.15.5:0/1838538398 wait complete. 2023-07-14T13:05:50.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.846+0000 7fe676818640 1 Processor -- start 2023-07-14T13:05:50.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.846+0000 7fe676818640 1 -- start start 2023-07-14T13:05:50.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.846+0000 7fe676818640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6700d2300 0x7fe6700b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:50.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.846+0000 7fe676818640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700d2fc0 0x7fe6700b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.846+0000 7fe676818640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe67015bde0 0x7fe67015d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.846+0000 7fe676818640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6700c6610 con 0x7fe6700d2fc0 2023-07-14T13:05:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.846+0000 7fe676818640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6700c6330 con 0x7fe6700d2300 2023-07-14T13:05:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.846+0000 7fe676818640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67015c910 con 0x7fe67015bde0 2023-07-14T13:05:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.846+0000 7fe66f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700d2fc0 0x7fe6700b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.846+0000 7fe66f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700d2fc0 0x7fe6700b7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35256/0 (socket says 172.21.15.5:35256) 2023-07-14T13:05:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.846+0000 7fe66ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6700d2300 0x7fe6700b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.846+0000 7fe66f7fe640 1 -- 172.21.15.5:0/3112315000 learned_addr learned my addr 172.21.15.5:0/3112315000 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.846+0000 7fe674db5640 1 --2- 172.21.15.5:0/3112315000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe67015bde0 0x7fe67015d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:50.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.846+0000 7fe66ffff640 1 -- 172.21.15.5:0/3112315000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe67015bde0 msgr2=0x7fe67015d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:50.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.846+0000 7fe66ffff640 1 --2- 172.21.15.5:0/3112315000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe67015bde0 0x7fe67015d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:50.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.846+0000 7fe66ffff640 1 -- 172.21.15.5:0/3112315000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700d2fc0 msgr2=0x7fe6700b7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:50.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.846+0000 7fe66ffff640 1 --2- 172.21.15.5:0/3112315000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700d2fc0 0x7fe6700b7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:50.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.846+0000 7fe66ffff640 1 -- 172.21.15.5:0/3112315000 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe668009b30 con 0x7fe6700d2300 2023-07-14T13:05:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.846+0000 7fe66f7fe640 1 --2- 172.21.15.5:0/3112315000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700d2fc0 0x7fe6700b7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.850+0000 7fe66ffff640 1 --2- 172.21.15.5:0/3112315000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6700d2300 0x7fe6700b5520 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe66000e870 tx=0x7fe66000ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.850+0000 7fe66cff9640 1 -- 172.21.15.5:0/3112315000 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66000eec0 con 0x7fe6700d2300 2023-07-14T13:05:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.850+0000 7fe66cff9640 1 -- 172.21.15.5:0/3112315000 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66000c940 con 0x7fe6700d2300 2023-07-14T13:05:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.850+0000 7fe66cff9640 1 -- 172.21.15.5:0/3112315000 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66000ccb0 con 0x7fe6700d2300 2023-07-14T13:05:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.850+0000 7fe676818640 1 -- 172.21.15.5:0/3112315000 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe67015cbf0 con 0x7fe6700d2300 2023-07-14T13:05:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.850+0000 7fe676818640 1 -- 172.21.15.5:0/3112315000 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe670157b90 con 0x7fe6700d2300 2023-07-14T13:05:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.850+0000 7fe676818640 1 -- 172.21.15.5:0/3112315000 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe67015c770 con 0x7fe6700d2300 2023-07-14T13:05:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.850+0000 7fe66cff9640 1 -- 172.21.15.5:0/3112315000 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe6600059a0 con 0x7fe6700d2300 2023-07-14T13:05:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.850+0000 7fe66cff9640 1 --2- 172.21.15.5:0/3112315000 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fe65c0663a0 0x7fe65c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.850+0000 7fe66cff9640 1 -- 172.21.15.5:0/3112315000 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 7244+0+0 (secure 0 0 0) 0x7fe6600848a0 con 0x7fe6700d2300 2023-07-14T13:05:50.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.854+0000 7fe66f7fe640 1 --2- 172.21.15.5:0/3112315000 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fe65c0663a0 0x7fe65c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:50.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.854+0000 7fe66f7fe640 1 --2- 172.21.15.5:0/3112315000 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fe65c0663a0 0x7fe65c068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe67015e7d0 tx=0x7fe664009040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:50.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:50.854+0000 7fe66cff9640 1 -- 172.21.15.5:0/3112315000 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe660051800 con 0x7fe6700d2300 2023-07-14T13:05:51.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.014+0000 7fe676818640 1 -- 172.21.15.5:0/3112315000 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe67015c770 con 0x7fe6700d2300 2023-07-14T13:05:51.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.702+0000 7fe66cff9640 1 -- 172.21.15.5:0/3112315000 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v56) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe67015c770 con 0x7fe6700d2300 2023-07-14T13:05:51.735 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-07-14T13:05:51.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.706+0000 7fe676818640 1 -- 172.21.15.5:0/3112315000 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fe65c0663a0 msgr2=0x7fe65c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:51.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.706+0000 7fe676818640 1 --2- 172.21.15.5:0/3112315000 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fe65c0663a0 0x7fe65c068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe67015e7d0 tx=0x7fe664009040 comp rx=0 tx=0).stop 2023-07-14T13:05:51.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.706+0000 7fe676818640 1 -- 172.21.15.5:0/3112315000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6700d2300 msgr2=0x7fe6700b5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:51.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.706+0000 7fe676818640 1 --2- 172.21.15.5:0/3112315000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6700d2300 0x7fe6700b5520 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe66000e870 tx=0x7fe66000ec70 comp rx=0 tx=0).stop 2023-07-14T13:05:51.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.706+0000 7fe676818640 1 -- 172.21.15.5:0/3112315000 shutdown_connections 2023-07-14T13:05:51.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.706+0000 7fe676818640 1 --2- 172.21.15.5:0/3112315000 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fe65c0663a0 0x7fe65c068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:51.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.706+0000 7fe676818640 1 --2- 172.21.15.5:0/3112315000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe67015bde0 0x7fe67015d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:51.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.706+0000 7fe676818640 1 --2- 172.21.15.5:0/3112315000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6700d2fc0 0x7fe6700b7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:51.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.706+0000 7fe676818640 1 --2- 172.21.15.5:0/3112315000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6700d2300 0x7fe6700b5520 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:51.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.706+0000 7fe676818640 1 -- 172.21.15.5:0/3112315000 >> 172.21.15.5:0/3112315000 conn(0x7fe6700659d0 msgr2=0x7fe6700c9440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:51.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.706+0000 7fe676818640 1 -- 172.21.15.5:0/3112315000 shutdown_connections 2023-07-14T13:05:51.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.706+0000 7fe676818640 1 -- 172.21.15.5:0/3112315000 wait complete. 2023-07-14T13:05:51.762 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-14T13:05:51.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.878+0000 7f207e1d2640 1 Processor -- start 2023-07-14T13:05:51.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.878+0000 7f207e1d2640 1 -- start start 2023-07-14T13:05:51.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.882+0000 7f207e1d2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f20781601f0 0x7f20780cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:51.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.882+0000 7f207e1d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f207806a910 0x7f20780d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:51.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.882+0000 7f207e1d2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20780cd1f0 con 0x7f207806a540 2023-07-14T13:05:51.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.882+0000 7f207e1d2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20780cd4d0 con 0x7f20781601f0 2023-07-14T13:05:51.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.882+0000 7f207e1d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20780cd7b0 con 0x7f207806a910 2023-07-14T13:05:51.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.882+0000 7f2076ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f20781601f0 0x7f20780cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:51.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.882+0000 7f2077fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f207806a910 0x7f20780d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:51.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.882+0000 7f20777fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f207806a540 0x7f20780cca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:53072/0 (socket says 172.21.15.5:53072) 2023-07-14T13:05:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.882+0000 7f20777fe640 1 -- 172.21.15.5:0/1175036668 learned_addr learned my addr 172.21.15.5:0/1175036668 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.882+0000 7f20767fc640 1 -- 172.21.15.5:0/1175036668 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2077450159 0 0) 0x7f20780cd1f0 con 0x7f207806a540 2023-07-14T13:05:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.882+0000 7f20767fc640 1 -- 172.21.15.5:0/1175036668 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2060003530 con 0x7f207806a540 2023-07-14T13:05:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.882+0000 7f2076ffd640 1 -- 172.21.15.5:0/1175036668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f207806a910 msgr2=0x7f20780d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.882+0000 7f2076ffd640 1 --2- 172.21.15.5:0/1175036668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f207806a910 0x7f20780d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:51.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.882+0000 7f2076ffd640 1 -- 172.21.15.5:0/1175036668 >> v1:172.21.15.154:6789/0 conn(0x7f207806a540 legacy=0x7f20780cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:51.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.882+0000 7f2076ffd640 1 -- 172.21.15.5:0/1175036668 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20780cfe40 con 0x7f20781601f0 2023-07-14T13:05:51.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.882+0000 7f2077fff640 1 --2- 172.21.15.5:0/1175036668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f207806a910 0x7f20780d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:51.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.886+0000 7f2076ffd640 1 --2- 172.21.15.5:0/1175036668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20781601f0 0x7f20780cdcd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f206c0097c0 tx=0x7f206c01c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36faca88ba23624c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:51.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.886+0000 7f20767fc640 1 -- 172.21.15.5:0/1175036668 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206c0ab600 con 0x7f20781601f0 2023-07-14T13:05:51.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.886+0000 7f20767fc640 1 -- 172.21.15.5:0/1175036668 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206c0a7050 con 0x7f20781601f0 2023-07-14T13:05:51.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.886+0000 7f20767fc640 1 -- 172.21.15.5:0/1175036668 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206c0ab960 con 0x7f20781601f0 2023-07-14T13:05:51.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.886+0000 7f207e1d2640 1 -- 172.21.15.5:0/1175036668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20781601f0 msgr2=0x7f20780cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:51.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.886+0000 7f207e1d2640 1 --2- 172.21.15.5:0/1175036668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20781601f0 0x7f20780cdcd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f206c0097c0 tx=0x7f206c01c360 comp rx=0 tx=0).stop 2023-07-14T13:05:51.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.886+0000 7f207e1d2640 1 -- 172.21.15.5:0/1175036668 shutdown_connections 2023-07-14T13:05:51.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.886+0000 7f207e1d2640 1 --2- 172.21.15.5:0/1175036668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f207806a910 0x7f20780d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:51.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.886+0000 7f207e1d2640 1 --2- 172.21.15.5:0/1175036668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20781601f0 0x7f20780cdcd0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:51.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.886+0000 7f207e1d2640 1 -- 172.21.15.5:0/1175036668 >> 172.21.15.5:0/1175036668 conn(0x7f2078099490 msgr2=0x7f2078089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:51.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.886+0000 7f207e1d2640 1 -- 172.21.15.5:0/1175036668 shutdown_connections 2023-07-14T13:05:51.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.886+0000 7f207e1d2640 1 -- 172.21.15.5:0/1175036668 wait complete. 2023-07-14T13:05:51.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.886+0000 7f207e1d2640 1 Processor -- start 2023-07-14T13:05:51.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.886+0000 7f207e1d2640 1 -- start start 2023-07-14T13:05:51.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.890+0000 7f207e1d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f207806a540 0x7f20780addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:51.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.890+0000 7f207e1d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f207806a910 0x7f207814f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:51.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.890+0000 7f207e1d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20781601f0 0x7f2078153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:51.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.890+0000 7f207e1d2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20780ae330 con 0x7f207806a540 2023-07-14T13:05:51.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.890+0000 7f207e1d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20781f7dc0 con 0x7f20781601f0 2023-07-14T13:05:51.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.890+0000 7f207e1d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20781f80a0 con 0x7f207806a910 2023-07-14T13:05:51.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.890+0000 7f20777fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f207806a540 0x7f20780addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:51.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.890+0000 7f20777fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f207806a540 0x7f20780addf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35258/0 (socket says 172.21.15.5:35258) 2023-07-14T13:05:51.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.890+0000 7f20777fe640 1 -- 172.21.15.5:0/1200583091 learned_addr learned my addr 172.21.15.5:0/1200583091 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:51.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.890+0000 7f20777fe640 1 -- 172.21.15.5:0/1200583091 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f207806a910 msgr2=0x7f207814f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:51.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.890+0000 7f20777fe640 1 --2- 172.21.15.5:0/1200583091 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f207806a910 0x7f207814f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.890+0000 7f20777fe640 1 -- 172.21.15.5:0/1200583091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20781601f0 msgr2=0x7f2078153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.890+0000 7f2077fff640 1 --2- 172.21.15.5:0/1200583091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20781601f0 0x7f2078153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.890+0000 7f20777fe640 1 --2- 172.21.15.5:0/1200583091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20781601f0 0x7f2078153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.890+0000 7f20777fe640 1 -- 172.21.15.5:0/1200583091 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2070009a70 con 0x7f207806a540 2023-07-14T13:05:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.890+0000 7f2077fff640 1 --2- 172.21.15.5:0/1200583091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20781601f0 0x7f2078153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:05:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.890+0000 7f20777fe640 1 --2- 172.21.15.5:0/1200583091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f207806a540 0x7f20780addf0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f206800c400 tx=0x7f206800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:51.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.890+0000 7f205ffff640 1 -- 172.21.15.5:0/1200583091 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2068005d40 con 0x7f207806a540 2023-07-14T13:05:51.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.890+0000 7f205ffff640 1 -- 172.21.15.5:0/1200583091 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20680070d0 con 0x7f207806a540 2023-07-14T13:05:51.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.890+0000 7f205ffff640 1 -- 172.21.15.5:0/1200583091 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2068007480 con 0x7f207806a540 2023-07-14T13:05:51.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.890+0000 7f207e1d2640 1 -- 172.21.15.5:0/1200583091 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f206c009420 con 0x7f207806a540 2023-07-14T13:05:51.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.890+0000 7f207e1d2640 1 -- 172.21.15.5:0/1200583091 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20781f8660 con 0x7f207806a540 2023-07-14T13:05:51.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.890+0000 7f207e1d2640 1 -- 172.21.15.5:0/1200583091 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20780678d0 con 0x7f207806a540 2023-07-14T13:05:51.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.890+0000 7f205ffff640 1 -- 172.21.15.5:0/1200583091 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f20680075e0 con 0x7f207806a540 2023-07-14T13:05:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.894+0000 7f205ffff640 1 --2- 172.21.15.5:0/1200583091 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f20640663a0 0x7f2064068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.894+0000 7f205ffff640 1 -- 172.21.15.5:0/1200583091 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5941+0+0 (secure 0 0 0) 0x7f20680834f0 con 0x7f207806a540 2023-07-14T13:05:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.894+0000 7f2076ffd640 1 --2- 172.21.15.5:0/1200583091 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f20640663a0 0x7f2064068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.894+0000 7f2076ffd640 1 --2- 172.21.15.5:0/1200583091 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f20640663a0 0x7f2064068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f206c0ad000 tx=0x7f206c004740 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:51.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:51.898+0000 7f205ffff640 1 -- 172.21.15.5:0/1200583091 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2068050830 con 0x7f207806a540 2023-07-14T13:05:52.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.054+0000 7f207e1d2640 1 -- 172.21.15.5:0/1200583091 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f20780698a0 con 0x7f207806a540 2023-07-14T13:05:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.058+0000 7f205ffff640 1 -- 172.21.15.5:0/1200583091 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v13) v1 ==== 120+0+0 (secure 0 0 0) 0x7f2068053e50 con 0x7f207806a540 2023-07-14T13:05:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.058+0000 7f207e1d2640 1 -- 172.21.15.5:0/1200583091 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f20640663a0 msgr2=0x7f2064068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.058+0000 7f207e1d2640 1 --2- 172.21.15.5:0/1200583091 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f20640663a0 0x7f2064068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f206c0ad000 tx=0x7f206c004740 comp rx=0 tx=0).stop 2023-07-14T13:05:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.058+0000 7f207e1d2640 1 -- 172.21.15.5:0/1200583091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f207806a540 msgr2=0x7f20780addf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.058+0000 7f207e1d2640 1 --2- 172.21.15.5:0/1200583091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f207806a540 0x7f20780addf0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f206800c400 tx=0x7f206800c8c0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.058+0000 7f207e1d2640 1 -- 172.21.15.5:0/1200583091 shutdown_connections 2023-07-14T13:05:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.062+0000 7f207e1d2640 1 --2- 172.21.15.5:0/1200583091 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f20640663a0 0x7f2064068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.062+0000 7f207e1d2640 1 --2- 172.21.15.5:0/1200583091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20781601f0 0x7f2078153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.062+0000 7f207e1d2640 1 --2- 172.21.15.5:0/1200583091 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f207806a910 0x7f207814f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.062+0000 7f207e1d2640 1 --2- 172.21.15.5:0/1200583091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f207806a540 0x7f20780addf0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.062+0000 7f207e1d2640 1 -- 172.21.15.5:0/1200583091 >> 172.21.15.5:0/1200583091 conn(0x7f2078099490 msgr2=0x7f207806e790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.062+0000 7f207e1d2640 1 -- 172.21.15.5:0/1200583091 shutdown_connections 2023-07-14T13:05:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.062+0000 7f207e1d2640 1 -- 172.21.15.5:0/1200583091 wait complete. 2023-07-14T13:05:52.111 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-14T13:05:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f86a62ca640 1 Processor -- start 2023-07-14T13:05:52.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f86a62ca640 1 -- start start 2023-07-14T13:05:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f86a62ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86a0159500 0x7f86a00cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f86a62ca640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a00b08d0 con 0x7f86a00cd670 2023-07-14T13:05:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f86a62ca640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a0159cb0 con 0x7f86a0156560 2023-07-14T13:05:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f86a62ca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a01599d0 con 0x7f86a0159500 2023-07-14T13:05:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f869f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f86a00cd670 0x7f86a0158df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54184/0 (socket says 172.21.15.5:54184) 2023-07-14T13:05:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f869f7fe640 1 -- 172.21.15.5:0/3183221293 learned_addr learned my addr 172.21.15.5:0/3183221293 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f86a4867640 1 --2- 172.21.15.5:0/3183221293 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86a0159500 0x7f86a00cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:52.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f869effd640 1 -- 172.21.15.5:0/3183221293 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 190009606 0 0) 0x7f86a00b08d0 con 0x7f86a00cd670 2023-07-14T13:05:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f869effd640 1 -- 172.21.15.5:0/3183221293 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8688003530 con 0x7f86a00cd670 2023-07-14T13:05:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f869effd640 1 -- 172.21.15.5:0/3183221293 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697155252 0 0) 0x7f86a0159cb0 con 0x7f86a0156560 2023-07-14T13:05:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f869effd640 1 -- 172.21.15.5:0/3183221293 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86a00b08d0 con 0x7f86a0156560 2023-07-14T13:05:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f869effd640 1 -- 172.21.15.5:0/3183221293 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1989530309 0 0) 0x7f8688003530 con 0x7f86a00cd670 2023-07-14T13:05:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f869effd640 1 -- 172.21.15.5:0/3183221293 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86a0159500 msgr2=0x7f86a00cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f869effd640 1 --2- 172.21.15.5:0/3183221293 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86a0159500 0x7f86a00cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f869effd640 1 -- 172.21.15.5:0/3183221293 >> v1:172.21.15.154:6789/0 conn(0x7f86a0156560 legacy=0x7f86a00ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f869effd640 1 -- 172.21.15.5:0/3183221293 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a00ca900 con 0x7f86a00cd670 2023-07-14T13:05:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f869effd640 1 -- 172.21.15.5:0/3183221293 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f8694001680 con 0x7f86a00cd670 2023-07-14T13:05:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f869effd640 1 -- 172.21.15.5:0/3183221293 >> v1:172.21.15.5:6789/0 conn(0x7f86a00cd670 legacy=0x7f86a0158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f869effd640 1 --2- 172.21.15.5:0/3183221293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8688003b40 0x7f8688003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f869effd640 1 --2- 172.21.15.5:0/3183221293 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86a0159500 0x7f86880047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f869effd640 1 --2- 172.21.15.5:0/3183221293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8688004d10 0x7f8688005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f869effd640 1 -- 172.21.15.5:0/3183221293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a01599d0 con 0x7f8688003b40 2023-07-14T13:05:52.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f869effd640 1 -- 172.21.15.5:0/3183221293 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868800ba70 con 0x7f8688004d10 2023-07-14T13:05:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f869effd640 1 -- 172.21.15.5:0/3183221293 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868800bc30 con 0x7f86a0159500 2023-07-14T13:05:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f869ffff640 1 --2- 172.21.15.5:0/3183221293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8688003b40 0x7f8688003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f869f7fe640 1 --2- 172.21.15.5:0/3183221293 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86a0159500 0x7f86880047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f86a4867640 1 --2- 172.21.15.5:0/3183221293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8688004d10 0x7f8688005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f869ffff640 1 -- 172.21.15.5:0/3183221293 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86a0159500 msgr2=0x7f86880047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f869ffff640 1 --2- 172.21.15.5:0/3183221293 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86a0159500 0x7f86880047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f869ffff640 1 -- 172.21.15.5:0/3183221293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8688004d10 msgr2=0x7f8688005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:52.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f869ffff640 1 --2- 172.21.15.5:0/3183221293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8688004d10 0x7f8688005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.230+0000 7f869ffff640 1 -- 172.21.15.5:0/3183221293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8688003530 con 0x7f8688003b40 2023-07-14T13:05:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.234+0000 7f869ffff640 1 --2- 172.21.15.5:0/3183221293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8688003b40 0x7f8688003f30 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8690007fd0 tx=0x7f869001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412d19db6b45d3c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.234+0000 7f869effd640 1 -- 172.21.15.5:0/3183221293 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86900052d0 con 0x7f8688003b40 2023-07-14T13:05:52.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.234+0000 7f869effd640 1 -- 172.21.15.5:0/3183221293 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8690005450 con 0x7f8688003b40 2023-07-14T13:05:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.234+0000 7f869effd640 1 -- 172.21.15.5:0/3183221293 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8690003840 con 0x7f8688003b40 2023-07-14T13:05:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.234+0000 7f86a62ca640 1 -- 172.21.15.5:0/3183221293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8688003b40 msgr2=0x7f8688003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.234+0000 7f86a62ca640 1 --2- 172.21.15.5:0/3183221293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8688003b40 0x7f8688003f30 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8690007fd0 tx=0x7f869001c510 comp rx=0 tx=0).stop 2023-07-14T13:05:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.234+0000 7f86a4867640 1 -- 172.21.15.5:0/3183221293 reap_dead start 2023-07-14T13:05:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.234+0000 7f86a62ca640 1 -- 172.21.15.5:0/3183221293 shutdown_connections 2023-07-14T13:05:52.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.234+0000 7f86a62ca640 1 -- 172.21.15.5:0/3183221293 >> 172.21.15.5:0/3183221293 conn(0x7f86a00afac0 msgr2=0x7f86a00afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.234+0000 7f86a62ca640 1 -- 172.21.15.5:0/3183221293 shutdown_connections 2023-07-14T13:05:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.234+0000 7f86a62ca640 1 -- 172.21.15.5:0/3183221293 wait complete. 2023-07-14T13:05:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.238+0000 7f86a62ca640 1 Processor -- start 2023-07-14T13:05:52.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.238+0000 7f86a62ca640 1 -- start start 2023-07-14T13:05:52.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.238+0000 7f86a62ca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8688003b40 0x7f86a01f0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.238+0000 7f86a62ca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86a00b2220 0x7f86a0154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.238+0000 7f86a62ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86a014b5b0 0x7f86a0070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.238+0000 7f86a62ca640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a01545b0 con 0x7f8688003b40 2023-07-14T13:05:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.238+0000 7f86a62ca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a014bce0 con 0x7f86a00b2220 2023-07-14T13:05:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.238+0000 7f86a62ca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a01f0c70 con 0x7f86a014b5b0 2023-07-14T13:05:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.238+0000 7f869ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8688003b40 0x7f86a01f0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:52.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.238+0000 7f869ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8688003b40 0x7f86a01f0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35274/0 (socket says 172.21.15.5:35274) 2023-07-14T13:05:52.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.238+0000 7f869ffff640 1 -- 172.21.15.5:0/2537731538 learned_addr learned my addr 172.21.15.5:0/2537731538 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:52.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.238+0000 7f869f7fe640 1 --2- 172.21.15.5:0/2537731538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86a00b2220 0x7f86a0154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:52.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.238+0000 7f86a4867640 1 --2- 172.21.15.5:0/2537731538 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86a014b5b0 0x7f86a0070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:52.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.238+0000 7f869ffff640 1 -- 172.21.15.5:0/2537731538 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86a014b5b0 msgr2=0x7f86a0070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:52.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.238+0000 7f869ffff640 1 --2- 172.21.15.5:0/2537731538 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86a014b5b0 0x7f86a0070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.238+0000 7f869ffff640 1 -- 172.21.15.5:0/2537731538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86a00b2220 msgr2=0x7f86a0154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:52.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.238+0000 7f869ffff640 1 --2- 172.21.15.5:0/2537731538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86a00b2220 0x7f86a0154070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.238+0000 7f869ffff640 1 -- 172.21.15.5:0/2537731538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a01f0f50 con 0x7f8688003b40 2023-07-14T13:05:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.238+0000 7f869ffff640 1 --2- 172.21.15.5:0/2537731538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8688003b40 0x7f86a01f0570 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f869001c340 tx=0x7f8688005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.238+0000 7f869cff9640 1 -- 172.21.15.5:0/2537731538 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8690003e70 con 0x7f8688003b40 2023-07-14T13:05:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.238+0000 7f869cff9640 1 -- 172.21.15.5:0/2537731538 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8690005070 con 0x7f8688003b40 2023-07-14T13:05:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.238+0000 7f869cff9640 1 -- 172.21.15.5:0/2537731538 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86900067e0 con 0x7f8688003b40 2023-07-14T13:05:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.238+0000 7f86a62ca640 1 -- 172.21.15.5:0/2537731538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a01f1230 con 0x7f8688003b40 2023-07-14T13:05:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.242+0000 7f86a62ca640 1 -- 172.21.15.5:0/2537731538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a014ba50 con 0x7f8688003b40 2023-07-14T13:05:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.242+0000 7f86a62ca640 1 -- 172.21.15.5:0/2537731538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a00afec0 con 0x7f8688003b40 2023-07-14T13:05:52.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.242+0000 7f869cff9640 1 -- 172.21.15.5:0/2537731538 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8690006940 con 0x7f8688003b40 2023-07-14T13:05:52.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.242+0000 7f869cff9640 1 --2- 172.21.15.5:0/2537731538 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f868c0663d0 0x7f868c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.242+0000 7f869cff9640 1 -- 172.21.15.5:0/2537731538 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5941+0+0 (secure 0 0 0) 0x7f869011de20 con 0x7f8688003b40 2023-07-14T13:05:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.242+0000 7f869f7fe640 1 --2- 172.21.15.5:0/2537731538 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f868c0663d0 0x7f868c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:52.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.242+0000 7f869f7fe640 1 --2- 172.21.15.5:0/2537731538 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f868c0663d0 0x7f868c068880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f86940017b0 tx=0x7f86940016a0 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:52.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.246+0000 7f869cff9640 1 -- 172.21.15.5:0/2537731538 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f86900eb220 con 0x7f8688003b40 2023-07-14T13:05:52.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.402+0000 7f86a62ca640 1 -- 172.21.15.5:0/2537731538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f86a01f16e0 con 0x7f8688003b40 2023-07-14T13:05:52.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.410+0000 7f869cff9640 1 -- 172.21.15.5:0/2537731538 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v14) v1 ==== 104+0+0 (secure 0 0 0) 0x7f86900ee840 con 0x7f8688003b40 2023-07-14T13:05:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.410+0000 7f86a62ca640 1 -- 172.21.15.5:0/2537731538 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f868c0663d0 msgr2=0x7f868c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:52.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.410+0000 7f86a62ca640 1 --2- 172.21.15.5:0/2537731538 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f868c0663d0 0x7f868c068880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f86940017b0 tx=0x7f86940016a0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.410+0000 7f86a62ca640 1 -- 172.21.15.5:0/2537731538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8688003b40 msgr2=0x7f86a01f0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.410+0000 7f86a62ca640 1 --2- 172.21.15.5:0/2537731538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8688003b40 0x7f86a01f0570 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f869001c340 tx=0x7f8688005800 comp rx=0 tx=0).stop 2023-07-14T13:05:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.410+0000 7f86a62ca640 1 -- 172.21.15.5:0/2537731538 shutdown_connections 2023-07-14T13:05:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.410+0000 7f86a62ca640 1 --2- 172.21.15.5:0/2537731538 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f868c0663d0 0x7f868c068880 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.410+0000 7f86a62ca640 1 --2- 172.21.15.5:0/2537731538 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86a014b5b0 0x7f86a0070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.410+0000 7f86a62ca640 1 --2- 172.21.15.5:0/2537731538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86a00b2220 0x7f86a0154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.410+0000 7f86a62ca640 1 --2- 172.21.15.5:0/2537731538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8688003b40 0x7f86a01f0570 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.410+0000 7f86a62ca640 1 -- 172.21.15.5:0/2537731538 >> 172.21.15.5:0/2537731538 conn(0x7f86a00afac0 msgr2=0x7f86a00adac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.410+0000 7f86a62ca640 1 -- 172.21.15.5:0/2537731538 shutdown_connections 2023-07-14T13:05:52.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.410+0000 7f86a62ca640 1 -- 172.21.15.5:0/2537731538 wait complete. 2023-07-14T13:05:52.461 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-14T13:05:52.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.578+0000 7f67aa293640 1 Processor -- start 2023-07-14T13:05:52.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.578+0000 7f67aa293640 1 -- start start 2023-07-14T13:05:52.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.578+0000 7f67aa293640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67a406c5d0 0x7f67a406ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:52.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.578+0000 7f67aa293640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f67a4158e40 0x7f67a41592a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:52.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.578+0000 7f67aa293640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67a41597e0 con 0x7f67a41564a0 2023-07-14T13:05:52.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.578+0000 7f67aa293640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67a40cb8b0 con 0x7f67a4158e40 2023-07-14T13:05:52.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.578+0000 7f67aa293640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a40cad10 con 0x7f67a406c5d0 2023-07-14T13:05:52.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.578+0000 7f67a8830640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f67a4158e40 0x7f67a41592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:52.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.578+0000 7f67a3fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f67a41564a0 0x7f67a40cb1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:53084/0 (socket says 172.21.15.5:53084) 2023-07-14T13:05:52.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.578+0000 7f67a3fff640 1 -- 172.21.15.5:0/1023342966 learned_addr learned my addr 172.21.15.5:0/1023342966 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:52.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.578+0000 7f67a37fe640 1 --2- 172.21.15.5:0/1023342966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67a406c5d0 0x7f67a406ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:52.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.578+0000 7f67a8830640 1 -- 172.21.15.5:0/1023342966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67a406c5d0 msgr2=0x7f67a406ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:52.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.578+0000 7f67a8830640 1 --2- 172.21.15.5:0/1023342966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67a406c5d0 0x7f67a406ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.578+0000 7f67a8830640 1 -- 172.21.15.5:0/1023342966 >> v1:172.21.15.154:6789/0 conn(0x7f67a41564a0 legacy=0x7f67a40cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:52.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.578+0000 7f67a8830640 1 -- 172.21.15.5:0/1023342966 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a406cf40 con 0x7f67a4158e40 2023-07-14T13:05:52.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.578+0000 7f67a2ffd640 1 -- 172.21.15.5:0/1023342966 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558712753 0 0) 0x7f6794001120 con 0x7f67a41564a0 2023-07-14T13:05:52.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.582+0000 7f67a8830640 1 --2- 172.21.15.5:0/1023342966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67a4158e40 0x7f67a41592a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f679c009d90 tx=0x7f679c01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f6b09779acaefa2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:52.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.582+0000 7f67a2ffd640 1 -- 172.21.15.5:0/1023342966 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c0a5900 con 0x7f67a4158e40 2023-07-14T13:05:52.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.582+0000 7f67a2ffd640 1 -- 172.21.15.5:0/1023342966 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679c0a5a60 con 0x7f67a4158e40 2023-07-14T13:05:52.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.582+0000 7f67a2ffd640 1 -- 172.21.15.5:0/1023342966 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c0a5df0 con 0x7f67a4158e40 2023-07-14T13:05:52.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.582+0000 7f67aa293640 1 -- 172.21.15.5:0/1023342966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67a4158e40 msgr2=0x7f67a41592a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.582+0000 7f67aa293640 1 --2- 172.21.15.5:0/1023342966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67a4158e40 0x7f67a41592a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f679c009d90 tx=0x7f679c01c950 comp rx=0 tx=0).stop 2023-07-14T13:05:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.582+0000 7f67aa293640 1 -- 172.21.15.5:0/1023342966 shutdown_connections 2023-07-14T13:05:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.582+0000 7f67aa293640 1 --2- 172.21.15.5:0/1023342966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67a4158e40 0x7f67a41592a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.582+0000 7f67aa293640 1 --2- 172.21.15.5:0/1023342966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67a406c5d0 0x7f67a406ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.582+0000 7f67aa293640 1 -- 172.21.15.5:0/1023342966 >> 172.21.15.5:0/1023342966 conn(0x7f67a40afc10 msgr2=0x7f67a40affe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.582+0000 7f67aa293640 1 -- 172.21.15.5:0/1023342966 shutdown_connections 2023-07-14T13:05:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.582+0000 7f67aa293640 1 -- 172.21.15.5:0/1023342966 wait complete. 2023-07-14T13:05:52.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.586+0000 7f67aa293640 1 Processor -- start 2023-07-14T13:05:52.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.586+0000 7f67aa293640 1 -- start start 2023-07-14T13:05:52.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.586+0000 7f67aa293640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67a406c5d0 0x7f67a4149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:52.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.586+0000 7f67aa293640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67a41564a0 0x7f67a41f9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:52.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.586+0000 7f67aa293640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67a4158e40 0x7f67a40b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:52.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.586+0000 7f67aa293640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a414a0a0 con 0x7f67a41564a0 2023-07-14T13:05:52.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.586+0000 7f67aa293640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a41f9c80 con 0x7f67a4158e40 2023-07-14T13:05:52.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.586+0000 7f67aa293640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a40b31a0 con 0x7f67a406c5d0 2023-07-14T13:05:52.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.586+0000 7f67a37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67a41564a0 0x7f67a41f9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:52.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.586+0000 7f67a37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67a41564a0 0x7f67a41f9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35278/0 (socket says 172.21.15.5:35278) 2023-07-14T13:05:52.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.586+0000 7f67a37fe640 1 -- 172.21.15.5:0/4261461638 learned_addr learned my addr 172.21.15.5:0/4261461638 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:52.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.586+0000 7f67a3fff640 1 --2- 172.21.15.5:0/4261461638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67a406c5d0 0x7f67a4149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.586+0000 7f67a8830640 1 --2- 172.21.15.5:0/4261461638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67a4158e40 0x7f67a40b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.586+0000 7f67a37fe640 1 -- 172.21.15.5:0/4261461638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67a406c5d0 msgr2=0x7f67a4149b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.586+0000 7f67a37fe640 1 --2- 172.21.15.5:0/4261461638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67a406c5d0 0x7f67a4149b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.586+0000 7f67a37fe640 1 -- 172.21.15.5:0/4261461638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67a4158e40 msgr2=0x7f67a40b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.586+0000 7f67a37fe640 1 --2- 172.21.15.5:0/4261461638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67a4158e40 0x7f67a40b2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.586+0000 7f67a37fe640 1 -- 172.21.15.5:0/4261461638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679c009a70 con 0x7f67a41564a0 2023-07-14T13:05:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.586+0000 7f67a37fe640 1 --2- 172.21.15.5:0/4261461638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67a41564a0 0x7f67a41f9740 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f679800e930 tx=0x7f679800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.586+0000 7f67a0ff9640 1 -- 172.21.15.5:0/4261461638 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6798009690 con 0x7f67a41564a0 2023-07-14T13:05:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.586+0000 7f67a0ff9640 1 -- 172.21.15.5:0/4261461638 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679800c9a0 con 0x7f67a41564a0 2023-07-14T13:05:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.586+0000 7f67a0ff9640 1 -- 172.21.15.5:0/4261461638 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679800cd10 con 0x7f67a41564a0 2023-07-14T13:05:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.586+0000 7f67aa293640 1 -- 172.21.15.5:0/4261461638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67a41fc080 con 0x7f67a41564a0 2023-07-14T13:05:52.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.586+0000 7f67aa293640 1 -- 172.21.15.5:0/4261461638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67a41fc640 con 0x7f67a41564a0 2023-07-14T13:05:52.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.590+0000 7f67aa293640 1 -- 172.21.15.5:0/4261461638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67a40ca5a0 con 0x7f67a41564a0 2023-07-14T13:05:52.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.590+0000 7f67a0ff9640 1 -- 172.21.15.5:0/4261461638 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6798013470 con 0x7f67a41564a0 2023-07-14T13:05:52.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.590+0000 7f67a0ff9640 1 --2- 172.21.15.5:0/4261461638 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f67900663a0 0x7f6790068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:52.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.590+0000 7f67a0ff9640 1 -- 172.21.15.5:0/4261461638 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5941+0+0 (secure 0 0 0) 0x7f6798084080 con 0x7f67a41564a0 2023-07-14T13:05:52.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.590+0000 7f67a3fff640 1 --2- 172.21.15.5:0/4261461638 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f67900663a0 0x7f6790068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:52.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.590+0000 7f67a3fff640 1 --2- 172.21.15.5:0/4261461638 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f67900663a0 0x7f6790068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6794007fd0 tx=0x7f6794007a20 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:52.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.594+0000 7f67a0ff9640 1 -- 172.21.15.5:0/4261461638 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f67980b4720 con 0x7f67a41564a0 2023-07-14T13:05:52.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.750+0000 7f67aa293640 1 -- 172.21.15.5:0/4261461638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f67a40678d0 con 0x7f67a41564a0 2023-07-14T13:05:52.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.754+0000 7f67a0ff9640 1 -- 172.21.15.5:0/4261461638 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v15) v1 ==== 115+0+0 (secure 0 0 0) 0x7f67980170b0 con 0x7f67a41564a0 2023-07-14T13:05:52.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.758+0000 7f67aa293640 1 -- 172.21.15.5:0/4261461638 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f67900663a0 msgr2=0x7f6790068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:52.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.758+0000 7f67aa293640 1 --2- 172.21.15.5:0/4261461638 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f67900663a0 0x7f6790068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6794007fd0 tx=0x7f6794007a20 comp rx=0 tx=0).stop 2023-07-14T13:05:52.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.758+0000 7f67aa293640 1 -- 172.21.15.5:0/4261461638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67a41564a0 msgr2=0x7f67a41f9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:52.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.758+0000 7f67aa293640 1 --2- 172.21.15.5:0/4261461638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67a41564a0 0x7f67a41f9740 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f679800e930 tx=0x7f679800edf0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.758+0000 7f67aa293640 1 -- 172.21.15.5:0/4261461638 shutdown_connections 2023-07-14T13:05:52.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.758+0000 7f67aa293640 1 --2- 172.21.15.5:0/4261461638 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f67900663a0 0x7f6790068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.758+0000 7f67aa293640 1 --2- 172.21.15.5:0/4261461638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67a4158e40 0x7f67a40b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.758+0000 7f67aa293640 1 --2- 172.21.15.5:0/4261461638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67a41564a0 0x7f67a41f9740 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.758+0000 7f67aa293640 1 --2- 172.21.15.5:0/4261461638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f67a406c5d0 0x7f67a4149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.758+0000 7f67aa293640 1 -- 172.21.15.5:0/4261461638 >> 172.21.15.5:0/4261461638 conn(0x7f67a40afc10 msgr2=0x7f67a40cb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:52.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.758+0000 7f67aa293640 1 -- 172.21.15.5:0/4261461638 shutdown_connections 2023-07-14T13:05:52.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.758+0000 7f67aa293640 1 -- 172.21.15.5:0/4261461638 wait complete. 2023-07-14T13:05:52.808 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-07-14T13:05:52.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.918+0000 7fb35baf9640 1 Processor -- start 2023-07-14T13:05:52.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.918+0000 7fb35baf9640 1 -- start start 2023-07-14T13:05:52.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.922+0000 7fb35baf9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb3540c8940 0x7fb3540cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:52.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.922+0000 7fb35baf9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3540c17d0 con 0x7fb354160330 2023-07-14T13:05:52.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.922+0000 7fb35baf9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3540c14f0 con 0x7fb3540c0f80 2023-07-14T13:05:52.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.922+0000 7fb35baf9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3540cdd70 con 0x7fb3540c8940 2023-07-14T13:05:52.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.922+0000 7fb359094640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb3540c8940 0x7fb3540cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:52.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.922+0000 7fb359895640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb354160330 0x7fb3540ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54188/0 (socket says 172.21.15.5:54188) 2023-07-14T13:05:52.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.922+0000 7fb359895640 1 -- 172.21.15.5:0/865789229 learned_addr learned my addr 172.21.15.5:0/865789229 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:52.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.922+0000 7fb359094640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb3540c8940 0x7fb3540cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35280/0 (socket says 172.21.15.5:35280) 2023-07-14T13:05:52.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.922+0000 7fb359094640 1 -- 172.21.15.5:0/865789229 >> v1:172.21.15.154:6789/0 conn(0x7fb3540c0f80 legacy=0x7fb3540cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:52.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.922+0000 7fb359094640 1 -- 172.21.15.5:0/865789229 >> v1:172.21.15.5:6789/0 conn(0x7fb354160330 legacy=0x7fb3540ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:52.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.922+0000 7fb359094640 1 -- 172.21.15.5:0/865789229 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3540cac10 con 0x7fb3540c8940 2023-07-14T13:05:52.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.922+0000 7fb358893640 1 -- 172.21.15.5:0/865789229 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3404330703 0 0) 0x7fb3540c17d0 con 0x7fb354160330 2023-07-14T13:05:52.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.926+0000 7fb359094640 1 --2- 172.21.15.5:0/865789229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3540c8940 0x7fb3540cb6f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb3440097c0 tx=0x7fb34401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90795cb3ddae840 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:52.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.926+0000 7fb358893640 1 -- 172.21.15.5:0/865789229 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3440a8970 con 0x7fb3540c8940 2023-07-14T13:05:52.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.926+0000 7fb358893640 1 -- 172.21.15.5:0/865789229 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3440a8ad0 con 0x7fb3540c8940 2023-07-14T13:05:52.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.926+0000 7fb358893640 1 -- 172.21.15.5:0/865789229 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3440a8e60 con 0x7fb3540c8940 2023-07-14T13:05:52.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.926+0000 7fb35baf9640 1 -- 172.21.15.5:0/865789229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3540c8940 msgr2=0x7fb3540cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:52.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.926+0000 7fb35baf9640 1 --2- 172.21.15.5:0/865789229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3540c8940 0x7fb3540cb6f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb3440097c0 tx=0x7fb34401ec70 comp rx=0 tx=0).stop 2023-07-14T13:05:52.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.926+0000 7fb35baf9640 1 -- 172.21.15.5:0/865789229 shutdown_connections 2023-07-14T13:05:52.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.926+0000 7fb35baf9640 1 --2- 172.21.15.5:0/865789229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3540c8940 0x7fb3540cb6f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.926+0000 7fb35baf9640 1 -- 172.21.15.5:0/865789229 >> 172.21.15.5:0/865789229 conn(0x7fb3540afcf0 msgr2=0x7fb3540b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:52.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.926+0000 7fb35baf9640 1 -- 172.21.15.5:0/865789229 shutdown_connections 2023-07-14T13:05:52.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.926+0000 7fb35baf9640 1 -- 172.21.15.5:0/865789229 wait complete. 2023-07-14T13:05:52.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.926+0000 7fb35baf9640 1 Processor -- start 2023-07-14T13:05:52.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.926+0000 7fb35baf9640 1 -- start start 2023-07-14T13:05:52.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.930+0000 7fb35baf9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3540c0f80 0x7fb3541f53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:52.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.930+0000 7fb35baf9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3540c8940 0x7fb3540b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:52.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.930+0000 7fb35baf9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb354160330 0x7fb354162980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:52.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.930+0000 7fb35baf9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3541f9f10 con 0x7fb354160330 2023-07-14T13:05:52.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.930+0000 7fb35baf9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3541f9060 con 0x7fb3540c8940 2023-07-14T13:05:52.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.930+0000 7fb35baf9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3541f9300 con 0x7fb3540c0f80 2023-07-14T13:05:52.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.930+0000 7fb35a096640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb354160330 0x7fb354162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:52.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.930+0000 7fb35a096640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb354160330 0x7fb354162980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35296/0 (socket says 172.21.15.5:35296) 2023-07-14T13:05:52.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.930+0000 7fb35a096640 1 -- 172.21.15.5:0/3336132600 learned_addr learned my addr 172.21.15.5:0/3336132600 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:52.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.930+0000 7fb359094640 1 --2- 172.21.15.5:0/3336132600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3540c8940 0x7fb3540b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:52.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.930+0000 7fb359895640 1 --2- 172.21.15.5:0/3336132600 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3540c0f80 0x7fb3541f53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:52.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.930+0000 7fb35a096640 1 -- 172.21.15.5:0/3336132600 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3540c0f80 msgr2=0x7fb3541f53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:52.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.930+0000 7fb35a096640 1 --2- 172.21.15.5:0/3336132600 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3540c0f80 0x7fb3541f53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.930+0000 7fb35a096640 1 -- 172.21.15.5:0/3336132600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3540c8940 msgr2=0x7fb3540b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:52.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.930+0000 7fb35a096640 1 --2- 172.21.15.5:0/3336132600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3540c8940 0x7fb3540b2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:52.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.930+0000 7fb35a096640 1 -- 172.21.15.5:0/3336132600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb344009420 con 0x7fb354160330 2023-07-14T13:05:52.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.930+0000 7fb35a096640 1 --2- 172.21.15.5:0/3336132600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb354160330 0x7fb354162980 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fb34c00c770 tx=0x7fb34c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:52.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.930+0000 7fb34a7fc640 1 -- 172.21.15.5:0/3336132600 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c003b80 con 0x7fb354160330 2023-07-14T13:05:52.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.930+0000 7fb34a7fc640 1 -- 172.21.15.5:0/3336132600 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34c003ce0 con 0x7fb354160330 2023-07-14T13:05:52.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.930+0000 7fb34a7fc640 1 -- 172.21.15.5:0/3336132600 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c00aa90 con 0x7fb354160330 2023-07-14T13:05:52.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.930+0000 7fb35baf9640 1 -- 172.21.15.5:0/3336132600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3541f95e0 con 0x7fb354160330 2023-07-14T13:05:52.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.930+0000 7fb35baf9640 1 -- 172.21.15.5:0/3336132600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3541f9ba0 con 0x7fb354160330 2023-07-14T13:05:52.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.930+0000 7fb35baf9640 1 -- 172.21.15.5:0/3336132600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb35415b5e0 con 0x7fb354160330 2023-07-14T13:05:52.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.930+0000 7fb34a7fc640 1 -- 172.21.15.5:0/3336132600 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb34c00abf0 con 0x7fb354160330 2023-07-14T13:05:52.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.934+0000 7fb34a7fc640 1 --2- 172.21.15.5:0/3336132600 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fb3380663d0 0x7fb338068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:52.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.934+0000 7fb34a7fc640 1 -- 172.21.15.5:0/3336132600 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5941+0+0 (secure 0 0 0) 0x7fb34c083a60 con 0x7fb354160330 2023-07-14T13:05:52.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.934+0000 7fb359895640 1 --2- 172.21.15.5:0/3336132600 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fb3380663d0 0x7fb338068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:52.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.934+0000 7fb359895640 1 --2- 172.21.15.5:0/3336132600 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fb3380663d0 0x7fb338068880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb350007c40 tx=0x7fb350007b90 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:52.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:52.938+0000 7fb34a7fc640 1 -- 172.21.15.5:0/3336132600 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb34c050f80 con 0x7fb354160330 2023-07-14T13:05:53.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.154+0000 7fb35baf9640 1 -- 172.21.15.5:0/3336132600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7fb3540678d0 con 0x7fb354160330 2023-07-14T13:05:53.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.706+0000 7fb34a7fc640 1 -- 172.21.15.5:0/3336132600 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v475) v1 ==== 158+0+0 (secure 0 0 0) 0x7fb34c0545a0 con 0x7fb354160330 2023-07-14T13:05:53.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.710+0000 7fb35baf9640 1 -- 172.21.15.5:0/3336132600 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fb3380663d0 msgr2=0x7fb338068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:53.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.710+0000 7fb35baf9640 1 --2- 172.21.15.5:0/3336132600 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fb3380663d0 0x7fb338068880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb350007c40 tx=0x7fb350007b90 comp rx=0 tx=0).stop 2023-07-14T13:05:53.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.710+0000 7fb35baf9640 1 -- 172.21.15.5:0/3336132600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb354160330 msgr2=0x7fb354162980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:53.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.710+0000 7fb35baf9640 1 --2- 172.21.15.5:0/3336132600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb354160330 0x7fb354162980 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fb34c00c770 tx=0x7fb34c00cc30 comp rx=0 tx=0).stop 2023-07-14T13:05:53.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.710+0000 7fb35baf9640 1 -- 172.21.15.5:0/3336132600 shutdown_connections 2023-07-14T13:05:53.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.710+0000 7fb35baf9640 1 --2- 172.21.15.5:0/3336132600 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fb3380663d0 0x7fb338068880 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:53.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.710+0000 7fb35baf9640 1 --2- 172.21.15.5:0/3336132600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb354160330 0x7fb354162980 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:53.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.710+0000 7fb35baf9640 1 --2- 172.21.15.5:0/3336132600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3540c8940 0x7fb3540b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:53.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.710+0000 7fb35baf9640 1 --2- 172.21.15.5:0/3336132600 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3540c0f80 0x7fb3541f53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:53.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.710+0000 7fb35baf9640 1 -- 172.21.15.5:0/3336132600 >> 172.21.15.5:0/3336132600 conn(0x7fb3540afcf0 msgr2=0x7fb3540cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:53.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.710+0000 7fb35baf9640 1 -- 172.21.15.5:0/3336132600 shutdown_connections 2023-07-14T13:05:53.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.710+0000 7fb35baf9640 1 -- 172.21.15.5:0/3336132600 wait complete. 2023-07-14T13:05:53.763 INFO:tasks.cephfs_test_runner:Test concurrent snap creates in same file-system without db issues ... ok 2023-07-14T13:05:53.763 INFO:tasks.cephfs_test_runner:Starting test: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test exisitence of multiple scheduled snapshots 2023-07-14T13:05:53.764 INFO:tasks.cephfs_test_runner:test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-14T13:05:53.764 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-07-14T13:05:53.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.878+0000 7ff60391e640 1 Processor -- start 2023-07-14T13:05:53.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.878+0000 7ff60391e640 1 -- start start 2023-07-14T13:05:53.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.882+0000 7ff60391e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5fc160330 0x7ff5fc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:53.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.882+0000 7ff60391e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff5fc0c8940 0x7ff5fc0ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:53.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.882+0000 7ff60391e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5fc0c17d0 con 0x7ff5fc0c0f80 2023-07-14T13:05:53.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.882+0000 7ff60391e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5fc0c14f0 con 0x7ff5fc0c8940 2023-07-14T13:05:53.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.882+0000 7ff60391e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc0cac10 con 0x7ff5fc160330 2023-07-14T13:05:53.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.882+0000 7ff601ebb640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff5fc0c0f80 0x7ff5fc0cd490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54196/0 (socket says 172.21.15.5:54196) 2023-07-14T13:05:53.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.882+0000 7ff601ebb640 1 -- 172.21.15.5:0/3165325449 learned_addr learned my addr 172.21.15.5:0/3165325449 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:53.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.882+0000 7ff600eb9640 1 --2- 172.21.15.5:0/3165325449 >> v2:172.21.15.154:3300/0 conn(0x7ff5fc0c8940 0x7ff5fc0ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:53.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.882+0000 7ff6016ba640 1 --2- 172.21.15.5:0/3165325449 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5fc160330 0x7ff5fc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:53.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.882+0000 7ff5f3fff640 1 -- 172.21.15.5:0/3165325449 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672199390 0 0) 0x7ff5fc0c17d0 con 0x7ff5fc0c0f80 2023-07-14T13:05:53.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.882+0000 7ff5f3fff640 1 -- 172.21.15.5:0/3165325449 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5e8003530 con 0x7ff5fc0c0f80 2023-07-14T13:05:53.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.882+0000 7ff5f3fff640 1 -- 172.21.15.5:0/3165325449 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3756256812 0 0) 0x7ff5e8003530 con 0x7ff5fc0c0f80 2023-07-14T13:05:53.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.882+0000 7ff600eb9640 1 -- 172.21.15.5:0/3165325449 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5fc160330 msgr2=0x7ff5fc0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:53.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.882+0000 7ff600eb9640 1 --2- 172.21.15.5:0/3165325449 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5fc160330 0x7ff5fc0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:53.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.882+0000 7ff600eb9640 1 -- 172.21.15.5:0/3165325449 >> v1:172.21.15.5:6789/0 conn(0x7ff5fc0c0f80 legacy=0x7ff5fc0cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:53.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.882+0000 7ff600eb9640 1 -- 172.21.15.5:0/3165325449 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5fc0caef0 con 0x7ff5fc0c8940 2023-07-14T13:05:53.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.882+0000 7ff6016ba640 1 --2- 172.21.15.5:0/3165325449 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5fc160330 0x7ff5fc0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:53.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.886+0000 7ff600eb9640 1 --2- 172.21.15.5:0/3165325449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5fc0c8940 0x7ff5fc0ccf50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0097c0 tx=0x7ff5ec01eb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bcf0d7f3dc2e601 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:53.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.886+0000 7ff5f3fff640 1 -- 172.21.15.5:0/3165325449 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4001a00 con 0x7ff5fc0c8940 2023-07-14T13:05:53.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.886+0000 7ff5f3fff640 1 -- 172.21.15.5:0/3165325449 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ec0a85d0 con 0x7ff5fc0c8940 2023-07-14T13:05:53.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.886+0000 7ff5f3fff640 1 -- 172.21.15.5:0/3165325449 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec0a8960 con 0x7ff5fc0c8940 2023-07-14T13:05:53.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.886+0000 7ff60391e640 1 -- 172.21.15.5:0/3165325449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5fc0c8940 msgr2=0x7ff5fc0ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:53.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.886+0000 7ff60391e640 1 --2- 172.21.15.5:0/3165325449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5fc0c8940 0x7ff5fc0ccf50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0097c0 tx=0x7ff5ec01eb90 comp rx=0 tx=0).stop 2023-07-14T13:05:53.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.886+0000 7ff60391e640 1 -- 172.21.15.5:0/3165325449 shutdown_connections 2023-07-14T13:05:53.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.886+0000 7ff60391e640 1 --2- 172.21.15.5:0/3165325449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5fc0c8940 0x7ff5fc0ccf50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:53.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.886+0000 7ff60391e640 1 --2- 172.21.15.5:0/3165325449 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5fc160330 0x7ff5fc0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:53.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.886+0000 7ff60391e640 1 -- 172.21.15.5:0/3165325449 >> 172.21.15.5:0/3165325449 conn(0x7ff5fc0afcf0 msgr2=0x7ff5fc0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:53.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.886+0000 7ff60391e640 1 -- 172.21.15.5:0/3165325449 shutdown_connections 2023-07-14T13:05:53.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.886+0000 7ff60391e640 1 -- 172.21.15.5:0/3165325449 wait complete. 2023-07-14T13:05:53.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.886+0000 7ff60391e640 1 Processor -- start 2023-07-14T13:05:53.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.886+0000 7ff60391e640 1 -- start start 2023-07-14T13:05:53.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.890+0000 7ff60391e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5fc0c0f80 0x7ff5fc0c36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:53.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.890+0000 7ff60391e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5fc0c8940 0x7ff5fc1591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:53.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.890+0000 7ff60391e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5fc160330 0x7ff5fc0b1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:53.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.890+0000 7ff60391e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc0b2010 con 0x7ff5fc0c0f80 2023-07-14T13:05:53.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.890+0000 7ff60391e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc0c3c80 con 0x7ff5fc160330 2023-07-14T13:05:53.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.890+0000 7ff60391e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc0c3f60 con 0x7ff5fc0c8940 2023-07-14T13:05:53.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.890+0000 7ff6016ba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5fc0c0f80 0x7ff5fc0c36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:53.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.890+0000 7ff6016ba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5fc0c0f80 0x7ff5fc0c36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35306/0 (socket says 172.21.15.5:35306) 2023-07-14T13:05:53.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.890+0000 7ff6016ba640 1 -- 172.21.15.5:0/807158423 learned_addr learned my addr 172.21.15.5:0/807158423 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:53.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.890+0000 7ff6016ba640 1 -- 172.21.15.5:0/807158423 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5fc0c8940 msgr2=0x7ff5fc1591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:53.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.890+0000 7ff601ebb640 1 --2- 172.21.15.5:0/807158423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5fc160330 0x7ff5fc0b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:53.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.890+0000 7ff600eb9640 1 --2- 172.21.15.5:0/807158423 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5fc0c8940 0x7ff5fc1591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:53.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.890+0000 7ff6016ba640 1 --2- 172.21.15.5:0/807158423 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5fc0c8940 0x7ff5fc1591b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:53.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.890+0000 7ff6016ba640 1 -- 172.21.15.5:0/807158423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5fc160330 msgr2=0x7ff5fc0b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:53.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.890+0000 7ff6016ba640 1 --2- 172.21.15.5:0/807158423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5fc160330 0x7ff5fc0b1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:53.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.890+0000 7ff6016ba640 1 -- 172.21.15.5:0/807158423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f8009420 con 0x7ff5fc0c0f80 2023-07-14T13:05:53.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.890+0000 7ff600eb9640 1 --2- 172.21.15.5:0/807158423 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5fc0c8940 0x7ff5fc1591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:05:53.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.890+0000 7ff601ebb640 1 --2- 172.21.15.5:0/807158423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5fc160330 0x7ff5fc0b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:05:53.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.890+0000 7ff6016ba640 1 --2- 172.21.15.5:0/807158423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5fc0c0f80 0x7ff5fc0c36a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff5f800e980 tx=0x7ff5f800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:53.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.890+0000 7ff5f1ffb640 1 -- 172.21.15.5:0/807158423 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f800ca00 con 0x7ff5fc0c0f80 2023-07-14T13:05:53.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.890+0000 7ff5f1ffb640 1 -- 172.21.15.5:0/807158423 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f800cb60 con 0x7ff5fc0c0f80 2023-07-14T13:05:53.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.890+0000 7ff60391e640 1 -- 172.21.15.5:0/807158423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ec009420 con 0x7ff5fc0c0f80 2023-07-14T13:05:53.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.890+0000 7ff5f1ffb640 1 -- 172.21.15.5:0/807158423 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8013470 con 0x7ff5fc0c0f80 2023-07-14T13:05:53.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.890+0000 7ff60391e640 1 -- 172.21.15.5:0/807158423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5fc0c4520 con 0x7ff5fc0c0f80 2023-07-14T13:05:53.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.890+0000 7ff60391e640 1 -- 172.21.15.5:0/807158423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5fc0678d0 con 0x7ff5fc0c0f80 2023-07-14T13:05:53.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.894+0000 7ff5f1ffb640 1 -- 172.21.15.5:0/807158423 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff5f80135d0 con 0x7ff5fc0c0f80 2023-07-14T13:05:53.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.894+0000 7ff5f1ffb640 1 --2- 172.21.15.5:0/807158423 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ff5e00663d0 0x7ff5e0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:53.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.894+0000 7ff5f1ffb640 1 -- 172.21.15.5:0/807158423 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5941+0+0 (secure 0 0 0) 0x7ff5f8083fe0 con 0x7ff5fc0c0f80 2023-07-14T13:05:53.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.894+0000 7ff600eb9640 1 --2- 172.21.15.5:0/807158423 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ff5e00663d0 0x7ff5e0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:53.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.894+0000 7ff600eb9640 1 --2- 172.21.15.5:0/807158423 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ff5e00663d0 0x7ff5e0068880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0b2000 tx=0x7ff5ec0aa070 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:53.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:53.898+0000 7ff5f1ffb640 1 -- 172.21.15.5:0/807158423 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff5f80513f0 con 0x7ff5fc0c0f80 2023-07-14T13:05:54.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.106+0000 7ff60391e640 1 -- 172.21.15.5:0/807158423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7ff5fc0b2150 con 0x7ff5fc0c0f80 2023-07-14T13:05:54.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.710+0000 7ff5f1ffb640 1 -- 172.21.15.5:0/807158423 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v476) v1 ==== 157+0+0 (secure 0 0 0) 0x7ff5fc0b2150 con 0x7ff5fc0c0f80 2023-07-14T13:05:54.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.714+0000 7ff60391e640 1 -- 172.21.15.5:0/807158423 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ff5e00663d0 msgr2=0x7ff5e0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:54.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.714+0000 7ff60391e640 1 --2- 172.21.15.5:0/807158423 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ff5e00663d0 0x7ff5e0068880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0b2000 tx=0x7ff5ec0aa070 comp rx=0 tx=0).stop 2023-07-14T13:05:54.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.714+0000 7ff60391e640 1 -- 172.21.15.5:0/807158423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5fc0c0f80 msgr2=0x7ff5fc0c36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:54.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.714+0000 7ff60391e640 1 --2- 172.21.15.5:0/807158423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5fc0c0f80 0x7ff5fc0c36a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff5f800e980 tx=0x7ff5f800ee40 comp rx=0 tx=0).stop 2023-07-14T13:05:54.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.714+0000 7ff60391e640 1 -- 172.21.15.5:0/807158423 shutdown_connections 2023-07-14T13:05:54.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.714+0000 7ff60391e640 1 --2- 172.21.15.5:0/807158423 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ff5e00663d0 0x7ff5e0068880 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:54.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.714+0000 7ff60391e640 1 --2- 172.21.15.5:0/807158423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5fc160330 0x7ff5fc0b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:54.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.714+0000 7ff60391e640 1 --2- 172.21.15.5:0/807158423 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5fc0c8940 0x7ff5fc1591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:54.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.714+0000 7ff60391e640 1 --2- 172.21.15.5:0/807158423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5fc0c0f80 0x7ff5fc0c36a0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:54.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.714+0000 7ff60391e640 1 -- 172.21.15.5:0/807158423 >> 172.21.15.5:0/807158423 conn(0x7ff5fc0afcf0 msgr2=0x7ff5fc06fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:54.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.714+0000 7ff60391e640 1 -- 172.21.15.5:0/807158423 shutdown_connections 2023-07-14T13:05:54.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.714+0000 7ff60391e640 1 -- 172.21.15.5:0/807158423 wait complete. 2023-07-14T13:05:54.767 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-14T13:05:54.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.886+0000 7f4159a34640 1 Processor -- start 2023-07-14T13:05:54.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f4159a34640 1 -- start start 2023-07-14T13:05:54.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f4159a34640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4154069430 0x7f41540cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:54.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f4159a34640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4154160030 0x7f4154069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:54.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f4159a34640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4154069d40 con 0x7f4154070330 2023-07-14T13:05:54.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f4159a34640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41540cb7d0 con 0x7f4154069430 2023-07-14T13:05:54.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f4159a34640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415406c510 con 0x7f4154160030 2023-07-14T13:05:54.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f41537fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4154070330 0x7f41540707b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54202/0 (socket says 172.21.15.5:54202) 2023-07-14T13:05:54.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f41537fe640 1 -- 172.21.15.5:0/2035416826 learned_addr learned my addr 172.21.15.5:0/2035416826 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:54.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f414bfff640 1 --2- 172.21.15.5:0/2035416826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4154160030 0x7f4154069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:54.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f4152ffd640 1 --2- 172.21.15.5:0/2035416826 >> v2:172.21.15.154:3300/0 conn(0x7f4154069430 0x7f41540cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:54.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f41527fc640 1 -- 172.21.15.5:0/2035416826 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4066700644 0 0) 0x7f4154069d40 con 0x7f4154070330 2023-07-14T13:05:54.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f41527fc640 1 -- 172.21.15.5:0/2035416826 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4140003530 con 0x7f4154070330 2023-07-14T13:05:54.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f41527fc640 1 -- 172.21.15.5:0/2035416826 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2290320990 0 0) 0x7f4140003530 con 0x7f4154070330 2023-07-14T13:05:54.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f41527fc640 1 -- 172.21.15.5:0/2035416826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4154160030 msgr2=0x7f4154069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:54.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f41527fc640 1 --2- 172.21.15.5:0/2035416826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4154160030 0x7f4154069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:54.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f41527fc640 1 -- 172.21.15.5:0/2035416826 >> v2:172.21.15.154:3300/0 conn(0x7f4154069430 msgr2=0x7f41540cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:54.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f41527fc640 1 --2- 172.21.15.5:0/2035416826 >> v2:172.21.15.154:3300/0 conn(0x7f4154069430 0x7f41540cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:54.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f41527fc640 1 -- 172.21.15.5:0/2035416826 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415406c7f0 con 0x7f4154070330 2023-07-14T13:05:54.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f41527fc640 1 -- 172.21.15.5:0/2035416826 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f414c001a00 con 0x7f4154070330 2023-07-14T13:05:54.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f41527fc640 1 -- 172.21.15.5:0/2035416826 >> v1:172.21.15.5:6789/0 conn(0x7f4154070330 legacy=0x7f41540707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:54.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f41527fc640 1 --2- 172.21.15.5:0/2035416826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4140003980 0x7f4140003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:54.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f41527fc640 1 --2- 172.21.15.5:0/2035416826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4154160030 0x7f41400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:54.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f41527fc640 1 --2- 172.21.15.5:0/2035416826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4140004d10 0x7f4140005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:54.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f41527fc640 1 -- 172.21.15.5:0/2035416826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41540cb7d0 con 0x7f4140004d10 2023-07-14T13:05:54.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f41527fc640 1 -- 172.21.15.5:0/2035416826 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415406c510 con 0x7f4140003980 2023-07-14T13:05:54.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f41527fc640 1 -- 172.21.15.5:0/2035416826 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414000b990 con 0x7f4154160030 2023-07-14T13:05:54.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f414bfff640 1 --2- 172.21.15.5:0/2035416826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4154160030 0x7f41400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:54.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f41537fe640 1 --2- 172.21.15.5:0/2035416826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4140004d10 0x7f4140005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:54.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f4152ffd640 1 --2- 172.21.15.5:0/2035416826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4140003980 0x7f4140003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:54.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f414bfff640 1 -- 172.21.15.5:0/2035416826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4140003980 msgr2=0x7f4140003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:54.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f414bfff640 1 --2- 172.21.15.5:0/2035416826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4140003980 0x7f4140003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:54.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f414bfff640 1 -- 172.21.15.5:0/2035416826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4140004d10 msgr2=0x7f4140005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:54.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f414bfff640 1 --2- 172.21.15.5:0/2035416826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4140004d10 0x7f4140005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:54.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f414bfff640 1 -- 172.21.15.5:0/2035416826 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4140003530 con 0x7f4154160030 2023-07-14T13:05:54.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.890+0000 7f41537fe640 1 --2- 172.21.15.5:0/2035416826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4140004d10 0x7f4140005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:54.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.894+0000 7f414bfff640 1 --2- 172.21.15.5:0/2035416826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4154160030 0x7f41400047d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f413c009ae0 tx=0x7f413c01ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f060ad93f4c8b17c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:54.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.894+0000 7f41527fc640 1 -- 172.21.15.5:0/2035416826 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c0a5680 con 0x7f4154160030 2023-07-14T13:05:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.894+0000 7f41527fc640 1 -- 172.21.15.5:0/2035416826 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413c0a57e0 con 0x7f4154160030 2023-07-14T13:05:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.894+0000 7f41527fc640 1 -- 172.21.15.5:0/2035416826 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c0a5b90 con 0x7f4154160030 2023-07-14T13:05:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.894+0000 7f4159a34640 1 -- 172.21.15.5:0/2035416826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4154160030 msgr2=0x7f41400047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.894+0000 7f4159a34640 1 --2- 172.21.15.5:0/2035416826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4154160030 0x7f41400047d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f413c009ae0 tx=0x7f413c01ca90 comp rx=0 tx=0).stop 2023-07-14T13:05:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.894+0000 7f41537fe640 1 -- 172.21.15.5:0/2035416826 reap_dead start 2023-07-14T13:05:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.894+0000 7f4159a34640 1 -- 172.21.15.5:0/2035416826 shutdown_connections 2023-07-14T13:05:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.894+0000 7f4159a34640 1 -- 172.21.15.5:0/2035416826 >> 172.21.15.5:0/2035416826 conn(0x7f41540b1840 msgr2=0x7f41540cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.894+0000 7f4159a34640 1 -- 172.21.15.5:0/2035416826 shutdown_connections 2023-07-14T13:05:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.894+0000 7f4159a34640 1 -- 172.21.15.5:0/2035416826 wait complete. 2023-07-14T13:05:54.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.898+0000 7f4159a34640 1 Processor -- start 2023-07-14T13:05:54.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.898+0000 7f4159a34640 1 -- start start 2023-07-14T13:05:54.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.898+0000 7f4159a34640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4154160030 0x7f41541503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:54.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.898+0000 7f4159a34640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41540c75f0 0x7f415406d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:54.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.898+0000 7f4159a34640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41540c7a60 0x7f415406dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.898+0000 7f4159a34640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41540c80b0 con 0x7f4154160030 2023-07-14T13:05:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.898+0000 7f4159a34640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41540c8390 con 0x7f41540c7a60 2023-07-14T13:05:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.898+0000 7f4159a34640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41540c8670 con 0x7f41540c75f0 2023-07-14T13:05:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.898+0000 7f4152ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4154160030 0x7f41541503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.898+0000 7f4152ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4154160030 0x7f41541503b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35334/0 (socket says 172.21.15.5:35334) 2023-07-14T13:05:54.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.898+0000 7f4152ffd640 1 -- 172.21.15.5:0/3242327340 learned_addr learned my addr 172.21.15.5:0/3242327340 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:54.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.898+0000 7f414bfff640 1 --2- 172.21.15.5:0/3242327340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41540c75f0 0x7f415406d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:54.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.898+0000 7f41537fe640 1 --2- 172.21.15.5:0/3242327340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41540c7a60 0x7f415406dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:54.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.898+0000 7f4152ffd640 1 -- 172.21.15.5:0/3242327340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41540c75f0 msgr2=0x7f415406d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:54.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.898+0000 7f4152ffd640 1 --2- 172.21.15.5:0/3242327340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41540c75f0 0x7f415406d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:54.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.898+0000 7f4152ffd640 1 -- 172.21.15.5:0/3242327340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41540c7a60 msgr2=0x7f415406dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:54.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.898+0000 7f4152ffd640 1 --2- 172.21.15.5:0/3242327340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41540c7a60 0x7f415406dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:54.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.898+0000 7f4152ffd640 1 -- 172.21.15.5:0/3242327340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41540c8950 con 0x7f4154160030 2023-07-14T13:05:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.898+0000 7f4152ffd640 1 --2- 172.21.15.5:0/3242327340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4154160030 0x7f41541503b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f41440119d0 tx=0x7f4144011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.898+0000 7f4150ff9640 1 -- 172.21.15.5:0/3242327340 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414400faf0 con 0x7f4154160030 2023-07-14T13:05:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.898+0000 7f4150ff9640 1 -- 172.21.15.5:0/3242327340 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414400fc50 con 0x7f4154160030 2023-07-14T13:05:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.898+0000 7f4150ff9640 1 -- 172.21.15.5:0/3242327340 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4144014440 con 0x7f4154160030 2023-07-14T13:05:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.898+0000 7f4159a34640 1 -- 172.21.15.5:0/3242327340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41540c8c30 con 0x7f4154160030 2023-07-14T13:05:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.898+0000 7f4159a34640 1 -- 172.21.15.5:0/3242327340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f415415d4f0 con 0x7f4154160030 2023-07-14T13:05:54.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.902+0000 7f4159a34640 1 -- 172.21.15.5:0/3242327340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41540678d0 con 0x7f4154160030 2023-07-14T13:05:54.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.902+0000 7f4150ff9640 1 -- 172.21.15.5:0/3242327340 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f41440145a0 con 0x7f4154160030 2023-07-14T13:05:54.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.902+0000 7f4150ff9640 1 --2- 172.21.15.5:0/3242327340 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f41340663d0 0x7f4134068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:54.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.902+0000 7f4150ff9640 1 -- 172.21.15.5:0/3242327340 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5941+0+0 (secure 0 0 0) 0x7f4144084560 con 0x7f4154160030 2023-07-14T13:05:54.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.902+0000 7f414bfff640 1 --2- 172.21.15.5:0/3242327340 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f41340663d0 0x7f4134068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:54.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.902+0000 7f414bfff640 1 --2- 172.21.15.5:0/3242327340 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f41340663d0 0x7f4134068880 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f413c0af000 tx=0x7f413c0046d0 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:54.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:54.906+0000 7f4150ff9640 1 -- 172.21.15.5:0/3242327340 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f41440519f0 con 0x7f4154160030 2023-07-14T13:05:55.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.062+0000 7f4159a34640 1 -- 172.21.15.5:0/3242327340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f415406e920 con 0x7f4154160030 2023-07-14T13:05:55.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.066+0000 7f4150ff9640 1 -- 172.21.15.5:0/3242327340 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4144055010 con 0x7f4154160030 2023-07-14T13:05:55.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.070+0000 7f4159a34640 1 -- 172.21.15.5:0/3242327340 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f41340663d0 msgr2=0x7f4134068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:55.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.070+0000 7f4159a34640 1 --2- 172.21.15.5:0/3242327340 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f41340663d0 0x7f4134068880 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f413c0af000 tx=0x7f413c0046d0 comp rx=0 tx=0).stop 2023-07-14T13:05:55.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.070+0000 7f4159a34640 1 -- 172.21.15.5:0/3242327340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4154160030 msgr2=0x7f41541503b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:55.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.070+0000 7f4159a34640 1 --2- 172.21.15.5:0/3242327340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4154160030 0x7f41541503b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f41440119d0 tx=0x7f4144011dd0 comp rx=0 tx=0).stop 2023-07-14T13:05:55.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.070+0000 7f4159a34640 1 -- 172.21.15.5:0/3242327340 shutdown_connections 2023-07-14T13:05:55.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.070+0000 7f4159a34640 1 --2- 172.21.15.5:0/3242327340 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f41340663d0 0x7f4134068880 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:55.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.070+0000 7f4159a34640 1 --2- 172.21.15.5:0/3242327340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41540c7a60 0x7f415406dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:55.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.070+0000 7f4159a34640 1 --2- 172.21.15.5:0/3242327340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41540c75f0 0x7f415406d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:55.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.070+0000 7f4159a34640 1 --2- 172.21.15.5:0/3242327340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4154160030 0x7f41541503b0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:55.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.070+0000 7f4159a34640 1 -- 172.21.15.5:0/3242327340 >> 172.21.15.5:0/3242327340 conn(0x7f41540b1840 msgr2=0x7f4154156700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:55.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.070+0000 7f4159a34640 1 -- 172.21.15.5:0/3242327340 shutdown_connections 2023-07-14T13:05:55.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.070+0000 7f4159a34640 1 -- 172.21.15.5:0/3242327340 wait complete. 2023-07-14T13:05:55.120 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T13:05:55.121 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:05:55.178 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:05:55.246 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T13:05:55.246 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:05:55.247 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:05:55.255 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:05:55.256 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:05:55.256 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:05:55.265 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:05:55.266 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:05:55.266 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:05:55.311 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:05:55.312 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:05:55.312 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:05:55.321 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:05:55.321 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-14T13:05:55.322 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:05:55.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.470+0000 7f70dd3d2640 1 Processor -- start 2023-07-14T13:05:55.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.470+0000 7f70dd3d2640 1 -- start start 2023-07-14T13:05:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.474+0000 7f70dd3d2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f70d8158ce0 0x7f70d8070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.474+0000 7f70dd3d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70d80c8ad0 0x7f70d80c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.474+0000 7f70dd3d2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f70d80c9560 0x7f70d80cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:55.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.474+0000 7f70dd3d2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d80c99e0 con 0x7f70d80c9560 2023-07-14T13:05:55.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.474+0000 7f70dd3d2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d80cc700 con 0x7f70d8158ce0 2023-07-14T13:05:55.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.474+0000 7f70dd3d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d80b0ff0 con 0x7f70d80c8ad0 2023-07-14T13:05:55.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.474+0000 7f70d77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f70d80c9560 0x7f70d80cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:55.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.474+0000 7f70d77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f70d80c9560 0x7f70d80cab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35342/0 (socket says 172.21.15.5:35342) 2023-07-14T13:05:55.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.474+0000 7f70d77fe640 1 -- 172.21.15.5:0/1481614585 learned_addr learned my addr 172.21.15.5:0/1481614585 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:55.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.474+0000 7f70d6ffd640 1 --2- 172.21.15.5:0/1481614585 >> v2:172.21.15.154:3300/0 conn(0x7f70d8158ce0 0x7f70d8070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:55.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.474+0000 7f70cffff640 1 --2- 172.21.15.5:0/1481614585 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70d80c8ad0 0x7f70d80c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:55.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.474+0000 7f70d77fe640 1 -- 172.21.15.5:0/1481614585 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70d80c8ad0 msgr2=0x7f70d80c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:55.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.474+0000 7f70d77fe640 1 --2- 172.21.15.5:0/1481614585 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70d80c8ad0 0x7f70d80c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:55.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.474+0000 7f70d77fe640 1 -- 172.21.15.5:0/1481614585 >> v2:172.21.15.154:3300/0 conn(0x7f70d8158ce0 msgr2=0x7f70d8070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:55.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.474+0000 7f70d77fe640 1 --2- 172.21.15.5:0/1481614585 >> v2:172.21.15.154:3300/0 conn(0x7f70d8158ce0 0x7f70d8070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:55.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.474+0000 7f70d77fe640 1 -- 172.21.15.5:0/1481614585 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d8070c80 con 0x7f70d80c9560 2023-07-14T13:05:55.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.478+0000 7f70d77fe640 1 --2- 172.21.15.5:0/1481614585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70d80c9560 0x7f70d80cab00 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f70d8071be0 tx=0x7f70d001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71709f846c30a668 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:55.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.478+0000 7f70d67fc640 1 -- 172.21.15.5:0/1481614585 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d00a5610 con 0x7f70d80c9560 2023-07-14T13:05:55.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.478+0000 7f70d67fc640 1 -- 172.21.15.5:0/1481614585 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d00a5770 con 0x7f70d80c9560 2023-07-14T13:05:55.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.478+0000 7f70d67fc640 1 -- 172.21.15.5:0/1481614585 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d00a5b00 con 0x7f70d80c9560 2023-07-14T13:05:55.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.478+0000 7f70dd3d2640 1 -- 172.21.15.5:0/1481614585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70d80c9560 msgr2=0x7f70d80cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:55.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.478+0000 7f70dd3d2640 1 --2- 172.21.15.5:0/1481614585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70d80c9560 0x7f70d80cab00 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f70d8071be0 tx=0x7f70d001c880 comp rx=0 tx=0).stop 2023-07-14T13:05:55.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.478+0000 7f70dd3d2640 1 -- 172.21.15.5:0/1481614585 shutdown_connections 2023-07-14T13:05:55.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.478+0000 7f70dd3d2640 1 --2- 172.21.15.5:0/1481614585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70d80c9560 0x7f70d80cab00 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:55.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.478+0000 7f70dd3d2640 1 --2- 172.21.15.5:0/1481614585 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70d80c8ad0 0x7f70d80c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:55.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.478+0000 7f70dd3d2640 1 --2- 172.21.15.5:0/1481614585 >> v2:172.21.15.154:3300/0 conn(0x7f70d8158ce0 0x7f70d8070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:55.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.478+0000 7f70dd3d2640 1 -- 172.21.15.5:0/1481614585 >> 172.21.15.5:0/1481614585 conn(0x7f70d80afcf0 msgr2=0x7f70d80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:55.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.478+0000 7f70dd3d2640 1 -- 172.21.15.5:0/1481614585 shutdown_connections 2023-07-14T13:05:55.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.478+0000 7f70dd3d2640 1 -- 172.21.15.5:0/1481614585 wait complete. 2023-07-14T13:05:55.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.478+0000 7f70dd3d2640 1 Processor -- start 2023-07-14T13:05:55.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.478+0000 7f70dd3d2640 1 -- start start 2023-07-14T13:05:55.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.478+0000 7f70dd3d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70d80c8ad0 0x7f70d80ae360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:55.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.478+0000 7f70dd3d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70d80c9560 0x7f70d80b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:55.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.478+0000 7f70dd3d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70d8158ce0 0x7f70d80b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:55.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.478+0000 7f70dd3d2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d80c1c90 con 0x7f70d80c9560 2023-07-14T13:05:55.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.478+0000 7f70dd3d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d80c44d0 con 0x7f70d80c8ad0 2023-07-14T13:05:55.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.478+0000 7f70dd3d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d80c47b0 con 0x7f70d8158ce0 2023-07-14T13:05:55.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.482+0000 7f70cffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70d80c9560 0x7f70d80b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:55.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.482+0000 7f70cffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70d80c9560 0x7f70d80b31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35344/0 (socket says 172.21.15.5:35344) 2023-07-14T13:05:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.482+0000 7f70cffff640 1 -- 172.21.15.5:0/1146124082 learned_addr learned my addr 172.21.15.5:0/1146124082 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.482+0000 7f70d77fe640 1 --2- 172.21.15.5:0/1146124082 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70d8158ce0 0x7f70d80b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.482+0000 7f70d6ffd640 1 --2- 172.21.15.5:0/1146124082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70d80c8ad0 0x7f70d80ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.482+0000 7f70cffff640 1 -- 172.21.15.5:0/1146124082 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70d8158ce0 msgr2=0x7f70d80b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.482+0000 7f70cffff640 1 --2- 172.21.15.5:0/1146124082 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70d8158ce0 0x7f70d80b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.482+0000 7f70cffff640 1 -- 172.21.15.5:0/1146124082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70d80c8ad0 msgr2=0x7f70d80ae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.482+0000 7f70cffff640 1 --2- 172.21.15.5:0/1146124082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70d80c8ad0 0x7f70d80ae360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.482+0000 7f70cffff640 1 -- 172.21.15.5:0/1146124082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d0009b30 con 0x7f70d80c9560 2023-07-14T13:05:55.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.482+0000 7f70d6ffd640 1 --2- 172.21.15.5:0/1146124082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70d80c8ad0 0x7f70d80ae360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:05:55.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.482+0000 7f70cffff640 1 --2- 172.21.15.5:0/1146124082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70d80c9560 0x7f70d80b31b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f70c000d5f0 tx=0x7f70c000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:55.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.482+0000 7f70cf7fe640 1 -- 172.21.15.5:0/1146124082 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c00125f0 con 0x7f70d80c9560 2023-07-14T13:05:55.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.482+0000 7f70cf7fe640 1 -- 172.21.15.5:0/1146124082 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c0012750 con 0x7f70d80c9560 2023-07-14T13:05:55.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.482+0000 7f70cf7fe640 1 -- 172.21.15.5:0/1146124082 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0012ae0 con 0x7f70d80c9560 2023-07-14T13:05:55.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.482+0000 7f70dd3d2640 1 -- 172.21.15.5:0/1146124082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d80c4a90 con 0x7f70d80c9560 2023-07-14T13:05:55.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.482+0000 7f70dd3d2640 1 -- 172.21.15.5:0/1146124082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d80c41c0 con 0x7f70d80c9560 2023-07-14T13:05:55.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.482+0000 7f70dd3d2640 1 -- 172.21.15.5:0/1146124082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d80ca1a0 con 0x7f70d80c9560 2023-07-14T13:05:55.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.482+0000 7f70cf7fe640 1 -- 172.21.15.5:0/1146124082 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f70c0012c40 con 0x7f70d80c9560 2023-07-14T13:05:55.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.482+0000 7f70cf7fe640 1 --2- 172.21.15.5:0/1146124082 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f70b80663a0 0x7f70b8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:55.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.486+0000 7f70cf7fe640 1 -- 172.21.15.5:0/1146124082 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5941+0+0 (secure 0 0 0) 0x7f70c00842d0 con 0x7f70d80c9560 2023-07-14T13:05:55.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.486+0000 7f70d6ffd640 1 --2- 172.21.15.5:0/1146124082 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f70b80663a0 0x7f70b8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:55.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.486+0000 7f70d6ffd640 1 --2- 172.21.15.5:0/1146124082 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f70b80663a0 0x7f70b8068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f70c80099c0 tx=0x7f70c8008040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:55.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.490+0000 7f70cf7fe640 1 -- 172.21.15.5:0/1146124082 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f70c00516b0 con 0x7f70d80c9560 2023-07-14T13:05:55.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.674+0000 7f70dd3d2640 1 -- 172.21.15.5:0/1146124082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70d80678d0 con 0x7f70d80c9560 2023-07-14T13:05:55.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.674+0000 7f70cf7fe640 1 -- 172.21.15.5:0/1146124082 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f70c0007380 con 0x7f70d80c9560 2023-07-14T13:05:55.708 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:05:55.708 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1121417572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1121417572},{"type":"v1","addr":"172.21.15.5:6833","nonce":1121417572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/1826988320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1826988320},{"type":"v1","addr":"172.21.15.154:6836","nonce":1826988320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5074,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3683900517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3683900517},{"type":"v1","addr":"172.21.15.154:6837","nonce":3683900517}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5961,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3298190186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3298190186},{"type":"v1","addr":"172.21.15.5:6835","nonce":3298190186}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[]} 2023-07-14T13:05:55.708 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 18 2023-07-14T13:05:55.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.678+0000 7f70dd3d2640 1 -- 172.21.15.5:0/1146124082 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f70b80663a0 msgr2=0x7f70b8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:55.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.678+0000 7f70dd3d2640 1 --2- 172.21.15.5:0/1146124082 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f70b80663a0 0x7f70b8068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f70c80099c0 tx=0x7f70c8008040 comp rx=0 tx=0).stop 2023-07-14T13:05:55.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.678+0000 7f70dd3d2640 1 -- 172.21.15.5:0/1146124082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70d80c9560 msgr2=0x7f70d80b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:55.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.678+0000 7f70dd3d2640 1 --2- 172.21.15.5:0/1146124082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70d80c9560 0x7f70d80b31b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f70c000d5f0 tx=0x7f70c000dab0 comp rx=0 tx=0).stop 2023-07-14T13:05:55.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.678+0000 7f70dd3d2640 1 -- 172.21.15.5:0/1146124082 shutdown_connections 2023-07-14T13:05:55.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.678+0000 7f70dd3d2640 1 --2- 172.21.15.5:0/1146124082 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f70b80663a0 0x7f70b8068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:55.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.678+0000 7f70dd3d2640 1 --2- 172.21.15.5:0/1146124082 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70d8158ce0 0x7f70d80b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:55.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.678+0000 7f70dd3d2640 1 --2- 172.21.15.5:0/1146124082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70d80c9560 0x7f70d80b31b0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:55.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.678+0000 7f70dd3d2640 1 --2- 172.21.15.5:0/1146124082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70d80c8ad0 0x7f70d80ae360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:55.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.678+0000 7f70dd3d2640 1 -- 172.21.15.5:0/1146124082 >> 172.21.15.5:0/1146124082 conn(0x7f70d80afcf0 msgr2=0x7f70d806b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:55.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.678+0000 7f70dd3d2640 1 -- 172.21.15.5:0/1146124082 shutdown_connections 2023-07-14T13:05:55.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.678+0000 7f70dd3d2640 1 -- 172.21.15.5:0/1146124082 wait complete. 2023-07-14T13:05:55.729 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-14T13:05:55.729 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-14T13:05:55.729 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-14T13:05:55.730 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:05:55.730 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-14T13:05:55.730 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-14T13:05:55.730 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-14T13:05:55.730 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:05:55.731 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-14T13:05:55.731 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-14T13:05:55.731 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-14T13:05:55.731 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:05:55.732 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-14T13:05:55.732 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-14T13:05:55.732 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-14T13:05:55.732 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:05:55.742 INFO:tasks.ceph.mds.a:Stopped 2023-07-14T13:05:55.742 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-14T13:05:55.743 INFO:tasks.ceph.mds.c:Stopped 2023-07-14T13:05:55.743 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-14T13:05:55.748 INFO:tasks.ceph.mds.d:Stopped 2023-07-14T13:05:55.748 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-14T13:05:55.749 INFO:tasks.ceph.mds.b:Stopped 2023-07-14T13:05:55.750 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-14T13:05:55.789 INFO:tasks.ceph.mds.a:Started 2023-07-14T13:05:55.790 DEBUG:teuthology.parallel:result is None 2023-07-14T13:05:55.792 INFO:tasks.ceph.mds.c:Started 2023-07-14T13:05:55.792 DEBUG:teuthology.parallel:result is None 2023-07-14T13:05:55.793 INFO:tasks.ceph.mds.d:Started 2023-07-14T13:05:55.793 DEBUG:teuthology.parallel:result is None 2023-07-14T13:05:55.796 INFO:tasks.ceph.mds.b:Started 2023-07-14T13:05:55.796 DEBUG:teuthology.parallel:result is None 2023-07-14T13:05:55.797 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-14T13:05:55.880 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-07-14T13:05:55.880 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-07-14T13:05:55.885 INFO:tasks.ceph.mds.d.smithi154.stdout:starting mds.d at 2023-07-14T13:05:55.887 INFO:tasks.ceph.mds.b.smithi154.stdout:starting mds.b at 2023-07-14T13:05:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.914+0000 7f240ced8640 1 Processor -- start 2023-07-14T13:05:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.914+0000 7f240ced8640 1 -- start start 2023-07-14T13:05:55.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.918+0000 7f240ced8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f240815f500 0x7f240806cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.918+0000 7f240ced8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f240806d430 0x7f240806a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.918+0000 7f240ced8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f240806aa80 0x7f24080b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.918+0000 7f240ced8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f240806af20 con 0x7f240806aa80 2023-07-14T13:05:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.918+0000 7f240ced8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24080cdc80 con 0x7f240806d430 2023-07-14T13:05:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.918+0000 7f240ced8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240806e4c0 con 0x7f240815f500 2023-07-14T13:05:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.918+0000 7f2406d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f240806aa80 0x7f24080b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:55.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.918+0000 7f2406d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f240806aa80 0x7f24080b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35376/0 (socket says 172.21.15.5:35376) 2023-07-14T13:05:55.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.918+0000 7f2406d9d640 1 -- 172.21.15.5:0/99828653 learned_addr learned my addr 172.21.15.5:0/99828653 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:55.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.918+0000 7f23fffff640 1 --2- 172.21.15.5:0/99828653 >> v2:172.21.15.154:3300/0 conn(0x7f240806d430 0x7f240806a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:55.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.918+0000 7f240659c640 1 --2- 172.21.15.5:0/99828653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f240815f500 0x7f240806cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:55.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.918+0000 7f2406d9d640 1 -- 172.21.15.5:0/99828653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f240815f500 msgr2=0x7f240806cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:55.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.918+0000 7f2406d9d640 1 --2- 172.21.15.5:0/99828653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f240815f500 0x7f240806cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:55.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.918+0000 7f2406d9d640 1 -- 172.21.15.5:0/99828653 >> v2:172.21.15.154:3300/0 conn(0x7f240806d430 msgr2=0x7f240806a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:55.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.918+0000 7f2406d9d640 1 --2- 172.21.15.5:0/99828653 >> v2:172.21.15.154:3300/0 conn(0x7f240806d430 0x7f240806a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:55.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.918+0000 7f2406d9d640 1 -- 172.21.15.5:0/99828653 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240806d940 con 0x7f240806aa80 2023-07-14T13:05:55.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.922+0000 7f2406d9d640 1 --2- 172.21.15.5:0/99828653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240806aa80 0x7f24080b1bc0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f2408070e30 tx=0x7f240001c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f6af67971402e4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.922+0000 7f2405d9b640 1 -- 172.21.15.5:0/99828653 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24000a6490 con 0x7f240806aa80 2023-07-14T13:05:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.922+0000 7f2405d9b640 1 -- 172.21.15.5:0/99828653 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24000a65f0 con 0x7f240806aa80 2023-07-14T13:05:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.922+0000 7f2405d9b640 1 -- 172.21.15.5:0/99828653 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24000a6980 con 0x7f240806aa80 2023-07-14T13:05:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.922+0000 7f240ced8640 1 -- 172.21.15.5:0/99828653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240806aa80 msgr2=0x7f24080b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.922+0000 7f240ced8640 1 --2- 172.21.15.5:0/99828653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240806aa80 0x7f24080b1bc0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f2408070e30 tx=0x7f240001c710 comp rx=0 tx=0).stop 2023-07-14T13:05:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.922+0000 7f240ced8640 1 -- 172.21.15.5:0/99828653 shutdown_connections 2023-07-14T13:05:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.922+0000 7f240ced8640 1 --2- 172.21.15.5:0/99828653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240806aa80 0x7f24080b1bc0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.922+0000 7f240ced8640 1 --2- 172.21.15.5:0/99828653 >> v2:172.21.15.154:3300/0 conn(0x7f240806d430 0x7f240806a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.922+0000 7f240ced8640 1 --2- 172.21.15.5:0/99828653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f240815f500 0x7f240806cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.922+0000 7f240ced8640 1 -- 172.21.15.5:0/99828653 >> 172.21.15.5:0/99828653 conn(0x7f24080659d0 msgr2=0x7f2408099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.922+0000 7f240ced8640 1 -- 172.21.15.5:0/99828653 shutdown_connections 2023-07-14T13:05:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.922+0000 7f240ced8640 1 -- 172.21.15.5:0/99828653 wait complete. 2023-07-14T13:05:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.922+0000 7f240ced8640 1 Processor -- start 2023-07-14T13:05:55.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.922+0000 7f240ced8640 1 -- start start 2023-07-14T13:05:55.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.926+0000 7f240ced8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240806aa80 0x7f24081580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:55.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.926+0000 7f240ced8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f240806d430 0x7f24080cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:55.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.926+0000 7f240ced8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f240815f500 0x7f240815d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:55.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.926+0000 7f240ced8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24080ccdf0 con 0x7f240806aa80 2023-07-14T13:05:55.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.926+0000 7f240ced8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24080cd0d0 con 0x7f240815f500 2023-07-14T13:05:55.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.926+0000 7f240ced8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24080cd3b0 con 0x7f240806d430 2023-07-14T13:05:55.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.926+0000 7f240659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240806aa80 0x7f24081580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:55.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.926+0000 7f240659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240806aa80 0x7f24081580a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35378/0 (socket says 172.21.15.5:35378) 2023-07-14T13:05:55.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.926+0000 7f240659c640 1 -- 172.21.15.5:0/1533117088 learned_addr learned my addr 172.21.15.5:0/1533117088 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:55.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.926+0000 7f23fffff640 1 --2- 172.21.15.5:0/1533117088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f240806d430 0x7f24080cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:55.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.926+0000 7f2406d9d640 1 --2- 172.21.15.5:0/1533117088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f240815f500 0x7f240815d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:55.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.926+0000 7f240659c640 1 -- 172.21.15.5:0/1533117088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f240806d430 msgr2=0x7f24080cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:55.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.926+0000 7f240659c640 1 --2- 172.21.15.5:0/1533117088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f240806d430 0x7f24080cb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:55.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.926+0000 7f240659c640 1 -- 172.21.15.5:0/1533117088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f240815f500 msgr2=0x7f240815d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:55.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.926+0000 7f240659c640 1 --2- 172.21.15.5:0/1533117088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f240815f500 0x7f240815d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:55.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.926+0000 7f240659c640 1 -- 172.21.15.5:0/1533117088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2400009b30 con 0x7f240806aa80 2023-07-14T13:05:55.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.926+0000 7f240659c640 1 --2- 172.21.15.5:0/1533117088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240806aa80 0x7f24081580a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f23f800d7d0 tx=0x7f23f800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:55.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.926+0000 7f23feffd640 1 -- 172.21.15.5:0/1533117088 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f800b6c0 con 0x7f240806aa80 2023-07-14T13:05:55.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.926+0000 7f23feffd640 1 -- 172.21.15.5:0/1533117088 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f800b820 con 0x7f240806aa80 2023-07-14T13:05:55.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.926+0000 7f23feffd640 1 -- 172.21.15.5:0/1533117088 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f800bbd0 con 0x7f240806aa80 2023-07-14T13:05:55.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.926+0000 7f240ced8640 1 -- 172.21.15.5:0/1533117088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24081594f0 con 0x7f240806aa80 2023-07-14T13:05:55.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.926+0000 7f240ced8640 1 -- 172.21.15.5:0/1533117088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24080b2f70 con 0x7f240806aa80 2023-07-14T13:05:55.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.926+0000 7f240ced8640 1 -- 172.21.15.5:0/1533117088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24080678d0 con 0x7f240806aa80 2023-07-14T13:05:55.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.926+0000 7f23feffd640 1 -- 172.21.15.5:0/1533117088 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f23f800bd30 con 0x7f240806aa80 2023-07-14T13:05:55.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.930+0000 7f23feffd640 1 --2- 172.21.15.5:0/1533117088 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f23e80663a0 0x7f23e8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:55.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.930+0000 7f23feffd640 1 -- 172.21.15.5:0/1533117088 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5941+0+0 (secure 0 0 0) 0x7f23f80842b0 con 0x7f240806aa80 2023-07-14T13:05:55.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.930+0000 7f23fffff640 1 --2- 172.21.15.5:0/1533117088 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f23e80663a0 0x7f23e8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:55.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.930+0000 7f23fffff640 1 --2- 172.21.15.5:0/1533117088 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f23e80663a0 0x7f23e8068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f24080b59f0 tx=0x7f23f0009190 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:55.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:55.934+0000 7f23feffd640 1 -- 172.21.15.5:0/1533117088 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f23f8055130 con 0x7f240806aa80 2023-07-14T13:05:56.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:56.102+0000 7f240ced8640 1 -- 172.21.15.5:0/1533117088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f24080ca2d0 con 0x7f240806aa80 2023-07-14T13:05:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.086+0000 7f23feffd640 1 -- 172.21.15.5:0/1533117088 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v61) v1 ==== 97+0+0 (secure 0 0 0) 0x7f23f8054cc0 con 0x7f240806aa80 2023-07-14T13:05:57.118 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2023-07-14T13:05:57.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.090+0000 7f240ced8640 1 -- 172.21.15.5:0/1533117088 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f23e80663a0 msgr2=0x7f23e8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:57.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.090+0000 7f240ced8640 1 --2- 172.21.15.5:0/1533117088 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f23e80663a0 0x7f23e8068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f24080b59f0 tx=0x7f23f0009190 comp rx=0 tx=0).stop 2023-07-14T13:05:57.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.090+0000 7f240ced8640 1 -- 172.21.15.5:0/1533117088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240806aa80 msgr2=0x7f24081580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:57.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.090+0000 7f240ced8640 1 --2- 172.21.15.5:0/1533117088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240806aa80 0x7f24081580a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f23f800d7d0 tx=0x7f23f800dc90 comp rx=0 tx=0).stop 2023-07-14T13:05:57.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.090+0000 7f240ced8640 1 -- 172.21.15.5:0/1533117088 shutdown_connections 2023-07-14T13:05:57.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.090+0000 7f240ced8640 1 --2- 172.21.15.5:0/1533117088 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f23e80663a0 0x7f23e8068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:57.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.090+0000 7f240ced8640 1 --2- 172.21.15.5:0/1533117088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f240815f500 0x7f240815d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:57.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.090+0000 7f240ced8640 1 --2- 172.21.15.5:0/1533117088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f240806d430 0x7f24080cb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:57.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.090+0000 7f240ced8640 1 --2- 172.21.15.5:0/1533117088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f240806aa80 0x7f24081580a0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:57.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.090+0000 7f240ced8640 1 -- 172.21.15.5:0/1533117088 >> 172.21.15.5:0/1533117088 conn(0x7f24080659d0 msgr2=0x7f24080acd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:57.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.090+0000 7f240ced8640 1 -- 172.21.15.5:0/1533117088 shutdown_connections 2023-07-14T13:05:57.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.090+0000 7f240ced8640 1 -- 172.21.15.5:0/1533117088 wait complete. 2023-07-14T13:05:57.145 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-14T13:05:57.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.262+0000 7fe54a574640 1 Processor -- start 2023-07-14T13:05:57.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.262+0000 7fe54a574640 1 -- start start 2023-07-14T13:05:57.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.266+0000 7fe54a574640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe544070b70 0x7fe544070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:57.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.266+0000 7fe54a574640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe54406b1e0 0x7fe5440c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:57.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.266+0000 7fe54a574640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5440cac70 con 0x7fe5440c21f0 2023-07-14T13:05:57.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.266+0000 7fe54a574640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe544071480 con 0x7fe54406b1e0 2023-07-14T13:05:57.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.266+0000 7fe54a574640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5440ca060 con 0x7fe544070b70 2023-07-14T13:05:57.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.266+0000 7fe5437fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe54406b1e0 0x7fe5440c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:57.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.266+0000 7fe548b11640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe5440c21f0 0x7fe5440cb100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54228/0 (socket says 172.21.15.5:54228) 2023-07-14T13:05:57.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.266+0000 7fe548b11640 1 -- 172.21.15.5:0/1596872487 learned_addr learned my addr 172.21.15.5:0/1596872487 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:57.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.266+0000 7fe543fff640 1 --2- 172.21.15.5:0/1596872487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe544070b70 0x7fe544070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:57.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.266+0000 7fe5437fe640 1 -- 172.21.15.5:0/1596872487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe544070b70 msgr2=0x7fe544070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:57.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.266+0000 7fe5437fe640 1 --2- 172.21.15.5:0/1596872487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe544070b70 0x7fe544070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:57.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.266+0000 7fe5437fe640 1 -- 172.21.15.5:0/1596872487 >> v1:172.21.15.5:6789/0 conn(0x7fe5440c21f0 legacy=0x7fe5440cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:57.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.266+0000 7fe542ffd640 1 -- 172.21.15.5:0/1596872487 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1810176781 0 0) 0x7fe5440cac70 con 0x7fe5440c21f0 2023-07-14T13:05:57.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.266+0000 7fe5437fe640 1 -- 172.21.15.5:0/1596872487 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5440ca340 con 0x7fe54406b1e0 2023-07-14T13:05:57.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.266+0000 7fe543fff640 1 --2- 172.21.15.5:0/1596872487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe544070b70 0x7fe544070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:05:57.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.266+0000 7fe5437fe640 1 --2- 172.21.15.5:0/1596872487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe54406b1e0 0x7fe5440c1cb0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe5380097c0 tx=0x7fe53801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f48b86931635ec78 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:57.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.270+0000 7fe542ffd640 1 -- 172.21.15.5:0/1596872487 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5380ac640 con 0x7fe54406b1e0 2023-07-14T13:05:57.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.270+0000 7fe542ffd640 1 -- 172.21.15.5:0/1596872487 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5380ac7a0 con 0x7fe54406b1e0 2023-07-14T13:05:57.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.270+0000 7fe542ffd640 1 -- 172.21.15.5:0/1596872487 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5380acb30 con 0x7fe54406b1e0 2023-07-14T13:05:57.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.270+0000 7fe54a574640 1 -- 172.21.15.5:0/1596872487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe54406b1e0 msgr2=0x7fe5440c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:57.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.270+0000 7fe54a574640 1 --2- 172.21.15.5:0/1596872487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe54406b1e0 0x7fe5440c1cb0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe5380097c0 tx=0x7fe53801c3e0 comp rx=0 tx=0).stop 2023-07-14T13:05:57.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.270+0000 7fe54a574640 1 -- 172.21.15.5:0/1596872487 shutdown_connections 2023-07-14T13:05:57.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.270+0000 7fe54a574640 1 --2- 172.21.15.5:0/1596872487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe54406b1e0 0x7fe5440c1cb0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:57.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.270+0000 7fe54a574640 1 --2- 172.21.15.5:0/1596872487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe544070b70 0x7fe544070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:57.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.270+0000 7fe54a574640 1 -- 172.21.15.5:0/1596872487 >> 172.21.15.5:0/1596872487 conn(0x7fe5440afcf0 msgr2=0x7fe5440b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:57.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.270+0000 7fe54a574640 1 -- 172.21.15.5:0/1596872487 shutdown_connections 2023-07-14T13:05:57.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.270+0000 7fe54a574640 1 -- 172.21.15.5:0/1596872487 wait complete. 2023-07-14T13:05:57.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.270+0000 7fe54a574640 1 Processor -- start 2023-07-14T13:05:57.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.270+0000 7fe54a574640 1 -- start start 2023-07-14T13:05:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.270+0000 7fe54a574640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe54406b1e0 0x7fe544152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.270+0000 7fe54a574640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe544070b70 0x7fe5441525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.270+0000 7fe54a574640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5440c21f0 0x7fe544158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.270+0000 7fe54a574640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe544159a20 con 0x7fe544070b70 2023-07-14T13:05:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.270+0000 7fe54a574640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe544152c10 con 0x7fe5440c21f0 2023-07-14T13:05:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.270+0000 7fe54a574640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe544152ef0 con 0x7fe54406b1e0 2023-07-14T13:05:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.270+0000 7fe5437fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe544070b70 0x7fe5441525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.270+0000 7fe5437fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe544070b70 0x7fe5441525d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35392/0 (socket says 172.21.15.5:35392) 2023-07-14T13:05:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.270+0000 7fe5437fe640 1 -- 172.21.15.5:0/1096047905 learned_addr learned my addr 172.21.15.5:0/1096047905 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.274+0000 7fe543fff640 1 --2- 172.21.15.5:0/1096047905 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe54406b1e0 0x7fe544152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.274+0000 7fe548b11640 1 --2- 172.21.15.5:0/1096047905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5440c21f0 0x7fe544158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.274+0000 7fe5437fe640 1 -- 172.21.15.5:0/1096047905 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe54406b1e0 msgr2=0x7fe544152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.274+0000 7fe5437fe640 1 --2- 172.21.15.5:0/1096047905 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe54406b1e0 0x7fe544152090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.274+0000 7fe5437fe640 1 -- 172.21.15.5:0/1096047905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5440c21f0 msgr2=0x7fe544158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:57.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.274+0000 7fe5437fe640 1 --2- 172.21.15.5:0/1096047905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5440c21f0 0x7fe544158590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:57.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.274+0000 7fe5437fe640 1 -- 172.21.15.5:0/1096047905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe538009420 con 0x7fe544070b70 2023-07-14T13:05:57.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.274+0000 7fe5437fe640 1 --2- 172.21.15.5:0/1096047905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe544070b70 0x7fe5441525d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe53801a010 tx=0x7fe53801ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:57.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.274+0000 7fe540ff9640 1 -- 172.21.15.5:0/1096047905 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe538004220 con 0x7fe544070b70 2023-07-14T13:05:57.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.274+0000 7fe540ff9640 1 -- 172.21.15.5:0/1096047905 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe538004380 con 0x7fe544070b70 2023-07-14T13:05:57.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.274+0000 7fe540ff9640 1 -- 172.21.15.5:0/1096047905 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe538003820 con 0x7fe544070b70 2023-07-14T13:05:57.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.274+0000 7fe54a574640 1 -- 172.21.15.5:0/1096047905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5441531d0 con 0x7fe544070b70 2023-07-14T13:05:57.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.274+0000 7fe54a574640 1 -- 172.21.15.5:0/1096047905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe544153790 con 0x7fe544070b70 2023-07-14T13:05:57.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.274+0000 7fe54a574640 1 -- 172.21.15.5:0/1096047905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe544153980 con 0x7fe544070b70 2023-07-14T13:05:57.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.274+0000 7fe540ff9640 1 -- 172.21.15.5:0/1096047905 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe538003b90 con 0x7fe544070b70 2023-07-14T13:05:57.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.274+0000 7fe540ff9640 1 --2- 172.21.15.5:0/1096047905 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fe5300663a0 0x7fe530068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:57.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.278+0000 7fe540ff9640 1 -- 172.21.15.5:0/1096047905 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe53811e0b0 con 0x7fe544070b70 2023-07-14T13:05:57.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.278+0000 7fe543fff640 1 --2- 172.21.15.5:0/1096047905 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fe5300663a0 0x7fe530068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:57.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.278+0000 7fe543fff640 1 --2- 172.21.15.5:0/1096047905 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fe5300663a0 0x7fe530068850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe53400a9a0 tx=0x7fe534008040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:57.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.282+0000 7fe540ff9640 1 -- 172.21.15.5:0/1096047905 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe5380eb640 con 0x7fe544070b70 2023-07-14T13:05:57.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.490+0000 7fe54a574640 1 -- 172.21.15.5:0/1096047905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe5440678d0 con 0x7fe544070b70 2023-07-14T13:05:57.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.490+0000 7fe540ff9640 1 -- 172.21.15.5:0/1096047905 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fe5380b1090 con 0x7fe544070b70 2023-07-14T13:05:57.521 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:05:57.522 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T13:05:57.522 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2023-07-14T13:05:57.522 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:05:57.522 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2023-07-14T13:05:57.522 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkGNTsMRAA5T/zjdynxEKmoNAAK0cChw==", 2023-07-14T13:05:57.522 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:05:57.522 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:05:57.523 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:05:57.523 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:05:57.523 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:05:57.523 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:05:57.523 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:05:57.523 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:05:57.523 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2023-07-14T13:05:57.523 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkqXNAAxAAb7bzXyE8cSS0A3Rz2de6TA==", 2023-07-14T13:05:57.524 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:05:57.524 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:05:57.524 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:05:57.524 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:05:57.524 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:05:57.524 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:05:57.524 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:05:57.525 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:05:57.525 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2023-07-14T13:05:57.525 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFk6NGUORAA+5odxrAlCCXYGc64nzFWwQ==", 2023-07-14T13:05:57.525 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:05:57.525 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:05:57.525 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:05:57.525 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:05:57.525 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:05:57.526 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:05:57.526 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:05:57.526 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:05:57.526 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2023-07-14T13:05:57.526 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkGh/BChAA5p9amLIC6ORC0JJov0bSVg==", 2023-07-14T13:05:57.526 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:05:57.526 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:05:57.526 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:05:57.527 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:05:57.527 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:05:57.527 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:05:57.527 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:05:57.527 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:05:57.527 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2023-07-14T13:05:57.527 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDlRLFkJ6MULhAAxExAqekc/gWudYBJ2sY4MQ==", 2023-07-14T13:05:57.527 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:05:57.528 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:05:57.528 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:05:57.528 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:05:57.528 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:05:57.528 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:05:57.528 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:05:57.528 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2023-07-14T13:05:57.529 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDoRLFksXGBNRAAFtHZt5OQw0aB6k3CkxOzZQ==", 2023-07-14T13:05:57.529 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:05:57.529 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:05:57.529 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:05:57.529 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:05:57.529 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:05:57.529 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:05:57.529 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:05:57.530 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2023-07-14T13:05:57.530 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDsRLFkaUH0ARAAkqgsKPX1dTSZQjn0cRxxRQ==", 2023-07-14T13:05:57.530 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:05:57.530 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:05:57.530 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:05:57.530 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:05:57.530 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:05:57.530 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:05:57.531 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:05:57.531 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2023-07-14T13:05:57.531 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDvRLFkvElJCRAAnox5LKwobP/1Qaf5d9UsjA==", 2023-07-14T13:05:57.531 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:05:57.531 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:05:57.531 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:05:57.531 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:05:57.531 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:05:57.532 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:05:57.532 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:05:57.532 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2023-07-14T13:05:57.532 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD1RLFkMNyyDxAA19dJkhhuSpcgVPQEyxb3lg==", 2023-07-14T13:05:57.532 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:05:57.532 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:05:57.532 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:05:57.533 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:05:57.533 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:05:57.533 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:05:57.533 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:05:57.533 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2023-07-14T13:05:57.533 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD4RLFkR8mTFhAAP5qUgUJI23XOvVAnNCSgRQ==", 2023-07-14T13:05:57.533 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:05:57.533 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:05:57.534 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:05:57.534 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:05:57.534 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:05:57.534 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:05:57.534 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:05:57.534 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2023-07-14T13:05:57.534 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD7RLFkpWL9HBAAo8MfszRnB4sHsDPPcRjCAg==", 2023-07-14T13:05:57.534 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:05:57.535 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:05:57.535 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:05:57.535 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:05:57.535 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:05:57.536 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:05:57.537 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:05:57.537 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2023-07-14T13:05:57.537 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD+RLFkL5cRIxAAF/4ndtYf0oiH3uhhDKnQQg==", 2023-07-14T13:05:57.538 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:05:57.538 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:05:57.538 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:05:57.538 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:05:57.538 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:05:57.538 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:05:57.538 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:05:57.538 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2023-07-14T13:05:57.539 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkCav/DhAA6SOiONAbTcWCnUZXcm7BcQ==", 2023-07-14T13:05:57.539 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:05:57.539 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:05:57.539 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2023-07-14T13:05:57.539 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-14T13:05:57.539 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:05:57.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:05:57.540 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:05:57.540 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2023-07-14T13:05:57.540 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkgS/hGBAAevMD2/lfNuaeV74w0Xj0Zw==", 2023-07-14T13:05:57.540 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:05:57.540 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:05:57.540 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T13:05:57.540 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T13:05:57.541 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T13:05:57.541 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:05:57.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:05:57.541 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:05:57.541 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2023-07-14T13:05:57.541 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkeBs4FRAAJ/UjIEKDajVyDb7PejPqAw==", 2023-07-14T13:05:57.541 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:05:57.541 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:05:57.542 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T13:05:57.542 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T13:05:57.542 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T13:05:57.542 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:05:57.542 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:05:57.542 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:05:57.542 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2023-07-14T13:05:57.542 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkSkDiHhAAV86wIrAVz3o/PI2CaBC44w==", 2023-07-14T13:05:57.543 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:05:57.543 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:05:57.543 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T13:05:57.543 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T13:05:57.543 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T13:05:57.543 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:05:57.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:05:57.543 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:05:57.544 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2023-07-14T13:05:57.544 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkk5IcFRAAThI0P1N8LsRetmwhHqSvdQ==", 2023-07-14T13:05:57.544 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:05:57.544 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T13:05:57.544 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:05:57.544 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:05:57.545 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:05:57.545 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:05:57.545 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:05:57.545 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:05:57.545 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2023-07-14T13:05:57.545 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkugeXLRAAEVAnLk/dldtqrpkdzQI3SA==", 2023-07-14T13:05:57.545 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:05:57.545 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T13:05:57.546 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-07-14T13:05:57.546 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:05:57.546 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:05:57.546 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:05:57.546 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:05:57.546 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2023-07-14T13:05:57.546 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkSvp/KRAAwvjYlrZYNeGbhCiDrTmnrA==", 2023-07-14T13:05:57.546 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:05:57.547 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T13:05:57.547 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-07-14T13:05:57.547 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:05:57.547 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:05:57.547 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:05:57.547 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-07-14T13:05:57.547 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T13:05:57.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.490+0000 7fe54a574640 1 -- 172.21.15.5:0/1096047905 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fe5300663a0 msgr2=0x7fe530068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:57.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.490+0000 7fe54a574640 1 --2- 172.21.15.5:0/1096047905 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fe5300663a0 0x7fe530068850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe53400a9a0 tx=0x7fe534008040 comp rx=0 tx=0).stop 2023-07-14T13:05:57.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.490+0000 7fe54a574640 1 -- 172.21.15.5:0/1096047905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe544070b70 msgr2=0x7fe5441525d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:57.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.490+0000 7fe54a574640 1 --2- 172.21.15.5:0/1096047905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe544070b70 0x7fe5441525d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe53801a010 tx=0x7fe53801ac20 comp rx=0 tx=0).stop 2023-07-14T13:05:57.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.490+0000 7fe54a574640 1 -- 172.21.15.5:0/1096047905 shutdown_connections 2023-07-14T13:05:57.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.490+0000 7fe54a574640 1 --2- 172.21.15.5:0/1096047905 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fe5300663a0 0x7fe530068850 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:57.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.490+0000 7fe54a574640 1 --2- 172.21.15.5:0/1096047905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5440c21f0 0x7fe544158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:57.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.490+0000 7fe54a574640 1 --2- 172.21.15.5:0/1096047905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe544070b70 0x7fe5441525d0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:57.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.490+0000 7fe54a574640 1 --2- 172.21.15.5:0/1096047905 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe54406b1e0 0x7fe544152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:57.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.490+0000 7fe54a574640 1 -- 172.21.15.5:0/1096047905 >> 172.21.15.5:0/1096047905 conn(0x7fe5440afcf0 msgr2=0x7fe5440c4590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:57.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.490+0000 7fe54a574640 1 -- 172.21.15.5:0/1096047905 shutdown_connections 2023-07-14T13:05:57.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.490+0000 7fe54a574640 1 -- 172.21.15.5:0/1096047905 wait complete. 2023-07-14T13:05:57.551 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:05:57.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.662+0000 7f3251b2c640 1 Processor -- start 2023-07-14T13:05:57.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.662+0000 7f3251b2c640 1 -- start start 2023-07-14T13:05:57.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.666+0000 7f3251b2c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f324c0ae1f0 0x7f324c0b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:57.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.666+0000 7f3251b2c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f324c06e160 0x7f324c06bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:57.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.666+0000 7f3251b2c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324c06a440 con 0x7f324c06c260 2023-07-14T13:05:57.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.666+0000 7f3251b2c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f324c06c680 con 0x7f324c06e160 2023-07-14T13:05:57.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.666+0000 7f3251b2c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324c0b24f0 con 0x7f324c0ae1f0 2023-07-14T13:05:57.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.666+0000 7f324affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f324c06e160 0x7f324c06bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:57.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.666+0000 7f324affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f324c06e160 0x7f324c06bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35398/0 (socket says 172.21.15.5:35398) 2023-07-14T13:05:57.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.666+0000 7f324affd640 1 -- 172.21.15.5:0/1091948206 learned_addr learned my addr 172.21.15.5:0/1091948206 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:57.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.666+0000 7f324b7fe640 1 --2- 172.21.15.5:0/1091948206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f324c0ae1f0 0x7f324c0b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:57.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.666+0000 7f324affd640 1 -- 172.21.15.5:0/1091948206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f324c0ae1f0 msgr2=0x7f324c0b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:57.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.666+0000 7f324affd640 1 --2- 172.21.15.5:0/1091948206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f324c0ae1f0 0x7f324c0b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:57.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.666+0000 7f324affd640 1 -- 172.21.15.5:0/1091948206 >> v1:172.21.15.154:6789/0 conn(0x7f324c06c260 legacy=0x7f324c15f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:57.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.666+0000 7f324affd640 1 -- 172.21.15.5:0/1091948206 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324c0b27d0 con 0x7f324c06e160 2023-07-14T13:05:57.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.670+0000 7f324affd640 1 --2- 172.21.15.5:0/1091948206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f324c06e160 0x7f324c06bd20 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3240009870 tx=0x7f324001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637167cfc6ebf29 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:57.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.670+0000 7f324a7fc640 1 -- 172.21.15.5:0/1091948206 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32400a7070 con 0x7f324c06e160 2023-07-14T13:05:57.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.670+0000 7f324a7fc640 1 -- 172.21.15.5:0/1091948206 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32400ab430 con 0x7f324c06e160 2023-07-14T13:05:57.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.670+0000 7f324a7fc640 1 -- 172.21.15.5:0/1091948206 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32400ab7c0 con 0x7f324c06e160 2023-07-14T13:05:57.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.670+0000 7f3251b2c640 1 -- 172.21.15.5:0/1091948206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f324c06e160 msgr2=0x7f324c06bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:57.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.670+0000 7f3251b2c640 1 --2- 172.21.15.5:0/1091948206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f324c06e160 0x7f324c06bd20 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3240009870 tx=0x7f324001c510 comp rx=0 tx=0).stop 2023-07-14T13:05:57.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.670+0000 7f3251b2c640 1 -- 172.21.15.5:0/1091948206 shutdown_connections 2023-07-14T13:05:57.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.670+0000 7f3251b2c640 1 --2- 172.21.15.5:0/1091948206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f324c06e160 0x7f324c06bd20 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:57.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.670+0000 7f3251b2c640 1 --2- 172.21.15.5:0/1091948206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f324c0ae1f0 0x7f324c0b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:57.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.670+0000 7f3251b2c640 1 -- 172.21.15.5:0/1091948206 >> 172.21.15.5:0/1091948206 conn(0x7f324c0b1300 msgr2=0x7f324c0ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:57.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.670+0000 7f3251b2c640 1 -- 172.21.15.5:0/1091948206 shutdown_connections 2023-07-14T13:05:57.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.670+0000 7f3251b2c640 1 -- 172.21.15.5:0/1091948206 wait complete. 2023-07-14T13:05:57.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.670+0000 7f3251b2c640 1 Processor -- start 2023-07-14T13:05:57.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.670+0000 7f3251b2c640 1 -- start start 2023-07-14T13:05:57.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.674+0000 7f3251b2c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f324c06c260 0x7f324c15b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:57.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.674+0000 7f3251b2c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f324c06e160 0x7f324c15ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:57.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.674+0000 7f3251b2c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f324c0ae1f0 0x7f324c143530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:57.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.674+0000 7f3251b2c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324c15fae0 con 0x7f324c0ae1f0 2023-07-14T13:05:57.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.674+0000 7f3251b2c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324c15b580 con 0x7f324c06c260 2023-07-14T13:05:57.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.674+0000 7f3251b2c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324c15f800 con 0x7f324c06e160 2023-07-14T13:05:57.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.674+0000 7f324bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f324c0ae1f0 0x7f324c143530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:57.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.674+0000 7f324bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f324c0ae1f0 0x7f324c143530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35414/0 (socket says 172.21.15.5:35414) 2023-07-14T13:05:57.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.674+0000 7f324affd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f324c06e160 0x7f324c15ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:57.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.674+0000 7f324b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f324c06c260 0x7f324c15b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:57.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.674+0000 7f324bfff640 1 -- 172.21.15.5:0/531190082 learned_addr learned my addr 172.21.15.5:0/531190082 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:57.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.674+0000 7f324bfff640 1 -- 172.21.15.5:0/531190082 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f324c06e160 msgr2=0x7f324c15ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:57.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.674+0000 7f324bfff640 1 --2- 172.21.15.5:0/531190082 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f324c06e160 0x7f324c15ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:57.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.674+0000 7f324bfff640 1 -- 172.21.15.5:0/531190082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f324c06c260 msgr2=0x7f324c15b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:57.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.674+0000 7f324bfff640 1 --2- 172.21.15.5:0/531190082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f324c06c260 0x7f324c15b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:57.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.674+0000 7f324bfff640 1 -- 172.21.15.5:0/531190082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32400094d0 con 0x7f324c0ae1f0 2023-07-14T13:05:57.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.674+0000 7f324bfff640 1 --2- 172.21.15.5:0/531190082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f324c0ae1f0 0x7f324c143530 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f324400c770 tx=0x7f324400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:57.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.674+0000 7f3233fff640 1 -- 172.21.15.5:0/531190082 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3244003b80 con 0x7f324c0ae1f0 2023-07-14T13:05:57.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.674+0000 7f3233fff640 1 -- 172.21.15.5:0/531190082 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3244003ce0 con 0x7f324c0ae1f0 2023-07-14T13:05:57.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.674+0000 7f3233fff640 1 -- 172.21.15.5:0/531190082 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324400aa90 con 0x7f324c0ae1f0 2023-07-14T13:05:57.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.674+0000 7f3251b2c640 1 -- 172.21.15.5:0/531190082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f324c0cb4a0 con 0x7f324c0ae1f0 2023-07-14T13:05:57.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.674+0000 7f3251b2c640 1 -- 172.21.15.5:0/531190082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f324c0cba60 con 0x7f324c0ae1f0 2023-07-14T13:05:57.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.674+0000 7f3251b2c640 1 -- 172.21.15.5:0/531190082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f324c0cbc50 con 0x7f324c0ae1f0 2023-07-14T13:05:57.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.674+0000 7f3233fff640 1 -- 172.21.15.5:0/531190082 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f324400abf0 con 0x7f324c0ae1f0 2023-07-14T13:05:57.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.678+0000 7f3233fff640 1 --2- 172.21.15.5:0/531190082 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f32380663a0 0x7f3238068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:57.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.678+0000 7f3233fff640 1 -- 172.21.15.5:0/531190082 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3244083910 con 0x7f324c0ae1f0 2023-07-14T13:05:57.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.678+0000 7f324b7fe640 1 --2- 172.21.15.5:0/531190082 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f32380663a0 0x7f3238068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:57.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.678+0000 7f324b7fe640 1 --2- 172.21.15.5:0/531190082 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f32380663a0 0x7f3238068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f323c0079c0 tx=0x7f323c008040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:57.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.682+0000 7f3233fff640 1 -- 172.21.15.5:0/531190082 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3244050fe0 con 0x7f324c0ae1f0 2023-07-14T13:05:57.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.838+0000 7f3251b2c640 1 -- 172.21.15.5:0/531190082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f324c0678d0 con 0x7f324c0ae1f0 2023-07-14T13:05:57.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.838+0000 7f3233fff640 1 -- 172.21.15.5:0/531190082 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+14591 (secure 0 0 0) 0x7f3244054600 con 0x7f324c0ae1f0 2023-07-14T13:05:57.871 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:05:57.871 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":61,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:05:57.083976+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:05:57.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.842+0000 7f3251b2c640 1 -- 172.21.15.5:0/531190082 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f32380663a0 msgr2=0x7f3238068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.842+0000 7f3251b2c640 1 --2- 172.21.15.5:0/531190082 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f32380663a0 0x7f3238068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f323c0079c0 tx=0x7f323c008040 comp rx=0 tx=0).stop 2023-07-14T13:05:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.842+0000 7f3251b2c640 1 -- 172.21.15.5:0/531190082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f324c0ae1f0 msgr2=0x7f324c143530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.842+0000 7f3251b2c640 1 --2- 172.21.15.5:0/531190082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f324c0ae1f0 0x7f324c143530 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f324400c770 tx=0x7f324400cc30 comp rx=0 tx=0).stop 2023-07-14T13:05:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.842+0000 7f3251b2c640 1 -- 172.21.15.5:0/531190082 shutdown_connections 2023-07-14T13:05:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.842+0000 7f3251b2c640 1 --2- 172.21.15.5:0/531190082 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f32380663a0 0x7f3238068850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.842+0000 7f3251b2c640 1 --2- 172.21.15.5:0/531190082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f324c0ae1f0 0x7f324c143530 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.842+0000 7f3251b2c640 1 --2- 172.21.15.5:0/531190082 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f324c06e160 0x7f324c15ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.842+0000 7f3251b2c640 1 --2- 172.21.15.5:0/531190082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f324c06c260 0x7f324c15b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.842+0000 7f3251b2c640 1 -- 172.21.15.5:0/531190082 >> 172.21.15.5:0/531190082 conn(0x7f324c0b1300 msgr2=0x7f324c0cab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.842+0000 7f3251b2c640 1 -- 172.21.15.5:0/531190082 shutdown_connections 2023-07-14T13:05:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:57.842+0000 7f3251b2c640 1 -- 172.21.15.5:0/531190082 wait complete. 2023-07-14T13:05:57.893 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:05:57.894 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:05:58.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.010+0000 7f7a20fe9640 1 Processor -- start 2023-07-14T13:05:58.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.010+0000 7f7a20fe9640 1 -- start start 2023-07-14T13:05:58.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.010+0000 7f7a20fe9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a1c15bde0 0x7f7a1c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.010+0000 7f7a20fe9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a1c0d2fc0 0x7f7a1c0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.010+0000 7f7a20fe9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1c0b04c0 con 0x7f7a1c0d2300 2023-07-14T13:05:58.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.010+0000 7f7a20fe9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a1c15c1b0 con 0x7f7a1c0d2fc0 2023-07-14T13:05:58.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.010+0000 7f7a20fe9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c0d0aa0 con 0x7f7a1c15bde0 2023-07-14T13:05:58.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.010+0000 7f7a1ad9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7a1c0d2300 0x7f7a1c0cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54244/0 (socket says 172.21.15.5:54244) 2023-07-14T13:05:58.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.010+0000 7f7a1ad9d640 1 -- 172.21.15.5:0/3007725739 learned_addr learned my addr 172.21.15.5:0/3007725739 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:58.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.010+0000 7f7a19d9b640 1 --2- 172.21.15.5:0/3007725739 >> v2:172.21.15.5:3300/0 conn(0x7f7a1c0d2fc0 0x7f7a1c0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.010+0000 7f7a1a59c640 1 --2- 172.21.15.5:0/3007725739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a1c15bde0 0x7f7a1c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.010+0000 7f7a1959a640 1 -- 172.21.15.5:0/3007725739 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1417477802 0 0) 0x7f7a1c0b04c0 con 0x7f7a1c0d2300 2023-07-14T13:05:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.010+0000 7f7a1959a640 1 -- 172.21.15.5:0/3007725739 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a04003530 con 0x7f7a1c0d2300 2023-07-14T13:05:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.010+0000 7f7a19d9b640 1 -- 172.21.15.5:0/3007725739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a1c15bde0 msgr2=0x7f7a1c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.010+0000 7f7a19d9b640 1 --2- 172.21.15.5:0/3007725739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a1c15bde0 0x7f7a1c0d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.010+0000 7f7a19d9b640 1 -- 172.21.15.5:0/3007725739 >> v1:172.21.15.5:6789/0 conn(0x7f7a1c0d2300 legacy=0x7f7a1c0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.010+0000 7f7a19d9b640 1 -- 172.21.15.5:0/3007725739 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c0afb90 con 0x7f7a1c0d2fc0 2023-07-14T13:05:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.014+0000 7f7a19d9b640 1 --2- 172.21.15.5:0/3007725739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a1c0d2fc0 0x7f7a1c0b0950 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7a100097c0 tx=0x7f7a1001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2c7d4688fa07ad server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.014+0000 7f7a1959a640 1 -- 172.21.15.5:0/3007725739 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a100ab680 con 0x7f7a1c0d2fc0 2023-07-14T13:05:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.014+0000 7f7a1959a640 1 -- 172.21.15.5:0/3007725739 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a100ab7e0 con 0x7f7a1c0d2fc0 2023-07-14T13:05:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.014+0000 7f7a1959a640 1 -- 172.21.15.5:0/3007725739 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a100abb70 con 0x7f7a1c0d2fc0 2023-07-14T13:05:58.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.014+0000 7f7a20fe9640 1 -- 172.21.15.5:0/3007725739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a1c0d2fc0 msgr2=0x7f7a1c0b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.014+0000 7f7a20fe9640 1 --2- 172.21.15.5:0/3007725739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a1c0d2fc0 0x7f7a1c0b0950 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7a100097c0 tx=0x7f7a1001c480 comp rx=0 tx=0).stop 2023-07-14T13:05:58.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.014+0000 7f7a20fe9640 1 -- 172.21.15.5:0/3007725739 shutdown_connections 2023-07-14T13:05:58.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.014+0000 7f7a20fe9640 1 --2- 172.21.15.5:0/3007725739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a1c0d2fc0 0x7f7a1c0b0950 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.014+0000 7f7a20fe9640 1 --2- 172.21.15.5:0/3007725739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a1c15bde0 0x7f7a1c0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.014+0000 7f7a20fe9640 1 -- 172.21.15.5:0/3007725739 >> 172.21.15.5:0/3007725739 conn(0x7f7a1c0659d0 msgr2=0x7f7a1c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:58.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.014+0000 7f7a20fe9640 1 -- 172.21.15.5:0/3007725739 shutdown_connections 2023-07-14T13:05:58.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.014+0000 7f7a20fe9640 1 -- 172.21.15.5:0/3007725739 wait complete. 2023-07-14T13:05:58.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.018+0000 7f7a20fe9640 1 Processor -- start 2023-07-14T13:05:58.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.018+0000 7f7a20fe9640 1 -- start start 2023-07-14T13:05:58.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.018+0000 7f7a20fe9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a1c0d2300 0x7f7a1c0cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.018+0000 7f7a20fe9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a1c0d2fc0 0x7f7a1c14b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.018+0000 7f7a20fe9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a1c15bde0 0x7f7a1c14bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.018+0000 7f7a20fe9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c15c320 con 0x7f7a1c0d2fc0 2023-07-14T13:05:58.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.018+0000 7f7a20fe9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c0c9950 con 0x7f7a1c15bde0 2023-07-14T13:05:58.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.018+0000 7f7a20fe9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c14c240 con 0x7f7a1c0d2300 2023-07-14T13:05:58.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.018+0000 7f7a19d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a1c0d2fc0 0x7f7a1c14b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.018+0000 7f7a19d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a1c0d2fc0 0x7f7a1c14b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35420/0 (socket says 172.21.15.5:35420) 2023-07-14T13:05:58.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.018+0000 7f7a19d9b640 1 -- 172.21.15.5:0/3773793598 learned_addr learned my addr 172.21.15.5:0/3773793598 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:58.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.018+0000 7f7a1a59c640 1 --2- 172.21.15.5:0/3773793598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a1c0d2300 0x7f7a1c0cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.018+0000 7f7a1ad9d640 1 --2- 172.21.15.5:0/3773793598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a1c15bde0 0x7f7a1c14bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.018+0000 7f7a19d9b640 1 -- 172.21.15.5:0/3773793598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a1c0d2300 msgr2=0x7f7a1c0cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.018+0000 7f7a19d9b640 1 --2- 172.21.15.5:0/3773793598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a1c0d2300 0x7f7a1c0cbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.018+0000 7f7a19d9b640 1 -- 172.21.15.5:0/3773793598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a1c15bde0 msgr2=0x7f7a1c14bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.018+0000 7f7a19d9b640 1 --2- 172.21.15.5:0/3773793598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a1c15bde0 0x7f7a1c14bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.018+0000 7f7a19d9b640 1 -- 172.21.15.5:0/3773793598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a10009420 con 0x7f7a1c0d2fc0 2023-07-14T13:05:58.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.018+0000 7f7a1ad9d640 1 --2- 172.21.15.5:0/3773793598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a1c15bde0 0x7f7a1c14bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:05:58.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.018+0000 7f7a19d9b640 1 --2- 172.21.15.5:0/3773793598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a1c0d2fc0 0x7f7a1c14b7c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7a100ad040 tx=0x7f7a1001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:58.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.018+0000 7f7a0affd640 1 -- 172.21.15.5:0/3773793598 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a100bf610 con 0x7f7a1c0d2fc0 2023-07-14T13:05:58.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.018+0000 7f7a0affd640 1 -- 172.21.15.5:0/3773793598 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a100bf790 con 0x7f7a1c0d2fc0 2023-07-14T13:05:58.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.018+0000 7f7a0affd640 1 -- 172.21.15.5:0/3773793598 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a100bfb40 con 0x7f7a1c0d2fc0 2023-07-14T13:05:58.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.018+0000 7f7a20fe9640 1 -- 172.21.15.5:0/3773793598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a1c0c8800 con 0x7f7a1c0d2fc0 2023-07-14T13:05:58.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.018+0000 7f7a20fe9640 1 -- 172.21.15.5:0/3773793598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1c0c8dc0 con 0x7f7a1c0d2fc0 2023-07-14T13:05:58.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.022+0000 7f7a20fe9640 1 -- 172.21.15.5:0/3773793598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1c0c9b00 con 0x7f7a1c0d2fc0 2023-07-14T13:05:58.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.022+0000 7f7a0affd640 1 -- 172.21.15.5:0/3773793598 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7a100b5400 con 0x7f7a1c0d2fc0 2023-07-14T13:05:58.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.022+0000 7f7a0affd640 1 --2- 172.21.15.5:0/3773793598 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f79fc0663a0 0x7f79fc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.022+0000 7f7a0affd640 1 -- 172.21.15.5:0/3773793598 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7a1011e660 con 0x7f7a1c0d2fc0 2023-07-14T13:05:58.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.022+0000 7f7a1a59c640 1 --2- 172.21.15.5:0/3773793598 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f79fc0663a0 0x7f79fc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.022+0000 7f7a1a59c640 1 --2- 172.21.15.5:0/3773793598 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f79fc0663a0 0x7f79fc068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c009b40 tx=0x7f7a0c006f90 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:58.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.026+0000 7f7a0affd640 1 -- 172.21.15.5:0/3773793598 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7a1c0c9b00 con 0x7f7a1c0d2fc0 2023-07-14T13:05:58.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.182+0000 7f7a20fe9640 1 -- 172.21.15.5:0/3773793598 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7a1c0c9b00 con 0x7f7a1c0d2fc0 2023-07-14T13:05:58.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.182+0000 7f7a0affd640 1 -- 172.21.15.5:0/3773793598 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7a1c0c9b00 con 0x7f7a1c0d2fc0 2023-07-14T13:05:58.213 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:05:58.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.182+0000 7f7a20fe9640 1 -- 172.21.15.5:0/3773793598 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f79fc0663a0 msgr2=0x7f79fc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.182+0000 7f7a20fe9640 1 --2- 172.21.15.5:0/3773793598 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f79fc0663a0 0x7f79fc068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c009b40 tx=0x7f7a0c006f90 comp rx=0 tx=0).stop 2023-07-14T13:05:58.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.182+0000 7f7a20fe9640 1 -- 172.21.15.5:0/3773793598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a1c0d2fc0 msgr2=0x7f7a1c14b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.182+0000 7f7a20fe9640 1 --2- 172.21.15.5:0/3773793598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a1c0d2fc0 0x7f7a1c14b7c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7a100ad040 tx=0x7f7a1001acc0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.182+0000 7f7a20fe9640 1 -- 172.21.15.5:0/3773793598 shutdown_connections 2023-07-14T13:05:58.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.182+0000 7f7a20fe9640 1 --2- 172.21.15.5:0/3773793598 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f79fc0663a0 0x7f79fc068850 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.182+0000 7f7a20fe9640 1 --2- 172.21.15.5:0/3773793598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a1c15bde0 0x7f7a1c14bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.182+0000 7f7a20fe9640 1 --2- 172.21.15.5:0/3773793598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a1c0d2fc0 0x7f7a1c14b7c0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.182+0000 7f7a20fe9640 1 --2- 172.21.15.5:0/3773793598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a1c0d2300 0x7f7a1c0cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.182+0000 7f7a20fe9640 1 -- 172.21.15.5:0/3773793598 >> 172.21.15.5:0/3773793598 conn(0x7f7a1c0659d0 msgr2=0x7f7a1c152f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:58.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.182+0000 7f7a20fe9640 1 -- 172.21.15.5:0/3773793598 shutdown_connections 2023-07-14T13:05:58.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.182+0000 7f7a20fe9640 1 -- 172.21.15.5:0/3773793598 wait complete. 2023-07-14T13:05:58.234 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:05:58.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.350+0000 7f6fce7fa640 1 Processor -- start 2023-07-14T13:05:58.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.350+0000 7f6fce7fa640 1 -- start start 2023-07-14T13:05:58.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.350+0000 7f6fce7fa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6fc80d2fc0 0x7f6fc80b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.350+0000 7f6fce7fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fc80d2300 0x7f6fc80d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.350+0000 7f6fce7fa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc80b04c0 con 0x7f6fc815bde0 2023-07-14T13:05:58.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.350+0000 7f6fce7fa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc815c1b0 con 0x7f6fc80d2fc0 2023-07-14T13:05:58.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.350+0000 7f6fce7fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc80d2cc0 con 0x7f6fc80d2300 2023-07-14T13:05:58.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.350+0000 7f6fc7fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6fc815bde0 0x7f6fc80d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54252/0 (socket says 172.21.15.5:54252) 2023-07-14T13:05:58.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.350+0000 7f6fc7fff640 1 -- 172.21.15.5:0/2937283899 learned_addr learned my addr 172.21.15.5:0/2937283899 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:58.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.350+0000 7f6fc77fe640 1 --2- 172.21.15.5:0/2937283899 >> v2:172.21.15.154:3300/0 conn(0x7f6fc80d2fc0 0x7f6fc80b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.350+0000 7f6fccd97640 1 --2- 172.21.15.5:0/2937283899 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fc80d2300 0x7f6fc80d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.350+0000 7f6fc6ffd640 1 -- 172.21.15.5:0/2937283899 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 985651677 0 0) 0x7f6fc80b04c0 con 0x7f6fc815bde0 2023-07-14T13:05:58.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.350+0000 7f6fc6ffd640 1 -- 172.21.15.5:0/2937283899 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fb0003530 con 0x7f6fc815bde0 2023-07-14T13:05:58.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.350+0000 7f6fc6ffd640 1 -- 172.21.15.5:0/2937283899 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 289204985 0 0) 0x7f6fb0003530 con 0x7f6fc815bde0 2023-07-14T13:05:58.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.350+0000 7f6fc6ffd640 1 -- 172.21.15.5:0/2937283899 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fc80d2300 msgr2=0x7f6fc80d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:58.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.350+0000 7f6fc6ffd640 1 --2- 172.21.15.5:0/2937283899 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fc80d2300 0x7f6fc80d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.350+0000 7f6fc6ffd640 1 -- 172.21.15.5:0/2937283899 >> v2:172.21.15.154:3300/0 conn(0x7f6fc80d2fc0 msgr2=0x7f6fc80b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:58.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.350+0000 7f6fc6ffd640 1 --2- 172.21.15.5:0/2937283899 >> v2:172.21.15.154:3300/0 conn(0x7f6fc80d2fc0 0x7f6fc80b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.350+0000 7f6fc6ffd640 1 -- 172.21.15.5:0/2937283899 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc80d0aa0 con 0x7f6fc815bde0 2023-07-14T13:05:58.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.350+0000 7f6fc77fe640 1 --2- 172.21.15.5:0/2937283899 >> v2:172.21.15.154:3300/0 conn(0x7f6fc80d2fc0 0x7f6fc80b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:58.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.350+0000 7f6fc6ffd640 1 -- 172.21.15.5:0/2937283899 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f6fb8001800 con 0x7f6fc815bde0 2023-07-14T13:05:58.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.350+0000 7f6fc6ffd640 1 -- 172.21.15.5:0/2937283899 >> v1:172.21.15.5:6789/0 conn(0x7f6fc815bde0 legacy=0x7f6fc80d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.350+0000 7f6fc6ffd640 1 --2- 172.21.15.5:0/2937283899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fb0003980 0x7f6fb0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.354+0000 7f6fc6ffd640 1 --2- 172.21.15.5:0/2937283899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fb00043b0 0x7f6fb0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.354+0000 7f6fc6ffd640 1 --2- 172.21.15.5:0/2937283899 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fc80d2300 0x7f6fb0004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.354+0000 7f6fc6ffd640 1 -- 172.21.15.5:0/2937283899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc815c1b0 con 0x7f6fb0003980 2023-07-14T13:05:58.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.354+0000 7f6fc6ffd640 1 -- 172.21.15.5:0/2937283899 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc80d2cc0 con 0x7f6fb00043b0 2023-07-14T13:05:58.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.354+0000 7f6fc6ffd640 1 -- 172.21.15.5:0/2937283899 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb000b990 con 0x7f6fc80d2300 2023-07-14T13:05:58.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.354+0000 7f6fc7fff640 1 --2- 172.21.15.5:0/2937283899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fb0003980 0x7f6fb0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.354+0000 7f6fc77fe640 1 --2- 172.21.15.5:0/2937283899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fb00043b0 0x7f6fb0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.354+0000 7f6fccd97640 1 --2- 172.21.15.5:0/2937283899 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fc80d2300 0x7f6fb0004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.354+0000 7f6fc7fff640 1 -- 172.21.15.5:0/2937283899 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fc80d2300 msgr2=0x7f6fb0004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:58.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.354+0000 7f6fc7fff640 1 --2- 172.21.15.5:0/2937283899 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fc80d2300 0x7f6fb0004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.354+0000 7f6fc7fff640 1 -- 172.21.15.5:0/2937283899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fb00043b0 msgr2=0x7f6fb0004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:58.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.354+0000 7f6fc7fff640 1 --2- 172.21.15.5:0/2937283899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fb00043b0 0x7f6fb0004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.354+0000 7f6fc7fff640 1 -- 172.21.15.5:0/2937283899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb0003530 con 0x7f6fb0003980 2023-07-14T13:05:58.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.354+0000 7f6fc77fe640 1 --2- 172.21.15.5:0/2937283899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fb00043b0 0x7f6fb0004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:05:58.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.354+0000 7f6fc7fff640 1 --2- 172.21.15.5:0/2937283899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fb0003980 0x7f6fb0003d90 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6fb800c240 tx=0x7f6fb801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a94b37506d17e35 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:58.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.354+0000 7f6fc6ffd640 1 -- 172.21.15.5:0/2937283899 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb80070d0 con 0x7f6fb0003980 2023-07-14T13:05:58.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.354+0000 7f6fc6ffd640 1 -- 172.21.15.5:0/2937283899 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb8007230 con 0x7f6fb0003980 2023-07-14T13:05:58.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.358+0000 7f6fc6ffd640 1 -- 172.21.15.5:0/2937283899 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb8007600 con 0x7f6fb0003980 2023-07-14T13:05:58.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.358+0000 7f6fce7fa640 1 -- 172.21.15.5:0/2937283899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fb0003980 msgr2=0x7f6fb0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.358+0000 7f6fce7fa640 1 --2- 172.21.15.5:0/2937283899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fb0003980 0x7f6fb0003d90 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6fb800c240 tx=0x7f6fb801cc60 comp rx=0 tx=0).stop 2023-07-14T13:05:58.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.358+0000 7f6fccd97640 1 -- 172.21.15.5:0/2937283899 reap_dead start 2023-07-14T13:05:58.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.358+0000 7f6fce7fa640 1 -- 172.21.15.5:0/2937283899 shutdown_connections 2023-07-14T13:05:58.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.358+0000 7f6fce7fa640 1 -- 172.21.15.5:0/2937283899 >> 172.21.15.5:0/2937283899 conn(0x7f6fc80659d0 msgr2=0x7f6fc809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:58.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.358+0000 7f6fce7fa640 1 -- 172.21.15.5:0/2937283899 shutdown_connections 2023-07-14T13:05:58.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.358+0000 7f6fce7fa640 1 -- 172.21.15.5:0/2937283899 wait complete. 2023-07-14T13:05:58.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.358+0000 7f6fce7fa640 1 Processor -- start 2023-07-14T13:05:58.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.358+0000 7f6fce7fa640 1 -- start start 2023-07-14T13:05:58.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.358+0000 7f6fce7fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fc815b1f0 0x7f6fc814e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.358+0000 7f6fce7fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fc8150f80 0x7f6fc8156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.358+0000 7f6fce7fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fc81573e0 0x7f6fc814ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.358+0000 7f6fce7fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc80cc1f0 con 0x7f6fc8150f80 2023-07-14T13:05:58.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.358+0000 7f6fce7fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc8157850 con 0x7f6fc81573e0 2023-07-14T13:05:58.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.358+0000 7f6fce7fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc814e100 con 0x7f6fc815b1f0 2023-07-14T13:05:58.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.358+0000 7f6fc77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fc8150f80 0x7f6fc8156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.358+0000 7f6fc77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fc8150f80 0x7f6fc8156ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35448/0 (socket says 172.21.15.5:35448) 2023-07-14T13:05:58.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.358+0000 7f6fc77fe640 1 -- 172.21.15.5:0/3232039060 learned_addr learned my addr 172.21.15.5:0/3232039060 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:58.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.362+0000 7f6fccd97640 1 --2- 172.21.15.5:0/3232039060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fc81573e0 0x7f6fc814ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.362+0000 7f6fc7fff640 1 --2- 172.21.15.5:0/3232039060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fc815b1f0 0x7f6fc814e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.362+0000 7f6fc77fe640 1 -- 172.21.15.5:0/3232039060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fc815b1f0 msgr2=0x7f6fc814e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.362+0000 7f6fc77fe640 1 --2- 172.21.15.5:0/3232039060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fc815b1f0 0x7f6fc814e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.362+0000 7f6fc77fe640 1 -- 172.21.15.5:0/3232039060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fc81573e0 msgr2=0x7f6fc814ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.362+0000 7f6fc77fe640 1 --2- 172.21.15.5:0/3232039060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fc81573e0 0x7f6fc814ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.362+0000 7f6fc77fe640 1 -- 172.21.15.5:0/3232039060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc80cb570 con 0x7f6fc8150f80 2023-07-14T13:05:58.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.362+0000 7f6fc7fff640 1 --2- 172.21.15.5:0/3232039060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fc815b1f0 0x7f6fc814e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:05:58.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.362+0000 7f6fccd97640 1 --2- 172.21.15.5:0/3232039060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fc81573e0 0x7f6fc814ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:05:58.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.362+0000 7f6fc77fe640 1 --2- 172.21.15.5:0/3232039060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fc8150f80 0x7f6fc8156ea0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0118d0 tx=0x7f6fbc011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:58.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.362+0000 7f6fc4ff9640 1 -- 172.21.15.5:0/3232039060 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc00fb70 con 0x7f6fc8150f80 2023-07-14T13:05:58.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.362+0000 7f6fc4ff9640 1 -- 172.21.15.5:0/3232039060 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fbc00fcd0 con 0x7f6fc8150f80 2023-07-14T13:05:58.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.362+0000 7f6fc4ff9640 1 -- 172.21.15.5:0/3232039060 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc009e80 con 0x7f6fc8150f80 2023-07-14T13:05:58.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.362+0000 7f6fce7fa640 1 -- 172.21.15.5:0/3232039060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc80cb850 con 0x7f6fc8150f80 2023-07-14T13:05:58.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.362+0000 7f6fce7fa640 1 -- 172.21.15.5:0/3232039060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc80cbe10 con 0x7f6fc8150f80 2023-07-14T13:05:58.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.362+0000 7f6fce7fa640 1 -- 172.21.15.5:0/3232039060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc80678d0 con 0x7f6fc8150f80 2023-07-14T13:05:58.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.362+0000 7f6fc4ff9640 1 -- 172.21.15.5:0/3232039060 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6fbc015460 con 0x7f6fc8150f80 2023-07-14T13:05:58.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.362+0000 7f6fc4ff9640 1 --2- 172.21.15.5:0/3232039060 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f6fb40663d0 0x7f6fb4068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.362+0000 7f6fc4ff9640 1 -- 172.21.15.5:0/3232039060 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6fbc084300 con 0x7f6fc8150f80 2023-07-14T13:05:58.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.366+0000 7f6fc7fff640 1 --2- 172.21.15.5:0/3232039060 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f6fb40663d0 0x7f6fb4068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.366+0000 7f6fc7fff640 1 --2- 172.21.15.5:0/3232039060 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f6fb40663d0 0x7f6fb4068880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6fb80aa000 tx=0x7f6fb8001c00 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:58.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.366+0000 7f6fc4ff9640 1 -- 172.21.15.5:0/3232039060 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6fbc051a30 con 0x7f6fc8150f80 2023-07-14T13:05:58.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.522+0000 7f6fce7fa640 1 -- 172.21.15.5:0/3232039060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6fc806bf20 con 0x7f6fc8150f80 2023-07-14T13:05:58.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.522+0000 7f6fc4ff9640 1 -- 172.21.15.5:0/3232039060 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v61) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6fbc055050 con 0x7f6fc8150f80 2023-07-14T13:05:58.554 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:05:58.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.526+0000 7f6fce7fa640 1 -- 172.21.15.5:0/3232039060 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f6fb40663d0 msgr2=0x7f6fb4068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.526+0000 7f6fce7fa640 1 --2- 172.21.15.5:0/3232039060 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f6fb40663d0 0x7f6fb4068880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6fb80aa000 tx=0x7f6fb8001c00 comp rx=0 tx=0).stop 2023-07-14T13:05:58.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.526+0000 7f6fce7fa640 1 -- 172.21.15.5:0/3232039060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fc8150f80 msgr2=0x7f6fc8156ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.526+0000 7f6fce7fa640 1 --2- 172.21.15.5:0/3232039060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fc8150f80 0x7f6fc8156ea0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0118d0 tx=0x7f6fbc011d90 comp rx=0 tx=0).stop 2023-07-14T13:05:58.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.526+0000 7f6fce7fa640 1 -- 172.21.15.5:0/3232039060 shutdown_connections 2023-07-14T13:05:58.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.526+0000 7f6fce7fa640 1 --2- 172.21.15.5:0/3232039060 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f6fb40663d0 0x7f6fb4068880 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.526+0000 7f6fce7fa640 1 --2- 172.21.15.5:0/3232039060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fc81573e0 0x7f6fc814ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.526+0000 7f6fce7fa640 1 --2- 172.21.15.5:0/3232039060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fc8150f80 0x7f6fc8156ea0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.526+0000 7f6fce7fa640 1 --2- 172.21.15.5:0/3232039060 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fc815b1f0 0x7f6fc814e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.526+0000 7f6fce7fa640 1 -- 172.21.15.5:0/3232039060 >> 172.21.15.5:0/3232039060 conn(0x7f6fc80659d0 msgr2=0x7f6fc806afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:58.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.526+0000 7f6fce7fa640 1 -- 172.21.15.5:0/3232039060 shutdown_connections 2023-07-14T13:05:58.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.526+0000 7f6fce7fa640 1 -- 172.21.15.5:0/3232039060 wait complete. 2023-07-14T13:05:58.576 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-14T13:05:58.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.690+0000 7f9350d74640 1 Processor -- start 2023-07-14T13:05:58.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.690+0000 7f9350d74640 1 -- start start 2023-07-14T13:05:58.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.690+0000 7f9350d74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f934c0d1850 0x7f934c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.690+0000 7f9350d74640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934c0ccaf0 con 0x7f934c0b7c70 2023-07-14T13:05:58.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.690+0000 7f9350d74640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934c160320 con 0x7f934c15fd60 2023-07-14T13:05:58.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.690+0000 7f9350d74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934c0d1190 con 0x7f934c0d1850 2023-07-14T13:05:58.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.690+0000 7f934a59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f934c0b7c70 0x7f934c15f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54264/0 (socket says 172.21.15.5:54264) 2023-07-14T13:05:58.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.690+0000 7f934a59c640 1 -- 172.21.15.5:0/2004253917 learned_addr learned my addr 172.21.15.5:0/2004253917 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:58.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.690+0000 7f934ad9d640 1 --2- 172.21.15.5:0/2004253917 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f934c0d1850 0x7f934c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.690+0000 7f9349d9b640 1 -- 172.21.15.5:0/2004253917 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 325071883 0 0) 0x7f934c0ccaf0 con 0x7f934c0b7c70 2023-07-14T13:05:58.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.690+0000 7f9349d9b640 1 -- 172.21.15.5:0/2004253917 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9338003530 con 0x7f934c0b7c70 2023-07-14T13:05:58.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.690+0000 7f9349d9b640 1 -- 172.21.15.5:0/2004253917 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4132410169 0 0) 0x7f9338003530 con 0x7f934c0b7c70 2023-07-14T13:05:58.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.690+0000 7f9349d9b640 1 -- 172.21.15.5:0/2004253917 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f934c0d1850 msgr2=0x7f934c0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:58.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.690+0000 7f9349d9b640 1 --2- 172.21.15.5:0/2004253917 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f934c0d1850 0x7f934c0d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.690+0000 7f9349d9b640 1 -- 172.21.15.5:0/2004253917 >> v1:172.21.15.154:6789/0 conn(0x7f934c15fd60 legacy=0x7f934c0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.690+0000 7f9349d9b640 1 -- 172.21.15.5:0/2004253917 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c0ccd90 con 0x7f934c0b7c70 2023-07-14T13:05:58.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.690+0000 7f9349d9b640 1 -- 172.21.15.5:0/2004253917 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f933c001680 con 0x7f934c0b7c70 2023-07-14T13:05:58.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.690+0000 7f9349d9b640 1 -- 172.21.15.5:0/2004253917 >> v1:172.21.15.5:6789/0 conn(0x7f934c0b7c70 legacy=0x7f934c15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.694+0000 7f9349d9b640 1 --2- 172.21.15.5:0/2004253917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93380039b0 0x7f9338003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.694+0000 7f9349d9b640 1 --2- 172.21.15.5:0/2004253917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93380047d0 0x7f9338004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.694+0000 7f9349d9b640 1 --2- 172.21.15.5:0/2004253917 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f934c0d1850 0x7f9338005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.694+0000 7f9349d9b640 1 -- 172.21.15.5:0/2004253917 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933800ba40 con 0x7f93380047d0 2023-07-14T13:05:58.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.694+0000 7f9349d9b640 1 -- 172.21.15.5:0/2004253917 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933800bb80 con 0x7f93380039b0 2023-07-14T13:05:58.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.694+0000 7f9349d9b640 1 -- 172.21.15.5:0/2004253917 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f933800bd40 con 0x7f934c0d1850 2023-07-14T13:05:58.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.694+0000 7f9343fff640 1 --2- 172.21.15.5:0/2004253917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93380047d0 0x7f9338004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.694+0000 7f934ad9d640 1 --2- 172.21.15.5:0/2004253917 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f934c0d1850 0x7f9338005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.694+0000 7f934a59c640 1 --2- 172.21.15.5:0/2004253917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93380039b0 0x7f9338003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.694+0000 7f9343fff640 1 -- 172.21.15.5:0/2004253917 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f934c0d1850 msgr2=0x7f9338005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:58.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.694+0000 7f9343fff640 1 --2- 172.21.15.5:0/2004253917 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f934c0d1850 0x7f9338005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.694+0000 7f9343fff640 1 -- 172.21.15.5:0/2004253917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93380039b0 msgr2=0x7f9338003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:58.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.694+0000 7f9343fff640 1 --2- 172.21.15.5:0/2004253917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93380039b0 0x7f9338003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.694+0000 7f9343fff640 1 -- 172.21.15.5:0/2004253917 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9338003530 con 0x7f93380047d0 2023-07-14T13:05:58.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.694+0000 7f9343fff640 1 --2- 172.21.15.5:0/2004253917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93380047d0 0x7f9338004c40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f9334001780 tx=0x7f933401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ebe9f26ee8b5776 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:58.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.694+0000 7f9349d9b640 1 -- 172.21.15.5:0/2004253917 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93340052d0 con 0x7f93380047d0 2023-07-14T13:05:58.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.694+0000 7f9349d9b640 1 -- 172.21.15.5:0/2004253917 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93340a7050 con 0x7f93380047d0 2023-07-14T13:05:58.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.694+0000 7f9349d9b640 1 -- 172.21.15.5:0/2004253917 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9334003600 con 0x7f93380047d0 2023-07-14T13:05:58.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.698+0000 7f9350d74640 1 -- 172.21.15.5:0/2004253917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93380047d0 msgr2=0x7f9338004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.698+0000 7f9350d74640 1 --2- 172.21.15.5:0/2004253917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93380047d0 0x7f9338004c40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f9334001780 tx=0x7f933401c400 comp rx=0 tx=0).stop 2023-07-14T13:05:58.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.698+0000 7f934ad9d640 1 -- 172.21.15.5:0/2004253917 reap_dead start 2023-07-14T13:05:58.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.698+0000 7f9350d74640 1 -- 172.21.15.5:0/2004253917 shutdown_connections 2023-07-14T13:05:58.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.698+0000 7f9350d74640 1 -- 172.21.15.5:0/2004253917 >> 172.21.15.5:0/2004253917 conn(0x7f934c0650b0 msgr2=0x7f934c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:58.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.698+0000 7f9350d74640 1 -- 172.21.15.5:0/2004253917 shutdown_connections 2023-07-14T13:05:58.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.698+0000 7f9350d74640 1 -- 172.21.15.5:0/2004253917 wait complete. 2023-07-14T13:05:58.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.698+0000 7f9350d74640 1 Processor -- start 2023-07-14T13:05:58.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.698+0000 7f9350d74640 1 -- start start 2023-07-14T13:05:58.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.698+0000 7f9350d74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93380047d0 0x7f934c0cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.698+0000 7f9350d74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f934c15d960 0x7f934c0c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.698+0000 7f9350d74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f934c15e750 0x7f934c15b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.698+0000 7f9350d74640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c0c7600 con 0x7f934c15d960 2023-07-14T13:05:58.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.698+0000 7f9350d74640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c0c6c30 con 0x7f934c15e750 2023-07-14T13:05:58.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.698+0000 7f9350d74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934c0c6040 con 0x7f93380047d0 2023-07-14T13:05:58.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.698+0000 7f9343fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f934c15d960 0x7f934c0c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.698+0000 7f9343fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f934c15d960 0x7f934c0c70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35470/0 (socket says 172.21.15.5:35470) 2023-07-14T13:05:58.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.698+0000 7f9343fff640 1 -- 172.21.15.5:0/3376208279 learned_addr learned my addr 172.21.15.5:0/3376208279 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:58.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.698+0000 7f934a59c640 1 --2- 172.21.15.5:0/3376208279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93380047d0 0x7f934c0cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.698+0000 7f934ad9d640 1 --2- 172.21.15.5:0/3376208279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f934c15e750 0x7f934c15b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.702+0000 7f9343fff640 1 -- 172.21.15.5:0/3376208279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93380047d0 msgr2=0x7f934c0cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.702+0000 7f9343fff640 1 --2- 172.21.15.5:0/3376208279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93380047d0 0x7f934c0cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.702+0000 7f9343fff640 1 -- 172.21.15.5:0/3376208279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f934c15e750 msgr2=0x7f934c15b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.702+0000 7f9343fff640 1 --2- 172.21.15.5:0/3376208279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f934c15e750 0x7f934c15b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.702+0000 7f9343fff640 1 -- 172.21.15.5:0/3376208279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c0c6300 con 0x7f934c15d960 2023-07-14T13:05:58.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.702+0000 7f9343fff640 1 --2- 172.21.15.5:0/3376208279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f934c15d960 0x7f934c0c70c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9334005040 tx=0x7f9338005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:58.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.702+0000 7f9342ffd640 1 -- 172.21.15.5:0/3376208279 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9334007390 con 0x7f934c15d960 2023-07-14T13:05:58.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.702+0000 7f9342ffd640 1 -- 172.21.15.5:0/3376208279 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93340074f0 con 0x7f934c15d960 2023-07-14T13:05:58.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.702+0000 7f9342ffd640 1 -- 172.21.15.5:0/3376208279 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9334006a00 con 0x7f934c15d960 2023-07-14T13:05:58.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.702+0000 7f9350d74640 1 -- 172.21.15.5:0/3376208279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f934c0c65e0 con 0x7f934c15d960 2023-07-14T13:05:58.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.702+0000 7f9350d74640 1 -- 172.21.15.5:0/3376208279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f934c15ebf0 con 0x7f934c15d960 2023-07-14T13:05:58.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.702+0000 7f9350d74640 1 -- 172.21.15.5:0/3376208279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f934c0c91f0 con 0x7f934c15d960 2023-07-14T13:05:58.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.702+0000 7f9342ffd640 1 -- 172.21.15.5:0/3376208279 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9334006b60 con 0x7f934c15d960 2023-07-14T13:05:58.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.702+0000 7f9342ffd640 1 --2- 172.21.15.5:0/3376208279 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f932c0663d0 0x7f932c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.702+0000 7f9342ffd640 1 -- 172.21.15.5:0/3376208279 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f933411dfb0 con 0x7f934c15d960 2023-07-14T13:05:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.706+0000 7f934a59c640 1 --2- 172.21.15.5:0/3376208279 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f932c0663d0 0x7f932c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.706+0000 7f934a59c640 1 --2- 172.21.15.5:0/3376208279 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f932c0663d0 0x7f932c068880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f933c005180 tx=0x7f933c001be0 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:58.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.706+0000 7f9342ffd640 1 -- 172.21.15.5:0/3376208279 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f93340ef000 con 0x7f934c15d960 2023-07-14T13:05:58.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.866+0000 7f9350d74640 1 -- 172.21.15.5:0/3376208279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f934c0c6da0 con 0x7f934c15d960 2023-07-14T13:05:58.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.866+0000 7f9342ffd640 1 -- 172.21.15.5:0/3376208279 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v61) v1 ==== 84+0+126 (secure 0 0 0) 0x7f93340eeb90 con 0x7f934c15d960 2023-07-14T13:05:58.897 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:05:58.898 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-07-14T13:05:58.898 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:05:58.898 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-07-14T13:05:58.898 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-07-14T13:05:58.898 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:05:58.898 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:05:58.899 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 2, 2023-07-14T13:05:58.899 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": "rbd" 2023-07-14T13:05:58.899 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:05:58.899 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-07-14T13:05:58.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.866+0000 7f9350d74640 1 -- 172.21.15.5:0/3376208279 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f932c0663d0 msgr2=0x7f932c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.866+0000 7f9350d74640 1 --2- 172.21.15.5:0/3376208279 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f932c0663d0 0x7f932c068880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f933c005180 tx=0x7f933c001be0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.866+0000 7f9350d74640 1 -- 172.21.15.5:0/3376208279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f934c15d960 msgr2=0x7f934c0c70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.866+0000 7f9350d74640 1 --2- 172.21.15.5:0/3376208279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f934c15d960 0x7f934c0c70c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9334005040 tx=0x7f9338005800 comp rx=0 tx=0).stop 2023-07-14T13:05:58.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.866+0000 7f9350d74640 1 -- 172.21.15.5:0/3376208279 shutdown_connections 2023-07-14T13:05:58.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.866+0000 7f9350d74640 1 --2- 172.21.15.5:0/3376208279 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f932c0663d0 0x7f932c068880 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.866+0000 7f9350d74640 1 --2- 172.21.15.5:0/3376208279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f934c15e750 0x7f934c15b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.866+0000 7f9350d74640 1 --2- 172.21.15.5:0/3376208279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f934c15d960 0x7f934c0c70c0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.866+0000 7f9350d74640 1 --2- 172.21.15.5:0/3376208279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93380047d0 0x7f934c0cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.866+0000 7f9350d74640 1 -- 172.21.15.5:0/3376208279 >> 172.21.15.5:0/3376208279 conn(0x7f934c0650b0 msgr2=0x7f934c0b2960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:58.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.866+0000 7f9350d74640 1 -- 172.21.15.5:0/3376208279 shutdown_connections 2023-07-14T13:05:58.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:58.866+0000 7f9350d74640 1 -- 172.21.15.5:0/3376208279 wait complete. 2023-07-14T13:05:58.918 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-14T13:05:58.918 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-14T13:05:59.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.034+0000 7f953627b640 1 Processor -- start 2023-07-14T13:05:59.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.034+0000 7f953627b640 1 -- start start 2023-07-14T13:05:59.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.034+0000 7f953627b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f95300aeb40 0x7f953015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.034+0000 7f953627b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9530159440 0x7f95300c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.034+0000 7f953627b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95301532b0 con 0x7f95300aef10 2023-07-14T13:05:59.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.034+0000 7f953627b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95300ca6f0 con 0x7f9530159440 2023-07-14T13:05:59.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.034+0000 7f953627b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95301599d0 con 0x7f95300aeb40 2023-07-14T13:05:59.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.034+0000 7f952f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f95300aef10 0x7f9530158d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48322/0 (socket says 172.21.15.5:48322) 2023-07-14T13:05:59.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.034+0000 7f9534818640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9530159440 0x7f95300c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.034+0000 7f952f7fe640 1 -- 172.21.15.5:0/4254843485 learned_addr learned my addr 172.21.15.5:0/4254843485 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:59.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.038+0000 7f952ffff640 1 --2- 172.21.15.5:0/4254843485 >> v2:172.21.15.154:3300/0 conn(0x7f95300aeb40 0x7f953015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.038+0000 7f9534818640 1 -- 172.21.15.5:0/4254843485 >> v2:172.21.15.154:3300/0 conn(0x7f95300aeb40 msgr2=0x7f953015cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:59.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.038+0000 7f9534818640 1 --2- 172.21.15.5:0/4254843485 >> v2:172.21.15.154:3300/0 conn(0x7f95300aeb40 0x7f953015cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.038+0000 7f9534818640 1 -- 172.21.15.5:0/4254843485 >> v1:172.21.15.5:6789/0 conn(0x7f95300aef10 legacy=0x7f9530158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:59.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.038+0000 7f9534818640 1 -- 172.21.15.5:0/4254843485 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9530159cb0 con 0x7f9530159440 2023-07-14T13:05:59.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.038+0000 7f952effd640 1 -- 172.21.15.5:0/4254843485 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2456158888 0 0) 0x7f95301532b0 con 0x7f95300aef10 2023-07-14T13:05:59.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.038+0000 7f9534818640 1 --2- 172.21.15.5:0/4254843485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9530159440 0x7f95300c88c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9530071ad0 tx=0x7f952801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc4859b7f2efcc0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:59.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.038+0000 7f952effd640 1 -- 172.21.15.5:0/4254843485 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95280a5910 con 0x7f9530159440 2023-07-14T13:05:59.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.038+0000 7f952effd640 1 -- 172.21.15.5:0/4254843485 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95280a5a70 con 0x7f9530159440 2023-07-14T13:05:59.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.038+0000 7f952effd640 1 -- 172.21.15.5:0/4254843485 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95280a5e00 con 0x7f9530159440 2023-07-14T13:05:59.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.038+0000 7f953627b640 1 -- 172.21.15.5:0/4254843485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9530159440 msgr2=0x7f95300c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:59.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.038+0000 7f953627b640 1 --2- 172.21.15.5:0/4254843485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9530159440 0x7f95300c88c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9530071ad0 tx=0x7f952801c850 comp rx=0 tx=0).stop 2023-07-14T13:05:59.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.042+0000 7f953627b640 1 -- 172.21.15.5:0/4254843485 shutdown_connections 2023-07-14T13:05:59.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.042+0000 7f953627b640 1 --2- 172.21.15.5:0/4254843485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9530159440 0x7f95300c88c0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.042+0000 7f953627b640 1 --2- 172.21.15.5:0/4254843485 >> v2:172.21.15.154:3300/0 conn(0x7f95300aeb40 0x7f953015cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.042+0000 7f953627b640 1 -- 172.21.15.5:0/4254843485 >> 172.21.15.5:0/4254843485 conn(0x7f95300cde90 msgr2=0x7f95300ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:59.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.042+0000 7f953627b640 1 -- 172.21.15.5:0/4254843485 shutdown_connections 2023-07-14T13:05:59.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.042+0000 7f953627b640 1 -- 172.21.15.5:0/4254843485 wait complete. 2023-07-14T13:05:59.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.042+0000 7f953627b640 1 Processor -- start 2023-07-14T13:05:59.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.042+0000 7f953627b640 1 -- start start 2023-07-14T13:05:59.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.042+0000 7f953627b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95300aeb40 0x7f95301f3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.042+0000 7f953627b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95300aef10 0x7f953015a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.042+0000 7f953627b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9530159440 0x7f9530070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.042+0000 7f953627b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95301f4bf0 con 0x7f95300aeb40 2023-07-14T13:05:59.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.042+0000 7f953627b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953015ab90 con 0x7f95300aef10 2023-07-14T13:05:59.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.042+0000 7f953627b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95301f4530 con 0x7f9530159440 2023-07-14T13:05:59.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.042+0000 7f952ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95300aeb40 0x7f95301f3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.042+0000 7f952ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95300aeb40 0x7f95301f3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57286/0 (socket says 172.21.15.5:57286) 2023-07-14T13:05:59.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.042+0000 7f952ffff640 1 -- 172.21.15.5:0/608119860 learned_addr learned my addr 172.21.15.5:0/608119860 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:59.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.042+0000 7f952f7fe640 1 --2- 172.21.15.5:0/608119860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95300aef10 0x7f953015a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.042+0000 7f9534818640 1 --2- 172.21.15.5:0/608119860 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9530159440 0x7f9530070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.042+0000 7f952ffff640 1 -- 172.21.15.5:0/608119860 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9530159440 msgr2=0x7f9530070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:59.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.042+0000 7f952ffff640 1 --2- 172.21.15.5:0/608119860 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9530159440 0x7f9530070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.042+0000 7f952ffff640 1 -- 172.21.15.5:0/608119860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95300aef10 msgr2=0x7f953015a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:59.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.042+0000 7f952ffff640 1 --2- 172.21.15.5:0/608119860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95300aef10 0x7f953015a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.042+0000 7f952ffff640 1 -- 172.21.15.5:0/608119860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9528009a70 con 0x7f95300aeb40 2023-07-14T13:05:59.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.042+0000 7f9534818640 1 --2- 172.21.15.5:0/608119860 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9530159440 0x7f9530070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:05:59.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.042+0000 7f952ffff640 1 --2- 172.21.15.5:0/608119860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95300aeb40 0x7f95301f3b60 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f952000e930 tx=0x7f952000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:59.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.046+0000 7f952cff9640 1 -- 172.21.15.5:0/608119860 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520009690 con 0x7f95300aeb40 2023-07-14T13:05:59.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.046+0000 7f952cff9640 1 -- 172.21.15.5:0/608119860 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952000ca00 con 0x7f95300aeb40 2023-07-14T13:05:59.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.046+0000 7f952cff9640 1 -- 172.21.15.5:0/608119860 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952000cd70 con 0x7f95300aeb40 2023-07-14T13:05:59.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.046+0000 7f953627b640 1 -- 172.21.15.5:0/608119860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95301f4810 con 0x7f95300aeb40 2023-07-14T13:05:59.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.046+0000 7f953627b640 1 -- 172.21.15.5:0/608119860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95301f40a0 con 0x7f95300aeb40 2023-07-14T13:05:59.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.046+0000 7f953627b640 1 -- 172.21.15.5:0/608119860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95301f4380 con 0x7f95300aeb40 2023-07-14T13:05:59.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.046+0000 7f952cff9640 1 -- 172.21.15.5:0/608119860 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9520013470 con 0x7f95300aeb40 2023-07-14T13:05:59.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.046+0000 7f952cff9640 1 --2- 172.21.15.5:0/608119860 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f951c0663a0 0x7f951c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.046+0000 7f952cff9640 1 -- 172.21.15.5:0/608119860 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9520083e00 con 0x7f95300aeb40 2023-07-14T13:05:59.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.046+0000 7f952f7fe640 1 --2- 172.21.15.5:0/608119860 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f951c0663a0 0x7f951c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.050+0000 7f952f7fe640 1 --2- 172.21.15.5:0/608119860 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f951c0663a0 0x7f951c068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9530152dd0 tx=0x7f9524007b60 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.050+0000 7f952cff9640 1 -- 172.21.15.5:0/608119860 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9520051570 con 0x7f95300aeb40 2023-07-14T13:05:59.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.206+0000 7f953627b640 1 -- 172.21.15.5:0/608119860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f95300678d0 con 0x7f95300aeb40 2023-07-14T13:05:59.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.734+0000 7f952cff9640 1 -- 172.21.15.5:0/608119860 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v62) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9520054b90 con 0x7f95300aeb40 2023-07-14T13:05:59.764 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-07-14T13:05:59.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.734+0000 7f953627b640 1 -- 172.21.15.5:0/608119860 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f951c0663a0 msgr2=0x7f951c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:59.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.734+0000 7f953627b640 1 --2- 172.21.15.5:0/608119860 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f951c0663a0 0x7f951c068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9530152dd0 tx=0x7f9524007b60 comp rx=0 tx=0).stop 2023-07-14T13:05:59.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.734+0000 7f953627b640 1 -- 172.21.15.5:0/608119860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95300aeb40 msgr2=0x7f95301f3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:59.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.734+0000 7f953627b640 1 --2- 172.21.15.5:0/608119860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95300aeb40 0x7f95301f3b60 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f952000e930 tx=0x7f952000edf0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.734+0000 7f953627b640 1 -- 172.21.15.5:0/608119860 shutdown_connections 2023-07-14T13:05:59.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.734+0000 7f953627b640 1 --2- 172.21.15.5:0/608119860 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f951c0663a0 0x7f951c068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.734+0000 7f953627b640 1 --2- 172.21.15.5:0/608119860 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9530159440 0x7f9530070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.734+0000 7f953627b640 1 --2- 172.21.15.5:0/608119860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95300aef10 0x7f953015a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.734+0000 7f953627b640 1 --2- 172.21.15.5:0/608119860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95300aeb40 0x7f95301f3b60 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.734+0000 7f953627b640 1 -- 172.21.15.5:0/608119860 >> 172.21.15.5:0/608119860 conn(0x7f95300cde90 msgr2=0x7f953015b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:59.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.738+0000 7f953627b640 1 -- 172.21.15.5:0/608119860 shutdown_connections 2023-07-14T13:05:59.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.738+0000 7f953627b640 1 -- 172.21.15.5:0/608119860 wait complete. 2023-07-14T13:05:59.793 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-14T13:05:59.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.914+0000 7fcf1f476640 1 Processor -- start 2023-07-14T13:05:59.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.914+0000 7fcf1f476640 1 -- start start 2023-07-14T13:05:59.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.918+0000 7fcf1f476640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf18160750 0x7fcf18166e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.918+0000 7fcf1f476640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf180cf430 con 0x7fcf180cc960 2023-07-14T13:05:59.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.918+0000 7fcf1f476640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1815fc70 con 0x7fcf180b1620 2023-07-14T13:05:59.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.918+0000 7fcf1f476640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf180cf710 con 0x7fcf18160750 2023-07-14T13:05:59.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.918+0000 7fcf1ec75640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf18160750 0x7fcf18166e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.918+0000 7fcf1e474640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcf180cc960 0x7fcf180ccd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48328/0 (socket says 172.21.15.5:48328) 2023-07-14T13:05:59.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.918+0000 7fcf1e474640 1 -- 172.21.15.5:0/3396141220 learned_addr learned my addr 172.21.15.5:0/3396141220 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:05:59.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.918+0000 7fcf1ec75640 1 -- 172.21.15.5:0/3396141220 >> v1:172.21.15.154:6789/0 conn(0x7fcf180b1620 legacy=0x7fcf180ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:59.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.918+0000 7fcf1ec75640 1 -- 172.21.15.5:0/3396141220 >> v1:172.21.15.5:6789/0 conn(0x7fcf180cc960 legacy=0x7fcf180ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:59.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.918+0000 7fcf1ec75640 1 -- 172.21.15.5:0/3396141220 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1815ff50 con 0x7fcf18160750 2023-07-14T13:05:59.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.918+0000 7fcf1ec75640 1 --2- 172.21.15.5:0/3396141220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf18160750 0x7fcf18166e00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fcf10009d90 tx=0x7fcf1001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0dfb1fc78c0190c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:59.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.922+0000 7fcf1d472640 1 -- 172.21.15.5:0/3396141220 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf100a59c0 con 0x7fcf18160750 2023-07-14T13:05:59.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.922+0000 7fcf1d472640 1 -- 172.21.15.5:0/3396141220 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf100a5b20 con 0x7fcf18160750 2023-07-14T13:05:59.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.922+0000 7fcf1d472640 1 -- 172.21.15.5:0/3396141220 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf100ad440 con 0x7fcf18160750 2023-07-14T13:05:59.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.922+0000 7fcf1f476640 1 -- 172.21.15.5:0/3396141220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf18160750 msgr2=0x7fcf18166e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:59.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.922+0000 7fcf1f476640 1 --2- 172.21.15.5:0/3396141220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf18160750 0x7fcf18166e00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fcf10009d90 tx=0x7fcf1001c8e0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.922+0000 7fcf1f476640 1 -- 172.21.15.5:0/3396141220 shutdown_connections 2023-07-14T13:05:59.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.922+0000 7fcf1f476640 1 --2- 172.21.15.5:0/3396141220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf18160750 0x7fcf18166e00 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.922+0000 7fcf1f476640 1 -- 172.21.15.5:0/3396141220 >> 172.21.15.5:0/3396141220 conn(0x7fcf18069f50 msgr2=0x7fcf1806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:59.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.922+0000 7fcf1f476640 1 -- 172.21.15.5:0/3396141220 shutdown_connections 2023-07-14T13:05:59.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.922+0000 7fcf1f476640 1 -- 172.21.15.5:0/3396141220 wait complete. 2023-07-14T13:05:59.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.922+0000 7fcf1f476640 1 Processor -- start 2023-07-14T13:05:59.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.922+0000 7fcf1f476640 1 -- start start 2023-07-14T13:05:59.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.922+0000 7fcf1f476640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf180b1620 0x7fcf18153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.922+0000 7fcf1f476640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf180cc960 0x7fcf181563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.922+0000 7fcf1f476640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf18160750 0x7fcf1814ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.922+0000 7fcf1f476640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf18153e30 con 0x7fcf18160750 2023-07-14T13:05:59.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.922+0000 7fcf1f476640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf180c9600 con 0x7fcf180b1620 2023-07-14T13:05:59.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.922+0000 7fcf1f476640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf180c98e0 con 0x7fcf180cc960 2023-07-14T13:05:59.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.922+0000 7fcf1ec75640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf18160750 0x7fcf1814ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.922+0000 7fcf1ec75640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf18160750 0x7fcf1814ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57306/0 (socket says 172.21.15.5:57306) 2023-07-14T13:05:59.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.922+0000 7fcf1ec75640 1 -- 172.21.15.5:0/529832707 learned_addr learned my addr 172.21.15.5:0/529832707 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:05:59.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.922+0000 7fcf1e474640 1 --2- 172.21.15.5:0/529832707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf180b1620 0x7fcf18153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.922+0000 7fcf1dc73640 1 --2- 172.21.15.5:0/529832707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf180cc960 0x7fcf181563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.926+0000 7fcf1ec75640 1 -- 172.21.15.5:0/529832707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf180cc960 msgr2=0x7fcf181563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:59.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.926+0000 7fcf1ec75640 1 --2- 172.21.15.5:0/529832707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf180cc960 0x7fcf181563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.926+0000 7fcf1ec75640 1 -- 172.21.15.5:0/529832707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf180b1620 msgr2=0x7fcf18153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:59.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.926+0000 7fcf1ec75640 1 --2- 172.21.15.5:0/529832707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf180b1620 0x7fcf18153790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.926+0000 7fcf1ec75640 1 -- 172.21.15.5:0/529832707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf10009a70 con 0x7fcf18160750 2023-07-14T13:05:59.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.926+0000 7fcf1ec75640 1 --2- 172.21.15.5:0/529832707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf18160750 0x7fcf1814ef70 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fcf100194f0 tx=0x7fcf10019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:59.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.926+0000 7fcf0effd640 1 -- 172.21.15.5:0/529832707 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf100aee90 con 0x7fcf18160750 2023-07-14T13:05:59.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.926+0000 7fcf0effd640 1 -- 172.21.15.5:0/529832707 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf10009450 con 0x7fcf18160750 2023-07-14T13:05:59.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.926+0000 7fcf1f476640 1 -- 172.21.15.5:0/529832707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf180c9bc0 con 0x7fcf18160750 2023-07-14T13:05:59.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.926+0000 7fcf0effd640 1 -- 172.21.15.5:0/529832707 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf100b7650 con 0x7fcf18160750 2023-07-14T13:05:59.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.926+0000 7fcf1f476640 1 -- 172.21.15.5:0/529832707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf180c9290 con 0x7fcf18160750 2023-07-14T13:05:59.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.926+0000 7fcf1f476640 1 -- 172.21.15.5:0/529832707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf1804e020 con 0x7fcf18160750 2023-07-14T13:05:59.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.926+0000 7fcf0effd640 1 -- 172.21.15.5:0/529832707 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcf100b4050 con 0x7fcf18160750 2023-07-14T13:05:59.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.930+0000 7fcf0effd640 1 --2- 172.21.15.5:0/529832707 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fcefc0663a0 0x7fcefc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.930+0000 7fcf0effd640 1 -- 172.21.15.5:0/529832707 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fcf1011f890 con 0x7fcf18160750 2023-07-14T13:05:59.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.930+0000 7fcf1e474640 1 --2- 172.21.15.5:0/529832707 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fcefc0663a0 0x7fcefc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.930+0000 7fcf1e474640 1 --2- 172.21.15.5:0/529832707 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fcefc0663a0 0x7fcefc068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcf14000f70 tx=0x7fcf14007e90 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:59.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:05:59.930+0000 7fcf0effd640 1 -- 172.21.15.5:0/529832707 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fcf100ece70 con 0x7fcf18160750 2023-07-14T13:06:00.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.086+0000 7fcf1f476640 1 -- 172.21.15.5:0/529832707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fcf1804e020 con 0x7fcf18160750 2023-07-14T13:06:00.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.734+0000 7fcf0effd640 1 -- 172.21.15.5:0/529832707 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v63) v1 ==== 170+0+0 (secure 0 0 0) 0x7fcf100f0490 con 0x7fcf18160750 2023-07-14T13:06:00.768 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-07-14T13:06:00.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.750+0000 7fcf1f476640 1 -- 172.21.15.5:0/529832707 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fcefc0663a0 msgr2=0x7fcefc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:00.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.750+0000 7fcf1f476640 1 --2- 172.21.15.5:0/529832707 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fcefc0663a0 0x7fcefc068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcf14000f70 tx=0x7fcf14007e90 comp rx=0 tx=0).stop 2023-07-14T13:06:00.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.750+0000 7fcf1f476640 1 -- 172.21.15.5:0/529832707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf18160750 msgr2=0x7fcf1814ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:00.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.750+0000 7fcf1f476640 1 --2- 172.21.15.5:0/529832707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf18160750 0x7fcf1814ef70 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fcf100194f0 tx=0x7fcf10019680 comp rx=0 tx=0).stop 2023-07-14T13:06:00.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.750+0000 7fcf1f476640 1 -- 172.21.15.5:0/529832707 shutdown_connections 2023-07-14T13:06:00.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.754+0000 7fcf1f476640 1 --2- 172.21.15.5:0/529832707 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fcefc0663a0 0x7fcefc068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:00.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.754+0000 7fcf1f476640 1 --2- 172.21.15.5:0/529832707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf18160750 0x7fcf1814ef70 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:00.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.754+0000 7fcf1f476640 1 --2- 172.21.15.5:0/529832707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf180cc960 0x7fcf181563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:00.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.754+0000 7fcf1f476640 1 --2- 172.21.15.5:0/529832707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf180b1620 0x7fcf18153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:00.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.754+0000 7fcf1f476640 1 -- 172.21.15.5:0/529832707 >> 172.21.15.5:0/529832707 conn(0x7fcf18069f50 msgr2=0x7fcf180d0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:00.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.754+0000 7fcf1f476640 1 -- 172.21.15.5:0/529832707 shutdown_connections 2023-07-14T13:06:00.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.754+0000 7fcf1f476640 1 -- 172.21.15.5:0/529832707 wait complete. 2023-07-14T13:06:00.812 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-14T13:06:00.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.930+0000 7fd969bc5640 1 Processor -- start 2023-07-14T13:06:00.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.930+0000 7fd969bc5640 1 -- start start 2023-07-14T13:06:00.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.930+0000 7fd969bc5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd9640aeb40 0x7fd96415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:00.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.930+0000 7fd969bc5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9640aef10 0x7fd964158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:00.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.930+0000 7fd969bc5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9641532b0 con 0x7fd964159270 2023-07-14T13:06:00.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.930+0000 7fd969bc5640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9640ca6f0 con 0x7fd9640aeb40 2023-07-14T13:06:00.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.930+0000 7fd969bc5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9641599d0 con 0x7fd9640aef10 2023-07-14T13:06:00.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.930+0000 7fd9637fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd9640aeb40 0x7fd96415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:00.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.930+0000 7fd962ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9640aef10 0x7fd964158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:00.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.930+0000 7fd963fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd964159270 0x7fd9640c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:43298/0 (socket says 172.21.15.5:43298) 2023-07-14T13:06:00.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.930+0000 7fd963fff640 1 -- 172.21.15.5:0/3702906831 learned_addr learned my addr 172.21.15.5:0/3702906831 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:06:00.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.930+0000 7fd962ffd640 1 -- 172.21.15.5:0/3702906831 >> v2:172.21.15.154:3300/0 conn(0x7fd9640aeb40 msgr2=0x7fd96415cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:00.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.930+0000 7fd962ffd640 1 --2- 172.21.15.5:0/3702906831 >> v2:172.21.15.154:3300/0 conn(0x7fd9640aeb40 0x7fd96415cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:00.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.930+0000 7fd962ffd640 1 -- 172.21.15.5:0/3702906831 >> v1:172.21.15.154:6789/0 conn(0x7fd964159270 legacy=0x7fd9640c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:00.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.930+0000 7fd962ffd640 1 -- 172.21.15.5:0/3702906831 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd964159cb0 con 0x7fd9640aef10 2023-07-14T13:06:00.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.930+0000 7fd9637fe640 1 --2- 172.21.15.5:0/3702906831 >> v2:172.21.15.154:3300/0 conn(0x7fd9640aeb40 0x7fd96415cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:06:00.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.934+0000 7fd962ffd640 1 --2- 172.21.15.5:0/3702906831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9640aef10 0x7fd964158d30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd9580097c0 tx=0x7fd95801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73a5bfdc3f190a1c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.934+0000 7fd9627fc640 1 -- 172.21.15.5:0/3702906831 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9580ac620 con 0x7fd9640aef10 2023-07-14T13:06:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.934+0000 7fd9627fc640 1 -- 172.21.15.5:0/3702906831 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9580ac780 con 0x7fd9640aef10 2023-07-14T13:06:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.934+0000 7fd9627fc640 1 -- 172.21.15.5:0/3702906831 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9580acb10 con 0x7fd9640aef10 2023-07-14T13:06:00.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.934+0000 7fd969bc5640 1 -- 172.21.15.5:0/3702906831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9640aef10 msgr2=0x7fd964158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:00.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.934+0000 7fd969bc5640 1 --2- 172.21.15.5:0/3702906831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9640aef10 0x7fd964158d30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd9580097c0 tx=0x7fd95801c3c0 comp rx=0 tx=0).stop 2023-07-14T13:06:00.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.934+0000 7fd969bc5640 1 -- 172.21.15.5:0/3702906831 shutdown_connections 2023-07-14T13:06:00.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.934+0000 7fd969bc5640 1 --2- 172.21.15.5:0/3702906831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9640aef10 0x7fd964158d30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:00.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.934+0000 7fd969bc5640 1 --2- 172.21.15.5:0/3702906831 >> v2:172.21.15.154:3300/0 conn(0x7fd9640aeb40 0x7fd96415cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:00.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.934+0000 7fd969bc5640 1 -- 172.21.15.5:0/3702906831 >> 172.21.15.5:0/3702906831 conn(0x7fd9640cde90 msgr2=0x7fd9640ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:00.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.934+0000 7fd969bc5640 1 -- 172.21.15.5:0/3702906831 shutdown_connections 2023-07-14T13:06:00.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.934+0000 7fd969bc5640 1 -- 172.21.15.5:0/3702906831 wait complete. 2023-07-14T13:06:00.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.938+0000 7fd969bc5640 1 Processor -- start 2023-07-14T13:06:00.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.938+0000 7fd969bc5640 1 -- start start 2023-07-14T13:06:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.938+0000 7fd969bc5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9640aeb40 0x7fd9641559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.938+0000 7fd969bc5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9640aef10 0x7fd9641f7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.938+0000 7fd969bc5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd964159270 0x7fd9641579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.938+0000 7fd969bc5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9641f3f50 con 0x7fd9640aeb40 2023-07-14T13:06:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.938+0000 7fd969bc5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd964070200 con 0x7fd964159270 2023-07-14T13:06:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.938+0000 7fd969bc5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd964155f30 con 0x7fd9640aef10 2023-07-14T13:06:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.938+0000 7fd9637fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9640aeb40 0x7fd9641559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.938+0000 7fd9637fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9640aeb40 0x7fd9641559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57314/0 (socket says 172.21.15.5:57314) 2023-07-14T13:06:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.938+0000 7fd9637fe640 1 -- 172.21.15.5:0/1732390525 learned_addr learned my addr 172.21.15.5:0/1732390525 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.938+0000 7fd962ffd640 1 --2- 172.21.15.5:0/1732390525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9640aef10 0x7fd9641f7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.938+0000 7fd963fff640 1 --2- 172.21.15.5:0/1732390525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd964159270 0x7fd9641579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:00.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.938+0000 7fd9637fe640 1 -- 172.21.15.5:0/1732390525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9640aef10 msgr2=0x7fd9641f7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.938+0000 7fd9637fe640 1 --2- 172.21.15.5:0/1732390525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9640aef10 0x7fd9641f7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.938+0000 7fd9637fe640 1 -- 172.21.15.5:0/1732390525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd964159270 msgr2=0x7fd9641579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.938+0000 7fd9637fe640 1 --2- 172.21.15.5:0/1732390525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd964159270 0x7fd9641579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.938+0000 7fd9637fe640 1 -- 172.21.15.5:0/1732390525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd954009420 con 0x7fd9640aeb40 2023-07-14T13:06:00.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.938+0000 7fd963fff640 1 --2- 172.21.15.5:0/1732390525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd964159270 0x7fd9641579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:06:00.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.938+0000 7fd9637fe640 1 --2- 172.21.15.5:0/1732390525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9640aeb40 0x7fd9641559f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fd95400ebe0 tx=0x7fd95400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:00.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.938+0000 7fd94bfff640 1 -- 172.21.15.5:0/1732390525 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95400eee0 con 0x7fd9640aeb40 2023-07-14T13:06:00.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.938+0000 7fd94bfff640 1 -- 172.21.15.5:0/1732390525 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95400cc30 con 0x7fd9640aeb40 2023-07-14T13:06:00.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.938+0000 7fd94bfff640 1 -- 172.21.15.5:0/1732390525 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd954013470 con 0x7fd9640aeb40 2023-07-14T13:06:00.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.938+0000 7fd969bc5640 1 -- 172.21.15.5:0/1732390525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd958009420 con 0x7fd9640aeb40 2023-07-14T13:06:00.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.938+0000 7fd969bc5640 1 -- 172.21.15.5:0/1732390525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9640706f0 con 0x7fd9640aeb40 2023-07-14T13:06:00.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.942+0000 7fd969bc5640 1 -- 172.21.15.5:0/1732390525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9640678d0 con 0x7fd9640aeb40 2023-07-14T13:06:00.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.942+0000 7fd94bfff640 1 -- 172.21.15.5:0/1732390525 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd9540135d0 con 0x7fd9640aeb40 2023-07-14T13:06:00.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.942+0000 7fd94bfff640 1 --2- 172.21.15.5:0/1732390525 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fd9500663a0 0x7fd950068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:00.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.942+0000 7fd94bfff640 1 -- 172.21.15.5:0/1732390525 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fd954084820 con 0x7fd9640aeb40 2023-07-14T13:06:00.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.942+0000 7fd962ffd640 1 --2- 172.21.15.5:0/1732390525 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fd9500663a0 0x7fd950068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:00.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.942+0000 7fd962ffd640 1 --2- 172.21.15.5:0/1732390525 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fd9500663a0 0x7fd950068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd9580ae000 tx=0x7fd958008040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:00.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:00.946+0000 7fd94bfff640 1 -- 172.21.15.5:0/1732390525 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd9540557c0 con 0x7fd9640aeb40 2023-07-14T13:06:01.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.134+0000 7fd969bc5640 1 -- 172.21.15.5:0/1732390525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd964071180 con 0x7fd9640aeb40 2023-07-14T13:06:01.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.786+0000 7fd94bfff640 1 -- 172.21.15.5:0/1732390525 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v20) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd954055350 con 0x7fd9640aeb40 2023-07-14T13:06:01.818 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 7 and data pool 8 2023-07-14T13:06:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.794+0000 7fd969bc5640 1 -- 172.21.15.5:0/1732390525 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fd9500663a0 msgr2=0x7fd950068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.794+0000 7fd969bc5640 1 --2- 172.21.15.5:0/1732390525 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fd9500663a0 0x7fd950068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd9580ae000 tx=0x7fd958008040 comp rx=0 tx=0).stop 2023-07-14T13:06:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.794+0000 7fd969bc5640 1 -- 172.21.15.5:0/1732390525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9640aeb40 msgr2=0x7fd9641559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.794+0000 7fd969bc5640 1 --2- 172.21.15.5:0/1732390525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9640aeb40 0x7fd9641559f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fd95400ebe0 tx=0x7fd95400c520 comp rx=0 tx=0).stop 2023-07-14T13:06:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.794+0000 7fd969bc5640 1 -- 172.21.15.5:0/1732390525 shutdown_connections 2023-07-14T13:06:01.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.794+0000 7fd969bc5640 1 --2- 172.21.15.5:0/1732390525 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fd9500663a0 0x7fd950068850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:01.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.794+0000 7fd969bc5640 1 --2- 172.21.15.5:0/1732390525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd964159270 0x7fd9641579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:01.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.794+0000 7fd969bc5640 1 --2- 172.21.15.5:0/1732390525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9640aef10 0x7fd9641f7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:01.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.794+0000 7fd969bc5640 1 --2- 172.21.15.5:0/1732390525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9640aeb40 0x7fd9641559f0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.794+0000 7fd969bc5640 1 -- 172.21.15.5:0/1732390525 >> 172.21.15.5:0/1732390525 conn(0x7fd9640cde90 msgr2=0x7fd9640ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.794+0000 7fd969bc5640 1 -- 172.21.15.5:0/1732390525 shutdown_connections 2023-07-14T13:06:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.794+0000 7fd969bc5640 1 -- 172.21.15.5:0/1732390525 wait complete. 2023-07-14T13:06:01.848 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:06:01.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.962+0000 7f55fc7fa640 1 Processor -- start 2023-07-14T13:06:01.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.962+0000 7f55fc7fa640 1 -- start start 2023-07-14T13:06:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.962+0000 7f55fc7fa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f55f40c8ad0 0x7f55f40c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.962+0000 7f55fc7fa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f55f40c9560 0x7f55f40ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:01.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.962+0000 7f55fc7fa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f40c99c0 con 0x7f55f4158ce0 2023-07-14T13:06:01.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.962+0000 7f55fc7fa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f40cc700 con 0x7f55f40c9560 2023-07-14T13:06:01.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.962+0000 7f55fc7fa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f40b0ff0 con 0x7f55f40c8ad0 2023-07-14T13:06:01.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.962+0000 7f55fa596640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f55f4158ce0 0x7f55f4070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48330/0 (socket says 172.21.15.5:48330) 2023-07-14T13:06:01.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.962+0000 7f55fa596640 1 -- 172.21.15.5:0/3008427815 learned_addr learned my addr 172.21.15.5:0/3008427815 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:06:01.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.962+0000 7f55fad97640 1 --2- 172.21.15.5:0/3008427815 >> v2:172.21.15.5:3300/0 conn(0x7f55f40c9560 0x7f55f40ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:01.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.966+0000 7f55f9d95640 1 --2- 172.21.15.5:0/3008427815 >> v2:172.21.15.154:3300/0 conn(0x7f55f40c8ad0 0x7f55f40c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:01.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.966+0000 7f55f9594640 1 -- 172.21.15.5:0/3008427815 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3558161578 0 0) 0x7f55f40c99c0 con 0x7f55f4158ce0 2023-07-14T13:06:01.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.966+0000 7f55f9594640 1 -- 172.21.15.5:0/3008427815 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55e0003530 con 0x7f55f4158ce0 2023-07-14T13:06:01.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.966+0000 7f55fad97640 1 -- 172.21.15.5:0/3008427815 >> v2:172.21.15.154:3300/0 conn(0x7f55f40c8ad0 msgr2=0x7f55f40c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:01.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.966+0000 7f55fad97640 1 --2- 172.21.15.5:0/3008427815 >> v2:172.21.15.154:3300/0 conn(0x7f55f40c8ad0 0x7f55f40c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:01.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.966+0000 7f55fad97640 1 -- 172.21.15.5:0/3008427815 >> v1:172.21.15.5:6789/0 conn(0x7f55f4158ce0 legacy=0x7f55f4070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:01.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.966+0000 7f55fad97640 1 -- 172.21.15.5:0/3008427815 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f4070c80 con 0x7f55f40c9560 2023-07-14T13:06:01.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.966+0000 7f55f9d95640 1 --2- 172.21.15.5:0/3008427815 >> v2:172.21.15.154:3300/0 conn(0x7f55f40c8ad0 0x7f55f40c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:06:01.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.966+0000 7f55fad97640 1 --2- 172.21.15.5:0/3008427815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f40c9560 0x7f55f40ccb90 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f55f40c1a30 tx=0x7f55ec01c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88360763056822e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:01.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.966+0000 7f55f9594640 1 -- 172.21.15.5:0/3008427815 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec0a5790 con 0x7f55f40c9560 2023-07-14T13:06:01.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.966+0000 7f55f9594640 1 -- 172.21.15.5:0/3008427815 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec0a58f0 con 0x7f55f40c9560 2023-07-14T13:06:01.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.966+0000 7f55f9594640 1 -- 172.21.15.5:0/3008427815 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec0a5c60 con 0x7f55f40c9560 2023-07-14T13:06:02.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55fc7fa640 1 -- 172.21.15.5:0/3008427815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f40c9560 msgr2=0x7f55f40ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:02.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55fc7fa640 1 --2- 172.21.15.5:0/3008427815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f40c9560 0x7f55f40ccb90 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f55f40c1a30 tx=0x7f55ec01c7c0 comp rx=0 tx=0).stop 2023-07-14T13:06:02.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55fc7fa640 1 -- 172.21.15.5:0/3008427815 shutdown_connections 2023-07-14T13:06:02.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55fc7fa640 1 --2- 172.21.15.5:0/3008427815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f40c9560 0x7f55f40ccb90 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:02.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55fc7fa640 1 --2- 172.21.15.5:0/3008427815 >> v2:172.21.15.154:3300/0 conn(0x7f55f40c8ad0 0x7f55f40c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:02.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55fc7fa640 1 -- 172.21.15.5:0/3008427815 >> 172.21.15.5:0/3008427815 conn(0x7f55f40afcf0 msgr2=0x7f55f40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:02.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55fc7fa640 1 -- 172.21.15.5:0/3008427815 shutdown_connections 2023-07-14T13:06:02.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55fc7fa640 1 -- 172.21.15.5:0/3008427815 wait complete. 2023-07-14T13:06:02.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55fc7fa640 1 Processor -- start 2023-07-14T13:06:02.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55fc7fa640 1 -- start start 2023-07-14T13:06:02.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55fc7fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55f40c8ad0 0x7f55f41f74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:02.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55fc7fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55f40c9560 0x7f55f40b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:02.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55fc7fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f4158ce0 0x7f55f414bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:02.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55fc7fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f40b1130 con 0x7f55f4158ce0 2023-07-14T13:06:02.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55fc7fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f40c7070 con 0x7f55f40c8ad0 2023-07-14T13:06:02.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55fc7fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f40c7350 con 0x7f55f40c9560 2023-07-14T13:06:02.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55fad97640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f4158ce0 0x7f55f414bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:02.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55fad97640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f4158ce0 0x7f55f414bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57340/0 (socket says 172.21.15.5:57340) 2023-07-14T13:06:02.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55fad97640 1 -- 172.21.15.5:0/2500395873 learned_addr learned my addr 172.21.15.5:0/2500395873 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:02.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55fa596640 1 --2- 172.21.15.5:0/2500395873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55f40c8ad0 0x7f55f41f74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:02.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55f9d95640 1 --2- 172.21.15.5:0/2500395873 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55f40c9560 0x7f55f40b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:02.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55fad97640 1 -- 172.21.15.5:0/2500395873 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55f40c9560 msgr2=0x7f55f40b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:02.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55fad97640 1 --2- 172.21.15.5:0/2500395873 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55f40c9560 0x7f55f40b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:02.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55fad97640 1 -- 172.21.15.5:0/2500395873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55f40c8ad0 msgr2=0x7f55f41f74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:02.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55fad97640 1 --2- 172.21.15.5:0/2500395873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55f40c8ad0 0x7f55f41f74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:02.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55fad97640 1 -- 172.21.15.5:0/2500395873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ec009a70 con 0x7f55f4158ce0 2023-07-14T13:06:02.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55fa596640 1 --2- 172.21.15.5:0/2500395873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55f40c8ad0 0x7f55f41f74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:06:02.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.970+0000 7f55f9d95640 1 --2- 172.21.15.5:0/2500395873 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55f40c9560 0x7f55f40b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:06:02.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.974+0000 7f55fad97640 1 --2- 172.21.15.5:0/2500395873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f4158ce0 0x7f55f414bcf0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0193d0 tx=0x7f55ec019560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:02.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.974+0000 7f55eaffd640 1 -- 172.21.15.5:0/2500395873 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec003ba0 con 0x7f55f4158ce0 2023-07-14T13:06:02.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.974+0000 7f55eaffd640 1 -- 172.21.15.5:0/2500395873 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec003d00 con 0x7f55f4158ce0 2023-07-14T13:06:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.974+0000 7f55eaffd640 1 -- 172.21.15.5:0/2500395873 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec004240 con 0x7f55f4158ce0 2023-07-14T13:06:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.974+0000 7f55fc7fa640 1 -- 172.21.15.5:0/2500395873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f40c7630 con 0x7f55f4158ce0 2023-07-14T13:06:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.974+0000 7f55fc7fa640 1 -- 172.21.15.5:0/2500395873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f40b18f0 con 0x7f55f4158ce0 2023-07-14T13:06:02.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.974+0000 7f55fc7fa640 1 -- 172.21.15.5:0/2500395873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f40ca1a0 con 0x7f55f4158ce0 2023-07-14T13:06:02.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.974+0000 7f55eaffd640 1 -- 172.21.15.5:0/2500395873 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f55ec0b4070 con 0x7f55f4158ce0 2023-07-14T13:06:02.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.974+0000 7f55eaffd640 1 --2- 172.21.15.5:0/2500395873 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f55d80663a0 0x7f55d8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:02.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.974+0000 7f55eaffd640 1 -- 172.21.15.5:0/2500395873 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f55ec11eb80 con 0x7f55f4158ce0 2023-07-14T13:06:02.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.974+0000 7f55fa596640 1 --2- 172.21.15.5:0/2500395873 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f55d80663a0 0x7f55d8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:02.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.978+0000 7f55fa596640 1 --2- 172.21.15.5:0/2500395873 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f55d80663a0 0x7f55d8068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f55f0005890 tx=0x7f55f0009040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:02.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:01.978+0000 7f55eaffd640 1 -- 172.21.15.5:0/2500395873 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f55ec0ebf70 con 0x7f55f4158ce0 2023-07-14T13:06:02.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.134+0000 7f55fc7fa640 1 -- 172.21.15.5:0/2500395873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55f40b1610 con 0x7f55f4158ce0 2023-07-14T13:06:02.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.138+0000 7f55eaffd640 1 -- 172.21.15.5:0/2500395873 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+18316 (secure 0 0 0) 0x7f55f40b1610 con 0x7f55f4158ce0 2023-07-14T13:06:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:06:02.168 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":64,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:06:01.137266+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:05:59.255634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-14T13:06:00.136409+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:06:02.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.138+0000 7f55fc7fa640 1 -- 172.21.15.5:0/2500395873 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f55d80663a0 msgr2=0x7f55d8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:02.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.138+0000 7f55fc7fa640 1 --2- 172.21.15.5:0/2500395873 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f55d80663a0 0x7f55d8068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f55f0005890 tx=0x7f55f0009040 comp rx=0 tx=0).stop 2023-07-14T13:06:02.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.138+0000 7f55fc7fa640 1 -- 172.21.15.5:0/2500395873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f4158ce0 msgr2=0x7f55f414bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:02.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.138+0000 7f55fc7fa640 1 --2- 172.21.15.5:0/2500395873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f4158ce0 0x7f55f414bcf0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0193d0 tx=0x7f55ec019560 comp rx=0 tx=0).stop 2023-07-14T13:06:02.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.138+0000 7f55fc7fa640 1 -- 172.21.15.5:0/2500395873 shutdown_connections 2023-07-14T13:06:02.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.138+0000 7f55fc7fa640 1 --2- 172.21.15.5:0/2500395873 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f55d80663a0 0x7f55d8068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:02.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.138+0000 7f55fc7fa640 1 --2- 172.21.15.5:0/2500395873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55f4158ce0 0x7f55f414bcf0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:02.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.138+0000 7f55fc7fa640 1 --2- 172.21.15.5:0/2500395873 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55f40c9560 0x7f55f40b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:02.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.138+0000 7f55fc7fa640 1 --2- 172.21.15.5:0/2500395873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55f40c8ad0 0x7f55f41f74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:02.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.138+0000 7f55fc7fa640 1 -- 172.21.15.5:0/2500395873 >> 172.21.15.5:0/2500395873 conn(0x7f55f40afcf0 msgr2=0x7f55f4150270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:02.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.138+0000 7f55fc7fa640 1 -- 172.21.15.5:0/2500395873 shutdown_connections 2023-07-14T13:06:02.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.138+0000 7f55fc7fa640 1 -- 172.21.15.5:0/2500395873 wait complete. 2023-07-14T13:06:02.189 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:06:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.302+0000 7f72b7f9d640 1 Processor -- start 2023-07-14T13:06:02.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.302+0000 7f72b7f9d640 1 -- start start 2023-07-14T13:06:02.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.302+0000 7f72b7f9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72b0145430 0x7f72b00b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:02.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.302+0000 7f72b7f9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f72b00b39f0 0x7f72b00d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:02.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.302+0000 7f72b7f9d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b00b2140 con 0x7f72b00d06b0 2023-07-14T13:06:02.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.302+0000 7f72b7f9d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b00b2410 con 0x7f72b00b39f0 2023-07-14T13:06:02.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.302+0000 7f72b7f9d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b00b26f0 con 0x7f72b0145430 2023-07-14T13:06:02.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.302+0000 7f72b653a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f72b00b39f0 0x7f72b00d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:02.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.302+0000 7f72b653a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f72b00b39f0 0x7f72b00d22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57348/0 (socket says 172.21.15.5:57348) 2023-07-14T13:06:02.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.302+0000 7f72b653a640 1 -- 172.21.15.5:0/3795308843 learned_addr learned my addr 172.21.15.5:0/3795308843 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:02.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.302+0000 7f72b5538640 1 --2- 172.21.15.5:0/3795308843 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72b0145430 0x7f72b00b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:02.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.302+0000 7f72b653a640 1 -- 172.21.15.5:0/3795308843 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72b0145430 msgr2=0x7f72b00b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:02.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.302+0000 7f72b653a640 1 --2- 172.21.15.5:0/3795308843 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72b0145430 0x7f72b00b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:02.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.302+0000 7f72b653a640 1 -- 172.21.15.5:0/3795308843 >> v1:172.21.15.154:6789/0 conn(0x7f72b00d06b0 legacy=0x7f72b00b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:02.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.302+0000 7f72b653a640 1 -- 172.21.15.5:0/3795308843 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b00b29d0 con 0x7f72b00b39f0 2023-07-14T13:06:02.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.306+0000 7f72b653a640 1 --2- 172.21.15.5:0/3795308843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72b00b39f0 0x7f72b00d22e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009e50 tx=0x7f72a801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de122d057e4e485e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:02.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.306+0000 7f72b4d37640 1 -- 172.21.15.5:0/3795308843 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a80a57c0 con 0x7f72b00b39f0 2023-07-14T13:06:02.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.306+0000 7f72b4d37640 1 -- 172.21.15.5:0/3795308843 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a80a5920 con 0x7f72b00b39f0 2023-07-14T13:06:02.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.306+0000 7f72b4d37640 1 -- 172.21.15.5:0/3795308843 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a80a5cb0 con 0x7f72b00b39f0 2023-07-14T13:06:02.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.306+0000 7f72b7f9d640 1 -- 172.21.15.5:0/3795308843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72b00b39f0 msgr2=0x7f72b00d22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:02.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.306+0000 7f72b7f9d640 1 --2- 172.21.15.5:0/3795308843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72b00b39f0 0x7f72b00d22e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009e50 tx=0x7f72a801c9e0 comp rx=0 tx=0).stop 2023-07-14T13:06:02.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.306+0000 7f72b7f9d640 1 -- 172.21.15.5:0/3795308843 shutdown_connections 2023-07-14T13:06:02.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.306+0000 7f72b7f9d640 1 --2- 172.21.15.5:0/3795308843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72b00b39f0 0x7f72b00d22e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:02.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.306+0000 7f72b7f9d640 1 --2- 172.21.15.5:0/3795308843 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72b0145430 0x7f72b00b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:02.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.306+0000 7f72b7f9d640 1 -- 172.21.15.5:0/3795308843 >> 172.21.15.5:0/3795308843 conn(0x7f72b00659d0 msgr2=0x7f72b009b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:02.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.306+0000 7f72b7f9d640 1 -- 172.21.15.5:0/3795308843 shutdown_connections 2023-07-14T13:06:02.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.306+0000 7f72b7f9d640 1 -- 172.21.15.5:0/3795308843 wait complete. 2023-07-14T13:06:02.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.310+0000 7f72b7f9d640 1 Processor -- start 2023-07-14T13:06:02.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.310+0000 7f72b7f9d640 1 -- start start 2023-07-14T13:06:02.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.310+0000 7f72b7f9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72b00b39f0 0x7f72b015b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:02.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.310+0000 7f72b7f9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72b00d06b0 0x7f72b01f81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:02.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.310+0000 7f72b7f9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72b00c5380 0x7f72b01f8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:02.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.310+0000 7f72b7f9d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b00cd000 con 0x7f72b00b39f0 2023-07-14T13:06:02.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.310+0000 7f72b7f9d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b00cc960 con 0x7f72b00c5380 2023-07-14T13:06:02.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.310+0000 7f72b7f9d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b01601f0 con 0x7f72b00d06b0 2023-07-14T13:06:02.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.310+0000 7f72b5d39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72b00b39f0 0x7f72b015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:02.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.310+0000 7f72b5d39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72b00b39f0 0x7f72b015b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57354/0 (socket says 172.21.15.5:57354) 2023-07-14T13:06:02.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.310+0000 7f72b5d39640 1 -- 172.21.15.5:0/1837035953 learned_addr learned my addr 172.21.15.5:0/1837035953 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:02.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.310+0000 7f72b653a640 1 --2- 172.21.15.5:0/1837035953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72b00c5380 0x7f72b01f8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:02.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.310+0000 7f72b5538640 1 --2- 172.21.15.5:0/1837035953 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72b00d06b0 0x7f72b01f81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:02.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.310+0000 7f72b5d39640 1 -- 172.21.15.5:0/1837035953 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72b00d06b0 msgr2=0x7f72b01f81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:02.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.310+0000 7f72b5d39640 1 --2- 172.21.15.5:0/1837035953 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72b00d06b0 0x7f72b01f81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:02.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.310+0000 7f72b5d39640 1 -- 172.21.15.5:0/1837035953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72b00c5380 msgr2=0x7f72b01f8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:02.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.310+0000 7f72b5d39640 1 --2- 172.21.15.5:0/1837035953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72b00c5380 0x7f72b01f8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:02.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.310+0000 7f72b5d39640 1 -- 172.21.15.5:0/1837035953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a8009b30 con 0x7f72b00b39f0 2023-07-14T13:06:02.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.310+0000 7f72b5538640 1 --2- 172.21.15.5:0/1837035953 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72b00d06b0 0x7f72b01f81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:06:02.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.310+0000 7f72b5d39640 1 --2- 172.21.15.5:0/1837035953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72b00b39f0 0x7f72b015b090 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00c3c0 tx=0x7f72ac00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:02.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.310+0000 7f72a67fc640 1 -- 172.21.15.5:0/1837035953 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac0052d0 con 0x7f72b00b39f0 2023-07-14T13:06:02.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.310+0000 7f72a67fc640 1 -- 172.21.15.5:0/1837035953 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ac005430 con 0x7f72b00b39f0 2023-07-14T13:06:02.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.310+0000 7f72b7f9d640 1 -- 172.21.15.5:0/1837035953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b01604d0 con 0x7f72b00b39f0 2023-07-14T13:06:02.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.310+0000 7f72a67fc640 1 -- 172.21.15.5:0/1837035953 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac003840 con 0x7f72b00b39f0 2023-07-14T13:06:02.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.310+0000 7f72b7f9d640 1 -- 172.21.15.5:0/1837035953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b00ccc20 con 0x7f72b00b39f0 2023-07-14T13:06:02.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.314+0000 7f72b7f9d640 1 -- 172.21.15.5:0/1837035953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b0072e70 con 0x7f72b00b39f0 2023-07-14T13:06:02.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.314+0000 7f72a67fc640 1 -- 172.21.15.5:0/1837035953 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f72ac0039a0 con 0x7f72b00b39f0 2023-07-14T13:06:02.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.314+0000 7f72a67fc640 1 --2- 172.21.15.5:0/1837035953 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f72940663a0 0x7f7294068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:02.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.314+0000 7f72a67fc640 1 -- 172.21.15.5:0/1837035953 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f72ac083320 con 0x7f72b00b39f0 2023-07-14T13:06:02.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.314+0000 7f72b5538640 1 --2- 172.21.15.5:0/1837035953 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f72940663a0 0x7f7294068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:02.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.314+0000 7f72b5538640 1 --2- 172.21.15.5:0/1837035953 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f72940663a0 0x7f7294068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f72b00b1180 tx=0x7f72a0008040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:02.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.318+0000 7f72a67fc640 1 -- 172.21.15.5:0/1837035953 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f72ac050730 con 0x7f72b00b39f0 2023-07-14T13:06:02.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.474+0000 7f72b7f9d640 1 -- 172.21.15.5:0/1837035953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72b00678d0 con 0x7f72b00b39f0 2023-07-14T13:06:02.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.474+0000 7f72a67fc640 1 -- 172.21.15.5:0/1837035953 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+18316 (secure 0 0 0) 0x7f72ac053d50 con 0x7f72b00b39f0 2023-07-14T13:06:02.506 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:06:02.507 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":64,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:06:01.137266+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:05:59.255634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-14T13:06:00.136409+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:06:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.478+0000 7f72b7f9d640 1 -- 172.21.15.5:0/1837035953 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f72940663a0 msgr2=0x7f7294068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.478+0000 7f72b7f9d640 1 --2- 172.21.15.5:0/1837035953 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f72940663a0 0x7f7294068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f72b00b1180 tx=0x7f72a0008040 comp rx=0 tx=0).stop 2023-07-14T13:06:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.478+0000 7f72b7f9d640 1 -- 172.21.15.5:0/1837035953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72b00b39f0 msgr2=0x7f72b015b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:02.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.478+0000 7f72b7f9d640 1 --2- 172.21.15.5:0/1837035953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72b00b39f0 0x7f72b015b090 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00c3c0 tx=0x7f72ac00c880 comp rx=0 tx=0).stop 2023-07-14T13:06:02.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.478+0000 7f72b7f9d640 1 -- 172.21.15.5:0/1837035953 shutdown_connections 2023-07-14T13:06:02.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.478+0000 7f72b7f9d640 1 --2- 172.21.15.5:0/1837035953 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f72940663a0 0x7f7294068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:02.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.478+0000 7f72b7f9d640 1 --2- 172.21.15.5:0/1837035953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72b00c5380 0x7f72b01f8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:02.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.478+0000 7f72b7f9d640 1 --2- 172.21.15.5:0/1837035953 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f72b00d06b0 0x7f72b01f81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:02.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.478+0000 7f72b7f9d640 1 --2- 172.21.15.5:0/1837035953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72b00b39f0 0x7f72b015b090 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:02.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.478+0000 7f72b7f9d640 1 -- 172.21.15.5:0/1837035953 >> 172.21.15.5:0/1837035953 conn(0x7f72b00659d0 msgr2=0x7f72b00afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:02.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.478+0000 7f72b7f9d640 1 -- 172.21.15.5:0/1837035953 shutdown_connections 2023-07-14T13:06:02.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.478+0000 7f72b7f9d640 1 -- 172.21.15.5:0/1837035953 wait complete. 2023-07-14T13:06:02.528 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-14T13:06:02.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.642+0000 7f097ced8640 1 Processor -- start 2023-07-14T13:06:02.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.642+0000 7f097ced8640 1 -- start start 2023-07-14T13:06:02.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.646+0000 7f097ced8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09780aeb40 0x7f097815cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:02.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.646+0000 7f097ced8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09780aef10 0x7f0978158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:02.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.646+0000 7f097ced8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0978159270 0x7f09780c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:02.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.646+0000 7f097ced8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09781532b0 con 0x7f09780aef10 2023-07-14T13:06:02.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.646+0000 7f097ced8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09780ca6f0 con 0x7f0978159270 2023-07-14T13:06:02.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.646+0000 7f097ced8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09781599d0 con 0x7f09780aeb40 2023-07-14T13:06:02.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.646+0000 7f096ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09780aef10 0x7f0978158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:02.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.646+0000 7f096ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09780aef10 0x7f0978158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57360/0 (socket says 172.21.15.5:57360) 2023-07-14T13:06:02.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.646+0000 7f096ffff640 1 -- 172.21.15.5:0/1715353138 learned_addr learned my addr 172.21.15.5:0/1715353138 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:02.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.646+0000 7f097659c640 1 --2- 172.21.15.5:0/1715353138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09780aeb40 0x7f097815cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:02.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.646+0000 7f0976d9d640 1 --2- 172.21.15.5:0/1715353138 >> v2:172.21.15.154:3300/0 conn(0x7f0978159270 0x7f09780c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:02.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.646+0000 7f096ffff640 1 -- 172.21.15.5:0/1715353138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09780aeb40 msgr2=0x7f097815cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:02.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.646+0000 7f096ffff640 1 --2- 172.21.15.5:0/1715353138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09780aeb40 0x7f097815cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:02.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.646+0000 7f096ffff640 1 -- 172.21.15.5:0/1715353138 >> v2:172.21.15.154:3300/0 conn(0x7f0978159270 msgr2=0x7f09780c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:02.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.646+0000 7f096ffff640 1 --2- 172.21.15.5:0/1715353138 >> v2:172.21.15.154:3300/0 conn(0x7f0978159270 0x7f09780c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:02.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.646+0000 7f096ffff640 1 -- 172.21.15.5:0/1715353138 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0978159cb0 con 0x7f09780aef10 2023-07-14T13:06:02.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.646+0000 7f096ffff640 1 --2- 172.21.15.5:0/1715353138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09780aef10 0x7f0978158d30 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f09780b4080 tx=0x7f096001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=968f1ff7c2bd8bab server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:02.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.650+0000 7f0975d9b640 1 -- 172.21.15.5:0/1715353138 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09600ab600 con 0x7f09780aef10 2023-07-14T13:06:02.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.650+0000 7f0975d9b640 1 -- 172.21.15.5:0/1715353138 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09600ab760 con 0x7f09780aef10 2023-07-14T13:06:02.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.650+0000 7f0975d9b640 1 -- 172.21.15.5:0/1715353138 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09600abaf0 con 0x7f09780aef10 2023-07-14T13:06:02.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.650+0000 7f097ced8640 1 -- 172.21.15.5:0/1715353138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09780aef10 msgr2=0x7f0978158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:02.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.650+0000 7f097ced8640 1 --2- 172.21.15.5:0/1715353138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09780aef10 0x7f0978158d30 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f09780b4080 tx=0x7f096001c440 comp rx=0 tx=0).stop 2023-07-14T13:06:02.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.650+0000 7f097ced8640 1 -- 172.21.15.5:0/1715353138 shutdown_connections 2023-07-14T13:06:02.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.650+0000 7f097ced8640 1 --2- 172.21.15.5:0/1715353138 >> v2:172.21.15.154:3300/0 conn(0x7f0978159270 0x7f09780c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:02.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.650+0000 7f097ced8640 1 --2- 172.21.15.5:0/1715353138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09780aef10 0x7f0978158d30 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:02.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.650+0000 7f097ced8640 1 --2- 172.21.15.5:0/1715353138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09780aeb40 0x7f097815cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:02.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.650+0000 7f097ced8640 1 -- 172.21.15.5:0/1715353138 >> 172.21.15.5:0/1715353138 conn(0x7f09780cde90 msgr2=0x7f09780ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:02.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.650+0000 7f097ced8640 1 -- 172.21.15.5:0/1715353138 shutdown_connections 2023-07-14T13:06:02.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.650+0000 7f097ced8640 1 -- 172.21.15.5:0/1715353138 wait complete. 2023-07-14T13:06:02.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.650+0000 7f097ced8640 1 Processor -- start 2023-07-14T13:06:02.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.650+0000 7f097ced8640 1 -- start start 2023-07-14T13:06:02.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.650+0000 7f097ced8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09780aeb40 0x7f0978151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:02.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.650+0000 7f097ced8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09780aef10 0x7f097806ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:02.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.650+0000 7f097ced8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0978159270 0x7f097814d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:02.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.650+0000 7f097ced8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09781523c0 con 0x7f0978159270 2023-07-14T13:06:02.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.650+0000 7f097ced8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09781520e0 con 0x7f09780aeb40 2023-07-14T13:06:02.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.650+0000 7f097ced8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097815a490 con 0x7f09780aef10 2023-07-14T13:06:02.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.654+0000 7f0976d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0978159270 0x7f097814d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:02.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.654+0000 7f097659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09780aeb40 0x7f0978151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:02.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.654+0000 7f0976d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0978159270 0x7f097814d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57364/0 (socket says 172.21.15.5:57364) 2023-07-14T13:06:02.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.654+0000 7f0976d9d640 1 -- 172.21.15.5:0/536732038 learned_addr learned my addr 172.21.15.5:0/536732038 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:02.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.654+0000 7f096ffff640 1 --2- 172.21.15.5:0/536732038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09780aef10 0x7f097806ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:02.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.654+0000 7f0976d9d640 1 -- 172.21.15.5:0/536732038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09780aef10 msgr2=0x7f097806ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:02.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.654+0000 7f0976d9d640 1 --2- 172.21.15.5:0/536732038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09780aef10 0x7f097806ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:02.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.654+0000 7f0976d9d640 1 -- 172.21.15.5:0/536732038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09780aeb40 msgr2=0x7f0978151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:02.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.654+0000 7f0976d9d640 1 --2- 172.21.15.5:0/536732038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09780aeb40 0x7f0978151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:02.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.654+0000 7f0976d9d640 1 -- 172.21.15.5:0/536732038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09600094d0 con 0x7f0978159270 2023-07-14T13:06:02.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.654+0000 7f0976d9d640 1 --2- 172.21.15.5:0/536732038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0978159270 0x7f097814d3b0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0970007e60 tx=0x7f097000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:02.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.654+0000 7f096effd640 1 -- 172.21.15.5:0/536732038 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0970014420 con 0x7f0978159270 2023-07-14T13:06:02.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.654+0000 7f096effd640 1 -- 172.21.15.5:0/536732038 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09700145a0 con 0x7f0978159270 2023-07-14T13:06:02.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.654+0000 7f096effd640 1 -- 172.21.15.5:0/536732038 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0970014950 con 0x7f0978159270 2023-07-14T13:06:02.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.654+0000 7f097ced8640 1 -- 172.21.15.5:0/536732038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f097815a770 con 0x7f0978159270 2023-07-14T13:06:02.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.654+0000 7f097ced8640 1 -- 172.21.15.5:0/536732038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0978150380 con 0x7f0978159270 2023-07-14T13:06:02.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.654+0000 7f097ced8640 1 -- 172.21.15.5:0/536732038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f097815a2f0 con 0x7f0978159270 2023-07-14T13:06:02.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.654+0000 7f096effd640 1 -- 172.21.15.5:0/536732038 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0970014ab0 con 0x7f0978159270 2023-07-14T13:06:02.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.654+0000 7f096effd640 1 --2- 172.21.15.5:0/536732038 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f09580663a0 0x7f0958068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:02.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.654+0000 7f096effd640 1 -- 172.21.15.5:0/536732038 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0970084560 con 0x7f0978159270 2023-07-14T13:06:02.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.658+0000 7f097659c640 1 --2- 172.21.15.5:0/536732038 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f09580663a0 0x7f0958068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:02.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.658+0000 7f097659c640 1 --2- 172.21.15.5:0/536732038 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f09580663a0 0x7f0958068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0968007a60 tx=0x7f0968008040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:02.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.658+0000 7f096effd640 1 -- 172.21.15.5:0/536732038 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f097815a2f0 con 0x7f0978159270 2023-07-14T13:06:02.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:02.850+0000 7f097ced8640 1 -- 172.21.15.5:0/536732038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f097815a2f0 con 0x7f0978159270 2023-07-14T13:06:03.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.782+0000 7f096effd640 1 -- 172.21.15.5:0/536732038 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v23) v1 ==== 118+0+0 (secure 0 0 0) 0x7f097815a2f0 con 0x7f0978159270 2023-07-14T13:06:03.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.782+0000 7f097ced8640 1 -- 172.21.15.5:0/536732038 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f09580663a0 msgr2=0x7f0958068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:03.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.782+0000 7f097ced8640 1 --2- 172.21.15.5:0/536732038 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f09580663a0 0x7f0958068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0968007a60 tx=0x7f0968008040 comp rx=0 tx=0).stop 2023-07-14T13:06:03.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.782+0000 7f097ced8640 1 -- 172.21.15.5:0/536732038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0978159270 msgr2=0x7f097814d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:03.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.782+0000 7f097ced8640 1 --2- 172.21.15.5:0/536732038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0978159270 0x7f097814d3b0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0970007e60 tx=0x7f097000e4b0 comp rx=0 tx=0).stop 2023-07-14T13:06:03.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.782+0000 7f097ced8640 1 -- 172.21.15.5:0/536732038 shutdown_connections 2023-07-14T13:06:03.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.782+0000 7f097ced8640 1 --2- 172.21.15.5:0/536732038 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f09580663a0 0x7f0958068850 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:03.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.782+0000 7f097ced8640 1 --2- 172.21.15.5:0/536732038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0978159270 0x7f097814d3b0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:03.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.782+0000 7f097ced8640 1 --2- 172.21.15.5:0/536732038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09780aef10 0x7f097806ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:03.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.782+0000 7f097ced8640 1 --2- 172.21.15.5:0/536732038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09780aeb40 0x7f0978151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:03.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.782+0000 7f097ced8640 1 -- 172.21.15.5:0/536732038 >> 172.21.15.5:0/536732038 conn(0x7f09780cde90 msgr2=0x7f09780cd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:03.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.782+0000 7f097ced8640 1 -- 172.21.15.5:0/536732038 shutdown_connections 2023-07-14T13:06:03.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.782+0000 7f097ced8640 1 -- 172.21.15.5:0/536732038 wait complete. 2023-07-14T13:06:03.838 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-14T13:06:03.839 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-14T13:06:03.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.958+0000 7ff82cb96640 1 Processor -- start 2023-07-14T13:06:03.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.958+0000 7ff82cb96640 1 -- start start 2023-07-14T13:06:03.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.962+0000 7ff82cb96640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff828070f30 0x7ff8280ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.962+0000 7ff82cb96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8280af2b0 0x7ff82815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.962+0000 7ff82cb96640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff828159d70 con 0x7ff828069430 2023-07-14T13:06:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.962+0000 7ff82cb96640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8280c9c60 con 0x7ff828070f30 2023-07-14T13:06:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.962+0000 7ff82cb96640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8280c9f40 con 0x7ff8280af2b0 2023-07-14T13:06:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.962+0000 7ff81ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff828070f30 0x7ff8280ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.962+0000 7ff81ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff828070f30 0x7ff8280ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57370/0 (socket says 172.21.15.5:57370) 2023-07-14T13:06:03.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.962+0000 7ff81ffff640 1 -- 172.21.15.5:0/464234935 learned_addr learned my addr 172.21.15.5:0/464234935 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:03.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.962+0000 7ff826d9d640 1 --2- 172.21.15.5:0/464234935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8280af2b0 0x7ff82815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:03.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.962+0000 7ff81ffff640 1 -- 172.21.15.5:0/464234935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8280af2b0 msgr2=0x7ff82815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:03.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.962+0000 7ff81ffff640 1 --2- 172.21.15.5:0/464234935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8280af2b0 0x7ff82815a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:03.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.962+0000 7ff81ffff640 1 -- 172.21.15.5:0/464234935 >> v1:172.21.15.154:6789/0 conn(0x7ff828069430 legacy=0x7ff828069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:03.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.962+0000 7ff81ffff640 1 -- 172.21.15.5:0/464234935 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8280ca220 con 0x7ff828070f30 2023-07-14T13:06:03.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.962+0000 7ff81ffff640 1 --2- 172.21.15.5:0/464234935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff828070f30 0x7ff8280ad6f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff810009870 tx=0x7ff81001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d90bd6f5cfdf0b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:03.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.966+0000 7ff825d9b640 1 -- 172.21.15.5:0/464234935 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8100a9400 con 0x7ff828070f30 2023-07-14T13:06:03.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.966+0000 7ff825d9b640 1 -- 172.21.15.5:0/464234935 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8100a9560 con 0x7ff828070f30 2023-07-14T13:06:03.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.966+0000 7ff825d9b640 1 -- 172.21.15.5:0/464234935 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8100a98f0 con 0x7ff828070f30 2023-07-14T13:06:03.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.966+0000 7ff82cb96640 1 -- 172.21.15.5:0/464234935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff828070f30 msgr2=0x7ff8280ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:03.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.966+0000 7ff82cb96640 1 --2- 172.21.15.5:0/464234935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff828070f30 0x7ff8280ad6f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff810009870 tx=0x7ff81001c540 comp rx=0 tx=0).stop 2023-07-14T13:06:03.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.966+0000 7ff82cb96640 1 -- 172.21.15.5:0/464234935 shutdown_connections 2023-07-14T13:06:03.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.966+0000 7ff82cb96640 1 --2- 172.21.15.5:0/464234935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8280af2b0 0x7ff82815a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:03.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.966+0000 7ff82cb96640 1 --2- 172.21.15.5:0/464234935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff828070f30 0x7ff8280ad6f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:03.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.966+0000 7ff82cb96640 1 -- 172.21.15.5:0/464234935 >> 172.21.15.5:0/464234935 conn(0x7ff8280cde90 msgr2=0x7ff8280ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:03.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.966+0000 7ff82cb96640 1 -- 172.21.15.5:0/464234935 shutdown_connections 2023-07-14T13:06:03.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.966+0000 7ff82cb96640 1 -- 172.21.15.5:0/464234935 wait complete. 2023-07-14T13:06:03.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.966+0000 7ff82cb96640 1 Processor -- start 2023-07-14T13:06:03.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.966+0000 7ff82cb96640 1 -- start start 2023-07-14T13:06:04.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.966+0000 7ff82cb96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff828069430 0x7ff8281489c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:04.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.966+0000 7ff82cb96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff828070f30 0x7ff82806bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:04.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.966+0000 7ff82cb96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8280af2b0 0x7ff82806c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:04.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.966+0000 7ff82cb96640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8280cb250 con 0x7ff828070f30 2023-07-14T13:06:04.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.966+0000 7ff82cb96640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8280cb520 con 0x7ff828069430 2023-07-14T13:06:04.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.966+0000 7ff82cb96640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8280cb800 con 0x7ff8280af2b0 2023-07-14T13:06:04.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.966+0000 7ff81ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff828070f30 0x7ff82806bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:04.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.966+0000 7ff81ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff828070f30 0x7ff82806bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57378/0 (socket says 172.21.15.5:57378) 2023-07-14T13:06:04.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.966+0000 7ff81ffff640 1 -- 172.21.15.5:0/2413030021 learned_addr learned my addr 172.21.15.5:0/2413030021 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:04.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.966+0000 7ff82659c640 1 --2- 172.21.15.5:0/2413030021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff828069430 0x7ff8281489c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:04.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.966+0000 7ff826d9d640 1 --2- 172.21.15.5:0/2413030021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8280af2b0 0x7ff82806c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:04.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.970+0000 7ff81ffff640 1 -- 172.21.15.5:0/2413030021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8280af2b0 msgr2=0x7ff82806c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:04.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.970+0000 7ff81ffff640 1 --2- 172.21.15.5:0/2413030021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8280af2b0 0x7ff82806c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:04.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.970+0000 7ff81ffff640 1 -- 172.21.15.5:0/2413030021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff828069430 msgr2=0x7ff8281489c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:04.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.970+0000 7ff81ffff640 1 --2- 172.21.15.5:0/2413030021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff828069430 0x7ff8281489c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:04.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.970+0000 7ff81ffff640 1 -- 172.21.15.5:0/2413030021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8100094d0 con 0x7ff828070f30 2023-07-14T13:06:04.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.970+0000 7ff82659c640 1 --2- 172.21.15.5:0/2413030021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff828069430 0x7ff8281489c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:06:04.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.970+0000 7ff826d9d640 1 --2- 172.21.15.5:0/2413030021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8280af2b0 0x7ff82806c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:06:04.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.970+0000 7ff81ffff640 1 --2- 172.21.15.5:0/2413030021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff828070f30 0x7ff82806bae0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff81001abf0 tx=0x7ff81001ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:04.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.970+0000 7ff81effd640 1 -- 172.21.15.5:0/2413030021 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8100a9400 con 0x7ff828070f30 2023-07-14T13:06:04.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.970+0000 7ff81effd640 1 -- 172.21.15.5:0/2413030021 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8100b1800 con 0x7ff828070f30 2023-07-14T13:06:04.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.970+0000 7ff81effd640 1 -- 172.21.15.5:0/2413030021 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8100b1bb0 con 0x7ff828070f30 2023-07-14T13:06:04.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.970+0000 7ff82cb96640 1 -- 172.21.15.5:0/2413030021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8280cbae0 con 0x7ff828070f30 2023-07-14T13:06:04.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.970+0000 7ff82cb96640 1 -- 172.21.15.5:0/2413030021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8280cc0a0 con 0x7ff828070f30 2023-07-14T13:06:04.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.970+0000 7ff82cb96640 1 -- 172.21.15.5:0/2413030021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8280678d0 con 0x7ff828070f30 2023-07-14T13:06:04.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.970+0000 7ff81effd640 1 -- 172.21.15.5:0/2413030021 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff8100b1d10 con 0x7ff828070f30 2023-07-14T13:06:04.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.970+0000 7ff81effd640 1 --2- 172.21.15.5:0/2413030021 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ff8080663a0 0x7ff808068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:04.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.970+0000 7ff81effd640 1 -- 172.21.15.5:0/2413030021 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff81011e6a0 con 0x7ff828070f30 2023-07-14T13:06:04.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.974+0000 7ff82659c640 1 --2- 172.21.15.5:0/2413030021 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ff8080663a0 0x7ff808068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:04.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.974+0000 7ff82659c640 1 --2- 172.21.15.5:0/2413030021 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ff8080663a0 0x7ff808068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff818000f70 tx=0x7ff818009040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:04.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:03.974+0000 7ff81effd640 1 -- 172.21.15.5:0/2413030021 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff8100ebac0 con 0x7ff828070f30 2023-07-14T13:06:04.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.162+0000 7ff82cb96640 1 -- 172.21.15.5:0/2413030021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff8280cb940 con 0x7ff828070f30 2023-07-14T13:06:04.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.790+0000 7ff81effd640 1 -- 172.21.15.5:0/2413030021 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff8280cb940 con 0x7ff828070f30 2023-07-14T13:06:04.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.790+0000 7ff82cb96640 1 -- 172.21.15.5:0/2413030021 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ff8080663a0 msgr2=0x7ff808068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:04.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.790+0000 7ff82cb96640 1 --2- 172.21.15.5:0/2413030021 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ff8080663a0 0x7ff808068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff818000f70 tx=0x7ff818009040 comp rx=0 tx=0).stop 2023-07-14T13:06:04.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.790+0000 7ff82cb96640 1 -- 172.21.15.5:0/2413030021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff828070f30 msgr2=0x7ff82806bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:04.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.790+0000 7ff82cb96640 1 --2- 172.21.15.5:0/2413030021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff828070f30 0x7ff82806bae0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff81001abf0 tx=0x7ff81001ad80 comp rx=0 tx=0).stop 2023-07-14T13:06:04.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.790+0000 7ff82cb96640 1 -- 172.21.15.5:0/2413030021 shutdown_connections 2023-07-14T13:06:04.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.790+0000 7ff82cb96640 1 --2- 172.21.15.5:0/2413030021 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ff8080663a0 0x7ff808068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:04.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.790+0000 7ff82cb96640 1 --2- 172.21.15.5:0/2413030021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8280af2b0 0x7ff82806c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:04.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.790+0000 7ff82cb96640 1 --2- 172.21.15.5:0/2413030021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff828070f30 0x7ff82806bae0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:04.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.790+0000 7ff82cb96640 1 --2- 172.21.15.5:0/2413030021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff828069430 0x7ff8281489c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:04.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.790+0000 7ff82cb96640 1 -- 172.21.15.5:0/2413030021 >> 172.21.15.5:0/2413030021 conn(0x7ff8280cde90 msgr2=0x7ff828156a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:04.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.794+0000 7ff82cb96640 1 -- 172.21.15.5:0/2413030021 shutdown_connections 2023-07-14T13:06:04.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.794+0000 7ff82cb96640 1 -- 172.21.15.5:0/2413030021 wait complete. 2023-07-14T13:06:04.846 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-14T13:06:04.846 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:06:04.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.962+0000 7f9fb2c9c640 1 Processor -- start 2023-07-14T13:06:04.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.962+0000 7f9fb2c9c640 1 -- start start 2023-07-14T13:06:04.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.962+0000 7f9fb2c9c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fac070b70 0x7f9fac070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:04.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.962+0000 7f9fb2c9c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9fac06b1e0 0x7f9fac0c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:04.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.962+0000 7f9fb2c9c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9fac0c21f0 0x7f9fac0cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.962+0000 7f9fb2c9c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fac0cac70 con 0x7f9fac06b1e0 2023-07-14T13:06:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.962+0000 7f9fb2c9c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fac071480 con 0x7f9fac0c21f0 2023-07-14T13:06:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.962+0000 7f9fb2c9c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac0ca060 con 0x7f9fac070b70 2023-07-14T13:06:04.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.962+0000 7f9fabfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9fac06b1e0 0x7f9fac0c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:04.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.962+0000 7f9fabfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9fac06b1e0 0x7f9fac0c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57390/0 (socket says 172.21.15.5:57390) 2023-07-14T13:06:04.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.962+0000 7f9fabfff640 1 -- 172.21.15.5:0/268416285 learned_addr learned my addr 172.21.15.5:0/268416285 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:04.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.966+0000 7f9fabfff640 1 -- 172.21.15.5:0/268416285 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fac070b70 msgr2=0x7f9fac070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:04.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.966+0000 7f9fabfff640 1 --2- 172.21.15.5:0/268416285 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fac070b70 0x7f9fac070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:04.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.966+0000 7f9fabfff640 1 -- 172.21.15.5:0/268416285 >> v2:172.21.15.154:3300/0 conn(0x7f9fac0c21f0 msgr2=0x7f9fac0cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:04.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.966+0000 7f9fabfff640 1 --2- 172.21.15.5:0/268416285 >> v2:172.21.15.154:3300/0 conn(0x7f9fac0c21f0 0x7f9fac0cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:04.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.966+0000 7f9fabfff640 1 -- 172.21.15.5:0/268416285 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac0ca340 con 0x7f9fac06b1e0 2023-07-14T13:06:05.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.966+0000 7f9fabfff640 1 --2- 172.21.15.5:0/268416285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fac06b1e0 0x7f9fac0c1cb0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9fac06a2c0 tx=0x7f9f9801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed264a072508f58 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.966+0000 7f9fab7fe640 1 -- 172.21.15.5:0/268416285 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f980ab640 con 0x7f9fac06b1e0 2023-07-14T13:06:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.966+0000 7f9fab7fe640 1 -- 172.21.15.5:0/268416285 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f980a7070 con 0x7f9fac06b1e0 2023-07-14T13:06:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.966+0000 7f9fab7fe640 1 -- 172.21.15.5:0/268416285 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f980ab9c0 con 0x7f9fac06b1e0 2023-07-14T13:06:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.966+0000 7f9fb2c9c640 1 -- 172.21.15.5:0/268416285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fac06b1e0 msgr2=0x7f9fac0c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:05.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.966+0000 7f9fb2c9c640 1 --2- 172.21.15.5:0/268416285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fac06b1e0 0x7f9fac0c1cb0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9fac06a2c0 tx=0x7f9f9801c460 comp rx=0 tx=0).stop 2023-07-14T13:06:05.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.966+0000 7f9fb2c9c640 1 -- 172.21.15.5:0/268416285 shutdown_connections 2023-07-14T13:06:05.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.966+0000 7f9fb2c9c640 1 --2- 172.21.15.5:0/268416285 >> v2:172.21.15.154:3300/0 conn(0x7f9fac0c21f0 0x7f9fac0cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.966+0000 7f9fb2c9c640 1 --2- 172.21.15.5:0/268416285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fac06b1e0 0x7f9fac0c1cb0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.966+0000 7f9fb2c9c640 1 --2- 172.21.15.5:0/268416285 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fac070b70 0x7f9fac070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.966+0000 7f9fb2c9c640 1 -- 172.21.15.5:0/268416285 >> 172.21.15.5:0/268416285 conn(0x7f9fac0afcf0 msgr2=0x7f9fac0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:05.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.966+0000 7f9fb2c9c640 1 -- 172.21.15.5:0/268416285 shutdown_connections 2023-07-14T13:06:05.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.970+0000 7f9fb2c9c640 1 -- 172.21.15.5:0/268416285 wait complete. 2023-07-14T13:06:05.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.970+0000 7f9fb2c9c640 1 Processor -- start 2023-07-14T13:06:05.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.970+0000 7f9fb2c9c640 1 -- start start 2023-07-14T13:06:05.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.970+0000 7f9fb2c9c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fac06b1e0 0x7f9fac0c3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:05.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.970+0000 7f9fb2c9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fac070b70 0x7f9fac0b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:05.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.970+0000 7f9fb2c9c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fac0c21f0 0x7f9fac14cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:05.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.970+0000 7f9fb2c9c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac0b1b60 con 0x7f9fac070b70 2023-07-14T13:06:05.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.970+0000 7f9fb2c9c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac0b1da0 con 0x7f9fac0c21f0 2023-07-14T13:06:05.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.970+0000 7f9fb2c9c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac1f86a0 con 0x7f9fac06b1e0 2023-07-14T13:06:05.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.970+0000 7f9fabfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fac070b70 0x7f9fac0b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:05.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.970+0000 7f9fabfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fac070b70 0x7f9fac0b1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57398/0 (socket says 172.21.15.5:57398) 2023-07-14T13:06:05.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.970+0000 7f9fabfff640 1 -- 172.21.15.5:0/380418478 learned_addr learned my addr 172.21.15.5:0/380418478 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:05.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.970+0000 7f9fb0a38640 1 --2- 172.21.15.5:0/380418478 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fac06b1e0 0x7f9fac0c3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:05.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.970+0000 7f9fb1239640 1 --2- 172.21.15.5:0/380418478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fac0c21f0 0x7f9fac14cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:05.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.970+0000 7f9fabfff640 1 -- 172.21.15.5:0/380418478 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fac06b1e0 msgr2=0x7f9fac0c3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:05.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.970+0000 7f9fabfff640 1 --2- 172.21.15.5:0/380418478 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fac06b1e0 0x7f9fac0c3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.970+0000 7f9fabfff640 1 -- 172.21.15.5:0/380418478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fac0c21f0 msgr2=0x7f9fac14cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:05.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.970+0000 7f9fabfff640 1 --2- 172.21.15.5:0/380418478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fac0c21f0 0x7f9fac14cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.970+0000 7f9fabfff640 1 -- 172.21.15.5:0/380418478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f980094d0 con 0x7f9fac070b70 2023-07-14T13:06:05.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.970+0000 7f9fb0a38640 1 --2- 172.21.15.5:0/380418478 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fac06b1e0 0x7f9fac0c3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:06:05.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.970+0000 7f9fabfff640 1 --2- 172.21.15.5:0/380418478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fac070b70 0x7f9fac0b1620 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9f9801ab10 tx=0x7f9f9801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:05.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.970+0000 7f9fa97fa640 1 -- 172.21.15.5:0/380418478 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f980be5f0 con 0x7f9fac070b70 2023-07-14T13:06:05.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.970+0000 7f9fa97fa640 1 -- 172.21.15.5:0/380418478 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f980be770 con 0x7f9fac070b70 2023-07-14T13:06:05.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.974+0000 7f9fa97fa640 1 -- 172.21.15.5:0/380418478 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f980beb20 con 0x7f9fac070b70 2023-07-14T13:06:05.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.974+0000 7f9fb2c9c640 1 -- 172.21.15.5:0/380418478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fac1f8b30 con 0x7f9fac070b70 2023-07-14T13:06:05.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.974+0000 7f9fb2c9c640 1 -- 172.21.15.5:0/380418478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fac1f8050 con 0x7f9fac070b70 2023-07-14T13:06:05.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.974+0000 7f9fb2c9c640 1 -- 172.21.15.5:0/380418478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fac1f8830 con 0x7f9fac070b70 2023-07-14T13:06:05.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.974+0000 7f9fa97fa640 1 -- 172.21.15.5:0/380418478 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9f980b43f0 con 0x7f9fac070b70 2023-07-14T13:06:05.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.974+0000 7f9fa97fa640 1 --2- 172.21.15.5:0/380418478 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f9f900663a0 0x7f9f90068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:05.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.974+0000 7f9fa97fa640 1 -- 172.21.15.5:0/380418478 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9f9811f200 con 0x7f9fac070b70 2023-07-14T13:06:05.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.974+0000 7f9fb0a38640 1 --2- 172.21.15.5:0/380418478 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f9f900663a0 0x7f9f90068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:05.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.974+0000 7f9fb0a38640 1 --2- 172.21.15.5:0/380418478 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f9f900663a0 0x7f9f90068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0006fd0 tx=0x7f9fa0008040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:05.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:04.978+0000 7f9fa97fa640 1 -- 172.21.15.5:0/380418478 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9f980ec570 con 0x7f9fac070b70 2023-07-14T13:06:05.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.170+0000 7f9fb2c9c640 1 -- 172.21.15.5:0/380418478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9fac0678d0 con 0x7f9fac070b70 2023-07-14T13:06:05.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.170+0000 7f9fa97fa640 1 -- 172.21.15.5:0/380418478 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4700 (secure 0 0 0) 0x7f9f980efb90 con 0x7f9fac070b70 2023-07-14T13:06:05.203 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:06:05.203 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5429,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/874132020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":874132020},{"type":"v1","addr":"172.21.15.154:6837","nonce":874132020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5911,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/217555499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":217555499},{"type":"v1","addr":"172.21.15.154:6835","nonce":217555499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6033,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3051331859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3051331859},{"type":"v1","addr":"172.21.15.5:6834","nonce":3051331859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:06:01.137621+0000","modified":"2023-07-14T13:06:04.782437+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6036":{"gid":6036,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/231396012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":231396012},{"type":"v1","addr":"172.21.15.5:6835","nonce":231396012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T13:06:05.204 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2023-07-14T13:06:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.174+0000 7f9fb2c9c640 1 -- 172.21.15.5:0/380418478 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f9f900663a0 msgr2=0x7f9f90068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.174+0000 7f9fb2c9c640 1 --2- 172.21.15.5:0/380418478 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f9f900663a0 0x7f9f90068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0006fd0 tx=0x7f9fa0008040 comp rx=0 tx=0).stop 2023-07-14T13:06:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.174+0000 7f9fb2c9c640 1 -- 172.21.15.5:0/380418478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fac070b70 msgr2=0x7f9fac0b1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.174+0000 7f9fb2c9c640 1 --2- 172.21.15.5:0/380418478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fac070b70 0x7f9fac0b1620 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9f9801ab10 tx=0x7f9f9801aca0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.174+0000 7f9fb2c9c640 1 -- 172.21.15.5:0/380418478 shutdown_connections 2023-07-14T13:06:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.174+0000 7f9fb2c9c640 1 --2- 172.21.15.5:0/380418478 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f9f900663a0 0x7f9f90068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.174+0000 7f9fb2c9c640 1 --2- 172.21.15.5:0/380418478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fac0c21f0 0x7f9fac14cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.174+0000 7f9fb2c9c640 1 --2- 172.21.15.5:0/380418478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fac070b70 0x7f9fac0b1620 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.174+0000 7f9fb2c9c640 1 --2- 172.21.15.5:0/380418478 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fac06b1e0 0x7f9fac0c3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.174+0000 7f9fb2c9c640 1 -- 172.21.15.5:0/380418478 >> 172.21.15.5:0/380418478 conn(0x7f9fac0afcf0 msgr2=0x7f9fac1524c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.174+0000 7f9fb2c9c640 1 -- 172.21.15.5:0/380418478 shutdown_connections 2023-07-14T13:06:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.174+0000 7f9fb2c9c640 1 -- 172.21.15.5:0/380418478 wait complete. 2023-07-14T13:06:05.224 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:06:05.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.338+0000 7f7c9dddb640 1 Processor -- start 2023-07-14T13:06:05.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.338+0000 7f7c9dddb640 1 -- start start 2023-07-14T13:06:05.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.338+0000 7f7c9dddb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7c9813ed20 0x7f7c9806a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:05.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.338+0000 7f7c9dddb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c9806de30 0x7f7c9806e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:05.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.338+0000 7f7c9dddb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7c9806bd20 0x7f7c9806c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:05.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.338+0000 7f7c9dddb640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9806a470 con 0x7f7c9806bd20 2023-07-14T13:06:05.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.338+0000 7f7c9dddb640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9806add0 con 0x7f7c9813ed20 2023-07-14T13:06:05.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.338+0000 7f7c9dddb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9806c6a0 con 0x7f7c9806de30 2023-07-14T13:06:05.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.342+0000 7f7c97fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7c9806bd20 0x7f7c9806c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:05.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.342+0000 7f7c97fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7c9806bd20 0x7f7c9806c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57406/0 (socket says 172.21.15.5:57406) 2023-07-14T13:06:05.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.342+0000 7f7c97fff640 1 -- 172.21.15.5:0/803460305 learned_addr learned my addr 172.21.15.5:0/803460305 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:05.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.342+0000 7f7c96ffd640 1 --2- 172.21.15.5:0/803460305 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c9806de30 0x7f7c9806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:05.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.342+0000 7f7c977fe640 1 --2- 172.21.15.5:0/803460305 >> v2:172.21.15.154:3300/0 conn(0x7f7c9813ed20 0x7f7c9806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:05.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.342+0000 7f7c97fff640 1 -- 172.21.15.5:0/803460305 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c9806de30 msgr2=0x7f7c9806e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:05.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.342+0000 7f7c97fff640 1 --2- 172.21.15.5:0/803460305 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c9806de30 0x7f7c9806e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.342+0000 7f7c97fff640 1 -- 172.21.15.5:0/803460305 >> v2:172.21.15.154:3300/0 conn(0x7f7c9813ed20 msgr2=0x7f7c9806a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:05.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.342+0000 7f7c97fff640 1 --2- 172.21.15.5:0/803460305 >> v2:172.21.15.154:3300/0 conn(0x7f7c9813ed20 0x7f7c9806a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.342+0000 7f7c97fff640 1 -- 172.21.15.5:0/803460305 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c980697f0 con 0x7f7c9806bd20 2023-07-14T13:06:05.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.342+0000 7f7c97fff640 1 --2- 172.21.15.5:0/803460305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c9806bd20 0x7f7c9806c160 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f7c98070fe0 tx=0x7f7c9001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de2d511f69a8ffb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:05.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.342+0000 7f7c967fc640 1 -- 172.21.15.5:0/803460305 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c900a57c0 con 0x7f7c9806bd20 2023-07-14T13:06:05.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.342+0000 7f7c967fc640 1 -- 172.21.15.5:0/803460305 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c900a5920 con 0x7f7c9806bd20 2023-07-14T13:06:05.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.342+0000 7f7c967fc640 1 -- 172.21.15.5:0/803460305 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c900a5cb0 con 0x7f7c9806bd20 2023-07-14T13:06:05.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.346+0000 7f7c9dddb640 1 -- 172.21.15.5:0/803460305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c9806bd20 msgr2=0x7f7c9806c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:05.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.346+0000 7f7c9dddb640 1 --2- 172.21.15.5:0/803460305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c9806bd20 0x7f7c9806c160 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f7c98070fe0 tx=0x7f7c9001c940 comp rx=0 tx=0).stop 2023-07-14T13:06:05.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.346+0000 7f7c9dddb640 1 -- 172.21.15.5:0/803460305 shutdown_connections 2023-07-14T13:06:05.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.346+0000 7f7c9dddb640 1 --2- 172.21.15.5:0/803460305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c9806bd20 0x7f7c9806c160 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.346+0000 7f7c9dddb640 1 --2- 172.21.15.5:0/803460305 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c9806de30 0x7f7c9806e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.346+0000 7f7c9dddb640 1 --2- 172.21.15.5:0/803460305 >> v2:172.21.15.154:3300/0 conn(0x7f7c9813ed20 0x7f7c9806a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.346+0000 7f7c9dddb640 1 -- 172.21.15.5:0/803460305 >> 172.21.15.5:0/803460305 conn(0x7f7c980b1300 msgr2=0x7f7c980ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:05.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.346+0000 7f7c9dddb640 1 -- 172.21.15.5:0/803460305 shutdown_connections 2023-07-14T13:06:05.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.346+0000 7f7c9dddb640 1 -- 172.21.15.5:0/803460305 wait complete. 2023-07-14T13:06:05.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.346+0000 7f7c9dddb640 1 Processor -- start 2023-07-14T13:06:05.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.346+0000 7f7c9dddb640 1 -- start start 2023-07-14T13:06:05.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.346+0000 7f7c9dddb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c9806bd20 0x7f7c980ad590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:05.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.346+0000 7f7c9dddb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9806de30 0x7f7c98135a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:05.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.346+0000 7f7c9dddb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c9813ed20 0x7f7c980ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:05.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.346+0000 7f7c9dddb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c981372a0 con 0x7f7c9813ed20 2023-07-14T13:06:05.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.346+0000 7f7c9dddb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9813e310 con 0x7f7c9806de30 2023-07-14T13:06:05.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.346+0000 7f7c9dddb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9813adc0 con 0x7f7c9806bd20 2023-07-14T13:06:05.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.346+0000 7f7c97fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c9813ed20 0x7f7c980ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:05.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.346+0000 7f7c97fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c9813ed20 0x7f7c980ab890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57414/0 (socket says 172.21.15.5:57414) 2023-07-14T13:06:05.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.346+0000 7f7c97fff640 1 -- 172.21.15.5:0/2403536774 learned_addr learned my addr 172.21.15.5:0/2403536774 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:05.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.346+0000 7f7c977fe640 1 --2- 172.21.15.5:0/2403536774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c9806bd20 0x7f7c980ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:05.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.346+0000 7f7c96ffd640 1 --2- 172.21.15.5:0/2403536774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9806de30 0x7f7c98135a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:05.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.350+0000 7f7c97fff640 1 -- 172.21.15.5:0/2403536774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c9806bd20 msgr2=0x7f7c980ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:05.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.350+0000 7f7c97fff640 1 --2- 172.21.15.5:0/2403536774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c9806bd20 0x7f7c980ad590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.350+0000 7f7c97fff640 1 -- 172.21.15.5:0/2403536774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9806de30 msgr2=0x7f7c98135a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:05.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.350+0000 7f7c97fff640 1 --2- 172.21.15.5:0/2403536774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9806de30 0x7f7c98135a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.350+0000 7f7c97fff640 1 -- 172.21.15.5:0/2403536774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c90009b30 con 0x7f7c9813ed20 2023-07-14T13:06:05.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.350+0000 7f7c96ffd640 1 --2- 172.21.15.5:0/2403536774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9806de30 0x7f7c98135a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:06:05.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.350+0000 7f7c97fff640 1 --2- 172.21.15.5:0/2403536774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c9813ed20 0x7f7c980ab890 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7c900af040 tx=0x7f7c900196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:05.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.350+0000 7f7c7ffff640 1 -- 172.21.15.5:0/2403536774 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c900b8670 con 0x7f7c9813ed20 2023-07-14T13:06:05.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.350+0000 7f7c7ffff640 1 -- 172.21.15.5:0/2403536774 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c900b87f0 con 0x7f7c9813ed20 2023-07-14T13:06:05.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.350+0000 7f7c7ffff640 1 -- 172.21.15.5:0/2403536774 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c900b8ba0 con 0x7f7c9813ed20 2023-07-14T13:06:05.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.350+0000 7f7c9dddb640 1 -- 172.21.15.5:0/2403536774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c9813a800 con 0x7f7c9813ed20 2023-07-14T13:06:05.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.350+0000 7f7c9dddb640 1 -- 172.21.15.5:0/2403536774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c9813ce20 con 0x7f7c9813ed20 2023-07-14T13:06:05.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.350+0000 7f7c9dddb640 1 -- 172.21.15.5:0/2403536774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9813d010 con 0x7f7c9813ed20 2023-07-14T13:06:05.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.350+0000 7f7c7ffff640 1 -- 172.21.15.5:0/2403536774 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7c900b8d00 con 0x7f7c9813ed20 2023-07-14T13:06:05.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.350+0000 7f7c7ffff640 1 --2- 172.21.15.5:0/2403536774 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f7c840663d0 0x7f7c84068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:05.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.350+0000 7f7c7ffff640 1 -- 172.21.15.5:0/2403536774 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7c9011f310 con 0x7f7c9813ed20 2023-07-14T13:06:05.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.354+0000 7f7c977fe640 1 --2- 172.21.15.5:0/2403536774 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f7c840663d0 0x7f7c84068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:05.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.354+0000 7f7c977fe640 1 --2- 172.21.15.5:0/2403536774 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f7c840663d0 0x7f7c84068880 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009a50 tx=0x7f7c88008040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:05.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.354+0000 7f7c7ffff640 1 -- 172.21.15.5:0/2403536774 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7c900ec560 con 0x7f7c9813ed20 2023-07-14T13:06:05.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.514+0000 7f7c9dddb640 1 -- 172.21.15.5:0/2403536774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c980678d0 con 0x7f7c9813ed20 2023-07-14T13:06:05.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.514+0000 7f7c7ffff640 1 -- 172.21.15.5:0/2403536774 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+18303 (secure 0 0 0) 0x7f7c90009510 con 0x7f7c9813ed20 2023-07-14T13:06:05.546 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:06:05.546 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":65,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:06:02.753257+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:05:59.255634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-14T13:06:00.136409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:06:05.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.514+0000 7f7c9dddb640 1 -- 172.21.15.5:0/2403536774 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f7c840663d0 msgr2=0x7f7c84068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:05.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.514+0000 7f7c9dddb640 1 --2- 172.21.15.5:0/2403536774 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f7c840663d0 0x7f7c84068880 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009a50 tx=0x7f7c88008040 comp rx=0 tx=0).stop 2023-07-14T13:06:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.514+0000 7f7c9dddb640 1 -- 172.21.15.5:0/2403536774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c9813ed20 msgr2=0x7f7c980ab890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.514+0000 7f7c9dddb640 1 --2- 172.21.15.5:0/2403536774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c9813ed20 0x7f7c980ab890 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7c900af040 tx=0x7f7c900196e0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.514+0000 7f7c9dddb640 1 -- 172.21.15.5:0/2403536774 shutdown_connections 2023-07-14T13:06:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.514+0000 7f7c9dddb640 1 --2- 172.21.15.5:0/2403536774 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f7c840663d0 0x7f7c84068880 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.514+0000 7f7c9dddb640 1 --2- 172.21.15.5:0/2403536774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c9813ed20 0x7f7c980ab890 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.514+0000 7f7c9dddb640 1 --2- 172.21.15.5:0/2403536774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9806de30 0x7f7c98135a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.514+0000 7f7c9dddb640 1 --2- 172.21.15.5:0/2403536774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c9806bd20 0x7f7c980ad590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.514+0000 7f7c9dddb640 1 -- 172.21.15.5:0/2403536774 >> 172.21.15.5:0/2403536774 conn(0x7f7c980b1300 msgr2=0x7f7c98137c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:05.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.518+0000 7f7c9dddb640 1 -- 172.21.15.5:0/2403536774 shutdown_connections 2023-07-14T13:06:05.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.518+0000 7f7c9dddb640 1 -- 172.21.15.5:0/2403536774 wait complete. 2023-07-14T13:06:05.567 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-14T13:06:05.568 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:06:05.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb5560b640 1 Processor -- start 2023-07-14T13:06:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb5560b640 1 -- start start 2023-07-14T13:06:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb5560b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffb500d06b0 0x7ffb500b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:05.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb5560b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb500b1f70 0x7ffb500d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:05.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb5560b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb500b2410 con 0x7ffb50145430 2023-07-14T13:06:05.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb5560b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb500b26f0 con 0x7ffb500d06b0 2023-07-14T13:06:05.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb5560b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb500b29d0 con 0x7ffb500b1f70 2023-07-14T13:06:05.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb47fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ffb50145430 0x7ffb500b34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48338/0 (socket says 172.21.15.5:48338) 2023-07-14T13:06:05.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb47fff640 1 -- 172.21.15.5:0/1173848410 learned_addr learned my addr 172.21.15.5:0/1173848410 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:06:05.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb4f7fe640 1 --2- 172.21.15.5:0/1173848410 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb500b1f70 0x7ffb500d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:05.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb4e7fc640 1 -- 172.21.15.5:0/1173848410 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 97587733 0 0) 0x7ffb500b2410 con 0x7ffb50145430 2023-07-14T13:06:05.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb4effd640 1 --2- 172.21.15.5:0/1173848410 >> v2:172.21.15.154:3300/0 conn(0x7ffb500d06b0 0x7ffb500b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:05.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb4e7fc640 1 -- 172.21.15.5:0/1173848410 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb3c003530 con 0x7ffb50145430 2023-07-14T13:06:05.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb4e7fc640 1 -- 172.21.15.5:0/1173848410 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1571494303 0 0) 0x7ffb3c003530 con 0x7ffb50145430 2023-07-14T13:06:05.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb4e7fc640 1 -- 172.21.15.5:0/1173848410 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb500b1f70 msgr2=0x7ffb500d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:05.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb4e7fc640 1 --2- 172.21.15.5:0/1173848410 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb500b1f70 0x7ffb500d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb4e7fc640 1 -- 172.21.15.5:0/1173848410 >> v2:172.21.15.154:3300/0 conn(0x7ffb500d06b0 msgr2=0x7ffb500b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:05.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb4e7fc640 1 --2- 172.21.15.5:0/1173848410 >> v2:172.21.15.154:3300/0 conn(0x7ffb500d06b0 0x7ffb500b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb4e7fc640 1 -- 172.21.15.5:0/1173848410 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb500b2cb0 con 0x7ffb50145430 2023-07-14T13:06:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb4e7fc640 1 -- 172.21.15.5:0/1173848410 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7ffb38001680 con 0x7ffb50145430 2023-07-14T13:06:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb4e7fc640 1 -- 172.21.15.5:0/1173848410 >> v1:172.21.15.5:6789/0 conn(0x7ffb50145430 legacy=0x7ffb500b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb4e7fc640 1 --2- 172.21.15.5:0/1173848410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb3c003980 0x7ffb3c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb4e7fc640 1 --2- 172.21.15.5:0/1173848410 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb500b1f70 0x7ffb3c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb4e7fc640 1 --2- 172.21.15.5:0/1173848410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb3c004d10 0x7ffb3c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb4e7fc640 1 -- 172.21.15.5:0/1173848410 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb500b26f0 con 0x7ffb3c003980 2023-07-14T13:06:05.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb4e7fc640 1 -- 172.21.15.5:0/1173848410 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb500b29d0 con 0x7ffb3c004d10 2023-07-14T13:06:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb4e7fc640 1 -- 172.21.15.5:0/1173848410 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3c00b990 con 0x7ffb500b1f70 2023-07-14T13:06:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.682+0000 7ffb4effd640 1 --2- 172.21.15.5:0/1173848410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb3c003980 0x7ffb3c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.686+0000 7ffb47fff640 1 --2- 172.21.15.5:0/1173848410 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb500b1f70 0x7ffb3c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.686+0000 7ffb4f7fe640 1 --2- 172.21.15.5:0/1173848410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb3c004d10 0x7ffb3c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.686+0000 7ffb4effd640 1 -- 172.21.15.5:0/1173848410 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb500b1f70 msgr2=0x7ffb3c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.686+0000 7ffb4effd640 1 --2- 172.21.15.5:0/1173848410 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb500b1f70 0x7ffb3c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.686+0000 7ffb4effd640 1 -- 172.21.15.5:0/1173848410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb3c004d10 msgr2=0x7ffb3c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:05.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.686+0000 7ffb4effd640 1 --2- 172.21.15.5:0/1173848410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb3c004d10 0x7ffb3c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.686+0000 7ffb4effd640 1 -- 172.21.15.5:0/1173848410 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3c003530 con 0x7ffb3c003980 2023-07-14T13:06:05.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.686+0000 7ffb47fff640 1 --2- 172.21.15.5:0/1173848410 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb500b1f70 0x7ffb3c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:06:05.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.686+0000 7ffb4effd640 1 --2- 172.21.15.5:0/1173848410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb3c003980 0x7ffb3c003d90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ffb40009ae0 tx=0x7ffb4001d4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366da4dcd70f7a03 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:05.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.686+0000 7ffb4e7fc640 1 -- 172.21.15.5:0/1173848410 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb400a5650 con 0x7ffb3c003980 2023-07-14T13:06:05.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.686+0000 7ffb4e7fc640 1 -- 172.21.15.5:0/1173848410 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb400a57b0 con 0x7ffb3c003980 2023-07-14T13:06:05.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.686+0000 7ffb4e7fc640 1 -- 172.21.15.5:0/1173848410 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb400a5b60 con 0x7ffb3c003980 2023-07-14T13:06:05.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.686+0000 7ffb5560b640 1 -- 172.21.15.5:0/1173848410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb3c003980 msgr2=0x7ffb3c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:05.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.686+0000 7ffb5560b640 1 --2- 172.21.15.5:0/1173848410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb3c003980 0x7ffb3c003d90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ffb40009ae0 tx=0x7ffb4001d4c0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.686+0000 7ffb4f7fe640 1 -- 172.21.15.5:0/1173848410 reap_dead start 2023-07-14T13:06:05.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb5560b640 1 -- 172.21.15.5:0/1173848410 shutdown_connections 2023-07-14T13:06:05.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb5560b640 1 -- 172.21.15.5:0/1173848410 >> 172.21.15.5:0/1173848410 conn(0x7ffb500659d0 msgr2=0x7ffb5009b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:05.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb5560b640 1 -- 172.21.15.5:0/1173848410 shutdown_connections 2023-07-14T13:06:05.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb5560b640 1 -- 172.21.15.5:0/1173848410 wait complete. 2023-07-14T13:06:05.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb5560b640 1 Processor -- start 2023-07-14T13:06:05.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb5560b640 1 -- start start 2023-07-14T13:06:05.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb5560b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb3c003980 0x7ffb501f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:05.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb5560b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb500cbf70 0x7ffb501571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:05.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb5560b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb500ca2d0 0x7ffb500ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:05.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb5560b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb500cc6e0 con 0x7ffb500cbf70 2023-07-14T13:06:05.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb5560b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb500c9550 con 0x7ffb3c003980 2023-07-14T13:06:05.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb5560b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb500c97f0 con 0x7ffb500ca2d0 2023-07-14T13:06:05.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb47fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb500cbf70 0x7ffb501571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:05.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb47fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb500cbf70 0x7ffb501571b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57434/0 (socket says 172.21.15.5:57434) 2023-07-14T13:06:05.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb47fff640 1 -- 172.21.15.5:0/2877121136 learned_addr learned my addr 172.21.15.5:0/2877121136 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:05.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb4effd640 1 --2- 172.21.15.5:0/2877121136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb3c003980 0x7ffb501f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:05.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb4f7fe640 1 --2- 172.21.15.5:0/2877121136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb500ca2d0 0x7ffb500ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:05.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb47fff640 1 -- 172.21.15.5:0/2877121136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb500ca2d0 msgr2=0x7ffb500ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:05.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb47fff640 1 --2- 172.21.15.5:0/2877121136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb500ca2d0 0x7ffb500ca740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb47fff640 1 -- 172.21.15.5:0/2877121136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb3c003980 msgr2=0x7ffb501f7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:05.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb47fff640 1 --2- 172.21.15.5:0/2877121136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb3c003980 0x7ffb501f7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb47fff640 1 -- 172.21.15.5:0/2877121136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb500c9ad0 con 0x7ffb500cbf70 2023-07-14T13:06:05.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb4effd640 1 --2- 172.21.15.5:0/2877121136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb3c003980 0x7ffb501f7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:06:05.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb4f7fe640 1 --2- 172.21.15.5:0/2877121136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb500ca2d0 0x7ffb500ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:06:05.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb47fff640 1 --2- 172.21.15.5:0/2877121136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb500cbf70 0x7ffb501571b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ffb3800e7d0 tx=0x7ffb3800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:05.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb477fe640 1 -- 172.21.15.5:0/2877121136 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3800eee0 con 0x7ffb500cbf70 2023-07-14T13:06:05.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb477fe640 1 -- 172.21.15.5:0/2877121136 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3800c8d0 con 0x7ffb500cbf70 2023-07-14T13:06:05.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb477fe640 1 -- 172.21.15.5:0/2877121136 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3800cc40 con 0x7ffb500cbf70 2023-07-14T13:06:05.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.690+0000 7ffb5560b640 1 -- 172.21.15.5:0/2877121136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb500c9db0 con 0x7ffb500cbf70 2023-07-14T13:06:05.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.694+0000 7ffb5560b640 1 -- 172.21.15.5:0/2877121136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb501576f0 con 0x7ffb500cbf70 2023-07-14T13:06:05.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.694+0000 7ffb5560b640 1 -- 172.21.15.5:0/2877121136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb500678d0 con 0x7ffb500cbf70 2023-07-14T13:06:05.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.694+0000 7ffb477fe640 1 -- 172.21.15.5:0/2877121136 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ffb3801d460 con 0x7ffb500cbf70 2023-07-14T13:06:05.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.694+0000 7ffb477fe640 1 --2- 172.21.15.5:0/2877121136 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ffb300663a0 0x7ffb30068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:05.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.694+0000 7ffb477fe640 1 -- 172.21.15.5:0/2877121136 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffb38083e70 con 0x7ffb500cbf70 2023-07-14T13:06:05.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.694+0000 7ffb4effd640 1 --2- 172.21.15.5:0/2877121136 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ffb300663a0 0x7ffb30068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:05.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.698+0000 7ffb4effd640 1 --2- 172.21.15.5:0/2877121136 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ffb300663a0 0x7ffb30068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffb400af000 tx=0x7ffb400a7040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:05.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.698+0000 7ffb477fe640 1 -- 172.21.15.5:0/2877121136 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ffb38054d00 con 0x7ffb500cbf70 2023-07-14T13:06:05.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.854+0000 7ffb5560b640 1 -- 172.21.15.5:0/2877121136 --> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffb500d0a80 con 0x7ffb300663a0 2023-07-14T13:06:05.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.866+0000 7ffb477fe640 1 -- 172.21.15.5:0/2877121136 <== mgr.5695 v2:172.21.15.154:6832/1810553301 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305582 (secure 0 0 0) 0x7ffb400a5920 con 0x7ffb300663a0 2023-07-14T13:06:05.899 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:06:05.901 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:06:05.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.870+0000 7ffb5560b640 1 -- 172.21.15.5:0/2877121136 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ffb300663a0 msgr2=0x7ffb30068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:05.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.870+0000 7ffb5560b640 1 --2- 172.21.15.5:0/2877121136 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ffb300663a0 0x7ffb30068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffb400af000 tx=0x7ffb400a7040 comp rx=0 tx=0).stop 2023-07-14T13:06:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.870+0000 7ffb5560b640 1 -- 172.21.15.5:0/2877121136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb500cbf70 msgr2=0x7ffb501571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.870+0000 7ffb5560b640 1 --2- 172.21.15.5:0/2877121136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb500cbf70 0x7ffb501571b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ffb3800e7d0 tx=0x7ffb3800ec90 comp rx=0 tx=0).stop 2023-07-14T13:06:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.870+0000 7ffb5560b640 1 -- 172.21.15.5:0/2877121136 shutdown_connections 2023-07-14T13:06:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.870+0000 7ffb5560b640 1 --2- 172.21.15.5:0/2877121136 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ffb300663a0 0x7ffb30068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.870+0000 7ffb5560b640 1 --2- 172.21.15.5:0/2877121136 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb500ca2d0 0x7ffb500ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.870+0000 7ffb5560b640 1 --2- 172.21.15.5:0/2877121136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb500cbf70 0x7ffb501571b0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.870+0000 7ffb5560b640 1 --2- 172.21.15.5:0/2877121136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb3c003980 0x7ffb501f7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:05.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.870+0000 7ffb5560b640 1 -- 172.21.15.5:0/2877121136 >> 172.21.15.5:0/2877121136 conn(0x7ffb500659d0 msgr2=0x7ffb5006b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:05.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.870+0000 7ffb5560b640 1 -- 172.21.15.5:0/2877121136 shutdown_connections 2023-07-14T13:06:05.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:05.870+0000 7ffb5560b640 1 -- 172.21.15.5:0/2877121136 wait complete. 2023-07-14T13:06:05.920 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-14T13:06:05.544750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":307848,"kb_used_data":6984,"kb_used_omap":0,"kb_used_meta":300800,"kb_avail":754666872,"statfs":{"total":773094113280,"available":772778876928,"internally_reserved":0,"allocated":7151616,"data_stored":4102306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308019200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.807432"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.748761+0000","last_change":"2023-07-14T13:06:00.748761+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.748761+0000","last_undegraded":"2023-07-14T13:06:00.748761+0000","last_fullsized":"2023-07-14T13:06:00.748761+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.754379+0000","last_change":"2023-07-14T13:06:00.754379+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.754379+0000","last_undegraded":"2023-07-14T13:06:00.754379+0000","last_fullsized":"2023-07-14T13:06:00.754379+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.747815+0000","last_change":"2023-07-14T13:06:00.747815+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.747815+0000","last_undegraded":"2023-07-14T13:06:00.747815+0000","last_fullsized":"2023-07-14T13:06:00.747815+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.753107+0000","last_change":"2023-07-14T13:06:00.753107+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.753107+0000","last_undegraded":"2023-07-14T13:06:00.753107+0000","last_fullsized":"2023-07-14T13:06:00.753107+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751429+0000","last_change":"2023-07-14T13:06:00.751429+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751429+0000","last_undegraded":"2023-07-14T13:06:00.751429+0000","last_fullsized":"2023-07-14T13:06:00.751429+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.744387+0000","last_change":"2023-07-14T13:06:00.744387+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.744387+0000","last_undegraded":"2023-07-14T13:06:00.744387+0000","last_fullsized":"2023-07-14T13:06:00.744387+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.744820+0000","last_change":"2023-07-14T13:06:00.744820+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.744820+0000","last_undegraded":"2023-07-14T13:06:00.744820+0000","last_fullsized":"2023-07-14T13:06:00.744820+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.744099+0000","last_change":"2023-07-14T13:06:00.744099+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.744099+0000","last_undegraded":"2023-07-14T13:06:00.744099+0000","last_fullsized":"2023-07-14T13:06:00.744099+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743374+0000","last_change":"2023-07-14T13:06:00.743374+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743374+0000","last_undegraded":"2023-07-14T13:06:00.743374+0000","last_fullsized":"2023-07-14T13:06:00.743374+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.748675+0000","last_change":"2023-07-14T13:06:00.748675+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.748675+0000","last_undegraded":"2023-07-14T13:06:00.748675+0000","last_fullsized":"2023-07-14T13:06:00.748675+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.744940+0000","last_change":"2023-07-14T13:06:00.744940+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.744940+0000","last_undegraded":"2023-07-14T13:06:00.744940+0000","last_fullsized":"2023-07-14T13:06:00.744940+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743067+0000","last_change":"2023-07-14T13:06:00.743067+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743067+0000","last_undegraded":"2023-07-14T13:06:00.743067+0000","last_fullsized":"2023-07-14T13:06:00.743067+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.752149+0000","last_change":"2023-07-14T13:06:00.752149+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.752149+0000","last_undegraded":"2023-07-14T13:06:00.752149+0000","last_fullsized":"2023-07-14T13:06:00.752149+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.748588+0000","last_change":"2023-07-14T13:06:00.748588+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.748588+0000","last_undegraded":"2023-07-14T13:06:00.748588+0000","last_fullsized":"2023-07-14T13:06:00.748588+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.755332+0000","last_change":"2023-07-14T13:06:00.755332+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.755332+0000","last_undegraded":"2023-07-14T13:06:00.755332+0000","last_fullsized":"2023-07-14T13:06:00.755332+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750787+0000","last_change":"2023-07-14T13:06:00.750787+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750787+0000","last_undegraded":"2023-07-14T13:06:00.750787+0000","last_fullsized":"2023-07-14T13:06:00.750787+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.746739+0000","last_change":"2023-07-14T13:06:00.746739+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.746739+0000","last_undegraded":"2023-07-14T13:06:00.746739+0000","last_fullsized":"2023-07-14T13:06:00.746739+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.749397+0000","last_change":"2023-07-14T13:06:00.749397+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.749397+0000","last_undegraded":"2023-07-14T13:06:00.749397+0000","last_fullsized":"2023-07-14T13:06:00.749397+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.747489+0000","last_change":"2023-07-14T13:06:00.747489+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.747489+0000","last_undegraded":"2023-07-14T13:06:00.747489+0000","last_fullsized":"2023-07-14T13:06:00.747489+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.746486+0000","last_change":"2023-07-14T13:06:00.746486+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.746486+0000","last_undegraded":"2023-07-14T13:06:00.746486+0000","last_fullsized":"2023-07-14T13:06:00.746486+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.745688+0000","last_change":"2023-07-14T13:06:00.745688+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.745688+0000","last_undegraded":"2023-07-14T13:06:00.745688+0000","last_fullsized":"2023-07-14T13:06:00.745688+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743004+0000","last_change":"2023-07-14T13:06:00.743004+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743004+0000","last_undegraded":"2023-07-14T13:06:00.743004+0000","last_fullsized":"2023-07-14T13:06:00.743004+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.745492+0000","last_change":"2023-07-14T13:06:00.745492+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.745492+0000","last_undegraded":"2023-07-14T13:06:00.745492+0000","last_fullsized":"2023-07-14T13:06:00.745492+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.742309+0000","last_change":"2023-07-14T13:06:00.742309+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.742309+0000","last_undegraded":"2023-07-14T13:06:00.742309+0000","last_fullsized":"2023-07-14T13:06:00.742309+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743183+0000","last_change":"2023-07-14T13:06:00.743183+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743183+0000","last_undegraded":"2023-07-14T13:06:00.743183+0000","last_fullsized":"2023-07-14T13:06:00.743183+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.748463+0000","last_change":"2023-07-14T13:06:00.748463+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.748463+0000","last_undegraded":"2023-07-14T13:06:00.748463+0000","last_fullsized":"2023-07-14T13:06:00.748463+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743994+0000","last_change":"2023-07-14T13:06:00.743994+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743994+0000","last_undegraded":"2023-07-14T13:06:00.743994+0000","last_fullsized":"2023-07-14T13:06:00.743994+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.745322+0000","last_change":"2023-07-14T13:06:00.745322+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.745322+0000","last_undegraded":"2023-07-14T13:06:00.745322+0000","last_fullsized":"2023-07-14T13:06:00.745322+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743892+0000","last_change":"2023-07-14T13:06:00.743892+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743892+0000","last_undegraded":"2023-07-14T13:06:00.743892+0000","last_fullsized":"2023-07-14T13:06:00.743892+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750152+0000","last_change":"2023-07-14T13:06:00.750152+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750152+0000","last_undegraded":"2023-07-14T13:06:00.750152+0000","last_fullsized":"2023-07-14T13:06:00.750152+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743608+0000","last_change":"2023-07-14T13:06:00.743608+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743608+0000","last_undegraded":"2023-07-14T13:06:00.743608+0000","last_fullsized":"2023-07-14T13:06:00.743608+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751944+0000","last_change":"2023-07-14T13:06:00.751944+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751944+0000","last_undegraded":"2023-07-14T13:06:00.751944+0000","last_fullsized":"2023-07-14T13:06:00.751944+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.755014+0000","last_change":"2023-07-14T13:06:00.755014+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.755014+0000","last_undegraded":"2023-07-14T13:06:00.755014+0000","last_fullsized":"2023-07-14T13:06:00.755014+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.761559+0000","last_change":"2023-07-14T13:06:00.756132+0000","last_active":"2023-07-14T13:06:00.761559+0000","last_peered":"2023-07-14T13:06:00.761559+0000","last_clean":"2023-07-14T13:06:00.761559+0000","last_became_active":"2023-07-14T13:06:00.755507+0000","last_became_peered":"2023-07-14T13:06:00.755507+0000","last_unstale":"2023-07-14T13:06:00.761559+0000","last_undegraded":"2023-07-14T13:06:00.761559+0000","last_fullsized":"2023-07-14T13:06:00.761559+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:44:35.427825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750889+0000","last_change":"2023-07-14T13:06:00.750889+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750889+0000","last_undegraded":"2023-07-14T13:06:00.750889+0000","last_fullsized":"2023-07-14T13:06:00.750889+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765663+0000","last_change":"2023-07-14T13:06:00.761498+0000","last_active":"2023-07-14T13:06:00.765663+0000","last_peered":"2023-07-14T13:06:00.765663+0000","last_clean":"2023-07-14T13:06:00.765663+0000","last_became_active":"2023-07-14T13:06:00.761218+0000","last_became_peered":"2023-07-14T13:06:00.761218+0000","last_unstale":"2023-07-14T13:06:00.765663+0000","last_undegraded":"2023-07-14T13:06:00.765663+0000","last_fullsized":"2023-07-14T13:06:00.765663+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:04:43.245058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.745320+0000","last_change":"2023-07-14T13:06:00.745320+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.745320+0000","last_undegraded":"2023-07-14T13:06:00.745320+0000","last_fullsized":"2023-07-14T13:06:00.745320+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.761184+0000","last_change":"2023-07-14T13:06:00.754529+0000","last_active":"2023-07-14T13:06:00.761184+0000","last_peered":"2023-07-14T13:06:00.761184+0000","last_clean":"2023-07-14T13:06:00.761184+0000","last_became_active":"2023-07-14T13:06:00.754227+0000","last_became_peered":"2023-07-14T13:06:00.754227+0000","last_unstale":"2023-07-14T13:06:00.761184+0000","last_undegraded":"2023-07-14T13:06:00.761184+0000","last_fullsized":"2023-07-14T13:06:00.761184+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:28.800346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.746995+0000","last_change":"2023-07-14T13:06:00.746995+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.746995+0000","last_undegraded":"2023-07-14T13:06:00.746995+0000","last_fullsized":"2023-07-14T13:06:00.746995+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765149+0000","last_change":"2023-07-14T13:06:00.763143+0000","last_active":"2023-07-14T13:06:00.765149+0000","last_peered":"2023-07-14T13:06:00.765149+0000","last_clean":"2023-07-14T13:06:00.765149+0000","last_became_active":"2023-07-14T13:06:00.762841+0000","last_became_peered":"2023-07-14T13:06:00.762841+0000","last_unstale":"2023-07-14T13:06:00.765149+0000","last_undegraded":"2023-07-14T13:06:00.765149+0000","last_fullsized":"2023-07-14T13:06:00.765149+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:05:53.281408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750581+0000","last_change":"2023-07-14T13:06:00.750581+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750581+0000","last_undegraded":"2023-07-14T13:06:00.750581+0000","last_fullsized":"2023-07-14T13:06:00.750581+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.761705+0000","last_change":"2023-07-14T13:06:00.756771+0000","last_active":"2023-07-14T13:06:00.761705+0000","last_peered":"2023-07-14T13:06:00.761705+0000","last_clean":"2023-07-14T13:06:00.761705+0000","last_became_active":"2023-07-14T13:06:00.756496+0000","last_became_peered":"2023-07-14T13:06:00.756496+0000","last_unstale":"2023-07-14T13:06:00.761705+0000","last_undegraded":"2023-07-14T13:06:00.761705+0000","last_fullsized":"2023-07-14T13:06:00.761705+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:12:25.869710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.749693+0000","last_change":"2023-07-14T13:06:00.749693+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.749693+0000","last_undegraded":"2023-07-14T13:06:00.749693+0000","last_fullsized":"2023-07-14T13:06:00.749693+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.757339+0000","last_change":"2023-07-14T13:06:00.756414+0000","last_active":"2023-07-14T13:06:00.757339+0000","last_peered":"2023-07-14T13:06:00.757339+0000","last_clean":"2023-07-14T13:06:00.757339+0000","last_became_active":"2023-07-14T13:06:00.755350+0000","last_became_peered":"2023-07-14T13:06:00.755350+0000","last_unstale":"2023-07-14T13:06:00.757339+0000","last_undegraded":"2023-07-14T13:06:00.757339+0000","last_fullsized":"2023-07-14T13:06:00.757339+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:04:43.245058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.741690+0000","last_change":"2023-07-14T13:06:00.741690+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.741690+0000","last_undegraded":"2023-07-14T13:06:00.741690+0000","last_fullsized":"2023-07-14T13:06:00.741690+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.768245+0000","last_change":"2023-07-14T13:06:00.764991+0000","last_active":"2023-07-14T13:06:00.768245+0000","last_peered":"2023-07-14T13:06:00.768245+0000","last_clean":"2023-07-14T13:06:00.768245+0000","last_became_active":"2023-07-14T13:06:00.764498+0000","last_became_peered":"2023-07-14T13:06:00.764498+0000","last_unstale":"2023-07-14T13:06:00.768245+0000","last_undegraded":"2023-07-14T13:06:00.768245+0000","last_fullsized":"2023-07-14T13:06:00.768245+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:24:37.042404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.753601+0000","last_change":"2023-07-14T13:06:00.753601+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.753601+0000","last_undegraded":"2023-07-14T13:06:00.753601+0000","last_fullsized":"2023-07-14T13:06:00.753601+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.756207+0000","last_change":"2023-07-14T13:06:00.752505+0000","last_active":"2023-07-14T13:06:00.756207+0000","last_peered":"2023-07-14T13:06:00.756207+0000","last_clean":"2023-07-14T13:06:00.756207+0000","last_became_active":"2023-07-14T13:06:00.752152+0000","last_became_peered":"2023-07-14T13:06:00.752152+0000","last_unstale":"2023-07-14T13:06:00.756207+0000","last_undegraded":"2023-07-14T13:06:00.756207+0000","last_fullsized":"2023-07-14T13:06:00.756207+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:01:19.219338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.749729+0000","last_change":"2023-07-14T13:06:00.749729+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.749729+0000","last_undegraded":"2023-07-14T13:06:00.749729+0000","last_fullsized":"2023-07-14T13:06:00.749729+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767626+0000","last_change":"2023-07-14T13:06:00.763540+0000","last_active":"2023-07-14T13:06:00.767626+0000","last_peered":"2023-07-14T13:06:00.767626+0000","last_clean":"2023-07-14T13:06:00.767626+0000","last_became_active":"2023-07-14T13:06:00.763248+0000","last_became_peered":"2023-07-14T13:06:00.763248+0000","last_unstale":"2023-07-14T13:06:00.767626+0000","last_undegraded":"2023-07-14T13:06:00.767626+0000","last_fullsized":"2023-07-14T13:06:00.767626+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:17:30.938068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751489+0000","last_change":"2023-07-14T13:06:00.751489+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751489+0000","last_undegraded":"2023-07-14T13:06:00.751489+0000","last_fullsized":"2023-07-14T13:06:00.751489+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765550+0000","last_change":"2023-07-14T13:06:00.762491+0000","last_active":"2023-07-14T13:06:00.765550+0000","last_peered":"2023-07-14T13:06:00.765550+0000","last_clean":"2023-07-14T13:06:00.765550+0000","last_became_active":"2023-07-14T13:06:00.762242+0000","last_became_peered":"2023-07-14T13:06:00.762242+0000","last_unstale":"2023-07-14T13:06:00.765550+0000","last_undegraded":"2023-07-14T13:06:00.765550+0000","last_fullsized":"2023-07-14T13:06:00.765550+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:54:08.359442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.742869+0000","last_change":"2023-07-14T13:06:00.742869+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.742869+0000","last_undegraded":"2023-07-14T13:06:00.742869+0000","last_fullsized":"2023-07-14T13:06:00.742869+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.769883+0000","last_change":"2023-07-14T13:06:00.769317+0000","last_active":"2023-07-14T13:06:00.769883+0000","last_peered":"2023-07-14T13:06:00.769883+0000","last_clean":"2023-07-14T13:06:00.769883+0000","last_became_active":"2023-07-14T13:06:00.768989+0000","last_became_peered":"2023-07-14T13:06:00.768989+0000","last_unstale":"2023-07-14T13:06:00.769883+0000","last_undegraded":"2023-07-14T13:06:00.769883+0000","last_fullsized":"2023-07-14T13:06:00.769883+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:04:25.791755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750209+0000","last_change":"2023-07-14T13:06:00.750209+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750209+0000","last_undegraded":"2023-07-14T13:06:00.750209+0000","last_fullsized":"2023-07-14T13:06:00.750209+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767765+0000","last_change":"2023-07-14T13:06:00.758935+0000","last_active":"2023-07-14T13:06:00.767765+0000","last_peered":"2023-07-14T13:06:00.767765+0000","last_clean":"2023-07-14T13:06:00.767765+0000","last_became_active":"2023-07-14T13:06:00.758549+0000","last_became_peered":"2023-07-14T13:06:00.758549+0000","last_unstale":"2023-07-14T13:06:00.767765+0000","last_undegraded":"2023-07-14T13:06:00.767765+0000","last_fullsized":"2023-07-14T13:06:00.767765+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:04:31.512964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751561+0000","last_change":"2023-07-14T13:06:00.751561+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751561+0000","last_undegraded":"2023-07-14T13:06:00.751561+0000","last_fullsized":"2023-07-14T13:06:00.751561+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765931+0000","last_change":"2023-07-14T13:06:00.763008+0000","last_active":"2023-07-14T13:06:00.765931+0000","last_peered":"2023-07-14T13:06:00.765931+0000","last_clean":"2023-07-14T13:06:00.765931+0000","last_became_active":"2023-07-14T13:06:00.762695+0000","last_became_peered":"2023-07-14T13:06:00.762695+0000","last_unstale":"2023-07-14T13:06:00.765931+0000","last_undegraded":"2023-07-14T13:06:00.765931+0000","last_fullsized":"2023-07-14T13:06:00.765931+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:30:32.352281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.744200+0000","last_change":"2023-07-14T13:06:00.744200+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.744200+0000","last_undegraded":"2023-07-14T13:06:00.744200+0000","last_fullsized":"2023-07-14T13:06:00.744200+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767365+0000","last_change":"2023-07-14T13:06:00.761495+0000","last_active":"2023-07-14T13:06:00.767365+0000","last_peered":"2023-07-14T13:06:00.767365+0000","last_clean":"2023-07-14T13:06:00.767365+0000","last_became_active":"2023-07-14T13:06:00.761218+0000","last_became_peered":"2023-07-14T13:06:00.761218+0000","last_unstale":"2023-07-14T13:06:00.767365+0000","last_undegraded":"2023-07-14T13:06:00.767365+0000","last_fullsized":"2023-07-14T13:06:00.767365+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:21:08.411166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.742230+0000","last_change":"2023-07-14T13:06:00.742230+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.742230+0000","last_undegraded":"2023-07-14T13:06:00.742230+0000","last_fullsized":"2023-07-14T13:06:00.742230+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767635+0000","last_change":"2023-07-14T13:06:00.763951+0000","last_active":"2023-07-14T13:06:00.767635+0000","last_peered":"2023-07-14T13:06:00.767635+0000","last_clean":"2023-07-14T13:06:00.767635+0000","last_became_active":"2023-07-14T13:06:00.763697+0000","last_became_peered":"2023-07-14T13:06:00.763697+0000","last_unstale":"2023-07-14T13:06:00.767635+0000","last_undegraded":"2023-07-14T13:06:00.767635+0000","last_fullsized":"2023-07-14T13:06:00.767635+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:18:44.339283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.747222+0000","last_change":"2023-07-14T13:06:00.747222+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.747222+0000","last_undegraded":"2023-07-14T13:06:00.747222+0000","last_fullsized":"2023-07-14T13:06:00.747222+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767712+0000","last_change":"2023-07-14T13:06:00.759768+0000","last_active":"2023-07-14T13:06:00.767712+0000","last_peered":"2023-07-14T13:06:00.767712+0000","last_clean":"2023-07-14T13:06:00.767712+0000","last_became_active":"2023-07-14T13:06:00.758411+0000","last_became_peered":"2023-07-14T13:06:00.758411+0000","last_unstale":"2023-07-14T13:06:00.767712+0000","last_undegraded":"2023-07-14T13:06:00.767712+0000","last_fullsized":"2023-07-14T13:06:00.767712+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:52:03.642841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743629+0000","last_change":"2023-07-14T13:06:00.743629+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743629+0000","last_undegraded":"2023-07-14T13:06:00.743629+0000","last_fullsized":"2023-07-14T13:06:00.743629+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.763479+0000","last_change":"2023-07-14T13:06:00.761474+0000","last_active":"2023-07-14T13:06:00.763479+0000","last_peered":"2023-07-14T13:06:00.763479+0000","last_clean":"2023-07-14T13:06:00.763479+0000","last_became_active":"2023-07-14T13:06:00.761216+0000","last_became_peered":"2023-07-14T13:06:00.761216+0000","last_unstale":"2023-07-14T13:06:00.763479+0000","last_undegraded":"2023-07-14T13:06:00.763479+0000","last_fullsized":"2023-07-14T13:06:00.763479+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:56:31.037462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750336+0000","last_change":"2023-07-14T13:06:00.750336+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750336+0000","last_undegraded":"2023-07-14T13:06:00.750336+0000","last_fullsized":"2023-07-14T13:06:00.750336+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.763883+0000","last_change":"2023-07-14T13:06:00.760343+0000","last_active":"2023-07-14T13:06:00.763883+0000","last_peered":"2023-07-14T13:06:00.763883+0000","last_clean":"2023-07-14T13:06:00.763883+0000","last_became_active":"2023-07-14T13:06:00.760062+0000","last_became_peered":"2023-07-14T13:06:00.760062+0000","last_unstale":"2023-07-14T13:06:00.763883+0000","last_undegraded":"2023-07-14T13:06:00.763883+0000","last_fullsized":"2023-07-14T13:06:00.763883+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:43:01.259058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.749674+0000","last_change":"2023-07-14T13:06:00.749674+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.749674+0000","last_undegraded":"2023-07-14T13:06:00.749674+0000","last_fullsized":"2023-07-14T13:06:00.749674+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767418+0000","last_change":"2023-07-14T13:06:00.762635+0000","last_active":"2023-07-14T13:06:00.767418+0000","last_peered":"2023-07-14T13:06:00.767418+0000","last_clean":"2023-07-14T13:06:00.767418+0000","last_became_active":"2023-07-14T13:06:00.762384+0000","last_became_peered":"2023-07-14T13:06:00.762384+0000","last_unstale":"2023-07-14T13:06:00.767418+0000","last_undegraded":"2023-07-14T13:06:00.767418+0000","last_fullsized":"2023-07-14T13:06:00.767418+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:22.137266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751703+0000","last_change":"2023-07-14T13:06:00.751703+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751703+0000","last_undegraded":"2023-07-14T13:06:00.751703+0000","last_fullsized":"2023-07-14T13:06:00.751703+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767466+0000","last_change":"2023-07-14T13:06:00.761859+0000","last_active":"2023-07-14T13:06:00.767466+0000","last_peered":"2023-07-14T13:06:00.767466+0000","last_clean":"2023-07-14T13:06:00.767466+0000","last_became_active":"2023-07-14T13:06:00.761595+0000","last_became_peered":"2023-07-14T13:06:00.761595+0000","last_unstale":"2023-07-14T13:06:00.767466+0000","last_undegraded":"2023-07-14T13:06:00.767466+0000","last_fullsized":"2023-07-14T13:06:00.767466+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:22:48.786505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751015+0000","last_change":"2023-07-14T13:06:00.751015+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751015+0000","last_undegraded":"2023-07-14T13:06:00.751015+0000","last_fullsized":"2023-07-14T13:06:00.751015+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765674+0000","last_change":"2023-07-14T13:06:00.761520+0000","last_active":"2023-07-14T13:06:00.765674+0000","last_peered":"2023-07-14T13:06:00.765674+0000","last_clean":"2023-07-14T13:06:00.765674+0000","last_became_active":"2023-07-14T13:06:00.761245+0000","last_became_peered":"2023-07-14T13:06:00.761245+0000","last_unstale":"2023-07-14T13:06:00.765674+0000","last_undegraded":"2023-07-14T13:06:00.765674+0000","last_fullsized":"2023-07-14T13:06:00.765674+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:54:08.359442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.746672+0000","last_change":"2023-07-14T13:06:00.746672+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.746672+0000","last_undegraded":"2023-07-14T13:06:00.746672+0000","last_fullsized":"2023-07-14T13:06:00.746672+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767614+0000","last_change":"2023-07-14T13:06:00.759041+0000","last_active":"2023-07-14T13:06:00.767614+0000","last_peered":"2023-07-14T13:06:00.767614+0000","last_clean":"2023-07-14T13:06:00.767614+0000","last_became_active":"2023-07-14T13:06:00.758732+0000","last_became_peered":"2023-07-14T13:06:00.758732+0000","last_unstale":"2023-07-14T13:06:00.767614+0000","last_undegraded":"2023-07-14T13:06:00.767614+0000","last_fullsized":"2023-07-14T13:06:00.767614+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:31:07.335972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.747138+0000","last_change":"2023-07-14T13:06:00.747138+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.747138+0000","last_undegraded":"2023-07-14T13:06:00.747138+0000","last_fullsized":"2023-07-14T13:06:00.747138+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765404+0000","last_change":"2023-07-14T13:06:00.762299+0000","last_active":"2023-07-14T13:06:00.765404+0000","last_peered":"2023-07-14T13:06:00.765404+0000","last_clean":"2023-07-14T13:06:00.765404+0000","last_became_active":"2023-07-14T13:06:00.761975+0000","last_became_peered":"2023-07-14T13:06:00.761975+0000","last_unstale":"2023-07-14T13:06:00.765404+0000","last_undegraded":"2023-07-14T13:06:00.765404+0000","last_fullsized":"2023-07-14T13:06:00.765404+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:41:42.646912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.748258+0000","last_change":"2023-07-14T13:06:00.748258+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.748258+0000","last_undegraded":"2023-07-14T13:06:00.748258+0000","last_fullsized":"2023-07-14T13:06:00.748258+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.764023+0000","last_change":"2023-07-14T13:06:00.762395+0000","last_active":"2023-07-14T13:06:00.764023+0000","last_peered":"2023-07-14T13:06:00.764023+0000","last_clean":"2023-07-14T13:06:00.764023+0000","last_became_active":"2023-07-14T13:06:00.762022+0000","last_became_peered":"2023-07-14T13:06:00.762022+0000","last_unstale":"2023-07-14T13:06:00.764023+0000","last_undegraded":"2023-07-14T13:06:00.764023+0000","last_fullsized":"2023-07-14T13:06:00.764023+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:02:08.227992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.745329+0000","last_change":"2023-07-14T13:06:00.745329+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.745329+0000","last_undegraded":"2023-07-14T13:06:00.745329+0000","last_fullsized":"2023-07-14T13:06:00.745329+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765902+0000","last_change":"2023-07-14T13:06:00.762994+0000","last_active":"2023-07-14T13:06:00.765902+0000","last_peered":"2023-07-14T13:06:00.765902+0000","last_clean":"2023-07-14T13:06:00.765902+0000","last_became_active":"2023-07-14T13:06:00.762704+0000","last_became_peered":"2023-07-14T13:06:00.762704+0000","last_unstale":"2023-07-14T13:06:00.765902+0000","last_undegraded":"2023-07-14T13:06:00.765902+0000","last_fullsized":"2023-07-14T13:06:00.765902+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:50:34.298484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"53'139","reported_seq":333,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.759241+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:06:00.759241+0000","last_peered":"2023-07-14T13:06:00.759241+0000","last_clean":"2023-07-14T13:06:00.759241+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:06:00.759241+0000","last_undegraded":"2023-07-14T13:06:00.759241+0000","last_fullsized":"2023-07-14T13:06:00.759241+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:25:19.700060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":99,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.753574+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:06:00.753574+0000","last_peered":"2023-07-14T13:06:00.753574+0000","last_clean":"2023-07-14T13:06:00.753574+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:06:00.753574+0000","last_undegraded":"2023-07-14T13:06:00.753574+0000","last_fullsized":"2023-07-14T13:06:00.753574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:46:51.928482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743863+0000","last_change":"2023-07-14T13:06:00.743863+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743863+0000","last_undegraded":"2023-07-14T13:06:00.743863+0000","last_fullsized":"2023-07-14T13:06:00.743863+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.768707+0000","last_change":"2023-07-14T13:06:00.766325+0000","last_active":"2023-07-14T13:06:00.768707+0000","last_peered":"2023-07-14T13:06:00.768707+0000","last_clean":"2023-07-14T13:06:00.768707+0000","last_became_active":"2023-07-14T13:06:00.766116+0000","last_became_peered":"2023-07-14T13:06:00.766116+0000","last_unstale":"2023-07-14T13:06:00.768707+0000","last_undegraded":"2023-07-14T13:06:00.768707+0000","last_fullsized":"2023-07-14T13:06:00.768707+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:47:41.009818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":99,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.759100+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:06:00.759100+0000","last_peered":"2023-07-14T13:06:00.759100+0000","last_clean":"2023-07-14T13:06:00.759100+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:06:00.759100+0000","last_undegraded":"2023-07-14T13:06:00.759100+0000","last_fullsized":"2023-07-14T13:06:00.759100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:06:36.972485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.746502+0000","last_change":"2023-07-14T13:06:00.746502+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.746502+0000","last_undegraded":"2023-07-14T13:06:00.746502+0000","last_fullsized":"2023-07-14T13:06:00.746502+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.756244+0000","last_change":"2023-07-14T13:06:00.752570+0000","last_active":"2023-07-14T13:06:00.756244+0000","last_peered":"2023-07-14T13:06:00.756244+0000","last_clean":"2023-07-14T13:06:00.756244+0000","last_became_active":"2023-07-14T13:06:00.752307+0000","last_became_peered":"2023-07-14T13:06:00.752307+0000","last_unstale":"2023-07-14T13:06:00.756244+0000","last_undegraded":"2023-07-14T13:06:00.756244+0000","last_fullsized":"2023-07-14T13:06:00.756244+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:42:22.518638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.738618+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:06:00.738618+0000","last_peered":"2023-07-14T13:06:00.738618+0000","last_clean":"2023-07-14T13:06:00.738618+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:06:00.738618+0000","last_undegraded":"2023-07-14T13:06:00.738618+0000","last_fullsized":"2023-07-14T13:06:00.738618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:32:53.565488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751428+0000","last_change":"2023-07-14T13:06:00.751428+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751428+0000","last_undegraded":"2023-07-14T13:06:00.751428+0000","last_fullsized":"2023-07-14T13:06:00.751428+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.764726+0000","last_change":"2023-07-14T13:06:00.760649+0000","last_active":"2023-07-14T13:06:00.764726+0000","last_peered":"2023-07-14T13:06:00.764726+0000","last_clean":"2023-07-14T13:06:00.764726+0000","last_became_active":"2023-07-14T13:06:00.760376+0000","last_became_peered":"2023-07-14T13:06:00.760376+0000","last_unstale":"2023-07-14T13:06:00.764726+0000","last_undegraded":"2023-07-14T13:06:00.764726+0000","last_fullsized":"2023-07-14T13:06:00.764726+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:12:44.502720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":99,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.753411+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:06:00.753411+0000","last_peered":"2023-07-14T13:06:00.753411+0000","last_clean":"2023-07-14T13:06:00.753411+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:06:00.753411+0000","last_undegraded":"2023-07-14T13:06:00.753411+0000","last_fullsized":"2023-07-14T13:06:00.753411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:59:19.438385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.747627+0000","last_change":"2023-07-14T13:06:00.747627+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.747627+0000","last_undegraded":"2023-07-14T13:06:00.747627+0000","last_fullsized":"2023-07-14T13:06:00.747627+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765589+0000","last_change":"2023-07-14T13:06:00.762610+0000","last_active":"2023-07-14T13:06:00.765589+0000","last_peered":"2023-07-14T13:06:00.765589+0000","last_clean":"2023-07-14T13:06:00.765589+0000","last_became_active":"2023-07-14T13:06:00.762305+0000","last_became_peered":"2023-07-14T13:06:00.762305+0000","last_unstale":"2023-07-14T13:06:00.765589+0000","last_undegraded":"2023-07-14T13:06:00.765589+0000","last_fullsized":"2023-07-14T13:06:00.765589+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:28.800346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":101,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.752612+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:06:00.752612+0000","last_peered":"2023-07-14T13:06:00.752612+0000","last_clean":"2023-07-14T13:06:00.752612+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:06:00.752612+0000","last_undegraded":"2023-07-14T13:06:00.752612+0000","last_fullsized":"2023-07-14T13:06:00.752612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:08.341386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.742916+0000","last_change":"2023-07-14T13:06:00.742916+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.742916+0000","last_undegraded":"2023-07-14T13:06:00.742916+0000","last_fullsized":"2023-07-14T13:06:00.742916+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.769021+0000","last_change":"2023-07-14T13:06:00.768010+0000","last_active":"2023-07-14T13:06:00.769021+0000","last_peered":"2023-07-14T13:06:00.769021+0000","last_clean":"2023-07-14T13:06:00.769021+0000","last_became_active":"2023-07-14T13:06:00.767670+0000","last_became_peered":"2023-07-14T13:06:00.767670+0000","last_unstale":"2023-07-14T13:06:00.769021+0000","last_undegraded":"2023-07-14T13:06:00.769021+0000","last_fullsized":"2023-07-14T13:06:00.769021+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:50:18.541594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":99,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.760517+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:06:00.760517+0000","last_peered":"2023-07-14T13:06:00.760517+0000","last_clean":"2023-07-14T13:06:00.760517+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:06:00.760517+0000","last_undegraded":"2023-07-14T13:06:00.760517+0000","last_fullsized":"2023-07-14T13:06:00.760517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:41:25.696130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.745965+0000","last_change":"2023-07-14T13:06:00.745965+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.745965+0000","last_undegraded":"2023-07-14T13:06:00.745965+0000","last_fullsized":"2023-07-14T13:06:00.745965+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765184+0000","last_change":"2023-07-14T13:06:00.757176+0000","last_active":"2023-07-14T13:06:00.765184+0000","last_peered":"2023-07-14T13:06:00.765184+0000","last_clean":"2023-07-14T13:06:00.765184+0000","last_became_active":"2023-07-14T13:06:00.756867+0000","last_became_peered":"2023-07-14T13:06:00.756867+0000","last_unstale":"2023-07-14T13:06:00.765184+0000","last_undegraded":"2023-07-14T13:06:00.765184+0000","last_fullsized":"2023-07-14T13:06:00.765184+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:24:48.579990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":101,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.753404+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:06:00.753404+0000","last_peered":"2023-07-14T13:06:00.753404+0000","last_clean":"2023-07-14T13:06:00.753404+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:06:00.753404+0000","last_undegraded":"2023-07-14T13:06:00.753404+0000","last_fullsized":"2023-07-14T13:06:00.753404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:26:51.965367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750879+0000","last_change":"2023-07-14T13:06:00.750879+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750879+0000","last_undegraded":"2023-07-14T13:06:00.750879+0000","last_fullsized":"2023-07-14T13:06:00.750879+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767941+0000","last_change":"2023-07-14T13:06:00.764320+0000","last_active":"2023-07-14T13:06:00.767941+0000","last_peered":"2023-07-14T13:06:00.767941+0000","last_clean":"2023-07-14T13:06:00.767941+0000","last_became_active":"2023-07-14T13:06:00.764000+0000","last_became_peered":"2023-07-14T13:06:00.764000+0000","last_unstale":"2023-07-14T13:06:00.767941+0000","last_undegraded":"2023-07-14T13:06:00.767941+0000","last_fullsized":"2023-07-14T13:06:00.767941+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:25.774499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":99,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.748597+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:06:00.748597+0000","last_peered":"2023-07-14T13:06:00.748597+0000","last_clean":"2023-07-14T13:06:00.748597+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:06:00.748597+0000","last_undegraded":"2023-07-14T13:06:00.748597+0000","last_fullsized":"2023-07-14T13:06:00.748597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:33:03.441107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575011,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54492,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317348,"statfs":{"total":96636764160,"available":96580964352,"internally_reserved":0,"allocated":1331200,"data_stored":950848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.35699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.85499999999999998,"5min":0.98399999999999999,"15min":1.879},"last":0.746},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.745,"15min":0.74099999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.439},"max":{"1min":0.877,"5min":0.95599999999999996,"15min":1.9059999999999999},"last":0.68100000000000005}]},{"osd":1,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.752,"15min":0.72999999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.42999999999999999},"max":{"1min":0.92600000000000005,"5min":1,"15min":1.069},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.76000000000000001,"15min":0.745},"min":{"1min":0.54000000000000004,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93000000000000005,"5min":0.97399999999999998,"15min":1.1020000000000001},"last":0.72399999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.745,"15min":0.72299999999999998},"min":{"1min":0.46999999999999997,"5min":0.42699999999999999,"15min":0.40600000000000003},"max":{"1min":0.877,"5min":1.016,"15min":1.048},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.77500000000000002,"15min":0.755},"min":{"1min":0.50600000000000001,"5min":0.503,"15min":0.46899999999999997},"max":{"1min":0.89200000000000002,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.69999999999999996}]},{"osd":3,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.753,"15min":0.73199999999999998},"min":{"1min":0.50700000000000001,"5min":0.46400000000000002,"15min":0.442},"max":{"1min":0.98199999999999998,"5min":1.0269999999999999,"15min":1.0760000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.78100000000000003,"15min":0.76000000000000001},"min":{"1min":0.51900000000000002,"5min":0.47299999999999998,"15min":0.41499999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.024},"last":0.51900000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.60899999999999999,"15min":0.58999999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.86299999999999999,"5min":1.022,"15min":1.022},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.40999999999999998,"5min":0.40000000000000002,"15min":0.39300000000000002},"max":{"1min":0.68100000000000005,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.66600000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.63300000000000001,"15min":0.622},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94699999999999995,"5min":0.98299999999999998,"15min":1.0249999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.65300000000000002,"15min":0.67300000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.008},"last":0.55700000000000005}]},{"osd":6,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.70399999999999996,"15min":0.71699999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96699999999999997,"5min":1.0489999999999999,"15min":1.4419999999999999},"last":0.62},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.68700000000000006,"15min":0.69199999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91000000000000003,"5min":0.98199999999999998,"15min":1.575},"last":0.54300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575012,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":749568,"data_stored":367108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.51300000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.89200000000000002,"5min":0.996,"15min":1.2749999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73899999999999999,"15min":0.74199999999999999},"min":{"1min":0.53700000000000003,"5min":0.48199999999999998,"15min":0.47399999999999998},"max":{"1min":1.0209999999999999,"5min":1.03,"15min":1.2110000000000001},"last":0.80600000000000005}]},{"osd":1,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.56499999999999995,"5min":0.50800000000000001,"15min":0.379},"max":{"1min":0.94699999999999995,"5min":1.0209999999999999,"15min":1.4299999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.745,"15min":0.72999999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.44},"max":{"1min":0.97099999999999997,"5min":1.077,"15min":1.1379999999999999},"last":0.88200000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.753,"15min":0.752},"min":{"1min":0.56699999999999995,"5min":0.496,"15min":0.40400000000000003},"max":{"1min":0.94099999999999995,"5min":1.105,"15min":1.319},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77300000000000002,"15min":0.75700000000000001},"min":{"1min":0.59199999999999997,"5min":0.54400000000000004,"15min":0.42299999999999999},"max":{"1min":0.94399999999999995,"5min":1.0900000000000001,"15min":1.341},"last":0.67800000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.79100000000000004,"15min":0.78600000000000003},"min":{"1min":0.53200000000000003,"5min":0.52200000000000002,"15min":0.45600000000000002},"max":{"1min":0.92500000000000004,"5min":1.093,"15min":1.3859999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.79300000000000004,"15min":0.76800000000000002},"min":{"1min":0.58199999999999996,"5min":0.53300000000000003,"15min":0.45900000000000002},"max":{"1min":0.99099999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.85699999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.58099999999999996,"15min":0.58999999999999997},"min":{"1min":0.40100000000000002,"5min":0.39300000000000002,"15min":0.32700000000000001},"max":{"1min":0.85899999999999999,"5min":0.871,"15min":0.97899999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63700000000000001,"15min":0.65000000000000002},"min":{"1min":0.442,"5min":0.435,"15min":0.36099999999999999},"max":{"1min":0.81499999999999995,"5min":1.0780000000000001,"15min":1.091},"last":0.61699999999999999}]},{"osd":5,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63700000000000001,"15min":0.65900000000000003},"min":{"1min":0.45800000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91200000000000003,"5min":0.98399999999999999,"15min":1.121},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.67300000000000004,"15min":0.70699999999999996},"min":{"1min":0.47499999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88300000000000001,"5min":0.98699999999999999,"15min":1.145},"last":0.95099999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65600000000000003,"15min":0.67500000000000004},"min":{"1min":0.44600000000000001,"5min":0.41699999999999998,"15min":0.38},"max":{"1min":0.92200000000000004,"5min":1.1200000000000001,"15min":1.208},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.71199999999999997,"15min":0.72499999999999998},"min":{"1min":0.53200000000000003,"5min":0.52700000000000002,"15min":0.442},"max":{"1min":0.85799999999999998,"5min":1.0489999999999999,"15min":1.194},"last":0.70299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575011,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":749568,"data_stored":367108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.73699999999999999,"15min":0.73399999999999999},"min":{"1min":0.45300000000000001,"5min":0.36499999999999999,"15min":0.32400000000000001},"max":{"1min":2.6699999999999999,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.72699999999999998,"15min":0.74099999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.94199999999999995,"5min":0.996,"15min":1.0069999999999999},"last":0.81799999999999995}]},{"osd":1,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.72699999999999998,"15min":0.73199999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.41099999999999998},"max":{"1min":0.85899999999999999,"5min":1.079,"15min":1.335},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75800000000000001,"15min":0.75600000000000001},"min":{"1min":0.505,"5min":0.40400000000000003,"15min":0.36799999999999999},"max":{"1min":2.706,"5min":2.706,"15min":2.706},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73499999999999999,"15min":0.748},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91800000000000004,"5min":1.0940000000000001,"15min":1.298},"last":0.879},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.73299999999999998,"15min":0.74199999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.90200000000000002,"5min":1.044,"15min":1.044},"last":0.68600000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.75600000000000001,"15min":0.745},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.76100000000000001,"15min":0.77600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88900000000000001,"5min":1.149,"15min":1.149},"last":0.77200000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.63200000000000001,"15min":0.64000000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.85199999999999998,"5min":0.94199999999999995,"15min":1.073},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.71599999999999997},"min":{"1min":0.40600000000000003,"5min":0.40200000000000002,"15min":0.35899999999999999},"max":{"1min":2.7719999999999998,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.53600000000000003}]},{"osd":6,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.621,"15min":0.64100000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.89800000000000002,"5min":0.95399999999999996,"15min":0.97999999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.63900000000000001,"15min":0.66200000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.042},"last":0.58799999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":3.0230000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67900000000000005,"15min":0.70899999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.95999999999999996,"5min":1.407,"15min":1.407},"last":0.46800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575011,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":749568,"data_stored":367108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76900000000000002,"15min":0.72999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.42299999999999999},"max":{"1min":1.0129999999999999,"5min":1.411,"15min":1.411},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.749,"15min":0.71299999999999997},"min":{"1min":0.54100000000000004,"5min":0.435,"15min":0.435},"max":{"1min":0.96799999999999997,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":1.0640000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77500000000000002,"15min":0.73599999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.442},"max":{"1min":0.90200000000000002,"5min":1.077,"15min":1.077},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76200000000000001,"15min":0.73899999999999999},"min":{"1min":0.55200000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93300000000000005,"5min":1.0469999999999999,"15min":1.2370000000000001},"last":0.94999999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.75800000000000001,"15min":0.72399999999999998},"min":{"1min":0.60499999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.95899999999999996,"5min":1.091,"15min":1.091},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.80400000000000005,"15min":0.76300000000000001},"min":{"1min":0.59099999999999997,"5min":0.499,"15min":0.443},"max":{"1min":0.99199999999999999,"5min":1.387,"15min":1.387},"last":0.77700000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.77100000000000002,"15min":0.74199999999999999},"min":{"1min":0.63600000000000001,"5min":0.52600000000000002,"15min":0.497},"max":{"1min":0.99399999999999999,"5min":1.008,"15min":1.099},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78900000000000003,"15min":0.76200000000000001},"min":{"1min":0.54100000000000004,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.97099999999999997,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.82199999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61699999999999999,"15min":0.61299999999999999},"min":{"1min":0.48799999999999999,"5min":0.441,"15min":0.38900000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":1.0029999999999999},"last":0.621},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61099999999999999,"15min":0.624},"min":{"1min":0.43099999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88600000000000001,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.751}]},{"osd":6,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.62,"15min":0.63300000000000001},"min":{"1min":0.495,"5min":0.41599999999999998,"15min":0.32300000000000001},"max":{"1min":0.91700000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":1.014},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.68100000000000005},"min":{"1min":0.45400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.98999999999999999},"last":0.84499999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66500000000000004,"15min":0.67800000000000005},"min":{"1min":0.54100000000000004,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94699999999999995,"5min":0.98099999999999998,"15min":1.0349999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69199999999999995,"15min":0.71599999999999997},"min":{"1min":0.56499999999999995,"5min":0.41599999999999998,"15min":0.36899999999999999},"max":{"1min":0.91800000000000004,"5min":1.026,"15min":1.1080000000000001},"last":0.97699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575011,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35876,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335964,"statfs":{"total":96636764160,"available":96600027136,"internally_reserved":0,"allocated":749568,"data_stored":367108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45400000000000001,"15min":0.44400000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.748,"5min":0.755,"15min":0.84199999999999997},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.503,"15min":0.52000000000000002},"min":{"1min":0.378,"5min":0.33300000000000002,"15min":0.309},"max":{"1min":0.65500000000000003,"5min":0.78700000000000003,"15min":1.577},"last":0.40100000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47199999999999998,"15min":0.47599999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.29199999999999998},"max":{"1min":0.65400000000000003,"5min":0.71699999999999997,"15min":0.88200000000000001},"last":0.315},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.32600000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.113},"last":0.376}]},{"osd":2,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.56499999999999995,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.38700000000000001},"max":{"1min":0.63900000000000001,"5min":0.88400000000000001,"15min":1.0820000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.624,"15min":0.59899999999999998},"min":{"1min":0.46400000000000002,"5min":0.441,"15min":0.40100000000000002},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.47499999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.51100000000000001,"5min":0.441,"15min":0.439},"max":{"1min":0.88200000000000001,"5min":1.284,"15min":1.627},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.77400000000000002,"15min":0.78400000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.47699999999999998},"max":{"1min":0.81899999999999995,"5min":1.135,"15min":1.214},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.78500000000000003,"15min":0.79000000000000004},"min":{"1min":0.58499999999999996,"5min":0.57999999999999996,"15min":0.52400000000000002},"max":{"1min":0.86399999999999999,"5min":1.306,"15min":1.333},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.78300000000000003,"15min":0.78600000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.96099999999999997,"5min":1.129,"15min":1.2470000000000001},"last":0.64200000000000002}]},{"osd":6,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.76800000000000002,"15min":0.78600000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.873,"5min":1.117,"15min":1.526},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.505},"max":{"1min":0.93200000000000005,"5min":1.2589999999999999,"15min":1.381},"last":0.54200000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.85099999999999998,"15min":0.84299999999999997},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.53100000000000003},"max":{"1min":2.4910000000000001,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.83099999999999996,"15min":0.83999999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.595,"5min":1.595,"15min":1.6910000000000001},"last":0.77100000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575011,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53908,"kb_used_data":716,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317932,"statfs":{"total":96636764160,"available":96581562368,"internally_reserved":0,"allocated":733184,"data_stored":359461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46700000000000003,"15min":0.46800000000000003},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.28999999999999998},"max":{"1min":2.5270000000000001,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.499}]},{"osd":1,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.47799999999999998,"15min":0.47499999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27500000000000002},"max":{"1min":2.7200000000000002,"5min":2.7200000000000002,"15min":2.7200000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.33000000000000002},"max":{"1min":2.6110000000000002,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":0.56100000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.66600000000000004,"15min":0.60199999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.38},"max":{"1min":8.2530000000000001,"5min":8.2530000000000001,"15min":8.2530000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89600000000000002,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.53400000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.3049999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81499999999999995,"15min":0.80900000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.81899999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.88200000000000001,"15min":0.874},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":3.1139999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.85599999999999998,"15min":0.84599999999999997},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.433},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.94999999999999996}]},{"osd":6,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.82099999999999995,"15min":0.80200000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.47599999999999998},"max":{"1min":3.9849999999999999,"5min":3.9849999999999999,"15min":3.9849999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.83999999999999997,"15min":0.81899999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":3.391,"5min":3.391,"15min":3.391},"last":0.96999999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.83799999999999997,"15min":0.83699999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.5779999999999998,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.84599999999999997,"15min":0.82599999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.50900000000000001},"max":{"1min":2.5939999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.89400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575012,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35876,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335964,"statfs":{"total":96636764160,"available":96600027136,"internally_reserved":0,"allocated":749568,"data_stored":367108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.432,"15min":0.42599999999999999},"min":{"1min":0.26300000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58699999999999997,"5min":0.69099999999999995,"15min":0.77200000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.51500000000000001,"15min":0.49299999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.26500000000000001},"max":{"1min":0.64700000000000002,"5min":0.751,"15min":0.82299999999999995},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.48899999999999999,"15min":0.46899999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.29499999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52600000000000002,"15min":0.51000000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.29299999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.495}]},{"osd":3,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64700000000000002,"15min":0.626},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.432},"max":{"1min":0.79200000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58299999999999996,"15min":0.57599999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.38100000000000001},"max":{"1min":0.749,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.80100000000000005,"15min":0.77200000000000002},"min":{"1min":0.51600000000000001,"5min":0.51300000000000001,"15min":0.40000000000000002},"max":{"1min":0.999,"5min":1.054,"15min":1.236},"last":0.874},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.79000000000000004,"15min":0.77800000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.45700000000000002},"max":{"1min":0.92200000000000004,"5min":1.1040000000000001,"15min":1.1180000000000001},"last":0.74199999999999999}]},{"osd":5,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.79700000000000004,"15min":0.77500000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":0.99099999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.80800000000000005,"15min":0.79200000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48199999999999998},"max":{"1min":0.88,"5min":1.2509999999999999,"15min":1.3600000000000001},"last":0.73299999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.81000000000000005,"15min":0.79100000000000004},"min":{"1min":0.503,"5min":0.503,"15min":0.48499999999999999},"max":{"1min":0.89600000000000002,"5min":1.0649999999999999,"15min":1.274},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.82699999999999996,"15min":0.81200000000000006},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.49199999999999999},"max":{"1min":0.96999999999999997,"5min":1.1599999999999999,"15min":1.2969999999999999},"last":0.70799999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.80200000000000005,"15min":0.78600000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.47799999999999998},"max":{"1min":0.93799999999999994,"5min":1.123,"15min":1.3400000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.85899999999999999,"15min":0.83599999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.52800000000000002},"max":{"1min":0.95699999999999996,"5min":1.1890000000000001,"15min":1.2929999999999999},"last":0.81699999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575013,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36452,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335388,"statfs":{"total":96636764160,"available":96599437312,"internally_reserved":0,"allocated":1339392,"data_stored":956457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.48299999999999998,"15min":0.45900000000000002},"min":{"1min":0.28899999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.50800000000000001,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.69699999999999995,"5min":0.77900000000000003,"15min":1.452},"last":0.35399999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.34100000000000003},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80300000000000005,"5min":0.90300000000000002,"15min":1.5700000000000001},"last":0.41999999999999998}]},{"osd":3,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.502,"15min":0.51100000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.66000000000000003,"5min":0.70599999999999996,"15min":0.99299999999999999},"last":0.502},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.60599999999999998,"15min":0.59699999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":2.4100000000000001,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.80300000000000005,"15min":0.78400000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.44400000000000001},"max":{"1min":1.2150000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.628},{"interface":"front","average":{"1min":0.873,"5min":0.82499999999999996,"15min":0.81599999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.755}]},{"osd":5,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.82299999999999995,"15min":0.80500000000000005},"min":{"1min":0.51800000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2549999999999999,"5min":1.3839999999999999,"15min":1.4950000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.81399999999999995,"15min":0.80400000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.47299999999999998},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.82599999999999996,"15min":0.81799999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.82799999999999996,"15min":0.82199999999999995},"min":{"1min":0.55500000000000005,"5min":0.50600000000000001,"15min":0.41299999999999998},"max":{"1min":1.141,"5min":1.3440000000000001,"15min":1.5369999999999999},"last":0.73899999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.84999999999999998,"15min":0.83999999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.45500000000000002},"max":{"1min":1.04,"5min":1.2749999999999999,"15min":1.603},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82999999999999996,"15min":0.82399999999999995},"min":{"1min":0.57099999999999995,"5min":0.52800000000000002,"15min":0.497},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.69499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:06:05.928 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:06:06.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.078+0000 7f4a73c34640 1 Processor -- start 2023-07-14T13:06:06.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.078+0000 7f4a73c34640 1 -- start start 2023-07-14T13:06:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.082+0000 7f4a73c34640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4a6c158ce0 0x7f4a6c070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.082+0000 7f4a73c34640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4a6c0c8ad0 0x7f4a6c0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.082+0000 7f4a73c34640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a6c0c9560 0x7f4a6c0cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.082+0000 7f4a73c34640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a6c0c99e0 con 0x7f4a6c158ce0 2023-07-14T13:06:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.082+0000 7f4a73c34640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a6c0cc700 con 0x7f4a6c0c8ad0 2023-07-14T13:06:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.082+0000 7f4a73c34640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c0b0ff0 con 0x7f4a6c0c9560 2023-07-14T13:06:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.082+0000 7f4a719d0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4a6c158ce0 0x7f4a6c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.082+0000 7f4a719d0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4a6c158ce0 0x7f4a6c070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57438/0 (socket says 172.21.15.5:57438) 2023-07-14T13:06:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.082+0000 7f4a719d0640 1 -- 172.21.15.5:0/2601886800 learned_addr learned my addr 172.21.15.5:0/2601886800 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:06.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.082+0000 7f4a721d1640 1 --2- 172.21.15.5:0/2601886800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a6c0c9560 0x7f4a6c0cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:06.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.082+0000 7f4a711cf640 1 --2- 172.21.15.5:0/2601886800 >> v2:172.21.15.154:3300/0 conn(0x7f4a6c0c8ad0 0x7f4a6c0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:06.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.082+0000 7f4a719d0640 1 -- 172.21.15.5:0/2601886800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a6c0c9560 msgr2=0x7f4a6c0cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:06.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.082+0000 7f4a719d0640 1 --2- 172.21.15.5:0/2601886800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a6c0c9560 0x7f4a6c0cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:06.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.082+0000 7f4a719d0640 1 -- 172.21.15.5:0/2601886800 >> v2:172.21.15.154:3300/0 conn(0x7f4a6c0c8ad0 msgr2=0x7f4a6c0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:06.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.082+0000 7f4a719d0640 1 --2- 172.21.15.5:0/2601886800 >> v2:172.21.15.154:3300/0 conn(0x7f4a6c0c8ad0 0x7f4a6c0c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:06.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.082+0000 7f4a719d0640 1 -- 172.21.15.5:0/2601886800 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c070c80 con 0x7f4a6c158ce0 2023-07-14T13:06:06.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.086+0000 7f4a719d0640 1 --2- 172.21.15.5:0/2601886800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6c158ce0 0x7f4a6c070450 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0c1a30 tx=0x7f4a6801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94f0c2904154a1f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:06.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.086+0000 7f4a709ce640 1 -- 172.21.15.5:0/2601886800 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a680ab600 con 0x7f4a6c158ce0 2023-07-14T13:06:06.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.086+0000 7f4a709ce640 1 -- 172.21.15.5:0/2601886800 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a680a7050 con 0x7f4a6c158ce0 2023-07-14T13:06:06.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.086+0000 7f4a709ce640 1 -- 172.21.15.5:0/2601886800 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a680ab980 con 0x7f4a6c158ce0 2023-07-14T13:06:06.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.086+0000 7f4a73c34640 1 -- 172.21.15.5:0/2601886800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6c158ce0 msgr2=0x7f4a6c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:06.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.086+0000 7f4a73c34640 1 --2- 172.21.15.5:0/2601886800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6c158ce0 0x7f4a6c070450 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0c1a30 tx=0x7f4a6801c3b0 comp rx=0 tx=0).stop 2023-07-14T13:06:06.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.086+0000 7f4a73c34640 1 -- 172.21.15.5:0/2601886800 shutdown_connections 2023-07-14T13:06:06.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.086+0000 7f4a73c34640 1 --2- 172.21.15.5:0/2601886800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a6c0c9560 0x7f4a6c0cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:06.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.086+0000 7f4a73c34640 1 --2- 172.21.15.5:0/2601886800 >> v2:172.21.15.154:3300/0 conn(0x7f4a6c0c8ad0 0x7f4a6c0c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:06.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.086+0000 7f4a73c34640 1 --2- 172.21.15.5:0/2601886800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6c158ce0 0x7f4a6c070450 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:06.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.086+0000 7f4a73c34640 1 -- 172.21.15.5:0/2601886800 >> 172.21.15.5:0/2601886800 conn(0x7f4a6c0afcf0 msgr2=0x7f4a6c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:06.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.086+0000 7f4a73c34640 1 -- 172.21.15.5:0/2601886800 shutdown_connections 2023-07-14T13:06:06.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.086+0000 7f4a73c34640 1 -- 172.21.15.5:0/2601886800 wait complete. 2023-07-14T13:06:06.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.086+0000 7f4a73c34640 1 Processor -- start 2023-07-14T13:06:06.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.086+0000 7f4a73c34640 1 -- start start 2023-07-14T13:06:06.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.090+0000 7f4a73c34640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6c0c8ad0 0x7f4a6c0c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:06.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.090+0000 7f4a73c34640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a6c0c9560 0x7f4a6c1f4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:06.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.090+0000 7f4a73c34640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a6c158ce0 0x7f4a6c0c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:06.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.090+0000 7f4a73c34640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c1f52d0 con 0x7f4a6c0c8ad0 2023-07-14T13:06:06.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.090+0000 7f4a73c34640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c0b3de0 con 0x7f4a6c0c9560 2023-07-14T13:06:06.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.090+0000 7f4a73c34640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c0c6840 con 0x7f4a6c158ce0 2023-07-14T13:06:06.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.090+0000 7f4a719d0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6c0c8ad0 0x7f4a6c0c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:06.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.090+0000 7f4a719d0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6c0c8ad0 0x7f4a6c0c5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57440/0 (socket says 172.21.15.5:57440) 2023-07-14T13:06:06.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.090+0000 7f4a719d0640 1 -- 172.21.15.5:0/1110990864 learned_addr learned my addr 172.21.15.5:0/1110990864 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:06.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.090+0000 7f4a711cf640 1 --2- 172.21.15.5:0/1110990864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a6c0c9560 0x7f4a6c1f4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:06.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.090+0000 7f4a721d1640 1 --2- 172.21.15.5:0/1110990864 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a6c158ce0 0x7f4a6c0c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:06.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.090+0000 7f4a719d0640 1 -- 172.21.15.5:0/1110990864 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a6c158ce0 msgr2=0x7f4a6c0c5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:06.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.090+0000 7f4a719d0640 1 --2- 172.21.15.5:0/1110990864 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a6c158ce0 0x7f4a6c0c5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:06.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.090+0000 7f4a719d0640 1 -- 172.21.15.5:0/1110990864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a6c0c9560 msgr2=0x7f4a6c1f4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:06.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.090+0000 7f4a719d0640 1 --2- 172.21.15.5:0/1110990864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a6c0c9560 0x7f4a6c1f4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:06.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.090+0000 7f4a719d0640 1 -- 172.21.15.5:0/1110990864 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a680094d0 con 0x7f4a6c0c8ad0 2023-07-14T13:06:06.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.090+0000 7f4a721d1640 1 --2- 172.21.15.5:0/1110990864 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a6c158ce0 0x7f4a6c0c5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:06:06.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.090+0000 7f4a719d0640 1 --2- 172.21.15.5:0/1110990864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6c0c8ad0 0x7f4a6c0c5230 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f4a680ae040 tx=0x7f4a68019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:06.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.090+0000 7f4a627fc640 1 -- 172.21.15.5:0/1110990864 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a680b4640 con 0x7f4a6c0c8ad0 2023-07-14T13:06:06.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.090+0000 7f4a627fc640 1 -- 172.21.15.5:0/1110990864 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a680b47c0 con 0x7f4a6c0c8ad0 2023-07-14T13:06:06.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.090+0000 7f4a627fc640 1 -- 172.21.15.5:0/1110990864 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a680b4b70 con 0x7f4a6c0c8ad0 2023-07-14T13:06:06.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.090+0000 7f4a73c34640 1 -- 172.21.15.5:0/1110990864 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a6c1f7e50 con 0x7f4a6c0c8ad0 2023-07-14T13:06:06.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.090+0000 7f4a73c34640 1 -- 172.21.15.5:0/1110990864 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6c1f8410 con 0x7f4a6c0c8ad0 2023-07-14T13:06:06.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.090+0000 7f4a73c34640 1 -- 172.21.15.5:0/1110990864 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a6c0ca1a0 con 0x7f4a6c0c8ad0 2023-07-14T13:06:06.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.090+0000 7f4a627fc640 1 -- 172.21.15.5:0/1110990864 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4a680b2070 con 0x7f4a6c0c8ad0 2023-07-14T13:06:06.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.094+0000 7f4a627fc640 1 --2- 172.21.15.5:0/1110990864 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f4a500663a0 0x7f4a50068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:06.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.094+0000 7f4a627fc640 1 -- 172.21.15.5:0/1110990864 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4a6811dfe0 con 0x7f4a6c0c8ad0 2023-07-14T13:06:06.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.094+0000 7f4a711cf640 1 --2- 172.21.15.5:0/1110990864 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f4a500663a0 0x7f4a50068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:06.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.094+0000 7f4a711cf640 1 --2- 172.21.15.5:0/1110990864 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f4a500663a0 0x7f4a50068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c14edb0 tx=0x7f4a5c008040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:06.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.098+0000 7f4a627fc640 1 -- 172.21.15.5:0/1110990864 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4a680eb1c0 con 0x7f4a6c0c8ad0 2023-07-14T13:06:06.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.250+0000 7f4a73c34640 1 -- 172.21.15.5:0/1110990864 --> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4a6c070990 con 0x7f4a500663a0 2023-07-14T13:06:06.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.258+0000 7f4a627fc640 1 -- 172.21.15.5:0/1110990864 <== mgr.5695 v2:172.21.15.154:6832/1810553301 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305582 (secure 0 0 0) 0x7f4a5c00be80 con 0x7f4a500663a0 2023-07-14T13:06:06.292 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:06:06.293 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:06:06.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.262+0000 7f4a73c34640 1 -- 172.21.15.5:0/1110990864 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f4a500663a0 msgr2=0x7f4a50068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:06.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.262+0000 7f4a73c34640 1 --2- 172.21.15.5:0/1110990864 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f4a500663a0 0x7f4a50068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c14edb0 tx=0x7f4a5c008040 comp rx=0 tx=0).stop 2023-07-14T13:06:06.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.262+0000 7f4a73c34640 1 -- 172.21.15.5:0/1110990864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6c0c8ad0 msgr2=0x7f4a6c0c5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:06.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.262+0000 7f4a73c34640 1 --2- 172.21.15.5:0/1110990864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6c0c8ad0 0x7f4a6c0c5230 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f4a680ae040 tx=0x7f4a68019150 comp rx=0 tx=0).stop 2023-07-14T13:06:06.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.262+0000 7f4a73c34640 1 -- 172.21.15.5:0/1110990864 shutdown_connections 2023-07-14T13:06:06.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.262+0000 7f4a73c34640 1 --2- 172.21.15.5:0/1110990864 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f4a500663a0 0x7f4a50068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:06.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.262+0000 7f4a73c34640 1 --2- 172.21.15.5:0/1110990864 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a6c158ce0 0x7f4a6c0c5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:06.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.262+0000 7f4a73c34640 1 --2- 172.21.15.5:0/1110990864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a6c0c9560 0x7f4a6c1f4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:06.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.262+0000 7f4a73c34640 1 --2- 172.21.15.5:0/1110990864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6c0c8ad0 0x7f4a6c0c5230 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:06.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.262+0000 7f4a73c34640 1 -- 172.21.15.5:0/1110990864 >> 172.21.15.5:0/1110990864 conn(0x7f4a6c0afcf0 msgr2=0x7f4a6c06bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:06.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.262+0000 7f4a73c34640 1 -- 172.21.15.5:0/1110990864 shutdown_connections 2023-07-14T13:06:06.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.262+0000 7f4a73c34640 1 -- 172.21.15.5:0/1110990864 wait complete. 2023-07-14T13:06:06.313 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-14T13:06:05.544750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":307848,"kb_used_data":6984,"kb_used_omap":0,"kb_used_meta":300800,"kb_avail":754666872,"statfs":{"total":773094113280,"available":772778876928,"internally_reserved":0,"allocated":7151616,"data_stored":4102306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308019200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.807432"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.748761+0000","last_change":"2023-07-14T13:06:00.748761+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.748761+0000","last_undegraded":"2023-07-14T13:06:00.748761+0000","last_fullsized":"2023-07-14T13:06:00.748761+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.754379+0000","last_change":"2023-07-14T13:06:00.754379+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.754379+0000","last_undegraded":"2023-07-14T13:06:00.754379+0000","last_fullsized":"2023-07-14T13:06:00.754379+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.747815+0000","last_change":"2023-07-14T13:06:00.747815+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.747815+0000","last_undegraded":"2023-07-14T13:06:00.747815+0000","last_fullsized":"2023-07-14T13:06:00.747815+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.753107+0000","last_change":"2023-07-14T13:06:00.753107+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.753107+0000","last_undegraded":"2023-07-14T13:06:00.753107+0000","last_fullsized":"2023-07-14T13:06:00.753107+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751429+0000","last_change":"2023-07-14T13:06:00.751429+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751429+0000","last_undegraded":"2023-07-14T13:06:00.751429+0000","last_fullsized":"2023-07-14T13:06:00.751429+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.744387+0000","last_change":"2023-07-14T13:06:00.744387+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.744387+0000","last_undegraded":"2023-07-14T13:06:00.744387+0000","last_fullsized":"2023-07-14T13:06:00.744387+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.744820+0000","last_change":"2023-07-14T13:06:00.744820+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.744820+0000","last_undegraded":"2023-07-14T13:06:00.744820+0000","last_fullsized":"2023-07-14T13:06:00.744820+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.744099+0000","last_change":"2023-07-14T13:06:00.744099+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.744099+0000","last_undegraded":"2023-07-14T13:06:00.744099+0000","last_fullsized":"2023-07-14T13:06:00.744099+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743374+0000","last_change":"2023-07-14T13:06:00.743374+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743374+0000","last_undegraded":"2023-07-14T13:06:00.743374+0000","last_fullsized":"2023-07-14T13:06:00.743374+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.748675+0000","last_change":"2023-07-14T13:06:00.748675+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.748675+0000","last_undegraded":"2023-07-14T13:06:00.748675+0000","last_fullsized":"2023-07-14T13:06:00.748675+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.744940+0000","last_change":"2023-07-14T13:06:00.744940+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.744940+0000","last_undegraded":"2023-07-14T13:06:00.744940+0000","last_fullsized":"2023-07-14T13:06:00.744940+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743067+0000","last_change":"2023-07-14T13:06:00.743067+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743067+0000","last_undegraded":"2023-07-14T13:06:00.743067+0000","last_fullsized":"2023-07-14T13:06:00.743067+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.752149+0000","last_change":"2023-07-14T13:06:00.752149+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.752149+0000","last_undegraded":"2023-07-14T13:06:00.752149+0000","last_fullsized":"2023-07-14T13:06:00.752149+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.748588+0000","last_change":"2023-07-14T13:06:00.748588+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.748588+0000","last_undegraded":"2023-07-14T13:06:00.748588+0000","last_fullsized":"2023-07-14T13:06:00.748588+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.755332+0000","last_change":"2023-07-14T13:06:00.755332+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.755332+0000","last_undegraded":"2023-07-14T13:06:00.755332+0000","last_fullsized":"2023-07-14T13:06:00.755332+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750787+0000","last_change":"2023-07-14T13:06:00.750787+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750787+0000","last_undegraded":"2023-07-14T13:06:00.750787+0000","last_fullsized":"2023-07-14T13:06:00.750787+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.746739+0000","last_change":"2023-07-14T13:06:00.746739+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.746739+0000","last_undegraded":"2023-07-14T13:06:00.746739+0000","last_fullsized":"2023-07-14T13:06:00.746739+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.749397+0000","last_change":"2023-07-14T13:06:00.749397+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.749397+0000","last_undegraded":"2023-07-14T13:06:00.749397+0000","last_fullsized":"2023-07-14T13:06:00.749397+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.747489+0000","last_change":"2023-07-14T13:06:00.747489+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.747489+0000","last_undegraded":"2023-07-14T13:06:00.747489+0000","last_fullsized":"2023-07-14T13:06:00.747489+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.746486+0000","last_change":"2023-07-14T13:06:00.746486+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.746486+0000","last_undegraded":"2023-07-14T13:06:00.746486+0000","last_fullsized":"2023-07-14T13:06:00.746486+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.745688+0000","last_change":"2023-07-14T13:06:00.745688+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.745688+0000","last_undegraded":"2023-07-14T13:06:00.745688+0000","last_fullsized":"2023-07-14T13:06:00.745688+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743004+0000","last_change":"2023-07-14T13:06:00.743004+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743004+0000","last_undegraded":"2023-07-14T13:06:00.743004+0000","last_fullsized":"2023-07-14T13:06:00.743004+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.745492+0000","last_change":"2023-07-14T13:06:00.745492+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.745492+0000","last_undegraded":"2023-07-14T13:06:00.745492+0000","last_fullsized":"2023-07-14T13:06:00.745492+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.742309+0000","last_change":"2023-07-14T13:06:00.742309+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.742309+0000","last_undegraded":"2023-07-14T13:06:00.742309+0000","last_fullsized":"2023-07-14T13:06:00.742309+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743183+0000","last_change":"2023-07-14T13:06:00.743183+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743183+0000","last_undegraded":"2023-07-14T13:06:00.743183+0000","last_fullsized":"2023-07-14T13:06:00.743183+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.748463+0000","last_change":"2023-07-14T13:06:00.748463+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.748463+0000","last_undegraded":"2023-07-14T13:06:00.748463+0000","last_fullsized":"2023-07-14T13:06:00.748463+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743994+0000","last_change":"2023-07-14T13:06:00.743994+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743994+0000","last_undegraded":"2023-07-14T13:06:00.743994+0000","last_fullsized":"2023-07-14T13:06:00.743994+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.745322+0000","last_change":"2023-07-14T13:06:00.745322+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.745322+0000","last_undegraded":"2023-07-14T13:06:00.745322+0000","last_fullsized":"2023-07-14T13:06:00.745322+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743892+0000","last_change":"2023-07-14T13:06:00.743892+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743892+0000","last_undegraded":"2023-07-14T13:06:00.743892+0000","last_fullsized":"2023-07-14T13:06:00.743892+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750152+0000","last_change":"2023-07-14T13:06:00.750152+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750152+0000","last_undegraded":"2023-07-14T13:06:00.750152+0000","last_fullsized":"2023-07-14T13:06:00.750152+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743608+0000","last_change":"2023-07-14T13:06:00.743608+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743608+0000","last_undegraded":"2023-07-14T13:06:00.743608+0000","last_fullsized":"2023-07-14T13:06:00.743608+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751944+0000","last_change":"2023-07-14T13:06:00.751944+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751944+0000","last_undegraded":"2023-07-14T13:06:00.751944+0000","last_fullsized":"2023-07-14T13:06:00.751944+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.755014+0000","last_change":"2023-07-14T13:06:00.755014+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.755014+0000","last_undegraded":"2023-07-14T13:06:00.755014+0000","last_fullsized":"2023-07-14T13:06:00.755014+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.761559+0000","last_change":"2023-07-14T13:06:00.756132+0000","last_active":"2023-07-14T13:06:00.761559+0000","last_peered":"2023-07-14T13:06:00.761559+0000","last_clean":"2023-07-14T13:06:00.761559+0000","last_became_active":"2023-07-14T13:06:00.755507+0000","last_became_peered":"2023-07-14T13:06:00.755507+0000","last_unstale":"2023-07-14T13:06:00.761559+0000","last_undegraded":"2023-07-14T13:06:00.761559+0000","last_fullsized":"2023-07-14T13:06:00.761559+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:44:35.427825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750889+0000","last_change":"2023-07-14T13:06:00.750889+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750889+0000","last_undegraded":"2023-07-14T13:06:00.750889+0000","last_fullsized":"2023-07-14T13:06:00.750889+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765663+0000","last_change":"2023-07-14T13:06:00.761498+0000","last_active":"2023-07-14T13:06:00.765663+0000","last_peered":"2023-07-14T13:06:00.765663+0000","last_clean":"2023-07-14T13:06:00.765663+0000","last_became_active":"2023-07-14T13:06:00.761218+0000","last_became_peered":"2023-07-14T13:06:00.761218+0000","last_unstale":"2023-07-14T13:06:00.765663+0000","last_undegraded":"2023-07-14T13:06:00.765663+0000","last_fullsized":"2023-07-14T13:06:00.765663+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:04:43.245058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.745320+0000","last_change":"2023-07-14T13:06:00.745320+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.745320+0000","last_undegraded":"2023-07-14T13:06:00.745320+0000","last_fullsized":"2023-07-14T13:06:00.745320+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.761184+0000","last_change":"2023-07-14T13:06:00.754529+0000","last_active":"2023-07-14T13:06:00.761184+0000","last_peered":"2023-07-14T13:06:00.761184+0000","last_clean":"2023-07-14T13:06:00.761184+0000","last_became_active":"2023-07-14T13:06:00.754227+0000","last_became_peered":"2023-07-14T13:06:00.754227+0000","last_unstale":"2023-07-14T13:06:00.761184+0000","last_undegraded":"2023-07-14T13:06:00.761184+0000","last_fullsized":"2023-07-14T13:06:00.761184+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:28.800346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.746995+0000","last_change":"2023-07-14T13:06:00.746995+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.746995+0000","last_undegraded":"2023-07-14T13:06:00.746995+0000","last_fullsized":"2023-07-14T13:06:00.746995+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765149+0000","last_change":"2023-07-14T13:06:00.763143+0000","last_active":"2023-07-14T13:06:00.765149+0000","last_peered":"2023-07-14T13:06:00.765149+0000","last_clean":"2023-07-14T13:06:00.765149+0000","last_became_active":"2023-07-14T13:06:00.762841+0000","last_became_peered":"2023-07-14T13:06:00.762841+0000","last_unstale":"2023-07-14T13:06:00.765149+0000","last_undegraded":"2023-07-14T13:06:00.765149+0000","last_fullsized":"2023-07-14T13:06:00.765149+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:05:53.281408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750581+0000","last_change":"2023-07-14T13:06:00.750581+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750581+0000","last_undegraded":"2023-07-14T13:06:00.750581+0000","last_fullsized":"2023-07-14T13:06:00.750581+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.761705+0000","last_change":"2023-07-14T13:06:00.756771+0000","last_active":"2023-07-14T13:06:00.761705+0000","last_peered":"2023-07-14T13:06:00.761705+0000","last_clean":"2023-07-14T13:06:00.761705+0000","last_became_active":"2023-07-14T13:06:00.756496+0000","last_became_peered":"2023-07-14T13:06:00.756496+0000","last_unstale":"2023-07-14T13:06:00.761705+0000","last_undegraded":"2023-07-14T13:06:00.761705+0000","last_fullsized":"2023-07-14T13:06:00.761705+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:12:25.869710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.749693+0000","last_change":"2023-07-14T13:06:00.749693+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.749693+0000","last_undegraded":"2023-07-14T13:06:00.749693+0000","last_fullsized":"2023-07-14T13:06:00.749693+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.757339+0000","last_change":"2023-07-14T13:06:00.756414+0000","last_active":"2023-07-14T13:06:00.757339+0000","last_peered":"2023-07-14T13:06:00.757339+0000","last_clean":"2023-07-14T13:06:00.757339+0000","last_became_active":"2023-07-14T13:06:00.755350+0000","last_became_peered":"2023-07-14T13:06:00.755350+0000","last_unstale":"2023-07-14T13:06:00.757339+0000","last_undegraded":"2023-07-14T13:06:00.757339+0000","last_fullsized":"2023-07-14T13:06:00.757339+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:04:43.245058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.741690+0000","last_change":"2023-07-14T13:06:00.741690+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.741690+0000","last_undegraded":"2023-07-14T13:06:00.741690+0000","last_fullsized":"2023-07-14T13:06:00.741690+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.768245+0000","last_change":"2023-07-14T13:06:00.764991+0000","last_active":"2023-07-14T13:06:00.768245+0000","last_peered":"2023-07-14T13:06:00.768245+0000","last_clean":"2023-07-14T13:06:00.768245+0000","last_became_active":"2023-07-14T13:06:00.764498+0000","last_became_peered":"2023-07-14T13:06:00.764498+0000","last_unstale":"2023-07-14T13:06:00.768245+0000","last_undegraded":"2023-07-14T13:06:00.768245+0000","last_fullsized":"2023-07-14T13:06:00.768245+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:24:37.042404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.753601+0000","last_change":"2023-07-14T13:06:00.753601+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.753601+0000","last_undegraded":"2023-07-14T13:06:00.753601+0000","last_fullsized":"2023-07-14T13:06:00.753601+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.756207+0000","last_change":"2023-07-14T13:06:00.752505+0000","last_active":"2023-07-14T13:06:00.756207+0000","last_peered":"2023-07-14T13:06:00.756207+0000","last_clean":"2023-07-14T13:06:00.756207+0000","last_became_active":"2023-07-14T13:06:00.752152+0000","last_became_peered":"2023-07-14T13:06:00.752152+0000","last_unstale":"2023-07-14T13:06:00.756207+0000","last_undegraded":"2023-07-14T13:06:00.756207+0000","last_fullsized":"2023-07-14T13:06:00.756207+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:01:19.219338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.749729+0000","last_change":"2023-07-14T13:06:00.749729+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.749729+0000","last_undegraded":"2023-07-14T13:06:00.749729+0000","last_fullsized":"2023-07-14T13:06:00.749729+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767626+0000","last_change":"2023-07-14T13:06:00.763540+0000","last_active":"2023-07-14T13:06:00.767626+0000","last_peered":"2023-07-14T13:06:00.767626+0000","last_clean":"2023-07-14T13:06:00.767626+0000","last_became_active":"2023-07-14T13:06:00.763248+0000","last_became_peered":"2023-07-14T13:06:00.763248+0000","last_unstale":"2023-07-14T13:06:00.767626+0000","last_undegraded":"2023-07-14T13:06:00.767626+0000","last_fullsized":"2023-07-14T13:06:00.767626+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:17:30.938068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751489+0000","last_change":"2023-07-14T13:06:00.751489+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751489+0000","last_undegraded":"2023-07-14T13:06:00.751489+0000","last_fullsized":"2023-07-14T13:06:00.751489+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765550+0000","last_change":"2023-07-14T13:06:00.762491+0000","last_active":"2023-07-14T13:06:00.765550+0000","last_peered":"2023-07-14T13:06:00.765550+0000","last_clean":"2023-07-14T13:06:00.765550+0000","last_became_active":"2023-07-14T13:06:00.762242+0000","last_became_peered":"2023-07-14T13:06:00.762242+0000","last_unstale":"2023-07-14T13:06:00.765550+0000","last_undegraded":"2023-07-14T13:06:00.765550+0000","last_fullsized":"2023-07-14T13:06:00.765550+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:54:08.359442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.742869+0000","last_change":"2023-07-14T13:06:00.742869+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.742869+0000","last_undegraded":"2023-07-14T13:06:00.742869+0000","last_fullsized":"2023-07-14T13:06:00.742869+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.769883+0000","last_change":"2023-07-14T13:06:00.769317+0000","last_active":"2023-07-14T13:06:00.769883+0000","last_peered":"2023-07-14T13:06:00.769883+0000","last_clean":"2023-07-14T13:06:00.769883+0000","last_became_active":"2023-07-14T13:06:00.768989+0000","last_became_peered":"2023-07-14T13:06:00.768989+0000","last_unstale":"2023-07-14T13:06:00.769883+0000","last_undegraded":"2023-07-14T13:06:00.769883+0000","last_fullsized":"2023-07-14T13:06:00.769883+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:04:25.791755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750209+0000","last_change":"2023-07-14T13:06:00.750209+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750209+0000","last_undegraded":"2023-07-14T13:06:00.750209+0000","last_fullsized":"2023-07-14T13:06:00.750209+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767765+0000","last_change":"2023-07-14T13:06:00.758935+0000","last_active":"2023-07-14T13:06:00.767765+0000","last_peered":"2023-07-14T13:06:00.767765+0000","last_clean":"2023-07-14T13:06:00.767765+0000","last_became_active":"2023-07-14T13:06:00.758549+0000","last_became_peered":"2023-07-14T13:06:00.758549+0000","last_unstale":"2023-07-14T13:06:00.767765+0000","last_undegraded":"2023-07-14T13:06:00.767765+0000","last_fullsized":"2023-07-14T13:06:00.767765+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:04:31.512964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751561+0000","last_change":"2023-07-14T13:06:00.751561+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751561+0000","last_undegraded":"2023-07-14T13:06:00.751561+0000","last_fullsized":"2023-07-14T13:06:00.751561+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765931+0000","last_change":"2023-07-14T13:06:00.763008+0000","last_active":"2023-07-14T13:06:00.765931+0000","last_peered":"2023-07-14T13:06:00.765931+0000","last_clean":"2023-07-14T13:06:00.765931+0000","last_became_active":"2023-07-14T13:06:00.762695+0000","last_became_peered":"2023-07-14T13:06:00.762695+0000","last_unstale":"2023-07-14T13:06:00.765931+0000","last_undegraded":"2023-07-14T13:06:00.765931+0000","last_fullsized":"2023-07-14T13:06:00.765931+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:30:32.352281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.744200+0000","last_change":"2023-07-14T13:06:00.744200+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.744200+0000","last_undegraded":"2023-07-14T13:06:00.744200+0000","last_fullsized":"2023-07-14T13:06:00.744200+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767365+0000","last_change":"2023-07-14T13:06:00.761495+0000","last_active":"2023-07-14T13:06:00.767365+0000","last_peered":"2023-07-14T13:06:00.767365+0000","last_clean":"2023-07-14T13:06:00.767365+0000","last_became_active":"2023-07-14T13:06:00.761218+0000","last_became_peered":"2023-07-14T13:06:00.761218+0000","last_unstale":"2023-07-14T13:06:00.767365+0000","last_undegraded":"2023-07-14T13:06:00.767365+0000","last_fullsized":"2023-07-14T13:06:00.767365+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:21:08.411166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.742230+0000","last_change":"2023-07-14T13:06:00.742230+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.742230+0000","last_undegraded":"2023-07-14T13:06:00.742230+0000","last_fullsized":"2023-07-14T13:06:00.742230+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767635+0000","last_change":"2023-07-14T13:06:00.763951+0000","last_active":"2023-07-14T13:06:00.767635+0000","last_peered":"2023-07-14T13:06:00.767635+0000","last_clean":"2023-07-14T13:06:00.767635+0000","last_became_active":"2023-07-14T13:06:00.763697+0000","last_became_peered":"2023-07-14T13:06:00.763697+0000","last_unstale":"2023-07-14T13:06:00.767635+0000","last_undegraded":"2023-07-14T13:06:00.767635+0000","last_fullsized":"2023-07-14T13:06:00.767635+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:18:44.339283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.747222+0000","last_change":"2023-07-14T13:06:00.747222+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.747222+0000","last_undegraded":"2023-07-14T13:06:00.747222+0000","last_fullsized":"2023-07-14T13:06:00.747222+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767712+0000","last_change":"2023-07-14T13:06:00.759768+0000","last_active":"2023-07-14T13:06:00.767712+0000","last_peered":"2023-07-14T13:06:00.767712+0000","last_clean":"2023-07-14T13:06:00.767712+0000","last_became_active":"2023-07-14T13:06:00.758411+0000","last_became_peered":"2023-07-14T13:06:00.758411+0000","last_unstale":"2023-07-14T13:06:00.767712+0000","last_undegraded":"2023-07-14T13:06:00.767712+0000","last_fullsized":"2023-07-14T13:06:00.767712+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:52:03.642841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743629+0000","last_change":"2023-07-14T13:06:00.743629+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743629+0000","last_undegraded":"2023-07-14T13:06:00.743629+0000","last_fullsized":"2023-07-14T13:06:00.743629+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.763479+0000","last_change":"2023-07-14T13:06:00.761474+0000","last_active":"2023-07-14T13:06:00.763479+0000","last_peered":"2023-07-14T13:06:00.763479+0000","last_clean":"2023-07-14T13:06:00.763479+0000","last_became_active":"2023-07-14T13:06:00.761216+0000","last_became_peered":"2023-07-14T13:06:00.761216+0000","last_unstale":"2023-07-14T13:06:00.763479+0000","last_undegraded":"2023-07-14T13:06:00.763479+0000","last_fullsized":"2023-07-14T13:06:00.763479+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:56:31.037462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750336+0000","last_change":"2023-07-14T13:06:00.750336+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750336+0000","last_undegraded":"2023-07-14T13:06:00.750336+0000","last_fullsized":"2023-07-14T13:06:00.750336+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.763883+0000","last_change":"2023-07-14T13:06:00.760343+0000","last_active":"2023-07-14T13:06:00.763883+0000","last_peered":"2023-07-14T13:06:00.763883+0000","last_clean":"2023-07-14T13:06:00.763883+0000","last_became_active":"2023-07-14T13:06:00.760062+0000","last_became_peered":"2023-07-14T13:06:00.760062+0000","last_unstale":"2023-07-14T13:06:00.763883+0000","last_undegraded":"2023-07-14T13:06:00.763883+0000","last_fullsized":"2023-07-14T13:06:00.763883+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:43:01.259058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.749674+0000","last_change":"2023-07-14T13:06:00.749674+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.749674+0000","last_undegraded":"2023-07-14T13:06:00.749674+0000","last_fullsized":"2023-07-14T13:06:00.749674+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767418+0000","last_change":"2023-07-14T13:06:00.762635+0000","last_active":"2023-07-14T13:06:00.767418+0000","last_peered":"2023-07-14T13:06:00.767418+0000","last_clean":"2023-07-14T13:06:00.767418+0000","last_became_active":"2023-07-14T13:06:00.762384+0000","last_became_peered":"2023-07-14T13:06:00.762384+0000","last_unstale":"2023-07-14T13:06:00.767418+0000","last_undegraded":"2023-07-14T13:06:00.767418+0000","last_fullsized":"2023-07-14T13:06:00.767418+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:22.137266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751703+0000","last_change":"2023-07-14T13:06:00.751703+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751703+0000","last_undegraded":"2023-07-14T13:06:00.751703+0000","last_fullsized":"2023-07-14T13:06:00.751703+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767466+0000","last_change":"2023-07-14T13:06:00.761859+0000","last_active":"2023-07-14T13:06:00.767466+0000","last_peered":"2023-07-14T13:06:00.767466+0000","last_clean":"2023-07-14T13:06:00.767466+0000","last_became_active":"2023-07-14T13:06:00.761595+0000","last_became_peered":"2023-07-14T13:06:00.761595+0000","last_unstale":"2023-07-14T13:06:00.767466+0000","last_undegraded":"2023-07-14T13:06:00.767466+0000","last_fullsized":"2023-07-14T13:06:00.767466+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:22:48.786505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751015+0000","last_change":"2023-07-14T13:06:00.751015+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751015+0000","last_undegraded":"2023-07-14T13:06:00.751015+0000","last_fullsized":"2023-07-14T13:06:00.751015+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765674+0000","last_change":"2023-07-14T13:06:00.761520+0000","last_active":"2023-07-14T13:06:00.765674+0000","last_peered":"2023-07-14T13:06:00.765674+0000","last_clean":"2023-07-14T13:06:00.765674+0000","last_became_active":"2023-07-14T13:06:00.761245+0000","last_became_peered":"2023-07-14T13:06:00.761245+0000","last_unstale":"2023-07-14T13:06:00.765674+0000","last_undegraded":"2023-07-14T13:06:00.765674+0000","last_fullsized":"2023-07-14T13:06:00.765674+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:54:08.359442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.746672+0000","last_change":"2023-07-14T13:06:00.746672+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.746672+0000","last_undegraded":"2023-07-14T13:06:00.746672+0000","last_fullsized":"2023-07-14T13:06:00.746672+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767614+0000","last_change":"2023-07-14T13:06:00.759041+0000","last_active":"2023-07-14T13:06:00.767614+0000","last_peered":"2023-07-14T13:06:00.767614+0000","last_clean":"2023-07-14T13:06:00.767614+0000","last_became_active":"2023-07-14T13:06:00.758732+0000","last_became_peered":"2023-07-14T13:06:00.758732+0000","last_unstale":"2023-07-14T13:06:00.767614+0000","last_undegraded":"2023-07-14T13:06:00.767614+0000","last_fullsized":"2023-07-14T13:06:00.767614+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:31:07.335972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.747138+0000","last_change":"2023-07-14T13:06:00.747138+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.747138+0000","last_undegraded":"2023-07-14T13:06:00.747138+0000","last_fullsized":"2023-07-14T13:06:00.747138+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765404+0000","last_change":"2023-07-14T13:06:00.762299+0000","last_active":"2023-07-14T13:06:00.765404+0000","last_peered":"2023-07-14T13:06:00.765404+0000","last_clean":"2023-07-14T13:06:00.765404+0000","last_became_active":"2023-07-14T13:06:00.761975+0000","last_became_peered":"2023-07-14T13:06:00.761975+0000","last_unstale":"2023-07-14T13:06:00.765404+0000","last_undegraded":"2023-07-14T13:06:00.765404+0000","last_fullsized":"2023-07-14T13:06:00.765404+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:41:42.646912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.748258+0000","last_change":"2023-07-14T13:06:00.748258+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.748258+0000","last_undegraded":"2023-07-14T13:06:00.748258+0000","last_fullsized":"2023-07-14T13:06:00.748258+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.764023+0000","last_change":"2023-07-14T13:06:00.762395+0000","last_active":"2023-07-14T13:06:00.764023+0000","last_peered":"2023-07-14T13:06:00.764023+0000","last_clean":"2023-07-14T13:06:00.764023+0000","last_became_active":"2023-07-14T13:06:00.762022+0000","last_became_peered":"2023-07-14T13:06:00.762022+0000","last_unstale":"2023-07-14T13:06:00.764023+0000","last_undegraded":"2023-07-14T13:06:00.764023+0000","last_fullsized":"2023-07-14T13:06:00.764023+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:02:08.227992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.745329+0000","last_change":"2023-07-14T13:06:00.745329+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.745329+0000","last_undegraded":"2023-07-14T13:06:00.745329+0000","last_fullsized":"2023-07-14T13:06:00.745329+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765902+0000","last_change":"2023-07-14T13:06:00.762994+0000","last_active":"2023-07-14T13:06:00.765902+0000","last_peered":"2023-07-14T13:06:00.765902+0000","last_clean":"2023-07-14T13:06:00.765902+0000","last_became_active":"2023-07-14T13:06:00.762704+0000","last_became_peered":"2023-07-14T13:06:00.762704+0000","last_unstale":"2023-07-14T13:06:00.765902+0000","last_undegraded":"2023-07-14T13:06:00.765902+0000","last_fullsized":"2023-07-14T13:06:00.765902+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:50:34.298484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"53'139","reported_seq":333,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.759241+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:06:00.759241+0000","last_peered":"2023-07-14T13:06:00.759241+0000","last_clean":"2023-07-14T13:06:00.759241+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:06:00.759241+0000","last_undegraded":"2023-07-14T13:06:00.759241+0000","last_fullsized":"2023-07-14T13:06:00.759241+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:25:19.700060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":99,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.753574+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:06:00.753574+0000","last_peered":"2023-07-14T13:06:00.753574+0000","last_clean":"2023-07-14T13:06:00.753574+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:06:00.753574+0000","last_undegraded":"2023-07-14T13:06:00.753574+0000","last_fullsized":"2023-07-14T13:06:00.753574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:46:51.928482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743863+0000","last_change":"2023-07-14T13:06:00.743863+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743863+0000","last_undegraded":"2023-07-14T13:06:00.743863+0000","last_fullsized":"2023-07-14T13:06:00.743863+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.768707+0000","last_change":"2023-07-14T13:06:00.766325+0000","last_active":"2023-07-14T13:06:00.768707+0000","last_peered":"2023-07-14T13:06:00.768707+0000","last_clean":"2023-07-14T13:06:00.768707+0000","last_became_active":"2023-07-14T13:06:00.766116+0000","last_became_peered":"2023-07-14T13:06:00.766116+0000","last_unstale":"2023-07-14T13:06:00.768707+0000","last_undegraded":"2023-07-14T13:06:00.768707+0000","last_fullsized":"2023-07-14T13:06:00.768707+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:47:41.009818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":99,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.759100+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:06:00.759100+0000","last_peered":"2023-07-14T13:06:00.759100+0000","last_clean":"2023-07-14T13:06:00.759100+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:06:00.759100+0000","last_undegraded":"2023-07-14T13:06:00.759100+0000","last_fullsized":"2023-07-14T13:06:00.759100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:06:36.972485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.746502+0000","last_change":"2023-07-14T13:06:00.746502+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.746502+0000","last_undegraded":"2023-07-14T13:06:00.746502+0000","last_fullsized":"2023-07-14T13:06:00.746502+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.756244+0000","last_change":"2023-07-14T13:06:00.752570+0000","last_active":"2023-07-14T13:06:00.756244+0000","last_peered":"2023-07-14T13:06:00.756244+0000","last_clean":"2023-07-14T13:06:00.756244+0000","last_became_active":"2023-07-14T13:06:00.752307+0000","last_became_peered":"2023-07-14T13:06:00.752307+0000","last_unstale":"2023-07-14T13:06:00.756244+0000","last_undegraded":"2023-07-14T13:06:00.756244+0000","last_fullsized":"2023-07-14T13:06:00.756244+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:42:22.518638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.738618+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:06:00.738618+0000","last_peered":"2023-07-14T13:06:00.738618+0000","last_clean":"2023-07-14T13:06:00.738618+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:06:00.738618+0000","last_undegraded":"2023-07-14T13:06:00.738618+0000","last_fullsized":"2023-07-14T13:06:00.738618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:32:53.565488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751428+0000","last_change":"2023-07-14T13:06:00.751428+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751428+0000","last_undegraded":"2023-07-14T13:06:00.751428+0000","last_fullsized":"2023-07-14T13:06:00.751428+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.764726+0000","last_change":"2023-07-14T13:06:00.760649+0000","last_active":"2023-07-14T13:06:00.764726+0000","last_peered":"2023-07-14T13:06:00.764726+0000","last_clean":"2023-07-14T13:06:00.764726+0000","last_became_active":"2023-07-14T13:06:00.760376+0000","last_became_peered":"2023-07-14T13:06:00.760376+0000","last_unstale":"2023-07-14T13:06:00.764726+0000","last_undegraded":"2023-07-14T13:06:00.764726+0000","last_fullsized":"2023-07-14T13:06:00.764726+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:12:44.502720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":99,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.753411+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:06:00.753411+0000","last_peered":"2023-07-14T13:06:00.753411+0000","last_clean":"2023-07-14T13:06:00.753411+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:06:00.753411+0000","last_undegraded":"2023-07-14T13:06:00.753411+0000","last_fullsized":"2023-07-14T13:06:00.753411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:59:19.438385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.747627+0000","last_change":"2023-07-14T13:06:00.747627+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.747627+0000","last_undegraded":"2023-07-14T13:06:00.747627+0000","last_fullsized":"2023-07-14T13:06:00.747627+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765589+0000","last_change":"2023-07-14T13:06:00.762610+0000","last_active":"2023-07-14T13:06:00.765589+0000","last_peered":"2023-07-14T13:06:00.765589+0000","last_clean":"2023-07-14T13:06:00.765589+0000","last_became_active":"2023-07-14T13:06:00.762305+0000","last_became_peered":"2023-07-14T13:06:00.762305+0000","last_unstale":"2023-07-14T13:06:00.765589+0000","last_undegraded":"2023-07-14T13:06:00.765589+0000","last_fullsized":"2023-07-14T13:06:00.765589+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:28.800346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":101,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.752612+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:06:00.752612+0000","last_peered":"2023-07-14T13:06:00.752612+0000","last_clean":"2023-07-14T13:06:00.752612+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:06:00.752612+0000","last_undegraded":"2023-07-14T13:06:00.752612+0000","last_fullsized":"2023-07-14T13:06:00.752612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:08.341386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.742916+0000","last_change":"2023-07-14T13:06:00.742916+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.742916+0000","last_undegraded":"2023-07-14T13:06:00.742916+0000","last_fullsized":"2023-07-14T13:06:00.742916+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.769021+0000","last_change":"2023-07-14T13:06:00.768010+0000","last_active":"2023-07-14T13:06:00.769021+0000","last_peered":"2023-07-14T13:06:00.769021+0000","last_clean":"2023-07-14T13:06:00.769021+0000","last_became_active":"2023-07-14T13:06:00.767670+0000","last_became_peered":"2023-07-14T13:06:00.767670+0000","last_unstale":"2023-07-14T13:06:00.769021+0000","last_undegraded":"2023-07-14T13:06:00.769021+0000","last_fullsized":"2023-07-14T13:06:00.769021+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:50:18.541594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":99,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.760517+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:06:00.760517+0000","last_peered":"2023-07-14T13:06:00.760517+0000","last_clean":"2023-07-14T13:06:00.760517+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:06:00.760517+0000","last_undegraded":"2023-07-14T13:06:00.760517+0000","last_fullsized":"2023-07-14T13:06:00.760517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:41:25.696130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.745965+0000","last_change":"2023-07-14T13:06:00.745965+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.745965+0000","last_undegraded":"2023-07-14T13:06:00.745965+0000","last_fullsized":"2023-07-14T13:06:00.745965+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765184+0000","last_change":"2023-07-14T13:06:00.757176+0000","last_active":"2023-07-14T13:06:00.765184+0000","last_peered":"2023-07-14T13:06:00.765184+0000","last_clean":"2023-07-14T13:06:00.765184+0000","last_became_active":"2023-07-14T13:06:00.756867+0000","last_became_peered":"2023-07-14T13:06:00.756867+0000","last_unstale":"2023-07-14T13:06:00.765184+0000","last_undegraded":"2023-07-14T13:06:00.765184+0000","last_fullsized":"2023-07-14T13:06:00.765184+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:24:48.579990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":101,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.753404+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:06:00.753404+0000","last_peered":"2023-07-14T13:06:00.753404+0000","last_clean":"2023-07-14T13:06:00.753404+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:06:00.753404+0000","last_undegraded":"2023-07-14T13:06:00.753404+0000","last_fullsized":"2023-07-14T13:06:00.753404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:26:51.965367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750879+0000","last_change":"2023-07-14T13:06:00.750879+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750879+0000","last_undegraded":"2023-07-14T13:06:00.750879+0000","last_fullsized":"2023-07-14T13:06:00.750879+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767941+0000","last_change":"2023-07-14T13:06:00.764320+0000","last_active":"2023-07-14T13:06:00.767941+0000","last_peered":"2023-07-14T13:06:00.767941+0000","last_clean":"2023-07-14T13:06:00.767941+0000","last_became_active":"2023-07-14T13:06:00.764000+0000","last_became_peered":"2023-07-14T13:06:00.764000+0000","last_unstale":"2023-07-14T13:06:00.767941+0000","last_undegraded":"2023-07-14T13:06:00.767941+0000","last_fullsized":"2023-07-14T13:06:00.767941+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:25.774499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":99,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.748597+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:06:00.748597+0000","last_peered":"2023-07-14T13:06:00.748597+0000","last_clean":"2023-07-14T13:06:00.748597+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:06:00.748597+0000","last_undegraded":"2023-07-14T13:06:00.748597+0000","last_fullsized":"2023-07-14T13:06:00.748597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:33:03.441107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575011,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54492,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317348,"statfs":{"total":96636764160,"available":96580964352,"internally_reserved":0,"allocated":1331200,"data_stored":950848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.35699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.85499999999999998,"5min":0.98399999999999999,"15min":1.879},"last":0.746},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.745,"15min":0.74099999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.439},"max":{"1min":0.877,"5min":0.95599999999999996,"15min":1.9059999999999999},"last":0.68100000000000005}]},{"osd":1,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.752,"15min":0.72999999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.42999999999999999},"max":{"1min":0.92600000000000005,"5min":1,"15min":1.069},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.76000000000000001,"15min":0.745},"min":{"1min":0.54000000000000004,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93000000000000005,"5min":0.97399999999999998,"15min":1.1020000000000001},"last":0.72399999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.745,"15min":0.72299999999999998},"min":{"1min":0.46999999999999997,"5min":0.42699999999999999,"15min":0.40600000000000003},"max":{"1min":0.877,"5min":1.016,"15min":1.048},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.77500000000000002,"15min":0.755},"min":{"1min":0.50600000000000001,"5min":0.503,"15min":0.46899999999999997},"max":{"1min":0.89200000000000002,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.69999999999999996}]},{"osd":3,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.753,"15min":0.73199999999999998},"min":{"1min":0.50700000000000001,"5min":0.46400000000000002,"15min":0.442},"max":{"1min":0.98199999999999998,"5min":1.0269999999999999,"15min":1.0760000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.78100000000000003,"15min":0.76000000000000001},"min":{"1min":0.51900000000000002,"5min":0.47299999999999998,"15min":0.41499999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.024},"last":0.51900000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.60899999999999999,"15min":0.58999999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.86299999999999999,"5min":1.022,"15min":1.022},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.40999999999999998,"5min":0.40000000000000002,"15min":0.39300000000000002},"max":{"1min":0.68100000000000005,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.66600000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.63300000000000001,"15min":0.622},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94699999999999995,"5min":0.98299999999999998,"15min":1.0249999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.65300000000000002,"15min":0.67300000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.008},"last":0.55700000000000005}]},{"osd":6,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.70399999999999996,"15min":0.71699999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96699999999999997,"5min":1.0489999999999999,"15min":1.4419999999999999},"last":0.62},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.68700000000000006,"15min":0.69199999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91000000000000003,"5min":0.98199999999999998,"15min":1.575},"last":0.54300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575012,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":749568,"data_stored":367108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.51300000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.89200000000000002,"5min":0.996,"15min":1.2749999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73899999999999999,"15min":0.74199999999999999},"min":{"1min":0.53700000000000003,"5min":0.48199999999999998,"15min":0.47399999999999998},"max":{"1min":1.0209999999999999,"5min":1.03,"15min":1.2110000000000001},"last":0.80600000000000005}]},{"osd":1,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.56499999999999995,"5min":0.50800000000000001,"15min":0.379},"max":{"1min":0.94699999999999995,"5min":1.0209999999999999,"15min":1.4299999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.745,"15min":0.72999999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.44},"max":{"1min":0.97099999999999997,"5min":1.077,"15min":1.1379999999999999},"last":0.88200000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.753,"15min":0.752},"min":{"1min":0.56699999999999995,"5min":0.496,"15min":0.40400000000000003},"max":{"1min":0.94099999999999995,"5min":1.105,"15min":1.319},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77300000000000002,"15min":0.75700000000000001},"min":{"1min":0.59199999999999997,"5min":0.54400000000000004,"15min":0.42299999999999999},"max":{"1min":0.94399999999999995,"5min":1.0900000000000001,"15min":1.341},"last":0.67800000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.79100000000000004,"15min":0.78600000000000003},"min":{"1min":0.53200000000000003,"5min":0.52200000000000002,"15min":0.45600000000000002},"max":{"1min":0.92500000000000004,"5min":1.093,"15min":1.3859999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.79300000000000004,"15min":0.76800000000000002},"min":{"1min":0.58199999999999996,"5min":0.53300000000000003,"15min":0.45900000000000002},"max":{"1min":0.99099999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.85699999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.58099999999999996,"15min":0.58999999999999997},"min":{"1min":0.40100000000000002,"5min":0.39300000000000002,"15min":0.32700000000000001},"max":{"1min":0.85899999999999999,"5min":0.871,"15min":0.97899999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63700000000000001,"15min":0.65000000000000002},"min":{"1min":0.442,"5min":0.435,"15min":0.36099999999999999},"max":{"1min":0.81499999999999995,"5min":1.0780000000000001,"15min":1.091},"last":0.61699999999999999}]},{"osd":5,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63700000000000001,"15min":0.65900000000000003},"min":{"1min":0.45800000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91200000000000003,"5min":0.98399999999999999,"15min":1.121},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.67300000000000004,"15min":0.70699999999999996},"min":{"1min":0.47499999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88300000000000001,"5min":0.98699999999999999,"15min":1.145},"last":0.95099999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65600000000000003,"15min":0.67500000000000004},"min":{"1min":0.44600000000000001,"5min":0.41699999999999998,"15min":0.38},"max":{"1min":0.92200000000000004,"5min":1.1200000000000001,"15min":1.208},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.71199999999999997,"15min":0.72499999999999998},"min":{"1min":0.53200000000000003,"5min":0.52700000000000002,"15min":0.442},"max":{"1min":0.85799999999999998,"5min":1.0489999999999999,"15min":1.194},"last":0.70299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575011,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":749568,"data_stored":367108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.73699999999999999,"15min":0.73399999999999999},"min":{"1min":0.45300000000000001,"5min":0.36499999999999999,"15min":0.32400000000000001},"max":{"1min":2.6699999999999999,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.72699999999999998,"15min":0.74099999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.94199999999999995,"5min":0.996,"15min":1.0069999999999999},"last":0.81799999999999995}]},{"osd":1,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.72699999999999998,"15min":0.73199999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.41099999999999998},"max":{"1min":0.85899999999999999,"5min":1.079,"15min":1.335},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75800000000000001,"15min":0.75600000000000001},"min":{"1min":0.505,"5min":0.40400000000000003,"15min":0.36799999999999999},"max":{"1min":2.706,"5min":2.706,"15min":2.706},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73499999999999999,"15min":0.748},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91800000000000004,"5min":1.0940000000000001,"15min":1.298},"last":0.879},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.73299999999999998,"15min":0.74199999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.90200000000000002,"5min":1.044,"15min":1.044},"last":0.68600000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.75600000000000001,"15min":0.745},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.76100000000000001,"15min":0.77600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88900000000000001,"5min":1.149,"15min":1.149},"last":0.77200000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.63200000000000001,"15min":0.64000000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.85199999999999998,"5min":0.94199999999999995,"15min":1.073},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.71599999999999997},"min":{"1min":0.40600000000000003,"5min":0.40200000000000002,"15min":0.35899999999999999},"max":{"1min":2.7719999999999998,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.53600000000000003}]},{"osd":6,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.621,"15min":0.64100000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.89800000000000002,"5min":0.95399999999999996,"15min":0.97999999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.63900000000000001,"15min":0.66200000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.042},"last":0.58799999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":3.0230000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67900000000000005,"15min":0.70899999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.95999999999999996,"5min":1.407,"15min":1.407},"last":0.46800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575011,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":749568,"data_stored":367108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76900000000000002,"15min":0.72999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.42299999999999999},"max":{"1min":1.0129999999999999,"5min":1.411,"15min":1.411},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.749,"15min":0.71299999999999997},"min":{"1min":0.54100000000000004,"5min":0.435,"15min":0.435},"max":{"1min":0.96799999999999997,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":1.0640000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77500000000000002,"15min":0.73599999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.442},"max":{"1min":0.90200000000000002,"5min":1.077,"15min":1.077},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76200000000000001,"15min":0.73899999999999999},"min":{"1min":0.55200000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93300000000000005,"5min":1.0469999999999999,"15min":1.2370000000000001},"last":0.94999999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.75800000000000001,"15min":0.72399999999999998},"min":{"1min":0.60499999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.95899999999999996,"5min":1.091,"15min":1.091},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.80400000000000005,"15min":0.76300000000000001},"min":{"1min":0.59099999999999997,"5min":0.499,"15min":0.443},"max":{"1min":0.99199999999999999,"5min":1.387,"15min":1.387},"last":0.77700000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.77100000000000002,"15min":0.74199999999999999},"min":{"1min":0.63600000000000001,"5min":0.52600000000000002,"15min":0.497},"max":{"1min":0.99399999999999999,"5min":1.008,"15min":1.099},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78900000000000003,"15min":0.76200000000000001},"min":{"1min":0.54100000000000004,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.97099999999999997,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.82199999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61699999999999999,"15min":0.61299999999999999},"min":{"1min":0.48799999999999999,"5min":0.441,"15min":0.38900000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":1.0029999999999999},"last":0.621},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61099999999999999,"15min":0.624},"min":{"1min":0.43099999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88600000000000001,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.751}]},{"osd":6,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.62,"15min":0.63300000000000001},"min":{"1min":0.495,"5min":0.41599999999999998,"15min":0.32300000000000001},"max":{"1min":0.91700000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":1.014},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.68100000000000005},"min":{"1min":0.45400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.98999999999999999},"last":0.84499999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66500000000000004,"15min":0.67800000000000005},"min":{"1min":0.54100000000000004,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94699999999999995,"5min":0.98099999999999998,"15min":1.0349999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69199999999999995,"15min":0.71599999999999997},"min":{"1min":0.56499999999999995,"5min":0.41599999999999998,"15min":0.36899999999999999},"max":{"1min":0.91800000000000004,"5min":1.026,"15min":1.1080000000000001},"last":0.97699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575011,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35876,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335964,"statfs":{"total":96636764160,"available":96600027136,"internally_reserved":0,"allocated":749568,"data_stored":367108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45400000000000001,"15min":0.44400000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.748,"5min":0.755,"15min":0.84199999999999997},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.503,"15min":0.52000000000000002},"min":{"1min":0.378,"5min":0.33300000000000002,"15min":0.309},"max":{"1min":0.65500000000000003,"5min":0.78700000000000003,"15min":1.577},"last":0.40100000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47199999999999998,"15min":0.47599999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.29199999999999998},"max":{"1min":0.65400000000000003,"5min":0.71699999999999997,"15min":0.88200000000000001},"last":0.315},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.32600000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.113},"last":0.376}]},{"osd":2,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.56499999999999995,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.38700000000000001},"max":{"1min":0.63900000000000001,"5min":0.88400000000000001,"15min":1.0820000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.624,"15min":0.59899999999999998},"min":{"1min":0.46400000000000002,"5min":0.441,"15min":0.40100000000000002},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.47499999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.51100000000000001,"5min":0.441,"15min":0.439},"max":{"1min":0.88200000000000001,"5min":1.284,"15min":1.627},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.77400000000000002,"15min":0.78400000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.47699999999999998},"max":{"1min":0.81899999999999995,"5min":1.135,"15min":1.214},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.78500000000000003,"15min":0.79000000000000004},"min":{"1min":0.58499999999999996,"5min":0.57999999999999996,"15min":0.52400000000000002},"max":{"1min":0.86399999999999999,"5min":1.306,"15min":1.333},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.78300000000000003,"15min":0.78600000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.96099999999999997,"5min":1.129,"15min":1.2470000000000001},"last":0.64200000000000002}]},{"osd":6,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.76800000000000002,"15min":0.78600000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.873,"5min":1.117,"15min":1.526},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.505},"max":{"1min":0.93200000000000005,"5min":1.2589999999999999,"15min":1.381},"last":0.54200000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.85099999999999998,"15min":0.84299999999999997},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.53100000000000003},"max":{"1min":2.4910000000000001,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.83099999999999996,"15min":0.83999999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.595,"5min":1.595,"15min":1.6910000000000001},"last":0.77100000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575011,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53908,"kb_used_data":716,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317932,"statfs":{"total":96636764160,"available":96581562368,"internally_reserved":0,"allocated":733184,"data_stored":359461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46700000000000003,"15min":0.46800000000000003},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.28999999999999998},"max":{"1min":2.5270000000000001,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.499}]},{"osd":1,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.47799999999999998,"15min":0.47499999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27500000000000002},"max":{"1min":2.7200000000000002,"5min":2.7200000000000002,"15min":2.7200000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.33000000000000002},"max":{"1min":2.6110000000000002,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":0.56100000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.66600000000000004,"15min":0.60199999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.38},"max":{"1min":8.2530000000000001,"5min":8.2530000000000001,"15min":8.2530000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89600000000000002,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.53400000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.3049999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81499999999999995,"15min":0.80900000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.81899999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.88200000000000001,"15min":0.874},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":3.1139999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.85599999999999998,"15min":0.84599999999999997},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.433},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.94999999999999996}]},{"osd":6,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.82099999999999995,"15min":0.80200000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.47599999999999998},"max":{"1min":3.9849999999999999,"5min":3.9849999999999999,"15min":3.9849999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.83999999999999997,"15min":0.81899999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":3.391,"5min":3.391,"15min":3.391},"last":0.96999999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.83799999999999997,"15min":0.83699999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.5779999999999998,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.84599999999999997,"15min":0.82599999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.50900000000000001},"max":{"1min":2.5939999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.89400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575012,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35876,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335964,"statfs":{"total":96636764160,"available":96600027136,"internally_reserved":0,"allocated":749568,"data_stored":367108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.432,"15min":0.42599999999999999},"min":{"1min":0.26300000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58699999999999997,"5min":0.69099999999999995,"15min":0.77200000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.51500000000000001,"15min":0.49299999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.26500000000000001},"max":{"1min":0.64700000000000002,"5min":0.751,"15min":0.82299999999999995},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.48899999999999999,"15min":0.46899999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.29499999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52600000000000002,"15min":0.51000000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.29299999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.495}]},{"osd":3,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64700000000000002,"15min":0.626},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.432},"max":{"1min":0.79200000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58299999999999996,"15min":0.57599999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.38100000000000001},"max":{"1min":0.749,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.80100000000000005,"15min":0.77200000000000002},"min":{"1min":0.51600000000000001,"5min":0.51300000000000001,"15min":0.40000000000000002},"max":{"1min":0.999,"5min":1.054,"15min":1.236},"last":0.874},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.79000000000000004,"15min":0.77800000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.45700000000000002},"max":{"1min":0.92200000000000004,"5min":1.1040000000000001,"15min":1.1180000000000001},"last":0.74199999999999999}]},{"osd":5,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.79700000000000004,"15min":0.77500000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":0.99099999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.80800000000000005,"15min":0.79200000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48199999999999998},"max":{"1min":0.88,"5min":1.2509999999999999,"15min":1.3600000000000001},"last":0.73299999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.81000000000000005,"15min":0.79100000000000004},"min":{"1min":0.503,"5min":0.503,"15min":0.48499999999999999},"max":{"1min":0.89600000000000002,"5min":1.0649999999999999,"15min":1.274},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.82699999999999996,"15min":0.81200000000000006},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.49199999999999999},"max":{"1min":0.96999999999999997,"5min":1.1599999999999999,"15min":1.2969999999999999},"last":0.70799999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.80200000000000005,"15min":0.78600000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.47799999999999998},"max":{"1min":0.93799999999999994,"5min":1.123,"15min":1.3400000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.85899999999999999,"15min":0.83599999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.52800000000000002},"max":{"1min":0.95699999999999996,"5min":1.1890000000000001,"15min":1.2929999999999999},"last":0.81699999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575013,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36452,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335388,"statfs":{"total":96636764160,"available":96599437312,"internally_reserved":0,"allocated":1339392,"data_stored":956457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.48299999999999998,"15min":0.45900000000000002},"min":{"1min":0.28899999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.50800000000000001,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.69699999999999995,"5min":0.77900000000000003,"15min":1.452},"last":0.35399999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.34100000000000003},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80300000000000005,"5min":0.90300000000000002,"15min":1.5700000000000001},"last":0.41999999999999998}]},{"osd":3,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.502,"15min":0.51100000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.66000000000000003,"5min":0.70599999999999996,"15min":0.99299999999999999},"last":0.502},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.60599999999999998,"15min":0.59699999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":2.4100000000000001,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.80300000000000005,"15min":0.78400000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.44400000000000001},"max":{"1min":1.2150000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.628},{"interface":"front","average":{"1min":0.873,"5min":0.82499999999999996,"15min":0.81599999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.755}]},{"osd":5,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.82299999999999995,"15min":0.80500000000000005},"min":{"1min":0.51800000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2549999999999999,"5min":1.3839999999999999,"15min":1.4950000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.81399999999999995,"15min":0.80400000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.47299999999999998},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.82599999999999996,"15min":0.81799999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.82799999999999996,"15min":0.82199999999999995},"min":{"1min":0.55500000000000005,"5min":0.50600000000000001,"15min":0.41299999999999998},"max":{"1min":1.141,"5min":1.3440000000000001,"15min":1.5369999999999999},"last":0.73899999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.84999999999999998,"15min":0.83999999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.45500000000000002},"max":{"1min":1.04,"5min":1.2749999999999999,"15min":1.603},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82999999999999996,"15min":0.82399999999999995},"min":{"1min":0.57099999999999995,"5min":0.52800000000000002,"15min":0.497},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.69499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:06:06.319 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:06:06.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22c3940640 1 Processor -- start 2023-07-14T13:06:06.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22c3940640 1 -- start start 2023-07-14T13:06:06.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22c3940640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f22bc15fd60 0x7f22bc0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:06.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22c3940640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22bc0d1850 0x7f22bc0d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:06.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22c3940640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22bc0ccaf0 con 0x7f22bc0b7c70 2023-07-14T13:06:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22c3940640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22bc0d1190 con 0x7f22bc15fd60 2023-07-14T13:06:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22c3940640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc160600 con 0x7f22bc0d1850 2023-07-14T13:06:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22c16dc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f22bc0b7c70 0x7f22bc15f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48342/0 (socket says 172.21.15.5:48342) 2023-07-14T13:06:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22c16dc640 1 -- 172.21.15.5:0/2323840772 learned_addr learned my addr 172.21.15.5:0/2323840772 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:06:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22c0edb640 1 --2- 172.21.15.5:0/2323840772 >> v2:172.21.15.154:3300/0 conn(0x7f22bc15fd60 0x7f22bc0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22c1edd640 1 --2- 172.21.15.5:0/2323840772 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22bc0d1850 0x7f22bc0d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22b3fff640 1 -- 172.21.15.5:0/2323840772 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2694231274 0 0) 0x7f22bc0ccaf0 con 0x7f22bc0b7c70 2023-07-14T13:06:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22b3fff640 1 -- 172.21.15.5:0/2323840772 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22a8003530 con 0x7f22bc0b7c70 2023-07-14T13:06:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22b3fff640 1 -- 172.21.15.5:0/2323840772 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 723424815 0 0) 0x7f22a8003530 con 0x7f22bc0b7c70 2023-07-14T13:06:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22b3fff640 1 -- 172.21.15.5:0/2323840772 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22bc0d1850 msgr2=0x7f22bc0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22b3fff640 1 --2- 172.21.15.5:0/2323840772 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22bc0d1850 0x7f22bc0d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22b3fff640 1 -- 172.21.15.5:0/2323840772 >> v2:172.21.15.154:3300/0 conn(0x7f22bc15fd60 msgr2=0x7f22bc0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22b3fff640 1 --2- 172.21.15.5:0/2323840772 >> v2:172.21.15.154:3300/0 conn(0x7f22bc15fd60 0x7f22bc0d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22b3fff640 1 -- 172.21.15.5:0/2323840772 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc160320 con 0x7f22bc0b7c70 2023-07-14T13:06:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22b3fff640 1 -- 172.21.15.5:0/2323840772 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f22b8001680 con 0x7f22bc0b7c70 2023-07-14T13:06:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22b3fff640 1 -- 172.21.15.5:0/2323840772 >> v1:172.21.15.5:6789/0 conn(0x7f22bc0b7c70 legacy=0x7f22bc15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:06.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22b3fff640 1 --2- 172.21.15.5:0/2323840772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22a8003980 0x7f22a8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:06.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22b3fff640 1 --2- 172.21.15.5:0/2323840772 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22bc0d1850 0x7f22a80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:06.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22b3fff640 1 --2- 172.21.15.5:0/2323840772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22a8004d10 0x7f22a8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:06.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22b3fff640 1 -- 172.21.15.5:0/2323840772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc160600 con 0x7f22a8004d10 2023-07-14T13:06:06.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22b3fff640 1 -- 172.21.15.5:0/2323840772 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a800b990 con 0x7f22a8003980 2023-07-14T13:06:06.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22b3fff640 1 -- 172.21.15.5:0/2323840772 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a800bad0 con 0x7f22bc0d1850 2023-07-14T13:06:06.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22c1edd640 1 --2- 172.21.15.5:0/2323840772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22a8004d10 0x7f22a8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22c16dc640 1 --2- 172.21.15.5:0/2323840772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22a8003980 0x7f22a8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22c0edb640 1 --2- 172.21.15.5:0/2323840772 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22bc0d1850 0x7f22a80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22c1edd640 1 -- 172.21.15.5:0/2323840772 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22bc0d1850 msgr2=0x7f22a80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22c1edd640 1 --2- 172.21.15.5:0/2323840772 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22bc0d1850 0x7f22a80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22c1edd640 1 -- 172.21.15.5:0/2323840772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22a8003980 msgr2=0x7f22a8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22c1edd640 1 --2- 172.21.15.5:0/2323840772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22a8003980 0x7f22a8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.470+0000 7f22c1edd640 1 -- 172.21.15.5:0/2323840772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a8003530 con 0x7f22a8004d10 2023-07-14T13:06:06.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.474+0000 7f22c1edd640 1 --2- 172.21.15.5:0/2323840772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22a8004d10 0x7f22a8005180 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009fc0 tx=0x7f22b401cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5327048680997e45 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.474+0000 7f22b3fff640 1 -- 172.21.15.5:0/2323840772 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b40a5c70 con 0x7f22a8004d10 2023-07-14T13:06:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.474+0000 7f22b3fff640 1 -- 172.21.15.5:0/2323840772 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b400f040 con 0x7f22a8004d10 2023-07-14T13:06:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.474+0000 7f22b3fff640 1 -- 172.21.15.5:0/2323840772 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b40ad440 con 0x7f22a8004d10 2023-07-14T13:06:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.474+0000 7f22c3940640 1 -- 172.21.15.5:0/2323840772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22a8004d10 msgr2=0x7f22a8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.474+0000 7f22c3940640 1 --2- 172.21.15.5:0/2323840772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22a8004d10 0x7f22a8005180 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009fc0 tx=0x7f22b401cc00 comp rx=0 tx=0).stop 2023-07-14T13:06:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.474+0000 7f22c1edd640 1 -- 172.21.15.5:0/2323840772 reap_dead start 2023-07-14T13:06:06.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.474+0000 7f22c3940640 1 -- 172.21.15.5:0/2323840772 shutdown_connections 2023-07-14T13:06:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.474+0000 7f22c3940640 1 -- 172.21.15.5:0/2323840772 >> 172.21.15.5:0/2323840772 conn(0x7f22bc0650b0 msgr2=0x7f22bc0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.474+0000 7f22c3940640 1 -- 172.21.15.5:0/2323840772 shutdown_connections 2023-07-14T13:06:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.474+0000 7f22c3940640 1 -- 172.21.15.5:0/2323840772 wait complete. 2023-07-14T13:06:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.478+0000 7f22c3940640 1 Processor -- start 2023-07-14T13:06:06.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.478+0000 7f22c3940640 1 -- start start 2023-07-14T13:06:06.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.478+0000 7f22c3940640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22a8004d10 0x7f22bc15b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:06.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.478+0000 7f22c3940640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22bc0cb430 0x7f22bc1f3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:06.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.478+0000 7f22c3940640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22bc0cb8a0 0x7f22bc0cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:06.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.478+0000 7f22c3940640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc1f4880 con 0x7f22a8004d10 2023-07-14T13:06:06.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.478+0000 7f22c3940640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc1f4b60 con 0x7f22bc0cb430 2023-07-14T13:06:06.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.478+0000 7f22c3940640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc1f4e40 con 0x7f22bc0cb8a0 2023-07-14T13:06:06.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.478+0000 7f22c16dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22a8004d10 0x7f22bc15b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.478+0000 7f22c16dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22a8004d10 0x7f22bc15b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57466/0 (socket says 172.21.15.5:57466) 2023-07-14T13:06:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.478+0000 7f22c16dc640 1 -- 172.21.15.5:0/1457154073 learned_addr learned my addr 172.21.15.5:0/1457154073 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.478+0000 7f22c16dc640 1 -- 172.21.15.5:0/1457154073 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22bc0cb8a0 msgr2=0x7f22bc0cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.478+0000 7f22c16dc640 1 --2- 172.21.15.5:0/1457154073 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22bc0cb8a0 0x7f22bc0cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.478+0000 7f22c16dc640 1 -- 172.21.15.5:0/1457154073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22bc0cb430 msgr2=0x7f22bc1f3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.478+0000 7f22c16dc640 1 --2- 172.21.15.5:0/1457154073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22bc0cb430 0x7f22bc1f3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:06.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.478+0000 7f22c16dc640 1 -- 172.21.15.5:0/1457154073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc1f5120 con 0x7f22a8004d10 2023-07-14T13:06:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.478+0000 7f22c16dc640 1 --2- 172.21.15.5:0/1457154073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22a8004d10 0x7f22bc15b750 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f22b8007310 tx=0x7f22b80077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.478+0000 7f22b1ffb640 1 -- 172.21.15.5:0/1457154073 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b800f940 con 0x7f22a8004d10 2023-07-14T13:06:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.478+0000 7f22b1ffb640 1 -- 172.21.15.5:0/1457154073 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b800fac0 con 0x7f22a8004d10 2023-07-14T13:06:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.478+0000 7f22b1ffb640 1 -- 172.21.15.5:0/1457154073 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b800fe70 con 0x7f22a8004d10 2023-07-14T13:06:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.478+0000 7f22c3940640 1 -- 172.21.15.5:0/1457154073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22bc15bc90 con 0x7f22a8004d10 2023-07-14T13:06:06.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.482+0000 7f22c3940640 1 -- 172.21.15.5:0/1457154073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22bc1f4230 con 0x7f22a8004d10 2023-07-14T13:06:06.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.482+0000 7f22c3940640 1 -- 172.21.15.5:0/1457154073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22bc15fbd0 con 0x7f22a8004d10 2023-07-14T13:06:06.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.482+0000 7f22b1ffb640 1 -- 172.21.15.5:0/1457154073 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f22b801d460 con 0x7f22a8004d10 2023-07-14T13:06:06.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.482+0000 7f22b1ffb640 1 --2- 172.21.15.5:0/1457154073 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f22a00663a0 0x7f22a0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:06.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.482+0000 7f22b1ffb640 1 -- 172.21.15.5:0/1457154073 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f22b8084060 con 0x7f22a8004d10 2023-07-14T13:06:06.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.482+0000 7f22c0edb640 1 --2- 172.21.15.5:0/1457154073 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f22a00663a0 0x7f22a0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:06.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.486+0000 7f22c0edb640 1 --2- 172.21.15.5:0/1457154073 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f22a00663a0 0x7f22a0068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f22ac006e90 tx=0x7f22ac006e00 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:06.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.486+0000 7f22b1ffb640 1 -- 172.21.15.5:0/1457154073 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f22b8054f10 con 0x7f22a8004d10 2023-07-14T13:06:06.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.642+0000 7f22c3940640 1 -- 172.21.15.5:0/1457154073 --> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f22bc1f4cd0 con 0x7f22a00663a0 2023-07-14T13:06:06.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.650+0000 7f22b1ffb640 1 -- 172.21.15.5:0/1457154073 <== mgr.5695 v2:172.21.15.154:6832/1810553301 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305582 (secure 0 0 0) 0x7f22bc1f4cd0 con 0x7f22a00663a0 2023-07-14T13:06:06.684 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:06:06.685 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:06:06.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.654+0000 7f22c3940640 1 -- 172.21.15.5:0/1457154073 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f22a00663a0 msgr2=0x7f22a0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:06.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.654+0000 7f22c3940640 1 --2- 172.21.15.5:0/1457154073 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f22a00663a0 0x7f22a0068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f22ac006e90 tx=0x7f22ac006e00 comp rx=0 tx=0).stop 2023-07-14T13:06:06.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.654+0000 7f22c3940640 1 -- 172.21.15.5:0/1457154073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22a8004d10 msgr2=0x7f22bc15b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:06.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.654+0000 7f22c3940640 1 --2- 172.21.15.5:0/1457154073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22a8004d10 0x7f22bc15b750 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f22b8007310 tx=0x7f22b80077d0 comp rx=0 tx=0).stop 2023-07-14T13:06:06.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.654+0000 7f22c3940640 1 -- 172.21.15.5:0/1457154073 shutdown_connections 2023-07-14T13:06:06.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.654+0000 7f22c3940640 1 --2- 172.21.15.5:0/1457154073 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f22a00663a0 0x7f22a0068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:06.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.654+0000 7f22c3940640 1 --2- 172.21.15.5:0/1457154073 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22bc0cb8a0 0x7f22bc0cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:06.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.654+0000 7f22c3940640 1 --2- 172.21.15.5:0/1457154073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22bc0cb430 0x7f22bc1f3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:06.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.654+0000 7f22c3940640 1 --2- 172.21.15.5:0/1457154073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22a8004d10 0x7f22bc15b750 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:06.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.654+0000 7f22c3940640 1 -- 172.21.15.5:0/1457154073 >> 172.21.15.5:0/1457154073 conn(0x7f22bc0650b0 msgr2=0x7f22bc0d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:06.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.654+0000 7f22c3940640 1 -- 172.21.15.5:0/1457154073 shutdown_connections 2023-07-14T13:06:06.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.654+0000 7f22c3940640 1 -- 172.21.15.5:0/1457154073 wait complete. 2023-07-14T13:06:06.703 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-14T13:06:05.544750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":307848,"kb_used_data":6984,"kb_used_omap":0,"kb_used_meta":300800,"kb_avail":754666872,"statfs":{"total":773094113280,"available":772778876928,"internally_reserved":0,"allocated":7151616,"data_stored":4102306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308019200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.807432"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.748761+0000","last_change":"2023-07-14T13:06:00.748761+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.748761+0000","last_undegraded":"2023-07-14T13:06:00.748761+0000","last_fullsized":"2023-07-14T13:06:00.748761+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.754379+0000","last_change":"2023-07-14T13:06:00.754379+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.754379+0000","last_undegraded":"2023-07-14T13:06:00.754379+0000","last_fullsized":"2023-07-14T13:06:00.754379+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.747815+0000","last_change":"2023-07-14T13:06:00.747815+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.747815+0000","last_undegraded":"2023-07-14T13:06:00.747815+0000","last_fullsized":"2023-07-14T13:06:00.747815+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.753107+0000","last_change":"2023-07-14T13:06:00.753107+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.753107+0000","last_undegraded":"2023-07-14T13:06:00.753107+0000","last_fullsized":"2023-07-14T13:06:00.753107+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751429+0000","last_change":"2023-07-14T13:06:00.751429+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751429+0000","last_undegraded":"2023-07-14T13:06:00.751429+0000","last_fullsized":"2023-07-14T13:06:00.751429+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.744387+0000","last_change":"2023-07-14T13:06:00.744387+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.744387+0000","last_undegraded":"2023-07-14T13:06:00.744387+0000","last_fullsized":"2023-07-14T13:06:00.744387+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.744820+0000","last_change":"2023-07-14T13:06:00.744820+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.744820+0000","last_undegraded":"2023-07-14T13:06:00.744820+0000","last_fullsized":"2023-07-14T13:06:00.744820+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.744099+0000","last_change":"2023-07-14T13:06:00.744099+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.744099+0000","last_undegraded":"2023-07-14T13:06:00.744099+0000","last_fullsized":"2023-07-14T13:06:00.744099+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743374+0000","last_change":"2023-07-14T13:06:00.743374+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743374+0000","last_undegraded":"2023-07-14T13:06:00.743374+0000","last_fullsized":"2023-07-14T13:06:00.743374+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.748675+0000","last_change":"2023-07-14T13:06:00.748675+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.748675+0000","last_undegraded":"2023-07-14T13:06:00.748675+0000","last_fullsized":"2023-07-14T13:06:00.748675+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.744940+0000","last_change":"2023-07-14T13:06:00.744940+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.744940+0000","last_undegraded":"2023-07-14T13:06:00.744940+0000","last_fullsized":"2023-07-14T13:06:00.744940+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743067+0000","last_change":"2023-07-14T13:06:00.743067+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743067+0000","last_undegraded":"2023-07-14T13:06:00.743067+0000","last_fullsized":"2023-07-14T13:06:00.743067+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.752149+0000","last_change":"2023-07-14T13:06:00.752149+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.752149+0000","last_undegraded":"2023-07-14T13:06:00.752149+0000","last_fullsized":"2023-07-14T13:06:00.752149+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.748588+0000","last_change":"2023-07-14T13:06:00.748588+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.748588+0000","last_undegraded":"2023-07-14T13:06:00.748588+0000","last_fullsized":"2023-07-14T13:06:00.748588+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.755332+0000","last_change":"2023-07-14T13:06:00.755332+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.755332+0000","last_undegraded":"2023-07-14T13:06:00.755332+0000","last_fullsized":"2023-07-14T13:06:00.755332+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750787+0000","last_change":"2023-07-14T13:06:00.750787+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750787+0000","last_undegraded":"2023-07-14T13:06:00.750787+0000","last_fullsized":"2023-07-14T13:06:00.750787+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.746739+0000","last_change":"2023-07-14T13:06:00.746739+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.746739+0000","last_undegraded":"2023-07-14T13:06:00.746739+0000","last_fullsized":"2023-07-14T13:06:00.746739+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.749397+0000","last_change":"2023-07-14T13:06:00.749397+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.749397+0000","last_undegraded":"2023-07-14T13:06:00.749397+0000","last_fullsized":"2023-07-14T13:06:00.749397+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.747489+0000","last_change":"2023-07-14T13:06:00.747489+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.747489+0000","last_undegraded":"2023-07-14T13:06:00.747489+0000","last_fullsized":"2023-07-14T13:06:00.747489+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.746486+0000","last_change":"2023-07-14T13:06:00.746486+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.746486+0000","last_undegraded":"2023-07-14T13:06:00.746486+0000","last_fullsized":"2023-07-14T13:06:00.746486+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.745688+0000","last_change":"2023-07-14T13:06:00.745688+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.745688+0000","last_undegraded":"2023-07-14T13:06:00.745688+0000","last_fullsized":"2023-07-14T13:06:00.745688+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743004+0000","last_change":"2023-07-14T13:06:00.743004+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743004+0000","last_undegraded":"2023-07-14T13:06:00.743004+0000","last_fullsized":"2023-07-14T13:06:00.743004+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.745492+0000","last_change":"2023-07-14T13:06:00.745492+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.745492+0000","last_undegraded":"2023-07-14T13:06:00.745492+0000","last_fullsized":"2023-07-14T13:06:00.745492+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.742309+0000","last_change":"2023-07-14T13:06:00.742309+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.742309+0000","last_undegraded":"2023-07-14T13:06:00.742309+0000","last_fullsized":"2023-07-14T13:06:00.742309+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743183+0000","last_change":"2023-07-14T13:06:00.743183+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743183+0000","last_undegraded":"2023-07-14T13:06:00.743183+0000","last_fullsized":"2023-07-14T13:06:00.743183+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.748463+0000","last_change":"2023-07-14T13:06:00.748463+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.748463+0000","last_undegraded":"2023-07-14T13:06:00.748463+0000","last_fullsized":"2023-07-14T13:06:00.748463+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743994+0000","last_change":"2023-07-14T13:06:00.743994+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743994+0000","last_undegraded":"2023-07-14T13:06:00.743994+0000","last_fullsized":"2023-07-14T13:06:00.743994+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.745322+0000","last_change":"2023-07-14T13:06:00.745322+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.745322+0000","last_undegraded":"2023-07-14T13:06:00.745322+0000","last_fullsized":"2023-07-14T13:06:00.745322+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743892+0000","last_change":"2023-07-14T13:06:00.743892+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743892+0000","last_undegraded":"2023-07-14T13:06:00.743892+0000","last_fullsized":"2023-07-14T13:06:00.743892+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750152+0000","last_change":"2023-07-14T13:06:00.750152+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750152+0000","last_undegraded":"2023-07-14T13:06:00.750152+0000","last_fullsized":"2023-07-14T13:06:00.750152+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743608+0000","last_change":"2023-07-14T13:06:00.743608+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743608+0000","last_undegraded":"2023-07-14T13:06:00.743608+0000","last_fullsized":"2023-07-14T13:06:00.743608+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751944+0000","last_change":"2023-07-14T13:06:00.751944+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751944+0000","last_undegraded":"2023-07-14T13:06:00.751944+0000","last_fullsized":"2023-07-14T13:06:00.751944+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.755014+0000","last_change":"2023-07-14T13:06:00.755014+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.755014+0000","last_undegraded":"2023-07-14T13:06:00.755014+0000","last_fullsized":"2023-07-14T13:06:00.755014+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.761559+0000","last_change":"2023-07-14T13:06:00.756132+0000","last_active":"2023-07-14T13:06:00.761559+0000","last_peered":"2023-07-14T13:06:00.761559+0000","last_clean":"2023-07-14T13:06:00.761559+0000","last_became_active":"2023-07-14T13:06:00.755507+0000","last_became_peered":"2023-07-14T13:06:00.755507+0000","last_unstale":"2023-07-14T13:06:00.761559+0000","last_undegraded":"2023-07-14T13:06:00.761559+0000","last_fullsized":"2023-07-14T13:06:00.761559+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:44:35.427825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750889+0000","last_change":"2023-07-14T13:06:00.750889+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750889+0000","last_undegraded":"2023-07-14T13:06:00.750889+0000","last_fullsized":"2023-07-14T13:06:00.750889+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765663+0000","last_change":"2023-07-14T13:06:00.761498+0000","last_active":"2023-07-14T13:06:00.765663+0000","last_peered":"2023-07-14T13:06:00.765663+0000","last_clean":"2023-07-14T13:06:00.765663+0000","last_became_active":"2023-07-14T13:06:00.761218+0000","last_became_peered":"2023-07-14T13:06:00.761218+0000","last_unstale":"2023-07-14T13:06:00.765663+0000","last_undegraded":"2023-07-14T13:06:00.765663+0000","last_fullsized":"2023-07-14T13:06:00.765663+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:04:43.245058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.745320+0000","last_change":"2023-07-14T13:06:00.745320+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.745320+0000","last_undegraded":"2023-07-14T13:06:00.745320+0000","last_fullsized":"2023-07-14T13:06:00.745320+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.761184+0000","last_change":"2023-07-14T13:06:00.754529+0000","last_active":"2023-07-14T13:06:00.761184+0000","last_peered":"2023-07-14T13:06:00.761184+0000","last_clean":"2023-07-14T13:06:00.761184+0000","last_became_active":"2023-07-14T13:06:00.754227+0000","last_became_peered":"2023-07-14T13:06:00.754227+0000","last_unstale":"2023-07-14T13:06:00.761184+0000","last_undegraded":"2023-07-14T13:06:00.761184+0000","last_fullsized":"2023-07-14T13:06:00.761184+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:28.800346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.746995+0000","last_change":"2023-07-14T13:06:00.746995+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.746995+0000","last_undegraded":"2023-07-14T13:06:00.746995+0000","last_fullsized":"2023-07-14T13:06:00.746995+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765149+0000","last_change":"2023-07-14T13:06:00.763143+0000","last_active":"2023-07-14T13:06:00.765149+0000","last_peered":"2023-07-14T13:06:00.765149+0000","last_clean":"2023-07-14T13:06:00.765149+0000","last_became_active":"2023-07-14T13:06:00.762841+0000","last_became_peered":"2023-07-14T13:06:00.762841+0000","last_unstale":"2023-07-14T13:06:00.765149+0000","last_undegraded":"2023-07-14T13:06:00.765149+0000","last_fullsized":"2023-07-14T13:06:00.765149+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:05:53.281408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750581+0000","last_change":"2023-07-14T13:06:00.750581+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750581+0000","last_undegraded":"2023-07-14T13:06:00.750581+0000","last_fullsized":"2023-07-14T13:06:00.750581+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.761705+0000","last_change":"2023-07-14T13:06:00.756771+0000","last_active":"2023-07-14T13:06:00.761705+0000","last_peered":"2023-07-14T13:06:00.761705+0000","last_clean":"2023-07-14T13:06:00.761705+0000","last_became_active":"2023-07-14T13:06:00.756496+0000","last_became_peered":"2023-07-14T13:06:00.756496+0000","last_unstale":"2023-07-14T13:06:00.761705+0000","last_undegraded":"2023-07-14T13:06:00.761705+0000","last_fullsized":"2023-07-14T13:06:00.761705+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:12:25.869710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.749693+0000","last_change":"2023-07-14T13:06:00.749693+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.749693+0000","last_undegraded":"2023-07-14T13:06:00.749693+0000","last_fullsized":"2023-07-14T13:06:00.749693+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.757339+0000","last_change":"2023-07-14T13:06:00.756414+0000","last_active":"2023-07-14T13:06:00.757339+0000","last_peered":"2023-07-14T13:06:00.757339+0000","last_clean":"2023-07-14T13:06:00.757339+0000","last_became_active":"2023-07-14T13:06:00.755350+0000","last_became_peered":"2023-07-14T13:06:00.755350+0000","last_unstale":"2023-07-14T13:06:00.757339+0000","last_undegraded":"2023-07-14T13:06:00.757339+0000","last_fullsized":"2023-07-14T13:06:00.757339+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:04:43.245058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.741690+0000","last_change":"2023-07-14T13:06:00.741690+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.741690+0000","last_undegraded":"2023-07-14T13:06:00.741690+0000","last_fullsized":"2023-07-14T13:06:00.741690+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.768245+0000","last_change":"2023-07-14T13:06:00.764991+0000","last_active":"2023-07-14T13:06:00.768245+0000","last_peered":"2023-07-14T13:06:00.768245+0000","last_clean":"2023-07-14T13:06:00.768245+0000","last_became_active":"2023-07-14T13:06:00.764498+0000","last_became_peered":"2023-07-14T13:06:00.764498+0000","last_unstale":"2023-07-14T13:06:00.768245+0000","last_undegraded":"2023-07-14T13:06:00.768245+0000","last_fullsized":"2023-07-14T13:06:00.768245+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:24:37.042404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.753601+0000","last_change":"2023-07-14T13:06:00.753601+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.753601+0000","last_undegraded":"2023-07-14T13:06:00.753601+0000","last_fullsized":"2023-07-14T13:06:00.753601+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.756207+0000","last_change":"2023-07-14T13:06:00.752505+0000","last_active":"2023-07-14T13:06:00.756207+0000","last_peered":"2023-07-14T13:06:00.756207+0000","last_clean":"2023-07-14T13:06:00.756207+0000","last_became_active":"2023-07-14T13:06:00.752152+0000","last_became_peered":"2023-07-14T13:06:00.752152+0000","last_unstale":"2023-07-14T13:06:00.756207+0000","last_undegraded":"2023-07-14T13:06:00.756207+0000","last_fullsized":"2023-07-14T13:06:00.756207+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:01:19.219338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.749729+0000","last_change":"2023-07-14T13:06:00.749729+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.749729+0000","last_undegraded":"2023-07-14T13:06:00.749729+0000","last_fullsized":"2023-07-14T13:06:00.749729+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767626+0000","last_change":"2023-07-14T13:06:00.763540+0000","last_active":"2023-07-14T13:06:00.767626+0000","last_peered":"2023-07-14T13:06:00.767626+0000","last_clean":"2023-07-14T13:06:00.767626+0000","last_became_active":"2023-07-14T13:06:00.763248+0000","last_became_peered":"2023-07-14T13:06:00.763248+0000","last_unstale":"2023-07-14T13:06:00.767626+0000","last_undegraded":"2023-07-14T13:06:00.767626+0000","last_fullsized":"2023-07-14T13:06:00.767626+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:17:30.938068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751489+0000","last_change":"2023-07-14T13:06:00.751489+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751489+0000","last_undegraded":"2023-07-14T13:06:00.751489+0000","last_fullsized":"2023-07-14T13:06:00.751489+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765550+0000","last_change":"2023-07-14T13:06:00.762491+0000","last_active":"2023-07-14T13:06:00.765550+0000","last_peered":"2023-07-14T13:06:00.765550+0000","last_clean":"2023-07-14T13:06:00.765550+0000","last_became_active":"2023-07-14T13:06:00.762242+0000","last_became_peered":"2023-07-14T13:06:00.762242+0000","last_unstale":"2023-07-14T13:06:00.765550+0000","last_undegraded":"2023-07-14T13:06:00.765550+0000","last_fullsized":"2023-07-14T13:06:00.765550+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:54:08.359442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.742869+0000","last_change":"2023-07-14T13:06:00.742869+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.742869+0000","last_undegraded":"2023-07-14T13:06:00.742869+0000","last_fullsized":"2023-07-14T13:06:00.742869+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.769883+0000","last_change":"2023-07-14T13:06:00.769317+0000","last_active":"2023-07-14T13:06:00.769883+0000","last_peered":"2023-07-14T13:06:00.769883+0000","last_clean":"2023-07-14T13:06:00.769883+0000","last_became_active":"2023-07-14T13:06:00.768989+0000","last_became_peered":"2023-07-14T13:06:00.768989+0000","last_unstale":"2023-07-14T13:06:00.769883+0000","last_undegraded":"2023-07-14T13:06:00.769883+0000","last_fullsized":"2023-07-14T13:06:00.769883+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:04:25.791755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750209+0000","last_change":"2023-07-14T13:06:00.750209+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750209+0000","last_undegraded":"2023-07-14T13:06:00.750209+0000","last_fullsized":"2023-07-14T13:06:00.750209+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767765+0000","last_change":"2023-07-14T13:06:00.758935+0000","last_active":"2023-07-14T13:06:00.767765+0000","last_peered":"2023-07-14T13:06:00.767765+0000","last_clean":"2023-07-14T13:06:00.767765+0000","last_became_active":"2023-07-14T13:06:00.758549+0000","last_became_peered":"2023-07-14T13:06:00.758549+0000","last_unstale":"2023-07-14T13:06:00.767765+0000","last_undegraded":"2023-07-14T13:06:00.767765+0000","last_fullsized":"2023-07-14T13:06:00.767765+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:04:31.512964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751561+0000","last_change":"2023-07-14T13:06:00.751561+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751561+0000","last_undegraded":"2023-07-14T13:06:00.751561+0000","last_fullsized":"2023-07-14T13:06:00.751561+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765931+0000","last_change":"2023-07-14T13:06:00.763008+0000","last_active":"2023-07-14T13:06:00.765931+0000","last_peered":"2023-07-14T13:06:00.765931+0000","last_clean":"2023-07-14T13:06:00.765931+0000","last_became_active":"2023-07-14T13:06:00.762695+0000","last_became_peered":"2023-07-14T13:06:00.762695+0000","last_unstale":"2023-07-14T13:06:00.765931+0000","last_undegraded":"2023-07-14T13:06:00.765931+0000","last_fullsized":"2023-07-14T13:06:00.765931+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:30:32.352281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.744200+0000","last_change":"2023-07-14T13:06:00.744200+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.744200+0000","last_undegraded":"2023-07-14T13:06:00.744200+0000","last_fullsized":"2023-07-14T13:06:00.744200+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767365+0000","last_change":"2023-07-14T13:06:00.761495+0000","last_active":"2023-07-14T13:06:00.767365+0000","last_peered":"2023-07-14T13:06:00.767365+0000","last_clean":"2023-07-14T13:06:00.767365+0000","last_became_active":"2023-07-14T13:06:00.761218+0000","last_became_peered":"2023-07-14T13:06:00.761218+0000","last_unstale":"2023-07-14T13:06:00.767365+0000","last_undegraded":"2023-07-14T13:06:00.767365+0000","last_fullsized":"2023-07-14T13:06:00.767365+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:21:08.411166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.742230+0000","last_change":"2023-07-14T13:06:00.742230+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.742230+0000","last_undegraded":"2023-07-14T13:06:00.742230+0000","last_fullsized":"2023-07-14T13:06:00.742230+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767635+0000","last_change":"2023-07-14T13:06:00.763951+0000","last_active":"2023-07-14T13:06:00.767635+0000","last_peered":"2023-07-14T13:06:00.767635+0000","last_clean":"2023-07-14T13:06:00.767635+0000","last_became_active":"2023-07-14T13:06:00.763697+0000","last_became_peered":"2023-07-14T13:06:00.763697+0000","last_unstale":"2023-07-14T13:06:00.767635+0000","last_undegraded":"2023-07-14T13:06:00.767635+0000","last_fullsized":"2023-07-14T13:06:00.767635+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:18:44.339283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.747222+0000","last_change":"2023-07-14T13:06:00.747222+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.747222+0000","last_undegraded":"2023-07-14T13:06:00.747222+0000","last_fullsized":"2023-07-14T13:06:00.747222+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767712+0000","last_change":"2023-07-14T13:06:00.759768+0000","last_active":"2023-07-14T13:06:00.767712+0000","last_peered":"2023-07-14T13:06:00.767712+0000","last_clean":"2023-07-14T13:06:00.767712+0000","last_became_active":"2023-07-14T13:06:00.758411+0000","last_became_peered":"2023-07-14T13:06:00.758411+0000","last_unstale":"2023-07-14T13:06:00.767712+0000","last_undegraded":"2023-07-14T13:06:00.767712+0000","last_fullsized":"2023-07-14T13:06:00.767712+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:52:03.642841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743629+0000","last_change":"2023-07-14T13:06:00.743629+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743629+0000","last_undegraded":"2023-07-14T13:06:00.743629+0000","last_fullsized":"2023-07-14T13:06:00.743629+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.763479+0000","last_change":"2023-07-14T13:06:00.761474+0000","last_active":"2023-07-14T13:06:00.763479+0000","last_peered":"2023-07-14T13:06:00.763479+0000","last_clean":"2023-07-14T13:06:00.763479+0000","last_became_active":"2023-07-14T13:06:00.761216+0000","last_became_peered":"2023-07-14T13:06:00.761216+0000","last_unstale":"2023-07-14T13:06:00.763479+0000","last_undegraded":"2023-07-14T13:06:00.763479+0000","last_fullsized":"2023-07-14T13:06:00.763479+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:56:31.037462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750336+0000","last_change":"2023-07-14T13:06:00.750336+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750336+0000","last_undegraded":"2023-07-14T13:06:00.750336+0000","last_fullsized":"2023-07-14T13:06:00.750336+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.763883+0000","last_change":"2023-07-14T13:06:00.760343+0000","last_active":"2023-07-14T13:06:00.763883+0000","last_peered":"2023-07-14T13:06:00.763883+0000","last_clean":"2023-07-14T13:06:00.763883+0000","last_became_active":"2023-07-14T13:06:00.760062+0000","last_became_peered":"2023-07-14T13:06:00.760062+0000","last_unstale":"2023-07-14T13:06:00.763883+0000","last_undegraded":"2023-07-14T13:06:00.763883+0000","last_fullsized":"2023-07-14T13:06:00.763883+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:43:01.259058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.749674+0000","last_change":"2023-07-14T13:06:00.749674+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.749674+0000","last_undegraded":"2023-07-14T13:06:00.749674+0000","last_fullsized":"2023-07-14T13:06:00.749674+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767418+0000","last_change":"2023-07-14T13:06:00.762635+0000","last_active":"2023-07-14T13:06:00.767418+0000","last_peered":"2023-07-14T13:06:00.767418+0000","last_clean":"2023-07-14T13:06:00.767418+0000","last_became_active":"2023-07-14T13:06:00.762384+0000","last_became_peered":"2023-07-14T13:06:00.762384+0000","last_unstale":"2023-07-14T13:06:00.767418+0000","last_undegraded":"2023-07-14T13:06:00.767418+0000","last_fullsized":"2023-07-14T13:06:00.767418+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:22.137266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751703+0000","last_change":"2023-07-14T13:06:00.751703+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751703+0000","last_undegraded":"2023-07-14T13:06:00.751703+0000","last_fullsized":"2023-07-14T13:06:00.751703+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767466+0000","last_change":"2023-07-14T13:06:00.761859+0000","last_active":"2023-07-14T13:06:00.767466+0000","last_peered":"2023-07-14T13:06:00.767466+0000","last_clean":"2023-07-14T13:06:00.767466+0000","last_became_active":"2023-07-14T13:06:00.761595+0000","last_became_peered":"2023-07-14T13:06:00.761595+0000","last_unstale":"2023-07-14T13:06:00.767466+0000","last_undegraded":"2023-07-14T13:06:00.767466+0000","last_fullsized":"2023-07-14T13:06:00.767466+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:22:48.786505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751015+0000","last_change":"2023-07-14T13:06:00.751015+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751015+0000","last_undegraded":"2023-07-14T13:06:00.751015+0000","last_fullsized":"2023-07-14T13:06:00.751015+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765674+0000","last_change":"2023-07-14T13:06:00.761520+0000","last_active":"2023-07-14T13:06:00.765674+0000","last_peered":"2023-07-14T13:06:00.765674+0000","last_clean":"2023-07-14T13:06:00.765674+0000","last_became_active":"2023-07-14T13:06:00.761245+0000","last_became_peered":"2023-07-14T13:06:00.761245+0000","last_unstale":"2023-07-14T13:06:00.765674+0000","last_undegraded":"2023-07-14T13:06:00.765674+0000","last_fullsized":"2023-07-14T13:06:00.765674+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:54:08.359442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.746672+0000","last_change":"2023-07-14T13:06:00.746672+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.746672+0000","last_undegraded":"2023-07-14T13:06:00.746672+0000","last_fullsized":"2023-07-14T13:06:00.746672+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767614+0000","last_change":"2023-07-14T13:06:00.759041+0000","last_active":"2023-07-14T13:06:00.767614+0000","last_peered":"2023-07-14T13:06:00.767614+0000","last_clean":"2023-07-14T13:06:00.767614+0000","last_became_active":"2023-07-14T13:06:00.758732+0000","last_became_peered":"2023-07-14T13:06:00.758732+0000","last_unstale":"2023-07-14T13:06:00.767614+0000","last_undegraded":"2023-07-14T13:06:00.767614+0000","last_fullsized":"2023-07-14T13:06:00.767614+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:31:07.335972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.747138+0000","last_change":"2023-07-14T13:06:00.747138+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.747138+0000","last_undegraded":"2023-07-14T13:06:00.747138+0000","last_fullsized":"2023-07-14T13:06:00.747138+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765404+0000","last_change":"2023-07-14T13:06:00.762299+0000","last_active":"2023-07-14T13:06:00.765404+0000","last_peered":"2023-07-14T13:06:00.765404+0000","last_clean":"2023-07-14T13:06:00.765404+0000","last_became_active":"2023-07-14T13:06:00.761975+0000","last_became_peered":"2023-07-14T13:06:00.761975+0000","last_unstale":"2023-07-14T13:06:00.765404+0000","last_undegraded":"2023-07-14T13:06:00.765404+0000","last_fullsized":"2023-07-14T13:06:00.765404+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:41:42.646912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.748258+0000","last_change":"2023-07-14T13:06:00.748258+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.748258+0000","last_undegraded":"2023-07-14T13:06:00.748258+0000","last_fullsized":"2023-07-14T13:06:00.748258+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.764023+0000","last_change":"2023-07-14T13:06:00.762395+0000","last_active":"2023-07-14T13:06:00.764023+0000","last_peered":"2023-07-14T13:06:00.764023+0000","last_clean":"2023-07-14T13:06:00.764023+0000","last_became_active":"2023-07-14T13:06:00.762022+0000","last_became_peered":"2023-07-14T13:06:00.762022+0000","last_unstale":"2023-07-14T13:06:00.764023+0000","last_undegraded":"2023-07-14T13:06:00.764023+0000","last_fullsized":"2023-07-14T13:06:00.764023+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:02:08.227992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.745329+0000","last_change":"2023-07-14T13:06:00.745329+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.745329+0000","last_undegraded":"2023-07-14T13:06:00.745329+0000","last_fullsized":"2023-07-14T13:06:00.745329+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765902+0000","last_change":"2023-07-14T13:06:00.762994+0000","last_active":"2023-07-14T13:06:00.765902+0000","last_peered":"2023-07-14T13:06:00.765902+0000","last_clean":"2023-07-14T13:06:00.765902+0000","last_became_active":"2023-07-14T13:06:00.762704+0000","last_became_peered":"2023-07-14T13:06:00.762704+0000","last_unstale":"2023-07-14T13:06:00.765902+0000","last_undegraded":"2023-07-14T13:06:00.765902+0000","last_fullsized":"2023-07-14T13:06:00.765902+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:50:34.298484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"53'139","reported_seq":333,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.759241+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:06:00.759241+0000","last_peered":"2023-07-14T13:06:00.759241+0000","last_clean":"2023-07-14T13:06:00.759241+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:06:00.759241+0000","last_undegraded":"2023-07-14T13:06:00.759241+0000","last_fullsized":"2023-07-14T13:06:00.759241+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:25:19.700060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":99,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.753574+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:06:00.753574+0000","last_peered":"2023-07-14T13:06:00.753574+0000","last_clean":"2023-07-14T13:06:00.753574+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:06:00.753574+0000","last_undegraded":"2023-07-14T13:06:00.753574+0000","last_fullsized":"2023-07-14T13:06:00.753574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:46:51.928482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743863+0000","last_change":"2023-07-14T13:06:00.743863+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743863+0000","last_undegraded":"2023-07-14T13:06:00.743863+0000","last_fullsized":"2023-07-14T13:06:00.743863+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.768707+0000","last_change":"2023-07-14T13:06:00.766325+0000","last_active":"2023-07-14T13:06:00.768707+0000","last_peered":"2023-07-14T13:06:00.768707+0000","last_clean":"2023-07-14T13:06:00.768707+0000","last_became_active":"2023-07-14T13:06:00.766116+0000","last_became_peered":"2023-07-14T13:06:00.766116+0000","last_unstale":"2023-07-14T13:06:00.768707+0000","last_undegraded":"2023-07-14T13:06:00.768707+0000","last_fullsized":"2023-07-14T13:06:00.768707+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:47:41.009818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":99,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.759100+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:06:00.759100+0000","last_peered":"2023-07-14T13:06:00.759100+0000","last_clean":"2023-07-14T13:06:00.759100+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:06:00.759100+0000","last_undegraded":"2023-07-14T13:06:00.759100+0000","last_fullsized":"2023-07-14T13:06:00.759100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:06:36.972485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.746502+0000","last_change":"2023-07-14T13:06:00.746502+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.746502+0000","last_undegraded":"2023-07-14T13:06:00.746502+0000","last_fullsized":"2023-07-14T13:06:00.746502+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.756244+0000","last_change":"2023-07-14T13:06:00.752570+0000","last_active":"2023-07-14T13:06:00.756244+0000","last_peered":"2023-07-14T13:06:00.756244+0000","last_clean":"2023-07-14T13:06:00.756244+0000","last_became_active":"2023-07-14T13:06:00.752307+0000","last_became_peered":"2023-07-14T13:06:00.752307+0000","last_unstale":"2023-07-14T13:06:00.756244+0000","last_undegraded":"2023-07-14T13:06:00.756244+0000","last_fullsized":"2023-07-14T13:06:00.756244+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:42:22.518638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.738618+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:06:00.738618+0000","last_peered":"2023-07-14T13:06:00.738618+0000","last_clean":"2023-07-14T13:06:00.738618+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:06:00.738618+0000","last_undegraded":"2023-07-14T13:06:00.738618+0000","last_fullsized":"2023-07-14T13:06:00.738618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:32:53.565488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751428+0000","last_change":"2023-07-14T13:06:00.751428+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751428+0000","last_undegraded":"2023-07-14T13:06:00.751428+0000","last_fullsized":"2023-07-14T13:06:00.751428+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.764726+0000","last_change":"2023-07-14T13:06:00.760649+0000","last_active":"2023-07-14T13:06:00.764726+0000","last_peered":"2023-07-14T13:06:00.764726+0000","last_clean":"2023-07-14T13:06:00.764726+0000","last_became_active":"2023-07-14T13:06:00.760376+0000","last_became_peered":"2023-07-14T13:06:00.760376+0000","last_unstale":"2023-07-14T13:06:00.764726+0000","last_undegraded":"2023-07-14T13:06:00.764726+0000","last_fullsized":"2023-07-14T13:06:00.764726+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:12:44.502720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":99,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.753411+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:06:00.753411+0000","last_peered":"2023-07-14T13:06:00.753411+0000","last_clean":"2023-07-14T13:06:00.753411+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:06:00.753411+0000","last_undegraded":"2023-07-14T13:06:00.753411+0000","last_fullsized":"2023-07-14T13:06:00.753411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:59:19.438385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.747627+0000","last_change":"2023-07-14T13:06:00.747627+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.747627+0000","last_undegraded":"2023-07-14T13:06:00.747627+0000","last_fullsized":"2023-07-14T13:06:00.747627+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765589+0000","last_change":"2023-07-14T13:06:00.762610+0000","last_active":"2023-07-14T13:06:00.765589+0000","last_peered":"2023-07-14T13:06:00.765589+0000","last_clean":"2023-07-14T13:06:00.765589+0000","last_became_active":"2023-07-14T13:06:00.762305+0000","last_became_peered":"2023-07-14T13:06:00.762305+0000","last_unstale":"2023-07-14T13:06:00.765589+0000","last_undegraded":"2023-07-14T13:06:00.765589+0000","last_fullsized":"2023-07-14T13:06:00.765589+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:28.800346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":101,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.752612+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:06:00.752612+0000","last_peered":"2023-07-14T13:06:00.752612+0000","last_clean":"2023-07-14T13:06:00.752612+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:06:00.752612+0000","last_undegraded":"2023-07-14T13:06:00.752612+0000","last_fullsized":"2023-07-14T13:06:00.752612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:08.341386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.742916+0000","last_change":"2023-07-14T13:06:00.742916+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.742916+0000","last_undegraded":"2023-07-14T13:06:00.742916+0000","last_fullsized":"2023-07-14T13:06:00.742916+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.769021+0000","last_change":"2023-07-14T13:06:00.768010+0000","last_active":"2023-07-14T13:06:00.769021+0000","last_peered":"2023-07-14T13:06:00.769021+0000","last_clean":"2023-07-14T13:06:00.769021+0000","last_became_active":"2023-07-14T13:06:00.767670+0000","last_became_peered":"2023-07-14T13:06:00.767670+0000","last_unstale":"2023-07-14T13:06:00.769021+0000","last_undegraded":"2023-07-14T13:06:00.769021+0000","last_fullsized":"2023-07-14T13:06:00.769021+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:50:18.541594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":99,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.760517+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:06:00.760517+0000","last_peered":"2023-07-14T13:06:00.760517+0000","last_clean":"2023-07-14T13:06:00.760517+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:06:00.760517+0000","last_undegraded":"2023-07-14T13:06:00.760517+0000","last_fullsized":"2023-07-14T13:06:00.760517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:41:25.696130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.745965+0000","last_change":"2023-07-14T13:06:00.745965+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.745965+0000","last_undegraded":"2023-07-14T13:06:00.745965+0000","last_fullsized":"2023-07-14T13:06:00.745965+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765184+0000","last_change":"2023-07-14T13:06:00.757176+0000","last_active":"2023-07-14T13:06:00.765184+0000","last_peered":"2023-07-14T13:06:00.765184+0000","last_clean":"2023-07-14T13:06:00.765184+0000","last_became_active":"2023-07-14T13:06:00.756867+0000","last_became_peered":"2023-07-14T13:06:00.756867+0000","last_unstale":"2023-07-14T13:06:00.765184+0000","last_undegraded":"2023-07-14T13:06:00.765184+0000","last_fullsized":"2023-07-14T13:06:00.765184+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:24:48.579990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":101,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.753404+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:06:00.753404+0000","last_peered":"2023-07-14T13:06:00.753404+0000","last_clean":"2023-07-14T13:06:00.753404+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:06:00.753404+0000","last_undegraded":"2023-07-14T13:06:00.753404+0000","last_fullsized":"2023-07-14T13:06:00.753404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:26:51.965367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750879+0000","last_change":"2023-07-14T13:06:00.750879+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750879+0000","last_undegraded":"2023-07-14T13:06:00.750879+0000","last_fullsized":"2023-07-14T13:06:00.750879+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767941+0000","last_change":"2023-07-14T13:06:00.764320+0000","last_active":"2023-07-14T13:06:00.767941+0000","last_peered":"2023-07-14T13:06:00.767941+0000","last_clean":"2023-07-14T13:06:00.767941+0000","last_became_active":"2023-07-14T13:06:00.764000+0000","last_became_peered":"2023-07-14T13:06:00.764000+0000","last_unstale":"2023-07-14T13:06:00.767941+0000","last_undegraded":"2023-07-14T13:06:00.767941+0000","last_fullsized":"2023-07-14T13:06:00.767941+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:25.774499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":99,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.748597+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:06:00.748597+0000","last_peered":"2023-07-14T13:06:00.748597+0000","last_clean":"2023-07-14T13:06:00.748597+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:06:00.748597+0000","last_undegraded":"2023-07-14T13:06:00.748597+0000","last_fullsized":"2023-07-14T13:06:00.748597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:33:03.441107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575011,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54492,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317348,"statfs":{"total":96636764160,"available":96580964352,"internally_reserved":0,"allocated":1331200,"data_stored":950848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.35699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.85499999999999998,"5min":0.98399999999999999,"15min":1.879},"last":0.746},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.745,"15min":0.74099999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.439},"max":{"1min":0.877,"5min":0.95599999999999996,"15min":1.9059999999999999},"last":0.68100000000000005}]},{"osd":1,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.752,"15min":0.72999999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.42999999999999999},"max":{"1min":0.92600000000000005,"5min":1,"15min":1.069},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.76000000000000001,"15min":0.745},"min":{"1min":0.54000000000000004,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93000000000000005,"5min":0.97399999999999998,"15min":1.1020000000000001},"last":0.72399999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.745,"15min":0.72299999999999998},"min":{"1min":0.46999999999999997,"5min":0.42699999999999999,"15min":0.40600000000000003},"max":{"1min":0.877,"5min":1.016,"15min":1.048},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.77500000000000002,"15min":0.755},"min":{"1min":0.50600000000000001,"5min":0.503,"15min":0.46899999999999997},"max":{"1min":0.89200000000000002,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.69999999999999996}]},{"osd":3,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.753,"15min":0.73199999999999998},"min":{"1min":0.50700000000000001,"5min":0.46400000000000002,"15min":0.442},"max":{"1min":0.98199999999999998,"5min":1.0269999999999999,"15min":1.0760000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.78100000000000003,"15min":0.76000000000000001},"min":{"1min":0.51900000000000002,"5min":0.47299999999999998,"15min":0.41499999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.024},"last":0.51900000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.60899999999999999,"15min":0.58999999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.86299999999999999,"5min":1.022,"15min":1.022},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.40999999999999998,"5min":0.40000000000000002,"15min":0.39300000000000002},"max":{"1min":0.68100000000000005,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.66600000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.63300000000000001,"15min":0.622},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94699999999999995,"5min":0.98299999999999998,"15min":1.0249999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.65300000000000002,"15min":0.67300000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.008},"last":0.55700000000000005}]},{"osd":6,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.70399999999999996,"15min":0.71699999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96699999999999997,"5min":1.0489999999999999,"15min":1.4419999999999999},"last":0.62},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.68700000000000006,"15min":0.69199999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91000000000000003,"5min":0.98199999999999998,"15min":1.575},"last":0.54300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575012,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":749568,"data_stored":367108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.51300000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.89200000000000002,"5min":0.996,"15min":1.2749999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73899999999999999,"15min":0.74199999999999999},"min":{"1min":0.53700000000000003,"5min":0.48199999999999998,"15min":0.47399999999999998},"max":{"1min":1.0209999999999999,"5min":1.03,"15min":1.2110000000000001},"last":0.80600000000000005}]},{"osd":1,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.56499999999999995,"5min":0.50800000000000001,"15min":0.379},"max":{"1min":0.94699999999999995,"5min":1.0209999999999999,"15min":1.4299999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.745,"15min":0.72999999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.44},"max":{"1min":0.97099999999999997,"5min":1.077,"15min":1.1379999999999999},"last":0.88200000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.753,"15min":0.752},"min":{"1min":0.56699999999999995,"5min":0.496,"15min":0.40400000000000003},"max":{"1min":0.94099999999999995,"5min":1.105,"15min":1.319},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77300000000000002,"15min":0.75700000000000001},"min":{"1min":0.59199999999999997,"5min":0.54400000000000004,"15min":0.42299999999999999},"max":{"1min":0.94399999999999995,"5min":1.0900000000000001,"15min":1.341},"last":0.67800000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.79100000000000004,"15min":0.78600000000000003},"min":{"1min":0.53200000000000003,"5min":0.52200000000000002,"15min":0.45600000000000002},"max":{"1min":0.92500000000000004,"5min":1.093,"15min":1.3859999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.79300000000000004,"15min":0.76800000000000002},"min":{"1min":0.58199999999999996,"5min":0.53300000000000003,"15min":0.45900000000000002},"max":{"1min":0.99099999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.85699999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.58099999999999996,"15min":0.58999999999999997},"min":{"1min":0.40100000000000002,"5min":0.39300000000000002,"15min":0.32700000000000001},"max":{"1min":0.85899999999999999,"5min":0.871,"15min":0.97899999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63700000000000001,"15min":0.65000000000000002},"min":{"1min":0.442,"5min":0.435,"15min":0.36099999999999999},"max":{"1min":0.81499999999999995,"5min":1.0780000000000001,"15min":1.091},"last":0.61699999999999999}]},{"osd":5,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63700000000000001,"15min":0.65900000000000003},"min":{"1min":0.45800000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91200000000000003,"5min":0.98399999999999999,"15min":1.121},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.67300000000000004,"15min":0.70699999999999996},"min":{"1min":0.47499999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88300000000000001,"5min":0.98699999999999999,"15min":1.145},"last":0.95099999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65600000000000003,"15min":0.67500000000000004},"min":{"1min":0.44600000000000001,"5min":0.41699999999999998,"15min":0.38},"max":{"1min":0.92200000000000004,"5min":1.1200000000000001,"15min":1.208},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.71199999999999997,"15min":0.72499999999999998},"min":{"1min":0.53200000000000003,"5min":0.52700000000000002,"15min":0.442},"max":{"1min":0.85799999999999998,"5min":1.0489999999999999,"15min":1.194},"last":0.70299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575011,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":749568,"data_stored":367108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.73699999999999999,"15min":0.73399999999999999},"min":{"1min":0.45300000000000001,"5min":0.36499999999999999,"15min":0.32400000000000001},"max":{"1min":2.6699999999999999,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.72699999999999998,"15min":0.74099999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.94199999999999995,"5min":0.996,"15min":1.0069999999999999},"last":0.81799999999999995}]},{"osd":1,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.72699999999999998,"15min":0.73199999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.41099999999999998},"max":{"1min":0.85899999999999999,"5min":1.079,"15min":1.335},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75800000000000001,"15min":0.75600000000000001},"min":{"1min":0.505,"5min":0.40400000000000003,"15min":0.36799999999999999},"max":{"1min":2.706,"5min":2.706,"15min":2.706},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73499999999999999,"15min":0.748},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91800000000000004,"5min":1.0940000000000001,"15min":1.298},"last":0.879},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.73299999999999998,"15min":0.74199999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.90200000000000002,"5min":1.044,"15min":1.044},"last":0.68600000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.75600000000000001,"15min":0.745},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.76100000000000001,"15min":0.77600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88900000000000001,"5min":1.149,"15min":1.149},"last":0.77200000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.63200000000000001,"15min":0.64000000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.85199999999999998,"5min":0.94199999999999995,"15min":1.073},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.71599999999999997},"min":{"1min":0.40600000000000003,"5min":0.40200000000000002,"15min":0.35899999999999999},"max":{"1min":2.7719999999999998,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.53600000000000003}]},{"osd":6,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.621,"15min":0.64100000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.89800000000000002,"5min":0.95399999999999996,"15min":0.97999999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.63900000000000001,"15min":0.66200000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.042},"last":0.58799999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":3.0230000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67900000000000005,"15min":0.70899999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.95999999999999996,"5min":1.407,"15min":1.407},"last":0.46800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575011,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":749568,"data_stored":367108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76900000000000002,"15min":0.72999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.42299999999999999},"max":{"1min":1.0129999999999999,"5min":1.411,"15min":1.411},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.749,"15min":0.71299999999999997},"min":{"1min":0.54100000000000004,"5min":0.435,"15min":0.435},"max":{"1min":0.96799999999999997,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":1.0640000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77500000000000002,"15min":0.73599999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.442},"max":{"1min":0.90200000000000002,"5min":1.077,"15min":1.077},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76200000000000001,"15min":0.73899999999999999},"min":{"1min":0.55200000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93300000000000005,"5min":1.0469999999999999,"15min":1.2370000000000001},"last":0.94999999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.75800000000000001,"15min":0.72399999999999998},"min":{"1min":0.60499999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.95899999999999996,"5min":1.091,"15min":1.091},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.80400000000000005,"15min":0.76300000000000001},"min":{"1min":0.59099999999999997,"5min":0.499,"15min":0.443},"max":{"1min":0.99199999999999999,"5min":1.387,"15min":1.387},"last":0.77700000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.77100000000000002,"15min":0.74199999999999999},"min":{"1min":0.63600000000000001,"5min":0.52600000000000002,"15min":0.497},"max":{"1min":0.99399999999999999,"5min":1.008,"15min":1.099},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78900000000000003,"15min":0.76200000000000001},"min":{"1min":0.54100000000000004,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.97099999999999997,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.82199999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61699999999999999,"15min":0.61299999999999999},"min":{"1min":0.48799999999999999,"5min":0.441,"15min":0.38900000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":1.0029999999999999},"last":0.621},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61099999999999999,"15min":0.624},"min":{"1min":0.43099999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88600000000000001,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.751}]},{"osd":6,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.62,"15min":0.63300000000000001},"min":{"1min":0.495,"5min":0.41599999999999998,"15min":0.32300000000000001},"max":{"1min":0.91700000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":1.014},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.68100000000000005},"min":{"1min":0.45400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.98999999999999999},"last":0.84499999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66500000000000004,"15min":0.67800000000000005},"min":{"1min":0.54100000000000004,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94699999999999995,"5min":0.98099999999999998,"15min":1.0349999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69199999999999995,"15min":0.71599999999999997},"min":{"1min":0.56499999999999995,"5min":0.41599999999999998,"15min":0.36899999999999999},"max":{"1min":0.91800000000000004,"5min":1.026,"15min":1.1080000000000001},"last":0.97699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575011,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35876,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335964,"statfs":{"total":96636764160,"available":96600027136,"internally_reserved":0,"allocated":749568,"data_stored":367108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45400000000000001,"15min":0.44400000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.748,"5min":0.755,"15min":0.84199999999999997},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.503,"15min":0.52000000000000002},"min":{"1min":0.378,"5min":0.33300000000000002,"15min":0.309},"max":{"1min":0.65500000000000003,"5min":0.78700000000000003,"15min":1.577},"last":0.40100000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47199999999999998,"15min":0.47599999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.29199999999999998},"max":{"1min":0.65400000000000003,"5min":0.71699999999999997,"15min":0.88200000000000001},"last":0.315},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.32600000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.113},"last":0.376}]},{"osd":2,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.56499999999999995,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.38700000000000001},"max":{"1min":0.63900000000000001,"5min":0.88400000000000001,"15min":1.0820000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.624,"15min":0.59899999999999998},"min":{"1min":0.46400000000000002,"5min":0.441,"15min":0.40100000000000002},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.47499999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.51100000000000001,"5min":0.441,"15min":0.439},"max":{"1min":0.88200000000000001,"5min":1.284,"15min":1.627},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.77400000000000002,"15min":0.78400000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.47699999999999998},"max":{"1min":0.81899999999999995,"5min":1.135,"15min":1.214},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.78500000000000003,"15min":0.79000000000000004},"min":{"1min":0.58499999999999996,"5min":0.57999999999999996,"15min":0.52400000000000002},"max":{"1min":0.86399999999999999,"5min":1.306,"15min":1.333},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.78300000000000003,"15min":0.78600000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.96099999999999997,"5min":1.129,"15min":1.2470000000000001},"last":0.64200000000000002}]},{"osd":6,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.76800000000000002,"15min":0.78600000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.873,"5min":1.117,"15min":1.526},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.505},"max":{"1min":0.93200000000000005,"5min":1.2589999999999999,"15min":1.381},"last":0.54200000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.85099999999999998,"15min":0.84299999999999997},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.53100000000000003},"max":{"1min":2.4910000000000001,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.83099999999999996,"15min":0.83999999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.595,"5min":1.595,"15min":1.6910000000000001},"last":0.77100000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575011,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53908,"kb_used_data":716,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317932,"statfs":{"total":96636764160,"available":96581562368,"internally_reserved":0,"allocated":733184,"data_stored":359461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46700000000000003,"15min":0.46800000000000003},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.28999999999999998},"max":{"1min":2.5270000000000001,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.499}]},{"osd":1,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.47799999999999998,"15min":0.47499999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27500000000000002},"max":{"1min":2.7200000000000002,"5min":2.7200000000000002,"15min":2.7200000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.33000000000000002},"max":{"1min":2.6110000000000002,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":0.56100000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.66600000000000004,"15min":0.60199999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.38},"max":{"1min":8.2530000000000001,"5min":8.2530000000000001,"15min":8.2530000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89600000000000002,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.53400000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.3049999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81499999999999995,"15min":0.80900000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.81899999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.88200000000000001,"15min":0.874},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":3.1139999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.85599999999999998,"15min":0.84599999999999997},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.433},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.94999999999999996}]},{"osd":6,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.82099999999999995,"15min":0.80200000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.47599999999999998},"max":{"1min":3.9849999999999999,"5min":3.9849999999999999,"15min":3.9849999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.83999999999999997,"15min":0.81899999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":3.391,"5min":3.391,"15min":3.391},"last":0.96999999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.83799999999999997,"15min":0.83699999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.5779999999999998,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.84599999999999997,"15min":0.82599999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.50900000000000001},"max":{"1min":2.5939999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.89400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575012,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35876,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335964,"statfs":{"total":96636764160,"available":96600027136,"internally_reserved":0,"allocated":749568,"data_stored":367108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.432,"15min":0.42599999999999999},"min":{"1min":0.26300000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58699999999999997,"5min":0.69099999999999995,"15min":0.77200000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.51500000000000001,"15min":0.49299999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.26500000000000001},"max":{"1min":0.64700000000000002,"5min":0.751,"15min":0.82299999999999995},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.48899999999999999,"15min":0.46899999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.29499999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52600000000000002,"15min":0.51000000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.29299999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.495}]},{"osd":3,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64700000000000002,"15min":0.626},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.432},"max":{"1min":0.79200000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58299999999999996,"15min":0.57599999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.38100000000000001},"max":{"1min":0.749,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.80100000000000005,"15min":0.77200000000000002},"min":{"1min":0.51600000000000001,"5min":0.51300000000000001,"15min":0.40000000000000002},"max":{"1min":0.999,"5min":1.054,"15min":1.236},"last":0.874},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.79000000000000004,"15min":0.77800000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.45700000000000002},"max":{"1min":0.92200000000000004,"5min":1.1040000000000001,"15min":1.1180000000000001},"last":0.74199999999999999}]},{"osd":5,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.79700000000000004,"15min":0.77500000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":0.99099999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.80800000000000005,"15min":0.79200000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48199999999999998},"max":{"1min":0.88,"5min":1.2509999999999999,"15min":1.3600000000000001},"last":0.73299999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.81000000000000005,"15min":0.79100000000000004},"min":{"1min":0.503,"5min":0.503,"15min":0.48499999999999999},"max":{"1min":0.89600000000000002,"5min":1.0649999999999999,"15min":1.274},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.82699999999999996,"15min":0.81200000000000006},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.49199999999999999},"max":{"1min":0.96999999999999997,"5min":1.1599999999999999,"15min":1.2969999999999999},"last":0.70799999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.80200000000000005,"15min":0.78600000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.47799999999999998},"max":{"1min":0.93799999999999994,"5min":1.123,"15min":1.3400000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.85899999999999999,"15min":0.83599999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.52800000000000002},"max":{"1min":0.95699999999999996,"5min":1.1890000000000001,"15min":1.2929999999999999},"last":0.81699999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575013,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36452,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335388,"statfs":{"total":96636764160,"available":96599437312,"internally_reserved":0,"allocated":1339392,"data_stored":956457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.48299999999999998,"15min":0.45900000000000002},"min":{"1min":0.28899999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.50800000000000001,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.69699999999999995,"5min":0.77900000000000003,"15min":1.452},"last":0.35399999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.34100000000000003},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80300000000000005,"5min":0.90300000000000002,"15min":1.5700000000000001},"last":0.41999999999999998}]},{"osd":3,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.502,"15min":0.51100000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.66000000000000003,"5min":0.70599999999999996,"15min":0.99299999999999999},"last":0.502},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.60599999999999998,"15min":0.59699999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":2.4100000000000001,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.80300000000000005,"15min":0.78400000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.44400000000000001},"max":{"1min":1.2150000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.628},{"interface":"front","average":{"1min":0.873,"5min":0.82499999999999996,"15min":0.81599999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.755}]},{"osd":5,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.82299999999999995,"15min":0.80500000000000005},"min":{"1min":0.51800000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2549999999999999,"5min":1.3839999999999999,"15min":1.4950000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.81399999999999995,"15min":0.80400000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.47299999999999998},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.82599999999999996,"15min":0.81799999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.82799999999999996,"15min":0.82199999999999995},"min":{"1min":0.55500000000000005,"5min":0.50600000000000001,"15min":0.41299999999999998},"max":{"1min":1.141,"5min":1.3440000000000001,"15min":1.5369999999999999},"last":0.73899999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.84999999999999998,"15min":0.83999999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.45500000000000002},"max":{"1min":1.04,"5min":1.2749999999999999,"15min":1.603},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82999999999999996,"15min":0.82399999999999995},"min":{"1min":0.57099999999999995,"5min":0.52800000000000002,"15min":0.497},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.69499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:06:06.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3f is not active+clean 2023-07-14T13:06:06.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.748761+0000', 'last_change': '2023-07-14T13:06:00.748761+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.748761+0000', 'last_undegraded': '2023-07-14T13:06:00.748761+0000', 'last_fullsized': '2023-07-14T13:06:00.748761+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:06:06.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3e is not active+clean 2023-07-14T13:06:06.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.754379+0000', 'last_change': '2023-07-14T13:06:00.754379+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.754379+0000', 'last_undegraded': '2023-07-14T13:06:00.754379+0000', 'last_fullsized': '2023-07-14T13:06:00.754379+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:06:06.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3d is not active+clean 2023-07-14T13:06:06.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.747815+0000', 'last_change': '2023-07-14T13:06:00.747815+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.747815+0000', 'last_undegraded': '2023-07-14T13:06:00.747815+0000', 'last_fullsized': '2023-07-14T13:06:00.747815+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:06:06.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3c is not active+clean 2023-07-14T13:06:06.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.753107+0000', 'last_change': '2023-07-14T13:06:00.753107+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.753107+0000', 'last_undegraded': '2023-07-14T13:06:00.753107+0000', 'last_fullsized': '2023-07-14T13:06:00.753107+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:06:06.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3b is not active+clean 2023-07-14T13:06:06.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.751429+0000', 'last_change': '2023-07-14T13:06:00.751429+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.751429+0000', 'last_undegraded': '2023-07-14T13:06:00.751429+0000', 'last_fullsized': '2023-07-14T13:06:00.751429+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:06:06.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3a is not active+clean 2023-07-14T13:06:06.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.744387+0000', 'last_change': '2023-07-14T13:06:00.744387+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.744387+0000', 'last_undegraded': '2023-07-14T13:06:00.744387+0000', 'last_fullsized': '2023-07-14T13:06:00.744387+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:06:06.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.39 is not active+clean 2023-07-14T13:06:06.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.744820+0000', 'last_change': '2023-07-14T13:06:00.744820+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.744820+0000', 'last_undegraded': '2023-07-14T13:06:00.744820+0000', 'last_fullsized': '2023-07-14T13:06:00.744820+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:06:06.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.38 is not active+clean 2023-07-14T13:06:06.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.744099+0000', 'last_change': '2023-07-14T13:06:00.744099+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.744099+0000', 'last_undegraded': '2023-07-14T13:06:00.744099+0000', 'last_fullsized': '2023-07-14T13:06:00.744099+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:06:06.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.37 is not active+clean 2023-07-14T13:06:06.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.743374+0000', 'last_change': '2023-07-14T13:06:00.743374+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.743374+0000', 'last_undegraded': '2023-07-14T13:06:00.743374+0000', 'last_fullsized': '2023-07-14T13:06:00.743374+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:06:06.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.36 is not active+clean 2023-07-14T13:06:06.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.748675+0000', 'last_change': '2023-07-14T13:06:00.748675+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.748675+0000', 'last_undegraded': '2023-07-14T13:06:00.748675+0000', 'last_fullsized': '2023-07-14T13:06:00.748675+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:06:06.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.35 is not active+clean 2023-07-14T13:06:06.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.744940+0000', 'last_change': '2023-07-14T13:06:00.744940+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.744940+0000', 'last_undegraded': '2023-07-14T13:06:00.744940+0000', 'last_fullsized': '2023-07-14T13:06:00.744940+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:06:06.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.34 is not active+clean 2023-07-14T13:06:06.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.743067+0000', 'last_change': '2023-07-14T13:06:00.743067+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.743067+0000', 'last_undegraded': '2023-07-14T13:06:00.743067+0000', 'last_fullsized': '2023-07-14T13:06:00.743067+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:06:06.719 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.33 is not active+clean 2023-07-14T13:06:06.719 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.752149+0000', 'last_change': '2023-07-14T13:06:00.752149+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.752149+0000', 'last_undegraded': '2023-07-14T13:06:00.752149+0000', 'last_fullsized': '2023-07-14T13:06:00.752149+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:06:06.719 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.32 is not active+clean 2023-07-14T13:06:06.719 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.748588+0000', 'last_change': '2023-07-14T13:06:00.748588+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.748588+0000', 'last_undegraded': '2023-07-14T13:06:00.748588+0000', 'last_fullsized': '2023-07-14T13:06:00.748588+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:06:06.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.31 is not active+clean 2023-07-14T13:06:06.720 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.755332+0000', 'last_change': '2023-07-14T13:06:00.755332+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.755332+0000', 'last_undegraded': '2023-07-14T13:06:00.755332+0000', 'last_fullsized': '2023-07-14T13:06:00.755332+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:06:06.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.30 is not active+clean 2023-07-14T13:06:06.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.750787+0000', 'last_change': '2023-07-14T13:06:00.750787+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.750787+0000', 'last_undegraded': '2023-07-14T13:06:00.750787+0000', 'last_fullsized': '2023-07-14T13:06:00.750787+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:06:06.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2f is not active+clean 2023-07-14T13:06:06.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.746739+0000', 'last_change': '2023-07-14T13:06:00.746739+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.746739+0000', 'last_undegraded': '2023-07-14T13:06:00.746739+0000', 'last_fullsized': '2023-07-14T13:06:00.746739+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:06:06.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2e is not active+clean 2023-07-14T13:06:06.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.749397+0000', 'last_change': '2023-07-14T13:06:00.749397+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.749397+0000', 'last_undegraded': '2023-07-14T13:06:00.749397+0000', 'last_fullsized': '2023-07-14T13:06:00.749397+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:06:06.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2d is not active+clean 2023-07-14T13:06:06.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.747489+0000', 'last_change': '2023-07-14T13:06:00.747489+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.747489+0000', 'last_undegraded': '2023-07-14T13:06:00.747489+0000', 'last_fullsized': '2023-07-14T13:06:00.747489+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:06:06.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2c is not active+clean 2023-07-14T13:06:06.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.746486+0000', 'last_change': '2023-07-14T13:06:00.746486+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.746486+0000', 'last_undegraded': '2023-07-14T13:06:00.746486+0000', 'last_fullsized': '2023-07-14T13:06:00.746486+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:06:06.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2b is not active+clean 2023-07-14T13:06:06.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.745688+0000', 'last_change': '2023-07-14T13:06:00.745688+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.745688+0000', 'last_undegraded': '2023-07-14T13:06:00.745688+0000', 'last_fullsized': '2023-07-14T13:06:00.745688+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:06:06.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2a is not active+clean 2023-07-14T13:06:06.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.743004+0000', 'last_change': '2023-07-14T13:06:00.743004+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.743004+0000', 'last_undegraded': '2023-07-14T13:06:00.743004+0000', 'last_fullsized': '2023-07-14T13:06:00.743004+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:06:06.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.29 is not active+clean 2023-07-14T13:06:06.726 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.745492+0000', 'last_change': '2023-07-14T13:06:00.745492+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.745492+0000', 'last_undegraded': '2023-07-14T13:06:00.745492+0000', 'last_fullsized': '2023-07-14T13:06:00.745492+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:06:06.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.28 is not active+clean 2023-07-14T13:06:06.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.742309+0000', 'last_change': '2023-07-14T13:06:00.742309+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.742309+0000', 'last_undegraded': '2023-07-14T13:06:00.742309+0000', 'last_fullsized': '2023-07-14T13:06:00.742309+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:06:06.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.27 is not active+clean 2023-07-14T13:06:06.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.743183+0000', 'last_change': '2023-07-14T13:06:00.743183+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.743183+0000', 'last_undegraded': '2023-07-14T13:06:00.743183+0000', 'last_fullsized': '2023-07-14T13:06:00.743183+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:06:06.728 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.26 is not active+clean 2023-07-14T13:06:06.728 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.748463+0000', 'last_change': '2023-07-14T13:06:00.748463+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.748463+0000', 'last_undegraded': '2023-07-14T13:06:00.748463+0000', 'last_fullsized': '2023-07-14T13:06:00.748463+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:06:06.729 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.25 is not active+clean 2023-07-14T13:06:06.729 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.743994+0000', 'last_change': '2023-07-14T13:06:00.743994+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.743994+0000', 'last_undegraded': '2023-07-14T13:06:00.743994+0000', 'last_fullsized': '2023-07-14T13:06:00.743994+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:06:06.729 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.24 is not active+clean 2023-07-14T13:06:06.730 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.745322+0000', 'last_change': '2023-07-14T13:06:00.745322+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.745322+0000', 'last_undegraded': '2023-07-14T13:06:00.745322+0000', 'last_fullsized': '2023-07-14T13:06:00.745322+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:06:06.730 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.23 is not active+clean 2023-07-14T13:06:06.731 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.743892+0000', 'last_change': '2023-07-14T13:06:00.743892+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.743892+0000', 'last_undegraded': '2023-07-14T13:06:00.743892+0000', 'last_fullsized': '2023-07-14T13:06:00.743892+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:06:06.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.22 is not active+clean 2023-07-14T13:06:06.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.750152+0000', 'last_change': '2023-07-14T13:06:00.750152+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.750152+0000', 'last_undegraded': '2023-07-14T13:06:00.750152+0000', 'last_fullsized': '2023-07-14T13:06:00.750152+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:06:06.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.21 is not active+clean 2023-07-14T13:06:06.733 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.743608+0000', 'last_change': '2023-07-14T13:06:00.743608+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.743608+0000', 'last_undegraded': '2023-07-14T13:06:00.743608+0000', 'last_fullsized': '2023-07-14T13:06:00.743608+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:06:06.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.20 is not active+clean 2023-07-14T13:06:06.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.751944+0000', 'last_change': '2023-07-14T13:06:00.751944+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.751944+0000', 'last_undegraded': '2023-07-14T13:06:00.751944+0000', 'last_fullsized': '2023-07-14T13:06:00.751944+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:06:06.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2023-07-14T13:06:06.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.755014+0000', 'last_change': '2023-07-14T13:06:00.755014+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.755014+0000', 'last_undegraded': '2023-07-14T13:06:00.755014+0000', 'last_fullsized': '2023-07-14T13:06:00.755014+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:06:06.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2023-07-14T13:06:06.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.750889+0000', 'last_change': '2023-07-14T13:06:00.750889+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.750889+0000', 'last_undegraded': '2023-07-14T13:06:00.750889+0000', 'last_fullsized': '2023-07-14T13:06:00.750889+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:06:06.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-07-14T13:06:06.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.745320+0000', 'last_change': '2023-07-14T13:06:00.745320+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.745320+0000', 'last_undegraded': '2023-07-14T13:06:00.745320+0000', 'last_fullsized': '2023-07-14T13:06:00.745320+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:06:06.737 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2023-07-14T13:06:06.737 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.746995+0000', 'last_change': '2023-07-14T13:06:00.746995+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.746995+0000', 'last_undegraded': '2023-07-14T13:06:00.746995+0000', 'last_fullsized': '2023-07-14T13:06:00.746995+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:06:06.737 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2023-07-14T13:06:06.738 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.750581+0000', 'last_change': '2023-07-14T13:06:00.750581+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.750581+0000', 'last_undegraded': '2023-07-14T13:06:00.750581+0000', 'last_fullsized': '2023-07-14T13:06:00.750581+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:06:06.738 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2023-07-14T13:06:06.738 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.749693+0000', 'last_change': '2023-07-14T13:06:00.749693+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.749693+0000', 'last_undegraded': '2023-07-14T13:06:00.749693+0000', 'last_fullsized': '2023-07-14T13:06:00.749693+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:06:06.739 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2023-07-14T13:06:06.739 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.741690+0000', 'last_change': '2023-07-14T13:06:00.741690+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.741690+0000', 'last_undegraded': '2023-07-14T13:06:00.741690+0000', 'last_fullsized': '2023-07-14T13:06:00.741690+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:06:06.739 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2023-07-14T13:06:06.740 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.753601+0000', 'last_change': '2023-07-14T13:06:00.753601+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.753601+0000', 'last_undegraded': '2023-07-14T13:06:00.753601+0000', 'last_fullsized': '2023-07-14T13:06:00.753601+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:06:06.740 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2023-07-14T13:06:06.740 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.749729+0000', 'last_change': '2023-07-14T13:06:00.749729+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.749729+0000', 'last_undegraded': '2023-07-14T13:06:00.749729+0000', 'last_fullsized': '2023-07-14T13:06:00.749729+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:06:06.741 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2023-07-14T13:06:06.741 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.751489+0000', 'last_change': '2023-07-14T13:06:00.751489+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.751489+0000', 'last_undegraded': '2023-07-14T13:06:00.751489+0000', 'last_fullsized': '2023-07-14T13:06:00.751489+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:06:06.742 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2023-07-14T13:06:06.742 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.742869+0000', 'last_change': '2023-07-14T13:06:00.742869+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.742869+0000', 'last_undegraded': '2023-07-14T13:06:00.742869+0000', 'last_fullsized': '2023-07-14T13:06:00.742869+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:06:06.742 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2023-07-14T13:06:06.743 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.750209+0000', 'last_change': '2023-07-14T13:06:00.750209+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.750209+0000', 'last_undegraded': '2023-07-14T13:06:00.750209+0000', 'last_fullsized': '2023-07-14T13:06:00.750209+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:06:06.743 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2023-07-14T13:06:06.744 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.751561+0000', 'last_change': '2023-07-14T13:06:00.751561+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.751561+0000', 'last_undegraded': '2023-07-14T13:06:00.751561+0000', 'last_fullsized': '2023-07-14T13:06:00.751561+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:06:06.744 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2023-07-14T13:06:06.744 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.744200+0000', 'last_change': '2023-07-14T13:06:00.744200+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.744200+0000', 'last_undegraded': '2023-07-14T13:06:00.744200+0000', 'last_fullsized': '2023-07-14T13:06:00.744200+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:06:06.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2023-07-14T13:06:06.745 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.742230+0000', 'last_change': '2023-07-14T13:06:00.742230+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.742230+0000', 'last_undegraded': '2023-07-14T13:06:00.742230+0000', 'last_fullsized': '2023-07-14T13:06:00.742230+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:06:06.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2023-07-14T13:06:06.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.747222+0000', 'last_change': '2023-07-14T13:06:00.747222+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.747222+0000', 'last_undegraded': '2023-07-14T13:06:00.747222+0000', 'last_fullsized': '2023-07-14T13:06:00.747222+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:06:06.746 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2023-07-14T13:06:06.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.743629+0000', 'last_change': '2023-07-14T13:06:00.743629+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.743629+0000', 'last_undegraded': '2023-07-14T13:06:00.743629+0000', 'last_fullsized': '2023-07-14T13:06:00.743629+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:06:06.747 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2023-07-14T13:06:06.747 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.750336+0000', 'last_change': '2023-07-14T13:06:00.750336+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.750336+0000', 'last_undegraded': '2023-07-14T13:06:00.750336+0000', 'last_fullsized': '2023-07-14T13:06:00.750336+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:06:06.747 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2023-07-14T13:06:06.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.749674+0000', 'last_change': '2023-07-14T13:06:00.749674+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.749674+0000', 'last_undegraded': '2023-07-14T13:06:00.749674+0000', 'last_fullsized': '2023-07-14T13:06:00.749674+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:06:06.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2023-07-14T13:06:06.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.751703+0000', 'last_change': '2023-07-14T13:06:00.751703+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.751703+0000', 'last_undegraded': '2023-07-14T13:06:00.751703+0000', 'last_fullsized': '2023-07-14T13:06:00.751703+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:06:06.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2023-07-14T13:06:06.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.751015+0000', 'last_change': '2023-07-14T13:06:00.751015+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.751015+0000', 'last_undegraded': '2023-07-14T13:06:00.751015+0000', 'last_fullsized': '2023-07-14T13:06:00.751015+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:06:06.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-07-14T13:06:06.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.746672+0000', 'last_change': '2023-07-14T13:06:00.746672+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.746672+0000', 'last_undegraded': '2023-07-14T13:06:00.746672+0000', 'last_fullsized': '2023-07-14T13:06:00.746672+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:06:06.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2023-07-14T13:06:06.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.747138+0000', 'last_change': '2023-07-14T13:06:00.747138+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.747138+0000', 'last_undegraded': '2023-07-14T13:06:00.747138+0000', 'last_fullsized': '2023-07-14T13:06:00.747138+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:06:06.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2023-07-14T13:06:06.752 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.748258+0000', 'last_change': '2023-07-14T13:06:00.748258+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.748258+0000', 'last_undegraded': '2023-07-14T13:06:00.748258+0000', 'last_fullsized': '2023-07-14T13:06:00.748258+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:06:06.752 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-07-14T13:06:06.752 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.745329+0000', 'last_change': '2023-07-14T13:06:00.745329+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.745329+0000', 'last_undegraded': '2023-07-14T13:06:00.745329+0000', 'last_fullsized': '2023-07-14T13:06:00.745329+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:06:06.753 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2023-07-14T13:06:06.753 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.743863+0000', 'last_change': '2023-07-14T13:06:00.743863+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.743863+0000', 'last_undegraded': '2023-07-14T13:06:00.743863+0000', 'last_fullsized': '2023-07-14T13:06:00.743863+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:06:06.754 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2023-07-14T13:06:06.754 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.746502+0000', 'last_change': '2023-07-14T13:06:00.746502+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.746502+0000', 'last_undegraded': '2023-07-14T13:06:00.746502+0000', 'last_fullsized': '2023-07-14T13:06:00.746502+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:06:06.754 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2023-07-14T13:06:06.755 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.751428+0000', 'last_change': '2023-07-14T13:06:00.751428+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.751428+0000', 'last_undegraded': '2023-07-14T13:06:00.751428+0000', 'last_fullsized': '2023-07-14T13:06:00.751428+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:06:06.755 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-07-14T13:06:06.755 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.747627+0000', 'last_change': '2023-07-14T13:06:00.747627+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.747627+0000', 'last_undegraded': '2023-07-14T13:06:00.747627+0000', 'last_fullsized': '2023-07-14T13:06:00.747627+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:06:06.756 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2023-07-14T13:06:06.756 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.742916+0000', 'last_change': '2023-07-14T13:06:00.742916+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.742916+0000', 'last_undegraded': '2023-07-14T13:06:00.742916+0000', 'last_fullsized': '2023-07-14T13:06:00.742916+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:06:06.757 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2023-07-14T13:06:06.757 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.745965+0000', 'last_change': '2023-07-14T13:06:00.745965+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.745965+0000', 'last_undegraded': '2023-07-14T13:06:00.745965+0000', 'last_fullsized': '2023-07-14T13:06:00.745965+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:06:06.757 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2023-07-14T13:06:06.758 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:06:00.750879+0000', 'last_change': '2023-07-14T13:06:00.750879+0000', 'last_active': '2023-07-14T13:06:00.732778+0000', 'last_peered': '2023-07-14T13:06:00.732778+0000', 'last_clean': '2023-07-14T13:06:00.732778+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:06:00.750879+0000', 'last_undegraded': '2023-07-14T13:06:00.750879+0000', 'last_fullsized': '2023-07-14T13:06:00.750879+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'last_clean_scrub_stamp': '2023-07-14T13:06:00.732778+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:06:06.758 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-14T13:06:06.760 INFO:tasks.ceph.mds.c.smithi005.stderr:2023-07-14T13:06:06.722+0000 7f00b37d2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T13:06:06.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.870+0000 7f7059e9e640 1 Processor -- start 2023-07-14T13:06:06.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.870+0000 7f7059e9e640 1 -- start start 2023-07-14T13:06:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.874+0000 7f7059e9e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f70540b7d90 0x7f70540cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.874+0000 7f7059e9e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70540d0f60 con 0x7f70540d13f0 2023-07-14T13:06:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.874+0000 7f7059e9e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70540d0390 con 0x7f705415f3f0 2023-07-14T13:06:06.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.874+0000 7f7059e9e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70540d0630 con 0x7f70540b7d90 2023-07-14T13:06:06.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.874+0000 7f7053fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f70540b7d90 0x7f70540cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:06.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.874+0000 7f705969d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f70540d13f0 0x7f70540ccee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48346/0 (socket says 172.21.15.5:48346) 2023-07-14T13:06:06.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.874+0000 7f705969d640 1 -- 172.21.15.5:0/4015018259 learned_addr learned my addr 172.21.15.5:0/4015018259 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:06:06.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.874+0000 7f7053fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f70540b7d90 0x7f70540cc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57480/0 (socket says 172.21.15.5:57480) 2023-07-14T13:06:06.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.874+0000 7f7053fff640 1 -- 172.21.15.5:0/4015018259 >> v1:172.21.15.154:6789/0 conn(0x7f705415f3f0 legacy=0x7f70540b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:06.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.874+0000 7f7053fff640 1 -- 172.21.15.5:0/4015018259 >> v1:172.21.15.5:6789/0 conn(0x7f70540d13f0 legacy=0x7f70540ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:06.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.874+0000 7f7053fff640 1 -- 172.21.15.5:0/4015018259 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70540d0910 con 0x7f70540b7d90 2023-07-14T13:06:06.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.874+0000 7f70537fe640 1 -- 172.21.15.5:0/4015018259 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3622432039 0 0) 0x7f70540d0f60 con 0x7f70540d13f0 2023-07-14T13:06:06.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.878+0000 7f7053fff640 1 --2- 172.21.15.5:0/4015018259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70540b7d90 0x7f70540cc9a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f70400097c0 tx=0x7f704001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d324576aa1402d5a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:06.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.878+0000 7f70537fe640 1 -- 172.21.15.5:0/4015018259 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70400ab600 con 0x7f70540b7d90 2023-07-14T13:06:06.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.878+0000 7f70537fe640 1 -- 172.21.15.5:0/4015018259 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70400a7050 con 0x7f70540b7d90 2023-07-14T13:06:06.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.878+0000 7f70537fe640 1 -- 172.21.15.5:0/4015018259 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70400ab980 con 0x7f70540b7d90 2023-07-14T13:06:06.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.878+0000 7f7059e9e640 1 -- 172.21.15.5:0/4015018259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70540b7d90 msgr2=0x7f70540cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:06.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.878+0000 7f7059e9e640 1 --2- 172.21.15.5:0/4015018259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70540b7d90 0x7f70540cc9a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f70400097c0 tx=0x7f704001c3f0 comp rx=0 tx=0).stop 2023-07-14T13:06:06.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.878+0000 7f7059e9e640 1 -- 172.21.15.5:0/4015018259 shutdown_connections 2023-07-14T13:06:06.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.878+0000 7f7059e9e640 1 --2- 172.21.15.5:0/4015018259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70540b7d90 0x7f70540cc9a0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:06.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.878+0000 7f7059e9e640 1 -- 172.21.15.5:0/4015018259 >> 172.21.15.5:0/4015018259 conn(0x7f7054069f50 msgr2=0x7f705406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:06.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.878+0000 7f7059e9e640 1 -- 172.21.15.5:0/4015018259 shutdown_connections 2023-07-14T13:06:06.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.878+0000 7f7059e9e640 1 -- 172.21.15.5:0/4015018259 wait complete. 2023-07-14T13:06:06.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.878+0000 7f7059e9e640 1 Processor -- start 2023-07-14T13:06:06.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.878+0000 7f7059e9e640 1 -- start start 2023-07-14T13:06:06.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.878+0000 7f7059e9e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70540b7d90 0x7f70540b1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:06.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.882+0000 7f7059e9e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70540d13f0 0x7f70540ca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.882+0000 7f7059e9e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f705415f3f0 0x7f70541532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.882+0000 7f7059e9e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70540b17c0 con 0x7f70540b7d90 2023-07-14T13:06:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.882+0000 7f7059e9e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70540ca950 con 0x7f705415f3f0 2023-07-14T13:06:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.882+0000 7f7059e9e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70541537e0 con 0x7f70540d13f0 2023-07-14T13:06:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.882+0000 7f7058e9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70540b7d90 0x7f70540b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.882+0000 7f7058e9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70540b7d90 0x7f70540b1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57486/0 (socket says 172.21.15.5:57486) 2023-07-14T13:06:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.882+0000 7f7058e9c640 1 -- 172.21.15.5:0/1882390831 learned_addr learned my addr 172.21.15.5:0/1882390831 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.882+0000 7f7058e9c640 1 -- 172.21.15.5:0/1882390831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70540d13f0 msgr2=0x7f70540ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:06.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.882+0000 7f7058e9c640 1 --2- 172.21.15.5:0/1882390831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70540d13f0 0x7f70540ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:06.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.882+0000 7f7058e9c640 1 -- 172.21.15.5:0/1882390831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f705415f3f0 msgr2=0x7f70541532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:06.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.882+0000 7f7058e9c640 1 --2- 172.21.15.5:0/1882390831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f705415f3f0 0x7f70541532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:06.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.882+0000 7f7058e9c640 1 -- 172.21.15.5:0/1882390831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7040009420 con 0x7f70540b7d90 2023-07-14T13:06:06.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.882+0000 7f7058e9c640 1 --2- 172.21.15.5:0/1882390831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70540b7d90 0x7f70540b1280 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f704800c7d0 tx=0x7f704800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:06.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.882+0000 7f70517fa640 1 -- 172.21.15.5:0/1882390831 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7048003b80 con 0x7f70540b7d90 2023-07-14T13:06:06.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.882+0000 7f70517fa640 1 -- 172.21.15.5:0/1882390831 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7048003ce0 con 0x7f70540b7d90 2023-07-14T13:06:06.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.882+0000 7f70517fa640 1 -- 172.21.15.5:0/1882390831 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704800aa90 con 0x7f70540b7d90 2023-07-14T13:06:06.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.882+0000 7f7059e9e640 1 -- 172.21.15.5:0/1882390831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70540cab80 con 0x7f70540b7d90 2023-07-14T13:06:06.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.882+0000 7f7059e9e640 1 -- 172.21.15.5:0/1882390831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70540cb140 con 0x7f70540b7d90 2023-07-14T13:06:06.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.882+0000 7f7059e9e640 1 -- 172.21.15.5:0/1882390831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70540678d0 con 0x7f70540b7d90 2023-07-14T13:06:06.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.882+0000 7f70517fa640 1 -- 172.21.15.5:0/1882390831 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f704800abf0 con 0x7f70540b7d90 2023-07-14T13:06:06.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.886+0000 7f70517fa640 1 --2- 172.21.15.5:0/1882390831 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f70380663a0 0x7f7038068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:06.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.886+0000 7f70517fa640 1 -- 172.21.15.5:0/1882390831 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7048083d50 con 0x7f70540b7d90 2023-07-14T13:06:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.886+0000 7f7053fff640 1 --2- 172.21.15.5:0/1882390831 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f70380663a0 0x7f7038068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.886+0000 7f7053fff640 1 --2- 172.21.15.5:0/1882390831 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f70380663a0 0x7f7038068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f70400ad000 tx=0x7f7040004740 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:06.890+0000 7f70517fa640 1 -- 172.21.15.5:0/1882390831 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7048051020 con 0x7f70540b7d90 2023-07-14T13:06:07.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.102+0000 7f7059e9e640 1 -- 172.21.15.5:0/1882390831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f7054072eb0 con 0x7f70540b7d90 2023-07-14T13:06:07.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.102+0000 7f70517fa640 1 -- 172.21.15.5:0/1882390831 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3229 (secure 0 0 0) 0x7f7048054640 con 0x7f70540b7d90 2023-07-14T13:06:07.133 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:06:07.133 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":826,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":65,"num_osds":8,"num_up_osds":8,"osd_up_since":1689339152,"num_in_osds":8,"osd_in_since":1689339143,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":315236352,"bytes_avail":772778876928,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":24,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":6036}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-07-14T13:05:49.540632+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-14T13:06:07.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.102+0000 7f7059e9e640 1 -- 172.21.15.5:0/1882390831 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f70380663a0 msgr2=0x7f7038068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:07.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.102+0000 7f7059e9e640 1 --2- 172.21.15.5:0/1882390831 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f70380663a0 0x7f7038068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f70400ad000 tx=0x7f7040004740 comp rx=0 tx=0).stop 2023-07-14T13:06:07.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.102+0000 7f7059e9e640 1 -- 172.21.15.5:0/1882390831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70540b7d90 msgr2=0x7f70540b1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:07.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.102+0000 7f7059e9e640 1 --2- 172.21.15.5:0/1882390831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70540b7d90 0x7f70540b1280 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f704800c7d0 tx=0x7f704800cc90 comp rx=0 tx=0).stop 2023-07-14T13:06:07.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.102+0000 7f7059e9e640 1 -- 172.21.15.5:0/1882390831 shutdown_connections 2023-07-14T13:06:07.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.102+0000 7f7059e9e640 1 --2- 172.21.15.5:0/1882390831 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f70380663a0 0x7f7038068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:07.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.102+0000 7f7059e9e640 1 --2- 172.21.15.5:0/1882390831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f705415f3f0 0x7f70541532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:07.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.102+0000 7f7059e9e640 1 --2- 172.21.15.5:0/1882390831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70540d13f0 0x7f70540ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:07.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.102+0000 7f7059e9e640 1 --2- 172.21.15.5:0/1882390831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70540b7d90 0x7f70540b1280 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:07.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.102+0000 7f7059e9e640 1 -- 172.21.15.5:0/1882390831 >> 172.21.15.5:0/1882390831 conn(0x7f7054069f50 msgr2=0x7f705415ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:07.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.102+0000 7f7059e9e640 1 -- 172.21.15.5:0/1882390831 shutdown_connections 2023-07-14T13:06:07.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.102+0000 7f7059e9e640 1 -- 172.21.15.5:0/1882390831 wait complete. 2023-07-14T13:06:07.154 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-14T13:06:07.155 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:06:07.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.266+0000 7f545fc6d640 1 Processor -- start 2023-07-14T13:06:07.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.266+0000 7f545fc6d640 1 -- start start 2023-07-14T13:06:07.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.270+0000 7f545fc6d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5458159a00 0x7f545806e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:07.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.270+0000 7f545fc6d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54580695d0 con 0x7f545815dcc0 2023-07-14T13:06:07.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.270+0000 7f545fc6d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54580698b0 con 0x7f545806a670 2023-07-14T13:06:07.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.270+0000 7f545fc6d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5458069b90 con 0x7f5458159a00 2023-07-14T13:06:07.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.270+0000 7f545da09640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5458159a00 0x7f545806e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:07.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.270+0000 7f545e20a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f545815dcc0 0x7f54580ccbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48354/0 (socket says 172.21.15.5:48354) 2023-07-14T13:06:07.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.270+0000 7f545e20a640 1 -- 172.21.15.5:0/4248890136 learned_addr learned my addr 172.21.15.5:0/4248890136 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:06:07.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.270+0000 7f545da09640 1 -- 172.21.15.5:0/4248890136 >> v1:172.21.15.154:6789/0 conn(0x7f545806a670 legacy=0x7f545815d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:07.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.270+0000 7f545da09640 1 -- 172.21.15.5:0/4248890136 >> v1:172.21.15.5:6789/0 conn(0x7f545815dcc0 legacy=0x7f54580ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:07.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.270+0000 7f545da09640 1 -- 172.21.15.5:0/4248890136 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5458069e70 con 0x7f5458159a00 2023-07-14T13:06:07.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.270+0000 7f545ca07640 1 -- 172.21.15.5:0/4248890136 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169967193 0 0) 0x7f54580695d0 con 0x7f545815dcc0 2023-07-14T13:06:07.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.270+0000 7f545da09640 1 --2- 172.21.15.5:0/4248890136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5458159a00 0x7f545806e010 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f54540097c0 tx=0x7f545401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477ed1b20ff80363 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:07.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.274+0000 7f545ca07640 1 -- 172.21.15.5:0/4248890136 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54540ad660 con 0x7f5458159a00 2023-07-14T13:06:07.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.274+0000 7f545ca07640 1 -- 172.21.15.5:0/4248890136 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54540ad7c0 con 0x7f5458159a00 2023-07-14T13:06:07.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.274+0000 7f545ca07640 1 -- 172.21.15.5:0/4248890136 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54540adb50 con 0x7f5458159a00 2023-07-14T13:06:07.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.274+0000 7f545fc6d640 1 -- 172.21.15.5:0/4248890136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5458159a00 msgr2=0x7f545806e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:07.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.274+0000 7f545fc6d640 1 --2- 172.21.15.5:0/4248890136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5458159a00 0x7f545806e010 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f54540097c0 tx=0x7f545401c450 comp rx=0 tx=0).stop 2023-07-14T13:06:07.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.274+0000 7f545fc6d640 1 -- 172.21.15.5:0/4248890136 shutdown_connections 2023-07-14T13:06:07.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.274+0000 7f545fc6d640 1 --2- 172.21.15.5:0/4248890136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5458159a00 0x7f545806e010 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:07.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.274+0000 7f545fc6d640 1 -- 172.21.15.5:0/4248890136 >> 172.21.15.5:0/4248890136 conn(0x7f54580b1300 msgr2=0x7f54580ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:07.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.274+0000 7f545fc6d640 1 -- 172.21.15.5:0/4248890136 shutdown_connections 2023-07-14T13:06:07.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.274+0000 7f545fc6d640 1 -- 172.21.15.5:0/4248890136 wait complete. 2023-07-14T13:06:07.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.274+0000 7f545fc6d640 1 Processor -- start 2023-07-14T13:06:07.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.274+0000 7f545fc6d640 1 -- start start 2023-07-14T13:06:07.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.274+0000 7f545fc6d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f545806a670 0x7f545814a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:07.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.274+0000 7f545fc6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5458159a00 0x7f54580ac480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:07.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.274+0000 7f545fc6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f545815dcc0 0x7f54581f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:07.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.274+0000 7f545fc6d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545814cbf0 con 0x7f5458159a00 2023-07-14T13:06:07.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.274+0000 7f545fc6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545814abb0 con 0x7f545815dcc0 2023-07-14T13:06:07.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.274+0000 7f545fc6d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545814c600 con 0x7f545806a670 2023-07-14T13:06:07.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.274+0000 7f545d208640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5458159a00 0x7f54580ac480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:07.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.274+0000 7f545d208640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5458159a00 0x7f54580ac480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57504/0 (socket says 172.21.15.5:57504) 2023-07-14T13:06:07.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.274+0000 7f545d208640 1 -- 172.21.15.5:0/4068066957 learned_addr learned my addr 172.21.15.5:0/4068066957 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:07.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.278+0000 7f545e20a640 1 --2- 172.21.15.5:0/4068066957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f545815dcc0 0x7f54581f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:07.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.278+0000 7f545da09640 1 --2- 172.21.15.5:0/4068066957 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f545806a670 0x7f545814a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:07.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.278+0000 7f545d208640 1 -- 172.21.15.5:0/4068066957 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f545806a670 msgr2=0x7f545814a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:07.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.278+0000 7f545d208640 1 --2- 172.21.15.5:0/4068066957 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f545806a670 0x7f545814a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:07.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.278+0000 7f545d208640 1 -- 172.21.15.5:0/4068066957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f545815dcc0 msgr2=0x7f54581f45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:07.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.278+0000 7f545d208640 1 --2- 172.21.15.5:0/4068066957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f545815dcc0 0x7f54581f45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:07.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.278+0000 7f545d208640 1 -- 172.21.15.5:0/4068066957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5454009420 con 0x7f5458159a00 2023-07-14T13:06:07.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.278+0000 7f545d208640 1 --2- 172.21.15.5:0/4068066957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5458159a00 0x7f54580ac480 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f544800c530 tx=0x7f544800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:07.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.278+0000 7f544e7fc640 1 -- 172.21.15.5:0/4068066957 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5448005220 con 0x7f5458159a00 2023-07-14T13:06:07.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.278+0000 7f544e7fc640 1 -- 172.21.15.5:0/4068066957 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5448005380 con 0x7f5458159a00 2023-07-14T13:06:07.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.278+0000 7f544e7fc640 1 -- 172.21.15.5:0/4068066957 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5448007270 con 0x7f5458159a00 2023-07-14T13:06:07.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.278+0000 7f545fc6d640 1 -- 172.21.15.5:0/4068066957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54581f5100 con 0x7f5458159a00 2023-07-14T13:06:07.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.278+0000 7f545fc6d640 1 -- 172.21.15.5:0/4068066957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545814c810 con 0x7f5458159a00 2023-07-14T13:06:07.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.278+0000 7f545fc6d640 1 -- 172.21.15.5:0/4068066957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f545814cd30 con 0x7f5458159a00 2023-07-14T13:06:07.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.278+0000 7f544e7fc640 1 -- 172.21.15.5:0/4068066957 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f54480073d0 con 0x7f5458159a00 2023-07-14T13:06:07.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.278+0000 7f544e7fc640 1 --2- 172.21.15.5:0/4068066957 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f543c0663a0 0x7f543c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:07.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.282+0000 7f544e7fc640 1 -- 172.21.15.5:0/4068066957 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5448083620 con 0x7f5458159a00 2023-07-14T13:06:07.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.282+0000 7f545da09640 1 --2- 172.21.15.5:0/4068066957 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f543c0663a0 0x7f543c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:07.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.282+0000 7f545da09640 1 --2- 172.21.15.5:0/4068066957 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f543c0663a0 0x7f543c068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f54540af000 tx=0x7f54540a7000 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:07.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.286+0000 7f544e7fc640 1 -- 172.21.15.5:0/4068066957 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f545814cd30 con 0x7f5458159a00 2023-07-14T13:06:07.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.438+0000 7f545fc6d640 1 -- 172.21.15.5:0/4068066957 --> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f545806d230 con 0x7f543c0663a0 2023-07-14T13:06:07.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.446+0000 7f544e7fc640 1 -- 172.21.15.5:0/4068066957 <== mgr.5695 v2:172.21.15.154:6832/1810553301 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305582 (secure 0 0 0) 0x7f54540bd070 con 0x7f543c0663a0 2023-07-14T13:06:07.481 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:06:07.482 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:06:07.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.450+0000 7f545fc6d640 1 -- 172.21.15.5:0/4068066957 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f543c0663a0 msgr2=0x7f543c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:07.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.450+0000 7f545fc6d640 1 --2- 172.21.15.5:0/4068066957 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f543c0663a0 0x7f543c068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f54540af000 tx=0x7f54540a7000 comp rx=0 tx=0).stop 2023-07-14T13:06:07.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.450+0000 7f545fc6d640 1 -- 172.21.15.5:0/4068066957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5458159a00 msgr2=0x7f54580ac480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:07.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.450+0000 7f545fc6d640 1 --2- 172.21.15.5:0/4068066957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5458159a00 0x7f54580ac480 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f544800c530 tx=0x7f544800c9f0 comp rx=0 tx=0).stop 2023-07-14T13:06:07.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.450+0000 7f545fc6d640 1 -- 172.21.15.5:0/4068066957 shutdown_connections 2023-07-14T13:06:07.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.450+0000 7f545fc6d640 1 --2- 172.21.15.5:0/4068066957 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f543c0663a0 0x7f543c068850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:07.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.450+0000 7f545fc6d640 1 --2- 172.21.15.5:0/4068066957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f545815dcc0 0x7f54581f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:07.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.450+0000 7f545fc6d640 1 --2- 172.21.15.5:0/4068066957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5458159a00 0x7f54580ac480 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:07.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.450+0000 7f545fc6d640 1 --2- 172.21.15.5:0/4068066957 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f545806a670 0x7f545814a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:07.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.450+0000 7f545fc6d640 1 -- 172.21.15.5:0/4068066957 >> 172.21.15.5:0/4068066957 conn(0x7f54580b1300 msgr2=0x7f545815d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:07.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.450+0000 7f545fc6d640 1 -- 172.21.15.5:0/4068066957 shutdown_connections 2023-07-14T13:06:07.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:07.450+0000 7f545fc6d640 1 -- 172.21.15.5:0/4068066957 wait complete. 2023-07-14T13:06:07.501 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-14T13:06:05.544750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":307848,"kb_used_data":6984,"kb_used_omap":0,"kb_used_meta":300800,"kb_avail":754666872,"statfs":{"total":773094113280,"available":772778876928,"internally_reserved":0,"allocated":7151616,"data_stored":4102306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308019200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.807432"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.748761+0000","last_change":"2023-07-14T13:06:00.748761+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.748761+0000","last_undegraded":"2023-07-14T13:06:00.748761+0000","last_fullsized":"2023-07-14T13:06:00.748761+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.754379+0000","last_change":"2023-07-14T13:06:00.754379+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.754379+0000","last_undegraded":"2023-07-14T13:06:00.754379+0000","last_fullsized":"2023-07-14T13:06:00.754379+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.747815+0000","last_change":"2023-07-14T13:06:00.747815+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.747815+0000","last_undegraded":"2023-07-14T13:06:00.747815+0000","last_fullsized":"2023-07-14T13:06:00.747815+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.753107+0000","last_change":"2023-07-14T13:06:00.753107+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.753107+0000","last_undegraded":"2023-07-14T13:06:00.753107+0000","last_fullsized":"2023-07-14T13:06:00.753107+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751429+0000","last_change":"2023-07-14T13:06:00.751429+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751429+0000","last_undegraded":"2023-07-14T13:06:00.751429+0000","last_fullsized":"2023-07-14T13:06:00.751429+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.744387+0000","last_change":"2023-07-14T13:06:00.744387+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.744387+0000","last_undegraded":"2023-07-14T13:06:00.744387+0000","last_fullsized":"2023-07-14T13:06:00.744387+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.744820+0000","last_change":"2023-07-14T13:06:00.744820+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.744820+0000","last_undegraded":"2023-07-14T13:06:00.744820+0000","last_fullsized":"2023-07-14T13:06:00.744820+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.744099+0000","last_change":"2023-07-14T13:06:00.744099+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.744099+0000","last_undegraded":"2023-07-14T13:06:00.744099+0000","last_fullsized":"2023-07-14T13:06:00.744099+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743374+0000","last_change":"2023-07-14T13:06:00.743374+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743374+0000","last_undegraded":"2023-07-14T13:06:00.743374+0000","last_fullsized":"2023-07-14T13:06:00.743374+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.748675+0000","last_change":"2023-07-14T13:06:00.748675+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.748675+0000","last_undegraded":"2023-07-14T13:06:00.748675+0000","last_fullsized":"2023-07-14T13:06:00.748675+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.744940+0000","last_change":"2023-07-14T13:06:00.744940+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.744940+0000","last_undegraded":"2023-07-14T13:06:00.744940+0000","last_fullsized":"2023-07-14T13:06:00.744940+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743067+0000","last_change":"2023-07-14T13:06:00.743067+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743067+0000","last_undegraded":"2023-07-14T13:06:00.743067+0000","last_fullsized":"2023-07-14T13:06:00.743067+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.752149+0000","last_change":"2023-07-14T13:06:00.752149+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.752149+0000","last_undegraded":"2023-07-14T13:06:00.752149+0000","last_fullsized":"2023-07-14T13:06:00.752149+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.748588+0000","last_change":"2023-07-14T13:06:00.748588+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.748588+0000","last_undegraded":"2023-07-14T13:06:00.748588+0000","last_fullsized":"2023-07-14T13:06:00.748588+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.755332+0000","last_change":"2023-07-14T13:06:00.755332+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.755332+0000","last_undegraded":"2023-07-14T13:06:00.755332+0000","last_fullsized":"2023-07-14T13:06:00.755332+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750787+0000","last_change":"2023-07-14T13:06:00.750787+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750787+0000","last_undegraded":"2023-07-14T13:06:00.750787+0000","last_fullsized":"2023-07-14T13:06:00.750787+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.746739+0000","last_change":"2023-07-14T13:06:00.746739+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.746739+0000","last_undegraded":"2023-07-14T13:06:00.746739+0000","last_fullsized":"2023-07-14T13:06:00.746739+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.749397+0000","last_change":"2023-07-14T13:06:00.749397+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.749397+0000","last_undegraded":"2023-07-14T13:06:00.749397+0000","last_fullsized":"2023-07-14T13:06:00.749397+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.747489+0000","last_change":"2023-07-14T13:06:00.747489+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.747489+0000","last_undegraded":"2023-07-14T13:06:00.747489+0000","last_fullsized":"2023-07-14T13:06:00.747489+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.746486+0000","last_change":"2023-07-14T13:06:00.746486+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.746486+0000","last_undegraded":"2023-07-14T13:06:00.746486+0000","last_fullsized":"2023-07-14T13:06:00.746486+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.745688+0000","last_change":"2023-07-14T13:06:00.745688+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.745688+0000","last_undegraded":"2023-07-14T13:06:00.745688+0000","last_fullsized":"2023-07-14T13:06:00.745688+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743004+0000","last_change":"2023-07-14T13:06:00.743004+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743004+0000","last_undegraded":"2023-07-14T13:06:00.743004+0000","last_fullsized":"2023-07-14T13:06:00.743004+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.745492+0000","last_change":"2023-07-14T13:06:00.745492+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.745492+0000","last_undegraded":"2023-07-14T13:06:00.745492+0000","last_fullsized":"2023-07-14T13:06:00.745492+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.742309+0000","last_change":"2023-07-14T13:06:00.742309+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.742309+0000","last_undegraded":"2023-07-14T13:06:00.742309+0000","last_fullsized":"2023-07-14T13:06:00.742309+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743183+0000","last_change":"2023-07-14T13:06:00.743183+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743183+0000","last_undegraded":"2023-07-14T13:06:00.743183+0000","last_fullsized":"2023-07-14T13:06:00.743183+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.748463+0000","last_change":"2023-07-14T13:06:00.748463+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.748463+0000","last_undegraded":"2023-07-14T13:06:00.748463+0000","last_fullsized":"2023-07-14T13:06:00.748463+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743994+0000","last_change":"2023-07-14T13:06:00.743994+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743994+0000","last_undegraded":"2023-07-14T13:06:00.743994+0000","last_fullsized":"2023-07-14T13:06:00.743994+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.745322+0000","last_change":"2023-07-14T13:06:00.745322+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.745322+0000","last_undegraded":"2023-07-14T13:06:00.745322+0000","last_fullsized":"2023-07-14T13:06:00.745322+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743892+0000","last_change":"2023-07-14T13:06:00.743892+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743892+0000","last_undegraded":"2023-07-14T13:06:00.743892+0000","last_fullsized":"2023-07-14T13:06:00.743892+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750152+0000","last_change":"2023-07-14T13:06:00.750152+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750152+0000","last_undegraded":"2023-07-14T13:06:00.750152+0000","last_fullsized":"2023-07-14T13:06:00.750152+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743608+0000","last_change":"2023-07-14T13:06:00.743608+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743608+0000","last_undegraded":"2023-07-14T13:06:00.743608+0000","last_fullsized":"2023-07-14T13:06:00.743608+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751944+0000","last_change":"2023-07-14T13:06:00.751944+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751944+0000","last_undegraded":"2023-07-14T13:06:00.751944+0000","last_fullsized":"2023-07-14T13:06:00.751944+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.755014+0000","last_change":"2023-07-14T13:06:00.755014+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.755014+0000","last_undegraded":"2023-07-14T13:06:00.755014+0000","last_fullsized":"2023-07-14T13:06:00.755014+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.761559+0000","last_change":"2023-07-14T13:06:00.756132+0000","last_active":"2023-07-14T13:06:00.761559+0000","last_peered":"2023-07-14T13:06:00.761559+0000","last_clean":"2023-07-14T13:06:00.761559+0000","last_became_active":"2023-07-14T13:06:00.755507+0000","last_became_peered":"2023-07-14T13:06:00.755507+0000","last_unstale":"2023-07-14T13:06:00.761559+0000","last_undegraded":"2023-07-14T13:06:00.761559+0000","last_fullsized":"2023-07-14T13:06:00.761559+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:44:35.427825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750889+0000","last_change":"2023-07-14T13:06:00.750889+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750889+0000","last_undegraded":"2023-07-14T13:06:00.750889+0000","last_fullsized":"2023-07-14T13:06:00.750889+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765663+0000","last_change":"2023-07-14T13:06:00.761498+0000","last_active":"2023-07-14T13:06:00.765663+0000","last_peered":"2023-07-14T13:06:00.765663+0000","last_clean":"2023-07-14T13:06:00.765663+0000","last_became_active":"2023-07-14T13:06:00.761218+0000","last_became_peered":"2023-07-14T13:06:00.761218+0000","last_unstale":"2023-07-14T13:06:00.765663+0000","last_undegraded":"2023-07-14T13:06:00.765663+0000","last_fullsized":"2023-07-14T13:06:00.765663+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:04:43.245058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.745320+0000","last_change":"2023-07-14T13:06:00.745320+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.745320+0000","last_undegraded":"2023-07-14T13:06:00.745320+0000","last_fullsized":"2023-07-14T13:06:00.745320+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.761184+0000","last_change":"2023-07-14T13:06:00.754529+0000","last_active":"2023-07-14T13:06:00.761184+0000","last_peered":"2023-07-14T13:06:00.761184+0000","last_clean":"2023-07-14T13:06:00.761184+0000","last_became_active":"2023-07-14T13:06:00.754227+0000","last_became_peered":"2023-07-14T13:06:00.754227+0000","last_unstale":"2023-07-14T13:06:00.761184+0000","last_undegraded":"2023-07-14T13:06:00.761184+0000","last_fullsized":"2023-07-14T13:06:00.761184+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:28.800346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.746995+0000","last_change":"2023-07-14T13:06:00.746995+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.746995+0000","last_undegraded":"2023-07-14T13:06:00.746995+0000","last_fullsized":"2023-07-14T13:06:00.746995+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765149+0000","last_change":"2023-07-14T13:06:00.763143+0000","last_active":"2023-07-14T13:06:00.765149+0000","last_peered":"2023-07-14T13:06:00.765149+0000","last_clean":"2023-07-14T13:06:00.765149+0000","last_became_active":"2023-07-14T13:06:00.762841+0000","last_became_peered":"2023-07-14T13:06:00.762841+0000","last_unstale":"2023-07-14T13:06:00.765149+0000","last_undegraded":"2023-07-14T13:06:00.765149+0000","last_fullsized":"2023-07-14T13:06:00.765149+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:05:53.281408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750581+0000","last_change":"2023-07-14T13:06:00.750581+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750581+0000","last_undegraded":"2023-07-14T13:06:00.750581+0000","last_fullsized":"2023-07-14T13:06:00.750581+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.761705+0000","last_change":"2023-07-14T13:06:00.756771+0000","last_active":"2023-07-14T13:06:00.761705+0000","last_peered":"2023-07-14T13:06:00.761705+0000","last_clean":"2023-07-14T13:06:00.761705+0000","last_became_active":"2023-07-14T13:06:00.756496+0000","last_became_peered":"2023-07-14T13:06:00.756496+0000","last_unstale":"2023-07-14T13:06:00.761705+0000","last_undegraded":"2023-07-14T13:06:00.761705+0000","last_fullsized":"2023-07-14T13:06:00.761705+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:12:25.869710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.749693+0000","last_change":"2023-07-14T13:06:00.749693+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.749693+0000","last_undegraded":"2023-07-14T13:06:00.749693+0000","last_fullsized":"2023-07-14T13:06:00.749693+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.757339+0000","last_change":"2023-07-14T13:06:00.756414+0000","last_active":"2023-07-14T13:06:00.757339+0000","last_peered":"2023-07-14T13:06:00.757339+0000","last_clean":"2023-07-14T13:06:00.757339+0000","last_became_active":"2023-07-14T13:06:00.755350+0000","last_became_peered":"2023-07-14T13:06:00.755350+0000","last_unstale":"2023-07-14T13:06:00.757339+0000","last_undegraded":"2023-07-14T13:06:00.757339+0000","last_fullsized":"2023-07-14T13:06:00.757339+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:04:43.245058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.741690+0000","last_change":"2023-07-14T13:06:00.741690+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.741690+0000","last_undegraded":"2023-07-14T13:06:00.741690+0000","last_fullsized":"2023-07-14T13:06:00.741690+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.768245+0000","last_change":"2023-07-14T13:06:00.764991+0000","last_active":"2023-07-14T13:06:00.768245+0000","last_peered":"2023-07-14T13:06:00.768245+0000","last_clean":"2023-07-14T13:06:00.768245+0000","last_became_active":"2023-07-14T13:06:00.764498+0000","last_became_peered":"2023-07-14T13:06:00.764498+0000","last_unstale":"2023-07-14T13:06:00.768245+0000","last_undegraded":"2023-07-14T13:06:00.768245+0000","last_fullsized":"2023-07-14T13:06:00.768245+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:24:37.042404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.753601+0000","last_change":"2023-07-14T13:06:00.753601+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.753601+0000","last_undegraded":"2023-07-14T13:06:00.753601+0000","last_fullsized":"2023-07-14T13:06:00.753601+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.756207+0000","last_change":"2023-07-14T13:06:00.752505+0000","last_active":"2023-07-14T13:06:00.756207+0000","last_peered":"2023-07-14T13:06:00.756207+0000","last_clean":"2023-07-14T13:06:00.756207+0000","last_became_active":"2023-07-14T13:06:00.752152+0000","last_became_peered":"2023-07-14T13:06:00.752152+0000","last_unstale":"2023-07-14T13:06:00.756207+0000","last_undegraded":"2023-07-14T13:06:00.756207+0000","last_fullsized":"2023-07-14T13:06:00.756207+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:01:19.219338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.749729+0000","last_change":"2023-07-14T13:06:00.749729+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.749729+0000","last_undegraded":"2023-07-14T13:06:00.749729+0000","last_fullsized":"2023-07-14T13:06:00.749729+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767626+0000","last_change":"2023-07-14T13:06:00.763540+0000","last_active":"2023-07-14T13:06:00.767626+0000","last_peered":"2023-07-14T13:06:00.767626+0000","last_clean":"2023-07-14T13:06:00.767626+0000","last_became_active":"2023-07-14T13:06:00.763248+0000","last_became_peered":"2023-07-14T13:06:00.763248+0000","last_unstale":"2023-07-14T13:06:00.767626+0000","last_undegraded":"2023-07-14T13:06:00.767626+0000","last_fullsized":"2023-07-14T13:06:00.767626+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:17:30.938068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751489+0000","last_change":"2023-07-14T13:06:00.751489+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751489+0000","last_undegraded":"2023-07-14T13:06:00.751489+0000","last_fullsized":"2023-07-14T13:06:00.751489+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765550+0000","last_change":"2023-07-14T13:06:00.762491+0000","last_active":"2023-07-14T13:06:00.765550+0000","last_peered":"2023-07-14T13:06:00.765550+0000","last_clean":"2023-07-14T13:06:00.765550+0000","last_became_active":"2023-07-14T13:06:00.762242+0000","last_became_peered":"2023-07-14T13:06:00.762242+0000","last_unstale":"2023-07-14T13:06:00.765550+0000","last_undegraded":"2023-07-14T13:06:00.765550+0000","last_fullsized":"2023-07-14T13:06:00.765550+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:54:08.359442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.742869+0000","last_change":"2023-07-14T13:06:00.742869+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.742869+0000","last_undegraded":"2023-07-14T13:06:00.742869+0000","last_fullsized":"2023-07-14T13:06:00.742869+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.769883+0000","last_change":"2023-07-14T13:06:00.769317+0000","last_active":"2023-07-14T13:06:00.769883+0000","last_peered":"2023-07-14T13:06:00.769883+0000","last_clean":"2023-07-14T13:06:00.769883+0000","last_became_active":"2023-07-14T13:06:00.768989+0000","last_became_peered":"2023-07-14T13:06:00.768989+0000","last_unstale":"2023-07-14T13:06:00.769883+0000","last_undegraded":"2023-07-14T13:06:00.769883+0000","last_fullsized":"2023-07-14T13:06:00.769883+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:04:25.791755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750209+0000","last_change":"2023-07-14T13:06:00.750209+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750209+0000","last_undegraded":"2023-07-14T13:06:00.750209+0000","last_fullsized":"2023-07-14T13:06:00.750209+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767765+0000","last_change":"2023-07-14T13:06:00.758935+0000","last_active":"2023-07-14T13:06:00.767765+0000","last_peered":"2023-07-14T13:06:00.767765+0000","last_clean":"2023-07-14T13:06:00.767765+0000","last_became_active":"2023-07-14T13:06:00.758549+0000","last_became_peered":"2023-07-14T13:06:00.758549+0000","last_unstale":"2023-07-14T13:06:00.767765+0000","last_undegraded":"2023-07-14T13:06:00.767765+0000","last_fullsized":"2023-07-14T13:06:00.767765+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:04:31.512964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751561+0000","last_change":"2023-07-14T13:06:00.751561+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751561+0000","last_undegraded":"2023-07-14T13:06:00.751561+0000","last_fullsized":"2023-07-14T13:06:00.751561+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765931+0000","last_change":"2023-07-14T13:06:00.763008+0000","last_active":"2023-07-14T13:06:00.765931+0000","last_peered":"2023-07-14T13:06:00.765931+0000","last_clean":"2023-07-14T13:06:00.765931+0000","last_became_active":"2023-07-14T13:06:00.762695+0000","last_became_peered":"2023-07-14T13:06:00.762695+0000","last_unstale":"2023-07-14T13:06:00.765931+0000","last_undegraded":"2023-07-14T13:06:00.765931+0000","last_fullsized":"2023-07-14T13:06:00.765931+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:30:32.352281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.744200+0000","last_change":"2023-07-14T13:06:00.744200+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.744200+0000","last_undegraded":"2023-07-14T13:06:00.744200+0000","last_fullsized":"2023-07-14T13:06:00.744200+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767365+0000","last_change":"2023-07-14T13:06:00.761495+0000","last_active":"2023-07-14T13:06:00.767365+0000","last_peered":"2023-07-14T13:06:00.767365+0000","last_clean":"2023-07-14T13:06:00.767365+0000","last_became_active":"2023-07-14T13:06:00.761218+0000","last_became_peered":"2023-07-14T13:06:00.761218+0000","last_unstale":"2023-07-14T13:06:00.767365+0000","last_undegraded":"2023-07-14T13:06:00.767365+0000","last_fullsized":"2023-07-14T13:06:00.767365+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:21:08.411166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.742230+0000","last_change":"2023-07-14T13:06:00.742230+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.742230+0000","last_undegraded":"2023-07-14T13:06:00.742230+0000","last_fullsized":"2023-07-14T13:06:00.742230+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767635+0000","last_change":"2023-07-14T13:06:00.763951+0000","last_active":"2023-07-14T13:06:00.767635+0000","last_peered":"2023-07-14T13:06:00.767635+0000","last_clean":"2023-07-14T13:06:00.767635+0000","last_became_active":"2023-07-14T13:06:00.763697+0000","last_became_peered":"2023-07-14T13:06:00.763697+0000","last_unstale":"2023-07-14T13:06:00.767635+0000","last_undegraded":"2023-07-14T13:06:00.767635+0000","last_fullsized":"2023-07-14T13:06:00.767635+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:18:44.339283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.747222+0000","last_change":"2023-07-14T13:06:00.747222+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.747222+0000","last_undegraded":"2023-07-14T13:06:00.747222+0000","last_fullsized":"2023-07-14T13:06:00.747222+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767712+0000","last_change":"2023-07-14T13:06:00.759768+0000","last_active":"2023-07-14T13:06:00.767712+0000","last_peered":"2023-07-14T13:06:00.767712+0000","last_clean":"2023-07-14T13:06:00.767712+0000","last_became_active":"2023-07-14T13:06:00.758411+0000","last_became_peered":"2023-07-14T13:06:00.758411+0000","last_unstale":"2023-07-14T13:06:00.767712+0000","last_undegraded":"2023-07-14T13:06:00.767712+0000","last_fullsized":"2023-07-14T13:06:00.767712+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:52:03.642841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743629+0000","last_change":"2023-07-14T13:06:00.743629+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743629+0000","last_undegraded":"2023-07-14T13:06:00.743629+0000","last_fullsized":"2023-07-14T13:06:00.743629+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.763479+0000","last_change":"2023-07-14T13:06:00.761474+0000","last_active":"2023-07-14T13:06:00.763479+0000","last_peered":"2023-07-14T13:06:00.763479+0000","last_clean":"2023-07-14T13:06:00.763479+0000","last_became_active":"2023-07-14T13:06:00.761216+0000","last_became_peered":"2023-07-14T13:06:00.761216+0000","last_unstale":"2023-07-14T13:06:00.763479+0000","last_undegraded":"2023-07-14T13:06:00.763479+0000","last_fullsized":"2023-07-14T13:06:00.763479+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:56:31.037462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750336+0000","last_change":"2023-07-14T13:06:00.750336+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750336+0000","last_undegraded":"2023-07-14T13:06:00.750336+0000","last_fullsized":"2023-07-14T13:06:00.750336+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.763883+0000","last_change":"2023-07-14T13:06:00.760343+0000","last_active":"2023-07-14T13:06:00.763883+0000","last_peered":"2023-07-14T13:06:00.763883+0000","last_clean":"2023-07-14T13:06:00.763883+0000","last_became_active":"2023-07-14T13:06:00.760062+0000","last_became_peered":"2023-07-14T13:06:00.760062+0000","last_unstale":"2023-07-14T13:06:00.763883+0000","last_undegraded":"2023-07-14T13:06:00.763883+0000","last_fullsized":"2023-07-14T13:06:00.763883+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:43:01.259058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.749674+0000","last_change":"2023-07-14T13:06:00.749674+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.749674+0000","last_undegraded":"2023-07-14T13:06:00.749674+0000","last_fullsized":"2023-07-14T13:06:00.749674+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767418+0000","last_change":"2023-07-14T13:06:00.762635+0000","last_active":"2023-07-14T13:06:00.767418+0000","last_peered":"2023-07-14T13:06:00.767418+0000","last_clean":"2023-07-14T13:06:00.767418+0000","last_became_active":"2023-07-14T13:06:00.762384+0000","last_became_peered":"2023-07-14T13:06:00.762384+0000","last_unstale":"2023-07-14T13:06:00.767418+0000","last_undegraded":"2023-07-14T13:06:00.767418+0000","last_fullsized":"2023-07-14T13:06:00.767418+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:22.137266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751703+0000","last_change":"2023-07-14T13:06:00.751703+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751703+0000","last_undegraded":"2023-07-14T13:06:00.751703+0000","last_fullsized":"2023-07-14T13:06:00.751703+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767466+0000","last_change":"2023-07-14T13:06:00.761859+0000","last_active":"2023-07-14T13:06:00.767466+0000","last_peered":"2023-07-14T13:06:00.767466+0000","last_clean":"2023-07-14T13:06:00.767466+0000","last_became_active":"2023-07-14T13:06:00.761595+0000","last_became_peered":"2023-07-14T13:06:00.761595+0000","last_unstale":"2023-07-14T13:06:00.767466+0000","last_undegraded":"2023-07-14T13:06:00.767466+0000","last_fullsized":"2023-07-14T13:06:00.767466+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:22:48.786505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751015+0000","last_change":"2023-07-14T13:06:00.751015+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751015+0000","last_undegraded":"2023-07-14T13:06:00.751015+0000","last_fullsized":"2023-07-14T13:06:00.751015+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765674+0000","last_change":"2023-07-14T13:06:00.761520+0000","last_active":"2023-07-14T13:06:00.765674+0000","last_peered":"2023-07-14T13:06:00.765674+0000","last_clean":"2023-07-14T13:06:00.765674+0000","last_became_active":"2023-07-14T13:06:00.761245+0000","last_became_peered":"2023-07-14T13:06:00.761245+0000","last_unstale":"2023-07-14T13:06:00.765674+0000","last_undegraded":"2023-07-14T13:06:00.765674+0000","last_fullsized":"2023-07-14T13:06:00.765674+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:54:08.359442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.746672+0000","last_change":"2023-07-14T13:06:00.746672+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.746672+0000","last_undegraded":"2023-07-14T13:06:00.746672+0000","last_fullsized":"2023-07-14T13:06:00.746672+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767614+0000","last_change":"2023-07-14T13:06:00.759041+0000","last_active":"2023-07-14T13:06:00.767614+0000","last_peered":"2023-07-14T13:06:00.767614+0000","last_clean":"2023-07-14T13:06:00.767614+0000","last_became_active":"2023-07-14T13:06:00.758732+0000","last_became_peered":"2023-07-14T13:06:00.758732+0000","last_unstale":"2023-07-14T13:06:00.767614+0000","last_undegraded":"2023-07-14T13:06:00.767614+0000","last_fullsized":"2023-07-14T13:06:00.767614+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:31:07.335972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.747138+0000","last_change":"2023-07-14T13:06:00.747138+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.747138+0000","last_undegraded":"2023-07-14T13:06:00.747138+0000","last_fullsized":"2023-07-14T13:06:00.747138+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765404+0000","last_change":"2023-07-14T13:06:00.762299+0000","last_active":"2023-07-14T13:06:00.765404+0000","last_peered":"2023-07-14T13:06:00.765404+0000","last_clean":"2023-07-14T13:06:00.765404+0000","last_became_active":"2023-07-14T13:06:00.761975+0000","last_became_peered":"2023-07-14T13:06:00.761975+0000","last_unstale":"2023-07-14T13:06:00.765404+0000","last_undegraded":"2023-07-14T13:06:00.765404+0000","last_fullsized":"2023-07-14T13:06:00.765404+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:41:42.646912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.748258+0000","last_change":"2023-07-14T13:06:00.748258+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.748258+0000","last_undegraded":"2023-07-14T13:06:00.748258+0000","last_fullsized":"2023-07-14T13:06:00.748258+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.764023+0000","last_change":"2023-07-14T13:06:00.762395+0000","last_active":"2023-07-14T13:06:00.764023+0000","last_peered":"2023-07-14T13:06:00.764023+0000","last_clean":"2023-07-14T13:06:00.764023+0000","last_became_active":"2023-07-14T13:06:00.762022+0000","last_became_peered":"2023-07-14T13:06:00.762022+0000","last_unstale":"2023-07-14T13:06:00.764023+0000","last_undegraded":"2023-07-14T13:06:00.764023+0000","last_fullsized":"2023-07-14T13:06:00.764023+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:02:08.227992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.745329+0000","last_change":"2023-07-14T13:06:00.745329+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.745329+0000","last_undegraded":"2023-07-14T13:06:00.745329+0000","last_fullsized":"2023-07-14T13:06:00.745329+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765902+0000","last_change":"2023-07-14T13:06:00.762994+0000","last_active":"2023-07-14T13:06:00.765902+0000","last_peered":"2023-07-14T13:06:00.765902+0000","last_clean":"2023-07-14T13:06:00.765902+0000","last_became_active":"2023-07-14T13:06:00.762704+0000","last_became_peered":"2023-07-14T13:06:00.762704+0000","last_unstale":"2023-07-14T13:06:00.765902+0000","last_undegraded":"2023-07-14T13:06:00.765902+0000","last_fullsized":"2023-07-14T13:06:00.765902+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:50:34.298484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"53'139","reported_seq":333,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.759241+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:06:00.759241+0000","last_peered":"2023-07-14T13:06:00.759241+0000","last_clean":"2023-07-14T13:06:00.759241+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:06:00.759241+0000","last_undegraded":"2023-07-14T13:06:00.759241+0000","last_fullsized":"2023-07-14T13:06:00.759241+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:25:19.700060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":99,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.753574+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:06:00.753574+0000","last_peered":"2023-07-14T13:06:00.753574+0000","last_clean":"2023-07-14T13:06:00.753574+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:06:00.753574+0000","last_undegraded":"2023-07-14T13:06:00.753574+0000","last_fullsized":"2023-07-14T13:06:00.753574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:46:51.928482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.743863+0000","last_change":"2023-07-14T13:06:00.743863+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.743863+0000","last_undegraded":"2023-07-14T13:06:00.743863+0000","last_fullsized":"2023-07-14T13:06:00.743863+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.768707+0000","last_change":"2023-07-14T13:06:00.766325+0000","last_active":"2023-07-14T13:06:00.768707+0000","last_peered":"2023-07-14T13:06:00.768707+0000","last_clean":"2023-07-14T13:06:00.768707+0000","last_became_active":"2023-07-14T13:06:00.766116+0000","last_became_peered":"2023-07-14T13:06:00.766116+0000","last_unstale":"2023-07-14T13:06:00.768707+0000","last_undegraded":"2023-07-14T13:06:00.768707+0000","last_fullsized":"2023-07-14T13:06:00.768707+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:47:41.009818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":99,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.759100+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:06:00.759100+0000","last_peered":"2023-07-14T13:06:00.759100+0000","last_clean":"2023-07-14T13:06:00.759100+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:06:00.759100+0000","last_undegraded":"2023-07-14T13:06:00.759100+0000","last_fullsized":"2023-07-14T13:06:00.759100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:06:36.972485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.746502+0000","last_change":"2023-07-14T13:06:00.746502+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.746502+0000","last_undegraded":"2023-07-14T13:06:00.746502+0000","last_fullsized":"2023-07-14T13:06:00.746502+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.756244+0000","last_change":"2023-07-14T13:06:00.752570+0000","last_active":"2023-07-14T13:06:00.756244+0000","last_peered":"2023-07-14T13:06:00.756244+0000","last_clean":"2023-07-14T13:06:00.756244+0000","last_became_active":"2023-07-14T13:06:00.752307+0000","last_became_peered":"2023-07-14T13:06:00.752307+0000","last_unstale":"2023-07-14T13:06:00.756244+0000","last_undegraded":"2023-07-14T13:06:00.756244+0000","last_fullsized":"2023-07-14T13:06:00.756244+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:42:22.518638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.738618+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:06:00.738618+0000","last_peered":"2023-07-14T13:06:00.738618+0000","last_clean":"2023-07-14T13:06:00.738618+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:06:00.738618+0000","last_undegraded":"2023-07-14T13:06:00.738618+0000","last_fullsized":"2023-07-14T13:06:00.738618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:32:53.565488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.751428+0000","last_change":"2023-07-14T13:06:00.751428+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.751428+0000","last_undegraded":"2023-07-14T13:06:00.751428+0000","last_fullsized":"2023-07-14T13:06:00.751428+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.764726+0000","last_change":"2023-07-14T13:06:00.760649+0000","last_active":"2023-07-14T13:06:00.764726+0000","last_peered":"2023-07-14T13:06:00.764726+0000","last_clean":"2023-07-14T13:06:00.764726+0000","last_became_active":"2023-07-14T13:06:00.760376+0000","last_became_peered":"2023-07-14T13:06:00.760376+0000","last_unstale":"2023-07-14T13:06:00.764726+0000","last_undegraded":"2023-07-14T13:06:00.764726+0000","last_fullsized":"2023-07-14T13:06:00.764726+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:12:44.502720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":99,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.753411+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:06:00.753411+0000","last_peered":"2023-07-14T13:06:00.753411+0000","last_clean":"2023-07-14T13:06:00.753411+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:06:00.753411+0000","last_undegraded":"2023-07-14T13:06:00.753411+0000","last_fullsized":"2023-07-14T13:06:00.753411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:59:19.438385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.747627+0000","last_change":"2023-07-14T13:06:00.747627+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.747627+0000","last_undegraded":"2023-07-14T13:06:00.747627+0000","last_fullsized":"2023-07-14T13:06:00.747627+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765589+0000","last_change":"2023-07-14T13:06:00.762610+0000","last_active":"2023-07-14T13:06:00.765589+0000","last_peered":"2023-07-14T13:06:00.765589+0000","last_clean":"2023-07-14T13:06:00.765589+0000","last_became_active":"2023-07-14T13:06:00.762305+0000","last_became_peered":"2023-07-14T13:06:00.762305+0000","last_unstale":"2023-07-14T13:06:00.765589+0000","last_undegraded":"2023-07-14T13:06:00.765589+0000","last_fullsized":"2023-07-14T13:06:00.765589+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:28.800346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":101,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.752612+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:06:00.752612+0000","last_peered":"2023-07-14T13:06:00.752612+0000","last_clean":"2023-07-14T13:06:00.752612+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:06:00.752612+0000","last_undegraded":"2023-07-14T13:06:00.752612+0000","last_fullsized":"2023-07-14T13:06:00.752612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:08.341386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.742916+0000","last_change":"2023-07-14T13:06:00.742916+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.742916+0000","last_undegraded":"2023-07-14T13:06:00.742916+0000","last_fullsized":"2023-07-14T13:06:00.742916+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.769021+0000","last_change":"2023-07-14T13:06:00.768010+0000","last_active":"2023-07-14T13:06:00.769021+0000","last_peered":"2023-07-14T13:06:00.769021+0000","last_clean":"2023-07-14T13:06:00.769021+0000","last_became_active":"2023-07-14T13:06:00.767670+0000","last_became_peered":"2023-07-14T13:06:00.767670+0000","last_unstale":"2023-07-14T13:06:00.769021+0000","last_undegraded":"2023-07-14T13:06:00.769021+0000","last_fullsized":"2023-07-14T13:06:00.769021+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:50:18.541594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":99,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.760517+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:06:00.760517+0000","last_peered":"2023-07-14T13:06:00.760517+0000","last_clean":"2023-07-14T13:06:00.760517+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:06:00.760517+0000","last_undegraded":"2023-07-14T13:06:00.760517+0000","last_fullsized":"2023-07-14T13:06:00.760517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:41:25.696130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.745965+0000","last_change":"2023-07-14T13:06:00.745965+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.745965+0000","last_undegraded":"2023-07-14T13:06:00.745965+0000","last_fullsized":"2023-07-14T13:06:00.745965+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.765184+0000","last_change":"2023-07-14T13:06:00.757176+0000","last_active":"2023-07-14T13:06:00.765184+0000","last_peered":"2023-07-14T13:06:00.765184+0000","last_clean":"2023-07-14T13:06:00.765184+0000","last_became_active":"2023-07-14T13:06:00.756867+0000","last_became_peered":"2023-07-14T13:06:00.756867+0000","last_unstale":"2023-07-14T13:06:00.765184+0000","last_undegraded":"2023-07-14T13:06:00.765184+0000","last_fullsized":"2023-07-14T13:06:00.765184+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:24:48.579990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":101,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.753404+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:06:00.753404+0000","last_peered":"2023-07-14T13:06:00.753404+0000","last_clean":"2023-07-14T13:06:00.753404+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:06:00.753404+0000","last_undegraded":"2023-07-14T13:06:00.753404+0000","last_fullsized":"2023-07-14T13:06:00.753404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:26:51.965367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2023-07-14T13:06:00.750879+0000","last_change":"2023-07-14T13:06:00.750879+0000","last_active":"2023-07-14T13:06:00.732778+0000","last_peered":"2023-07-14T13:06:00.732778+0000","last_clean":"2023-07-14T13:06:00.732778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:06:00.750879+0000","last_undegraded":"2023-07-14T13:06:00.750879+0000","last_fullsized":"2023-07-14T13:06:00.750879+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.767941+0000","last_change":"2023-07-14T13:06:00.764320+0000","last_active":"2023-07-14T13:06:00.767941+0000","last_peered":"2023-07-14T13:06:00.767941+0000","last_clean":"2023-07-14T13:06:00.767941+0000","last_became_active":"2023-07-14T13:06:00.764000+0000","last_became_peered":"2023-07-14T13:06:00.764000+0000","last_unstale":"2023-07-14T13:06:00.767941+0000","last_undegraded":"2023-07-14T13:06:00.767941+0000","last_fullsized":"2023-07-14T13:06:00.767941+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:25.774499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":99,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-07-14T13:06:00.748597+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:06:00.748597+0000","last_peered":"2023-07-14T13:06:00.748597+0000","last_clean":"2023-07-14T13:06:00.748597+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:06:00.748597+0000","last_undegraded":"2023-07-14T13:06:00.748597+0000","last_fullsized":"2023-07-14T13:06:00.748597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:33:03.441107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575011,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54492,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317348,"statfs":{"total":96636764160,"available":96580964352,"internally_reserved":0,"allocated":1331200,"data_stored":950848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.35699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.85499999999999998,"5min":0.98399999999999999,"15min":1.879},"last":0.746},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.745,"15min":0.74099999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.439},"max":{"1min":0.877,"5min":0.95599999999999996,"15min":1.9059999999999999},"last":0.68100000000000005}]},{"osd":1,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.752,"15min":0.72999999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.42999999999999999},"max":{"1min":0.92600000000000005,"5min":1,"15min":1.069},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.76000000000000001,"15min":0.745},"min":{"1min":0.54000000000000004,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93000000000000005,"5min":0.97399999999999998,"15min":1.1020000000000001},"last":0.72399999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.745,"15min":0.72299999999999998},"min":{"1min":0.46999999999999997,"5min":0.42699999999999999,"15min":0.40600000000000003},"max":{"1min":0.877,"5min":1.016,"15min":1.048},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.77500000000000002,"15min":0.755},"min":{"1min":0.50600000000000001,"5min":0.503,"15min":0.46899999999999997},"max":{"1min":0.89200000000000002,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.69999999999999996}]},{"osd":3,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.753,"15min":0.73199999999999998},"min":{"1min":0.50700000000000001,"5min":0.46400000000000002,"15min":0.442},"max":{"1min":0.98199999999999998,"5min":1.0269999999999999,"15min":1.0760000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.78100000000000003,"15min":0.76000000000000001},"min":{"1min":0.51900000000000002,"5min":0.47299999999999998,"15min":0.41499999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.024},"last":0.51900000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.60899999999999999,"15min":0.58999999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.86299999999999999,"5min":1.022,"15min":1.022},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.40999999999999998,"5min":0.40000000000000002,"15min":0.39300000000000002},"max":{"1min":0.68100000000000005,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.66600000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.63300000000000001,"15min":0.622},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94699999999999995,"5min":0.98299999999999998,"15min":1.0249999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.65300000000000002,"15min":0.67300000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.008},"last":0.55700000000000005}]},{"osd":6,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.70399999999999996,"15min":0.71699999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96699999999999997,"5min":1.0489999999999999,"15min":1.4419999999999999},"last":0.62},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.68700000000000006,"15min":0.69199999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91000000000000003,"5min":0.98199999999999998,"15min":1.575},"last":0.54300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575012,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":749568,"data_stored":367108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.51300000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.89200000000000002,"5min":0.996,"15min":1.2749999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73899999999999999,"15min":0.74199999999999999},"min":{"1min":0.53700000000000003,"5min":0.48199999999999998,"15min":0.47399999999999998},"max":{"1min":1.0209999999999999,"5min":1.03,"15min":1.2110000000000001},"last":0.80600000000000005}]},{"osd":1,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.56499999999999995,"5min":0.50800000000000001,"15min":0.379},"max":{"1min":0.94699999999999995,"5min":1.0209999999999999,"15min":1.4299999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.745,"15min":0.72999999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.44},"max":{"1min":0.97099999999999997,"5min":1.077,"15min":1.1379999999999999},"last":0.88200000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.753,"15min":0.752},"min":{"1min":0.56699999999999995,"5min":0.496,"15min":0.40400000000000003},"max":{"1min":0.94099999999999995,"5min":1.105,"15min":1.319},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77300000000000002,"15min":0.75700000000000001},"min":{"1min":0.59199999999999997,"5min":0.54400000000000004,"15min":0.42299999999999999},"max":{"1min":0.94399999999999995,"5min":1.0900000000000001,"15min":1.341},"last":0.67800000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.79100000000000004,"15min":0.78600000000000003},"min":{"1min":0.53200000000000003,"5min":0.52200000000000002,"15min":0.45600000000000002},"max":{"1min":0.92500000000000004,"5min":1.093,"15min":1.3859999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.79300000000000004,"15min":0.76800000000000002},"min":{"1min":0.58199999999999996,"5min":0.53300000000000003,"15min":0.45900000000000002},"max":{"1min":0.99099999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.85699999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.58099999999999996,"15min":0.58999999999999997},"min":{"1min":0.40100000000000002,"5min":0.39300000000000002,"15min":0.32700000000000001},"max":{"1min":0.85899999999999999,"5min":0.871,"15min":0.97899999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63700000000000001,"15min":0.65000000000000002},"min":{"1min":0.442,"5min":0.435,"15min":0.36099999999999999},"max":{"1min":0.81499999999999995,"5min":1.0780000000000001,"15min":1.091},"last":0.61699999999999999}]},{"osd":5,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63700000000000001,"15min":0.65900000000000003},"min":{"1min":0.45800000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91200000000000003,"5min":0.98399999999999999,"15min":1.121},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.67300000000000004,"15min":0.70699999999999996},"min":{"1min":0.47499999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88300000000000001,"5min":0.98699999999999999,"15min":1.145},"last":0.95099999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:04:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65600000000000003,"15min":0.67500000000000004},"min":{"1min":0.44600000000000001,"5min":0.41699999999999998,"15min":0.38},"max":{"1min":0.92200000000000004,"5min":1.1200000000000001,"15min":1.208},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.71199999999999997,"15min":0.72499999999999998},"min":{"1min":0.53200000000000003,"5min":0.52700000000000002,"15min":0.442},"max":{"1min":0.85799999999999998,"5min":1.0489999999999999,"15min":1.194},"last":0.70299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575011,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":749568,"data_stored":367108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.73699999999999999,"15min":0.73399999999999999},"min":{"1min":0.45300000000000001,"5min":0.36499999999999999,"15min":0.32400000000000001},"max":{"1min":2.6699999999999999,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.72699999999999998,"15min":0.74099999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.94199999999999995,"5min":0.996,"15min":1.0069999999999999},"last":0.81799999999999995}]},{"osd":1,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.72699999999999998,"15min":0.73199999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.41099999999999998},"max":{"1min":0.85899999999999999,"5min":1.079,"15min":1.335},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75800000000000001,"15min":0.75600000000000001},"min":{"1min":0.505,"5min":0.40400000000000003,"15min":0.36799999999999999},"max":{"1min":2.706,"5min":2.706,"15min":2.706},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73499999999999999,"15min":0.748},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91800000000000004,"5min":1.0940000000000001,"15min":1.298},"last":0.879},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.73299999999999998,"15min":0.74199999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.90200000000000002,"5min":1.044,"15min":1.044},"last":0.68600000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.75600000000000001,"15min":0.745},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.76100000000000001,"15min":0.77600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88900000000000001,"5min":1.149,"15min":1.149},"last":0.77200000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.63200000000000001,"15min":0.64000000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.85199999999999998,"5min":0.94199999999999995,"15min":1.073},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.71599999999999997},"min":{"1min":0.40600000000000003,"5min":0.40200000000000002,"15min":0.35899999999999999},"max":{"1min":2.7719999999999998,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.53600000000000003}]},{"osd":6,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.621,"15min":0.64100000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.89800000000000002,"5min":0.95399999999999996,"15min":0.97999999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.63900000000000001,"15min":0.66200000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.042},"last":0.58799999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":3.0230000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67900000000000005,"15min":0.70899999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.95999999999999996,"5min":1.407,"15min":1.407},"last":0.46800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575011,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":749568,"data_stored":367108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76900000000000002,"15min":0.72999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.42299999999999999},"max":{"1min":1.0129999999999999,"5min":1.411,"15min":1.411},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.749,"15min":0.71299999999999997},"min":{"1min":0.54100000000000004,"5min":0.435,"15min":0.435},"max":{"1min":0.96799999999999997,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":1.0640000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77500000000000002,"15min":0.73599999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.442},"max":{"1min":0.90200000000000002,"5min":1.077,"15min":1.077},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76200000000000001,"15min":0.73899999999999999},"min":{"1min":0.55200000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93300000000000005,"5min":1.0469999999999999,"15min":1.2370000000000001},"last":0.94999999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.75800000000000001,"15min":0.72399999999999998},"min":{"1min":0.60499999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.95899999999999996,"5min":1.091,"15min":1.091},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.80400000000000005,"15min":0.76300000000000001},"min":{"1min":0.59099999999999997,"5min":0.499,"15min":0.443},"max":{"1min":0.99199999999999999,"5min":1.387,"15min":1.387},"last":0.77700000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.77100000000000002,"15min":0.74199999999999999},"min":{"1min":0.63600000000000001,"5min":0.52600000000000002,"15min":0.497},"max":{"1min":0.99399999999999999,"5min":1.008,"15min":1.099},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78900000000000003,"15min":0.76200000000000001},"min":{"1min":0.54100000000000004,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.97099999999999997,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.82199999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61699999999999999,"15min":0.61299999999999999},"min":{"1min":0.48799999999999999,"5min":0.441,"15min":0.38900000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":1.0029999999999999},"last":0.621},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61099999999999999,"15min":0.624},"min":{"1min":0.43099999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88600000000000001,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.751}]},{"osd":6,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.62,"15min":0.63300000000000001},"min":{"1min":0.495,"5min":0.41599999999999998,"15min":0.32300000000000001},"max":{"1min":0.91700000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":1.014},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.68100000000000005},"min":{"1min":0.45400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.98999999999999999},"last":0.84499999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:05:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66500000000000004,"15min":0.67800000000000005},"min":{"1min":0.54100000000000004,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.94699999999999995,"5min":0.98099999999999998,"15min":1.0349999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69199999999999995,"15min":0.71599999999999997},"min":{"1min":0.56499999999999995,"5min":0.41599999999999998,"15min":0.36899999999999999},"max":{"1min":0.91800000000000004,"5min":1.026,"15min":1.1080000000000001},"last":0.97699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575011,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35876,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335964,"statfs":{"total":96636764160,"available":96600027136,"internally_reserved":0,"allocated":749568,"data_stored":367108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45400000000000001,"15min":0.44400000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.748,"5min":0.755,"15min":0.84199999999999997},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.503,"15min":0.52000000000000002},"min":{"1min":0.378,"5min":0.33300000000000002,"15min":0.309},"max":{"1min":0.65500000000000003,"5min":0.78700000000000003,"15min":1.577},"last":0.40100000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47199999999999998,"15min":0.47599999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.29199999999999998},"max":{"1min":0.65400000000000003,"5min":0.71699999999999997,"15min":0.88200000000000001},"last":0.315},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.32600000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.113},"last":0.376}]},{"osd":2,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.56499999999999995,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.38700000000000001},"max":{"1min":0.63900000000000001,"5min":0.88400000000000001,"15min":1.0820000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.624,"15min":0.59899999999999998},"min":{"1min":0.46400000000000002,"5min":0.441,"15min":0.40100000000000002},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.47499999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.51100000000000001,"5min":0.441,"15min":0.439},"max":{"1min":0.88200000000000001,"5min":1.284,"15min":1.627},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.77400000000000002,"15min":0.78400000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.47699999999999998},"max":{"1min":0.81899999999999995,"5min":1.135,"15min":1.214},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.78500000000000003,"15min":0.79000000000000004},"min":{"1min":0.58499999999999996,"5min":0.57999999999999996,"15min":0.52400000000000002},"max":{"1min":0.86399999999999999,"5min":1.306,"15min":1.333},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.78300000000000003,"15min":0.78600000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.96099999999999997,"5min":1.129,"15min":1.2470000000000001},"last":0.64200000000000002}]},{"osd":6,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.76800000000000002,"15min":0.78600000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.873,"5min":1.117,"15min":1.526},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.505},"max":{"1min":0.93200000000000005,"5min":1.2589999999999999,"15min":1.381},"last":0.54200000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.85099999999999998,"15min":0.84299999999999997},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.53100000000000003},"max":{"1min":2.4910000000000001,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.83099999999999996,"15min":0.83999999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.595,"5min":1.595,"15min":1.6910000000000001},"last":0.77100000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575011,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53908,"kb_used_data":716,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317932,"statfs":{"total":96636764160,"available":96581562368,"internally_reserved":0,"allocated":733184,"data_stored":359461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46700000000000003,"15min":0.46800000000000003},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.28999999999999998},"max":{"1min":2.5270000000000001,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.499}]},{"osd":1,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.47799999999999998,"15min":0.47499999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27500000000000002},"max":{"1min":2.7200000000000002,"5min":2.7200000000000002,"15min":2.7200000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.33000000000000002},"max":{"1min":2.6110000000000002,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":0.56100000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.66600000000000004,"15min":0.60199999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.38},"max":{"1min":8.2530000000000001,"5min":8.2530000000000001,"15min":8.2530000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89600000000000002,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.53400000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.3049999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81499999999999995,"15min":0.80900000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.81899999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.88200000000000001,"15min":0.874},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":3.1139999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.85599999999999998,"15min":0.84599999999999997},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.433},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.94999999999999996}]},{"osd":6,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.82099999999999995,"15min":0.80200000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.47599999999999998},"max":{"1min":3.9849999999999999,"5min":3.9849999999999999,"15min":3.9849999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.83999999999999997,"15min":0.81899999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":3.391,"5min":3.391,"15min":3.391},"last":0.96999999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.83799999999999997,"15min":0.83699999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.5779999999999998,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.84599999999999997,"15min":0.82599999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.50900000000000001},"max":{"1min":2.5939999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.89400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575012,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35876,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335964,"statfs":{"total":96636764160,"available":96600027136,"internally_reserved":0,"allocated":749568,"data_stored":367108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.432,"15min":0.42599999999999999},"min":{"1min":0.26300000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58699999999999997,"5min":0.69099999999999995,"15min":0.77200000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.51500000000000001,"15min":0.49299999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.26500000000000001},"max":{"1min":0.64700000000000002,"5min":0.751,"15min":0.82299999999999995},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.48899999999999999,"15min":0.46899999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.29499999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52600000000000002,"15min":0.51000000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.29299999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.495}]},{"osd":3,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64700000000000002,"15min":0.626},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.432},"max":{"1min":0.79200000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58299999999999996,"15min":0.57599999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.38100000000000001},"max":{"1min":0.749,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.80100000000000005,"15min":0.77200000000000002},"min":{"1min":0.51600000000000001,"5min":0.51300000000000001,"15min":0.40000000000000002},"max":{"1min":0.999,"5min":1.054,"15min":1.236},"last":0.874},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.79000000000000004,"15min":0.77800000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.45700000000000002},"max":{"1min":0.92200000000000004,"5min":1.1040000000000001,"15min":1.1180000000000001},"last":0.74199999999999999}]},{"osd":5,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.79700000000000004,"15min":0.77500000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":0.99099999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.80800000000000005,"15min":0.79200000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48199999999999998},"max":{"1min":0.88,"5min":1.2509999999999999,"15min":1.3600000000000001},"last":0.73299999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.81000000000000005,"15min":0.79100000000000004},"min":{"1min":0.503,"5min":0.503,"15min":0.48499999999999999},"max":{"1min":0.89600000000000002,"5min":1.0649999999999999,"15min":1.274},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.82699999999999996,"15min":0.81200000000000006},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.49199999999999999},"max":{"1min":0.96999999999999997,"5min":1.1599999999999999,"15min":1.2969999999999999},"last":0.70799999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.80200000000000005,"15min":0.78600000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.47799999999999998},"max":{"1min":0.93799999999999994,"5min":1.123,"15min":1.3400000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.85899999999999999,"15min":0.83599999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.52800000000000002},"max":{"1min":0.95699999999999996,"5min":1.1890000000000001,"15min":1.2929999999999999},"last":0.81699999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575013,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36452,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335388,"statfs":{"total":96636764160,"available":96599437312,"internally_reserved":0,"allocated":1339392,"data_stored":956457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.48299999999999998,"15min":0.45900000000000002},"min":{"1min":0.28899999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.50800000000000001,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.69699999999999995,"5min":0.77900000000000003,"15min":1.452},"last":0.35399999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.34100000000000003},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80300000000000005,"5min":0.90300000000000002,"15min":1.5700000000000001},"last":0.41999999999999998}]},{"osd":3,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.502,"15min":0.51100000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.66000000000000003,"5min":0.70599999999999996,"15min":0.99299999999999999},"last":0.502},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.60599999999999998,"15min":0.59699999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":2.4100000000000001,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.80300000000000005,"15min":0.78400000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.44400000000000001},"max":{"1min":1.2150000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.628},{"interface":"front","average":{"1min":0.873,"5min":0.82499999999999996,"15min":0.81599999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.755}]},{"osd":5,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.82299999999999995,"15min":0.80500000000000005},"min":{"1min":0.51800000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2549999999999999,"5min":1.3839999999999999,"15min":1.4950000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.81399999999999995,"15min":0.80400000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.47299999999999998},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.82599999999999996,"15min":0.81799999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.82799999999999996,"15min":0.82199999999999995},"min":{"1min":0.55500000000000005,"5min":0.50600000000000001,"15min":0.41299999999999998},"max":{"1min":1.141,"5min":1.3440000000000001,"15min":1.5369999999999999},"last":0.73899999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.84999999999999998,"15min":0.83999999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.45500000000000002},"max":{"1min":1.04,"5min":1.2749999999999999,"15min":1.603},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82999999999999996,"15min":0.82399999999999995},"min":{"1min":0.57099999999999995,"5min":0.52800000000000002,"15min":0.497},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.69499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:06:10.508 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:06:10.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.634+0000 7f2587696640 1 Processor -- start 2023-07-14T13:06:10.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.634+0000 7f2587696640 1 -- start start 2023-07-14T13:06:10.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.634+0000 7f2587696640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f25800d06b0 0x7f25800b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:10.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.634+0000 7f2587696640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25800b2410 con 0x7f2580145430 2023-07-14T13:06:10.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.634+0000 7f2587696640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25800b26f0 con 0x7f25800b1f70 2023-07-14T13:06:10.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.634+0000 7f2587696640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25800b29d0 con 0x7f25800d06b0 2023-07-14T13:06:10.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.634+0000 7f2584c31640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2580145430 0x7f25800b34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47592/0 (socket says 172.21.15.5:47592) 2023-07-14T13:06:10.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.634+0000 7f2584c31640 1 -- 172.21.15.5:0/2107303161 learned_addr learned my addr 172.21.15.5:0/2107303161 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:06:10.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.634+0000 7f2585432640 1 --2- 172.21.15.5:0/2107303161 >> v2:172.21.15.154:3300/0 conn(0x7f25800d06b0 0x7f25800b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:10.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.634+0000 7f2577fff640 1 -- 172.21.15.5:0/2107303161 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999366146 0 0) 0x7f25800b2410 con 0x7f2580145430 2023-07-14T13:06:10.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.634+0000 7f2577fff640 1 -- 172.21.15.5:0/2107303161 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f256c003530 con 0x7f2580145430 2023-07-14T13:06:10.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.634+0000 7f2585432640 1 -- 172.21.15.5:0/2107303161 >> v1:172.21.15.154:6789/0 conn(0x7f25800b1f70 legacy=0x7f25800d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:10.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.634+0000 7f2585432640 1 -- 172.21.15.5:0/2107303161 >> v1:172.21.15.5:6789/0 conn(0x7f2580145430 legacy=0x7f25800b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:10.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.634+0000 7f2585432640 1 -- 172.21.15.5:0/2107303161 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25800b2cb0 con 0x7f25800d06b0 2023-07-14T13:06:10.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.638+0000 7f2585432640 1 --2- 172.21.15.5:0/2107303161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25800d06b0 0x7f25800b1a30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f257c0097c0 tx=0x7f257c01ceb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c4c257a05319820 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:10.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.638+0000 7f2577fff640 1 -- 172.21.15.5:0/2107303161 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c0ab670 con 0x7f25800d06b0 2023-07-14T13:06:10.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.638+0000 7f2577fff640 1 -- 172.21.15.5:0/2107303161 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257c0ab7d0 con 0x7f25800d06b0 2023-07-14T13:06:10.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.638+0000 7f2577fff640 1 -- 172.21.15.5:0/2107303161 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c0abb60 con 0x7f25800d06b0 2023-07-14T13:06:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.638+0000 7f2587696640 1 -- 172.21.15.5:0/2107303161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25800d06b0 msgr2=0x7f25800b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.638+0000 7f2587696640 1 --2- 172.21.15.5:0/2107303161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25800d06b0 0x7f25800b1a30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f257c0097c0 tx=0x7f257c01ceb0 comp rx=0 tx=0).stop 2023-07-14T13:06:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.638+0000 7f2587696640 1 -- 172.21.15.5:0/2107303161 shutdown_connections 2023-07-14T13:06:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.638+0000 7f2587696640 1 --2- 172.21.15.5:0/2107303161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25800d06b0 0x7f25800b1a30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.638+0000 7f2587696640 1 -- 172.21.15.5:0/2107303161 >> 172.21.15.5:0/2107303161 conn(0x7f25800659d0 msgr2=0x7f258009b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.638+0000 7f2587696640 1 -- 172.21.15.5:0/2107303161 shutdown_connections 2023-07-14T13:06:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.638+0000 7f2587696640 1 -- 172.21.15.5:0/2107303161 wait complete. 2023-07-14T13:06:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.642+0000 7f2587696640 1 Processor -- start 2023-07-14T13:06:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.642+0000 7f2587696640 1 -- start start 2023-07-14T13:06:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.642+0000 7f2587696640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25800b1f70 0x7f258015e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.642+0000 7f2587696640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25800d06b0 0x7f25800b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.642+0000 7f2587696640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f258015bd20 0x7f25800cf050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:10.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.642+0000 7f2587696640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2580153a80 con 0x7f25800d06b0 2023-07-14T13:06:10.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.642+0000 7f2587696640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25800b6570 con 0x7f258015bd20 2023-07-14T13:06:10.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.642+0000 7f2587696640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25800b56c0 con 0x7f25800b1f70 2023-07-14T13:06:10.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.642+0000 7f2584c31640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25800d06b0 0x7f25800b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:10.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.642+0000 7f2584c31640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25800d06b0 0x7f25800b5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52204/0 (socket says 172.21.15.5:52204) 2023-07-14T13:06:10.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.642+0000 7f2584c31640 1 -- 172.21.15.5:0/3475398282 learned_addr learned my addr 172.21.15.5:0/3475398282 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:10.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.642+0000 7f2585432640 1 --2- 172.21.15.5:0/3475398282 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25800b1f70 0x7f258015e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:10.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.642+0000 7f2585c33640 1 --2- 172.21.15.5:0/3475398282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f258015bd20 0x7f25800cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:10.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.642+0000 7f2584c31640 1 -- 172.21.15.5:0/3475398282 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25800b1f70 msgr2=0x7f258015e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:10.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.642+0000 7f2584c31640 1 --2- 172.21.15.5:0/3475398282 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25800b1f70 0x7f258015e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:10.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.642+0000 7f2584c31640 1 -- 172.21.15.5:0/3475398282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f258015bd20 msgr2=0x7f25800cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:10.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.642+0000 7f2584c31640 1 --2- 172.21.15.5:0/3475398282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f258015bd20 0x7f25800cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:10.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.642+0000 7f2584c31640 1 -- 172.21.15.5:0/3475398282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257c009420 con 0x7f25800d06b0 2023-07-14T13:06:10.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.642+0000 7f2585c33640 1 --2- 172.21.15.5:0/3475398282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f258015bd20 0x7f25800cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:06:10.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.642+0000 7f2584c31640 1 --2- 172.21.15.5:0/3475398282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25800d06b0 0x7f25800b5180 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f257000c4d0 tx=0x7f257000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:10.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.642+0000 7f2575ffb640 1 -- 172.21.15.5:0/3475398282 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2570005cf0 con 0x7f25800d06b0 2023-07-14T13:06:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.642+0000 7f2575ffb640 1 -- 172.21.15.5:0/3475398282 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2570005e50 con 0x7f25800d06b0 2023-07-14T13:06:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.642+0000 7f2575ffb640 1 -- 172.21.15.5:0/3475398282 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2570007270 con 0x7f25800d06b0 2023-07-14T13:06:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.642+0000 7f2587696640 1 -- 172.21.15.5:0/3475398282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25800b5960 con 0x7f25800d06b0 2023-07-14T13:06:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.642+0000 7f2587696640 1 -- 172.21.15.5:0/3475398282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25800b5f20 con 0x7f25800d06b0 2023-07-14T13:06:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.646+0000 7f2587696640 1 -- 172.21.15.5:0/3475398282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25800b6700 con 0x7f25800d06b0 2023-07-14T13:06:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.646+0000 7f2575ffb640 1 -- 172.21.15.5:0/3475398282 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f25700073d0 con 0x7f25800d06b0 2023-07-14T13:06:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.646+0000 7f2575ffb640 1 --2- 172.21.15.5:0/3475398282 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f25640663a0 0x7f2564068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.646+0000 7f2575ffb640 1 -- 172.21.15.5:0/3475398282 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2570083360 con 0x7f25800d06b0 2023-07-14T13:06:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.646+0000 7f2585432640 1 --2- 172.21.15.5:0/3475398282 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f25640663a0 0x7f2564068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:10.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.646+0000 7f2585432640 1 --2- 172.21.15.5:0/3475398282 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f25640663a0 0x7f2564068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f257c0af000 tx=0x7f257c004740 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:10.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.650+0000 7f2575ffb640 1 -- 172.21.15.5:0/3475398282 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2570050770 con 0x7f25800d06b0 2023-07-14T13:06:10.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.802+0000 7f2587696640 1 -- 172.21.15.5:0/3475398282 --> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25800d0a80 con 0x7f25640663a0 2023-07-14T13:06:10.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.810+0000 7f2575ffb640 1 -- 172.21.15.5:0/3475398282 <== mgr.5695 v2:172.21.15.154:6832/1810553301 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310735 (secure 0 0 0) 0x7f257c0ab940 con 0x7f25640663a0 2023-07-14T13:06:10.845 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:06:10.846 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:06:10.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.814+0000 7f2587696640 1 -- 172.21.15.5:0/3475398282 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f25640663a0 msgr2=0x7f2564068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:10.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.814+0000 7f2587696640 1 --2- 172.21.15.5:0/3475398282 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f25640663a0 0x7f2564068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f257c0af000 tx=0x7f257c004740 comp rx=0 tx=0).stop 2023-07-14T13:06:10.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.814+0000 7f2587696640 1 -- 172.21.15.5:0/3475398282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25800d06b0 msgr2=0x7f25800b5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:10.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.814+0000 7f2587696640 1 --2- 172.21.15.5:0/3475398282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25800d06b0 0x7f25800b5180 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f257000c4d0 tx=0x7f257000c990 comp rx=0 tx=0).stop 2023-07-14T13:06:10.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.814+0000 7f2587696640 1 -- 172.21.15.5:0/3475398282 shutdown_connections 2023-07-14T13:06:10.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.814+0000 7f2587696640 1 --2- 172.21.15.5:0/3475398282 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f25640663a0 0x7f2564068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:10.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.814+0000 7f2587696640 1 --2- 172.21.15.5:0/3475398282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f258015bd20 0x7f25800cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:10.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.814+0000 7f2587696640 1 --2- 172.21.15.5:0/3475398282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25800d06b0 0x7f25800b5180 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:10.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.814+0000 7f2587696640 1 --2- 172.21.15.5:0/3475398282 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25800b1f70 0x7f258015e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:10.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.814+0000 7f2587696640 1 -- 172.21.15.5:0/3475398282 >> 172.21.15.5:0/3475398282 conn(0x7f25800659d0 msgr2=0x7f258015cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:10.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.814+0000 7f2587696640 1 -- 172.21.15.5:0/3475398282 shutdown_connections 2023-07-14T13:06:10.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:10.814+0000 7f2587696640 1 -- 172.21.15.5:0/3475398282 wait complete. 2023-07-14T13:06:10.865 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-14T13:06:09.546081+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":244,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":178,"ondisk_log_size":178,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":202,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":308128,"kb_used_data":7264,"kb_used_omap":0,"kb_used_meta":300800,"kb_avail":754666592,"statfs":{"total":773094113280,"available":772778590208,"internally_reserved":0,"allocated":7438336,"data_stored":4230534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308019200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002534"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.172528+0000","last_change":"2023-07-14T13:06:01.785985+0000","last_active":"2023-07-14T13:06:03.172528+0000","last_peered":"2023-07-14T13:06:03.172528+0000","last_clean":"2023-07-14T13:06:03.172528+0000","last_became_active":"2023-07-14T13:06:01.785708+0000","last_became_peered":"2023-07-14T13:06:01.785708+0000","last_unstale":"2023-07-14T13:06:03.172528+0000","last_undegraded":"2023-07-14T13:06:03.172528+0000","last_fullsized":"2023-07-14T13:06:03.172528+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:52:14.318840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.176197+0000","last_change":"2023-07-14T13:06:01.784430+0000","last_active":"2023-07-14T13:06:03.176197+0000","last_peered":"2023-07-14T13:06:03.176197+0000","last_clean":"2023-07-14T13:06:03.176197+0000","last_became_active":"2023-07-14T13:06:01.784144+0000","last_became_peered":"2023-07-14T13:06:01.784144+0000","last_unstale":"2023-07-14T13:06:03.176197+0000","last_undegraded":"2023-07-14T13:06:03.176197+0000","last_fullsized":"2023-07-14T13:06:03.176197+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:59:30.627856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.758853+0000","last_change":"2023-07-14T13:06:01.793080+0000","last_active":"2023-07-14T13:06:02.758853+0000","last_peered":"2023-07-14T13:06:02.758853+0000","last_clean":"2023-07-14T13:06:02.758853+0000","last_became_active":"2023-07-14T13:06:01.792733+0000","last_became_peered":"2023-07-14T13:06:01.792733+0000","last_unstale":"2023-07-14T13:06:02.758853+0000","last_undegraded":"2023-07-14T13:06:02.758853+0000","last_fullsized":"2023-07-14T13:06:02.758853+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:45:43.665772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.175926+0000","last_change":"2023-07-14T13:06:01.793013+0000","last_active":"2023-07-14T13:06:03.175926+0000","last_peered":"2023-07-14T13:06:03.175926+0000","last_clean":"2023-07-14T13:06:03.175926+0000","last_became_active":"2023-07-14T13:06:01.792705+0000","last_became_peered":"2023-07-14T13:06:01.792705+0000","last_unstale":"2023-07-14T13:06:03.175926+0000","last_undegraded":"2023-07-14T13:06:03.175926+0000","last_fullsized":"2023-07-14T13:06:03.175926+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:45:33.668904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.762995+0000","last_change":"2023-07-14T13:06:01.775117+0000","last_active":"2023-07-14T13:06:02.762995+0000","last_peered":"2023-07-14T13:06:02.762995+0000","last_clean":"2023-07-14T13:06:02.762995+0000","last_became_active":"2023-07-14T13:06:01.774817+0000","last_became_peered":"2023-07-14T13:06:01.774817+0000","last_unstale":"2023-07-14T13:06:02.762995+0000","last_undegraded":"2023-07-14T13:06:02.762995+0000","last_fullsized":"2023-07-14T13:06:02.762995+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:34:22.119314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.172498+0000","last_change":"2023-07-14T13:06:01.779750+0000","last_active":"2023-07-14T13:06:03.172498+0000","last_peered":"2023-07-14T13:06:03.172498+0000","last_clean":"2023-07-14T13:06:03.172498+0000","last_became_active":"2023-07-14T13:06:01.771936+0000","last_became_peered":"2023-07-14T13:06:01.771936+0000","last_unstale":"2023-07-14T13:06:03.172498+0000","last_undegraded":"2023-07-14T13:06:03.172498+0000","last_fullsized":"2023-07-14T13:06:03.172498+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:55:33.291974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.758267+0000","last_change":"2023-07-14T13:06:01.776854+0000","last_active":"2023-07-14T13:06:02.758267+0000","last_peered":"2023-07-14T13:06:02.758267+0000","last_clean":"2023-07-14T13:06:02.758267+0000","last_became_active":"2023-07-14T13:06:01.776428+0000","last_became_peered":"2023-07-14T13:06:01.776428+0000","last_unstale":"2023-07-14T13:06:02.758267+0000","last_undegraded":"2023-07-14T13:06:02.758267+0000","last_fullsized":"2023-07-14T13:06:02.758267+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:34:46.280329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.172919+0000","last_change":"2023-07-14T13:06:01.779177+0000","last_active":"2023-07-14T13:06:03.172919+0000","last_peered":"2023-07-14T13:06:03.172919+0000","last_clean":"2023-07-14T13:06:03.172919+0000","last_became_active":"2023-07-14T13:06:01.778557+0000","last_became_peered":"2023-07-14T13:06:01.778557+0000","last_unstale":"2023-07-14T13:06:03.172919+0000","last_undegraded":"2023-07-14T13:06:03.172919+0000","last_fullsized":"2023-07-14T13:06:03.172919+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:36:17.589820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.173739+0000","last_change":"2023-07-14T13:06:01.793122+0000","last_active":"2023-07-14T13:06:03.173739+0000","last_peered":"2023-07-14T13:06:03.173739+0000","last_clean":"2023-07-14T13:06:03.173739+0000","last_became_active":"2023-07-14T13:06:01.792744+0000","last_became_peered":"2023-07-14T13:06:01.792744+0000","last_unstale":"2023-07-14T13:06:03.173739+0000","last_undegraded":"2023-07-14T13:06:03.173739+0000","last_fullsized":"2023-07-14T13:06:03.173739+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:42:52.348527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.172615+0000","last_change":"2023-07-14T13:06:01.769789+0000","last_active":"2023-07-14T13:06:03.172615+0000","last_peered":"2023-07-14T13:06:03.172615+0000","last_clean":"2023-07-14T13:06:03.172615+0000","last_became_active":"2023-07-14T13:06:01.769528+0000","last_became_peered":"2023-07-14T13:06:01.769528+0000","last_unstale":"2023-07-14T13:06:03.172615+0000","last_undegraded":"2023-07-14T13:06:03.172615+0000","last_fullsized":"2023-07-14T13:06:03.172615+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:54:16.812392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.173295+0000","last_change":"2023-07-14T13:06:01.771519+0000","last_active":"2023-07-14T13:06:03.173295+0000","last_peered":"2023-07-14T13:06:03.173295+0000","last_clean":"2023-07-14T13:06:03.173295+0000","last_became_active":"2023-07-14T13:06:01.770670+0000","last_became_peered":"2023-07-14T13:06:01.770670+0000","last_unstale":"2023-07-14T13:06:03.173295+0000","last_undegraded":"2023-07-14T13:06:03.173295+0000","last_fullsized":"2023-07-14T13:06:03.173295+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:41:43.655069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.173226+0000","last_change":"2023-07-14T13:06:01.787257+0000","last_active":"2023-07-14T13:06:03.173226+0000","last_peered":"2023-07-14T13:06:03.173226+0000","last_clean":"2023-07-14T13:06:03.173226+0000","last_became_active":"2023-07-14T13:06:01.786959+0000","last_became_peered":"2023-07-14T13:06:01.786959+0000","last_unstale":"2023-07-14T13:06:03.173226+0000","last_undegraded":"2023-07-14T13:06:03.173226+0000","last_fullsized":"2023-07-14T13:06:03.173226+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:21:21.868689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.172209+0000","last_change":"2023-07-14T13:06:01.776577+0000","last_active":"2023-07-14T13:06:03.172209+0000","last_peered":"2023-07-14T13:06:03.172209+0000","last_clean":"2023-07-14T13:06:03.172209+0000","last_became_active":"2023-07-14T13:06:01.776285+0000","last_became_peered":"2023-07-14T13:06:01.776285+0000","last_unstale":"2023-07-14T13:06:03.172209+0000","last_undegraded":"2023-07-14T13:06:03.172209+0000","last_fullsized":"2023-07-14T13:06:03.172209+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:26.782656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.758768+0000","last_change":"2023-07-14T13:06:01.778118+0000","last_active":"2023-07-14T13:06:02.758768+0000","last_peered":"2023-07-14T13:06:02.758768+0000","last_clean":"2023-07-14T13:06:02.758768+0000","last_became_active":"2023-07-14T13:06:01.777765+0000","last_became_peered":"2023-07-14T13:06:01.777765+0000","last_unstale":"2023-07-14T13:06:02.758768+0000","last_undegraded":"2023-07-14T13:06:02.758768+0000","last_fullsized":"2023-07-14T13:06:02.758768+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:29:47.982522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.175927+0000","last_change":"2023-07-14T13:06:01.791055+0000","last_active":"2023-07-14T13:06:03.175927+0000","last_peered":"2023-07-14T13:06:03.175927+0000","last_clean":"2023-07-14T13:06:03.175927+0000","last_became_active":"2023-07-14T13:06:01.790776+0000","last_became_peered":"2023-07-14T13:06:01.790776+0000","last_unstale":"2023-07-14T13:06:03.175927+0000","last_undegraded":"2023-07-14T13:06:03.175927+0000","last_fullsized":"2023-07-14T13:06:03.175927+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:37:46.993082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.172249+0000","last_change":"2023-07-14T13:06:01.769249+0000","last_active":"2023-07-14T13:06:03.172249+0000","last_peered":"2023-07-14T13:06:03.172249+0000","last_clean":"2023-07-14T13:06:03.172249+0000","last_became_active":"2023-07-14T13:06:01.768988+0000","last_became_peered":"2023-07-14T13:06:01.768988+0000","last_unstale":"2023-07-14T13:06:03.172249+0000","last_undegraded":"2023-07-14T13:06:03.172249+0000","last_fullsized":"2023-07-14T13:06:03.172249+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:31:08.344129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.759150+0000","last_change":"2023-07-14T13:06:01.792266+0000","last_active":"2023-07-14T13:06:02.759150+0000","last_peered":"2023-07-14T13:06:02.759150+0000","last_clean":"2023-07-14T13:06:02.759150+0000","last_became_active":"2023-07-14T13:06:01.791880+0000","last_became_peered":"2023-07-14T13:06:01.791880+0000","last_unstale":"2023-07-14T13:06:02.759150+0000","last_undegraded":"2023-07-14T13:06:02.759150+0000","last_fullsized":"2023-07-14T13:06:02.759150+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:54:09.367599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.176272+0000","last_change":"2023-07-14T13:06:01.784409+0000","last_active":"2023-07-14T13:06:03.176272+0000","last_peered":"2023-07-14T13:06:03.176272+0000","last_clean":"2023-07-14T13:06:03.176272+0000","last_became_active":"2023-07-14T13:06:01.784066+0000","last_became_peered":"2023-07-14T13:06:01.784066+0000","last_unstale":"2023-07-14T13:06:03.176272+0000","last_undegraded":"2023-07-14T13:06:03.176272+0000","last_fullsized":"2023-07-14T13:06:03.176272+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:10:32.927456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.758963+0000","last_change":"2023-07-14T13:06:01.792435+0000","last_active":"2023-07-14T13:06:02.758963+0000","last_peered":"2023-07-14T13:06:02.758963+0000","last_clean":"2023-07-14T13:06:02.758963+0000","last_became_active":"2023-07-14T13:06:01.792141+0000","last_became_peered":"2023-07-14T13:06:01.792141+0000","last_unstale":"2023-07-14T13:06:02.758963+0000","last_undegraded":"2023-07-14T13:06:02.758963+0000","last_fullsized":"2023-07-14T13:06:02.758963+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:53:42.530517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.856501+0000","last_change":"2023-07-14T13:06:01.782018+0000","last_active":"2023-07-14T13:06:02.856501+0000","last_peered":"2023-07-14T13:06:02.856501+0000","last_clean":"2023-07-14T13:06:02.856501+0000","last_became_active":"2023-07-14T13:06:01.781674+0000","last_became_peered":"2023-07-14T13:06:01.781674+0000","last_unstale":"2023-07-14T13:06:02.856501+0000","last_undegraded":"2023-07-14T13:06:02.856501+0000","last_fullsized":"2023-07-14T13:06:02.856501+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:14:50.345385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.856454+0000","last_change":"2023-07-14T13:06:01.782071+0000","last_active":"2023-07-14T13:06:02.856454+0000","last_peered":"2023-07-14T13:06:02.856454+0000","last_clean":"2023-07-14T13:06:02.856454+0000","last_became_active":"2023-07-14T13:06:01.781688+0000","last_became_peered":"2023-07-14T13:06:01.781688+0000","last_unstale":"2023-07-14T13:06:02.856454+0000","last_undegraded":"2023-07-14T13:06:02.856454+0000","last_fullsized":"2023-07-14T13:06:02.856454+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:46:14.284733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.173220+0000","last_change":"2023-07-14T13:06:01.782840+0000","last_active":"2023-07-14T13:06:03.173220+0000","last_peered":"2023-07-14T13:06:03.173220+0000","last_clean":"2023-07-14T13:06:03.173220+0000","last_became_active":"2023-07-14T13:06:01.782450+0000","last_became_peered":"2023-07-14T13:06:01.782450+0000","last_unstale":"2023-07-14T13:06:03.173220+0000","last_undegraded":"2023-07-14T13:06:03.173220+0000","last_fullsized":"2023-07-14T13:06:03.173220+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:41:11.030645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.171915+0000","last_change":"2023-07-14T13:06:01.773752+0000","last_active":"2023-07-14T13:06:03.171915+0000","last_peered":"2023-07-14T13:06:03.171915+0000","last_clean":"2023-07-14T13:06:03.171915+0000","last_became_active":"2023-07-14T13:06:01.773493+0000","last_became_peered":"2023-07-14T13:06:01.773493+0000","last_unstale":"2023-07-14T13:06:03.171915+0000","last_undegraded":"2023-07-14T13:06:03.171915+0000","last_fullsized":"2023-07-14T13:06:03.171915+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:01:20.227495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.758260+0000","last_change":"2023-07-14T13:06:01.775678+0000","last_active":"2023-07-14T13:06:02.758260+0000","last_peered":"2023-07-14T13:06:02.758260+0000","last_clean":"2023-07-14T13:06:02.758260+0000","last_became_active":"2023-07-14T13:06:01.775323+0000","last_became_peered":"2023-07-14T13:06:01.775323+0000","last_unstale":"2023-07-14T13:06:02.758260+0000","last_undegraded":"2023-07-14T13:06:02.758260+0000","last_fullsized":"2023-07-14T13:06:02.758260+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:04:10.487709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.759256+0000","last_change":"2023-07-14T13:06:01.775407+0000","last_active":"2023-07-14T13:06:02.759256+0000","last_peered":"2023-07-14T13:06:02.759256+0000","last_clean":"2023-07-14T13:06:02.759256+0000","last_became_active":"2023-07-14T13:06:01.775121+0000","last_became_peered":"2023-07-14T13:06:01.775121+0000","last_unstale":"2023-07-14T13:06:02.759256+0000","last_undegraded":"2023-07-14T13:06:02.759256+0000","last_fullsized":"2023-07-14T13:06:02.759256+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:25:29.060631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.173435+0000","last_change":"2023-07-14T13:06:01.769643+0000","last_active":"2023-07-14T13:06:03.173435+0000","last_peered":"2023-07-14T13:06:03.173435+0000","last_clean":"2023-07-14T13:06:03.173435+0000","last_became_active":"2023-07-14T13:06:01.769161+0000","last_became_peered":"2023-07-14T13:06:01.769161+0000","last_unstale":"2023-07-14T13:06:03.173435+0000","last_undegraded":"2023-07-14T13:06:03.173435+0000","last_fullsized":"2023-07-14T13:06:03.173435+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:07:25.786910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.172628+0000","last_change":"2023-07-14T13:06:01.794120+0000","last_active":"2023-07-14T13:06:03.172628+0000","last_peered":"2023-07-14T13:06:03.172628+0000","last_clean":"2023-07-14T13:06:03.172628+0000","last_became_active":"2023-07-14T13:06:01.793726+0000","last_became_peered":"2023-07-14T13:06:01.793726+0000","last_unstale":"2023-07-14T13:06:03.172628+0000","last_undegraded":"2023-07-14T13:06:03.172628+0000","last_fullsized":"2023-07-14T13:06:03.172628+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:40:22.953641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.856760+0000","last_change":"2023-07-14T13:06:01.777402+0000","last_active":"2023-07-14T13:06:02.856760+0000","last_peered":"2023-07-14T13:06:02.856760+0000","last_clean":"2023-07-14T13:06:02.856760+0000","last_became_active":"2023-07-14T13:06:01.777095+0000","last_became_peered":"2023-07-14T13:06:01.777095+0000","last_unstale":"2023-07-14T13:06:02.856760+0000","last_undegraded":"2023-07-14T13:06:02.856760+0000","last_fullsized":"2023-07-14T13:06:02.856760+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:01:20.227495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.758474+0000","last_change":"2023-07-14T13:06:01.785976+0000","last_active":"2023-07-14T13:06:02.758474+0000","last_peered":"2023-07-14T13:06:02.758474+0000","last_clean":"2023-07-14T13:06:02.758474+0000","last_became_active":"2023-07-14T13:06:01.785708+0000","last_became_peered":"2023-07-14T13:06:01.785708+0000","last_unstale":"2023-07-14T13:06:02.758474+0000","last_undegraded":"2023-07-14T13:06:02.758474+0000","last_fullsized":"2023-07-14T13:06:02.758474+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:05:18.234463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.175585+0000","last_change":"2023-07-14T13:06:01.788693+0000","last_active":"2023-07-14T13:06:03.175585+0000","last_peered":"2023-07-14T13:06:03.175585+0000","last_clean":"2023-07-14T13:06:03.175585+0000","last_became_active":"2023-07-14T13:06:01.788253+0000","last_became_peered":"2023-07-14T13:06:01.788253+0000","last_unstale":"2023-07-14T13:06:03.175585+0000","last_undegraded":"2023-07-14T13:06:03.175585+0000","last_fullsized":"2023-07-14T13:06:03.175585+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:58:51.729294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.758349+0000","last_change":"2023-07-14T13:06:01.776675+0000","last_active":"2023-07-14T13:06:02.758349+0000","last_peered":"2023-07-14T13:06:02.758349+0000","last_clean":"2023-07-14T13:06:02.758349+0000","last_became_active":"2023-07-14T13:06:01.776120+0000","last_became_peered":"2023-07-14T13:06:01.776120+0000","last_unstale":"2023-07-14T13:06:02.758349+0000","last_undegraded":"2023-07-14T13:06:02.758349+0000","last_fullsized":"2023-07-14T13:06:02.758349+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:28:43.115369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.175504+0000","last_change":"2023-07-14T13:06:01.797353+0000","last_active":"2023-07-14T13:06:03.175504+0000","last_peered":"2023-07-14T13:06:03.175504+0000","last_clean":"2023-07-14T13:06:03.175504+0000","last_became_active":"2023-07-14T13:06:01.797090+0000","last_became_peered":"2023-07-14T13:06:01.797090+0000","last_unstale":"2023-07-14T13:06:03.175504+0000","last_undegraded":"2023-07-14T13:06:03.175504+0000","last_fullsized":"2023-07-14T13:06:03.175504+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:58:51.729294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.175306+0000","last_change":"2023-07-14T13:06:01.782149+0000","last_active":"2023-07-14T13:06:03.175306+0000","last_peered":"2023-07-14T13:06:03.175306+0000","last_clean":"2023-07-14T13:06:03.175306+0000","last_became_active":"2023-07-14T13:06:01.781855+0000","last_became_peered":"2023-07-14T13:06:01.781855+0000","last_unstale":"2023-07-14T13:06:03.175306+0000","last_undegraded":"2023-07-14T13:06:03.175306+0000","last_fullsized":"2023-07-14T13:06:03.175306+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:12:47.969924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"64'4","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.856834+0000","last_change":"2023-07-14T13:06:00.756132+0000","last_active":"2023-07-14T13:06:02.856834+0000","last_peered":"2023-07-14T13:06:02.856834+0000","last_clean":"2023-07-14T13:06:02.856834+0000","last_became_active":"2023-07-14T13:06:00.755507+0000","last_became_peered":"2023-07-14T13:06:00.755507+0000","last_unstale":"2023-07-14T13:06:02.856834+0000","last_undegraded":"2023-07-14T13:06:02.856834+0000","last_fullsized":"2023-07-14T13:06:02.856834+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:42:22.518638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.175982+0000","last_change":"2023-07-14T13:06:01.779910+0000","last_active":"2023-07-14T13:06:03.175982+0000","last_peered":"2023-07-14T13:06:03.175982+0000","last_clean":"2023-07-14T13:06:03.175982+0000","last_became_active":"2023-07-14T13:06:01.779312+0000","last_became_peered":"2023-07-14T13:06:01.779312+0000","last_unstale":"2023-07-14T13:06:03.175982+0000","last_undegraded":"2023-07-14T13:06:03.175982+0000","last_fullsized":"2023-07-14T13:06:03.175982+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:59:30.627856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"64'1","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.172718+0000","last_change":"2023-07-14T13:06:00.761498+0000","last_active":"2023-07-14T13:06:03.172718+0000","last_peered":"2023-07-14T13:06:03.172718+0000","last_clean":"2023-07-14T13:06:03.172718+0000","last_became_active":"2023-07-14T13:06:00.761218+0000","last_became_peered":"2023-07-14T13:06:00.761218+0000","last_unstale":"2023-07-14T13:06:03.172718+0000","last_undegraded":"2023-07-14T13:06:03.172718+0000","last_fullsized":"2023-07-14T13:06:03.172718+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:25:05.920718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.856442+0000","last_change":"2023-07-14T13:06:01.789331+0000","last_active":"2023-07-14T13:06:02.856442+0000","last_peered":"2023-07-14T13:06:02.856442+0000","last_clean":"2023-07-14T13:06:02.856442+0000","last_became_active":"2023-07-14T13:06:01.788985+0000","last_became_peered":"2023-07-14T13:06:01.788985+0000","last_unstale":"2023-07-14T13:06:02.856442+0000","last_undegraded":"2023-07-14T13:06:02.856442+0000","last_fullsized":"2023-07-14T13:06:02.856442+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:36:22.111666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"64'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.172708+0000","last_change":"2023-07-14T13:06:00.754529+0000","last_active":"2023-07-14T13:06:03.172708+0000","last_peered":"2023-07-14T13:06:03.172708+0000","last_clean":"2023-07-14T13:06:03.172708+0000","last_became_active":"2023-07-14T13:06:00.754227+0000","last_became_peered":"2023-07-14T13:06:00.754227+0000","last_unstale":"2023-07-14T13:06:03.172708+0000","last_undegraded":"2023-07-14T13:06:03.172708+0000","last_fullsized":"2023-07-14T13:06:03.172708+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:28:27.756070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.173063+0000","last_change":"2023-07-14T13:06:01.770908+0000","last_active":"2023-07-14T13:06:03.173063+0000","last_peered":"2023-07-14T13:06:03.173063+0000","last_clean":"2023-07-14T13:06:03.173063+0000","last_became_active":"2023-07-14T13:06:01.770585+0000","last_became_peered":"2023-07-14T13:06:01.770585+0000","last_unstale":"2023-07-14T13:06:03.173063+0000","last_undegraded":"2023-07-14T13:06:03.173063+0000","last_fullsized":"2023-07-14T13:06:03.173063+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:01:08.858766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"64'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.176414+0000","last_change":"2023-07-14T13:06:00.763143+0000","last_active":"2023-07-14T13:06:03.176414+0000","last_peered":"2023-07-14T13:06:03.176414+0000","last_clean":"2023-07-14T13:06:03.176414+0000","last_became_active":"2023-07-14T13:06:00.762841+0000","last_became_peered":"2023-07-14T13:06:00.762841+0000","last_unstale":"2023-07-14T13:06:03.176414+0000","last_undegraded":"2023-07-14T13:06:03.176414+0000","last_fullsized":"2023-07-14T13:06:03.176414+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:59:17.601896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.763184+0000","last_change":"2023-07-14T13:06:01.796467+0000","last_active":"2023-07-14T13:06:02.763184+0000","last_peered":"2023-07-14T13:06:02.763184+0000","last_clean":"2023-07-14T13:06:02.763184+0000","last_became_active":"2023-07-14T13:06:01.796137+0000","last_became_peered":"2023-07-14T13:06:01.796137+0000","last_unstale":"2023-07-14T13:06:02.763184+0000","last_undegraded":"2023-07-14T13:06:02.763184+0000","last_fullsized":"2023-07-14T13:06:02.763184+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:54:22.373186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"64'1","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.758485+0000","last_change":"2023-07-14T13:06:00.756771+0000","last_active":"2023-07-14T13:06:02.758485+0000","last_peered":"2023-07-14T13:06:02.758485+0000","last_clean":"2023-07-14T13:06:02.758485+0000","last_became_active":"2023-07-14T13:06:00.756496+0000","last_became_peered":"2023-07-14T13:06:00.756496+0000","last_unstale":"2023-07-14T13:06:02.758485+0000","last_undegraded":"2023-07-14T13:06:02.758485+0000","last_fullsized":"2023-07-14T13:06:02.758485+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:44:59.287152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.176313+0000","last_change":"2023-07-14T13:06:01.784086+0000","last_active":"2023-07-14T13:06:03.176313+0000","last_peered":"2023-07-14T13:06:03.176313+0000","last_clean":"2023-07-14T13:06:03.176313+0000","last_became_active":"2023-07-14T13:06:01.783738+0000","last_became_peered":"2023-07-14T13:06:01.783738+0000","last_unstale":"2023-07-14T13:06:03.176313+0000","last_undegraded":"2023-07-14T13:06:03.176313+0000","last_fullsized":"2023-07-14T13:06:03.176313+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:28:13.894395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"64'1","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.763168+0000","last_change":"2023-07-14T13:06:00.756414+0000","last_active":"2023-07-14T13:06:02.763168+0000","last_peered":"2023-07-14T13:06:02.763168+0000","last_clean":"2023-07-14T13:06:02.763168+0000","last_became_active":"2023-07-14T13:06:00.755350+0000","last_became_peered":"2023-07-14T13:06:00.755350+0000","last_unstale":"2023-07-14T13:06:02.763168+0000","last_undegraded":"2023-07-14T13:06:02.763168+0000","last_fullsized":"2023-07-14T13:06:02.763168+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:09:32.803818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.173563+0000","last_change":"2023-07-14T13:06:01.769466+0000","last_active":"2023-07-14T13:06:03.173563+0000","last_peered":"2023-07-14T13:06:03.173563+0000","last_clean":"2023-07-14T13:06:03.173563+0000","last_became_active":"2023-07-14T13:06:01.768815+0000","last_became_peered":"2023-07-14T13:06:01.768815+0000","last_unstale":"2023-07-14T13:06:03.173563+0000","last_undegraded":"2023-07-14T13:06:03.173563+0000","last_fullsized":"2023-07-14T13:06:03.173563+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:56:58.346106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.856587+0000","last_change":"2023-07-14T13:06:00.764991+0000","last_active":"2023-07-14T13:06:02.856587+0000","last_peered":"2023-07-14T13:06:02.856587+0000","last_clean":"2023-07-14T13:06:02.856587+0000","last_became_active":"2023-07-14T13:06:00.764498+0000","last_became_peered":"2023-07-14T13:06:00.764498+0000","last_unstale":"2023-07-14T13:06:02.856587+0000","last_undegraded":"2023-07-14T13:06:02.856587+0000","last_fullsized":"2023-07-14T13:06:02.856587+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:17:00.422736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.175838+0000","last_change":"2023-07-14T13:06:01.803373+0000","last_active":"2023-07-14T13:06:03.175838+0000","last_peered":"2023-07-14T13:06:03.175838+0000","last_clean":"2023-07-14T13:06:03.175838+0000","last_became_active":"2023-07-14T13:06:01.803148+0000","last_became_peered":"2023-07-14T13:06:01.803148+0000","last_unstale":"2023-07-14T13:06:03.175838+0000","last_undegraded":"2023-07-14T13:06:03.175838+0000","last_fullsized":"2023-07-14T13:06:03.175838+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:18:16.613833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.758312+0000","last_change":"2023-07-14T13:06:00.752505+0000","last_active":"2023-07-14T13:06:02.758312+0000","last_peered":"2023-07-14T13:06:02.758312+0000","last_clean":"2023-07-14T13:06:02.758312+0000","last_became_active":"2023-07-14T13:06:00.752152+0000","last_became_peered":"2023-07-14T13:06:00.752152+0000","last_unstale":"2023-07-14T13:06:02.758312+0000","last_undegraded":"2023-07-14T13:06:02.758312+0000","last_fullsized":"2023-07-14T13:06:02.758312+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:20:42.652443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.762817+0000","last_change":"2023-07-14T13:06:01.770405+0000","last_active":"2023-07-14T13:06:02.762817+0000","last_peered":"2023-07-14T13:06:02.762817+0000","last_clean":"2023-07-14T13:06:02.762817+0000","last_became_active":"2023-07-14T13:06:01.770090+0000","last_became_peered":"2023-07-14T13:06:01.770090+0000","last_unstale":"2023-07-14T13:06:02.762817+0000","last_undegraded":"2023-07-14T13:06:02.762817+0000","last_fullsized":"2023-07-14T13:06:02.762817+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:42:28.047703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.175687+0000","last_change":"2023-07-14T13:06:00.763540+0000","last_active":"2023-07-14T13:06:03.175687+0000","last_peered":"2023-07-14T13:06:03.175687+0000","last_clean":"2023-07-14T13:06:03.175687+0000","last_became_active":"2023-07-14T13:06:00.763248+0000","last_became_peered":"2023-07-14T13:06:00.763248+0000","last_unstale":"2023-07-14T13:06:03.175687+0000","last_undegraded":"2023-07-14T13:06:03.175687+0000","last_fullsized":"2023-07-14T13:06:03.175687+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:25:01.370263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.175882+0000","last_change":"2023-07-14T13:06:01.780935+0000","last_active":"2023-07-14T13:06:03.175882+0000","last_peered":"2023-07-14T13:06:03.175882+0000","last_clean":"2023-07-14T13:06:03.175882+0000","last_became_active":"2023-07-14T13:06:01.779619+0000","last_became_peered":"2023-07-14T13:06:01.779619+0000","last_unstale":"2023-07-14T13:06:03.175882+0000","last_undegraded":"2023-07-14T13:06:03.175882+0000","last_fullsized":"2023-07-14T13:06:03.175882+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:37:46.993082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.763275+0000","last_change":"2023-07-14T13:06:00.762491+0000","last_active":"2023-07-14T13:06:02.763275+0000","last_peered":"2023-07-14T13:06:02.763275+0000","last_clean":"2023-07-14T13:06:02.763275+0000","last_became_active":"2023-07-14T13:06:00.762242+0000","last_became_peered":"2023-07-14T13:06:00.762242+0000","last_unstale":"2023-07-14T13:06:02.763275+0000","last_undegraded":"2023-07-14T13:06:02.763275+0000","last_fullsized":"2023-07-14T13:06:02.763275+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:44:08.984648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.758902+0000","last_change":"2023-07-14T13:06:01.786570+0000","last_active":"2023-07-14T13:06:02.758902+0000","last_peered":"2023-07-14T13:06:02.758902+0000","last_clean":"2023-07-14T13:06:02.758902+0000","last_became_active":"2023-07-14T13:06:01.786274+0000","last_became_peered":"2023-07-14T13:06:01.786274+0000","last_unstale":"2023-07-14T13:06:02.758902+0000","last_undegraded":"2023-07-14T13:06:02.758902+0000","last_fullsized":"2023-07-14T13:06:02.758902+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:09:29.373774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"64'3","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.176462+0000","last_change":"2023-07-14T13:06:00.769317+0000","last_active":"2023-07-14T13:06:03.176462+0000","last_peered":"2023-07-14T13:06:03.176462+0000","last_clean":"2023-07-14T13:06:03.176462+0000","last_became_active":"2023-07-14T13:06:00.768989+0000","last_became_peered":"2023-07-14T13:06:00.768989+0000","last_unstale":"2023-07-14T13:06:03.176462+0000","last_undegraded":"2023-07-14T13:06:03.176462+0000","last_fullsized":"2023-07-14T13:06:03.176462+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:59:17.601896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.763013+0000","last_change":"2023-07-14T13:06:01.773462+0000","last_active":"2023-07-14T13:06:02.763013+0000","last_peered":"2023-07-14T13:06:02.763013+0000","last_clean":"2023-07-14T13:06:02.763013+0000","last_became_active":"2023-07-14T13:06:01.773149+0000","last_became_peered":"2023-07-14T13:06:01.773149+0000","last_unstale":"2023-07-14T13:06:02.763013+0000","last_undegraded":"2023-07-14T13:06:02.763013+0000","last_fullsized":"2023-07-14T13:06:02.763013+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:55:04.871500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"64'6","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.173270+0000","last_change":"2023-07-14T13:06:00.758935+0000","last_active":"2023-07-14T13:06:03.173270+0000","last_peered":"2023-07-14T13:06:03.173270+0000","last_clean":"2023-07-14T13:06:03.173270+0000","last_became_active":"2023-07-14T13:06:00.758549+0000","last_became_peered":"2023-07-14T13:06:00.758549+0000","last_unstale":"2023-07-14T13:06:03.173270+0000","last_undegraded":"2023-07-14T13:06:03.173270+0000","last_fullsized":"2023-07-14T13:06:03.173270+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:58:05.965985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.176272+0000","last_change":"2023-07-14T13:06:01.780740+0000","last_active":"2023-07-14T13:06:03.176272+0000","last_peered":"2023-07-14T13:06:03.176272+0000","last_clean":"2023-07-14T13:06:03.176272+0000","last_became_active":"2023-07-14T13:06:01.779893+0000","last_became_peered":"2023-07-14T13:06:01.779893+0000","last_unstale":"2023-07-14T13:06:03.176272+0000","last_undegraded":"2023-07-14T13:06:03.176272+0000","last_fullsized":"2023-07-14T13:06:03.176272+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:41:11.913033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"64'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.758615+0000","last_change":"2023-07-14T13:06:00.763008+0000","last_active":"2023-07-14T13:06:02.758615+0000","last_peered":"2023-07-14T13:06:02.758615+0000","last_clean":"2023-07-14T13:06:02.758615+0000","last_became_active":"2023-07-14T13:06:00.762695+0000","last_became_peered":"2023-07-14T13:06:00.762695+0000","last_unstale":"2023-07-14T13:06:02.758615+0000","last_undegraded":"2023-07-14T13:06:02.758615+0000","last_fullsized":"2023-07-14T13:06:02.758615+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:46:39.319963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.758991+0000","last_change":"2023-07-14T13:06:01.777449+0000","last_active":"2023-07-14T13:06:02.758991+0000","last_peered":"2023-07-14T13:06:02.758991+0000","last_clean":"2023-07-14T13:06:02.758991+0000","last_became_active":"2023-07-14T13:06:01.777195+0000","last_became_peered":"2023-07-14T13:06:01.777195+0000","last_unstale":"2023-07-14T13:06:02.758991+0000","last_undegraded":"2023-07-14T13:06:02.758991+0000","last_fullsized":"2023-07-14T13:06:02.758991+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:29.808503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.856467+0000","last_change":"2023-07-14T13:06:00.761495+0000","last_active":"2023-07-14T13:06:02.856467+0000","last_peered":"2023-07-14T13:06:02.856467+0000","last_clean":"2023-07-14T13:06:02.856467+0000","last_became_active":"2023-07-14T13:06:00.761218+0000","last_became_peered":"2023-07-14T13:06:00.761218+0000","last_unstale":"2023-07-14T13:06:02.856467+0000","last_undegraded":"2023-07-14T13:06:02.856467+0000","last_fullsized":"2023-07-14T13:06:02.856467+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:43:01.259058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.173501+0000","last_change":"2023-07-14T13:06:01.767217+0000","last_active":"2023-07-14T13:06:03.173501+0000","last_peered":"2023-07-14T13:06:03.173501+0000","last_clean":"2023-07-14T13:06:03.173501+0000","last_became_active":"2023-07-14T13:06:01.766814+0000","last_became_peered":"2023-07-14T13:06:01.766814+0000","last_unstale":"2023-07-14T13:06:03.173501+0000","last_undegraded":"2023-07-14T13:06:03.173501+0000","last_fullsized":"2023-07-14T13:06:03.173501+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:55:35.078530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.176088+0000","last_change":"2023-07-14T13:06:00.763951+0000","last_active":"2023-07-14T13:06:03.176088+0000","last_peered":"2023-07-14T13:06:03.176088+0000","last_clean":"2023-07-14T13:06:03.176088+0000","last_became_active":"2023-07-14T13:06:00.763697+0000","last_became_peered":"2023-07-14T13:06:00.763697+0000","last_unstale":"2023-07-14T13:06:03.176088+0000","last_undegraded":"2023-07-14T13:06:03.176088+0000","last_fullsized":"2023-07-14T13:06:03.176088+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:29:46.819124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.759353+0000","last_change":"2023-07-14T13:06:01.781758+0000","last_active":"2023-07-14T13:06:02.759353+0000","last_peered":"2023-07-14T13:06:02.759353+0000","last_clean":"2023-07-14T13:06:02.759353+0000","last_became_active":"2023-07-14T13:06:01.781414+0000","last_became_peered":"2023-07-14T13:06:01.781414+0000","last_unstale":"2023-07-14T13:06:02.759353+0000","last_undegraded":"2023-07-14T13:06:02.759353+0000","last_fullsized":"2023-07-14T13:06:02.759353+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:50:44.708012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"64'8","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.173062+0000","last_change":"2023-07-14T13:06:00.759768+0000","last_active":"2023-07-14T13:06:03.173062+0000","last_peered":"2023-07-14T13:06:03.173062+0000","last_clean":"2023-07-14T13:06:03.173062+0000","last_became_active":"2023-07-14T13:06:00.758411+0000","last_became_peered":"2023-07-14T13:06:00.758411+0000","last_unstale":"2023-07-14T13:06:03.173062+0000","last_undegraded":"2023-07-14T13:06:03.173062+0000","last_fullsized":"2023-07-14T13:06:03.173062+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:39:49.660860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.172964+0000","last_change":"2023-07-14T13:06:01.779402+0000","last_active":"2023-07-14T13:06:03.172964+0000","last_peered":"2023-07-14T13:06:03.172964+0000","last_clean":"2023-07-14T13:06:03.172964+0000","last_became_active":"2023-07-14T13:06:01.778911+0000","last_became_peered":"2023-07-14T13:06:01.778911+0000","last_unstale":"2023-07-14T13:06:03.172964+0000","last_undegraded":"2023-07-14T13:06:03.172964+0000","last_fullsized":"2023-07-14T13:06:03.172964+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:55:34.178402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"64'1","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.759317+0000","last_change":"2023-07-14T13:06:00.761474+0000","last_active":"2023-07-14T13:06:02.759317+0000","last_peered":"2023-07-14T13:06:02.759317+0000","last_clean":"2023-07-14T13:06:02.759317+0000","last_became_active":"2023-07-14T13:06:00.761216+0000","last_became_peered":"2023-07-14T13:06:00.761216+0000","last_unstale":"2023-07-14T13:06:02.759317+0000","last_undegraded":"2023-07-14T13:06:02.759317+0000","last_fullsized":"2023-07-14T13:06:02.759317+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:40:11.676455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.172245+0000","last_change":"2023-07-14T13:06:01.794058+0000","last_active":"2023-07-14T13:06:03.172245+0000","last_peered":"2023-07-14T13:06:03.172245+0000","last_clean":"2023-07-14T13:06:03.172245+0000","last_became_active":"2023-07-14T13:06:01.793804+0000","last_became_peered":"2023-07-14T13:06:01.793804+0000","last_unstale":"2023-07-14T13:06:03.172245+0000","last_undegraded":"2023-07-14T13:06:03.172245+0000","last_fullsized":"2023-07-14T13:06:03.172245+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:24:49.588147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"64'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.173558+0000","last_change":"2023-07-14T13:06:00.760343+0000","last_active":"2023-07-14T13:06:03.173558+0000","last_peered":"2023-07-14T13:06:03.173558+0000","last_clean":"2023-07-14T13:06:03.173558+0000","last_became_active":"2023-07-14T13:06:00.760062+0000","last_became_peered":"2023-07-14T13:06:00.760062+0000","last_unstale":"2023-07-14T13:06:03.173558+0000","last_undegraded":"2023-07-14T13:06:03.173558+0000","last_fullsized":"2023-07-14T13:06:03.173558+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:30:32.352281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.763024+0000","last_change":"2023-07-14T13:06:01.796470+0000","last_active":"2023-07-14T13:06:02.763024+0000","last_peered":"2023-07-14T13:06:02.763024+0000","last_clean":"2023-07-14T13:06:02.763024+0000","last_became_active":"2023-07-14T13:06:01.796179+0000","last_became_peered":"2023-07-14T13:06:01.796179+0000","last_unstale":"2023-07-14T13:06:02.763024+0000","last_undegraded":"2023-07-14T13:06:02.763024+0000","last_fullsized":"2023-07-14T13:06:02.763024+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:05:10.430295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"64'1","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.856686+0000","last_change":"2023-07-14T13:06:00.762635+0000","last_active":"2023-07-14T13:06:02.856686+0000","last_peered":"2023-07-14T13:06:02.856686+0000","last_clean":"2023-07-14T13:06:02.856686+0000","last_became_active":"2023-07-14T13:06:00.762384+0000","last_became_peered":"2023-07-14T13:06:00.762384+0000","last_unstale":"2023-07-14T13:06:02.856686+0000","last_undegraded":"2023-07-14T13:06:02.856686+0000","last_fullsized":"2023-07-14T13:06:02.856686+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:23:45.200855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.172323+0000","last_change":"2023-07-14T13:06:01.777744+0000","last_active":"2023-07-14T13:06:03.172323+0000","last_peered":"2023-07-14T13:06:03.172323+0000","last_clean":"2023-07-14T13:06:03.172323+0000","last_became_active":"2023-07-14T13:06:01.777465+0000","last_became_peered":"2023-07-14T13:06:01.777465+0000","last_unstale":"2023-07-14T13:06:03.172323+0000","last_undegraded":"2023-07-14T13:06:03.172323+0000","last_fullsized":"2023-07-14T13:06:03.172323+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:52:04.650998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.856688+0000","last_change":"2023-07-14T13:06:00.761859+0000","last_active":"2023-07-14T13:06:02.856688+0000","last_peered":"2023-07-14T13:06:02.856688+0000","last_clean":"2023-07-14T13:06:02.856688+0000","last_became_active":"2023-07-14T13:06:00.761595+0000","last_became_peered":"2023-07-14T13:06:00.761595+0000","last_unstale":"2023-07-14T13:06:02.856688+0000","last_undegraded":"2023-07-14T13:06:02.856688+0000","last_fullsized":"2023-07-14T13:06:02.856688+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:22:43.516154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.176267+0000","last_change":"2023-07-14T13:06:01.780584+0000","last_active":"2023-07-14T13:06:03.176267+0000","last_peered":"2023-07-14T13:06:03.176267+0000","last_clean":"2023-07-14T13:06:03.176267+0000","last_became_active":"2023-07-14T13:06:01.779870+0000","last_became_peered":"2023-07-14T13:06:01.779870+0000","last_unstale":"2023-07-14T13:06:03.176267+0000","last_undegraded":"2023-07-14T13:06:03.176267+0000","last_fullsized":"2023-07-14T13:06:03.176267+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:28:13.894395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"64'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.172350+0000","last_change":"2023-07-14T13:06:00.761520+0000","last_active":"2023-07-14T13:06:03.172350+0000","last_peered":"2023-07-14T13:06:03.172350+0000","last_clean":"2023-07-14T13:06:03.172350+0000","last_became_active":"2023-07-14T13:06:00.761245+0000","last_became_peered":"2023-07-14T13:06:00.761245+0000","last_unstale":"2023-07-14T13:06:03.172350+0000","last_undegraded":"2023-07-14T13:06:03.172350+0000","last_fullsized":"2023-07-14T13:06:03.172350+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:04:31.512964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.856679+0000","last_change":"2023-07-14T13:06:01.788605+0000","last_active":"2023-07-14T13:06:02.856679+0000","last_peered":"2023-07-14T13:06:02.856679+0000","last_clean":"2023-07-14T13:06:02.856679+0000","last_became_active":"2023-07-14T13:06:01.788310+0000","last_became_peered":"2023-07-14T13:06:01.788310+0000","last_unstale":"2023-07-14T13:06:02.856679+0000","last_undegraded":"2023-07-14T13:06:02.856679+0000","last_fullsized":"2023-07-14T13:06:02.856679+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:24:34.297209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.173340+0000","last_change":"2023-07-14T13:06:00.759041+0000","last_active":"2023-07-14T13:06:03.173340+0000","last_peered":"2023-07-14T13:06:03.173340+0000","last_clean":"2023-07-14T13:06:03.173340+0000","last_became_active":"2023-07-14T13:06:00.758732+0000","last_became_peered":"2023-07-14T13:06:00.758732+0000","last_unstale":"2023-07-14T13:06:03.173340+0000","last_undegraded":"2023-07-14T13:06:03.173340+0000","last_fullsized":"2023-07-14T13:06:03.173340+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:06:17.633819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.758777+0000","last_change":"2023-07-14T13:06:01.786190+0000","last_active":"2023-07-14T13:06:02.758777+0000","last_peered":"2023-07-14T13:06:02.758777+0000","last_clean":"2023-07-14T13:06:02.758777+0000","last_became_active":"2023-07-14T13:06:01.785905+0000","last_became_peered":"2023-07-14T13:06:01.785905+0000","last_unstale":"2023-07-14T13:06:02.758777+0000","last_undegraded":"2023-07-14T13:06:02.758777+0000","last_fullsized":"2023-07-14T13:06:02.758777+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:14:38.601120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.758408+0000","last_change":"2023-07-14T13:06:00.762299+0000","last_active":"2023-07-14T13:06:02.758408+0000","last_peered":"2023-07-14T13:06:02.758408+0000","last_clean":"2023-07-14T13:06:02.758408+0000","last_became_active":"2023-07-14T13:06:00.761975+0000","last_became_peered":"2023-07-14T13:06:00.761975+0000","last_unstale":"2023-07-14T13:06:02.758408+0000","last_undegraded":"2023-07-14T13:06:02.758408+0000","last_fullsized":"2023-07-14T13:06:02.758408+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:41:11.417262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.172642+0000","last_change":"2023-07-14T13:06:01.773825+0000","last_active":"2023-07-14T13:06:03.172642+0000","last_peered":"2023-07-14T13:06:03.172642+0000","last_clean":"2023-07-14T13:06:03.172642+0000","last_became_active":"2023-07-14T13:06:01.773536+0000","last_became_peered":"2023-07-14T13:06:01.773536+0000","last_unstale":"2023-07-14T13:06:03.172642+0000","last_undegraded":"2023-07-14T13:06:03.172642+0000","last_fullsized":"2023-07-14T13:06:03.172642+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:18:14.572870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.171863+0000","last_change":"2023-07-14T13:06:00.762395+0000","last_active":"2023-07-14T13:06:03.171863+0000","last_peered":"2023-07-14T13:06:03.171863+0000","last_clean":"2023-07-14T13:06:03.171863+0000","last_became_active":"2023-07-14T13:06:00.762022+0000","last_became_peered":"2023-07-14T13:06:00.762022+0000","last_unstale":"2023-07-14T13:06:03.171863+0000","last_undegraded":"2023-07-14T13:06:03.171863+0000","last_fullsized":"2023-07-14T13:06:03.171863+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:56:31.037462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.856451+0000","last_change":"2023-07-14T13:06:01.790135+0000","last_active":"2023-07-14T13:06:02.856451+0000","last_peered":"2023-07-14T13:06:02.856451+0000","last_clean":"2023-07-14T13:06:02.856451+0000","last_became_active":"2023-07-14T13:06:01.788914+0000","last_became_peered":"2023-07-14T13:06:01.788914+0000","last_unstale":"2023-07-14T13:06:02.856451+0000","last_undegraded":"2023-07-14T13:06:02.856451+0000","last_fullsized":"2023-07-14T13:06:02.856451+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:02:09.236149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"65'1","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.758932+0000","last_change":"2023-07-14T13:06:00.762994+0000","last_active":"2023-07-14T13:06:02.758932+0000","last_peered":"2023-07-14T13:06:02.758932+0000","last_clean":"2023-07-14T13:06:02.758932+0000","last_became_active":"2023-07-14T13:06:00.762704+0000","last_became_peered":"2023-07-14T13:06:00.762704+0000","last_unstale":"2023-07-14T13:06:02.758932+0000","last_undegraded":"2023-07-14T13:06:02.758932+0000","last_fullsized":"2023-07-14T13:06:02.758932+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:30:08.549823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"53'139","reported_seq":337,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.175249+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:06:03.175249+0000","last_peered":"2023-07-14T13:06:03.175249+0000","last_clean":"2023-07-14T13:06:03.175249+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:06:03.175249+0000","last_undegraded":"2023-07-14T13:06:03.175249+0000","last_fullsized":"2023-07-14T13:06:03.175249+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:59:49.745914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":103,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.176087+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:06:03.176087+0000","last_peered":"2023-07-14T13:06:03.176087+0000","last_clean":"2023-07-14T13:06:03.176087+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:06:03.176087+0000","last_undegraded":"2023-07-14T13:06:03.176087+0000","last_fullsized":"2023-07-14T13:06:03.176087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:57:12.208211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.172608+0000","last_change":"2023-07-14T13:06:01.771627+0000","last_active":"2023-07-14T13:06:03.172608+0000","last_peered":"2023-07-14T13:06:03.172608+0000","last_clean":"2023-07-14T13:06:03.172608+0000","last_became_active":"2023-07-14T13:06:01.767997+0000","last_became_peered":"2023-07-14T13:06:01.767997+0000","last_unstale":"2023-07-14T13:06:03.172608+0000","last_undegraded":"2023-07-14T13:06:03.172608+0000","last_fullsized":"2023-07-14T13:06:03.172608+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:58:46.245037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.176461+0000","last_change":"2023-07-14T13:06:00.766325+0000","last_active":"2023-07-14T13:06:03.176461+0000","last_peered":"2023-07-14T13:06:03.176461+0000","last_clean":"2023-07-14T13:06:03.176461+0000","last_became_active":"2023-07-14T13:06:00.766116+0000","last_became_peered":"2023-07-14T13:06:00.766116+0000","last_unstale":"2023-07-14T13:06:03.176461+0000","last_undegraded":"2023-07-14T13:06:03.176461+0000","last_fullsized":"2023-07-14T13:06:03.176461+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:41:10.904876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":103,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.175553+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:06:03.175553+0000","last_peered":"2023-07-14T13:06:03.175553+0000","last_clean":"2023-07-14T13:06:03.175553+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:06:03.175553+0000","last_undegraded":"2023-07-14T13:06:03.175553+0000","last_fullsized":"2023-07-14T13:06:03.175553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:38:24.064321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.173131+0000","last_change":"2023-07-14T13:06:01.763433+0000","last_active":"2023-07-14T13:06:03.173131+0000","last_peered":"2023-07-14T13:06:03.173131+0000","last_clean":"2023-07-14T13:06:03.173131+0000","last_became_active":"2023-07-14T13:06:01.763120+0000","last_became_peered":"2023-07-14T13:06:01.763120+0000","last_unstale":"2023-07-14T13:06:03.173131+0000","last_undegraded":"2023-07-14T13:06:03.173131+0000","last_fullsized":"2023-07-14T13:06:03.173131+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:43:55.818811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.758602+0000","last_change":"2023-07-14T13:06:00.752570+0000","last_active":"2023-07-14T13:06:02.758602+0000","last_peered":"2023-07-14T13:06:02.758602+0000","last_clean":"2023-07-14T13:06:02.758602+0000","last_became_active":"2023-07-14T13:06:00.752307+0000","last_became_peered":"2023-07-14T13:06:00.752307+0000","last_unstale":"2023-07-14T13:06:02.758602+0000","last_undegraded":"2023-07-14T13:06:02.758602+0000","last_fullsized":"2023-07-14T13:06:02.758602+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:55:04.134111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":101,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.171952+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:06:03.171952+0000","last_peered":"2023-07-14T13:06:03.171952+0000","last_clean":"2023-07-14T13:06:03.171952+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:06:03.171952+0000","last_undegraded":"2023-07-14T13:06:03.171952+0000","last_fullsized":"2023-07-14T13:06:03.171952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:29:02.807550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.175663+0000","last_change":"2023-07-14T13:06:01.796978+0000","last_active":"2023-07-14T13:06:03.175663+0000","last_peered":"2023-07-14T13:06:03.175663+0000","last_clean":"2023-07-14T13:06:03.175663+0000","last_became_active":"2023-07-14T13:06:01.796700+0000","last_became_peered":"2023-07-14T13:06:01.796700+0000","last_unstale":"2023-07-14T13:06:03.175663+0000","last_undegraded":"2023-07-14T13:06:03.175663+0000","last_fullsized":"2023-07-14T13:06:03.175663+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:25:02.378420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"64'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.856760+0000","last_change":"2023-07-14T13:06:00.760649+0000","last_active":"2023-07-14T13:06:02.856760+0000","last_peered":"2023-07-14T13:06:02.856760+0000","last_clean":"2023-07-14T13:06:02.856760+0000","last_became_active":"2023-07-14T13:06:00.760376+0000","last_became_peered":"2023-07-14T13:06:00.760376+0000","last_unstale":"2023-07-14T13:06:02.856760+0000","last_undegraded":"2023-07-14T13:06:02.856760+0000","last_fullsized":"2023-07-14T13:06:02.856760+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:41:22.350916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":103,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.175715+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:06:03.175715+0000","last_peered":"2023-07-14T13:06:03.175715+0000","last_clean":"2023-07-14T13:06:03.175715+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:06:03.175715+0000","last_undegraded":"2023-07-14T13:06:03.175715+0000","last_fullsized":"2023-07-14T13:06:03.175715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:04:55.894588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.759028+0000","last_change":"2023-07-14T13:06:01.775018+0000","last_active":"2023-07-14T13:06:02.759028+0000","last_peered":"2023-07-14T13:06:02.759028+0000","last_clean":"2023-07-14T13:06:02.759028+0000","last_became_active":"2023-07-14T13:06:01.774735+0000","last_became_peered":"2023-07-14T13:06:01.774735+0000","last_unstale":"2023-07-14T13:06:02.759028+0000","last_undegraded":"2023-07-14T13:06:02.759028+0000","last_fullsized":"2023-07-14T13:06:02.759028+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:04:44.253215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.762815+0000","last_change":"2023-07-14T13:06:00.762610+0000","last_active":"2023-07-14T13:06:02.762815+0000","last_peered":"2023-07-14T13:06:02.762815+0000","last_clean":"2023-07-14T13:06:02.762815+0000","last_became_active":"2023-07-14T13:06:00.762305+0000","last_became_peered":"2023-07-14T13:06:00.762305+0000","last_unstale":"2023-07-14T13:06:02.762815+0000","last_undegraded":"2023-07-14T13:06:02.762815+0000","last_fullsized":"2023-07-14T13:06:02.762815+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:40:20.935542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":105,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.172459+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:06:03.172459+0000","last_peered":"2023-07-14T13:06:03.172459+0000","last_clean":"2023-07-14T13:06:03.172459+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:06:03.172459+0000","last_undegraded":"2023-07-14T13:06:03.172459+0000","last_fullsized":"2023-07-14T13:06:03.172459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:41:56.450087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.173821+0000","last_change":"2023-07-14T13:06:01.772586+0000","last_active":"2023-07-14T13:06:03.173821+0000","last_peered":"2023-07-14T13:06:03.173821+0000","last_clean":"2023-07-14T13:06:03.173821+0000","last_became_active":"2023-07-14T13:06:01.772274+0000","last_became_peered":"2023-07-14T13:06:01.772274+0000","last_unstale":"2023-07-14T13:06:03.173821+0000","last_undegraded":"2023-07-14T13:06:03.173821+0000","last_fullsized":"2023-07-14T13:06:03.173821+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:48:20.590789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.175814+0000","last_change":"2023-07-14T13:06:00.768010+0000","last_active":"2023-07-14T13:06:03.175814+0000","last_peered":"2023-07-14T13:06:03.175814+0000","last_clean":"2023-07-14T13:06:03.175814+0000","last_became_active":"2023-07-14T13:06:00.767670+0000","last_became_peered":"2023-07-14T13:06:00.767670+0000","last_unstale":"2023-07-14T13:06:03.175814+0000","last_undegraded":"2023-07-14T13:06:03.175814+0000","last_fullsized":"2023-07-14T13:06:03.175814+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:45:32.660747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":103,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.176562+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:06:03.176562+0000","last_peered":"2023-07-14T13:06:03.176562+0000","last_clean":"2023-07-14T13:06:03.176562+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:06:03.176562+0000","last_undegraded":"2023-07-14T13:06:03.176562+0000","last_fullsized":"2023-07-14T13:06:03.176562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:30:30.953033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.758588+0000","last_change":"2023-07-14T13:06:01.792137+0000","last_active":"2023-07-14T13:06:02.758588+0000","last_peered":"2023-07-14T13:06:02.758588+0000","last_clean":"2023-07-14T13:06:02.758588+0000","last_became_active":"2023-07-14T13:06:01.791830+0000","last_became_peered":"2023-07-14T13:06:01.791830+0000","last_unstale":"2023-07-14T13:06:02.758588+0000","last_undegraded":"2023-07-14T13:06:02.758588+0000","last_fullsized":"2023-07-14T13:06:02.758588+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:03:48.015208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.173196+0000","last_change":"2023-07-14T13:06:00.757176+0000","last_active":"2023-07-14T13:06:03.173196+0000","last_peered":"2023-07-14T13:06:03.173196+0000","last_clean":"2023-07-14T13:06:03.173196+0000","last_became_active":"2023-07-14T13:06:00.756867+0000","last_became_peered":"2023-07-14T13:06:00.756867+0000","last_unstale":"2023-07-14T13:06:03.173196+0000","last_undegraded":"2023-07-14T13:06:03.173196+0000","last_fullsized":"2023-07-14T13:06:03.173196+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:39:17.110636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":105,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.172768+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:06:03.172768+0000","last_peered":"2023-07-14T13:06:03.172768+0000","last_clean":"2023-07-14T13:06:03.172768+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:06:03.172768+0000","last_undegraded":"2023-07-14T13:06:03.172768+0000","last_fullsized":"2023-07-14T13:06:03.172768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:17:22.968044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.175892+0000","last_change":"2023-07-14T13:06:01.779578+0000","last_active":"2023-07-14T13:06:03.175892+0000","last_peered":"2023-07-14T13:06:03.175892+0000","last_clean":"2023-07-14T13:06:03.175892+0000","last_became_active":"2023-07-14T13:06:01.779047+0000","last_became_peered":"2023-07-14T13:06:01.779047+0000","last_unstale":"2023-07-14T13:06:03.175892+0000","last_undegraded":"2023-07-14T13:06:03.175892+0000","last_fullsized":"2023-07-14T13:06:03.175892+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:06:00.732778+0000","last_clean_scrub_stamp":"2023-07-14T13:06:00.732778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:29:47.827281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:03.173455+0000","last_change":"2023-07-14T13:06:00.764320+0000","last_active":"2023-07-14T13:06:03.173455+0000","last_peered":"2023-07-14T13:06:03.173455+0000","last_clean":"2023-07-14T13:06:03.173455+0000","last_became_active":"2023-07-14T13:06:00.764000+0000","last_became_peered":"2023-07-14T13:06:00.764000+0000","last_unstale":"2023-07-14T13:06:03.173455+0000","last_undegraded":"2023-07-14T13:06:03.173455+0000","last_fullsized":"2023-07-14T13:06:03.173455+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:05:59.724621+0000","last_clean_scrub_stamp":"2023-07-14T13:05:59.724621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:56:37.754308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":103,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-14T13:06:02.856880+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:06:02.856880+0000","last_peered":"2023-07-14T13:06:02.856880+0000","last_clean":"2023-07-14T13:06:02.856880+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:06:02.856880+0000","last_undegraded":"2023-07-14T13:06:02.856880+0000","last_fullsized":"2023-07-14T13:06:02.856880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:43:11.326374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575012,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54536,"kb_used_data":1344,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317304,"statfs":{"total":96636764160,"available":96580919296,"internally_reserved":0,"allocated":1376256,"data_stored":971381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.35699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.85499999999999998,"5min":0.98399999999999999,"15min":1.879},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.745,"15min":0.74099999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.439},"max":{"1min":0.877,"5min":0.95599999999999996,"15min":1.9059999999999999},"last":0.748}]},{"osd":1,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.752,"15min":0.72999999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.42999999999999999},"max":{"1min":0.92600000000000005,"5min":1,"15min":1.069},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.76000000000000001,"15min":0.745},"min":{"1min":0.54000000000000004,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93000000000000005,"5min":0.97399999999999998,"15min":1.1020000000000001},"last":0.627}]},{"osd":2,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.745,"15min":0.72299999999999998},"min":{"1min":0.46999999999999997,"5min":0.42699999999999999,"15min":0.40600000000000003},"max":{"1min":0.877,"5min":1.016,"15min":1.048},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.77500000000000002,"15min":0.755},"min":{"1min":0.50600000000000001,"5min":0.503,"15min":0.46899999999999997},"max":{"1min":0.89200000000000002,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.76800000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.753,"15min":0.73199999999999998},"min":{"1min":0.50700000000000001,"5min":0.46400000000000002,"15min":0.442},"max":{"1min":0.98199999999999998,"5min":1.0269999999999999,"15min":1.0760000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.78100000000000003,"15min":0.76000000000000001},"min":{"1min":0.51900000000000002,"5min":0.47299999999999998,"15min":0.41499999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.024},"last":0.70799999999999996}]},{"osd":4,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.60899999999999999,"15min":0.58999999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.86299999999999999,"5min":1.022,"15min":1.022},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.40999999999999998,"5min":0.40000000000000002,"15min":0.39300000000000002},"max":{"1min":0.68100000000000005,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.78600000000000003}]},{"osd":5,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.63300000000000001,"15min":0.622},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94699999999999995,"5min":0.98299999999999998,"15min":1.0249999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.65300000000000002,"15min":0.67300000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.008},"last":0.66300000000000003}]},{"osd":6,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.70399999999999996,"15min":0.71699999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96699999999999997,"5min":1.0489999999999999,"15min":1.4419999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.68700000000000006,"15min":0.69199999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91000000000000003,"5min":0.98199999999999998,"15min":1.575},"last":0.72999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575013,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31812,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":782336,"data_stored":381541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73499999999999999,"15min":0.73099999999999998},"min":{"1min":0.46700000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.96499999999999997,"5min":0.996,"15min":1.2749999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73799999999999999,"15min":0.73999999999999999},"min":{"1min":0.48799999999999999,"5min":0.48199999999999998,"15min":0.47399999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.2110000000000001},"last":0.61299999999999999}]},{"osd":1,"last update":"Fri Jul 14 13:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.751,"15min":0.75600000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.379},"max":{"1min":0.86599999999999999,"5min":1.0209999999999999,"15min":1.4299999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.73499999999999999,"15min":0.72599999999999998},"min":{"1min":0.49199999999999999,"5min":0.46999999999999997,"15min":0.44},"max":{"1min":0.88200000000000001,"5min":1.077,"15min":1.1379999999999999},"last":0.59799999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.752,"15min":0.749},"min":{"1min":0.505,"5min":0.496,"15min":0.40400000000000003},"max":{"1min":0.91000000000000003,"5min":1.105,"15min":1.319},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.76400000000000001,"15min":0.753},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.42299999999999999},"max":{"1min":0.95099999999999996,"5min":1.0900000000000001,"15min":1.341},"last":0.75900000000000001}]},{"osd":3,"last update":"Fri Jul 14 13:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.78200000000000003,"15min":0.78100000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.91300000000000003,"5min":1.093,"15min":1.3859999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.77900000000000003,"15min":0.76500000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.45900000000000002},"max":{"1min":0.96499999999999997,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.54000000000000004}]},{"osd":4,"last update":"Fri Jul 14 13:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57599999999999996,"15min":0.58499999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.78500000000000003,"5min":0.871,"15min":0.97899999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.626,"15min":0.64200000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.36099999999999999},"max":{"1min":1.012,"5min":1.0780000000000001,"15min":1.091},"last":0.66800000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64600000000000002,"15min":0.65500000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67300000000000004,"15min":0.70099999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.05,"5min":1.05,"15min":1.145},"last":0.70699999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.64700000000000002,"15min":0.66600000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.92800000000000005,"5min":1.1200000000000001,"15min":1.208},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70599999999999996,"15min":0.71899999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.626}]}]},{"osd":5,"up_from":13,"seq":55834575012,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":774144,"data_stored":380889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.73699999999999999,"15min":0.73399999999999999},"min":{"1min":0.45300000000000001,"5min":0.36499999999999999,"15min":0.32400000000000001},"max":{"1min":2.6699999999999999,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.878},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.72699999999999998,"15min":0.74099999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.94199999999999995,"5min":0.996,"15min":1.0069999999999999},"last":0.94399999999999995}]},{"osd":1,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.72699999999999998,"15min":0.73199999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.41099999999999998},"max":{"1min":0.85899999999999999,"5min":1.079,"15min":1.335},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75800000000000001,"15min":0.75600000000000001},"min":{"1min":0.505,"5min":0.40400000000000003,"15min":0.36799999999999999},"max":{"1min":2.706,"5min":2.706,"15min":2.706},"last":0.95899999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73499999999999999,"15min":0.748},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91800000000000004,"5min":1.0940000000000001,"15min":1.298},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.73299999999999998,"15min":0.74199999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.90200000000000002,"5min":1.044,"15min":1.044},"last":0.86599999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.75600000000000001,"15min":0.745},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.76100000000000001,"15min":0.77600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88900000000000001,"5min":1.149,"15min":1.149},"last":0.90200000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.63200000000000001,"15min":0.64000000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.85199999999999998,"5min":0.94199999999999995,"15min":1.073},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.71599999999999997},"min":{"1min":0.40600000000000003,"5min":0.40200000000000002,"15min":0.35899999999999999},"max":{"1min":2.7719999999999998,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.58099999999999996}]},{"osd":6,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.621,"15min":0.64100000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.89800000000000002,"5min":0.95399999999999996,"15min":0.97999999999999998},"last":0.621},{"interface":"front","average":{"1min":0.623,"5min":0.63900000000000001,"15min":0.66200000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.042},"last":0.70799999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":3.0230000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67900000000000005,"15min":0.70899999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.95999999999999996,"5min":1.407,"15min":1.407},"last":0.80700000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575012,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31808,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":778240,"data_stored":381471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.746,"15min":0.72899999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93400000000000005,"5min":1.411,"15min":1.411},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.748,"15min":0.71599999999999997},"min":{"1min":0.45800000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.0640000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.70499999999999996}]},{"osd":1,"last update":"Fri Jul 14 13:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76300000000000001,"15min":0.73799999999999999},"min":{"1min":0.50900000000000001,"5min":0.47999999999999998,"15min":0.442},"max":{"1min":0.88800000000000001,"5min":1.077,"15min":1.077},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94999999999999996,"5min":1.0469999999999999,"15min":1.2370000000000001},"last":0.57199999999999995}]},{"osd":2,"last update":"Fri Jul 14 13:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.74199999999999999,"15min":0.72499999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92200000000000004,"5min":1.091,"15min":1.091},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79300000000000004,"15min":0.76400000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0649999999999999,"5min":1.387,"15min":1.387},"last":0.745}]},{"osd":3,"last update":"Fri Jul 14 13:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.75,"15min":0.73999999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.90500000000000003,"5min":1.008,"15min":1.099},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77500000000000002,"15min":0.76300000000000001},"min":{"1min":0.496,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.024,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.76200000000000001}]},{"osd":5,"last update":"Fri Jul 14 13:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61499999999999999,"15min":0.60999999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":1.0029999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60899999999999999,"15min":0.621},"min":{"1min":0.41399999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93600000000000005,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.77600000000000002}]},{"osd":6,"last update":"Fri Jul 14 13:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.60799999999999998,"15min":0.626},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.32300000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66800000000000004,"15min":0.67600000000000005},"min":{"1min":0.42099999999999999,"5min":0.374,"15min":0.374},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.67100000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.66400000000000003,"15min":0.67300000000000004},"min":{"1min":0.46000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.89900000000000002,"5min":0.98099999999999998,"15min":1.0349999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68999999999999995,"15min":0.70799999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.36899999999999999},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.1080000000000001},"last":0.59499999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575012,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35916,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335924,"statfs":{"total":96636764160,"available":96599986176,"internally_reserved":0,"allocated":790528,"data_stored":382475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45400000000000001,"15min":0.44400000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.748,"5min":0.755,"15min":0.84199999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.503,"15min":0.52000000000000002},"min":{"1min":0.378,"5min":0.33300000000000002,"15min":0.309},"max":{"1min":0.65500000000000003,"5min":0.78700000000000003,"15min":1.577},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47199999999999998,"15min":0.47599999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.29199999999999998},"max":{"1min":0.65400000000000003,"5min":0.71699999999999997,"15min":0.88200000000000001},"last":0.621},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.32600000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.113},"last":0.495}]},{"osd":2,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.56499999999999995,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.38700000000000001},"max":{"1min":0.63900000000000001,"5min":0.88400000000000001,"15min":1.0820000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.624,"15min":0.59899999999999998},"min":{"1min":0.46400000000000002,"5min":0.441,"15min":0.40100000000000002},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.60499999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.51100000000000001,"5min":0.441,"15min":0.439},"max":{"1min":0.88200000000000001,"5min":1.284,"15min":1.627},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.77400000000000002,"15min":0.78400000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.47699999999999998},"max":{"1min":0.81899999999999995,"5min":1.135,"15min":1.214},"last":0.73199999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.78500000000000003,"15min":0.79000000000000004},"min":{"1min":0.58499999999999996,"5min":0.57999999999999996,"15min":0.52400000000000002},"max":{"1min":0.86399999999999999,"5min":1.306,"15min":1.333},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.78300000000000003,"15min":0.78600000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.96099999999999997,"5min":1.129,"15min":1.2470000000000001},"last":0.86899999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.76800000000000002,"15min":0.78600000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.873,"5min":1.117,"15min":1.526},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.505},"max":{"1min":0.93200000000000005,"5min":1.2589999999999999,"15min":1.381},"last":0.76400000000000001}]},{"osd":7,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.85099999999999998,"15min":0.84299999999999997},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.53100000000000003},"max":{"1min":2.4910000000000001,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.83099999999999996,"15min":0.83999999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.595,"5min":1.595,"15min":1.6910000000000001},"last":0.91500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575012,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53956,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317884,"statfs":{"total":96636764160,"available":96581513216,"internally_reserved":0,"allocated":782336,"data_stored":381434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46700000000000003,"15min":0.46800000000000003},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.28999999999999998},"max":{"1min":2.5270000000000001,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.41399999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.47799999999999998,"15min":0.47499999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27500000000000002},"max":{"1min":2.7200000000000002,"5min":2.7200000000000002,"15min":2.7200000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.33000000000000002},"max":{"1min":2.6110000000000002,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":0.45300000000000001}]},{"osd":3,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.66600000000000004,"15min":0.60199999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.38},"max":{"1min":8.2530000000000001,"5min":8.2530000000000001,"15min":8.2530000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89600000000000002,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.51000000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.3049999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81499999999999995,"15min":0.80900000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.78300000000000003}]},{"osd":5,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.88200000000000001,"15min":0.874},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":3.1139999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.85599999999999998,"15min":0.84599999999999997},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.433},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.90500000000000003}]},{"osd":6,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.82099999999999995,"15min":0.80200000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.47599999999999998},"max":{"1min":3.9849999999999999,"5min":3.9849999999999999,"15min":3.9849999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.83999999999999997,"15min":0.81899999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":3.391,"5min":3.391,"15min":3.391},"last":0.76900000000000002}]},{"osd":7,"last update":"Fri Jul 14 13:06:00 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.83799999999999997,"15min":0.83699999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.5779999999999998,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.753},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.84599999999999997,"15min":0.82599999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.50900000000000001},"max":{"1min":2.5939999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.879}]}]},{"osd":1,"up_from":13,"seq":55834575013,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35908,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335932,"statfs":{"total":96636764160,"available":96599994368,"internally_reserved":0,"allocated":782336,"data_stored":381049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.432,"15min":0.42599999999999999},"min":{"1min":0.26300000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58699999999999997,"5min":0.69099999999999995,"15min":0.77200000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.51500000000000001,"15min":0.49299999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.26500000000000001},"max":{"1min":0.64700000000000002,"5min":0.751,"15min":0.82299999999999995},"last":0.28199999999999997}]},{"osd":2,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.48899999999999999,"15min":0.46899999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.29499999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52600000000000002,"15min":0.51000000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.29299999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.35099999999999998}]},{"osd":3,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64700000000000002,"15min":0.626},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.432},"max":{"1min":0.79200000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58299999999999996,"15min":0.57599999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.38100000000000001},"max":{"1min":0.749,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.371}]},{"osd":4,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.80100000000000005,"15min":0.77200000000000002},"min":{"1min":0.51600000000000001,"5min":0.51300000000000001,"15min":0.40000000000000002},"max":{"1min":0.999,"5min":1.054,"15min":1.236},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.79000000000000004,"15min":0.77800000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.45700000000000002},"max":{"1min":0.92200000000000004,"5min":1.1040000000000001,"15min":1.1180000000000001},"last":0.68799999999999994}]},{"osd":5,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.79700000000000004,"15min":0.77500000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":0.99099999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.80800000000000005,"15min":0.79200000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48199999999999998},"max":{"1min":0.88,"5min":1.2509999999999999,"15min":1.3600000000000001},"last":0.90800000000000003}]},{"osd":6,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.81000000000000005,"15min":0.79100000000000004},"min":{"1min":0.503,"5min":0.503,"15min":0.48499999999999999},"max":{"1min":0.89600000000000002,"5min":1.0649999999999999,"15min":1.274},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.82699999999999996,"15min":0.81200000000000006},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.49199999999999999},"max":{"1min":0.96999999999999997,"5min":1.1599999999999999,"15min":1.2969999999999999},"last":0.751}]},{"osd":7,"last update":"Fri Jul 14 13:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.80200000000000005,"15min":0.78600000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.47799999999999998},"max":{"1min":0.93799999999999994,"5min":1.123,"15min":1.3400000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.85899999999999999,"15min":0.83599999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.52800000000000002},"max":{"1min":0.95699999999999996,"5min":1.1890000000000001,"15min":1.2929999999999999},"last":0.872}]}]},{"osd":0,"up_from":13,"seq":55834575014,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36484,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335356,"statfs":{"total":96636764160,"available":96599404544,"internally_reserved":0,"allocated":1372160,"data_stored":970294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.48299999999999998,"15min":0.45900000000000002},"min":{"1min":0.28899999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.50800000000000001,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.69699999999999995,"5min":0.77900000000000003,"15min":1.452},"last":0.499}]},{"osd":2,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.34100000000000003},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80300000000000005,"5min":0.90300000000000002,"15min":1.5700000000000001},"last":0.56100000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.502,"15min":0.51100000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.66000000000000003,"5min":0.70599999999999996,"15min":0.99299999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.60599999999999998,"15min":0.59699999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":2.4100000000000001,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.58599999999999997}]},{"osd":4,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.80300000000000005,"15min":0.78400000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.44400000000000001},"max":{"1min":1.2150000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.873,"5min":0.82499999999999996,"15min":0.81599999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.93899999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.82299999999999995,"15min":0.80500000000000005},"min":{"1min":0.51800000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2549999999999999,"5min":1.3839999999999999,"15min":1.4950000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.81399999999999995,"15min":0.80400000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.47299999999999998},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.79600000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.82599999999999996,"15min":0.81799999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.82799999999999996,"15min":0.82199999999999995},"min":{"1min":0.55500000000000005,"5min":0.50600000000000001,"15min":0.41299999999999998},"max":{"1min":1.141,"5min":1.3440000000000001,"15min":1.5369999999999999},"last":0.81200000000000006}]},{"osd":7,"last update":"Fri Jul 14 13:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.84999999999999998,"15min":0.83999999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.45500000000000002},"max":{"1min":1.04,"5min":1.2749999999999999,"15min":1.603},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82999999999999996,"15min":0.82399999999999995},"min":{"1min":0.57099999999999995,"5min":0.52800000000000002,"15min":0.497},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.83199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:06:10.872 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-14T13:06:10.873 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-14T13:06:11.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.030+0000 7fe4e2a0b640 1 Processor -- start 2023-07-14T13:06:11.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.030+0000 7fe4e2a0b640 1 -- start start 2023-07-14T13:06:11.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.030+0000 7fe4e2a0b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe4dc06a100 0x7fe4dc06fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.030+0000 7fe4e2a0b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4dc15f6a0 con 0x7fe4dc06ff80 2023-07-14T13:06:11.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.030+0000 7fe4e2a0b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4dc160220 con 0x7fe4dc06d650 2023-07-14T13:06:11.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.030+0000 7fe4e2a0b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4dc0703d0 con 0x7fe4dc06a100 2023-07-14T13:06:11.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.030+0000 7fe4dbfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe4dc06a100 0x7fe4dc06fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.030+0000 7fe4db7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe4dc06ff80 0x7fe4dc06cf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47596/0 (socket says 172.21.15.5:47596) 2023-07-14T13:06:11.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.030+0000 7fe4db7fe640 1 -- 172.21.15.5:0/3248789365 learned_addr learned my addr 172.21.15.5:0/3248789365 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:06:11.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.030+0000 7fe4dbfff640 1 -- 172.21.15.5:0/3248789365 >> v1:172.21.15.154:6789/0 conn(0x7fe4dc06d650 legacy=0x7fe4dc15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:11.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.030+0000 7fe4dbfff640 1 -- 172.21.15.5:0/3248789365 >> v1:172.21.15.5:6789/0 conn(0x7fe4dc06ff80 legacy=0x7fe4dc06cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:11.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.030+0000 7fe4dbfff640 1 -- 172.21.15.5:0/3248789365 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc06a4d0 con 0x7fe4dc06a100 2023-07-14T13:06:11.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.034+0000 7fe4dbfff640 1 --2- 172.21.15.5:0/3248789365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4dc06a100 0x7fe4dc06fa40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc0097c0 tx=0x7fe4cc01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe643f5a556976bd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:11.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.034+0000 7fe4daffd640 1 -- 172.21.15.5:0/3248789365 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc0a8050 con 0x7fe4dc06a100 2023-07-14T13:06:11.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.034+0000 7fe4daffd640 1 -- 172.21.15.5:0/3248789365 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4cc0ac5f0 con 0x7fe4dc06a100 2023-07-14T13:06:11.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.034+0000 7fe4daffd640 1 -- 172.21.15.5:0/3248789365 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc0ac980 con 0x7fe4dc06a100 2023-07-14T13:06:11.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.034+0000 7fe4e2a0b640 1 -- 172.21.15.5:0/3248789365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4dc06a100 msgr2=0x7fe4dc06fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:11.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.034+0000 7fe4e2a0b640 1 --2- 172.21.15.5:0/3248789365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4dc06a100 0x7fe4dc06fa40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc0097c0 tx=0x7fe4cc01c390 comp rx=0 tx=0).stop 2023-07-14T13:06:11.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.034+0000 7fe4e2a0b640 1 -- 172.21.15.5:0/3248789365 shutdown_connections 2023-07-14T13:06:11.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.034+0000 7fe4e2a0b640 1 --2- 172.21.15.5:0/3248789365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4dc06a100 0x7fe4dc06fa40 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.034+0000 7fe4e2a0b640 1 -- 172.21.15.5:0/3248789365 >> 172.21.15.5:0/3248789365 conn(0x7fe4dc0b0490 msgr2=0x7fe4dc0b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:11.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.038+0000 7fe4e2a0b640 1 -- 172.21.15.5:0/3248789365 shutdown_connections 2023-07-14T13:06:11.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.038+0000 7fe4e2a0b640 1 -- 172.21.15.5:0/3248789365 wait complete. 2023-07-14T13:06:11.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.038+0000 7fe4e2a0b640 1 Processor -- start 2023-07-14T13:06:11.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.038+0000 7fe4e2a0b640 1 -- start start 2023-07-14T13:06:11.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.038+0000 7fe4e2a0b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4dc06a100 0x7fe4dc144500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.038+0000 7fe4e2a0b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4dc06d650 0x7fe4dc164a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.038+0000 7fe4e2a0b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4dc06ff80 0x7fe4dc164f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.038+0000 7fe4e2a0b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc165480 con 0x7fe4dc06d650 2023-07-14T13:06:11.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.038+0000 7fe4e2a0b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc158f90 con 0x7fe4dc06a100 2023-07-14T13:06:11.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.038+0000 7fe4e2a0b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc146830 con 0x7fe4dc06ff80 2023-07-14T13:06:11.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.038+0000 7fe4db7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4dc06d650 0x7fe4dc164a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.038+0000 7fe4db7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4dc06d650 0x7fe4dc164a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52214/0 (socket says 172.21.15.5:52214) 2023-07-14T13:06:11.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.038+0000 7fe4db7fe640 1 -- 172.21.15.5:0/1803413452 learned_addr learned my addr 172.21.15.5:0/1803413452 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:11.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.038+0000 7fe4dbfff640 1 --2- 172.21.15.5:0/1803413452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4dc06a100 0x7fe4dc144500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.038+0000 7fe4e0fa8640 1 --2- 172.21.15.5:0/1803413452 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4dc06ff80 0x7fe4dc164f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.038+0000 7fe4db7fe640 1 -- 172.21.15.5:0/1803413452 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4dc06ff80 msgr2=0x7fe4dc164f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:11.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.038+0000 7fe4db7fe640 1 --2- 172.21.15.5:0/1803413452 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4dc06ff80 0x7fe4dc164f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.038+0000 7fe4db7fe640 1 -- 172.21.15.5:0/1803413452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4dc06a100 msgr2=0x7fe4dc144500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:11.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.038+0000 7fe4db7fe640 1 --2- 172.21.15.5:0/1803413452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4dc06a100 0x7fe4dc144500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.038+0000 7fe4db7fe640 1 -- 172.21.15.5:0/1803413452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc009420 con 0x7fe4dc06d650 2023-07-14T13:06:11.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.038+0000 7fe4e0fa8640 1 --2- 172.21.15.5:0/1803413452 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4dc06ff80 0x7fe4dc164f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:06:11.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.038+0000 7fe4db7fe640 1 --2- 172.21.15.5:0/1803413452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4dc06d650 0x7fe4dc164a00 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000c500 tx=0x7fe4d000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:11.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.042+0000 7fe4d8ff9640 1 -- 172.21.15.5:0/1803413452 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0005cf0 con 0x7fe4dc06d650 2023-07-14T13:06:11.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.042+0000 7fe4d8ff9640 1 -- 172.21.15.5:0/1803413452 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d0005e50 con 0x7fe4dc06d650 2023-07-14T13:06:11.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.042+0000 7fe4d8ff9640 1 -- 172.21.15.5:0/1803413452 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d00072f0 con 0x7fe4dc06d650 2023-07-14T13:06:11.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.042+0000 7fe4e2a0b640 1 -- 172.21.15.5:0/1803413452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4dc146b10 con 0x7fe4dc06d650 2023-07-14T13:06:11.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.042+0000 7fe4e2a0b640 1 -- 172.21.15.5:0/1803413452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4dc159480 con 0x7fe4dc06d650 2023-07-14T13:06:11.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.042+0000 7fe4e2a0b640 1 -- 172.21.15.5:0/1803413452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4dc0678d0 con 0x7fe4dc06d650 2023-07-14T13:06:11.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.042+0000 7fe4d8ff9640 1 -- 172.21.15.5:0/1803413452 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe4d0007450 con 0x7fe4dc06d650 2023-07-14T13:06:11.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.042+0000 7fe4d8ff9640 1 --2- 172.21.15.5:0/1803413452 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fe4c80663a0 0x7fe4c8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.042+0000 7fe4d8ff9640 1 -- 172.21.15.5:0/1803413452 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe4d0083340 con 0x7fe4dc06d650 2023-07-14T13:06:11.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.042+0000 7fe4dbfff640 1 --2- 172.21.15.5:0/1803413452 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fe4c80663a0 0x7fe4c8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.046+0000 7fe4dbfff640 1 --2- 172.21.15.5:0/1803413452 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fe4c80663a0 0x7fe4c8068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc0ae000 tx=0x7fe4cc008040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:11.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.046+0000 7fe4d8ff9640 1 -- 172.21.15.5:0/1803413452 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe4d0050750 con 0x7fe4dc06d650 2023-07-14T13:06:11.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.254+0000 7fe4e2a0b640 1 -- 172.21.15.5:0/1803413452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe4dc146d00 con 0x7fe4dc06d650 2023-07-14T13:06:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.258+0000 7fe4d8ff9640 1 -- 172.21.15.5:0/1803413452 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7fe4dc146d00 con 0x7fe4dc06d650 2023-07-14T13:06:11.292 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-07-14T13:06:11.292 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDkRLFkCav/DhAA6SOiONAbTcWCnUZXcm7BcQ== 2023-07-14T13:06:11.292 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2023-07-14T13:06:11.293 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2023-07-14T13:06:11.293 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-14T13:06:11.293 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2023-07-14T13:06:11.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.262+0000 7fe4e2a0b640 1 -- 172.21.15.5:0/1803413452 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fe4c80663a0 msgr2=0x7fe4c8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:11.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.262+0000 7fe4e2a0b640 1 --2- 172.21.15.5:0/1803413452 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fe4c80663a0 0x7fe4c8068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc0ae000 tx=0x7fe4cc008040 comp rx=0 tx=0).stop 2023-07-14T13:06:11.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.262+0000 7fe4e2a0b640 1 -- 172.21.15.5:0/1803413452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4dc06d650 msgr2=0x7fe4dc164a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:11.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.262+0000 7fe4e2a0b640 1 --2- 172.21.15.5:0/1803413452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4dc06d650 0x7fe4dc164a00 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000c500 tx=0x7fe4d000c9c0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.262+0000 7fe4e2a0b640 1 -- 172.21.15.5:0/1803413452 shutdown_connections 2023-07-14T13:06:11.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.262+0000 7fe4e2a0b640 1 --2- 172.21.15.5:0/1803413452 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fe4c80663a0 0x7fe4c8068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.262+0000 7fe4e2a0b640 1 --2- 172.21.15.5:0/1803413452 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4dc06ff80 0x7fe4dc164f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.262+0000 7fe4e2a0b640 1 --2- 172.21.15.5:0/1803413452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4dc06d650 0x7fe4dc164a00 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.262+0000 7fe4e2a0b640 1 --2- 172.21.15.5:0/1803413452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4dc06a100 0x7fe4dc144500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.262+0000 7fe4e2a0b640 1 -- 172.21.15.5:0/1803413452 >> 172.21.15.5:0/1803413452 conn(0x7fe4dc0b0490 msgr2=0x7fe4dc0cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.262+0000 7fe4e2a0b640 1 -- 172.21.15.5:0/1803413452 shutdown_connections 2023-07-14T13:06:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.262+0000 7fe4e2a0b640 1 -- 172.21.15.5:0/1803413452 wait complete. 2023-07-14T13:06:11.312 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:06:11.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.426+0000 7f26180f9640 1 Processor -- start 2023-07-14T13:06:11.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.426+0000 7f26180f9640 1 -- start start 2023-07-14T13:06:11.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.426+0000 7f26180f9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2610160330 0x7f26100cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.426+0000 7f26180f9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f26100c0f80 0x7f26100cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.426+0000 7f26180f9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26100c17d0 con 0x7f26100c8940 2023-07-14T13:06:11.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.426+0000 7f26180f9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26100c14f0 con 0x7f2610160330 2023-07-14T13:06:11.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.426+0000 7f26180f9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26100cac10 con 0x7f26100c0f80 2023-07-14T13:06:11.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.426+0000 7f2615694640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f26100c8940 0x7f26100ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47606/0 (socket says 172.21.15.5:47606) 2023-07-14T13:06:11.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.426+0000 7f2615694640 1 -- 172.21.15.5:0/3900477389 learned_addr learned my addr 172.21.15.5:0/3900477389 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:06:11.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.426+0000 7f2615e95640 1 --2- 172.21.15.5:0/3900477389 >> v2:172.21.15.5:3300/0 conn(0x7f2610160330 0x7f26100cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.426+0000 7f2616696640 1 --2- 172.21.15.5:0/3900477389 >> v2:172.21.15.154:3300/0 conn(0x7f26100c0f80 0x7f26100cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.426+0000 7f2615e95640 1 -- 172.21.15.5:0/3900477389 >> v2:172.21.15.154:3300/0 conn(0x7f26100c0f80 msgr2=0x7f26100cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:11.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.426+0000 7f2615e95640 1 --2- 172.21.15.5:0/3900477389 >> v2:172.21.15.154:3300/0 conn(0x7f26100c0f80 0x7f26100cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.426+0000 7f2615e95640 1 -- 172.21.15.5:0/3900477389 >> v1:172.21.15.5:6789/0 conn(0x7f26100c8940 legacy=0x7f26100ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:11.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.426+0000 7f2615e95640 1 -- 172.21.15.5:0/3900477389 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26100caef0 con 0x7f2610160330 2023-07-14T13:06:11.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.426+0000 7f2614e93640 1 -- 172.21.15.5:0/3900477389 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4098627944 0 0) 0x7f26100c17d0 con 0x7f26100c8940 2023-07-14T13:06:11.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.426+0000 7f2616696640 1 --2- 172.21.15.5:0/3900477389 >> v2:172.21.15.154:3300/0 conn(0x7f26100c0f80 0x7f26100cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:06:11.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.430+0000 7f2615e95640 1 --2- 172.21.15.5:0/3900477389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2610160330 0x7f26100cb6f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f26100c51e0 tx=0x7f260c01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec5ed302d96c2bd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:11.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.430+0000 7f2614e93640 1 -- 172.21.15.5:0/3900477389 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0a8950 con 0x7f2610160330 2023-07-14T13:06:11.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.430+0000 7f2614e93640 1 -- 172.21.15.5:0/3900477389 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c0a8ab0 con 0x7f2610160330 2023-07-14T13:06:11.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.430+0000 7f2614e93640 1 -- 172.21.15.5:0/3900477389 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0a8e40 con 0x7f2610160330 2023-07-14T13:06:11.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.430+0000 7f26180f9640 1 -- 172.21.15.5:0/3900477389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2610160330 msgr2=0x7f26100cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:11.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.430+0000 7f26180f9640 1 --2- 172.21.15.5:0/3900477389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2610160330 0x7f26100cb6f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f26100c51e0 tx=0x7f260c01ec50 comp rx=0 tx=0).stop 2023-07-14T13:06:11.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.430+0000 7f26180f9640 1 -- 172.21.15.5:0/3900477389 shutdown_connections 2023-07-14T13:06:11.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.430+0000 7f26180f9640 1 --2- 172.21.15.5:0/3900477389 >> v2:172.21.15.154:3300/0 conn(0x7f26100c0f80 0x7f26100cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.430+0000 7f26180f9640 1 --2- 172.21.15.5:0/3900477389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2610160330 0x7f26100cb6f0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.430+0000 7f26180f9640 1 -- 172.21.15.5:0/3900477389 >> 172.21.15.5:0/3900477389 conn(0x7f26100afcf0 msgr2=0x7f26100b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:11.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.430+0000 7f26180f9640 1 -- 172.21.15.5:0/3900477389 shutdown_connections 2023-07-14T13:06:11.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.430+0000 7f26180f9640 1 -- 172.21.15.5:0/3900477389 wait complete. 2023-07-14T13:06:11.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.434+0000 7f26180f9640 1 Processor -- start 2023-07-14T13:06:11.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.434+0000 7f26180f9640 1 -- start start 2023-07-14T13:06:11.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.434+0000 7f26180f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26100c0f80 0x7f261015c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.434+0000 7f26180f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26100c8940 0x7f26100c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.434+0000 7f26180f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2610160330 0x7f261006f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.434+0000 7f26180f9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26101f5b20 con 0x7f26100c8940 2023-07-14T13:06:11.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.434+0000 7f26180f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26101f6b40 con 0x7f26100c0f80 2023-07-14T13:06:11.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.434+0000 7f26180f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26100c6470 con 0x7f2610160330 2023-07-14T13:06:11.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.434+0000 7f2615694640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26100c8940 0x7f26100c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.434+0000 7f2615694640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26100c8940 0x7f26100c5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52228/0 (socket says 172.21.15.5:52228) 2023-07-14T13:06:11.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.434+0000 7f2615694640 1 -- 172.21.15.5:0/4119149389 learned_addr learned my addr 172.21.15.5:0/4119149389 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:11.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.434+0000 7f2615e95640 1 --2- 172.21.15.5:0/4119149389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26100c0f80 0x7f261015c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.434+0000 7f2615694640 1 -- 172.21.15.5:0/4119149389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2610160330 msgr2=0x7f261006f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:11.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.434+0000 7f2616696640 1 --2- 172.21.15.5:0/4119149389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2610160330 0x7f261006f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.434+0000 7f2615694640 1 --2- 172.21.15.5:0/4119149389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2610160330 0x7f261006f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.434+0000 7f2615694640 1 -- 172.21.15.5:0/4119149389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26100c0f80 msgr2=0x7f261015c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:11.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.434+0000 7f2615694640 1 --2- 172.21.15.5:0/4119149389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26100c0f80 0x7f261015c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.434+0000 7f2615694640 1 -- 172.21.15.5:0/4119149389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c009420 con 0x7f26100c8940 2023-07-14T13:06:11.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.434+0000 7f2615e95640 1 --2- 172.21.15.5:0/4119149389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26100c0f80 0x7f261015c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:06:11.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.434+0000 7f2616696640 1 --2- 172.21.15.5:0/4119149389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2610160330 0x7f261006f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:06:11.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.434+0000 7f2615694640 1 --2- 172.21.15.5:0/4119149389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26100c8940 0x7f26100c5a90 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f26000011f0 tx=0x7f260000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:11.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.434+0000 7f26067fc640 1 -- 172.21.15.5:0/4119149389 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26000074e0 con 0x7f26100c8940 2023-07-14T13:06:11.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.434+0000 7f26067fc640 1 -- 172.21.15.5:0/4119149389 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2600007640 con 0x7f26100c8940 2023-07-14T13:06:11.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.434+0000 7f26180f9640 1 -- 172.21.15.5:0/4119149389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26101f5d80 con 0x7f26100c8940 2023-07-14T13:06:11.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.434+0000 7f26067fc640 1 -- 172.21.15.5:0/4119149389 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2600004a10 con 0x7f26100c8940 2023-07-14T13:06:11.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.434+0000 7f26180f9640 1 -- 172.21.15.5:0/4119149389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26101f6340 con 0x7f26100c8940 2023-07-14T13:06:11.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.438+0000 7f26180f9640 1 -- 172.21.15.5:0/4119149389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26100678d0 con 0x7f26100c8940 2023-07-14T13:06:11.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.438+0000 7f26067fc640 1 -- 172.21.15.5:0/4119149389 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2600004b70 con 0x7f26100c8940 2023-07-14T13:06:11.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.438+0000 7f26067fc640 1 --2- 172.21.15.5:0/4119149389 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f25f40663a0 0x7f25f4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.438+0000 7f26067fc640 1 -- 172.21.15.5:0/4119149389 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2600083180 con 0x7f26100c8940 2023-07-14T13:06:11.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.438+0000 7f2615e95640 1 --2- 172.21.15.5:0/4119149389 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f25f40663a0 0x7f25f4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.438+0000 7f2615e95640 1 --2- 172.21.15.5:0/4119149389 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f25f40663a0 0x7f25f4068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f260c0b2000 tx=0x7f260c0aa070 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:11.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.442+0000 7f26067fc640 1 -- 172.21.15.5:0/4119149389 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f26000504e0 con 0x7f26100c8940 2023-07-14T13:06:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.630+0000 7f26180f9640 1 -- 172.21.15.5:0/4119149389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f261006c380 con 0x7f26100c8940 2023-07-14T13:06:11.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.630+0000 7f26067fc640 1 -- 172.21.15.5:0/4119149389 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4700 (secure 0 0 0) 0x7f2600053b00 con 0x7f26100c8940 2023-07-14T13:06:11.662 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:06:11.662 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5429,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/874132020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":874132020},{"type":"v1","addr":"172.21.15.154:6837","nonce":874132020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5911,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/217555499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":217555499},{"type":"v1","addr":"172.21.15.154:6835","nonce":217555499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6033,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3051331859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3051331859},{"type":"v1","addr":"172.21.15.5:6834","nonce":3051331859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:06:01.137621+0000","modified":"2023-07-14T13:06:04.782437+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6036":{"gid":6036,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/231396012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":231396012},{"type":"v1","addr":"172.21.15.5:6835","nonce":231396012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T13:06:11.662 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2023-07-14T13:06:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.630+0000 7f26180f9640 1 -- 172.21.15.5:0/4119149389 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f25f40663a0 msgr2=0x7f25f4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.630+0000 7f26180f9640 1 --2- 172.21.15.5:0/4119149389 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f25f40663a0 0x7f25f4068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f260c0b2000 tx=0x7f260c0aa070 comp rx=0 tx=0).stop 2023-07-14T13:06:11.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.630+0000 7f26180f9640 1 -- 172.21.15.5:0/4119149389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26100c8940 msgr2=0x7f26100c5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.630+0000 7f26180f9640 1 --2- 172.21.15.5:0/4119149389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26100c8940 0x7f26100c5a90 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f26000011f0 tx=0x7f260000c9b0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.630+0000 7f26180f9640 1 -- 172.21.15.5:0/4119149389 shutdown_connections 2023-07-14T13:06:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.630+0000 7f26180f9640 1 --2- 172.21.15.5:0/4119149389 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f25f40663a0 0x7f25f4068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.630+0000 7f26180f9640 1 --2- 172.21.15.5:0/4119149389 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2610160330 0x7f261006f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.630+0000 7f26180f9640 1 --2- 172.21.15.5:0/4119149389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26100c8940 0x7f26100c5a90 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.630+0000 7f26180f9640 1 --2- 172.21.15.5:0/4119149389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26100c0f80 0x7f261015c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.630+0000 7f26180f9640 1 -- 172.21.15.5:0/4119149389 >> 172.21.15.5:0/4119149389 conn(0x7f26100afcf0 msgr2=0x7f26100cd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.630+0000 7f26180f9640 1 -- 172.21.15.5:0/4119149389 shutdown_connections 2023-07-14T13:06:11.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:11.630+0000 7f26180f9640 1 -- 172.21.15.5:0/4119149389 wait complete. 2023-07-14T13:06:12.085 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-14T13:06:01.137621+0000', 'modified': '2023-07-14T13:06:04.782437+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6036}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6036': {'gid': 6036, 'name': 'c', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6835/231396012', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6833', 'nonce': 231396012}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 231396012}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-14T13:06:12.085 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-14T13:06:12.086 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-14T13:06:12.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.206+0000 7f66846d8640 1 Processor -- start 2023-07-14T13:06:12.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.206+0000 7f66846d8640 1 -- start start 2023-07-14T13:06:12.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.206+0000 7f66846d8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f667c0ae1f0 0x7f667c0b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:12.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.206+0000 7f66846d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f667c06c430 0x7f667c069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:12.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.206+0000 7f66846d8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667c0b24f0 con 0x7f667c06e160 2023-07-14T13:06:12.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.206+0000 7f66846d8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667c0b27d0 con 0x7f667c0ae1f0 2023-07-14T13:06:12.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.206+0000 7f66846d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0b2ab0 con 0x7f667c06c430 2023-07-14T13:06:12.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.206+0000 7f6682474640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f667c0ae1f0 0x7f667c0b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:12.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.206+0000 7f6681c73640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f667c06e160 0x7f667c06bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47608/0 (socket says 172.21.15.5:47608) 2023-07-14T13:06:12.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.206+0000 7f6681c73640 1 -- 172.21.15.5:0/2897306892 learned_addr learned my addr 172.21.15.5:0/2897306892 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:06:12.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.206+0000 7f6682474640 1 -- 172.21.15.5:0/2897306892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f667c06c430 msgr2=0x7f667c069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:12.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.206+0000 7f6682474640 1 --2- 172.21.15.5:0/2897306892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f667c06c430 0x7f667c069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.206+0000 7f6682474640 1 -- 172.21.15.5:0/2897306892 >> v1:172.21.15.5:6789/0 conn(0x7f667c06e160 legacy=0x7f667c06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:12.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.206+0000 7f6682474640 1 -- 172.21.15.5:0/2897306892 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c0b2d90 con 0x7f667c0ae1f0 2023-07-14T13:06:12.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.206+0000 7f6681472640 1 -- 172.21.15.5:0/2897306892 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3996869053 0 0) 0x7f667c0b24f0 con 0x7f667c06e160 2023-07-14T13:06:12.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.210+0000 7f6682474640 1 --2- 172.21.15.5:0/2897306892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f667c0ae1f0 0x7f667c0b1e60 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f66780097c0 tx=0x7f667801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8248e6e6f7fbce server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:12.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.210+0000 7f6681472640 1 -- 172.21.15.5:0/2897306892 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66780ab670 con 0x7f667c0ae1f0 2023-07-14T13:06:12.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.210+0000 7f6681472640 1 -- 172.21.15.5:0/2897306892 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66780ab7d0 con 0x7f667c0ae1f0 2023-07-14T13:06:12.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.210+0000 7f6681472640 1 -- 172.21.15.5:0/2897306892 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66780abb60 con 0x7f667c0ae1f0 2023-07-14T13:06:12.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.210+0000 7f66846d8640 1 -- 172.21.15.5:0/2897306892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f667c0ae1f0 msgr2=0x7f667c0b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:12.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.210+0000 7f66846d8640 1 --2- 172.21.15.5:0/2897306892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f667c0ae1f0 0x7f667c0b1e60 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f66780097c0 tx=0x7f667801c450 comp rx=0 tx=0).stop 2023-07-14T13:06:12.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.210+0000 7f66846d8640 1 -- 172.21.15.5:0/2897306892 shutdown_connections 2023-07-14T13:06:12.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.210+0000 7f66846d8640 1 --2- 172.21.15.5:0/2897306892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f667c06c430 0x7f667c069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.210+0000 7f66846d8640 1 --2- 172.21.15.5:0/2897306892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f667c0ae1f0 0x7f667c0b1e60 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.210+0000 7f66846d8640 1 -- 172.21.15.5:0/2897306892 >> 172.21.15.5:0/2897306892 conn(0x7f667c0b1300 msgr2=0x7f667c0ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:12.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.210+0000 7f66846d8640 1 -- 172.21.15.5:0/2897306892 shutdown_connections 2023-07-14T13:06:12.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.210+0000 7f66846d8640 1 -- 172.21.15.5:0/2897306892 wait complete. 2023-07-14T13:06:12.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.214+0000 7f66846d8640 1 Processor -- start 2023-07-14T13:06:12.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.214+0000 7f66846d8640 1 -- start start 2023-07-14T13:06:12.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.214+0000 7f66846d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f667c06c430 0x7f667c160020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:12.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.214+0000 7f66846d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f667c06e160 0x7f667c13f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:12.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.214+0000 7f66846d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f667c0ae1f0 0x7f667c15c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:12.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.214+0000 7f66846d8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c13fdc0 con 0x7f667c06e160 2023-07-14T13:06:12.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.214+0000 7f66846d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c1404e0 con 0x7f667c06c430 2023-07-14T13:06:12.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.214+0000 7f66846d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667c1407c0 con 0x7f667c0ae1f0 2023-07-14T13:06:12.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.214+0000 7f6681c73640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f667c06e160 0x7f667c13f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:12.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.214+0000 7f6681c73640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f667c06e160 0x7f667c13f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52244/0 (socket says 172.21.15.5:52244) 2023-07-14T13:06:12.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.214+0000 7f6681c73640 1 -- 172.21.15.5:0/678372463 learned_addr learned my addr 172.21.15.5:0/678372463 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:12.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.214+0000 7f6682474640 1 --2- 172.21.15.5:0/678372463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f667c06c430 0x7f667c160020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:12.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.214+0000 7f6682c75640 1 --2- 172.21.15.5:0/678372463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f667c0ae1f0 0x7f667c15c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.214+0000 7f6681c73640 1 -- 172.21.15.5:0/678372463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f667c0ae1f0 msgr2=0x7f667c15c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.214+0000 7f6681c73640 1 --2- 172.21.15.5:0/678372463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f667c0ae1f0 0x7f667c15c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.214+0000 7f6681c73640 1 -- 172.21.15.5:0/678372463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f667c06c430 msgr2=0x7f667c160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.214+0000 7f6681c73640 1 --2- 172.21.15.5:0/678372463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f667c06c430 0x7f667c160020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.214+0000 7f6681c73640 1 -- 172.21.15.5:0/678372463 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6678009420 con 0x7f667c06e160 2023-07-14T13:06:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.214+0000 7f6682474640 1 --2- 172.21.15.5:0/678372463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f667c06c430 0x7f667c160020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:06:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.214+0000 7f6681c73640 1 --2- 172.21.15.5:0/678372463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f667c06e160 0x7f667c13f340 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f666c0011f0 tx=0x7f666c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.214+0000 7f6672ffd640 1 -- 172.21.15.5:0/678372463 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c0074e0 con 0x7f667c06e160 2023-07-14T13:06:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.214+0000 7f6672ffd640 1 -- 172.21.15.5:0/678372463 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c007640 con 0x7f667c06e160 2023-07-14T13:06:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.214+0000 7f66846d8640 1 -- 172.21.15.5:0/678372463 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f667c0b3710 con 0x7f667c06e160 2023-07-14T13:06:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.214+0000 7f6672ffd640 1 -- 172.21.15.5:0/678372463 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c004a10 con 0x7f667c06e160 2023-07-14T13:06:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.214+0000 7f66846d8640 1 -- 172.21.15.5:0/678372463 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f667c140d80 con 0x7f667c06e160 2023-07-14T13:06:12.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.218+0000 7f6672ffd640 1 -- 172.21.15.5:0/678372463 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f666c004b70 con 0x7f667c06e160 2023-07-14T13:06:12.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.218+0000 7f6672ffd640 1 --2- 172.21.15.5:0/678372463 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f66600663a0 0x7f6660068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:12.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.218+0000 7f6672ffd640 1 -- 172.21.15.5:0/678372463 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f666c083480 con 0x7f667c06e160 2023-07-14T13:06:12.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.218+0000 7f6687a2f000 1 Processor -- start 2023-07-14T13:06:12.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.218+0000 7f6682474640 1 --2- 172.21.15.5:0/678372463 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f66600663a0 0x7f6660068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:12.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.218+0000 7f6687a2f000 1 -- start start 2023-07-14T13:06:12.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.218+0000 7f6682474640 1 --2- 172.21.15.5:0/678372463 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f66600663a0 0x7f6660068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f66780af000 tx=0x7f66780a7000 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:12.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.218+0000 7f6687a2f000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5586fbfcff80 0x5586fbfd0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:12.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.218+0000 7f6687a2f000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586fbfd0890 0x5586fbf863f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:12.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.218+0000 7f6687a2f000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5586fbf86930 0x5586fbf86d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:12.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.218+0000 7f6687a2f000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586fbe4d900 con 0x5586fbf86930 2023-07-14T13:06:12.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.218+0000 7f6687a2f000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586fbd878c0 con 0x5586fbfd0890 2023-07-14T13:06:12.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.218+0000 7f6687a2f000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586fbddb360 con 0x5586fbfcff80 2023-07-14T13:06:12.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.218+0000 7f6682c75640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5586fbf86930 0x5586fbf86d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:12.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.218+0000 7f6682c75640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5586fbf86930 0x5586fbf86d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52254/0 (socket says 172.21.15.5:52254) 2023-07-14T13:06:12.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.218+0000 7f6682c75640 1 -- 172.21.15.5:0/2024201514 learned_addr learned my addr 172.21.15.5:0/2024201514 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:12.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f6681c73640 1 --2- 172.21.15.5:0/2024201514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586fbfd0890 0x5586fbf863f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:12.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f6682474640 1 --2- 172.21.15.5:0/2024201514 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5586fbfcff80 0x5586fbfd0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:12.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f6682c75640 1 -- 172.21.15.5:0/2024201514 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5586fbfcff80 msgr2=0x5586fbfd0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:12.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f6682c75640 1 --2- 172.21.15.5:0/2024201514 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5586fbfcff80 0x5586fbfd0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f6682c75640 1 -- 172.21.15.5:0/2024201514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586fbfd0890 msgr2=0x5586fbf863f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:12.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f6682c75640 1 --2- 172.21.15.5:0/2024201514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586fbfd0890 0x5586fbf863f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f6682c75640 1 -- 172.21.15.5:0/2024201514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586fbad0890 con 0x5586fbf86930 2023-07-14T13:06:12.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f6682c75640 1 --2- 172.21.15.5:0/2024201514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5586fbf86930 0x5586fbf86d00 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6674009f20 tx=0x7f667400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f066225b411e89ad server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:12.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f665ffff640 1 -- 172.21.15.5:0/2024201514 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6674011070 con 0x5586fbf86930 2023-07-14T13:06:12.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f665ffff640 1 -- 172.21.15.5:0/2024201514 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6674015410 con 0x5586fbf86930 2023-07-14T13:06:12.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f665ffff640 1 -- 172.21.15.5:0/2024201514 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66740157c0 con 0x5586fbf86930 2023-07-14T13:06:12.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f6687a2f000 1 -- 172.21.15.5:0/2024201514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5586fbf86930 msgr2=0x5586fbf86d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:12.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f6687a2f000 1 --2- 172.21.15.5:0/2024201514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5586fbf86930 0x5586fbf86d00 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6674009f20 tx=0x7f667400c8b0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f6687a2f000 1 -- 172.21.15.5:0/2024201514 shutdown_connections 2023-07-14T13:06:12.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f6687a2f000 1 --2- 172.21.15.5:0/2024201514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5586fbf86930 0x5586fbf86d00 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f6687a2f000 1 --2- 172.21.15.5:0/2024201514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586fbfd0890 0x5586fbf863f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f6687a2f000 1 --2- 172.21.15.5:0/2024201514 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5586fbfcff80 0x5586fbfd0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f6687a2f000 1 -- 172.21.15.5:0/2024201514 >> 172.21.15.5:0/2024201514 conn(0x5586fbf8ca90 msgr2=0x5586fbf84cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:12.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f6687a2f000 1 -- 172.21.15.5:0/2024201514 shutdown_connections 2023-07-14T13:06:12.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f6687a2f000 1 -- 172.21.15.5:0/2024201514 wait complete. 2023-07-14T13:06:12.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f6687a2f000 1 -- start start 2023-07-14T13:06:12.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f6687a2f000 1 Processor -- start 2023-07-14T13:06:12.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f6687a2f000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586fbf86930 0x5586fbfd70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:12.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f6687a2f000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5586fbfcff80 0x5586fbfd75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:12.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f6687a2f000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5586fbfd0890 0x5586fbf91570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:12.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f6687a2f000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586fbdd4400 con 0x5586fbfcff80 2023-07-14T13:06:12.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f6687a2f000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586fbd90b60 con 0x5586fbf86930 2023-07-14T13:06:12.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f6687a2f000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586fbd90800 con 0x5586fbfd0890 2023-07-14T13:06:12.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f6687a2f000 10 client.0 _ll_register_callbacks cb 0x5586fbf722c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:06:12.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.222+0000 7f6681c73640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5586fbfcff80 0x5586fbfd75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:12.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6682c75640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5586fbfd0890 0x5586fbf91570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:12.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6682c75640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5586fbfd0890 0x5586fbf91570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:58306/0 (socket says 172.21.15.5:58306) 2023-07-14T13:06:12.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6682c75640 1 -- 172.21.15.5:0/1374415587 learned_addr learned my addr 172.21.15.5:0/1374415587 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:12.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6682474640 1 --2- 172.21.15.5:0/1374415587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586fbf86930 0x5586fbfd70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:12.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6681c73640 1 -- 172.21.15.5:0/1374415587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5586fbfd0890 msgr2=0x5586fbf91570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:12.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6681c73640 1 --2- 172.21.15.5:0/1374415587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5586fbfd0890 0x5586fbf91570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6681c73640 1 -- 172.21.15.5:0/1374415587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586fbf86930 msgr2=0x5586fbfd70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:12.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6681c73640 1 --2- 172.21.15.5:0/1374415587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586fbf86930 0x5586fbfd70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6681c73640 1 -- 172.21.15.5:0/1374415587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6674009bd0 con 0x5586fbfcff80 2023-07-14T13:06:12.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6682c75640 1 --2- 172.21.15.5:0/1374415587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5586fbfd0890 0x5586fbf91570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:06:12.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6681c73640 1 --2- 172.21.15.5:0/1374415587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5586fbfcff80 0x5586fbfd75f0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f666c081600 tx=0x7f666c05c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a15bcb7e9f6a2d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:12.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f665d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-07-14T13:06:12.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f665d7fa640 1 -- 172.21.15.5:0/1374415587 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c083270 con 0x5586fbfcff80 2023-07-14T13:06:12.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6687a2f000 1 -- 172.21.15.5:0/1374415587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5586fbd9baa0 con 0x5586fbfcff80 2023-07-14T13:06:12.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f665d7fa640 1 -- 172.21.15.5:0/1374415587 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f666c05c2d0 con 0x5586fbfcff80 2023-07-14T13:06:12.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f665d7fa640 1 -- 172.21.15.5:0/1374415587 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f666c05c490 con 0x5586fbfcff80 2023-07-14T13:06:12.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6687a2f000 10 client.6219 fetch_fsmap learned FSMap version 24 2023-07-14T13:06:12.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6687a2f000 1 -- 172.21.15.5:0/1374415587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x5586fbd98d90 con 0x5586fbfcff80 2023-07-14T13:06:12.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f665d7fa640 1 -- 172.21.15.5:0/1374415587 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5586fbd9baa0 con 0x5586fbfcff80 2023-07-14T13:06:12.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f665d7fa640 1 -- 172.21.15.5:0/1374415587 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 24) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f666c081280 con 0x5586fbfcff80 2023-07-14T13:06:12.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6687a2f000 10 client.6219 fetch_fsmap finished waiting for FSMap version 24 2023-07-14T13:06:12.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6687a2f000 10 client.6219 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T13:06:12.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6687a2f000 20 client.6219 populate_metadata read hostname 'smithi005' 2023-07-14T13:06:12.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6687a2f000 1 --2- 172.21.15.5:0/1374415587 >> [v2:172.21.15.5:6833/231396012,v1:172.21.15.5:6835/231396012] conn(0x5586fbf92310 0x5586fbf926e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:12.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6687a2f000 4 client.6219 mds_command: new command op to 6036 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:06:12.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6687a2f000 1 -- 172.21.15.5:0/1374415587 --> [v2:172.21.15.5:6833/231396012,v1:172.21.15.5:6835/231396012] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5586fbe02f40 con 0x5586fbf92310 2023-07-14T13:06:12.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6682474640 1 --2- 172.21.15.5:0/1374415587 >> [v2:172.21.15.5:6833/231396012,v1:172.21.15.5:6835/231396012] conn(0x5586fbf92310 0x5586fbf926e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:12.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6682474640 1 --2- 172.21.15.5:0/1374415587 >> [v2:172.21.15.5:6833/231396012,v1:172.21.15.5:6835/231396012] conn(0x5586fbf92310 0x5586fbf926e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c5b8e116c2c6113 server_cookie=3401b9116a342c34 in_seq=0 out_seq=0 2023-07-14T13:06:12.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f665d7fa640 10 client.6219 ms_handle_connect on v2:172.21.15.5:6833/231396012 2023-07-14T13:06:12.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f665d7fa640 1 -- 172.21.15.5:0/1374415587 <== mds.0 v2:172.21.15.5:6833/231396012 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5586fbe02f40 con 0x5586fbf92310 2023-07-14T13:06:12.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f665d7fa640 10 client.6219 handle_command_reply: tid=0 2023-07-14T13:06:12.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6687a2f000 1 client.6219 shutdown 2023-07-14T13:06:12.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6687a2f000 1 -- 172.21.15.5:0/1374415587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5586fbfcff80 msgr2=0x5586fbfd75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:12.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6687a2f000 1 --2- 172.21.15.5:0/1374415587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5586fbfcff80 0x5586fbfd75f0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f666c081600 tx=0x7f666c05c820 comp rx=0 tx=0).stop 2023-07-14T13:06:12.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6687a2f000 1 -- 172.21.15.5:0/1374415587 shutdown_connections 2023-07-14T13:06:12.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6687a2f000 1 --2- 172.21.15.5:0/1374415587 >> [v2:172.21.15.5:6833/231396012,v1:172.21.15.5:6835/231396012] conn(0x5586fbf92310 0x5586fbf926e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6687a2f000 1 --2- 172.21.15.5:0/1374415587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5586fbfd0890 0x5586fbf91570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6687a2f000 1 --2- 172.21.15.5:0/1374415587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5586fbfcff80 0x5586fbfd75f0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6687a2f000 1 --2- 172.21.15.5:0/1374415587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586fbf86930 0x5586fbfd70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f665d7fa640 0 client.6219 ms_handle_reset on v2:172.21.15.5:6833/231396012 2023-07-14T13:06:12.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6687a2f000 1 -- 172.21.15.5:0/1374415587 >> 172.21.15.5:0/1374415587 conn(0x5586fbf8ca90 msgr2=0x5586fbf853d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:12.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6687a2f000 1 -- 172.21.15.5:0/1374415587 shutdown_connections 2023-07-14T13:06:12.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6687a2f000 1 -- 172.21.15.5:0/1374415587 wait complete. 2023-07-14T13:06:12.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.226+0000 7f6687a2f000 20 client.6219 trim_cache size 0 max 16384 2023-07-14T13:06:12.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.242+0000 7f6687a2f000 1 Processor -- start 2023-07-14T13:06:12.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.242+0000 7f6687a2f000 1 -- start start 2023-07-14T13:06:12.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6687a2f000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586fbf86930 0x5586fc029730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:12.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6687a2f000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5586fbfcff80 0x5586fc029c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:12.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6687a2f000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5586fbfd0890 0x5586fc02a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:12.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6687a2f000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586fba91940 con 0x5586fbfcff80 2023-07-14T13:06:12.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6687a2f000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586fbfdd130 con 0x5586fbf86930 2023-07-14T13:06:12.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6687a2f000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586fbd926f0 con 0x5586fbfd0890 2023-07-14T13:06:12.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6681c73640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5586fbfcff80 0x5586fc029c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:12.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6681c73640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5586fbfcff80 0x5586fc029c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52266/0 (socket says 172.21.15.5:52266) 2023-07-14T13:06:12.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6681c73640 1 -- 172.21.15.5:0/2482004621 learned_addr learned my addr 172.21.15.5:0/2482004621 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:12.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6682c75640 1 --2- 172.21.15.5:0/2482004621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5586fbfd0890 0x5586fc02a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:12.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6682474640 1 --2- 172.21.15.5:0/2482004621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586fbf86930 0x5586fc029730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:12.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6681c73640 1 -- 172.21.15.5:0/2482004621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5586fbfd0890 msgr2=0x5586fc02a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:12.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6681c73640 1 --2- 172.21.15.5:0/2482004621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5586fbfd0890 0x5586fc02a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6681c73640 1 -- 172.21.15.5:0/2482004621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586fbf86930 msgr2=0x5586fc029730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:12.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6681c73640 1 --2- 172.21.15.5:0/2482004621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586fbf86930 0x5586fc029730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6681c73640 1 -- 172.21.15.5:0/2482004621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586fbf89000 con 0x5586fbfcff80 2023-07-14T13:06:12.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6681c73640 1 --2- 172.21.15.5:0/2482004621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5586fbfcff80 0x5586fc029c70 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f666c0543a0 tx=0x7f666c083000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4662a236d186160c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:12.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6670ff9640 1 -- 172.21.15.5:0/2482004621 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c083270 con 0x5586fbfcff80 2023-07-14T13:06:12.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6670ff9640 1 -- 172.21.15.5:0/2482004621 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c0583d0 con 0x5586fbfcff80 2023-07-14T13:06:12.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6670ff9640 1 -- 172.21.15.5:0/2482004621 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c05c2d0 con 0x5586fbfcff80 2023-07-14T13:06:12.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6687a2f000 1 -- 172.21.15.5:0/2482004621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5586fbfcff80 msgr2=0x5586fc029c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:12.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6687a2f000 1 --2- 172.21.15.5:0/2482004621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5586fbfcff80 0x5586fc029c70 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f666c0543a0 tx=0x7f666c083000 comp rx=0 tx=0).stop 2023-07-14T13:06:12.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6687a2f000 1 -- 172.21.15.5:0/2482004621 shutdown_connections 2023-07-14T13:06:12.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6687a2f000 1 --2- 172.21.15.5:0/2482004621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5586fbfd0890 0x5586fc02a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6687a2f000 1 --2- 172.21.15.5:0/2482004621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5586fbfcff80 0x5586fc029c70 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6687a2f000 1 --2- 172.21.15.5:0/2482004621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586fbf86930 0x5586fc029730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6687a2f000 1 -- 172.21.15.5:0/2482004621 >> 172.21.15.5:0/2482004621 conn(0x5586fbf8ca90 msgr2=0x5586fbf8b960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:12.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6687a2f000 1 -- 172.21.15.5:0/2482004621 shutdown_connections 2023-07-14T13:06:12.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6687a2f000 1 -- 172.21.15.5:0/2482004621 wait complete. 2023-07-14T13:06:12.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6687a2f000 1 -- start start 2023-07-14T13:06:12.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.246+0000 7f6687a2f000 1 Processor -- start 2023-07-14T13:06:12.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6687a2f000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586fbf86930 0x5586fbfd3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:12.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6687a2f000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5586fbfcff80 0x5586fbfd4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:12.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6687a2f000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5586fbfd0890 0x5586fbfd48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:12.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6687a2f000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586fbd71b00 con 0x5586fbfd0890 2023-07-14T13:06:12.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6687a2f000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586fbdd6f60 con 0x5586fbf86930 2023-07-14T13:06:12.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6687a2f000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586fbfdd6d0 con 0x5586fbfcff80 2023-07-14T13:06:12.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6687a2f000 10 client.0 _ll_register_callbacks cb 0x5586fbf524b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:06:12.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6681c73640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5586fbfcff80 0x5586fbfd4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:12.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6682474640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586fbf86930 0x5586fbfd3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:12.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6682474640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586fbf86930 0x5586fbfd3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:37414/0 (socket says 172.21.15.5:37414) 2023-07-14T13:06:12.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6681c73640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5586fbfcff80 0x5586fbfd4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:58314/0 (socket says 172.21.15.5:58314) 2023-07-14T13:06:12.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6682474640 1 -- 172.21.15.5:0/157733474 learned_addr learned my addr 172.21.15.5:0/157733474 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:12.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6682c75640 1 --2- 172.21.15.5:0/157733474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5586fbfd0890 0x5586fbfd48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:12.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6682474640 1 -- 172.21.15.5:0/157733474 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5586fbfcff80 msgr2=0x5586fbfd4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:12.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6682474640 1 --2- 172.21.15.5:0/157733474 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5586fbfcff80 0x5586fbfd4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6682474640 1 -- 172.21.15.5:0/157733474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5586fbfd0890 msgr2=0x5586fbfd48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:12.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6682474640 1 --2- 172.21.15.5:0/157733474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5586fbfd0890 0x5586fbfd48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6682474640 1 -- 172.21.15.5:0/157733474 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5586fbd98d90 con 0x5586fbf86930 2023-07-14T13:06:12.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6682474640 1 --2- 172.21.15.5:0/157733474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586fbf86930 0x5586fbfd3e30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f667801c490 tx=0x7f66780046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dbe6dad8b2c1e76 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:12.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f665d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-07-14T13:06:12.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f665d7fa640 1 -- 172.21.15.5:0/157733474 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66780c6040 con 0x5586fbf86930 2023-07-14T13:06:12.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6687a2f000 1 -- 172.21.15.5:0/157733474 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5586fbdd2d50 con 0x5586fbf86930 2023-07-14T13:06:12.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f665d7fa640 1 -- 172.21.15.5:0/157733474 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f66780cd960 con 0x5586fbf86930 2023-07-14T13:06:12.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f665d7fa640 1 -- 172.21.15.5:0/157733474 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66780cd620 con 0x5586fbf86930 2023-07-14T13:06:12.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6687a2f000 10 client.6031 fetch_fsmap learned FSMap version 24 2023-07-14T13:06:12.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6687a2f000 1 -- 172.21.15.5:0/157733474 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x5586fbd7f020 con 0x5586fbf86930 2023-07-14T13:06:12.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f665d7fa640 1 -- 172.21.15.5:0/157733474 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5586fbdd2d50 con 0x5586fbf86930 2023-07-14T13:06:12.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f665d7fa640 1 -- 172.21.15.5:0/157733474 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 24) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f66780cdb20 con 0x5586fbf86930 2023-07-14T13:06:12.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6687a2f000 10 client.6031 fetch_fsmap finished waiting for FSMap version 24 2023-07-14T13:06:12.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6687a2f000 10 client.6031 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T13:06:12.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6687a2f000 20 client.6031 populate_metadata read hostname 'smithi005' 2023-07-14T13:06:12.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6687a2f000 1 --2- 172.21.15.5:0/157733474 >> [v2:172.21.15.5:6833/231396012,v1:172.21.15.5:6835/231396012] conn(0x5586fc0339b0 0x5586fc035d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:12.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6687a2f000 4 client.6031 mds_command: new command op to 6036 tid=0[{"prefix": "status"}] 2023-07-14T13:06:12.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6687a2f000 1 -- 172.21.15.5:0/157733474 --> [v2:172.21.15.5:6833/231396012,v1:172.21.15.5:6835/231396012] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5586fbdcd3e0 con 0x5586fc0339b0 2023-07-14T13:06:12.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6681c73640 1 --2- 172.21.15.5:0/157733474 >> [v2:172.21.15.5:6833/231396012,v1:172.21.15.5:6835/231396012] conn(0x5586fc0339b0 0x5586fc035d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:12.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6681c73640 1 --2- 172.21.15.5:0/157733474 >> [v2:172.21.15.5:6833/231396012,v1:172.21.15.5:6835/231396012] conn(0x5586fc0339b0 0x5586fc035d90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94e3a77d8886070b server_cookie=24eb41628e76f724 in_seq=0 out_seq=0 2023-07-14T13:06:12.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f665d7fa640 10 client.6031 ms_handle_connect on v2:172.21.15.5:6833/231396012 2023-07-14T13:06:12.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f665d7fa640 1 -- 172.21.15.5:0/157733474 <== mds.0 v2:172.21.15.5:6833/231396012 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x5586fbdcd3e0 con 0x5586fc0339b0 2023-07-14T13:06:12.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f665d7fa640 10 client.6031 handle_command_reply: tid=0 2023-07-14T13:06:12.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6687a2f000 1 client.6031 shutdown 2023-07-14T13:06:12.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6687a2f000 1 -- 172.21.15.5:0/157733474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586fbf86930 msgr2=0x5586fbfd3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:12.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.250+0000 7f6687a2f000 1 --2- 172.21.15.5:0/157733474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586fbf86930 0x5586fbfd3e30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f667801c490 tx=0x7f66780046d0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.254+0000 7f6687a2f000 1 -- 172.21.15.5:0/157733474 shutdown_connections 2023-07-14T13:06:12.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.254+0000 7f6687a2f000 1 --2- 172.21.15.5:0/157733474 >> [v2:172.21.15.5:6833/231396012,v1:172.21.15.5:6835/231396012] conn(0x5586fc0339b0 0x5586fc035d90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.254+0000 7f6687a2f000 1 --2- 172.21.15.5:0/157733474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5586fbfd0890 0x5586fbfd48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.254+0000 7f6687a2f000 1 --2- 172.21.15.5:0/157733474 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5586fbfcff80 0x5586fbfd4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.254+0000 7f6687a2f000 1 --2- 172.21.15.5:0/157733474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5586fbf86930 0x5586fbfd3e30 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.254+0000 7f665d7fa640 0 client.6031 ms_handle_reset on v2:172.21.15.5:6833/231396012 2023-07-14T13:06:12.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.254+0000 7f6687a2f000 1 -- 172.21.15.5:0/157733474 >> 172.21.15.5:0/157733474 conn(0x5586fbf8ca90 msgr2=0x5586fbf8c060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:12.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.254+0000 7f6687a2f000 1 -- 172.21.15.5:0/157733474 shutdown_connections 2023-07-14T13:06:12.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.254+0000 7f6687a2f000 1 -- 172.21.15.5:0/157733474 wait complete. 2023-07-14T13:06:12.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.254+0000 7f6687a2f000 20 client.6031 trim_cache size 0 max 16384 2023-07-14T13:06:12.291 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T13:06:12.291 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "22affb8d-e389-40f8-a764-dd40eb1759c8", 2023-07-14T13:06:12.291 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-07-14T13:06:12.291 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 6036, 2023-07-14T13:06:12.291 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-07-14T13:06:12.291 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-07-14T13:06:12.291 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-07-14T13:06:12.292 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 10.486756288, 2023-07-14T13:06:12.292 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 24, 2023-07-14T13:06:12.292 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 65, 2023-07-14T13:06:12.292 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 65, 2023-07-14T13:06:12.292 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 16.398287222 2023-07-14T13:06:12.292 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T13:06:12.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.254+0000 7f66846d8640 1 -- 172.21.15.5:0/678372463 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f66600663a0 msgr2=0x7f6660068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:12.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.254+0000 7f66846d8640 1 --2- 172.21.15.5:0/678372463 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f66600663a0 0x7f6660068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f66780af000 tx=0x7f66780a7000 comp rx=0 tx=0).stop 2023-07-14T13:06:12.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.254+0000 7f66846d8640 1 -- 172.21.15.5:0/678372463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f667c06e160 msgr2=0x7f667c13f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:12.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.254+0000 7f66846d8640 1 --2- 172.21.15.5:0/678372463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f667c06e160 0x7f667c13f340 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f666c0011f0 tx=0x7f666c00c9b0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.254+0000 7f66846d8640 1 -- 172.21.15.5:0/678372463 shutdown_connections 2023-07-14T13:06:12.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.254+0000 7f66846d8640 1 --2- 172.21.15.5:0/678372463 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f66600663a0 0x7f6660068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.254+0000 7f66846d8640 1 --2- 172.21.15.5:0/678372463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f667c0ae1f0 0x7f667c15c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.254+0000 7f66846d8640 1 --2- 172.21.15.5:0/678372463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f667c06e160 0x7f667c13f340 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.254+0000 7f66846d8640 1 --2- 172.21.15.5:0/678372463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f667c06c430 0x7f667c160020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.254+0000 7f66846d8640 1 -- 172.21.15.5:0/678372463 >> 172.21.15.5:0/678372463 conn(0x7f667c0b1300 msgr2=0x7f667c0ac990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:12.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.254+0000 7f66846d8640 1 -- 172.21.15.5:0/678372463 shutdown_connections 2023-07-14T13:06:12.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.254+0000 7f66846d8640 1 -- 172.21.15.5:0/678372463 wait complete. 2023-07-14T13:06:12.304 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T13:06:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.418+0000 7f86a1c31640 1 Processor -- start 2023-07-14T13:06:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.418+0000 7f86a1c31640 1 -- start start 2023-07-14T13:06:12.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.418+0000 7f86a1c31640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f869c06c0b0 0x7f869c0b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:12.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.418+0000 7f86a1c31640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f869c0b28a0 con 0x7f869c0b20b0 2023-07-14T13:06:12.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.418+0000 7f86a1c31640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f869c1604a0 con 0x7f869c15b9a0 2023-07-14T13:06:12.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.418+0000 7f86a1c31640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f869c15f6e0 con 0x7f869c06c0b0 2023-07-14T13:06:12.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.418+0000 7f86a1430640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f869c0b20b0 0x7f869c06a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47622/0 (socket says 172.21.15.5:47622) 2023-07-14T13:06:12.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.418+0000 7f86a1430640 1 -- 172.21.15.5:0/1887059684 learned_addr learned my addr 172.21.15.5:0/1887059684 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:06:12.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.418+0000 7f869bfff640 1 --2- 172.21.15.5:0/1887059684 >> v2:172.21.15.154:3300/0 conn(0x7f869c06c0b0 0x7f869c0b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:12.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.418+0000 7f869b7fe640 1 -- 172.21.15.5:0/1887059684 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2088624430 0 0) 0x7f869c0b28a0 con 0x7f869c0b20b0 2023-07-14T13:06:12.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.418+0000 7f869b7fe640 1 -- 172.21.15.5:0/1887059684 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f868c003530 con 0x7f869c0b20b0 2023-07-14T13:06:12.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.418+0000 7f869b7fe640 1 -- 172.21.15.5:0/1887059684 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 956886165 0 0) 0x7f868c003530 con 0x7f869c0b20b0 2023-07-14T13:06:12.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.418+0000 7f869bfff640 1 -- 172.21.15.5:0/1887059684 >> v1:172.21.15.154:6789/0 conn(0x7f869c15b9a0 legacy=0x7f869c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:12.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.418+0000 7f869bfff640 1 -- 172.21.15.5:0/1887059684 >> v1:172.21.15.5:6789/0 conn(0x7f869c0b20b0 legacy=0x7f869c06a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:12.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.418+0000 7f869bfff640 1 -- 172.21.15.5:0/1887059684 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869c15f9c0 con 0x7f869c06c0b0 2023-07-14T13:06:12.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.422+0000 7f869bfff640 1 --2- 172.21.15.5:0/1887059684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f869c06c0b0 0x7f869c0b1b70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f86880097c0 tx=0x7f868801c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=672fb5533d96dd6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:12.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.422+0000 7f869b7fe640 1 -- 172.21.15.5:0/1887059684 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8694001a00 con 0x7f869c06c0b0 2023-07-14T13:06:12.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.422+0000 7f869b7fe640 1 -- 172.21.15.5:0/1887059684 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86880a7050 con 0x7f869c06c0b0 2023-07-14T13:06:12.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.422+0000 7f869b7fe640 1 -- 172.21.15.5:0/1887059684 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86880ab620 con 0x7f869c06c0b0 2023-07-14T13:06:12.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.422+0000 7f86a1c31640 1 -- 172.21.15.5:0/1887059684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f869c06c0b0 msgr2=0x7f869c0b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:12.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.422+0000 7f86a1c31640 1 --2- 172.21.15.5:0/1887059684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f869c06c0b0 0x7f869c0b1b70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f86880097c0 tx=0x7f868801c2e0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.422+0000 7f86a1c31640 1 -- 172.21.15.5:0/1887059684 shutdown_connections 2023-07-14T13:06:12.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.422+0000 7f86a1c31640 1 --2- 172.21.15.5:0/1887059684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f869c06c0b0 0x7f869c0b1b70 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.422+0000 7f86a1c31640 1 -- 172.21.15.5:0/1887059684 >> 172.21.15.5:0/1887059684 conn(0x7f869c0cffa0 msgr2=0x7f869c0d03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:12.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.422+0000 7f86a1c31640 1 -- 172.21.15.5:0/1887059684 shutdown_connections 2023-07-14T13:06:12.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.422+0000 7f86a1c31640 1 -- 172.21.15.5:0/1887059684 wait complete. 2023-07-14T13:06:12.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.426+0000 7f86a1c31640 1 Processor -- start 2023-07-14T13:06:12.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.426+0000 7f86a1c31640 1 -- start start 2023-07-14T13:06:12.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.426+0000 7f86a1c31640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f869c06c0b0 0x7f869c1460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:12.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.426+0000 7f86a1c31640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f869c0b20b0 0x7f869c0cf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:12.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.426+0000 7f86a1c31640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f869c15b9a0 0x7f869c0cf930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:12.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.426+0000 7f86a1c31640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869c0c3ab0 con 0x7f869c0b20b0 2023-07-14T13:06:12.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.426+0000 7f86a1c31640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869c0c27c0 con 0x7f869c06c0b0 2023-07-14T13:06:12.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.426+0000 7f86a1c31640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f869c0c2aa0 con 0x7f869c15b9a0 2023-07-14T13:06:12.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.426+0000 7f869bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f869c0b20b0 0x7f869c0cf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:12.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.426+0000 7f869bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f869c0b20b0 0x7f869c0cf3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52278/0 (socket says 172.21.15.5:52278) 2023-07-14T13:06:12.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.426+0000 7f869bfff640 1 -- 172.21.15.5:0/2043552057 learned_addr learned my addr 172.21.15.5:0/2043552057 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:12.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.426+0000 7f86a1430640 1 --2- 172.21.15.5:0/2043552057 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f869c15b9a0 0x7f869c0cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:12.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.426+0000 7f86a0c2f640 1 --2- 172.21.15.5:0/2043552057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f869c06c0b0 0x7f869c1460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:12.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.426+0000 7f869bfff640 1 -- 172.21.15.5:0/2043552057 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f869c15b9a0 msgr2=0x7f869c0cf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:12.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.426+0000 7f869bfff640 1 --2- 172.21.15.5:0/2043552057 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f869c15b9a0 0x7f869c0cf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.426+0000 7f869bfff640 1 -- 172.21.15.5:0/2043552057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f869c06c0b0 msgr2=0x7f869c1460d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:12.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.426+0000 7f869bfff640 1 --2- 172.21.15.5:0/2043552057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f869c06c0b0 0x7f869c1460d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.426+0000 7f869bfff640 1 -- 172.21.15.5:0/2043552057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8688009420 con 0x7f869c0b20b0 2023-07-14T13:06:12.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.426+0000 7f86a1430640 1 --2- 172.21.15.5:0/2043552057 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f869c15b9a0 0x7f869c0cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:06:12.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.426+0000 7f86a0c2f640 1 --2- 172.21.15.5:0/2043552057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f869c06c0b0 0x7f869c1460d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:06:12.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.426+0000 7f869bfff640 1 --2- 172.21.15.5:0/2043552057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f869c0b20b0 0x7f869c0cf3f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f86880ae040 tx=0x7f8688019080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:12.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.426+0000 7f86997fa640 1 -- 172.21.15.5:0/2043552057 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8688004020 con 0x7f869c0b20b0 2023-07-14T13:06:12.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.426+0000 7f86997fa640 1 -- 172.21.15.5:0/2043552057 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8688004180 con 0x7f869c0b20b0 2023-07-14T13:06:12.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.426+0000 7f86997fa640 1 -- 172.21.15.5:0/2043552057 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86880044f0 con 0x7f869c0b20b0 2023-07-14T13:06:12.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.426+0000 7f86a1c31640 1 -- 172.21.15.5:0/2043552057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f869c0c2d80 con 0x7f869c0b20b0 2023-07-14T13:06:12.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.426+0000 7f86a1c31640 1 -- 172.21.15.5:0/2043552057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f869c146610 con 0x7f869c0b20b0 2023-07-14T13:06:12.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.426+0000 7f86a1c31640 1 -- 172.21.15.5:0/2043552057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f869c0678d0 con 0x7f869c0b20b0 2023-07-14T13:06:12.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.430+0000 7f86997fa640 1 -- 172.21.15.5:0/2043552057 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f86880b2040 con 0x7f869c0b20b0 2023-07-14T13:06:12.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.430+0000 7f86997fa640 1 --2- 172.21.15.5:0/2043552057 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f86800663a0 0x7f8680068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:12.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.430+0000 7f86997fa640 1 -- 172.21.15.5:0/2043552057 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f868811dd10 con 0x7f869c0b20b0 2023-07-14T13:06:12.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.430+0000 7f86a0c2f640 1 --2- 172.21.15.5:0/2043552057 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f86800663a0 0x7f8680068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:12.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.430+0000 7f86a0c2f640 1 --2- 172.21.15.5:0/2043552057 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f86800663a0 0x7f8680068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8690000f70 tx=0x7f8690009040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:12.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.434+0000 7f86997fa640 1 -- 172.21.15.5:0/2043552057 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f8688123020 con 0x7f869c0b20b0 2023-07-14T13:06:12.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.626+0000 7f86a1c31640 1 -- 172.21.15.5:0/2043552057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f869c158c60 con 0x7f869c0b20b0 2023-07-14T13:06:12.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.626+0000 7f86997fa640 1 -- 172.21.15.5:0/2043552057 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7f86880eb070 con 0x7f869c0b20b0 2023-07-14T13:06:12.657 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T13:06:12.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.626+0000 7f86a1c31640 1 -- 172.21.15.5:0/2043552057 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f86800663a0 msgr2=0x7f8680068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:12.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.626+0000 7f86a1c31640 1 --2- 172.21.15.5:0/2043552057 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f86800663a0 0x7f8680068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8690000f70 tx=0x7f8690009040 comp rx=0 tx=0).stop 2023-07-14T13:06:12.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.626+0000 7f86a1c31640 1 -- 172.21.15.5:0/2043552057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f869c0b20b0 msgr2=0x7f869c0cf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:12.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.626+0000 7f86a1c31640 1 --2- 172.21.15.5:0/2043552057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f869c0b20b0 0x7f869c0cf3f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f86880ae040 tx=0x7f8688019080 comp rx=0 tx=0).stop 2023-07-14T13:06:12.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.626+0000 7f86a1c31640 1 -- 172.21.15.5:0/2043552057 shutdown_connections 2023-07-14T13:06:12.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.626+0000 7f86a1c31640 1 --2- 172.21.15.5:0/2043552057 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f86800663a0 0x7f8680068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.626+0000 7f86a1c31640 1 --2- 172.21.15.5:0/2043552057 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f869c15b9a0 0x7f869c0cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.626+0000 7f86a1c31640 1 --2- 172.21.15.5:0/2043552057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f869c0b20b0 0x7f869c0cf3f0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.626+0000 7f86a1c31640 1 --2- 172.21.15.5:0/2043552057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f869c06c0b0 0x7f869c1460d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:12.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.626+0000 7f86a1c31640 1 -- 172.21.15.5:0/2043552057 >> 172.21.15.5:0/2043552057 conn(0x7f869c0cffa0 msgr2=0x7f869c158fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:12.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.626+0000 7f86a1c31640 1 -- 172.21.15.5:0/2043552057 shutdown_connections 2023-07-14T13:06:12.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:12.626+0000 7f86a1c31640 1 -- 172.21.15.5:0/2043552057 wait complete. 2023-07-14T13:06:12.678 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-14T13:06:12.678 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T13:06:12.679 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-07-14T13:06:12.680 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-14T13:06:12.680 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-14T13:06:12.681 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-14T13:06:12.681 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-14T13:06:12.681 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T13:06:12.681 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T13:06:12.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:12.683 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-07-14T13:06:12.693 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T13:06:12.693 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T13:06:12.693 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T13:06:12.693 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:06:12.693 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-07-14T13:06:12.693 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:06:12.694 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T13:06:12.694 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-07-14T13:06:12.694 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2023-07-14T13:06:12.694 INFO:teuthology.orchestra.run.smithi005.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T13:06:12.694 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-07-14T13:06:12.694 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2023-07-14T13:06:12.694 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-14T13:06:12.694 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 41544sec preferred_lft 41544sec 2023-07-14T13:06:12.695 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-07-14T13:06:12.695 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:06:12.695 INFO:teuthology.orchestra.run.smithi005.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T13:06:12.695 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-07-14T13:06:12.695 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2023-07-14T13:06:12.695 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T13:06:12.695 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-07-14T13:06:12.695 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2023-07-14T13:06:12.696 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-14T13:06:12.696 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:96:b6:fb:c6 brd ff:ff:ff:ff:ff:ff 2023-07-14T13:06:12.696 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-14T13:06:12.696 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:06:12.696 INFO:teuthology.orchestra.run.smithi005.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T13:06:12.696 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-14T13:06:12.696 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T13:06:12.697 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:06:12.697 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-14T13:06:12.697 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:06:12.697 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T13:06:12.697 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T13:06:12.697 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-14T13:06:12.698 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:06:12.698 INFO:teuthology.orchestra.run.smithi005.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T13:06:12.698 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-14T13:06:12.698 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-14T13:06:12.698 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:06:12.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:12.699 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T13:06:12.767 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-07-14T13:06:12.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:12.769 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-07-14T13:06:12.821 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-07-14T13:06:12.821 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T13:06:12.821 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-14T13:06:12.821 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-14T13:06:12.822 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-14T13:06:12.822 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T13:06:12.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:12.822 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-07-14T13:06:12.823 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-07-14T13:06:12.823 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-14T13:06:12.823 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-14T13:06:12.824 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-14T13:06:12.824 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-07-14T13:06:12.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:12.922 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-07-14T13:06:12.931 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-14T13:06:12.931 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-14T13:06:12.932 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T13:06:12.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:12.933 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-07-14T13:06:13.000 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T13:06:13.001 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-14T13:06:13.052 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-14T13:06:13.052 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T13:06:13.053 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-14T13:06:13.107 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-14T13:06:13.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:13.107 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:06:13.198 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:06:13.199 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T13:06:13.199 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T13:06:13.214 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:06:13.214 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T13:06:13.215 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T13:06:13.215 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T13:06:13.215 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T13:06:13.222 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:06:13.222 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T13:06:13.222 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T13:06:13.223 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T13:06:13.223 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T13:06:13.223 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790" 2023-07-14T13:06:13.223 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790:/ 2023-07-14T13:06:13.223 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=22affb8d-e389-40f8-a764-dd40eb1759c8" will pass to kernel 2023-07-14T13:06:13.226 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T13:06:13.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:13.227 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-14T13:06:13.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:13.249 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T13:06:13.307 INFO:teuthology.orchestra.run.smithi005.stdout:client6043 2023-07-14T13:06:13.308 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:06:13.308 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:06:13.359 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-14T13:06:13.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.514+0000 7fe93cffa640 1 Processor -- start 2023-07-14T13:06:13.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.514+0000 7fe93cffa640 1 -- start start 2023-07-14T13:06:13.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.518+0000 7fe93cffa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe938158ce0 0x7fe938070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:13.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.518+0000 7fe93cffa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9380c8ad0 0x7fe9380c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:13.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.518+0000 7fe93cffa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe9380c9560 0x7fe9380cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:13.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.518+0000 7fe93cffa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9380c99e0 con 0x7fe938158ce0 2023-07-14T13:06:13.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.518+0000 7fe93cffa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9380cc700 con 0x7fe9380c9560 2023-07-14T13:06:13.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.518+0000 7fe93cffa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9380b0ff0 con 0x7fe9380c8ad0 2023-07-14T13:06:13.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.518+0000 7fe93659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe938158ce0 0x7fe938070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:13.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.518+0000 7fe93659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe938158ce0 0x7fe938070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52292/0 (socket says 172.21.15.5:52292) 2023-07-14T13:06:13.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.518+0000 7fe93659c640 1 -- 172.21.15.5:0/1731397576 learned_addr learned my addr 172.21.15.5:0/1731397576 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:13.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.518+0000 7fe935d9b640 1 --2- 172.21.15.5:0/1731397576 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9380c8ad0 0x7fe9380c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:13.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.518+0000 7fe936d9d640 1 --2- 172.21.15.5:0/1731397576 >> v2:172.21.15.154:3300/0 conn(0x7fe9380c9560 0x7fe9380cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:13.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.518+0000 7fe93659c640 1 -- 172.21.15.5:0/1731397576 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9380c8ad0 msgr2=0x7fe9380c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:13.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.518+0000 7fe93659c640 1 --2- 172.21.15.5:0/1731397576 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9380c8ad0 0x7fe9380c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:13.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.518+0000 7fe93659c640 1 -- 172.21.15.5:0/1731397576 >> v2:172.21.15.154:3300/0 conn(0x7fe9380c9560 msgr2=0x7fe9380cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:13.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.518+0000 7fe93659c640 1 --2- 172.21.15.5:0/1731397576 >> v2:172.21.15.154:3300/0 conn(0x7fe9380c9560 0x7fe9380cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:13.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.518+0000 7fe93659c640 1 -- 172.21.15.5:0/1731397576 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe938070c80 con 0x7fe938158ce0 2023-07-14T13:06:13.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.518+0000 7fe936d9d640 1 --2- 172.21.15.5:0/1731397576 >> v2:172.21.15.154:3300/0 conn(0x7fe9380c9560 0x7fe9380cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:06:13.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.522+0000 7fe93659c640 1 --2- 172.21.15.5:0/1731397576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe938158ce0 0x7fe938070450 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fe9380c17e0 tx=0x7fe92801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb2074ffb345ac6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:13.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.522+0000 7fe93559a640 1 -- 172.21.15.5:0/1731397576 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9280ab600 con 0x7fe938158ce0 2023-07-14T13:06:13.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.522+0000 7fe93559a640 1 -- 172.21.15.5:0/1731397576 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9280a7050 con 0x7fe938158ce0 2023-07-14T13:06:13.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.522+0000 7fe93559a640 1 -- 172.21.15.5:0/1731397576 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9280ab980 con 0x7fe938158ce0 2023-07-14T13:06:13.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.522+0000 7fe93cffa640 1 -- 172.21.15.5:0/1731397576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe938158ce0 msgr2=0x7fe938070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:13.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.522+0000 7fe93cffa640 1 --2- 172.21.15.5:0/1731397576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe938158ce0 0x7fe938070450 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fe9380c17e0 tx=0x7fe92801c3b0 comp rx=0 tx=0).stop 2023-07-14T13:06:13.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.522+0000 7fe93cffa640 1 -- 172.21.15.5:0/1731397576 shutdown_connections 2023-07-14T13:06:13.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.522+0000 7fe93cffa640 1 --2- 172.21.15.5:0/1731397576 >> v2:172.21.15.154:3300/0 conn(0x7fe9380c9560 0x7fe9380cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:13.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.522+0000 7fe93cffa640 1 --2- 172.21.15.5:0/1731397576 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9380c8ad0 0x7fe9380c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:13.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.522+0000 7fe93cffa640 1 --2- 172.21.15.5:0/1731397576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe938158ce0 0x7fe938070450 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:13.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.522+0000 7fe93cffa640 1 -- 172.21.15.5:0/1731397576 >> 172.21.15.5:0/1731397576 conn(0x7fe9380afcf0 msgr2=0x7fe9380b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:13.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.522+0000 7fe93cffa640 1 -- 172.21.15.5:0/1731397576 shutdown_connections 2023-07-14T13:06:13.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.522+0000 7fe93cffa640 1 -- 172.21.15.5:0/1731397576 wait complete. 2023-07-14T13:06:13.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.522+0000 7fe93cffa640 1 Processor -- start 2023-07-14T13:06:13.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.522+0000 7fe93cffa640 1 -- start start 2023-07-14T13:06:13.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.526+0000 7fe93cffa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9380c8ad0 0x7fe93814efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:13.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.526+0000 7fe93cffa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9380c9560 0x7fe938156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:13.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.526+0000 7fe93cffa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe938158ce0 0x7fe93806bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:13.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.526+0000 7fe93cffa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9381593f0 con 0x7fe938158ce0 2023-07-14T13:06:13.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.526+0000 7fe93cffa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93815ab00 con 0x7fe9380c9560 2023-07-14T13:06:13.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.526+0000 7fe93cffa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93815ade0 con 0x7fe9380c8ad0 2023-07-14T13:06:13.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.526+0000 7fe936d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe938158ce0 0x7fe93806bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:13.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.526+0000 7fe936d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe938158ce0 0x7fe93806bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52302/0 (socket says 172.21.15.5:52302) 2023-07-14T13:06:13.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.526+0000 7fe936d9d640 1 -- 172.21.15.5:0/4234713797 learned_addr learned my addr 172.21.15.5:0/4234713797 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:13.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.526+0000 7fe935d9b640 1 --2- 172.21.15.5:0/4234713797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9380c9560 0x7fe938156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:13.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.526+0000 7fe93659c640 1 --2- 172.21.15.5:0/4234713797 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9380c8ad0 0x7fe93814efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:13.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.526+0000 7fe936d9d640 1 -- 172.21.15.5:0/4234713797 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9380c8ad0 msgr2=0x7fe93814efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:13.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.526+0000 7fe936d9d640 1 --2- 172.21.15.5:0/4234713797 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9380c8ad0 0x7fe93814efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:13.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.526+0000 7fe936d9d640 1 -- 172.21.15.5:0/4234713797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9380c9560 msgr2=0x7fe938156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:13.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.526+0000 7fe936d9d640 1 --2- 172.21.15.5:0/4234713797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9380c9560 0x7fe938156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:13.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.526+0000 7fe936d9d640 1 -- 172.21.15.5:0/4234713797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9280094d0 con 0x7fe938158ce0 2023-07-14T13:06:13.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.526+0000 7fe936d9d640 1 --2- 172.21.15.5:0/4234713797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe938158ce0 0x7fe93806bb20 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe930007e70 tx=0x7fe93000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:13.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.526+0000 7fe926ffd640 1 -- 172.21.15.5:0/4234713797 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe930003ba0 con 0x7fe938158ce0 2023-07-14T13:06:13.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.526+0000 7fe926ffd640 1 -- 172.21.15.5:0/4234713797 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93000f040 con 0x7fe938158ce0 2023-07-14T13:06:13.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.526+0000 7fe926ffd640 1 -- 172.21.15.5:0/4234713797 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93000de80 con 0x7fe938158ce0 2023-07-14T13:06:13.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.526+0000 7fe93cffa640 1 -- 172.21.15.5:0/4234713797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe93815b0c0 con 0x7fe938158ce0 2023-07-14T13:06:13.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.526+0000 7fe93cffa640 1 -- 172.21.15.5:0/4234713797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9381f5b80 con 0x7fe938158ce0 2023-07-14T13:06:13.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.526+0000 7fe93cffa640 1 -- 172.21.15.5:0/4234713797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9381f5e00 con 0x7fe938158ce0 2023-07-14T13:06:13.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.530+0000 7fe926ffd640 1 -- 172.21.15.5:0/4234713797 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe930004030 con 0x7fe938158ce0 2023-07-14T13:06:13.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.530+0000 7fe926ffd640 1 --2- 172.21.15.5:0/4234713797 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fe9180663a0 0x7fe918068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:13.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.530+0000 7fe926ffd640 1 -- 172.21.15.5:0/4234713797 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe930084240 con 0x7fe938158ce0 2023-07-14T13:06:13.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.530+0000 7fe93659c640 1 --2- 172.21.15.5:0/4234713797 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fe9180663a0 0x7fe918068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:13.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.530+0000 7fe93659c640 1 --2- 172.21.15.5:0/4234713797 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fe9180663a0 0x7fe918068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe9280ad000 tx=0x7fe9280a6000 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:13.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.534+0000 7fe926ffd640 1 -- 172.21.15.5:0/4234713797 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe930051540 con 0x7fe938158ce0 2023-07-14T13:06:13.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.710+0000 7fe93cffa640 1 -- 172.21.15.5:0/4234713797 --> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe93815b570 con 0x7fe9180663a0 2023-07-14T13:06:13.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.710+0000 7fe926ffd640 1 -- 172.21.15.5:0/4234713797 <== mgr.5695 v2:172.21.15.154:6832/1810553301 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fe9280ab5e0 con 0x7fe9180663a0 2023-07-14T13:06:13.743 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-07-14T13:06:13.744 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:06:13.744 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs" 2023-07-14T13:06:13.744 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:06:13.744 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-07-14T13:06:13.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.714+0000 7fe93cffa640 1 -- 172.21.15.5:0/4234713797 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fe9180663a0 msgr2=0x7fe918068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:13.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.714+0000 7fe93cffa640 1 --2- 172.21.15.5:0/4234713797 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fe9180663a0 0x7fe918068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe9280ad000 tx=0x7fe9280a6000 comp rx=0 tx=0).stop 2023-07-14T13:06:13.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.714+0000 7fe93cffa640 1 -- 172.21.15.5:0/4234713797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe938158ce0 msgr2=0x7fe93806bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:13.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.714+0000 7fe93cffa640 1 --2- 172.21.15.5:0/4234713797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe938158ce0 0x7fe93806bb20 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe930007e70 tx=0x7fe93000d4a0 comp rx=0 tx=0).stop 2023-07-14T13:06:13.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.714+0000 7fe93cffa640 1 -- 172.21.15.5:0/4234713797 shutdown_connections 2023-07-14T13:06:13.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.714+0000 7fe93cffa640 1 --2- 172.21.15.5:0/4234713797 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fe9180663a0 0x7fe918068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:13.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.714+0000 7fe93cffa640 1 --2- 172.21.15.5:0/4234713797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe938158ce0 0x7fe93806bb20 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:13.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.714+0000 7fe93cffa640 1 --2- 172.21.15.5:0/4234713797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9380c9560 0x7fe938156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:13.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.714+0000 7fe93cffa640 1 --2- 172.21.15.5:0/4234713797 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9380c8ad0 0x7fe93814efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:13.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.714+0000 7fe93cffa640 1 -- 172.21.15.5:0/4234713797 >> 172.21.15.5:0/4234713797 conn(0x7fe9380afcf0 msgr2=0x7fe938156bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:13.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.714+0000 7fe93cffa640 1 -- 172.21.15.5:0/4234713797 shutdown_connections 2023-07-14T13:06:13.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.714+0000 7fe93cffa640 1 -- 172.21.15.5:0/4234713797 wait complete. 2023-07-14T13:06:13.765 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-14T13:06:13.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.882+0000 7eff7b46d640 1 Processor -- start 2023-07-14T13:06:13.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.882+0000 7eff7b46d640 1 -- start start 2023-07-14T13:06:13.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.882+0000 7eff7b46d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7eff741600b0 0x7eff740cd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:13.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.882+0000 7eff7b46d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff74164340 0x7eff740c0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:13.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.882+0000 7eff7b46d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff740c89f0 con 0x7eff7406cf80 2023-07-14T13:06:13.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.882+0000 7eff7b46d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff740cbe50 con 0x7eff741600b0 2023-07-14T13:06:13.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.882+0000 7eff7b46d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff740cc9d0 con 0x7eff74164340 2023-07-14T13:06:13.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.882+0000 7eff79209640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7eff741600b0 0x7eff740cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:13.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.882+0000 7eff79209640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7eff741600b0 0x7eff740cd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52310/0 (socket says 172.21.15.5:52310) 2023-07-14T13:06:13.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.882+0000 7eff79209640 1 -- 172.21.15.5:0/3642037949 learned_addr learned my addr 172.21.15.5:0/3642037949 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:13.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.882+0000 7eff79a0a640 1 --2- 172.21.15.5:0/3642037949 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff74164340 0x7eff740c0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:13.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.882+0000 7eff79209640 1 -- 172.21.15.5:0/3642037949 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff74164340 msgr2=0x7eff740c0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:13.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.882+0000 7eff79209640 1 --2- 172.21.15.5:0/3642037949 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff74164340 0x7eff740c0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:13.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.882+0000 7eff79209640 1 -- 172.21.15.5:0/3642037949 >> v1:172.21.15.154:6789/0 conn(0x7eff7406cf80 legacy=0x7eff74163c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:13.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.882+0000 7eff79209640 1 -- 172.21.15.5:0/3642037949 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff740c9e20 con 0x7eff741600b0 2023-07-14T13:06:13.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.886+0000 7eff79209640 1 --2- 172.21.15.5:0/3642037949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff741600b0 0x7eff740cd980 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7eff70009870 tx=0x7eff7001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed641fcadb70f9c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:13.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.886+0000 7eff6bfff640 1 -- 172.21.15.5:0/3642037949 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff700ab600 con 0x7eff741600b0 2023-07-14T13:06:13.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.886+0000 7eff6bfff640 1 -- 172.21.15.5:0/3642037949 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff700a7050 con 0x7eff741600b0 2023-07-14T13:06:13.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.886+0000 7eff6bfff640 1 -- 172.21.15.5:0/3642037949 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff700ab980 con 0x7eff741600b0 2023-07-14T13:06:13.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.886+0000 7eff7b46d640 1 -- 172.21.15.5:0/3642037949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff741600b0 msgr2=0x7eff740cd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:13.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.886+0000 7eff7b46d640 1 --2- 172.21.15.5:0/3642037949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff741600b0 0x7eff740cd980 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7eff70009870 tx=0x7eff7001c360 comp rx=0 tx=0).stop 2023-07-14T13:06:13.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.886+0000 7eff7b46d640 1 -- 172.21.15.5:0/3642037949 shutdown_connections 2023-07-14T13:06:13.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.886+0000 7eff7b46d640 1 --2- 172.21.15.5:0/3642037949 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff74164340 0x7eff740c0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:13.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.886+0000 7eff7b46d640 1 --2- 172.21.15.5:0/3642037949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff741600b0 0x7eff740cd980 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:13.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.886+0000 7eff7b46d640 1 -- 172.21.15.5:0/3642037949 >> 172.21.15.5:0/3642037949 conn(0x7eff740afac0 msgr2=0x7eff740afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:13.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.886+0000 7eff7b46d640 1 -- 172.21.15.5:0/3642037949 shutdown_connections 2023-07-14T13:06:13.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.886+0000 7eff7b46d640 1 -- 172.21.15.5:0/3642037949 wait complete. 2023-07-14T13:06:13.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.890+0000 7eff7b46d640 1 Processor -- start 2023-07-14T13:06:13.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.890+0000 7eff7b46d640 1 -- start start 2023-07-14T13:06:13.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.890+0000 7eff7b46d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff7406cf80 0x7eff741574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:13.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.890+0000 7eff7b46d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff741600b0 0x7eff741547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:13.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.890+0000 7eff7b46d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff74164340 0x7eff740b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:13.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.890+0000 7eff7b46d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff740b3150 con 0x7eff741600b0 2023-07-14T13:06:13.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.890+0000 7eff7b46d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff740c4550 con 0x7eff7406cf80 2023-07-14T13:06:13.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.890+0000 7eff7b46d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff740b33f0 con 0x7eff74164340 2023-07-14T13:06:13.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.890+0000 7eff78a08640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff741600b0 0x7eff741547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:13.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.890+0000 7eff78a08640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff741600b0 0x7eff741547f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52322/0 (socket says 172.21.15.5:52322) 2023-07-14T13:06:13.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.890+0000 7eff78a08640 1 -- 172.21.15.5:0/3412404025 learned_addr learned my addr 172.21.15.5:0/3412404025 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:13.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.890+0000 7eff79a0a640 1 --2- 172.21.15.5:0/3412404025 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff74164340 0x7eff740b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:13.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.890+0000 7eff79209640 1 --2- 172.21.15.5:0/3412404025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff7406cf80 0x7eff741574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:13.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.890+0000 7eff78a08640 1 -- 172.21.15.5:0/3412404025 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff74164340 msgr2=0x7eff740b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:13.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.890+0000 7eff78a08640 1 --2- 172.21.15.5:0/3412404025 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff74164340 0x7eff740b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:13.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.890+0000 7eff78a08640 1 -- 172.21.15.5:0/3412404025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff7406cf80 msgr2=0x7eff741574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:13.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.890+0000 7eff78a08640 1 --2- 172.21.15.5:0/3412404025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff7406cf80 0x7eff741574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:13.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.890+0000 7eff78a08640 1 -- 172.21.15.5:0/3412404025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff700094d0 con 0x7eff741600b0 2023-07-14T13:06:13.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.890+0000 7eff78a08640 1 --2- 172.21.15.5:0/3412404025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff741600b0 0x7eff741547f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7eff6400c500 tx=0x7eff6400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:13.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.890+0000 7eff69ffb640 1 -- 172.21.15.5:0/3412404025 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff64005220 con 0x7eff741600b0 2023-07-14T13:06:13.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.890+0000 7eff69ffb640 1 -- 172.21.15.5:0/3412404025 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff64005380 con 0x7eff741600b0 2023-07-14T13:06:13.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.890+0000 7eff69ffb640 1 -- 172.21.15.5:0/3412404025 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff64007270 con 0x7eff741600b0 2023-07-14T13:06:13.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.890+0000 7eff7b46d640 1 -- 172.21.15.5:0/3412404025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff740b36d0 con 0x7eff741600b0 2023-07-14T13:06:13.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.890+0000 7eff7b46d640 1 -- 172.21.15.5:0/3412404025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff740c4830 con 0x7eff741600b0 2023-07-14T13:06:13.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.890+0000 7eff7b46d640 1 -- 172.21.15.5:0/3412404025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff740b38f0 con 0x7eff741600b0 2023-07-14T13:06:13.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.894+0000 7eff69ffb640 1 -- 172.21.15.5:0/3412404025 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) v1 ==== 85760+0+0 (secure 0 0 0) 0x7eff640073d0 con 0x7eff741600b0 2023-07-14T13:06:13.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.894+0000 7eff69ffb640 1 --2- 172.21.15.5:0/3412404025 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7eff580663a0 0x7eff58068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:13.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.894+0000 7eff69ffb640 1 -- 172.21.15.5:0/3412404025 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7eff640836c0 con 0x7eff741600b0 2023-07-14T13:06:13.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.894+0000 7eff79209640 1 --2- 172.21.15.5:0/3412404025 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7eff580663a0 0x7eff58068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:13.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.894+0000 7eff79209640 1 --2- 172.21.15.5:0/3412404025 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7eff580663a0 0x7eff58068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7eff700ad000 tx=0x7eff70008040 comp rx=0 tx=0).ready entity=mgr.5695 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:13.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:13.898+0000 7eff69ffb640 1 -- 172.21.15.5:0/3412404025 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7eff64050a50 con 0x7eff741600b0 2023-07-14T13:06:14.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.090+0000 7eff7b46d640 1 -- 172.21.15.5:0/3412404025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7eff740678d0 con 0x7eff741600b0 2023-07-14T13:06:14.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.674+0000 7eff69ffb640 1 -- 172.21.15.5:0/3412404025 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 21) v1 ==== 85777+0+0 (secure 0 0 0) 0x7eff64050e20 con 0x7eff741600b0 2023-07-14T13:06:14.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.678+0000 7eff69ffb640 1 -- 172.21.15.5:0/3412404025 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v21) v1 ==== 92+0+0 (secure 0 0 0) 0x7eff6407ed20 con 0x7eff741600b0 2023-07-14T13:06:14.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.678+0000 7eff7b46d640 1 -- 172.21.15.5:0/3412404025 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7eff580663a0 msgr2=0x7eff58068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:14.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.678+0000 7eff7b46d640 1 --2- 172.21.15.5:0/3412404025 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7eff580663a0 0x7eff58068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7eff700ad000 tx=0x7eff70008040 comp rx=0 tx=0).stop 2023-07-14T13:06:14.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.678+0000 7eff7b46d640 1 -- 172.21.15.5:0/3412404025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff741600b0 msgr2=0x7eff741547f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:14.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.678+0000 7eff7b46d640 1 --2- 172.21.15.5:0/3412404025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff741600b0 0x7eff741547f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7eff6400c500 tx=0x7eff6400c9c0 comp rx=0 tx=0).stop 2023-07-14T13:06:14.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.678+0000 7eff7b46d640 1 -- 172.21.15.5:0/3412404025 shutdown_connections 2023-07-14T13:06:14.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.678+0000 7eff7b46d640 1 --2- 172.21.15.5:0/3412404025 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7eff580663a0 0x7eff58068850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:14.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.678+0000 7eff7b46d640 1 --2- 172.21.15.5:0/3412404025 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff74164340 0x7eff740b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:14.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.678+0000 7eff7b46d640 1 --2- 172.21.15.5:0/3412404025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff741600b0 0x7eff741547f0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:14.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.678+0000 7eff7b46d640 1 --2- 172.21.15.5:0/3412404025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff7406cf80 0x7eff741574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:14.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.678+0000 7eff7b46d640 1 -- 172.21.15.5:0/3412404025 >> 172.21.15.5:0/3412404025 conn(0x7eff740afac0 msgr2=0x7eff74158640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:14.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.678+0000 7eff7b46d640 1 -- 172.21.15.5:0/3412404025 shutdown_connections 2023-07-14T13:06:14.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.678+0000 7eff7b46d640 1 -- 172.21.15.5:0/3412404025 wait complete. 2023-07-14T13:06:14.732 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-14T13:06:14.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.850+0000 7fb2563d2640 1 Processor -- start 2023-07-14T13:06:14.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.850+0000 7fb2563d2640 1 -- start start 2023-07-14T13:06:14.883 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:14.857+0000 7f6008fe6180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:06:14.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.854+0000 7fb2563d2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb25015bde0 0x7fb2500d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:14.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.854+0000 7fb2563d2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb2500d2fc0 0x7fb2500b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:14.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.854+0000 7fb2563d2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2500b04c0 con 0x7fb2500d2300 2023-07-14T13:06:14.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.854+0000 7fb2563d2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb25015c1b0 con 0x7fb25015bde0 2023-07-14T13:06:14.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.854+0000 7fb2563d2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2500d0aa0 con 0x7fb2500d2fc0 2023-07-14T13:06:14.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.854+0000 7fb24ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb25015bde0 0x7fb2500d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:14.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.854+0000 7fb24ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb25015bde0 0x7fb2500d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52346/0 (socket says 172.21.15.5:52346) 2023-07-14T13:06:14.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.854+0000 7fb24ffff640 1 -- 172.21.15.5:0/924820597 learned_addr learned my addr 172.21.15.5:0/924820597 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:14.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.854+0000 7fb25496f640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb2500d2300 0x7fb2500cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47644/0 (socket says 172.21.15.5:47644) 2023-07-14T13:06:14.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.854+0000 7fb24f7fe640 1 --2- 172.21.15.5:0/924820597 >> v2:172.21.15.154:3300/0 conn(0x7fb2500d2fc0 0x7fb2500b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:14.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.854+0000 7fb24ffff640 1 -- 172.21.15.5:0/924820597 >> v2:172.21.15.154:3300/0 conn(0x7fb2500d2fc0 msgr2=0x7fb2500b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:14.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.854+0000 7fb24ffff640 1 --2- 172.21.15.5:0/924820597 >> v2:172.21.15.154:3300/0 conn(0x7fb2500d2fc0 0x7fb2500b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:14.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.854+0000 7fb24ffff640 1 -- 172.21.15.5:0/924820597 >> v1:172.21.15.5:6789/0 conn(0x7fb2500d2300 legacy=0x7fb2500cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:14.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.854+0000 7fb24ffff640 1 -- 172.21.15.5:0/924820597 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2500afb90 con 0x7fb25015bde0 2023-07-14T13:06:14.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.858+0000 7fb24ffff640 1 --2- 172.21.15.5:0/924820597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb25015bde0 0x7fb2500d0270 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb25008c600 tx=0x7fb24001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de202ccb2c3c89a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:14.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.858+0000 7fb24effd640 1 -- 172.21.15.5:0/924820597 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2400aa660 con 0x7fb25015bde0 2023-07-14T13:06:14.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.858+0000 7fb24effd640 1 -- 172.21.15.5:0/924820597 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2400aa7c0 con 0x7fb25015bde0 2023-07-14T13:06:14.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.858+0000 7fb24effd640 1 -- 172.21.15.5:0/924820597 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2400aab50 con 0x7fb25015bde0 2023-07-14T13:06:14.889 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:06:14.858+0000 7f6a96a46180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:06:14.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.858+0000 7fb2563d2640 1 -- 172.21.15.5:0/924820597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb25015bde0 msgr2=0x7fb2500d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:14.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.858+0000 7fb2563d2640 1 --2- 172.21.15.5:0/924820597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb25015bde0 0x7fb2500d0270 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb25008c600 tx=0x7fb24001c500 comp rx=0 tx=0).stop 2023-07-14T13:06:14.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.858+0000 7fb2563d2640 1 -- 172.21.15.5:0/924820597 shutdown_connections 2023-07-14T13:06:14.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.858+0000 7fb2563d2640 1 --2- 172.21.15.5:0/924820597 >> v2:172.21.15.154:3300/0 conn(0x7fb2500d2fc0 0x7fb2500b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:14.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.858+0000 7fb2563d2640 1 --2- 172.21.15.5:0/924820597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb25015bde0 0x7fb2500d0270 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:14.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.858+0000 7fb2563d2640 1 -- 172.21.15.5:0/924820597 >> 172.21.15.5:0/924820597 conn(0x7fb2500659d0 msgr2=0x7fb25009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:14.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.858+0000 7fb2563d2640 1 -- 172.21.15.5:0/924820597 shutdown_connections 2023-07-14T13:06:14.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.858+0000 7fb2563d2640 1 -- 172.21.15.5:0/924820597 wait complete. 2023-07-14T13:06:14.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.862+0000 7fb2563d2640 1 Processor -- start 2023-07-14T13:06:14.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.862+0000 7fb2563d2640 1 -- start start 2023-07-14T13:06:14.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.862+0000 7fb2563d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2500d2300 0x7fb2500c5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:14.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.862+0000 7fb2563d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2500d2fc0 0x7fb250149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:14.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.862+0000 7fb2563d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb25015bde0 0x7fb25015c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:14.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.862+0000 7fb2563d2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25014a8f0 con 0x7fb2500d2fc0 2023-07-14T13:06:14.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.862+0000 7fb2563d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25014abc0 con 0x7fb2500d2300 2023-07-14T13:06:14.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.862+0000 7fb2563d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb25014aea0 con 0x7fb25015bde0 2023-07-14T13:06:14.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.862+0000 7fb24f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2500d2fc0 0x7fb250149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:14.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.862+0000 7fb24f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2500d2fc0 0x7fb250149700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52350/0 (socket says 172.21.15.5:52350) 2023-07-14T13:06:14.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.862+0000 7fb24f7fe640 1 -- 172.21.15.5:0/1315837882 learned_addr learned my addr 172.21.15.5:0/1315837882 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:14.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.862+0000 7fb24ffff640 1 --2- 172.21.15.5:0/1315837882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2500d2300 0x7fb2500c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:14.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.862+0000 7fb25496f640 1 --2- 172.21.15.5:0/1315837882 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb25015bde0 0x7fb25015c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:14.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.862+0000 7fb24ffff640 1 -- 172.21.15.5:0/1315837882 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb25015bde0 msgr2=0x7fb25015c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.862+0000 7fb24ffff640 1 --2- 172.21.15.5:0/1315837882 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb25015bde0 0x7fb25015c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.862+0000 7fb24ffff640 1 -- 172.21.15.5:0/1315837882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2500d2fc0 msgr2=0x7fb250149700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.862+0000 7fb24ffff640 1 --2- 172.21.15.5:0/1315837882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2500d2fc0 0x7fb250149700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.862+0000 7fb24ffff640 1 -- 172.21.15.5:0/1315837882 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb240009480 con 0x7fb2500d2300 2023-07-14T13:06:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.862+0000 7fb24f7fe640 1 --2- 172.21.15.5:0/1315837882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2500d2fc0 0x7fb250149700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:06:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.862+0000 7fb24ffff640 1 --2- 172.21.15.5:0/1315837882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2500d2300 0x7fb2500c5290 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb2400ab000 tx=0x7fb2400192a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.862+0000 7fb24cff9640 1 -- 172.21.15.5:0/1315837882 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2400bb070 con 0x7fb2500d2300 2023-07-14T13:06:14.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.862+0000 7fb24cff9640 1 -- 172.21.15.5:0/1315837882 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2400aa930 con 0x7fb2500d2300 2023-07-14T13:06:14.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.862+0000 7fb24cff9640 1 -- 172.21.15.5:0/1315837882 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2400aaca0 con 0x7fb2500d2300 2023-07-14T13:06:14.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.862+0000 7fb2563d2640 1 -- 172.21.15.5:0/1315837882 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2500b52b0 con 0x7fb2500d2300 2023-07-14T13:06:14.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.866+0000 7fb2563d2640 1 -- 172.21.15.5:0/1315837882 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb25014b180 con 0x7fb2500d2300 2023-07-14T13:06:14.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.866+0000 7fb2563d2640 1 -- 172.21.15.5:0/1315837882 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2500678d0 con 0x7fb2500d2300 2023-07-14T13:06:14.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.866+0000 7fb24cff9640 1 -- 172.21.15.5:0/1315837882 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 21) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fb240003830 con 0x7fb2500d2300 2023-07-14T13:06:14.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.866+0000 7fb24cff9640 1 --2- 172.21.15.5:0/1315837882 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fb23c0663f0 0x7fb23c0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:14.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.866+0000 7fb24cff9640 1 -- 172.21.15.5:0/1315837882 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb2400a6040 con 0x7fb2500d2300 2023-07-14T13:06:14.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.866+0000 7fb24f7fe640 1 -- 172.21.15.5:0/1315837882 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fb23c0663f0 msgr2=0x7fb23c0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1810553301 2023-07-14T13:06:14.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.866+0000 7fb24f7fe640 1 --2- 172.21.15.5:0/1315837882 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fb23c0663f0 0x7fb23c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:06:14.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:14.870+0000 7fb24cff9640 1 -- 172.21.15.5:0/1315837882 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb2400eb620 con 0x7fb2500d2300 2023-07-14T13:06:15.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.030+0000 7fb2563d2640 1 -- 172.21.15.5:0/1315837882 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fb2500b5760 con 0x7fb2500d2300 2023-07-14T13:06:15.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.038+0000 7fb24cff9640 1 -- 172.21.15.5:0/1315837882 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v17)=0 v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb2400eec40 con 0x7fb2500d2300 2023-07-14T13:06:15.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.042+0000 7fb2563d2640 1 -- 172.21.15.5:0/1315837882 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fb23c0663f0 msgr2=0x7fb23c0688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:06:15.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.042+0000 7fb2563d2640 1 --2- 172.21.15.5:0/1315837882 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fb23c0663f0 0x7fb23c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:15.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.042+0000 7fb2563d2640 1 -- 172.21.15.5:0/1315837882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2500d2300 msgr2=0x7fb2500c5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:15.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.042+0000 7fb2563d2640 1 --2- 172.21.15.5:0/1315837882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2500d2300 0x7fb2500c5290 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb2400ab000 tx=0x7fb2400192a0 comp rx=0 tx=0).stop 2023-07-14T13:06:15.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.042+0000 7fb2563d2640 1 -- 172.21.15.5:0/1315837882 shutdown_connections 2023-07-14T13:06:15.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.042+0000 7fb2563d2640 1 --2- 172.21.15.5:0/1315837882 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7fb23c0663f0 0x7fb23c0688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:15.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.042+0000 7fb2563d2640 1 --2- 172.21.15.5:0/1315837882 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb25015bde0 0x7fb25015c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:15.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.042+0000 7fb2563d2640 1 --2- 172.21.15.5:0/1315837882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2500d2fc0 0x7fb250149700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:15.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.042+0000 7fb2563d2640 1 --2- 172.21.15.5:0/1315837882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2500d2300 0x7fb2500c5290 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:15.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.042+0000 7fb2563d2640 1 -- 172.21.15.5:0/1315837882 >> 172.21.15.5:0/1315837882 conn(0x7fb2500659d0 msgr2=0x7fb25006afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:15.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.042+0000 7fb2563d2640 1 -- 172.21.15.5:0/1315837882 shutdown_connections 2023-07-14T13:06:15.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.042+0000 7fb2563d2640 1 -- 172.21.15.5:0/1315837882 wait complete. 2023-07-14T13:06:15.092 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-14T13:06:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.210+0000 7f885d12c640 1 Processor -- start 2023-07-14T13:06:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.210+0000 7f885d12c640 1 -- start start 2023-07-14T13:06:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.210+0000 7f885d12c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f88580d2fc0 0x7f88580b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.210+0000 7f885d12c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f88580d2300 0x7f88580d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.210+0000 7f885d12c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88580b04c0 con 0x7f885815bde0 2023-07-14T13:06:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.210+0000 7f885d12c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885815c1b0 con 0x7f88580d2fc0 2023-07-14T13:06:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.210+0000 7f885d12c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88580d2c80 con 0x7f88580d2300 2023-07-14T13:06:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.210+0000 7f885659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f88580d2fc0 0x7f88580b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.210+0000 7f885659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f88580d2fc0 0x7f88580b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52362/0 (socket says 172.21.15.5:52362) 2023-07-14T13:06:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.210+0000 7f885659c640 1 -- 172.21.15.5:0/3293891326 learned_addr learned my addr 172.21.15.5:0/3293891326 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.210+0000 7f885759e640 1 --2- 172.21.15.5:0/3293891326 >> v2:172.21.15.154:3300/0 conn(0x7f88580d2300 0x7f88580d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.210+0000 7f885659c640 1 -- 172.21.15.5:0/3293891326 >> v2:172.21.15.154:3300/0 conn(0x7f88580d2300 msgr2=0x7f88580d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.210+0000 7f885659c640 1 --2- 172.21.15.5:0/3293891326 >> v2:172.21.15.154:3300/0 conn(0x7f88580d2300 0x7f88580d2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.210+0000 7f885659c640 1 -- 172.21.15.5:0/3293891326 >> v1:172.21.15.154:6789/0 conn(0x7f885815bde0 legacy=0x7f88580d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.210+0000 7f885659c640 1 -- 172.21.15.5:0/3293891326 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88580d0aa0 con 0x7f88580d2fc0 2023-07-14T13:06:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.210+0000 7f8855d9b640 1 -- 172.21.15.5:0/3293891326 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3191209423 0 0) 0x7f88580b04c0 con 0x7f885815bde0 2023-07-14T13:06:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.214+0000 7f885659c640 1 --2- 172.21.15.5:0/3293891326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88580d2fc0 0x7f88580b0950 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f885808c820 tx=0x7f884c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb899f0e8230296e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.214+0000 7f8855d9b640 1 -- 172.21.15.5:0/3293891326 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c0aa660 con 0x7f88580d2fc0 2023-07-14T13:06:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.214+0000 7f8855d9b640 1 -- 172.21.15.5:0/3293891326 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884c0aa7c0 con 0x7f88580d2fc0 2023-07-14T13:06:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.214+0000 7f8855d9b640 1 -- 172.21.15.5:0/3293891326 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c0aab50 con 0x7f88580d2fc0 2023-07-14T13:06:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.214+0000 7f885d12c640 1 -- 172.21.15.5:0/3293891326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88580d2fc0 msgr2=0x7f88580b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.214+0000 7f885d12c640 1 --2- 172.21.15.5:0/3293891326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88580d2fc0 0x7f88580b0950 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f885808c820 tx=0x7f884c01c500 comp rx=0 tx=0).stop 2023-07-14T13:06:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.214+0000 7f885d12c640 1 -- 172.21.15.5:0/3293891326 shutdown_connections 2023-07-14T13:06:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.214+0000 7f885d12c640 1 --2- 172.21.15.5:0/3293891326 >> v2:172.21.15.154:3300/0 conn(0x7f88580d2300 0x7f88580d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.214+0000 7f885d12c640 1 --2- 172.21.15.5:0/3293891326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88580d2fc0 0x7f88580b0950 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.214+0000 7f885d12c640 1 -- 172.21.15.5:0/3293891326 >> 172.21.15.5:0/3293891326 conn(0x7f88580659d0 msgr2=0x7f885809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.214+0000 7f885d12c640 1 -- 172.21.15.5:0/3293891326 shutdown_connections 2023-07-14T13:06:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.214+0000 7f885d12c640 1 -- 172.21.15.5:0/3293891326 wait complete. 2023-07-14T13:06:15.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.218+0000 7f885d12c640 1 Processor -- start 2023-07-14T13:06:15.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.218+0000 7f885d12c640 1 -- start start 2023-07-14T13:06:15.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.218+0000 7f885d12c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88580d2300 0x7f8858152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:15.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.218+0000 7f885d12c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88580d2fc0 0x7f88580cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:15.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.218+0000 7f885d12c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885815bde0 0x7f88580ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.218+0000 7f885d12c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88580cb500 con 0x7f885815bde0 2023-07-14T13:06:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.218+0000 7f885d12c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88580c9820 con 0x7f88580d2fc0 2023-07-14T13:06:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.218+0000 7f885d12c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88580c9b00 con 0x7f88580d2300 2023-07-14T13:06:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.218+0000 7f885759e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885815bde0 0x7f88580ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.218+0000 7f885659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88580d2fc0 0x7f88580cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.218+0000 7f885759e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885815bde0 0x7f88580ce9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52370/0 (socket says 172.21.15.5:52370) 2023-07-14T13:06:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.218+0000 7f885759e640 1 -- 172.21.15.5:0/3360062631 learned_addr learned my addr 172.21.15.5:0/3360062631 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:15.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.218+0000 7f8856d9d640 1 --2- 172.21.15.5:0/3360062631 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88580d2300 0x7f8858152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.218+0000 7f885659c640 1 -- 172.21.15.5:0/3360062631 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88580d2300 msgr2=0x7f8858152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.218+0000 7f885659c640 1 --2- 172.21.15.5:0/3360062631 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88580d2300 0x7f8858152660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.218+0000 7f885659c640 1 -- 172.21.15.5:0/3360062631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885815bde0 msgr2=0x7f88580ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.218+0000 7f885659c640 1 --2- 172.21.15.5:0/3360062631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885815bde0 0x7f88580ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.218+0000 7f885659c640 1 -- 172.21.15.5:0/3360062631 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c0094d0 con 0x7f88580d2fc0 2023-07-14T13:06:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.218+0000 7f885659c640 1 --2- 172.21.15.5:0/3360062631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88580d2fc0 0x7f88580cafc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f884c0ab000 tx=0x7f884c01ad40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.218+0000 7f883f7fe640 1 -- 172.21.15.5:0/3360062631 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c0b3800 con 0x7f88580d2fc0 2023-07-14T13:06:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.218+0000 7f883f7fe640 1 -- 172.21.15.5:0/3360062631 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884c0b3960 con 0x7f88580d2fc0 2023-07-14T13:06:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.218+0000 7f885d12c640 1 -- 172.21.15.5:0/3360062631 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88580c9de0 con 0x7f88580d2fc0 2023-07-14T13:06:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.222+0000 7f883f7fe640 1 -- 172.21.15.5:0/3360062631 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c0b3d10 con 0x7f88580d2fc0 2023-07-14T13:06:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.222+0000 7f885d12c640 1 -- 172.21.15.5:0/3360062631 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88580ca3a0 con 0x7f88580d2fc0 2023-07-14T13:06:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.222+0000 7f885d12c640 1 -- 172.21.15.5:0/3360062631 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88580ca590 con 0x7f88580d2fc0 2023-07-14T13:06:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.222+0000 7f883f7fe640 1 -- 172.21.15.5:0/3360062631 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 21) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f884c0c6390 con 0x7f88580d2fc0 2023-07-14T13:06:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.222+0000 7f883f7fe640 1 --2- 172.21.15.5:0/3360062631 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f88440663f0 0x7f88440688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.222+0000 7f883f7fe640 1 -- 172.21.15.5:0/3360062631 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f884c0a6040 con 0x7f88580d2fc0 2023-07-14T13:06:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.222+0000 7f8856d9d640 1 -- 172.21.15.5:0/3360062631 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f88440663f0 msgr2=0x7f88440688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1810553301 2023-07-14T13:06:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.222+0000 7f8856d9d640 1 --2- 172.21.15.5:0/3360062631 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f88440663f0 0x7f88440688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:06:15.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.226+0000 7f883f7fe640 1 -- 172.21.15.5:0/3360062631 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f884c0ebe80 con 0x7f88580d2fc0 2023-07-14T13:06:15.305 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:15.277+0000 7f6008fe6180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:06:15.338 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:06:15.306+0000 7f6a96a46180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:06:15.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.386+0000 7f885d12c640 1 -- 172.21.15.5:0/3360062631 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f88580678d0 con 0x7f88580d2fc0 2023-07-14T13:06:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.394+0000 7f883f7fe640 1 -- 172.21.15.5:0/3360062631 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v18)=0 v18) v1 ==== 133+0+0 (secure 0 0 0) 0x7f884c0ef4a0 con 0x7f88580d2fc0 2023-07-14T13:06:15.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.398+0000 7f885d12c640 1 -- 172.21.15.5:0/3360062631 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f88440663f0 msgr2=0x7f88440688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:06:15.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.398+0000 7f885d12c640 1 --2- 172.21.15.5:0/3360062631 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f88440663f0 0x7f88440688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:15.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.398+0000 7f885d12c640 1 -- 172.21.15.5:0/3360062631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88580d2fc0 msgr2=0x7f88580cafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.398+0000 7f885d12c640 1 --2- 172.21.15.5:0/3360062631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88580d2fc0 0x7f88580cafc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f884c0ab000 tx=0x7f884c01ad40 comp rx=0 tx=0).stop 2023-07-14T13:06:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.398+0000 7f885d12c640 1 -- 172.21.15.5:0/3360062631 shutdown_connections 2023-07-14T13:06:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.398+0000 7f885d12c640 1 --2- 172.21.15.5:0/3360062631 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7f88440663f0 0x7f88440688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.398+0000 7f885d12c640 1 --2- 172.21.15.5:0/3360062631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f885815bde0 0x7f88580ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.398+0000 7f885d12c640 1 --2- 172.21.15.5:0/3360062631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88580d2fc0 0x7f88580cafc0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.398+0000 7f885d12c640 1 --2- 172.21.15.5:0/3360062631 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88580d2300 0x7f8858152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.398+0000 7f885d12c640 1 -- 172.21.15.5:0/3360062631 >> 172.21.15.5:0/3360062631 conn(0x7f88580659d0 msgr2=0x7f88580d0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:15.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.398+0000 7f885d12c640 1 -- 172.21.15.5:0/3360062631 shutdown_connections 2023-07-14T13:06:15.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.398+0000 7f885d12c640 1 -- 172.21.15.5:0/3360062631 wait complete. 2023-07-14T13:06:15.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:15.449 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-14T13:06:15.459 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:15.433+0000 7f6008fe6180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:06:15.464 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-07-14T13:06:15.500 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:06:15.470+0000 7f6a96a46180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:06:15.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.618+0000 7ff6fd9fa640 1 Processor -- start 2023-07-14T13:06:15.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.618+0000 7ff6fd9fa640 1 -- start start 2023-07-14T13:06:15.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.622+0000 7ff6fd9fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6f80d2300 0x7ff6f80d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:15.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.622+0000 7ff6fd9fa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f80b04c0 con 0x7ff6f815bde0 2023-07-14T13:06:15.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.622+0000 7ff6fd9fa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f80b1060 con 0x7ff6f80d2fc0 2023-07-14T13:06:15.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.622+0000 7ff6fd9fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f815c1b0 con 0x7ff6f80d2300 2023-07-14T13:06:15.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.622+0000 7ff6f6ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff6f815bde0 0x7ff6f80d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47648/0 (socket says 172.21.15.5:47648) 2023-07-14T13:06:15.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.622+0000 7ff6f6ffd640 1 -- 172.21.15.5:0/4256308462 learned_addr learned my addr 172.21.15.5:0/4256308462 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:06:15.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.622+0000 7ff6f77fe640 1 --2- 172.21.15.5:0/4256308462 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6f80d2300 0x7ff6f80d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:15.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.622+0000 7ff6f67fc640 1 -- 172.21.15.5:0/4256308462 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3763656273 0 0) 0x7ff6f80b04c0 con 0x7ff6f815bde0 2023-07-14T13:06:15.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.622+0000 7ff6f67fc640 1 -- 172.21.15.5:0/4256308462 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6e4003530 con 0x7ff6f815bde0 2023-07-14T13:06:15.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.622+0000 7ff6f67fc640 1 -- 172.21.15.5:0/4256308462 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1391364054 0 0) 0x7ff6f80b1060 con 0x7ff6f80d2fc0 2023-07-14T13:06:15.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.622+0000 7ff6f67fc640 1 -- 172.21.15.5:0/4256308462 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6f80b04c0 con 0x7ff6f80d2fc0 2023-07-14T13:06:15.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.622+0000 7ff6f77fe640 1 -- 172.21.15.5:0/4256308462 >> v1:172.21.15.154:6789/0 conn(0x7ff6f80d2fc0 legacy=0x7ff6f80b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:15.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.622+0000 7ff6f77fe640 1 -- 172.21.15.5:0/4256308462 >> v1:172.21.15.5:6789/0 conn(0x7ff6f815bde0 legacy=0x7ff6f80d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:15.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.622+0000 7ff6f77fe640 1 -- 172.21.15.5:0/4256308462 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f80d0aa0 con 0x7ff6f80d2300 2023-07-14T13:06:15.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.626+0000 7ff6f77fe640 1 --2- 172.21.15.5:0/4256308462 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6f80d2300 0x7ff6f80d2780 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0009dc0 tx=0x7ff6f001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=987aa06fd38e1853 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:15.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.626+0000 7ff6f67fc640 1 -- 172.21.15.5:0/4256308462 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f00a5940 con 0x7ff6f80d2300 2023-07-14T13:06:15.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.626+0000 7ff6f67fc640 1 -- 172.21.15.5:0/4256308462 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f00a5aa0 con 0x7ff6f80d2300 2023-07-14T13:06:15.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.626+0000 7ff6f67fc640 1 -- 172.21.15.5:0/4256308462 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f00a5e10 con 0x7ff6f80d2300 2023-07-14T13:06:15.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.626+0000 7ff6fd9fa640 1 -- 172.21.15.5:0/4256308462 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6f80d2300 msgr2=0x7ff6f80d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:15.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.626+0000 7ff6fd9fa640 1 --2- 172.21.15.5:0/4256308462 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6f80d2300 0x7ff6f80d2780 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0009dc0 tx=0x7ff6f001c970 comp rx=0 tx=0).stop 2023-07-14T13:06:15.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.626+0000 7ff6fd9fa640 1 -- 172.21.15.5:0/4256308462 shutdown_connections 2023-07-14T13:06:15.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.626+0000 7ff6fd9fa640 1 --2- 172.21.15.5:0/4256308462 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6f80d2300 0x7ff6f80d2780 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:15.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.626+0000 7ff6fd9fa640 1 -- 172.21.15.5:0/4256308462 >> 172.21.15.5:0/4256308462 conn(0x7ff6f80659d0 msgr2=0x7ff6f809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:15.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.626+0000 7ff6fd9fa640 1 -- 172.21.15.5:0/4256308462 shutdown_connections 2023-07-14T13:06:15.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.626+0000 7ff6fd9fa640 1 -- 172.21.15.5:0/4256308462 wait complete. 2023-07-14T13:06:15.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.626+0000 7ff6fd9fa640 1 Processor -- start 2023-07-14T13:06:15.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.626+0000 7ff6fd9fa640 1 -- start start 2023-07-14T13:06:15.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.626+0000 7ff6fd9fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6f80d2300 0x7ff6f815ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:15.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.626+0000 7ff6fd9fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6f80d2fc0 0x7ff6f814a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:15.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.626+0000 7ff6fd9fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6f815bde0 0x7ff6f80b6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:15.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.630+0000 7ff6fd9fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f815e570 con 0x7ff6f80d2fc0 2023-07-14T13:06:15.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.630+0000 7ff6fd9fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f81527e0 con 0x7ff6f80d2300 2023-07-14T13:06:15.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.630+0000 7ff6fd9fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f8152220 con 0x7ff6f815bde0 2023-07-14T13:06:15.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.630+0000 7ff6effff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6f80d2fc0 0x7ff6f814a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:15.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.630+0000 7ff6effff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6f80d2fc0 0x7ff6f814a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52386/0 (socket says 172.21.15.5:52386) 2023-07-14T13:06:15.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.630+0000 7ff6effff640 1 -- 172.21.15.5:0/3273066542 learned_addr learned my addr 172.21.15.5:0/3273066542 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:15.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.630+0000 7ff6f6ffd640 1 --2- 172.21.15.5:0/3273066542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6f80d2300 0x7ff6f815ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:15.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.630+0000 7ff6f77fe640 1 --2- 172.21.15.5:0/3273066542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6f815bde0 0x7ff6f80b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:15.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.630+0000 7ff6effff640 1 -- 172.21.15.5:0/3273066542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6f815bde0 msgr2=0x7ff6f80b6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:15.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.630+0000 7ff6effff640 1 --2- 172.21.15.5:0/3273066542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6f815bde0 0x7ff6f80b6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:15.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.630+0000 7ff6effff640 1 -- 172.21.15.5:0/3273066542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6f80d2300 msgr2=0x7ff6f815ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:15.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.630+0000 7ff6effff640 1 --2- 172.21.15.5:0/3273066542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6f80d2300 0x7ff6f815ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:15.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.630+0000 7ff6effff640 1 -- 172.21.15.5:0/3273066542 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f0009a70 con 0x7ff6f80d2fc0 2023-07-14T13:06:15.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.630+0000 7ff6effff640 1 --2- 172.21.15.5:0/3273066542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6f80d2fc0 0x7ff6f814a8d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff6e000c370 tx=0x7ff6e000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:15.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.630+0000 7ff6f4ff9640 1 -- 172.21.15.5:0/3273066542 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e00052d0 con 0x7ff6f80d2fc0 2023-07-14T13:06:15.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.630+0000 7ff6f4ff9640 1 -- 172.21.15.5:0/3273066542 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e0005430 con 0x7ff6f80d2fc0 2023-07-14T13:06:15.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.630+0000 7ff6f4ff9640 1 -- 172.21.15.5:0/3273066542 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0003840 con 0x7ff6f80d2fc0 2023-07-14T13:06:15.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.630+0000 7ff6fd9fa640 1 -- 172.21.15.5:0/3273066542 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f8152500 con 0x7ff6f80d2fc0 2023-07-14T13:06:15.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.630+0000 7ff6fd9fa640 1 -- 172.21.15.5:0/3273066542 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f80b5f30 con 0x7ff6f80d2fc0 2023-07-14T13:06:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.630+0000 7ff6fd9fa640 1 -- 172.21.15.5:0/3273066542 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f80cf920 con 0x7ff6f80d2fc0 2023-07-14T13:06:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.634+0000 7ff6f4ff9640 1 -- 172.21.15.5:0/3273066542 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) v1 ==== 85777+0+0 (secure 0 0 0) 0x7ff6e00039a0 con 0x7ff6f80d2fc0 2023-07-14T13:06:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.634+0000 7ff6f4ff9640 1 --2- 172.21.15.5:0/3273066542 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ff6d80663f0 0x7ff6d80688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.634+0000 7ff6f4ff9640 1 -- 172.21.15.5:0/3273066542 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff6e00834d0 con 0x7ff6f80d2fc0 2023-07-14T13:06:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.634+0000 7ff6f6ffd640 1 -- 172.21.15.5:0/3273066542 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ff6d80663f0 msgr2=0x7ff6d80688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1810553301 2023-07-14T13:06:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.634+0000 7ff6f6ffd640 1 --2- 172.21.15.5:0/3273066542 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ff6d80663f0 0x7ff6d80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:06:15.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.638+0000 7ff6f4ff9640 1 -- 172.21.15.5:0/3273066542 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff6e0050850 con 0x7ff6f80d2fc0 2023-07-14T13:06:15.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.814+0000 7ff6fd9fa640 1 -- 172.21.15.5:0/3273066542 --> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6f80b0150 con 0x7ff6d80663f0 2023-07-14T13:06:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.838+0000 7ff6f6ffd640 1 -- 172.21.15.5:0/3273066542 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ff6d80663f0 msgr2=0x7ff6d80688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1810553301 2023-07-14T13:06:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:15.838+0000 7ff6f6ffd640 1 --2- 172.21.15.5:0/3273066542 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ff6d80663f0 0x7ff6d80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-14T13:06:15.946 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:15.917+0000 7f6008fe6180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:06:16.004 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:15.977+0000 7f6008fe6180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:06:16.015 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:06:15.982+0000 7f6a96a46180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:06:16.060 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:16.033+0000 7f6008fe6180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:06:16.077 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:06:16.046+0000 7f6a96a46180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:06:16.135 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:06:16.102+0000 7f6a96a46180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:06:16.146 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:16.117+0000 7f6008fe6180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:06:16.203 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:16.177+0000 7f6008fe6180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:06:16.226 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:06:16.194+0000 7f6a96a46180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:06:16.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:16.242+0000 7ff6f6ffd640 1 -- 172.21.15.5:0/3273066542 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ff6d80663f0 msgr2=0x7ff6d80688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1810553301 2023-07-14T13:06:16.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:16.242+0000 7ff6f6ffd640 1 --2- 172.21.15.5:0/3273066542 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ff6d80663f0 0x7ff6d80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-14T13:06:16.287 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:06:16.254+0000 7f6a96a46180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:06:16.288 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:16.261+0000 7f6008fe6180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:06:16.344 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:16.317+0000 7f6008fe6180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:06:16.375 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:06:16.342+0000 7f6a96a46180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:06:16.434 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:06:16.402+0000 7f6a96a46180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:06:16.487 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:16.457+0000 7f6008fe6180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:06:16.544 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:16.517+0000 7f6008fe6180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:06:16.584 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:06:16.554+0000 7f6a96a46180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:06:16.645 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:06:16.614+0000 7f6a96a46180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:06:16.785 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:06:16.786 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:06:16.786 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:06:16.795 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:16.769+0000 7f6008fe6180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:06:16.895 INFO:tasks.ceph.mgr.y.smithi005.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:06:16.896 INFO:tasks.ceph.mgr.y.smithi005.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:06:16.896 INFO:tasks.ceph.mgr.y.smithi005.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:06:16.903 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:06:16.874+0000 7f6a96a46180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:06:16.928 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:16.901+0000 7f6008fe6180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:06:17.044 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:06:17.014+0000 7f6a96a46180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:06:17.053 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:17.025+0000 7f6008fe6180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:06:17.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:17.046+0000 7ff6f6ffd640 1 -- 172.21.15.5:0/3273066542 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ff6d80663f0 msgr2=0x7ff6d80688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1810553301 2023-07-14T13:06:17.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:17.046+0000 7ff6f6ffd640 1 --2- 172.21.15.5:0/3273066542 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ff6d80663f0 0x7ff6d80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-14T13:06:17.125 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:17.097+0000 7f6008fe6180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:06:17.177 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:06:17.146+0000 7f6a96a46180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:06:17.252 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:06:17.222+0000 7f6a96a46180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:06:17.259 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:17.233+0000 7f6008fe6180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:06:17.393 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:06:17.362+0000 7f6a96a46180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:06:17.489 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:06:17.492 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:06:17.804 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:17.777+0000 7f6008fe6180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:06:17.891 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:17.865+0000 7f6008fe6180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:06:17.963 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:06:17.934+0000 7f6a96a46180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:06:18.039 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:18.009+0000 7f6008fe6180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:06:18.052 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:06:18.022+0000 7f6a96a46180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:06:18.123 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:18.097+0000 7f6008fe6180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:06:18.208 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:06:18.178+0000 7f6a96a46180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:06:18.296 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:06:18.266+0000 7f6a96a46180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:06:18.394 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:18.365+0000 7f6008fe6180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:06:18.455 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:18.425+0000 7f6008fe6180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:06:18.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:18.434+0000 7ff6f4ff9640 1 -- 172.21.15.5:0/3273066542 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 22) v1 ==== 85386+0+0 (secure 0 0 0) 0x7ff6e0050c20 con 0x7ff6f80d2fc0 2023-07-14T13:06:18.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:18.434+0000 7ff6f4ff9640 1 -- 172.21.15.5:0/3273066542 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ff6d80663f0 msgr2=0x7ff6d80688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:06:18.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:18.434+0000 7ff6f4ff9640 1 --2- 172.21.15.5:0/3273066542 >> [v2:172.21.15.154:6832/1810553301,v1:172.21.15.154:6833/1810553301] conn(0x7ff6d80663f0 0x7ff6d80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:18.591 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:18.565+0000 7f5f8b156640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:06:18.592 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:18.565+0000 7f5f8b156640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:06:18.592 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:18.565+0000 7f5f8b156640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:06:18.592 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:18.565+0000 7f5f8b156640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:06:18.592 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:18.565+0000 7f5f8b156640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:06:18.593 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:18.565+0000 7f5f88150640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:06:18.593 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:18.565+0000 7f5f88150640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:06:18.593 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:18.565+0000 7f5f88150640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:06:18.593 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:18.565+0000 7f5f88150640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:06:18.593 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:06:18.565+0000 7f5f88150640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:06:18.601 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:06:18.570+0000 7f6a96a46180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:06:18.666 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:06:18.634+0000 7f6a96a46180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:06:19.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.442+0000 7ff6f4ff9640 1 -- 172.21.15.5:0/3273066542 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mgrmap(e 23) v1 ==== 85513+0+0 (secure 0 0 0) 0x7ff6e0083110 con 0x7ff6f80d2fc0 2023-07-14T13:06:19.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.442+0000 7ff6f4ff9640 1 --2- 172.21.15.5:0/3273066542 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7ff6d8033e90 0x7ff6d80708c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:19.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.442+0000 7ff6f4ff9640 1 -- 172.21.15.5:0/3273066542 --> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6d8034260 con 0x7ff6d8033e90 2023-07-14T13:06:19.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.446+0000 7ff6f6ffd640 1 --2- 172.21.15.5:0/3273066542 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7ff6d8033e90 0x7ff6d80708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:19.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.450+0000 7ff6f6ffd640 1 --2- 172.21.15.5:0/3273066542 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7ff6d8033e90 0x7ff6d80708c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8001010 tx=0x7ff6e8007b90 comp rx=0 tx=0).ready entity=mgr.6064 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:19.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.518+0000 7ff6f4ff9640 1 -- 172.21.15.5:0/3273066542 <== mgr.6064 v2:172.21.15.154:6832/497535468 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff6d8034260 con 0x7ff6d8033e90 2023-07-14T13:06:19.549 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule set for path snap_test_dir1 2023-07-14T13:06:19.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.518+0000 7ff6fd9fa640 1 -- 172.21.15.5:0/3273066542 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7ff6d8033e90 msgr2=0x7ff6d80708c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.518+0000 7ff6fd9fa640 1 --2- 172.21.15.5:0/3273066542 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7ff6d8033e90 0x7ff6d80708c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8001010 tx=0x7ff6e8007b90 comp rx=0 tx=0).stop 2023-07-14T13:06:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.518+0000 7ff6fd9fa640 1 -- 172.21.15.5:0/3273066542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6f80d2fc0 msgr2=0x7ff6f814a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.518+0000 7ff6fd9fa640 1 --2- 172.21.15.5:0/3273066542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6f80d2fc0 0x7ff6f814a8d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff6e000c370 tx=0x7ff6e000c830 comp rx=0 tx=0).stop 2023-07-14T13:06:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.518+0000 7ff6f77fe640 1 -- 172.21.15.5:0/3273066542 reap_dead start 2023-07-14T13:06:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.518+0000 7ff6fd9fa640 1 -- 172.21.15.5:0/3273066542 shutdown_connections 2023-07-14T13:06:19.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.518+0000 7ff6fd9fa640 1 -- 172.21.15.5:0/3273066542 >> 172.21.15.5:0/3273066542 conn(0x7ff6f80659d0 msgr2=0x7ff6f806afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.518+0000 7ff6fd9fa640 1 -- 172.21.15.5:0/3273066542 shutdown_connections 2023-07-14T13:06:19.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.518+0000 7ff6fd9fa640 1 -- 172.21.15.5:0/3273066542 wait complete. 2023-07-14T13:06:19.571 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-14T13:06:19.572 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 2M 2023-07-14T13:06:19.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.690+0000 7f5b2ebfa640 1 Processor -- start 2023-07-14T13:06:19.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.690+0000 7f5b2ebfa640 1 -- start start 2023-07-14T13:06:19.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.690+0000 7f5b2ebfa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5b28069430 0x7f5b28069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:19.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.694+0000 7f5b2ebfa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5b28070f30 0x7f5b280ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:19.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.694+0000 7f5b2ebfa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b280af2b0 0x7f5b2815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:19.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.694+0000 7f5b2ebfa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b28159d70 con 0x7f5b28070f30 2023-07-14T13:06:19.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.694+0000 7f5b2ebfa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b28069d40 con 0x7f5b28069430 2023-07-14T13:06:19.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.694+0000 7f5b2ebfa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b280c9c60 con 0x7f5b280af2b0 2023-07-14T13:06:19.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.694+0000 7f5b27fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5b28070f30 0x7f5b280ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:19.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.694+0000 7f5b27fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5b28070f30 0x7f5b280ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36644/0 (socket says 172.21.15.5:36644) 2023-07-14T13:06:19.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.694+0000 7f5b2c996640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5b28069430 0x7f5b28069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:19.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.694+0000 7f5b27fff640 1 -- 172.21.15.5:0/4139784574 learned_addr learned my addr 172.21.15.5:0/4139784574 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:19.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.694+0000 7f5b2d197640 1 --2- 172.21.15.5:0/4139784574 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b280af2b0 0x7f5b2815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:19.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.694+0000 7f5b27fff640 1 -- 172.21.15.5:0/4139784574 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b280af2b0 msgr2=0x7f5b2815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:19.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.694+0000 7f5b27fff640 1 --2- 172.21.15.5:0/4139784574 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b280af2b0 0x7f5b2815a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:19.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.694+0000 7f5b27fff640 1 -- 172.21.15.5:0/4139784574 >> v2:172.21.15.154:3300/0 conn(0x7f5b28069430 msgr2=0x7f5b28069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:19.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.694+0000 7f5b27fff640 1 --2- 172.21.15.5:0/4139784574 >> v2:172.21.15.154:3300/0 conn(0x7f5b28069430 0x7f5b28069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:19.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.694+0000 7f5b27fff640 1 -- 172.21.15.5:0/4139784574 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b280c9f40 con 0x7f5b28070f30 2023-07-14T13:06:19.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.694+0000 7f5b2c996640 1 --2- 172.21.15.5:0/4139784574 >> v2:172.21.15.154:3300/0 conn(0x7f5b28069430 0x7f5b28069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:06:19.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.694+0000 7f5b27fff640 1 --2- 172.21.15.5:0/4139784574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b28070f30 0x7f5b280ad6f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5b28071910 tx=0x7f5b1401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce9338cb0cd80d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:19.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.698+0000 7f5b277fe640 1 -- 172.21.15.5:0/4139784574 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b140aa620 con 0x7f5b28070f30 2023-07-14T13:06:19.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.698+0000 7f5b277fe640 1 -- 172.21.15.5:0/4139784574 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b140aa780 con 0x7f5b28070f30 2023-07-14T13:06:19.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.698+0000 7f5b277fe640 1 -- 172.21.15.5:0/4139784574 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b140aab10 con 0x7f5b28070f30 2023-07-14T13:06:19.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.698+0000 7f5b2ebfa640 1 -- 172.21.15.5:0/4139784574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b28070f30 msgr2=0x7f5b280ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:19.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.698+0000 7f5b2ebfa640 1 --2- 172.21.15.5:0/4139784574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b28070f30 0x7f5b280ad6f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5b28071910 tx=0x7f5b1401c500 comp rx=0 tx=0).stop 2023-07-14T13:06:19.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.698+0000 7f5b2ebfa640 1 -- 172.21.15.5:0/4139784574 shutdown_connections 2023-07-14T13:06:19.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.698+0000 7f5b2ebfa640 1 --2- 172.21.15.5:0/4139784574 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b280af2b0 0x7f5b2815a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:19.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.698+0000 7f5b2ebfa640 1 --2- 172.21.15.5:0/4139784574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b28070f30 0x7f5b280ad6f0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:19.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.698+0000 7f5b2ebfa640 1 --2- 172.21.15.5:0/4139784574 >> v2:172.21.15.154:3300/0 conn(0x7f5b28069430 0x7f5b28069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:19.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.698+0000 7f5b2ebfa640 1 -- 172.21.15.5:0/4139784574 >> 172.21.15.5:0/4139784574 conn(0x7f5b280cde90 msgr2=0x7f5b280ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:19.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.698+0000 7f5b2ebfa640 1 -- 172.21.15.5:0/4139784574 shutdown_connections 2023-07-14T13:06:19.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.698+0000 7f5b2ebfa640 1 -- 172.21.15.5:0/4139784574 wait complete. 2023-07-14T13:06:19.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.698+0000 7f5b2ebfa640 1 Processor -- start 2023-07-14T13:06:19.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.698+0000 7f5b2ebfa640 1 -- start start 2023-07-14T13:06:19.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.698+0000 7f5b2ebfa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b28069430 0x7f5b28145040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:19.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.698+0000 7f5b2ebfa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b28070f30 0x7f5b280cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:19.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.698+0000 7f5b2ebfa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b280af2b0 0x7f5b280cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:19.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.698+0000 7f5b2ebfa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2814bf80 con 0x7f5b28069430 2023-07-14T13:06:19.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.698+0000 7f5b2ebfa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2814d380 con 0x7f5b280af2b0 2023-07-14T13:06:19.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.698+0000 7f5b2ebfa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2806c290 con 0x7f5b28070f30 2023-07-14T13:06:19.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.698+0000 7f5b2c996640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b28069430 0x7f5b28145040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:19.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.698+0000 7f5b2c996640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b28069430 0x7f5b28145040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36650/0 (socket says 172.21.15.5:36650) 2023-07-14T13:06:19.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.698+0000 7f5b2c996640 1 -- 172.21.15.5:0/3936073581 learned_addr learned my addr 172.21.15.5:0/3936073581 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:19.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.698+0000 7f5b27fff640 1 --2- 172.21.15.5:0/3936073581 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b28070f30 0x7f5b280cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:19.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.698+0000 7f5b2d197640 1 --2- 172.21.15.5:0/3936073581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b280af2b0 0x7f5b280cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:19.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.702+0000 7f5b2c996640 1 -- 172.21.15.5:0/3936073581 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b28070f30 msgr2=0x7f5b280cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:19.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.702+0000 7f5b2c996640 1 --2- 172.21.15.5:0/3936073581 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b28070f30 0x7f5b280cba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:19.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.702+0000 7f5b2c996640 1 -- 172.21.15.5:0/3936073581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b280af2b0 msgr2=0x7f5b280cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:19.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.702+0000 7f5b2c996640 1 --2- 172.21.15.5:0/3936073581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b280af2b0 0x7f5b280cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:19.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.702+0000 7f5b2c996640 1 -- 172.21.15.5:0/3936073581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c009420 con 0x7f5b28069430 2023-07-14T13:06:19.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.702+0000 7f5b2c996640 1 --2- 172.21.15.5:0/3936073581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b28069430 0x7f5b28145040 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00e980 tx=0x7f5b1c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:19.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.702+0000 7f5b257fa640 1 -- 172.21.15.5:0/3936073581 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c00ca00 con 0x7f5b28069430 2023-07-14T13:06:19.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.702+0000 7f5b257fa640 1 -- 172.21.15.5:0/3936073581 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1c00cb60 con 0x7f5b28069430 2023-07-14T13:06:19.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.702+0000 7f5b2ebfa640 1 -- 172.21.15.5:0/3936073581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b140094d0 con 0x7f5b28069430 2023-07-14T13:06:19.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.702+0000 7f5b257fa640 1 -- 172.21.15.5:0/3936073581 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c013470 con 0x7f5b28069430 2023-07-14T13:06:19.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.702+0000 7f5b2ebfa640 1 -- 172.21.15.5:0/3936073581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2814b780 con 0x7f5b28069430 2023-07-14T13:06:19.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.702+0000 7f5b2ebfa640 1 -- 172.21.15.5:0/3936073581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2806a360 con 0x7f5b28069430 2023-07-14T13:06:19.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.702+0000 7f5b257fa640 1 -- 172.21.15.5:0/3936073581 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 23) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f5b1c0135d0 con 0x7f5b28069430 2023-07-14T13:06:19.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.702+0000 7f5b257fa640 1 --2- 172.21.15.5:0/3936073581 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f5b0c066120 0x7f5b0c0685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:19.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.702+0000 7f5b257fa640 1 -- 172.21.15.5:0/3936073581 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f5b1c083d40 con 0x7f5b28069430 2023-07-14T13:06:19.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.706+0000 7f5b27fff640 1 --2- 172.21.15.5:0/3936073581 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f5b0c066120 0x7f5b0c0685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:19.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.706+0000 7f5b27fff640 1 --2- 172.21.15.5:0/3936073581 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f5b0c066120 0x7f5b0c0685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5b140ae000 tx=0x7f5b140b5040 comp rx=0 tx=0).ready entity=mgr.6064 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:19.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.710+0000 7f5b257fa640 1 -- 172.21.15.5:0/3936073581 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f5b1c051380 con 0x7f5b28069430 2023-07-14T13:06:19.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.882+0000 7f5b2ebfa640 1 -- 172.21.15.5:0/3936073581 --> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "2M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b2814d720 con 0x7f5b0c066120 2023-07-14T13:06:19.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.934+0000 7f5b257fa640 1 -- 172.21.15.5:0/3936073581 <== mgr.6064 v2:172.21.15.154:6832/497535468 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5b2814d720 con 0x7f5b0c066120 2023-07-14T13:06:19.967 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule set for path snap_test_dir1 2023-07-14T13:06:19.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.938+0000 7f5b2ebfa640 1 -- 172.21.15.5:0/3936073581 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f5b0c066120 msgr2=0x7f5b0c0685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:19.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.938+0000 7f5b2ebfa640 1 --2- 172.21.15.5:0/3936073581 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f5b0c066120 0x7f5b0c0685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5b140ae000 tx=0x7f5b140b5040 comp rx=0 tx=0).stop 2023-07-14T13:06:19.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.938+0000 7f5b2ebfa640 1 -- 172.21.15.5:0/3936073581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b28069430 msgr2=0x7f5b28145040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:19.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.938+0000 7f5b2ebfa640 1 --2- 172.21.15.5:0/3936073581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b28069430 0x7f5b28145040 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00e980 tx=0x7f5b1c00ee40 comp rx=0 tx=0).stop 2023-07-14T13:06:19.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.938+0000 7f5b2ebfa640 1 -- 172.21.15.5:0/3936073581 shutdown_connections 2023-07-14T13:06:19.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.938+0000 7f5b2ebfa640 1 --2- 172.21.15.5:0/3936073581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b280af2b0 0x7f5b280cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:19.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.938+0000 7f5b2ebfa640 1 --2- 172.21.15.5:0/3936073581 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b28070f30 0x7f5b280cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:19.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.938+0000 7f5b2ebfa640 1 --2- 172.21.15.5:0/3936073581 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f5b0c066120 0x7f5b0c0685d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:19.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.938+0000 7f5b2ebfa640 1 --2- 172.21.15.5:0/3936073581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b28069430 0x7f5b28145040 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:19.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.938+0000 7f5b2ebfa640 1 -- 172.21.15.5:0/3936073581 >> 172.21.15.5:0/3936073581 conn(0x7f5b280cde90 msgr2=0x7f5b2806fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:19.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.938+0000 7f5b2ebfa640 1 -- 172.21.15.5:0/3936073581 shutdown_connections 2023-07-14T13:06:19.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:19.938+0000 7f5b2ebfa640 1 -- 172.21.15.5:0/3936073581 wait complete. 2023-07-14T13:06:19.987 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-14T13:06:19.988 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-07-14-13_07_00 in ~41s... 2023-07-14T13:06:19.988 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-07-14-13_08_00 in ~101s... 2023-07-14T13:06:19.988 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M', '2M'], expected_retention: [] 2023-07-14T13:06:19.989 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-07-14T13:06:20.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.106+0000 7fa37aa34640 1 Processor -- start 2023-07-14T13:06:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.106+0000 7fa37aa34640 1 -- start start 2023-07-14T13:06:20.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.110+0000 7fa37aa34640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa37415cef0 0x7fa374158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:20.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.110+0000 7fa37aa34640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3741532b0 con 0x7fa374159270 2023-07-14T13:06:20.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.110+0000 7fa37aa34640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3740ca6f0 con 0x7fa3740aeb40 2023-07-14T13:06:20.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.110+0000 7fa37aa34640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37415d360 con 0x7fa37415cef0 2023-07-14T13:06:20.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.110+0000 7fa378fd1640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa374159270 0x7fa3740c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:54358/0 (socket says 172.21.15.5:54358) 2023-07-14T13:06:20.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.110+0000 7fa378fd1640 1 -- 172.21.15.5:0/2676271658 learned_addr learned my addr 172.21.15.5:0/2676271658 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:06:20.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.110+0000 7fa3737fe640 1 --2- 172.21.15.5:0/2676271658 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa37415cef0 0x7fa374158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:20.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.110+0000 7fa372ffd640 1 -- 172.21.15.5:0/2676271658 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3869147679 0 0) 0x7fa3741532b0 con 0x7fa374159270 2023-07-14T13:06:20.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.110+0000 7fa372ffd640 1 -- 172.21.15.5:0/2676271658 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa35c003530 con 0x7fa374159270 2023-07-14T13:06:20.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.110+0000 7fa372ffd640 1 -- 172.21.15.5:0/2676271658 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2271243936 0 0) 0x7fa3740ca6f0 con 0x7fa3740aeb40 2023-07-14T13:06:20.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.110+0000 7fa372ffd640 1 -- 172.21.15.5:0/2676271658 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3741532b0 con 0x7fa3740aeb40 2023-07-14T13:06:20.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.110+0000 7fa3737fe640 1 -- 172.21.15.5:0/2676271658 >> v1:172.21.15.154:6789/0 conn(0x7fa3740aeb40 legacy=0x7fa3740aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:20.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.110+0000 7fa3737fe640 1 -- 172.21.15.5:0/2676271658 >> v1:172.21.15.5:6789/0 conn(0x7fa374159270 legacy=0x7fa3740c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:20.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.110+0000 7fa3737fe640 1 -- 172.21.15.5:0/2676271658 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3741599d0 con 0x7fa37415cef0 2023-07-14T13:06:20.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.114+0000 7fa3737fe640 1 --2- 172.21.15.5:0/2676271658 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa37415cef0 0x7fa374158d30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa3680097f0 tx=0x7fa36801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe9dc8405718bb74 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:20.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.114+0000 7fa372ffd640 1 -- 172.21.15.5:0/2676271658 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3680aa5f0 con 0x7fa37415cef0 2023-07-14T13:06:20.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.114+0000 7fa372ffd640 1 -- 172.21.15.5:0/2676271658 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3680aa750 con 0x7fa37415cef0 2023-07-14T13:06:20.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.114+0000 7fa372ffd640 1 -- 172.21.15.5:0/2676271658 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3680aaac0 con 0x7fa37415cef0 2023-07-14T13:06:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.114+0000 7fa37aa34640 1 -- 172.21.15.5:0/2676271658 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa37415cef0 msgr2=0x7fa374158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.114+0000 7fa37aa34640 1 --2- 172.21.15.5:0/2676271658 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa37415cef0 0x7fa374158d30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa3680097f0 tx=0x7fa36801c490 comp rx=0 tx=0).stop 2023-07-14T13:06:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.114+0000 7fa37aa34640 1 -- 172.21.15.5:0/2676271658 shutdown_connections 2023-07-14T13:06:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.114+0000 7fa37aa34640 1 --2- 172.21.15.5:0/2676271658 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa37415cef0 0x7fa374158d30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.114+0000 7fa37aa34640 1 -- 172.21.15.5:0/2676271658 >> 172.21.15.5:0/2676271658 conn(0x7fa3740cde90 msgr2=0x7fa3740ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.114+0000 7fa37aa34640 1 -- 172.21.15.5:0/2676271658 shutdown_connections 2023-07-14T13:06:20.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.114+0000 7fa37aa34640 1 -- 172.21.15.5:0/2676271658 wait complete. 2023-07-14T13:06:20.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.114+0000 7fa37aa34640 1 Processor -- start 2023-07-14T13:06:20.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.114+0000 7fa37aa34640 1 -- start start 2023-07-14T13:06:20.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.118+0000 7fa37aa34640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3740aeb40 0x7fa37414aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:20.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.118+0000 7fa37aa34640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa374159270 0x7fa37414a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:20.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.118+0000 7fa37aa34640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa37415cef0 0x7fa37406ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:20.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.118+0000 7fa37aa34640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37414a8d0 con 0x7fa37415cef0 2023-07-14T13:06:20.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.118+0000 7fa37aa34640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37406b1f0 con 0x7fa374159270 2023-07-14T13:06:20.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.118+0000 7fa37aa34640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37414b080 con 0x7fa3740aeb40 2023-07-14T13:06:20.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.118+0000 7fa378fd1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa37415cef0 0x7fa37406ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:20.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.118+0000 7fa378fd1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa37415cef0 0x7fa37406ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36658/0 (socket says 172.21.15.5:36658) 2023-07-14T13:06:20.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.118+0000 7fa378fd1640 1 -- 172.21.15.5:0/1961329308 learned_addr learned my addr 172.21.15.5:0/1961329308 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:06:20.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.118+0000 7fa3737fe640 1 --2- 172.21.15.5:0/1961329308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa374159270 0x7fa37414a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:20.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.118+0000 7fa373fff640 1 --2- 172.21.15.5:0/1961329308 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3740aeb40 0x7fa37414aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:20.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.118+0000 7fa378fd1640 1 -- 172.21.15.5:0/1961329308 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3740aeb40 msgr2=0x7fa37414aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:20.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.118+0000 7fa378fd1640 1 --2- 172.21.15.5:0/1961329308 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3740aeb40 0x7fa37414aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:20.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.118+0000 7fa378fd1640 1 -- 172.21.15.5:0/1961329308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa374159270 msgr2=0x7fa37414a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:20.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.118+0000 7fa378fd1640 1 --2- 172.21.15.5:0/1961329308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa374159270 0x7fa37414a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:20.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.118+0000 7fa378fd1640 1 -- 172.21.15.5:0/1961329308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa368009420 con 0x7fa37415cef0 2023-07-14T13:06:20.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.118+0000 7fa378fd1640 1 --2- 172.21.15.5:0/1961329308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa37415cef0 0x7fa37406ca90 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa36c00cba0 tx=0x7fa36c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:20.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.118+0000 7fa370ff9640 1 -- 172.21.15.5:0/1961329308 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c00ace0 con 0x7fa37415cef0 2023-07-14T13:06:20.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.118+0000 7fa370ff9640 1 -- 172.21.15.5:0/1961329308 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36c00ae40 con 0x7fa37415cef0 2023-07-14T13:06:20.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.118+0000 7fa370ff9640 1 -- 172.21.15.5:0/1961329308 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c012620 con 0x7fa37415cef0 2023-07-14T13:06:20.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.118+0000 7fa37aa34640 1 -- 172.21.15.5:0/1961329308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa37406b490 con 0x7fa37415cef0 2023-07-14T13:06:20.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.118+0000 7fa37aa34640 1 -- 172.21.15.5:0/1961329308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37406ba50 con 0x7fa37415cef0 2023-07-14T13:06:20.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.118+0000 7fa37aa34640 1 -- 172.21.15.5:0/1961329308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa37406bc40 con 0x7fa37415cef0 2023-07-14T13:06:20.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.118+0000 7fa370ff9640 1 -- 172.21.15.5:0/1961329308 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 23) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fa36c007070 con 0x7fa37415cef0 2023-07-14T13:06:20.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.122+0000 7fa370ff9640 1 --2- 172.21.15.5:0/1961329308 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7fa360066120 0x7fa3600685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:20.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.122+0000 7fa370ff9640 1 -- 172.21.15.5:0/1961329308 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fa36c083c50 con 0x7fa37415cef0 2023-07-14T13:06:20.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.122+0000 7fa373fff640 1 --2- 172.21.15.5:0/1961329308 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7fa360066120 0x7fa3600685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:20.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.122+0000 7fa373fff640 1 --2- 172.21.15.5:0/1961329308 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7fa360066120 0x7fa3600685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa3640011f0 tx=0x7fa364009040 comp rx=0 tx=0).ready entity=mgr.6064 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:20.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.126+0000 7fa370ff9640 1 -- 172.21.15.5:0/1961329308 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa36c054c70 con 0x7fa37415cef0 2023-07-14T13:06:20.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.298+0000 7fa37aa34640 1 -- 172.21.15.5:0/1961329308 --> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3740ad540 con 0x7fa360066120 2023-07-14T13:06:20.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.306+0000 7fa370ff9640 1 -- 172.21.15.5:0/1961329308 <== mgr.6064 v2:172.21.15.154:6832/497535468 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+76 (secure 0 0 0) 0x7fa3740ad540 con 0x7fa360066120 2023-07-14T13:06:20.338 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:06:20.338 INFO:teuthology.orchestra.run.smithi005.stdout:{"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-07-14T13:06:20.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.310+0000 7fa37aa34640 1 -- 172.21.15.5:0/1961329308 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7fa360066120 msgr2=0x7fa3600685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:20.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.310+0000 7fa37aa34640 1 --2- 172.21.15.5:0/1961329308 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7fa360066120 0x7fa3600685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa3640011f0 tx=0x7fa364009040 comp rx=0 tx=0).stop 2023-07-14T13:06:20.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.310+0000 7fa37aa34640 1 -- 172.21.15.5:0/1961329308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa37415cef0 msgr2=0x7fa37406ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:20.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.310+0000 7fa37aa34640 1 --2- 172.21.15.5:0/1961329308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa37415cef0 0x7fa37406ca90 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa36c00cba0 tx=0x7fa36c00a430 comp rx=0 tx=0).stop 2023-07-14T13:06:20.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.310+0000 7fa37aa34640 1 -- 172.21.15.5:0/1961329308 shutdown_connections 2023-07-14T13:06:20.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.310+0000 7fa37aa34640 1 --2- 172.21.15.5:0/1961329308 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7fa360066120 0x7fa3600685d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:20.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.310+0000 7fa37aa34640 1 --2- 172.21.15.5:0/1961329308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa37415cef0 0x7fa37406ca90 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:20.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.310+0000 7fa37aa34640 1 --2- 172.21.15.5:0/1961329308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa374159270 0x7fa37414a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:20.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.310+0000 7fa37aa34640 1 --2- 172.21.15.5:0/1961329308 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3740aeb40 0x7fa37414aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:20.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.310+0000 7fa37aa34640 1 -- 172.21.15.5:0/1961329308 >> 172.21.15.5:0/1961329308 conn(0x7fa3740cde90 msgr2=0x7fa3740ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:20.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.310+0000 7fa37aa34640 1 -- 172.21.15.5:0/1961329308 shutdown_connections 2023-07-14T13:06:20.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:06:20.310+0000 7fa37aa34640 1 -- 172.21.15.5:0/1961329308 wait complete. 2023-07-14T13:06:20.359 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-07-14T13:06:20.360 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M', '2M'], 'retention': [{}, {}]} 2023-07-14T13:06:20.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:20.360 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:20.371 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:20.371 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:20.371 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:21.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:21.373 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:21.385 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:21.386 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:21.387 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:22.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:22.389 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:22.401 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:22.401 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:22.402 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:23.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:23.403 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:23.415 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:23.416 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:23.416 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:24.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:24.417 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:24.429 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:24.430 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:24.430 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:25.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:25.433 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:25.445 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:25.446 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:25.446 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:26.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:26.447 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:26.459 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:26.460 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:26.460 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:27.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:27.462 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:27.474 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:27.474 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:27.474 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:28.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:28.476 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:28.488 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:28.488 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:28.489 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:29.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:29.490 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:29.502 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:29.503 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:29.503 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:30.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:30.505 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:30.517 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:30.518 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:30.519 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:31.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:31.521 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:31.532 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:31.533 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:31.533 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:32.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:32.535 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:32.548 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:32.548 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:32.548 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:33.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:33.550 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:33.562 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:33.562 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:33.563 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:34.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:34.565 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:34.577 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:34.577 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:34.578 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:35.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:35.579 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:35.591 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:35.591 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:35.592 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:36.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:36.593 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:36.605 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:36.606 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:36.606 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:37.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:37.607 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:37.620 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:37.621 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:37.621 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:38.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:38.623 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:38.635 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:38.636 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:38.636 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:39.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:39.638 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:39.650 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:39.650 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:39.651 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:40.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:40.652 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:40.664 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:40.664 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:40.664 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:41.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:41.666 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:41.678 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:41.679 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:41.679 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:42.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:42.681 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:42.693 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:42.693 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:42.693 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:43.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:43.695 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:43.706 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:43.707 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:43.707 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:44.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:44.709 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:44.720 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:44.721 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:44.721 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:45.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:45.722 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:45.734 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:45.734 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:45.734 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:46.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:46.736 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:46.748 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:46.749 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:46.749 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:47.587 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:06:47.591 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:06:47.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:47.750 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:47.762 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:47.762 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:47.762 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:48.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:48.765 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:48.778 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:48.778 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:48.779 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:49.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:49.781 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:49.793 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:49.793 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:49.793 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:50.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:50.795 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:50.807 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:50.807 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:50.807 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:51.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:51.809 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:51.821 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:51.821 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:51.821 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:52.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:52.823 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:52.835 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:52.835 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:52.835 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:53.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:53.837 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:53.849 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:53.850 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:53.850 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:54.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:54.851 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:54.863 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:54.864 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:54.864 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:55.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:55.866 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:55.878 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:55.878 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:55.879 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:56.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:56.880 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:56.892 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:56.893 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:56.893 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:57.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:57.895 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:57.917 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:57.917 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:57.918 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:58.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:58.919 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:58.931 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:58.931 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:58.932 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:06:59.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:06:59.933 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:06:59.945 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:06:59.946 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:06:59.946 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:00.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:00.947 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:00.959 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:07:00.959 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:00.959 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:00.979 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:07:00.952+0000 7f5f7a134640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:07:00.980 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:07:00.952+0000 7f5f7a134640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:07:00.980 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:07:00.952+0000 7f5f7a134640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:07:00.980 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:07:00.952+0000 7f5f7a134640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:07:00.980 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:07:00.952+0000 7f5f7a134640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:07:01.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:01.961 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:01.972 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:01.973 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:01.973 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:01.973 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:01.974 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-07-14-13_07_00_UTC'] 2023-07-14T13:07:01.974 DEBUG:tasks.cephfs.test_snap_schedules:exec=1689339979.9882736, now = 1689340021.974399, timo = 41 2023-07-14T13:07:02.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:02.975 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:02.986 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:02.987 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:02.987 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:02.988 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:03.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:03.989 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:04.000 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:04.001 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:04.001 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:04.001 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:05.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:05.002 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:05.013 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:05.014 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:05.014 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:05.015 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:06.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:06.017 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:06.029 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:06.029 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:06.030 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:06.030 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:07.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:07.031 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:07.042 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:07.043 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:07.043 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:07.044 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:08.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:08.045 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:08.056 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:08.057 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:08.057 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:08.057 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:09.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:09.059 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:09.070 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:09.071 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:09.071 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:09.071 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:10.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:10.073 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:10.083 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:10.084 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:10.085 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:10.085 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:11.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:11.086 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:11.098 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:11.099 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:11.099 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:11.099 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:12.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:12.101 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:12.113 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:12.114 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:12.114 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:12.115 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:13.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:13.117 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:13.128 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:13.129 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:13.129 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:13.129 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:14.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:14.131 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:14.142 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:14.143 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:14.143 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:14.143 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:15.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:15.146 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:15.157 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:15.158 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:15.159 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:15.159 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:16.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:16.161 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:16.172 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:16.173 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:16.173 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:16.174 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:17.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:17.175 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:17.186 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:17.186 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:17.187 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:17.187 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:17.661 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:07:17.664 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:07:18.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:18.189 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:18.200 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:18.201 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:18.202 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:18.202 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:19.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:19.203 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:19.214 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:19.215 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:19.215 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:19.215 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:20.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:20.217 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:20.230 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:20.231 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:20.231 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:20.232 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:21.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:21.233 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:21.244 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:21.245 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:21.246 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:21.246 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:22.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:22.248 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:22.259 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:22.260 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:22.260 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:22.260 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:23.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:23.262 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:23.273 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:23.274 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:23.274 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:23.275 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:24.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:24.276 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:24.287 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:24.288 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:24.288 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:24.289 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:25.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:25.290 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:25.302 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:25.303 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:25.304 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:25.304 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:26.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:26.306 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:26.317 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:26.318 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:26.319 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:26.319 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:27.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:27.320 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:27.331 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:27.332 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:27.332 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:27.332 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:28.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:28.334 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:28.345 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:28.346 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:28.346 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:28.346 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:29.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:29.348 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:29.359 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:29.360 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:29.360 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:29.360 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:30.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:30.362 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:30.374 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:30.374 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:30.375 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:30.375 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:31.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:31.377 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:31.389 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:31.390 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:31.390 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:31.390 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:32.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:32.392 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:32.403 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:32.404 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:32.404 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:32.404 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:33.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:33.406 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:33.418 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:33.419 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:33.419 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:33.419 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:34.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:34.421 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:34.433 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:34.434 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:34.434 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:34.434 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:35.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:35.436 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:35.447 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:35.448 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:35.448 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:35.448 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:36.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:36.450 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:36.461 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:36.462 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:36.462 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:36.462 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:37.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:37.463 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:37.474 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:37.475 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:37.476 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:37.476 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:38.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:38.478 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:38.488 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:38.489 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:38.490 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:38.490 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:39.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:39.492 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:39.503 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:39.504 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:39.505 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:39.505 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:40.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:40.507 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:40.519 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:40.520 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:40.520 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:40.520 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:41.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:41.521 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:41.532 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:41.533 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:41.533 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:41.534 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:42.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:42.535 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:42.546 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:42.547 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:42.548 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:42.548 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:43.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:43.549 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:43.560 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:43.562 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:43.563 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:43.563 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:44.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:44.565 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:44.575 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:44.576 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:44.577 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:44.577 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:45.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:45.579 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:45.590 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:45.591 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:45.591 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:45.591 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:46.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:46.593 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:46.604 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:46.605 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:46.606 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:46.606 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:47.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:47.607 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:47.619 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:47.619 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:47.620 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:47.620 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:47.719 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:07:47.723 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:07:48.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:48.622 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:48.633 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:48.634 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:48.634 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:48.634 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:49.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:49.636 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:49.647 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:49.648 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:49.648 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:49.649 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:50.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:50.650 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:50.661 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:50.662 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:50.662 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:50.663 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:51.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:51.665 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:51.676 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:51.677 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:51.677 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:51.678 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:52.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:52.680 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:52.692 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:52.692 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:52.693 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:52.693 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:53.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:53.695 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:53.706 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:53.707 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:53.707 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:53.707 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:54.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:54.709 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:54.720 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:54.720 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:54.721 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:54.721 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:55.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:55.722 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:55.733 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:55.734 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:55.735 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:55.735 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:56.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:56.736 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:56.747 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:56.748 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:56.749 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:56.749 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:57.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:57.750 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:57.761 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:57.762 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:57.762 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:57.762 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:58.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:58.764 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:58.775 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:58.776 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:58.776 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:58.776 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:07:59.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:07:59.777 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:07:59.789 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:07:59.790 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC'} 2023-07-14T13:07:59.791 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:07:59.791 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:08:00.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:08:00.792 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:08:00.803 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:08:00.803 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_08_00_UTC 2023-07-14T13:08:00.804 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_07_00_UTC', 'scheduled-2023-07-14-13_08_00_UTC'} 2023-07-14T13:08:00.804 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-07-14-13_08_00_UTC'} 2023-07-14T13:08:00.805 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:08:00.805 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-07-14-13_08_00_UTC'] 2023-07-14T13:08:00.805 DEBUG:tasks.cephfs.test_snap_schedules:exec=1689339979.9882736, now = 1689340080.8056293, timo = 101 2023-07-14T13:08:01.806 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-07-14T13:08:01.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.932+0000 7ff0668e5640 1 Processor -- start 2023-07-14T13:08:01.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.932+0000 7ff0668e5640 1 -- start start 2023-07-14T13:08:01.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.932+0000 7ff0668e5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff060069430 0x7ff0600c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:01.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.932+0000 7ff0668e5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff060069800 0x7ff0600c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:01.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.932+0000 7ff0668e5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff060154280 con 0x7ff0600ca370 2023-07-14T13:08:01.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.932+0000 7ff0668e5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff06006d430 con 0x7ff060069430 2023-07-14T13:08:01.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.932+0000 7ff0668e5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06006cb00 con 0x7ff060069800 2023-07-14T13:08:01.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.932+0000 7ff05ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff060069430 0x7ff0600c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:01.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.932+0000 7ff05ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff060069430 0x7ff0600c2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55516/0 (socket says 172.21.15.5:55516) 2023-07-14T13:08:01.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.932+0000 7ff05ffff640 1 -- 172.21.15.5:0/3015830487 learned_addr learned my addr 172.21.15.5:0/3015830487 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:01.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.932+0000 7ff057fff640 1 --2- 172.21.15.5:0/3015830487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff060069800 0x7ff0600c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:01.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.932+0000 7ff05ffff640 1 -- 172.21.15.5:0/3015830487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff060069800 msgr2=0x7ff0600c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:01.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.932+0000 7ff05ffff640 1 --2- 172.21.15.5:0/3015830487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff060069800 0x7ff0600c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:01.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.932+0000 7ff05ffff640 1 -- 172.21.15.5:0/3015830487 >> v1:172.21.15.154:6789/0 conn(0x7ff0600ca370 legacy=0x7ff060159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:01.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.932+0000 7ff05ffff640 1 -- 172.21.15.5:0/3015830487 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06006cde0 con 0x7ff060069430 2023-07-14T13:08:01.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.936+0000 7ff05ffff640 1 --2- 172.21.15.5:0/3015830487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff060069430 0x7ff0600c2d30 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7ff050009870 tx=0x7ff05001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfeb9629a7f4cf4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:01.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.936+0000 7ff05f7fe640 1 -- 172.21.15.5:0/3015830487 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0500a6040 con 0x7ff060069430 2023-07-14T13:08:01.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.936+0000 7ff05f7fe640 1 -- 172.21.15.5:0/3015830487 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0500aa600 con 0x7ff060069430 2023-07-14T13:08:01.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.936+0000 7ff05f7fe640 1 -- 172.21.15.5:0/3015830487 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0500aa990 con 0x7ff060069430 2023-07-14T13:08:01.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.936+0000 7ff0668e5640 1 -- 172.21.15.5:0/3015830487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff060069430 msgr2=0x7ff0600c2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.936+0000 7ff0668e5640 1 --2- 172.21.15.5:0/3015830487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff060069430 0x7ff0600c2d30 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7ff050009870 tx=0x7ff05001c480 comp rx=0 tx=0).stop 2023-07-14T13:08:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.936+0000 7ff0668e5640 1 -- 172.21.15.5:0/3015830487 shutdown_connections 2023-07-14T13:08:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.936+0000 7ff0668e5640 1 --2- 172.21.15.5:0/3015830487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff060069800 0x7ff0600c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.936+0000 7ff0668e5640 1 --2- 172.21.15.5:0/3015830487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff060069430 0x7ff0600c2d30 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.936+0000 7ff0668e5640 1 -- 172.21.15.5:0/3015830487 >> 172.21.15.5:0/3015830487 conn(0x7ff0600cde50 msgr2=0x7ff0600ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.936+0000 7ff0668e5640 1 -- 172.21.15.5:0/3015830487 shutdown_connections 2023-07-14T13:08:01.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.936+0000 7ff0668e5640 1 -- 172.21.15.5:0/3015830487 wait complete. 2023-07-14T13:08:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.940+0000 7ff0668e5640 1 Processor -- start 2023-07-14T13:08:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.940+0000 7ff0668e5640 1 -- start start 2023-07-14T13:08:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.940+0000 7ff0668e5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff060069430 0x7ff0600cd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.940+0000 7ff0668e5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff060069800 0x7ff06014b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.940+0000 7ff0668e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff06013bad0 0x7ff0600aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:01.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.940+0000 7ff0668e5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06014c830 con 0x7ff06013bad0 2023-07-14T13:08:01.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.940+0000 7ff0668e5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06014b980 con 0x7ff060069800 2023-07-14T13:08:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.940+0000 7ff0668e5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06014bbb0 con 0x7ff060069430 2023-07-14T13:08:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.940+0000 7ff064e82640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff06013bad0 0x7ff0600aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.940+0000 7ff064e82640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff06013bad0 0x7ff0600aeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55532/0 (socket says 172.21.15.5:55532) 2023-07-14T13:08:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.940+0000 7ff064e82640 1 -- 172.21.15.5:0/1081430724 learned_addr learned my addr 172.21.15.5:0/1081430724 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.940+0000 7ff057fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff060069800 0x7ff06014b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.940+0000 7ff05ffff640 1 --2- 172.21.15.5:0/1081430724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff060069430 0x7ff0600cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:01.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.940+0000 7ff05ffff640 1 -- 172.21.15.5:0/1081430724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff060069800 msgr2=0x7ff06014b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:01.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.940+0000 7ff05ffff640 1 --2- 172.21.15.5:0/1081430724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff060069800 0x7ff06014b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:01.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.940+0000 7ff05ffff640 1 -- 172.21.15.5:0/1081430724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff06013bad0 msgr2=0x7ff0600aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:01.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.940+0000 7ff05ffff640 1 --2- 172.21.15.5:0/1081430724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff06013bad0 0x7ff0600aeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:01.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.940+0000 7ff05ffff640 1 -- 172.21.15.5:0/1081430724 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0500094d0 con 0x7ff060069430 2023-07-14T13:08:01.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.940+0000 7ff064e82640 1 --2- 172.21.15.5:0/1081430724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff06013bad0 0x7ff0600aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:01.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.940+0000 7ff05ffff640 1 --2- 172.21.15.5:0/1081430724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff060069430 0x7ff0600cd020 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff0500ab000 tx=0x7ff05001acc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:01.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.940+0000 7ff05d7fa640 1 -- 172.21.15.5:0/1081430724 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0500b3800 con 0x7ff060069430 2023-07-14T13:08:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.940+0000 7ff05d7fa640 1 -- 172.21.15.5:0/1081430724 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0500b39a0 con 0x7ff060069430 2023-07-14T13:08:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.940+0000 7ff05d7fa640 1 -- 172.21.15.5:0/1081430724 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0500b3d50 con 0x7ff060069430 2023-07-14T13:08:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.940+0000 7ff0668e5640 1 -- 172.21.15.5:0/1081430724 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0600c3e80 con 0x7ff060069430 2023-07-14T13:08:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.940+0000 7ff0668e5640 1 -- 172.21.15.5:0/1081430724 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff06014c170 con 0x7ff060069430 2023-07-14T13:08:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.944+0000 7ff0668e5640 1 -- 172.21.15.5:0/1081430724 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0600678d0 con 0x7ff060069430 2023-07-14T13:08:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.944+0000 7ff05d7fa640 1 -- 172.21.15.5:0/1081430724 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 26) v1 ==== 85789+0+0 (secure 0 0 0) 0x7ff0500c73a0 con 0x7ff060069430 2023-07-14T13:08:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.944+0000 7ff05d7fa640 1 --2- 172.21.15.5:0/1081430724 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7ff040066420 0x7ff0400688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.944+0000 7ff05d7fa640 1 -- 172.21.15.5:0/1081430724 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6464+0+0 (secure 0 0 0) 0x7ff05011e880 con 0x7ff060069430 2023-07-14T13:08:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.944+0000 7ff057fff640 1 --2- 172.21.15.5:0/1081430724 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7ff040066420 0x7ff0400688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:01.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.944+0000 7ff057fff640 1 --2- 172.21.15.5:0/1081430724 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7ff040066420 0x7ff0400688d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff060153960 tx=0x7ff048009190 comp rx=0 tx=0).ready entity=mgr.6064 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:01.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:01.948+0000 7ff05d7fa640 1 -- 172.21.15.5:0/1081430724 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff0500eb980 con 0x7ff060069430 2023-07-14T13:08:02.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.128+0000 7ff0668e5640 1 -- 172.21.15.5:0/1081430724 --> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0600c3d00 con 0x7ff040066420 2023-07-14T13:08:02.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.196+0000 7ff05d7fa640 1 -- 172.21.15.5:0/1081430724 <== mgr.6064 v2:172.21.15.154:6832/497535468 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff048011a30 con 0x7ff040066420 2023-07-14T13:08:02.231 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule removed for path snap_test_dir1 2023-07-14T13:08:02.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.200+0000 7ff0668e5640 1 -- 172.21.15.5:0/1081430724 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7ff040066420 msgr2=0x7ff0400688d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:02.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.200+0000 7ff0668e5640 1 --2- 172.21.15.5:0/1081430724 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7ff040066420 0x7ff0400688d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff060153960 tx=0x7ff048009190 comp rx=0 tx=0).stop 2023-07-14T13:08:02.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.200+0000 7ff0668e5640 1 -- 172.21.15.5:0/1081430724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff060069430 msgr2=0x7ff0600cd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:02.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.200+0000 7ff0668e5640 1 --2- 172.21.15.5:0/1081430724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff060069430 0x7ff0600cd020 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff0500ab000 tx=0x7ff05001acc0 comp rx=0 tx=0).stop 2023-07-14T13:08:02.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.200+0000 7ff0668e5640 1 -- 172.21.15.5:0/1081430724 shutdown_connections 2023-07-14T13:08:02.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.200+0000 7ff0668e5640 1 --2- 172.21.15.5:0/1081430724 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7ff040066420 0x7ff0400688d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:02.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.200+0000 7ff0668e5640 1 --2- 172.21.15.5:0/1081430724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff06013bad0 0x7ff0600aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:02.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.200+0000 7ff0668e5640 1 --2- 172.21.15.5:0/1081430724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff060069800 0x7ff06014b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:02.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.200+0000 7ff0668e5640 1 --2- 172.21.15.5:0/1081430724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff060069430 0x7ff0600cd020 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:02.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.200+0000 7ff0668e5640 1 -- 172.21.15.5:0/1081430724 >> 172.21.15.5:0/1081430724 conn(0x7ff0600cde50 msgr2=0x7ff060159fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:02.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.200+0000 7ff0668e5640 1 -- 172.21.15.5:0/1081430724 shutdown_connections 2023-07-14T13:08:02.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.200+0000 7ff0668e5640 1 -- 172.21.15.5:0/1081430724 wait complete. 2023-07-14T13:08:02.251 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-07-14T13:08:02.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:08:02.252 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:08:02.262 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:08:02.262 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_08_00_UTC 2023-07-14T13:08:02.263 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-14-13_07_00_UTC 2023-07-14T13:08:02.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:08:02.263 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-14-13_07_00_UTC) 2023-07-14T13:08:02.320 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-14-13_08_00_UTC 2023-07-14T13:08:02.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:08:02.321 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-14-13_08_00_UTC) 2023-07-14T13:08:02.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:08:02.377 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-14T13:08:02.431 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-14T13:08:02.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.588+0000 7f809d382640 1 Processor -- start 2023-07-14T13:08:02.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.588+0000 7f809d382640 1 -- start start 2023-07-14T13:08:02.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.588+0000 7f809d382640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8098156560 0x7f80980cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:02.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.588+0000 7f809d382640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80980b08d0 con 0x7f8098159500 2023-07-14T13:08:02.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.588+0000 7f809d382640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8098159cb0 con 0x7f80980ccf60 2023-07-14T13:08:02.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.588+0000 7f809d382640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80981599d0 con 0x7f8098156560 2023-07-14T13:08:02.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.588+0000 7f8096ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8098156560 0x7f80980cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:02.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.588+0000 7f80977fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8098159500 0x7f809806bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44750/0 (socket says 172.21.15.5:44750) 2023-07-14T13:08:02.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.588+0000 7f80977fe640 1 -- 172.21.15.5:0/136140249 learned_addr learned my addr 172.21.15.5:0/136140249 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:02.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.588+0000 7f8096ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8098156560 0x7f80980cb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55542/0 (socket says 172.21.15.5:55542) 2023-07-14T13:08:02.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.588+0000 7f8096ffd640 1 -- 172.21.15.5:0/136140249 >> v1:172.21.15.154:6789/0 conn(0x7f80980ccf60 legacy=0x7f8098158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:02.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.588+0000 7f8096ffd640 1 -- 172.21.15.5:0/136140249 >> v1:172.21.15.5:6789/0 conn(0x7f8098159500 legacy=0x7f809806bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:02.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.588+0000 7f8096ffd640 1 -- 172.21.15.5:0/136140249 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80980ca900 con 0x7f8098156560 2023-07-14T13:08:02.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.588+0000 7f80967fc640 1 -- 172.21.15.5:0/136140249 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942993845 0 0) 0x7f80980b08d0 con 0x7f8098159500 2023-07-14T13:08:02.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.592+0000 7f8096ffd640 1 --2- 172.21.15.5:0/136140249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8098156560 0x7f80980cb3e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f80880097c0 tx=0x7f808801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec24ddd3202e9ac server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:02.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.592+0000 7f80967fc640 1 -- 172.21.15.5:0/136140249 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80880ab650 con 0x7f8098156560 2023-07-14T13:08:02.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.592+0000 7f80967fc640 1 -- 172.21.15.5:0/136140249 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80880ab7b0 con 0x7f8098156560 2023-07-14T13:08:02.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.592+0000 7f80967fc640 1 -- 172.21.15.5:0/136140249 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80880abb40 con 0x7f8098156560 2023-07-14T13:08:02.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.592+0000 7f809d382640 1 -- 172.21.15.5:0/136140249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8098156560 msgr2=0x7f80980cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:02.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.592+0000 7f809d382640 1 --2- 172.21.15.5:0/136140249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8098156560 0x7f80980cb3e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f80880097c0 tx=0x7f808801c450 comp rx=0 tx=0).stop 2023-07-14T13:08:02.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.592+0000 7f809d382640 1 -- 172.21.15.5:0/136140249 shutdown_connections 2023-07-14T13:08:02.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.592+0000 7f809d382640 1 --2- 172.21.15.5:0/136140249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8098156560 0x7f80980cb3e0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:02.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.592+0000 7f809d382640 1 -- 172.21.15.5:0/136140249 >> 172.21.15.5:0/136140249 conn(0x7f80980afac0 msgr2=0x7f80980afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:02.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.592+0000 7f809d382640 1 -- 172.21.15.5:0/136140249 shutdown_connections 2023-07-14T13:08:02.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.592+0000 7f809d382640 1 -- 172.21.15.5:0/136140249 wait complete. 2023-07-14T13:08:02.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.596+0000 7f809d382640 1 Processor -- start 2023-07-14T13:08:02.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.596+0000 7f809d382640 1 -- start start 2023-07-14T13:08:02.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.596+0000 7f809d382640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80980ccf60 0x7f809814dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:02.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.596+0000 7f809d382640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8098156560 0x7f809814b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:02.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.596+0000 7f809d382640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8098159500 0x7f809814cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:02.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.596+0000 7f809d382640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809814c920 con 0x7f80980ccf60 2023-07-14T13:08:02.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.596+0000 7f809d382640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809814bd10 con 0x7f8098159500 2023-07-14T13:08:02.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.596+0000 7f809d382640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809814bff0 con 0x7f8098156560 2023-07-14T13:08:02.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.596+0000 7f8096ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80980ccf60 0x7f809814dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:02.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.596+0000 7f8096ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80980ccf60 0x7f809814dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55554/0 (socket says 172.21.15.5:55554) 2023-07-14T13:08:02.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.596+0000 7f8096ffd640 1 -- 172.21.15.5:0/4099351192 learned_addr learned my addr 172.21.15.5:0/4099351192 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:02.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.596+0000 7f808ffff640 1 --2- 172.21.15.5:0/4099351192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8098156560 0x7f809814b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:02.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.596+0000 7f80977fe640 1 --2- 172.21.15.5:0/4099351192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8098159500 0x7f809814cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.596+0000 7f8096ffd640 1 -- 172.21.15.5:0/4099351192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8098156560 msgr2=0x7f809814b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.596+0000 7f8096ffd640 1 --2- 172.21.15.5:0/4099351192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8098156560 0x7f809814b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.596+0000 7f8096ffd640 1 -- 172.21.15.5:0/4099351192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8098159500 msgr2=0x7f809814cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:02.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.596+0000 7f8096ffd640 1 --2- 172.21.15.5:0/4099351192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8098159500 0x7f809814cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:02.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.596+0000 7f8096ffd640 1 -- 172.21.15.5:0/4099351192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8088009420 con 0x7f80980ccf60 2023-07-14T13:08:02.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.596+0000 7f808ffff640 1 --2- 172.21.15.5:0/4099351192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8098156560 0x7f809814b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:02.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.596+0000 7f8096ffd640 1 --2- 172.21.15.5:0/4099351192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80980ccf60 0x7f809814dfc0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f80880ad040 tx=0x7f808801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:02.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.596+0000 7f808f7fe640 1 -- 172.21.15.5:0/4099351192 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80880b5810 con 0x7f80980ccf60 2023-07-14T13:08:02.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.596+0000 7f808f7fe640 1 -- 172.21.15.5:0/4099351192 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80880b59b0 con 0x7f80980ccf60 2023-07-14T13:08:02.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.596+0000 7f808f7fe640 1 -- 172.21.15.5:0/4099351192 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80880b5d60 con 0x7f80980ccf60 2023-07-14T13:08:02.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.596+0000 7f809d382640 1 -- 172.21.15.5:0/4099351192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f809814c2d0 con 0x7f80980ccf60 2023-07-14T13:08:02.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.596+0000 7f809d382640 1 -- 172.21.15.5:0/4099351192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80980c81d0 con 0x7f80980ccf60 2023-07-14T13:08:02.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.600+0000 7f809d382640 1 -- 172.21.15.5:0/4099351192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80980678d0 con 0x7f80980ccf60 2023-07-14T13:08:02.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.600+0000 7f808f7fe640 1 -- 172.21.15.5:0/4099351192 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) v1 ==== 85789+0+0 (secure 0 0 0) 0x7f80880b4390 con 0x7f80980ccf60 2023-07-14T13:08:02.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.600+0000 7f808f7fe640 1 --2- 172.21.15.5:0/4099351192 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f80780663f0 0x7f80780688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:02.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.600+0000 7f808f7fe640 1 -- 172.21.15.5:0/4099351192 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f808811edc0 con 0x7f80980ccf60 2023-07-14T13:08:02.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.600+0000 7f808ffff640 1 --2- 172.21.15.5:0/4099351192 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f80780663f0 0x7f80780688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:02.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.600+0000 7f808ffff640 1 --2- 172.21.15.5:0/4099351192 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f80780663f0 0x7f80780688a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f80981503e0 tx=0x7f8080009040 comp rx=0 tx=0).ready entity=mgr.6064 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:02.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.604+0000 7f808f7fe640 1 -- 172.21.15.5:0/4099351192 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f80880ebf20 con 0x7f80980ccf60 2023-07-14T13:08:02.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:02.800+0000 7f809d382640 1 -- 172.21.15.5:0/4099351192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f809814c130 con 0x7f80980ccf60 2023-07-14T13:08:03.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:03.760+0000 7f808f7fe640 1 -- 172.21.15.5:0/4099351192 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 27) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f80880ec2f0 con 0x7f80980ccf60 2023-07-14T13:08:03.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:03.764+0000 7f808f7fe640 1 -- 172.21.15.5:0/4099351192 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v27) v1 ==== 93+0+0 (secure 0 0 0) 0x7f8088103e30 con 0x7f80980ccf60 2023-07-14T13:08:03.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:03.764+0000 7f809d382640 1 -- 172.21.15.5:0/4099351192 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f80780663f0 msgr2=0x7f80780688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:03.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:03.764+0000 7f809d382640 1 --2- 172.21.15.5:0/4099351192 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f80780663f0 0x7f80780688a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f80981503e0 tx=0x7f8080009040 comp rx=0 tx=0).stop 2023-07-14T13:08:03.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:03.764+0000 7f809d382640 1 -- 172.21.15.5:0/4099351192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80980ccf60 msgr2=0x7f809814dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:03.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:03.764+0000 7f809d382640 1 --2- 172.21.15.5:0/4099351192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80980ccf60 0x7f809814dfc0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f80880ad040 tx=0x7f808801ac90 comp rx=0 tx=0).stop 2023-07-14T13:08:03.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:03.764+0000 7f809d382640 1 -- 172.21.15.5:0/4099351192 shutdown_connections 2023-07-14T13:08:03.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:03.764+0000 7f809d382640 1 --2- 172.21.15.5:0/4099351192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8098159500 0x7f809814cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:03.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:03.764+0000 7f809d382640 1 --2- 172.21.15.5:0/4099351192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8098156560 0x7f809814b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:03.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:03.764+0000 7f809d382640 1 --2- 172.21.15.5:0/4099351192 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f80780663f0 0x7f80780688a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:03.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:03.764+0000 7f809d382640 1 --2- 172.21.15.5:0/4099351192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80980ccf60 0x7f809814dfc0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:03.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:03.764+0000 7f809d382640 1 -- 172.21.15.5:0/4099351192 >> 172.21.15.5:0/4099351192 conn(0x7f80980afac0 msgr2=0x7f80980adac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:03.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:03.768+0000 7f809d382640 1 -- 172.21.15.5:0/4099351192 shutdown_connections 2023-07-14T13:08:03.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:03.768+0000 7f809d382640 1 -- 172.21.15.5:0/4099351192 wait complete. 2023-07-14T13:08:03.825 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T13:08:03.825 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:08:03.894 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:08:03.955 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T13:08:03.955 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:08:03.955 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:08:03.965 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:08:03.965 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:08:03.972 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:03.946+0000 7f0bdcf08180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:08:03.974 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:03.940+0000 7f4d3b348180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:08:03.984 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:08:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.136+0000 7f1012c6d640 1 Processor -- start 2023-07-14T13:08:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.136+0000 7f1012c6d640 1 -- start start 2023-07-14T13:08:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.136+0000 7f1012c6d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f100c158ce0 0x7f100c070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.136+0000 7f1012c6d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f100c0c9730 0x7f100c0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.136+0000 7f1012c6d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f100c0cc700 con 0x7f100c0c8ad0 2023-07-14T13:08:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.136+0000 7f1012c6d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f100c0b0ff0 con 0x7f100c158ce0 2023-07-14T13:08:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.136+0000 7f1012c6d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100c070c80 con 0x7f100c0c9730 2023-07-14T13:08:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.136+0000 7f1010a09640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f100c158ce0 0x7f100c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.136+0000 7f1010a09640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f100c158ce0 0x7f100c070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55572/0 (socket says 172.21.15.5:55572) 2023-07-14T13:08:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.136+0000 7f1010a09640 1 -- 172.21.15.5:0/1461348888 learned_addr learned my addr 172.21.15.5:0/1461348888 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.136+0000 7f101120a640 1 --2- 172.21.15.5:0/1461348888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f100c0c9730 0x7f100c0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.136+0000 7f1010a09640 1 -- 172.21.15.5:0/1461348888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f100c0c9730 msgr2=0x7f100c0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.136+0000 7f1010a09640 1 --2- 172.21.15.5:0/1461348888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f100c0c9730 0x7f100c0ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.140+0000 7f1010a09640 1 -- 172.21.15.5:0/1461348888 >> v1:172.21.15.154:6789/0 conn(0x7f100c0c8ad0 legacy=0x7f100c0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:04.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.140+0000 7f1010a09640 1 -- 172.21.15.5:0/1461348888 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100c0cbdd0 con 0x7f100c158ce0 2023-07-14T13:08:04.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.140+0000 7f1010a09640 1 --2- 172.21.15.5:0/1461348888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f100c158ce0 0x7f100c070450 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1000009870 tx=0x7f100001e600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f56226002b2b81 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:04.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.140+0000 7f100b7fe640 1 -- 172.21.15.5:0/1461348888 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10000ac680 con 0x7f100c158ce0 2023-07-14T13:08:04.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.140+0000 7f100b7fe640 1 -- 172.21.15.5:0/1461348888 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10000ac7e0 con 0x7f100c158ce0 2023-07-14T13:08:04.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.140+0000 7f100b7fe640 1 -- 172.21.15.5:0/1461348888 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10000acb70 con 0x7f100c158ce0 2023-07-14T13:08:04.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.140+0000 7f1012c6d640 1 -- 172.21.15.5:0/1461348888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f100c158ce0 msgr2=0x7f100c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:04.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.140+0000 7f1012c6d640 1 --2- 172.21.15.5:0/1461348888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f100c158ce0 0x7f100c070450 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1000009870 tx=0x7f100001e600 comp rx=0 tx=0).stop 2023-07-14T13:08:04.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.140+0000 7f1012c6d640 1 -- 172.21.15.5:0/1461348888 shutdown_connections 2023-07-14T13:08:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.140+0000 7f1012c6d640 1 --2- 172.21.15.5:0/1461348888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f100c0c9730 0x7f100c0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.140+0000 7f1012c6d640 1 --2- 172.21.15.5:0/1461348888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f100c158ce0 0x7f100c070450 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.140+0000 7f1012c6d640 1 -- 172.21.15.5:0/1461348888 >> 172.21.15.5:0/1461348888 conn(0x7f100c0afcf0 msgr2=0x7f100c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.140+0000 7f1012c6d640 1 -- 172.21.15.5:0/1461348888 shutdown_connections 2023-07-14T13:08:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.144+0000 7f1012c6d640 1 -- 172.21.15.5:0/1461348888 wait complete. 2023-07-14T13:08:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.144+0000 7f1012c6d640 1 Processor -- start 2023-07-14T13:08:04.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.144+0000 7f1012c6d640 1 -- start start 2023-07-14T13:08:04.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.144+0000 7f1012c6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f100c0c8ad0 0x7f100c0c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:04.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.144+0000 7f1012c6d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f100c0c9730 0x7f100c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:04.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.144+0000 7f1012c6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f100c158ce0 0x7f100c0af650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:04.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.144+0000 7f1012c6d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100c0afb90 con 0x7f100c158ce0 2023-07-14T13:08:04.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.144+0000 7f1012c6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100c0b17c0 con 0x7f100c0c8ad0 2023-07-14T13:08:04.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.144+0000 7f1012c6d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100c0c2ef0 con 0x7f100c0c9730 2023-07-14T13:08:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.144+0000 7f101120a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f100c158ce0 0x7f100c0af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.144+0000 7f101120a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f100c158ce0 0x7f100c0af650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55584/0 (socket says 172.21.15.5:55584) 2023-07-14T13:08:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.144+0000 7f101120a640 1 -- 172.21.15.5:0/144646491 learned_addr learned my addr 172.21.15.5:0/144646491 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.144+0000 7f1010a09640 1 --2- 172.21.15.5:0/144646491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f100c0c8ad0 0x7f100c0c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.144+0000 7f100bfff640 1 --2- 172.21.15.5:0/144646491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f100c0c9730 0x7f100c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.144+0000 7f101120a640 1 -- 172.21.15.5:0/144646491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f100c0c9730 msgr2=0x7f100c0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.144+0000 7f101120a640 1 --2- 172.21.15.5:0/144646491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f100c0c9730 0x7f100c0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.144+0000 7f101120a640 1 -- 172.21.15.5:0/144646491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f100c0c8ad0 msgr2=0x7f100c0c3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.144+0000 7f101120a640 1 --2- 172.21.15.5:0/144646491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f100c0c8ad0 0x7f100c0c3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.144+0000 7f101120a640 1 -- 172.21.15.5:0/144646491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10000094d0 con 0x7f100c158ce0 2023-07-14T13:08:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.144+0000 7f101120a640 1 --2- 172.21.15.5:0/144646491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f100c158ce0 0x7f100c0af650 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f100400ef90 tx=0x7f100400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.148+0000 7f10097fa640 1 -- 172.21.15.5:0/144646491 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1004009ca0 con 0x7f100c158ce0 2023-07-14T13:08:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.148+0000 7f10097fa640 1 -- 172.21.15.5:0/144646491 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100400f040 con 0x7f100c158ce0 2023-07-14T13:08:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.148+0000 7f10097fa640 1 -- 172.21.15.5:0/144646491 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10040146c0 con 0x7f100c158ce0 2023-07-14T13:08:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.148+0000 7f1012c6d640 1 -- 172.21.15.5:0/144646491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f100c0c3190 con 0x7f100c158ce0 2023-07-14T13:08:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.148+0000 7f1012c6d640 1 -- 172.21.15.5:0/144646491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f100c0c3750 con 0x7f100c158ce0 2023-07-14T13:08:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.148+0000 7f1012c6d640 1 -- 172.21.15.5:0/144646491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f100c0ca1a0 con 0x7f100c158ce0 2023-07-14T13:08:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.148+0000 7f10097fa640 1 -- 172.21.15.5:0/144646491 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 27) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f1004014820 con 0x7f100c158ce0 2023-07-14T13:08:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.148+0000 7f10097fa640 1 --2- 172.21.15.5:0/144646491 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f0ff00663d0 0x7f0ff0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.148+0000 7f10097fa640 1 -- 172.21.15.5:0/144646491 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f1004084df0 con 0x7f100c158ce0 2023-07-14T13:08:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.148+0000 7f1010a09640 1 -- 172.21.15.5:0/144646491 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f0ff00663d0 msgr2=0x7f0ff0068880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/497535468 2023-07-14T13:08:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.148+0000 7f1010a09640 1 --2- 172.21.15.5:0/144646491 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f0ff00663d0 0x7f0ff0068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:08:04.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.152+0000 7f10097fa640 1 -- 172.21.15.5:0/144646491 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f1004052000 con 0x7f100c158ce0 2023-07-14T13:08:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.312+0000 7f1012c6d640 1 -- 172.21.15.5:0/144646491 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f100c0678d0 con 0x7f100c158ce0 2023-07-14T13:08:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.312+0000 7f10097fa640 1 -- 172.21.15.5:0/144646491 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+18850 (secure 0 0 0) 0x7f1004018090 con 0x7f100c158ce0 2023-07-14T13:08:04.346 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:04.346 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":68,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:07:19.699161+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:05:59.255634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-14T13:06:00.136409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.37","mappings":[{"from":0,"to":6}]},{"pgid":"8.3d","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/3011670516":"2023-07-15T13:06:18.429741+0000","172.21.15.154:0/2719767027":"2023-07-15T13:06:18.429741+0000","172.21.15.154:6833/1810553301":"2023-07-15T13:06:18.429741+0000","172.21.15.154:6832/1810553301":"2023-07-15T13:06:18.429741+0000","172.21.15.154:0/2307511449":"2023-07-15T13:06:18.429741+0000","172.21.15.154:0/2860419665":"2023-07-15T13:06:18.429741+0000","172.21.15.154:0/870084639":"2023-07-15T13:06:18.429741+0000","172.21.15.154:0/124304401":"2023-07-15T13:06:18.429741+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:08:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.312+0000 7f1012c6d640 1 -- 172.21.15.5:0/144646491 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f0ff00663d0 msgr2=0x7f0ff0068880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:08:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.312+0000 7f1012c6d640 1 --2- 172.21.15.5:0/144646491 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f0ff00663d0 0x7f0ff0068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.312+0000 7f1012c6d640 1 -- 172.21.15.5:0/144646491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f100c158ce0 msgr2=0x7f100c0af650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.312+0000 7f1012c6d640 1 --2- 172.21.15.5:0/144646491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f100c158ce0 0x7f100c0af650 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f100400ef90 tx=0x7f100400c490 comp rx=0 tx=0).stop 2023-07-14T13:08:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.312+0000 7f1012c6d640 1 -- 172.21.15.5:0/144646491 shutdown_connections 2023-07-14T13:08:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.312+0000 7f1012c6d640 1 --2- 172.21.15.5:0/144646491 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f0ff00663d0 0x7f0ff0068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.312+0000 7f1012c6d640 1 --2- 172.21.15.5:0/144646491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f100c158ce0 0x7f100c0af650 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.312+0000 7f1012c6d640 1 --2- 172.21.15.5:0/144646491 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f100c0c9730 0x7f100c0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.312+0000 7f1012c6d640 1 --2- 172.21.15.5:0/144646491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f100c0c8ad0 0x7f100c0c3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.312+0000 7f1012c6d640 1 -- 172.21.15.5:0/144646491 >> 172.21.15.5:0/144646491 conn(0x7f100c0afcf0 msgr2=0x7f100c155820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.316+0000 7f1012c6d640 1 -- 172.21.15.5:0/144646491 shutdown_connections 2023-07-14T13:08:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.316+0000 7f1012c6d640 1 -- 172.21.15.5:0/144646491 wait complete. 2023-07-14T13:08:04.368 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T13:05:59.255634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T13:06:00.136409+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:08:04.369 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:08:04.385 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:04.358+0000 7f0bdcf08180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:08:04.421 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:04.388+0000 7f4d3b348180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:08:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.488+0000 7f6c2bbfa640 1 Processor -- start 2023-07-14T13:08:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.488+0000 7f6c2bbfa640 1 -- start start 2023-07-14T13:08:04.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.488+0000 7f6c2bbfa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6c2415bde0 0x7f6c240d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:04.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.488+0000 7f6c2bbfa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6c240d2fc0 0x7f6c240b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:04.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.488+0000 7f6c2bbfa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c240d2300 0x7f6c240d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:04.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.488+0000 7f6c2bbfa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c2415c1b0 con 0x7f6c240d2fc0 2023-07-14T13:08:04.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.488+0000 7f6c2bbfa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c240d2cc0 con 0x7f6c2415bde0 2023-07-14T13:08:04.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.488+0000 7f6c2bbfa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c240b04c0 con 0x7f6c240d2300 2023-07-14T13:08:04.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.488+0000 7f6c29195640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6c240d2fc0 0x7f6c240b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:04.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.488+0000 7f6c29195640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6c240d2fc0 0x7f6c240b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55596/0 (socket says 172.21.15.5:55596) 2023-07-14T13:08:04.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.488+0000 7f6c29195640 1 -- 172.21.15.5:0/1559809224 learned_addr learned my addr 172.21.15.5:0/1559809224 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:04.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.488+0000 7f6c29996640 1 --2- 172.21.15.5:0/1559809224 >> v2:172.21.15.154:3300/0 conn(0x7f6c2415bde0 0x7f6c240d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.488+0000 7f6c2a197640 1 --2- 172.21.15.5:0/1559809224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c240d2300 0x7f6c240d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.488+0000 7f6c29195640 1 -- 172.21.15.5:0/1559809224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c240d2300 msgr2=0x7f6c240d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.488+0000 7f6c29195640 1 --2- 172.21.15.5:0/1559809224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c240d2300 0x7f6c240d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.488+0000 7f6c29195640 1 -- 172.21.15.5:0/1559809224 >> v2:172.21.15.154:3300/0 conn(0x7f6c2415bde0 msgr2=0x7f6c240d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.488+0000 7f6c29195640 1 --2- 172.21.15.5:0/1559809224 >> v2:172.21.15.154:3300/0 conn(0x7f6c2415bde0 0x7f6c240d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.488+0000 7f6c29195640 1 -- 172.21.15.5:0/1559809224 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c240d0aa0 con 0x7f6c240d2fc0 2023-07-14T13:08:04.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.492+0000 7f6c29195640 1 --2- 172.21.15.5:0/1559809224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c240d2fc0 0x7f6c240b0950 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f6c2408b210 tx=0x7f6c1401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c8c7f634600b80 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:04.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.492+0000 7f6c28994640 1 -- 172.21.15.5:0/1559809224 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c140aa620 con 0x7f6c240d2fc0 2023-07-14T13:08:04.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.492+0000 7f6c28994640 1 -- 172.21.15.5:0/1559809224 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c140aa780 con 0x7f6c240d2fc0 2023-07-14T13:08:04.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.492+0000 7f6c28994640 1 -- 172.21.15.5:0/1559809224 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c140aab10 con 0x7f6c240d2fc0 2023-07-14T13:08:04.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.492+0000 7f6c2bbfa640 1 -- 172.21.15.5:0/1559809224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c240d2fc0 msgr2=0x7f6c240b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:04.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.492+0000 7f6c2bbfa640 1 --2- 172.21.15.5:0/1559809224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c240d2fc0 0x7f6c240b0950 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f6c2408b210 tx=0x7f6c1401c500 comp rx=0 tx=0).stop 2023-07-14T13:08:04.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.492+0000 7f6c2bbfa640 1 -- 172.21.15.5:0/1559809224 shutdown_connections 2023-07-14T13:08:04.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.492+0000 7f6c2bbfa640 1 --2- 172.21.15.5:0/1559809224 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c240d2300 0x7f6c240d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.492+0000 7f6c2bbfa640 1 --2- 172.21.15.5:0/1559809224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c240d2fc0 0x7f6c240b0950 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.492+0000 7f6c2bbfa640 1 --2- 172.21.15.5:0/1559809224 >> v2:172.21.15.154:3300/0 conn(0x7f6c2415bde0 0x7f6c240d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.492+0000 7f6c2bbfa640 1 -- 172.21.15.5:0/1559809224 >> 172.21.15.5:0/1559809224 conn(0x7f6c240659d0 msgr2=0x7f6c2409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:04.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.492+0000 7f6c2bbfa640 1 -- 172.21.15.5:0/1559809224 shutdown_connections 2023-07-14T13:08:04.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.492+0000 7f6c2bbfa640 1 -- 172.21.15.5:0/1559809224 wait complete. 2023-07-14T13:08:04.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.496+0000 7f6c2bbfa640 1 Processor -- start 2023-07-14T13:08:04.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.496+0000 7f6c2bbfa640 1 -- start start 2023-07-14T13:08:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.496+0000 7f6c2bbfa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c240d2300 0x7f6c241541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.496+0000 7f6c2bbfa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c240d2fc0 0x7f6c2415e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.496+0000 7f6c2bbfa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c2415bde0 0x7f6c24153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.496+0000 7f6c2bbfa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c240b3350 con 0x7f6c240d2300 2023-07-14T13:08:04.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.496+0000 7f6c2bbfa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c240b3630 con 0x7f6c240d2fc0 2023-07-14T13:08:04.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.496+0000 7f6c2bbfa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c240b3910 con 0x7f6c2415bde0 2023-07-14T13:08:04.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.496+0000 7f6c29996640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c240d2300 0x7f6c241541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:04.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.496+0000 7f6c29996640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c240d2300 0x7f6c241541b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55602/0 (socket says 172.21.15.5:55602) 2023-07-14T13:08:04.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.496+0000 7f6c29996640 1 -- 172.21.15.5:0/4239277676 learned_addr learned my addr 172.21.15.5:0/4239277676 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:04.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.496+0000 7f6c2a197640 1 --2- 172.21.15.5:0/4239277676 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c2415bde0 0x7f6c24153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:04.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.496+0000 7f6c29195640 1 --2- 172.21.15.5:0/4239277676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c240d2fc0 0x7f6c2415e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:04.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.496+0000 7f6c29996640 1 -- 172.21.15.5:0/4239277676 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c2415bde0 msgr2=0x7f6c24153a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:04.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.496+0000 7f6c29996640 1 --2- 172.21.15.5:0/4239277676 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c2415bde0 0x7f6c24153a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.496+0000 7f6c29996640 1 -- 172.21.15.5:0/4239277676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c240d2fc0 msgr2=0x7f6c2415e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:04.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.496+0000 7f6c29996640 1 --2- 172.21.15.5:0/4239277676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c240d2fc0 0x7f6c2415e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.496+0000 7f6c29996640 1 -- 172.21.15.5:0/4239277676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c140094d0 con 0x7f6c240d2300 2023-07-14T13:08:04.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.496+0000 7f6c29996640 1 --2- 172.21.15.5:0/4239277676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c240d2300 0x7f6c241541b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000d800 tx=0x7f6c2000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:04.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.496+0000 7f6c1a7fc640 1 -- 172.21.15.5:0/4239277676 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c20018070 con 0x7f6c240d2300 2023-07-14T13:08:04.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.496+0000 7f6c1a7fc640 1 -- 172.21.15.5:0/4239277676 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c200059a0 con 0x7f6c240d2300 2023-07-14T13:08:04.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.496+0000 7f6c1a7fc640 1 -- 172.21.15.5:0/4239277676 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c20005b50 con 0x7f6c240d2300 2023-07-14T13:08:04.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.496+0000 7f6c2bbfa640 1 -- 172.21.15.5:0/4239277676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c240b3bf0 con 0x7f6c240d2300 2023-07-14T13:08:04.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.496+0000 7f6c2bbfa640 1 -- 172.21.15.5:0/4239277676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c24154890 con 0x7f6c240d2300 2023-07-14T13:08:04.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.496+0000 7f6c2bbfa640 1 -- 172.21.15.5:0/4239277676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c240d0fb0 con 0x7f6c240d2300 2023-07-14T13:08:04.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.500+0000 7f6c1a7fc640 1 -- 172.21.15.5:0/4239277676 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 27) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f6c20005cb0 con 0x7f6c240d2300 2023-07-14T13:08:04.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.500+0000 7f6c1a7fc640 1 --2- 172.21.15.5:0/4239277676 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f6c080663a0 0x7f6c08068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:04.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.500+0000 7f6c1a7fc640 1 -- 172.21.15.5:0/4239277676 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f6c20083db0 con 0x7f6c240d2300 2023-07-14T13:08:04.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.500+0000 7f6c29195640 1 -- 172.21.15.5:0/4239277676 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f6c080663a0 msgr2=0x7f6c08068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/497535468 2023-07-14T13:08:04.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.500+0000 7f6c29195640 1 --2- 172.21.15.5:0/4239277676 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f6c080663a0 0x7f6c08068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:08:04.536 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:04.506+0000 7f0bdcf08180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:08:04.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.504+0000 7f6c1a7fc640 1 -- 172.21.15.5:0/4239277676 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6c20088070 con 0x7f6c240d2300 2023-07-14T13:08:04.584 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:04.552+0000 7f4d3b348180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:08:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.660+0000 7f6c2bbfa640 1 -- 172.21.15.5:0/4239277676 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6c240b3490 con 0x7f6c240d2300 2023-07-14T13:08:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.660+0000 7f6c1a7fc640 1 -- 172.21.15.5:0/4239277676 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6c240b3490 con 0x7f6c240d2300 2023-07-14T13:08:04.697 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:08:04.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.664+0000 7f6c2bbfa640 1 -- 172.21.15.5:0/4239277676 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f6c080663a0 msgr2=0x7f6c08068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:08:04.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.664+0000 7f6c2bbfa640 1 --2- 172.21.15.5:0/4239277676 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f6c080663a0 0x7f6c08068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.664+0000 7f6c2bbfa640 1 -- 172.21.15.5:0/4239277676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c240d2300 msgr2=0x7f6c241541b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:04.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.664+0000 7f6c2bbfa640 1 --2- 172.21.15.5:0/4239277676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c240d2300 0x7f6c241541b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000d800 tx=0x7f6c2000dcc0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.664+0000 7f6c2bbfa640 1 -- 172.21.15.5:0/4239277676 shutdown_connections 2023-07-14T13:08:04.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.664+0000 7f6c2bbfa640 1 --2- 172.21.15.5:0/4239277676 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c2415bde0 0x7f6c24153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.664+0000 7f6c2bbfa640 1 --2- 172.21.15.5:0/4239277676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c240d2fc0 0x7f6c2415e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.664+0000 7f6c2bbfa640 1 --2- 172.21.15.5:0/4239277676 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f6c080663a0 0x7f6c08068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.664+0000 7f6c2bbfa640 1 --2- 172.21.15.5:0/4239277676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c240d2300 0x7f6c241541b0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.664+0000 7f6c2bbfa640 1 -- 172.21.15.5:0/4239277676 >> 172.21.15.5:0/4239277676 conn(0x7f6c240659d0 msgr2=0x7f6c240b46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.664+0000 7f6c2bbfa640 1 -- 172.21.15.5:0/4239277676 shutdown_connections 2023-07-14T13:08:04.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.664+0000 7f6c2bbfa640 1 -- 172.21.15.5:0/4239277676 wait complete. 2023-07-14T13:08:04.717 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:08:04.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.832+0000 7f451dd03640 1 Processor -- start 2023-07-14T13:08:04.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.832+0000 7f451dd03640 1 -- start start 2023-07-14T13:08:04.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.832+0000 7f451dd03640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f451815bde0 0x7f45180d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:04.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.832+0000 7f451dd03640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f45180d2300 0x7f45180d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:04.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.832+0000 7f451dd03640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45180b04c0 con 0x7f45180d2fc0 2023-07-14T13:08:04.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.832+0000 7f451dd03640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45180d2ce0 con 0x7f45180d2300 2023-07-14T13:08:04.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.832+0000 7f451dd03640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f451815c1b0 con 0x7f451815bde0 2023-07-14T13:08:04.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.832+0000 7f4517fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f45180d2300 0x7f45180d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:04.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.832+0000 7f4517fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f45180d2300 0x7f45180d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55604/0 (socket says 172.21.15.5:55604) 2023-07-14T13:08:04.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.832+0000 7f4517fff640 1 -- 172.21.15.5:0/4024087436 learned_addr learned my addr 172.21.15.5:0/4024087436 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:04.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.832+0000 7f45177fe640 1 --2- 172.21.15.5:0/4024087436 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f451815bde0 0x7f45180d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:04.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.836+0000 7f4517fff640 1 -- 172.21.15.5:0/4024087436 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f451815bde0 msgr2=0x7f45180d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:04.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.836+0000 7f4517fff640 1 --2- 172.21.15.5:0/4024087436 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f451815bde0 0x7f45180d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.836+0000 7f4517fff640 1 -- 172.21.15.5:0/4024087436 >> v1:172.21.15.154:6789/0 conn(0x7f45180d2fc0 legacy=0x7f45180b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:04.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.836+0000 7f4517fff640 1 -- 172.21.15.5:0/4024087436 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45180b1060 con 0x7f45180d2300 2023-07-14T13:08:04.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.836+0000 7f4517fff640 1 --2- 172.21.15.5:0/4024087436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45180d2300 0x7f45180d27a0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4510009e50 tx=0x7f451001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c0eef7b0107f9d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:04.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.836+0000 7f45167fc640 1 -- 172.21.15.5:0/4024087436 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45100a57f0 con 0x7f45180d2300 2023-07-14T13:08:04.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.836+0000 7f45167fc640 1 -- 172.21.15.5:0/4024087436 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45100a5950 con 0x7f45180d2300 2023-07-14T13:08:04.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.836+0000 7f45167fc640 1 -- 172.21.15.5:0/4024087436 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45100a5ce0 con 0x7f45180d2300 2023-07-14T13:08:04.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.836+0000 7f451dd03640 1 -- 172.21.15.5:0/4024087436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45180d2300 msgr2=0x7f45180d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:04.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.836+0000 7f451dd03640 1 --2- 172.21.15.5:0/4024087436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45180d2300 0x7f45180d27a0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4510009e50 tx=0x7f451001ca10 comp rx=0 tx=0).stop 2023-07-14T13:08:04.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.836+0000 7f451dd03640 1 -- 172.21.15.5:0/4024087436 shutdown_connections 2023-07-14T13:08:04.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.836+0000 7f451dd03640 1 --2- 172.21.15.5:0/4024087436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45180d2300 0x7f45180d27a0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.836+0000 7f451dd03640 1 --2- 172.21.15.5:0/4024087436 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f451815bde0 0x7f45180d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.836+0000 7f451dd03640 1 -- 172.21.15.5:0/4024087436 >> 172.21.15.5:0/4024087436 conn(0x7f45180659d0 msgr2=0x7f451809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:04.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.840+0000 7f451dd03640 1 -- 172.21.15.5:0/4024087436 shutdown_connections 2023-07-14T13:08:04.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.840+0000 7f451dd03640 1 -- 172.21.15.5:0/4024087436 wait complete. 2023-07-14T13:08:04.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.840+0000 7f451dd03640 1 Processor -- start 2023-07-14T13:08:04.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.840+0000 7f451dd03640 1 -- start start 2023-07-14T13:08:04.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.840+0000 7f451dd03640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45180d2300 0x7f451814e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:04.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.840+0000 7f451dd03640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45180d2fc0 0x7f451814c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:04.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.840+0000 7f451dd03640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f451815bde0 0x7f45180cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:04.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.840+0000 7f451dd03640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451814dfa0 con 0x7f451815bde0 2023-07-14T13:08:04.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.840+0000 7f451dd03640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451815a660 con 0x7f45180d2fc0 2023-07-14T13:08:04.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.840+0000 7f451dd03640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f451814d0d0 con 0x7f45180d2300 2023-07-14T13:08:04.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.840+0000 7f4517fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f451815bde0 0x7f45180cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:04.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.840+0000 7f4517fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f451815bde0 0x7f45180cebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55608/0 (socket says 172.21.15.5:55608) 2023-07-14T13:08:04.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.840+0000 7f4517fff640 1 -- 172.21.15.5:0/2265739011 learned_addr learned my addr 172.21.15.5:0/2265739011 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:04.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.840+0000 7f45177fe640 1 --2- 172.21.15.5:0/2265739011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45180d2300 0x7f451814e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:04.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.840+0000 7f4516ffd640 1 --2- 172.21.15.5:0/2265739011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45180d2fc0 0x7f451814c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:04.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.840+0000 7f4517fff640 1 -- 172.21.15.5:0/2265739011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45180d2300 msgr2=0x7f451814e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:04.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.840+0000 7f4517fff640 1 --2- 172.21.15.5:0/2265739011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45180d2300 0x7f451814e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.840+0000 7f4517fff640 1 -- 172.21.15.5:0/2265739011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45180d2fc0 msgr2=0x7f451814c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:04.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.840+0000 7f4517fff640 1 --2- 172.21.15.5:0/2265739011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45180d2fc0 0x7f451814c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:04.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.840+0000 7f4517fff640 1 -- 172.21.15.5:0/2265739011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4510009b30 con 0x7f451815bde0 2023-07-14T13:08:04.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.840+0000 7f4517fff640 1 --2- 172.21.15.5:0/2265739011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f451815bde0 0x7f45180cebf0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f45100af040 tx=0x7f45100197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:04.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.844+0000 7f44fffff640 1 -- 172.21.15.5:0/2265739011 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45100b8670 con 0x7f451815bde0 2023-07-14T13:08:04.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.844+0000 7f44fffff640 1 -- 172.21.15.5:0/2265739011 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45100b87d0 con 0x7f451815bde0 2023-07-14T13:08:04.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.844+0000 7f44fffff640 1 -- 172.21.15.5:0/2265739011 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45100b8b60 con 0x7f451815bde0 2023-07-14T13:08:04.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.844+0000 7f451dd03640 1 -- 172.21.15.5:0/2265739011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f451814e900 con 0x7f451815bde0 2023-07-14T13:08:04.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.844+0000 7f451dd03640 1 -- 172.21.15.5:0/2265739011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f451814d600 con 0x7f451815bde0 2023-07-14T13:08:04.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.844+0000 7f451dd03640 1 -- 172.21.15.5:0/2265739011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45180678d0 con 0x7f451815bde0 2023-07-14T13:08:04.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.844+0000 7f44fffff640 1 -- 172.21.15.5:0/2265739011 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 27) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f45100b8cc0 con 0x7f451815bde0 2023-07-14T13:08:04.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.844+0000 7f44fffff640 1 --2- 172.21.15.5:0/2265739011 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f45040663d0 0x7f4504068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:04.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.844+0000 7f44fffff640 1 -- 172.21.15.5:0/2265739011 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f451011f6a0 con 0x7f451815bde0 2023-07-14T13:08:04.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.844+0000 7f45177fe640 1 -- 172.21.15.5:0/2265739011 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f45040663d0 msgr2=0x7f4504068880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/497535468 2023-07-14T13:08:04.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.844+0000 7f45177fe640 1 --2- 172.21.15.5:0/2265739011 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f45040663d0 0x7f4504068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:08:04.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:04.848+0000 7f44fffff640 1 -- 172.21.15.5:0/2265739011 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f45100ec9c0 con 0x7f451815bde0 2023-07-14T13:08:05.011 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:04.982+0000 7f0bdcf08180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:08:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.012+0000 7f451dd03640 1 -- 172.21.15.5:0/2265739011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f45180b3980 con 0x7f451815bde0 2023-07-14T13:08:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.012+0000 7f44fffff640 1 -- 172.21.15.5:0/2265739011 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v68) v1 ==== 92+0+10 (secure 0 0 0) 0x7f45100effe0 con 0x7f451815bde0 2023-07-14T13:08:05.048 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:08:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.016+0000 7f451dd03640 1 -- 172.21.15.5:0/2265739011 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f45040663d0 msgr2=0x7f4504068880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:08:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.016+0000 7f451dd03640 1 --2- 172.21.15.5:0/2265739011 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f45040663d0 0x7f4504068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.016+0000 7f451dd03640 1 -- 172.21.15.5:0/2265739011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f451815bde0 msgr2=0x7f45180cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.016+0000 7f451dd03640 1 --2- 172.21.15.5:0/2265739011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f451815bde0 0x7f45180cebf0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f45100af040 tx=0x7f45100197b0 comp rx=0 tx=0).stop 2023-07-14T13:08:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.016+0000 7f451dd03640 1 -- 172.21.15.5:0/2265739011 shutdown_connections 2023-07-14T13:08:05.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.016+0000 7f451dd03640 1 --2- 172.21.15.5:0/2265739011 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f45040663d0 0x7f4504068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:05.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.016+0000 7f451dd03640 1 --2- 172.21.15.5:0/2265739011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f451815bde0 0x7f45180cebf0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:05.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.016+0000 7f451dd03640 1 --2- 172.21.15.5:0/2265739011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45180d2fc0 0x7f451814c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:05.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.016+0000 7f451dd03640 1 --2- 172.21.15.5:0/2265739011 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45180d2300 0x7f451814e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:05.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.016+0000 7f451dd03640 1 -- 172.21.15.5:0/2265739011 >> 172.21.15.5:0/2265739011 conn(0x7f45180659d0 msgr2=0x7f451806afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:05.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.016+0000 7f451dd03640 1 -- 172.21.15.5:0/2265739011 shutdown_connections 2023-07-14T13:08:05.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.016+0000 7f451dd03640 1 -- 172.21.15.5:0/2265739011 wait complete. 2023-07-14T13:08:05.069 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T13:08:05.070 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:05.042+0000 7f0bdcf08180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:08:05.103 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:05.068+0000 7f4d3b348180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:08:05.124 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:05.098+0000 7f0bdcf08180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:08:05.166 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:05.132+0000 7f4d3b348180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:08:05.209 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:05.182+0000 7f0bdcf08180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:08:05.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.184+0000 7f7387337640 1 Processor -- start 2023-07-14T13:08:05.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.184+0000 7f7387337640 1 -- start start 2023-07-14T13:08:05.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.184+0000 7f7387337640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f738015bde0 0x7f73800d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:05.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.184+0000 7f7387337640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f73800d2fc0 0x7f73800b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:05.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.184+0000 7f7387337640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73800b04c0 con 0x7f73800d2300 2023-07-14T13:08:05.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.184+0000 7f7387337640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f738015c1b0 con 0x7f738015bde0 2023-07-14T13:08:05.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.184+0000 7f7387337640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73800d0aa0 con 0x7f73800d2fc0 2023-07-14T13:08:05.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.188+0000 7f73858d4640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f73800d2300 0x7f73800cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44760/0 (socket says 172.21.15.5:44760) 2023-07-14T13:08:05.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.188+0000 7f73858d4640 1 -- 172.21.15.5:0/2059995473 learned_addr learned my addr 172.21.15.5:0/2059995473 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:05.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.188+0000 7f73848d2640 1 --2- 172.21.15.5:0/2059995473 >> v2:172.21.15.154:3300/0 conn(0x7f73800d2fc0 0x7f73800b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:05.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.188+0000 7f73850d3640 1 --2- 172.21.15.5:0/2059995473 >> v2:172.21.15.5:3300/0 conn(0x7f738015bde0 0x7f73800d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:05.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.188+0000 7f73848d2640 1 -- 172.21.15.5:0/2059995473 >> v2:172.21.15.5:3300/0 conn(0x7f738015bde0 msgr2=0x7f73800d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:05.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.188+0000 7f73848d2640 1 --2- 172.21.15.5:0/2059995473 >> v2:172.21.15.5:3300/0 conn(0x7f738015bde0 0x7f73800d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:05.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.188+0000 7f73848d2640 1 -- 172.21.15.5:0/2059995473 >> v1:172.21.15.5:6789/0 conn(0x7f73800d2300 legacy=0x7f73800cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:05.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.188+0000 7f73848d2640 1 -- 172.21.15.5:0/2059995473 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73800afb90 con 0x7f73800d2fc0 2023-07-14T13:08:05.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.188+0000 7f7377fff640 1 -- 172.21.15.5:0/2059995473 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1773194808 0 0) 0x7f73800b04c0 con 0x7f73800d2300 2023-07-14T13:08:05.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.188+0000 7f73850d3640 1 --2- 172.21.15.5:0/2059995473 >> v2:172.21.15.5:3300/0 conn(0x7f738015bde0 0x7f73800d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:05.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.188+0000 7f73848d2640 1 --2- 172.21.15.5:0/2059995473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73800d2fc0 0x7f73800b0950 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f738008c600 tx=0x7f737001c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fe70537d07482bf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:05.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.188+0000 7f7377fff640 1 -- 172.21.15.5:0/2059995473 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73700ab660 con 0x7f73800d2fc0 2023-07-14T13:08:05.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.188+0000 7f7377fff640 1 -- 172.21.15.5:0/2059995473 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73700ab7c0 con 0x7f73800d2fc0 2023-07-14T13:08:05.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.188+0000 7f7377fff640 1 -- 172.21.15.5:0/2059995473 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73700abb50 con 0x7f73800d2fc0 2023-07-14T13:08:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.192+0000 7f7387337640 1 -- 172.21.15.5:0/2059995473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73800d2fc0 msgr2=0x7f73800b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.192+0000 7f7387337640 1 --2- 172.21.15.5:0/2059995473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73800d2fc0 0x7f73800b0950 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f738008c600 tx=0x7f737001c460 comp rx=0 tx=0).stop 2023-07-14T13:08:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.192+0000 7f7387337640 1 -- 172.21.15.5:0/2059995473 shutdown_connections 2023-07-14T13:08:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.192+0000 7f7387337640 1 --2- 172.21.15.5:0/2059995473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73800d2fc0 0x7f73800b0950 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.192+0000 7f7387337640 1 --2- 172.21.15.5:0/2059995473 >> v2:172.21.15.5:3300/0 conn(0x7f738015bde0 0x7f73800d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.192+0000 7f7387337640 1 -- 172.21.15.5:0/2059995473 >> 172.21.15.5:0/2059995473 conn(0x7f73800659d0 msgr2=0x7f738009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.192+0000 7f7387337640 1 -- 172.21.15.5:0/2059995473 shutdown_connections 2023-07-14T13:08:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.192+0000 7f7387337640 1 -- 172.21.15.5:0/2059995473 wait complete. 2023-07-14T13:08:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.192+0000 7f7387337640 1 Processor -- start 2023-07-14T13:08:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.192+0000 7f7387337640 1 -- start start 2023-07-14T13:08:05.227 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:05.192+0000 7f4d3b348180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:08:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.192+0000 7f7387337640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73800d2300 0x7f738015d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.192+0000 7f7387337640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f73800d2fc0 0x7f7380154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.192+0000 7f7387337640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f738015bde0 0x7f7380153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.192+0000 7f7387337640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738015c700 con 0x7f738015bde0 2023-07-14T13:08:05.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.192+0000 7f7387337640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738015c9e0 con 0x7f73800d2300 2023-07-14T13:08:05.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.192+0000 7f7387337640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738015ccc0 con 0x7f73800d2fc0 2023-07-14T13:08:05.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.192+0000 7f73858d4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f738015bde0 0x7f7380153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:05.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.192+0000 7f73858d4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f738015bde0 0x7f7380153320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55632/0 (socket says 172.21.15.5:55632) 2023-07-14T13:08:05.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.192+0000 7f73858d4640 1 -- 172.21.15.5:0/2783196734 learned_addr learned my addr 172.21.15.5:0/2783196734 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:05.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.192+0000 7f73850d3640 1 --2- 172.21.15.5:0/2783196734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73800d2300 0x7f738015d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:05.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.192+0000 7f73848d2640 1 --2- 172.21.15.5:0/2783196734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f73800d2fc0 0x7f7380154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.196+0000 7f73858d4640 1 -- 172.21.15.5:0/2783196734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f73800d2fc0 msgr2=0x7f7380154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.196+0000 7f73858d4640 1 --2- 172.21.15.5:0/2783196734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f73800d2fc0 0x7f7380154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.196+0000 7f73858d4640 1 -- 172.21.15.5:0/2783196734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73800d2300 msgr2=0x7f738015d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.196+0000 7f73858d4640 1 --2- 172.21.15.5:0/2783196734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73800d2300 0x7f738015d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.196+0000 7f73858d4640 1 -- 172.21.15.5:0/2783196734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c0093b0 con 0x7f738015bde0 2023-07-14T13:08:05.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.196+0000 7f73858d4640 1 --2- 172.21.15.5:0/2783196734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f738015bde0 0x7f7380153320 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7378001570 tx=0x7f737800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:05.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.196+0000 7f7375ffb640 1 -- 172.21.15.5:0/2783196734 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737800a640 con 0x7f738015bde0 2023-07-14T13:08:05.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.196+0000 7f7375ffb640 1 -- 172.21.15.5:0/2783196734 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737800a7c0 con 0x7f738015bde0 2023-07-14T13:08:05.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.196+0000 7f7387337640 1 -- 172.21.15.5:0/2783196734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7370009420 con 0x7f738015bde0 2023-07-14T13:08:05.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.196+0000 7f7375ffb640 1 -- 172.21.15.5:0/2783196734 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737800ab70 con 0x7f738015bde0 2023-07-14T13:08:05.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.196+0000 7f7387337640 1 -- 172.21.15.5:0/2783196734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738015d280 con 0x7f738015bde0 2023-07-14T13:08:05.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.196+0000 7f7387337640 1 -- 172.21.15.5:0/2783196734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f738015d470 con 0x7f738015bde0 2023-07-14T13:08:05.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.196+0000 7f7375ffb640 1 -- 172.21.15.5:0/2783196734 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 27) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f737800acd0 con 0x7f738015bde0 2023-07-14T13:08:05.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.200+0000 7f7375ffb640 1 --2- 172.21.15.5:0/2783196734 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f73640663a0 0x7f7364068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:05.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.200+0000 7f7375ffb640 1 -- 172.21.15.5:0/2783196734 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f73780835d0 con 0x7f738015bde0 2023-07-14T13:08:05.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.200+0000 7f73850d3640 1 -- 172.21.15.5:0/2783196734 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f73640663a0 msgr2=0x7f7364068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/497535468 2023-07-14T13:08:05.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.200+0000 7f73850d3640 1 --2- 172.21.15.5:0/2783196734 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f73640663a0 0x7f7364068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:08:05.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.200+0000 7f7375ffb640 1 -- 172.21.15.5:0/2783196734 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f73780507e0 con 0x7f738015bde0 2023-07-14T13:08:05.268 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:05.242+0000 7f0bdcf08180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:08:05.320 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:05.288+0000 7f4d3b348180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:08:05.351 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:05.322+0000 7f0bdcf08180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:08:05.380 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:05.348+0000 7f4d3b348180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:08:05.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.360+0000 7f7387337640 1 -- 172.21.15.5:0/2783196734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f73800678d0 con 0x7f738015bde0 2023-07-14T13:08:05.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.360+0000 7f7375ffb640 1 -- 172.21.15.5:0/2783196734 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v68) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7378053e00 con 0x7f738015bde0 2023-07-14T13:08:05.393 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T13:08:05.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.360+0000 7f7387337640 1 -- 172.21.15.5:0/2783196734 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f73640663a0 msgr2=0x7f7364068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:08:05.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.360+0000 7f7387337640 1 --2- 172.21.15.5:0/2783196734 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f73640663a0 0x7f7364068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:05.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.360+0000 7f7387337640 1 -- 172.21.15.5:0/2783196734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f738015bde0 msgr2=0x7f7380153320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:05.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.360+0000 7f7387337640 1 --2- 172.21.15.5:0/2783196734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f738015bde0 0x7f7380153320 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7378001570 tx=0x7f737800cca0 comp rx=0 tx=0).stop 2023-07-14T13:08:05.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.360+0000 7f7387337640 1 -- 172.21.15.5:0/2783196734 shutdown_connections 2023-07-14T13:08:05.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.360+0000 7f7387337640 1 --2- 172.21.15.5:0/2783196734 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f73640663a0 0x7f7364068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:05.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.360+0000 7f7387337640 1 --2- 172.21.15.5:0/2783196734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f738015bde0 0x7f7380153320 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:05.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.360+0000 7f7387337640 1 --2- 172.21.15.5:0/2783196734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f73800d2fc0 0x7f7380154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:05.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.360+0000 7f7387337640 1 --2- 172.21.15.5:0/2783196734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73800d2300 0x7f738015d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:05.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.360+0000 7f7387337640 1 -- 172.21.15.5:0/2783196734 >> 172.21.15.5:0/2783196734 conn(0x7f73800659d0 msgr2=0x7f738006afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:05.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.360+0000 7f7387337640 1 -- 172.21.15.5:0/2783196734 shutdown_connections 2023-07-14T13:08:05.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.360+0000 7f7387337640 1 -- 172.21.15.5:0/2783196734 wait complete. 2023-07-14T13:08:05.407 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:05.378+0000 7f0bdcf08180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:08:05.415 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T13:08:05.470 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:05.436+0000 7f4d3b348180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:08:05.531 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:05.496+0000 7f4d3b348180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:08:05.547 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:05.522+0000 7f0bdcf08180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:08:05.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.568+0000 7f7603bdf640 1 Processor -- start 2023-07-14T13:08:05.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.568+0000 7f7603bdf640 1 -- start start 2023-07-14T13:08:05.604 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:05.578+0000 7f0bdcf08180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:08:05.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.572+0000 7f7603bdf640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75fc15bde0 0x7f75fc0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:05.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.572+0000 7f7603bdf640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f75fc0d2fc0 0x7f75fc0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:05.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.572+0000 7f7603bdf640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75fc0b04c0 con 0x7f75fc0d2300 2023-07-14T13:08:05.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.572+0000 7f7603bdf640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75fc15c1b0 con 0x7f75fc0d2fc0 2023-07-14T13:08:05.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.572+0000 7f7603bdf640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc0d0aa0 con 0x7f75fc15bde0 2023-07-14T13:08:05.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.572+0000 7f760217c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f75fc0d2300 0x7f75fc0cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44762/0 (socket says 172.21.15.5:44762) 2023-07-14T13:08:05.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.572+0000 7f760217c640 1 -- 172.21.15.5:0/3044147091 learned_addr learned my addr 172.21.15.5:0/3044147091 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.572+0000 7f760117a640 1 --2- 172.21.15.5:0/3044147091 >> v2:172.21.15.154:3300/0 conn(0x7f75fc0d2fc0 0x7f75fc0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.572+0000 7f760197b640 1 --2- 172.21.15.5:0/3044147091 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75fc15bde0 0x7f75fc0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.572+0000 7f7600979640 1 -- 172.21.15.5:0/3044147091 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3489024160 0 0) 0x7f75fc0b04c0 con 0x7f75fc0d2300 2023-07-14T13:08:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.572+0000 7f7600979640 1 -- 172.21.15.5:0/3044147091 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75e8003530 con 0x7f75fc0d2300 2023-07-14T13:08:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.572+0000 7f760117a640 1 -- 172.21.15.5:0/3044147091 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75fc15bde0 msgr2=0x7f75fc0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.572+0000 7f760117a640 1 --2- 172.21.15.5:0/3044147091 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75fc15bde0 0x7f75fc0d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.572+0000 7f760117a640 1 -- 172.21.15.5:0/3044147091 >> v1:172.21.15.5:6789/0 conn(0x7f75fc0d2300 legacy=0x7f75fc0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.572+0000 7f760117a640 1 -- 172.21.15.5:0/3044147091 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc0afb90 con 0x7f75fc0d2fc0 2023-07-14T13:08:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.576+0000 7f760117a640 1 --2- 172.21.15.5:0/3044147091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75fc0d2fc0 0x7f75fc0b0950 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0097c0 tx=0x7f75ec01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62513beb7d2681ab server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.576+0000 7f7600979640 1 -- 172.21.15.5:0/3044147091 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec0ab680 con 0x7f75fc0d2fc0 2023-07-14T13:08:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.576+0000 7f7600979640 1 -- 172.21.15.5:0/3044147091 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ec0ab7e0 con 0x7f75fc0d2fc0 2023-07-14T13:08:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.576+0000 7f7600979640 1 -- 172.21.15.5:0/3044147091 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec0abb70 con 0x7f75fc0d2fc0 2023-07-14T13:08:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.576+0000 7f7603bdf640 1 -- 172.21.15.5:0/3044147091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75fc0d2fc0 msgr2=0x7f75fc0b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.576+0000 7f7603bdf640 1 --2- 172.21.15.5:0/3044147091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75fc0d2fc0 0x7f75fc0b0950 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0097c0 tx=0x7f75ec01c480 comp rx=0 tx=0).stop 2023-07-14T13:08:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.576+0000 7f7603bdf640 1 -- 172.21.15.5:0/3044147091 shutdown_connections 2023-07-14T13:08:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.576+0000 7f7603bdf640 1 --2- 172.21.15.5:0/3044147091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75fc0d2fc0 0x7f75fc0b0950 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.576+0000 7f7603bdf640 1 --2- 172.21.15.5:0/3044147091 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75fc15bde0 0x7f75fc0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.576+0000 7f7603bdf640 1 -- 172.21.15.5:0/3044147091 >> 172.21.15.5:0/3044147091 conn(0x7f75fc0659d0 msgr2=0x7f75fc09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.576+0000 7f7603bdf640 1 -- 172.21.15.5:0/3044147091 shutdown_connections 2023-07-14T13:08:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.576+0000 7f7603bdf640 1 -- 172.21.15.5:0/3044147091 wait complete. 2023-07-14T13:08:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.576+0000 7f7603bdf640 1 Processor -- start 2023-07-14T13:08:05.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.576+0000 7f7603bdf640 1 -- start start 2023-07-14T13:08:05.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.580+0000 7f7603bdf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75fc0d2300 0x7f75fc155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:05.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.580+0000 7f7603bdf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75fc0d2fc0 0x7f75fc159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:05.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.580+0000 7f7603bdf640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75fc15bde0 0x7f75fc159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:05.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.580+0000 7f7603bdf640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc15d360 con 0x7f75fc0d2300 2023-07-14T13:08:05.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.580+0000 7f7603bdf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc15d640 con 0x7f75fc0d2fc0 2023-07-14T13:08:05.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.580+0000 7f7603bdf640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc15d920 con 0x7f75fc15bde0 2023-07-14T13:08:05.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.580+0000 7f760197b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75fc0d2300 0x7f75fc155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:05.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.580+0000 7f760197b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75fc0d2300 0x7f75fc155a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55640/0 (socket says 172.21.15.5:55640) 2023-07-14T13:08:05.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.580+0000 7f760197b640 1 -- 172.21.15.5:0/509624002 learned_addr learned my addr 172.21.15.5:0/509624002 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:05.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.580+0000 7f760217c640 1 --2- 172.21.15.5:0/509624002 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75fc15bde0 0x7f75fc159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:05.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.580+0000 7f760117a640 1 --2- 172.21.15.5:0/509624002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75fc0d2fc0 0x7f75fc159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:05.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.580+0000 7f760197b640 1 -- 172.21.15.5:0/509624002 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75fc15bde0 msgr2=0x7f75fc159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:05.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.580+0000 7f760197b640 1 --2- 172.21.15.5:0/509624002 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75fc15bde0 0x7f75fc159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:05.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.580+0000 7f760197b640 1 -- 172.21.15.5:0/509624002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75fc0d2fc0 msgr2=0x7f75fc159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:05.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.580+0000 7f760197b640 1 --2- 172.21.15.5:0/509624002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75fc0d2fc0 0x7f75fc159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.580+0000 7f760197b640 1 -- 172.21.15.5:0/509624002 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ec009420 con 0x7f75fc0d2300 2023-07-14T13:08:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.580+0000 7f760197b640 1 --2- 172.21.15.5:0/509624002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75fc0d2300 0x7f75fc155a10 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f75f800e9b0 tx=0x7f75f800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.580+0000 7f75f27fc640 1 -- 172.21.15.5:0/509624002 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f8009670 con 0x7f75fc0d2300 2023-07-14T13:08:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.580+0000 7f75f27fc640 1 -- 172.21.15.5:0/509624002 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f800c9a0 con 0x7f75fc0d2300 2023-07-14T13:08:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.580+0000 7f75f27fc640 1 -- 172.21.15.5:0/509624002 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f800cd10 con 0x7f75fc0d2300 2023-07-14T13:08:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.580+0000 7f7603bdf640 1 -- 172.21.15.5:0/509624002 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75fc15dc00 con 0x7f75fc0d2300 2023-07-14T13:08:05.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.580+0000 7f7603bdf640 1 -- 172.21.15.5:0/509624002 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75fc15e400 con 0x7f75fc0d2300 2023-07-14T13:08:05.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.580+0000 7f7603bdf640 1 -- 172.21.15.5:0/509624002 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75fc0678d0 con 0x7f75fc0d2300 2023-07-14T13:08:05.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.584+0000 7f75f27fc640 1 -- 172.21.15.5:0/509624002 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 27) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f75f8013470 con 0x7f75fc0d2300 2023-07-14T13:08:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.584+0000 7f75f27fc640 1 --2- 172.21.15.5:0/509624002 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f75e00663a0 0x7f75e0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.584+0000 7f75f27fc640 1 -- 172.21.15.5:0/509624002 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f75f80845b0 con 0x7f75fc0d2300 2023-07-14T13:08:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.584+0000 7f760117a640 1 -- 172.21.15.5:0/509624002 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f75e00663a0 msgr2=0x7f75e0068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/497535468 2023-07-14T13:08:05.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.584+0000 7f760117a640 1 --2- 172.21.15.5:0/509624002 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f75e00663a0 0x7f75e0068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:08:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.588+0000 7f75f27fc640 1 -- 172.21.15.5:0/509624002 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f75f8051840 con 0x7f75fc0d2300 2023-07-14T13:08:05.686 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:05.652+0000 7f4d3b348180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:08:05.748 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:05.716+0000 7f4d3b348180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:08:05.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.744+0000 7f7603bdf640 1 -- 172.21.15.5:0/509624002 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f75fc08ad20 con 0x7f75fc0d2300 2023-07-14T13:08:05.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.744+0000 7f75f27fc640 1 -- 172.21.15.5:0/509624002 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v68) v1 ==== 100+0+11 (secure 0 0 0) 0x7f75f8054e60 con 0x7f75fc0d2300 2023-07-14T13:08:05.780 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T13:08:05.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.748+0000 7f7603bdf640 1 -- 172.21.15.5:0/509624002 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f75e00663a0 msgr2=0x7f75e0068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:08:05.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.748+0000 7f7603bdf640 1 --2- 172.21.15.5:0/509624002 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f75e00663a0 0x7f75e0068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:05.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.748+0000 7f7603bdf640 1 -- 172.21.15.5:0/509624002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75fc0d2300 msgr2=0x7f75fc155a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:05.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.748+0000 7f7603bdf640 1 --2- 172.21.15.5:0/509624002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75fc0d2300 0x7f75fc155a10 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f75f800e9b0 tx=0x7f75f800ee70 comp rx=0 tx=0).stop 2023-07-14T13:08:05.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.748+0000 7f7603bdf640 1 -- 172.21.15.5:0/509624002 shutdown_connections 2023-07-14T13:08:05.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.748+0000 7f7603bdf640 1 --2- 172.21.15.5:0/509624002 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75fc15bde0 0x7f75fc159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:05.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.748+0000 7f7603bdf640 1 --2- 172.21.15.5:0/509624002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75fc0d2fc0 0x7f75fc159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:05.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.748+0000 7f7603bdf640 1 --2- 172.21.15.5:0/509624002 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f75e00663a0 0x7f75e0068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:05.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.748+0000 7f7603bdf640 1 --2- 172.21.15.5:0/509624002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75fc0d2300 0x7f75fc155a10 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:05.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.748+0000 7f7603bdf640 1 -- 172.21.15.5:0/509624002 >> 172.21.15.5:0/509624002 conn(0x7f75fc0659d0 msgr2=0x7f75fc15b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:05.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.748+0000 7f7603bdf640 1 -- 172.21.15.5:0/509624002 shutdown_connections 2023-07-14T13:08:05.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.748+0000 7f7603bdf640 1 -- 172.21.15.5:0/509624002 wait complete. 2023-07-14T13:08:05.802 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T13:08:05.847 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:08:05.847 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:08:05.847 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:08:05.855 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:05.826+0000 7f0bdcf08180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:08:05.989 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:05.962+0000 7f0bdcf08180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:08:06.008 INFO:tasks.ceph.mgr.y.smithi005.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:08:06.008 INFO:tasks.ceph.mgr.y.smithi005.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:08:06.008 INFO:tasks.ceph.mgr.y.smithi005.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:08:06.017 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:05.984+0000 7f4d3b348180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:08:06.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.992+0000 7fe48be9c640 1 Processor -- start 2023-07-14T13:08:06.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.992+0000 7fe48be9c640 1 -- start start 2023-07-14T13:08:06.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.992+0000 7fe48be9c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe4840d06b0 0x7fe4840b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:06.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.992+0000 7fe48be9c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4840b1f70 0x7fe4840d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.992+0000 7fe48be9c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4840b2410 con 0x7fe484145430 2023-07-14T13:08:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.992+0000 7fe48be9c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4840b26f0 con 0x7fe4840d06b0 2023-07-14T13:08:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.992+0000 7fe48be9c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4840b29d0 con 0x7fe4840b1f70 2023-07-14T13:08:06.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.992+0000 7fe489437640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe484145430 0x7fe4840b34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44768/0 (socket says 172.21.15.5:44768) 2023-07-14T13:08:06.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.992+0000 7fe489437640 1 -- 172.21.15.5:0/3501129687 learned_addr learned my addr 172.21.15.5:0/3501129687 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:06.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.996+0000 7fe48a439640 1 --2- 172.21.15.5:0/3501129687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4840b1f70 0x7fe4840d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:06.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.996+0000 7fe489c38640 1 --2- 172.21.15.5:0/3501129687 >> v2:172.21.15.154:3300/0 conn(0x7fe4840d06b0 0x7fe4840b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:06.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.996+0000 7fe488c36640 1 -- 172.21.15.5:0/3501129687 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036894048 0 0) 0x7fe4840b2410 con 0x7fe484145430 2023-07-14T13:08:06.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.996+0000 7fe488c36640 1 -- 172.21.15.5:0/3501129687 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe470003530 con 0x7fe484145430 2023-07-14T13:08:06.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.996+0000 7fe48a439640 1 -- 172.21.15.5:0/3501129687 >> v2:172.21.15.154:3300/0 conn(0x7fe4840d06b0 msgr2=0x7fe4840b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:06.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.996+0000 7fe48a439640 1 --2- 172.21.15.5:0/3501129687 >> v2:172.21.15.154:3300/0 conn(0x7fe4840d06b0 0x7fe4840b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:06.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.996+0000 7fe48a439640 1 -- 172.21.15.5:0/3501129687 >> v1:172.21.15.5:6789/0 conn(0x7fe484145430 legacy=0x7fe4840b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:06.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.996+0000 7fe48a439640 1 -- 172.21.15.5:0/3501129687 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4840b2cb0 con 0x7fe4840b1f70 2023-07-14T13:08:06.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.996+0000 7fe48a439640 1 --2- 172.21.15.5:0/3501129687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4840b1f70 0x7fe4840d22e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe47c009d90 tx=0x7fe47c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27bc830ff38fbeaf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:06.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.996+0000 7fe488c36640 1 -- 172.21.15.5:0/3501129687 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c0a58f0 con 0x7fe4840b1f70 2023-07-14T13:08:06.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.996+0000 7fe488c36640 1 -- 172.21.15.5:0/3501129687 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47c0a5a50 con 0x7fe4840b1f70 2023-07-14T13:08:06.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:05.996+0000 7fe488c36640 1 -- 172.21.15.5:0/3501129687 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c0a5de0 con 0x7fe4840b1f70 2023-07-14T13:08:06.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.000+0000 7fe48be9c640 1 -- 172.21.15.5:0/3501129687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4840b1f70 msgr2=0x7fe4840d22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.000+0000 7fe48be9c640 1 --2- 172.21.15.5:0/3501129687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4840b1f70 0x7fe4840d22e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe47c009d90 tx=0x7fe47c01c920 comp rx=0 tx=0).stop 2023-07-14T13:08:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.000+0000 7fe48be9c640 1 -- 172.21.15.5:0/3501129687 shutdown_connections 2023-07-14T13:08:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.000+0000 7fe48be9c640 1 --2- 172.21.15.5:0/3501129687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4840b1f70 0x7fe4840d22e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.000+0000 7fe48be9c640 1 --2- 172.21.15.5:0/3501129687 >> v2:172.21.15.154:3300/0 conn(0x7fe4840d06b0 0x7fe4840b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.000+0000 7fe48be9c640 1 -- 172.21.15.5:0/3501129687 >> 172.21.15.5:0/3501129687 conn(0x7fe4840659d0 msgr2=0x7fe48409b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.000+0000 7fe48be9c640 1 -- 172.21.15.5:0/3501129687 shutdown_connections 2023-07-14T13:08:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.000+0000 7fe48be9c640 1 -- 172.21.15.5:0/3501129687 wait complete. 2023-07-14T13:08:06.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.000+0000 7fe48be9c640 1 Processor -- start 2023-07-14T13:08:06.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.000+0000 7fe48be9c640 1 -- start start 2023-07-14T13:08:06.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.000+0000 7fe48be9c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4840b1f70 0x7fe4840cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:06.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.000+0000 7fe48be9c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4840d06b0 0x7fe4840b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:06.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.000+0000 7fe48be9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4840ca5a0 0x7fe4840b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:06.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.000+0000 7fe48be9c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4840cbf30 con 0x7fe4840ca5a0 2023-07-14T13:08:06.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.000+0000 7fe48be9c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4840b7b40 con 0x7fe4840b1f70 2023-07-14T13:08:06.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.000+0000 7fe48be9c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4840ca110 con 0x7fe4840d06b0 2023-07-14T13:08:06.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.000+0000 7fe48a439640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4840ca5a0 0x7fe4840b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:06.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.000+0000 7fe48a439640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4840ca5a0 0x7fe4840b56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55646/0 (socket says 172.21.15.5:55646) 2023-07-14T13:08:06.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.000+0000 7fe48a439640 1 -- 172.21.15.5:0/3082395061 learned_addr learned my addr 172.21.15.5:0/3082395061 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:06.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.000+0000 7fe489c38640 1 --2- 172.21.15.5:0/3082395061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4840b1f70 0x7fe4840cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:06.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.000+0000 7fe489437640 1 --2- 172.21.15.5:0/3082395061 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4840d06b0 0x7fe4840b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:06.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.004+0000 7fe48a439640 1 -- 172.21.15.5:0/3082395061 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4840d06b0 msgr2=0x7fe4840b5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:06.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.004+0000 7fe48a439640 1 --2- 172.21.15.5:0/3082395061 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4840d06b0 0x7fe4840b5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:06.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.004+0000 7fe48a439640 1 -- 172.21.15.5:0/3082395061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4840b1f70 msgr2=0x7fe4840cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:06.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.004+0000 7fe48a439640 1 --2- 172.21.15.5:0/3082395061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4840b1f70 0x7fe4840cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:06.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.004+0000 7fe48a439640 1 -- 172.21.15.5:0/3082395061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c009a70 con 0x7fe4840ca5a0 2023-07-14T13:08:06.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.004+0000 7fe489437640 1 --2- 172.21.15.5:0/3082395061 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4840d06b0 0x7fe4840b5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:06.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.004+0000 7fe48a439640 1 --2- 172.21.15.5:0/3082395061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4840ca5a0 0x7fe4840b56c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe47c009d90 tx=0x7fe47c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:06.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.004+0000 7fe47a7fc640 1 -- 172.21.15.5:0/3082395061 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c0b9650 con 0x7fe4840ca5a0 2023-07-14T13:08:06.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.004+0000 7fe47a7fc640 1 -- 172.21.15.5:0/3082395061 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47c0b97b0 con 0x7fe4840ca5a0 2023-07-14T13:08:06.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.004+0000 7fe47a7fc640 1 -- 172.21.15.5:0/3082395061 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c0b9b40 con 0x7fe4840ca5a0 2023-07-14T13:08:06.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.004+0000 7fe48be9c640 1 -- 172.21.15.5:0/3082395061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4840c9e00 con 0x7fe4840ca5a0 2023-07-14T13:08:06.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.004+0000 7fe48be9c640 1 -- 172.21.15.5:0/3082395061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4840b8070 con 0x7fe4840ca5a0 2023-07-14T13:08:06.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.004+0000 7fe48be9c640 1 -- 172.21.15.5:0/3082395061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe484072e70 con 0x7fe4840ca5a0 2023-07-14T13:08:06.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.004+0000 7fe47a7fc640 1 -- 172.21.15.5:0/3082395061 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 27) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fe47c0b9ca0 con 0x7fe4840ca5a0 2023-07-14T13:08:06.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.008+0000 7fe47a7fc640 1 --2- 172.21.15.5:0/3082395061 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7fe4680663a0 0x7fe468068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:06.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.008+0000 7fe47a7fc640 1 -- 172.21.15.5:0/3082395061 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fe47c11f610 con 0x7fe4840ca5a0 2023-07-14T13:08:06.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.008+0000 7fe489c38640 1 -- 172.21.15.5:0/3082395061 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7fe4680663a0 msgr2=0x7fe468068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/497535468 2023-07-14T13:08:06.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.008+0000 7fe489c38640 1 --2- 172.21.15.5:0/3082395061 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7fe4680663a0 0x7fe468068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:08:06.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.012+0000 7fe47a7fc640 1 -- 172.21.15.5:0/3082395061 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe47c0ec9a0 con 0x7fe4840ca5a0 2023-07-14T13:08:06.115 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:06.086+0000 7f0bdcf08180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:08:06.164 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:06.132+0000 7f4d3b348180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:08:06.184 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:06.158+0000 7f0bdcf08180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:08:06.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.184+0000 7fe48be9c640 1 -- 172.21.15.5:0/3082395061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe4840ca280 con 0x7fe4840ca5a0 2023-07-14T13:08:06.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.184+0000 7fe47a7fc640 1 -- 172.21.15.5:0/3082395061 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v68) v1 ==== 80+0+476 (secure 0 0 0) 0x7fe47c0effc0 con 0x7fe4840ca5a0 2023-07-14T13:08:06.219 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/3011670516 2023-07-15T13:06:18.429741+0000 2023-07-14T13:08:06.219 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/2719767027 2023-07-15T13:06:18.429741+0000 2023-07-14T13:08:06.219 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:6833/1810553301 2023-07-15T13:06:18.429741+0000 2023-07-14T13:08:06.219 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:6832/1810553301 2023-07-15T13:06:18.429741+0000 2023-07-14T13:08:06.219 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/2307511449 2023-07-15T13:06:18.429741+0000 2023-07-14T13:08:06.219 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/2860419665 2023-07-15T13:06:18.429741+0000 2023-07-14T13:08:06.220 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/870084639 2023-07-15T13:06:18.429741+0000 2023-07-14T13:08:06.220 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/124304401 2023-07-15T13:06:18.429741+0000 2023-07-14T13:08:06.221 INFO:teuthology.orchestra.run.smithi005.stderr:listed 8 entries 2023-07-14T13:08:06.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.188+0000 7fe48be9c640 1 -- 172.21.15.5:0/3082395061 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7fe4680663a0 msgr2=0x7fe468068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:08:06.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.188+0000 7fe48be9c640 1 --2- 172.21.15.5:0/3082395061 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7fe4680663a0 0x7fe468068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:06.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.188+0000 7fe48be9c640 1 -- 172.21.15.5:0/3082395061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4840ca5a0 msgr2=0x7fe4840b56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:06.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.188+0000 7fe48be9c640 1 --2- 172.21.15.5:0/3082395061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4840ca5a0 0x7fe4840b56c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe47c009d90 tx=0x7fe47c0196c0 comp rx=0 tx=0).stop 2023-07-14T13:08:06.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.188+0000 7fe48be9c640 1 -- 172.21.15.5:0/3082395061 shutdown_connections 2023-07-14T13:08:06.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.188+0000 7fe48be9c640 1 --2- 172.21.15.5:0/3082395061 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7fe4680663a0 0x7fe468068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:06.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.188+0000 7fe48be9c640 1 --2- 172.21.15.5:0/3082395061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4840ca5a0 0x7fe4840b56c0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:06.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.188+0000 7fe48be9c640 1 --2- 172.21.15.5:0/3082395061 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe4840d06b0 0x7fe4840b5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:06.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.188+0000 7fe48be9c640 1 --2- 172.21.15.5:0/3082395061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4840b1f70 0x7fe4840cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:06.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.188+0000 7fe48be9c640 1 -- 172.21.15.5:0/3082395061 >> 172.21.15.5:0/3082395061 conn(0x7fe4840659d0 msgr2=0x7fe4840afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:06.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.188+0000 7fe48be9c640 1 -- 172.21.15.5:0/3082395061 shutdown_connections 2023-07-14T13:08:06.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.188+0000 7fe48be9c640 1 -- 172.21.15.5:0/3082395061 wait complete. 2023-07-14T13:08:06.240 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-14T13:08:06.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:08:06.241 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-14T13:08:06.296 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-07-14T13:08:06.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:08:06.297 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-14T13:08:06.300 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:06.268+0000 7f4d3b348180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:08:06.306 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:08:06.307 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:08:06.315 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:08:06.316 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:08:06.316 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:08:06.317 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:06.290+0000 7f0bdcf08180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:08:06.356 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:08:06.356 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:08:06.357 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:08:06.366 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:08:06.366 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:08:06.374 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:06.340+0000 7f4d3b348180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:08:06.518 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:06.484+0000 7f4d3b348180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:08:06.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.484+0000 7f20ff7d2640 1 Processor -- start 2023-07-14T13:08:06.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.484+0000 7f20ff7d2640 1 -- start start 2023-07-14T13:08:06.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.488+0000 7f20ff7d2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f20f80b7990 0x7f20f80d0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:06.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.488+0000 7f20ff7d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20f80d1840 0x7f20f80d1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:06.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.488+0000 7f20ff7d2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f80b4840 con 0x7f20f80d12f0 2023-07-14T13:08:06.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.488+0000 7f20ff7d2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f80cd060 con 0x7f20f80b7990 2023-07-14T13:08:06.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.488+0000 7f20ff7d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f80d1180 con 0x7f20f80d1840 2023-07-14T13:08:06.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.488+0000 7f20fd56e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f20f80b7990 0x7f20f80d0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:06.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.488+0000 7f20fdd6f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20f80d1840 0x7f20f80d1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:06.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.488+0000 7f20fdd6f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20f80d1840 0x7f20f80d1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:40540/0 (socket says 172.21.15.5:40540) 2023-07-14T13:08:06.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.488+0000 7f20fdd6f640 1 -- 172.21.15.5:0/185093159 learned_addr learned my addr 172.21.15.5:0/185093159 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:06.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.488+0000 7f20fd56e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f20f80b7990 0x7f20f80d0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:58664/0 (socket says 172.21.15.5:58664) 2023-07-14T13:08:06.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.488+0000 7f20fd56e640 1 -- 172.21.15.5:0/185093159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20f80d1840 msgr2=0x7f20f80d1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:06.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.488+0000 7f20fd56e640 1 --2- 172.21.15.5:0/185093159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20f80d1840 0x7f20f80d1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:06.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.488+0000 7f20fd56e640 1 -- 172.21.15.5:0/185093159 >> v1:172.21.15.154:6789/0 conn(0x7f20f80d12f0 legacy=0x7f20f815f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:06.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.488+0000 7f20fd56e640 1 -- 172.21.15.5:0/185093159 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f80ccae0 con 0x7f20f80b7990 2023-07-14T13:08:06.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.488+0000 7f20fdd6f640 1 --2- 172.21.15.5:0/185093159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20f80d1840 0x7f20f80d1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:06.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.492+0000 7f20fd56e640 1 --2- 172.21.15.5:0/185093159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20f80b7990 0x7f20f80d0c40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f20f40097c0 tx=0x7f20f401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c6f7a0783ace48d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:06.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.492+0000 7f20effff640 1 -- 172.21.15.5:0/185093159 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f40ab600 con 0x7f20f80b7990 2023-07-14T13:08:06.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.492+0000 7f20effff640 1 -- 172.21.15.5:0/185093159 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f40a7050 con 0x7f20f80b7990 2023-07-14T13:08:06.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.492+0000 7f20effff640 1 -- 172.21.15.5:0/185093159 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f40ab980 con 0x7f20f80b7990 2023-07-14T13:08:06.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.492+0000 7f20ff7d2640 1 -- 172.21.15.5:0/185093159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20f80b7990 msgr2=0x7f20f80d0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:06.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.492+0000 7f20ff7d2640 1 --2- 172.21.15.5:0/185093159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20f80b7990 0x7f20f80d0c40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f20f40097c0 tx=0x7f20f401c3f0 comp rx=0 tx=0).stop 2023-07-14T13:08:06.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.492+0000 7f20ff7d2640 1 -- 172.21.15.5:0/185093159 shutdown_connections 2023-07-14T13:08:06.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.492+0000 7f20ff7d2640 1 --2- 172.21.15.5:0/185093159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20f80d1840 0x7f20f80d1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:06.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.492+0000 7f20ff7d2640 1 --2- 172.21.15.5:0/185093159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20f80b7990 0x7f20f80d0c40 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:06.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.492+0000 7f20ff7d2640 1 -- 172.21.15.5:0/185093159 >> 172.21.15.5:0/185093159 conn(0x7f20f80650b0 msgr2=0x7f20f80654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:06.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.492+0000 7f20ff7d2640 1 -- 172.21.15.5:0/185093159 shutdown_connections 2023-07-14T13:08:06.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.492+0000 7f20ff7d2640 1 -- 172.21.15.5:0/185093159 wait complete. 2023-07-14T13:08:06.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.492+0000 7f20ff7d2640 1 Processor -- start 2023-07-14T13:08:06.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.492+0000 7f20ff7d2640 1 -- start start 2023-07-14T13:08:06.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.496+0000 7f20ff7d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20f80b7990 0x7f20f8152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:06.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.496+0000 7f20ff7d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20f80d12f0 0x7f20f815e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:06.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.496+0000 7f20ff7d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20f80d1840 0x7f20f80c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:06.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.496+0000 7f20ff7d2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f8152cc0 con 0x7f20f80d12f0 2023-07-14T13:08:06.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.496+0000 7f20ff7d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f815e580 con 0x7f20f80d1840 2023-07-14T13:08:06.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.496+0000 7f20ff7d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f815a7e0 con 0x7f20f80b7990 2023-07-14T13:08:06.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.496+0000 7f20fcd6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20f80d12f0 0x7f20f815e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:06.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.496+0000 7f20fcd6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20f80d12f0 0x7f20f815e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55654/0 (socket says 172.21.15.5:55654) 2023-07-14T13:08:06.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.496+0000 7f20fcd6d640 1 -- 172.21.15.5:0/3276158252 learned_addr learned my addr 172.21.15.5:0/3276158252 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:06.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.496+0000 7f20fdd6f640 1 --2- 172.21.15.5:0/3276158252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20f80d1840 0x7f20f80c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:06.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.496+0000 7f20fd56e640 1 --2- 172.21.15.5:0/3276158252 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20f80b7990 0x7f20f8152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:06.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.496+0000 7f20fcd6d640 1 -- 172.21.15.5:0/3276158252 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20f80b7990 msgr2=0x7f20f8152780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:06.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.496+0000 7f20fcd6d640 1 --2- 172.21.15.5:0/3276158252 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20f80b7990 0x7f20f8152780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:06.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.496+0000 7f20fcd6d640 1 -- 172.21.15.5:0/3276158252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20f80d1840 msgr2=0x7f20f80c77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:06.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.496+0000 7f20fcd6d640 1 --2- 172.21.15.5:0/3276158252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20f80d1840 0x7f20f80c77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:06.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.496+0000 7f20fcd6d640 1 -- 172.21.15.5:0/3276158252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f0009b30 con 0x7f20f80d12f0 2023-07-14T13:08:06.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.496+0000 7f20fcd6d640 1 --2- 172.21.15.5:0/3276158252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20f80d12f0 0x7f20f815e040 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f20e800c3a0 tx=0x7f20e800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:06.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.496+0000 7f20edffb640 1 -- 172.21.15.5:0/3276158252 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e80052d0 con 0x7f20f80d12f0 2023-07-14T13:08:06.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.496+0000 7f20edffb640 1 -- 172.21.15.5:0/3276158252 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e8005450 con 0x7f20f80d12f0 2023-07-14T13:08:06.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.496+0000 7f20edffb640 1 -- 172.21.15.5:0/3276158252 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e8003860 con 0x7f20f80d12f0 2023-07-14T13:08:06.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.496+0000 7f20ff7d2640 1 -- 172.21.15.5:0/3276158252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f4009420 con 0x7f20f80d12f0 2023-07-14T13:08:06.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.496+0000 7f20ff7d2640 1 -- 172.21.15.5:0/3276158252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f80b7ee0 con 0x7f20f80d12f0 2023-07-14T13:08:06.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.496+0000 7f20ff7d2640 1 -- 172.21.15.5:0/3276158252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f80678d0 con 0x7f20f80d12f0 2023-07-14T13:08:06.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.500+0000 7f20edffb640 1 -- 172.21.15.5:0/3276158252 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 27) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f20e80039c0 con 0x7f20f80d12f0 2023-07-14T13:08:06.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.500+0000 7f20edffb640 1 --2- 172.21.15.5:0/3276158252 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f20dc0663d0 0x7f20dc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:06.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.500+0000 7f20edffb640 1 -- 172.21.15.5:0/3276158252 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f20e80834e0 con 0x7f20f80d12f0 2023-07-14T13:08:06.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.500+0000 7f20fd56e640 1 -- 172.21.15.5:0/3276158252 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f20dc0663d0 msgr2=0x7f20dc068880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/497535468 2023-07-14T13:08:06.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.500+0000 7f20fd56e640 1 --2- 172.21.15.5:0/3276158252 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f20dc0663d0 0x7f20dc068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:08:06.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.508+0000 7f20edffb640 1 -- 172.21.15.5:0/3276158252 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f20e80506f0 con 0x7f20f80d12f0 2023-07-14T13:08:06.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.696+0000 7f20ff7d2640 1 -- 172.21.15.5:0/3276158252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20f8073040 con 0x7f20f80d12f0 2023-07-14T13:08:06.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.696+0000 7f20edffb640 1 -- 172.21.15.5:0/3276158252 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4700 (secure 0 0 0) 0x7f20e8053d10 con 0x7f20f80d12f0 2023-07-14T13:08:06.730 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:06.731 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5429,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/874132020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":874132020},{"type":"v1","addr":"172.21.15.154:6837","nonce":874132020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5911,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/217555499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":217555499},{"type":"v1","addr":"172.21.15.154:6835","nonce":217555499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6033,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3051331859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3051331859},{"type":"v1","addr":"172.21.15.5:6834","nonce":3051331859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:06:01.137621+0000","modified":"2023-07-14T13:06:04.782437+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6036":{"gid":6036,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/231396012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":231396012},{"type":"v1","addr":"172.21.15.5:6835","nonce":231396012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T13:08:06.731 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2023-07-14T13:08:06.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.700+0000 7f20ff7d2640 1 -- 172.21.15.5:0/3276158252 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f20dc0663d0 msgr2=0x7f20dc068880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:08:06.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.700+0000 7f20ff7d2640 1 --2- 172.21.15.5:0/3276158252 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f20dc0663d0 0x7f20dc068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:06.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.700+0000 7f20ff7d2640 1 -- 172.21.15.5:0/3276158252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20f80d12f0 msgr2=0x7f20f815e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:06.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.700+0000 7f20ff7d2640 1 --2- 172.21.15.5:0/3276158252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20f80d12f0 0x7f20f815e040 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f20e800c3a0 tx=0x7f20e800c860 comp rx=0 tx=0).stop 2023-07-14T13:08:06.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.700+0000 7f20ff7d2640 1 -- 172.21.15.5:0/3276158252 shutdown_connections 2023-07-14T13:08:06.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.700+0000 7f20ff7d2640 1 --2- 172.21.15.5:0/3276158252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20f80d1840 0x7f20f80c77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:06.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.700+0000 7f20ff7d2640 1 --2- 172.21.15.5:0/3276158252 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f20dc0663d0 0x7f20dc068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:06.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.700+0000 7f20ff7d2640 1 --2- 172.21.15.5:0/3276158252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20f80d12f0 0x7f20f815e040 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:06.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.700+0000 7f20ff7d2640 1 --2- 172.21.15.5:0/3276158252 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20f80b7990 0x7f20f8152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:06.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.700+0000 7f20ff7d2640 1 -- 172.21.15.5:0/3276158252 >> 172.21.15.5:0/3276158252 conn(0x7f20f80650b0 msgr2=0x7f20f80b65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:06.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.700+0000 7f20ff7d2640 1 -- 172.21.15.5:0/3276158252 shutdown_connections 2023-07-14T13:08:06.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.700+0000 7f20ff7d2640 1 -- 172.21.15.5:0/3276158252 wait complete. 2023-07-14T13:08:06.752 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:08:06.857 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:06.830+0000 7f0bdcf08180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:08:06.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.868+0000 7f54c91d2640 1 Processor -- start 2023-07-14T13:08:06.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.868+0000 7f54c91d2640 1 -- start start 2023-07-14T13:08:06.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.868+0000 7f54c91d2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f54c40b7c70 0x7f54c40d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:06.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.868+0000 7f54c91d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54c415fd60 0x7f54c40d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:06.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.868+0000 7f54c91d2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40ccaf0 con 0x7f54c40d1850 2023-07-14T13:08:06.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.868+0000 7f54c91d2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40d1190 con 0x7f54c40b7c70 2023-07-14T13:08:06.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.868+0000 7f54c91d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c4160600 con 0x7f54c415fd60 2023-07-14T13:08:06.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.868+0000 7f54c2d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f54c40b7c70 0x7f54c40d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:06.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.868+0000 7f54c2d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f54c40b7c70 0x7f54c40d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55664/0 (socket says 172.21.15.5:55664) 2023-07-14T13:08:06.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.868+0000 7f54c2d9d640 1 -- 172.21.15.5:0/1368698760 learned_addr learned my addr 172.21.15.5:0/1368698760 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:06.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.868+0000 7f54c359e640 1 --2- 172.21.15.5:0/1368698760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54c415fd60 0x7f54c40d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.868+0000 7f54c2d9d640 1 -- 172.21.15.5:0/1368698760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54c415fd60 msgr2=0x7f54c40d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.868+0000 7f54c2d9d640 1 --2- 172.21.15.5:0/1368698760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54c415fd60 0x7f54c40d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.868+0000 7f54c2d9d640 1 -- 172.21.15.5:0/1368698760 >> v1:172.21.15.154:6789/0 conn(0x7f54c40d1850 legacy=0x7f54c415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.868+0000 7f54c2d9d640 1 -- 172.21.15.5:0/1368698760 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c4160320 con 0x7f54c40b7c70 2023-07-14T13:08:06.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.872+0000 7f54c2d9d640 1 --2- 172.21.15.5:0/1368698760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c40b7c70 0x7f54c40d0c50 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f54b4009870 tx=0x7f54b401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99df3c45366165f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:06.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.872+0000 7f54c259c640 1 -- 172.21.15.5:0/1368698760 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b40a95f0 con 0x7f54c40b7c70 2023-07-14T13:08:06.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.872+0000 7f54c259c640 1 -- 172.21.15.5:0/1368698760 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b40a9750 con 0x7f54c40b7c70 2023-07-14T13:08:06.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.872+0000 7f54c259c640 1 -- 172.21.15.5:0/1368698760 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b40a9ae0 con 0x7f54c40b7c70 2023-07-14T13:08:06.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.872+0000 7f54c91d2640 1 -- 172.21.15.5:0/1368698760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c40b7c70 msgr2=0x7f54c40d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:06.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.872+0000 7f54c91d2640 1 --2- 172.21.15.5:0/1368698760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c40b7c70 0x7f54c40d0c50 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f54b4009870 tx=0x7f54b401c510 comp rx=0 tx=0).stop 2023-07-14T13:08:06.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.872+0000 7f54c91d2640 1 -- 172.21.15.5:0/1368698760 shutdown_connections 2023-07-14T13:08:06.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.872+0000 7f54c91d2640 1 --2- 172.21.15.5:0/1368698760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54c415fd60 0x7f54c40d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:06.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.872+0000 7f54c91d2640 1 --2- 172.21.15.5:0/1368698760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c40b7c70 0x7f54c40d0c50 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:06.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.872+0000 7f54c91d2640 1 -- 172.21.15.5:0/1368698760 >> 172.21.15.5:0/1368698760 conn(0x7f54c40650b0 msgr2=0x7f54c40654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:06.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.872+0000 7f54c91d2640 1 -- 172.21.15.5:0/1368698760 shutdown_connections 2023-07-14T13:08:06.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.872+0000 7f54c91d2640 1 -- 172.21.15.5:0/1368698760 wait complete. 2023-07-14T13:08:06.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.876+0000 7f54c91d2640 1 Processor -- start 2023-07-14T13:08:06.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.876+0000 7f54c91d2640 1 -- start start 2023-07-14T13:08:06.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.876+0000 7f54c91d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c40b7c70 0x7f54c41541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:06.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.876+0000 7f54c91d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c40d1850 0x7f54c415ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:06.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.876+0000 7f54c91d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54c415fd60 0x7f54c415d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:06.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.876+0000 7f54c91d2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c415ba40 con 0x7f54c40b7c70 2023-07-14T13:08:06.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.876+0000 7f54c91d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c415ae30 con 0x7f54c40d1850 2023-07-14T13:08:06.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.876+0000 7f54c91d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c415b110 con 0x7f54c415fd60 2023-07-14T13:08:06.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.876+0000 7f54c2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c40b7c70 0x7f54c41541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:06.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.876+0000 7f54c2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c40b7c70 0x7f54c41541d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55666/0 (socket says 172.21.15.5:55666) 2023-07-14T13:08:06.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.876+0000 7f54c2d9d640 1 -- 172.21.15.5:0/56976633 learned_addr learned my addr 172.21.15.5:0/56976633 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:06.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.876+0000 7f54bbfff640 1 --2- 172.21.15.5:0/56976633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c40d1850 0x7f54c415ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:06.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.876+0000 7f54c359e640 1 --2- 172.21.15.5:0/56976633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54c415fd60 0x7f54c415d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:06.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.876+0000 7f54c2d9d640 1 -- 172.21.15.5:0/56976633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54c415fd60 msgr2=0x7f54c415d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:06.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.876+0000 7f54c2d9d640 1 --2- 172.21.15.5:0/56976633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54c415fd60 0x7f54c415d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:06.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.876+0000 7f54c2d9d640 1 -- 172.21.15.5:0/56976633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c40d1850 msgr2=0x7f54c415ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:06.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.876+0000 7f54c2d9d640 1 --2- 172.21.15.5:0/56976633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c40d1850 0x7f54c415ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:06.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.876+0000 7f54c2d9d640 1 -- 172.21.15.5:0/56976633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b40094d0 con 0x7f54c40b7c70 2023-07-14T13:08:06.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.876+0000 7f54c2d9d640 1 --2- 172.21.15.5:0/56976633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c40b7c70 0x7f54c41541d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f54b401abc0 tx=0x7f54b40192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.880+0000 7f54bb7fe640 1 -- 172.21.15.5:0/56976633 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b40a95f0 con 0x7f54c40b7c70 2023-07-14T13:08:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.880+0000 7f54bb7fe640 1 -- 172.21.15.5:0/56976633 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b40b1820 con 0x7f54c40b7c70 2023-07-14T13:08:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.880+0000 7f54bb7fe640 1 -- 172.21.15.5:0/56976633 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b40b1bd0 con 0x7f54c40b7c70 2023-07-14T13:08:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.880+0000 7f54c91d2640 1 -- 172.21.15.5:0/56976633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c415b3f0 con 0x7f54c40b7c70 2023-07-14T13:08:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.880+0000 7f54c91d2640 1 -- 172.21.15.5:0/56976633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c415aac0 con 0x7f54c40b7c70 2023-07-14T13:08:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.880+0000 7f54c91d2640 1 -- 172.21.15.5:0/56976633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c40c92a0 con 0x7f54c40b7c70 2023-07-14T13:08:06.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.880+0000 7f54bb7fe640 1 -- 172.21.15.5:0/56976633 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 27) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f54b40b1d30 con 0x7f54c40b7c70 2023-07-14T13:08:06.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.880+0000 7f54bb7fe640 1 --2- 172.21.15.5:0/56976633 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f54a40663a0 0x7f54a4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:06.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.880+0000 7f54bb7fe640 1 -- 172.21.15.5:0/56976633 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6552+0+0 (secure 0 0 0) 0x7f54b411e590 con 0x7f54c40b7c70 2023-07-14T13:08:06.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.880+0000 7f54bbfff640 1 -- 172.21.15.5:0/56976633 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f54a40663a0 msgr2=0x7f54a4068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/497535468 2023-07-14T13:08:06.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.880+0000 7f54bbfff640 1 --2- 172.21.15.5:0/56976633 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f54a40663a0 0x7f54a4068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:08:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:06.888+0000 7f54bb7fe640 1 -- 172.21.15.5:0/56976633 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f54c40c92a0 con 0x7f54c40b7c70 2023-07-14T13:08:06.943 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:06.914+0000 7f0bdcf08180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:08:07.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.060+0000 7f54c91d2640 1 -- 172.21.15.5:0/56976633 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54c40c92a0 con 0x7f54c40b7c70 2023-07-14T13:08:07.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.060+0000 7f54bb7fe640 1 -- 172.21.15.5:0/56976633 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+19004 (secure 0 0 0) 0x7f54c40c92a0 con 0x7f54c40b7c70 2023-07-14T13:08:07.094 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:07.094 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":69,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:08:06.777654+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:05:59.255634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-14T13:06:00.136409+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":4,"snap_epoch":69,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.37","mappings":[{"from":0,"to":6}]},{"pgid":"8.3d","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/3011670516":"2023-07-15T13:06:18.429741+0000","172.21.15.154:0/2719767027":"2023-07-15T13:06:18.429741+0000","172.21.15.154:6833/1810553301":"2023-07-15T13:06:18.429741+0000","172.21.15.154:6832/1810553301":"2023-07-15T13:06:18.429741+0000","172.21.15.154:0/2307511449":"2023-07-15T13:06:18.429741+0000","172.21.15.154:0/2860419665":"2023-07-15T13:06:18.429741+0000","172.21.15.154:0/870084639":"2023-07-15T13:06:18.429741+0000","172.21.15.154:0/124304401":"2023-07-15T13:06:18.429741+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:08:07.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.064+0000 7f54c91d2640 1 -- 172.21.15.5:0/56976633 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f54a40663a0 msgr2=0x7f54a4068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:08:07.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.064+0000 7f54c91d2640 1 --2- 172.21.15.5:0/56976633 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f54a40663a0 0x7f54a4068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:07.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.064+0000 7f54c91d2640 1 -- 172.21.15.5:0/56976633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c40b7c70 msgr2=0x7f54c41541d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:07.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.064+0000 7f54c91d2640 1 --2- 172.21.15.5:0/56976633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c40b7c70 0x7f54c41541d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f54b401abc0 tx=0x7f54b40192b0 comp rx=0 tx=0).stop 2023-07-14T13:08:07.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.064+0000 7f54c91d2640 1 -- 172.21.15.5:0/56976633 shutdown_connections 2023-07-14T13:08:07.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.064+0000 7f54c91d2640 1 --2- 172.21.15.5:0/56976633 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54c415fd60 0x7f54c415d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:07.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.064+0000 7f54c91d2640 1 --2- 172.21.15.5:0/56976633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c40d1850 0x7f54c415ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:07.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.064+0000 7f54c91d2640 1 --2- 172.21.15.5:0/56976633 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f54a40663a0 0x7f54a4068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:07.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.064+0000 7f54c91d2640 1 --2- 172.21.15.5:0/56976633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54c40b7c70 0x7f54c41541d0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:07.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.064+0000 7f54c91d2640 1 -- 172.21.15.5:0/56976633 >> 172.21.15.5:0/56976633 conn(0x7f54c40650b0 msgr2=0x7f54c40b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:07.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.064+0000 7f54c91d2640 1 -- 172.21.15.5:0/56976633 shutdown_connections 2023-07-14T13:08:07.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.064+0000 7f54c91d2640 1 -- 172.21.15.5:0/56976633 wait complete. 2023-07-14T13:08:07.099 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:07.070+0000 7f0bdcf08180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:08:07.116 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T13:05:59.255634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T13:06:00.136409+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 4, 'snap_epoch': 69, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:08:07.117 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:08:07.121 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:07.084+0000 7f4d3b348180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:08:07.182 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:07.154+0000 7f0bdcf08180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:08:07.210 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:07.176+0000 7f4d3b348180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:08:07.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.232+0000 7f870366d640 1 Processor -- start 2023-07-14T13:08:07.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.232+0000 7f870366d640 1 -- start start 2023-07-14T13:08:07.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.232+0000 7f870366d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86fc0cf2e0 0x7f86fc0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:07.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.232+0000 7f870366d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86fc0d0920 con 0x7f86fc06a540 2023-07-14T13:08:07.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.232+0000 7f870366d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86fc15bfd0 con 0x7f86fc0ca790 2023-07-14T13:08:07.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.232+0000 7f870366d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86fc0cfd10 con 0x7f86fc0cf2e0 2023-07-14T13:08:07.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.232+0000 7f8700c08640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86fc0cf2e0 0x7f86fc0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:07.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.232+0000 7f8701409640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f86fc06a540 0x7f86fc06a910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44774/0 (socket says 172.21.15.5:44774) 2023-07-14T13:08:07.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.232+0000 7f8701409640 1 -- 172.21.15.5:0/3329154483 learned_addr learned my addr 172.21.15.5:0/3329154483 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:07.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.232+0000 7f8700c08640 1 -- 172.21.15.5:0/3329154483 >> v1:172.21.15.154:6789/0 conn(0x7f86fc0ca790 legacy=0x7f86fc0cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:07.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.232+0000 7f8700c08640 1 -- 172.21.15.5:0/3329154483 >> v1:172.21.15.5:6789/0 conn(0x7f86fc06a540 legacy=0x7f86fc06a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:07.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.232+0000 7f8700c08640 1 -- 172.21.15.5:0/3329154483 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86fc0cfff0 con 0x7f86fc0cf2e0 2023-07-14T13:08:07.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.236+0000 7f8700c08640 1 --2- 172.21.15.5:0/3329154483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86fc0cf2e0 0x7f86fc0cf710 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0097f0 tx=0x7f86ec01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=becf5bd9c3f3ebee server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:07.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.236+0000 7f86f3fff640 1 -- 172.21.15.5:0/3329154483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec0ad660 con 0x7f86fc0cf2e0 2023-07-14T13:08:07.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.236+0000 7f86f3fff640 1 -- 172.21.15.5:0/3329154483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ec0ad7c0 con 0x7f86fc0cf2e0 2023-07-14T13:08:07.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.236+0000 7f86f3fff640 1 -- 172.21.15.5:0/3329154483 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec0adb50 con 0x7f86fc0cf2e0 2023-07-14T13:08:07.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.236+0000 7f870366d640 1 -- 172.21.15.5:0/3329154483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86fc0cf2e0 msgr2=0x7f86fc0cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:07.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.236+0000 7f870366d640 1 --2- 172.21.15.5:0/3329154483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86fc0cf2e0 0x7f86fc0cf710 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0097f0 tx=0x7f86ec01c450 comp rx=0 tx=0).stop 2023-07-14T13:08:07.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.236+0000 7f870366d640 1 -- 172.21.15.5:0/3329154483 shutdown_connections 2023-07-14T13:08:07.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.236+0000 7f870366d640 1 --2- 172.21.15.5:0/3329154483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86fc0cf2e0 0x7f86fc0cf710 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:07.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.236+0000 7f870366d640 1 -- 172.21.15.5:0/3329154483 >> 172.21.15.5:0/3329154483 conn(0x7f86fc099490 msgr2=0x7f86fc089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:07.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.236+0000 7f870366d640 1 -- 172.21.15.5:0/3329154483 shutdown_connections 2023-07-14T13:08:07.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.236+0000 7f870366d640 1 -- 172.21.15.5:0/3329154483 wait complete. 2023-07-14T13:08:07.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.240+0000 7f870366d640 1 Processor -- start 2023-07-14T13:08:07.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.240+0000 7f870366d640 1 -- start start 2023-07-14T13:08:07.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.240+0000 7f870366d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86fc06a540 0x7f86fc0c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:07.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.240+0000 7f870366d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86fc0ca790 0x7f86fc151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:07.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.240+0000 7f870366d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86fc0cf2e0 0x7f86fc0cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:07.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.240+0000 7f870366d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc154bc0 con 0x7f86fc0ca790 2023-07-14T13:08:07.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.240+0000 7f870366d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc1548e0 con 0x7f86fc0cf2e0 2023-07-14T13:08:07.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.240+0000 7f870366d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc152a80 con 0x7f86fc06a540 2023-07-14T13:08:07.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.240+0000 7f8700c08640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86fc0ca790 0x7f86fc151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:07.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.240+0000 7f8700c08640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86fc0ca790 0x7f86fc151540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55678/0 (socket says 172.21.15.5:55678) 2023-07-14T13:08:07.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.240+0000 7f8700c08640 1 -- 172.21.15.5:0/3167574923 learned_addr learned my addr 172.21.15.5:0/3167574923 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:07.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.240+0000 7f8701409640 1 --2- 172.21.15.5:0/3167574923 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86fc06a540 0x7f86fc0c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:07.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.240+0000 7f8701c0a640 1 --2- 172.21.15.5:0/3167574923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86fc0cf2e0 0x7f86fc0cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:07.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.240+0000 7f8700c08640 1 -- 172.21.15.5:0/3167574923 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86fc06a540 msgr2=0x7f86fc0c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:07.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.240+0000 7f8700c08640 1 --2- 172.21.15.5:0/3167574923 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86fc06a540 0x7f86fc0c3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:07.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.240+0000 7f8700c08640 1 -- 172.21.15.5:0/3167574923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86fc0cf2e0 msgr2=0x7f86fc0cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:07.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.240+0000 7f8700c08640 1 --2- 172.21.15.5:0/3167574923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86fc0cf2e0 0x7f86fc0cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:07.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.240+0000 7f8700c08640 1 -- 172.21.15.5:0/3167574923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec009420 con 0x7f86fc0ca790 2023-07-14T13:08:07.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.240+0000 7f8700c08640 1 --2- 172.21.15.5:0/3167574923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86fc0ca790 0x7f86fc151540 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0b0040 tx=0x7f86ec0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:07.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.240+0000 7f86f1ffb640 1 -- 172.21.15.5:0/3167574923 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec0b6610 con 0x7f86fc0ca790 2023-07-14T13:08:07.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.240+0000 7f86f1ffb640 1 -- 172.21.15.5:0/3167574923 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ec0b6770 con 0x7f86fc0ca790 2023-07-14T13:08:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.240+0000 7f870366d640 1 -- 172.21.15.5:0/3167574923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86fc152d60 con 0x7f86fc0ca790 2023-07-14T13:08:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.240+0000 7f86f1ffb640 1 -- 172.21.15.5:0/3167574923 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec0b6b20 con 0x7f86fc0ca790 2023-07-14T13:08:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.244+0000 7f870366d640 1 -- 172.21.15.5:0/3167574923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86fc0c4430 con 0x7f86fc0ca790 2023-07-14T13:08:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.244+0000 7f870366d640 1 -- 172.21.15.5:0/3167574923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86fc154d70 con 0x7f86fc0ca790 2023-07-14T13:08:07.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.244+0000 7f86f1ffb640 1 -- 172.21.15.5:0/3167574923 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 27) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f86ec0b4040 con 0x7f86fc0ca790 2023-07-14T13:08:07.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.244+0000 7f86f1ffb640 1 --2- 172.21.15.5:0/3167574923 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f86e00663a0 0x7f86e0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:07.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.244+0000 7f86f1ffb640 1 -- 172.21.15.5:0/3167574923 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6552+0+0 (secure 0 0 0) 0x7f86ec11ee20 con 0x7f86fc0ca790 2023-07-14T13:08:07.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.244+0000 7f8701409640 1 -- 172.21.15.5:0/3167574923 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f86e00663a0 msgr2=0x7f86e0068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/497535468 2023-07-14T13:08:07.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.244+0000 7f8701409640 1 --2- 172.21.15.5:0/3167574923 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f86e00663a0 0x7f86e0068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:08:07.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.252+0000 7f86f1ffb640 1 -- 172.21.15.5:0/3167574923 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f86ec0ec180 con 0x7f86fc0ca790 2023-07-14T13:08:07.372 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:07.340+0000 7f4d3b348180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:08:07.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.408+0000 7f870366d640 1 -- 172.21.15.5:0/3167574923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f86fc154d70 con 0x7f86fc0ca790 2023-07-14T13:08:07.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.408+0000 7f86f1ffb640 1 -- 172.21.15.5:0/3167574923 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7f86fc154d70 con 0x7f86fc0ca790 2023-07-14T13:08:07.442 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:08:07.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.408+0000 7f870366d640 1 -- 172.21.15.5:0/3167574923 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f86e00663a0 msgr2=0x7f86e0068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:08:07.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.408+0000 7f870366d640 1 --2- 172.21.15.5:0/3167574923 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f86e00663a0 0x7f86e0068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:07.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.408+0000 7f870366d640 1 -- 172.21.15.5:0/3167574923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86fc0ca790 msgr2=0x7f86fc151540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:07.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.408+0000 7f870366d640 1 --2- 172.21.15.5:0/3167574923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86fc0ca790 0x7f86fc151540 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0b0040 tx=0x7f86ec0191f0 comp rx=0 tx=0).stop 2023-07-14T13:08:07.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.408+0000 7f870366d640 1 -- 172.21.15.5:0/3167574923 shutdown_connections 2023-07-14T13:08:07.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.408+0000 7f870366d640 1 --2- 172.21.15.5:0/3167574923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86fc0cf2e0 0x7f86fc0cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:07.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.408+0000 7f870366d640 1 --2- 172.21.15.5:0/3167574923 >> [v2:172.21.15.154:6832/497535468,v1:172.21.15.154:6833/497535468] conn(0x7f86e00663a0 0x7f86e0068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:07.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.408+0000 7f870366d640 1 --2- 172.21.15.5:0/3167574923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86fc0ca790 0x7f86fc151540 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:07.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.408+0000 7f870366d640 1 --2- 172.21.15.5:0/3167574923 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86fc06a540 0x7f86fc0c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:07.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.408+0000 7f870366d640 1 -- 172.21.15.5:0/3167574923 >> 172.21.15.5:0/3167574923 conn(0x7f86fc099490 msgr2=0x7f86fc0ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:07.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.408+0000 7f870366d640 1 -- 172.21.15.5:0/3167574923 shutdown_connections 2023-07-14T13:08:07.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.408+0000 7f870366d640 1 -- 172.21.15.5:0/3167574923 wait complete. 2023-07-14T13:08:07.449 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:07.422+0000 7f0bdcf08180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:08:07.461 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:07.428+0000 7f4d3b348180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:08:07.463 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:08:07.508 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:07.482+0000 7f0bdcf08180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:08:07.596 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:07.570+0000 7f0b6617c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:07.597 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:07.570+0000 7f0b6617c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:07.597 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:07.570+0000 7f0b6617c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:07.597 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:07.570+0000 7f0b6617c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:07.597 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:07.570+0000 7f0b6617c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:07.598 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:07.570+0000 7f0b69182640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:07.598 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:07.570+0000 7f0b69182640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:07.599 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:07.570+0000 7f0b69182640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:07.599 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:07.570+0000 7f0b69182640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:07.599 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:07.570+0000 7f0b69182640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:07.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.596+0000 7fbe05e31640 1 Processor -- start 2023-07-14T13:08:07.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.596+0000 7fbe05e31640 1 -- start start 2023-07-14T13:08:07.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.596+0000 7fbe05e31640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe000b1620 0x7fbe000ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:07.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.596+0000 7fbe05e31640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbe00160750 0x7fbe0015c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:07.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.596+0000 7fbe05e31640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe000cf430 con 0x7fbe000cc960 2023-07-14T13:08:07.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.596+0000 7fbe05e31640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe000cf710 con 0x7fbe00160750 2023-07-14T13:08:07.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.596+0000 7fbe05e31640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0015fc70 con 0x7fbe000b1620 2023-07-14T13:08:07.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.596+0000 7fbe05630640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbe00160750 0x7fbe0015c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:07.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.596+0000 7fbdfffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe000b1620 0x7fbe000ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:07.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.596+0000 7fbe05630640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbe00160750 0x7fbe0015c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:58700/0 (socket says 172.21.15.5:58700) 2023-07-14T13:08:07.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.596+0000 7fbe05630640 1 -- 172.21.15.5:0/4031058254 learned_addr learned my addr 172.21.15.5:0/4031058254 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:07.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.596+0000 7fbdfffff640 1 -- 172.21.15.5:0/4031058254 >> v2:172.21.15.154:3300/0 conn(0x7fbe00160750 msgr2=0x7fbe0015c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:07.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.596+0000 7fbdfffff640 1 --2- 172.21.15.5:0/4031058254 >> v2:172.21.15.154:3300/0 conn(0x7fbe00160750 0x7fbe0015c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:07.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.596+0000 7fbdfffff640 1 -- 172.21.15.5:0/4031058254 >> v1:172.21.15.154:6789/0 conn(0x7fbe000cc960 legacy=0x7fbe000ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:07.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.596+0000 7fbdff7fe640 1 -- 172.21.15.5:0/4031058254 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3444056429 0 0) 0x7fbe000cf430 con 0x7fbe000cc960 2023-07-14T13:08:07.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.596+0000 7fbdfffff640 1 -- 172.21.15.5:0/4031058254 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0015ff50 con 0x7fbe000b1620 2023-07-14T13:08:07.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.596+0000 7fbe05630640 1 --2- 172.21.15.5:0/4031058254 >> v2:172.21.15.154:3300/0 conn(0x7fbe00160750 0x7fbe0015c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:07.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.600+0000 7fbdfffff640 1 --2- 172.21.15.5:0/4031058254 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe000b1620 0x7fbe000ce950 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbdec0097c0 tx=0x7fbdec01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdfa0ca5fec3fdc1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:07.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.600+0000 7fbdff7fe640 1 -- 172.21.15.5:0/4031058254 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec0ab670 con 0x7fbe000b1620 2023-07-14T13:08:07.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.600+0000 7fbdff7fe640 1 -- 172.21.15.5:0/4031058254 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdec0ab7d0 con 0x7fbe000b1620 2023-07-14T13:08:07.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.600+0000 7fbdff7fe640 1 -- 172.21.15.5:0/4031058254 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec0abb60 con 0x7fbe000b1620 2023-07-14T13:08:07.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.600+0000 7fbe05e31640 1 -- 172.21.15.5:0/4031058254 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe000b1620 msgr2=0x7fbe000ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:07.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.600+0000 7fbe05e31640 1 --2- 172.21.15.5:0/4031058254 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe000b1620 0x7fbe000ce950 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbdec0097c0 tx=0x7fbdec01c450 comp rx=0 tx=0).stop 2023-07-14T13:08:07.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.600+0000 7fbe05e31640 1 -- 172.21.15.5:0/4031058254 shutdown_connections 2023-07-14T13:08:07.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.600+0000 7fbe05e31640 1 --2- 172.21.15.5:0/4031058254 >> v2:172.21.15.154:3300/0 conn(0x7fbe00160750 0x7fbe0015c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:07.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.600+0000 7fbe05e31640 1 --2- 172.21.15.5:0/4031058254 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe000b1620 0x7fbe000ce950 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:07.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.600+0000 7fbe05e31640 1 -- 172.21.15.5:0/4031058254 >> 172.21.15.5:0/4031058254 conn(0x7fbe00069f50 msgr2=0x7fbe0006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:07.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.600+0000 7fbe05e31640 1 -- 172.21.15.5:0/4031058254 shutdown_connections 2023-07-14T13:08:07.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.600+0000 7fbe05e31640 1 -- 172.21.15.5:0/4031058254 wait complete. 2023-07-14T13:08:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.604+0000 7fbe05e31640 1 Processor -- start 2023-07-14T13:08:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.604+0000 7fbe05e31640 1 -- start start 2023-07-14T13:08:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.604+0000 7fbe05e31640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe000b1620 0x7fbe00155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:07.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.604+0000 7fbe05e31640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe000cc960 0x7fbe00154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:07.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.604+0000 7fbe05e31640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe00160750 0x7fbe001519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:07.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.604+0000 7fbe05e31640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe00153810 con 0x7fbe000cc960 2023-07-14T13:08:07.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.604+0000 7fbe05e31640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe00155390 con 0x7fbe00160750 2023-07-14T13:08:07.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.604+0000 7fbe05e31640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe00158800 con 0x7fbe000b1620 2023-07-14T13:08:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.604+0000 7fbe05630640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe00160750 0x7fbe001519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.604+0000 7fbe04e2f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe000b1620 0x7fbe00155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.604+0000 7fbdfffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe000cc960 0x7fbe00154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.604+0000 7fbe05630640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe00160750 0x7fbe001519f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:58714/0 (socket says 172.21.15.5:58714) 2023-07-14T13:08:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.604+0000 7fbe05630640 1 -- 172.21.15.5:0/3149366924 learned_addr learned my addr 172.21.15.5:0/3149366924 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.604+0000 7fbe04e2f640 1 -- 172.21.15.5:0/3149366924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe00160750 msgr2=0x7fbe001519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.604+0000 7fbe04e2f640 1 --2- 172.21.15.5:0/3149366924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe00160750 0x7fbe001519f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.604+0000 7fbe04e2f640 1 -- 172.21.15.5:0/3149366924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe000cc960 msgr2=0x7fbe00154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:07.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.604+0000 7fbe04e2f640 1 --2- 172.21.15.5:0/3149366924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe000cc960 0x7fbe00154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:07.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.604+0000 7fbe04e2f640 1 -- 172.21.15.5:0/3149366924 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf8009b30 con 0x7fbe000b1620 2023-07-14T13:08:07.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.604+0000 7fbe04e2f640 1 --2- 172.21.15.5:0/3149366924 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe000b1620 0x7fbe00155e90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400c430 tx=0x7fbdf400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:07.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.604+0000 7fbdfd7fa640 1 -- 172.21.15.5:0/3149366924 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf40054e0 con 0x7fbe000b1620 2023-07-14T13:08:07.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.604+0000 7fbdfd7fa640 1 -- 172.21.15.5:0/3149366924 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf4003600 con 0x7fbe000b1620 2023-07-14T13:08:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.604+0000 7fbdfd7fa640 1 -- 172.21.15.5:0/3149366924 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf40039f0 con 0x7fbe000b1620 2023-07-14T13:08:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.604+0000 7fbe05e31640 1 -- 172.21.15.5:0/3149366924 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdec009420 con 0x7fbe000b1620 2023-07-14T13:08:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.604+0000 7fbe05e31640 1 -- 172.21.15.5:0/3149366924 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe00158aa0 con 0x7fbe000b1620 2023-07-14T13:08:07.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.608+0000 7fbe05e31640 1 -- 172.21.15.5:0/3149366924 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe000b19f0 con 0x7fbe000b1620 2023-07-14T13:08:07.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.608+0000 7fbdfd7fa640 1 -- 172.21.15.5:0/3149366924 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 28) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fbdf4003b50 con 0x7fbe000b1620 2023-07-14T13:08:07.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.608+0000 7fbdfd7fa640 1 -- 172.21.15.5:0/3149366924 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6880+0+0 (secure 0 0 0) 0x7fbdf40830b0 con 0x7fbe000b1620 2023-07-14T13:08:07.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.612+0000 7fbdfd7fa640 1 -- 172.21.15.5:0/3149366924 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fbe000b19f0 con 0x7fbe000b1620 2023-07-14T13:08:07.773 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:07.740+0000 7f4d3b348180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:08:07.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.772+0000 7fbe05e31640 1 -- 172.21.15.5:0/3149366924 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbe000b19f0 con 0x7fbe000b1620 2023-07-14T13:08:07.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.772+0000 7fbdfd7fa640 1 -- 172.21.15.5:0/3149366924 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v70) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbe000b19f0 con 0x7fbe000b1620 2023-07-14T13:08:07.806 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:08:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.772+0000 7fbe05e31640 1 -- 172.21.15.5:0/3149366924 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe000b1620 msgr2=0x7fbe00155e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.772+0000 7fbe05e31640 1 --2- 172.21.15.5:0/3149366924 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe000b1620 0x7fbe00155e90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400c430 tx=0x7fbdf400c8f0 comp rx=0 tx=0).stop 2023-07-14T13:08:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.776+0000 7fbe05e31640 1 -- 172.21.15.5:0/3149366924 shutdown_connections 2023-07-14T13:08:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.776+0000 7fbe05e31640 1 --2- 172.21.15.5:0/3149366924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe00160750 0x7fbe001519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.776+0000 7fbe05e31640 1 --2- 172.21.15.5:0/3149366924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe000cc960 0x7fbe00154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:07.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.776+0000 7fbe05e31640 1 --2- 172.21.15.5:0/3149366924 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe000b1620 0x7fbe00155e90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:07.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.776+0000 7fbe05e31640 1 -- 172.21.15.5:0/3149366924 >> 172.21.15.5:0/3149366924 conn(0x7fbe00069f50 msgr2=0x7fbe000d0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:07.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.776+0000 7fbe05e31640 1 -- 172.21.15.5:0/3149366924 shutdown_connections 2023-07-14T13:08:07.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.776+0000 7fbe05e31640 1 -- 172.21.15.5:0/3149366924 wait complete. 2023-07-14T13:08:07.829 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T13:08:07.838 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:07.804+0000 7f4d3b348180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:08:07.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.944+0000 7f48cc034640 1 Processor -- start 2023-07-14T13:08:07.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.944+0000 7f48cc034640 1 -- start start 2023-07-14T13:08:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.948+0000 7f48cc034640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f48c40af2b0 0x7f48c40c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.948+0000 7f48cc034640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c40695b0 con 0x7f48c40cd120 2023-07-14T13:08:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.948+0000 7f48cc034640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c4069890 con 0x7f48c40c3ac0 2023-07-14T13:08:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.948+0000 7f48cc034640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c4069b70 con 0x7f48c40af2b0 2023-07-14T13:08:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.948+0000 7f48ca5d1640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f48c40cd120 0x7f48c40cd570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44780/0 (socket says 172.21.15.5:44780) 2023-07-14T13:08:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.948+0000 7f48ca5d1640 1 -- 172.21.15.5:0/926476888 learned_addr learned my addr 172.21.15.5:0/926476888 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:07.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.948+0000 7f48c95cf640 1 --2- 172.21.15.5:0/926476888 >> v2:172.21.15.154:3300/0 conn(0x7f48c40af2b0 0x7f48c40c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:07.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.948+0000 7f48c8dce640 1 -- 172.21.15.5:0/926476888 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206458235 0 0) 0x7f48c40695b0 con 0x7f48c40cd120 2023-07-14T13:08:07.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.948+0000 7f48c8dce640 1 -- 172.21.15.5:0/926476888 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48b0003530 con 0x7f48c40cd120 2023-07-14T13:08:07.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.948+0000 7f48c8dce640 1 -- 172.21.15.5:0/926476888 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497013110 0 0) 0x7f48c4069890 con 0x7f48c40c3ac0 2023-07-14T13:08:07.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.948+0000 7f48c8dce640 1 -- 172.21.15.5:0/926476888 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48c40695b0 con 0x7f48c40c3ac0 2023-07-14T13:08:07.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.948+0000 7f48c95cf640 1 -- 172.21.15.5:0/926476888 >> v1:172.21.15.154:6789/0 conn(0x7f48c40c3ac0 legacy=0x7f48c40ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:07.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.948+0000 7f48c95cf640 1 -- 172.21.15.5:0/926476888 >> v1:172.21.15.5:6789/0 conn(0x7f48c40cd120 legacy=0x7f48c40cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:07.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.948+0000 7f48c95cf640 1 -- 172.21.15.5:0/926476888 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c4069e50 con 0x7f48c40af2b0 2023-07-14T13:08:07.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.952+0000 7f48c95cf640 1 --2- 172.21.15.5:0/926476888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48c40af2b0 0x7f48c40c2d30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f48b40097c0 tx=0x7f48b401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7d4f05a5a8f378a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:07.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.952+0000 7f48c8dce640 1 -- 172.21.15.5:0/926476888 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b40a6040 con 0x7f48c40af2b0 2023-07-14T13:08:07.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.952+0000 7f48c8dce640 1 -- 172.21.15.5:0/926476888 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b40aa600 con 0x7f48c40af2b0 2023-07-14T13:08:07.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.952+0000 7f48c8dce640 1 -- 172.21.15.5:0/926476888 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b40aa970 con 0x7f48c40af2b0 2023-07-14T13:08:07.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.952+0000 7f48cc034640 1 -- 172.21.15.5:0/926476888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48c40af2b0 msgr2=0x7f48c40c2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:07.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.952+0000 7f48cc034640 1 --2- 172.21.15.5:0/926476888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48c40af2b0 0x7f48c40c2d30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f48b40097c0 tx=0x7f48b401c480 comp rx=0 tx=0).stop 2023-07-14T13:08:07.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.952+0000 7f48cc034640 1 -- 172.21.15.5:0/926476888 shutdown_connections 2023-07-14T13:08:07.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.952+0000 7f48cc034640 1 --2- 172.21.15.5:0/926476888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48c40af2b0 0x7f48c40c2d30 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:07.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.952+0000 7f48cc034640 1 -- 172.21.15.5:0/926476888 >> 172.21.15.5:0/926476888 conn(0x7f48c40cde90 msgr2=0x7f48c40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:07.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.952+0000 7f48cc034640 1 -- 172.21.15.5:0/926476888 shutdown_connections 2023-07-14T13:08:07.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.952+0000 7f48cc034640 1 -- 172.21.15.5:0/926476888 wait complete. 2023-07-14T13:08:07.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.952+0000 7f48cc034640 1 Processor -- start 2023-07-14T13:08:07.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.956+0000 7f48cc034640 1 -- start start 2023-07-14T13:08:07.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.956+0000 7f48cc034640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48c40af2b0 0x7f48c41627e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:07.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.956+0000 7f48cc034640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48c40c3ac0 0x7f48c4144ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:07.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.956+0000 7f48cc034640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48c40cd120 0x7f48c41451e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:07.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.956+0000 7f48cc034640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c40c5c40 con 0x7f48c40c3ac0 2023-07-14T13:08:07.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.956+0000 7f48cc034640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c40c9420 con 0x7f48c40cd120 2023-07-14T13:08:07.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.956+0000 7f48cc034640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c40c88a0 con 0x7f48c40af2b0 2023-07-14T13:08:07.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.956+0000 7f48c95cf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48c40c3ac0 0x7f48c4144ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:07.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.956+0000 7f48c95cf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48c40c3ac0 0x7f48c4144ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55696/0 (socket says 172.21.15.5:55696) 2023-07-14T13:08:07.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.956+0000 7f48c95cf640 1 -- 172.21.15.5:0/1757310223 learned_addr learned my addr 172.21.15.5:0/1757310223 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:07.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.956+0000 7f48ca5d1640 1 --2- 172.21.15.5:0/1757310223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48c40cd120 0x7f48c41451e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:07.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.956+0000 7f48c9dd0640 1 --2- 172.21.15.5:0/1757310223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48c40af2b0 0x7f48c41627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:07.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.956+0000 7f48c95cf640 1 -- 172.21.15.5:0/1757310223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48c40af2b0 msgr2=0x7f48c41627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:07.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.956+0000 7f48c95cf640 1 --2- 172.21.15.5:0/1757310223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48c40af2b0 0x7f48c41627e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:07.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.956+0000 7f48c95cf640 1 -- 172.21.15.5:0/1757310223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48c40cd120 msgr2=0x7f48c41451e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:07.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.956+0000 7f48c95cf640 1 --2- 172.21.15.5:0/1757310223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48c40cd120 0x7f48c41451e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:07.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.956+0000 7f48c95cf640 1 -- 172.21.15.5:0/1757310223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b4009420 con 0x7f48c40c3ac0 2023-07-14T13:08:07.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.956+0000 7f48c95cf640 1 --2- 172.21.15.5:0/1757310223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48c40c3ac0 0x7f48c4144ca0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f48b4000c10 tx=0x7f48b4019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:07.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.956+0000 7f48ba7fc640 1 -- 172.21.15.5:0/1757310223 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b40a6020 con 0x7f48c40c3ac0 2023-07-14T13:08:07.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.956+0000 7f48ba7fc640 1 -- 172.21.15.5:0/1757310223 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b4006e20 con 0x7f48c40c3ac0 2023-07-14T13:08:07.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.956+0000 7f48ba7fc640 1 -- 172.21.15.5:0/1757310223 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b4003a30 con 0x7f48c40c3ac0 2023-07-14T13:08:07.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.956+0000 7f48cc034640 1 -- 172.21.15.5:0/1757310223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c40c8b80 con 0x7f48c40c3ac0 2023-07-14T13:08:07.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.956+0000 7f48cc034640 1 -- 172.21.15.5:0/1757310223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c40c9140 con 0x7f48c40c3ac0 2023-07-14T13:08:07.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.956+0000 7f48cc034640 1 -- 172.21.15.5:0/1757310223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c40678d0 con 0x7f48c40c3ac0 2023-07-14T13:08:07.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.960+0000 7f48ba7fc640 1 -- 172.21.15.5:0/1757310223 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 28) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f48b4003b90 con 0x7f48c40c3ac0 2023-07-14T13:08:07.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.960+0000 7f48ba7fc640 1 -- 172.21.15.5:0/1757310223 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6880+0+0 (secure 0 0 0) 0x7f48b411d460 con 0x7f48c40c3ac0 2023-07-14T13:08:07.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:07.964+0000 7f48ba7fc640 1 -- 172.21.15.5:0/1757310223 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f48b40ea950 con 0x7f48c40c3ac0 2023-07-14T13:08:08.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.116+0000 7f48cc034640 1 -- 172.21.15.5:0/1757310223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f48c40aeb80 con 0x7f48c40c3ac0 2023-07-14T13:08:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.116+0000 7f48ba7fc640 1 -- 172.21.15.5:0/1757310223 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v70) v1 ==== 104+0+11 (secure 0 0 0) 0x7f48b40edf70 con 0x7f48c40c3ac0 2023-07-14T13:08:08.151 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T13:08:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.120+0000 7f48cc034640 1 -- 172.21.15.5:0/1757310223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48c40c3ac0 msgr2=0x7f48c4144ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.120+0000 7f48cc034640 1 --2- 172.21.15.5:0/1757310223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48c40c3ac0 0x7f48c4144ca0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f48b4000c10 tx=0x7f48b4019220 comp rx=0 tx=0).stop 2023-07-14T13:08:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.120+0000 7f48cc034640 1 -- 172.21.15.5:0/1757310223 shutdown_connections 2023-07-14T13:08:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.120+0000 7f48cc034640 1 --2- 172.21.15.5:0/1757310223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48c40cd120 0x7f48c41451e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.120+0000 7f48cc034640 1 --2- 172.21.15.5:0/1757310223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48c40c3ac0 0x7f48c4144ca0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.120+0000 7f48cc034640 1 --2- 172.21.15.5:0/1757310223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48c40af2b0 0x7f48c41627e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:08.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.120+0000 7f48cc034640 1 -- 172.21.15.5:0/1757310223 >> 172.21.15.5:0/1757310223 conn(0x7f48c40cde90 msgr2=0x7f48c40ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:08.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.120+0000 7f48cc034640 1 -- 172.21.15.5:0/1757310223 shutdown_connections 2023-07-14T13:08:08.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.120+0000 7f48cc034640 1 -- 172.21.15.5:0/1757310223 wait complete. 2023-07-14T13:08:08.171 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T13:08:08.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.332+0000 7f2773ed8640 1 Processor -- start 2023-07-14T13:08:08.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.332+0000 7f2773ed8640 1 -- start start 2023-07-14T13:08:08.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.332+0000 7f2773ed8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f276c0d2fc0 0x7f276c0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:08.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.332+0000 7f2773ed8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f276c0d2300 0x7f276c0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:08.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.332+0000 7f2773ed8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f276c0b04c0 con 0x7f276c15bde0 2023-07-14T13:08:08.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.332+0000 7f2773ed8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f276c0d2ce0 con 0x7f276c0d2300 2023-07-14T13:08:08.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.332+0000 7f2773ed8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f276c15c1b0 con 0x7f276c0d2fc0 2023-07-14T13:08:08.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.332+0000 7f2772475640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f276c0d2300 0x7f276c0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:08.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.332+0000 7f2771473640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f276c0d2fc0 0x7f276c0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:08.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.332+0000 7f2771c74640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f276c15bde0 0x7f276c0d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:51672/0 (socket says 172.21.15.5:51672) 2023-07-14T13:08:08.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.332+0000 7f2771c74640 1 -- 172.21.15.5:0/2986254645 learned_addr learned my addr 172.21.15.5:0/2986254645 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:08.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.332+0000 7f2772475640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f276c0d2300 0x7f276c0d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:58740/0 (socket says 172.21.15.5:58740) 2023-07-14T13:08:08.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.332+0000 7f2772475640 1 -- 172.21.15.5:0/2986254645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f276c0d2fc0 msgr2=0x7f276c0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:08.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.332+0000 7f2772475640 1 --2- 172.21.15.5:0/2986254645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f276c0d2fc0 0x7f276c0b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:08.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.332+0000 7f2772475640 1 -- 172.21.15.5:0/2986254645 >> v1:172.21.15.154:6789/0 conn(0x7f276c15bde0 legacy=0x7f276c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:08.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.332+0000 7f2772475640 1 -- 172.21.15.5:0/2986254645 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276c0d0aa0 con 0x7f276c0d2300 2023-07-14T13:08:08.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.332+0000 7f2770c72640 1 -- 172.21.15.5:0/2986254645 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617719728 0 0) 0x7f276c0b04c0 con 0x7f276c15bde0 2023-07-14T13:08:08.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.336+0000 7f2772475640 1 --2- 172.21.15.5:0/2986254645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f276c0d2300 0x7f276c0d27a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2764009d90 tx=0x7f276401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7f3fb86263fa453 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:08.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.336+0000 7f2770c72640 1 -- 172.21.15.5:0/2986254645 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27640a5a10 con 0x7f276c0d2300 2023-07-14T13:08:08.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.336+0000 7f2770c72640 1 -- 172.21.15.5:0/2986254645 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27640a5b70 con 0x7f276c0d2300 2023-07-14T13:08:08.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.336+0000 7f2770c72640 1 -- 172.21.15.5:0/2986254645 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27640ad440 con 0x7f276c0d2300 2023-07-14T13:08:08.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.336+0000 7f2773ed8640 1 -- 172.21.15.5:0/2986254645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f276c0d2300 msgr2=0x7f276c0d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:08.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.336+0000 7f2773ed8640 1 --2- 172.21.15.5:0/2986254645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f276c0d2300 0x7f276c0d27a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2764009d90 tx=0x7f276401c950 comp rx=0 tx=0).stop 2023-07-14T13:08:08.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.336+0000 7f2773ed8640 1 -- 172.21.15.5:0/2986254645 shutdown_connections 2023-07-14T13:08:08.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.336+0000 7f2773ed8640 1 --2- 172.21.15.5:0/2986254645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f276c0d2300 0x7f276c0d27a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:08.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.336+0000 7f2773ed8640 1 --2- 172.21.15.5:0/2986254645 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f276c0d2fc0 0x7f276c0b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:08.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.336+0000 7f2773ed8640 1 -- 172.21.15.5:0/2986254645 >> 172.21.15.5:0/2986254645 conn(0x7f276c0659d0 msgr2=0x7f276c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:08.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.336+0000 7f2773ed8640 1 -- 172.21.15.5:0/2986254645 shutdown_connections 2023-07-14T13:08:08.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.336+0000 7f2773ed8640 1 -- 172.21.15.5:0/2986254645 wait complete. 2023-07-14T13:08:08.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.340+0000 7f2773ed8640 1 Processor -- start 2023-07-14T13:08:08.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.340+0000 7f2773ed8640 1 -- start start 2023-07-14T13:08:08.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.340+0000 7f2773ed8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f276c0d2300 0x7f276c14e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:08.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.340+0000 7f2773ed8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f276c0d2fc0 0x7f276c0c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:08.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.340+0000 7f2773ed8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f276c15bde0 0x7f276c0c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:08.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.340+0000 7f2773ed8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276c154020 con 0x7f276c15bde0 2023-07-14T13:08:08.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.340+0000 7f2773ed8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276c153d40 con 0x7f276c0d2300 2023-07-14T13:08:08.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.340+0000 7f2773ed8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f276c0b59b0 con 0x7f276c0d2fc0 2023-07-14T13:08:08.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.340+0000 7f2772475640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f276c15bde0 0x7f276c0c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:08.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.340+0000 7f2772475640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f276c15bde0 0x7f276c0c63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55700/0 (socket says 172.21.15.5:55700) 2023-07-14T13:08:08.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.340+0000 7f2772475640 1 -- 172.21.15.5:0/1461209998 learned_addr learned my addr 172.21.15.5:0/1461209998 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:08.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.340+0000 7f2771c74640 1 --2- 172.21.15.5:0/1461209998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f276c0d2300 0x7f276c14e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:08.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.340+0000 7f2771473640 1 --2- 172.21.15.5:0/1461209998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f276c0d2fc0 0x7f276c0c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:08.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.340+0000 7f2772475640 1 -- 172.21.15.5:0/1461209998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f276c0d2fc0 msgr2=0x7f276c0c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:08.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.340+0000 7f2772475640 1 --2- 172.21.15.5:0/1461209998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f276c0d2fc0 0x7f276c0c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:08.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.340+0000 7f2772475640 1 -- 172.21.15.5:0/1461209998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f276c0d2300 msgr2=0x7f276c14e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:08.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.340+0000 7f2772475640 1 --2- 172.21.15.5:0/1461209998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f276c0d2300 0x7f276c14e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:08.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.340+0000 7f2772475640 1 -- 172.21.15.5:0/1461209998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2764009a70 con 0x7f276c15bde0 2023-07-14T13:08:08.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.340+0000 7f2772475640 1 --2- 172.21.15.5:0/1461209998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f276c15bde0 0x7f276c0c63e0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f276401b000 tx=0x7f27640196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:08.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.340+0000 7f27627fc640 1 -- 172.21.15.5:0/1461209998 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27640bf070 con 0x7f276c15bde0 2023-07-14T13:08:08.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.340+0000 7f27627fc640 1 -- 172.21.15.5:0/1461209998 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27640aeae0 con 0x7f276c15bde0 2023-07-14T13:08:08.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.340+0000 7f27627fc640 1 -- 172.21.15.5:0/1461209998 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27640aee70 con 0x7f276c15bde0 2023-07-14T13:08:08.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.340+0000 7f2773ed8640 1 -- 172.21.15.5:0/1461209998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f276c0b5c90 con 0x7f276c15bde0 2023-07-14T13:08:08.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.340+0000 7f2773ed8640 1 -- 172.21.15.5:0/1461209998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276c14ed90 con 0x7f276c15bde0 2023-07-14T13:08:08.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.344+0000 7f2773ed8640 1 -- 172.21.15.5:0/1461209998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f276c0b5810 con 0x7f276c15bde0 2023-07-14T13:08:08.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.344+0000 7f27627fc640 1 -- 172.21.15.5:0/1461209998 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 28) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f27640b4050 con 0x7f276c15bde0 2023-07-14T13:08:08.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.344+0000 7f27627fc640 1 -- 172.21.15.5:0/1461209998 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6880+0+0 (secure 0 0 0) 0x7f276411e2b0 con 0x7f276c15bde0 2023-07-14T13:08:08.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.348+0000 7f27627fc640 1 -- 172.21.15.5:0/1461209998 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f276c0b5810 con 0x7f276c15bde0 2023-07-14T13:08:08.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.492+0000 7f27627fc640 1 -- 172.21.15.5:0/1461209998 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 29) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f27640eb2e0 con 0x7f276c15bde0 2023-07-14T13:08:08.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.492+0000 7f27627fc640 1 --2- 172.21.15.5:0/1461209998 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f275006c210 0x7f275006e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:08.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.496+0000 7f2771c74640 1 --2- 172.21.15.5:0/1461209998 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f275006c210 0x7f275006e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:08.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.500+0000 7f2771c74640 1 --2- 172.21.15.5:0/1461209998 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f275006c210 0x7f275006e5f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2768000fc0 tx=0x7f2768007cf0 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:08.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.504+0000 7f2773ed8640 1 -- 172.21.15.5:0/1461209998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f276c0b5810 con 0x7f276c15bde0 2023-07-14T13:08:08.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.504+0000 7f27627fc640 1 -- 172.21.15.5:0/1461209998 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v70) v1 ==== 100+0+11 (secure 0 0 0) 0x7f276c0b5810 con 0x7f276c15bde0 2023-07-14T13:08:08.540 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T13:08:08.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.508+0000 7f2773ed8640 1 -- 172.21.15.5:0/1461209998 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f275006c210 msgr2=0x7f275006e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:08.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.508+0000 7f2773ed8640 1 --2- 172.21.15.5:0/1461209998 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f275006c210 0x7f275006e5f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2768000fc0 tx=0x7f2768007cf0 comp rx=0 tx=0).stop 2023-07-14T13:08:08.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.508+0000 7f2773ed8640 1 -- 172.21.15.5:0/1461209998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f276c15bde0 msgr2=0x7f276c0c63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:08.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.508+0000 7f2773ed8640 1 --2- 172.21.15.5:0/1461209998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f276c15bde0 0x7f276c0c63e0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f276401b000 tx=0x7f27640196f0 comp rx=0 tx=0).stop 2023-07-14T13:08:08.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.508+0000 7f2773ed8640 1 -- 172.21.15.5:0/1461209998 shutdown_connections 2023-07-14T13:08:08.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.508+0000 7f2773ed8640 1 --2- 172.21.15.5:0/1461209998 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f275006c210 0x7f275006e5f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:08.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.508+0000 7f2773ed8640 1 --2- 172.21.15.5:0/1461209998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f276c15bde0 0x7f276c0c63e0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:08.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.508+0000 7f2773ed8640 1 --2- 172.21.15.5:0/1461209998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f276c0d2fc0 0x7f276c0c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:08.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.508+0000 7f2773ed8640 1 --2- 172.21.15.5:0/1461209998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f276c0d2300 0x7f276c14e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:08.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.508+0000 7f2773ed8640 1 -- 172.21.15.5:0/1461209998 >> 172.21.15.5:0/1461209998 conn(0x7f276c0659d0 msgr2=0x7f276c0ced20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:08.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.508+0000 7f2773ed8640 1 -- 172.21.15.5:0/1461209998 shutdown_connections 2023-07-14T13:08:08.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.508+0000 7f2773ed8640 1 -- 172.21.15.5:0/1461209998 wait complete. 2023-07-14T13:08:08.560 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:08:08.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.668+0000 7f1277434640 1 Processor -- start 2023-07-14T13:08:08.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.672+0000 7f1277434640 1 -- start start 2023-07-14T13:08:08.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.672+0000 7f1277434640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12700ae1f0 0x7f12700b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:08.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.672+0000 7f1277434640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f127006c430 0x7f1270069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:08.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.672+0000 7f1277434640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12700b24f0 con 0x7f127006e160 2023-07-14T13:08:08.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.672+0000 7f1277434640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12700b27d0 con 0x7f127006c430 2023-07-14T13:08:08.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.672+0000 7f1277434640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12700b2ab0 con 0x7f12700ae1f0 2023-07-14T13:08:08.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.672+0000 7f12749cf640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f127006e160 0x7f127006bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44796/0 (socket says 172.21.15.5:44796) 2023-07-14T13:08:08.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.672+0000 7f12749cf640 1 -- 172.21.15.5:0/4251949349 learned_addr learned my addr 172.21.15.5:0/4251949349 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:08.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.672+0000 7f12751d0640 1 --2- 172.21.15.5:0/4251949349 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12700ae1f0 0x7f12700b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:08.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.672+0000 7f12759d1640 1 --2- 172.21.15.5:0/4251949349 >> v2:172.21.15.154:3300/0 conn(0x7f127006c430 0x7f1270069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:08.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.672+0000 7f1267fff640 1 -- 172.21.15.5:0/4251949349 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 669681240 0 0) 0x7f12700b24f0 con 0x7f127006e160 2023-07-14T13:08:08.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.672+0000 7f1267fff640 1 -- 172.21.15.5:0/4251949349 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f125c003530 con 0x7f127006e160 2023-07-14T13:08:08.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.672+0000 7f12751d0640 1 -- 172.21.15.5:0/4251949349 >> v2:172.21.15.154:3300/0 conn(0x7f127006c430 msgr2=0x7f1270069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:08.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.672+0000 7f12751d0640 1 --2- 172.21.15.5:0/4251949349 >> v2:172.21.15.154:3300/0 conn(0x7f127006c430 0x7f1270069430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:08.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.672+0000 7f12751d0640 1 -- 172.21.15.5:0/4251949349 >> v1:172.21.15.5:6789/0 conn(0x7f127006e160 legacy=0x7f127006bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:08.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.672+0000 7f12751d0640 1 -- 172.21.15.5:0/4251949349 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12700b2d90 con 0x7f12700ae1f0 2023-07-14T13:08:08.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.672+0000 7f12759d1640 1 --2- 172.21.15.5:0/4251949349 >> v2:172.21.15.154:3300/0 conn(0x7f127006c430 0x7f1270069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:08.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.676+0000 7f12751d0640 1 --2- 172.21.15.5:0/4251949349 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12700ae1f0 0x7f12700b1e60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f126c0097c0 tx=0x7f126c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3eb5fc6f40f4a44 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:08.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.676+0000 7f1267fff640 1 -- 172.21.15.5:0/4251949349 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c0ab600 con 0x7f12700ae1f0 2023-07-14T13:08:08.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.676+0000 7f1267fff640 1 -- 172.21.15.5:0/4251949349 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126c0a7050 con 0x7f12700ae1f0 2023-07-14T13:08:08.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.676+0000 7f1267fff640 1 -- 172.21.15.5:0/4251949349 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c0ab980 con 0x7f12700ae1f0 2023-07-14T13:08:08.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.676+0000 7f1277434640 1 -- 172.21.15.5:0/4251949349 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12700ae1f0 msgr2=0x7f12700b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:08.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.676+0000 7f1277434640 1 --2- 172.21.15.5:0/4251949349 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12700ae1f0 0x7f12700b1e60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f126c0097c0 tx=0x7f126c01c450 comp rx=0 tx=0).stop 2023-07-14T13:08:08.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.676+0000 7f1277434640 1 -- 172.21.15.5:0/4251949349 shutdown_connections 2023-07-14T13:08:08.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.676+0000 7f1277434640 1 --2- 172.21.15.5:0/4251949349 >> v2:172.21.15.154:3300/0 conn(0x7f127006c430 0x7f1270069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:08.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.676+0000 7f1277434640 1 --2- 172.21.15.5:0/4251949349 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12700ae1f0 0x7f12700b1e60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:08.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.676+0000 7f1277434640 1 -- 172.21.15.5:0/4251949349 >> 172.21.15.5:0/4251949349 conn(0x7f12700b1300 msgr2=0x7f12700ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:08.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.676+0000 7f1277434640 1 -- 172.21.15.5:0/4251949349 shutdown_connections 2023-07-14T13:08:08.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.676+0000 7f1277434640 1 -- 172.21.15.5:0/4251949349 wait complete. 2023-07-14T13:08:08.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.676+0000 7f1277434640 1 Processor -- start 2023-07-14T13:08:08.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.676+0000 7f1277434640 1 -- start start 2023-07-14T13:08:08.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.680+0000 7f1277434640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f127006c430 0x7f1270165570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:08.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.680+0000 7f1277434640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f127006e160 0x7f1270141d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:08.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.680+0000 7f1277434640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12700ae1f0 0x7f1270161b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:08.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.680+0000 7f1277434640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127015f530 con 0x7f127006c430 2023-07-14T13:08:08.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.680+0000 7f1277434640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1270165ab0 con 0x7f127006e160 2023-07-14T13:08:08.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.680+0000 7f1277434640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12701647f0 con 0x7f12700ae1f0 2023-07-14T13:08:08.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.680+0000 7f12751d0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f127006c430 0x7f1270165570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:08.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.680+0000 7f12751d0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f127006c430 0x7f1270165570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55716/0 (socket says 172.21.15.5:55716) 2023-07-14T13:08:08.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.680+0000 7f12751d0640 1 -- 172.21.15.5:0/3738431703 learned_addr learned my addr 172.21.15.5:0/3738431703 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:08.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.680+0000 7f12749cf640 1 --2- 172.21.15.5:0/3738431703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f127006e160 0x7f1270141d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:08.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.680+0000 7f12759d1640 1 --2- 172.21.15.5:0/3738431703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12700ae1f0 0x7f1270161b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:08.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.680+0000 7f12751d0640 1 -- 172.21.15.5:0/3738431703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12700ae1f0 msgr2=0x7f1270161b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:08.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.680+0000 7f12751d0640 1 --2- 172.21.15.5:0/3738431703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12700ae1f0 0x7f1270161b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:08.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.680+0000 7f12751d0640 1 -- 172.21.15.5:0/3738431703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f127006e160 msgr2=0x7f1270141d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:08.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.680+0000 7f12751d0640 1 --2- 172.21.15.5:0/3738431703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f127006e160 0x7f1270141d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:08.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.680+0000 7f12751d0640 1 -- 172.21.15.5:0/3738431703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1268009a70 con 0x7f127006c430 2023-07-14T13:08:08.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.680+0000 7f12759d1640 1 --2- 172.21.15.5:0/3738431703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12700ae1f0 0x7f1270161b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:08.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.680+0000 7f12749cf640 1 --2- 172.21.15.5:0/3738431703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f127006e160 0x7f1270141d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:08.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.680+0000 7f12751d0640 1 --2- 172.21.15.5:0/3738431703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f127006c430 0x7f1270165570 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f126c0ae040 tx=0x7f126c0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:08.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.680+0000 7f1265ffb640 1 -- 172.21.15.5:0/3738431703 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c0b4430 con 0x7f127006c430 2023-07-14T13:08:08.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.680+0000 7f1265ffb640 1 -- 172.21.15.5:0/3738431703 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126c0b45b0 con 0x7f127006c430 2023-07-14T13:08:08.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.680+0000 7f1265ffb640 1 -- 172.21.15.5:0/3738431703 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c0b4960 con 0x7f127006c430 2023-07-14T13:08:08.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.680+0000 7f1277434640 1 -- 172.21.15.5:0/3738431703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126c009420 con 0x7f127006c430 2023-07-14T13:08:08.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.680+0000 7f1277434640 1 -- 172.21.15.5:0/3738431703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127006e6b0 con 0x7f127006c430 2023-07-14T13:08:08.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.680+0000 7f1277434640 1 -- 172.21.15.5:0/3738431703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12700678d0 con 0x7f127006c430 2023-07-14T13:08:08.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.684+0000 7f1265ffb640 1 -- 172.21.15.5:0/3738431703 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 29) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f126c0b2040 con 0x7f127006c430 2023-07-14T13:08:08.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.684+0000 7f1265ffb640 1 --2- 172.21.15.5:0/3738431703 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f12540660d0 0x7f1254068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:08.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.684+0000 7f1265ffb640 1 -- 172.21.15.5:0/3738431703 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6880+0+0 (secure 0 0 0) 0x7f126c11db60 con 0x7f127006c430 2023-07-14T13:08:08.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.684+0000 7f12749cf640 1 --2- 172.21.15.5:0/3738431703 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f12540660d0 0x7f1254068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:08.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.684+0000 7f12749cf640 1 --2- 172.21.15.5:0/3738431703 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f12540660d0 0x7f1254068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f127006d390 tx=0x7f1260009040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:08.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.688+0000 7f1265ffb640 1 -- 172.21.15.5:0/3738431703 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f126c0eaec0 con 0x7f127006c430 2023-07-14T13:08:08.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.876+0000 7f1277434640 1 -- 172.21.15.5:0/3738431703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12701626f0 con 0x7f127006c430 2023-07-14T13:08:08.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.876+0000 7f1265ffb640 1 -- 172.21.15.5:0/3738431703 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4700 (secure 0 0 0) 0x7f126c0ee4e0 con 0x7f127006c430 2023-07-14T13:08:08.910 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:08.910 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5429,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/874132020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":874132020},{"type":"v1","addr":"172.21.15.154:6837","nonce":874132020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5911,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/217555499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":217555499},{"type":"v1","addr":"172.21.15.154:6835","nonce":217555499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6033,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3051331859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3051331859},{"type":"v1","addr":"172.21.15.5:6834","nonce":3051331859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:06:01.137621+0000","modified":"2023-07-14T13:06:04.782437+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6036":{"gid":6036,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/231396012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":231396012},{"type":"v1","addr":"172.21.15.5:6835","nonce":231396012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T13:08:08.910 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2023-07-14T13:08:08.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.876+0000 7f1277434640 1 -- 172.21.15.5:0/3738431703 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f12540660d0 msgr2=0x7f1254068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:08.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.876+0000 7f1277434640 1 --2- 172.21.15.5:0/3738431703 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f12540660d0 0x7f1254068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f127006d390 tx=0x7f1260009040 comp rx=0 tx=0).stop 2023-07-14T13:08:08.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.876+0000 7f1277434640 1 -- 172.21.15.5:0/3738431703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f127006c430 msgr2=0x7f1270165570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:08.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.876+0000 7f1277434640 1 --2- 172.21.15.5:0/3738431703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f127006c430 0x7f1270165570 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f126c0ae040 tx=0x7f126c0191f0 comp rx=0 tx=0).stop 2023-07-14T13:08:08.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.876+0000 7f1277434640 1 -- 172.21.15.5:0/3738431703 shutdown_connections 2023-07-14T13:08:08.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.876+0000 7f1277434640 1 --2- 172.21.15.5:0/3738431703 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f12540660d0 0x7f1254068580 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:08.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.876+0000 7f1277434640 1 --2- 172.21.15.5:0/3738431703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12700ae1f0 0x7f1270161b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:08.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.876+0000 7f1277434640 1 --2- 172.21.15.5:0/3738431703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f127006e160 0x7f1270141d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:08.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.876+0000 7f1277434640 1 --2- 172.21.15.5:0/3738431703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f127006c430 0x7f1270165570 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:08.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.876+0000 7f1277434640 1 -- 172.21.15.5:0/3738431703 >> 172.21.15.5:0/3738431703 conn(0x7f12700b1300 msgr2=0x7f12700ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:08.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.880+0000 7f1277434640 1 -- 172.21.15.5:0/3738431703 shutdown_connections 2023-07-14T13:08:08.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:08.880+0000 7f1277434640 1 -- 172.21.15.5:0/3738431703 wait complete. 2023-07-14T13:08:08.931 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:08:09.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.040+0000 7f36851d2640 1 Processor -- start 2023-07-14T13:08:09.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.040+0000 7f36851d2640 1 -- start start 2023-07-14T13:08:09.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.040+0000 7f36851d2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3680158ce0 0x7f3680070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:09.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.040+0000 7f36851d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36800c8ad0 0x7f36800c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:09.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.040+0000 7f36851d2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f36800c9560 0x7f36800cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:09.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.040+0000 7f36851d2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36800c99e0 con 0x7f3680158ce0 2023-07-14T13:08:09.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.040+0000 7f36851d2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36800cc700 con 0x7f36800c9560 2023-07-14T13:08:09.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.040+0000 7f36851d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36800b0ff0 con 0x7f36800c8ad0 2023-07-14T13:08:09.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.044+0000 7f367ed9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3680158ce0 0x7f3680070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:09.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.044+0000 7f367ed9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3680158ce0 0x7f3680070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32912/0 (socket says 172.21.15.5:32912) 2023-07-14T13:08:09.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.044+0000 7f367ed9d640 1 -- 172.21.15.5:0/1714197585 learned_addr learned my addr 172.21.15.5:0/1714197585 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:09.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.044+0000 7f3677fff640 1 --2- 172.21.15.5:0/1714197585 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36800c8ad0 0x7f36800c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:09.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.044+0000 7f367f59e640 1 --2- 172.21.15.5:0/1714197585 >> v2:172.21.15.154:3300/0 conn(0x7f36800c9560 0x7f36800cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:09.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.044+0000 7f367ed9d640 1 -- 172.21.15.5:0/1714197585 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36800c8ad0 msgr2=0x7f36800c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:09.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.044+0000 7f367ed9d640 1 --2- 172.21.15.5:0/1714197585 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36800c8ad0 0x7f36800c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.044+0000 7f367ed9d640 1 -- 172.21.15.5:0/1714197585 >> v2:172.21.15.154:3300/0 conn(0x7f36800c9560 msgr2=0x7f36800cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:09.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.044+0000 7f367ed9d640 1 --2- 172.21.15.5:0/1714197585 >> v2:172.21.15.154:3300/0 conn(0x7f36800c9560 0x7f36800cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.044+0000 7f367ed9d640 1 -- 172.21.15.5:0/1714197585 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3680070c80 con 0x7f3680158ce0 2023-07-14T13:08:09.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.044+0000 7f367ed9d640 1 --2- 172.21.15.5:0/1714197585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3680158ce0 0x7f3680070450 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f36800c17e0 tx=0x7f367001ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508c942ab875ed01 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:09.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.044+0000 7f367e59c640 1 -- 172.21.15.5:0/1714197585 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36700a7a20 con 0x7f3680158ce0 2023-07-14T13:08:09.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.048+0000 7f367e59c640 1 -- 172.21.15.5:0/1714197585 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36700a7b80 con 0x7f3680158ce0 2023-07-14T13:08:09.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.048+0000 7f367e59c640 1 -- 172.21.15.5:0/1714197585 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36700af440 con 0x7f3680158ce0 2023-07-14T13:08:09.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.048+0000 7f36851d2640 1 -- 172.21.15.5:0/1714197585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3680158ce0 msgr2=0x7f3680070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:09.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.048+0000 7f36851d2640 1 --2- 172.21.15.5:0/1714197585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3680158ce0 0x7f3680070450 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f36800c17e0 tx=0x7f367001ea80 comp rx=0 tx=0).stop 2023-07-14T13:08:09.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.048+0000 7f36851d2640 1 -- 172.21.15.5:0/1714197585 shutdown_connections 2023-07-14T13:08:09.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.048+0000 7f36851d2640 1 --2- 172.21.15.5:0/1714197585 >> v2:172.21.15.154:3300/0 conn(0x7f36800c9560 0x7f36800cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.048+0000 7f36851d2640 1 --2- 172.21.15.5:0/1714197585 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36800c8ad0 0x7f36800c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.048+0000 7f36851d2640 1 --2- 172.21.15.5:0/1714197585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3680158ce0 0x7f3680070450 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.048+0000 7f36851d2640 1 -- 172.21.15.5:0/1714197585 >> 172.21.15.5:0/1714197585 conn(0x7f36800afcf0 msgr2=0x7f36800b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:09.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.048+0000 7f36851d2640 1 -- 172.21.15.5:0/1714197585 shutdown_connections 2023-07-14T13:08:09.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.048+0000 7f36851d2640 1 -- 172.21.15.5:0/1714197585 wait complete. 2023-07-14T13:08:09.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.048+0000 7f36851d2640 1 Processor -- start 2023-07-14T13:08:09.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.048+0000 7f36851d2640 1 -- start start 2023-07-14T13:08:09.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.048+0000 7f36851d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36800c8ad0 0x7f368014c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:09.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.048+0000 7f36851d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36800c9560 0x7f36801f07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:09.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.048+0000 7f36851d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3680158ce0 0x7f3680156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:09.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.048+0000 7f36851d2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368014c5f0 con 0x7f36800c8ad0 2023-07-14T13:08:09.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.048+0000 7f36851d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36801f0d00 con 0x7f36800c9560 2023-07-14T13:08:09.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.048+0000 7f36851d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36801f37b0 con 0x7f3680158ce0 2023-07-14T13:08:09.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.048+0000 7f367ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36800c8ad0 0x7f368014c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:09.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.048+0000 7f367ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36800c8ad0 0x7f368014c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32914/0 (socket says 172.21.15.5:32914) 2023-07-14T13:08:09.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.048+0000 7f367ed9d640 1 -- 172.21.15.5:0/1886827498 learned_addr learned my addr 172.21.15.5:0/1886827498 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:09.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.048+0000 7f3677fff640 1 --2- 172.21.15.5:0/1886827498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36800c9560 0x7f36801f07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:09.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.048+0000 7f367f59e640 1 --2- 172.21.15.5:0/1886827498 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3680158ce0 0x7f3680156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:09.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.052+0000 7f367ed9d640 1 -- 172.21.15.5:0/1886827498 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3680158ce0 msgr2=0x7f3680156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:09.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.052+0000 7f367ed9d640 1 --2- 172.21.15.5:0/1886827498 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3680158ce0 0x7f3680156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.052+0000 7f367ed9d640 1 -- 172.21.15.5:0/1886827498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36800c9560 msgr2=0x7f36801f07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:09.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.052+0000 7f367ed9d640 1 --2- 172.21.15.5:0/1886827498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36800c9560 0x7f36801f07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.052+0000 7f367ed9d640 1 -- 172.21.15.5:0/1886827498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367000b770 con 0x7f36800c8ad0 2023-07-14T13:08:09.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.052+0000 7f367ed9d640 1 --2- 172.21.15.5:0/1886827498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36800c8ad0 0x7f368014c0b0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f367001f320 tx=0x7f367001b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:09.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.052+0000 7f36777fe640 1 -- 172.21.15.5:0/1886827498 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36700ba640 con 0x7f36800c8ad0 2023-07-14T13:08:09.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.052+0000 7f36777fe640 1 -- 172.21.15.5:0/1886827498 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36700ba7a0 con 0x7f36800c8ad0 2023-07-14T13:08:09.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.052+0000 7f36777fe640 1 -- 172.21.15.5:0/1886827498 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36700bab50 con 0x7f36800c8ad0 2023-07-14T13:08:09.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.052+0000 7f36851d2640 1 -- 172.21.15.5:0/1886827498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36801f3a90 con 0x7f36800c8ad0 2023-07-14T13:08:09.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.052+0000 7f36851d2640 1 -- 172.21.15.5:0/1886827498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36801f4050 con 0x7f36800c8ad0 2023-07-14T13:08:09.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.052+0000 7f36851d2640 1 -- 172.21.15.5:0/1886827498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36800ca1a0 con 0x7f36800c8ad0 2023-07-14T13:08:09.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.052+0000 7f36777fe640 1 -- 172.21.15.5:0/1886827498 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 29) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f36700b6040 con 0x7f36800c8ad0 2023-07-14T13:08:09.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.056+0000 7f36777fe640 1 --2- 172.21.15.5:0/1886827498 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f36600660d0 0x7f3660068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:09.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.056+0000 7f36777fe640 1 -- 172.21.15.5:0/1886827498 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6880+0+0 (secure 0 0 0) 0x7f36701211e0 con 0x7f36800c8ad0 2023-07-14T13:08:09.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.056+0000 7f3677fff640 1 --2- 172.21.15.5:0/1886827498 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f36600660d0 0x7f3660068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:09.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.056+0000 7f3677fff640 1 --2- 172.21.15.5:0/1886827498 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f36600660d0 0x7f3660068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3680153c00 tx=0x7f3668008040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:09.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.060+0000 7f36777fe640 1 -- 172.21.15.5:0/1886827498 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f36700ee670 con 0x7f36800c8ad0 2023-07-14T13:08:09.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.212+0000 7f36851d2640 1 -- 172.21.15.5:0/1886827498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36801f4240 con 0x7f36800c8ad0 2023-07-14T13:08:09.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.216+0000 7f36777fe640 1 -- 172.21.15.5:0/1886827498 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+19489 (secure 0 0 0) 0x7f36700f1c90 con 0x7f36800c8ad0 2023-07-14T13:08:09.248 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:09.249 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":70,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:08:07.482309+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:05:59.255634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-14T13:06:00.136409+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.37","mappings":[{"from":0,"to":6}]},{"pgid":"8.3d","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/4268797178":"2023-07-15T13:08:07.482252+0000","172.21.15.154:6833/497535468":"2023-07-15T13:08:07.482252+0000","172.21.15.154:6832/497535468":"2023-07-15T13:08:07.482252+0000","172.21.15.154:0/1425753077":"2023-07-15T13:08:07.482252+0000","172.21.15.154:0/1845109198":"2023-07-15T13:08:07.482252+0000","172.21.15.154:0/3296805177":"2023-07-15T13:08:07.482252+0000","172.21.15.154:0/2605934647":"2023-07-15T13:08:07.482252+0000","172.21.15.154:0/1178558752":"2023-07-15T13:08:07.482252+0000","172.21.15.154:0/3011670516":"2023-07-15T13:06:18.429741+0000","172.21.15.154:0/2719767027":"2023-07-15T13:06:18.429741+0000","172.21.15.154:6833/1810553301":"2023-07-15T13:06:18.429741+0000","172.21.15.154:6832/1810553301":"2023-07-15T13:06:18.429741+0000","172.21.15.154:0/2307511449":"2023-07-15T13:06:18.429741+0000","172.21.15.154:0/2860419665":"2023-07-15T13:06:18.429741+0000","172.21.15.154:0/870084639":"2023-07-15T13:06:18.429741+0000","172.21.15.154:0/124304401":"2023-07-15T13:06:18.429741+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:08:09.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.216+0000 7f36851d2640 1 -- 172.21.15.5:0/1886827498 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f36600660d0 msgr2=0x7f3660068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:09.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.216+0000 7f36851d2640 1 --2- 172.21.15.5:0/1886827498 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f36600660d0 0x7f3660068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3680153c00 tx=0x7f3668008040 comp rx=0 tx=0).stop 2023-07-14T13:08:09.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.216+0000 7f36851d2640 1 -- 172.21.15.5:0/1886827498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36800c8ad0 msgr2=0x7f368014c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:09.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.216+0000 7f36851d2640 1 --2- 172.21.15.5:0/1886827498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36800c8ad0 0x7f368014c0b0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f367001f320 tx=0x7f367001b820 comp rx=0 tx=0).stop 2023-07-14T13:08:09.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.216+0000 7f36851d2640 1 -- 172.21.15.5:0/1886827498 shutdown_connections 2023-07-14T13:08:09.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.216+0000 7f36851d2640 1 --2- 172.21.15.5:0/1886827498 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f36600660d0 0x7f3660068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.216+0000 7f36851d2640 1 --2- 172.21.15.5:0/1886827498 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3680158ce0 0x7f3680156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.216+0000 7f36851d2640 1 --2- 172.21.15.5:0/1886827498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36800c9560 0x7f36801f07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.216+0000 7f36851d2640 1 --2- 172.21.15.5:0/1886827498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36800c8ad0 0x7f368014c0b0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.216+0000 7f36851d2640 1 -- 172.21.15.5:0/1886827498 >> 172.21.15.5:0/1886827498 conn(0x7f36800afcf0 msgr2=0x7f36800b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:09.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.216+0000 7f36851d2640 1 -- 172.21.15.5:0/1886827498 shutdown_connections 2023-07-14T13:08:09.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.216+0000 7f36851d2640 1 -- 172.21.15.5:0/1886827498 wait complete. 2023-07-14T13:08:09.269 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-14T13:08:09.270 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:08:09.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.380+0000 7f4a6fc6d640 1 Processor -- start 2023-07-14T13:08:09.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.380+0000 7f4a6fc6d640 1 -- start start 2023-07-14T13:08:09.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.380+0000 7f4a6fc6d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4a6806b1e0 0x7f4a680c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:09.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.380+0000 7f4a6fc6d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4a680c21f0 0x7f4a680cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:09.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.380+0000 7f4a6fc6d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a680cac70 con 0x7f4a68070b70 2023-07-14T13:08:09.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.380+0000 7f4a6fc6d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a680ca060 con 0x7f4a6806b1e0 2023-07-14T13:08:09.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.380+0000 7f4a6fc6d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a680ca340 con 0x7f4a680c21f0 2023-07-14T13:08:09.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.380+0000 7f4a6d208640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4a6806b1e0 0x7f4a680c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:09.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.380+0000 7f4a6d208640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4a6806b1e0 0x7f4a680c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32926/0 (socket says 172.21.15.5:32926) 2023-07-14T13:08:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.380+0000 7f4a6d208640 1 -- 172.21.15.5:0/246913033 learned_addr learned my addr 172.21.15.5:0/246913033 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.380+0000 7f4a6e20a640 1 --2- 172.21.15.5:0/246913033 >> v2:172.21.15.154:3300/0 conn(0x7f4a680c21f0 0x7f4a680cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.380+0000 7f4a6d208640 1 -- 172.21.15.5:0/246913033 >> v2:172.21.15.154:3300/0 conn(0x7f4a680c21f0 msgr2=0x7f4a680cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.380+0000 7f4a6d208640 1 --2- 172.21.15.5:0/246913033 >> v2:172.21.15.154:3300/0 conn(0x7f4a680c21f0 0x7f4a680cb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.380+0000 7f4a6d208640 1 -- 172.21.15.5:0/246913033 >> v1:172.21.15.154:6789/0 conn(0x7f4a68070b70 legacy=0x7f4a68070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.380+0000 7f4a6d208640 1 -- 172.21.15.5:0/246913033 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a680ca620 con 0x7f4a6806b1e0 2023-07-14T13:08:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.380+0000 7f4a6e20a640 1 --2- 172.21.15.5:0/246913033 >> v2:172.21.15.154:3300/0 conn(0x7f4a680c21f0 0x7f4a680cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:09.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.384+0000 7f4a6d208640 1 --2- 172.21.15.5:0/246913033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6806b1e0 0x7f4a680c1cb0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f4a680c19c0 tx=0x7f4a5801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826a3b978f36119c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:09.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.384+0000 7f4a6ca07640 1 -- 172.21.15.5:0/246913033 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a580aa650 con 0x7f4a6806b1e0 2023-07-14T13:08:09.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.384+0000 7f4a6ca07640 1 -- 172.21.15.5:0/246913033 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a580aa7b0 con 0x7f4a6806b1e0 2023-07-14T13:08:09.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.384+0000 7f4a6ca07640 1 -- 172.21.15.5:0/246913033 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a580aab40 con 0x7f4a6806b1e0 2023-07-14T13:08:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.384+0000 7f4a6fc6d640 1 -- 172.21.15.5:0/246913033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6806b1e0 msgr2=0x7f4a680c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.384+0000 7f4a6fc6d640 1 --2- 172.21.15.5:0/246913033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6806b1e0 0x7f4a680c1cb0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f4a680c19c0 tx=0x7f4a5801c4d0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.384+0000 7f4a6fc6d640 1 -- 172.21.15.5:0/246913033 shutdown_connections 2023-07-14T13:08:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.384+0000 7f4a6fc6d640 1 --2- 172.21.15.5:0/246913033 >> v2:172.21.15.154:3300/0 conn(0x7f4a680c21f0 0x7f4a680cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.384+0000 7f4a6fc6d640 1 --2- 172.21.15.5:0/246913033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6806b1e0 0x7f4a680c1cb0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.384+0000 7f4a6fc6d640 1 -- 172.21.15.5:0/246913033 >> 172.21.15.5:0/246913033 conn(0x7f4a680afcf0 msgr2=0x7f4a680b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.384+0000 7f4a6fc6d640 1 -- 172.21.15.5:0/246913033 shutdown_connections 2023-07-14T13:08:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.384+0000 7f4a6fc6d640 1 -- 172.21.15.5:0/246913033 wait complete. 2023-07-14T13:08:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.388+0000 7f4a6fc6d640 1 Processor -- start 2023-07-14T13:08:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.388+0000 7f4a6fc6d640 1 -- start start 2023-07-14T13:08:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.388+0000 7f4a6fc6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6806b1e0 0x7f4a6814b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:09.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.388+0000 7f4a6fc6d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a68070b70 0x7f4a6814cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:09.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.388+0000 7f4a6fc6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a680c21f0 0x7f4a680c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:09.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.388+0000 7f4a6fc6d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6814b740 con 0x7f4a6806b1e0 2023-07-14T13:08:09.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.388+0000 7f4a6fc6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a680c5f40 con 0x7f4a680c21f0 2023-07-14T13:08:09.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.388+0000 7f4a6fc6d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a680c6220 con 0x7f4a68070b70 2023-07-14T13:08:09.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.388+0000 7f4a6da09640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6806b1e0 0x7f4a6814b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:09.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.388+0000 7f4a6da09640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6806b1e0 0x7f4a6814b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32942/0 (socket says 172.21.15.5:32942) 2023-07-14T13:08:09.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.388+0000 7f4a6da09640 1 -- 172.21.15.5:0/1455058991 learned_addr learned my addr 172.21.15.5:0/1455058991 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:09.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.388+0000 7f4a6e20a640 1 --2- 172.21.15.5:0/1455058991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a680c21f0 0x7f4a680c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:09.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.388+0000 7f4a6d208640 1 --2- 172.21.15.5:0/1455058991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a68070b70 0x7f4a6814cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:09.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.388+0000 7f4a6da09640 1 -- 172.21.15.5:0/1455058991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a68070b70 msgr2=0x7f4a6814cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:09.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.388+0000 7f4a6da09640 1 --2- 172.21.15.5:0/1455058991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a68070b70 0x7f4a6814cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.388+0000 7f4a6da09640 1 -- 172.21.15.5:0/1455058991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a680c21f0 msgr2=0x7f4a680c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:09.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.388+0000 7f4a6da09640 1 --2- 172.21.15.5:0/1455058991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a680c21f0 0x7f4a680c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.388+0000 7f4a6da09640 1 -- 172.21.15.5:0/1455058991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a580094d0 con 0x7f4a6806b1e0 2023-07-14T13:08:09.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.388+0000 7f4a6da09640 1 --2- 172.21.15.5:0/1455058991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6806b1e0 0x7f4a6814b200 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f4a6400c500 tx=0x7f4a6400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:09.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.388+0000 7f4a5e7fc640 1 -- 172.21.15.5:0/1455058991 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a64005220 con 0x7f4a6806b1e0 2023-07-14T13:08:09.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.388+0000 7f4a5e7fc640 1 -- 172.21.15.5:0/1455058991 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a64005380 con 0x7f4a6806b1e0 2023-07-14T13:08:09.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.388+0000 7f4a6fc6d640 1 -- 172.21.15.5:0/1455058991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a680c6500 con 0x7f4a6806b1e0 2023-07-14T13:08:09.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.388+0000 7f4a5e7fc640 1 -- 172.21.15.5:0/1455058991 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a64007270 con 0x7f4a6806b1e0 2023-07-14T13:08:09.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.388+0000 7f4a6fc6d640 1 -- 172.21.15.5:0/1455058991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a680b1f80 con 0x7f4a6806b1e0 2023-07-14T13:08:09.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.388+0000 7f4a6fc6d640 1 -- 172.21.15.5:0/1455058991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a680678d0 con 0x7f4a6806b1e0 2023-07-14T13:08:09.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.392+0000 7f4a5e7fc640 1 -- 172.21.15.5:0/1455058991 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 29) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f4a640073d0 con 0x7f4a6806b1e0 2023-07-14T13:08:09.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.392+0000 7f4a5e7fc640 1 --2- 172.21.15.5:0/1455058991 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f4a4c0660d0 0x7f4a4c068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:09.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.392+0000 7f4a5e7fc640 1 -- 172.21.15.5:0/1455058991 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6880+0+0 (secure 0 0 0) 0x7f4a640836b0 con 0x7f4a6806b1e0 2023-07-14T13:08:09.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.392+0000 7f4a6d208640 1 --2- 172.21.15.5:0/1455058991 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f4a4c0660d0 0x7f4a4c068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:09.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.392+0000 7f4a6d208640 1 --2- 172.21.15.5:0/1455058991 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f4a4c0660d0 0x7f4a4c068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4a580ae000 tx=0x7f4a580a7000 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:09.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.396+0000 7f4a5e7fc640 1 -- 172.21.15.5:0/1455058991 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4a64050a10 con 0x7f4a6806b1e0 2023-07-14T13:08:09.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.580+0000 7f4a6fc6d640 1 -- 172.21.15.5:0/1455058991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a680c98c0 con 0x7f4a6806b1e0 2023-07-14T13:08:09.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.580+0000 7f4a5e7fc640 1 -- 172.21.15.5:0/1455058991 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4700 (secure 0 0 0) 0x7f4a64054030 con 0x7f4a6806b1e0 2023-07-14T13:08:09.616 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:09.616 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5429,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/874132020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":874132020},{"type":"v1","addr":"172.21.15.154:6837","nonce":874132020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5911,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/217555499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":217555499},{"type":"v1","addr":"172.21.15.154:6835","nonce":217555499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6033,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3051331859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3051331859},{"type":"v1","addr":"172.21.15.5:6834","nonce":3051331859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:06:01.137621+0000","modified":"2023-07-14T13:06:04.782437+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6036":{"gid":6036,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/231396012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":231396012},{"type":"v1","addr":"172.21.15.5:6835","nonce":231396012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T13:08:09.617 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2023-07-14T13:08:09.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.584+0000 7f4a6fc6d640 1 -- 172.21.15.5:0/1455058991 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f4a4c0660d0 msgr2=0x7f4a4c068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:09.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.584+0000 7f4a6fc6d640 1 --2- 172.21.15.5:0/1455058991 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f4a4c0660d0 0x7f4a4c068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4a580ae000 tx=0x7f4a580a7000 comp rx=0 tx=0).stop 2023-07-14T13:08:09.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.584+0000 7f4a6fc6d640 1 -- 172.21.15.5:0/1455058991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6806b1e0 msgr2=0x7f4a6814b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:09.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.584+0000 7f4a6fc6d640 1 --2- 172.21.15.5:0/1455058991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6806b1e0 0x7f4a6814b200 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f4a6400c500 tx=0x7f4a6400c9c0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.584+0000 7f4a6fc6d640 1 -- 172.21.15.5:0/1455058991 shutdown_connections 2023-07-14T13:08:09.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.584+0000 7f4a6fc6d640 1 --2- 172.21.15.5:0/1455058991 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f4a4c0660d0 0x7f4a4c068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.584+0000 7f4a6fc6d640 1 --2- 172.21.15.5:0/1455058991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a680c21f0 0x7f4a680c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.584+0000 7f4a6fc6d640 1 --2- 172.21.15.5:0/1455058991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a68070b70 0x7f4a6814cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.584+0000 7f4a6fc6d640 1 --2- 172.21.15.5:0/1455058991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6806b1e0 0x7f4a6814b200 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.584+0000 7f4a6fc6d640 1 -- 172.21.15.5:0/1455058991 >> 172.21.15.5:0/1455058991 conn(0x7f4a680afcf0 msgr2=0x7f4a680c4450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:09.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.584+0000 7f4a6fc6d640 1 -- 172.21.15.5:0/1455058991 shutdown_connections 2023-07-14T13:08:09.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.584+0000 7f4a6fc6d640 1 -- 172.21.15.5:0/1455058991 wait complete. 2023-07-14T13:08:09.637 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:08:09.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.752+0000 7fb212e48640 1 Processor -- start 2023-07-14T13:08:09.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.752+0000 7fb212e48640 1 -- start start 2023-07-14T13:08:09.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.756+0000 7fb212e48640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb20c15bdf0 0x7fb20c0ca970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:09.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.756+0000 7fb212e48640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb20c15f970 0x7fb20c15fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:09.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.756+0000 7fb212e48640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb20c160300 con 0x7fb20c06b1e0 2023-07-14T13:08:09.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.756+0000 7fb212e48640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb20c0cb2e0 con 0x7fb20c15f970 2023-07-14T13:08:09.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.756+0000 7fb212e48640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c0cb5c0 con 0x7fb20c15bdf0 2023-07-14T13:08:09.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.756+0000 7fb20bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb20c15f970 0x7fb20c15fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:09.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.756+0000 7fb210be4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb20c15bdf0 0x7fb20c0ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:09.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.756+0000 7fb20bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb20c15f970 0x7fb20c15fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:46186/0 (socket says 172.21.15.5:46186) 2023-07-14T13:08:09.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.756+0000 7fb20bfff640 1 -- 172.21.15.5:0/3437951254 learned_addr learned my addr 172.21.15.5:0/3437951254 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:09.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.756+0000 7fb20bfff640 1 -- 172.21.15.5:0/3437951254 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb20c15bdf0 msgr2=0x7fb20c0ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:09.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.756+0000 7fb20bfff640 1 --2- 172.21.15.5:0/3437951254 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb20c15bdf0 0x7fb20c0ca970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.756+0000 7fb20bfff640 1 -- 172.21.15.5:0/3437951254 >> v1:172.21.15.154:6789/0 conn(0x7fb20c06b1e0 legacy=0x7fb20c06b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:09.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.756+0000 7fb20bfff640 1 -- 172.21.15.5:0/3437951254 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c0cb8a0 con 0x7fb20c15f970 2023-07-14T13:08:09.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.760+0000 7fb20bfff640 1 --2- 172.21.15.5:0/3437951254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb20c15f970 0x7fb20c15fdc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8009870 tx=0x7fb1f801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc51f036dda1357 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:09.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.760+0000 7fb20b7fe640 1 -- 172.21.15.5:0/3437951254 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f80a6040 con 0x7fb20c15f970 2023-07-14T13:08:09.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.760+0000 7fb20b7fe640 1 -- 172.21.15.5:0/3437951254 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f80aa600 con 0x7fb20c15f970 2023-07-14T13:08:09.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.760+0000 7fb20b7fe640 1 -- 172.21.15.5:0/3437951254 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f80aa990 con 0x7fb20c15f970 2023-07-14T13:08:09.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.760+0000 7fb212e48640 1 -- 172.21.15.5:0/3437951254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb20c15f970 msgr2=0x7fb20c15fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:09.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.760+0000 7fb212e48640 1 --2- 172.21.15.5:0/3437951254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb20c15f970 0x7fb20c15fdc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8009870 tx=0x7fb1f801c480 comp rx=0 tx=0).stop 2023-07-14T13:08:09.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.760+0000 7fb212e48640 1 -- 172.21.15.5:0/3437951254 shutdown_connections 2023-07-14T13:08:09.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.760+0000 7fb212e48640 1 --2- 172.21.15.5:0/3437951254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb20c15f970 0x7fb20c15fdc0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.760+0000 7fb212e48640 1 --2- 172.21.15.5:0/3437951254 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb20c15bdf0 0x7fb20c0ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.760+0000 7fb212e48640 1 -- 172.21.15.5:0/3437951254 >> 172.21.15.5:0/3437951254 conn(0x7fb20c0afcf0 msgr2=0x7fb20c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:09.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.760+0000 7fb212e48640 1 -- 172.21.15.5:0/3437951254 shutdown_connections 2023-07-14T13:08:09.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.760+0000 7fb212e48640 1 -- 172.21.15.5:0/3437951254 wait complete. 2023-07-14T13:08:09.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.760+0000 7fb212e48640 1 Processor -- start 2023-07-14T13:08:09.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.764+0000 7fb212e48640 1 -- start start 2023-07-14T13:08:09.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.764+0000 7fb212e48640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb20c06b1e0 0x7fb20c158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:09.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.764+0000 7fb212e48640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb20c15bdf0 0x7fb20c06f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:09.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.764+0000 7fb212e48640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb20c15f970 0x7fb20c06fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:09.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.764+0000 7fb212e48640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c15af30 con 0x7fb20c15f970 2023-07-14T13:08:09.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.764+0000 7fb212e48640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c15b210 con 0x7fb20c15bdf0 2023-07-14T13:08:09.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.764+0000 7fb212e48640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c15b4f0 con 0x7fb20c06b1e0 2023-07-14T13:08:09.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.764+0000 7fb2113e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb20c15f970 0x7fb20c06fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:09.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.764+0000 7fb20bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb20c15bdf0 0x7fb20c06f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:09.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.764+0000 7fb210be4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb20c06b1e0 0x7fb20c158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:09.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.764+0000 7fb2113e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb20c15f970 0x7fb20c06fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32958/0 (socket says 172.21.15.5:32958) 2023-07-14T13:08:09.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.764+0000 7fb2113e5640 1 -- 172.21.15.5:0/2033811393 learned_addr learned my addr 172.21.15.5:0/2033811393 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:09.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.764+0000 7fb20bfff640 1 --2- 172.21.15.5:0/2033811393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb20c15bdf0 0x7fb20c06f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:46188/0 (socket says 172.21.15.5:46188) 2023-07-14T13:08:09.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.764+0000 7fb2113e5640 1 -- 172.21.15.5:0/2033811393 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb20c06b1e0 msgr2=0x7fb20c158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:09.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.764+0000 7fb2113e5640 1 --2- 172.21.15.5:0/2033811393 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb20c06b1e0 0x7fb20c158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.764+0000 7fb2113e5640 1 -- 172.21.15.5:0/2033811393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb20c15bdf0 msgr2=0x7fb20c06f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:09.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.764+0000 7fb2113e5640 1 --2- 172.21.15.5:0/2033811393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb20c15bdf0 0x7fb20c06f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.764+0000 7fb2113e5640 1 -- 172.21.15.5:0/2033811393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f80094d0 con 0x7fb20c15f970 2023-07-14T13:08:09.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.764+0000 7fb2113e5640 1 --2- 172.21.15.5:0/2033811393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb20c15f970 0x7fb20c06fd40 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fb20400c770 tx=0x7fb20400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:09.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.764+0000 7fb2097fa640 1 -- 172.21.15.5:0/2033811393 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb204003b80 con 0x7fb20c15f970 2023-07-14T13:08:09.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.764+0000 7fb2097fa640 1 -- 172.21.15.5:0/2033811393 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb204003ce0 con 0x7fb20c15f970 2023-07-14T13:08:09.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.764+0000 7fb2097fa640 1 -- 172.21.15.5:0/2033811393 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20400aa90 con 0x7fb20c15f970 2023-07-14T13:08:09.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.764+0000 7fb212e48640 1 -- 172.21.15.5:0/2033811393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb20c15b7d0 con 0x7fb20c15f970 2023-07-14T13:08:09.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.764+0000 7fb212e48640 1 -- 172.21.15.5:0/2033811393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb20c15a220 con 0x7fb20c15f970 2023-07-14T13:08:09.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.764+0000 7fb212e48640 1 -- 172.21.15.5:0/2033811393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb20c15d0d0 con 0x7fb20c15f970 2023-07-14T13:08:09.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.768+0000 7fb2097fa640 1 -- 172.21.15.5:0/2033811393 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 29) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fb20400abf0 con 0x7fb20c15f970 2023-07-14T13:08:09.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.768+0000 7fb2097fa640 1 --2- 172.21.15.5:0/2033811393 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fb1f00660d0 0x7fb1f0068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:09.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.768+0000 7fb2097fa640 1 -- 172.21.15.5:0/2033811393 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6880+0+0 (secure 0 0 0) 0x7fb204083a50 con 0x7fb20c15f970 2023-07-14T13:08:09.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.768+0000 7fb210be4640 1 --2- 172.21.15.5:0/2033811393 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fb1f00660d0 0x7fb1f0068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:09.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.768+0000 7fb210be4640 1 --2- 172.21.15.5:0/2033811393 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fb1f00660d0 0x7fb1f0068580 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb200009b60 tx=0x7fb200009190 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:09.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.772+0000 7fb2097fa640 1 -- 172.21.15.5:0/2033811393 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb204050ee0 con 0x7fb20c15f970 2023-07-14T13:08:09.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.800+0000 7fb2097fa640 1 -- 172.21.15.5:0/2033811393 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb2040512b0 con 0x7fb20c15f970 2023-07-14T13:08:09.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.964+0000 7fb212e48640 1 -- 172.21.15.5:0/2033811393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb20c0678d0 con 0x7fb20c15f970 2023-07-14T13:08:09.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.964+0000 7fb2097fa640 1 -- 172.21.15.5:0/2033811393 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4700 (secure 0 0 0) 0x7fb204070590 con 0x7fb20c15f970 2023-07-14T13:08:09.997 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:09.997 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5429,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/874132020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":874132020},{"type":"v1","addr":"172.21.15.154:6837","nonce":874132020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5911,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/217555499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":217555499},{"type":"v1","addr":"172.21.15.154:6835","nonce":217555499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6033,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3051331859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3051331859},{"type":"v1","addr":"172.21.15.5:6834","nonce":3051331859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:06:01.137621+0000","modified":"2023-07-14T13:06:04.782437+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6036":{"gid":6036,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/231396012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":231396012},{"type":"v1","addr":"172.21.15.5:6835","nonce":231396012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-14T13:08:09.997 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2023-07-14T13:08:09.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.964+0000 7fb212e48640 1 -- 172.21.15.5:0/2033811393 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fb1f00660d0 msgr2=0x7fb1f0068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:09.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.964+0000 7fb212e48640 1 --2- 172.21.15.5:0/2033811393 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fb1f00660d0 0x7fb1f0068580 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb200009b60 tx=0x7fb200009190 comp rx=0 tx=0).stop 2023-07-14T13:08:09.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.964+0000 7fb212e48640 1 -- 172.21.15.5:0/2033811393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb20c15f970 msgr2=0x7fb20c06fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:09.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.964+0000 7fb212e48640 1 --2- 172.21.15.5:0/2033811393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb20c15f970 0x7fb20c06fd40 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fb20400c770 tx=0x7fb20400cc30 comp rx=0 tx=0).stop 2023-07-14T13:08:09.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.964+0000 7fb212e48640 1 -- 172.21.15.5:0/2033811393 shutdown_connections 2023-07-14T13:08:09.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.964+0000 7fb212e48640 1 --2- 172.21.15.5:0/2033811393 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fb1f00660d0 0x7fb1f0068580 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.964+0000 7fb212e48640 1 --2- 172.21.15.5:0/2033811393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb20c15f970 0x7fb20c06fd40 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.964+0000 7fb212e48640 1 --2- 172.21.15.5:0/2033811393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb20c15bdf0 0x7fb20c06f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:09.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.964+0000 7fb212e48640 1 --2- 172.21.15.5:0/2033811393 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb20c06b1e0 0x7fb20c158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.964+0000 7fb212e48640 1 -- 172.21.15.5:0/2033811393 >> 172.21.15.5:0/2033811393 conn(0x7fb20c0afcf0 msgr2=0x7fb20c0b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:10.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.964+0000 7fb212e48640 1 -- 172.21.15.5:0/2033811393 shutdown_connections 2023-07-14T13:08:10.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:09.964+0000 7fb212e48640 1 -- 172.21.15.5:0/2033811393 wait complete. 2023-07-14T13:08:10.018 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:08:10.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.128+0000 7f4916f74640 1 Processor -- start 2023-07-14T13:08:10.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.128+0000 7f4916f74640 1 -- start start 2023-07-14T13:08:10.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.128+0000 7f4916f74640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4910070b70 0x7f4910070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.128+0000 7f4916f74640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f491006b1e0 0x7f49100c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.128+0000 7f4916f74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49100c21f0 0x7f49100cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.128+0000 7f4916f74640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49100cac70 con 0x7f491006b1e0 2023-07-14T13:08:10.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.128+0000 7f4916f74640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4910071480 con 0x7f4910070b70 2023-07-14T13:08:10.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.128+0000 7f4916f74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49100ca060 con 0x7f49100c21f0 2023-07-14T13:08:10.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.128+0000 7f490ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f491006b1e0 0x7f49100c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.128+0000 7f490ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f491006b1e0 0x7f49100c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32972/0 (socket says 172.21.15.5:32972) 2023-07-14T13:08:10.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.128+0000 7f490ffff640 1 -- 172.21.15.5:0/1708182229 learned_addr learned my addr 172.21.15.5:0/1708182229 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:10.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.128+0000 7f490ffff640 1 -- 172.21.15.5:0/1708182229 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49100c21f0 msgr2=0x7f49100cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:10.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.128+0000 7f4914d10640 1 --2- 172.21.15.5:0/1708182229 >> v2:172.21.15.154:3300/0 conn(0x7f4910070b70 0x7f4910070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.128+0000 7f4915511640 1 --2- 172.21.15.5:0/1708182229 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49100c21f0 0x7f49100cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.128+0000 7f490ffff640 1 --2- 172.21.15.5:0/1708182229 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49100c21f0 0x7f49100cb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.128+0000 7f490ffff640 1 -- 172.21.15.5:0/1708182229 >> v2:172.21.15.154:3300/0 conn(0x7f4910070b70 msgr2=0x7f4910070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:10.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.128+0000 7f490ffff640 1 --2- 172.21.15.5:0/1708182229 >> v2:172.21.15.154:3300/0 conn(0x7f4910070b70 0x7f4910070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.128+0000 7f490ffff640 1 -- 172.21.15.5:0/1708182229 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49100ca340 con 0x7f491006b1e0 2023-07-14T13:08:10.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.128+0000 7f4914d10640 1 --2- 172.21.15.5:0/1708182229 >> v2:172.21.15.154:3300/0 conn(0x7f4910070b70 0x7f4910070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:08:10.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.128+0000 7f4915511640 1 --2- 172.21.15.5:0/1708182229 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49100c21f0 0x7f49100cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:08:10.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.132+0000 7f490ffff640 1 --2- 172.21.15.5:0/1708182229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f491006b1e0 0x7f49100c1cb0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f491006f1f0 tx=0x7f48fc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165c6f92c3d0d215 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:10.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.132+0000 7f490f7fe640 1 -- 172.21.15.5:0/1708182229 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc0aa610 con 0x7f491006b1e0 2023-07-14T13:08:10.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.132+0000 7f490f7fe640 1 -- 172.21.15.5:0/1708182229 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48fc0a6040 con 0x7f491006b1e0 2023-07-14T13:08:10.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.132+0000 7f490f7fe640 1 -- 172.21.15.5:0/1708182229 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc0aa990 con 0x7f491006b1e0 2023-07-14T13:08:10.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.132+0000 7f4916f74640 1 -- 172.21.15.5:0/1708182229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f491006b1e0 msgr2=0x7f49100c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:10.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.132+0000 7f4916f74640 1 --2- 172.21.15.5:0/1708182229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f491006b1e0 0x7f49100c1cb0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f491006f1f0 tx=0x7f48fc01c4d0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.132+0000 7f4916f74640 1 -- 172.21.15.5:0/1708182229 shutdown_connections 2023-07-14T13:08:10.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.132+0000 7f4916f74640 1 --2- 172.21.15.5:0/1708182229 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49100c21f0 0x7f49100cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.132+0000 7f4916f74640 1 --2- 172.21.15.5:0/1708182229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f491006b1e0 0x7f49100c1cb0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.132+0000 7f4916f74640 1 --2- 172.21.15.5:0/1708182229 >> v2:172.21.15.154:3300/0 conn(0x7f4910070b70 0x7f4910070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.132+0000 7f4916f74640 1 -- 172.21.15.5:0/1708182229 >> 172.21.15.5:0/1708182229 conn(0x7f49100afcf0 msgr2=0x7f49100b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:10.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.132+0000 7f4916f74640 1 -- 172.21.15.5:0/1708182229 shutdown_connections 2023-07-14T13:08:10.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.132+0000 7f4916f74640 1 -- 172.21.15.5:0/1708182229 wait complete. 2023-07-14T13:08:10.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.136+0000 7f4916f74640 1 Processor -- start 2023-07-14T13:08:10.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.136+0000 7f4916f74640 1 -- start start 2023-07-14T13:08:10.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.136+0000 7f4916f74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f491006b1e0 0x7f49101f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.136+0000 7f4916f74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4910070b70 0x7f4910158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.136+0000 7f4916f74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49100c21f0 0x7f49100b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.136+0000 7f4916f74640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49100aeb50 con 0x7f4910070b70 2023-07-14T13:08:10.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.136+0000 7f4916f74640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49101f7ad0 con 0x7f49100c21f0 2023-07-14T13:08:10.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.136+0000 7f4916f74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4910158780 con 0x7f491006b1e0 2023-07-14T13:08:10.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.136+0000 7f490ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4910070b70 0x7f4910158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.136+0000 7f490ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4910070b70 0x7f4910158240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32982/0 (socket says 172.21.15.5:32982) 2023-07-14T13:08:10.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.136+0000 7f490ffff640 1 -- 172.21.15.5:0/2624520894 learned_addr learned my addr 172.21.15.5:0/2624520894 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:10.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.136+0000 7f4914d10640 1 --2- 172.21.15.5:0/2624520894 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f491006b1e0 0x7f49101f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.136+0000 7f4915511640 1 --2- 172.21.15.5:0/2624520894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49100c21f0 0x7f49100b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.136+0000 7f490ffff640 1 -- 172.21.15.5:0/2624520894 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f491006b1e0 msgr2=0x7f49101f4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:10.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.136+0000 7f490ffff640 1 --2- 172.21.15.5:0/2624520894 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f491006b1e0 0x7f49101f4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.136+0000 7f490ffff640 1 -- 172.21.15.5:0/2624520894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49100c21f0 msgr2=0x7f49100b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:10.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.136+0000 7f490ffff640 1 --2- 172.21.15.5:0/2624520894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49100c21f0 0x7f49100b0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.136+0000 7f490ffff640 1 -- 172.21.15.5:0/2624520894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc0094d0 con 0x7f4910070b70 2023-07-14T13:08:10.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.136+0000 7f4914d10640 1 --2- 172.21.15.5:0/2624520894 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f491006b1e0 0x7f49101f4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:10.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.136+0000 7f490ffff640 1 --2- 172.21.15.5:0/2624520894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4910070b70 0x7f4910158240 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f48fc01ab80 tx=0x7f48fc01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:10.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.136+0000 7f490d7fa640 1 -- 172.21.15.5:0/2624520894 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc0b3800 con 0x7f4910070b70 2023-07-14T13:08:10.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.136+0000 7f490d7fa640 1 -- 172.21.15.5:0/2624520894 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48fc0b3980 con 0x7f4910070b70 2023-07-14T13:08:10.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.140+0000 7f490d7fa640 1 -- 172.21.15.5:0/2624520894 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc0b3d30 con 0x7f4910070b70 2023-07-14T13:08:10.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.140+0000 7f4916f74640 1 -- 172.21.15.5:0/2624520894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49101f7d20 con 0x7f4910070b70 2023-07-14T13:08:10.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.140+0000 7f4916f74640 1 -- 172.21.15.5:0/2624520894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49101f82e0 con 0x7f4910070b70 2023-07-14T13:08:10.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.140+0000 7f4916f74640 1 -- 172.21.15.5:0/2624520894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49100678d0 con 0x7f4910070b70 2023-07-14T13:08:10.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.140+0000 7f490d7fa640 1 -- 172.21.15.5:0/2624520894 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f48fc0b2380 con 0x7f4910070b70 2023-07-14T13:08:10.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.140+0000 7f490d7fa640 1 --2- 172.21.15.5:0/2624520894 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f48f40663d0 0x7f48f4068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.140+0000 7f490d7fa640 1 -- 172.21.15.5:0/2624520894 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6880+0+0 (secure 0 0 0) 0x7f48fc11e5d0 con 0x7f4910070b70 2023-07-14T13:08:10.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.140+0000 7f4914d10640 1 --2- 172.21.15.5:0/2624520894 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f48f40663d0 0x7f48f4068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.140+0000 7f4914d10640 1 --2- 172.21.15.5:0/2624520894 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f48f40663d0 0x7f48f4068880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4904006b20 tx=0x7f4904008040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:10.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.144+0000 7f490d7fa640 1 -- 172.21.15.5:0/2624520894 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f48fc0eb4a0 con 0x7f4910070b70 2023-07-14T13:08:10.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.300+0000 7f4916f74640 1 -- 172.21.15.5:0/2624520894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49100c6a20 con 0x7f4910070b70 2023-07-14T13:08:10.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.300+0000 7f490d7fa640 1 -- 172.21.15.5:0/2624520894 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+19489 (secure 0 0 0) 0x7f48fc0eeac0 con 0x7f4910070b70 2023-07-14T13:08:10.335 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:10.335 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":70,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:08:07.482309+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:05:59.255634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-14T13:06:00.136409+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.37","mappings":[{"from":0,"to":6}]},{"pgid":"8.3d","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/4268797178":"2023-07-15T13:08:07.482252+0000","172.21.15.154:6833/497535468":"2023-07-15T13:08:07.482252+0000","172.21.15.154:6832/497535468":"2023-07-15T13:08:07.482252+0000","172.21.15.154:0/1425753077":"2023-07-15T13:08:07.482252+0000","172.21.15.154:0/1845109198":"2023-07-15T13:08:07.482252+0000","172.21.15.154:0/3296805177":"2023-07-15T13:08:07.482252+0000","172.21.15.154:0/2605934647":"2023-07-15T13:08:07.482252+0000","172.21.15.154:0/1178558752":"2023-07-15T13:08:07.482252+0000","172.21.15.154:0/3011670516":"2023-07-15T13:06:18.429741+0000","172.21.15.154:0/2719767027":"2023-07-15T13:06:18.429741+0000","172.21.15.154:6833/1810553301":"2023-07-15T13:06:18.429741+0000","172.21.15.154:6832/1810553301":"2023-07-15T13:06:18.429741+0000","172.21.15.154:0/2307511449":"2023-07-15T13:06:18.429741+0000","172.21.15.154:0/2860419665":"2023-07-15T13:06:18.429741+0000","172.21.15.154:0/870084639":"2023-07-15T13:06:18.429741+0000","172.21.15.154:0/124304401":"2023-07-15T13:06:18.429741+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:08:10.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.304+0000 7f4916f74640 1 -- 172.21.15.5:0/2624520894 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f48f40663d0 msgr2=0x7f48f4068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:10.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.304+0000 7f4916f74640 1 --2- 172.21.15.5:0/2624520894 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f48f40663d0 0x7f48f4068880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4904006b20 tx=0x7f4904008040 comp rx=0 tx=0).stop 2023-07-14T13:08:10.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.304+0000 7f4916f74640 1 -- 172.21.15.5:0/2624520894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4910070b70 msgr2=0x7f4910158240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:10.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.304+0000 7f4916f74640 1 --2- 172.21.15.5:0/2624520894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4910070b70 0x7f4910158240 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f48fc01ab80 tx=0x7f48fc01ad10 comp rx=0 tx=0).stop 2023-07-14T13:08:10.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.304+0000 7f4916f74640 1 -- 172.21.15.5:0/2624520894 shutdown_connections 2023-07-14T13:08:10.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.304+0000 7f4916f74640 1 --2- 172.21.15.5:0/2624520894 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f48f40663d0 0x7f48f4068880 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.304+0000 7f4916f74640 1 --2- 172.21.15.5:0/2624520894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49100c21f0 0x7f49100b0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.304+0000 7f4916f74640 1 --2- 172.21.15.5:0/2624520894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4910070b70 0x7f4910158240 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.304+0000 7f4916f74640 1 --2- 172.21.15.5:0/2624520894 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f491006b1e0 0x7f49101f4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.304+0000 7f4916f74640 1 -- 172.21.15.5:0/2624520894 >> 172.21.15.5:0/2624520894 conn(0x7f49100afcf0 msgr2=0x7f4910158f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:10.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.304+0000 7f4916f74640 1 -- 172.21.15.5:0/2624520894 shutdown_connections 2023-07-14T13:08:10.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.304+0000 7f4916f74640 1 -- 172.21.15.5:0/2624520894 wait complete. 2023-07-14T13:08:10.356 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-14T13:08:10.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.468+0000 7f30e51fa640 1 Processor -- start 2023-07-14T13:08:10.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.468+0000 7f30e51fa640 1 -- start start 2023-07-14T13:08:10.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.468+0000 7f30e51fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30e006a9c0 0x7f30e00ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.468+0000 7f30e51fa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e00cdc80 con 0x7f30e006a540 2023-07-14T13:08:10.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.468+0000 7f30e51fa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e006e4c0 con 0x7f30e015f500 2023-07-14T13:08:10.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.468+0000 7f30e51fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e006ae40 con 0x7f30e006a9c0 2023-07-14T13:08:10.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.468+0000 7f30d7fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f30e006a540 0x7f30e00ce0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44292/0 (socket says 172.21.15.5:44292) 2023-07-14T13:08:10.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.468+0000 7f30d7fff640 1 -- 172.21.15.5:0/862331418 learned_addr learned my addr 172.21.15.5:0/862331418 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:10.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.468+0000 7f30df59e640 1 --2- 172.21.15.5:0/862331418 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30e006a9c0 0x7f30e00ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.468+0000 7f30de59c640 1 -- 172.21.15.5:0/862331418 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052832829 0 0) 0x7f30e00cdc80 con 0x7f30e006a540 2023-07-14T13:08:10.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.472+0000 7f30de59c640 1 -- 172.21.15.5:0/862331418 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30cc003530 con 0x7f30e006a540 2023-07-14T13:08:10.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.472+0000 7f30de59c640 1 -- 172.21.15.5:0/862331418 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2191813269 0 0) 0x7f30cc003530 con 0x7f30e006a540 2023-07-14T13:08:10.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.472+0000 7f30de59c640 1 -- 172.21.15.5:0/862331418 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30e006a9c0 msgr2=0x7f30e00ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:10.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.472+0000 7f30de59c640 1 --2- 172.21.15.5:0/862331418 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30e006a9c0 0x7f30e00ce800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.472+0000 7f30de59c640 1 -- 172.21.15.5:0/862331418 >> v1:172.21.15.154:6789/0 conn(0x7f30e015f500 legacy=0x7f30e006cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:10.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.472+0000 7f30de59c640 1 -- 172.21.15.5:0/862331418 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e006d940 con 0x7f30e006a540 2023-07-14T13:08:10.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.472+0000 7f30de59c640 1 -- 172.21.15.5:0/862331418 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f30c8001680 con 0x7f30e006a540 2023-07-14T13:08:10.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.472+0000 7f30de59c640 1 -- 172.21.15.5:0/862331418 >> v1:172.21.15.5:6789/0 conn(0x7f30e006a540 legacy=0x7f30e00ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:10.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.472+0000 7f30de59c640 1 --2- 172.21.15.5:0/862331418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30cc0039b0 0x7f30cc003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.472+0000 7f30de59c640 1 --2- 172.21.15.5:0/862331418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30cc004350 0x7f30cc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.472+0000 7f30de59c640 1 --2- 172.21.15.5:0/862331418 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30cc005010 0x7f30cc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.472+0000 7f30de59c640 1 -- 172.21.15.5:0/862331418 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e006ae40 con 0x7f30cc004350 2023-07-14T13:08:10.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.472+0000 7f30de59c640 1 -- 172.21.15.5:0/862331418 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc00bed0 con 0x7f30cc0039b0 2023-07-14T13:08:10.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.472+0000 7f30de59c640 1 -- 172.21.15.5:0/862331418 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc00c090 con 0x7f30cc005010 2023-07-14T13:08:10.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.472+0000 7f30df59e640 1 --2- 172.21.15.5:0/862331418 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30e006a9c0 0x7f30e00ce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:10.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.472+0000 7f30d7fff640 1 --2- 172.21.15.5:0/862331418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30cc004350 0x7f30cc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.472+0000 7f30ded9d640 1 --2- 172.21.15.5:0/862331418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30cc0039b0 0x7f30cc003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.472+0000 7f30df59e640 1 --2- 172.21.15.5:0/862331418 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30cc005010 0x7f30cc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.472+0000 7f30d7fff640 1 -- 172.21.15.5:0/862331418 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30cc005010 msgr2=0x7f30cc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:10.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.472+0000 7f30d7fff640 1 --2- 172.21.15.5:0/862331418 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30cc005010 0x7f30cc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.472+0000 7f30d7fff640 1 -- 172.21.15.5:0/862331418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30cc0039b0 msgr2=0x7f30cc003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:10.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.472+0000 7f30d7fff640 1 --2- 172.21.15.5:0/862331418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30cc0039b0 0x7f30cc003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.472+0000 7f30d7fff640 1 -- 172.21.15.5:0/862331418 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30cc003530 con 0x7f30cc004350 2023-07-14T13:08:10.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.472+0000 7f30d7fff640 1 --2- 172.21.15.5:0/862331418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30cc004350 0x7f30cc004810 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f30c800c210 tx=0x7f30c801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff390fa879859823 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:10.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.476+0000 7f30de59c640 1 -- 172.21.15.5:0/862331418 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c80a5b40 con 0x7f30cc004350 2023-07-14T13:08:10.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.476+0000 7f30de59c640 1 -- 172.21.15.5:0/862331418 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c80a5cc0 con 0x7f30cc004350 2023-07-14T13:08:10.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.476+0000 7f30de59c640 1 -- 172.21.15.5:0/862331418 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c8005b20 con 0x7f30cc004350 2023-07-14T13:08:10.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.476+0000 7f30e51fa640 1 -- 172.21.15.5:0/862331418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30cc004350 msgr2=0x7f30cc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:10.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.476+0000 7f30e51fa640 1 --2- 172.21.15.5:0/862331418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30cc004350 0x7f30cc004810 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f30c800c210 tx=0x7f30c801cc40 comp rx=0 tx=0).stop 2023-07-14T13:08:10.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.476+0000 7f30df59e640 1 -- 172.21.15.5:0/862331418 reap_dead start 2023-07-14T13:08:10.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.476+0000 7f30e51fa640 1 -- 172.21.15.5:0/862331418 shutdown_connections 2023-07-14T13:08:10.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.476+0000 7f30e51fa640 1 -- 172.21.15.5:0/862331418 >> 172.21.15.5:0/862331418 conn(0x7f30e00659d0 msgr2=0x7f30e0099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:10.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.476+0000 7f30e51fa640 1 -- 172.21.15.5:0/862331418 shutdown_connections 2023-07-14T13:08:10.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.476+0000 7f30e51fa640 1 -- 172.21.15.5:0/862331418 wait complete. 2023-07-14T13:08:10.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.476+0000 7f30e51fa640 1 Processor -- start 2023-07-14T13:08:10.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.476+0000 7f30e51fa640 1 -- start start 2023-07-14T13:08:10.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.476+0000 7f30e51fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30cc004350 0x7f30e01f0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.476+0000 7f30e51fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30e00b5110 0x7f30e00cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.476+0000 7f30e51fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30e00b2f70 0x7f30e00b3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.476+0000 7f30e51fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e00b3950 con 0x7f30e00b5110 2023-07-14T13:08:10.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.476+0000 7f30e51fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e00cd0b0 con 0x7f30cc004350 2023-07-14T13:08:10.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.476+0000 7f30e51fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e00cc010 con 0x7f30e00b2f70 2023-07-14T13:08:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.476+0000 7f30d7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30e00b5110 0x7f30e00cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.480+0000 7f30d7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30e00b5110 0x7f30e00cb730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33006/0 (socket says 172.21.15.5:33006) 2023-07-14T13:08:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.480+0000 7f30d7fff640 1 -- 172.21.15.5:0/769476396 learned_addr learned my addr 172.21.15.5:0/769476396 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.480+0000 7f30ded9d640 1 --2- 172.21.15.5:0/769476396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30cc004350 0x7f30e01f0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.480+0000 7f30df59e640 1 --2- 172.21.15.5:0/769476396 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30e00b2f70 0x7f30e00b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.480+0000 7f30d7fff640 1 -- 172.21.15.5:0/769476396 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30e00b2f70 msgr2=0x7f30e00b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:10.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.480+0000 7f30d7fff640 1 --2- 172.21.15.5:0/769476396 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30e00b2f70 0x7f30e00b3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.480+0000 7f30d7fff640 1 -- 172.21.15.5:0/769476396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30cc004350 msgr2=0x7f30e01f0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:10.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.480+0000 7f30d7fff640 1 --2- 172.21.15.5:0/769476396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30cc004350 0x7f30e01f0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.480+0000 7f30d7fff640 1 -- 172.21.15.5:0/769476396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e00cc2f0 con 0x7f30e00b5110 2023-07-14T13:08:10.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.480+0000 7f30d7fff640 1 --2- 172.21.15.5:0/769476396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30e00b5110 0x7f30e00cb730 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f30c801c6b0 tx=0x7f30cc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:10.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.480+0000 7f30d77fe640 1 -- 172.21.15.5:0/769476396 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c80b4070 con 0x7f30e00b5110 2023-07-14T13:08:10.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.480+0000 7f30d77fe640 1 -- 172.21.15.5:0/769476396 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c80a5b50 con 0x7f30e00b5110 2023-07-14T13:08:10.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.480+0000 7f30d77fe640 1 -- 172.21.15.5:0/769476396 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c8001640 con 0x7f30e00b5110 2023-07-14T13:08:10.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.480+0000 7f30e51fa640 1 -- 172.21.15.5:0/769476396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e00cc5d0 con 0x7f30e00b5110 2023-07-14T13:08:10.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.480+0000 7f30e51fa640 1 -- 172.21.15.5:0/769476396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e00ccb90 con 0x7f30e00b5110 2023-07-14T13:08:10.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.480+0000 7f30e51fa640 1 -- 172.21.15.5:0/769476396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e00678d0 con 0x7f30e00b5110 2023-07-14T13:08:10.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.480+0000 7f30d77fe640 1 -- 172.21.15.5:0/769476396 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f30c8007070 con 0x7f30e00b5110 2023-07-14T13:08:10.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.480+0000 7f30d77fe640 1 --2- 172.21.15.5:0/769476396 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f30c00663d0 0x7f30c0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.480+0000 7f30d77fe640 1 -- 172.21.15.5:0/769476396 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6880+0+0 (secure 0 0 0) 0x7f30c811dc30 con 0x7f30e00b5110 2023-07-14T13:08:10.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.484+0000 7f30ded9d640 1 --2- 172.21.15.5:0/769476396 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f30c00663d0 0x7f30c0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.484+0000 7f30ded9d640 1 --2- 172.21.15.5:0/769476396 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f30c00663d0 0x7f30c0068880 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f30d00079e0 tx=0x7f30d0007970 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:10.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.484+0000 7f30d77fe640 1 -- 172.21.15.5:0/769476396 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f30c80eaca0 con 0x7f30e00b5110 2023-07-14T13:08:10.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.676+0000 7f30e51fa640 1 -- 172.21.15.5:0/769476396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f30e00ca2d0 con 0x7f30e00b5110 2023-07-14T13:08:10.709 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-07-14T13:08:10.676+0000 7f17b1648640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-14T13:08:10.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.680+0000 7f30d77fe640 1 -- 172.21.15.5:0/769476396 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 161+0+0 (secure 0 0 0) 0x7f30c80ee2c0 con 0x7f30e00b5110 2023-07-14T13:08:10.716 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-14T13:08:10.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.684+0000 7f30e51fa640 1 -- 172.21.15.5:0/769476396 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f30c00663d0 msgr2=0x7f30c0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:10.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.684+0000 7f30e51fa640 1 --2- 172.21.15.5:0/769476396 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f30c00663d0 0x7f30c0068880 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f30d00079e0 tx=0x7f30d0007970 comp rx=0 tx=0).stop 2023-07-14T13:08:10.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.684+0000 7f30e51fa640 1 -- 172.21.15.5:0/769476396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30e00b5110 msgr2=0x7f30e00cb730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:10.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.684+0000 7f30e51fa640 1 --2- 172.21.15.5:0/769476396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30e00b5110 0x7f30e00cb730 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f30c801c6b0 tx=0x7f30cc005800 comp rx=0 tx=0).stop 2023-07-14T13:08:10.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.684+0000 7f30e51fa640 1 -- 172.21.15.5:0/769476396 shutdown_connections 2023-07-14T13:08:10.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.684+0000 7f30e51fa640 1 --2- 172.21.15.5:0/769476396 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f30c00663d0 0x7f30c0068880 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.684+0000 7f30e51fa640 1 --2- 172.21.15.5:0/769476396 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f30e00b2f70 0x7f30e00b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.684+0000 7f30e51fa640 1 --2- 172.21.15.5:0/769476396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30e00b5110 0x7f30e00cb730 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.684+0000 7f30e51fa640 1 --2- 172.21.15.5:0/769476396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30cc004350 0x7f30e01f0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.684+0000 7f30e51fa640 1 -- 172.21.15.5:0/769476396 >> 172.21.15.5:0/769476396 conn(0x7f30e00659d0 msgr2=0x7f30e00adf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.684+0000 7f30e51fa640 1 -- 172.21.15.5:0/769476396 shutdown_connections 2023-07-14T13:08:10.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.684+0000 7f30e51fa640 1 -- 172.21.15.5:0/769476396 wait complete. 2023-07-14T13:08:10.740 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-14T13:08:10.782 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-07-14T13:08:10.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.860+0000 7ff94e2d8640 1 Processor -- start 2023-07-14T13:08:10.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.860+0000 7ff94e2d8640 1 -- start start 2023-07-14T13:08:10.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.860+0000 7ff94e2d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff948159a70 0x7ff9480ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.860+0000 7ff94e2d8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff94815e060 0x7ff948070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.860+0000 7ff94e2d8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff948070e60 0x7ff9480c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.860+0000 7ff94e2d8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9480cbe50 con 0x7ff948070e60 2023-07-14T13:08:10.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.860+0000 7ff94e2d8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9480cd660 con 0x7ff94815e060 2023-07-14T13:08:10.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.860+0000 7ff94e2d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9480cc0a0 con 0x7ff948159a70 2023-07-14T13:08:10.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.860+0000 7ff94c875640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff948070e60 0x7ff9480c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.860+0000 7ff94c875640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff948070e60 0x7ff9480c85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33028/0 (socket says 172.21.15.5:33028) 2023-07-14T13:08:10.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.860+0000 7ff94c875640 1 -- 172.21.15.5:0/3836705806 learned_addr learned my addr 172.21.15.5:0/3836705806 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:10.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.860+0000 7ff947fff640 1 --2- 172.21.15.5:0/3836705806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff948159a70 0x7ff9480ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.860+0000 7ff9477fe640 1 --2- 172.21.15.5:0/3836705806 >> v2:172.21.15.154:3300/0 conn(0x7ff94815e060 0x7ff948070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.860+0000 7ff94c875640 1 -- 172.21.15.5:0/3836705806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff948159a70 msgr2=0x7ff9480ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:10.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.860+0000 7ff94c875640 1 --2- 172.21.15.5:0/3836705806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff948159a70 0x7ff9480ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.860+0000 7ff94c875640 1 -- 172.21.15.5:0/3836705806 >> v2:172.21.15.154:3300/0 conn(0x7ff94815e060 msgr2=0x7ff948070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:10.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.860+0000 7ff94c875640 1 --2- 172.21.15.5:0/3836705806 >> v2:172.21.15.154:3300/0 conn(0x7ff94815e060 0x7ff948070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.860+0000 7ff94c875640 1 -- 172.21.15.5:0/3836705806 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9480cc380 con 0x7ff948070e60 2023-07-14T13:08:10.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.864+0000 7ff94c875640 1 --2- 172.21.15.5:0/3836705806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff948070e60 0x7ff9480c85a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff9480cbad0 tx=0x7ff94001c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35c67c5a1d3db5a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:10.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.864+0000 7ff946ffd640 1 -- 172.21.15.5:0/3836705806 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9400a8450 con 0x7ff948070e60 2023-07-14T13:08:10.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.864+0000 7ff946ffd640 1 -- 172.21.15.5:0/3836705806 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9400a85b0 con 0x7ff948070e60 2023-07-14T13:08:10.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.864+0000 7ff946ffd640 1 -- 172.21.15.5:0/3836705806 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9400a8940 con 0x7ff948070e60 2023-07-14T13:08:10.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.864+0000 7ff94e2d8640 1 -- 172.21.15.5:0/3836705806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff948070e60 msgr2=0x7ff9480c85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:10.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.864+0000 7ff94e2d8640 1 --2- 172.21.15.5:0/3836705806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff948070e60 0x7ff9480c85a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff9480cbad0 tx=0x7ff94001c5c0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.864+0000 7ff94e2d8640 1 -- 172.21.15.5:0/3836705806 shutdown_connections 2023-07-14T13:08:10.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.864+0000 7ff94e2d8640 1 --2- 172.21.15.5:0/3836705806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff948070e60 0x7ff9480c85a0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.864+0000 7ff94e2d8640 1 --2- 172.21.15.5:0/3836705806 >> v2:172.21.15.154:3300/0 conn(0x7ff94815e060 0x7ff948070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.864+0000 7ff94e2d8640 1 --2- 172.21.15.5:0/3836705806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff948159a70 0x7ff9480ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.864+0000 7ff94e2d8640 1 -- 172.21.15.5:0/3836705806 >> 172.21.15.5:0/3836705806 conn(0x7ff9480afac0 msgr2=0x7ff9480afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:10.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.864+0000 7ff94e2d8640 1 -- 172.21.15.5:0/3836705806 shutdown_connections 2023-07-14T13:08:10.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.864+0000 7ff94e2d8640 1 -- 172.21.15.5:0/3836705806 wait complete. 2023-07-14T13:08:10.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.868+0000 7ff94e2d8640 1 Processor -- start 2023-07-14T13:08:10.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.868+0000 7ff94e2d8640 1 -- start start 2023-07-14T13:08:10.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.868+0000 7ff94e2d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff948070e60 0x7ff94814f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.868+0000 7ff94e2d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff948159a70 0x7ff948162b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.868+0000 7ff94e2d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff94815e060 0x7ff9481630b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.868+0000 7ff94e2d8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94806d400 con 0x7ff948070e60 2023-07-14T13:08:10.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.868+0000 7ff94e2d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94814fac0 con 0x7ff948159a70 2023-07-14T13:08:10.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.868+0000 7ff94e2d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94806c780 con 0x7ff94815e060 2023-07-14T13:08:10.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.868+0000 7ff947fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff948070e60 0x7ff94814f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.868+0000 7ff947fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff948070e60 0x7ff94814f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33036/0 (socket says 172.21.15.5:33036) 2023-07-14T13:08:10.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.868+0000 7ff947fff640 1 -- 172.21.15.5:0/3051461290 learned_addr learned my addr 172.21.15.5:0/3051461290 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:10.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.868+0000 7ff9477fe640 1 --2- 172.21.15.5:0/3051461290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff948159a70 0x7ff948162b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.868+0000 7ff94c875640 1 --2- 172.21.15.5:0/3051461290 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff94815e060 0x7ff9481630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.868+0000 7ff947fff640 1 -- 172.21.15.5:0/3051461290 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff94815e060 msgr2=0x7ff9481630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:10.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.868+0000 7ff947fff640 1 --2- 172.21.15.5:0/3051461290 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff94815e060 0x7ff9481630b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.868+0000 7ff947fff640 1 -- 172.21.15.5:0/3051461290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff948159a70 msgr2=0x7ff948162b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:10.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.868+0000 7ff947fff640 1 --2- 172.21.15.5:0/3051461290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff948159a70 0x7ff948162b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.868+0000 7ff947fff640 1 -- 172.21.15.5:0/3051461290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff940009b30 con 0x7ff948070e60 2023-07-14T13:08:10.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.868+0000 7ff947fff640 1 --2- 172.21.15.5:0/3051461290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff948070e60 0x7ff94814f580 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff93800d800 tx=0x7ff93800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:10.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.868+0000 7ff944ff9640 1 -- 172.21.15.5:0/3051461290 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9380096a0 con 0x7ff948070e60 2023-07-14T13:08:10.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.868+0000 7ff944ff9640 1 -- 172.21.15.5:0/3051461290 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff938009800 con 0x7ff948070e60 2023-07-14T13:08:10.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.868+0000 7ff944ff9640 1 -- 172.21.15.5:0/3051461290 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff938009b70 con 0x7ff948070e60 2023-07-14T13:08:10.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.868+0000 7ff94e2d8640 1 -- 172.21.15.5:0/3051461290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff94806ca60 con 0x7ff948070e60 2023-07-14T13:08:10.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.868+0000 7ff94e2d8640 1 -- 172.21.15.5:0/3051461290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94806d020 con 0x7ff948070e60 2023-07-14T13:08:10.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.872+0000 7ff94e2d8640 1 -- 172.21.15.5:0/3051461290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9480678d0 con 0x7ff948070e60 2023-07-14T13:08:10.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.872+0000 7ff944ff9640 1 -- 172.21.15.5:0/3051461290 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff938009cd0 con 0x7ff948070e60 2023-07-14T13:08:10.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.872+0000 7ff944ff9640 1 --2- 172.21.15.5:0/3051461290 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7ff9340663a0 0x7ff934068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.872+0000 7ff944ff9640 1 -- 172.21.15.5:0/3051461290 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6922+0+0 (secure 0 0 0) 0x7ff938084910 con 0x7ff948070e60 2023-07-14T13:08:10.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.872+0000 7ff9477fe640 1 --2- 172.21.15.5:0/3051461290 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7ff9340663a0 0x7ff934068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.872+0000 7ff9477fe640 1 --2- 172.21.15.5:0/3051461290 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7ff9340663a0 0x7ff934068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff9480c8730 tx=0x7ff93c008040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:10.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:10.876+0000 7ff944ff9640 1 -- 172.21.15.5:0/3051461290 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff938051930 con 0x7ff948070e60 2023-07-14T13:08:11.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.068+0000 7ff94e2d8640 1 -- 172.21.15.5:0/3051461290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff9480aec10 con 0x7ff948070e60 2023-07-14T13:08:11.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.700+0000 7ff944ff9640 1 -- 172.21.15.5:0/3051461290 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff938054f50 con 0x7ff948070e60 2023-07-14T13:08:11.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.704+0000 7ff94e2d8640 1 -- 172.21.15.5:0/3051461290 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7ff9340663a0 msgr2=0x7ff934068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:11.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.704+0000 7ff94e2d8640 1 --2- 172.21.15.5:0/3051461290 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7ff9340663a0 0x7ff934068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff9480c8730 tx=0x7ff93c008040 comp rx=0 tx=0).stop 2023-07-14T13:08:11.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.704+0000 7ff94e2d8640 1 -- 172.21.15.5:0/3051461290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff948070e60 msgr2=0x7ff94814f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:11.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.704+0000 7ff94e2d8640 1 --2- 172.21.15.5:0/3051461290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff948070e60 0x7ff94814f580 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff93800d800 tx=0x7ff93800dcc0 comp rx=0 tx=0).stop 2023-07-14T13:08:11.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.704+0000 7ff94e2d8640 1 -- 172.21.15.5:0/3051461290 shutdown_connections 2023-07-14T13:08:11.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.704+0000 7ff94e2d8640 1 --2- 172.21.15.5:0/3051461290 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7ff9340663a0 0x7ff934068850 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:11.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.704+0000 7ff94e2d8640 1 --2- 172.21.15.5:0/3051461290 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff94815e060 0x7ff9481630b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:11.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.704+0000 7ff94e2d8640 1 --2- 172.21.15.5:0/3051461290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff948159a70 0x7ff948162b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:11.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.704+0000 7ff94e2d8640 1 --2- 172.21.15.5:0/3051461290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff948070e60 0x7ff94814f580 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:11.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.704+0000 7ff94e2d8640 1 -- 172.21.15.5:0/3051461290 >> 172.21.15.5:0/3051461290 conn(0x7ff9480afac0 msgr2=0x7ff9480af060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:11.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.704+0000 7ff94e2d8640 1 -- 172.21.15.5:0/3051461290 shutdown_connections 2023-07-14T13:08:11.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.704+0000 7ff94e2d8640 1 -- 172.21.15.5:0/3051461290 wait complete. 2023-07-14T13:08:11.762 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-14T13:08:11.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.928+0000 7f15c0c96640 1 Processor -- start 2023-07-14T13:08:11.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.928+0000 7f15c0c96640 1 -- start start 2023-07-14T13:08:11.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.928+0000 7f15c0c96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15bc069430 0x7f15bc069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:11.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.928+0000 7f15c0c96640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f15bc0af2b0 0x7f15bc15a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:11.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.928+0000 7f15c0c96640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15bc159d70 con 0x7f15bc070f30 2023-07-14T13:08:11.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.928+0000 7f15c0c96640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15bc069d40 con 0x7f15bc0af2b0 2023-07-14T13:08:11.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.928+0000 7f15c0c96640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc0c9c60 con 0x7f15bc069430 2023-07-14T13:08:11.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.928+0000 7f15ba59c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15bc069430 0x7f15bc069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:11.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.928+0000 7f15bad9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f15bc0af2b0 0x7f15bc15a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:11.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.928+0000 7f15ba59c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15bc069430 0x7f15bc069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:52810/0 (socket says 172.21.15.5:52810) 2023-07-14T13:08:11.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.928+0000 7f15ba59c640 1 -- 172.21.15.5:0/1668148709 learned_addr learned my addr 172.21.15.5:0/1668148709 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:11.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.932+0000 7f15ba59c640 1 -- 172.21.15.5:0/1668148709 >> v2:172.21.15.154:3300/0 conn(0x7f15bc0af2b0 msgr2=0x7f15bc15a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:11.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.932+0000 7f15ba59c640 1 --2- 172.21.15.5:0/1668148709 >> v2:172.21.15.154:3300/0 conn(0x7f15bc0af2b0 0x7f15bc15a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:11.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.932+0000 7f15ba59c640 1 -- 172.21.15.5:0/1668148709 >> v1:172.21.15.154:6789/0 conn(0x7f15bc070f30 legacy=0x7f15bc0ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:11.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.932+0000 7f15ba59c640 1 -- 172.21.15.5:0/1668148709 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15bc0c9f40 con 0x7f15bc069430 2023-07-14T13:08:11.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.932+0000 7f15b9d9b640 1 -- 172.21.15.5:0/1668148709 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813700858 0 0) 0x7f15a4001120 con 0x7f15bc070f30 2023-07-14T13:08:11.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.932+0000 7f15ba59c640 1 --2- 172.21.15.5:0/1668148709 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15bc069430 0x7f15bc069800 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f15ac009870 tx=0x7f15ac01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a3dfab3cd36fdca server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:11.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.932+0000 7f15b9d9b640 1 -- 172.21.15.5:0/1668148709 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ac0a9400 con 0x7f15bc069430 2023-07-14T13:08:11.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.932+0000 7f15b9d9b640 1 -- 172.21.15.5:0/1668148709 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ac0a9560 con 0x7f15bc069430 2023-07-14T13:08:11.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.932+0000 7f15b9d9b640 1 -- 172.21.15.5:0/1668148709 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ac0a98f0 con 0x7f15bc069430 2023-07-14T13:08:11.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.932+0000 7f15c0c96640 1 -- 172.21.15.5:0/1668148709 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15bc069430 msgr2=0x7f15bc069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:11.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.932+0000 7f15c0c96640 1 --2- 172.21.15.5:0/1668148709 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15bc069430 0x7f15bc069800 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f15ac009870 tx=0x7f15ac01c540 comp rx=0 tx=0).stop 2023-07-14T13:08:11.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.932+0000 7f15c0c96640 1 -- 172.21.15.5:0/1668148709 shutdown_connections 2023-07-14T13:08:11.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.932+0000 7f15c0c96640 1 --2- 172.21.15.5:0/1668148709 >> v2:172.21.15.154:3300/0 conn(0x7f15bc0af2b0 0x7f15bc15a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:11.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.932+0000 7f15c0c96640 1 --2- 172.21.15.5:0/1668148709 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15bc069430 0x7f15bc069800 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:11.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.932+0000 7f15c0c96640 1 -- 172.21.15.5:0/1668148709 >> 172.21.15.5:0/1668148709 conn(0x7f15bc0cde90 msgr2=0x7f15bc0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:11.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.936+0000 7f15c0c96640 1 -- 172.21.15.5:0/1668148709 shutdown_connections 2023-07-14T13:08:11.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.936+0000 7f15c0c96640 1 -- 172.21.15.5:0/1668148709 wait complete. 2023-07-14T13:08:11.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.936+0000 7f15c0c96640 1 Processor -- start 2023-07-14T13:08:11.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.936+0000 7f15c0c96640 1 -- start start 2023-07-14T13:08:11.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.936+0000 7f15c0c96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15bc069430 0x7f15bc0b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:11.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.936+0000 7f15c0c96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15bc070f30 0x7f15bc06bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:11.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.936+0000 7f15c0c96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15bc0af2b0 0x7f15bc149d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:11.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.936+0000 7f15c0c96640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc1498e0 con 0x7f15bc0af2b0 2023-07-14T13:08:11.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.936+0000 7f15c0c96640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc0b3e40 con 0x7f15bc070f30 2023-07-14T13:08:11.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.936+0000 7f15c0c96640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc0b3b60 con 0x7f15bc069430 2023-07-14T13:08:11.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.936+0000 7f15bad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15bc0af2b0 0x7f15bc149d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:11.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.936+0000 7f15bad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15bc0af2b0 0x7f15bc149d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33042/0 (socket says 172.21.15.5:33042) 2023-07-14T13:08:11.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.936+0000 7f15bad9d640 1 -- 172.21.15.5:0/332214036 learned_addr learned my addr 172.21.15.5:0/332214036 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:11.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.936+0000 7f15ba59c640 1 --2- 172.21.15.5:0/332214036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15bc069430 0x7f15bc0b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:11.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.936+0000 7f15b3fff640 1 --2- 172.21.15.5:0/332214036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15bc070f30 0x7f15bc06bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:11.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.936+0000 7f15bad9d640 1 -- 172.21.15.5:0/332214036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15bc069430 msgr2=0x7f15bc0b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:11.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.936+0000 7f15bad9d640 1 --2- 172.21.15.5:0/332214036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15bc069430 0x7f15bc0b1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:11.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.936+0000 7f15bad9d640 1 -- 172.21.15.5:0/332214036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15bc070f30 msgr2=0x7f15bc06bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:11.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.936+0000 7f15bad9d640 1 --2- 172.21.15.5:0/332214036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15bc070f30 0x7f15bc06bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:11.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.936+0000 7f15bad9d640 1 -- 172.21.15.5:0/332214036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ac0094d0 con 0x7f15bc0af2b0 2023-07-14T13:08:11.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.936+0000 7f15bad9d640 1 --2- 172.21.15.5:0/332214036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15bc0af2b0 0x7f15bc149d70 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f15b400efc0 tx=0x7f15b400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:11.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.940+0000 7f15b2ffd640 1 -- 172.21.15.5:0/332214036 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b4014480 con 0x7f15bc0af2b0 2023-07-14T13:08:11.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.940+0000 7f15b2ffd640 1 -- 172.21.15.5:0/332214036 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b400f040 con 0x7f15bc0af2b0 2023-07-14T13:08:11.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.940+0000 7f15b2ffd640 1 -- 172.21.15.5:0/332214036 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b4014820 con 0x7f15bc0af2b0 2023-07-14T13:08:11.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.940+0000 7f15c0c96640 1 -- 172.21.15.5:0/332214036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15bc149290 con 0x7f15bc0af2b0 2023-07-14T13:08:11.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.940+0000 7f15c0c96640 1 -- 172.21.15.5:0/332214036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15bc0b21a0 con 0x7f15bc0af2b0 2023-07-14T13:08:11.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.940+0000 7f15c0c96640 1 -- 172.21.15.5:0/332214036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15bc149a90 con 0x7f15bc0af2b0 2023-07-14T13:08:11.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.940+0000 7f15b2ffd640 1 -- 172.21.15.5:0/332214036 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f15b4014980 con 0x7f15bc0af2b0 2023-07-14T13:08:11.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.940+0000 7f15b2ffd640 1 --2- 172.21.15.5:0/332214036 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f159c0663a0 0x7f159c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:11.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.940+0000 7f15b2ffd640 1 -- 172.21.15.5:0/332214036 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6922+0+0 (secure 0 0 0) 0x7f15b4085110 con 0x7f15bc0af2b0 2023-07-14T13:08:11.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.940+0000 7f15ba59c640 1 --2- 172.21.15.5:0/332214036 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f159c0663a0 0x7f159c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:11.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.944+0000 7f15ba59c640 1 --2- 172.21.15.5:0/332214036 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f159c0663a0 0x7f159c068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0ae000 tx=0x7f15ac008040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:11.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:11.944+0000 7f15b2ffd640 1 -- 172.21.15.5:0/332214036 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f15bc149a90 con 0x7f15bc0af2b0 2023-07-14T13:08:12.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.096+0000 7f15c0c96640 1 -- 172.21.15.5:0/332214036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f15bc0678d0 con 0x7f15bc0af2b0 2023-07-14T13:08:12.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.812+0000 7f15b2ffd640 1 -- 172.21.15.5:0/332214036 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v73) v1 ==== 181+0+0 (secure 0 0 0) 0x7f15b4055ab0 con 0x7f15bc0af2b0 2023-07-14T13:08:12.847 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-07-14T13:08:12.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.816+0000 7f15c0c96640 1 -- 172.21.15.5:0/332214036 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f159c0663a0 msgr2=0x7f159c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:12.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.816+0000 7f15c0c96640 1 --2- 172.21.15.5:0/332214036 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f159c0663a0 0x7f159c068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0ae000 tx=0x7f15ac008040 comp rx=0 tx=0).stop 2023-07-14T13:08:12.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.816+0000 7f15c0c96640 1 -- 172.21.15.5:0/332214036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15bc0af2b0 msgr2=0x7f15bc149d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:12.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.816+0000 7f15c0c96640 1 --2- 172.21.15.5:0/332214036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15bc0af2b0 0x7f15bc149d70 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f15b400efc0 tx=0x7f15b400c490 comp rx=0 tx=0).stop 2023-07-14T13:08:12.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.816+0000 7f15c0c96640 1 -- 172.21.15.5:0/332214036 shutdown_connections 2023-07-14T13:08:12.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.816+0000 7f15c0c96640 1 --2- 172.21.15.5:0/332214036 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f159c0663a0 0x7f159c068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:12.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.816+0000 7f15c0c96640 1 --2- 172.21.15.5:0/332214036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15bc0af2b0 0x7f15bc149d70 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:12.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.816+0000 7f15c0c96640 1 --2- 172.21.15.5:0/332214036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15bc070f30 0x7f15bc06bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:12.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.816+0000 7f15c0c96640 1 --2- 172.21.15.5:0/332214036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15bc069430 0x7f15bc0b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:12.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.816+0000 7f15c0c96640 1 -- 172.21.15.5:0/332214036 >> 172.21.15.5:0/332214036 conn(0x7f15bc0cde90 msgr2=0x7f15bc06f060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:12.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.816+0000 7f15c0c96640 1 -- 172.21.15.5:0/332214036 shutdown_connections 2023-07-14T13:08:12.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.816+0000 7f15c0c96640 1 -- 172.21.15.5:0/332214036 wait complete. 2023-07-14T13:08:12.876 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-14T13:08:13.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.992+0000 7f8a1b848640 1 Processor -- start 2023-07-14T13:08:13.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.992+0000 7f8a1b848640 1 -- start start 2023-07-14T13:08:13.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a1b848640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8a141453a0 0x7f8a140b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:13.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a1b848640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a1406c040 con 0x7f8a1406a440 2023-07-14T13:08:13.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a1b848640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a14160600 con 0x7f8a1415f690 2023-07-14T13:08:13.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a1b848640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a14160170 con 0x7f8a141453a0 2023-07-14T13:08:13.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a18de3640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8a1406a440 0x7f8a1406c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44316/0 (socket says 172.21.15.5:44316) 2023-07-14T13:08:13.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a18de3640 1 -- 172.21.15.5:0/798137990 learned_addr learned my addr 172.21.15.5:0/798137990 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:13.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a19de5640 1 --2- 172.21.15.5:0/798137990 >> v2:172.21.15.154:3300/0 conn(0x7f8a141453a0 0x7f8a140b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:13.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a0bfff640 1 -- 172.21.15.5:0/798137990 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3805812985 0 0) 0x7f8a1406c040 con 0x7f8a1406a440 2023-07-14T13:08:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a0bfff640 1 -- 172.21.15.5:0/798137990 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a00003530 con 0x7f8a1406a440 2023-07-14T13:08:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a0bfff640 1 -- 172.21.15.5:0/798137990 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 533831206 0 0) 0x7f8a14160600 con 0x7f8a1415f690 2023-07-14T13:08:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a0bfff640 1 -- 172.21.15.5:0/798137990 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a1406c040 con 0x7f8a1415f690 2023-07-14T13:08:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a0bfff640 1 -- 172.21.15.5:0/798137990 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3642074069 0 0) 0x7f8a00003530 con 0x7f8a1406a440 2023-07-14T13:08:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a0bfff640 1 -- 172.21.15.5:0/798137990 >> v2:172.21.15.154:3300/0 conn(0x7f8a141453a0 msgr2=0x7f8a140b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a0bfff640 1 --2- 172.21.15.5:0/798137990 >> v2:172.21.15.154:3300/0 conn(0x7f8a141453a0 0x7f8a140b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a0bfff640 1 -- 172.21.15.5:0/798137990 >> v1:172.21.15.154:6789/0 conn(0x7f8a1415f690 legacy=0x7f8a1415fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:13.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a0bfff640 1 -- 172.21.15.5:0/798137990 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a14160360 con 0x7f8a1406a440 2023-07-14T13:08:13.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a0bfff640 1 -- 172.21.15.5:0/798137990 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f8a04001680 con 0x7f8a1406a440 2023-07-14T13:08:13.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a0bfff640 1 -- 172.21.15.5:0/798137990 >> v1:172.21.15.5:6789/0 conn(0x7f8a1406a440 legacy=0x7f8a1406c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:13.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a0bfff640 1 --2- 172.21.15.5:0/798137990 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a00003b10 0x7f8a00003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:13.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a0bfff640 1 --2- 172.21.15.5:0/798137990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a000047d0 0x7f8a00004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:13.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a0bfff640 1 --2- 172.21.15.5:0/798137990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a00005180 0x7f8a0000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:13.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a0bfff640 1 -- 172.21.15.5:0/798137990 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0000c060 con 0x7f8a00005180 2023-07-14T13:08:13.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a0bfff640 1 -- 172.21.15.5:0/798137990 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0000c1d0 con 0x7f8a000047d0 2023-07-14T13:08:13.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a0bfff640 1 -- 172.21.15.5:0/798137990 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0000c390 con 0x7f8a00003b10 2023-07-14T13:08:13.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a19de5640 1 --2- 172.21.15.5:0/798137990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a00005180 0x7f8a0000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:13.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a195e4640 1 --2- 172.21.15.5:0/798137990 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a00003b10 0x7f8a00003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:13.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a18de3640 1 --2- 172.21.15.5:0/798137990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a000047d0 0x7f8a00004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:13.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a19de5640 1 -- 172.21.15.5:0/798137990 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a00003b10 msgr2=0x7f8a00003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:13.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a19de5640 1 --2- 172.21.15.5:0/798137990 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a00003b10 0x7f8a00003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:13.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a19de5640 1 -- 172.21.15.5:0/798137990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a000047d0 msgr2=0x7f8a00004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a19de5640 1 --2- 172.21.15.5:0/798137990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a000047d0 0x7f8a00004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:12.996+0000 7f8a19de5640 1 -- 172.21.15.5:0/798137990 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a00003530 con 0x7f8a00005180 2023-07-14T13:08:13.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.000+0000 7f8a19de5640 1 -- 172.21.15.5:0/798137990 reap_dead start 2023-07-14T13:08:13.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.000+0000 7f8a19de5640 1 --2- 172.21.15.5:0/798137990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a00005180 0x7f8a0000b990 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009f90 tx=0x7f8a0c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6249266bd7cfcaa2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:13.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.000+0000 7f8a0bfff640 1 -- 172.21.15.5:0/798137990 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c0a5c70 con 0x7f8a00005180 2023-07-14T13:08:13.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.000+0000 7f8a0bfff640 1 -- 172.21.15.5:0/798137990 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0c00f040 con 0x7f8a00005180 2023-07-14T13:08:13.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.000+0000 7f8a0bfff640 1 -- 172.21.15.5:0/798137990 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c0039a0 con 0x7f8a00005180 2023-07-14T13:08:13.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.000+0000 7f8a1b848640 1 -- 172.21.15.5:0/798137990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a00005180 msgr2=0x7f8a0000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:13.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.000+0000 7f8a1b848640 1 --2- 172.21.15.5:0/798137990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a00005180 0x7f8a0000b990 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009f90 tx=0x7f8a0c01cc60 comp rx=0 tx=0).stop 2023-07-14T13:08:13.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.000+0000 7f8a1b848640 1 -- 172.21.15.5:0/798137990 shutdown_connections 2023-07-14T13:08:13.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.000+0000 7f8a1b848640 1 --2- 172.21.15.5:0/798137990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a00005180 0x7f8a0000b990 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:13.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.000+0000 7f8a1b848640 1 -- 172.21.15.5:0/798137990 >> 172.21.15.5:0/798137990 conn(0x7f8a140b1210 msgr2=0x7f8a140ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:13.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.000+0000 7f8a1b848640 1 -- 172.21.15.5:0/798137990 shutdown_connections 2023-07-14T13:08:13.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.000+0000 7f8a1b848640 1 -- 172.21.15.5:0/798137990 wait complete. 2023-07-14T13:08:13.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.004+0000 7f8a1b848640 1 Processor -- start 2023-07-14T13:08:13.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.004+0000 7f8a1b848640 1 -- start start 2023-07-14T13:08:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.004+0000 7f8a1b848640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a00005180 0x7f8a1415c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.004+0000 7f8a1b848640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a14131d00 0x7f8a14142f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.004+0000 7f8a1b848640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a140c3ad0 0x7f8a140c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.004+0000 7f8a1b848640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1412fc70 con 0x7f8a00005180 2023-07-14T13:08:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.004+0000 7f8a1b848640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1412eff0 con 0x7f8a14131d00 2023-07-14T13:08:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.004+0000 7f8a1b848640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1412f2d0 con 0x7f8a140c3ad0 2023-07-14T13:08:13.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.004+0000 7f8a195e4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a00005180 0x7f8a1415c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:13.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.004+0000 7f8a195e4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a00005180 0x7f8a1415c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33072/0 (socket says 172.21.15.5:33072) 2023-07-14T13:08:13.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.004+0000 7f8a195e4640 1 -- 172.21.15.5:0/3246075516 learned_addr learned my addr 172.21.15.5:0/3246075516 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:13.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.004+0000 7f8a19de5640 1 --2- 172.21.15.5:0/3246075516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a140c3ad0 0x7f8a140c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:13.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.004+0000 7f8a18de3640 1 --2- 172.21.15.5:0/3246075516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a14131d00 0x7f8a14142f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:13.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.004+0000 7f8a195e4640 1 -- 172.21.15.5:0/3246075516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a140c3ad0 msgr2=0x7f8a140c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:13.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.004+0000 7f8a195e4640 1 --2- 172.21.15.5:0/3246075516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a140c3ad0 0x7f8a140c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:13.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.004+0000 7f8a195e4640 1 -- 172.21.15.5:0/3246075516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a14131d00 msgr2=0x7f8a14142f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:13.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.004+0000 7f8a195e4640 1 --2- 172.21.15.5:0/3246075516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a14131d00 0x7f8a14142f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:13.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.004+0000 7f8a195e4640 1 -- 172.21.15.5:0/3246075516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1412f5b0 con 0x7f8a00005180 2023-07-14T13:08:13.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.004+0000 7f8a18de3640 1 --2- 172.21.15.5:0/3246075516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a14131d00 0x7f8a14142f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:13.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.004+0000 7f8a195e4640 1 --2- 172.21.15.5:0/3246075516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a00005180 0x7f8a1415c720 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f8a10012830 tx=0x7f8a10012cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:13.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.004+0000 7f8a09ffb640 1 -- 172.21.15.5:0/3246075516 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a10012ee0 con 0x7f8a00005180 2023-07-14T13:08:13.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.004+0000 7f8a09ffb640 1 -- 172.21.15.5:0/3246075516 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a10010bf0 con 0x7f8a00005180 2023-07-14T13:08:13.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.004+0000 7f8a1b848640 1 -- 172.21.15.5:0/3246075516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a1412f890 con 0x7f8a00005180 2023-07-14T13:08:13.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.004+0000 7f8a09ffb640 1 -- 172.21.15.5:0/3246075516 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a10016480 con 0x7f8a00005180 2023-07-14T13:08:13.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.004+0000 7f8a1b848640 1 -- 172.21.15.5:0/3246075516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a14143660 con 0x7f8a00005180 2023-07-14T13:08:13.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.008+0000 7f8a1b848640 1 -- 172.21.15.5:0/3246075516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a1412fdb0 con 0x7f8a00005180 2023-07-14T13:08:13.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.008+0000 7f8a09ffb640 1 -- 172.21.15.5:0/3246075516 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8a100165e0 con 0x7f8a00005180 2023-07-14T13:08:13.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.008+0000 7f8a09ffb640 1 --2- 172.21.15.5:0/3246075516 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f89f80663a0 0x7f89f8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:13.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.008+0000 7f8a09ffb640 1 -- 172.21.15.5:0/3246075516 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f8a10087770 con 0x7f8a00005180 2023-07-14T13:08:13.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.008+0000 7f8a18de3640 1 --2- 172.21.15.5:0/3246075516 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f89f80663a0 0x7f89f8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:13.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.008+0000 7f8a18de3640 1 --2- 172.21.15.5:0/3246075516 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f89f80663a0 0x7f89f8068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8a04001ec0 tx=0x7f8a04009040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:13.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.012+0000 7f8a09ffb640 1 -- 172.21.15.5:0/3246075516 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f8a1412fdb0 con 0x7f8a00005180 2023-07-14T13:08:13.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.168+0000 7f8a1b848640 1 -- 172.21.15.5:0/3246075516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8a1412fdb0 con 0x7f8a00005180 2023-07-14T13:08:13.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.828+0000 7f8a09ffb640 1 -- 172.21.15.5:0/3246075516 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v74) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8a1412fdb0 con 0x7f8a00005180 2023-07-14T13:08:13.863 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-07-14T13:08:13.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.832+0000 7f8a1b848640 1 -- 172.21.15.5:0/3246075516 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f89f80663a0 msgr2=0x7f89f8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:13.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.832+0000 7f8a1b848640 1 --2- 172.21.15.5:0/3246075516 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f89f80663a0 0x7f89f8068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8a04001ec0 tx=0x7f8a04009040 comp rx=0 tx=0).stop 2023-07-14T13:08:13.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.832+0000 7f8a1b848640 1 -- 172.21.15.5:0/3246075516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a00005180 msgr2=0x7f8a1415c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:13.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.832+0000 7f8a1b848640 1 --2- 172.21.15.5:0/3246075516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a00005180 0x7f8a1415c720 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f8a10012830 tx=0x7f8a10012cf0 comp rx=0 tx=0).stop 2023-07-14T13:08:13.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.832+0000 7f8a1b848640 1 -- 172.21.15.5:0/3246075516 shutdown_connections 2023-07-14T13:08:13.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.832+0000 7f8a1b848640 1 --2- 172.21.15.5:0/3246075516 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f89f80663a0 0x7f89f8068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:13.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.832+0000 7f8a1b848640 1 --2- 172.21.15.5:0/3246075516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a140c3ad0 0x7f8a140c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:13.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.832+0000 7f8a1b848640 1 --2- 172.21.15.5:0/3246075516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a14131d00 0x7f8a14142f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:13.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.832+0000 7f8a1b848640 1 --2- 172.21.15.5:0/3246075516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a00005180 0x7f8a1415c720 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:13.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.832+0000 7f8a1b848640 1 -- 172.21.15.5:0/3246075516 >> 172.21.15.5:0/3246075516 conn(0x7f8a140b1210 msgr2=0x7f8a140abd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:13.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.832+0000 7f8a1b848640 1 -- 172.21.15.5:0/3246075516 shutdown_connections 2023-07-14T13:08:13.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:13.832+0000 7f8a1b848640 1 -- 172.21.15.5:0/3246075516 wait complete. 2023-07-14T13:08:13.896 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-14T13:08:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.028+0000 7fcdf4234640 1 Processor -- start 2023-07-14T13:08:14.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.028+0000 7fcdf4234640 1 -- start start 2023-07-14T13:08:14.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.028+0000 7fcdf4234640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdec0d06b0 0x7fcdec0b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:14.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.028+0000 7fcdf4234640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcdec145430 0x7fcdec0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:14.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.028+0000 7fcdf4234640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdec0b2410 con 0x7fcdec0b1f70 2023-07-14T13:08:14.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.028+0000 7fcdf4234640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdec0b26f0 con 0x7fcdec145430 2023-07-14T13:08:14.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.028+0000 7fcdf4234640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec0b29d0 con 0x7fcdec0d06b0 2023-07-14T13:08:14.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.028+0000 7fcdf17cf640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcdec145430 0x7fcdec0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:14.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.028+0000 7fcdf27d1640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fcdec0b1f70 0x7fcdec0d22e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:45392/0 (socket says 172.21.15.5:45392) 2023-07-14T13:08:14.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.028+0000 7fcdf1fd0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdec0d06b0 0x7fcdec0b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:14.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.028+0000 7fcdf27d1640 1 -- 172.21.15.5:0/269679054 learned_addr learned my addr 172.21.15.5:0/269679054 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:14.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.028+0000 7fcdf0fce640 1 -- 172.21.15.5:0/269679054 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833214747 0 0) 0x7fcdec0b2410 con 0x7fcdec0b1f70 2023-07-14T13:08:14.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.028+0000 7fcdf1fd0640 1 -- 172.21.15.5:0/269679054 >> v2:172.21.15.154:3300/0 conn(0x7fcdec145430 msgr2=0x7fcdec0b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:14.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.028+0000 7fcdf1fd0640 1 --2- 172.21.15.5:0/269679054 >> v2:172.21.15.154:3300/0 conn(0x7fcdec145430 0x7fcdec0b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.028+0000 7fcdf1fd0640 1 -- 172.21.15.5:0/269679054 >> v1:172.21.15.154:6789/0 conn(0x7fcdec0b1f70 legacy=0x7fcdec0d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:14.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.028+0000 7fcdf1fd0640 1 -- 172.21.15.5:0/269679054 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdec0b2cb0 con 0x7fcdec0d06b0 2023-07-14T13:08:14.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.028+0000 7fcdf17cf640 1 --2- 172.21.15.5:0/269679054 >> v2:172.21.15.154:3300/0 conn(0x7fcdec145430 0x7fcdec0b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:14.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.032+0000 7fcdf1fd0640 1 --2- 172.21.15.5:0/269679054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdec0d06b0 0x7fcdec0b1a30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcde80097c0 tx=0x7fcde801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3772c33bc114df85 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.032+0000 7fcdf0fce640 1 -- 172.21.15.5:0/269679054 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde80ab670 con 0x7fcdec0d06b0 2023-07-14T13:08:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.032+0000 7fcdf0fce640 1 -- 172.21.15.5:0/269679054 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde80ab7d0 con 0x7fcdec0d06b0 2023-07-14T13:08:14.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.032+0000 7fcdf0fce640 1 -- 172.21.15.5:0/269679054 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde80abb60 con 0x7fcdec0d06b0 2023-07-14T13:08:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.032+0000 7fcdf4234640 1 -- 172.21.15.5:0/269679054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdec0d06b0 msgr2=0x7fcdec0b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.032+0000 7fcdf4234640 1 --2- 172.21.15.5:0/269679054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdec0d06b0 0x7fcdec0b1a30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcde80097c0 tx=0x7fcde801c450 comp rx=0 tx=0).stop 2023-07-14T13:08:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.032+0000 7fcdf4234640 1 -- 172.21.15.5:0/269679054 shutdown_connections 2023-07-14T13:08:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.032+0000 7fcdf4234640 1 --2- 172.21.15.5:0/269679054 >> v2:172.21.15.154:3300/0 conn(0x7fcdec145430 0x7fcdec0b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.032+0000 7fcdf4234640 1 --2- 172.21.15.5:0/269679054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdec0d06b0 0x7fcdec0b1a30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.032+0000 7fcdf4234640 1 -- 172.21.15.5:0/269679054 >> 172.21.15.5:0/269679054 conn(0x7fcdec0659d0 msgr2=0x7fcdec09b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:14.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.032+0000 7fcdf4234640 1 -- 172.21.15.5:0/269679054 shutdown_connections 2023-07-14T13:08:14.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.032+0000 7fcdf4234640 1 -- 172.21.15.5:0/269679054 wait complete. 2023-07-14T13:08:14.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.036+0000 7fcdf4234640 1 Processor -- start 2023-07-14T13:08:14.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.036+0000 7fcdf4234640 1 -- start start 2023-07-14T13:08:14.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.036+0000 7fcdf4234640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdec0b1f70 0x7fcdec0c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:14.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.036+0000 7fcdf4234640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdec0d06b0 0x7fcdec156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:14.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.036+0000 7fcdf4234640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdec15e390 0x7fcdec156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:14.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.036+0000 7fcdf4234640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec154180 con 0x7fcdec15e390 2023-07-14T13:08:14.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.036+0000 7fcdf4234640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec0c8bc0 con 0x7fcdec0d06b0 2023-07-14T13:08:14.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.036+0000 7fcdf4234640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec0c5f20 con 0x7fcdec0b1f70 2023-07-14T13:08:14.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.036+0000 7fcdf27d1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdec15e390 0x7fcdec156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:14.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.036+0000 7fcdf27d1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdec15e390 0x7fcdec156f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33076/0 (socket says 172.21.15.5:33076) 2023-07-14T13:08:14.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.036+0000 7fcdf27d1640 1 -- 172.21.15.5:0/4098359279 learned_addr learned my addr 172.21.15.5:0/4098359279 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:14.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.036+0000 7fcdf1fd0640 1 --2- 172.21.15.5:0/4098359279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdec0b1f70 0x7fcdec0c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:14.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.036+0000 7fcdf17cf640 1 --2- 172.21.15.5:0/4098359279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdec0d06b0 0x7fcdec156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:14.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.036+0000 7fcdf27d1640 1 -- 172.21.15.5:0/4098359279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdec0b1f70 msgr2=0x7fcdec0c51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:14.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.036+0000 7fcdf27d1640 1 --2- 172.21.15.5:0/4098359279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdec0b1f70 0x7fcdec0c51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.036+0000 7fcdf27d1640 1 -- 172.21.15.5:0/4098359279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdec0d06b0 msgr2=0x7fcdec156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:14.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.036+0000 7fcdf27d1640 1 --2- 172.21.15.5:0/4098359279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdec0d06b0 0x7fcdec156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.036+0000 7fcdf27d1640 1 -- 172.21.15.5:0/4098359279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcddc009420 con 0x7fcdec15e390 2023-07-14T13:08:14.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.036+0000 7fcdf1fd0640 1 --2- 172.21.15.5:0/4098359279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdec0b1f70 0x7fcdec0c51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.036+0000 7fcdf27d1640 1 --2- 172.21.15.5:0/4098359279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdec15e390 0x7fcdec156f90 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fcde400c780 tx=0x7fcde400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.036+0000 7fcde27fc640 1 -- 172.21.15.5:0/4098359279 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde400ce90 con 0x7fcdec15e390 2023-07-14T13:08:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.036+0000 7fcde27fc640 1 -- 172.21.15.5:0/4098359279 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde400a640 con 0x7fcdec15e390 2023-07-14T13:08:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.036+0000 7fcde27fc640 1 -- 172.21.15.5:0/4098359279 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde400a9d0 con 0x7fcdec15e390 2023-07-14T13:08:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.036+0000 7fcdf4234640 1 -- 172.21.15.5:0/4098359279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde8009420 con 0x7fcdec15e390 2023-07-14T13:08:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.036+0000 7fcdf4234640 1 -- 172.21.15.5:0/4098359279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdec0c64e0 con 0x7fcdec15e390 2023-07-14T13:08:14.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.040+0000 7fcdf4234640 1 -- 172.21.15.5:0/4098359279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdec072e70 con 0x7fcdec15e390 2023-07-14T13:08:14.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.040+0000 7fcde27fc640 1 -- 172.21.15.5:0/4098359279 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcde400ab30 con 0x7fcdec15e390 2023-07-14T13:08:14.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.040+0000 7fcde27fc640 1 --2- 172.21.15.5:0/4098359279 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fcdd00663d0 0x7fcdd0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:14.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.040+0000 7fcde27fc640 1 -- 172.21.15.5:0/4098359279 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fcde4083210 con 0x7fcdec15e390 2023-07-14T13:08:14.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.040+0000 7fcdf1fd0640 1 --2- 172.21.15.5:0/4098359279 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fcdd00663d0 0x7fcdd0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:14.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.044+0000 7fcdf1fd0640 1 --2- 172.21.15.5:0/4098359279 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fcdd00663d0 0x7fcdd0068880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcde80af000 tx=0x7fcde80a7000 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:14.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.044+0000 7fcde27fc640 1 -- 172.21.15.5:0/4098359279 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fcde40505e0 con 0x7fcdec15e390 2023-07-14T13:08:14.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.204+0000 7fcdf4234640 1 -- 172.21.15.5:0/4098359279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fcdec0678d0 con 0x7fcdec15e390 2023-07-14T13:08:14.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.208+0000 7fcde27fc640 1 -- 172.21.15.5:0/4098359279 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v19) v1 ==== 120+0+0 (secure 0 0 0) 0x7fcde4053c00 con 0x7fcdec15e390 2023-07-14T13:08:14.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.208+0000 7fcdf4234640 1 -- 172.21.15.5:0/4098359279 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fcdd00663d0 msgr2=0x7fcdd0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:14.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.208+0000 7fcdf4234640 1 --2- 172.21.15.5:0/4098359279 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fcdd00663d0 0x7fcdd0068880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcde80af000 tx=0x7fcde80a7000 comp rx=0 tx=0).stop 2023-07-14T13:08:14.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.208+0000 7fcdf4234640 1 -- 172.21.15.5:0/4098359279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdec15e390 msgr2=0x7fcdec156f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:14.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.208+0000 7fcdf4234640 1 --2- 172.21.15.5:0/4098359279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdec15e390 0x7fcdec156f90 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fcde400c780 tx=0x7fcde400cc40 comp rx=0 tx=0).stop 2023-07-14T13:08:14.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.208+0000 7fcdf4234640 1 -- 172.21.15.5:0/4098359279 shutdown_connections 2023-07-14T13:08:14.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.208+0000 7fcdf4234640 1 --2- 172.21.15.5:0/4098359279 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fcdd00663d0 0x7fcdd0068880 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.208+0000 7fcdf4234640 1 --2- 172.21.15.5:0/4098359279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdec15e390 0x7fcdec156f90 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.208+0000 7fcdf4234640 1 --2- 172.21.15.5:0/4098359279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdec0d06b0 0x7fcdec156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.208+0000 7fcdf4234640 1 --2- 172.21.15.5:0/4098359279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdec0b1f70 0x7fcdec0c51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.208+0000 7fcdf4234640 1 -- 172.21.15.5:0/4098359279 >> 172.21.15.5:0/4098359279 conn(0x7fcdec0659d0 msgr2=0x7fcdec15c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:14.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.208+0000 7fcdf4234640 1 -- 172.21.15.5:0/4098359279 shutdown_connections 2023-07-14T13:08:14.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.208+0000 7fcdf4234640 1 -- 172.21.15.5:0/4098359279 wait complete. 2023-07-14T13:08:14.262 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-14T13:08:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.376+0000 7f16e2ffa640 1 Processor -- start 2023-07-14T13:08:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.376+0000 7f16e2ffa640 1 -- start start 2023-07-14T13:08:14.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.376+0000 7f16e2ffa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f16dc159a70 0x7f16dc0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:14.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.376+0000 7f16e2ffa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f16dc15e060 0x7f16dc070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:14.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.376+0000 7f16e2ffa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16dc070e60 0x7f16dc0c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:14.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.376+0000 7f16e2ffa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16dc0cbe50 con 0x7f16dc15e060 2023-07-14T13:08:14.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.376+0000 7f16e2ffa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16dc0cd660 con 0x7f16dc159a70 2023-07-14T13:08:14.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.376+0000 7f16e2ffa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc0cc0a0 con 0x7f16dc070e60 2023-07-14T13:08:14.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.376+0000 7f16dbfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f16dc15e060 0x7f16dc070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:14.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.376+0000 7f16dbfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f16dc15e060 0x7f16dc070920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33088/0 (socket says 172.21.15.5:33088) 2023-07-14T13:08:14.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.376+0000 7f16dbfff640 1 -- 172.21.15.5:0/1081956613 learned_addr learned my addr 172.21.15.5:0/1081956613 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:14.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.376+0000 7f16e0d96640 1 --2- 172.21.15.5:0/1081956613 >> v2:172.21.15.154:3300/0 conn(0x7f16dc159a70 0x7f16dc0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:14.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.376+0000 7f16e1597640 1 --2- 172.21.15.5:0/1081956613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16dc070e60 0x7f16dc0c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.376+0000 7f16dbfff640 1 -- 172.21.15.5:0/1081956613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16dc070e60 msgr2=0x7f16dc0c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.376+0000 7f16dbfff640 1 --2- 172.21.15.5:0/1081956613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16dc070e60 0x7f16dc0c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.376+0000 7f16dbfff640 1 -- 172.21.15.5:0/1081956613 >> v2:172.21.15.154:3300/0 conn(0x7f16dc159a70 msgr2=0x7f16dc0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.376+0000 7f16dbfff640 1 --2- 172.21.15.5:0/1081956613 >> v2:172.21.15.154:3300/0 conn(0x7f16dc159a70 0x7f16dc0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.376+0000 7f16dbfff640 1 -- 172.21.15.5:0/1081956613 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc0cc380 con 0x7f16dc15e060 2023-07-14T13:08:14.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.380+0000 7f16dbfff640 1 --2- 172.21.15.5:0/1081956613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16dc15e060 0x7f16dc070920 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f16dc071b50 tx=0x7f16c801cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4b809d6ea48a40 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:14.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.380+0000 7f16db7fe640 1 -- 172.21.15.5:0/1081956613 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c80ab600 con 0x7f16dc15e060 2023-07-14T13:08:14.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.380+0000 7f16db7fe640 1 -- 172.21.15.5:0/1081956613 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c80a7050 con 0x7f16dc15e060 2023-07-14T13:08:14.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.380+0000 7f16db7fe640 1 -- 172.21.15.5:0/1081956613 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c80ab980 con 0x7f16dc15e060 2023-07-14T13:08:14.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.380+0000 7f16e2ffa640 1 -- 172.21.15.5:0/1081956613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16dc15e060 msgr2=0x7f16dc070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.380+0000 7f16e2ffa640 1 --2- 172.21.15.5:0/1081956613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16dc15e060 0x7f16dc070920 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f16dc071b50 tx=0x7f16c801cb50 comp rx=0 tx=0).stop 2023-07-14T13:08:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.380+0000 7f16e2ffa640 1 -- 172.21.15.5:0/1081956613 shutdown_connections 2023-07-14T13:08:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.380+0000 7f16e2ffa640 1 --2- 172.21.15.5:0/1081956613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16dc070e60 0x7f16dc0c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.380+0000 7f16e2ffa640 1 --2- 172.21.15.5:0/1081956613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16dc15e060 0x7f16dc070920 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.380+0000 7f16e2ffa640 1 --2- 172.21.15.5:0/1081956613 >> v2:172.21.15.154:3300/0 conn(0x7f16dc159a70 0x7f16dc0ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.380+0000 7f16e2ffa640 1 -- 172.21.15.5:0/1081956613 >> 172.21.15.5:0/1081956613 conn(0x7f16dc0afac0 msgr2=0x7f16dc0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:14.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.380+0000 7f16e2ffa640 1 -- 172.21.15.5:0/1081956613 shutdown_connections 2023-07-14T13:08:14.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.380+0000 7f16e2ffa640 1 -- 172.21.15.5:0/1081956613 wait complete. 2023-07-14T13:08:14.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.380+0000 7f16e2ffa640 1 Processor -- start 2023-07-14T13:08:14.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.380+0000 7f16e2ffa640 1 -- start start 2023-07-14T13:08:14.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.384+0000 7f16e2ffa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16dc070e60 0x7f16dc1555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:14.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.384+0000 7f16e2ffa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16dc159a70 0x7f16dc14bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:14.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.384+0000 7f16e2ffa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16dc15e060 0x7f16dc0c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:14.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.384+0000 7f16e2ffa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc14fdd0 con 0x7f16dc159a70 2023-07-14T13:08:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.384+0000 7f16e2ffa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc14e950 con 0x7f16dc15e060 2023-07-14T13:08:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.384+0000 7f16e2ffa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc154370 con 0x7f16dc070e60 2023-07-14T13:08:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.384+0000 7f16dbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16dc159a70 0x7f16dc14bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.384+0000 7f16dbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16dc159a70 0x7f16dc14bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33096/0 (socket says 172.21.15.5:33096) 2023-07-14T13:08:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.384+0000 7f16dbfff640 1 -- 172.21.15.5:0/1263659620 learned_addr learned my addr 172.21.15.5:0/1263659620 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.384+0000 7f16e0d96640 1 --2- 172.21.15.5:0/1263659620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16dc070e60 0x7f16dc1555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:14.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.384+0000 7f16e1597640 1 --2- 172.21.15.5:0/1263659620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16dc15e060 0x7f16dc0c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.384+0000 7f16dbfff640 1 -- 172.21.15.5:0/1263659620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16dc070e60 msgr2=0x7f16dc1555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:14.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.384+0000 7f16dbfff640 1 --2- 172.21.15.5:0/1263659620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16dc070e60 0x7f16dc1555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.384+0000 7f16dbfff640 1 -- 172.21.15.5:0/1263659620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16dc15e060 msgr2=0x7f16dc0c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.384+0000 7f16dbfff640 1 --2- 172.21.15.5:0/1263659620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16dc15e060 0x7f16dc0c66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.384+0000 7f16dbfff640 1 -- 172.21.15.5:0/1263659620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c80094d0 con 0x7f16dc159a70 2023-07-14T13:08:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.384+0000 7f16dbfff640 1 --2- 172.21.15.5:0/1263659620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16dc159a70 0x7f16dc14bc10 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f16c801a7a0 tx=0x7f16c8018e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.384+0000 7f16d97fa640 1 -- 172.21.15.5:0/1263659620 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c80b5850 con 0x7f16dc159a70 2023-07-14T13:08:14.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.384+0000 7f16d97fa640 1 -- 172.21.15.5:0/1263659620 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c80b59b0 con 0x7f16dc159a70 2023-07-14T13:08:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.384+0000 7f16d97fa640 1 -- 172.21.15.5:0/1263659620 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c80b5d60 con 0x7f16dc159a70 2023-07-14T13:08:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.384+0000 7f16e2ffa640 1 -- 172.21.15.5:0/1263659620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16dc154650 con 0x7f16dc159a70 2023-07-14T13:08:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.384+0000 7f16e2ffa640 1 -- 172.21.15.5:0/1263659620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16dc155c50 con 0x7f16dc159a70 2023-07-14T13:08:14.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.384+0000 7f16e2ffa640 1 -- 172.21.15.5:0/1263659620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16dc14ff40 con 0x7f16dc159a70 2023-07-14T13:08:14.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.388+0000 7f16d97fa640 1 -- 172.21.15.5:0/1263659620 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f16c80be410 con 0x7f16dc159a70 2023-07-14T13:08:14.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.388+0000 7f16d97fa640 1 --2- 172.21.15.5:0/1263659620 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f16c00663a0 0x7f16c0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:14.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.388+0000 7f16d97fa640 1 -- 172.21.15.5:0/1263659620 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f16c811e620 con 0x7f16dc159a70 2023-07-14T13:08:14.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.388+0000 7f16e0d96640 1 --2- 172.21.15.5:0/1263659620 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f16c00663a0 0x7f16c0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:14.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.388+0000 7f16e0d96640 1 --2- 172.21.15.5:0/1263659620 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f16c00663a0 0x7f16c0068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f16d0007a60 tx=0x7f16d0008040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.392+0000 7f16d97fa640 1 -- 172.21.15.5:0/1263659620 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f16dc14ff40 con 0x7f16dc159a70 2023-07-14T13:08:14.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.548+0000 7f16e2ffa640 1 -- 172.21.15.5:0/1263659620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f16dc14ff10 con 0x7f16dc159a70 2023-07-14T13:08:14.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.552+0000 7f16d97fa640 1 -- 172.21.15.5:0/1263659620 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f16c80eba10 con 0x7f16dc159a70 2023-07-14T13:08:14.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.556+0000 7f16e2ffa640 1 -- 172.21.15.5:0/1263659620 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f16c00663a0 msgr2=0x7f16c0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:14.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.556+0000 7f16e2ffa640 1 --2- 172.21.15.5:0/1263659620 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f16c00663a0 0x7f16c0068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f16d0007a60 tx=0x7f16d0008040 comp rx=0 tx=0).stop 2023-07-14T13:08:14.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.556+0000 7f16e2ffa640 1 -- 172.21.15.5:0/1263659620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16dc159a70 msgr2=0x7f16dc14bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.556+0000 7f16e2ffa640 1 --2- 172.21.15.5:0/1263659620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16dc159a70 0x7f16dc14bc10 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f16c801a7a0 tx=0x7f16c8018e90 comp rx=0 tx=0).stop 2023-07-14T13:08:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.556+0000 7f16e2ffa640 1 -- 172.21.15.5:0/1263659620 shutdown_connections 2023-07-14T13:08:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.556+0000 7f16e2ffa640 1 --2- 172.21.15.5:0/1263659620 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f16c00663a0 0x7f16c0068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.556+0000 7f16e2ffa640 1 --2- 172.21.15.5:0/1263659620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16dc15e060 0x7f16dc0c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.556+0000 7f16e2ffa640 1 --2- 172.21.15.5:0/1263659620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16dc159a70 0x7f16dc14bc10 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.556+0000 7f16e2ffa640 1 --2- 172.21.15.5:0/1263659620 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16dc070e60 0x7f16dc1555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.556+0000 7f16e2ffa640 1 -- 172.21.15.5:0/1263659620 >> 172.21.15.5:0/1263659620 conn(0x7f16dc0afac0 msgr2=0x7f16dc0caec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:14.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.556+0000 7f16e2ffa640 1 -- 172.21.15.5:0/1263659620 shutdown_connections 2023-07-14T13:08:14.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.556+0000 7f16e2ffa640 1 -- 172.21.15.5:0/1263659620 wait complete. 2023-07-14T13:08:14.608 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-14T13:08:14.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.720+0000 7fab7a340640 1 Processor -- start 2023-07-14T13:08:14.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.720+0000 7fab7a340640 1 -- start start 2023-07-14T13:08:14.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.724+0000 7fab7a340640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab7406cf10 0x7fab7415c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:14.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.724+0000 7fab7a340640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fab740ca980 0x7fab740c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:14.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.724+0000 7fab7a340640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fab740cadd0 0x7fab740c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:14.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.724+0000 7fab7a340640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab741595a0 con 0x7fab740cadd0 2023-07-14T13:08:14.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.724+0000 7fab7a340640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab7415cc70 con 0x7fab740ca980 2023-07-14T13:08:14.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.724+0000 7fab7a340640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab741586e0 con 0x7fab7406cf10 2023-07-14T13:08:14.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.724+0000 7fab788dd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fab740cadd0 0x7fab740c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:14.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.724+0000 7fab788dd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fab740cadd0 0x7fab740c8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33102/0 (socket says 172.21.15.5:33102) 2023-07-14T13:08:14.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.724+0000 7fab788dd640 1 -- 172.21.15.5:0/2736411614 learned_addr learned my addr 172.21.15.5:0/2736411614 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:14.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.724+0000 7fab737fe640 1 --2- 172.21.15.5:0/2736411614 >> v2:172.21.15.154:3300/0 conn(0x7fab740ca980 0x7fab740c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:14.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.724+0000 7fab73fff640 1 --2- 172.21.15.5:0/2736411614 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab7406cf10 0x7fab7415c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:14.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.724+0000 7fab788dd640 1 -- 172.21.15.5:0/2736411614 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab7406cf10 msgr2=0x7fab7415c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:14.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.724+0000 7fab788dd640 1 --2- 172.21.15.5:0/2736411614 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab7406cf10 0x7fab7415c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.724+0000 7fab788dd640 1 -- 172.21.15.5:0/2736411614 >> v2:172.21.15.154:3300/0 conn(0x7fab740ca980 msgr2=0x7fab740c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:14.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.724+0000 7fab788dd640 1 --2- 172.21.15.5:0/2736411614 >> v2:172.21.15.154:3300/0 conn(0x7fab740ca980 0x7fab740c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.724+0000 7fab788dd640 1 -- 172.21.15.5:0/2736411614 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab741560a0 con 0x7fab740cadd0 2023-07-14T13:08:14.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.724+0000 7fab788dd640 1 --2- 172.21.15.5:0/2736411614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab740cadd0 0x7fab740c8ae0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fab74071ae0 tx=0x7fab6c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db185905ca9b3ef6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:14.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.724+0000 7fab72ffd640 1 -- 172.21.15.5:0/2736411614 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c0a56b0 con 0x7fab740cadd0 2023-07-14T13:08:14.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.724+0000 7fab72ffd640 1 -- 172.21.15.5:0/2736411614 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6c0a5810 con 0x7fab740cadd0 2023-07-14T13:08:14.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.724+0000 7fab72ffd640 1 -- 172.21.15.5:0/2736411614 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c0a5ba0 con 0x7fab740cadd0 2023-07-14T13:08:14.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.728+0000 7fab7a340640 1 -- 172.21.15.5:0/2736411614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab740cadd0 msgr2=0x7fab740c8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:14.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.728+0000 7fab7a340640 1 --2- 172.21.15.5:0/2736411614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab740cadd0 0x7fab740c8ae0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fab74071ae0 tx=0x7fab6c01c940 comp rx=0 tx=0).stop 2023-07-14T13:08:14.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.728+0000 7fab7a340640 1 -- 172.21.15.5:0/2736411614 shutdown_connections 2023-07-14T13:08:14.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.728+0000 7fab7a340640 1 --2- 172.21.15.5:0/2736411614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab740cadd0 0x7fab740c8ae0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.728+0000 7fab7a340640 1 --2- 172.21.15.5:0/2736411614 >> v2:172.21.15.154:3300/0 conn(0x7fab740ca980 0x7fab740c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.728+0000 7fab7a340640 1 --2- 172.21.15.5:0/2736411614 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab7406cf10 0x7fab7415c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.728+0000 7fab7a340640 1 -- 172.21.15.5:0/2736411614 >> 172.21.15.5:0/2736411614 conn(0x7fab740afac0 msgr2=0x7fab740afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:14.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.728+0000 7fab7a340640 1 -- 172.21.15.5:0/2736411614 shutdown_connections 2023-07-14T13:08:14.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.728+0000 7fab7a340640 1 -- 172.21.15.5:0/2736411614 wait complete. 2023-07-14T13:08:14.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.728+0000 7fab7a340640 1 Processor -- start 2023-07-14T13:08:14.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.728+0000 7fab7a340640 1 -- start start 2023-07-14T13:08:14.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.728+0000 7fab7a340640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7406cf10 0x7fab741522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:14.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.728+0000 7fab7a340640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab740ca980 0x7fab7414eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:14.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.728+0000 7fab7a340640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab740cadd0 0x7fab741f2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:14.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.728+0000 7fab7a340640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab741f3a80 con 0x7fab7406cf10 2023-07-14T13:08:14.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.728+0000 7fab7a340640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab740b1040 con 0x7fab740cadd0 2023-07-14T13:08:14.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.728+0000 7fab7a340640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab741f2f40 con 0x7fab740ca980 2023-07-14T13:08:14.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.728+0000 7fab73fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7406cf10 0x7fab741522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:14.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.728+0000 7fab73fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7406cf10 0x7fab741522a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33104/0 (socket says 172.21.15.5:33104) 2023-07-14T13:08:14.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.728+0000 7fab73fff640 1 -- 172.21.15.5:0/450667313 learned_addr learned my addr 172.21.15.5:0/450667313 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:14.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.728+0000 7fab788dd640 1 --2- 172.21.15.5:0/450667313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab740cadd0 0x7fab741f2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:14.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.728+0000 7fab737fe640 1 --2- 172.21.15.5:0/450667313 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab740ca980 0x7fab7414eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:14.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.732+0000 7fab73fff640 1 -- 172.21.15.5:0/450667313 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab740ca980 msgr2=0x7fab7414eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:14.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.732+0000 7fab73fff640 1 --2- 172.21.15.5:0/450667313 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab740ca980 0x7fab7414eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.732+0000 7fab73fff640 1 -- 172.21.15.5:0/450667313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab740cadd0 msgr2=0x7fab741f2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:14.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.732+0000 7fab73fff640 1 --2- 172.21.15.5:0/450667313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab740cadd0 0x7fab741f2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.732+0000 7fab73fff640 1 -- 172.21.15.5:0/450667313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c009b30 con 0x7fab7406cf10 2023-07-14T13:08:14.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.732+0000 7fab788dd640 1 --2- 172.21.15.5:0/450667313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab740cadd0 0x7fab741f2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:14.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.732+0000 7fab73fff640 1 --2- 172.21.15.5:0/450667313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7406cf10 0x7fab741522a0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fab6400d830 tx=0x7fab6400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:14.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.732+0000 7fab70ff9640 1 -- 172.21.15.5:0/450667313 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab640096a0 con 0x7fab7406cf10 2023-07-14T13:08:14.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.732+0000 7fab70ff9640 1 -- 172.21.15.5:0/450667313 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab64009800 con 0x7fab7406cf10 2023-07-14T13:08:14.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.732+0000 7fab70ff9640 1 -- 172.21.15.5:0/450667313 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab64009b70 con 0x7fab7406cf10 2023-07-14T13:08:14.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.732+0000 7fab7a340640 1 -- 172.21.15.5:0/450667313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab741f31e0 con 0x7fab7406cf10 2023-07-14T13:08:14.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.732+0000 7fab7a340640 1 -- 172.21.15.5:0/450667313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab741f37a0 con 0x7fab7406cf10 2023-07-14T13:08:14.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.732+0000 7fab7a340640 1 -- 172.21.15.5:0/450667313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab740c9b40 con 0x7fab7406cf10 2023-07-14T13:08:14.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.732+0000 7fab70ff9640 1 -- 172.21.15.5:0/450667313 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fab64014410 con 0x7fab7406cf10 2023-07-14T13:08:14.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.732+0000 7fab70ff9640 1 --2- 172.21.15.5:0/450667313 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fab600663d0 0x7fab60068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:14.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.736+0000 7fab70ff9640 1 -- 172.21.15.5:0/450667313 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fab64084780 con 0x7fab7406cf10 2023-07-14T13:08:14.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.736+0000 7fab737fe640 1 --2- 172.21.15.5:0/450667313 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fab600663d0 0x7fab60068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:14.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.736+0000 7fab737fe640 1 --2- 172.21.15.5:0/450667313 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fab600663d0 0x7fab60068880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fab741547d0 tx=0x7fab68008040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:14.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.736+0000 7fab70ff9640 1 -- 172.21.15.5:0/450667313 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fab64051b50 con 0x7fab7406cf10 2023-07-14T13:08:14.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.896+0000 7fab7a340640 1 -- 172.21.15.5:0/450667313 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fab740b0dc0 con 0x7fab7406cf10 2023-07-14T13:08:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.900+0000 7fab70ff9640 1 -- 172.21.15.5:0/450667313 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v21) v1 ==== 115+0+0 (secure 0 0 0) 0x7fab64055170 con 0x7fab7406cf10 2023-07-14T13:08:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.904+0000 7fab7a340640 1 -- 172.21.15.5:0/450667313 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fab600663d0 msgr2=0x7fab60068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.904+0000 7fab7a340640 1 --2- 172.21.15.5:0/450667313 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fab600663d0 0x7fab60068880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fab741547d0 tx=0x7fab68008040 comp rx=0 tx=0).stop 2023-07-14T13:08:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.904+0000 7fab7a340640 1 -- 172.21.15.5:0/450667313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7406cf10 msgr2=0x7fab741522a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:14.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.904+0000 7fab7a340640 1 --2- 172.21.15.5:0/450667313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7406cf10 0x7fab741522a0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fab6400d830 tx=0x7fab6400dcf0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.904+0000 7fab7a340640 1 -- 172.21.15.5:0/450667313 shutdown_connections 2023-07-14T13:08:14.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.904+0000 7fab7a340640 1 --2- 172.21.15.5:0/450667313 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fab600663d0 0x7fab60068880 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.904+0000 7fab7a340640 1 --2- 172.21.15.5:0/450667313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab740cadd0 0x7fab741f2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.904+0000 7fab7a340640 1 --2- 172.21.15.5:0/450667313 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab740ca980 0x7fab7414eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.904+0000 7fab7a340640 1 --2- 172.21.15.5:0/450667313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7406cf10 0x7fab741522a0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:14.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.904+0000 7fab7a340640 1 -- 172.21.15.5:0/450667313 >> 172.21.15.5:0/450667313 conn(0x7fab740afac0 msgr2=0x7fab740cc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:14.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.904+0000 7fab7a340640 1 -- 172.21.15.5:0/450667313 shutdown_connections 2023-07-14T13:08:14.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:14.904+0000 7fab7a340640 1 -- 172.21.15.5:0/450667313 wait complete. 2023-07-14T13:08:14.956 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-07-14T13:08:15.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.068+0000 7f564c434640 1 Processor -- start 2023-07-14T13:08:15.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.068+0000 7f564c434640 1 -- start start 2023-07-14T13:08:15.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.068+0000 7f564c434640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f564406a540 0x7f564406a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:15.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.068+0000 7f564c434640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f56440ca750 0x7f56440cab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:15.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.068+0000 7f564c434640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f564406ae50 con 0x7f56440cdcd0 2023-07-14T13:08:15.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.068+0000 7f564c434640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56440cef10 con 0x7f564406a540 2023-07-14T13:08:15.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.068+0000 7f564c434640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56440cfaf0 con 0x7f56440ca750 2023-07-14T13:08:15.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.068+0000 7f564a1d0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f564406a540 0x7f564406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:15.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.068+0000 7f564a1d0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f564406a540 0x7f564406a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33110/0 (socket says 172.21.15.5:33110) 2023-07-14T13:08:15.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.068+0000 7f564a1d0640 1 -- 172.21.15.5:0/145583144 learned_addr learned my addr 172.21.15.5:0/145583144 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:15.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.068+0000 7f564a9d1640 1 --2- 172.21.15.5:0/145583144 >> v2:172.21.15.154:3300/0 conn(0x7f56440ca750 0x7f56440cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:15.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.068+0000 7f564a1d0640 1 -- 172.21.15.5:0/145583144 >> v2:172.21.15.154:3300/0 conn(0x7f56440ca750 msgr2=0x7f56440cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:15.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.068+0000 7f564a1d0640 1 --2- 172.21.15.5:0/145583144 >> v2:172.21.15.154:3300/0 conn(0x7f56440ca750 0x7f56440cab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:15.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.068+0000 7f564a1d0640 1 -- 172.21.15.5:0/145583144 >> v1:172.21.15.154:6789/0 conn(0x7f56440cdcd0 legacy=0x7f56440cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:15.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.068+0000 7f564a1d0640 1 -- 172.21.15.5:0/145583144 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56440cfdd0 con 0x7f564406a540 2023-07-14T13:08:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.072+0000 7f564a1d0640 1 --2- 172.21.15.5:0/145583144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f564406a540 0x7f564406a910 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f5644069f40 tx=0x7f564001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef7c4c69d51cc7a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.072+0000 7f56491ce640 1 -- 172.21.15.5:0/145583144 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56400a89b0 con 0x7f564406a540 2023-07-14T13:08:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.072+0000 7f56491ce640 1 -- 172.21.15.5:0/145583144 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56400a8b10 con 0x7f564406a540 2023-07-14T13:08:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.072+0000 7f56491ce640 1 -- 172.21.15.5:0/145583144 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56400a8ea0 con 0x7f564406a540 2023-07-14T13:08:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.072+0000 7f564c434640 1 -- 172.21.15.5:0/145583144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f564406a540 msgr2=0x7f564406a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.072+0000 7f564c434640 1 --2- 172.21.15.5:0/145583144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f564406a540 0x7f564406a910 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f5644069f40 tx=0x7f564001ecb0 comp rx=0 tx=0).stop 2023-07-14T13:08:15.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.072+0000 7f564c434640 1 -- 172.21.15.5:0/145583144 shutdown_connections 2023-07-14T13:08:15.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.072+0000 7f564c434640 1 --2- 172.21.15.5:0/145583144 >> v2:172.21.15.154:3300/0 conn(0x7f56440ca750 0x7f56440cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:15.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.072+0000 7f564c434640 1 --2- 172.21.15.5:0/145583144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f564406a540 0x7f564406a910 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:15.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.072+0000 7f564c434640 1 -- 172.21.15.5:0/145583144 >> 172.21.15.5:0/145583144 conn(0x7f5644099490 msgr2=0x7f5644089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.072+0000 7f564c434640 1 -- 172.21.15.5:0/145583144 shutdown_connections 2023-07-14T13:08:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.072+0000 7f564c434640 1 -- 172.21.15.5:0/145583144 wait complete. 2023-07-14T13:08:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.076+0000 7f564c434640 1 Processor -- start 2023-07-14T13:08:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.076+0000 7f564c434640 1 -- start start 2023-07-14T13:08:15.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.076+0000 7f564c434640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f564406a540 0x7f56441f1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:15.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.076+0000 7f564c434640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56440ca750 0x7f56440c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:15.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.076+0000 7f564c434640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56440cdcd0 0x7f56440c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:15.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.076+0000 7f564c434640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56440ca1b0 con 0x7f564406a540 2023-07-14T13:08:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.076+0000 7f564c434640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564415ede0 con 0x7f56440ca750 2023-07-14T13:08:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.076+0000 7f564c434640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56441f1a00 con 0x7f56440cdcd0 2023-07-14T13:08:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.076+0000 7f564a1d0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f564406a540 0x7f56441f1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.076+0000 7f564a1d0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f564406a540 0x7f56441f1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33114/0 (socket says 172.21.15.5:33114) 2023-07-14T13:08:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.076+0000 7f564a1d0640 1 -- 172.21.15.5:0/3972439758 learned_addr learned my addr 172.21.15.5:0/3972439758 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.076+0000 7f56499cf640 1 --2- 172.21.15.5:0/3972439758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56440ca750 0x7f56440c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.076+0000 7f564a9d1640 1 --2- 172.21.15.5:0/3972439758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56440cdcd0 0x7f56440c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:15.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.076+0000 7f564a1d0640 1 -- 172.21.15.5:0/3972439758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56440cdcd0 msgr2=0x7f56440c3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.076+0000 7f564a1d0640 1 --2- 172.21.15.5:0/3972439758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56440cdcd0 0x7f56440c3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.076+0000 7f564a1d0640 1 -- 172.21.15.5:0/3972439758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56440ca750 msgr2=0x7f56440c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.076+0000 7f564a1d0640 1 --2- 172.21.15.5:0/3972439758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56440ca750 0x7f56440c9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.076+0000 7f564a1d0640 1 -- 172.21.15.5:0/3972439758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5640009480 con 0x7f564406a540 2023-07-14T13:08:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.076+0000 7f56499cf640 1 --2- 172.21.15.5:0/3972439758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56440ca750 0x7f56440c9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.076+0000 7f564a1d0640 1 --2- 172.21.15.5:0/3972439758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f564406a540 0x7f56441f1300 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f564001d360 tx=0x7f564001ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:15.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.076+0000 7f563affd640 1 -- 172.21.15.5:0/3972439758 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5640005ba0 con 0x7f564406a540 2023-07-14T13:08:15.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.076+0000 7f563affd640 1 -- 172.21.15.5:0/3972439758 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5640005d00 con 0x7f564406a540 2023-07-14T13:08:15.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.076+0000 7f563affd640 1 -- 172.21.15.5:0/3972439758 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5640006220 con 0x7f564406a540 2023-07-14T13:08:15.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.076+0000 7f564c434640 1 -- 172.21.15.5:0/3972439758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56441f1ce0 con 0x7f564406a540 2023-07-14T13:08:15.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.076+0000 7f564c434640 1 -- 172.21.15.5:0/3972439758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f564415c170 con 0x7f564406a540 2023-07-14T13:08:15.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.080+0000 7f564c434640 1 -- 172.21.15.5:0/3972439758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f564415bfd0 con 0x7f564406a540 2023-07-14T13:08:15.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.080+0000 7f563affd640 1 -- 172.21.15.5:0/3972439758 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f56400b7070 con 0x7f564406a540 2023-07-14T13:08:15.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.080+0000 7f563affd640 1 --2- 172.21.15.5:0/3972439758 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f56280663a0 0x7f5628068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:15.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.080+0000 7f563affd640 1 -- 172.21.15.5:0/3972439758 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f5640120ef0 con 0x7f564406a540 2023-07-14T13:08:15.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.080+0000 7f56499cf640 1 --2- 172.21.15.5:0/3972439758 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f56280663a0 0x7f5628068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:15.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.080+0000 7f56499cf640 1 --2- 172.21.15.5:0/3972439758 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f56280663a0 0x7f5628068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5644159f00 tx=0x7f5634009040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:15.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.084+0000 7f563affd640 1 -- 172.21.15.5:0/3972439758 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f564415bfd0 con 0x7f564406a540 2023-07-14T13:08:15.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.296+0000 7f564c434640 1 -- 172.21.15.5:0/3972439758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7f564415bfd0 con 0x7f564406a540 2023-07-14T13:08:15.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.832+0000 7f563affd640 1 -- 172.21.15.5:0/3972439758 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v563) v1 ==== 154+0+0 (secure 0 0 0) 0x7f564415bfd0 con 0x7f564406a540 2023-07-14T13:08:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.832+0000 7f564c434640 1 -- 172.21.15.5:0/3972439758 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f56280663a0 msgr2=0x7f5628068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.832+0000 7f564c434640 1 --2- 172.21.15.5:0/3972439758 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f56280663a0 0x7f5628068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5644159f00 tx=0x7f5634009040 comp rx=0 tx=0).stop 2023-07-14T13:08:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.832+0000 7f564c434640 1 -- 172.21.15.5:0/3972439758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f564406a540 msgr2=0x7f56441f1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.832+0000 7f564c434640 1 --2- 172.21.15.5:0/3972439758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f564406a540 0x7f56441f1300 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f564001d360 tx=0x7f564001ba50 comp rx=0 tx=0).stop 2023-07-14T13:08:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.832+0000 7f564c434640 1 -- 172.21.15.5:0/3972439758 shutdown_connections 2023-07-14T13:08:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.832+0000 7f564c434640 1 --2- 172.21.15.5:0/3972439758 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f56280663a0 0x7f5628068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.832+0000 7f564c434640 1 --2- 172.21.15.5:0/3972439758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f56440cdcd0 0x7f56440c3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.832+0000 7f564c434640 1 --2- 172.21.15.5:0/3972439758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56440ca750 0x7f56440c9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.832+0000 7f564c434640 1 --2- 172.21.15.5:0/3972439758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f564406a540 0x7f56441f1300 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.832+0000 7f564c434640 1 -- 172.21.15.5:0/3972439758 >> 172.21.15.5:0/3972439758 conn(0x7f5644099490 msgr2=0x7f56440aed00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:15.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.832+0000 7f564c434640 1 -- 172.21.15.5:0/3972439758 shutdown_connections 2023-07-14T13:08:15.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:15.832+0000 7f564c434640 1 -- 172.21.15.5:0/3972439758 wait complete. 2023-07-14T13:08:15.887 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots ... ok 2023-07-14T13:08:15.887 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing non-existing snap schedules failure 2023-07-14T13:08:15.887 INFO:tasks.cephfs_test_runner:test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-14T13:08:15.888 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-07-14T13:08:16.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.000+0000 7f689866a640 1 Processor -- start 2023-07-14T13:08:16.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.000+0000 7f689866a640 1 -- start start 2023-07-14T13:08:16.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.000+0000 7f689866a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6890070b70 0x7f6890070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:16.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.000+0000 7f689866a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f689006b1e0 0x7f68900c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:16.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.000+0000 7f689866a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68900cac70 con 0x7f68900c21f0 2023-07-14T13:08:16.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.000+0000 7f689866a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6890071480 con 0x7f6890070b70 2023-07-14T13:08:16.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.000+0000 7f689866a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68900ca060 con 0x7f689006b1e0 2023-07-14T13:08:16.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.000+0000 7f6896406640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6890070b70 0x7f6890070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:16.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.000+0000 7f6896406640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6890070b70 0x7f6890070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33120/0 (socket says 172.21.15.5:33120) 2023-07-14T13:08:16.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.000+0000 7f6896406640 1 -- 172.21.15.5:0/486206595 learned_addr learned my addr 172.21.15.5:0/486206595 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:16.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.000+0000 7f6896406640 1 -- 172.21.15.5:0/486206595 >> v2:172.21.15.154:3300/0 conn(0x7f689006b1e0 msgr2=0x7f68900c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:16.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.000+0000 7f6896406640 1 --2- 172.21.15.5:0/486206595 >> v2:172.21.15.154:3300/0 conn(0x7f689006b1e0 0x7f68900c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:16.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.000+0000 7f6896406640 1 -- 172.21.15.5:0/486206595 >> v1:172.21.15.154:6789/0 conn(0x7f68900c21f0 legacy=0x7f68900cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:16.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.000+0000 7f6896406640 1 -- 172.21.15.5:0/486206595 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68900ca340 con 0x7f6890070b70 2023-07-14T13:08:16.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.004+0000 7f6896406640 1 --2- 172.21.15.5:0/486206595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6890070b70 0x7f6890070f40 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f689006f380 tx=0x7f688c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46175703b4474001 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:16.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.004+0000 7f6895404640 1 -- 172.21.15.5:0/486206595 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c0aa5f0 con 0x7f6890070b70 2023-07-14T13:08:16.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.004+0000 7f6895404640 1 -- 172.21.15.5:0/486206595 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688c0aa750 con 0x7f6890070b70 2023-07-14T13:08:16.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.004+0000 7f6895404640 1 -- 172.21.15.5:0/486206595 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688c0aaae0 con 0x7f6890070b70 2023-07-14T13:08:16.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.004+0000 7f689866a640 1 -- 172.21.15.5:0/486206595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6890070b70 msgr2=0x7f6890070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.004+0000 7f689866a640 1 --2- 172.21.15.5:0/486206595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6890070b70 0x7f6890070f40 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f689006f380 tx=0x7f688c01c490 comp rx=0 tx=0).stop 2023-07-14T13:08:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.004+0000 7f689866a640 1 -- 172.21.15.5:0/486206595 shutdown_connections 2023-07-14T13:08:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.004+0000 7f689866a640 1 --2- 172.21.15.5:0/486206595 >> v2:172.21.15.154:3300/0 conn(0x7f689006b1e0 0x7f68900c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:16.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.004+0000 7f689866a640 1 --2- 172.21.15.5:0/486206595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6890070b70 0x7f6890070f40 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:16.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.004+0000 7f689866a640 1 -- 172.21.15.5:0/486206595 >> 172.21.15.5:0/486206595 conn(0x7f68900afcf0 msgr2=0x7f68900b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:16.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.004+0000 7f689866a640 1 -- 172.21.15.5:0/486206595 shutdown_connections 2023-07-14T13:08:16.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.004+0000 7f689866a640 1 -- 172.21.15.5:0/486206595 wait complete. 2023-07-14T13:08:16.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.008+0000 7f689866a640 1 Processor -- start 2023-07-14T13:08:16.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.008+0000 7f689866a640 1 -- start start 2023-07-14T13:08:16.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.008+0000 7f689866a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f689006b1e0 0x7f6890141380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:16.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.008+0000 7f689866a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6890070b70 0x7f6890151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:16.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.008+0000 7f689866a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68900c21f0 0x7f68900cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:16.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.008+0000 7f689866a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68901523c0 con 0x7f6890070b70 2023-07-14T13:08:16.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.008+0000 7f689866a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6890151b20 con 0x7f68900c21f0 2023-07-14T13:08:16.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.008+0000 7f689866a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6890151e00 con 0x7f689006b1e0 2023-07-14T13:08:16.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.008+0000 7f6895c05640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6890070b70 0x7f6890151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:16.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.008+0000 7f6895c05640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6890070b70 0x7f6890151240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33134/0 (socket says 172.21.15.5:33134) 2023-07-14T13:08:16.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.008+0000 7f6895c05640 1 -- 172.21.15.5:0/2914380960 learned_addr learned my addr 172.21.15.5:0/2914380960 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:16.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.008+0000 7f6896406640 1 --2- 172.21.15.5:0/2914380960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f689006b1e0 0x7f6890141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:16.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.008+0000 7f6896c07640 1 --2- 172.21.15.5:0/2914380960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68900c21f0 0x7f68900cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:16.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.008+0000 7f6895c05640 1 -- 172.21.15.5:0/2914380960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f689006b1e0 msgr2=0x7f6890141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:16.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.008+0000 7f6895c05640 1 --2- 172.21.15.5:0/2914380960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f689006b1e0 0x7f6890141380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:16.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.008+0000 7f6895c05640 1 -- 172.21.15.5:0/2914380960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68900c21f0 msgr2=0x7f68900cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:16.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.008+0000 7f6895c05640 1 --2- 172.21.15.5:0/2914380960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68900c21f0 0x7f68900cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:16.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.008+0000 7f6895c05640 1 -- 172.21.15.5:0/2914380960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688c0094d0 con 0x7f6890070b70 2023-07-14T13:08:16.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.008+0000 7f6896406640 1 --2- 172.21.15.5:0/2914380960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f689006b1e0 0x7f6890141380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:16.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.008+0000 7f6895c05640 1 --2- 172.21.15.5:0/2914380960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6890070b70 0x7f6890151240 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f688000b550 tx=0x7f688000ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:16.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.008+0000 7f6886ffd640 1 -- 172.21.15.5:0/2914380960 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6880010870 con 0x7f6890070b70 2023-07-14T13:08:16.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.008+0000 7f6886ffd640 1 -- 172.21.15.5:0/2914380960 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68800109f0 con 0x7f6890070b70 2023-07-14T13:08:16.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.008+0000 7f6886ffd640 1 -- 172.21.15.5:0/2914380960 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6880010da0 con 0x7f6890070b70 2023-07-14T13:08:16.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.008+0000 7f689866a640 1 -- 172.21.15.5:0/2914380960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68901520e0 con 0x7f6890070b70 2023-07-14T13:08:16.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.008+0000 7f689866a640 1 -- 172.21.15.5:0/2914380960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68901418c0 con 0x7f6890070b70 2023-07-14T13:08:16.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.012+0000 7f689866a640 1 -- 172.21.15.5:0/2914380960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68900b1850 con 0x7f6890070b70 2023-07-14T13:08:16.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.012+0000 7f6886ffd640 1 -- 172.21.15.5:0/2914380960 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f688000f3c0 con 0x7f6890070b70 2023-07-14T13:08:16.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.012+0000 7f6886ffd640 1 --2- 172.21.15.5:0/2914380960 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f68740663a0 0x7f6874068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:16.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.012+0000 7f6886ffd640 1 -- 172.21.15.5:0/2914380960 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f6880083e90 con 0x7f6890070b70 2023-07-14T13:08:16.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.012+0000 7f6896406640 1 --2- 172.21.15.5:0/2914380960 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f68740663a0 0x7f6874068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:16.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.012+0000 7f6896406640 1 --2- 172.21.15.5:0/2914380960 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f68740663a0 0x7f6874068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f688c0ae000 tx=0x7f688c0a7000 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:16.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.016+0000 7f6886ffd640 1 -- 172.21.15.5:0/2914380960 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f68900b1850 con 0x7f6890070b70 2023-07-14T13:08:16.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.224+0000 7f689866a640 1 -- 172.21.15.5:0/2914380960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f68900b1c30 con 0x7f6890070b70 2023-07-14T13:08:16.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.832+0000 7f6886ffd640 1 -- 172.21.15.5:0/2914380960 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v564) v1 ==== 159+0+0 (secure 0 0 0) 0x7f68900b1c30 con 0x7f6890070b70 2023-07-14T13:08:16.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.836+0000 7f689866a640 1 -- 172.21.15.5:0/2914380960 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f68740663a0 msgr2=0x7f6874068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:16.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.836+0000 7f689866a640 1 --2- 172.21.15.5:0/2914380960 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f68740663a0 0x7f6874068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f688c0ae000 tx=0x7f688c0a7000 comp rx=0 tx=0).stop 2023-07-14T13:08:16.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.836+0000 7f689866a640 1 -- 172.21.15.5:0/2914380960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6890070b70 msgr2=0x7f6890151240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:16.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.836+0000 7f689866a640 1 --2- 172.21.15.5:0/2914380960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6890070b70 0x7f6890151240 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f688000b550 tx=0x7f688000ba10 comp rx=0 tx=0).stop 2023-07-14T13:08:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.836+0000 7f689866a640 1 -- 172.21.15.5:0/2914380960 shutdown_connections 2023-07-14T13:08:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.836+0000 7f689866a640 1 --2- 172.21.15.5:0/2914380960 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f68740663a0 0x7f6874068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.836+0000 7f689866a640 1 --2- 172.21.15.5:0/2914380960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68900c21f0 0x7f68900cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.836+0000 7f689866a640 1 --2- 172.21.15.5:0/2914380960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6890070b70 0x7f6890151240 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.836+0000 7f689866a640 1 --2- 172.21.15.5:0/2914380960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f689006b1e0 0x7f6890141380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.836+0000 7f689866a640 1 -- 172.21.15.5:0/2914380960 >> 172.21.15.5:0/2914380960 conn(0x7f68900afcf0 msgr2=0x7f6890159030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:16.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.836+0000 7f689866a640 1 -- 172.21.15.5:0/2914380960 shutdown_connections 2023-07-14T13:08:16.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:16.836+0000 7f689866a640 1 -- 172.21.15.5:0/2914380960 wait complete. 2023-07-14T13:08:16.890 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-14T13:08:17.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.004+0000 7f37363c5640 1 Processor -- start 2023-07-14T13:08:17.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.004+0000 7f37363c5640 1 -- start start 2023-07-14T13:08:17.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.008+0000 7f37363c5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f37300aeb40 0x7f373015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:17.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.008+0000 7f37363c5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37300aef10 0x7f3730158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:17.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.008+0000 7f37363c5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37301532b0 con 0x7f3730159270 2023-07-14T13:08:17.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.008+0000 7f37363c5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37300ca6f0 con 0x7f37300aeb40 2023-07-14T13:08:17.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.008+0000 7f37363c5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37301599d0 con 0x7f37300aef10 2023-07-14T13:08:17.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.008+0000 7f372ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f37300aeb40 0x7f373015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:17.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.008+0000 7f372ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f37300aeb40 0x7f373015cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33142/0 (socket says 172.21.15.5:33142) 2023-07-14T13:08:17.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.008+0000 7f372ffff640 1 -- 172.21.15.5:0/3913181010 learned_addr learned my addr 172.21.15.5:0/3913181010 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:17.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.008+0000 7f372ffff640 1 -- 172.21.15.5:0/3913181010 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37300aef10 msgr2=0x7f3730158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:17.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.008+0000 7f372ffff640 1 --2- 172.21.15.5:0/3913181010 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37300aef10 0x7f3730158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:17.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.008+0000 7f372ffff640 1 -- 172.21.15.5:0/3913181010 >> v1:172.21.15.154:6789/0 conn(0x7f3730159270 legacy=0x7f37300c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:17.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.008+0000 7f372ffff640 1 -- 172.21.15.5:0/3913181010 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3730159cb0 con 0x7f37300aeb40 2023-07-14T13:08:17.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.012+0000 7f372ffff640 1 --2- 172.21.15.5:0/3913181010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37300aeb40 0x7f373015cef0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3720009870 tx=0x7f372001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=555439d943f4637f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:17.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.012+0000 7f372effd640 1 -- 172.21.15.5:0/3913181010 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37200ab600 con 0x7f37300aeb40 2023-07-14T13:08:17.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.012+0000 7f372effd640 1 -- 172.21.15.5:0/3913181010 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37200ab760 con 0x7f37300aeb40 2023-07-14T13:08:17.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.012+0000 7f372effd640 1 -- 172.21.15.5:0/3913181010 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37200abaf0 con 0x7f37300aeb40 2023-07-14T13:08:17.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.012+0000 7f37363c5640 1 -- 172.21.15.5:0/3913181010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37300aeb40 msgr2=0x7f373015cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:17.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.012+0000 7f37363c5640 1 --2- 172.21.15.5:0/3913181010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37300aeb40 0x7f373015cef0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3720009870 tx=0x7f372001c440 comp rx=0 tx=0).stop 2023-07-14T13:08:17.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.012+0000 7f37363c5640 1 -- 172.21.15.5:0/3913181010 shutdown_connections 2023-07-14T13:08:17.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.012+0000 7f37363c5640 1 --2- 172.21.15.5:0/3913181010 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37300aef10 0x7f3730158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:17.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.012+0000 7f37363c5640 1 --2- 172.21.15.5:0/3913181010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37300aeb40 0x7f373015cef0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:17.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.012+0000 7f37363c5640 1 -- 172.21.15.5:0/3913181010 >> 172.21.15.5:0/3913181010 conn(0x7f37300cde90 msgr2=0x7f37300ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:17.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.012+0000 7f37363c5640 1 -- 172.21.15.5:0/3913181010 shutdown_connections 2023-07-14T13:08:17.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.012+0000 7f37363c5640 1 -- 172.21.15.5:0/3913181010 wait complete. 2023-07-14T13:08:17.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.012+0000 7f37363c5640 1 Processor -- start 2023-07-14T13:08:17.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.012+0000 7f37363c5640 1 -- start start 2023-07-14T13:08:17.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.016+0000 7f37363c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37300aeb40 0x7f3730152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:17.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.016+0000 7f37363c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37300aef10 0x7f3730070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.016+0000 7f37363c5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3730159270 0x7f373014df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.016+0000 7f37363c5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373014d1c0 con 0x7f37300aeb40 2023-07-14T13:08:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.016+0000 7f37363c5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37300710f0 con 0x7f37300aef10 2023-07-14T13:08:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.016+0000 7f37363c5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373014e450 con 0x7f3730159270 2023-07-14T13:08:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.016+0000 7f372ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37300aeb40 0x7f3730152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.016+0000 7f372ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37300aeb40 0x7f3730152780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33156/0 (socket says 172.21.15.5:33156) 2023-07-14T13:08:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.016+0000 7f372ffff640 1 -- 172.21.15.5:0/3343367906 learned_addr learned my addr 172.21.15.5:0/3343367906 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.016+0000 7f3734962640 1 --2- 172.21.15.5:0/3343367906 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3730159270 0x7f373014df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:17.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.016+0000 7f372f7fe640 1 --2- 172.21.15.5:0/3343367906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37300aef10 0x7f3730070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:17.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.016+0000 7f372ffff640 1 -- 172.21.15.5:0/3343367906 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3730159270 msgr2=0x7f373014df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:17.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.016+0000 7f372ffff640 1 --2- 172.21.15.5:0/3343367906 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3730159270 0x7f373014df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:17.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.016+0000 7f372ffff640 1 -- 172.21.15.5:0/3343367906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37300aef10 msgr2=0x7f3730070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:17.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.016+0000 7f372ffff640 1 --2- 172.21.15.5:0/3343367906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37300aef10 0x7f3730070bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:17.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.016+0000 7f372ffff640 1 -- 172.21.15.5:0/3343367906 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37200094d0 con 0x7f37300aeb40 2023-07-14T13:08:17.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.016+0000 7f372f7fe640 1 --2- 172.21.15.5:0/3343367906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37300aef10 0x7f3730070bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:17.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.016+0000 7f372ffff640 1 --2- 172.21.15.5:0/3343367906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37300aeb40 0x7f3730152780 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f37200ad040 tx=0x7f372001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:17.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.016+0000 7f372cff9640 1 -- 172.21.15.5:0/3343367906 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37200ab600 con 0x7f37300aeb40 2023-07-14T13:08:17.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.016+0000 7f372cff9640 1 -- 172.21.15.5:0/3343367906 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37200b4820 con 0x7f37300aeb40 2023-07-14T13:08:17.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.016+0000 7f372cff9640 1 -- 172.21.15.5:0/3343367906 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37200b4bd0 con 0x7f37300aeb40 2023-07-14T13:08:17.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.016+0000 7f37363c5640 1 -- 172.21.15.5:0/3343367906 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f373014d430 con 0x7f37300aeb40 2023-07-14T13:08:17.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.016+0000 7f37363c5640 1 -- 172.21.15.5:0/3343367906 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f373014d9f0 con 0x7f37300aeb40 2023-07-14T13:08:17.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.016+0000 7f37363c5640 1 -- 172.21.15.5:0/3343367906 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37300af340 con 0x7f37300aeb40 2023-07-14T13:08:17.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.016+0000 7f372cff9640 1 -- 172.21.15.5:0/3343367906 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f37200b4d30 con 0x7f37300aeb40 2023-07-14T13:08:17.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.020+0000 7f372cff9640 1 --2- 172.21.15.5:0/3343367906 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f371c0663a0 0x7f371c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:17.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.020+0000 7f372cff9640 1 -- 172.21.15.5:0/3343367906 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f372011ea80 con 0x7f37300aeb40 2023-07-14T13:08:17.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.020+0000 7f372f7fe640 1 --2- 172.21.15.5:0/3343367906 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f371c0663a0 0x7f371c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:17.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.020+0000 7f372f7fe640 1 --2- 172.21.15.5:0/3343367906 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f371c0663a0 0x7f371c068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3724006fd0 tx=0x7f3724008040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:17.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.024+0000 7f372cff9640 1 -- 172.21.15.5:0/3343367906 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f37300af340 con 0x7f37300aeb40 2023-07-14T13:08:17.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.176+0000 7f37363c5640 1 -- 172.21.15.5:0/3343367906 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f37300af340 con 0x7f37300aeb40 2023-07-14T13:08:17.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.180+0000 7f372cff9640 1 -- 172.21.15.5:0/3343367906 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f37300af340 con 0x7f37300aeb40 2023-07-14T13:08:17.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.184+0000 7f37363c5640 1 -- 172.21.15.5:0/3343367906 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f371c0663a0 msgr2=0x7f371c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:17.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.184+0000 7f37363c5640 1 --2- 172.21.15.5:0/3343367906 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f371c0663a0 0x7f371c068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3724006fd0 tx=0x7f3724008040 comp rx=0 tx=0).stop 2023-07-14T13:08:17.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.184+0000 7f37363c5640 1 -- 172.21.15.5:0/3343367906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37300aeb40 msgr2=0x7f3730152780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:17.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.184+0000 7f37363c5640 1 --2- 172.21.15.5:0/3343367906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37300aeb40 0x7f3730152780 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f37200ad040 tx=0x7f372001ac80 comp rx=0 tx=0).stop 2023-07-14T13:08:17.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.184+0000 7f37363c5640 1 -- 172.21.15.5:0/3343367906 shutdown_connections 2023-07-14T13:08:17.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.184+0000 7f37363c5640 1 --2- 172.21.15.5:0/3343367906 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f371c0663a0 0x7f371c068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:17.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.184+0000 7f37363c5640 1 --2- 172.21.15.5:0/3343367906 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3730159270 0x7f373014df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:17.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.184+0000 7f37363c5640 1 --2- 172.21.15.5:0/3343367906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37300aef10 0x7f3730070bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:17.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.184+0000 7f37363c5640 1 --2- 172.21.15.5:0/3343367906 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37300aeb40 0x7f3730152780 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:17.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.184+0000 7f37363c5640 1 -- 172.21.15.5:0/3343367906 >> 172.21.15.5:0/3343367906 conn(0x7f37300cde90 msgr2=0x7f37300caad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:17.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.184+0000 7f37363c5640 1 -- 172.21.15.5:0/3343367906 shutdown_connections 2023-07-14T13:08:17.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.184+0000 7f37363c5640 1 -- 172.21.15.5:0/3343367906 wait complete. 2023-07-14T13:08:17.237 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T13:08:17.238 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:08:17.302 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:08:17.355 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T13:08:17.355 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:08:17.355 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:08:17.366 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:08:17.366 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:08:17.366 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:08:17.376 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:08:17.377 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:08:17.377 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:08:17.415 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:08:17.416 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:08:17.416 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:08:17.432 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:08:17.433 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-14T13:08:17.433 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:08:17.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.572+0000 7f3ef7140640 1 Processor -- start 2023-07-14T13:08:17.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.572+0000 7f3ef7140640 1 -- start start 2023-07-14T13:08:17.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.576+0000 7f3ef7140640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3ef0158ce0 0x7f3ef0070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:17.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.576+0000 7f3ef7140640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3ef00c9730 0x7f3ef00ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:17.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.576+0000 7f3ef7140640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef00cc700 con 0x7f3ef00c8ad0 2023-07-14T13:08:17.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.576+0000 7f3ef7140640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef00b0ff0 con 0x7f3ef00c9730 2023-07-14T13:08:17.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.576+0000 7f3ef7140640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef0070c80 con 0x7f3ef0158ce0 2023-07-14T13:08:17.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.576+0000 7f3ef56dd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3ef00c9730 0x7f3ef00ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:17.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.576+0000 7f3eeffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3ef00c8ad0 0x7f3ef00c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:44328/0 (socket says 172.21.15.5:44328) 2023-07-14T13:08:17.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.576+0000 7f3eeffff640 1 -- 172.21.15.5:0/4211340457 learned_addr learned my addr 172.21.15.5:0/4211340457 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:17.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.576+0000 7f3ef4edc640 1 --2- 172.21.15.5:0/4211340457 >> v2:172.21.15.154:3300/0 conn(0x7f3ef0158ce0 0x7f3ef0070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:17.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.576+0000 7f3ef56dd640 1 -- 172.21.15.5:0/4211340457 >> v2:172.21.15.154:3300/0 conn(0x7f3ef0158ce0 msgr2=0x7f3ef0070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:17.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.576+0000 7f3ef56dd640 1 --2- 172.21.15.5:0/4211340457 >> v2:172.21.15.154:3300/0 conn(0x7f3ef0158ce0 0x7f3ef0070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:17.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.576+0000 7f3ef56dd640 1 -- 172.21.15.5:0/4211340457 >> v1:172.21.15.5:6789/0 conn(0x7f3ef00c8ad0 legacy=0x7f3ef00c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:17.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.576+0000 7f3ef56dd640 1 -- 172.21.15.5:0/4211340457 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef00cbdd0 con 0x7f3ef00c9730 2023-07-14T13:08:17.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.576+0000 7f3eef7fe640 1 -- 172.21.15.5:0/4211340457 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046136764 0 0) 0x7f3ef00cc700 con 0x7f3ef00c8ad0 2023-07-14T13:08:17.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.576+0000 7f3ef56dd640 1 --2- 172.21.15.5:0/4211340457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef00c9730 0x7f3ef00ccb90 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0071be0 tx=0x7f3ee801c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13be2cd905ec57a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:17.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.580+0000 7f3eef7fe640 1 -- 172.21.15.5:0/4211340457 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee80a58a0 con 0x7f3ef00c9730 2023-07-14T13:08:17.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.580+0000 7f3eef7fe640 1 -- 172.21.15.5:0/4211340457 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee80a5a00 con 0x7f3ef00c9730 2023-07-14T13:08:17.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.580+0000 7f3eef7fe640 1 -- 172.21.15.5:0/4211340457 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee80a5d90 con 0x7f3ef00c9730 2023-07-14T13:08:17.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.580+0000 7f3ef7140640 1 -- 172.21.15.5:0/4211340457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef00c9730 msgr2=0x7f3ef00ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:17.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.580+0000 7f3ef7140640 1 --2- 172.21.15.5:0/4211340457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef00c9730 0x7f3ef00ccb90 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0071be0 tx=0x7f3ee801c7c0 comp rx=0 tx=0).stop 2023-07-14T13:08:17.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.580+0000 7f3ef7140640 1 -- 172.21.15.5:0/4211340457 shutdown_connections 2023-07-14T13:08:17.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.580+0000 7f3ef7140640 1 --2- 172.21.15.5:0/4211340457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef00c9730 0x7f3ef00ccb90 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:17.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.580+0000 7f3ef7140640 1 --2- 172.21.15.5:0/4211340457 >> v2:172.21.15.154:3300/0 conn(0x7f3ef0158ce0 0x7f3ef0070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:17.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.580+0000 7f3ef7140640 1 -- 172.21.15.5:0/4211340457 >> 172.21.15.5:0/4211340457 conn(0x7f3ef00afcf0 msgr2=0x7f3ef00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:17.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.580+0000 7f3ef7140640 1 -- 172.21.15.5:0/4211340457 shutdown_connections 2023-07-14T13:08:17.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.580+0000 7f3ef7140640 1 -- 172.21.15.5:0/4211340457 wait complete. 2023-07-14T13:08:17.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.580+0000 7f3ef7140640 1 Processor -- start 2023-07-14T13:08:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.580+0000 7f3ef7140640 1 -- start start 2023-07-14T13:08:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.580+0000 7f3ef7140640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef00c8ad0 0x7f3ef015a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.580+0000 7f3ef7140640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ef00c9730 0x7f3ef00c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.580+0000 7f3ef7140640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ef0158ce0 0x7f3ef00c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.580+0000 7f3ef7140640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef00c5230 con 0x7f3ef00c8ad0 2023-07-14T13:08:17.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.580+0000 7f3ef7140640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef00c6600 con 0x7f3ef0158ce0 2023-07-14T13:08:17.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.580+0000 7f3ef7140640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef00b3ac0 con 0x7f3ef00c9730 2023-07-14T13:08:17.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.580+0000 7f3ef4edc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef00c8ad0 0x7f3ef015a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:17.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.580+0000 7f3ef4edc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef00c8ad0 0x7f3ef015a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33176/0 (socket says 172.21.15.5:33176) 2023-07-14T13:08:17.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.580+0000 7f3ef4edc640 1 -- 172.21.15.5:0/2033502246 learned_addr learned my addr 172.21.15.5:0/2033502246 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:17.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.584+0000 7f3ef56dd640 1 --2- 172.21.15.5:0/2033502246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ef0158ce0 0x7f3ef00c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:17.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.584+0000 7f3eeffff640 1 --2- 172.21.15.5:0/2033502246 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ef00c9730 0x7f3ef00c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:17.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.584+0000 7f3ef4edc640 1 -- 172.21.15.5:0/2033502246 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ef00c9730 msgr2=0x7f3ef00c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:17.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.584+0000 7f3ef4edc640 1 --2- 172.21.15.5:0/2033502246 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ef00c9730 0x7f3ef00c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.584+0000 7f3ef4edc640 1 -- 172.21.15.5:0/2033502246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ef0158ce0 msgr2=0x7f3ef00c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.584+0000 7f3ef4edc640 1 --2- 172.21.15.5:0/2033502246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ef0158ce0 0x7f3ef00c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.584+0000 7f3ef4edc640 1 -- 172.21.15.5:0/2033502246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee8009a70 con 0x7f3ef00c8ad0 2023-07-14T13:08:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.584+0000 7f3ef4edc640 1 --2- 172.21.15.5:0/2033502246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef00c8ad0 0x7f3ef015a3b0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f3ee400d5f0 tx=0x7f3ee400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:17.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.584+0000 7f3eed7fa640 1 -- 172.21.15.5:0/2033502246 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee40125f0 con 0x7f3ef00c8ad0 2023-07-14T13:08:17.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.584+0000 7f3eed7fa640 1 -- 172.21.15.5:0/2033502246 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee4012750 con 0x7f3ef00c8ad0 2023-07-14T13:08:17.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.584+0000 7f3eed7fa640 1 -- 172.21.15.5:0/2033502246 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee4012b00 con 0x7f3ef00c8ad0 2023-07-14T13:08:17.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.584+0000 7f3ef7140640 1 -- 172.21.15.5:0/2033502246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef00b3da0 con 0x7f3ef00c8ad0 2023-07-14T13:08:17.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.584+0000 7f3ef7140640 1 -- 172.21.15.5:0/2033502246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef00b4080 con 0x7f3ef00c8ad0 2023-07-14T13:08:17.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.584+0000 7f3ef7140640 1 -- 172.21.15.5:0/2033502246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef00ca1a0 con 0x7f3ef00c8ad0 2023-07-14T13:08:17.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.584+0000 7f3eed7fa640 1 -- 172.21.15.5:0/2033502246 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3ee4012c60 con 0x7f3ef00c8ad0 2023-07-14T13:08:17.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.588+0000 7f3eed7fa640 1 --2- 172.21.15.5:0/2033502246 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f3ed40663a0 0x7f3ed4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:17.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.588+0000 7f3eed7fa640 1 -- 172.21.15.5:0/2033502246 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f3ee4084330 con 0x7f3ef00c8ad0 2023-07-14T13:08:17.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.588+0000 7f3eeffff640 1 --2- 172.21.15.5:0/2033502246 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f3ed40663a0 0x7f3ed4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.588+0000 7f3eeffff640 1 --2- 172.21.15.5:0/2033502246 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f3ed40663a0 0x7f3ed4068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3ef00c8230 tx=0x7f3edc007b60 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.592+0000 7f3eed7fa640 1 -- 172.21.15.5:0/2033502246 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3ee4051670 con 0x7f3ef00c8ad0 2023-07-14T13:08:17.784 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:08:17.788 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:08:17.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.784+0000 7f3ef7140640 1 -- 172.21.15.5:0/2033502246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ef00678d0 con 0x7f3ef00c8ad0 2023-07-14T13:08:17.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.784+0000 7f3eed7fa640 1 -- 172.21.15.5:0/2033502246 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3520 (secure 0 0 0) 0x7f3ee4054c90 con 0x7f3ef00c8ad0 2023-07-14T13:08:17.818 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:17.818 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5429,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/874132020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":874132020},{"type":"v1","addr":"172.21.15.154:6837","nonce":874132020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5911,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/217555499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":217555499},{"type":"v1","addr":"172.21.15.154:6835","nonce":217555499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6033,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3051331859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3051331859},{"type":"v1","addr":"172.21.15.5:6834","nonce":3051331859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/919412224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":919412224},{"type":"v1","addr":"172.21.15.5:6835","nonce":919412224}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[]} 2023-07-14T13:08:17.818 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 26 2023-07-14T13:08:17.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.784+0000 7f3ef7140640 1 -- 172.21.15.5:0/2033502246 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f3ed40663a0 msgr2=0x7f3ed4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:17.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.784+0000 7f3ef7140640 1 --2- 172.21.15.5:0/2033502246 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f3ed40663a0 0x7f3ed4068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3ef00c8230 tx=0x7f3edc007b60 comp rx=0 tx=0).stop 2023-07-14T13:08:17.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.788+0000 7f3ef7140640 1 -- 172.21.15.5:0/2033502246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef00c8ad0 msgr2=0x7f3ef015a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:17.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.788+0000 7f3ef7140640 1 --2- 172.21.15.5:0/2033502246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef00c8ad0 0x7f3ef015a3b0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f3ee400d5f0 tx=0x7f3ee400dab0 comp rx=0 tx=0).stop 2023-07-14T13:08:17.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.788+0000 7f3ef7140640 1 -- 172.21.15.5:0/2033502246 shutdown_connections 2023-07-14T13:08:17.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.788+0000 7f3ef7140640 1 --2- 172.21.15.5:0/2033502246 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f3ed40663a0 0x7f3ed4068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:17.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.788+0000 7f3ef7140640 1 --2- 172.21.15.5:0/2033502246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ef0158ce0 0x7f3ef00c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:17.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.788+0000 7f3ef7140640 1 --2- 172.21.15.5:0/2033502246 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ef00c9730 0x7f3ef00c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:17.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.788+0000 7f3ef7140640 1 --2- 172.21.15.5:0/2033502246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ef00c8ad0 0x7f3ef015a3b0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:17.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.788+0000 7f3ef7140640 1 -- 172.21.15.5:0/2033502246 >> 172.21.15.5:0/2033502246 conn(0x7f3ef00afcf0 msgr2=0x7f3ef01509f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:17.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.788+0000 7f3ef7140640 1 -- 172.21.15.5:0/2033502246 shutdown_connections 2023-07-14T13:08:17.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:17.788+0000 7f3ef7140640 1 -- 172.21.15.5:0/2033502246 wait complete. 2023-07-14T13:08:17.840 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-14T13:08:17.840 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-14T13:08:17.841 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-14T13:08:17.841 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:08:17.841 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-14T13:08:17.841 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-14T13:08:17.842 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-14T13:08:17.842 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:08:17.842 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-14T13:08:17.842 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-14T13:08:17.843 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-14T13:08:17.843 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:08:17.843 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-14T13:08:17.843 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-14T13:08:17.843 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-14T13:08:17.844 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:08:17.858 INFO:tasks.ceph.mds.c:Stopped 2023-07-14T13:08:17.859 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-14T13:08:17.859 INFO:tasks.ceph.mds.a:Stopped 2023-07-14T13:08:17.860 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-14T13:08:17.861 INFO:tasks.ceph.mds.b:Stopped 2023-07-14T13:08:17.862 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-14T13:08:17.862 INFO:tasks.ceph.mds.d:Stopped 2023-07-14T13:08:17.863 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-14T13:08:17.902 INFO:tasks.ceph.mds.c:Started 2023-07-14T13:08:17.903 DEBUG:teuthology.parallel:result is None 2023-07-14T13:08:17.904 INFO:tasks.ceph.mds.a:Started 2023-07-14T13:08:17.905 DEBUG:teuthology.parallel:result is None 2023-07-14T13:08:17.910 INFO:tasks.ceph.mds.b:Started 2023-07-14T13:08:17.911 DEBUG:teuthology.parallel:result is None 2023-07-14T13:08:17.912 INFO:tasks.ceph.mds.d:Started 2023-07-14T13:08:17.913 DEBUG:teuthology.parallel:result is None 2023-07-14T13:08:17.913 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-14T13:08:17.992 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-07-14T13:08:17.992 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-07-14T13:08:18.001 INFO:tasks.ceph.mds.b.smithi154.stdout:starting mds.b at 2023-07-14T13:08:18.002 INFO:tasks.ceph.mds.d.smithi154.stdout:starting mds.d at 2023-07-14T13:08:18.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.028+0000 7f09197fa640 1 Processor -- start 2023-07-14T13:08:18.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.028+0000 7f09197fa640 1 -- start start 2023-07-14T13:08:18.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.032+0000 7f09197fa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09140c8ad0 0x7f09140c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:18.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.032+0000 7f09197fa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f09140c9560 0x7f09140ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:18.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.032+0000 7f09197fa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09140c99c0 con 0x7f0914158ce0 2023-07-14T13:08:18.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.032+0000 7f09197fa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09140cc700 con 0x7f09140c8ad0 2023-07-14T13:08:18.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.032+0000 7f09197fa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09140b0ff0 con 0x7f09140c9560 2023-07-14T13:08:18.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.032+0000 7f09127fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09140c8ad0 0x7f09140c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:18.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.032+0000 7f09127fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09140c8ad0 0x7f09140c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33224/0 (socket says 172.21.15.5:33224) 2023-07-14T13:08:18.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.032+0000 7f09127fc640 1 -- 172.21.15.5:0/3364488533 learned_addr learned my addr 172.21.15.5:0/3364488533 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:18.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.032+0000 7f09137fe640 1 --2- 172.21.15.5:0/3364488533 >> v2:172.21.15.154:3300/0 conn(0x7f09140c9560 0x7f09140ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:18.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.032+0000 7f09127fc640 1 -- 172.21.15.5:0/3364488533 >> v2:172.21.15.154:3300/0 conn(0x7f09140c9560 msgr2=0x7f09140ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:18.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.032+0000 7f09127fc640 1 --2- 172.21.15.5:0/3364488533 >> v2:172.21.15.154:3300/0 conn(0x7f09140c9560 0x7f09140ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:18.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.032+0000 7f09127fc640 1 -- 172.21.15.5:0/3364488533 >> v1:172.21.15.154:6789/0 conn(0x7f0914158ce0 legacy=0x7f0914070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:18.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.032+0000 7f09127fc640 1 -- 172.21.15.5:0/3364488533 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0914070c80 con 0x7f09140c8ad0 2023-07-14T13:08:18.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.036+0000 7f09127fc640 1 --2- 172.21.15.5:0/3364488533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09140c8ad0 0x7f09140c9020 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f09140b0d70 tx=0x7f090801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224d54e27ccb1775 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:18.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.036+0000 7f0911ffb640 1 -- 172.21.15.5:0/3364488533 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09080ac410 con 0x7f09140c8ad0 2023-07-14T13:08:18.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.036+0000 7f0911ffb640 1 -- 172.21.15.5:0/3364488533 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09080ac570 con 0x7f09140c8ad0 2023-07-14T13:08:18.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.036+0000 7f0911ffb640 1 -- 172.21.15.5:0/3364488533 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09080ac900 con 0x7f09140c8ad0 2023-07-14T13:08:18.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.036+0000 7f09197fa640 1 -- 172.21.15.5:0/3364488533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09140c8ad0 msgr2=0x7f09140c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:18.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.036+0000 7f09197fa640 1 --2- 172.21.15.5:0/3364488533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09140c8ad0 0x7f09140c9020 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f09140b0d70 tx=0x7f090801c3b0 comp rx=0 tx=0).stop 2023-07-14T13:08:18.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.036+0000 7f09197fa640 1 -- 172.21.15.5:0/3364488533 shutdown_connections 2023-07-14T13:08:18.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.036+0000 7f09197fa640 1 --2- 172.21.15.5:0/3364488533 >> v2:172.21.15.154:3300/0 conn(0x7f09140c9560 0x7f09140ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:18.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.036+0000 7f09197fa640 1 --2- 172.21.15.5:0/3364488533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09140c8ad0 0x7f09140c9020 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:18.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.036+0000 7f09197fa640 1 -- 172.21.15.5:0/3364488533 >> 172.21.15.5:0/3364488533 conn(0x7f09140afcf0 msgr2=0x7f09140b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:18.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.036+0000 7f09197fa640 1 -- 172.21.15.5:0/3364488533 shutdown_connections 2023-07-14T13:08:18.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.036+0000 7f09197fa640 1 -- 172.21.15.5:0/3364488533 wait complete. 2023-07-14T13:08:18.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.036+0000 7f09197fa640 1 Processor -- start 2023-07-14T13:08:18.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.036+0000 7f09197fa640 1 -- start start 2023-07-14T13:08:18.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.036+0000 7f09197fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09140c8ad0 0x7f09140c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:18.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.040+0000 7f09197fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09140c9560 0x7f09140ac460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:18.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.040+0000 7f09197fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0914158ce0 0x7f09140c2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:18.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.040+0000 7f09197fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0914143db0 con 0x7f0914158ce0 2023-07-14T13:08:18.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.040+0000 7f09197fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09140ac9a0 con 0x7f09140c9560 2023-07-14T13:08:18.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.040+0000 7f09197fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0914150c30 con 0x7f09140c8ad0 2023-07-14T13:08:18.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.040+0000 7f09127fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09140c9560 0x7f09140ac460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:18.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.040+0000 7f09137fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0914158ce0 0x7f09140c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:18.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.040+0000 7f0912ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09140c8ad0 0x7f09140c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:18.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.040+0000 7f09127fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09140c9560 0x7f09140ac460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:46452/0 (socket says 172.21.15.5:46452) 2023-07-14T13:08:18.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.040+0000 7f09137fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0914158ce0 0x7f09140c2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33234/0 (socket says 172.21.15.5:33234) 2023-07-14T13:08:18.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.040+0000 7f09127fc640 1 -- 172.21.15.5:0/2048950889 learned_addr learned my addr 172.21.15.5:0/2048950889 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:18.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.040+0000 7f09127fc640 1 -- 172.21.15.5:0/2048950889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09140c8ad0 msgr2=0x7f09140c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:18.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.040+0000 7f09127fc640 1 --2- 172.21.15.5:0/2048950889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09140c8ad0 0x7f09140c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:18.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.040+0000 7f09127fc640 1 -- 172.21.15.5:0/2048950889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0914158ce0 msgr2=0x7f09140c2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:18.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.040+0000 7f09127fc640 1 --2- 172.21.15.5:0/2048950889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0914158ce0 0x7f09140c2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:18.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.040+0000 7f09127fc640 1 -- 172.21.15.5:0/2048950889 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09080094d0 con 0x7f09140c9560 2023-07-14T13:08:18.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.040+0000 7f09127fc640 1 --2- 172.21.15.5:0/2048950889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09140c9560 0x7f09140ac460 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f09080af040 tx=0x7f0908019150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:18.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.040+0000 7f08fb7fe640 1 -- 172.21.15.5:0/2048950889 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09080ac410 con 0x7f09140c9560 2023-07-14T13:08:18.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.040+0000 7f08fb7fe640 1 -- 172.21.15.5:0/2048950889 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09080b45c0 con 0x7f09140c9560 2023-07-14T13:08:18.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.040+0000 7f08fb7fe640 1 -- 172.21.15.5:0/2048950889 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09080b4990 con 0x7f09140c9560 2023-07-14T13:08:18.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.040+0000 7f09197fa640 1 -- 172.21.15.5:0/2048950889 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0914143880 con 0x7f09140c9560 2023-07-14T13:08:18.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.040+0000 7f09197fa640 1 -- 172.21.15.5:0/2048950889 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0914155f20 con 0x7f09140c9560 2023-07-14T13:08:18.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.040+0000 7f09197fa640 1 -- 172.21.15.5:0/2048950889 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09140ca1a0 con 0x7f09140c9560 2023-07-14T13:08:18.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.040+0000 7f08fb7fe640 1 -- 172.21.15.5:0/2048950889 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f09080b4af0 con 0x7f09140c9560 2023-07-14T13:08:18.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.044+0000 7f08fb7fe640 1 --2- 172.21.15.5:0/2048950889 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f09000663a0 0x7f0900068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:18.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.044+0000 7f08fb7fe640 1 -- 172.21.15.5:0/2048950889 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f090811ee50 con 0x7f09140c9560 2023-07-14T13:08:18.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.044+0000 7f0912ffd640 1 --2- 172.21.15.5:0/2048950889 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f09000663a0 0x7f0900068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:18.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.044+0000 7f0912ffd640 1 --2- 172.21.15.5:0/2048950889 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f09000663a0 0x7f0900068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0904007fd0 tx=0x7f0904009040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:18.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.044+0000 7f08fb7fe640 1 -- 172.21.15.5:0/2048950889 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f09080ec2c0 con 0x7f09140c9560 2023-07-14T13:08:18.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:18.216+0000 7f09197fa640 1 -- 172.21.15.5:0/2048950889 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f09140678d0 con 0x7f09140c9560 2023-07-14T13:08:19.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.204+0000 7f08fb7fe640 1 -- 172.21.15.5:0/2048950889 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v79) v1 ==== 97+0+0 (secure 0 0 0) 0x7f09080b1080 con 0x7f09140c9560 2023-07-14T13:08:19.237 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2023-07-14T13:08:19.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.204+0000 7f09197fa640 1 -- 172.21.15.5:0/2048950889 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f09000663a0 msgr2=0x7f0900068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:19.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.204+0000 7f09197fa640 1 --2- 172.21.15.5:0/2048950889 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f09000663a0 0x7f0900068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0904007fd0 tx=0x7f0904009040 comp rx=0 tx=0).stop 2023-07-14T13:08:19.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.204+0000 7f09197fa640 1 -- 172.21.15.5:0/2048950889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09140c9560 msgr2=0x7f09140ac460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:19.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.204+0000 7f09197fa640 1 --2- 172.21.15.5:0/2048950889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09140c9560 0x7f09140ac460 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f09080af040 tx=0x7f0908019150 comp rx=0 tx=0).stop 2023-07-14T13:08:19.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.204+0000 7f09197fa640 1 -- 172.21.15.5:0/2048950889 shutdown_connections 2023-07-14T13:08:19.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.204+0000 7f09197fa640 1 --2- 172.21.15.5:0/2048950889 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f09000663a0 0x7f0900068850 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:19.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.204+0000 7f09197fa640 1 --2- 172.21.15.5:0/2048950889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0914158ce0 0x7f09140c2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:19.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.204+0000 7f09197fa640 1 --2- 172.21.15.5:0/2048950889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09140c9560 0x7f09140ac460 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:19.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.204+0000 7f09197fa640 1 --2- 172.21.15.5:0/2048950889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09140c8ad0 0x7f09140c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:19.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.204+0000 7f09197fa640 1 -- 172.21.15.5:0/2048950889 >> 172.21.15.5:0/2048950889 conn(0x7f09140afcf0 msgr2=0x7f0914070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:19.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.204+0000 7f09197fa640 1 -- 172.21.15.5:0/2048950889 shutdown_connections 2023-07-14T13:08:19.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.204+0000 7f09197fa640 1 -- 172.21.15.5:0/2048950889 wait complete. 2023-07-14T13:08:19.262 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-14T13:08:19.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.376+0000 7f5e16937640 1 Processor -- start 2023-07-14T13:08:19.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.376+0000 7f5e16937640 1 -- start start 2023-07-14T13:08:19.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.380+0000 7f5e16937640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5e100c8ad0 0x7f5e100c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:19.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.380+0000 7f5e16937640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e100c9560 0x7f5e100ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:19.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.380+0000 7f5e16937640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e100cc700 con 0x7f5e10158ce0 2023-07-14T13:08:19.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.380+0000 7f5e16937640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e100c99e0 con 0x7f5e100c8ad0 2023-07-14T13:08:19.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.380+0000 7f5e16937640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e100b0ff0 con 0x7f5e100c9560 2023-07-14T13:08:19.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.380+0000 7f5e0f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5e100c8ad0 0x7f5e100c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:19.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.380+0000 7f5e0ffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5e10158ce0 0x7f5e10070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58014/0 (socket says 172.21.15.5:58014) 2023-07-14T13:08:19.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.380+0000 7f5e0ffff640 1 -- 172.21.15.5:0/2554691069 learned_addr learned my addr 172.21.15.5:0/2554691069 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:19.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.380+0000 7f5e14ed4640 1 --2- 172.21.15.5:0/2554691069 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e100c9560 0x7f5e100ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:19.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.380+0000 7f5e0f7fe640 1 -- 172.21.15.5:0/2554691069 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e100c9560 msgr2=0x7f5e100ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:19.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.380+0000 7f5e0f7fe640 1 --2- 172.21.15.5:0/2554691069 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e100c9560 0x7f5e100ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:19.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.380+0000 7f5e0f7fe640 1 -- 172.21.15.5:0/2554691069 >> v1:172.21.15.5:6789/0 conn(0x7f5e10158ce0 legacy=0x7f5e10070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:19.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.380+0000 7f5e0f7fe640 1 -- 172.21.15.5:0/2554691069 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e10070c80 con 0x7f5e100c8ad0 2023-07-14T13:08:19.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.380+0000 7f5e14ed4640 1 --2- 172.21.15.5:0/2554691069 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e100c9560 0x7f5e100ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:08:19.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.380+0000 7f5e0f7fe640 1 --2- 172.21.15.5:0/2554691069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e100c8ad0 0x7f5e100c9020 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f5e040097c0 tx=0x7f5e0401c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18da8bc104e61c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:19.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.380+0000 7f5e0effd640 1 -- 172.21.15.5:0/2554691069 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e040ab600 con 0x7f5e100c8ad0 2023-07-14T13:08:19.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.384+0000 7f5e0effd640 1 -- 172.21.15.5:0/2554691069 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e040a7050 con 0x7f5e100c8ad0 2023-07-14T13:08:19.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.384+0000 7f5e0effd640 1 -- 172.21.15.5:0/2554691069 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e040ab980 con 0x7f5e100c8ad0 2023-07-14T13:08:19.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.384+0000 7f5e16937640 1 -- 172.21.15.5:0/2554691069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e100c8ad0 msgr2=0x7f5e100c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:19.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.384+0000 7f5e16937640 1 --2- 172.21.15.5:0/2554691069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e100c8ad0 0x7f5e100c9020 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f5e040097c0 tx=0x7f5e0401c330 comp rx=0 tx=0).stop 2023-07-14T13:08:19.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.384+0000 7f5e16937640 1 -- 172.21.15.5:0/2554691069 shutdown_connections 2023-07-14T13:08:19.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.384+0000 7f5e16937640 1 --2- 172.21.15.5:0/2554691069 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e100c9560 0x7f5e100ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:19.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.384+0000 7f5e16937640 1 --2- 172.21.15.5:0/2554691069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e100c8ad0 0x7f5e100c9020 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:19.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.384+0000 7f5e16937640 1 -- 172.21.15.5:0/2554691069 >> 172.21.15.5:0/2554691069 conn(0x7f5e100afcf0 msgr2=0x7f5e100b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:19.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.384+0000 7f5e16937640 1 -- 172.21.15.5:0/2554691069 shutdown_connections 2023-07-14T13:08:19.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.384+0000 7f5e16937640 1 -- 172.21.15.5:0/2554691069 wait complete. 2023-07-14T13:08:19.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.384+0000 7f5e16937640 1 Processor -- start 2023-07-14T13:08:19.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.384+0000 7f5e16937640 1 -- start start 2023-07-14T13:08:19.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.384+0000 7f5e16937640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e100c8ad0 0x7f5e100b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:19.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.384+0000 7f5e16937640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e100c9560 0x7f5e1014f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:19.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.384+0000 7f5e16937640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e10158ce0 0x7f5e10156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:19.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.384+0000 7f5e16937640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1015c630 con 0x7f5e100c8ad0 2023-07-14T13:08:19.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.384+0000 7f5e16937640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1014fbd0 con 0x7f5e10158ce0 2023-07-14T13:08:19.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.384+0000 7f5e16937640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e100c5230 con 0x7f5e100c9560 2023-07-14T13:08:19.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.384+0000 7f5e0ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e100c8ad0 0x7f5e100b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:19.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.384+0000 7f5e0ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e100c8ad0 0x7f5e100b38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38532/0 (socket says 172.21.15.5:38532) 2023-07-14T13:08:19.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.384+0000 7f5e0ffff640 1 -- 172.21.15.5:0/24227078 learned_addr learned my addr 172.21.15.5:0/24227078 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:19.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.384+0000 7f5e0f7fe640 1 --2- 172.21.15.5:0/24227078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e100c9560 0x7f5e1014f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:19.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.384+0000 7f5e14ed4640 1 --2- 172.21.15.5:0/24227078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e10158ce0 0x7f5e10156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:19.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.388+0000 7f5e0ffff640 1 -- 172.21.15.5:0/24227078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e100c9560 msgr2=0x7f5e1014f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:19.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.388+0000 7f5e0ffff640 1 --2- 172.21.15.5:0/24227078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e100c9560 0x7f5e1014f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:19.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.388+0000 7f5e0ffff640 1 -- 172.21.15.5:0/24227078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e10158ce0 msgr2=0x7f5e10156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:19.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.388+0000 7f5e0ffff640 1 --2- 172.21.15.5:0/24227078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e10158ce0 0x7f5e10156900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:19.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.388+0000 7f5e0ffff640 1 -- 172.21.15.5:0/24227078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e04009420 con 0x7f5e100c8ad0 2023-07-14T13:08:19.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.388+0000 7f5e14ed4640 1 --2- 172.21.15.5:0/24227078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e10158ce0 0x7f5e10156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:19.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.388+0000 7f5e0ffff640 1 --2- 172.21.15.5:0/24227078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e100c8ad0 0x7f5e100b38d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f5e0000c400 tx=0x7f5e0000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:19.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.388+0000 7f5e0cff9640 1 -- 172.21.15.5:0/24227078 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e00005cf0 con 0x7f5e100c8ad0 2023-07-14T13:08:19.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.388+0000 7f5e0cff9640 1 -- 172.21.15.5:0/24227078 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e00005e50 con 0x7f5e100c8ad0 2023-07-14T13:08:19.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.388+0000 7f5e0cff9640 1 -- 172.21.15.5:0/24227078 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e000072d0 con 0x7f5e100c8ad0 2023-07-14T13:08:19.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.388+0000 7f5e16937640 1 -- 172.21.15.5:0/24227078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e100c5510 con 0x7f5e100c8ad0 2023-07-14T13:08:19.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.388+0000 7f5e16937640 1 -- 172.21.15.5:0/24227078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e100c5ad0 con 0x7f5e100c8ad0 2023-07-14T13:08:19.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.388+0000 7f5e16937640 1 -- 172.21.15.5:0/24227078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e100ca1a0 con 0x7f5e100c8ad0 2023-07-14T13:08:19.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.388+0000 7f5e0cff9640 1 -- 172.21.15.5:0/24227078 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5e00007430 con 0x7f5e100c8ad0 2023-07-14T13:08:19.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.388+0000 7f5e0cff9640 1 --2- 172.21.15.5:0/24227078 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f5dfc0663a0 0x7f5dfc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:19.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.388+0000 7f5e0cff9640 1 -- 172.21.15.5:0/24227078 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5e00082ff0 con 0x7f5e100c8ad0 2023-07-14T13:08:19.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.392+0000 7f5e0f7fe640 1 --2- 172.21.15.5:0/24227078 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f5dfc0663a0 0x7f5dfc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:19.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.392+0000 7f5e0f7fe640 1 --2- 172.21.15.5:0/24227078 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f5dfc0663a0 0x7f5dfc068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5e040ad000 tx=0x7f5e04008040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:19.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.392+0000 7f5e0cff9640 1 -- 172.21.15.5:0/24227078 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f5e000506c0 con 0x7f5e100c8ad0 2023-07-14T13:08:19.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.604+0000 7f5e16937640 1 -- 172.21.15.5:0/24227078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5e1006fd30 con 0x7f5e100c8ad0 2023-07-14T13:08:19.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.604+0000 7f5e0cff9640 1 -- 172.21.15.5:0/24227078 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f5e00053ce0 con 0x7f5e100c8ad0 2023-07-14T13:08:19.639 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:19.640 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T13:08:19.640 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2023-07-14T13:08:19.640 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:08:19.640 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2023-07-14T13:08:19.641 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkGNTsMRAA5T/zjdynxEKmoNAAK0cChw==", 2023-07-14T13:08:19.641 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:08:19.641 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:08:19.641 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:08:19.641 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:08:19.641 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:08:19.641 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:08:19.641 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:08:19.642 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:08:19.642 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2023-07-14T13:08:19.642 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkqXNAAxAAb7bzXyE8cSS0A3Rz2de6TA==", 2023-07-14T13:08:19.642 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:08:19.642 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:08:19.642 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:08:19.642 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:08:19.642 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:08:19.643 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:08:19.643 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:08:19.643 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:08:19.643 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2023-07-14T13:08:19.643 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFk6NGUORAA+5odxrAlCCXYGc64nzFWwQ==", 2023-07-14T13:08:19.643 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:08:19.643 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:08:19.644 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:08:19.644 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:08:19.644 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:08:19.644 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:08:19.644 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:08:19.644 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:08:19.644 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2023-07-14T13:08:19.644 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkGh/BChAA5p9amLIC6ORC0JJov0bSVg==", 2023-07-14T13:08:19.645 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:08:19.645 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:08:19.645 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:08:19.645 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:08:19.645 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:08:19.645 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:08:19.645 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:08:19.646 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:08:19.646 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2023-07-14T13:08:19.646 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDlRLFkJ6MULhAAxExAqekc/gWudYBJ2sY4MQ==", 2023-07-14T13:08:19.646 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:08:19.646 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:08:19.646 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:08:19.646 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:08:19.646 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:08:19.647 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:08:19.647 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:08:19.647 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2023-07-14T13:08:19.647 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDoRLFksXGBNRAAFtHZt5OQw0aB6k3CkxOzZQ==", 2023-07-14T13:08:19.647 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:08:19.647 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:08:19.647 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:08:19.647 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:08:19.648 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:08:19.648 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:08:19.648 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:08:19.648 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2023-07-14T13:08:19.648 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDsRLFkaUH0ARAAkqgsKPX1dTSZQjn0cRxxRQ==", 2023-07-14T13:08:19.648 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:08:19.648 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:08:19.649 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:08:19.649 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:08:19.649 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:08:19.649 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:08:19.649 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:08:19.649 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2023-07-14T13:08:19.649 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDvRLFkvElJCRAAnox5LKwobP/1Qaf5d9UsjA==", 2023-07-14T13:08:19.649 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:08:19.650 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:08:19.650 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:08:19.650 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:08:19.650 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:08:19.651 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:08:19.651 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:08:19.651 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2023-07-14T13:08:19.651 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD1RLFkMNyyDxAA19dJkhhuSpcgVPQEyxb3lg==", 2023-07-14T13:08:19.651 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:08:19.651 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:08:19.652 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:08:19.652 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:08:19.652 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:08:19.652 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:08:19.652 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:08:19.652 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2023-07-14T13:08:19.652 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD4RLFkR8mTFhAAP5qUgUJI23XOvVAnNCSgRQ==", 2023-07-14T13:08:19.653 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:08:19.653 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:08:19.653 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:08:19.653 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:08:19.653 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:08:19.653 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:08:19.653 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:08:19.653 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2023-07-14T13:08:19.654 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD7RLFkpWL9HBAAo8MfszRnB4sHsDPPcRjCAg==", 2023-07-14T13:08:19.654 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:08:19.654 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:08:19.654 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:08:19.654 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:08:19.654 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:08:19.654 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:08:19.655 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:08:19.655 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2023-07-14T13:08:19.655 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD+RLFkL5cRIxAAF/4ndtYf0oiH3uhhDKnQQg==", 2023-07-14T13:08:19.655 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:08:19.655 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:08:19.655 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:08:19.655 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:08:19.655 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:08:19.656 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:08:19.656 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:08:19.656 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2023-07-14T13:08:19.656 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkCav/DhAA6SOiONAbTcWCnUZXcm7BcQ==", 2023-07-14T13:08:19.656 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:08:19.656 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:08:19.656 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2023-07-14T13:08:19.656 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-14T13:08:19.657 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:08:19.657 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:08:19.657 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:08:19.657 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2023-07-14T13:08:19.657 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkgS/hGBAAevMD2/lfNuaeV74w0Xj0Zw==", 2023-07-14T13:08:19.657 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:08:19.657 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:08:19.658 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T13:08:19.658 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T13:08:19.658 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T13:08:19.658 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:08:19.658 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:08:19.658 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:08:19.658 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2023-07-14T13:08:19.658 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkeBs4FRAAJ/UjIEKDajVyDb7PejPqAw==", 2023-07-14T13:08:19.659 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:08:19.659 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:08:19.659 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T13:08:19.659 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T13:08:19.659 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T13:08:19.659 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:08:19.660 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:08:19.660 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:08:19.660 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2023-07-14T13:08:19.660 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkSkDiHhAAV86wIrAVz3o/PI2CaBC44w==", 2023-07-14T13:08:19.661 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:08:19.661 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:08:19.661 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T13:08:19.661 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T13:08:19.661 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T13:08:19.661 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:08:19.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:08:19.662 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:08:19.663 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2023-07-14T13:08:19.663 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkk5IcFRAAThI0P1N8LsRetmwhHqSvdQ==", 2023-07-14T13:08:19.663 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:08:19.663 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T13:08:19.663 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:08:19.663 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:08:19.663 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:08:19.664 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:08:19.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:08:19.664 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:08:19.664 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2023-07-14T13:08:19.664 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkugeXLRAAEVAnLk/dldtqrpkdzQI3SA==", 2023-07-14T13:08:19.664 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:08:19.664 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T13:08:19.665 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-07-14T13:08:19.665 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:08:19.665 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:08:19.665 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:08:19.665 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:08:19.665 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2023-07-14T13:08:19.666 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkSvp/KRAAwvjYlrZYNeGbhCiDrTmnrA==", 2023-07-14T13:08:19.666 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:08:19.666 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T13:08:19.666 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-07-14T13:08:19.666 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:08:19.666 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:08:19.667 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:08:19.667 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-07-14T13:08:19.667 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T13:08:19.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.608+0000 7f5e16937640 1 -- 172.21.15.5:0/24227078 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f5dfc0663a0 msgr2=0x7f5dfc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:19.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.608+0000 7f5e16937640 1 --2- 172.21.15.5:0/24227078 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f5dfc0663a0 0x7f5dfc068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5e040ad000 tx=0x7f5e04008040 comp rx=0 tx=0).stop 2023-07-14T13:08:19.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.608+0000 7f5e16937640 1 -- 172.21.15.5:0/24227078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e100c8ad0 msgr2=0x7f5e100b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:19.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.608+0000 7f5e16937640 1 --2- 172.21.15.5:0/24227078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e100c8ad0 0x7f5e100b38d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f5e0000c400 tx=0x7f5e0000c8c0 comp rx=0 tx=0).stop 2023-07-14T13:08:19.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.608+0000 7f5e16937640 1 -- 172.21.15.5:0/24227078 shutdown_connections 2023-07-14T13:08:19.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.608+0000 7f5e16937640 1 --2- 172.21.15.5:0/24227078 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f5dfc0663a0 0x7f5dfc068850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:19.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.608+0000 7f5e16937640 1 --2- 172.21.15.5:0/24227078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e10158ce0 0x7f5e10156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:19.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.608+0000 7f5e16937640 1 --2- 172.21.15.5:0/24227078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5e100c9560 0x7f5e1014f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:19.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.608+0000 7f5e16937640 1 --2- 172.21.15.5:0/24227078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e100c8ad0 0x7f5e100b38d0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:19.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.608+0000 7f5e16937640 1 -- 172.21.15.5:0/24227078 >> 172.21.15.5:0/24227078 conn(0x7f5e100afcf0 msgr2=0x7f5e10070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:19.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.608+0000 7f5e16937640 1 -- 172.21.15.5:0/24227078 shutdown_connections 2023-07-14T13:08:19.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.608+0000 7f5e16937640 1 -- 172.21.15.5:0/24227078 wait complete. 2023-07-14T13:08:19.672 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:08:19.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.784+0000 7f54697d2640 1 Processor -- start 2023-07-14T13:08:19.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.784+0000 7f54697d2640 1 -- start start 2023-07-14T13:08:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.784+0000 7f54697d2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f546415bc00 0x7f54640ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.784+0000 7f54697d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5464069430 0x7f5464069870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:19.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.784+0000 7f54697d2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54640c9c30 con 0x7f5464160450 2023-07-14T13:08:19.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.784+0000 7f54697d2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54640c96b0 con 0x7f546415bc00 2023-07-14T13:08:19.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.784+0000 7f54697d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5464069db0 con 0x7f5464069430 2023-07-14T13:08:19.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.784+0000 7f5462ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f546415bc00 0x7f54640ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:19.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.784+0000 7f5462ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f546415bc00 0x7f54640ce8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38548/0 (socket says 172.21.15.5:38548) 2023-07-14T13:08:19.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.784+0000 7f5462ffd640 1 -- 172.21.15.5:0/2380661740 learned_addr learned my addr 172.21.15.5:0/2380661740 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.788+0000 7f54637fe640 1 --2- 172.21.15.5:0/2380661740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5464069430 0x7f5464069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.788+0000 7f5462ffd640 1 -- 172.21.15.5:0/2380661740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5464069430 msgr2=0x7f5464069870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.788+0000 7f5462ffd640 1 --2- 172.21.15.5:0/2380661740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5464069430 0x7f5464069870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.788+0000 7f5462ffd640 1 -- 172.21.15.5:0/2380661740 >> v1:172.21.15.154:6789/0 conn(0x7f5464160450 legacy=0x7f546406e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.788+0000 7f5462ffd640 1 -- 172.21.15.5:0/2380661740 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546415bfd0 con 0x7f546415bc00 2023-07-14T13:08:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.788+0000 7f5462ffd640 1 --2- 172.21.15.5:0/2380661740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f546415bc00 0x7f54640ce8f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f5454009870 tx=0x7f545401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ed7fa694f970bf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.788+0000 7f54627fc640 1 -- 172.21.15.5:0/2380661740 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54540aa680 con 0x7f546415bc00 2023-07-14T13:08:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.788+0000 7f54627fc640 1 -- 172.21.15.5:0/2380661740 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54540aa7e0 con 0x7f546415bc00 2023-07-14T13:08:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.788+0000 7f54627fc640 1 -- 172.21.15.5:0/2380661740 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54540aab70 con 0x7f546415bc00 2023-07-14T13:08:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.788+0000 7f54697d2640 1 -- 172.21.15.5:0/2380661740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f546415bc00 msgr2=0x7f54640ce8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.788+0000 7f54697d2640 1 --2- 172.21.15.5:0/2380661740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f546415bc00 0x7f54640ce8f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f5454009870 tx=0x7f545401c520 comp rx=0 tx=0).stop 2023-07-14T13:08:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.792+0000 7f54697d2640 1 -- 172.21.15.5:0/2380661740 shutdown_connections 2023-07-14T13:08:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.792+0000 7f54697d2640 1 --2- 172.21.15.5:0/2380661740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5464069430 0x7f5464069870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.792+0000 7f54697d2640 1 --2- 172.21.15.5:0/2380661740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f546415bc00 0x7f54640ce8f0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.792+0000 7f54697d2640 1 -- 172.21.15.5:0/2380661740 >> 172.21.15.5:0/2380661740 conn(0x7f54640b1840 msgr2=0x7f54640cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.792+0000 7f54697d2640 1 -- 172.21.15.5:0/2380661740 shutdown_connections 2023-07-14T13:08:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.792+0000 7f54697d2640 1 -- 172.21.15.5:0/2380661740 wait complete. 2023-07-14T13:08:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.792+0000 7f54697d2640 1 Processor -- start 2023-07-14T13:08:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.792+0000 7f54697d2640 1 -- start start 2023-07-14T13:08:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.792+0000 7f54697d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5464069430 0x7f546414e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.792+0000 7f54697d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f546415bc00 0x7f546415cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.792+0000 7f54697d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5464160450 0x7f546406c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.792+0000 7f54697d2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546415eb90 con 0x7f546415bc00 2023-07-14T13:08:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.792+0000 7f54697d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54640b2bb0 con 0x7f5464160450 2023-07-14T13:08:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.792+0000 7f54697d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54640b2e90 con 0x7f5464069430 2023-07-14T13:08:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.792+0000 7f545bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f546415bc00 0x7f546415cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.792+0000 7f545bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f546415bc00 0x7f546415cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38554/0 (socket says 172.21.15.5:38554) 2023-07-14T13:08:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.792+0000 7f545bfff640 1 -- 172.21.15.5:0/1719814790 learned_addr learned my addr 172.21.15.5:0/1719814790 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.792+0000 7f5462ffd640 1 --2- 172.21.15.5:0/1719814790 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5464069430 0x7f546414e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.792+0000 7f54637fe640 1 --2- 172.21.15.5:0/1719814790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5464160450 0x7f546406c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.792+0000 7f545bfff640 1 -- 172.21.15.5:0/1719814790 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5464069430 msgr2=0x7f546414e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.792+0000 7f545bfff640 1 --2- 172.21.15.5:0/1719814790 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5464069430 0x7f546414e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.792+0000 7f545bfff640 1 -- 172.21.15.5:0/1719814790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5464160450 msgr2=0x7f546406c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.792+0000 7f545bfff640 1 --2- 172.21.15.5:0/1719814790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5464160450 0x7f546406c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.792+0000 7f545bfff640 1 -- 172.21.15.5:0/1719814790 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54540094d0 con 0x7f546415bc00 2023-07-14T13:08:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.792+0000 7f54637fe640 1 --2- 172.21.15.5:0/1719814790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5464160450 0x7f546406c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.792+0000 7f545bfff640 1 --2- 172.21.15.5:0/1719814790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f546415bc00 0x7f546415cb70 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f544c00c3c0 tx=0x7f544c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.796+0000 7f545b7fe640 1 -- 172.21.15.5:0/1719814790 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c0052d0 con 0x7f546415bc00 2023-07-14T13:08:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.796+0000 7f545b7fe640 1 -- 172.21.15.5:0/1719814790 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544c005430 con 0x7f546415bc00 2023-07-14T13:08:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.796+0000 7f545b7fe640 1 -- 172.21.15.5:0/1719814790 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c003840 con 0x7f546415bc00 2023-07-14T13:08:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.796+0000 7f54697d2640 1 -- 172.21.15.5:0/1719814790 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54640b3170 con 0x7f546415bc00 2023-07-14T13:08:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.796+0000 7f54697d2640 1 -- 172.21.15.5:0/1719814790 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54640b3730 con 0x7f546415bc00 2023-07-14T13:08:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.796+0000 7f54697d2640 1 -- 172.21.15.5:0/1719814790 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54640678d0 con 0x7f546415bc00 2023-07-14T13:08:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.796+0000 7f545b7fe640 1 -- 172.21.15.5:0/1719814790 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f544c0039a0 con 0x7f546415bc00 2023-07-14T13:08:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.796+0000 7f545b7fe640 1 --2- 172.21.15.5:0/1719814790 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f54440663d0 0x7f5444068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.796+0000 7f545b7fe640 1 -- 172.21.15.5:0/1719814790 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f544c082f80 con 0x7f546415bc00 2023-07-14T13:08:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.796+0000 7f5462ffd640 1 --2- 172.21.15.5:0/1719814790 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f54440663d0 0x7f5444068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.800+0000 7f5462ffd640 1 --2- 172.21.15.5:0/1719814790 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f54440663d0 0x7f5444068880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f54540ae000 tx=0x7f54540b5040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.800+0000 7f545b7fe640 1 -- 172.21.15.5:0/1719814790 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f544c0b3720 con 0x7f546415bc00 2023-07-14T13:08:19.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.960+0000 7f54697d2640 1 -- 172.21.15.5:0/1719814790 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54640cfbf0 con 0x7f546415bc00 2023-07-14T13:08:19.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.960+0000 7f545b7fe640 1 -- 172.21.15.5:0/1719814790 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+14591 (secure 0 0 0) 0x7f544c0506f0 con 0x7f546415bc00 2023-07-14T13:08:19.994 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:19.995 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":79,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:08:19.202700+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:08:19.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.960+0000 7f54697d2640 1 -- 172.21.15.5:0/1719814790 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f54440663d0 msgr2=0x7f5444068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:19.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.960+0000 7f54697d2640 1 --2- 172.21.15.5:0/1719814790 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f54440663d0 0x7f5444068880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f54540ae000 tx=0x7f54540b5040 comp rx=0 tx=0).stop 2023-07-14T13:08:19.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.960+0000 7f54697d2640 1 -- 172.21.15.5:0/1719814790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f546415bc00 msgr2=0x7f546415cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:19.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.960+0000 7f54697d2640 1 --2- 172.21.15.5:0/1719814790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f546415bc00 0x7f546415cb70 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f544c00c3c0 tx=0x7f544c00c880 comp rx=0 tx=0).stop 2023-07-14T13:08:19.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.960+0000 7f54697d2640 1 -- 172.21.15.5:0/1719814790 shutdown_connections 2023-07-14T13:08:19.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.960+0000 7f54697d2640 1 --2- 172.21.15.5:0/1719814790 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f54440663d0 0x7f5444068880 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:19.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.960+0000 7f54697d2640 1 --2- 172.21.15.5:0/1719814790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5464160450 0x7f546406c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:19.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.960+0000 7f54697d2640 1 --2- 172.21.15.5:0/1719814790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f546415bc00 0x7f546415cb70 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:19.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.960+0000 7f54697d2640 1 --2- 172.21.15.5:0/1719814790 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5464069430 0x7f546414e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:19.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.960+0000 7f54697d2640 1 -- 172.21.15.5:0/1719814790 >> 172.21.15.5:0/1719814790 conn(0x7f54640b1840 msgr2=0x7f54640b0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:19.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.960+0000 7f54697d2640 1 -- 172.21.15.5:0/1719814790 shutdown_connections 2023-07-14T13:08:19.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:19.960+0000 7f54697d2640 1 -- 172.21.15.5:0/1719814790 wait complete. 2023-07-14T13:08:20.015 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:08:20.016 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:08:20.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.128+0000 7fec39b9f640 1 Processor -- start 2023-07-14T13:08:20.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.128+0000 7fec39b9f640 1 -- start start 2023-07-14T13:08:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.128+0000 7fec39b9f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec3406a440 0x7fec340b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.128+0000 7fec39b9f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fec341453a0 0x7fec3406c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.128+0000 7fec39b9f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec3406c040 con 0x7fec3415f690 2023-07-14T13:08:20.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.128+0000 7fec39b9f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec34160170 con 0x7fec341453a0 2023-07-14T13:08:20.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.132+0000 7fec39b9f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec34160600 con 0x7fec3406a440 2023-07-14T13:08:20.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.132+0000 7fec33fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fec341453a0 0x7fec3406c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:20.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.132+0000 7fec337fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fec3415f690 0x7fec3415fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:50212/0 (socket says 172.21.15.5:50212) 2023-07-14T13:08:20.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.132+0000 7fec33fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fec341453a0 0x7fec3406c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:52676/0 (socket says 172.21.15.5:52676) 2023-07-14T13:08:20.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.132+0000 7fec337fe640 1 -- 172.21.15.5:0/2336212496 learned_addr learned my addr 172.21.15.5:0/2336212496 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:20.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.132+0000 7fec32ffd640 1 --2- 172.21.15.5:0/2336212496 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec3406a440 0x7fec340b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:20.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.132+0000 7fec33fff640 1 -- 172.21.15.5:0/2336212496 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec3406a440 msgr2=0x7fec340b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:20.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.132+0000 7fec33fff640 1 --2- 172.21.15.5:0/2336212496 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec3406a440 0x7fec340b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:20.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.132+0000 7fec33fff640 1 -- 172.21.15.5:0/2336212496 >> v1:172.21.15.154:6789/0 conn(0x7fec3415f690 legacy=0x7fec3415fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:20.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.132+0000 7fec33fff640 1 -- 172.21.15.5:0/2336212496 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec34160360 con 0x7fec341453a0 2023-07-14T13:08:20.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.132+0000 7fec327fc640 1 -- 172.21.15.5:0/2336212496 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894018314 0 0) 0x7fec3406c040 con 0x7fec3415f690 2023-07-14T13:08:20.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.132+0000 7fec33fff640 1 --2- 172.21.15.5:0/2336212496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec341453a0 0x7fec3406c4d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fec2c009d90 tx=0x7fec2c01c6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c995b850629bd809 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:20.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.136+0000 7fec327fc640 1 -- 172.21.15.5:0/2336212496 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c0a6690 con 0x7fec341453a0 2023-07-14T13:08:20.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.136+0000 7fec327fc640 1 -- 172.21.15.5:0/2336212496 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec2c0a67f0 con 0x7fec341453a0 2023-07-14T13:08:20.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.136+0000 7fec327fc640 1 -- 172.21.15.5:0/2336212496 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c0a6b80 con 0x7fec341453a0 2023-07-14T13:08:20.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.136+0000 7fec39b9f640 1 -- 172.21.15.5:0/2336212496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec341453a0 msgr2=0x7fec3406c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:20.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.136+0000 7fec39b9f640 1 --2- 172.21.15.5:0/2336212496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec341453a0 0x7fec3406c4d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fec2c009d90 tx=0x7fec2c01c6b0 comp rx=0 tx=0).stop 2023-07-14T13:08:20.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.136+0000 7fec39b9f640 1 -- 172.21.15.5:0/2336212496 shutdown_connections 2023-07-14T13:08:20.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.136+0000 7fec39b9f640 1 --2- 172.21.15.5:0/2336212496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec341453a0 0x7fec3406c4d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:20.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.136+0000 7fec39b9f640 1 --2- 172.21.15.5:0/2336212496 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec3406a440 0x7fec340b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:20.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.136+0000 7fec39b9f640 1 -- 172.21.15.5:0/2336212496 >> 172.21.15.5:0/2336212496 conn(0x7fec340b1210 msgr2=0x7fec340ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:20.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.136+0000 7fec39b9f640 1 -- 172.21.15.5:0/2336212496 shutdown_connections 2023-07-14T13:08:20.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.136+0000 7fec39b9f640 1 -- 172.21.15.5:0/2336212496 wait complete. 2023-07-14T13:08:20.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.136+0000 7fec39b9f640 1 Processor -- start 2023-07-14T13:08:20.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.136+0000 7fec39b9f640 1 -- start start 2023-07-14T13:08:20.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.136+0000 7fec39b9f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec3406a440 0x7fec34143b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:20.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.136+0000 7fec39b9f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec341453a0 0x7fec3413c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:20.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.136+0000 7fec39b9f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec3415f690 0x7fec34158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:20.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.136+0000 7fec39b9f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3415e890 con 0x7fec3415f690 2023-07-14T13:08:20.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.136+0000 7fec39b9f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec34159940 con 0x7fec341453a0 2023-07-14T13:08:20.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.136+0000 7fec39b9f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec3415eb30 con 0x7fec3406a440 2023-07-14T13:08:20.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.140+0000 7fec33fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec3415f690 0x7fec34158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:20.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.140+0000 7fec33fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec3415f690 0x7fec34158ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38558/0 (socket says 172.21.15.5:38558) 2023-07-14T13:08:20.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.140+0000 7fec33fff640 1 -- 172.21.15.5:0/429689043 learned_addr learned my addr 172.21.15.5:0/429689043 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:20.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.140+0000 7fec337fe640 1 --2- 172.21.15.5:0/429689043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec3406a440 0x7fec34143b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:20.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.140+0000 7fec32ffd640 1 --2- 172.21.15.5:0/429689043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec341453a0 0x7fec3413c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:20.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.140+0000 7fec33fff640 1 -- 172.21.15.5:0/429689043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec3406a440 msgr2=0x7fec34143b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:20.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.140+0000 7fec33fff640 1 --2- 172.21.15.5:0/429689043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec3406a440 0x7fec34143b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:20.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.140+0000 7fec33fff640 1 -- 172.21.15.5:0/429689043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec341453a0 msgr2=0x7fec3413c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:20.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.140+0000 7fec33fff640 1 --2- 172.21.15.5:0/429689043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec341453a0 0x7fec3413c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:20.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.140+0000 7fec33fff640 1 -- 172.21.15.5:0/429689043 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c009a70 con 0x7fec3415f690 2023-07-14T13:08:20.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.140+0000 7fec33fff640 1 --2- 172.21.15.5:0/429689043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec3415f690 0x7fec34158ca0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fec2c009d90 tx=0x7fec2c019450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:20.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.140+0000 7fec1bfff640 1 -- 172.21.15.5:0/429689043 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c0b6070 con 0x7fec3415f690 2023-07-14T13:08:20.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.140+0000 7fec1bfff640 1 -- 172.21.15.5:0/429689043 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec2c0a7470 con 0x7fec3415f690 2023-07-14T13:08:20.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.140+0000 7fec1bfff640 1 -- 172.21.15.5:0/429689043 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c0a7820 con 0x7fec3415f690 2023-07-14T13:08:20.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.140+0000 7fec39b9f640 1 -- 172.21.15.5:0/429689043 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec3415ee10 con 0x7fec3415f690 2023-07-14T13:08:20.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.140+0000 7fec39b9f640 1 -- 172.21.15.5:0/429689043 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec3415cd90 con 0x7fec3415f690 2023-07-14T13:08:20.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.140+0000 7fec39b9f640 1 -- 172.21.15.5:0/429689043 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec340678d0 con 0x7fec3415f690 2023-07-14T13:08:20.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.140+0000 7fec1bfff640 1 -- 172.21.15.5:0/429689043 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fec2c0a7980 con 0x7fec3415f690 2023-07-14T13:08:20.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.144+0000 7fec1bfff640 1 --2- 172.21.15.5:0/429689043 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fec200663a0 0x7fec20068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:20.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.144+0000 7fec1bfff640 1 -- 172.21.15.5:0/429689043 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fec2c11e030 con 0x7fec3415f690 2023-07-14T13:08:20.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.144+0000 7fec337fe640 1 --2- 172.21.15.5:0/429689043 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fec200663a0 0x7fec20068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:20.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.144+0000 7fec337fe640 1 --2- 172.21.15.5:0/429689043 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fec200663a0 0x7fec20068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fec24007fd0 tx=0x7fec24007d60 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:20.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.148+0000 7fec1bfff640 1 -- 172.21.15.5:0/429689043 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fec2c0eb690 con 0x7fec3415f690 2023-07-14T13:08:20.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.304+0000 7fec39b9f640 1 -- 172.21.15.5:0/429689043 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fec340cf300 con 0x7fec3415f690 2023-07-14T13:08:20.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.304+0000 7fec1bfff640 1 -- 172.21.15.5:0/429689043 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7fec2c0eecb0 con 0x7fec3415f690 2023-07-14T13:08:20.338 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:08:20.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.304+0000 7fec39b9f640 1 -- 172.21.15.5:0/429689043 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fec200663a0 msgr2=0x7fec20068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:20.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.304+0000 7fec39b9f640 1 --2- 172.21.15.5:0/429689043 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fec200663a0 0x7fec20068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fec24007fd0 tx=0x7fec24007d60 comp rx=0 tx=0).stop 2023-07-14T13:08:20.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.304+0000 7fec39b9f640 1 -- 172.21.15.5:0/429689043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec3415f690 msgr2=0x7fec34158ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:20.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.304+0000 7fec39b9f640 1 --2- 172.21.15.5:0/429689043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec3415f690 0x7fec34158ca0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fec2c009d90 tx=0x7fec2c019450 comp rx=0 tx=0).stop 2023-07-14T13:08:20.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.304+0000 7fec39b9f640 1 -- 172.21.15.5:0/429689043 shutdown_connections 2023-07-14T13:08:20.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.304+0000 7fec39b9f640 1 --2- 172.21.15.5:0/429689043 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fec200663a0 0x7fec20068850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:20.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.304+0000 7fec39b9f640 1 --2- 172.21.15.5:0/429689043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec3415f690 0x7fec34158ca0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:20.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.304+0000 7fec39b9f640 1 --2- 172.21.15.5:0/429689043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec341453a0 0x7fec3413c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:20.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.304+0000 7fec39b9f640 1 --2- 172.21.15.5:0/429689043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec3406a440 0x7fec34143b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:20.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.304+0000 7fec39b9f640 1 -- 172.21.15.5:0/429689043 >> 172.21.15.5:0/429689043 conn(0x7fec340b1210 msgr2=0x7fec340b2240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:20.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.308+0000 7fec39b9f640 1 -- 172.21.15.5:0/429689043 shutdown_connections 2023-07-14T13:08:20.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.308+0000 7fec39b9f640 1 -- 172.21.15.5:0/429689043 wait complete. 2023-07-14T13:08:20.360 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:08:20.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.472+0000 7f160800b640 1 Processor -- start 2023-07-14T13:08:20.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.472+0000 7f160800b640 1 -- start start 2023-07-14T13:08:20.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.476+0000 7f160800b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f160006a540 0x7f160006a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:20.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.476+0000 7f160800b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f16000cf710 0x7f16000cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:20.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.476+0000 7f160800b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16000cb7a0 con 0x7f16000cf2e0 2023-07-14T13:08:20.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.476+0000 7f160800b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16000d0920 con 0x7f160006a540 2023-07-14T13:08:20.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.476+0000 7f160800b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160015bfd0 con 0x7f16000cf710 2023-07-14T13:08:20.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.476+0000 7f1605da7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f160006a540 0x7f160006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:20.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.476+0000 7f16055a6640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f16000cf2e0 0x7f16000cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58016/0 (socket says 172.21.15.5:58016) 2023-07-14T13:08:20.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.476+0000 7f16055a6640 1 -- 172.21.15.5:0/30680154 learned_addr learned my addr 172.21.15.5:0/30680154 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:20.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.476+0000 7f1605da7640 1 -- 172.21.15.5:0/30680154 >> v2:172.21.15.154:3300/0 conn(0x7f16000cf710 msgr2=0x7f16000cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:20.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.476+0000 7f16065a8640 1 --2- 172.21.15.5:0/30680154 >> v2:172.21.15.154:3300/0 conn(0x7f16000cf710 0x7f16000cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:20.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.476+0000 7f1605da7640 1 --2- 172.21.15.5:0/30680154 >> v2:172.21.15.154:3300/0 conn(0x7f16000cf710 0x7f16000cd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:20.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.476+0000 7f1605da7640 1 -- 172.21.15.5:0/30680154 >> v1:172.21.15.5:6789/0 conn(0x7f16000cf2e0 legacy=0x7f16000cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:20.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.476+0000 7f1605da7640 1 -- 172.21.15.5:0/30680154 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160006ae50 con 0x7f160006a540 2023-07-14T13:08:20.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.476+0000 7f1604da5640 1 -- 172.21.15.5:0/30680154 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2419893838 0 0) 0x7f16000cb7a0 con 0x7f16000cf2e0 2023-07-14T13:08:20.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.476+0000 7f16065a8640 1 --2- 172.21.15.5:0/30680154 >> v2:172.21.15.154:3300/0 conn(0x7f16000cf710 0x7f16000cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:08:20.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.476+0000 7f1605da7640 1 --2- 172.21.15.5:0/30680154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f160006a540 0x7f160006a910 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f16000712c0 tx=0x7f15fc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19e404e12a9e80d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:20.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.480+0000 7f1604da5640 1 -- 172.21.15.5:0/30680154 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc0ab600 con 0x7f160006a540 2023-07-14T13:08:20.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.480+0000 7f1604da5640 1 -- 172.21.15.5:0/30680154 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15fc0a7050 con 0x7f160006a540 2023-07-14T13:08:20.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.480+0000 7f1604da5640 1 -- 172.21.15.5:0/30680154 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc0ab980 con 0x7f160006a540 2023-07-14T13:08:20.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.480+0000 7f160800b640 1 -- 172.21.15.5:0/30680154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f160006a540 msgr2=0x7f160006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:20.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.480+0000 7f160800b640 1 --2- 172.21.15.5:0/30680154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f160006a540 0x7f160006a910 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f16000712c0 tx=0x7f15fc01c430 comp rx=0 tx=0).stop 2023-07-14T13:08:20.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.480+0000 7f160800b640 1 -- 172.21.15.5:0/30680154 shutdown_connections 2023-07-14T13:08:20.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.480+0000 7f160800b640 1 --2- 172.21.15.5:0/30680154 >> v2:172.21.15.154:3300/0 conn(0x7f16000cf710 0x7f16000cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:20.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.480+0000 7f160800b640 1 --2- 172.21.15.5:0/30680154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f160006a540 0x7f160006a910 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:20.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.480+0000 7f160800b640 1 -- 172.21.15.5:0/30680154 >> 172.21.15.5:0/30680154 conn(0x7f1600099490 msgr2=0x7f1600089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:20.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.480+0000 7f160800b640 1 -- 172.21.15.5:0/30680154 shutdown_connections 2023-07-14T13:08:20.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.480+0000 7f160800b640 1 -- 172.21.15.5:0/30680154 wait complete. 2023-07-14T13:08:20.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.480+0000 7f160800b640 1 Processor -- start 2023-07-14T13:08:20.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.480+0000 7f160800b640 1 -- start start 2023-07-14T13:08:20.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.480+0000 7f160800b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f160006a540 0x7f16000b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:20.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.480+0000 7f160800b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16000cf2e0 0x7f16001f7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.480+0000 7f160800b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16000cf710 0x7f16001f7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.480+0000 7f160800b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160014b050 con 0x7f16000cf2e0 2023-07-14T13:08:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.480+0000 7f160800b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16001f7d70 con 0x7f16000cf710 2023-07-14T13:08:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.480+0000 7f160800b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16000b5100 con 0x7f160006a540 2023-07-14T13:08:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.480+0000 7f16055a6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16000cf2e0 0x7f16001f7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.480+0000 7f16055a6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16000cf2e0 0x7f16001f7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38580/0 (socket says 172.21.15.5:38580) 2023-07-14T13:08:20.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.480+0000 7f16055a6640 1 -- 172.21.15.5:0/245954104 learned_addr learned my addr 172.21.15.5:0/245954104 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:20.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.484+0000 7f16065a8640 1 --2- 172.21.15.5:0/245954104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16000cf710 0x7f16001f7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.484+0000 7f1605da7640 1 --2- 172.21.15.5:0/245954104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f160006a540 0x7f16000b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.484+0000 7f16055a6640 1 -- 172.21.15.5:0/245954104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f160006a540 msgr2=0x7f16000b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.484+0000 7f16055a6640 1 --2- 172.21.15.5:0/245954104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f160006a540 0x7f16000b5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.484+0000 7f16055a6640 1 -- 172.21.15.5:0/245954104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16000cf710 msgr2=0x7f16001f7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:20.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.484+0000 7f16055a6640 1 --2- 172.21.15.5:0/245954104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16000cf710 0x7f16001f7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.484+0000 7f16055a6640 1 -- 172.21.15.5:0/245954104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15fc009420 con 0x7f16000cf2e0 2023-07-14T13:08:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.484+0000 7f16065a8640 1 --2- 172.21.15.5:0/245954104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16000cf710 0x7f16001f7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:08:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.484+0000 7f16055a6640 1 --2- 172.21.15.5:0/245954104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16000cf2e0 0x7f16001f7200 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f15f000c450 tx=0x7f15f000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.484+0000 7f15f67fc640 1 -- 172.21.15.5:0/245954104 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f00074e0 con 0x7f16000cf2e0 2023-07-14T13:08:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.484+0000 7f15f67fc640 1 -- 172.21.15.5:0/245954104 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f0007640 con 0x7f16000cf2e0 2023-07-14T13:08:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.484+0000 7f160800b640 1 -- 172.21.15.5:0/245954104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16000b53e0 con 0x7f16000cf2e0 2023-07-14T13:08:20.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.484+0000 7f15f67fc640 1 -- 172.21.15.5:0/245954104 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f00049f0 con 0x7f16000cf2e0 2023-07-14T13:08:20.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.484+0000 7f160800b640 1 -- 172.21.15.5:0/245954104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16001f8050 con 0x7f16000cf2e0 2023-07-14T13:08:20.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.484+0000 7f160800b640 1 -- 172.21.15.5:0/245954104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16000b4f60 con 0x7f16000cf2e0 2023-07-14T13:08:20.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.484+0000 7f15f67fc640 1 -- 172.21.15.5:0/245954104 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f15f0004b50 con 0x7f16000cf2e0 2023-07-14T13:08:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.484+0000 7f15f67fc640 1 --2- 172.21.15.5:0/245954104 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f15e40663a0 0x7f15e4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.484+0000 7f15f67fc640 1 -- 172.21.15.5:0/245954104 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f15f0083130 con 0x7f16000cf2e0 2023-07-14T13:08:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.488+0000 7f1605da7640 1 --2- 172.21.15.5:0/245954104 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f15e40663a0 0x7f15e4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:20.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.488+0000 7f1605da7640 1 --2- 172.21.15.5:0/245954104 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f15e40663a0 0x7f15e4068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f160006fc40 tx=0x7f15fc008040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:20.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.488+0000 7f15f67fc640 1 -- 172.21.15.5:0/245954104 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f16000b4f60 con 0x7f16000cf2e0 2023-07-14T13:08:20.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.644+0000 7f160800b640 1 -- 172.21.15.5:0/245954104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f16000b4f60 con 0x7f16000cf2e0 2023-07-14T13:08:20.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.644+0000 7f15f67fc640 1 -- 172.21.15.5:0/245954104 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v79) v1 ==== 92+0+10 (secure 0 0 0) 0x7f15f0018020 con 0x7f16000cf2e0 2023-07-14T13:08:20.679 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:08:20.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.648+0000 7f160800b640 1 -- 172.21.15.5:0/245954104 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f15e40663a0 msgr2=0x7f15e4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:20.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.648+0000 7f160800b640 1 --2- 172.21.15.5:0/245954104 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f15e40663a0 0x7f15e4068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f160006fc40 tx=0x7f15fc008040 comp rx=0 tx=0).stop 2023-07-14T13:08:20.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.648+0000 7f160800b640 1 -- 172.21.15.5:0/245954104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16000cf2e0 msgr2=0x7f16001f7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:20.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.648+0000 7f160800b640 1 --2- 172.21.15.5:0/245954104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16000cf2e0 0x7f16001f7200 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f15f000c450 tx=0x7f15f000c910 comp rx=0 tx=0).stop 2023-07-14T13:08:20.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.648+0000 7f160800b640 1 -- 172.21.15.5:0/245954104 shutdown_connections 2023-07-14T13:08:20.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.648+0000 7f160800b640 1 --2- 172.21.15.5:0/245954104 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f15e40663a0 0x7f15e4068850 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:20.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.648+0000 7f160800b640 1 --2- 172.21.15.5:0/245954104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16000cf710 0x7f16001f7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:20.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.648+0000 7f160800b640 1 --2- 172.21.15.5:0/245954104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16000cf2e0 0x7f16001f7200 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:20.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.648+0000 7f160800b640 1 --2- 172.21.15.5:0/245954104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f160006a540 0x7f16000b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:20.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.648+0000 7f160800b640 1 -- 172.21.15.5:0/245954104 >> 172.21.15.5:0/245954104 conn(0x7f1600099490 msgr2=0x7f16000cded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:20.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.648+0000 7f160800b640 1 -- 172.21.15.5:0/245954104 shutdown_connections 2023-07-14T13:08:20.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.648+0000 7f160800b640 1 -- 172.21.15.5:0/245954104 wait complete. 2023-07-14T13:08:20.700 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-14T13:08:20.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.812+0000 7f25ec974640 1 Processor -- start 2023-07-14T13:08:20.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.812+0000 7f25ec974640 1 -- start start 2023-07-14T13:08:20.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.812+0000 7f25ec974640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25e80d06b0 0x7f25e80b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:20.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.812+0000 7f25ec974640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e80b2410 con 0x7f25e80b1f70 2023-07-14T13:08:20.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.812+0000 7f25ec974640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e80b26f0 con 0x7f25e8145430 2023-07-14T13:08:20.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.812+0000 7f25ec974640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e80b29d0 con 0x7f25e80d06b0 2023-07-14T13:08:20.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.812+0000 7f25e6d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f25e80b1f70 0x7f25e80d22e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58022/0 (socket says 172.21.15.5:58022) 2023-07-14T13:08:20.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.812+0000 7f25e6d9d640 1 -- 172.21.15.5:0/1139179265 learned_addr learned my addr 172.21.15.5:0/1139179265 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:20.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.812+0000 7f25e659c640 1 --2- 172.21.15.5:0/1139179265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25e80d06b0 0x7f25e80b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:20.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.812+0000 7f25e5d9b640 1 -- 172.21.15.5:0/1139179265 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925537093 0 0) 0x7f25e80b2410 con 0x7f25e80b1f70 2023-07-14T13:08:20.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.812+0000 7f25e5d9b640 1 -- 172.21.15.5:0/1139179265 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25d4003530 con 0x7f25e80b1f70 2023-07-14T13:08:20.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.812+0000 7f25e5d9b640 1 -- 172.21.15.5:0/1139179265 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1094592525 0 0) 0x7f25e80b26f0 con 0x7f25e8145430 2023-07-14T13:08:20.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.812+0000 7f25e5d9b640 1 -- 172.21.15.5:0/1139179265 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25e80b2410 con 0x7f25e8145430 2023-07-14T13:08:20.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.812+0000 7f25e5d9b640 1 -- 172.21.15.5:0/1139179265 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3205226771 0 0) 0x7f25d4003530 con 0x7f25e80b1f70 2023-07-14T13:08:20.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.812+0000 7f25e5d9b640 1 -- 172.21.15.5:0/1139179265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25e80d06b0 msgr2=0x7f25e80b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:20.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.812+0000 7f25e5d9b640 1 --2- 172.21.15.5:0/1139179265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25e80d06b0 0x7f25e80b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:20.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.812+0000 7f25e5d9b640 1 -- 172.21.15.5:0/1139179265 >> v1:172.21.15.154:6789/0 conn(0x7f25e8145430 legacy=0x7f25e80b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:20.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.812+0000 7f25e5d9b640 1 -- 172.21.15.5:0/1139179265 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e80b2cb0 con 0x7f25e80b1f70 2023-07-14T13:08:20.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.812+0000 7f25e5d9b640 1 -- 172.21.15.5:0/1139179265 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f25e0001a00 con 0x7f25e80b1f70 2023-07-14T13:08:20.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.812+0000 7f25e5d9b640 1 -- 172.21.15.5:0/1139179265 >> v1:172.21.15.5:6789/0 conn(0x7f25e80b1f70 legacy=0x7f25e80d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:20.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.812+0000 7f25e5d9b640 1 --2- 172.21.15.5:0/1139179265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25d4003b40 0x7f25d4003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:20.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.812+0000 7f25e5d9b640 1 --2- 172.21.15.5:0/1139179265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25e80d06b0 0x7f25d40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:20.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.812+0000 7f25e5d9b640 1 --2- 172.21.15.5:0/1139179265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25d4004d10 0x7f25d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:20.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.816+0000 7f25e5d9b640 1 -- 172.21.15.5:0/1139179265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e80b29d0 con 0x7f25d4003b40 2023-07-14T13:08:20.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.816+0000 7f25e5d9b640 1 -- 172.21.15.5:0/1139179265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d400ba40 con 0x7f25d4004d10 2023-07-14T13:08:20.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.816+0000 7f25e5d9b640 1 -- 172.21.15.5:0/1139179265 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d400bbb0 con 0x7f25e80d06b0 2023-07-14T13:08:20.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.816+0000 7f25e659c640 1 --2- 172.21.15.5:0/1139179265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25d4003b40 0x7f25d4003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:20.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.816+0000 7f25dffff640 1 --2- 172.21.15.5:0/1139179265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25e80d06b0 0x7f25d40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:20.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.816+0000 7f25e6d9d640 1 --2- 172.21.15.5:0/1139179265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25d4004d10 0x7f25d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:20.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.816+0000 7f25e659c640 1 -- 172.21.15.5:0/1139179265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25e80d06b0 msgr2=0x7f25d40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:20.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.816+0000 7f25e659c640 1 --2- 172.21.15.5:0/1139179265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25e80d06b0 0x7f25d40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:20.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.816+0000 7f25e659c640 1 -- 172.21.15.5:0/1139179265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25d4004d10 msgr2=0x7f25d4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:20.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.816+0000 7f25e659c640 1 --2- 172.21.15.5:0/1139179265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25d4004d10 0x7f25d4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:20.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.816+0000 7f25e659c640 1 -- 172.21.15.5:0/1139179265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d4003530 con 0x7f25d4003b40 2023-07-14T13:08:20.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.816+0000 7f25e659c640 1 --2- 172.21.15.5:0/1139179265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25d4003b40 0x7f25d4003f30 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009ae0 tx=0x7f25d801d420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=138ed25b3cedf6aa server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:20.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.816+0000 7f25e5d9b640 1 -- 172.21.15.5:0/1139179265 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d80a5610 con 0x7f25d4003b40 2023-07-14T13:08:20.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.816+0000 7f25e5d9b640 1 -- 172.21.15.5:0/1139179265 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d80a5770 con 0x7f25d4003b40 2023-07-14T13:08:20.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.816+0000 7f25e5d9b640 1 -- 172.21.15.5:0/1139179265 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d80a5b20 con 0x7f25d4003b40 2023-07-14T13:08:20.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.820+0000 7f25ec974640 1 -- 172.21.15.5:0/1139179265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25d4003b40 msgr2=0x7f25d4003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:20.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.820+0000 7f25ec974640 1 --2- 172.21.15.5:0/1139179265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25d4003b40 0x7f25d4003f30 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009ae0 tx=0x7f25d801d420 comp rx=0 tx=0).stop 2023-07-14T13:08:20.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.820+0000 7f25e6d9d640 1 -- 172.21.15.5:0/1139179265 reap_dead start 2023-07-14T13:08:20.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.820+0000 7f25ec974640 1 -- 172.21.15.5:0/1139179265 shutdown_connections 2023-07-14T13:08:20.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.820+0000 7f25ec974640 1 -- 172.21.15.5:0/1139179265 >> 172.21.15.5:0/1139179265 conn(0x7f25e80659d0 msgr2=0x7f25e809b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:20.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.820+0000 7f25ec974640 1 -- 172.21.15.5:0/1139179265 shutdown_connections 2023-07-14T13:08:20.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.820+0000 7f25ec974640 1 -- 172.21.15.5:0/1139179265 wait complete. 2023-07-14T13:08:20.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.820+0000 7f25ec974640 1 Processor -- start 2023-07-14T13:08:20.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.820+0000 7f25ec974640 1 -- start start 2023-07-14T13:08:20.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.820+0000 7f25ec974640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25d4003b40 0x7f25e81f4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:20.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.820+0000 7f25ec974640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25e815da80 0x7f25e81f7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:20.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.820+0000 7f25ec974640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25e81f83c0 0x7f25e80b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:20.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.820+0000 7f25ec974640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e81f8d40 con 0x7f25d4003b40 2023-07-14T13:08:20.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.820+0000 7f25ec974640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e81f8830 con 0x7f25e815da80 2023-07-14T13:08:20.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.820+0000 7f25ec974640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e815d5f0 con 0x7f25e81f83c0 2023-07-14T13:08:20.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.820+0000 7f25e659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25d4003b40 0x7f25e81f4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:20.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.820+0000 7f25e659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25d4003b40 0x7f25e81f4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38590/0 (socket says 172.21.15.5:38590) 2023-07-14T13:08:20.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.820+0000 7f25e659c640 1 -- 172.21.15.5:0/2221774151 learned_addr learned my addr 172.21.15.5:0/2221774151 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:20.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.820+0000 7f25dffff640 1 --2- 172.21.15.5:0/2221774151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25e815da80 0x7f25e81f7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:20.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.820+0000 7f25e6d9d640 1 --2- 172.21.15.5:0/2221774151 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25e81f83c0 0x7f25e80b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:20.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.820+0000 7f25e659c640 1 -- 172.21.15.5:0/2221774151 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25e81f83c0 msgr2=0x7f25e80b5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:20.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.820+0000 7f25e659c640 1 --2- 172.21.15.5:0/2221774151 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25e81f83c0 0x7f25e80b5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:20.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.820+0000 7f25e659c640 1 -- 172.21.15.5:0/2221774151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25e815da80 msgr2=0x7f25e81f7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:20.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.820+0000 7f25e659c640 1 --2- 172.21.15.5:0/2221774151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25e815da80 0x7f25e81f7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:20.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.820+0000 7f25e659c640 1 -- 172.21.15.5:0/2221774151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e81f47d0 con 0x7f25d4003b40 2023-07-14T13:08:20.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.824+0000 7f25e659c640 1 --2- 172.21.15.5:0/2221774151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25d4003b40 0x7f25e81f4290 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f25d801cea0 tx=0x7f25d80197c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:20.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.824+0000 7f25deffd640 1 -- 172.21.15.5:0/2221774151 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d800f000 con 0x7f25d4003b40 2023-07-14T13:08:20.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.824+0000 7f25deffd640 1 -- 172.21.15.5:0/2221774151 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d8004020 con 0x7f25d4003b40 2023-07-14T13:08:20.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.824+0000 7f25ec974640 1 -- 172.21.15.5:0/2221774151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e815cfe0 con 0x7f25d4003b40 2023-07-14T13:08:20.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.824+0000 7f25deffd640 1 -- 172.21.15.5:0/2221774151 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d80043d0 con 0x7f25d4003b40 2023-07-14T13:08:20.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.824+0000 7f25ec974640 1 -- 172.21.15.5:0/2221774151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e815d280 con 0x7f25d4003b40 2023-07-14T13:08:20.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.824+0000 7f25ec974640 1 -- 172.21.15.5:0/2221774151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e80678d0 con 0x7f25d4003b40 2023-07-14T13:08:20.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.824+0000 7f25deffd640 1 -- 172.21.15.5:0/2221774151 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f25d80b4070 con 0x7f25d4003b40 2023-07-14T13:08:20.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.824+0000 7f25deffd640 1 --2- 172.21.15.5:0/2221774151 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f25c80663d0 0x7f25c8068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:20.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.824+0000 7f25deffd640 1 -- 172.21.15.5:0/2221774151 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f25d811d510 con 0x7f25d4003b40 2023-07-14T13:08:20.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.824+0000 7f25dffff640 1 --2- 172.21.15.5:0/2221774151 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f25c80663d0 0x7f25c8068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:20.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.828+0000 7f25dffff640 1 --2- 172.21.15.5:0/2221774151 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f25c80663d0 0x7f25c8068880 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f25d0007af0 tx=0x7f25d0009040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:20.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.828+0000 7f25deffd640 1 -- 172.21.15.5:0/2221774151 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f25d80eabc0 con 0x7f25d4003b40 2023-07-14T13:08:21.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.984+0000 7f25ec974640 1 -- 172.21.15.5:0/2221774151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f25e80d2e80 con 0x7f25d4003b40 2023-07-14T13:08:21.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.988+0000 7f25deffd640 1 -- 172.21.15.5:0/2221774151 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) v1 ==== 84+0+126 (secure 0 0 0) 0x7f25d80ee1e0 con 0x7f25d4003b40 2023-07-14T13:08:21.021 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:21.021 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-07-14T13:08:21.021 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:08:21.021 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-07-14T13:08:21.022 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-07-14T13:08:21.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:08:21.022 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:08:21.022 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 2, 2023-07-14T13:08:21.022 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": "rbd" 2023-07-14T13:08:21.023 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:08:21.023 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-07-14T13:08:21.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.988+0000 7f25ec974640 1 -- 172.21.15.5:0/2221774151 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f25c80663d0 msgr2=0x7f25c8068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:21.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.988+0000 7f25ec974640 1 --2- 172.21.15.5:0/2221774151 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f25c80663d0 0x7f25c8068880 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f25d0007af0 tx=0x7f25d0009040 comp rx=0 tx=0).stop 2023-07-14T13:08:21.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.988+0000 7f25ec974640 1 -- 172.21.15.5:0/2221774151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25d4003b40 msgr2=0x7f25e81f4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:21.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.988+0000 7f25ec974640 1 --2- 172.21.15.5:0/2221774151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25d4003b40 0x7f25e81f4290 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f25d801cea0 tx=0x7f25d80197c0 comp rx=0 tx=0).stop 2023-07-14T13:08:21.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.988+0000 7f25ec974640 1 -- 172.21.15.5:0/2221774151 shutdown_connections 2023-07-14T13:08:21.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.988+0000 7f25ec974640 1 --2- 172.21.15.5:0/2221774151 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f25c80663d0 0x7f25c8068880 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:21.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.988+0000 7f25ec974640 1 --2- 172.21.15.5:0/2221774151 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25e81f83c0 0x7f25e80b5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:21.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.988+0000 7f25ec974640 1 --2- 172.21.15.5:0/2221774151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25e815da80 0x7f25e81f7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:21.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.988+0000 7f25ec974640 1 --2- 172.21.15.5:0/2221774151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25d4003b40 0x7f25e81f4290 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:21.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.988+0000 7f25ec974640 1 -- 172.21.15.5:0/2221774151 >> 172.21.15.5:0/2221774151 conn(0x7f25e80659d0 msgr2=0x7f25e815a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:21.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.988+0000 7f25ec974640 1 -- 172.21.15.5:0/2221774151 shutdown_connections 2023-07-14T13:08:21.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:20.988+0000 7f25ec974640 1 -- 172.21.15.5:0/2221774151 wait complete. 2023-07-14T13:08:21.041 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-14T13:08:21.042 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-14T13:08:21.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.156+0000 7efe917e9640 1 Processor -- start 2023-07-14T13:08:21.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.156+0000 7efe917e9640 1 -- start start 2023-07-14T13:08:21.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe917e9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efe8c0cb3b0 0x7efe8c0ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:21.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe917e9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe8c0cd780 con 0x7efe8c158d80 2023-07-14T13:08:21.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe917e9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe8c06b3f0 con 0x7efe8c0cd320 2023-07-14T13:08:21.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe917e9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe8c06a540 con 0x7efe8c0cb3b0 2023-07-14T13:08:21.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe8affd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efe8c158d80 0x7efe8c15d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58036/0 (socket says 172.21.15.5:58036) 2023-07-14T13:08:21.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe8affd640 1 -- 172.21.15.5:0/3031891638 learned_addr learned my addr 172.21.15.5:0/3031891638 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:21.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe83fff640 1 --2- 172.21.15.5:0/3031891638 >> v2:172.21.15.154:3300/0 conn(0x7efe8c0cb3b0 0x7efe8c0ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:21.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe8a7fc640 1 -- 172.21.15.5:0/3031891638 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2692354550 0 0) 0x7efe8c0cd780 con 0x7efe8c158d80 2023-07-14T13:08:21.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe8a7fc640 1 -- 172.21.15.5:0/3031891638 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe78003530 con 0x7efe8c158d80 2023-07-14T13:08:21.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe8a7fc640 1 -- 172.21.15.5:0/3031891638 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1404540573 0 0) 0x7efe78003530 con 0x7efe8c158d80 2023-07-14T13:08:21.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe8a7fc640 1 -- 172.21.15.5:0/3031891638 >> v2:172.21.15.154:3300/0 conn(0x7efe8c0cb3b0 msgr2=0x7efe8c0ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:21.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe8a7fc640 1 --2- 172.21.15.5:0/3031891638 >> v2:172.21.15.154:3300/0 conn(0x7efe8c0cb3b0 0x7efe8c0ccde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:21.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe8a7fc640 1 -- 172.21.15.5:0/3031891638 >> v1:172.21.15.154:6789/0 conn(0x7efe8c0cd320 legacy=0x7efe8c0702d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:21.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe8a7fc640 1 -- 172.21.15.5:0/3031891638 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8c159150 con 0x7efe8c158d80 2023-07-14T13:08:21.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe8a7fc640 1 -- 172.21.15.5:0/3031891638 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7efe7c001680 con 0x7efe8c158d80 2023-07-14T13:08:21.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe8a7fc640 1 -- 172.21.15.5:0/3031891638 >> v1:172.21.15.5:6789/0 conn(0x7efe8c158d80 legacy=0x7efe8c15d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:21.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe8a7fc640 1 --2- 172.21.15.5:0/3031891638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe78003980 0x7efe78003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:21.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe8a7fc640 1 --2- 172.21.15.5:0/3031891638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe780047d0 0x7efe78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:21.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe8a7fc640 1 --2- 172.21.15.5:0/3031891638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe78005180 0x7efe7800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:21.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe8a7fc640 1 -- 172.21.15.5:0/3031891638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c06a540 con 0x7efe78003980 2023-07-14T13:08:21.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe8a7fc640 1 -- 172.21.15.5:0/3031891638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7800bfe0 con 0x7efe780047d0 2023-07-14T13:08:21.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe8a7fc640 1 -- 172.21.15.5:0/3031891638 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7800c1a0 con 0x7efe78005180 2023-07-14T13:08:21.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe8affd640 1 --2- 172.21.15.5:0/3031891638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe78003980 0x7efe78003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:21.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe83fff640 1 --2- 172.21.15.5:0/3031891638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe780047d0 0x7efe78004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:21.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe8b7fe640 1 --2- 172.21.15.5:0/3031891638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe78005180 0x7efe7800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:21.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe8affd640 1 -- 172.21.15.5:0/3031891638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe78005180 msgr2=0x7efe7800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:21.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe8affd640 1 --2- 172.21.15.5:0/3031891638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe78005180 0x7efe7800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:21.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe8affd640 1 -- 172.21.15.5:0/3031891638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe780047d0 msgr2=0x7efe78004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:21.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe8affd640 1 --2- 172.21.15.5:0/3031891638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe780047d0 0x7efe78004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:21.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe8affd640 1 -- 172.21.15.5:0/3031891638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe78003530 con 0x7efe78003980 2023-07-14T13:08:21.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.160+0000 7efe8b7fe640 1 -- 172.21.15.5:0/3031891638 reap_dead start 2023-07-14T13:08:21.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.164+0000 7efe8affd640 1 --2- 172.21.15.5:0/3031891638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe78003980 0x7efe78003d90 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00c1c0 tx=0x7efe7c01f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1647b1c520e40f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:21.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.164+0000 7efe8a7fc640 1 -- 172.21.15.5:0/3031891638 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c005ae0 con 0x7efe78003980 2023-07-14T13:08:21.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.164+0000 7efe8a7fc640 1 -- 172.21.15.5:0/3031891638 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7c0ab070 con 0x7efe78003980 2023-07-14T13:08:21.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.164+0000 7efe8a7fc640 1 -- 172.21.15.5:0/3031891638 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c007070 con 0x7efe78003980 2023-07-14T13:08:21.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.164+0000 7efe917e9640 1 -- 172.21.15.5:0/3031891638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe78003980 msgr2=0x7efe78003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:21.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.164+0000 7efe917e9640 1 --2- 172.21.15.5:0/3031891638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe78003980 0x7efe78003d90 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00c1c0 tx=0x7efe7c01f390 comp rx=0 tx=0).stop 2023-07-14T13:08:21.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.164+0000 7efe917e9640 1 -- 172.21.15.5:0/3031891638 shutdown_connections 2023-07-14T13:08:21.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.164+0000 7efe917e9640 1 --2- 172.21.15.5:0/3031891638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe78003980 0x7efe78003d90 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:21.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.164+0000 7efe917e9640 1 -- 172.21.15.5:0/3031891638 >> 172.21.15.5:0/3031891638 conn(0x7efe8c0cfb30 msgr2=0x7efe8c0cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:21.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.164+0000 7efe917e9640 1 -- 172.21.15.5:0/3031891638 shutdown_connections 2023-07-14T13:08:21.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.164+0000 7efe917e9640 1 -- 172.21.15.5:0/3031891638 wait complete. 2023-07-14T13:08:21.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.164+0000 7efe917e9640 1 Processor -- start 2023-07-14T13:08:21.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.164+0000 7efe917e9640 1 -- start start 2023-07-14T13:08:21.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.168+0000 7efe917e9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe78003980 0x7efe8c151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:21.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.168+0000 7efe917e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe8c0c8760 0x7efe8c0c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:21.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.168+0000 7efe917e9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe8c0ca590 0x7efe8c0ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:21.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.168+0000 7efe917e9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c0caf20 con 0x7efe8c0c8760 2023-07-14T13:08:21.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.168+0000 7efe917e9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c154e70 con 0x7efe8c0ca590 2023-07-14T13:08:21.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.168+0000 7efe917e9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c1559f0 con 0x7efe78003980 2023-07-14T13:08:21.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.168+0000 7efe83fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe8c0c8760 0x7efe8c0c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:21.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.168+0000 7efe83fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe8c0c8760 0x7efe8c0c7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38606/0 (socket says 172.21.15.5:38606) 2023-07-14T13:08:21.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.168+0000 7efe83fff640 1 -- 172.21.15.5:0/2080902550 learned_addr learned my addr 172.21.15.5:0/2080902550 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:21.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.168+0000 7efe8affd640 1 --2- 172.21.15.5:0/2080902550 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe78003980 0x7efe8c151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:21.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.168+0000 7efe8b7fe640 1 --2- 172.21.15.5:0/2080902550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe8c0ca590 0x7efe8c0ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:21.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.168+0000 7efe83fff640 1 -- 172.21.15.5:0/2080902550 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe78003980 msgr2=0x7efe8c151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:21.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.168+0000 7efe83fff640 1 --2- 172.21.15.5:0/2080902550 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe78003980 0x7efe8c151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:21.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.168+0000 7efe83fff640 1 -- 172.21.15.5:0/2080902550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe8c0ca590 msgr2=0x7efe8c0ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:21.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.168+0000 7efe83fff640 1 --2- 172.21.15.5:0/2080902550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe8c0ca590 0x7efe8c0ca9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:21.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.168+0000 7efe83fff640 1 -- 172.21.15.5:0/2080902550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8c1550c0 con 0x7efe8c0c8760 2023-07-14T13:08:21.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.168+0000 7efe83fff640 1 --2- 172.21.15.5:0/2080902550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe8c0c8760 0x7efe8c0c7650 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7efe74011560 tx=0x7efe74011650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:21.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.168+0000 7efe837fe640 1 -- 172.21.15.5:0/2080902550 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe74015660 con 0x7efe8c0c8760 2023-07-14T13:08:21.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.168+0000 7efe837fe640 1 -- 172.21.15.5:0/2080902550 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe740157c0 con 0x7efe8c0c8760 2023-07-14T13:08:21.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.168+0000 7efe917e9640 1 -- 172.21.15.5:0/2080902550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe8c1553a0 con 0x7efe8c0c8760 2023-07-14T13:08:21.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.168+0000 7efe837fe640 1 -- 172.21.15.5:0/2080902550 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe74015b30 con 0x7efe8c0c8760 2023-07-14T13:08:21.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.168+0000 7efe917e9640 1 -- 172.21.15.5:0/2080902550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe8c151840 con 0x7efe8c0c8760 2023-07-14T13:08:21.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.168+0000 7efe917e9640 1 -- 172.21.15.5:0/2080902550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe8c04e020 con 0x7efe8c0c8760 2023-07-14T13:08:21.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.172+0000 7efe837fe640 1 -- 172.21.15.5:0/2080902550 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7efe74015c90 con 0x7efe8c0c8760 2023-07-14T13:08:21.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.172+0000 7efe837fe640 1 --2- 172.21.15.5:0/2080902550 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7efe6c0663a0 0x7efe6c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:21.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.172+0000 7efe837fe640 1 -- 172.21.15.5:0/2080902550 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5210+0+0 (secure 0 0 0) 0x7efe74083a60 con 0x7efe8c0c8760 2023-07-14T13:08:21.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.172+0000 7efe8affd640 1 --2- 172.21.15.5:0/2080902550 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7efe6c0663a0 0x7efe6c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:21.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.172+0000 7efe8affd640 1 --2- 172.21.15.5:0/2080902550 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7efe6c0663a0 0x7efe6c068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efe7c0af000 tx=0x7efe7c0aa000 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:21.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.176+0000 7efe837fe640 1 -- 172.21.15.5:0/2080902550 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7efe740511d0 con 0x7efe8c0c8760 2023-07-14T13:08:21.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.332+0000 7efe917e9640 1 -- 172.21.15.5:0/2080902550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7efe8c0b4e60 con 0x7efe8c0c8760 2023-07-14T13:08:21.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.852+0000 7efe837fe640 1 -- 172.21.15.5:0/2080902550 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) v1 ==== 138+0+0 (secure 0 0 0) 0x7efe740547f0 con 0x7efe8c0c8760 2023-07-14T13:08:21.888 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-07-14T13:08:21.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.856+0000 7efe917e9640 1 -- 172.21.15.5:0/2080902550 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7efe6c0663a0 msgr2=0x7efe6c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:21.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.856+0000 7efe917e9640 1 --2- 172.21.15.5:0/2080902550 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7efe6c0663a0 0x7efe6c068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efe7c0af000 tx=0x7efe7c0aa000 comp rx=0 tx=0).stop 2023-07-14T13:08:21.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.856+0000 7efe917e9640 1 -- 172.21.15.5:0/2080902550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe8c0c8760 msgr2=0x7efe8c0c7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:21.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.856+0000 7efe917e9640 1 --2- 172.21.15.5:0/2080902550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe8c0c8760 0x7efe8c0c7650 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7efe74011560 tx=0x7efe74011650 comp rx=0 tx=0).stop 2023-07-14T13:08:21.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.856+0000 7efe917e9640 1 -- 172.21.15.5:0/2080902550 shutdown_connections 2023-07-14T13:08:21.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.856+0000 7efe917e9640 1 --2- 172.21.15.5:0/2080902550 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7efe6c0663a0 0x7efe6c068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:21.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.856+0000 7efe917e9640 1 --2- 172.21.15.5:0/2080902550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe8c0ca590 0x7efe8c0ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:21.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.856+0000 7efe917e9640 1 --2- 172.21.15.5:0/2080902550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe8c0c8760 0x7efe8c0c7650 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:21.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.856+0000 7efe917e9640 1 --2- 172.21.15.5:0/2080902550 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe78003980 0x7efe8c151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:21.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.856+0000 7efe917e9640 1 -- 172.21.15.5:0/2080902550 >> 172.21.15.5:0/2080902550 conn(0x7efe8c0cfb30 msgr2=0x7efe8c153960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:21.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.856+0000 7efe917e9640 1 -- 172.21.15.5:0/2080902550 shutdown_connections 2023-07-14T13:08:21.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:21.856+0000 7efe917e9640 1 -- 172.21.15.5:0/2080902550 wait complete. 2023-07-14T13:08:21.916 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-14T13:08:22.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.036+0000 7f5168aca640 1 Processor -- start 2023-07-14T13:08:22.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.036+0000 7f5168aca640 1 -- start start 2023-07-14T13:08:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.036+0000 7f5168aca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5164158a40 0x7f51640cb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.036+0000 7f5168aca640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f51640c8940 0x7f51640ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.036+0000 7f5168aca640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f51640cd4a0 0x7f516415c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.036+0000 7f5168aca640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51640cd940 con 0x7f51640cd4a0 2023-07-14T13:08:22.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.036+0000 7f5168aca640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51640711b0 con 0x7f51640c8940 2023-07-14T13:08:22.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.036+0000 7f5168aca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51640c8e20 con 0x7f5164158a40 2023-07-14T13:08:22.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.036+0000 7f5162d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f51640cd4a0 0x7f516415c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:22.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.036+0000 7f5162d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f51640cd4a0 0x7f516415c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38618/0 (socket says 172.21.15.5:38618) 2023-07-14T13:08:22.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.036+0000 7f5162d9d640 1 -- 172.21.15.5:0/2506603577 learned_addr learned my addr 172.21.15.5:0/2506603577 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:22.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.036+0000 7f516259c640 1 --2- 172.21.15.5:0/2506603577 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5164158a40 0x7f51640cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:22.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.036+0000 7f515bfff640 1 --2- 172.21.15.5:0/2506603577 >> v2:172.21.15.154:3300/0 conn(0x7f51640c8940 0x7f51640ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:22.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.036+0000 7f5162d9d640 1 -- 172.21.15.5:0/2506603577 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5164158a40 msgr2=0x7f51640cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:22.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.036+0000 7f5162d9d640 1 --2- 172.21.15.5:0/2506603577 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5164158a40 0x7f51640cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:22.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.036+0000 7f5162d9d640 1 -- 172.21.15.5:0/2506603577 >> v2:172.21.15.154:3300/0 conn(0x7f51640c8940 msgr2=0x7f51640ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:22.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.036+0000 7f5162d9d640 1 --2- 172.21.15.5:0/2506603577 >> v2:172.21.15.154:3300/0 conn(0x7f51640c8940 0x7f51640ccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.036+0000 7f5162d9d640 1 -- 172.21.15.5:0/2506603577 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51640c9100 con 0x7f51640cd4a0 2023-07-14T13:08:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.036+0000 7f516259c640 1 --2- 172.21.15.5:0/2506603577 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5164158a40 0x7f51640cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.040+0000 7f5162d9d640 1 --2- 172.21.15.5:0/2506603577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51640cd4a0 0x7f516415c410 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f51640cb9e0 tx=0x7f515c01c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfbe1f80f7637d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.040+0000 7f5161d9b640 1 -- 172.21.15.5:0/2506603577 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c0a5560 con 0x7f51640cd4a0 2023-07-14T13:08:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.040+0000 7f5161d9b640 1 -- 172.21.15.5:0/2506603577 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515c0a56c0 con 0x7f51640cd4a0 2023-07-14T13:08:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.040+0000 7f5161d9b640 1 -- 172.21.15.5:0/2506603577 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c0a5a50 con 0x7f51640cd4a0 2023-07-14T13:08:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.040+0000 7f5168aca640 1 -- 172.21.15.5:0/2506603577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51640cd4a0 msgr2=0x7f516415c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.040+0000 7f5168aca640 1 --2- 172.21.15.5:0/2506603577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51640cd4a0 0x7f516415c410 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f51640cb9e0 tx=0x7f515c01c6e0 comp rx=0 tx=0).stop 2023-07-14T13:08:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.040+0000 7f5168aca640 1 -- 172.21.15.5:0/2506603577 shutdown_connections 2023-07-14T13:08:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.040+0000 7f5168aca640 1 --2- 172.21.15.5:0/2506603577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51640cd4a0 0x7f516415c410 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.040+0000 7f5168aca640 1 --2- 172.21.15.5:0/2506603577 >> v2:172.21.15.154:3300/0 conn(0x7f51640c8940 0x7f51640ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.040+0000 7f5168aca640 1 --2- 172.21.15.5:0/2506603577 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5164158a40 0x7f51640cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.040+0000 7f5168aca640 1 -- 172.21.15.5:0/2506603577 >> 172.21.15.5:0/2506603577 conn(0x7f51640afac0 msgr2=0x7f51640afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.040+0000 7f5168aca640 1 -- 172.21.15.5:0/2506603577 shutdown_connections 2023-07-14T13:08:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.040+0000 7f5168aca640 1 -- 172.21.15.5:0/2506603577 wait complete. 2023-07-14T13:08:22.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.044+0000 7f5168aca640 1 Processor -- start 2023-07-14T13:08:22.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.044+0000 7f5168aca640 1 -- start start 2023-07-14T13:08:22.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.044+0000 7f5168aca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51640c8940 0x7f51641383e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:22.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.044+0000 7f5168aca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51640cd4a0 0x7f516415b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:22.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.044+0000 7f5168aca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51640700a0 0x7f5164070540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.044+0000 7f5168aca640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5164070a80 con 0x7f51640700a0 2023-07-14T13:08:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.044+0000 7f5168aca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5164138920 con 0x7f51640c8940 2023-07-14T13:08:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.044+0000 7f5168aca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f516415a5a0 con 0x7f51640cd4a0 2023-07-14T13:08:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.044+0000 7f5162d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51640700a0 0x7f5164070540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.044+0000 7f5162d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51640700a0 0x7f5164070540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38634/0 (socket says 172.21.15.5:38634) 2023-07-14T13:08:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.044+0000 7f5162d9d640 1 -- 172.21.15.5:0/1794938285 learned_addr learned my addr 172.21.15.5:0/1794938285 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.044+0000 7f516259c640 1 --2- 172.21.15.5:0/1794938285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51640c8940 0x7f51641383e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:22.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.044+0000 7f515bfff640 1 --2- 172.21.15.5:0/1794938285 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51640cd4a0 0x7f516415b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:22.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.044+0000 7f5162d9d640 1 -- 172.21.15.5:0/1794938285 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51640cd4a0 msgr2=0x7f516415b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:22.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.044+0000 7f5162d9d640 1 --2- 172.21.15.5:0/1794938285 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51640cd4a0 0x7f516415b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:22.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.044+0000 7f5162d9d640 1 -- 172.21.15.5:0/1794938285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51640c8940 msgr2=0x7f51641383e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:22.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.044+0000 7f5162d9d640 1 --2- 172.21.15.5:0/1794938285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51640c8940 0x7f51641383e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:22.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.044+0000 7f5162d9d640 1 -- 172.21.15.5:0/1794938285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515c009b30 con 0x7f51640700a0 2023-07-14T13:08:22.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.044+0000 7f5162d9d640 1 --2- 172.21.15.5:0/1794938285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51640700a0 0x7f5164070540 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f515c01ad90 tx=0x7f515c019480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:22.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.044+0000 7f515affd640 1 -- 172.21.15.5:0/1794938285 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c0a5560 con 0x7f51640700a0 2023-07-14T13:08:22.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.044+0000 7f515affd640 1 -- 172.21.15.5:0/1794938285 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515c0b8670 con 0x7f51640700a0 2023-07-14T13:08:22.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.044+0000 7f515affd640 1 -- 172.21.15.5:0/1794938285 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c0b8a00 con 0x7f51640700a0 2023-07-14T13:08:22.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.044+0000 7f5168aca640 1 -- 172.21.15.5:0/1794938285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f516415a880 con 0x7f51640700a0 2023-07-14T13:08:22.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.044+0000 7f5168aca640 1 -- 172.21.15.5:0/1794938285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f516415ae40 con 0x7f51640700a0 2023-07-14T13:08:22.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.048+0000 7f5168aca640 1 -- 172.21.15.5:0/1794938285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51640ca370 con 0x7f51640700a0 2023-07-14T13:08:22.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.048+0000 7f515affd640 1 -- 172.21.15.5:0/1794938285 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f515c0b8b60 con 0x7f51640700a0 2023-07-14T13:08:22.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.048+0000 7f515affd640 1 --2- 172.21.15.5:0/1794938285 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f51440663d0 0x7f5144068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:22.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.048+0000 7f515affd640 1 -- 172.21.15.5:0/1794938285 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f515c11e840 con 0x7f51640700a0 2023-07-14T13:08:22.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.048+0000 7f516259c640 1 --2- 172.21.15.5:0/1794938285 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f51440663d0 0x7f5144068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:22.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.048+0000 7f516259c640 1 --2- 172.21.15.5:0/1794938285 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f51440663d0 0x7f5144068880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f51641556f0 tx=0x7f5154008040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.052+0000 7f515affd640 1 -- 172.21.15.5:0/1794938285 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f515c0ebda0 con 0x7f51640700a0 2023-07-14T13:08:22.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.208+0000 7f5168aca640 1 -- 172.21.15.5:0/1794938285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f51640678d0 con 0x7f51640700a0 2023-07-14T13:08:22.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.864+0000 7f515affd640 1 -- 172.21.15.5:0/1794938285 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v81) v1 ==== 170+0+0 (secure 0 0 0) 0x7f515c11e0d0 con 0x7f51640700a0 2023-07-14T13:08:22.899 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-07-14T13:08:22.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.872+0000 7f5168aca640 1 -- 172.21.15.5:0/1794938285 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f51440663d0 msgr2=0x7f5144068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:22.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.872+0000 7f5168aca640 1 --2- 172.21.15.5:0/1794938285 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f51440663d0 0x7f5144068880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f51641556f0 tx=0x7f5154008040 comp rx=0 tx=0).stop 2023-07-14T13:08:22.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.872+0000 7f5168aca640 1 -- 172.21.15.5:0/1794938285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51640700a0 msgr2=0x7f5164070540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:22.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.872+0000 7f5168aca640 1 --2- 172.21.15.5:0/1794938285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51640700a0 0x7f5164070540 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f515c01ad90 tx=0x7f515c019480 comp rx=0 tx=0).stop 2023-07-14T13:08:22.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.876+0000 7f5168aca640 1 -- 172.21.15.5:0/1794938285 shutdown_connections 2023-07-14T13:08:22.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.876+0000 7f5168aca640 1 --2- 172.21.15.5:0/1794938285 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f51440663d0 0x7f5144068880 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:22.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.876+0000 7f5168aca640 1 --2- 172.21.15.5:0/1794938285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51640700a0 0x7f5164070540 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:22.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.876+0000 7f5168aca640 1 --2- 172.21.15.5:0/1794938285 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51640cd4a0 0x7f516415b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:22.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.876+0000 7f5168aca640 1 --2- 172.21.15.5:0/1794938285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51640c8940 0x7f51641383e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:22.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.876+0000 7f5168aca640 1 -- 172.21.15.5:0/1794938285 >> 172.21.15.5:0/1794938285 conn(0x7f51640afac0 msgr2=0x7f516406c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:22.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.876+0000 7f5168aca640 1 -- 172.21.15.5:0/1794938285 shutdown_connections 2023-07-14T13:08:22.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:22.876+0000 7f5168aca640 1 -- 172.21.15.5:0/1794938285 wait complete. 2023-07-14T13:08:22.942 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-14T13:08:23.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.060+0000 7f734e9c5640 1 Processor -- start 2023-07-14T13:08:23.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.060+0000 7f734e9c5640 1 -- start start 2023-07-14T13:08:23.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.060+0000 7f734e9c5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f73480aeb40 0x7f734815cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:23.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.060+0000 7f734e9c5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f73480aef10 0x7f7348158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:23.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.060+0000 7f734e9c5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73481532b0 con 0x7f7348159270 2023-07-14T13:08:23.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.060+0000 7f734e9c5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73480ca6f0 con 0x7f73480aef10 2023-07-14T13:08:23.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.060+0000 7f734e9c5640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73481599d0 con 0x7f73480aeb40 2023-07-14T13:08:23.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.060+0000 7f73477fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f73480aef10 0x7f7348158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:23.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.060+0000 7f73477fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f73480aef10 0x7f7348158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38642/0 (socket says 172.21.15.5:38642) 2023-07-14T13:08:23.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.060+0000 7f73477fe640 1 -- 172.21.15.5:0/2010877650 learned_addr learned my addr 172.21.15.5:0/2010877650 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:23.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.060+0000 7f7347fff640 1 --2- 172.21.15.5:0/2010877650 >> v2:172.21.15.154:3300/0 conn(0x7f73480aeb40 0x7f734815cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:23.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.060+0000 7f73477fe640 1 -- 172.21.15.5:0/2010877650 >> v2:172.21.15.154:3300/0 conn(0x7f73480aeb40 msgr2=0x7f734815cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:23.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.060+0000 7f73477fe640 1 --2- 172.21.15.5:0/2010877650 >> v2:172.21.15.154:3300/0 conn(0x7f73480aeb40 0x7f734815cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.060+0000 7f73477fe640 1 -- 172.21.15.5:0/2010877650 >> v1:172.21.15.154:6789/0 conn(0x7f7348159270 legacy=0x7f73480c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:23.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.060+0000 7f73477fe640 1 -- 172.21.15.5:0/2010877650 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7348159cb0 con 0x7f73480aef10 2023-07-14T13:08:23.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.060+0000 7f7347fff640 1 --2- 172.21.15.5:0/2010877650 >> v2:172.21.15.154:3300/0 conn(0x7f73480aeb40 0x7f734815cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:23.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.064+0000 7f73477fe640 1 --2- 172.21.15.5:0/2010877650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73480aef10 0x7f7348158d30 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f7348071ad0 tx=0x7f733c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6680f10a1c9f7c47 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:23.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.064+0000 7f7346ffd640 1 -- 172.21.15.5:0/2010877650 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c0ab640 con 0x7f73480aef10 2023-07-14T13:08:23.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.064+0000 7f7346ffd640 1 -- 172.21.15.5:0/2010877650 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733c0a7070 con 0x7f73480aef10 2023-07-14T13:08:23.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.064+0000 7f7346ffd640 1 -- 172.21.15.5:0/2010877650 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c0ab9c0 con 0x7f73480aef10 2023-07-14T13:08:23.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.064+0000 7f734e9c5640 1 -- 172.21.15.5:0/2010877650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73480aef10 msgr2=0x7f7348158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:23.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.064+0000 7f734e9c5640 1 --2- 172.21.15.5:0/2010877650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73480aef10 0x7f7348158d30 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f7348071ad0 tx=0x7f733c01c440 comp rx=0 tx=0).stop 2023-07-14T13:08:23.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.064+0000 7f734e9c5640 1 -- 172.21.15.5:0/2010877650 shutdown_connections 2023-07-14T13:08:23.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.064+0000 7f734e9c5640 1 --2- 172.21.15.5:0/2010877650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73480aef10 0x7f7348158d30 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.064+0000 7f734e9c5640 1 --2- 172.21.15.5:0/2010877650 >> v2:172.21.15.154:3300/0 conn(0x7f73480aeb40 0x7f734815cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.064+0000 7f734e9c5640 1 -- 172.21.15.5:0/2010877650 >> 172.21.15.5:0/2010877650 conn(0x7f73480cde90 msgr2=0x7f73480ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:23.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.064+0000 7f734e9c5640 1 -- 172.21.15.5:0/2010877650 shutdown_connections 2023-07-14T13:08:23.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.064+0000 7f734e9c5640 1 -- 172.21.15.5:0/2010877650 wait complete. 2023-07-14T13:08:23.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.068+0000 7f734e9c5640 1 Processor -- start 2023-07-14T13:08:23.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.068+0000 7f734e9c5640 1 -- start start 2023-07-14T13:08:23.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.068+0000 7f734e9c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73480aeb40 0x7f734806d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:23.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.068+0000 7f734e9c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73480aef10 0x7f7348148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:23.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.068+0000 7f734e9c5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7348159270 0x7f7348165cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:23.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.068+0000 7f734e9c5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73480c7460 con 0x7f73480aeb40 2023-07-14T13:08:23.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.068+0000 7f734e9c5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73480c5f90 con 0x7f73480aef10 2023-07-14T13:08:23.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.068+0000 7f734e9c5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73480c7a00 con 0x7f7348159270 2023-07-14T13:08:23.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.068+0000 7f7347fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73480aeb40 0x7f734806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:23.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.068+0000 7f7347fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73480aeb40 0x7f734806d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38646/0 (socket says 172.21.15.5:38646) 2023-07-14T13:08:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.068+0000 7f7347fff640 1 -- 172.21.15.5:0/314379882 learned_addr learned my addr 172.21.15.5:0/314379882 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.068+0000 7f73477fe640 1 --2- 172.21.15.5:0/314379882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73480aef10 0x7f7348148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.068+0000 7f734cf62640 1 --2- 172.21.15.5:0/314379882 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7348159270 0x7f7348165cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.068+0000 7f7347fff640 1 -- 172.21.15.5:0/314379882 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7348159270 msgr2=0x7f7348165cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.068+0000 7f7347fff640 1 --2- 172.21.15.5:0/314379882 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7348159270 0x7f7348165cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.068+0000 7f7347fff640 1 -- 172.21.15.5:0/314379882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73480aef10 msgr2=0x7f7348148070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.068+0000 7f7347fff640 1 --2- 172.21.15.5:0/314379882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73480aef10 0x7f7348148070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.068+0000 7f7347fff640 1 -- 172.21.15.5:0/314379882 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733c0094d0 con 0x7f73480aeb40 2023-07-14T13:08:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.068+0000 7f734cf62640 1 --2- 172.21.15.5:0/314379882 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7348159270 0x7f7348165cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:08:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.068+0000 7f7347fff640 1 --2- 172.21.15.5:0/314379882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73480aeb40 0x7f734806d100 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f733800e810 tx=0x7f733800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.068+0000 7f7344ff9640 1 -- 172.21.15.5:0/314379882 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733800c8d0 con 0x7f73480aeb40 2023-07-14T13:08:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.068+0000 7f7344ff9640 1 -- 172.21.15.5:0/314379882 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733800ca30 con 0x7f73480aeb40 2023-07-14T13:08:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.068+0000 7f7344ff9640 1 -- 172.21.15.5:0/314379882 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733800cde0 con 0x7f73480aeb40 2023-07-14T13:08:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.068+0000 7f734e9c5640 1 -- 172.21.15.5:0/314379882 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73480c5a10 con 0x7f73480aeb40 2023-07-14T13:08:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.068+0000 7f734e9c5640 1 -- 172.21.15.5:0/314379882 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73480c7690 con 0x7f73480aeb40 2023-07-14T13:08:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.068+0000 7f734e9c5640 1 -- 172.21.15.5:0/314379882 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73480678d0 con 0x7f73480aeb40 2023-07-14T13:08:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.072+0000 7f7344ff9640 1 -- 172.21.15.5:0/314379882 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7338026480 con 0x7f73480aeb40 2023-07-14T13:08:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.072+0000 7f7344ff9640 1 --2- 172.21.15.5:0/314379882 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f73340663a0 0x7f7334068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:23.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.072+0000 7f7344ff9640 1 -- 172.21.15.5:0/314379882 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f7338084250 con 0x7f73480aeb40 2023-07-14T13:08:23.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.072+0000 7f73477fe640 1 --2- 172.21.15.5:0/314379882 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f73340663a0 0x7f7334068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:23.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.072+0000 7f73477fe640 1 --2- 172.21.15.5:0/314379882 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f73340663a0 0x7f7334068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f733c0af000 tx=0x7f733c0a7000 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:23.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.076+0000 7f7344ff9640 1 -- 172.21.15.5:0/314379882 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f73380514f0 con 0x7f73480aeb40 2023-07-14T13:08:23.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.260+0000 7f734e9c5640 1 -- 172.21.15.5:0/314379882 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f734815d180 con 0x7f73480aeb40 2023-07-14T13:08:23.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.884+0000 7f7344ff9640 1 -- 172.21.15.5:0/314379882 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v28) v1 ==== 173+0+0 (secure 0 0 0) 0x7f7338054b10 con 0x7f73480aeb40 2023-07-14T13:08:23.924 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 9 and data pool 10 2023-07-14T13:08:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.896+0000 7f734e9c5640 1 -- 172.21.15.5:0/314379882 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f73340663a0 msgr2=0x7f7334068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.896+0000 7f734e9c5640 1 --2- 172.21.15.5:0/314379882 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f73340663a0 0x7f7334068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f733c0af000 tx=0x7f733c0a7000 comp rx=0 tx=0).stop 2023-07-14T13:08:23.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.896+0000 7f734e9c5640 1 -- 172.21.15.5:0/314379882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73480aeb40 msgr2=0x7f734806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:23.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.896+0000 7f734e9c5640 1 --2- 172.21.15.5:0/314379882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73480aeb40 0x7f734806d100 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f733800e810 tx=0x7f733800ecd0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.896+0000 7f734e9c5640 1 -- 172.21.15.5:0/314379882 shutdown_connections 2023-07-14T13:08:23.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.896+0000 7f734e9c5640 1 --2- 172.21.15.5:0/314379882 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f73340663a0 0x7f7334068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.896+0000 7f734e9c5640 1 --2- 172.21.15.5:0/314379882 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7348159270 0x7f7348165cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.896+0000 7f734e9c5640 1 --2- 172.21.15.5:0/314379882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73480aef10 0x7f7348148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.896+0000 7f734e9c5640 1 --2- 172.21.15.5:0/314379882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73480aeb40 0x7f734806d100 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.896+0000 7f734e9c5640 1 -- 172.21.15.5:0/314379882 >> 172.21.15.5:0/314379882 conn(0x7f73480cde90 msgr2=0x7f734815a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:23.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.896+0000 7f734e9c5640 1 -- 172.21.15.5:0/314379882 shutdown_connections 2023-07-14T13:08:23.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:23.896+0000 7f734e9c5640 1 -- 172.21.15.5:0/314379882 wait complete. 2023-07-14T13:08:23.955 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:08:24.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.064+0000 7ffb74d11640 1 Processor -- start 2023-07-14T13:08:24.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.068+0000 7ffb74d11640 1 -- start start 2023-07-14T13:08:24.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.068+0000 7ffb74d11640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb700d1850 0x7ffb700d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:24.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.068+0000 7ffb74d11640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb700ccaf0 con 0x7ffb700b7c70 2023-07-14T13:08:24.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.068+0000 7ffb74d11640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb70160320 con 0x7ffb7015fd60 2023-07-14T13:08:24.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.068+0000 7ffb74d11640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700d1190 con 0x7ffb700d1850 2023-07-14T13:08:24.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.068+0000 7ffb6e59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ffb700b7c70 0x7ffb7015f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58048/0 (socket says 172.21.15.5:58048) 2023-07-14T13:08:24.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.068+0000 7ffb6e59c640 1 -- 172.21.15.5:0/3185017166 learned_addr learned my addr 172.21.15.5:0/3185017166 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:24.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.068+0000 7ffb6ed9d640 1 --2- 172.21.15.5:0/3185017166 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb700d1850 0x7ffb700d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:24.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.068+0000 7ffb6dd9b640 1 -- 172.21.15.5:0/3185017166 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1350498590 0 0) 0x7ffb700ccaf0 con 0x7ffb700b7c70 2023-07-14T13:08:24.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.068+0000 7ffb6dd9b640 1 -- 172.21.15.5:0/3185017166 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb5c003530 con 0x7ffb700b7c70 2023-07-14T13:08:24.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.068+0000 7ffb6dd9b640 1 -- 172.21.15.5:0/3185017166 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686250998 0 0) 0x7ffb70160320 con 0x7ffb7015fd60 2023-07-14T13:08:24.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.068+0000 7ffb6dd9b640 1 -- 172.21.15.5:0/3185017166 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb700ccaf0 con 0x7ffb7015fd60 2023-07-14T13:08:24.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.068+0000 7ffb6dd9b640 1 -- 172.21.15.5:0/3185017166 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4277898676 0 0) 0x7ffb5c003530 con 0x7ffb700b7c70 2023-07-14T13:08:24.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.068+0000 7ffb6ed9d640 1 -- 172.21.15.5:0/3185017166 >> v1:172.21.15.154:6789/0 conn(0x7ffb7015fd60 legacy=0x7ffb700d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:24.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.068+0000 7ffb6ed9d640 1 -- 172.21.15.5:0/3185017166 >> v1:172.21.15.5:6789/0 conn(0x7ffb700b7c70 legacy=0x7ffb7015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:24.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.068+0000 7ffb6ed9d640 1 -- 172.21.15.5:0/3185017166 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb700ccd90 con 0x7ffb700d1850 2023-07-14T13:08:24.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.072+0000 7ffb6ed9d640 1 --2- 172.21.15.5:0/3185017166 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb700d1850 0x7ffb700d0c50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009dc0 tx=0x7ffb6801c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a105c0ee7d6a5b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:24.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.072+0000 7ffb6dd9b640 1 -- 172.21.15.5:0/3185017166 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb60001680 con 0x7ffb700d1850 2023-07-14T13:08:24.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.072+0000 7ffb6dd9b640 1 -- 172.21.15.5:0/3185017166 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb680a55e0 con 0x7ffb700d1850 2023-07-14T13:08:24.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.072+0000 7ffb6dd9b640 1 -- 172.21.15.5:0/3185017166 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb680a5970 con 0x7ffb700d1850 2023-07-14T13:08:24.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.072+0000 7ffb74d11640 1 -- 172.21.15.5:0/3185017166 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb700d1850 msgr2=0x7ffb700d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:24.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.072+0000 7ffb74d11640 1 --2- 172.21.15.5:0/3185017166 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb700d1850 0x7ffb700d0c50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009dc0 tx=0x7ffb6801c890 comp rx=0 tx=0).stop 2023-07-14T13:08:24.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.072+0000 7ffb74d11640 1 -- 172.21.15.5:0/3185017166 shutdown_connections 2023-07-14T13:08:24.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.072+0000 7ffb74d11640 1 --2- 172.21.15.5:0/3185017166 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb700d1850 0x7ffb700d0c50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:24.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.072+0000 7ffb74d11640 1 -- 172.21.15.5:0/3185017166 >> 172.21.15.5:0/3185017166 conn(0x7ffb700650b0 msgr2=0x7ffb700654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:24.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.072+0000 7ffb74d11640 1 -- 172.21.15.5:0/3185017166 shutdown_connections 2023-07-14T13:08:24.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.072+0000 7ffb74d11640 1 -- 172.21.15.5:0/3185017166 wait complete. 2023-07-14T13:08:24.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.076+0000 7ffb74d11640 1 Processor -- start 2023-07-14T13:08:24.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.076+0000 7ffb74d11640 1 -- start start 2023-07-14T13:08:24.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.076+0000 7ffb74d11640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb700b7c70 0x7ffb7015ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:24.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.076+0000 7ffb74d11640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb700d1850 0x7ffb7014c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:24.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.076+0000 7ffb74d11640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb7015fd60 0x7ffb701f86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:24.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.076+0000 7ffb74d11640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7014c890 con 0x7ffb7015fd60 2023-07-14T13:08:24.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.076+0000 7ffb74d11640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7015db50 con 0x7ffb700d1850 2023-07-14T13:08:24.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.076+0000 7ffb74d11640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7015de30 con 0x7ffb700b7c70 2023-07-14T13:08:24.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.076+0000 7ffb6ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb7015fd60 0x7ffb701f86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:24.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.076+0000 7ffb6ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb7015fd60 0x7ffb701f86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38650/0 (socket says 172.21.15.5:38650) 2023-07-14T13:08:24.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.076+0000 7ffb6ed9d640 1 -- 172.21.15.5:0/3437011258 learned_addr learned my addr 172.21.15.5:0/3437011258 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:24.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.076+0000 7ffb6e59c640 1 --2- 172.21.15.5:0/3437011258 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb700b7c70 0x7ffb7015ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:24.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.076+0000 7ffb67fff640 1 --2- 172.21.15.5:0/3437011258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb700d1850 0x7ffb7014c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:24.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.076+0000 7ffb6ed9d640 1 -- 172.21.15.5:0/3437011258 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb700b7c70 msgr2=0x7ffb7015ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:24.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.076+0000 7ffb6ed9d640 1 --2- 172.21.15.5:0/3437011258 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb700b7c70 0x7ffb7015ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:24.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.076+0000 7ffb6ed9d640 1 -- 172.21.15.5:0/3437011258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb700d1850 msgr2=0x7ffb7014c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:24.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.076+0000 7ffb6ed9d640 1 --2- 172.21.15.5:0/3437011258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb700d1850 0x7ffb7014c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:24.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.076+0000 7ffb6ed9d640 1 -- 172.21.15.5:0/3437011258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb68009a70 con 0x7ffb7015fd60 2023-07-14T13:08:24.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.076+0000 7ffb6ed9d640 1 --2- 172.21.15.5:0/3437011258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb7015fd60 0x7ffb701f86b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7ffb6801af40 tx=0x7ffb68019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:24.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.076+0000 7ffb66ffd640 1 -- 172.21.15.5:0/3437011258 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb680039a0 con 0x7ffb7015fd60 2023-07-14T13:08:24.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.076+0000 7ffb66ffd640 1 -- 172.21.15.5:0/3437011258 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb68003b00 con 0x7ffb7015fd60 2023-07-14T13:08:24.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.076+0000 7ffb74d11640 1 -- 172.21.15.5:0/3437011258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7015e110 con 0x7ffb7015fd60 2023-07-14T13:08:24.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.076+0000 7ffb66ffd640 1 -- 172.21.15.5:0/3437011258 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb68003e90 con 0x7ffb7015fd60 2023-07-14T13:08:24.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.076+0000 7ffb74d11640 1 -- 172.21.15.5:0/3437011258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb7015e6d0 con 0x7ffb7015fd60 2023-07-14T13:08:24.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.076+0000 7ffb74d11640 1 -- 172.21.15.5:0/3437011258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb7015e8c0 con 0x7ffb7015fd60 2023-07-14T13:08:24.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.080+0000 7ffb66ffd640 1 -- 172.21.15.5:0/3437011258 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ffb680ad650 con 0x7ffb7015fd60 2023-07-14T13:08:24.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.080+0000 7ffb66ffd640 1 --2- 172.21.15.5:0/3437011258 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7ffb500663a0 0x7ffb50068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:24.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.080+0000 7ffb66ffd640 1 -- 172.21.15.5:0/3437011258 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffb6811f450 con 0x7ffb7015fd60 2023-07-14T13:08:24.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.080+0000 7ffb6e59c640 1 --2- 172.21.15.5:0/3437011258 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7ffb500663a0 0x7ffb50068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:24.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.080+0000 7ffb6e59c640 1 --2- 172.21.15.5:0/3437011258 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7ffb500663a0 0x7ffb50068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffb60000fe0 tx=0x7ffb6000f1d0 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:24.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.084+0000 7ffb66ffd640 1 -- 172.21.15.5:0/3437011258 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ffb680ec850 con 0x7ffb7015fd60 2023-07-14T13:08:24.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.240+0000 7ffb74d11640 1 -- 172.21.15.5:0/3437011258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb700678d0 con 0x7ffb7015fd60 2023-07-14T13:08:24.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.240+0000 7ffb66ffd640 1 -- 172.21.15.5:0/3437011258 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18258 (secure 0 0 0) 0x7ffb680efe70 con 0x7ffb7015fd60 2023-07-14T13:08:24.275 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:24.275 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":82,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:08:23.268065+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:08:21.382297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-14T13:08:22.261284+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:08:24.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.244+0000 7ffb74d11640 1 -- 172.21.15.5:0/3437011258 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7ffb500663a0 msgr2=0x7ffb50068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:24.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.244+0000 7ffb74d11640 1 --2- 172.21.15.5:0/3437011258 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7ffb500663a0 0x7ffb50068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffb60000fe0 tx=0x7ffb6000f1d0 comp rx=0 tx=0).stop 2023-07-14T13:08:24.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.244+0000 7ffb74d11640 1 -- 172.21.15.5:0/3437011258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb7015fd60 msgr2=0x7ffb701f86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:24.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.244+0000 7ffb74d11640 1 --2- 172.21.15.5:0/3437011258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb7015fd60 0x7ffb701f86b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7ffb6801af40 tx=0x7ffb68019630 comp rx=0 tx=0).stop 2023-07-14T13:08:24.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.244+0000 7ffb74d11640 1 -- 172.21.15.5:0/3437011258 shutdown_connections 2023-07-14T13:08:24.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.244+0000 7ffb74d11640 1 --2- 172.21.15.5:0/3437011258 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7ffb500663a0 0x7ffb50068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:24.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.244+0000 7ffb74d11640 1 --2- 172.21.15.5:0/3437011258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb7015fd60 0x7ffb701f86b0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:24.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.244+0000 7ffb74d11640 1 --2- 172.21.15.5:0/3437011258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb700d1850 0x7ffb7014c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:24.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.244+0000 7ffb74d11640 1 --2- 172.21.15.5:0/3437011258 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb700b7c70 0x7ffb7015ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:24.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.244+0000 7ffb74d11640 1 -- 172.21.15.5:0/3437011258 >> 172.21.15.5:0/3437011258 conn(0x7ffb700650b0 msgr2=0x7ffb70156750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:24.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.244+0000 7ffb74d11640 1 -- 172.21.15.5:0/3437011258 shutdown_connections 2023-07-14T13:08:24.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.244+0000 7ffb74d11640 1 -- 172.21.15.5:0/3437011258 wait complete. 2023-07-14T13:08:24.297 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:08:24.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.408+0000 7fed51d2c640 1 Processor -- start 2023-07-14T13:08:24.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.408+0000 7fed51d2c640 1 -- start start 2023-07-14T13:08:24.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.408+0000 7fed51d2c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fed4c15fd60 0x7fed4c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:24.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.408+0000 7fed51d2c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed4c0ccaf0 con 0x7fed4c0d1850 2023-07-14T13:08:24.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.408+0000 7fed51d2c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed4c160320 con 0x7fed4c0b7c70 2023-07-14T13:08:24.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.408+0000 7fed51d2c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed4c0d1190 con 0x7fed4c15fd60 2023-07-14T13:08:24.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.408+0000 7fed4bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fed4c0d1850 0x7fed4c0d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58064/0 (socket says 172.21.15.5:58064) 2023-07-14T13:08:24.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.408+0000 7fed4affd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fed4c15fd60 0x7fed4c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:24.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.408+0000 7fed4bfff640 1 -- 172.21.15.5:0/1120070706 learned_addr learned my addr 172.21.15.5:0/1120070706 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:24.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.408+0000 7fed4a7fc640 1 -- 172.21.15.5:0/1120070706 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3899690426 0 0) 0x7fed4c0ccaf0 con 0x7fed4c0d1850 2023-07-14T13:08:24.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.408+0000 7fed4a7fc640 1 -- 172.21.15.5:0/1120070706 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed34003530 con 0x7fed4c0d1850 2023-07-14T13:08:24.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.408+0000 7fed4affd640 1 -- 172.21.15.5:0/1120070706 >> v1:172.21.15.154:6789/0 conn(0x7fed4c0b7c70 legacy=0x7fed4c15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:24.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.408+0000 7fed4affd640 1 -- 172.21.15.5:0/1120070706 >> v1:172.21.15.5:6789/0 conn(0x7fed4c0d1850 legacy=0x7fed4c0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:24.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.408+0000 7fed4a7fc640 1 -- 172.21.15.5:0/1120070706 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3822515197 0 0) 0x7fed4c160320 con 0x7fed4c0b7c70 2023-07-14T13:08:24.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.408+0000 7fed4affd640 1 -- 172.21.15.5:0/1120070706 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c0ccd90 con 0x7fed4c15fd60 2023-07-14T13:08:24.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.412+0000 7fed4affd640 1 --2- 172.21.15.5:0/1120070706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed4c15fd60 0x7fed4c0d0c50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fed400097c0 tx=0x7fed4001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56a05b699922c873 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:24.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.412+0000 7fed4a7fc640 1 -- 172.21.15.5:0/1120070706 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed400a8050 con 0x7fed4c15fd60 2023-07-14T13:08:24.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.412+0000 7fed4a7fc640 1 -- 172.21.15.5:0/1120070706 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed400ac5f0 con 0x7fed4c15fd60 2023-07-14T13:08:24.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.412+0000 7fed4a7fc640 1 -- 172.21.15.5:0/1120070706 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed400ac980 con 0x7fed4c15fd60 2023-07-14T13:08:24.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.412+0000 7fed51d2c640 1 -- 172.21.15.5:0/1120070706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed4c15fd60 msgr2=0x7fed4c0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:24.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.412+0000 7fed51d2c640 1 --2- 172.21.15.5:0/1120070706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed4c15fd60 0x7fed4c0d0c50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fed400097c0 tx=0x7fed4001c480 comp rx=0 tx=0).stop 2023-07-14T13:08:24.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.412+0000 7fed51d2c640 1 -- 172.21.15.5:0/1120070706 shutdown_connections 2023-07-14T13:08:24.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.412+0000 7fed51d2c640 1 --2- 172.21.15.5:0/1120070706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed4c15fd60 0x7fed4c0d0c50 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:24.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.412+0000 7fed51d2c640 1 -- 172.21.15.5:0/1120070706 >> 172.21.15.5:0/1120070706 conn(0x7fed4c0650b0 msgr2=0x7fed4c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:24.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.412+0000 7fed51d2c640 1 -- 172.21.15.5:0/1120070706 shutdown_connections 2023-07-14T13:08:24.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.412+0000 7fed51d2c640 1 -- 172.21.15.5:0/1120070706 wait complete. 2023-07-14T13:08:24.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.416+0000 7fed51d2c640 1 Processor -- start 2023-07-14T13:08:24.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.416+0000 7fed51d2c640 1 -- start start 2023-07-14T13:08:24.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.416+0000 7fed51d2c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed4c0b7c70 0x7fed4c14b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:24.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.416+0000 7fed51d2c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed4c0d1850 0x7fed4c14eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:24.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.416+0000 7fed51d2c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed4c15fd60 0x7fed4c0b62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:24.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.416+0000 7fed51d2c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c14f0e0 con 0x7fed4c15fd60 2023-07-14T13:08:24.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.416+0000 7fed51d2c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0b6bb0 con 0x7fed4c0b7c70 2023-07-14T13:08:24.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.416+0000 7fed51d2c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0b6e90 con 0x7fed4c0d1850 2023-07-14T13:08:24.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.416+0000 7fed4bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed4c15fd60 0x7fed4c0b62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:24.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.416+0000 7fed4bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed4c15fd60 0x7fed4c0b62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38664/0 (socket says 172.21.15.5:38664) 2023-07-14T13:08:24.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.416+0000 7fed4bfff640 1 -- 172.21.15.5:0/284101605 learned_addr learned my addr 172.21.15.5:0/284101605 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:24.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.416+0000 7fed4b7fe640 1 --2- 172.21.15.5:0/284101605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed4c0b7c70 0x7fed4c14b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:24.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.416+0000 7fed4affd640 1 --2- 172.21.15.5:0/284101605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed4c0d1850 0x7fed4c14eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:24.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.416+0000 7fed4bfff640 1 -- 172.21.15.5:0/284101605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed4c0d1850 msgr2=0x7fed4c14eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:24.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.416+0000 7fed4bfff640 1 --2- 172.21.15.5:0/284101605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed4c0d1850 0x7fed4c14eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:24.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.416+0000 7fed4bfff640 1 -- 172.21.15.5:0/284101605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed4c0b7c70 msgr2=0x7fed4c14b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:24.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.416+0000 7fed4bfff640 1 --2- 172.21.15.5:0/284101605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed4c0b7c70 0x7fed4c14b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:24.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.416+0000 7fed4bfff640 1 -- 172.21.15.5:0/284101605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed40009420 con 0x7fed4c15fd60 2023-07-14T13:08:24.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.416+0000 7fed4bfff640 1 --2- 172.21.15.5:0/284101605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed4c15fd60 0x7fed4c0b62b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fed4400caa0 tx=0x7fed4400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:24.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.416+0000 7fed33fff640 1 -- 172.21.15.5:0/284101605 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4400ac00 con 0x7fed4c15fd60 2023-07-14T13:08:24.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.416+0000 7fed33fff640 1 -- 172.21.15.5:0/284101605 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4400ad60 con 0x7fed4c15fd60 2023-07-14T13:08:24.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.416+0000 7fed33fff640 1 -- 172.21.15.5:0/284101605 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed44012620 con 0x7fed4c15fd60 2023-07-14T13:08:24.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.416+0000 7fed51d2c640 1 -- 172.21.15.5:0/284101605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4c14d480 con 0x7fed4c15fd60 2023-07-14T13:08:24.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.416+0000 7fed51d2c640 1 -- 172.21.15.5:0/284101605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4c0b67f0 con 0x7fed4c15fd60 2023-07-14T13:08:24.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.420+0000 7fed51d2c640 1 -- 172.21.15.5:0/284101605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed4c0c9220 con 0x7fed4c15fd60 2023-07-14T13:08:24.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.420+0000 7fed33fff640 1 -- 172.21.15.5:0/284101605 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fed44007070 con 0x7fed4c15fd60 2023-07-14T13:08:24.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.420+0000 7fed33fff640 1 --2- 172.21.15.5:0/284101605 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fed380663a0 0x7fed38068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:24.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.420+0000 7fed33fff640 1 -- 172.21.15.5:0/284101605 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed44083e70 con 0x7fed4c15fd60 2023-07-14T13:08:24.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.420+0000 7fed4b7fe640 1 --2- 172.21.15.5:0/284101605 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fed380663a0 0x7fed38068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:24.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.420+0000 7fed4b7fe640 1 --2- 172.21.15.5:0/284101605 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fed380663a0 0x7fed38068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fed3c007fd0 tx=0x7fed3c009040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:24.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.424+0000 7fed33fff640 1 -- 172.21.15.5:0/284101605 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fed44051170 con 0x7fed4c15fd60 2023-07-14T13:08:24.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.580+0000 7fed51d2c640 1 -- 172.21.15.5:0/284101605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed4c0678d0 con 0x7fed4c15fd60 2023-07-14T13:08:24.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.584+0000 7fed33fff640 1 -- 172.21.15.5:0/284101605 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18258 (secure 0 0 0) 0x7fed44054790 con 0x7fed4c15fd60 2023-07-14T13:08:24.617 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:24.618 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":82,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:08:23.268065+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:08:21.382297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-14T13:08:22.261284+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:08:24.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.584+0000 7fed51d2c640 1 -- 172.21.15.5:0/284101605 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fed380663a0 msgr2=0x7fed38068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:24.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.584+0000 7fed51d2c640 1 --2- 172.21.15.5:0/284101605 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fed380663a0 0x7fed38068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fed3c007fd0 tx=0x7fed3c009040 comp rx=0 tx=0).stop 2023-07-14T13:08:24.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.584+0000 7fed51d2c640 1 -- 172.21.15.5:0/284101605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed4c15fd60 msgr2=0x7fed4c0b62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:24.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.584+0000 7fed51d2c640 1 --2- 172.21.15.5:0/284101605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed4c15fd60 0x7fed4c0b62b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fed4400caa0 tx=0x7fed4400cf60 comp rx=0 tx=0).stop 2023-07-14T13:08:24.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.584+0000 7fed51d2c640 1 -- 172.21.15.5:0/284101605 shutdown_connections 2023-07-14T13:08:24.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.584+0000 7fed51d2c640 1 --2- 172.21.15.5:0/284101605 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fed380663a0 0x7fed38068850 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:24.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.584+0000 7fed51d2c640 1 --2- 172.21.15.5:0/284101605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed4c15fd60 0x7fed4c0b62b0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:24.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.584+0000 7fed51d2c640 1 --2- 172.21.15.5:0/284101605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed4c0d1850 0x7fed4c14eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:24.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.584+0000 7fed51d2c640 1 --2- 172.21.15.5:0/284101605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed4c0b7c70 0x7fed4c14b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:24.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.584+0000 7fed51d2c640 1 -- 172.21.15.5:0/284101605 >> 172.21.15.5:0/284101605 conn(0x7fed4c0650b0 msgr2=0x7fed4c15f370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:24.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.584+0000 7fed51d2c640 1 -- 172.21.15.5:0/284101605 shutdown_connections 2023-07-14T13:08:24.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.584+0000 7fed51d2c640 1 -- 172.21.15.5:0/284101605 wait complete. 2023-07-14T13:08:24.640 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-14T13:08:24.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.752+0000 7fd907940640 1 Processor -- start 2023-07-14T13:08:24.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.752+0000 7fd907940640 1 -- start start 2023-07-14T13:08:24.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.752+0000 7fd907940640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd900069430 0x7fd900069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:24.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.752+0000 7fd907940640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd900070f30 0x7fd9000ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:24.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.752+0000 7fd907940640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd900159d70 con 0x7fd9000af2b0 2023-07-14T13:08:24.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.752+0000 7fd907940640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd900069d40 con 0x7fd900070f30 2023-07-14T13:08:24.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.752+0000 7fd907940640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9000c9c60 con 0x7fd900069430 2023-07-14T13:08:24.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.756+0000 7fd904edb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd900070f30 0x7fd9000ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:24.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.756+0000 7fd904edb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd900070f30 0x7fd9000ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38678/0 (socket says 172.21.15.5:38678) 2023-07-14T13:08:24.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.756+0000 7fd904edb640 1 -- 172.21.15.5:0/1346644084 learned_addr learned my addr 172.21.15.5:0/1346644084 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:24.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.756+0000 7fd9056dc640 1 --2- 172.21.15.5:0/1346644084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd900069430 0x7fd900069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.756+0000 7fd905edd640 1 --1- 172.21.15.5:0/1346644084 >> v1:172.21.15.154:6789/0 conn(0x7fd9000af2b0 0x7fd90015a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:50260/0 (socket says 172.21.15.5:50260) 2023-07-14T13:08:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.756+0000 7fd904edb640 1 -- 172.21.15.5:0/1346644084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd900069430 msgr2=0x7fd900069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.756+0000 7fd904edb640 1 --2- 172.21.15.5:0/1346644084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd900069430 0x7fd900069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.756+0000 7fd904edb640 1 -- 172.21.15.5:0/1346644084 >> v1:172.21.15.154:6789/0 conn(0x7fd9000af2b0 legacy=0x7fd90015a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.756+0000 7fd904edb640 1 -- 172.21.15.5:0/1346644084 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9000c9f40 con 0x7fd900070f30 2023-07-14T13:08:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.756+0000 7fd8f7fff640 1 -- 172.21.15.5:0/1346644084 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065052518 0 0) 0x7fd8f80014a0 con 0x7fd9000af2b0 2023-07-14T13:08:24.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.756+0000 7fd904edb640 1 --2- 172.21.15.5:0/1346644084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd900070f30 0x7fd9000ad6f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009870 tx=0x7fd8f001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b3d1a66c46363f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:24.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.760+0000 7fd8f7fff640 1 -- 172.21.15.5:0/1346644084 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f00a9400 con 0x7fd900070f30 2023-07-14T13:08:24.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.760+0000 7fd8f7fff640 1 -- 172.21.15.5:0/1346644084 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f00a9560 con 0x7fd900070f30 2023-07-14T13:08:24.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.760+0000 7fd8f7fff640 1 -- 172.21.15.5:0/1346644084 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f00a98f0 con 0x7fd900070f30 2023-07-14T13:08:24.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.760+0000 7fd907940640 1 -- 172.21.15.5:0/1346644084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd900070f30 msgr2=0x7fd9000ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:24.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.760+0000 7fd907940640 1 --2- 172.21.15.5:0/1346644084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd900070f30 0x7fd9000ad6f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009870 tx=0x7fd8f001c540 comp rx=0 tx=0).stop 2023-07-14T13:08:24.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.760+0000 7fd907940640 1 -- 172.21.15.5:0/1346644084 shutdown_connections 2023-07-14T13:08:24.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.760+0000 7fd907940640 1 --2- 172.21.15.5:0/1346644084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd900070f30 0x7fd9000ad6f0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:24.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.760+0000 7fd907940640 1 --2- 172.21.15.5:0/1346644084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd900069430 0x7fd900069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:24.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.760+0000 7fd907940640 1 -- 172.21.15.5:0/1346644084 >> 172.21.15.5:0/1346644084 conn(0x7fd9000cde90 msgr2=0x7fd9000ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:24.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.760+0000 7fd907940640 1 -- 172.21.15.5:0/1346644084 shutdown_connections 2023-07-14T13:08:24.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.760+0000 7fd907940640 1 -- 172.21.15.5:0/1346644084 wait complete. 2023-07-14T13:08:24.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.760+0000 7fd907940640 1 Processor -- start 2023-07-14T13:08:24.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.760+0000 7fd907940640 1 -- start start 2023-07-14T13:08:24.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.760+0000 7fd907940640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd900069430 0x7fd900141850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:24.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.760+0000 7fd907940640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd900070f30 0x7fd90013ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:24.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.760+0000 7fd907940640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9000af2b0 0x7fd90006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:24.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.760+0000 7fd907940640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90006c090 con 0x7fd900069430 2023-07-14T13:08:24.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.760+0000 7fd907940640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90006bdf0 con 0x7fd9000af2b0 2023-07-14T13:08:24.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.760+0000 7fd907940640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90013f290 con 0x7fd900070f30 2023-07-14T13:08:24.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.760+0000 7fd9056dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd900069430 0x7fd900141850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:24.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.760+0000 7fd9056dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd900069430 0x7fd900141850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38680/0 (socket says 172.21.15.5:38680) 2023-07-14T13:08:24.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.760+0000 7fd9056dc640 1 -- 172.21.15.5:0/1371760069 learned_addr learned my addr 172.21.15.5:0/1371760069 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:24.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.760+0000 7fd904edb640 1 --2- 172.21.15.5:0/1371760069 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd900070f30 0x7fd90013ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:24.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.760+0000 7fd905edd640 1 --2- 172.21.15.5:0/1371760069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9000af2b0 0x7fd90006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:24.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.764+0000 7fd9056dc640 1 -- 172.21.15.5:0/1371760069 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd900070f30 msgr2=0x7fd90013ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:24.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.764+0000 7fd9056dc640 1 --2- 172.21.15.5:0/1371760069 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd900070f30 0x7fd90013ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:24.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.764+0000 7fd9056dc640 1 -- 172.21.15.5:0/1371760069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9000af2b0 msgr2=0x7fd90006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:24.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.764+0000 7fd9056dc640 1 --2- 172.21.15.5:0/1371760069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9000af2b0 0x7fd90006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:24.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.764+0000 7fd9056dc640 1 -- 172.21.15.5:0/1371760069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f00094d0 con 0x7fd900069430 2023-07-14T13:08:24.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.764+0000 7fd9056dc640 1 --2- 172.21.15.5:0/1371760069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd900069430 0x7fd900141850 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc00e870 tx=0x7fd8fc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:24.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.764+0000 7fd8f5ffb640 1 -- 172.21.15.5:0/1371760069 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc009510 con 0x7fd900069430 2023-07-14T13:08:24.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.764+0000 7fd8f5ffb640 1 -- 172.21.15.5:0/1371760069 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8fc00eec0 con 0x7fd900069430 2023-07-14T13:08:24.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.764+0000 7fd8f5ffb640 1 -- 172.21.15.5:0/1371760069 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc00cb40 con 0x7fd900069430 2023-07-14T13:08:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.764+0000 7fd907940640 1 -- 172.21.15.5:0/1371760069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9000ab9c0 con 0x7fd900069430 2023-07-14T13:08:24.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.764+0000 7fd907940640 1 -- 172.21.15.5:0/1371760069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9000abf80 con 0x7fd900069430 2023-07-14T13:08:24.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.764+0000 7fd907940640 1 -- 172.21.15.5:0/1371760069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9000adbb0 con 0x7fd900069430 2023-07-14T13:08:24.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.764+0000 7fd8f5ffb640 1 -- 172.21.15.5:0/1371760069 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd8fc00cca0 con 0x7fd900069430 2023-07-14T13:08:24.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.764+0000 7fd8f5ffb640 1 --2- 172.21.15.5:0/1371760069 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fd8e40663a0 0x7fd8e4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:24.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.764+0000 7fd8f5ffb640 1 -- 172.21.15.5:0/1371760069 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd8fc083e30 con 0x7fd900069430 2023-07-14T13:08:24.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.768+0000 7fd904edb640 1 --2- 172.21.15.5:0/1371760069 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fd8e40663a0 0x7fd8e4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:24.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.768+0000 7fd904edb640 1 --2- 172.21.15.5:0/1371760069 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fd8e40663a0 0x7fd8e4068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd8f00ae000 tx=0x7fd8f00b3040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:24.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.768+0000 7fd8f5ffb640 1 -- 172.21.15.5:0/1371760069 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd8fc0512e0 con 0x7fd900069430 2023-07-14T13:08:24.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:24.960+0000 7fd907940640 1 -- 172.21.15.5:0/1371760069 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd9000678d0 con 0x7fd900069430 2023-07-14T13:08:25.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:25.900+0000 7fd8f5ffb640 1 -- 172.21.15.5:0/1371760069 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd8fc0170b0 con 0x7fd900069430 2023-07-14T13:08:25.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:25.904+0000 7fd907940640 1 -- 172.21.15.5:0/1371760069 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fd8e40663a0 msgr2=0x7fd8e4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:25.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:25.904+0000 7fd907940640 1 --2- 172.21.15.5:0/1371760069 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fd8e40663a0 0x7fd8e4068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd8f00ae000 tx=0x7fd8f00b3040 comp rx=0 tx=0).stop 2023-07-14T13:08:25.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:25.904+0000 7fd907940640 1 -- 172.21.15.5:0/1371760069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd900069430 msgr2=0x7fd900141850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:25.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:25.904+0000 7fd907940640 1 --2- 172.21.15.5:0/1371760069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd900069430 0x7fd900141850 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc00e870 tx=0x7fd8fc00ec70 comp rx=0 tx=0).stop 2023-07-14T13:08:25.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:25.904+0000 7fd907940640 1 -- 172.21.15.5:0/1371760069 shutdown_connections 2023-07-14T13:08:25.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:25.904+0000 7fd907940640 1 --2- 172.21.15.5:0/1371760069 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fd8e40663a0 0x7fd8e4068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:25.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:25.904+0000 7fd907940640 1 --2- 172.21.15.5:0/1371760069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9000af2b0 0x7fd90006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:25.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:25.904+0000 7fd907940640 1 --2- 172.21.15.5:0/1371760069 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd900070f30 0x7fd90013ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:25.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:25.904+0000 7fd907940640 1 --2- 172.21.15.5:0/1371760069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd900069430 0x7fd900141850 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:25.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:25.904+0000 7fd907940640 1 -- 172.21.15.5:0/1371760069 >> 172.21.15.5:0/1371760069 conn(0x7fd9000cde90 msgr2=0x7fd900153450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:25.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:25.904+0000 7fd907940640 1 -- 172.21.15.5:0/1371760069 shutdown_connections 2023-07-14T13:08:25.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:25.904+0000 7fd907940640 1 -- 172.21.15.5:0/1371760069 wait complete. 2023-07-14T13:08:25.960 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-14T13:08:25.960 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-14T13:08:26.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.080+0000 7f2e6de96640 1 Processor -- start 2023-07-14T13:08:26.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.080+0000 7f2e6de96640 1 -- start start 2023-07-14T13:08:26.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.080+0000 7f2e6de96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e680ad450 0x7f2e680c4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:26.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.080+0000 7f2e6de96640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e6815bf70 con 0x7f2e680c2d30 2023-07-14T13:08:26.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.080+0000 7f2e6de96640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e681600e0 con 0x7f2e6815bba0 2023-07-14T13:08:26.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.080+0000 7f2e6de96640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e680c4d00 con 0x7f2e680ad450 2023-07-14T13:08:26.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.080+0000 7f2e67fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2e680c2d30 0x7f2e680ad930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58072/0 (socket says 172.21.15.5:58072) 2023-07-14T13:08:26.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.080+0000 7f2e67fff640 1 -- 172.21.15.5:0/2366348336 learned_addr learned my addr 172.21.15.5:0/2366348336 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:26.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.080+0000 7f2e66ffd640 1 --2- 172.21.15.5:0/2366348336 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e680ad450 0x7f2e680c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:26.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.080+0000 7f2e667fc640 1 -- 172.21.15.5:0/2366348336 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3296209734 0 0) 0x7f2e6815bf70 con 0x7f2e680c2d30 2023-07-14T13:08:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.080+0000 7f2e667fc640 1 -- 172.21.15.5:0/2366348336 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e50003530 con 0x7f2e680c2d30 2023-07-14T13:08:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.080+0000 7f2e667fc640 1 -- 172.21.15.5:0/2366348336 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 201620182 0 0) 0x7f2e681600e0 con 0x7f2e6815bba0 2023-07-14T13:08:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.080+0000 7f2e667fc640 1 -- 172.21.15.5:0/2366348336 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e6815bf70 con 0x7f2e6815bba0 2023-07-14T13:08:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.080+0000 7f2e66ffd640 1 -- 172.21.15.5:0/2366348336 >> v1:172.21.15.154:6789/0 conn(0x7f2e6815bba0 legacy=0x7f2e680acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.080+0000 7f2e66ffd640 1 -- 172.21.15.5:0/2366348336 >> v1:172.21.15.5:6789/0 conn(0x7f2e680c2d30 legacy=0x7f2e680ad930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.080+0000 7f2e66ffd640 1 -- 172.21.15.5:0/2366348336 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e68160570 con 0x7f2e680ad450 2023-07-14T13:08:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.084+0000 7f2e66ffd640 1 --2- 172.21.15.5:0/2366348336 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e680ad450 0x7f2e680c4620 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0097f0 tx=0x7f2e5c01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4e7870665087432 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:26.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.084+0000 7f2e667fc640 1 -- 172.21.15.5:0/2366348336 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c0ab600 con 0x7f2e680ad450 2023-07-14T13:08:26.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.084+0000 7f2e667fc640 1 -- 172.21.15.5:0/2366348336 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5c0ab760 con 0x7f2e680ad450 2023-07-14T13:08:26.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.084+0000 7f2e667fc640 1 -- 172.21.15.5:0/2366348336 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c0abad0 con 0x7f2e680ad450 2023-07-14T13:08:26.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.084+0000 7f2e6de96640 1 -- 172.21.15.5:0/2366348336 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e680ad450 msgr2=0x7f2e680c4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:26.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.084+0000 7f2e6de96640 1 --2- 172.21.15.5:0/2366348336 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e680ad450 0x7f2e680c4620 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0097f0 tx=0x7f2e5c01c400 comp rx=0 tx=0).stop 2023-07-14T13:08:26.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.084+0000 7f2e6de96640 1 -- 172.21.15.5:0/2366348336 shutdown_connections 2023-07-14T13:08:26.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.084+0000 7f2e6de96640 1 --2- 172.21.15.5:0/2366348336 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e680ad450 0x7f2e680c4620 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:26.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.084+0000 7f2e6de96640 1 -- 172.21.15.5:0/2366348336 >> 172.21.15.5:0/2366348336 conn(0x7f2e680cde90 msgr2=0x7f2e680ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:26.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.084+0000 7f2e6de96640 1 -- 172.21.15.5:0/2366348336 shutdown_connections 2023-07-14T13:08:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.084+0000 7f2e6de96640 1 -- 172.21.15.5:0/2366348336 wait complete. 2023-07-14T13:08:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.088+0000 7f2e6de96640 1 Processor -- start 2023-07-14T13:08:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.088+0000 7f2e6de96640 1 -- start start 2023-07-14T13:08:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.088+0000 7f2e6de96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e680ad450 0x7f2e6815cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.088+0000 7f2e6de96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e680c2d30 0x7f2e68152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.088+0000 7f2e6de96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e6815bba0 0x7f2e6814ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:26.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.088+0000 7f2e6de96640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e680cd5c0 con 0x7f2e680ad450 2023-07-14T13:08:26.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.088+0000 7f2e6de96640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6815d0f0 con 0x7f2e680c2d30 2023-07-14T13:08:26.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.088+0000 7f2e6de96640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6815d6e0 con 0x7f2e6815bba0 2023-07-14T13:08:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.088+0000 7f2e677fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e680ad450 0x7f2e6815cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.088+0000 7f2e677fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e680ad450 0x7f2e6815cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38694/0 (socket says 172.21.15.5:38694) 2023-07-14T13:08:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.088+0000 7f2e677fe640 1 -- 172.21.15.5:0/273378696 learned_addr learned my addr 172.21.15.5:0/273378696 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.088+0000 7f2e67fff640 1 --2- 172.21.15.5:0/273378696 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e6815bba0 0x7f2e6814ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.088+0000 7f2e66ffd640 1 --2- 172.21.15.5:0/273378696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e680c2d30 0x7f2e68152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:26.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.088+0000 7f2e677fe640 1 -- 172.21.15.5:0/273378696 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e6815bba0 msgr2=0x7f2e6814ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:26.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.088+0000 7f2e677fe640 1 --2- 172.21.15.5:0/273378696 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e6815bba0 0x7f2e6814ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:26.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.088+0000 7f2e677fe640 1 -- 172.21.15.5:0/273378696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e680c2d30 msgr2=0x7f2e68152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:26.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.088+0000 7f2e677fe640 1 --2- 172.21.15.5:0/273378696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e680c2d30 0x7f2e68152450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:26.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.088+0000 7f2e677fe640 1 -- 172.21.15.5:0/273378696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5c009420 con 0x7f2e680ad450 2023-07-14T13:08:26.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.088+0000 7f2e677fe640 1 --2- 172.21.15.5:0/273378696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e680ad450 0x7f2e6815cae0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800c490 tx=0x7f2e5800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:26.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.088+0000 7f2e4ffff640 1 -- 172.21.15.5:0/273378696 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e580052d0 con 0x7f2e680ad450 2023-07-14T13:08:26.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.088+0000 7f2e4ffff640 1 -- 172.21.15.5:0/273378696 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e58005430 con 0x7f2e680ad450 2023-07-14T13:08:26.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.088+0000 7f2e6de96640 1 -- 172.21.15.5:0/273378696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e680cd000 con 0x7f2e680ad450 2023-07-14T13:08:26.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.088+0000 7f2e4ffff640 1 -- 172.21.15.5:0/273378696 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e58012870 con 0x7f2e680ad450 2023-07-14T13:08:26.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.088+0000 7f2e6de96640 1 -- 172.21.15.5:0/273378696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e680cd9f0 con 0x7f2e680ad450 2023-07-14T13:08:26.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.092+0000 7f2e6de96640 1 -- 172.21.15.5:0/273378696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6815d4b0 con 0x7f2e680ad450 2023-07-14T13:08:26.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.092+0000 7f2e4ffff640 1 -- 172.21.15.5:0/273378696 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2e580129d0 con 0x7f2e680ad450 2023-07-14T13:08:26.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.092+0000 7f2e4ffff640 1 --2- 172.21.15.5:0/273378696 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f2e540663d0 0x7f2e54068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:26.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.092+0000 7f2e4ffff640 1 -- 172.21.15.5:0/273378696 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2e580838c0 con 0x7f2e680ad450 2023-07-14T13:08:26.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.092+0000 7f2e66ffd640 1 --2- 172.21.15.5:0/273378696 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f2e540663d0 0x7f2e54068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:26.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.092+0000 7f2e66ffd640 1 --2- 172.21.15.5:0/273378696 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f2e540663d0 0x7f2e54068880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0af000 tx=0x7f2e5c0a7000 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:26.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.096+0000 7f2e4ffff640 1 -- 172.21.15.5:0/273378696 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2e6815d4b0 con 0x7f2e680ad450 2023-07-14T13:08:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.288+0000 7f2e6de96640 1 -- 172.21.15.5:0/273378696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2e6815d4b0 con 0x7f2e680ad450 2023-07-14T13:08:26.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.904+0000 7f2e4ffff640 1 -- 172.21.15.5:0/273378696 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2e6815d4b0 con 0x7f2e680ad450 2023-07-14T13:08:26.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.904+0000 7f2e6de96640 1 -- 172.21.15.5:0/273378696 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f2e540663d0 msgr2=0x7f2e54068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:26.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.904+0000 7f2e6de96640 1 --2- 172.21.15.5:0/273378696 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f2e540663d0 0x7f2e54068880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0af000 tx=0x7f2e5c0a7000 comp rx=0 tx=0).stop 2023-07-14T13:08:26.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.904+0000 7f2e6de96640 1 -- 172.21.15.5:0/273378696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e680ad450 msgr2=0x7f2e6815cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:26.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.904+0000 7f2e6de96640 1 --2- 172.21.15.5:0/273378696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e680ad450 0x7f2e6815cae0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800c490 tx=0x7f2e5800c950 comp rx=0 tx=0).stop 2023-07-14T13:08:26.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.904+0000 7f2e6de96640 1 -- 172.21.15.5:0/273378696 shutdown_connections 2023-07-14T13:08:26.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.904+0000 7f2e6de96640 1 --2- 172.21.15.5:0/273378696 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f2e540663d0 0x7f2e54068880 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:26.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.904+0000 7f2e6de96640 1 --2- 172.21.15.5:0/273378696 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e6815bba0 0x7f2e6814ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:26.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.904+0000 7f2e6de96640 1 --2- 172.21.15.5:0/273378696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e680c2d30 0x7f2e68152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:26.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.904+0000 7f2e6de96640 1 --2- 172.21.15.5:0/273378696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e680ad450 0x7f2e6815cae0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:26.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.904+0000 7f2e6de96640 1 -- 172.21.15.5:0/273378696 >> 172.21.15.5:0/273378696 conn(0x7f2e680cde90 msgr2=0x7f2e680c88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:26.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.908+0000 7f2e6de96640 1 -- 172.21.15.5:0/273378696 shutdown_connections 2023-07-14T13:08:26.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:26.908+0000 7f2e6de96640 1 -- 172.21.15.5:0/273378696 wait complete. 2023-07-14T13:08:26.963 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-14T13:08:26.964 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:08:27.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.080+0000 7f34b148a640 1 Processor -- start 2023-07-14T13:08:27.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.080+0000 7f34b148a640 1 -- start start 2023-07-14T13:08:27.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.080+0000 7f34b148a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f34ac159850 0x7f34ac15db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:27.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.080+0000 7f34b148a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ac0cd7e0 0x7f34ac159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:27.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.080+0000 7f34b148a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34ac15a660 con 0x7f34ac15a160 2023-07-14T13:08:27.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.080+0000 7f34b148a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34ac15a940 con 0x7f34ac159850 2023-07-14T13:08:27.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.080+0000 7f34b148a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac15ac20 con 0x7f34ac0cd7e0 2023-07-14T13:08:27.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.080+0000 7f34abfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f34ac159850 0x7f34ac15db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:27.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.080+0000 7f34ab7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ac0cd7e0 0x7f34ac159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:27.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.080+0000 7f34b0c89640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f34ac15a160 0x7f34ac0af8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:50274/0 (socket says 172.21.15.5:50274) 2023-07-14T13:08:27.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.080+0000 7f34b0c89640 1 -- 172.21.15.5:0/1204185291 learned_addr learned my addr 172.21.15.5:0/1204185291 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:27.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.080+0000 7f34ab7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ac0cd7e0 0x7f34ac159c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:42946/0 (socket says 172.21.15.5:42946) 2023-07-14T13:08:27.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.080+0000 7f34abfff640 1 -- 172.21.15.5:0/1204185291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ac0cd7e0 msgr2=0x7f34ac159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:27.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.080+0000 7f34abfff640 1 --2- 172.21.15.5:0/1204185291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ac0cd7e0 0x7f34ac159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:27.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.080+0000 7f34abfff640 1 -- 172.21.15.5:0/1204185291 >> v1:172.21.15.154:6789/0 conn(0x7f34ac15a160 legacy=0x7f34ac0af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:27.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.080+0000 7f34abfff640 1 -- 172.21.15.5:0/1204185291 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ac15d380 con 0x7f34ac159850 2023-07-14T13:08:27.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.080+0000 7f34ab7fe640 1 --2- 172.21.15.5:0/1204185291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ac0cd7e0 0x7f34ac159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:27.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.080+0000 7f34aaffd640 1 -- 172.21.15.5:0/1204185291 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231162572 0 0) 0x7f34ac15a660 con 0x7f34ac15a160 2023-07-14T13:08:27.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.084+0000 7f34abfff640 1 --2- 172.21.15.5:0/1204185291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34ac159850 0x7f34ac15db80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f349c0097c0 tx=0x7f349c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf394085b2945c23 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:27.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.084+0000 7f34aaffd640 1 -- 172.21.15.5:0/1204185291 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac15e2d0 con 0x7f34ac159850 2023-07-14T13:08:27.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.084+0000 7f34aaffd640 1 -- 172.21.15.5:0/1204185291 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c0ab670 con 0x7f34ac159850 2023-07-14T13:08:27.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.084+0000 7f34aaffd640 1 -- 172.21.15.5:0/1204185291 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c0aba00 con 0x7f34ac159850 2023-07-14T13:08:27.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.084+0000 7f34b148a640 1 -- 172.21.15.5:0/1204185291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34ac159850 msgr2=0x7f34ac15db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:27.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.084+0000 7f34b148a640 1 --2- 172.21.15.5:0/1204185291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34ac159850 0x7f34ac15db80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f349c0097c0 tx=0x7f349c01c450 comp rx=0 tx=0).stop 2023-07-14T13:08:27.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.084+0000 7f34b148a640 1 -- 172.21.15.5:0/1204185291 shutdown_connections 2023-07-14T13:08:27.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.084+0000 7f34b148a640 1 --2- 172.21.15.5:0/1204185291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ac0cd7e0 0x7f34ac159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:27.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.084+0000 7f34b148a640 1 --2- 172.21.15.5:0/1204185291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34ac159850 0x7f34ac15db80 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:27.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.084+0000 7f34b148a640 1 -- 172.21.15.5:0/1204185291 >> 172.21.15.5:0/1204185291 conn(0x7f34ac0ca8b0 msgr2=0x7f34ac0cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:27.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.084+0000 7f34b148a640 1 -- 172.21.15.5:0/1204185291 shutdown_connections 2023-07-14T13:08:27.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.084+0000 7f34b148a640 1 -- 172.21.15.5:0/1204185291 wait complete. 2023-07-14T13:08:27.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.088+0000 7f34b148a640 1 Processor -- start 2023-07-14T13:08:27.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.088+0000 7f34b148a640 1 -- start start 2023-07-14T13:08:27.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.088+0000 7f34b148a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ac0cd7e0 0x7f34ac0c3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:27.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.088+0000 7f34b148a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34ac159850 0x7f34ac0c2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:27.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.088+0000 7f34b148a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34ac15a160 0x7f34ac06f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:27.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.088+0000 7f34b148a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac0707e0 con 0x7f34ac15a160 2023-07-14T13:08:27.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.088+0000 7f34b148a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac14f960 con 0x7f34ac159850 2023-07-14T13:08:27.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.088+0000 7f34b148a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac0c4290 con 0x7f34ac0cd7e0 2023-07-14T13:08:27.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.088+0000 7f34b0c89640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34ac15a160 0x7f34ac06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:27.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.088+0000 7f34b0c89640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34ac15a160 0x7f34ac06f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38696/0 (socket says 172.21.15.5:38696) 2023-07-14T13:08:27.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.088+0000 7f34b0c89640 1 -- 172.21.15.5:0/2598670694 learned_addr learned my addr 172.21.15.5:0/2598670694 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:27.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.088+0000 7f34ab7fe640 1 --2- 172.21.15.5:0/2598670694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34ac159850 0x7f34ac0c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:27.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.088+0000 7f34abfff640 1 --2- 172.21.15.5:0/2598670694 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ac0cd7e0 0x7f34ac0c3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:27.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.088+0000 7f34b0c89640 1 -- 172.21.15.5:0/2598670694 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ac0cd7e0 msgr2=0x7f34ac0c3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:27.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.088+0000 7f34b0c89640 1 --2- 172.21.15.5:0/2598670694 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ac0cd7e0 0x7f34ac0c3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:27.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.088+0000 7f34b0c89640 1 -- 172.21.15.5:0/2598670694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34ac159850 msgr2=0x7f34ac0c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:27.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.088+0000 7f34b0c89640 1 --2- 172.21.15.5:0/2598670694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34ac159850 0x7f34ac0c2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:27.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.088+0000 7f34b0c89640 1 -- 172.21.15.5:0/2598670694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a0009420 con 0x7f34ac15a160 2023-07-14T13:08:27.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.088+0000 7f34b0c89640 1 --2- 172.21.15.5:0/2598670694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34ac15a160 0x7f34ac06f060 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f34a400c780 tx=0x7f34a400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:27.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.088+0000 7f34a8ff9640 1 -- 172.21.15.5:0/2598670694 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a400ce90 con 0x7f34ac15a160 2023-07-14T13:08:27.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.088+0000 7f34a8ff9640 1 -- 172.21.15.5:0/2598670694 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a400a640 con 0x7f34ac15a160 2023-07-14T13:08:27.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.088+0000 7f34a8ff9640 1 -- 172.21.15.5:0/2598670694 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a400a9d0 con 0x7f34ac15a160 2023-07-14T13:08:27.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.088+0000 7f34b148a640 1 -- 172.21.15.5:0/2598670694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349c009420 con 0x7f34ac15a160 2023-07-14T13:08:27.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.088+0000 7f34b148a640 1 -- 172.21.15.5:0/2598670694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ac0c4850 con 0x7f34ac15a160 2023-07-14T13:08:27.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.088+0000 7f34b148a640 1 -- 172.21.15.5:0/2598670694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ac14fad0 con 0x7f34ac15a160 2023-07-14T13:08:27.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.092+0000 7f34a8ff9640 1 -- 172.21.15.5:0/2598670694 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f34a400ab30 con 0x7f34ac15a160 2023-07-14T13:08:27.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.092+0000 7f34a8ff9640 1 --2- 172.21.15.5:0/2598670694 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f34980663a0 0x7f3498068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:27.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.092+0000 7f34a8ff9640 1 -- 172.21.15.5:0/2598670694 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f34a4083310 con 0x7f34ac15a160 2023-07-14T13:08:27.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.092+0000 7f34abfff640 1 --2- 172.21.15.5:0/2598670694 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f34980663a0 0x7f3498068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:27.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.092+0000 7f34abfff640 1 --2- 172.21.15.5:0/2598670694 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f34980663a0 0x7f3498068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f349c0af000 tx=0x7f349c0a7000 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:27.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.096+0000 7f34a8ff9640 1 -- 172.21.15.5:0/2598670694 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f34ac14fad0 con 0x7f34ac15a160 2023-07-14T13:08:27.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.284+0000 7f34b148a640 1 -- 172.21.15.5:0/2598670694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34ac14fad0 con 0x7f34ac15a160 2023-07-14T13:08:27.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.284+0000 7f34a8ff9640 1 -- 172.21.15.5:0/2598670694 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4710 (secure 0 0 0) 0x7f34ac14fad0 con 0x7f34ac15a160 2023-07-14T13:08:27.319 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:27.319 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5837,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3019701155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3019701155},{"type":"v1","addr":"172.21.15.5:6835","nonce":3019701155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5843,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1673574180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1673574180},{"type":"v1","addr":"172.21.15.154:6837","nonce":1673574180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6421,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3017507974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3017507974},{"type":"v1","addr":"172.21.15.154:6836","nonce":3017507974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:08:23.268544+0000","modified":"2023-07-14T13:08:26.903497+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6576},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6576":{"gid":6576,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/1613814904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1613814904},{"type":"v1","addr":"172.21.15.5:6834","nonce":1613814904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-14T13:08:27.319 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 32 2023-07-14T13:08:27.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.288+0000 7f34b148a640 1 -- 172.21.15.5:0/2598670694 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f34980663a0 msgr2=0x7f3498068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:27.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.288+0000 7f34b148a640 1 --2- 172.21.15.5:0/2598670694 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f34980663a0 0x7f3498068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f349c0af000 tx=0x7f349c0a7000 comp rx=0 tx=0).stop 2023-07-14T13:08:27.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.288+0000 7f34b148a640 1 -- 172.21.15.5:0/2598670694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34ac15a160 msgr2=0x7f34ac06f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:27.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.288+0000 7f34b148a640 1 --2- 172.21.15.5:0/2598670694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34ac15a160 0x7f34ac06f060 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f34a400c780 tx=0x7f34a400cc40 comp rx=0 tx=0).stop 2023-07-14T13:08:27.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.288+0000 7f34b148a640 1 -- 172.21.15.5:0/2598670694 shutdown_connections 2023-07-14T13:08:27.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.288+0000 7f34b148a640 1 --2- 172.21.15.5:0/2598670694 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f34980663a0 0x7f3498068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:27.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.288+0000 7f34b148a640 1 --2- 172.21.15.5:0/2598670694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34ac15a160 0x7f34ac06f060 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:27.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.288+0000 7f34b148a640 1 --2- 172.21.15.5:0/2598670694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34ac159850 0x7f34ac0c2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:27.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.288+0000 7f34b148a640 1 --2- 172.21.15.5:0/2598670694 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ac0cd7e0 0x7f34ac0c3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:27.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.288+0000 7f34b148a640 1 -- 172.21.15.5:0/2598670694 >> 172.21.15.5:0/2598670694 conn(0x7f34ac0ca8b0 msgr2=0x7f34ac158840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:27.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.288+0000 7f34b148a640 1 -- 172.21.15.5:0/2598670694 shutdown_connections 2023-07-14T13:08:27.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.288+0000 7f34b148a640 1 -- 172.21.15.5:0/2598670694 wait complete. 2023-07-14T13:08:27.339 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:08:27.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.448+0000 7f2e1c79f640 1 Processor -- start 2023-07-14T13:08:27.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.448+0000 7f2e1c79f640 1 -- start start 2023-07-14T13:08:27.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e1c79f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e140cb100 0x7f2e140cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:27.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e1c79f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e140cac70 con 0x7f2e1406b1e0 2023-07-14T13:08:27.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e1c79f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e140cbaa0 con 0x7f2e14070b70 2023-07-14T13:08:27.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e1c79f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e140ca060 con 0x7f2e140cb100 2023-07-14T13:08:27.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e19d3a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2e1406b1e0 0x7f2e140c1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58088/0 (socket says 172.21.15.5:58088) 2023-07-14T13:08:27.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e19d3a640 1 -- 172.21.15.5:0/1091847376 learned_addr learned my addr 172.21.15.5:0/1091847376 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:27.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e1ad3c640 1 --2- 172.21.15.5:0/1091847376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e140cb100 0x7f2e140cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:27.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e19539640 1 -- 172.21.15.5:0/1091847376 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1868786962 0 0) 0x7f2e140cac70 con 0x7f2e1406b1e0 2023-07-14T13:08:27.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e19539640 1 -- 172.21.15.5:0/1091847376 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e00003530 con 0x7f2e1406b1e0 2023-07-14T13:08:27.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e19539640 1 -- 172.21.15.5:0/1091847376 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847166331 0 0) 0x7f2e140cbaa0 con 0x7f2e14070b70 2023-07-14T13:08:27.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e19539640 1 -- 172.21.15.5:0/1091847376 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e140cac70 con 0x7f2e14070b70 2023-07-14T13:08:27.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e19539640 1 -- 172.21.15.5:0/1091847376 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2758570443 0 0) 0x7f2e00003530 con 0x7f2e1406b1e0 2023-07-14T13:08:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e19539640 1 -- 172.21.15.5:0/1091847376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e140cb100 msgr2=0x7f2e140cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e19539640 1 --2- 172.21.15.5:0/1091847376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e140cb100 0x7f2e140cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e19539640 1 -- 172.21.15.5:0/1091847376 >> v1:172.21.15.154:6789/0 conn(0x7f2e14070b70 legacy=0x7f2e14070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e19539640 1 -- 172.21.15.5:0/1091847376 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e140ca340 con 0x7f2e1406b1e0 2023-07-14T13:08:27.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e19539640 1 -- 172.21.15.5:0/1091847376 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f2e04001680 con 0x7f2e1406b1e0 2023-07-14T13:08:27.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e19539640 1 -- 172.21.15.5:0/1091847376 >> v1:172.21.15.5:6789/0 conn(0x7f2e1406b1e0 legacy=0x7f2e140c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:27.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e19539640 1 --2- 172.21.15.5:0/1091847376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e00003b40 0x7f2e00003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:27.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e19539640 1 --2- 172.21.15.5:0/1091847376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e000047d0 0x7f2e00004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:27.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e19539640 1 --2- 172.21.15.5:0/1091847376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e00005180 0x7f2e0000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:27.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e19539640 1 -- 172.21.15.5:0/1091847376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e140ca060 con 0x7f2e000047d0 2023-07-14T13:08:27.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e19539640 1 -- 172.21.15.5:0/1091847376 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0000bf50 con 0x7f2e00005180 2023-07-14T13:08:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e19539640 1 -- 172.21.15.5:0/1091847376 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0000c110 con 0x7f2e00003b40 2023-07-14T13:08:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e19d3a640 1 --2- 172.21.15.5:0/1091847376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e000047d0 0x7f2e00004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e1a53b640 1 --2- 172.21.15.5:0/1091847376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e00003b40 0x7f2e00003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e1ad3c640 1 --2- 172.21.15.5:0/1091847376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e00005180 0x7f2e0000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:27.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e19d3a640 1 -- 172.21.15.5:0/1091847376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e00003b40 msgr2=0x7f2e00003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:27.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e19d3a640 1 --2- 172.21.15.5:0/1091847376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e00003b40 0x7f2e00003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:27.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e19d3a640 1 -- 172.21.15.5:0/1091847376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e00005180 msgr2=0x7f2e0000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:27.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e19d3a640 1 --2- 172.21.15.5:0/1091847376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e00005180 0x7f2e0000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:27.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e19d3a640 1 -- 172.21.15.5:0/1091847376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e00003530 con 0x7f2e000047d0 2023-07-14T13:08:27.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.452+0000 7f2e1ad3c640 1 --2- 172.21.15.5:0/1091847376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e00005180 0x7f2e0000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:27.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.456+0000 7f2e19d3a640 1 --2- 172.21.15.5:0/1091847376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e000047d0 0x7f2e00004c40 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400c160 tx=0x7f2e0401cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6e21d5b329ccde server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:27.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.456+0000 7f2e19539640 1 -- 172.21.15.5:0/1091847376 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e040058e0 con 0x7f2e000047d0 2023-07-14T13:08:27.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.456+0000 7f2e19539640 1 -- 172.21.15.5:0/1091847376 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e04005a60 con 0x7f2e000047d0 2023-07-14T13:08:27.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.456+0000 7f2e19539640 1 -- 172.21.15.5:0/1091847376 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e04005e50 con 0x7f2e000047d0 2023-07-14T13:08:27.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.456+0000 7f2e1c79f640 1 -- 172.21.15.5:0/1091847376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e000047d0 msgr2=0x7f2e00004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:27.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.456+0000 7f2e1c79f640 1 --2- 172.21.15.5:0/1091847376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e000047d0 0x7f2e00004c40 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400c160 tx=0x7f2e0401cae0 comp rx=0 tx=0).stop 2023-07-14T13:08:27.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.456+0000 7f2e1ad3c640 1 -- 172.21.15.5:0/1091847376 reap_dead start 2023-07-14T13:08:27.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.456+0000 7f2e1c79f640 1 -- 172.21.15.5:0/1091847376 shutdown_connections 2023-07-14T13:08:27.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.456+0000 7f2e1c79f640 1 -- 172.21.15.5:0/1091847376 >> 172.21.15.5:0/1091847376 conn(0x7f2e140afcf0 msgr2=0x7f2e140b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:27.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.456+0000 7f2e1c79f640 1 -- 172.21.15.5:0/1091847376 shutdown_connections 2023-07-14T13:08:27.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.456+0000 7f2e1c79f640 1 -- 172.21.15.5:0/1091847376 wait complete. 2023-07-14T13:08:27.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.460+0000 7f2e1c79f640 1 Processor -- start 2023-07-14T13:08:27.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.460+0000 7f2e1c79f640 1 -- start start 2023-07-14T13:08:27.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.460+0000 7f2e1c79f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e000047d0 0x7f2e140c7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:27.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.460+0000 7f2e1c79f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e14148520 0x7f2e14155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:27.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.460+0000 7f2e1c79f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e14156130 0x7f2e140cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:27.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.460+0000 7f2e1c79f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e140c6010 con 0x7f2e14156130 2023-07-14T13:08:27.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.460+0000 7f2e1c79f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e140c62b0 con 0x7f2e14148520 2023-07-14T13:08:27.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.460+0000 7f2e1c79f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e140c6590 con 0x7f2e000047d0 2023-07-14T13:08:27.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.460+0000 7f2e1ad3c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e14156130 0x7f2e140cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:27.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.460+0000 7f2e1ad3c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e14156130 0x7f2e140cd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38718/0 (socket says 172.21.15.5:38718) 2023-07-14T13:08:27.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.460+0000 7f2e1ad3c640 1 -- 172.21.15.5:0/1137809195 learned_addr learned my addr 172.21.15.5:0/1137809195 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:27.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.460+0000 7f2e1a53b640 1 --2- 172.21.15.5:0/1137809195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e000047d0 0x7f2e140c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:27.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.460+0000 7f2e19d3a640 1 --2- 172.21.15.5:0/1137809195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e14148520 0x7f2e14155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:27.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.460+0000 7f2e1ad3c640 1 -- 172.21.15.5:0/1137809195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e000047d0 msgr2=0x7f2e140c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:27.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.460+0000 7f2e1ad3c640 1 --2- 172.21.15.5:0/1137809195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e000047d0 0x7f2e140c7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.460+0000 7f2e1ad3c640 1 -- 172.21.15.5:0/1137809195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e14148520 msgr2=0x7f2e14155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.460+0000 7f2e1ad3c640 1 --2- 172.21.15.5:0/1137809195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e14148520 0x7f2e14155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.460+0000 7f2e1ad3c640 1 -- 172.21.15.5:0/1137809195 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e140c6870 con 0x7f2e14156130 2023-07-14T13:08:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.460+0000 7f2e1ad3c640 1 --2- 172.21.15.5:0/1137809195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e14156130 0x7f2e140cd330 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f2e140c4cb0 tx=0x7f2e0c0101c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.460+0000 7f2e0affd640 1 -- 172.21.15.5:0/1137809195 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c01b070 con 0x7f2e14156130 2023-07-14T13:08:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.460+0000 7f2e0affd640 1 -- 172.21.15.5:0/1137809195 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c00f040 con 0x7f2e14156130 2023-07-14T13:08:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.460+0000 7f2e0affd640 1 -- 172.21.15.5:0/1137809195 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c00e050 con 0x7f2e14156130 2023-07-14T13:08:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.460+0000 7f2e1c79f640 1 -- 172.21.15.5:0/1137809195 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e140c6b50 con 0x7f2e14156130 2023-07-14T13:08:27.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.460+0000 7f2e1c79f640 1 -- 172.21.15.5:0/1137809195 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e14148970 con 0x7f2e14156130 2023-07-14T13:08:27.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.460+0000 7f2e1c79f640 1 -- 172.21.15.5:0/1137809195 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e140c6d40 con 0x7f2e14156130 2023-07-14T13:08:27.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.464+0000 7f2e0affd640 1 -- 172.21.15.5:0/1137809195 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2e0c010720 con 0x7f2e14156130 2023-07-14T13:08:27.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.464+0000 7f2e0affd640 1 --2- 172.21.15.5:0/1137809195 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f2df80663a0 0x7f2df8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:27.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.464+0000 7f2e0affd640 1 -- 172.21.15.5:0/1137809195 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2e0c083dc0 con 0x7f2e14156130 2023-07-14T13:08:27.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.464+0000 7f2e1a53b640 1 --2- 172.21.15.5:0/1137809195 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f2df80663a0 0x7f2df8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:27.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.464+0000 7f2e1a53b640 1 --2- 172.21.15.5:0/1137809195 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f2df80663a0 0x7f2df8068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2e10005630 tx=0x7f2e10009040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.468+0000 7f2e0affd640 1 -- 172.21.15.5:0/1137809195 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2e0c051020 con 0x7f2e14156130 2023-07-14T13:08:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.624+0000 7f2e1c79f640 1 -- 172.21.15.5:0/1137809195 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e140678d0 con 0x7f2e14156130 2023-07-14T13:08:27.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.624+0000 7f2e0affd640 1 -- 172.21.15.5:0/1137809195 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+18245 (secure 0 0 0) 0x7f2e0c054640 con 0x7f2e14156130 2023-07-14T13:08:27.660 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:27.660 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":83,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:08:24.881829+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:08:21.382297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-14T13:08:22.261284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:08:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.628+0000 7f2e1c79f640 1 -- 172.21.15.5:0/1137809195 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f2df80663a0 msgr2=0x7f2df8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.628+0000 7f2e1c79f640 1 --2- 172.21.15.5:0/1137809195 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f2df80663a0 0x7f2df8068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2e10005630 tx=0x7f2e10009040 comp rx=0 tx=0).stop 2023-07-14T13:08:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.628+0000 7f2e1c79f640 1 -- 172.21.15.5:0/1137809195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e14156130 msgr2=0x7f2e140cd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:27.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.628+0000 7f2e1c79f640 1 --2- 172.21.15.5:0/1137809195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e14156130 0x7f2e140cd330 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f2e140c4cb0 tx=0x7f2e0c0101c0 comp rx=0 tx=0).stop 2023-07-14T13:08:27.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.628+0000 7f2e1c79f640 1 -- 172.21.15.5:0/1137809195 shutdown_connections 2023-07-14T13:08:27.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.628+0000 7f2e1c79f640 1 --2- 172.21.15.5:0/1137809195 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f2df80663a0 0x7f2df8068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:27.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.628+0000 7f2e1c79f640 1 --2- 172.21.15.5:0/1137809195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e14156130 0x7f2e140cd330 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:27.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.628+0000 7f2e1c79f640 1 --2- 172.21.15.5:0/1137809195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e14148520 0x7f2e14155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:27.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.628+0000 7f2e1c79f640 1 --2- 172.21.15.5:0/1137809195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e000047d0 0x7f2e140c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:27.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.628+0000 7f2e1c79f640 1 -- 172.21.15.5:0/1137809195 >> 172.21.15.5:0/1137809195 conn(0x7f2e140afcf0 msgr2=0x7f2e140c1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:27.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.628+0000 7f2e1c79f640 1 -- 172.21.15.5:0/1137809195 shutdown_connections 2023-07-14T13:08:27.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.628+0000 7f2e1c79f640 1 -- 172.21.15.5:0/1137809195 wait complete. 2023-07-14T13:08:27.681 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-14T13:08:27.681 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:08:27.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.792+0000 7f3243394640 1 Processor -- start 2023-07-14T13:08:27.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.792+0000 7f3243394640 1 -- start start 2023-07-14T13:08:27.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.792+0000 7f3243394640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f323c158680 0x7f323c0af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:27.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.792+0000 7f3243394640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f323c0afdf0 0x7f323c06fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:27.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.792+0000 7f3243394640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323c158a50 con 0x7f323c06ffb0 2023-07-14T13:08:27.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.792+0000 7f3243394640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f323c1599b0 con 0x7f323c158680 2023-07-14T13:08:27.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.792+0000 7f3243394640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323c15d170 con 0x7f323c0afdf0 2023-07-14T13:08:27.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.792+0000 7f3242b93640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f323c06ffb0 0x7f323c0ccb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58096/0 (socket says 172.21.15.5:58096) 2023-07-14T13:08:27.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.792+0000 7f3242b93640 1 -- 172.21.15.5:0/4254787801 learned_addr learned my addr 172.21.15.5:0/4254787801 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:27.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.792+0000 7f3241b91640 1 --2- 172.21.15.5:0/4254787801 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f323c0afdf0 0x7f323c06fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:27.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.792+0000 7f3242392640 1 --2- 172.21.15.5:0/4254787801 >> v2:172.21.15.154:3300/0 conn(0x7f323c158680 0x7f323c0af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:27.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.792+0000 7f3241390640 1 -- 172.21.15.5:0/4254787801 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2768699602 0 0) 0x7f323c158a50 con 0x7f323c06ffb0 2023-07-14T13:08:27.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.792+0000 7f3241390640 1 -- 172.21.15.5:0/4254787801 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3228003530 con 0x7f323c06ffb0 2023-07-14T13:08:27.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.792+0000 7f3242392640 1 -- 172.21.15.5:0/4254787801 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f323c0afdf0 msgr2=0x7f323c06fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:27.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.792+0000 7f3242392640 1 --2- 172.21.15.5:0/4254787801 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f323c0afdf0 0x7f323c06fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:27.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.792+0000 7f3242392640 1 -- 172.21.15.5:0/4254787801 >> v1:172.21.15.5:6789/0 conn(0x7f323c06ffb0 legacy=0x7f323c0ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:27.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.792+0000 7f3242392640 1 -- 172.21.15.5:0/4254787801 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323c158d30 con 0x7f323c158680 2023-07-14T13:08:27.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.792+0000 7f3241b91640 1 --2- 172.21.15.5:0/4254787801 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f323c0afdf0 0x7f323c06fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:27.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.796+0000 7f3242392640 1 --2- 172.21.15.5:0/4254787801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f323c158680 0x7f323c0af8b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f32380097c0 tx=0x7f323801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afa5f99234b29b90 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:27.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.796+0000 7f3241390640 1 -- 172.21.15.5:0/4254787801 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32380ab600 con 0x7f323c158680 2023-07-14T13:08:27.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.796+0000 7f3241390640 1 -- 172.21.15.5:0/4254787801 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32380a7050 con 0x7f323c158680 2023-07-14T13:08:27.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.796+0000 7f3241390640 1 -- 172.21.15.5:0/4254787801 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32380ab960 con 0x7f323c158680 2023-07-14T13:08:27.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.796+0000 7f3243394640 1 -- 172.21.15.5:0/4254787801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f323c158680 msgr2=0x7f323c0af8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:27.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.796+0000 7f3243394640 1 --2- 172.21.15.5:0/4254787801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f323c158680 0x7f323c0af8b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f32380097c0 tx=0x7f323801c480 comp rx=0 tx=0).stop 2023-07-14T13:08:27.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.796+0000 7f3243394640 1 -- 172.21.15.5:0/4254787801 shutdown_connections 2023-07-14T13:08:27.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.796+0000 7f3243394640 1 --2- 172.21.15.5:0/4254787801 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f323c0afdf0 0x7f323c06fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:27.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.796+0000 7f3243394640 1 --2- 172.21.15.5:0/4254787801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f323c158680 0x7f323c0af8b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:27.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.796+0000 7f3243394640 1 -- 172.21.15.5:0/4254787801 >> 172.21.15.5:0/4254787801 conn(0x7f323c0ca8b0 msgr2=0x7f323c0cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:27.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.796+0000 7f3243394640 1 -- 172.21.15.5:0/4254787801 shutdown_connections 2023-07-14T13:08:27.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.796+0000 7f3243394640 1 -- 172.21.15.5:0/4254787801 wait complete. 2023-07-14T13:08:27.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.800+0000 7f3243394640 1 Processor -- start 2023-07-14T13:08:27.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.800+0000 7f3243394640 1 -- start start 2023-07-14T13:08:27.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.800+0000 7f3243394640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f323c06ffb0 0x7f323c0c1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:27.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.800+0000 7f3243394640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f323c0afdf0 0x7f323c146160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:27.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.800+0000 7f3243394640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f323c158680 0x7f323c1466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:27.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.800+0000 7f3243394640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c0c4f90 con 0x7f323c06ffb0 2023-07-14T13:08:27.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.800+0000 7f3243394640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c145cd0 con 0x7f323c0afdf0 2023-07-14T13:08:27.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.800+0000 7f3243394640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323c1453a0 con 0x7f323c158680 2023-07-14T13:08:27.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.800+0000 7f3242392640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f323c06ffb0 0x7f323c0c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:27.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.800+0000 7f3242392640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f323c06ffb0 0x7f323c0c1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38722/0 (socket says 172.21.15.5:38722) 2023-07-14T13:08:27.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.800+0000 7f3242392640 1 -- 172.21.15.5:0/2103000575 learned_addr learned my addr 172.21.15.5:0/2103000575 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:27.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.800+0000 7f3242392640 1 -- 172.21.15.5:0/2103000575 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f323c158680 msgr2=0x7f323c1466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:27.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.800+0000 7f3242392640 1 --2- 172.21.15.5:0/2103000575 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f323c158680 0x7f323c1466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:27.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.800+0000 7f3242392640 1 -- 172.21.15.5:0/2103000575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f323c0afdf0 msgr2=0x7f323c146160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.800+0000 7f3242392640 1 --2- 172.21.15.5:0/2103000575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f323c0afdf0 0x7f323c146160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.800+0000 7f3242392640 1 -- 172.21.15.5:0/2103000575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322c009420 con 0x7f323c06ffb0 2023-07-14T13:08:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.800+0000 7f3242392640 1 --2- 172.21.15.5:0/2103000575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f323c06ffb0 0x7f323c0c1600 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f323801a0b0 tx=0x7f3238019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.800+0000 7f3232ffd640 1 -- 172.21.15.5:0/2103000575 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3238006e20 con 0x7f323c06ffb0 2023-07-14T13:08:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.800+0000 7f3232ffd640 1 -- 172.21.15.5:0/2103000575 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32380b4400 con 0x7f323c06ffb0 2023-07-14T13:08:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.800+0000 7f3243394640 1 -- 172.21.15.5:0/2103000575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3238009420 con 0x7f323c06ffb0 2023-07-14T13:08:27.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.800+0000 7f3232ffd640 1 -- 172.21.15.5:0/2103000575 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32380b4770 con 0x7f323c06ffb0 2023-07-14T13:08:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.800+0000 7f3243394640 1 -- 172.21.15.5:0/2103000575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323c145960 con 0x7f323c06ffb0 2023-07-14T13:08:27.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.800+0000 7f3243394640 1 -- 172.21.15.5:0/2103000575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f323c0678d0 con 0x7f323c06ffb0 2023-07-14T13:08:27.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.804+0000 7f3232ffd640 1 -- 172.21.15.5:0/2103000575 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f32380b2040 con 0x7f323c06ffb0 2023-07-14T13:08:27.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.804+0000 7f3232ffd640 1 --2- 172.21.15.5:0/2103000575 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f32200663d0 0x7f3220068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:27.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.804+0000 7f3232ffd640 1 -- 172.21.15.5:0/2103000575 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f323811dde0 con 0x7f323c06ffb0 2023-07-14T13:08:27.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.804+0000 7f3241b91640 1 --2- 172.21.15.5:0/2103000575 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f32200663d0 0x7f3220068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:27.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.804+0000 7f3241b91640 1 --2- 172.21.15.5:0/2103000575 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f32200663d0 0x7f3220068880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f322c006e90 tx=0x7f322c006de0 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:27.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.808+0000 7f3232ffd640 1 -- 172.21.15.5:0/2103000575 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f32380eafa0 con 0x7f323c06ffb0 2023-07-14T13:08:27.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.960+0000 7f3243394640 1 -- 172.21.15.5:0/2103000575 --> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f323c1595d0 con 0x7f32200663d0 2023-07-14T13:08:28.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.972+0000 7f3232ffd640 1 -- 172.21.15.5:0/2103000575 <== mgr.5648 v2:172.21.15.154:6832/1874317247 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305540 (secure 0 0 0) 0x7f322c009d60 con 0x7f32200663d0 2023-07-14T13:08:28.009 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:28.011 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:08:28.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.976+0000 7f3243394640 1 -- 172.21.15.5:0/2103000575 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f32200663d0 msgr2=0x7f3220068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:28.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.976+0000 7f3243394640 1 --2- 172.21.15.5:0/2103000575 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f32200663d0 0x7f3220068880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f322c006e90 tx=0x7f322c006de0 comp rx=0 tx=0).stop 2023-07-14T13:08:28.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.976+0000 7f3243394640 1 -- 172.21.15.5:0/2103000575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f323c06ffb0 msgr2=0x7f323c0c1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:28.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.976+0000 7f3243394640 1 --2- 172.21.15.5:0/2103000575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f323c06ffb0 0x7f323c0c1600 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f323801a0b0 tx=0x7f3238019220 comp rx=0 tx=0).stop 2023-07-14T13:08:28.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.976+0000 7f3243394640 1 -- 172.21.15.5:0/2103000575 shutdown_connections 2023-07-14T13:08:28.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.976+0000 7f3243394640 1 --2- 172.21.15.5:0/2103000575 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f32200663d0 0x7f3220068880 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:28.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.976+0000 7f3243394640 1 --2- 172.21.15.5:0/2103000575 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f323c158680 0x7f323c1466a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:28.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.976+0000 7f3243394640 1 --2- 172.21.15.5:0/2103000575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f323c0afdf0 0x7f323c146160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:28.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.976+0000 7f3243394640 1 --2- 172.21.15.5:0/2103000575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f323c06ffb0 0x7f323c0c1600 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:28.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.976+0000 7f3243394640 1 -- 172.21.15.5:0/2103000575 >> 172.21.15.5:0/2103000575 conn(0x7f323c0ca8b0 msgr2=0x7f323c0cac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:28.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.976+0000 7f3243394640 1 -- 172.21.15.5:0/2103000575 shutdown_connections 2023-07-14T13:08:28.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:27.976+0000 7f3243394640 1 -- 172.21.15.5:0/2103000575 wait complete. 2023-07-14T13:08:28.030 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-14T13:08:27.514762+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":313724,"kb_used_data":8764,"kb_used_omap":0,"kb_used_meta":304896,"kb_avail":754660996,"statfs":{"total":773094113280,"available":772772859904,"internally_reserved":0,"allocated":8974336,"data_stored":5065246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312213504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.653666"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.874656+0000","last_change":"2023-07-14T13:08:22.874656+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.874656+0000","last_undegraded":"2023-07-14T13:08:22.874656+0000","last_fullsized":"2023-07-14T13:08:22.874656+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.875595+0000","last_change":"2023-07-14T13:08:22.875595+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.875595+0000","last_undegraded":"2023-07-14T13:08:22.875595+0000","last_fullsized":"2023-07-14T13:08:22.875595+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.881004+0000","last_change":"2023-07-14T13:08:22.881004+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.881004+0000","last_undegraded":"2023-07-14T13:08:22.881004+0000","last_fullsized":"2023-07-14T13:08:22.881004+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.877032+0000","last_change":"2023-07-14T13:08:22.877032+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.877032+0000","last_undegraded":"2023-07-14T13:08:22.877032+0000","last_fullsized":"2023-07-14T13:08:22.877032+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.881951+0000","last_change":"2023-07-14T13:08:22.881951+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.881951+0000","last_undegraded":"2023-07-14T13:08:22.881951+0000","last_fullsized":"2023-07-14T13:08:22.881951+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.874852+0000","last_change":"2023-07-14T13:08:22.874852+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.874852+0000","last_undegraded":"2023-07-14T13:08:22.874852+0000","last_fullsized":"2023-07-14T13:08:22.874852+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.877520+0000","last_change":"2023-07-14T13:08:22.877520+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.877520+0000","last_undegraded":"2023-07-14T13:08:22.877520+0000","last_fullsized":"2023-07-14T13:08:22.877520+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.880131+0000","last_change":"2023-07-14T13:08:22.880131+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.880131+0000","last_undegraded":"2023-07-14T13:08:22.880131+0000","last_fullsized":"2023-07-14T13:08:22.880131+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.884955+0000","last_change":"2023-07-14T13:08:22.884955+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.884955+0000","last_undegraded":"2023-07-14T13:08:22.884955+0000","last_fullsized":"2023-07-14T13:08:22.884955+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.878859+0000","last_change":"2023-07-14T13:08:22.878859+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.878859+0000","last_undegraded":"2023-07-14T13:08:22.878859+0000","last_fullsized":"2023-07-14T13:08:22.878859+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.878049+0000","last_change":"2023-07-14T13:08:22.878049+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.878049+0000","last_undegraded":"2023-07-14T13:08:22.878049+0000","last_fullsized":"2023-07-14T13:08:22.878049+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.881668+0000","last_change":"2023-07-14T13:08:22.881668+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.881668+0000","last_undegraded":"2023-07-14T13:08:22.881668+0000","last_fullsized":"2023-07-14T13:08:22.881668+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.881867+0000","last_change":"2023-07-14T13:08:22.881867+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.881867+0000","last_undegraded":"2023-07-14T13:08:22.881867+0000","last_fullsized":"2023-07-14T13:08:22.881867+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.879097+0000","last_change":"2023-07-14T13:08:22.879097+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.879097+0000","last_undegraded":"2023-07-14T13:08:22.879097+0000","last_fullsized":"2023-07-14T13:08:22.879097+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.884027+0000","last_change":"2023-07-14T13:08:22.884027+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.884027+0000","last_undegraded":"2023-07-14T13:08:22.884027+0000","last_fullsized":"2023-07-14T13:08:22.884027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.878091+0000","last_change":"2023-07-14T13:08:22.878091+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.878091+0000","last_undegraded":"2023-07-14T13:08:22.878091+0000","last_fullsized":"2023-07-14T13:08:22.878091+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.874124+0000","last_change":"2023-07-14T13:08:22.874124+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.874124+0000","last_undegraded":"2023-07-14T13:08:22.874124+0000","last_fullsized":"2023-07-14T13:08:22.874124+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.876616+0000","last_change":"2023-07-14T13:08:22.876616+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.876616+0000","last_undegraded":"2023-07-14T13:08:22.876616+0000","last_fullsized":"2023-07-14T13:08:22.876616+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.880454+0000","last_change":"2023-07-14T13:08:22.880454+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.880454+0000","last_undegraded":"2023-07-14T13:08:22.880454+0000","last_fullsized":"2023-07-14T13:08:22.880454+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.876197+0000","last_change":"2023-07-14T13:08:22.876197+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.876197+0000","last_undegraded":"2023-07-14T13:08:22.876197+0000","last_fullsized":"2023-07-14T13:08:22.876197+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.881312+0000","last_change":"2023-07-14T13:08:22.881312+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.881312+0000","last_undegraded":"2023-07-14T13:08:22.881312+0000","last_fullsized":"2023-07-14T13:08:22.881312+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.879148+0000","last_change":"2023-07-14T13:08:22.879148+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.879148+0000","last_undegraded":"2023-07-14T13:08:22.879148+0000","last_fullsized":"2023-07-14T13:08:22.879148+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.878744+0000","last_change":"2023-07-14T13:08:22.878744+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.878744+0000","last_undegraded":"2023-07-14T13:08:22.878744+0000","last_fullsized":"2023-07-14T13:08:22.878744+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.884697+0000","last_change":"2023-07-14T13:08:22.884697+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.884697+0000","last_undegraded":"2023-07-14T13:08:22.884697+0000","last_fullsized":"2023-07-14T13:08:22.884697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.883558+0000","last_change":"2023-07-14T13:08:22.883558+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.883558+0000","last_undegraded":"2023-07-14T13:08:22.883558+0000","last_fullsized":"2023-07-14T13:08:22.883558+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.883234+0000","last_change":"2023-07-14T13:08:22.883234+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.883234+0000","last_undegraded":"2023-07-14T13:08:22.883234+0000","last_fullsized":"2023-07-14T13:08:22.883234+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.876532+0000","last_change":"2023-07-14T13:08:22.876532+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.876532+0000","last_undegraded":"2023-07-14T13:08:22.876532+0000","last_fullsized":"2023-07-14T13:08:22.876532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.873908+0000","last_change":"2023-07-14T13:08:22.873908+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.873908+0000","last_undegraded":"2023-07-14T13:08:22.873908+0000","last_fullsized":"2023-07-14T13:08:22.873908+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.880128+0000","last_change":"2023-07-14T13:08:22.880128+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.880128+0000","last_undegraded":"2023-07-14T13:08:22.880128+0000","last_fullsized":"2023-07-14T13:08:22.880128+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.881491+0000","last_change":"2023-07-14T13:08:22.881491+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.881491+0000","last_undegraded":"2023-07-14T13:08:22.881491+0000","last_fullsized":"2023-07-14T13:08:22.881491+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.877794+0000","last_change":"2023-07-14T13:08:22.877794+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.877794+0000","last_undegraded":"2023-07-14T13:08:22.877794+0000","last_fullsized":"2023-07-14T13:08:22.877794+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.876787+0000","last_change":"2023-07-14T13:08:22.876787+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.876787+0000","last_undegraded":"2023-07-14T13:08:22.876787+0000","last_fullsized":"2023-07-14T13:08:22.876787+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.880076+0000","last_change":"2023-07-14T13:08:22.880076+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.880076+0000","last_undegraded":"2023-07-14T13:08:22.880076+0000","last_fullsized":"2023-07-14T13:08:22.880076+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.894607+0000","last_change":"2023-07-14T13:08:22.892834+0000","last_active":"2023-07-14T13:08:22.894607+0000","last_peered":"2023-07-14T13:08:22.894607+0000","last_clean":"2023-07-14T13:08:22.894607+0000","last_became_active":"2023-07-14T13:08:22.892557+0000","last_became_peered":"2023-07-14T13:08:22.892557+0000","last_unstale":"2023-07-14T13:08:22.894607+0000","last_undegraded":"2023-07-14T13:08:22.894607+0000","last_fullsized":"2023-07-14T13:08:22.894607+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:39:25.704839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.875717+0000","last_change":"2023-07-14T13:08:22.875717+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.875717+0000","last_undegraded":"2023-07-14T13:08:22.875717+0000","last_fullsized":"2023-07-14T13:08:22.875717+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.893651+0000","last_change":"2023-07-14T13:08:22.888782+0000","last_active":"2023-07-14T13:08:22.893651+0000","last_peered":"2023-07-14T13:08:22.893651+0000","last_clean":"2023-07-14T13:08:22.893651+0000","last_became_active":"2023-07-14T13:08:22.888435+0000","last_became_peered":"2023-07-14T13:08:22.888435+0000","last_unstale":"2023-07-14T13:08:22.893651+0000","last_undegraded":"2023-07-14T13:08:22.893651+0000","last_fullsized":"2023-07-14T13:08:22.893651+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:52:49.835822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.875437+0000","last_change":"2023-07-14T13:08:22.875437+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.875437+0000","last_undegraded":"2023-07-14T13:08:22.875437+0000","last_fullsized":"2023-07-14T13:08:22.875437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.890136+0000","last_change":"2023-07-14T13:08:22.886288+0000","last_active":"2023-07-14T13:08:22.890136+0000","last_peered":"2023-07-14T13:08:22.890136+0000","last_clean":"2023-07-14T13:08:22.890136+0000","last_became_active":"2023-07-14T13:08:22.885619+0000","last_became_peered":"2023-07-14T13:08:22.885619+0000","last_unstale":"2023-07-14T13:08:22.890136+0000","last_undegraded":"2023-07-14T13:08:22.890136+0000","last_fullsized":"2023-07-14T13:08:22.890136+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:06.776201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.885416+0000","last_change":"2023-07-14T13:08:22.885416+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.885416+0000","last_undegraded":"2023-07-14T13:08:22.885416+0000","last_fullsized":"2023-07-14T13:08:22.885416+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.893540+0000","last_change":"2023-07-14T13:08:22.888011+0000","last_active":"2023-07-14T13:08:22.893540+0000","last_peered":"2023-07-14T13:08:22.893540+0000","last_clean":"2023-07-14T13:08:22.893540+0000","last_became_active":"2023-07-14T13:08:22.887659+0000","last_became_peered":"2023-07-14T13:08:22.887659+0000","last_unstale":"2023-07-14T13:08:22.893540+0000","last_undegraded":"2023-07-14T13:08:22.893540+0000","last_fullsized":"2023-07-14T13:08:22.893540+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:03:54.376631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.877566+0000","last_change":"2023-07-14T13:08:22.877566+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.877566+0000","last_undegraded":"2023-07-14T13:08:22.877566+0000","last_fullsized":"2023-07-14T13:08:22.877566+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.887011+0000","last_change":"2023-07-14T13:08:22.884530+0000","last_active":"2023-07-14T13:08:22.887011+0000","last_peered":"2023-07-14T13:08:22.887011+0000","last_clean":"2023-07-14T13:08:22.887011+0000","last_became_active":"2023-07-14T13:08:22.884229+0000","last_became_peered":"2023-07-14T13:08:22.884229+0000","last_unstale":"2023-07-14T13:08:22.887011+0000","last_undegraded":"2023-07-14T13:08:22.887011+0000","last_fullsized":"2023-07-14T13:08:22.887011+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:54:47.831816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.873445+0000","last_change":"2023-07-14T13:08:22.873445+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.873445+0000","last_undegraded":"2023-07-14T13:08:22.873445+0000","last_fullsized":"2023-07-14T13:08:22.873445+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.885902+0000","last_change":"2023-07-14T13:08:22.883779+0000","last_active":"2023-07-14T13:08:22.885902+0000","last_peered":"2023-07-14T13:08:22.885902+0000","last_clean":"2023-07-14T13:08:22.885902+0000","last_became_active":"2023-07-14T13:08:22.883464+0000","last_became_peered":"2023-07-14T13:08:22.883464+0000","last_unstale":"2023-07-14T13:08:22.885902+0000","last_undegraded":"2023-07-14T13:08:22.885902+0000","last_fullsized":"2023-07-14T13:08:22.885902+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:44:03.170860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.884122+0000","last_change":"2023-07-14T13:08:22.884122+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.884122+0000","last_undegraded":"2023-07-14T13:08:22.884122+0000","last_fullsized":"2023-07-14T13:08:22.884122+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.889935+0000","last_change":"2023-07-14T13:08:22.887027+0000","last_active":"2023-07-14T13:08:22.889935+0000","last_peered":"2023-07-14T13:08:22.889935+0000","last_clean":"2023-07-14T13:08:22.889935+0000","last_became_active":"2023-07-14T13:08:22.886683+0000","last_became_peered":"2023-07-14T13:08:22.886683+0000","last_unstale":"2023-07-14T13:08:22.889935+0000","last_undegraded":"2023-07-14T13:08:22.889935+0000","last_fullsized":"2023-07-14T13:08:22.889935+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:14:46.468529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.875343+0000","last_change":"2023-07-14T13:08:22.875343+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.875343+0000","last_undegraded":"2023-07-14T13:08:22.875343+0000","last_fullsized":"2023-07-14T13:08:22.875343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.897981+0000","last_change":"2023-07-14T13:08:22.896649+0000","last_active":"2023-07-14T13:08:22.897981+0000","last_peered":"2023-07-14T13:08:22.897981+0000","last_clean":"2023-07-14T13:08:22.897981+0000","last_became_active":"2023-07-14T13:08:22.896318+0000","last_became_peered":"2023-07-14T13:08:22.896318+0000","last_unstale":"2023-07-14T13:08:22.897981+0000","last_undegraded":"2023-07-14T13:08:22.897981+0000","last_fullsized":"2023-07-14T13:08:22.897981+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:05.261247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.873301+0000","last_change":"2023-07-14T13:08:22.873301+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.873301+0000","last_undegraded":"2023-07-14T13:08:22.873301+0000","last_fullsized":"2023-07-14T13:08:22.873301+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.900625+0000","last_change":"2023-07-14T13:08:22.899027+0000","last_active":"2023-07-14T13:08:22.900625+0000","last_peered":"2023-07-14T13:08:22.900625+0000","last_clean":"2023-07-14T13:08:22.900625+0000","last_became_active":"2023-07-14T13:08:22.898673+0000","last_became_peered":"2023-07-14T13:08:22.898673+0000","last_unstale":"2023-07-14T13:08:22.900625+0000","last_undegraded":"2023-07-14T13:08:22.900625+0000","last_fullsized":"2023-07-14T13:08:22.900625+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:23:31.869780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.874124+0000","last_change":"2023-07-14T13:08:22.874124+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.874124+0000","last_undegraded":"2023-07-14T13:08:22.874124+0000","last_fullsized":"2023-07-14T13:08:22.874124+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.893762+0000","last_change":"2023-07-14T13:08:22.889053+0000","last_active":"2023-07-14T13:08:22.893762+0000","last_peered":"2023-07-14T13:08:22.893762+0000","last_clean":"2023-07-14T13:08:22.893762+0000","last_became_active":"2023-07-14T13:08:22.888145+0000","last_became_peered":"2023-07-14T13:08:22.888145+0000","last_unstale":"2023-07-14T13:08:22.893762+0000","last_undegraded":"2023-07-14T13:08:22.893762+0000","last_fullsized":"2023-07-14T13:08:22.893762+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:01:01.654800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.880896+0000","last_change":"2023-07-14T13:08:22.880896+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.880896+0000","last_undegraded":"2023-07-14T13:08:22.880896+0000","last_fullsized":"2023-07-14T13:08:22.880896+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.900548+0000","last_change":"2023-07-14T13:08:22.898636+0000","last_active":"2023-07-14T13:08:22.900548+0000","last_peered":"2023-07-14T13:08:22.900548+0000","last_clean":"2023-07-14T13:08:22.900548+0000","last_became_active":"2023-07-14T13:08:22.898199+0000","last_became_peered":"2023-07-14T13:08:22.898199+0000","last_unstale":"2023-07-14T13:08:22.900548+0000","last_undegraded":"2023-07-14T13:08:22.900548+0000","last_fullsized":"2023-07-14T13:08:22.900548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:45:04.006207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.875703+0000","last_change":"2023-07-14T13:08:22.875703+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.875703+0000","last_undegraded":"2023-07-14T13:08:22.875703+0000","last_fullsized":"2023-07-14T13:08:22.875703+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.891087+0000","last_change":"2023-07-14T13:08:22.886746+0000","last_active":"2023-07-14T13:08:22.891087+0000","last_peered":"2023-07-14T13:08:22.891087+0000","last_clean":"2023-07-14T13:08:22.891087+0000","last_became_active":"2023-07-14T13:08:22.886234+0000","last_became_peered":"2023-07-14T13:08:22.886234+0000","last_unstale":"2023-07-14T13:08:22.891087+0000","last_undegraded":"2023-07-14T13:08:22.891087+0000","last_fullsized":"2023-07-14T13:08:22.891087+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:56:41.891811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.875703+0000","last_change":"2023-07-14T13:08:22.875703+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.875703+0000","last_undegraded":"2023-07-14T13:08:22.875703+0000","last_fullsized":"2023-07-14T13:08:22.875703+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.898473+0000","last_change":"2023-07-14T13:08:22.896327+0000","last_active":"2023-07-14T13:08:22.898473+0000","last_peered":"2023-07-14T13:08:22.898473+0000","last_clean":"2023-07-14T13:08:22.898473+0000","last_became_active":"2023-07-14T13:08:22.895999+0000","last_became_peered":"2023-07-14T13:08:22.895999+0000","last_unstale":"2023-07-14T13:08:22.898473+0000","last_undegraded":"2023-07-14T13:08:22.898473+0000","last_fullsized":"2023-07-14T13:08:22.898473+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:42:49.923663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.880817+0000","last_change":"2023-07-14T13:08:22.880817+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.880817+0000","last_undegraded":"2023-07-14T13:08:22.880817+0000","last_fullsized":"2023-07-14T13:08:22.880817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.896774+0000","last_change":"2023-07-14T13:08:22.894256+0000","last_active":"2023-07-14T13:08:22.896774+0000","last_peered":"2023-07-14T13:08:22.896774+0000","last_clean":"2023-07-14T13:08:22.896774+0000","last_became_active":"2023-07-14T13:08:22.893973+0000","last_became_peered":"2023-07-14T13:08:22.893973+0000","last_unstale":"2023-07-14T13:08:22.896774+0000","last_undegraded":"2023-07-14T13:08:22.896774+0000","last_fullsized":"2023-07-14T13:08:22.896774+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:53:09.427111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.883675+0000","last_change":"2023-07-14T13:08:22.883675+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.883675+0000","last_undegraded":"2023-07-14T13:08:22.883675+0000","last_fullsized":"2023-07-14T13:08:22.883675+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.899788+0000","last_change":"2023-07-14T13:08:22.897595+0000","last_active":"2023-07-14T13:08:22.899788+0000","last_peered":"2023-07-14T13:08:22.899788+0000","last_clean":"2023-07-14T13:08:22.899788+0000","last_became_active":"2023-07-14T13:08:22.896980+0000","last_became_peered":"2023-07-14T13:08:22.896980+0000","last_unstale":"2023-07-14T13:08:22.899788+0000","last_undegraded":"2023-07-14T13:08:22.899788+0000","last_fullsized":"2023-07-14T13:08:22.899788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:36:22.832887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.872577+0000","last_change":"2023-07-14T13:08:22.872577+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.872577+0000","last_undegraded":"2023-07-14T13:08:22.872577+0000","last_fullsized":"2023-07-14T13:08:22.872577+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.897560+0000","last_change":"2023-07-14T13:08:22.896567+0000","last_active":"2023-07-14T13:08:22.897560+0000","last_peered":"2023-07-14T13:08:22.897560+0000","last_clean":"2023-07-14T13:08:22.897560+0000","last_became_active":"2023-07-14T13:08:22.896244+0000","last_became_peered":"2023-07-14T13:08:22.896244+0000","last_unstale":"2023-07-14T13:08:22.897560+0000","last_undegraded":"2023-07-14T13:08:22.897560+0000","last_fullsized":"2023-07-14T13:08:22.897560+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:19:46.036377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.874264+0000","last_change":"2023-07-14T13:08:22.874264+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.874264+0000","last_undegraded":"2023-07-14T13:08:22.874264+0000","last_fullsized":"2023-07-14T13:08:22.874264+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.899711+0000","last_change":"2023-07-14T13:08:22.896731+0000","last_active":"2023-07-14T13:08:22.899711+0000","last_peered":"2023-07-14T13:08:22.899711+0000","last_clean":"2023-07-14T13:08:22.899711+0000","last_became_active":"2023-07-14T13:08:22.896451+0000","last_became_peered":"2023-07-14T13:08:22.896451+0000","last_unstale":"2023-07-14T13:08:22.899711+0000","last_undegraded":"2023-07-14T13:08:22.899711+0000","last_fullsized":"2023-07-14T13:08:22.899711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:52:59.408573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.877483+0000","last_change":"2023-07-14T13:08:22.877483+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.877483+0000","last_undegraded":"2023-07-14T13:08:22.877483+0000","last_fullsized":"2023-07-14T13:08:22.877483+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.891526+0000","last_change":"2023-07-14T13:08:22.888742+0000","last_active":"2023-07-14T13:08:22.891526+0000","last_peered":"2023-07-14T13:08:22.891526+0000","last_clean":"2023-07-14T13:08:22.891526+0000","last_became_active":"2023-07-14T13:08:22.888451+0000","last_became_peered":"2023-07-14T13:08:22.888451+0000","last_unstale":"2023-07-14T13:08:22.891526+0000","last_undegraded":"2023-07-14T13:08:22.891526+0000","last_fullsized":"2023-07-14T13:08:22.891526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:03.131223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.882704+0000","last_change":"2023-07-14T13:08:22.882704+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.882704+0000","last_undegraded":"2023-07-14T13:08:22.882704+0000","last_fullsized":"2023-07-14T13:08:22.882704+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.890154+0000","last_change":"2023-07-14T13:08:22.886480+0000","last_active":"2023-07-14T13:08:22.890154+0000","last_peered":"2023-07-14T13:08:22.890154+0000","last_clean":"2023-07-14T13:08:22.890154+0000","last_became_active":"2023-07-14T13:08:22.885968+0000","last_became_peered":"2023-07-14T13:08:22.885968+0000","last_unstale":"2023-07-14T13:08:22.890154+0000","last_undegraded":"2023-07-14T13:08:22.890154+0000","last_fullsized":"2023-07-14T13:08:22.890154+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:31:12.625405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.881843+0000","last_change":"2023-07-14T13:08:22.881843+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.881843+0000","last_undegraded":"2023-07-14T13:08:22.881843+0000","last_fullsized":"2023-07-14T13:08:22.881843+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.891064+0000","last_change":"2023-07-14T13:08:22.886524+0000","last_active":"2023-07-14T13:08:22.891064+0000","last_peered":"2023-07-14T13:08:22.891064+0000","last_clean":"2023-07-14T13:08:22.891064+0000","last_became_active":"2023-07-14T13:08:22.882894+0000","last_became_peered":"2023-07-14T13:08:22.882894+0000","last_unstale":"2023-07-14T13:08:22.891064+0000","last_undegraded":"2023-07-14T13:08:22.891064+0000","last_fullsized":"2023-07-14T13:08:22.891064+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:49:48.097803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.882574+0000","last_change":"2023-07-14T13:08:22.882574+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.882574+0000","last_undegraded":"2023-07-14T13:08:22.882574+0000","last_fullsized":"2023-07-14T13:08:22.882574+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.899796+0000","last_change":"2023-07-14T13:08:22.897266+0000","last_active":"2023-07-14T13:08:22.899796+0000","last_peered":"2023-07-14T13:08:22.899796+0000","last_clean":"2023-07-14T13:08:22.899796+0000","last_became_active":"2023-07-14T13:08:22.896932+0000","last_became_peered":"2023-07-14T13:08:22.896932+0000","last_unstale":"2023-07-14T13:08:22.899796+0000","last_undegraded":"2023-07-14T13:08:22.899796+0000","last_fullsized":"2023-07-14T13:08:22.899796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:11:15.706077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.875833+0000","last_change":"2023-07-14T13:08:22.875833+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.875833+0000","last_undegraded":"2023-07-14T13:08:22.875833+0000","last_fullsized":"2023-07-14T13:08:22.875833+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.887064+0000","last_change":"2023-07-14T13:08:22.884847+0000","last_active":"2023-07-14T13:08:22.887064+0000","last_peered":"2023-07-14T13:08:22.887064+0000","last_clean":"2023-07-14T13:08:22.887064+0000","last_became_active":"2023-07-14T13:08:22.884442+0000","last_became_peered":"2023-07-14T13:08:22.884442+0000","last_unstale":"2023-07-14T13:08:22.887064+0000","last_undegraded":"2023-07-14T13:08:22.887064+0000","last_fullsized":"2023-07-14T13:08:22.887064+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:41:36.689812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.872492+0000","last_change":"2023-07-14T13:08:22.872492+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.872492+0000","last_undegraded":"2023-07-14T13:08:22.872492+0000","last_fullsized":"2023-07-14T13:08:22.872492+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.893415+0000","last_change":"2023-07-14T13:08:22.890676+0000","last_active":"2023-07-14T13:08:22.893415+0000","last_peered":"2023-07-14T13:08:22.893415+0000","last_clean":"2023-07-14T13:08:22.893415+0000","last_became_active":"2023-07-14T13:08:22.890323+0000","last_became_peered":"2023-07-14T13:08:22.890323+0000","last_unstale":"2023-07-14T13:08:22.893415+0000","last_undegraded":"2023-07-14T13:08:22.893415+0000","last_fullsized":"2023-07-14T13:08:22.893415+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:54:57.718294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.878334+0000","last_change":"2023-07-14T13:08:22.878334+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.878334+0000","last_undegraded":"2023-07-14T13:08:22.878334+0000","last_fullsized":"2023-07-14T13:08:22.878334+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.891352+0000","last_change":"2023-07-14T13:08:22.888081+0000","last_active":"2023-07-14T13:08:22.891352+0000","last_peered":"2023-07-14T13:08:22.891352+0000","last_clean":"2023-07-14T13:08:22.891352+0000","last_became_active":"2023-07-14T13:08:22.887733+0000","last_became_peered":"2023-07-14T13:08:22.887733+0000","last_unstale":"2023-07-14T13:08:22.891352+0000","last_undegraded":"2023-07-14T13:08:22.891352+0000","last_fullsized":"2023-07-14T13:08:22.891352+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:54:57.718294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.881449+0000","last_change":"2023-07-14T13:08:22.881449+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.881449+0000","last_undegraded":"2023-07-14T13:08:22.881449+0000","last_fullsized":"2023-07-14T13:08:22.881449+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.887343+0000","last_change":"2023-07-14T13:08:22.885339+0000","last_active":"2023-07-14T13:08:22.887343+0000","last_peered":"2023-07-14T13:08:22.887343+0000","last_clean":"2023-07-14T13:08:22.887343+0000","last_became_active":"2023-07-14T13:08:22.885052+0000","last_became_peered":"2023-07-14T13:08:22.885052+0000","last_unstale":"2023-07-14T13:08:22.887343+0000","last_undegraded":"2023-07-14T13:08:22.887343+0000","last_fullsized":"2023-07-14T13:08:22.887343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:02:58.361007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"70'161","reported_seq":440,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.889580+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:08:22.889580+0000","last_peered":"2023-07-14T13:08:22.889580+0000","last_clean":"2023-07-14T13:08:22.889580+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:08:22.889580+0000","last_undegraded":"2023-07-14T13:08:22.889580+0000","last_fullsized":"2023-07-14T13:08:22.889580+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:12:39.945742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.886927+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:08:22.886927+0000","last_peered":"2023-07-14T13:08:22.886927+0000","last_clean":"2023-07-14T13:08:22.886927+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:08:22.886927+0000","last_undegraded":"2023-07-14T13:08:22.886927+0000","last_fullsized":"2023-07-14T13:08:22.886927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:35:06.179987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.873769+0000","last_change":"2023-07-14T13:08:22.873769+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.873769+0000","last_undegraded":"2023-07-14T13:08:22.873769+0000","last_fullsized":"2023-07-14T13:08:22.873769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.893610+0000","last_change":"2023-07-14T13:08:22.888358+0000","last_active":"2023-07-14T13:08:22.893610+0000","last_peered":"2023-07-14T13:08:22.893610+0000","last_clean":"2023-07-14T13:08:22.893610+0000","last_became_active":"2023-07-14T13:08:22.888086+0000","last_became_peered":"2023-07-14T13:08:22.888086+0000","last_unstale":"2023-07-14T13:08:22.893610+0000","last_undegraded":"2023-07-14T13:08:22.893610+0000","last_fullsized":"2023-07-14T13:08:22.893610+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:23:27.051257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.889371+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:08:22.889371+0000","last_peered":"2023-07-14T13:08:22.889371+0000","last_clean":"2023-07-14T13:08:22.889371+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:08:22.889371+0000","last_undegraded":"2023-07-14T13:08:22.889371+0000","last_fullsized":"2023-07-14T13:08:22.889371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:55:41.263847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.880317+0000","last_change":"2023-07-14T13:08:22.880317+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.880317+0000","last_undegraded":"2023-07-14T13:08:22.880317+0000","last_fullsized":"2023-07-14T13:08:22.880317+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.896794+0000","last_change":"2023-07-14T13:08:22.894336+0000","last_active":"2023-07-14T13:08:22.896794+0000","last_peered":"2023-07-14T13:08:22.896794+0000","last_clean":"2023-07-14T13:08:22.896794+0000","last_became_active":"2023-07-14T13:08:22.894049+0000","last_became_peered":"2023-07-14T13:08:22.894049+0000","last_unstale":"2023-07-14T13:08:22.896794+0000","last_undegraded":"2023-07-14T13:08:22.896794+0000","last_fullsized":"2023-07-14T13:08:22.896794+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:24:57.826152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":124,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.878743+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:08:22.878743+0000","last_peered":"2023-07-14T13:08:22.878743+0000","last_clean":"2023-07-14T13:08:22.878743+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:08:22.878743+0000","last_undegraded":"2023-07-14T13:08:22.878743+0000","last_fullsized":"2023-07-14T13:08:22.878743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:25:57.748881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.879882+0000","last_change":"2023-07-14T13:08:22.879882+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.879882+0000","last_undegraded":"2023-07-14T13:08:22.879882+0000","last_fullsized":"2023-07-14T13:08:22.879882+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.893609+0000","last_change":"2023-07-14T13:08:22.888384+0000","last_active":"2023-07-14T13:08:22.893609+0000","last_peered":"2023-07-14T13:08:22.893609+0000","last_clean":"2023-07-14T13:08:22.893609+0000","last_became_active":"2023-07-14T13:08:22.888062+0000","last_became_peered":"2023-07-14T13:08:22.888062+0000","last_unstale":"2023-07-14T13:08:22.893609+0000","last_undegraded":"2023-07-14T13:08:22.893609+0000","last_fullsized":"2023-07-14T13:08:22.893609+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:48:33.099003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.887019+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:08:22.887019+0000","last_peered":"2023-07-14T13:08:22.887019+0000","last_clean":"2023-07-14T13:08:22.887019+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:08:22.887019+0000","last_undegraded":"2023-07-14T13:08:22.887019+0000","last_fullsized":"2023-07-14T13:08:22.887019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:51:45.137826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.880578+0000","last_change":"2023-07-14T13:08:22.880578+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.880578+0000","last_undegraded":"2023-07-14T13:08:22.880578+0000","last_fullsized":"2023-07-14T13:08:22.880578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.898248+0000","last_change":"2023-07-14T13:08:22.895241+0000","last_active":"2023-07-14T13:08:22.898248+0000","last_peered":"2023-07-14T13:08:22.898248+0000","last_clean":"2023-07-14T13:08:22.898248+0000","last_became_active":"2023-07-14T13:08:22.894924+0000","last_became_peered":"2023-07-14T13:08:22.894924+0000","last_unstale":"2023-07-14T13:08:22.898248+0000","last_undegraded":"2023-07-14T13:08:22.898248+0000","last_fullsized":"2023-07-14T13:08:22.898248+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:35:50.435128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.870905+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:08:22.870905+0000","last_peered":"2023-07-14T13:08:22.870905+0000","last_clean":"2023-07-14T13:08:22.870905+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:08:22.870905+0000","last_undegraded":"2023-07-14T13:08:22.870905+0000","last_fullsized":"2023-07-14T13:08:22.870905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:50.832212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.879839+0000","last_change":"2023-07-14T13:08:22.879839+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.879839+0000","last_undegraded":"2023-07-14T13:08:22.879839+0000","last_fullsized":"2023-07-14T13:08:22.879839+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.900585+0000","last_change":"2023-07-14T13:08:22.898695+0000","last_active":"2023-07-14T13:08:22.900585+0000","last_peered":"2023-07-14T13:08:22.900585+0000","last_clean":"2023-07-14T13:08:22.900585+0000","last_became_active":"2023-07-14T13:08:22.898408+0000","last_became_peered":"2023-07-14T13:08:22.898408+0000","last_unstale":"2023-07-14T13:08:22.900585+0000","last_undegraded":"2023-07-14T13:08:22.900585+0000","last_fullsized":"2023-07-14T13:08:22.900585+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:29:41.565522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.891224+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:08:22.891224+0000","last_peered":"2023-07-14T13:08:22.891224+0000","last_clean":"2023-07-14T13:08:22.891224+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:08:22.891224+0000","last_undegraded":"2023-07-14T13:08:22.891224+0000","last_fullsized":"2023-07-14T13:08:22.891224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:11:22.279127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.876091+0000","last_change":"2023-07-14T13:08:22.876091+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.876091+0000","last_undegraded":"2023-07-14T13:08:22.876091+0000","last_fullsized":"2023-07-14T13:08:22.876091+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.900629+0000","last_change":"2023-07-14T13:08:22.899305+0000","last_active":"2023-07-14T13:08:22.900629+0000","last_peered":"2023-07-14T13:08:22.900629+0000","last_clean":"2023-07-14T13:08:22.900629+0000","last_became_active":"2023-07-14T13:08:22.898996+0000","last_became_peered":"2023-07-14T13:08:22.898996+0000","last_unstale":"2023-07-14T13:08:22.900629+0000","last_undegraded":"2023-07-14T13:08:22.900629+0000","last_fullsized":"2023-07-14T13:08:22.900629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:56:03.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.870478+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:08:22.870478+0000","last_peered":"2023-07-14T13:08:22.870478+0000","last_clean":"2023-07-14T13:08:22.870478+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:08:22.870478+0000","last_undegraded":"2023-07-14T13:08:22.870478+0000","last_fullsized":"2023-07-14T13:08:22.870478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:28:21.335135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.881311+0000","last_change":"2023-07-14T13:08:22.881311+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.881311+0000","last_undegraded":"2023-07-14T13:08:22.881311+0000","last_fullsized":"2023-07-14T13:08:22.881311+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.887032+0000","last_change":"2023-07-14T13:08:22.885480+0000","last_active":"2023-07-14T13:08:22.887032+0000","last_peered":"2023-07-14T13:08:22.887032+0000","last_clean":"2023-07-14T13:08:22.887032+0000","last_became_active":"2023-07-14T13:08:22.885180+0000","last_became_peered":"2023-07-14T13:08:22.885180+0000","last_unstale":"2023-07-14T13:08:22.887032+0000","last_undegraded":"2023-07-14T13:08:22.887032+0000","last_fullsized":"2023-07-14T13:08:22.887032+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:48:30.643508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.890458+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:08:22.890458+0000","last_peered":"2023-07-14T13:08:22.890458+0000","last_clean":"2023-07-14T13:08:22.890458+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:08:22.890458+0000","last_undegraded":"2023-07-14T13:08:22.890458+0000","last_fullsized":"2023-07-14T13:08:22.890458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:01.711854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575038,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54716,"kb_used_data":1524,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317124,"statfs":{"total":96636764160,"available":96580734976,"internally_reserved":0,"allocated":1560576,"data_stored":1072049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.51500000000000001,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.98299999999999998,"5min":0.98399999999999999,"15min":1.879},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.56799999999999995,"5min":0.44,"15min":0.439},"max":{"1min":1.054,"5min":1.054,"15min":1.9059999999999999},"last":0.627}]},{"osd":1,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73899999999999999,"15min":0.73599999999999999},"min":{"1min":0.504,"5min":0.434,"15min":0.42999999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.069},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.749,"15min":0.746},"min":{"1min":0.54400000000000004,"5min":0.48999999999999999,"15min":0.40500000000000003},"max":{"1min":0.93999999999999995,"5min":0.97399999999999998,"15min":1.1020000000000001},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73899999999999999,"15min":0.72799999999999998},"min":{"1min":0.52700000000000002,"5min":0.46999999999999997,"15min":0.40600000000000003},"max":{"1min":0.88100000000000001,"5min":0.98899999999999999,"15min":1.048},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.747,"15min":0.752},"min":{"1min":0.47499999999999998,"5min":0.47199999999999998,"15min":0.46899999999999997},"max":{"1min":0.91300000000000003,"5min":0.97099999999999997,"15min":1.0169999999999999},"last":0.76000000000000001}]},{"osd":3,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.746,"15min":0.73399999999999999},"min":{"1min":0.59399999999999997,"5min":0.503,"15min":0.442},"max":{"1min":0.88400000000000001,"5min":1.0269999999999999,"15min":1.0760000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.755,"15min":0.75700000000000001},"min":{"1min":0.60199999999999998,"5min":0.47299999999999998,"15min":0.41499999999999998},"max":{"1min":0.91600000000000004,"5min":1.018,"15min":1.024},"last":0.80400000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.44400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.82099999999999995,"5min":1.0009999999999999,"15min":1.022},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.41799999999999998,"5min":0.40999999999999998,"15min":0.39300000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.82599999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59699999999999998,"15min":0.60599999999999998},"min":{"1min":0.39300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.0249999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63400000000000001,"15min":0.65600000000000003},"min":{"1min":0.41999999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.77700000000000002}]},{"osd":6,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68400000000000005,"15min":0.70099999999999996},"min":{"1min":0.45200000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.99299999999999999,"5min":1.0489999999999999,"15min":1.4419999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.67600000000000005},"min":{"1min":0.46999999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81200000000000006,"5min":0.95799999999999996,"15min":1.575},"last":0.79400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575039,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":966656,"data_stored":481681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.57799999999999996,"5min":0.38,"15min":0.38},"max":{"1min":0.90400000000000003,"5min":0.996,"15min":1.2749999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.72499999999999998,"15min":0.74199999999999999},"min":{"1min":0.53600000000000003,"5min":0.48199999999999998,"15min":0.47399999999999998},"max":{"1min":0.98199999999999998,"5min":1.0800000000000001,"15min":1.2110000000000001},"last":0.69799999999999995}]},{"osd":1,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73599999999999999,"15min":0.752},"min":{"1min":0.48299999999999998,"5min":0.47399999999999998,"15min":0.379},"max":{"1min":0.90900000000000003,"5min":1.0089999999999999,"15min":1.4299999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70799999999999996,"15min":0.72599999999999998},"min":{"1min":0.56999999999999995,"5min":0.46999999999999997,"15min":0.44},"max":{"1min":0.86899999999999999,"5min":0.97099999999999997,"15min":1.1379999999999999},"last":0.71699999999999997}]},{"osd":2,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.73899999999999999,"15min":0.754},"min":{"1min":0.55800000000000005,"5min":0.45900000000000002,"15min":0.40400000000000003},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":1.319},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.755,"15min":0.75600000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.42299999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.341},"last":0.56599999999999995}]},{"osd":3,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76000000000000001,"15min":0.78100000000000003},"min":{"1min":0.51000000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.054,"5min":1.054,"15min":1.3859999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.52400000000000002,"5min":0.48399999999999999,"15min":0.45900000000000002},"max":{"1min":0.94799999999999995,"5min":0.99099999999999999,"15min":1.1080000000000001},"last":0.58199999999999996}]},{"osd":4,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.97899999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.624,"15min":0.63900000000000001},"min":{"1min":0.47399999999999998,"5min":0.38500000000000001,"15min":0.36099999999999999},"max":{"1min":0.93500000000000005,"5min":1.012,"15min":1.091},"last":0.51200000000000001}]},{"osd":5,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64100000000000001,"15min":0.64700000000000002},"min":{"1min":0.499,"5min":0.37,"15min":0.37},"max":{"1min":0.96599999999999997,"5min":1.579,"15min":1.579},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67800000000000005,"15min":0.69399999999999995},"min":{"1min":0.46700000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.145},"last":0.621}]},{"osd":7,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.438,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.208},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.499,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0209999999999999,"5min":1.657,"15min":1.657},"last":0.60399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575038,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":978944,"data_stored":488301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.72999999999999998,"15min":0.73599999999999999},"min":{"1min":0.60999999999999999,"5min":0.36499999999999999,"15min":0.32400000000000001},"max":{"1min":0.90200000000000002,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.70799999999999996,"15min":0.73899999999999999},"min":{"1min":0.52500000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.625}]},{"osd":1,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71799999999999997,"15min":0.73099999999999998},"min":{"1min":0.56399999999999995,"5min":0.44500000000000001,"15min":0.41099999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.335},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.745,"15min":0.752},"min":{"1min":0.60299999999999998,"5min":0.48699999999999999,"15min":0.36799999999999999},"max":{"1min":0.94499999999999995,"5min":2.706,"15min":2.706},"last":0.53900000000000003}]},{"osd":2,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72399999999999998,"15min":0.74399999999999999},"min":{"1min":0.59499999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.212,"5min":1.212,"15min":1.298},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.71899999999999997,"15min":0.73999999999999999},"min":{"1min":0.53800000000000003,"5min":0.433,"15min":0.433},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.73499999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.75,"15min":0.751},"min":{"1min":0.60599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.90900000000000003,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.57999999999999996,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.55300000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.45700000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68000000000000005,"15min":0.68899999999999995},"min":{"1min":0.443,"5min":0.36299999999999999,"15min":0.35899999999999999},"max":{"1min":0.86799999999999999,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.69899999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60199999999999998,"15min":0.62},"min":{"1min":0.41699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63900000000000001,"15min":0.64600000000000002},"min":{"1min":0.496,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.83699999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66000000000000003,"15min":0.64900000000000002},"min":{"1min":0.48899999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.026,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.46600000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.2589999999999999,"5min":1.407,"15min":1.407},"last":0.79000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575038,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":978944,"data_stored":488301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.73999999999999999,"15min":0.73499999999999999},"min":{"1min":0.56200000000000006,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92400000000000004,"5min":1.411,"15min":1.411},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.76800000000000002,"15min":0.73199999999999998},"min":{"1min":0.64000000000000001,"5min":0.45800000000000002,"15min":0.435},"max":{"1min":0.94599999999999995,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.73999999999999999}]},{"osd":1,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77000000000000002,"15min":0.751},"min":{"1min":0.62,"5min":0.47999999999999998,"15min":0.442},"max":{"1min":0.90700000000000003,"5min":1.077,"15min":1.077},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.54600000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91900000000000004,"5min":1.0469999999999999,"15min":1.2370000000000001},"last":0.55900000000000005}]},{"osd":2,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.749,"15min":0.73599999999999999},"min":{"1min":0.60799999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.95599999999999996,"5min":1.091,"15min":1.091},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79800000000000004,"15min":0.77600000000000002},"min":{"1min":0.60399999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98199999999999998,"5min":1.387,"15min":1.387},"last":0.84099999999999997}]},{"osd":3,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75,"15min":0.748},"min":{"1min":0.58099999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84799999999999998,"5min":1.008,"15min":1.099},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77500000000000002,"15min":0.77300000000000002},"min":{"1min":0.64700000000000002,"5min":0.496,"15min":0.46800000000000003},"max":{"1min":0.98699999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.69199999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.61699999999999999,"15min":0.60499999999999998},"min":{"1min":0.437,"5min":0.378,"15min":0.378},"max":{"1min":0.76400000000000001,"5min":0.95599999999999996,"15min":1.0029999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.627,"15min":0.61799999999999999},"min":{"1min":0.52400000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85799999999999998,"5min":0.93600000000000005,"15min":0.95199999999999996},"last":0.47899999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.621,"15min":0.62},"min":{"1min":0.48699999999999999,"5min":0.38900000000000001,"15min":0.32300000000000001},"max":{"1min":0.873,"5min":1.014,"15min":1.014},"last":0.443},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.51900000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.94599999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.625}]},{"osd":7,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.68200000000000005,"15min":0.67100000000000004},"min":{"1min":0.57199999999999995,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93200000000000005,"5min":0.94699999999999995,"15min":1.0349999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.55800000000000005,"5min":0.40300000000000002,"15min":0.36899999999999999},"max":{"1min":0.96899999999999997,"5min":1.0629999999999999,"15min":1.1080000000000001},"last":0.64700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575038,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36100,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335740,"statfs":{"total":96636764160,"available":96599797760,"internally_reserved":0,"allocated":978944,"data_stored":488301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.44900000000000001,"15min":0.44600000000000001},"min":{"1min":0.32300000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.70099999999999996,"5min":0.755,"15min":0.84199999999999997},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.309},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":1.577},"last":0.35599999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47699999999999998,"15min":0.47799999999999998},"min":{"1min":0.33100000000000002,"5min":0.315,"15min":0.29199999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.88200000000000001},"last":0.38},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54900000000000004,"15min":0.54300000000000004},"min":{"1min":0.438,"5min":0.35899999999999999,"15min":0.32600000000000001},"max":{"1min":0.71399999999999997,"5min":1.0029999999999999,"15min":1.113},"last":0.33000000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55600000000000005,"15min":0.57199999999999995},"min":{"1min":0.40999999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.82599999999999996,"5min":0.88400000000000001,"15min":1.0820000000000001},"last":0.433},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.60399999999999998},"min":{"1min":0.436,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.747,"5min":1.663,"15min":1.663},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.76800000000000002,"15min":0.76900000000000002},"min":{"1min":0.60499999999999998,"5min":0.47899999999999998,"15min":0.439},"max":{"1min":1.018,"5min":1.284,"15min":1.627},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.61699999999999999,"5min":0.56399999999999995,"15min":0.47699999999999998},"max":{"1min":1.0469999999999999,"5min":1.121,"15min":1.214},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.79800000000000004,"15min":0.79900000000000004},"min":{"1min":0.65700000000000003,"5min":0.58499999999999996,"15min":0.52400000000000002},"max":{"1min":0.997,"5min":1.306,"15min":1.333},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.55000000000000004,"5min":0.372,"15min":0.372},"max":{"1min":0.98899999999999999,"5min":1.1870000000000001,"15min":1.2470000000000001},"last":0.61699999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77700000000000002,"15min":0.78600000000000003},"min":{"1min":0.60399999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.99199999999999999,"5min":1.105,"15min":1.526},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.81699999999999995,"15min":0.82199999999999995},"min":{"1min":0.59199999999999997,"5min":0.54200000000000004,"15min":0.505},"max":{"1min":1.0109999999999999,"5min":1.2589999999999999,"15min":1.381},"last":0.69799999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.85799999999999998,"15min":0.84799999999999998},"min":{"1min":0.66400000000000003,"5min":0.55800000000000005,"15min":0.53100000000000003},"max":{"1min":1.0349999999999999,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.83799999999999997,"15min":0.83699999999999997},"min":{"1min":0.63,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.026,"5min":1.595,"15min":1.6910000000000001},"last":0.63500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575038,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58240,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313600,"statfs":{"total":96636764160,"available":96577126400,"internally_reserved":0,"allocated":974848,"data_stored":487282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.32100000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64500000000000002,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55500000000000005,"15min":0.54100000000000004},"min":{"1min":0.34100000000000003,"5min":0.32900000000000001,"15min":0.28999999999999998},"max":{"1min":0.80800000000000005,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.50700000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48599999999999999,"15min":0.47599999999999998},"min":{"1min":0.38,"5min":0.29999999999999999,"15min":0.27500000000000002},"max":{"1min":0.71599999999999997,"5min":2.7200000000000002,"15min":2.7200000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.40899999999999997,"5min":0.35999999999999999,"15min":0.33000000000000002},"max":{"1min":0.77900000000000003,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":0.55500000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.66200000000000003,"15min":0.60699999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72099999999999997,"5min":8.2530000000000001,"15min":8.2530000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.55400000000000005},"min":{"1min":0.40300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77200000000000002,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.47299999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76800000000000002,"15min":0.78300000000000003},"min":{"1min":0.61599999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.95199999999999996,"5min":1.0940000000000001,"15min":1.3049999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78500000000000003,"15min":0.80100000000000005},"min":{"1min":0.58199999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.006,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.91800000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.86299999999999999,"15min":0.86599999999999999},"min":{"1min":0.64600000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0640000000000001,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.84299999999999997,"15min":0.84399999999999997},"min":{"1min":0.57799999999999996,"5min":0.55600000000000005,"15min":0.433},"max":{"1min":1.081,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.93899999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.81100000000000005,"15min":0.80700000000000005},"min":{"1min":0.60399999999999998,"5min":0.48999999999999999,"15min":0.47599999999999998},"max":{"1min":0.99099999999999999,"5min":3.9849999999999999,"15min":3.9849999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82199999999999995,"15min":0.81699999999999995},"min":{"1min":0.64600000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98499999999999999,"5min":3.391,"15min":3.391},"last":0.69099999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.81799999999999995,"15min":0.82799999999999996},"min":{"1min":0.61099999999999999,"5min":0.5,"15min":0.5},"max":{"1min":1.022,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.87},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83399999999999996,"15min":0.82599999999999996},"min":{"1min":0.66900000000000004,"5min":0.53200000000000003,"15min":0.50900000000000001},"max":{"1min":1.0069999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.77100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575039,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36100,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335740,"statfs":{"total":96636764160,"available":96599797760,"internally_reserved":0,"allocated":978944,"data_stored":488301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.439,"15min":0.43099999999999999},"min":{"1min":0.317,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.65400000000000003,"5min":0.67200000000000004,"15min":0.77200000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.51800000000000002,"15min":0.504},"min":{"1min":0.34799999999999998,"5min":0.28199999999999997,"15min":0.26500000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47599999999999998,"15min":0.47199999999999998},"min":{"1min":0.34599999999999997,"5min":0.32100000000000001,"15min":0.29499999999999998},"max":{"1min":0.67900000000000005,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.38200000000000001,"5min":0.30599999999999999,"15min":0.29299999999999998},"max":{"1min":0.74399999999999999,"5min":1.014,"15min":1.014},"last":0.505}]},{"osd":3,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.55100000000000005,"5min":0.44700000000000001,"15min":0.432},"max":{"1min":0.80300000000000005,"5min":0.86899999999999999,"15min":0.96299999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.57999999999999996},"min":{"1min":0.46200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.80300000000000005,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.54600000000000004}]},{"osd":4,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.79300000000000004,"15min":0.78400000000000003},"min":{"1min":0.61299999999999999,"5min":0.51300000000000001,"15min":0.40000000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.236},"last":0.997},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.77800000000000002,"15min":0.78500000000000003},"min":{"1min":0.54900000000000004,"5min":0.502,"15min":0.45700000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.93799999999999994}]},{"osd":5,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.67900000000000005,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":1.1000000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.81200000000000006,"15min":0.80400000000000005},"min":{"1min":0.56999999999999995,"5min":0.48599999999999999,"15min":0.48199999999999998},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.3600000000000001},"last":0.85899999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.80000000000000004,"15min":0.80200000000000005},"min":{"1min":0.58299999999999996,"5min":0.503,"15min":0.48499999999999999},"max":{"1min":1.1120000000000001,"5min":1.2170000000000001,"15min":1.274},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.82899999999999996,"15min":0.81799999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.49199999999999999},"max":{"1min":1.1319999999999999,"5min":1.262,"15min":1.2969999999999999},"last":1.044}]},{"osd":7,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.79700000000000004},"min":{"1min":0.62,"5min":0.55200000000000005,"15min":0.47799999999999998},"max":{"1min":1.1579999999999999,"5min":1.1859999999999999,"15min":1.3400000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.87,"5min":0.84599999999999997,"15min":0.84199999999999997},"min":{"1min":0.60799999999999998,"5min":0.53700000000000003,"15min":0.52800000000000002},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.0820000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575040,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36664,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335176,"statfs":{"total":96636764160,"available":96599220224,"internally_reserved":0,"allocated":1556480,"data_stored":1071030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47099999999999997,"15min":0.45300000000000001},"min":{"1min":0.30199999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.76500000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.33000000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":1.452},"last":0.47499999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53800000000000003,"15min":0.52000000000000002},"min":{"1min":0.39800000000000002,"5min":0.35799999999999998,"15min":0.34100000000000003},"max":{"1min":0.84499999999999997,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.376,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71699999999999997,"5min":0.80300000000000005,"15min":1.5700000000000001},"last":0.58499999999999996}]},{"osd":3,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.499,"15min":0.50700000000000001},"min":{"1min":0.432,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.99299999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77100000000000002,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.82899999999999996}]},{"osd":4,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.79900000000000004,"15min":0.79000000000000004},"min":{"1min":0.55200000000000005,"5min":0.48399999999999999,"15min":0.44400000000000001},"max":{"1min":1.21,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81999999999999995,"15min":0.81100000000000005},"min":{"1min":0.57999999999999996,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.03,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.88600000000000001}]},{"osd":5,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81000000000000005,"15min":0.81100000000000005},"min":{"1min":0.56999999999999995,"5min":0.51800000000000002,"15min":0.47899999999999998},"max":{"1min":1.042,"5min":1.3839999999999999,"15min":1.4950000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.80000000000000004,"15min":0.80100000000000005},"min":{"1min":0.621,"5min":0.49299999999999999,"15min":0.47299999999999998},"max":{"1min":1.069,"5min":1.325,"15min":1.325},"last":0.84999999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.82299999999999995,"15min":0.81399999999999995},"min":{"1min":0.58699999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.05,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.63900000000000001,"5min":0.50600000000000001,"15min":0.41299999999999998},"max":{"1min":1.044,"5min":1.3440000000000001,"15min":1.5369999999999999},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.82899999999999996,"15min":0.83799999999999997},"min":{"1min":0.60599999999999998,"5min":0.503,"15min":0.45500000000000002},"max":{"1min":1.1180000000000001,"5min":1.2749999999999999,"15min":1.603},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.80500000000000005,"15min":0.81799999999999995},"min":{"1min":0.65100000000000002,"5min":0.502,"15min":0.497},"max":{"1min":1.0880000000000001,"5min":1.381,"15min":1.381},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:08:28.038 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:08:28.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.184+0000 7fd8118d8640 1 Processor -- start 2023-07-14T13:08:28.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.184+0000 7fd8118d8640 1 -- start start 2023-07-14T13:08:28.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.188+0000 7fd8118d8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd80c0b7c70 0x7fd80c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:28.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.188+0000 7fd8118d8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd80c15fd60 0x7fd80c0d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:28.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.188+0000 7fd8118d8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd80c0ccaf0 con 0x7fd80c0d1850 2023-07-14T13:08:28.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.188+0000 7fd8118d8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd80c0d1190 con 0x7fd80c15fd60 2023-07-14T13:08:28.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.188+0000 7fd8118d8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd80c160600 con 0x7fd80c0b7c70 2023-07-14T13:08:28.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.188+0000 7fd803fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd80c0d1850 0x7fd80c15f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58112/0 (socket says 172.21.15.5:58112) 2023-07-14T13:08:28.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.188+0000 7fd803fff640 1 -- 172.21.15.5:0/2166318788 learned_addr learned my addr 172.21.15.5:0/2166318788 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:28.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.188+0000 7fd80b7fe640 1 --2- 172.21.15.5:0/2166318788 >> v2:172.21.15.5:3300/0 conn(0x7fd80c15fd60 0x7fd80c0d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:28.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.188+0000 7fd80affd640 1 --2- 172.21.15.5:0/2166318788 >> v2:172.21.15.154:3300/0 conn(0x7fd80c0b7c70 0x7fd80c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:28.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.188+0000 7fd80a7fc640 1 -- 172.21.15.5:0/2166318788 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821574326 0 0) 0x7fd80c0ccaf0 con 0x7fd80c0d1850 2023-07-14T13:08:28.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.188+0000 7fd80a7fc640 1 -- 172.21.15.5:0/2166318788 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7f8003530 con 0x7fd80c0d1850 2023-07-14T13:08:28.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.188+0000 7fd80b7fe640 1 -- 172.21.15.5:0/2166318788 >> v2:172.21.15.154:3300/0 conn(0x7fd80c0b7c70 msgr2=0x7fd80c0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:28.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.188+0000 7fd80b7fe640 1 --2- 172.21.15.5:0/2166318788 >> v2:172.21.15.154:3300/0 conn(0x7fd80c0b7c70 0x7fd80c0d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:28.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.188+0000 7fd80b7fe640 1 -- 172.21.15.5:0/2166318788 >> v1:172.21.15.5:6789/0 conn(0x7fd80c0d1850 legacy=0x7fd80c15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:28.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.188+0000 7fd80b7fe640 1 -- 172.21.15.5:0/2166318788 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80c160320 con 0x7fd80c15fd60 2023-07-14T13:08:28.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.188+0000 7fd80b7fe640 1 --2- 172.21.15.5:0/2166318788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd80c15fd60 0x7fd80c0d1da0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0b40a0 tx=0x7fd80401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7785369c3775a195 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:28.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.192+0000 7fd80a7fc640 1 -- 172.21.15.5:0/2166318788 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8040a59c0 con 0x7fd80c15fd60 2023-07-14T13:08:28.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.192+0000 7fd80a7fc640 1 -- 172.21.15.5:0/2166318788 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8040a5b20 con 0x7fd80c15fd60 2023-07-14T13:08:28.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.192+0000 7fd80a7fc640 1 -- 172.21.15.5:0/2166318788 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8040ad440 con 0x7fd80c15fd60 2023-07-14T13:08:28.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.192+0000 7fd8118d8640 1 -- 172.21.15.5:0/2166318788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd80c15fd60 msgr2=0x7fd80c0d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:28.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.192+0000 7fd8118d8640 1 --2- 172.21.15.5:0/2166318788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd80c15fd60 0x7fd80c0d1da0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0b40a0 tx=0x7fd80401c8e0 comp rx=0 tx=0).stop 2023-07-14T13:08:28.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.192+0000 7fd8118d8640 1 -- 172.21.15.5:0/2166318788 shutdown_connections 2023-07-14T13:08:28.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.192+0000 7fd8118d8640 1 --2- 172.21.15.5:0/2166318788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd80c15fd60 0x7fd80c0d1da0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:28.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.192+0000 7fd8118d8640 1 --2- 172.21.15.5:0/2166318788 >> v2:172.21.15.154:3300/0 conn(0x7fd80c0b7c70 0x7fd80c0d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:28.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.192+0000 7fd8118d8640 1 -- 172.21.15.5:0/2166318788 >> 172.21.15.5:0/2166318788 conn(0x7fd80c0650b0 msgr2=0x7fd80c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:28.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.192+0000 7fd8118d8640 1 -- 172.21.15.5:0/2166318788 shutdown_connections 2023-07-14T13:08:28.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.192+0000 7fd8118d8640 1 -- 172.21.15.5:0/2166318788 wait complete. 2023-07-14T13:08:28.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.192+0000 7fd8118d8640 1 Processor -- start 2023-07-14T13:08:28.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.192+0000 7fd8118d8640 1 -- start start 2023-07-14T13:08:28.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.192+0000 7fd8118d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd80c0b7c70 0x7fd80c153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:28.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.192+0000 7fd8118d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd80c0d1850 0x7fd80c15b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:28.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.192+0000 7fd8118d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd80c15fd60 0x7fd80c15b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:28.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.192+0000 7fd8118d8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c153940 con 0x7fd80c15fd60 2023-07-14T13:08:28.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.192+0000 7fd8118d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c15c130 con 0x7fd80c0d1850 2023-07-14T13:08:28.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.192+0000 7fd8118d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c15c410 con 0x7fd80c0b7c70 2023-07-14T13:08:28.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.192+0000 7fd80b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd80c15fd60 0x7fd80c15b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:28.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.192+0000 7fd80b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd80c15fd60 0x7fd80c15b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38730/0 (socket says 172.21.15.5:38730) 2023-07-14T13:08:28.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.192+0000 7fd80b7fe640 1 -- 172.21.15.5:0/489284090 learned_addr learned my addr 172.21.15.5:0/489284090 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:28.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.196+0000 7fd803fff640 1 --2- 172.21.15.5:0/489284090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd80c0d1850 0x7fd80c15b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:28.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.196+0000 7fd80affd640 1 --2- 172.21.15.5:0/489284090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd80c0b7c70 0x7fd80c153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:28.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.196+0000 7fd80b7fe640 1 -- 172.21.15.5:0/489284090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd80c0b7c70 msgr2=0x7fd80c153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:28.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.196+0000 7fd80b7fe640 1 --2- 172.21.15.5:0/489284090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd80c0b7c70 0x7fd80c153360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:28.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.196+0000 7fd80b7fe640 1 -- 172.21.15.5:0/489284090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd80c0d1850 msgr2=0x7fd80c15b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:28.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.196+0000 7fd80b7fe640 1 --2- 172.21.15.5:0/489284090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd80c0d1850 0x7fd80c15b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:28.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.196+0000 7fd80b7fe640 1 -- 172.21.15.5:0/489284090 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd804009a70 con 0x7fd80c15fd60 2023-07-14T13:08:28.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.196+0000 7fd80b7fe640 1 --2- 172.21.15.5:0/489284090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd80c15fd60 0x7fd80c15b640 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fd804009d90 tx=0x7fd804019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:28.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.196+0000 7fd808ff9640 1 -- 172.21.15.5:0/489284090 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd804007000 con 0x7fd80c15fd60 2023-07-14T13:08:28.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.196+0000 7fd808ff9640 1 -- 172.21.15.5:0/489284090 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8040aede0 con 0x7fd80c15fd60 2023-07-14T13:08:28.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.196+0000 7fd808ff9640 1 -- 172.21.15.5:0/489284090 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8040b7650 con 0x7fd80c15fd60 2023-07-14T13:08:28.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.196+0000 7fd8118d8640 1 -- 172.21.15.5:0/489284090 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80c15c6f0 con 0x7fd80c15fd60 2023-07-14T13:08:28.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.196+0000 7fd8118d8640 1 -- 172.21.15.5:0/489284090 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80c0cf910 con 0x7fd80c15fd60 2023-07-14T13:08:28.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.196+0000 7fd8118d8640 1 -- 172.21.15.5:0/489284090 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd80c15cc10 con 0x7fd80c15fd60 2023-07-14T13:08:28.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.196+0000 7fd808ff9640 1 -- 172.21.15.5:0/489284090 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd8040b4050 con 0x7fd80c15fd60 2023-07-14T13:08:28.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.196+0000 7fd808ff9640 1 --2- 172.21.15.5:0/489284090 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fd7ec0663a0 0x7fd7ec068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:28.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.196+0000 7fd808ff9640 1 -- 172.21.15.5:0/489284090 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd80411ee00 con 0x7fd80c15fd60 2023-07-14T13:08:28.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.200+0000 7fd80affd640 1 --2- 172.21.15.5:0/489284090 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fd7ec0663a0 0x7fd7ec068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:28.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.200+0000 7fd80affd640 1 --2- 172.21.15.5:0/489284090 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fd7ec0663a0 0x7fd7ec068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0079c0 tx=0x7fd7fc008040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:28.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.200+0000 7fd808ff9640 1 -- 172.21.15.5:0/489284090 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd80c15cc10 con 0x7fd80c15fd60 2023-07-14T13:08:28.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.352+0000 7fd8118d8640 1 -- 172.21.15.5:0/489284090 --> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd80c15c2a0 con 0x7fd7ec0663a0 2023-07-14T13:08:28.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.360+0000 7fd808ff9640 1 -- 172.21.15.5:0/489284090 <== mgr.5648 v2:172.21.15.154:6832/1874317247 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305540 (secure 0 0 0) 0x7fd80c15c2a0 con 0x7fd7ec0663a0 2023-07-14T13:08:28.397 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:28.398 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:08:28.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.364+0000 7fd8118d8640 1 -- 172.21.15.5:0/489284090 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fd7ec0663a0 msgr2=0x7fd7ec068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:28.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.364+0000 7fd8118d8640 1 --2- 172.21.15.5:0/489284090 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fd7ec0663a0 0x7fd7ec068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0079c0 tx=0x7fd7fc008040 comp rx=0 tx=0).stop 2023-07-14T13:08:28.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.364+0000 7fd8118d8640 1 -- 172.21.15.5:0/489284090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd80c15fd60 msgr2=0x7fd80c15b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:28.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.364+0000 7fd8118d8640 1 --2- 172.21.15.5:0/489284090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd80c15fd60 0x7fd80c15b640 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fd804009d90 tx=0x7fd804019680 comp rx=0 tx=0).stop 2023-07-14T13:08:28.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.364+0000 7fd8118d8640 1 -- 172.21.15.5:0/489284090 shutdown_connections 2023-07-14T13:08:28.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.364+0000 7fd8118d8640 1 --2- 172.21.15.5:0/489284090 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fd7ec0663a0 0x7fd7ec068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:28.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.364+0000 7fd8118d8640 1 --2- 172.21.15.5:0/489284090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd80c15fd60 0x7fd80c15b640 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:28.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.364+0000 7fd8118d8640 1 --2- 172.21.15.5:0/489284090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd80c0d1850 0x7fd80c15b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:28.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.364+0000 7fd8118d8640 1 --2- 172.21.15.5:0/489284090 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd80c0b7c70 0x7fd80c153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:28.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.364+0000 7fd8118d8640 1 -- 172.21.15.5:0/489284090 >> 172.21.15.5:0/489284090 conn(0x7fd80c0650b0 msgr2=0x7fd80c165c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:28.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.364+0000 7fd8118d8640 1 -- 172.21.15.5:0/489284090 shutdown_connections 2023-07-14T13:08:28.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.364+0000 7fd8118d8640 1 -- 172.21.15.5:0/489284090 wait complete. 2023-07-14T13:08:28.417 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-14T13:08:27.514762+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":313724,"kb_used_data":8764,"kb_used_omap":0,"kb_used_meta":304896,"kb_avail":754660996,"statfs":{"total":773094113280,"available":772772859904,"internally_reserved":0,"allocated":8974336,"data_stored":5065246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312213504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.653666"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.874656+0000","last_change":"2023-07-14T13:08:22.874656+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.874656+0000","last_undegraded":"2023-07-14T13:08:22.874656+0000","last_fullsized":"2023-07-14T13:08:22.874656+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.875595+0000","last_change":"2023-07-14T13:08:22.875595+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.875595+0000","last_undegraded":"2023-07-14T13:08:22.875595+0000","last_fullsized":"2023-07-14T13:08:22.875595+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.881004+0000","last_change":"2023-07-14T13:08:22.881004+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.881004+0000","last_undegraded":"2023-07-14T13:08:22.881004+0000","last_fullsized":"2023-07-14T13:08:22.881004+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.877032+0000","last_change":"2023-07-14T13:08:22.877032+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.877032+0000","last_undegraded":"2023-07-14T13:08:22.877032+0000","last_fullsized":"2023-07-14T13:08:22.877032+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.881951+0000","last_change":"2023-07-14T13:08:22.881951+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.881951+0000","last_undegraded":"2023-07-14T13:08:22.881951+0000","last_fullsized":"2023-07-14T13:08:22.881951+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.874852+0000","last_change":"2023-07-14T13:08:22.874852+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.874852+0000","last_undegraded":"2023-07-14T13:08:22.874852+0000","last_fullsized":"2023-07-14T13:08:22.874852+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.877520+0000","last_change":"2023-07-14T13:08:22.877520+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.877520+0000","last_undegraded":"2023-07-14T13:08:22.877520+0000","last_fullsized":"2023-07-14T13:08:22.877520+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.880131+0000","last_change":"2023-07-14T13:08:22.880131+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.880131+0000","last_undegraded":"2023-07-14T13:08:22.880131+0000","last_fullsized":"2023-07-14T13:08:22.880131+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.884955+0000","last_change":"2023-07-14T13:08:22.884955+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.884955+0000","last_undegraded":"2023-07-14T13:08:22.884955+0000","last_fullsized":"2023-07-14T13:08:22.884955+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.878859+0000","last_change":"2023-07-14T13:08:22.878859+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.878859+0000","last_undegraded":"2023-07-14T13:08:22.878859+0000","last_fullsized":"2023-07-14T13:08:22.878859+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.878049+0000","last_change":"2023-07-14T13:08:22.878049+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.878049+0000","last_undegraded":"2023-07-14T13:08:22.878049+0000","last_fullsized":"2023-07-14T13:08:22.878049+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.881668+0000","last_change":"2023-07-14T13:08:22.881668+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.881668+0000","last_undegraded":"2023-07-14T13:08:22.881668+0000","last_fullsized":"2023-07-14T13:08:22.881668+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.881867+0000","last_change":"2023-07-14T13:08:22.881867+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.881867+0000","last_undegraded":"2023-07-14T13:08:22.881867+0000","last_fullsized":"2023-07-14T13:08:22.881867+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.879097+0000","last_change":"2023-07-14T13:08:22.879097+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.879097+0000","last_undegraded":"2023-07-14T13:08:22.879097+0000","last_fullsized":"2023-07-14T13:08:22.879097+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.884027+0000","last_change":"2023-07-14T13:08:22.884027+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.884027+0000","last_undegraded":"2023-07-14T13:08:22.884027+0000","last_fullsized":"2023-07-14T13:08:22.884027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.878091+0000","last_change":"2023-07-14T13:08:22.878091+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.878091+0000","last_undegraded":"2023-07-14T13:08:22.878091+0000","last_fullsized":"2023-07-14T13:08:22.878091+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.874124+0000","last_change":"2023-07-14T13:08:22.874124+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.874124+0000","last_undegraded":"2023-07-14T13:08:22.874124+0000","last_fullsized":"2023-07-14T13:08:22.874124+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.876616+0000","last_change":"2023-07-14T13:08:22.876616+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.876616+0000","last_undegraded":"2023-07-14T13:08:22.876616+0000","last_fullsized":"2023-07-14T13:08:22.876616+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.880454+0000","last_change":"2023-07-14T13:08:22.880454+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.880454+0000","last_undegraded":"2023-07-14T13:08:22.880454+0000","last_fullsized":"2023-07-14T13:08:22.880454+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.876197+0000","last_change":"2023-07-14T13:08:22.876197+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.876197+0000","last_undegraded":"2023-07-14T13:08:22.876197+0000","last_fullsized":"2023-07-14T13:08:22.876197+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.881312+0000","last_change":"2023-07-14T13:08:22.881312+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.881312+0000","last_undegraded":"2023-07-14T13:08:22.881312+0000","last_fullsized":"2023-07-14T13:08:22.881312+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.879148+0000","last_change":"2023-07-14T13:08:22.879148+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.879148+0000","last_undegraded":"2023-07-14T13:08:22.879148+0000","last_fullsized":"2023-07-14T13:08:22.879148+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.878744+0000","last_change":"2023-07-14T13:08:22.878744+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.878744+0000","last_undegraded":"2023-07-14T13:08:22.878744+0000","last_fullsized":"2023-07-14T13:08:22.878744+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.884697+0000","last_change":"2023-07-14T13:08:22.884697+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.884697+0000","last_undegraded":"2023-07-14T13:08:22.884697+0000","last_fullsized":"2023-07-14T13:08:22.884697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.883558+0000","last_change":"2023-07-14T13:08:22.883558+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.883558+0000","last_undegraded":"2023-07-14T13:08:22.883558+0000","last_fullsized":"2023-07-14T13:08:22.883558+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.883234+0000","last_change":"2023-07-14T13:08:22.883234+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.883234+0000","last_undegraded":"2023-07-14T13:08:22.883234+0000","last_fullsized":"2023-07-14T13:08:22.883234+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.876532+0000","last_change":"2023-07-14T13:08:22.876532+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.876532+0000","last_undegraded":"2023-07-14T13:08:22.876532+0000","last_fullsized":"2023-07-14T13:08:22.876532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.873908+0000","last_change":"2023-07-14T13:08:22.873908+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.873908+0000","last_undegraded":"2023-07-14T13:08:22.873908+0000","last_fullsized":"2023-07-14T13:08:22.873908+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.880128+0000","last_change":"2023-07-14T13:08:22.880128+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.880128+0000","last_undegraded":"2023-07-14T13:08:22.880128+0000","last_fullsized":"2023-07-14T13:08:22.880128+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.881491+0000","last_change":"2023-07-14T13:08:22.881491+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.881491+0000","last_undegraded":"2023-07-14T13:08:22.881491+0000","last_fullsized":"2023-07-14T13:08:22.881491+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.877794+0000","last_change":"2023-07-14T13:08:22.877794+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.877794+0000","last_undegraded":"2023-07-14T13:08:22.877794+0000","last_fullsized":"2023-07-14T13:08:22.877794+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.876787+0000","last_change":"2023-07-14T13:08:22.876787+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.876787+0000","last_undegraded":"2023-07-14T13:08:22.876787+0000","last_fullsized":"2023-07-14T13:08:22.876787+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.880076+0000","last_change":"2023-07-14T13:08:22.880076+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.880076+0000","last_undegraded":"2023-07-14T13:08:22.880076+0000","last_fullsized":"2023-07-14T13:08:22.880076+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.894607+0000","last_change":"2023-07-14T13:08:22.892834+0000","last_active":"2023-07-14T13:08:22.894607+0000","last_peered":"2023-07-14T13:08:22.894607+0000","last_clean":"2023-07-14T13:08:22.894607+0000","last_became_active":"2023-07-14T13:08:22.892557+0000","last_became_peered":"2023-07-14T13:08:22.892557+0000","last_unstale":"2023-07-14T13:08:22.894607+0000","last_undegraded":"2023-07-14T13:08:22.894607+0000","last_fullsized":"2023-07-14T13:08:22.894607+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:39:25.704839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.875717+0000","last_change":"2023-07-14T13:08:22.875717+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.875717+0000","last_undegraded":"2023-07-14T13:08:22.875717+0000","last_fullsized":"2023-07-14T13:08:22.875717+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.893651+0000","last_change":"2023-07-14T13:08:22.888782+0000","last_active":"2023-07-14T13:08:22.893651+0000","last_peered":"2023-07-14T13:08:22.893651+0000","last_clean":"2023-07-14T13:08:22.893651+0000","last_became_active":"2023-07-14T13:08:22.888435+0000","last_became_peered":"2023-07-14T13:08:22.888435+0000","last_unstale":"2023-07-14T13:08:22.893651+0000","last_undegraded":"2023-07-14T13:08:22.893651+0000","last_fullsized":"2023-07-14T13:08:22.893651+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:52:49.835822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.875437+0000","last_change":"2023-07-14T13:08:22.875437+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.875437+0000","last_undegraded":"2023-07-14T13:08:22.875437+0000","last_fullsized":"2023-07-14T13:08:22.875437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.890136+0000","last_change":"2023-07-14T13:08:22.886288+0000","last_active":"2023-07-14T13:08:22.890136+0000","last_peered":"2023-07-14T13:08:22.890136+0000","last_clean":"2023-07-14T13:08:22.890136+0000","last_became_active":"2023-07-14T13:08:22.885619+0000","last_became_peered":"2023-07-14T13:08:22.885619+0000","last_unstale":"2023-07-14T13:08:22.890136+0000","last_undegraded":"2023-07-14T13:08:22.890136+0000","last_fullsized":"2023-07-14T13:08:22.890136+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:06.776201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.885416+0000","last_change":"2023-07-14T13:08:22.885416+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.885416+0000","last_undegraded":"2023-07-14T13:08:22.885416+0000","last_fullsized":"2023-07-14T13:08:22.885416+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.893540+0000","last_change":"2023-07-14T13:08:22.888011+0000","last_active":"2023-07-14T13:08:22.893540+0000","last_peered":"2023-07-14T13:08:22.893540+0000","last_clean":"2023-07-14T13:08:22.893540+0000","last_became_active":"2023-07-14T13:08:22.887659+0000","last_became_peered":"2023-07-14T13:08:22.887659+0000","last_unstale":"2023-07-14T13:08:22.893540+0000","last_undegraded":"2023-07-14T13:08:22.893540+0000","last_fullsized":"2023-07-14T13:08:22.893540+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:03:54.376631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.877566+0000","last_change":"2023-07-14T13:08:22.877566+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.877566+0000","last_undegraded":"2023-07-14T13:08:22.877566+0000","last_fullsized":"2023-07-14T13:08:22.877566+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.887011+0000","last_change":"2023-07-14T13:08:22.884530+0000","last_active":"2023-07-14T13:08:22.887011+0000","last_peered":"2023-07-14T13:08:22.887011+0000","last_clean":"2023-07-14T13:08:22.887011+0000","last_became_active":"2023-07-14T13:08:22.884229+0000","last_became_peered":"2023-07-14T13:08:22.884229+0000","last_unstale":"2023-07-14T13:08:22.887011+0000","last_undegraded":"2023-07-14T13:08:22.887011+0000","last_fullsized":"2023-07-14T13:08:22.887011+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:54:47.831816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.873445+0000","last_change":"2023-07-14T13:08:22.873445+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.873445+0000","last_undegraded":"2023-07-14T13:08:22.873445+0000","last_fullsized":"2023-07-14T13:08:22.873445+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.885902+0000","last_change":"2023-07-14T13:08:22.883779+0000","last_active":"2023-07-14T13:08:22.885902+0000","last_peered":"2023-07-14T13:08:22.885902+0000","last_clean":"2023-07-14T13:08:22.885902+0000","last_became_active":"2023-07-14T13:08:22.883464+0000","last_became_peered":"2023-07-14T13:08:22.883464+0000","last_unstale":"2023-07-14T13:08:22.885902+0000","last_undegraded":"2023-07-14T13:08:22.885902+0000","last_fullsized":"2023-07-14T13:08:22.885902+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:44:03.170860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.884122+0000","last_change":"2023-07-14T13:08:22.884122+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.884122+0000","last_undegraded":"2023-07-14T13:08:22.884122+0000","last_fullsized":"2023-07-14T13:08:22.884122+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.889935+0000","last_change":"2023-07-14T13:08:22.887027+0000","last_active":"2023-07-14T13:08:22.889935+0000","last_peered":"2023-07-14T13:08:22.889935+0000","last_clean":"2023-07-14T13:08:22.889935+0000","last_became_active":"2023-07-14T13:08:22.886683+0000","last_became_peered":"2023-07-14T13:08:22.886683+0000","last_unstale":"2023-07-14T13:08:22.889935+0000","last_undegraded":"2023-07-14T13:08:22.889935+0000","last_fullsized":"2023-07-14T13:08:22.889935+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:14:46.468529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.875343+0000","last_change":"2023-07-14T13:08:22.875343+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.875343+0000","last_undegraded":"2023-07-14T13:08:22.875343+0000","last_fullsized":"2023-07-14T13:08:22.875343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.897981+0000","last_change":"2023-07-14T13:08:22.896649+0000","last_active":"2023-07-14T13:08:22.897981+0000","last_peered":"2023-07-14T13:08:22.897981+0000","last_clean":"2023-07-14T13:08:22.897981+0000","last_became_active":"2023-07-14T13:08:22.896318+0000","last_became_peered":"2023-07-14T13:08:22.896318+0000","last_unstale":"2023-07-14T13:08:22.897981+0000","last_undegraded":"2023-07-14T13:08:22.897981+0000","last_fullsized":"2023-07-14T13:08:22.897981+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:05.261247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.873301+0000","last_change":"2023-07-14T13:08:22.873301+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.873301+0000","last_undegraded":"2023-07-14T13:08:22.873301+0000","last_fullsized":"2023-07-14T13:08:22.873301+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.900625+0000","last_change":"2023-07-14T13:08:22.899027+0000","last_active":"2023-07-14T13:08:22.900625+0000","last_peered":"2023-07-14T13:08:22.900625+0000","last_clean":"2023-07-14T13:08:22.900625+0000","last_became_active":"2023-07-14T13:08:22.898673+0000","last_became_peered":"2023-07-14T13:08:22.898673+0000","last_unstale":"2023-07-14T13:08:22.900625+0000","last_undegraded":"2023-07-14T13:08:22.900625+0000","last_fullsized":"2023-07-14T13:08:22.900625+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:23:31.869780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.874124+0000","last_change":"2023-07-14T13:08:22.874124+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.874124+0000","last_undegraded":"2023-07-14T13:08:22.874124+0000","last_fullsized":"2023-07-14T13:08:22.874124+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.893762+0000","last_change":"2023-07-14T13:08:22.889053+0000","last_active":"2023-07-14T13:08:22.893762+0000","last_peered":"2023-07-14T13:08:22.893762+0000","last_clean":"2023-07-14T13:08:22.893762+0000","last_became_active":"2023-07-14T13:08:22.888145+0000","last_became_peered":"2023-07-14T13:08:22.888145+0000","last_unstale":"2023-07-14T13:08:22.893762+0000","last_undegraded":"2023-07-14T13:08:22.893762+0000","last_fullsized":"2023-07-14T13:08:22.893762+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:01:01.654800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.880896+0000","last_change":"2023-07-14T13:08:22.880896+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.880896+0000","last_undegraded":"2023-07-14T13:08:22.880896+0000","last_fullsized":"2023-07-14T13:08:22.880896+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.900548+0000","last_change":"2023-07-14T13:08:22.898636+0000","last_active":"2023-07-14T13:08:22.900548+0000","last_peered":"2023-07-14T13:08:22.900548+0000","last_clean":"2023-07-14T13:08:22.900548+0000","last_became_active":"2023-07-14T13:08:22.898199+0000","last_became_peered":"2023-07-14T13:08:22.898199+0000","last_unstale":"2023-07-14T13:08:22.900548+0000","last_undegraded":"2023-07-14T13:08:22.900548+0000","last_fullsized":"2023-07-14T13:08:22.900548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:45:04.006207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.875703+0000","last_change":"2023-07-14T13:08:22.875703+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.875703+0000","last_undegraded":"2023-07-14T13:08:22.875703+0000","last_fullsized":"2023-07-14T13:08:22.875703+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.891087+0000","last_change":"2023-07-14T13:08:22.886746+0000","last_active":"2023-07-14T13:08:22.891087+0000","last_peered":"2023-07-14T13:08:22.891087+0000","last_clean":"2023-07-14T13:08:22.891087+0000","last_became_active":"2023-07-14T13:08:22.886234+0000","last_became_peered":"2023-07-14T13:08:22.886234+0000","last_unstale":"2023-07-14T13:08:22.891087+0000","last_undegraded":"2023-07-14T13:08:22.891087+0000","last_fullsized":"2023-07-14T13:08:22.891087+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:56:41.891811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.875703+0000","last_change":"2023-07-14T13:08:22.875703+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.875703+0000","last_undegraded":"2023-07-14T13:08:22.875703+0000","last_fullsized":"2023-07-14T13:08:22.875703+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.898473+0000","last_change":"2023-07-14T13:08:22.896327+0000","last_active":"2023-07-14T13:08:22.898473+0000","last_peered":"2023-07-14T13:08:22.898473+0000","last_clean":"2023-07-14T13:08:22.898473+0000","last_became_active":"2023-07-14T13:08:22.895999+0000","last_became_peered":"2023-07-14T13:08:22.895999+0000","last_unstale":"2023-07-14T13:08:22.898473+0000","last_undegraded":"2023-07-14T13:08:22.898473+0000","last_fullsized":"2023-07-14T13:08:22.898473+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:42:49.923663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.880817+0000","last_change":"2023-07-14T13:08:22.880817+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.880817+0000","last_undegraded":"2023-07-14T13:08:22.880817+0000","last_fullsized":"2023-07-14T13:08:22.880817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.896774+0000","last_change":"2023-07-14T13:08:22.894256+0000","last_active":"2023-07-14T13:08:22.896774+0000","last_peered":"2023-07-14T13:08:22.896774+0000","last_clean":"2023-07-14T13:08:22.896774+0000","last_became_active":"2023-07-14T13:08:22.893973+0000","last_became_peered":"2023-07-14T13:08:22.893973+0000","last_unstale":"2023-07-14T13:08:22.896774+0000","last_undegraded":"2023-07-14T13:08:22.896774+0000","last_fullsized":"2023-07-14T13:08:22.896774+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:53:09.427111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.883675+0000","last_change":"2023-07-14T13:08:22.883675+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.883675+0000","last_undegraded":"2023-07-14T13:08:22.883675+0000","last_fullsized":"2023-07-14T13:08:22.883675+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.899788+0000","last_change":"2023-07-14T13:08:22.897595+0000","last_active":"2023-07-14T13:08:22.899788+0000","last_peered":"2023-07-14T13:08:22.899788+0000","last_clean":"2023-07-14T13:08:22.899788+0000","last_became_active":"2023-07-14T13:08:22.896980+0000","last_became_peered":"2023-07-14T13:08:22.896980+0000","last_unstale":"2023-07-14T13:08:22.899788+0000","last_undegraded":"2023-07-14T13:08:22.899788+0000","last_fullsized":"2023-07-14T13:08:22.899788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:36:22.832887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.872577+0000","last_change":"2023-07-14T13:08:22.872577+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.872577+0000","last_undegraded":"2023-07-14T13:08:22.872577+0000","last_fullsized":"2023-07-14T13:08:22.872577+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.897560+0000","last_change":"2023-07-14T13:08:22.896567+0000","last_active":"2023-07-14T13:08:22.897560+0000","last_peered":"2023-07-14T13:08:22.897560+0000","last_clean":"2023-07-14T13:08:22.897560+0000","last_became_active":"2023-07-14T13:08:22.896244+0000","last_became_peered":"2023-07-14T13:08:22.896244+0000","last_unstale":"2023-07-14T13:08:22.897560+0000","last_undegraded":"2023-07-14T13:08:22.897560+0000","last_fullsized":"2023-07-14T13:08:22.897560+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:19:46.036377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.874264+0000","last_change":"2023-07-14T13:08:22.874264+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.874264+0000","last_undegraded":"2023-07-14T13:08:22.874264+0000","last_fullsized":"2023-07-14T13:08:22.874264+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.899711+0000","last_change":"2023-07-14T13:08:22.896731+0000","last_active":"2023-07-14T13:08:22.899711+0000","last_peered":"2023-07-14T13:08:22.899711+0000","last_clean":"2023-07-14T13:08:22.899711+0000","last_became_active":"2023-07-14T13:08:22.896451+0000","last_became_peered":"2023-07-14T13:08:22.896451+0000","last_unstale":"2023-07-14T13:08:22.899711+0000","last_undegraded":"2023-07-14T13:08:22.899711+0000","last_fullsized":"2023-07-14T13:08:22.899711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:52:59.408573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.877483+0000","last_change":"2023-07-14T13:08:22.877483+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.877483+0000","last_undegraded":"2023-07-14T13:08:22.877483+0000","last_fullsized":"2023-07-14T13:08:22.877483+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.891526+0000","last_change":"2023-07-14T13:08:22.888742+0000","last_active":"2023-07-14T13:08:22.891526+0000","last_peered":"2023-07-14T13:08:22.891526+0000","last_clean":"2023-07-14T13:08:22.891526+0000","last_became_active":"2023-07-14T13:08:22.888451+0000","last_became_peered":"2023-07-14T13:08:22.888451+0000","last_unstale":"2023-07-14T13:08:22.891526+0000","last_undegraded":"2023-07-14T13:08:22.891526+0000","last_fullsized":"2023-07-14T13:08:22.891526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:03.131223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.882704+0000","last_change":"2023-07-14T13:08:22.882704+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.882704+0000","last_undegraded":"2023-07-14T13:08:22.882704+0000","last_fullsized":"2023-07-14T13:08:22.882704+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.890154+0000","last_change":"2023-07-14T13:08:22.886480+0000","last_active":"2023-07-14T13:08:22.890154+0000","last_peered":"2023-07-14T13:08:22.890154+0000","last_clean":"2023-07-14T13:08:22.890154+0000","last_became_active":"2023-07-14T13:08:22.885968+0000","last_became_peered":"2023-07-14T13:08:22.885968+0000","last_unstale":"2023-07-14T13:08:22.890154+0000","last_undegraded":"2023-07-14T13:08:22.890154+0000","last_fullsized":"2023-07-14T13:08:22.890154+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:31:12.625405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.881843+0000","last_change":"2023-07-14T13:08:22.881843+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.881843+0000","last_undegraded":"2023-07-14T13:08:22.881843+0000","last_fullsized":"2023-07-14T13:08:22.881843+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.891064+0000","last_change":"2023-07-14T13:08:22.886524+0000","last_active":"2023-07-14T13:08:22.891064+0000","last_peered":"2023-07-14T13:08:22.891064+0000","last_clean":"2023-07-14T13:08:22.891064+0000","last_became_active":"2023-07-14T13:08:22.882894+0000","last_became_peered":"2023-07-14T13:08:22.882894+0000","last_unstale":"2023-07-14T13:08:22.891064+0000","last_undegraded":"2023-07-14T13:08:22.891064+0000","last_fullsized":"2023-07-14T13:08:22.891064+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:49:48.097803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.882574+0000","last_change":"2023-07-14T13:08:22.882574+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.882574+0000","last_undegraded":"2023-07-14T13:08:22.882574+0000","last_fullsized":"2023-07-14T13:08:22.882574+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.899796+0000","last_change":"2023-07-14T13:08:22.897266+0000","last_active":"2023-07-14T13:08:22.899796+0000","last_peered":"2023-07-14T13:08:22.899796+0000","last_clean":"2023-07-14T13:08:22.899796+0000","last_became_active":"2023-07-14T13:08:22.896932+0000","last_became_peered":"2023-07-14T13:08:22.896932+0000","last_unstale":"2023-07-14T13:08:22.899796+0000","last_undegraded":"2023-07-14T13:08:22.899796+0000","last_fullsized":"2023-07-14T13:08:22.899796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:11:15.706077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.875833+0000","last_change":"2023-07-14T13:08:22.875833+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.875833+0000","last_undegraded":"2023-07-14T13:08:22.875833+0000","last_fullsized":"2023-07-14T13:08:22.875833+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.887064+0000","last_change":"2023-07-14T13:08:22.884847+0000","last_active":"2023-07-14T13:08:22.887064+0000","last_peered":"2023-07-14T13:08:22.887064+0000","last_clean":"2023-07-14T13:08:22.887064+0000","last_became_active":"2023-07-14T13:08:22.884442+0000","last_became_peered":"2023-07-14T13:08:22.884442+0000","last_unstale":"2023-07-14T13:08:22.887064+0000","last_undegraded":"2023-07-14T13:08:22.887064+0000","last_fullsized":"2023-07-14T13:08:22.887064+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:41:36.689812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.872492+0000","last_change":"2023-07-14T13:08:22.872492+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.872492+0000","last_undegraded":"2023-07-14T13:08:22.872492+0000","last_fullsized":"2023-07-14T13:08:22.872492+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.893415+0000","last_change":"2023-07-14T13:08:22.890676+0000","last_active":"2023-07-14T13:08:22.893415+0000","last_peered":"2023-07-14T13:08:22.893415+0000","last_clean":"2023-07-14T13:08:22.893415+0000","last_became_active":"2023-07-14T13:08:22.890323+0000","last_became_peered":"2023-07-14T13:08:22.890323+0000","last_unstale":"2023-07-14T13:08:22.893415+0000","last_undegraded":"2023-07-14T13:08:22.893415+0000","last_fullsized":"2023-07-14T13:08:22.893415+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:54:57.718294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.878334+0000","last_change":"2023-07-14T13:08:22.878334+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.878334+0000","last_undegraded":"2023-07-14T13:08:22.878334+0000","last_fullsized":"2023-07-14T13:08:22.878334+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.891352+0000","last_change":"2023-07-14T13:08:22.888081+0000","last_active":"2023-07-14T13:08:22.891352+0000","last_peered":"2023-07-14T13:08:22.891352+0000","last_clean":"2023-07-14T13:08:22.891352+0000","last_became_active":"2023-07-14T13:08:22.887733+0000","last_became_peered":"2023-07-14T13:08:22.887733+0000","last_unstale":"2023-07-14T13:08:22.891352+0000","last_undegraded":"2023-07-14T13:08:22.891352+0000","last_fullsized":"2023-07-14T13:08:22.891352+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:54:57.718294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.881449+0000","last_change":"2023-07-14T13:08:22.881449+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.881449+0000","last_undegraded":"2023-07-14T13:08:22.881449+0000","last_fullsized":"2023-07-14T13:08:22.881449+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.887343+0000","last_change":"2023-07-14T13:08:22.885339+0000","last_active":"2023-07-14T13:08:22.887343+0000","last_peered":"2023-07-14T13:08:22.887343+0000","last_clean":"2023-07-14T13:08:22.887343+0000","last_became_active":"2023-07-14T13:08:22.885052+0000","last_became_peered":"2023-07-14T13:08:22.885052+0000","last_unstale":"2023-07-14T13:08:22.887343+0000","last_undegraded":"2023-07-14T13:08:22.887343+0000","last_fullsized":"2023-07-14T13:08:22.887343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:02:58.361007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"70'161","reported_seq":440,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.889580+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:08:22.889580+0000","last_peered":"2023-07-14T13:08:22.889580+0000","last_clean":"2023-07-14T13:08:22.889580+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:08:22.889580+0000","last_undegraded":"2023-07-14T13:08:22.889580+0000","last_fullsized":"2023-07-14T13:08:22.889580+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:12:39.945742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.886927+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:08:22.886927+0000","last_peered":"2023-07-14T13:08:22.886927+0000","last_clean":"2023-07-14T13:08:22.886927+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:08:22.886927+0000","last_undegraded":"2023-07-14T13:08:22.886927+0000","last_fullsized":"2023-07-14T13:08:22.886927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:35:06.179987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.873769+0000","last_change":"2023-07-14T13:08:22.873769+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.873769+0000","last_undegraded":"2023-07-14T13:08:22.873769+0000","last_fullsized":"2023-07-14T13:08:22.873769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.893610+0000","last_change":"2023-07-14T13:08:22.888358+0000","last_active":"2023-07-14T13:08:22.893610+0000","last_peered":"2023-07-14T13:08:22.893610+0000","last_clean":"2023-07-14T13:08:22.893610+0000","last_became_active":"2023-07-14T13:08:22.888086+0000","last_became_peered":"2023-07-14T13:08:22.888086+0000","last_unstale":"2023-07-14T13:08:22.893610+0000","last_undegraded":"2023-07-14T13:08:22.893610+0000","last_fullsized":"2023-07-14T13:08:22.893610+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:23:27.051257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.889371+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:08:22.889371+0000","last_peered":"2023-07-14T13:08:22.889371+0000","last_clean":"2023-07-14T13:08:22.889371+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:08:22.889371+0000","last_undegraded":"2023-07-14T13:08:22.889371+0000","last_fullsized":"2023-07-14T13:08:22.889371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:55:41.263847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.880317+0000","last_change":"2023-07-14T13:08:22.880317+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.880317+0000","last_undegraded":"2023-07-14T13:08:22.880317+0000","last_fullsized":"2023-07-14T13:08:22.880317+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.896794+0000","last_change":"2023-07-14T13:08:22.894336+0000","last_active":"2023-07-14T13:08:22.896794+0000","last_peered":"2023-07-14T13:08:22.896794+0000","last_clean":"2023-07-14T13:08:22.896794+0000","last_became_active":"2023-07-14T13:08:22.894049+0000","last_became_peered":"2023-07-14T13:08:22.894049+0000","last_unstale":"2023-07-14T13:08:22.896794+0000","last_undegraded":"2023-07-14T13:08:22.896794+0000","last_fullsized":"2023-07-14T13:08:22.896794+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:24:57.826152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":124,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.878743+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:08:22.878743+0000","last_peered":"2023-07-14T13:08:22.878743+0000","last_clean":"2023-07-14T13:08:22.878743+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:08:22.878743+0000","last_undegraded":"2023-07-14T13:08:22.878743+0000","last_fullsized":"2023-07-14T13:08:22.878743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:25:57.748881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.879882+0000","last_change":"2023-07-14T13:08:22.879882+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.879882+0000","last_undegraded":"2023-07-14T13:08:22.879882+0000","last_fullsized":"2023-07-14T13:08:22.879882+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.893609+0000","last_change":"2023-07-14T13:08:22.888384+0000","last_active":"2023-07-14T13:08:22.893609+0000","last_peered":"2023-07-14T13:08:22.893609+0000","last_clean":"2023-07-14T13:08:22.893609+0000","last_became_active":"2023-07-14T13:08:22.888062+0000","last_became_peered":"2023-07-14T13:08:22.888062+0000","last_unstale":"2023-07-14T13:08:22.893609+0000","last_undegraded":"2023-07-14T13:08:22.893609+0000","last_fullsized":"2023-07-14T13:08:22.893609+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:48:33.099003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.887019+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:08:22.887019+0000","last_peered":"2023-07-14T13:08:22.887019+0000","last_clean":"2023-07-14T13:08:22.887019+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:08:22.887019+0000","last_undegraded":"2023-07-14T13:08:22.887019+0000","last_fullsized":"2023-07-14T13:08:22.887019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:51:45.137826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.880578+0000","last_change":"2023-07-14T13:08:22.880578+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.880578+0000","last_undegraded":"2023-07-14T13:08:22.880578+0000","last_fullsized":"2023-07-14T13:08:22.880578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.898248+0000","last_change":"2023-07-14T13:08:22.895241+0000","last_active":"2023-07-14T13:08:22.898248+0000","last_peered":"2023-07-14T13:08:22.898248+0000","last_clean":"2023-07-14T13:08:22.898248+0000","last_became_active":"2023-07-14T13:08:22.894924+0000","last_became_peered":"2023-07-14T13:08:22.894924+0000","last_unstale":"2023-07-14T13:08:22.898248+0000","last_undegraded":"2023-07-14T13:08:22.898248+0000","last_fullsized":"2023-07-14T13:08:22.898248+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:35:50.435128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.870905+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:08:22.870905+0000","last_peered":"2023-07-14T13:08:22.870905+0000","last_clean":"2023-07-14T13:08:22.870905+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:08:22.870905+0000","last_undegraded":"2023-07-14T13:08:22.870905+0000","last_fullsized":"2023-07-14T13:08:22.870905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:50.832212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.879839+0000","last_change":"2023-07-14T13:08:22.879839+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.879839+0000","last_undegraded":"2023-07-14T13:08:22.879839+0000","last_fullsized":"2023-07-14T13:08:22.879839+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.900585+0000","last_change":"2023-07-14T13:08:22.898695+0000","last_active":"2023-07-14T13:08:22.900585+0000","last_peered":"2023-07-14T13:08:22.900585+0000","last_clean":"2023-07-14T13:08:22.900585+0000","last_became_active":"2023-07-14T13:08:22.898408+0000","last_became_peered":"2023-07-14T13:08:22.898408+0000","last_unstale":"2023-07-14T13:08:22.900585+0000","last_undegraded":"2023-07-14T13:08:22.900585+0000","last_fullsized":"2023-07-14T13:08:22.900585+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:29:41.565522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.891224+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:08:22.891224+0000","last_peered":"2023-07-14T13:08:22.891224+0000","last_clean":"2023-07-14T13:08:22.891224+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:08:22.891224+0000","last_undegraded":"2023-07-14T13:08:22.891224+0000","last_fullsized":"2023-07-14T13:08:22.891224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:11:22.279127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.876091+0000","last_change":"2023-07-14T13:08:22.876091+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.876091+0000","last_undegraded":"2023-07-14T13:08:22.876091+0000","last_fullsized":"2023-07-14T13:08:22.876091+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.900629+0000","last_change":"2023-07-14T13:08:22.899305+0000","last_active":"2023-07-14T13:08:22.900629+0000","last_peered":"2023-07-14T13:08:22.900629+0000","last_clean":"2023-07-14T13:08:22.900629+0000","last_became_active":"2023-07-14T13:08:22.898996+0000","last_became_peered":"2023-07-14T13:08:22.898996+0000","last_unstale":"2023-07-14T13:08:22.900629+0000","last_undegraded":"2023-07-14T13:08:22.900629+0000","last_fullsized":"2023-07-14T13:08:22.900629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:56:03.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.870478+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:08:22.870478+0000","last_peered":"2023-07-14T13:08:22.870478+0000","last_clean":"2023-07-14T13:08:22.870478+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:08:22.870478+0000","last_undegraded":"2023-07-14T13:08:22.870478+0000","last_fullsized":"2023-07-14T13:08:22.870478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:28:21.335135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.881311+0000","last_change":"2023-07-14T13:08:22.881311+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.881311+0000","last_undegraded":"2023-07-14T13:08:22.881311+0000","last_fullsized":"2023-07-14T13:08:22.881311+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.887032+0000","last_change":"2023-07-14T13:08:22.885480+0000","last_active":"2023-07-14T13:08:22.887032+0000","last_peered":"2023-07-14T13:08:22.887032+0000","last_clean":"2023-07-14T13:08:22.887032+0000","last_became_active":"2023-07-14T13:08:22.885180+0000","last_became_peered":"2023-07-14T13:08:22.885180+0000","last_unstale":"2023-07-14T13:08:22.887032+0000","last_undegraded":"2023-07-14T13:08:22.887032+0000","last_fullsized":"2023-07-14T13:08:22.887032+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:48:30.643508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.890458+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:08:22.890458+0000","last_peered":"2023-07-14T13:08:22.890458+0000","last_clean":"2023-07-14T13:08:22.890458+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:08:22.890458+0000","last_undegraded":"2023-07-14T13:08:22.890458+0000","last_fullsized":"2023-07-14T13:08:22.890458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:01.711854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575038,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54716,"kb_used_data":1524,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317124,"statfs":{"total":96636764160,"available":96580734976,"internally_reserved":0,"allocated":1560576,"data_stored":1072049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.51500000000000001,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.98299999999999998,"5min":0.98399999999999999,"15min":1.879},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.56799999999999995,"5min":0.44,"15min":0.439},"max":{"1min":1.054,"5min":1.054,"15min":1.9059999999999999},"last":0.627}]},{"osd":1,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73899999999999999,"15min":0.73599999999999999},"min":{"1min":0.504,"5min":0.434,"15min":0.42999999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.069},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.749,"15min":0.746},"min":{"1min":0.54400000000000004,"5min":0.48999999999999999,"15min":0.40500000000000003},"max":{"1min":0.93999999999999995,"5min":0.97399999999999998,"15min":1.1020000000000001},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73899999999999999,"15min":0.72799999999999998},"min":{"1min":0.52700000000000002,"5min":0.46999999999999997,"15min":0.40600000000000003},"max":{"1min":0.88100000000000001,"5min":0.98899999999999999,"15min":1.048},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.747,"15min":0.752},"min":{"1min":0.47499999999999998,"5min":0.47199999999999998,"15min":0.46899999999999997},"max":{"1min":0.91300000000000003,"5min":0.97099999999999997,"15min":1.0169999999999999},"last":0.76000000000000001}]},{"osd":3,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.746,"15min":0.73399999999999999},"min":{"1min":0.59399999999999997,"5min":0.503,"15min":0.442},"max":{"1min":0.88400000000000001,"5min":1.0269999999999999,"15min":1.0760000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.755,"15min":0.75700000000000001},"min":{"1min":0.60199999999999998,"5min":0.47299999999999998,"15min":0.41499999999999998},"max":{"1min":0.91600000000000004,"5min":1.018,"15min":1.024},"last":0.80400000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.44400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.82099999999999995,"5min":1.0009999999999999,"15min":1.022},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.41799999999999998,"5min":0.40999999999999998,"15min":0.39300000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.82599999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59699999999999998,"15min":0.60599999999999998},"min":{"1min":0.39300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.0249999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63400000000000001,"15min":0.65600000000000003},"min":{"1min":0.41999999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.77700000000000002}]},{"osd":6,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68400000000000005,"15min":0.70099999999999996},"min":{"1min":0.45200000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.99299999999999999,"5min":1.0489999999999999,"15min":1.4419999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.67600000000000005},"min":{"1min":0.46999999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81200000000000006,"5min":0.95799999999999996,"15min":1.575},"last":0.79400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575039,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":966656,"data_stored":481681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.57799999999999996,"5min":0.38,"15min":0.38},"max":{"1min":0.90400000000000003,"5min":0.996,"15min":1.2749999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.72499999999999998,"15min":0.74199999999999999},"min":{"1min":0.53600000000000003,"5min":0.48199999999999998,"15min":0.47399999999999998},"max":{"1min":0.98199999999999998,"5min":1.0800000000000001,"15min":1.2110000000000001},"last":0.69799999999999995}]},{"osd":1,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73599999999999999,"15min":0.752},"min":{"1min":0.48299999999999998,"5min":0.47399999999999998,"15min":0.379},"max":{"1min":0.90900000000000003,"5min":1.0089999999999999,"15min":1.4299999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70799999999999996,"15min":0.72599999999999998},"min":{"1min":0.56999999999999995,"5min":0.46999999999999997,"15min":0.44},"max":{"1min":0.86899999999999999,"5min":0.97099999999999997,"15min":1.1379999999999999},"last":0.71699999999999997}]},{"osd":2,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.73899999999999999,"15min":0.754},"min":{"1min":0.55800000000000005,"5min":0.45900000000000002,"15min":0.40400000000000003},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":1.319},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.755,"15min":0.75600000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.42299999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.341},"last":0.56599999999999995}]},{"osd":3,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76000000000000001,"15min":0.78100000000000003},"min":{"1min":0.51000000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.054,"5min":1.054,"15min":1.3859999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.52400000000000002,"5min":0.48399999999999999,"15min":0.45900000000000002},"max":{"1min":0.94799999999999995,"5min":0.99099999999999999,"15min":1.1080000000000001},"last":0.58199999999999996}]},{"osd":4,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.97899999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.624,"15min":0.63900000000000001},"min":{"1min":0.47399999999999998,"5min":0.38500000000000001,"15min":0.36099999999999999},"max":{"1min":0.93500000000000005,"5min":1.012,"15min":1.091},"last":0.51200000000000001}]},{"osd":5,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64100000000000001,"15min":0.64700000000000002},"min":{"1min":0.499,"5min":0.37,"15min":0.37},"max":{"1min":0.96599999999999997,"5min":1.579,"15min":1.579},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67800000000000005,"15min":0.69399999999999995},"min":{"1min":0.46700000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.145},"last":0.621}]},{"osd":7,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.438,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.208},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.499,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0209999999999999,"5min":1.657,"15min":1.657},"last":0.60399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575038,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":978944,"data_stored":488301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.72999999999999998,"15min":0.73599999999999999},"min":{"1min":0.60999999999999999,"5min":0.36499999999999999,"15min":0.32400000000000001},"max":{"1min":0.90200000000000002,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.70799999999999996,"15min":0.73899999999999999},"min":{"1min":0.52500000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.625}]},{"osd":1,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71799999999999997,"15min":0.73099999999999998},"min":{"1min":0.56399999999999995,"5min":0.44500000000000001,"15min":0.41099999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.335},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.745,"15min":0.752},"min":{"1min":0.60299999999999998,"5min":0.48699999999999999,"15min":0.36799999999999999},"max":{"1min":0.94499999999999995,"5min":2.706,"15min":2.706},"last":0.53900000000000003}]},{"osd":2,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72399999999999998,"15min":0.74399999999999999},"min":{"1min":0.59499999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.212,"5min":1.212,"15min":1.298},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.71899999999999997,"15min":0.73999999999999999},"min":{"1min":0.53800000000000003,"5min":0.433,"15min":0.433},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.73499999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.75,"15min":0.751},"min":{"1min":0.60599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.90900000000000003,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.57999999999999996,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.55300000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.45700000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68000000000000005,"15min":0.68899999999999995},"min":{"1min":0.443,"5min":0.36299999999999999,"15min":0.35899999999999999},"max":{"1min":0.86799999999999999,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.69899999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60199999999999998,"15min":0.62},"min":{"1min":0.41699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63900000000000001,"15min":0.64600000000000002},"min":{"1min":0.496,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.83699999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66000000000000003,"15min":0.64900000000000002},"min":{"1min":0.48899999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.026,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.46600000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.2589999999999999,"5min":1.407,"15min":1.407},"last":0.79000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575038,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":978944,"data_stored":488301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.73999999999999999,"15min":0.73499999999999999},"min":{"1min":0.56200000000000006,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92400000000000004,"5min":1.411,"15min":1.411},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.76800000000000002,"15min":0.73199999999999998},"min":{"1min":0.64000000000000001,"5min":0.45800000000000002,"15min":0.435},"max":{"1min":0.94599999999999995,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.73999999999999999}]},{"osd":1,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77000000000000002,"15min":0.751},"min":{"1min":0.62,"5min":0.47999999999999998,"15min":0.442},"max":{"1min":0.90700000000000003,"5min":1.077,"15min":1.077},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.54600000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91900000000000004,"5min":1.0469999999999999,"15min":1.2370000000000001},"last":0.55900000000000005}]},{"osd":2,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.749,"15min":0.73599999999999999},"min":{"1min":0.60799999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.95599999999999996,"5min":1.091,"15min":1.091},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79800000000000004,"15min":0.77600000000000002},"min":{"1min":0.60399999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98199999999999998,"5min":1.387,"15min":1.387},"last":0.84099999999999997}]},{"osd":3,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75,"15min":0.748},"min":{"1min":0.58099999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84799999999999998,"5min":1.008,"15min":1.099},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77500000000000002,"15min":0.77300000000000002},"min":{"1min":0.64700000000000002,"5min":0.496,"15min":0.46800000000000003},"max":{"1min":0.98699999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.69199999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.61699999999999999,"15min":0.60499999999999998},"min":{"1min":0.437,"5min":0.378,"15min":0.378},"max":{"1min":0.76400000000000001,"5min":0.95599999999999996,"15min":1.0029999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.627,"15min":0.61799999999999999},"min":{"1min":0.52400000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85799999999999998,"5min":0.93600000000000005,"15min":0.95199999999999996},"last":0.47899999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.621,"15min":0.62},"min":{"1min":0.48699999999999999,"5min":0.38900000000000001,"15min":0.32300000000000001},"max":{"1min":0.873,"5min":1.014,"15min":1.014},"last":0.443},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.51900000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.94599999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.625}]},{"osd":7,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.68200000000000005,"15min":0.67100000000000004},"min":{"1min":0.57199999999999995,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93200000000000005,"5min":0.94699999999999995,"15min":1.0349999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.55800000000000005,"5min":0.40300000000000002,"15min":0.36899999999999999},"max":{"1min":0.96899999999999997,"5min":1.0629999999999999,"15min":1.1080000000000001},"last":0.64700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575038,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36100,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335740,"statfs":{"total":96636764160,"available":96599797760,"internally_reserved":0,"allocated":978944,"data_stored":488301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.44900000000000001,"15min":0.44600000000000001},"min":{"1min":0.32300000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.70099999999999996,"5min":0.755,"15min":0.84199999999999997},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.309},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":1.577},"last":0.35599999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47699999999999998,"15min":0.47799999999999998},"min":{"1min":0.33100000000000002,"5min":0.315,"15min":0.29199999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.88200000000000001},"last":0.38},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54900000000000004,"15min":0.54300000000000004},"min":{"1min":0.438,"5min":0.35899999999999999,"15min":0.32600000000000001},"max":{"1min":0.71399999999999997,"5min":1.0029999999999999,"15min":1.113},"last":0.33000000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55600000000000005,"15min":0.57199999999999995},"min":{"1min":0.40999999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.82599999999999996,"5min":0.88400000000000001,"15min":1.0820000000000001},"last":0.433},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.60399999999999998},"min":{"1min":0.436,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.747,"5min":1.663,"15min":1.663},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.76800000000000002,"15min":0.76900000000000002},"min":{"1min":0.60499999999999998,"5min":0.47899999999999998,"15min":0.439},"max":{"1min":1.018,"5min":1.284,"15min":1.627},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.61699999999999999,"5min":0.56399999999999995,"15min":0.47699999999999998},"max":{"1min":1.0469999999999999,"5min":1.121,"15min":1.214},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.79800000000000004,"15min":0.79900000000000004},"min":{"1min":0.65700000000000003,"5min":0.58499999999999996,"15min":0.52400000000000002},"max":{"1min":0.997,"5min":1.306,"15min":1.333},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.55000000000000004,"5min":0.372,"15min":0.372},"max":{"1min":0.98899999999999999,"5min":1.1870000000000001,"15min":1.2470000000000001},"last":0.61699999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77700000000000002,"15min":0.78600000000000003},"min":{"1min":0.60399999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.99199999999999999,"5min":1.105,"15min":1.526},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.81699999999999995,"15min":0.82199999999999995},"min":{"1min":0.59199999999999997,"5min":0.54200000000000004,"15min":0.505},"max":{"1min":1.0109999999999999,"5min":1.2589999999999999,"15min":1.381},"last":0.69799999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.85799999999999998,"15min":0.84799999999999998},"min":{"1min":0.66400000000000003,"5min":0.55800000000000005,"15min":0.53100000000000003},"max":{"1min":1.0349999999999999,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.83799999999999997,"15min":0.83699999999999997},"min":{"1min":0.63,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.026,"5min":1.595,"15min":1.6910000000000001},"last":0.63500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575038,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58240,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313600,"statfs":{"total":96636764160,"available":96577126400,"internally_reserved":0,"allocated":974848,"data_stored":487282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.32100000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64500000000000002,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55500000000000005,"15min":0.54100000000000004},"min":{"1min":0.34100000000000003,"5min":0.32900000000000001,"15min":0.28999999999999998},"max":{"1min":0.80800000000000005,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.50700000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48599999999999999,"15min":0.47599999999999998},"min":{"1min":0.38,"5min":0.29999999999999999,"15min":0.27500000000000002},"max":{"1min":0.71599999999999997,"5min":2.7200000000000002,"15min":2.7200000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.40899999999999997,"5min":0.35999999999999999,"15min":0.33000000000000002},"max":{"1min":0.77900000000000003,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":0.55500000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.66200000000000003,"15min":0.60699999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72099999999999997,"5min":8.2530000000000001,"15min":8.2530000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.55400000000000005},"min":{"1min":0.40300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77200000000000002,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.47299999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76800000000000002,"15min":0.78300000000000003},"min":{"1min":0.61599999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.95199999999999996,"5min":1.0940000000000001,"15min":1.3049999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78500000000000003,"15min":0.80100000000000005},"min":{"1min":0.58199999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.006,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.91800000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.86299999999999999,"15min":0.86599999999999999},"min":{"1min":0.64600000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0640000000000001,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.84299999999999997,"15min":0.84399999999999997},"min":{"1min":0.57799999999999996,"5min":0.55600000000000005,"15min":0.433},"max":{"1min":1.081,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.93899999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.81100000000000005,"15min":0.80700000000000005},"min":{"1min":0.60399999999999998,"5min":0.48999999999999999,"15min":0.47599999999999998},"max":{"1min":0.99099999999999999,"5min":3.9849999999999999,"15min":3.9849999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82199999999999995,"15min":0.81699999999999995},"min":{"1min":0.64600000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98499999999999999,"5min":3.391,"15min":3.391},"last":0.69099999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.81799999999999995,"15min":0.82799999999999996},"min":{"1min":0.61099999999999999,"5min":0.5,"15min":0.5},"max":{"1min":1.022,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.87},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83399999999999996,"15min":0.82599999999999996},"min":{"1min":0.66900000000000004,"5min":0.53200000000000003,"15min":0.50900000000000001},"max":{"1min":1.0069999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.77100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575039,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36100,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335740,"statfs":{"total":96636764160,"available":96599797760,"internally_reserved":0,"allocated":978944,"data_stored":488301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.439,"15min":0.43099999999999999},"min":{"1min":0.317,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.65400000000000003,"5min":0.67200000000000004,"15min":0.77200000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.51800000000000002,"15min":0.504},"min":{"1min":0.34799999999999998,"5min":0.28199999999999997,"15min":0.26500000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47599999999999998,"15min":0.47199999999999998},"min":{"1min":0.34599999999999997,"5min":0.32100000000000001,"15min":0.29499999999999998},"max":{"1min":0.67900000000000005,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.38200000000000001,"5min":0.30599999999999999,"15min":0.29299999999999998},"max":{"1min":0.74399999999999999,"5min":1.014,"15min":1.014},"last":0.505}]},{"osd":3,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.55100000000000005,"5min":0.44700000000000001,"15min":0.432},"max":{"1min":0.80300000000000005,"5min":0.86899999999999999,"15min":0.96299999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.57999999999999996},"min":{"1min":0.46200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.80300000000000005,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.54600000000000004}]},{"osd":4,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.79300000000000004,"15min":0.78400000000000003},"min":{"1min":0.61299999999999999,"5min":0.51300000000000001,"15min":0.40000000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.236},"last":0.997},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.77800000000000002,"15min":0.78500000000000003},"min":{"1min":0.54900000000000004,"5min":0.502,"15min":0.45700000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.93799999999999994}]},{"osd":5,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.67900000000000005,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":1.1000000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.81200000000000006,"15min":0.80400000000000005},"min":{"1min":0.56999999999999995,"5min":0.48599999999999999,"15min":0.48199999999999998},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.3600000000000001},"last":0.85899999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.80000000000000004,"15min":0.80200000000000005},"min":{"1min":0.58299999999999996,"5min":0.503,"15min":0.48499999999999999},"max":{"1min":1.1120000000000001,"5min":1.2170000000000001,"15min":1.274},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.82899999999999996,"15min":0.81799999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.49199999999999999},"max":{"1min":1.1319999999999999,"5min":1.262,"15min":1.2969999999999999},"last":1.044}]},{"osd":7,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.79700000000000004},"min":{"1min":0.62,"5min":0.55200000000000005,"15min":0.47799999999999998},"max":{"1min":1.1579999999999999,"5min":1.1859999999999999,"15min":1.3400000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.87,"5min":0.84599999999999997,"15min":0.84199999999999997},"min":{"1min":0.60799999999999998,"5min":0.53700000000000003,"15min":0.52800000000000002},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.0820000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575040,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36664,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335176,"statfs":{"total":96636764160,"available":96599220224,"internally_reserved":0,"allocated":1556480,"data_stored":1071030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47099999999999997,"15min":0.45300000000000001},"min":{"1min":0.30199999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.76500000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.33000000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":1.452},"last":0.47499999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53800000000000003,"15min":0.52000000000000002},"min":{"1min":0.39800000000000002,"5min":0.35799999999999998,"15min":0.34100000000000003},"max":{"1min":0.84499999999999997,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.376,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71699999999999997,"5min":0.80300000000000005,"15min":1.5700000000000001},"last":0.58499999999999996}]},{"osd":3,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.499,"15min":0.50700000000000001},"min":{"1min":0.432,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.99299999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77100000000000002,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.82899999999999996}]},{"osd":4,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.79900000000000004,"15min":0.79000000000000004},"min":{"1min":0.55200000000000005,"5min":0.48399999999999999,"15min":0.44400000000000001},"max":{"1min":1.21,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81999999999999995,"15min":0.81100000000000005},"min":{"1min":0.57999999999999996,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.03,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.88600000000000001}]},{"osd":5,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81000000000000005,"15min":0.81100000000000005},"min":{"1min":0.56999999999999995,"5min":0.51800000000000002,"15min":0.47899999999999998},"max":{"1min":1.042,"5min":1.3839999999999999,"15min":1.4950000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.80000000000000004,"15min":0.80100000000000005},"min":{"1min":0.621,"5min":0.49299999999999999,"15min":0.47299999999999998},"max":{"1min":1.069,"5min":1.325,"15min":1.325},"last":0.84999999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.82299999999999995,"15min":0.81399999999999995},"min":{"1min":0.58699999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.05,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.63900000000000001,"5min":0.50600000000000001,"15min":0.41299999999999998},"max":{"1min":1.044,"5min":1.3440000000000001,"15min":1.5369999999999999},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.82899999999999996,"15min":0.83799999999999997},"min":{"1min":0.60599999999999998,"5min":0.503,"15min":0.45500000000000002},"max":{"1min":1.1180000000000001,"5min":1.2749999999999999,"15min":1.603},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.80500000000000005,"15min":0.81799999999999995},"min":{"1min":0.65100000000000002,"5min":0.502,"15min":0.497},"max":{"1min":1.0880000000000001,"5min":1.381,"15min":1.381},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:08:28.424 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:08:28.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.568+0000 7f36e1f74640 1 Processor -- start 2023-07-14T13:08:28.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.568+0000 7f36e1f74640 1 -- start start 2023-07-14T13:08:28.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.568+0000 7f36e1f74640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f36dc15fd60 0x7f36dc0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:28.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.568+0000 7f36e1f74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36dc0d1850 0x7f36dc0d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:28.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.572+0000 7f36e1f74640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36dc0ccaf0 con 0x7f36dc0b7c70 2023-07-14T13:08:28.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.572+0000 7f36e1f74640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36dc0d1190 con 0x7f36dc15fd60 2023-07-14T13:08:28.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.572+0000 7f36e1f74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36dc160600 con 0x7f36dc0d1850 2023-07-14T13:08:28.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.572+0000 7f36db7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f36dc0b7c70 0x7f36dc15f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58116/0 (socket says 172.21.15.5:58116) 2023-07-14T13:08:28.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.572+0000 7f36db7fe640 1 -- 172.21.15.5:0/2911901308 learned_addr learned my addr 172.21.15.5:0/2911901308 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:28.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.572+0000 7f36daffd640 1 --2- 172.21.15.5:0/2911901308 >> v2:172.21.15.5:3300/0 conn(0x7f36dc15fd60 0x7f36dc0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:28.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.572+0000 7f36dbfff640 1 --2- 172.21.15.5:0/2911901308 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36dc0d1850 0x7f36dc0d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:28.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.572+0000 7f36da7fc640 1 -- 172.21.15.5:0/2911901308 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011395843 0 0) 0x7f36dc0ccaf0 con 0x7f36dc0b7c70 2023-07-14T13:08:28.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.572+0000 7f36da7fc640 1 -- 172.21.15.5:0/2911901308 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36c4003530 con 0x7f36dc0b7c70 2023-07-14T13:08:28.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.572+0000 7f36daffd640 1 -- 172.21.15.5:0/2911901308 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36dc0d1850 msgr2=0x7f36dc0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:28.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.572+0000 7f36daffd640 1 --2- 172.21.15.5:0/2911901308 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36dc0d1850 0x7f36dc0d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:28.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.572+0000 7f36daffd640 1 -- 172.21.15.5:0/2911901308 >> v1:172.21.15.5:6789/0 conn(0x7f36dc0b7c70 legacy=0x7f36dc15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:28.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.572+0000 7f36daffd640 1 -- 172.21.15.5:0/2911901308 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36dc160320 con 0x7f36dc15fd60 2023-07-14T13:08:28.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.572+0000 7f36daffd640 1 --2- 172.21.15.5:0/2911901308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36dc15fd60 0x7f36dc0d0c50 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f36d00097c0 tx=0x7f36d001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06282a06554a603 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:28.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.572+0000 7f36da7fc640 1 -- 172.21.15.5:0/2911901308 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d00ab670 con 0x7f36dc15fd60 2023-07-14T13:08:28.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.572+0000 7f36da7fc640 1 -- 172.21.15.5:0/2911901308 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d00ab7d0 con 0x7f36dc15fd60 2023-07-14T13:08:28.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.572+0000 7f36da7fc640 1 -- 172.21.15.5:0/2911901308 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d00abb60 con 0x7f36dc15fd60 2023-07-14T13:08:28.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.576+0000 7f36e1f74640 1 -- 172.21.15.5:0/2911901308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36dc15fd60 msgr2=0x7f36dc0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:28.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.576+0000 7f36e1f74640 1 --2- 172.21.15.5:0/2911901308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36dc15fd60 0x7f36dc0d0c50 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f36d00097c0 tx=0x7f36d001c450 comp rx=0 tx=0).stop 2023-07-14T13:08:28.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.576+0000 7f36e1f74640 1 -- 172.21.15.5:0/2911901308 shutdown_connections 2023-07-14T13:08:28.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.576+0000 7f36e1f74640 1 --2- 172.21.15.5:0/2911901308 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36dc0d1850 0x7f36dc0d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:28.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.576+0000 7f36e1f74640 1 --2- 172.21.15.5:0/2911901308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36dc15fd60 0x7f36dc0d0c50 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:28.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.576+0000 7f36e1f74640 1 -- 172.21.15.5:0/2911901308 >> 172.21.15.5:0/2911901308 conn(0x7f36dc0650b0 msgr2=0x7f36dc0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:28.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.576+0000 7f36e1f74640 1 -- 172.21.15.5:0/2911901308 shutdown_connections 2023-07-14T13:08:28.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.576+0000 7f36e1f74640 1 -- 172.21.15.5:0/2911901308 wait complete. 2023-07-14T13:08:28.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.576+0000 7f36e1f74640 1 Processor -- start 2023-07-14T13:08:28.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.576+0000 7f36e1f74640 1 -- start start 2023-07-14T13:08:28.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.576+0000 7f36e1f74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36dc0b7c70 0x7f36dc0c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:28.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.576+0000 7f36e1f74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36dc0d1850 0x7f36dc0c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:28.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.576+0000 7f36e1f74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36dc15fd60 0x7f36dc0c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:28.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.576+0000 7f36e1f74640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36dc15c6b0 con 0x7f36dc0d1850 2023-07-14T13:08:28.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.576+0000 7f36e1f74640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36dc15efe0 con 0x7f36dc0b7c70 2023-07-14T13:08:28.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.576+0000 7f36e1f74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36dc0c6370 con 0x7f36dc15fd60 2023-07-14T13:08:28.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.576+0000 7f36daffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36dc0d1850 0x7f36dc0c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:28.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.576+0000 7f36daffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36dc0d1850 0x7f36dc0c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38758/0 (socket says 172.21.15.5:38758) 2023-07-14T13:08:28.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.576+0000 7f36daffd640 1 -- 172.21.15.5:0/3693285632 learned_addr learned my addr 172.21.15.5:0/3693285632 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:28.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.580+0000 7f36db7fe640 1 --2- 172.21.15.5:0/3693285632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36dc0b7c70 0x7f36dc0c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:28.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.580+0000 7f36dbfff640 1 --2- 172.21.15.5:0/3693285632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36dc15fd60 0x7f36dc0c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:28.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.580+0000 7f36daffd640 1 -- 172.21.15.5:0/3693285632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36dc15fd60 msgr2=0x7f36dc0c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:28.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.580+0000 7f36daffd640 1 --2- 172.21.15.5:0/3693285632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36dc15fd60 0x7f36dc0c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:28.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.580+0000 7f36daffd640 1 -- 172.21.15.5:0/3693285632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36dc0b7c70 msgr2=0x7f36dc0c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:28.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.580+0000 7f36daffd640 1 --2- 172.21.15.5:0/3693285632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36dc0b7c70 0x7f36dc0c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:28.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.580+0000 7f36daffd640 1 -- 172.21.15.5:0/3693285632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d0009420 con 0x7f36dc0d1850 2023-07-14T13:08:28.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.580+0000 7f36db7fe640 1 --2- 172.21.15.5:0/3693285632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36dc0b7c70 0x7f36dc0c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:28.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.580+0000 7f36daffd640 1 --2- 172.21.15.5:0/3693285632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36dc0d1850 0x7f36dc0c82d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f36d001a080 tx=0x7f36d00191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:28.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.580+0000 7f36c3fff640 1 -- 172.21.15.5:0/3693285632 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d00abe10 con 0x7f36dc0d1850 2023-07-14T13:08:28.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.580+0000 7f36c3fff640 1 -- 172.21.15.5:0/3693285632 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d00bf450 con 0x7f36dc0d1850 2023-07-14T13:08:28.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.580+0000 7f36c3fff640 1 -- 172.21.15.5:0/3693285632 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d00bf800 con 0x7f36dc0d1850 2023-07-14T13:08:28.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.580+0000 7f36e1f74640 1 -- 172.21.15.5:0/3693285632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36dc15c310 con 0x7f36dc0d1850 2023-07-14T13:08:28.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.580+0000 7f36e1f74640 1 -- 172.21.15.5:0/3693285632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36dc15ed00 con 0x7f36dc0d1850 2023-07-14T13:08:28.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.580+0000 7f36e1f74640 1 -- 172.21.15.5:0/3693285632 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36dc15c170 con 0x7f36dc0d1850 2023-07-14T13:08:28.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.580+0000 7f36c3fff640 1 -- 172.21.15.5:0/3693285632 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f36d00b43f0 con 0x7f36dc0d1850 2023-07-14T13:08:28.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.580+0000 7f36c3fff640 1 --2- 172.21.15.5:0/3693285632 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f36c80663a0 0x7f36c8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:28.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.580+0000 7f36c3fff640 1 -- 172.21.15.5:0/3693285632 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f36d011e680 con 0x7f36dc0d1850 2023-07-14T13:08:28.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.584+0000 7f36db7fe640 1 --2- 172.21.15.5:0/3693285632 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f36c80663a0 0x7f36c8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:28.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.584+0000 7f36db7fe640 1 --2- 172.21.15.5:0/3693285632 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f36c80663a0 0x7f36c8068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f36cc0011f0 tx=0x7f36cc009040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:28.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.588+0000 7f36c3fff640 1 -- 172.21.15.5:0/3693285632 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f36dc15c170 con 0x7f36dc0d1850 2023-07-14T13:08:28.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.736+0000 7f36e1f74640 1 -- 172.21.15.5:0/3693285632 --> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f36dc0c59c0 con 0x7f36c80663a0 2023-07-14T13:08:28.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.748+0000 7f36c3fff640 1 -- 172.21.15.5:0/3693285632 <== mgr.5648 v2:172.21.15.154:6832/1874317247 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305540 (secure 0 0 0) 0x7f36cc0013e0 con 0x7f36c80663a0 2023-07-14T13:08:28.783 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:28.784 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:08:28.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.748+0000 7f36e1f74640 1 -- 172.21.15.5:0/3693285632 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f36c80663a0 msgr2=0x7f36c8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:28.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.748+0000 7f36e1f74640 1 --2- 172.21.15.5:0/3693285632 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f36c80663a0 0x7f36c8068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f36cc0011f0 tx=0x7f36cc009040 comp rx=0 tx=0).stop 2023-07-14T13:08:28.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.748+0000 7f36e1f74640 1 -- 172.21.15.5:0/3693285632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36dc0d1850 msgr2=0x7f36dc0c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:28.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.748+0000 7f36e1f74640 1 --2- 172.21.15.5:0/3693285632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36dc0d1850 0x7f36dc0c82d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f36d001a080 tx=0x7f36d00191f0 comp rx=0 tx=0).stop 2023-07-14T13:08:28.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.748+0000 7f36e1f74640 1 -- 172.21.15.5:0/3693285632 shutdown_connections 2023-07-14T13:08:28.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.748+0000 7f36e1f74640 1 --2- 172.21.15.5:0/3693285632 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f36c80663a0 0x7f36c8068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:28.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.748+0000 7f36e1f74640 1 --2- 172.21.15.5:0/3693285632 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36dc15fd60 0x7f36dc0c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:28.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.748+0000 7f36e1f74640 1 --2- 172.21.15.5:0/3693285632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36dc0d1850 0x7f36dc0c82d0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:28.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.748+0000 7f36e1f74640 1 --2- 172.21.15.5:0/3693285632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36dc0b7c70 0x7f36dc0c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:28.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.748+0000 7f36e1f74640 1 -- 172.21.15.5:0/3693285632 >> 172.21.15.5:0/3693285632 conn(0x7f36dc0650b0 msgr2=0x7f36dc0b7140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:28.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.748+0000 7f36e1f74640 1 -- 172.21.15.5:0/3693285632 shutdown_connections 2023-07-14T13:08:28.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.748+0000 7f36e1f74640 1 -- 172.21.15.5:0/3693285632 wait complete. 2023-07-14T13:08:28.803 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-14T13:08:27.514762+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":313724,"kb_used_data":8764,"kb_used_omap":0,"kb_used_meta":304896,"kb_avail":754660996,"statfs":{"total":773094113280,"available":772772859904,"internally_reserved":0,"allocated":8974336,"data_stored":5065246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312213504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.653666"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.874656+0000","last_change":"2023-07-14T13:08:22.874656+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.874656+0000","last_undegraded":"2023-07-14T13:08:22.874656+0000","last_fullsized":"2023-07-14T13:08:22.874656+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.875595+0000","last_change":"2023-07-14T13:08:22.875595+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.875595+0000","last_undegraded":"2023-07-14T13:08:22.875595+0000","last_fullsized":"2023-07-14T13:08:22.875595+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.881004+0000","last_change":"2023-07-14T13:08:22.881004+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.881004+0000","last_undegraded":"2023-07-14T13:08:22.881004+0000","last_fullsized":"2023-07-14T13:08:22.881004+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.877032+0000","last_change":"2023-07-14T13:08:22.877032+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.877032+0000","last_undegraded":"2023-07-14T13:08:22.877032+0000","last_fullsized":"2023-07-14T13:08:22.877032+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.881951+0000","last_change":"2023-07-14T13:08:22.881951+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.881951+0000","last_undegraded":"2023-07-14T13:08:22.881951+0000","last_fullsized":"2023-07-14T13:08:22.881951+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.874852+0000","last_change":"2023-07-14T13:08:22.874852+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.874852+0000","last_undegraded":"2023-07-14T13:08:22.874852+0000","last_fullsized":"2023-07-14T13:08:22.874852+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.877520+0000","last_change":"2023-07-14T13:08:22.877520+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.877520+0000","last_undegraded":"2023-07-14T13:08:22.877520+0000","last_fullsized":"2023-07-14T13:08:22.877520+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.880131+0000","last_change":"2023-07-14T13:08:22.880131+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.880131+0000","last_undegraded":"2023-07-14T13:08:22.880131+0000","last_fullsized":"2023-07-14T13:08:22.880131+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.884955+0000","last_change":"2023-07-14T13:08:22.884955+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.884955+0000","last_undegraded":"2023-07-14T13:08:22.884955+0000","last_fullsized":"2023-07-14T13:08:22.884955+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.878859+0000","last_change":"2023-07-14T13:08:22.878859+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.878859+0000","last_undegraded":"2023-07-14T13:08:22.878859+0000","last_fullsized":"2023-07-14T13:08:22.878859+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.878049+0000","last_change":"2023-07-14T13:08:22.878049+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.878049+0000","last_undegraded":"2023-07-14T13:08:22.878049+0000","last_fullsized":"2023-07-14T13:08:22.878049+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.881668+0000","last_change":"2023-07-14T13:08:22.881668+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.881668+0000","last_undegraded":"2023-07-14T13:08:22.881668+0000","last_fullsized":"2023-07-14T13:08:22.881668+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.881867+0000","last_change":"2023-07-14T13:08:22.881867+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.881867+0000","last_undegraded":"2023-07-14T13:08:22.881867+0000","last_fullsized":"2023-07-14T13:08:22.881867+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.879097+0000","last_change":"2023-07-14T13:08:22.879097+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.879097+0000","last_undegraded":"2023-07-14T13:08:22.879097+0000","last_fullsized":"2023-07-14T13:08:22.879097+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.884027+0000","last_change":"2023-07-14T13:08:22.884027+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.884027+0000","last_undegraded":"2023-07-14T13:08:22.884027+0000","last_fullsized":"2023-07-14T13:08:22.884027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.878091+0000","last_change":"2023-07-14T13:08:22.878091+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.878091+0000","last_undegraded":"2023-07-14T13:08:22.878091+0000","last_fullsized":"2023-07-14T13:08:22.878091+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.874124+0000","last_change":"2023-07-14T13:08:22.874124+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.874124+0000","last_undegraded":"2023-07-14T13:08:22.874124+0000","last_fullsized":"2023-07-14T13:08:22.874124+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.876616+0000","last_change":"2023-07-14T13:08:22.876616+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.876616+0000","last_undegraded":"2023-07-14T13:08:22.876616+0000","last_fullsized":"2023-07-14T13:08:22.876616+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.880454+0000","last_change":"2023-07-14T13:08:22.880454+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.880454+0000","last_undegraded":"2023-07-14T13:08:22.880454+0000","last_fullsized":"2023-07-14T13:08:22.880454+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.876197+0000","last_change":"2023-07-14T13:08:22.876197+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.876197+0000","last_undegraded":"2023-07-14T13:08:22.876197+0000","last_fullsized":"2023-07-14T13:08:22.876197+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.881312+0000","last_change":"2023-07-14T13:08:22.881312+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.881312+0000","last_undegraded":"2023-07-14T13:08:22.881312+0000","last_fullsized":"2023-07-14T13:08:22.881312+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.879148+0000","last_change":"2023-07-14T13:08:22.879148+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.879148+0000","last_undegraded":"2023-07-14T13:08:22.879148+0000","last_fullsized":"2023-07-14T13:08:22.879148+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.878744+0000","last_change":"2023-07-14T13:08:22.878744+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.878744+0000","last_undegraded":"2023-07-14T13:08:22.878744+0000","last_fullsized":"2023-07-14T13:08:22.878744+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.884697+0000","last_change":"2023-07-14T13:08:22.884697+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.884697+0000","last_undegraded":"2023-07-14T13:08:22.884697+0000","last_fullsized":"2023-07-14T13:08:22.884697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.883558+0000","last_change":"2023-07-14T13:08:22.883558+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.883558+0000","last_undegraded":"2023-07-14T13:08:22.883558+0000","last_fullsized":"2023-07-14T13:08:22.883558+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.883234+0000","last_change":"2023-07-14T13:08:22.883234+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.883234+0000","last_undegraded":"2023-07-14T13:08:22.883234+0000","last_fullsized":"2023-07-14T13:08:22.883234+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.876532+0000","last_change":"2023-07-14T13:08:22.876532+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.876532+0000","last_undegraded":"2023-07-14T13:08:22.876532+0000","last_fullsized":"2023-07-14T13:08:22.876532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.873908+0000","last_change":"2023-07-14T13:08:22.873908+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.873908+0000","last_undegraded":"2023-07-14T13:08:22.873908+0000","last_fullsized":"2023-07-14T13:08:22.873908+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.880128+0000","last_change":"2023-07-14T13:08:22.880128+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.880128+0000","last_undegraded":"2023-07-14T13:08:22.880128+0000","last_fullsized":"2023-07-14T13:08:22.880128+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.881491+0000","last_change":"2023-07-14T13:08:22.881491+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.881491+0000","last_undegraded":"2023-07-14T13:08:22.881491+0000","last_fullsized":"2023-07-14T13:08:22.881491+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.877794+0000","last_change":"2023-07-14T13:08:22.877794+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.877794+0000","last_undegraded":"2023-07-14T13:08:22.877794+0000","last_fullsized":"2023-07-14T13:08:22.877794+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.876787+0000","last_change":"2023-07-14T13:08:22.876787+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.876787+0000","last_undegraded":"2023-07-14T13:08:22.876787+0000","last_fullsized":"2023-07-14T13:08:22.876787+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.880076+0000","last_change":"2023-07-14T13:08:22.880076+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.880076+0000","last_undegraded":"2023-07-14T13:08:22.880076+0000","last_fullsized":"2023-07-14T13:08:22.880076+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.894607+0000","last_change":"2023-07-14T13:08:22.892834+0000","last_active":"2023-07-14T13:08:22.894607+0000","last_peered":"2023-07-14T13:08:22.894607+0000","last_clean":"2023-07-14T13:08:22.894607+0000","last_became_active":"2023-07-14T13:08:22.892557+0000","last_became_peered":"2023-07-14T13:08:22.892557+0000","last_unstale":"2023-07-14T13:08:22.894607+0000","last_undegraded":"2023-07-14T13:08:22.894607+0000","last_fullsized":"2023-07-14T13:08:22.894607+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:39:25.704839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.875717+0000","last_change":"2023-07-14T13:08:22.875717+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.875717+0000","last_undegraded":"2023-07-14T13:08:22.875717+0000","last_fullsized":"2023-07-14T13:08:22.875717+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.893651+0000","last_change":"2023-07-14T13:08:22.888782+0000","last_active":"2023-07-14T13:08:22.893651+0000","last_peered":"2023-07-14T13:08:22.893651+0000","last_clean":"2023-07-14T13:08:22.893651+0000","last_became_active":"2023-07-14T13:08:22.888435+0000","last_became_peered":"2023-07-14T13:08:22.888435+0000","last_unstale":"2023-07-14T13:08:22.893651+0000","last_undegraded":"2023-07-14T13:08:22.893651+0000","last_fullsized":"2023-07-14T13:08:22.893651+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:52:49.835822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.875437+0000","last_change":"2023-07-14T13:08:22.875437+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.875437+0000","last_undegraded":"2023-07-14T13:08:22.875437+0000","last_fullsized":"2023-07-14T13:08:22.875437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.890136+0000","last_change":"2023-07-14T13:08:22.886288+0000","last_active":"2023-07-14T13:08:22.890136+0000","last_peered":"2023-07-14T13:08:22.890136+0000","last_clean":"2023-07-14T13:08:22.890136+0000","last_became_active":"2023-07-14T13:08:22.885619+0000","last_became_peered":"2023-07-14T13:08:22.885619+0000","last_unstale":"2023-07-14T13:08:22.890136+0000","last_undegraded":"2023-07-14T13:08:22.890136+0000","last_fullsized":"2023-07-14T13:08:22.890136+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:06.776201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.885416+0000","last_change":"2023-07-14T13:08:22.885416+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.885416+0000","last_undegraded":"2023-07-14T13:08:22.885416+0000","last_fullsized":"2023-07-14T13:08:22.885416+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.893540+0000","last_change":"2023-07-14T13:08:22.888011+0000","last_active":"2023-07-14T13:08:22.893540+0000","last_peered":"2023-07-14T13:08:22.893540+0000","last_clean":"2023-07-14T13:08:22.893540+0000","last_became_active":"2023-07-14T13:08:22.887659+0000","last_became_peered":"2023-07-14T13:08:22.887659+0000","last_unstale":"2023-07-14T13:08:22.893540+0000","last_undegraded":"2023-07-14T13:08:22.893540+0000","last_fullsized":"2023-07-14T13:08:22.893540+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:03:54.376631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.877566+0000","last_change":"2023-07-14T13:08:22.877566+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.877566+0000","last_undegraded":"2023-07-14T13:08:22.877566+0000","last_fullsized":"2023-07-14T13:08:22.877566+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.887011+0000","last_change":"2023-07-14T13:08:22.884530+0000","last_active":"2023-07-14T13:08:22.887011+0000","last_peered":"2023-07-14T13:08:22.887011+0000","last_clean":"2023-07-14T13:08:22.887011+0000","last_became_active":"2023-07-14T13:08:22.884229+0000","last_became_peered":"2023-07-14T13:08:22.884229+0000","last_unstale":"2023-07-14T13:08:22.887011+0000","last_undegraded":"2023-07-14T13:08:22.887011+0000","last_fullsized":"2023-07-14T13:08:22.887011+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:54:47.831816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.873445+0000","last_change":"2023-07-14T13:08:22.873445+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.873445+0000","last_undegraded":"2023-07-14T13:08:22.873445+0000","last_fullsized":"2023-07-14T13:08:22.873445+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.885902+0000","last_change":"2023-07-14T13:08:22.883779+0000","last_active":"2023-07-14T13:08:22.885902+0000","last_peered":"2023-07-14T13:08:22.885902+0000","last_clean":"2023-07-14T13:08:22.885902+0000","last_became_active":"2023-07-14T13:08:22.883464+0000","last_became_peered":"2023-07-14T13:08:22.883464+0000","last_unstale":"2023-07-14T13:08:22.885902+0000","last_undegraded":"2023-07-14T13:08:22.885902+0000","last_fullsized":"2023-07-14T13:08:22.885902+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:44:03.170860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.884122+0000","last_change":"2023-07-14T13:08:22.884122+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.884122+0000","last_undegraded":"2023-07-14T13:08:22.884122+0000","last_fullsized":"2023-07-14T13:08:22.884122+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.889935+0000","last_change":"2023-07-14T13:08:22.887027+0000","last_active":"2023-07-14T13:08:22.889935+0000","last_peered":"2023-07-14T13:08:22.889935+0000","last_clean":"2023-07-14T13:08:22.889935+0000","last_became_active":"2023-07-14T13:08:22.886683+0000","last_became_peered":"2023-07-14T13:08:22.886683+0000","last_unstale":"2023-07-14T13:08:22.889935+0000","last_undegraded":"2023-07-14T13:08:22.889935+0000","last_fullsized":"2023-07-14T13:08:22.889935+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:14:46.468529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.875343+0000","last_change":"2023-07-14T13:08:22.875343+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.875343+0000","last_undegraded":"2023-07-14T13:08:22.875343+0000","last_fullsized":"2023-07-14T13:08:22.875343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.897981+0000","last_change":"2023-07-14T13:08:22.896649+0000","last_active":"2023-07-14T13:08:22.897981+0000","last_peered":"2023-07-14T13:08:22.897981+0000","last_clean":"2023-07-14T13:08:22.897981+0000","last_became_active":"2023-07-14T13:08:22.896318+0000","last_became_peered":"2023-07-14T13:08:22.896318+0000","last_unstale":"2023-07-14T13:08:22.897981+0000","last_undegraded":"2023-07-14T13:08:22.897981+0000","last_fullsized":"2023-07-14T13:08:22.897981+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:05.261247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.873301+0000","last_change":"2023-07-14T13:08:22.873301+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.873301+0000","last_undegraded":"2023-07-14T13:08:22.873301+0000","last_fullsized":"2023-07-14T13:08:22.873301+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.900625+0000","last_change":"2023-07-14T13:08:22.899027+0000","last_active":"2023-07-14T13:08:22.900625+0000","last_peered":"2023-07-14T13:08:22.900625+0000","last_clean":"2023-07-14T13:08:22.900625+0000","last_became_active":"2023-07-14T13:08:22.898673+0000","last_became_peered":"2023-07-14T13:08:22.898673+0000","last_unstale":"2023-07-14T13:08:22.900625+0000","last_undegraded":"2023-07-14T13:08:22.900625+0000","last_fullsized":"2023-07-14T13:08:22.900625+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:23:31.869780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.874124+0000","last_change":"2023-07-14T13:08:22.874124+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.874124+0000","last_undegraded":"2023-07-14T13:08:22.874124+0000","last_fullsized":"2023-07-14T13:08:22.874124+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.893762+0000","last_change":"2023-07-14T13:08:22.889053+0000","last_active":"2023-07-14T13:08:22.893762+0000","last_peered":"2023-07-14T13:08:22.893762+0000","last_clean":"2023-07-14T13:08:22.893762+0000","last_became_active":"2023-07-14T13:08:22.888145+0000","last_became_peered":"2023-07-14T13:08:22.888145+0000","last_unstale":"2023-07-14T13:08:22.893762+0000","last_undegraded":"2023-07-14T13:08:22.893762+0000","last_fullsized":"2023-07-14T13:08:22.893762+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:01:01.654800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.880896+0000","last_change":"2023-07-14T13:08:22.880896+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.880896+0000","last_undegraded":"2023-07-14T13:08:22.880896+0000","last_fullsized":"2023-07-14T13:08:22.880896+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.900548+0000","last_change":"2023-07-14T13:08:22.898636+0000","last_active":"2023-07-14T13:08:22.900548+0000","last_peered":"2023-07-14T13:08:22.900548+0000","last_clean":"2023-07-14T13:08:22.900548+0000","last_became_active":"2023-07-14T13:08:22.898199+0000","last_became_peered":"2023-07-14T13:08:22.898199+0000","last_unstale":"2023-07-14T13:08:22.900548+0000","last_undegraded":"2023-07-14T13:08:22.900548+0000","last_fullsized":"2023-07-14T13:08:22.900548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:45:04.006207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.875703+0000","last_change":"2023-07-14T13:08:22.875703+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.875703+0000","last_undegraded":"2023-07-14T13:08:22.875703+0000","last_fullsized":"2023-07-14T13:08:22.875703+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.891087+0000","last_change":"2023-07-14T13:08:22.886746+0000","last_active":"2023-07-14T13:08:22.891087+0000","last_peered":"2023-07-14T13:08:22.891087+0000","last_clean":"2023-07-14T13:08:22.891087+0000","last_became_active":"2023-07-14T13:08:22.886234+0000","last_became_peered":"2023-07-14T13:08:22.886234+0000","last_unstale":"2023-07-14T13:08:22.891087+0000","last_undegraded":"2023-07-14T13:08:22.891087+0000","last_fullsized":"2023-07-14T13:08:22.891087+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:56:41.891811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.875703+0000","last_change":"2023-07-14T13:08:22.875703+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.875703+0000","last_undegraded":"2023-07-14T13:08:22.875703+0000","last_fullsized":"2023-07-14T13:08:22.875703+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.898473+0000","last_change":"2023-07-14T13:08:22.896327+0000","last_active":"2023-07-14T13:08:22.898473+0000","last_peered":"2023-07-14T13:08:22.898473+0000","last_clean":"2023-07-14T13:08:22.898473+0000","last_became_active":"2023-07-14T13:08:22.895999+0000","last_became_peered":"2023-07-14T13:08:22.895999+0000","last_unstale":"2023-07-14T13:08:22.898473+0000","last_undegraded":"2023-07-14T13:08:22.898473+0000","last_fullsized":"2023-07-14T13:08:22.898473+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:42:49.923663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.880817+0000","last_change":"2023-07-14T13:08:22.880817+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.880817+0000","last_undegraded":"2023-07-14T13:08:22.880817+0000","last_fullsized":"2023-07-14T13:08:22.880817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.896774+0000","last_change":"2023-07-14T13:08:22.894256+0000","last_active":"2023-07-14T13:08:22.896774+0000","last_peered":"2023-07-14T13:08:22.896774+0000","last_clean":"2023-07-14T13:08:22.896774+0000","last_became_active":"2023-07-14T13:08:22.893973+0000","last_became_peered":"2023-07-14T13:08:22.893973+0000","last_unstale":"2023-07-14T13:08:22.896774+0000","last_undegraded":"2023-07-14T13:08:22.896774+0000","last_fullsized":"2023-07-14T13:08:22.896774+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:53:09.427111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.883675+0000","last_change":"2023-07-14T13:08:22.883675+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.883675+0000","last_undegraded":"2023-07-14T13:08:22.883675+0000","last_fullsized":"2023-07-14T13:08:22.883675+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.899788+0000","last_change":"2023-07-14T13:08:22.897595+0000","last_active":"2023-07-14T13:08:22.899788+0000","last_peered":"2023-07-14T13:08:22.899788+0000","last_clean":"2023-07-14T13:08:22.899788+0000","last_became_active":"2023-07-14T13:08:22.896980+0000","last_became_peered":"2023-07-14T13:08:22.896980+0000","last_unstale":"2023-07-14T13:08:22.899788+0000","last_undegraded":"2023-07-14T13:08:22.899788+0000","last_fullsized":"2023-07-14T13:08:22.899788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:36:22.832887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.872577+0000","last_change":"2023-07-14T13:08:22.872577+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.872577+0000","last_undegraded":"2023-07-14T13:08:22.872577+0000","last_fullsized":"2023-07-14T13:08:22.872577+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.897560+0000","last_change":"2023-07-14T13:08:22.896567+0000","last_active":"2023-07-14T13:08:22.897560+0000","last_peered":"2023-07-14T13:08:22.897560+0000","last_clean":"2023-07-14T13:08:22.897560+0000","last_became_active":"2023-07-14T13:08:22.896244+0000","last_became_peered":"2023-07-14T13:08:22.896244+0000","last_unstale":"2023-07-14T13:08:22.897560+0000","last_undegraded":"2023-07-14T13:08:22.897560+0000","last_fullsized":"2023-07-14T13:08:22.897560+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:19:46.036377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.874264+0000","last_change":"2023-07-14T13:08:22.874264+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.874264+0000","last_undegraded":"2023-07-14T13:08:22.874264+0000","last_fullsized":"2023-07-14T13:08:22.874264+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.899711+0000","last_change":"2023-07-14T13:08:22.896731+0000","last_active":"2023-07-14T13:08:22.899711+0000","last_peered":"2023-07-14T13:08:22.899711+0000","last_clean":"2023-07-14T13:08:22.899711+0000","last_became_active":"2023-07-14T13:08:22.896451+0000","last_became_peered":"2023-07-14T13:08:22.896451+0000","last_unstale":"2023-07-14T13:08:22.899711+0000","last_undegraded":"2023-07-14T13:08:22.899711+0000","last_fullsized":"2023-07-14T13:08:22.899711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:52:59.408573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.877483+0000","last_change":"2023-07-14T13:08:22.877483+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.877483+0000","last_undegraded":"2023-07-14T13:08:22.877483+0000","last_fullsized":"2023-07-14T13:08:22.877483+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.891526+0000","last_change":"2023-07-14T13:08:22.888742+0000","last_active":"2023-07-14T13:08:22.891526+0000","last_peered":"2023-07-14T13:08:22.891526+0000","last_clean":"2023-07-14T13:08:22.891526+0000","last_became_active":"2023-07-14T13:08:22.888451+0000","last_became_peered":"2023-07-14T13:08:22.888451+0000","last_unstale":"2023-07-14T13:08:22.891526+0000","last_undegraded":"2023-07-14T13:08:22.891526+0000","last_fullsized":"2023-07-14T13:08:22.891526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:03.131223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.882704+0000","last_change":"2023-07-14T13:08:22.882704+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.882704+0000","last_undegraded":"2023-07-14T13:08:22.882704+0000","last_fullsized":"2023-07-14T13:08:22.882704+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.890154+0000","last_change":"2023-07-14T13:08:22.886480+0000","last_active":"2023-07-14T13:08:22.890154+0000","last_peered":"2023-07-14T13:08:22.890154+0000","last_clean":"2023-07-14T13:08:22.890154+0000","last_became_active":"2023-07-14T13:08:22.885968+0000","last_became_peered":"2023-07-14T13:08:22.885968+0000","last_unstale":"2023-07-14T13:08:22.890154+0000","last_undegraded":"2023-07-14T13:08:22.890154+0000","last_fullsized":"2023-07-14T13:08:22.890154+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:31:12.625405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.881843+0000","last_change":"2023-07-14T13:08:22.881843+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.881843+0000","last_undegraded":"2023-07-14T13:08:22.881843+0000","last_fullsized":"2023-07-14T13:08:22.881843+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.891064+0000","last_change":"2023-07-14T13:08:22.886524+0000","last_active":"2023-07-14T13:08:22.891064+0000","last_peered":"2023-07-14T13:08:22.891064+0000","last_clean":"2023-07-14T13:08:22.891064+0000","last_became_active":"2023-07-14T13:08:22.882894+0000","last_became_peered":"2023-07-14T13:08:22.882894+0000","last_unstale":"2023-07-14T13:08:22.891064+0000","last_undegraded":"2023-07-14T13:08:22.891064+0000","last_fullsized":"2023-07-14T13:08:22.891064+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:49:48.097803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.882574+0000","last_change":"2023-07-14T13:08:22.882574+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.882574+0000","last_undegraded":"2023-07-14T13:08:22.882574+0000","last_fullsized":"2023-07-14T13:08:22.882574+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.899796+0000","last_change":"2023-07-14T13:08:22.897266+0000","last_active":"2023-07-14T13:08:22.899796+0000","last_peered":"2023-07-14T13:08:22.899796+0000","last_clean":"2023-07-14T13:08:22.899796+0000","last_became_active":"2023-07-14T13:08:22.896932+0000","last_became_peered":"2023-07-14T13:08:22.896932+0000","last_unstale":"2023-07-14T13:08:22.899796+0000","last_undegraded":"2023-07-14T13:08:22.899796+0000","last_fullsized":"2023-07-14T13:08:22.899796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:11:15.706077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.875833+0000","last_change":"2023-07-14T13:08:22.875833+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.875833+0000","last_undegraded":"2023-07-14T13:08:22.875833+0000","last_fullsized":"2023-07-14T13:08:22.875833+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.887064+0000","last_change":"2023-07-14T13:08:22.884847+0000","last_active":"2023-07-14T13:08:22.887064+0000","last_peered":"2023-07-14T13:08:22.887064+0000","last_clean":"2023-07-14T13:08:22.887064+0000","last_became_active":"2023-07-14T13:08:22.884442+0000","last_became_peered":"2023-07-14T13:08:22.884442+0000","last_unstale":"2023-07-14T13:08:22.887064+0000","last_undegraded":"2023-07-14T13:08:22.887064+0000","last_fullsized":"2023-07-14T13:08:22.887064+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:41:36.689812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.872492+0000","last_change":"2023-07-14T13:08:22.872492+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.872492+0000","last_undegraded":"2023-07-14T13:08:22.872492+0000","last_fullsized":"2023-07-14T13:08:22.872492+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.893415+0000","last_change":"2023-07-14T13:08:22.890676+0000","last_active":"2023-07-14T13:08:22.893415+0000","last_peered":"2023-07-14T13:08:22.893415+0000","last_clean":"2023-07-14T13:08:22.893415+0000","last_became_active":"2023-07-14T13:08:22.890323+0000","last_became_peered":"2023-07-14T13:08:22.890323+0000","last_unstale":"2023-07-14T13:08:22.893415+0000","last_undegraded":"2023-07-14T13:08:22.893415+0000","last_fullsized":"2023-07-14T13:08:22.893415+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:54:57.718294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.878334+0000","last_change":"2023-07-14T13:08:22.878334+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.878334+0000","last_undegraded":"2023-07-14T13:08:22.878334+0000","last_fullsized":"2023-07-14T13:08:22.878334+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.891352+0000","last_change":"2023-07-14T13:08:22.888081+0000","last_active":"2023-07-14T13:08:22.891352+0000","last_peered":"2023-07-14T13:08:22.891352+0000","last_clean":"2023-07-14T13:08:22.891352+0000","last_became_active":"2023-07-14T13:08:22.887733+0000","last_became_peered":"2023-07-14T13:08:22.887733+0000","last_unstale":"2023-07-14T13:08:22.891352+0000","last_undegraded":"2023-07-14T13:08:22.891352+0000","last_fullsized":"2023-07-14T13:08:22.891352+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:54:57.718294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.881449+0000","last_change":"2023-07-14T13:08:22.881449+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.881449+0000","last_undegraded":"2023-07-14T13:08:22.881449+0000","last_fullsized":"2023-07-14T13:08:22.881449+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.887343+0000","last_change":"2023-07-14T13:08:22.885339+0000","last_active":"2023-07-14T13:08:22.887343+0000","last_peered":"2023-07-14T13:08:22.887343+0000","last_clean":"2023-07-14T13:08:22.887343+0000","last_became_active":"2023-07-14T13:08:22.885052+0000","last_became_peered":"2023-07-14T13:08:22.885052+0000","last_unstale":"2023-07-14T13:08:22.887343+0000","last_undegraded":"2023-07-14T13:08:22.887343+0000","last_fullsized":"2023-07-14T13:08:22.887343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:02:58.361007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"70'161","reported_seq":440,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.889580+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:08:22.889580+0000","last_peered":"2023-07-14T13:08:22.889580+0000","last_clean":"2023-07-14T13:08:22.889580+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:08:22.889580+0000","last_undegraded":"2023-07-14T13:08:22.889580+0000","last_fullsized":"2023-07-14T13:08:22.889580+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:12:39.945742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.886927+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:08:22.886927+0000","last_peered":"2023-07-14T13:08:22.886927+0000","last_clean":"2023-07-14T13:08:22.886927+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:08:22.886927+0000","last_undegraded":"2023-07-14T13:08:22.886927+0000","last_fullsized":"2023-07-14T13:08:22.886927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:35:06.179987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.873769+0000","last_change":"2023-07-14T13:08:22.873769+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.873769+0000","last_undegraded":"2023-07-14T13:08:22.873769+0000","last_fullsized":"2023-07-14T13:08:22.873769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.893610+0000","last_change":"2023-07-14T13:08:22.888358+0000","last_active":"2023-07-14T13:08:22.893610+0000","last_peered":"2023-07-14T13:08:22.893610+0000","last_clean":"2023-07-14T13:08:22.893610+0000","last_became_active":"2023-07-14T13:08:22.888086+0000","last_became_peered":"2023-07-14T13:08:22.888086+0000","last_unstale":"2023-07-14T13:08:22.893610+0000","last_undegraded":"2023-07-14T13:08:22.893610+0000","last_fullsized":"2023-07-14T13:08:22.893610+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:23:27.051257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.889371+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:08:22.889371+0000","last_peered":"2023-07-14T13:08:22.889371+0000","last_clean":"2023-07-14T13:08:22.889371+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:08:22.889371+0000","last_undegraded":"2023-07-14T13:08:22.889371+0000","last_fullsized":"2023-07-14T13:08:22.889371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:55:41.263847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.880317+0000","last_change":"2023-07-14T13:08:22.880317+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.880317+0000","last_undegraded":"2023-07-14T13:08:22.880317+0000","last_fullsized":"2023-07-14T13:08:22.880317+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.896794+0000","last_change":"2023-07-14T13:08:22.894336+0000","last_active":"2023-07-14T13:08:22.896794+0000","last_peered":"2023-07-14T13:08:22.896794+0000","last_clean":"2023-07-14T13:08:22.896794+0000","last_became_active":"2023-07-14T13:08:22.894049+0000","last_became_peered":"2023-07-14T13:08:22.894049+0000","last_unstale":"2023-07-14T13:08:22.896794+0000","last_undegraded":"2023-07-14T13:08:22.896794+0000","last_fullsized":"2023-07-14T13:08:22.896794+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:24:57.826152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":124,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.878743+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:08:22.878743+0000","last_peered":"2023-07-14T13:08:22.878743+0000","last_clean":"2023-07-14T13:08:22.878743+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:08:22.878743+0000","last_undegraded":"2023-07-14T13:08:22.878743+0000","last_fullsized":"2023-07-14T13:08:22.878743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:25:57.748881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.879882+0000","last_change":"2023-07-14T13:08:22.879882+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.879882+0000","last_undegraded":"2023-07-14T13:08:22.879882+0000","last_fullsized":"2023-07-14T13:08:22.879882+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.893609+0000","last_change":"2023-07-14T13:08:22.888384+0000","last_active":"2023-07-14T13:08:22.893609+0000","last_peered":"2023-07-14T13:08:22.893609+0000","last_clean":"2023-07-14T13:08:22.893609+0000","last_became_active":"2023-07-14T13:08:22.888062+0000","last_became_peered":"2023-07-14T13:08:22.888062+0000","last_unstale":"2023-07-14T13:08:22.893609+0000","last_undegraded":"2023-07-14T13:08:22.893609+0000","last_fullsized":"2023-07-14T13:08:22.893609+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:48:33.099003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.887019+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:08:22.887019+0000","last_peered":"2023-07-14T13:08:22.887019+0000","last_clean":"2023-07-14T13:08:22.887019+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:08:22.887019+0000","last_undegraded":"2023-07-14T13:08:22.887019+0000","last_fullsized":"2023-07-14T13:08:22.887019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:51:45.137826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.880578+0000","last_change":"2023-07-14T13:08:22.880578+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.880578+0000","last_undegraded":"2023-07-14T13:08:22.880578+0000","last_fullsized":"2023-07-14T13:08:22.880578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.898248+0000","last_change":"2023-07-14T13:08:22.895241+0000","last_active":"2023-07-14T13:08:22.898248+0000","last_peered":"2023-07-14T13:08:22.898248+0000","last_clean":"2023-07-14T13:08:22.898248+0000","last_became_active":"2023-07-14T13:08:22.894924+0000","last_became_peered":"2023-07-14T13:08:22.894924+0000","last_unstale":"2023-07-14T13:08:22.898248+0000","last_undegraded":"2023-07-14T13:08:22.898248+0000","last_fullsized":"2023-07-14T13:08:22.898248+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:35:50.435128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.870905+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:08:22.870905+0000","last_peered":"2023-07-14T13:08:22.870905+0000","last_clean":"2023-07-14T13:08:22.870905+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:08:22.870905+0000","last_undegraded":"2023-07-14T13:08:22.870905+0000","last_fullsized":"2023-07-14T13:08:22.870905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:50.832212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.879839+0000","last_change":"2023-07-14T13:08:22.879839+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.879839+0000","last_undegraded":"2023-07-14T13:08:22.879839+0000","last_fullsized":"2023-07-14T13:08:22.879839+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.900585+0000","last_change":"2023-07-14T13:08:22.898695+0000","last_active":"2023-07-14T13:08:22.900585+0000","last_peered":"2023-07-14T13:08:22.900585+0000","last_clean":"2023-07-14T13:08:22.900585+0000","last_became_active":"2023-07-14T13:08:22.898408+0000","last_became_peered":"2023-07-14T13:08:22.898408+0000","last_unstale":"2023-07-14T13:08:22.900585+0000","last_undegraded":"2023-07-14T13:08:22.900585+0000","last_fullsized":"2023-07-14T13:08:22.900585+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:29:41.565522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.891224+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:08:22.891224+0000","last_peered":"2023-07-14T13:08:22.891224+0000","last_clean":"2023-07-14T13:08:22.891224+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:08:22.891224+0000","last_undegraded":"2023-07-14T13:08:22.891224+0000","last_fullsized":"2023-07-14T13:08:22.891224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:11:22.279127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.876091+0000","last_change":"2023-07-14T13:08:22.876091+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.876091+0000","last_undegraded":"2023-07-14T13:08:22.876091+0000","last_fullsized":"2023-07-14T13:08:22.876091+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.900629+0000","last_change":"2023-07-14T13:08:22.899305+0000","last_active":"2023-07-14T13:08:22.900629+0000","last_peered":"2023-07-14T13:08:22.900629+0000","last_clean":"2023-07-14T13:08:22.900629+0000","last_became_active":"2023-07-14T13:08:22.898996+0000","last_became_peered":"2023-07-14T13:08:22.898996+0000","last_unstale":"2023-07-14T13:08:22.900629+0000","last_undegraded":"2023-07-14T13:08:22.900629+0000","last_fullsized":"2023-07-14T13:08:22.900629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:56:03.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.870478+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:08:22.870478+0000","last_peered":"2023-07-14T13:08:22.870478+0000","last_clean":"2023-07-14T13:08:22.870478+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:08:22.870478+0000","last_undegraded":"2023-07-14T13:08:22.870478+0000","last_fullsized":"2023-07-14T13:08:22.870478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:28:21.335135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2023-07-14T13:08:22.881311+0000","last_change":"2023-07-14T13:08:22.881311+0000","last_active":"2023-07-14T13:08:22.857040+0000","last_peered":"2023-07-14T13:08:22.857040+0000","last_clean":"2023-07-14T13:08:22.857040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:08:22.881311+0000","last_undegraded":"2023-07-14T13:08:22.881311+0000","last_fullsized":"2023-07-14T13:08:22.881311+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.887032+0000","last_change":"2023-07-14T13:08:22.885480+0000","last_active":"2023-07-14T13:08:22.887032+0000","last_peered":"2023-07-14T13:08:22.887032+0000","last_clean":"2023-07-14T13:08:22.887032+0000","last_became_active":"2023-07-14T13:08:22.885180+0000","last_became_peered":"2023-07-14T13:08:22.885180+0000","last_unstale":"2023-07-14T13:08:22.887032+0000","last_undegraded":"2023-07-14T13:08:22.887032+0000","last_fullsized":"2023-07-14T13:08:22.887032+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:48:30.643508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-14T13:08:22.890458+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:08:22.890458+0000","last_peered":"2023-07-14T13:08:22.890458+0000","last_clean":"2023-07-14T13:08:22.890458+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:08:22.890458+0000","last_undegraded":"2023-07-14T13:08:22.890458+0000","last_fullsized":"2023-07-14T13:08:22.890458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:01.711854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575038,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54716,"kb_used_data":1524,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317124,"statfs":{"total":96636764160,"available":96580734976,"internally_reserved":0,"allocated":1560576,"data_stored":1072049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.51500000000000001,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.98299999999999998,"5min":0.98399999999999999,"15min":1.879},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.56799999999999995,"5min":0.44,"15min":0.439},"max":{"1min":1.054,"5min":1.054,"15min":1.9059999999999999},"last":0.627}]},{"osd":1,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73899999999999999,"15min":0.73599999999999999},"min":{"1min":0.504,"5min":0.434,"15min":0.42999999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.069},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.749,"15min":0.746},"min":{"1min":0.54400000000000004,"5min":0.48999999999999999,"15min":0.40500000000000003},"max":{"1min":0.93999999999999995,"5min":0.97399999999999998,"15min":1.1020000000000001},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73899999999999999,"15min":0.72799999999999998},"min":{"1min":0.52700000000000002,"5min":0.46999999999999997,"15min":0.40600000000000003},"max":{"1min":0.88100000000000001,"5min":0.98899999999999999,"15min":1.048},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.747,"15min":0.752},"min":{"1min":0.47499999999999998,"5min":0.47199999999999998,"15min":0.46899999999999997},"max":{"1min":0.91300000000000003,"5min":0.97099999999999997,"15min":1.0169999999999999},"last":0.76000000000000001}]},{"osd":3,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.746,"15min":0.73399999999999999},"min":{"1min":0.59399999999999997,"5min":0.503,"15min":0.442},"max":{"1min":0.88400000000000001,"5min":1.0269999999999999,"15min":1.0760000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.755,"15min":0.75700000000000001},"min":{"1min":0.60199999999999998,"5min":0.47299999999999998,"15min":0.41499999999999998},"max":{"1min":0.91600000000000004,"5min":1.018,"15min":1.024},"last":0.80400000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.44400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.82099999999999995,"5min":1.0009999999999999,"15min":1.022},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.41799999999999998,"5min":0.40999999999999998,"15min":0.39300000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.82599999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59699999999999998,"15min":0.60599999999999998},"min":{"1min":0.39300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.0249999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63400000000000001,"15min":0.65600000000000003},"min":{"1min":0.41999999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.77700000000000002}]},{"osd":6,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68400000000000005,"15min":0.70099999999999996},"min":{"1min":0.45200000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.99299999999999999,"5min":1.0489999999999999,"15min":1.4419999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.67600000000000005},"min":{"1min":0.46999999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81200000000000006,"5min":0.95799999999999996,"15min":1.575},"last":0.79400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575039,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":966656,"data_stored":481681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.57799999999999996,"5min":0.38,"15min":0.38},"max":{"1min":0.90400000000000003,"5min":0.996,"15min":1.2749999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.72499999999999998,"15min":0.74199999999999999},"min":{"1min":0.53600000000000003,"5min":0.48199999999999998,"15min":0.47399999999999998},"max":{"1min":0.98199999999999998,"5min":1.0800000000000001,"15min":1.2110000000000001},"last":0.69799999999999995}]},{"osd":1,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73599999999999999,"15min":0.752},"min":{"1min":0.48299999999999998,"5min":0.47399999999999998,"15min":0.379},"max":{"1min":0.90900000000000003,"5min":1.0089999999999999,"15min":1.4299999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70799999999999996,"15min":0.72599999999999998},"min":{"1min":0.56999999999999995,"5min":0.46999999999999997,"15min":0.44},"max":{"1min":0.86899999999999999,"5min":0.97099999999999997,"15min":1.1379999999999999},"last":0.71699999999999997}]},{"osd":2,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.73899999999999999,"15min":0.754},"min":{"1min":0.55800000000000005,"5min":0.45900000000000002,"15min":0.40400000000000003},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":1.319},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.755,"15min":0.75600000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.42299999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.341},"last":0.56599999999999995}]},{"osd":3,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76000000000000001,"15min":0.78100000000000003},"min":{"1min":0.51000000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.054,"5min":1.054,"15min":1.3859999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.52400000000000002,"5min":0.48399999999999999,"15min":0.45900000000000002},"max":{"1min":0.94799999999999995,"5min":0.99099999999999999,"15min":1.1080000000000001},"last":0.58199999999999996}]},{"osd":4,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.97899999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.624,"15min":0.63900000000000001},"min":{"1min":0.47399999999999998,"5min":0.38500000000000001,"15min":0.36099999999999999},"max":{"1min":0.93500000000000005,"5min":1.012,"15min":1.091},"last":0.51200000000000001}]},{"osd":5,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64100000000000001,"15min":0.64700000000000002},"min":{"1min":0.499,"5min":0.37,"15min":0.37},"max":{"1min":0.96599999999999997,"5min":1.579,"15min":1.579},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67800000000000005,"15min":0.69399999999999995},"min":{"1min":0.46700000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.145},"last":0.621}]},{"osd":7,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.438,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.208},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.499,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0209999999999999,"5min":1.657,"15min":1.657},"last":0.60399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575038,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":978944,"data_stored":488301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.72999999999999998,"15min":0.73599999999999999},"min":{"1min":0.60999999999999999,"5min":0.36499999999999999,"15min":0.32400000000000001},"max":{"1min":0.90200000000000002,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.70799999999999996,"15min":0.73899999999999999},"min":{"1min":0.52500000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.625}]},{"osd":1,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71799999999999997,"15min":0.73099999999999998},"min":{"1min":0.56399999999999995,"5min":0.44500000000000001,"15min":0.41099999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.335},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.745,"15min":0.752},"min":{"1min":0.60299999999999998,"5min":0.48699999999999999,"15min":0.36799999999999999},"max":{"1min":0.94499999999999995,"5min":2.706,"15min":2.706},"last":0.53900000000000003}]},{"osd":2,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72399999999999998,"15min":0.74399999999999999},"min":{"1min":0.59499999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.212,"5min":1.212,"15min":1.298},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.71899999999999997,"15min":0.73999999999999999},"min":{"1min":0.53800000000000003,"5min":0.433,"15min":0.433},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.73499999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.75,"15min":0.751},"min":{"1min":0.60599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.90900000000000003,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.57999999999999996,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.55300000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.45700000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68000000000000005,"15min":0.68899999999999995},"min":{"1min":0.443,"5min":0.36299999999999999,"15min":0.35899999999999999},"max":{"1min":0.86799999999999999,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.69899999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60199999999999998,"15min":0.62},"min":{"1min":0.41699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63900000000000001,"15min":0.64600000000000002},"min":{"1min":0.496,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.83699999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66000000000000003,"15min":0.64900000000000002},"min":{"1min":0.48899999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.026,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.46600000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.2589999999999999,"5min":1.407,"15min":1.407},"last":0.79000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575038,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":978944,"data_stored":488301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.73999999999999999,"15min":0.73499999999999999},"min":{"1min":0.56200000000000006,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92400000000000004,"5min":1.411,"15min":1.411},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.76800000000000002,"15min":0.73199999999999998},"min":{"1min":0.64000000000000001,"5min":0.45800000000000002,"15min":0.435},"max":{"1min":0.94599999999999995,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.73999999999999999}]},{"osd":1,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77000000000000002,"15min":0.751},"min":{"1min":0.62,"5min":0.47999999999999998,"15min":0.442},"max":{"1min":0.90700000000000003,"5min":1.077,"15min":1.077},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.54600000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91900000000000004,"5min":1.0469999999999999,"15min":1.2370000000000001},"last":0.55900000000000005}]},{"osd":2,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.749,"15min":0.73599999999999999},"min":{"1min":0.60799999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.95599999999999996,"5min":1.091,"15min":1.091},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79800000000000004,"15min":0.77600000000000002},"min":{"1min":0.60399999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98199999999999998,"5min":1.387,"15min":1.387},"last":0.84099999999999997}]},{"osd":3,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75,"15min":0.748},"min":{"1min":0.58099999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84799999999999998,"5min":1.008,"15min":1.099},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77500000000000002,"15min":0.77300000000000002},"min":{"1min":0.64700000000000002,"5min":0.496,"15min":0.46800000000000003},"max":{"1min":0.98699999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.69199999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.61699999999999999,"15min":0.60499999999999998},"min":{"1min":0.437,"5min":0.378,"15min":0.378},"max":{"1min":0.76400000000000001,"5min":0.95599999999999996,"15min":1.0029999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.627,"15min":0.61799999999999999},"min":{"1min":0.52400000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85799999999999998,"5min":0.93600000000000005,"15min":0.95199999999999996},"last":0.47899999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.621,"15min":0.62},"min":{"1min":0.48699999999999999,"5min":0.38900000000000001,"15min":0.32300000000000001},"max":{"1min":0.873,"5min":1.014,"15min":1.014},"last":0.443},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.51900000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.94599999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.625}]},{"osd":7,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.68200000000000005,"15min":0.67100000000000004},"min":{"1min":0.57199999999999995,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93200000000000005,"5min":0.94699999999999995,"15min":1.0349999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.55800000000000005,"5min":0.40300000000000002,"15min":0.36899999999999999},"max":{"1min":0.96899999999999997,"5min":1.0629999999999999,"15min":1.1080000000000001},"last":0.64700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575038,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36100,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335740,"statfs":{"total":96636764160,"available":96599797760,"internally_reserved":0,"allocated":978944,"data_stored":488301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.44900000000000001,"15min":0.44600000000000001},"min":{"1min":0.32300000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.70099999999999996,"5min":0.755,"15min":0.84199999999999997},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.309},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":1.577},"last":0.35599999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47699999999999998,"15min":0.47799999999999998},"min":{"1min":0.33100000000000002,"5min":0.315,"15min":0.29199999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.88200000000000001},"last":0.38},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54900000000000004,"15min":0.54300000000000004},"min":{"1min":0.438,"5min":0.35899999999999999,"15min":0.32600000000000001},"max":{"1min":0.71399999999999997,"5min":1.0029999999999999,"15min":1.113},"last":0.33000000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55600000000000005,"15min":0.57199999999999995},"min":{"1min":0.40999999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.82599999999999996,"5min":0.88400000000000001,"15min":1.0820000000000001},"last":0.433},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.60399999999999998},"min":{"1min":0.436,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.747,"5min":1.663,"15min":1.663},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.76800000000000002,"15min":0.76900000000000002},"min":{"1min":0.60499999999999998,"5min":0.47899999999999998,"15min":0.439},"max":{"1min":1.018,"5min":1.284,"15min":1.627},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.61699999999999999,"5min":0.56399999999999995,"15min":0.47699999999999998},"max":{"1min":1.0469999999999999,"5min":1.121,"15min":1.214},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.79800000000000004,"15min":0.79900000000000004},"min":{"1min":0.65700000000000003,"5min":0.58499999999999996,"15min":0.52400000000000002},"max":{"1min":0.997,"5min":1.306,"15min":1.333},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.55000000000000004,"5min":0.372,"15min":0.372},"max":{"1min":0.98899999999999999,"5min":1.1870000000000001,"15min":1.2470000000000001},"last":0.61699999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77700000000000002,"15min":0.78600000000000003},"min":{"1min":0.60399999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.99199999999999999,"5min":1.105,"15min":1.526},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.81699999999999995,"15min":0.82199999999999995},"min":{"1min":0.59199999999999997,"5min":0.54200000000000004,"15min":0.505},"max":{"1min":1.0109999999999999,"5min":1.2589999999999999,"15min":1.381},"last":0.69799999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.85799999999999998,"15min":0.84799999999999998},"min":{"1min":0.66400000000000003,"5min":0.55800000000000005,"15min":0.53100000000000003},"max":{"1min":1.0349999999999999,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.83799999999999997,"15min":0.83699999999999997},"min":{"1min":0.63,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.026,"5min":1.595,"15min":1.6910000000000001},"last":0.63500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575038,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58240,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313600,"statfs":{"total":96636764160,"available":96577126400,"internally_reserved":0,"allocated":974848,"data_stored":487282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.32100000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64500000000000002,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55500000000000005,"15min":0.54100000000000004},"min":{"1min":0.34100000000000003,"5min":0.32900000000000001,"15min":0.28999999999999998},"max":{"1min":0.80800000000000005,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.50700000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48599999999999999,"15min":0.47599999999999998},"min":{"1min":0.38,"5min":0.29999999999999999,"15min":0.27500000000000002},"max":{"1min":0.71599999999999997,"5min":2.7200000000000002,"15min":2.7200000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.40899999999999997,"5min":0.35999999999999999,"15min":0.33000000000000002},"max":{"1min":0.77900000000000003,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":0.55500000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.66200000000000003,"15min":0.60699999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72099999999999997,"5min":8.2530000000000001,"15min":8.2530000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.55400000000000005},"min":{"1min":0.40300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77200000000000002,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.47299999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76800000000000002,"15min":0.78300000000000003},"min":{"1min":0.61599999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.95199999999999996,"5min":1.0940000000000001,"15min":1.3049999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78500000000000003,"15min":0.80100000000000005},"min":{"1min":0.58199999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.006,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.91800000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.86299999999999999,"15min":0.86599999999999999},"min":{"1min":0.64600000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0640000000000001,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.84299999999999997,"15min":0.84399999999999997},"min":{"1min":0.57799999999999996,"5min":0.55600000000000005,"15min":0.433},"max":{"1min":1.081,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.93899999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.81100000000000005,"15min":0.80700000000000005},"min":{"1min":0.60399999999999998,"5min":0.48999999999999999,"15min":0.47599999999999998},"max":{"1min":0.99099999999999999,"5min":3.9849999999999999,"15min":3.9849999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82199999999999995,"15min":0.81699999999999995},"min":{"1min":0.64600000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98499999999999999,"5min":3.391,"15min":3.391},"last":0.69099999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.81799999999999995,"15min":0.82799999999999996},"min":{"1min":0.61099999999999999,"5min":0.5,"15min":0.5},"max":{"1min":1.022,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.87},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83399999999999996,"15min":0.82599999999999996},"min":{"1min":0.66900000000000004,"5min":0.53200000000000003,"15min":0.50900000000000001},"max":{"1min":1.0069999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.77100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575039,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36100,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335740,"statfs":{"total":96636764160,"available":96599797760,"internally_reserved":0,"allocated":978944,"data_stored":488301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.439,"15min":0.43099999999999999},"min":{"1min":0.317,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.65400000000000003,"5min":0.67200000000000004,"15min":0.77200000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.51800000000000002,"15min":0.504},"min":{"1min":0.34799999999999998,"5min":0.28199999999999997,"15min":0.26500000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47599999999999998,"15min":0.47199999999999998},"min":{"1min":0.34599999999999997,"5min":0.32100000000000001,"15min":0.29499999999999998},"max":{"1min":0.67900000000000005,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.38200000000000001,"5min":0.30599999999999999,"15min":0.29299999999999998},"max":{"1min":0.74399999999999999,"5min":1.014,"15min":1.014},"last":0.505}]},{"osd":3,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.55100000000000005,"5min":0.44700000000000001,"15min":0.432},"max":{"1min":0.80300000000000005,"5min":0.86899999999999999,"15min":0.96299999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.57999999999999996},"min":{"1min":0.46200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.80300000000000005,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.54600000000000004}]},{"osd":4,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.79300000000000004,"15min":0.78400000000000003},"min":{"1min":0.61299999999999999,"5min":0.51300000000000001,"15min":0.40000000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.236},"last":0.997},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.77800000000000002,"15min":0.78500000000000003},"min":{"1min":0.54900000000000004,"5min":0.502,"15min":0.45700000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.93799999999999994}]},{"osd":5,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.67900000000000005,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":1.1000000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.81200000000000006,"15min":0.80400000000000005},"min":{"1min":0.56999999999999995,"5min":0.48599999999999999,"15min":0.48199999999999998},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.3600000000000001},"last":0.85899999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.80000000000000004,"15min":0.80200000000000005},"min":{"1min":0.58299999999999996,"5min":0.503,"15min":0.48499999999999999},"max":{"1min":1.1120000000000001,"5min":1.2170000000000001,"15min":1.274},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.82899999999999996,"15min":0.81799999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.49199999999999999},"max":{"1min":1.1319999999999999,"5min":1.262,"15min":1.2969999999999999},"last":1.044}]},{"osd":7,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.79700000000000004},"min":{"1min":0.62,"5min":0.55200000000000005,"15min":0.47799999999999998},"max":{"1min":1.1579999999999999,"5min":1.1859999999999999,"15min":1.3400000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.87,"5min":0.84599999999999997,"15min":0.84199999999999997},"min":{"1min":0.60799999999999998,"5min":0.53700000000000003,"15min":0.52800000000000002},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.0820000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575040,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36664,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335176,"statfs":{"total":96636764160,"available":96599220224,"internally_reserved":0,"allocated":1556480,"data_stored":1071030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47099999999999997,"15min":0.45300000000000001},"min":{"1min":0.30199999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.76500000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.33000000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":1.452},"last":0.47499999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53800000000000003,"15min":0.52000000000000002},"min":{"1min":0.39800000000000002,"5min":0.35799999999999998,"15min":0.34100000000000003},"max":{"1min":0.84499999999999997,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.376,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71699999999999997,"5min":0.80300000000000005,"15min":1.5700000000000001},"last":0.58499999999999996}]},{"osd":3,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.499,"15min":0.50700000000000001},"min":{"1min":0.432,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.99299999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77100000000000002,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.82899999999999996}]},{"osd":4,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.79900000000000004,"15min":0.79000000000000004},"min":{"1min":0.55200000000000005,"5min":0.48399999999999999,"15min":0.44400000000000001},"max":{"1min":1.21,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81999999999999995,"15min":0.81100000000000005},"min":{"1min":0.57999999999999996,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.03,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.88600000000000001}]},{"osd":5,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81000000000000005,"15min":0.81100000000000005},"min":{"1min":0.56999999999999995,"5min":0.51800000000000002,"15min":0.47899999999999998},"max":{"1min":1.042,"5min":1.3839999999999999,"15min":1.4950000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.80000000000000004,"15min":0.80100000000000005},"min":{"1min":0.621,"5min":0.49299999999999999,"15min":0.47299999999999998},"max":{"1min":1.069,"5min":1.325,"15min":1.325},"last":0.84999999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.82299999999999995,"15min":0.81399999999999995},"min":{"1min":0.58699999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.05,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.63900000000000001,"5min":0.50600000000000001,"15min":0.41299999999999998},"max":{"1min":1.044,"5min":1.3440000000000001,"15min":1.5369999999999999},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.82899999999999996,"15min":0.83799999999999997},"min":{"1min":0.60599999999999998,"5min":0.503,"15min":0.45500000000000002},"max":{"1min":1.1180000000000001,"5min":1.2749999999999999,"15min":1.603},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.80500000000000005,"15min":0.81799999999999995},"min":{"1min":0.65100000000000002,"5min":0.502,"15min":0.497},"max":{"1min":1.0880000000000001,"5min":1.381,"15min":1.381},"last":0.80500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:08:28.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3f is not active+clean 2023-07-14T13:08:28.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.874656+0000', 'last_change': '2023-07-14T13:08:22.874656+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.874656+0000', 'last_undegraded': '2023-07-14T13:08:22.874656+0000', 'last_fullsized': '2023-07-14T13:08:22.874656+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:08:28.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3e is not active+clean 2023-07-14T13:08:28.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.875595+0000', 'last_change': '2023-07-14T13:08:22.875595+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.875595+0000', 'last_undegraded': '2023-07-14T13:08:22.875595+0000', 'last_fullsized': '2023-07-14T13:08:22.875595+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:08:28.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3d is not active+clean 2023-07-14T13:08:28.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.881004+0000', 'last_change': '2023-07-14T13:08:22.881004+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.881004+0000', 'last_undegraded': '2023-07-14T13:08:22.881004+0000', 'last_fullsized': '2023-07-14T13:08:22.881004+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:08:28.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3c is not active+clean 2023-07-14T13:08:28.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.877032+0000', 'last_change': '2023-07-14T13:08:22.877032+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.877032+0000', 'last_undegraded': '2023-07-14T13:08:22.877032+0000', 'last_fullsized': '2023-07-14T13:08:22.877032+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:08:28.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3b is not active+clean 2023-07-14T13:08:28.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.881951+0000', 'last_change': '2023-07-14T13:08:22.881951+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.881951+0000', 'last_undegraded': '2023-07-14T13:08:22.881951+0000', 'last_fullsized': '2023-07-14T13:08:22.881951+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:08:28.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3a is not active+clean 2023-07-14T13:08:28.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.874852+0000', 'last_change': '2023-07-14T13:08:22.874852+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.874852+0000', 'last_undegraded': '2023-07-14T13:08:22.874852+0000', 'last_fullsized': '2023-07-14T13:08:22.874852+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:08:28.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.39 is not active+clean 2023-07-14T13:08:28.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.877520+0000', 'last_change': '2023-07-14T13:08:22.877520+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.877520+0000', 'last_undegraded': '2023-07-14T13:08:22.877520+0000', 'last_fullsized': '2023-07-14T13:08:22.877520+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:08:28.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.38 is not active+clean 2023-07-14T13:08:28.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.880131+0000', 'last_change': '2023-07-14T13:08:22.880131+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.880131+0000', 'last_undegraded': '2023-07-14T13:08:22.880131+0000', 'last_fullsized': '2023-07-14T13:08:22.880131+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:08:28.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.37 is not active+clean 2023-07-14T13:08:28.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.884955+0000', 'last_change': '2023-07-14T13:08:22.884955+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.884955+0000', 'last_undegraded': '2023-07-14T13:08:22.884955+0000', 'last_fullsized': '2023-07-14T13:08:22.884955+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:08:28.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.36 is not active+clean 2023-07-14T13:08:28.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.878859+0000', 'last_change': '2023-07-14T13:08:22.878859+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.878859+0000', 'last_undegraded': '2023-07-14T13:08:22.878859+0000', 'last_fullsized': '2023-07-14T13:08:22.878859+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:08:28.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.35 is not active+clean 2023-07-14T13:08:28.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.878049+0000', 'last_change': '2023-07-14T13:08:22.878049+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.878049+0000', 'last_undegraded': '2023-07-14T13:08:22.878049+0000', 'last_fullsized': '2023-07-14T13:08:22.878049+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:08:28.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.34 is not active+clean 2023-07-14T13:08:28.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.881668+0000', 'last_change': '2023-07-14T13:08:22.881668+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.881668+0000', 'last_undegraded': '2023-07-14T13:08:22.881668+0000', 'last_fullsized': '2023-07-14T13:08:22.881668+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:08:28.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.33 is not active+clean 2023-07-14T13:08:28.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.881867+0000', 'last_change': '2023-07-14T13:08:22.881867+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.881867+0000', 'last_undegraded': '2023-07-14T13:08:22.881867+0000', 'last_fullsized': '2023-07-14T13:08:22.881867+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:08:28.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.32 is not active+clean 2023-07-14T13:08:28.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.879097+0000', 'last_change': '2023-07-14T13:08:22.879097+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.879097+0000', 'last_undegraded': '2023-07-14T13:08:22.879097+0000', 'last_fullsized': '2023-07-14T13:08:22.879097+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:08:28.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.31 is not active+clean 2023-07-14T13:08:28.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.884027+0000', 'last_change': '2023-07-14T13:08:22.884027+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.884027+0000', 'last_undegraded': '2023-07-14T13:08:22.884027+0000', 'last_fullsized': '2023-07-14T13:08:22.884027+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:08:28.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.30 is not active+clean 2023-07-14T13:08:28.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.878091+0000', 'last_change': '2023-07-14T13:08:22.878091+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.878091+0000', 'last_undegraded': '2023-07-14T13:08:22.878091+0000', 'last_fullsized': '2023-07-14T13:08:22.878091+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:08:28.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2f is not active+clean 2023-07-14T13:08:28.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.874124+0000', 'last_change': '2023-07-14T13:08:22.874124+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.874124+0000', 'last_undegraded': '2023-07-14T13:08:22.874124+0000', 'last_fullsized': '2023-07-14T13:08:22.874124+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:08:28.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2e is not active+clean 2023-07-14T13:08:28.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.876616+0000', 'last_change': '2023-07-14T13:08:22.876616+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.876616+0000', 'last_undegraded': '2023-07-14T13:08:22.876616+0000', 'last_fullsized': '2023-07-14T13:08:22.876616+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:08:28.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2d is not active+clean 2023-07-14T13:08:28.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.880454+0000', 'last_change': '2023-07-14T13:08:22.880454+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.880454+0000', 'last_undegraded': '2023-07-14T13:08:22.880454+0000', 'last_fullsized': '2023-07-14T13:08:22.880454+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:08:28.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2c is not active+clean 2023-07-14T13:08:28.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.876197+0000', 'last_change': '2023-07-14T13:08:22.876197+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.876197+0000', 'last_undegraded': '2023-07-14T13:08:22.876197+0000', 'last_fullsized': '2023-07-14T13:08:22.876197+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:08:28.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2b is not active+clean 2023-07-14T13:08:28.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.881312+0000', 'last_change': '2023-07-14T13:08:22.881312+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.881312+0000', 'last_undegraded': '2023-07-14T13:08:22.881312+0000', 'last_fullsized': '2023-07-14T13:08:22.881312+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:08:28.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2a is not active+clean 2023-07-14T13:08:28.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.879148+0000', 'last_change': '2023-07-14T13:08:22.879148+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.879148+0000', 'last_undegraded': '2023-07-14T13:08:22.879148+0000', 'last_fullsized': '2023-07-14T13:08:22.879148+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:08:28.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.29 is not active+clean 2023-07-14T13:08:28.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.878744+0000', 'last_change': '2023-07-14T13:08:22.878744+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.878744+0000', 'last_undegraded': '2023-07-14T13:08:22.878744+0000', 'last_fullsized': '2023-07-14T13:08:22.878744+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:08:28.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.28 is not active+clean 2023-07-14T13:08:28.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.884697+0000', 'last_change': '2023-07-14T13:08:22.884697+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.884697+0000', 'last_undegraded': '2023-07-14T13:08:22.884697+0000', 'last_fullsized': '2023-07-14T13:08:22.884697+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:08:28.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.27 is not active+clean 2023-07-14T13:08:28.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.883558+0000', 'last_change': '2023-07-14T13:08:22.883558+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.883558+0000', 'last_undegraded': '2023-07-14T13:08:22.883558+0000', 'last_fullsized': '2023-07-14T13:08:22.883558+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:08:28.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.26 is not active+clean 2023-07-14T13:08:28.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.883234+0000', 'last_change': '2023-07-14T13:08:22.883234+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.883234+0000', 'last_undegraded': '2023-07-14T13:08:22.883234+0000', 'last_fullsized': '2023-07-14T13:08:22.883234+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:08:28.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.25 is not active+clean 2023-07-14T13:08:28.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.876532+0000', 'last_change': '2023-07-14T13:08:22.876532+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.876532+0000', 'last_undegraded': '2023-07-14T13:08:22.876532+0000', 'last_fullsized': '2023-07-14T13:08:22.876532+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:08:28.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.24 is not active+clean 2023-07-14T13:08:28.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.873908+0000', 'last_change': '2023-07-14T13:08:22.873908+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.873908+0000', 'last_undegraded': '2023-07-14T13:08:22.873908+0000', 'last_fullsized': '2023-07-14T13:08:22.873908+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:08:28.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.23 is not active+clean 2023-07-14T13:08:28.829 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.880128+0000', 'last_change': '2023-07-14T13:08:22.880128+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.880128+0000', 'last_undegraded': '2023-07-14T13:08:22.880128+0000', 'last_fullsized': '2023-07-14T13:08:22.880128+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:08:28.829 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.22 is not active+clean 2023-07-14T13:08:28.829 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.881491+0000', 'last_change': '2023-07-14T13:08:22.881491+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.881491+0000', 'last_undegraded': '2023-07-14T13:08:22.881491+0000', 'last_fullsized': '2023-07-14T13:08:22.881491+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:08:28.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.21 is not active+clean 2023-07-14T13:08:28.830 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.877794+0000', 'last_change': '2023-07-14T13:08:22.877794+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.877794+0000', 'last_undegraded': '2023-07-14T13:08:22.877794+0000', 'last_fullsized': '2023-07-14T13:08:22.877794+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:08:28.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.20 is not active+clean 2023-07-14T13:08:28.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.876787+0000', 'last_change': '2023-07-14T13:08:22.876787+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.876787+0000', 'last_undegraded': '2023-07-14T13:08:22.876787+0000', 'last_fullsized': '2023-07-14T13:08:22.876787+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:08:28.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-07-14T13:08:28.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.880076+0000', 'last_change': '2023-07-14T13:08:22.880076+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.880076+0000', 'last_undegraded': '2023-07-14T13:08:22.880076+0000', 'last_fullsized': '2023-07-14T13:08:22.880076+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:08:28.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-07-14T13:08:28.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.875717+0000', 'last_change': '2023-07-14T13:08:22.875717+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.875717+0000', 'last_undegraded': '2023-07-14T13:08:22.875717+0000', 'last_fullsized': '2023-07-14T13:08:22.875717+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:08:28.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2023-07-14T13:08:28.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.875437+0000', 'last_change': '2023-07-14T13:08:22.875437+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.875437+0000', 'last_undegraded': '2023-07-14T13:08:22.875437+0000', 'last_fullsized': '2023-07-14T13:08:22.875437+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:08:28.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-07-14T13:08:28.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.885416+0000', 'last_change': '2023-07-14T13:08:22.885416+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.885416+0000', 'last_undegraded': '2023-07-14T13:08:22.885416+0000', 'last_fullsized': '2023-07-14T13:08:22.885416+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:08:28.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2023-07-14T13:08:28.834 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.877566+0000', 'last_change': '2023-07-14T13:08:22.877566+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.877566+0000', 'last_undegraded': '2023-07-14T13:08:22.877566+0000', 'last_fullsized': '2023-07-14T13:08:22.877566+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:08:28.834 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2023-07-14T13:08:28.834 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.873445+0000', 'last_change': '2023-07-14T13:08:22.873445+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.873445+0000', 'last_undegraded': '2023-07-14T13:08:22.873445+0000', 'last_fullsized': '2023-07-14T13:08:22.873445+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:08:28.835 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-07-14T13:08:28.835 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.884122+0000', 'last_change': '2023-07-14T13:08:22.884122+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.884122+0000', 'last_undegraded': '2023-07-14T13:08:22.884122+0000', 'last_fullsized': '2023-07-14T13:08:22.884122+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:08:28.835 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2023-07-14T13:08:28.836 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.875343+0000', 'last_change': '2023-07-14T13:08:22.875343+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.875343+0000', 'last_undegraded': '2023-07-14T13:08:22.875343+0000', 'last_fullsized': '2023-07-14T13:08:22.875343+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:08:28.836 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2023-07-14T13:08:28.836 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.873301+0000', 'last_change': '2023-07-14T13:08:22.873301+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.873301+0000', 'last_undegraded': '2023-07-14T13:08:22.873301+0000', 'last_fullsized': '2023-07-14T13:08:22.873301+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:08:28.837 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2023-07-14T13:08:28.837 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.874124+0000', 'last_change': '2023-07-14T13:08:22.874124+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.874124+0000', 'last_undegraded': '2023-07-14T13:08:22.874124+0000', 'last_fullsized': '2023-07-14T13:08:22.874124+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:08:28.837 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2023-07-14T13:08:28.837 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.880896+0000', 'last_change': '2023-07-14T13:08:22.880896+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.880896+0000', 'last_undegraded': '2023-07-14T13:08:22.880896+0000', 'last_fullsized': '2023-07-14T13:08:22.880896+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:08:28.838 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-07-14T13:08:28.838 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.875703+0000', 'last_change': '2023-07-14T13:08:22.875703+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.875703+0000', 'last_undegraded': '2023-07-14T13:08:22.875703+0000', 'last_fullsized': '2023-07-14T13:08:22.875703+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:08:28.838 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-07-14T13:08:28.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.875703+0000', 'last_change': '2023-07-14T13:08:22.875703+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.875703+0000', 'last_undegraded': '2023-07-14T13:08:22.875703+0000', 'last_fullsized': '2023-07-14T13:08:22.875703+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:08:28.839 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-07-14T13:08:28.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.880817+0000', 'last_change': '2023-07-14T13:08:22.880817+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.880817+0000', 'last_undegraded': '2023-07-14T13:08:22.880817+0000', 'last_fullsized': '2023-07-14T13:08:22.880817+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:08:28.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2023-07-14T13:08:28.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.883675+0000', 'last_change': '2023-07-14T13:08:22.883675+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.883675+0000', 'last_undegraded': '2023-07-14T13:08:22.883675+0000', 'last_fullsized': '2023-07-14T13:08:22.883675+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:08:28.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2023-07-14T13:08:28.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.872577+0000', 'last_change': '2023-07-14T13:08:22.872577+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.872577+0000', 'last_undegraded': '2023-07-14T13:08:22.872577+0000', 'last_fullsized': '2023-07-14T13:08:22.872577+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:08:28.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2023-07-14T13:08:28.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.874264+0000', 'last_change': '2023-07-14T13:08:22.874264+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.874264+0000', 'last_undegraded': '2023-07-14T13:08:22.874264+0000', 'last_fullsized': '2023-07-14T13:08:22.874264+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:08:28.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2023-07-14T13:08:28.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.877483+0000', 'last_change': '2023-07-14T13:08:22.877483+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.877483+0000', 'last_undegraded': '2023-07-14T13:08:22.877483+0000', 'last_fullsized': '2023-07-14T13:08:22.877483+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:08:28.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-07-14T13:08:28.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.882704+0000', 'last_change': '2023-07-14T13:08:22.882704+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.882704+0000', 'last_undegraded': '2023-07-14T13:08:22.882704+0000', 'last_fullsized': '2023-07-14T13:08:22.882704+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:08:28.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2023-07-14T13:08:28.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.881843+0000', 'last_change': '2023-07-14T13:08:22.881843+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.881843+0000', 'last_undegraded': '2023-07-14T13:08:22.881843+0000', 'last_fullsized': '2023-07-14T13:08:22.881843+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:08:28.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2023-07-14T13:08:28.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.882574+0000', 'last_change': '2023-07-14T13:08:22.882574+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.882574+0000', 'last_undegraded': '2023-07-14T13:08:22.882574+0000', 'last_fullsized': '2023-07-14T13:08:22.882574+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:08:28.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-07-14T13:08:28.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.875833+0000', 'last_change': '2023-07-14T13:08:22.875833+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.875833+0000', 'last_undegraded': '2023-07-14T13:08:22.875833+0000', 'last_fullsized': '2023-07-14T13:08:22.875833+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:08:28.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2023-07-14T13:08:28.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.872492+0000', 'last_change': '2023-07-14T13:08:22.872492+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.872492+0000', 'last_undegraded': '2023-07-14T13:08:22.872492+0000', 'last_fullsized': '2023-07-14T13:08:22.872492+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:08:28.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2023-07-14T13:08:28.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.878334+0000', 'last_change': '2023-07-14T13:08:22.878334+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.878334+0000', 'last_undegraded': '2023-07-14T13:08:22.878334+0000', 'last_fullsized': '2023-07-14T13:08:22.878334+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:08:28.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-07-14T13:08:28.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.881449+0000', 'last_change': '2023-07-14T13:08:22.881449+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.881449+0000', 'last_undegraded': '2023-07-14T13:08:22.881449+0000', 'last_fullsized': '2023-07-14T13:08:22.881449+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:08:28.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2023-07-14T13:08:28.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.873769+0000', 'last_change': '2023-07-14T13:08:22.873769+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.873769+0000', 'last_undegraded': '2023-07-14T13:08:22.873769+0000', 'last_fullsized': '2023-07-14T13:08:22.873769+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:08:28.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-07-14T13:08:28.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.880317+0000', 'last_change': '2023-07-14T13:08:22.880317+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.880317+0000', 'last_undegraded': '2023-07-14T13:08:22.880317+0000', 'last_fullsized': '2023-07-14T13:08:22.880317+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:08:28.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2023-07-14T13:08:28.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.879882+0000', 'last_change': '2023-07-14T13:08:22.879882+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.879882+0000', 'last_undegraded': '2023-07-14T13:08:22.879882+0000', 'last_fullsized': '2023-07-14T13:08:22.879882+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:08:28.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-07-14T13:08:28.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.880578+0000', 'last_change': '2023-07-14T13:08:22.880578+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.880578+0000', 'last_undegraded': '2023-07-14T13:08:22.880578+0000', 'last_fullsized': '2023-07-14T13:08:22.880578+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:08:28.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-07-14T13:08:28.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.879839+0000', 'last_change': '2023-07-14T13:08:22.879839+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.879839+0000', 'last_undegraded': '2023-07-14T13:08:22.879839+0000', 'last_fullsized': '2023-07-14T13:08:22.879839+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:08:28.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-07-14T13:08:28.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.876091+0000', 'last_change': '2023-07-14T13:08:22.876091+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.876091+0000', 'last_undegraded': '2023-07-14T13:08:22.876091+0000', 'last_fullsized': '2023-07-14T13:08:22.876091+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:08:28.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2023-07-14T13:08:28.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:08:22.881311+0000', 'last_change': '2023-07-14T13:08:22.881311+0000', 'last_active': '2023-07-14T13:08:22.857040+0000', 'last_peered': '2023-07-14T13:08:22.857040+0000', 'last_clean': '2023-07-14T13:08:22.857040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:08:22.881311+0000', 'last_undegraded': '2023-07-14T13:08:22.881311+0000', 'last_fullsized': '2023-07-14T13:08:22.881311+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'last_clean_scrub_stamp': '2023-07-14T13:08:22.857040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:08:28.851 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-14T13:08:28.876 INFO:tasks.ceph.mds.a.smithi005.stderr:2023-07-14T13:08:28.844+0000 7fa4ccde1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T13:08:28.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.960+0000 7fb3cdaf7640 1 Processor -- start 2023-07-14T13:08:28.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.960+0000 7fb3cdaf7640 1 -- start start 2023-07-14T13:08:28.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.964+0000 7fb3cdaf7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3c815f3f0 0x7fb3c80b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:28.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.964+0000 7fb3cdaf7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb3c80b7bc0 0x7fb3c80cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:28.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.964+0000 7fb3cdaf7640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c80d0f60 con 0x7fb3c80d13f0 2023-07-14T13:08:28.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.964+0000 7fb3cdaf7640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c80b7ff0 con 0x7fb3c80b7bc0 2023-07-14T13:08:28.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.964+0000 7fb3cdaf7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c80d0390 con 0x7fb3c815f3f0 2023-07-14T13:08:28.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.964+0000 7fb3c7fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb3c80d13f0 0x7fb3c80cc9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58124/0 (socket says 172.21.15.5:58124) 2023-07-14T13:08:28.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.964+0000 7fb3cd2f6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb3c80b7bc0 0x7fb3c80cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:28.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.964+0000 7fb3c7fff640 1 -- 172.21.15.5:0/3786782459 learned_addr learned my addr 172.21.15.5:0/3786782459 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:28.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.964+0000 7fb3ccaf5640 1 --2- 172.21.15.5:0/3786782459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3c815f3f0 0x7fb3c80b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:28.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.964+0000 7fb3c77fe640 1 -- 172.21.15.5:0/3786782459 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1148847082 0 0) 0x7fb3c80d0f60 con 0x7fb3c80d13f0 2023-07-14T13:08:28.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.964+0000 7fb3cd2f6640 1 -- 172.21.15.5:0/3786782459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3c815f3f0 msgr2=0x7fb3c80b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:28.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.964+0000 7fb3cd2f6640 1 --2- 172.21.15.5:0/3786782459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3c815f3f0 0x7fb3c80b7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:28.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.964+0000 7fb3cd2f6640 1 -- 172.21.15.5:0/3786782459 >> v1:172.21.15.5:6789/0 conn(0x7fb3c80d13f0 legacy=0x7fb3c80cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:28.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.964+0000 7fb3cd2f6640 1 -- 172.21.15.5:0/3786782459 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c80d0630 con 0x7fb3c80b7bc0 2023-07-14T13:08:29.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.968+0000 7fb3cd2f6640 1 --2- 172.21.15.5:0/3786782459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3c80b7bc0 0x7fb3c80cd0b0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009d90 tx=0x7fb3c001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec08a23b2586da4d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:29.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.968+0000 7fb3c77fe640 1 -- 172.21.15.5:0/3786782459 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c00a5870 con 0x7fb3c80b7bc0 2023-07-14T13:08:29.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.968+0000 7fb3c77fe640 1 -- 172.21.15.5:0/3786782459 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c00a59d0 con 0x7fb3c80b7bc0 2023-07-14T13:08:29.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.968+0000 7fb3c77fe640 1 -- 172.21.15.5:0/3786782459 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c00a5d60 con 0x7fb3c80b7bc0 2023-07-14T13:08:29.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.968+0000 7fb3cdaf7640 1 -- 172.21.15.5:0/3786782459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3c80b7bc0 msgr2=0x7fb3c80cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:29.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.968+0000 7fb3cdaf7640 1 --2- 172.21.15.5:0/3786782459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3c80b7bc0 0x7fb3c80cd0b0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009d90 tx=0x7fb3c001c8c0 comp rx=0 tx=0).stop 2023-07-14T13:08:29.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.968+0000 7fb3cdaf7640 1 -- 172.21.15.5:0/3786782459 shutdown_connections 2023-07-14T13:08:29.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.968+0000 7fb3cdaf7640 1 --2- 172.21.15.5:0/3786782459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3c80b7bc0 0x7fb3c80cd0b0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:29.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.968+0000 7fb3cdaf7640 1 --2- 172.21.15.5:0/3786782459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3c815f3f0 0x7fb3c80b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:29.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.968+0000 7fb3cdaf7640 1 -- 172.21.15.5:0/3786782459 >> 172.21.15.5:0/3786782459 conn(0x7fb3c8069f50 msgr2=0x7fb3c806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:29.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.968+0000 7fb3cdaf7640 1 -- 172.21.15.5:0/3786782459 shutdown_connections 2023-07-14T13:08:29.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.968+0000 7fb3cdaf7640 1 -- 172.21.15.5:0/3786782459 wait complete. 2023-07-14T13:08:29.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.968+0000 7fb3cdaf7640 1 Processor -- start 2023-07-14T13:08:29.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.968+0000 7fb3cdaf7640 1 -- start start 2023-07-14T13:08:29.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.968+0000 7fb3cdaf7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3c80b7bc0 0x7fb3c8152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:29.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.968+0000 7fb3cdaf7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3c80d13f0 0x7fb3c8154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:29.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.968+0000 7fb3cdaf7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3c815f3f0 0x7fb3c8150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:29.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.968+0000 7fb3cdaf7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c81564c0 con 0x7fb3c815f3f0 2023-07-14T13:08:29.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.968+0000 7fb3cdaf7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c81550b0 con 0x7fb3c80d13f0 2023-07-14T13:08:29.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.968+0000 7fb3cdaf7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c8156760 con 0x7fb3c80b7bc0 2023-07-14T13:08:29.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.972+0000 7fb3cd2f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3c815f3f0 0x7fb3c8150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:29.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.972+0000 7fb3cd2f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3c815f3f0 0x7fb3c8150970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38768/0 (socket says 172.21.15.5:38768) 2023-07-14T13:08:29.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.972+0000 7fb3cd2f6640 1 -- 172.21.15.5:0/1640654412 learned_addr learned my addr 172.21.15.5:0/1640654412 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:29.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.972+0000 7fb3ccaf5640 1 --2- 172.21.15.5:0/1640654412 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3c80b7bc0 0x7fb3c8152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:29.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.972+0000 7fb3c7fff640 1 --2- 172.21.15.5:0/1640654412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3c80d13f0 0x7fb3c8154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:29.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.972+0000 7fb3cd2f6640 1 -- 172.21.15.5:0/1640654412 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3c80b7bc0 msgr2=0x7fb3c8152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:29.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.972+0000 7fb3cd2f6640 1 --2- 172.21.15.5:0/1640654412 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3c80b7bc0 0x7fb3c8152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:29.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.972+0000 7fb3cd2f6640 1 -- 172.21.15.5:0/1640654412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3c80d13f0 msgr2=0x7fb3c8154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:29.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.972+0000 7fb3cd2f6640 1 --2- 172.21.15.5:0/1640654412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3c80d13f0 0x7fb3c8154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:29.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.972+0000 7fb3cd2f6640 1 -- 172.21.15.5:0/1640654412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c0009a70 con 0x7fb3c815f3f0 2023-07-14T13:08:29.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.972+0000 7fb3ccaf5640 1 --2- 172.21.15.5:0/1640654412 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3c80b7bc0 0x7fb3c8152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:08:29.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.972+0000 7fb3c7fff640 1 --2- 172.21.15.5:0/1640654412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3c80d13f0 0x7fb3c8154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:08:29.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.972+0000 7fb3cd2f6640 1 --2- 172.21.15.5:0/1640654412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3c815f3f0 0x7fb3c8150970 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fb3c00b0040 tx=0x7fb3c0019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:29.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.972+0000 7fb3c57fa640 1 -- 172.21.15.5:0/1640654412 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c00b9860 con 0x7fb3c815f3f0 2023-07-14T13:08:29.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.972+0000 7fb3c57fa640 1 -- 172.21.15.5:0/1640654412 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c00b99c0 con 0x7fb3c815f3f0 2023-07-14T13:08:29.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.972+0000 7fb3c57fa640 1 -- 172.21.15.5:0/1640654412 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c00b9d70 con 0x7fb3c815f3f0 2023-07-14T13:08:29.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.972+0000 7fb3cdaf7640 1 -- 172.21.15.5:0/1640654412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c8156a40 con 0x7fb3c815f3f0 2023-07-14T13:08:29.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.972+0000 7fb3cdaf7640 1 -- 172.21.15.5:0/1640654412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c8153480 con 0x7fb3c815f3f0 2023-07-14T13:08:29.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.972+0000 7fb3cdaf7640 1 -- 172.21.15.5:0/1640654412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c80678d0 con 0x7fb3c815f3f0 2023-07-14T13:08:29.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.972+0000 7fb3c57fa640 1 -- 172.21.15.5:0/1640654412 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb3c00ad440 con 0x7fb3c815f3f0 2023-07-14T13:08:29.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.976+0000 7fb3c57fa640 1 --2- 172.21.15.5:0/1640654412 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fb3ac0663a0 0x7fb3ac068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:29.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.976+0000 7fb3c57fa640 1 -- 172.21.15.5:0/1640654412 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb3c011f230 con 0x7fb3c815f3f0 2023-07-14T13:08:29.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.976+0000 7fb3ccaf5640 1 --2- 172.21.15.5:0/1640654412 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fb3ac0663a0 0x7fb3ac068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:29.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.976+0000 7fb3ccaf5640 1 --2- 172.21.15.5:0/1640654412 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fb3ac0663a0 0x7fb3ac068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc0097a0 tx=0x7fb3bc008040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:29.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:28.980+0000 7fb3c57fa640 1 -- 172.21.15.5:0/1640654412 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb3c00ec750 con 0x7fb3c815f3f0 2023-07-14T13:08:29.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.184+0000 7fb3cdaf7640 1 -- 172.21.15.5:0/1640654412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb3c8156ef0 con 0x7fb3c815f3f0 2023-07-14T13:08:29.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.188+0000 7fb3c57fa640 1 -- 172.21.15.5:0/1640654412 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3229 (secure 0 0 0) 0x7fb3c00efd70 con 0x7fb3c815f3f0 2023-07-14T13:08:29.221 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:29.221 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":968,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":83,"num_osds":8,"num_up_osds":8,"osd_up_since":1689339152,"num_in_osds":8,"osd_in_since":1689339143,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":321253376,"bytes_avail":772772859904,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":32,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":6576}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2023-07-14T13:08:11.511033+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-14T13:08:29.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.188+0000 7fb3cdaf7640 1 -- 172.21.15.5:0/1640654412 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fb3ac0663a0 msgr2=0x7fb3ac068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:29.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.188+0000 7fb3cdaf7640 1 --2- 172.21.15.5:0/1640654412 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fb3ac0663a0 0x7fb3ac068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc0097a0 tx=0x7fb3bc008040 comp rx=0 tx=0).stop 2023-07-14T13:08:29.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.188+0000 7fb3cdaf7640 1 -- 172.21.15.5:0/1640654412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3c815f3f0 msgr2=0x7fb3c8150970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:29.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.188+0000 7fb3cdaf7640 1 --2- 172.21.15.5:0/1640654412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3c815f3f0 0x7fb3c8150970 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fb3c00b0040 tx=0x7fb3c0019660 comp rx=0 tx=0).stop 2023-07-14T13:08:29.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.188+0000 7fb3cdaf7640 1 -- 172.21.15.5:0/1640654412 shutdown_connections 2023-07-14T13:08:29.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.188+0000 7fb3cdaf7640 1 --2- 172.21.15.5:0/1640654412 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fb3ac0663a0 0x7fb3ac068850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:29.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.188+0000 7fb3cdaf7640 1 --2- 172.21.15.5:0/1640654412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3c815f3f0 0x7fb3c8150970 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:29.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.188+0000 7fb3cdaf7640 1 --2- 172.21.15.5:0/1640654412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3c80d13f0 0x7fb3c8154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:29.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.188+0000 7fb3cdaf7640 1 --2- 172.21.15.5:0/1640654412 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3c80b7bc0 0x7fb3c8152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:29.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.188+0000 7fb3cdaf7640 1 -- 172.21.15.5:0/1640654412 >> 172.21.15.5:0/1640654412 conn(0x7fb3c8069f50 msgr2=0x7fb3c80cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:29.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.188+0000 7fb3cdaf7640 1 -- 172.21.15.5:0/1640654412 shutdown_connections 2023-07-14T13:08:29.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.188+0000 7fb3cdaf7640 1 -- 172.21.15.5:0/1640654412 wait complete. 2023-07-14T13:08:29.241 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-14T13:08:29.242 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:08:29.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.392+0000 7fca68740640 1 Processor -- start 2023-07-14T13:08:29.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.392+0000 7fca68740640 1 -- start start 2023-07-14T13:08:29.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.392+0000 7fca68740640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fca60158ce0 0x7fca60070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:29.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.392+0000 7fca68740640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca600c8ad0 0x7fca600c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:29.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.392+0000 7fca68740640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca600c9560 0x7fca600cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:29.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.392+0000 7fca68740640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca600c99e0 con 0x7fca600c8ad0 2023-07-14T13:08:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.392+0000 7fca68740640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca600cc700 con 0x7fca60158ce0 2023-07-14T13:08:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.392+0000 7fca68740640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca600b0ff0 con 0x7fca600c9560 2023-07-14T13:08:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.392+0000 7fca65cdb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca600c8ad0 0x7fca600c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.392+0000 7fca65cdb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca600c8ad0 0x7fca600c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51770/0 (socket says 172.21.15.5:51770) 2023-07-14T13:08:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.392+0000 7fca65cdb640 1 -- 172.21.15.5:0/3111330494 learned_addr learned my addr 172.21.15.5:0/3111330494 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.392+0000 7fca664dc640 1 --2- 172.21.15.5:0/3111330494 >> v2:172.21.15.154:3300/0 conn(0x7fca60158ce0 0x7fca60070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.392+0000 7fca66cdd640 1 --2- 172.21.15.5:0/3111330494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca600c9560 0x7fca600cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:29.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.396+0000 7fca65cdb640 1 -- 172.21.15.5:0/3111330494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca600c9560 msgr2=0x7fca600cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:29.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.396+0000 7fca65cdb640 1 --2- 172.21.15.5:0/3111330494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca600c9560 0x7fca600cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:29.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.396+0000 7fca65cdb640 1 -- 172.21.15.5:0/3111330494 >> v2:172.21.15.154:3300/0 conn(0x7fca60158ce0 msgr2=0x7fca60070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:29.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.396+0000 7fca65cdb640 1 --2- 172.21.15.5:0/3111330494 >> v2:172.21.15.154:3300/0 conn(0x7fca60158ce0 0x7fca60070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:29.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.396+0000 7fca65cdb640 1 -- 172.21.15.5:0/3111330494 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca60070c80 con 0x7fca600c8ad0 2023-07-14T13:08:29.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.396+0000 7fca664dc640 1 --2- 172.21.15.5:0/3111330494 >> v2:172.21.15.154:3300/0 conn(0x7fca60158ce0 0x7fca60070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:29.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.396+0000 7fca66cdd640 1 --2- 172.21.15.5:0/3111330494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca600c9560 0x7fca600cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:29.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.396+0000 7fca65cdb640 1 --2- 172.21.15.5:0/3111330494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca600c8ad0 0x7fca600c9020 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fca60071be0 tx=0x7fca5001ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ddccf13c004f9c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:29.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.396+0000 7fca654da640 1 -- 172.21.15.5:0/3111330494 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca500a7b10 con 0x7fca600c8ad0 2023-07-14T13:08:29.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.396+0000 7fca654da640 1 -- 172.21.15.5:0/3111330494 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca500a7c70 con 0x7fca600c8ad0 2023-07-14T13:08:29.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.396+0000 7fca654da640 1 -- 172.21.15.5:0/3111330494 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca500af440 con 0x7fca600c8ad0 2023-07-14T13:08:29.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.396+0000 7fca68740640 1 -- 172.21.15.5:0/3111330494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca600c8ad0 msgr2=0x7fca600c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:29.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.396+0000 7fca68740640 1 --2- 172.21.15.5:0/3111330494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca600c8ad0 0x7fca600c9020 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fca60071be0 tx=0x7fca5001ea80 comp rx=0 tx=0).stop 2023-07-14T13:08:29.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.396+0000 7fca68740640 1 -- 172.21.15.5:0/3111330494 shutdown_connections 2023-07-14T13:08:29.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.396+0000 7fca68740640 1 --2- 172.21.15.5:0/3111330494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca600c9560 0x7fca600cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:29.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.396+0000 7fca68740640 1 --2- 172.21.15.5:0/3111330494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca600c8ad0 0x7fca600c9020 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:29.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.396+0000 7fca68740640 1 --2- 172.21.15.5:0/3111330494 >> v2:172.21.15.154:3300/0 conn(0x7fca60158ce0 0x7fca60070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:29.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.396+0000 7fca68740640 1 -- 172.21.15.5:0/3111330494 >> 172.21.15.5:0/3111330494 conn(0x7fca600afcf0 msgr2=0x7fca600b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:29.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.396+0000 7fca68740640 1 -- 172.21.15.5:0/3111330494 shutdown_connections 2023-07-14T13:08:29.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.400+0000 7fca68740640 1 -- 172.21.15.5:0/3111330494 wait complete. 2023-07-14T13:08:29.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.400+0000 7fca68740640 1 Processor -- start 2023-07-14T13:08:29.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.400+0000 7fca68740640 1 -- start start 2023-07-14T13:08:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.400+0000 7fca68740640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca600c8ad0 0x7fca6014a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.400+0000 7fca68740640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca600c9560 0x7fca6014fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.400+0000 7fca68740640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca60158ce0 0x7fca60143e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:29.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.400+0000 7fca68740640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6006b1e0 con 0x7fca600c8ad0 2023-07-14T13:08:29.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.400+0000 7fca68740640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca60144360 con 0x7fca600c9560 2023-07-14T13:08:29.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.400+0000 7fca68740640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6006b430 con 0x7fca60158ce0 2023-07-14T13:08:29.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.400+0000 7fca664dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca600c8ad0 0x7fca6014a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:29.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.400+0000 7fca664dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca600c8ad0 0x7fca6014a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51774/0 (socket says 172.21.15.5:51774) 2023-07-14T13:08:29.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.400+0000 7fca664dc640 1 -- 172.21.15.5:0/182245440 learned_addr learned my addr 172.21.15.5:0/182245440 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:29.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.400+0000 7fca66cdd640 1 --2- 172.21.15.5:0/182245440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca60158ce0 0x7fca60143e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.400+0000 7fca65cdb640 1 --2- 172.21.15.5:0/182245440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca600c9560 0x7fca6014fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.400+0000 7fca664dc640 1 -- 172.21.15.5:0/182245440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca60158ce0 msgr2=0x7fca60143e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.400+0000 7fca664dc640 1 --2- 172.21.15.5:0/182245440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca60158ce0 0x7fca60143e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.400+0000 7fca664dc640 1 -- 172.21.15.5:0/182245440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca600c9560 msgr2=0x7fca6014fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.400+0000 7fca664dc640 1 --2- 172.21.15.5:0/182245440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca600c9560 0x7fca6014fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.400+0000 7fca664dc640 1 -- 172.21.15.5:0/182245440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5000b770 con 0x7fca600c8ad0 2023-07-14T13:08:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.400+0000 7fca664dc640 1 --2- 172.21.15.5:0/182245440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca600c8ad0 0x7fca6014a4c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00e810 tx=0x7fca5c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.400+0000 7fca56ffd640 1 -- 172.21.15.5:0/182245440 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c00c8d0 con 0x7fca600c8ad0 2023-07-14T13:08:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.400+0000 7fca56ffd640 1 -- 172.21.15.5:0/182245440 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5c00ca30 con 0x7fca600c8ad0 2023-07-14T13:08:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.400+0000 7fca56ffd640 1 -- 172.21.15.5:0/182245440 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c00cde0 con 0x7fca600c8ad0 2023-07-14T13:08:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.400+0000 7fca68740640 1 -- 172.21.15.5:0/182245440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca6014f310 con 0x7fca600c8ad0 2023-07-14T13:08:29.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.404+0000 7fca68740640 1 -- 172.21.15.5:0/182245440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6014f8d0 con 0x7fca600c8ad0 2023-07-14T13:08:29.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.404+0000 7fca68740640 1 -- 172.21.15.5:0/182245440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca60072d90 con 0x7fca600c8ad0 2023-07-14T13:08:29.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.404+0000 7fca56ffd640 1 -- 172.21.15.5:0/182245440 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fca5c013410 con 0x7fca600c8ad0 2023-07-14T13:08:29.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.404+0000 7fca56ffd640 1 --2- 172.21.15.5:0/182245440 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fca440663d0 0x7fca44068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:29.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.404+0000 7fca56ffd640 1 -- 172.21.15.5:0/182245440 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fca5c083e30 con 0x7fca600c8ad0 2023-07-14T13:08:29.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.404+0000 7fca65cdb640 1 --2- 172.21.15.5:0/182245440 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fca440663d0 0x7fca44068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:29.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.408+0000 7fca65cdb640 1 --2- 172.21.15.5:0/182245440 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fca440663d0 0x7fca44068880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fca500b1000 tx=0x7fca50008040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:29.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.408+0000 7fca56ffd640 1 -- 172.21.15.5:0/182245440 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fca5c050ff0 con 0x7fca600c8ad0 2023-07-14T13:08:29.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.564+0000 7fca68740640 1 -- 172.21.15.5:0/182245440 --> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca600cc390 con 0x7fca440663d0 2023-07-14T13:08:29.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.576+0000 7fca56ffd640 1 -- 172.21.15.5:0/182245440 <== mgr.5648 v2:172.21.15.154:6832/1874317247 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310883 (secure 0 0 0) 0x7fca500a7ad0 con 0x7fca440663d0 2023-07-14T13:08:29.609 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:08:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.576+0000 7fca68740640 1 -- 172.21.15.5:0/182245440 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fca440663d0 msgr2=0x7fca44068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.576+0000 7fca68740640 1 --2- 172.21.15.5:0/182245440 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fca440663d0 0x7fca44068880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fca500b1000 tx=0x7fca50008040 comp rx=0 tx=0).stop 2023-07-14T13:08:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.576+0000 7fca68740640 1 -- 172.21.15.5:0/182245440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca600c8ad0 msgr2=0x7fca6014a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.576+0000 7fca68740640 1 --2- 172.21.15.5:0/182245440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca600c8ad0 0x7fca6014a4c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00e810 tx=0x7fca5c00ecd0 comp rx=0 tx=0).stop 2023-07-14T13:08:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.576+0000 7fca68740640 1 -- 172.21.15.5:0/182245440 shutdown_connections 2023-07-14T13:08:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.576+0000 7fca68740640 1 --2- 172.21.15.5:0/182245440 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fca440663d0 0x7fca44068880 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.576+0000 7fca68740640 1 --2- 172.21.15.5:0/182245440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca60158ce0 0x7fca60143e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.576+0000 7fca68740640 1 --2- 172.21.15.5:0/182245440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca600c9560 0x7fca6014fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.576+0000 7fca68740640 1 --2- 172.21.15.5:0/182245440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca600c8ad0 0x7fca6014a4c0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.576+0000 7fca68740640 1 -- 172.21.15.5:0/182245440 >> 172.21.15.5:0/182245440 conn(0x7fca600afcf0 msgr2=0x7fca600aea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.576+0000 7fca68740640 1 -- 172.21.15.5:0/182245440 shutdown_connections 2023-07-14T13:08:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:29.576+0000 7fca68740640 1 -- 172.21.15.5:0/182245440 wait complete. 2023-07-14T13:08:29.630 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-14T13:08:29.515275+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":284,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":207,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":314016,"kb_used_data":9056,"kb_used_omap":0,"kb_used_meta":304896,"kb_avail":754660704,"statfs":{"total":773094113280,"available":772772560896,"internally_reserved":0,"allocated":9273344,"data_stored":5200078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312213504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.642582"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045423+0000","last_change":"2023-07-14T13:08:23.905921+0000","last_active":"2023-07-14T13:08:25.045423+0000","last_peered":"2023-07-14T13:08:25.045423+0000","last_clean":"2023-07-14T13:08:25.045423+0000","last_became_active":"2023-07-14T13:08:23.905634+0000","last_became_peered":"2023-07-14T13:08:23.905634+0000","last_unstale":"2023-07-14T13:08:25.045423+0000","last_undegraded":"2023-07-14T13:08:25.045423+0000","last_fullsized":"2023-07-14T13:08:25.045423+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:51:03.865057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.046034+0000","last_change":"2023-07-14T13:08:23.882039+0000","last_active":"2023-07-14T13:08:25.046034+0000","last_peered":"2023-07-14T13:08:25.046034+0000","last_clean":"2023-07-14T13:08:25.046034+0000","last_became_active":"2023-07-14T13:08:23.881770+0000","last_became_peered":"2023-07-14T13:08:23.881770+0000","last_unstale":"2023-07-14T13:08:25.046034+0000","last_undegraded":"2023-07-14T13:08:25.046034+0000","last_fullsized":"2023-07-14T13:08:25.046034+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:24:12.085418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899793+0000","last_change":"2023-07-14T13:08:23.901855+0000","last_active":"2023-07-14T13:08:24.899793+0000","last_peered":"2023-07-14T13:08:24.899793+0000","last_clean":"2023-07-14T13:08:24.899793+0000","last_became_active":"2023-07-14T13:08:23.901563+0000","last_became_peered":"2023-07-14T13:08:23.901563+0000","last_unstale":"2023-07-14T13:08:24.899793+0000","last_undegraded":"2023-07-14T13:08:24.899793+0000","last_fullsized":"2023-07-14T13:08:24.899793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:24:37.315704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048446+0000","last_change":"2023-07-14T13:08:23.886064+0000","last_active":"2023-07-14T13:08:25.048446+0000","last_peered":"2023-07-14T13:08:25.048446+0000","last_clean":"2023-07-14T13:08:25.048446+0000","last_became_active":"2023-07-14T13:08:23.885778+0000","last_became_peered":"2023-07-14T13:08:23.885778+0000","last_unstale":"2023-07-14T13:08:25.048446+0000","last_undegraded":"2023-07-14T13:08:25.048446+0000","last_fullsized":"2023-07-14T13:08:25.048446+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:34:33.895370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048024+0000","last_change":"2023-07-14T13:08:23.904565+0000","last_active":"2023-07-14T13:08:25.048024+0000","last_peered":"2023-07-14T13:08:25.048024+0000","last_clean":"2023-07-14T13:08:25.048024+0000","last_became_active":"2023-07-14T13:08:23.904259+0000","last_became_peered":"2023-07-14T13:08:23.904259+0000","last_unstale":"2023-07-14T13:08:25.048024+0000","last_undegraded":"2023-07-14T13:08:25.048024+0000","last_fullsized":"2023-07-14T13:08:25.048024+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:54:24.528317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045592+0000","last_change":"2023-07-14T13:08:23.904798+0000","last_active":"2023-07-14T13:08:25.045592+0000","last_peered":"2023-07-14T13:08:25.045592+0000","last_clean":"2023-07-14T13:08:25.045592+0000","last_became_active":"2023-07-14T13:08:23.904476+0000","last_became_peered":"2023-07-14T13:08:23.904476+0000","last_unstale":"2023-07-14T13:08:25.045592+0000","last_undegraded":"2023-07-14T13:08:25.045592+0000","last_fullsized":"2023-07-14T13:08:25.045592+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:14:47.476311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.044392+0000","last_change":"2023-07-14T13:08:23.903612+0000","last_active":"2023-07-14T13:08:25.044392+0000","last_peered":"2023-07-14T13:08:25.044392+0000","last_clean":"2023-07-14T13:08:25.044392+0000","last_became_active":"2023-07-14T13:08:23.903272+0000","last_became_peered":"2023-07-14T13:08:23.903272+0000","last_unstale":"2023-07-14T13:08:25.044392+0000","last_undegraded":"2023-07-14T13:08:25.044392+0000","last_fullsized":"2023-07-14T13:08:25.044392+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:32:24.029612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.047779+0000","last_change":"2023-07-14T13:08:23.910590+0000","last_active":"2023-07-14T13:08:25.047779+0000","last_peered":"2023-07-14T13:08:25.047779+0000","last_clean":"2023-07-14T13:08:25.047779+0000","last_became_active":"2023-07-14T13:08:23.910327+0000","last_became_peered":"2023-07-14T13:08:23.910327+0000","last_unstale":"2023-07-14T13:08:25.047779+0000","last_undegraded":"2023-07-14T13:08:25.047779+0000","last_fullsized":"2023-07-14T13:08:25.047779+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:28:29.037116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899952+0000","last_change":"2023-07-14T13:08:23.913807+0000","last_active":"2023-07-14T13:08:24.899952+0000","last_peered":"2023-07-14T13:08:24.899952+0000","last_clean":"2023-07-14T13:08:24.899952+0000","last_became_active":"2023-07-14T13:08:23.913486+0000","last_became_peered":"2023-07-14T13:08:23.913486+0000","last_unstale":"2023-07-14T13:08:24.899952+0000","last_undegraded":"2023-07-14T13:08:24.899952+0000","last_fullsized":"2023-07-14T13:08:24.899952+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:30:05.724323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899864+0000","last_change":"2023-07-14T13:08:23.897804+0000","last_active":"2023-07-14T13:08:24.899864+0000","last_peered":"2023-07-14T13:08:24.899864+0000","last_clean":"2023-07-14T13:08:24.899864+0000","last_became_active":"2023-07-14T13:08:23.897497+0000","last_became_peered":"2023-07-14T13:08:23.897497+0000","last_unstale":"2023-07-14T13:08:24.899864+0000","last_undegraded":"2023-07-14T13:08:24.899864+0000","last_fullsized":"2023-07-14T13:08:24.899864+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:08:37.141024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048994+0000","last_change":"2023-07-14T13:08:23.889945+0000","last_active":"2023-07-14T13:08:25.048994+0000","last_peered":"2023-07-14T13:08:25.048994+0000","last_clean":"2023-07-14T13:08:25.048994+0000","last_became_active":"2023-07-14T13:08:23.889680+0000","last_became_peered":"2023-07-14T13:08:23.889680+0000","last_unstale":"2023-07-14T13:08:25.048994+0000","last_undegraded":"2023-07-14T13:08:25.048994+0000","last_fullsized":"2023-07-14T13:08:25.048994+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:12:39.593879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.049004+0000","last_change":"2023-07-14T13:08:23.912010+0000","last_active":"2023-07-14T13:08:25.049004+0000","last_peered":"2023-07-14T13:08:25.049004+0000","last_clean":"2023-07-14T13:08:25.049004+0000","last_became_active":"2023-07-14T13:08:23.911731+0000","last_became_peered":"2023-07-14T13:08:23.911731+0000","last_unstale":"2023-07-14T13:08:25.049004+0000","last_undegraded":"2023-07-14T13:08:25.049004+0000","last_fullsized":"2023-07-14T13:08:25.049004+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:23:32.877562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048856+0000","last_change":"2023-07-14T13:08:23.908733+0000","last_active":"2023-07-14T13:08:25.048856+0000","last_peered":"2023-07-14T13:08:25.048856+0000","last_clean":"2023-07-14T13:08:25.048856+0000","last_became_active":"2023-07-14T13:08:23.908445+0000","last_became_peered":"2023-07-14T13:08:23.908445+0000","last_unstale":"2023-07-14T13:08:25.048856+0000","last_undegraded":"2023-07-14T13:08:25.048856+0000","last_fullsized":"2023-07-14T13:08:25.048856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:29:42.573304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899525+0000","last_change":"2023-07-14T13:08:23.906643+0000","last_active":"2023-07-14T13:08:24.899525+0000","last_peered":"2023-07-14T13:08:24.899525+0000","last_clean":"2023-07-14T13:08:24.899525+0000","last_became_active":"2023-07-14T13:08:23.906346+0000","last_became_peered":"2023-07-14T13:08:23.906346+0000","last_unstale":"2023-07-14T13:08:24.899525+0000","last_undegraded":"2023-07-14T13:08:24.899525+0000","last_fullsized":"2023-07-14T13:08:24.899525+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:48:46.443381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899296+0000","last_change":"2023-07-14T13:08:23.907024+0000","last_active":"2023-07-14T13:08:24.899296+0000","last_peered":"2023-07-14T13:08:24.899296+0000","last_clean":"2023-07-14T13:08:24.899296+0000","last_became_active":"2023-07-14T13:08:23.905952+0000","last_became_peered":"2023-07-14T13:08:23.905952+0000","last_unstale":"2023-07-14T13:08:24.899296+0000","last_undegraded":"2023-07-14T13:08:24.899296+0000","last_fullsized":"2023-07-14T13:08:24.899296+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:20:45.459752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.044433+0000","last_change":"2023-07-14T13:08:23.895947+0000","last_active":"2023-07-14T13:08:25.044433+0000","last_peered":"2023-07-14T13:08:25.044433+0000","last_clean":"2023-07-14T13:08:25.044433+0000","last_became_active":"2023-07-14T13:08:23.895674+0000","last_became_peered":"2023-07-14T13:08:23.895674+0000","last_unstale":"2023-07-14T13:08:25.044433+0000","last_undegraded":"2023-07-14T13:08:25.044433+0000","last_fullsized":"2023-07-14T13:08:25.044433+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:30.024107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045560+0000","last_change":"2023-07-14T13:08:23.902617+0000","last_active":"2023-07-14T13:08:25.045560+0000","last_peered":"2023-07-14T13:08:25.045560+0000","last_clean":"2023-07-14T13:08:25.045560+0000","last_became_active":"2023-07-14T13:08:23.902180+0000","last_became_peered":"2023-07-14T13:08:23.902180+0000","last_unstale":"2023-07-14T13:08:25.045560+0000","last_undegraded":"2023-07-14T13:08:25.045560+0000","last_fullsized":"2023-07-14T13:08:25.045560+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:31:12.659287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048644+0000","last_change":"2023-07-14T13:08:23.887008+0000","last_active":"2023-07-14T13:08:25.048644+0000","last_peered":"2023-07-14T13:08:25.048644+0000","last_clean":"2023-07-14T13:08:25.048644+0000","last_became_active":"2023-07-14T13:08:23.886643+0000","last_became_peered":"2023-07-14T13:08:23.886643+0000","last_unstale":"2023-07-14T13:08:25.048644+0000","last_undegraded":"2023-07-14T13:08:25.048644+0000","last_fullsized":"2023-07-14T13:08:25.048644+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:13:12.282482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048207+0000","last_change":"2023-07-14T13:08:23.891663+0000","last_active":"2023-07-14T13:08:25.048207+0000","last_peered":"2023-07-14T13:08:25.048207+0000","last_clean":"2023-07-14T13:08:25.048207+0000","last_became_active":"2023-07-14T13:08:23.891290+0000","last_became_peered":"2023-07-14T13:08:23.891290+0000","last_unstale":"2023-07-14T13:08:25.048207+0000","last_undegraded":"2023-07-14T13:08:25.048207+0000","last_fullsized":"2023-07-14T13:08:25.048207+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:19:01.297217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.892998+0000","last_change":"2023-07-14T13:08:23.889618+0000","last_active":"2023-07-14T13:08:24.892998+0000","last_peered":"2023-07-14T13:08:24.892998+0000","last_clean":"2023-07-14T13:08:24.892998+0000","last_became_active":"2023-07-14T13:08:23.889326+0000","last_became_peered":"2023-07-14T13:08:23.889326+0000","last_unstale":"2023-07-14T13:08:24.892998+0000","last_undegraded":"2023-07-14T13:08:24.892998+0000","last_fullsized":"2023-07-14T13:08:24.892998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:36:24.439481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.049012+0000","last_change":"2023-07-14T13:08:23.901161+0000","last_active":"2023-07-14T13:08:25.049012+0000","last_peered":"2023-07-14T13:08:25.049012+0000","last_clean":"2023-07-14T13:08:25.049012+0000","last_became_active":"2023-07-14T13:08:23.900864+0000","last_became_peered":"2023-07-14T13:08:23.900864+0000","last_unstale":"2023-07-14T13:08:25.049012+0000","last_undegraded":"2023-07-14T13:08:25.049012+0000","last_fullsized":"2023-07-14T13:08:25.049012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:09:31.289089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.892749+0000","last_change":"2023-07-14T13:08:23.905722+0000","last_active":"2023-07-14T13:08:24.892749+0000","last_peered":"2023-07-14T13:08:24.892749+0000","last_clean":"2023-07-14T13:08:24.892749+0000","last_became_active":"2023-07-14T13:08:23.905026+0000","last_became_peered":"2023-07-14T13:08:23.905026+0000","last_unstale":"2023-07-14T13:08:24.892749+0000","last_undegraded":"2023-07-14T13:08:24.892749+0000","last_fullsized":"2023-07-14T13:08:24.892749+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:16:03.622051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.892716+0000","last_change":"2023-07-14T13:08:23.904502+0000","last_active":"2023-07-14T13:08:24.892716+0000","last_peered":"2023-07-14T13:08:24.892716+0000","last_clean":"2023-07-14T13:08:24.892716+0000","last_became_active":"2023-07-14T13:08:23.904179+0000","last_became_peered":"2023-07-14T13:08:23.904179+0000","last_unstale":"2023-07-14T13:08:24.892716+0000","last_undegraded":"2023-07-14T13:08:24.892716+0000","last_fullsized":"2023-07-14T13:08:24.892716+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:10:09.838920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899178+0000","last_change":"2023-07-14T13:08:23.902351+0000","last_active":"2023-07-14T13:08:24.899178+0000","last_peered":"2023-07-14T13:08:24.899178+0000","last_clean":"2023-07-14T13:08:24.899178+0000","last_became_active":"2023-07-14T13:08:23.901577+0000","last_became_peered":"2023-07-14T13:08:23.901577+0000","last_unstale":"2023-07-14T13:08:24.899178+0000","last_undegraded":"2023-07-14T13:08:24.899178+0000","last_fullsized":"2023-07-14T13:08:24.899178+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:18:52.003692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.049215+0000","last_change":"2023-07-14T13:08:23.904414+0000","last_active":"2023-07-14T13:08:25.049215+0000","last_peered":"2023-07-14T13:08:25.049215+0000","last_clean":"2023-07-14T13:08:25.049215+0000","last_became_active":"2023-07-14T13:08:23.904098+0000","last_became_peered":"2023-07-14T13:08:23.904098+0000","last_unstale":"2023-07-14T13:08:25.049215+0000","last_undegraded":"2023-07-14T13:08:25.049215+0000","last_fullsized":"2023-07-14T13:08:25.049215+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:13:51.265659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.049307+0000","last_change":"2023-07-14T13:08:23.903378+0000","last_active":"2023-07-14T13:08:25.049307+0000","last_peered":"2023-07-14T13:08:25.049307+0000","last_clean":"2023-07-14T13:08:25.049307+0000","last_became_active":"2023-07-14T13:08:23.903108+0000","last_became_peered":"2023-07-14T13:08:23.903108+0000","last_unstale":"2023-07-14T13:08:25.049307+0000","last_undegraded":"2023-07-14T13:08:25.049307+0000","last_fullsized":"2023-07-14T13:08:25.049307+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:06.959284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.049103+0000","last_change":"2023-07-14T13:08:23.889379+0000","last_active":"2023-07-14T13:08:25.049103+0000","last_peered":"2023-07-14T13:08:25.049103+0000","last_clean":"2023-07-14T13:08:25.049103+0000","last_became_active":"2023-07-14T13:08:23.889096+0000","last_became_peered":"2023-07-14T13:08:23.889096+0000","last_unstale":"2023-07-14T13:08:25.049103+0000","last_undegraded":"2023-07-14T13:08:25.049103+0000","last_fullsized":"2023-07-14T13:08:25.049103+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:16:08.431188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045444+0000","last_change":"2023-07-14T13:08:23.892320+0000","last_active":"2023-07-14T13:08:25.045444+0000","last_peered":"2023-07-14T13:08:25.045444+0000","last_clean":"2023-07-14T13:08:25.045444+0000","last_became_active":"2023-07-14T13:08:23.891961+0000","last_became_peered":"2023-07-14T13:08:23.891961+0000","last_unstale":"2023-07-14T13:08:25.045444+0000","last_undegraded":"2023-07-14T13:08:25.045444+0000","last_fullsized":"2023-07-14T13:08:25.045444+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:00:07.741530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899513+0000","last_change":"2023-07-14T13:08:23.913742+0000","last_active":"2023-07-14T13:08:24.899513+0000","last_peered":"2023-07-14T13:08:24.899513+0000","last_clean":"2023-07-14T13:08:24.899513+0000","last_became_active":"2023-07-14T13:08:23.913435+0000","last_became_peered":"2023-07-14T13:08:23.913435+0000","last_unstale":"2023-07-14T13:08:24.899513+0000","last_undegraded":"2023-07-14T13:08:24.899513+0000","last_fullsized":"2023-07-14T13:08:24.899513+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:21:45.860510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.047862+0000","last_change":"2023-07-14T13:08:23.909993+0000","last_active":"2023-07-14T13:08:25.047862+0000","last_peered":"2023-07-14T13:08:25.047862+0000","last_clean":"2023-07-14T13:08:25.047862+0000","last_became_active":"2023-07-14T13:08:23.909712+0000","last_became_peered":"2023-07-14T13:08:23.909712+0000","last_unstale":"2023-07-14T13:08:25.047862+0000","last_undegraded":"2023-07-14T13:08:25.047862+0000","last_fullsized":"2023-07-14T13:08:25.047862+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:11:16.713859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048877+0000","last_change":"2023-07-14T13:08:23.888280+0000","last_active":"2023-07-14T13:08:25.048877+0000","last_peered":"2023-07-14T13:08:25.048877+0000","last_clean":"2023-07-14T13:08:25.048877+0000","last_became_active":"2023-07-14T13:08:23.887947+0000","last_became_peered":"2023-07-14T13:08:23.887947+0000","last_unstale":"2023-07-14T13:08:25.048877+0000","last_undegraded":"2023-07-14T13:08:25.048877+0000","last_fullsized":"2023-07-14T13:08:25.048877+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:36:39.201043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.044981+0000","last_change":"2023-07-14T13:08:23.885882+0000","last_active":"2023-07-14T13:08:25.044981+0000","last_peered":"2023-07-14T13:08:25.044981+0000","last_clean":"2023-07-14T13:08:25.044981+0000","last_became_active":"2023-07-14T13:08:23.884847+0000","last_became_peered":"2023-07-14T13:08:23.884847+0000","last_unstale":"2023-07-14T13:08:25.044981+0000","last_undegraded":"2023-07-14T13:08:25.044981+0000","last_fullsized":"2023-07-14T13:08:25.044981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:17:22.299597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048524+0000","last_change":"2023-07-14T13:08:23.899984+0000","last_active":"2023-07-14T13:08:25.048524+0000","last_peered":"2023-07-14T13:08:25.048524+0000","last_clean":"2023-07-14T13:08:25.048524+0000","last_became_active":"2023-07-14T13:08:23.899660+0000","last_became_peered":"2023-07-14T13:08:23.899660+0000","last_unstale":"2023-07-14T13:08:25.048524+0000","last_undegraded":"2023-07-14T13:08:25.048524+0000","last_fullsized":"2023-07-14T13:08:25.048524+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:40.390751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"82'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045688+0000","last_change":"2023-07-14T13:08:22.892834+0000","last_active":"2023-07-14T13:08:25.045688+0000","last_peered":"2023-07-14T13:08:25.045688+0000","last_clean":"2023-07-14T13:08:25.045688+0000","last_became_active":"2023-07-14T13:08:22.892557+0000","last_became_peered":"2023-07-14T13:08:22.892557+0000","last_unstale":"2023-07-14T13:08:25.045688+0000","last_undegraded":"2023-07-14T13:08:25.045688+0000","last_fullsized":"2023-07-14T13:08:25.045688+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:53:07.222035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.049155+0000","last_change":"2023-07-14T13:08:23.892836+0000","last_active":"2023-07-14T13:08:25.049155+0000","last_peered":"2023-07-14T13:08:25.049155+0000","last_clean":"2023-07-14T13:08:25.049155+0000","last_became_active":"2023-07-14T13:08:23.892506+0000","last_became_peered":"2023-07-14T13:08:23.892506+0000","last_unstale":"2023-07-14T13:08:25.049155+0000","last_undegraded":"2023-07-14T13:08:25.049155+0000","last_fullsized":"2023-07-14T13:08:25.049155+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:34:29.622181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"82'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045645+0000","last_change":"2023-07-14T13:08:22.888782+0000","last_active":"2023-07-14T13:08:25.045645+0000","last_peered":"2023-07-14T13:08:25.045645+0000","last_clean":"2023-07-14T13:08:25.045645+0000","last_became_active":"2023-07-14T13:08:22.888435+0000","last_became_peered":"2023-07-14T13:08:22.888435+0000","last_unstale":"2023-07-14T13:08:25.045645+0000","last_undegraded":"2023-07-14T13:08:25.045645+0000","last_fullsized":"2023-07-14T13:08:25.045645+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:41:36.689812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045448+0000","last_change":"2023-07-14T13:08:23.882568+0000","last_active":"2023-07-14T13:08:25.045448+0000","last_peered":"2023-07-14T13:08:25.045448+0000","last_clean":"2023-07-14T13:08:25.045448+0000","last_became_active":"2023-07-14T13:08:23.882264+0000","last_became_peered":"2023-07-14T13:08:23.882264+0000","last_unstale":"2023-07-14T13:08:25.045448+0000","last_undegraded":"2023-07-14T13:08:25.045448+0000","last_fullsized":"2023-07-14T13:08:25.045448+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:48:31.651290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"82'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045364+0000","last_change":"2023-07-14T13:08:22.886288+0000","last_active":"2023-07-14T13:08:25.045364+0000","last_peered":"2023-07-14T13:08:25.045364+0000","last_clean":"2023-07-14T13:08:25.045364+0000","last_became_active":"2023-07-14T13:08:22.885619+0000","last_became_peered":"2023-07-14T13:08:22.885619+0000","last_unstale":"2023-07-14T13:08:25.045364+0000","last_undegraded":"2023-07-14T13:08:25.045364+0000","last_fullsized":"2023-07-14T13:08:25.045364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:54:47.831816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899992+0000","last_change":"2023-07-14T13:08:23.899652+0000","last_active":"2023-07-14T13:08:24.899992+0000","last_peered":"2023-07-14T13:08:24.899992+0000","last_clean":"2023-07-14T13:08:24.899992+0000","last_became_active":"2023-07-14T13:08:23.899282+0000","last_became_peered":"2023-07-14T13:08:23.899282+0000","last_unstale":"2023-07-14T13:08:24.899992+0000","last_undegraded":"2023-07-14T13:08:24.899992+0000","last_fullsized":"2023-07-14T13:08:24.899992+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:24:23.644889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"82'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.044988+0000","last_change":"2023-07-14T13:08:22.888011+0000","last_active":"2023-07-14T13:08:25.044988+0000","last_peered":"2023-07-14T13:08:25.044988+0000","last_clean":"2023-07-14T13:08:25.044988+0000","last_became_active":"2023-07-14T13:08:22.887659+0000","last_became_peered":"2023-07-14T13:08:22.887659+0000","last_unstale":"2023-07-14T13:08:25.044988+0000","last_undegraded":"2023-07-14T13:08:25.044988+0000","last_fullsized":"2023-07-14T13:08:25.044988+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:48.399242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.044430+0000","last_change":"2023-07-14T13:08:23.887955+0000","last_active":"2023-07-14T13:08:25.044430+0000","last_peered":"2023-07-14T13:08:25.044430+0000","last_clean":"2023-07-14T13:08:25.044430+0000","last_became_active":"2023-07-14T13:08:23.887605+0000","last_became_peered":"2023-07-14T13:08:23.887605+0000","last_unstale":"2023-07-14T13:08:25.044430+0000","last_undegraded":"2023-07-14T13:08:25.044430+0000","last_fullsized":"2023-07-14T13:08:25.044430+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:30:13.365080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"82'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.893043+0000","last_change":"2023-07-14T13:08:22.884530+0000","last_active":"2023-07-14T13:08:24.893043+0000","last_peered":"2023-07-14T13:08:24.893043+0000","last_clean":"2023-07-14T13:08:24.893043+0000","last_became_active":"2023-07-14T13:08:22.884229+0000","last_became_peered":"2023-07-14T13:08:22.884229+0000","last_unstale":"2023-07-14T13:08:24.893043+0000","last_undegraded":"2023-07-14T13:08:24.893043+0000","last_fullsized":"2023-07-14T13:08:24.893043+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:00:06.733748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045126+0000","last_change":"2023-07-14T13:08:23.886261+0000","last_active":"2023-07-14T13:08:25.045126+0000","last_peered":"2023-07-14T13:08:25.045126+0000","last_clean":"2023-07-14T13:08:25.045126+0000","last_became_active":"2023-07-14T13:08:23.885957+0000","last_became_peered":"2023-07-14T13:08:23.885957+0000","last_unstale":"2023-07-14T13:08:25.045126+0000","last_undegraded":"2023-07-14T13:08:25.045126+0000","last_fullsized":"2023-07-14T13:08:25.045126+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:36:24.439481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"82'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.892778+0000","last_change":"2023-07-14T13:08:22.883779+0000","last_active":"2023-07-14T13:08:24.892778+0000","last_peered":"2023-07-14T13:08:24.892778+0000","last_clean":"2023-07-14T13:08:24.892778+0000","last_became_active":"2023-07-14T13:08:22.883464+0000","last_became_peered":"2023-07-14T13:08:22.883464+0000","last_unstale":"2023-07-14T13:08:24.892778+0000","last_undegraded":"2023-07-14T13:08:24.892778+0000","last_fullsized":"2023-07-14T13:08:24.892778+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:31:56.881715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.047890+0000","last_change":"2023-07-14T13:08:23.901749+0000","last_active":"2023-07-14T13:08:25.047890+0000","last_peered":"2023-07-14T13:08:25.047890+0000","last_clean":"2023-07-14T13:08:25.047890+0000","last_became_active":"2023-07-14T13:08:23.901277+0000","last_became_peered":"2023-07-14T13:08:23.901277+0000","last_unstale":"2023-07-14T13:08:25.047890+0000","last_undegraded":"2023-07-14T13:08:25.047890+0000","last_fullsized":"2023-07-14T13:08:25.047890+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:17:22.396268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.892853+0000","last_change":"2023-07-14T13:08:22.887027+0000","last_active":"2023-07-14T13:08:24.892853+0000","last_peered":"2023-07-14T13:08:24.892853+0000","last_clean":"2023-07-14T13:08:24.892853+0000","last_became_active":"2023-07-14T13:08:22.886683+0000","last_became_peered":"2023-07-14T13:08:22.886683+0000","last_unstale":"2023-07-14T13:08:24.892853+0000","last_undegraded":"2023-07-14T13:08:24.892853+0000","last_fullsized":"2023-07-14T13:08:24.892853+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:53:16.820627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.893021+0000","last_change":"2023-07-14T13:08:23.891123+0000","last_active":"2023-07-14T13:08:24.893021+0000","last_peered":"2023-07-14T13:08:24.893021+0000","last_clean":"2023-07-14T13:08:24.893021+0000","last_became_active":"2023-07-14T13:08:23.890830+0000","last_became_peered":"2023-07-14T13:08:23.890830+0000","last_unstale":"2023-07-14T13:08:24.893021+0000","last_undegraded":"2023-07-14T13:08:24.893021+0000","last_fullsized":"2023-07-14T13:08:24.893021+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:51:03.865057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048437+0000","last_change":"2023-07-14T13:08:22.896649+0000","last_active":"2023-07-14T13:08:25.048437+0000","last_peered":"2023-07-14T13:08:25.048437+0000","last_clean":"2023-07-14T13:08:25.048437+0000","last_became_active":"2023-07-14T13:08:22.896318+0000","last_became_peered":"2023-07-14T13:08:22.896318+0000","last_unstale":"2023-07-14T13:08:25.048437+0000","last_undegraded":"2023-07-14T13:08:25.048437+0000","last_fullsized":"2023-07-14T13:08:25.048437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:16:24.938164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045483+0000","last_change":"2023-07-14T13:08:23.886470+0000","last_active":"2023-07-14T13:08:25.045483+0000","last_peered":"2023-07-14T13:08:25.045483+0000","last_clean":"2023-07-14T13:08:25.045483+0000","last_became_active":"2023-07-14T13:08:23.886175+0000","last_became_peered":"2023-07-14T13:08:23.886175+0000","last_unstale":"2023-07-14T13:08:25.045483+0000","last_undegraded":"2023-07-14T13:08:25.045483+0000","last_fullsized":"2023-07-14T13:08:25.045483+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:22:50.422019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.900151+0000","last_change":"2023-07-14T13:08:22.899027+0000","last_active":"2023-07-14T13:08:24.900151+0000","last_peered":"2023-07-14T13:08:24.900151+0000","last_clean":"2023-07-14T13:08:24.900151+0000","last_became_active":"2023-07-14T13:08:22.898673+0000","last_became_peered":"2023-07-14T13:08:22.898673+0000","last_unstale":"2023-07-14T13:08:24.900151+0000","last_undegraded":"2023-07-14T13:08:24.900151+0000","last_fullsized":"2023-07-14T13:08:24.900151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:22:07.726479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.893101+0000","last_change":"2023-07-14T13:08:23.897021+0000","last_active":"2023-07-14T13:08:24.893101+0000","last_peered":"2023-07-14T13:08:24.893101+0000","last_clean":"2023-07-14T13:08:24.893101+0000","last_became_active":"2023-07-14T13:08:23.896770+0000","last_became_peered":"2023-07-14T13:08:23.896770+0000","last_unstale":"2023-07-14T13:08:24.893101+0000","last_undegraded":"2023-07-14T13:08:24.893101+0000","last_fullsized":"2023-07-14T13:08:24.893101+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:22:50.422019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048954+0000","last_change":"2023-07-14T13:08:22.889053+0000","last_active":"2023-07-14T13:08:25.048954+0000","last_peered":"2023-07-14T13:08:25.048954+0000","last_clean":"2023-07-14T13:08:25.048954+0000","last_became_active":"2023-07-14T13:08:22.888145+0000","last_became_peered":"2023-07-14T13:08:22.888145+0000","last_unstale":"2023-07-14T13:08:25.048954+0000","last_undegraded":"2023-07-14T13:08:25.048954+0000","last_fullsized":"2023-07-14T13:08:25.048954+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:18:34.248849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048369+0000","last_change":"2023-07-14T13:08:23.903246+0000","last_active":"2023-07-14T13:08:25.048369+0000","last_peered":"2023-07-14T13:08:25.048369+0000","last_clean":"2023-07-14T13:08:25.048369+0000","last_became_active":"2023-07-14T13:08:23.902904+0000","last_became_peered":"2023-07-14T13:08:23.902904+0000","last_unstale":"2023-07-14T13:08:25.048369+0000","last_undegraded":"2023-07-14T13:08:25.048369+0000","last_fullsized":"2023-07-14T13:08:25.048369+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:40:23.817315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"82'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899984+0000","last_change":"2023-07-14T13:08:22.898636+0000","last_active":"2023-07-14T13:08:24.899984+0000","last_peered":"2023-07-14T13:08:24.899984+0000","last_clean":"2023-07-14T13:08:24.899984+0000","last_became_active":"2023-07-14T13:08:22.898199+0000","last_became_peered":"2023-07-14T13:08:22.898199+0000","last_unstale":"2023-07-14T13:08:24.899984+0000","last_undegraded":"2023-07-14T13:08:24.899984+0000","last_fullsized":"2023-07-14T13:08:24.899984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:52:05.378205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.049299+0000","last_change":"2023-07-14T13:08:23.886400+0000","last_active":"2023-07-14T13:08:25.049299+0000","last_peered":"2023-07-14T13:08:25.049299+0000","last_clean":"2023-07-14T13:08:25.049299+0000","last_became_active":"2023-07-14T13:08:23.886115+0000","last_became_peered":"2023-07-14T13:08:23.886115+0000","last_unstale":"2023-07-14T13:08:25.049299+0000","last_undegraded":"2023-07-14T13:08:25.049299+0000","last_fullsized":"2023-07-14T13:08:25.049299+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:51:00.187533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"82'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045575+0000","last_change":"2023-07-14T13:08:22.886746+0000","last_active":"2023-07-14T13:08:25.045575+0000","last_peered":"2023-07-14T13:08:25.045575+0000","last_clean":"2023-07-14T13:08:25.045575+0000","last_became_active":"2023-07-14T13:08:22.886234+0000","last_became_peered":"2023-07-14T13:08:22.886234+0000","last_unstale":"2023-07-14T13:08:25.045575+0000","last_undegraded":"2023-07-14T13:08:25.045575+0000","last_fullsized":"2023-07-14T13:08:25.045575+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:06:31.353019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.047749+0000","last_change":"2023-07-14T13:08:23.905115+0000","last_active":"2023-07-14T13:08:25.047749+0000","last_peered":"2023-07-14T13:08:25.047749+0000","last_clean":"2023-07-14T13:08:25.047749+0000","last_became_active":"2023-07-14T13:08:23.904852+0000","last_became_peered":"2023-07-14T13:08:23.904852+0000","last_unstale":"2023-07-14T13:08:25.047749+0000","last_undegraded":"2023-07-14T13:08:25.047749+0000","last_fullsized":"2023-07-14T13:08:25.047749+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:30:13.784311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"82'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899605+0000","last_change":"2023-07-14T13:08:22.896327+0000","last_active":"2023-07-14T13:08:24.899605+0000","last_peered":"2023-07-14T13:08:24.899605+0000","last_clean":"2023-07-14T13:08:24.899605+0000","last_became_active":"2023-07-14T13:08:22.895999+0000","last_became_peered":"2023-07-14T13:08:22.895999+0000","last_unstale":"2023-07-14T13:08:24.899605+0000","last_undegraded":"2023-07-14T13:08:24.899605+0000","last_fullsized":"2023-07-14T13:08:24.899605+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:07:27.701213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.047777+0000","last_change":"2023-07-14T13:08:23.899288+0000","last_active":"2023-07-14T13:08:25.047777+0000","last_peered":"2023-07-14T13:08:25.047777+0000","last_clean":"2023-07-14T13:08:25.047777+0000","last_became_active":"2023-07-14T13:08:23.898831+0000","last_became_peered":"2023-07-14T13:08:23.898831+0000","last_unstale":"2023-07-14T13:08:25.047777+0000","last_undegraded":"2023-07-14T13:08:25.047777+0000","last_fullsized":"2023-07-14T13:08:25.047777+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:42:50.931445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048010+0000","last_change":"2023-07-14T13:08:22.894256+0000","last_active":"2023-07-14T13:08:25.048010+0000","last_peered":"2023-07-14T13:08:25.048010+0000","last_clean":"2023-07-14T13:08:25.048010+0000","last_became_active":"2023-07-14T13:08:22.893973+0000","last_became_peered":"2023-07-14T13:08:22.893973+0000","last_unstale":"2023-07-14T13:08:25.048010+0000","last_undegraded":"2023-07-14T13:08:25.048010+0000","last_fullsized":"2023-07-14T13:08:25.048010+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:45:04.006207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048052+0000","last_change":"2023-07-14T13:08:23.891783+0000","last_active":"2023-07-14T13:08:25.048052+0000","last_peered":"2023-07-14T13:08:25.048052+0000","last_clean":"2023-07-14T13:08:25.048052+0000","last_became_active":"2023-07-14T13:08:23.891424+0000","last_became_peered":"2023-07-14T13:08:23.891424+0000","last_unstale":"2023-07-14T13:08:25.048052+0000","last_undegraded":"2023-07-14T13:08:25.048052+0000","last_fullsized":"2023-07-14T13:08:25.048052+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:12.809317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899554+0000","last_change":"2023-07-14T13:08:22.897595+0000","last_active":"2023-07-14T13:08:24.899554+0000","last_peered":"2023-07-14T13:08:24.899554+0000","last_clean":"2023-07-14T13:08:24.899554+0000","last_became_active":"2023-07-14T13:08:22.896980+0000","last_became_peered":"2023-07-14T13:08:22.896980+0000","last_unstale":"2023-07-14T13:08:24.899554+0000","last_undegraded":"2023-07-14T13:08:24.899554+0000","last_fullsized":"2023-07-14T13:08:24.899554+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:09:26.287380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045125+0000","last_change":"2023-07-14T13:08:23.904809+0000","last_active":"2023-07-14T13:08:25.045125+0000","last_peered":"2023-07-14T13:08:25.045125+0000","last_clean":"2023-07-14T13:08:25.045125+0000","last_became_active":"2023-07-14T13:08:23.904515+0000","last_became_peered":"2023-07-14T13:08:23.904515+0000","last_unstale":"2023-07-14T13:08:25.045125+0000","last_undegraded":"2023-07-14T13:08:25.045125+0000","last_fullsized":"2023-07-14T13:08:25.045125+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:05:31.229761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"82'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048657+0000","last_change":"2023-07-14T13:08:22.896567+0000","last_active":"2023-07-14T13:08:25.048657+0000","last_peered":"2023-07-14T13:08:25.048657+0000","last_clean":"2023-07-14T13:08:25.048657+0000","last_became_active":"2023-07-14T13:08:22.896244+0000","last_became_peered":"2023-07-14T13:08:22.896244+0000","last_unstale":"2023-07-14T13:08:25.048657+0000","last_undegraded":"2023-07-14T13:08:25.048657+0000","last_fullsized":"2023-07-14T13:08:25.048657+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:21:31.619049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.044860+0000","last_change":"2023-07-14T13:08:23.890655+0000","last_active":"2023-07-14T13:08:25.044860+0000","last_peered":"2023-07-14T13:08:25.044860+0000","last_clean":"2023-07-14T13:08:25.044860+0000","last_became_active":"2023-07-14T13:08:23.890330+0000","last_became_peered":"2023-07-14T13:08:23.890330+0000","last_unstale":"2023-07-14T13:08:25.044860+0000","last_undegraded":"2023-07-14T13:08:25.044860+0000","last_fullsized":"2023-07-14T13:08:25.044860+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:30:10.907617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"82'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.049447+0000","last_change":"2023-07-14T13:08:22.896731+0000","last_active":"2023-07-14T13:08:25.049447+0000","last_peered":"2023-07-14T13:08:25.049447+0000","last_clean":"2023-07-14T13:08:25.049447+0000","last_became_active":"2023-07-14T13:08:22.896451+0000","last_became_peered":"2023-07-14T13:08:22.896451+0000","last_unstale":"2023-07-14T13:08:25.049447+0000","last_undegraded":"2023-07-14T13:08:25.049447+0000","last_fullsized":"2023-07-14T13:08:25.049447+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:02:39.769844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.046136+0000","last_change":"2023-07-14T13:08:23.881942+0000","last_active":"2023-07-14T13:08:25.046136+0000","last_peered":"2023-07-14T13:08:25.046136+0000","last_clean":"2023-07-14T13:08:25.046136+0000","last_became_active":"2023-07-14T13:08:23.881653+0000","last_became_peered":"2023-07-14T13:08:23.881653+0000","last_unstale":"2023-07-14T13:08:25.046136+0000","last_undegraded":"2023-07-14T13:08:25.046136+0000","last_fullsized":"2023-07-14T13:08:25.046136+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:29:07.420224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.049569+0000","last_change":"2023-07-14T13:08:22.888742+0000","last_active":"2023-07-14T13:08:25.049569+0000","last_peered":"2023-07-14T13:08:25.049569+0000","last_clean":"2023-07-14T13:08:25.049569+0000","last_became_active":"2023-07-14T13:08:22.888451+0000","last_became_peered":"2023-07-14T13:08:22.888451+0000","last_unstale":"2023-07-14T13:08:25.049569+0000","last_undegraded":"2023-07-14T13:08:25.049569+0000","last_fullsized":"2023-07-14T13:08:25.049569+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:38:24.197513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.049466+0000","last_change":"2023-07-14T13:08:23.902014+0000","last_active":"2023-07-14T13:08:25.049466+0000","last_peered":"2023-07-14T13:08:25.049466+0000","last_clean":"2023-07-14T13:08:25.049466+0000","last_became_active":"2023-07-14T13:08:23.901695+0000","last_became_peered":"2023-07-14T13:08:23.901695+0000","last_unstale":"2023-07-14T13:08:25.049466+0000","last_undegraded":"2023-07-14T13:08:25.049466+0000","last_fullsized":"2023-07-14T13:08:25.049466+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:15:28.002257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045229+0000","last_change":"2023-07-14T13:08:22.886480+0000","last_active":"2023-07-14T13:08:25.045229+0000","last_peered":"2023-07-14T13:08:25.045229+0000","last_clean":"2023-07-14T13:08:25.045229+0000","last_became_active":"2023-07-14T13:08:22.885968+0000","last_became_peered":"2023-07-14T13:08:22.885968+0000","last_unstale":"2023-07-14T13:08:25.045229+0000","last_undegraded":"2023-07-14T13:08:25.045229+0000","last_fullsized":"2023-07-14T13:08:25.045229+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:02:58.361007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048625+0000","last_change":"2023-07-14T13:08:23.897767+0000","last_active":"2023-07-14T13:08:25.048625+0000","last_peered":"2023-07-14T13:08:25.048625+0000","last_clean":"2023-07-14T13:08:25.048625+0000","last_became_active":"2023-07-14T13:08:23.897279+0000","last_became_peered":"2023-07-14T13:08:23.897279+0000","last_unstale":"2023-07-14T13:08:25.048625+0000","last_undegraded":"2023-07-14T13:08:25.048625+0000","last_fullsized":"2023-07-14T13:08:25.048625+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:38:30.528323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045608+0000","last_change":"2023-07-14T13:08:22.886524+0000","last_active":"2023-07-14T13:08:25.045608+0000","last_peered":"2023-07-14T13:08:25.045608+0000","last_clean":"2023-07-14T13:08:25.045608+0000","last_became_active":"2023-07-14T13:08:22.882894+0000","last_became_peered":"2023-07-14T13:08:22.882894+0000","last_unstale":"2023-07-14T13:08:25.045608+0000","last_undegraded":"2023-07-14T13:08:25.045608+0000","last_fullsized":"2023-07-14T13:08:25.045608+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:56:04.254791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048005+0000","last_change":"2023-07-14T13:08:23.899032+0000","last_active":"2023-07-14T13:08:25.048005+0000","last_peered":"2023-07-14T13:08:25.048005+0000","last_clean":"2023-07-14T13:08:25.048005+0000","last_became_active":"2023-07-14T13:08:23.898709+0000","last_became_peered":"2023-07-14T13:08:23.898709+0000","last_unstale":"2023-07-14T13:08:25.048005+0000","last_undegraded":"2023-07-14T13:08:25.048005+0000","last_fullsized":"2023-07-14T13:08:25.048005+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:28:13.669609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899681+0000","last_change":"2023-07-14T13:08:22.897266+0000","last_active":"2023-07-14T13:08:24.899681+0000","last_peered":"2023-07-14T13:08:24.899681+0000","last_clean":"2023-07-14T13:08:24.899681+0000","last_became_active":"2023-07-14T13:08:22.896932+0000","last_became_peered":"2023-07-14T13:08:22.896932+0000","last_unstale":"2023-07-14T13:08:24.899681+0000","last_undegraded":"2023-07-14T13:08:24.899681+0000","last_fullsized":"2023-07-14T13:08:24.899681+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:24:28.167304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.049402+0000","last_change":"2023-07-14T13:08:23.908501+0000","last_active":"2023-07-14T13:08:25.049402+0000","last_peered":"2023-07-14T13:08:25.049402+0000","last_clean":"2023-07-14T13:08:25.049402+0000","last_became_active":"2023-07-14T13:08:23.908199+0000","last_became_peered":"2023-07-14T13:08:23.908199+0000","last_unstale":"2023-07-14T13:08:25.049402+0000","last_undegraded":"2023-07-14T13:08:25.049402+0000","last_fullsized":"2023-07-14T13:08:25.049402+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:57:49.058359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.892934+0000","last_change":"2023-07-14T13:08:22.884847+0000","last_active":"2023-07-14T13:08:24.892934+0000","last_peered":"2023-07-14T13:08:24.892934+0000","last_clean":"2023-07-14T13:08:24.892934+0000","last_became_active":"2023-07-14T13:08:22.884442+0000","last_became_peered":"2023-07-14T13:08:22.884442+0000","last_unstale":"2023-07-14T13:08:24.892934+0000","last_undegraded":"2023-07-14T13:08:24.892934+0000","last_fullsized":"2023-07-14T13:08:24.892934+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:05:30.221979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045881+0000","last_change":"2023-07-14T13:08:23.894532+0000","last_active":"2023-07-14T13:08:25.045881+0000","last_peered":"2023-07-14T13:08:25.045881+0000","last_clean":"2023-07-14T13:08:25.045881+0000","last_became_active":"2023-07-14T13:08:23.894279+0000","last_became_peered":"2023-07-14T13:08:23.894279+0000","last_unstale":"2023-07-14T13:08:25.045881+0000","last_undegraded":"2023-07-14T13:08:25.045881+0000","last_fullsized":"2023-07-14T13:08:25.045881+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:20.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.892776+0000","last_change":"2023-07-14T13:08:22.890676+0000","last_active":"2023-07-14T13:08:24.892776+0000","last_peered":"2023-07-14T13:08:24.892776+0000","last_clean":"2023-07-14T13:08:24.892776+0000","last_became_active":"2023-07-14T13:08:22.890323+0000","last_became_peered":"2023-07-14T13:08:22.890323+0000","last_unstale":"2023-07-14T13:08:24.892776+0000","last_undegraded":"2023-07-14T13:08:24.892776+0000","last_fullsized":"2023-07-14T13:08:24.892776+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:56:30.779442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.044597+0000","last_change":"2023-07-14T13:08:23.900832+0000","last_active":"2023-07-14T13:08:25.044597+0000","last_peered":"2023-07-14T13:08:25.044597+0000","last_clean":"2023-07-14T13:08:25.044597+0000","last_became_active":"2023-07-14T13:08:23.900547+0000","last_became_peered":"2023-07-14T13:08:23.900547+0000","last_unstale":"2023-07-14T13:08:25.044597+0000","last_undegraded":"2023-07-14T13:08:25.044597+0000","last_fullsized":"2023-07-14T13:08:25.044597+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:18:21.892026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045815+0000","last_change":"2023-07-14T13:08:22.888081+0000","last_active":"2023-07-14T13:08:25.045815+0000","last_peered":"2023-07-14T13:08:25.045815+0000","last_clean":"2023-07-14T13:08:25.045815+0000","last_became_active":"2023-07-14T13:08:22.887733+0000","last_became_peered":"2023-07-14T13:08:22.887733+0000","last_unstale":"2023-07-14T13:08:25.045815+0000","last_undegraded":"2023-07-14T13:08:25.045815+0000","last_fullsized":"2023-07-14T13:08:25.045815+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:44:24.297343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048196+0000","last_change":"2023-07-14T13:08:23.899770+0000","last_active":"2023-07-14T13:08:25.048196+0000","last_peered":"2023-07-14T13:08:25.048196+0000","last_clean":"2023-07-14T13:08:25.048196+0000","last_became_active":"2023-07-14T13:08:23.899069+0000","last_became_peered":"2023-07-14T13:08:23.899069+0000","last_unstale":"2023-07-14T13:08:25.048196+0000","last_undegraded":"2023-07-14T13:08:25.048196+0000","last_fullsized":"2023-07-14T13:08:25.048196+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:11.871609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.892678+0000","last_change":"2023-07-14T13:08:22.885339+0000","last_active":"2023-07-14T13:08:24.892678+0000","last_peered":"2023-07-14T13:08:24.892678+0000","last_clean":"2023-07-14T13:08:24.892678+0000","last_became_active":"2023-07-14T13:08:22.885052+0000","last_became_peered":"2023-07-14T13:08:22.885052+0000","last_unstale":"2023-07-14T13:08:24.892678+0000","last_undegraded":"2023-07-14T13:08:24.892678+0000","last_fullsized":"2023-07-14T13:08:24.892678+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:52:42.265517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"70'161","reported_seq":444,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899478+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:08:24.899478+0000","last_peered":"2023-07-14T13:08:24.899478+0000","last_clean":"2023-07-14T13:08:24.899478+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:08:24.899478+0000","last_undegraded":"2023-07-14T13:08:24.899478+0000","last_fullsized":"2023-07-14T13:08:24.899478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:10:38.210479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.049128+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:08:25.049128+0000","last_peered":"2023-07-14T13:08:25.049128+0000","last_clean":"2023-07-14T13:08:25.049128+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:08:25.049128+0000","last_undegraded":"2023-07-14T13:08:25.049128+0000","last_fullsized":"2023-07-14T13:08:25.049128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:13:04.854090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045110+0000","last_change":"2023-07-14T13:08:23.885699+0000","last_active":"2023-07-14T13:08:25.045110+0000","last_peered":"2023-07-14T13:08:25.045110+0000","last_clean":"2023-07-14T13:08:25.045110+0000","last_became_active":"2023-07-14T13:08:23.884469+0000","last_became_peered":"2023-07-14T13:08:23.884469+0000","last_unstale":"2023-07-14T13:08:25.045110+0000","last_undegraded":"2023-07-14T13:08:25.045110+0000","last_fullsized":"2023-07-14T13:08:25.045110+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:06:08.893708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"82'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.044811+0000","last_change":"2023-07-14T13:08:22.888358+0000","last_active":"2023-07-14T13:08:25.044811+0000","last_peered":"2023-07-14T13:08:25.044811+0000","last_clean":"2023-07-14T13:08:25.044811+0000","last_became_active":"2023-07-14T13:08:22.888086+0000","last_became_peered":"2023-07-14T13:08:22.888086+0000","last_unstale":"2023-07-14T13:08:25.044811+0000","last_undegraded":"2023-07-14T13:08:25.044811+0000","last_fullsized":"2023-07-14T13:08:25.044811+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:12:10.363163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899369+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:08:24.899369+0000","last_peered":"2023-07-14T13:08:24.899369+0000","last_clean":"2023-07-14T13:08:24.899369+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:08:24.899369+0000","last_undegraded":"2023-07-14T13:08:24.899369+0000","last_fullsized":"2023-07-14T13:08:24.899369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:47:26.615295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.047938+0000","last_change":"2023-07-14T13:08:23.899098+0000","last_active":"2023-07-14T13:08:25.047938+0000","last_peered":"2023-07-14T13:08:25.047938+0000","last_clean":"2023-07-14T13:08:25.047938+0000","last_became_active":"2023-07-14T13:08:23.898388+0000","last_became_peered":"2023-07-14T13:08:23.898388+0000","last_unstale":"2023-07-14T13:08:25.047938+0000","last_undegraded":"2023-07-14T13:08:25.047938+0000","last_fullsized":"2023-07-14T13:08:25.047938+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:36:23.840669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048091+0000","last_change":"2023-07-14T13:08:22.894336+0000","last_active":"2023-07-14T13:08:25.048091+0000","last_peered":"2023-07-14T13:08:25.048091+0000","last_clean":"2023-07-14T13:08:25.048091+0000","last_became_active":"2023-07-14T13:08:22.894049+0000","last_became_peered":"2023-07-14T13:08:22.894049+0000","last_unstale":"2023-07-14T13:08:25.048091+0000","last_undegraded":"2023-07-14T13:08:25.048091+0000","last_fullsized":"2023-07-14T13:08:25.048091+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:56:03.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":128,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045574+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:08:25.045574+0000","last_peered":"2023-07-14T13:08:25.045574+0000","last_clean":"2023-07-14T13:08:25.045574+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:08:25.045574+0000","last_undegraded":"2023-07-14T13:08:25.045574+0000","last_fullsized":"2023-07-14T13:08:25.045574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:25:57.129457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048219+0000","last_change":"2023-07-14T13:08:23.901570+0000","last_active":"2023-07-14T13:08:25.048219+0000","last_peered":"2023-07-14T13:08:25.048219+0000","last_clean":"2023-07-14T13:08:25.048219+0000","last_became_active":"2023-07-14T13:08:23.900837+0000","last_became_peered":"2023-07-14T13:08:23.900837+0000","last_unstale":"2023-07-14T13:08:25.048219+0000","last_undegraded":"2023-07-14T13:08:25.048219+0000","last_fullsized":"2023-07-14T13:08:25.048219+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:18:56.013748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.044889+0000","last_change":"2023-07-14T13:08:22.888384+0000","last_active":"2023-07-14T13:08:25.044889+0000","last_peered":"2023-07-14T13:08:25.044889+0000","last_clean":"2023-07-14T13:08:25.044889+0000","last_became_active":"2023-07-14T13:08:22.888062+0000","last_became_peered":"2023-07-14T13:08:22.888062+0000","last_unstale":"2023-07-14T13:08:25.044889+0000","last_undegraded":"2023-07-14T13:08:25.044889+0000","last_fullsized":"2023-07-14T13:08:25.044889+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:45:36.055616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048141+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:08:25.048141+0000","last_peered":"2023-07-14T13:08:25.048141+0000","last_clean":"2023-07-14T13:08:25.048141+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:08:25.048141+0000","last_undegraded":"2023-07-14T13:08:25.048141+0000","last_fullsized":"2023-07-14T13:08:25.048141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:11:22.279127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899927+0000","last_change":"2023-07-14T13:08:23.914210+0000","last_active":"2023-07-14T13:08:24.899927+0000","last_peered":"2023-07-14T13:08:24.899927+0000","last_clean":"2023-07-14T13:08:24.899927+0000","last_became_active":"2023-07-14T13:08:23.911500+0000","last_became_peered":"2023-07-14T13:08:23.911500+0000","last_unstale":"2023-07-14T13:08:24.899927+0000","last_undegraded":"2023-07-14T13:08:24.899927+0000","last_fullsized":"2023-07-14T13:08:24.899927+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:50:21.243267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"82'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.049309+0000","last_change":"2023-07-14T13:08:22.895241+0000","last_active":"2023-07-14T13:08:25.049309+0000","last_peered":"2023-07-14T13:08:25.049309+0000","last_clean":"2023-07-14T13:08:25.049309+0000","last_became_active":"2023-07-14T13:08:22.894924+0000","last_became_peered":"2023-07-14T13:08:22.894924+0000","last_unstale":"2023-07-14T13:08:25.049309+0000","last_undegraded":"2023-07-14T13:08:25.049309+0000","last_fullsized":"2023-07-14T13:08:25.049309+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:15:34.219642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":138,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045688+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:08:25.045688+0000","last_peered":"2023-07-14T13:08:25.045688+0000","last_clean":"2023-07-14T13:08:25.045688+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:08:25.045688+0000","last_undegraded":"2023-07-14T13:08:25.045688+0000","last_fullsized":"2023-07-14T13:08:25.045688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:51:11.137382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048624+0000","last_change":"2023-07-14T13:08:23.904605+0000","last_active":"2023-07-14T13:08:25.048624+0000","last_peered":"2023-07-14T13:08:25.048624+0000","last_clean":"2023-07-14T13:08:25.048624+0000","last_became_active":"2023-07-14T13:08:23.904340+0000","last_became_peered":"2023-07-14T13:08:23.904340+0000","last_unstale":"2023-07-14T13:08:25.048624+0000","last_undegraded":"2023-07-14T13:08:25.048624+0000","last_fullsized":"2023-07-14T13:08:25.048624+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:36:53.504459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"82'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899899+0000","last_change":"2023-07-14T13:08:22.898695+0000","last_active":"2023-07-14T13:08:24.899899+0000","last_peered":"2023-07-14T13:08:24.899899+0000","last_clean":"2023-07-14T13:08:24.899899+0000","last_became_active":"2023-07-14T13:08:22.898408+0000","last_became_peered":"2023-07-14T13:08:22.898408+0000","last_unstale":"2023-07-14T13:08:24.899899+0000","last_undegraded":"2023-07-14T13:08:24.899899+0000","last_fullsized":"2023-07-14T13:08:24.899899+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:44:53.007841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.900149+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:08:24.900149+0000","last_peered":"2023-07-14T13:08:24.900149+0000","last_clean":"2023-07-14T13:08:24.900149+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:08:24.900149+0000","last_undegraded":"2023-07-14T13:08:24.900149+0000","last_fullsized":"2023-07-14T13:08:24.900149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:31:45.606288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048795+0000","last_change":"2023-07-14T13:08:23.895185+0000","last_active":"2023-07-14T13:08:25.048795+0000","last_peered":"2023-07-14T13:08:25.048795+0000","last_clean":"2023-07-14T13:08:25.048795+0000","last_became_active":"2023-07-14T13:08:23.894901+0000","last_became_peered":"2023-07-14T13:08:23.894901+0000","last_unstale":"2023-07-14T13:08:25.048795+0000","last_undegraded":"2023-07-14T13:08:25.048795+0000","last_fullsized":"2023-07-14T13:08:25.048795+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:36:45.999263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"82'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.900082+0000","last_change":"2023-07-14T13:08:22.899305+0000","last_active":"2023-07-14T13:08:24.900082+0000","last_peered":"2023-07-14T13:08:24.900082+0000","last_clean":"2023-07-14T13:08:24.900082+0000","last_became_active":"2023-07-14T13:08:22.898996+0000","last_became_peered":"2023-07-14T13:08:22.898996+0000","last_unstale":"2023-07-14T13:08:24.900082+0000","last_undegraded":"2023-07-14T13:08:24.900082+0000","last_fullsized":"2023-07-14T13:08:24.900082+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:57:25.380682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":138,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.046099+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:08:25.046099+0000","last_peered":"2023-07-14T13:08:25.046099+0000","last_clean":"2023-07-14T13:08:25.046099+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:08:25.046099+0000","last_undegraded":"2023-07-14T13:08:25.046099+0000","last_fullsized":"2023-07-14T13:08:25.046099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:39:53.280298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048701+0000","last_change":"2023-07-14T13:08:23.897543+0000","last_active":"2023-07-14T13:08:25.048701+0000","last_peered":"2023-07-14T13:08:25.048701+0000","last_clean":"2023-07-14T13:08:25.048701+0000","last_became_active":"2023-07-14T13:08:23.896925+0000","last_became_peered":"2023-07-14T13:08:23.896925+0000","last_unstale":"2023-07-14T13:08:25.048701+0000","last_undegraded":"2023-07-14T13:08:25.048701+0000","last_fullsized":"2023-07-14T13:08:25.048701+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:23.802760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.893126+0000","last_change":"2023-07-14T13:08:22.885480+0000","last_active":"2023-07-14T13:08:24.893126+0000","last_peered":"2023-07-14T13:08:24.893126+0000","last_clean":"2023-07-14T13:08:24.893126+0000","last_became_active":"2023-07-14T13:08:22.885180+0000","last_became_peered":"2023-07-14T13:08:22.885180+0000","last_unstale":"2023-07-14T13:08:24.893126+0000","last_undegraded":"2023-07-14T13:08:24.893126+0000","last_fullsized":"2023-07-14T13:08:24.893126+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:31:11.651505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":130,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048753+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:08:25.048753+0000","last_peered":"2023-07-14T13:08:25.048753+0000","last_clean":"2023-07-14T13:08:25.048753+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:08:25.048753+0000","last_undegraded":"2023-07-14T13:08:25.048753+0000","last_fullsized":"2023-07-14T13:08:25.048753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:18:09.383157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575039,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54768,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317072,"statfs":{"total":96636764160,"available":96580681728,"internally_reserved":0,"allocated":1613824,"data_stored":1093226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.51500000000000001,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.98299999999999998,"5min":0.98399999999999999,"15min":1.879},"last":1.262},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.56799999999999995,"5min":0.44,"15min":0.439},"max":{"1min":1.054,"5min":1.054,"15min":1.9059999999999999},"last":1.0720000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73899999999999999,"15min":0.73599999999999999},"min":{"1min":0.504,"5min":0.434,"15min":0.42999999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.069},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.749,"15min":0.746},"min":{"1min":0.54400000000000004,"5min":0.48999999999999999,"15min":0.40500000000000003},"max":{"1min":0.93999999999999995,"5min":0.97399999999999998,"15min":1.1020000000000001},"last":1.1819999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73899999999999999,"15min":0.72799999999999998},"min":{"1min":0.52700000000000002,"5min":0.46999999999999997,"15min":0.40600000000000003},"max":{"1min":0.88100000000000001,"5min":0.98899999999999999,"15min":1.048},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.747,"15min":0.752},"min":{"1min":0.47499999999999998,"5min":0.47199999999999998,"15min":0.46899999999999997},"max":{"1min":0.91300000000000003,"5min":0.97099999999999997,"15min":1.0169999999999999},"last":1.1519999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.746,"15min":0.73399999999999999},"min":{"1min":0.59399999999999997,"5min":0.503,"15min":0.442},"max":{"1min":0.88400000000000001,"5min":1.0269999999999999,"15min":1.0760000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.755,"15min":0.75700000000000001},"min":{"1min":0.60199999999999998,"5min":0.47299999999999998,"15min":0.41499999999999998},"max":{"1min":0.91600000000000004,"5min":1.018,"15min":1.024},"last":0.86699999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.44400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.82099999999999995,"5min":1.0009999999999999,"15min":1.022},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.41799999999999998,"5min":0.40999999999999998,"15min":0.39300000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.626}]},{"osd":5,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59699999999999998,"15min":0.60599999999999998},"min":{"1min":0.39300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.0249999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63400000000000001,"15min":0.65600000000000003},"min":{"1min":0.41999999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.81399999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68400000000000005,"15min":0.70099999999999996},"min":{"1min":0.45200000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.99299999999999999,"5min":1.0489999999999999,"15min":1.4419999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.67600000000000005},"min":{"1min":0.46999999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81200000000000006,"5min":0.95799999999999996,"15min":1.575},"last":0.78300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575040,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":1007616,"data_stored":502116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.57799999999999996,"5min":0.38,"15min":0.38},"max":{"1min":0.90400000000000003,"5min":0.996,"15min":1.2749999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.72499999999999998,"15min":0.74199999999999999},"min":{"1min":0.53600000000000003,"5min":0.48199999999999998,"15min":0.47399999999999998},"max":{"1min":0.98199999999999998,"5min":1.0800000000000001,"15min":1.2110000000000001},"last":0.68799999999999994}]},{"osd":1,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73599999999999999,"15min":0.752},"min":{"1min":0.48299999999999998,"5min":0.47399999999999998,"15min":0.379},"max":{"1min":0.90900000000000003,"5min":1.0089999999999999,"15min":1.4299999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70799999999999996,"15min":0.72599999999999998},"min":{"1min":0.56999999999999995,"5min":0.46999999999999997,"15min":0.44},"max":{"1min":0.86899999999999999,"5min":0.97099999999999997,"15min":1.1379999999999999},"last":0.76800000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.73899999999999999,"15min":0.754},"min":{"1min":0.55800000000000005,"5min":0.45900000000000002,"15min":0.40400000000000003},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":1.319},"last":0.745},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.755,"15min":0.75600000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.42299999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.341},"last":0.89500000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76000000000000001,"15min":0.78100000000000003},"min":{"1min":0.51000000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.054,"5min":1.054,"15min":1.3859999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.52400000000000002,"5min":0.48399999999999999,"15min":0.45900000000000002},"max":{"1min":0.94799999999999995,"5min":0.99099999999999999,"15min":1.1080000000000001},"last":0.79000000000000004}]},{"osd":4,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.97899999999999998},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.624,"15min":0.63900000000000001},"min":{"1min":0.47399999999999998,"5min":0.38500000000000001,"15min":0.36099999999999999},"max":{"1min":0.93500000000000005,"5min":1.012,"15min":1.091},"last":0.84499999999999997}]},{"osd":5,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64100000000000001,"15min":0.64700000000000002},"min":{"1min":0.499,"5min":0.37,"15min":0.37},"max":{"1min":0.96599999999999997,"5min":1.579,"15min":1.579},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67800000000000005,"15min":0.69399999999999995},"min":{"1min":0.46700000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.145},"last":0.82099999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.438,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.208},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.499,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0209999999999999,"5min":1.657,"15min":1.657},"last":0.92400000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575039,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":1007616,"data_stored":502104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.72999999999999998,"15min":0.73599999999999999},"min":{"1min":0.60999999999999999,"5min":0.36499999999999999,"15min":0.32400000000000001},"max":{"1min":0.90200000000000002,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.70799999999999996,"15min":0.73899999999999999},"min":{"1min":0.52500000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.63700000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71799999999999997,"15min":0.73099999999999998},"min":{"1min":0.56399999999999995,"5min":0.44500000000000001,"15min":0.41099999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.335},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.745,"15min":0.752},"min":{"1min":0.60299999999999998,"5min":0.48699999999999999,"15min":0.36799999999999999},"max":{"1min":0.94499999999999995,"5min":2.706,"15min":2.706},"last":0.90000000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72399999999999998,"15min":0.74399999999999999},"min":{"1min":0.59499999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.212,"5min":1.212,"15min":1.298},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.71899999999999997,"15min":0.73999999999999999},"min":{"1min":0.53800000000000003,"5min":0.433,"15min":0.433},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.753}]},{"osd":3,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.75,"15min":0.751},"min":{"1min":0.60599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.90900000000000003,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.57999999999999996,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.81499999999999995}]},{"osd":4,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.45700000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68000000000000005,"15min":0.68899999999999995},"min":{"1min":0.443,"5min":0.36299999999999999,"15min":0.35899999999999999},"max":{"1min":0.86799999999999999,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.83799999999999997}]},{"osd":6,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60199999999999998,"15min":0.62},"min":{"1min":0.41699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63900000000000001,"15min":0.64600000000000002},"min":{"1min":0.496,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.79400000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66000000000000003,"15min":0.64900000000000002},"min":{"1min":0.48899999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.026,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.46600000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.2589999999999999,"5min":1.407,"15min":1.407},"last":0.88300000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575039,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":1015808,"data_stored":503646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.73999999999999999,"15min":0.73499999999999999},"min":{"1min":0.56200000000000006,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92400000000000004,"5min":1.411,"15min":1.411},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.76800000000000002,"15min":0.73199999999999998},"min":{"1min":0.64000000000000001,"5min":0.45800000000000002,"15min":0.435},"max":{"1min":0.94599999999999995,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.45100000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77000000000000002,"15min":0.751},"min":{"1min":0.62,"5min":0.47999999999999998,"15min":0.442},"max":{"1min":0.90700000000000003,"5min":1.077,"15min":1.077},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.54600000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91900000000000004,"5min":1.0469999999999999,"15min":1.2370000000000001},"last":0.496}]},{"osd":2,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.749,"15min":0.73599999999999999},"min":{"1min":0.60799999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.95599999999999996,"5min":1.091,"15min":1.091},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79800000000000004,"15min":0.77600000000000002},"min":{"1min":0.60399999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98199999999999998,"5min":1.387,"15min":1.387},"last":0.66900000000000004}]},{"osd":3,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75,"15min":0.748},"min":{"1min":0.58099999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84799999999999998,"5min":1.008,"15min":1.099},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77500000000000002,"15min":0.77300000000000002},"min":{"1min":0.64700000000000002,"5min":0.496,"15min":0.46800000000000003},"max":{"1min":0.98699999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.621}]},{"osd":5,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.61699999999999999,"15min":0.60499999999999998},"min":{"1min":0.437,"5min":0.378,"15min":0.378},"max":{"1min":0.76400000000000001,"5min":0.95599999999999996,"15min":1.0029999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.627,"15min":0.61799999999999999},"min":{"1min":0.52400000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85799999999999998,"5min":0.93600000000000005,"15min":0.95199999999999996},"last":0.63800000000000001}]},{"osd":6,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.621,"15min":0.62},"min":{"1min":0.48699999999999999,"5min":0.38900000000000001,"15min":0.32300000000000001},"max":{"1min":0.873,"5min":1.014,"15min":1.014},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.51900000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.94599999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.60599999999999998}]},{"osd":7,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.68200000000000005,"15min":0.67100000000000004},"min":{"1min":0.57199999999999995,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93200000000000005,"5min":0.94699999999999995,"15min":1.0349999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.55800000000000005,"5min":0.40300000000000002,"15min":0.36899999999999999},"max":{"1min":0.96899999999999997,"5min":1.0629999999999999,"15min":1.1080000000000001},"last":0.70099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575039,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36124,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335716,"statfs":{"total":96636764160,"available":96599773184,"internally_reserved":0,"allocated":1003520,"data_stored":502082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.44900000000000001,"15min":0.44600000000000001},"min":{"1min":0.32300000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.70099999999999996,"5min":0.755,"15min":0.84199999999999997},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.309},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":1.577},"last":0.51300000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47699999999999998,"15min":0.47799999999999998},"min":{"1min":0.33100000000000002,"5min":0.315,"15min":0.29199999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.88200000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54900000000000004,"15min":0.54300000000000004},"min":{"1min":0.438,"5min":0.35899999999999999,"15min":0.32600000000000001},"max":{"1min":0.71399999999999997,"5min":1.0029999999999999,"15min":1.113},"last":0.57199999999999995}]},{"osd":2,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55600000000000005,"15min":0.57199999999999995},"min":{"1min":0.40999999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.82599999999999996,"5min":0.88400000000000001,"15min":1.0820000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.60399999999999998},"min":{"1min":0.436,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.747,"5min":1.663,"15min":1.663},"last":0.49299999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.76800000000000002,"15min":0.76900000000000002},"min":{"1min":0.60499999999999998,"5min":0.47899999999999998,"15min":0.439},"max":{"1min":1.018,"5min":1.284,"15min":1.627},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.61699999999999999,"5min":0.56399999999999995,"15min":0.47699999999999998},"max":{"1min":1.0469999999999999,"5min":1.121,"15min":1.214},"last":0.72799999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.79800000000000004,"15min":0.79900000000000004},"min":{"1min":0.65700000000000003,"5min":0.58499999999999996,"15min":0.52400000000000002},"max":{"1min":0.997,"5min":1.306,"15min":1.333},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.55000000000000004,"5min":0.372,"15min":0.372},"max":{"1min":0.98899999999999999,"5min":1.1870000000000001,"15min":1.2470000000000001},"last":0.67100000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77700000000000002,"15min":0.78600000000000003},"min":{"1min":0.60399999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.99199999999999999,"5min":1.105,"15min":1.526},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.81699999999999995,"15min":0.82199999999999995},"min":{"1min":0.59199999999999997,"5min":0.54200000000000004,"15min":0.505},"max":{"1min":1.0109999999999999,"5min":1.2589999999999999,"15min":1.381},"last":0.68600000000000005}]},{"osd":7,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.85799999999999998,"15min":0.84799999999999998},"min":{"1min":0.66400000000000003,"5min":0.55800000000000005,"15min":0.53100000000000003},"max":{"1min":1.0349999999999999,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.83799999999999997,"15min":0.83699999999999997},"min":{"1min":0.63,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.026,"5min":1.595,"15min":1.6910000000000001},"last":0.77000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575039,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58264,"kb_used_data":976,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313576,"statfs":{"total":96636764160,"available":96577101824,"internally_reserved":0,"allocated":999424,"data_stored":501063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.32100000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64500000000000002,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55500000000000005,"15min":0.54100000000000004},"min":{"1min":0.34100000000000003,"5min":0.32900000000000001,"15min":0.28999999999999998},"max":{"1min":0.80800000000000005,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.33900000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48599999999999999,"15min":0.47599999999999998},"min":{"1min":0.38,"5min":0.29999999999999999,"15min":0.27500000000000002},"max":{"1min":0.71599999999999997,"5min":2.7200000000000002,"15min":2.7200000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.40899999999999997,"5min":0.35999999999999999,"15min":0.33000000000000002},"max":{"1min":0.77900000000000003,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":0.438}]},{"osd":3,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.66200000000000003,"15min":0.60699999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72099999999999997,"5min":8.2530000000000001,"15min":8.2530000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.55400000000000005},"min":{"1min":0.40300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77200000000000002,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.41399999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76800000000000002,"15min":0.78300000000000003},"min":{"1min":0.61599999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.95199999999999996,"5min":1.0940000000000001,"15min":1.3049999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78500000000000003,"15min":0.80100000000000005},"min":{"1min":0.58199999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.006,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.748}]},{"osd":5,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.86299999999999999,"15min":0.86599999999999999},"min":{"1min":0.64600000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0640000000000001,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.84299999999999997,"15min":0.84399999999999997},"min":{"1min":0.57799999999999996,"5min":0.55600000000000005,"15min":0.433},"max":{"1min":1.081,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.67300000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.81100000000000005,"15min":0.80700000000000005},"min":{"1min":0.60399999999999998,"5min":0.48999999999999999,"15min":0.47599999999999998},"max":{"1min":0.99099999999999999,"5min":3.9849999999999999,"15min":3.9849999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82199999999999995,"15min":0.81699999999999995},"min":{"1min":0.64600000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98499999999999999,"5min":3.391,"15min":3.391},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.81799999999999995,"15min":0.82799999999999996},"min":{"1min":0.61099999999999999,"5min":0.5,"15min":0.5},"max":{"1min":1.022,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83399999999999996,"15min":0.82599999999999996},"min":{"1min":0.66900000000000004,"5min":0.53200000000000003,"15min":0.50900000000000001},"max":{"1min":1.0069999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.71399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575040,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36152,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335688,"statfs":{"total":96636764160,"available":96599744512,"internally_reserved":0,"allocated":1032192,"data_stored":504410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.439,"15min":0.43099999999999999},"min":{"1min":0.317,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.65400000000000003,"5min":0.67200000000000004,"15min":0.77200000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.51800000000000002,"15min":0.504},"min":{"1min":0.34799999999999998,"5min":0.28199999999999997,"15min":0.26500000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.95699999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47599999999999998,"15min":0.47199999999999998},"min":{"1min":0.34599999999999997,"5min":0.32100000000000001,"15min":0.29499999999999998},"max":{"1min":0.67900000000000005,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.38200000000000001,"5min":0.30599999999999999,"15min":0.29299999999999998},"max":{"1min":0.74399999999999999,"5min":1.014,"15min":1.014},"last":0.47099999999999997}]},{"osd":3,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.55100000000000005,"5min":0.44700000000000001,"15min":0.432},"max":{"1min":0.80300000000000005,"5min":0.86899999999999999,"15min":0.96299999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.57999999999999996},"min":{"1min":0.46200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.80300000000000005,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.52100000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.79300000000000004,"15min":0.78400000000000003},"min":{"1min":0.61299999999999999,"5min":0.51300000000000001,"15min":0.40000000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.236},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.77800000000000002,"15min":0.78500000000000003},"min":{"1min":0.54900000000000004,"5min":0.502,"15min":0.45700000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.82099999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.67900000000000005,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":1.1000000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.81200000000000006,"15min":0.80400000000000005},"min":{"1min":0.56999999999999995,"5min":0.48599999999999999,"15min":0.48199999999999998},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.3600000000000001},"last":0.78000000000000003}]},{"osd":6,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.80000000000000004,"15min":0.80200000000000005},"min":{"1min":0.58299999999999996,"5min":0.503,"15min":0.48499999999999999},"max":{"1min":1.1120000000000001,"5min":1.2170000000000001,"15min":1.274},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.82899999999999996,"15min":0.81799999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.49199999999999999},"max":{"1min":1.1319999999999999,"5min":1.262,"15min":1.2969999999999999},"last":0.80600000000000005}]},{"osd":7,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.79700000000000004},"min":{"1min":0.62,"5min":0.55200000000000005,"15min":0.47799999999999998},"max":{"1min":1.1579999999999999,"5min":1.1859999999999999,"15min":1.3400000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.87,"5min":0.84599999999999997,"15min":0.84199999999999997},"min":{"1min":0.60799999999999998,"5min":0.53700000000000003,"15min":0.52800000000000002},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.65800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575041,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36700,"kb_used_data":1556,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335140,"statfs":{"total":96636764160,"available":96599183360,"internally_reserved":0,"allocated":1593344,"data_stored":1091431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47099999999999997,"15min":0.45300000000000001},"min":{"1min":0.30199999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.76500000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.254},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.33000000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":1.452},"last":0.42799999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53800000000000003,"15min":0.52000000000000002},"min":{"1min":0.39800000000000002,"5min":0.35799999999999998,"15min":0.34100000000000003},"max":{"1min":0.84499999999999997,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.376,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71699999999999997,"5min":0.80300000000000005,"15min":1.5700000000000001},"last":0.39800000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.499,"15min":0.50700000000000001},"min":{"1min":0.432,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.99299999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77100000000000002,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.46100000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.79900000000000004,"15min":0.79000000000000004},"min":{"1min":0.55200000000000005,"5min":0.48399999999999999,"15min":0.44400000000000001},"max":{"1min":1.21,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81999999999999995,"15min":0.81100000000000005},"min":{"1min":0.57999999999999996,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.03,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.59499999999999997}]},{"osd":5,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81000000000000005,"15min":0.81100000000000005},"min":{"1min":0.56999999999999995,"5min":0.51800000000000002,"15min":0.47899999999999998},"max":{"1min":1.042,"5min":1.3839999999999999,"15min":1.4950000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.80000000000000004,"15min":0.80100000000000005},"min":{"1min":0.621,"5min":0.49299999999999999,"15min":0.47299999999999998},"max":{"1min":1.069,"5min":1.325,"15min":1.325},"last":0.69599999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.82299999999999995,"15min":0.81399999999999995},"min":{"1min":0.58699999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.05,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.63900000000000001,"5min":0.50600000000000001,"15min":0.41299999999999998},"max":{"1min":1.044,"5min":1.3440000000000001,"15min":1.5369999999999999},"last":0.58399999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.82899999999999996,"15min":0.83799999999999997},"min":{"1min":0.60599999999999998,"5min":0.503,"15min":0.45500000000000002},"max":{"1min":1.1180000000000001,"5min":1.2749999999999999,"15min":1.603},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.80500000000000005,"15min":0.81799999999999995},"min":{"1min":0.65100000000000002,"5min":0.502,"15min":0.497},"max":{"1min":1.0880000000000001,"5min":1.381,"15min":1.381},"last":0.57099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:08:32.640 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:08:32.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.764+0000 7f0a18819640 1 Processor -- start 2023-07-14T13:08:32.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.764+0000 7f0a18819640 1 -- start start 2023-07-14T13:08:32.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.764+0000 7f0a18819640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0a140cb780 0x7f0a140cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:32.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.764+0000 7f0a18819640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0a1406b8f0 0x7f0a140cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:32.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.764+0000 7f0a18819640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a1406f900 con 0x7f0a1415b7c0 2023-07-14T13:08:32.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.764+0000 7f0a18819640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a140cdce0 con 0x7f0a140cb780 2023-07-14T13:08:32.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.764+0000 7f0a18819640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a140ca830 con 0x7f0a1406b8f0 2023-07-14T13:08:32.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.764+0000 7f0a1259c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0a1415b7c0 0x7f0a1406b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40214/0 (socket says 172.21.15.5:40214) 2023-07-14T13:08:32.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.764+0000 7f0a1259c640 1 -- 172.21.15.5:0/2296386649 learned_addr learned my addr 172.21.15.5:0/2296386649 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:32.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.764+0000 7f0a0bfff640 1 --2- 172.21.15.5:0/2296386649 >> v2:172.21.15.5:3300/0 conn(0x7f0a140cb780 0x7f0a140cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:32.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.764+0000 7f0a12d9d640 1 --2- 172.21.15.5:0/2296386649 >> v2:172.21.15.154:3300/0 conn(0x7f0a1406b8f0 0x7f0a140cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:32.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.764+0000 7f0a11d9b640 1 -- 172.21.15.5:0/2296386649 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 570766542 0 0) 0x7f0a1406f900 con 0x7f0a1415b7c0 2023-07-14T13:08:32.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.764+0000 7f0a11d9b640 1 -- 172.21.15.5:0/2296386649 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a00003530 con 0x7f0a1415b7c0 2023-07-14T13:08:32.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.764+0000 7f0a0bfff640 1 -- 172.21.15.5:0/2296386649 >> v2:172.21.15.154:3300/0 conn(0x7f0a1406b8f0 msgr2=0x7f0a140cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:32.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.764+0000 7f0a0bfff640 1 --2- 172.21.15.5:0/2296386649 >> v2:172.21.15.154:3300/0 conn(0x7f0a1406b8f0 0x7f0a140cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:32.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.764+0000 7f0a0bfff640 1 -- 172.21.15.5:0/2296386649 >> v1:172.21.15.5:6789/0 conn(0x7f0a1415b7c0 legacy=0x7f0a1406b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:32.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.764+0000 7f0a0bfff640 1 -- 172.21.15.5:0/2296386649 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1415bb90 con 0x7f0a140cb780 2023-07-14T13:08:32.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.768+0000 7f0a0bfff640 1 --2- 172.21.15.5:0/2296386649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a140cb780 0x7f0a140cbd30 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f0a1406a410 tx=0x7f09fc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8de10e112d95f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:32.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.768+0000 7f0a11d9b640 1 -- 172.21.15.5:0/2296386649 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc0ab600 con 0x7f0a140cb780 2023-07-14T13:08:32.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.768+0000 7f0a11d9b640 1 -- 172.21.15.5:0/2296386649 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09fc0a7050 con 0x7f0a140cb780 2023-07-14T13:08:32.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.768+0000 7f0a11d9b640 1 -- 172.21.15.5:0/2296386649 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc0ab980 con 0x7f0a140cb780 2023-07-14T13:08:32.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.768+0000 7f0a18819640 1 -- 172.21.15.5:0/2296386649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a140cb780 msgr2=0x7f0a140cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:32.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.768+0000 7f0a18819640 1 --2- 172.21.15.5:0/2296386649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a140cb780 0x7f0a140cbd30 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f0a1406a410 tx=0x7f09fc01c430 comp rx=0 tx=0).stop 2023-07-14T13:08:32.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.768+0000 7f0a18819640 1 -- 172.21.15.5:0/2296386649 shutdown_connections 2023-07-14T13:08:32.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.768+0000 7f0a18819640 1 --2- 172.21.15.5:0/2296386649 >> v2:172.21.15.154:3300/0 conn(0x7f0a1406b8f0 0x7f0a140cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:32.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.768+0000 7f0a18819640 1 --2- 172.21.15.5:0/2296386649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a140cb780 0x7f0a140cbd30 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:32.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.768+0000 7f0a18819640 1 -- 172.21.15.5:0/2296386649 >> 172.21.15.5:0/2296386649 conn(0x7f0a140afcf0 msgr2=0x7f0a140b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:32.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.768+0000 7f0a18819640 1 -- 172.21.15.5:0/2296386649 shutdown_connections 2023-07-14T13:08:32.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.768+0000 7f0a18819640 1 -- 172.21.15.5:0/2296386649 wait complete. 2023-07-14T13:08:32.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.772+0000 7f0a18819640 1 Processor -- start 2023-07-14T13:08:32.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.772+0000 7f0a18819640 1 -- start start 2023-07-14T13:08:32.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.772+0000 7f0a18819640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a1406b8f0 0x7f0a141f7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:32.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.772+0000 7f0a18819640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1415b7c0 0x7f0a141f5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:32.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.772+0000 7f0a18819640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a14156530 0x7f0a14166370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:32.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.772+0000 7f0a18819640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a141f57b0 con 0x7f0a1415b7c0 2023-07-14T13:08:32.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.772+0000 7f0a18819640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a141f8cb0 con 0x7f0a1406b8f0 2023-07-14T13:08:32.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.772+0000 7f0a18819640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a141f8410 con 0x7f0a14156530 2023-07-14T13:08:32.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.772+0000 7f0a0bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1415b7c0 0x7f0a141f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:32.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.772+0000 7f0a0bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1415b7c0 0x7f0a141f5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51778/0 (socket says 172.21.15.5:51778) 2023-07-14T13:08:32.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.772+0000 7f0a0bfff640 1 -- 172.21.15.5:0/1101187580 learned_addr learned my addr 172.21.15.5:0/1101187580 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:32.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.772+0000 7f0a1259c640 1 --2- 172.21.15.5:0/1101187580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a1406b8f0 0x7f0a141f7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:32.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.772+0000 7f0a0bfff640 1 -- 172.21.15.5:0/1101187580 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a14156530 msgr2=0x7f0a14166370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:32.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.772+0000 7f0a12d9d640 1 --2- 172.21.15.5:0/1101187580 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a14156530 0x7f0a14166370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:32.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.772+0000 7f0a0bfff640 1 --2- 172.21.15.5:0/1101187580 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a14156530 0x7f0a14166370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:32.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.772+0000 7f0a0bfff640 1 -- 172.21.15.5:0/1101187580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a1406b8f0 msgr2=0x7f0a141f7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:32.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.772+0000 7f0a0bfff640 1 --2- 172.21.15.5:0/1101187580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a1406b8f0 0x7f0a141f7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:32.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.772+0000 7f0a0bfff640 1 -- 172.21.15.5:0/1101187580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc009420 con 0x7f0a1415b7c0 2023-07-14T13:08:32.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.772+0000 7f0a1259c640 1 --2- 172.21.15.5:0/1101187580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a1406b8f0 0x7f0a141f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:08:32.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.772+0000 7f0a12d9d640 1 --2- 172.21.15.5:0/1101187580 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a14156530 0x7f0a14166370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:08:32.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.772+0000 7f0a0bfff640 1 --2- 172.21.15.5:0/1101187580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1415b7c0 0x7f0a141f5270 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f09fc01a060 tx=0x7f09fc0191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:32.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.772+0000 7f0a0affd640 1 -- 172.21.15.5:0/1101187580 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc0abe70 con 0x7f0a1415b7c0 2023-07-14T13:08:32.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.772+0000 7f0a0affd640 1 -- 172.21.15.5:0/1101187580 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09fc0b4430 con 0x7f0a1415b7c0 2023-07-14T13:08:32.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.772+0000 7f0a0affd640 1 -- 172.21.15.5:0/1101187580 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc0b4800 con 0x7f0a1415b7c0 2023-07-14T13:08:32.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.772+0000 7f0a18819640 1 -- 172.21.15.5:0/1101187580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a141f86f0 con 0x7f0a1415b7c0 2023-07-14T13:08:32.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.772+0000 7f0a18819640 1 -- 172.21.15.5:0/1101187580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a140c1fb0 con 0x7f0a1415b7c0 2023-07-14T13:08:32.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.776+0000 7f0a18819640 1 -- 172.21.15.5:0/1101187580 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a140678d0 con 0x7f0a1415b7c0 2023-07-14T13:08:32.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.776+0000 7f0a0affd640 1 -- 172.21.15.5:0/1101187580 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f09fc0b2040 con 0x7f0a1415b7c0 2023-07-14T13:08:32.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.776+0000 7f0a0affd640 1 --2- 172.21.15.5:0/1101187580 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f09f40663a0 0x7f09f4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.776+0000 7f0a0affd640 1 -- 172.21.15.5:0/1101187580 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f09fc11de90 con 0x7f0a1415b7c0 2023-07-14T13:08:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.776+0000 7f0a1259c640 1 --2- 172.21.15.5:0/1101187580 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f09f40663a0 0x7f09f4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.776+0000 7f0a1259c640 1 --2- 172.21.15.5:0/1101187580 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f09f40663a0 0x7f09f4068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0a040011f0 tx=0x7f0a04009040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:32.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.780+0000 7f0a0affd640 1 -- 172.21.15.5:0/1101187580 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f09fc0eb050 con 0x7f0a1415b7c0 2023-07-14T13:08:32.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.936+0000 7f0a18819640 1 -- 172.21.15.5:0/1101187580 --> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0a1406f590 con 0x7f09f40663a0 2023-07-14T13:08:32.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.944+0000 7f0a0affd640 1 -- 172.21.15.5:0/1101187580 <== mgr.5648 v2:172.21.15.154:6832/1874317247 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310883 (secure 0 0 0) 0x7f0a04001c90 con 0x7f09f40663a0 2023-07-14T13:08:32.980 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:32.981 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:08:32.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.948+0000 7f0a18819640 1 -- 172.21.15.5:0/1101187580 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f09f40663a0 msgr2=0x7f09f4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:32.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.948+0000 7f0a18819640 1 --2- 172.21.15.5:0/1101187580 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f09f40663a0 0x7f09f4068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0a040011f0 tx=0x7f0a04009040 comp rx=0 tx=0).stop 2023-07-14T13:08:32.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.948+0000 7f0a18819640 1 -- 172.21.15.5:0/1101187580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1415b7c0 msgr2=0x7f0a141f5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:32.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.948+0000 7f0a18819640 1 --2- 172.21.15.5:0/1101187580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1415b7c0 0x7f0a141f5270 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f09fc01a060 tx=0x7f09fc0191d0 comp rx=0 tx=0).stop 2023-07-14T13:08:32.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.948+0000 7f0a18819640 1 -- 172.21.15.5:0/1101187580 shutdown_connections 2023-07-14T13:08:32.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.948+0000 7f0a18819640 1 --2- 172.21.15.5:0/1101187580 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f09f40663a0 0x7f09f4068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:32.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.948+0000 7f0a18819640 1 --2- 172.21.15.5:0/1101187580 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0a14156530 0x7f0a14166370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:32.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.948+0000 7f0a18819640 1 --2- 172.21.15.5:0/1101187580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1415b7c0 0x7f0a141f5270 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:32.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.948+0000 7f0a18819640 1 --2- 172.21.15.5:0/1101187580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a1406b8f0 0x7f0a141f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:32.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.948+0000 7f0a18819640 1 -- 172.21.15.5:0/1101187580 >> 172.21.15.5:0/1101187580 conn(0x7f0a140afcf0 msgr2=0x7f0a140af440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:32.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.948+0000 7f0a18819640 1 -- 172.21.15.5:0/1101187580 shutdown_connections 2023-07-14T13:08:32.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:32.948+0000 7f0a18819640 1 -- 172.21.15.5:0/1101187580 wait complete. 2023-07-14T13:08:33.000 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-14T13:08:31.516031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":284,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":207,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":314016,"kb_used_data":9056,"kb_used_omap":0,"kb_used_meta":304896,"kb_avail":754660704,"statfs":{"total":773094113280,"available":772772560896,"internally_reserved":0,"allocated":9273344,"data_stored":5200078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312213504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002292"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045423+0000","last_change":"2023-07-14T13:08:23.905921+0000","last_active":"2023-07-14T13:08:25.045423+0000","last_peered":"2023-07-14T13:08:25.045423+0000","last_clean":"2023-07-14T13:08:25.045423+0000","last_became_active":"2023-07-14T13:08:23.905634+0000","last_became_peered":"2023-07-14T13:08:23.905634+0000","last_unstale":"2023-07-14T13:08:25.045423+0000","last_undegraded":"2023-07-14T13:08:25.045423+0000","last_fullsized":"2023-07-14T13:08:25.045423+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:51:03.865057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.046034+0000","last_change":"2023-07-14T13:08:23.882039+0000","last_active":"2023-07-14T13:08:25.046034+0000","last_peered":"2023-07-14T13:08:25.046034+0000","last_clean":"2023-07-14T13:08:25.046034+0000","last_became_active":"2023-07-14T13:08:23.881770+0000","last_became_peered":"2023-07-14T13:08:23.881770+0000","last_unstale":"2023-07-14T13:08:25.046034+0000","last_undegraded":"2023-07-14T13:08:25.046034+0000","last_fullsized":"2023-07-14T13:08:25.046034+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:24:12.085418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899793+0000","last_change":"2023-07-14T13:08:23.901855+0000","last_active":"2023-07-14T13:08:24.899793+0000","last_peered":"2023-07-14T13:08:24.899793+0000","last_clean":"2023-07-14T13:08:24.899793+0000","last_became_active":"2023-07-14T13:08:23.901563+0000","last_became_peered":"2023-07-14T13:08:23.901563+0000","last_unstale":"2023-07-14T13:08:24.899793+0000","last_undegraded":"2023-07-14T13:08:24.899793+0000","last_fullsized":"2023-07-14T13:08:24.899793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:24:37.315704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048446+0000","last_change":"2023-07-14T13:08:23.886064+0000","last_active":"2023-07-14T13:08:25.048446+0000","last_peered":"2023-07-14T13:08:25.048446+0000","last_clean":"2023-07-14T13:08:25.048446+0000","last_became_active":"2023-07-14T13:08:23.885778+0000","last_became_peered":"2023-07-14T13:08:23.885778+0000","last_unstale":"2023-07-14T13:08:25.048446+0000","last_undegraded":"2023-07-14T13:08:25.048446+0000","last_fullsized":"2023-07-14T13:08:25.048446+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:34:33.895370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048024+0000","last_change":"2023-07-14T13:08:23.904565+0000","last_active":"2023-07-14T13:08:25.048024+0000","last_peered":"2023-07-14T13:08:25.048024+0000","last_clean":"2023-07-14T13:08:25.048024+0000","last_became_active":"2023-07-14T13:08:23.904259+0000","last_became_peered":"2023-07-14T13:08:23.904259+0000","last_unstale":"2023-07-14T13:08:25.048024+0000","last_undegraded":"2023-07-14T13:08:25.048024+0000","last_fullsized":"2023-07-14T13:08:25.048024+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:54:24.528317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045592+0000","last_change":"2023-07-14T13:08:23.904798+0000","last_active":"2023-07-14T13:08:25.045592+0000","last_peered":"2023-07-14T13:08:25.045592+0000","last_clean":"2023-07-14T13:08:25.045592+0000","last_became_active":"2023-07-14T13:08:23.904476+0000","last_became_peered":"2023-07-14T13:08:23.904476+0000","last_unstale":"2023-07-14T13:08:25.045592+0000","last_undegraded":"2023-07-14T13:08:25.045592+0000","last_fullsized":"2023-07-14T13:08:25.045592+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:14:47.476311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.044392+0000","last_change":"2023-07-14T13:08:23.903612+0000","last_active":"2023-07-14T13:08:25.044392+0000","last_peered":"2023-07-14T13:08:25.044392+0000","last_clean":"2023-07-14T13:08:25.044392+0000","last_became_active":"2023-07-14T13:08:23.903272+0000","last_became_peered":"2023-07-14T13:08:23.903272+0000","last_unstale":"2023-07-14T13:08:25.044392+0000","last_undegraded":"2023-07-14T13:08:25.044392+0000","last_fullsized":"2023-07-14T13:08:25.044392+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:32:24.029612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.047779+0000","last_change":"2023-07-14T13:08:23.910590+0000","last_active":"2023-07-14T13:08:25.047779+0000","last_peered":"2023-07-14T13:08:25.047779+0000","last_clean":"2023-07-14T13:08:25.047779+0000","last_became_active":"2023-07-14T13:08:23.910327+0000","last_became_peered":"2023-07-14T13:08:23.910327+0000","last_unstale":"2023-07-14T13:08:25.047779+0000","last_undegraded":"2023-07-14T13:08:25.047779+0000","last_fullsized":"2023-07-14T13:08:25.047779+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:28:29.037116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899952+0000","last_change":"2023-07-14T13:08:23.913807+0000","last_active":"2023-07-14T13:08:24.899952+0000","last_peered":"2023-07-14T13:08:24.899952+0000","last_clean":"2023-07-14T13:08:24.899952+0000","last_became_active":"2023-07-14T13:08:23.913486+0000","last_became_peered":"2023-07-14T13:08:23.913486+0000","last_unstale":"2023-07-14T13:08:24.899952+0000","last_undegraded":"2023-07-14T13:08:24.899952+0000","last_fullsized":"2023-07-14T13:08:24.899952+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:30:05.724323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899864+0000","last_change":"2023-07-14T13:08:23.897804+0000","last_active":"2023-07-14T13:08:24.899864+0000","last_peered":"2023-07-14T13:08:24.899864+0000","last_clean":"2023-07-14T13:08:24.899864+0000","last_became_active":"2023-07-14T13:08:23.897497+0000","last_became_peered":"2023-07-14T13:08:23.897497+0000","last_unstale":"2023-07-14T13:08:24.899864+0000","last_undegraded":"2023-07-14T13:08:24.899864+0000","last_fullsized":"2023-07-14T13:08:24.899864+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:08:37.141024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048994+0000","last_change":"2023-07-14T13:08:23.889945+0000","last_active":"2023-07-14T13:08:25.048994+0000","last_peered":"2023-07-14T13:08:25.048994+0000","last_clean":"2023-07-14T13:08:25.048994+0000","last_became_active":"2023-07-14T13:08:23.889680+0000","last_became_peered":"2023-07-14T13:08:23.889680+0000","last_unstale":"2023-07-14T13:08:25.048994+0000","last_undegraded":"2023-07-14T13:08:25.048994+0000","last_fullsized":"2023-07-14T13:08:25.048994+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:12:39.593879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.049004+0000","last_change":"2023-07-14T13:08:23.912010+0000","last_active":"2023-07-14T13:08:25.049004+0000","last_peered":"2023-07-14T13:08:25.049004+0000","last_clean":"2023-07-14T13:08:25.049004+0000","last_became_active":"2023-07-14T13:08:23.911731+0000","last_became_peered":"2023-07-14T13:08:23.911731+0000","last_unstale":"2023-07-14T13:08:25.049004+0000","last_undegraded":"2023-07-14T13:08:25.049004+0000","last_fullsized":"2023-07-14T13:08:25.049004+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:23:32.877562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048856+0000","last_change":"2023-07-14T13:08:23.908733+0000","last_active":"2023-07-14T13:08:25.048856+0000","last_peered":"2023-07-14T13:08:25.048856+0000","last_clean":"2023-07-14T13:08:25.048856+0000","last_became_active":"2023-07-14T13:08:23.908445+0000","last_became_peered":"2023-07-14T13:08:23.908445+0000","last_unstale":"2023-07-14T13:08:25.048856+0000","last_undegraded":"2023-07-14T13:08:25.048856+0000","last_fullsized":"2023-07-14T13:08:25.048856+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:29:42.573304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899525+0000","last_change":"2023-07-14T13:08:23.906643+0000","last_active":"2023-07-14T13:08:24.899525+0000","last_peered":"2023-07-14T13:08:24.899525+0000","last_clean":"2023-07-14T13:08:24.899525+0000","last_became_active":"2023-07-14T13:08:23.906346+0000","last_became_peered":"2023-07-14T13:08:23.906346+0000","last_unstale":"2023-07-14T13:08:24.899525+0000","last_undegraded":"2023-07-14T13:08:24.899525+0000","last_fullsized":"2023-07-14T13:08:24.899525+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:48:46.443381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899296+0000","last_change":"2023-07-14T13:08:23.907024+0000","last_active":"2023-07-14T13:08:24.899296+0000","last_peered":"2023-07-14T13:08:24.899296+0000","last_clean":"2023-07-14T13:08:24.899296+0000","last_became_active":"2023-07-14T13:08:23.905952+0000","last_became_peered":"2023-07-14T13:08:23.905952+0000","last_unstale":"2023-07-14T13:08:24.899296+0000","last_undegraded":"2023-07-14T13:08:24.899296+0000","last_fullsized":"2023-07-14T13:08:24.899296+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:20:45.459752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.044433+0000","last_change":"2023-07-14T13:08:23.895947+0000","last_active":"2023-07-14T13:08:25.044433+0000","last_peered":"2023-07-14T13:08:25.044433+0000","last_clean":"2023-07-14T13:08:25.044433+0000","last_became_active":"2023-07-14T13:08:23.895674+0000","last_became_peered":"2023-07-14T13:08:23.895674+0000","last_unstale":"2023-07-14T13:08:25.044433+0000","last_undegraded":"2023-07-14T13:08:25.044433+0000","last_fullsized":"2023-07-14T13:08:25.044433+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:30.024107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045560+0000","last_change":"2023-07-14T13:08:23.902617+0000","last_active":"2023-07-14T13:08:25.045560+0000","last_peered":"2023-07-14T13:08:25.045560+0000","last_clean":"2023-07-14T13:08:25.045560+0000","last_became_active":"2023-07-14T13:08:23.902180+0000","last_became_peered":"2023-07-14T13:08:23.902180+0000","last_unstale":"2023-07-14T13:08:25.045560+0000","last_undegraded":"2023-07-14T13:08:25.045560+0000","last_fullsized":"2023-07-14T13:08:25.045560+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:31:12.659287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048644+0000","last_change":"2023-07-14T13:08:23.887008+0000","last_active":"2023-07-14T13:08:25.048644+0000","last_peered":"2023-07-14T13:08:25.048644+0000","last_clean":"2023-07-14T13:08:25.048644+0000","last_became_active":"2023-07-14T13:08:23.886643+0000","last_became_peered":"2023-07-14T13:08:23.886643+0000","last_unstale":"2023-07-14T13:08:25.048644+0000","last_undegraded":"2023-07-14T13:08:25.048644+0000","last_fullsized":"2023-07-14T13:08:25.048644+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:13:12.282482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048207+0000","last_change":"2023-07-14T13:08:23.891663+0000","last_active":"2023-07-14T13:08:25.048207+0000","last_peered":"2023-07-14T13:08:25.048207+0000","last_clean":"2023-07-14T13:08:25.048207+0000","last_became_active":"2023-07-14T13:08:23.891290+0000","last_became_peered":"2023-07-14T13:08:23.891290+0000","last_unstale":"2023-07-14T13:08:25.048207+0000","last_undegraded":"2023-07-14T13:08:25.048207+0000","last_fullsized":"2023-07-14T13:08:25.048207+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:19:01.297217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.892998+0000","last_change":"2023-07-14T13:08:23.889618+0000","last_active":"2023-07-14T13:08:24.892998+0000","last_peered":"2023-07-14T13:08:24.892998+0000","last_clean":"2023-07-14T13:08:24.892998+0000","last_became_active":"2023-07-14T13:08:23.889326+0000","last_became_peered":"2023-07-14T13:08:23.889326+0000","last_unstale":"2023-07-14T13:08:24.892998+0000","last_undegraded":"2023-07-14T13:08:24.892998+0000","last_fullsized":"2023-07-14T13:08:24.892998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:36:24.439481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.049012+0000","last_change":"2023-07-14T13:08:23.901161+0000","last_active":"2023-07-14T13:08:25.049012+0000","last_peered":"2023-07-14T13:08:25.049012+0000","last_clean":"2023-07-14T13:08:25.049012+0000","last_became_active":"2023-07-14T13:08:23.900864+0000","last_became_peered":"2023-07-14T13:08:23.900864+0000","last_unstale":"2023-07-14T13:08:25.049012+0000","last_undegraded":"2023-07-14T13:08:25.049012+0000","last_fullsized":"2023-07-14T13:08:25.049012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:09:31.289089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.892749+0000","last_change":"2023-07-14T13:08:23.905722+0000","last_active":"2023-07-14T13:08:24.892749+0000","last_peered":"2023-07-14T13:08:24.892749+0000","last_clean":"2023-07-14T13:08:24.892749+0000","last_became_active":"2023-07-14T13:08:23.905026+0000","last_became_peered":"2023-07-14T13:08:23.905026+0000","last_unstale":"2023-07-14T13:08:24.892749+0000","last_undegraded":"2023-07-14T13:08:24.892749+0000","last_fullsized":"2023-07-14T13:08:24.892749+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:16:03.622051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.892716+0000","last_change":"2023-07-14T13:08:23.904502+0000","last_active":"2023-07-14T13:08:24.892716+0000","last_peered":"2023-07-14T13:08:24.892716+0000","last_clean":"2023-07-14T13:08:24.892716+0000","last_became_active":"2023-07-14T13:08:23.904179+0000","last_became_peered":"2023-07-14T13:08:23.904179+0000","last_unstale":"2023-07-14T13:08:24.892716+0000","last_undegraded":"2023-07-14T13:08:24.892716+0000","last_fullsized":"2023-07-14T13:08:24.892716+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:10:09.838920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899178+0000","last_change":"2023-07-14T13:08:23.902351+0000","last_active":"2023-07-14T13:08:24.899178+0000","last_peered":"2023-07-14T13:08:24.899178+0000","last_clean":"2023-07-14T13:08:24.899178+0000","last_became_active":"2023-07-14T13:08:23.901577+0000","last_became_peered":"2023-07-14T13:08:23.901577+0000","last_unstale":"2023-07-14T13:08:24.899178+0000","last_undegraded":"2023-07-14T13:08:24.899178+0000","last_fullsized":"2023-07-14T13:08:24.899178+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:18:52.003692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.049215+0000","last_change":"2023-07-14T13:08:23.904414+0000","last_active":"2023-07-14T13:08:25.049215+0000","last_peered":"2023-07-14T13:08:25.049215+0000","last_clean":"2023-07-14T13:08:25.049215+0000","last_became_active":"2023-07-14T13:08:23.904098+0000","last_became_peered":"2023-07-14T13:08:23.904098+0000","last_unstale":"2023-07-14T13:08:25.049215+0000","last_undegraded":"2023-07-14T13:08:25.049215+0000","last_fullsized":"2023-07-14T13:08:25.049215+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:13:51.265659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.049307+0000","last_change":"2023-07-14T13:08:23.903378+0000","last_active":"2023-07-14T13:08:25.049307+0000","last_peered":"2023-07-14T13:08:25.049307+0000","last_clean":"2023-07-14T13:08:25.049307+0000","last_became_active":"2023-07-14T13:08:23.903108+0000","last_became_peered":"2023-07-14T13:08:23.903108+0000","last_unstale":"2023-07-14T13:08:25.049307+0000","last_undegraded":"2023-07-14T13:08:25.049307+0000","last_fullsized":"2023-07-14T13:08:25.049307+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:06.959284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.049103+0000","last_change":"2023-07-14T13:08:23.889379+0000","last_active":"2023-07-14T13:08:25.049103+0000","last_peered":"2023-07-14T13:08:25.049103+0000","last_clean":"2023-07-14T13:08:25.049103+0000","last_became_active":"2023-07-14T13:08:23.889096+0000","last_became_peered":"2023-07-14T13:08:23.889096+0000","last_unstale":"2023-07-14T13:08:25.049103+0000","last_undegraded":"2023-07-14T13:08:25.049103+0000","last_fullsized":"2023-07-14T13:08:25.049103+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:16:08.431188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045444+0000","last_change":"2023-07-14T13:08:23.892320+0000","last_active":"2023-07-14T13:08:25.045444+0000","last_peered":"2023-07-14T13:08:25.045444+0000","last_clean":"2023-07-14T13:08:25.045444+0000","last_became_active":"2023-07-14T13:08:23.891961+0000","last_became_peered":"2023-07-14T13:08:23.891961+0000","last_unstale":"2023-07-14T13:08:25.045444+0000","last_undegraded":"2023-07-14T13:08:25.045444+0000","last_fullsized":"2023-07-14T13:08:25.045444+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:00:07.741530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899513+0000","last_change":"2023-07-14T13:08:23.913742+0000","last_active":"2023-07-14T13:08:24.899513+0000","last_peered":"2023-07-14T13:08:24.899513+0000","last_clean":"2023-07-14T13:08:24.899513+0000","last_became_active":"2023-07-14T13:08:23.913435+0000","last_became_peered":"2023-07-14T13:08:23.913435+0000","last_unstale":"2023-07-14T13:08:24.899513+0000","last_undegraded":"2023-07-14T13:08:24.899513+0000","last_fullsized":"2023-07-14T13:08:24.899513+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:21:45.860510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.047862+0000","last_change":"2023-07-14T13:08:23.909993+0000","last_active":"2023-07-14T13:08:25.047862+0000","last_peered":"2023-07-14T13:08:25.047862+0000","last_clean":"2023-07-14T13:08:25.047862+0000","last_became_active":"2023-07-14T13:08:23.909712+0000","last_became_peered":"2023-07-14T13:08:23.909712+0000","last_unstale":"2023-07-14T13:08:25.047862+0000","last_undegraded":"2023-07-14T13:08:25.047862+0000","last_fullsized":"2023-07-14T13:08:25.047862+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:11:16.713859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048877+0000","last_change":"2023-07-14T13:08:23.888280+0000","last_active":"2023-07-14T13:08:25.048877+0000","last_peered":"2023-07-14T13:08:25.048877+0000","last_clean":"2023-07-14T13:08:25.048877+0000","last_became_active":"2023-07-14T13:08:23.887947+0000","last_became_peered":"2023-07-14T13:08:23.887947+0000","last_unstale":"2023-07-14T13:08:25.048877+0000","last_undegraded":"2023-07-14T13:08:25.048877+0000","last_fullsized":"2023-07-14T13:08:25.048877+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:36:39.201043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.044981+0000","last_change":"2023-07-14T13:08:23.885882+0000","last_active":"2023-07-14T13:08:25.044981+0000","last_peered":"2023-07-14T13:08:25.044981+0000","last_clean":"2023-07-14T13:08:25.044981+0000","last_became_active":"2023-07-14T13:08:23.884847+0000","last_became_peered":"2023-07-14T13:08:23.884847+0000","last_unstale":"2023-07-14T13:08:25.044981+0000","last_undegraded":"2023-07-14T13:08:25.044981+0000","last_fullsized":"2023-07-14T13:08:25.044981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:17:22.299597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048524+0000","last_change":"2023-07-14T13:08:23.899984+0000","last_active":"2023-07-14T13:08:25.048524+0000","last_peered":"2023-07-14T13:08:25.048524+0000","last_clean":"2023-07-14T13:08:25.048524+0000","last_became_active":"2023-07-14T13:08:23.899660+0000","last_became_peered":"2023-07-14T13:08:23.899660+0000","last_unstale":"2023-07-14T13:08:25.048524+0000","last_undegraded":"2023-07-14T13:08:25.048524+0000","last_fullsized":"2023-07-14T13:08:25.048524+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:40.390751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"82'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045688+0000","last_change":"2023-07-14T13:08:22.892834+0000","last_active":"2023-07-14T13:08:25.045688+0000","last_peered":"2023-07-14T13:08:25.045688+0000","last_clean":"2023-07-14T13:08:25.045688+0000","last_became_active":"2023-07-14T13:08:22.892557+0000","last_became_peered":"2023-07-14T13:08:22.892557+0000","last_unstale":"2023-07-14T13:08:25.045688+0000","last_undegraded":"2023-07-14T13:08:25.045688+0000","last_fullsized":"2023-07-14T13:08:25.045688+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:53:07.222035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.049155+0000","last_change":"2023-07-14T13:08:23.892836+0000","last_active":"2023-07-14T13:08:25.049155+0000","last_peered":"2023-07-14T13:08:25.049155+0000","last_clean":"2023-07-14T13:08:25.049155+0000","last_became_active":"2023-07-14T13:08:23.892506+0000","last_became_peered":"2023-07-14T13:08:23.892506+0000","last_unstale":"2023-07-14T13:08:25.049155+0000","last_undegraded":"2023-07-14T13:08:25.049155+0000","last_fullsized":"2023-07-14T13:08:25.049155+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:34:29.622181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"82'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045645+0000","last_change":"2023-07-14T13:08:22.888782+0000","last_active":"2023-07-14T13:08:25.045645+0000","last_peered":"2023-07-14T13:08:25.045645+0000","last_clean":"2023-07-14T13:08:25.045645+0000","last_became_active":"2023-07-14T13:08:22.888435+0000","last_became_peered":"2023-07-14T13:08:22.888435+0000","last_unstale":"2023-07-14T13:08:25.045645+0000","last_undegraded":"2023-07-14T13:08:25.045645+0000","last_fullsized":"2023-07-14T13:08:25.045645+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:41:36.689812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045448+0000","last_change":"2023-07-14T13:08:23.882568+0000","last_active":"2023-07-14T13:08:25.045448+0000","last_peered":"2023-07-14T13:08:25.045448+0000","last_clean":"2023-07-14T13:08:25.045448+0000","last_became_active":"2023-07-14T13:08:23.882264+0000","last_became_peered":"2023-07-14T13:08:23.882264+0000","last_unstale":"2023-07-14T13:08:25.045448+0000","last_undegraded":"2023-07-14T13:08:25.045448+0000","last_fullsized":"2023-07-14T13:08:25.045448+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:48:31.651290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"82'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045364+0000","last_change":"2023-07-14T13:08:22.886288+0000","last_active":"2023-07-14T13:08:25.045364+0000","last_peered":"2023-07-14T13:08:25.045364+0000","last_clean":"2023-07-14T13:08:25.045364+0000","last_became_active":"2023-07-14T13:08:22.885619+0000","last_became_peered":"2023-07-14T13:08:22.885619+0000","last_unstale":"2023-07-14T13:08:25.045364+0000","last_undegraded":"2023-07-14T13:08:25.045364+0000","last_fullsized":"2023-07-14T13:08:25.045364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:54:47.831816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899992+0000","last_change":"2023-07-14T13:08:23.899652+0000","last_active":"2023-07-14T13:08:24.899992+0000","last_peered":"2023-07-14T13:08:24.899992+0000","last_clean":"2023-07-14T13:08:24.899992+0000","last_became_active":"2023-07-14T13:08:23.899282+0000","last_became_peered":"2023-07-14T13:08:23.899282+0000","last_unstale":"2023-07-14T13:08:24.899992+0000","last_undegraded":"2023-07-14T13:08:24.899992+0000","last_fullsized":"2023-07-14T13:08:24.899992+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:24:23.644889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"82'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.044988+0000","last_change":"2023-07-14T13:08:22.888011+0000","last_active":"2023-07-14T13:08:25.044988+0000","last_peered":"2023-07-14T13:08:25.044988+0000","last_clean":"2023-07-14T13:08:25.044988+0000","last_became_active":"2023-07-14T13:08:22.887659+0000","last_became_peered":"2023-07-14T13:08:22.887659+0000","last_unstale":"2023-07-14T13:08:25.044988+0000","last_undegraded":"2023-07-14T13:08:25.044988+0000","last_fullsized":"2023-07-14T13:08:25.044988+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:48.399242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.044430+0000","last_change":"2023-07-14T13:08:23.887955+0000","last_active":"2023-07-14T13:08:25.044430+0000","last_peered":"2023-07-14T13:08:25.044430+0000","last_clean":"2023-07-14T13:08:25.044430+0000","last_became_active":"2023-07-14T13:08:23.887605+0000","last_became_peered":"2023-07-14T13:08:23.887605+0000","last_unstale":"2023-07-14T13:08:25.044430+0000","last_undegraded":"2023-07-14T13:08:25.044430+0000","last_fullsized":"2023-07-14T13:08:25.044430+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:30:13.365080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"82'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.893043+0000","last_change":"2023-07-14T13:08:22.884530+0000","last_active":"2023-07-14T13:08:24.893043+0000","last_peered":"2023-07-14T13:08:24.893043+0000","last_clean":"2023-07-14T13:08:24.893043+0000","last_became_active":"2023-07-14T13:08:22.884229+0000","last_became_peered":"2023-07-14T13:08:22.884229+0000","last_unstale":"2023-07-14T13:08:24.893043+0000","last_undegraded":"2023-07-14T13:08:24.893043+0000","last_fullsized":"2023-07-14T13:08:24.893043+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:00:06.733748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045126+0000","last_change":"2023-07-14T13:08:23.886261+0000","last_active":"2023-07-14T13:08:25.045126+0000","last_peered":"2023-07-14T13:08:25.045126+0000","last_clean":"2023-07-14T13:08:25.045126+0000","last_became_active":"2023-07-14T13:08:23.885957+0000","last_became_peered":"2023-07-14T13:08:23.885957+0000","last_unstale":"2023-07-14T13:08:25.045126+0000","last_undegraded":"2023-07-14T13:08:25.045126+0000","last_fullsized":"2023-07-14T13:08:25.045126+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:36:24.439481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"82'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.892778+0000","last_change":"2023-07-14T13:08:22.883779+0000","last_active":"2023-07-14T13:08:24.892778+0000","last_peered":"2023-07-14T13:08:24.892778+0000","last_clean":"2023-07-14T13:08:24.892778+0000","last_became_active":"2023-07-14T13:08:22.883464+0000","last_became_peered":"2023-07-14T13:08:22.883464+0000","last_unstale":"2023-07-14T13:08:24.892778+0000","last_undegraded":"2023-07-14T13:08:24.892778+0000","last_fullsized":"2023-07-14T13:08:24.892778+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:31:56.881715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.047890+0000","last_change":"2023-07-14T13:08:23.901749+0000","last_active":"2023-07-14T13:08:25.047890+0000","last_peered":"2023-07-14T13:08:25.047890+0000","last_clean":"2023-07-14T13:08:25.047890+0000","last_became_active":"2023-07-14T13:08:23.901277+0000","last_became_peered":"2023-07-14T13:08:23.901277+0000","last_unstale":"2023-07-14T13:08:25.047890+0000","last_undegraded":"2023-07-14T13:08:25.047890+0000","last_fullsized":"2023-07-14T13:08:25.047890+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:17:22.396268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.892853+0000","last_change":"2023-07-14T13:08:22.887027+0000","last_active":"2023-07-14T13:08:24.892853+0000","last_peered":"2023-07-14T13:08:24.892853+0000","last_clean":"2023-07-14T13:08:24.892853+0000","last_became_active":"2023-07-14T13:08:22.886683+0000","last_became_peered":"2023-07-14T13:08:22.886683+0000","last_unstale":"2023-07-14T13:08:24.892853+0000","last_undegraded":"2023-07-14T13:08:24.892853+0000","last_fullsized":"2023-07-14T13:08:24.892853+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:53:16.820627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.893021+0000","last_change":"2023-07-14T13:08:23.891123+0000","last_active":"2023-07-14T13:08:24.893021+0000","last_peered":"2023-07-14T13:08:24.893021+0000","last_clean":"2023-07-14T13:08:24.893021+0000","last_became_active":"2023-07-14T13:08:23.890830+0000","last_became_peered":"2023-07-14T13:08:23.890830+0000","last_unstale":"2023-07-14T13:08:24.893021+0000","last_undegraded":"2023-07-14T13:08:24.893021+0000","last_fullsized":"2023-07-14T13:08:24.893021+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:51:03.865057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048437+0000","last_change":"2023-07-14T13:08:22.896649+0000","last_active":"2023-07-14T13:08:25.048437+0000","last_peered":"2023-07-14T13:08:25.048437+0000","last_clean":"2023-07-14T13:08:25.048437+0000","last_became_active":"2023-07-14T13:08:22.896318+0000","last_became_peered":"2023-07-14T13:08:22.896318+0000","last_unstale":"2023-07-14T13:08:25.048437+0000","last_undegraded":"2023-07-14T13:08:25.048437+0000","last_fullsized":"2023-07-14T13:08:25.048437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:16:24.938164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045483+0000","last_change":"2023-07-14T13:08:23.886470+0000","last_active":"2023-07-14T13:08:25.045483+0000","last_peered":"2023-07-14T13:08:25.045483+0000","last_clean":"2023-07-14T13:08:25.045483+0000","last_became_active":"2023-07-14T13:08:23.886175+0000","last_became_peered":"2023-07-14T13:08:23.886175+0000","last_unstale":"2023-07-14T13:08:25.045483+0000","last_undegraded":"2023-07-14T13:08:25.045483+0000","last_fullsized":"2023-07-14T13:08:25.045483+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:22:50.422019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.900151+0000","last_change":"2023-07-14T13:08:22.899027+0000","last_active":"2023-07-14T13:08:24.900151+0000","last_peered":"2023-07-14T13:08:24.900151+0000","last_clean":"2023-07-14T13:08:24.900151+0000","last_became_active":"2023-07-14T13:08:22.898673+0000","last_became_peered":"2023-07-14T13:08:22.898673+0000","last_unstale":"2023-07-14T13:08:24.900151+0000","last_undegraded":"2023-07-14T13:08:24.900151+0000","last_fullsized":"2023-07-14T13:08:24.900151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:22:07.726479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.893101+0000","last_change":"2023-07-14T13:08:23.897021+0000","last_active":"2023-07-14T13:08:24.893101+0000","last_peered":"2023-07-14T13:08:24.893101+0000","last_clean":"2023-07-14T13:08:24.893101+0000","last_became_active":"2023-07-14T13:08:23.896770+0000","last_became_peered":"2023-07-14T13:08:23.896770+0000","last_unstale":"2023-07-14T13:08:24.893101+0000","last_undegraded":"2023-07-14T13:08:24.893101+0000","last_fullsized":"2023-07-14T13:08:24.893101+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:22:50.422019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048954+0000","last_change":"2023-07-14T13:08:22.889053+0000","last_active":"2023-07-14T13:08:25.048954+0000","last_peered":"2023-07-14T13:08:25.048954+0000","last_clean":"2023-07-14T13:08:25.048954+0000","last_became_active":"2023-07-14T13:08:22.888145+0000","last_became_peered":"2023-07-14T13:08:22.888145+0000","last_unstale":"2023-07-14T13:08:25.048954+0000","last_undegraded":"2023-07-14T13:08:25.048954+0000","last_fullsized":"2023-07-14T13:08:25.048954+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:18:34.248849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048369+0000","last_change":"2023-07-14T13:08:23.903246+0000","last_active":"2023-07-14T13:08:25.048369+0000","last_peered":"2023-07-14T13:08:25.048369+0000","last_clean":"2023-07-14T13:08:25.048369+0000","last_became_active":"2023-07-14T13:08:23.902904+0000","last_became_peered":"2023-07-14T13:08:23.902904+0000","last_unstale":"2023-07-14T13:08:25.048369+0000","last_undegraded":"2023-07-14T13:08:25.048369+0000","last_fullsized":"2023-07-14T13:08:25.048369+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:40:23.817315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"82'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899984+0000","last_change":"2023-07-14T13:08:22.898636+0000","last_active":"2023-07-14T13:08:24.899984+0000","last_peered":"2023-07-14T13:08:24.899984+0000","last_clean":"2023-07-14T13:08:24.899984+0000","last_became_active":"2023-07-14T13:08:22.898199+0000","last_became_peered":"2023-07-14T13:08:22.898199+0000","last_unstale":"2023-07-14T13:08:24.899984+0000","last_undegraded":"2023-07-14T13:08:24.899984+0000","last_fullsized":"2023-07-14T13:08:24.899984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:52:05.378205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.049299+0000","last_change":"2023-07-14T13:08:23.886400+0000","last_active":"2023-07-14T13:08:25.049299+0000","last_peered":"2023-07-14T13:08:25.049299+0000","last_clean":"2023-07-14T13:08:25.049299+0000","last_became_active":"2023-07-14T13:08:23.886115+0000","last_became_peered":"2023-07-14T13:08:23.886115+0000","last_unstale":"2023-07-14T13:08:25.049299+0000","last_undegraded":"2023-07-14T13:08:25.049299+0000","last_fullsized":"2023-07-14T13:08:25.049299+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:51:00.187533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"82'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045575+0000","last_change":"2023-07-14T13:08:22.886746+0000","last_active":"2023-07-14T13:08:25.045575+0000","last_peered":"2023-07-14T13:08:25.045575+0000","last_clean":"2023-07-14T13:08:25.045575+0000","last_became_active":"2023-07-14T13:08:22.886234+0000","last_became_peered":"2023-07-14T13:08:22.886234+0000","last_unstale":"2023-07-14T13:08:25.045575+0000","last_undegraded":"2023-07-14T13:08:25.045575+0000","last_fullsized":"2023-07-14T13:08:25.045575+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:06:31.353019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.047749+0000","last_change":"2023-07-14T13:08:23.905115+0000","last_active":"2023-07-14T13:08:25.047749+0000","last_peered":"2023-07-14T13:08:25.047749+0000","last_clean":"2023-07-14T13:08:25.047749+0000","last_became_active":"2023-07-14T13:08:23.904852+0000","last_became_peered":"2023-07-14T13:08:23.904852+0000","last_unstale":"2023-07-14T13:08:25.047749+0000","last_undegraded":"2023-07-14T13:08:25.047749+0000","last_fullsized":"2023-07-14T13:08:25.047749+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:30:13.784311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"82'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899605+0000","last_change":"2023-07-14T13:08:22.896327+0000","last_active":"2023-07-14T13:08:24.899605+0000","last_peered":"2023-07-14T13:08:24.899605+0000","last_clean":"2023-07-14T13:08:24.899605+0000","last_became_active":"2023-07-14T13:08:22.895999+0000","last_became_peered":"2023-07-14T13:08:22.895999+0000","last_unstale":"2023-07-14T13:08:24.899605+0000","last_undegraded":"2023-07-14T13:08:24.899605+0000","last_fullsized":"2023-07-14T13:08:24.899605+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:07:27.701213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.047777+0000","last_change":"2023-07-14T13:08:23.899288+0000","last_active":"2023-07-14T13:08:25.047777+0000","last_peered":"2023-07-14T13:08:25.047777+0000","last_clean":"2023-07-14T13:08:25.047777+0000","last_became_active":"2023-07-14T13:08:23.898831+0000","last_became_peered":"2023-07-14T13:08:23.898831+0000","last_unstale":"2023-07-14T13:08:25.047777+0000","last_undegraded":"2023-07-14T13:08:25.047777+0000","last_fullsized":"2023-07-14T13:08:25.047777+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:42:50.931445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048010+0000","last_change":"2023-07-14T13:08:22.894256+0000","last_active":"2023-07-14T13:08:25.048010+0000","last_peered":"2023-07-14T13:08:25.048010+0000","last_clean":"2023-07-14T13:08:25.048010+0000","last_became_active":"2023-07-14T13:08:22.893973+0000","last_became_peered":"2023-07-14T13:08:22.893973+0000","last_unstale":"2023-07-14T13:08:25.048010+0000","last_undegraded":"2023-07-14T13:08:25.048010+0000","last_fullsized":"2023-07-14T13:08:25.048010+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:45:04.006207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048052+0000","last_change":"2023-07-14T13:08:23.891783+0000","last_active":"2023-07-14T13:08:25.048052+0000","last_peered":"2023-07-14T13:08:25.048052+0000","last_clean":"2023-07-14T13:08:25.048052+0000","last_became_active":"2023-07-14T13:08:23.891424+0000","last_became_peered":"2023-07-14T13:08:23.891424+0000","last_unstale":"2023-07-14T13:08:25.048052+0000","last_undegraded":"2023-07-14T13:08:25.048052+0000","last_fullsized":"2023-07-14T13:08:25.048052+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:12.809317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899554+0000","last_change":"2023-07-14T13:08:22.897595+0000","last_active":"2023-07-14T13:08:24.899554+0000","last_peered":"2023-07-14T13:08:24.899554+0000","last_clean":"2023-07-14T13:08:24.899554+0000","last_became_active":"2023-07-14T13:08:22.896980+0000","last_became_peered":"2023-07-14T13:08:22.896980+0000","last_unstale":"2023-07-14T13:08:24.899554+0000","last_undegraded":"2023-07-14T13:08:24.899554+0000","last_fullsized":"2023-07-14T13:08:24.899554+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:09:26.287380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045125+0000","last_change":"2023-07-14T13:08:23.904809+0000","last_active":"2023-07-14T13:08:25.045125+0000","last_peered":"2023-07-14T13:08:25.045125+0000","last_clean":"2023-07-14T13:08:25.045125+0000","last_became_active":"2023-07-14T13:08:23.904515+0000","last_became_peered":"2023-07-14T13:08:23.904515+0000","last_unstale":"2023-07-14T13:08:25.045125+0000","last_undegraded":"2023-07-14T13:08:25.045125+0000","last_fullsized":"2023-07-14T13:08:25.045125+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:05:31.229761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"82'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048657+0000","last_change":"2023-07-14T13:08:22.896567+0000","last_active":"2023-07-14T13:08:25.048657+0000","last_peered":"2023-07-14T13:08:25.048657+0000","last_clean":"2023-07-14T13:08:25.048657+0000","last_became_active":"2023-07-14T13:08:22.896244+0000","last_became_peered":"2023-07-14T13:08:22.896244+0000","last_unstale":"2023-07-14T13:08:25.048657+0000","last_undegraded":"2023-07-14T13:08:25.048657+0000","last_fullsized":"2023-07-14T13:08:25.048657+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:21:31.619049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.044860+0000","last_change":"2023-07-14T13:08:23.890655+0000","last_active":"2023-07-14T13:08:25.044860+0000","last_peered":"2023-07-14T13:08:25.044860+0000","last_clean":"2023-07-14T13:08:25.044860+0000","last_became_active":"2023-07-14T13:08:23.890330+0000","last_became_peered":"2023-07-14T13:08:23.890330+0000","last_unstale":"2023-07-14T13:08:25.044860+0000","last_undegraded":"2023-07-14T13:08:25.044860+0000","last_fullsized":"2023-07-14T13:08:25.044860+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:30:10.907617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"82'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.049447+0000","last_change":"2023-07-14T13:08:22.896731+0000","last_active":"2023-07-14T13:08:25.049447+0000","last_peered":"2023-07-14T13:08:25.049447+0000","last_clean":"2023-07-14T13:08:25.049447+0000","last_became_active":"2023-07-14T13:08:22.896451+0000","last_became_peered":"2023-07-14T13:08:22.896451+0000","last_unstale":"2023-07-14T13:08:25.049447+0000","last_undegraded":"2023-07-14T13:08:25.049447+0000","last_fullsized":"2023-07-14T13:08:25.049447+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:02:39.769844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.046136+0000","last_change":"2023-07-14T13:08:23.881942+0000","last_active":"2023-07-14T13:08:25.046136+0000","last_peered":"2023-07-14T13:08:25.046136+0000","last_clean":"2023-07-14T13:08:25.046136+0000","last_became_active":"2023-07-14T13:08:23.881653+0000","last_became_peered":"2023-07-14T13:08:23.881653+0000","last_unstale":"2023-07-14T13:08:25.046136+0000","last_undegraded":"2023-07-14T13:08:25.046136+0000","last_fullsized":"2023-07-14T13:08:25.046136+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:29:07.420224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.049569+0000","last_change":"2023-07-14T13:08:22.888742+0000","last_active":"2023-07-14T13:08:25.049569+0000","last_peered":"2023-07-14T13:08:25.049569+0000","last_clean":"2023-07-14T13:08:25.049569+0000","last_became_active":"2023-07-14T13:08:22.888451+0000","last_became_peered":"2023-07-14T13:08:22.888451+0000","last_unstale":"2023-07-14T13:08:25.049569+0000","last_undegraded":"2023-07-14T13:08:25.049569+0000","last_fullsized":"2023-07-14T13:08:25.049569+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:38:24.197513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.049466+0000","last_change":"2023-07-14T13:08:23.902014+0000","last_active":"2023-07-14T13:08:25.049466+0000","last_peered":"2023-07-14T13:08:25.049466+0000","last_clean":"2023-07-14T13:08:25.049466+0000","last_became_active":"2023-07-14T13:08:23.901695+0000","last_became_peered":"2023-07-14T13:08:23.901695+0000","last_unstale":"2023-07-14T13:08:25.049466+0000","last_undegraded":"2023-07-14T13:08:25.049466+0000","last_fullsized":"2023-07-14T13:08:25.049466+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:15:28.002257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045229+0000","last_change":"2023-07-14T13:08:22.886480+0000","last_active":"2023-07-14T13:08:25.045229+0000","last_peered":"2023-07-14T13:08:25.045229+0000","last_clean":"2023-07-14T13:08:25.045229+0000","last_became_active":"2023-07-14T13:08:22.885968+0000","last_became_peered":"2023-07-14T13:08:22.885968+0000","last_unstale":"2023-07-14T13:08:25.045229+0000","last_undegraded":"2023-07-14T13:08:25.045229+0000","last_fullsized":"2023-07-14T13:08:25.045229+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:02:58.361007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048625+0000","last_change":"2023-07-14T13:08:23.897767+0000","last_active":"2023-07-14T13:08:25.048625+0000","last_peered":"2023-07-14T13:08:25.048625+0000","last_clean":"2023-07-14T13:08:25.048625+0000","last_became_active":"2023-07-14T13:08:23.897279+0000","last_became_peered":"2023-07-14T13:08:23.897279+0000","last_unstale":"2023-07-14T13:08:25.048625+0000","last_undegraded":"2023-07-14T13:08:25.048625+0000","last_fullsized":"2023-07-14T13:08:25.048625+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:38:30.528323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045608+0000","last_change":"2023-07-14T13:08:22.886524+0000","last_active":"2023-07-14T13:08:25.045608+0000","last_peered":"2023-07-14T13:08:25.045608+0000","last_clean":"2023-07-14T13:08:25.045608+0000","last_became_active":"2023-07-14T13:08:22.882894+0000","last_became_peered":"2023-07-14T13:08:22.882894+0000","last_unstale":"2023-07-14T13:08:25.045608+0000","last_undegraded":"2023-07-14T13:08:25.045608+0000","last_fullsized":"2023-07-14T13:08:25.045608+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:56:04.254791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048005+0000","last_change":"2023-07-14T13:08:23.899032+0000","last_active":"2023-07-14T13:08:25.048005+0000","last_peered":"2023-07-14T13:08:25.048005+0000","last_clean":"2023-07-14T13:08:25.048005+0000","last_became_active":"2023-07-14T13:08:23.898709+0000","last_became_peered":"2023-07-14T13:08:23.898709+0000","last_unstale":"2023-07-14T13:08:25.048005+0000","last_undegraded":"2023-07-14T13:08:25.048005+0000","last_fullsized":"2023-07-14T13:08:25.048005+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:28:13.669609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899681+0000","last_change":"2023-07-14T13:08:22.897266+0000","last_active":"2023-07-14T13:08:24.899681+0000","last_peered":"2023-07-14T13:08:24.899681+0000","last_clean":"2023-07-14T13:08:24.899681+0000","last_became_active":"2023-07-14T13:08:22.896932+0000","last_became_peered":"2023-07-14T13:08:22.896932+0000","last_unstale":"2023-07-14T13:08:24.899681+0000","last_undegraded":"2023-07-14T13:08:24.899681+0000","last_fullsized":"2023-07-14T13:08:24.899681+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:24:28.167304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.049402+0000","last_change":"2023-07-14T13:08:23.908501+0000","last_active":"2023-07-14T13:08:25.049402+0000","last_peered":"2023-07-14T13:08:25.049402+0000","last_clean":"2023-07-14T13:08:25.049402+0000","last_became_active":"2023-07-14T13:08:23.908199+0000","last_became_peered":"2023-07-14T13:08:23.908199+0000","last_unstale":"2023-07-14T13:08:25.049402+0000","last_undegraded":"2023-07-14T13:08:25.049402+0000","last_fullsized":"2023-07-14T13:08:25.049402+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:57:49.058359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.892934+0000","last_change":"2023-07-14T13:08:22.884847+0000","last_active":"2023-07-14T13:08:24.892934+0000","last_peered":"2023-07-14T13:08:24.892934+0000","last_clean":"2023-07-14T13:08:24.892934+0000","last_became_active":"2023-07-14T13:08:22.884442+0000","last_became_peered":"2023-07-14T13:08:22.884442+0000","last_unstale":"2023-07-14T13:08:24.892934+0000","last_undegraded":"2023-07-14T13:08:24.892934+0000","last_fullsized":"2023-07-14T13:08:24.892934+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:05:30.221979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045881+0000","last_change":"2023-07-14T13:08:23.894532+0000","last_active":"2023-07-14T13:08:25.045881+0000","last_peered":"2023-07-14T13:08:25.045881+0000","last_clean":"2023-07-14T13:08:25.045881+0000","last_became_active":"2023-07-14T13:08:23.894279+0000","last_became_peered":"2023-07-14T13:08:23.894279+0000","last_unstale":"2023-07-14T13:08:25.045881+0000","last_undegraded":"2023-07-14T13:08:25.045881+0000","last_fullsized":"2023-07-14T13:08:25.045881+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:20.229415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.892776+0000","last_change":"2023-07-14T13:08:22.890676+0000","last_active":"2023-07-14T13:08:24.892776+0000","last_peered":"2023-07-14T13:08:24.892776+0000","last_clean":"2023-07-14T13:08:24.892776+0000","last_became_active":"2023-07-14T13:08:22.890323+0000","last_became_peered":"2023-07-14T13:08:22.890323+0000","last_unstale":"2023-07-14T13:08:24.892776+0000","last_undegraded":"2023-07-14T13:08:24.892776+0000","last_fullsized":"2023-07-14T13:08:24.892776+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:56:30.779442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.044597+0000","last_change":"2023-07-14T13:08:23.900832+0000","last_active":"2023-07-14T13:08:25.044597+0000","last_peered":"2023-07-14T13:08:25.044597+0000","last_clean":"2023-07-14T13:08:25.044597+0000","last_became_active":"2023-07-14T13:08:23.900547+0000","last_became_peered":"2023-07-14T13:08:23.900547+0000","last_unstale":"2023-07-14T13:08:25.044597+0000","last_undegraded":"2023-07-14T13:08:25.044597+0000","last_fullsized":"2023-07-14T13:08:25.044597+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:18:21.892026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045815+0000","last_change":"2023-07-14T13:08:22.888081+0000","last_active":"2023-07-14T13:08:25.045815+0000","last_peered":"2023-07-14T13:08:25.045815+0000","last_clean":"2023-07-14T13:08:25.045815+0000","last_became_active":"2023-07-14T13:08:22.887733+0000","last_became_peered":"2023-07-14T13:08:22.887733+0000","last_unstale":"2023-07-14T13:08:25.045815+0000","last_undegraded":"2023-07-14T13:08:25.045815+0000","last_fullsized":"2023-07-14T13:08:25.045815+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:44:24.297343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048196+0000","last_change":"2023-07-14T13:08:23.899770+0000","last_active":"2023-07-14T13:08:25.048196+0000","last_peered":"2023-07-14T13:08:25.048196+0000","last_clean":"2023-07-14T13:08:25.048196+0000","last_became_active":"2023-07-14T13:08:23.899069+0000","last_became_peered":"2023-07-14T13:08:23.899069+0000","last_unstale":"2023-07-14T13:08:25.048196+0000","last_undegraded":"2023-07-14T13:08:25.048196+0000","last_fullsized":"2023-07-14T13:08:25.048196+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:11.871609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.892678+0000","last_change":"2023-07-14T13:08:22.885339+0000","last_active":"2023-07-14T13:08:24.892678+0000","last_peered":"2023-07-14T13:08:24.892678+0000","last_clean":"2023-07-14T13:08:24.892678+0000","last_became_active":"2023-07-14T13:08:22.885052+0000","last_became_peered":"2023-07-14T13:08:22.885052+0000","last_unstale":"2023-07-14T13:08:24.892678+0000","last_undegraded":"2023-07-14T13:08:24.892678+0000","last_fullsized":"2023-07-14T13:08:24.892678+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:52:42.265517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"70'161","reported_seq":444,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899478+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:08:24.899478+0000","last_peered":"2023-07-14T13:08:24.899478+0000","last_clean":"2023-07-14T13:08:24.899478+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:08:24.899478+0000","last_undegraded":"2023-07-14T13:08:24.899478+0000","last_fullsized":"2023-07-14T13:08:24.899478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:10:38.210479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.049128+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:08:25.049128+0000","last_peered":"2023-07-14T13:08:25.049128+0000","last_clean":"2023-07-14T13:08:25.049128+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:08:25.049128+0000","last_undegraded":"2023-07-14T13:08:25.049128+0000","last_fullsized":"2023-07-14T13:08:25.049128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:13:04.854090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045110+0000","last_change":"2023-07-14T13:08:23.885699+0000","last_active":"2023-07-14T13:08:25.045110+0000","last_peered":"2023-07-14T13:08:25.045110+0000","last_clean":"2023-07-14T13:08:25.045110+0000","last_became_active":"2023-07-14T13:08:23.884469+0000","last_became_peered":"2023-07-14T13:08:23.884469+0000","last_unstale":"2023-07-14T13:08:25.045110+0000","last_undegraded":"2023-07-14T13:08:25.045110+0000","last_fullsized":"2023-07-14T13:08:25.045110+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:06:08.893708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"82'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.044811+0000","last_change":"2023-07-14T13:08:22.888358+0000","last_active":"2023-07-14T13:08:25.044811+0000","last_peered":"2023-07-14T13:08:25.044811+0000","last_clean":"2023-07-14T13:08:25.044811+0000","last_became_active":"2023-07-14T13:08:22.888086+0000","last_became_peered":"2023-07-14T13:08:22.888086+0000","last_unstale":"2023-07-14T13:08:25.044811+0000","last_undegraded":"2023-07-14T13:08:25.044811+0000","last_fullsized":"2023-07-14T13:08:25.044811+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:12:10.363163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899369+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:08:24.899369+0000","last_peered":"2023-07-14T13:08:24.899369+0000","last_clean":"2023-07-14T13:08:24.899369+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:08:24.899369+0000","last_undegraded":"2023-07-14T13:08:24.899369+0000","last_fullsized":"2023-07-14T13:08:24.899369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:47:26.615295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.047938+0000","last_change":"2023-07-14T13:08:23.899098+0000","last_active":"2023-07-14T13:08:25.047938+0000","last_peered":"2023-07-14T13:08:25.047938+0000","last_clean":"2023-07-14T13:08:25.047938+0000","last_became_active":"2023-07-14T13:08:23.898388+0000","last_became_peered":"2023-07-14T13:08:23.898388+0000","last_unstale":"2023-07-14T13:08:25.047938+0000","last_undegraded":"2023-07-14T13:08:25.047938+0000","last_fullsized":"2023-07-14T13:08:25.047938+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:36:23.840669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048091+0000","last_change":"2023-07-14T13:08:22.894336+0000","last_active":"2023-07-14T13:08:25.048091+0000","last_peered":"2023-07-14T13:08:25.048091+0000","last_clean":"2023-07-14T13:08:25.048091+0000","last_became_active":"2023-07-14T13:08:22.894049+0000","last_became_peered":"2023-07-14T13:08:22.894049+0000","last_unstale":"2023-07-14T13:08:25.048091+0000","last_undegraded":"2023-07-14T13:08:25.048091+0000","last_fullsized":"2023-07-14T13:08:25.048091+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:56:03.283910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":128,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045574+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:08:25.045574+0000","last_peered":"2023-07-14T13:08:25.045574+0000","last_clean":"2023-07-14T13:08:25.045574+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:08:25.045574+0000","last_undegraded":"2023-07-14T13:08:25.045574+0000","last_fullsized":"2023-07-14T13:08:25.045574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:25:57.129457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048219+0000","last_change":"2023-07-14T13:08:23.901570+0000","last_active":"2023-07-14T13:08:25.048219+0000","last_peered":"2023-07-14T13:08:25.048219+0000","last_clean":"2023-07-14T13:08:25.048219+0000","last_became_active":"2023-07-14T13:08:23.900837+0000","last_became_peered":"2023-07-14T13:08:23.900837+0000","last_unstale":"2023-07-14T13:08:25.048219+0000","last_undegraded":"2023-07-14T13:08:25.048219+0000","last_fullsized":"2023-07-14T13:08:25.048219+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:18:56.013748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.044889+0000","last_change":"2023-07-14T13:08:22.888384+0000","last_active":"2023-07-14T13:08:25.044889+0000","last_peered":"2023-07-14T13:08:25.044889+0000","last_clean":"2023-07-14T13:08:25.044889+0000","last_became_active":"2023-07-14T13:08:22.888062+0000","last_became_peered":"2023-07-14T13:08:22.888062+0000","last_unstale":"2023-07-14T13:08:25.044889+0000","last_undegraded":"2023-07-14T13:08:25.044889+0000","last_fullsized":"2023-07-14T13:08:25.044889+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:45:36.055616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048141+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:08:25.048141+0000","last_peered":"2023-07-14T13:08:25.048141+0000","last_clean":"2023-07-14T13:08:25.048141+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:08:25.048141+0000","last_undegraded":"2023-07-14T13:08:25.048141+0000","last_fullsized":"2023-07-14T13:08:25.048141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:11:22.279127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899927+0000","last_change":"2023-07-14T13:08:23.914210+0000","last_active":"2023-07-14T13:08:24.899927+0000","last_peered":"2023-07-14T13:08:24.899927+0000","last_clean":"2023-07-14T13:08:24.899927+0000","last_became_active":"2023-07-14T13:08:23.911500+0000","last_became_peered":"2023-07-14T13:08:23.911500+0000","last_unstale":"2023-07-14T13:08:24.899927+0000","last_undegraded":"2023-07-14T13:08:24.899927+0000","last_fullsized":"2023-07-14T13:08:24.899927+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:50:21.243267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"82'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.049309+0000","last_change":"2023-07-14T13:08:22.895241+0000","last_active":"2023-07-14T13:08:25.049309+0000","last_peered":"2023-07-14T13:08:25.049309+0000","last_clean":"2023-07-14T13:08:25.049309+0000","last_became_active":"2023-07-14T13:08:22.894924+0000","last_became_peered":"2023-07-14T13:08:22.894924+0000","last_unstale":"2023-07-14T13:08:25.049309+0000","last_undegraded":"2023-07-14T13:08:25.049309+0000","last_fullsized":"2023-07-14T13:08:25.049309+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:15:34.219642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":138,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.045688+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:08:25.045688+0000","last_peered":"2023-07-14T13:08:25.045688+0000","last_clean":"2023-07-14T13:08:25.045688+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:08:25.045688+0000","last_undegraded":"2023-07-14T13:08:25.045688+0000","last_fullsized":"2023-07-14T13:08:25.045688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:51:11.137382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048624+0000","last_change":"2023-07-14T13:08:23.904605+0000","last_active":"2023-07-14T13:08:25.048624+0000","last_peered":"2023-07-14T13:08:25.048624+0000","last_clean":"2023-07-14T13:08:25.048624+0000","last_became_active":"2023-07-14T13:08:23.904340+0000","last_became_peered":"2023-07-14T13:08:23.904340+0000","last_unstale":"2023-07-14T13:08:25.048624+0000","last_undegraded":"2023-07-14T13:08:25.048624+0000","last_fullsized":"2023-07-14T13:08:25.048624+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:36:53.504459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"82'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.899899+0000","last_change":"2023-07-14T13:08:22.898695+0000","last_active":"2023-07-14T13:08:24.899899+0000","last_peered":"2023-07-14T13:08:24.899899+0000","last_clean":"2023-07-14T13:08:24.899899+0000","last_became_active":"2023-07-14T13:08:22.898408+0000","last_became_peered":"2023-07-14T13:08:22.898408+0000","last_unstale":"2023-07-14T13:08:24.899899+0000","last_undegraded":"2023-07-14T13:08:24.899899+0000","last_fullsized":"2023-07-14T13:08:24.899899+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:44:53.007841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.900149+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:08:24.900149+0000","last_peered":"2023-07-14T13:08:24.900149+0000","last_clean":"2023-07-14T13:08:24.900149+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:08:24.900149+0000","last_undegraded":"2023-07-14T13:08:24.900149+0000","last_fullsized":"2023-07-14T13:08:24.900149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:31:45.606288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048795+0000","last_change":"2023-07-14T13:08:23.895185+0000","last_active":"2023-07-14T13:08:25.048795+0000","last_peered":"2023-07-14T13:08:25.048795+0000","last_clean":"2023-07-14T13:08:25.048795+0000","last_became_active":"2023-07-14T13:08:23.894901+0000","last_became_peered":"2023-07-14T13:08:23.894901+0000","last_unstale":"2023-07-14T13:08:25.048795+0000","last_undegraded":"2023-07-14T13:08:25.048795+0000","last_fullsized":"2023-07-14T13:08:25.048795+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:36:45.999263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"82'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.900082+0000","last_change":"2023-07-14T13:08:22.899305+0000","last_active":"2023-07-14T13:08:24.900082+0000","last_peered":"2023-07-14T13:08:24.900082+0000","last_clean":"2023-07-14T13:08:24.900082+0000","last_became_active":"2023-07-14T13:08:22.898996+0000","last_became_peered":"2023-07-14T13:08:22.898996+0000","last_unstale":"2023-07-14T13:08:24.900082+0000","last_undegraded":"2023-07-14T13:08:24.900082+0000","last_fullsized":"2023-07-14T13:08:24.900082+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:57:25.380682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":138,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.046099+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:08:25.046099+0000","last_peered":"2023-07-14T13:08:25.046099+0000","last_clean":"2023-07-14T13:08:25.046099+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:08:25.046099+0000","last_undegraded":"2023-07-14T13:08:25.046099+0000","last_fullsized":"2023-07-14T13:08:25.046099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:39:53.280298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048701+0000","last_change":"2023-07-14T13:08:23.897543+0000","last_active":"2023-07-14T13:08:25.048701+0000","last_peered":"2023-07-14T13:08:25.048701+0000","last_clean":"2023-07-14T13:08:25.048701+0000","last_became_active":"2023-07-14T13:08:23.896925+0000","last_became_peered":"2023-07-14T13:08:23.896925+0000","last_unstale":"2023-07-14T13:08:25.048701+0000","last_undegraded":"2023-07-14T13:08:25.048701+0000","last_fullsized":"2023-07-14T13:08:25.048701+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:22.857040+0000","last_clean_scrub_stamp":"2023-07-14T13:08:22.857040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:23.802760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:24.893126+0000","last_change":"2023-07-14T13:08:22.885480+0000","last_active":"2023-07-14T13:08:24.893126+0000","last_peered":"2023-07-14T13:08:24.893126+0000","last_clean":"2023-07-14T13:08:24.893126+0000","last_became_active":"2023-07-14T13:08:22.885180+0000","last_became_peered":"2023-07-14T13:08:22.885180+0000","last_unstale":"2023-07-14T13:08:24.893126+0000","last_undegraded":"2023-07-14T13:08:24.893126+0000","last_fullsized":"2023-07-14T13:08:24.893126+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:08:21.849258+0000","last_clean_scrub_stamp":"2023-07-14T13:08:21.849258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:31:11.651505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":130,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-14T13:08:25.048753+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:08:25.048753+0000","last_peered":"2023-07-14T13:08:25.048753+0000","last_clean":"2023-07-14T13:08:25.048753+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:08:25.048753+0000","last_undegraded":"2023-07-14T13:08:25.048753+0000","last_fullsized":"2023-07-14T13:08:25.048753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:18:09.383157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575039,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54768,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317072,"statfs":{"total":96636764160,"available":96580681728,"internally_reserved":0,"allocated":1613824,"data_stored":1093226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.51500000000000001,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.98299999999999998,"5min":0.98399999999999999,"15min":1.879},"last":1.262},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.56799999999999995,"5min":0.44,"15min":0.439},"max":{"1min":1.054,"5min":1.054,"15min":1.9059999999999999},"last":1.0720000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73899999999999999,"15min":0.73599999999999999},"min":{"1min":0.504,"5min":0.434,"15min":0.42999999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.069},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.749,"15min":0.746},"min":{"1min":0.54400000000000004,"5min":0.48999999999999999,"15min":0.40500000000000003},"max":{"1min":0.93999999999999995,"5min":0.97399999999999998,"15min":1.1020000000000001},"last":1.1819999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73899999999999999,"15min":0.72799999999999998},"min":{"1min":0.52700000000000002,"5min":0.46999999999999997,"15min":0.40600000000000003},"max":{"1min":0.88100000000000001,"5min":0.98899999999999999,"15min":1.048},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.747,"15min":0.752},"min":{"1min":0.47499999999999998,"5min":0.47199999999999998,"15min":0.46899999999999997},"max":{"1min":0.91300000000000003,"5min":0.97099999999999997,"15min":1.0169999999999999},"last":1.1519999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.746,"15min":0.73399999999999999},"min":{"1min":0.59399999999999997,"5min":0.503,"15min":0.442},"max":{"1min":0.88400000000000001,"5min":1.0269999999999999,"15min":1.0760000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.755,"15min":0.75700000000000001},"min":{"1min":0.60199999999999998,"5min":0.47299999999999998,"15min":0.41499999999999998},"max":{"1min":0.91600000000000004,"5min":1.018,"15min":1.024},"last":0.86699999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.44400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.82099999999999995,"5min":1.0009999999999999,"15min":1.022},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.41799999999999998,"5min":0.40999999999999998,"15min":0.39300000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.626}]},{"osd":5,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59699999999999998,"15min":0.60599999999999998},"min":{"1min":0.39300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.0249999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63400000000000001,"15min":0.65600000000000003},"min":{"1min":0.41999999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.81399999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68400000000000005,"15min":0.70099999999999996},"min":{"1min":0.45200000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.99299999999999999,"5min":1.0489999999999999,"15min":1.4419999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.67600000000000005},"min":{"1min":0.46999999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81200000000000006,"5min":0.95799999999999996,"15min":1.575},"last":0.78300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575040,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":1007616,"data_stored":502116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.57799999999999996,"5min":0.38,"15min":0.38},"max":{"1min":0.90400000000000003,"5min":0.996,"15min":1.2749999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.72499999999999998,"15min":0.74199999999999999},"min":{"1min":0.53600000000000003,"5min":0.48199999999999998,"15min":0.47399999999999998},"max":{"1min":0.98199999999999998,"5min":1.0800000000000001,"15min":1.2110000000000001},"last":0.68799999999999994}]},{"osd":1,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73599999999999999,"15min":0.752},"min":{"1min":0.48299999999999998,"5min":0.47399999999999998,"15min":0.379},"max":{"1min":0.90900000000000003,"5min":1.0089999999999999,"15min":1.4299999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70799999999999996,"15min":0.72599999999999998},"min":{"1min":0.56999999999999995,"5min":0.46999999999999997,"15min":0.44},"max":{"1min":0.86899999999999999,"5min":0.97099999999999997,"15min":1.1379999999999999},"last":0.76800000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.73899999999999999,"15min":0.754},"min":{"1min":0.55800000000000005,"5min":0.45900000000000002,"15min":0.40400000000000003},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":1.319},"last":0.745},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.755,"15min":0.75600000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.42299999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.341},"last":0.89500000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76000000000000001,"15min":0.78100000000000003},"min":{"1min":0.51000000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.054,"5min":1.054,"15min":1.3859999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.52400000000000002,"5min":0.48399999999999999,"15min":0.45900000000000002},"max":{"1min":0.94799999999999995,"5min":0.99099999999999999,"15min":1.1080000000000001},"last":0.79000000000000004}]},{"osd":4,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.97899999999999998},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.624,"15min":0.63900000000000001},"min":{"1min":0.47399999999999998,"5min":0.38500000000000001,"15min":0.36099999999999999},"max":{"1min":0.93500000000000005,"5min":1.012,"15min":1.091},"last":0.84499999999999997}]},{"osd":5,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64100000000000001,"15min":0.64700000000000002},"min":{"1min":0.499,"5min":0.37,"15min":0.37},"max":{"1min":0.96599999999999997,"5min":1.579,"15min":1.579},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67800000000000005,"15min":0.69399999999999995},"min":{"1min":0.46700000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.145},"last":0.82099999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.438,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.208},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.499,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0209999999999999,"5min":1.657,"15min":1.657},"last":0.92400000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575039,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":1007616,"data_stored":502104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.72999999999999998,"15min":0.73599999999999999},"min":{"1min":0.60999999999999999,"5min":0.36499999999999999,"15min":0.32400000000000001},"max":{"1min":0.90200000000000002,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.70799999999999996,"15min":0.73899999999999999},"min":{"1min":0.52500000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.63700000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71799999999999997,"15min":0.73099999999999998},"min":{"1min":0.56399999999999995,"5min":0.44500000000000001,"15min":0.41099999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.335},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.745,"15min":0.752},"min":{"1min":0.60299999999999998,"5min":0.48699999999999999,"15min":0.36799999999999999},"max":{"1min":0.94499999999999995,"5min":2.706,"15min":2.706},"last":0.90000000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72399999999999998,"15min":0.74399999999999999},"min":{"1min":0.59499999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.212,"5min":1.212,"15min":1.298},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.71899999999999997,"15min":0.73999999999999999},"min":{"1min":0.53800000000000003,"5min":0.433,"15min":0.433},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.753}]},{"osd":3,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.75,"15min":0.751},"min":{"1min":0.60599999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.90900000000000003,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.57999999999999996,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.81499999999999995}]},{"osd":4,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.45700000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68000000000000005,"15min":0.68899999999999995},"min":{"1min":0.443,"5min":0.36299999999999999,"15min":0.35899999999999999},"max":{"1min":0.86799999999999999,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.83799999999999997}]},{"osd":6,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60199999999999998,"15min":0.62},"min":{"1min":0.41699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63900000000000001,"15min":0.64600000000000002},"min":{"1min":0.496,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.79400000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:08:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66000000000000003,"15min":0.64900000000000002},"min":{"1min":0.48899999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.026,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.46600000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.2589999999999999,"5min":1.407,"15min":1.407},"last":0.88300000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575039,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":992,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":1015808,"data_stored":503646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.73999999999999999,"15min":0.73499999999999999},"min":{"1min":0.56200000000000006,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92400000000000004,"5min":1.411,"15min":1.411},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.76800000000000002,"15min":0.73199999999999998},"min":{"1min":0.64000000000000001,"5min":0.45800000000000002,"15min":0.435},"max":{"1min":0.94599999999999995,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.45100000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77000000000000002,"15min":0.751},"min":{"1min":0.62,"5min":0.47999999999999998,"15min":0.442},"max":{"1min":0.90700000000000003,"5min":1.077,"15min":1.077},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.54600000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91900000000000004,"5min":1.0469999999999999,"15min":1.2370000000000001},"last":0.496}]},{"osd":2,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.749,"15min":0.73599999999999999},"min":{"1min":0.60799999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.95599999999999996,"5min":1.091,"15min":1.091},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79800000000000004,"15min":0.77600000000000002},"min":{"1min":0.60399999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98199999999999998,"5min":1.387,"15min":1.387},"last":0.66900000000000004}]},{"osd":3,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75,"15min":0.748},"min":{"1min":0.58099999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84799999999999998,"5min":1.008,"15min":1.099},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77500000000000002,"15min":0.77300000000000002},"min":{"1min":0.64700000000000002,"5min":0.496,"15min":0.46800000000000003},"max":{"1min":0.98699999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.621}]},{"osd":5,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.61699999999999999,"15min":0.60499999999999998},"min":{"1min":0.437,"5min":0.378,"15min":0.378},"max":{"1min":0.76400000000000001,"5min":0.95599999999999996,"15min":1.0029999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.627,"15min":0.61799999999999999},"min":{"1min":0.52400000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85799999999999998,"5min":0.93600000000000005,"15min":0.95199999999999996},"last":0.63800000000000001}]},{"osd":6,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.621,"15min":0.62},"min":{"1min":0.48699999999999999,"5min":0.38900000000000001,"15min":0.32300000000000001},"max":{"1min":0.873,"5min":1.014,"15min":1.014},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.51900000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.94599999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.60599999999999998}]},{"osd":7,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.68200000000000005,"15min":0.67100000000000004},"min":{"1min":0.57199999999999995,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93200000000000005,"5min":0.94699999999999995,"15min":1.0349999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.55800000000000005,"5min":0.40300000000000002,"15min":0.36899999999999999},"max":{"1min":0.96899999999999997,"5min":1.0629999999999999,"15min":1.1080000000000001},"last":0.70099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575039,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36124,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335716,"statfs":{"total":96636764160,"available":96599773184,"internally_reserved":0,"allocated":1003520,"data_stored":502082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.44900000000000001,"15min":0.44600000000000001},"min":{"1min":0.32300000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.70099999999999996,"5min":0.755,"15min":0.84199999999999997},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.309},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":1.577},"last":0.51300000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47699999999999998,"15min":0.47799999999999998},"min":{"1min":0.33100000000000002,"5min":0.315,"15min":0.29199999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.88200000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54900000000000004,"15min":0.54300000000000004},"min":{"1min":0.438,"5min":0.35899999999999999,"15min":0.32600000000000001},"max":{"1min":0.71399999999999997,"5min":1.0029999999999999,"15min":1.113},"last":0.57199999999999995}]},{"osd":2,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55600000000000005,"15min":0.57199999999999995},"min":{"1min":0.40999999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.82599999999999996,"5min":0.88400000000000001,"15min":1.0820000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.60399999999999998},"min":{"1min":0.436,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.747,"5min":1.663,"15min":1.663},"last":0.49299999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.76800000000000002,"15min":0.76900000000000002},"min":{"1min":0.60499999999999998,"5min":0.47899999999999998,"15min":0.439},"max":{"1min":1.018,"5min":1.284,"15min":1.627},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.61699999999999999,"5min":0.56399999999999995,"15min":0.47699999999999998},"max":{"1min":1.0469999999999999,"5min":1.121,"15min":1.214},"last":0.72799999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.79800000000000004,"15min":0.79900000000000004},"min":{"1min":0.65700000000000003,"5min":0.58499999999999996,"15min":0.52400000000000002},"max":{"1min":0.997,"5min":1.306,"15min":1.333},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.55000000000000004,"5min":0.372,"15min":0.372},"max":{"1min":0.98899999999999999,"5min":1.1870000000000001,"15min":1.2470000000000001},"last":0.67100000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77700000000000002,"15min":0.78600000000000003},"min":{"1min":0.60399999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.99199999999999999,"5min":1.105,"15min":1.526},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.81699999999999995,"15min":0.82199999999999995},"min":{"1min":0.59199999999999997,"5min":0.54200000000000004,"15min":0.505},"max":{"1min":1.0109999999999999,"5min":1.2589999999999999,"15min":1.381},"last":0.68600000000000005}]},{"osd":7,"last update":"Fri Jul 14 13:08:01 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.85799999999999998,"15min":0.84799999999999998},"min":{"1min":0.66400000000000003,"5min":0.55800000000000005,"15min":0.53100000000000003},"max":{"1min":1.0349999999999999,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.83799999999999997,"15min":0.83699999999999997},"min":{"1min":0.63,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.026,"5min":1.595,"15min":1.6910000000000001},"last":0.77000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575039,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58264,"kb_used_data":976,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313576,"statfs":{"total":96636764160,"available":96577101824,"internally_reserved":0,"allocated":999424,"data_stored":501063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.32100000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64500000000000002,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55500000000000005,"15min":0.54100000000000004},"min":{"1min":0.34100000000000003,"5min":0.32900000000000001,"15min":0.28999999999999998},"max":{"1min":0.80800000000000005,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.33900000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48599999999999999,"15min":0.47599999999999998},"min":{"1min":0.38,"5min":0.29999999999999999,"15min":0.27500000000000002},"max":{"1min":0.71599999999999997,"5min":2.7200000000000002,"15min":2.7200000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55700000000000005,"15min":0.56899999999999995},"min":{"1min":0.40899999999999997,"5min":0.35999999999999999,"15min":0.33000000000000002},"max":{"1min":0.77900000000000003,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":0.438}]},{"osd":3,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.66200000000000003,"15min":0.60699999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72099999999999997,"5min":8.2530000000000001,"15min":8.2530000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.55400000000000005},"min":{"1min":0.40300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77200000000000002,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.41399999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76800000000000002,"15min":0.78300000000000003},"min":{"1min":0.61599999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.95199999999999996,"5min":1.0940000000000001,"15min":1.3049999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78500000000000003,"15min":0.80100000000000005},"min":{"1min":0.58199999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.006,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.748}]},{"osd":5,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.86299999999999999,"15min":0.86599999999999999},"min":{"1min":0.64600000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0640000000000001,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.84299999999999997,"15min":0.84399999999999997},"min":{"1min":0.57799999999999996,"5min":0.55600000000000005,"15min":0.433},"max":{"1min":1.081,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.67300000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.81100000000000005,"15min":0.80700000000000005},"min":{"1min":0.60399999999999998,"5min":0.48999999999999999,"15min":0.47599999999999998},"max":{"1min":0.99099999999999999,"5min":3.9849999999999999,"15min":3.9849999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82199999999999995,"15min":0.81699999999999995},"min":{"1min":0.64600000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.98499999999999999,"5min":3.391,"15min":3.391},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.81799999999999995,"15min":0.82799999999999996},"min":{"1min":0.61099999999999999,"5min":0.5,"15min":0.5},"max":{"1min":1.022,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83399999999999996,"15min":0.82599999999999996},"min":{"1min":0.66900000000000004,"5min":0.53200000000000003,"15min":0.50900000000000001},"max":{"1min":1.0069999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.71399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575040,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36152,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335688,"statfs":{"total":96636764160,"available":96599744512,"internally_reserved":0,"allocated":1032192,"data_stored":504410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.439,"15min":0.43099999999999999},"min":{"1min":0.317,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.65400000000000003,"5min":0.67200000000000004,"15min":0.77200000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.51800000000000002,"15min":0.504},"min":{"1min":0.34799999999999998,"5min":0.28199999999999997,"15min":0.26500000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.95699999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47599999999999998,"15min":0.47199999999999998},"min":{"1min":0.34599999999999997,"5min":0.32100000000000001,"15min":0.29499999999999998},"max":{"1min":0.67900000000000005,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.38200000000000001,"5min":0.30599999999999999,"15min":0.29299999999999998},"max":{"1min":0.74399999999999999,"5min":1.014,"15min":1.014},"last":0.47099999999999997}]},{"osd":3,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.55100000000000005,"5min":0.44700000000000001,"15min":0.432},"max":{"1min":0.80300000000000005,"5min":0.86899999999999999,"15min":0.96299999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.57999999999999996},"min":{"1min":0.46200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.80300000000000005,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.52100000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.79300000000000004,"15min":0.78400000000000003},"min":{"1min":0.61299999999999999,"5min":0.51300000000000001,"15min":0.40000000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.236},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.77800000000000002,"15min":0.78500000000000003},"min":{"1min":0.54900000000000004,"5min":0.502,"15min":0.45700000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.82099999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.67900000000000005,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":1.1000000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.81200000000000006,"15min":0.80400000000000005},"min":{"1min":0.56999999999999995,"5min":0.48599999999999999,"15min":0.48199999999999998},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.3600000000000001},"last":0.78000000000000003}]},{"osd":6,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.80000000000000004,"15min":0.80200000000000005},"min":{"1min":0.58299999999999996,"5min":0.503,"15min":0.48499999999999999},"max":{"1min":1.1120000000000001,"5min":1.2170000000000001,"15min":1.274},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.82899999999999996,"15min":0.81799999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.49199999999999999},"max":{"1min":1.1319999999999999,"5min":1.262,"15min":1.2969999999999999},"last":0.80600000000000005}]},{"osd":7,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.79700000000000004},"min":{"1min":0.62,"5min":0.55200000000000005,"15min":0.47799999999999998},"max":{"1min":1.1579999999999999,"5min":1.1859999999999999,"15min":1.3400000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.87,"5min":0.84599999999999997,"15min":0.84199999999999997},"min":{"1min":0.60799999999999998,"5min":0.53700000000000003,"15min":0.52800000000000002},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.65800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575041,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36700,"kb_used_data":1556,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335140,"statfs":{"total":96636764160,"available":96599183360,"internally_reserved":0,"allocated":1593344,"data_stored":1091431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.47099999999999997,"15min":0.45300000000000001},"min":{"1min":0.30199999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.76500000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.254},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.33000000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":1.452},"last":0.42799999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53800000000000003,"15min":0.52000000000000002},"min":{"1min":0.39800000000000002,"5min":0.35799999999999998,"15min":0.34100000000000003},"max":{"1min":0.84499999999999997,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55000000000000004,"15min":0.55700000000000005},"min":{"1min":0.376,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71699999999999997,"5min":0.80300000000000005,"15min":1.5700000000000001},"last":0.39800000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.499,"15min":0.50700000000000001},"min":{"1min":0.432,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.99299999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77100000000000002,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.46100000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.79900000000000004,"15min":0.79000000000000004},"min":{"1min":0.55200000000000005,"5min":0.48399999999999999,"15min":0.44400000000000001},"max":{"1min":1.21,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81999999999999995,"15min":0.81100000000000005},"min":{"1min":0.57999999999999996,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.03,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.59499999999999997}]},{"osd":5,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81000000000000005,"15min":0.81100000000000005},"min":{"1min":0.56999999999999995,"5min":0.51800000000000002,"15min":0.47899999999999998},"max":{"1min":1.042,"5min":1.3839999999999999,"15min":1.4950000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.80000000000000004,"15min":0.80100000000000005},"min":{"1min":0.621,"5min":0.49299999999999999,"15min":0.47299999999999998},"max":{"1min":1.069,"5min":1.325,"15min":1.325},"last":0.69599999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.82299999999999995,"15min":0.81399999999999995},"min":{"1min":0.58699999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.05,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.63900000000000001,"5min":0.50600000000000001,"15min":0.41299999999999998},"max":{"1min":1.044,"5min":1.3440000000000001,"15min":1.5369999999999999},"last":0.58399999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:08:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.82899999999999996,"15min":0.83799999999999997},"min":{"1min":0.60599999999999998,"5min":0.503,"15min":0.45500000000000002},"max":{"1min":1.1180000000000001,"5min":1.2749999999999999,"15min":1.603},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.80500000000000005,"15min":0.81799999999999995},"min":{"1min":0.65100000000000002,"5min":0.502,"15min":0.497},"max":{"1min":1.0880000000000001,"5min":1.381,"15min":1.381},"last":0.57099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:08:33.007 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-14T13:08:33.008 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-14T13:08:33.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.164+0000 7fb50a740640 1 Processor -- start 2023-07-14T13:08:33.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.164+0000 7fb50a740640 1 -- start start 2023-07-14T13:08:33.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.164+0000 7fb50a740640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb504158a40 0x7fb5040cb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:33.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.168+0000 7fb50a740640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb5040cd670 0x7fb50406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:33.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.168+0000 7fb50a740640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5040c8e20 con 0x7fb5040c8940 2023-07-14T13:08:33.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.168+0000 7fb50a740640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5040711b0 con 0x7fb5040cd670 2023-07-14T13:08:33.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.168+0000 7fb50a740640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5040c9100 con 0x7fb504158a40 2023-07-14T13:08:33.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.168+0000 7fb5037fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb5040c8940 0x7fb5040ccf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40228/0 (socket says 172.21.15.5:40228) 2023-07-14T13:08:33.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.168+0000 7fb5037fe640 1 -- 172.21.15.5:0/3997980006 learned_addr learned my addr 172.21.15.5:0/3997980006 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:33.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.168+0000 7fb503fff640 1 --2- 172.21.15.5:0/3997980006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb504158a40 0x7fb5040cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:33.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.168+0000 7fb508cdd640 1 --2- 172.21.15.5:0/3997980006 >> v2:172.21.15.154:3300/0 conn(0x7fb5040cd670 0x7fb50406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:33.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.168+0000 7fb502ffd640 1 -- 172.21.15.5:0/3997980006 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896492089 0 0) 0x7fb5040c8e20 con 0x7fb5040c8940 2023-07-14T13:08:33.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.168+0000 7fb502ffd640 1 -- 172.21.15.5:0/3997980006 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4ec003530 con 0x7fb5040c8940 2023-07-14T13:08:33.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.168+0000 7fb508cdd640 1 -- 172.21.15.5:0/3997980006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb504158a40 msgr2=0x7fb5040cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:33.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.168+0000 7fb508cdd640 1 --2- 172.21.15.5:0/3997980006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb504158a40 0x7fb5040cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:33.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.168+0000 7fb508cdd640 1 -- 172.21.15.5:0/3997980006 >> v1:172.21.15.5:6789/0 conn(0x7fb5040c8940 legacy=0x7fb5040ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:33.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.168+0000 7fb508cdd640 1 -- 172.21.15.5:0/3997980006 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5040c93e0 con 0x7fb5040cd670 2023-07-14T13:08:33.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.168+0000 7fb503fff640 1 --2- 172.21.15.5:0/3997980006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb504158a40 0x7fb5040cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:33.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.168+0000 7fb508cdd640 1 --2- 172.21.15.5:0/3997980006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5040cd670 0x7fb50406fc00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc009d90 tx=0x7fb4fc01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32efb1d4e14a1e1e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:33.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.172+0000 7fb502ffd640 1 -- 172.21.15.5:0/3997980006 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc0a59e0 con 0x7fb5040cd670 2023-07-14T13:08:33.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.172+0000 7fb502ffd640 1 -- 172.21.15.5:0/3997980006 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4fc0a5b40 con 0x7fb5040cd670 2023-07-14T13:08:33.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.172+0000 7fb502ffd640 1 -- 172.21.15.5:0/3997980006 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc0ad440 con 0x7fb5040cd670 2023-07-14T13:08:33.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.172+0000 7fb50a740640 1 -- 172.21.15.5:0/3997980006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5040cd670 msgr2=0x7fb50406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:33.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.172+0000 7fb50a740640 1 --2- 172.21.15.5:0/3997980006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5040cd670 0x7fb50406fc00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc009d90 tx=0x7fb4fc01c920 comp rx=0 tx=0).stop 2023-07-14T13:08:33.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.172+0000 7fb50a740640 1 -- 172.21.15.5:0/3997980006 shutdown_connections 2023-07-14T13:08:33.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.172+0000 7fb50a740640 1 --2- 172.21.15.5:0/3997980006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5040cd670 0x7fb50406fc00 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:33.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.172+0000 7fb50a740640 1 --2- 172.21.15.5:0/3997980006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb504158a40 0x7fb5040cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:33.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.172+0000 7fb50a740640 1 -- 172.21.15.5:0/3997980006 >> 172.21.15.5:0/3997980006 conn(0x7fb5040afac0 msgr2=0x7fb5040afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:33.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.172+0000 7fb50a740640 1 -- 172.21.15.5:0/3997980006 shutdown_connections 2023-07-14T13:08:33.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.172+0000 7fb50a740640 1 -- 172.21.15.5:0/3997980006 wait complete. 2023-07-14T13:08:33.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.172+0000 7fb50a740640 1 Processor -- start 2023-07-14T13:08:33.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.172+0000 7fb50a740640 1 -- start start 2023-07-14T13:08:33.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.172+0000 7fb50a740640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5040c8940 0x7fb504149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:33.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.172+0000 7fb50a740640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5040cd670 0x7fb50414d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:33.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.172+0000 7fb50a740640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb50415b440 0x7fb5041472f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:33.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.172+0000 7fb50a740640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50414de90 con 0x7fb5040c8940 2023-07-14T13:08:33.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.172+0000 7fb50a740640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50414e3e0 con 0x7fb50415b440 2023-07-14T13:08:33.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.172+0000 7fb50a740640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50414e100 con 0x7fb5040cd670 2023-07-14T13:08:33.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.176+0000 7fb503fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5040c8940 0x7fb504149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:33.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.176+0000 7fb503fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5040c8940 0x7fb504149e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51790/0 (socket says 172.21.15.5:51790) 2023-07-14T13:08:33.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.176+0000 7fb503fff640 1 -- 172.21.15.5:0/2783862656 learned_addr learned my addr 172.21.15.5:0/2783862656 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:33.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.176+0000 7fb5037fe640 1 --2- 172.21.15.5:0/2783862656 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5040cd670 0x7fb50414d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:33.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.176+0000 7fb508cdd640 1 --2- 172.21.15.5:0/2783862656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb50415b440 0x7fb5041472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:33.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.176+0000 7fb503fff640 1 -- 172.21.15.5:0/2783862656 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5040cd670 msgr2=0x7fb50414d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:33.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.176+0000 7fb503fff640 1 --2- 172.21.15.5:0/2783862656 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5040cd670 0x7fb50414d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:33.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.176+0000 7fb503fff640 1 -- 172.21.15.5:0/2783862656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb50415b440 msgr2=0x7fb5041472f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:33.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.176+0000 7fb503fff640 1 --2- 172.21.15.5:0/2783862656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb50415b440 0x7fb5041472f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:33.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.176+0000 7fb503fff640 1 -- 172.21.15.5:0/2783862656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f4009420 con 0x7fb5040c8940 2023-07-14T13:08:33.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.176+0000 7fb5037fe640 1 --2- 172.21.15.5:0/2783862656 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5040cd670 0x7fb50414d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:33.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.176+0000 7fb503fff640 1 --2- 172.21.15.5:0/2783862656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5040c8940 0x7fb504149e60 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400e980 tx=0x7fb4f400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:33.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.176+0000 7fb500ff9640 1 -- 172.21.15.5:0/2783862656 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f400ca00 con 0x7fb5040c8940 2023-07-14T13:08:33.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.176+0000 7fb500ff9640 1 -- 172.21.15.5:0/2783862656 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f400cb60 con 0x7fb5040c8940 2023-07-14T13:08:33.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.176+0000 7fb50a740640 1 -- 172.21.15.5:0/2783862656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4fc009a70 con 0x7fb5040c8940 2023-07-14T13:08:33.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.176+0000 7fb500ff9640 1 -- 172.21.15.5:0/2783862656 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f4013470 con 0x7fb5040c8940 2023-07-14T13:08:33.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.176+0000 7fb50a740640 1 -- 172.21.15.5:0/2783862656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5041487a0 con 0x7fb5040c8940 2023-07-14T13:08:33.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.176+0000 7fb50a740640 1 -- 172.21.15.5:0/2783862656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5040ca370 con 0x7fb5040c8940 2023-07-14T13:08:33.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.176+0000 7fb500ff9640 1 -- 172.21.15.5:0/2783862656 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb4f40135d0 con 0x7fb5040c8940 2023-07-14T13:08:33.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.180+0000 7fb500ff9640 1 --2- 172.21.15.5:0/2783862656 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fb4f00663d0 0x7fb4f0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:33.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.180+0000 7fb500ff9640 1 -- 172.21.15.5:0/2783862656 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb4f4083fb0 con 0x7fb5040c8940 2023-07-14T13:08:33.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.180+0000 7fb5037fe640 1 --2- 172.21.15.5:0/2783862656 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fb4f00663d0 0x7fb4f0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:33.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.180+0000 7fb5037fe640 1 --2- 172.21.15.5:0/2783862656 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fb4f00663d0 0x7fb4f0068880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb50406c760 tx=0x7fb4f8009040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:33.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.184+0000 7fb500ff9640 1 -- 172.21.15.5:0/2783862656 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb4f40513c0 con 0x7fb5040c8940 2023-07-14T13:08:33.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.388+0000 7fb50a740640 1 -- 172.21.15.5:0/2783862656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb5040678d0 con 0x7fb5040c8940 2023-07-14T13:08:33.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.396+0000 7fb500ff9640 1 -- 172.21.15.5:0/2783862656 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+147 (secure 0 0 0) 0x7fb4f40170b0 con 0x7fb5040c8940 2023-07-14T13:08:33.429 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-07-14T13:08:33.429 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDkRLFkCav/DhAA6SOiONAbTcWCnUZXcm7BcQ== 2023-07-14T13:08:33.429 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2023-07-14T13:08:33.429 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2023-07-14T13:08:33.430 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-14T13:08:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2023-07-14T13:08:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.396+0000 7fb50a740640 1 -- 172.21.15.5:0/2783862656 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fb4f00663d0 msgr2=0x7fb4f0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.396+0000 7fb50a740640 1 --2- 172.21.15.5:0/2783862656 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fb4f00663d0 0x7fb4f0068880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb50406c760 tx=0x7fb4f8009040 comp rx=0 tx=0).stop 2023-07-14T13:08:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.396+0000 7fb50a740640 1 -- 172.21.15.5:0/2783862656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5040c8940 msgr2=0x7fb504149e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.396+0000 7fb50a740640 1 --2- 172.21.15.5:0/2783862656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5040c8940 0x7fb504149e60 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400e980 tx=0x7fb4f400ee40 comp rx=0 tx=0).stop 2023-07-14T13:08:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.396+0000 7fb50a740640 1 -- 172.21.15.5:0/2783862656 shutdown_connections 2023-07-14T13:08:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.396+0000 7fb50a740640 1 --2- 172.21.15.5:0/2783862656 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fb4f00663d0 0x7fb4f0068880 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.396+0000 7fb50a740640 1 --2- 172.21.15.5:0/2783862656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb50415b440 0x7fb5041472f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.396+0000 7fb50a740640 1 --2- 172.21.15.5:0/2783862656 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5040cd670 0x7fb50414d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.396+0000 7fb50a740640 1 --2- 172.21.15.5:0/2783862656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5040c8940 0x7fb504149e60 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.396+0000 7fb50a740640 1 -- 172.21.15.5:0/2783862656 >> 172.21.15.5:0/2783862656 conn(0x7fb5040afac0 msgr2=0x7fb50406c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.396+0000 7fb50a740640 1 -- 172.21.15.5:0/2783862656 shutdown_connections 2023-07-14T13:08:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.396+0000 7fb50a740640 1 -- 172.21.15.5:0/2783862656 wait complete. 2023-07-14T13:08:33.450 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:08:33.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.560+0000 7efd71340640 1 Processor -- start 2023-07-14T13:08:33.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.560+0000 7efd71340640 1 -- start start 2023-07-14T13:08:33.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd71340640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efd6c15bc00 0x7efd6c0ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:33.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd71340640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd6c160450 0x7efd6c06e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:33.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd71340640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd6c0c9c30 con 0x7efd6c069430 2023-07-14T13:08:33.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd71340640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd6c0c96b0 con 0x7efd6c15bc00 2023-07-14T13:08:33.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd71340640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c15bfd0 con 0x7efd6c160450 2023-07-14T13:08:33.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd6b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efd6c069430 0x7efd6c0702c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40244/0 (socket says 172.21.15.5:40244) 2023-07-14T13:08:33.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd6b7fe640 1 -- 172.21.15.5:0/2520548343 learned_addr learned my addr 172.21.15.5:0/2520548343 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:33.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd63fff640 1 --2- 172.21.15.5:0/2520548343 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd6c160450 0x7efd6c06e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:33.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd6affd640 1 --2- 172.21.15.5:0/2520548343 >> v2:172.21.15.154:3300/0 conn(0x7efd6c15bc00 0x7efd6c0ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:33.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd6a7fc640 1 -- 172.21.15.5:0/2520548343 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741365972 0 0) 0x7efd6c0c9c30 con 0x7efd6c069430 2023-07-14T13:08:33.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd6a7fc640 1 -- 172.21.15.5:0/2520548343 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd58003530 con 0x7efd6c069430 2023-07-14T13:08:33.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd6a7fc640 1 -- 172.21.15.5:0/2520548343 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3040393385 0 0) 0x7efd58003530 con 0x7efd6c069430 2023-07-14T13:08:33.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd6a7fc640 1 -- 172.21.15.5:0/2520548343 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd6c160450 msgr2=0x7efd6c06e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:33.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd6a7fc640 1 --2- 172.21.15.5:0/2520548343 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd6c160450 0x7efd6c06e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:33.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd6a7fc640 1 -- 172.21.15.5:0/2520548343 >> v2:172.21.15.154:3300/0 conn(0x7efd6c15bc00 msgr2=0x7efd6c0ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:33.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd6a7fc640 1 --2- 172.21.15.5:0/2520548343 >> v2:172.21.15.154:3300/0 conn(0x7efd6c15bc00 0x7efd6c0ce8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:33.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd6a7fc640 1 -- 172.21.15.5:0/2520548343 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6c0cee30 con 0x7efd6c069430 2023-07-14T13:08:33.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd6a7fc640 1 -- 172.21.15.5:0/2520548343 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7efd64001a00 con 0x7efd6c069430 2023-07-14T13:08:33.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd6a7fc640 1 -- 172.21.15.5:0/2520548343 >> v1:172.21.15.5:6789/0 conn(0x7efd6c069430 legacy=0x7efd6c0702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:33.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd6a7fc640 1 --2- 172.21.15.5:0/2520548343 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd6c160450 0x7efd58003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:33.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd6a7fc640 1 --2- 172.21.15.5:0/2520548343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd58003f00 0x7efd580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:33.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd6a7fc640 1 --2- 172.21.15.5:0/2520548343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd58004d10 0x7efd58005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:33.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd6a7fc640 1 -- 172.21.15.5:0/2520548343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c0c96b0 con 0x7efd58004d10 2023-07-14T13:08:33.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd6a7fc640 1 -- 172.21.15.5:0/2520548343 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c15bfd0 con 0x7efd58003f00 2023-07-14T13:08:33.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd6a7fc640 1 -- 172.21.15.5:0/2520548343 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5800b990 con 0x7efd6c160450 2023-07-14T13:08:33.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd6b7fe640 1 --2- 172.21.15.5:0/2520548343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd58004d10 0x7efd58005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:33.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd6affd640 1 --2- 172.21.15.5:0/2520548343 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd6c160450 0x7efd58003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:33.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd63fff640 1 --2- 172.21.15.5:0/2520548343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd58003f00 0x7efd580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:33.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd6b7fe640 1 -- 172.21.15.5:0/2520548343 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd6c160450 msgr2=0x7efd58003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:33.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd6b7fe640 1 --2- 172.21.15.5:0/2520548343 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd6c160450 0x7efd58003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:33.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd6b7fe640 1 -- 172.21.15.5:0/2520548343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd58003f00 msgr2=0x7efd580047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:33.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd6b7fe640 1 --2- 172.21.15.5:0/2520548343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd58003f00 0x7efd580047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:33.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.564+0000 7efd6b7fe640 1 -- 172.21.15.5:0/2520548343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd58003530 con 0x7efd58004d10 2023-07-14T13:08:33.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.568+0000 7efd6b7fe640 1 --2- 172.21.15.5:0/2520548343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd58004d10 0x7efd58005180 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7efd6400a8d0 tx=0x7efd6401d3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0551acfc557204 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:33.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.568+0000 7efd6a7fc640 1 -- 172.21.15.5:0/2520548343 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd640ad630 con 0x7efd58004d10 2023-07-14T13:08:33.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.568+0000 7efd6a7fc640 1 -- 172.21.15.5:0/2520548343 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd640a8070 con 0x7efd58004d10 2023-07-14T13:08:33.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.568+0000 7efd6a7fc640 1 -- 172.21.15.5:0/2520548343 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd640ad9d0 con 0x7efd58004d10 2023-07-14T13:08:33.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.568+0000 7efd71340640 1 -- 172.21.15.5:0/2520548343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd58004d10 msgr2=0x7efd58005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:33.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.568+0000 7efd71340640 1 --2- 172.21.15.5:0/2520548343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd58004d10 0x7efd58005180 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7efd6400a8d0 tx=0x7efd6401d3e0 comp rx=0 tx=0).stop 2023-07-14T13:08:33.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.568+0000 7efd6b7fe640 1 -- 172.21.15.5:0/2520548343 reap_dead start 2023-07-14T13:08:33.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.568+0000 7efd71340640 1 -- 172.21.15.5:0/2520548343 shutdown_connections 2023-07-14T13:08:33.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.568+0000 7efd71340640 1 -- 172.21.15.5:0/2520548343 >> 172.21.15.5:0/2520548343 conn(0x7efd6c0b1840 msgr2=0x7efd6c0cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:33.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.568+0000 7efd71340640 1 -- 172.21.15.5:0/2520548343 shutdown_connections 2023-07-14T13:08:33.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.568+0000 7efd71340640 1 -- 172.21.15.5:0/2520548343 wait complete. 2023-07-14T13:08:33.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.572+0000 7efd71340640 1 Processor -- start 2023-07-14T13:08:33.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.572+0000 7efd71340640 1 -- start start 2023-07-14T13:08:33.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.572+0000 7efd71340640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd58004d10 0x7efd6c0c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:33.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.572+0000 7efd71340640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd6c0c7fc0 0x7efd6c146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:33.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.572+0000 7efd71340640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd6c147500 0x7efd6c147970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:33.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.572+0000 7efd71340640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c15c300 con 0x7efd6c147500 2023-07-14T13:08:33.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.572+0000 7efd71340640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c0c87b0 con 0x7efd58004d10 2023-07-14T13:08:33.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.572+0000 7efd71340640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c0c8a90 con 0x7efd6c0c7fc0 2023-07-14T13:08:33.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.572+0000 7efd6b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd6c147500 0x7efd6c147970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:33.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.572+0000 7efd6b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd6c147500 0x7efd6c147970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51798/0 (socket says 172.21.15.5:51798) 2023-07-14T13:08:33.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.572+0000 7efd6b7fe640 1 -- 172.21.15.5:0/568264770 learned_addr learned my addr 172.21.15.5:0/568264770 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:33.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.572+0000 7efd6affd640 1 --2- 172.21.15.5:0/568264770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd58004d10 0x7efd6c0c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:33.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.572+0000 7efd63fff640 1 --2- 172.21.15.5:0/568264770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd6c0c7fc0 0x7efd6c146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:33.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.572+0000 7efd6b7fe640 1 -- 172.21.15.5:0/568264770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd6c0c7fc0 msgr2=0x7efd6c146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:33.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.572+0000 7efd6b7fe640 1 --2- 172.21.15.5:0/568264770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd6c0c7fc0 0x7efd6c146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:33.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.572+0000 7efd6b7fe640 1 -- 172.21.15.5:0/568264770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd58004d10 msgr2=0x7efd6c0c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:33.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.572+0000 7efd6b7fe640 1 --2- 172.21.15.5:0/568264770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd58004d10 0x7efd6c0c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:33.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.572+0000 7efd6b7fe640 1 -- 172.21.15.5:0/568264770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6c0c8d70 con 0x7efd6c147500 2023-07-14T13:08:33.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.572+0000 7efd6b7fe640 1 --2- 172.21.15.5:0/568264770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd6c147500 0x7efd6c147970 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7efd6401ce50 tx=0x7efd58005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:33.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.572+0000 7efd637fe640 1 -- 172.21.15.5:0/568264770 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd640017c0 con 0x7efd6c147500 2023-07-14T13:08:33.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.572+0000 7efd637fe640 1 -- 172.21.15.5:0/568264770 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd64001940 con 0x7efd6c147500 2023-07-14T13:08:33.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.572+0000 7efd637fe640 1 -- 172.21.15.5:0/568264770 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd64004db0 con 0x7efd6c147500 2023-07-14T13:08:33.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.572+0000 7efd71340640 1 -- 172.21.15.5:0/568264770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd6c0c9050 con 0x7efd6c147500 2023-07-14T13:08:33.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.572+0000 7efd71340640 1 -- 172.21.15.5:0/568264770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6c1eefc0 con 0x7efd6c147500 2023-07-14T13:08:33.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.572+0000 7efd71340640 1 -- 172.21.15.5:0/568264770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd6c15c470 con 0x7efd6c147500 2023-07-14T13:08:33.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.576+0000 7efd637fe640 1 -- 172.21.15.5:0/568264770 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7efd640aa030 con 0x7efd6c147500 2023-07-14T13:08:33.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.576+0000 7efd637fe640 1 --2- 172.21.15.5:0/568264770 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7efd4c0663a0 0x7efd4c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:33.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.576+0000 7efd637fe640 1 -- 172.21.15.5:0/568264770 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efd6411db10 con 0x7efd6c147500 2023-07-14T13:08:33.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.576+0000 7efd6affd640 1 --2- 172.21.15.5:0/568264770 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7efd4c0663a0 0x7efd4c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:33.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.576+0000 7efd6affd640 1 --2- 172.21.15.5:0/568264770 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7efd4c0663a0 0x7efd4c068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efd6c0ce600 tx=0x7efd5c009190 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:33.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.580+0000 7efd637fe640 1 -- 172.21.15.5:0/568264770 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7efd6c15c470 con 0x7efd6c147500 2023-07-14T13:08:33.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.768+0000 7efd71340640 1 -- 172.21.15.5:0/568264770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd6c0c91e0 con 0x7efd6c147500 2023-07-14T13:08:33.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.768+0000 7efd637fe640 1 -- 172.21.15.5:0/568264770 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4710 (secure 0 0 0) 0x7efd640eaec0 con 0x7efd6c147500 2023-07-14T13:08:33.801 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:33.801 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5837,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3019701155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3019701155},{"type":"v1","addr":"172.21.15.5:6835","nonce":3019701155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5843,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1673574180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1673574180},{"type":"v1","addr":"172.21.15.154:6837","nonce":1673574180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6421,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3017507974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3017507974},{"type":"v1","addr":"172.21.15.154:6836","nonce":3017507974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:08:23.268544+0000","modified":"2023-07-14T13:08:26.903497+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6576},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6576":{"gid":6576,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/1613814904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1613814904},{"type":"v1","addr":"172.21.15.5:6834","nonce":1613814904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-14T13:08:33.802 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 32 2023-07-14T13:08:33.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.768+0000 7efd71340640 1 -- 172.21.15.5:0/568264770 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7efd4c0663a0 msgr2=0x7efd4c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:33.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.768+0000 7efd71340640 1 --2- 172.21.15.5:0/568264770 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7efd4c0663a0 0x7efd4c068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efd6c0ce600 tx=0x7efd5c009190 comp rx=0 tx=0).stop 2023-07-14T13:08:33.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.768+0000 7efd71340640 1 -- 172.21.15.5:0/568264770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd6c147500 msgr2=0x7efd6c147970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:33.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.768+0000 7efd71340640 1 --2- 172.21.15.5:0/568264770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd6c147500 0x7efd6c147970 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7efd6401ce50 tx=0x7efd58005800 comp rx=0 tx=0).stop 2023-07-14T13:08:33.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.768+0000 7efd71340640 1 -- 172.21.15.5:0/568264770 shutdown_connections 2023-07-14T13:08:33.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.768+0000 7efd71340640 1 --2- 172.21.15.5:0/568264770 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7efd4c0663a0 0x7efd4c068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:33.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.768+0000 7efd71340640 1 --2- 172.21.15.5:0/568264770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd6c147500 0x7efd6c147970 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:33.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.768+0000 7efd71340640 1 --2- 172.21.15.5:0/568264770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd6c0c7fc0 0x7efd6c146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:33.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.768+0000 7efd71340640 1 --2- 172.21.15.5:0/568264770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd58004d10 0x7efd6c0c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:33.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.768+0000 7efd71340640 1 -- 172.21.15.5:0/568264770 >> 172.21.15.5:0/568264770 conn(0x7efd6c0b1840 msgr2=0x7efd6c15f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:33.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.768+0000 7efd71340640 1 -- 172.21.15.5:0/568264770 shutdown_connections 2023-07-14T13:08:33.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:33.768+0000 7efd71340640 1 -- 172.21.15.5:0/568264770 wait complete. 2023-07-14T13:08:34.223 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-14T13:08:23.268544+0000', 'modified': '2023-07-14T13:08:26.903497+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6576}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6576': {'gid': 6576, 'name': 'a', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6834/1613814904', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6832', 'nonce': 1613814904}, {'type': 'v1', 'addr': '172.21.15.5:6834', 'nonce': 1613814904}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-14T13:08:34.224 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-14T13:08:34.224 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-14T13:08:34.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.336+0000 7fc94c3ad640 1 Processor -- start 2023-07-14T13:08:34.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.336+0000 7fc94c3ad640 1 -- start start 2023-07-14T13:08:34.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.340+0000 7fc94c3ad640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc944158ce0 0x7fc944070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:34.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.340+0000 7fc94c3ad640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc9440c9730 0x7fc9440ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:34.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.340+0000 7fc94c3ad640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9440cc700 con 0x7fc9440c8ad0 2023-07-14T13:08:34.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.340+0000 7fc94c3ad640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9440b0ff0 con 0x7fc9440c9730 2023-07-14T13:08:34.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.340+0000 7fc94c3ad640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc944070c80 con 0x7fc944158ce0 2023-07-14T13:08:34.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.340+0000 7fc94a94a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc9440c9730 0x7fc9440ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:34.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.340+0000 7fc94a94a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc9440c9730 0x7fc9440ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51812/0 (socket says 172.21.15.5:51812) 2023-07-14T13:08:34.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.340+0000 7fc94a94a640 1 -- 172.21.15.5:0/3081451721 learned_addr learned my addr 172.21.15.5:0/3081451721 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:34.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.340+0000 7fc94a149640 1 --2- 172.21.15.5:0/3081451721 >> v2:172.21.15.154:3300/0 conn(0x7fc944158ce0 0x7fc944070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:34.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.340+0000 7fc94a94a640 1 -- 172.21.15.5:0/3081451721 >> v2:172.21.15.154:3300/0 conn(0x7fc944158ce0 msgr2=0x7fc944070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:34.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.340+0000 7fc94a94a640 1 --2- 172.21.15.5:0/3081451721 >> v2:172.21.15.154:3300/0 conn(0x7fc944158ce0 0x7fc944070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.340+0000 7fc94a94a640 1 -- 172.21.15.5:0/3081451721 >> v1:172.21.15.154:6789/0 conn(0x7fc9440c8ad0 legacy=0x7fc9440c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:34.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.340+0000 7fc94a94a640 1 -- 172.21.15.5:0/3081451721 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9440cbdd0 con 0x7fc9440c9730 2023-07-14T13:08:34.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.340+0000 7fc94a149640 1 --2- 172.21.15.5:0/3081451721 >> v2:172.21.15.154:3300/0 conn(0x7fc944158ce0 0x7fc944070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:34.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.344+0000 7fc94a94a640 1 --2- 172.21.15.5:0/3081451721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9440c9730 0x7fc9440ccb90 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fc944071be0 tx=0x7fc93c01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7ab9d35e93aeb9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:34.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.344+0000 7fc949147640 1 -- 172.21.15.5:0/3081451721 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c0a5650 con 0x7fc9440c9730 2023-07-14T13:08:34.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.344+0000 7fc949147640 1 -- 172.21.15.5:0/3081451721 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93c0a57b0 con 0x7fc9440c9730 2023-07-14T13:08:34.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.344+0000 7fc949147640 1 -- 172.21.15.5:0/3081451721 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c0a5b40 con 0x7fc9440c9730 2023-07-14T13:08:34.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.344+0000 7fc94c3ad640 1 -- 172.21.15.5:0/3081451721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9440c9730 msgr2=0x7fc9440ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:34.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.344+0000 7fc94c3ad640 1 --2- 172.21.15.5:0/3081451721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9440c9730 0x7fc9440ccb90 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fc944071be0 tx=0x7fc93c01c880 comp rx=0 tx=0).stop 2023-07-14T13:08:34.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.344+0000 7fc94c3ad640 1 -- 172.21.15.5:0/3081451721 shutdown_connections 2023-07-14T13:08:34.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.344+0000 7fc94c3ad640 1 --2- 172.21.15.5:0/3081451721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9440c9730 0x7fc9440ccb90 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.344+0000 7fc94c3ad640 1 --2- 172.21.15.5:0/3081451721 >> v2:172.21.15.154:3300/0 conn(0x7fc944158ce0 0x7fc944070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.344+0000 7fc94c3ad640 1 -- 172.21.15.5:0/3081451721 >> 172.21.15.5:0/3081451721 conn(0x7fc9440afcf0 msgr2=0x7fc9440b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:34.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.344+0000 7fc94c3ad640 1 -- 172.21.15.5:0/3081451721 shutdown_connections 2023-07-14T13:08:34.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.344+0000 7fc94c3ad640 1 -- 172.21.15.5:0/3081451721 wait complete. 2023-07-14T13:08:34.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.344+0000 7fc94c3ad640 1 Processor -- start 2023-07-14T13:08:34.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.344+0000 7fc94c3ad640 1 -- start start 2023-07-14T13:08:34.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.348+0000 7fc94c3ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9440c8ad0 0x7fc9440c21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:34.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.348+0000 7fc94c3ad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9440c9730 0x7fc9440c2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:34.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.348+0000 7fc94c3ad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc944158ce0 0x7fc9440adc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:34.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.348+0000 7fc94c3ad640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9441f8240 con 0x7fc9440c9730 2023-07-14T13:08:34.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.348+0000 7fc94c3ad640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9440c2700 con 0x7fc9440c8ad0 2023-07-14T13:08:34.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.348+0000 7fc94c3ad640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9440c3490 con 0x7fc944158ce0 2023-07-14T13:08:34.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.348+0000 7fc949948640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9440c9730 0x7fc9440c2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:34.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.348+0000 7fc949948640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9440c9730 0x7fc9440c2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51828/0 (socket says 172.21.15.5:51828) 2023-07-14T13:08:34.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.348+0000 7fc949948640 1 -- 172.21.15.5:0/1622863752 learned_addr learned my addr 172.21.15.5:0/1622863752 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:34.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.348+0000 7fc94a149640 1 --2- 172.21.15.5:0/1622863752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9440c8ad0 0x7fc9440c21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:34.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.348+0000 7fc94a94a640 1 --2- 172.21.15.5:0/1622863752 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc944158ce0 0x7fc9440adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:34.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.348+0000 7fc949948640 1 -- 172.21.15.5:0/1622863752 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc944158ce0 msgr2=0x7fc9440adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:34.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.348+0000 7fc949948640 1 --2- 172.21.15.5:0/1622863752 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc944158ce0 0x7fc9440adc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.348+0000 7fc949948640 1 -- 172.21.15.5:0/1622863752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9440c8ad0 msgr2=0x7fc9440c21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:34.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.348+0000 7fc949948640 1 --2- 172.21.15.5:0/1622863752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9440c8ad0 0x7fc9440c21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.348+0000 7fc949948640 1 -- 172.21.15.5:0/1622863752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c009b30 con 0x7fc9440c9730 2023-07-14T13:08:34.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.348+0000 7fc94a94a640 1 --2- 172.21.15.5:0/1622863752 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc944158ce0 0x7fc9440adc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:34.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.348+0000 7fc949948640 1 --2- 172.21.15.5:0/1622863752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9440c9730 0x7fc9440c2f50 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fc93400c530 tx=0x7fc93400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:34.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.348+0000 7fc93affd640 1 -- 172.21.15.5:0/1622863752 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc934005220 con 0x7fc9440c9730 2023-07-14T13:08:34.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.348+0000 7fc93affd640 1 -- 172.21.15.5:0/1622863752 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc934005380 con 0x7fc9440c9730 2023-07-14T13:08:34.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.348+0000 7fc94c3ad640 1 -- 172.21.15.5:0/1622863752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9441f75c0 con 0x7fc9440c9730 2023-07-14T13:08:34.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.348+0000 7fc93affd640 1 -- 172.21.15.5:0/1622863752 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc934007270 con 0x7fc9440c9730 2023-07-14T13:08:34.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.348+0000 7fc94c3ad640 1 -- 172.21.15.5:0/1622863752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9441f7b80 con 0x7fc9440c9730 2023-07-14T13:08:34.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.352+0000 7fc93affd640 1 -- 172.21.15.5:0/1622863752 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc9340073d0 con 0x7fc9440c9730 2023-07-14T13:08:34.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.352+0000 7fc93affd640 1 --2- 172.21.15.5:0/1622863752 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fc9280663a0 0x7fc928068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:34.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.352+0000 7fc93affd640 1 -- 172.21.15.5:0/1622863752 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc9340836d0 con 0x7fc9440c9730 2023-07-14T13:08:34.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.352+0000 7fc94f705000 1 Processor -- start 2023-07-14T13:08:34.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.352+0000 7fc94a149640 1 --2- 172.21.15.5:0/1622863752 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fc9280663a0 0x7fc928068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:34.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.352+0000 7fc94f705000 1 -- start start 2023-07-14T13:08:34.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.352+0000 7fc94a149640 1 --2- 172.21.15.5:0/1622863752 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fc9280663a0 0x7fc928068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc940006e90 tx=0x7fc940008040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:34.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.352+0000 7fc94f705000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562cebf4f80 0x5562cebf5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:34.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.352+0000 7fc94f705000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf5890 0x5562cebab3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:34.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.352+0000 7fc94f705000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5562cebab930 0x5562cebabd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:34.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.352+0000 7fc94f705000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562cea72900 con 0x5562cebf5890 2023-07-14T13:08:34.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.352+0000 7fc94f705000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562ce9ac8c0 con 0x5562cebf4f80 2023-07-14T13:08:34.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.352+0000 7fc94f705000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562cea00360 con 0x5562cebab930 2023-07-14T13:08:34.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.352+0000 7fc949948640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf5890 0x5562cebab3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:34.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.352+0000 7fc949948640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf5890 0x5562cebab3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51840/0 (socket says 172.21.15.5:51840) 2023-07-14T13:08:34.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.352+0000 7fc949948640 1 -- 172.21.15.5:0/2297954653 learned_addr learned my addr 172.21.15.5:0/2297954653 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:34.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.352+0000 7fc94a149640 1 --2- 172.21.15.5:0/2297954653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562cebf4f80 0x5562cebf5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:34.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.352+0000 7fc94a94a640 1 --2- 172.21.15.5:0/2297954653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5562cebab930 0x5562cebabd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:34.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.352+0000 7fc949948640 1 -- 172.21.15.5:0/2297954653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5562cebab930 msgr2=0x5562cebabd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:34.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.352+0000 7fc949948640 1 --2- 172.21.15.5:0/2297954653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5562cebab930 0x5562cebabd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.352+0000 7fc949948640 1 -- 172.21.15.5:0/2297954653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562cebf4f80 msgr2=0x5562cebf5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:34.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.352+0000 7fc949948640 1 --2- 172.21.15.5:0/2297954653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562cebf4f80 0x5562cebf5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.352+0000 7fc949948640 1 -- 172.21.15.5:0/2297954653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562ce6f5890 con 0x5562cebf5890 2023-07-14T13:08:34.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.352+0000 7fc949948640 1 --2- 172.21.15.5:0/2297954653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf5890 0x5562cebab3f0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fc934001320 tx=0x7fc934054120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cefbeb28be4e39e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:34.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.352+0000 7fc927fff640 1 -- 172.21.15.5:0/2297954653 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93405ca40 con 0x5562cebf5890 2023-07-14T13:08:34.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.352+0000 7fc927fff640 1 -- 172.21.15.5:0/2297954653 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9340819f0 con 0x5562cebf5890 2023-07-14T13:08:34.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.352+0000 7fc927fff640 1 -- 172.21.15.5:0/2297954653 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc934081ba0 con 0x5562cebf5890 2023-07-14T13:08:34.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc94f705000 1 -- 172.21.15.5:0/2297954653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf5890 msgr2=0x5562cebab3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:34.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc94f705000 1 --2- 172.21.15.5:0/2297954653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf5890 0x5562cebab3f0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fc934001320 tx=0x7fc934054120 comp rx=0 tx=0).stop 2023-07-14T13:08:34.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc94f705000 1 -- 172.21.15.5:0/2297954653 shutdown_connections 2023-07-14T13:08:34.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc94f705000 1 --2- 172.21.15.5:0/2297954653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5562cebab930 0x5562cebabd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc94f705000 1 --2- 172.21.15.5:0/2297954653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf5890 0x5562cebab3f0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc94f705000 1 --2- 172.21.15.5:0/2297954653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562cebf4f80 0x5562cebf5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc94f705000 1 -- 172.21.15.5:0/2297954653 >> 172.21.15.5:0/2297954653 conn(0x5562cebb1a90 msgr2=0x5562ceba9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:34.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc94f705000 1 -- 172.21.15.5:0/2297954653 shutdown_connections 2023-07-14T13:08:34.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc94f705000 1 -- 172.21.15.5:0/2297954653 wait complete. 2023-07-14T13:08:34.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc94f705000 1 -- start start 2023-07-14T13:08:34.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc94f705000 1 Processor -- start 2023-07-14T13:08:34.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc94f705000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5562cebab930 0x5562cebfc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:34.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc94f705000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf4f80 0x5562cebfc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:34.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc94f705000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562cebf5890 0x5562cebb6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:34.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc94f705000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562ce9f9400 con 0x5562cebf4f80 2023-07-14T13:08:34.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc94f705000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562ce9b5b60 con 0x5562cebf5890 2023-07-14T13:08:34.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc94f705000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562ce9b5800 con 0x5562cebab930 2023-07-14T13:08:34.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc94f705000 10 client.0 _ll_register_callbacks cb 0x5562ceb972c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:08:34.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc949948640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf4f80 0x5562cebfc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:34.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc949948640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf4f80 0x5562cebfc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51844/0 (socket says 172.21.15.5:51844) 2023-07-14T13:08:34.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc949948640 1 -- 172.21.15.5:0/2034138377 learned_addr learned my addr 172.21.15.5:0/2034138377 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:34.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc94a149640 1 --2- 172.21.15.5:0/2034138377 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5562cebab930 0x5562cebfc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:34.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc94a94a640 1 --2- 172.21.15.5:0/2034138377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562cebf5890 0x5562cebb6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:34.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc949948640 1 -- 172.21.15.5:0/2034138377 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5562cebab930 msgr2=0x5562cebfc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:34.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc949948640 1 --2- 172.21.15.5:0/2034138377 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5562cebab930 0x5562cebfc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc949948640 1 -- 172.21.15.5:0/2034138377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562cebf5890 msgr2=0x5562cebb6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:34.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc949948640 1 --2- 172.21.15.5:0/2034138377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562cebf5890 0x5562cebb6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc949948640 1 -- 172.21.15.5:0/2034138377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9441f7b80 con 0x5562cebf4f80 2023-07-14T13:08:34.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc94a94a640 1 --2- 172.21.15.5:0/2034138377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562cebf5890 0x5562cebb6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:34.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc949948640 1 --2- 172.21.15.5:0/2034138377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf4f80 0x5562cebfc5f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fc934052a40 tx=0x7fc934001270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caeb83dc2c91123a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:34.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc9257fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-07-14T13:08:34.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc9257fa640 1 -- 172.21.15.5:0/2034138377 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc934081bb0 con 0x5562cebf4f80 2023-07-14T13:08:34.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc94f705000 1 -- 172.21.15.5:0/2034138377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562ce9c0aa0 con 0x5562cebf4f80 2023-07-14T13:08:34.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.356+0000 7fc9257fa640 1 -- 172.21.15.5:0/2034138377 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc934058170 con 0x5562cebf4f80 2023-07-14T13:08:34.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc9257fa640 1 -- 172.21.15.5:0/2034138377 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc934058330 con 0x5562cebf4f80 2023-07-14T13:08:34.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc94f705000 10 client.6753 fetch_fsmap learned FSMap version 32 2023-07-14T13:08:34.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc94f705000 1 -- 172.21.15.5:0/2034138377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x5562ce9bdd90 con 0x5562cebf4f80 2023-07-14T13:08:34.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc9257fa640 1 -- 172.21.15.5:0/2034138377 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5562ce9c0aa0 con 0x5562cebf4f80 2023-07-14T13:08:34.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc9257fa640 1 -- 172.21.15.5:0/2034138377 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc934019030 con 0x5562cebf4f80 2023-07-14T13:08:34.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc94f705000 10 client.6753 fetch_fsmap finished waiting for FSMap version 32 2023-07-14T13:08:34.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc94f705000 10 client.6753 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-14T13:08:34.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc94f705000 20 client.6753 populate_metadata read hostname 'smithi005' 2023-07-14T13:08:34.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc94f705000 1 --2- 172.21.15.5:0/2034138377 >> [v2:172.21.15.5:6832/1613814904,v1:172.21.15.5:6834/1613814904] conn(0x5562cebb72e0 0x5562cebb76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:34.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc94f705000 4 client.6753 mds_command: new command op to 6576 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:08:34.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc94f705000 1 -- 172.21.15.5:0/2034138377 --> [v2:172.21.15.5:6832/1613814904,v1:172.21.15.5:6834/1613814904] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5562cea27f40 con 0x5562cebb72e0 2023-07-14T13:08:34.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc94a149640 1 --2- 172.21.15.5:0/2034138377 >> [v2:172.21.15.5:6832/1613814904,v1:172.21.15.5:6834/1613814904] conn(0x5562cebb72e0 0x5562cebb76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:34.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc9257fa640 10 client.6753 ms_handle_connect on v2:172.21.15.5:6832/1613814904 2023-07-14T13:08:34.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc94a149640 1 --2- 172.21.15.5:0/2034138377 >> [v2:172.21.15.5:6832/1613814904,v1:172.21.15.5:6834/1613814904] conn(0x5562cebb72e0 0x5562cebb76b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3308d874c7532878 server_cookie=b5ba06e539503670 in_seq=0 out_seq=0 2023-07-14T13:08:34.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc9257fa640 1 -- 172.21.15.5:0/2034138377 <== mds.0 v2:172.21.15.5:6832/1613814904 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5562cea27f40 con 0x5562cebb72e0 2023-07-14T13:08:34.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc9257fa640 10 client.6753 handle_command_reply: tid=0 2023-07-14T13:08:34.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc94f705000 1 client.6753 shutdown 2023-07-14T13:08:34.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc94f705000 1 -- 172.21.15.5:0/2034138377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf4f80 msgr2=0x5562cebfc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:34.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc94f705000 1 --2- 172.21.15.5:0/2034138377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf4f80 0x5562cebfc5f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fc934052a40 tx=0x7fc934001270 comp rx=0 tx=0).stop 2023-07-14T13:08:34.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc94f705000 1 -- 172.21.15.5:0/2034138377 shutdown_connections 2023-07-14T13:08:34.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc94f705000 1 --2- 172.21.15.5:0/2034138377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562cebf5890 0x5562cebb6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc94f705000 1 --2- 172.21.15.5:0/2034138377 >> [v2:172.21.15.5:6832/1613814904,v1:172.21.15.5:6834/1613814904] conn(0x5562cebb72e0 0x5562cebb76b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc94f705000 1 --2- 172.21.15.5:0/2034138377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf4f80 0x5562cebfc5f0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc94f705000 1 --2- 172.21.15.5:0/2034138377 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5562cebab930 0x5562cebfc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc94f705000 1 -- 172.21.15.5:0/2034138377 >> 172.21.15.5:0/2034138377 conn(0x5562cebb1a90 msgr2=0x5562cebaa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:34.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc9257fa640 0 client.6753 ms_handle_reset on v2:172.21.15.5:6832/1613814904 2023-07-14T13:08:34.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc94f705000 1 -- 172.21.15.5:0/2034138377 shutdown_connections 2023-07-14T13:08:34.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc94f705000 1 -- 172.21.15.5:0/2034138377 wait complete. 2023-07-14T13:08:34.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.360+0000 7fc94f705000 20 client.6753 trim_cache size 0 max 16384 2023-07-14T13:08:34.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.376+0000 7fc94f705000 1 Processor -- start 2023-07-14T13:08:34.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.376+0000 7fc94f705000 1 -- start start 2023-07-14T13:08:34.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.376+0000 7fc94f705000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562cebab930 0x5562cec4e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:34.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.376+0000 7fc94f705000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5562cebf4f80 0x5562cec4ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:34.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.376+0000 7fc94f705000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf5890 0x5562cec4f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:34.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.376+0000 7fc94f705000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562ce6b6940 con 0x5562cebf5890 2023-07-14T13:08:34.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.376+0000 7fc94f705000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562ce9f8290 con 0x5562cebab930 2023-07-14T13:08:34.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.376+0000 7fc94f705000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562ce9c06b0 con 0x5562cebf4f80 2023-07-14T13:08:34.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.376+0000 7fc94a94a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf5890 0x5562cec4f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:34.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.376+0000 7fc94a94a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf5890 0x5562cec4f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51852/0 (socket says 172.21.15.5:51852) 2023-07-14T13:08:34.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.376+0000 7fc94a94a640 1 -- 172.21.15.5:0/2499440030 learned_addr learned my addr 172.21.15.5:0/2499440030 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:34.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.376+0000 7fc949948640 1 --2- 172.21.15.5:0/2499440030 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5562cebf4f80 0x5562cec4ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:34.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.376+0000 7fc94a94a640 1 -- 172.21.15.5:0/2499440030 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5562cebf4f80 msgr2=0x5562cec4ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:34.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.376+0000 7fc94a149640 1 --2- 172.21.15.5:0/2499440030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562cebab930 0x5562cec4e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:34.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.376+0000 7fc94a94a640 1 --2- 172.21.15.5:0/2499440030 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5562cebf4f80 0x5562cec4ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.376+0000 7fc94a94a640 1 -- 172.21.15.5:0/2499440030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562cebab930 msgr2=0x5562cec4e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:34.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.376+0000 7fc94a94a640 1 --2- 172.21.15.5:0/2499440030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562cebab930 0x5562cec4e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.376+0000 7fc94a94a640 1 -- 172.21.15.5:0/2499440030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562cebae000 con 0x5562cebf5890 2023-07-14T13:08:34.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.376+0000 7fc94a149640 1 --2- 172.21.15.5:0/2499440030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562cebab930 0x5562cec4e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:08:34.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.376+0000 7fc949948640 1 --2- 172.21.15.5:0/2499440030 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5562cebf4f80 0x5562cec4ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:08:34.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.376+0000 7fc94a94a640 1 --2- 172.21.15.5:0/2499440030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf5890 0x5562cec4f3c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fc93c01cd60 tx=0x7fc93c0a7070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a717936b60bae2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:34.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc938ff9640 1 -- 172.21.15.5:0/2499440030 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c0a5920 con 0x5562cebf5890 2023-07-14T13:08:34.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc938ff9640 1 -- 172.21.15.5:0/2499440030 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93c0a5a80 con 0x5562cebf5890 2023-07-14T13:08:34.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc938ff9640 1 -- 172.21.15.5:0/2499440030 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c0a5e30 con 0x5562cebf5890 2023-07-14T13:08:34.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc94f705000 1 -- 172.21.15.5:0/2499440030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf5890 msgr2=0x5562cec4f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:34.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc94f705000 1 --2- 172.21.15.5:0/2499440030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf5890 0x5562cec4f3c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fc93c01cd60 tx=0x7fc93c0a7070 comp rx=0 tx=0).stop 2023-07-14T13:08:34.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc94f705000 1 -- 172.21.15.5:0/2499440030 shutdown_connections 2023-07-14T13:08:34.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc94f705000 1 --2- 172.21.15.5:0/2499440030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf5890 0x5562cec4f3c0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc94f705000 1 --2- 172.21.15.5:0/2499440030 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5562cebf4f80 0x5562cec4ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc94f705000 1 --2- 172.21.15.5:0/2499440030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562cebab930 0x5562cec4e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc94f705000 1 -- 172.21.15.5:0/2499440030 >> 172.21.15.5:0/2499440030 conn(0x5562cebb1a90 msgr2=0x5562cebafa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:34.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc94f705000 1 -- 172.21.15.5:0/2499440030 shutdown_connections 2023-07-14T13:08:34.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc94f705000 1 -- 172.21.15.5:0/2499440030 wait complete. 2023-07-14T13:08:34.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc94f705000 1 -- start start 2023-07-14T13:08:34.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc94f705000 1 Processor -- start 2023-07-14T13:08:34.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc94f705000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5562cebab930 0x5562cebf9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:34.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc94f705000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf4f80 0x5562cebf9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:34.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc94f705000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562cebf5890 0x5562cebf9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:34.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc94f705000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562cea3c600 con 0x5562cebf4f80 2023-07-14T13:08:34.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc94f705000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562ce9f4d70 con 0x5562cebf5890 2023-07-14T13:08:34.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc94f705000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562ce9a14d0 con 0x5562cebab930 2023-07-14T13:08:34.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc94f705000 10 client.0 _ll_register_callbacks cb 0x5562ceb774b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:08:34.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc949948640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf4f80 0x5562cebf9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:34.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc949948640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf4f80 0x5562cebf9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51862/0 (socket says 172.21.15.5:51862) 2023-07-14T13:08:34.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc949948640 1 -- 172.21.15.5:0/3954019231 learned_addr learned my addr 172.21.15.5:0/3954019231 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:34.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc94a149640 1 --2- 172.21.15.5:0/3954019231 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5562cebab930 0x5562cebf9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:34.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc94a94a640 1 --2- 172.21.15.5:0/3954019231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562cebf5890 0x5562cebf9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:34.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc949948640 1 -- 172.21.15.5:0/3954019231 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5562cebab930 msgr2=0x5562cebf9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:34.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc949948640 1 --2- 172.21.15.5:0/3954019231 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5562cebab930 0x5562cebf9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc949948640 1 -- 172.21.15.5:0/3954019231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562cebf5890 msgr2=0x5562cebf9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:34.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc949948640 1 --2- 172.21.15.5:0/3954019231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562cebf5890 0x5562cebf9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc949948640 1 -- 172.21.15.5:0/3954019231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9440cbdd0 con 0x5562cebf4f80 2023-07-14T13:08:34.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc94a94a640 1 --2- 172.21.15.5:0/3954019231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562cebf5890 0x5562cebf9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:34.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc949948640 1 --2- 172.21.15.5:0/3954019231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf4f80 0x5562cebf9ab0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc934050bf0 tx=0x7fc934050b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7601047ea199c95a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:34.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc9257fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-07-14T13:08:34.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc9257fa640 1 -- 172.21.15.5:0/3954019231 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc934060070 con 0x5562cebf4f80 2023-07-14T13:08:34.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc9257fa640 1 -- 172.21.15.5:0/3954019231 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc93405ca40 con 0x5562cebf4f80 2023-07-14T13:08:34.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.380+0000 7fc94f705000 1 -- 172.21.15.5:0/3954019231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562ce9f7d50 con 0x5562cebf4f80 2023-07-14T13:08:34.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc9257fa640 1 -- 172.21.15.5:0/3954019231 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc934081bb0 con 0x5562cebf4f80 2023-07-14T13:08:34.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94f705000 10 client.6759 fetch_fsmap learned FSMap version 32 2023-07-14T13:08:34.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94f705000 1 -- 172.21.15.5:0/3954019231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x5562ce9a4020 con 0x5562cebf4f80 2023-07-14T13:08:34.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc9257fa640 1 -- 172.21.15.5:0/3954019231 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5562ce9f7d50 con 0x5562cebf4f80 2023-07-14T13:08:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc9257fa640 1 -- 172.21.15.5:0/3954019231 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc934019040 con 0x5562cebf4f80 2023-07-14T13:08:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94f705000 10 client.6759 fetch_fsmap finished waiting for FSMap version 32 2023-07-14T13:08:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94f705000 10 client.6759 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-14T13:08:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94f705000 20 client.6759 populate_metadata read hostname 'smithi005' 2023-07-14T13:08:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94f705000 1 --2- 172.21.15.5:0/3954019231 >> [v2:172.21.15.5:6832/1613814904,v1:172.21.15.5:6834/1613814904] conn(0x5562cebfa980 0x5562cec5abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94f705000 4 client.6759 mds_command: new command op to 6576 tid=0[{"prefix": "status"}] 2023-07-14T13:08:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94f705000 1 -- 172.21.15.5:0/3954019231 --> [v2:172.21.15.5:6832/1613814904,v1:172.21.15.5:6834/1613814904] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5562ce9f23e0 con 0x5562cebfa980 2023-07-14T13:08:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94a149640 1 --2- 172.21.15.5:0/3954019231 >> [v2:172.21.15.5:6832/1613814904,v1:172.21.15.5:6834/1613814904] conn(0x5562cebfa980 0x5562cec5abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94a149640 1 --2- 172.21.15.5:0/3954019231 >> [v2:172.21.15.5:6832/1613814904,v1:172.21.15.5:6834/1613814904] conn(0x5562cebfa980 0x5562cec5abd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad2e4329bbc06553 server_cookie=d18f88730653b1b0 in_seq=0 out_seq=0 2023-07-14T13:08:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc9257fa640 10 client.6759 ms_handle_connect on v2:172.21.15.5:6832/1613814904 2023-07-14T13:08:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc9257fa640 1 -- 172.21.15.5:0/3954019231 <== mds.0 v2:172.21.15.5:6832/1613814904 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5562ce9f23e0 con 0x5562cebfa980 2023-07-14T13:08:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc9257fa640 10 client.6759 handle_command_reply: tid=0 2023-07-14T13:08:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94f705000 1 client.6759 shutdown 2023-07-14T13:08:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94f705000 1 -- 172.21.15.5:0/3954019231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf4f80 msgr2=0x5562cebf9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94f705000 1 --2- 172.21.15.5:0/3954019231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf4f80 0x5562cebf9ab0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc934050bf0 tx=0x7fc934050b60 comp rx=0 tx=0).stop 2023-07-14T13:08:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94f705000 1 -- 172.21.15.5:0/3954019231 shutdown_connections 2023-07-14T13:08:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94f705000 1 --2- 172.21.15.5:0/3954019231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5562cebf5890 0x5562cebf9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94f705000 1 --2- 172.21.15.5:0/3954019231 >> [v2:172.21.15.5:6832/1613814904,v1:172.21.15.5:6834/1613814904] conn(0x5562cebfa980 0x5562cec5abd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94f705000 1 --2- 172.21.15.5:0/3954019231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5562cebf4f80 0x5562cebf9ab0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94f705000 1 --2- 172.21.15.5:0/3954019231 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5562cebab930 0x5562cebf9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc9257fa640 0 client.6759 ms_handle_reset on v2:172.21.15.5:6832/1613814904 2023-07-14T13:08:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94f705000 1 -- 172.21.15.5:0/3954019231 >> 172.21.15.5:0/3954019231 conn(0x5562cebb1a90 msgr2=0x5562cebb02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94f705000 1 -- 172.21.15.5:0/3954019231 shutdown_connections 2023-07-14T13:08:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94f705000 1 -- 172.21.15.5:0/3954019231 wait complete. 2023-07-14T13:08:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94f705000 20 client.6759 trim_cache size 0 max 16384 2023-07-14T13:08:34.426 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T13:08:34.426 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "22affb8d-e389-40f8-a764-dd40eb1759c8", 2023-07-14T13:08:34.426 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-07-14T13:08:34.427 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 6576, 2023-07-14T13:08:34.427 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-07-14T13:08:34.427 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-07-14T13:08:34.427 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-07-14T13:08:34.427 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 10.506303164, 2023-07-14T13:08:34.427 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 32, 2023-07-14T13:08:34.427 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 83, 2023-07-14T13:08:34.428 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 83, 2023-07-14T13:08:34.428 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 16.422313672000001 2023-07-14T13:08:34.428 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T13:08:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94c3ad640 1 -- 172.21.15.5:0/1622863752 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fc9280663a0 msgr2=0x7fc928068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94c3ad640 1 --2- 172.21.15.5:0/1622863752 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fc9280663a0 0x7fc928068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc940006e90 tx=0x7fc940008040 comp rx=0 tx=0).stop 2023-07-14T13:08:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94c3ad640 1 -- 172.21.15.5:0/1622863752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9440c9730 msgr2=0x7fc9440c2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94c3ad640 1 --2- 172.21.15.5:0/1622863752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9440c9730 0x7fc9440c2f50 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fc93400c530 tx=0x7fc93400c9f0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94c3ad640 1 -- 172.21.15.5:0/1622863752 shutdown_connections 2023-07-14T13:08:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94c3ad640 1 --2- 172.21.15.5:0/1622863752 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7fc9280663a0 0x7fc928068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94c3ad640 1 --2- 172.21.15.5:0/1622863752 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc944158ce0 0x7fc9440adc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94c3ad640 1 --2- 172.21.15.5:0/1622863752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9440c9730 0x7fc9440c2f50 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94c3ad640 1 --2- 172.21.15.5:0/1622863752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9440c8ad0 0x7fc9440c21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94c3ad640 1 -- 172.21.15.5:0/1622863752 >> 172.21.15.5:0/1622863752 conn(0x7fc9440afcf0 msgr2=0x7fc9440c9000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:34.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94c3ad640 1 -- 172.21.15.5:0/1622863752 shutdown_connections 2023-07-14T13:08:34.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.384+0000 7fc94c3ad640 1 -- 172.21.15.5:0/1622863752 wait complete. 2023-07-14T13:08:34.437 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T13:08:34.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.548+0000 7f5a473df640 1 Processor -- start 2023-07-14T13:08:34.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.548+0000 7f5a473df640 1 -- start start 2023-07-14T13:08:34.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.548+0000 7f5a473df640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a40160330 0x7f5a400cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:34.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.548+0000 7f5a473df640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a400c17d0 con 0x7f5a400c0f80 2023-07-14T13:08:34.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.548+0000 7f5a473df640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a400c14f0 con 0x7f5a400c8940 2023-07-14T13:08:34.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.548+0000 7f5a473df640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a400cdd70 con 0x7f5a40160330 2023-07-14T13:08:34.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.552+0000 7f5a4597c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5a400c0f80 0x7f5a400cd660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40256/0 (socket says 172.21.15.5:40256) 2023-07-14T13:08:34.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.552+0000 7f5a4597c640 1 -- 172.21.15.5:0/280053206 learned_addr learned my addr 172.21.15.5:0/280053206 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:34.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.552+0000 7f5a4517b640 1 --2- 172.21.15.5:0/280053206 >> v2:172.21.15.5:3300/0 conn(0x7f5a40160330 0x7f5a400cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:34.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.552+0000 7f5a37fff640 1 -- 172.21.15.5:0/280053206 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 136013767 0 0) 0x7f5a400c17d0 con 0x7f5a400c0f80 2023-07-14T13:08:34.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.552+0000 7f5a4517b640 1 -- 172.21.15.5:0/280053206 >> v1:172.21.15.154:6789/0 conn(0x7f5a400c8940 legacy=0x7f5a400ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:34.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.552+0000 7f5a4517b640 1 -- 172.21.15.5:0/280053206 >> v1:172.21.15.5:6789/0 conn(0x7f5a400c0f80 legacy=0x7f5a400cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:34.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.552+0000 7f5a4517b640 1 -- 172.21.15.5:0/280053206 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a400cac10 con 0x7f5a40160330 2023-07-14T13:08:34.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.552+0000 7f5a4517b640 1 --2- 172.21.15.5:0/280053206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a40160330 0x7f5a400cb6f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c0097c0 tx=0x7f5a3c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e64906bff111c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:34.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.552+0000 7f5a37fff640 1 -- 172.21.15.5:0/280053206 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c0a8970 con 0x7f5a40160330 2023-07-14T13:08:34.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.552+0000 7f5a37fff640 1 -- 172.21.15.5:0/280053206 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c0a8ad0 con 0x7f5a40160330 2023-07-14T13:08:34.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.552+0000 7f5a37fff640 1 -- 172.21.15.5:0/280053206 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c0a8e60 con 0x7f5a40160330 2023-07-14T13:08:34.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.556+0000 7f5a473df640 1 -- 172.21.15.5:0/280053206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a40160330 msgr2=0x7f5a400cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:34.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.556+0000 7f5a473df640 1 --2- 172.21.15.5:0/280053206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a40160330 0x7f5a400cb6f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c0097c0 tx=0x7f5a3c01ec70 comp rx=0 tx=0).stop 2023-07-14T13:08:34.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.556+0000 7f5a473df640 1 -- 172.21.15.5:0/280053206 shutdown_connections 2023-07-14T13:08:34.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.556+0000 7f5a473df640 1 --2- 172.21.15.5:0/280053206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a40160330 0x7f5a400cb6f0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.556+0000 7f5a473df640 1 -- 172.21.15.5:0/280053206 >> 172.21.15.5:0/280053206 conn(0x7f5a400afcf0 msgr2=0x7f5a400b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:34.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.556+0000 7f5a473df640 1 -- 172.21.15.5:0/280053206 shutdown_connections 2023-07-14T13:08:34.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.556+0000 7f5a473df640 1 -- 172.21.15.5:0/280053206 wait complete. 2023-07-14T13:08:34.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.556+0000 7f5a473df640 1 Processor -- start 2023-07-14T13:08:34.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.556+0000 7f5a473df640 1 -- start start 2023-07-14T13:08:34.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.556+0000 7f5a473df640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a400c0f80 0x7f5a400b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:34.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.556+0000 7f5a473df640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a400c8940 0x7f5a40155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:34.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.556+0000 7f5a473df640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a40160330 0x7f5a400cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:34.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.556+0000 7f5a473df640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a40160b10 con 0x7f5a40160330 2023-07-14T13:08:34.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.556+0000 7f5a473df640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a400c58e0 con 0x7f5a400c0f80 2023-07-14T13:08:34.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.556+0000 7f5a473df640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a400c52d0 con 0x7f5a400c8940 2023-07-14T13:08:34.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.556+0000 7f5a4597c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a40160330 0x7f5a400cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:34.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.556+0000 7f5a4597c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a40160330 0x7f5a400cc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51890/0 (socket says 172.21.15.5:51890) 2023-07-14T13:08:34.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.556+0000 7f5a4597c640 1 -- 172.21.15.5:0/2017918430 learned_addr learned my addr 172.21.15.5:0/2017918430 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:34.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.556+0000 7f5a4517b640 1 --2- 172.21.15.5:0/2017918430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a400c0f80 0x7f5a400b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:34.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.556+0000 7f5a4497a640 1 --2- 172.21.15.5:0/2017918430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a400c8940 0x7f5a40155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:34.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.556+0000 7f5a4597c640 1 -- 172.21.15.5:0/2017918430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a400c8940 msgr2=0x7f5a40155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:34.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.556+0000 7f5a4597c640 1 --2- 172.21.15.5:0/2017918430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a400c8940 0x7f5a40155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.556+0000 7f5a4597c640 1 -- 172.21.15.5:0/2017918430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a400c0f80 msgr2=0x7f5a400b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:34.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.556+0000 7f5a4597c640 1 --2- 172.21.15.5:0/2017918430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a400c0f80 0x7f5a400b34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.556+0000 7f5a4597c640 1 -- 172.21.15.5:0/2017918430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3c009420 con 0x7f5a40160330 2023-07-14T13:08:34.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.560+0000 7f5a4597c640 1 --2- 172.21.15.5:0/2017918430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a40160330 0x7f5a400cc880 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f5a38001570 tx=0x7f5a3800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:34.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.560+0000 7f5a35ffb640 1 -- 172.21.15.5:0/2017918430 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3800a640 con 0x7f5a40160330 2023-07-14T13:08:34.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.560+0000 7f5a35ffb640 1 -- 172.21.15.5:0/2017918430 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3800a7c0 con 0x7f5a40160330 2023-07-14T13:08:34.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.560+0000 7f5a35ffb640 1 -- 172.21.15.5:0/2017918430 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3800ab70 con 0x7f5a40160330 2023-07-14T13:08:34.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.560+0000 7f5a473df640 1 -- 172.21.15.5:0/2017918430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a40156c70 con 0x7f5a40160330 2023-07-14T13:08:34.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.560+0000 7f5a473df640 1 -- 172.21.15.5:0/2017918430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a400c5570 con 0x7f5a40160330 2023-07-14T13:08:34.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.560+0000 7f5a473df640 1 -- 172.21.15.5:0/2017918430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a400c5a50 con 0x7f5a40160330 2023-07-14T13:08:34.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.560+0000 7f5a35ffb640 1 -- 172.21.15.5:0/2017918430 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5a3800acd0 con 0x7f5a40160330 2023-07-14T13:08:34.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.560+0000 7f5a35ffb640 1 --2- 172.21.15.5:0/2017918430 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f5a240663d0 0x7f5a24068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:34.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.560+0000 7f5a35ffb640 1 -- 172.21.15.5:0/2017918430 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5a380832c0 con 0x7f5a40160330 2023-07-14T13:08:34.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.560+0000 7f5a4517b640 1 --2- 172.21.15.5:0/2017918430 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f5a240663d0 0x7f5a24068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:34.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.564+0000 7f5a4517b640 1 --2- 172.21.15.5:0/2017918430 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f5a240663d0 0x7f5a24068880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c0b2000 tx=0x7f5a3c008040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:34.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.564+0000 7f5a35ffb640 1 -- 172.21.15.5:0/2017918430 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f5a38050640 con 0x7f5a40160330 2023-07-14T13:08:34.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.752+0000 7f5a473df640 1 -- 172.21.15.5:0/2017918430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5a400678d0 con 0x7f5a40160330 2023-07-14T13:08:34.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.756+0000 7f5a35ffb640 1 -- 172.21.15.5:0/2017918430 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5a38053c60 con 0x7f5a40160330 2023-07-14T13:08:34.788 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T13:08:34.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.756+0000 7f5a473df640 1 -- 172.21.15.5:0/2017918430 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f5a240663d0 msgr2=0x7f5a24068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:34.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.756+0000 7f5a473df640 1 --2- 172.21.15.5:0/2017918430 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f5a240663d0 0x7f5a24068880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c0b2000 tx=0x7f5a3c008040 comp rx=0 tx=0).stop 2023-07-14T13:08:34.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.756+0000 7f5a473df640 1 -- 172.21.15.5:0/2017918430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a40160330 msgr2=0x7f5a400cc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:34.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.756+0000 7f5a473df640 1 --2- 172.21.15.5:0/2017918430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a40160330 0x7f5a400cc880 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f5a38001570 tx=0x7f5a3800cca0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.756+0000 7f5a473df640 1 -- 172.21.15.5:0/2017918430 shutdown_connections 2023-07-14T13:08:34.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.756+0000 7f5a473df640 1 --2- 172.21.15.5:0/2017918430 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f5a240663d0 0x7f5a24068880 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.756+0000 7f5a473df640 1 --2- 172.21.15.5:0/2017918430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a40160330 0x7f5a400cc880 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.756+0000 7f5a473df640 1 --2- 172.21.15.5:0/2017918430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5a400c8940 0x7f5a40155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.756+0000 7f5a473df640 1 --2- 172.21.15.5:0/2017918430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a400c0f80 0x7f5a400b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:34.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.756+0000 7f5a473df640 1 -- 172.21.15.5:0/2017918430 >> 172.21.15.5:0/2017918430 conn(0x7f5a400afcf0 msgr2=0x7f5a4006f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:34.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.756+0000 7f5a473df640 1 -- 172.21.15.5:0/2017918430 shutdown_connections 2023-07-14T13:08:34.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:34.756+0000 7f5a473df640 1 -- 172.21.15.5:0/2017918430 wait complete. 2023-07-14T13:08:34.809 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-14T13:08:34.809 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T13:08:34.809 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-07-14T13:08:34.810 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-14T13:08:34.810 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-14T13:08:34.810 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-14T13:08:34.810 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-14T13:08:34.811 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T13:08:34.811 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T13:08:34.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:08:34.812 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-07-14T13:08:34.822 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T13:08:34.822 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T13:08:34.822 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T13:08:34.822 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:08:34.823 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-07-14T13:08:34.823 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:08:34.823 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T13:08:34.823 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-07-14T13:08:34.823 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2023-07-14T13:08:34.823 INFO:teuthology.orchestra.run.smithi005.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T13:08:34.823 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-07-14T13:08:34.824 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2023-07-14T13:08:34.824 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-14T13:08:34.824 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 41401sec preferred_lft 41401sec 2023-07-14T13:08:34.824 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-07-14T13:08:34.824 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:08:34.824 INFO:teuthology.orchestra.run.smithi005.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T13:08:34.824 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-07-14T13:08:34.824 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2023-07-14T13:08:34.825 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T13:08:34.825 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-07-14T13:08:34.825 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2023-07-14T13:08:34.825 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-14T13:08:34.825 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:96:b6:fb:c6 brd ff:ff:ff:ff:ff:ff 2023-07-14T13:08:34.825 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-14T13:08:34.825 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:08:34.826 INFO:teuthology.orchestra.run.smithi005.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T13:08:34.826 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-14T13:08:34.826 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T13:08:34.826 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:08:34.826 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-14T13:08:34.826 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:08:34.826 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T13:08:34.826 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T13:08:34.827 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-14T13:08:34.827 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:08:34.827 INFO:teuthology.orchestra.run.smithi005.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T13:08:34.827 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-14T13:08:34.827 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-14T13:08:34.827 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:08:34.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:08:34.828 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T13:08:34.884 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-07-14T13:08:34.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:08:34.886 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-07-14T13:08:34.937 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-07-14T13:08:34.937 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T13:08:34.937 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-14T13:08:34.937 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-14T13:08:34.937 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-14T13:08:34.938 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T13:08:34.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:08:34.938 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-07-14T13:08:34.939 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-07-14T13:08:34.939 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-14T13:08:34.939 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-14T13:08:34.940 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-14T13:08:34.940 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-07-14T13:08:35.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:08:35.037 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-07-14T13:08:35.047 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-14T13:08:35.047 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-14T13:08:35.048 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T13:08:35.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:08:35.049 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-07-14T13:08:35.113 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T13:08:35.113 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-14T13:08:35.164 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-14T13:08:35.164 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T13:08:35.165 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-14T13:08:35.215 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-14T13:08:35.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:08:35.216 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:08:35.312 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:08:35.313 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T13:08:35.313 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T13:08:35.328 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:08:35.328 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T13:08:35.328 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T13:08:35.329 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T13:08:35.329 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T13:08:35.337 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:08:35.337 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T13:08:35.338 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T13:08:35.338 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T13:08:35.338 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T13:08:35.338 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790" 2023-07-14T13:08:35.338 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790:/ 2023-07-14T13:08:35.338 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=22affb8d-e389-40f8-a764-dd40eb1759c8" will pass to kernel 2023-07-14T13:08:35.341 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T13:08:35.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:08:35.342 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-14T13:08:35.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:08:35.364 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T13:08:35.419 INFO:teuthology.orchestra.run.smithi005.stdout:client6580 2023-07-14T13:08:35.419 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:08:35.419 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:08:35.472 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-14T13:08:35.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.628+0000 7f7e4d418640 1 Processor -- start 2023-07-14T13:08:35.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.628+0000 7f7e4d418640 1 -- start start 2023-07-14T13:08:35.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.628+0000 7f7e4d418640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e48158ce0 0x7f7e48070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:35.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.628+0000 7f7e4d418640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7e480c8ad0 0x7f7e480c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:35.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.628+0000 7f7e4d418640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7e480c9560 0x7f7e480cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:35.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.628+0000 7f7e4d418640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e480c99e0 con 0x7f7e480c9560 2023-07-14T13:08:35.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.628+0000 7f7e4d418640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e480cc700 con 0x7f7e480c8ad0 2023-07-14T13:08:35.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.628+0000 7f7e4d418640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e480b0ff0 con 0x7f7e48158ce0 2023-07-14T13:08:35.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.628+0000 7f7e477fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7e480c9560 0x7f7e480cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:35.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.628+0000 7f7e477fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7e480c9560 0x7f7e480cab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51904/0 (socket says 172.21.15.5:51904) 2023-07-14T13:08:35.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.628+0000 7f7e477fe640 1 -- 172.21.15.5:0/3331941293 learned_addr learned my addr 172.21.15.5:0/3331941293 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:35.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.628+0000 7f7e46ffd640 1 --2- 172.21.15.5:0/3331941293 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e48158ce0 0x7f7e48070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:35.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.628+0000 7f7e3ffff640 1 --2- 172.21.15.5:0/3331941293 >> v2:172.21.15.154:3300/0 conn(0x7f7e480c8ad0 0x7f7e480c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:35.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.628+0000 7f7e477fe640 1 -- 172.21.15.5:0/3331941293 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e48158ce0 msgr2=0x7f7e48070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:35.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.628+0000 7f7e477fe640 1 --2- 172.21.15.5:0/3331941293 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e48158ce0 0x7f7e48070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:35.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.628+0000 7f7e477fe640 1 -- 172.21.15.5:0/3331941293 >> v2:172.21.15.154:3300/0 conn(0x7f7e480c8ad0 msgr2=0x7f7e480c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:35.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.628+0000 7f7e477fe640 1 --2- 172.21.15.5:0/3331941293 >> v2:172.21.15.154:3300/0 conn(0x7f7e480c8ad0 0x7f7e480c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:35.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.628+0000 7f7e477fe640 1 -- 172.21.15.5:0/3331941293 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e48070c80 con 0x7f7e480c9560 2023-07-14T13:08:35.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.632+0000 7f7e477fe640 1 --2- 172.21.15.5:0/3331941293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e480c9560 0x7f7e480cab00 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f7e4806a6d0 tx=0x7f7e4001ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a77a0381d9b762 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:35.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.632+0000 7f7e467fc640 1 -- 172.21.15.5:0/3331941293 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4000b2d0 con 0x7f7e480c9560 2023-07-14T13:08:35.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.632+0000 7f7e467fc640 1 -- 172.21.15.5:0/3331941293 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4000b430 con 0x7f7e480c9560 2023-07-14T13:08:35.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.632+0000 7f7e467fc640 1 -- 172.21.15.5:0/3331941293 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e400a7a40 con 0x7f7e480c9560 2023-07-14T13:08:35.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.632+0000 7f7e4d418640 1 -- 172.21.15.5:0/3331941293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e480c9560 msgr2=0x7f7e480cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:35.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.632+0000 7f7e4d418640 1 --2- 172.21.15.5:0/3331941293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e480c9560 0x7f7e480cab00 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f7e4806a6d0 tx=0x7f7e4001ea80 comp rx=0 tx=0).stop 2023-07-14T13:08:35.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.632+0000 7f7e4d418640 1 -- 172.21.15.5:0/3331941293 shutdown_connections 2023-07-14T13:08:35.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.632+0000 7f7e4d418640 1 --2- 172.21.15.5:0/3331941293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e480c9560 0x7f7e480cab00 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:35.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.632+0000 7f7e4d418640 1 --2- 172.21.15.5:0/3331941293 >> v2:172.21.15.154:3300/0 conn(0x7f7e480c8ad0 0x7f7e480c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:35.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.632+0000 7f7e4d418640 1 --2- 172.21.15.5:0/3331941293 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e48158ce0 0x7f7e48070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:35.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.632+0000 7f7e4d418640 1 -- 172.21.15.5:0/3331941293 >> 172.21.15.5:0/3331941293 conn(0x7f7e480afcf0 msgr2=0x7f7e480b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:35.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.632+0000 7f7e4d418640 1 -- 172.21.15.5:0/3331941293 shutdown_connections 2023-07-14T13:08:35.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.632+0000 7f7e4d418640 1 -- 172.21.15.5:0/3331941293 wait complete. 2023-07-14T13:08:35.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.636+0000 7f7e4d418640 1 Processor -- start 2023-07-14T13:08:35.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.636+0000 7f7e4d418640 1 -- start start 2023-07-14T13:08:35.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.636+0000 7f7e4d418640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e480c8ad0 0x7f7e480c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:35.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.636+0000 7f7e4d418640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e480c9560 0x7f7e480c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:35.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.636+0000 7f7e4d418640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e48158ce0 0x7f7e4813e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:35.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.636+0000 7f7e4d418640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e48150160 con 0x7f7e480c9560 2023-07-14T13:08:35.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.636+0000 7f7e4d418640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4814fe50 con 0x7f7e480c8ad0 2023-07-14T13:08:35.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.636+0000 7f7e4d418640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4813f8c0 con 0x7f7e48158ce0 2023-07-14T13:08:35.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.636+0000 7f7e3ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e480c9560 0x7f7e480c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:35.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.636+0000 7f7e3ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e480c9560 0x7f7e480c5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51912/0 (socket says 172.21.15.5:51912) 2023-07-14T13:08:35.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.636+0000 7f7e3ffff640 1 -- 172.21.15.5:0/2024998393 learned_addr learned my addr 172.21.15.5:0/2024998393 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:35.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.636+0000 7f7e46ffd640 1 --2- 172.21.15.5:0/2024998393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e480c8ad0 0x7f7e480c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:35.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.636+0000 7f7e477fe640 1 --2- 172.21.15.5:0/2024998393 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e48158ce0 0x7f7e4813e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:35.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.636+0000 7f7e3ffff640 1 -- 172.21.15.5:0/2024998393 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e48158ce0 msgr2=0x7f7e4813e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:35.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.636+0000 7f7e3ffff640 1 --2- 172.21.15.5:0/2024998393 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e48158ce0 0x7f7e4813e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:35.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.636+0000 7f7e3ffff640 1 -- 172.21.15.5:0/2024998393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e480c8ad0 msgr2=0x7f7e480c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:35.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.636+0000 7f7e3ffff640 1 --2- 172.21.15.5:0/2024998393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e480c8ad0 0x7f7e480c5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:35.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.636+0000 7f7e3ffff640 1 -- 172.21.15.5:0/2024998393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4000bd40 con 0x7f7e480c9560 2023-07-14T13:08:35.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.636+0000 7f7e3ffff640 1 --2- 172.21.15.5:0/2024998393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e480c9560 0x7f7e480c5770 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000e870 tx=0x7f7e3000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:35.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.636+0000 7f7e3f7fe640 1 -- 172.21.15.5:0/2024998393 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e30009510 con 0x7f7e480c9560 2023-07-14T13:08:35.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.636+0000 7f7e3f7fe640 1 -- 172.21.15.5:0/2024998393 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3000eec0 con 0x7f7e480c9560 2023-07-14T13:08:35.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.636+0000 7f7e4d418640 1 -- 172.21.15.5:0/2024998393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e4813fba0 con 0x7f7e480c9560 2023-07-14T13:08:35.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.636+0000 7f7e3f7fe640 1 -- 172.21.15.5:0/2024998393 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3000cb40 con 0x7f7e480c9560 2023-07-14T13:08:35.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.636+0000 7f7e4d418640 1 -- 172.21.15.5:0/2024998393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e4814f140 con 0x7f7e480c9560 2023-07-14T13:08:35.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.640+0000 7f7e4d418640 1 -- 172.21.15.5:0/2024998393 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e480ca1a0 con 0x7f7e480c9560 2023-07-14T13:08:35.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.640+0000 7f7e3f7fe640 1 -- 172.21.15.5:0/2024998393 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7e3000cca0 con 0x7f7e480c9560 2023-07-14T13:08:35.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.640+0000 7f7e3f7fe640 1 --2- 172.21.15.5:0/2024998393 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f7e280663a0 0x7f7e28068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:35.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.640+0000 7f7e3f7fe640 1 -- 172.21.15.5:0/2024998393 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e30083e30 con 0x7f7e480c9560 2023-07-14T13:08:35.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.640+0000 7f7e46ffd640 1 --2- 172.21.15.5:0/2024998393 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f7e280663a0 0x7f7e28068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:35.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.640+0000 7f7e46ffd640 1 --2- 172.21.15.5:0/2024998393 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f7e280663a0 0x7f7e28068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7e480c8230 tx=0x7f7e38009190 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.644+0000 7f7e3f7fe640 1 -- 172.21.15.5:0/2024998393 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7e300512e0 con 0x7f7e480c9560 2023-07-14T13:08:35.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.824+0000 7f7e4d418640 1 -- 172.21.15.5:0/2024998393 --> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e48070990 con 0x7f7e280663a0 2023-07-14T13:08:35.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.828+0000 7f7e3f7fe640 1 -- 172.21.15.5:0/2024998393 <== mgr.5648 v2:172.21.15.154:6832/1874317247 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f7e38004040 con 0x7f7e280663a0 2023-07-14T13:08:35.860 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-07-14T13:08:35.861 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:08:35.861 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs" 2023-07-14T13:08:35.861 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:08:35.861 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-07-14T13:08:35.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.828+0000 7f7e4d418640 1 -- 172.21.15.5:0/2024998393 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f7e280663a0 msgr2=0x7f7e28068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:35.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.828+0000 7f7e4d418640 1 --2- 172.21.15.5:0/2024998393 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f7e280663a0 0x7f7e28068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7e480c8230 tx=0x7f7e38009190 comp rx=0 tx=0).stop 2023-07-14T13:08:35.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.828+0000 7f7e4d418640 1 -- 172.21.15.5:0/2024998393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e480c9560 msgr2=0x7f7e480c5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:35.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.828+0000 7f7e4d418640 1 --2- 172.21.15.5:0/2024998393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e480c9560 0x7f7e480c5770 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000e870 tx=0x7f7e3000ec70 comp rx=0 tx=0).stop 2023-07-14T13:08:35.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.828+0000 7f7e4d418640 1 -- 172.21.15.5:0/2024998393 shutdown_connections 2023-07-14T13:08:35.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.828+0000 7f7e4d418640 1 --2- 172.21.15.5:0/2024998393 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f7e280663a0 0x7f7e28068850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:35.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.828+0000 7f7e4d418640 1 --2- 172.21.15.5:0/2024998393 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e48158ce0 0x7f7e4813e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:35.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.828+0000 7f7e4d418640 1 --2- 172.21.15.5:0/2024998393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e480c9560 0x7f7e480c5770 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:35.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.828+0000 7f7e4d418640 1 --2- 172.21.15.5:0/2024998393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e480c8ad0 0x7f7e480c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:35.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.828+0000 7f7e4d418640 1 -- 172.21.15.5:0/2024998393 >> 172.21.15.5:0/2024998393 conn(0x7f7e480afcf0 msgr2=0x7f7e48070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:35.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.828+0000 7f7e4d418640 1 -- 172.21.15.5:0/2024998393 shutdown_connections 2023-07-14T13:08:35.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.828+0000 7f7e4d418640 1 -- 172.21.15.5:0/2024998393 wait complete. 2023-07-14T13:08:35.881 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-14T13:08:36.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.996+0000 7f3c62a5c640 1 Processor -- start 2023-07-14T13:08:36.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.996+0000 7f3c62a5c640 1 -- start start 2023-07-14T13:08:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.996+0000 7f3c62a5c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3c5c069430 0x7f3c5c15c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.996+0000 7f3c62a5c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5c15fa90 con 0x7f3c5c15bd50 2023-07-14T13:08:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.996+0000 7f3c62a5c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5c15fd70 con 0x7f3c5c06cc80 2023-07-14T13:08:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.996+0000 7f3c62a5c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c5c160050 con 0x7f3c5c069430 2023-07-14T13:08:36.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.996+0000 7f3c5b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3c5c15bd50 0x7f3c5c06fcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40258/0 (socket says 172.21.15.5:40258) 2023-07-14T13:08:36.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.996+0000 7f3c5b7fe640 1 -- 172.21.15.5:0/1779558374 learned_addr learned my addr 172.21.15.5:0/1779558374 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:36.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.996+0000 7f3c60ff9640 1 --2- 172.21.15.5:0/1779558374 >> v2:172.21.15.154:3300/0 conn(0x7f3c5c069430 0x7f3c5c15c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:35.996+0000 7f3c5affd640 1 -- 172.21.15.5:0/1779558374 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1984759053 0 0) 0x7f3c5c15fa90 con 0x7f3c5c15bd50 2023-07-14T13:08:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.000+0000 7f3c5affd640 1 -- 172.21.15.5:0/1779558374 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c44003530 con 0x7f3c5c15bd50 2023-07-14T13:08:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.000+0000 7f3c60ff9640 1 -- 172.21.15.5:0/1779558374 >> v1:172.21.15.154:6789/0 conn(0x7f3c5c06cc80 legacy=0x7f3c5c06d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.000+0000 7f3c5affd640 1 -- 172.21.15.5:0/1779558374 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2442351464 0 0) 0x7f3c44003530 con 0x7f3c5c15bd50 2023-07-14T13:08:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.000+0000 7f3c60ff9640 1 -- 172.21.15.5:0/1779558374 >> v1:172.21.15.5:6789/0 conn(0x7f3c5c15bd50 legacy=0x7f3c5c06fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.000+0000 7f3c60ff9640 1 -- 172.21.15.5:0/1779558374 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c160330 con 0x7f3c5c069430 2023-07-14T13:08:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.000+0000 7f3c60ff9640 1 --2- 172.21.15.5:0/1779558374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c5c069430 0x7f3c5c15c480 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3c54009d90 tx=0x7f3c5401c5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82196b1d9d2b6005 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.000+0000 7f3c5affd640 1 -- 172.21.15.5:0/1779558374 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c50001680 con 0x7f3c5c069430 2023-07-14T13:08:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.000+0000 7f3c5affd640 1 -- 172.21.15.5:0/1779558374 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c540a9410 con 0x7f3c5c069430 2023-07-14T13:08:36.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.000+0000 7f3c5affd640 1 -- 172.21.15.5:0/1779558374 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c540a97a0 con 0x7f3c5c069430 2023-07-14T13:08:36.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.004+0000 7f3c62a5c640 1 -- 172.21.15.5:0/1779558374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c5c069430 msgr2=0x7f3c5c15c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:36.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.004+0000 7f3c62a5c640 1 --2- 172.21.15.5:0/1779558374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c5c069430 0x7f3c5c15c480 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3c54009d90 tx=0x7f3c5401c5d0 comp rx=0 tx=0).stop 2023-07-14T13:08:36.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.004+0000 7f3c62a5c640 1 -- 172.21.15.5:0/1779558374 shutdown_connections 2023-07-14T13:08:36.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.004+0000 7f3c62a5c640 1 --2- 172.21.15.5:0/1779558374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c5c069430 0x7f3c5c15c480 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:36.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.004+0000 7f3c62a5c640 1 -- 172.21.15.5:0/1779558374 >> 172.21.15.5:0/1779558374 conn(0x7f3c5c0b0490 msgr2=0x7f3c5c0b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:36.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.004+0000 7f3c62a5c640 1 -- 172.21.15.5:0/1779558374 shutdown_connections 2023-07-14T13:08:36.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.004+0000 7f3c62a5c640 1 -- 172.21.15.5:0/1779558374 wait complete. 2023-07-14T13:08:36.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.004+0000 7f3c62a5c640 1 Processor -- start 2023-07-14T13:08:36.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.004+0000 7f3c62a5c640 1 -- start start 2023-07-14T13:08:36.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.004+0000 7f3c62a5c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c5c069430 0x7f3c5c0c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:36.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.004+0000 7f3c62a5c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c5c06cc80 0x7f3c5c1f7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:36.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.004+0000 7f3c62a5c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c5c15bd50 0x7f3c5c1f8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:36.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.004+0000 7f3c62a5c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c15b780 con 0x7f3c5c069430 2023-07-14T13:08:36.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.004+0000 7f3c62a5c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c0ca470 con 0x7f3c5c15bd50 2023-07-14T13:08:36.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.004+0000 7f3c62a5c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c0ca750 con 0x7f3c5c06cc80 2023-07-14T13:08:36.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.004+0000 7f3c5bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c5c069430 0x7f3c5c0c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:36.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.004+0000 7f3c5bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c5c069430 0x7f3c5c0c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51922/0 (socket says 172.21.15.5:51922) 2023-07-14T13:08:36.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.004+0000 7f3c5bfff640 1 -- 172.21.15.5:0/610580025 learned_addr learned my addr 172.21.15.5:0/610580025 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:36.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.004+0000 7f3c60ff9640 1 --2- 172.21.15.5:0/610580025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c5c15bd50 0x7f3c5c1f8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:36.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.004+0000 7f3c5b7fe640 1 --2- 172.21.15.5:0/610580025 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c5c06cc80 0x7f3c5c1f7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:36.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.004+0000 7f3c5bfff640 1 -- 172.21.15.5:0/610580025 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c5c06cc80 msgr2=0x7f3c5c1f7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:36.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.004+0000 7f3c5bfff640 1 --2- 172.21.15.5:0/610580025 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c5c06cc80 0x7f3c5c1f7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:36.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.004+0000 7f3c5bfff640 1 -- 172.21.15.5:0/610580025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c5c15bd50 msgr2=0x7f3c5c1f8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:36.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.004+0000 7f3c5bfff640 1 --2- 172.21.15.5:0/610580025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c5c15bd50 0x7f3c5c1f8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:36.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.004+0000 7f3c5bfff640 1 -- 172.21.15.5:0/610580025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c54009a70 con 0x7f3c5c069430 2023-07-14T13:08:36.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.004+0000 7f3c60ff9640 1 --2- 172.21.15.5:0/610580025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c5c15bd50 0x7f3c5c1f8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:36.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.004+0000 7f3c5bfff640 1 --2- 172.21.15.5:0/610580025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c5c069430 0x7f3c5c0c8800 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c00c780 tx=0x7f3c4c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:36.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.008+0000 7f3c58ff9640 1 -- 172.21.15.5:0/610580025 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c005270 con 0x7f3c5c069430 2023-07-14T13:08:36.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.008+0000 7f3c58ff9640 1 -- 172.21.15.5:0/610580025 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c0053d0 con 0x7f3c5c069430 2023-07-14T13:08:36.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.008+0000 7f3c58ff9640 1 -- 172.21.15.5:0/610580025 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c00a880 con 0x7f3c5c069430 2023-07-14T13:08:36.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.008+0000 7f3c62a5c640 1 -- 172.21.15.5:0/610580025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5c0ca120 con 0x7f3c5c069430 2023-07-14T13:08:36.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.008+0000 7f3c62a5c640 1 -- 172.21.15.5:0/610580025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5c0c7bf0 con 0x7f3c5c069430 2023-07-14T13:08:36.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.008+0000 7f3c62a5c640 1 -- 172.21.15.5:0/610580025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5c0b3cd0 con 0x7f3c5c069430 2023-07-14T13:08:36.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.008+0000 7f3c58ff9640 1 -- 172.21.15.5:0/610580025 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3c4c00a9e0 con 0x7f3c5c069430 2023-07-14T13:08:36.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.008+0000 7f3c58ff9640 1 --2- 172.21.15.5:0/610580025 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f3c480663a0 0x7f3c48068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:36.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.008+0000 7f3c58ff9640 1 -- 172.21.15.5:0/610580025 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3c4c0835b0 con 0x7f3c5c069430 2023-07-14T13:08:36.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.012+0000 7f3c5b7fe640 1 --2- 172.21.15.5:0/610580025 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f3c480663a0 0x7f3c48068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:36.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.012+0000 7f3c5b7fe640 1 --2- 172.21.15.5:0/610580025 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f3c480663a0 0x7f3c48068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c156570 tx=0x7f3c50009040 comp rx=0 tx=0).ready entity=mgr.5648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:36.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.012+0000 7f3c58ff9640 1 -- 172.21.15.5:0/610580025 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3c4c0509d0 con 0x7f3c5c069430 2023-07-14T13:08:36.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.204+0000 7f3c62a5c640 1 -- 172.21.15.5:0/610580025 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f3c5c0678d0 con 0x7f3c5c069430 2023-07-14T13:08:36.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.724+0000 7f3c58ff9640 1 -- 172.21.15.5:0/610580025 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 31) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f3c4c050da0 con 0x7f3c5c069430 2023-07-14T13:08:36.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.728+0000 7f3c58ff9640 1 -- 172.21.15.5:0/610580025 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v31) v1 ==== 92+0+0 (secure 0 0 0) 0x7f3c4c074250 con 0x7f3c5c069430 2023-07-14T13:08:36.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.728+0000 7f3c62a5c640 1 -- 172.21.15.5:0/610580025 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f3c480663a0 msgr2=0x7f3c48068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:36.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.728+0000 7f3c62a5c640 1 --2- 172.21.15.5:0/610580025 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f3c480663a0 0x7f3c48068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c156570 tx=0x7f3c50009040 comp rx=0 tx=0).stop 2023-07-14T13:08:36.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.728+0000 7f3c62a5c640 1 -- 172.21.15.5:0/610580025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c5c069430 msgr2=0x7f3c5c0c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:36.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.728+0000 7f3c62a5c640 1 --2- 172.21.15.5:0/610580025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c5c069430 0x7f3c5c0c8800 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c00c780 tx=0x7f3c4c00cc40 comp rx=0 tx=0).stop 2023-07-14T13:08:36.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.728+0000 7f3c62a5c640 1 -- 172.21.15.5:0/610580025 shutdown_connections 2023-07-14T13:08:36.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.728+0000 7f3c62a5c640 1 --2- 172.21.15.5:0/610580025 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f3c480663a0 0x7f3c48068850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:36.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.728+0000 7f3c62a5c640 1 --2- 172.21.15.5:0/610580025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c5c15bd50 0x7f3c5c1f8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:36.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.728+0000 7f3c62a5c640 1 --2- 172.21.15.5:0/610580025 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c5c06cc80 0x7f3c5c1f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:36.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.728+0000 7f3c62a5c640 1 --2- 172.21.15.5:0/610580025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c5c069430 0x7f3c5c0c8800 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:36.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.728+0000 7f3c62a5c640 1 -- 172.21.15.5:0/610580025 >> 172.21.15.5:0/610580025 conn(0x7f3c5c0b0490 msgr2=0x7f3c5c15d490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:36.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.728+0000 7f3c62a5c640 1 -- 172.21.15.5:0/610580025 shutdown_connections 2023-07-14T13:08:36.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.728+0000 7f3c62a5c640 1 -- 172.21.15.5:0/610580025 wait complete. 2023-07-14T13:08:36.787 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-14T13:08:36.933 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:36.905+0000 7fd9d7a0a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:08:36.952 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:36.920+0000 7f9768b3f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:08:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.920+0000 7f9462574640 1 Processor -- start 2023-07-14T13:08:36.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.920+0000 7f9462574640 1 -- start start 2023-07-14T13:08:36.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.920+0000 7f9462574640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f945c15bde0 0x7f945c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:36.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.920+0000 7f9462574640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f945c0d2300 0x7f945c0d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:36.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.920+0000 7f9462574640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f945c0b04c0 con 0x7f945c0d2fc0 2023-07-14T13:08:36.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.920+0000 7f9462574640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f945c15c1b0 con 0x7f945c15bde0 2023-07-14T13:08:36.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.920+0000 7f9462574640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f945c0d2cc0 con 0x7f945c0d2300 2023-07-14T13:08:36.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.920+0000 7f945b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f945c0d2fc0 0x7f945c0b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40274/0 (socket says 172.21.15.5:40274) 2023-07-14T13:08:36.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.920+0000 7f945b7fe640 1 -- 172.21.15.5:0/2142560879 learned_addr learned my addr 172.21.15.5:0/2142560879 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:36.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.920+0000 7f9460b11640 1 --2- 172.21.15.5:0/2142560879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f945c0d2300 0x7f945c0d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:36.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.920+0000 7f945bfff640 1 --2- 172.21.15.5:0/2142560879 >> v2:172.21.15.154:3300/0 conn(0x7f945c15bde0 0x7f945c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:36.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.920+0000 7f945affd640 1 -- 172.21.15.5:0/2142560879 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1853666924 0 0) 0x7f945c0b04c0 con 0x7f945c0d2fc0 2023-07-14T13:08:36.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.920+0000 7f945affd640 1 -- 172.21.15.5:0/2142560879 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9444003530 con 0x7f945c0d2fc0 2023-07-14T13:08:36.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.920+0000 7f9460b11640 1 -- 172.21.15.5:0/2142560879 >> v2:172.21.15.154:3300/0 conn(0x7f945c15bde0 msgr2=0x7f945c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:36.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.920+0000 7f9460b11640 1 --2- 172.21.15.5:0/2142560879 >> v2:172.21.15.154:3300/0 conn(0x7f945c15bde0 0x7f945c0d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:36.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.920+0000 7f9460b11640 1 -- 172.21.15.5:0/2142560879 >> v1:172.21.15.5:6789/0 conn(0x7f945c0d2fc0 legacy=0x7f945c0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:36.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.920+0000 7f9460b11640 1 -- 172.21.15.5:0/2142560879 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c0b1060 con 0x7f945c0d2300 2023-07-14T13:08:36.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.924+0000 7f9460b11640 1 --2- 172.21.15.5:0/2142560879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f945c0d2300 0x7f945c0d2780 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9454009d90 tx=0x7f945401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45fde006a50763c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.924+0000 7f945affd640 1 -- 172.21.15.5:0/2142560879 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94540a5920 con 0x7f945c0d2300 2023-07-14T13:08:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.924+0000 7f945affd640 1 -- 172.21.15.5:0/2142560879 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94540a5a80 con 0x7f945c0d2300 2023-07-14T13:08:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.924+0000 7f945affd640 1 -- 172.21.15.5:0/2142560879 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94540a5e10 con 0x7f945c0d2300 2023-07-14T13:08:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.924+0000 7f9462574640 1 -- 172.21.15.5:0/2142560879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f945c0d2300 msgr2=0x7f945c0d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.924+0000 7f9462574640 1 --2- 172.21.15.5:0/2142560879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f945c0d2300 0x7f945c0d2780 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9454009d90 tx=0x7f945401c950 comp rx=0 tx=0).stop 2023-07-14T13:08:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.924+0000 7f9462574640 1 -- 172.21.15.5:0/2142560879 shutdown_connections 2023-07-14T13:08:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.924+0000 7f9462574640 1 --2- 172.21.15.5:0/2142560879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f945c0d2300 0x7f945c0d2780 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:36.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.924+0000 7f9462574640 1 --2- 172.21.15.5:0/2142560879 >> v2:172.21.15.154:3300/0 conn(0x7f945c15bde0 0x7f945c0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.924+0000 7f9462574640 1 -- 172.21.15.5:0/2142560879 >> 172.21.15.5:0/2142560879 conn(0x7f945c0659d0 msgr2=0x7f945c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.924+0000 7f9462574640 1 -- 172.21.15.5:0/2142560879 shutdown_connections 2023-07-14T13:08:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.924+0000 7f9462574640 1 -- 172.21.15.5:0/2142560879 wait complete. 2023-07-14T13:08:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.928+0000 7f9462574640 1 Processor -- start 2023-07-14T13:08:36.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.928+0000 7f9462574640 1 -- start start 2023-07-14T13:08:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.928+0000 7f9462574640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f945c0d2300 0x7f945c1574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:36.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.928+0000 7f9462574640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f945c0d2fc0 0x7f945c0c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:36.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.928+0000 7f9462574640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f945c15bde0 0x7f945c0c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:36.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.928+0000 7f9462574640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c1f4c10 con 0x7f945c0d2fc0 2023-07-14T13:08:36.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.928+0000 7f9462574640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c0c8c00 con 0x7f945c15bde0 2023-07-14T13:08:36.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.928+0000 7f9462574640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f945c0b11f0 con 0x7f945c0d2300 2023-07-14T13:08:36.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.928+0000 7f945b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f945c0d2fc0 0x7f945c0c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:36.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.928+0000 7f945b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f945c0d2fc0 0x7f945c0c80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51936/0 (socket says 172.21.15.5:51936) 2023-07-14T13:08:36.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.928+0000 7f945b7fe640 1 -- 172.21.15.5:0/2072727102 learned_addr learned my addr 172.21.15.5:0/2072727102 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:36.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.928+0000 7f945bfff640 1 --2- 172.21.15.5:0/2072727102 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f945c0d2300 0x7f945c1574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:36.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.928+0000 7f9460b11640 1 --2- 172.21.15.5:0/2072727102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f945c15bde0 0x7f945c0c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.928+0000 7f945b7fe640 1 -- 172.21.15.5:0/2072727102 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f945c0d2300 msgr2=0x7f945c1574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.928+0000 7f945b7fe640 1 --2- 172.21.15.5:0/2072727102 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f945c0d2300 0x7f945c1574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.928+0000 7f945b7fe640 1 -- 172.21.15.5:0/2072727102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f945c15bde0 msgr2=0x7f945c0c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.928+0000 7f945b7fe640 1 --2- 172.21.15.5:0/2072727102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f945c15bde0 0x7f945c0c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:36.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.928+0000 7f945b7fe640 1 -- 172.21.15.5:0/2072727102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9454009a70 con 0x7f945c0d2fc0 2023-07-14T13:08:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.928+0000 7f945b7fe640 1 --2- 172.21.15.5:0/2072727102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f945c0d2fc0 0x7f945c0c80b0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f945000c390 tx=0x7f945000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.928+0000 7f9458ff9640 1 -- 172.21.15.5:0/2072727102 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9450005cf0 con 0x7f945c0d2fc0 2023-07-14T13:08:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.928+0000 7f9458ff9640 1 -- 172.21.15.5:0/2072727102 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9450005e70 con 0x7f945c0d2fc0 2023-07-14T13:08:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.928+0000 7f9458ff9640 1 -- 172.21.15.5:0/2072727102 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94500072f0 con 0x7f945c0d2fc0 2023-07-14T13:08:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.932+0000 7f9462574640 1 -- 172.21.15.5:0/2072727102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f945c0b14d0 con 0x7f945c0d2fc0 2023-07-14T13:08:36.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.932+0000 7f9462574640 1 -- 172.21.15.5:0/2072727102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f945c0b1a90 con 0x7f945c0d2fc0 2023-07-14T13:08:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.932+0000 7f9462574640 1 -- 172.21.15.5:0/2072727102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f945c0b1c80 con 0x7f945c0d2fc0 2023-07-14T13:08:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.932+0000 7f9458ff9640 1 -- 172.21.15.5:0/2072727102 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 31) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f9450007450 con 0x7f945c0d2fc0 2023-07-14T13:08:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.932+0000 7f9458ff9640 1 --2- 172.21.15.5:0/2072727102 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f94480663f0 0x7f94480688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:36.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.932+0000 7f9458ff9640 1 -- 172.21.15.5:0/2072727102 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9450083470 con 0x7f945c0d2fc0 2023-07-14T13:08:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.932+0000 7f945bfff640 1 -- 172.21.15.5:0/2072727102 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f94480663f0 msgr2=0x7f94480688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1874317247 2023-07-14T13:08:36.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.932+0000 7f945bfff640 1 --2- 172.21.15.5:0/2072727102 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f94480663f0 0x7f94480688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:08:36.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:36.936+0000 7f9458ff9640 1 -- 172.21.15.5:0/2072727102 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9450050950 con 0x7f945c0d2fc0 2023-07-14T13:08:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.092+0000 7f9462574640 1 -- 172.21.15.5:0/2072727102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f945c0d0780 con 0x7f945c0d2fc0 2023-07-14T13:08:37.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.100+0000 7f9458ff9640 1 -- 172.21.15.5:0/2072727102 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9450053f70 con 0x7f945c0d2fc0 2023-07-14T13:08:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.100+0000 7f9462574640 1 -- 172.21.15.5:0/2072727102 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f94480663f0 msgr2=0x7f94480688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:08:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.100+0000 7f9462574640 1 --2- 172.21.15.5:0/2072727102 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f94480663f0 0x7f94480688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.100+0000 7f9462574640 1 -- 172.21.15.5:0/2072727102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f945c0d2fc0 msgr2=0x7f945c0c80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:37.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.100+0000 7f9462574640 1 --2- 172.21.15.5:0/2072727102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f945c0d2fc0 0x7f945c0c80b0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f945000c390 tx=0x7f945000c850 comp rx=0 tx=0).stop 2023-07-14T13:08:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.100+0000 7f9462574640 1 -- 172.21.15.5:0/2072727102 shutdown_connections 2023-07-14T13:08:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.100+0000 7f9462574640 1 --2- 172.21.15.5:0/2072727102 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f94480663f0 0x7f94480688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.100+0000 7f9462574640 1 --2- 172.21.15.5:0/2072727102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f945c15bde0 0x7f945c0c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.100+0000 7f9462574640 1 --2- 172.21.15.5:0/2072727102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f945c0d2fc0 0x7f945c0c80b0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.100+0000 7f9462574640 1 --2- 172.21.15.5:0/2072727102 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f945c0d2300 0x7f945c1574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.100+0000 7f9462574640 1 -- 172.21.15.5:0/2072727102 >> 172.21.15.5:0/2072727102 conn(0x7f945c0659d0 msgr2=0x7f945c0b71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.100+0000 7f9462574640 1 -- 172.21.15.5:0/2072727102 shutdown_connections 2023-07-14T13:08:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.100+0000 7f9462574640 1 -- 172.21.15.5:0/2072727102 wait complete. 2023-07-14T13:08:37.155 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-14T13:08:37.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.272+0000 7f4f63e7b640 1 Processor -- start 2023-07-14T13:08:37.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.272+0000 7f4f63e7b640 1 -- start start 2023-07-14T13:08:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.272+0000 7f4f63e7b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4f5c0d2fc0 0x7f4f5c0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.272+0000 7f4f63e7b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4f5c0d2300 0x7f4f5c0d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.272+0000 7f4f63e7b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f5c0b04c0 con 0x7f4f5c15bde0 2023-07-14T13:08:37.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.272+0000 7f4f63e7b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5c15c1b0 con 0x7f4f5c0d2300 2023-07-14T13:08:37.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.272+0000 7f4f63e7b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5c0d2c80 con 0x7f4f5c0d2fc0 2023-07-14T13:08:37.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.272+0000 7f4f62418640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4f5c0d2300 0x7f4f5c0d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:37.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.272+0000 7f4f62418640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4f5c0d2300 0x7f4f5c0d2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51950/0 (socket says 172.21.15.5:51950) 2023-07-14T13:08:37.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.272+0000 7f4f62418640 1 -- 172.21.15.5:0/827026560 learned_addr learned my addr 172.21.15.5:0/827026560 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:37.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.272+0000 7f4f61416640 1 --2- 172.21.15.5:0/827026560 >> v2:172.21.15.154:3300/0 conn(0x7f4f5c0d2fc0 0x7f4f5c0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:37.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.272+0000 7f4f62418640 1 -- 172.21.15.5:0/827026560 >> v2:172.21.15.154:3300/0 conn(0x7f4f5c0d2fc0 msgr2=0x7f4f5c0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:37.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.272+0000 7f4f62418640 1 --2- 172.21.15.5:0/827026560 >> v2:172.21.15.154:3300/0 conn(0x7f4f5c0d2fc0 0x7f4f5c0b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.272+0000 7f4f62418640 1 -- 172.21.15.5:0/827026560 >> v1:172.21.15.154:6789/0 conn(0x7f4f5c15bde0 legacy=0x7f4f5c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:37.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.272+0000 7f4f62418640 1 -- 172.21.15.5:0/827026560 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c0d0aa0 con 0x7f4f5c0d2300 2023-07-14T13:08:37.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.276+0000 7f4f62418640 1 --2- 172.21.15.5:0/827026560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f5c0d2300 0x7f4f5c0d2740 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c08c600 tx=0x7f4f5401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6695f811654c1962 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:37.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.276+0000 7f4f60c15640 1 -- 172.21.15.5:0/827026560 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f540a5890 con 0x7f4f5c0d2300 2023-07-14T13:08:37.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.276+0000 7f4f60c15640 1 -- 172.21.15.5:0/827026560 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f540a59f0 con 0x7f4f5c0d2300 2023-07-14T13:08:37.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.276+0000 7f4f60c15640 1 -- 172.21.15.5:0/827026560 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f540a5d80 con 0x7f4f5c0d2300 2023-07-14T13:08:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.276+0000 7f4f63e7b640 1 -- 172.21.15.5:0/827026560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f5c0d2300 msgr2=0x7f4f5c0d2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.276+0000 7f4f63e7b640 1 --2- 172.21.15.5:0/827026560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f5c0d2300 0x7f4f5c0d2740 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c08c600 tx=0x7f4f5401c9d0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.276+0000 7f4f63e7b640 1 -- 172.21.15.5:0/827026560 shutdown_connections 2023-07-14T13:08:37.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.276+0000 7f4f63e7b640 1 --2- 172.21.15.5:0/827026560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f5c0d2300 0x7f4f5c0d2740 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.276+0000 7f4f63e7b640 1 --2- 172.21.15.5:0/827026560 >> v2:172.21.15.154:3300/0 conn(0x7f4f5c0d2fc0 0x7f4f5c0b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.276+0000 7f4f63e7b640 1 -- 172.21.15.5:0/827026560 >> 172.21.15.5:0/827026560 conn(0x7f4f5c0659d0 msgr2=0x7f4f5c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:37.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.276+0000 7f4f63e7b640 1 -- 172.21.15.5:0/827026560 shutdown_connections 2023-07-14T13:08:37.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.276+0000 7f4f63e7b640 1 -- 172.21.15.5:0/827026560 wait complete. 2023-07-14T13:08:37.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.280+0000 7f4f63e7b640 1 Processor -- start 2023-07-14T13:08:37.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.280+0000 7f4f63e7b640 1 -- start start 2023-07-14T13:08:37.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.280+0000 7f4f63e7b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f5c0d2300 0x7f4f5c154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:37.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.280+0000 7f4f63e7b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f5c0d2fc0 0x7f4f5c0cee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:37.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.280+0000 7f4f63e7b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f5c15bde0 0x7f4f5c0cf380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:37.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.280+0000 7f4f63e7b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c15dc10 con 0x7f4f5c0d2fc0 2023-07-14T13:08:37.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.280+0000 7f4f63e7b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c15def0 con 0x7f4f5c15bde0 2023-07-14T13:08:37.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.280+0000 7f4f63e7b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c15e1d0 con 0x7f4f5c0d2300 2023-07-14T13:08:37.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.280+0000 7f4f61416640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f5c0d2fc0 0x7f4f5c0cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:37.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.280+0000 7f4f61c17640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f5c0d2300 0x7f4f5c154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:37.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.280+0000 7f4f61416640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f5c0d2fc0 0x7f4f5c0cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51966/0 (socket says 172.21.15.5:51966) 2023-07-14T13:08:37.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.280+0000 7f4f61416640 1 -- 172.21.15.5:0/1142895264 learned_addr learned my addr 172.21.15.5:0/1142895264 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:37.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.280+0000 7f4f62418640 1 --2- 172.21.15.5:0/1142895264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f5c15bde0 0x7f4f5c0cf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:37.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.280+0000 7f4f61416640 1 -- 172.21.15.5:0/1142895264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f5c0d2300 msgr2=0x7f4f5c154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:37.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.280+0000 7f4f61416640 1 --2- 172.21.15.5:0/1142895264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f5c0d2300 0x7f4f5c154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.280+0000 7f4f61416640 1 -- 172.21.15.5:0/1142895264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f5c15bde0 msgr2=0x7f4f5c0cf380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:37.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.280+0000 7f4f61416640 1 --2- 172.21.15.5:0/1142895264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f5c15bde0 0x7f4f5c0cf380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.280+0000 7f4f61416640 1 -- 172.21.15.5:0/1142895264 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f54009b30 con 0x7f4f5c0d2fc0 2023-07-14T13:08:37.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.280+0000 7f4f61416640 1 --2- 172.21.15.5:0/1142895264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f5c0d2fc0 0x7f4f5c0cee40 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00e900 tx=0x7f4f4c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:37.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.280+0000 7f4f527fc640 1 -- 172.21.15.5:0/1142895264 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c009690 con 0x7f4f5c0d2fc0 2023-07-14T13:08:37.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.280+0000 7f4f527fc640 1 -- 172.21.15.5:0/1142895264 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4c00ca00 con 0x7f4f5c0d2fc0 2023-07-14T13:08:37.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.280+0000 7f4f527fc640 1 -- 172.21.15.5:0/1142895264 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c00cdb0 con 0x7f4f5c0d2fc0 2023-07-14T13:08:37.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.280+0000 7f4f63e7b640 1 -- 172.21.15.5:0/1142895264 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f5c0b1a60 con 0x7f4f5c0d2fc0 2023-07-14T13:08:37.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.280+0000 7f4f63e7b640 1 -- 172.21.15.5:0/1142895264 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5c1545c0 con 0x7f4f5c0d2fc0 2023-07-14T13:08:37.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.284+0000 7f4f63e7b640 1 -- 172.21.15.5:0/1142895264 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f5c0678d0 con 0x7f4f5c0d2fc0 2023-07-14T13:08:37.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.284+0000 7f4f527fc640 1 -- 172.21.15.5:0/1142895264 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 31) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f4f4c013470 con 0x7f4f5c0d2fc0 2023-07-14T13:08:37.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.284+0000 7f4f527fc640 1 --2- 172.21.15.5:0/1142895264 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f4f400663f0 0x7f4f400688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:37.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.284+0000 7f4f527fc640 1 -- 172.21.15.5:0/1142895264 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4f4c084050 con 0x7f4f5c0d2fc0 2023-07-14T13:08:37.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.284+0000 7f4f61c17640 1 -- 172.21.15.5:0/1142895264 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f4f400663f0 msgr2=0x7f4f400688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1874317247 2023-07-14T13:08:37.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.284+0000 7f4f61c17640 1 --2- 172.21.15.5:0/1142895264 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f4f400663f0 0x7f4f400688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:08:37.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.288+0000 7f4f527fc640 1 -- 172.21.15.5:0/1142895264 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4f4c051500 con 0x7f4f5c0d2fc0 2023-07-14T13:08:37.354 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:37.325+0000 7fd9d7a0a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:08:37.401 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:37.368+0000 7f9768b3f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:08:37.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.448+0000 7f4f63e7b640 1 -- 172.21.15.5:0/1142895264 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f4f5c065e80 con 0x7f4f5c0d2fc0 2023-07-14T13:08:37.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.452+0000 7f4f527fc640 1 -- 172.21.15.5:0/1142895264 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v24)=0 v24) v1 ==== 133+0+0 (secure 0 0 0) 0x7f4f4c054b20 con 0x7f4f5c0d2fc0 2023-07-14T13:08:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.452+0000 7f4f63e7b640 1 -- 172.21.15.5:0/1142895264 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f4f400663f0 msgr2=0x7f4f400688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:08:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.452+0000 7f4f63e7b640 1 --2- 172.21.15.5:0/1142895264 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f4f400663f0 0x7f4f400688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.452+0000 7f4f63e7b640 1 -- 172.21.15.5:0/1142895264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f5c0d2fc0 msgr2=0x7f4f5c0cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.452+0000 7f4f63e7b640 1 --2- 172.21.15.5:0/1142895264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f5c0d2fc0 0x7f4f5c0cee40 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00e900 tx=0x7f4f4c00edc0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.456+0000 7f4f63e7b640 1 -- 172.21.15.5:0/1142895264 shutdown_connections 2023-07-14T13:08:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.456+0000 7f4f63e7b640 1 --2- 172.21.15.5:0/1142895264 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f4f400663f0 0x7f4f400688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.456+0000 7f4f63e7b640 1 --2- 172.21.15.5:0/1142895264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f5c15bde0 0x7f4f5c0cf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.456+0000 7f4f63e7b640 1 --2- 172.21.15.5:0/1142895264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f5c0d2fc0 0x7f4f5c0cee40 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.456+0000 7f4f63e7b640 1 --2- 172.21.15.5:0/1142895264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f5c0d2300 0x7f4f5c154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.456+0000 7f4f63e7b640 1 -- 172.21.15.5:0/1142895264 >> 172.21.15.5:0/1142895264 conn(0x7f4f5c0659d0 msgr2=0x7f4f5c0cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.456+0000 7f4f63e7b640 1 -- 172.21.15.5:0/1142895264 shutdown_connections 2023-07-14T13:08:37.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.456+0000 7f4f63e7b640 1 -- 172.21.15.5:0/1142895264 wait complete. 2023-07-14T13:08:37.507 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:37.477+0000 7fd9d7a0a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:08:37.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:08:37.508 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-14T13:08:37.525 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-07-14T13:08:37.562 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:37.528+0000 7f9768b3f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:08:37.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.676+0000 7f635140b640 1 Processor -- start 2023-07-14T13:08:37.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.676+0000 7f635140b640 1 -- start start 2023-07-14T13:08:37.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.680+0000 7f635140b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f634c15bde0 0x7f634c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:37.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.680+0000 7f635140b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f634c0d2300 0x7f634c0d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:37.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.680+0000 7f635140b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634c0b04c0 con 0x7f634c0d2fc0 2023-07-14T13:08:37.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.680+0000 7f635140b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634c15c1b0 con 0x7f634c15bde0 2023-07-14T13:08:37.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.680+0000 7f635140b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0d2cc0 con 0x7f634c0d2300 2023-07-14T13:08:37.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.680+0000 7f634affd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f634c15bde0 0x7f634c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:37.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.680+0000 7f634b7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f634c0d2300 0x7f634c0d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:37.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.680+0000 7f634affd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f634c15bde0 0x7f634c0d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:46460/0 (socket says 172.21.15.5:46460) 2023-07-14T13:08:37.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.680+0000 7f634a7fc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f634c0d2fc0 0x7f634c0b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:42000/0 (socket says 172.21.15.5:42000) 2023-07-14T13:08:37.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.680+0000 7f634affd640 1 -- 172.21.15.5:0/1650860758 learned_addr learned my addr 172.21.15.5:0/1650860758 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:37.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.680+0000 7f6349ffb640 1 -- 172.21.15.5:0/1650860758 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2641693474 0 0) 0x7f634c0b04c0 con 0x7f634c0d2fc0 2023-07-14T13:08:37.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.680+0000 7f634affd640 1 -- 172.21.15.5:0/1650860758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f634c0d2300 msgr2=0x7f634c0d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:37.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.680+0000 7f634affd640 1 --2- 172.21.15.5:0/1650860758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f634c0d2300 0x7f634c0d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.680+0000 7f634affd640 1 -- 172.21.15.5:0/1650860758 >> v1:172.21.15.154:6789/0 conn(0x7f634c0d2fc0 legacy=0x7f634c0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:37.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.680+0000 7f634affd640 1 -- 172.21.15.5:0/1650860758 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c0b1060 con 0x7f634c15bde0 2023-07-14T13:08:37.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.680+0000 7f634b7fe640 1 --2- 172.21.15.5:0/1650860758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f634c0d2300 0x7f634c0d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:37.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.684+0000 7f634affd640 1 --2- 172.21.15.5:0/1650860758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f634c15bde0 0x7f634c0d0270 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f633c006fd0 tx=0x7f633c01c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb58aa9e06f2f908 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:37.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.684+0000 7f6349ffb640 1 -- 172.21.15.5:0/1650860758 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c0a7070 con 0x7f634c15bde0 2023-07-14T13:08:37.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.684+0000 7f6349ffb640 1 -- 172.21.15.5:0/1650860758 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c0ab430 con 0x7f634c15bde0 2023-07-14T13:08:37.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.684+0000 7f6349ffb640 1 -- 172.21.15.5:0/1650860758 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c0ab7c0 con 0x7f634c15bde0 2023-07-14T13:08:37.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.684+0000 7f635140b640 1 -- 172.21.15.5:0/1650860758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f634c15bde0 msgr2=0x7f634c0d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:37.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.684+0000 7f635140b640 1 --2- 172.21.15.5:0/1650860758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f634c15bde0 0x7f634c0d0270 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f633c006fd0 tx=0x7f633c01c520 comp rx=0 tx=0).stop 2023-07-14T13:08:37.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.684+0000 7f635140b640 1 -- 172.21.15.5:0/1650860758 shutdown_connections 2023-07-14T13:08:37.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.684+0000 7f635140b640 1 --2- 172.21.15.5:0/1650860758 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f634c0d2300 0x7f634c0d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.684+0000 7f635140b640 1 --2- 172.21.15.5:0/1650860758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f634c15bde0 0x7f634c0d0270 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.684+0000 7f635140b640 1 -- 172.21.15.5:0/1650860758 >> 172.21.15.5:0/1650860758 conn(0x7f634c0659d0 msgr2=0x7f634c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:37.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.684+0000 7f635140b640 1 -- 172.21.15.5:0/1650860758 shutdown_connections 2023-07-14T13:08:37.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.684+0000 7f635140b640 1 -- 172.21.15.5:0/1650860758 wait complete. 2023-07-14T13:08:37.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.684+0000 7f635140b640 1 Processor -- start 2023-07-14T13:08:37.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.684+0000 7f635140b640 1 -- start start 2023-07-14T13:08:37.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.688+0000 7f635140b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f634c0d2300 0x7f634c14f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:37.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.688+0000 7f635140b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f634c0d2fc0 0x7f634c153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:37.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.688+0000 7f635140b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f634c15bde0 0x7f634c154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:37.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.688+0000 7f635140b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c1523e0 con 0x7f634c0d2300 2023-07-14T13:08:37.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.688+0000 7f635140b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c152630 con 0x7f634c0d2fc0 2023-07-14T13:08:37.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.688+0000 7f635140b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c152910 con 0x7f634c15bde0 2023-07-14T13:08:37.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.688+0000 7f634affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f634c0d2300 0x7f634c14f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:37.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.688+0000 7f634a7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f634c0d2fc0 0x7f634c153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:37.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.688+0000 7f634affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f634c0d2300 0x7f634c14f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51978/0 (socket says 172.21.15.5:51978) 2023-07-14T13:08:37.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.688+0000 7f634affd640 1 -- 172.21.15.5:0/1317796784 learned_addr learned my addr 172.21.15.5:0/1317796784 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:37.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.688+0000 7f634b7fe640 1 --2- 172.21.15.5:0/1317796784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f634c15bde0 0x7f634c154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:37.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.688+0000 7f634a7fc640 1 -- 172.21.15.5:0/1317796784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f634c15bde0 msgr2=0x7f634c154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:37.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.688+0000 7f634a7fc640 1 --2- 172.21.15.5:0/1317796784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f634c15bde0 0x7f634c154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.688+0000 7f634a7fc640 1 -- 172.21.15.5:0/1317796784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f634c0d2300 msgr2=0x7f634c14f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:37.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.688+0000 7f634a7fc640 1 --2- 172.21.15.5:0/1317796784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f634c0d2300 0x7f634c14f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.688+0000 7f634a7fc640 1 -- 172.21.15.5:0/1317796784 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6344009a70 con 0x7f634c0d2fc0 2023-07-14T13:08:37.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.688+0000 7f634affd640 1 --2- 172.21.15.5:0/1317796784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f634c0d2300 0x7f634c14f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:37.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.688+0000 7f634a7fc640 1 --2- 172.21.15.5:0/1317796784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f634c0d2fc0 0x7f634c153d10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f634000c3e0 tx=0x7f634000c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:37.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.688+0000 7f63337fe640 1 -- 172.21.15.5:0/1317796784 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63400074e0 con 0x7f634c0d2fc0 2023-07-14T13:08:37.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.688+0000 7f63337fe640 1 -- 172.21.15.5:0/1317796784 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6340007660 con 0x7f634c0d2fc0 2023-07-14T13:08:37.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.688+0000 7f63337fe640 1 -- 172.21.15.5:0/1317796784 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6340004a30 con 0x7f634c0d2fc0 2023-07-14T13:08:37.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.688+0000 7f635140b640 1 -- 172.21.15.5:0/1317796784 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633c009480 con 0x7f634c0d2fc0 2023-07-14T13:08:37.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.688+0000 7f635140b640 1 -- 172.21.15.5:0/1317796784 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634c152ed0 con 0x7f634c0d2fc0 2023-07-14T13:08:37.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.688+0000 7f635140b640 1 -- 172.21.15.5:0/1317796784 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634c0678d0 con 0x7f634c0d2fc0 2023-07-14T13:08:37.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.688+0000 7f63337fe640 1 -- 172.21.15.5:0/1317796784 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 31) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f6340004b90 con 0x7f634c0d2fc0 2023-07-14T13:08:37.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.692+0000 7f63337fe640 1 --2- 172.21.15.5:0/1317796784 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f63380663f0 0x7f63380688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:37.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.692+0000 7f63337fe640 1 -- 172.21.15.5:0/1317796784 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6340083b80 con 0x7f634c0d2fc0 2023-07-14T13:08:37.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.692+0000 7f634affd640 1 -- 172.21.15.5:0/1317796784 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f63380663f0 msgr2=0x7f63380688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1874317247 2023-07-14T13:08:37.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.692+0000 7f634affd640 1 --2- 172.21.15.5:0/1317796784 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f63380663f0 0x7f63380688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:08:37.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.696+0000 7f63337fe640 1 -- 172.21.15.5:0/1317796784 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6340050f10 con 0x7f634c0d2fc0 2023-07-14T13:08:37.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.871+0000 7f635140b640 1 -- 172.21.15.5:0/1317796784 --> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f634c0d07b0 con 0x7f63380663f0 2023-07-14T13:08:37.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.895+0000 7f634affd640 1 -- 172.21.15.5:0/1317796784 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f63380663f0 msgr2=0x7f63380688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1874317247 2023-07-14T13:08:37.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:37.895+0000 7f634affd640 1 --2- 172.21.15.5:0/1317796784 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f63380663f0 0x7f63380688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-14T13:08:37.990 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:37.961+0000 7fd9d7a0a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:08:38.051 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:38.021+0000 7fd9d7a0a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:08:38.076 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:38.039+0000 7f9768b3f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:08:38.107 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:38.077+0000 7fd9d7a0a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:08:38.137 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:38.103+0000 7f9768b3f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:08:38.193 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:38.165+0000 7fd9d7a0a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:08:38.196 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:38.163+0000 7f9768b3f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:08:38.253 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:38.225+0000 7fd9d7a0a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:08:38.287 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:38.251+0000 7f9768b3f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:08:38.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:38.299+0000 7f634affd640 1 -- 172.21.15.5:0/1317796784 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f63380663f0 msgr2=0x7f63380688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1874317247 2023-07-14T13:08:38.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:38.299+0000 7f634affd640 1 --2- 172.21.15.5:0/1317796784 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f63380663f0 0x7f63380688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-14T13:08:38.337 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:38.309+0000 7fd9d7a0a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:08:38.347 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:38.311+0000 7f9768b3f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:08:38.394 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:38.365+0000 7fd9d7a0a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:08:38.435 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:38.399+0000 7f9768b3f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:08:38.494 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:38.459+0000 7f9768b3f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:08:38.537 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:38.509+0000 7fd9d7a0a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:08:38.595 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:38.565+0000 7fd9d7a0a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:08:38.644 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:38.611+0000 7f9768b3f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:08:38.705 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:38.671+0000 7f9768b3f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:08:38.836 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:08:38.836 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:08:38.837 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:08:38.844 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:38.813+0000 7fd9d7a0a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:08:38.956 INFO:tasks.ceph.mgr.y.smithi005.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:08:38.956 INFO:tasks.ceph.mgr.y.smithi005.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:08:38.956 INFO:tasks.ceph.mgr.y.smithi005.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:08:38.964 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:38.931+0000 7f9768b3f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:08:38.981 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:38.953+0000 7fd9d7a0a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:08:39.104 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:39.071+0000 7f9768b3f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:08:39.106 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:39.077+0000 7fd9d7a0a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:08:39.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:39.103+0000 7f634affd640 1 -- 172.21.15.5:0/1317796784 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f63380663f0 msgr2=0x7f63380688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1874317247 2023-07-14T13:08:39.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:39.103+0000 7f634affd640 1 --2- 172.21.15.5:0/1317796784 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f63380663f0 0x7f63380688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-14T13:08:39.177 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:39.149+0000 7fd9d7a0a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:08:39.236 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:39.199+0000 7f9768b3f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:08:39.310 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:39.275+0000 7f9768b3f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:08:39.310 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:39.281+0000 7fd9d7a0a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:08:39.450 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:39.415+0000 7f9768b3f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:08:39.849 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:39.821+0000 7fd9d7a0a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:08:39.938 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:39.909+0000 7fd9d7a0a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:08:40.019 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:39.983+0000 7f9768b3f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:08:40.087 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:40.057+0000 7fd9d7a0a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:08:40.108 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:40.071+0000 7f9768b3f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:08:40.171 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:40.141+0000 7fd9d7a0a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:08:40.262 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:40.227+0000 7f9768b3f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:08:40.350 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:40.315+0000 7f9768b3f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:08:40.441 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:40.413+0000 7fd9d7a0a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:08:40.501 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:40.473+0000 7fd9d7a0a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:08:40.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:40.479+0000 7f63337fe640 1 -- 172.21.15.5:0/1317796784 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 32) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f63400512e0 con 0x7f634c0d2fc0 2023-07-14T13:08:40.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:40.479+0000 7f63337fe640 1 -- 172.21.15.5:0/1317796784 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f63380663f0 msgr2=0x7f63380688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:08:40.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:40.479+0000 7f63337fe640 1 --2- 172.21.15.5:0/1317796784 >> [v2:172.21.15.154:6832/1874317247,v1:172.21.15.154:6833/1874317247] conn(0x7f63380663f0 0x7f63380688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:40.636 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:40.605+0000 7fd956b76640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:40.637 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:40.605+0000 7fd956b76640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:40.637 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:40.605+0000 7fd956b76640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:40.637 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:40.605+0000 7fd956b76640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:40.637 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:40.605+0000 7fd956b76640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:40.637 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:40.605+0000 7fd959b7c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:40.637 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:40.605+0000 7fd959b7c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:40.637 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:40.605+0000 7fd959b7c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:40.638 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:40.605+0000 7fd959b7c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:40.638 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:40.605+0000 7fd959b7c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:40.649 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:40.615+0000 7f9768b3f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:08:40.712 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:40.679+0000 7f9768b3f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:08:41.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.487+0000 7f63337fe640 1 -- 172.21.15.5:0/1317796784 <== mon.1 v2:172.21.15.154:3300/0 8 ==== mgrmap(e 33) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f63400540c0 con 0x7f634c0d2fc0 2023-07-14T13:08:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.487+0000 7f63337fe640 1 --2- 172.21.15.5:0/1317796784 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f6338033e90 0x7f63380708c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.487+0000 7f63337fe640 1 -- 172.21.15.5:0/1317796784 --> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6338034260 con 0x7f6338033e90 2023-07-14T13:08:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.487+0000 7f634affd640 1 --2- 172.21.15.5:0/1317796784 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f6338033e90 0x7f63380708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.495+0000 7f634affd640 1 --2- 172.21.15.5:0/1317796784 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f6338033e90 0x7f63380708c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f633c0ad040 tx=0x7f633c0a7000 comp rx=0 tx=0).ready entity=mgr.5978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:41.539 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:41.509+0000 7fd960b8a640 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-07-14T13:08:41.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.503+0000 7f63337fe640 1 -- 172.21.15.5:0/1317796784 <== mgr.5978 v2:172.21.15.154:6832/224047690 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f6338034260 con 0x7f6338033e90 2023-07-14T13:08:41.540 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-07-14T13:08:41.549 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-07-14T13:08:41.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:08:41.550 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-14T13:08:41.562 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-14T13:08:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.719+0000 7fd138c34640 1 Processor -- start 2023-07-14T13:08:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.719+0000 7fd138c34640 1 -- start start 2023-07-14T13:08:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.719+0000 7fd138c34640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd13415c2a0 0x7fd13415c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.719+0000 7fd138c34640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1340703a0 con 0x7fd1340c8db0 2023-07-14T13:08:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.719+0000 7fd138c34640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13415d010 con 0x7fd1340af8b0 2023-07-14T13:08:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.719+0000 7fd138c34640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd134158c70 con 0x7fd13415c2a0 2023-07-14T13:08:41.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.719+0000 7fd132ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd13415c2a0 0x7fd13415c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:41.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.719+0000 7fd133fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd1340c8db0 0x7fd1340c9230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47202/0 (socket says 172.21.15.5:47202) 2023-07-14T13:08:41.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.719+0000 7fd133fff640 1 -- 172.21.15.5:0/3368131245 learned_addr learned my addr 172.21.15.5:0/3368131245 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:41.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.723+0000 7fd132ffd640 1 -- 172.21.15.5:0/3368131245 >> v1:172.21.15.154:6789/0 conn(0x7fd1340af8b0 legacy=0x7fd1340afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:41.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.723+0000 7fd132ffd640 1 -- 172.21.15.5:0/3368131245 >> v1:172.21.15.5:6789/0 conn(0x7fd1340c8db0 legacy=0x7fd1340c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:41.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.723+0000 7fd132ffd640 1 -- 172.21.15.5:0/3368131245 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd134158f50 con 0x7fd13415c2a0 2023-07-14T13:08:41.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.723+0000 7fd1327fc640 1 -- 172.21.15.5:0/3368131245 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2007292081 0 0) 0x7fd12c0014a0 con 0x7fd1340c8db0 2023-07-14T13:08:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.723+0000 7fd132ffd640 1 --2- 172.21.15.5:0/3368131245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd13415c2a0 0x7fd13415c710 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fd1280097c0 tx=0x7fd12801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a007b11eb1de7fa8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.723+0000 7fd1327fc640 1 -- 172.21.15.5:0/3368131245 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1280ab650 con 0x7fd13415c2a0 2023-07-14T13:08:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.723+0000 7fd1327fc640 1 -- 172.21.15.5:0/3368131245 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1280ab7b0 con 0x7fd13415c2a0 2023-07-14T13:08:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.723+0000 7fd1327fc640 1 -- 172.21.15.5:0/3368131245 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1280abb40 con 0x7fd13415c2a0 2023-07-14T13:08:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.723+0000 7fd138c34640 1 -- 172.21.15.5:0/3368131245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd13415c2a0 msgr2=0x7fd13415c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.723+0000 7fd138c34640 1 --2- 172.21.15.5:0/3368131245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd13415c2a0 0x7fd13415c710 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fd1280097c0 tx=0x7fd12801c450 comp rx=0 tx=0).stop 2023-07-14T13:08:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.727+0000 7fd138c34640 1 -- 172.21.15.5:0/3368131245 shutdown_connections 2023-07-14T13:08:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.727+0000 7fd138c34640 1 --2- 172.21.15.5:0/3368131245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd13415c2a0 0x7fd13415c710 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.727+0000 7fd138c34640 1 -- 172.21.15.5:0/3368131245 >> 172.21.15.5:0/3368131245 conn(0x7fd1340ca8b0 msgr2=0x7fd1340cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.727+0000 7fd138c34640 1 -- 172.21.15.5:0/3368131245 shutdown_connections 2023-07-14T13:08:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.727+0000 7fd138c34640 1 -- 172.21.15.5:0/3368131245 wait complete. 2023-07-14T13:08:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.727+0000 7fd138c34640 1 Processor -- start 2023-07-14T13:08:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.727+0000 7fd138c34640 1 -- start start 2023-07-14T13:08:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.727+0000 7fd138c34640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1340af8b0 0x7fd134149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.727+0000 7fd138c34640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1340c8db0 0x7fd1340c4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.727+0000 7fd138c34640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd13415c2a0 0x7fd134151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.727+0000 7fd138c34640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1340c2ae0 con 0x7fd1340c8db0 2023-07-14T13:08:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.727+0000 7fd138c34640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1340c1ed0 con 0x7fd1340af8b0 2023-07-14T13:08:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.727+0000 7fd138c34640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1340c21b0 con 0x7fd13415c2a0 2023-07-14T13:08:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.727+0000 7fd132ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1340c8db0 0x7fd1340c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.727+0000 7fd132ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1340c8db0 0x7fd1340c4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56212/0 (socket says 172.21.15.5:56212) 2023-07-14T13:08:41.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.727+0000 7fd132ffd640 1 -- 172.21.15.5:0/3234367067 learned_addr learned my addr 172.21.15.5:0/3234367067 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.727+0000 7fd133fff640 1 --2- 172.21.15.5:0/3234367067 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd13415c2a0 0x7fd134151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.727+0000 7fd1337fe640 1 --2- 172.21.15.5:0/3234367067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1340af8b0 0x7fd134149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.727+0000 7fd132ffd640 1 -- 172.21.15.5:0/3234367067 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd13415c2a0 msgr2=0x7fd134151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.727+0000 7fd132ffd640 1 --2- 172.21.15.5:0/3234367067 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd13415c2a0 0x7fd134151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.727+0000 7fd132ffd640 1 -- 172.21.15.5:0/3234367067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1340af8b0 msgr2=0x7fd134149e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.727+0000 7fd132ffd640 1 --2- 172.21.15.5:0/3234367067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1340af8b0 0x7fd134149e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.731+0000 7fd132ffd640 1 -- 172.21.15.5:0/3234367067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd128009420 con 0x7fd1340c8db0 2023-07-14T13:08:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.731+0000 7fd133fff640 1 --2- 172.21.15.5:0/3234367067 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd13415c2a0 0x7fd134151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.731+0000 7fd132ffd640 1 --2- 172.21.15.5:0/3234367067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1340c8db0 0x7fd1340c4130 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fd1280ad040 tx=0x7fd1280191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.731+0000 7fd11bfff640 1 -- 172.21.15.5:0/3234367067 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1280abd20 con 0x7fd1340c8db0 2023-07-14T13:08:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.731+0000 7fd11bfff640 1 -- 172.21.15.5:0/3234367067 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1280abe80 con 0x7fd1340c8db0 2023-07-14T13:08:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.731+0000 7fd11bfff640 1 -- 172.21.15.5:0/3234367067 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd128004220 con 0x7fd1340c8db0 2023-07-14T13:08:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.731+0000 7fd138c34640 1 -- 172.21.15.5:0/3234367067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1340c2490 con 0x7fd1340c8db0 2023-07-14T13:08:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.731+0000 7fd138c34640 1 -- 172.21.15.5:0/3234367067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13414a370 con 0x7fd1340c8db0 2023-07-14T13:08:41.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.731+0000 7fd138c34640 1 -- 172.21.15.5:0/3234367067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1340c22f0 con 0x7fd1340c8db0 2023-07-14T13:08:41.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.731+0000 7fd11bfff640 1 -- 172.21.15.5:0/3234367067 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 33) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fd1280bc070 con 0x7fd1340c8db0 2023-07-14T13:08:41.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.731+0000 7fd11bfff640 1 --2- 172.21.15.5:0/3234367067 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7fd120066150 0x7fd120068600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:41.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.731+0000 7fd11bfff640 1 -- 172.21.15.5:0/3234367067 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fd12811e120 con 0x7fd1340c8db0 2023-07-14T13:08:41.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.731+0000 7fd1337fe640 1 --2- 172.21.15.5:0/3234367067 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7fd120066150 0x7fd120068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:41.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.735+0000 7fd1337fe640 1 --2- 172.21.15.5:0/3234367067 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7fd120066150 0x7fd120068600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd124000f70 tx=0x7fd124009040 comp rx=0 tx=0).ready entity=mgr.5978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.735+0000 7fd11bfff640 1 -- 172.21.15.5:0/3234367067 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd1340c22f0 con 0x7fd1340c8db0 2023-07-14T13:08:41.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:41.931+0000 7fd138c34640 1 -- 172.21.15.5:0/3234367067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fd1340c22f0 con 0x7fd1340c8db0 2023-07-14T13:08:42.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.531+0000 7fd11bfff640 1 -- 172.21.15.5:0/3234367067 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 34) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fd128004380 con 0x7fd1340c8db0 2023-07-14T13:08:42.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.535+0000 7fd11bfff640 1 -- 172.21.15.5:0/3234367067 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v34) v1 ==== 93+0+0 (secure 0 0 0) 0x7fd1280ed540 con 0x7fd1340c8db0 2023-07-14T13:08:42.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.539+0000 7fd138c34640 1 -- 172.21.15.5:0/3234367067 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7fd120066150 msgr2=0x7fd120068600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:42.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.539+0000 7fd138c34640 1 --2- 172.21.15.5:0/3234367067 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7fd120066150 0x7fd120068600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd124000f70 tx=0x7fd124009040 comp rx=0 tx=0).stop 2023-07-14T13:08:42.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.539+0000 7fd138c34640 1 -- 172.21.15.5:0/3234367067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1340c8db0 msgr2=0x7fd1340c4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:42.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.539+0000 7fd138c34640 1 --2- 172.21.15.5:0/3234367067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1340c8db0 0x7fd1340c4130 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fd1280ad040 tx=0x7fd1280191f0 comp rx=0 tx=0).stop 2023-07-14T13:08:42.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.539+0000 7fd138c34640 1 -- 172.21.15.5:0/3234367067 shutdown_connections 2023-07-14T13:08:42.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.539+0000 7fd138c34640 1 --2- 172.21.15.5:0/3234367067 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7fd120066150 0x7fd120068600 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:42.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.539+0000 7fd138c34640 1 --2- 172.21.15.5:0/3234367067 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd13415c2a0 0x7fd134151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:42.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.539+0000 7fd138c34640 1 --2- 172.21.15.5:0/3234367067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1340c8db0 0x7fd1340c4130 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:42.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.539+0000 7fd138c34640 1 --2- 172.21.15.5:0/3234367067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1340af8b0 0x7fd134149e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:42.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.539+0000 7fd138c34640 1 -- 172.21.15.5:0/3234367067 >> 172.21.15.5:0/3234367067 conn(0x7fd1340ca8b0 msgr2=0x7fd134168810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:42.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.539+0000 7fd138c34640 1 -- 172.21.15.5:0/3234367067 shutdown_connections 2023-07-14T13:08:42.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.539+0000 7fd138c34640 1 -- 172.21.15.5:0/3234367067 wait complete. 2023-07-14T13:08:42.595 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T13:08:42.596 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:08:42.663 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:08:42.736 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T13:08:42.736 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:08:42.737 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:08:42.744 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:42.711+0000 7f66c902c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:08:42.746 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:08:42.746 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:08:42.747 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:42.717+0000 7fa17da2c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:08:42.796 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:08:42.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.951+0000 7fcc13503640 1 Processor -- start 2023-07-14T13:08:42.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.951+0000 7fcc13503640 1 -- start start 2023-07-14T13:08:42.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.951+0000 7fcc13503640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcc0c0b7990 0x7fcc0c0d0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:42.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.951+0000 7fcc13503640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc0c0b4840 con 0x7fcc0c0d1840 2023-07-14T13:08:42.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.951+0000 7fcc13503640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc0c0ccae0 con 0x7fcc0c0d12f0 2023-07-14T13:08:42.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.951+0000 7fcc13503640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc0c0cd060 con 0x7fcc0c0b7990 2023-07-14T13:08:42.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.951+0000 7fcc11aa0640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcc0c0d1840 0x7fcc0c0d1d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47230/0 (socket says 172.21.15.5:47230) 2023-07-14T13:08:42.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.951+0000 7fcc11aa0640 1 -- 172.21.15.5:0/2764359284 learned_addr learned my addr 172.21.15.5:0/2764359284 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:42.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.951+0000 7fcc1129f640 1 --2- 172.21.15.5:0/2764359284 >> v2:172.21.15.154:3300/0 conn(0x7fcc0c0b7990 0x7fcc0c0d0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:42.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.951+0000 7fcc03fff640 1 -- 172.21.15.5:0/2764359284 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 400886803 0 0) 0x7fcc0c0b4840 con 0x7fcc0c0d1840 2023-07-14T13:08:42.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.951+0000 7fcc03fff640 1 -- 172.21.15.5:0/2764359284 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbf8003530 con 0x7fcc0c0d1840 2023-07-14T13:08:42.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.951+0000 7fcc1129f640 1 -- 172.21.15.5:0/2764359284 >> v1:172.21.15.154:6789/0 conn(0x7fcc0c0d12f0 legacy=0x7fcc0c15f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:42.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.951+0000 7fcc03fff640 1 -- 172.21.15.5:0/2764359284 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115908395 0 0) 0x7fcc0c0ccae0 con 0x7fcc0c0d12f0 2023-07-14T13:08:42.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.951+0000 7fcc1129f640 1 -- 172.21.15.5:0/2764359284 >> v1:172.21.15.5:6789/0 conn(0x7fcc0c0d1840 legacy=0x7fcc0c0d1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:42.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.951+0000 7fcc1129f640 1 -- 172.21.15.5:0/2764359284 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0c160310 con 0x7fcc0c0b7990 2023-07-14T13:08:42.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.955+0000 7fcc1129f640 1 --2- 172.21.15.5:0/2764359284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc0c0b7990 0x7fcc0c0d0c40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcc080097c0 tx=0x7fcc0801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7f40e3f6fd95653 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:42.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.955+0000 7fcc03fff640 1 -- 172.21.15.5:0/2764359284 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc080ab600 con 0x7fcc0c0b7990 2023-07-14T13:08:42.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.955+0000 7fcc03fff640 1 -- 172.21.15.5:0/2764359284 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc080a7050 con 0x7fcc0c0b7990 2023-07-14T13:08:42.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.955+0000 7fcc03fff640 1 -- 172.21.15.5:0/2764359284 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc080ab980 con 0x7fcc0c0b7990 2023-07-14T13:08:42.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.955+0000 7fcc13503640 1 -- 172.21.15.5:0/2764359284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc0c0b7990 msgr2=0x7fcc0c0d0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:42.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.955+0000 7fcc13503640 1 --2- 172.21.15.5:0/2764359284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc0c0b7990 0x7fcc0c0d0c40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcc080097c0 tx=0x7fcc0801c3f0 comp rx=0 tx=0).stop 2023-07-14T13:08:42.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.955+0000 7fcc13503640 1 -- 172.21.15.5:0/2764359284 shutdown_connections 2023-07-14T13:08:42.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.955+0000 7fcc13503640 1 --2- 172.21.15.5:0/2764359284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc0c0b7990 0x7fcc0c0d0c40 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:42.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.955+0000 7fcc13503640 1 -- 172.21.15.5:0/2764359284 >> 172.21.15.5:0/2764359284 conn(0x7fcc0c0650b0 msgr2=0x7fcc0c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:42.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.955+0000 7fcc13503640 1 -- 172.21.15.5:0/2764359284 shutdown_connections 2023-07-14T13:08:42.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.955+0000 7fcc13503640 1 -- 172.21.15.5:0/2764359284 wait complete. 2023-07-14T13:08:42.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.959+0000 7fcc13503640 1 Processor -- start 2023-07-14T13:08:42.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.959+0000 7fcc13503640 1 -- start start 2023-07-14T13:08:42.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.959+0000 7fcc13503640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc0c0b7990 0x7fcc0c14be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:42.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.959+0000 7fcc13503640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc0c0d12f0 0x7fcc0c0b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:42.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.959+0000 7fcc13503640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc0c0d1840 0x7fcc0c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:42.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.959+0000 7fcc13503640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c153300 con 0x7fcc0c0d12f0 2023-07-14T13:08:42.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.959+0000 7fcc13503640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c14c380 con 0x7fcc0c0d1840 2023-07-14T13:08:42.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.959+0000 7fcc13503640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c0cc170 con 0x7fcc0c0b7990 2023-07-14T13:08:42.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.959+0000 7fcc10a9e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc0c0d12f0 0x7fcc0c0b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:42.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.959+0000 7fcc10a9e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc0c0d12f0 0x7fcc0c0b2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56230/0 (socket says 172.21.15.5:56230) 2023-07-14T13:08:42.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.959+0000 7fcc10a9e640 1 -- 172.21.15.5:0/4018321697 learned_addr learned my addr 172.21.15.5:0/4018321697 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:42.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.959+0000 7fcc11aa0640 1 --2- 172.21.15.5:0/4018321697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc0c0d1840 0x7fcc0c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:42.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.959+0000 7fcc1129f640 1 --2- 172.21.15.5:0/4018321697 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc0c0b7990 0x7fcc0c14be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:42.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.959+0000 7fcc10a9e640 1 -- 172.21.15.5:0/4018321697 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc0c0b7990 msgr2=0x7fcc0c14be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:42.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.959+0000 7fcc10a9e640 1 --2- 172.21.15.5:0/4018321697 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc0c0b7990 0x7fcc0c14be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:42.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.959+0000 7fcc10a9e640 1 -- 172.21.15.5:0/4018321697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc0c0d1840 msgr2=0x7fcc0c0b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:42.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.959+0000 7fcc10a9e640 1 --2- 172.21.15.5:0/4018321697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc0c0d1840 0x7fcc0c0b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:42.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.959+0000 7fcc10a9e640 1 -- 172.21.15.5:0/4018321697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc08009420 con 0x7fcc0c0d12f0 2023-07-14T13:08:42.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.959+0000 7fcc1129f640 1 --2- 172.21.15.5:0/4018321697 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc0c0b7990 0x7fcc0c14be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:42.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.959+0000 7fcc10a9e640 1 --2- 172.21.15.5:0/4018321697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc0c0d12f0 0x7fcc0c0b2da0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc007fd0 tx=0x7fcbfc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:42.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.959+0000 7fcc01ffb640 1 -- 172.21.15.5:0/4018321697 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc0052d0 con 0x7fcc0c0d12f0 2023-07-14T13:08:42.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.959+0000 7fcc01ffb640 1 -- 172.21.15.5:0/4018321697 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbfc005430 con 0x7fcc0c0d12f0 2023-07-14T13:08:42.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.959+0000 7fcc01ffb640 1 -- 172.21.15.5:0/4018321697 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc003840 con 0x7fcc0c0d12f0 2023-07-14T13:08:42.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.959+0000 7fcc13503640 1 -- 172.21.15.5:0/4018321697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc0c0cb8d0 con 0x7fcc0c0d12f0 2023-07-14T13:08:42.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.959+0000 7fcc13503640 1 -- 172.21.15.5:0/4018321697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc0c0cbe90 con 0x7fcc0c0d12f0 2023-07-14T13:08:42.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.963+0000 7fcc13503640 1 -- 172.21.15.5:0/4018321697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc0c153440 con 0x7fcc0c0d12f0 2023-07-14T13:08:42.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.963+0000 7fcc01ffb640 1 -- 172.21.15.5:0/4018321697 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 34) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fcbfc0039a0 con 0x7fcc0c0d12f0 2023-07-14T13:08:42.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.963+0000 7fcc01ffb640 1 --2- 172.21.15.5:0/4018321697 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7fcbf0066430 0x7fcbf00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:42.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.963+0000 7fcc01ffb640 1 -- 172.21.15.5:0/4018321697 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fcbfc083740 con 0x7fcc0c0d12f0 2023-07-14T13:08:43.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.963+0000 7fcc1129f640 1 -- 172.21.15.5:0/4018321697 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7fcbf0066430 msgr2=0x7fcbf00688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/224047690 2023-07-14T13:08:43.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.963+0000 7fcc1129f640 1 --2- 172.21.15.5:0/4018321697 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7fcbf0066430 0x7fcbf00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:08:43.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:42.967+0000 7fcc01ffb640 1 -- 172.21.15.5:0/4018321697 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fcc0c153440 con 0x7fcc0c0d12f0 2023-07-14T13:08:43.170 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:43.141+0000 7fa17da2c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:08:43.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.167+0000 7fcc1129f640 1 -- 172.21.15.5:0/4018321697 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7fcbf0066430 msgr2=0x7fcbf00688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/224047690 2023-07-14T13:08:43.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.167+0000 7fcc1129f640 1 --2- 172.21.15.5:0/4018321697 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7fcbf0066430 0x7fcbf00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-14T13:08:43.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.255+0000 7fcc13503640 1 -- 172.21.15.5:0/4018321697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc0c153440 con 0x7fcc0c0d12f0 2023-07-14T13:08:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.255+0000 7fcc01ffb640 1 -- 172.21.15.5:0/4018321697 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+18752 (secure 0 0 0) 0x7fcc0c153440 con 0x7fcc0c0d12f0 2023-07-14T13:08:43.290 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:43.290 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":84,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:08:40.475286+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:08:21.382297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-14T13:08:22.261284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6833/1874317247":"2023-07-15T13:08:40.475248+0000","172.21.15.154:6832/1874317247":"2023-07-15T13:08:40.475248+0000","172.21.15.154:0/2022303100":"2023-07-15T13:08:40.475248+0000","172.21.15.154:0/857765741":"2023-07-15T13:08:40.475248+0000","172.21.15.154:0/1586644269":"2023-07-15T13:08:40.475248+0000","172.21.15.154:0/974976956":"2023-07-15T13:08:40.475248+0000","172.21.15.154:0/2603107851":"2023-07-15T13:08:40.475248+0000","172.21.15.154:0/2677415683":"2023-07-15T13:08:40.475248+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:08:43.292 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:43.255+0000 7f66c902c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:08:43.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.255+0000 7fcc13503640 1 -- 172.21.15.5:0/4018321697 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7fcbf0066430 msgr2=0x7fcbf00688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:08:43.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.255+0000 7fcc13503640 1 --2- 172.21.15.5:0/4018321697 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7fcbf0066430 0x7fcbf00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:43.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.259+0000 7fcc13503640 1 -- 172.21.15.5:0/4018321697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc0c0d12f0 msgr2=0x7fcc0c0b2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:43.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.259+0000 7fcc13503640 1 --2- 172.21.15.5:0/4018321697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc0c0d12f0 0x7fcc0c0b2da0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc007fd0 tx=0x7fcbfc00c8e0 comp rx=0 tx=0).stop 2023-07-14T13:08:43.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.259+0000 7fcc13503640 1 -- 172.21.15.5:0/4018321697 shutdown_connections 2023-07-14T13:08:43.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.259+0000 7fcc13503640 1 --2- 172.21.15.5:0/4018321697 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7fcbf0066430 0x7fcbf00688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:43.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.259+0000 7fcc13503640 1 --2- 172.21.15.5:0/4018321697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc0c0d1840 0x7fcc0c0b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:43.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.259+0000 7fcc13503640 1 --2- 172.21.15.5:0/4018321697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc0c0d12f0 0x7fcc0c0b2da0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:43.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.259+0000 7fcc13503640 1 --2- 172.21.15.5:0/4018321697 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcc0c0b7990 0x7fcc0c14be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:43.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.259+0000 7fcc13503640 1 -- 172.21.15.5:0/4018321697 >> 172.21.15.5:0/4018321697 conn(0x7fcc0c0650b0 msgr2=0x7fcc0c0b5120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:43.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.259+0000 7fcc13503640 1 -- 172.21.15.5:0/4018321697 shutdown_connections 2023-07-14T13:08:43.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.259+0000 7fcc13503640 1 -- 172.21.15.5:0/4018321697 wait complete. 2023-07-14T13:08:43.312 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T13:08:21.382297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T13:08:22.261284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:08:43.313 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:08:43.321 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:43.293+0000 7fa17da2c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:08:43.452 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:43.419+0000 7f66c902c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:08:43.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.427+0000 7f9b9ad40640 1 Processor -- start 2023-07-14T13:08:43.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.427+0000 7f9b9ad40640 1 -- start start 2023-07-14T13:08:43.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.435+0000 7f9b9ad40640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b940d2fc0 0x7f9b940b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:43.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.435+0000 7f9b9ad40640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9b940d2300 0x7f9b940d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:43.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.435+0000 7f9b9ad40640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b940b04c0 con 0x7f9b9415bde0 2023-07-14T13:08:43.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.435+0000 7f9b9ad40640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b940d2ce0 con 0x7f9b940d2300 2023-07-14T13:08:43.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.435+0000 7f9b9ad40640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9415c1b0 con 0x7f9b940d2fc0 2023-07-14T13:08:43.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.435+0000 7f9b98adc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9b9415bde0 0x7f9b940d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47234/0 (socket says 172.21.15.5:47234) 2023-07-14T13:08:43.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.435+0000 7f9b98adc640 1 -- 172.21.15.5:0/2221732411 learned_addr learned my addr 172.21.15.5:0/2221732411 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:43.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.435+0000 7f9b992dd640 1 --2- 172.21.15.5:0/2221732411 >> v2:172.21.15.5:3300/0 conn(0x7f9b940d2300 0x7f9b940d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.435+0000 7f9b93fff640 1 --2- 172.21.15.5:0/2221732411 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b940d2fc0 0x7f9b940b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.435+0000 7f9b992dd640 1 -- 172.21.15.5:0/2221732411 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b940d2fc0 msgr2=0x7f9b940b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.435+0000 7f9b992dd640 1 --2- 172.21.15.5:0/2221732411 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b940d2fc0 0x7f9b940b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.435+0000 7f9b992dd640 1 -- 172.21.15.5:0/2221732411 >> v1:172.21.15.5:6789/0 conn(0x7f9b9415bde0 legacy=0x7f9b940d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:43.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.435+0000 7f9b992dd640 1 -- 172.21.15.5:0/2221732411 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b940d0aa0 con 0x7f9b940d2300 2023-07-14T13:08:43.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.435+0000 7f9b992dd640 1 --2- 172.21.15.5:0/2221732411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b940d2300 0x7f9b940d27a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c009d90 tx=0x7f9b8c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3373af151240774 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.435+0000 7f9b937fe640 1 -- 172.21.15.5:0/2221732411 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c0a5a10 con 0x7f9b940d2300 2023-07-14T13:08:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.435+0000 7f9b937fe640 1 -- 172.21.15.5:0/2221732411 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c0a5b70 con 0x7f9b940d2300 2023-07-14T13:08:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.435+0000 7f9b937fe640 1 -- 172.21.15.5:0/2221732411 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c0ad440 con 0x7f9b940d2300 2023-07-14T13:08:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.435+0000 7f9b9ad40640 1 -- 172.21.15.5:0/2221732411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b940d2300 msgr2=0x7f9b940d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.435+0000 7f9b9ad40640 1 --2- 172.21.15.5:0/2221732411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b940d2300 0x7f9b940d27a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c009d90 tx=0x7f9b8c01c950 comp rx=0 tx=0).stop 2023-07-14T13:08:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.435+0000 7f9b9ad40640 1 -- 172.21.15.5:0/2221732411 shutdown_connections 2023-07-14T13:08:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.435+0000 7f9b9ad40640 1 --2- 172.21.15.5:0/2221732411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b940d2300 0x7f9b940d27a0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.435+0000 7f9b9ad40640 1 --2- 172.21.15.5:0/2221732411 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b940d2fc0 0x7f9b940b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.435+0000 7f9b9ad40640 1 -- 172.21.15.5:0/2221732411 >> 172.21.15.5:0/2221732411 conn(0x7f9b940659d0 msgr2=0x7f9b9409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.435+0000 7f9b9ad40640 1 -- 172.21.15.5:0/2221732411 shutdown_connections 2023-07-14T13:08:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.435+0000 7f9b9ad40640 1 -- 172.21.15.5:0/2221732411 wait complete. 2023-07-14T13:08:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.435+0000 7f9b9ad40640 1 Processor -- start 2023-07-14T13:08:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.439+0000 7f9b9ad40640 1 -- start start 2023-07-14T13:08:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.439+0000 7f9b9ad40640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b940d2300 0x7f9b941528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.439+0000 7f9b9ad40640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b940d2fc0 0x7f9b94152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.439+0000 7f9b9ad40640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b9415bde0 0x7f9b94153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.439+0000 7f9b9ad40640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b94154200 con 0x7f9b940d2fc0 2023-07-14T13:08:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.439+0000 7f9b9ad40640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b940b5db0 con 0x7f9b940d2300 2023-07-14T13:08:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.439+0000 7f9b9ad40640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b94153c40 con 0x7f9b9415bde0 2023-07-14T13:08:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.439+0000 7f9b93fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b940d2fc0 0x7f9b94152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.439+0000 7f9b98adc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b940d2300 0x7f9b941528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.439+0000 7f9b93fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b940d2fc0 0x7f9b94152e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56262/0 (socket says 172.21.15.5:56262) 2023-07-14T13:08:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.439+0000 7f9b93fff640 1 -- 172.21.15.5:0/1743786036 learned_addr learned my addr 172.21.15.5:0/1743786036 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.439+0000 7f9b992dd640 1 --2- 172.21.15.5:0/1743786036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b9415bde0 0x7f9b94153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.439+0000 7f9b93fff640 1 -- 172.21.15.5:0/1743786036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b9415bde0 msgr2=0x7f9b94153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.439+0000 7f9b93fff640 1 --2- 172.21.15.5:0/1743786036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b9415bde0 0x7f9b94153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.439+0000 7f9b93fff640 1 -- 172.21.15.5:0/1743786036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b940d2300 msgr2=0x7f9b941528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.439+0000 7f9b93fff640 1 --2- 172.21.15.5:0/1743786036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b940d2300 0x7f9b941528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.439+0000 7f9b93fff640 1 -- 172.21.15.5:0/1743786036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8c009a70 con 0x7f9b940d2fc0 2023-07-14T13:08:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.439+0000 7f9b93fff640 1 --2- 172.21.15.5:0/1743786036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b940d2fc0 0x7f9b94152e00 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f9b8000e870 tx=0x7f9b8000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.439+0000 7f9b917fa640 1 -- 172.21.15.5:0/1743786036 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b80009510 con 0x7f9b940d2fc0 2023-07-14T13:08:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.439+0000 7f9b917fa640 1 -- 172.21.15.5:0/1743786036 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8000eec0 con 0x7f9b940d2fc0 2023-07-14T13:08:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.439+0000 7f9b9ad40640 1 -- 172.21.15.5:0/1743786036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b94153f20 con 0x7f9b940d2fc0 2023-07-14T13:08:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.439+0000 7f9b917fa640 1 -- 172.21.15.5:0/1743786036 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8000cb40 con 0x7f9b940d2fc0 2023-07-14T13:08:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.439+0000 7f9b9ad40640 1 -- 172.21.15.5:0/1743786036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b940b5470 con 0x7f9b940d2fc0 2023-07-14T13:08:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.439+0000 7f9b9ad40640 1 -- 172.21.15.5:0/1743786036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b940b5f20 con 0x7f9b940d2fc0 2023-07-14T13:08:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.443+0000 7f9b917fa640 1 -- 172.21.15.5:0/1743786036 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 34) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f9b8000ccc0 con 0x7f9b940d2fc0 2023-07-14T13:08:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.443+0000 7f9b917fa640 1 --2- 172.21.15.5:0/1743786036 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f9b78066430 0x7f9b780688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.443+0000 7f9b917fa640 1 -- 172.21.15.5:0/1743786036 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f9b800841b0 con 0x7f9b940d2fc0 2023-07-14T13:08:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.443+0000 7f9b98adc640 1 -- 172.21.15.5:0/1743786036 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f9b78066430 msgr2=0x7f9b780688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/224047690 2023-07-14T13:08:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.443+0000 7f9b98adc640 1 --2- 172.21.15.5:0/1743786036 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f9b78066430 0x7f9b780688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:08:43.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.447+0000 7f9b917fa640 1 -- 172.21.15.5:0/1743786036 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9b80051320 con 0x7f9b940d2fc0 2023-07-14T13:08:43.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.607+0000 7f9b9ad40640 1 -- 172.21.15.5:0/1743786036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9b940678d0 con 0x7f9b940d2fc0 2023-07-14T13:08:43.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.607+0000 7f9b917fa640 1 -- 172.21.15.5:0/1743786036 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9b80054940 con 0x7f9b940d2fc0 2023-07-14T13:08:43.643 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:08:43.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.611+0000 7f9b9ad40640 1 -- 172.21.15.5:0/1743786036 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f9b78066430 msgr2=0x7f9b780688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:08:43.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.611+0000 7f9b9ad40640 1 --2- 172.21.15.5:0/1743786036 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f9b78066430 0x7f9b780688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:43.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.611+0000 7f9b9ad40640 1 -- 172.21.15.5:0/1743786036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b940d2fc0 msgr2=0x7f9b94152e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:43.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.611+0000 7f9b9ad40640 1 --2- 172.21.15.5:0/1743786036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b940d2fc0 0x7f9b94152e00 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f9b8000e870 tx=0x7f9b8000ec70 comp rx=0 tx=0).stop 2023-07-14T13:08:43.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.611+0000 7f9b9ad40640 1 -- 172.21.15.5:0/1743786036 shutdown_connections 2023-07-14T13:08:43.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.611+0000 7f9b9ad40640 1 --2- 172.21.15.5:0/1743786036 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f9b78066430 0x7f9b780688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:43.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.611+0000 7f9b9ad40640 1 --2- 172.21.15.5:0/1743786036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9b9415bde0 0x7f9b94153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:43.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.611+0000 7f9b9ad40640 1 --2- 172.21.15.5:0/1743786036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b940d2fc0 0x7f9b94152e00 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:43.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.611+0000 7f9b9ad40640 1 --2- 172.21.15.5:0/1743786036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b940d2300 0x7f9b941528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:43.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.611+0000 7f9b9ad40640 1 -- 172.21.15.5:0/1743786036 >> 172.21.15.5:0/1743786036 conn(0x7f9b940659d0 msgr2=0x7f9b940cda50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:43.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.611+0000 7f9b9ad40640 1 -- 172.21.15.5:0/1743786036 shutdown_connections 2023-07-14T13:08:43.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.611+0000 7f9b9ad40640 1 -- 172.21.15.5:0/1743786036 wait complete. 2023-07-14T13:08:43.665 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:08:43.805 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:43.777+0000 7fa17da2c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:08:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.779+0000 7f99462f9640 1 Processor -- start 2023-07-14T13:08:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.779+0000 7f99462f9640 1 -- start start 2023-07-14T13:08:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.779+0000 7f99462f9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f99400d2fc0 0x7f99400b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.779+0000 7f99462f9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99400d2300 0x7f99400d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.779+0000 7f99462f9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99400b04c0 con 0x7f994015bde0 2023-07-14T13:08:43.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.779+0000 7f99462f9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f994015c1b0 con 0x7f99400d2300 2023-07-14T13:08:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.779+0000 7f99462f9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99400d2c80 con 0x7f99400d2fc0 2023-07-14T13:08:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.779+0000 7f9944896640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99400d2300 0x7f99400d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.779+0000 7f9944896640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99400d2300 0x7f99400d2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56272/0 (socket says 172.21.15.5:56272) 2023-07-14T13:08:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.779+0000 7f9944896640 1 -- 172.21.15.5:0/3869482606 learned_addr learned my addr 172.21.15.5:0/3869482606 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:43.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.779+0000 7f993f7fe640 1 --2- 172.21.15.5:0/3869482606 >> v2:172.21.15.154:3300/0 conn(0x7f99400d2fc0 0x7f99400b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:43.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.779+0000 7f9944896640 1 -- 172.21.15.5:0/3869482606 >> v2:172.21.15.154:3300/0 conn(0x7f99400d2fc0 msgr2=0x7f99400b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:43.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.779+0000 7f9944896640 1 --2- 172.21.15.5:0/3869482606 >> v2:172.21.15.154:3300/0 conn(0x7f99400d2fc0 0x7f99400b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:43.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.779+0000 7f9944896640 1 -- 172.21.15.5:0/3869482606 >> v1:172.21.15.154:6789/0 conn(0x7f994015bde0 legacy=0x7f99400d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:43.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.779+0000 7f9944896640 1 -- 172.21.15.5:0/3869482606 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99400d0aa0 con 0x7f99400d2300 2023-07-14T13:08:43.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.783+0000 7f9944896640 1 --2- 172.21.15.5:0/3869482606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99400d2300 0x7f99400d2740 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f994008c600 tx=0x7f993801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3f5916bee8a06e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:43.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.783+0000 7f993effd640 1 -- 172.21.15.5:0/3869482606 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99380a5890 con 0x7f99400d2300 2023-07-14T13:08:43.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.783+0000 7f993effd640 1 -- 172.21.15.5:0/3869482606 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99380a59f0 con 0x7f99400d2300 2023-07-14T13:08:43.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.783+0000 7f993effd640 1 -- 172.21.15.5:0/3869482606 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99380a5d80 con 0x7f99400d2300 2023-07-14T13:08:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.783+0000 7f99462f9640 1 -- 172.21.15.5:0/3869482606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99400d2300 msgr2=0x7f99400d2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.783+0000 7f99462f9640 1 --2- 172.21.15.5:0/3869482606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99400d2300 0x7f99400d2740 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f994008c600 tx=0x7f993801c9d0 comp rx=0 tx=0).stop 2023-07-14T13:08:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.783+0000 7f99462f9640 1 -- 172.21.15.5:0/3869482606 shutdown_connections 2023-07-14T13:08:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.783+0000 7f99462f9640 1 --2- 172.21.15.5:0/3869482606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99400d2300 0x7f99400d2740 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:43.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.783+0000 7f99462f9640 1 --2- 172.21.15.5:0/3869482606 >> v2:172.21.15.154:3300/0 conn(0x7f99400d2fc0 0x7f99400b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.783+0000 7f99462f9640 1 -- 172.21.15.5:0/3869482606 >> 172.21.15.5:0/3869482606 conn(0x7f99400659d0 msgr2=0x7f994009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.783+0000 7f99462f9640 1 -- 172.21.15.5:0/3869482606 shutdown_connections 2023-07-14T13:08:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.783+0000 7f99462f9640 1 -- 172.21.15.5:0/3869482606 wait complete. 2023-07-14T13:08:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.787+0000 7f99462f9640 1 Processor -- start 2023-07-14T13:08:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.787+0000 7f99462f9640 1 -- start start 2023-07-14T13:08:43.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.787+0000 7f99462f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99400d2300 0x7f9940154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:43.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.787+0000 7f99462f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99400d2fc0 0x7f99400cee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:43.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.787+0000 7f99462f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f994015bde0 0x7f99400cf380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:43.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.787+0000 7f99462f9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994015dc10 con 0x7f994015bde0 2023-07-14T13:08:43.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.787+0000 7f99462f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994015def0 con 0x7f99400d2fc0 2023-07-14T13:08:43.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.787+0000 7f99462f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f994015e1d0 con 0x7f99400d2300 2023-07-14T13:08:43.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.787+0000 7f9944896640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f994015bde0 0x7f99400cf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:43.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.787+0000 7f9944896640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f994015bde0 0x7f99400cf380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56276/0 (socket says 172.21.15.5:56276) 2023-07-14T13:08:43.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.787+0000 7f9944896640 1 -- 172.21.15.5:0/2623264431 learned_addr learned my addr 172.21.15.5:0/2623264431 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:43.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.787+0000 7f993f7fe640 1 --2- 172.21.15.5:0/2623264431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99400d2fc0 0x7f99400cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:43.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.787+0000 7f993ffff640 1 --2- 172.21.15.5:0/2623264431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99400d2300 0x7f9940154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.787+0000 7f9944896640 1 -- 172.21.15.5:0/2623264431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99400d2300 msgr2=0x7f9940154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.787+0000 7f9944896640 1 --2- 172.21.15.5:0/2623264431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99400d2300 0x7f9940154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.787+0000 7f9944896640 1 -- 172.21.15.5:0/2623264431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99400d2fc0 msgr2=0x7f99400cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.787+0000 7f9944896640 1 --2- 172.21.15.5:0/2623264431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99400d2fc0 0x7f99400cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:43.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.787+0000 7f9944896640 1 -- 172.21.15.5:0/2623264431 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9938009b30 con 0x7f994015bde0 2023-07-14T13:08:43.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.787+0000 7f993ffff640 1 --2- 172.21.15.5:0/2623264431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99400d2300 0x7f9940154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:43.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.787+0000 7f9944896640 1 --2- 172.21.15.5:0/2623264431 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f994015bde0 0x7f99400cf380 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f99380195e0 tx=0x7f9938019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:43.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.787+0000 7f993cff9640 1 -- 172.21.15.5:0/2623264431 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99380b8670 con 0x7f994015bde0 2023-07-14T13:08:43.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.787+0000 7f993cff9640 1 -- 172.21.15.5:0/2623264431 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99380b87d0 con 0x7f994015bde0 2023-07-14T13:08:43.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.787+0000 7f99462f9640 1 -- 172.21.15.5:0/2623264431 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99400b1a60 con 0x7f994015bde0 2023-07-14T13:08:43.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.787+0000 7f993cff9640 1 -- 172.21.15.5:0/2623264431 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99380b8b60 con 0x7f994015bde0 2023-07-14T13:08:43.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.791+0000 7f99462f9640 1 -- 172.21.15.5:0/2623264431 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99401545c0 con 0x7f994015bde0 2023-07-14T13:08:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.791+0000 7f99462f9640 1 -- 172.21.15.5:0/2623264431 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99400b1c80 con 0x7f994015bde0 2023-07-14T13:08:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.791+0000 7f993cff9640 1 -- 172.21.15.5:0/2623264431 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 34) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f99380b8cc0 con 0x7f994015bde0 2023-07-14T13:08:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.791+0000 7f993cff9640 1 --2- 172.21.15.5:0/2623264431 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f992c066430 0x7f992c0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.791+0000 7f993cff9640 1 -- 172.21.15.5:0/2623264431 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f993811f5b0 con 0x7f994015bde0 2023-07-14T13:08:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.791+0000 7f993ffff640 1 -- 172.21.15.5:0/2623264431 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f992c066430 msgr2=0x7f992c0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/224047690 2023-07-14T13:08:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.791+0000 7f993ffff640 1 --2- 172.21.15.5:0/2623264431 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f992c066430 0x7f992c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:08:43.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.795+0000 7f993cff9640 1 -- 172.21.15.5:0/2623264431 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f99380ec640 con 0x7f994015bde0 2023-07-14T13:08:43.866 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:43.837+0000 7fa17da2c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:08:43.922 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:43.893+0000 7fa17da2c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:08:43.973 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:43.939+0000 7f66c902c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:08:43.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.955+0000 7f99462f9640 1 -- 172.21.15.5:0/2623264431 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f99400678d0 con 0x7f994015bde0 2023-07-14T13:08:43.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.955+0000 7f993cff9640 1 -- 172.21.15.5:0/2623264431 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v84) v1 ==== 92+0+10 (secure 0 0 0) 0x7f99380efc60 con 0x7f994015bde0 2023-07-14T13:08:43.990 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:08:43.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.955+0000 7f99462f9640 1 -- 172.21.15.5:0/2623264431 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f992c066430 msgr2=0x7f992c0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:08:43.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.955+0000 7f99462f9640 1 --2- 172.21.15.5:0/2623264431 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f992c066430 0x7f992c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:43.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.955+0000 7f99462f9640 1 -- 172.21.15.5:0/2623264431 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f994015bde0 msgr2=0x7f99400cf380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.955+0000 7f99462f9640 1 --2- 172.21.15.5:0/2623264431 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f994015bde0 0x7f99400cf380 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f99380195e0 tx=0x7f9938019770 comp rx=0 tx=0).stop 2023-07-14T13:08:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.959+0000 7f99462f9640 1 -- 172.21.15.5:0/2623264431 shutdown_connections 2023-07-14T13:08:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.959+0000 7f99462f9640 1 --2- 172.21.15.5:0/2623264431 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f992c066430 0x7f992c0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.959+0000 7f99462f9640 1 --2- 172.21.15.5:0/2623264431 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f994015bde0 0x7f99400cf380 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.959+0000 7f99462f9640 1 --2- 172.21.15.5:0/2623264431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99400d2fc0 0x7f99400cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.959+0000 7f99462f9640 1 --2- 172.21.15.5:0/2623264431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99400d2300 0x7f9940154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.959+0000 7f99462f9640 1 -- 172.21.15.5:0/2623264431 >> 172.21.15.5:0/2623264431 conn(0x7f99400659d0 msgr2=0x7f99400cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:43.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.959+0000 7f99462f9640 1 -- 172.21.15.5:0/2623264431 shutdown_connections 2023-07-14T13:08:43.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:43.959+0000 7f99462f9640 1 -- 172.21.15.5:0/2623264431 wait complete. 2023-07-14T13:08:44.008 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:43.977+0000 7fa17da2c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:08:44.012 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T13:08:44.038 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:44.003+0000 7f66c902c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:08:44.067 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:44.037+0000 7fa17da2c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:08:44.098 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:44.063+0000 7f66c902c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:08:44.152 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:44.121+0000 7fa17da2c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:08:44.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.127+0000 7ff22772c640 1 Processor -- start 2023-07-14T13:08:44.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.127+0000 7ff22772c640 1 -- start start 2023-07-14T13:08:44.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.127+0000 7ff22772c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2200d2fc0 0x7ff2200b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.127+0000 7ff22772c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2200b04c0 con 0x7ff22015bde0 2023-07-14T13:08:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.127+0000 7ff22772c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2200d0aa0 con 0x7ff2200d2300 2023-07-14T13:08:44.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.127+0000 7ff22772c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22015c1b0 con 0x7ff2200d2fc0 2023-07-14T13:08:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.131+0000 7ff2254c8640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff22015bde0 0x7ff2200d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47248/0 (socket says 172.21.15.5:47248) 2023-07-14T13:08:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.131+0000 7ff2254c8640 1 -- 172.21.15.5:0/2772791036 learned_addr learned my addr 172.21.15.5:0/2772791036 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.131+0000 7ff224cc7640 1 --2- 172.21.15.5:0/2772791036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2200d2fc0 0x7ff2200b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.131+0000 7ff217fff640 1 -- 172.21.15.5:0/2772791036 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 998050331 0 0) 0x7ff2200b04c0 con 0x7ff22015bde0 2023-07-14T13:08:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.131+0000 7ff217fff640 1 -- 172.21.15.5:0/2772791036 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff20c003530 con 0x7ff22015bde0 2023-07-14T13:08:44.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.131+0000 7ff224cc7640 1 -- 172.21.15.5:0/2772791036 >> v1:172.21.15.154:6789/0 conn(0x7ff2200d2300 legacy=0x7ff2200cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.131+0000 7ff217fff640 1 -- 172.21.15.5:0/2772791036 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3393915686 0 0) 0x7ff2200d0aa0 con 0x7ff2200d2300 2023-07-14T13:08:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.131+0000 7ff224cc7640 1 -- 172.21.15.5:0/2772791036 >> v1:172.21.15.5:6789/0 conn(0x7ff22015bde0 legacy=0x7ff2200d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:44.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.131+0000 7ff224cc7640 1 -- 172.21.15.5:0/2772791036 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2200afb90 con 0x7ff2200d2fc0 2023-07-14T13:08:44.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.131+0000 7ff224cc7640 1 --2- 172.21.15.5:0/2772791036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2200d2fc0 0x7ff2200b0950 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff2100097f0 tx=0x7ff21001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=419de15ec1f7cab8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:44.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.131+0000 7ff217fff640 1 -- 172.21.15.5:0/2772791036 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2100aa620 con 0x7ff2200d2fc0 2023-07-14T13:08:44.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.131+0000 7ff217fff640 1 -- 172.21.15.5:0/2772791036 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2100aa780 con 0x7ff2200d2fc0 2023-07-14T13:08:44.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.131+0000 7ff217fff640 1 -- 172.21.15.5:0/2772791036 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2100aab10 con 0x7ff2200d2fc0 2023-07-14T13:08:44.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.135+0000 7ff22772c640 1 -- 172.21.15.5:0/2772791036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2200d2fc0 msgr2=0x7ff2200b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:44.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.135+0000 7ff22772c640 1 --2- 172.21.15.5:0/2772791036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2200d2fc0 0x7ff2200b0950 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff2100097f0 tx=0x7ff21001c4c0 comp rx=0 tx=0).stop 2023-07-14T13:08:44.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.135+0000 7ff22772c640 1 -- 172.21.15.5:0/2772791036 shutdown_connections 2023-07-14T13:08:44.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.135+0000 7ff22772c640 1 --2- 172.21.15.5:0/2772791036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2200d2fc0 0x7ff2200b0950 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:44.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.135+0000 7ff22772c640 1 -- 172.21.15.5:0/2772791036 >> 172.21.15.5:0/2772791036 conn(0x7ff2200659d0 msgr2=0x7ff22009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:44.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.135+0000 7ff22772c640 1 -- 172.21.15.5:0/2772791036 shutdown_connections 2023-07-14T13:08:44.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.135+0000 7ff22772c640 1 -- 172.21.15.5:0/2772791036 wait complete. 2023-07-14T13:08:44.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.135+0000 7ff22772c640 1 Processor -- start 2023-07-14T13:08:44.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.139+0000 7ff22772c640 1 -- start start 2023-07-14T13:08:44.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.139+0000 7ff22772c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2200d2300 0x7ff2200b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.139+0000 7ff22772c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2200d2fc0 0x7ff22015cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.139+0000 7ff22772c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff22015bde0 0x7ff2200cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.139+0000 7ff22772c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22015e170 con 0x7ff2200d2300 2023-07-14T13:08:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.139+0000 7ff22772c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2200b4440 con 0x7ff22015bde0 2023-07-14T13:08:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.139+0000 7ff22772c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22015d560 con 0x7ff2200d2fc0 2023-07-14T13:08:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.139+0000 7ff2254c8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2200d2300 0x7ff2200b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.139+0000 7ff2254c8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2200d2300 0x7ff2200b3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56282/0 (socket says 172.21.15.5:56282) 2023-07-14T13:08:44.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.139+0000 7ff2254c8640 1 -- 172.21.15.5:0/3966494050 learned_addr learned my addr 172.21.15.5:0/3966494050 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:44.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.139+0000 7ff224cc7640 1 --2- 172.21.15.5:0/3966494050 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2200d2fc0 0x7ff22015cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:44.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.139+0000 7ff225cc9640 1 --2- 172.21.15.5:0/3966494050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff22015bde0 0x7ff2200cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.139+0000 7ff2254c8640 1 -- 172.21.15.5:0/3966494050 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2200d2fc0 msgr2=0x7ff22015cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.139+0000 7ff2254c8640 1 --2- 172.21.15.5:0/3966494050 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2200d2fc0 0x7ff22015cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.139+0000 7ff2254c8640 1 -- 172.21.15.5:0/3966494050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff22015bde0 msgr2=0x7ff2200cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.139+0000 7ff2254c8640 1 --2- 172.21.15.5:0/3966494050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff22015bde0 0x7ff2200cd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.139+0000 7ff2254c8640 1 -- 172.21.15.5:0/3966494050 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff210009420 con 0x7ff2200d2300 2023-07-14T13:08:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.139+0000 7ff2254c8640 1 --2- 172.21.15.5:0/3966494050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2200d2300 0x7ff2200b3f00 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00c730 tx=0x7ff21c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.139+0000 7ff215ffb640 1 -- 172.21.15.5:0/3966494050 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c007270 con 0x7ff2200d2300 2023-07-14T13:08:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.139+0000 7ff215ffb640 1 -- 172.21.15.5:0/3966494050 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21c0073d0 con 0x7ff2200d2300 2023-07-14T13:08:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.139+0000 7ff215ffb640 1 -- 172.21.15.5:0/3966494050 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c001d50 con 0x7ff2200d2300 2023-07-14T13:08:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.139+0000 7ff22772c640 1 -- 172.21.15.5:0/3966494050 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff22015d840 con 0x7ff2200d2300 2023-07-14T13:08:44.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.139+0000 7ff22772c640 1 -- 172.21.15.5:0/3966494050 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22015de00 con 0x7ff2200d2300 2023-07-14T13:08:44.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.143+0000 7ff22772c640 1 -- 172.21.15.5:0/3966494050 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2200678d0 con 0x7ff2200d2300 2023-07-14T13:08:44.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.143+0000 7ff215ffb640 1 -- 172.21.15.5:0/3966494050 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 34) v1 ==== 85817+0+0 (secure 0 0 0) 0x7ff21c0057b0 con 0x7ff2200d2300 2023-07-14T13:08:44.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.143+0000 7ff215ffb640 1 --2- 172.21.15.5:0/3966494050 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7ff204066430 0x7ff2040688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.143+0000 7ff215ffb640 1 -- 172.21.15.5:0/3966494050 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6406+0+0 (secure 0 0 0) 0x7ff21c0836b0 con 0x7ff2200d2300 2023-07-14T13:08:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.143+0000 7ff224cc7640 1 -- 172.21.15.5:0/3966494050 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7ff204066430 msgr2=0x7ff2040688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/224047690 2023-07-14T13:08:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.143+0000 7ff224cc7640 1 --2- 172.21.15.5:0/3966494050 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7ff204066430 0x7ff2040688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:08:44.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.147+0000 7ff215ffb640 1 -- 172.21.15.5:0/3966494050 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff21c050820 con 0x7ff2200d2300 2023-07-14T13:08:44.193 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:44.159+0000 7f66c902c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:08:44.209 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:44.181+0000 7fa17da2c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:08:44.254 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:44.219+0000 7f66c902c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:08:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.303+0000 7ff22772c640 1 -- 172.21.15.5:0/3966494050 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff2200d1500 con 0x7ff2200d2300 2023-07-14T13:08:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.303+0000 7ff215ffb640 1 -- 172.21.15.5:0/3966494050 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff21c053e40 con 0x7ff2200d2300 2023-07-14T13:08:44.338 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T13:08:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.303+0000 7ff22772c640 1 -- 172.21.15.5:0/3966494050 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7ff204066430 msgr2=0x7ff2040688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:08:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.303+0000 7ff22772c640 1 --2- 172.21.15.5:0/3966494050 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7ff204066430 0x7ff2040688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.303+0000 7ff22772c640 1 -- 172.21.15.5:0/3966494050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2200d2300 msgr2=0x7ff2200b3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.303+0000 7ff22772c640 1 --2- 172.21.15.5:0/3966494050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2200d2300 0x7ff2200b3f00 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00c730 tx=0x7ff21c00cbf0 comp rx=0 tx=0).stop 2023-07-14T13:08:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.303+0000 7ff22772c640 1 -- 172.21.15.5:0/3966494050 shutdown_connections 2023-07-14T13:08:44.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.303+0000 7ff22772c640 1 --2- 172.21.15.5:0/3966494050 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7ff204066430 0x7ff2040688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.303+0000 7ff22772c640 1 --2- 172.21.15.5:0/3966494050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff22015bde0 0x7ff2200cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.303+0000 7ff22772c640 1 --2- 172.21.15.5:0/3966494050 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2200d2fc0 0x7ff22015cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.303+0000 7ff22772c640 1 --2- 172.21.15.5:0/3966494050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2200d2300 0x7ff2200b3f00 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.303+0000 7ff22772c640 1 -- 172.21.15.5:0/3966494050 >> 172.21.15.5:0/3966494050 conn(0x7ff2200659d0 msgr2=0x7ff2200b71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.303+0000 7ff22772c640 1 -- 172.21.15.5:0/3966494050 shutdown_connections 2023-07-14T13:08:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.303+0000 7ff22772c640 1 -- 172.21.15.5:0/3966494050 wait complete. 2023-07-14T13:08:44.343 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:44.311+0000 7f66c902c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:08:44.352 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:44.321+0000 7fa17da2c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:08:44.359 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T13:08:44.404 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:44.375+0000 7f66c902c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:08:44.410 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:44.381+0000 7fa17da2c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:08:44.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.519+0000 7f1e6d574640 1 Processor -- start 2023-07-14T13:08:44.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.519+0000 7f1e6d574640 1 -- start start 2023-07-14T13:08:44.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.519+0000 7f1e6d574640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e680d2fc0 0x7f1e680b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:44.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.519+0000 7f1e6d574640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e680d2300 0x7f1e680d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:44.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.519+0000 7f1e6d574640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e680b04c0 con 0x7f1e6815bde0 2023-07-14T13:08:44.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.519+0000 7f1e6d574640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e680d2ce0 con 0x7f1e680d2300 2023-07-14T13:08:44.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.519+0000 7f1e6d574640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6815c1b0 con 0x7f1e680d2fc0 2023-07-14T13:08:44.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.519+0000 7f1e677fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e680d2300 0x7f1e680d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:44.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.519+0000 7f1e677fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1e680d2300 0x7f1e680d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56294/0 (socket says 172.21.15.5:56294) 2023-07-14T13:08:44.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.519+0000 7f1e677fe640 1 -- 172.21.15.5:0/4247844405 learned_addr learned my addr 172.21.15.5:0/4247844405 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:44.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.519+0000 7f1e5ffff640 1 --2- 172.21.15.5:0/4247844405 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e680d2fc0 0x7f1e680b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.519+0000 7f1e677fe640 1 -- 172.21.15.5:0/4247844405 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e680d2fc0 msgr2=0x7f1e680b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.519+0000 7f1e677fe640 1 --2- 172.21.15.5:0/4247844405 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e680d2fc0 0x7f1e680b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.519+0000 7f1e677fe640 1 -- 172.21.15.5:0/4247844405 >> v1:172.21.15.154:6789/0 conn(0x7f1e6815bde0 legacy=0x7f1e680d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:44.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.519+0000 7f1e677fe640 1 -- 172.21.15.5:0/4247844405 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e680d0aa0 con 0x7f1e680d2300 2023-07-14T13:08:44.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.523+0000 7f1e677fe640 1 --2- 172.21.15.5:0/4247844405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e680d2300 0x7f1e680d27a0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f1e60009e50 tx=0x7f1e6001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b782f913115381eb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:44.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.523+0000 7f1e667fc640 1 -- 172.21.15.5:0/4247844405 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e600a58e0 con 0x7f1e680d2300 2023-07-14T13:08:44.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.523+0000 7f1e667fc640 1 -- 172.21.15.5:0/4247844405 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e600a5a40 con 0x7f1e680d2300 2023-07-14T13:08:44.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.523+0000 7f1e667fc640 1 -- 172.21.15.5:0/4247844405 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e600a5dd0 con 0x7f1e680d2300 2023-07-14T13:08:44.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.523+0000 7f1e6d574640 1 -- 172.21.15.5:0/4247844405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e680d2300 msgr2=0x7f1e680d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:44.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.523+0000 7f1e6d574640 1 --2- 172.21.15.5:0/4247844405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e680d2300 0x7f1e680d27a0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f1e60009e50 tx=0x7f1e6001ca10 comp rx=0 tx=0).stop 2023-07-14T13:08:44.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.523+0000 7f1e6d574640 1 -- 172.21.15.5:0/4247844405 shutdown_connections 2023-07-14T13:08:44.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.523+0000 7f1e6d574640 1 --2- 172.21.15.5:0/4247844405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e680d2300 0x7f1e680d27a0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:44.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.523+0000 7f1e6d574640 1 --2- 172.21.15.5:0/4247844405 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e680d2fc0 0x7f1e680b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:44.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.523+0000 7f1e6d574640 1 -- 172.21.15.5:0/4247844405 >> 172.21.15.5:0/4247844405 conn(0x7f1e680659d0 msgr2=0x7f1e6809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:44.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.523+0000 7f1e6d574640 1 -- 172.21.15.5:0/4247844405 shutdown_connections 2023-07-14T13:08:44.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.523+0000 7f1e6d574640 1 -- 172.21.15.5:0/4247844405 wait complete. 2023-07-14T13:08:44.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.527+0000 7f1e6d574640 1 Processor -- start 2023-07-14T13:08:44.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.527+0000 7f1e6d574640 1 -- start start 2023-07-14T13:08:44.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.527+0000 7f1e6d574640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e680d2300 0x7f1e680b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.527+0000 7f1e6d574640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e680d2fc0 0x7f1e6814ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.527+0000 7f1e6d574640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e6815bde0 0x7f1e681593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.527+0000 7f1e6d574640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e680b1390 con 0x7f1e680d2300 2023-07-14T13:08:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.527+0000 7f1e6d574640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e680b1650 con 0x7f1e6815bde0 2023-07-14T13:08:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.527+0000 7f1e6d574640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e680b1930 con 0x7f1e680d2fc0 2023-07-14T13:08:44.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.527+0000 7f1e66ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e680d2300 0x7f1e680b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:44.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.527+0000 7f1e66ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e680d2300 0x7f1e680b2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56308/0 (socket says 172.21.15.5:56308) 2023-07-14T13:08:44.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.527+0000 7f1e66ffd640 1 -- 172.21.15.5:0/396659687 learned_addr learned my addr 172.21.15.5:0/396659687 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:44.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.527+0000 7f1e5ffff640 1 --2- 172.21.15.5:0/396659687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e680d2fc0 0x7f1e6814ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:44.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.527+0000 7f1e677fe640 1 --2- 172.21.15.5:0/396659687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e6815bde0 0x7f1e681593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:44.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.527+0000 7f1e66ffd640 1 -- 172.21.15.5:0/396659687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e680d2fc0 msgr2=0x7f1e6814ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:44.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.527+0000 7f1e66ffd640 1 --2- 172.21.15.5:0/396659687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e680d2fc0 0x7f1e6814ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:44.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.527+0000 7f1e66ffd640 1 -- 172.21.15.5:0/396659687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e6815bde0 msgr2=0x7f1e681593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:44.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.527+0000 7f1e66ffd640 1 --2- 172.21.15.5:0/396659687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e6815bde0 0x7f1e681593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:44.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.527+0000 7f1e66ffd640 1 -- 172.21.15.5:0/396659687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e60009b30 con 0x7f1e680d2300 2023-07-14T13:08:44.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.527+0000 7f1e677fe640 1 --2- 172.21.15.5:0/396659687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e6815bde0 0x7f1e681593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:44.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.527+0000 7f1e66ffd640 1 --2- 172.21.15.5:0/396659687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e680d2300 0x7f1e680b2f80 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f1e5800c400 tx=0x7f1e5800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:44.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.527+0000 7f1e5f7fe640 1 -- 172.21.15.5:0/396659687 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e580052d0 con 0x7f1e680d2300 2023-07-14T13:08:44.561 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:44.527+0000 7f66c902c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:08:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.527+0000 7f1e5f7fe640 1 -- 172.21.15.5:0/396659687 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e58005470 con 0x7f1e680d2300 2023-07-14T13:08:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.527+0000 7f1e5f7fe640 1 -- 172.21.15.5:0/396659687 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e58006a70 con 0x7f1e680d2300 2023-07-14T13:08:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.527+0000 7f1e6d574640 1 -- 172.21.15.5:0/396659687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e680b1c10 con 0x7f1e680d2300 2023-07-14T13:08:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.527+0000 7f1e6d574640 1 -- 172.21.15.5:0/396659687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e6814ecc0 con 0x7f1e680d2300 2023-07-14T13:08:44.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.531+0000 7f1e6d574640 1 -- 172.21.15.5:0/396659687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e680678d0 con 0x7f1e680d2300 2023-07-14T13:08:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.531+0000 7f1e5f7fe640 1 -- 172.21.15.5:0/396659687 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 34) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f1e58006bd0 con 0x7f1e680d2300 2023-07-14T13:08:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.531+0000 7f1e5f7fe640 1 --2- 172.21.15.5:0/396659687 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f1e48066430 0x7f1e480688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.531+0000 7f1e5f7fe640 1 -- 172.21.15.5:0/396659687 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f1e58083530 con 0x7f1e680d2300 2023-07-14T13:08:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.531+0000 7f1e5ffff640 1 -- 172.21.15.5:0/396659687 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f1e48066430 msgr2=0x7f1e480688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/224047690 2023-07-14T13:08:44.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.531+0000 7f1e5ffff640 1 --2- 172.21.15.5:0/396659687 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f1e48066430 0x7f1e480688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:08:44.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.535+0000 7f1e5f7fe640 1 -- 172.21.15.5:0/396659687 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f1e58050680 con 0x7f1e680d2300 2023-07-14T13:08:44.621 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:44.591+0000 7f66c902c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:08:44.651 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:08:44.651 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:08:44.651 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:08:44.659 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:44.629+0000 7fa17da2c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:08:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.691+0000 7f1e6d574640 1 -- 172.21.15.5:0/396659687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1e680ce920 con 0x7f1e680d2300 2023-07-14T13:08:44.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.691+0000 7f1e5f7fe640 1 -- 172.21.15.5:0/396659687 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1e58053ca0 con 0x7f1e680d2300 2023-07-14T13:08:44.723 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T13:08:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.695+0000 7f1e6d574640 1 -- 172.21.15.5:0/396659687 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f1e48066430 msgr2=0x7f1e480688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:08:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.695+0000 7f1e6d574640 1 --2- 172.21.15.5:0/396659687 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f1e48066430 0x7f1e480688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.695+0000 7f1e6d574640 1 -- 172.21.15.5:0/396659687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e680d2300 msgr2=0x7f1e680b2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.695+0000 7f1e6d574640 1 --2- 172.21.15.5:0/396659687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e680d2300 0x7f1e680b2f80 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f1e5800c400 tx=0x7f1e5800c8c0 comp rx=0 tx=0).stop 2023-07-14T13:08:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.695+0000 7f1e6d574640 1 -- 172.21.15.5:0/396659687 shutdown_connections 2023-07-14T13:08:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.695+0000 7f1e6d574640 1 --2- 172.21.15.5:0/396659687 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f1e48066430 0x7f1e480688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.695+0000 7f1e6d574640 1 --2- 172.21.15.5:0/396659687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e6815bde0 0x7f1e681593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.695+0000 7f1e6d574640 1 --2- 172.21.15.5:0/396659687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1e680d2fc0 0x7f1e6814ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.695+0000 7f1e6d574640 1 --2- 172.21.15.5:0/396659687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e680d2300 0x7f1e680b2f80 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.695+0000 7f1e6d574640 1 -- 172.21.15.5:0/396659687 >> 172.21.15.5:0/396659687 conn(0x7f1e680659d0 msgr2=0x7f1e680b3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.695+0000 7f1e6d574640 1 -- 172.21.15.5:0/396659687 shutdown_connections 2023-07-14T13:08:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.695+0000 7f1e6d574640 1 -- 172.21.15.5:0/396659687 wait complete. 2023-07-14T13:08:44.746 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T13:08:44.792 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:44.765+0000 7fa17da2c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:08:44.877 INFO:tasks.ceph.mgr.y.smithi005.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:08:44.877 INFO:tasks.ceph.mgr.y.smithi005.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:08:44.878 INFO:tasks.ceph.mgr.y.smithi005.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:08:44.886 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:44.855+0000 7f66c902c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:08:44.918 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:44.889+0000 7fa17da2c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:08:44.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.895+0000 7fcee9b00640 1 Processor -- start 2023-07-14T13:08:44.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.895+0000 7fcee9b00640 1 -- start start 2023-07-14T13:08:44.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.899+0000 7fcee9b00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcee415fd60 0x7fcee40d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:44.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.899+0000 7fcee9b00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee40ccaf0 con 0x7fcee40d1850 2023-07-14T13:08:44.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.899+0000 7fcee9b00640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee4160320 con 0x7fcee40b7c70 2023-07-14T13:08:44.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.899+0000 7fcee9b00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee40d1190 con 0x7fcee415fd60 2023-07-14T13:08:44.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.899+0000 7fcee2ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcee415fd60 0x7fcee40d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:44.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.899+0000 7fcee2ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcee415fd60 0x7fcee40d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56316/0 (socket says 172.21.15.5:56316) 2023-07-14T13:08:44.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.899+0000 7fcee2ffd640 1 -- 172.21.15.5:0/995311793 learned_addr learned my addr 172.21.15.5:0/995311793 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:44.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.899+0000 7fcee2ffd640 1 -- 172.21.15.5:0/995311793 >> v1:172.21.15.154:6789/0 conn(0x7fcee40b7c70 legacy=0x7fcee415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:44.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.899+0000 7fcee2ffd640 1 -- 172.21.15.5:0/995311793 >> v1:172.21.15.5:6789/0 conn(0x7fcee40d1850 legacy=0x7fcee40d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:44.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.899+0000 7fcee2ffd640 1 -- 172.21.15.5:0/995311793 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee40ccd90 con 0x7fcee415fd60 2023-07-14T13:08:44.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.899+0000 7fcee27fc640 1 -- 172.21.15.5:0/995311793 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703106147 0 0) 0x7fcee40ccaf0 con 0x7fcee40d1850 2023-07-14T13:08:44.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.899+0000 7fcee2ffd640 1 --2- 172.21.15.5:0/995311793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcee415fd60 0x7fcee40d0c50 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fced8009870 tx=0x7fced801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcbc50b1ebbe3ed5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:44.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.903+0000 7fcee27fc640 1 -- 172.21.15.5:0/995311793 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced80ab650 con 0x7fcee415fd60 2023-07-14T13:08:44.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.903+0000 7fcee27fc640 1 -- 172.21.15.5:0/995311793 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced80ab7b0 con 0x7fcee415fd60 2023-07-14T13:08:44.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.903+0000 7fcee27fc640 1 -- 172.21.15.5:0/995311793 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced80abb40 con 0x7fcee415fd60 2023-07-14T13:08:44.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.903+0000 7fcee9b00640 1 -- 172.21.15.5:0/995311793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcee415fd60 msgr2=0x7fcee40d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:44.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.903+0000 7fcee9b00640 1 --2- 172.21.15.5:0/995311793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcee415fd60 0x7fcee40d0c50 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fced8009870 tx=0x7fced801c540 comp rx=0 tx=0).stop 2023-07-14T13:08:44.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.903+0000 7fcee9b00640 1 -- 172.21.15.5:0/995311793 shutdown_connections 2023-07-14T13:08:44.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.903+0000 7fcee9b00640 1 --2- 172.21.15.5:0/995311793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcee415fd60 0x7fcee40d0c50 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:44.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.903+0000 7fcee9b00640 1 -- 172.21.15.5:0/995311793 >> 172.21.15.5:0/995311793 conn(0x7fcee40650b0 msgr2=0x7fcee40654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:44.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.903+0000 7fcee9b00640 1 -- 172.21.15.5:0/995311793 shutdown_connections 2023-07-14T13:08:44.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.903+0000 7fcee9b00640 1 -- 172.21.15.5:0/995311793 wait complete. 2023-07-14T13:08:44.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.903+0000 7fcee9b00640 1 Processor -- start 2023-07-14T13:08:44.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.903+0000 7fcee9b00640 1 -- start start 2023-07-14T13:08:44.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.903+0000 7fcee9b00640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcee40b7c70 0x7fcee414b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:44.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.903+0000 7fcee9b00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcee40d1850 0x7fcee414a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:44.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.903+0000 7fcee9b00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcee415fd60 0x7fcee4151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:44.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.903+0000 7fcee9b00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee414a210 con 0x7fcee415fd60 2023-07-14T13:08:44.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.903+0000 7fcee9b00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee41498e0 con 0x7fcee40d1850 2023-07-14T13:08:44.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.903+0000 7fcee9b00640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee4149bc0 con 0x7fcee40b7c70 2023-07-14T13:08:44.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.907+0000 7fcee37fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcee40b7c70 0x7fcee414b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:44.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.907+0000 7fcee3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcee415fd60 0x7fcee4151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:44.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.907+0000 7fcee2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcee40d1850 0x7fcee414a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:44.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.907+0000 7fcee37fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcee40b7c70 0x7fcee414b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:46994/0 (socket says 172.21.15.5:46994) 2023-07-14T13:08:44.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.907+0000 7fcee37fe640 1 -- 172.21.15.5:0/547239728 learned_addr learned my addr 172.21.15.5:0/547239728 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:44.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.907+0000 7fcee37fe640 1 -- 172.21.15.5:0/547239728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcee40d1850 msgr2=0x7fcee414a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:44.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.907+0000 7fcee37fe640 1 --2- 172.21.15.5:0/547239728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcee40d1850 0x7fcee414a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:44.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.907+0000 7fcee37fe640 1 -- 172.21.15.5:0/547239728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcee415fd60 msgr2=0x7fcee4151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:44.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.907+0000 7fcee37fe640 1 --2- 172.21.15.5:0/547239728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcee415fd60 0x7fcee4151680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:44.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.907+0000 7fcee37fe640 1 -- 172.21.15.5:0/547239728 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced80094d0 con 0x7fcee40b7c70 2023-07-14T13:08:44.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.907+0000 7fcee2ffd640 1 --2- 172.21.15.5:0/547239728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcee40d1850 0x7fcee414a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:44.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.907+0000 7fcee3fff640 1 --2- 172.21.15.5:0/547239728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcee415fd60 0x7fcee4151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:44.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.907+0000 7fcee37fe640 1 --2- 172.21.15.5:0/547239728 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcee40b7c70 0x7fcee414b690 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fced400c3c0 tx=0x7fced400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:44.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.907+0000 7fcecbfff640 1 -- 172.21.15.5:0/547239728 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced40052d0 con 0x7fcee40b7c70 2023-07-14T13:08:44.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.907+0000 7fcecbfff640 1 -- 172.21.15.5:0/547239728 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced4005430 con 0x7fcee40b7c70 2023-07-14T13:08:44.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.907+0000 7fcecbfff640 1 -- 172.21.15.5:0/547239728 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced4003840 con 0x7fcee40b7c70 2023-07-14T13:08:44.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.907+0000 7fcee9b00640 1 -- 172.21.15.5:0/547239728 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee4149ea0 con 0x7fcee40b7c70 2023-07-14T13:08:44.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.907+0000 7fcee9b00640 1 -- 172.21.15.5:0/547239728 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee414bbd0 con 0x7fcee40b7c70 2023-07-14T13:08:44.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.907+0000 7fcee9b00640 1 -- 172.21.15.5:0/547239728 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee40678d0 con 0x7fcee40b7c70 2023-07-14T13:08:44.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.907+0000 7fcecbfff640 1 -- 172.21.15.5:0/547239728 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 34) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fced40039a0 con 0x7fcee40b7c70 2023-07-14T13:08:44.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.911+0000 7fcecbfff640 1 --2- 172.21.15.5:0/547239728 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7fced0066430 0x7fced00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:44.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.911+0000 7fcecbfff640 1 -- 172.21.15.5:0/547239728 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fced4083630 con 0x7fcee40b7c70 2023-07-14T13:08:44.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.911+0000 7fcee2ffd640 1 -- 172.21.15.5:0/547239728 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7fced0066430 msgr2=0x7fced00688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/224047690 2023-07-14T13:08:44.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.911+0000 7fcee2ffd640 1 --2- 172.21.15.5:0/547239728 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7fced0066430 0x7fced00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:08:44.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:44.915+0000 7fcecbfff640 1 -- 172.21.15.5:0/547239728 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fced4050790 con 0x7fcee40b7c70 2023-07-14T13:08:44.991 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:44.961+0000 7fa17da2c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:08:45.052 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:45.019+0000 7f66c902c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:08:45.125 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:45.097+0000 7fa17da2c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:08:45.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.103+0000 7fcee9b00640 1 -- 172.21.15.5:0/547239728 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcee4149d00 con 0x7fcee40b7c70 2023-07-14T13:08:45.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.103+0000 7fcecbfff640 1 -- 172.21.15.5:0/547239728 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v84) v1 ==== 80+0+476 (secure 0 0 0) 0x7fcee4149d00 con 0x7fcee40b7c70 2023-07-14T13:08:45.134 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:6833/1874317247 2023-07-15T13:08:40.475248+0000 2023-07-14T13:08:45.134 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:6832/1874317247 2023-07-15T13:08:40.475248+0000 2023-07-14T13:08:45.134 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/2022303100 2023-07-15T13:08:40.475248+0000 2023-07-14T13:08:45.134 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/857765741 2023-07-15T13:08:40.475248+0000 2023-07-14T13:08:45.134 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/1586644269 2023-07-15T13:08:40.475248+0000 2023-07-14T13:08:45.135 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/974976956 2023-07-15T13:08:40.475248+0000 2023-07-14T13:08:45.135 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/2603107851 2023-07-15T13:08:40.475248+0000 2023-07-14T13:08:45.135 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/2677415683 2023-07-15T13:08:40.475248+0000 2023-07-14T13:08:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:listed 8 entries 2023-07-14T13:08:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.103+0000 7fcee9b00640 1 -- 172.21.15.5:0/547239728 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7fced0066430 msgr2=0x7fced00688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:08:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.103+0000 7fcee9b00640 1 --2- 172.21.15.5:0/547239728 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7fced0066430 0x7fced00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.103+0000 7fcee9b00640 1 -- 172.21.15.5:0/547239728 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcee40b7c70 msgr2=0x7fcee414b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.103+0000 7fcee9b00640 1 --2- 172.21.15.5:0/547239728 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcee40b7c70 0x7fcee414b690 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fced400c3c0 tx=0x7fced400c880 comp rx=0 tx=0).stop 2023-07-14T13:08:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.103+0000 7fcee9b00640 1 -- 172.21.15.5:0/547239728 shutdown_connections 2023-07-14T13:08:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.103+0000 7fcee9b00640 1 --2- 172.21.15.5:0/547239728 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7fced0066430 0x7fced00688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.103+0000 7fcee9b00640 1 --2- 172.21.15.5:0/547239728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcee415fd60 0x7fcee4151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.103+0000 7fcee9b00640 1 --2- 172.21.15.5:0/547239728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcee40d1850 0x7fcee414a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.103+0000 7fcee9b00640 1 --2- 172.21.15.5:0/547239728 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcee40b7c70 0x7fcee414b690 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.103+0000 7fcee9b00640 1 -- 172.21.15.5:0/547239728 >> 172.21.15.5:0/547239728 conn(0x7fcee40650b0 msgr2=0x7fcee40b2670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.103+0000 7fcee9b00640 1 -- 172.21.15.5:0/547239728 shutdown_connections 2023-07-14T13:08:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.103+0000 7fcee9b00640 1 -- 172.21.15.5:0/547239728 wait complete. 2023-07-14T13:08:45.155 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-14T13:08:45.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:08:45.156 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-14T13:08:45.187 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:45.155+0000 7f66c902c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:08:45.216 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-07-14T13:08:45.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:08:45.217 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-14T13:08:45.261 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:45.231+0000 7f66c902c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:08:45.271 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:08:45.271 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:08:45.280 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:08:45.281 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:08:45.281 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:08:45.320 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:08:45.321 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:08:45.321 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:08:45.332 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:08:45.332 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:08:45.404 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:45.375+0000 7f66c902c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:08:45.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.479+0000 7f4d99596640 1 Processor -- start 2023-07-14T13:08:45.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.479+0000 7f4d99596640 1 -- start start 2023-07-14T13:08:45.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.479+0000 7f4d99596640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4d940c8ad0 0x7f4d940c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:45.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.479+0000 7f4d99596640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d940c9560 0x7f4d940ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:45.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.479+0000 7f4d99596640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d940cc700 con 0x7f4d94158ce0 2023-07-14T13:08:45.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.479+0000 7f4d99596640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d940c99e0 con 0x7f4d940c8ad0 2023-07-14T13:08:45.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.479+0000 7f4d99596640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d940b0ff0 con 0x7f4d940c9560 2023-07-14T13:08:45.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.479+0000 7f4d92ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4d94158ce0 0x7f4d94070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47270/0 (socket says 172.21.15.5:47270) 2023-07-14T13:08:45.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.479+0000 7f4d92ffd640 1 -- 172.21.15.5:0/1848999669 learned_addr learned my addr 172.21.15.5:0/1848999669 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:45.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.479+0000 7f4d927fc640 1 --2- 172.21.15.5:0/1848999669 >> v2:172.21.15.154:3300/0 conn(0x7f4d940c8ad0 0x7f4d940c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:45.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.479+0000 7f4d937fe640 1 --2- 172.21.15.5:0/1848999669 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d940c9560 0x7f4d940ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:45.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.479+0000 7f4d91ffb640 1 -- 172.21.15.5:0/1848999669 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 61669226 0 0) 0x7f4d940cc700 con 0x7f4d94158ce0 2023-07-14T13:08:45.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.479+0000 7f4d91ffb640 1 -- 172.21.15.5:0/1848999669 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d7c003530 con 0x7f4d94158ce0 2023-07-14T13:08:45.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.479+0000 7f4d937fe640 1 -- 172.21.15.5:0/1848999669 >> v2:172.21.15.154:3300/0 conn(0x7f4d940c8ad0 msgr2=0x7f4d940c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:45.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.479+0000 7f4d937fe640 1 --2- 172.21.15.5:0/1848999669 >> v2:172.21.15.154:3300/0 conn(0x7f4d940c8ad0 0x7f4d940c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:45.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.479+0000 7f4d937fe640 1 -- 172.21.15.5:0/1848999669 >> v1:172.21.15.5:6789/0 conn(0x7f4d94158ce0 legacy=0x7f4d94070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:45.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.479+0000 7f4d91ffb640 1 -- 172.21.15.5:0/1848999669 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1643270646 0 0) 0x7f4d7c003530 con 0x7f4d94158ce0 2023-07-14T13:08:45.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.479+0000 7f4d937fe640 1 -- 172.21.15.5:0/1848999669 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d94070c80 con 0x7f4d940c9560 2023-07-14T13:08:45.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.479+0000 7f4d927fc640 1 --2- 172.21.15.5:0/1848999669 >> v2:172.21.15.154:3300/0 conn(0x7f4d940c8ad0 0x7f4d940c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:45.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.483+0000 7f4d937fe640 1 --2- 172.21.15.5:0/1848999669 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d940c9560 0x7f4d940ccb90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009d90 tx=0x7f4d8c01c720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=687e2e12460e3aa1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:45.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.483+0000 7f4d91ffb640 1 -- 172.21.15.5:0/1848999669 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d84001680 con 0x7f4d940c9560 2023-07-14T13:08:45.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.483+0000 7f4d91ffb640 1 -- 172.21.15.5:0/1848999669 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8c0a6440 con 0x7f4d940c9560 2023-07-14T13:08:45.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.483+0000 7f4d91ffb640 1 -- 172.21.15.5:0/1848999669 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c0a67d0 con 0x7f4d940c9560 2023-07-14T13:08:45.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.483+0000 7f4d99596640 1 -- 172.21.15.5:0/1848999669 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d940c9560 msgr2=0x7f4d940ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:45.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.483+0000 7f4d99596640 1 --2- 172.21.15.5:0/1848999669 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d940c9560 0x7f4d940ccb90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009d90 tx=0x7f4d8c01c720 comp rx=0 tx=0).stop 2023-07-14T13:08:45.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.483+0000 7f4d99596640 1 -- 172.21.15.5:0/1848999669 shutdown_connections 2023-07-14T13:08:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.483+0000 7f4d99596640 1 --2- 172.21.15.5:0/1848999669 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d940c9560 0x7f4d940ccb90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.483+0000 7f4d99596640 1 --2- 172.21.15.5:0/1848999669 >> v2:172.21.15.154:3300/0 conn(0x7f4d940c8ad0 0x7f4d940c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.483+0000 7f4d99596640 1 -- 172.21.15.5:0/1848999669 >> 172.21.15.5:0/1848999669 conn(0x7f4d940afcf0 msgr2=0x7f4d940b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.483+0000 7f4d99596640 1 -- 172.21.15.5:0/1848999669 shutdown_connections 2023-07-14T13:08:45.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.483+0000 7f4d99596640 1 -- 172.21.15.5:0/1848999669 wait complete. 2023-07-14T13:08:45.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.487+0000 7f4d99596640 1 Processor -- start 2023-07-14T13:08:45.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.487+0000 7f4d99596640 1 -- start start 2023-07-14T13:08:45.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.487+0000 7f4d99596640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d940c8ad0 0x7f4d940b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:45.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.487+0000 7f4d99596640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d940c9560 0x7f4d940b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:45.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.487+0000 7f4d99596640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d94158ce0 0x7f4d9406b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:45.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.487+0000 7f4d99596640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d94148100 con 0x7f4d940c9560 2023-07-14T13:08:45.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.487+0000 7f4d99596640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d940b1a10 con 0x7f4d94158ce0 2023-07-14T13:08:45.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.487+0000 7f4d99596640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d940b1cf0 con 0x7f4d940c8ad0 2023-07-14T13:08:45.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.487+0000 7f4d927fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d940c9560 0x7f4d940b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:45.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.487+0000 7f4d927fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d940c9560 0x7f4d940b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56332/0 (socket says 172.21.15.5:56332) 2023-07-14T13:08:45.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.487+0000 7f4d927fc640 1 -- 172.21.15.5:0/117639768 learned_addr learned my addr 172.21.15.5:0/117639768 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:45.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.487+0000 7f4d937fe640 1 --2- 172.21.15.5:0/117639768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d94158ce0 0x7f4d9406b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:45.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.487+0000 7f4d92ffd640 1 --2- 172.21.15.5:0/117639768 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d940c8ad0 0x7f4d940b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:45.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.487+0000 7f4d927fc640 1 -- 172.21.15.5:0/117639768 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d940c8ad0 msgr2=0x7f4d940b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:45.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.487+0000 7f4d927fc640 1 --2- 172.21.15.5:0/117639768 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d940c8ad0 0x7f4d940b3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:45.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.487+0000 7f4d927fc640 1 -- 172.21.15.5:0/117639768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d94158ce0 msgr2=0x7f4d9406b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:45.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.487+0000 7f4d927fc640 1 --2- 172.21.15.5:0/117639768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d94158ce0 0x7f4d9406b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:45.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.487+0000 7f4d927fc640 1 -- 172.21.15.5:0/117639768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d88009420 con 0x7f4d940c9560 2023-07-14T13:08:45.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.487+0000 7f4d937fe640 1 --2- 172.21.15.5:0/117639768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d94158ce0 0x7f4d9406b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:45.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.487+0000 7f4d927fc640 1 --2- 172.21.15.5:0/117639768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d940c9560 0x7f4d940b1130 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f4d8800ebe0 tx=0x7f4d8800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:45.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.487+0000 7f4d7b7fe640 1 -- 172.21.15.5:0/117639768 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8800eee0 con 0x7f4d940c9560 2023-07-14T13:08:45.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.487+0000 7f4d7b7fe640 1 -- 172.21.15.5:0/117639768 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8800cc30 con 0x7f4d940c9560 2023-07-14T13:08:45.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.487+0000 7f4d99596640 1 -- 172.21.15.5:0/117639768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d8c009a70 con 0x7f4d940c9560 2023-07-14T13:08:45.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.487+0000 7f4d7b7fe640 1 -- 172.21.15.5:0/117639768 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d88013470 con 0x7f4d940c9560 2023-07-14T13:08:45.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.487+0000 7f4d99596640 1 -- 172.21.15.5:0/117639768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d940c2360 con 0x7f4d940c9560 2023-07-14T13:08:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.491+0000 7f4d99596640 1 -- 172.21.15.5:0/117639768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d940ca1a0 con 0x7f4d940c9560 2023-07-14T13:08:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.491+0000 7f4d7b7fe640 1 -- 172.21.15.5:0/117639768 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 34) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f4d880135d0 con 0x7f4d940c9560 2023-07-14T13:08:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.491+0000 7f4d7b7fe640 1 --2- 172.21.15.5:0/117639768 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f4d80066430 0x7f4d800688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.491+0000 7f4d7b7fe640 1 -- 172.21.15.5:0/117639768 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f4d88084860 con 0x7f4d940c9560 2023-07-14T13:08:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.491+0000 7f4d92ffd640 1 -- 172.21.15.5:0/117639768 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f4d80066430 msgr2=0x7f4d800688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/224047690 2023-07-14T13:08:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.491+0000 7f4d92ffd640 1 --2- 172.21.15.5:0/117639768 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f4d80066430 0x7f4d800688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:08:45.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.499+0000 7f4d7b7fe640 1 -- 172.21.15.5:0/117639768 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4d88051910 con 0x7f4d940c9560 2023-07-14T13:08:45.673 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:45.645+0000 7fa17da2c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:08:45.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.691+0000 7f4d99596640 1 -- 172.21.15.5:0/117639768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d940c21c0 con 0x7f4d940c9560 2023-07-14T13:08:45.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.691+0000 7f4d7b7fe640 1 -- 172.21.15.5:0/117639768 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4710 (secure 0 0 0) 0x7f4d940c21c0 con 0x7f4d940c9560 2023-07-14T13:08:45.721 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:45.721 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5837,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3019701155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3019701155},{"type":"v1","addr":"172.21.15.5:6835","nonce":3019701155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5843,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1673574180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1673574180},{"type":"v1","addr":"172.21.15.154:6837","nonce":1673574180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6421,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3017507974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3017507974},{"type":"v1","addr":"172.21.15.154:6836","nonce":3017507974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:08:23.268544+0000","modified":"2023-07-14T13:08:26.903497+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6576},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6576":{"gid":6576,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/1613814904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1613814904},{"type":"v1","addr":"172.21.15.5:6834","nonce":1613814904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-14T13:08:45.722 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 32 2023-07-14T13:08:45.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.691+0000 7f4d99596640 1 -- 172.21.15.5:0/117639768 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f4d80066430 msgr2=0x7f4d800688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:08:45.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.691+0000 7f4d99596640 1 --2- 172.21.15.5:0/117639768 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f4d80066430 0x7f4d800688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:45.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.691+0000 7f4d99596640 1 -- 172.21.15.5:0/117639768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d940c9560 msgr2=0x7f4d940b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:45.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.691+0000 7f4d99596640 1 --2- 172.21.15.5:0/117639768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d940c9560 0x7f4d940b1130 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f4d8800ebe0 tx=0x7f4d8800c520 comp rx=0 tx=0).stop 2023-07-14T13:08:45.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.691+0000 7f4d99596640 1 -- 172.21.15.5:0/117639768 shutdown_connections 2023-07-14T13:08:45.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.691+0000 7f4d99596640 1 --2- 172.21.15.5:0/117639768 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f4d80066430 0x7f4d800688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:45.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.691+0000 7f4d99596640 1 --2- 172.21.15.5:0/117639768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d94158ce0 0x7f4d9406b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:45.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.691+0000 7f4d99596640 1 --2- 172.21.15.5:0/117639768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d940c9560 0x7f4d940b1130 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:45.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.691+0000 7f4d99596640 1 --2- 172.21.15.5:0/117639768 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d940c8ad0 0x7f4d940b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:45.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.691+0000 7f4d99596640 1 -- 172.21.15.5:0/117639768 >> 172.21.15.5:0/117639768 conn(0x7f4d940afcf0 msgr2=0x7f4d94151670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:45.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.691+0000 7f4d99596640 1 -- 172.21.15.5:0/117639768 shutdown_connections 2023-07-14T13:08:45.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.691+0000 7f4d99596640 1 -- 172.21.15.5:0/117639768 wait complete. 2023-07-14T13:08:45.744 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:08:45.759 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:45.729+0000 7fa17da2c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:08:45.906 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:45.877+0000 7fa17da2c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:08:45.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.899+0000 7f420f59e640 1 Processor -- start 2023-07-14T13:08:45.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.903+0000 7f420f59e640 1 -- start start 2023-07-14T13:08:45.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.903+0000 7f420f59e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42100b42c0 0x7f421006a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:45.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.903+0000 7f420f59e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42100cf310 con 0x7f42100b7a10 2023-07-14T13:08:45.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.903+0000 7f420f59e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42100ccee0 con 0x7f42100cee90 2023-07-14T13:08:45.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.903+0000 7f420f59e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42100cff30 con 0x7f42100b42c0 2023-07-14T13:08:45.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.903+0000 7f420e59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f42100b7a10 0x7f42100b3bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47274/0 (socket says 172.21.15.5:47274) 2023-07-14T13:08:45.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.903+0000 7f420e59c640 1 -- 172.21.15.5:0/468216246 learned_addr learned my addr 172.21.15.5:0/468216246 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:45.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.903+0000 7f4207fff640 1 --2- 172.21.15.5:0/468216246 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42100b42c0 0x7f421006a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.903+0000 7f4207fff640 1 -- 172.21.15.5:0/468216246 >> v1:172.21.15.154:6789/0 conn(0x7f42100cee90 legacy=0x7f42100d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.903+0000 7f4207fff640 1 -- 172.21.15.5:0/468216246 >> v1:172.21.15.5:6789/0 conn(0x7f42100b7a10 legacy=0x7f42100b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.903+0000 7f420dd9b640 1 -- 172.21.15.5:0/468216246 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3983819691 0 0) 0x7f42100ccee0 con 0x7f42100cee90 2023-07-14T13:08:45.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.903+0000 7f4207fff640 1 -- 172.21.15.5:0/468216246 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42100cc920 con 0x7f42100b42c0 2023-07-14T13:08:45.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.907+0000 7f4207fff640 1 --2- 172.21.15.5:0/468216246 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42100b42c0 0x7f421006a9b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f41f80097f0 tx=0x7f41f801c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64f48a73518a8e0a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:45.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.907+0000 7f420dd9b640 1 -- 172.21.15.5:0/468216246 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f80ab600 con 0x7f42100b42c0 2023-07-14T13:08:45.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.907+0000 7f420dd9b640 1 -- 172.21.15.5:0/468216246 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f80a7050 con 0x7f42100b42c0 2023-07-14T13:08:45.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.907+0000 7f420dd9b640 1 -- 172.21.15.5:0/468216246 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f80ab980 con 0x7f42100b42c0 2023-07-14T13:08:45.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.907+0000 7f420f59e640 1 -- 172.21.15.5:0/468216246 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42100b42c0 msgr2=0x7f421006a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.907+0000 7f420f59e640 1 --2- 172.21.15.5:0/468216246 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42100b42c0 0x7f421006a9b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f41f80097f0 tx=0x7f41f801c320 comp rx=0 tx=0).stop 2023-07-14T13:08:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.907+0000 7f420f59e640 1 -- 172.21.15.5:0/468216246 shutdown_connections 2023-07-14T13:08:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.907+0000 7f420f59e640 1 --2- 172.21.15.5:0/468216246 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42100b42c0 0x7f421006a9b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.907+0000 7f420f59e640 1 -- 172.21.15.5:0/468216246 >> 172.21.15.5:0/468216246 conn(0x7f4210069ea0 msgr2=0x7f421006a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.907+0000 7f420f59e640 1 -- 172.21.15.5:0/468216246 shutdown_connections 2023-07-14T13:08:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.907+0000 7f420f59e640 1 -- 172.21.15.5:0/468216246 wait complete. 2023-07-14T13:08:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.911+0000 7f420f59e640 1 Processor -- start 2023-07-14T13:08:45.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.911+0000 7f420f59e640 1 -- start start 2023-07-14T13:08:45.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.911+0000 7f420f59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42100b42c0 0x7f4210153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:45.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.911+0000 7f420f59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42100b7a10 0x7f42101578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:45.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.911+0000 7f420f59e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42100cee90 0x7f421014da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:45.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.911+0000 7f420f59e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4210151420 con 0x7f42100b7a10 2023-07-14T13:08:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.911+0000 7f420f59e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42101507e0 con 0x7f42100b42c0 2023-07-14T13:08:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.911+0000 7f420f59e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4210151610 con 0x7f42100cee90 2023-07-14T13:08:45.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.911+0000 7f4207fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42100b7a10 0x7f42101578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:45.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.911+0000 7f420e59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42100b42c0 0x7f4210153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:45.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.911+0000 7f4207fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42100b7a10 0x7f42101578d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56340/0 (socket says 172.21.15.5:56340) 2023-07-14T13:08:45.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.911+0000 7f4207fff640 1 -- 172.21.15.5:0/3565195698 learned_addr learned my addr 172.21.15.5:0/3565195698 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:45.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.911+0000 7f420ed9d640 1 --2- 172.21.15.5:0/3565195698 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42100cee90 0x7f421014da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:45.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.911+0000 7f4207fff640 1 -- 172.21.15.5:0/3565195698 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42100cee90 msgr2=0x7f421014da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:45.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.911+0000 7f4207fff640 1 --2- 172.21.15.5:0/3565195698 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42100cee90 0x7f421014da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:45.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.911+0000 7f4207fff640 1 -- 172.21.15.5:0/3565195698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42100b42c0 msgr2=0x7f4210153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:45.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.911+0000 7f4207fff640 1 --2- 172.21.15.5:0/3565195698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42100b42c0 0x7f4210153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:45.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.911+0000 7f4207fff640 1 -- 172.21.15.5:0/3565195698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f8009420 con 0x7f42100b7a10 2023-07-14T13:08:45.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.911+0000 7f4207fff640 1 --2- 172.21.15.5:0/3565195698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42100b7a10 0x7f42101578d0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f41f80097f0 tx=0x7f41f801ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:45.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.915+0000 7f4206ffd640 1 -- 172.21.15.5:0/3565195698 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f80b7660 con 0x7f42100b7a10 2023-07-14T13:08:45.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.915+0000 7f4206ffd640 1 -- 172.21.15.5:0/3565195698 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f80b77c0 con 0x7f42100b7a10 2023-07-14T13:08:45.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.915+0000 7f4206ffd640 1 -- 172.21.15.5:0/3565195698 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f80b7b70 con 0x7f42100b7a10 2023-07-14T13:08:45.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.915+0000 7f420f59e640 1 -- 172.21.15.5:0/3565195698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42100cbac0 con 0x7f42100b7a10 2023-07-14T13:08:45.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.915+0000 7f420f59e640 1 -- 172.21.15.5:0/3565195698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f421014df90 con 0x7f42100b7a10 2023-07-14T13:08:45.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.915+0000 7f420f59e640 1 -- 172.21.15.5:0/3565195698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42100cb920 con 0x7f42100b7a10 2023-07-14T13:08:45.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.915+0000 7f4206ffd640 1 -- 172.21.15.5:0/3565195698 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 34) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f41f80b7cd0 con 0x7f42100b7a10 2023-07-14T13:08:45.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.915+0000 7f4206ffd640 1 --2- 172.21.15.5:0/3565195698 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f41f0066430 0x7f41f00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:45.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.915+0000 7f4206ffd640 1 -- 172.21.15.5:0/3565195698 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f41f811ec20 con 0x7f42100b7a10 2023-07-14T13:08:45.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.915+0000 7f420e59c640 1 -- 172.21.15.5:0/3565195698 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f41f0066430 msgr2=0x7f41f00688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/224047690 2023-07-14T13:08:45.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.915+0000 7f420e59c640 1 --2- 172.21.15.5:0/3565195698 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f41f0066430 0x7f41f00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:08:45.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:45.923+0000 7f4206ffd640 1 -- 172.21.15.5:0/3565195698 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f42100cb920 con 0x7f42100b7a10 2023-07-14T13:08:45.993 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:45.963+0000 7f66c902c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:08:45.994 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:45.965+0000 7fa17da2c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:08:46.083 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:46.051+0000 7f66c902c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:08:46.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.079+0000 7f420f59e640 1 -- 172.21.15.5:0/3565195698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4210071900 con 0x7f42100b7a10 2023-07-14T13:08:46.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.083+0000 7f4206ffd640 1 -- 172.21.15.5:0/3565195698 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+18752 (secure 0 0 0) 0x7f4210071900 con 0x7f42100b7a10 2023-07-14T13:08:46.112 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:46.113 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":84,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:08:40.475286+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:08:21.382297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-14T13:08:22.261284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6833/1874317247":"2023-07-15T13:08:40.475248+0000","172.21.15.154:6832/1874317247":"2023-07-15T13:08:40.475248+0000","172.21.15.154:0/2022303100":"2023-07-15T13:08:40.475248+0000","172.21.15.154:0/857765741":"2023-07-15T13:08:40.475248+0000","172.21.15.154:0/1586644269":"2023-07-15T13:08:40.475248+0000","172.21.15.154:0/974976956":"2023-07-15T13:08:40.475248+0000","172.21.15.154:0/2603107851":"2023-07-15T13:08:40.475248+0000","172.21.15.154:0/2677415683":"2023-07-15T13:08:40.475248+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:08:46.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.083+0000 7f420f59e640 1 -- 172.21.15.5:0/3565195698 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f41f0066430 msgr2=0x7f41f00688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:08:46.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.083+0000 7f420f59e640 1 --2- 172.21.15.5:0/3565195698 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f41f0066430 0x7f41f00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.083+0000 7f420f59e640 1 -- 172.21.15.5:0/3565195698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42100b7a10 msgr2=0x7f42101578d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.083+0000 7f420f59e640 1 --2- 172.21.15.5:0/3565195698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42100b7a10 0x7f42101578d0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f41f80097f0 tx=0x7f41f801ab60 comp rx=0 tx=0).stop 2023-07-14T13:08:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.083+0000 7f420f59e640 1 -- 172.21.15.5:0/3565195698 shutdown_connections 2023-07-14T13:08:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.083+0000 7f420f59e640 1 --2- 172.21.15.5:0/3565195698 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7f41f0066430 0x7f41f00688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.083+0000 7f420f59e640 1 --2- 172.21.15.5:0/3565195698 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42100cee90 0x7f421014da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.083+0000 7f420f59e640 1 --2- 172.21.15.5:0/3565195698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42100b7a10 0x7f42101578d0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.083+0000 7f420f59e640 1 --2- 172.21.15.5:0/3565195698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42100b42c0 0x7f4210153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.083+0000 7f420f59e640 1 -- 172.21.15.5:0/3565195698 >> 172.21.15.5:0/3565195698 conn(0x7f4210069ea0 msgr2=0x7f42100d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:46.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.083+0000 7f420f59e640 1 -- 172.21.15.5:0/3565195698 shutdown_connections 2023-07-14T13:08:46.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.083+0000 7f420f59e640 1 -- 172.21.15.5:0/3565195698 wait complete. 2023-07-14T13:08:46.134 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T13:08:21.382297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T13:08:22.261284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:08:46.135 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:08:46.242 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:46.211+0000 7f66c902c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:08:46.267 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:46.236+0000 7fa17da2c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:08:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.255+0000 7efd38996640 1 Processor -- start 2023-07-14T13:08:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.255+0000 7efd38996640 1 -- start start 2023-07-14T13:08:46.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.255+0000 7efd38996640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efd3415bde0 0x7efd340d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.255+0000 7efd38996640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efd340d2fc0 0x7efd340b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.255+0000 7efd38996640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd340b04c0 con 0x7efd340d2300 2023-07-14T13:08:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.255+0000 7efd38996640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd3415c1b0 con 0x7efd3415bde0 2023-07-14T13:08:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.255+0000 7efd38996640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd340d0aa0 con 0x7efd340d2fc0 2023-07-14T13:08:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.255+0000 7efd3259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efd3415bde0 0x7efd340d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.255+0000 7efd32d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efd340d2300 0x7efd340cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47286/0 (socket says 172.21.15.5:47286) 2023-07-14T13:08:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.255+0000 7efd32d9d640 1 -- 172.21.15.5:0/1164587520 learned_addr learned my addr 172.21.15.5:0/1164587520 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.255+0000 7efd31d9b640 1 --2- 172.21.15.5:0/1164587520 >> v2:172.21.15.154:3300/0 conn(0x7efd340d2fc0 0x7efd340b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.255+0000 7efd3259c640 1 -- 172.21.15.5:0/1164587520 >> v2:172.21.15.154:3300/0 conn(0x7efd340d2fc0 msgr2=0x7efd340b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.255+0000 7efd3259c640 1 --2- 172.21.15.5:0/1164587520 >> v2:172.21.15.154:3300/0 conn(0x7efd340d2fc0 0x7efd340b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.255+0000 7efd3259c640 1 -- 172.21.15.5:0/1164587520 >> v1:172.21.15.5:6789/0 conn(0x7efd340d2300 legacy=0x7efd340cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:46.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.255+0000 7efd3259c640 1 -- 172.21.15.5:0/1164587520 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd340afb90 con 0x7efd3415bde0 2023-07-14T13:08:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.259+0000 7efd3259c640 1 --2- 172.21.15.5:0/1164587520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd3415bde0 0x7efd340d0270 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7efd3408c600 tx=0x7efd2401c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3118522aa3143571 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.259+0000 7efd3159a640 1 -- 172.21.15.5:0/1164587520 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd240ab600 con 0x7efd3415bde0 2023-07-14T13:08:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.259+0000 7efd3159a640 1 -- 172.21.15.5:0/1164587520 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd240a7050 con 0x7efd3415bde0 2023-07-14T13:08:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.259+0000 7efd3159a640 1 -- 172.21.15.5:0/1164587520 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd240ab980 con 0x7efd3415bde0 2023-07-14T13:08:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.259+0000 7efd38996640 1 -- 172.21.15.5:0/1164587520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd3415bde0 msgr2=0x7efd340d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:46.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.259+0000 7efd38996640 1 --2- 172.21.15.5:0/1164587520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd3415bde0 0x7efd340d0270 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7efd3408c600 tx=0x7efd2401c2d0 comp rx=0 tx=0).stop 2023-07-14T13:08:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.259+0000 7efd38996640 1 -- 172.21.15.5:0/1164587520 shutdown_connections 2023-07-14T13:08:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.259+0000 7efd38996640 1 --2- 172.21.15.5:0/1164587520 >> v2:172.21.15.154:3300/0 conn(0x7efd340d2fc0 0x7efd340b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.259+0000 7efd38996640 1 --2- 172.21.15.5:0/1164587520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd3415bde0 0x7efd340d0270 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:46.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.259+0000 7efd38996640 1 -- 172.21.15.5:0/1164587520 >> 172.21.15.5:0/1164587520 conn(0x7efd340659d0 msgr2=0x7efd3409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:46.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.259+0000 7efd38996640 1 -- 172.21.15.5:0/1164587520 shutdown_connections 2023-07-14T13:08:46.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.263+0000 7efd38996640 1 -- 172.21.15.5:0/1164587520 wait complete. 2023-07-14T13:08:46.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.263+0000 7efd38996640 1 Processor -- start 2023-07-14T13:08:46.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.263+0000 7efd38996640 1 -- start start 2023-07-14T13:08:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.267+0000 7efd38996640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd340d2300 0x7efd3414e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.267+0000 7efd38996640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd340d2fc0 0x7efd34151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.267+0000 7efd38996640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd3415bde0 0x7efd3414f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.267+0000 7efd38996640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd34152730 con 0x7efd340d2300 2023-07-14T13:08:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.267+0000 7efd38996640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd34151bb0 con 0x7efd3415bde0 2023-07-14T13:08:46.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.267+0000 7efd38996640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd34151e90 con 0x7efd340d2fc0 2023-07-14T13:08:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.267+0000 7efd3259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd340d2300 0x7efd3414e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.267+0000 7efd3259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd340d2300 0x7efd3414e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56370/0 (socket says 172.21.15.5:56370) 2023-07-14T13:08:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.267+0000 7efd3259c640 1 -- 172.21.15.5:0/1016762218 learned_addr learned my addr 172.21.15.5:0/1016762218 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.267+0000 7efd31d9b640 1 --2- 172.21.15.5:0/1016762218 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd340d2fc0 0x7efd34151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:46.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.267+0000 7efd32d9d640 1 --2- 172.21.15.5:0/1016762218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd3415bde0 0x7efd3414f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.267+0000 7efd3259c640 1 -- 172.21.15.5:0/1016762218 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd340d2fc0 msgr2=0x7efd34151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.267+0000 7efd3259c640 1 --2- 172.21.15.5:0/1016762218 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd340d2fc0 0x7efd34151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.267+0000 7efd3259c640 1 -- 172.21.15.5:0/1016762218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd3415bde0 msgr2=0x7efd3414f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:46.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.267+0000 7efd3259c640 1 --2- 172.21.15.5:0/1016762218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd3415bde0 0x7efd3414f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.267+0000 7efd3259c640 1 -- 172.21.15.5:0/1016762218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd240093b0 con 0x7efd340d2300 2023-07-14T13:08:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.267+0000 7efd3259c640 1 --2- 172.21.15.5:0/1016762218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd340d2300 0x7efd3414e500 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7efd240ae040 tx=0x7efd24019070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.267+0000 7efd22ffd640 1 -- 172.21.15.5:0/1016762218 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd24005ba0 con 0x7efd340d2300 2023-07-14T13:08:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.267+0000 7efd22ffd640 1 -- 172.21.15.5:0/1016762218 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd24005d00 con 0x7efd340d2300 2023-07-14T13:08:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.267+0000 7efd38996640 1 -- 172.21.15.5:0/1016762218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd34152170 con 0x7efd340d2300 2023-07-14T13:08:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.267+0000 7efd22ffd640 1 -- 172.21.15.5:0/1016762218 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd24006260 con 0x7efd340d2300 2023-07-14T13:08:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.267+0000 7efd38996640 1 -- 172.21.15.5:0/1016762218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd3414ea40 con 0x7efd340d2300 2023-07-14T13:08:46.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.267+0000 7efd38996640 1 -- 172.21.15.5:0/1016762218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd340c5f30 con 0x7efd340d2300 2023-07-14T13:08:46.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.271+0000 7efd22ffd640 1 -- 172.21.15.5:0/1016762218 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 34) v1 ==== 85817+0+0 (secure 0 0 0) 0x7efd240b2040 con 0x7efd340d2300 2023-07-14T13:08:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.271+0000 7efd22ffd640 1 --2- 172.21.15.5:0/1016762218 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7efd14066430 0x7efd140688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.271+0000 7efd22ffd640 1 -- 172.21.15.5:0/1016762218 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6406+0+0 (secure 0 0 0) 0x7efd2411e2d0 con 0x7efd340d2300 2023-07-14T13:08:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.271+0000 7efd31d9b640 1 -- 172.21.15.5:0/1016762218 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7efd14066430 msgr2=0x7efd140688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/224047690 2023-07-14T13:08:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.271+0000 7efd31d9b640 1 --2- 172.21.15.5:0/1016762218 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7efd14066430 0x7efd140688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:08:46.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.275+0000 7efd22ffd640 1 -- 172.21.15.5:0/1016762218 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7efd240eb3b0 con 0x7efd340d2300 2023-07-14T13:08:46.329 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:46.300+0000 7fa17da2c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:08:46.338 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:46.307+0000 7f66c902c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:08:46.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.315+0000 7efd22ffd640 1 -- 172.21.15.5:0/1016762218 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 35) v1 ==== 85369+0+0 (secure 0 0 0) 0x7efd240eb780 con 0x7efd340d2300 2023-07-14T13:08:46.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.315+0000 7efd22ffd640 1 -- 172.21.15.5:0/1016762218 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7efd14066430 msgr2=0x7efd140688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:08:46.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.315+0000 7efd22ffd640 1 --2- 172.21.15.5:0/1016762218 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7efd14066430 0x7efd140688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:46.411 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:46.380+0000 7fa104dcb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:46.412 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:46.380+0000 7fa104dcb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:46.412 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:46.380+0000 7fa104dcb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:46.412 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:46.380+0000 7fa104dcb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:46.412 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:46.380+0000 7fa104dcb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:46.412 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:46.380+0000 7fa108dd3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:46.412 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:46.380+0000 7fa108dd3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:46.413 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:46.380+0000 7fa108dd3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:46.413 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:46.380+0000 7fa108dd3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:46.413 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:08:46.380+0000 7fa108dd3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:08:46.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.447+0000 7efd38996640 1 -- 172.21.15.5:0/1016762218 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efd340678d0 con 0x7efd340d2300 2023-07-14T13:08:46.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.447+0000 7efd22ffd640 1 -- 172.21.15.5:0/1016762218 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7efd24102d90 con 0x7efd340d2300 2023-07-14T13:08:46.477 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:08:46.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.447+0000 7efd38996640 1 -- 172.21.15.5:0/1016762218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd340d2300 msgr2=0x7efd3414e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:46.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.447+0000 7efd38996640 1 --2- 172.21.15.5:0/1016762218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd340d2300 0x7efd3414e500 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7efd240ae040 tx=0x7efd24019070 comp rx=0 tx=0).stop 2023-07-14T13:08:46.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.447+0000 7efd38996640 1 -- 172.21.15.5:0/1016762218 shutdown_connections 2023-07-14T13:08:46.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.447+0000 7efd38996640 1 --2- 172.21.15.5:0/1016762218 >> [v2:172.21.15.154:6832/224047690,v1:172.21.15.154:6833/224047690] conn(0x7efd14066430 0x7efd140688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:46.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.447+0000 7efd38996640 1 --2- 172.21.15.5:0/1016762218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd3415bde0 0x7efd3414f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:46.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.447+0000 7efd38996640 1 --2- 172.21.15.5:0/1016762218 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd340d2fc0 0x7efd34151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:46.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.447+0000 7efd38996640 1 --2- 172.21.15.5:0/1016762218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd340d2300 0x7efd3414e500 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:46.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.447+0000 7efd38996640 1 -- 172.21.15.5:0/1016762218 >> 172.21.15.5:0/1016762218 conn(0x7efd340659d0 msgr2=0x7efd3406afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:46.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.447+0000 7efd38996640 1 -- 172.21.15.5:0/1016762218 shutdown_connections 2023-07-14T13:08:46.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.447+0000 7efd38996640 1 -- 172.21.15.5:0/1016762218 wait complete. 2023-07-14T13:08:46.498 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:08:46.643 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:46.611+0000 7f66c902c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:08:46.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.619+0000 7f1558bd3640 1 Processor -- start 2023-07-14T13:08:46.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.619+0000 7f1558bd3640 1 -- start start 2023-07-14T13:08:46.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.619+0000 7f1558bd3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f155415bde0 0x7f15540d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:46.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.619+0000 7f1558bd3640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15540d2fc0 0x7f15540b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:46.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.619+0000 7f1558bd3640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f15540d2300 0x7f15540d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:46.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.619+0000 7f1558bd3640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15540d2ce0 con 0x7f155415bde0 2023-07-14T13:08:46.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.619+0000 7f1558bd3640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f155415c1b0 con 0x7f15540d2300 2023-07-14T13:08:46.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.619+0000 7f1558bd3640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15540b04c0 con 0x7f15540d2fc0 2023-07-14T13:08:46.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.619+0000 7f155259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f155415bde0 0x7f15540d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:46.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.619+0000 7f155259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f155415bde0 0x7f15540d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56384/0 (socket says 172.21.15.5:56384) 2023-07-14T13:08:46.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.619+0000 7f155259c640 1 -- 172.21.15.5:0/2370533268 learned_addr learned my addr 172.21.15.5:0/2370533268 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:46.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.619+0000 7f1552d9d640 1 --2- 172.21.15.5:0/2370533268 >> v2:172.21.15.154:3300/0 conn(0x7f15540d2300 0x7f15540d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:46.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.619+0000 7f1551d9b640 1 --2- 172.21.15.5:0/2370533268 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15540d2fc0 0x7f15540b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:46.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.619+0000 7f155259c640 1 -- 172.21.15.5:0/2370533268 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15540d2fc0 msgr2=0x7f15540b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:46.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.619+0000 7f155259c640 1 --2- 172.21.15.5:0/2370533268 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15540d2fc0 0x7f15540b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:46.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.619+0000 7f155259c640 1 -- 172.21.15.5:0/2370533268 >> v2:172.21.15.154:3300/0 conn(0x7f15540d2300 msgr2=0x7f15540d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:46.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.619+0000 7f155259c640 1 --2- 172.21.15.5:0/2370533268 >> v2:172.21.15.154:3300/0 conn(0x7f15540d2300 0x7f15540d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:46.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.619+0000 7f155259c640 1 -- 172.21.15.5:0/2370533268 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15540d0aa0 con 0x7f155415bde0 2023-07-14T13:08:46.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.619+0000 7f1552d9d640 1 --2- 172.21.15.5:0/2370533268 >> v2:172.21.15.154:3300/0 conn(0x7f15540d2300 0x7f15540d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:08:46.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.619+0000 7f1551d9b640 1 --2- 172.21.15.5:0/2370533268 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15540d2fc0 0x7f15540b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:08:46.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.623+0000 7f155259c640 1 --2- 172.21.15.5:0/2370533268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f155415bde0 0x7f15540d0270 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f15540b83f0 tx=0x7f154401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=638d839b31420a2a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:46.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.623+0000 7f155159a640 1 -- 172.21.15.5:0/2370533268 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15440aa620 con 0x7f155415bde0 2023-07-14T13:08:46.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.623+0000 7f155159a640 1 -- 172.21.15.5:0/2370533268 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15440aa780 con 0x7f155415bde0 2023-07-14T13:08:46.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.623+0000 7f155159a640 1 -- 172.21.15.5:0/2370533268 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15440aab10 con 0x7f155415bde0 2023-07-14T13:08:46.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.623+0000 7f1558bd3640 1 -- 172.21.15.5:0/2370533268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f155415bde0 msgr2=0x7f15540d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:46.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.623+0000 7f1558bd3640 1 --2- 172.21.15.5:0/2370533268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f155415bde0 0x7f15540d0270 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f15540b83f0 tx=0x7f154401c500 comp rx=0 tx=0).stop 2023-07-14T13:08:46.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.623+0000 7f1558bd3640 1 -- 172.21.15.5:0/2370533268 shutdown_connections 2023-07-14T13:08:46.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.623+0000 7f1558bd3640 1 --2- 172.21.15.5:0/2370533268 >> v2:172.21.15.154:3300/0 conn(0x7f15540d2300 0x7f15540d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:46.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.623+0000 7f1558bd3640 1 --2- 172.21.15.5:0/2370533268 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15540d2fc0 0x7f15540b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:46.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.623+0000 7f1558bd3640 1 --2- 172.21.15.5:0/2370533268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f155415bde0 0x7f15540d0270 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:46.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.623+0000 7f1558bd3640 1 -- 172.21.15.5:0/2370533268 >> 172.21.15.5:0/2370533268 conn(0x7f15540659d0 msgr2=0x7f155409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:46.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.623+0000 7f1558bd3640 1 -- 172.21.15.5:0/2370533268 shutdown_connections 2023-07-14T13:08:46.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.623+0000 7f1558bd3640 1 -- 172.21.15.5:0/2370533268 wait complete. 2023-07-14T13:08:46.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.627+0000 7f1558bd3640 1 Processor -- start 2023-07-14T13:08:46.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.627+0000 7f1558bd3640 1 -- start start 2023-07-14T13:08:46.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.627+0000 7f1558bd3640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15540d2300 0x7f155414f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:46.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.627+0000 7f1558bd3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15540d2fc0 0x7f15540b1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:46.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.627+0000 7f1558bd3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f155415bde0 0x7f15540b7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:46.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.627+0000 7f1558bd3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15540c8140 con 0x7f155415bde0 2023-07-14T13:08:46.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.627+0000 7f1558bd3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155414fdf0 con 0x7f15540d2fc0 2023-07-14T13:08:46.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.627+0000 7f1558bd3640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15540b1cc0 con 0x7f15540d2300 2023-07-14T13:08:46.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.627+0000 7f1552d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f155415bde0 0x7f15540b7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:46.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.627+0000 7f1552d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f155415bde0 0x7f15540b7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56390/0 (socket says 172.21.15.5:56390) 2023-07-14T13:08:46.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.627+0000 7f1552d9d640 1 -- 172.21.15.5:0/493866289 learned_addr learned my addr 172.21.15.5:0/493866289 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:46.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.627+0000 7f155259c640 1 --2- 172.21.15.5:0/493866289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15540d2300 0x7f155414f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:46.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.627+0000 7f1551d9b640 1 --2- 172.21.15.5:0/493866289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15540d2fc0 0x7f15540b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:46.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.627+0000 7f1552d9d640 1 -- 172.21.15.5:0/493866289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15540d2300 msgr2=0x7f155414f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:46.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.627+0000 7f1552d9d640 1 --2- 172.21.15.5:0/493866289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15540d2300 0x7f155414f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:46.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.627+0000 7f1552d9d640 1 -- 172.21.15.5:0/493866289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15540d2fc0 msgr2=0x7f15540b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:46.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.627+0000 7f1552d9d640 1 --2- 172.21.15.5:0/493866289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15540d2fc0 0x7f15540b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:46.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.627+0000 7f1552d9d640 1 -- 172.21.15.5:0/493866289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1544009480 con 0x7f155415bde0 2023-07-14T13:08:46.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.627+0000 7f1552d9d640 1 --2- 172.21.15.5:0/493866289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f155415bde0 0x7f15540b7630 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f154c00cd10 tx=0x7f154c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:46.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.627+0000 7f1542ffd640 1 -- 172.21.15.5:0/493866289 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c00f680 con 0x7f155415bde0 2023-07-14T13:08:46.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.627+0000 7f1542ffd640 1 -- 172.21.15.5:0/493866289 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154c00f800 con 0x7f155415bde0 2023-07-14T13:08:46.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.627+0000 7f1558bd3640 1 -- 172.21.15.5:0/493866289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15540b52d0 con 0x7f155415bde0 2023-07-14T13:08:46.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.627+0000 7f1542ffd640 1 -- 172.21.15.5:0/493866289 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c00fbb0 con 0x7f155415bde0 2023-07-14T13:08:46.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.627+0000 7f1558bd3640 1 -- 172.21.15.5:0/493866289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15540b5890 con 0x7f155415bde0 2023-07-14T13:08:46.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.631+0000 7f1558bd3640 1 -- 172.21.15.5:0/493866289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15540678d0 con 0x7f155415bde0 2023-07-14T13:08:46.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.631+0000 7f1542ffd640 1 -- 172.21.15.5:0/493866289 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 35) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f154c00b040 con 0x7f155415bde0 2023-07-14T13:08:46.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.631+0000 7f1542ffd640 1 -- 172.21.15.5:0/493866289 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f154c084300 con 0x7f155415bde0 2023-07-14T13:08:46.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.639+0000 7f1542ffd640 1 -- 172.21.15.5:0/493866289 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f154c051920 con 0x7f155415bde0 2023-07-14T13:08:46.713 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:08:46.683+0000 7f66c902c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:08:46.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.795+0000 7f1558bd3640 1 -- 172.21.15.5:0/493866289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f15540cc7a0 con 0x7f155415bde0 2023-07-14T13:08:46.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.795+0000 7f1542ffd640 1 -- 172.21.15.5:0/493866289 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v85) v1 ==== 92+0+10 (secure 0 0 0) 0x7f154c054f40 con 0x7f155415bde0 2023-07-14T13:08:46.826 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:08:46.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.795+0000 7f1558bd3640 1 -- 172.21.15.5:0/493866289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f155415bde0 msgr2=0x7f15540b7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:46.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.795+0000 7f1558bd3640 1 --2- 172.21.15.5:0/493866289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f155415bde0 0x7f15540b7630 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f154c00cd10 tx=0x7f154c00a650 comp rx=0 tx=0).stop 2023-07-14T13:08:46.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.795+0000 7f1558bd3640 1 -- 172.21.15.5:0/493866289 shutdown_connections 2023-07-14T13:08:46.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.795+0000 7f1558bd3640 1 --2- 172.21.15.5:0/493866289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f155415bde0 0x7f15540b7630 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:46.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.795+0000 7f1558bd3640 1 --2- 172.21.15.5:0/493866289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15540d2fc0 0x7f15540b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:46.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.795+0000 7f1558bd3640 1 --2- 172.21.15.5:0/493866289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15540d2300 0x7f155414f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:46.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.795+0000 7f1558bd3640 1 -- 172.21.15.5:0/493866289 >> 172.21.15.5:0/493866289 conn(0x7f15540659d0 msgr2=0x7f15540cdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:46.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.795+0000 7f1558bd3640 1 -- 172.21.15.5:0/493866289 shutdown_connections 2023-07-14T13:08:46.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.795+0000 7f1558bd3640 1 -- 172.21.15.5:0/493866289 wait complete. 2023-07-14T13:08:46.846 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T13:08:46.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.963+0000 7f5f751fa640 1 Processor -- start 2023-07-14T13:08:46.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.963+0000 7f5f751fa640 1 -- start start 2023-07-14T13:08:46.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.963+0000 7f5f751fa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5f7015f690 0x7f5f700b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:46.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.963+0000 7f5f751fa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f7006a440 0x7f5f7006c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:46.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.963+0000 7f5f751fa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7006c040 con 0x7f5f701453a0 2023-07-14T13:08:46.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.963+0000 7f5f751fa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f70160170 con 0x7f5f7006a440 2023-07-14T13:08:46.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.963+0000 7f5f751fa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f70160600 con 0x7f5f7015f690 2023-07-14T13:08:46.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.963+0000 7f5f6f59e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f7006a440 0x7f5f7006c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:46.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.963+0000 7f5f6f59e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f7006a440 0x7f5f7006c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56404/0 (socket says 172.21.15.5:56404) 2023-07-14T13:08:46.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.963+0000 7f5f6f59e640 1 -- 172.21.15.5:0/671436574 learned_addr learned my addr 172.21.15.5:0/671436574 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:46.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.967+0000 7f5f6ed9d640 1 --2- 172.21.15.5:0/671436574 >> v2:172.21.15.154:3300/0 conn(0x7f5f7015f690 0x7f5f700b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.967+0000 7f5f6f59e640 1 -- 172.21.15.5:0/671436574 >> v2:172.21.15.154:3300/0 conn(0x7f5f7015f690 msgr2=0x7f5f700b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.967+0000 7f5f6f59e640 1 --2- 172.21.15.5:0/671436574 >> v2:172.21.15.154:3300/0 conn(0x7f5f7015f690 0x7f5f700b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.967+0000 7f5f6f59e640 1 -- 172.21.15.5:0/671436574 >> v1:172.21.15.5:6789/0 conn(0x7f5f701453a0 legacy=0x7f5f7015fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.967+0000 7f5f6f59e640 1 -- 172.21.15.5:0/671436574 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f70160360 con 0x7f5f7006a440 2023-07-14T13:08:47.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.967+0000 7f5f6f59e640 1 --2- 172.21.15.5:0/671436574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f7006a440 0x7f5f7006c4d0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f5f700aba90 tx=0x7f5f6801c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5bb8cdde14fce4f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:47.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.967+0000 7f5f6e59c640 1 -- 172.21.15.5:0/671436574 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f680a6480 con 0x7f5f7006a440 2023-07-14T13:08:47.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.967+0000 7f5f6e59c640 1 -- 172.21.15.5:0/671436574 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f680a65e0 con 0x7f5f7006a440 2023-07-14T13:08:47.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.967+0000 7f5f6e59c640 1 -- 172.21.15.5:0/671436574 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f680a6970 con 0x7f5f7006a440 2023-07-14T13:08:47.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.967+0000 7f5f751fa640 1 -- 172.21.15.5:0/671436574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f7006a440 msgr2=0x7f5f7006c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:47.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.967+0000 7f5f751fa640 1 --2- 172.21.15.5:0/671436574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f7006a440 0x7f5f7006c4d0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f5f700aba90 tx=0x7f5f6801c6a0 comp rx=0 tx=0).stop 2023-07-14T13:08:47.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.967+0000 7f5f751fa640 1 -- 172.21.15.5:0/671436574 shutdown_connections 2023-07-14T13:08:47.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.967+0000 7f5f751fa640 1 --2- 172.21.15.5:0/671436574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f7006a440 0x7f5f7006c4d0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:47.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.967+0000 7f5f751fa640 1 --2- 172.21.15.5:0/671436574 >> v2:172.21.15.154:3300/0 conn(0x7f5f7015f690 0x7f5f700b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:47.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.967+0000 7f5f751fa640 1 -- 172.21.15.5:0/671436574 >> 172.21.15.5:0/671436574 conn(0x7f5f700b1210 msgr2=0x7f5f700ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:47.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.971+0000 7f5f751fa640 1 -- 172.21.15.5:0/671436574 shutdown_connections 2023-07-14T13:08:47.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.971+0000 7f5f751fa640 1 -- 172.21.15.5:0/671436574 wait complete. 2023-07-14T13:08:47.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.971+0000 7f5f751fa640 1 Processor -- start 2023-07-14T13:08:47.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.971+0000 7f5f751fa640 1 -- start start 2023-07-14T13:08:47.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.971+0000 7f5f751fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f7006a440 0x7f5f7013d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:47.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.971+0000 7f5f751fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f701453a0 0x7f5f70160740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:47.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.971+0000 7f5f751fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f7015f690 0x7f5f70160c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:47.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.971+0000 7f5f751fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f701420c0 con 0x7f5f701453a0 2023-07-14T13:08:47.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.971+0000 7f5f751fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7013d790 con 0x7f5f7006a440 2023-07-14T13:08:47.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.971+0000 7f5f751fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7015d190 con 0x7f5f7015f690 2023-07-14T13:08:47.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.971+0000 7f5f67fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f701453a0 0x7f5f70160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:47.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.971+0000 7f5f67fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f701453a0 0x7f5f70160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56406/0 (socket says 172.21.15.5:56406) 2023-07-14T13:08:47.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.971+0000 7f5f67fff640 1 -- 172.21.15.5:0/2833794997 learned_addr learned my addr 172.21.15.5:0/2833794997 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.971+0000 7f5f6ed9d640 1 --2- 172.21.15.5:0/2833794997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f7006a440 0x7f5f7013d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.971+0000 7f5f67fff640 1 -- 172.21.15.5:0/2833794997 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f7015f690 msgr2=0x7f5f70160c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.971+0000 7f5f67fff640 1 --2- 172.21.15.5:0/2833794997 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f7015f690 0x7f5f70160c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.971+0000 7f5f67fff640 1 -- 172.21.15.5:0/2833794997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f7006a440 msgr2=0x7f5f7013d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.971+0000 7f5f67fff640 1 --2- 172.21.15.5:0/2833794997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f7006a440 0x7f5f7013d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.971+0000 7f5f67fff640 1 -- 172.21.15.5:0/2833794997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f68009b30 con 0x7f5f701453a0 2023-07-14T13:08:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.971+0000 7f5f67fff640 1 --2- 172.21.15.5:0/2833794997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f701453a0 0x7f5f70160740 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800c3c0 tx=0x7f5f5800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:47.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.971+0000 7f5f677fe640 1 -- 172.21.15.5:0/2833794997 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f580052d0 con 0x7f5f701453a0 2023-07-14T13:08:47.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.975+0000 7f5f677fe640 1 -- 172.21.15.5:0/2833794997 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f58005430 con 0x7f5f701453a0 2023-07-14T13:08:47.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.975+0000 7f5f677fe640 1 -- 172.21.15.5:0/2833794997 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f58003840 con 0x7f5f701453a0 2023-07-14T13:08:47.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.975+0000 7f5f751fa640 1 -- 172.21.15.5:0/2833794997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7015d470 con 0x7f5f701453a0 2023-07-14T13:08:47.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.975+0000 7f5f751fa640 1 -- 172.21.15.5:0/2833794997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7015da30 con 0x7f5f701453a0 2023-07-14T13:08:47.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.975+0000 7f5f751fa640 1 -- 172.21.15.5:0/2833794997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f70142230 con 0x7f5f701453a0 2023-07-14T13:08:47.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.975+0000 7f5f677fe640 1 -- 172.21.15.5:0/2833794997 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 35) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f5f580039a0 con 0x7f5f701453a0 2023-07-14T13:08:47.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.975+0000 7f5f677fe640 1 -- 172.21.15.5:0/2833794997 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f5f58082f70 con 0x7f5f701453a0 2023-07-14T13:08:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:46.979+0000 7f5f677fe640 1 -- 172.21.15.5:0/2833794997 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f5f580b3720 con 0x7f5f701453a0 2023-07-14T13:08:47.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.135+0000 7f5f751fa640 1 -- 172.21.15.5:0/2833794997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5f700678d0 con 0x7f5f701453a0 2023-07-14T13:08:47.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.135+0000 7f5f677fe640 1 -- 172.21.15.5:0/2833794997 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5f70142230 con 0x7f5f701453a0 2023-07-14T13:08:47.166 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T13:08:47.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.135+0000 7f5f751fa640 1 -- 172.21.15.5:0/2833794997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f701453a0 msgr2=0x7f5f70160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:47.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.135+0000 7f5f751fa640 1 --2- 172.21.15.5:0/2833794997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f701453a0 0x7f5f70160740 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800c3c0 tx=0x7f5f5800c880 comp rx=0 tx=0).stop 2023-07-14T13:08:47.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.135+0000 7f5f751fa640 1 -- 172.21.15.5:0/2833794997 shutdown_connections 2023-07-14T13:08:47.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.135+0000 7f5f751fa640 1 --2- 172.21.15.5:0/2833794997 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f7015f690 0x7f5f70160c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:47.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.135+0000 7f5f751fa640 1 --2- 172.21.15.5:0/2833794997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f701453a0 0x7f5f70160740 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:47.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.135+0000 7f5f751fa640 1 --2- 172.21.15.5:0/2833794997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f7006a440 0x7f5f7013d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:47.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.135+0000 7f5f751fa640 1 -- 172.21.15.5:0/2833794997 >> 172.21.15.5:0/2833794997 conn(0x7f5f700b1210 msgr2=0x7f5f700afdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:47.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.135+0000 7f5f751fa640 1 -- 172.21.15.5:0/2833794997 shutdown_connections 2023-07-14T13:08:47.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.135+0000 7f5f751fa640 1 -- 172.21.15.5:0/2833794997 wait complete. 2023-07-14T13:08:47.187 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T13:08:47.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.303+0000 7fa07f693640 1 Processor -- start 2023-07-14T13:08:47.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.303+0000 7fa07f693640 1 -- start start 2023-07-14T13:08:47.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.303+0000 7fa07f693640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0780aeb40 0x7fa07815cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:47.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.303+0000 7fa07f693640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0780aef10 0x7fa078158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:47.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.303+0000 7fa07f693640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0781532b0 con 0x7fa078159270 2023-07-14T13:08:47.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.303+0000 7fa07f693640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0780ca6f0 con 0x7fa0780aeb40 2023-07-14T13:08:47.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.303+0000 7fa07f693640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0781599d0 con 0x7fa0780aef10 2023-07-14T13:08:47.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.303+0000 7fa07d42f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0780aeb40 0x7fa07815cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:47.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.303+0000 7fa07d42f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0780aeb40 0x7fa07815cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56414/0 (socket says 172.21.15.5:56414) 2023-07-14T13:08:47.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.303+0000 7fa07d42f640 1 -- 172.21.15.5:0/222738800 learned_addr learned my addr 172.21.15.5:0/222738800 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:47.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.303+0000 7fa07dc30640 1 --1- 172.21.15.5:0/222738800 >> v1:172.21.15.5:6789/0 conn(0x7fa078159270 0x7fa0780c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47310/0 (socket says 172.21.15.5:47310) 2023-07-14T13:08:47.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.303+0000 7fa07cc2e640 1 --2- 172.21.15.5:0/222738800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0780aef10 0x7fa078158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:47.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.303+0000 7fa07d42f640 1 -- 172.21.15.5:0/222738800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0780aef10 msgr2=0x7fa078158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:47.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.303+0000 7fa07d42f640 1 --2- 172.21.15.5:0/222738800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0780aef10 0x7fa078158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:47.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.303+0000 7fa07d42f640 1 -- 172.21.15.5:0/222738800 >> v1:172.21.15.5:6789/0 conn(0x7fa078159270 legacy=0x7fa0780c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:47.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.303+0000 7fa07d42f640 1 -- 172.21.15.5:0/222738800 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa078159cb0 con 0x7fa0780aeb40 2023-07-14T13:08:47.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.303+0000 7fa06ffff640 1 -- 172.21.15.5:0/222738800 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2043839257 0 0) 0x7fa0781532b0 con 0x7fa078159270 2023-07-14T13:08:47.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.307+0000 7fa07d42f640 1 --2- 172.21.15.5:0/222738800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0780aeb40 0x7fa07815cef0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fa074009870 tx=0x7fa07401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964f9a402ef3fddf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:47.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.307+0000 7fa06ffff640 1 -- 172.21.15.5:0/222738800 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0740ab680 con 0x7fa0780aeb40 2023-07-14T13:08:47.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.307+0000 7fa06ffff640 1 -- 172.21.15.5:0/222738800 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0740ab7e0 con 0x7fa0780aeb40 2023-07-14T13:08:47.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.307+0000 7fa06ffff640 1 -- 172.21.15.5:0/222738800 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0740abb70 con 0x7fa0780aeb40 2023-07-14T13:08:47.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.307+0000 7fa07f693640 1 -- 172.21.15.5:0/222738800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0780aeb40 msgr2=0x7fa07815cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:47.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.307+0000 7fa07f693640 1 --2- 172.21.15.5:0/222738800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0780aeb40 0x7fa07815cef0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fa074009870 tx=0x7fa07401c480 comp rx=0 tx=0).stop 2023-07-14T13:08:47.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.307+0000 7fa07f693640 1 -- 172.21.15.5:0/222738800 shutdown_connections 2023-07-14T13:08:47.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.307+0000 7fa07f693640 1 --2- 172.21.15.5:0/222738800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0780aef10 0x7fa078158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:47.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.307+0000 7fa07f693640 1 --2- 172.21.15.5:0/222738800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0780aeb40 0x7fa07815cef0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:47.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.307+0000 7fa07f693640 1 -- 172.21.15.5:0/222738800 >> 172.21.15.5:0/222738800 conn(0x7fa0780cde90 msgr2=0x7fa0780ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:47.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.307+0000 7fa07f693640 1 -- 172.21.15.5:0/222738800 shutdown_connections 2023-07-14T13:08:47.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.307+0000 7fa07f693640 1 -- 172.21.15.5:0/222738800 wait complete. 2023-07-14T13:08:47.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.311+0000 7fa07f693640 1 Processor -- start 2023-07-14T13:08:47.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.311+0000 7fa07f693640 1 -- start start 2023-07-14T13:08:47.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.311+0000 7fa07f693640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0780aeb40 0x7fa07814e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:47.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.311+0000 7fa07f693640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0780aef10 0x7fa078155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:47.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.311+0000 7fa07f693640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa078159270 0x7fa078155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:47.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.311+0000 7fa07f693640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07814ebc0 con 0x7fa0780aeb40 2023-07-14T13:08:47.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.311+0000 7fa07f693640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07806be20 con 0x7fa0780aef10 2023-07-14T13:08:47.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.311+0000 7fa07f693640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07806b280 con 0x7fa078159270 2023-07-14T13:08:47.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.311+0000 7fa07d42f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0780aeb40 0x7fa07814e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:47.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.311+0000 7fa07d42f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0780aeb40 0x7fa07814e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56422/0 (socket says 172.21.15.5:56422) 2023-07-14T13:08:47.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.311+0000 7fa07d42f640 1 -- 172.21.15.5:0/2637377128 learned_addr learned my addr 172.21.15.5:0/2637377128 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:47.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.311+0000 7fa07dc30640 1 --2- 172.21.15.5:0/2637377128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa078159270 0x7fa078155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:47.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.311+0000 7fa07cc2e640 1 --2- 172.21.15.5:0/2637377128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0780aef10 0x7fa078155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:47.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.311+0000 7fa07d42f640 1 -- 172.21.15.5:0/2637377128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa078159270 msgr2=0x7fa078155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:47.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.311+0000 7fa07d42f640 1 --2- 172.21.15.5:0/2637377128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa078159270 0x7fa078155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:47.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.311+0000 7fa07d42f640 1 -- 172.21.15.5:0/2637377128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0780aef10 msgr2=0x7fa078155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:47.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.311+0000 7fa07d42f640 1 --2- 172.21.15.5:0/2637377128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0780aef10 0x7fa078155690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:47.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.311+0000 7fa07d42f640 1 -- 172.21.15.5:0/2637377128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0740094d0 con 0x7fa0780aeb40 2023-07-14T13:08:47.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.311+0000 7fa07d42f640 1 --2- 172.21.15.5:0/2637377128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0780aeb40 0x7fa07814e680 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fa0740ad040 tx=0x7fa07401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:47.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.315+0000 7fa06dffb640 1 -- 172.21.15.5:0/2637377128 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0740b4800 con 0x7fa0780aeb40 2023-07-14T13:08:47.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.319+0000 7fa06dffb640 1 -- 172.21.15.5:0/2637377128 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0740b4980 con 0x7fa0780aeb40 2023-07-14T13:08:47.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.319+0000 7fa06dffb640 1 -- 172.21.15.5:0/2637377128 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0740b4d30 con 0x7fa0780aeb40 2023-07-14T13:08:47.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.319+0000 7fa07f693640 1 -- 172.21.15.5:0/2637377128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa07806b4f0 con 0x7fa0780aeb40 2023-07-14T13:08:47.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.319+0000 7fa07f693640 1 -- 172.21.15.5:0/2637377128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa07806bab0 con 0x7fa0780aeb40 2023-07-14T13:08:47.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.319+0000 7fa07f693640 1 -- 172.21.15.5:0/2637377128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0780678d0 con 0x7fa0780aeb40 2023-07-14T13:08:47.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.319+0000 7fa06dffb640 1 -- 172.21.15.5:0/2637377128 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 36) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fa0740b3380 con 0x7fa0780aeb40 2023-07-14T13:08:47.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.319+0000 7fa06dffb640 1 --2- 172.21.15.5:0/2637377128 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fa05c0660d0 0x7fa05c068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:47.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.319+0000 7fa06dffb640 1 -- 172.21.15.5:0/2637377128 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fa07411e600 con 0x7fa0780aeb40 2023-07-14T13:08:47.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.323+0000 7fa07cc2e640 1 --2- 172.21.15.5:0/2637377128 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fa05c0660d0 0x7fa05c068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:47.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.323+0000 7fa06dffb640 1 -- 172.21.15.5:0/2637377128 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa0740ebb90 con 0x7fa0780aeb40 2023-07-14T13:08:47.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.327+0000 7fa07cc2e640 1 --2- 172.21.15.5:0/2637377128 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fa05c0660d0 0x7fa05c068580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa0781f72b0 tx=0x7fa068008040 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:47.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.479+0000 7fa07f693640 1 -- 172.21.15.5:0/2637377128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa0780c2ee0 con 0x7fa0780aeb40 2023-07-14T13:08:47.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.479+0000 7fa06dffb640 1 -- 172.21.15.5:0/2637377128 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa0740ef1b0 con 0x7fa0780aeb40 2023-07-14T13:08:47.512 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T13:08:47.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.483+0000 7fa07f693640 1 -- 172.21.15.5:0/2637377128 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fa05c0660d0 msgr2=0x7fa05c068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:47.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.483+0000 7fa07f693640 1 --2- 172.21.15.5:0/2637377128 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fa05c0660d0 0x7fa05c068580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa0781f72b0 tx=0x7fa068008040 comp rx=0 tx=0).stop 2023-07-14T13:08:47.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.483+0000 7fa07f693640 1 -- 172.21.15.5:0/2637377128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0780aeb40 msgr2=0x7fa07814e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:47.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.483+0000 7fa07f693640 1 --2- 172.21.15.5:0/2637377128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0780aeb40 0x7fa07814e680 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fa0740ad040 tx=0x7fa07401acc0 comp rx=0 tx=0).stop 2023-07-14T13:08:47.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.483+0000 7fa07f693640 1 -- 172.21.15.5:0/2637377128 shutdown_connections 2023-07-14T13:08:47.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.483+0000 7fa07f693640 1 --2- 172.21.15.5:0/2637377128 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fa05c0660d0 0x7fa05c068580 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:47.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.483+0000 7fa07f693640 1 --2- 172.21.15.5:0/2637377128 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa078159270 0x7fa078155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:47.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.483+0000 7fa07f693640 1 --2- 172.21.15.5:0/2637377128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0780aef10 0x7fa078155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:47.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.483+0000 7fa07f693640 1 --2- 172.21.15.5:0/2637377128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0780aeb40 0x7fa07814e680 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:47.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.483+0000 7fa07f693640 1 -- 172.21.15.5:0/2637377128 >> 172.21.15.5:0/2637377128 conn(0x7fa0780cde90 msgr2=0x7fa0781580e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:47.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.483+0000 7fa07f693640 1 -- 172.21.15.5:0/2637377128 shutdown_connections 2023-07-14T13:08:47.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.483+0000 7fa07f693640 1 -- 172.21.15.5:0/2637377128 wait complete. 2023-07-14T13:08:47.532 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:08:47.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.647+0000 7f91cf140640 1 Processor -- start 2023-07-14T13:08:47.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.647+0000 7f91cf140640 1 -- start start 2023-07-14T13:08:47.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.647+0000 7f91cf140640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c80c9730 0x7f91c81638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:47.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.647+0000 7f91cf140640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c80cc700 con 0x7f91c8158ce0 2023-07-14T13:08:47.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.647+0000 7f91cf140640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c80b0ff0 con 0x7f91c80c8ad0 2023-07-14T13:08:47.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.647+0000 7f91cf140640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c8070c80 con 0x7f91c80c9730 2023-07-14T13:08:47.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.647+0000 7f91ccedc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f91c8158ce0 0x7f91c8070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47318/0 (socket says 172.21.15.5:47318) 2023-07-14T13:08:47.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.647+0000 7f91ccedc640 1 -- 172.21.15.5:0/4220184430 learned_addr learned my addr 172.21.15.5:0/4220184430 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:47.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.647+0000 7f91cd6dd640 1 --2- 172.21.15.5:0/4220184430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c80c9730 0x7f91c81638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:47.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.647+0000 7f91c77fe640 1 -- 172.21.15.5:0/4220184430 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 867068471 0 0) 0x7f91c80cc700 con 0x7f91c8158ce0 2023-07-14T13:08:47.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.651+0000 7f91c77fe640 1 -- 172.21.15.5:0/4220184430 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91b8003530 con 0x7f91c8158ce0 2023-07-14T13:08:47.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.651+0000 7f91cd6dd640 1 -- 172.21.15.5:0/4220184430 >> v1:172.21.15.154:6789/0 conn(0x7f91c80c8ad0 legacy=0x7f91c80c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:47.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.651+0000 7f91c77fe640 1 -- 172.21.15.5:0/4220184430 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1619470854 0 0) 0x7f91c80b0ff0 con 0x7f91c80c8ad0 2023-07-14T13:08:47.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.651+0000 7f91cd6dd640 1 -- 172.21.15.5:0/4220184430 >> v1:172.21.15.5:6789/0 conn(0x7f91c8158ce0 legacy=0x7f91c8070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:47.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.651+0000 7f91cd6dd640 1 -- 172.21.15.5:0/4220184430 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c80cbdd0 con 0x7f91c80c9730 2023-07-14T13:08:47.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.651+0000 7f91cd6dd640 1 --2- 172.21.15.5:0/4220184430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c80c9730 0x7f91c81638b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f91c0009dc0 tx=0x7f91c001c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5cc3763cd639ab3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:47.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.651+0000 7f91c77fe640 1 -- 172.21.15.5:0/4220184430 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c00a5900 con 0x7f91c80c9730 2023-07-14T13:08:47.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.651+0000 7f91c77fe640 1 -- 172.21.15.5:0/4220184430 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c00a5a60 con 0x7f91c80c9730 2023-07-14T13:08:47.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.651+0000 7f91c77fe640 1 -- 172.21.15.5:0/4220184430 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c00a5df0 con 0x7f91c80c9730 2023-07-14T13:08:47.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.651+0000 7f91cf140640 1 -- 172.21.15.5:0/4220184430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c80c9730 msgr2=0x7f91c81638b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:47.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.651+0000 7f91cf140640 1 --2- 172.21.15.5:0/4220184430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c80c9730 0x7f91c81638b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f91c0009dc0 tx=0x7f91c001c820 comp rx=0 tx=0).stop 2023-07-14T13:08:47.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.655+0000 7f91cf140640 1 -- 172.21.15.5:0/4220184430 shutdown_connections 2023-07-14T13:08:47.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.655+0000 7f91cf140640 1 --2- 172.21.15.5:0/4220184430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c80c9730 0x7f91c81638b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:47.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.655+0000 7f91cf140640 1 -- 172.21.15.5:0/4220184430 >> 172.21.15.5:0/4220184430 conn(0x7f91c80afcf0 msgr2=0x7f91c80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:47.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.655+0000 7f91cf140640 1 -- 172.21.15.5:0/4220184430 shutdown_connections 2023-07-14T13:08:47.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.655+0000 7f91cf140640 1 -- 172.21.15.5:0/4220184430 wait complete. 2023-07-14T13:08:47.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.655+0000 7f91cf140640 1 Processor -- start 2023-07-14T13:08:47.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.655+0000 7f91cf140640 1 -- start start 2023-07-14T13:08:47.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.655+0000 7f91cf140640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c80c8ad0 0x7f91c80c37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:47.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.655+0000 7f91cf140640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c80c9730 0x7f91c8148240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:47.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.655+0000 7f91cf140640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91c8158ce0 0x7f91c8159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:47.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.655+0000 7f91cf140640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c8159b60 con 0x7f91c8158ce0 2023-07-14T13:08:47.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.655+0000 7f91cf140640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c80c3e00 con 0x7f91c80c8ad0 2023-07-14T13:08:47.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.655+0000 7f91cf140640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c8159230 con 0x7f91c80c9730 2023-07-14T13:08:47.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.655+0000 7f91cd6dd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91c8158ce0 0x7f91c8159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:47.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.655+0000 7f91cd6dd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91c8158ce0 0x7f91c8159ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56436/0 (socket says 172.21.15.5:56436) 2023-07-14T13:08:47.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.655+0000 7f91cd6dd640 1 -- 172.21.15.5:0/3523922112 learned_addr learned my addr 172.21.15.5:0/3523922112 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:47.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.655+0000 7f91ccedc640 1 --2- 172.21.15.5:0/3523922112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c80c8ad0 0x7f91c80c37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:47.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.655+0000 7f91c7fff640 1 --2- 172.21.15.5:0/3523922112 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c80c9730 0x7f91c8148240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:47.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.655+0000 7f91cd6dd640 1 -- 172.21.15.5:0/3523922112 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c80c9730 msgr2=0x7f91c8148240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:47.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.655+0000 7f91cd6dd640 1 --2- 172.21.15.5:0/3523922112 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c80c9730 0x7f91c8148240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:47.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.655+0000 7f91cd6dd640 1 -- 172.21.15.5:0/3523922112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c80c8ad0 msgr2=0x7f91c80c37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:47.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.655+0000 7f91cd6dd640 1 --2- 172.21.15.5:0/3523922112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c80c8ad0 0x7f91c80c37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:47.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.655+0000 7f91cd6dd640 1 -- 172.21.15.5:0/3523922112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c0009a70 con 0x7f91c8158ce0 2023-07-14T13:08:47.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.655+0000 7f91cd6dd640 1 --2- 172.21.15.5:0/3523922112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91c8158ce0 0x7f91c8159ff0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f91c001cd00 tx=0x7f91c00195c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:47.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.659+0000 7f91c57fa640 1 -- 172.21.15.5:0/3523922112 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c00b9860 con 0x7f91c8158ce0 2023-07-14T13:08:47.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.659+0000 7f91c57fa640 1 -- 172.21.15.5:0/3523922112 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c00b99c0 con 0x7f91c8158ce0 2023-07-14T13:08:47.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.659+0000 7f91c57fa640 1 -- 172.21.15.5:0/3523922112 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c00b9d30 con 0x7f91c8158ce0 2023-07-14T13:08:47.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.659+0000 7f91cf140640 1 -- 172.21.15.5:0/3523922112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c8159510 con 0x7f91c8158ce0 2023-07-14T13:08:47.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.659+0000 7f91cf140640 1 -- 172.21.15.5:0/3523922112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c8148780 con 0x7f91c8158ce0 2023-07-14T13:08:47.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.659+0000 7f91cf140640 1 -- 172.21.15.5:0/3523922112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c8159cd0 con 0x7f91c8158ce0 2023-07-14T13:08:47.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.659+0000 7f91c57fa640 1 -- 172.21.15.5:0/3523922112 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 36) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f91c00ad440 con 0x7f91c8158ce0 2023-07-14T13:08:47.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.659+0000 7f91c57fa640 1 --2- 172.21.15.5:0/3523922112 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f91ac066100 0x7f91ac0685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:47.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.659+0000 7f91c57fa640 1 -- 172.21.15.5:0/3523922112 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f91c011ee60 con 0x7f91c8158ce0 2023-07-14T13:08:47.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.659+0000 7f91ccedc640 1 --2- 172.21.15.5:0/3523922112 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f91ac066100 0x7f91ac0685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:47.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.663+0000 7f91ccedc640 1 --2- 172.21.15.5:0/3523922112 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f91ac066100 0x7f91ac0685b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f91bc005890 tx=0x7f91bc009040 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:47.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.663+0000 7f91c57fa640 1 -- 172.21.15.5:0/3523922112 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f91c00ec340 con 0x7f91c8158ce0 2023-07-14T13:08:47.849 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:08:47.852 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:08:47.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.851+0000 7f91cf140640 1 -- 172.21.15.5:0/3523922112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91c80678d0 con 0x7f91c8158ce0 2023-07-14T13:08:47.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.855+0000 7f91c57fa640 1 -- 172.21.15.5:0/3523922112 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4710 (secure 0 0 0) 0x7f91c00a58c0 con 0x7f91c8158ce0 2023-07-14T13:08:47.884 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:47.884 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5837,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3019701155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3019701155},{"type":"v1","addr":"172.21.15.5:6835","nonce":3019701155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5843,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1673574180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1673574180},{"type":"v1","addr":"172.21.15.154:6837","nonce":1673574180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6421,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3017507974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3017507974},{"type":"v1","addr":"172.21.15.154:6836","nonce":3017507974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:08:23.268544+0000","modified":"2023-07-14T13:08:26.903497+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6576},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6576":{"gid":6576,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/1613814904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1613814904},{"type":"v1","addr":"172.21.15.5:6834","nonce":1613814904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-14T13:08:47.885 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 32 2023-07-14T13:08:47.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.855+0000 7f91cf140640 1 -- 172.21.15.5:0/3523922112 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f91ac066100 msgr2=0x7f91ac0685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:47.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.855+0000 7f91cf140640 1 --2- 172.21.15.5:0/3523922112 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f91ac066100 0x7f91ac0685b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f91bc005890 tx=0x7f91bc009040 comp rx=0 tx=0).stop 2023-07-14T13:08:47.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.855+0000 7f91cf140640 1 -- 172.21.15.5:0/3523922112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91c8158ce0 msgr2=0x7f91c8159ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:47.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.855+0000 7f91cf140640 1 --2- 172.21.15.5:0/3523922112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91c8158ce0 0x7f91c8159ff0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f91c001cd00 tx=0x7f91c00195c0 comp rx=0 tx=0).stop 2023-07-14T13:08:47.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.855+0000 7f91cf140640 1 -- 172.21.15.5:0/3523922112 shutdown_connections 2023-07-14T13:08:47.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.855+0000 7f91cf140640 1 --2- 172.21.15.5:0/3523922112 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f91ac066100 0x7f91ac0685b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:47.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.855+0000 7f91cf140640 1 --2- 172.21.15.5:0/3523922112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91c8158ce0 0x7f91c8159ff0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:47.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.855+0000 7f91cf140640 1 --2- 172.21.15.5:0/3523922112 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c80c9730 0x7f91c8148240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:47.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.855+0000 7f91cf140640 1 --2- 172.21.15.5:0/3523922112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c80c8ad0 0x7f91c80c37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:47.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.855+0000 7f91cf140640 1 -- 172.21.15.5:0/3523922112 >> 172.21.15.5:0/3523922112 conn(0x7f91c80afcf0 msgr2=0x7f91c81503d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:47.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.855+0000 7f91cf140640 1 -- 172.21.15.5:0/3523922112 shutdown_connections 2023-07-14T13:08:47.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:47.855+0000 7f91cf140640 1 -- 172.21.15.5:0/3523922112 wait complete. 2023-07-14T13:08:47.905 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:08:48.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.059+0000 7fceb585c640 1 Processor -- start 2023-07-14T13:08:48.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.059+0000 7fceb585c640 1 -- start start 2023-07-14T13:08:48.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.063+0000 7fceb585c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fceb015c2b0 0x7fceb0069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:48.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.063+0000 7fceb585c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fceb0069970 0x7fceb00cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:48.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.063+0000 7fceb585c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb00cbc40 con 0x7fceb015b530 2023-07-14T13:08:48.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.063+0000 7fceb585c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb0069df0 con 0x7fceb015c2b0 2023-07-14T13:08:48.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.063+0000 7fceb585c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb015c700 con 0x7fceb0069970 2023-07-14T13:08:48.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.063+0000 7fcea7fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fceb015c2b0 0x7fceb0069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:48.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.063+0000 7fceaf7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fceb0069970 0x7fceb00cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:48.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.063+0000 7fceaeffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fceb015b530 0x7fceb00ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:56266/0 (socket says 172.21.15.5:56266) 2023-07-14T13:08:48.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.063+0000 7fceaeffd640 1 -- 172.21.15.5:0/2484618440 learned_addr learned my addr 172.21.15.5:0/2484618440 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:48.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.063+0000 7fceaf7fe640 1 -- 172.21.15.5:0/2484618440 >> v2:172.21.15.154:3300/0 conn(0x7fceb015c2b0 msgr2=0x7fceb0069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:48.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.063+0000 7fceaf7fe640 1 --2- 172.21.15.5:0/2484618440 >> v2:172.21.15.154:3300/0 conn(0x7fceb015c2b0 0x7fceb0069430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:48.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.063+0000 7fceae7fc640 1 -- 172.21.15.5:0/2484618440 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2460401812 0 0) 0x7fceb00cbc40 con 0x7fceb015b530 2023-07-14T13:08:48.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.063+0000 7fceaf7fe640 1 -- 172.21.15.5:0/2484618440 >> v1:172.21.15.154:6789/0 conn(0x7fceb015b530 legacy=0x7fceb00ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:48.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.063+0000 7fceaf7fe640 1 -- 172.21.15.5:0/2484618440 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb015c950 con 0x7fceb0069970 2023-07-14T13:08:48.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.063+0000 7fcea7fff640 1 --2- 172.21.15.5:0/2484618440 >> v2:172.21.15.154:3300/0 conn(0x7fceb015c2b0 0x7fceb0069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:48.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.067+0000 7fceaf7fe640 1 --2- 172.21.15.5:0/2484618440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fceb0069970 0x7fceb00cc0d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcea8009d90 tx=0x7fcea801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab0e003a1c2c7b6a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:48.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.067+0000 7fceae7fc640 1 -- 172.21.15.5:0/2484618440 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea80a5850 con 0x7fceb0069970 2023-07-14T13:08:48.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.067+0000 7fceae7fc640 1 -- 172.21.15.5:0/2484618440 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea80a59b0 con 0x7fceb0069970 2023-07-14T13:08:48.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.067+0000 7fceae7fc640 1 -- 172.21.15.5:0/2484618440 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea80a5d40 con 0x7fceb0069970 2023-07-14T13:08:48.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.067+0000 7fceb585c640 1 -- 172.21.15.5:0/2484618440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fceb0069970 msgr2=0x7fceb00cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:48.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.067+0000 7fceb585c640 1 --2- 172.21.15.5:0/2484618440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fceb0069970 0x7fceb00cc0d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcea8009d90 tx=0x7fcea801c920 comp rx=0 tx=0).stop 2023-07-14T13:08:48.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.067+0000 7fceb585c640 1 -- 172.21.15.5:0/2484618440 shutdown_connections 2023-07-14T13:08:48.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.067+0000 7fceb585c640 1 --2- 172.21.15.5:0/2484618440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fceb0069970 0x7fceb00cc0d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:48.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.067+0000 7fceb585c640 1 --2- 172.21.15.5:0/2484618440 >> v2:172.21.15.154:3300/0 conn(0x7fceb015c2b0 0x7fceb0069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:48.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.067+0000 7fceb585c640 1 -- 172.21.15.5:0/2484618440 >> 172.21.15.5:0/2484618440 conn(0x7fceb00ce9d0 msgr2=0x7fceb00ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:48.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.067+0000 7fceb585c640 1 -- 172.21.15.5:0/2484618440 shutdown_connections 2023-07-14T13:08:48.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.067+0000 7fceb585c640 1 -- 172.21.15.5:0/2484618440 wait complete. 2023-07-14T13:08:48.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.067+0000 7fceb585c640 1 Processor -- start 2023-07-14T13:08:48.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.067+0000 7fceb585c640 1 -- start start 2023-07-14T13:08:48.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.071+0000 7fceb585c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fceb0069970 0x7fceb00c4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:48.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.071+0000 7fceb585c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fceb015b530 0x7fceb00b1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:48.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.071+0000 7fceb585c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fceb015c2b0 0x7fceb00c3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:48.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.071+0000 7fceb585c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb00b33d0 con 0x7fceb015c2b0 2023-07-14T13:08:48.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.071+0000 7fceb585c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb00b3670 con 0x7fceb0069970 2023-07-14T13:08:48.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.071+0000 7fceb585c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb00b3950 con 0x7fceb015b530 2023-07-14T13:08:48.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.071+0000 7fceaf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fceb015c2b0 0x7fceb00c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:48.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.071+0000 7fceaf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fceb015c2b0 0x7fceb00c3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56442/0 (socket says 172.21.15.5:56442) 2023-07-14T13:08:48.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.071+0000 7fceaf7fe640 1 -- 172.21.15.5:0/2374107822 learned_addr learned my addr 172.21.15.5:0/2374107822 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:48.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.071+0000 7fceaeffd640 1 --2- 172.21.15.5:0/2374107822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fceb0069970 0x7fceb00c4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:48.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.071+0000 7fcea7fff640 1 --2- 172.21.15.5:0/2374107822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fceb015b530 0x7fceb00b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:48.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.071+0000 7fceaf7fe640 1 -- 172.21.15.5:0/2374107822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fceb015b530 msgr2=0x7fceb00b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:48.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.071+0000 7fceaf7fe640 1 --2- 172.21.15.5:0/2374107822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fceb015b530 0x7fceb00b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:48.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.071+0000 7fceaf7fe640 1 -- 172.21.15.5:0/2374107822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fceb0069970 msgr2=0x7fceb00c4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:48.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.071+0000 7fceaf7fe640 1 --2- 172.21.15.5:0/2374107822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fceb0069970 0x7fceb00c4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:48.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.071+0000 7fceaf7fe640 1 -- 172.21.15.5:0/2374107822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce980093b0 con 0x7fceb015c2b0 2023-07-14T13:08:48.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.071+0000 7fceaf7fe640 1 --2- 172.21.15.5:0/2374107822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fceb015c2b0 0x7fceb00c3790 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fcea801afd0 tx=0x7fcea80196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:48.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.071+0000 7fceacff9640 1 -- 172.21.15.5:0/2374107822 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea80b9650 con 0x7fceb015c2b0 2023-07-14T13:08:48.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.071+0000 7fceacff9640 1 -- 172.21.15.5:0/2374107822 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea80b97b0 con 0x7fceb015c2b0 2023-07-14T13:08:48.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.071+0000 7fceb585c640 1 -- 172.21.15.5:0/2374107822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea8009a70 con 0x7fceb015c2b0 2023-07-14T13:08:48.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.071+0000 7fceacff9640 1 -- 172.21.15.5:0/2374107822 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea80b9b20 con 0x7fceb015c2b0 2023-07-14T13:08:48.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.071+0000 7fceb585c640 1 -- 172.21.15.5:0/2374107822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb0156a10 con 0x7fceb015c2b0 2023-07-14T13:08:48.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.071+0000 7fceb585c640 1 -- 172.21.15.5:0/2374107822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb0156c00 con 0x7fceb015c2b0 2023-07-14T13:08:48.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.075+0000 7fceacff9640 1 -- 172.21.15.5:0/2374107822 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 36) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fcea80b9c80 con 0x7fceb015c2b0 2023-07-14T13:08:48.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.075+0000 7fceacff9640 1 --2- 172.21.15.5:0/2374107822 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fce900660d0 0x7fce90068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:48.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.075+0000 7fceacff9640 1 -- 172.21.15.5:0/2374107822 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fcea811efa0 con 0x7fceb015c2b0 2023-07-14T13:08:48.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.075+0000 7fceaeffd640 1 --2- 172.21.15.5:0/2374107822 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fce900660d0 0x7fce90068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:48.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.075+0000 7fceaeffd640 1 --2- 172.21.15.5:0/2374107822 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fce900660d0 0x7fce90068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcea0007fd0 tx=0x7fcea0007d60 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:48.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.079+0000 7fceacff9640 1 -- 172.21.15.5:0/2374107822 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fcea80ec500 con 0x7fceb015c2b0 2023-07-14T13:08:48.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.235+0000 7fceb585c640 1 -- 172.21.15.5:0/2374107822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fceb00678d0 con 0x7fceb015c2b0 2023-07-14T13:08:48.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.235+0000 7fceacff9640 1 -- 172.21.15.5:0/2374107822 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+19323 (secure 0 0 0) 0x7fcea80efb20 con 0x7fceb015c2b0 2023-07-14T13:08:48.268 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:48.268 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":85,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:08:46.303231+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:08:21.382297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-14T13:08:22.261284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/1242365666":"2023-07-15T13:08:46.303174+0000","172.21.15.154:0/3781322655":"2023-07-15T13:08:46.303174+0000","172.21.15.154:0/3124586107":"2023-07-15T13:08:46.303174+0000","172.21.15.154:0/3030240873":"2023-07-15T13:08:46.303174+0000","172.21.15.154:0/2396252510":"2023-07-15T13:08:46.303174+0000","172.21.15.154:0/3616517975":"2023-07-15T13:08:46.303174+0000","172.21.15.154:6833/224047690":"2023-07-15T13:08:46.303174+0000","172.21.15.154:0/1527926807":"2023-07-15T13:08:46.303174+0000","172.21.15.154:6833/1874317247":"2023-07-15T13:08:40.475248+0000","172.21.15.154:6832/1874317247":"2023-07-15T13:08:40.475248+0000","172.21.15.154:0/2022303100":"2023-07-15T13:08:40.475248+0000","172.21.15.154:0/857765741":"2023-07-15T13:08:40.475248+0000","172.21.15.154:0/1586644269":"2023-07-15T13:08:40.475248+0000","172.21.15.154:0/974976956":"2023-07-15T13:08:40.475248+0000","172.21.15.154:0/2603107851":"2023-07-15T13:08:40.475248+0000","172.21.15.154:6832/224047690":"2023-07-15T13:08:46.303174+0000","172.21.15.154:0/2677415683":"2023-07-15T13:08:40.475248+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:08:48.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.239+0000 7fceb585c640 1 -- 172.21.15.5:0/2374107822 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fce900660d0 msgr2=0x7fce90068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:48.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.239+0000 7fceb585c640 1 --2- 172.21.15.5:0/2374107822 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fce900660d0 0x7fce90068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcea0007fd0 tx=0x7fcea0007d60 comp rx=0 tx=0).stop 2023-07-14T13:08:48.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.239+0000 7fceb585c640 1 -- 172.21.15.5:0/2374107822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fceb015c2b0 msgr2=0x7fceb00c3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:48.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.239+0000 7fceb585c640 1 --2- 172.21.15.5:0/2374107822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fceb015c2b0 0x7fceb00c3790 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fcea801afd0 tx=0x7fcea80196c0 comp rx=0 tx=0).stop 2023-07-14T13:08:48.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.239+0000 7fceb585c640 1 -- 172.21.15.5:0/2374107822 shutdown_connections 2023-07-14T13:08:48.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.239+0000 7fceb585c640 1 --2- 172.21.15.5:0/2374107822 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fce900660d0 0x7fce90068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:48.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.239+0000 7fceb585c640 1 --2- 172.21.15.5:0/2374107822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fceb015c2b0 0x7fceb00c3790 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:48.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.239+0000 7fceb585c640 1 --2- 172.21.15.5:0/2374107822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fceb015b530 0x7fceb00b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:48.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.239+0000 7fceb585c640 1 --2- 172.21.15.5:0/2374107822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fceb0069970 0x7fceb00c4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:48.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.239+0000 7fceb585c640 1 -- 172.21.15.5:0/2374107822 >> 172.21.15.5:0/2374107822 conn(0x7fceb00ce9d0 msgr2=0x7fceb015a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:48.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.239+0000 7fceb585c640 1 -- 172.21.15.5:0/2374107822 shutdown_connections 2023-07-14T13:08:48.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.239+0000 7fceb585c640 1 -- 172.21.15.5:0/2374107822 wait complete. 2023-07-14T13:08:48.289 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-14T13:08:48.290 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:08:48.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.403+0000 7f2ea1511640 1 Processor -- start 2023-07-14T13:08:48.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.403+0000 7f2ea1511640 1 -- start start 2023-07-14T13:08:48.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.403+0000 7f2ea1511640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e9c0c8ad0 0x7f2e9c0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:48.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.403+0000 7f2ea1511640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2e9c0c9560 0x7f2e9c0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:48.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.403+0000 7f2ea1511640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9c0c99c0 con 0x7f2e9c158ce0 2023-07-14T13:08:48.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.403+0000 7f2ea1511640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9c0cc700 con 0x7f2e9c0c8ad0 2023-07-14T13:08:48.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.403+0000 7f2ea1511640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9c0b0ff0 con 0x7f2e9c0c9560 2023-07-14T13:08:48.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.403+0000 7f2e93fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e9c0c8ad0 0x7f2e9c0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:48.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.403+0000 7f2e93fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e9c0c8ad0 0x7f2e9c0c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56450/0 (socket says 172.21.15.5:56450) 2023-07-14T13:08:48.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.403+0000 7f2e93fff640 1 -- 172.21.15.5:0/1293372910 learned_addr learned my addr 172.21.15.5:0/1293372910 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:48.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.403+0000 7f2e9b7fe640 1 --2- 172.21.15.5:0/1293372910 >> v2:172.21.15.154:3300/0 conn(0x7f2e9c0c9560 0x7f2e9c0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:48.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.407+0000 7f2e93fff640 1 -- 172.21.15.5:0/1293372910 >> v2:172.21.15.154:3300/0 conn(0x7f2e9c0c9560 msgr2=0x7f2e9c0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:48.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.407+0000 7f2e93fff640 1 --2- 172.21.15.5:0/1293372910 >> v2:172.21.15.154:3300/0 conn(0x7f2e9c0c9560 0x7f2e9c0ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:48.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.407+0000 7f2e93fff640 1 -- 172.21.15.5:0/1293372910 >> v1:172.21.15.154:6789/0 conn(0x7f2e9c158ce0 legacy=0x7f2e9c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:48.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.407+0000 7f2e93fff640 1 -- 172.21.15.5:0/1293372910 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c070c80 con 0x7f2e9c0c8ad0 2023-07-14T13:08:48.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.407+0000 7f2e93fff640 1 --2- 172.21.15.5:0/1293372910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e9c0c8ad0 0x7f2e9c0c9020 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0b0d70 tx=0x7f2e8401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d8c6f04078a322 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:48.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.407+0000 7f2e9a7fc640 1 -- 172.21.15.5:0/1293372910 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e840ac410 con 0x7f2e9c0c8ad0 2023-07-14T13:08:48.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.407+0000 7f2e9a7fc640 1 -- 172.21.15.5:0/1293372910 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e840ac570 con 0x7f2e9c0c8ad0 2023-07-14T13:08:48.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.407+0000 7f2e9a7fc640 1 -- 172.21.15.5:0/1293372910 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e840ac900 con 0x7f2e9c0c8ad0 2023-07-14T13:08:48.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.407+0000 7f2ea1511640 1 -- 172.21.15.5:0/1293372910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e9c0c8ad0 msgr2=0x7f2e9c0c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:48.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.407+0000 7f2ea1511640 1 --2- 172.21.15.5:0/1293372910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e9c0c8ad0 0x7f2e9c0c9020 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0b0d70 tx=0x7f2e8401c3b0 comp rx=0 tx=0).stop 2023-07-14T13:08:48.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.407+0000 7f2ea1511640 1 -- 172.21.15.5:0/1293372910 shutdown_connections 2023-07-14T13:08:48.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.407+0000 7f2ea1511640 1 --2- 172.21.15.5:0/1293372910 >> v2:172.21.15.154:3300/0 conn(0x7f2e9c0c9560 0x7f2e9c0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:48.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.407+0000 7f2ea1511640 1 --2- 172.21.15.5:0/1293372910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e9c0c8ad0 0x7f2e9c0c9020 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:48.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.407+0000 7f2ea1511640 1 -- 172.21.15.5:0/1293372910 >> 172.21.15.5:0/1293372910 conn(0x7f2e9c0afcf0 msgr2=0x7f2e9c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:48.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.407+0000 7f2ea1511640 1 -- 172.21.15.5:0/1293372910 shutdown_connections 2023-07-14T13:08:48.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.407+0000 7f2ea1511640 1 -- 172.21.15.5:0/1293372910 wait complete. 2023-07-14T13:08:48.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.411+0000 7f2ea1511640 1 Processor -- start 2023-07-14T13:08:48.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.411+0000 7f2ea1511640 1 -- start start 2023-07-14T13:08:48.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.411+0000 7f2ea1511640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e9c0c8ad0 0x7f2e9c14e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:48.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.411+0000 7f2ea1511640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e9c0c9560 0x7f2e9c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:48.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.411+0000 7f2ea1511640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e9c158ce0 0x7f2e9c0b1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:48.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.411+0000 7f2ea1511640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c0ace10 con 0x7f2e9c0c8ad0 2023-07-14T13:08:48.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.411+0000 7f2ea1511640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c14e8f0 con 0x7f2e9c0c9560 2023-07-14T13:08:48.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.411+0000 7f2ea1511640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c0c55a0 con 0x7f2e9c158ce0 2023-07-14T13:08:48.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.411+0000 7f2e9affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e9c0c8ad0 0x7f2e9c14e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:48.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.411+0000 7f2e9affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e9c0c8ad0 0x7f2e9c14e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56452/0 (socket says 172.21.15.5:56452) 2023-07-14T13:08:48.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.411+0000 7f2e9affd640 1 -- 172.21.15.5:0/240650769 learned_addr learned my addr 172.21.15.5:0/240650769 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:48.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.411+0000 7f2e9b7fe640 1 --2- 172.21.15.5:0/240650769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e9c158ce0 0x7f2e9c0b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:48.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.411+0000 7f2e9affd640 1 -- 172.21.15.5:0/240650769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e9c158ce0 msgr2=0x7f2e9c0b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:48.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.411+0000 7f2e9affd640 1 --2- 172.21.15.5:0/240650769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e9c158ce0 0x7f2e9c0b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:48.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.411+0000 7f2e93fff640 1 --2- 172.21.15.5:0/240650769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e9c0c9560 0x7f2e9c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:48.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.411+0000 7f2e9affd640 1 -- 172.21.15.5:0/240650769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e9c0c9560 msgr2=0x7f2e9c0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:48.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.411+0000 7f2e9affd640 1 --2- 172.21.15.5:0/240650769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e9c0c9560 0x7f2e9c0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:48.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.411+0000 7f2e9affd640 1 -- 172.21.15.5:0/240650769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e840094d0 con 0x7f2e9c0c8ad0 2023-07-14T13:08:48.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.411+0000 7f2e93fff640 1 --2- 172.21.15.5:0/240650769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e9c0c9560 0x7f2e9c0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:08:48.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.411+0000 7f2e9b7fe640 1 --2- 172.21.15.5:0/240650769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e9c158ce0 0x7f2e9c0b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:08:48.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.411+0000 7f2e9affd640 1 --2- 172.21.15.5:0/240650769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e9c0c8ad0 0x7f2e9c14e3b0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00c3c0 tx=0x7f2e8c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:48.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.411+0000 7f2e937fe640 1 -- 172.21.15.5:0/240650769 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c0052d0 con 0x7f2e9c0c8ad0 2023-07-14T13:08:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.411+0000 7f2e937fe640 1 -- 172.21.15.5:0/240650769 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c005430 con 0x7f2e9c0c8ad0 2023-07-14T13:08:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.411+0000 7f2e937fe640 1 -- 172.21.15.5:0/240650769 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c003840 con 0x7f2e9c0c8ad0 2023-07-14T13:08:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.411+0000 7f2ea1511640 1 -- 172.21.15.5:0/240650769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9c0c5880 con 0x7f2e9c0c8ad0 2023-07-14T13:08:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.415+0000 7f2ea1511640 1 -- 172.21.15.5:0/240650769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9c0c5e40 con 0x7f2e9c0c8ad0 2023-07-14T13:08:48.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.415+0000 7f2ea1511640 1 -- 172.21.15.5:0/240650769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e9c0ca1a0 con 0x7f2e9c0c8ad0 2023-07-14T13:08:48.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.415+0000 7f2e937fe640 1 -- 172.21.15.5:0/240650769 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 36) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f2e8c0039a0 con 0x7f2e9c0c8ad0 2023-07-14T13:08:48.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.415+0000 7f2e937fe640 1 --2- 172.21.15.5:0/240650769 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2e7c0660d0 0x7f2e7c068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:48.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.415+0000 7f2e937fe640 1 -- 172.21.15.5:0/240650769 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f2e8c0832c0 con 0x7f2e9c0c8ad0 2023-07-14T13:08:48.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.415+0000 7f2e93fff640 1 --2- 172.21.15.5:0/240650769 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2e7c0660d0 0x7f2e7c068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:48.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.415+0000 7f2e93fff640 1 --2- 172.21.15.5:0/240650769 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2e7c0660d0 0x7f2e7c068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2e840ae000 tx=0x7f2e840a6040 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:48.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.419+0000 7f2e937fe640 1 -- 172.21.15.5:0/240650769 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2e8c050640 con 0x7f2e9c0c8ad0 2023-07-14T13:08:48.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.559+0000 7f2e937fe640 1 -- 172.21.15.5:0/240650769 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2e8c050a10 con 0x7f2e9c0c8ad0 2023-07-14T13:08:48.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.607+0000 7f2ea1511640 1 -- 172.21.15.5:0/240650769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e9c0678d0 con 0x7f2e9c0c8ad0 2023-07-14T13:08:48.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.611+0000 7f2e937fe640 1 -- 172.21.15.5:0/240650769 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4710 (secure 0 0 0) 0x7f2e8c070780 con 0x7f2e9c0c8ad0 2023-07-14T13:08:48.641 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:48.641 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5837,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3019701155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3019701155},{"type":"v1","addr":"172.21.15.5:6835","nonce":3019701155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5843,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1673574180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1673574180},{"type":"v1","addr":"172.21.15.154:6837","nonce":1673574180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6421,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3017507974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3017507974},{"type":"v1","addr":"172.21.15.154:6836","nonce":3017507974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:08:23.268544+0000","modified":"2023-07-14T13:08:26.903497+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6576},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6576":{"gid":6576,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/1613814904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1613814904},{"type":"v1","addr":"172.21.15.5:6834","nonce":1613814904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-14T13:08:48.641 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 32 2023-07-14T13:08:48.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.611+0000 7f2ea1511640 1 -- 172.21.15.5:0/240650769 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2e7c0660d0 msgr2=0x7f2e7c068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:48.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.611+0000 7f2ea1511640 1 --2- 172.21.15.5:0/240650769 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2e7c0660d0 0x7f2e7c068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2e840ae000 tx=0x7f2e840a6040 comp rx=0 tx=0).stop 2023-07-14T13:08:48.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.611+0000 7f2ea1511640 1 -- 172.21.15.5:0/240650769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e9c0c8ad0 msgr2=0x7f2e9c14e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:48.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.611+0000 7f2ea1511640 1 --2- 172.21.15.5:0/240650769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e9c0c8ad0 0x7f2e9c14e3b0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00c3c0 tx=0x7f2e8c00c880 comp rx=0 tx=0).stop 2023-07-14T13:08:48.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.611+0000 7f2ea1511640 1 -- 172.21.15.5:0/240650769 shutdown_connections 2023-07-14T13:08:48.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.611+0000 7f2ea1511640 1 --2- 172.21.15.5:0/240650769 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2e7c0660d0 0x7f2e7c068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:48.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.611+0000 7f2ea1511640 1 --2- 172.21.15.5:0/240650769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e9c158ce0 0x7f2e9c0b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:48.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.611+0000 7f2ea1511640 1 --2- 172.21.15.5:0/240650769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e9c0c9560 0x7f2e9c0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:48.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.611+0000 7f2ea1511640 1 --2- 172.21.15.5:0/240650769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e9c0c8ad0 0x7f2e9c14e3b0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:48.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.611+0000 7f2ea1511640 1 -- 172.21.15.5:0/240650769 >> 172.21.15.5:0/240650769 conn(0x7f2e9c0afcf0 msgr2=0x7f2e9c070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:48.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.611+0000 7f2ea1511640 1 -- 172.21.15.5:0/240650769 shutdown_connections 2023-07-14T13:08:48.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.611+0000 7f2ea1511640 1 -- 172.21.15.5:0/240650769 wait complete. 2023-07-14T13:08:48.662 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:08:48.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.775+0000 7eff009d2640 1 Processor -- start 2023-07-14T13:08:48.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.775+0000 7eff009d2640 1 -- start start 2023-07-14T13:08:48.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.775+0000 7eff009d2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efefc0affc0 0x7efefc06fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:48.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.775+0000 7eff009d2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efefc06ffb0 0x7efefc0c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:48.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.775+0000 7eff009d2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efefc158a50 con 0x7efefc158680 2023-07-14T13:08:48.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.775+0000 7eff009d2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efefc1599b0 con 0x7efefc0affc0 2023-07-14T13:08:48.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.775+0000 7eff009d2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efefc15d170 con 0x7efefc06ffb0 2023-07-14T13:08:48.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.775+0000 7efefaffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efefc0affc0 0x7efefc06fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:48.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.775+0000 7efefaffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efefc0affc0 0x7efefc06fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56460/0 (socket says 172.21.15.5:56460) 2023-07-14T13:08:48.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.775+0000 7efefaffd640 1 -- 172.21.15.5:0/3403848450 learned_addr learned my addr 172.21.15.5:0/3403848450 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:48.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.779+0000 7efefbfff640 1 --2- 172.21.15.5:0/3403848450 >> v2:172.21.15.154:3300/0 conn(0x7efefc06ffb0 0x7efefc0c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:48.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.779+0000 7efefaffd640 1 -- 172.21.15.5:0/3403848450 >> v2:172.21.15.154:3300/0 conn(0x7efefc06ffb0 msgr2=0x7efefc0c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:48.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.779+0000 7efefaffd640 1 --2- 172.21.15.5:0/3403848450 >> v2:172.21.15.154:3300/0 conn(0x7efefc06ffb0 0x7efefc0c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:48.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.779+0000 7efefaffd640 1 -- 172.21.15.5:0/3403848450 >> v1:172.21.15.154:6789/0 conn(0x7efefc158680 legacy=0x7efefc0af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:48.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.779+0000 7efefaffd640 1 -- 172.21.15.5:0/3403848450 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efefc158d30 con 0x7efefc0affc0 2023-07-14T13:08:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.779+0000 7efefaffd640 1 --2- 172.21.15.5:0/3403848450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efefc0affc0 0x7efefc06fa70 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7efefc0ad840 tx=0x7efef001eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aaa501cdc3a5c63 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.779+0000 7efefa7fc640 1 -- 172.21.15.5:0/3403848450 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef00a7c70 con 0x7efefc0affc0 2023-07-14T13:08:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.779+0000 7efefa7fc640 1 -- 172.21.15.5:0/3403848450 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef00a7dd0 con 0x7efefc0affc0 2023-07-14T13:08:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.779+0000 7efefa7fc640 1 -- 172.21.15.5:0/3403848450 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef00af660 con 0x7efefc0affc0 2023-07-14T13:08:48.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.779+0000 7eff009d2640 1 -- 172.21.15.5:0/3403848450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efefc0affc0 msgr2=0x7efefc06fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:48.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.779+0000 7eff009d2640 1 --2- 172.21.15.5:0/3403848450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efefc0affc0 0x7efefc06fa70 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7efefc0ad840 tx=0x7efef001eba0 comp rx=0 tx=0).stop 2023-07-14T13:08:48.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.779+0000 7eff009d2640 1 -- 172.21.15.5:0/3403848450 shutdown_connections 2023-07-14T13:08:48.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.779+0000 7eff009d2640 1 --2- 172.21.15.5:0/3403848450 >> v2:172.21.15.154:3300/0 conn(0x7efefc06ffb0 0x7efefc0c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:48.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.779+0000 7eff009d2640 1 --2- 172.21.15.5:0/3403848450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efefc0affc0 0x7efefc06fa70 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:48.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.783+0000 7eff009d2640 1 -- 172.21.15.5:0/3403848450 >> 172.21.15.5:0/3403848450 conn(0x7efefc0ca8b0 msgr2=0x7efefc0cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:48.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.783+0000 7eff009d2640 1 -- 172.21.15.5:0/3403848450 shutdown_connections 2023-07-14T13:08:48.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.783+0000 7eff009d2640 1 -- 172.21.15.5:0/3403848450 wait complete. 2023-07-14T13:08:48.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.783+0000 7eff009d2640 1 Processor -- start 2023-07-14T13:08:48.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.783+0000 7eff009d2640 1 -- start start 2023-07-14T13:08:48.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.783+0000 7eff009d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efefc06ffb0 0x7efefc1f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.783+0000 7eff009d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efefc0affc0 0x7efefc1f75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.783+0000 7eff009d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efefc158680 0x7efefc1f7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.783+0000 7eff009d2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efefc0cbaf0 con 0x7efefc06ffb0 2023-07-14T13:08:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.783+0000 7eff009d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efefc157de0 con 0x7efefc158680 2023-07-14T13:08:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.783+0000 7eff009d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efefc0cbd90 con 0x7efefc0affc0 2023-07-14T13:08:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.783+0000 7efefb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efefc06ffb0 0x7efefc1f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.783+0000 7efefb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efefc06ffb0 0x7efefc1f5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56468/0 (socket says 172.21.15.5:56468) 2023-07-14T13:08:48.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.783+0000 7efefb7fe640 1 -- 172.21.15.5:0/1450902867 learned_addr learned my addr 172.21.15.5:0/1450902867 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:48.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.783+0000 7efefbfff640 1 --2- 172.21.15.5:0/1450902867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efefc158680 0x7efefc1f7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:48.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.783+0000 7efefaffd640 1 --2- 172.21.15.5:0/1450902867 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efefc0affc0 0x7efefc1f75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:48.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.783+0000 7efefb7fe640 1 -- 172.21.15.5:0/1450902867 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efefc0affc0 msgr2=0x7efefc1f75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:48.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.783+0000 7efefb7fe640 1 --2- 172.21.15.5:0/1450902867 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efefc0affc0 0x7efefc1f75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:48.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.783+0000 7efefb7fe640 1 -- 172.21.15.5:0/1450902867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efefc158680 msgr2=0x7efefc1f7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:48.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.783+0000 7efefb7fe640 1 --2- 172.21.15.5:0/1450902867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efefc158680 0x7efefc1f7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:48.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.783+0000 7efefb7fe640 1 -- 172.21.15.5:0/1450902867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef000b770 con 0x7efefc06ffb0 2023-07-14T13:08:48.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.783+0000 7efefb7fe640 1 --2- 172.21.15.5:0/1450902867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efefc06ffb0 0x7efefc1f5080 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7efeec00c3c0 tx=0x7efeec00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:48.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.787+0000 7efee3fff640 1 -- 172.21.15.5:0/1450902867 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec0052d0 con 0x7efefc06ffb0 2023-07-14T13:08:48.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.787+0000 7efee3fff640 1 -- 172.21.15.5:0/1450902867 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeec005430 con 0x7efefc06ffb0 2023-07-14T13:08:48.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.787+0000 7efee3fff640 1 -- 172.21.15.5:0/1450902867 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec003840 con 0x7efefc06ffb0 2023-07-14T13:08:48.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.787+0000 7eff009d2640 1 -- 172.21.15.5:0/1450902867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efefc0cc070 con 0x7efefc06ffb0 2023-07-14T13:08:48.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.787+0000 7eff009d2640 1 -- 172.21.15.5:0/1450902867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efefc1f55c0 con 0x7efefc06ffb0 2023-07-14T13:08:48.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.787+0000 7eff009d2640 1 -- 172.21.15.5:0/1450902867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efefc0678d0 con 0x7efefc06ffb0 2023-07-14T13:08:48.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.787+0000 7efee3fff640 1 -- 172.21.15.5:0/1450902867 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7efeec0039a0 con 0x7efefc06ffb0 2023-07-14T13:08:48.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.787+0000 7efee3fff640 1 --2- 172.21.15.5:0/1450902867 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7efee80663d0 0x7efee8068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:48.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.787+0000 7efee3fff640 1 -- 172.21.15.5:0/1450902867 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6793+0+0 (secure 0 0 0) 0x7efeec083530 con 0x7efefc06ffb0 2023-07-14T13:08:48.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.787+0000 7efefaffd640 1 --2- 172.21.15.5:0/1450902867 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7efee80663d0 0x7efee8068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:48.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.791+0000 7efefaffd640 1 --2- 172.21.15.5:0/1450902867 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7efee80663d0 0x7efee8068880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efef00b1000 tx=0x7efef0008040 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:48.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.791+0000 7efee3fff640 1 -- 172.21.15.5:0/1450902867 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7efeec050700 con 0x7efefc06ffb0 2023-07-14T13:08:49.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.979+0000 7eff009d2640 1 -- 172.21.15.5:0/1450902867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efefc0c89d0 con 0x7efefc06ffb0 2023-07-14T13:08:49.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.979+0000 7efee3fff640 1 -- 172.21.15.5:0/1450902867 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4710 (secure 0 0 0) 0x7efeec053d20 con 0x7efefc06ffb0 2023-07-14T13:08:49.010 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:49.011 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5837,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3019701155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3019701155},{"type":"v1","addr":"172.21.15.5:6835","nonce":3019701155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5843,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1673574180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1673574180},{"type":"v1","addr":"172.21.15.154:6837","nonce":1673574180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6421,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3017507974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3017507974},{"type":"v1","addr":"172.21.15.154:6836","nonce":3017507974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:08:23.268544+0000","modified":"2023-07-14T13:08:26.903497+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6576},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6576":{"gid":6576,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/1613814904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1613814904},{"type":"v1","addr":"172.21.15.5:6834","nonce":1613814904}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-14T13:08:49.011 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 32 2023-07-14T13:08:49.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.979+0000 7eff009d2640 1 -- 172.21.15.5:0/1450902867 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7efee80663d0 msgr2=0x7efee8068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:49.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.979+0000 7eff009d2640 1 --2- 172.21.15.5:0/1450902867 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7efee80663d0 0x7efee8068880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efef00b1000 tx=0x7efef0008040 comp rx=0 tx=0).stop 2023-07-14T13:08:49.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.979+0000 7eff009d2640 1 -- 172.21.15.5:0/1450902867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efefc06ffb0 msgr2=0x7efefc1f5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:49.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.979+0000 7eff009d2640 1 --2- 172.21.15.5:0/1450902867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efefc06ffb0 0x7efefc1f5080 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7efeec00c3c0 tx=0x7efeec00c880 comp rx=0 tx=0).stop 2023-07-14T13:08:49.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.983+0000 7eff009d2640 1 -- 172.21.15.5:0/1450902867 shutdown_connections 2023-07-14T13:08:49.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.983+0000 7eff009d2640 1 --2- 172.21.15.5:0/1450902867 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7efee80663d0 0x7efee8068880 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.983+0000 7eff009d2640 1 --2- 172.21.15.5:0/1450902867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efefc158680 0x7efefc1f7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.983+0000 7eff009d2640 1 --2- 172.21.15.5:0/1450902867 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efefc0affc0 0x7efefc1f75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.983+0000 7eff009d2640 1 --2- 172.21.15.5:0/1450902867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efefc06ffb0 0x7efefc1f5080 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.983+0000 7eff009d2640 1 -- 172.21.15.5:0/1450902867 >> 172.21.15.5:0/1450902867 conn(0x7efefc0ca8b0 msgr2=0x7efefc1542b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:49.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.983+0000 7eff009d2640 1 -- 172.21.15.5:0/1450902867 shutdown_connections 2023-07-14T13:08:49.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:48.983+0000 7eff009d2640 1 -- 172.21.15.5:0/1450902867 wait complete. 2023-07-14T13:08:49.031 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:08:49.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.143+0000 7fa1001df640 1 Processor -- start 2023-07-14T13:08:49.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.143+0000 7fa1001df640 1 -- start start 2023-07-14T13:08:49.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.147+0000 7fa1001df640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0f8160330 0x7fa0f80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:49.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.147+0000 7fa1001df640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f80c17d0 con 0x7fa0f80c8940 2023-07-14T13:08:49.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.147+0000 7fa1001df640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f80c14f0 con 0x7fa0f80c0f80 2023-07-14T13:08:49.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.147+0000 7fa1001df640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f80cdd70 con 0x7fa0f8160330 2023-07-14T13:08:49.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.147+0000 7fa0fd77a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa0f80c8940 0x7fa0f80ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57138/0 (socket says 172.21.15.5:57138) 2023-07-14T13:08:49.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.147+0000 7fa0fd77a640 1 -- 172.21.15.5:0/765335863 learned_addr learned my addr 172.21.15.5:0/765335863 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:49.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.147+0000 7fa0fdf7b640 1 --2- 172.21.15.5:0/765335863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0f8160330 0x7fa0f80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:49.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.147+0000 7fa0fcf79640 1 -- 172.21.15.5:0/765335863 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3641296075 0 0) 0x7fa0f80c17d0 con 0x7fa0f80c8940 2023-07-14T13:08:49.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.147+0000 7fa0fdf7b640 1 -- 172.21.15.5:0/765335863 >> v1:172.21.15.154:6789/0 conn(0x7fa0f80c0f80 legacy=0x7fa0f80cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:49.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.147+0000 7fa0fdf7b640 1 -- 172.21.15.5:0/765335863 >> v1:172.21.15.5:6789/0 conn(0x7fa0f80c8940 legacy=0x7fa0f80ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:49.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.147+0000 7fa0fdf7b640 1 -- 172.21.15.5:0/765335863 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f80cac10 con 0x7fa0f8160330 2023-07-14T13:08:49.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.151+0000 7fa0fdf7b640 1 --2- 172.21.15.5:0/765335863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0f8160330 0x7fa0f80cb6f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa0f40097f0 tx=0x7fa0f401ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=632d4922d7857972 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:49.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.151+0000 7fa0fcf79640 1 -- 172.21.15.5:0/765335863 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f40a89b0 con 0x7fa0f8160330 2023-07-14T13:08:49.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.151+0000 7fa0fcf79640 1 -- 172.21.15.5:0/765335863 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f40a8b10 con 0x7fa0f8160330 2023-07-14T13:08:49.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.151+0000 7fa0fcf79640 1 -- 172.21.15.5:0/765335863 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f40a8ea0 con 0x7fa0f8160330 2023-07-14T13:08:49.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.151+0000 7fa1001df640 1 -- 172.21.15.5:0/765335863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0f8160330 msgr2=0x7fa0f80cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:49.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.151+0000 7fa1001df640 1 --2- 172.21.15.5:0/765335863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0f8160330 0x7fa0f80cb6f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa0f40097f0 tx=0x7fa0f401ecb0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.151+0000 7fa1001df640 1 -- 172.21.15.5:0/765335863 shutdown_connections 2023-07-14T13:08:49.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.151+0000 7fa1001df640 1 --2- 172.21.15.5:0/765335863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0f8160330 0x7fa0f80cb6f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.151+0000 7fa1001df640 1 -- 172.21.15.5:0/765335863 >> 172.21.15.5:0/765335863 conn(0x7fa0f80afcf0 msgr2=0x7fa0f80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:49.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.151+0000 7fa1001df640 1 -- 172.21.15.5:0/765335863 shutdown_connections 2023-07-14T13:08:49.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.151+0000 7fa1001df640 1 -- 172.21.15.5:0/765335863 wait complete. 2023-07-14T13:08:49.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.151+0000 7fa1001df640 1 Processor -- start 2023-07-14T13:08:49.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.151+0000 7fa1001df640 1 -- start start 2023-07-14T13:08:49.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.155+0000 7fa1001df640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0f80c0f80 0x7fa0f815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:49.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.155+0000 7fa1001df640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0f80c8940 0x7fa0f81635b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:49.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.155+0000 7fa1001df640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0f8160330 0x7fa0f80c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:49.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.155+0000 7fa1001df640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f815c9f0 con 0x7fa0f80c0f80 2023-07-14T13:08:49.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.155+0000 7fa1001df640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f80c3330 con 0x7fa0f80c8940 2023-07-14T13:08:49.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.155+0000 7fa1001df640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f80c3610 con 0x7fa0f8160330 2023-07-14T13:08:49.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.155+0000 7fa0fdf7b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0f80c0f80 0x7fa0f815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:49.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.155+0000 7fa0fdf7b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0f80c0f80 0x7fa0f815bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44632/0 (socket says 172.21.15.5:44632) 2023-07-14T13:08:49.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.155+0000 7fa0fdf7b640 1 -- 172.21.15.5:0/3278382868 learned_addr learned my addr 172.21.15.5:0/3278382868 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:49.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.155+0000 7fa0fd77a640 1 --2- 172.21.15.5:0/3278382868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0f80c8940 0x7fa0f81635b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:49.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.155+0000 7fa0fe77c640 1 --2- 172.21.15.5:0/3278382868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0f8160330 0x7fa0f80c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:49.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.155+0000 7fa0fdf7b640 1 -- 172.21.15.5:0/3278382868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0f8160330 msgr2=0x7fa0f80c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:49.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.155+0000 7fa0fdf7b640 1 --2- 172.21.15.5:0/3278382868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0f8160330 0x7fa0f80c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.155+0000 7fa0fdf7b640 1 -- 172.21.15.5:0/3278382868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0f80c8940 msgr2=0x7fa0f81635b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:49.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.155+0000 7fa0fdf7b640 1 --2- 172.21.15.5:0/3278382868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0f80c8940 0x7fa0f81635b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.155+0000 7fa0fdf7b640 1 -- 172.21.15.5:0/3278382868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f4009420 con 0x7fa0f80c0f80 2023-07-14T13:08:49.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.155+0000 7fa0fe77c640 1 --2- 172.21.15.5:0/3278382868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0f8160330 0x7fa0f80c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:49.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.155+0000 7fa0fdf7b640 1 --2- 172.21.15.5:0/3278382868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0f80c0f80 0x7fa0f815bf30 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fa0f40097f0 tx=0x7fa0f401ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:49.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.155+0000 7fa0ee7fc640 1 -- 172.21.15.5:0/3278382868 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f40b0ea0 con 0x7fa0f80c0f80 2023-07-14T13:08:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.155+0000 7fa0ee7fc640 1 -- 172.21.15.5:0/3278382868 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f40bb420 con 0x7fa0f80c0f80 2023-07-14T13:08:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.155+0000 7fa0ee7fc640 1 -- 172.21.15.5:0/3278382868 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f40bb7d0 con 0x7fa0f80c0f80 2023-07-14T13:08:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.155+0000 7fa1001df640 1 -- 172.21.15.5:0/3278382868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f80c38f0 con 0x7fa0f80c0f80 2023-07-14T13:08:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.155+0000 7fa1001df640 1 -- 172.21.15.5:0/3278382868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f80c3eb0 con 0x7fa0f80c0f80 2023-07-14T13:08:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.155+0000 7fa1001df640 1 -- 172.21.15.5:0/3278382868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f80678d0 con 0x7fa0f80c0f80 2023-07-14T13:08:49.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.155+0000 7fa0ee7fc640 1 -- 172.21.15.5:0/3278382868 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa0f40b7040 con 0x7fa0f80c0f80 2023-07-14T13:08:49.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.159+0000 7fa0ee7fc640 1 --2- 172.21.15.5:0/3278382868 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fa0dc0663a0 0x7fa0dc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:49.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.159+0000 7fa0ee7fc640 1 -- 172.21.15.5:0/3278382868 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fa0f4122750 con 0x7fa0f80c0f80 2023-07-14T13:08:49.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.159+0000 7fa0fd77a640 1 --2- 172.21.15.5:0/3278382868 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fa0dc0663a0 0x7fa0dc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:49.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.159+0000 7fa0fd77a640 1 --2- 172.21.15.5:0/3278382868 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fa0dc0663a0 0x7fa0dc068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8007a90 tx=0x7fa0e80079e0 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:49.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.163+0000 7fa0ee7fc640 1 -- 172.21.15.5:0/3278382868 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa0f40ef800 con 0x7fa0f80c0f80 2023-07-14T13:08:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.315+0000 7fa1001df640 1 -- 172.21.15.5:0/3278382868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0f80707c0 con 0x7fa0f80c0f80 2023-07-14T13:08:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.319+0000 7fa0ee7fc640 1 -- 172.21.15.5:0/3278382868 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+19323 (secure 0 0 0) 0x7fa0f40f2e20 con 0x7fa0f80c0f80 2023-07-14T13:08:49.350 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:49.350 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":85,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:08:46.303231+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:08:21.382297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-14T13:08:22.261284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/1242365666":"2023-07-15T13:08:46.303174+0000","172.21.15.154:0/3781322655":"2023-07-15T13:08:46.303174+0000","172.21.15.154:0/3124586107":"2023-07-15T13:08:46.303174+0000","172.21.15.154:0/3030240873":"2023-07-15T13:08:46.303174+0000","172.21.15.154:0/2396252510":"2023-07-15T13:08:46.303174+0000","172.21.15.154:0/3616517975":"2023-07-15T13:08:46.303174+0000","172.21.15.154:6833/224047690":"2023-07-15T13:08:46.303174+0000","172.21.15.154:0/1527926807":"2023-07-15T13:08:46.303174+0000","172.21.15.154:6833/1874317247":"2023-07-15T13:08:40.475248+0000","172.21.15.154:6832/1874317247":"2023-07-15T13:08:40.475248+0000","172.21.15.154:0/2022303100":"2023-07-15T13:08:40.475248+0000","172.21.15.154:0/857765741":"2023-07-15T13:08:40.475248+0000","172.21.15.154:0/1586644269":"2023-07-15T13:08:40.475248+0000","172.21.15.154:0/974976956":"2023-07-15T13:08:40.475248+0000","172.21.15.154:0/2603107851":"2023-07-15T13:08:40.475248+0000","172.21.15.154:6832/224047690":"2023-07-15T13:08:46.303174+0000","172.21.15.154:0/2677415683":"2023-07-15T13:08:40.475248+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:08:49.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.319+0000 7fa1001df640 1 -- 172.21.15.5:0/3278382868 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fa0dc0663a0 msgr2=0x7fa0dc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:49.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.319+0000 7fa1001df640 1 --2- 172.21.15.5:0/3278382868 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fa0dc0663a0 0x7fa0dc068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8007a90 tx=0x7fa0e80079e0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.319+0000 7fa1001df640 1 -- 172.21.15.5:0/3278382868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0f80c0f80 msgr2=0x7fa0f815bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:49.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.319+0000 7fa1001df640 1 --2- 172.21.15.5:0/3278382868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0f80c0f80 0x7fa0f815bf30 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fa0f40097f0 tx=0x7fa0f401ba50 comp rx=0 tx=0).stop 2023-07-14T13:08:49.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.319+0000 7fa1001df640 1 -- 172.21.15.5:0/3278382868 shutdown_connections 2023-07-14T13:08:49.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.319+0000 7fa1001df640 1 --2- 172.21.15.5:0/3278382868 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fa0dc0663a0 0x7fa0dc068850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.319+0000 7fa1001df640 1 --2- 172.21.15.5:0/3278382868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0f8160330 0x7fa0f80c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.319+0000 7fa1001df640 1 --2- 172.21.15.5:0/3278382868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0f80c8940 0x7fa0f81635b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.319+0000 7fa1001df640 1 --2- 172.21.15.5:0/3278382868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0f80c0f80 0x7fa0f815bf30 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.319+0000 7fa1001df640 1 -- 172.21.15.5:0/3278382868 >> 172.21.15.5:0/3278382868 conn(0x7fa0f80afcf0 msgr2=0x7fa0f80adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:49.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.319+0000 7fa1001df640 1 -- 172.21.15.5:0/3278382868 shutdown_connections 2023-07-14T13:08:49.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.319+0000 7fa1001df640 1 -- 172.21.15.5:0/3278382868 wait complete. 2023-07-14T13:08:49.371 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-14T13:08:49.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.487+0000 7f492967b640 1 Processor -- start 2023-07-14T13:08:49.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.487+0000 7f492967b640 1 -- start start 2023-07-14T13:08:49.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.487+0000 7f492967b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f492406a540 0x7f492406a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:49.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.487+0000 7f492967b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f49240ce0f0 0x7f49240ce550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:49.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.487+0000 7f492967b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49240cdc80 con 0x7f492415f500 2023-07-14T13:08:49.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.487+0000 7f492967b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f492406af00 con 0x7f49240ce0f0 2023-07-14T13:08:49.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.487+0000 7f492967b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f492406e4c0 con 0x7f492406a540 2023-07-14T13:08:49.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.487+0000 7f49237fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f49240ce0f0 0x7f49240ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:49.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.487+0000 7f49237fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f49240ce0f0 0x7f49240ce550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44638/0 (socket says 172.21.15.5:44638) 2023-07-14T13:08:49.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.487+0000 7f49237fe640 1 -- 172.21.15.5:0/1848607544 learned_addr learned my addr 172.21.15.5:0/1848607544 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:49.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.487+0000 7f49237fe640 1 -- 172.21.15.5:0/1848607544 >> v2:172.21.15.154:3300/0 conn(0x7f492406a540 msgr2=0x7f492406a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:49.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.487+0000 7f49227fc640 1 --2- 172.21.15.5:0/1848607544 >> v2:172.21.15.154:3300/0 conn(0x7f492406a540 0x7f492406a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:49.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.487+0000 7f49237fe640 1 --2- 172.21.15.5:0/1848607544 >> v2:172.21.15.154:3300/0 conn(0x7f492406a540 0x7f492406a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.487+0000 7f49237fe640 1 -- 172.21.15.5:0/1848607544 >> v1:172.21.15.154:6789/0 conn(0x7f492415f500 legacy=0x7f492406cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:49.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.487+0000 7f49237fe640 1 -- 172.21.15.5:0/1848607544 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492406d940 con 0x7f49240ce0f0 2023-07-14T13:08:49.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.487+0000 7f49227fc640 1 --2- 172.21.15.5:0/1848607544 >> v2:172.21.15.154:3300/0 conn(0x7f492406a540 0x7f492406a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:08:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.491+0000 7f49237fe640 1 --2- 172.21.15.5:0/1848607544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49240ce0f0 0x7f49240ce550 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f49240d1190 tx=0x7f491c01c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41de882269fe09fd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.491+0000 7f4921ffb640 1 -- 172.21.15.5:0/1848607544 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c0a5740 con 0x7f49240ce0f0 2023-07-14T13:08:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.491+0000 7f4921ffb640 1 -- 172.21.15.5:0/1848607544 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491c0a58a0 con 0x7f49240ce0f0 2023-07-14T13:08:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.491+0000 7f4921ffb640 1 -- 172.21.15.5:0/1848607544 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c0a5c30 con 0x7f49240ce0f0 2023-07-14T13:08:49.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.491+0000 7f492967b640 1 -- 172.21.15.5:0/1848607544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49240ce0f0 msgr2=0x7f49240ce550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:49.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.491+0000 7f492967b640 1 --2- 172.21.15.5:0/1848607544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49240ce0f0 0x7f49240ce550 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f49240d1190 tx=0x7f491c01c990 comp rx=0 tx=0).stop 2023-07-14T13:08:49.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.491+0000 7f492967b640 1 -- 172.21.15.5:0/1848607544 shutdown_connections 2023-07-14T13:08:49.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.491+0000 7f492967b640 1 --2- 172.21.15.5:0/1848607544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49240ce0f0 0x7f49240ce550 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.491+0000 7f492967b640 1 --2- 172.21.15.5:0/1848607544 >> v2:172.21.15.154:3300/0 conn(0x7f492406a540 0x7f492406a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.491+0000 7f492967b640 1 -- 172.21.15.5:0/1848607544 >> 172.21.15.5:0/1848607544 conn(0x7f49240659d0 msgr2=0x7f4924099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:49.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.491+0000 7f492967b640 1 -- 172.21.15.5:0/1848607544 shutdown_connections 2023-07-14T13:08:49.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.491+0000 7f492967b640 1 -- 172.21.15.5:0/1848607544 wait complete. 2023-07-14T13:08:49.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.491+0000 7f492967b640 1 Processor -- start 2023-07-14T13:08:49.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.495+0000 7f492967b640 1 -- start start 2023-07-14T13:08:49.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.495+0000 7f492967b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f492406a540 0x7f4924155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:49.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.495+0000 7f492967b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49240ce0f0 0x7f49241554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:49.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.495+0000 7f492967b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f492415f500 0x7f49240ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:49.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.495+0000 7f492967b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4924155a30 con 0x7f492406a540 2023-07-14T13:08:49.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.495+0000 7f492967b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49240c8ed0 con 0x7f492415f500 2023-07-14T13:08:49.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.495+0000 7f492967b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49240cb670 con 0x7f49240ce0f0 2023-07-14T13:08:49.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.495+0000 7f4922ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f492406a540 0x7f4924155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:49.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.495+0000 7f4922ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f492406a540 0x7f4924155bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44642/0 (socket says 172.21.15.5:44642) 2023-07-14T13:08:49.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.495+0000 7f4922ffd640 1 -- 172.21.15.5:0/2878134567 learned_addr learned my addr 172.21.15.5:0/2878134567 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:49.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.495+0000 7f49227fc640 1 --2- 172.21.15.5:0/2878134567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49240ce0f0 0x7f49241554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:49.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.495+0000 7f49237fe640 1 --2- 172.21.15.5:0/2878134567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f492415f500 0x7f49240ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:49.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.495+0000 7f4922ffd640 1 -- 172.21.15.5:0/2878134567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49240ce0f0 msgr2=0x7f49241554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:49.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.495+0000 7f4922ffd640 1 --2- 172.21.15.5:0/2878134567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49240ce0f0 0x7f49241554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.495+0000 7f4922ffd640 1 -- 172.21.15.5:0/2878134567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f492415f500 msgr2=0x7f49240ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:49.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.495+0000 7f4922ffd640 1 --2- 172.21.15.5:0/2878134567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f492415f500 0x7f49240ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.495+0000 7f4922ffd640 1 -- 172.21.15.5:0/2878134567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c009b30 con 0x7f492406a540 2023-07-14T13:08:49.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.495+0000 7f49227fc640 1 --2- 172.21.15.5:0/2878134567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49240ce0f0 0x7f49241554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:49.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.495+0000 7f49237fe640 1 --2- 172.21.15.5:0/2878134567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f492415f500 0x7f49240ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:49.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.495+0000 7f4922ffd640 1 --2- 172.21.15.5:0/2878134567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f492406a540 0x7f4924155bc0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f491400c430 tx=0x7f491400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:49.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.495+0000 7f490b7fe640 1 -- 172.21.15.5:0/2878134567 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4914011790 con 0x7f492406a540 2023-07-14T13:08:49.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.495+0000 7f490b7fe640 1 -- 172.21.15.5:0/2878134567 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49140118f0 con 0x7f492406a540 2023-07-14T13:08:49.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.495+0000 7f490b7fe640 1 -- 172.21.15.5:0/2878134567 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4914011ce0 con 0x7f492406a540 2023-07-14T13:08:49.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.495+0000 7f492967b640 1 -- 172.21.15.5:0/2878134567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49240c9120 con 0x7f492406a540 2023-07-14T13:08:49.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.495+0000 7f492967b640 1 -- 172.21.15.5:0/2878134567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49240c96e0 con 0x7f492406a540 2023-07-14T13:08:49.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.495+0000 7f492967b640 1 -- 172.21.15.5:0/2878134567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49240ae910 con 0x7f492406a540 2023-07-14T13:08:49.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.499+0000 7f490b7fe640 1 -- 172.21.15.5:0/2878134567 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4914012420 con 0x7f492406a540 2023-07-14T13:08:49.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.499+0000 7f490b7fe640 1 --2- 172.21.15.5:0/2878134567 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f49100663f0 0x7f49100688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:49.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.499+0000 7f490b7fe640 1 -- 172.21.15.5:0/2878134567 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f4914083c10 con 0x7f492406a540 2023-07-14T13:08:49.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.499+0000 7f49227fc640 1 --2- 172.21.15.5:0/2878134567 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f49100663f0 0x7f49100688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:49.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.499+0000 7f49227fc640 1 --2- 172.21.15.5:0/2878134567 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f49100663f0 0x7f49100688a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f492406e160 tx=0x7f4918008040 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:49.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.503+0000 7f490b7fe640 1 -- 172.21.15.5:0/2878134567 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4914050d80 con 0x7f492406a540 2023-07-14T13:08:49.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.687+0000 7f492967b640 1 -- 172.21.15.5:0/2878134567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f49240678d0 con 0x7f492406a540 2023-07-14T13:08:49.720 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-07-14T13:08:49.691+0000 7f17b1648640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-14T13:08:49.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.695+0000 7f490b7fe640 1 -- 172.21.15.5:0/2878134567 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) v1 ==== 161+0+0 (secure 0 0 0) 0x7f49140543a0 con 0x7f492406a540 2023-07-14T13:08:49.726 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-14T13:08:49.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.699+0000 7f492967b640 1 -- 172.21.15.5:0/2878134567 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f49100663f0 msgr2=0x7f49100688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:49.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.699+0000 7f492967b640 1 --2- 172.21.15.5:0/2878134567 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f49100663f0 0x7f49100688a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f492406e160 tx=0x7f4918008040 comp rx=0 tx=0).stop 2023-07-14T13:08:49.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.699+0000 7f492967b640 1 -- 172.21.15.5:0/2878134567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f492406a540 msgr2=0x7f4924155bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:49.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.699+0000 7f492967b640 1 --2- 172.21.15.5:0/2878134567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f492406a540 0x7f4924155bc0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f491400c430 tx=0x7f491400c8f0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.699+0000 7f492967b640 1 -- 172.21.15.5:0/2878134567 shutdown_connections 2023-07-14T13:08:49.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.699+0000 7f492967b640 1 --2- 172.21.15.5:0/2878134567 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f49100663f0 0x7f49100688a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.699+0000 7f492967b640 1 --2- 172.21.15.5:0/2878134567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f492415f500 0x7f49240ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.699+0000 7f492967b640 1 --2- 172.21.15.5:0/2878134567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49240ce0f0 0x7f49241554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.699+0000 7f492967b640 1 --2- 172.21.15.5:0/2878134567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f492406a540 0x7f4924155bc0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.699+0000 7f492967b640 1 -- 172.21.15.5:0/2878134567 >> 172.21.15.5:0/2878134567 conn(0x7f49240659d0 msgr2=0x7f492406cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:49.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.699+0000 7f492967b640 1 -- 172.21.15.5:0/2878134567 shutdown_connections 2023-07-14T13:08:49.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.699+0000 7f492967b640 1 -- 172.21.15.5:0/2878134567 wait complete. 2023-07-14T13:08:49.734 INFO:tasks.ceph.mds.a.smithi005.stderr: -3932> 2023-07-14T13:08:28.844+0000 7fa4ccde1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T13:08:49.749 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-14T13:08:49.785 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-07-14T13:08:49.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.867+0000 7fed86111640 1 Processor -- start 2023-07-14T13:08:49.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.867+0000 7fed86111640 1 -- start start 2023-07-14T13:08:49.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.867+0000 7fed86111640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed8006a540 0x7fed800cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:49.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.867+0000 7fed86111640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fed8006a910 0x7fed800d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:49.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.867+0000 7fed86111640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed800cd1f0 con 0x7fed801601f0 2023-07-14T13:08:49.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.867+0000 7fed86111640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed800cd4d0 con 0x7fed8006a910 2023-07-14T13:08:49.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.867+0000 7fed86111640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed800cd7b0 con 0x7fed8006a540 2023-07-14T13:08:49.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.867+0000 7fed7effd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fed801601f0 0x7fed800cca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57154/0 (socket says 172.21.15.5:57154) 2023-07-14T13:08:49.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.867+0000 7fed7effd640 1 -- 172.21.15.5:0/554319855 learned_addr learned my addr 172.21.15.5:0/554319855 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:49.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.867+0000 7fed7f7fe640 1 --2- 172.21.15.5:0/554319855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed8006a540 0x7fed800cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:49.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.867+0000 7fed7ffff640 1 --2- 172.21.15.5:0/554319855 >> v2:172.21.15.154:3300/0 conn(0x7fed8006a910 0x7fed800d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:49.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.867+0000 7fed7e7fc640 1 -- 172.21.15.5:0/554319855 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4290263665 0 0) 0x7fed800cd1f0 con 0x7fed801601f0 2023-07-14T13:08:49.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.867+0000 7fed7e7fc640 1 -- 172.21.15.5:0/554319855 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed68003530 con 0x7fed801601f0 2023-07-14T13:08:49.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.867+0000 7fed7f7fe640 1 -- 172.21.15.5:0/554319855 >> v2:172.21.15.154:3300/0 conn(0x7fed8006a910 msgr2=0x7fed800d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:49.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.867+0000 7fed7f7fe640 1 --2- 172.21.15.5:0/554319855 >> v2:172.21.15.154:3300/0 conn(0x7fed8006a910 0x7fed800d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.867+0000 7fed7f7fe640 1 -- 172.21.15.5:0/554319855 >> v1:172.21.15.5:6789/0 conn(0x7fed801601f0 legacy=0x7fed800cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:49.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.867+0000 7fed7f7fe640 1 -- 172.21.15.5:0/554319855 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed800cfe40 con 0x7fed8006a540 2023-07-14T13:08:49.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.871+0000 7fed7f7fe640 1 --2- 172.21.15.5:0/554319855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed8006a540 0x7fed800cdcd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fed700097a0 tx=0x7fed7001c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=623b7411d1962e90 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:49.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.871+0000 7fed7e7fc640 1 -- 172.21.15.5:0/554319855 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed700ab600 con 0x7fed8006a540 2023-07-14T13:08:49.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.871+0000 7fed7e7fc640 1 -- 172.21.15.5:0/554319855 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed700a7050 con 0x7fed8006a540 2023-07-14T13:08:49.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.871+0000 7fed7e7fc640 1 -- 172.21.15.5:0/554319855 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed700ab960 con 0x7fed8006a540 2023-07-14T13:08:49.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.871+0000 7fed86111640 1 -- 172.21.15.5:0/554319855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed8006a540 msgr2=0x7fed800cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:49.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.871+0000 7fed86111640 1 --2- 172.21.15.5:0/554319855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed8006a540 0x7fed800cdcd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fed700097a0 tx=0x7fed7001c3d0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.871+0000 7fed86111640 1 -- 172.21.15.5:0/554319855 shutdown_connections 2023-07-14T13:08:49.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.871+0000 7fed86111640 1 --2- 172.21.15.5:0/554319855 >> v2:172.21.15.154:3300/0 conn(0x7fed8006a910 0x7fed800d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.871+0000 7fed86111640 1 --2- 172.21.15.5:0/554319855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed8006a540 0x7fed800cdcd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.871+0000 7fed86111640 1 -- 172.21.15.5:0/554319855 >> 172.21.15.5:0/554319855 conn(0x7fed80099490 msgr2=0x7fed80089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:49.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.871+0000 7fed86111640 1 -- 172.21.15.5:0/554319855 shutdown_connections 2023-07-14T13:08:49.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.871+0000 7fed86111640 1 -- 172.21.15.5:0/554319855 wait complete. 2023-07-14T13:08:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.875+0000 7fed86111640 1 Processor -- start 2023-07-14T13:08:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.875+0000 7fed86111640 1 -- start start 2023-07-14T13:08:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.875+0000 7fed86111640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed8006a540 0x7fed800aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.875+0000 7fed86111640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed8006a910 0x7fed801589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.875+0000 7fed86111640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed801601f0 0x7fed800b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.875+0000 7fed86111640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed800aea80 con 0x7fed801601f0 2023-07-14T13:08:49.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.875+0000 7fed86111640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed800b4220 con 0x7fed8006a910 2023-07-14T13:08:49.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.875+0000 7fed86111640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed800b3610 con 0x7fed8006a540 2023-07-14T13:08:49.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.875+0000 7fed7ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed801601f0 0x7fed800b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:49.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.875+0000 7fed7ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed801601f0 0x7fed800b2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44662/0 (socket says 172.21.15.5:44662) 2023-07-14T13:08:49.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.875+0000 7fed7ffff640 1 -- 172.21.15.5:0/2319982164 learned_addr learned my addr 172.21.15.5:0/2319982164 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:49.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.875+0000 7fed7f7fe640 1 --2- 172.21.15.5:0/2319982164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed8006a540 0x7fed800aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:49.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.875+0000 7fed7effd640 1 --2- 172.21.15.5:0/2319982164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed8006a910 0x7fed801589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:49.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.875+0000 7fed7ffff640 1 -- 172.21.15.5:0/2319982164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed8006a540 msgr2=0x7fed800aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:49.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.875+0000 7fed7ffff640 1 --2- 172.21.15.5:0/2319982164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed8006a540 0x7fed800aefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.875+0000 7fed7ffff640 1 -- 172.21.15.5:0/2319982164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed8006a910 msgr2=0x7fed801589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:49.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.875+0000 7fed7ffff640 1 --2- 172.21.15.5:0/2319982164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed8006a910 0x7fed801589a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:49.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.875+0000 7fed7ffff640 1 -- 172.21.15.5:0/2319982164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed700093b0 con 0x7fed801601f0 2023-07-14T13:08:49.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.875+0000 7fed7ffff640 1 --2- 172.21.15.5:0/2319982164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed801601f0 0x7fed800b2f30 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fed7800efc0 tx=0x7fed7800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:49.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.875+0000 7fed67fff640 1 -- 172.21.15.5:0/2319982164 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed78014480 con 0x7fed801601f0 2023-07-14T13:08:49.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.875+0000 7fed67fff640 1 -- 172.21.15.5:0/2319982164 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7800f040 con 0x7fed801601f0 2023-07-14T13:08:49.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.875+0000 7fed67fff640 1 -- 172.21.15.5:0/2319982164 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed78014820 con 0x7fed801601f0 2023-07-14T13:08:49.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.875+0000 7fed86111640 1 -- 172.21.15.5:0/2319982164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed800b38f0 con 0x7fed801601f0 2023-07-14T13:08:49.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.879+0000 7fed86111640 1 -- 172.21.15.5:0/2319982164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed800b3eb0 con 0x7fed801601f0 2023-07-14T13:08:49.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.879+0000 7fed86111640 1 -- 172.21.15.5:0/2319982164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed800b43b0 con 0x7fed801601f0 2023-07-14T13:08:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.879+0000 7fed67fff640 1 -- 172.21.15.5:0/2319982164 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fed78014980 con 0x7fed801601f0 2023-07-14T13:08:49.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.879+0000 7fed67fff640 1 --2- 172.21.15.5:0/2319982164 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fed6c0663a0 0x7fed6c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.879+0000 7fed67fff640 1 -- 172.21.15.5:0/2319982164 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6879+0+0 (secure 0 0 0) 0x7fed78084ea0 con 0x7fed801601f0 2023-07-14T13:08:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.879+0000 7fed7f7fe640 1 --2- 172.21.15.5:0/2319982164 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fed6c0663a0 0x7fed6c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.883+0000 7fed7f7fe640 1 --2- 172.21.15.5:0/2319982164 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fed6c0663a0 0x7fed6c068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fed700ad000 tx=0x7fed700a6000 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:49.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:49.883+0000 7fed67fff640 1 -- 172.21.15.5:0/2319982164 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fed78051d30 con 0x7fed801601f0 2023-07-14T13:08:50.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.075+0000 7fed86111640 1 -- 172.21.15.5:0/2319982164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fed800678d0 con 0x7fed801601f0 2023-07-14T13:08:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.699+0000 7fed67fff640 1 -- 172.21.15.5:0/2319982164 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) v1 ==== 104+0+0 (secure 0 0 0) 0x7fed78055350 con 0x7fed801601f0 2023-07-14T13:08:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.703+0000 7fed86111640 1 -- 172.21.15.5:0/2319982164 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fed6c0663a0 msgr2=0x7fed6c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.703+0000 7fed86111640 1 --2- 172.21.15.5:0/2319982164 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fed6c0663a0 0x7fed6c068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fed700ad000 tx=0x7fed700a6000 comp rx=0 tx=0).stop 2023-07-14T13:08:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.703+0000 7fed86111640 1 -- 172.21.15.5:0/2319982164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed801601f0 msgr2=0x7fed800b2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.703+0000 7fed86111640 1 --2- 172.21.15.5:0/2319982164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed801601f0 0x7fed800b2f30 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fed7800efc0 tx=0x7fed7800c490 comp rx=0 tx=0).stop 2023-07-14T13:08:50.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.703+0000 7fed86111640 1 -- 172.21.15.5:0/2319982164 shutdown_connections 2023-07-14T13:08:50.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.703+0000 7fed86111640 1 --2- 172.21.15.5:0/2319982164 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fed6c0663a0 0x7fed6c068850 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.703+0000 7fed86111640 1 --2- 172.21.15.5:0/2319982164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed801601f0 0x7fed800b2f30 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.703+0000 7fed86111640 1 --2- 172.21.15.5:0/2319982164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed8006a910 0x7fed801589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.703+0000 7fed86111640 1 --2- 172.21.15.5:0/2319982164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed8006a540 0x7fed800aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.703+0000 7fed86111640 1 -- 172.21.15.5:0/2319982164 >> 172.21.15.5:0/2319982164 conn(0x7fed80099490 msgr2=0x7fed800afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:50.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.703+0000 7fed86111640 1 -- 172.21.15.5:0/2319982164 shutdown_connections 2023-07-14T13:08:50.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.703+0000 7fed86111640 1 -- 172.21.15.5:0/2319982164 wait complete. 2023-07-14T13:08:50.754 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-14T13:08:50.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.919+0000 7f905412c640 1 Processor -- start 2023-07-14T13:08:50.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.919+0000 7f905412c640 1 -- start start 2023-07-14T13:08:50.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.919+0000 7f905412c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f904c06a440 0x7f904c0b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:50.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.919+0000 7f905412c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904c06c040 con 0x7f904c1453a0 2023-07-14T13:08:50.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.919+0000 7f905412c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904c160600 con 0x7f904c15f690 2023-07-14T13:08:50.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.919+0000 7f905412c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904c160170 con 0x7f904c06a440 2023-07-14T13:08:50.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.919+0000 7f90526c9640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f904c1453a0 0x7f904c06c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57170/0 (socket says 172.21.15.5:57170) 2023-07-14T13:08:50.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.919+0000 7f90526c9640 1 -- 172.21.15.5:0/2169399159 learned_addr learned my addr 172.21.15.5:0/2169399159 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:50.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.919+0000 7f90516c7640 1 --2- 172.21.15.5:0/2169399159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f904c06a440 0x7f904c0b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:50.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.919+0000 7f9050ec6640 1 -- 172.21.15.5:0/2169399159 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023714871 0 0) 0x7f904c06c040 con 0x7f904c1453a0 2023-07-14T13:08:50.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.919+0000 7f9050ec6640 1 -- 172.21.15.5:0/2169399159 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9038003530 con 0x7f904c1453a0 2023-07-14T13:08:50.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.919+0000 7f90516c7640 1 -- 172.21.15.5:0/2169399159 >> v1:172.21.15.154:6789/0 conn(0x7f904c15f690 legacy=0x7f904c15fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:50.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.919+0000 7f9050ec6640 1 -- 172.21.15.5:0/2169399159 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504150322 0 0) 0x7f904c160600 con 0x7f904c15f690 2023-07-14T13:08:50.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.919+0000 7f90516c7640 1 -- 172.21.15.5:0/2169399159 >> v1:172.21.15.5:6789/0 conn(0x7f904c1453a0 legacy=0x7f904c06c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:50.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.919+0000 7f90516c7640 1 -- 172.21.15.5:0/2169399159 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904c160360 con 0x7f904c06a440 2023-07-14T13:08:50.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.923+0000 7f90516c7640 1 --2- 172.21.15.5:0/2169399159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f904c06a440 0x7f904c0b1890 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f903c0097f0 tx=0x7f903c01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b386a155c9960f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:50.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.923+0000 7f9050ec6640 1 -- 172.21.15.5:0/2169399159 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c0ac640 con 0x7f904c06a440 2023-07-14T13:08:50.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.923+0000 7f9050ec6640 1 -- 172.21.15.5:0/2169399159 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903c0ac7a0 con 0x7f904c06a440 2023-07-14T13:08:50.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.923+0000 7f9050ec6640 1 -- 172.21.15.5:0/2169399159 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c0acb30 con 0x7f904c06a440 2023-07-14T13:08:50.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.923+0000 7f905412c640 1 -- 172.21.15.5:0/2169399159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f904c06a440 msgr2=0x7f904c0b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:50.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.923+0000 7f905412c640 1 --2- 172.21.15.5:0/2169399159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f904c06a440 0x7f904c0b1890 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f903c0097f0 tx=0x7f903c01c400 comp rx=0 tx=0).stop 2023-07-14T13:08:50.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.923+0000 7f905412c640 1 -- 172.21.15.5:0/2169399159 shutdown_connections 2023-07-14T13:08:50.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.923+0000 7f905412c640 1 --2- 172.21.15.5:0/2169399159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f904c06a440 0x7f904c0b1890 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.923+0000 7f905412c640 1 -- 172.21.15.5:0/2169399159 >> 172.21.15.5:0/2169399159 conn(0x7f904c0b1210 msgr2=0x7f904c0ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:50.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.923+0000 7f905412c640 1 -- 172.21.15.5:0/2169399159 shutdown_connections 2023-07-14T13:08:50.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.923+0000 7f905412c640 1 -- 172.21.15.5:0/2169399159 wait complete. 2023-07-14T13:08:50.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.927+0000 7f905412c640 1 Processor -- start 2023-07-14T13:08:50.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.927+0000 7f905412c640 1 -- start start 2023-07-14T13:08:50.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.927+0000 7f905412c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f904c06a440 0x7f904c15e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:50.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.927+0000 7f905412c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f904c1453a0 0x7f904c15c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:50.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.927+0000 7f905412c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f904c15f690 0x7f904c15c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:50.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.927+0000 7f905412c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c0b2880 con 0x7f904c06a440 2023-07-14T13:08:50.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.927+0000 7f905412c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c0b2b60 con 0x7f904c1453a0 2023-07-14T13:08:50.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.927+0000 7f905412c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904c0b2e40 con 0x7f904c15f690 2023-07-14T13:08:50.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.927+0000 7f9051ec8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f904c06a440 0x7f904c15e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:50.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.927+0000 7f9051ec8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f904c06a440 0x7f904c15e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44668/0 (socket says 172.21.15.5:44668) 2023-07-14T13:08:50.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.927+0000 7f9051ec8640 1 -- 172.21.15.5:0/2135926908 learned_addr learned my addr 172.21.15.5:0/2135926908 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:50.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.927+0000 7f90526c9640 1 --2- 172.21.15.5:0/2135926908 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f904c15f690 0x7f904c15c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:50.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.927+0000 7f90516c7640 1 --2- 172.21.15.5:0/2135926908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f904c1453a0 0x7f904c15c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:50.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.927+0000 7f9051ec8640 1 -- 172.21.15.5:0/2135926908 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f904c15f690 msgr2=0x7f904c15c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:50.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.927+0000 7f9051ec8640 1 --2- 172.21.15.5:0/2135926908 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f904c15f690 0x7f904c15c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.927+0000 7f9051ec8640 1 -- 172.21.15.5:0/2135926908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f904c1453a0 msgr2=0x7f904c15c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:50.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.927+0000 7f9051ec8640 1 --2- 172.21.15.5:0/2135926908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f904c1453a0 0x7f904c15c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.927+0000 7f9051ec8640 1 -- 172.21.15.5:0/2135926908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903c009420 con 0x7f904c06a440 2023-07-14T13:08:50.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.927+0000 7f9051ec8640 1 --2- 172.21.15.5:0/2135926908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f904c06a440 0x7f904c15e920 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f904800c4d0 tx=0x7f904800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:50.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.927+0000 7f90427fc640 1 -- 172.21.15.5:0/2135926908 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9048005480 con 0x7f904c06a440 2023-07-14T13:08:50.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.927+0000 7f90427fc640 1 -- 172.21.15.5:0/2135926908 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9048003600 con 0x7f904c06a440 2023-07-14T13:08:50.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.927+0000 7f90427fc640 1 -- 172.21.15.5:0/2135926908 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90480039b0 con 0x7f904c06a440 2023-07-14T13:08:50.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.927+0000 7f905412c640 1 -- 172.21.15.5:0/2135926908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f904c0b3120 con 0x7f904c06a440 2023-07-14T13:08:50.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.927+0000 7f905412c640 1 -- 172.21.15.5:0/2135926908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f904c138a90 con 0x7f904c06a440 2023-07-14T13:08:50.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.927+0000 7f905412c640 1 -- 172.21.15.5:0/2135926908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f904c0678d0 con 0x7f904c06a440 2023-07-14T13:08:50.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.931+0000 7f90427fc640 1 -- 172.21.15.5:0/2135926908 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9048003b10 con 0x7f904c06a440 2023-07-14T13:08:50.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.931+0000 7f90427fc640 1 --2- 172.21.15.5:0/2135926908 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f90300663a0 0x7f9030068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.931+0000 7f90427fc640 1 -- 172.21.15.5:0/2135926908 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6879+0+0 (secure 0 0 0) 0x7f90480837f0 con 0x7f904c06a440 2023-07-14T13:08:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.931+0000 7f90516c7640 1 --2- 172.21.15.5:0/2135926908 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f90300663a0 0x7f9030068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:50.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.931+0000 7f90516c7640 1 --2- 172.21.15.5:0/2135926908 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f90300663a0 0x7f9030068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f903c0ae000 tx=0x7f903c0a6070 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:50.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:50.935+0000 7f90427fc640 1 -- 172.21.15.5:0/2135926908 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9048054370 con 0x7f904c06a440 2023-07-14T13:08:51.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.091+0000 7f905412c640 1 -- 172.21.15.5:0/2135926908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f904c0b3640 con 0x7f904c06a440 2023-07-14T13:08:51.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.707+0000 7f90427fc640 1 -- 172.21.15.5:0/2135926908 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v87) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9048053f00 con 0x7f904c06a440 2023-07-14T13:08:51.740 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-07-14T13:08:51.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.711+0000 7f905412c640 1 -- 172.21.15.5:0/2135926908 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f90300663a0 msgr2=0x7f9030068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:51.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.711+0000 7f905412c640 1 --2- 172.21.15.5:0/2135926908 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f90300663a0 0x7f9030068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f903c0ae000 tx=0x7f903c0a6070 comp rx=0 tx=0).stop 2023-07-14T13:08:51.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.711+0000 7f905412c640 1 -- 172.21.15.5:0/2135926908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f904c06a440 msgr2=0x7f904c15e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:51.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.711+0000 7f905412c640 1 --2- 172.21.15.5:0/2135926908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f904c06a440 0x7f904c15e920 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f904800c4d0 tx=0x7f904800c990 comp rx=0 tx=0).stop 2023-07-14T13:08:51.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.711+0000 7f905412c640 1 -- 172.21.15.5:0/2135926908 shutdown_connections 2023-07-14T13:08:51.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.711+0000 7f905412c640 1 --2- 172.21.15.5:0/2135926908 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f90300663a0 0x7f9030068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:51.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.711+0000 7f905412c640 1 --2- 172.21.15.5:0/2135926908 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f904c15f690 0x7f904c15c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:51.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.711+0000 7f905412c640 1 --2- 172.21.15.5:0/2135926908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f904c1453a0 0x7f904c15c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:51.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.711+0000 7f905412c640 1 --2- 172.21.15.5:0/2135926908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f904c06a440 0x7f904c15e920 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:51.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.711+0000 7f905412c640 1 -- 172.21.15.5:0/2135926908 >> 172.21.15.5:0/2135926908 conn(0x7f904c0b1210 msgr2=0x7f904c0ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:51.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.711+0000 7f905412c640 1 -- 172.21.15.5:0/2135926908 shutdown_connections 2023-07-14T13:08:51.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.711+0000 7f905412c640 1 -- 172.21.15.5:0/2135926908 wait complete. 2023-07-14T13:08:51.767 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-14T13:08:51.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.887+0000 7f2d3e00b640 1 Processor -- start 2023-07-14T13:08:51.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.887+0000 7f2d3e00b640 1 -- start start 2023-07-14T13:08:51.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.891+0000 7f2d3e00b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2d38069430 0x7f2d38069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:51.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.891+0000 7f2d3e00b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d38070f30 0x7f2d380ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:51.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.891+0000 7f2d3e00b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d38159d70 con 0x7f2d380af2b0 2023-07-14T13:08:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.891+0000 7f2d3e00b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d38069d40 con 0x7f2d38069430 2023-07-14T13:08:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.891+0000 7f2d3e00b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380c9c60 con 0x7f2d38070f30 2023-07-14T13:08:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.891+0000 7f2d377fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2d38069430 0x7f2d38069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.891+0000 7f2d377fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2d38069430 0x7f2d38069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44674/0 (socket says 172.21.15.5:44674) 2023-07-14T13:08:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.891+0000 7f2d377fe640 1 -- 172.21.15.5:0/3795285844 learned_addr learned my addr 172.21.15.5:0/3795285844 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.891+0000 7f2d37fff640 1 --1- 172.21.15.5:0/3795285844 >> v1:172.21.15.5:6789/0 conn(0x7f2d380af2b0 0x7f2d3815a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57176/0 (socket says 172.21.15.5:57176) 2023-07-14T13:08:51.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.891+0000 7f2d36ffd640 1 --2- 172.21.15.5:0/3795285844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d38070f30 0x7f2d380ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:51.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.891+0000 7f2d377fe640 1 -- 172.21.15.5:0/3795285844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d38070f30 msgr2=0x7f2d380ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:51.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.891+0000 7f2d377fe640 1 --2- 172.21.15.5:0/3795285844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d38070f30 0x7f2d380ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:51.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.891+0000 7f2d377fe640 1 -- 172.21.15.5:0/3795285844 >> v1:172.21.15.5:6789/0 conn(0x7f2d380af2b0 legacy=0x7f2d3815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:51.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.891+0000 7f2d367fc640 1 -- 172.21.15.5:0/3795285844 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2781104359 0 0) 0x7f2d300014a0 con 0x7f2d380af2b0 2023-07-14T13:08:51.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.891+0000 7f2d377fe640 1 -- 172.21.15.5:0/3795285844 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d380c9f40 con 0x7f2d38069430 2023-07-14T13:08:51.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.891+0000 7f2d36ffd640 1 --2- 172.21.15.5:0/3795285844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d38070f30 0x7f2d380ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:08:51.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.895+0000 7f2d377fe640 1 --2- 172.21.15.5:0/3795285844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d38069430 0x7f2d38069800 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f2d28009870 tx=0x7f2d2801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a558fb0bd4322a9e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:51.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.895+0000 7f2d367fc640 1 -- 172.21.15.5:0/3795285844 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d280ab650 con 0x7f2d38069430 2023-07-14T13:08:51.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.895+0000 7f2d367fc640 1 -- 172.21.15.5:0/3795285844 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d280ab7b0 con 0x7f2d38069430 2023-07-14T13:08:51.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.895+0000 7f2d367fc640 1 -- 172.21.15.5:0/3795285844 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d280abb40 con 0x7f2d38069430 2023-07-14T13:08:51.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.895+0000 7f2d3e00b640 1 -- 172.21.15.5:0/3795285844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d38069430 msgr2=0x7f2d38069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:51.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.895+0000 7f2d3e00b640 1 --2- 172.21.15.5:0/3795285844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d38069430 0x7f2d38069800 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f2d28009870 tx=0x7f2d2801c540 comp rx=0 tx=0).stop 2023-07-14T13:08:51.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.895+0000 7f2d3e00b640 1 -- 172.21.15.5:0/3795285844 shutdown_connections 2023-07-14T13:08:51.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.895+0000 7f2d3e00b640 1 --2- 172.21.15.5:0/3795285844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d38070f30 0x7f2d380ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:51.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.895+0000 7f2d3e00b640 1 --2- 172.21.15.5:0/3795285844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d38069430 0x7f2d38069800 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:51.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.895+0000 7f2d3e00b640 1 -- 172.21.15.5:0/3795285844 >> 172.21.15.5:0/3795285844 conn(0x7f2d380cde90 msgr2=0x7f2d380ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:51.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.895+0000 7f2d3e00b640 1 -- 172.21.15.5:0/3795285844 shutdown_connections 2023-07-14T13:08:51.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.895+0000 7f2d3e00b640 1 -- 172.21.15.5:0/3795285844 wait complete. 2023-07-14T13:08:51.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.895+0000 7f2d3e00b640 1 Processor -- start 2023-07-14T13:08:51.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.899+0000 7f2d3e00b640 1 -- start start 2023-07-14T13:08:51.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.899+0000 7f2d3e00b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d38069430 0x7f2d380b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:51.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.899+0000 7f2d3e00b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d38070f30 0x7f2d380c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:51.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.899+0000 7f2d3e00b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d380af2b0 0x7f2d380b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:51.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.899+0000 7f2d3e00b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380b18b0 con 0x7f2d38069430 2023-07-14T13:08:51.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.899+0000 7f2d3e00b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380b2520 con 0x7f2d380af2b0 2023-07-14T13:08:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.899+0000 7f2d3e00b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380c5000 con 0x7f2d38070f30 2023-07-14T13:08:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.899+0000 7f2d377fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d38069430 0x7f2d380b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.899+0000 7f2d377fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d38069430 0x7f2d380b1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44678/0 (socket says 172.21.15.5:44678) 2023-07-14T13:08:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.899+0000 7f2d377fe640 1 -- 172.21.15.5:0/3053325306 learned_addr learned my addr 172.21.15.5:0/3053325306 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.899+0000 7f2d36ffd640 1 --2- 172.21.15.5:0/3053325306 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d38070f30 0x7f2d380c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.899+0000 7f2d37fff640 1 --2- 172.21.15.5:0/3053325306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d380af2b0 0x7f2d380b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.899+0000 7f2d377fe640 1 -- 172.21.15.5:0/3053325306 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d38070f30 msgr2=0x7f2d380c5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:51.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.899+0000 7f2d377fe640 1 --2- 172.21.15.5:0/3053325306 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d38070f30 0x7f2d380c5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:51.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.899+0000 7f2d377fe640 1 -- 172.21.15.5:0/3053325306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d380af2b0 msgr2=0x7f2d380b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:51.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.899+0000 7f2d377fe640 1 --2- 172.21.15.5:0/3053325306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d380af2b0 0x7f2d380b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:51.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.899+0000 7f2d377fe640 1 -- 172.21.15.5:0/3053325306 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d280094d0 con 0x7f2d38069430 2023-07-14T13:08:51.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.899+0000 7f2d37fff640 1 --2- 172.21.15.5:0/3053325306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d380af2b0 0x7f2d380b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:08:51.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.899+0000 7f2d377fe640 1 --2- 172.21.15.5:0/3053325306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d38069430 0x7f2d380b1370 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f2d280ad040 tx=0x7f2d2801ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:51.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.899+0000 7f2d1ffff640 1 -- 172.21.15.5:0/3053325306 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d280b4800 con 0x7f2d38069430 2023-07-14T13:08:51.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.899+0000 7f2d1ffff640 1 -- 172.21.15.5:0/3053325306 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d280b4980 con 0x7f2d38069430 2023-07-14T13:08:51.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.899+0000 7f2d1ffff640 1 -- 172.21.15.5:0/3053325306 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d280b4d30 con 0x7f2d38069430 2023-07-14T13:08:51.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.899+0000 7f2d3e00b640 1 -- 172.21.15.5:0/3053325306 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d380c52e0 con 0x7f2d38069430 2023-07-14T13:08:51.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.899+0000 7f2d3e00b640 1 -- 172.21.15.5:0/3053325306 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d380b2800 con 0x7f2d38069430 2023-07-14T13:08:51.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.899+0000 7f2d3e00b640 1 -- 172.21.15.5:0/3053325306 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d380678d0 con 0x7f2d38069430 2023-07-14T13:08:51.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.903+0000 7f2d1ffff640 1 -- 172.21.15.5:0/3053325306 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2d280b3380 con 0x7f2d38069430 2023-07-14T13:08:51.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.903+0000 7f2d1ffff640 1 --2- 172.21.15.5:0/3053325306 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2d240663a0 0x7f2d24068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:51.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.903+0000 7f2d1ffff640 1 -- 172.21.15.5:0/3053325306 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6441+0+0 (secure 0 0 0) 0x7f2d2811e7e0 con 0x7f2d38069430 2023-07-14T13:08:51.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.903+0000 7f2d36ffd640 1 --2- 172.21.15.5:0/3053325306 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2d240663a0 0x7f2d24068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:51.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.903+0000 7f2d36ffd640 1 --2- 172.21.15.5:0/3053325306 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2d240663a0 0x7f2d24068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2d380c6d50 tx=0x7f2d2c008040 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:51.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:51.907+0000 7f2d1ffff640 1 -- 172.21.15.5:0/3053325306 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2d280ebb00 con 0x7f2d38069430 2023-07-14T13:08:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.059+0000 7f2d3e00b640 1 -- 172.21.15.5:0/3053325306 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2d380c82c0 con 0x7f2d38069430 2023-07-14T13:08:52.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.719+0000 7f2d1ffff640 1 -- 172.21.15.5:0/3053325306 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v88) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2d280ef120 con 0x7f2d38069430 2023-07-14T13:08:52.748 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-07-14T13:08:52.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.719+0000 7f2d3e00b640 1 -- 172.21.15.5:0/3053325306 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2d240663a0 msgr2=0x7f2d24068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:52.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.719+0000 7f2d3e00b640 1 --2- 172.21.15.5:0/3053325306 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2d240663a0 0x7f2d24068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2d380c6d50 tx=0x7f2d2c008040 comp rx=0 tx=0).stop 2023-07-14T13:08:52.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.719+0000 7f2d3e00b640 1 -- 172.21.15.5:0/3053325306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d38069430 msgr2=0x7f2d380b1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:52.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.719+0000 7f2d3e00b640 1 --2- 172.21.15.5:0/3053325306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d38069430 0x7f2d380b1370 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f2d280ad040 tx=0x7f2d2801ad80 comp rx=0 tx=0).stop 2023-07-14T13:08:52.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.719+0000 7f2d3e00b640 1 -- 172.21.15.5:0/3053325306 shutdown_connections 2023-07-14T13:08:52.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.723+0000 7f2d3e00b640 1 --2- 172.21.15.5:0/3053325306 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2d240663a0 0x7f2d24068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:52.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.723+0000 7f2d3e00b640 1 --2- 172.21.15.5:0/3053325306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d380af2b0 0x7f2d380b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:52.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.723+0000 7f2d3e00b640 1 --2- 172.21.15.5:0/3053325306 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2d38070f30 0x7f2d380c5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:52.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.723+0000 7f2d3e00b640 1 --2- 172.21.15.5:0/3053325306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d38069430 0x7f2d380b1370 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:52.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.723+0000 7f2d3e00b640 1 -- 172.21.15.5:0/3053325306 >> 172.21.15.5:0/3053325306 conn(0x7f2d380cde90 msgr2=0x7f2d38153d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:52.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.723+0000 7f2d3e00b640 1 -- 172.21.15.5:0/3053325306 shutdown_connections 2023-07-14T13:08:52.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.723+0000 7f2d3e00b640 1 -- 172.21.15.5:0/3053325306 wait complete. 2023-07-14T13:08:52.777 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-14T13:08:52.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.895+0000 7f9851d67640 1 Processor -- start 2023-07-14T13:08:52.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.895+0000 7f9851d67640 1 -- start start 2023-07-14T13:08:52.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f9851d67640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f984c15bd50 0x7f984c069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:52.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f9851d67640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f984c069970 con 0x7f984c06cc80 2023-07-14T13:08:52.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f9851d67640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f984c15fa90 con 0x7f984c06fcf0 2023-07-14T13:08:52.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f9851d67640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984c15fd70 con 0x7f984c15bd50 2023-07-14T13:08:52.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f984c06cc80 0x7f984c06d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57182/0 (socket says 172.21.15.5:57182) 2023-07-14T13:08:52.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984b7fe640 1 -- 172.21.15.5:0/428671174 learned_addr learned my addr 172.21.15.5:0/428671174 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:52.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984affd640 1 --2- 172.21.15.5:0/428671174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f984c15bd50 0x7f984c069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:52.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984a7fc640 1 -- 172.21.15.5:0/428671174 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4060183879 0 0) 0x7f984c069970 con 0x7f984c06cc80 2023-07-14T13:08:52.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984a7fc640 1 -- 172.21.15.5:0/428671174 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9834003530 con 0x7f984c06cc80 2023-07-14T13:08:52.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984a7fc640 1 -- 172.21.15.5:0/428671174 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1958859527 0 0) 0x7f984c15fa90 con 0x7f984c06fcf0 2023-07-14T13:08:52.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984a7fc640 1 -- 172.21.15.5:0/428671174 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f984c069970 con 0x7f984c06fcf0 2023-07-14T13:08:52.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984a7fc640 1 -- 172.21.15.5:0/428671174 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1741182318 0 0) 0x7f9834003530 con 0x7f984c06cc80 2023-07-14T13:08:52.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984a7fc640 1 -- 172.21.15.5:0/428671174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f984c15bd50 msgr2=0x7f984c069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:52.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984a7fc640 1 --2- 172.21.15.5:0/428671174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f984c15bd50 0x7f984c069430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:52.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984a7fc640 1 -- 172.21.15.5:0/428671174 >> v1:172.21.15.154:6789/0 conn(0x7f984c06fcf0 legacy=0x7f984c15c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:52.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984a7fc640 1 -- 172.21.15.5:0/428671174 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984c160050 con 0x7f984c06cc80 2023-07-14T13:08:52.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984a7fc640 1 -- 172.21.15.5:0/428671174 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f983c001680 con 0x7f984c06cc80 2023-07-14T13:08:52.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984a7fc640 1 -- 172.21.15.5:0/428671174 >> v1:172.21.15.5:6789/0 conn(0x7f984c06cc80 legacy=0x7f984c06d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:52.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984a7fc640 1 --2- 172.21.15.5:0/428671174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9834003b40 0x7f9834003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:52.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984a7fc640 1 --2- 172.21.15.5:0/428671174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98340047d0 0x7f9834004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:52.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984a7fc640 1 --2- 172.21.15.5:0/428671174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9834005180 0x7f983400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:52.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984a7fc640 1 -- 172.21.15.5:0/428671174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c15fd70 con 0x7f9834003b40 2023-07-14T13:08:52.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984a7fc640 1 -- 172.21.15.5:0/428671174 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983400bf50 con 0x7f98340047d0 2023-07-14T13:08:52.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984a7fc640 1 -- 172.21.15.5:0/428671174 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983400c110 con 0x7f9834005180 2023-07-14T13:08:52.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984affd640 1 --2- 172.21.15.5:0/428671174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f984c15bd50 0x7f984c069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:52.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984b7fe640 1 --2- 172.21.15.5:0/428671174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9834003b40 0x7f9834003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:52.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984bfff640 1 --2- 172.21.15.5:0/428671174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9834005180 0x7f983400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:52.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984affd640 1 --2- 172.21.15.5:0/428671174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98340047d0 0x7f9834004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:52.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984b7fe640 1 -- 172.21.15.5:0/428671174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9834005180 msgr2=0x7f983400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:52.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984b7fe640 1 --2- 172.21.15.5:0/428671174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9834005180 0x7f983400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:52.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984b7fe640 1 -- 172.21.15.5:0/428671174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98340047d0 msgr2=0x7f9834004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:52.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984b7fe640 1 --2- 172.21.15.5:0/428671174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98340047d0 0x7f9834004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:52.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.899+0000 7f984b7fe640 1 -- 172.21.15.5:0/428671174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9834003530 con 0x7f9834003b40 2023-07-14T13:08:52.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.903+0000 7f984b7fe640 1 --2- 172.21.15.5:0/428671174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9834003b40 0x7f9834003f30 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f983c00c160 tx=0x7f983c01cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=182427077a6c7915 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:52.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.903+0000 7f984a7fc640 1 -- 172.21.15.5:0/428671174 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983c0058e0 con 0x7f9834003b40 2023-07-14T13:08:52.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.903+0000 7f984a7fc640 1 -- 172.21.15.5:0/428671174 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983c005a60 con 0x7f9834003b40 2023-07-14T13:08:52.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.903+0000 7f984a7fc640 1 -- 172.21.15.5:0/428671174 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983c005e10 con 0x7f9834003b40 2023-07-14T13:08:52.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.903+0000 7f9851d67640 1 -- 172.21.15.5:0/428671174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9834003b40 msgr2=0x7f9834003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:52.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.903+0000 7f9851d67640 1 --2- 172.21.15.5:0/428671174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9834003b40 0x7f9834003f30 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f983c00c160 tx=0x7f983c01cad0 comp rx=0 tx=0).stop 2023-07-14T13:08:52.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.903+0000 7f984bfff640 1 -- 172.21.15.5:0/428671174 reap_dead start 2023-07-14T13:08:52.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.903+0000 7f9851d67640 1 -- 172.21.15.5:0/428671174 shutdown_connections 2023-07-14T13:08:52.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.903+0000 7f9851d67640 1 -- 172.21.15.5:0/428671174 >> 172.21.15.5:0/428671174 conn(0x7f984c0b0490 msgr2=0x7f984c0b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:52.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.903+0000 7f9851d67640 1 -- 172.21.15.5:0/428671174 shutdown_connections 2023-07-14T13:08:52.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.903+0000 7f9851d67640 1 -- 172.21.15.5:0/428671174 wait complete. 2023-07-14T13:08:52.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.903+0000 7f9851d67640 1 Processor -- start 2023-07-14T13:08:52.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.903+0000 7f9851d67640 1 -- start start 2023-07-14T13:08:52.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.907+0000 7f9851d67640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9834003b40 0x7f984c0b3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:52.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.907+0000 7f9851d67640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f984c0ca760 0x7f984c0c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.907+0000 7f9851d67640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f984c143290 0x7f984c1606a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.907+0000 7f9851d67640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c0ca050 con 0x7f984c0ca760 2023-07-14T13:08:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.907+0000 7f9851d67640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c0c8180 con 0x7f9834003b40 2023-07-14T13:08:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.907+0000 7f9851d67640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984c15e980 con 0x7f984c143290 2023-07-14T13:08:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.907+0000 7f984affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f984c0ca760 0x7f984c0c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.907+0000 7f984affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f984c0ca760 0x7f984c0c7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44688/0 (socket says 172.21.15.5:44688) 2023-07-14T13:08:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.907+0000 7f984affd640 1 -- 172.21.15.5:0/26545526 learned_addr learned my addr 172.21.15.5:0/26545526 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.907+0000 7f984bfff640 1 --2- 172.21.15.5:0/26545526 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f984c143290 0x7f984c1606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.907+0000 7f984b7fe640 1 --2- 172.21.15.5:0/26545526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9834003b40 0x7f984c0b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.907+0000 7f984affd640 1 -- 172.21.15.5:0/26545526 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f984c143290 msgr2=0x7f984c1606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.907+0000 7f984affd640 1 --2- 172.21.15.5:0/26545526 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f984c143290 0x7f984c1606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.907+0000 7f984affd640 1 -- 172.21.15.5:0/26545526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9834003b40 msgr2=0x7f984c0b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.907+0000 7f984affd640 1 --2- 172.21.15.5:0/26545526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9834003b40 0x7f984c0b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.907+0000 7f984affd640 1 -- 172.21.15.5:0/26545526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984c158390 con 0x7f984c0ca760 2023-07-14T13:08:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.907+0000 7f984bfff640 1 --2- 172.21.15.5:0/26545526 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f984c143290 0x7f984c1606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:08:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.907+0000 7f984b7fe640 1 --2- 172.21.15.5:0/26545526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9834003b40 0x7f984c0b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:08:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.907+0000 7f984affd640 1 --2- 172.21.15.5:0/26545526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f984c0ca760 0x7f984c0c7b10 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f9840011830 tx=0x7f9840011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.907+0000 7f9833fff640 1 -- 172.21.15.5:0/26545526 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9840015870 con 0x7f984c0ca760 2023-07-14T13:08:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.907+0000 7f9833fff640 1 -- 172.21.15.5:0/26545526 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98400159d0 con 0x7f984c0ca760 2023-07-14T13:08:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.907+0000 7f9833fff640 1 -- 172.21.15.5:0/26545526 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9840015d80 con 0x7f984c0ca760 2023-07-14T13:08:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.907+0000 7f9851d67640 1 -- 172.21.15.5:0/26545526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f984c15ebd0 con 0x7f984c0ca760 2023-07-14T13:08:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.907+0000 7f9851d67640 1 -- 172.21.15.5:0/26545526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984c0ca240 con 0x7f984c0ca760 2023-07-14T13:08:52.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.907+0000 7f9851d67640 1 -- 172.21.15.5:0/26545526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f984c15f0f0 con 0x7f984c0ca760 2023-07-14T13:08:52.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.911+0000 7f9833fff640 1 -- 172.21.15.5:0/26545526 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f98400059a0 con 0x7f984c0ca760 2023-07-14T13:08:52.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.911+0000 7f9833fff640 1 --2- 172.21.15.5:0/26545526 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f98380663d0 0x7f9838068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:52.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.911+0000 7f9833fff640 1 -- 172.21.15.5:0/26545526 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6027+0+0 (secure 0 0 0) 0x7f9840083d80 con 0x7f984c0ca760 2023-07-14T13:08:52.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.911+0000 7f984b7fe640 1 --2- 172.21.15.5:0/26545526 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f98380663d0 0x7f9838068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:52.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.911+0000 7f984b7fe640 1 --2- 172.21.15.5:0/26545526 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f98380663d0 0x7f9838068880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f983c0aa000 tx=0x7f983c001a00 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:52.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:52.915+0000 7f9833fff640 1 -- 172.21.15.5:0/26545526 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9840051100 con 0x7f984c0ca760 2023-07-14T13:08:53.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.079+0000 7f9851d67640 1 -- 172.21.15.5:0/26545526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f984c0678d0 con 0x7f984c0ca760 2023-07-14T13:08:53.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.087+0000 7f9833fff640 1 -- 172.21.15.5:0/26545526 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v25) v1 ==== 120+0+0 (secure 0 0 0) 0x7f9840054720 con 0x7f984c0ca760 2023-07-14T13:08:53.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.087+0000 7f9851d67640 1 -- 172.21.15.5:0/26545526 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f98380663d0 msgr2=0x7f9838068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:53.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.087+0000 7f9851d67640 1 --2- 172.21.15.5:0/26545526 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f98380663d0 0x7f9838068880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f983c0aa000 tx=0x7f983c001a00 comp rx=0 tx=0).stop 2023-07-14T13:08:53.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.087+0000 7f9851d67640 1 -- 172.21.15.5:0/26545526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f984c0ca760 msgr2=0x7f984c0c7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:53.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.087+0000 7f9851d67640 1 --2- 172.21.15.5:0/26545526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f984c0ca760 0x7f984c0c7b10 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f9840011830 tx=0x7f9840011920 comp rx=0 tx=0).stop 2023-07-14T13:08:53.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.087+0000 7f9851d67640 1 -- 172.21.15.5:0/26545526 shutdown_connections 2023-07-14T13:08:53.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.087+0000 7f9851d67640 1 --2- 172.21.15.5:0/26545526 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f98380663d0 0x7f9838068880 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:53.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.087+0000 7f9851d67640 1 --2- 172.21.15.5:0/26545526 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f984c143290 0x7f984c1606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:53.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.087+0000 7f9851d67640 1 --2- 172.21.15.5:0/26545526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f984c0ca760 0x7f984c0c7b10 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:53.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.087+0000 7f9851d67640 1 --2- 172.21.15.5:0/26545526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9834003b40 0x7f984c0b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:53.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.087+0000 7f9851d67640 1 -- 172.21.15.5:0/26545526 >> 172.21.15.5:0/26545526 conn(0x7f984c0b0490 msgr2=0x7f984c158cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:53.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.087+0000 7f9851d67640 1 -- 172.21.15.5:0/26545526 shutdown_connections 2023-07-14T13:08:53.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.087+0000 7f9851d67640 1 -- 172.21.15.5:0/26545526 wait complete. 2023-07-14T13:08:53.138 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-14T13:08:53.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.255+0000 7f0614834640 1 Processor -- start 2023-07-14T13:08:53.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.255+0000 7f0614834640 1 -- start start 2023-07-14T13:08:53.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.255+0000 7f0614834640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06100cd670 0x7f06100cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:53.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.255+0000 7f0614834640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0610158df0 0x7f0610159290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:53.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.255+0000 7f0614834640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06100b08d0 con 0x7f0610156560 2023-07-14T13:08:53.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.255+0000 7f0614834640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06101597d0 con 0x7f06100cd670 2023-07-14T13:08:53.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.255+0000 7f0614834640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0610159cb0 con 0x7f0610158df0 2023-07-14T13:08:53.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.255+0000 7f0607fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06100cd670 0x7f06100cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:53.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.255+0000 7f0607fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06100cd670 0x7f06100cb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44692/0 (socket says 172.21.15.5:44692) 2023-07-14T13:08:53.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.255+0000 7f0607fff640 1 -- 172.21.15.5:0/1477796321 learned_addr learned my addr 172.21.15.5:0/1477796321 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:53.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.255+0000 7f060ed9d640 1 --2- 172.21.15.5:0/1477796321 >> v2:172.21.15.154:3300/0 conn(0x7f0610158df0 0x7f0610159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:53.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.255+0000 7f0607fff640 1 -- 172.21.15.5:0/1477796321 >> v2:172.21.15.154:3300/0 conn(0x7f0610158df0 msgr2=0x7f0610159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:53.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.255+0000 7f0607fff640 1 --2- 172.21.15.5:0/1477796321 >> v2:172.21.15.154:3300/0 conn(0x7f0610158df0 0x7f0610159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:53.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.255+0000 7f0607fff640 1 -- 172.21.15.5:0/1477796321 >> v1:172.21.15.154:6789/0 conn(0x7f0610156560 legacy=0x7f06100ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:53.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.255+0000 7f0607fff640 1 -- 172.21.15.5:0/1477796321 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06101599d0 con 0x7f06100cd670 2023-07-14T13:08:53.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.255+0000 7f060ed9d640 1 --2- 172.21.15.5:0/1477796321 >> v2:172.21.15.154:3300/0 conn(0x7f0610158df0 0x7f0610159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:53.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.259+0000 7f0607fff640 1 --2- 172.21.15.5:0/1477796321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06100cd670 0x7f06100cb3e0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f06100c86e0 tx=0x7f05f801e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dcde2f1b8a632a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:53.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.259+0000 7f060dd9b640 1 -- 172.21.15.5:0/1477796321 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f80a86d0 con 0x7f06100cd670 2023-07-14T13:08:53.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.259+0000 7f060dd9b640 1 -- 172.21.15.5:0/1477796321 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f80a8830 con 0x7f06100cd670 2023-07-14T13:08:53.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.259+0000 7f060dd9b640 1 -- 172.21.15.5:0/1477796321 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f80a8bc0 con 0x7f06100cd670 2023-07-14T13:08:53.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.259+0000 7f0614834640 1 -- 172.21.15.5:0/1477796321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06100cd670 msgr2=0x7f06100cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:53.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.259+0000 7f0614834640 1 --2- 172.21.15.5:0/1477796321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06100cd670 0x7f06100cb3e0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f06100c86e0 tx=0x7f05f801e6e0 comp rx=0 tx=0).stop 2023-07-14T13:08:53.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.259+0000 7f0614834640 1 -- 172.21.15.5:0/1477796321 shutdown_connections 2023-07-14T13:08:53.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.259+0000 7f0614834640 1 --2- 172.21.15.5:0/1477796321 >> v2:172.21.15.154:3300/0 conn(0x7f0610158df0 0x7f0610159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:53.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.259+0000 7f0614834640 1 --2- 172.21.15.5:0/1477796321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06100cd670 0x7f06100cb3e0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:53.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.259+0000 7f0614834640 1 -- 172.21.15.5:0/1477796321 >> 172.21.15.5:0/1477796321 conn(0x7f06100afac0 msgr2=0x7f06100afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:53.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.259+0000 7f0614834640 1 -- 172.21.15.5:0/1477796321 shutdown_connections 2023-07-14T13:08:53.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.259+0000 7f0614834640 1 -- 172.21.15.5:0/1477796321 wait complete. 2023-07-14T13:08:53.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.263+0000 7f0614834640 1 Processor -- start 2023-07-14T13:08:53.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.263+0000 7f0614834640 1 -- start start 2023-07-14T13:08:53.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.263+0000 7f0614834640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06100cd670 0x7f0610151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:53.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.263+0000 7f0614834640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0610156560 0x7f061006fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:53.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.263+0000 7f0614834640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0610158df0 0x7f0610070370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:53.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.263+0000 7f0614834640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06100b1850 con 0x7f0610156560 2023-07-14T13:08:53.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.263+0000 7f0614834640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06100b3710 con 0x7f06100cd670 2023-07-14T13:08:53.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.263+0000 7f0614834640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06100b2520 con 0x7f0610158df0 2023-07-14T13:08:53.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.263+0000 7f0607fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0610156560 0x7f061006fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:53.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.263+0000 7f0607fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0610156560 0x7f061006fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44702/0 (socket says 172.21.15.5:44702) 2023-07-14T13:08:53.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.263+0000 7f0607fff640 1 -- 172.21.15.5:0/4249016500 learned_addr learned my addr 172.21.15.5:0/4249016500 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:53.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.263+0000 7f060e59c640 1 --2- 172.21.15.5:0/4249016500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06100cd670 0x7f0610151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:53.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.263+0000 7f060ed9d640 1 --2- 172.21.15.5:0/4249016500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0610158df0 0x7f0610070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.263+0000 7f0607fff640 1 -- 172.21.15.5:0/4249016500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0610158df0 msgr2=0x7f0610070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.263+0000 7f0607fff640 1 --2- 172.21.15.5:0/4249016500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0610158df0 0x7f0610070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.263+0000 7f0607fff640 1 -- 172.21.15.5:0/4249016500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06100cd670 msgr2=0x7f0610151270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.263+0000 7f0607fff640 1 --2- 172.21.15.5:0/4249016500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06100cd670 0x7f0610151270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.263+0000 7f0607fff640 1 -- 172.21.15.5:0/4249016500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f80094d0 con 0x7f0610156560 2023-07-14T13:08:53.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.263+0000 7f060e59c640 1 --2- 172.21.15.5:0/4249016500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06100cd670 0x7f0610151270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:53.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.263+0000 7f060ed9d640 1 --2- 172.21.15.5:0/4249016500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0610158df0 0x7f0610070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:53.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.263+0000 7f0607fff640 1 --2- 172.21.15.5:0/4249016500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0610156560 0x7f061006fe30 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f05f801b2f0 tx=0x7f05f801cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:53.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.263+0000 7f0606ffd640 1 -- 172.21.15.5:0/4249016500 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f80b0830 con 0x7f0610156560 2023-07-14T13:08:53.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.263+0000 7f0606ffd640 1 -- 172.21.15.5:0/4249016500 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f80b0990 con 0x7f0610156560 2023-07-14T13:08:53.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.263+0000 7f0614834640 1 -- 172.21.15.5:0/4249016500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06100b0f40 con 0x7f0610156560 2023-07-14T13:08:53.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.263+0000 7f0606ffd640 1 -- 172.21.15.5:0/4249016500 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f80b0d20 con 0x7f0610156560 2023-07-14T13:08:53.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.263+0000 7f0614834640 1 -- 172.21.15.5:0/4249016500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06100b14e0 con 0x7f0610156560 2023-07-14T13:08:53.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.267+0000 7f0614834640 1 -- 172.21.15.5:0/4249016500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06100c4ef0 con 0x7f0610156560 2023-07-14T13:08:53.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.267+0000 7f0606ffd640 1 -- 172.21.15.5:0/4249016500 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f05f80c4460 con 0x7f0610156560 2023-07-14T13:08:53.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.267+0000 7f0606ffd640 1 --2- 172.21.15.5:0/4249016500 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f05f00663a0 0x7f05f0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:53.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.267+0000 7f0606ffd640 1 -- 172.21.15.5:0/4249016500 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6027+0+0 (secure 0 0 0) 0x7f05f80ac070 con 0x7f0610156560 2023-07-14T13:08:53.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.267+0000 7f060e59c640 1 --2- 172.21.15.5:0/4249016500 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f05f00663a0 0x7f05f0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:53.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.267+0000 7f060e59c640 1 --2- 172.21.15.5:0/4249016500 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f05f00663a0 0x7f05f0068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0600000f70 tx=0x7f0600009040 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:53.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.271+0000 7f0606ffd640 1 -- 172.21.15.5:0/4249016500 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f05f80ec640 con 0x7f0610156560 2023-07-14T13:08:53.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.431+0000 7f0614834640 1 -- 172.21.15.5:0/4249016500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f06100678d0 con 0x7f0610156560 2023-07-14T13:08:53.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.439+0000 7f0606ffd640 1 -- 172.21.15.5:0/4249016500 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7f05f80efc60 con 0x7f0610156560 2023-07-14T13:08:53.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.439+0000 7f0614834640 1 -- 172.21.15.5:0/4249016500 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f05f00663a0 msgr2=0x7f05f0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:53.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.439+0000 7f0614834640 1 --2- 172.21.15.5:0/4249016500 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f05f00663a0 0x7f05f0068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0600000f70 tx=0x7f0600009040 comp rx=0 tx=0).stop 2023-07-14T13:08:53.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.439+0000 7f0614834640 1 -- 172.21.15.5:0/4249016500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0610156560 msgr2=0x7f061006fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:53.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.439+0000 7f0614834640 1 --2- 172.21.15.5:0/4249016500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0610156560 0x7f061006fe30 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f05f801b2f0 tx=0x7f05f801cf20 comp rx=0 tx=0).stop 2023-07-14T13:08:53.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.439+0000 7f0614834640 1 -- 172.21.15.5:0/4249016500 shutdown_connections 2023-07-14T13:08:53.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.439+0000 7f0614834640 1 --2- 172.21.15.5:0/4249016500 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f05f00663a0 0x7f05f0068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:53.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.439+0000 7f0614834640 1 --2- 172.21.15.5:0/4249016500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0610158df0 0x7f0610070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:53.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.439+0000 7f0614834640 1 --2- 172.21.15.5:0/4249016500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0610156560 0x7f061006fe30 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:53.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.439+0000 7f0614834640 1 --2- 172.21.15.5:0/4249016500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06100cd670 0x7f0610151270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:53.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.439+0000 7f0614834640 1 -- 172.21.15.5:0/4249016500 >> 172.21.15.5:0/4249016500 conn(0x7f06100afac0 msgr2=0x7f06100ada30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:53.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.439+0000 7f0614834640 1 -- 172.21.15.5:0/4249016500 shutdown_connections 2023-07-14T13:08:53.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.439+0000 7f0614834640 1 -- 172.21.15.5:0/4249016500 wait complete. 2023-07-14T13:08:53.490 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-14T13:08:53.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.611+0000 7f11ea09c640 1 Processor -- start 2023-07-14T13:08:53.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.611+0000 7f11ea09c640 1 -- start start 2023-07-14T13:08:53.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.611+0000 7f11ea09c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f11e4159a70 0x7f11e40ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:53.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.611+0000 7f11ea09c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f11e4071030 0x7f11e40c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:53.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.611+0000 7f11ea09c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e40cbe50 con 0x7f11e415e060 2023-07-14T13:08:53.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.611+0000 7f11ea09c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e40cd660 con 0x7f11e4071030 2023-07-14T13:08:53.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.611+0000 7f11ea09c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e40cc0a0 con 0x7f11e4159a70 2023-07-14T13:08:53.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.611+0000 7f11e3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f11e4071030 0x7f11e40c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:53.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.611+0000 7f11e3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f11e4071030 0x7f11e40c9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44708/0 (socket says 172.21.15.5:44708) 2023-07-14T13:08:53.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.611+0000 7f11e3fff640 1 -- 172.21.15.5:0/2702296099 learned_addr learned my addr 172.21.15.5:0/2702296099 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:53.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.611+0000 7f11e37fe640 1 --2- 172.21.15.5:0/2702296099 >> v2:172.21.15.154:3300/0 conn(0x7f11e4159a70 0x7f11e40ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:53.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.611+0000 7f11e3fff640 1 -- 172.21.15.5:0/2702296099 >> v2:172.21.15.154:3300/0 conn(0x7f11e4159a70 msgr2=0x7f11e40ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:53.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.611+0000 7f11e3fff640 1 --2- 172.21.15.5:0/2702296099 >> v2:172.21.15.154:3300/0 conn(0x7f11e4159a70 0x7f11e40ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:53.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.611+0000 7f11e3fff640 1 -- 172.21.15.5:0/2702296099 >> v1:172.21.15.154:6789/0 conn(0x7f11e415e060 legacy=0x7f11e4070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:53.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.611+0000 7f11e3fff640 1 -- 172.21.15.5:0/2702296099 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e40cc380 con 0x7f11e4071030 2023-07-14T13:08:53.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.615+0000 7f11e3fff640 1 --2- 172.21.15.5:0/2702296099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e4071030 0x7f11e40c9da0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f11e4071b50 tx=0x7f11dc01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc08bbbc12b0f85 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:53.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.615+0000 7f11e27fc640 1 -- 172.21.15.5:0/2702296099 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc0a56e0 con 0x7f11e4071030 2023-07-14T13:08:53.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.615+0000 7f11e27fc640 1 -- 172.21.15.5:0/2702296099 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11dc0a5840 con 0x7f11e4071030 2023-07-14T13:08:53.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.615+0000 7f11e27fc640 1 -- 172.21.15.5:0/2702296099 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc0a5bd0 con 0x7f11e4071030 2023-07-14T13:08:53.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.615+0000 7f11ea09c640 1 -- 172.21.15.5:0/2702296099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e4071030 msgr2=0x7f11e40c9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:53.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.615+0000 7f11ea09c640 1 --2- 172.21.15.5:0/2702296099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e4071030 0x7f11e40c9da0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f11e4071b50 tx=0x7f11dc01c880 comp rx=0 tx=0).stop 2023-07-14T13:08:53.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.615+0000 7f11ea09c640 1 -- 172.21.15.5:0/2702296099 shutdown_connections 2023-07-14T13:08:53.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.615+0000 7f11ea09c640 1 --2- 172.21.15.5:0/2702296099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e4071030 0x7f11e40c9da0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:53.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.615+0000 7f11ea09c640 1 --2- 172.21.15.5:0/2702296099 >> v2:172.21.15.154:3300/0 conn(0x7f11e4159a70 0x7f11e40ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:53.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.615+0000 7f11ea09c640 1 -- 172.21.15.5:0/2702296099 >> 172.21.15.5:0/2702296099 conn(0x7f11e40afac0 msgr2=0x7f11e40afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:53.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.615+0000 7f11ea09c640 1 -- 172.21.15.5:0/2702296099 shutdown_connections 2023-07-14T13:08:53.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.615+0000 7f11ea09c640 1 -- 172.21.15.5:0/2702296099 wait complete. 2023-07-14T13:08:53.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.615+0000 7f11ea09c640 1 Processor -- start 2023-07-14T13:08:53.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.615+0000 7f11ea09c640 1 -- start start 2023-07-14T13:08:53.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.619+0000 7f11ea09c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e4071030 0x7f11e4152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:53.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.619+0000 7f11ea09c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11e4159a70 0x7f11e4144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:53.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.619+0000 7f11ea09c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11e415e060 0x7f11e40ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:53.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.619+0000 7f11ea09c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e4152e90 con 0x7f11e4071030 2023-07-14T13:08:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.619+0000 7f11ea09c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e4145000 con 0x7f11e4159a70 2023-07-14T13:08:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.619+0000 7f11ea09c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e40b3030 con 0x7f11e415e060 2023-07-14T13:08:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.619+0000 7f11e37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e4071030 0x7f11e4152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.619+0000 7f11e37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e4071030 0x7f11e4152950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44724/0 (socket says 172.21.15.5:44724) 2023-07-14T13:08:53.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.619+0000 7f11e37fe640 1 -- 172.21.15.5:0/2710208454 learned_addr learned my addr 172.21.15.5:0/2710208454 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:53.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.619+0000 7f11e2ffd640 1 --2- 172.21.15.5:0/2710208454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11e4159a70 0x7f11e4144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:53.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.619+0000 7f11e3fff640 1 --2- 172.21.15.5:0/2710208454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11e415e060 0x7f11e40ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:53.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.619+0000 7f11e37fe640 1 -- 172.21.15.5:0/2710208454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11e415e060 msgr2=0x7f11e40ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:53.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.619+0000 7f11e37fe640 1 --2- 172.21.15.5:0/2710208454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11e415e060 0x7f11e40ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:53.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.619+0000 7f11e37fe640 1 -- 172.21.15.5:0/2710208454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11e4159a70 msgr2=0x7f11e4144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:53.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.619+0000 7f11e37fe640 1 --2- 172.21.15.5:0/2710208454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11e4159a70 0x7f11e4144ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:53.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.619+0000 7f11e37fe640 1 -- 172.21.15.5:0/2710208454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11dc009b30 con 0x7f11e4071030 2023-07-14T13:08:53.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.619+0000 7f11e37fe640 1 --2- 172.21.15.5:0/2710208454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e4071030 0x7f11e4152950 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f11d400d800 tx=0x7f11d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:53.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.619+0000 7f11cbfff640 1 -- 172.21.15.5:0/2710208454 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d400b6c0 con 0x7f11e4071030 2023-07-14T13:08:53.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.619+0000 7f11cbfff640 1 -- 172.21.15.5:0/2710208454 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d400b860 con 0x7f11e4071030 2023-07-14T13:08:53.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.619+0000 7f11cbfff640 1 -- 172.21.15.5:0/2710208454 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d400bc10 con 0x7f11e4071030 2023-07-14T13:08:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.619+0000 7f11ea09c640 1 -- 172.21.15.5:0/2710208454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e40b3310 con 0x7f11e4071030 2023-07-14T13:08:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.619+0000 7f11ea09c640 1 -- 172.21.15.5:0/2710208454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e40b38d0 con 0x7f11e4071030 2023-07-14T13:08:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.619+0000 7f11ea09c640 1 -- 172.21.15.5:0/2710208454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e40678d0 con 0x7f11e4071030 2023-07-14T13:08:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.623+0000 7f11cbfff640 1 -- 172.21.15.5:0/2710208454 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f11d401e460 con 0x7f11e4071030 2023-07-14T13:08:53.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.623+0000 7f11cbfff640 1 --2- 172.21.15.5:0/2710208454 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f11d00663a0 0x7f11d0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:53.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.623+0000 7f11cbfff640 1 -- 172.21.15.5:0/2710208454 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6027+0+0 (secure 0 0 0) 0x7f11d4084460 con 0x7f11e4071030 2023-07-14T13:08:53.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.623+0000 7f11e2ffd640 1 --2- 172.21.15.5:0/2710208454 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f11d00663a0 0x7f11d0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:53.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.623+0000 7f11e2ffd640 1 --2- 172.21.15.5:0/2710208454 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f11d00663a0 0x7f11d0068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f11d8000f70 tx=0x7f11d8009040 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:53.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.627+0000 7f11cbfff640 1 -- 172.21.15.5:0/2710208454 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f11d40517e0 con 0x7f11e4071030 2023-07-14T13:08:53.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.783+0000 7f11ea09c640 1 -- 172.21.15.5:0/2710208454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f11e40c9980 con 0x7f11e4071030 2023-07-14T13:08:53.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.787+0000 7f11cbfff640 1 -- 172.21.15.5:0/2710208454 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v27) v1 ==== 115+0+0 (secure 0 0 0) 0x7f11d4054e00 con 0x7f11e4071030 2023-07-14T13:08:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.787+0000 7f11ea09c640 1 -- 172.21.15.5:0/2710208454 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f11d00663a0 msgr2=0x7f11d0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.787+0000 7f11ea09c640 1 --2- 172.21.15.5:0/2710208454 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f11d00663a0 0x7f11d0068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f11d8000f70 tx=0x7f11d8009040 comp rx=0 tx=0).stop 2023-07-14T13:08:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.787+0000 7f11ea09c640 1 -- 172.21.15.5:0/2710208454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e4071030 msgr2=0x7f11e4152950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.787+0000 7f11ea09c640 1 --2- 172.21.15.5:0/2710208454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e4071030 0x7f11e4152950 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f11d400d800 tx=0x7f11d400dcc0 comp rx=0 tx=0).stop 2023-07-14T13:08:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.787+0000 7f11ea09c640 1 -- 172.21.15.5:0/2710208454 shutdown_connections 2023-07-14T13:08:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.787+0000 7f11ea09c640 1 --2- 172.21.15.5:0/2710208454 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f11d00663a0 0x7f11d0068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.787+0000 7f11ea09c640 1 --2- 172.21.15.5:0/2710208454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11e415e060 0x7f11e40ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.787+0000 7f11ea09c640 1 --2- 172.21.15.5:0/2710208454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11e4159a70 0x7f11e4144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.787+0000 7f11ea09c640 1 --2- 172.21.15.5:0/2710208454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e4071030 0x7f11e4152950 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.787+0000 7f11ea09c640 1 -- 172.21.15.5:0/2710208454 >> 172.21.15.5:0/2710208454 conn(0x7f11e40afac0 msgr2=0x7f11e406b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.787+0000 7f11ea09c640 1 -- 172.21.15.5:0/2710208454 shutdown_connections 2023-07-14T13:08:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.787+0000 7f11ea09c640 1 -- 172.21.15.5:0/2710208454 wait complete. 2023-07-14T13:08:53.839 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-07-14T13:08:53.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.955+0000 7f7ad527b640 1 Processor -- start 2023-07-14T13:08:53.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.955+0000 7f7ad527b640 1 -- start start 2023-07-14T13:08:53.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.955+0000 7f7ad527b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7ad00c9730 0x7f7ad01638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:53.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.955+0000 7f7ad527b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad00cc700 con 0x7f7ad0158ce0 2023-07-14T13:08:53.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.955+0000 7f7ad527b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad00b0ff0 con 0x7f7ad00c8ad0 2023-07-14T13:08:53.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.955+0000 7f7ad527b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad0070c80 con 0x7f7ad00c9730 2023-07-14T13:08:53.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.955+0000 7f7aceffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7ad0158ce0 0x7f7ad0070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57192/0 (socket says 172.21.15.5:57192) 2023-07-14T13:08:53.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.955+0000 7f7aceffd640 1 -- 172.21.15.5:0/2064706595 learned_addr learned my addr 172.21.15.5:0/2064706595 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:53.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.955+0000 7f7acf7fe640 1 --2- 172.21.15.5:0/2064706595 >> v2:172.21.15.5:3300/0 conn(0x7f7ad00c9730 0x7f7ad01638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:53.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.955+0000 7f7acf7fe640 1 -- 172.21.15.5:0/2064706595 >> v1:172.21.15.154:6789/0 conn(0x7f7ad00c8ad0 legacy=0x7f7ad00c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:53.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.955+0000 7f7acf7fe640 1 -- 172.21.15.5:0/2064706595 >> v1:172.21.15.5:6789/0 conn(0x7f7ad0158ce0 legacy=0x7f7ad0070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:53.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.955+0000 7f7acf7fe640 1 -- 172.21.15.5:0/2064706595 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad00cbdd0 con 0x7f7ad00c9730 2023-07-14T13:08:53.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.959+0000 7f7acf7fe640 1 --2- 172.21.15.5:0/2064706595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad00c9730 0x7f7ad01638b0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8009d90 tx=0x7f7ac801c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7a3e337d2b085c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:53.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.959+0000 7f7ace7fc640 1 -- 172.21.15.5:0/2064706595 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac80a57d0 con 0x7f7ad00c9730 2023-07-14T13:08:53.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.959+0000 7f7ace7fc640 1 -- 172.21.15.5:0/2064706595 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac80a5930 con 0x7f7ad00c9730 2023-07-14T13:08:53.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.959+0000 7f7ace7fc640 1 -- 172.21.15.5:0/2064706595 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac80a5cc0 con 0x7f7ad00c9730 2023-07-14T13:08:53.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.959+0000 7f7ad527b640 1 -- 172.21.15.5:0/2064706595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad00c9730 msgr2=0x7f7ad01638b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:53.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.959+0000 7f7ad527b640 1 --2- 172.21.15.5:0/2064706595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad00c9730 0x7f7ad01638b0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8009d90 tx=0x7f7ac801c800 comp rx=0 tx=0).stop 2023-07-14T13:08:53.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.959+0000 7f7ad527b640 1 -- 172.21.15.5:0/2064706595 shutdown_connections 2023-07-14T13:08:53.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.959+0000 7f7ad527b640 1 --2- 172.21.15.5:0/2064706595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad00c9730 0x7f7ad01638b0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:53.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.959+0000 7f7ad527b640 1 -- 172.21.15.5:0/2064706595 >> 172.21.15.5:0/2064706595 conn(0x7f7ad00afcf0 msgr2=0x7f7ad00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:53.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.959+0000 7f7ad527b640 1 -- 172.21.15.5:0/2064706595 shutdown_connections 2023-07-14T13:08:53.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.959+0000 7f7ad527b640 1 -- 172.21.15.5:0/2064706595 wait complete. 2023-07-14T13:08:53.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.959+0000 7f7ad527b640 1 Processor -- start 2023-07-14T13:08:53.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.959+0000 7f7ad527b640 1 -- start start 2023-07-14T13:08:53.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.963+0000 7f7ad527b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ad00c8ad0 0x7f7ad00b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:53.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.963+0000 7f7ad527b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ad00c9730 0x7f7ad0153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:53.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.963+0000 7f7ad527b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad0158ce0 0x7f7ad014e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:53.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.963+0000 7f7ad527b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad00b2890 con 0x7f7ad0158ce0 2023-07-14T13:08:53.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.963+0000 7f7ad527b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad00b2a70 con 0x7f7ad00c8ad0 2023-07-14T13:08:53.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.963+0000 7f7ad527b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad00b2d50 con 0x7f7ad00c9730 2023-07-14T13:08:53.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.963+0000 7f7acf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad0158ce0 0x7f7ad014e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:53.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.963+0000 7f7acf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad0158ce0 0x7f7ad014e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44748/0 (socket says 172.21.15.5:44748) 2023-07-14T13:08:53.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.963+0000 7f7acf7fe640 1 -- 172.21.15.5:0/3000317612 learned_addr learned my addr 172.21.15.5:0/3000317612 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:53.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.963+0000 7f7ac7fff640 1 --2- 172.21.15.5:0/3000317612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ad00c9730 0x7f7ad0153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:53.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.963+0000 7f7aceffd640 1 --2- 172.21.15.5:0/3000317612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ad00c8ad0 0x7f7ad00b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:53.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.963+0000 7f7acf7fe640 1 -- 172.21.15.5:0/3000317612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ad00c9730 msgr2=0x7f7ad0153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:53.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.963+0000 7f7acf7fe640 1 --2- 172.21.15.5:0/3000317612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ad00c9730 0x7f7ad0153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:53.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.963+0000 7f7acf7fe640 1 -- 172.21.15.5:0/3000317612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ad00c8ad0 msgr2=0x7f7ad00b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:53.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.963+0000 7f7acf7fe640 1 --2- 172.21.15.5:0/3000317612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ad00c8ad0 0x7f7ad00b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:53.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.963+0000 7f7acf7fe640 1 -- 172.21.15.5:0/3000317612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac8009a70 con 0x7f7ad0158ce0 2023-07-14T13:08:53.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.963+0000 7f7ac7fff640 1 --2- 172.21.15.5:0/3000317612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ad00c9730 0x7f7ad0153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:08:53.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.963+0000 7f7acf7fe640 1 --2- 172.21.15.5:0/3000317612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad0158ce0 0x7f7ad014e1f0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80b0040 tx=0x7f7ac80195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:53.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.963+0000 7f7ac77fe640 1 -- 172.21.15.5:0/3000317612 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac80b9860 con 0x7f7ad0158ce0 2023-07-14T13:08:53.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.963+0000 7f7ac77fe640 1 -- 172.21.15.5:0/3000317612 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac80b99c0 con 0x7f7ad0158ce0 2023-07-14T13:08:53.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.963+0000 7f7ad527b640 1 -- 172.21.15.5:0/3000317612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad00b3030 con 0x7f7ad0158ce0 2023-07-14T13:08:53.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.963+0000 7f7ac77fe640 1 -- 172.21.15.5:0/3000317612 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac80b9d50 con 0x7f7ad0158ce0 2023-07-14T13:08:53.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.963+0000 7f7ad527b640 1 -- 172.21.15.5:0/3000317612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad0157b40 con 0x7f7ad0158ce0 2023-07-14T13:08:53.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.963+0000 7f7ad527b640 1 -- 172.21.15.5:0/3000317612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad00ca1a0 con 0x7f7ad0158ce0 2023-07-14T13:08:53.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.967+0000 7f7ac77fe640 1 -- 172.21.15.5:0/3000317612 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7ac80ad440 con 0x7f7ad0158ce0 2023-07-14T13:08:53.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.967+0000 7f7ac77fe640 1 --2- 172.21.15.5:0/3000317612 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f7ab00663a0 0x7f7ab0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:53.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.967+0000 7f7ac77fe640 1 -- 172.21.15.5:0/3000317612 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6027+0+0 (secure 0 0 0) 0x7f7ac811f2c0 con 0x7f7ad0158ce0 2023-07-14T13:08:53.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.967+0000 7f7aceffd640 1 --2- 172.21.15.5:0/3000317612 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f7ab00663a0 0x7f7ab0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:53.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.967+0000 7f7aceffd640 1 --2- 172.21.15.5:0/3000317612 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f7ab00663a0 0x7f7ab0068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0005890 tx=0x7f7ac0009040 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:54.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:53.971+0000 7f7ac77fe640 1 -- 172.21.15.5:0/3000317612 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7ac80ec5b0 con 0x7f7ad0158ce0 2023-07-14T13:08:54.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.191+0000 7f7ad527b640 1 -- 172.21.15.5:0/3000317612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f7ad00678d0 con 0x7f7ad0158ce0 2023-07-14T13:08:54.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.719+0000 7f7ac77fe640 1 -- 172.21.15.5:0/3000317612 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v598) v1 ==== 156+0+0 (secure 0 0 0) 0x7f7ac80a5790 con 0x7f7ad0158ce0 2023-07-14T13:08:54.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.723+0000 7f7ad527b640 1 -- 172.21.15.5:0/3000317612 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f7ab00663a0 msgr2=0x7f7ab0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:54.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.723+0000 7f7ad527b640 1 --2- 172.21.15.5:0/3000317612 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f7ab00663a0 0x7f7ab0068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0005890 tx=0x7f7ac0009040 comp rx=0 tx=0).stop 2023-07-14T13:08:54.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.723+0000 7f7ad527b640 1 -- 172.21.15.5:0/3000317612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad0158ce0 msgr2=0x7f7ad014e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:54.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.723+0000 7f7ad527b640 1 --2- 172.21.15.5:0/3000317612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad0158ce0 0x7f7ad014e1f0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80b0040 tx=0x7f7ac80195a0 comp rx=0 tx=0).stop 2023-07-14T13:08:54.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.723+0000 7f7ad527b640 1 -- 172.21.15.5:0/3000317612 shutdown_connections 2023-07-14T13:08:54.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.723+0000 7f7ad527b640 1 --2- 172.21.15.5:0/3000317612 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f7ab00663a0 0x7f7ab0068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:54.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.723+0000 7f7ad527b640 1 --2- 172.21.15.5:0/3000317612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad0158ce0 0x7f7ad014e1f0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:54.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.723+0000 7f7ad527b640 1 --2- 172.21.15.5:0/3000317612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ad00c9730 0x7f7ad0153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:54.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.723+0000 7f7ad527b640 1 --2- 172.21.15.5:0/3000317612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ad00c8ad0 0x7f7ad00b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:54.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.723+0000 7f7ad527b640 1 -- 172.21.15.5:0/3000317612 >> 172.21.15.5:0/3000317612 conn(0x7f7ad00afcf0 msgr2=0x7f7ad006ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:54.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.723+0000 7f7ad527b640 1 -- 172.21.15.5:0/3000317612 shutdown_connections 2023-07-14T13:08:54.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.723+0000 7f7ad527b640 1 -- 172.21.15.5:0/3000317612 wait complete. 2023-07-14T13:08:54.776 INFO:tasks.cephfs_test_runner:Test listing non-existing snap schedules failure ... ok 2023-07-14T13:08:54.776 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules on a non-existing filesystem path failure 2023-07-14T13:08:54.777 INFO:tasks.cephfs_test_runner:test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-14T13:08:54.777 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-07-14T13:08:54.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.895+0000 7f2a25634640 1 Processor -- start 2023-07-14T13:08:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.895+0000 7f2a25634640 1 -- start start 2023-07-14T13:08:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a25634640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a20145430 0x7f2a200b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a25634640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a200b2140 con 0x7f2a200d06b0 2023-07-14T13:08:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a25634640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a200b2410 con 0x7f2a200b39f0 2023-07-14T13:08:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a25634640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200b26f0 con 0x7f2a20145430 2023-07-14T13:08:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a1effd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2a200d06b0 0x7f2a200b1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57202/0 (socket says 172.21.15.5:57202) 2023-07-14T13:08:54.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a1effd640 1 -- 172.21.15.5:0/278735053 learned_addr learned my addr 172.21.15.5:0/278735053 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:08:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a17fff640 1 --2- 172.21.15.5:0/278735053 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a20145430 0x7f2a200b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a1e7fc640 1 -- 172.21.15.5:0/278735053 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579765371 0 0) 0x7f2a200b2140 con 0x7f2a200d06b0 2023-07-14T13:08:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a1e7fc640 1 -- 172.21.15.5:0/278735053 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a0c003530 con 0x7f2a200d06b0 2023-07-14T13:08:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a1e7fc640 1 -- 172.21.15.5:0/278735053 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 319786126 0 0) 0x7f2a200b2410 con 0x7f2a200b39f0 2023-07-14T13:08:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a1e7fc640 1 -- 172.21.15.5:0/278735053 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a200b2140 con 0x7f2a200b39f0 2023-07-14T13:08:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a1e7fc640 1 -- 172.21.15.5:0/278735053 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2502942771 0 0) 0x7f2a0c003530 con 0x7f2a200d06b0 2023-07-14T13:08:54.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a1e7fc640 1 -- 172.21.15.5:0/278735053 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a20145430 msgr2=0x7f2a200b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:54.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a1e7fc640 1 --2- 172.21.15.5:0/278735053 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a20145430 0x7f2a200b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:54.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a1e7fc640 1 -- 172.21.15.5:0/278735053 >> v1:172.21.15.154:6789/0 conn(0x7f2a200b39f0 legacy=0x7f2a200d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:54.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a1e7fc640 1 -- 172.21.15.5:0/278735053 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a200b29d0 con 0x7f2a200d06b0 2023-07-14T13:08:54.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a1e7fc640 1 -- 172.21.15.5:0/278735053 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f2a10001680 con 0x7f2a200d06b0 2023-07-14T13:08:54.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a1e7fc640 1 -- 172.21.15.5:0/278735053 >> v1:172.21.15.5:6789/0 conn(0x7f2a200d06b0 legacy=0x7f2a200b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:54.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a1e7fc640 1 --2- 172.21.15.5:0/278735053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a0c003b40 0x7f2a0c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:54.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a1e7fc640 1 --2- 172.21.15.5:0/278735053 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a0c0047d0 0x7f2a0c004c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:54.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a1e7fc640 1 --2- 172.21.15.5:0/278735053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a0c005140 0x7f2a0c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:54.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a1e7fc640 1 -- 172.21.15.5:0/278735053 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200b26f0 con 0x7f2a0c005140 2023-07-14T13:08:54.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a1e7fc640 1 -- 172.21.15.5:0/278735053 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c00bed0 con 0x7f2a0c003b40 2023-07-14T13:08:54.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a1e7fc640 1 -- 172.21.15.5:0/278735053 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c00c010 con 0x7f2a0c0047d0 2023-07-14T13:08:54.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a1f7fe640 1 --2- 172.21.15.5:0/278735053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a0c005140 0x7f2a0c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:54.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a1effd640 1 --2- 172.21.15.5:0/278735053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a0c003b40 0x7f2a0c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:54.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a17fff640 1 --2- 172.21.15.5:0/278735053 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a0c0047d0 0x7f2a0c004c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:54.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a1f7fe640 1 -- 172.21.15.5:0/278735053 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a0c0047d0 msgr2=0x7f2a0c004c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a1f7fe640 1 --2- 172.21.15.5:0/278735053 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a0c0047d0 0x7f2a0c004c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a1f7fe640 1 -- 172.21.15.5:0/278735053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a0c003b40 msgr2=0x7f2a0c003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a1f7fe640 1 --2- 172.21.15.5:0/278735053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a0c003b40 0x7f2a0c003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:54.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.899+0000 7f2a1f7fe640 1 -- 172.21.15.5:0/278735053 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0c003530 con 0x7f2a0c005140 2023-07-14T13:08:54.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.903+0000 7f2a1f7fe640 1 --2- 172.21.15.5:0/278735053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a0c005140 0x7f2a0c00b990 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f2a200b3e10 tx=0x7f2a1801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5aa434ac3a9ee47 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:54.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.903+0000 7f2a1e7fc640 1 -- 172.21.15.5:0/278735053 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a10007ea0 con 0x7f2a0c005140 2023-07-14T13:08:54.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.903+0000 7f2a1e7fc640 1 -- 172.21.15.5:0/278735053 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a18003ba0 con 0x7f2a0c005140 2023-07-14T13:08:54.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.903+0000 7f2a1e7fc640 1 -- 172.21.15.5:0/278735053 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a180050d0 con 0x7f2a0c005140 2023-07-14T13:08:54.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.903+0000 7f2a25634640 1 -- 172.21.15.5:0/278735053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a0c005140 msgr2=0x7f2a0c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:54.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.903+0000 7f2a25634640 1 --2- 172.21.15.5:0/278735053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a0c005140 0x7f2a0c00b990 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f2a200b3e10 tx=0x7f2a1801c8c0 comp rx=0 tx=0).stop 2023-07-14T13:08:54.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.903+0000 7f2a1f7fe640 1 -- 172.21.15.5:0/278735053 reap_dead start 2023-07-14T13:08:54.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.903+0000 7f2a25634640 1 -- 172.21.15.5:0/278735053 shutdown_connections 2023-07-14T13:08:54.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.903+0000 7f2a25634640 1 -- 172.21.15.5:0/278735053 >> 172.21.15.5:0/278735053 conn(0x7f2a200659d0 msgr2=0x7f2a2009b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:54.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.903+0000 7f2a25634640 1 -- 172.21.15.5:0/278735053 shutdown_connections 2023-07-14T13:08:54.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.903+0000 7f2a25634640 1 -- 172.21.15.5:0/278735053 wait complete. 2023-07-14T13:08:54.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.903+0000 7f2a25634640 1 Processor -- start 2023-07-14T13:08:54.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.907+0000 7f2a25634640 1 -- start start 2023-07-14T13:08:54.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.907+0000 7f2a25634640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a0c005140 0x7f2a20155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:54.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.907+0000 7f2a25634640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a200b7340 0x7f2a2006a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:54.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.907+0000 7f2a25634640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a2006ad50 0x7f2a2015e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:54.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.907+0000 7f2a25634640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200b6650 con 0x7f2a200b7340 2023-07-14T13:08:54.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.907+0000 7f2a25634640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2006b1c0 con 0x7f2a0c005140 2023-07-14T13:08:54.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.907+0000 7f2a25634640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2015f340 con 0x7f2a2006ad50 2023-07-14T13:08:54.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.907+0000 7f2a17fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a200b7340 0x7f2a2006a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:54.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.907+0000 7f2a17fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a200b7340 0x7f2a2006a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44766/0 (socket says 172.21.15.5:44766) 2023-07-14T13:08:54.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.907+0000 7f2a17fff640 1 -- 172.21.15.5:0/4285266534 learned_addr learned my addr 172.21.15.5:0/4285266534 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:54.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.907+0000 7f2a1effd640 1 --2- 172.21.15.5:0/4285266534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a0c005140 0x7f2a20155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:54.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.907+0000 7f2a1f7fe640 1 --2- 172.21.15.5:0/4285266534 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a2006ad50 0x7f2a2015e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:54.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.907+0000 7f2a17fff640 1 -- 172.21.15.5:0/4285266534 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a2006ad50 msgr2=0x7f2a2015e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:54.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.907+0000 7f2a17fff640 1 --2- 172.21.15.5:0/4285266534 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a2006ad50 0x7f2a2015e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:54.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.907+0000 7f2a17fff640 1 -- 172.21.15.5:0/4285266534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a0c005140 msgr2=0x7f2a20155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:54.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.907+0000 7f2a17fff640 1 --2- 172.21.15.5:0/4285266534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a0c005140 0x7f2a20155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:54.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.907+0000 7f2a17fff640 1 -- 172.21.15.5:0/4285266534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a200b6860 con 0x7f2a200b7340 2023-07-14T13:08:54.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.907+0000 7f2a1effd640 1 --2- 172.21.15.5:0/4285266534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a0c005140 0x7f2a20155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:08:54.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.907+0000 7f2a1f7fe640 1 --2- 172.21.15.5:0/4285266534 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a2006ad50 0x7f2a2015e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:08:54.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.907+0000 7f2a17fff640 1 --2- 172.21.15.5:0/4285266534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a200b7340 0x7f2a2006a810 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f2a08011a00 tx=0x7f2a08011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:54.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.907+0000 7f2a177fe640 1 -- 172.21.15.5:0/4285266534 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0800faf0 con 0x7f2a200b7340 2023-07-14T13:08:54.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.907+0000 7f2a177fe640 1 -- 172.21.15.5:0/4285266534 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0800fc50 con 0x7f2a200b7340 2023-07-14T13:08:54.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.907+0000 7f2a177fe640 1 -- 172.21.15.5:0/4285266534 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a08014440 con 0x7f2a200b7340 2023-07-14T13:08:54.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.907+0000 7f2a25634640 1 -- 172.21.15.5:0/4285266534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a200b6b40 con 0x7f2a200b7340 2023-07-14T13:08:54.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.907+0000 7f2a25634640 1 -- 172.21.15.5:0/4285266534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a20156430 con 0x7f2a200b7340 2023-07-14T13:08:54.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.907+0000 7f2a25634640 1 -- 172.21.15.5:0/4285266534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a200678d0 con 0x7f2a200b7340 2023-07-14T13:08:54.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.911+0000 7f2a177fe640 1 -- 172.21.15.5:0/4285266534 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2a080145a0 con 0x7f2a200b7340 2023-07-14T13:08:54.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.911+0000 7f2a177fe640 1 --2- 172.21.15.5:0/4285266534 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2a000663a0 0x7f2a00068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:54.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.911+0000 7f2a177fe640 1 -- 172.21.15.5:0/4285266534 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6027+0+0 (secure 0 0 0) 0x7f2a08084670 con 0x7f2a200b7340 2023-07-14T13:08:54.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.911+0000 7f2a1effd640 1 --2- 172.21.15.5:0/4285266534 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2a000663a0 0x7f2a00068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:54.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.911+0000 7f2a1effd640 1 --2- 172.21.15.5:0/4285266534 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2a000663a0 0x7f2a00068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2a10007c60 tx=0x7f2a10001e10 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:54.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:54.915+0000 7f2a177fe640 1 -- 172.21.15.5:0/4285266534 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2a08051b70 con 0x7f2a200b7340 2023-07-14T13:08:55.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.123+0000 7f2a25634640 1 -- 172.21.15.5:0/4285266534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7f2a200d2e80 con 0x7f2a200b7340 2023-07-14T13:08:55.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.723+0000 7f2a177fe640 1 -- 172.21.15.5:0/4285266534 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v599) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2a08055190 con 0x7f2a200b7340 2023-07-14T13:08:55.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.723+0000 7f2a25634640 1 -- 172.21.15.5:0/4285266534 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2a000663a0 msgr2=0x7f2a00068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:55.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.723+0000 7f2a25634640 1 --2- 172.21.15.5:0/4285266534 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2a000663a0 0x7f2a00068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2a10007c60 tx=0x7f2a10001e10 comp rx=0 tx=0).stop 2023-07-14T13:08:55.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.723+0000 7f2a25634640 1 -- 172.21.15.5:0/4285266534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a200b7340 msgr2=0x7f2a2006a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:55.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.723+0000 7f2a25634640 1 --2- 172.21.15.5:0/4285266534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a200b7340 0x7f2a2006a810 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f2a08011a00 tx=0x7f2a08011ec0 comp rx=0 tx=0).stop 2023-07-14T13:08:55.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.723+0000 7f2a25634640 1 -- 172.21.15.5:0/4285266534 shutdown_connections 2023-07-14T13:08:55.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.723+0000 7f2a25634640 1 --2- 172.21.15.5:0/4285266534 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2a000663a0 0x7f2a00068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:55.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.723+0000 7f2a25634640 1 --2- 172.21.15.5:0/4285266534 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a2006ad50 0x7f2a2015e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:55.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.723+0000 7f2a25634640 1 --2- 172.21.15.5:0/4285266534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a200b7340 0x7f2a2006a810 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:55.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.723+0000 7f2a25634640 1 --2- 172.21.15.5:0/4285266534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a0c005140 0x7f2a20155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:55.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.723+0000 7f2a25634640 1 -- 172.21.15.5:0/4285266534 >> 172.21.15.5:0/4285266534 conn(0x7f2a200659d0 msgr2=0x7f2a2006b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:55.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.723+0000 7f2a25634640 1 -- 172.21.15.5:0/4285266534 shutdown_connections 2023-07-14T13:08:55.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.723+0000 7f2a25634640 1 -- 172.21.15.5:0/4285266534 wait complete. 2023-07-14T13:08:55.779 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-14T13:08:55.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.899+0000 7f82d7d67640 1 Processor -- start 2023-07-14T13:08:55.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.903+0000 7f82d7d67640 1 -- start start 2023-07-14T13:08:55.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.903+0000 7f82d7d67640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f82d0069430 0x7f82d00cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:55.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.903+0000 7f82d7d67640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82d0160030 0x7f82d0069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:55.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.903+0000 7f82d7d67640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f82d0070330 0x7f82d00707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:55.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.903+0000 7f82d7d67640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d0069d40 con 0x7f82d0070330 2023-07-14T13:08:55.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.903+0000 7f82d7d67640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d00cb7d0 con 0x7f82d0069430 2023-07-14T13:08:55.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.903+0000 7f82d7d67640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d006c510 con 0x7f82d0160030 2023-07-14T13:08:55.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.903+0000 7f82d6304640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f82d0070330 0x7f82d00707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:55.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.903+0000 7f82d6304640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f82d0070330 0x7f82d00707b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44774/0 (socket says 172.21.15.5:44774) 2023-07-14T13:08:55.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.903+0000 7f82d6304640 1 -- 172.21.15.5:0/2110565110 learned_addr learned my addr 172.21.15.5:0/2110565110 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:55.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.903+0000 7f82d5302640 1 --2- 172.21.15.5:0/2110565110 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82d0160030 0x7f82d0069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:55.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.903+0000 7f82d5b03640 1 --2- 172.21.15.5:0/2110565110 >> v2:172.21.15.154:3300/0 conn(0x7f82d0069430 0x7f82d00cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:55.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.903+0000 7f82d6304640 1 -- 172.21.15.5:0/2110565110 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82d0160030 msgr2=0x7f82d0069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:55.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.903+0000 7f82d6304640 1 --2- 172.21.15.5:0/2110565110 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82d0160030 0x7f82d0069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:55.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.903+0000 7f82d6304640 1 -- 172.21.15.5:0/2110565110 >> v2:172.21.15.154:3300/0 conn(0x7f82d0069430 msgr2=0x7f82d00cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:55.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.903+0000 7f82d6304640 1 --2- 172.21.15.5:0/2110565110 >> v2:172.21.15.154:3300/0 conn(0x7f82d0069430 0x7f82d00cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:55.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.903+0000 7f82d6304640 1 -- 172.21.15.5:0/2110565110 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d006c7f0 con 0x7f82d0070330 2023-07-14T13:08:55.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.907+0000 7f82d6304640 1 --2- 172.21.15.5:0/2110565110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82d0070330 0x7f82d00707b0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f82d006eee0 tx=0x7f82c801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e380c0dca610379 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:55.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.907+0000 7f82d4b01640 1 -- 172.21.15.5:0/2110565110 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c80a56b0 con 0x7f82d0070330 2023-07-14T13:08:55.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.907+0000 7f82d4b01640 1 -- 172.21.15.5:0/2110565110 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c80a5810 con 0x7f82d0070330 2023-07-14T13:08:55.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.907+0000 7f82d4b01640 1 -- 172.21.15.5:0/2110565110 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c80a5ba0 con 0x7f82d0070330 2023-07-14T13:08:55.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.907+0000 7f82d7d67640 1 -- 172.21.15.5:0/2110565110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82d0070330 msgr2=0x7f82d00707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:55.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.907+0000 7f82d7d67640 1 --2- 172.21.15.5:0/2110565110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82d0070330 0x7f82d00707b0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f82d006eee0 tx=0x7f82c801c910 comp rx=0 tx=0).stop 2023-07-14T13:08:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.907+0000 7f82d7d67640 1 -- 172.21.15.5:0/2110565110 shutdown_connections 2023-07-14T13:08:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.907+0000 7f82d7d67640 1 --2- 172.21.15.5:0/2110565110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82d0070330 0x7f82d00707b0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.907+0000 7f82d7d67640 1 --2- 172.21.15.5:0/2110565110 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82d0160030 0x7f82d0069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.907+0000 7f82d7d67640 1 --2- 172.21.15.5:0/2110565110 >> v2:172.21.15.154:3300/0 conn(0x7f82d0069430 0x7f82d00cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.907+0000 7f82d7d67640 1 -- 172.21.15.5:0/2110565110 >> 172.21.15.5:0/2110565110 conn(0x7f82d00b1840 msgr2=0x7f82d00cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.907+0000 7f82d7d67640 1 -- 172.21.15.5:0/2110565110 shutdown_connections 2023-07-14T13:08:55.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.907+0000 7f82d7d67640 1 -- 172.21.15.5:0/2110565110 wait complete. 2023-07-14T13:08:55.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.907+0000 7f82d7d67640 1 Processor -- start 2023-07-14T13:08:55.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.907+0000 7f82d7d67640 1 -- start start 2023-07-14T13:08:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.911+0000 7f82d7d67640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82d0069430 0x7f82d01550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.911+0000 7f82d7d67640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82d0070330 0x7f82d00c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:55.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.911+0000 7f82d7d67640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82d0160030 0x7f82d014a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:55.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.911+0000 7f82d7d67640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00c8fa0 con 0x7f82d0160030 2023-07-14T13:08:55.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.911+0000 7f82d7d67640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d0154c40 con 0x7f82d0070330 2023-07-14T13:08:55.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.911+0000 7f82d7d67640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00c7310 con 0x7f82d0069430 2023-07-14T13:08:55.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.911+0000 7f82d6304640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82d0160030 0x7f82d014a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:55.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.911+0000 7f82d6304640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82d0160030 0x7f82d014a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44790/0 (socket says 172.21.15.5:44790) 2023-07-14T13:08:55.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.911+0000 7f82d6304640 1 -- 172.21.15.5:0/1796601193 learned_addr learned my addr 172.21.15.5:0/1796601193 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:55.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.911+0000 7f82d5b03640 1 --2- 172.21.15.5:0/1796601193 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82d0069430 0x7f82d01550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.911+0000 7f82d5302640 1 --2- 172.21.15.5:0/1796601193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82d0070330 0x7f82d00c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.911+0000 7f82d6304640 1 -- 172.21.15.5:0/1796601193 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82d0069430 msgr2=0x7f82d01550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.911+0000 7f82d6304640 1 --2- 172.21.15.5:0/1796601193 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82d0069430 0x7f82d01550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.911+0000 7f82d6304640 1 -- 172.21.15.5:0/1796601193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82d0070330 msgr2=0x7f82d00c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:55.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.911+0000 7f82d6304640 1 --2- 172.21.15.5:0/1796601193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82d0070330 0x7f82d00c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:55.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.911+0000 7f82d6304640 1 -- 172.21.15.5:0/1796601193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c8009b30 con 0x7f82d0160030 2023-07-14T13:08:55.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.911+0000 7f82d6304640 1 --2- 172.21.15.5:0/1796601193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82d0160030 0x7f82d014a350 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f82c801afc0 tx=0x7f82c80196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:55.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.911+0000 7f82c67fc640 1 -- 172.21.15.5:0/1796601193 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c80b8670 con 0x7f82d0160030 2023-07-14T13:08:55.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.911+0000 7f82c67fc640 1 -- 172.21.15.5:0/1796601193 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c80b87f0 con 0x7f82d0160030 2023-07-14T13:08:55.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.911+0000 7f82c67fc640 1 -- 172.21.15.5:0/1796601193 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c80b8ba0 con 0x7f82d0160030 2023-07-14T13:08:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.911+0000 7f82d7d67640 1 -- 172.21.15.5:0/1796601193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d01545f0 con 0x7f82d0160030 2023-07-14T13:08:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.911+0000 7f82d7d67640 1 -- 172.21.15.5:0/1796601193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d014a890 con 0x7f82d0160030 2023-07-14T13:08:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.911+0000 7f82d7d67640 1 -- 172.21.15.5:0/1796601193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d0154420 con 0x7f82d0160030 2023-07-14T13:08:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.915+0000 7f82c67fc640 1 -- 172.21.15.5:0/1796601193 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f82c80b8d00 con 0x7f82d0160030 2023-07-14T13:08:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.915+0000 7f82c67fc640 1 --2- 172.21.15.5:0/1796601193 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f82b40663a0 0x7f82b4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.915+0000 7f82c67fc640 1 -- 172.21.15.5:0/1796601193 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6027+0+0 (secure 0 0 0) 0x7f82c811f500 con 0x7f82d0160030 2023-07-14T13:08:55.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.915+0000 7f82d5b03640 1 --2- 172.21.15.5:0/1796601193 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f82b40663a0 0x7f82b4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:55.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.915+0000 7f82d5b03640 1 --2- 172.21.15.5:0/1796601193 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f82b40663a0 0x7f82b4068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0045f0 tx=0x7f82cc008040 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:55.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:55.919+0000 7f82c67fc640 1 -- 172.21.15.5:0/1796601193 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f82c80ec910 con 0x7f82d0160030 2023-07-14T13:08:56.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.075+0000 7f82d7d67640 1 -- 172.21.15.5:0/1796601193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f82d00678d0 con 0x7f82d0160030 2023-07-14T13:08:56.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.079+0000 7f82c67fc640 1 -- 172.21.15.5:0/1796601193 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7f82c80eff30 con 0x7f82d0160030 2023-07-14T13:08:56.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.079+0000 7f82d7d67640 1 -- 172.21.15.5:0/1796601193 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f82b40663a0 msgr2=0x7f82b4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:56.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.079+0000 7f82d7d67640 1 --2- 172.21.15.5:0/1796601193 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f82b40663a0 0x7f82b4068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0045f0 tx=0x7f82cc008040 comp rx=0 tx=0).stop 2023-07-14T13:08:56.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.079+0000 7f82d7d67640 1 -- 172.21.15.5:0/1796601193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82d0160030 msgr2=0x7f82d014a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:56.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.079+0000 7f82d7d67640 1 --2- 172.21.15.5:0/1796601193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82d0160030 0x7f82d014a350 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f82c801afc0 tx=0x7f82c80196b0 comp rx=0 tx=0).stop 2023-07-14T13:08:56.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.079+0000 7f82d7d67640 1 -- 172.21.15.5:0/1796601193 shutdown_connections 2023-07-14T13:08:56.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.079+0000 7f82d7d67640 1 --2- 172.21.15.5:0/1796601193 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f82b40663a0 0x7f82b4068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:56.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.079+0000 7f82d7d67640 1 --2- 172.21.15.5:0/1796601193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82d0160030 0x7f82d014a350 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:56.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.079+0000 7f82d7d67640 1 --2- 172.21.15.5:0/1796601193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82d0070330 0x7f82d00c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:56.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.079+0000 7f82d7d67640 1 --2- 172.21.15.5:0/1796601193 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82d0069430 0x7f82d01550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:56.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.079+0000 7f82d7d67640 1 -- 172.21.15.5:0/1796601193 >> 172.21.15.5:0/1796601193 conn(0x7f82d00b1840 msgr2=0x7f82d00b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:56.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.079+0000 7f82d7d67640 1 -- 172.21.15.5:0/1796601193 shutdown_connections 2023-07-14T13:08:56.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.079+0000 7f82d7d67640 1 -- 172.21.15.5:0/1796601193 wait complete. 2023-07-14T13:08:56.131 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T13:08:56.131 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:08:56.218 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:08:56.288 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T13:08:56.288 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:08:56.289 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:08:56.298 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:08:56.298 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:08:56.298 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:08:56.308 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:08:56.308 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:08:56.308 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:08:56.348 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:08:56.348 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:08:56.349 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:08:56.363 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:08:56.363 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-14T13:08:56.364 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:08:56.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.503+0000 7fadb55fa640 1 Processor -- start 2023-07-14T13:08:56.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.503+0000 7fadb55fa640 1 -- start start 2023-07-14T13:08:56.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.507+0000 7fadb55fa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fadb00c8ad0 0x7fadb00c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:56.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.507+0000 7fadb55fa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fadb00c9560 0x7fadb00ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:56.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.507+0000 7fadb55fa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadb00c99c0 con 0x7fadb0158ce0 2023-07-14T13:08:56.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.507+0000 7fadb55fa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadb00cc700 con 0x7fadb00c8ad0 2023-07-14T13:08:56.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.507+0000 7fadb55fa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadb00b0ff0 con 0x7fadb00c9560 2023-07-14T13:08:56.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.507+0000 7fada7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fadb00c8ad0 0x7fadb00c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:56.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.507+0000 7fada7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fadb00c8ad0 0x7fadb00c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44794/0 (socket says 172.21.15.5:44794) 2023-07-14T13:08:56.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.507+0000 7fada7fff640 1 -- 172.21.15.5:0/3626765004 learned_addr learned my addr 172.21.15.5:0/3626765004 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:56.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.507+0000 7fada7fff640 1 -- 172.21.15.5:0/3626765004 >> v2:172.21.15.154:3300/0 conn(0x7fadb00c9560 msgr2=0x7fadb00ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:56.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.507+0000 7fada7fff640 1 --2- 172.21.15.5:0/3626765004 >> v2:172.21.15.154:3300/0 conn(0x7fadb00c9560 0x7fadb00ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:56.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.507+0000 7fada7fff640 1 -- 172.21.15.5:0/3626765004 >> v1:172.21.15.154:6789/0 conn(0x7fadb0158ce0 legacy=0x7fadb0070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:56.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.507+0000 7fada7fff640 1 -- 172.21.15.5:0/3626765004 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb0070c80 con 0x7fadb00c8ad0 2023-07-14T13:08:56.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.511+0000 7fada7fff640 1 --2- 172.21.15.5:0/3626765004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadb00c8ad0 0x7fadb00c9020 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fadb00b0d70 tx=0x7fad9801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a979a2b43da104 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:56.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.511+0000 7fadae7fc640 1 -- 172.21.15.5:0/3626765004 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad980ab600 con 0x7fadb00c8ad0 2023-07-14T13:08:56.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.511+0000 7fadae7fc640 1 -- 172.21.15.5:0/3626765004 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad980a7050 con 0x7fadb00c8ad0 2023-07-14T13:08:56.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.511+0000 7fadae7fc640 1 -- 172.21.15.5:0/3626765004 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad980ab980 con 0x7fadb00c8ad0 2023-07-14T13:08:56.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.511+0000 7fadb55fa640 1 -- 172.21.15.5:0/3626765004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadb00c8ad0 msgr2=0x7fadb00c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:56.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.511+0000 7fadb55fa640 1 --2- 172.21.15.5:0/3626765004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadb00c8ad0 0x7fadb00c9020 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fadb00b0d70 tx=0x7fad9801c370 comp rx=0 tx=0).stop 2023-07-14T13:08:56.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.511+0000 7fadb55fa640 1 -- 172.21.15.5:0/3626765004 shutdown_connections 2023-07-14T13:08:56.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.511+0000 7fadb55fa640 1 --2- 172.21.15.5:0/3626765004 >> v2:172.21.15.154:3300/0 conn(0x7fadb00c9560 0x7fadb00ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:56.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.511+0000 7fadb55fa640 1 --2- 172.21.15.5:0/3626765004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadb00c8ad0 0x7fadb00c9020 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:56.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.511+0000 7fadb55fa640 1 -- 172.21.15.5:0/3626765004 >> 172.21.15.5:0/3626765004 conn(0x7fadb00afcf0 msgr2=0x7fadb00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:56.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.511+0000 7fadb55fa640 1 -- 172.21.15.5:0/3626765004 shutdown_connections 2023-07-14T13:08:56.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.511+0000 7fadb55fa640 1 -- 172.21.15.5:0/3626765004 wait complete. 2023-07-14T13:08:56.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.511+0000 7fadb55fa640 1 Processor -- start 2023-07-14T13:08:56.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.511+0000 7fadb55fa640 1 -- start start 2023-07-14T13:08:56.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.515+0000 7fadb55fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadb00c8ad0 0x7fadb013ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:56.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.515+0000 7fadb55fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadb00c9560 0x7fadb00b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:56.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.515+0000 7fadb55fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadb0158ce0 0x7fadb00c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:56.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.515+0000 7fadb55fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb01583a0 con 0x7fadb0158ce0 2023-07-14T13:08:56.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.515+0000 7fadb55fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb0157300 con 0x7fadb00c9560 2023-07-14T13:08:56.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.515+0000 7fadb55fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb01575e0 con 0x7fadb00c8ad0 2023-07-14T13:08:56.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.515+0000 7fadaf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadb0158ce0 0x7fadb00c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:56.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.515+0000 7fadaf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadb0158ce0 0x7fadb00c3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44798/0 (socket says 172.21.15.5:44798) 2023-07-14T13:08:56.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.515+0000 7fadaf7fe640 1 -- 172.21.15.5:0/656758717 learned_addr learned my addr 172.21.15.5:0/656758717 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:08:56.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.515+0000 7fada7fff640 1 --2- 172.21.15.5:0/656758717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadb00c9560 0x7fadb00b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:56.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.515+0000 7fadaeffd640 1 --2- 172.21.15.5:0/656758717 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadb00c8ad0 0x7fadb013ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:56.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.515+0000 7fadaf7fe640 1 -- 172.21.15.5:0/656758717 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadb00c8ad0 msgr2=0x7fadb013ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:56.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.515+0000 7fadaf7fe640 1 --2- 172.21.15.5:0/656758717 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadb00c8ad0 0x7fadb013ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:56.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.515+0000 7fadaf7fe640 1 -- 172.21.15.5:0/656758717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadb00c9560 msgr2=0x7fadb00b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:56.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.515+0000 7fadaf7fe640 1 --2- 172.21.15.5:0/656758717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadb00c9560 0x7fadb00b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:56.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.515+0000 7fadaf7fe640 1 -- 172.21.15.5:0/656758717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad980094d0 con 0x7fadb0158ce0 2023-07-14T13:08:56.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.515+0000 7fadaf7fe640 1 --2- 172.21.15.5:0/656758717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadb0158ce0 0x7fadb00c3ca0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fada800b970 tx=0x7fada800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:56.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.515+0000 7fada77fe640 1 -- 172.21.15.5:0/656758717 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada800cb40 con 0x7fadb0158ce0 2023-07-14T13:08:56.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.515+0000 7fada77fe640 1 -- 172.21.15.5:0/656758717 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada800ccc0 con 0x7fadb0158ce0 2023-07-14T13:08:56.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.515+0000 7fadb55fa640 1 -- 172.21.15.5:0/656758717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb01578c0 con 0x7fadb0158ce0 2023-07-14T13:08:56.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.515+0000 7fada77fe640 1 -- 172.21.15.5:0/656758717 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada8014680 con 0x7fadb0158ce0 2023-07-14T13:08:56.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.515+0000 7fadb55fa640 1 -- 172.21.15.5:0/656758717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb0157e80 con 0x7fadb0158ce0 2023-07-14T13:08:56.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.515+0000 7fadb55fa640 1 -- 172.21.15.5:0/656758717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb00ca1a0 con 0x7fadb0158ce0 2023-07-14T13:08:56.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.515+0000 7fada77fe640 1 -- 172.21.15.5:0/656758717 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fada801d3b0 con 0x7fadb0158ce0 2023-07-14T13:08:56.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.519+0000 7fada77fe640 1 --2- 172.21.15.5:0/656758717 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fad900663a0 0x7fad90068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:56.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.519+0000 7fada77fe640 1 -- 172.21.15.5:0/656758717 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6027+0+0 (secure 0 0 0) 0x7fada8083e10 con 0x7fadb0158ce0 2023-07-14T13:08:56.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.519+0000 7fadaeffd640 1 --2- 172.21.15.5:0/656758717 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fad900663a0 0x7fad90068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:56.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.519+0000 7fadaeffd640 1 --2- 172.21.15.5:0/656758717 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fad900663a0 0x7fad90068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fada000b810 tx=0x7fada0008040 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:56.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.523+0000 7fada77fe640 1 -- 172.21.15.5:0/656758717 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fada80511a0 con 0x7fadb0158ce0 2023-07-14T13:08:56.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.707+0000 7fadb55fa640 1 -- 172.21.15.5:0/656758717 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadb00678d0 con 0x7fadb0158ce0 2023-07-14T13:08:56.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.707+0000 7fada77fe640 1 -- 172.21.15.5:0/656758717 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fada8019020 con 0x7fadb0158ce0 2023-07-14T13:08:56.739 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:08:56.740 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5837,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/3019701155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":3019701155},{"type":"v1","addr":"172.21.15.5:6835","nonce":3019701155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5843,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1673574180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1673574180},{"type":"v1","addr":"172.21.15.154:6837","nonce":1673574180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6421,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3017507974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3017507974},{"type":"v1","addr":"172.21.15.154:6836","nonce":3017507974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":7029,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3184954548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3184954548},{"type":"v1","addr":"172.21.15.5:6834","nonce":3184954548}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[]} 2023-07-14T13:08:56.740 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 34 2023-07-14T13:08:56.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.711+0000 7fadb55fa640 1 -- 172.21.15.5:0/656758717 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fad900663a0 msgr2=0x7fad90068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:56.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.711+0000 7fadb55fa640 1 --2- 172.21.15.5:0/656758717 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fad900663a0 0x7fad90068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fada000b810 tx=0x7fada0008040 comp rx=0 tx=0).stop 2023-07-14T13:08:56.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.711+0000 7fadb55fa640 1 -- 172.21.15.5:0/656758717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadb0158ce0 msgr2=0x7fadb00c3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:56.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.711+0000 7fadb55fa640 1 --2- 172.21.15.5:0/656758717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadb0158ce0 0x7fadb00c3ca0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fada800b970 tx=0x7fada800be30 comp rx=0 tx=0).stop 2023-07-14T13:08:56.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.711+0000 7fadb55fa640 1 -- 172.21.15.5:0/656758717 shutdown_connections 2023-07-14T13:08:56.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.711+0000 7fadb55fa640 1 --2- 172.21.15.5:0/656758717 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fad900663a0 0x7fad90068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:56.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.711+0000 7fadb55fa640 1 --2- 172.21.15.5:0/656758717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadb0158ce0 0x7fadb00c3ca0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:56.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.711+0000 7fadb55fa640 1 --2- 172.21.15.5:0/656758717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadb00c9560 0x7fadb00b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:56.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.711+0000 7fadb55fa640 1 --2- 172.21.15.5:0/656758717 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadb00c8ad0 0x7fadb013ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:56.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.711+0000 7fadb55fa640 1 -- 172.21.15.5:0/656758717 >> 172.21.15.5:0/656758717 conn(0x7fadb00afcf0 msgr2=0x7fadb0070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:56.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.711+0000 7fadb55fa640 1 -- 172.21.15.5:0/656758717 shutdown_connections 2023-07-14T13:08:56.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:08:56.711+0000 7fadb55fa640 1 -- 172.21.15.5:0/656758717 wait complete. 2023-07-14T13:08:56.760 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-14T13:08:56.761 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-14T13:08:56.761 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-14T13:08:56.761 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:08:56.762 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-14T13:08:56.762 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-14T13:08:56.762 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-14T13:08:56.762 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:08:56.762 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-14T13:08:56.763 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-14T13:08:56.763 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-14T13:08:56.763 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:08:56.763 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-14T13:08:56.763 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-14T13:08:56.764 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-14T13:08:56.764 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:08:56.777 INFO:tasks.ceph.mds.a:Stopped 2023-07-14T13:08:56.777 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-14T13:08:56.778 INFO:tasks.ceph.mds.c:Stopped 2023-07-14T13:08:56.778 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-14T13:08:56.779 INFO:tasks.ceph.mds.d:Stopped 2023-07-14T13:08:56.780 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-14T13:08:56.823 INFO:tasks.ceph.mds.a:Started 2023-07-14T13:08:56.823 DEBUG:teuthology.parallel:result is None 2023-07-14T13:08:56.825 INFO:tasks.ceph.mds.c:Started 2023-07-14T13:08:56.825 DEBUG:teuthology.parallel:result is None 2023-07-14T13:08:56.828 INFO:tasks.ceph.mds.d:Started 2023-07-14T13:08:56.828 DEBUG:teuthology.parallel:result is None 2023-07-14T13:08:56.911 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-07-14T13:08:56.912 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-07-14T13:08:56.922 INFO:tasks.ceph.mds.d.smithi154.stdout:starting mds.d at 2023-07-14T13:09:00.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-07-14T13:09:02.780 INFO:tasks.ceph.mds.b:Stopped 2023-07-14T13:09:02.780 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-14T13:09:02.784 INFO:tasks.ceph.mds.b:Started 2023-07-14T13:09:02.785 DEBUG:teuthology.parallel:result is None 2023-07-14T13:09:02.785 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-14T13:09:02.878 INFO:tasks.ceph.mds.b.smithi154.stdout:starting mds.b at 2023-07-14T13:09:02.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.911+0000 7f6958019640 1 Processor -- start 2023-07-14T13:09:02.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.911+0000 7f6958019640 1 -- start start 2023-07-14T13:09:02.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.911+0000 7f6958019640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69500c0f80 0x7f69500cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:02.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.911+0000 7f6958019640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69500c17d0 con 0x7f6950160330 2023-07-14T13:09:02.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.911+0000 7f6958019640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69500c14f0 con 0x7f69500c8940 2023-07-14T13:09:02.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.911+0000 7f6958019640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69500cdd70 con 0x7f69500c0f80 2023-07-14T13:09:02.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.915+0000 7f6955db5640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6950160330 0x7f69500ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46424/0 (socket says 172.21.15.5:46424) 2023-07-14T13:09:02.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.915+0000 7f6955db5640 1 -- 172.21.15.5:0/553085501 learned_addr learned my addr 172.21.15.5:0/553085501 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:02.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.915+0000 7f69565b6640 1 --2- 172.21.15.5:0/553085501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69500c0f80 0x7f69500cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:02.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.915+0000 7f6954db3640 1 -- 172.21.15.5:0/553085501 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3885403927 0 0) 0x7f69500c17d0 con 0x7f6950160330 2023-07-14T13:09:02.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.915+0000 7f6954db3640 1 -- 172.21.15.5:0/553085501 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f693c003530 con 0x7f6950160330 2023-07-14T13:09:02.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.915+0000 7f6954db3640 1 -- 172.21.15.5:0/553085501 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966652484 0 0) 0x7f69500c14f0 con 0x7f69500c8940 2023-07-14T13:09:02.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.915+0000 7f6954db3640 1 -- 172.21.15.5:0/553085501 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69500c17d0 con 0x7f69500c8940 2023-07-14T13:09:02.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.915+0000 7f69565b6640 1 -- 172.21.15.5:0/553085501 >> v1:172.21.15.154:6789/0 conn(0x7f69500c8940 legacy=0x7f69500cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:02.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.915+0000 7f69565b6640 1 -- 172.21.15.5:0/553085501 >> v1:172.21.15.5:6789/0 conn(0x7f6950160330 legacy=0x7f69500ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:02.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.915+0000 7f69565b6640 1 -- 172.21.15.5:0/553085501 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69500cac10 con 0x7f69500c0f80 2023-07-14T13:09:02.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.915+0000 7f69565b6640 1 --2- 172.21.15.5:0/553085501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69500c0f80 0x7f69500cb6f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6948009dc0 tx=0x7f694801f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b1fde97a61f8402 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:02.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.919+0000 7f6954db3640 1 -- 172.21.15.5:0/553085501 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69480af600 con 0x7f69500c0f80 2023-07-14T13:09:02.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.919+0000 7f6954db3640 1 -- 172.21.15.5:0/553085501 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69480ab050 con 0x7f69500c0f80 2023-07-14T13:09:02.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.919+0000 7f6954db3640 1 -- 172.21.15.5:0/553085501 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69480af980 con 0x7f69500c0f80 2023-07-14T13:09:02.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.919+0000 7f6958019640 1 -- 172.21.15.5:0/553085501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69500c0f80 msgr2=0x7f69500cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:02.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.919+0000 7f6958019640 1 --2- 172.21.15.5:0/553085501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69500c0f80 0x7f69500cb6f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6948009dc0 tx=0x7f694801f150 comp rx=0 tx=0).stop 2023-07-14T13:09:02.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.919+0000 7f6958019640 1 -- 172.21.15.5:0/553085501 shutdown_connections 2023-07-14T13:09:02.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.919+0000 7f6958019640 1 --2- 172.21.15.5:0/553085501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69500c0f80 0x7f69500cb6f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:02.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.919+0000 7f6958019640 1 -- 172.21.15.5:0/553085501 >> 172.21.15.5:0/553085501 conn(0x7f69500afcf0 msgr2=0x7f69500b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:02.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.919+0000 7f6958019640 1 -- 172.21.15.5:0/553085501 shutdown_connections 2023-07-14T13:09:02.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.919+0000 7f6958019640 1 -- 172.21.15.5:0/553085501 wait complete. 2023-07-14T13:09:02.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.919+0000 7f6958019640 1 Processor -- start 2023-07-14T13:09:02.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.919+0000 7f6958019640 1 -- start start 2023-07-14T13:09:02.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.919+0000 7f6958019640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69500c0f80 0x7f69500c4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:02.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.919+0000 7f6958019640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69500c8940 0x7f69500c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:02.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.919+0000 7f6958019640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6950160330 0x7f69500c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:02.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.919+0000 7f6958019640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6950155b70 con 0x7f69500c8940 2023-07-14T13:09:02.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.919+0000 7f6958019640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69500c3db0 con 0x7f6950160330 2023-07-14T13:09:02.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.919+0000 7f6958019640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69500c31a0 con 0x7f69500c0f80 2023-07-14T13:09:02.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.919+0000 7f69555b4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69500c8940 0x7f69500c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:02.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.919+0000 7f69555b4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69500c8940 0x7f69500c53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57716/0 (socket says 172.21.15.5:57716) 2023-07-14T13:09:02.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.919+0000 7f69555b4640 1 -- 172.21.15.5:0/3448927163 learned_addr learned my addr 172.21.15.5:0/3448927163 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:02.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.923+0000 7f6955db5640 1 --2- 172.21.15.5:0/3448927163 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69500c0f80 0x7f69500c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:02.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.923+0000 7f69565b6640 1 --2- 172.21.15.5:0/3448927163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6950160330 0x7f69500c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:02.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.923+0000 7f69555b4640 1 -- 172.21.15.5:0/3448927163 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69500c0f80 msgr2=0x7f69500c4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:02.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.923+0000 7f69555b4640 1 --2- 172.21.15.5:0/3448927163 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69500c0f80 0x7f69500c4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:02.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.923+0000 7f69555b4640 1 -- 172.21.15.5:0/3448927163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6950160330 msgr2=0x7f69500c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:02.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.923+0000 7f69555b4640 1 --2- 172.21.15.5:0/3448927163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6950160330 0x7f69500c5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:02.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.923+0000 7f69555b4640 1 -- 172.21.15.5:0/3448927163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6948009a70 con 0x7f69500c8940 2023-07-14T13:09:02.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.923+0000 7f69555b4640 1 --2- 172.21.15.5:0/3448927163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69500c8940 0x7f69500c53f0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f694000c490 tx=0x7f694000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:02.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.923+0000 7f69467fc640 1 -- 172.21.15.5:0/3448927163 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69400052d0 con 0x7f69500c8940 2023-07-14T13:09:02.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.923+0000 7f69467fc640 1 -- 172.21.15.5:0/3448927163 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6940005430 con 0x7f69500c8940 2023-07-14T13:09:02.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.923+0000 7f6958019640 1 -- 172.21.15.5:0/3448927163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69500c3480 con 0x7f69500c8940 2023-07-14T13:09:02.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.923+0000 7f69467fc640 1 -- 172.21.15.5:0/3448927163 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6940012870 con 0x7f69500c8940 2023-07-14T13:09:02.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.923+0000 7f6958019640 1 -- 172.21.15.5:0/3448927163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69500c3a40 con 0x7f69500c8940 2023-07-14T13:09:02.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.923+0000 7f6958019640 1 -- 172.21.15.5:0/3448927163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69500c3f20 con 0x7f69500c8940 2023-07-14T13:09:02.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.923+0000 7f69467fc640 1 -- 172.21.15.5:0/3448927163 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f69400129d0 con 0x7f69500c8940 2023-07-14T13:09:02.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.923+0000 7f69467fc640 1 --2- 172.21.15.5:0/3448927163 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f69340663a0 0x7f6934068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:02.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.923+0000 7f69467fc640 1 -- 172.21.15.5:0/3448927163 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6027+0+0 (secure 0 0 0) 0x7f69400838d0 con 0x7f69500c8940 2023-07-14T13:09:02.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.927+0000 7f6955db5640 1 --2- 172.21.15.5:0/3448927163 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f69340663a0 0x7f6934068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:02.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.927+0000 7f6955db5640 1 --2- 172.21.15.5:0/3448927163 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f69340663a0 0x7f6934068850 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f694c005890 tx=0x7f694c009040 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:02.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:02.927+0000 7f69467fc640 1 -- 172.21.15.5:0/3448927163 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6940050d00 con 0x7f69500c8940 2023-07-14T13:09:03.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:03.095+0000 7f6958019640 1 -- 172.21.15.5:0/3448927163 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f69500678d0 con 0x7f69500c8940 2023-07-14T13:09:04.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.391+0000 7f69467fc640 1 -- 172.21.15.5:0/3448927163 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v93) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6940054320 con 0x7f69500c8940 2023-07-14T13:09:04.424 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2023-07-14T13:09:04.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.395+0000 7f6958019640 1 -- 172.21.15.5:0/3448927163 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f69340663a0 msgr2=0x7f6934068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:04.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.395+0000 7f6958019640 1 --2- 172.21.15.5:0/3448927163 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f69340663a0 0x7f6934068850 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f694c005890 tx=0x7f694c009040 comp rx=0 tx=0).stop 2023-07-14T13:09:04.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.395+0000 7f6958019640 1 -- 172.21.15.5:0/3448927163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69500c8940 msgr2=0x7f69500c53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:04.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.395+0000 7f6958019640 1 --2- 172.21.15.5:0/3448927163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69500c8940 0x7f69500c53f0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f694000c490 tx=0x7f694000c950 comp rx=0 tx=0).stop 2023-07-14T13:09:04.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.395+0000 7f6958019640 1 -- 172.21.15.5:0/3448927163 shutdown_connections 2023-07-14T13:09:04.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.395+0000 7f6958019640 1 --2- 172.21.15.5:0/3448927163 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f69340663a0 0x7f6934068850 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:04.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.395+0000 7f6958019640 1 --2- 172.21.15.5:0/3448927163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6950160330 0x7f69500c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:04.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.395+0000 7f6958019640 1 --2- 172.21.15.5:0/3448927163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69500c8940 0x7f69500c53f0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:04.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.395+0000 7f6958019640 1 --2- 172.21.15.5:0/3448927163 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69500c0f80 0x7f69500c4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:04.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.395+0000 7f6958019640 1 -- 172.21.15.5:0/3448927163 >> 172.21.15.5:0/3448927163 conn(0x7f69500afcf0 msgr2=0x7f69500adc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:04.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.395+0000 7f6958019640 1 -- 172.21.15.5:0/3448927163 shutdown_connections 2023-07-14T13:09:04.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.395+0000 7f6958019640 1 -- 172.21.15.5:0/3448927163 wait complete. 2023-07-14T13:09:04.451 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-14T13:09:04.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.567+0000 7feaa1574640 1 Processor -- start 2023-07-14T13:09:04.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.567+0000 7feaa1574640 1 -- start start 2023-07-14T13:09:04.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7feaa1574640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fea9c06a540 0x7fea9c06a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:04.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7feaa1574640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea9c0ce0f0 0x7fea9c0ce570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:04.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7feaa1574640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea9c0cdc80 con 0x7fea9c15f500 2023-07-14T13:09:04.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7feaa1574640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea9c06af00 con 0x7fea9c06a540 2023-07-14T13:09:04.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7feaa1574640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c06e4c0 con 0x7fea9c0ce0f0 2023-07-14T13:09:04.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea9affd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fea9c15f500 0x7fea9c06cef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46440/0 (socket says 172.21.15.5:46440) 2023-07-14T13:09:04.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea9affd640 1 -- 172.21.15.5:0/3791664056 learned_addr learned my addr 172.21.15.5:0/3791664056 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:04.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea9a7fc640 1 -- 172.21.15.5:0/3791664056 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781853210 0 0) 0x7fea9c0cdc80 con 0x7fea9c15f500 2023-07-14T13:09:04.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea9a7fc640 1 -- 172.21.15.5:0/3791664056 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea88003530 con 0x7fea9c15f500 2023-07-14T13:09:04.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea9b7fe640 1 --2- 172.21.15.5:0/3791664056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea9c0ce0f0 0x7fea9c0ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:04.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea93fff640 1 --2- 172.21.15.5:0/3791664056 >> v2:172.21.15.154:3300/0 conn(0x7fea9c06a540 0x7fea9c06a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:04.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea9a7fc640 1 -- 172.21.15.5:0/3791664056 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3244776229 0 0) 0x7fea88003530 con 0x7fea9c15f500 2023-07-14T13:09:04.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea9a7fc640 1 -- 172.21.15.5:0/3791664056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea9c0ce0f0 msgr2=0x7fea9c0ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:04.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea9a7fc640 1 --2- 172.21.15.5:0/3791664056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea9c0ce0f0 0x7fea9c0ce570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:04.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea9a7fc640 1 -- 172.21.15.5:0/3791664056 >> v2:172.21.15.154:3300/0 conn(0x7fea9c06a540 msgr2=0x7fea9c06a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:04.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea9a7fc640 1 --2- 172.21.15.5:0/3791664056 >> v2:172.21.15.154:3300/0 conn(0x7fea9c06a540 0x7fea9c06a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:04.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea9a7fc640 1 -- 172.21.15.5:0/3791664056 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c06d940 con 0x7fea9c15f500 2023-07-14T13:09:04.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea9a7fc640 1 -- 172.21.15.5:0/3791664056 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7fea8c001800 con 0x7fea9c15f500 2023-07-14T13:09:04.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea9a7fc640 1 -- 172.21.15.5:0/3791664056 >> v1:172.21.15.5:6789/0 conn(0x7fea9c15f500 legacy=0x7fea9c06cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:04.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea9a7fc640 1 --2- 172.21.15.5:0/3791664056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea88003980 0x7fea88003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:04.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea9a7fc640 1 --2- 172.21.15.5:0/3791664056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea9c0ce0f0 0x7fea880047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:04.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea9a7fc640 1 --2- 172.21.15.5:0/3791664056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea88004d10 0x7fea88005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:04.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea9a7fc640 1 -- 172.21.15.5:0/3791664056 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c06af00 con 0x7fea88004d10 2023-07-14T13:09:04.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea9a7fc640 1 -- 172.21.15.5:0/3791664056 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c06e4c0 con 0x7fea88003980 2023-07-14T13:09:04.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea9a7fc640 1 -- 172.21.15.5:0/3791664056 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea8800b990 con 0x7fea9c0ce0f0 2023-07-14T13:09:04.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea9b7fe640 1 --2- 172.21.15.5:0/3791664056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea88004d10 0x7fea88005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:04.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea93fff640 1 --2- 172.21.15.5:0/3791664056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea9c0ce0f0 0x7fea880047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:04.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea9affd640 1 --2- 172.21.15.5:0/3791664056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea88003980 0x7fea88003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:04.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea9b7fe640 1 -- 172.21.15.5:0/3791664056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea9c0ce0f0 msgr2=0x7fea880047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:04.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea9b7fe640 1 --2- 172.21.15.5:0/3791664056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea9c0ce0f0 0x7fea880047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:04.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea9b7fe640 1 -- 172.21.15.5:0/3791664056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea88003980 msgr2=0x7fea88003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:04.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea9b7fe640 1 --2- 172.21.15.5:0/3791664056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea88003980 0x7fea88003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:04.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea9b7fe640 1 -- 172.21.15.5:0/3791664056 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea88003530 con 0x7fea88004d10 2023-07-14T13:09:04.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.571+0000 7fea9affd640 1 --2- 172.21.15.5:0/3791664056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea88003980 0x7fea88003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:04.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.575+0000 7fea9b7fe640 1 --2- 172.21.15.5:0/3791664056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea88004d10 0x7fea88005180 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fea94009fc0 tx=0x7fea9401cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab89cd811a01276f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:04.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.575+0000 7fea9a7fc640 1 -- 172.21.15.5:0/3791664056 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea940a5c70 con 0x7fea88004d10 2023-07-14T13:09:04.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.575+0000 7fea9a7fc640 1 -- 172.21.15.5:0/3791664056 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9400f040 con 0x7fea88004d10 2023-07-14T13:09:04.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.575+0000 7fea9a7fc640 1 -- 172.21.15.5:0/3791664056 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea940ad440 con 0x7fea88004d10 2023-07-14T13:09:04.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.575+0000 7feaa1574640 1 -- 172.21.15.5:0/3791664056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea88004d10 msgr2=0x7fea88005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:04.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.575+0000 7feaa1574640 1 --2- 172.21.15.5:0/3791664056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea88004d10 0x7fea88005180 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fea94009fc0 tx=0x7fea9401cc00 comp rx=0 tx=0).stop 2023-07-14T13:09:04.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.575+0000 7fea9b7fe640 1 -- 172.21.15.5:0/3791664056 reap_dead start 2023-07-14T13:09:04.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.575+0000 7feaa1574640 1 -- 172.21.15.5:0/3791664056 shutdown_connections 2023-07-14T13:09:04.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.575+0000 7feaa1574640 1 -- 172.21.15.5:0/3791664056 >> 172.21.15.5:0/3791664056 conn(0x7fea9c0659d0 msgr2=0x7fea9c099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:04.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.575+0000 7feaa1574640 1 -- 172.21.15.5:0/3791664056 shutdown_connections 2023-07-14T13:09:04.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.575+0000 7feaa1574640 1 -- 172.21.15.5:0/3791664056 wait complete. 2023-07-14T13:09:04.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.575+0000 7feaa1574640 1 Processor -- start 2023-07-14T13:09:04.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.575+0000 7feaa1574640 1 -- start start 2023-07-14T13:09:04.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.579+0000 7feaa1574640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea88004d10 0x7fea9c0b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:04.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.579+0000 7feaa1574640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea9c152550 0x7fea9c1529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:04.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.579+0000 7feaa1574640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea9c0cc0e0 0x7fea9c0cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:04.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.579+0000 7feaa1574640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c1f2470 con 0x7fea9c0cc0e0 2023-07-14T13:09:04.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.579+0000 7feaa1574640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0b0d10 con 0x7fea9c152550 2023-07-14T13:09:04.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.579+0000 7feaa1574640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c152f00 con 0x7fea88004d10 2023-07-14T13:09:04.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.579+0000 7fea9b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea9c0cc0e0 0x7fea9c0cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:04.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.579+0000 7fea9b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea9c0cc0e0 0x7fea9c0cc560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57740/0 (socket says 172.21.15.5:57740) 2023-07-14T13:09:04.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.579+0000 7fea9b7fe640 1 -- 172.21.15.5:0/3054560445 learned_addr learned my addr 172.21.15.5:0/3054560445 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:04.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.579+0000 7fea9affd640 1 --2- 172.21.15.5:0/3054560445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea88004d10 0x7fea9c0b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.579+0000 7fea93fff640 1 --2- 172.21.15.5:0/3054560445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea9c152550 0x7fea9c1529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.579+0000 7fea9b7fe640 1 -- 172.21.15.5:0/3054560445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea88004d10 msgr2=0x7fea9c0b07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.579+0000 7fea9b7fe640 1 --2- 172.21.15.5:0/3054560445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea88004d10 0x7fea9c0b07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.579+0000 7fea9b7fe640 1 -- 172.21.15.5:0/3054560445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea9c152550 msgr2=0x7fea9c1529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.579+0000 7fea9b7fe640 1 --2- 172.21.15.5:0/3054560445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea9c152550 0x7fea9c1529c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.579+0000 7fea9b7fe640 1 -- 172.21.15.5:0/3054560445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c1f2190 con 0x7fea9c0cc0e0 2023-07-14T13:09:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.579+0000 7fea9b7fe640 1 --2- 172.21.15.5:0/3054560445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea9c0cc0e0 0x7fea9c0cc560 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fea94002240 tx=0x7fea94009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:04.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.579+0000 7fea937fe640 1 -- 172.21.15.5:0/3054560445 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea940bc070 con 0x7fea9c0cc0e0 2023-07-14T13:09:04.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.579+0000 7fea937fe640 1 -- 172.21.15.5:0/3054560445 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea940039a0 con 0x7fea9c0cc0e0 2023-07-14T13:09:04.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.579+0000 7feaa1574640 1 -- 172.21.15.5:0/3054560445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea9c0afcf0 con 0x7fea9c0cc0e0 2023-07-14T13:09:04.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.579+0000 7fea937fe640 1 -- 172.21.15.5:0/3054560445 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea94003b30 con 0x7fea9c0cc0e0 2023-07-14T13:09:04.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.579+0000 7feaa1574640 1 -- 172.21.15.5:0/3054560445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9c0b02b0 con 0x7fea9c0cc0e0 2023-07-14T13:09:04.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.579+0000 7feaa1574640 1 -- 172.21.15.5:0/3054560445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea9c0afb50 con 0x7fea9c0cc0e0 2023-07-14T13:09:04.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.579+0000 7fea937fe640 1 -- 172.21.15.5:0/3054560445 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fea940b4040 con 0x7fea9c0cc0e0 2023-07-14T13:09:04.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.583+0000 7fea937fe640 1 --2- 172.21.15.5:0/3054560445 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fea7c0663a0 0x7fea7c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:04.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.583+0000 7fea937fe640 1 -- 172.21.15.5:0/3054560445 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fea9411dd10 con 0x7fea9c0cc0e0 2023-07-14T13:09:04.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.583+0000 7fea9affd640 1 --2- 172.21.15.5:0/3054560445 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fea7c0663a0 0x7fea7c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:04.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.583+0000 7fea9affd640 1 --2- 172.21.15.5:0/3054560445 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fea7c0663a0 0x7fea7c068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0010f0 tx=0x7fea8c009040 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:04.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.587+0000 7fea937fe640 1 -- 172.21.15.5:0/3054560445 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fea9c0afb50 con 0x7fea9c0cc0e0 2023-07-14T13:09:04.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.799+0000 7feaa1574640 1 -- 172.21.15.5:0/3054560445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fea9c0afb50 con 0x7fea9c0cc0e0 2023-07-14T13:09:04.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.799+0000 7fea937fe640 1 -- 172.21.15.5:0/3054560445 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fea9c0afb50 con 0x7fea9c0cc0e0 2023-07-14T13:09:04.830 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:04.830 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T13:09:04.831 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2023-07-14T13:09:04.831 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:04.831 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2023-07-14T13:09:04.831 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkGNTsMRAA5T/zjdynxEKmoNAAK0cChw==", 2023-07-14T13:09:04.831 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:04.831 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:09:04.831 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:09:04.832 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:09:04.832 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:04.832 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:04.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:04.832 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:04.832 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2023-07-14T13:09:04.832 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkqXNAAxAAb7bzXyE8cSS0A3Rz2de6TA==", 2023-07-14T13:09:04.832 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:04.833 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:09:04.833 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:09:04.833 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:09:04.833 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:04.833 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:04.833 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:04.833 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:04.834 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2023-07-14T13:09:04.834 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFk6NGUORAA+5odxrAlCCXYGc64nzFWwQ==", 2023-07-14T13:09:04.834 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:04.834 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:09:04.834 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:09:04.834 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:09:04.834 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:04.834 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:04.835 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:04.835 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:04.835 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2023-07-14T13:09:04.835 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkGh/BChAA5p9amLIC6ORC0JJov0bSVg==", 2023-07-14T13:09:04.835 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:04.835 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:09:04.835 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:09:04.835 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:09:04.836 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:04.836 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:04.836 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:04.836 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:04.836 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2023-07-14T13:09:04.836 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDlRLFkJ6MULhAAxExAqekc/gWudYBJ2sY4MQ==", 2023-07-14T13:09:04.836 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:04.837 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:09:04.837 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:09:04.837 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:04.837 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:04.837 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:04.837 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:04.837 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2023-07-14T13:09:04.837 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDoRLFksXGBNRAAFtHZt5OQw0aB6k3CkxOzZQ==", 2023-07-14T13:09:04.838 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:04.838 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:09:04.838 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:09:04.838 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:04.838 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:04.838 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:04.838 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:04.838 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2023-07-14T13:09:04.839 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDsRLFkaUH0ARAAkqgsKPX1dTSZQjn0cRxxRQ==", 2023-07-14T13:09:04.839 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:04.839 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:09:04.839 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:09:04.839 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:04.839 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:04.839 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:04.839 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:04.840 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2023-07-14T13:09:04.840 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDvRLFkvElJCRAAnox5LKwobP/1Qaf5d9UsjA==", 2023-07-14T13:09:04.840 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:04.840 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:09:04.840 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:09:04.840 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:04.840 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:04.840 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:04.841 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:04.841 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2023-07-14T13:09:04.841 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD1RLFkMNyyDxAA19dJkhhuSpcgVPQEyxb3lg==", 2023-07-14T13:09:04.841 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:04.841 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:09:04.841 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:09:04.841 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:04.842 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:04.842 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:04.842 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:04.842 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2023-07-14T13:09:04.842 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD4RLFkR8mTFhAAP5qUgUJI23XOvVAnNCSgRQ==", 2023-07-14T13:09:04.842 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:04.842 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:09:04.842 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:09:04.843 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:04.843 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:04.843 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:04.843 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:04.843 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2023-07-14T13:09:04.843 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD7RLFkpWL9HBAAo8MfszRnB4sHsDPPcRjCAg==", 2023-07-14T13:09:04.843 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:04.843 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:09:04.844 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:09:04.844 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:04.844 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:04.844 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:04.844 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:04.844 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2023-07-14T13:09:04.844 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD+RLFkL5cRIxAAF/4ndtYf0oiH3uhhDKnQQg==", 2023-07-14T13:09:04.844 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:04.845 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:09:04.845 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:09:04.845 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:04.845 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:04.845 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:04.845 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:04.845 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2023-07-14T13:09:04.845 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkCav/DhAA6SOiONAbTcWCnUZXcm7BcQ==", 2023-07-14T13:09:04.846 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:04.846 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:09:04.846 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2023-07-14T13:09:04.846 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-14T13:09:04.846 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:04.846 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:04.846 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:04.847 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2023-07-14T13:09:04.847 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkgS/hGBAAevMD2/lfNuaeV74w0Xj0Zw==", 2023-07-14T13:09:04.847 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:04.847 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:09:04.847 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T13:09:04.847 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T13:09:04.847 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T13:09:04.847 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:04.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:04.848 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:04.848 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2023-07-14T13:09:04.848 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkeBs4FRAAJ/UjIEKDajVyDb7PejPqAw==", 2023-07-14T13:09:04.848 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:04.848 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:09:04.848 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T13:09:04.849 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T13:09:04.849 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T13:09:04.849 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:04.849 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:04.849 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:04.849 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2023-07-14T13:09:04.849 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkSkDiHhAAV86wIrAVz3o/PI2CaBC44w==", 2023-07-14T13:09:04.849 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:04.850 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:09:04.850 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T13:09:04.850 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T13:09:04.850 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T13:09:04.850 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:04.850 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:04.850 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:04.850 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2023-07-14T13:09:04.851 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkk5IcFRAAThI0P1N8LsRetmwhHqSvdQ==", 2023-07-14T13:09:04.851 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:04.851 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T13:09:04.851 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:09:04.851 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:09:04.851 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:04.851 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:04.851 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:04.852 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:04.852 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2023-07-14T13:09:04.852 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkugeXLRAAEVAnLk/dldtqrpkdzQI3SA==", 2023-07-14T13:09:04.852 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:04.852 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T13:09:04.852 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-07-14T13:09:04.852 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:04.852 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:04.853 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:04.853 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:04.853 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2023-07-14T13:09:04.853 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkSvp/KRAAwvjYlrZYNeGbhCiDrTmnrA==", 2023-07-14T13:09:04.853 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:04.853 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T13:09:04.853 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-07-14T13:09:04.854 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:04.854 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:04.854 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:04.854 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-07-14T13:09:04.854 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T13:09:04.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.799+0000 7feaa1574640 1 -- 172.21.15.5:0/3054560445 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fea7c0663a0 msgr2=0x7fea7c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:04.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.799+0000 7feaa1574640 1 --2- 172.21.15.5:0/3054560445 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fea7c0663a0 0x7fea7c068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0010f0 tx=0x7fea8c009040 comp rx=0 tx=0).stop 2023-07-14T13:09:04.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.799+0000 7feaa1574640 1 -- 172.21.15.5:0/3054560445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea9c0cc0e0 msgr2=0x7fea9c0cc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:04.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.799+0000 7feaa1574640 1 --2- 172.21.15.5:0/3054560445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea9c0cc0e0 0x7fea9c0cc560 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fea94002240 tx=0x7fea94009750 comp rx=0 tx=0).stop 2023-07-14T13:09:04.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.799+0000 7feaa1574640 1 -- 172.21.15.5:0/3054560445 shutdown_connections 2023-07-14T13:09:04.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.799+0000 7feaa1574640 1 --2- 172.21.15.5:0/3054560445 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fea7c0663a0 0x7fea7c068850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:04.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.799+0000 7feaa1574640 1 --2- 172.21.15.5:0/3054560445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea9c0cc0e0 0x7fea9c0cc560 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:04.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.799+0000 7feaa1574640 1 --2- 172.21.15.5:0/3054560445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea9c152550 0x7fea9c1529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:04.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.799+0000 7feaa1574640 1 --2- 172.21.15.5:0/3054560445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea88004d10 0x7fea9c0b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:04.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.799+0000 7feaa1574640 1 -- 172.21.15.5:0/3054560445 >> 172.21.15.5:0/3054560445 conn(0x7fea9c0659d0 msgr2=0x7fea9c0ce4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:04.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.803+0000 7feaa1574640 1 -- 172.21.15.5:0/3054560445 shutdown_connections 2023-07-14T13:09:04.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.803+0000 7feaa1574640 1 -- 172.21.15.5:0/3054560445 wait complete. 2023-07-14T13:09:04.857 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:09:05.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.971+0000 7f39e36ca640 1 Processor -- start 2023-07-14T13:09:05.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.971+0000 7f39e36ca640 1 -- start start 2023-07-14T13:09:05.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.971+0000 7f39e36ca640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f39dc158ce0 0x7f39dc070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:05.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.971+0000 7f39e36ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39dc0c8ad0 0x7f39dc0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:05.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.971+0000 7f39e36ca640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39dc0cc700 con 0x7f39dc0c9560 2023-07-14T13:09:05.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.971+0000 7f39e36ca640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39dc0c99e0 con 0x7f39dc158ce0 2023-07-14T13:09:05.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.971+0000 7f39e36ca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc0b0ff0 con 0x7f39dc0c8ad0 2023-07-14T13:09:05.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.971+0000 7f39e1466640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f39dc158ce0 0x7f39dc070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:05.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.971+0000 7f39e1466640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f39dc158ce0 0x7f39dc070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57742/0 (socket says 172.21.15.5:57742) 2023-07-14T13:09:05.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.971+0000 7f39e1466640 1 -- 172.21.15.5:0/2062104049 learned_addr learned my addr 172.21.15.5:0/2062104049 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:05.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.971+0000 7f39e1c67640 1 --1- 172.21.15.5:0/2062104049 >> v1:172.21.15.5:6789/0 conn(0x7f39dc0c9560 0x7f39dc0cab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46448/0 (socket says 172.21.15.5:46448) 2023-07-14T13:09:05.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.971+0000 7f39e0c65640 1 --2- 172.21.15.5:0/2062104049 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39dc0c8ad0 0x7f39dc0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:05.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.971+0000 7f39e1466640 1 -- 172.21.15.5:0/2062104049 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39dc0c8ad0 msgr2=0x7f39dc0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:05.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.971+0000 7f39e1466640 1 --2- 172.21.15.5:0/2062104049 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39dc0c8ad0 0x7f39dc0c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.971+0000 7f39e1466640 1 -- 172.21.15.5:0/2062104049 >> v1:172.21.15.5:6789/0 conn(0x7f39dc0c9560 legacy=0x7f39dc0cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:05.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.971+0000 7f39d3fff640 1 -- 172.21.15.5:0/2062104049 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 118458046 0 0) 0x7f39dc0cc700 con 0x7f39dc0c9560 2023-07-14T13:09:05.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.971+0000 7f39e1466640 1 -- 172.21.15.5:0/2062104049 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39dc070c80 con 0x7f39dc158ce0 2023-07-14T13:09:05.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.975+0000 7f39e1466640 1 --2- 172.21.15.5:0/2062104049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39dc158ce0 0x7f39dc070450 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f39d8009870 tx=0x7f39d801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8410ae6b36157ef0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:05.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.975+0000 7f39d3fff640 1 -- 172.21.15.5:0/2062104049 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc0cba20 con 0x7f39dc158ce0 2023-07-14T13:09:05.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.975+0000 7f39d3fff640 1 -- 172.21.15.5:0/2062104049 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d80a7050 con 0x7f39dc158ce0 2023-07-14T13:09:05.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.975+0000 7f39d3fff640 1 -- 172.21.15.5:0/2062104049 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d80ab820 con 0x7f39dc158ce0 2023-07-14T13:09:05.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.975+0000 7f39e36ca640 1 -- 172.21.15.5:0/2062104049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39dc158ce0 msgr2=0x7f39dc070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:05.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.975+0000 7f39e36ca640 1 --2- 172.21.15.5:0/2062104049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39dc158ce0 0x7f39dc070450 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f39d8009870 tx=0x7f39d801c3f0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.975+0000 7f39e36ca640 1 -- 172.21.15.5:0/2062104049 shutdown_connections 2023-07-14T13:09:05.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.975+0000 7f39e36ca640 1 --2- 172.21.15.5:0/2062104049 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39dc0c8ad0 0x7f39dc0c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.975+0000 7f39e36ca640 1 --2- 172.21.15.5:0/2062104049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39dc158ce0 0x7f39dc070450 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.975+0000 7f39e36ca640 1 -- 172.21.15.5:0/2062104049 >> 172.21.15.5:0/2062104049 conn(0x7f39dc0afcf0 msgr2=0x7f39dc0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:05.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.975+0000 7f39e36ca640 1 -- 172.21.15.5:0/2062104049 shutdown_connections 2023-07-14T13:09:05.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.975+0000 7f39e36ca640 1 -- 172.21.15.5:0/2062104049 wait complete. 2023-07-14T13:09:05.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.979+0000 7f39e36ca640 1 Processor -- start 2023-07-14T13:09:05.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.979+0000 7f39e36ca640 1 -- start start 2023-07-14T13:09:05.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.979+0000 7f39e36ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39dc0c8ad0 0x7f39dc1f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:05.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.979+0000 7f39e36ca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39dc0c9560 0x7f39dc1f5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:05.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.979+0000 7f39e36ca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39dc158ce0 0x7f39dc14e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:05.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.979+0000 7f39e36ca640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc0c52c0 con 0x7f39dc0c9560 2023-07-14T13:09:05.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.979+0000 7f39e36ca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc1f7dc0 con 0x7f39dc158ce0 2023-07-14T13:09:05.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.979+0000 7f39e36ca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc1f80a0 con 0x7f39dc0c8ad0 2023-07-14T13:09:05.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.979+0000 7f39e0c65640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39dc0c9560 0x7f39dc1f5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:05.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.979+0000 7f39e0c65640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39dc0c9560 0x7f39dc1f5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57752/0 (socket says 172.21.15.5:57752) 2023-07-14T13:09:05.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.979+0000 7f39e0c65640 1 -- 172.21.15.5:0/1789105012 learned_addr learned my addr 172.21.15.5:0/1789105012 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:05.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.979+0000 7f39e1466640 1 --2- 172.21.15.5:0/1789105012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39dc0c8ad0 0x7f39dc1f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:05.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.979+0000 7f39e1c67640 1 --2- 172.21.15.5:0/1789105012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39dc158ce0 0x7f39dc14e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:05.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.979+0000 7f39e0c65640 1 -- 172.21.15.5:0/1789105012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39dc0c8ad0 msgr2=0x7f39dc1f4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:05.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.979+0000 7f39e0c65640 1 --2- 172.21.15.5:0/1789105012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39dc0c8ad0 0x7f39dc1f4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.979+0000 7f39e0c65640 1 -- 172.21.15.5:0/1789105012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39dc158ce0 msgr2=0x7f39dc14e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:05.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.979+0000 7f39e0c65640 1 --2- 172.21.15.5:0/1789105012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39dc158ce0 0x7f39dc14e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.979+0000 7f39e0c65640 1 -- 172.21.15.5:0/1789105012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d80094d0 con 0x7f39dc0c9560 2023-07-14T13:09:05.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.979+0000 7f39e0c65640 1 --2- 172.21.15.5:0/1789105012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39dc0c9560 0x7f39dc1f5440 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00d5f0 tx=0x7f39cc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:05.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.979+0000 7f39d1ffb640 1 -- 172.21.15.5:0/1789105012 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39cc0125f0 con 0x7f39dc0c9560 2023-07-14T13:09:05.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.979+0000 7f39d1ffb640 1 -- 172.21.15.5:0/1789105012 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39cc012750 con 0x7f39dc0c9560 2023-07-14T13:09:05.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.979+0000 7f39d1ffb640 1 -- 172.21.15.5:0/1789105012 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39cc012ae0 con 0x7f39dc0c9560 2023-07-14T13:09:05.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.979+0000 7f39e36ca640 1 -- 172.21.15.5:0/1789105012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39dc1f8380 con 0x7f39dc0c9560 2023-07-14T13:09:05.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.979+0000 7f39e36ca640 1 -- 172.21.15.5:0/1789105012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39dc1f5980 con 0x7f39dc0c9560 2023-07-14T13:09:05.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.983+0000 7f39e36ca640 1 -- 172.21.15.5:0/1789105012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39dc0ca1a0 con 0x7f39dc0c9560 2023-07-14T13:09:05.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.983+0000 7f39d1ffb640 1 -- 172.21.15.5:0/1789105012 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f39cc012c40 con 0x7f39dc0c9560 2023-07-14T13:09:05.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.983+0000 7f39d1ffb640 1 --2- 172.21.15.5:0/1789105012 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f39c00663d0 0x7f39c0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:05.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.983+0000 7f39d1ffb640 1 -- 172.21.15.5:0/1789105012 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f39cc083fe0 con 0x7f39dc0c9560 2023-07-14T13:09:05.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.983+0000 7f39e1466640 1 --2- 172.21.15.5:0/1789105012 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f39c00663d0 0x7f39c0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:05.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.983+0000 7f39e1466640 1 --2- 172.21.15.5:0/1789105012 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f39c00663d0 0x7f39c0068880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f39d80ad000 tx=0x7f39d80a4f90 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:05.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:04.987+0000 7f39d1ffb640 1 -- 172.21.15.5:0/1789105012 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f39cc0516b0 con 0x7f39dc0c9560 2023-07-14T13:09:05.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.147+0000 7f39e36ca640 1 -- 172.21.15.5:0/1789105012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39dc0678d0 con 0x7f39dc0c9560 2023-07-14T13:09:05.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.147+0000 7f39d1ffb640 1 -- 172.21.15.5:0/1789105012 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+14592 (secure 0 0 0) 0x7f39cc007380 con 0x7f39dc0c9560 2023-07-14T13:09:05.177 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:05.178 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":93,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:09:04.389210+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:09:05.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.147+0000 7f39e36ca640 1 -- 172.21.15.5:0/1789105012 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f39c00663d0 msgr2=0x7f39c0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:05.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.147+0000 7f39e36ca640 1 --2- 172.21.15.5:0/1789105012 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f39c00663d0 0x7f39c0068880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f39d80ad000 tx=0x7f39d80a4f90 comp rx=0 tx=0).stop 2023-07-14T13:09:05.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.147+0000 7f39e36ca640 1 -- 172.21.15.5:0/1789105012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39dc0c9560 msgr2=0x7f39dc1f5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:05.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.147+0000 7f39e36ca640 1 --2- 172.21.15.5:0/1789105012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39dc0c9560 0x7f39dc1f5440 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00d5f0 tx=0x7f39cc00dab0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.147+0000 7f39e36ca640 1 -- 172.21.15.5:0/1789105012 shutdown_connections 2023-07-14T13:09:05.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.147+0000 7f39e36ca640 1 --2- 172.21.15.5:0/1789105012 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f39c00663d0 0x7f39c0068880 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.147+0000 7f39e36ca640 1 --2- 172.21.15.5:0/1789105012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39dc158ce0 0x7f39dc14e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.147+0000 7f39e36ca640 1 --2- 172.21.15.5:0/1789105012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39dc0c9560 0x7f39dc1f5440 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.147+0000 7f39e36ca640 1 --2- 172.21.15.5:0/1789105012 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39dc0c8ad0 0x7f39dc1f4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.147+0000 7f39e36ca640 1 -- 172.21.15.5:0/1789105012 >> 172.21.15.5:0/1789105012 conn(0x7f39dc0afcf0 msgr2=0x7f39dc0ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:05.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.147+0000 7f39e36ca640 1 -- 172.21.15.5:0/1789105012 shutdown_connections 2023-07-14T13:09:05.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.147+0000 7f39e36ca640 1 -- 172.21.15.5:0/1789105012 wait complete. 2023-07-14T13:09:05.199 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:09:05.200 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:09:05.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.319+0000 7ff76b5d2640 1 Processor -- start 2023-07-14T13:09:05.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.319+0000 7ff76b5d2640 1 -- start start 2023-07-14T13:09:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.319+0000 7ff76b5d2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7640b1fa0 0x7ff76406a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.319+0000 7ff76b5d2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7641594f0 con 0x7ff76406b8c0 2023-07-14T13:09:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.319+0000 7ff76b5d2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff764158970 con 0x7ff764155c60 2023-07-14T13:09:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.319+0000 7ff76b5d2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7640ae250 con 0x7ff7640b1fa0 2023-07-14T13:09:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.319+0000 7ff769b6f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7640b1fa0 0x7ff76406a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:05.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.319+0000 7ff768b6d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff76406b8c0 0x7ff7640b1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46462/0 (socket says 172.21.15.5:46462) 2023-07-14T13:09:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.319+0000 7ff768b6d640 1 -- 172.21.15.5:0/3916356286 learned_addr learned my addr 172.21.15.5:0/3916356286 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.319+0000 7ff769b6f640 1 -- 172.21.15.5:0/3916356286 >> v1:172.21.15.154:6789/0 conn(0x7ff764155c60 legacy=0x7ff7640adb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.319+0000 7ff769b6f640 1 -- 172.21.15.5:0/3916356286 >> v1:172.21.15.5:6789/0 conn(0x7ff76406b8c0 legacy=0x7ff7640b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:05.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.319+0000 7ff769b6f640 1 -- 172.21.15.5:0/3916356286 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff764158c50 con 0x7ff7640b1fa0 2023-07-14T13:09:05.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.319+0000 7ff75bfff640 1 -- 172.21.15.5:0/3916356286 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 428186396 0 0) 0x7ff7641594f0 con 0x7ff76406b8c0 2023-07-14T13:09:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.323+0000 7ff769b6f640 1 --2- 172.21.15.5:0/3916356286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7640b1fa0 0x7ff76406a0f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00aea0 tx=0x7ff75c01da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e9c3345c770961 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:05.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.323+0000 7ff75bfff640 1 -- 172.21.15.5:0/3916356286 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c00a2d0 con 0x7ff7640b1fa0 2023-07-14T13:09:05.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.323+0000 7ff75bfff640 1 -- 172.21.15.5:0/3916356286 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75c0a66b0 con 0x7ff7640b1fa0 2023-07-14T13:09:05.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.323+0000 7ff75bfff640 1 -- 172.21.15.5:0/3916356286 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c0a6a40 con 0x7ff7640b1fa0 2023-07-14T13:09:05.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.323+0000 7ff76b5d2640 1 -- 172.21.15.5:0/3916356286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7640b1fa0 msgr2=0x7ff76406a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.323+0000 7ff76b5d2640 1 --2- 172.21.15.5:0/3916356286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7640b1fa0 0x7ff76406a0f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00aea0 tx=0x7ff75c01da50 comp rx=0 tx=0).stop 2023-07-14T13:09:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.323+0000 7ff76b5d2640 1 -- 172.21.15.5:0/3916356286 shutdown_connections 2023-07-14T13:09:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.323+0000 7ff76b5d2640 1 --2- 172.21.15.5:0/3916356286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7640b1fa0 0x7ff76406a0f0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.323+0000 7ff76b5d2640 1 -- 172.21.15.5:0/3916356286 >> 172.21.15.5:0/3916356286 conn(0x7ff7640b1210 msgr2=0x7ff7640ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.323+0000 7ff76b5d2640 1 -- 172.21.15.5:0/3916356286 shutdown_connections 2023-07-14T13:09:05.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.323+0000 7ff76b5d2640 1 -- 172.21.15.5:0/3916356286 wait complete. 2023-07-14T13:09:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.327+0000 7ff76b5d2640 1 Processor -- start 2023-07-14T13:09:05.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.327+0000 7ff76b5d2640 1 -- start start 2023-07-14T13:09:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.327+0000 7ff76b5d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff76406b8c0 0x7ff7641403a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.327+0000 7ff76b5d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7640b1fa0 0x7ff7640afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:05.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.327+0000 7ff76b5d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff764155c60 0x7ff76414fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.327+0000 7ff76b5d2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff764150220 con 0x7ff764155c60 2023-07-14T13:09:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.327+0000 7ff76b5d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7641504a0 con 0x7ff7640b1fa0 2023-07-14T13:09:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.327+0000 7ff76b5d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76415a270 con 0x7ff76406b8c0 2023-07-14T13:09:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.327+0000 7ff769b6f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff764155c60 0x7ff76414fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.327+0000 7ff769b6f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff764155c60 0x7ff76414fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57782/0 (socket says 172.21.15.5:57782) 2023-07-14T13:09:05.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.327+0000 7ff769b6f640 1 -- 172.21.15.5:0/100411475 learned_addr learned my addr 172.21.15.5:0/100411475 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:05.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.327+0000 7ff768b6d640 1 --2- 172.21.15.5:0/100411475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7640b1fa0 0x7ff7640afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.327+0000 7ff76936e640 1 --2- 172.21.15.5:0/100411475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff76406b8c0 0x7ff7641403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.327+0000 7ff769b6f640 1 -- 172.21.15.5:0/100411475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff76406b8c0 msgr2=0x7ff7641403a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.327+0000 7ff769b6f640 1 --2- 172.21.15.5:0/100411475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff76406b8c0 0x7ff7641403a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.327+0000 7ff769b6f640 1 -- 172.21.15.5:0/100411475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7640b1fa0 msgr2=0x7ff7640afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.327+0000 7ff769b6f640 1 --2- 172.21.15.5:0/100411475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7640b1fa0 0x7ff7640afd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.327+0000 7ff769b6f640 1 -- 172.21.15.5:0/100411475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75c00ab80 con 0x7ff764155c60 2023-07-14T13:09:05.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.327+0000 7ff768b6d640 1 --2- 172.21.15.5:0/100411475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7640b1fa0 0x7ff7640afd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:05.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.327+0000 7ff769b6f640 1 --2- 172.21.15.5:0/100411475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff764155c60 0x7ff76414fce0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7ff75c0b0040 tx=0x7ff75c01a7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:05.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.327+0000 7ff759ffb640 1 -- 172.21.15.5:0/100411475 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c0039a0 con 0x7ff764155c60 2023-07-14T13:09:05.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.327+0000 7ff759ffb640 1 -- 172.21.15.5:0/100411475 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75c003b00 con 0x7ff764155c60 2023-07-14T13:09:05.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.327+0000 7ff759ffb640 1 -- 172.21.15.5:0/100411475 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c003e70 con 0x7ff764155c60 2023-07-14T13:09:05.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.327+0000 7ff76b5d2640 1 -- 172.21.15.5:0/100411475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff76415a550 con 0x7ff764155c60 2023-07-14T13:09:05.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.327+0000 7ff76b5d2640 1 -- 172.21.15.5:0/100411475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff764151950 con 0x7ff764155c60 2023-07-14T13:09:05.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.327+0000 7ff76b5d2640 1 -- 172.21.15.5:0/100411475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff76406bcb0 con 0x7ff764155c60 2023-07-14T13:09:05.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.331+0000 7ff759ffb640 1 -- 172.21.15.5:0/100411475 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff75c004020 con 0x7ff764155c60 2023-07-14T13:09:05.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.331+0000 7ff759ffb640 1 --2- 172.21.15.5:0/100411475 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7ff7480663d0 0x7ff748068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:05.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.331+0000 7ff759ffb640 1 -- 172.21.15.5:0/100411475 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff75c11e7d0 con 0x7ff764155c60 2023-07-14T13:09:05.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.331+0000 7ff76936e640 1 --2- 172.21.15.5:0/100411475 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7ff7480663d0 0x7ff748068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:05.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.331+0000 7ff76936e640 1 --2- 172.21.15.5:0/100411475 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7ff7480663d0 0x7ff748068880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff760000f70 tx=0x7ff760009040 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:05.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.335+0000 7ff759ffb640 1 -- 172.21.15.5:0/100411475 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff75c0ebe80 con 0x7ff764155c60 2023-07-14T13:09:05.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.491+0000 7ff76b5d2640 1 -- 172.21.15.5:0/100411475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff7640678d0 con 0x7ff764155c60 2023-07-14T13:09:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.491+0000 7ff759ffb640 1 -- 172.21.15.5:0/100411475 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff75c0ef4a0 con 0x7ff764155c60 2023-07-14T13:09:05.522 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:09:05.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.491+0000 7ff76b5d2640 1 -- 172.21.15.5:0/100411475 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7ff7480663d0 msgr2=0x7ff748068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:05.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.491+0000 7ff76b5d2640 1 --2- 172.21.15.5:0/100411475 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7ff7480663d0 0x7ff748068880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff760000f70 tx=0x7ff760009040 comp rx=0 tx=0).stop 2023-07-14T13:09:05.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.491+0000 7ff76b5d2640 1 -- 172.21.15.5:0/100411475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff764155c60 msgr2=0x7ff76414fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:05.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.491+0000 7ff76b5d2640 1 --2- 172.21.15.5:0/100411475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff764155c60 0x7ff76414fce0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7ff75c0b0040 tx=0x7ff75c01a7f0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.491+0000 7ff76b5d2640 1 -- 172.21.15.5:0/100411475 shutdown_connections 2023-07-14T13:09:05.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.491+0000 7ff76b5d2640 1 --2- 172.21.15.5:0/100411475 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7ff7480663d0 0x7ff748068880 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.491+0000 7ff76b5d2640 1 --2- 172.21.15.5:0/100411475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff764155c60 0x7ff76414fce0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.491+0000 7ff76b5d2640 1 --2- 172.21.15.5:0/100411475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7640b1fa0 0x7ff7640afd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.491+0000 7ff76b5d2640 1 --2- 172.21.15.5:0/100411475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff76406b8c0 0x7ff7641403a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.491+0000 7ff76b5d2640 1 -- 172.21.15.5:0/100411475 >> 172.21.15.5:0/100411475 conn(0x7ff7640b1210 msgr2=0x7ff7641561d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:05.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.491+0000 7ff76b5d2640 1 -- 172.21.15.5:0/100411475 shutdown_connections 2023-07-14T13:09:05.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.491+0000 7ff76b5d2640 1 -- 172.21.15.5:0/100411475 wait complete. 2023-07-14T13:09:05.543 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:09:05.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.659+0000 7ff27fd03640 1 Processor -- start 2023-07-14T13:09:05.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.659+0000 7ff27fd03640 1 -- start start 2023-07-14T13:09:05.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.659+0000 7ff27fd03640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff27815bde0 0x7ff2780d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:05.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.659+0000 7ff27fd03640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2780b04c0 con 0x7ff2780d2fc0 2023-07-14T13:09:05.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.659+0000 7ff27fd03640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2780b1060 con 0x7ff2780d2300 2023-07-14T13:09:05.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.659+0000 7ff27fd03640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27815c1b0 con 0x7ff27815bde0 2023-07-14T13:09:05.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.659+0000 7ff27d29e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff2780d2fc0 0x7ff2780b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46464/0 (socket says 172.21.15.5:46464) 2023-07-14T13:09:05.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.659+0000 7ff27d29e640 1 -- 172.21.15.5:0/1690579114 learned_addr learned my addr 172.21.15.5:0/1690579114 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:05.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.659+0000 7ff27da9f640 1 --2- 172.21.15.5:0/1690579114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff27815bde0 0x7ff2780d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:05.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.659+0000 7ff27ca9d640 1 -- 172.21.15.5:0/1690579114 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1846050563 0 0) 0x7ff2780b04c0 con 0x7ff2780d2fc0 2023-07-14T13:09:05.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.659+0000 7ff27ca9d640 1 -- 172.21.15.5:0/1690579114 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff264003530 con 0x7ff2780d2fc0 2023-07-14T13:09:05.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.659+0000 7ff27ca9d640 1 -- 172.21.15.5:0/1690579114 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3470758694 0 0) 0x7ff264003530 con 0x7ff2780d2fc0 2023-07-14T13:09:05.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.659+0000 7ff27ca9d640 1 -- 172.21.15.5:0/1690579114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff27815bde0 msgr2=0x7ff2780d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:05.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.659+0000 7ff27ca9d640 1 --2- 172.21.15.5:0/1690579114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff27815bde0 0x7ff2780d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.659+0000 7ff27ca9d640 1 -- 172.21.15.5:0/1690579114 >> v1:172.21.15.154:6789/0 conn(0x7ff2780d2300 legacy=0x7ff2780cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:05.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.659+0000 7ff27ca9d640 1 -- 172.21.15.5:0/1690579114 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2780d0aa0 con 0x7ff2780d2fc0 2023-07-14T13:09:05.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.659+0000 7ff27ca9d640 1 -- 172.21.15.5:0/1690579114 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7ff268001680 con 0x7ff2780d2fc0 2023-07-14T13:09:05.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.659+0000 7ff27ca9d640 1 -- 172.21.15.5:0/1690579114 >> v1:172.21.15.5:6789/0 conn(0x7ff2780d2fc0 legacy=0x7ff2780b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:05.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.659+0000 7ff27ca9d640 1 --2- 172.21.15.5:0/1690579114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2640039b0 0x7ff264003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:05.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.659+0000 7ff27ca9d640 1 --2- 172.21.15.5:0/1690579114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff27815bde0 0x7ff2640047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:05.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.659+0000 7ff27ca9d640 1 --2- 172.21.15.5:0/1690579114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff264004d10 0x7ff264005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:05.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.659+0000 7ff27ca9d640 1 -- 172.21.15.5:0/1690579114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27815c1b0 con 0x7ff2640039b0 2023-07-14T13:09:05.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.659+0000 7ff27ca9d640 1 -- 172.21.15.5:0/1690579114 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26400ba40 con 0x7ff264004d10 2023-07-14T13:09:05.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.659+0000 7ff27ca9d640 1 -- 172.21.15.5:0/1690579114 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26400bbd0 con 0x7ff27815bde0 2023-07-14T13:09:05.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.663+0000 7ff27da9f640 1 --2- 172.21.15.5:0/1690579114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2640039b0 0x7ff264003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:05.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.663+0000 7ff27d29e640 1 --2- 172.21.15.5:0/1690579114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff27815bde0 0x7ff2640047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:05.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.663+0000 7ff27e2a0640 1 --2- 172.21.15.5:0/1690579114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff264004d10 0x7ff264005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:05.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.663+0000 7ff27da9f640 1 -- 172.21.15.5:0/1690579114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff27815bde0 msgr2=0x7ff2640047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:05.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.663+0000 7ff27da9f640 1 --2- 172.21.15.5:0/1690579114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff27815bde0 0x7ff2640047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.663+0000 7ff27da9f640 1 -- 172.21.15.5:0/1690579114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff264004d10 msgr2=0x7ff264005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:05.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.663+0000 7ff27da9f640 1 --2- 172.21.15.5:0/1690579114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff264004d10 0x7ff264005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.663+0000 7ff27da9f640 1 -- 172.21.15.5:0/1690579114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff264003530 con 0x7ff2640039b0 2023-07-14T13:09:05.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.663+0000 7ff27da9f640 1 --2- 172.21.15.5:0/1690579114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2640039b0 0x7ff264003dc0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7ff274009ac0 tx=0x7ff27401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fbb846e00faf0c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:05.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.663+0000 7ff27ca9d640 1 -- 172.21.15.5:0/1690579114 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2740059a0 con 0x7ff2640039b0 2023-07-14T13:09:05.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.663+0000 7ff27ca9d640 1 -- 172.21.15.5:0/1690579114 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff274005b00 con 0x7ff2640039b0 2023-07-14T13:09:05.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.663+0000 7ff27ca9d640 1 -- 172.21.15.5:0/1690579114 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2740a5600 con 0x7ff2640039b0 2023-07-14T13:09:05.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.663+0000 7ff27fd03640 1 -- 172.21.15.5:0/1690579114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2640039b0 msgr2=0x7ff264003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:05.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.663+0000 7ff27fd03640 1 --2- 172.21.15.5:0/1690579114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2640039b0 0x7ff264003dc0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7ff274009ac0 tx=0x7ff27401ca30 comp rx=0 tx=0).stop 2023-07-14T13:09:05.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.667+0000 7ff27e2a0640 1 -- 172.21.15.5:0/1690579114 reap_dead start 2023-07-14T13:09:05.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.667+0000 7ff27fd03640 1 -- 172.21.15.5:0/1690579114 shutdown_connections 2023-07-14T13:09:05.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.667+0000 7ff27fd03640 1 -- 172.21.15.5:0/1690579114 >> 172.21.15.5:0/1690579114 conn(0x7ff2780659d0 msgr2=0x7ff27809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:05.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.667+0000 7ff27fd03640 1 -- 172.21.15.5:0/1690579114 shutdown_connections 2023-07-14T13:09:05.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.667+0000 7ff27fd03640 1 -- 172.21.15.5:0/1690579114 wait complete. 2023-07-14T13:09:05.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.667+0000 7ff27fd03640 1 Processor -- start 2023-07-14T13:09:05.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.667+0000 7ff27fd03640 1 -- start start 2023-07-14T13:09:05.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.667+0000 7ff27fd03640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2640039b0 0x7ff278158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:05.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.667+0000 7ff27fd03640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff27815e160 0x7ff27815e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:05.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.667+0000 7ff27fd03640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2780c7ad0 0x7ff2780c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:05.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.667+0000 7ff27fd03640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27815eb10 con 0x7ff27815e160 2023-07-14T13:09:05.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.667+0000 7ff27fd03640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff278158e60 con 0x7ff2640039b0 2023-07-14T13:09:05.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.667+0000 7ff27fd03640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2780c87c0 con 0x7ff2780c7ad0 2023-07-14T13:09:05.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.667+0000 7ff27d29e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff27815e160 0x7ff27815e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:05.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.667+0000 7ff27d29e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff27815e160 0x7ff27815e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57806/0 (socket says 172.21.15.5:57806) 2023-07-14T13:09:05.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.667+0000 7ff27d29e640 1 -- 172.21.15.5:0/3001296427 learned_addr learned my addr 172.21.15.5:0/3001296427 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:05.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.667+0000 7ff27da9f640 1 --2- 172.21.15.5:0/3001296427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2640039b0 0x7ff278158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:05.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.667+0000 7ff27e2a0640 1 --2- 172.21.15.5:0/3001296427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2780c7ad0 0x7ff2780c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:05.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.667+0000 7ff27d29e640 1 -- 172.21.15.5:0/3001296427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2780c7ad0 msgr2=0x7ff2780c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:05.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.667+0000 7ff27d29e640 1 --2- 172.21.15.5:0/3001296427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2780c7ad0 0x7ff2780c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.667+0000 7ff27d29e640 1 -- 172.21.15.5:0/3001296427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2640039b0 msgr2=0x7ff278158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:05.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.667+0000 7ff27d29e640 1 --2- 172.21.15.5:0/3001296427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2640039b0 0x7ff278158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.667+0000 7ff27d29e640 1 -- 172.21.15.5:0/3001296427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2780c8aa0 con 0x7ff27815e160 2023-07-14T13:09:05.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.671+0000 7ff27d29e640 1 --2- 172.21.15.5:0/3001296427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff27815e160 0x7ff27815e5d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7ff268005fd0 tx=0x7ff26800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:05.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.671+0000 7ff26e7fc640 1 -- 172.21.15.5:0/3001296427 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26800c8d0 con 0x7ff27815e160 2023-07-14T13:09:05.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.671+0000 7ff26e7fc640 1 -- 172.21.15.5:0/3001296427 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26800ca30 con 0x7ff27815e160 2023-07-14T13:09:05.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.671+0000 7ff26e7fc640 1 -- 172.21.15.5:0/3001296427 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26800cdc0 con 0x7ff27815e160 2023-07-14T13:09:05.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.671+0000 7ff27fd03640 1 -- 172.21.15.5:0/3001296427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2780c8d80 con 0x7ff27815e160 2023-07-14T13:09:05.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.671+0000 7ff27fd03640 1 -- 172.21.15.5:0/3001296427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2780b5520 con 0x7ff27815e160 2023-07-14T13:09:05.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.671+0000 7ff27fd03640 1 -- 172.21.15.5:0/3001296427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2780678d0 con 0x7ff27815e160 2023-07-14T13:09:05.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.671+0000 7ff26e7fc640 1 -- 172.21.15.5:0/3001296427 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff26801d460 con 0x7ff27815e160 2023-07-14T13:09:05.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.671+0000 7ff26e7fc640 1 --2- 172.21.15.5:0/3001296427 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7ff25c0663a0 0x7ff25c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:05.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.671+0000 7ff26e7fc640 1 -- 172.21.15.5:0/3001296427 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff268083a40 con 0x7ff27815e160 2023-07-14T13:09:05.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.671+0000 7ff27da9f640 1 --2- 172.21.15.5:0/3001296427 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7ff25c0663a0 0x7ff25c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:05.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.675+0000 7ff27da9f640 1 --2- 172.21.15.5:0/3001296427 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7ff25c0663a0 0x7ff25c068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff2740ae000 tx=0x7ff2740046d0 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:05.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.675+0000 7ff26e7fc640 1 -- 172.21.15.5:0/3001296427 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff2680511a0 con 0x7ff27815e160 2023-07-14T13:09:05.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.831+0000 7ff27fd03640 1 -- 172.21.15.5:0/3001296427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff278159cf0 con 0x7ff27815e160 2023-07-14T13:09:05.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.835+0000 7ff26e7fc640 1 -- 172.21.15.5:0/3001296427 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v93) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff2680547c0 con 0x7ff27815e160 2023-07-14T13:09:05.865 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:09:05.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.835+0000 7ff27fd03640 1 -- 172.21.15.5:0/3001296427 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7ff25c0663a0 msgr2=0x7ff25c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:05.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.835+0000 7ff27fd03640 1 --2- 172.21.15.5:0/3001296427 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7ff25c0663a0 0x7ff25c068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff2740ae000 tx=0x7ff2740046d0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.835+0000 7ff27fd03640 1 -- 172.21.15.5:0/3001296427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff27815e160 msgr2=0x7ff27815e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:05.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.835+0000 7ff27fd03640 1 --2- 172.21.15.5:0/3001296427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff27815e160 0x7ff27815e5d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7ff268005fd0 tx=0x7ff26800ec80 comp rx=0 tx=0).stop 2023-07-14T13:09:05.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.835+0000 7ff27fd03640 1 -- 172.21.15.5:0/3001296427 shutdown_connections 2023-07-14T13:09:05.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.835+0000 7ff27fd03640 1 --2- 172.21.15.5:0/3001296427 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7ff25c0663a0 0x7ff25c068850 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.835+0000 7ff27fd03640 1 --2- 172.21.15.5:0/3001296427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2780c7ad0 0x7ff2780c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.835+0000 7ff27fd03640 1 --2- 172.21.15.5:0/3001296427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff27815e160 0x7ff27815e5d0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.835+0000 7ff27fd03640 1 --2- 172.21.15.5:0/3001296427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2640039b0 0x7ff278158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:05.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.835+0000 7ff27fd03640 1 -- 172.21.15.5:0/3001296427 >> 172.21.15.5:0/3001296427 conn(0x7ff2780659d0 msgr2=0x7ff2780cf150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:05.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.835+0000 7ff27fd03640 1 -- 172.21.15.5:0/3001296427 shutdown_connections 2023-07-14T13:09:05.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.835+0000 7ff27fd03640 1 -- 172.21.15.5:0/3001296427 wait complete. 2023-07-14T13:09:05.885 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-14T13:09:06.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.999+0000 7f63ff3c5640 1 Processor -- start 2023-07-14T13:09:06.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.999+0000 7f63ff3c5640 1 -- start start 2023-07-14T13:09:06.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.999+0000 7f63ff3c5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f63f8160330 0x7f63f80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:06.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:05.999+0000 7f63ff3c5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f80c17d0 con 0x7f63f80c8940 2023-07-14T13:09:06.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.003+0000 7f63ff3c5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f80c14f0 con 0x7f63f80c0f80 2023-07-14T13:09:06.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.003+0000 7f63ff3c5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f80cdd70 con 0x7f63f8160330 2023-07-14T13:09:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.003+0000 7f63fd161640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f63f8160330 0x7f63f80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.003+0000 7f63fd161640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f63f8160330 0x7f63f80cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57814/0 (socket says 172.21.15.5:57814) 2023-07-14T13:09:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.003+0000 7f63fc960640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f63f80c8940 0x7f63f80ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46470/0 (socket says 172.21.15.5:46470) 2023-07-14T13:09:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.003+0000 7f63fd161640 1 -- 172.21.15.5:0/576431530 learned_addr learned my addr 172.21.15.5:0/576431530 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:06.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.003+0000 7f63fd161640 1 -- 172.21.15.5:0/576431530 >> v1:172.21.15.154:6789/0 conn(0x7f63f80c0f80 legacy=0x7f63f80cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:06.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.003+0000 7f63fd161640 1 -- 172.21.15.5:0/576431530 >> v1:172.21.15.5:6789/0 conn(0x7f63f80c8940 legacy=0x7f63f80ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:06.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.003+0000 7f63fd161640 1 -- 172.21.15.5:0/576431530 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f80cac10 con 0x7f63f8160330 2023-07-14T13:09:06.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.003+0000 7f63effff640 1 -- 172.21.15.5:0/576431530 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 88335144 0 0) 0x7f63f80c17d0 con 0x7f63f80c8940 2023-07-14T13:09:06.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.003+0000 7f63fd161640 1 --2- 172.21.15.5:0/576431530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63f8160330 0x7f63f80cb6f0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009870 tx=0x7f63f401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0e11ec23400401 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:06.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.003+0000 7f63effff640 1 -- 172.21.15.5:0/576431530 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f40a89f0 con 0x7f63f8160330 2023-07-14T13:09:06.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.003+0000 7f63effff640 1 -- 172.21.15.5:0/576431530 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f40a8b50 con 0x7f63f8160330 2023-07-14T13:09:06.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.003+0000 7f63effff640 1 -- 172.21.15.5:0/576431530 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f40b0440 con 0x7f63f8160330 2023-07-14T13:09:06.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.007+0000 7f63ff3c5640 1 -- 172.21.15.5:0/576431530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63f8160330 msgr2=0x7f63f80cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:06.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.007+0000 7f63ff3c5640 1 --2- 172.21.15.5:0/576431530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63f8160330 0x7f63f80cb6f0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009870 tx=0x7f63f401ecf0 comp rx=0 tx=0).stop 2023-07-14T13:09:06.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.007+0000 7f63ff3c5640 1 -- 172.21.15.5:0/576431530 shutdown_connections 2023-07-14T13:09:06.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.007+0000 7f63ff3c5640 1 --2- 172.21.15.5:0/576431530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63f8160330 0x7f63f80cb6f0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:06.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.007+0000 7f63ff3c5640 1 -- 172.21.15.5:0/576431530 >> 172.21.15.5:0/576431530 conn(0x7f63f80afcf0 msgr2=0x7f63f80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:06.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.007+0000 7f63ff3c5640 1 -- 172.21.15.5:0/576431530 shutdown_connections 2023-07-14T13:09:06.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.007+0000 7f63ff3c5640 1 -- 172.21.15.5:0/576431530 wait complete. 2023-07-14T13:09:06.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.007+0000 7f63ff3c5640 1 Processor -- start 2023-07-14T13:09:06.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.007+0000 7f63ff3c5640 1 -- start start 2023-07-14T13:09:06.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.007+0000 7f63ff3c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63f80c0f80 0x7f63f8160970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:06.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.007+0000 7f63ff3c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63f80c8940 0x7f63f80c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:06.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.007+0000 7f63ff3c5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63f8160330 0x7f63f80c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:06.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.007+0000 7f63ff3c5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f80b2750 con 0x7f63f80c0f80 2023-07-14T13:09:06.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.007+0000 7f63ff3c5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f80c6060 con 0x7f63f80c8940 2023-07-14T13:09:06.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.007+0000 7f63ff3c5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f80b3f70 con 0x7f63f8160330 2023-07-14T13:09:06.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.007+0000 7f63fd161640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63f80c0f80 0x7f63f8160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:06.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.007+0000 7f63fd161640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63f80c0f80 0x7f63f8160970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57816/0 (socket says 172.21.15.5:57816) 2023-07-14T13:09:06.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.007+0000 7f63fd161640 1 -- 172.21.15.5:0/3516219768 learned_addr learned my addr 172.21.15.5:0/3516219768 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:06.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.007+0000 7f63fd161640 1 -- 172.21.15.5:0/3516219768 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63f8160330 msgr2=0x7f63f80c77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:06.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.007+0000 7f63fd161640 1 --2- 172.21.15.5:0/3516219768 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63f8160330 0x7f63f80c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:06.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.007+0000 7f63fd161640 1 -- 172.21.15.5:0/3516219768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63f80c8940 msgr2=0x7f63f80c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:06.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.007+0000 7f63fd161640 1 --2- 172.21.15.5:0/3516219768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63f80c8940 0x7f63f80c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:06.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.007+0000 7f63fd161640 1 -- 172.21.15.5:0/3516219768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f40094d0 con 0x7f63f80c0f80 2023-07-14T13:09:06.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.011+0000 7f63fd161640 1 --2- 172.21.15.5:0/3516219768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63f80c0f80 0x7f63f8160970 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009870 tx=0x7f63f401ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:06.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.011+0000 7f63edffb640 1 -- 172.21.15.5:0/3516219768 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f40b0e20 con 0x7f63f80c0f80 2023-07-14T13:09:06.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.011+0000 7f63edffb640 1 -- 172.21.15.5:0/3516219768 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f4004030 con 0x7f63f80c0f80 2023-07-14T13:09:06.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.011+0000 7f63edffb640 1 -- 172.21.15.5:0/3516219768 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f40043a0 con 0x7f63f80c0f80 2023-07-14T13:09:06.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.011+0000 7f63ff3c5640 1 -- 172.21.15.5:0/3516219768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f80b1db0 con 0x7f63f80c0f80 2023-07-14T13:09:06.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.011+0000 7f63ff3c5640 1 -- 172.21.15.5:0/3516219768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f80b2370 con 0x7f63f80c0f80 2023-07-14T13:09:06.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.011+0000 7f63ff3c5640 1 -- 172.21.15.5:0/3516219768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f80678d0 con 0x7f63f80c0f80 2023-07-14T13:09:06.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.011+0000 7f63edffb640 1 -- 172.21.15.5:0/3516219768 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f63f4003620 con 0x7f63f80c0f80 2023-07-14T13:09:06.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.011+0000 7f63edffb640 1 --2- 172.21.15.5:0/3516219768 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f63dc0663d0 0x7f63dc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:06.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.011+0000 7f63edffb640 1 -- 172.21.15.5:0/3516219768 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f63f4121be0 con 0x7f63f80c0f80 2023-07-14T13:09:06.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.015+0000 7f63fc960640 1 --2- 172.21.15.5:0/3516219768 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f63dc0663d0 0x7f63dc068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:06.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.015+0000 7f63fc960640 1 --2- 172.21.15.5:0/3516219768 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f63dc0663d0 0x7f63dc068880 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f63e80011f0 tx=0x7f63e8007930 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:06.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.015+0000 7f63edffb640 1 -- 172.21.15.5:0/3516219768 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f63f40ef340 con 0x7f63f80c0f80 2023-07-14T13:09:06.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.171+0000 7f63ff3c5640 1 -- 172.21.15.5:0/3516219768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f63f806c380 con 0x7f63f80c0f80 2023-07-14T13:09:06.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.171+0000 7f63edffb640 1 -- 172.21.15.5:0/3516219768 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v93) v1 ==== 84+0+126 (secure 0 0 0) 0x7f63f40b5090 con 0x7f63f80c0f80 2023-07-14T13:09:06.204 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:06.204 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-07-14T13:09:06.204 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:06.205 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-07-14T13:09:06.205 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-07-14T13:09:06.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:06.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:06.205 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 2, 2023-07-14T13:09:06.205 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": "rbd" 2023-07-14T13:09:06.206 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:06.206 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-07-14T13:09:06.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.175+0000 7f63ff3c5640 1 -- 172.21.15.5:0/3516219768 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f63dc0663d0 msgr2=0x7f63dc068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:06.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.175+0000 7f63ff3c5640 1 --2- 172.21.15.5:0/3516219768 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f63dc0663d0 0x7f63dc068880 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f63e80011f0 tx=0x7f63e8007930 comp rx=0 tx=0).stop 2023-07-14T13:09:06.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.175+0000 7f63ff3c5640 1 -- 172.21.15.5:0/3516219768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63f80c0f80 msgr2=0x7f63f8160970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:06.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.175+0000 7f63ff3c5640 1 --2- 172.21.15.5:0/3516219768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63f80c0f80 0x7f63f8160970 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009870 tx=0x7f63f401ba90 comp rx=0 tx=0).stop 2023-07-14T13:09:06.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.175+0000 7f63ff3c5640 1 -- 172.21.15.5:0/3516219768 shutdown_connections 2023-07-14T13:09:06.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.175+0000 7f63ff3c5640 1 --2- 172.21.15.5:0/3516219768 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f63dc0663d0 0x7f63dc068880 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:06.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.175+0000 7f63ff3c5640 1 --2- 172.21.15.5:0/3516219768 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63f8160330 0x7f63f80c77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:06.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.175+0000 7f63ff3c5640 1 --2- 172.21.15.5:0/3516219768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63f80c8940 0x7f63f80c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:06.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.175+0000 7f63ff3c5640 1 --2- 172.21.15.5:0/3516219768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63f80c0f80 0x7f63f8160970 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:06.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.175+0000 7f63ff3c5640 1 -- 172.21.15.5:0/3516219768 >> 172.21.15.5:0/3516219768 conn(0x7f63f80afcf0 msgr2=0x7f63f80cbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:06.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.175+0000 7f63ff3c5640 1 -- 172.21.15.5:0/3516219768 shutdown_connections 2023-07-14T13:09:06.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.175+0000 7f63ff3c5640 1 -- 172.21.15.5:0/3516219768 wait complete. 2023-07-14T13:09:06.225 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-14T13:09:06.226 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-14T13:09:06.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.343+0000 7f0364c48640 1 Processor -- start 2023-07-14T13:09:06.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.343+0000 7f0364c48640 1 -- start start 2023-07-14T13:09:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.343+0000 7f0364c48640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0360069430 0x7f0360069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.343+0000 7f0364c48640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0360070f30 0x7f03600ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.343+0000 7f0364c48640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0360159d70 con 0x7f03600af2b0 2023-07-14T13:09:06.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.343+0000 7f0364c48640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0360069d40 con 0x7f0360069430 2023-07-14T13:09:06.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.343+0000 7f0364c48640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03600c9c60 con 0x7f0360070f30 2023-07-14T13:09:06.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.343+0000 7f035e59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0360069430 0x7f0360069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.343+0000 7f035ed9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f03600af2b0 0x7f036015a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46486/0 (socket says 172.21.15.5:46486) 2023-07-14T13:09:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.343+0000 7f035ed9d640 1 -- 172.21.15.5:0/427554718 learned_addr learned my addr 172.21.15.5:0/427554718 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.343+0000 7f0357fff640 1 --2- 172.21.15.5:0/427554718 >> v2:172.21.15.154:3300/0 conn(0x7f0360070f30 0x7f03600ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.343+0000 7f035e59c640 1 -- 172.21.15.5:0/427554718 >> v2:172.21.15.154:3300/0 conn(0x7f0360070f30 msgr2=0x7f03600ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.343+0000 7f035e59c640 1 --2- 172.21.15.5:0/427554718 >> v2:172.21.15.154:3300/0 conn(0x7f0360070f30 0x7f03600ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.343+0000 7f035e59c640 1 -- 172.21.15.5:0/427554718 >> v1:172.21.15.5:6789/0 conn(0x7f03600af2b0 legacy=0x7f036015a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.347+0000 7f035e59c640 1 -- 172.21.15.5:0/427554718 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03600c9f40 con 0x7f0360069430 2023-07-14T13:09:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.347+0000 7f035dd9b640 1 -- 172.21.15.5:0/427554718 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 726651110 0 0) 0x7f03580014a0 con 0x7f03600af2b0 2023-07-14T13:09:06.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.347+0000 7f035e59c640 1 --2- 172.21.15.5:0/427554718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0360069430 0x7f0360069800 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f03600c9830 tx=0x7f035001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34917a8aa3c304c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:06.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.347+0000 7f035dd9b640 1 -- 172.21.15.5:0/427554718 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03500ab600 con 0x7f0360069430 2023-07-14T13:09:06.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.347+0000 7f035dd9b640 1 -- 172.21.15.5:0/427554718 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03500a7050 con 0x7f0360069430 2023-07-14T13:09:06.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.347+0000 7f035dd9b640 1 -- 172.21.15.5:0/427554718 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03500ab980 con 0x7f0360069430 2023-07-14T13:09:06.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.347+0000 7f0364c48640 1 -- 172.21.15.5:0/427554718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0360069430 msgr2=0x7f0360069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:06.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.347+0000 7f0364c48640 1 --2- 172.21.15.5:0/427554718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0360069430 0x7f0360069800 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f03600c9830 tx=0x7f035001c460 comp rx=0 tx=0).stop 2023-07-14T13:09:06.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.347+0000 7f0364c48640 1 -- 172.21.15.5:0/427554718 shutdown_connections 2023-07-14T13:09:06.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.347+0000 7f0364c48640 1 --2- 172.21.15.5:0/427554718 >> v2:172.21.15.154:3300/0 conn(0x7f0360070f30 0x7f03600ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:06.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.347+0000 7f0364c48640 1 --2- 172.21.15.5:0/427554718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0360069430 0x7f0360069800 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.347+0000 7f0364c48640 1 -- 172.21.15.5:0/427554718 >> 172.21.15.5:0/427554718 conn(0x7f03600cde90 msgr2=0x7f03600ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.351+0000 7f0364c48640 1 -- 172.21.15.5:0/427554718 shutdown_connections 2023-07-14T13:09:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.351+0000 7f0364c48640 1 -- 172.21.15.5:0/427554718 wait complete. 2023-07-14T13:09:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.351+0000 7f0364c48640 1 Processor -- start 2023-07-14T13:09:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.351+0000 7f0364c48640 1 -- start start 2023-07-14T13:09:06.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.351+0000 7f0364c48640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0360069430 0x7f03600cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:06.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.351+0000 7f0364c48640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0360070f30 0x7f036014cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:06.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.351+0000 7f0364c48640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03600af2b0 0x7f03600ca870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:06.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.351+0000 7f0364c48640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03600ccaa0 con 0x7f0360070f30 2023-07-14T13:09:06.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.351+0000 7f0364c48640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03600c2d30 con 0x7f03600af2b0 2023-07-14T13:09:06.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.351+0000 7f0364c48640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03600c3010 con 0x7f0360069430 2023-07-14T13:09:06.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.351+0000 7f0357fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0360070f30 0x7f036014cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:06.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.351+0000 7f0357fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0360070f30 0x7f036014cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57832/0 (socket says 172.21.15.5:57832) 2023-07-14T13:09:06.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.351+0000 7f0357fff640 1 -- 172.21.15.5:0/1395754159 learned_addr learned my addr 172.21.15.5:0/1395754159 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:06.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.351+0000 7f035ed9d640 1 --2- 172.21.15.5:0/1395754159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03600af2b0 0x7f03600ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:06.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.351+0000 7f035e59c640 1 --2- 172.21.15.5:0/1395754159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0360069430 0x7f03600cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:06.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.351+0000 7f0357fff640 1 -- 172.21.15.5:0/1395754159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0360069430 msgr2=0x7f03600cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:06.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.351+0000 7f0357fff640 1 --2- 172.21.15.5:0/1395754159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0360069430 0x7f03600cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:06.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.351+0000 7f0357fff640 1 -- 172.21.15.5:0/1395754159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03600af2b0 msgr2=0x7f03600ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:06.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.351+0000 7f0357fff640 1 --2- 172.21.15.5:0/1395754159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03600af2b0 0x7f03600ca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:06.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.351+0000 7f0357fff640 1 -- 172.21.15.5:0/1395754159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0350009420 con 0x7f0360070f30 2023-07-14T13:09:06.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.351+0000 7f0357fff640 1 --2- 172.21.15.5:0/1395754159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0360070f30 0x7f036014cef0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f034800d5f0 tx=0x7f034800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:06.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.355+0000 7f0356ffd640 1 -- 172.21.15.5:0/1395754159 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03480125f0 con 0x7f0360070f30 2023-07-14T13:09:06.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.355+0000 7f0356ffd640 1 -- 172.21.15.5:0/1395754159 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0348012750 con 0x7f0360070f30 2023-07-14T13:09:06.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.355+0000 7f0356ffd640 1 -- 172.21.15.5:0/1395754159 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348012ae0 con 0x7f0360070f30 2023-07-14T13:09:06.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.355+0000 7f0364c48640 1 -- 172.21.15.5:0/1395754159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03600c32f0 con 0x7f0360070f30 2023-07-14T13:09:06.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.355+0000 7f0364c48640 1 -- 172.21.15.5:0/1395754159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03600c38b0 con 0x7f0360070f30 2023-07-14T13:09:06.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.355+0000 7f0364c48640 1 -- 172.21.15.5:0/1395754159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03600678d0 con 0x7f0360070f30 2023-07-14T13:09:06.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.355+0000 7f0356ffd640 1 -- 172.21.15.5:0/1395754159 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0348012c40 con 0x7f0360070f30 2023-07-14T13:09:06.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.355+0000 7f0356ffd640 1 --2- 172.21.15.5:0/1395754159 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f03400663a0 0x7f0340068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:06.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.355+0000 7f0356ffd640 1 -- 172.21.15.5:0/1395754159 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0348083ea0 con 0x7f0360070f30 2023-07-14T13:09:06.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.359+0000 7f035e59c640 1 --2- 172.21.15.5:0/1395754159 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f03400663a0 0x7f0340068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:06.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.359+0000 7f035e59c640 1 --2- 172.21.15.5:0/1395754159 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f03400663a0 0x7f0340068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f03500ad000 tx=0x7f03500a6000 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:06.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.359+0000 7f0356ffd640 1 -- 172.21.15.5:0/1395754159 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f0348051610 con 0x7f0360070f30 2023-07-14T13:09:06.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:06.519+0000 7f0364c48640 1 -- 172.21.15.5:0/1395754159 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f03600aeb80 con 0x7f0360070f30 2023-07-14T13:09:06.747 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-07-14T13:09:07.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.415+0000 7f0356ffd640 1 -- 172.21.15.5:0/1395754159 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v94) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0348054c30 con 0x7f0360070f30 2023-07-14T13:09:07.445 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-07-14T13:09:07.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.419+0000 7f0364c48640 1 -- 172.21.15.5:0/1395754159 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f03400663a0 msgr2=0x7f0340068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:07.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.419+0000 7f0364c48640 1 --2- 172.21.15.5:0/1395754159 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f03400663a0 0x7f0340068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f03500ad000 tx=0x7f03500a6000 comp rx=0 tx=0).stop 2023-07-14T13:09:07.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.419+0000 7f0364c48640 1 -- 172.21.15.5:0/1395754159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0360070f30 msgr2=0x7f036014cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:07.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.419+0000 7f0364c48640 1 --2- 172.21.15.5:0/1395754159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0360070f30 0x7f036014cef0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f034800d5f0 tx=0x7f034800dab0 comp rx=0 tx=0).stop 2023-07-14T13:09:07.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.419+0000 7f0364c48640 1 -- 172.21.15.5:0/1395754159 shutdown_connections 2023-07-14T13:09:07.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.419+0000 7f0364c48640 1 --2- 172.21.15.5:0/1395754159 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f03400663a0 0x7f0340068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:07.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.419+0000 7f0364c48640 1 --2- 172.21.15.5:0/1395754159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03600af2b0 0x7f03600ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:07.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.419+0000 7f0364c48640 1 --2- 172.21.15.5:0/1395754159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0360070f30 0x7f036014cef0 secure :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f034800d5f0 tx=0x7f034800dab0 comp rx=0 tx=0).stop 2023-07-14T13:09:07.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.419+0000 7f0364c48640 1 --2- 172.21.15.5:0/1395754159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0360069430 0x7f03600cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:07.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.419+0000 7f0364c48640 1 -- 172.21.15.5:0/1395754159 >> 172.21.15.5:0/1395754159 conn(0x7f03600cde90 msgr2=0x7f036015a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:07.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.423+0000 7f0364c48640 1 -- 172.21.15.5:0/1395754159 shutdown_connections 2023-07-14T13:09:07.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.423+0000 7f0364c48640 1 -- 172.21.15.5:0/1395754159 wait complete. 2023-07-14T13:09:07.478 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-14T13:09:07.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.599+0000 7fdfc87e9640 1 Processor -- start 2023-07-14T13:09:07.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.599+0000 7fdfc87e9640 1 -- start start 2023-07-14T13:09:07.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.603+0000 7fdfc87e9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdfc00c85a0 0x7fdfc015c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:07.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.603+0000 7fdfc87e9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdfc006cff0 0x7fdfc00c8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:07.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.603+0000 7fdfc87e9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc015cc90 con 0x7fdfc006b8f0 2023-07-14T13:09:07.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.603+0000 7fdfc87e9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc00c8eb0 con 0x7fdfc00c85a0 2023-07-14T13:09:07.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.603+0000 7fdfc87e9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc0156130 con 0x7fdfc006cff0 2023-07-14T13:09:07.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.603+0000 7fdfc6585640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdfc00c85a0 0x7fdfc015c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:07.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.603+0000 7fdfc6d86640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdfc006b8f0 0x7fdfc006bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46496/0 (socket says 172.21.15.5:46496) 2023-07-14T13:09:07.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.603+0000 7fdfc6d86640 1 -- 172.21.15.5:0/699918193 learned_addr learned my addr 172.21.15.5:0/699918193 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:07.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.603+0000 7fdfc5d84640 1 --2- 172.21.15.5:0/699918193 >> v2:172.21.15.154:3300/0 conn(0x7fdfc006cff0 0x7fdfc00c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:07.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.603+0000 7fdfc6585640 1 -- 172.21.15.5:0/699918193 >> v2:172.21.15.154:3300/0 conn(0x7fdfc006cff0 msgr2=0x7fdfc00c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.603+0000 7fdfc6585640 1 --2- 172.21.15.5:0/699918193 >> v2:172.21.15.154:3300/0 conn(0x7fdfc006cff0 0x7fdfc00c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.603+0000 7fdfc6585640 1 -- 172.21.15.5:0/699918193 >> v1:172.21.15.5:6789/0 conn(0x7fdfc006b8f0 legacy=0x7fdfc006bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.603+0000 7fdfc6585640 1 -- 172.21.15.5:0/699918193 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc0158a10 con 0x7fdfc00c85a0 2023-07-14T13:09:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.603+0000 7fdfc5583640 1 -- 172.21.15.5:0/699918193 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678556612 0 0) 0x7fdfc015cc90 con 0x7fdfc006b8f0 2023-07-14T13:09:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.607+0000 7fdfc6585640 1 --2- 172.21.15.5:0/699918193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc00c85a0 0x7fdfc015c750 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fdfc00b0b40 tx=0x7fdfbc01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eade5549a9f8d2a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.607+0000 7fdfc5583640 1 -- 172.21.15.5:0/699918193 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0ac630 con 0x7fdfc00c85a0 2023-07-14T13:09:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.607+0000 7fdfc5583640 1 -- 172.21.15.5:0/699918193 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfbc0ac790 con 0x7fdfc00c85a0 2023-07-14T13:09:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.607+0000 7fdfc5583640 1 -- 172.21.15.5:0/699918193 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0acb20 con 0x7fdfc00c85a0 2023-07-14T13:09:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.607+0000 7fdfc87e9640 1 -- 172.21.15.5:0/699918193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc00c85a0 msgr2=0x7fdfc015c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.607+0000 7fdfc87e9640 1 --2- 172.21.15.5:0/699918193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc00c85a0 0x7fdfc015c750 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fdfc00b0b40 tx=0x7fdfbc01c3d0 comp rx=0 tx=0).stop 2023-07-14T13:09:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.607+0000 7fdfc87e9640 1 -- 172.21.15.5:0/699918193 shutdown_connections 2023-07-14T13:09:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.607+0000 7fdfc87e9640 1 --2- 172.21.15.5:0/699918193 >> v2:172.21.15.154:3300/0 conn(0x7fdfc006cff0 0x7fdfc00c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.607+0000 7fdfc87e9640 1 --2- 172.21.15.5:0/699918193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc00c85a0 0x7fdfc015c750 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.607+0000 7fdfc87e9640 1 -- 172.21.15.5:0/699918193 >> 172.21.15.5:0/699918193 conn(0x7fdfc00afac0 msgr2=0x7fdfc00afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.607+0000 7fdfc87e9640 1 -- 172.21.15.5:0/699918193 shutdown_connections 2023-07-14T13:09:07.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.607+0000 7fdfc87e9640 1 -- 172.21.15.5:0/699918193 wait complete. 2023-07-14T13:09:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.607+0000 7fdfc87e9640 1 Processor -- start 2023-07-14T13:09:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.607+0000 7fdfc87e9640 1 -- start start 2023-07-14T13:09:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.611+0000 7fdfc87e9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdfc006b8f0 0x7fdfc015ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.611+0000 7fdfc87e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc006cff0 0x7fdfc00c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.611+0000 7fdfc87e9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfc00c85a0 0x7fdfc00c2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.611+0000 7fdfc87e9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc00c1a80 con 0x7fdfc006cff0 2023-07-14T13:09:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.611+0000 7fdfc87e9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc015b260 con 0x7fdfc00c85a0 2023-07-14T13:09:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.611+0000 7fdfc87e9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc00c1c90 con 0x7fdfc006b8f0 2023-07-14T13:09:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.611+0000 7fdfc5d84640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc006cff0 0x7fdfc00c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.611+0000 7fdfc5d84640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc006cff0 0x7fdfc00c40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57858/0 (socket says 172.21.15.5:57858) 2023-07-14T13:09:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.611+0000 7fdfc5d84640 1 -- 172.21.15.5:0/746937948 learned_addr learned my addr 172.21.15.5:0/746937948 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:07.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.611+0000 7fdfc6585640 1 --2- 172.21.15.5:0/746937948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdfc006b8f0 0x7fdfc015ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:07.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.611+0000 7fdfc6d86640 1 --2- 172.21.15.5:0/746937948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfc00c85a0 0x7fdfc00c2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:07.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.611+0000 7fdfc5d84640 1 -- 172.21.15.5:0/746937948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdfc006b8f0 msgr2=0x7fdfc015ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:07.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.611+0000 7fdfc5d84640 1 --2- 172.21.15.5:0/746937948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdfc006b8f0 0x7fdfc015ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:07.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.611+0000 7fdfc5d84640 1 -- 172.21.15.5:0/746937948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfc00c85a0 msgr2=0x7fdfc00c2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:07.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.611+0000 7fdfc5d84640 1 --2- 172.21.15.5:0/746937948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfc00c85a0 0x7fdfc00c2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:07.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.611+0000 7fdfc5d84640 1 -- 172.21.15.5:0/746937948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc009420 con 0x7fdfc006cff0 2023-07-14T13:09:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.611+0000 7fdfc5d84640 1 --2- 172.21.15.5:0/746937948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc006cff0 0x7fdfc00c40c0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000d800 tx=0x7fdfb000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.611+0000 7fdfb6ffd640 1 -- 172.21.15.5:0/746937948 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb000b6c0 con 0x7fdfc006cff0 2023-07-14T13:09:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.611+0000 7fdfb6ffd640 1 -- 172.21.15.5:0/746937948 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb000b820 con 0x7fdfc006cff0 2023-07-14T13:09:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.611+0000 7fdfb6ffd640 1 -- 172.21.15.5:0/746937948 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb000bb90 con 0x7fdfc006cff0 2023-07-14T13:09:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.611+0000 7fdfc87e9640 1 -- 172.21.15.5:0/746937948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc00c1f70 con 0x7fdfc006cff0 2023-07-14T13:09:07.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.611+0000 7fdfc87e9640 1 -- 172.21.15.5:0/746937948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc00c4600 con 0x7fdfc006cff0 2023-07-14T13:09:07.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.611+0000 7fdfc87e9640 1 -- 172.21.15.5:0/746937948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc00678d0 con 0x7fdfc006cff0 2023-07-14T13:09:07.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.615+0000 7fdfb6ffd640 1 -- 172.21.15.5:0/746937948 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdfb000bcf0 con 0x7fdfc006cff0 2023-07-14T13:09:07.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.615+0000 7fdfb6ffd640 1 --2- 172.21.15.5:0/746937948 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fdfa40663a0 0x7fdfa4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:07.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.615+0000 7fdfb6ffd640 1 -- 172.21.15.5:0/746937948 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fdfb0084d10 con 0x7fdfc006cff0 2023-07-14T13:09:07.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.615+0000 7fdfc6585640 1 --2- 172.21.15.5:0/746937948 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fdfa40663a0 0x7fdfa4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:07.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.615+0000 7fdfc6585640 1 --2- 172.21.15.5:0/746937948 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fdfa40663a0 0x7fdfa4068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0ae000 tx=0x7fdfbc008040 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:07.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.619+0000 7fdfb6ffd640 1 -- 172.21.15.5:0/746937948 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fdfb0055cd0 con 0x7fdfc006cff0 2023-07-14T13:09:07.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:07.775+0000 7fdfc87e9640 1 -- 172.21.15.5:0/746937948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdfc006b6d0 con 0x7fdfc006cff0 2023-07-14T13:09:08.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.423+0000 7fdfb6ffd640 1 -- 172.21.15.5:0/746937948 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v95) v1 ==== 170+0+0 (secure 0 0 0) 0x7fdfb0055860 con 0x7fdfc006cff0 2023-07-14T13:09:08.456 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-07-14T13:09:08.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.431+0000 7fdfc87e9640 1 -- 172.21.15.5:0/746937948 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fdfa40663a0 msgr2=0x7fdfa4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:08.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.431+0000 7fdfc87e9640 1 --2- 172.21.15.5:0/746937948 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fdfa40663a0 0x7fdfa4068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0ae000 tx=0x7fdfbc008040 comp rx=0 tx=0).stop 2023-07-14T13:09:08.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.431+0000 7fdfc87e9640 1 -- 172.21.15.5:0/746937948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc006cff0 msgr2=0x7fdfc00c40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:08.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.431+0000 7fdfc87e9640 1 --2- 172.21.15.5:0/746937948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc006cff0 0x7fdfc00c40c0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000d800 tx=0x7fdfb000dcc0 comp rx=0 tx=0).stop 2023-07-14T13:09:08.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.431+0000 7fdfc87e9640 1 -- 172.21.15.5:0/746937948 shutdown_connections 2023-07-14T13:09:08.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.431+0000 7fdfc87e9640 1 --2- 172.21.15.5:0/746937948 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fdfa40663a0 0x7fdfa4068850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:08.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.431+0000 7fdfc87e9640 1 --2- 172.21.15.5:0/746937948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfc00c85a0 0x7fdfc00c2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:08.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.431+0000 7fdfc87e9640 1 --2- 172.21.15.5:0/746937948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc006cff0 0x7fdfc00c40c0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:08.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.431+0000 7fdfc87e9640 1 --2- 172.21.15.5:0/746937948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdfc006b8f0 0x7fdfc015ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:08.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.431+0000 7fdfc87e9640 1 -- 172.21.15.5:0/746937948 >> 172.21.15.5:0/746937948 conn(0x7fdfc00afac0 msgr2=0x7fdfc0156d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:08.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.439+0000 7fdfc87e9640 1 -- 172.21.15.5:0/746937948 shutdown_connections 2023-07-14T13:09:08.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.443+0000 7fdfc87e9640 1 -- 172.21.15.5:0/746937948 wait complete. 2023-07-14T13:09:08.499 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-14T13:09:08.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.619+0000 7f2c352d8640 1 Processor -- start 2023-07-14T13:09:08.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.619+0000 7f2c352d8640 1 -- start start 2023-07-14T13:09:08.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.619+0000 7f2c352d8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2c300aeb40 0x7f2c3015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:08.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.619+0000 7f2c352d8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2c300aef10 0x7f2c30158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:08.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.619+0000 7f2c352d8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c301532b0 con 0x7f2c30159270 2023-07-14T13:09:08.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.619+0000 7f2c352d8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c300ca6f0 con 0x7f2c300aef10 2023-07-14T13:09:08.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.619+0000 7f2c352d8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c301599d0 con 0x7f2c300aeb40 2023-07-14T13:09:08.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.619+0000 7f2c27fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2c300aef10 0x7f2c30158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:08.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.619+0000 7f2c27fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2c300aef10 0x7f2c30158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57872/0 (socket says 172.21.15.5:57872) 2023-07-14T13:09:08.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.619+0000 7f2c27fff640 1 -- 172.21.15.5:0/4138000440 learned_addr learned my addr 172.21.15.5:0/4138000440 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:08.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.619+0000 7f2c27fff640 1 -- 172.21.15.5:0/4138000440 >> v2:172.21.15.154:3300/0 conn(0x7f2c300aeb40 msgr2=0x7f2c3015cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:08.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.619+0000 7f2c27fff640 1 --2- 172.21.15.5:0/4138000440 >> v2:172.21.15.154:3300/0 conn(0x7f2c300aeb40 0x7f2c3015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:08.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.619+0000 7f2c27fff640 1 -- 172.21.15.5:0/4138000440 >> v1:172.21.15.154:6789/0 conn(0x7f2c30159270 legacy=0x7f2c300c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:08.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.619+0000 7f2c27fff640 1 -- 172.21.15.5:0/4138000440 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c30159cb0 con 0x7f2c300aef10 2023-07-14T13:09:08.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.623+0000 7f2c27fff640 1 --2- 172.21.15.5:0/4138000440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c300aef10 0x7f2c30158d30 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f2c30071ad0 tx=0x7f2c1801ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ececef39bafc452 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:08.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.623+0000 7f2c2e7fc640 1 -- 172.21.15.5:0/4138000440 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c180a7ba0 con 0x7f2c300aef10 2023-07-14T13:09:08.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.623+0000 7f2c2e7fc640 1 -- 172.21.15.5:0/4138000440 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c180a7d00 con 0x7f2c300aef10 2023-07-14T13:09:08.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.623+0000 7f2c2e7fc640 1 -- 172.21.15.5:0/4138000440 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c180af660 con 0x7f2c300aef10 2023-07-14T13:09:08.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.623+0000 7f2c352d8640 1 -- 172.21.15.5:0/4138000440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c300aef10 msgr2=0x7f2c30158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:08.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.623+0000 7f2c352d8640 1 --2- 172.21.15.5:0/4138000440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c300aef10 0x7f2c30158d30 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f2c30071ad0 tx=0x7f2c1801ead0 comp rx=0 tx=0).stop 2023-07-14T13:09:08.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.623+0000 7f2c352d8640 1 -- 172.21.15.5:0/4138000440 shutdown_connections 2023-07-14T13:09:08.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.623+0000 7f2c352d8640 1 --2- 172.21.15.5:0/4138000440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c300aef10 0x7f2c30158d30 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:08.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.623+0000 7f2c352d8640 1 --2- 172.21.15.5:0/4138000440 >> v2:172.21.15.154:3300/0 conn(0x7f2c300aeb40 0x7f2c3015cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:08.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.623+0000 7f2c352d8640 1 -- 172.21.15.5:0/4138000440 >> 172.21.15.5:0/4138000440 conn(0x7f2c300cde90 msgr2=0x7f2c300ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:08.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.623+0000 7f2c352d8640 1 -- 172.21.15.5:0/4138000440 shutdown_connections 2023-07-14T13:09:08.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.623+0000 7f2c352d8640 1 -- 172.21.15.5:0/4138000440 wait complete. 2023-07-14T13:09:08.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.627+0000 7f2c352d8640 1 Processor -- start 2023-07-14T13:09:08.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.627+0000 7f2c352d8640 1 -- start start 2023-07-14T13:09:08.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.627+0000 7f2c352d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c300aeb40 0x7f2c3014e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:08.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.627+0000 7f2c352d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c300aef10 0x7f2c301583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:08.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.627+0000 7f2c352d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c30159270 0x7f2c3015b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:08.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.627+0000 7f2c352d8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3014c030 con 0x7f2c300aef10 2023-07-14T13:09:08.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.627+0000 7f2c352d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c30156ad0 con 0x7f2c30159270 2023-07-14T13:09:08.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.627+0000 7f2c352d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c30159ed0 con 0x7f2c300aeb40 2023-07-14T13:09:08.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.627+0000 7f2c27fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c300aef10 0x7f2c301583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:08.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.627+0000 7f2c27fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c300aef10 0x7f2c301583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57880/0 (socket says 172.21.15.5:57880) 2023-07-14T13:09:08.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.627+0000 7f2c27fff640 1 -- 172.21.15.5:0/2953454512 learned_addr learned my addr 172.21.15.5:0/2953454512 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:08.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.627+0000 7f2c2f7fe640 1 --2- 172.21.15.5:0/2953454512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c30159270 0x7f2c3015b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:08.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.627+0000 7f2c2effd640 1 --2- 172.21.15.5:0/2953454512 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c300aeb40 0x7f2c3014e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:08.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.627+0000 7f2c27fff640 1 -- 172.21.15.5:0/2953454512 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c300aeb40 msgr2=0x7f2c3014e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:08.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.627+0000 7f2c27fff640 1 --2- 172.21.15.5:0/2953454512 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c300aeb40 0x7f2c3014e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:08.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.627+0000 7f2c27fff640 1 -- 172.21.15.5:0/2953454512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c30159270 msgr2=0x7f2c3015b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:08.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.627+0000 7f2c27fff640 1 --2- 172.21.15.5:0/2953454512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c30159270 0x7f2c3015b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:08.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.627+0000 7f2c27fff640 1 -- 172.21.15.5:0/2953454512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1800b770 con 0x7f2c300aef10 2023-07-14T13:09:08.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.627+0000 7f2c27fff640 1 --2- 172.21.15.5:0/2953454512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c300aef10 0x7f2c301583e0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f2c1801d180 tx=0x7f2c1801d310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:08.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.627+0000 7f2c277fe640 1 -- 172.21.15.5:0/2953454512 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c180a7ba0 con 0x7f2c300aef10 2023-07-14T13:09:08.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.627+0000 7f2c277fe640 1 -- 172.21.15.5:0/2953454512 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c180ba480 con 0x7f2c300aef10 2023-07-14T13:09:08.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.627+0000 7f2c277fe640 1 -- 172.21.15.5:0/2953454512 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c180ba830 con 0x7f2c300aef10 2023-07-14T13:09:08.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.627+0000 7f2c352d8640 1 -- 172.21.15.5:0/2953454512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c3014b1b0 con 0x7f2c300aef10 2023-07-14T13:09:08.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.627+0000 7f2c352d8640 1 -- 172.21.15.5:0/2953454512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c3014b770 con 0x7f2c300aef10 2023-07-14T13:09:08.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.631+0000 7f2c352d8640 1 -- 172.21.15.5:0/2953454512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c300c99c0 con 0x7f2c300aef10 2023-07-14T13:09:08.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.631+0000 7f2c277fe640 1 -- 172.21.15.5:0/2953454512 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2c180ba990 con 0x7f2c300aef10 2023-07-14T13:09:08.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.631+0000 7f2c277fe640 1 --2- 172.21.15.5:0/2953454512 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2c100663a0 0x7f2c10068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:08.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.631+0000 7f2c277fe640 1 -- 172.21.15.5:0/2953454512 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f2c18120040 con 0x7f2c300aef10 2023-07-14T13:09:08.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.631+0000 7f2c2effd640 1 --2- 172.21.15.5:0/2953454512 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2c100663a0 0x7f2c10068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:08.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.635+0000 7f2c2effd640 1 --2- 172.21.15.5:0/2953454512 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2c100663a0 0x7f2c10068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2c20006fd0 tx=0x7f2c20008040 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:08.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.635+0000 7f2c277fe640 1 -- 172.21.15.5:0/2953454512 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2c180ed3f0 con 0x7f2c300aef10 2023-07-14T13:09:08.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:08.827+0000 7f2c352d8640 1 -- 172.21.15.5:0/2953454512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2c300c99c0 con 0x7f2c300aef10 2023-07-14T13:09:09.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.431+0000 7f2c277fe640 1 -- 172.21.15.5:0/2953454512 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v37) v1 ==== 174+0+0 (secure 0 0 0) 0x7f2c180b4070 con 0x7f2c300aef10 2023-07-14T13:09:09.465 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 11 and data pool 12 2023-07-14T13:09:09.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.459+0000 7f2c257fa640 1 -- 172.21.15.5:0/2953454512 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2c100663a0 msgr2=0x7f2c10068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:09.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.459+0000 7f2c257fa640 1 --2- 172.21.15.5:0/2953454512 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2c100663a0 0x7f2c10068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2c20006fd0 tx=0x7f2c20008040 comp rx=0 tx=0).stop 2023-07-14T13:09:09.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.459+0000 7f2c257fa640 1 -- 172.21.15.5:0/2953454512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c300aef10 msgr2=0x7f2c301583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:09.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.459+0000 7f2c257fa640 1 --2- 172.21.15.5:0/2953454512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c300aef10 0x7f2c301583e0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f2c1801d180 tx=0x7f2c1801d310 comp rx=0 tx=0).stop 2023-07-14T13:09:09.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.459+0000 7f2c257fa640 1 -- 172.21.15.5:0/2953454512 shutdown_connections 2023-07-14T13:09:09.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.459+0000 7f2c257fa640 1 --2- 172.21.15.5:0/2953454512 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2c100663a0 0x7f2c10068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:09.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.459+0000 7f2c257fa640 1 --2- 172.21.15.5:0/2953454512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c30159270 0x7f2c3015b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:09.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.459+0000 7f2c257fa640 1 --2- 172.21.15.5:0/2953454512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c300aef10 0x7f2c301583e0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:09.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.459+0000 7f2c257fa640 1 --2- 172.21.15.5:0/2953454512 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c300aeb40 0x7f2c3014e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:09.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.459+0000 7f2c257fa640 1 -- 172.21.15.5:0/2953454512 >> 172.21.15.5:0/2953454512 conn(0x7f2c300cde90 msgr2=0x7f2c300c3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:09.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.459+0000 7f2c257fa640 1 -- 172.21.15.5:0/2953454512 shutdown_connections 2023-07-14T13:09:09.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.459+0000 7f2c257fa640 1 -- 172.21.15.5:0/2953454512 wait complete. 2023-07-14T13:09:09.515 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:09:09.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.631+0000 7f0c95311640 1 Processor -- start 2023-07-14T13:09:09.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.631+0000 7f0c95311640 1 -- start start 2023-07-14T13:09:09.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.631+0000 7f0c95311640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c900b7c70 0x7f0c900d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:09.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.631+0000 7f0c95311640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0c9015fd60 0x7f0c900d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:09.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.631+0000 7f0c95311640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c900ccaf0 con 0x7f0c900d1850 2023-07-14T13:09:09.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.631+0000 7f0c95311640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c900d1190 con 0x7f0c9015fd60 2023-07-14T13:09:09.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.631+0000 7f0c95311640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c90160600 con 0x7f0c900b7c70 2023-07-14T13:09:09.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.631+0000 7f0c8f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0c9015fd60 0x7f0c900d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:09.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.631+0000 7f0c8f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0c9015fd60 0x7f0c900d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37858/0 (socket says 172.21.15.5:37858) 2023-07-14T13:09:09.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.631+0000 7f0c8f7fe640 1 -- 172.21.15.5:0/1933541874 learned_addr learned my addr 172.21.15.5:0/1933541874 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:09.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.631+0000 7f0c8effd640 1 --2- 172.21.15.5:0/1933541874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c900b7c70 0x7f0c900d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:09.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.631+0000 7f0c8f7fe640 1 -- 172.21.15.5:0/1933541874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c900b7c70 msgr2=0x7f0c900d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:09.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.631+0000 7f0c8f7fe640 1 --2- 172.21.15.5:0/1933541874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c900b7c70 0x7f0c900d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:09.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.631+0000 7f0c8f7fe640 1 -- 172.21.15.5:0/1933541874 >> v1:172.21.15.154:6789/0 conn(0x7f0c900d1850 legacy=0x7f0c9015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:09.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.631+0000 7f0c8f7fe640 1 -- 172.21.15.5:0/1933541874 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c90160320 con 0x7f0c9015fd60 2023-07-14T13:09:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.635+0000 7f0c8f7fe640 1 --2- 172.21.15.5:0/1933541874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c9015fd60 0x7f0c900d1da0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f0c88009e80 tx=0x7f0c8801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f56c5060de74aceb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.635+0000 7f0c8e7fc640 1 -- 172.21.15.5:0/1933541874 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c880a58a0 con 0x7f0c9015fd60 2023-07-14T13:09:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.635+0000 7f0c8e7fc640 1 -- 172.21.15.5:0/1933541874 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c880a5a00 con 0x7f0c9015fd60 2023-07-14T13:09:09.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.635+0000 7f0c8e7fc640 1 -- 172.21.15.5:0/1933541874 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c880a5d90 con 0x7f0c9015fd60 2023-07-14T13:09:09.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.635+0000 7f0c95311640 1 -- 172.21.15.5:0/1933541874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c9015fd60 msgr2=0x7f0c900d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:09.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.635+0000 7f0c95311640 1 --2- 172.21.15.5:0/1933541874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c9015fd60 0x7f0c900d1da0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f0c88009e80 tx=0x7f0c8801c9c0 comp rx=0 tx=0).stop 2023-07-14T13:09:09.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.635+0000 7f0c95311640 1 -- 172.21.15.5:0/1933541874 shutdown_connections 2023-07-14T13:09:09.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.635+0000 7f0c95311640 1 --2- 172.21.15.5:0/1933541874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c9015fd60 0x7f0c900d1da0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:09.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.635+0000 7f0c95311640 1 --2- 172.21.15.5:0/1933541874 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c900b7c70 0x7f0c900d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:09.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.635+0000 7f0c95311640 1 -- 172.21.15.5:0/1933541874 >> 172.21.15.5:0/1933541874 conn(0x7f0c900650b0 msgr2=0x7f0c900654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:09.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.635+0000 7f0c95311640 1 -- 172.21.15.5:0/1933541874 shutdown_connections 2023-07-14T13:09:09.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.635+0000 7f0c95311640 1 -- 172.21.15.5:0/1933541874 wait complete. 2023-07-14T13:09:09.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.639+0000 7f0c95311640 1 Processor -- start 2023-07-14T13:09:09.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.639+0000 7f0c95311640 1 -- start start 2023-07-14T13:09:09.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.639+0000 7f0c95311640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c900b7c70 0x7f0c90155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.639+0000 7f0c95311640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c900d1850 0x7f0c9014b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.639+0000 7f0c95311640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c9015fd60 0x7f0c9014c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.639+0000 7f0c95311640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c900b6c30 con 0x7f0c9015fd60 2023-07-14T13:09:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.639+0000 7f0c95311640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9015e6a0 con 0x7f0c900b7c70 2023-07-14T13:09:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.639+0000 7f0c95311640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c901544f0 con 0x7f0c900d1850 2023-07-14T13:09:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.639+0000 7f0c8f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c9015fd60 0x7f0c9014c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.639+0000 7f0c8f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c9015fd60 0x7f0c9014c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37864/0 (socket says 172.21.15.5:37864) 2023-07-14T13:09:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.639+0000 7f0c8f7fe640 1 -- 172.21.15.5:0/2989557279 learned_addr learned my addr 172.21.15.5:0/2989557279 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:09.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.639+0000 7f0c8effd640 1 --2- 172.21.15.5:0/2989557279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c900b7c70 0x7f0c90155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:09.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.639+0000 7f0c867fc640 1 --2- 172.21.15.5:0/2989557279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c900d1850 0x7f0c9014b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:09.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.639+0000 7f0c8f7fe640 1 -- 172.21.15.5:0/2989557279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c900d1850 msgr2=0x7f0c9014b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:09.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.639+0000 7f0c8f7fe640 1 --2- 172.21.15.5:0/2989557279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c900d1850 0x7f0c9014b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:09.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.639+0000 7f0c8f7fe640 1 -- 172.21.15.5:0/2989557279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c900b7c70 msgr2=0x7f0c90155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:09.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.639+0000 7f0c8f7fe640 1 --2- 172.21.15.5:0/2989557279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c900b7c70 0x7f0c90155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:09.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.639+0000 7f0c8f7fe640 1 -- 172.21.15.5:0/2989557279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c88009b30 con 0x7f0c9015fd60 2023-07-14T13:09:09.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.639+0000 7f0c8f7fe640 1 --2- 172.21.15.5:0/2989557279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c9015fd60 0x7f0c9014c7b0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f0c880af040 tx=0x7f0c88019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:09.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.639+0000 7f0c87fff640 1 -- 172.21.15.5:0/2989557279 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c880b8640 con 0x7f0c9015fd60 2023-07-14T13:09:09.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.639+0000 7f0c87fff640 1 -- 172.21.15.5:0/2989557279 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c880b87a0 con 0x7f0c9015fd60 2023-07-14T13:09:09.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.639+0000 7f0c87fff640 1 -- 172.21.15.5:0/2989557279 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c880b8b50 con 0x7f0c9015fd60 2023-07-14T13:09:09.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.639+0000 7f0c95311640 1 -- 172.21.15.5:0/2989557279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c9015e920 con 0x7f0c9015fd60 2023-07-14T13:09:09.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.639+0000 7f0c95311640 1 -- 172.21.15.5:0/2989557279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c9015eee0 con 0x7f0c9015fd60 2023-07-14T13:09:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.639+0000 7f0c95311640 1 -- 172.21.15.5:0/2989557279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c900678d0 con 0x7f0c9015fd60 2023-07-14T13:09:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.643+0000 7f0c87fff640 1 -- 172.21.15.5:0/2989557279 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0c880b8cb0 con 0x7f0c9015fd60 2023-07-14T13:09:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.643+0000 7f0c87fff640 1 --2- 172.21.15.5:0/2989557279 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f0c700663d0 0x7f0c70068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.643+0000 7f0c87fff640 1 -- 172.21.15.5:0/2989557279 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0c8811f0b0 con 0x7f0c9015fd60 2023-07-14T13:09:09.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.643+0000 7f0c8effd640 1 --2- 172.21.15.5:0/2989557279 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f0c700663d0 0x7f0c70068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:09.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.643+0000 7f0c8effd640 1 --2- 172.21.15.5:0/2989557279 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f0c700663d0 0x7f0c70068880 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0c9015e490 tx=0x7f0c80008040 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:09.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.647+0000 7f0c87fff640 1 -- 172.21.15.5:0/2989557279 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f0c880ec4b0 con 0x7f0c9015fd60 2023-07-14T13:09:09.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.803+0000 7f0c95311640 1 -- 172.21.15.5:0/2989557279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c9014c510 con 0x7f0c9015fd60 2023-07-14T13:09:09.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.803+0000 7f0c87fff640 1 -- 172.21.15.5:0/2989557279 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+18319 (secure 0 0 0) 0x7f0c880efad0 con 0x7f0c9015fd60 2023-07-14T13:09:09.835 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:09.835 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":96,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:09:08.828324+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:09:06.567743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-14T13:09:07.824380+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:09:09.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.807+0000 7f0c95311640 1 -- 172.21.15.5:0/2989557279 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f0c700663d0 msgr2=0x7f0c70068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:09.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.807+0000 7f0c95311640 1 --2- 172.21.15.5:0/2989557279 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f0c700663d0 0x7f0c70068880 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0c9015e490 tx=0x7f0c80008040 comp rx=0 tx=0).stop 2023-07-14T13:09:09.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.807+0000 7f0c95311640 1 -- 172.21.15.5:0/2989557279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c9015fd60 msgr2=0x7f0c9014c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:09.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.807+0000 7f0c95311640 1 --2- 172.21.15.5:0/2989557279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c9015fd60 0x7f0c9014c7b0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f0c880af040 tx=0x7f0c88019760 comp rx=0 tx=0).stop 2023-07-14T13:09:09.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.807+0000 7f0c95311640 1 -- 172.21.15.5:0/2989557279 shutdown_connections 2023-07-14T13:09:09.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.807+0000 7f0c95311640 1 --2- 172.21.15.5:0/2989557279 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f0c700663d0 0x7f0c70068880 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:09.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.807+0000 7f0c95311640 1 --2- 172.21.15.5:0/2989557279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c9015fd60 0x7f0c9014c7b0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:09.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.807+0000 7f0c95311640 1 --2- 172.21.15.5:0/2989557279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c900d1850 0x7f0c9014b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:09.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.807+0000 7f0c95311640 1 --2- 172.21.15.5:0/2989557279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c900b7c70 0x7f0c90155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:09.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.807+0000 7f0c95311640 1 -- 172.21.15.5:0/2989557279 >> 172.21.15.5:0/2989557279 conn(0x7f0c900650b0 msgr2=0x7f0c90165c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:09.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.807+0000 7f0c95311640 1 -- 172.21.15.5:0/2989557279 shutdown_connections 2023-07-14T13:09:09.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.807+0000 7f0c95311640 1 -- 172.21.15.5:0/2989557279 wait complete. 2023-07-14T13:09:09.857 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:09:10.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.971+0000 7fe7e4940640 1 Processor -- start 2023-07-14T13:09:10.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.971+0000 7fe7e4940640 1 -- start start 2023-07-14T13:09:10.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.971+0000 7fe7e4940640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe7e0158ce0 0x7fe7e0070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:10.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.971+0000 7fe7e4940640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe7e00c8ad0 0x7fe7e00c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:10.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.971+0000 7fe7e4940640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e00c99c0 con 0x7fe7e00c9560 2023-07-14T13:09:10.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.971+0000 7fe7e4940640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7e00cc700 con 0x7fe7e0158ce0 2023-07-14T13:09:10.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.971+0000 7fe7e4940640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7e00b0ff0 con 0x7fe7e00c8ad0 2023-07-14T13:09:10.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.971+0000 7fe7de59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe7e0158ce0 0x7fe7e0070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:10.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.971+0000 7fe7de59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe7e0158ce0 0x7fe7e0070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37876/0 (socket says 172.21.15.5:37876) 2023-07-14T13:09:10.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.971+0000 7fe7de59c640 1 -- 172.21.15.5:0/2440649562 learned_addr learned my addr 172.21.15.5:0/2440649562 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:10.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.971+0000 7fe7d7fff640 1 --2- 172.21.15.5:0/2440649562 >> v2:172.21.15.154:3300/0 conn(0x7fe7e00c8ad0 0x7fe7e00c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:10.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.971+0000 7fe7de59c640 1 -- 172.21.15.5:0/2440649562 >> v2:172.21.15.154:3300/0 conn(0x7fe7e00c8ad0 msgr2=0x7fe7e00c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:10.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.971+0000 7fe7de59c640 1 --2- 172.21.15.5:0/2440649562 >> v2:172.21.15.154:3300/0 conn(0x7fe7e00c8ad0 0x7fe7e00c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:10.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.971+0000 7fe7de59c640 1 -- 172.21.15.5:0/2440649562 >> v1:172.21.15.154:6789/0 conn(0x7fe7e00c9560 legacy=0x7fe7e00cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:10.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.971+0000 7fe7de59c640 1 -- 172.21.15.5:0/2440649562 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e0070c80 con 0x7fe7e0158ce0 2023-07-14T13:09:10.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.975+0000 7fe7de59c640 1 --2- 172.21.15.5:0/2440649562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7e0158ce0 0x7fe7e0070450 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fe7e00c1a30 tx=0x7fe7d001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3eb7dec23aaf46 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:10.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.975+0000 7fe7ddd9b640 1 -- 172.21.15.5:0/2440649562 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e00cba20 con 0x7fe7e0158ce0 2023-07-14T13:09:10.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.975+0000 7fe7ddd9b640 1 -- 172.21.15.5:0/2440649562 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d00a7050 con 0x7fe7e0158ce0 2023-07-14T13:09:10.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.975+0000 7fe7ddd9b640 1 -- 172.21.15.5:0/2440649562 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d00ab820 con 0x7fe7e0158ce0 2023-07-14T13:09:10.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.975+0000 7fe7e4940640 1 -- 172.21.15.5:0/2440649562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7e0158ce0 msgr2=0x7fe7e0070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:10.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.975+0000 7fe7e4940640 1 --2- 172.21.15.5:0/2440649562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7e0158ce0 0x7fe7e0070450 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fe7e00c1a30 tx=0x7fe7d001c370 comp rx=0 tx=0).stop 2023-07-14T13:09:10.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.975+0000 7fe7e4940640 1 -- 172.21.15.5:0/2440649562 shutdown_connections 2023-07-14T13:09:10.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.975+0000 7fe7e4940640 1 --2- 172.21.15.5:0/2440649562 >> v2:172.21.15.154:3300/0 conn(0x7fe7e00c8ad0 0x7fe7e00c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:10.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.975+0000 7fe7e4940640 1 --2- 172.21.15.5:0/2440649562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7e0158ce0 0x7fe7e0070450 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:10.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.975+0000 7fe7e4940640 1 -- 172.21.15.5:0/2440649562 >> 172.21.15.5:0/2440649562 conn(0x7fe7e00afcf0 msgr2=0x7fe7e00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:10.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.975+0000 7fe7e4940640 1 -- 172.21.15.5:0/2440649562 shutdown_connections 2023-07-14T13:09:10.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.975+0000 7fe7e4940640 1 -- 172.21.15.5:0/2440649562 wait complete. 2023-07-14T13:09:10.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.979+0000 7fe7e4940640 1 Processor -- start 2023-07-14T13:09:10.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.979+0000 7fe7e4940640 1 -- start start 2023-07-14T13:09:10.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.979+0000 7fe7e4940640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7e00c8ad0 0x7fe7e0150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:10.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.979+0000 7fe7e4940640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7e00c9560 0x7fe7e0153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:10.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.979+0000 7fe7e4940640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7e0158ce0 0x7fe7e0152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:10.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.979+0000 7fe7e4940640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e0153670 con 0x7fe7e00c8ad0 2023-07-14T13:09:10.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.979+0000 7fe7e4940640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e0154040 con 0x7fe7e0158ce0 2023-07-14T13:09:10.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.979+0000 7fe7e4940640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e0152a60 con 0x7fe7e00c9560 2023-07-14T13:09:10.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.979+0000 7fe7de59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7e00c8ad0 0x7fe7e0150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:10.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.979+0000 7fe7de59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7e00c8ad0 0x7fe7e0150c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37892/0 (socket says 172.21.15.5:37892) 2023-07-14T13:09:10.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.979+0000 7fe7de59c640 1 -- 172.21.15.5:0/2847771391 learned_addr learned my addr 172.21.15.5:0/2847771391 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:10.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.979+0000 7fe7d7fff640 1 --2- 172.21.15.5:0/2847771391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7e00c9560 0x7fe7e0153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:10.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.979+0000 7fe7ded9d640 1 --2- 172.21.15.5:0/2847771391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7e0158ce0 0x7fe7e0152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:10.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.979+0000 7fe7de59c640 1 -- 172.21.15.5:0/2847771391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7e00c9560 msgr2=0x7fe7e0153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:10.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.979+0000 7fe7de59c640 1 --2- 172.21.15.5:0/2847771391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7e00c9560 0x7fe7e0153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:10.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.979+0000 7fe7de59c640 1 -- 172.21.15.5:0/2847771391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7e0158ce0 msgr2=0x7fe7e0152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:10.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.979+0000 7fe7de59c640 1 --2- 172.21.15.5:0/2847771391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7e0158ce0 0x7fe7e0152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:10.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.979+0000 7fe7de59c640 1 -- 172.21.15.5:0/2847771391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d00094d0 con 0x7fe7e00c8ad0 2023-07-14T13:09:10.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.979+0000 7fe7de59c640 1 --2- 172.21.15.5:0/2847771391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7e00c8ad0 0x7fe7e0150c60 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fe7d00ae040 tx=0x7fe7d001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:10.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.979+0000 7fe7d6ffd640 1 -- 172.21.15.5:0/2847771391 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d00b6620 con 0x7fe7e00c8ad0 2023-07-14T13:09:10.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.979+0000 7fe7d6ffd640 1 -- 172.21.15.5:0/2847771391 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d00b67a0 con 0x7fe7e00c8ad0 2023-07-14T13:09:10.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.979+0000 7fe7d6ffd640 1 -- 172.21.15.5:0/2847771391 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d00b6b50 con 0x7fe7e00c8ad0 2023-07-14T13:09:10.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.979+0000 7fe7e4940640 1 -- 172.21.15.5:0/2847771391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e0152d40 con 0x7fe7e00c8ad0 2023-07-14T13:09:10.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.979+0000 7fe7e4940640 1 -- 172.21.15.5:0/2847771391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e0153300 con 0x7fe7e00c8ad0 2023-07-14T13:09:10.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.983+0000 7fe7e4940640 1 -- 172.21.15.5:0/2847771391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7e00ca1a0 con 0x7fe7e00c8ad0 2023-07-14T13:09:10.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.983+0000 7fe7d6ffd640 1 -- 172.21.15.5:0/2847771391 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe7d00b2040 con 0x7fe7e00c8ad0 2023-07-14T13:09:10.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.983+0000 7fe7d6ffd640 1 --2- 172.21.15.5:0/2847771391 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fe7c00663d0 0x7fe7c0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:10.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.983+0000 7fe7d6ffd640 1 -- 172.21.15.5:0/2847771391 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe7d011e370 con 0x7fe7e00c8ad0 2023-07-14T13:09:10.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.983+0000 7fe7d7fff640 1 --2- 172.21.15.5:0/2847771391 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fe7c00663d0 0x7fe7c0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:10.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.987+0000 7fe7d7fff640 1 --2- 172.21.15.5:0/2847771391 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fe7c00663d0 0x7fe7c0068880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0071050 tx=0x7fe7c8008040 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:10.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:09.987+0000 7fe7d6ffd640 1 -- 172.21.15.5:0/2847771391 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe7d00eb5f0 con 0x7fe7e00c8ad0 2023-07-14T13:09:10.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.143+0000 7fe7e4940640 1 -- 172.21.15.5:0/2847771391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7e00678d0 con 0x7fe7e00c8ad0 2023-07-14T13:09:10.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.143+0000 7fe7d6ffd640 1 -- 172.21.15.5:0/2847771391 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+18319 (secure 0 0 0) 0x7fe7d00eec10 con 0x7fe7e00c8ad0 2023-07-14T13:09:10.176 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:10.177 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":96,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:09:08.828324+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:09:06.567743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-14T13:09:07.824380+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:09:10.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.147+0000 7fe7e4940640 1 -- 172.21.15.5:0/2847771391 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fe7c00663d0 msgr2=0x7fe7c0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:10.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.147+0000 7fe7e4940640 1 --2- 172.21.15.5:0/2847771391 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fe7c00663d0 0x7fe7c0068880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0071050 tx=0x7fe7c8008040 comp rx=0 tx=0).stop 2023-07-14T13:09:10.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.147+0000 7fe7e4940640 1 -- 172.21.15.5:0/2847771391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7e00c8ad0 msgr2=0x7fe7e0150c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:10.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.147+0000 7fe7e4940640 1 --2- 172.21.15.5:0/2847771391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7e00c8ad0 0x7fe7e0150c60 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fe7d00ae040 tx=0x7fe7d001abb0 comp rx=0 tx=0).stop 2023-07-14T13:09:10.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.147+0000 7fe7e4940640 1 -- 172.21.15.5:0/2847771391 shutdown_connections 2023-07-14T13:09:10.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.147+0000 7fe7e4940640 1 --2- 172.21.15.5:0/2847771391 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fe7c00663d0 0x7fe7c0068880 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:10.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.147+0000 7fe7e4940640 1 --2- 172.21.15.5:0/2847771391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7e0158ce0 0x7fe7e0152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:10.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.147+0000 7fe7e4940640 1 --2- 172.21.15.5:0/2847771391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7e00c9560 0x7fe7e0153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:10.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.147+0000 7fe7e4940640 1 --2- 172.21.15.5:0/2847771391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7e00c8ad0 0x7fe7e0150c60 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:10.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.147+0000 7fe7e4940640 1 -- 172.21.15.5:0/2847771391 >> 172.21.15.5:0/2847771391 conn(0x7fe7e00afcf0 msgr2=0x7fe7e006b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:10.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.147+0000 7fe7e4940640 1 -- 172.21.15.5:0/2847771391 shutdown_connections 2023-07-14T13:09:10.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.147+0000 7fe7e4940640 1 -- 172.21.15.5:0/2847771391 wait complete. 2023-07-14T13:09:10.198 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-14T13:09:10.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.315+0000 7fdf7af74640 1 Processor -- start 2023-07-14T13:09:10.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.315+0000 7fdf7af74640 1 -- start start 2023-07-14T13:09:10.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.315+0000 7fdf7af74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf74069430 0x7fdf74069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:10.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.315+0000 7fdf7af74640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdf74070f30 0x7fdf740ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:10.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.315+0000 7fdf7af74640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdf740af2b0 0x7fdf7415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:10.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.315+0000 7fdf7af74640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf74159d70 con 0x7fdf74070f30 2023-07-14T13:09:10.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.315+0000 7fdf7af74640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf74069d40 con 0x7fdf740af2b0 2023-07-14T13:09:10.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.315+0000 7fdf7af74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf740c9c60 con 0x7fdf74069430 2023-07-14T13:09:10.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.315+0000 7fdf73fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdf74070f30 0x7fdf740ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:10.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.315+0000 7fdf73fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdf74070f30 0x7fdf740ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37902/0 (socket says 172.21.15.5:37902) 2023-07-14T13:09:10.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.315+0000 7fdf73fff640 1 -- 172.21.15.5:0/3826482666 learned_addr learned my addr 172.21.15.5:0/3826482666 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:10.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.315+0000 7fdf78d10640 1 --2- 172.21.15.5:0/3826482666 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf74069430 0x7fdf74069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:10.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.315+0000 7fdf79511640 1 --2- 172.21.15.5:0/3826482666 >> v2:172.21.15.154:3300/0 conn(0x7fdf740af2b0 0x7fdf7415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:10.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.319+0000 7fdf73fff640 1 -- 172.21.15.5:0/3826482666 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf74069430 msgr2=0x7fdf74069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:10.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.319+0000 7fdf73fff640 1 --2- 172.21.15.5:0/3826482666 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf74069430 0x7fdf74069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:10.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.319+0000 7fdf73fff640 1 -- 172.21.15.5:0/3826482666 >> v2:172.21.15.154:3300/0 conn(0x7fdf740af2b0 msgr2=0x7fdf7415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:10.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.319+0000 7fdf73fff640 1 --2- 172.21.15.5:0/3826482666 >> v2:172.21.15.154:3300/0 conn(0x7fdf740af2b0 0x7fdf7415a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:10.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.319+0000 7fdf73fff640 1 -- 172.21.15.5:0/3826482666 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf740c9f40 con 0x7fdf74070f30 2023-07-14T13:09:10.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.319+0000 7fdf73fff640 1 --2- 172.21.15.5:0/3826482666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf74070f30 0x7fdf740ad6f0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fdf740715f0 tx=0x7fdf6001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c89cc21434b8bb4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:10.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.319+0000 7fdf737fe640 1 -- 172.21.15.5:0/3826482666 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf600aa620 con 0x7fdf74070f30 2023-07-14T13:09:10.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.319+0000 7fdf737fe640 1 -- 172.21.15.5:0/3826482666 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf600aa780 con 0x7fdf74070f30 2023-07-14T13:09:10.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.319+0000 7fdf737fe640 1 -- 172.21.15.5:0/3826482666 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf600aab10 con 0x7fdf74070f30 2023-07-14T13:09:10.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.319+0000 7fdf7af74640 1 -- 172.21.15.5:0/3826482666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf74070f30 msgr2=0x7fdf740ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:10.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.319+0000 7fdf7af74640 1 --2- 172.21.15.5:0/3826482666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf74070f30 0x7fdf740ad6f0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fdf740715f0 tx=0x7fdf6001c500 comp rx=0 tx=0).stop 2023-07-14T13:09:10.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.323+0000 7fdf7af74640 1 -- 172.21.15.5:0/3826482666 shutdown_connections 2023-07-14T13:09:10.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.323+0000 7fdf7af74640 1 --2- 172.21.15.5:0/3826482666 >> v2:172.21.15.154:3300/0 conn(0x7fdf740af2b0 0x7fdf7415a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:10.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.323+0000 7fdf7af74640 1 --2- 172.21.15.5:0/3826482666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf74070f30 0x7fdf740ad6f0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:10.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.323+0000 7fdf7af74640 1 --2- 172.21.15.5:0/3826482666 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf74069430 0x7fdf74069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:10.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.323+0000 7fdf7af74640 1 -- 172.21.15.5:0/3826482666 >> 172.21.15.5:0/3826482666 conn(0x7fdf740cde90 msgr2=0x7fdf740ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:10.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.323+0000 7fdf7af74640 1 -- 172.21.15.5:0/3826482666 shutdown_connections 2023-07-14T13:09:10.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.323+0000 7fdf7af74640 1 -- 172.21.15.5:0/3826482666 wait complete. 2023-07-14T13:09:10.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.323+0000 7fdf7af74640 1 Processor -- start 2023-07-14T13:09:10.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.323+0000 7fdf7af74640 1 -- start start 2023-07-14T13:09:10.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.323+0000 7fdf7af74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf74069430 0x7fdf7414d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:10.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.323+0000 7fdf7af74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf74070f30 0x7fdf740b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:10.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.323+0000 7fdf7af74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf740af2b0 0x7fdf740b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:10.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.323+0000 7fdf7af74640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf741f4110 con 0x7fdf74070f30 2023-07-14T13:09:10.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.323+0000 7fdf7af74640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf741520a0 con 0x7fdf74069430 2023-07-14T13:09:10.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.323+0000 7fdf7af74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf74155920 con 0x7fdf740af2b0 2023-07-14T13:09:10.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.323+0000 7fdf73fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf74070f30 0x7fdf740b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:10.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.323+0000 7fdf73fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf74070f30 0x7fdf740b0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37918/0 (socket says 172.21.15.5:37918) 2023-07-14T13:09:10.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.323+0000 7fdf73fff640 1 -- 172.21.15.5:0/3017174091 learned_addr learned my addr 172.21.15.5:0/3017174091 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:10.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.323+0000 7fdf78d10640 1 --2- 172.21.15.5:0/3017174091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf74069430 0x7fdf7414d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:10.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.323+0000 7fdf79511640 1 --2- 172.21.15.5:0/3017174091 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf740af2b0 0x7fdf740b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:10.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.323+0000 7fdf73fff640 1 -- 172.21.15.5:0/3017174091 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf740af2b0 msgr2=0x7fdf740b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:10.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.323+0000 7fdf73fff640 1 --2- 172.21.15.5:0/3017174091 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf740af2b0 0x7fdf740b13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:10.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.323+0000 7fdf73fff640 1 -- 172.21.15.5:0/3017174091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf74069430 msgr2=0x7fdf7414d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:10.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.323+0000 7fdf73fff640 1 --2- 172.21.15.5:0/3017174091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf74069430 0x7fdf7414d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:10.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.323+0000 7fdf73fff640 1 -- 172.21.15.5:0/3017174091 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf600094d0 con 0x7fdf74070f30 2023-07-14T13:09:10.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.323+0000 7fdf79511640 1 --2- 172.21.15.5:0/3017174091 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf740af2b0 0x7fdf740b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:10.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.323+0000 7fdf73fff640 1 --2- 172.21.15.5:0/3017174091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf74070f30 0x7fdf740b0e70 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fdf6001abb0 tx=0x7fdf6001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:10.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.327+0000 7fdf717fa640 1 -- 172.21.15.5:0/3017174091 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf600aadc0 con 0x7fdf74070f30 2023-07-14T13:09:10.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.327+0000 7fdf717fa640 1 -- 172.21.15.5:0/3017174091 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf600bd3f0 con 0x7fdf74070f30 2023-07-14T13:09:10.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.327+0000 7fdf7af74640 1 -- 172.21.15.5:0/3017174091 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf74155c00 con 0x7fdf74070f30 2023-07-14T13:09:10.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.327+0000 7fdf717fa640 1 -- 172.21.15.5:0/3017174091 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf600bd7a0 con 0x7fdf74070f30 2023-07-14T13:09:10.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.327+0000 7fdf7af74640 1 -- 172.21.15.5:0/3017174091 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf741561c0 con 0x7fdf74070f30 2023-07-14T13:09:10.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.327+0000 7fdf7af74640 1 -- 172.21.15.5:0/3017174091 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf740678d0 con 0x7fdf74070f30 2023-07-14T13:09:10.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.327+0000 7fdf717fa640 1 -- 172.21.15.5:0/3017174091 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdf600b33f0 con 0x7fdf74070f30 2023-07-14T13:09:10.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.327+0000 7fdf717fa640 1 --2- 172.21.15.5:0/3017174091 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fdf580663a0 0x7fdf58068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:10.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.327+0000 7fdf717fa640 1 -- 172.21.15.5:0/3017174091 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdf6011dd40 con 0x7fdf74070f30 2023-07-14T13:09:10.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.327+0000 7fdf78d10640 1 --2- 172.21.15.5:0/3017174091 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fdf580663a0 0x7fdf58068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:10.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.331+0000 7fdf78d10640 1 --2- 172.21.15.5:0/3017174091 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fdf580663a0 0x7fdf58068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdf68009ac0 tx=0x7fdf68009190 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:10.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.331+0000 7fdf717fa640 1 -- 172.21.15.5:0/3017174091 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fdf600eb040 con 0x7fdf74070f30 2023-07-14T13:09:10.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:10.531+0000 7fdf7af74640 1 -- 172.21.15.5:0/3017174091 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdf741563b0 con 0x7fdf74070f30 2023-07-14T13:09:11.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.467+0000 7fdf717fa640 1 -- 172.21.15.5:0/3017174091 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v40) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdf600c3020 con 0x7fdf74070f30 2023-07-14T13:09:11.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.471+0000 7fdf7af74640 1 -- 172.21.15.5:0/3017174091 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fdf580663a0 msgr2=0x7fdf58068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.471+0000 7fdf7af74640 1 --2- 172.21.15.5:0/3017174091 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fdf580663a0 0x7fdf58068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdf68009ac0 tx=0x7fdf68009190 comp rx=0 tx=0).stop 2023-07-14T13:09:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.471+0000 7fdf7af74640 1 -- 172.21.15.5:0/3017174091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf74070f30 msgr2=0x7fdf740b0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.471+0000 7fdf7af74640 1 --2- 172.21.15.5:0/3017174091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf74070f30 0x7fdf740b0e70 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fdf6001abb0 tx=0x7fdf6001ad40 comp rx=0 tx=0).stop 2023-07-14T13:09:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.471+0000 7fdf7af74640 1 -- 172.21.15.5:0/3017174091 shutdown_connections 2023-07-14T13:09:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.471+0000 7fdf7af74640 1 --2- 172.21.15.5:0/3017174091 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fdf580663a0 0x7fdf58068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:11.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.471+0000 7fdf7af74640 1 --2- 172.21.15.5:0/3017174091 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf740af2b0 0x7fdf740b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.471+0000 7fdf7af74640 1 --2- 172.21.15.5:0/3017174091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf74070f30 0x7fdf740b0e70 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.471+0000 7fdf7af74640 1 --2- 172.21.15.5:0/3017174091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf74069430 0x7fdf7414d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.471+0000 7fdf7af74640 1 -- 172.21.15.5:0/3017174091 >> 172.21.15.5:0/3017174091 conn(0x7fdf740cde90 msgr2=0x7fdf740cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.471+0000 7fdf7af74640 1 -- 172.21.15.5:0/3017174091 shutdown_connections 2023-07-14T13:09:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.471+0000 7fdf7af74640 1 -- 172.21.15.5:0/3017174091 wait complete. 2023-07-14T13:09:11.525 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-14T13:09:11.525 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-14T13:09:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f52fad640 1 Processor -- start 2023-07-14T13:09:11.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f52fad640 1 -- start start 2023-07-14T13:09:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f52fad640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1f4c0aeb40 0x7f1f4c15cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f52fad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f4c0aef10 0x7f1f4c158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f52fad640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f4c1532b0 con 0x7f1f4c159270 2023-07-14T13:09:11.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f52fad640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f4c0ca6f0 con 0x7f1f4c0aeb40 2023-07-14T13:09:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f52fad640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c1599d0 con 0x7f1f4c0aef10 2023-07-14T13:09:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f5154a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1f4c159270 0x7f1f4c0c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40252/0 (socket says 172.21.15.5:40252) 2023-07-14T13:09:11.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f5154a640 1 -- 172.21.15.5:0/4294672044 learned_addr learned my addr 172.21.15.5:0/4294672044 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f50d49640 1 --2- 172.21.15.5:0/4294672044 >> v2:172.21.15.154:3300/0 conn(0x7f1f4c0aeb40 0x7f1f4c15cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f4bfff640 1 --2- 172.21.15.5:0/4294672044 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f4c0aef10 0x7f1f4c158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:11.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f4b7fe640 1 -- 172.21.15.5:0/4294672044 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2586593689 0 0) 0x7f1f4c1532b0 con 0x7f1f4c159270 2023-07-14T13:09:11.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f4b7fe640 1 -- 172.21.15.5:0/4294672044 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f3c003530 con 0x7f1f4c159270 2023-07-14T13:09:11.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f4b7fe640 1 -- 172.21.15.5:0/4294672044 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1507785410 0 0) 0x7f1f3c003530 con 0x7f1f4c159270 2023-07-14T13:09:11.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f4b7fe640 1 -- 172.21.15.5:0/4294672044 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f4c0aef10 msgr2=0x7f1f4c158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:11.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f4b7fe640 1 --2- 172.21.15.5:0/4294672044 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f4c0aef10 0x7f1f4c158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:11.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f4b7fe640 1 -- 172.21.15.5:0/4294672044 >> v2:172.21.15.154:3300/0 conn(0x7f1f4c0aeb40 msgr2=0x7f1f4c15cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f4b7fe640 1 --2- 172.21.15.5:0/4294672044 >> v2:172.21.15.154:3300/0 conn(0x7f1f4c0aeb40 0x7f1f4c15cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f4b7fe640 1 -- 172.21.15.5:0/4294672044 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c159cb0 con 0x7f1f4c159270 2023-07-14T13:09:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f4b7fe640 1 -- 172.21.15.5:0/4294672044 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f1f44001a00 con 0x7f1f4c159270 2023-07-14T13:09:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f4b7fe640 1 -- 172.21.15.5:0/4294672044 >> v1:172.21.15.5:6789/0 conn(0x7f1f4c159270 legacy=0x7f1f4c0c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f4b7fe640 1 --2- 172.21.15.5:0/4294672044 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f4c0aef10 0x7f1f3c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f4b7fe640 1 --2- 172.21.15.5:0/4294672044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f3c003f00 0x7f1f3c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:11.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f4b7fe640 1 --2- 172.21.15.5:0/4294672044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f3c004d10 0x7f1f3c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f4b7fe640 1 -- 172.21.15.5:0/4294672044 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c0ca6f0 con 0x7f1f3c003f00 2023-07-14T13:09:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f4b7fe640 1 -- 172.21.15.5:0/4294672044 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c1599d0 con 0x7f1f3c004d10 2023-07-14T13:09:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f4b7fe640 1 -- 172.21.15.5:0/4294672044 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c005990 con 0x7f1f4c0aef10 2023-07-14T13:09:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f4bfff640 1 --2- 172.21.15.5:0/4294672044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f3c003f00 0x7f1f3c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f50d49640 1 --2- 172.21.15.5:0/4294672044 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f4c0aef10 0x7f1f3c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f5154a640 1 --2- 172.21.15.5:0/4294672044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f3c004d10 0x7f1f3c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f4bfff640 1 -- 172.21.15.5:0/4294672044 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f4c0aef10 msgr2=0x7f1f3c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:11.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f4bfff640 1 --2- 172.21.15.5:0/4294672044 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f4c0aef10 0x7f1f3c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f4bfff640 1 -- 172.21.15.5:0/4294672044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f3c004d10 msgr2=0x7f1f3c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f4bfff640 1 --2- 172.21.15.5:0/4294672044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f3c004d10 0x7f1f3c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:11.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.647+0000 7f1f4bfff640 1 -- 172.21.15.5:0/4294672044 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c003530 con 0x7f1f3c003f00 2023-07-14T13:09:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.651+0000 7f1f4bfff640 1 --2- 172.21.15.5:0/4294672044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f3c003f00 0x7f1f3c0047d0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f1f38009ae0 tx=0x7f1f3801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61673c89fbd3ca0c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.651+0000 7f1f4b7fe640 1 -- 172.21.15.5:0/4294672044 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f380a6510 con 0x7f1f3c003f00 2023-07-14T13:09:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.651+0000 7f1f4b7fe640 1 -- 172.21.15.5:0/4294672044 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f380a6670 con 0x7f1f3c003f00 2023-07-14T13:09:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.651+0000 7f1f4b7fe640 1 -- 172.21.15.5:0/4294672044 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f380a6a20 con 0x7f1f3c003f00 2023-07-14T13:09:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.651+0000 7f1f52fad640 1 -- 172.21.15.5:0/4294672044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f3c003f00 msgr2=0x7f1f3c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:11.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.651+0000 7f1f52fad640 1 --2- 172.21.15.5:0/4294672044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f3c003f00 0x7f1f3c0047d0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f1f38009ae0 tx=0x7f1f3801c9c0 comp rx=0 tx=0).stop 2023-07-14T13:09:11.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.651+0000 7f1f5154a640 1 -- 172.21.15.5:0/4294672044 reap_dead start 2023-07-14T13:09:11.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.651+0000 7f1f52fad640 1 -- 172.21.15.5:0/4294672044 shutdown_connections 2023-07-14T13:09:11.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.651+0000 7f1f52fad640 1 -- 172.21.15.5:0/4294672044 >> 172.21.15.5:0/4294672044 conn(0x7f1f4c0cde90 msgr2=0x7f1f4c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:11.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.651+0000 7f1f52fad640 1 -- 172.21.15.5:0/4294672044 shutdown_connections 2023-07-14T13:09:11.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.651+0000 7f1f52fad640 1 -- 172.21.15.5:0/4294672044 wait complete. 2023-07-14T13:09:11.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.655+0000 7f1f52fad640 1 Processor -- start 2023-07-14T13:09:11.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.655+0000 7f1f52fad640 1 -- start start 2023-07-14T13:09:11.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.655+0000 7f1f52fad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f3c003f00 0x7f1f4c14d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:11.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.655+0000 7f1f52fad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f4c0caa90 0x7f1f4c14c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:11.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.655+0000 7f1f52fad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f4c0caf00 0x7f1f4c14cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:11.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.655+0000 7f1f52fad640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c14dbc0 con 0x7f1f4c0caf00 2023-07-14T13:09:11.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.655+0000 7f1f52fad640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c14dea0 con 0x7f1f3c003f00 2023-07-14T13:09:11.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.655+0000 7f1f52fad640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4c14e180 con 0x7f1f4c0caa90 2023-07-14T13:09:11.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.655+0000 7f1f5154a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f4c0caf00 0x7f1f4c14cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:11.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.655+0000 7f1f5154a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f4c0caf00 0x7f1f4c14cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37930/0 (socket says 172.21.15.5:37930) 2023-07-14T13:09:11.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.655+0000 7f1f5154a640 1 -- 172.21.15.5:0/2613408951 learned_addr learned my addr 172.21.15.5:0/2613408951 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:11.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.655+0000 7f1f50d49640 1 --2- 172.21.15.5:0/2613408951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f3c003f00 0x7f1f4c14d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:11.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.655+0000 7f1f4bfff640 1 --2- 172.21.15.5:0/2613408951 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f4c0caa90 0x7f1f4c14c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:11.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.655+0000 7f1f5154a640 1 -- 172.21.15.5:0/2613408951 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f4c0caa90 msgr2=0x7f1f4c14c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:11.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.655+0000 7f1f5154a640 1 --2- 172.21.15.5:0/2613408951 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f4c0caa90 0x7f1f4c14c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:11.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.655+0000 7f1f5154a640 1 -- 172.21.15.5:0/2613408951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f3c003f00 msgr2=0x7f1f4c14d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:11.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.655+0000 7f1f5154a640 1 --2- 172.21.15.5:0/2613408951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f3c003f00 0x7f1f4c14d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:11.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.655+0000 7f1f5154a640 1 -- 172.21.15.5:0/2613408951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c14e460 con 0x7f1f4c0caf00 2023-07-14T13:09:11.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.655+0000 7f1f5154a640 1 --2- 172.21.15.5:0/2613408951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f4c0caf00 0x7f1f4c14cbe0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f1f44001340 tx=0x7f1f44007960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:11.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.655+0000 7f1f497fa640 1 -- 172.21.15.5:0/2613408951 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f44001f10 con 0x7f1f4c0caf00 2023-07-14T13:09:11.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.655+0000 7f1f497fa640 1 -- 172.21.15.5:0/2613408951 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f44014480 con 0x7f1f4c0caf00 2023-07-14T13:09:11.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.655+0000 7f1f497fa640 1 -- 172.21.15.5:0/2613408951 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f44014810 con 0x7f1f4c0caf00 2023-07-14T13:09:11.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.655+0000 7f1f52fad640 1 -- 172.21.15.5:0/2613408951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4c14e740 con 0x7f1f4c0caf00 2023-07-14T13:09:11.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.655+0000 7f1f52fad640 1 -- 172.21.15.5:0/2613408951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4c14d790 con 0x7f1f4c0caf00 2023-07-14T13:09:11.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.659+0000 7f1f52fad640 1 -- 172.21.15.5:0/2613408951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f4c0678d0 con 0x7f1f4c0caf00 2023-07-14T13:09:11.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.659+0000 7f1f497fa640 1 -- 172.21.15.5:0/2613408951 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1f440114f0 con 0x7f1f4c0caf00 2023-07-14T13:09:11.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.659+0000 7f1f497fa640 1 --2- 172.21.15.5:0/2613408951 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f1f300663a0 0x7f1f30068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:11.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.659+0000 7f1f497fa640 1 -- 172.21.15.5:0/2613408951 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1f44083700 con 0x7f1f4c0caf00 2023-07-14T13:09:11.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.659+0000 7f1f50d49640 1 --2- 172.21.15.5:0/2613408951 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f1f300663a0 0x7f1f30068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:11.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.659+0000 7f1f50d49640 1 --2- 172.21.15.5:0/2613408951 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f1f300663a0 0x7f1f30068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c152170 tx=0x7f1f40009190 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:11.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.663+0000 7f1f497fa640 1 -- 172.21.15.5:0/2613408951 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f1f44054510 con 0x7f1f4c0caf00 2023-07-14T13:09:11.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:11.851+0000 7f1f52fad640 1 -- 172.21.15.5:0/2613408951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1f4c159640 con 0x7f1f4c0caf00 2023-07-14T13:09:12.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.479+0000 7f1f497fa640 1 -- 172.21.15.5:0/2613408951 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v41) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1f440540a0 con 0x7f1f4c0caf00 2023-07-14T13:09:12.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.479+0000 7f1f52fad640 1 -- 172.21.15.5:0/2613408951 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f1f300663a0 msgr2=0x7f1f30068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:12.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.479+0000 7f1f52fad640 1 --2- 172.21.15.5:0/2613408951 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f1f300663a0 0x7f1f30068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c152170 tx=0x7f1f40009190 comp rx=0 tx=0).stop 2023-07-14T13:09:12.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.479+0000 7f1f52fad640 1 -- 172.21.15.5:0/2613408951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f4c0caf00 msgr2=0x7f1f4c14cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:12.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.479+0000 7f1f52fad640 1 --2- 172.21.15.5:0/2613408951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f4c0caf00 0x7f1f4c14cbe0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f1f44001340 tx=0x7f1f44007960 comp rx=0 tx=0).stop 2023-07-14T13:09:12.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.479+0000 7f1f52fad640 1 -- 172.21.15.5:0/2613408951 shutdown_connections 2023-07-14T13:09:12.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.479+0000 7f1f52fad640 1 --2- 172.21.15.5:0/2613408951 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f1f300663a0 0x7f1f30068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:12.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.479+0000 7f1f52fad640 1 --2- 172.21.15.5:0/2613408951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f4c0caf00 0x7f1f4c14cbe0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:12.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.479+0000 7f1f52fad640 1 --2- 172.21.15.5:0/2613408951 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f4c0caa90 0x7f1f4c14c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:12.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.479+0000 7f1f52fad640 1 --2- 172.21.15.5:0/2613408951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f3c003f00 0x7f1f4c14d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:12.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.479+0000 7f1f52fad640 1 -- 172.21.15.5:0/2613408951 >> 172.21.15.5:0/2613408951 conn(0x7f1f4c0cde90 msgr2=0x7f1f4c0c3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:12.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.479+0000 7f1f52fad640 1 -- 172.21.15.5:0/2613408951 shutdown_connections 2023-07-14T13:09:12.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.479+0000 7f1f52fad640 1 -- 172.21.15.5:0/2613408951 wait complete. 2023-07-14T13:09:12.533 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-14T13:09:12.534 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:09:12.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.647+0000 7f3daced5640 1 Processor -- start 2023-07-14T13:09:12.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.647+0000 7f3daced5640 1 -- start start 2023-07-14T13:09:12.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.651+0000 7f3daced5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3da815f3f0 0x7f3da80b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:12.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.651+0000 7f3daced5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3da80b7bc0 0x7f3da80cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:12.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.651+0000 7f3daced5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da80b8020 con 0x7f3da80d13f0 2023-07-14T13:09:12.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.651+0000 7f3daced5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da80d0f60 con 0x7f3da80b7bc0 2023-07-14T13:09:12.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.651+0000 7f3daced5640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da80d0390 con 0x7f3da815f3f0 2023-07-14T13:09:12.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.651+0000 7f3da7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3da80b7bc0 0x7f3da80cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:12.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.651+0000 7f3da7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3da80b7bc0 0x7f3da80cd0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37936/0 (socket says 172.21.15.5:37936) 2023-07-14T13:09:12.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.651+0000 7f3da7fff640 1 -- 172.21.15.5:0/1988471682 learned_addr learned my addr 172.21.15.5:0/1988471682 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:12.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.651+0000 7f3da77fe640 1 --2- 172.21.15.5:0/1988471682 >> v2:172.21.15.154:3300/0 conn(0x7f3da815f3f0 0x7f3da80b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:12.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.651+0000 7f3da7fff640 1 -- 172.21.15.5:0/1988471682 >> v2:172.21.15.154:3300/0 conn(0x7f3da815f3f0 msgr2=0x7f3da80b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:12.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.651+0000 7f3da7fff640 1 --2- 172.21.15.5:0/1988471682 >> v2:172.21.15.154:3300/0 conn(0x7f3da815f3f0 0x7f3da80b7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:12.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.651+0000 7f3da7fff640 1 -- 172.21.15.5:0/1988471682 >> v1:172.21.15.154:6789/0 conn(0x7f3da80d13f0 legacy=0x7f3da80cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:12.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.651+0000 7f3da7fff640 1 -- 172.21.15.5:0/1988471682 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da80d0630 con 0x7f3da80b7bc0 2023-07-14T13:09:12.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.655+0000 7f3da7fff640 1 --2- 172.21.15.5:0/1988471682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3da80b7bc0 0x7f3da80cd0b0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f3da80cf890 tx=0x7f3da001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=387b907b8ea7b36f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:12.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.655+0000 7f3da67fc640 1 -- 172.21.15.5:0/1988471682 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da00a56f0 con 0x7f3da80b7bc0 2023-07-14T13:09:12.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.655+0000 7f3da67fc640 1 -- 172.21.15.5:0/1988471682 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da00a5850 con 0x7f3da80b7bc0 2023-07-14T13:09:12.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.655+0000 7f3da67fc640 1 -- 172.21.15.5:0/1988471682 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da00a5be0 con 0x7f3da80b7bc0 2023-07-14T13:09:12.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.655+0000 7f3daced5640 1 -- 172.21.15.5:0/1988471682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3da80b7bc0 msgr2=0x7f3da80cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:12.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.655+0000 7f3daced5640 1 --2- 172.21.15.5:0/1988471682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3da80b7bc0 0x7f3da80cd0b0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f3da80cf890 tx=0x7f3da001c940 comp rx=0 tx=0).stop 2023-07-14T13:09:12.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.655+0000 7f3daced5640 1 -- 172.21.15.5:0/1988471682 shutdown_connections 2023-07-14T13:09:12.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.655+0000 7f3daced5640 1 --2- 172.21.15.5:0/1988471682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3da80b7bc0 0x7f3da80cd0b0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:12.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.655+0000 7f3daced5640 1 --2- 172.21.15.5:0/1988471682 >> v2:172.21.15.154:3300/0 conn(0x7f3da815f3f0 0x7f3da80b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:12.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.655+0000 7f3daced5640 1 -- 172.21.15.5:0/1988471682 >> 172.21.15.5:0/1988471682 conn(0x7f3da8069f50 msgr2=0x7f3da806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:12.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.655+0000 7f3daced5640 1 -- 172.21.15.5:0/1988471682 shutdown_connections 2023-07-14T13:09:12.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.655+0000 7f3daced5640 1 -- 172.21.15.5:0/1988471682 wait complete. 2023-07-14T13:09:12.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.655+0000 7f3daced5640 1 Processor -- start 2023-07-14T13:09:12.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.655+0000 7f3daced5640 1 -- start start 2023-07-14T13:09:12.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.659+0000 7f3daced5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3da80b7bc0 0x7f3da815fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:12.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.659+0000 7f3daced5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3da80d13f0 0x7f3da815ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:12.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.659+0000 7f3daced5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3da815f3f0 0x7f3da8158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:12.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.659+0000 7f3daced5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da815e330 con 0x7f3da80b7bc0 2023-07-14T13:09:12.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.659+0000 7f3daced5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da8158dd0 con 0x7f3da815f3f0 2023-07-14T13:09:12.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.659+0000 7f3daced5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da8159020 con 0x7f3da80d13f0 2023-07-14T13:09:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.659+0000 7f3da77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3da80b7bc0 0x7f3da815fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.659+0000 7f3da77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3da80b7bc0 0x7f3da815fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37952/0 (socket says 172.21.15.5:37952) 2023-07-14T13:09:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.659+0000 7f3da77fe640 1 -- 172.21.15.5:0/499779866 learned_addr learned my addr 172.21.15.5:0/499779866 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.659+0000 7f3da6ffd640 1 --2- 172.21.15.5:0/499779866 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3da80d13f0 0x7f3da815ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.659+0000 7f3da7fff640 1 --2- 172.21.15.5:0/499779866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3da815f3f0 0x7f3da8158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:12.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.659+0000 7f3da77fe640 1 -- 172.21.15.5:0/499779866 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3da80d13f0 msgr2=0x7f3da815ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:12.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.659+0000 7f3da77fe640 1 --2- 172.21.15.5:0/499779866 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3da80d13f0 0x7f3da815ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:12.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.659+0000 7f3da77fe640 1 -- 172.21.15.5:0/499779866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3da815f3f0 msgr2=0x7f3da8158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:12.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.659+0000 7f3da77fe640 1 --2- 172.21.15.5:0/499779866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3da815f3f0 0x7f3da8158600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.659+0000 7f3da77fe640 1 -- 172.21.15.5:0/499779866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da0009b30 con 0x7f3da80b7bc0 2023-07-14T13:09:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.659+0000 7f3da77fe640 1 --2- 172.21.15.5:0/499779866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3da80b7bc0 0x7f3da815fb00 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f3d9800e870 tx=0x7f3d9800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.659+0000 7f3d8ffff640 1 -- 172.21.15.5:0/499779866 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d98009510 con 0x7f3da80b7bc0 2023-07-14T13:09:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.659+0000 7f3d8ffff640 1 -- 172.21.15.5:0/499779866 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9800eec0 con 0x7f3da80b7bc0 2023-07-14T13:09:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.659+0000 7f3d8ffff640 1 -- 172.21.15.5:0/499779866 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9800cb40 con 0x7f3da80b7bc0 2023-07-14T13:09:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.659+0000 7f3daced5640 1 -- 172.21.15.5:0/499779866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da8159300 con 0x7f3da80b7bc0 2023-07-14T13:09:12.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.659+0000 7f3daced5640 1 -- 172.21.15.5:0/499779866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da81598c0 con 0x7f3da80b7bc0 2023-07-14T13:09:12.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.659+0000 7f3daced5640 1 -- 172.21.15.5:0/499779866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da80678d0 con 0x7f3da80b7bc0 2023-07-14T13:09:12.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.663+0000 7f3d8ffff640 1 -- 172.21.15.5:0/499779866 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3d9800cca0 con 0x7f3da80b7bc0 2023-07-14T13:09:12.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.663+0000 7f3d8ffff640 1 --2- 172.21.15.5:0/499779866 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f3d940663a0 0x7f3d94068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.663+0000 7f3d8ffff640 1 -- 172.21.15.5:0/499779866 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3d98083e00 con 0x7f3da80b7bc0 2023-07-14T13:09:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.663+0000 7f3da6ffd640 1 --2- 172.21.15.5:0/499779866 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f3d940663a0 0x7f3d94068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:12.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.663+0000 7f3da6ffd640 1 --2- 172.21.15.5:0/499779866 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f3d940663a0 0x7f3d94068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3da806ae90 tx=0x7f3d9c009040 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:12.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.667+0000 7f3d8ffff640 1 -- 172.21.15.5:0/499779866 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3d98051290 con 0x7f3da80b7bc0 2023-07-14T13:09:12.768 INFO:tasks.ceph.mds.a.smithi005.stderr:2023-07-14T13:09:12.739+0000 7fafff6fd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T13:09:12.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.851+0000 7f3daced5640 1 -- 172.21.15.5:0/499779866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3da80c8960 con 0x7f3da80b7bc0 2023-07-14T13:09:12.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.855+0000 7f3d8ffff640 1 -- 172.21.15.5:0/499779866 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4702 (secure 0 0 0) 0x7f3d98017090 con 0x7f3da80b7bc0 2023-07-14T13:09:12.886 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:12.886 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6901,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/747965975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":747965975},{"type":"v1","addr":"172.21.15.5:6835","nonce":747965975}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6907,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1902785181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1902785181},{"type":"v1","addr":"172.21.15.154:6835","nonce":1902785181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6916,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/90532135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":90532135},{"type":"v1","addr":"172.21.15.154:6837","nonce":90532135}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:09:08.828642+0000","modified":"2023-07-14T13:09:12.468790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7104},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7104":{"gid":7104,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6834/2611471565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2611471565},{"type":"v1","addr":"172.21.15.5:6834","nonce":2611471565}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-14T13:09:12.887 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 41 2023-07-14T13:09:12.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.855+0000 7f3daced5640 1 -- 172.21.15.5:0/499779866 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f3d940663a0 msgr2=0x7f3d94068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:12.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.855+0000 7f3daced5640 1 --2- 172.21.15.5:0/499779866 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f3d940663a0 0x7f3d94068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3da806ae90 tx=0x7f3d9c009040 comp rx=0 tx=0).stop 2023-07-14T13:09:12.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.855+0000 7f3daced5640 1 -- 172.21.15.5:0/499779866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3da80b7bc0 msgr2=0x7f3da815fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:12.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.855+0000 7f3daced5640 1 --2- 172.21.15.5:0/499779866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3da80b7bc0 0x7f3da815fb00 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f3d9800e870 tx=0x7f3d9800ec70 comp rx=0 tx=0).stop 2023-07-14T13:09:12.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.855+0000 7f3daced5640 1 -- 172.21.15.5:0/499779866 shutdown_connections 2023-07-14T13:09:12.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.855+0000 7f3daced5640 1 --2- 172.21.15.5:0/499779866 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f3d940663a0 0x7f3d94068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:12.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.855+0000 7f3daced5640 1 --2- 172.21.15.5:0/499779866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3da815f3f0 0x7f3da8158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:12.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.855+0000 7f3daced5640 1 --2- 172.21.15.5:0/499779866 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3da80d13f0 0x7f3da815ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:12.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.855+0000 7f3daced5640 1 --2- 172.21.15.5:0/499779866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3da80b7bc0 0x7f3da815fb00 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:12.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.855+0000 7f3daced5640 1 -- 172.21.15.5:0/499779866 >> 172.21.15.5:0/499779866 conn(0x7f3da8069f50 msgr2=0x7f3da80c63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:12.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.855+0000 7f3daced5640 1 -- 172.21.15.5:0/499779866 shutdown_connections 2023-07-14T13:09:12.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:12.855+0000 7f3daced5640 1 -- 172.21.15.5:0/499779866 wait complete. 2023-07-14T13:09:12.906 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:09:13.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.019+0000 7f650e634640 1 Processor -- start 2023-07-14T13:09:13.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.019+0000 7f650e634640 1 -- start start 2023-07-14T13:09:13.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.019+0000 7f650e634640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f65080d06b0 0x7f65080b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:13.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.019+0000 7f650e634640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6508145430 0x7f65080b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:13.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.019+0000 7f650e634640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65080b2410 con 0x7f65080b1f70 2023-07-14T13:09:13.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.019+0000 7f650e634640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65080b26f0 con 0x7f65080d06b0 2023-07-14T13:09:13.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.019+0000 7f650e634640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65080b29d0 con 0x7f6508145430 2023-07-14T13:09:13.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.019+0000 7f65077fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6508145430 0x7f65080b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:13.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.019+0000 7f6507fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f65080d06b0 0x7f65080b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:13.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.019+0000 7f6507fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f65080d06b0 0x7f65080b1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:38038/0 (socket says 172.21.15.5:38038) 2023-07-14T13:09:13.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.019+0000 7f6507fff640 1 -- 172.21.15.5:0/4075376984 learned_addr learned my addr 172.21.15.5:0/4075376984 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:13.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.019+0000 7f65077fe640 1 -- 172.21.15.5:0/4075376984 >> v2:172.21.15.154:3300/0 conn(0x7f65080d06b0 msgr2=0x7f65080b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:13.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.019+0000 7f65077fe640 1 --2- 172.21.15.5:0/4075376984 >> v2:172.21.15.154:3300/0 conn(0x7f65080d06b0 0x7f65080b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:13.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.019+0000 7f65077fe640 1 -- 172.21.15.5:0/4075376984 >> v1:172.21.15.154:6789/0 conn(0x7f65080b1f70 legacy=0x7f65080d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:13.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.019+0000 7f65077fe640 1 -- 172.21.15.5:0/4075376984 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65080b2cb0 con 0x7f6508145430 2023-07-14T13:09:13.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.019+0000 7f6506ffd640 1 -- 172.21.15.5:0/4075376984 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104496888 0 0) 0x7f65080b2410 con 0x7f65080b1f70 2023-07-14T13:09:13.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.019+0000 7f6507fff640 1 --2- 172.21.15.5:0/4075376984 >> v2:172.21.15.154:3300/0 conn(0x7f65080d06b0 0x7f65080b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:09:13.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.023+0000 7f65077fe640 1 --2- 172.21.15.5:0/4075376984 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6508145430 0x7f65080b34b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f64fc0097c0 tx=0x7f64fc01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47c3f4d604ef9812 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:13.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.023+0000 7f6506ffd640 1 -- 172.21.15.5:0/4075376984 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc0ab670 con 0x7f6508145430 2023-07-14T13:09:13.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.023+0000 7f6506ffd640 1 -- 172.21.15.5:0/4075376984 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc0ab7d0 con 0x7f6508145430 2023-07-14T13:09:13.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.023+0000 7f6506ffd640 1 -- 172.21.15.5:0/4075376984 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc0abb60 con 0x7f6508145430 2023-07-14T13:09:13.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.023+0000 7f650e634640 1 -- 172.21.15.5:0/4075376984 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6508145430 msgr2=0x7f65080b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:13.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.023+0000 7f650e634640 1 --2- 172.21.15.5:0/4075376984 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6508145430 0x7f65080b34b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f64fc0097c0 tx=0x7f64fc01c450 comp rx=0 tx=0).stop 2023-07-14T13:09:13.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.023+0000 7f650e634640 1 -- 172.21.15.5:0/4075376984 shutdown_connections 2023-07-14T13:09:13.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.023+0000 7f650e634640 1 --2- 172.21.15.5:0/4075376984 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6508145430 0x7f65080b34b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:13.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.023+0000 7f650e634640 1 --2- 172.21.15.5:0/4075376984 >> v2:172.21.15.154:3300/0 conn(0x7f65080d06b0 0x7f65080b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:13.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.023+0000 7f650e634640 1 -- 172.21.15.5:0/4075376984 >> 172.21.15.5:0/4075376984 conn(0x7f65080659d0 msgr2=0x7f650809b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:13.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.023+0000 7f650e634640 1 -- 172.21.15.5:0/4075376984 shutdown_connections 2023-07-14T13:09:13.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.023+0000 7f650e634640 1 -- 172.21.15.5:0/4075376984 wait complete. 2023-07-14T13:09:13.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.027+0000 7f650e634640 1 Processor -- start 2023-07-14T13:09:13.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.027+0000 7f650e634640 1 -- start start 2023-07-14T13:09:13.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.027+0000 7f650e634640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65080b1f70 0x7f65080b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:13.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.027+0000 7f650e634640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65080d06b0 0x7f65081545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:13.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.027+0000 7f650e634640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65081427b0 0x7f6508157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:13.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.027+0000 7f650e634640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6508154ae0 con 0x7f65081427b0 2023-07-14T13:09:13.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.027+0000 7f650e634640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6508156810 con 0x7f65080d06b0 2023-07-14T13:09:13.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.027+0000 7f650e634640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6508157630 con 0x7f65080b1f70 2023-07-14T13:09:13.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.027+0000 7f650cbd1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65081427b0 0x7f6508157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:13.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.027+0000 7f650cbd1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65081427b0 0x7f6508157ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37962/0 (socket says 172.21.15.5:37962) 2023-07-14T13:09:13.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.027+0000 7f650cbd1640 1 -- 172.21.15.5:0/2087048357 learned_addr learned my addr 172.21.15.5:0/2087048357 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:13.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.027+0000 7f65077fe640 1 --2- 172.21.15.5:0/2087048357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65080d06b0 0x7f65081545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:13.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.027+0000 7f6507fff640 1 --2- 172.21.15.5:0/2087048357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65080b1f70 0x7f65080b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:13.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.027+0000 7f650cbd1640 1 -- 172.21.15.5:0/2087048357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65080b1f70 msgr2=0x7f65080b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:13.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.027+0000 7f650cbd1640 1 --2- 172.21.15.5:0/2087048357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65080b1f70 0x7f65080b3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:13.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.027+0000 7f650cbd1640 1 -- 172.21.15.5:0/2087048357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65080d06b0 msgr2=0x7f65081545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:13.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.027+0000 7f650cbd1640 1 --2- 172.21.15.5:0/2087048357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65080d06b0 0x7f65081545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:13.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.027+0000 7f650cbd1640 1 -- 172.21.15.5:0/2087048357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f80094d0 con 0x7f65081427b0 2023-07-14T13:09:13.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.031+0000 7f650cbd1640 1 --2- 172.21.15.5:0/2087048357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65081427b0 0x7f6508157ac0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f650000c780 tx=0x7f650000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:13.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.031+0000 7f6504ff9640 1 -- 172.21.15.5:0/2087048357 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6500003db0 con 0x7f65081427b0 2023-07-14T13:09:13.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.031+0000 7f6504ff9640 1 -- 172.21.15.5:0/2087048357 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650000ce30 con 0x7f65081427b0 2023-07-14T13:09:13.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.031+0000 7f650e634640 1 -- 172.21.15.5:0/2087048357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64fc009420 con 0x7f65081427b0 2023-07-14T13:09:13.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.031+0000 7f6504ff9640 1 -- 172.21.15.5:0/2087048357 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65000052b0 con 0x7f65081427b0 2023-07-14T13:09:13.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.031+0000 7f650e634640 1 -- 172.21.15.5:0/2087048357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6508156a20 con 0x7f65081427b0 2023-07-14T13:09:13.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.031+0000 7f650e634640 1 -- 172.21.15.5:0/2087048357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6508072e70 con 0x7f65081427b0 2023-07-14T13:09:13.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.031+0000 7f6504ff9640 1 -- 172.21.15.5:0/2087048357 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6500005410 con 0x7f65081427b0 2023-07-14T13:09:13.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.031+0000 7f6504ff9640 1 --2- 172.21.15.5:0/2087048357 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f64f40663d0 0x7f64f4068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:13.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.031+0000 7f6504ff9640 1 -- 172.21.15.5:0/2087048357 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6500083ab0 con 0x7f65081427b0 2023-07-14T13:09:13.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.031+0000 7f6507fff640 1 --2- 172.21.15.5:0/2087048357 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f64f40663d0 0x7f64f4068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:13.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.035+0000 7f6507fff640 1 --2- 172.21.15.5:0/2087048357 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f64f40663d0 0x7f64f4068880 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6508158a80 tx=0x7f64f8009240 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:13.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.035+0000 7f6504ff9640 1 -- 172.21.15.5:0/2087048357 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6500050ed0 con 0x7f65081427b0 2023-07-14T13:09:13.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.191+0000 7f650e634640 1 -- 172.21.15.5:0/2087048357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65080678d0 con 0x7f65081427b0 2023-07-14T13:09:13.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.191+0000 7f6504ff9640 1 -- 172.21.15.5:0/2087048357 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+18306 (secure 0 0 0) 0x7f65000544f0 con 0x7f65081427b0 2023-07-14T13:09:13.224 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:13.224 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":97,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:09:10.424823+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:09:06.567743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-14T13:09:07.824380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:09:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.195+0000 7f650e634640 1 -- 172.21.15.5:0/2087048357 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f64f40663d0 msgr2=0x7f64f4068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.195+0000 7f650e634640 1 --2- 172.21.15.5:0/2087048357 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f64f40663d0 0x7f64f4068880 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6508158a80 tx=0x7f64f8009240 comp rx=0 tx=0).stop 2023-07-14T13:09:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.195+0000 7f650e634640 1 -- 172.21.15.5:0/2087048357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65081427b0 msgr2=0x7f6508157ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.195+0000 7f650e634640 1 --2- 172.21.15.5:0/2087048357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65081427b0 0x7f6508157ac0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f650000c780 tx=0x7f650000cc40 comp rx=0 tx=0).stop 2023-07-14T13:09:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.195+0000 7f650e634640 1 -- 172.21.15.5:0/2087048357 shutdown_connections 2023-07-14T13:09:13.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.195+0000 7f650e634640 1 --2- 172.21.15.5:0/2087048357 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f64f40663d0 0x7f64f4068880 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:13.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.195+0000 7f650e634640 1 --2- 172.21.15.5:0/2087048357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65081427b0 0x7f6508157ac0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:13.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.195+0000 7f650e634640 1 --2- 172.21.15.5:0/2087048357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65080d06b0 0x7f65081545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:13.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.195+0000 7f650e634640 1 --2- 172.21.15.5:0/2087048357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65080b1f70 0x7f65080b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:13.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.195+0000 7f650e634640 1 -- 172.21.15.5:0/2087048357 >> 172.21.15.5:0/2087048357 conn(0x7f65080659d0 msgr2=0x7f6508158250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:13.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.195+0000 7f650e634640 1 -- 172.21.15.5:0/2087048357 shutdown_connections 2023-07-14T13:09:13.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.195+0000 7f650e634640 1 -- 172.21.15.5:0/2087048357 wait complete. 2023-07-14T13:09:13.245 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-14T13:09:13.246 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:09:13.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.359+0000 7f3b48311640 1 Processor -- start 2023-07-14T13:09:13.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.359+0000 7f3b48311640 1 -- start start 2023-07-14T13:09:13.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.359+0000 7f3b48311640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b4006b1e0 0x7f3b400c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:13.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.359+0000 7f3b48311640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b400cac70 con 0x7f3b400c21f0 2023-07-14T13:09:13.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.359+0000 7f3b48311640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b400ca060 con 0x7f3b40070b70 2023-07-14T13:09:13.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.359+0000 7f3b48311640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b400ca340 con 0x7f3b4006b1e0 2023-07-14T13:09:13.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.359+0000 7f3b468ae640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3b400c21f0 0x7f3b400cb100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40254/0 (socket says 172.21.15.5:40254) 2023-07-14T13:09:13.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.359+0000 7f3b468ae640 1 -- 172.21.15.5:0/2680515068 learned_addr learned my addr 172.21.15.5:0/2680515068 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:13.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.359+0000 7f3b458ac640 1 --2- 172.21.15.5:0/2680515068 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b4006b1e0 0x7f3b400c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:13.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.359+0000 7f3b450ab640 1 -- 172.21.15.5:0/2680515068 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3099975052 0 0) 0x7f3b400cac70 con 0x7f3b400c21f0 2023-07-14T13:09:13.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.359+0000 7f3b450ab640 1 -- 172.21.15.5:0/2680515068 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b2c003530 con 0x7f3b400c21f0 2023-07-14T13:09:13.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.359+0000 7f3b450ab640 1 -- 172.21.15.5:0/2680515068 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3097347275 0 0) 0x7f3b400ca060 con 0x7f3b40070b70 2023-07-14T13:09:13.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.359+0000 7f3b450ab640 1 -- 172.21.15.5:0/2680515068 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b400cac70 con 0x7f3b40070b70 2023-07-14T13:09:13.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.359+0000 7f3b450ab640 1 -- 172.21.15.5:0/2680515068 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2880599979 0 0) 0x7f3b2c003530 con 0x7f3b400c21f0 2023-07-14T13:09:13.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.359+0000 7f3b458ac640 1 -- 172.21.15.5:0/2680515068 >> v1:172.21.15.154:6789/0 conn(0x7f3b40070b70 legacy=0x7f3b40070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:13.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.359+0000 7f3b458ac640 1 -- 172.21.15.5:0/2680515068 >> v1:172.21.15.5:6789/0 conn(0x7f3b400c21f0 legacy=0x7f3b400cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:13.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.359+0000 7f3b458ac640 1 -- 172.21.15.5:0/2680515068 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b400ca620 con 0x7f3b4006b1e0 2023-07-14T13:09:13.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.363+0000 7f3b458ac640 1 --2- 172.21.15.5:0/2680515068 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b4006b1e0 0x7f3b400c1cb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3b300097f0 tx=0x7f3b3001c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=629881688a521fa server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:13.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.363+0000 7f3b450ab640 1 -- 172.21.15.5:0/2680515068 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b38001a00 con 0x7f3b4006b1e0 2023-07-14T13:09:13.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.363+0000 7f3b450ab640 1 -- 172.21.15.5:0/2680515068 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b300a7050 con 0x7f3b4006b1e0 2023-07-14T13:09:13.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.363+0000 7f3b450ab640 1 -- 172.21.15.5:0/2680515068 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b300ab620 con 0x7f3b4006b1e0 2023-07-14T13:09:13.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.363+0000 7f3b48311640 1 -- 172.21.15.5:0/2680515068 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b4006b1e0 msgr2=0x7f3b400c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:13.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.363+0000 7f3b48311640 1 --2- 172.21.15.5:0/2680515068 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b4006b1e0 0x7f3b400c1cb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3b300097f0 tx=0x7f3b3001c320 comp rx=0 tx=0).stop 2023-07-14T13:09:13.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.363+0000 7f3b48311640 1 -- 172.21.15.5:0/2680515068 shutdown_connections 2023-07-14T13:09:13.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.363+0000 7f3b48311640 1 --2- 172.21.15.5:0/2680515068 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b4006b1e0 0x7f3b400c1cb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:13.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.363+0000 7f3b48311640 1 -- 172.21.15.5:0/2680515068 >> 172.21.15.5:0/2680515068 conn(0x7f3b400afcf0 msgr2=0x7f3b400b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:13.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.363+0000 7f3b48311640 1 -- 172.21.15.5:0/2680515068 shutdown_connections 2023-07-14T13:09:13.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.363+0000 7f3b48311640 1 -- 172.21.15.5:0/2680515068 wait complete. 2023-07-14T13:09:13.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.367+0000 7f3b48311640 1 Processor -- start 2023-07-14T13:09:13.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.367+0000 7f3b48311640 1 -- start start 2023-07-14T13:09:13.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.367+0000 7f3b48311640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b4006b1e0 0x7f3b401477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:13.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.367+0000 7f3b48311640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b40070b70 0x7f3b40144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:13.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.367+0000 7f3b48311640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b400c21f0 0x7f3b400c4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:13.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.367+0000 7f3b48311640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b400c49c0 con 0x7f3b400c21f0 2023-07-14T13:09:13.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.367+0000 7f3b48311640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b401569f0 con 0x7f3b4006b1e0 2023-07-14T13:09:13.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.367+0000 7f3b48311640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b401450e0 con 0x7f3b40070b70 2023-07-14T13:09:13.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.367+0000 7f3b468ae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b400c21f0 0x7f3b400c4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:13.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.367+0000 7f3b468ae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b400c21f0 0x7f3b400c4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37972/0 (socket says 172.21.15.5:37972) 2023-07-14T13:09:13.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.367+0000 7f3b468ae640 1 -- 172.21.15.5:0/152792322 learned_addr learned my addr 172.21.15.5:0/152792322 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:13.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.367+0000 7f3b458ac640 1 --2- 172.21.15.5:0/152792322 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b40070b70 0x7f3b40144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:13.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.367+0000 7f3b460ad640 1 --2- 172.21.15.5:0/152792322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b4006b1e0 0x7f3b401477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:13.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.367+0000 7f3b468ae640 1 -- 172.21.15.5:0/152792322 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b40070b70 msgr2=0x7f3b40144ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:13.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.367+0000 7f3b468ae640 1 --2- 172.21.15.5:0/152792322 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b40070b70 0x7f3b40144ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:13.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.367+0000 7f3b468ae640 1 -- 172.21.15.5:0/152792322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b4006b1e0 msgr2=0x7f3b401477f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:13.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.367+0000 7f3b468ae640 1 --2- 172.21.15.5:0/152792322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b4006b1e0 0x7f3b401477f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:13.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.367+0000 7f3b468ae640 1 -- 172.21.15.5:0/152792322 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b30009420 con 0x7f3b400c21f0 2023-07-14T13:09:13.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.367+0000 7f3b460ad640 1 --2- 172.21.15.5:0/152792322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b4006b1e0 0x7f3b401477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:09:13.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.367+0000 7f3b468ae640 1 --2- 172.21.15.5:0/152792322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b400c21f0 0x7f3b400c4170 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f3b3800cbb0 tx=0x7f3b3800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:13.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.367+0000 7f3b36ffd640 1 -- 172.21.15.5:0/152792322 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3800ace0 con 0x7f3b400c21f0 2023-07-14T13:09:13.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.367+0000 7f3b36ffd640 1 -- 172.21.15.5:0/152792322 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3800ae40 con 0x7f3b400c21f0 2023-07-14T13:09:13.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.367+0000 7f3b48311640 1 -- 172.21.15.5:0/152792322 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b40156050 con 0x7f3b400c21f0 2023-07-14T13:09:13.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.367+0000 7f3b36ffd640 1 -- 172.21.15.5:0/152792322 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b38012620 con 0x7f3b400c21f0 2023-07-14T13:09:13.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.367+0000 7f3b48311640 1 -- 172.21.15.5:0/152792322 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b40156610 con 0x7f3b400c21f0 2023-07-14T13:09:13.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.371+0000 7f3b48311640 1 -- 172.21.15.5:0/152792322 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b40156b30 con 0x7f3b400c21f0 2023-07-14T13:09:13.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.371+0000 7f3b36ffd640 1 -- 172.21.15.5:0/152792322 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3b38007070 con 0x7f3b400c21f0 2023-07-14T13:09:13.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.371+0000 7f3b36ffd640 1 --2- 172.21.15.5:0/152792322 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f3b240663a0 0x7f3b24068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:13.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.371+0000 7f3b36ffd640 1 -- 172.21.15.5:0/152792322 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3b38083fc0 con 0x7f3b400c21f0 2023-07-14T13:09:13.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.371+0000 7f3b460ad640 1 --2- 172.21.15.5:0/152792322 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f3b240663a0 0x7f3b24068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:13.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.375+0000 7f3b460ad640 1 --2- 172.21.15.5:0/152792322 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f3b240663a0 0x7f3b24068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c0011f0 tx=0x7f3b3c009040 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:13.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.375+0000 7f3b36ffd640 1 -- 172.21.15.5:0/152792322 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3b40156b30 con 0x7f3b400c21f0 2023-07-14T13:09:13.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.531+0000 7f3b48311640 1 -- 172.21.15.5:0/152792322 --> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3b400c9cf0 con 0x7f3b240663a0 2023-07-14T13:09:13.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.539+0000 7f3b36ffd640 1 -- 172.21.15.5:0/152792322 <== mgr.6691 v2:172.21.15.154:6832/3243469291 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+304092 (secure 0 0 0) 0x7f3b3c001d10 con 0x7f3b240663a0 2023-07-14T13:09:13.574 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:13.575 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:09:13.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.543+0000 7f3b48311640 1 -- 172.21.15.5:0/152792322 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f3b240663a0 msgr2=0x7f3b24068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:13.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.543+0000 7f3b48311640 1 --2- 172.21.15.5:0/152792322 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f3b240663a0 0x7f3b24068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c0011f0 tx=0x7f3b3c009040 comp rx=0 tx=0).stop 2023-07-14T13:09:13.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.543+0000 7f3b48311640 1 -- 172.21.15.5:0/152792322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b400c21f0 msgr2=0x7f3b400c4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:13.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.543+0000 7f3b48311640 1 --2- 172.21.15.5:0/152792322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b400c21f0 0x7f3b400c4170 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f3b3800cbb0 tx=0x7f3b3800a430 comp rx=0 tx=0).stop 2023-07-14T13:09:13.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.543+0000 7f3b48311640 1 -- 172.21.15.5:0/152792322 shutdown_connections 2023-07-14T13:09:13.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.543+0000 7f3b48311640 1 --2- 172.21.15.5:0/152792322 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f3b240663a0 0x7f3b24068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:13.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.543+0000 7f3b48311640 1 --2- 172.21.15.5:0/152792322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b400c21f0 0x7f3b400c4170 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:13.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.543+0000 7f3b48311640 1 --2- 172.21.15.5:0/152792322 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b40070b70 0x7f3b40144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:13.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.543+0000 7f3b48311640 1 --2- 172.21.15.5:0/152792322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b4006b1e0 0x7f3b401477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:13.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.543+0000 7f3b48311640 1 -- 172.21.15.5:0/152792322 >> 172.21.15.5:0/152792322 conn(0x7f3b400afcf0 msgr2=0x7f3b40155440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:13.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.543+0000 7f3b48311640 1 -- 172.21.15.5:0/152792322 shutdown_connections 2023-07-14T13:09:13.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.543+0000 7f3b48311640 1 -- 172.21.15.5:0/152792322 wait complete. 2023-07-14T13:09:13.595 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-14T13:09:12.334175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591110,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":302,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":118,"acting":118,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":315168,"kb_used_data":10208,"kb_used_omap":0,"kb_used_meta":304896,"kb_avail":754659552,"statfs":{"total":773094113280,"available":772771381248,"internally_reserved":0,"allocated":10452992,"data_stored":5819512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312213504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.915413"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.430093+0000","last_change":"2023-07-14T13:09:09.446176+0000","last_active":"2023-07-14T13:09:10.430093+0000","last_peered":"2023-07-14T13:09:10.430093+0000","last_clean":"2023-07-14T13:09:10.430093+0000","last_became_active":"2023-07-14T13:09:09.445293+0000","last_became_peered":"2023-07-14T13:09:09.445293+0000","last_unstale":"2023-07-14T13:09:10.430093+0000","last_undegraded":"2023-07-14T13:09:10.430093+0000","last_fullsized":"2023-07-14T13:09:10.430093+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:33:21.009243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034775+0000","last_change":"2023-07-14T13:09:09.448668+0000","last_active":"2023-07-14T13:09:12.034775+0000","last_peered":"2023-07-14T13:09:12.034775+0000","last_clean":"2023-07-14T13:09:12.034775+0000","last_became_active":"2023-07-14T13:09:09.448371+0000","last_became_peered":"2023-07-14T13:09:09.448371+0000","last_unstale":"2023-07-14T13:09:12.034775+0000","last_undegraded":"2023-07-14T13:09:12.034775+0000","last_fullsized":"2023-07-14T13:09:12.034775+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:48:39.755881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892686+0000","last_change":"2023-07-14T13:09:09.454198+0000","last_active":"2023-07-14T13:09:11.892686+0000","last_peered":"2023-07-14T13:09:11.892686+0000","last_clean":"2023-07-14T13:09:11.892686+0000","last_became_active":"2023-07-14T13:09:09.453939+0000","last_became_peered":"2023-07-14T13:09:09.453939+0000","last_unstale":"2023-07-14T13:09:11.892686+0000","last_undegraded":"2023-07-14T13:09:11.892686+0000","last_fullsized":"2023-07-14T13:09:11.892686+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:22:29.316898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033830+0000","last_change":"2023-07-14T13:09:09.466445+0000","last_active":"2023-07-14T13:09:12.033830+0000","last_peered":"2023-07-14T13:09:12.033830+0000","last_clean":"2023-07-14T13:09:12.033830+0000","last_became_active":"2023-07-14T13:09:09.466235+0000","last_became_peered":"2023-07-14T13:09:09.466235+0000","last_unstale":"2023-07-14T13:09:12.033830+0000","last_undegraded":"2023-07-14T13:09:12.033830+0000","last_fullsized":"2023-07-14T13:09:12.033830+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:42:41.071144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892478+0000","last_change":"2023-07-14T13:09:09.444492+0000","last_active":"2023-07-14T13:09:11.892478+0000","last_peered":"2023-07-14T13:09:11.892478+0000","last_clean":"2023-07-14T13:09:11.892478+0000","last_became_active":"2023-07-14T13:09:09.444047+0000","last_became_peered":"2023-07-14T13:09:09.444047+0000","last_unstale":"2023-07-14T13:09:11.892478+0000","last_undegraded":"2023-07-14T13:09:11.892478+0000","last_fullsized":"2023-07-14T13:09:11.892478+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:09:58.802715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429956+0000","last_change":"2023-07-14T13:09:09.452430+0000","last_active":"2023-07-14T13:09:10.429956+0000","last_peered":"2023-07-14T13:09:10.429956+0000","last_clean":"2023-07-14T13:09:10.429956+0000","last_became_active":"2023-07-14T13:09:09.449894+0000","last_became_peered":"2023-07-14T13:09:09.449894+0000","last_unstale":"2023-07-14T13:09:10.429956+0000","last_undegraded":"2023-07-14T13:09:10.429956+0000","last_fullsized":"2023-07-14T13:09:10.429956+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:48:14.007032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892830+0000","last_change":"2023-07-14T13:09:09.469561+0000","last_active":"2023-07-14T13:09:11.892830+0000","last_peered":"2023-07-14T13:09:11.892830+0000","last_clean":"2023-07-14T13:09:11.892830+0000","last_became_active":"2023-07-14T13:09:09.469257+0000","last_became_peered":"2023-07-14T13:09:09.469257+0000","last_unstale":"2023-07-14T13:09:11.892830+0000","last_undegraded":"2023-07-14T13:09:11.892830+0000","last_fullsized":"2023-07-14T13:09:11.892830+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:54:26.926217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034246+0000","last_change":"2023-07-14T13:09:09.465984+0000","last_active":"2023-07-14T13:09:12.034246+0000","last_peered":"2023-07-14T13:09:12.034246+0000","last_clean":"2023-07-14T13:09:12.034246+0000","last_became_active":"2023-07-14T13:09:09.465297+0000","last_became_peered":"2023-07-14T13:09:09.465297+0000","last_unstale":"2023-07-14T13:09:12.034246+0000","last_undegraded":"2023-07-14T13:09:12.034246+0000","last_fullsized":"2023-07-14T13:09:12.034246+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:36:51.749103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429563+0000","last_change":"2023-07-14T13:09:09.447329+0000","last_active":"2023-07-14T13:09:10.429563+0000","last_peered":"2023-07-14T13:09:10.429563+0000","last_clean":"2023-07-14T13:09:10.429563+0000","last_became_active":"2023-07-14T13:09:09.447000+0000","last_became_peered":"2023-07-14T13:09:09.447000+0000","last_unstale":"2023-07-14T13:09:10.429563+0000","last_undegraded":"2023-07-14T13:09:10.429563+0000","last_fullsized":"2023-07-14T13:09:10.429563+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:25:22.872941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892937+0000","last_change":"2023-07-14T13:09:09.455889+0000","last_active":"2023-07-14T13:09:11.892937+0000","last_peered":"2023-07-14T13:09:11.892937+0000","last_clean":"2023-07-14T13:09:11.892937+0000","last_became_active":"2023-07-14T13:09:09.455632+0000","last_became_peered":"2023-07-14T13:09:09.455632+0000","last_unstale":"2023-07-14T13:09:11.892937+0000","last_undegraded":"2023-07-14T13:09:11.892937+0000","last_fullsized":"2023-07-14T13:09:11.892937+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:29:40.244587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034806+0000","last_change":"2023-07-14T13:09:09.450337+0000","last_active":"2023-07-14T13:09:12.034806+0000","last_peered":"2023-07-14T13:09:12.034806+0000","last_clean":"2023-07-14T13:09:12.034806+0000","last_became_active":"2023-07-14T13:09:09.450041+0000","last_became_peered":"2023-07-14T13:09:09.450041+0000","last_unstale":"2023-07-14T13:09:12.034806+0000","last_undegraded":"2023-07-14T13:09:12.034806+0000","last_fullsized":"2023-07-14T13:09:12.034806+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:25:09.990529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034503+0000","last_change":"2023-07-14T13:09:09.457178+0000","last_active":"2023-07-14T13:09:12.034503+0000","last_peered":"2023-07-14T13:09:12.034503+0000","last_clean":"2023-07-14T13:09:12.034503+0000","last_became_active":"2023-07-14T13:09:09.456873+0000","last_became_peered":"2023-07-14T13:09:09.456873+0000","last_unstale":"2023-07-14T13:09:12.034503+0000","last_undegraded":"2023-07-14T13:09:12.034503+0000","last_fullsized":"2023-07-14T13:09:12.034503+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:13:42.988795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892699+0000","last_change":"2023-07-14T13:09:09.449996+0000","last_active":"2023-07-14T13:09:11.892699+0000","last_peered":"2023-07-14T13:09:11.892699+0000","last_clean":"2023-07-14T13:09:11.892699+0000","last_became_active":"2023-07-14T13:09:09.449678+0000","last_became_peered":"2023-07-14T13:09:09.449678+0000","last_unstale":"2023-07-14T13:09:11.892699+0000","last_undegraded":"2023-07-14T13:09:11.892699+0000","last_fullsized":"2023-07-14T13:09:11.892699+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:58:24.472482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892490+0000","last_change":"2023-07-14T13:09:09.469085+0000","last_active":"2023-07-14T13:09:11.892490+0000","last_peered":"2023-07-14T13:09:11.892490+0000","last_clean":"2023-07-14T13:09:11.892490+0000","last_became_active":"2023-07-14T13:09:09.468814+0000","last_became_peered":"2023-07-14T13:09:09.468814+0000","last_unstale":"2023-07-14T13:09:11.892490+0000","last_undegraded":"2023-07-14T13:09:11.892490+0000","last_fullsized":"2023-07-14T13:09:11.892490+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:11:15.830663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429728+0000","last_change":"2023-07-14T13:09:09.459438+0000","last_active":"2023-07-14T13:09:10.429728+0000","last_peered":"2023-07-14T13:09:10.429728+0000","last_clean":"2023-07-14T13:09:10.429728+0000","last_became_active":"2023-07-14T13:09:09.459180+0000","last_became_peered":"2023-07-14T13:09:09.459180+0000","last_unstale":"2023-07-14T13:09:10.429728+0000","last_undegraded":"2023-07-14T13:09:10.429728+0000","last_fullsized":"2023-07-14T13:09:10.429728+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:51:06.800504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.430164+0000","last_change":"2023-07-14T13:09:09.455611+0000","last_active":"2023-07-14T13:09:10.430164+0000","last_peered":"2023-07-14T13:09:10.430164+0000","last_clean":"2023-07-14T13:09:10.430164+0000","last_became_active":"2023-07-14T13:09:09.455121+0000","last_became_peered":"2023-07-14T13:09:09.455121+0000","last_unstale":"2023-07-14T13:09:10.430164+0000","last_undegraded":"2023-07-14T13:09:10.430164+0000","last_fullsized":"2023-07-14T13:09:10.430164+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:03:49.784846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892820+0000","last_change":"2023-07-14T13:09:09.454892+0000","last_active":"2023-07-14T13:09:11.892820+0000","last_peered":"2023-07-14T13:09:11.892820+0000","last_clean":"2023-07-14T13:09:11.892820+0000","last_became_active":"2023-07-14T13:09:09.454598+0000","last_became_peered":"2023-07-14T13:09:09.454598+0000","last_unstale":"2023-07-14T13:09:11.892820+0000","last_undegraded":"2023-07-14T13:09:11.892820+0000","last_fullsized":"2023-07-14T13:09:11.892820+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:02:23.849786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429732+0000","last_change":"2023-07-14T13:09:09.446033+0000","last_active":"2023-07-14T13:09:10.429732+0000","last_peered":"2023-07-14T13:09:10.429732+0000","last_clean":"2023-07-14T13:09:10.429732+0000","last_became_active":"2023-07-14T13:09:09.445481+0000","last_became_peered":"2023-07-14T13:09:09.445481+0000","last_unstale":"2023-07-14T13:09:10.429732+0000","last_undegraded":"2023-07-14T13:09:10.429732+0000","last_fullsized":"2023-07-14T13:09:10.429732+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:52:51.943223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033999+0000","last_change":"2023-07-14T13:09:09.445955+0000","last_active":"2023-07-14T13:09:12.033999+0000","last_peered":"2023-07-14T13:09:12.033999+0000","last_clean":"2023-07-14T13:09:12.033999+0000","last_became_active":"2023-07-14T13:09:09.445618+0000","last_became_peered":"2023-07-14T13:09:09.445618+0000","last_unstale":"2023-07-14T13:09:12.033999+0000","last_undegraded":"2023-07-14T13:09:12.033999+0000","last_fullsized":"2023-07-14T13:09:12.033999+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:13:42.533007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033987+0000","last_change":"2023-07-14T13:09:09.450411+0000","last_active":"2023-07-14T13:09:12.033987+0000","last_peered":"2023-07-14T13:09:12.033987+0000","last_clean":"2023-07-14T13:09:12.033987+0000","last_became_active":"2023-07-14T13:09:09.450124+0000","last_became_peered":"2023-07-14T13:09:09.450124+0000","last_unstale":"2023-07-14T13:09:12.033987+0000","last_undegraded":"2023-07-14T13:09:12.033987+0000","last_fullsized":"2023-07-14T13:09:12.033987+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:17:47.890949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"96'4","reported_seq":17,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892923+0000","last_change":"2023-07-14T13:09:08.444497+0000","last_active":"2023-07-14T13:09:11.892923+0000","last_peered":"2023-07-14T13:09:11.892923+0000","last_clean":"2023-07-14T13:09:11.892923+0000","last_became_active":"2023-07-14T13:09:08.444214+0000","last_became_peered":"2023-07-14T13:09:08.444214+0000","last_unstale":"2023-07-14T13:09:11.892923+0000","last_undegraded":"2023-07-14T13:09:11.892923+0000","last_fullsized":"2023-07-14T13:09:11.892923+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:51:45.905778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429570+0000","last_change":"2023-07-14T13:09:09.458943+0000","last_active":"2023-07-14T13:09:10.429570+0000","last_peered":"2023-07-14T13:09:10.429570+0000","last_clean":"2023-07-14T13:09:10.429570+0000","last_became_active":"2023-07-14T13:09:09.455757+0000","last_became_peered":"2023-07-14T13:09:09.455757+0000","last_unstale":"2023-07-14T13:09:10.429570+0000","last_undegraded":"2023-07-14T13:09:10.429570+0000","last_fullsized":"2023-07-14T13:09:10.429570+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:45:39.572860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429834+0000","last_change":"2023-07-14T13:09:09.447229+0000","last_active":"2023-07-14T13:09:10.429834+0000","last_peered":"2023-07-14T13:09:10.429834+0000","last_clean":"2023-07-14T13:09:10.429834+0000","last_became_active":"2023-07-14T13:09:09.446944+0000","last_became_peered":"2023-07-14T13:09:09.446944+0000","last_unstale":"2023-07-14T13:09:10.429834+0000","last_undegraded":"2023-07-14T13:09:10.429834+0000","last_fullsized":"2023-07-14T13:09:10.429834+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:58:11.945700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.430015+0000","last_change":"2023-07-14T13:09:09.445796+0000","last_active":"2023-07-14T13:09:10.430015+0000","last_peered":"2023-07-14T13:09:10.430015+0000","last_clean":"2023-07-14T13:09:10.430015+0000","last_became_active":"2023-07-14T13:09:09.445514+0000","last_became_peered":"2023-07-14T13:09:09.445514+0000","last_unstale":"2023-07-14T13:09:10.430015+0000","last_undegraded":"2023-07-14T13:09:10.430015+0000","last_fullsized":"2023-07-14T13:09:10.430015+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:02:59.884389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429710+0000","last_change":"2023-07-14T13:09:08.443183+0000","last_active":"2023-07-14T13:09:10.429710+0000","last_peered":"2023-07-14T13:09:10.429710+0000","last_clean":"2023-07-14T13:09:10.429710+0000","last_became_active":"2023-07-14T13:09:08.442696+0000","last_became_peered":"2023-07-14T13:09:08.442696+0000","last_unstale":"2023-07-14T13:09:10.429710+0000","last_undegraded":"2023-07-14T13:09:10.429710+0000","last_fullsized":"2023-07-14T13:09:10.429710+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:30:50.273654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892594+0000","last_change":"2023-07-14T13:09:08.433369+0000","last_active":"2023-07-14T13:09:11.892594+0000","last_peered":"2023-07-14T13:09:11.892594+0000","last_clean":"2023-07-14T13:09:11.892594+0000","last_became_active":"2023-07-14T13:09:08.431724+0000","last_became_peered":"2023-07-14T13:09:08.431724+0000","last_unstale":"2023-07-14T13:09:11.892594+0000","last_undegraded":"2023-07-14T13:09:11.892594+0000","last_fullsized":"2023-07-14T13:09:11.892594+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:12:54.167527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429571+0000","last_change":"2023-07-14T13:09:09.447525+0000","last_active":"2023-07-14T13:09:10.429571+0000","last_peered":"2023-07-14T13:09:10.429571+0000","last_clean":"2023-07-14T13:09:10.429571+0000","last_became_active":"2023-07-14T13:09:09.446162+0000","last_became_peered":"2023-07-14T13:09:09.446162+0000","last_unstale":"2023-07-14T13:09:10.429571+0000","last_undegraded":"2023-07-14T13:09:10.429571+0000","last_fullsized":"2023-07-14T13:09:10.429571+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:22.698260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034350+0000","last_change":"2023-07-14T13:09:09.453933+0000","last_active":"2023-07-14T13:09:12.034350+0000","last_peered":"2023-07-14T13:09:12.034350+0000","last_clean":"2023-07-14T13:09:12.034350+0000","last_became_active":"2023-07-14T13:09:09.453610+0000","last_became_peered":"2023-07-14T13:09:09.453610+0000","last_unstale":"2023-07-14T13:09:12.034350+0000","last_undegraded":"2023-07-14T13:09:12.034350+0000","last_fullsized":"2023-07-14T13:09:12.034350+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:24:39.457351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"96'3","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892897+0000","last_change":"2023-07-14T13:09:08.437217+0000","last_active":"2023-07-14T13:09:11.892897+0000","last_peered":"2023-07-14T13:09:11.892897+0000","last_clean":"2023-07-14T13:09:11.892897+0000","last_became_active":"2023-07-14T13:09:08.436904+0000","last_became_peered":"2023-07-14T13:09:08.436904+0000","last_unstale":"2023-07-14T13:09:11.892897+0000","last_undegraded":"2023-07-14T13:09:11.892897+0000","last_fullsized":"2023-07-14T13:09:11.892897+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:33:17.679033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034191+0000","last_change":"2023-07-14T13:09:09.449362+0000","last_active":"2023-07-14T13:09:12.034191+0000","last_peered":"2023-07-14T13:09:12.034191+0000","last_clean":"2023-07-14T13:09:12.034191+0000","last_became_active":"2023-07-14T13:09:09.448691+0000","last_became_peered":"2023-07-14T13:09:09.448691+0000","last_unstale":"2023-07-14T13:09:12.034191+0000","last_undegraded":"2023-07-14T13:09:12.034191+0000","last_fullsized":"2023-07-14T13:09:12.034191+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:11:22.058932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892506+0000","last_change":"2023-07-14T13:09:08.443228+0000","last_active":"2023-07-14T13:09:11.892506+0000","last_peered":"2023-07-14T13:09:11.892506+0000","last_clean":"2023-07-14T13:09:11.892506+0000","last_became_active":"2023-07-14T13:09:08.442874+0000","last_became_peered":"2023-07-14T13:09:08.442874+0000","last_unstale":"2023-07-14T13:09:11.892506+0000","last_undegraded":"2023-07-14T13:09:11.892506+0000","last_fullsized":"2023-07-14T13:09:11.892506+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:38:31.212301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"96'8","reported_seq":21,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429919+0000","last_change":"2023-07-14T13:09:08.443086+0000","last_active":"2023-07-14T13:09:10.429919+0000","last_peered":"2023-07-14T13:09:10.429919+0000","last_clean":"2023-07-14T13:09:10.429919+0000","last_became_active":"2023-07-14T13:09:08.442793+0000","last_became_peered":"2023-07-14T13:09:08.442793+0000","last_unstale":"2023-07-14T13:09:10.429919+0000","last_undegraded":"2023-07-14T13:09:10.429919+0000","last_fullsized":"2023-07-14T13:09:10.429919+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:22:53.283592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"97'1","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.891853+0000","last_change":"2023-07-14T13:09:08.447067+0000","last_active":"2023-07-14T13:09:11.891853+0000","last_peered":"2023-07-14T13:09:11.891853+0000","last_clean":"2023-07-14T13:09:11.891853+0000","last_became_active":"2023-07-14T13:09:08.446799+0000","last_became_peered":"2023-07-14T13:09:08.446799+0000","last_unstale":"2023-07-14T13:09:11.891853+0000","last_undegraded":"2023-07-14T13:09:11.891853+0000","last_fullsized":"2023-07-14T13:09:11.891853+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:28:21.757335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429786+0000","last_change":"2023-07-14T13:09:09.445848+0000","last_active":"2023-07-14T13:09:10.429786+0000","last_peered":"2023-07-14T13:09:10.429786+0000","last_clean":"2023-07-14T13:09:10.429786+0000","last_became_active":"2023-07-14T13:09:09.445068+0000","last_became_peered":"2023-07-14T13:09:09.445068+0000","last_unstale":"2023-07-14T13:09:10.429786+0000","last_undegraded":"2023-07-14T13:09:10.429786+0000","last_fullsized":"2023-07-14T13:09:10.429786+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:25:09.202126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892633+0000","last_change":"2023-07-14T13:09:08.443277+0000","last_active":"2023-07-14T13:09:11.892633+0000","last_peered":"2023-07-14T13:09:11.892633+0000","last_clean":"2023-07-14T13:09:11.892633+0000","last_became_active":"2023-07-14T13:09:08.442915+0000","last_became_peered":"2023-07-14T13:09:08.442915+0000","last_unstale":"2023-07-14T13:09:11.892633+0000","last_undegraded":"2023-07-14T13:09:11.892633+0000","last_fullsized":"2023-07-14T13:09:11.892633+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:48:52.995190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034856+0000","last_change":"2023-07-14T13:09:09.463272+0000","last_active":"2023-07-14T13:09:12.034856+0000","last_peered":"2023-07-14T13:09:12.034856+0000","last_clean":"2023-07-14T13:09:12.034856+0000","last_became_active":"2023-07-14T13:09:09.462912+0000","last_became_peered":"2023-07-14T13:09:09.462912+0000","last_unstale":"2023-07-14T13:09:12.034856+0000","last_undegraded":"2023-07-14T13:09:12.034856+0000","last_fullsized":"2023-07-14T13:09:12.034856+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:28:41.067336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034922+0000","last_change":"2023-07-14T13:09:09.445631+0000","last_active":"2023-07-14T13:09:12.034922+0000","last_peered":"2023-07-14T13:09:12.034922+0000","last_clean":"2023-07-14T13:09:12.034922+0000","last_became_active":"2023-07-14T13:09:09.445366+0000","last_became_peered":"2023-07-14T13:09:09.445366+0000","last_unstale":"2023-07-14T13:09:12.034922+0000","last_undegraded":"2023-07-14T13:09:12.034922+0000","last_fullsized":"2023-07-14T13:09:12.034922+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:47:59.705980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034027+0000","last_change":"2023-07-14T13:09:08.441197+0000","last_active":"2023-07-14T13:09:12.034027+0000","last_peered":"2023-07-14T13:09:12.034027+0000","last_clean":"2023-07-14T13:09:12.034027+0000","last_became_active":"2023-07-14T13:09:08.440996+0000","last_became_peered":"2023-07-14T13:09:08.440996+0000","last_unstale":"2023-07-14T13:09:12.034027+0000","last_undegraded":"2023-07-14T13:09:12.034027+0000","last_fullsized":"2023-07-14T13:09:12.034027+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:08:34.441857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034521+0000","last_change":"2023-07-14T13:09:08.446105+0000","last_active":"2023-07-14T13:09:12.034521+0000","last_peered":"2023-07-14T13:09:12.034521+0000","last_clean":"2023-07-14T13:09:12.034521+0000","last_became_active":"2023-07-14T13:09:08.445697+0000","last_became_peered":"2023-07-14T13:09:08.445697+0000","last_unstale":"2023-07-14T13:09:12.034521+0000","last_undegraded":"2023-07-14T13:09:12.034521+0000","last_fullsized":"2023-07-14T13:09:12.034521+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:00:10.980521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"85'183","reported_seq":539,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-07-14T13:09:05.200783+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:09:05.200783+0000","last_peered":"2023-07-14T13:09:05.200783+0000","last_clean":"2023-07-14T13:09:05.200783+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:09:05.200783+0000","last_undegraded":"2023-07-14T13:09:05.200783+0000","last_fullsized":"2023-07-14T13:09:05.200783+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:11:42.664390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":148,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-07-14T13:09:05.200774+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:09:05.200774+0000","last_peered":"2023-07-14T13:09:05.200774+0000","last_clean":"2023-07-14T13:09:05.200774+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:09:05.200774+0000","last_undegraded":"2023-07-14T13:09:05.200774+0000","last_fullsized":"2023-07-14T13:09:05.200774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:24:29.586540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.430147+0000","last_change":"2023-07-14T13:09:09.445181+0000","last_active":"2023-07-14T13:09:10.430147+0000","last_peered":"2023-07-14T13:09:10.430147+0000","last_clean":"2023-07-14T13:09:10.430147+0000","last_became_active":"2023-07-14T13:09:09.439207+0000","last_became_peered":"2023-07-14T13:09:09.439207+0000","last_unstale":"2023-07-14T13:09:10.430147+0000","last_undegraded":"2023-07-14T13:09:10.430147+0000","last_fullsized":"2023-07-14T13:09:10.430147+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:29:51.451099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033893+0000","last_change":"2023-07-14T13:09:08.445355+0000","last_active":"2023-07-14T13:09:12.033893+0000","last_peered":"2023-07-14T13:09:12.033893+0000","last_clean":"2023-07-14T13:09:12.033893+0000","last_became_active":"2023-07-14T13:09:08.445081+0000","last_became_peered":"2023-07-14T13:09:08.445081+0000","last_unstale":"2023-07-14T13:09:12.033893+0000","last_undegraded":"2023-07-14T13:09:12.033893+0000","last_fullsized":"2023-07-14T13:09:12.033893+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:02:41.574353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-07-14T13:09:05.200636+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:09:05.200636+0000","last_peered":"2023-07-14T13:09:05.200636+0000","last_clean":"2023-07-14T13:09:05.200636+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:09:05.200636+0000","last_undegraded":"2023-07-14T13:09:05.200636+0000","last_fullsized":"2023-07-14T13:09:05.200636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:13:13.014415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033787+0000","last_change":"2023-07-14T13:09:08.444592+0000","last_active":"2023-07-14T13:09:12.033787+0000","last_peered":"2023-07-14T13:09:12.033787+0000","last_clean":"2023-07-14T13:09:12.033787+0000","last_became_active":"2023-07-14T13:09:08.444313+0000","last_became_peered":"2023-07-14T13:09:08.444313+0000","last_unstale":"2023-07-14T13:09:12.033787+0000","last_undegraded":"2023-07-14T13:09:12.033787+0000","last_fullsized":"2023-07-14T13:09:12.033787+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:26:10.415790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":150,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892700+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:09:11.892700+0000","last_peered":"2023-07-14T13:09:11.892700+0000","last_clean":"2023-07-14T13:09:11.892700+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:09:11.892700+0000","last_undegraded":"2023-07-14T13:09:11.892700+0000","last_fullsized":"2023-07-14T13:09:11.892700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:50:36.399832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429987+0000","last_change":"2023-07-14T13:09:09.455678+0000","last_active":"2023-07-14T13:09:10.429987+0000","last_peered":"2023-07-14T13:09:10.429987+0000","last_clean":"2023-07-14T13:09:10.429987+0000","last_became_active":"2023-07-14T13:09:09.455373+0000","last_became_peered":"2023-07-14T13:09:09.455373+0000","last_unstale":"2023-07-14T13:09:10.429987+0000","last_undegraded":"2023-07-14T13:09:10.429987+0000","last_fullsized":"2023-07-14T13:09:10.429987+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:46:27.362227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"96'2","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034498+0000","last_change":"2023-07-14T13:09:08.441285+0000","last_active":"2023-07-14T13:09:12.034498+0000","last_peered":"2023-07-14T13:09:12.034498+0000","last_clean":"2023-07-14T13:09:12.034498+0000","last_became_active":"2023-07-14T13:09:08.440995+0000","last_became_peered":"2023-07-14T13:09:08.440995+0000","last_unstale":"2023-07-14T13:09:12.034498+0000","last_undegraded":"2023-07-14T13:09:12.034498+0000","last_fullsized":"2023-07-14T13:09:12.034498+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:52:51.529066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":148,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-07-14T13:09:05.200750+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:09:05.200750+0000","last_peered":"2023-07-14T13:09:05.200750+0000","last_clean":"2023-07-14T13:09:05.200750+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:09:05.200750+0000","last_undegraded":"2023-07-14T13:09:05.200750+0000","last_fullsized":"2023-07-14T13:09:05.200750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:07:46.968763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892570+0000","last_change":"2023-07-14T13:09:09.448817+0000","last_active":"2023-07-14T13:09:11.892570+0000","last_peered":"2023-07-14T13:09:11.892570+0000","last_clean":"2023-07-14T13:09:11.892570+0000","last_became_active":"2023-07-14T13:09:09.448520+0000","last_became_peered":"2023-07-14T13:09:09.448520+0000","last_unstale":"2023-07-14T13:09:11.892570+0000","last_undegraded":"2023-07-14T13:09:11.892570+0000","last_fullsized":"2023-07-14T13:09:11.892570+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:53:13.224188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"96'1","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892913+0000","last_change":"2023-07-14T13:09:08.440049+0000","last_active":"2023-07-14T13:09:11.892913+0000","last_peered":"2023-07-14T13:09:11.892913+0000","last_clean":"2023-07-14T13:09:11.892913+0000","last_became_active":"2023-07-14T13:09:08.439676+0000","last_became_peered":"2023-07-14T13:09:08.439676+0000","last_unstale":"2023-07-14T13:09:11.892913+0000","last_undegraded":"2023-07-14T13:09:11.892913+0000","last_fullsized":"2023-07-14T13:09:11.892913+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:14:18.335021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":164,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034634+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:09:12.034634+0000","last_peered":"2023-07-14T13:09:12.034634+0000","last_clean":"2023-07-14T13:09:12.034634+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:09:12.034634+0000","last_undegraded":"2023-07-14T13:09:12.034634+0000","last_fullsized":"2023-07-14T13:09:12.034634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:07:38.092074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034347+0000","last_change":"2023-07-14T13:09:09.453843+0000","last_active":"2023-07-14T13:09:12.034347+0000","last_peered":"2023-07-14T13:09:12.034347+0000","last_clean":"2023-07-14T13:09:12.034347+0000","last_became_active":"2023-07-14T13:09:09.453556+0000","last_became_peered":"2023-07-14T13:09:09.453556+0000","last_unstale":"2023-07-14T13:09:12.034347+0000","last_undegraded":"2023-07-14T13:09:12.034347+0000","last_fullsized":"2023-07-14T13:09:12.034347+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:46:26.111226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034192+0000","last_change":"2023-07-14T13:09:08.448203+0000","last_active":"2023-07-14T13:09:12.034192+0000","last_peered":"2023-07-14T13:09:12.034192+0000","last_clean":"2023-07-14T13:09:12.034192+0000","last_became_active":"2023-07-14T13:09:08.447855+0000","last_became_peered":"2023-07-14T13:09:08.447855+0000","last_unstale":"2023-07-14T13:09:12.034192+0000","last_undegraded":"2023-07-14T13:09:12.034192+0000","last_fullsized":"2023-07-14T13:09:12.034192+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:41:24.859927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":148,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-07-14T13:09:05.200784+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:09:05.200784+0000","last_peered":"2023-07-14T13:09:05.200784+0000","last_clean":"2023-07-14T13:09:05.200784+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:09:05.200784+0000","last_undegraded":"2023-07-14T13:09:05.200784+0000","last_fullsized":"2023-07-14T13:09:05.200784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:03:39.427825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033787+0000","last_change":"2023-07-14T13:09:09.468504+0000","last_active":"2023-07-14T13:09:12.033787+0000","last_peered":"2023-07-14T13:09:12.033787+0000","last_clean":"2023-07-14T13:09:12.033787+0000","last_became_active":"2023-07-14T13:09:09.468224+0000","last_became_peered":"2023-07-14T13:09:09.468224+0000","last_unstale":"2023-07-14T13:09:12.033787+0000","last_undegraded":"2023-07-14T13:09:12.033787+0000","last_fullsized":"2023-07-14T13:09:12.033787+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:15:08.881840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":164,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034886+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:09:12.034886+0000","last_peered":"2023-07-14T13:09:12.034886+0000","last_clean":"2023-07-14T13:09:12.034886+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:09:12.034886+0000","last_undegraded":"2023-07-14T13:09:12.034886+0000","last_fullsized":"2023-07-14T13:09:12.034886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:23:14.929289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892460+0000","last_change":"2023-07-14T13:09:09.455863+0000","last_active":"2023-07-14T13:09:11.892460+0000","last_peered":"2023-07-14T13:09:11.892460+0000","last_clean":"2023-07-14T13:09:11.892460+0000","last_became_active":"2023-07-14T13:09:09.455594+0000","last_became_peered":"2023-07-14T13:09:09.455594+0000","last_unstale":"2023-07-14T13:09:11.892460+0000","last_undegraded":"2023-07-14T13:09:11.892460+0000","last_fullsized":"2023-07-14T13:09:11.892460+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:01.249886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":146,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-07-14T13:09:05.200910+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:09:05.200910+0000","last_peered":"2023-07-14T13:09:05.200910+0000","last_clean":"2023-07-14T13:09:05.200910+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:09:05.200910+0000","last_undegraded":"2023-07-14T13:09:05.200910+0000","last_fullsized":"2023-07-14T13:09:05.200910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:47:16.844849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":70,"acting":70,"num_store_stats":4},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":742,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":30,"acting":30,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575046,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54880,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316960,"statfs":{"total":96636764160,"available":96580567040,"internally_reserved":0,"allocated":1728512,"data_stored":1158664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.51500000000000001,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.98299999999999998,"5min":0.98399999999999999,"15min":1.879},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.56799999999999995,"5min":0.44,"15min":0.439},"max":{"1min":1.054,"5min":1.054,"15min":1.9059999999999999},"last":1.1259999999999999}]},{"osd":1,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73899999999999999,"15min":0.73599999999999999},"min":{"1min":0.504,"5min":0.434,"15min":0.42999999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.069},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.749,"15min":0.746},"min":{"1min":0.54400000000000004,"5min":0.48999999999999999,"15min":0.40500000000000003},"max":{"1min":0.93999999999999995,"5min":0.97399999999999998,"15min":1.1020000000000001},"last":0.95599999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73899999999999999,"15min":0.72799999999999998},"min":{"1min":0.52700000000000002,"5min":0.46999999999999997,"15min":0.40600000000000003},"max":{"1min":0.88100000000000001,"5min":0.98899999999999999,"15min":1.048},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.747,"15min":0.752},"min":{"1min":0.47499999999999998,"5min":0.47199999999999998,"15min":0.46899999999999997},"max":{"1min":0.91300000000000003,"5min":0.97099999999999997,"15min":1.0169999999999999},"last":1.0069999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.746,"15min":0.73399999999999999},"min":{"1min":0.59399999999999997,"5min":0.503,"15min":0.442},"max":{"1min":0.88400000000000001,"5min":1.0269999999999999,"15min":1.0760000000000001},"last":1.161},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.755,"15min":0.75700000000000001},"min":{"1min":0.60199999999999998,"5min":0.47299999999999998,"15min":0.41499999999999998},"max":{"1min":0.91600000000000004,"5min":1.018,"15min":1.024},"last":0.92600000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.44400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.82099999999999995,"5min":1.0009999999999999,"15min":1.022},"last":0.501},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.41799999999999998,"5min":0.40999999999999998,"15min":0.39300000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59699999999999998,"15min":0.60599999999999998},"min":{"1min":0.39300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.0249999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63400000000000001,"15min":0.65600000000000003},"min":{"1min":0.41999999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.69199999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68400000000000005,"15min":0.70099999999999996},"min":{"1min":0.45200000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.99299999999999999,"5min":1.0489999999999999,"15min":1.4419999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.67600000000000005},"min":{"1min":0.46999999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81200000000000006,"5min":0.95799999999999996,"15min":1.575},"last":0.72599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575047,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":1134592,"data_stored":568296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.57799999999999996,"5min":0.38,"15min":0.38},"max":{"1min":0.90400000000000003,"5min":0.996,"15min":1.2749999999999999},"last":0.874},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.72499999999999998,"15min":0.74199999999999999},"min":{"1min":0.53600000000000003,"5min":0.48199999999999998,"15min":0.47399999999999998},"max":{"1min":0.98199999999999998,"5min":1.0800000000000001,"15min":1.2110000000000001},"last":0.77700000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73599999999999999,"15min":0.752},"min":{"1min":0.48299999999999998,"5min":0.47399999999999998,"15min":0.379},"max":{"1min":0.90900000000000003,"5min":1.0089999999999999,"15min":1.4299999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70799999999999996,"15min":0.72599999999999998},"min":{"1min":0.56999999999999995,"5min":0.46999999999999997,"15min":0.44},"max":{"1min":0.86899999999999999,"5min":0.97099999999999997,"15min":1.1379999999999999},"last":0.72599999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.73899999999999999,"15min":0.754},"min":{"1min":0.55800000000000005,"5min":0.45900000000000002,"15min":0.40400000000000003},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":1.319},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.755,"15min":0.75600000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.42299999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.341},"last":0.69099999999999995}]},{"osd":3,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76000000000000001,"15min":0.78100000000000003},"min":{"1min":0.51000000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.054,"5min":1.054,"15min":1.3859999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.52400000000000002,"5min":0.48399999999999999,"15min":0.45900000000000002},"max":{"1min":0.94799999999999995,"5min":0.99099999999999999,"15min":1.1080000000000001},"last":0.82299999999999995}]},{"osd":4,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.97899999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.624,"15min":0.63900000000000001},"min":{"1min":0.47399999999999998,"5min":0.38500000000000001,"15min":0.36099999999999999},"max":{"1min":0.93500000000000005,"5min":1.012,"15min":1.091},"last":0.66200000000000003}]},{"osd":5,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64100000000000001,"15min":0.64700000000000002},"min":{"1min":0.499,"5min":0.37,"15min":0.37},"max":{"1min":0.96599999999999997,"5min":1.579,"15min":1.579},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67800000000000005,"15min":0.69399999999999995},"min":{"1min":0.46700000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.145},"last":0.74099999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.438,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.208},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.499,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0209999999999999,"5min":1.657,"15min":1.657},"last":0.63600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575046,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1134592,"data_stored":568296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.70799999999999996,"15min":0.73099999999999998},"min":{"1min":0.376,"5min":0.36499999999999999,"15min":0.32400000000000001},"max":{"1min":0.91500000000000004,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.432},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68799999999999994,"15min":0.73299999999999998},"min":{"1min":0.41699999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.86099999999999999,"5min":1.083,"15min":1.083},"last":0.503}]},{"osd":1,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69899999999999995,"15min":0.72699999999999998},"min":{"1min":0.46899999999999997,"5min":0.44500000000000001,"15min":0.41099999999999998},"max":{"1min":0.85199999999999998,"5min":1.05,"15min":1.079},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73299999999999998,"15min":0.747},"min":{"1min":0.48999999999999999,"5min":0.48699999999999999,"15min":0.36799999999999999},"max":{"1min":0.94599999999999995,"5min":2.706,"15min":2.706},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71299999999999997,"15min":0.73899999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86299999999999999,"5min":1.212,"15min":1.212},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.70499999999999996,"15min":0.73499999999999999},"min":{"1min":0.44800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89200000000000002,"5min":1.181,"15min":1.181},"last":0.66400000000000003}]},{"osd":3,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73299999999999998,"15min":0.748},"min":{"1min":0.48599999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.876,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72799999999999998,"15min":0.76000000000000001},"min":{"1min":0.47299999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90800000000000003,"5min":1.304,"15min":1.304},"last":0.77000000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64000000000000001,"15min":0.629},"min":{"1min":0.437,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.85399999999999998,"5min":1.129,"15min":1.129},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.39900000000000002,"5min":0.36299999999999999,"15min":0.35899999999999999},"max":{"1min":0.84499999999999997,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.68500000000000005}]},{"osd":6,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.60399999999999998,"15min":0.61399999999999999},"min":{"1min":0.41999999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90200000000000002,"5min":1.169,"15min":1.169},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.64400000000000002,"15min":0.64100000000000001},"min":{"1min":0.39400000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.83699999999999997,"5min":1.238,"15min":1.238},"last":0.70899999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66100000000000003,"15min":0.64300000000000002},"min":{"1min":0.45500000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93300000000000005,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68200000000000005,"15min":0.67800000000000005},"min":{"1min":0.48999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90100000000000002,"5min":1.407,"15min":1.407},"last":0.79400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575046,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32156,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":1134592,"data_stored":568296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.73999999999999999,"15min":0.73499999999999999},"min":{"1min":0.56200000000000006,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92400000000000004,"5min":1.411,"15min":1.411},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.76800000000000002,"15min":0.73199999999999998},"min":{"1min":0.64000000000000001,"5min":0.45800000000000002,"15min":0.435},"max":{"1min":0.94599999999999995,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.83199999999999996}]},{"osd":1,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77000000000000002,"15min":0.751},"min":{"1min":0.62,"5min":0.47999999999999998,"15min":0.442},"max":{"1min":0.90700000000000003,"5min":1.077,"15min":1.077},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.54600000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91900000000000004,"5min":1.0469999999999999,"15min":1.2370000000000001},"last":0.89400000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.749,"15min":0.73599999999999999},"min":{"1min":0.60799999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.95599999999999996,"5min":1.091,"15min":1.091},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79800000000000004,"15min":0.77600000000000002},"min":{"1min":0.60399999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98199999999999998,"5min":1.387,"15min":1.387},"last":0.52100000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75,"15min":0.748},"min":{"1min":0.58099999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84799999999999998,"5min":1.008,"15min":1.099},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77500000000000002,"15min":0.77300000000000002},"min":{"1min":0.64700000000000002,"5min":0.496,"15min":0.46800000000000003},"max":{"1min":0.98699999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.61699999999999999,"15min":0.60499999999999998},"min":{"1min":0.437,"5min":0.378,"15min":0.378},"max":{"1min":0.76400000000000001,"5min":0.95599999999999996,"15min":1.0029999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.627,"15min":0.61799999999999999},"min":{"1min":0.52400000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85799999999999998,"5min":0.93600000000000005,"15min":0.95199999999999996},"last":0.57599999999999996}]},{"osd":6,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.621,"15min":0.62},"min":{"1min":0.48699999999999999,"5min":0.38900000000000001,"15min":0.32300000000000001},"max":{"1min":0.873,"5min":1.014,"15min":1.014},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.51900000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.94599999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.86599999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.68200000000000005,"15min":0.67100000000000004},"min":{"1min":0.57199999999999995,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93200000000000005,"5min":0.94699999999999995,"15min":1.0349999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.55800000000000005,"5min":0.40300000000000002,"15min":0.36899999999999999},"max":{"1min":0.96899999999999997,"5min":1.0629999999999999,"15min":1.1080000000000001},"last":0.91800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575047,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36292,"kb_used_data":1148,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335548,"statfs":{"total":96636764160,"available":96599601152,"internally_reserved":0,"allocated":1175552,"data_stored":588804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.26200000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.84199999999999997},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.498,"15min":0.51500000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.60799999999999998,"5min":0.77300000000000002,"15min":1.0209999999999999},"last":0.46800000000000003}]},{"osd":1,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47199999999999998,"15min":0.47499999999999998},"min":{"1min":0.33100000000000002,"5min":0.315,"15min":0.29599999999999999},"max":{"1min":0.63900000000000001,"5min":0.77200000000000002,"15min":0.79600000000000004},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67800000000000005,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.40699999999999997}]},{"osd":2,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54100000000000004,"15min":0.56999999999999995},"min":{"1min":0.38200000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.72399999999999998,"5min":0.82599999999999996,"15min":0.95899999999999996},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60699999999999998,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86599999999999999,"5min":1.663,"15min":1.663},"last":0.48499999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.748,"15min":0.76500000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":0.90900000000000003,"5min":1.284,"15min":1.284},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76800000000000002,"15min":0.78900000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.47699999999999998},"max":{"1min":1.0660000000000001,"5min":1.121,"15min":1.196},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.52400000000000002},"max":{"1min":1.0229999999999999,"5min":1.306,"15min":1.306},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77900000000000003,"15min":0.79100000000000004},"min":{"1min":0.58099999999999996,"5min":0.372,"15min":0.372},"max":{"1min":0.97399999999999998,"5min":1.1870000000000001,"15min":1.2470000000000001},"last":0.57299999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.76800000000000002,"15min":0.78000000000000003},"min":{"1min":0.50600000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96599999999999997,"5min":1.105,"15min":1.117},"last":0.625},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.79700000000000004,"15min":0.81799999999999995},"min":{"1min":0.56299999999999994,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.93999999999999995,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.83299999999999996,"15min":0.84099999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53100000000000003},"max":{"1min":0.89900000000000002,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.53500000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0009999999999999,"5min":1.595,"15min":1.595},"last":0.65600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575047,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58440,"kb_used_data":1152,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313400,"statfs":{"total":96636764160,"available":96576921600,"internally_reserved":0,"allocated":1179648,"data_stored":587945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45900000000000002,"15min":0.46800000000000003},"min":{"1min":0.29199999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.84699999999999998,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.54200000000000004,"15min":0.53300000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.70799999999999996,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.65500000000000003}]},{"osd":1,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.48299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30399999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65500000000000003,"5min":2.7200000000000002,"15min":2.7200000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.499,"5min":0.55000000000000004,"15min":0.56299999999999994},"min":{"1min":0.36299999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78300000000000003,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":0.61199999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.64500000000000002,"15min":0.60399999999999998},"min":{"1min":0.39500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71699999999999997,"5min":8.2530000000000001,"15min":8.2530000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89600000000000002,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.74199999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.754,"15min":0.78100000000000003},"min":{"1min":0.53200000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.99399999999999999,"5min":1.0940000000000001,"15min":1.1499999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.56699999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0629999999999999,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.76500000000000001}]},{"osd":5,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.84399999999999997,"15min":0.85799999999999998},"min":{"1min":0.58599999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1319999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.879},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82499999999999996,"15min":0.83999999999999997},"min":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.433},"max":{"1min":1.153,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.92400000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.78700000000000003,"15min":0.80400000000000005},"min":{"1min":0.57299999999999995,"5min":0.48999999999999999,"15min":0.47599999999999998},"max":{"1min":0.93999999999999995,"5min":3.9849999999999999,"15min":3.9849999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80200000000000005,"15min":0.81299999999999994},"min":{"1min":0.60699999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0289999999999999,"5min":3.391,"15min":3.391},"last":0.82799999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.79600000000000004,"15min":0.82199999999999995},"min":{"1min":0.55000000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.1759999999999999,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.81499999999999995,"15min":0.82299999999999995},"min":{"1min":0.60199999999999998,"5min":0.53200000000000003,"15min":0.50900000000000001},"max":{"1min":1.0940000000000001,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.89100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575048,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":1191936,"data_stored":594987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.29199999999999998,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.53700000000000003,"5min":0.65400000000000003,"15min":0.77200000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.28199999999999997,"15min":0.26500000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.41899999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47199999999999998,"15min":0.47299999999999998},"min":{"1min":0.34300000000000003,"5min":0.32100000000000001,"15min":0.29499999999999998},"max":{"1min":0.54200000000000004,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65100000000000002,"5min":1.014,"15min":1.014},"last":0.52300000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.621,"15min":0.63600000000000001},"min":{"1min":0.48199999999999998,"5min":0.44700000000000001,"15min":0.437},"max":{"1min":0.73899999999999999,"5min":0.80500000000000005,"15min":0.96299999999999997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56499999999999995,"15min":0.57999999999999996},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.50600000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77700000000000002,"15min":0.78400000000000003},"min":{"1min":0.55500000000000005,"5min":0.51600000000000001,"15min":0.40000000000000002},"max":{"1min":1.0409999999999999,"5min":1.2110000000000001,"15min":1.236},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77200000000000002,"15min":0.78600000000000003},"min":{"1min":0.57499999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.0309999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.77500000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.60799999999999998,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.55800000000000005,"5min":0.48599999999999999,"15min":0.48199999999999998},"max":{"1min":1.0940000000000001,"5min":1.2749999999999999,"15min":1.3600000000000001},"last":0.85399999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.53800000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1.0580000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.80500000000000005,"15min":0.81399999999999995},"min":{"1min":0.56100000000000005,"5min":0.52200000000000002,"15min":0.49199999999999999},"max":{"1min":1.1319999999999999,"5min":1.262,"15min":1.2969999999999999},"last":0.752}]},{"osd":7,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.47799999999999998},"max":{"1min":1.1479999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.82099999999999995,"15min":0.84099999999999997},"min":{"1min":0.58499999999999996,"5min":0.53700000000000003,"15min":0.52800000000000002},"max":{"1min":1.2070000000000001,"5min":1.327,"15min":1.327},"last":0.90800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575049,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36876,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334964,"statfs":{"total":96636764160,"available":96599003136,"internally_reserved":0,"allocated":1773568,"data_stored":1184224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.45600000000000002,"15min":0.44700000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.61199999999999999,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.49099999999999999,"15min":0.51500000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.27700000000000002},"max":{"1min":0.61799999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.36599999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.51900000000000002,"15min":0.51100000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69699999999999995,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.54000000000000004,"15min":0.55300000000000005},"min":{"1min":0.39800000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63800000000000001,"5min":0.80300000000000005,"15min":0.90300000000000002},"last":0.441}]},{"osd":3,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.504},"min":{"1min":0.36399999999999999,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.67600000000000005,"5min":0.72999999999999998,"15min":0.84999999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82899999999999996,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76900000000000002,"15min":0.78800000000000003},"min":{"1min":0.56100000000000005,"5min":0.48399999999999999,"15min":0.44400000000000001},"max":{"1min":0.90500000000000003,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.878},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.53500000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.038,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.91700000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.77100000000000002,"15min":0.80600000000000005},"min":{"1min":0.55100000000000005,"5min":0.51800000000000002,"15min":0.47899999999999998},"max":{"1min":0.80500000000000005,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.56399999999999995,"5min":0.49299999999999999,"15min":0.47299999999999998},"max":{"1min":0.97299999999999998,"5min":1.325,"15min":1.325},"last":0.93999999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.79100000000000004,"15min":0.80600000000000005},"min":{"1min":0.53500000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91400000000000003,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78900000000000003,"15min":0.81499999999999995},"min":{"1min":0.58399999999999996,"5min":0.55500000000000005,"15min":0.41299999999999998},"max":{"1min":1.0900000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.98099999999999998}]},{"osd":7,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.79800000000000004,"15min":0.83199999999999996},"min":{"1min":0.57699999999999996,"5min":0.503,"15min":0.45500000000000002},"max":{"1min":0.93799999999999994,"5min":1.171,"15min":1.2749999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.77100000000000002,"15min":0.81100000000000005},"min":{"1min":0.50600000000000001,"5min":0.502,"15min":0.497},"max":{"1min":0.95199999999999996,"5min":1.381,"15min":1.381},"last":0.77300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:09:13.602 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:09:13.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.755+0000 7f5c65374640 1 Processor -- start 2023-07-14T13:09:13.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.755+0000 7f5c65374640 1 -- start start 2023-07-14T13:09:13.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.755+0000 7f5c65374640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5c600707f0 0x7f5c601632f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:13.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.755+0000 7f5c65374640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c600ccaa0 con 0x7f5c6006c100 2023-07-14T13:09:13.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.755+0000 7f5c65374640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c600ccce0 con 0x7f5c600cc650 2023-07-14T13:09:13.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.755+0000 7f5c65374640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c600ccfc0 con 0x7f5c600707f0 2023-07-14T13:09:13.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.755+0000 7f5c5effd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5c6006c100 0x7f5c6006c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40266/0 (socket says 172.21.15.5:40266) 2023-07-14T13:09:13.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.755+0000 7f5c5effd640 1 -- 172.21.15.5:0/2955984554 learned_addr learned my addr 172.21.15.5:0/2955984554 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:13.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.755+0000 7f5c5f7fe640 1 --2- 172.21.15.5:0/2955984554 >> v2:172.21.15.154:3300/0 conn(0x7f5c600707f0 0x7f5c601632f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:13.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.755+0000 7f5c5dffb640 1 -- 172.21.15.5:0/2955984554 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570379666 0 0) 0x7f5c50001120 con 0x7f5c6006c100 2023-07-14T13:09:13.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.755+0000 7f5c5dffb640 1 -- 172.21.15.5:0/2955984554 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c48003530 con 0x7f5c6006c100 2023-07-14T13:09:13.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.755+0000 7f5c5f7fe640 1 -- 172.21.15.5:0/2955984554 >> v1:172.21.15.154:6789/0 conn(0x7f5c600cc650 legacy=0x7f5c600c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:13.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.755+0000 7f5c5f7fe640 1 -- 172.21.15.5:0/2955984554 >> v1:172.21.15.5:6789/0 conn(0x7f5c6006c100 legacy=0x7f5c6006c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:13.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.755+0000 7f5c5dffb640 1 -- 172.21.15.5:0/2955984554 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1965513297 0 0) 0x7f5c48003530 con 0x7f5c6006c100 2023-07-14T13:09:13.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.755+0000 7f5c5f7fe640 1 -- 172.21.15.5:0/2955984554 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c600cd2a0 con 0x7f5c600707f0 2023-07-14T13:09:13.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.759+0000 7f5c5f7fe640 1 --2- 172.21.15.5:0/2955984554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c600707f0 0x7f5c601632f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5c58009d90 tx=0x7f5c58021270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3116ea78ea9c67a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:13.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.759+0000 7f5c5dffb640 1 -- 172.21.15.5:0/2955984554 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c50001810 con 0x7f5c600707f0 2023-07-14T13:09:13.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.759+0000 7f5c5dffb640 1 -- 172.21.15.5:0/2955984554 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c580ad050 con 0x7f5c600707f0 2023-07-14T13:09:13.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.759+0000 7f5c5dffb640 1 -- 172.21.15.5:0/2955984554 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c580b1600 con 0x7f5c600707f0 2023-07-14T13:09:13.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.759+0000 7f5c65374640 1 -- 172.21.15.5:0/2955984554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c600707f0 msgr2=0x7f5c601632f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:13.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.759+0000 7f5c65374640 1 --2- 172.21.15.5:0/2955984554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c600707f0 0x7f5c601632f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5c58009d90 tx=0x7f5c58021270 comp rx=0 tx=0).stop 2023-07-14T13:09:13.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.759+0000 7f5c65374640 1 -- 172.21.15.5:0/2955984554 shutdown_connections 2023-07-14T13:09:13.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.759+0000 7f5c65374640 1 --2- 172.21.15.5:0/2955984554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c600707f0 0x7f5c601632f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:13.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.759+0000 7f5c65374640 1 -- 172.21.15.5:0/2955984554 >> 172.21.15.5:0/2955984554 conn(0x7f5c600ce9d0 msgr2=0x7f5c600ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:13.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.759+0000 7f5c65374640 1 -- 172.21.15.5:0/2955984554 shutdown_connections 2023-07-14T13:09:13.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.759+0000 7f5c65374640 1 -- 172.21.15.5:0/2955984554 wait complete. 2023-07-14T13:09:13.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.763+0000 7f5c65374640 1 Processor -- start 2023-07-14T13:09:13.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.763+0000 7f5c65374640 1 -- start start 2023-07-14T13:09:13.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.763+0000 7f5c65374640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c6006c100 0x7f5c600b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:13.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.763+0000 7f5c65374640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c600707f0 0x7f5c60157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:13.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.763+0000 7f5c65374640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c600cc650 0x7f5c601510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:13.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.763+0000 7f5c65374640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c600b3c50 con 0x7f5c600707f0 2023-07-14T13:09:13.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.763+0000 7f5c65374640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c600c7ac0 con 0x7f5c6006c100 2023-07-14T13:09:13.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.763+0000 7f5c65374640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c601524b0 con 0x7f5c600cc650 2023-07-14T13:09:13.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.763+0000 7f5c5e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c600707f0 0x7f5c60157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:13.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.763+0000 7f5c5e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c600707f0 0x7f5c60157610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37986/0 (socket says 172.21.15.5:37986) 2023-07-14T13:09:13.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.763+0000 7f5c5e7fc640 1 -- 172.21.15.5:0/3806754875 learned_addr learned my addr 172.21.15.5:0/3806754875 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:13.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.763+0000 7f5c5effd640 1 --2- 172.21.15.5:0/3806754875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c6006c100 0x7f5c600b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:13.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.763+0000 7f5c5f7fe640 1 --2- 172.21.15.5:0/3806754875 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c600cc650 0x7f5c601510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:13.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.763+0000 7f5c5e7fc640 1 -- 172.21.15.5:0/3806754875 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c600cc650 msgr2=0x7f5c601510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:13.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.763+0000 7f5c5e7fc640 1 --2- 172.21.15.5:0/3806754875 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c600cc650 0x7f5c601510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:13.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.763+0000 7f5c5e7fc640 1 -- 172.21.15.5:0/3806754875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c6006c100 msgr2=0x7f5c600b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:13.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.763+0000 7f5c5e7fc640 1 --2- 172.21.15.5:0/3806754875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c6006c100 0x7f5c600b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:13.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.763+0000 7f5c5e7fc640 1 -- 172.21.15.5:0/3806754875 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c58009a70 con 0x7f5c600707f0 2023-07-14T13:09:13.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.763+0000 7f5c5effd640 1 --2- 172.21.15.5:0/3806754875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c6006c100 0x7f5c600b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:13.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.763+0000 7f5c5e7fc640 1 --2- 172.21.15.5:0/3806754875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c600707f0 0x7f5c60157610 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400c470 tx=0x7f5c5400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:13.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.763+0000 7f5c477fe640 1 -- 172.21.15.5:0/3806754875 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c540052d0 con 0x7f5c600707f0 2023-07-14T13:09:13.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.763+0000 7f5c477fe640 1 -- 172.21.15.5:0/3806754875 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c54005470 con 0x7f5c600707f0 2023-07-14T13:09:13.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.763+0000 7f5c65374640 1 -- 172.21.15.5:0/3806754875 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c600b3970 con 0x7f5c600707f0 2023-07-14T13:09:13.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.763+0000 7f5c477fe640 1 -- 172.21.15.5:0/3806754875 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c54006a70 con 0x7f5c600707f0 2023-07-14T13:09:13.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.763+0000 7f5c65374640 1 -- 172.21.15.5:0/3806754875 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c60157b50 con 0x7f5c600707f0 2023-07-14T13:09:13.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.763+0000 7f5c65374640 1 -- 172.21.15.5:0/3806754875 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c600c7c50 con 0x7f5c600707f0 2023-07-14T13:09:13.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.767+0000 7f5c477fe640 1 -- 172.21.15.5:0/3806754875 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5c54006bd0 con 0x7f5c600707f0 2023-07-14T13:09:13.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.767+0000 7f5c477fe640 1 --2- 172.21.15.5:0/3806754875 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f5c4c0663a0 0x7f5c4c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:13.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.767+0000 7f5c477fe640 1 -- 172.21.15.5:0/3806754875 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5c54083230 con 0x7f5c600707f0 2023-07-14T13:09:13.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.767+0000 7f5c5effd640 1 --2- 172.21.15.5:0/3806754875 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f5c4c0663a0 0x7f5c4c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:13.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.767+0000 7f5c5effd640 1 --2- 172.21.15.5:0/3806754875 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f5c4c0663a0 0x7f5c4c068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5c50001820 tx=0x7f5c50009040 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:13.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.771+0000 7f5c477fe640 1 -- 172.21.15.5:0/3806754875 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f5c54050590 con 0x7f5c600707f0 2023-07-14T13:09:13.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.923+0000 7f5c65374640 1 -- 172.21.15.5:0/3806754875 --> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c600cd580 con 0x7f5c4c0663a0 2023-07-14T13:09:13.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.931+0000 7f5c477fe640 1 -- 172.21.15.5:0/3806754875 <== mgr.6691 v2:172.21.15.154:6832/3243469291 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+304092 (secure 0 0 0) 0x7f5c500058e0 con 0x7f5c4c0663a0 2023-07-14T13:09:13.965 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:13.967 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:09:13.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.935+0000 7f5c65374640 1 -- 172.21.15.5:0/3806754875 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f5c4c0663a0 msgr2=0x7f5c4c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:13.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.935+0000 7f5c65374640 1 --2- 172.21.15.5:0/3806754875 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f5c4c0663a0 0x7f5c4c068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5c50001820 tx=0x7f5c50009040 comp rx=0 tx=0).stop 2023-07-14T13:09:13.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.935+0000 7f5c65374640 1 -- 172.21.15.5:0/3806754875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c600707f0 msgr2=0x7f5c60157610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:13.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.935+0000 7f5c65374640 1 --2- 172.21.15.5:0/3806754875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c600707f0 0x7f5c60157610 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400c470 tx=0x7f5c5400c930 comp rx=0 tx=0).stop 2023-07-14T13:09:13.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.935+0000 7f5c65374640 1 -- 172.21.15.5:0/3806754875 shutdown_connections 2023-07-14T13:09:13.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.935+0000 7f5c65374640 1 --2- 172.21.15.5:0/3806754875 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f5c4c0663a0 0x7f5c4c068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:13.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.935+0000 7f5c65374640 1 --2- 172.21.15.5:0/3806754875 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5c600cc650 0x7f5c601510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:13.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.935+0000 7f5c65374640 1 --2- 172.21.15.5:0/3806754875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c600707f0 0x7f5c60157610 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:13.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.935+0000 7f5c65374640 1 --2- 172.21.15.5:0/3806754875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c6006c100 0x7f5c600b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:13.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.935+0000 7f5c65374640 1 -- 172.21.15.5:0/3806754875 >> 172.21.15.5:0/3806754875 conn(0x7f5c600ce9d0 msgr2=0x7f5c6006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:13.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.935+0000 7f5c65374640 1 -- 172.21.15.5:0/3806754875 shutdown_connections 2023-07-14T13:09:13.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:13.935+0000 7f5c65374640 1 -- 172.21.15.5:0/3806754875 wait complete. 2023-07-14T13:09:13.986 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-14T13:09:12.334175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591110,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":302,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":118,"acting":118,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":315168,"kb_used_data":10208,"kb_used_omap":0,"kb_used_meta":304896,"kb_avail":754659552,"statfs":{"total":773094113280,"available":772771381248,"internally_reserved":0,"allocated":10452992,"data_stored":5819512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312213504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.915413"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.430093+0000","last_change":"2023-07-14T13:09:09.446176+0000","last_active":"2023-07-14T13:09:10.430093+0000","last_peered":"2023-07-14T13:09:10.430093+0000","last_clean":"2023-07-14T13:09:10.430093+0000","last_became_active":"2023-07-14T13:09:09.445293+0000","last_became_peered":"2023-07-14T13:09:09.445293+0000","last_unstale":"2023-07-14T13:09:10.430093+0000","last_undegraded":"2023-07-14T13:09:10.430093+0000","last_fullsized":"2023-07-14T13:09:10.430093+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:33:21.009243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034775+0000","last_change":"2023-07-14T13:09:09.448668+0000","last_active":"2023-07-14T13:09:12.034775+0000","last_peered":"2023-07-14T13:09:12.034775+0000","last_clean":"2023-07-14T13:09:12.034775+0000","last_became_active":"2023-07-14T13:09:09.448371+0000","last_became_peered":"2023-07-14T13:09:09.448371+0000","last_unstale":"2023-07-14T13:09:12.034775+0000","last_undegraded":"2023-07-14T13:09:12.034775+0000","last_fullsized":"2023-07-14T13:09:12.034775+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:48:39.755881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892686+0000","last_change":"2023-07-14T13:09:09.454198+0000","last_active":"2023-07-14T13:09:11.892686+0000","last_peered":"2023-07-14T13:09:11.892686+0000","last_clean":"2023-07-14T13:09:11.892686+0000","last_became_active":"2023-07-14T13:09:09.453939+0000","last_became_peered":"2023-07-14T13:09:09.453939+0000","last_unstale":"2023-07-14T13:09:11.892686+0000","last_undegraded":"2023-07-14T13:09:11.892686+0000","last_fullsized":"2023-07-14T13:09:11.892686+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:22:29.316898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033830+0000","last_change":"2023-07-14T13:09:09.466445+0000","last_active":"2023-07-14T13:09:12.033830+0000","last_peered":"2023-07-14T13:09:12.033830+0000","last_clean":"2023-07-14T13:09:12.033830+0000","last_became_active":"2023-07-14T13:09:09.466235+0000","last_became_peered":"2023-07-14T13:09:09.466235+0000","last_unstale":"2023-07-14T13:09:12.033830+0000","last_undegraded":"2023-07-14T13:09:12.033830+0000","last_fullsized":"2023-07-14T13:09:12.033830+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:42:41.071144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892478+0000","last_change":"2023-07-14T13:09:09.444492+0000","last_active":"2023-07-14T13:09:11.892478+0000","last_peered":"2023-07-14T13:09:11.892478+0000","last_clean":"2023-07-14T13:09:11.892478+0000","last_became_active":"2023-07-14T13:09:09.444047+0000","last_became_peered":"2023-07-14T13:09:09.444047+0000","last_unstale":"2023-07-14T13:09:11.892478+0000","last_undegraded":"2023-07-14T13:09:11.892478+0000","last_fullsized":"2023-07-14T13:09:11.892478+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:09:58.802715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429956+0000","last_change":"2023-07-14T13:09:09.452430+0000","last_active":"2023-07-14T13:09:10.429956+0000","last_peered":"2023-07-14T13:09:10.429956+0000","last_clean":"2023-07-14T13:09:10.429956+0000","last_became_active":"2023-07-14T13:09:09.449894+0000","last_became_peered":"2023-07-14T13:09:09.449894+0000","last_unstale":"2023-07-14T13:09:10.429956+0000","last_undegraded":"2023-07-14T13:09:10.429956+0000","last_fullsized":"2023-07-14T13:09:10.429956+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:48:14.007032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892830+0000","last_change":"2023-07-14T13:09:09.469561+0000","last_active":"2023-07-14T13:09:11.892830+0000","last_peered":"2023-07-14T13:09:11.892830+0000","last_clean":"2023-07-14T13:09:11.892830+0000","last_became_active":"2023-07-14T13:09:09.469257+0000","last_became_peered":"2023-07-14T13:09:09.469257+0000","last_unstale":"2023-07-14T13:09:11.892830+0000","last_undegraded":"2023-07-14T13:09:11.892830+0000","last_fullsized":"2023-07-14T13:09:11.892830+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:54:26.926217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034246+0000","last_change":"2023-07-14T13:09:09.465984+0000","last_active":"2023-07-14T13:09:12.034246+0000","last_peered":"2023-07-14T13:09:12.034246+0000","last_clean":"2023-07-14T13:09:12.034246+0000","last_became_active":"2023-07-14T13:09:09.465297+0000","last_became_peered":"2023-07-14T13:09:09.465297+0000","last_unstale":"2023-07-14T13:09:12.034246+0000","last_undegraded":"2023-07-14T13:09:12.034246+0000","last_fullsized":"2023-07-14T13:09:12.034246+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:36:51.749103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429563+0000","last_change":"2023-07-14T13:09:09.447329+0000","last_active":"2023-07-14T13:09:10.429563+0000","last_peered":"2023-07-14T13:09:10.429563+0000","last_clean":"2023-07-14T13:09:10.429563+0000","last_became_active":"2023-07-14T13:09:09.447000+0000","last_became_peered":"2023-07-14T13:09:09.447000+0000","last_unstale":"2023-07-14T13:09:10.429563+0000","last_undegraded":"2023-07-14T13:09:10.429563+0000","last_fullsized":"2023-07-14T13:09:10.429563+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:25:22.872941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892937+0000","last_change":"2023-07-14T13:09:09.455889+0000","last_active":"2023-07-14T13:09:11.892937+0000","last_peered":"2023-07-14T13:09:11.892937+0000","last_clean":"2023-07-14T13:09:11.892937+0000","last_became_active":"2023-07-14T13:09:09.455632+0000","last_became_peered":"2023-07-14T13:09:09.455632+0000","last_unstale":"2023-07-14T13:09:11.892937+0000","last_undegraded":"2023-07-14T13:09:11.892937+0000","last_fullsized":"2023-07-14T13:09:11.892937+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:29:40.244587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034806+0000","last_change":"2023-07-14T13:09:09.450337+0000","last_active":"2023-07-14T13:09:12.034806+0000","last_peered":"2023-07-14T13:09:12.034806+0000","last_clean":"2023-07-14T13:09:12.034806+0000","last_became_active":"2023-07-14T13:09:09.450041+0000","last_became_peered":"2023-07-14T13:09:09.450041+0000","last_unstale":"2023-07-14T13:09:12.034806+0000","last_undegraded":"2023-07-14T13:09:12.034806+0000","last_fullsized":"2023-07-14T13:09:12.034806+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:25:09.990529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034503+0000","last_change":"2023-07-14T13:09:09.457178+0000","last_active":"2023-07-14T13:09:12.034503+0000","last_peered":"2023-07-14T13:09:12.034503+0000","last_clean":"2023-07-14T13:09:12.034503+0000","last_became_active":"2023-07-14T13:09:09.456873+0000","last_became_peered":"2023-07-14T13:09:09.456873+0000","last_unstale":"2023-07-14T13:09:12.034503+0000","last_undegraded":"2023-07-14T13:09:12.034503+0000","last_fullsized":"2023-07-14T13:09:12.034503+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:13:42.988795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892699+0000","last_change":"2023-07-14T13:09:09.449996+0000","last_active":"2023-07-14T13:09:11.892699+0000","last_peered":"2023-07-14T13:09:11.892699+0000","last_clean":"2023-07-14T13:09:11.892699+0000","last_became_active":"2023-07-14T13:09:09.449678+0000","last_became_peered":"2023-07-14T13:09:09.449678+0000","last_unstale":"2023-07-14T13:09:11.892699+0000","last_undegraded":"2023-07-14T13:09:11.892699+0000","last_fullsized":"2023-07-14T13:09:11.892699+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:58:24.472482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892490+0000","last_change":"2023-07-14T13:09:09.469085+0000","last_active":"2023-07-14T13:09:11.892490+0000","last_peered":"2023-07-14T13:09:11.892490+0000","last_clean":"2023-07-14T13:09:11.892490+0000","last_became_active":"2023-07-14T13:09:09.468814+0000","last_became_peered":"2023-07-14T13:09:09.468814+0000","last_unstale":"2023-07-14T13:09:11.892490+0000","last_undegraded":"2023-07-14T13:09:11.892490+0000","last_fullsized":"2023-07-14T13:09:11.892490+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:11:15.830663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429728+0000","last_change":"2023-07-14T13:09:09.459438+0000","last_active":"2023-07-14T13:09:10.429728+0000","last_peered":"2023-07-14T13:09:10.429728+0000","last_clean":"2023-07-14T13:09:10.429728+0000","last_became_active":"2023-07-14T13:09:09.459180+0000","last_became_peered":"2023-07-14T13:09:09.459180+0000","last_unstale":"2023-07-14T13:09:10.429728+0000","last_undegraded":"2023-07-14T13:09:10.429728+0000","last_fullsized":"2023-07-14T13:09:10.429728+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:51:06.800504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.430164+0000","last_change":"2023-07-14T13:09:09.455611+0000","last_active":"2023-07-14T13:09:10.430164+0000","last_peered":"2023-07-14T13:09:10.430164+0000","last_clean":"2023-07-14T13:09:10.430164+0000","last_became_active":"2023-07-14T13:09:09.455121+0000","last_became_peered":"2023-07-14T13:09:09.455121+0000","last_unstale":"2023-07-14T13:09:10.430164+0000","last_undegraded":"2023-07-14T13:09:10.430164+0000","last_fullsized":"2023-07-14T13:09:10.430164+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:03:49.784846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892820+0000","last_change":"2023-07-14T13:09:09.454892+0000","last_active":"2023-07-14T13:09:11.892820+0000","last_peered":"2023-07-14T13:09:11.892820+0000","last_clean":"2023-07-14T13:09:11.892820+0000","last_became_active":"2023-07-14T13:09:09.454598+0000","last_became_peered":"2023-07-14T13:09:09.454598+0000","last_unstale":"2023-07-14T13:09:11.892820+0000","last_undegraded":"2023-07-14T13:09:11.892820+0000","last_fullsized":"2023-07-14T13:09:11.892820+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:02:23.849786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429732+0000","last_change":"2023-07-14T13:09:09.446033+0000","last_active":"2023-07-14T13:09:10.429732+0000","last_peered":"2023-07-14T13:09:10.429732+0000","last_clean":"2023-07-14T13:09:10.429732+0000","last_became_active":"2023-07-14T13:09:09.445481+0000","last_became_peered":"2023-07-14T13:09:09.445481+0000","last_unstale":"2023-07-14T13:09:10.429732+0000","last_undegraded":"2023-07-14T13:09:10.429732+0000","last_fullsized":"2023-07-14T13:09:10.429732+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:52:51.943223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033999+0000","last_change":"2023-07-14T13:09:09.445955+0000","last_active":"2023-07-14T13:09:12.033999+0000","last_peered":"2023-07-14T13:09:12.033999+0000","last_clean":"2023-07-14T13:09:12.033999+0000","last_became_active":"2023-07-14T13:09:09.445618+0000","last_became_peered":"2023-07-14T13:09:09.445618+0000","last_unstale":"2023-07-14T13:09:12.033999+0000","last_undegraded":"2023-07-14T13:09:12.033999+0000","last_fullsized":"2023-07-14T13:09:12.033999+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:13:42.533007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033987+0000","last_change":"2023-07-14T13:09:09.450411+0000","last_active":"2023-07-14T13:09:12.033987+0000","last_peered":"2023-07-14T13:09:12.033987+0000","last_clean":"2023-07-14T13:09:12.033987+0000","last_became_active":"2023-07-14T13:09:09.450124+0000","last_became_peered":"2023-07-14T13:09:09.450124+0000","last_unstale":"2023-07-14T13:09:12.033987+0000","last_undegraded":"2023-07-14T13:09:12.033987+0000","last_fullsized":"2023-07-14T13:09:12.033987+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:17:47.890949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"96'4","reported_seq":17,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892923+0000","last_change":"2023-07-14T13:09:08.444497+0000","last_active":"2023-07-14T13:09:11.892923+0000","last_peered":"2023-07-14T13:09:11.892923+0000","last_clean":"2023-07-14T13:09:11.892923+0000","last_became_active":"2023-07-14T13:09:08.444214+0000","last_became_peered":"2023-07-14T13:09:08.444214+0000","last_unstale":"2023-07-14T13:09:11.892923+0000","last_undegraded":"2023-07-14T13:09:11.892923+0000","last_fullsized":"2023-07-14T13:09:11.892923+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:51:45.905778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429570+0000","last_change":"2023-07-14T13:09:09.458943+0000","last_active":"2023-07-14T13:09:10.429570+0000","last_peered":"2023-07-14T13:09:10.429570+0000","last_clean":"2023-07-14T13:09:10.429570+0000","last_became_active":"2023-07-14T13:09:09.455757+0000","last_became_peered":"2023-07-14T13:09:09.455757+0000","last_unstale":"2023-07-14T13:09:10.429570+0000","last_undegraded":"2023-07-14T13:09:10.429570+0000","last_fullsized":"2023-07-14T13:09:10.429570+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:45:39.572860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429834+0000","last_change":"2023-07-14T13:09:09.447229+0000","last_active":"2023-07-14T13:09:10.429834+0000","last_peered":"2023-07-14T13:09:10.429834+0000","last_clean":"2023-07-14T13:09:10.429834+0000","last_became_active":"2023-07-14T13:09:09.446944+0000","last_became_peered":"2023-07-14T13:09:09.446944+0000","last_unstale":"2023-07-14T13:09:10.429834+0000","last_undegraded":"2023-07-14T13:09:10.429834+0000","last_fullsized":"2023-07-14T13:09:10.429834+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:58:11.945700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.430015+0000","last_change":"2023-07-14T13:09:09.445796+0000","last_active":"2023-07-14T13:09:10.430015+0000","last_peered":"2023-07-14T13:09:10.430015+0000","last_clean":"2023-07-14T13:09:10.430015+0000","last_became_active":"2023-07-14T13:09:09.445514+0000","last_became_peered":"2023-07-14T13:09:09.445514+0000","last_unstale":"2023-07-14T13:09:10.430015+0000","last_undegraded":"2023-07-14T13:09:10.430015+0000","last_fullsized":"2023-07-14T13:09:10.430015+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:02:59.884389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429710+0000","last_change":"2023-07-14T13:09:08.443183+0000","last_active":"2023-07-14T13:09:10.429710+0000","last_peered":"2023-07-14T13:09:10.429710+0000","last_clean":"2023-07-14T13:09:10.429710+0000","last_became_active":"2023-07-14T13:09:08.442696+0000","last_became_peered":"2023-07-14T13:09:08.442696+0000","last_unstale":"2023-07-14T13:09:10.429710+0000","last_undegraded":"2023-07-14T13:09:10.429710+0000","last_fullsized":"2023-07-14T13:09:10.429710+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:30:50.273654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892594+0000","last_change":"2023-07-14T13:09:08.433369+0000","last_active":"2023-07-14T13:09:11.892594+0000","last_peered":"2023-07-14T13:09:11.892594+0000","last_clean":"2023-07-14T13:09:11.892594+0000","last_became_active":"2023-07-14T13:09:08.431724+0000","last_became_peered":"2023-07-14T13:09:08.431724+0000","last_unstale":"2023-07-14T13:09:11.892594+0000","last_undegraded":"2023-07-14T13:09:11.892594+0000","last_fullsized":"2023-07-14T13:09:11.892594+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:12:54.167527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429571+0000","last_change":"2023-07-14T13:09:09.447525+0000","last_active":"2023-07-14T13:09:10.429571+0000","last_peered":"2023-07-14T13:09:10.429571+0000","last_clean":"2023-07-14T13:09:10.429571+0000","last_became_active":"2023-07-14T13:09:09.446162+0000","last_became_peered":"2023-07-14T13:09:09.446162+0000","last_unstale":"2023-07-14T13:09:10.429571+0000","last_undegraded":"2023-07-14T13:09:10.429571+0000","last_fullsized":"2023-07-14T13:09:10.429571+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:22.698260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034350+0000","last_change":"2023-07-14T13:09:09.453933+0000","last_active":"2023-07-14T13:09:12.034350+0000","last_peered":"2023-07-14T13:09:12.034350+0000","last_clean":"2023-07-14T13:09:12.034350+0000","last_became_active":"2023-07-14T13:09:09.453610+0000","last_became_peered":"2023-07-14T13:09:09.453610+0000","last_unstale":"2023-07-14T13:09:12.034350+0000","last_undegraded":"2023-07-14T13:09:12.034350+0000","last_fullsized":"2023-07-14T13:09:12.034350+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:24:39.457351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"96'3","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892897+0000","last_change":"2023-07-14T13:09:08.437217+0000","last_active":"2023-07-14T13:09:11.892897+0000","last_peered":"2023-07-14T13:09:11.892897+0000","last_clean":"2023-07-14T13:09:11.892897+0000","last_became_active":"2023-07-14T13:09:08.436904+0000","last_became_peered":"2023-07-14T13:09:08.436904+0000","last_unstale":"2023-07-14T13:09:11.892897+0000","last_undegraded":"2023-07-14T13:09:11.892897+0000","last_fullsized":"2023-07-14T13:09:11.892897+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:33:17.679033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034191+0000","last_change":"2023-07-14T13:09:09.449362+0000","last_active":"2023-07-14T13:09:12.034191+0000","last_peered":"2023-07-14T13:09:12.034191+0000","last_clean":"2023-07-14T13:09:12.034191+0000","last_became_active":"2023-07-14T13:09:09.448691+0000","last_became_peered":"2023-07-14T13:09:09.448691+0000","last_unstale":"2023-07-14T13:09:12.034191+0000","last_undegraded":"2023-07-14T13:09:12.034191+0000","last_fullsized":"2023-07-14T13:09:12.034191+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:11:22.058932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892506+0000","last_change":"2023-07-14T13:09:08.443228+0000","last_active":"2023-07-14T13:09:11.892506+0000","last_peered":"2023-07-14T13:09:11.892506+0000","last_clean":"2023-07-14T13:09:11.892506+0000","last_became_active":"2023-07-14T13:09:08.442874+0000","last_became_peered":"2023-07-14T13:09:08.442874+0000","last_unstale":"2023-07-14T13:09:11.892506+0000","last_undegraded":"2023-07-14T13:09:11.892506+0000","last_fullsized":"2023-07-14T13:09:11.892506+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:38:31.212301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"96'8","reported_seq":21,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429919+0000","last_change":"2023-07-14T13:09:08.443086+0000","last_active":"2023-07-14T13:09:10.429919+0000","last_peered":"2023-07-14T13:09:10.429919+0000","last_clean":"2023-07-14T13:09:10.429919+0000","last_became_active":"2023-07-14T13:09:08.442793+0000","last_became_peered":"2023-07-14T13:09:08.442793+0000","last_unstale":"2023-07-14T13:09:10.429919+0000","last_undegraded":"2023-07-14T13:09:10.429919+0000","last_fullsized":"2023-07-14T13:09:10.429919+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:22:53.283592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"97'1","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.891853+0000","last_change":"2023-07-14T13:09:08.447067+0000","last_active":"2023-07-14T13:09:11.891853+0000","last_peered":"2023-07-14T13:09:11.891853+0000","last_clean":"2023-07-14T13:09:11.891853+0000","last_became_active":"2023-07-14T13:09:08.446799+0000","last_became_peered":"2023-07-14T13:09:08.446799+0000","last_unstale":"2023-07-14T13:09:11.891853+0000","last_undegraded":"2023-07-14T13:09:11.891853+0000","last_fullsized":"2023-07-14T13:09:11.891853+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:28:21.757335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429786+0000","last_change":"2023-07-14T13:09:09.445848+0000","last_active":"2023-07-14T13:09:10.429786+0000","last_peered":"2023-07-14T13:09:10.429786+0000","last_clean":"2023-07-14T13:09:10.429786+0000","last_became_active":"2023-07-14T13:09:09.445068+0000","last_became_peered":"2023-07-14T13:09:09.445068+0000","last_unstale":"2023-07-14T13:09:10.429786+0000","last_undegraded":"2023-07-14T13:09:10.429786+0000","last_fullsized":"2023-07-14T13:09:10.429786+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:25:09.202126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892633+0000","last_change":"2023-07-14T13:09:08.443277+0000","last_active":"2023-07-14T13:09:11.892633+0000","last_peered":"2023-07-14T13:09:11.892633+0000","last_clean":"2023-07-14T13:09:11.892633+0000","last_became_active":"2023-07-14T13:09:08.442915+0000","last_became_peered":"2023-07-14T13:09:08.442915+0000","last_unstale":"2023-07-14T13:09:11.892633+0000","last_undegraded":"2023-07-14T13:09:11.892633+0000","last_fullsized":"2023-07-14T13:09:11.892633+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:48:52.995190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034856+0000","last_change":"2023-07-14T13:09:09.463272+0000","last_active":"2023-07-14T13:09:12.034856+0000","last_peered":"2023-07-14T13:09:12.034856+0000","last_clean":"2023-07-14T13:09:12.034856+0000","last_became_active":"2023-07-14T13:09:09.462912+0000","last_became_peered":"2023-07-14T13:09:09.462912+0000","last_unstale":"2023-07-14T13:09:12.034856+0000","last_undegraded":"2023-07-14T13:09:12.034856+0000","last_fullsized":"2023-07-14T13:09:12.034856+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:28:41.067336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034922+0000","last_change":"2023-07-14T13:09:09.445631+0000","last_active":"2023-07-14T13:09:12.034922+0000","last_peered":"2023-07-14T13:09:12.034922+0000","last_clean":"2023-07-14T13:09:12.034922+0000","last_became_active":"2023-07-14T13:09:09.445366+0000","last_became_peered":"2023-07-14T13:09:09.445366+0000","last_unstale":"2023-07-14T13:09:12.034922+0000","last_undegraded":"2023-07-14T13:09:12.034922+0000","last_fullsized":"2023-07-14T13:09:12.034922+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:47:59.705980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034027+0000","last_change":"2023-07-14T13:09:08.441197+0000","last_active":"2023-07-14T13:09:12.034027+0000","last_peered":"2023-07-14T13:09:12.034027+0000","last_clean":"2023-07-14T13:09:12.034027+0000","last_became_active":"2023-07-14T13:09:08.440996+0000","last_became_peered":"2023-07-14T13:09:08.440996+0000","last_unstale":"2023-07-14T13:09:12.034027+0000","last_undegraded":"2023-07-14T13:09:12.034027+0000","last_fullsized":"2023-07-14T13:09:12.034027+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:08:34.441857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034521+0000","last_change":"2023-07-14T13:09:08.446105+0000","last_active":"2023-07-14T13:09:12.034521+0000","last_peered":"2023-07-14T13:09:12.034521+0000","last_clean":"2023-07-14T13:09:12.034521+0000","last_became_active":"2023-07-14T13:09:08.445697+0000","last_became_peered":"2023-07-14T13:09:08.445697+0000","last_unstale":"2023-07-14T13:09:12.034521+0000","last_undegraded":"2023-07-14T13:09:12.034521+0000","last_fullsized":"2023-07-14T13:09:12.034521+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:00:10.980521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"85'183","reported_seq":539,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-07-14T13:09:05.200783+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:09:05.200783+0000","last_peered":"2023-07-14T13:09:05.200783+0000","last_clean":"2023-07-14T13:09:05.200783+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:09:05.200783+0000","last_undegraded":"2023-07-14T13:09:05.200783+0000","last_fullsized":"2023-07-14T13:09:05.200783+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:11:42.664390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":148,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-07-14T13:09:05.200774+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:09:05.200774+0000","last_peered":"2023-07-14T13:09:05.200774+0000","last_clean":"2023-07-14T13:09:05.200774+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:09:05.200774+0000","last_undegraded":"2023-07-14T13:09:05.200774+0000","last_fullsized":"2023-07-14T13:09:05.200774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:24:29.586540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.430147+0000","last_change":"2023-07-14T13:09:09.445181+0000","last_active":"2023-07-14T13:09:10.430147+0000","last_peered":"2023-07-14T13:09:10.430147+0000","last_clean":"2023-07-14T13:09:10.430147+0000","last_became_active":"2023-07-14T13:09:09.439207+0000","last_became_peered":"2023-07-14T13:09:09.439207+0000","last_unstale":"2023-07-14T13:09:10.430147+0000","last_undegraded":"2023-07-14T13:09:10.430147+0000","last_fullsized":"2023-07-14T13:09:10.430147+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:29:51.451099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033893+0000","last_change":"2023-07-14T13:09:08.445355+0000","last_active":"2023-07-14T13:09:12.033893+0000","last_peered":"2023-07-14T13:09:12.033893+0000","last_clean":"2023-07-14T13:09:12.033893+0000","last_became_active":"2023-07-14T13:09:08.445081+0000","last_became_peered":"2023-07-14T13:09:08.445081+0000","last_unstale":"2023-07-14T13:09:12.033893+0000","last_undegraded":"2023-07-14T13:09:12.033893+0000","last_fullsized":"2023-07-14T13:09:12.033893+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:02:41.574353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-07-14T13:09:05.200636+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:09:05.200636+0000","last_peered":"2023-07-14T13:09:05.200636+0000","last_clean":"2023-07-14T13:09:05.200636+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:09:05.200636+0000","last_undegraded":"2023-07-14T13:09:05.200636+0000","last_fullsized":"2023-07-14T13:09:05.200636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:13:13.014415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033787+0000","last_change":"2023-07-14T13:09:08.444592+0000","last_active":"2023-07-14T13:09:12.033787+0000","last_peered":"2023-07-14T13:09:12.033787+0000","last_clean":"2023-07-14T13:09:12.033787+0000","last_became_active":"2023-07-14T13:09:08.444313+0000","last_became_peered":"2023-07-14T13:09:08.444313+0000","last_unstale":"2023-07-14T13:09:12.033787+0000","last_undegraded":"2023-07-14T13:09:12.033787+0000","last_fullsized":"2023-07-14T13:09:12.033787+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:26:10.415790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":150,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892700+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:09:11.892700+0000","last_peered":"2023-07-14T13:09:11.892700+0000","last_clean":"2023-07-14T13:09:11.892700+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:09:11.892700+0000","last_undegraded":"2023-07-14T13:09:11.892700+0000","last_fullsized":"2023-07-14T13:09:11.892700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:50:36.399832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429987+0000","last_change":"2023-07-14T13:09:09.455678+0000","last_active":"2023-07-14T13:09:10.429987+0000","last_peered":"2023-07-14T13:09:10.429987+0000","last_clean":"2023-07-14T13:09:10.429987+0000","last_became_active":"2023-07-14T13:09:09.455373+0000","last_became_peered":"2023-07-14T13:09:09.455373+0000","last_unstale":"2023-07-14T13:09:10.429987+0000","last_undegraded":"2023-07-14T13:09:10.429987+0000","last_fullsized":"2023-07-14T13:09:10.429987+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:46:27.362227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"96'2","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034498+0000","last_change":"2023-07-14T13:09:08.441285+0000","last_active":"2023-07-14T13:09:12.034498+0000","last_peered":"2023-07-14T13:09:12.034498+0000","last_clean":"2023-07-14T13:09:12.034498+0000","last_became_active":"2023-07-14T13:09:08.440995+0000","last_became_peered":"2023-07-14T13:09:08.440995+0000","last_unstale":"2023-07-14T13:09:12.034498+0000","last_undegraded":"2023-07-14T13:09:12.034498+0000","last_fullsized":"2023-07-14T13:09:12.034498+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:52:51.529066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":148,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-07-14T13:09:05.200750+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:09:05.200750+0000","last_peered":"2023-07-14T13:09:05.200750+0000","last_clean":"2023-07-14T13:09:05.200750+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:09:05.200750+0000","last_undegraded":"2023-07-14T13:09:05.200750+0000","last_fullsized":"2023-07-14T13:09:05.200750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:07:46.968763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892570+0000","last_change":"2023-07-14T13:09:09.448817+0000","last_active":"2023-07-14T13:09:11.892570+0000","last_peered":"2023-07-14T13:09:11.892570+0000","last_clean":"2023-07-14T13:09:11.892570+0000","last_became_active":"2023-07-14T13:09:09.448520+0000","last_became_peered":"2023-07-14T13:09:09.448520+0000","last_unstale":"2023-07-14T13:09:11.892570+0000","last_undegraded":"2023-07-14T13:09:11.892570+0000","last_fullsized":"2023-07-14T13:09:11.892570+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:53:13.224188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"96'1","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892913+0000","last_change":"2023-07-14T13:09:08.440049+0000","last_active":"2023-07-14T13:09:11.892913+0000","last_peered":"2023-07-14T13:09:11.892913+0000","last_clean":"2023-07-14T13:09:11.892913+0000","last_became_active":"2023-07-14T13:09:08.439676+0000","last_became_peered":"2023-07-14T13:09:08.439676+0000","last_unstale":"2023-07-14T13:09:11.892913+0000","last_undegraded":"2023-07-14T13:09:11.892913+0000","last_fullsized":"2023-07-14T13:09:11.892913+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:14:18.335021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":164,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034634+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:09:12.034634+0000","last_peered":"2023-07-14T13:09:12.034634+0000","last_clean":"2023-07-14T13:09:12.034634+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:09:12.034634+0000","last_undegraded":"2023-07-14T13:09:12.034634+0000","last_fullsized":"2023-07-14T13:09:12.034634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:07:38.092074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034347+0000","last_change":"2023-07-14T13:09:09.453843+0000","last_active":"2023-07-14T13:09:12.034347+0000","last_peered":"2023-07-14T13:09:12.034347+0000","last_clean":"2023-07-14T13:09:12.034347+0000","last_became_active":"2023-07-14T13:09:09.453556+0000","last_became_peered":"2023-07-14T13:09:09.453556+0000","last_unstale":"2023-07-14T13:09:12.034347+0000","last_undegraded":"2023-07-14T13:09:12.034347+0000","last_fullsized":"2023-07-14T13:09:12.034347+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:46:26.111226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034192+0000","last_change":"2023-07-14T13:09:08.448203+0000","last_active":"2023-07-14T13:09:12.034192+0000","last_peered":"2023-07-14T13:09:12.034192+0000","last_clean":"2023-07-14T13:09:12.034192+0000","last_became_active":"2023-07-14T13:09:08.447855+0000","last_became_peered":"2023-07-14T13:09:08.447855+0000","last_unstale":"2023-07-14T13:09:12.034192+0000","last_undegraded":"2023-07-14T13:09:12.034192+0000","last_fullsized":"2023-07-14T13:09:12.034192+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:41:24.859927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":148,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-07-14T13:09:05.200784+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:09:05.200784+0000","last_peered":"2023-07-14T13:09:05.200784+0000","last_clean":"2023-07-14T13:09:05.200784+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:09:05.200784+0000","last_undegraded":"2023-07-14T13:09:05.200784+0000","last_fullsized":"2023-07-14T13:09:05.200784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:03:39.427825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033787+0000","last_change":"2023-07-14T13:09:09.468504+0000","last_active":"2023-07-14T13:09:12.033787+0000","last_peered":"2023-07-14T13:09:12.033787+0000","last_clean":"2023-07-14T13:09:12.033787+0000","last_became_active":"2023-07-14T13:09:09.468224+0000","last_became_peered":"2023-07-14T13:09:09.468224+0000","last_unstale":"2023-07-14T13:09:12.033787+0000","last_undegraded":"2023-07-14T13:09:12.033787+0000","last_fullsized":"2023-07-14T13:09:12.033787+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:15:08.881840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":164,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034886+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:09:12.034886+0000","last_peered":"2023-07-14T13:09:12.034886+0000","last_clean":"2023-07-14T13:09:12.034886+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:09:12.034886+0000","last_undegraded":"2023-07-14T13:09:12.034886+0000","last_fullsized":"2023-07-14T13:09:12.034886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:23:14.929289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892460+0000","last_change":"2023-07-14T13:09:09.455863+0000","last_active":"2023-07-14T13:09:11.892460+0000","last_peered":"2023-07-14T13:09:11.892460+0000","last_clean":"2023-07-14T13:09:11.892460+0000","last_became_active":"2023-07-14T13:09:09.455594+0000","last_became_peered":"2023-07-14T13:09:09.455594+0000","last_unstale":"2023-07-14T13:09:11.892460+0000","last_undegraded":"2023-07-14T13:09:11.892460+0000","last_fullsized":"2023-07-14T13:09:11.892460+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:01.249886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":146,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-07-14T13:09:05.200910+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:09:05.200910+0000","last_peered":"2023-07-14T13:09:05.200910+0000","last_clean":"2023-07-14T13:09:05.200910+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:09:05.200910+0000","last_undegraded":"2023-07-14T13:09:05.200910+0000","last_fullsized":"2023-07-14T13:09:05.200910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:47:16.844849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":70,"acting":70,"num_store_stats":4},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":742,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":30,"acting":30,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575046,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54880,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316960,"statfs":{"total":96636764160,"available":96580567040,"internally_reserved":0,"allocated":1728512,"data_stored":1158664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.51500000000000001,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.98299999999999998,"5min":0.98399999999999999,"15min":1.879},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.56799999999999995,"5min":0.44,"15min":0.439},"max":{"1min":1.054,"5min":1.054,"15min":1.9059999999999999},"last":1.1259999999999999}]},{"osd":1,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73899999999999999,"15min":0.73599999999999999},"min":{"1min":0.504,"5min":0.434,"15min":0.42999999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.069},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.749,"15min":0.746},"min":{"1min":0.54400000000000004,"5min":0.48999999999999999,"15min":0.40500000000000003},"max":{"1min":0.93999999999999995,"5min":0.97399999999999998,"15min":1.1020000000000001},"last":0.95599999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73899999999999999,"15min":0.72799999999999998},"min":{"1min":0.52700000000000002,"5min":0.46999999999999997,"15min":0.40600000000000003},"max":{"1min":0.88100000000000001,"5min":0.98899999999999999,"15min":1.048},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.747,"15min":0.752},"min":{"1min":0.47499999999999998,"5min":0.47199999999999998,"15min":0.46899999999999997},"max":{"1min":0.91300000000000003,"5min":0.97099999999999997,"15min":1.0169999999999999},"last":1.0069999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.746,"15min":0.73399999999999999},"min":{"1min":0.59399999999999997,"5min":0.503,"15min":0.442},"max":{"1min":0.88400000000000001,"5min":1.0269999999999999,"15min":1.0760000000000001},"last":1.161},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.755,"15min":0.75700000000000001},"min":{"1min":0.60199999999999998,"5min":0.47299999999999998,"15min":0.41499999999999998},"max":{"1min":0.91600000000000004,"5min":1.018,"15min":1.024},"last":0.92600000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.44400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.82099999999999995,"5min":1.0009999999999999,"15min":1.022},"last":0.501},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.41799999999999998,"5min":0.40999999999999998,"15min":0.39300000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59699999999999998,"15min":0.60599999999999998},"min":{"1min":0.39300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.0249999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63400000000000001,"15min":0.65600000000000003},"min":{"1min":0.41999999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.69199999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68400000000000005,"15min":0.70099999999999996},"min":{"1min":0.45200000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.99299999999999999,"5min":1.0489999999999999,"15min":1.4419999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.67600000000000005},"min":{"1min":0.46999999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81200000000000006,"5min":0.95799999999999996,"15min":1.575},"last":0.72599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575047,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":1134592,"data_stored":568296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.57799999999999996,"5min":0.38,"15min":0.38},"max":{"1min":0.90400000000000003,"5min":0.996,"15min":1.2749999999999999},"last":0.874},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.72499999999999998,"15min":0.74199999999999999},"min":{"1min":0.53600000000000003,"5min":0.48199999999999998,"15min":0.47399999999999998},"max":{"1min":0.98199999999999998,"5min":1.0800000000000001,"15min":1.2110000000000001},"last":0.77700000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73599999999999999,"15min":0.752},"min":{"1min":0.48299999999999998,"5min":0.47399999999999998,"15min":0.379},"max":{"1min":0.90900000000000003,"5min":1.0089999999999999,"15min":1.4299999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70799999999999996,"15min":0.72599999999999998},"min":{"1min":0.56999999999999995,"5min":0.46999999999999997,"15min":0.44},"max":{"1min":0.86899999999999999,"5min":0.97099999999999997,"15min":1.1379999999999999},"last":0.72599999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.73899999999999999,"15min":0.754},"min":{"1min":0.55800000000000005,"5min":0.45900000000000002,"15min":0.40400000000000003},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":1.319},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.755,"15min":0.75600000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.42299999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.341},"last":0.69099999999999995}]},{"osd":3,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76000000000000001,"15min":0.78100000000000003},"min":{"1min":0.51000000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.054,"5min":1.054,"15min":1.3859999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.52400000000000002,"5min":0.48399999999999999,"15min":0.45900000000000002},"max":{"1min":0.94799999999999995,"5min":0.99099999999999999,"15min":1.1080000000000001},"last":0.82299999999999995}]},{"osd":4,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.97899999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.624,"15min":0.63900000000000001},"min":{"1min":0.47399999999999998,"5min":0.38500000000000001,"15min":0.36099999999999999},"max":{"1min":0.93500000000000005,"5min":1.012,"15min":1.091},"last":0.66200000000000003}]},{"osd":5,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64100000000000001,"15min":0.64700000000000002},"min":{"1min":0.499,"5min":0.37,"15min":0.37},"max":{"1min":0.96599999999999997,"5min":1.579,"15min":1.579},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67800000000000005,"15min":0.69399999999999995},"min":{"1min":0.46700000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.145},"last":0.74099999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.438,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.208},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.499,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0209999999999999,"5min":1.657,"15min":1.657},"last":0.63600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575046,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1134592,"data_stored":568296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.70799999999999996,"15min":0.73099999999999998},"min":{"1min":0.376,"5min":0.36499999999999999,"15min":0.32400000000000001},"max":{"1min":0.91500000000000004,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.432},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68799999999999994,"15min":0.73299999999999998},"min":{"1min":0.41699999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.86099999999999999,"5min":1.083,"15min":1.083},"last":0.503}]},{"osd":1,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69899999999999995,"15min":0.72699999999999998},"min":{"1min":0.46899999999999997,"5min":0.44500000000000001,"15min":0.41099999999999998},"max":{"1min":0.85199999999999998,"5min":1.05,"15min":1.079},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73299999999999998,"15min":0.747},"min":{"1min":0.48999999999999999,"5min":0.48699999999999999,"15min":0.36799999999999999},"max":{"1min":0.94599999999999995,"5min":2.706,"15min":2.706},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71299999999999997,"15min":0.73899999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86299999999999999,"5min":1.212,"15min":1.212},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.70499999999999996,"15min":0.73499999999999999},"min":{"1min":0.44800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89200000000000002,"5min":1.181,"15min":1.181},"last":0.66400000000000003}]},{"osd":3,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73299999999999998,"15min":0.748},"min":{"1min":0.48599999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.876,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72799999999999998,"15min":0.76000000000000001},"min":{"1min":0.47299999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90800000000000003,"5min":1.304,"15min":1.304},"last":0.77000000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64000000000000001,"15min":0.629},"min":{"1min":0.437,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.85399999999999998,"5min":1.129,"15min":1.129},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.39900000000000002,"5min":0.36299999999999999,"15min":0.35899999999999999},"max":{"1min":0.84499999999999997,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.68500000000000005}]},{"osd":6,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.60399999999999998,"15min":0.61399999999999999},"min":{"1min":0.41999999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90200000000000002,"5min":1.169,"15min":1.169},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.64400000000000002,"15min":0.64100000000000001},"min":{"1min":0.39400000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.83699999999999997,"5min":1.238,"15min":1.238},"last":0.70899999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66100000000000003,"15min":0.64300000000000002},"min":{"1min":0.45500000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93300000000000005,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68200000000000005,"15min":0.67800000000000005},"min":{"1min":0.48999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90100000000000002,"5min":1.407,"15min":1.407},"last":0.79400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575046,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32156,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":1134592,"data_stored":568296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.73999999999999999,"15min":0.73499999999999999},"min":{"1min":0.56200000000000006,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92400000000000004,"5min":1.411,"15min":1.411},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.76800000000000002,"15min":0.73199999999999998},"min":{"1min":0.64000000000000001,"5min":0.45800000000000002,"15min":0.435},"max":{"1min":0.94599999999999995,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.83199999999999996}]},{"osd":1,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77000000000000002,"15min":0.751},"min":{"1min":0.62,"5min":0.47999999999999998,"15min":0.442},"max":{"1min":0.90700000000000003,"5min":1.077,"15min":1.077},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.54600000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91900000000000004,"5min":1.0469999999999999,"15min":1.2370000000000001},"last":0.89400000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.749,"15min":0.73599999999999999},"min":{"1min":0.60799999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.95599999999999996,"5min":1.091,"15min":1.091},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79800000000000004,"15min":0.77600000000000002},"min":{"1min":0.60399999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98199999999999998,"5min":1.387,"15min":1.387},"last":0.52100000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75,"15min":0.748},"min":{"1min":0.58099999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84799999999999998,"5min":1.008,"15min":1.099},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77500000000000002,"15min":0.77300000000000002},"min":{"1min":0.64700000000000002,"5min":0.496,"15min":0.46800000000000003},"max":{"1min":0.98699999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.61699999999999999,"15min":0.60499999999999998},"min":{"1min":0.437,"5min":0.378,"15min":0.378},"max":{"1min":0.76400000000000001,"5min":0.95599999999999996,"15min":1.0029999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.627,"15min":0.61799999999999999},"min":{"1min":0.52400000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85799999999999998,"5min":0.93600000000000005,"15min":0.95199999999999996},"last":0.57599999999999996}]},{"osd":6,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.621,"15min":0.62},"min":{"1min":0.48699999999999999,"5min":0.38900000000000001,"15min":0.32300000000000001},"max":{"1min":0.873,"5min":1.014,"15min":1.014},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.51900000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.94599999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.86599999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.68200000000000005,"15min":0.67100000000000004},"min":{"1min":0.57199999999999995,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93200000000000005,"5min":0.94699999999999995,"15min":1.0349999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.55800000000000005,"5min":0.40300000000000002,"15min":0.36899999999999999},"max":{"1min":0.96899999999999997,"5min":1.0629999999999999,"15min":1.1080000000000001},"last":0.91800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575047,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36292,"kb_used_data":1148,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335548,"statfs":{"total":96636764160,"available":96599601152,"internally_reserved":0,"allocated":1175552,"data_stored":588804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.26200000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.84199999999999997},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.498,"15min":0.51500000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.60799999999999998,"5min":0.77300000000000002,"15min":1.0209999999999999},"last":0.46800000000000003}]},{"osd":1,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47199999999999998,"15min":0.47499999999999998},"min":{"1min":0.33100000000000002,"5min":0.315,"15min":0.29599999999999999},"max":{"1min":0.63900000000000001,"5min":0.77200000000000002,"15min":0.79600000000000004},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67800000000000005,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.40699999999999997}]},{"osd":2,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54100000000000004,"15min":0.56999999999999995},"min":{"1min":0.38200000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.72399999999999998,"5min":0.82599999999999996,"15min":0.95899999999999996},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60699999999999998,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86599999999999999,"5min":1.663,"15min":1.663},"last":0.48499999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.748,"15min":0.76500000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":0.90900000000000003,"5min":1.284,"15min":1.284},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76800000000000002,"15min":0.78900000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.47699999999999998},"max":{"1min":1.0660000000000001,"5min":1.121,"15min":1.196},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.52400000000000002},"max":{"1min":1.0229999999999999,"5min":1.306,"15min":1.306},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77900000000000003,"15min":0.79100000000000004},"min":{"1min":0.58099999999999996,"5min":0.372,"15min":0.372},"max":{"1min":0.97399999999999998,"5min":1.1870000000000001,"15min":1.2470000000000001},"last":0.57299999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.76800000000000002,"15min":0.78000000000000003},"min":{"1min":0.50600000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96599999999999997,"5min":1.105,"15min":1.117},"last":0.625},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.79700000000000004,"15min":0.81799999999999995},"min":{"1min":0.56299999999999994,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.93999999999999995,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.83299999999999996,"15min":0.84099999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53100000000000003},"max":{"1min":0.89900000000000002,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.53500000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0009999999999999,"5min":1.595,"15min":1.595},"last":0.65600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575047,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58440,"kb_used_data":1152,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313400,"statfs":{"total":96636764160,"available":96576921600,"internally_reserved":0,"allocated":1179648,"data_stored":587945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45900000000000002,"15min":0.46800000000000003},"min":{"1min":0.29199999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.84699999999999998,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.54200000000000004,"15min":0.53300000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.70799999999999996,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.65500000000000003}]},{"osd":1,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.48299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30399999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65500000000000003,"5min":2.7200000000000002,"15min":2.7200000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.499,"5min":0.55000000000000004,"15min":0.56299999999999994},"min":{"1min":0.36299999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78300000000000003,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":0.61199999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.64500000000000002,"15min":0.60399999999999998},"min":{"1min":0.39500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71699999999999997,"5min":8.2530000000000001,"15min":8.2530000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89600000000000002,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.74199999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.754,"15min":0.78100000000000003},"min":{"1min":0.53200000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.99399999999999999,"5min":1.0940000000000001,"15min":1.1499999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.56699999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0629999999999999,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.76500000000000001}]},{"osd":5,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.84399999999999997,"15min":0.85799999999999998},"min":{"1min":0.58599999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1319999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.879},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82499999999999996,"15min":0.83999999999999997},"min":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.433},"max":{"1min":1.153,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.92400000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.78700000000000003,"15min":0.80400000000000005},"min":{"1min":0.57299999999999995,"5min":0.48999999999999999,"15min":0.47599999999999998},"max":{"1min":0.93999999999999995,"5min":3.9849999999999999,"15min":3.9849999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80200000000000005,"15min":0.81299999999999994},"min":{"1min":0.60699999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0289999999999999,"5min":3.391,"15min":3.391},"last":0.82799999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.79600000000000004,"15min":0.82199999999999995},"min":{"1min":0.55000000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.1759999999999999,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.81499999999999995,"15min":0.82299999999999995},"min":{"1min":0.60199999999999998,"5min":0.53200000000000003,"15min":0.50900000000000001},"max":{"1min":1.0940000000000001,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.89100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575048,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":1191936,"data_stored":594987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.29199999999999998,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.53700000000000003,"5min":0.65400000000000003,"15min":0.77200000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.28199999999999997,"15min":0.26500000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.41899999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47199999999999998,"15min":0.47299999999999998},"min":{"1min":0.34300000000000003,"5min":0.32100000000000001,"15min":0.29499999999999998},"max":{"1min":0.54200000000000004,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65100000000000002,"5min":1.014,"15min":1.014},"last":0.52300000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.621,"15min":0.63600000000000001},"min":{"1min":0.48199999999999998,"5min":0.44700000000000001,"15min":0.437},"max":{"1min":0.73899999999999999,"5min":0.80500000000000005,"15min":0.96299999999999997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56499999999999995,"15min":0.57999999999999996},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.50600000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77700000000000002,"15min":0.78400000000000003},"min":{"1min":0.55500000000000005,"5min":0.51600000000000001,"15min":0.40000000000000002},"max":{"1min":1.0409999999999999,"5min":1.2110000000000001,"15min":1.236},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77200000000000002,"15min":0.78600000000000003},"min":{"1min":0.57499999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.0309999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.77500000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.60799999999999998,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.55800000000000005,"5min":0.48599999999999999,"15min":0.48199999999999998},"max":{"1min":1.0940000000000001,"5min":1.2749999999999999,"15min":1.3600000000000001},"last":0.85399999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.53800000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1.0580000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.80500000000000005,"15min":0.81399999999999995},"min":{"1min":0.56100000000000005,"5min":0.52200000000000002,"15min":0.49199999999999999},"max":{"1min":1.1319999999999999,"5min":1.262,"15min":1.2969999999999999},"last":0.752}]},{"osd":7,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.47799999999999998},"max":{"1min":1.1479999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.82099999999999995,"15min":0.84099999999999997},"min":{"1min":0.58499999999999996,"5min":0.53700000000000003,"15min":0.52800000000000002},"max":{"1min":1.2070000000000001,"5min":1.327,"15min":1.327},"last":0.90800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575049,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36876,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334964,"statfs":{"total":96636764160,"available":96599003136,"internally_reserved":0,"allocated":1773568,"data_stored":1184224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.45600000000000002,"15min":0.44700000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.61199999999999999,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.49099999999999999,"15min":0.51500000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.27700000000000002},"max":{"1min":0.61799999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.36599999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.51900000000000002,"15min":0.51100000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69699999999999995,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.54000000000000004,"15min":0.55300000000000005},"min":{"1min":0.39800000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63800000000000001,"5min":0.80300000000000005,"15min":0.90300000000000002},"last":0.441}]},{"osd":3,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.504},"min":{"1min":0.36399999999999999,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.67600000000000005,"5min":0.72999999999999998,"15min":0.84999999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82899999999999996,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76900000000000002,"15min":0.78800000000000003},"min":{"1min":0.56100000000000005,"5min":0.48399999999999999,"15min":0.44400000000000001},"max":{"1min":0.90500000000000003,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.878},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.53500000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.038,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.91700000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.77100000000000002,"15min":0.80600000000000005},"min":{"1min":0.55100000000000005,"5min":0.51800000000000002,"15min":0.47899999999999998},"max":{"1min":0.80500000000000005,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.56399999999999995,"5min":0.49299999999999999,"15min":0.47299999999999998},"max":{"1min":0.97299999999999998,"5min":1.325,"15min":1.325},"last":0.93999999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.79100000000000004,"15min":0.80600000000000005},"min":{"1min":0.53500000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91400000000000003,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78900000000000003,"15min":0.81499999999999995},"min":{"1min":0.58399999999999996,"5min":0.55500000000000005,"15min":0.41299999999999998},"max":{"1min":1.0900000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.98099999999999998}]},{"osd":7,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.79800000000000004,"15min":0.83199999999999996},"min":{"1min":0.57699999999999996,"5min":0.503,"15min":0.45500000000000002},"max":{"1min":0.93799999999999994,"5min":1.171,"15min":1.2749999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.77100000000000002,"15min":0.81100000000000005},"min":{"1min":0.50600000000000001,"5min":0.502,"15min":0.497},"max":{"1min":0.95199999999999996,"5min":1.381,"15min":1.381},"last":0.77300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:09:13.994 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:09:14.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.139+0000 7ff0d4b74640 1 Processor -- start 2023-07-14T13:09:14.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.139+0000 7ff0d4b74640 1 -- start start 2023-07-14T13:09:14.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.139+0000 7ff0d4b74640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff0d0158ce0 0x7ff0d0070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:14.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.139+0000 7ff0d4b74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0d00c9730 0x7ff0d00ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:14.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.139+0000 7ff0d4b74640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d00cc700 con 0x7ff0d00c8ad0 2023-07-14T13:09:14.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.139+0000 7ff0d4b74640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d00b0ff0 con 0x7ff0d0158ce0 2023-07-14T13:09:14.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.139+0000 7ff0d4b74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d0070c80 con 0x7ff0d00c9730 2023-07-14T13:09:14.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.143+0000 7ff0ce59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff0d0158ce0 0x7ff0d0070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:14.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.143+0000 7ff0ce59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff0d0158ce0 0x7ff0d0070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37994/0 (socket says 172.21.15.5:37994) 2023-07-14T13:09:14.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.143+0000 7ff0ce59c640 1 -- 172.21.15.5:0/3167695554 learned_addr learned my addr 172.21.15.5:0/3167695554 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:14.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.143+0000 7ff0ced9d640 1 --2- 172.21.15.5:0/3167695554 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0d00c9730 0x7ff0d00ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:14.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.143+0000 7ff0ce59c640 1 -- 172.21.15.5:0/3167695554 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0d00c9730 msgr2=0x7ff0d00ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:14.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.143+0000 7ff0ce59c640 1 --2- 172.21.15.5:0/3167695554 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0d00c9730 0x7ff0d00ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:14.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.143+0000 7ff0ce59c640 1 -- 172.21.15.5:0/3167695554 >> v1:172.21.15.5:6789/0 conn(0x7ff0d00c8ad0 legacy=0x7ff0d00c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:14.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.143+0000 7ff0ce59c640 1 -- 172.21.15.5:0/3167695554 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d00cbdd0 con 0x7ff0d0158ce0 2023-07-14T13:09:14.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.143+0000 7ff0cdd9b640 1 -- 172.21.15.5:0/3167695554 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407607356 0 0) 0x7ff0d00cc700 con 0x7ff0d00c8ad0 2023-07-14T13:09:14.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.143+0000 7ff0ce59c640 1 --2- 172.21.15.5:0/3167695554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0d0158ce0 0x7ff0d0070450 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7ff0c000bb10 tx=0x7ff0c001eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf54d0f3d574a7b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:14.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.143+0000 7ff0cdd9b640 1 -- 172.21.15.5:0/3167695554 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c00a7bb0 con 0x7ff0d0158ce0 2023-07-14T13:09:14.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.143+0000 7ff0cdd9b640 1 -- 172.21.15.5:0/3167695554 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c00a7d10 con 0x7ff0d0158ce0 2023-07-14T13:09:14.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.143+0000 7ff0cdd9b640 1 -- 172.21.15.5:0/3167695554 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c00af660 con 0x7ff0d0158ce0 2023-07-14T13:09:14.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.147+0000 7ff0d4b74640 1 -- 172.21.15.5:0/3167695554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0d0158ce0 msgr2=0x7ff0d0070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:14.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.147+0000 7ff0d4b74640 1 --2- 172.21.15.5:0/3167695554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0d0158ce0 0x7ff0d0070450 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7ff0c000bb10 tx=0x7ff0c001eac0 comp rx=0 tx=0).stop 2023-07-14T13:09:14.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.147+0000 7ff0d4b74640 1 -- 172.21.15.5:0/3167695554 shutdown_connections 2023-07-14T13:09:14.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.147+0000 7ff0d4b74640 1 --2- 172.21.15.5:0/3167695554 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0d00c9730 0x7ff0d00ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:14.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.147+0000 7ff0d4b74640 1 --2- 172.21.15.5:0/3167695554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0d0158ce0 0x7ff0d0070450 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:14.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.147+0000 7ff0d4b74640 1 -- 172.21.15.5:0/3167695554 >> 172.21.15.5:0/3167695554 conn(0x7ff0d00afcf0 msgr2=0x7ff0d00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:14.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.147+0000 7ff0d4b74640 1 -- 172.21.15.5:0/3167695554 shutdown_connections 2023-07-14T13:09:14.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.147+0000 7ff0d4b74640 1 -- 172.21.15.5:0/3167695554 wait complete. 2023-07-14T13:09:14.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.147+0000 7ff0d4b74640 1 Processor -- start 2023-07-14T13:09:14.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.147+0000 7ff0d4b74640 1 -- start start 2023-07-14T13:09:14.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.147+0000 7ff0d4b74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d00c8ad0 0x7ff0d0144680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:14.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.147+0000 7ff0d4b74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0d00c9730 0x7ff0d014bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:14.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.147+0000 7ff0d4b74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0d0158ce0 0x7ff0d014c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:14.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.147+0000 7ff0d4b74640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d0144bc0 con 0x7ff0d0158ce0 2023-07-14T13:09:14.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.147+0000 7ff0d4b74640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d01451d0 con 0x7ff0d00c8ad0 2023-07-14T13:09:14.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.147+0000 7ff0d4b74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d01454b0 con 0x7ff0d00c9730 2023-07-14T13:09:14.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.147+0000 7ff0ced9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0d0158ce0 0x7ff0d014c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:14.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.147+0000 7ff0ced9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0d0158ce0 0x7ff0d014c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38006/0 (socket says 172.21.15.5:38006) 2023-07-14T13:09:14.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.147+0000 7ff0ced9d640 1 -- 172.21.15.5:0/921546038 learned_addr learned my addr 172.21.15.5:0/921546038 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:14.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.151+0000 7ff0ced9d640 1 -- 172.21.15.5:0/921546038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0d00c9730 msgr2=0x7ff0d014bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:14.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.151+0000 7ff0ced9d640 1 --2- 172.21.15.5:0/921546038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0d00c9730 0x7ff0d014bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:14.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.151+0000 7ff0ced9d640 1 -- 172.21.15.5:0/921546038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d00c8ad0 msgr2=0x7ff0d0144680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:14.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.151+0000 7ff0ce59c640 1 --2- 172.21.15.5:0/921546038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d00c8ad0 0x7ff0d0144680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:14.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.151+0000 7ff0ced9d640 1 --2- 172.21.15.5:0/921546038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d00c8ad0 0x7ff0d0144680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:14.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.151+0000 7ff0ced9d640 1 -- 172.21.15.5:0/921546038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c000b770 con 0x7ff0d0158ce0 2023-07-14T13:09:14.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.151+0000 7ff0ced9d640 1 --2- 172.21.15.5:0/921546038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0d0158ce0 0x7ff0d014c0d0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800ef90 tx=0x7ff0c800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:14.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.151+0000 7ff0c6ffd640 1 -- 172.21.15.5:0/921546038 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c8009ca0 con 0x7ff0d0158ce0 2023-07-14T13:09:14.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.151+0000 7ff0c6ffd640 1 -- 172.21.15.5:0/921546038 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c800f040 con 0x7ff0d0158ce0 2023-07-14T13:09:14.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.151+0000 7ff0d4b74640 1 -- 172.21.15.5:0/921546038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d0145790 con 0x7ff0d0158ce0 2023-07-14T13:09:14.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.151+0000 7ff0c6ffd640 1 -- 172.21.15.5:0/921546038 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c80146c0 con 0x7ff0d0158ce0 2023-07-14T13:09:14.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.151+0000 7ff0d4b74640 1 -- 172.21.15.5:0/921546038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d0145d50 con 0x7ff0d0158ce0 2023-07-14T13:09:14.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.151+0000 7ff0d4b74640 1 -- 172.21.15.5:0/921546038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d00ca1a0 con 0x7ff0d0158ce0 2023-07-14T13:09:14.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.151+0000 7ff0c6ffd640 1 -- 172.21.15.5:0/921546038 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff0c8014820 con 0x7ff0d0158ce0 2023-07-14T13:09:14.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.151+0000 7ff0c6ffd640 1 --2- 172.21.15.5:0/921546038 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7ff0b00663a0 0x7ff0b0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:14.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.151+0000 7ff0c6ffd640 1 -- 172.21.15.5:0/921546038 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff0c8084f00 con 0x7ff0d0158ce0 2023-07-14T13:09:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.151+0000 7ff0ce59c640 1 --2- 172.21.15.5:0/921546038 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7ff0b00663a0 0x7ff0b0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:14.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.155+0000 7ff0ce59c640 1 --2- 172.21.15.5:0/921546038 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7ff0b00663a0 0x7ff0b0068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff0c00b1000 tx=0x7ff0c00a9070 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:14.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.155+0000 7ff0c6ffd640 1 -- 172.21.15.5:0/921546038 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff0c80520c0 con 0x7ff0d0158ce0 2023-07-14T13:09:14.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.307+0000 7ff0d4b74640 1 -- 172.21.15.5:0/921546038 --> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff0d01590b0 con 0x7ff0b00663a0 2023-07-14T13:09:14.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.319+0000 7ff0c6ffd640 1 -- 172.21.15.5:0/921546038 <== mgr.6691 v2:172.21.15.154:6832/3243469291 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+304092 (secure 0 0 0) 0x7ff0c00bf090 con 0x7ff0b00663a0 2023-07-14T13:09:14.351 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:14.352 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:09:14.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.319+0000 7ff0d4b74640 1 -- 172.21.15.5:0/921546038 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7ff0b00663a0 msgr2=0x7ff0b0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:14.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.319+0000 7ff0d4b74640 1 --2- 172.21.15.5:0/921546038 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7ff0b00663a0 0x7ff0b0068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff0c00b1000 tx=0x7ff0c00a9070 comp rx=0 tx=0).stop 2023-07-14T13:09:14.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.319+0000 7ff0d4b74640 1 -- 172.21.15.5:0/921546038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0d0158ce0 msgr2=0x7ff0d014c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:14.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.319+0000 7ff0d4b74640 1 --2- 172.21.15.5:0/921546038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0d0158ce0 0x7ff0d014c0d0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800ef90 tx=0x7ff0c800c490 comp rx=0 tx=0).stop 2023-07-14T13:09:14.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.319+0000 7ff0d4b74640 1 -- 172.21.15.5:0/921546038 shutdown_connections 2023-07-14T13:09:14.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.319+0000 7ff0d4b74640 1 --2- 172.21.15.5:0/921546038 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7ff0b00663a0 0x7ff0b0068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:14.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.319+0000 7ff0d4b74640 1 --2- 172.21.15.5:0/921546038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0d0158ce0 0x7ff0d014c0d0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:14.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.319+0000 7ff0d4b74640 1 --2- 172.21.15.5:0/921546038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0d00c9730 0x7ff0d014bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:14.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.319+0000 7ff0d4b74640 1 --2- 172.21.15.5:0/921546038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d00c8ad0 0x7ff0d0144680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:14.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.319+0000 7ff0d4b74640 1 -- 172.21.15.5:0/921546038 >> 172.21.15.5:0/921546038 conn(0x7ff0d00afcf0 msgr2=0x7ff0d00ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:14.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.323+0000 7ff0d4b74640 1 -- 172.21.15.5:0/921546038 shutdown_connections 2023-07-14T13:09:14.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.323+0000 7ff0d4b74640 1 -- 172.21.15.5:0/921546038 wait complete. 2023-07-14T13:09:14.372 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-14T13:09:12.334175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591110,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":302,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":118,"acting":118,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":315168,"kb_used_data":10208,"kb_used_omap":0,"kb_used_meta":304896,"kb_avail":754659552,"statfs":{"total":773094113280,"available":772771381248,"internally_reserved":0,"allocated":10452992,"data_stored":5819512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312213504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.915413"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.430093+0000","last_change":"2023-07-14T13:09:09.446176+0000","last_active":"2023-07-14T13:09:10.430093+0000","last_peered":"2023-07-14T13:09:10.430093+0000","last_clean":"2023-07-14T13:09:10.430093+0000","last_became_active":"2023-07-14T13:09:09.445293+0000","last_became_peered":"2023-07-14T13:09:09.445293+0000","last_unstale":"2023-07-14T13:09:10.430093+0000","last_undegraded":"2023-07-14T13:09:10.430093+0000","last_fullsized":"2023-07-14T13:09:10.430093+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:33:21.009243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034775+0000","last_change":"2023-07-14T13:09:09.448668+0000","last_active":"2023-07-14T13:09:12.034775+0000","last_peered":"2023-07-14T13:09:12.034775+0000","last_clean":"2023-07-14T13:09:12.034775+0000","last_became_active":"2023-07-14T13:09:09.448371+0000","last_became_peered":"2023-07-14T13:09:09.448371+0000","last_unstale":"2023-07-14T13:09:12.034775+0000","last_undegraded":"2023-07-14T13:09:12.034775+0000","last_fullsized":"2023-07-14T13:09:12.034775+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:48:39.755881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892686+0000","last_change":"2023-07-14T13:09:09.454198+0000","last_active":"2023-07-14T13:09:11.892686+0000","last_peered":"2023-07-14T13:09:11.892686+0000","last_clean":"2023-07-14T13:09:11.892686+0000","last_became_active":"2023-07-14T13:09:09.453939+0000","last_became_peered":"2023-07-14T13:09:09.453939+0000","last_unstale":"2023-07-14T13:09:11.892686+0000","last_undegraded":"2023-07-14T13:09:11.892686+0000","last_fullsized":"2023-07-14T13:09:11.892686+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:22:29.316898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033830+0000","last_change":"2023-07-14T13:09:09.466445+0000","last_active":"2023-07-14T13:09:12.033830+0000","last_peered":"2023-07-14T13:09:12.033830+0000","last_clean":"2023-07-14T13:09:12.033830+0000","last_became_active":"2023-07-14T13:09:09.466235+0000","last_became_peered":"2023-07-14T13:09:09.466235+0000","last_unstale":"2023-07-14T13:09:12.033830+0000","last_undegraded":"2023-07-14T13:09:12.033830+0000","last_fullsized":"2023-07-14T13:09:12.033830+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:42:41.071144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892478+0000","last_change":"2023-07-14T13:09:09.444492+0000","last_active":"2023-07-14T13:09:11.892478+0000","last_peered":"2023-07-14T13:09:11.892478+0000","last_clean":"2023-07-14T13:09:11.892478+0000","last_became_active":"2023-07-14T13:09:09.444047+0000","last_became_peered":"2023-07-14T13:09:09.444047+0000","last_unstale":"2023-07-14T13:09:11.892478+0000","last_undegraded":"2023-07-14T13:09:11.892478+0000","last_fullsized":"2023-07-14T13:09:11.892478+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:09:58.802715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429956+0000","last_change":"2023-07-14T13:09:09.452430+0000","last_active":"2023-07-14T13:09:10.429956+0000","last_peered":"2023-07-14T13:09:10.429956+0000","last_clean":"2023-07-14T13:09:10.429956+0000","last_became_active":"2023-07-14T13:09:09.449894+0000","last_became_peered":"2023-07-14T13:09:09.449894+0000","last_unstale":"2023-07-14T13:09:10.429956+0000","last_undegraded":"2023-07-14T13:09:10.429956+0000","last_fullsized":"2023-07-14T13:09:10.429956+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:48:14.007032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892830+0000","last_change":"2023-07-14T13:09:09.469561+0000","last_active":"2023-07-14T13:09:11.892830+0000","last_peered":"2023-07-14T13:09:11.892830+0000","last_clean":"2023-07-14T13:09:11.892830+0000","last_became_active":"2023-07-14T13:09:09.469257+0000","last_became_peered":"2023-07-14T13:09:09.469257+0000","last_unstale":"2023-07-14T13:09:11.892830+0000","last_undegraded":"2023-07-14T13:09:11.892830+0000","last_fullsized":"2023-07-14T13:09:11.892830+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:54:26.926217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034246+0000","last_change":"2023-07-14T13:09:09.465984+0000","last_active":"2023-07-14T13:09:12.034246+0000","last_peered":"2023-07-14T13:09:12.034246+0000","last_clean":"2023-07-14T13:09:12.034246+0000","last_became_active":"2023-07-14T13:09:09.465297+0000","last_became_peered":"2023-07-14T13:09:09.465297+0000","last_unstale":"2023-07-14T13:09:12.034246+0000","last_undegraded":"2023-07-14T13:09:12.034246+0000","last_fullsized":"2023-07-14T13:09:12.034246+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:36:51.749103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429563+0000","last_change":"2023-07-14T13:09:09.447329+0000","last_active":"2023-07-14T13:09:10.429563+0000","last_peered":"2023-07-14T13:09:10.429563+0000","last_clean":"2023-07-14T13:09:10.429563+0000","last_became_active":"2023-07-14T13:09:09.447000+0000","last_became_peered":"2023-07-14T13:09:09.447000+0000","last_unstale":"2023-07-14T13:09:10.429563+0000","last_undegraded":"2023-07-14T13:09:10.429563+0000","last_fullsized":"2023-07-14T13:09:10.429563+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:25:22.872941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892937+0000","last_change":"2023-07-14T13:09:09.455889+0000","last_active":"2023-07-14T13:09:11.892937+0000","last_peered":"2023-07-14T13:09:11.892937+0000","last_clean":"2023-07-14T13:09:11.892937+0000","last_became_active":"2023-07-14T13:09:09.455632+0000","last_became_peered":"2023-07-14T13:09:09.455632+0000","last_unstale":"2023-07-14T13:09:11.892937+0000","last_undegraded":"2023-07-14T13:09:11.892937+0000","last_fullsized":"2023-07-14T13:09:11.892937+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:29:40.244587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034806+0000","last_change":"2023-07-14T13:09:09.450337+0000","last_active":"2023-07-14T13:09:12.034806+0000","last_peered":"2023-07-14T13:09:12.034806+0000","last_clean":"2023-07-14T13:09:12.034806+0000","last_became_active":"2023-07-14T13:09:09.450041+0000","last_became_peered":"2023-07-14T13:09:09.450041+0000","last_unstale":"2023-07-14T13:09:12.034806+0000","last_undegraded":"2023-07-14T13:09:12.034806+0000","last_fullsized":"2023-07-14T13:09:12.034806+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:25:09.990529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034503+0000","last_change":"2023-07-14T13:09:09.457178+0000","last_active":"2023-07-14T13:09:12.034503+0000","last_peered":"2023-07-14T13:09:12.034503+0000","last_clean":"2023-07-14T13:09:12.034503+0000","last_became_active":"2023-07-14T13:09:09.456873+0000","last_became_peered":"2023-07-14T13:09:09.456873+0000","last_unstale":"2023-07-14T13:09:12.034503+0000","last_undegraded":"2023-07-14T13:09:12.034503+0000","last_fullsized":"2023-07-14T13:09:12.034503+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:13:42.988795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892699+0000","last_change":"2023-07-14T13:09:09.449996+0000","last_active":"2023-07-14T13:09:11.892699+0000","last_peered":"2023-07-14T13:09:11.892699+0000","last_clean":"2023-07-14T13:09:11.892699+0000","last_became_active":"2023-07-14T13:09:09.449678+0000","last_became_peered":"2023-07-14T13:09:09.449678+0000","last_unstale":"2023-07-14T13:09:11.892699+0000","last_undegraded":"2023-07-14T13:09:11.892699+0000","last_fullsized":"2023-07-14T13:09:11.892699+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:58:24.472482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892490+0000","last_change":"2023-07-14T13:09:09.469085+0000","last_active":"2023-07-14T13:09:11.892490+0000","last_peered":"2023-07-14T13:09:11.892490+0000","last_clean":"2023-07-14T13:09:11.892490+0000","last_became_active":"2023-07-14T13:09:09.468814+0000","last_became_peered":"2023-07-14T13:09:09.468814+0000","last_unstale":"2023-07-14T13:09:11.892490+0000","last_undegraded":"2023-07-14T13:09:11.892490+0000","last_fullsized":"2023-07-14T13:09:11.892490+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:11:15.830663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429728+0000","last_change":"2023-07-14T13:09:09.459438+0000","last_active":"2023-07-14T13:09:10.429728+0000","last_peered":"2023-07-14T13:09:10.429728+0000","last_clean":"2023-07-14T13:09:10.429728+0000","last_became_active":"2023-07-14T13:09:09.459180+0000","last_became_peered":"2023-07-14T13:09:09.459180+0000","last_unstale":"2023-07-14T13:09:10.429728+0000","last_undegraded":"2023-07-14T13:09:10.429728+0000","last_fullsized":"2023-07-14T13:09:10.429728+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:51:06.800504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.430164+0000","last_change":"2023-07-14T13:09:09.455611+0000","last_active":"2023-07-14T13:09:10.430164+0000","last_peered":"2023-07-14T13:09:10.430164+0000","last_clean":"2023-07-14T13:09:10.430164+0000","last_became_active":"2023-07-14T13:09:09.455121+0000","last_became_peered":"2023-07-14T13:09:09.455121+0000","last_unstale":"2023-07-14T13:09:10.430164+0000","last_undegraded":"2023-07-14T13:09:10.430164+0000","last_fullsized":"2023-07-14T13:09:10.430164+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:03:49.784846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892820+0000","last_change":"2023-07-14T13:09:09.454892+0000","last_active":"2023-07-14T13:09:11.892820+0000","last_peered":"2023-07-14T13:09:11.892820+0000","last_clean":"2023-07-14T13:09:11.892820+0000","last_became_active":"2023-07-14T13:09:09.454598+0000","last_became_peered":"2023-07-14T13:09:09.454598+0000","last_unstale":"2023-07-14T13:09:11.892820+0000","last_undegraded":"2023-07-14T13:09:11.892820+0000","last_fullsized":"2023-07-14T13:09:11.892820+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:02:23.849786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429732+0000","last_change":"2023-07-14T13:09:09.446033+0000","last_active":"2023-07-14T13:09:10.429732+0000","last_peered":"2023-07-14T13:09:10.429732+0000","last_clean":"2023-07-14T13:09:10.429732+0000","last_became_active":"2023-07-14T13:09:09.445481+0000","last_became_peered":"2023-07-14T13:09:09.445481+0000","last_unstale":"2023-07-14T13:09:10.429732+0000","last_undegraded":"2023-07-14T13:09:10.429732+0000","last_fullsized":"2023-07-14T13:09:10.429732+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:52:51.943223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033999+0000","last_change":"2023-07-14T13:09:09.445955+0000","last_active":"2023-07-14T13:09:12.033999+0000","last_peered":"2023-07-14T13:09:12.033999+0000","last_clean":"2023-07-14T13:09:12.033999+0000","last_became_active":"2023-07-14T13:09:09.445618+0000","last_became_peered":"2023-07-14T13:09:09.445618+0000","last_unstale":"2023-07-14T13:09:12.033999+0000","last_undegraded":"2023-07-14T13:09:12.033999+0000","last_fullsized":"2023-07-14T13:09:12.033999+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:13:42.533007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033987+0000","last_change":"2023-07-14T13:09:09.450411+0000","last_active":"2023-07-14T13:09:12.033987+0000","last_peered":"2023-07-14T13:09:12.033987+0000","last_clean":"2023-07-14T13:09:12.033987+0000","last_became_active":"2023-07-14T13:09:09.450124+0000","last_became_peered":"2023-07-14T13:09:09.450124+0000","last_unstale":"2023-07-14T13:09:12.033987+0000","last_undegraded":"2023-07-14T13:09:12.033987+0000","last_fullsized":"2023-07-14T13:09:12.033987+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:17:47.890949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"96'4","reported_seq":17,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892923+0000","last_change":"2023-07-14T13:09:08.444497+0000","last_active":"2023-07-14T13:09:11.892923+0000","last_peered":"2023-07-14T13:09:11.892923+0000","last_clean":"2023-07-14T13:09:11.892923+0000","last_became_active":"2023-07-14T13:09:08.444214+0000","last_became_peered":"2023-07-14T13:09:08.444214+0000","last_unstale":"2023-07-14T13:09:11.892923+0000","last_undegraded":"2023-07-14T13:09:11.892923+0000","last_fullsized":"2023-07-14T13:09:11.892923+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:51:45.905778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429570+0000","last_change":"2023-07-14T13:09:09.458943+0000","last_active":"2023-07-14T13:09:10.429570+0000","last_peered":"2023-07-14T13:09:10.429570+0000","last_clean":"2023-07-14T13:09:10.429570+0000","last_became_active":"2023-07-14T13:09:09.455757+0000","last_became_peered":"2023-07-14T13:09:09.455757+0000","last_unstale":"2023-07-14T13:09:10.429570+0000","last_undegraded":"2023-07-14T13:09:10.429570+0000","last_fullsized":"2023-07-14T13:09:10.429570+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:45:39.572860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429834+0000","last_change":"2023-07-14T13:09:09.447229+0000","last_active":"2023-07-14T13:09:10.429834+0000","last_peered":"2023-07-14T13:09:10.429834+0000","last_clean":"2023-07-14T13:09:10.429834+0000","last_became_active":"2023-07-14T13:09:09.446944+0000","last_became_peered":"2023-07-14T13:09:09.446944+0000","last_unstale":"2023-07-14T13:09:10.429834+0000","last_undegraded":"2023-07-14T13:09:10.429834+0000","last_fullsized":"2023-07-14T13:09:10.429834+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:58:11.945700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.430015+0000","last_change":"2023-07-14T13:09:09.445796+0000","last_active":"2023-07-14T13:09:10.430015+0000","last_peered":"2023-07-14T13:09:10.430015+0000","last_clean":"2023-07-14T13:09:10.430015+0000","last_became_active":"2023-07-14T13:09:09.445514+0000","last_became_peered":"2023-07-14T13:09:09.445514+0000","last_unstale":"2023-07-14T13:09:10.430015+0000","last_undegraded":"2023-07-14T13:09:10.430015+0000","last_fullsized":"2023-07-14T13:09:10.430015+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:02:59.884389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429710+0000","last_change":"2023-07-14T13:09:08.443183+0000","last_active":"2023-07-14T13:09:10.429710+0000","last_peered":"2023-07-14T13:09:10.429710+0000","last_clean":"2023-07-14T13:09:10.429710+0000","last_became_active":"2023-07-14T13:09:08.442696+0000","last_became_peered":"2023-07-14T13:09:08.442696+0000","last_unstale":"2023-07-14T13:09:10.429710+0000","last_undegraded":"2023-07-14T13:09:10.429710+0000","last_fullsized":"2023-07-14T13:09:10.429710+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:30:50.273654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892594+0000","last_change":"2023-07-14T13:09:08.433369+0000","last_active":"2023-07-14T13:09:11.892594+0000","last_peered":"2023-07-14T13:09:11.892594+0000","last_clean":"2023-07-14T13:09:11.892594+0000","last_became_active":"2023-07-14T13:09:08.431724+0000","last_became_peered":"2023-07-14T13:09:08.431724+0000","last_unstale":"2023-07-14T13:09:11.892594+0000","last_undegraded":"2023-07-14T13:09:11.892594+0000","last_fullsized":"2023-07-14T13:09:11.892594+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:12:54.167527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429571+0000","last_change":"2023-07-14T13:09:09.447525+0000","last_active":"2023-07-14T13:09:10.429571+0000","last_peered":"2023-07-14T13:09:10.429571+0000","last_clean":"2023-07-14T13:09:10.429571+0000","last_became_active":"2023-07-14T13:09:09.446162+0000","last_became_peered":"2023-07-14T13:09:09.446162+0000","last_unstale":"2023-07-14T13:09:10.429571+0000","last_undegraded":"2023-07-14T13:09:10.429571+0000","last_fullsized":"2023-07-14T13:09:10.429571+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:22.698260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034350+0000","last_change":"2023-07-14T13:09:09.453933+0000","last_active":"2023-07-14T13:09:12.034350+0000","last_peered":"2023-07-14T13:09:12.034350+0000","last_clean":"2023-07-14T13:09:12.034350+0000","last_became_active":"2023-07-14T13:09:09.453610+0000","last_became_peered":"2023-07-14T13:09:09.453610+0000","last_unstale":"2023-07-14T13:09:12.034350+0000","last_undegraded":"2023-07-14T13:09:12.034350+0000","last_fullsized":"2023-07-14T13:09:12.034350+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:24:39.457351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"96'3","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892897+0000","last_change":"2023-07-14T13:09:08.437217+0000","last_active":"2023-07-14T13:09:11.892897+0000","last_peered":"2023-07-14T13:09:11.892897+0000","last_clean":"2023-07-14T13:09:11.892897+0000","last_became_active":"2023-07-14T13:09:08.436904+0000","last_became_peered":"2023-07-14T13:09:08.436904+0000","last_unstale":"2023-07-14T13:09:11.892897+0000","last_undegraded":"2023-07-14T13:09:11.892897+0000","last_fullsized":"2023-07-14T13:09:11.892897+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:33:17.679033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034191+0000","last_change":"2023-07-14T13:09:09.449362+0000","last_active":"2023-07-14T13:09:12.034191+0000","last_peered":"2023-07-14T13:09:12.034191+0000","last_clean":"2023-07-14T13:09:12.034191+0000","last_became_active":"2023-07-14T13:09:09.448691+0000","last_became_peered":"2023-07-14T13:09:09.448691+0000","last_unstale":"2023-07-14T13:09:12.034191+0000","last_undegraded":"2023-07-14T13:09:12.034191+0000","last_fullsized":"2023-07-14T13:09:12.034191+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:11:22.058932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892506+0000","last_change":"2023-07-14T13:09:08.443228+0000","last_active":"2023-07-14T13:09:11.892506+0000","last_peered":"2023-07-14T13:09:11.892506+0000","last_clean":"2023-07-14T13:09:11.892506+0000","last_became_active":"2023-07-14T13:09:08.442874+0000","last_became_peered":"2023-07-14T13:09:08.442874+0000","last_unstale":"2023-07-14T13:09:11.892506+0000","last_undegraded":"2023-07-14T13:09:11.892506+0000","last_fullsized":"2023-07-14T13:09:11.892506+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:38:31.212301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"96'8","reported_seq":21,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429919+0000","last_change":"2023-07-14T13:09:08.443086+0000","last_active":"2023-07-14T13:09:10.429919+0000","last_peered":"2023-07-14T13:09:10.429919+0000","last_clean":"2023-07-14T13:09:10.429919+0000","last_became_active":"2023-07-14T13:09:08.442793+0000","last_became_peered":"2023-07-14T13:09:08.442793+0000","last_unstale":"2023-07-14T13:09:10.429919+0000","last_undegraded":"2023-07-14T13:09:10.429919+0000","last_fullsized":"2023-07-14T13:09:10.429919+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:22:53.283592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"97'1","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.891853+0000","last_change":"2023-07-14T13:09:08.447067+0000","last_active":"2023-07-14T13:09:11.891853+0000","last_peered":"2023-07-14T13:09:11.891853+0000","last_clean":"2023-07-14T13:09:11.891853+0000","last_became_active":"2023-07-14T13:09:08.446799+0000","last_became_peered":"2023-07-14T13:09:08.446799+0000","last_unstale":"2023-07-14T13:09:11.891853+0000","last_undegraded":"2023-07-14T13:09:11.891853+0000","last_fullsized":"2023-07-14T13:09:11.891853+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:28:21.757335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429786+0000","last_change":"2023-07-14T13:09:09.445848+0000","last_active":"2023-07-14T13:09:10.429786+0000","last_peered":"2023-07-14T13:09:10.429786+0000","last_clean":"2023-07-14T13:09:10.429786+0000","last_became_active":"2023-07-14T13:09:09.445068+0000","last_became_peered":"2023-07-14T13:09:09.445068+0000","last_unstale":"2023-07-14T13:09:10.429786+0000","last_undegraded":"2023-07-14T13:09:10.429786+0000","last_fullsized":"2023-07-14T13:09:10.429786+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:25:09.202126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892633+0000","last_change":"2023-07-14T13:09:08.443277+0000","last_active":"2023-07-14T13:09:11.892633+0000","last_peered":"2023-07-14T13:09:11.892633+0000","last_clean":"2023-07-14T13:09:11.892633+0000","last_became_active":"2023-07-14T13:09:08.442915+0000","last_became_peered":"2023-07-14T13:09:08.442915+0000","last_unstale":"2023-07-14T13:09:11.892633+0000","last_undegraded":"2023-07-14T13:09:11.892633+0000","last_fullsized":"2023-07-14T13:09:11.892633+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:48:52.995190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034856+0000","last_change":"2023-07-14T13:09:09.463272+0000","last_active":"2023-07-14T13:09:12.034856+0000","last_peered":"2023-07-14T13:09:12.034856+0000","last_clean":"2023-07-14T13:09:12.034856+0000","last_became_active":"2023-07-14T13:09:09.462912+0000","last_became_peered":"2023-07-14T13:09:09.462912+0000","last_unstale":"2023-07-14T13:09:12.034856+0000","last_undegraded":"2023-07-14T13:09:12.034856+0000","last_fullsized":"2023-07-14T13:09:12.034856+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:28:41.067336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034922+0000","last_change":"2023-07-14T13:09:09.445631+0000","last_active":"2023-07-14T13:09:12.034922+0000","last_peered":"2023-07-14T13:09:12.034922+0000","last_clean":"2023-07-14T13:09:12.034922+0000","last_became_active":"2023-07-14T13:09:09.445366+0000","last_became_peered":"2023-07-14T13:09:09.445366+0000","last_unstale":"2023-07-14T13:09:12.034922+0000","last_undegraded":"2023-07-14T13:09:12.034922+0000","last_fullsized":"2023-07-14T13:09:12.034922+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:47:59.705980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034027+0000","last_change":"2023-07-14T13:09:08.441197+0000","last_active":"2023-07-14T13:09:12.034027+0000","last_peered":"2023-07-14T13:09:12.034027+0000","last_clean":"2023-07-14T13:09:12.034027+0000","last_became_active":"2023-07-14T13:09:08.440996+0000","last_became_peered":"2023-07-14T13:09:08.440996+0000","last_unstale":"2023-07-14T13:09:12.034027+0000","last_undegraded":"2023-07-14T13:09:12.034027+0000","last_fullsized":"2023-07-14T13:09:12.034027+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:08:34.441857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034521+0000","last_change":"2023-07-14T13:09:08.446105+0000","last_active":"2023-07-14T13:09:12.034521+0000","last_peered":"2023-07-14T13:09:12.034521+0000","last_clean":"2023-07-14T13:09:12.034521+0000","last_became_active":"2023-07-14T13:09:08.445697+0000","last_became_peered":"2023-07-14T13:09:08.445697+0000","last_unstale":"2023-07-14T13:09:12.034521+0000","last_undegraded":"2023-07-14T13:09:12.034521+0000","last_fullsized":"2023-07-14T13:09:12.034521+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:00:10.980521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"85'183","reported_seq":539,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-07-14T13:09:05.200783+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:09:05.200783+0000","last_peered":"2023-07-14T13:09:05.200783+0000","last_clean":"2023-07-14T13:09:05.200783+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:09:05.200783+0000","last_undegraded":"2023-07-14T13:09:05.200783+0000","last_fullsized":"2023-07-14T13:09:05.200783+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:11:42.664390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":148,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-07-14T13:09:05.200774+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:09:05.200774+0000","last_peered":"2023-07-14T13:09:05.200774+0000","last_clean":"2023-07-14T13:09:05.200774+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:09:05.200774+0000","last_undegraded":"2023-07-14T13:09:05.200774+0000","last_fullsized":"2023-07-14T13:09:05.200774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:24:29.586540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.430147+0000","last_change":"2023-07-14T13:09:09.445181+0000","last_active":"2023-07-14T13:09:10.430147+0000","last_peered":"2023-07-14T13:09:10.430147+0000","last_clean":"2023-07-14T13:09:10.430147+0000","last_became_active":"2023-07-14T13:09:09.439207+0000","last_became_peered":"2023-07-14T13:09:09.439207+0000","last_unstale":"2023-07-14T13:09:10.430147+0000","last_undegraded":"2023-07-14T13:09:10.430147+0000","last_fullsized":"2023-07-14T13:09:10.430147+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:29:51.451099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033893+0000","last_change":"2023-07-14T13:09:08.445355+0000","last_active":"2023-07-14T13:09:12.033893+0000","last_peered":"2023-07-14T13:09:12.033893+0000","last_clean":"2023-07-14T13:09:12.033893+0000","last_became_active":"2023-07-14T13:09:08.445081+0000","last_became_peered":"2023-07-14T13:09:08.445081+0000","last_unstale":"2023-07-14T13:09:12.033893+0000","last_undegraded":"2023-07-14T13:09:12.033893+0000","last_fullsized":"2023-07-14T13:09:12.033893+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:02:41.574353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-07-14T13:09:05.200636+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:09:05.200636+0000","last_peered":"2023-07-14T13:09:05.200636+0000","last_clean":"2023-07-14T13:09:05.200636+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:09:05.200636+0000","last_undegraded":"2023-07-14T13:09:05.200636+0000","last_fullsized":"2023-07-14T13:09:05.200636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:13:13.014415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:08.414277+0000","last_change":"2023-07-14T13:09:08.414277+0000","last_active":"2023-07-14T13:09:08.414277+0000","last_peered":"2023-07-14T13:09:08.414277+0000","last_clean":"2023-07-14T13:09:08.414277+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:08.414277+0000","last_undegraded":"2023-07-14T13:09:08.414277+0000","last_fullsized":"2023-07-14T13:09:08.414277+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033787+0000","last_change":"2023-07-14T13:09:08.444592+0000","last_active":"2023-07-14T13:09:12.033787+0000","last_peered":"2023-07-14T13:09:12.033787+0000","last_clean":"2023-07-14T13:09:12.033787+0000","last_became_active":"2023-07-14T13:09:08.444313+0000","last_became_peered":"2023-07-14T13:09:08.444313+0000","last_unstale":"2023-07-14T13:09:12.033787+0000","last_undegraded":"2023-07-14T13:09:12.033787+0000","last_fullsized":"2023-07-14T13:09:12.033787+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:26:10.415790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":150,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892700+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:09:11.892700+0000","last_peered":"2023-07-14T13:09:11.892700+0000","last_clean":"2023-07-14T13:09:11.892700+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:09:11.892700+0000","last_undegraded":"2023-07-14T13:09:11.892700+0000","last_fullsized":"2023-07-14T13:09:11.892700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:50:36.399832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429987+0000","last_change":"2023-07-14T13:09:09.455678+0000","last_active":"2023-07-14T13:09:10.429987+0000","last_peered":"2023-07-14T13:09:10.429987+0000","last_clean":"2023-07-14T13:09:10.429987+0000","last_became_active":"2023-07-14T13:09:09.455373+0000","last_became_peered":"2023-07-14T13:09:09.455373+0000","last_unstale":"2023-07-14T13:09:10.429987+0000","last_undegraded":"2023-07-14T13:09:10.429987+0000","last_fullsized":"2023-07-14T13:09:10.429987+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:46:27.362227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"96'2","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034498+0000","last_change":"2023-07-14T13:09:08.441285+0000","last_active":"2023-07-14T13:09:12.034498+0000","last_peered":"2023-07-14T13:09:12.034498+0000","last_clean":"2023-07-14T13:09:12.034498+0000","last_became_active":"2023-07-14T13:09:08.440995+0000","last_became_peered":"2023-07-14T13:09:08.440995+0000","last_unstale":"2023-07-14T13:09:12.034498+0000","last_undegraded":"2023-07-14T13:09:12.034498+0000","last_fullsized":"2023-07-14T13:09:12.034498+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:52:51.529066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":148,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-07-14T13:09:05.200750+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:09:05.200750+0000","last_peered":"2023-07-14T13:09:05.200750+0000","last_clean":"2023-07-14T13:09:05.200750+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:09:05.200750+0000","last_undegraded":"2023-07-14T13:09:05.200750+0000","last_fullsized":"2023-07-14T13:09:05.200750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:07:46.968763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892570+0000","last_change":"2023-07-14T13:09:09.448817+0000","last_active":"2023-07-14T13:09:11.892570+0000","last_peered":"2023-07-14T13:09:11.892570+0000","last_clean":"2023-07-14T13:09:11.892570+0000","last_became_active":"2023-07-14T13:09:09.448520+0000","last_became_peered":"2023-07-14T13:09:09.448520+0000","last_unstale":"2023-07-14T13:09:11.892570+0000","last_undegraded":"2023-07-14T13:09:11.892570+0000","last_fullsized":"2023-07-14T13:09:11.892570+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:53:13.224188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"96'1","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892913+0000","last_change":"2023-07-14T13:09:08.440049+0000","last_active":"2023-07-14T13:09:11.892913+0000","last_peered":"2023-07-14T13:09:11.892913+0000","last_clean":"2023-07-14T13:09:11.892913+0000","last_became_active":"2023-07-14T13:09:08.439676+0000","last_became_peered":"2023-07-14T13:09:08.439676+0000","last_unstale":"2023-07-14T13:09:11.892913+0000","last_undegraded":"2023-07-14T13:09:11.892913+0000","last_fullsized":"2023-07-14T13:09:11.892913+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:14:18.335021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":164,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034634+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:09:12.034634+0000","last_peered":"2023-07-14T13:09:12.034634+0000","last_clean":"2023-07-14T13:09:12.034634+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:09:12.034634+0000","last_undegraded":"2023-07-14T13:09:12.034634+0000","last_fullsized":"2023-07-14T13:09:12.034634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:07:38.092074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034347+0000","last_change":"2023-07-14T13:09:09.453843+0000","last_active":"2023-07-14T13:09:12.034347+0000","last_peered":"2023-07-14T13:09:12.034347+0000","last_clean":"2023-07-14T13:09:12.034347+0000","last_became_active":"2023-07-14T13:09:09.453556+0000","last_became_peered":"2023-07-14T13:09:09.453556+0000","last_unstale":"2023-07-14T13:09:12.034347+0000","last_undegraded":"2023-07-14T13:09:12.034347+0000","last_fullsized":"2023-07-14T13:09:12.034347+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:46:26.111226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034192+0000","last_change":"2023-07-14T13:09:08.448203+0000","last_active":"2023-07-14T13:09:12.034192+0000","last_peered":"2023-07-14T13:09:12.034192+0000","last_clean":"2023-07-14T13:09:12.034192+0000","last_became_active":"2023-07-14T13:09:08.447855+0000","last_became_peered":"2023-07-14T13:09:08.447855+0000","last_unstale":"2023-07-14T13:09:12.034192+0000","last_undegraded":"2023-07-14T13:09:12.034192+0000","last_fullsized":"2023-07-14T13:09:12.034192+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:41:24.859927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":148,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-07-14T13:09:05.200784+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:09:05.200784+0000","last_peered":"2023-07-14T13:09:05.200784+0000","last_clean":"2023-07-14T13:09:05.200784+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:09:05.200784+0000","last_undegraded":"2023-07-14T13:09:05.200784+0000","last_fullsized":"2023-07-14T13:09:05.200784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:03:39.427825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033787+0000","last_change":"2023-07-14T13:09:09.468504+0000","last_active":"2023-07-14T13:09:12.033787+0000","last_peered":"2023-07-14T13:09:12.033787+0000","last_clean":"2023-07-14T13:09:12.033787+0000","last_became_active":"2023-07-14T13:09:09.468224+0000","last_became_peered":"2023-07-14T13:09:09.468224+0000","last_unstale":"2023-07-14T13:09:12.033787+0000","last_undegraded":"2023-07-14T13:09:12.033787+0000","last_fullsized":"2023-07-14T13:09:12.033787+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:15:08.881840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":164,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034886+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:09:12.034886+0000","last_peered":"2023-07-14T13:09:12.034886+0000","last_clean":"2023-07-14T13:09:12.034886+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:09:12.034886+0000","last_undegraded":"2023-07-14T13:09:12.034886+0000","last_fullsized":"2023-07-14T13:09:12.034886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:23:14.929289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892460+0000","last_change":"2023-07-14T13:09:09.455863+0000","last_active":"2023-07-14T13:09:11.892460+0000","last_peered":"2023-07-14T13:09:11.892460+0000","last_clean":"2023-07-14T13:09:11.892460+0000","last_became_active":"2023-07-14T13:09:09.455594+0000","last_became_peered":"2023-07-14T13:09:09.455594+0000","last_unstale":"2023-07-14T13:09:11.892460+0000","last_undegraded":"2023-07-14T13:09:11.892460+0000","last_fullsized":"2023-07-14T13:09:11.892460+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:01.249886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:09:07.406370+0000","last_change":"2023-07-14T13:09:07.406370+0000","last_active":"2023-07-14T13:09:07.406370+0000","last_peered":"2023-07-14T13:09:07.406370+0000","last_clean":"2023-07-14T13:09:07.406370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:07.406370+0000","last_undegraded":"2023-07-14T13:09:07.406370+0000","last_fullsized":"2023-07-14T13:09:07.406370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":146,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-07-14T13:09:05.200910+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:09:05.200910+0000","last_peered":"2023-07-14T13:09:05.200910+0000","last_clean":"2023-07-14T13:09:05.200910+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:09:05.200910+0000","last_undegraded":"2023-07-14T13:09:05.200910+0000","last_fullsized":"2023-07-14T13:09:05.200910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:47:16.844849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":70,"acting":70,"num_store_stats":4},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":742,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":30,"acting":30,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575046,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54880,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316960,"statfs":{"total":96636764160,"available":96580567040,"internally_reserved":0,"allocated":1728512,"data_stored":1158664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.51500000000000001,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.98299999999999998,"5min":0.98399999999999999,"15min":1.879},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.56799999999999995,"5min":0.44,"15min":0.439},"max":{"1min":1.054,"5min":1.054,"15min":1.9059999999999999},"last":1.1259999999999999}]},{"osd":1,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73899999999999999,"15min":0.73599999999999999},"min":{"1min":0.504,"5min":0.434,"15min":0.42999999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.069},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.749,"15min":0.746},"min":{"1min":0.54400000000000004,"5min":0.48999999999999999,"15min":0.40500000000000003},"max":{"1min":0.93999999999999995,"5min":0.97399999999999998,"15min":1.1020000000000001},"last":0.95599999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73899999999999999,"15min":0.72799999999999998},"min":{"1min":0.52700000000000002,"5min":0.46999999999999997,"15min":0.40600000000000003},"max":{"1min":0.88100000000000001,"5min":0.98899999999999999,"15min":1.048},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.747,"15min":0.752},"min":{"1min":0.47499999999999998,"5min":0.47199999999999998,"15min":0.46899999999999997},"max":{"1min":0.91300000000000003,"5min":0.97099999999999997,"15min":1.0169999999999999},"last":1.0069999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.746,"15min":0.73399999999999999},"min":{"1min":0.59399999999999997,"5min":0.503,"15min":0.442},"max":{"1min":0.88400000000000001,"5min":1.0269999999999999,"15min":1.0760000000000001},"last":1.161},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.755,"15min":0.75700000000000001},"min":{"1min":0.60199999999999998,"5min":0.47299999999999998,"15min":0.41499999999999998},"max":{"1min":0.91600000000000004,"5min":1.018,"15min":1.024},"last":0.92600000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.44400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.82099999999999995,"5min":1.0009999999999999,"15min":1.022},"last":0.501},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.41799999999999998,"5min":0.40999999999999998,"15min":0.39300000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59699999999999998,"15min":0.60599999999999998},"min":{"1min":0.39300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.0249999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.63400000000000001,"15min":0.65600000000000003},"min":{"1min":0.41999999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.69199999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:08:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68400000000000005,"15min":0.70099999999999996},"min":{"1min":0.45200000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.99299999999999999,"5min":1.0489999999999999,"15min":1.4419999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65800000000000003,"15min":0.67600000000000005},"min":{"1min":0.46999999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81200000000000006,"5min":0.95799999999999996,"15min":1.575},"last":0.72599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575047,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":1134592,"data_stored":568296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.57799999999999996,"5min":0.38,"15min":0.38},"max":{"1min":0.90400000000000003,"5min":0.996,"15min":1.2749999999999999},"last":0.874},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.72499999999999998,"15min":0.74199999999999999},"min":{"1min":0.53600000000000003,"5min":0.48199999999999998,"15min":0.47399999999999998},"max":{"1min":0.98199999999999998,"5min":1.0800000000000001,"15min":1.2110000000000001},"last":0.77700000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73599999999999999,"15min":0.752},"min":{"1min":0.48299999999999998,"5min":0.47399999999999998,"15min":0.379},"max":{"1min":0.90900000000000003,"5min":1.0089999999999999,"15min":1.4299999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70799999999999996,"15min":0.72599999999999998},"min":{"1min":0.56999999999999995,"5min":0.46999999999999997,"15min":0.44},"max":{"1min":0.86899999999999999,"5min":0.97099999999999997,"15min":1.1379999999999999},"last":0.72599999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.73899999999999999,"15min":0.754},"min":{"1min":0.55800000000000005,"5min":0.45900000000000002,"15min":0.40400000000000003},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":1.319},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.755,"15min":0.75600000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.42299999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.341},"last":0.69099999999999995}]},{"osd":3,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76000000000000001,"15min":0.78100000000000003},"min":{"1min":0.51000000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.054,"5min":1.054,"15min":1.3859999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.52400000000000002,"5min":0.48399999999999999,"15min":0.45900000000000002},"max":{"1min":0.94799999999999995,"5min":0.99099999999999999,"15min":1.1080000000000001},"last":0.82299999999999995}]},{"osd":4,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.97899999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.624,"15min":0.63900000000000001},"min":{"1min":0.47399999999999998,"5min":0.38500000000000001,"15min":0.36099999999999999},"max":{"1min":0.93500000000000005,"5min":1.012,"15min":1.091},"last":0.66200000000000003}]},{"osd":5,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64100000000000001,"15min":0.64700000000000002},"min":{"1min":0.499,"5min":0.37,"15min":0.37},"max":{"1min":0.96599999999999997,"5min":1.579,"15min":1.579},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67800000000000005,"15min":0.69399999999999995},"min":{"1min":0.46700000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.145},"last":0.74099999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:08:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.438,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.208},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.499,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0209999999999999,"5min":1.657,"15min":1.657},"last":0.63600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575046,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1134592,"data_stored":568296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.70799999999999996,"15min":0.73099999999999998},"min":{"1min":0.376,"5min":0.36499999999999999,"15min":0.32400000000000001},"max":{"1min":0.91500000000000004,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.432},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68799999999999994,"15min":0.73299999999999998},"min":{"1min":0.41699999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.86099999999999999,"5min":1.083,"15min":1.083},"last":0.503}]},{"osd":1,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69899999999999995,"15min":0.72699999999999998},"min":{"1min":0.46899999999999997,"5min":0.44500000000000001,"15min":0.41099999999999998},"max":{"1min":0.85199999999999998,"5min":1.05,"15min":1.079},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73299999999999998,"15min":0.747},"min":{"1min":0.48999999999999999,"5min":0.48699999999999999,"15min":0.36799999999999999},"max":{"1min":0.94599999999999995,"5min":2.706,"15min":2.706},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71299999999999997,"15min":0.73899999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86299999999999999,"5min":1.212,"15min":1.212},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.70499999999999996,"15min":0.73499999999999999},"min":{"1min":0.44800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89200000000000002,"5min":1.181,"15min":1.181},"last":0.66400000000000003}]},{"osd":3,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73299999999999998,"15min":0.748},"min":{"1min":0.48599999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.876,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72799999999999998,"15min":0.76000000000000001},"min":{"1min":0.47299999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90800000000000003,"5min":1.304,"15min":1.304},"last":0.77000000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64000000000000001,"15min":0.629},"min":{"1min":0.437,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.85399999999999998,"5min":1.129,"15min":1.129},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.39900000000000002,"5min":0.36299999999999999,"15min":0.35899999999999999},"max":{"1min":0.84499999999999997,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.68500000000000005}]},{"osd":6,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.60399999999999998,"15min":0.61399999999999999},"min":{"1min":0.41999999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90200000000000002,"5min":1.169,"15min":1.169},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.64400000000000002,"15min":0.64100000000000001},"min":{"1min":0.39400000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.83699999999999997,"5min":1.238,"15min":1.238},"last":0.70899999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66100000000000003,"15min":0.64300000000000002},"min":{"1min":0.45500000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93300000000000005,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68200000000000005,"15min":0.67800000000000005},"min":{"1min":0.48999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90100000000000002,"5min":1.407,"15min":1.407},"last":0.79400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575046,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32156,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":1134592,"data_stored":568296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.73999999999999999,"15min":0.73499999999999999},"min":{"1min":0.56200000000000006,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92400000000000004,"5min":1.411,"15min":1.411},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.76800000000000002,"15min":0.73199999999999998},"min":{"1min":0.64000000000000001,"5min":0.45800000000000002,"15min":0.435},"max":{"1min":0.94599999999999995,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.83199999999999996}]},{"osd":1,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77000000000000002,"15min":0.751},"min":{"1min":0.62,"5min":0.47999999999999998,"15min":0.442},"max":{"1min":0.90700000000000003,"5min":1.077,"15min":1.077},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.54600000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91900000000000004,"5min":1.0469999999999999,"15min":1.2370000000000001},"last":0.89400000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.749,"15min":0.73599999999999999},"min":{"1min":0.60799999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.95599999999999996,"5min":1.091,"15min":1.091},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79800000000000004,"15min":0.77600000000000002},"min":{"1min":0.60399999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98199999999999998,"5min":1.387,"15min":1.387},"last":0.52100000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75,"15min":0.748},"min":{"1min":0.58099999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84799999999999998,"5min":1.008,"15min":1.099},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77500000000000002,"15min":0.77300000000000002},"min":{"1min":0.64700000000000002,"5min":0.496,"15min":0.46800000000000003},"max":{"1min":0.98699999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.61699999999999999,"15min":0.60499999999999998},"min":{"1min":0.437,"5min":0.378,"15min":0.378},"max":{"1min":0.76400000000000001,"5min":0.95599999999999996,"15min":1.0029999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.627,"15min":0.61799999999999999},"min":{"1min":0.52400000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85799999999999998,"5min":0.93600000000000005,"15min":0.95199999999999996},"last":0.57599999999999996}]},{"osd":6,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.621,"15min":0.62},"min":{"1min":0.48699999999999999,"5min":0.38900000000000001,"15min":0.32300000000000001},"max":{"1min":0.873,"5min":1.014,"15min":1.014},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.51900000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.94599999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.86599999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:08:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.68200000000000005,"15min":0.67100000000000004},"min":{"1min":0.57199999999999995,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93200000000000005,"5min":0.94699999999999995,"15min":1.0349999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.55800000000000005,"5min":0.40300000000000002,"15min":0.36899999999999999},"max":{"1min":0.96899999999999997,"5min":1.0629999999999999,"15min":1.1080000000000001},"last":0.91800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575047,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36292,"kb_used_data":1148,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335548,"statfs":{"total":96636764160,"available":96599601152,"internally_reserved":0,"allocated":1175552,"data_stored":588804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.26200000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.84199999999999997},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.498,"15min":0.51500000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.60799999999999998,"5min":0.77300000000000002,"15min":1.0209999999999999},"last":0.46800000000000003}]},{"osd":1,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47199999999999998,"15min":0.47499999999999998},"min":{"1min":0.33100000000000002,"5min":0.315,"15min":0.29599999999999999},"max":{"1min":0.63900000000000001,"5min":0.77200000000000002,"15min":0.79600000000000004},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67800000000000005,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.40699999999999997}]},{"osd":2,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54100000000000004,"15min":0.56999999999999995},"min":{"1min":0.38200000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.72399999999999998,"5min":0.82599999999999996,"15min":0.95899999999999996},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60699999999999998,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86599999999999999,"5min":1.663,"15min":1.663},"last":0.48499999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.748,"15min":0.76500000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":0.90900000000000003,"5min":1.284,"15min":1.284},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76800000000000002,"15min":0.78900000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.47699999999999998},"max":{"1min":1.0660000000000001,"5min":1.121,"15min":1.196},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.52400000000000002},"max":{"1min":1.0229999999999999,"5min":1.306,"15min":1.306},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77900000000000003,"15min":0.79100000000000004},"min":{"1min":0.58099999999999996,"5min":0.372,"15min":0.372},"max":{"1min":0.97399999999999998,"5min":1.1870000000000001,"15min":1.2470000000000001},"last":0.57299999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.76800000000000002,"15min":0.78000000000000003},"min":{"1min":0.50600000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96599999999999997,"5min":1.105,"15min":1.117},"last":0.625},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.79700000000000004,"15min":0.81799999999999995},"min":{"1min":0.56299999999999994,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.93999999999999995,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.83299999999999996,"15min":0.84099999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53100000000000003},"max":{"1min":0.89900000000000002,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.53500000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0009999999999999,"5min":1.595,"15min":1.595},"last":0.65600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575047,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58440,"kb_used_data":1152,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313400,"statfs":{"total":96636764160,"available":96576921600,"internally_reserved":0,"allocated":1179648,"data_stored":587945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45900000000000002,"15min":0.46800000000000003},"min":{"1min":0.29199999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.84699999999999998,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.54200000000000004,"15min":0.53300000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.70799999999999996,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.65500000000000003}]},{"osd":1,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.48299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30399999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65500000000000003,"5min":2.7200000000000002,"15min":2.7200000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.499,"5min":0.55000000000000004,"15min":0.56299999999999994},"min":{"1min":0.36299999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78300000000000003,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":0.61199999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.64500000000000002,"15min":0.60399999999999998},"min":{"1min":0.39500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71699999999999997,"5min":8.2530000000000001,"15min":8.2530000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89600000000000002,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.74199999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.754,"15min":0.78100000000000003},"min":{"1min":0.53200000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.99399999999999999,"5min":1.0940000000000001,"15min":1.1499999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.56699999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0629999999999999,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.76500000000000001}]},{"osd":5,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.84399999999999997,"15min":0.85799999999999998},"min":{"1min":0.58599999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1319999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.879},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82499999999999996,"15min":0.83999999999999997},"min":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.433},"max":{"1min":1.153,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.92400000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.78700000000000003,"15min":0.80400000000000005},"min":{"1min":0.57299999999999995,"5min":0.48999999999999999,"15min":0.47599999999999998},"max":{"1min":0.93999999999999995,"5min":3.9849999999999999,"15min":3.9849999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80200000000000005,"15min":0.81299999999999994},"min":{"1min":0.60699999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0289999999999999,"5min":3.391,"15min":3.391},"last":0.82799999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.79600000000000004,"15min":0.82199999999999995},"min":{"1min":0.55000000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.1759999999999999,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.81499999999999995,"15min":0.82299999999999995},"min":{"1min":0.60199999999999998,"5min":0.53200000000000003,"15min":0.50900000000000001},"max":{"1min":1.0940000000000001,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.89100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575048,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":1191936,"data_stored":594987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.29199999999999998,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.53700000000000003,"5min":0.65400000000000003,"15min":0.77200000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.28199999999999997,"15min":0.26500000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.41899999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47199999999999998,"15min":0.47299999999999998},"min":{"1min":0.34300000000000003,"5min":0.32100000000000001,"15min":0.29499999999999998},"max":{"1min":0.54200000000000004,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65100000000000002,"5min":1.014,"15min":1.014},"last":0.52300000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.621,"15min":0.63600000000000001},"min":{"1min":0.48199999999999998,"5min":0.44700000000000001,"15min":0.437},"max":{"1min":0.73899999999999999,"5min":0.80500000000000005,"15min":0.96299999999999997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56499999999999995,"15min":0.57999999999999996},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.50600000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77700000000000002,"15min":0.78400000000000003},"min":{"1min":0.55500000000000005,"5min":0.51600000000000001,"15min":0.40000000000000002},"max":{"1min":1.0409999999999999,"5min":1.2110000000000001,"15min":1.236},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77200000000000002,"15min":0.78600000000000003},"min":{"1min":0.57499999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.0309999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.77500000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.60799999999999998,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.55800000000000005,"5min":0.48599999999999999,"15min":0.48199999999999998},"max":{"1min":1.0940000000000001,"5min":1.2749999999999999,"15min":1.3600000000000001},"last":0.85399999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.53800000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1.0580000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.80500000000000005,"15min":0.81399999999999995},"min":{"1min":0.56100000000000005,"5min":0.52200000000000002,"15min":0.49199999999999999},"max":{"1min":1.1319999999999999,"5min":1.262,"15min":1.2969999999999999},"last":0.752}]},{"osd":7,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.47799999999999998},"max":{"1min":1.1479999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.82099999999999995,"15min":0.84099999999999997},"min":{"1min":0.58499999999999996,"5min":0.53700000000000003,"15min":0.52800000000000002},"max":{"1min":1.2070000000000001,"5min":1.327,"15min":1.327},"last":0.90800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575049,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36876,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334964,"statfs":{"total":96636764160,"available":96599003136,"internally_reserved":0,"allocated":1773568,"data_stored":1184224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.45600000000000002,"15min":0.44700000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.61199999999999999,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.49099999999999999,"15min":0.51500000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.27700000000000002},"max":{"1min":0.61799999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.36599999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.51900000000000002,"15min":0.51100000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69699999999999995,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.54000000000000004,"15min":0.55300000000000005},"min":{"1min":0.39800000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63800000000000001,"5min":0.80300000000000005,"15min":0.90300000000000002},"last":0.441}]},{"osd":3,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.504},"min":{"1min":0.36399999999999999,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.67600000000000005,"5min":0.72999999999999998,"15min":0.84999999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82899999999999996,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76900000000000002,"15min":0.78800000000000003},"min":{"1min":0.56100000000000005,"5min":0.48399999999999999,"15min":0.44400000000000001},"max":{"1min":0.90500000000000003,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.878},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.53500000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.038,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.91700000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.77100000000000002,"15min":0.80600000000000005},"min":{"1min":0.55100000000000005,"5min":0.51800000000000002,"15min":0.47899999999999998},"max":{"1min":0.80500000000000005,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.56399999999999995,"5min":0.49299999999999999,"15min":0.47299999999999998},"max":{"1min":0.97299999999999998,"5min":1.325,"15min":1.325},"last":0.93999999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.79100000000000004,"15min":0.80600000000000005},"min":{"1min":0.53500000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91400000000000003,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78900000000000003,"15min":0.81499999999999995},"min":{"1min":0.58399999999999996,"5min":0.55500000000000005,"15min":0.41299999999999998},"max":{"1min":1.0900000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.98099999999999998}]},{"osd":7,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.79800000000000004,"15min":0.83199999999999996},"min":{"1min":0.57699999999999996,"5min":0.503,"15min":0.45500000000000002},"max":{"1min":0.93799999999999994,"5min":1.171,"15min":1.2749999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.77100000000000002,"15min":0.81100000000000005},"min":{"1min":0.50600000000000001,"5min":0.502,"15min":0.497},"max":{"1min":0.95199999999999996,"5min":1.381,"15min":1.381},"last":0.77300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:09:14.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3f is not active+clean 2023-07-14T13:09:14.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3c is not active+clean 2023-07-14T13:09:14.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.39 is not active+clean 2023-07-14T13:09:14.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.37 is not active+clean 2023-07-14T13:09:14.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.36 is not active+clean 2023-07-14T13:09:14.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.34 is not active+clean 2023-07-14T13:09:14.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.30 is not active+clean 2023-07-14T13:09:14.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2b is not active+clean 2023-07-14T13:09:14.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.29 is not active+clean 2023-07-14T13:09:14.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.26 is not active+clean 2023-07-14T13:09:14.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.25 is not active+clean 2023-07-14T13:09:14.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.22 is not active+clean 2023-07-14T13:09:14.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.20 is not active+clean 2023-07-14T13:09:14.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2023-07-14T13:09:14.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:07.406370+0000', 'last_change': '2023-07-14T13:09:07.406370+0000', 'last_active': '2023-07-14T13:09:07.406370+0000', 'last_peered': '2023-07-14T13:09:07.406370+0000', 'last_clean': '2023-07-14T13:09:07.406370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:07.406370+0000', 'last_undegraded': '2023-07-14T13:09:07.406370+0000', 'last_fullsized': '2023-07-14T13:09:07.406370+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1a is not active+clean 2023-07-14T13:09:14.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2023-07-14T13:09:14.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:07.406370+0000', 'last_change': '2023-07-14T13:09:07.406370+0000', 'last_active': '2023-07-14T13:09:07.406370+0000', 'last_peered': '2023-07-14T13:09:07.406370+0000', 'last_clean': '2023-07-14T13:09:07.406370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:07.406370+0000', 'last_undegraded': '2023-07-14T13:09:07.406370+0000', 'last_fullsized': '2023-07-14T13:09:07.406370+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1b is not active+clean 2023-07-14T13:09:14.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2023-07-14T13:09:14.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:07.406370+0000', 'last_change': '2023-07-14T13:09:07.406370+0000', 'last_active': '2023-07-14T13:09:07.406370+0000', 'last_peered': '2023-07-14T13:09:07.406370+0000', 'last_clean': '2023-07-14T13:09:07.406370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:07.406370+0000', 'last_undegraded': '2023-07-14T13:09:07.406370+0000', 'last_fullsized': '2023-07-14T13:09:07.406370+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-07-14T13:09:14.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:07.406370+0000', 'last_change': '2023-07-14T13:09:07.406370+0000', 'last_active': '2023-07-14T13:09:07.406370+0000', 'last_peered': '2023-07-14T13:09:07.406370+0000', 'last_clean': '2023-07-14T13:09:07.406370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:07.406370+0000', 'last_undegraded': '2023-07-14T13:09:07.406370+0000', 'last_fullsized': '2023-07-14T13:09:07.406370+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-07-14T13:09:14.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:07.406370+0000', 'last_change': '2023-07-14T13:09:07.406370+0000', 'last_active': '2023-07-14T13:09:07.406370+0000', 'last_peered': '2023-07-14T13:09:07.406370+0000', 'last_clean': '2023-07-14T13:09:07.406370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:07.406370+0000', 'last_undegraded': '2023-07-14T13:09:07.406370+0000', 'last_fullsized': '2023-07-14T13:09:07.406370+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1e is not active+clean 2023-07-14T13:09:14.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2023-07-14T13:09:14.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2023-07-14T13:09:14.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:07.406370+0000', 'last_change': '2023-07-14T13:09:07.406370+0000', 'last_active': '2023-07-14T13:09:07.406370+0000', 'last_peered': '2023-07-14T13:09:07.406370+0000', 'last_clean': '2023-07-14T13:09:07.406370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:07.406370+0000', 'last_undegraded': '2023-07-14T13:09:07.406370+0000', 'last_fullsized': '2023-07-14T13:09:07.406370+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.11 is not active+clean 2023-07-14T13:09:14.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-07-14T13:09:14.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:07.406370+0000', 'last_change': '2023-07-14T13:09:07.406370+0000', 'last_active': '2023-07-14T13:09:07.406370+0000', 'last_peered': '2023-07-14T13:09:07.406370+0000', 'last_clean': '2023-07-14T13:09:07.406370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:07.406370+0000', 'last_undegraded': '2023-07-14T13:09:07.406370+0000', 'last_fullsized': '2023-07-14T13:09:07.406370+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.395 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2023-07-14T13:09:14.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:07.406370+0000', 'last_change': '2023-07-14T13:09:07.406370+0000', 'last_active': '2023-07-14T13:09:07.406370+0000', 'last_peered': '2023-07-14T13:09:07.406370+0000', 'last_clean': '2023-07-14T13:09:07.406370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:07.406370+0000', 'last_undegraded': '2023-07-14T13:09:07.406370+0000', 'last_fullsized': '2023-07-14T13:09:07.406370+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.14 is not active+clean 2023-07-14T13:09:14.396 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-07-14T13:09:14.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:07.406370+0000', 'last_change': '2023-07-14T13:09:07.406370+0000', 'last_active': '2023-07-14T13:09:07.406370+0000', 'last_peered': '2023-07-14T13:09:07.406370+0000', 'last_clean': '2023-07-14T13:09:07.406370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:07.406370+0000', 'last_undegraded': '2023-07-14T13:09:07.406370+0000', 'last_fullsized': '2023-07-14T13:09:07.406370+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.397 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2023-07-14T13:09:14.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.397 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2023-07-14T13:09:14.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:07.406370+0000', 'last_change': '2023-07-14T13:09:07.406370+0000', 'last_active': '2023-07-14T13:09:07.406370+0000', 'last_peered': '2023-07-14T13:09:07.406370+0000', 'last_clean': '2023-07-14T13:09:07.406370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:07.406370+0000', 'last_undegraded': '2023-07-14T13:09:07.406370+0000', 'last_fullsized': '2023-07-14T13:09:07.406370+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.16 is not active+clean 2023-07-14T13:09:14.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.17 is not active+clean 2023-07-14T13:09:14.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.400 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.0 is not active+clean 2023-07-14T13:09:14.400 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.400 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-07-14T13:09:14.400 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:07.406370+0000', 'last_change': '2023-07-14T13:09:07.406370+0000', 'last_active': '2023-07-14T13:09:07.406370+0000', 'last_peered': '2023-07-14T13:09:07.406370+0000', 'last_clean': '2023-07-14T13:09:07.406370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:07.406370+0000', 'last_undegraded': '2023-07-14T13:09:07.406370+0000', 'last_fullsized': '2023-07-14T13:09:07.406370+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.401 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1 is not active+clean 2023-07-14T13:09:14.401 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.401 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2 is not active+clean 2023-07-14T13:09:14.402 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.402 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2023-07-14T13:09:14.402 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:07.406370+0000', 'last_change': '2023-07-14T13:09:07.406370+0000', 'last_active': '2023-07-14T13:09:07.406370+0000', 'last_peered': '2023-07-14T13:09:07.406370+0000', 'last_clean': '2023-07-14T13:09:07.406370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:07.406370+0000', 'last_undegraded': '2023-07-14T13:09:07.406370+0000', 'last_fullsized': '2023-07-14T13:09:07.406370+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.403 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2023-07-14T13:09:14.403 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:07.406370+0000', 'last_change': '2023-07-14T13:09:07.406370+0000', 'last_active': '2023-07-14T13:09:07.406370+0000', 'last_peered': '2023-07-14T13:09:07.406370+0000', 'last_clean': '2023-07-14T13:09:07.406370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:07.406370+0000', 'last_undegraded': '2023-07-14T13:09:07.406370+0000', 'last_fullsized': '2023-07-14T13:09:07.406370+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.403 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.4 is not active+clean 2023-07-14T13:09:14.404 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.404 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2023-07-14T13:09:14.404 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:07.406370+0000', 'last_change': '2023-07-14T13:09:07.406370+0000', 'last_active': '2023-07-14T13:09:07.406370+0000', 'last_peered': '2023-07-14T13:09:07.406370+0000', 'last_clean': '2023-07-14T13:09:07.406370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:07.406370+0000', 'last_undegraded': '2023-07-14T13:09:07.406370+0000', 'last_fullsized': '2023-07-14T13:09:07.406370+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.405 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.5 is not active+clean 2023-07-14T13:09:14.405 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.405 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2023-07-14T13:09:14.406 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:07.406370+0000', 'last_change': '2023-07-14T13:09:07.406370+0000', 'last_active': '2023-07-14T13:09:07.406370+0000', 'last_peered': '2023-07-14T13:09:07.406370+0000', 'last_clean': '2023-07-14T13:09:07.406370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:07.406370+0000', 'last_undegraded': '2023-07-14T13:09:07.406370+0000', 'last_fullsized': '2023-07-14T13:09:07.406370+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.406 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2023-07-14T13:09:14.406 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.406 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.f is not active+clean 2023-07-14T13:09:14.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:08.414277+0000', 'last_change': '2023-07-14T13:09:08.414277+0000', 'last_active': '2023-07-14T13:09:08.414277+0000', 'last_peered': '2023-07-14T13:09:08.414277+0000', 'last_clean': '2023-07-14T13:09:08.414277+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:08.414277+0000', 'last_undegraded': '2023-07-14T13:09:08.414277+0000', 'last_fullsized': '2023-07-14T13:09:08.414277+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:08.414277+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2023-07-14T13:09:14.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:07.406370+0000', 'last_change': '2023-07-14T13:09:07.406370+0000', 'last_active': '2023-07-14T13:09:07.406370+0000', 'last_peered': '2023-07-14T13:09:07.406370+0000', 'last_clean': '2023-07-14T13:09:07.406370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:07.406370+0000', 'last_undegraded': '2023-07-14T13:09:07.406370+0000', 'last_fullsized': '2023-07-14T13:09:07.406370+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-07-14T13:09:14.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:09:07.406370+0000', 'last_change': '2023-07-14T13:09:07.406370+0000', 'last_active': '2023-07-14T13:09:07.406370+0000', 'last_peered': '2023-07-14T13:09:07.406370+0000', 'last_clean': '2023-07-14T13:09:07.406370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:07.406370+0000', 'last_undegraded': '2023-07-14T13:09:07.406370+0000', 'last_fullsized': '2023-07-14T13:09:07.406370+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:07.406370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:09:14.409 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-14T13:09:14.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.527+0000 7ffa6bb40640 1 Processor -- start 2023-07-14T13:09:14.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.527+0000 7ffa6bb40640 1 -- start start 2023-07-14T13:09:14.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa6bb40640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffa640d06b0 0x7ffa640b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:14.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa6bb40640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa64145430 0x7ffa640b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:14.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa6bb40640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa640b2410 con 0x7ffa640b1f70 2023-07-14T13:09:14.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa6bb40640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa640b26f0 con 0x7ffa640d06b0 2023-07-14T13:09:14.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa6bb40640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa640b29d0 con 0x7ffa64145430 2023-07-14T13:09:14.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa6a0dd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ffa640b1f70 0x7ffa640d22e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40298/0 (socket says 172.21.15.5:40298) 2023-07-14T13:09:14.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa6a0dd640 1 -- 172.21.15.5:0/2475641903 learned_addr learned my addr 172.21.15.5:0/2475641903 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:14.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa698dc640 1 --2- 172.21.15.5:0/2475641903 >> v2:172.21.15.154:3300/0 conn(0x7ffa640d06b0 0x7ffa640b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:14.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa690db640 1 --2- 172.21.15.5:0/2475641903 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa64145430 0x7ffa640b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:14.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa688da640 1 -- 172.21.15.5:0/2475641903 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063342520 0 0) 0x7ffa640b2410 con 0x7ffa640b1f70 2023-07-14T13:09:14.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa688da640 1 -- 172.21.15.5:0/2475641903 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa50003530 con 0x7ffa640b1f70 2023-07-14T13:09:14.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa688da640 1 -- 172.21.15.5:0/2475641903 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4158171985 0 0) 0x7ffa50003530 con 0x7ffa640b1f70 2023-07-14T13:09:14.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa688da640 1 -- 172.21.15.5:0/2475641903 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa64145430 msgr2=0x7ffa640b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:14.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa688da640 1 --2- 172.21.15.5:0/2475641903 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa64145430 0x7ffa640b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:14.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa688da640 1 -- 172.21.15.5:0/2475641903 >> v2:172.21.15.154:3300/0 conn(0x7ffa640d06b0 msgr2=0x7ffa640b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:14.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa688da640 1 --2- 172.21.15.5:0/2475641903 >> v2:172.21.15.154:3300/0 conn(0x7ffa640d06b0 0x7ffa640b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:14.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa688da640 1 -- 172.21.15.5:0/2475641903 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa640b2cb0 con 0x7ffa640b1f70 2023-07-14T13:09:14.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa688da640 1 -- 172.21.15.5:0/2475641903 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7ffa5c001a00 con 0x7ffa640b1f70 2023-07-14T13:09:14.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa688da640 1 -- 172.21.15.5:0/2475641903 >> v1:172.21.15.5:6789/0 conn(0x7ffa640b1f70 legacy=0x7ffa640d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:14.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa688da640 1 --2- 172.21.15.5:0/2475641903 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa50003980 0x7ffa50003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:14.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa688da640 1 --2- 172.21.15.5:0/2475641903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa500042d0 0x7ffa500047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:14.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa688da640 1 --2- 172.21.15.5:0/2475641903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa50004e00 0x7ffa50005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:14.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa688da640 1 -- 172.21.15.5:0/2475641903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa640b26f0 con 0x7ffa50004e00 2023-07-14T13:09:14.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa688da640 1 -- 172.21.15.5:0/2475641903 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa640b29d0 con 0x7ffa500042d0 2023-07-14T13:09:14.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa688da640 1 -- 172.21.15.5:0/2475641903 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5000bcf0 con 0x7ffa50003980 2023-07-14T13:09:14.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa6a0dd640 1 --2- 172.21.15.5:0/2475641903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa50004e00 0x7ffa50005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:14.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa698dc640 1 --2- 172.21.15.5:0/2475641903 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa50003980 0x7ffa50003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:14.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa690db640 1 --2- 172.21.15.5:0/2475641903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa500042d0 0x7ffa500047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:14.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa6a0dd640 1 -- 172.21.15.5:0/2475641903 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa50003980 msgr2=0x7ffa50003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:14.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa6a0dd640 1 --2- 172.21.15.5:0/2475641903 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa50003980 0x7ffa50003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:14.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa6a0dd640 1 -- 172.21.15.5:0/2475641903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa500042d0 msgr2=0x7ffa500047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:14.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa6a0dd640 1 --2- 172.21.15.5:0/2475641903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa500042d0 0x7ffa500047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:14.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa6a0dd640 1 -- 172.21.15.5:0/2475641903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa50003530 con 0x7ffa50004e00 2023-07-14T13:09:14.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.531+0000 7ffa690db640 1 --2- 172.21.15.5:0/2475641903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa500042d0 0x7ffa500047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:14.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.535+0000 7ffa6a0dd640 1 --2- 172.21.15.5:0/2475641903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa50004e00 0x7ffa50005270 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00a860 tx=0x7ffa5c01d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c793fb0fea431fd5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:14.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.535+0000 7ffa688da640 1 -- 172.21.15.5:0/2475641903 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c0ad630 con 0x7ffa50004e00 2023-07-14T13:09:14.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.535+0000 7ffa688da640 1 -- 172.21.15.5:0/2475641903 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5c0a8070 con 0x7ffa50004e00 2023-07-14T13:09:14.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.535+0000 7ffa688da640 1 -- 172.21.15.5:0/2475641903 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c0ada30 con 0x7ffa50004e00 2023-07-14T13:09:14.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.535+0000 7ffa6bb40640 1 -- 172.21.15.5:0/2475641903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa50004e00 msgr2=0x7ffa50005270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:14.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.535+0000 7ffa6bb40640 1 --2- 172.21.15.5:0/2475641903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa50004e00 0x7ffa50005270 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00a860 tx=0x7ffa5c01d360 comp rx=0 tx=0).stop 2023-07-14T13:09:14.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.535+0000 7ffa6a0dd640 1 -- 172.21.15.5:0/2475641903 reap_dead start 2023-07-14T13:09:14.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.535+0000 7ffa6bb40640 1 -- 172.21.15.5:0/2475641903 shutdown_connections 2023-07-14T13:09:14.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.535+0000 7ffa6bb40640 1 -- 172.21.15.5:0/2475641903 >> 172.21.15.5:0/2475641903 conn(0x7ffa640659d0 msgr2=0x7ffa6409b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:14.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.535+0000 7ffa6bb40640 1 -- 172.21.15.5:0/2475641903 shutdown_connections 2023-07-14T13:09:14.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.535+0000 7ffa6bb40640 1 -- 172.21.15.5:0/2475641903 wait complete. 2023-07-14T13:09:14.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.535+0000 7ffa6bb40640 1 Processor -- start 2023-07-14T13:09:14.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.535+0000 7ffa6bb40640 1 -- start start 2023-07-14T13:09:14.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.539+0000 7ffa6bb40640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa50004e00 0x7ffa640b7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:14.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.539+0000 7ffa6bb40640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa640b5180 0x7ffa640b66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:14.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.539+0000 7ffa6bb40640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa64159d50 0x7ffa640c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:14.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.539+0000 7ffa6bb40640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa640b6290 con 0x7ffa640b5180 2023-07-14T13:09:14.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.539+0000 7ffa6bb40640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa640b6bf0 con 0x7ffa64159d50 2023-07-14T13:09:14.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.539+0000 7ffa6bb40640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa640b5610 con 0x7ffa50004e00 2023-07-14T13:09:14.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.539+0000 7ffa690db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa640b5180 0x7ffa640b66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:14.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.539+0000 7ffa690db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa640b5180 0x7ffa640b66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38024/0 (socket says 172.21.15.5:38024) 2023-07-14T13:09:14.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.539+0000 7ffa690db640 1 -- 172.21.15.5:0/525337966 learned_addr learned my addr 172.21.15.5:0/525337966 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:14.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.539+0000 7ffa698dc640 1 --2- 172.21.15.5:0/525337966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa50004e00 0x7ffa640b7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:14.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.539+0000 7ffa6a0dd640 1 --2- 172.21.15.5:0/525337966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa64159d50 0x7ffa640c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:14.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.539+0000 7ffa690db640 1 -- 172.21.15.5:0/525337966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa50004e00 msgr2=0x7ffa640b7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:14.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.539+0000 7ffa690db640 1 --2- 172.21.15.5:0/525337966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa50004e00 0x7ffa640b7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:14.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.539+0000 7ffa690db640 1 -- 172.21.15.5:0/525337966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa64159d50 msgr2=0x7ffa640c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:14.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.539+0000 7ffa690db640 1 --2- 172.21.15.5:0/525337966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa64159d50 0x7ffa640c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:14.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.539+0000 7ffa690db640 1 -- 172.21.15.5:0/525337966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa640b58f0 con 0x7ffa640b5180 2023-07-14T13:09:14.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.539+0000 7ffa6a0dd640 1 --2- 172.21.15.5:0/525337966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa64159d50 0x7ffa640c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:14.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.539+0000 7ffa690db640 1 --2- 172.21.15.5:0/525337966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa640b5180 0x7ffa640b66b0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ffa54009fd0 tx=0x7ffa54011a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:14.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.539+0000 7ffa5a7fc640 1 -- 172.21.15.5:0/525337966 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa54004220 con 0x7ffa640b5180 2023-07-14T13:09:14.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.539+0000 7ffa5a7fc640 1 -- 172.21.15.5:0/525337966 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa54004380 con 0x7ffa640b5180 2023-07-14T13:09:14.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.539+0000 7ffa5a7fc640 1 -- 172.21.15.5:0/525337966 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa54015890 con 0x7ffa640b5180 2023-07-14T13:09:14.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.539+0000 7ffa6bb40640 1 -- 172.21.15.5:0/525337966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa640b5bd0 con 0x7ffa640b5180 2023-07-14T13:09:14.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.539+0000 7ffa6bb40640 1 -- 172.21.15.5:0/525337966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6415a7c0 con 0x7ffa640b5180 2023-07-14T13:09:14.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.539+0000 7ffa6bb40640 1 -- 172.21.15.5:0/525337966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa640b2f70 con 0x7ffa640b5180 2023-07-14T13:09:14.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.539+0000 7ffa5a7fc640 1 -- 172.21.15.5:0/525337966 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ffa540159f0 con 0x7ffa640b5180 2023-07-14T13:09:14.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.543+0000 7ffa5a7fc640 1 --2- 172.21.15.5:0/525337966 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7ffa480663a0 0x7ffa48068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:14.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.543+0000 7ffa5a7fc640 1 -- 172.21.15.5:0/525337966 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffa54084490 con 0x7ffa640b5180 2023-07-14T13:09:14.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.543+0000 7ffa698dc640 1 --2- 172.21.15.5:0/525337966 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7ffa480663a0 0x7ffa48068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:14.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.543+0000 7ffa698dc640 1 --2- 172.21.15.5:0/525337966 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7ffa480663a0 0x7ffa48068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffa60009c00 tx=0x7ffa60009190 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:14.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.547+0000 7ffa5a7fc640 1 -- 172.21.15.5:0/525337966 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ffa640b2f70 con 0x7ffa640b5180 2023-07-14T13:09:14.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.755+0000 7ffa6bb40640 1 -- 172.21.15.5:0/525337966 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ffa640b63d0 con 0x7ffa640b5180 2023-07-14T13:09:14.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.755+0000 7ffa5a7fc640 1 -- 172.21.15.5:0/525337966 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3210 (secure 0 0 0) 0x7ffa640b63d0 con 0x7ffa640b5180 2023-07-14T13:09:14.787 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:14.787 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1014,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":97,"num_osds":8,"num_up_osds":8,"osd_up_since":1689339152,"num_in_osds":8,"osd_in_since":1689339143,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592730,"bytes_used":322945024,"bytes_avail":772771168256,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":41,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":7104}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2023-07-14T13:08:50.329679+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-14T13:09:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.759+0000 7ffa6bb40640 1 -- 172.21.15.5:0/525337966 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7ffa480663a0 msgr2=0x7ffa48068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.759+0000 7ffa6bb40640 1 --2- 172.21.15.5:0/525337966 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7ffa480663a0 0x7ffa48068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffa60009c00 tx=0x7ffa60009190 comp rx=0 tx=0).stop 2023-07-14T13:09:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.759+0000 7ffa6bb40640 1 -- 172.21.15.5:0/525337966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa640b5180 msgr2=0x7ffa640b66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.759+0000 7ffa6bb40640 1 --2- 172.21.15.5:0/525337966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa640b5180 0x7ffa640b66b0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ffa54009fd0 tx=0x7ffa54011a70 comp rx=0 tx=0).stop 2023-07-14T13:09:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.759+0000 7ffa6bb40640 1 -- 172.21.15.5:0/525337966 shutdown_connections 2023-07-14T13:09:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.759+0000 7ffa6bb40640 1 --2- 172.21.15.5:0/525337966 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7ffa480663a0 0x7ffa48068850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.759+0000 7ffa6bb40640 1 --2- 172.21.15.5:0/525337966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa64159d50 0x7ffa640c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.759+0000 7ffa6bb40640 1 --2- 172.21.15.5:0/525337966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa640b5180 0x7ffa640b66b0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.759+0000 7ffa6bb40640 1 --2- 172.21.15.5:0/525337966 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa50004e00 0x7ffa640b7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:14.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.759+0000 7ffa6bb40640 1 -- 172.21.15.5:0/525337966 >> 172.21.15.5:0/525337966 conn(0x7ffa640659d0 msgr2=0x7ffa640aefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:14.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.759+0000 7ffa6bb40640 1 -- 172.21.15.5:0/525337966 shutdown_connections 2023-07-14T13:09:14.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.759+0000 7ffa6bb40640 1 -- 172.21.15.5:0/525337966 wait complete. 2023-07-14T13:09:14.808 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-14T13:09:14.809 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:09:14.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.923+0000 7f683b40b640 1 Processor -- start 2023-07-14T13:09:14.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.923+0000 7f683b40b640 1 -- start start 2023-07-14T13:09:14.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.923+0000 7f683b40b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6834158ce0 0x7f6834070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:14.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.923+0000 7f683b40b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f68340c9730 0x7f68340ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:14.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.923+0000 7f683b40b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68340cc700 con 0x7f68340c8ad0 2023-07-14T13:09:14.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.923+0000 7f683b40b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68340b0ff0 con 0x7f6834158ce0 2023-07-14T13:09:14.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.923+0000 7f683b40b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6834070c80 con 0x7f68340c9730 2023-07-14T13:09:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.923+0000 7f68391a7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6834158ce0 0x7f6834070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.923+0000 7f68391a7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6834158ce0 0x7f6834070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38032/0 (socket says 172.21.15.5:38032) 2023-07-14T13:09:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.923+0000 7f68391a7640 1 -- 172.21.15.5:0/322554656 learned_addr learned my addr 172.21.15.5:0/322554656 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.923+0000 7f68389a6640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f68340c8ad0 0x7f68340c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40302/0 (socket says 172.21.15.5:40302) 2023-07-14T13:09:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.923+0000 7f68399a8640 1 --2- 172.21.15.5:0/322554656 >> v2:172.21.15.154:3300/0 conn(0x7f68340c9730 0x7f68340ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.923+0000 7f68391a7640 1 -- 172.21.15.5:0/322554656 >> v2:172.21.15.154:3300/0 conn(0x7f68340c9730 msgr2=0x7f68340ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:14.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.923+0000 7f68391a7640 1 --2- 172.21.15.5:0/322554656 >> v2:172.21.15.154:3300/0 conn(0x7f68340c9730 0x7f68340ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:14.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.923+0000 7f68391a7640 1 -- 172.21.15.5:0/322554656 >> v1:172.21.15.5:6789/0 conn(0x7f68340c8ad0 legacy=0x7f68340c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:14.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.923+0000 7f68391a7640 1 -- 172.21.15.5:0/322554656 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68340cbdd0 con 0x7f6834158ce0 2023-07-14T13:09:14.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.927+0000 7f68391a7640 1 --2- 172.21.15.5:0/322554656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6834158ce0 0x7f6834070450 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f68340b0d70 tx=0x7f683001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa08b6b4bc0b1ab server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:14.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.927+0000 7f682bfff640 1 -- 172.21.15.5:0/322554656 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68300ab600 con 0x7f6834158ce0 2023-07-14T13:09:14.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.927+0000 7f682bfff640 1 -- 172.21.15.5:0/322554656 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68300a7050 con 0x7f6834158ce0 2023-07-14T13:09:14.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.927+0000 7f682bfff640 1 -- 172.21.15.5:0/322554656 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68300ab980 con 0x7f6834158ce0 2023-07-14T13:09:14.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.927+0000 7f683b40b640 1 -- 172.21.15.5:0/322554656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6834158ce0 msgr2=0x7f6834070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:14.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.927+0000 7f683b40b640 1 --2- 172.21.15.5:0/322554656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6834158ce0 0x7f6834070450 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f68340b0d70 tx=0x7f683001c3b0 comp rx=0 tx=0).stop 2023-07-14T13:09:14.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.927+0000 7f683b40b640 1 -- 172.21.15.5:0/322554656 shutdown_connections 2023-07-14T13:09:14.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.927+0000 7f683b40b640 1 --2- 172.21.15.5:0/322554656 >> v2:172.21.15.154:3300/0 conn(0x7f68340c9730 0x7f68340ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:14.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.927+0000 7f683b40b640 1 --2- 172.21.15.5:0/322554656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6834158ce0 0x7f6834070450 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:14.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.927+0000 7f683b40b640 1 -- 172.21.15.5:0/322554656 >> 172.21.15.5:0/322554656 conn(0x7f68340afcf0 msgr2=0x7f68340b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:14.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.927+0000 7f683b40b640 1 -- 172.21.15.5:0/322554656 shutdown_connections 2023-07-14T13:09:14.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.927+0000 7f683b40b640 1 -- 172.21.15.5:0/322554656 wait complete. 2023-07-14T13:09:14.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.931+0000 7f683b40b640 1 Processor -- start 2023-07-14T13:09:14.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.931+0000 7f683b40b640 1 -- start start 2023-07-14T13:09:14.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.931+0000 7f683b40b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68340c8ad0 0x7f683414f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:14.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.931+0000 7f683b40b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68340c9730 0x7f68340cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:14.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.931+0000 7f683b40b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6834158ce0 0x7f68340cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:14.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.931+0000 7f683b40b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683415a6e0 con 0x7f6834158ce0 2023-07-14T13:09:14.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.931+0000 7f683b40b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6834159ad0 con 0x7f68340c9730 2023-07-14T13:09:14.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.931+0000 7f683b40b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6834159db0 con 0x7f68340c8ad0 2023-07-14T13:09:14.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.931+0000 7f68399a8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6834158ce0 0x7f68340cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:14.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.931+0000 7f68399a8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6834158ce0 0x7f68340cb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38044/0 (socket says 172.21.15.5:38044) 2023-07-14T13:09:14.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.931+0000 7f68399a8640 1 -- 172.21.15.5:0/1085707920 learned_addr learned my addr 172.21.15.5:0/1085707920 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:14.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.931+0000 7f68389a6640 1 --2- 172.21.15.5:0/1085707920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68340c9730 0x7f68340cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:14.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.931+0000 7f68391a7640 1 --2- 172.21.15.5:0/1085707920 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68340c8ad0 0x7f683414f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:14.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.931+0000 7f68399a8640 1 -- 172.21.15.5:0/1085707920 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68340c8ad0 msgr2=0x7f683414f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:14.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.931+0000 7f68399a8640 1 --2- 172.21.15.5:0/1085707920 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68340c8ad0 0x7f683414f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:14.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.931+0000 7f68399a8640 1 -- 172.21.15.5:0/1085707920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68340c9730 msgr2=0x7f68340cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:14.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.931+0000 7f68399a8640 1 --2- 172.21.15.5:0/1085707920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68340c9730 0x7f68340cac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:14.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.931+0000 7f68399a8640 1 -- 172.21.15.5:0/1085707920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68300094d0 con 0x7f6834158ce0 2023-07-14T13:09:14.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.931+0000 7f68399a8640 1 --2- 172.21.15.5:0/1085707920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6834158ce0 0x7f68340cb150 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f682c007e30 tx=0x7f682c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:14.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.931+0000 7f6829ffb640 1 -- 172.21.15.5:0/1085707920 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c014620 con 0x7f6834158ce0 2023-07-14T13:09:14.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.931+0000 7f6829ffb640 1 -- 172.21.15.5:0/1085707920 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682c00ee90 con 0x7f6834158ce0 2023-07-14T13:09:14.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.931+0000 7f6829ffb640 1 -- 172.21.15.5:0/1085707920 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c0149c0 con 0x7f6834158ce0 2023-07-14T13:09:14.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.931+0000 7f683b40b640 1 -- 172.21.15.5:0/1085707920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f683415a090 con 0x7f6834158ce0 2023-07-14T13:09:14.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.931+0000 7f683b40b640 1 -- 172.21.15.5:0/1085707920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f683415ab70 con 0x7f6834158ce0 2023-07-14T13:09:14.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.931+0000 7f683b40b640 1 -- 172.21.15.5:0/1085707920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68340ca1a0 con 0x7f6834158ce0 2023-07-14T13:09:14.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.935+0000 7f6829ffb640 1 -- 172.21.15.5:0/1085707920 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f682c014b20 con 0x7f6834158ce0 2023-07-14T13:09:14.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.935+0000 7f6829ffb640 1 --2- 172.21.15.5:0/1085707920 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f68180663a0 0x7f6818068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:14.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.935+0000 7f6829ffb640 1 -- 172.21.15.5:0/1085707920 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f682c084780 con 0x7f6834158ce0 2023-07-14T13:09:14.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.935+0000 7f68391a7640 1 --2- 172.21.15.5:0/1085707920 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f68180663a0 0x7f6818068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:14.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.935+0000 7f68391a7640 1 --2- 172.21.15.5:0/1085707920 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f68180663a0 0x7f6818068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f68300ad000 tx=0x7f6830008040 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:14.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:14.939+0000 7f6829ffb640 1 -- 172.21.15.5:0/1085707920 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f682c051b00 con 0x7f6834158ce0 2023-07-14T13:09:15.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:15.091+0000 7f683b40b640 1 -- 172.21.15.5:0/1085707920 --> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f683415a540 con 0x7f68180663a0 2023-07-14T13:09:15.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:15.099+0000 7f6829ffb640 1 -- 172.21.15.5:0/1085707920 <== mgr.6691 v2:172.21.15.154:6832/3243469291 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311404 (secure 0 0 0) 0x7f68300aa3a0 con 0x7f68180663a0 2023-07-14T13:09:15.132 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:15.134 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:09:15.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:15.103+0000 7f683b40b640 1 -- 172.21.15.5:0/1085707920 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f68180663a0 msgr2=0x7f6818068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:15.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:15.103+0000 7f683b40b640 1 --2- 172.21.15.5:0/1085707920 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f68180663a0 0x7f6818068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f68300ad000 tx=0x7f6830008040 comp rx=0 tx=0).stop 2023-07-14T13:09:15.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:15.103+0000 7f683b40b640 1 -- 172.21.15.5:0/1085707920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6834158ce0 msgr2=0x7f68340cb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:15.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:15.103+0000 7f683b40b640 1 --2- 172.21.15.5:0/1085707920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6834158ce0 0x7f68340cb150 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f682c007e30 tx=0x7f682c00e4b0 comp rx=0 tx=0).stop 2023-07-14T13:09:15.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:15.103+0000 7f683b40b640 1 -- 172.21.15.5:0/1085707920 shutdown_connections 2023-07-14T13:09:15.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:15.103+0000 7f683b40b640 1 --2- 172.21.15.5:0/1085707920 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f68180663a0 0x7f6818068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:15.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:15.103+0000 7f683b40b640 1 --2- 172.21.15.5:0/1085707920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6834158ce0 0x7f68340cb150 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:15.103+0000 7f683b40b640 1 --2- 172.21.15.5:0/1085707920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68340c9730 0x7f68340cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:15.103+0000 7f683b40b640 1 --2- 172.21.15.5:0/1085707920 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68340c8ad0 0x7f683414f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:15.103+0000 7f683b40b640 1 -- 172.21.15.5:0/1085707920 >> 172.21.15.5:0/1085707920 conn(0x7f68340afcf0 msgr2=0x7f683406b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:15.103+0000 7f683b40b640 1 -- 172.21.15.5:0/1085707920 shutdown_connections 2023-07-14T13:09:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:15.103+0000 7f683b40b640 1 -- 172.21.15.5:0/1085707920 wait complete. 2023-07-14T13:09:15.153 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-07-14T13:09:14.334790+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":324,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":315376,"kb_used_data":10416,"kb_used_omap":0,"kb_used_meta":304896,"kb_avail":754659344,"statfs":{"total":773094113280,"available":772771168256,"internally_reserved":0,"allocated":10665984,"data_stored":5915810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312213504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001470"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038085+0000","last_change":"2023-07-14T13:09:09.453088+0000","last_active":"2023-07-14T13:09:12.038085+0000","last_peered":"2023-07-14T13:09:12.038085+0000","last_clean":"2023-07-14T13:09:12.038085+0000","last_became_active":"2023-07-14T13:09:09.452803+0000","last_became_peered":"2023-07-14T13:09:09.452803+0000","last_unstale":"2023-07-14T13:09:12.038085+0000","last_undegraded":"2023-07-14T13:09:12.038085+0000","last_fullsized":"2023-07-14T13:09:12.038085+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:03:08.674699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.430093+0000","last_change":"2023-07-14T13:09:09.446176+0000","last_active":"2023-07-14T13:09:10.430093+0000","last_peered":"2023-07-14T13:09:10.430093+0000","last_clean":"2023-07-14T13:09:10.430093+0000","last_became_active":"2023-07-14T13:09:09.445293+0000","last_became_peered":"2023-07-14T13:09:09.445293+0000","last_unstale":"2023-07-14T13:09:10.430093+0000","last_undegraded":"2023-07-14T13:09:10.430093+0000","last_fullsized":"2023-07-14T13:09:10.430093+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:33:21.009243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034775+0000","last_change":"2023-07-14T13:09:09.448668+0000","last_active":"2023-07-14T13:09:12.034775+0000","last_peered":"2023-07-14T13:09:12.034775+0000","last_clean":"2023-07-14T13:09:12.034775+0000","last_became_active":"2023-07-14T13:09:09.448371+0000","last_became_peered":"2023-07-14T13:09:09.448371+0000","last_unstale":"2023-07-14T13:09:12.034775+0000","last_undegraded":"2023-07-14T13:09:12.034775+0000","last_fullsized":"2023-07-14T13:09:12.034775+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:48:39.755881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.037989+0000","last_change":"2023-07-14T13:09:09.453091+0000","last_active":"2023-07-14T13:09:12.037989+0000","last_peered":"2023-07-14T13:09:12.037989+0000","last_clean":"2023-07-14T13:09:12.037989+0000","last_became_active":"2023-07-14T13:09:09.452688+0000","last_became_peered":"2023-07-14T13:09:09.452688+0000","last_unstale":"2023-07-14T13:09:12.037989+0000","last_undegraded":"2023-07-14T13:09:12.037989+0000","last_fullsized":"2023-07-14T13:09:12.037989+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:59.123420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892686+0000","last_change":"2023-07-14T13:09:09.454198+0000","last_active":"2023-07-14T13:09:11.892686+0000","last_peered":"2023-07-14T13:09:11.892686+0000","last_clean":"2023-07-14T13:09:11.892686+0000","last_became_active":"2023-07-14T13:09:09.453939+0000","last_became_peered":"2023-07-14T13:09:09.453939+0000","last_unstale":"2023-07-14T13:09:11.892686+0000","last_undegraded":"2023-07-14T13:09:11.892686+0000","last_fullsized":"2023-07-14T13:09:11.892686+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:22:29.316898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033830+0000","last_change":"2023-07-14T13:09:09.466445+0000","last_active":"2023-07-14T13:09:12.033830+0000","last_peered":"2023-07-14T13:09:12.033830+0000","last_clean":"2023-07-14T13:09:12.033830+0000","last_became_active":"2023-07-14T13:09:09.466235+0000","last_became_peered":"2023-07-14T13:09:09.466235+0000","last_unstale":"2023-07-14T13:09:12.033830+0000","last_undegraded":"2023-07-14T13:09:12.033830+0000","last_fullsized":"2023-07-14T13:09:12.033830+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:42:41.071144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038390+0000","last_change":"2023-07-14T13:09:09.456644+0000","last_active":"2023-07-14T13:09:12.038390+0000","last_peered":"2023-07-14T13:09:12.038390+0000","last_clean":"2023-07-14T13:09:12.038390+0000","last_became_active":"2023-07-14T13:09:09.456363+0000","last_became_peered":"2023-07-14T13:09:09.456363+0000","last_unstale":"2023-07-14T13:09:12.038390+0000","last_undegraded":"2023-07-14T13:09:12.038390+0000","last_fullsized":"2023-07-14T13:09:12.038390+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:00:22.376834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892478+0000","last_change":"2023-07-14T13:09:09.444492+0000","last_active":"2023-07-14T13:09:11.892478+0000","last_peered":"2023-07-14T13:09:11.892478+0000","last_clean":"2023-07-14T13:09:11.892478+0000","last_became_active":"2023-07-14T13:09:09.444047+0000","last_became_peered":"2023-07-14T13:09:09.444047+0000","last_unstale":"2023-07-14T13:09:11.892478+0000","last_undegraded":"2023-07-14T13:09:11.892478+0000","last_fullsized":"2023-07-14T13:09:11.892478+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:09:58.802715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.434426+0000","last_change":"2023-07-14T13:09:09.460638+0000","last_active":"2023-07-14T13:09:10.434426+0000","last_peered":"2023-07-14T13:09:10.434426+0000","last_clean":"2023-07-14T13:09:10.434426+0000","last_became_active":"2023-07-14T13:09:09.460360+0000","last_became_peered":"2023-07-14T13:09:09.460360+0000","last_unstale":"2023-07-14T13:09:10.434426+0000","last_undegraded":"2023-07-14T13:09:10.434426+0000","last_fullsized":"2023-07-14T13:09:10.434426+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:34:29.457249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.037927+0000","last_change":"2023-07-14T13:09:09.450754+0000","last_active":"2023-07-14T13:09:12.037927+0000","last_peered":"2023-07-14T13:09:12.037927+0000","last_clean":"2023-07-14T13:09:12.037927+0000","last_became_active":"2023-07-14T13:09:09.450449+0000","last_became_peered":"2023-07-14T13:09:09.450449+0000","last_unstale":"2023-07-14T13:09:12.037927+0000","last_undegraded":"2023-07-14T13:09:12.037927+0000","last_fullsized":"2023-07-14T13:09:12.037927+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:40:01.655059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429956+0000","last_change":"2023-07-14T13:09:09.452430+0000","last_active":"2023-07-14T13:09:10.429956+0000","last_peered":"2023-07-14T13:09:10.429956+0000","last_clean":"2023-07-14T13:09:10.429956+0000","last_became_active":"2023-07-14T13:09:09.449894+0000","last_became_peered":"2023-07-14T13:09:09.449894+0000","last_unstale":"2023-07-14T13:09:10.429956+0000","last_undegraded":"2023-07-14T13:09:10.429956+0000","last_fullsized":"2023-07-14T13:09:10.429956+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:48:14.007032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038218+0000","last_change":"2023-07-14T13:09:09.451429+0000","last_active":"2023-07-14T13:09:12.038218+0000","last_peered":"2023-07-14T13:09:12.038218+0000","last_clean":"2023-07-14T13:09:12.038218+0000","last_became_active":"2023-07-14T13:09:09.451110+0000","last_became_peered":"2023-07-14T13:09:09.451110+0000","last_unstale":"2023-07-14T13:09:12.038218+0000","last_undegraded":"2023-07-14T13:09:12.038218+0000","last_fullsized":"2023-07-14T13:09:12.038218+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:12:08.144007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892830+0000","last_change":"2023-07-14T13:09:09.469561+0000","last_active":"2023-07-14T13:09:11.892830+0000","last_peered":"2023-07-14T13:09:11.892830+0000","last_clean":"2023-07-14T13:09:11.892830+0000","last_became_active":"2023-07-14T13:09:09.469257+0000","last_became_peered":"2023-07-14T13:09:09.469257+0000","last_unstale":"2023-07-14T13:09:11.892830+0000","last_undegraded":"2023-07-14T13:09:11.892830+0000","last_fullsized":"2023-07-14T13:09:11.892830+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:54:26.926217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034246+0000","last_change":"2023-07-14T13:09:09.465984+0000","last_active":"2023-07-14T13:09:12.034246+0000","last_peered":"2023-07-14T13:09:12.034246+0000","last_clean":"2023-07-14T13:09:12.034246+0000","last_became_active":"2023-07-14T13:09:09.465297+0000","last_became_peered":"2023-07-14T13:09:09.465297+0000","last_unstale":"2023-07-14T13:09:12.034246+0000","last_undegraded":"2023-07-14T13:09:12.034246+0000","last_fullsized":"2023-07-14T13:09:12.034246+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:36:51.749103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429563+0000","last_change":"2023-07-14T13:09:09.447329+0000","last_active":"2023-07-14T13:09:10.429563+0000","last_peered":"2023-07-14T13:09:10.429563+0000","last_clean":"2023-07-14T13:09:10.429563+0000","last_became_active":"2023-07-14T13:09:09.447000+0000","last_became_peered":"2023-07-14T13:09:09.447000+0000","last_unstale":"2023-07-14T13:09:10.429563+0000","last_undegraded":"2023-07-14T13:09:10.429563+0000","last_fullsized":"2023-07-14T13:09:10.429563+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:25:22.872941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.037545+0000","last_change":"2023-07-14T13:09:09.457273+0000","last_active":"2023-07-14T13:09:12.037545+0000","last_peered":"2023-07-14T13:09:12.037545+0000","last_clean":"2023-07-14T13:09:12.037545+0000","last_became_active":"2023-07-14T13:09:09.456952+0000","last_became_peered":"2023-07-14T13:09:09.456952+0000","last_unstale":"2023-07-14T13:09:12.037545+0000","last_undegraded":"2023-07-14T13:09:12.037545+0000","last_fullsized":"2023-07-14T13:09:12.037545+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:30:00.342646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892937+0000","last_change":"2023-07-14T13:09:09.455889+0000","last_active":"2023-07-14T13:09:11.892937+0000","last_peered":"2023-07-14T13:09:11.892937+0000","last_clean":"2023-07-14T13:09:11.892937+0000","last_became_active":"2023-07-14T13:09:09.455632+0000","last_became_peered":"2023-07-14T13:09:09.455632+0000","last_unstale":"2023-07-14T13:09:11.892937+0000","last_undegraded":"2023-07-14T13:09:11.892937+0000","last_fullsized":"2023-07-14T13:09:11.892937+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:29:40.244587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034806+0000","last_change":"2023-07-14T13:09:09.450337+0000","last_active":"2023-07-14T13:09:12.034806+0000","last_peered":"2023-07-14T13:09:12.034806+0000","last_clean":"2023-07-14T13:09:12.034806+0000","last_became_active":"2023-07-14T13:09:09.450041+0000","last_became_peered":"2023-07-14T13:09:09.450041+0000","last_unstale":"2023-07-14T13:09:12.034806+0000","last_undegraded":"2023-07-14T13:09:12.034806+0000","last_fullsized":"2023-07-14T13:09:12.034806+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:25:09.990529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034503+0000","last_change":"2023-07-14T13:09:09.457178+0000","last_active":"2023-07-14T13:09:12.034503+0000","last_peered":"2023-07-14T13:09:12.034503+0000","last_clean":"2023-07-14T13:09:12.034503+0000","last_became_active":"2023-07-14T13:09:09.456873+0000","last_became_peered":"2023-07-14T13:09:09.456873+0000","last_unstale":"2023-07-14T13:09:12.034503+0000","last_undegraded":"2023-07-14T13:09:12.034503+0000","last_fullsized":"2023-07-14T13:09:12.034503+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:13:42.988795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892699+0000","last_change":"2023-07-14T13:09:09.449996+0000","last_active":"2023-07-14T13:09:11.892699+0000","last_peered":"2023-07-14T13:09:11.892699+0000","last_clean":"2023-07-14T13:09:11.892699+0000","last_became_active":"2023-07-14T13:09:09.449678+0000","last_became_peered":"2023-07-14T13:09:09.449678+0000","last_unstale":"2023-07-14T13:09:11.892699+0000","last_undegraded":"2023-07-14T13:09:11.892699+0000","last_fullsized":"2023-07-14T13:09:11.892699+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:58:24.472482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.433706+0000","last_change":"2023-07-14T13:09:09.449140+0000","last_active":"2023-07-14T13:09:10.433706+0000","last_peered":"2023-07-14T13:09:10.433706+0000","last_clean":"2023-07-14T13:09:10.433706+0000","last_became_active":"2023-07-14T13:09:09.448603+0000","last_became_peered":"2023-07-14T13:09:09.448603+0000","last_unstale":"2023-07-14T13:09:10.433706+0000","last_undegraded":"2023-07-14T13:09:10.433706+0000","last_fullsized":"2023-07-14T13:09:10.433706+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:36:37.000147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892490+0000","last_change":"2023-07-14T13:09:09.469085+0000","last_active":"2023-07-14T13:09:11.892490+0000","last_peered":"2023-07-14T13:09:11.892490+0000","last_clean":"2023-07-14T13:09:11.892490+0000","last_became_active":"2023-07-14T13:09:09.468814+0000","last_became_peered":"2023-07-14T13:09:09.468814+0000","last_unstale":"2023-07-14T13:09:11.892490+0000","last_undegraded":"2023-07-14T13:09:11.892490+0000","last_fullsized":"2023-07-14T13:09:11.892490+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:11:15.830663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.433661+0000","last_change":"2023-07-14T13:09:09.451724+0000","last_active":"2023-07-14T13:09:10.433661+0000","last_peered":"2023-07-14T13:09:10.433661+0000","last_clean":"2023-07-14T13:09:10.433661+0000","last_became_active":"2023-07-14T13:09:09.451415+0000","last_became_peered":"2023-07-14T13:09:09.451415+0000","last_unstale":"2023-07-14T13:09:10.433661+0000","last_undegraded":"2023-07-14T13:09:10.433661+0000","last_fullsized":"2023-07-14T13:09:10.433661+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:53:45.973591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429728+0000","last_change":"2023-07-14T13:09:09.459438+0000","last_active":"2023-07-14T13:09:10.429728+0000","last_peered":"2023-07-14T13:09:10.429728+0000","last_clean":"2023-07-14T13:09:10.429728+0000","last_became_active":"2023-07-14T13:09:09.459180+0000","last_became_peered":"2023-07-14T13:09:09.459180+0000","last_unstale":"2023-07-14T13:09:10.429728+0000","last_undegraded":"2023-07-14T13:09:10.429728+0000","last_fullsized":"2023-07-14T13:09:10.429728+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:51:06.800504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.430164+0000","last_change":"2023-07-14T13:09:09.455611+0000","last_active":"2023-07-14T13:09:10.430164+0000","last_peered":"2023-07-14T13:09:10.430164+0000","last_clean":"2023-07-14T13:09:10.430164+0000","last_became_active":"2023-07-14T13:09:09.455121+0000","last_became_peered":"2023-07-14T13:09:09.455121+0000","last_unstale":"2023-07-14T13:09:10.430164+0000","last_undegraded":"2023-07-14T13:09:10.430164+0000","last_fullsized":"2023-07-14T13:09:10.430164+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:03:49.784846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038082+0000","last_change":"2023-07-14T13:09:09.465811+0000","last_active":"2023-07-14T13:09:12.038082+0000","last_peered":"2023-07-14T13:09:12.038082+0000","last_clean":"2023-07-14T13:09:12.038082+0000","last_became_active":"2023-07-14T13:09:09.465497+0000","last_became_peered":"2023-07-14T13:09:09.465497+0000","last_unstale":"2023-07-14T13:09:12.038082+0000","last_undegraded":"2023-07-14T13:09:12.038082+0000","last_fullsized":"2023-07-14T13:09:12.038082+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:55:03.116826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038335+0000","last_change":"2023-07-14T13:09:09.457560+0000","last_active":"2023-07-14T13:09:12.038335+0000","last_peered":"2023-07-14T13:09:12.038335+0000","last_clean":"2023-07-14T13:09:12.038335+0000","last_became_active":"2023-07-14T13:09:09.457027+0000","last_became_peered":"2023-07-14T13:09:09.457027+0000","last_unstale":"2023-07-14T13:09:12.038335+0000","last_undegraded":"2023-07-14T13:09:12.038335+0000","last_fullsized":"2023-07-14T13:09:12.038335+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:20:05.726658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892820+0000","last_change":"2023-07-14T13:09:09.454892+0000","last_active":"2023-07-14T13:09:11.892820+0000","last_peered":"2023-07-14T13:09:11.892820+0000","last_clean":"2023-07-14T13:09:11.892820+0000","last_became_active":"2023-07-14T13:09:09.454598+0000","last_became_peered":"2023-07-14T13:09:09.454598+0000","last_unstale":"2023-07-14T13:09:11.892820+0000","last_undegraded":"2023-07-14T13:09:11.892820+0000","last_fullsized":"2023-07-14T13:09:11.892820+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:02:23.849786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429732+0000","last_change":"2023-07-14T13:09:09.446033+0000","last_active":"2023-07-14T13:09:10.429732+0000","last_peered":"2023-07-14T13:09:10.429732+0000","last_clean":"2023-07-14T13:09:10.429732+0000","last_became_active":"2023-07-14T13:09:09.445481+0000","last_became_peered":"2023-07-14T13:09:09.445481+0000","last_unstale":"2023-07-14T13:09:10.429732+0000","last_undegraded":"2023-07-14T13:09:10.429732+0000","last_fullsized":"2023-07-14T13:09:10.429732+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:52:51.943223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.037533+0000","last_change":"2023-07-14T13:09:09.451546+0000","last_active":"2023-07-14T13:09:12.037533+0000","last_peered":"2023-07-14T13:09:12.037533+0000","last_clean":"2023-07-14T13:09:12.037533+0000","last_became_active":"2023-07-14T13:09:09.451269+0000","last_became_peered":"2023-07-14T13:09:09.451269+0000","last_unstale":"2023-07-14T13:09:12.037533+0000","last_undegraded":"2023-07-14T13:09:12.037533+0000","last_fullsized":"2023-07-14T13:09:12.037533+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:51:42.037789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033999+0000","last_change":"2023-07-14T13:09:09.445955+0000","last_active":"2023-07-14T13:09:12.033999+0000","last_peered":"2023-07-14T13:09:12.033999+0000","last_clean":"2023-07-14T13:09:12.033999+0000","last_became_active":"2023-07-14T13:09:09.445618+0000","last_became_peered":"2023-07-14T13:09:09.445618+0000","last_unstale":"2023-07-14T13:09:12.033999+0000","last_undegraded":"2023-07-14T13:09:12.033999+0000","last_fullsized":"2023-07-14T13:09:12.033999+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:13:42.533007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.037707+0000","last_change":"2023-07-14T13:09:09.454971+0000","last_active":"2023-07-14T13:09:12.037707+0000","last_peered":"2023-07-14T13:09:12.037707+0000","last_clean":"2023-07-14T13:09:12.037707+0000","last_became_active":"2023-07-14T13:09:09.454618+0000","last_became_peered":"2023-07-14T13:09:09.454618+0000","last_unstale":"2023-07-14T13:09:12.037707+0000","last_undegraded":"2023-07-14T13:09:12.037707+0000","last_fullsized":"2023-07-14T13:09:12.037707+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:28:55.677486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033987+0000","last_change":"2023-07-14T13:09:09.450411+0000","last_active":"2023-07-14T13:09:12.033987+0000","last_peered":"2023-07-14T13:09:12.033987+0000","last_clean":"2023-07-14T13:09:12.033987+0000","last_became_active":"2023-07-14T13:09:09.450124+0000","last_became_peered":"2023-07-14T13:09:09.450124+0000","last_unstale":"2023-07-14T13:09:12.033987+0000","last_undegraded":"2023-07-14T13:09:12.033987+0000","last_fullsized":"2023-07-14T13:09:12.033987+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:17:47.890949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"96'4","reported_seq":17,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892923+0000","last_change":"2023-07-14T13:09:08.444497+0000","last_active":"2023-07-14T13:09:11.892923+0000","last_peered":"2023-07-14T13:09:11.892923+0000","last_clean":"2023-07-14T13:09:11.892923+0000","last_became_active":"2023-07-14T13:09:08.444214+0000","last_became_peered":"2023-07-14T13:09:08.444214+0000","last_unstale":"2023-07-14T13:09:11.892923+0000","last_undegraded":"2023-07-14T13:09:11.892923+0000","last_fullsized":"2023-07-14T13:09:11.892923+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:51:45.905778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429570+0000","last_change":"2023-07-14T13:09:09.458943+0000","last_active":"2023-07-14T13:09:10.429570+0000","last_peered":"2023-07-14T13:09:10.429570+0000","last_clean":"2023-07-14T13:09:10.429570+0000","last_became_active":"2023-07-14T13:09:09.455757+0000","last_became_peered":"2023-07-14T13:09:09.455757+0000","last_unstale":"2023-07-14T13:09:10.429570+0000","last_undegraded":"2023-07-14T13:09:10.429570+0000","last_fullsized":"2023-07-14T13:09:10.429570+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:45:39.572860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"96'1","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038419+0000","last_change":"2023-07-14T13:09:08.453613+0000","last_active":"2023-07-14T13:09:12.038419+0000","last_peered":"2023-07-14T13:09:12.038419+0000","last_clean":"2023-07-14T13:09:12.038419+0000","last_became_active":"2023-07-14T13:09:08.453262+0000","last_became_peered":"2023-07-14T13:09:08.453262+0000","last_unstale":"2023-07-14T13:09:12.038419+0000","last_undegraded":"2023-07-14T13:09:12.038419+0000","last_fullsized":"2023-07-14T13:09:12.038419+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:22:29.840805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.433807+0000","last_change":"2023-07-14T13:09:09.461096+0000","last_active":"2023-07-14T13:09:10.433807+0000","last_peered":"2023-07-14T13:09:10.433807+0000","last_clean":"2023-07-14T13:09:10.433807+0000","last_became_active":"2023-07-14T13:09:09.460654+0000","last_became_peered":"2023-07-14T13:09:09.460654+0000","last_unstale":"2023-07-14T13:09:10.433807+0000","last_undegraded":"2023-07-14T13:09:10.433807+0000","last_fullsized":"2023-07-14T13:09:10.433807+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:51:34.580731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"96'2","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038472+0000","last_change":"2023-07-14T13:09:08.447878+0000","last_active":"2023-07-14T13:09:12.038472+0000","last_peered":"2023-07-14T13:09:12.038472+0000","last_clean":"2023-07-14T13:09:12.038472+0000","last_became_active":"2023-07-14T13:09:08.447510+0000","last_became_peered":"2023-07-14T13:09:08.447510+0000","last_unstale":"2023-07-14T13:09:12.038472+0000","last_undegraded":"2023-07-14T13:09:12.038472+0000","last_fullsized":"2023-07-14T13:09:12.038472+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:36:05.438485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.434078+0000","last_change":"2023-07-14T13:09:09.448912+0000","last_active":"2023-07-14T13:09:10.434078+0000","last_peered":"2023-07-14T13:09:10.434078+0000","last_clean":"2023-07-14T13:09:10.434078+0000","last_became_active":"2023-07-14T13:09:09.448421+0000","last_became_peered":"2023-07-14T13:09:09.448421+0000","last_unstale":"2023-07-14T13:09:10.434078+0000","last_undegraded":"2023-07-14T13:09:10.434078+0000","last_fullsized":"2023-07-14T13:09:10.434078+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:59:26.802394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"96'2","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038787+0000","last_change":"2023-07-14T13:09:08.449278+0000","last_active":"2023-07-14T13:09:12.038787+0000","last_peered":"2023-07-14T13:09:12.038787+0000","last_clean":"2023-07-14T13:09:12.038787+0000","last_became_active":"2023-07-14T13:09:08.449027+0000","last_became_peered":"2023-07-14T13:09:08.449027+0000","last_unstale":"2023-07-14T13:09:12.038787+0000","last_undegraded":"2023-07-14T13:09:12.038787+0000","last_fullsized":"2023-07-14T13:09:12.038787+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:25:43.383264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429834+0000","last_change":"2023-07-14T13:09:09.447229+0000","last_active":"2023-07-14T13:09:10.429834+0000","last_peered":"2023-07-14T13:09:10.429834+0000","last_clean":"2023-07-14T13:09:10.429834+0000","last_became_active":"2023-07-14T13:09:09.446944+0000","last_became_peered":"2023-07-14T13:09:09.446944+0000","last_unstale":"2023-07-14T13:09:10.429834+0000","last_undegraded":"2023-07-14T13:09:10.429834+0000","last_fullsized":"2023-07-14T13:09:10.429834+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:58:11.945700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"96'1","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.434063+0000","last_change":"2023-07-14T13:09:08.442294+0000","last_active":"2023-07-14T13:09:10.434063+0000","last_peered":"2023-07-14T13:09:10.434063+0000","last_clean":"2023-07-14T13:09:10.434063+0000","last_became_active":"2023-07-14T13:09:08.442027+0000","last_became_peered":"2023-07-14T13:09:08.442027+0000","last_unstale":"2023-07-14T13:09:10.434063+0000","last_undegraded":"2023-07-14T13:09:10.434063+0000","last_fullsized":"2023-07-14T13:09:10.434063+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:49:43.076566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.430015+0000","last_change":"2023-07-14T13:09:09.445796+0000","last_active":"2023-07-14T13:09:10.430015+0000","last_peered":"2023-07-14T13:09:10.430015+0000","last_clean":"2023-07-14T13:09:10.430015+0000","last_became_active":"2023-07-14T13:09:09.445514+0000","last_became_peered":"2023-07-14T13:09:09.445514+0000","last_unstale":"2023-07-14T13:09:10.430015+0000","last_undegraded":"2023-07-14T13:09:10.430015+0000","last_fullsized":"2023-07-14T13:09:10.430015+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:02:59.884389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"96'1","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038902+0000","last_change":"2023-07-14T13:09:08.448534+0000","last_active":"2023-07-14T13:09:12.038902+0000","last_peered":"2023-07-14T13:09:12.038902+0000","last_clean":"2023-07-14T13:09:12.038902+0000","last_became_active":"2023-07-14T13:09:08.448250+0000","last_became_peered":"2023-07-14T13:09:08.448250+0000","last_unstale":"2023-07-14T13:09:12.038902+0000","last_undegraded":"2023-07-14T13:09:12.038902+0000","last_fullsized":"2023-07-14T13:09:12.038902+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:17:22.696776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.434373+0000","last_change":"2023-07-14T13:09:09.460632+0000","last_active":"2023-07-14T13:09:10.434373+0000","last_peered":"2023-07-14T13:09:10.434373+0000","last_clean":"2023-07-14T13:09:10.434373+0000","last_became_active":"2023-07-14T13:09:09.460314+0000","last_became_peered":"2023-07-14T13:09:09.460314+0000","last_unstale":"2023-07-14T13:09:10.434373+0000","last_undegraded":"2023-07-14T13:09:10.434373+0000","last_fullsized":"2023-07-14T13:09:10.434373+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:55:55.944103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429710+0000","last_change":"2023-07-14T13:09:08.443183+0000","last_active":"2023-07-14T13:09:10.429710+0000","last_peered":"2023-07-14T13:09:10.429710+0000","last_clean":"2023-07-14T13:09:10.429710+0000","last_became_active":"2023-07-14T13:09:08.442696+0000","last_became_peered":"2023-07-14T13:09:08.442696+0000","last_unstale":"2023-07-14T13:09:10.429710+0000","last_undegraded":"2023-07-14T13:09:10.429710+0000","last_fullsized":"2023-07-14T13:09:10.429710+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:30:50.273654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038791+0000","last_change":"2023-07-14T13:09:09.457306+0000","last_active":"2023-07-14T13:09:12.038791+0000","last_peered":"2023-07-14T13:09:12.038791+0000","last_clean":"2023-07-14T13:09:12.038791+0000","last_became_active":"2023-07-14T13:09:09.456582+0000","last_became_peered":"2023-07-14T13:09:09.456582+0000","last_unstale":"2023-07-14T13:09:12.038791+0000","last_undegraded":"2023-07-14T13:09:12.038791+0000","last_fullsized":"2023-07-14T13:09:12.038791+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:53:55.992130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892594+0000","last_change":"2023-07-14T13:09:08.433369+0000","last_active":"2023-07-14T13:09:11.892594+0000","last_peered":"2023-07-14T13:09:11.892594+0000","last_clean":"2023-07-14T13:09:11.892594+0000","last_became_active":"2023-07-14T13:09:08.431724+0000","last_became_peered":"2023-07-14T13:09:08.431724+0000","last_unstale":"2023-07-14T13:09:11.892594+0000","last_undegraded":"2023-07-14T13:09:11.892594+0000","last_fullsized":"2023-07-14T13:09:11.892594+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:12:54.167527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429571+0000","last_change":"2023-07-14T13:09:09.447525+0000","last_active":"2023-07-14T13:09:10.429571+0000","last_peered":"2023-07-14T13:09:10.429571+0000","last_clean":"2023-07-14T13:09:10.429571+0000","last_became_active":"2023-07-14T13:09:09.446162+0000","last_became_peered":"2023-07-14T13:09:09.446162+0000","last_unstale":"2023-07-14T13:09:10.429571+0000","last_undegraded":"2023-07-14T13:09:10.429571+0000","last_fullsized":"2023-07-14T13:09:10.429571+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:22.698260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038225+0000","last_change":"2023-07-14T13:09:08.452152+0000","last_active":"2023-07-14T13:09:12.038225+0000","last_peered":"2023-07-14T13:09:12.038225+0000","last_clean":"2023-07-14T13:09:12.038225+0000","last_became_active":"2023-07-14T13:09:08.451860+0000","last_became_peered":"2023-07-14T13:09:08.451860+0000","last_unstale":"2023-07-14T13:09:12.038225+0000","last_undegraded":"2023-07-14T13:09:12.038225+0000","last_fullsized":"2023-07-14T13:09:12.038225+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:57:05.529700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.037771+0000","last_change":"2023-07-14T13:09:09.456337+0000","last_active":"2023-07-14T13:09:12.037771+0000","last_peered":"2023-07-14T13:09:12.037771+0000","last_clean":"2023-07-14T13:09:12.037771+0000","last_became_active":"2023-07-14T13:09:09.456042+0000","last_became_peered":"2023-07-14T13:09:09.456042+0000","last_unstale":"2023-07-14T13:09:12.037771+0000","last_undegraded":"2023-07-14T13:09:12.037771+0000","last_fullsized":"2023-07-14T13:09:12.037771+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:33:58.283600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038224+0000","last_change":"2023-07-14T13:09:08.449606+0000","last_active":"2023-07-14T13:09:12.038224+0000","last_peered":"2023-07-14T13:09:12.038224+0000","last_clean":"2023-07-14T13:09:12.038224+0000","last_became_active":"2023-07-14T13:09:08.449305+0000","last_became_peered":"2023-07-14T13:09:08.449305+0000","last_unstale":"2023-07-14T13:09:12.038224+0000","last_undegraded":"2023-07-14T13:09:12.038224+0000","last_fullsized":"2023-07-14T13:09:12.038224+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:29:40.407252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034350+0000","last_change":"2023-07-14T13:09:09.453933+0000","last_active":"2023-07-14T13:09:12.034350+0000","last_peered":"2023-07-14T13:09:12.034350+0000","last_clean":"2023-07-14T13:09:12.034350+0000","last_became_active":"2023-07-14T13:09:09.453610+0000","last_became_peered":"2023-07-14T13:09:09.453610+0000","last_unstale":"2023-07-14T13:09:12.034350+0000","last_undegraded":"2023-07-14T13:09:12.034350+0000","last_fullsized":"2023-07-14T13:09:12.034350+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:24:39.457351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"96'3","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892897+0000","last_change":"2023-07-14T13:09:08.437217+0000","last_active":"2023-07-14T13:09:11.892897+0000","last_peered":"2023-07-14T13:09:11.892897+0000","last_clean":"2023-07-14T13:09:11.892897+0000","last_became_active":"2023-07-14T13:09:08.436904+0000","last_became_peered":"2023-07-14T13:09:08.436904+0000","last_unstale":"2023-07-14T13:09:11.892897+0000","last_undegraded":"2023-07-14T13:09:11.892897+0000","last_fullsized":"2023-07-14T13:09:11.892897+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:33:17.679033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034191+0000","last_change":"2023-07-14T13:09:09.449362+0000","last_active":"2023-07-14T13:09:12.034191+0000","last_peered":"2023-07-14T13:09:12.034191+0000","last_clean":"2023-07-14T13:09:12.034191+0000","last_became_active":"2023-07-14T13:09:09.448691+0000","last_became_peered":"2023-07-14T13:09:09.448691+0000","last_unstale":"2023-07-14T13:09:12.034191+0000","last_undegraded":"2023-07-14T13:09:12.034191+0000","last_fullsized":"2023-07-14T13:09:12.034191+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:11:22.058932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"96'6","reported_seq":19,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038823+0000","last_change":"2023-07-14T13:09:08.443531+0000","last_active":"2023-07-14T13:09:12.038823+0000","last_peered":"2023-07-14T13:09:12.038823+0000","last_clean":"2023-07-14T13:09:12.038823+0000","last_became_active":"2023-07-14T13:09:08.443178+0000","last_became_peered":"2023-07-14T13:09:08.443178+0000","last_unstale":"2023-07-14T13:09:12.038823+0000","last_undegraded":"2023-07-14T13:09:12.038823+0000","last_fullsized":"2023-07-14T13:09:12.038823+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:48.688335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038350+0000","last_change":"2023-07-14T13:09:09.460134+0000","last_active":"2023-07-14T13:09:12.038350+0000","last_peered":"2023-07-14T13:09:12.038350+0000","last_clean":"2023-07-14T13:09:12.038350+0000","last_became_active":"2023-07-14T13:09:09.459840+0000","last_became_peered":"2023-07-14T13:09:09.459840+0000","last_unstale":"2023-07-14T13:09:12.038350+0000","last_undegraded":"2023-07-14T13:09:12.038350+0000","last_fullsized":"2023-07-14T13:09:12.038350+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:28:17.313001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"96'2","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.037994+0000","last_change":"2023-07-14T13:09:08.448340+0000","last_active":"2023-07-14T13:09:12.037994+0000","last_peered":"2023-07-14T13:09:12.037994+0000","last_clean":"2023-07-14T13:09:12.037994+0000","last_became_active":"2023-07-14T13:09:08.445388+0000","last_became_peered":"2023-07-14T13:09:08.445388+0000","last_unstale":"2023-07-14T13:09:12.037994+0000","last_undegraded":"2023-07-14T13:09:12.037994+0000","last_fullsized":"2023-07-14T13:09:12.037994+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:53:06.965703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038446+0000","last_change":"2023-07-14T13:09:09.444294+0000","last_active":"2023-07-14T13:09:12.038446+0000","last_peered":"2023-07-14T13:09:12.038446+0000","last_clean":"2023-07-14T13:09:12.038446+0000","last_became_active":"2023-07-14T13:09:09.444012+0000","last_became_peered":"2023-07-14T13:09:09.444012+0000","last_unstale":"2023-07-14T13:09:12.038446+0000","last_undegraded":"2023-07-14T13:09:12.038446+0000","last_fullsized":"2023-07-14T13:09:12.038446+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:01:20.255770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.037671+0000","last_change":"2023-07-14T13:09:08.450436+0000","last_active":"2023-07-14T13:09:12.037671+0000","last_peered":"2023-07-14T13:09:12.037671+0000","last_clean":"2023-07-14T13:09:12.037671+0000","last_became_active":"2023-07-14T13:09:08.449973+0000","last_became_peered":"2023-07-14T13:09:08.449973+0000","last_unstale":"2023-07-14T13:09:12.037671+0000","last_undegraded":"2023-07-14T13:09:12.037671+0000","last_fullsized":"2023-07-14T13:09:12.037671+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:57:10.734307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.039002+0000","last_change":"2023-07-14T13:09:09.445892+0000","last_active":"2023-07-14T13:09:12.039002+0000","last_peered":"2023-07-14T13:09:12.039002+0000","last_clean":"2023-07-14T13:09:12.039002+0000","last_became_active":"2023-07-14T13:09:09.445569+0000","last_became_peered":"2023-07-14T13:09:09.445569+0000","last_unstale":"2023-07-14T13:09:12.039002+0000","last_undegraded":"2023-07-14T13:09:12.039002+0000","last_fullsized":"2023-07-14T13:09:12.039002+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:36:37.000147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892506+0000","last_change":"2023-07-14T13:09:08.443228+0000","last_active":"2023-07-14T13:09:11.892506+0000","last_peered":"2023-07-14T13:09:11.892506+0000","last_clean":"2023-07-14T13:09:11.892506+0000","last_became_active":"2023-07-14T13:09:08.442874+0000","last_became_peered":"2023-07-14T13:09:08.442874+0000","last_unstale":"2023-07-14T13:09:11.892506+0000","last_undegraded":"2023-07-14T13:09:11.892506+0000","last_fullsized":"2023-07-14T13:09:11.892506+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:38:31.212301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038961+0000","last_change":"2023-07-14T13:09:09.460868+0000","last_active":"2023-07-14T13:09:12.038961+0000","last_peered":"2023-07-14T13:09:12.038961+0000","last_clean":"2023-07-14T13:09:12.038961+0000","last_became_active":"2023-07-14T13:09:09.460515+0000","last_became_peered":"2023-07-14T13:09:09.460515+0000","last_unstale":"2023-07-14T13:09:12.038961+0000","last_undegraded":"2023-07-14T13:09:12.038961+0000","last_fullsized":"2023-07-14T13:09:12.038961+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:53:45.973591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"96'8","reported_seq":21,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429919+0000","last_change":"2023-07-14T13:09:08.443086+0000","last_active":"2023-07-14T13:09:10.429919+0000","last_peered":"2023-07-14T13:09:10.429919+0000","last_clean":"2023-07-14T13:09:10.429919+0000","last_became_active":"2023-07-14T13:09:08.442793+0000","last_became_peered":"2023-07-14T13:09:08.442793+0000","last_unstale":"2023-07-14T13:09:10.429919+0000","last_undegraded":"2023-07-14T13:09:10.429919+0000","last_fullsized":"2023-07-14T13:09:10.429919+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:22:53.283592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.433661+0000","last_change":"2023-07-14T13:09:09.444059+0000","last_active":"2023-07-14T13:09:10.433661+0000","last_peered":"2023-07-14T13:09:10.433661+0000","last_clean":"2023-07-14T13:09:10.433661+0000","last_became_active":"2023-07-14T13:09:09.443711+0000","last_became_peered":"2023-07-14T13:09:09.443711+0000","last_unstale":"2023-07-14T13:09:10.433661+0000","last_undegraded":"2023-07-14T13:09:10.433661+0000","last_fullsized":"2023-07-14T13:09:10.433661+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:49.696241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"96'2","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038785+0000","last_change":"2023-07-14T13:09:08.444164+0000","last_active":"2023-07-14T13:09:12.038785+0000","last_peered":"2023-07-14T13:09:12.038785+0000","last_clean":"2023-07-14T13:09:12.038785+0000","last_became_active":"2023-07-14T13:09:08.443877+0000","last_became_peered":"2023-07-14T13:09:08.443877+0000","last_unstale":"2023-07-14T13:09:12.038785+0000","last_undegraded":"2023-07-14T13:09:12.038785+0000","last_fullsized":"2023-07-14T13:09:12.038785+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:20:06.820662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038469+0000","last_change":"2023-07-14T13:09:09.461698+0000","last_active":"2023-07-14T13:09:12.038469+0000","last_peered":"2023-07-14T13:09:12.038469+0000","last_clean":"2023-07-14T13:09:12.038469+0000","last_became_active":"2023-07-14T13:09:09.461050+0000","last_became_peered":"2023-07-14T13:09:09.461050+0000","last_unstale":"2023-07-14T13:09:12.038469+0000","last_undegraded":"2023-07-14T13:09:12.038469+0000","last_fullsized":"2023-07-14T13:09:12.038469+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:14:32.393337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"97'1","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.891853+0000","last_change":"2023-07-14T13:09:08.447067+0000","last_active":"2023-07-14T13:09:11.891853+0000","last_peered":"2023-07-14T13:09:11.891853+0000","last_clean":"2023-07-14T13:09:11.891853+0000","last_became_active":"2023-07-14T13:09:08.446799+0000","last_became_peered":"2023-07-14T13:09:08.446799+0000","last_unstale":"2023-07-14T13:09:11.891853+0000","last_undegraded":"2023-07-14T13:09:11.891853+0000","last_fullsized":"2023-07-14T13:09:11.891853+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:28:21.757335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.433933+0000","last_change":"2023-07-14T13:09:09.460918+0000","last_active":"2023-07-14T13:09:10.433933+0000","last_peered":"2023-07-14T13:09:10.433933+0000","last_clean":"2023-07-14T13:09:10.433933+0000","last_became_active":"2023-07-14T13:09:09.460283+0000","last_became_peered":"2023-07-14T13:09:09.460283+0000","last_unstale":"2023-07-14T13:09:10.433933+0000","last_undegraded":"2023-07-14T13:09:10.433933+0000","last_fullsized":"2023-07-14T13:09:10.433933+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:08:13.538570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038607+0000","last_change":"2023-07-14T13:09:08.450971+0000","last_active":"2023-07-14T13:09:12.038607+0000","last_peered":"2023-07-14T13:09:12.038607+0000","last_clean":"2023-07-14T13:09:12.038607+0000","last_became_active":"2023-07-14T13:09:08.450672+0000","last_became_peered":"2023-07-14T13:09:08.450672+0000","last_unstale":"2023-07-14T13:09:12.038607+0000","last_undegraded":"2023-07-14T13:09:12.038607+0000","last_fullsized":"2023-07-14T13:09:12.038607+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:40:55.399781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429786+0000","last_change":"2023-07-14T13:09:09.445848+0000","last_active":"2023-07-14T13:09:10.429786+0000","last_peered":"2023-07-14T13:09:10.429786+0000","last_clean":"2023-07-14T13:09:10.429786+0000","last_became_active":"2023-07-14T13:09:09.445068+0000","last_became_peered":"2023-07-14T13:09:09.445068+0000","last_unstale":"2023-07-14T13:09:10.429786+0000","last_undegraded":"2023-07-14T13:09:10.429786+0000","last_fullsized":"2023-07-14T13:09:10.429786+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:25:09.202126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038237+0000","last_change":"2023-07-14T13:09:08.452253+0000","last_active":"2023-07-14T13:09:12.038237+0000","last_peered":"2023-07-14T13:09:12.038237+0000","last_clean":"2023-07-14T13:09:12.038237+0000","last_became_active":"2023-07-14T13:09:08.451854+0000","last_became_peered":"2023-07-14T13:09:08.451854+0000","last_unstale":"2023-07-14T13:09:12.038237+0000","last_undegraded":"2023-07-14T13:09:12.038237+0000","last_fullsized":"2023-07-14T13:09:12.038237+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:28:54.151153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038686+0000","last_change":"2023-07-14T13:09:09.460891+0000","last_active":"2023-07-14T13:09:12.038686+0000","last_peered":"2023-07-14T13:09:12.038686+0000","last_clean":"2023-07-14T13:09:12.038686+0000","last_became_active":"2023-07-14T13:09:09.460589+0000","last_became_peered":"2023-07-14T13:09:09.460589+0000","last_unstale":"2023-07-14T13:09:12.038686+0000","last_undegraded":"2023-07-14T13:09:12.038686+0000","last_fullsized":"2023-07-14T13:09:12.038686+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:02:41.323521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.037750+0000","last_change":"2023-07-14T13:09:08.446348+0000","last_active":"2023-07-14T13:09:12.037750+0000","last_peered":"2023-07-14T13:09:12.037750+0000","last_clean":"2023-07-14T13:09:12.037750+0000","last_became_active":"2023-07-14T13:09:08.446025+0000","last_became_peered":"2023-07-14T13:09:08.446025+0000","last_unstale":"2023-07-14T13:09:12.037750+0000","last_undegraded":"2023-07-14T13:09:12.037750+0000","last_fullsized":"2023-07-14T13:09:12.037750+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:30:10.969191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038504+0000","last_change":"2023-07-14T13:09:09.459146+0000","last_active":"2023-07-14T13:09:12.038504+0000","last_peered":"2023-07-14T13:09:12.038504+0000","last_clean":"2023-07-14T13:09:12.038504+0000","last_became_active":"2023-07-14T13:09:09.458807+0000","last_became_peered":"2023-07-14T13:09:09.458807+0000","last_unstale":"2023-07-14T13:09:12.038504+0000","last_undegraded":"2023-07-14T13:09:12.038504+0000","last_fullsized":"2023-07-14T13:09:12.038504+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:02:09.358714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892633+0000","last_change":"2023-07-14T13:09:08.443277+0000","last_active":"2023-07-14T13:09:11.892633+0000","last_peered":"2023-07-14T13:09:11.892633+0000","last_clean":"2023-07-14T13:09:11.892633+0000","last_became_active":"2023-07-14T13:09:08.442915+0000","last_became_peered":"2023-07-14T13:09:08.442915+0000","last_unstale":"2023-07-14T13:09:11.892633+0000","last_undegraded":"2023-07-14T13:09:11.892633+0000","last_fullsized":"2023-07-14T13:09:11.892633+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:48:52.995190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034856+0000","last_change":"2023-07-14T13:09:09.463272+0000","last_active":"2023-07-14T13:09:12.034856+0000","last_peered":"2023-07-14T13:09:12.034856+0000","last_clean":"2023-07-14T13:09:12.034856+0000","last_became_active":"2023-07-14T13:09:09.462912+0000","last_became_peered":"2023-07-14T13:09:09.462912+0000","last_unstale":"2023-07-14T13:09:12.034856+0000","last_undegraded":"2023-07-14T13:09:12.034856+0000","last_fullsized":"2023-07-14T13:09:12.034856+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:28:41.067336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038532+0000","last_change":"2023-07-14T13:09:08.451413+0000","last_active":"2023-07-14T13:09:12.038532+0000","last_peered":"2023-07-14T13:09:12.038532+0000","last_clean":"2023-07-14T13:09:12.038532+0000","last_became_active":"2023-07-14T13:09:08.451115+0000","last_became_peered":"2023-07-14T13:09:08.451115+0000","last_unstale":"2023-07-14T13:09:12.038532+0000","last_undegraded":"2023-07-14T13:09:12.038532+0000","last_fullsized":"2023-07-14T13:09:12.038532+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:09:00.012874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034922+0000","last_change":"2023-07-14T13:09:09.445631+0000","last_active":"2023-07-14T13:09:12.034922+0000","last_peered":"2023-07-14T13:09:12.034922+0000","last_clean":"2023-07-14T13:09:12.034922+0000","last_became_active":"2023-07-14T13:09:09.445366+0000","last_became_peered":"2023-07-14T13:09:09.445366+0000","last_unstale":"2023-07-14T13:09:12.034922+0000","last_undegraded":"2023-07-14T13:09:12.034922+0000","last_fullsized":"2023-07-14T13:09:12.034922+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:47:59.705980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034027+0000","last_change":"2023-07-14T13:09:08.441197+0000","last_active":"2023-07-14T13:09:12.034027+0000","last_peered":"2023-07-14T13:09:12.034027+0000","last_clean":"2023-07-14T13:09:12.034027+0000","last_became_active":"2023-07-14T13:09:08.440996+0000","last_became_peered":"2023-07-14T13:09:08.440996+0000","last_unstale":"2023-07-14T13:09:12.034027+0000","last_undegraded":"2023-07-14T13:09:12.034027+0000","last_fullsized":"2023-07-14T13:09:12.034027+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:08:34.441857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038543+0000","last_change":"2023-07-14T13:09:09.449255+0000","last_active":"2023-07-14T13:09:12.038543+0000","last_peered":"2023-07-14T13:09:12.038543+0000","last_clean":"2023-07-14T13:09:12.038543+0000","last_became_active":"2023-07-14T13:09:09.448962+0000","last_became_peered":"2023-07-14T13:09:09.448962+0000","last_unstale":"2023-07-14T13:09:12.038543+0000","last_undegraded":"2023-07-14T13:09:12.038543+0000","last_fullsized":"2023-07-14T13:09:12.038543+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:54:51.429932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034521+0000","last_change":"2023-07-14T13:09:08.446105+0000","last_active":"2023-07-14T13:09:12.034521+0000","last_peered":"2023-07-14T13:09:12.034521+0000","last_clean":"2023-07-14T13:09:12.034521+0000","last_became_active":"2023-07-14T13:09:08.445697+0000","last_became_peered":"2023-07-14T13:09:08.445697+0000","last_unstale":"2023-07-14T13:09:12.034521+0000","last_undegraded":"2023-07-14T13:09:12.034521+0000","last_fullsized":"2023-07-14T13:09:12.034521+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:00:10.980521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"85'183","reported_seq":547,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038007+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:09:12.038007+0000","last_peered":"2023-07-14T13:09:12.038007+0000","last_clean":"2023-07-14T13:09:12.038007+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:09:12.038007+0000","last_undegraded":"2023-07-14T13:09:12.038007+0000","last_fullsized":"2023-07-14T13:09:12.038007+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:28:27.734850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":156,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038115+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:09:12.038115+0000","last_peered":"2023-07-14T13:09:12.038115+0000","last_clean":"2023-07-14T13:09:12.038115+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:09:12.038115+0000","last_undegraded":"2023-07-14T13:09:12.038115+0000","last_fullsized":"2023-07-14T13:09:12.038115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:19:50.081265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.430147+0000","last_change":"2023-07-14T13:09:09.445181+0000","last_active":"2023-07-14T13:09:10.430147+0000","last_peered":"2023-07-14T13:09:10.430147+0000","last_clean":"2023-07-14T13:09:10.430147+0000","last_became_active":"2023-07-14T13:09:09.439207+0000","last_became_peered":"2023-07-14T13:09:09.439207+0000","last_unstale":"2023-07-14T13:09:10.430147+0000","last_undegraded":"2023-07-14T13:09:10.430147+0000","last_fullsized":"2023-07-14T13:09:10.430147+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:29:51.451099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033893+0000","last_change":"2023-07-14T13:09:08.445355+0000","last_active":"2023-07-14T13:09:12.033893+0000","last_peered":"2023-07-14T13:09:12.033893+0000","last_clean":"2023-07-14T13:09:12.033893+0000","last_became_active":"2023-07-14T13:09:08.445081+0000","last_became_peered":"2023-07-14T13:09:08.445081+0000","last_unstale":"2023-07-14T13:09:12.033893+0000","last_undegraded":"2023-07-14T13:09:12.033893+0000","last_fullsized":"2023-07-14T13:09:12.033893+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:02:41.574353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.037865+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:09:12.037865+0000","last_peered":"2023-07-14T13:09:12.037865+0000","last_clean":"2023-07-14T13:09:12.037865+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:09:12.037865+0000","last_undegraded":"2023-07-14T13:09:12.037865+0000","last_fullsized":"2023-07-14T13:09:12.037865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:42:41.031735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.039067+0000","last_change":"2023-07-14T13:09:09.457487+0000","last_active":"2023-07-14T13:09:12.039067+0000","last_peered":"2023-07-14T13:09:12.039067+0000","last_clean":"2023-07-14T13:09:12.039067+0000","last_became_active":"2023-07-14T13:09:09.456950+0000","last_became_peered":"2023-07-14T13:09:09.456950+0000","last_unstale":"2023-07-14T13:09:12.039067+0000","last_undegraded":"2023-07-14T13:09:12.039067+0000","last_fullsized":"2023-07-14T13:09:12.039067+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:51:34.580731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033787+0000","last_change":"2023-07-14T13:09:08.444592+0000","last_active":"2023-07-14T13:09:12.033787+0000","last_peered":"2023-07-14T13:09:12.033787+0000","last_clean":"2023-07-14T13:09:12.033787+0000","last_became_active":"2023-07-14T13:09:08.444313+0000","last_became_peered":"2023-07-14T13:09:08.444313+0000","last_unstale":"2023-07-14T13:09:12.033787+0000","last_undegraded":"2023-07-14T13:09:12.033787+0000","last_fullsized":"2023-07-14T13:09:12.033787+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:26:10.415790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":150,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892700+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:09:11.892700+0000","last_peered":"2023-07-14T13:09:11.892700+0000","last_clean":"2023-07-14T13:09:11.892700+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:09:11.892700+0000","last_undegraded":"2023-07-14T13:09:11.892700+0000","last_fullsized":"2023-07-14T13:09:11.892700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:50:36.399832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429987+0000","last_change":"2023-07-14T13:09:09.455678+0000","last_active":"2023-07-14T13:09:10.429987+0000","last_peered":"2023-07-14T13:09:10.429987+0000","last_clean":"2023-07-14T13:09:10.429987+0000","last_became_active":"2023-07-14T13:09:09.455373+0000","last_became_peered":"2023-07-14T13:09:09.455373+0000","last_unstale":"2023-07-14T13:09:10.429987+0000","last_undegraded":"2023-07-14T13:09:10.429987+0000","last_fullsized":"2023-07-14T13:09:10.429987+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:46:27.362227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"96'2","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034498+0000","last_change":"2023-07-14T13:09:08.441285+0000","last_active":"2023-07-14T13:09:12.034498+0000","last_peered":"2023-07-14T13:09:12.034498+0000","last_clean":"2023-07-14T13:09:12.034498+0000","last_became_active":"2023-07-14T13:09:08.440995+0000","last_became_peered":"2023-07-14T13:09:08.440995+0000","last_unstale":"2023-07-14T13:09:12.034498+0000","last_undegraded":"2023-07-14T13:09:12.034498+0000","last_fullsized":"2023-07-14T13:09:12.034498+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:52:51.529066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":156,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.037980+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:09:12.037980+0000","last_peered":"2023-07-14T13:09:12.037980+0000","last_clean":"2023-07-14T13:09:12.037980+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:09:12.037980+0000","last_undegraded":"2023-07-14T13:09:12.037980+0000","last_fullsized":"2023-07-14T13:09:12.037980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:50:29.202192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892570+0000","last_change":"2023-07-14T13:09:09.448817+0000","last_active":"2023-07-14T13:09:11.892570+0000","last_peered":"2023-07-14T13:09:11.892570+0000","last_clean":"2023-07-14T13:09:11.892570+0000","last_became_active":"2023-07-14T13:09:09.448520+0000","last_became_peered":"2023-07-14T13:09:09.448520+0000","last_unstale":"2023-07-14T13:09:11.892570+0000","last_undegraded":"2023-07-14T13:09:11.892570+0000","last_fullsized":"2023-07-14T13:09:11.892570+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:53:13.224188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"96'1","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892913+0000","last_change":"2023-07-14T13:09:08.440049+0000","last_active":"2023-07-14T13:09:11.892913+0000","last_peered":"2023-07-14T13:09:11.892913+0000","last_clean":"2023-07-14T13:09:11.892913+0000","last_became_active":"2023-07-14T13:09:08.439676+0000","last_became_peered":"2023-07-14T13:09:08.439676+0000","last_unstale":"2023-07-14T13:09:11.892913+0000","last_undegraded":"2023-07-14T13:09:11.892913+0000","last_fullsized":"2023-07-14T13:09:11.892913+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:14:18.335021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":164,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034634+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:09:12.034634+0000","last_peered":"2023-07-14T13:09:12.034634+0000","last_clean":"2023-07-14T13:09:12.034634+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:09:12.034634+0000","last_undegraded":"2023-07-14T13:09:12.034634+0000","last_fullsized":"2023-07-14T13:09:12.034634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:07:38.092074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034347+0000","last_change":"2023-07-14T13:09:09.453843+0000","last_active":"2023-07-14T13:09:12.034347+0000","last_peered":"2023-07-14T13:09:12.034347+0000","last_clean":"2023-07-14T13:09:12.034347+0000","last_became_active":"2023-07-14T13:09:09.453556+0000","last_became_peered":"2023-07-14T13:09:09.453556+0000","last_unstale":"2023-07-14T13:09:12.034347+0000","last_undegraded":"2023-07-14T13:09:12.034347+0000","last_fullsized":"2023-07-14T13:09:12.034347+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:46:26.111226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034192+0000","last_change":"2023-07-14T13:09:08.448203+0000","last_active":"2023-07-14T13:09:12.034192+0000","last_peered":"2023-07-14T13:09:12.034192+0000","last_clean":"2023-07-14T13:09:12.034192+0000","last_became_active":"2023-07-14T13:09:08.447855+0000","last_became_peered":"2023-07-14T13:09:08.447855+0000","last_unstale":"2023-07-14T13:09:12.034192+0000","last_undegraded":"2023-07-14T13:09:12.034192+0000","last_fullsized":"2023-07-14T13:09:12.034192+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:41:24.859927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":156,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038634+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:09:12.038634+0000","last_peered":"2023-07-14T13:09:12.038634+0000","last_clean":"2023-07-14T13:09:12.038634+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:09:12.038634+0000","last_undegraded":"2023-07-14T13:09:12.038634+0000","last_fullsized":"2023-07-14T13:09:12.038634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:06:32.006164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033787+0000","last_change":"2023-07-14T13:09:09.468504+0000","last_active":"2023-07-14T13:09:12.033787+0000","last_peered":"2023-07-14T13:09:12.033787+0000","last_clean":"2023-07-14T13:09:12.033787+0000","last_became_active":"2023-07-14T13:09:09.468224+0000","last_became_peered":"2023-07-14T13:09:09.468224+0000","last_unstale":"2023-07-14T13:09:12.033787+0000","last_undegraded":"2023-07-14T13:09:12.033787+0000","last_fullsized":"2023-07-14T13:09:12.033787+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:15:08.881840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"96'1","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038386+0000","last_change":"2023-07-14T13:09:08.449416+0000","last_active":"2023-07-14T13:09:12.038386+0000","last_peered":"2023-07-14T13:09:12.038386+0000","last_clean":"2023-07-14T13:09:12.038386+0000","last_became_active":"2023-07-14T13:09:08.449100+0000","last_became_peered":"2023-07-14T13:09:08.449100+0000","last_unstale":"2023-07-14T13:09:12.038386+0000","last_undegraded":"2023-07-14T13:09:12.038386+0000","last_fullsized":"2023-07-14T13:09:12.038386+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:52:59.486243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":164,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034886+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:09:12.034886+0000","last_peered":"2023-07-14T13:09:12.034886+0000","last_clean":"2023-07-14T13:09:12.034886+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:09:12.034886+0000","last_undegraded":"2023-07-14T13:09:12.034886+0000","last_fullsized":"2023-07-14T13:09:12.034886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:23:14.929289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892460+0000","last_change":"2023-07-14T13:09:09.455863+0000","last_active":"2023-07-14T13:09:11.892460+0000","last_peered":"2023-07-14T13:09:11.892460+0000","last_clean":"2023-07-14T13:09:11.892460+0000","last_became_active":"2023-07-14T13:09:09.455594+0000","last_became_peered":"2023-07-14T13:09:09.455594+0000","last_unstale":"2023-07-14T13:09:11.892460+0000","last_undegraded":"2023-07-14T13:09:11.892460+0000","last_fullsized":"2023-07-14T13:09:11.892460+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:01.249886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"96'2","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.434398+0000","last_change":"2023-07-14T13:09:08.440769+0000","last_active":"2023-07-14T13:09:10.434398+0000","last_peered":"2023-07-14T13:09:10.434398+0000","last_clean":"2023-07-14T13:09:10.434398+0000","last_became_active":"2023-07-14T13:09:08.439981+0000","last_became_peered":"2023-07-14T13:09:08.439981+0000","last_unstale":"2023-07-14T13:09:10.434398+0000","last_undegraded":"2023-07-14T13:09:10.434398+0000","last_fullsized":"2023-07-14T13:09:10.434398+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:57:56.918317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":154,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.039055+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:09:12.039055+0000","last_peered":"2023-07-14T13:09:12.039055+0000","last_clean":"2023-07-14T13:09:12.039055+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:09:12.039055+0000","last_undegraded":"2023-07-14T13:09:12.039055+0000","last_fullsized":"2023-07-14T13:09:12.039055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:51:45.137826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575047,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54920,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316920,"statfs":{"total":96636764160,"available":96580526080,"internally_reserved":0,"allocated":1769472,"data_stored":1178612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.70299999999999996,"15min":0.71699999999999997},"min":{"1min":0.46300000000000002,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.53900000000000003}]},{"osd":1,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72099999999999997,"15min":0.73699999999999999},"min":{"1min":0.47199999999999998,"5min":0.434,"15min":0.434},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72499999999999998,"15min":0.745},"min":{"1min":0.436,"5min":0.436,"15min":0.40500000000000003},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.58199999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.72999999999999998},"min":{"1min":0.51900000000000002,"5min":0.46999999999999997,"15min":0.42699999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72499999999999998,"15min":0.75},"min":{"1min":0.47999999999999998,"5min":0.47199999999999998,"15min":0.46899999999999997},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.55900000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72499999999999998,"15min":0.73599999999999999},"min":{"1min":0.57999999999999996,"5min":0.503,"15min":0.46400000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72999999999999998,"15min":0.75600000000000001},"min":{"1min":0.47899999999999998,"5min":0.47299999999999998,"15min":0.41499999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68100000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55400000000000005,"15min":0.58099999999999996},"min":{"1min":0.44,"5min":0.318,"15min":0.318},"max":{"1min":0.74299999999999999,"5min":0.86299999999999999,"15min":1.022},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58899999999999997,"15min":0.60299999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.39300000000000002},"max":{"1min":0.84399999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.84399999999999997}]},{"osd":5,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98299999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.628,"15min":0.65300000000000002},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82899999999999996,"5min":1.028,"15min":1.028},"last":0.82799999999999996}]},{"osd":6,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.67300000000000004,"15min":0.69599999999999995},"min":{"1min":0.499,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89800000000000002,"5min":0.99299999999999999,"15min":1.0600000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64100000000000001,"15min":0.66900000000000004},"min":{"1min":0.46200000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81399999999999995,"5min":0.95799999999999996,"15min":1.04},"last":0.81399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575048,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1156,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1183744,"data_stored":589786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.48399999999999999,"5min":0.39500000000000002,"15min":0.38},"max":{"1min":0.874,"5min":0.96499999999999997,"15min":1.05},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.71299999999999997,"15min":0.73699999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.47399999999999998},"max":{"1min":0.86499999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.64200000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71699999999999997,"15min":0.745},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.379},"max":{"1min":0.81499999999999995,"5min":0.97199999999999998,"15min":1.0209999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69699999999999995,"15min":0.72299999999999998},"min":{"1min":0.55900000000000005,"5min":0.46999999999999997,"15min":0.44},"max":{"1min":0.85199999999999998,"5min":0.97099999999999997,"15min":1.077},"last":0.60399999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73899999999999999,"15min":0.752},"min":{"1min":0.55500000000000005,"5min":0.45900000000000002,"15min":0.40400000000000003},"max":{"1min":0.89700000000000002,"5min":0.95099999999999996,"15min":1.105},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.73599999999999999,"15min":0.751},"min":{"1min":0.441,"5min":0.441,"15min":0.42299999999999999},"max":{"1min":0.89500000000000002,"5min":0.99099999999999999,"15min":1.0900000000000001},"last":0.82999999999999996}]},{"osd":3,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.748,"15min":0.77500000000000002},"min":{"1min":0.46000000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.93999999999999995,"5min":1.054,"15min":1.1359999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74199999999999999,"15min":0.76300000000000001},"min":{"1min":0.50900000000000001,"5min":0.48399999999999999,"15min":0.45900000000000002},"max":{"1min":0.94599999999999995,"5min":0.99099999999999999,"15min":1.1080000000000001},"last":0.80200000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56399999999999995,"15min":0.57299999999999995},"min":{"1min":0.39900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.83299999999999996,"5min":0.89900000000000002,"15min":0.97899999999999998},"last":0.748},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.439,"5min":0.38500000000000001,"15min":0.36099999999999999},"max":{"1min":0.87,"5min":1.012,"15min":1.0780000000000001},"last":0.93700000000000006}]},{"osd":5,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.48699999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.88100000000000001,"5min":1.579,"15min":1.579},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67900000000000005,"15min":0.68999999999999995},"min":{"1min":0.46300000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90100000000000002,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.97399999999999998}]},{"osd":7,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64400000000000002,"15min":0.65700000000000003},"min":{"1min":0.44700000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86399999999999999,"5min":1.0940000000000001,"15min":1.1200000000000001},"last":0.875},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69599999999999995,"15min":0.70799999999999996},"min":{"1min":0.53400000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.92400000000000004,"5min":1.657,"15min":1.657},"last":0.91500000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575047,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1160,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1187840,"data_stored":594909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.70799999999999996,"15min":0.73099999999999998},"min":{"1min":0.376,"5min":0.36499999999999999,"15min":0.32400000000000001},"max":{"1min":0.91500000000000004,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68799999999999994,"15min":0.73299999999999998},"min":{"1min":0.41699999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.86099999999999999,"5min":1.083,"15min":1.083},"last":0.76100000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69899999999999995,"15min":0.72699999999999998},"min":{"1min":0.46899999999999997,"5min":0.44500000000000001,"15min":0.41099999999999998},"max":{"1min":0.85199999999999998,"5min":1.05,"15min":1.079},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73299999999999998,"15min":0.747},"min":{"1min":0.48999999999999999,"5min":0.48699999999999999,"15min":0.36799999999999999},"max":{"1min":0.94599999999999995,"5min":2.706,"15min":2.706},"last":0.81499999999999995}]},{"osd":2,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71299999999999997,"15min":0.73899999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86299999999999999,"5min":1.212,"15min":1.212},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.70499999999999996,"15min":0.73499999999999999},"min":{"1min":0.44800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89200000000000002,"5min":1.181,"15min":1.181},"last":0.74199999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73299999999999998,"15min":0.748},"min":{"1min":0.48599999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.876,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72799999999999998,"15min":0.76000000000000001},"min":{"1min":0.47299999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90800000000000003,"5min":1.304,"15min":1.304},"last":0.72299999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64000000000000001,"15min":0.629},"min":{"1min":0.437,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.85399999999999998,"5min":1.129,"15min":1.129},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.39900000000000002,"5min":0.36299999999999999,"15min":0.35899999999999999},"max":{"1min":0.84499999999999997,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.59599999999999997}]},{"osd":6,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.60399999999999998,"15min":0.61399999999999999},"min":{"1min":0.41999999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90200000000000002,"5min":1.169,"15min":1.169},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.64400000000000002,"15min":0.64100000000000001},"min":{"1min":0.39400000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.83699999999999997,"5min":1.238,"15min":1.238},"last":0.50700000000000001}]},{"osd":7,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66100000000000003,"15min":0.64300000000000002},"min":{"1min":0.45500000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93300000000000005,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68200000000000005,"15min":0.67800000000000005},"min":{"1min":0.48999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90100000000000002,"5min":1.407,"15min":1.407},"last":0.56000000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575047,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1204224,"data_stored":596543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.70899999999999996,"15min":0.72999999999999998},"min":{"1min":0.36899999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.90800000000000003,"5min":1.0129999999999999,"15min":1.411},"last":0.374},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.435},"max":{"1min":0.85199999999999998,"5min":1.0640000000000001,"15min":1.1200000000000001},"last":0.63700000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.748,"15min":0.749},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92500000000000004,"5min":0.94699999999999995,"15min":1.077},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70999999999999996,"15min":0.73599999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89600000000000002,"5min":0.96399999999999997,"15min":1.0469999999999999},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.51800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91000000000000003,"5min":0.96499999999999997,"15min":1.091},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.76900000000000002,"15min":0.77400000000000002},"min":{"1min":0.46400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98099999999999998,"5min":1.0649999999999999,"15min":1.387},"last":0.46400000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.72999999999999998,"15min":0.746},"min":{"1min":0.53200000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.94699999999999995,"5min":0.997,"15min":1.008},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.75800000000000001,"15min":0.77100000000000002},"min":{"1min":0.504,"5min":0.496,"15min":0.46800000000000003},"max":{"1min":0.875,"5min":1.024,"15min":1.0589999999999999},"last":0.67600000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61899999999999999,"15min":0.60499999999999998},"min":{"1min":0.49299999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.85299999999999998,"5min":0.95599999999999996,"15min":1.0029999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63300000000000001,"15min":0.61799999999999999},"min":{"1min":0.45900000000000002,"5min":0.41399999999999998,"15min":0.34599999999999997},"max":{"1min":0.93200000000000005,"5min":0.93600000000000005,"15min":0.95199999999999996},"last":0.753}]},{"osd":6,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.32300000000000001},"max":{"1min":0.96999999999999997,"5min":1.014,"15min":1.014},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68300000000000005,"15min":0.66900000000000004},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.374},"max":{"1min":0.86899999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.69899999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68899999999999995,"15min":0.66900000000000004},"min":{"1min":0.503,"5min":0.46000000000000002,"15min":0.39000000000000001},"max":{"1min":0.89400000000000002,"5min":0.94699999999999995,"15min":1.0349999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70999999999999996,"15min":0.69499999999999995},"min":{"1min":0.42799999999999999,"5min":0.40300000000000002,"15min":0.36899999999999999},"max":{"1min":0.91800000000000004,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.77400000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575047,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36292,"kb_used_data":1148,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335548,"statfs":{"total":96636764160,"available":96599601152,"internally_reserved":0,"allocated":1175552,"data_stored":588804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.26200000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.84199999999999997},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.498,"15min":0.51500000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.60799999999999998,"5min":0.77300000000000002,"15min":1.0209999999999999},"last":0.46800000000000003}]},{"osd":1,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47199999999999998,"15min":0.47499999999999998},"min":{"1min":0.33100000000000002,"5min":0.315,"15min":0.29599999999999999},"max":{"1min":0.63900000000000001,"5min":0.77200000000000002,"15min":0.79600000000000004},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67800000000000005,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.40699999999999997}]},{"osd":2,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54100000000000004,"15min":0.56999999999999995},"min":{"1min":0.38200000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.72399999999999998,"5min":0.82599999999999996,"15min":0.95899999999999996},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60699999999999998,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86599999999999999,"5min":1.663,"15min":1.663},"last":0.48499999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.748,"15min":0.76500000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":0.90900000000000003,"5min":1.284,"15min":1.284},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76800000000000002,"15min":0.78900000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.47699999999999998},"max":{"1min":1.0660000000000001,"5min":1.121,"15min":1.196},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.52400000000000002},"max":{"1min":1.0229999999999999,"5min":1.306,"15min":1.306},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77900000000000003,"15min":0.79100000000000004},"min":{"1min":0.58099999999999996,"5min":0.372,"15min":0.372},"max":{"1min":0.97399999999999998,"5min":1.1870000000000001,"15min":1.2470000000000001},"last":0.57299999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.76800000000000002,"15min":0.78000000000000003},"min":{"1min":0.50600000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96599999999999997,"5min":1.105,"15min":1.117},"last":0.625},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.79700000000000004,"15min":0.81799999999999995},"min":{"1min":0.56299999999999994,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.93999999999999995,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.83299999999999996,"15min":0.84099999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53100000000000003},"max":{"1min":0.89900000000000002,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.53500000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0009999999999999,"5min":1.595,"15min":1.595},"last":0.65600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575047,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58440,"kb_used_data":1152,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313400,"statfs":{"total":96636764160,"available":96576921600,"internally_reserved":0,"allocated":1179648,"data_stored":587945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45900000000000002,"15min":0.46800000000000003},"min":{"1min":0.29199999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.84699999999999998,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.54200000000000004,"15min":0.53300000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.70799999999999996,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.65500000000000003}]},{"osd":1,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.48299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30399999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65500000000000003,"5min":2.7200000000000002,"15min":2.7200000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.499,"5min":0.55000000000000004,"15min":0.56299999999999994},"min":{"1min":0.36299999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78300000000000003,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":0.61199999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.64500000000000002,"15min":0.60399999999999998},"min":{"1min":0.39500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71699999999999997,"5min":8.2530000000000001,"15min":8.2530000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89600000000000002,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.74199999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.754,"15min":0.78100000000000003},"min":{"1min":0.53200000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.99399999999999999,"5min":1.0940000000000001,"15min":1.1499999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.56699999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0629999999999999,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.76500000000000001}]},{"osd":5,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.84399999999999997,"15min":0.85799999999999998},"min":{"1min":0.58599999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1319999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.879},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82499999999999996,"15min":0.83999999999999997},"min":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.433},"max":{"1min":1.153,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.92400000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.78700000000000003,"15min":0.80400000000000005},"min":{"1min":0.57299999999999995,"5min":0.48999999999999999,"15min":0.47599999999999998},"max":{"1min":0.93999999999999995,"5min":3.9849999999999999,"15min":3.9849999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80200000000000005,"15min":0.81299999999999994},"min":{"1min":0.60699999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0289999999999999,"5min":3.391,"15min":3.391},"last":0.82799999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.79600000000000004,"15min":0.82199999999999995},"min":{"1min":0.55000000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.1759999999999999,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.81499999999999995,"15min":0.82299999999999995},"min":{"1min":0.60199999999999998,"5min":0.53200000000000003,"15min":0.50900000000000001},"max":{"1min":1.0940000000000001,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.89100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575048,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":1191936,"data_stored":594987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.29199999999999998,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.53700000000000003,"5min":0.65400000000000003,"15min":0.77200000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.28199999999999997,"15min":0.26500000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.41899999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47199999999999998,"15min":0.47299999999999998},"min":{"1min":0.34300000000000003,"5min":0.32100000000000001,"15min":0.29499999999999998},"max":{"1min":0.54200000000000004,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65100000000000002,"5min":1.014,"15min":1.014},"last":0.52300000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.621,"15min":0.63600000000000001},"min":{"1min":0.48199999999999998,"5min":0.44700000000000001,"15min":0.437},"max":{"1min":0.73899999999999999,"5min":0.80500000000000005,"15min":0.96299999999999997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56499999999999995,"15min":0.57999999999999996},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.50600000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77700000000000002,"15min":0.78400000000000003},"min":{"1min":0.55500000000000005,"5min":0.51600000000000001,"15min":0.40000000000000002},"max":{"1min":1.0409999999999999,"5min":1.2110000000000001,"15min":1.236},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77200000000000002,"15min":0.78600000000000003},"min":{"1min":0.57499999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.0309999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.77500000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.60799999999999998,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.55800000000000005,"5min":0.48599999999999999,"15min":0.48199999999999998},"max":{"1min":1.0940000000000001,"5min":1.2749999999999999,"15min":1.3600000000000001},"last":0.85399999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.53800000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1.0580000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.80500000000000005,"15min":0.81399999999999995},"min":{"1min":0.56100000000000005,"5min":0.52200000000000002,"15min":0.49199999999999999},"max":{"1min":1.1319999999999999,"5min":1.262,"15min":1.2969999999999999},"last":0.752}]},{"osd":7,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.47799999999999998},"max":{"1min":1.1479999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.82099999999999995,"15min":0.84099999999999997},"min":{"1min":0.58499999999999996,"5min":0.53700000000000003,"15min":0.52800000000000002},"max":{"1min":1.2070000000000001,"5min":1.327,"15min":1.327},"last":0.90800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575049,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36876,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334964,"statfs":{"total":96636764160,"available":96599003136,"internally_reserved":0,"allocated":1773568,"data_stored":1184224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.45600000000000002,"15min":0.44700000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.61199999999999999,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.49099999999999999,"15min":0.51500000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.27700000000000002},"max":{"1min":0.61799999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.36599999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.51900000000000002,"15min":0.51100000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69699999999999995,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.54000000000000004,"15min":0.55300000000000005},"min":{"1min":0.39800000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63800000000000001,"5min":0.80300000000000005,"15min":0.90300000000000002},"last":0.441}]},{"osd":3,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.504},"min":{"1min":0.36399999999999999,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.67600000000000005,"5min":0.72999999999999998,"15min":0.84999999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82899999999999996,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76900000000000002,"15min":0.78800000000000003},"min":{"1min":0.56100000000000005,"5min":0.48399999999999999,"15min":0.44400000000000001},"max":{"1min":0.90500000000000003,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.878},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.53500000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.038,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.91700000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.77100000000000002,"15min":0.80600000000000005},"min":{"1min":0.55100000000000005,"5min":0.51800000000000002,"15min":0.47899999999999998},"max":{"1min":0.80500000000000005,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.56399999999999995,"5min":0.49299999999999999,"15min":0.47299999999999998},"max":{"1min":0.97299999999999998,"5min":1.325,"15min":1.325},"last":0.93999999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.79100000000000004,"15min":0.80600000000000005},"min":{"1min":0.53500000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91400000000000003,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78900000000000003,"15min":0.81499999999999995},"min":{"1min":0.58399999999999996,"5min":0.55500000000000005,"15min":0.41299999999999998},"max":{"1min":1.0900000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.98099999999999998}]},{"osd":7,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.79800000000000004,"15min":0.83199999999999996},"min":{"1min":0.57699999999999996,"5min":0.503,"15min":0.45500000000000002},"max":{"1min":0.93799999999999994,"5min":1.171,"15min":1.2749999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.77100000000000002,"15min":0.81100000000000005},"min":{"1min":0.50600000000000001,"5min":0.502,"15min":0.497},"max":{"1min":0.95199999999999996,"5min":1.381,"15min":1.381},"last":0.77300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:09:17.911 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:09:17.916 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:09:18.160 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:09:18.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.283+0000 7fb05aa31640 1 Processor -- start 2023-07-14T13:09:18.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.283+0000 7fb05aa31640 1 -- start start 2023-07-14T13:09:18.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.283+0000 7fb05aa31640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb05406f080 0x7fb05406f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:18.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.283+0000 7fb05aa31640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb054158490 0x7fb05415ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:18.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.283+0000 7fb05aa31640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0540c8990 con 0x7fb0540c8480 2023-07-14T13:09:18.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.283+0000 7fb05aa31640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0540708d0 con 0x7fb05406f080 2023-07-14T13:09:18.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.283+0000 7fb05aa31640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0540c99a0 con 0x7fb054158490 2023-07-14T13:09:18.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.287+0000 7fb059a2f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb05406f080 0x7fb05406f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:18.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.287+0000 7fb059a2f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb05406f080 0x7fb05406f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38054/0 (socket says 172.21.15.5:38054) 2023-07-14T13:09:18.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.287+0000 7fb059a2f640 1 -- 172.21.15.5:0/2428256726 learned_addr learned my addr 172.21.15.5:0/2428256726 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:18.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.287+0000 7fb05922e640 1 --2- 172.21.15.5:0/2428256726 >> v2:172.21.15.154:3300/0 conn(0x7fb054158490 0x7fb05415ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:18.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.287+0000 7fb059a2f640 1 -- 172.21.15.5:0/2428256726 >> v2:172.21.15.154:3300/0 conn(0x7fb054158490 msgr2=0x7fb05415ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:18.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.287+0000 7fb059a2f640 1 --2- 172.21.15.5:0/2428256726 >> v2:172.21.15.154:3300/0 conn(0x7fb054158490 0x7fb05415ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:18.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.287+0000 7fb059a2f640 1 -- 172.21.15.5:0/2428256726 >> v1:172.21.15.154:6789/0 conn(0x7fb0540c8480 legacy=0x7fb05415bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:18.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.287+0000 7fb059a2f640 1 -- 172.21.15.5:0/2428256726 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05406f990 con 0x7fb05406f080 2023-07-14T13:09:18.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.287+0000 7fb059a2f640 1 --2- 172.21.15.5:0/2428256726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb05406f080 0x7fb05406f450 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fb054065e60 tx=0x7fb05001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0699d566a11490 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:18.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.287+0000 7fb058a2d640 1 -- 172.21.15.5:0/2428256726 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0500ab5f0 con 0x7fb05406f080 2023-07-14T13:09:18.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.287+0000 7fb058a2d640 1 -- 172.21.15.5:0/2428256726 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0500ab750 con 0x7fb05406f080 2023-07-14T13:09:18.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.287+0000 7fb058a2d640 1 -- 172.21.15.5:0/2428256726 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0500abae0 con 0x7fb05406f080 2023-07-14T13:09:18.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.291+0000 7fb05aa31640 1 -- 172.21.15.5:0/2428256726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb05406f080 msgr2=0x7fb05406f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:18.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.291+0000 7fb05aa31640 1 --2- 172.21.15.5:0/2428256726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb05406f080 0x7fb05406f450 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fb054065e60 tx=0x7fb05001c500 comp rx=0 tx=0).stop 2023-07-14T13:09:18.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.291+0000 7fb05aa31640 1 -- 172.21.15.5:0/2428256726 shutdown_connections 2023-07-14T13:09:18.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.291+0000 7fb05aa31640 1 --2- 172.21.15.5:0/2428256726 >> v2:172.21.15.154:3300/0 conn(0x7fb054158490 0x7fb05415ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:18.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.291+0000 7fb05aa31640 1 --2- 172.21.15.5:0/2428256726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb05406f080 0x7fb05406f450 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:18.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.291+0000 7fb05aa31640 1 -- 172.21.15.5:0/2428256726 >> 172.21.15.5:0/2428256726 conn(0x7fb0540ca8b0 msgr2=0x7fb0540cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:18.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.291+0000 7fb05aa31640 1 -- 172.21.15.5:0/2428256726 shutdown_connections 2023-07-14T13:09:18.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.291+0000 7fb05aa31640 1 -- 172.21.15.5:0/2428256726 wait complete. 2023-07-14T13:09:18.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.291+0000 7fb05aa31640 1 Processor -- start 2023-07-14T13:09:18.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.291+0000 7fb05aa31640 1 -- start start 2023-07-14T13:09:18.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.291+0000 7fb05aa31640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb05406f080 0x7fb05414bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.291+0000 7fb05aa31640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0540c8480 0x7fb05415bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.291+0000 7fb05aa31640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb054158490 0x7fb054145a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.291+0000 7fb05aa31640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb054149b50 con 0x7fb054158490 2023-07-14T13:09:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.291+0000 7fb05aa31640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05414d590 con 0x7fb05406f080 2023-07-14T13:09:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.291+0000 7fb05aa31640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb05414c020 con 0x7fb0540c8480 2023-07-14T13:09:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.291+0000 7fb05a230640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb054158490 0x7fb054145a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.291+0000 7fb05a230640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb054158490 0x7fb054145a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38062/0 (socket says 172.21.15.5:38062) 2023-07-14T13:09:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.291+0000 7fb05a230640 1 -- 172.21.15.5:0/1191145948 learned_addr learned my addr 172.21.15.5:0/1191145948 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.291+0000 7fb059a2f640 1 --2- 172.21.15.5:0/1191145948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb05406f080 0x7fb05414bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.291+0000 7fb05922e640 1 --2- 172.21.15.5:0/1191145948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0540c8480 0x7fb05415bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.295+0000 7fb05a230640 1 -- 172.21.15.5:0/1191145948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0540c8480 msgr2=0x7fb05415bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.295+0000 7fb05a230640 1 --2- 172.21.15.5:0/1191145948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0540c8480 0x7fb05415bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.295+0000 7fb05a230640 1 -- 172.21.15.5:0/1191145948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb05406f080 msgr2=0x7fb05414bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.295+0000 7fb05a230640 1 --2- 172.21.15.5:0/1191145948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb05406f080 0x7fb05414bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.295+0000 7fb05a230640 1 -- 172.21.15.5:0/1191145948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0500094d0 con 0x7fb054158490 2023-07-14T13:09:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.295+0000 7fb05a230640 1 --2- 172.21.15.5:0/1191145948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb054158490 0x7fb054145a60 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00c730 tx=0x7fb04c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.295+0000 7fb04a7fc640 1 -- 172.21.15.5:0/1191145948 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c003b80 con 0x7fb054158490 2023-07-14T13:09:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.295+0000 7fb04a7fc640 1 -- 172.21.15.5:0/1191145948 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04c003ce0 con 0x7fb054158490 2023-07-14T13:09:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.295+0000 7fb04a7fc640 1 -- 172.21.15.5:0/1191145948 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c005310 con 0x7fb054158490 2023-07-14T13:09:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.295+0000 7fb05aa31640 1 -- 172.21.15.5:0/1191145948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb05414b2c0 con 0x7fb054158490 2023-07-14T13:09:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.295+0000 7fb05aa31640 1 -- 172.21.15.5:0/1191145948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb05414dae0 con 0x7fb054158490 2023-07-14T13:09:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.295+0000 7fb05aa31640 1 -- 172.21.15.5:0/1191145948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb05414dca0 con 0x7fb054158490 2023-07-14T13:09:18.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.295+0000 7fb04a7fc640 1 -- 172.21.15.5:0/1191145948 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb04c005680 con 0x7fb054158490 2023-07-14T13:09:18.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.295+0000 7fb04a7fc640 1 --2- 172.21.15.5:0/1191145948 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fb0380663a0 0x7fb038068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:18.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.295+0000 7fb04a7fc640 1 -- 172.21.15.5:0/1191145948 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb04c083d80 con 0x7fb054158490 2023-07-14T13:09:18.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.299+0000 7fb059a2f640 1 --2- 172.21.15.5:0/1191145948 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fb0380663a0 0x7fb038068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:18.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.299+0000 7fb059a2f640 1 --2- 172.21.15.5:0/1191145948 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fb0380663a0 0x7fb038068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb0500af000 tx=0x7fb0500b6040 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:18.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.303+0000 7fb04a7fc640 1 -- 172.21.15.5:0/1191145948 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb04c051100 con 0x7fb054158490 2023-07-14T13:09:18.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.451+0000 7fb05aa31640 1 -- 172.21.15.5:0/1191145948 --> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb0540c9480 con 0x7fb0380663a0 2023-07-14T13:09:18.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.463+0000 7fb04a7fc640 1 -- 172.21.15.5:0/1191145948 <== mgr.6691 v2:172.21.15.154:6832/3243469291 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311235 (secure 0 0 0) 0x7fb0500ab8c0 con 0x7fb0380663a0 2023-07-14T13:09:18.497 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:18.499 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:09:18.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.467+0000 7fb05aa31640 1 -- 172.21.15.5:0/1191145948 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fb0380663a0 msgr2=0x7fb038068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:18.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.467+0000 7fb05aa31640 1 --2- 172.21.15.5:0/1191145948 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fb0380663a0 0x7fb038068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb0500af000 tx=0x7fb0500b6040 comp rx=0 tx=0).stop 2023-07-14T13:09:18.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.467+0000 7fb05aa31640 1 -- 172.21.15.5:0/1191145948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb054158490 msgr2=0x7fb054145a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:18.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.467+0000 7fb05aa31640 1 --2- 172.21.15.5:0/1191145948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb054158490 0x7fb054145a60 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00c730 tx=0x7fb04c00cbf0 comp rx=0 tx=0).stop 2023-07-14T13:09:18.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.467+0000 7fb05aa31640 1 -- 172.21.15.5:0/1191145948 shutdown_connections 2023-07-14T13:09:18.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.467+0000 7fb05aa31640 1 --2- 172.21.15.5:0/1191145948 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fb0380663a0 0x7fb038068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:18.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.467+0000 7fb05aa31640 1 --2- 172.21.15.5:0/1191145948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb054158490 0x7fb054145a60 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:18.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.467+0000 7fb05aa31640 1 --2- 172.21.15.5:0/1191145948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0540c8480 0x7fb05415bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:18.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.467+0000 7fb05aa31640 1 --2- 172.21.15.5:0/1191145948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb05406f080 0x7fb05414bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:18.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.467+0000 7fb05aa31640 1 -- 172.21.15.5:0/1191145948 >> 172.21.15.5:0/1191145948 conn(0x7fb0540ca8b0 msgr2=0x7fb054157660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:18.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.467+0000 7fb05aa31640 1 -- 172.21.15.5:0/1191145948 shutdown_connections 2023-07-14T13:09:18.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.467+0000 7fb05aa31640 1 -- 172.21.15.5:0/1191145948 wait complete. 2023-07-14T13:09:18.516 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2023-07-14T13:09:18.335824+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":324,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":315424,"kb_used_data":10464,"kb_used_omap":0,"kb_used_meta":304896,"kb_avail":754659296,"statfs":{"total":773094113280,"available":772771119104,"internally_reserved":0,"allocated":10715136,"data_stored":5942422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312213504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.905254"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038085+0000","last_change":"2023-07-14T13:09:09.453088+0000","last_active":"2023-07-14T13:09:12.038085+0000","last_peered":"2023-07-14T13:09:12.038085+0000","last_clean":"2023-07-14T13:09:12.038085+0000","last_became_active":"2023-07-14T13:09:09.452803+0000","last_became_peered":"2023-07-14T13:09:09.452803+0000","last_unstale":"2023-07-14T13:09:12.038085+0000","last_undegraded":"2023-07-14T13:09:12.038085+0000","last_fullsized":"2023-07-14T13:09:12.038085+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:03:08.674699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.430093+0000","last_change":"2023-07-14T13:09:09.446176+0000","last_active":"2023-07-14T13:09:10.430093+0000","last_peered":"2023-07-14T13:09:10.430093+0000","last_clean":"2023-07-14T13:09:10.430093+0000","last_became_active":"2023-07-14T13:09:09.445293+0000","last_became_peered":"2023-07-14T13:09:09.445293+0000","last_unstale":"2023-07-14T13:09:10.430093+0000","last_undegraded":"2023-07-14T13:09:10.430093+0000","last_fullsized":"2023-07-14T13:09:10.430093+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:33:21.009243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034775+0000","last_change":"2023-07-14T13:09:09.448668+0000","last_active":"2023-07-14T13:09:12.034775+0000","last_peered":"2023-07-14T13:09:12.034775+0000","last_clean":"2023-07-14T13:09:12.034775+0000","last_became_active":"2023-07-14T13:09:09.448371+0000","last_became_peered":"2023-07-14T13:09:09.448371+0000","last_unstale":"2023-07-14T13:09:12.034775+0000","last_undegraded":"2023-07-14T13:09:12.034775+0000","last_fullsized":"2023-07-14T13:09:12.034775+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:48:39.755881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.037989+0000","last_change":"2023-07-14T13:09:09.453091+0000","last_active":"2023-07-14T13:09:12.037989+0000","last_peered":"2023-07-14T13:09:12.037989+0000","last_clean":"2023-07-14T13:09:12.037989+0000","last_became_active":"2023-07-14T13:09:09.452688+0000","last_became_peered":"2023-07-14T13:09:09.452688+0000","last_unstale":"2023-07-14T13:09:12.037989+0000","last_undegraded":"2023-07-14T13:09:12.037989+0000","last_fullsized":"2023-07-14T13:09:12.037989+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:59.123420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892686+0000","last_change":"2023-07-14T13:09:09.454198+0000","last_active":"2023-07-14T13:09:11.892686+0000","last_peered":"2023-07-14T13:09:11.892686+0000","last_clean":"2023-07-14T13:09:11.892686+0000","last_became_active":"2023-07-14T13:09:09.453939+0000","last_became_peered":"2023-07-14T13:09:09.453939+0000","last_unstale":"2023-07-14T13:09:11.892686+0000","last_undegraded":"2023-07-14T13:09:11.892686+0000","last_fullsized":"2023-07-14T13:09:11.892686+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:22:29.316898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033830+0000","last_change":"2023-07-14T13:09:09.466445+0000","last_active":"2023-07-14T13:09:12.033830+0000","last_peered":"2023-07-14T13:09:12.033830+0000","last_clean":"2023-07-14T13:09:12.033830+0000","last_became_active":"2023-07-14T13:09:09.466235+0000","last_became_peered":"2023-07-14T13:09:09.466235+0000","last_unstale":"2023-07-14T13:09:12.033830+0000","last_undegraded":"2023-07-14T13:09:12.033830+0000","last_fullsized":"2023-07-14T13:09:12.033830+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:42:41.071144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038390+0000","last_change":"2023-07-14T13:09:09.456644+0000","last_active":"2023-07-14T13:09:12.038390+0000","last_peered":"2023-07-14T13:09:12.038390+0000","last_clean":"2023-07-14T13:09:12.038390+0000","last_became_active":"2023-07-14T13:09:09.456363+0000","last_became_peered":"2023-07-14T13:09:09.456363+0000","last_unstale":"2023-07-14T13:09:12.038390+0000","last_undegraded":"2023-07-14T13:09:12.038390+0000","last_fullsized":"2023-07-14T13:09:12.038390+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:00:22.376834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892478+0000","last_change":"2023-07-14T13:09:09.444492+0000","last_active":"2023-07-14T13:09:11.892478+0000","last_peered":"2023-07-14T13:09:11.892478+0000","last_clean":"2023-07-14T13:09:11.892478+0000","last_became_active":"2023-07-14T13:09:09.444047+0000","last_became_peered":"2023-07-14T13:09:09.444047+0000","last_unstale":"2023-07-14T13:09:11.892478+0000","last_undegraded":"2023-07-14T13:09:11.892478+0000","last_fullsized":"2023-07-14T13:09:11.892478+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:09:58.802715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.434426+0000","last_change":"2023-07-14T13:09:09.460638+0000","last_active":"2023-07-14T13:09:10.434426+0000","last_peered":"2023-07-14T13:09:10.434426+0000","last_clean":"2023-07-14T13:09:10.434426+0000","last_became_active":"2023-07-14T13:09:09.460360+0000","last_became_peered":"2023-07-14T13:09:09.460360+0000","last_unstale":"2023-07-14T13:09:10.434426+0000","last_undegraded":"2023-07-14T13:09:10.434426+0000","last_fullsized":"2023-07-14T13:09:10.434426+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:34:29.457249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.037927+0000","last_change":"2023-07-14T13:09:09.450754+0000","last_active":"2023-07-14T13:09:12.037927+0000","last_peered":"2023-07-14T13:09:12.037927+0000","last_clean":"2023-07-14T13:09:12.037927+0000","last_became_active":"2023-07-14T13:09:09.450449+0000","last_became_peered":"2023-07-14T13:09:09.450449+0000","last_unstale":"2023-07-14T13:09:12.037927+0000","last_undegraded":"2023-07-14T13:09:12.037927+0000","last_fullsized":"2023-07-14T13:09:12.037927+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:40:01.655059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429956+0000","last_change":"2023-07-14T13:09:09.452430+0000","last_active":"2023-07-14T13:09:10.429956+0000","last_peered":"2023-07-14T13:09:10.429956+0000","last_clean":"2023-07-14T13:09:10.429956+0000","last_became_active":"2023-07-14T13:09:09.449894+0000","last_became_peered":"2023-07-14T13:09:09.449894+0000","last_unstale":"2023-07-14T13:09:10.429956+0000","last_undegraded":"2023-07-14T13:09:10.429956+0000","last_fullsized":"2023-07-14T13:09:10.429956+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:48:14.007032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038218+0000","last_change":"2023-07-14T13:09:09.451429+0000","last_active":"2023-07-14T13:09:12.038218+0000","last_peered":"2023-07-14T13:09:12.038218+0000","last_clean":"2023-07-14T13:09:12.038218+0000","last_became_active":"2023-07-14T13:09:09.451110+0000","last_became_peered":"2023-07-14T13:09:09.451110+0000","last_unstale":"2023-07-14T13:09:12.038218+0000","last_undegraded":"2023-07-14T13:09:12.038218+0000","last_fullsized":"2023-07-14T13:09:12.038218+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:12:08.144007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892830+0000","last_change":"2023-07-14T13:09:09.469561+0000","last_active":"2023-07-14T13:09:11.892830+0000","last_peered":"2023-07-14T13:09:11.892830+0000","last_clean":"2023-07-14T13:09:11.892830+0000","last_became_active":"2023-07-14T13:09:09.469257+0000","last_became_peered":"2023-07-14T13:09:09.469257+0000","last_unstale":"2023-07-14T13:09:11.892830+0000","last_undegraded":"2023-07-14T13:09:11.892830+0000","last_fullsized":"2023-07-14T13:09:11.892830+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:54:26.926217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034246+0000","last_change":"2023-07-14T13:09:09.465984+0000","last_active":"2023-07-14T13:09:12.034246+0000","last_peered":"2023-07-14T13:09:12.034246+0000","last_clean":"2023-07-14T13:09:12.034246+0000","last_became_active":"2023-07-14T13:09:09.465297+0000","last_became_peered":"2023-07-14T13:09:09.465297+0000","last_unstale":"2023-07-14T13:09:12.034246+0000","last_undegraded":"2023-07-14T13:09:12.034246+0000","last_fullsized":"2023-07-14T13:09:12.034246+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:36:51.749103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429563+0000","last_change":"2023-07-14T13:09:09.447329+0000","last_active":"2023-07-14T13:09:10.429563+0000","last_peered":"2023-07-14T13:09:10.429563+0000","last_clean":"2023-07-14T13:09:10.429563+0000","last_became_active":"2023-07-14T13:09:09.447000+0000","last_became_peered":"2023-07-14T13:09:09.447000+0000","last_unstale":"2023-07-14T13:09:10.429563+0000","last_undegraded":"2023-07-14T13:09:10.429563+0000","last_fullsized":"2023-07-14T13:09:10.429563+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:25:22.872941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.037545+0000","last_change":"2023-07-14T13:09:09.457273+0000","last_active":"2023-07-14T13:09:12.037545+0000","last_peered":"2023-07-14T13:09:12.037545+0000","last_clean":"2023-07-14T13:09:12.037545+0000","last_became_active":"2023-07-14T13:09:09.456952+0000","last_became_peered":"2023-07-14T13:09:09.456952+0000","last_unstale":"2023-07-14T13:09:12.037545+0000","last_undegraded":"2023-07-14T13:09:12.037545+0000","last_fullsized":"2023-07-14T13:09:12.037545+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:30:00.342646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892937+0000","last_change":"2023-07-14T13:09:09.455889+0000","last_active":"2023-07-14T13:09:11.892937+0000","last_peered":"2023-07-14T13:09:11.892937+0000","last_clean":"2023-07-14T13:09:11.892937+0000","last_became_active":"2023-07-14T13:09:09.455632+0000","last_became_peered":"2023-07-14T13:09:09.455632+0000","last_unstale":"2023-07-14T13:09:11.892937+0000","last_undegraded":"2023-07-14T13:09:11.892937+0000","last_fullsized":"2023-07-14T13:09:11.892937+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:29:40.244587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034806+0000","last_change":"2023-07-14T13:09:09.450337+0000","last_active":"2023-07-14T13:09:12.034806+0000","last_peered":"2023-07-14T13:09:12.034806+0000","last_clean":"2023-07-14T13:09:12.034806+0000","last_became_active":"2023-07-14T13:09:09.450041+0000","last_became_peered":"2023-07-14T13:09:09.450041+0000","last_unstale":"2023-07-14T13:09:12.034806+0000","last_undegraded":"2023-07-14T13:09:12.034806+0000","last_fullsized":"2023-07-14T13:09:12.034806+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:25:09.990529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034503+0000","last_change":"2023-07-14T13:09:09.457178+0000","last_active":"2023-07-14T13:09:12.034503+0000","last_peered":"2023-07-14T13:09:12.034503+0000","last_clean":"2023-07-14T13:09:12.034503+0000","last_became_active":"2023-07-14T13:09:09.456873+0000","last_became_peered":"2023-07-14T13:09:09.456873+0000","last_unstale":"2023-07-14T13:09:12.034503+0000","last_undegraded":"2023-07-14T13:09:12.034503+0000","last_fullsized":"2023-07-14T13:09:12.034503+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:13:42.988795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892699+0000","last_change":"2023-07-14T13:09:09.449996+0000","last_active":"2023-07-14T13:09:11.892699+0000","last_peered":"2023-07-14T13:09:11.892699+0000","last_clean":"2023-07-14T13:09:11.892699+0000","last_became_active":"2023-07-14T13:09:09.449678+0000","last_became_peered":"2023-07-14T13:09:09.449678+0000","last_unstale":"2023-07-14T13:09:11.892699+0000","last_undegraded":"2023-07-14T13:09:11.892699+0000","last_fullsized":"2023-07-14T13:09:11.892699+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:58:24.472482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.433706+0000","last_change":"2023-07-14T13:09:09.449140+0000","last_active":"2023-07-14T13:09:10.433706+0000","last_peered":"2023-07-14T13:09:10.433706+0000","last_clean":"2023-07-14T13:09:10.433706+0000","last_became_active":"2023-07-14T13:09:09.448603+0000","last_became_peered":"2023-07-14T13:09:09.448603+0000","last_unstale":"2023-07-14T13:09:10.433706+0000","last_undegraded":"2023-07-14T13:09:10.433706+0000","last_fullsized":"2023-07-14T13:09:10.433706+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:36:37.000147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892490+0000","last_change":"2023-07-14T13:09:09.469085+0000","last_active":"2023-07-14T13:09:11.892490+0000","last_peered":"2023-07-14T13:09:11.892490+0000","last_clean":"2023-07-14T13:09:11.892490+0000","last_became_active":"2023-07-14T13:09:09.468814+0000","last_became_peered":"2023-07-14T13:09:09.468814+0000","last_unstale":"2023-07-14T13:09:11.892490+0000","last_undegraded":"2023-07-14T13:09:11.892490+0000","last_fullsized":"2023-07-14T13:09:11.892490+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:11:15.830663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.433661+0000","last_change":"2023-07-14T13:09:09.451724+0000","last_active":"2023-07-14T13:09:10.433661+0000","last_peered":"2023-07-14T13:09:10.433661+0000","last_clean":"2023-07-14T13:09:10.433661+0000","last_became_active":"2023-07-14T13:09:09.451415+0000","last_became_peered":"2023-07-14T13:09:09.451415+0000","last_unstale":"2023-07-14T13:09:10.433661+0000","last_undegraded":"2023-07-14T13:09:10.433661+0000","last_fullsized":"2023-07-14T13:09:10.433661+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:53:45.973591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429728+0000","last_change":"2023-07-14T13:09:09.459438+0000","last_active":"2023-07-14T13:09:10.429728+0000","last_peered":"2023-07-14T13:09:10.429728+0000","last_clean":"2023-07-14T13:09:10.429728+0000","last_became_active":"2023-07-14T13:09:09.459180+0000","last_became_peered":"2023-07-14T13:09:09.459180+0000","last_unstale":"2023-07-14T13:09:10.429728+0000","last_undegraded":"2023-07-14T13:09:10.429728+0000","last_fullsized":"2023-07-14T13:09:10.429728+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:51:06.800504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.430164+0000","last_change":"2023-07-14T13:09:09.455611+0000","last_active":"2023-07-14T13:09:10.430164+0000","last_peered":"2023-07-14T13:09:10.430164+0000","last_clean":"2023-07-14T13:09:10.430164+0000","last_became_active":"2023-07-14T13:09:09.455121+0000","last_became_peered":"2023-07-14T13:09:09.455121+0000","last_unstale":"2023-07-14T13:09:10.430164+0000","last_undegraded":"2023-07-14T13:09:10.430164+0000","last_fullsized":"2023-07-14T13:09:10.430164+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:03:49.784846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038082+0000","last_change":"2023-07-14T13:09:09.465811+0000","last_active":"2023-07-14T13:09:12.038082+0000","last_peered":"2023-07-14T13:09:12.038082+0000","last_clean":"2023-07-14T13:09:12.038082+0000","last_became_active":"2023-07-14T13:09:09.465497+0000","last_became_peered":"2023-07-14T13:09:09.465497+0000","last_unstale":"2023-07-14T13:09:12.038082+0000","last_undegraded":"2023-07-14T13:09:12.038082+0000","last_fullsized":"2023-07-14T13:09:12.038082+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:55:03.116826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038335+0000","last_change":"2023-07-14T13:09:09.457560+0000","last_active":"2023-07-14T13:09:12.038335+0000","last_peered":"2023-07-14T13:09:12.038335+0000","last_clean":"2023-07-14T13:09:12.038335+0000","last_became_active":"2023-07-14T13:09:09.457027+0000","last_became_peered":"2023-07-14T13:09:09.457027+0000","last_unstale":"2023-07-14T13:09:12.038335+0000","last_undegraded":"2023-07-14T13:09:12.038335+0000","last_fullsized":"2023-07-14T13:09:12.038335+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:20:05.726658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892820+0000","last_change":"2023-07-14T13:09:09.454892+0000","last_active":"2023-07-14T13:09:11.892820+0000","last_peered":"2023-07-14T13:09:11.892820+0000","last_clean":"2023-07-14T13:09:11.892820+0000","last_became_active":"2023-07-14T13:09:09.454598+0000","last_became_peered":"2023-07-14T13:09:09.454598+0000","last_unstale":"2023-07-14T13:09:11.892820+0000","last_undegraded":"2023-07-14T13:09:11.892820+0000","last_fullsized":"2023-07-14T13:09:11.892820+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:02:23.849786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429732+0000","last_change":"2023-07-14T13:09:09.446033+0000","last_active":"2023-07-14T13:09:10.429732+0000","last_peered":"2023-07-14T13:09:10.429732+0000","last_clean":"2023-07-14T13:09:10.429732+0000","last_became_active":"2023-07-14T13:09:09.445481+0000","last_became_peered":"2023-07-14T13:09:09.445481+0000","last_unstale":"2023-07-14T13:09:10.429732+0000","last_undegraded":"2023-07-14T13:09:10.429732+0000","last_fullsized":"2023-07-14T13:09:10.429732+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:52:51.943223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.037533+0000","last_change":"2023-07-14T13:09:09.451546+0000","last_active":"2023-07-14T13:09:12.037533+0000","last_peered":"2023-07-14T13:09:12.037533+0000","last_clean":"2023-07-14T13:09:12.037533+0000","last_became_active":"2023-07-14T13:09:09.451269+0000","last_became_peered":"2023-07-14T13:09:09.451269+0000","last_unstale":"2023-07-14T13:09:12.037533+0000","last_undegraded":"2023-07-14T13:09:12.037533+0000","last_fullsized":"2023-07-14T13:09:12.037533+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:51:42.037789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033999+0000","last_change":"2023-07-14T13:09:09.445955+0000","last_active":"2023-07-14T13:09:12.033999+0000","last_peered":"2023-07-14T13:09:12.033999+0000","last_clean":"2023-07-14T13:09:12.033999+0000","last_became_active":"2023-07-14T13:09:09.445618+0000","last_became_peered":"2023-07-14T13:09:09.445618+0000","last_unstale":"2023-07-14T13:09:12.033999+0000","last_undegraded":"2023-07-14T13:09:12.033999+0000","last_fullsized":"2023-07-14T13:09:12.033999+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:13:42.533007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.037707+0000","last_change":"2023-07-14T13:09:09.454971+0000","last_active":"2023-07-14T13:09:12.037707+0000","last_peered":"2023-07-14T13:09:12.037707+0000","last_clean":"2023-07-14T13:09:12.037707+0000","last_became_active":"2023-07-14T13:09:09.454618+0000","last_became_peered":"2023-07-14T13:09:09.454618+0000","last_unstale":"2023-07-14T13:09:12.037707+0000","last_undegraded":"2023-07-14T13:09:12.037707+0000","last_fullsized":"2023-07-14T13:09:12.037707+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:28:55.677486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033987+0000","last_change":"2023-07-14T13:09:09.450411+0000","last_active":"2023-07-14T13:09:12.033987+0000","last_peered":"2023-07-14T13:09:12.033987+0000","last_clean":"2023-07-14T13:09:12.033987+0000","last_became_active":"2023-07-14T13:09:09.450124+0000","last_became_peered":"2023-07-14T13:09:09.450124+0000","last_unstale":"2023-07-14T13:09:12.033987+0000","last_undegraded":"2023-07-14T13:09:12.033987+0000","last_fullsized":"2023-07-14T13:09:12.033987+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:17:47.890949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"96'4","reported_seq":17,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892923+0000","last_change":"2023-07-14T13:09:08.444497+0000","last_active":"2023-07-14T13:09:11.892923+0000","last_peered":"2023-07-14T13:09:11.892923+0000","last_clean":"2023-07-14T13:09:11.892923+0000","last_became_active":"2023-07-14T13:09:08.444214+0000","last_became_peered":"2023-07-14T13:09:08.444214+0000","last_unstale":"2023-07-14T13:09:11.892923+0000","last_undegraded":"2023-07-14T13:09:11.892923+0000","last_fullsized":"2023-07-14T13:09:11.892923+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:51:45.905778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429570+0000","last_change":"2023-07-14T13:09:09.458943+0000","last_active":"2023-07-14T13:09:10.429570+0000","last_peered":"2023-07-14T13:09:10.429570+0000","last_clean":"2023-07-14T13:09:10.429570+0000","last_became_active":"2023-07-14T13:09:09.455757+0000","last_became_peered":"2023-07-14T13:09:09.455757+0000","last_unstale":"2023-07-14T13:09:10.429570+0000","last_undegraded":"2023-07-14T13:09:10.429570+0000","last_fullsized":"2023-07-14T13:09:10.429570+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:45:39.572860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"96'1","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038419+0000","last_change":"2023-07-14T13:09:08.453613+0000","last_active":"2023-07-14T13:09:12.038419+0000","last_peered":"2023-07-14T13:09:12.038419+0000","last_clean":"2023-07-14T13:09:12.038419+0000","last_became_active":"2023-07-14T13:09:08.453262+0000","last_became_peered":"2023-07-14T13:09:08.453262+0000","last_unstale":"2023-07-14T13:09:12.038419+0000","last_undegraded":"2023-07-14T13:09:12.038419+0000","last_fullsized":"2023-07-14T13:09:12.038419+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:22:29.840805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.433807+0000","last_change":"2023-07-14T13:09:09.461096+0000","last_active":"2023-07-14T13:09:10.433807+0000","last_peered":"2023-07-14T13:09:10.433807+0000","last_clean":"2023-07-14T13:09:10.433807+0000","last_became_active":"2023-07-14T13:09:09.460654+0000","last_became_peered":"2023-07-14T13:09:09.460654+0000","last_unstale":"2023-07-14T13:09:10.433807+0000","last_undegraded":"2023-07-14T13:09:10.433807+0000","last_fullsized":"2023-07-14T13:09:10.433807+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:51:34.580731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"96'2","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038472+0000","last_change":"2023-07-14T13:09:08.447878+0000","last_active":"2023-07-14T13:09:12.038472+0000","last_peered":"2023-07-14T13:09:12.038472+0000","last_clean":"2023-07-14T13:09:12.038472+0000","last_became_active":"2023-07-14T13:09:08.447510+0000","last_became_peered":"2023-07-14T13:09:08.447510+0000","last_unstale":"2023-07-14T13:09:12.038472+0000","last_undegraded":"2023-07-14T13:09:12.038472+0000","last_fullsized":"2023-07-14T13:09:12.038472+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:36:05.438485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.434078+0000","last_change":"2023-07-14T13:09:09.448912+0000","last_active":"2023-07-14T13:09:10.434078+0000","last_peered":"2023-07-14T13:09:10.434078+0000","last_clean":"2023-07-14T13:09:10.434078+0000","last_became_active":"2023-07-14T13:09:09.448421+0000","last_became_peered":"2023-07-14T13:09:09.448421+0000","last_unstale":"2023-07-14T13:09:10.434078+0000","last_undegraded":"2023-07-14T13:09:10.434078+0000","last_fullsized":"2023-07-14T13:09:10.434078+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:59:26.802394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"96'2","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038787+0000","last_change":"2023-07-14T13:09:08.449278+0000","last_active":"2023-07-14T13:09:12.038787+0000","last_peered":"2023-07-14T13:09:12.038787+0000","last_clean":"2023-07-14T13:09:12.038787+0000","last_became_active":"2023-07-14T13:09:08.449027+0000","last_became_peered":"2023-07-14T13:09:08.449027+0000","last_unstale":"2023-07-14T13:09:12.038787+0000","last_undegraded":"2023-07-14T13:09:12.038787+0000","last_fullsized":"2023-07-14T13:09:12.038787+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:25:43.383264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429834+0000","last_change":"2023-07-14T13:09:09.447229+0000","last_active":"2023-07-14T13:09:10.429834+0000","last_peered":"2023-07-14T13:09:10.429834+0000","last_clean":"2023-07-14T13:09:10.429834+0000","last_became_active":"2023-07-14T13:09:09.446944+0000","last_became_peered":"2023-07-14T13:09:09.446944+0000","last_unstale":"2023-07-14T13:09:10.429834+0000","last_undegraded":"2023-07-14T13:09:10.429834+0000","last_fullsized":"2023-07-14T13:09:10.429834+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:58:11.945700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"96'1","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.434063+0000","last_change":"2023-07-14T13:09:08.442294+0000","last_active":"2023-07-14T13:09:10.434063+0000","last_peered":"2023-07-14T13:09:10.434063+0000","last_clean":"2023-07-14T13:09:10.434063+0000","last_became_active":"2023-07-14T13:09:08.442027+0000","last_became_peered":"2023-07-14T13:09:08.442027+0000","last_unstale":"2023-07-14T13:09:10.434063+0000","last_undegraded":"2023-07-14T13:09:10.434063+0000","last_fullsized":"2023-07-14T13:09:10.434063+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:49:43.076566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.430015+0000","last_change":"2023-07-14T13:09:09.445796+0000","last_active":"2023-07-14T13:09:10.430015+0000","last_peered":"2023-07-14T13:09:10.430015+0000","last_clean":"2023-07-14T13:09:10.430015+0000","last_became_active":"2023-07-14T13:09:09.445514+0000","last_became_peered":"2023-07-14T13:09:09.445514+0000","last_unstale":"2023-07-14T13:09:10.430015+0000","last_undegraded":"2023-07-14T13:09:10.430015+0000","last_fullsized":"2023-07-14T13:09:10.430015+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:02:59.884389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"96'1","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038902+0000","last_change":"2023-07-14T13:09:08.448534+0000","last_active":"2023-07-14T13:09:12.038902+0000","last_peered":"2023-07-14T13:09:12.038902+0000","last_clean":"2023-07-14T13:09:12.038902+0000","last_became_active":"2023-07-14T13:09:08.448250+0000","last_became_peered":"2023-07-14T13:09:08.448250+0000","last_unstale":"2023-07-14T13:09:12.038902+0000","last_undegraded":"2023-07-14T13:09:12.038902+0000","last_fullsized":"2023-07-14T13:09:12.038902+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:17:22.696776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.434373+0000","last_change":"2023-07-14T13:09:09.460632+0000","last_active":"2023-07-14T13:09:10.434373+0000","last_peered":"2023-07-14T13:09:10.434373+0000","last_clean":"2023-07-14T13:09:10.434373+0000","last_became_active":"2023-07-14T13:09:09.460314+0000","last_became_peered":"2023-07-14T13:09:09.460314+0000","last_unstale":"2023-07-14T13:09:10.434373+0000","last_undegraded":"2023-07-14T13:09:10.434373+0000","last_fullsized":"2023-07-14T13:09:10.434373+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:55:55.944103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429710+0000","last_change":"2023-07-14T13:09:08.443183+0000","last_active":"2023-07-14T13:09:10.429710+0000","last_peered":"2023-07-14T13:09:10.429710+0000","last_clean":"2023-07-14T13:09:10.429710+0000","last_became_active":"2023-07-14T13:09:08.442696+0000","last_became_peered":"2023-07-14T13:09:08.442696+0000","last_unstale":"2023-07-14T13:09:10.429710+0000","last_undegraded":"2023-07-14T13:09:10.429710+0000","last_fullsized":"2023-07-14T13:09:10.429710+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:30:50.273654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038791+0000","last_change":"2023-07-14T13:09:09.457306+0000","last_active":"2023-07-14T13:09:12.038791+0000","last_peered":"2023-07-14T13:09:12.038791+0000","last_clean":"2023-07-14T13:09:12.038791+0000","last_became_active":"2023-07-14T13:09:09.456582+0000","last_became_peered":"2023-07-14T13:09:09.456582+0000","last_unstale":"2023-07-14T13:09:12.038791+0000","last_undegraded":"2023-07-14T13:09:12.038791+0000","last_fullsized":"2023-07-14T13:09:12.038791+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:53:55.992130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892594+0000","last_change":"2023-07-14T13:09:08.433369+0000","last_active":"2023-07-14T13:09:11.892594+0000","last_peered":"2023-07-14T13:09:11.892594+0000","last_clean":"2023-07-14T13:09:11.892594+0000","last_became_active":"2023-07-14T13:09:08.431724+0000","last_became_peered":"2023-07-14T13:09:08.431724+0000","last_unstale":"2023-07-14T13:09:11.892594+0000","last_undegraded":"2023-07-14T13:09:11.892594+0000","last_fullsized":"2023-07-14T13:09:11.892594+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:12:54.167527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429571+0000","last_change":"2023-07-14T13:09:09.447525+0000","last_active":"2023-07-14T13:09:10.429571+0000","last_peered":"2023-07-14T13:09:10.429571+0000","last_clean":"2023-07-14T13:09:10.429571+0000","last_became_active":"2023-07-14T13:09:09.446162+0000","last_became_peered":"2023-07-14T13:09:09.446162+0000","last_unstale":"2023-07-14T13:09:10.429571+0000","last_undegraded":"2023-07-14T13:09:10.429571+0000","last_fullsized":"2023-07-14T13:09:10.429571+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:22.698260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038225+0000","last_change":"2023-07-14T13:09:08.452152+0000","last_active":"2023-07-14T13:09:12.038225+0000","last_peered":"2023-07-14T13:09:12.038225+0000","last_clean":"2023-07-14T13:09:12.038225+0000","last_became_active":"2023-07-14T13:09:08.451860+0000","last_became_peered":"2023-07-14T13:09:08.451860+0000","last_unstale":"2023-07-14T13:09:12.038225+0000","last_undegraded":"2023-07-14T13:09:12.038225+0000","last_fullsized":"2023-07-14T13:09:12.038225+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:57:05.529700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.037771+0000","last_change":"2023-07-14T13:09:09.456337+0000","last_active":"2023-07-14T13:09:12.037771+0000","last_peered":"2023-07-14T13:09:12.037771+0000","last_clean":"2023-07-14T13:09:12.037771+0000","last_became_active":"2023-07-14T13:09:09.456042+0000","last_became_peered":"2023-07-14T13:09:09.456042+0000","last_unstale":"2023-07-14T13:09:12.037771+0000","last_undegraded":"2023-07-14T13:09:12.037771+0000","last_fullsized":"2023-07-14T13:09:12.037771+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:33:58.283600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038224+0000","last_change":"2023-07-14T13:09:08.449606+0000","last_active":"2023-07-14T13:09:12.038224+0000","last_peered":"2023-07-14T13:09:12.038224+0000","last_clean":"2023-07-14T13:09:12.038224+0000","last_became_active":"2023-07-14T13:09:08.449305+0000","last_became_peered":"2023-07-14T13:09:08.449305+0000","last_unstale":"2023-07-14T13:09:12.038224+0000","last_undegraded":"2023-07-14T13:09:12.038224+0000","last_fullsized":"2023-07-14T13:09:12.038224+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:29:40.407252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034350+0000","last_change":"2023-07-14T13:09:09.453933+0000","last_active":"2023-07-14T13:09:12.034350+0000","last_peered":"2023-07-14T13:09:12.034350+0000","last_clean":"2023-07-14T13:09:12.034350+0000","last_became_active":"2023-07-14T13:09:09.453610+0000","last_became_peered":"2023-07-14T13:09:09.453610+0000","last_unstale":"2023-07-14T13:09:12.034350+0000","last_undegraded":"2023-07-14T13:09:12.034350+0000","last_fullsized":"2023-07-14T13:09:12.034350+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:24:39.457351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"96'3","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892897+0000","last_change":"2023-07-14T13:09:08.437217+0000","last_active":"2023-07-14T13:09:11.892897+0000","last_peered":"2023-07-14T13:09:11.892897+0000","last_clean":"2023-07-14T13:09:11.892897+0000","last_became_active":"2023-07-14T13:09:08.436904+0000","last_became_peered":"2023-07-14T13:09:08.436904+0000","last_unstale":"2023-07-14T13:09:11.892897+0000","last_undegraded":"2023-07-14T13:09:11.892897+0000","last_fullsized":"2023-07-14T13:09:11.892897+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:33:17.679033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034191+0000","last_change":"2023-07-14T13:09:09.449362+0000","last_active":"2023-07-14T13:09:12.034191+0000","last_peered":"2023-07-14T13:09:12.034191+0000","last_clean":"2023-07-14T13:09:12.034191+0000","last_became_active":"2023-07-14T13:09:09.448691+0000","last_became_peered":"2023-07-14T13:09:09.448691+0000","last_unstale":"2023-07-14T13:09:12.034191+0000","last_undegraded":"2023-07-14T13:09:12.034191+0000","last_fullsized":"2023-07-14T13:09:12.034191+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:11:22.058932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"96'6","reported_seq":19,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038823+0000","last_change":"2023-07-14T13:09:08.443531+0000","last_active":"2023-07-14T13:09:12.038823+0000","last_peered":"2023-07-14T13:09:12.038823+0000","last_clean":"2023-07-14T13:09:12.038823+0000","last_became_active":"2023-07-14T13:09:08.443178+0000","last_became_peered":"2023-07-14T13:09:08.443178+0000","last_unstale":"2023-07-14T13:09:12.038823+0000","last_undegraded":"2023-07-14T13:09:12.038823+0000","last_fullsized":"2023-07-14T13:09:12.038823+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:48.688335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038350+0000","last_change":"2023-07-14T13:09:09.460134+0000","last_active":"2023-07-14T13:09:12.038350+0000","last_peered":"2023-07-14T13:09:12.038350+0000","last_clean":"2023-07-14T13:09:12.038350+0000","last_became_active":"2023-07-14T13:09:09.459840+0000","last_became_peered":"2023-07-14T13:09:09.459840+0000","last_unstale":"2023-07-14T13:09:12.038350+0000","last_undegraded":"2023-07-14T13:09:12.038350+0000","last_fullsized":"2023-07-14T13:09:12.038350+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:28:17.313001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"96'2","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.037994+0000","last_change":"2023-07-14T13:09:08.448340+0000","last_active":"2023-07-14T13:09:12.037994+0000","last_peered":"2023-07-14T13:09:12.037994+0000","last_clean":"2023-07-14T13:09:12.037994+0000","last_became_active":"2023-07-14T13:09:08.445388+0000","last_became_peered":"2023-07-14T13:09:08.445388+0000","last_unstale":"2023-07-14T13:09:12.037994+0000","last_undegraded":"2023-07-14T13:09:12.037994+0000","last_fullsized":"2023-07-14T13:09:12.037994+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:53:06.965703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038446+0000","last_change":"2023-07-14T13:09:09.444294+0000","last_active":"2023-07-14T13:09:12.038446+0000","last_peered":"2023-07-14T13:09:12.038446+0000","last_clean":"2023-07-14T13:09:12.038446+0000","last_became_active":"2023-07-14T13:09:09.444012+0000","last_became_peered":"2023-07-14T13:09:09.444012+0000","last_unstale":"2023-07-14T13:09:12.038446+0000","last_undegraded":"2023-07-14T13:09:12.038446+0000","last_fullsized":"2023-07-14T13:09:12.038446+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:01:20.255770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.037671+0000","last_change":"2023-07-14T13:09:08.450436+0000","last_active":"2023-07-14T13:09:12.037671+0000","last_peered":"2023-07-14T13:09:12.037671+0000","last_clean":"2023-07-14T13:09:12.037671+0000","last_became_active":"2023-07-14T13:09:08.449973+0000","last_became_peered":"2023-07-14T13:09:08.449973+0000","last_unstale":"2023-07-14T13:09:12.037671+0000","last_undegraded":"2023-07-14T13:09:12.037671+0000","last_fullsized":"2023-07-14T13:09:12.037671+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:57:10.734307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.039002+0000","last_change":"2023-07-14T13:09:09.445892+0000","last_active":"2023-07-14T13:09:12.039002+0000","last_peered":"2023-07-14T13:09:12.039002+0000","last_clean":"2023-07-14T13:09:12.039002+0000","last_became_active":"2023-07-14T13:09:09.445569+0000","last_became_peered":"2023-07-14T13:09:09.445569+0000","last_unstale":"2023-07-14T13:09:12.039002+0000","last_undegraded":"2023-07-14T13:09:12.039002+0000","last_fullsized":"2023-07-14T13:09:12.039002+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:36:37.000147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892506+0000","last_change":"2023-07-14T13:09:08.443228+0000","last_active":"2023-07-14T13:09:11.892506+0000","last_peered":"2023-07-14T13:09:11.892506+0000","last_clean":"2023-07-14T13:09:11.892506+0000","last_became_active":"2023-07-14T13:09:08.442874+0000","last_became_peered":"2023-07-14T13:09:08.442874+0000","last_unstale":"2023-07-14T13:09:11.892506+0000","last_undegraded":"2023-07-14T13:09:11.892506+0000","last_fullsized":"2023-07-14T13:09:11.892506+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:38:31.212301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038961+0000","last_change":"2023-07-14T13:09:09.460868+0000","last_active":"2023-07-14T13:09:12.038961+0000","last_peered":"2023-07-14T13:09:12.038961+0000","last_clean":"2023-07-14T13:09:12.038961+0000","last_became_active":"2023-07-14T13:09:09.460515+0000","last_became_peered":"2023-07-14T13:09:09.460515+0000","last_unstale":"2023-07-14T13:09:12.038961+0000","last_undegraded":"2023-07-14T13:09:12.038961+0000","last_fullsized":"2023-07-14T13:09:12.038961+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:53:45.973591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"96'8","reported_seq":21,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429919+0000","last_change":"2023-07-14T13:09:08.443086+0000","last_active":"2023-07-14T13:09:10.429919+0000","last_peered":"2023-07-14T13:09:10.429919+0000","last_clean":"2023-07-14T13:09:10.429919+0000","last_became_active":"2023-07-14T13:09:08.442793+0000","last_became_peered":"2023-07-14T13:09:08.442793+0000","last_unstale":"2023-07-14T13:09:10.429919+0000","last_undegraded":"2023-07-14T13:09:10.429919+0000","last_fullsized":"2023-07-14T13:09:10.429919+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:22:53.283592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.433661+0000","last_change":"2023-07-14T13:09:09.444059+0000","last_active":"2023-07-14T13:09:10.433661+0000","last_peered":"2023-07-14T13:09:10.433661+0000","last_clean":"2023-07-14T13:09:10.433661+0000","last_became_active":"2023-07-14T13:09:09.443711+0000","last_became_peered":"2023-07-14T13:09:09.443711+0000","last_unstale":"2023-07-14T13:09:10.433661+0000","last_undegraded":"2023-07-14T13:09:10.433661+0000","last_fullsized":"2023-07-14T13:09:10.433661+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:49.696241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"96'2","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038785+0000","last_change":"2023-07-14T13:09:08.444164+0000","last_active":"2023-07-14T13:09:12.038785+0000","last_peered":"2023-07-14T13:09:12.038785+0000","last_clean":"2023-07-14T13:09:12.038785+0000","last_became_active":"2023-07-14T13:09:08.443877+0000","last_became_peered":"2023-07-14T13:09:08.443877+0000","last_unstale":"2023-07-14T13:09:12.038785+0000","last_undegraded":"2023-07-14T13:09:12.038785+0000","last_fullsized":"2023-07-14T13:09:12.038785+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:20:06.820662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038469+0000","last_change":"2023-07-14T13:09:09.461698+0000","last_active":"2023-07-14T13:09:12.038469+0000","last_peered":"2023-07-14T13:09:12.038469+0000","last_clean":"2023-07-14T13:09:12.038469+0000","last_became_active":"2023-07-14T13:09:09.461050+0000","last_became_peered":"2023-07-14T13:09:09.461050+0000","last_unstale":"2023-07-14T13:09:12.038469+0000","last_undegraded":"2023-07-14T13:09:12.038469+0000","last_fullsized":"2023-07-14T13:09:12.038469+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:14:32.393337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"97'1","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.891853+0000","last_change":"2023-07-14T13:09:08.447067+0000","last_active":"2023-07-14T13:09:11.891853+0000","last_peered":"2023-07-14T13:09:11.891853+0000","last_clean":"2023-07-14T13:09:11.891853+0000","last_became_active":"2023-07-14T13:09:08.446799+0000","last_became_peered":"2023-07-14T13:09:08.446799+0000","last_unstale":"2023-07-14T13:09:11.891853+0000","last_undegraded":"2023-07-14T13:09:11.891853+0000","last_fullsized":"2023-07-14T13:09:11.891853+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:28:21.757335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.433933+0000","last_change":"2023-07-14T13:09:09.460918+0000","last_active":"2023-07-14T13:09:10.433933+0000","last_peered":"2023-07-14T13:09:10.433933+0000","last_clean":"2023-07-14T13:09:10.433933+0000","last_became_active":"2023-07-14T13:09:09.460283+0000","last_became_peered":"2023-07-14T13:09:09.460283+0000","last_unstale":"2023-07-14T13:09:10.433933+0000","last_undegraded":"2023-07-14T13:09:10.433933+0000","last_fullsized":"2023-07-14T13:09:10.433933+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:08:13.538570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038607+0000","last_change":"2023-07-14T13:09:08.450971+0000","last_active":"2023-07-14T13:09:12.038607+0000","last_peered":"2023-07-14T13:09:12.038607+0000","last_clean":"2023-07-14T13:09:12.038607+0000","last_became_active":"2023-07-14T13:09:08.450672+0000","last_became_peered":"2023-07-14T13:09:08.450672+0000","last_unstale":"2023-07-14T13:09:12.038607+0000","last_undegraded":"2023-07-14T13:09:12.038607+0000","last_fullsized":"2023-07-14T13:09:12.038607+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:40:55.399781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429786+0000","last_change":"2023-07-14T13:09:09.445848+0000","last_active":"2023-07-14T13:09:10.429786+0000","last_peered":"2023-07-14T13:09:10.429786+0000","last_clean":"2023-07-14T13:09:10.429786+0000","last_became_active":"2023-07-14T13:09:09.445068+0000","last_became_peered":"2023-07-14T13:09:09.445068+0000","last_unstale":"2023-07-14T13:09:10.429786+0000","last_undegraded":"2023-07-14T13:09:10.429786+0000","last_fullsized":"2023-07-14T13:09:10.429786+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:25:09.202126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038237+0000","last_change":"2023-07-14T13:09:08.452253+0000","last_active":"2023-07-14T13:09:12.038237+0000","last_peered":"2023-07-14T13:09:12.038237+0000","last_clean":"2023-07-14T13:09:12.038237+0000","last_became_active":"2023-07-14T13:09:08.451854+0000","last_became_peered":"2023-07-14T13:09:08.451854+0000","last_unstale":"2023-07-14T13:09:12.038237+0000","last_undegraded":"2023-07-14T13:09:12.038237+0000","last_fullsized":"2023-07-14T13:09:12.038237+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:28:54.151153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038686+0000","last_change":"2023-07-14T13:09:09.460891+0000","last_active":"2023-07-14T13:09:12.038686+0000","last_peered":"2023-07-14T13:09:12.038686+0000","last_clean":"2023-07-14T13:09:12.038686+0000","last_became_active":"2023-07-14T13:09:09.460589+0000","last_became_peered":"2023-07-14T13:09:09.460589+0000","last_unstale":"2023-07-14T13:09:12.038686+0000","last_undegraded":"2023-07-14T13:09:12.038686+0000","last_fullsized":"2023-07-14T13:09:12.038686+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:02:41.323521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.037750+0000","last_change":"2023-07-14T13:09:08.446348+0000","last_active":"2023-07-14T13:09:12.037750+0000","last_peered":"2023-07-14T13:09:12.037750+0000","last_clean":"2023-07-14T13:09:12.037750+0000","last_became_active":"2023-07-14T13:09:08.446025+0000","last_became_peered":"2023-07-14T13:09:08.446025+0000","last_unstale":"2023-07-14T13:09:12.037750+0000","last_undegraded":"2023-07-14T13:09:12.037750+0000","last_fullsized":"2023-07-14T13:09:12.037750+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:30:10.969191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038504+0000","last_change":"2023-07-14T13:09:09.459146+0000","last_active":"2023-07-14T13:09:12.038504+0000","last_peered":"2023-07-14T13:09:12.038504+0000","last_clean":"2023-07-14T13:09:12.038504+0000","last_became_active":"2023-07-14T13:09:09.458807+0000","last_became_peered":"2023-07-14T13:09:09.458807+0000","last_unstale":"2023-07-14T13:09:12.038504+0000","last_undegraded":"2023-07-14T13:09:12.038504+0000","last_fullsized":"2023-07-14T13:09:12.038504+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:02:09.358714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892633+0000","last_change":"2023-07-14T13:09:08.443277+0000","last_active":"2023-07-14T13:09:11.892633+0000","last_peered":"2023-07-14T13:09:11.892633+0000","last_clean":"2023-07-14T13:09:11.892633+0000","last_became_active":"2023-07-14T13:09:08.442915+0000","last_became_peered":"2023-07-14T13:09:08.442915+0000","last_unstale":"2023-07-14T13:09:11.892633+0000","last_undegraded":"2023-07-14T13:09:11.892633+0000","last_fullsized":"2023-07-14T13:09:11.892633+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:48:52.995190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034856+0000","last_change":"2023-07-14T13:09:09.463272+0000","last_active":"2023-07-14T13:09:12.034856+0000","last_peered":"2023-07-14T13:09:12.034856+0000","last_clean":"2023-07-14T13:09:12.034856+0000","last_became_active":"2023-07-14T13:09:09.462912+0000","last_became_peered":"2023-07-14T13:09:09.462912+0000","last_unstale":"2023-07-14T13:09:12.034856+0000","last_undegraded":"2023-07-14T13:09:12.034856+0000","last_fullsized":"2023-07-14T13:09:12.034856+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:28:41.067336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038532+0000","last_change":"2023-07-14T13:09:08.451413+0000","last_active":"2023-07-14T13:09:12.038532+0000","last_peered":"2023-07-14T13:09:12.038532+0000","last_clean":"2023-07-14T13:09:12.038532+0000","last_became_active":"2023-07-14T13:09:08.451115+0000","last_became_peered":"2023-07-14T13:09:08.451115+0000","last_unstale":"2023-07-14T13:09:12.038532+0000","last_undegraded":"2023-07-14T13:09:12.038532+0000","last_fullsized":"2023-07-14T13:09:12.038532+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:09:00.012874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034922+0000","last_change":"2023-07-14T13:09:09.445631+0000","last_active":"2023-07-14T13:09:12.034922+0000","last_peered":"2023-07-14T13:09:12.034922+0000","last_clean":"2023-07-14T13:09:12.034922+0000","last_became_active":"2023-07-14T13:09:09.445366+0000","last_became_peered":"2023-07-14T13:09:09.445366+0000","last_unstale":"2023-07-14T13:09:12.034922+0000","last_undegraded":"2023-07-14T13:09:12.034922+0000","last_fullsized":"2023-07-14T13:09:12.034922+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:47:59.705980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034027+0000","last_change":"2023-07-14T13:09:08.441197+0000","last_active":"2023-07-14T13:09:12.034027+0000","last_peered":"2023-07-14T13:09:12.034027+0000","last_clean":"2023-07-14T13:09:12.034027+0000","last_became_active":"2023-07-14T13:09:08.440996+0000","last_became_peered":"2023-07-14T13:09:08.440996+0000","last_unstale":"2023-07-14T13:09:12.034027+0000","last_undegraded":"2023-07-14T13:09:12.034027+0000","last_fullsized":"2023-07-14T13:09:12.034027+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:08:34.441857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038543+0000","last_change":"2023-07-14T13:09:09.449255+0000","last_active":"2023-07-14T13:09:12.038543+0000","last_peered":"2023-07-14T13:09:12.038543+0000","last_clean":"2023-07-14T13:09:12.038543+0000","last_became_active":"2023-07-14T13:09:09.448962+0000","last_became_peered":"2023-07-14T13:09:09.448962+0000","last_unstale":"2023-07-14T13:09:12.038543+0000","last_undegraded":"2023-07-14T13:09:12.038543+0000","last_fullsized":"2023-07-14T13:09:12.038543+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:54:51.429932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034521+0000","last_change":"2023-07-14T13:09:08.446105+0000","last_active":"2023-07-14T13:09:12.034521+0000","last_peered":"2023-07-14T13:09:12.034521+0000","last_clean":"2023-07-14T13:09:12.034521+0000","last_became_active":"2023-07-14T13:09:08.445697+0000","last_became_peered":"2023-07-14T13:09:08.445697+0000","last_unstale":"2023-07-14T13:09:12.034521+0000","last_undegraded":"2023-07-14T13:09:12.034521+0000","last_fullsized":"2023-07-14T13:09:12.034521+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:00:10.980521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"85'183","reported_seq":547,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038007+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:09:12.038007+0000","last_peered":"2023-07-14T13:09:12.038007+0000","last_clean":"2023-07-14T13:09:12.038007+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:09:12.038007+0000","last_undegraded":"2023-07-14T13:09:12.038007+0000","last_fullsized":"2023-07-14T13:09:12.038007+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:28:27.734850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":156,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038115+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:09:12.038115+0000","last_peered":"2023-07-14T13:09:12.038115+0000","last_clean":"2023-07-14T13:09:12.038115+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:09:12.038115+0000","last_undegraded":"2023-07-14T13:09:12.038115+0000","last_fullsized":"2023-07-14T13:09:12.038115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:19:50.081265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.430147+0000","last_change":"2023-07-14T13:09:09.445181+0000","last_active":"2023-07-14T13:09:10.430147+0000","last_peered":"2023-07-14T13:09:10.430147+0000","last_clean":"2023-07-14T13:09:10.430147+0000","last_became_active":"2023-07-14T13:09:09.439207+0000","last_became_peered":"2023-07-14T13:09:09.439207+0000","last_unstale":"2023-07-14T13:09:10.430147+0000","last_undegraded":"2023-07-14T13:09:10.430147+0000","last_fullsized":"2023-07-14T13:09:10.430147+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:29:51.451099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033893+0000","last_change":"2023-07-14T13:09:08.445355+0000","last_active":"2023-07-14T13:09:12.033893+0000","last_peered":"2023-07-14T13:09:12.033893+0000","last_clean":"2023-07-14T13:09:12.033893+0000","last_became_active":"2023-07-14T13:09:08.445081+0000","last_became_peered":"2023-07-14T13:09:08.445081+0000","last_unstale":"2023-07-14T13:09:12.033893+0000","last_undegraded":"2023-07-14T13:09:12.033893+0000","last_fullsized":"2023-07-14T13:09:12.033893+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:02:41.574353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.037865+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:09:12.037865+0000","last_peered":"2023-07-14T13:09:12.037865+0000","last_clean":"2023-07-14T13:09:12.037865+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:09:12.037865+0000","last_undegraded":"2023-07-14T13:09:12.037865+0000","last_fullsized":"2023-07-14T13:09:12.037865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:42:41.031735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.039067+0000","last_change":"2023-07-14T13:09:09.457487+0000","last_active":"2023-07-14T13:09:12.039067+0000","last_peered":"2023-07-14T13:09:12.039067+0000","last_clean":"2023-07-14T13:09:12.039067+0000","last_became_active":"2023-07-14T13:09:09.456950+0000","last_became_peered":"2023-07-14T13:09:09.456950+0000","last_unstale":"2023-07-14T13:09:12.039067+0000","last_undegraded":"2023-07-14T13:09:12.039067+0000","last_fullsized":"2023-07-14T13:09:12.039067+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:51:34.580731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033787+0000","last_change":"2023-07-14T13:09:08.444592+0000","last_active":"2023-07-14T13:09:12.033787+0000","last_peered":"2023-07-14T13:09:12.033787+0000","last_clean":"2023-07-14T13:09:12.033787+0000","last_became_active":"2023-07-14T13:09:08.444313+0000","last_became_peered":"2023-07-14T13:09:08.444313+0000","last_unstale":"2023-07-14T13:09:12.033787+0000","last_undegraded":"2023-07-14T13:09:12.033787+0000","last_fullsized":"2023-07-14T13:09:12.033787+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:26:10.415790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":151,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892745+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:09:11.892745+0000","last_peered":"2023-07-14T13:09:11.892745+0000","last_clean":"2023-07-14T13:09:11.892745+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:09:11.892745+0000","last_undegraded":"2023-07-14T13:09:11.892745+0000","last_fullsized":"2023-07-14T13:09:11.892745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:50:36.399832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.429987+0000","last_change":"2023-07-14T13:09:09.455678+0000","last_active":"2023-07-14T13:09:10.429987+0000","last_peered":"2023-07-14T13:09:10.429987+0000","last_clean":"2023-07-14T13:09:10.429987+0000","last_became_active":"2023-07-14T13:09:09.455373+0000","last_became_peered":"2023-07-14T13:09:09.455373+0000","last_unstale":"2023-07-14T13:09:10.429987+0000","last_undegraded":"2023-07-14T13:09:10.429987+0000","last_fullsized":"2023-07-14T13:09:10.429987+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:46:27.362227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"96'2","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034498+0000","last_change":"2023-07-14T13:09:08.441285+0000","last_active":"2023-07-14T13:09:12.034498+0000","last_peered":"2023-07-14T13:09:12.034498+0000","last_clean":"2023-07-14T13:09:12.034498+0000","last_became_active":"2023-07-14T13:09:08.440995+0000","last_became_peered":"2023-07-14T13:09:08.440995+0000","last_unstale":"2023-07-14T13:09:12.034498+0000","last_undegraded":"2023-07-14T13:09:12.034498+0000","last_fullsized":"2023-07-14T13:09:12.034498+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:52:51.529066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":157,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038043+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:09:12.038043+0000","last_peered":"2023-07-14T13:09:12.038043+0000","last_clean":"2023-07-14T13:09:12.038043+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:09:12.038043+0000","last_undegraded":"2023-07-14T13:09:12.038043+0000","last_fullsized":"2023-07-14T13:09:12.038043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:50:29.202192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892570+0000","last_change":"2023-07-14T13:09:09.448817+0000","last_active":"2023-07-14T13:09:11.892570+0000","last_peered":"2023-07-14T13:09:11.892570+0000","last_clean":"2023-07-14T13:09:11.892570+0000","last_became_active":"2023-07-14T13:09:09.448520+0000","last_became_peered":"2023-07-14T13:09:09.448520+0000","last_unstale":"2023-07-14T13:09:11.892570+0000","last_undegraded":"2023-07-14T13:09:11.892570+0000","last_fullsized":"2023-07-14T13:09:11.892570+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:53:13.224188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"96'1","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892913+0000","last_change":"2023-07-14T13:09:08.440049+0000","last_active":"2023-07-14T13:09:11.892913+0000","last_peered":"2023-07-14T13:09:11.892913+0000","last_clean":"2023-07-14T13:09:11.892913+0000","last_became_active":"2023-07-14T13:09:08.439676+0000","last_became_peered":"2023-07-14T13:09:08.439676+0000","last_unstale":"2023-07-14T13:09:11.892913+0000","last_undegraded":"2023-07-14T13:09:11.892913+0000","last_fullsized":"2023-07-14T13:09:11.892913+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:14:18.335021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":164,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034634+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:09:12.034634+0000","last_peered":"2023-07-14T13:09:12.034634+0000","last_clean":"2023-07-14T13:09:12.034634+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:09:12.034634+0000","last_undegraded":"2023-07-14T13:09:12.034634+0000","last_fullsized":"2023-07-14T13:09:12.034634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:07:38.092074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034347+0000","last_change":"2023-07-14T13:09:09.453843+0000","last_active":"2023-07-14T13:09:12.034347+0000","last_peered":"2023-07-14T13:09:12.034347+0000","last_clean":"2023-07-14T13:09:12.034347+0000","last_became_active":"2023-07-14T13:09:09.453556+0000","last_became_peered":"2023-07-14T13:09:09.453556+0000","last_unstale":"2023-07-14T13:09:12.034347+0000","last_undegraded":"2023-07-14T13:09:12.034347+0000","last_fullsized":"2023-07-14T13:09:12.034347+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:46:26.111226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034192+0000","last_change":"2023-07-14T13:09:08.448203+0000","last_active":"2023-07-14T13:09:12.034192+0000","last_peered":"2023-07-14T13:09:12.034192+0000","last_clean":"2023-07-14T13:09:12.034192+0000","last_became_active":"2023-07-14T13:09:08.447855+0000","last_became_peered":"2023-07-14T13:09:08.447855+0000","last_unstale":"2023-07-14T13:09:12.034192+0000","last_undegraded":"2023-07-14T13:09:12.034192+0000","last_fullsized":"2023-07-14T13:09:12.034192+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:41:24.859927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":156,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038634+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:09:12.038634+0000","last_peered":"2023-07-14T13:09:12.038634+0000","last_clean":"2023-07-14T13:09:12.038634+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:09:12.038634+0000","last_undegraded":"2023-07-14T13:09:12.038634+0000","last_fullsized":"2023-07-14T13:09:12.038634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:06:32.006164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.033787+0000","last_change":"2023-07-14T13:09:09.468504+0000","last_active":"2023-07-14T13:09:12.033787+0000","last_peered":"2023-07-14T13:09:12.033787+0000","last_clean":"2023-07-14T13:09:12.033787+0000","last_became_active":"2023-07-14T13:09:09.468224+0000","last_became_peered":"2023-07-14T13:09:09.468224+0000","last_unstale":"2023-07-14T13:09:12.033787+0000","last_undegraded":"2023-07-14T13:09:12.033787+0000","last_fullsized":"2023-07-14T13:09:12.033787+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:15:08.881840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"96'1","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.038386+0000","last_change":"2023-07-14T13:09:08.449416+0000","last_active":"2023-07-14T13:09:12.038386+0000","last_peered":"2023-07-14T13:09:12.038386+0000","last_clean":"2023-07-14T13:09:12.038386+0000","last_became_active":"2023-07-14T13:09:08.449100+0000","last_became_peered":"2023-07-14T13:09:08.449100+0000","last_unstale":"2023-07-14T13:09:12.038386+0000","last_undegraded":"2023-07-14T13:09:12.038386+0000","last_fullsized":"2023-07-14T13:09:12.038386+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:52:59.486243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":164,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.034886+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:09:12.034886+0000","last_peered":"2023-07-14T13:09:12.034886+0000","last_clean":"2023-07-14T13:09:12.034886+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:09:12.034886+0000","last_undegraded":"2023-07-14T13:09:12.034886+0000","last_fullsized":"2023-07-14T13:09:12.034886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:23:14.929289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:11.892460+0000","last_change":"2023-07-14T13:09:09.455863+0000","last_active":"2023-07-14T13:09:11.892460+0000","last_peered":"2023-07-14T13:09:11.892460+0000","last_clean":"2023-07-14T13:09:11.892460+0000","last_became_active":"2023-07-14T13:09:09.455594+0000","last_became_peered":"2023-07-14T13:09:09.455594+0000","last_unstale":"2023-07-14T13:09:11.892460+0000","last_undegraded":"2023-07-14T13:09:11.892460+0000","last_fullsized":"2023-07-14T13:09:11.892460+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:08.414277+0000","last_clean_scrub_stamp":"2023-07-14T13:09:08.414277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:01.249886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"96'2","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:10.434398+0000","last_change":"2023-07-14T13:09:08.440769+0000","last_active":"2023-07-14T13:09:10.434398+0000","last_peered":"2023-07-14T13:09:10.434398+0000","last_clean":"2023-07-14T13:09:10.434398+0000","last_became_active":"2023-07-14T13:09:08.439981+0000","last_became_peered":"2023-07-14T13:09:08.439981+0000","last_unstale":"2023-07-14T13:09:10.434398+0000","last_undegraded":"2023-07-14T13:09:10.434398+0000","last_fullsized":"2023-07-14T13:09:10.434398+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:07.406370+0000","last_clean_scrub_stamp":"2023-07-14T13:09:07.406370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:57:56.918317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":154,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-14T13:09:12.039055+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:09:12.039055+0000","last_peered":"2023-07-14T13:09:12.039055+0000","last_clean":"2023-07-14T13:09:12.039055+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:09:12.039055+0000","last_undegraded":"2023-07-14T13:09:12.039055+0000","last_fullsized":"2023-07-14T13:09:12.039055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:51:45.137826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575048,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54932,"kb_used_data":1740,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316908,"statfs":{"total":96636764160,"available":96580513792,"internally_reserved":0,"allocated":1781760,"data_stored":1185265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.70299999999999996,"15min":0.71699999999999997},"min":{"1min":0.46300000000000002,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.79700000000000004}]},{"osd":1,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72099999999999997,"15min":0.73699999999999999},"min":{"1min":0.47199999999999998,"5min":0.434,"15min":0.434},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72499999999999998,"15min":0.745},"min":{"1min":0.436,"5min":0.436,"15min":0.40500000000000003},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.73999999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.72999999999999998},"min":{"1min":0.51900000000000002,"5min":0.46999999999999997,"15min":0.42699999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72499999999999998,"15min":0.75},"min":{"1min":0.47999999999999998,"5min":0.47199999999999998,"15min":0.46899999999999997},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.78000000000000003}]},{"osd":3,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72499999999999998,"15min":0.73599999999999999},"min":{"1min":0.57999999999999996,"5min":0.503,"15min":0.46400000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72999999999999998,"15min":0.75600000000000001},"min":{"1min":0.47899999999999998,"5min":0.47299999999999998,"15min":0.41499999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.71999999999999997}]},{"osd":4,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55400000000000005,"15min":0.58099999999999996},"min":{"1min":0.44,"5min":0.318,"15min":0.318},"max":{"1min":0.74299999999999999,"5min":0.86299999999999999,"15min":1.022},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58899999999999997,"15min":0.60299999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.39300000000000002},"max":{"1min":0.84399999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.48999999999999999}]},{"osd":5,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98299999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.628,"15min":0.65300000000000002},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82899999999999996,"5min":1.028,"15min":1.028},"last":0.65000000000000002}]},{"osd":6,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.67300000000000004,"15min":0.69599999999999995},"min":{"1min":0.499,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89800000000000002,"5min":0.99299999999999999,"15min":1.0600000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64100000000000001,"15min":0.66900000000000004},"min":{"1min":0.46200000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81399999999999995,"5min":0.95799999999999996,"15min":1.04},"last":0.54100000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575049,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1196032,"data_stored":596439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.48399999999999999,"5min":0.39500000000000002,"15min":0.38},"max":{"1min":0.874,"5min":0.96499999999999997,"15min":1.05},"last":0.751},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.71299999999999997,"15min":0.73699999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.47399999999999998},"max":{"1min":0.86499999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.72899999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71699999999999997,"15min":0.745},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.379},"max":{"1min":0.81499999999999995,"5min":0.97199999999999998,"15min":1.0209999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69699999999999995,"15min":0.72299999999999998},"min":{"1min":0.55900000000000005,"5min":0.46999999999999997,"15min":0.44},"max":{"1min":0.85199999999999998,"5min":0.97099999999999997,"15min":1.077},"last":0.64500000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73899999999999999,"15min":0.752},"min":{"1min":0.55500000000000005,"5min":0.45900000000000002,"15min":0.40400000000000003},"max":{"1min":0.89700000000000002,"5min":0.95099999999999996,"15min":1.105},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.73599999999999999,"15min":0.751},"min":{"1min":0.441,"5min":0.441,"15min":0.42299999999999999},"max":{"1min":0.89500000000000002,"5min":0.99099999999999999,"15min":1.0900000000000001},"last":0.69199999999999995}]},{"osd":3,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.748,"15min":0.77500000000000002},"min":{"1min":0.46000000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.93999999999999995,"5min":1.054,"15min":1.1359999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74199999999999999,"15min":0.76300000000000001},"min":{"1min":0.50900000000000001,"5min":0.48399999999999999,"15min":0.45900000000000002},"max":{"1min":0.94599999999999995,"5min":0.99099999999999999,"15min":1.1080000000000001},"last":0.67700000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56399999999999995,"15min":0.57299999999999995},"min":{"1min":0.39900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.83299999999999996,"5min":0.89900000000000002,"15min":0.97899999999999998},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.439,"5min":0.38500000000000001,"15min":0.36099999999999999},"max":{"1min":0.87,"5min":1.012,"15min":1.0780000000000001},"last":0.623}]},{"osd":5,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.48699999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.88100000000000001,"5min":1.579,"15min":1.579},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67900000000000005,"15min":0.68999999999999995},"min":{"1min":0.46300000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90100000000000002,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.79800000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64400000000000002,"15min":0.65700000000000003},"min":{"1min":0.44700000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86399999999999999,"5min":1.0940000000000001,"15min":1.1200000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69599999999999995,"15min":0.70799999999999996},"min":{"1min":0.53400000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.92400000000000004,"5min":1.657,"15min":1.657},"last":0.84999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575048,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1160,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1187840,"data_stored":594909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.70799999999999996,"15min":0.73099999999999998},"min":{"1min":0.376,"5min":0.36499999999999999,"15min":0.32400000000000001},"max":{"1min":0.91500000000000004,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68799999999999994,"15min":0.73299999999999998},"min":{"1min":0.41699999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.86099999999999999,"5min":1.083,"15min":1.083},"last":0.85699999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69899999999999995,"15min":0.72699999999999998},"min":{"1min":0.46899999999999997,"5min":0.44500000000000001,"15min":0.41099999999999998},"max":{"1min":0.85199999999999998,"5min":1.05,"15min":1.079},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73299999999999998,"15min":0.747},"min":{"1min":0.48999999999999999,"5min":0.48699999999999999,"15min":0.36799999999999999},"max":{"1min":0.94599999999999995,"5min":2.706,"15min":2.706},"last":0.91900000000000004}]},{"osd":2,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71299999999999997,"15min":0.73899999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86299999999999999,"5min":1.212,"15min":1.212},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.70499999999999996,"15min":0.73499999999999999},"min":{"1min":0.44800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89200000000000002,"5min":1.181,"15min":1.181},"last":0.80100000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73299999999999998,"15min":0.748},"min":{"1min":0.48599999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.876,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72799999999999998,"15min":0.76000000000000001},"min":{"1min":0.47299999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90800000000000003,"5min":1.304,"15min":1.304},"last":0.78400000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64000000000000001,"15min":0.629},"min":{"1min":0.437,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.85399999999999998,"5min":1.129,"15min":1.129},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.39900000000000002,"5min":0.36299999999999999,"15min":0.35899999999999999},"max":{"1min":0.84499999999999997,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.83199999999999996}]},{"osd":6,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.60399999999999998,"15min":0.61399999999999999},"min":{"1min":0.41999999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90200000000000002,"5min":1.169,"15min":1.169},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.64400000000000002,"15min":0.64100000000000001},"min":{"1min":0.39400000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.83699999999999997,"5min":1.238,"15min":1.238},"last":0.68999999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66100000000000003,"15min":0.64300000000000002},"min":{"1min":0.45500000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93300000000000005,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68200000000000005,"15min":0.67800000000000005},"min":{"1min":0.48999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90100000000000002,"5min":1.407,"15min":1.407},"last":0.63900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575048,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1204224,"data_stored":596543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.70899999999999996,"15min":0.72999999999999998},"min":{"1min":0.36899999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.90800000000000003,"5min":1.0129999999999999,"15min":1.411},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.435},"max":{"1min":0.85199999999999998,"5min":1.0640000000000001,"15min":1.1200000000000001},"last":0.85099999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.748,"15min":0.749},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92500000000000004,"5min":0.94699999999999995,"15min":1.077},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70999999999999996,"15min":0.73599999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89600000000000002,"5min":0.96399999999999997,"15min":1.0469999999999999},"last":0.68400000000000005}]},{"osd":2,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.51800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91000000000000003,"5min":0.96499999999999997,"15min":1.091},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.76900000000000002,"15min":0.77400000000000002},"min":{"1min":0.46400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98099999999999998,"5min":1.0649999999999999,"15min":1.387},"last":0.73599999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.72999999999999998,"15min":0.746},"min":{"1min":0.53200000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.94699999999999995,"5min":0.997,"15min":1.008},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.75800000000000001,"15min":0.77100000000000002},"min":{"1min":0.504,"5min":0.496,"15min":0.46800000000000003},"max":{"1min":0.875,"5min":1.024,"15min":1.0589999999999999},"last":0.752}]},{"osd":5,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61899999999999999,"15min":0.60499999999999998},"min":{"1min":0.49299999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.85299999999999998,"5min":0.95599999999999996,"15min":1.0029999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63300000000000001,"15min":0.61799999999999999},"min":{"1min":0.45900000000000002,"5min":0.41399999999999998,"15min":0.34599999999999997},"max":{"1min":0.93200000000000005,"5min":0.93600000000000005,"15min":0.95199999999999996},"last":0.77000000000000002}]},{"osd":6,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.32300000000000001},"max":{"1min":0.96999999999999997,"5min":1.014,"15min":1.014},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68300000000000005,"15min":0.66900000000000004},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.374},"max":{"1min":0.86899999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.88200000000000001}]},{"osd":7,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68899999999999995,"15min":0.66900000000000004},"min":{"1min":0.503,"5min":0.46000000000000002,"15min":0.39000000000000001},"max":{"1min":0.89400000000000002,"5min":0.94699999999999995,"15min":1.0349999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70999999999999996,"15min":0.69499999999999995},"min":{"1min":0.42799999999999999,"5min":0.40300000000000002,"15min":0.36899999999999999},"max":{"1min":0.91800000000000004,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.71499999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575048,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36304,"kb_used_data":1160,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335536,"statfs":{"total":96636764160,"available":96599588864,"internally_reserved":0,"allocated":1187840,"data_stored":595457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.26200000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.84199999999999997},"last":0.379},{"interface":"front","average":{"1min":0.436,"5min":0.498,"15min":0.51500000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.60799999999999998,"5min":0.77300000000000002,"15min":1.0209999999999999},"last":0.47499999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47199999999999998,"15min":0.47499999999999998},"min":{"1min":0.33100000000000002,"5min":0.315,"15min":0.29599999999999999},"max":{"1min":0.63900000000000001,"5min":0.77200000000000002,"15min":0.79600000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67800000000000005,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.42999999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54100000000000004,"15min":0.56999999999999995},"min":{"1min":0.38200000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.72399999999999998,"5min":0.82599999999999996,"15min":0.95899999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60699999999999998,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86599999999999999,"5min":1.663,"15min":1.663},"last":0.68600000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.748,"15min":0.76500000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":0.90900000000000003,"5min":1.284,"15min":1.284},"last":0.623},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76800000000000002,"15min":0.78900000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.47699999999999998},"max":{"1min":1.0660000000000001,"5min":1.121,"15min":1.196},"last":0.55300000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.52400000000000002},"max":{"1min":1.0229999999999999,"5min":1.306,"15min":1.306},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77900000000000003,"15min":0.79100000000000004},"min":{"1min":0.58099999999999996,"5min":0.372,"15min":0.372},"max":{"1min":0.97399999999999998,"5min":1.1870000000000001,"15min":1.2470000000000001},"last":0.77800000000000002}]},{"osd":6,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.76800000000000002,"15min":0.78000000000000003},"min":{"1min":0.50600000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96599999999999997,"5min":1.105,"15min":1.117},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.79700000000000004,"15min":0.81799999999999995},"min":{"1min":0.56299999999999994,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.93999999999999995,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.71299999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.83299999999999996,"15min":0.84099999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53100000000000003},"max":{"1min":0.89900000000000002,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.746},{"interface":"front","average":{"1min":0.752,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.53500000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0009999999999999,"5min":1.595,"15min":1.595},"last":0.67300000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575048,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58452,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313388,"statfs":{"total":96636764160,"available":96576909312,"internally_reserved":0,"allocated":1191936,"data_stored":594598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45900000000000002,"15min":0.46800000000000003},"min":{"1min":0.29199999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.84699999999999998,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.439},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.54200000000000004,"15min":0.53300000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.70799999999999996,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.48299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30399999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65500000000000003,"5min":2.7200000000000002,"15min":2.7200000000000002},"last":0.37},{"interface":"front","average":{"1min":0.499,"5min":0.55000000000000004,"15min":0.56299999999999994},"min":{"1min":0.36299999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78300000000000003,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":0.45900000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.64500000000000002,"15min":0.60399999999999998},"min":{"1min":0.39500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71699999999999997,"5min":8.2530000000000001,"15min":8.2530000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89600000000000002,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.502}]},{"osd":4,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.754,"15min":0.78100000000000003},"min":{"1min":0.53200000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.99399999999999999,"5min":1.0940000000000001,"15min":1.1499999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.56699999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0629999999999999,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.63600000000000001}]},{"osd":5,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.84399999999999997,"15min":0.85799999999999998},"min":{"1min":0.58599999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1319999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82499999999999996,"15min":0.83999999999999997},"min":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.433},"max":{"1min":1.153,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.66100000000000003}]},{"osd":6,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.78700000000000003,"15min":0.80400000000000005},"min":{"1min":0.57299999999999995,"5min":0.48999999999999999,"15min":0.47599999999999998},"max":{"1min":0.93999999999999995,"5min":3.9849999999999999,"15min":3.9849999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80200000000000005,"15min":0.81299999999999994},"min":{"1min":0.60699999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0289999999999999,"5min":3.391,"15min":3.391},"last":0.58499999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.79600000000000004,"15min":0.82199999999999995},"min":{"1min":0.55000000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.1759999999999999,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.81499999999999995,"15min":0.82299999999999995},"min":{"1min":0.60199999999999998,"5min":0.53200000000000003,"15min":0.50900000000000001},"max":{"1min":1.0940000000000001,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.621}]}]},{"osd":1,"up_from":13,"seq":55834575049,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":1191936,"data_stored":594987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.29199999999999998,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.53700000000000003,"5min":0.65400000000000003,"15min":0.77200000000000002},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.28199999999999997,"15min":0.26500000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.38500000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47199999999999998,"15min":0.47299999999999998},"min":{"1min":0.34300000000000003,"5min":0.32100000000000001,"15min":0.29499999999999998},"max":{"1min":0.54200000000000004,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65100000000000002,"5min":1.014,"15min":1.014},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.621,"15min":0.63600000000000001},"min":{"1min":0.48199999999999998,"5min":0.44700000000000001,"15min":0.437},"max":{"1min":0.73899999999999999,"5min":0.80500000000000005,"15min":0.96299999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56499999999999995,"15min":0.57999999999999996},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.498}]},{"osd":4,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77700000000000002,"15min":0.78400000000000003},"min":{"1min":0.55500000000000005,"5min":0.51600000000000001,"15min":0.40000000000000002},"max":{"1min":1.0409999999999999,"5min":1.2110000000000001,"15min":1.236},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77200000000000002,"15min":0.78600000000000003},"min":{"1min":0.57499999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.0309999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.83099999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.60799999999999998,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.55800000000000005,"5min":0.48599999999999999,"15min":0.48199999999999998},"max":{"1min":1.0940000000000001,"5min":1.2749999999999999,"15min":1.3600000000000001},"last":0.84399999999999997}]},{"osd":6,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.53800000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1.0580000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.80500000000000005,"15min":0.81399999999999995},"min":{"1min":0.56100000000000005,"5min":0.52200000000000002,"15min":0.49199999999999999},"max":{"1min":1.1319999999999999,"5min":1.262,"15min":1.2969999999999999},"last":0.92000000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.47799999999999998},"max":{"1min":1.1479999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.82099999999999995,"15min":0.84099999999999997},"min":{"1min":0.58499999999999996,"5min":0.53700000000000003,"15min":0.52800000000000002},"max":{"1min":1.2070000000000001,"5min":1.327,"15min":1.327},"last":0.88800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575050,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36876,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334964,"statfs":{"total":96636764160,"available":96599003136,"internally_reserved":0,"allocated":1773568,"data_stored":1184224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.45600000000000002,"15min":0.44700000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.61199999999999999,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.49099999999999999,"15min":0.51500000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.27700000000000002},"max":{"1min":0.61799999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.36599999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.51900000000000002,"15min":0.51100000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69699999999999995,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.54000000000000004,"15min":0.55300000000000005},"min":{"1min":0.39800000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63800000000000001,"5min":0.80300000000000005,"15min":0.90300000000000002},"last":0.441}]},{"osd":3,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.504},"min":{"1min":0.36399999999999999,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.67600000000000005,"5min":0.72999999999999998,"15min":0.84999999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82899999999999996,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76900000000000002,"15min":0.78800000000000003},"min":{"1min":0.56100000000000005,"5min":0.48399999999999999,"15min":0.44400000000000001},"max":{"1min":0.90500000000000003,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.878},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.53500000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.038,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.91700000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.77100000000000002,"15min":0.80600000000000005},"min":{"1min":0.55100000000000005,"5min":0.51800000000000002,"15min":0.47899999999999998},"max":{"1min":0.80500000000000005,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.56399999999999995,"5min":0.49299999999999999,"15min":0.47299999999999998},"max":{"1min":0.97299999999999998,"5min":1.325,"15min":1.325},"last":0.93999999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.79100000000000004,"15min":0.80600000000000005},"min":{"1min":0.53500000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91400000000000003,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78900000000000003,"15min":0.81499999999999995},"min":{"1min":0.58399999999999996,"5min":0.55500000000000005,"15min":0.41299999999999998},"max":{"1min":1.0900000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.98099999999999998}]},{"osd":7,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.79800000000000004,"15min":0.83199999999999996},"min":{"1min":0.57699999999999996,"5min":0.503,"15min":0.45500000000000002},"max":{"1min":0.93799999999999994,"5min":1.171,"15min":1.2749999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.77100000000000002,"15min":0.81100000000000005},"min":{"1min":0.50600000000000001,"5min":0.502,"15min":0.497},"max":{"1min":0.95199999999999996,"5min":1.381,"15min":1.381},"last":0.77300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:09:18.523 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-14T13:09:18.524 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-14T13:09:18.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.683+0000 7fa899967640 1 Processor -- start 2023-07-14T13:09:18.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.683+0000 7fa899967640 1 -- start start 2023-07-14T13:09:18.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.683+0000 7fa899967640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa8940cd490 0x7fa8940c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:18.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.687+0000 7fa899967640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8940cc900 con 0x7fa8940cb360 2023-07-14T13:09:18.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.687+0000 7fa899967640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8940ccbe0 con 0x7fa8940b38d0 2023-07-14T13:09:18.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.687+0000 7fa899967640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa89415d780 con 0x7fa8940cd490 2023-07-14T13:09:18.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.687+0000 7fa8937fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa8940cd490 0x7fa8940c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:18.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.687+0000 7fa8937fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa8940cd490 0x7fa8940c9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38074/0 (socket says 172.21.15.5:38074) 2023-07-14T13:09:18.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.687+0000 7fa8937fe640 1 -- 172.21.15.5:0/3814752087 learned_addr learned my addr 172.21.15.5:0/3814752087 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:18.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.687+0000 7fa892ffd640 1 --1- 172.21.15.5:0/3814752087 >> v1:172.21.15.5:6789/0 conn(0x7fa8940cb360 0x7fa89415df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:40306/0 (socket says 172.21.15.5:40306) 2023-07-14T13:09:18.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.687+0000 7fa8937fe640 1 -- 172.21.15.5:0/3814752087 >> v1:172.21.15.154:6789/0 conn(0x7fa8940b38d0 legacy=0x7fa894070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:18.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.687+0000 7fa8937fe640 1 -- 172.21.15.5:0/3814752087 >> v1:172.21.15.5:6789/0 conn(0x7fa8940cb360 legacy=0x7fa89415df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:18.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.687+0000 7fa8937fe640 1 -- 172.21.15.5:0/3814752087 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89415da60 con 0x7fa8940cd490 2023-07-14T13:09:18.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.687+0000 7fa8927fc640 1 -- 172.21.15.5:0/3814752087 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2074840359 0 0) 0x7fa8940cc900 con 0x7fa8940cb360 2023-07-14T13:09:18.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.687+0000 7fa8937fe640 1 --2- 172.21.15.5:0/3814752087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8940cd490 0x7fa8940c9d10 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009e50 tx=0x7fa88c01c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a39d917eed0c7f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:18.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.687+0000 7fa8927fc640 1 -- 172.21.15.5:0/3814752087 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c0a4a80 con 0x7fa8940cd490 2023-07-14T13:09:18.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.687+0000 7fa8927fc640 1 -- 172.21.15.5:0/3814752087 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88c0a4be0 con 0x7fa8940cd490 2023-07-14T13:09:18.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.687+0000 7fa8927fc640 1 -- 172.21.15.5:0/3814752087 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c0ac3f0 con 0x7fa8940cd490 2023-07-14T13:09:18.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.691+0000 7fa899967640 1 -- 172.21.15.5:0/3814752087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8940cd490 msgr2=0x7fa8940c9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:18.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.691+0000 7fa899967640 1 --2- 172.21.15.5:0/3814752087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8940cd490 0x7fa8940c9d10 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009e50 tx=0x7fa88c01c590 comp rx=0 tx=0).stop 2023-07-14T13:09:18.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.691+0000 7fa899967640 1 -- 172.21.15.5:0/3814752087 shutdown_connections 2023-07-14T13:09:18.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.691+0000 7fa899967640 1 --2- 172.21.15.5:0/3814752087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8940cd490 0x7fa8940c9d10 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:18.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.691+0000 7fa899967640 1 -- 172.21.15.5:0/3814752087 >> 172.21.15.5:0/3814752087 conn(0x7fa8940afac0 msgr2=0x7fa8940afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:18.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.691+0000 7fa899967640 1 -- 172.21.15.5:0/3814752087 shutdown_connections 2023-07-14T13:09:18.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.691+0000 7fa899967640 1 -- 172.21.15.5:0/3814752087 wait complete. 2023-07-14T13:09:18.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.691+0000 7fa899967640 1 Processor -- start 2023-07-14T13:09:18.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.691+0000 7fa899967640 1 -- start start 2023-07-14T13:09:18.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.691+0000 7fa899967640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8940b38d0 0x7fa8940c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:18.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.691+0000 7fa899967640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8940cb360 0x7fa894152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:18.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.691+0000 7fa899967640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8940cd490 0x7fa89415a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:18.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.691+0000 7fa899967640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa894152790 con 0x7fa8940cd490 2023-07-14T13:09:18.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.691+0000 7fa899967640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8940c4740 con 0x7fa8940b38d0 2023-07-14T13:09:18.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.691+0000 7fa899967640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89415ac90 con 0x7fa8940cb360 2023-07-14T13:09:18.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.691+0000 7fa8937fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8940cd490 0x7fa89415a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:18.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.691+0000 7fa8937fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8940cd490 0x7fa89415a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38088/0 (socket says 172.21.15.5:38088) 2023-07-14T13:09:18.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.691+0000 7fa8937fe640 1 -- 172.21.15.5:0/3226751316 learned_addr learned my addr 172.21.15.5:0/3226751316 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:18.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.691+0000 7fa892ffd640 1 --2- 172.21.15.5:0/3226751316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8940b38d0 0x7fa8940c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:18.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.691+0000 7fa88bfff640 1 --2- 172.21.15.5:0/3226751316 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8940cb360 0x7fa894152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:18.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.691+0000 7fa8937fe640 1 -- 172.21.15.5:0/3226751316 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8940cb360 msgr2=0x7fa894152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:18.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.691+0000 7fa8937fe640 1 --2- 172.21.15.5:0/3226751316 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8940cb360 0x7fa894152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:18.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.691+0000 7fa8937fe640 1 -- 172.21.15.5:0/3226751316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8940b38d0 msgr2=0x7fa8940c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:18.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.691+0000 7fa8937fe640 1 --2- 172.21.15.5:0/3226751316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8940b38d0 0x7fa8940c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:18.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.691+0000 7fa8937fe640 1 -- 172.21.15.5:0/3226751316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c009b30 con 0x7fa8940cd490 2023-07-14T13:09:18.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.695+0000 7fa8937fe640 1 --2- 172.21.15.5:0/3226751316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8940cd490 0x7fa89415a750 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0ae040 tx=0x7fa88c019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:18.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.695+0000 7fa890ff9640 1 -- 172.21.15.5:0/3226751316 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c0b7670 con 0x7fa8940cd490 2023-07-14T13:09:18.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.695+0000 7fa890ff9640 1 -- 172.21.15.5:0/3226751316 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88c0b77d0 con 0x7fa8940cd490 2023-07-14T13:09:18.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.695+0000 7fa890ff9640 1 -- 172.21.15.5:0/3226751316 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c0b7b80 con 0x7fa8940cd490 2023-07-14T13:09:18.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.695+0000 7fa899967640 1 -- 172.21.15.5:0/3226751316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8941533d0 con 0x7fa8940cd490 2023-07-14T13:09:18.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.695+0000 7fa899967640 1 -- 172.21.15.5:0/3226751316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa894152d80 con 0x7fa8940cd490 2023-07-14T13:09:18.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.695+0000 7fa899967640 1 -- 172.21.15.5:0/3226751316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa894153560 con 0x7fa8940cd490 2023-07-14T13:09:18.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.695+0000 7fa890ff9640 1 -- 172.21.15.5:0/3226751316 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa88c0a4d50 con 0x7fa8940cd490 2023-07-14T13:09:18.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.695+0000 7fa890ff9640 1 --2- 172.21.15.5:0/3226751316 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fa8740663a0 0x7fa874068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:18.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.695+0000 7fa890ff9640 1 -- 172.21.15.5:0/3226751316 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa88c11e8e0 con 0x7fa8940cd490 2023-07-14T13:09:18.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.699+0000 7fa892ffd640 1 --2- 172.21.15.5:0/3226751316 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fa8740663a0 0x7fa874068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:18.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.699+0000 7fa892ffd640 1 --2- 172.21.15.5:0/3226751316 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fa8740663a0 0x7fa874068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa884000f70 tx=0x7fa884007df0 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:18.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.699+0000 7fa890ff9640 1 -- 172.21.15.5:0/3226751316 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa88c0ebd20 con 0x7fa8940cd490 2023-07-14T13:09:18.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.907+0000 7fa899967640 1 -- 172.21.15.5:0/3226751316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa8940678d0 con 0x7fa8940cd490 2023-07-14T13:09:18.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.915+0000 7fa890ff9640 1 -- 172.21.15.5:0/3226751316 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7fa88c0bb0b0 con 0x7fa8940cd490 2023-07-14T13:09:18.944 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-07-14T13:09:18.945 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDkRLFkCav/DhAA6SOiONAbTcWCnUZXcm7BcQ== 2023-07-14T13:09:18.945 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2023-07-14T13:09:18.945 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2023-07-14T13:09:18.945 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-14T13:09:18.945 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2023-07-14T13:09:18.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.915+0000 7fa899967640 1 -- 172.21.15.5:0/3226751316 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fa8740663a0 msgr2=0x7fa874068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:18.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.915+0000 7fa899967640 1 --2- 172.21.15.5:0/3226751316 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fa8740663a0 0x7fa874068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa884000f70 tx=0x7fa884007df0 comp rx=0 tx=0).stop 2023-07-14T13:09:18.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.915+0000 7fa899967640 1 -- 172.21.15.5:0/3226751316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8940cd490 msgr2=0x7fa89415a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:18.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.915+0000 7fa899967640 1 --2- 172.21.15.5:0/3226751316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8940cd490 0x7fa89415a750 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0ae040 tx=0x7fa88c019650 comp rx=0 tx=0).stop 2023-07-14T13:09:18.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.915+0000 7fa899967640 1 -- 172.21.15.5:0/3226751316 shutdown_connections 2023-07-14T13:09:18.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.915+0000 7fa899967640 1 --2- 172.21.15.5:0/3226751316 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fa8740663a0 0x7fa874068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:18.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.915+0000 7fa899967640 1 --2- 172.21.15.5:0/3226751316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8940cd490 0x7fa89415a750 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:18.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.915+0000 7fa899967640 1 --2- 172.21.15.5:0/3226751316 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8940cb360 0x7fa894152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:18.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.915+0000 7fa899967640 1 --2- 172.21.15.5:0/3226751316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8940b38d0 0x7fa8940c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:18.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.915+0000 7fa899967640 1 -- 172.21.15.5:0/3226751316 >> 172.21.15.5:0/3226751316 conn(0x7fa8940afac0 msgr2=0x7fa8940c9430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:18.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.915+0000 7fa899967640 1 -- 172.21.15.5:0/3226751316 shutdown_connections 2023-07-14T13:09:18.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:18.915+0000 7fa899967640 1 -- 172.21.15.5:0/3226751316 wait complete. 2023-07-14T13:09:18.965 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:09:19.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.079+0000 7fad4a12c640 1 Processor -- start 2023-07-14T13:09:19.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.079+0000 7fad4a12c640 1 -- start start 2023-07-14T13:09:19.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.079+0000 7fad4a12c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fad440c8ad0 0x7fad440c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:19.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.079+0000 7fad4a12c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad440c99c0 con 0x7fad440c9560 2023-07-14T13:09:19.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.079+0000 7fad4a12c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad440cc700 con 0x7fad44158ce0 2023-07-14T13:09:19.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.079+0000 7fad4a12c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad440b0ff0 con 0x7fad440c8ad0 2023-07-14T13:09:19.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.079+0000 7fad43fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fad440c9560 0x7fad440ccb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57584/0 (socket says 172.21.15.5:57584) 2023-07-14T13:09:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.079+0000 7fad43fff640 1 -- 172.21.15.5:0/339829366 learned_addr learned my addr 172.21.15.5:0/339829366 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.079+0000 7fad42ffd640 1 --2- 172.21.15.5:0/339829366 >> v2:172.21.15.154:3300/0 conn(0x7fad440c8ad0 0x7fad440c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.079+0000 7fad427fc640 1 -- 172.21.15.5:0/339829366 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768872406 0 0) 0x7fad440c99c0 con 0x7fad440c9560 2023-07-14T13:09:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.083+0000 7fad427fc640 1 -- 172.21.15.5:0/339829366 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad2c005740 con 0x7fad440c9560 2023-07-14T13:09:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.083+0000 7fad427fc640 1 -- 172.21.15.5:0/339829366 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865775634 0 0) 0x7fad440cc700 con 0x7fad44158ce0 2023-07-14T13:09:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.083+0000 7fad427fc640 1 -- 172.21.15.5:0/339829366 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad440c99c0 con 0x7fad44158ce0 2023-07-14T13:09:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.083+0000 7fad42ffd640 1 -- 172.21.15.5:0/339829366 >> v1:172.21.15.154:6789/0 conn(0x7fad44158ce0 legacy=0x7fad44070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.083+0000 7fad42ffd640 1 -- 172.21.15.5:0/339829366 >> v1:172.21.15.5:6789/0 conn(0x7fad440c9560 legacy=0x7fad440ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:19.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.083+0000 7fad427fc640 1 -- 172.21.15.5:0/339829366 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1662326275 0 0) 0x7fad2c005740 con 0x7fad440c9560 2023-07-14T13:09:19.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.083+0000 7fad42ffd640 1 -- 172.21.15.5:0/339829366 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad44070c80 con 0x7fad440c8ad0 2023-07-14T13:09:19.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.083+0000 7fad42ffd640 1 --2- 172.21.15.5:0/339829366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad440c8ad0 0x7fad440c9020 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fad380097c0 tx=0x7fad3801c250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e7be5c9d6677d5f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:19.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.083+0000 7fad427fc640 1 -- 172.21.15.5:0/339829366 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c001a00 con 0x7fad440c8ad0 2023-07-14T13:09:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.083+0000 7fad427fc640 1 -- 172.21.15.5:0/339829366 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad380a7050 con 0x7fad440c8ad0 2023-07-14T13:09:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.083+0000 7fad427fc640 1 -- 172.21.15.5:0/339829366 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad380ab620 con 0x7fad440c8ad0 2023-07-14T13:09:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.087+0000 7fad4a12c640 1 -- 172.21.15.5:0/339829366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad440c8ad0 msgr2=0x7fad440c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.087+0000 7fad4a12c640 1 --2- 172.21.15.5:0/339829366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad440c8ad0 0x7fad440c9020 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fad380097c0 tx=0x7fad3801c250 comp rx=0 tx=0).stop 2023-07-14T13:09:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.087+0000 7fad4a12c640 1 -- 172.21.15.5:0/339829366 shutdown_connections 2023-07-14T13:09:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.087+0000 7fad4a12c640 1 --2- 172.21.15.5:0/339829366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad440c8ad0 0x7fad440c9020 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.087+0000 7fad4a12c640 1 -- 172.21.15.5:0/339829366 >> 172.21.15.5:0/339829366 conn(0x7fad440afcf0 msgr2=0x7fad440b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.087+0000 7fad4a12c640 1 -- 172.21.15.5:0/339829366 shutdown_connections 2023-07-14T13:09:19.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.087+0000 7fad4a12c640 1 -- 172.21.15.5:0/339829366 wait complete. 2023-07-14T13:09:19.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.087+0000 7fad4a12c640 1 Processor -- start 2023-07-14T13:09:19.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.087+0000 7fad4a12c640 1 -- start start 2023-07-14T13:09:19.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.087+0000 7fad4a12c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad440c8ad0 0x7fad4414af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:19.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.087+0000 7fad4a12c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad440c9560 0x7fad44156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:19.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.087+0000 7fad4a12c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad44158ce0 0x7fad44151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:19.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.087+0000 7fad4a12c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad44156df0 con 0x7fad44158ce0 2023-07-14T13:09:19.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.087+0000 7fad4a12c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad44157000 con 0x7fad440c8ad0 2023-07-14T13:09:19.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.087+0000 7fad4a12c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad441572e0 con 0x7fad440c9560 2023-07-14T13:09:19.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.087+0000 7fad43fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad44158ce0 0x7fad44151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:19.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.087+0000 7fad43fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad44158ce0 0x7fad44151540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52978/0 (socket says 172.21.15.5:52978) 2023-07-14T13:09:19.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.087+0000 7fad43fff640 1 -- 172.21.15.5:0/68098111 learned_addr learned my addr 172.21.15.5:0/68098111 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:19.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.087+0000 7fad42ffd640 1 --2- 172.21.15.5:0/68098111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad440c9560 0x7fad44156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:19.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.087+0000 7fad437fe640 1 --2- 172.21.15.5:0/68098111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad440c8ad0 0x7fad4414af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:19.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.087+0000 7fad43fff640 1 -- 172.21.15.5:0/68098111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad440c9560 msgr2=0x7fad44156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:19.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.087+0000 7fad43fff640 1 --2- 172.21.15.5:0/68098111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad440c9560 0x7fad44156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.087+0000 7fad43fff640 1 -- 172.21.15.5:0/68098111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad440c8ad0 msgr2=0x7fad4414af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:19.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.087+0000 7fad43fff640 1 --2- 172.21.15.5:0/68098111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad440c8ad0 0x7fad4414af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.087+0000 7fad43fff640 1 -- 172.21.15.5:0/68098111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad38009420 con 0x7fad44158ce0 2023-07-14T13:09:19.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.091+0000 7fad43fff640 1 --2- 172.21.15.5:0/68098111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad44158ce0 0x7fad44151540 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fad3c001f70 tx=0x7fad3c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:19.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.091+0000 7fad2bfff640 1 -- 172.21.15.5:0/68098111 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c012400 con 0x7fad44158ce0 2023-07-14T13:09:19.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.091+0000 7fad2bfff640 1 -- 172.21.15.5:0/68098111 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c012560 con 0x7fad44158ce0 2023-07-14T13:09:19.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.091+0000 7fad4a12c640 1 -- 172.21.15.5:0/68098111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad441575c0 con 0x7fad44158ce0 2023-07-14T13:09:19.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.091+0000 7fad2bfff640 1 -- 172.21.15.5:0/68098111 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c012910 con 0x7fad44158ce0 2023-07-14T13:09:19.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.091+0000 7fad4a12c640 1 -- 172.21.15.5:0/68098111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad44157b80 con 0x7fad44158ce0 2023-07-14T13:09:19.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.091+0000 7fad4a12c640 1 -- 172.21.15.5:0/68098111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad440ca1a0 con 0x7fad44158ce0 2023-07-14T13:09:19.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.091+0000 7fad2bfff640 1 -- 172.21.15.5:0/68098111 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fad3c012a70 con 0x7fad44158ce0 2023-07-14T13:09:19.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.091+0000 7fad2bfff640 1 --2- 172.21.15.5:0/68098111 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fad300663a0 0x7fad30068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:19.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.091+0000 7fad2bfff640 1 -- 172.21.15.5:0/68098111 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fad3c084600 con 0x7fad44158ce0 2023-07-14T13:09:19.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.091+0000 7fad437fe640 1 --2- 172.21.15.5:0/68098111 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fad300663a0 0x7fad30068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:19.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.095+0000 7fad437fe640 1 --2- 172.21.15.5:0/68098111 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fad300663a0 0x7fad30068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fad340011f0 tx=0x7fad34009040 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:19.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.095+0000 7fad2bfff640 1 -- 172.21.15.5:0/68098111 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fad3c0518f0 con 0x7fad44158ce0 2023-07-14T13:09:19.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.283+0000 7fad4a12c640 1 -- 172.21.15.5:0/68098111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad44157da0 con 0x7fad44158ce0 2023-07-14T13:09:19.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.283+0000 7fad2bfff640 1 -- 172.21.15.5:0/68098111 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4702 (secure 0 0 0) 0x7fad3c054f10 con 0x7fad44158ce0 2023-07-14T13:09:19.314 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:19.314 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6901,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/747965975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":747965975},{"type":"v1","addr":"172.21.15.5:6835","nonce":747965975}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6907,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1902785181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1902785181},{"type":"v1","addr":"172.21.15.154:6835","nonce":1902785181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6916,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/90532135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":90532135},{"type":"v1","addr":"172.21.15.154:6837","nonce":90532135}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:09:08.828642+0000","modified":"2023-07-14T13:09:12.468790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7104},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7104":{"gid":7104,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6834/2611471565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2611471565},{"type":"v1","addr":"172.21.15.5:6834","nonce":2611471565}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-14T13:09:19.314 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 41 2023-07-14T13:09:19.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.283+0000 7fad4a12c640 1 -- 172.21.15.5:0/68098111 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fad300663a0 msgr2=0x7fad30068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:19.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.283+0000 7fad4a12c640 1 --2- 172.21.15.5:0/68098111 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fad300663a0 0x7fad30068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fad340011f0 tx=0x7fad34009040 comp rx=0 tx=0).stop 2023-07-14T13:09:19.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.283+0000 7fad4a12c640 1 -- 172.21.15.5:0/68098111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad44158ce0 msgr2=0x7fad44151540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:19.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.283+0000 7fad4a12c640 1 --2- 172.21.15.5:0/68098111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad44158ce0 0x7fad44151540 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fad3c001f70 tx=0x7fad3c00a430 comp rx=0 tx=0).stop 2023-07-14T13:09:19.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.283+0000 7fad4a12c640 1 -- 172.21.15.5:0/68098111 shutdown_connections 2023-07-14T13:09:19.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.283+0000 7fad4a12c640 1 --2- 172.21.15.5:0/68098111 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fad300663a0 0x7fad30068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.283+0000 7fad4a12c640 1 --2- 172.21.15.5:0/68098111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad44158ce0 0x7fad44151540 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.283+0000 7fad4a12c640 1 --2- 172.21.15.5:0/68098111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad440c9560 0x7fad44156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.283+0000 7fad4a12c640 1 --2- 172.21.15.5:0/68098111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad440c8ad0 0x7fad4414af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.283+0000 7fad4a12c640 1 -- 172.21.15.5:0/68098111 >> 172.21.15.5:0/68098111 conn(0x7fad440afcf0 msgr2=0x7fad44154b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:19.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.283+0000 7fad4a12c640 1 -- 172.21.15.5:0/68098111 shutdown_connections 2023-07-14T13:09:19.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.283+0000 7fad4a12c640 1 -- 172.21.15.5:0/68098111 wait complete. 2023-07-14T13:09:19.738 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-14T13:09:08.828642+0000', 'modified': '2023-07-14T13:09:12.468790+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7104}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7104': {'gid': 7104, 'name': 'a', 'rank': 0, 'incarnation': 37, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.5:6834/2611471565', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6833', 'nonce': 2611471565}, {'type': 'v1', 'addr': '172.21.15.5:6834', 'nonce': 2611471565}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-14T13:09:19.738 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-14T13:09:19.739 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-14T13:09:19.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.855+0000 7f687545c640 1 Processor -- start 2023-07-14T13:09:19.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.855+0000 7f687545c640 1 -- start start 2023-07-14T13:09:19.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.859+0000 7f687545c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6870070b70 0x7f6870070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:19.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.859+0000 7f687545c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f687006b1e0 0x7f68700c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.859+0000 7f687545c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68700cac70 con 0x7f68700c21f0 2023-07-14T13:09:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.859+0000 7f687545c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6870071480 con 0x7f687006b1e0 2023-07-14T13:09:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.859+0000 7f687545c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68700ca060 con 0x7f6870070b70 2023-07-14T13:09:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.859+0000 7f6867fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f687006b1e0 0x7f68700c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.859+0000 7f686f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f68700c21f0 0x7f68700cb100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57596/0 (socket says 172.21.15.5:57596) 2023-07-14T13:09:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.859+0000 7f6867fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f687006b1e0 0x7f68700c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52988/0 (socket says 172.21.15.5:52988) 2023-07-14T13:09:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.859+0000 7f686f7fe640 1 -- 172.21.15.5:0/230093090 learned_addr learned my addr 172.21.15.5:0/230093090 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:19.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.859+0000 7f686effd640 1 --2- 172.21.15.5:0/230093090 >> v2:172.21.15.154:3300/0 conn(0x7f6870070b70 0x7f6870070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:19.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.859+0000 7f6867fff640 1 -- 172.21.15.5:0/230093090 >> v2:172.21.15.154:3300/0 conn(0x7f6870070b70 msgr2=0x7f6870070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:19.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.859+0000 7f6867fff640 1 --2- 172.21.15.5:0/230093090 >> v2:172.21.15.154:3300/0 conn(0x7f6870070b70 0x7f6870070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.859+0000 7f6867fff640 1 -- 172.21.15.5:0/230093090 >> v1:172.21.15.5:6789/0 conn(0x7f68700c21f0 legacy=0x7f68700cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:19.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.859+0000 7f6867fff640 1 -- 172.21.15.5:0/230093090 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68700ca340 con 0x7f687006b1e0 2023-07-14T13:09:19.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.859+0000 7f686e7fc640 1 -- 172.21.15.5:0/230093090 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277095005 0 0) 0x7f68700cac70 con 0x7f68700c21f0 2023-07-14T13:09:19.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.863+0000 7f6867fff640 1 --2- 172.21.15.5:0/230093090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f687006b1e0 0x7f68700c1cb0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f687006f1f0 tx=0x7f685801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52579c1ea2381760 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:19.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.863+0000 7f686e7fc640 1 -- 172.21.15.5:0/230093090 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68580a7070 con 0x7f687006b1e0 2023-07-14T13:09:19.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.863+0000 7f686e7fc640 1 -- 172.21.15.5:0/230093090 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68580ab430 con 0x7f687006b1e0 2023-07-14T13:09:19.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.863+0000 7f686e7fc640 1 -- 172.21.15.5:0/230093090 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68580ab7c0 con 0x7f687006b1e0 2023-07-14T13:09:19.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.863+0000 7f687545c640 1 -- 172.21.15.5:0/230093090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f687006b1e0 msgr2=0x7f68700c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:19.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.863+0000 7f687545c640 1 --2- 172.21.15.5:0/230093090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f687006b1e0 0x7f68700c1cb0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f687006f1f0 tx=0x7f685801c430 comp rx=0 tx=0).stop 2023-07-14T13:09:19.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.863+0000 7f687545c640 1 -- 172.21.15.5:0/230093090 shutdown_connections 2023-07-14T13:09:19.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.863+0000 7f687545c640 1 --2- 172.21.15.5:0/230093090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f687006b1e0 0x7f68700c1cb0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.863+0000 7f687545c640 1 --2- 172.21.15.5:0/230093090 >> v2:172.21.15.154:3300/0 conn(0x7f6870070b70 0x7f6870070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.863+0000 7f687545c640 1 -- 172.21.15.5:0/230093090 >> 172.21.15.5:0/230093090 conn(0x7f68700afcf0 msgr2=0x7f68700b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.863+0000 7f687545c640 1 -- 172.21.15.5:0/230093090 shutdown_connections 2023-07-14T13:09:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.863+0000 7f687545c640 1 -- 172.21.15.5:0/230093090 wait complete. 2023-07-14T13:09:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.863+0000 7f687545c640 1 Processor -- start 2023-07-14T13:09:19.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.863+0000 7f687545c640 1 -- start start 2023-07-14T13:09:19.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.867+0000 7f687545c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f687006b1e0 0x7f68700c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.867+0000 7f687545c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6870070b70 0x7f68701f57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.867+0000 7f687545c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68700c21f0 0x7f68701513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.867+0000 7f687545c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68701f5d00 con 0x7f687006b1e0 2023-07-14T13:09:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.867+0000 7f687545c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68701f6790 con 0x7f6870070b70 2023-07-14T13:09:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.867+0000 7f687545c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68701411a0 con 0x7f68700c21f0 2023-07-14T13:09:19.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.867+0000 7f686effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f687006b1e0 0x7f68700c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.867+0000 7f686effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f687006b1e0 0x7f68700c8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53000/0 (socket says 172.21.15.5:53000) 2023-07-14T13:09:19.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.867+0000 7f686effd640 1 -- 172.21.15.5:0/4017230756 learned_addr learned my addr 172.21.15.5:0/4017230756 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.867+0000 7f686f7fe640 1 --2- 172.21.15.5:0/4017230756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68700c21f0 0x7f68701513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.867+0000 7f6867fff640 1 --2- 172.21.15.5:0/4017230756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6870070b70 0x7f68701f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.867+0000 7f686effd640 1 -- 172.21.15.5:0/4017230756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68700c21f0 msgr2=0x7f68701513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.867+0000 7f686effd640 1 --2- 172.21.15.5:0/4017230756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68700c21f0 0x7f68701513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.867+0000 7f686effd640 1 -- 172.21.15.5:0/4017230756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6870070b70 msgr2=0x7f68701f57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:19.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.867+0000 7f686effd640 1 --2- 172.21.15.5:0/4017230756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6870070b70 0x7f68701f57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.867+0000 7f686effd640 1 -- 172.21.15.5:0/4017230756 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6858009420 con 0x7f687006b1e0 2023-07-14T13:09:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.867+0000 7f686effd640 1 --2- 172.21.15.5:0/4017230756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f687006b1e0 0x7f68700c8160 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f686000d800 tx=0x7f686000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.867+0000 7f68677fe640 1 -- 172.21.15.5:0/4017230756 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686000b6c0 con 0x7f687006b1e0 2023-07-14T13:09:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.867+0000 7f68677fe640 1 -- 172.21.15.5:0/4017230756 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686000b820 con 0x7f687006b1e0 2023-07-14T13:09:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.867+0000 7f68677fe640 1 -- 172.21.15.5:0/4017230756 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686000bb90 con 0x7f687006b1e0 2023-07-14T13:09:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.867+0000 7f687545c640 1 -- 172.21.15.5:0/4017230756 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68701f5ef0 con 0x7f687006b1e0 2023-07-14T13:09:19.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.867+0000 7f687545c640 1 -- 172.21.15.5:0/4017230756 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68701f64b0 con 0x7f687006b1e0 2023-07-14T13:09:19.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.867+0000 7f68677fe640 1 -- 172.21.15.5:0/4017230756 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f686000bcf0 con 0x7f687006b1e0 2023-07-14T13:09:19.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.871+0000 7f68677fe640 1 --2- 172.21.15.5:0/4017230756 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f68500663d0 0x7f6850068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:19.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.871+0000 7f68677fe640 1 -- 172.21.15.5:0/4017230756 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f68600844b0 con 0x7f687006b1e0 2023-07-14T13:09:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.871+0000 7f6867fff640 1 --2- 172.21.15.5:0/4017230756 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f68500663d0 0x7f6850068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:19.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.871+0000 7f68787a5000 1 Processor -- start 2023-07-14T13:09:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.871+0000 7f68787a5000 1 -- start start 2023-07-14T13:09:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.871+0000 7f6867fff640 1 --2- 172.21.15.5:0/4017230756 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f68500663d0 0x7f6850068880 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f68580af000 tx=0x7f68580a7000 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.871+0000 7f68787a5000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c2dba3e0 0x55c4c2dba7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.871+0000 7f68787a5000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c4c2dbacf0 0x55c4c2d70800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.871+0000 7f68787a5000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2d70d40 0x55c4c2d71110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:19.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.871+0000 7f68787a5000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4c2c33900 con 0x55c4c2d70d40 2023-07-14T13:09:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.871+0000 7f68787a5000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4c2b6d8c0 con 0x55c4c2dba3e0 2023-07-14T13:09:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.871+0000 7f68787a5000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c4c2bc1360 con 0x55c4c2dbacf0 2023-07-14T13:09:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.871+0000 7f686f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2d70d40 0x55c4c2d71110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.871+0000 7f686f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2d70d40 0x55c4c2d71110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53014/0 (socket says 172.21.15.5:53014) 2023-07-14T13:09:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.871+0000 7f686f7fe640 1 -- 172.21.15.5:0/3313476187 learned_addr learned my addr 172.21.15.5:0/3313476187 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.871+0000 7f686effd640 1 --2- 172.21.15.5:0/3313476187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c2dba3e0 0x55c4c2dba7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:19.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.871+0000 7f6867fff640 1 --2- 172.21.15.5:0/3313476187 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c4c2dbacf0 0x55c4c2d70800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.871+0000 7f686f7fe640 1 -- 172.21.15.5:0/3313476187 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c4c2dbacf0 msgr2=0x55c4c2d70800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.871+0000 7f686f7fe640 1 --2- 172.21.15.5:0/3313476187 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c4c2dbacf0 0x55c4c2d70800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.871+0000 7f686f7fe640 1 -- 172.21.15.5:0/3313476187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c2dba3e0 msgr2=0x55c4c2dba7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.871+0000 7f686f7fe640 1 --2- 172.21.15.5:0/3313476187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c2dba3e0 0x55c4c2dba7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.871+0000 7f686f7fe640 1 -- 172.21.15.5:0/3313476187 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4c28b6890 con 0x55c4c2d70d40 2023-07-14T13:09:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.871+0000 7f686f7fe640 1 --2- 172.21.15.5:0/3313476187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2d70d40 0x55c4c2d71110 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f68680073b0 tx=0x7f6868007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68171aa9e9546628 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.871+0000 7f6864ff9640 1 -- 172.21.15.5:0/3313476187 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868001cd0 con 0x55c4c2d70d40 2023-07-14T13:09:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.871+0000 7f6864ff9640 1 -- 172.21.15.5:0/3313476187 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6868001e30 con 0x55c4c2d70d40 2023-07-14T13:09:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.871+0000 7f6864ff9640 1 -- 172.21.15.5:0/3313476187 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868014430 con 0x55c4c2d70d40 2023-07-14T13:09:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f68787a5000 1 -- 172.21.15.5:0/3313476187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2d70d40 msgr2=0x55c4c2d71110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f68787a5000 1 --2- 172.21.15.5:0/3313476187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2d70d40 0x55c4c2d71110 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f68680073b0 tx=0x7f6868007870 comp rx=0 tx=0).stop 2023-07-14T13:09:19.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f68787a5000 1 -- 172.21.15.5:0/3313476187 shutdown_connections 2023-07-14T13:09:19.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f68787a5000 1 --2- 172.21.15.5:0/3313476187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2d70d40 0x55c4c2d71110 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f68787a5000 1 --2- 172.21.15.5:0/3313476187 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c4c2dbacf0 0x55c4c2d70800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f68787a5000 1 --2- 172.21.15.5:0/3313476187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c2dba3e0 0x55c4c2dba7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f68787a5000 1 -- 172.21.15.5:0/3313476187 >> 172.21.15.5:0/3313476187 conn(0x55c4c2d72a90 msgr2=0x55c4c2d6acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:19.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f68787a5000 1 -- 172.21.15.5:0/3313476187 shutdown_connections 2023-07-14T13:09:19.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f68787a5000 1 -- 172.21.15.5:0/3313476187 wait complete. 2023-07-14T13:09:19.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f68787a5000 1 -- start start 2023-07-14T13:09:19.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f68787a5000 1 Processor -- start 2023-07-14T13:09:19.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f68787a5000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c4c2d70d40 0x55c4c2da7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:19.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f68787a5000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2dba3e0 0x55c4c2da81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:19.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f68787a5000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c2dbacf0 0x55c4c2da86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:19.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f68787a5000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4c2bba400 con 0x55c4c2dba3e0 2023-07-14T13:09:19.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f68787a5000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4c2b76b60 con 0x55c4c2dbacf0 2023-07-14T13:09:19.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f68787a5000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c4c2b76800 con 0x55c4c2d70d40 2023-07-14T13:09:19.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f68787a5000 10 client.0 _ll_register_callbacks cb 0x55c4c2d582c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:09:19.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f6867fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2dba3e0 0x55c4c2da81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:19.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f6867fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2dba3e0 0x55c4c2da81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53024/0 (socket says 172.21.15.5:53024) 2023-07-14T13:09:19.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f6867fff640 1 -- 172.21.15.5:0/1137361747 learned_addr learned my addr 172.21.15.5:0/1137361747 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:19.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f686effd640 1 --2- 172.21.15.5:0/1137361747 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c4c2d70d40 0x55c4c2da7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:19.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f686f7fe640 1 --2- 172.21.15.5:0/1137361747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c2dbacf0 0x55c4c2da86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:19.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f6867fff640 1 -- 172.21.15.5:0/1137361747 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c4c2d70d40 msgr2=0x55c4c2da7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:19.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f6867fff640 1 --2- 172.21.15.5:0/1137361747 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c4c2d70d40 0x55c4c2da7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f6867fff640 1 -- 172.21.15.5:0/1137361747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c2dbacf0 msgr2=0x55c4c2da86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:19.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f6867fff640 1 --2- 172.21.15.5:0/1137361747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c2dbacf0 0x55c4c2da86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f6867fff640 1 -- 172.21.15.5:0/1137361747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686800f040 con 0x55c4c2dba3e0 2023-07-14T13:09:19.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f6867fff640 1 --2- 172.21.15.5:0/1137361747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2dba3e0 0x55c4c2da81b0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f685801c470 tx=0x7f685801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b971245e806d0d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:19.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.875+0000 7f684dffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-07-14T13:09:19.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f684dffb640 1 -- 172.21.15.5:0/1137361747 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68580c5070 con 0x55c4c2dba3e0 2023-07-14T13:09:19.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f68787a5000 1 -- 172.21.15.5:0/1137361747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c4c2b81aa0 con 0x55c4c2dba3e0 2023-07-14T13:09:19.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f684dffb640 1 -- 172.21.15.5:0/1137361747 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f68580c08e0 con 0x55c4c2dba3e0 2023-07-14T13:09:19.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f684dffb640 1 -- 172.21.15.5:0/1137361747 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68580c0aa0 con 0x55c4c2dba3e0 2023-07-14T13:09:19.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f68787a5000 10 client.7293 fetch_fsmap learned FSMap version 41 2023-07-14T13:09:19.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f68787a5000 1 -- 172.21.15.5:0/1137361747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55c4c2b7ed90 con 0x55c4c2dba3e0 2023-07-14T13:09:19.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f684dffb640 1 -- 172.21.15.5:0/1137361747 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c4c2b81aa0 con 0x55c4c2dba3e0 2023-07-14T13:09:19.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f684dffb640 1 -- 172.21.15.5:0/1137361747 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 41) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f68580c0c00 con 0x55c4c2dba3e0 2023-07-14T13:09:19.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f68787a5000 10 client.7293 fetch_fsmap finished waiting for FSMap version 41 2023-07-14T13:09:19.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f68787a5000 10 client.7293 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-14T13:09:19.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f68787a5000 20 client.7293 populate_metadata read hostname 'smithi005' 2023-07-14T13:09:19.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f68787a5000 1 --2- 172.21.15.5:0/1137361747 >> [v2:172.21.15.5:6833/2611471565,v1:172.21.15.5:6834/2611471565] conn(0x55c4c2dc9660 0x55c4c2dcba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:19.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f68787a5000 4 client.7293 mds_command: new command op to 7104 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:09:19.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f68787a5000 1 -- 172.21.15.5:0/1137361747 --> [v2:172.21.15.5:6833/2611471565,v1:172.21.15.5:6834/2611471565] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c4c2be8f40 con 0x55c4c2dc9660 2023-07-14T13:09:19.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f686effd640 1 --2- 172.21.15.5:0/1137361747 >> [v2:172.21.15.5:6833/2611471565,v1:172.21.15.5:6834/2611471565] conn(0x55c4c2dc9660 0x55c4c2dcba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:19.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f686effd640 1 --2- 172.21.15.5:0/1137361747 >> [v2:172.21.15.5:6833/2611471565,v1:172.21.15.5:6834/2611471565] conn(0x55c4c2dc9660 0x55c4c2dcba40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=101d600cb0a47b4b server_cookie=4187d0d7f121ee9b in_seq=0 out_seq=0 2023-07-14T13:09:19.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f684dffb640 10 client.7293 ms_handle_connect on v2:172.21.15.5:6833/2611471565 2023-07-14T13:09:19.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f684dffb640 1 -- 172.21.15.5:0/1137361747 <== mds.0 v2:172.21.15.5:6833/2611471565 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c4c2be8f40 con 0x55c4c2dc9660 2023-07-14T13:09:19.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f684dffb640 10 client.7293 handle_command_reply: tid=0 2023-07-14T13:09:19.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f68787a5000 1 client.7293 shutdown 2023-07-14T13:09:19.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f68787a5000 1 -- 172.21.15.5:0/1137361747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2dba3e0 msgr2=0x55c4c2da81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:19.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f68787a5000 1 --2- 172.21.15.5:0/1137361747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2dba3e0 0x55c4c2da81b0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f685801c470 tx=0x7f685801ac70 comp rx=0 tx=0).stop 2023-07-14T13:09:19.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f68787a5000 1 -- 172.21.15.5:0/1137361747 shutdown_connections 2023-07-14T13:09:19.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f68787a5000 1 --2- 172.21.15.5:0/1137361747 >> [v2:172.21.15.5:6833/2611471565,v1:172.21.15.5:6834/2611471565] conn(0x55c4c2dc9660 0x55c4c2dcba40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f68787a5000 1 --2- 172.21.15.5:0/1137361747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c2dbacf0 0x55c4c2da86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f68787a5000 1 --2- 172.21.15.5:0/1137361747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2dba3e0 0x55c4c2da81b0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f68787a5000 1 --2- 172.21.15.5:0/1137361747 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c4c2d70d40 0x55c4c2da7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f684dffb640 0 client.7293 ms_handle_reset on v2:172.21.15.5:6833/2611471565 2023-07-14T13:09:19.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f68787a5000 1 -- 172.21.15.5:0/1137361747 >> 172.21.15.5:0/1137361747 conn(0x55c4c2d72a90 msgr2=0x55c4c2d6a440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:19.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f68787a5000 1 -- 172.21.15.5:0/1137361747 shutdown_connections 2023-07-14T13:09:19.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f68787a5000 1 -- 172.21.15.5:0/1137361747 wait complete. 2023-07-14T13:09:19.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.879+0000 7f68787a5000 20 client.7293 trim_cache size 0 max 16384 2023-07-14T13:09:19.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.895+0000 7f68787a5000 1 Processor -- start 2023-07-14T13:09:19.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.895+0000 7f68787a5000 1 -- start start 2023-07-14T13:09:19.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.895+0000 7f68787a5000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c4c2d70d40 0x55c4c2da5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:19.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.895+0000 7f68787a5000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c2dba3e0 0x55c4c2da5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:19.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.895+0000 7f68787a5000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2dbacf0 0x55c4c2da6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:19.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.895+0000 7f68787a5000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4c2877940 con 0x55c4c2dbacf0 2023-07-14T13:09:19.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.895+0000 7f68787a5000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4c2bb7c10 con 0x55c4c2dba3e0 2023-07-14T13:09:19.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.895+0000 7f68787a5000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c4c2bfd600 con 0x55c4c2d70d40 2023-07-14T13:09:19.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.895+0000 7f686f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2dbacf0 0x55c4c2da6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:19.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.895+0000 7f686f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2dbacf0 0x55c4c2da6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53026/0 (socket says 172.21.15.5:53026) 2023-07-14T13:09:19.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.895+0000 7f686f7fe640 1 -- 172.21.15.5:0/2909198909 learned_addr learned my addr 172.21.15.5:0/2909198909 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:19.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.895+0000 7f686effd640 1 --2- 172.21.15.5:0/2909198909 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c4c2d70d40 0x55c4c2da5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:19.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.895+0000 7f6867fff640 1 --2- 172.21.15.5:0/2909198909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c2dba3e0 0x55c4c2da5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:19.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.895+0000 7f686f7fe640 1 -- 172.21.15.5:0/2909198909 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c4c2d70d40 msgr2=0x55c4c2da5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:19.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.895+0000 7f686f7fe640 1 --2- 172.21.15.5:0/2909198909 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c4c2d70d40 0x55c4c2da5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f686f7fe640 1 -- 172.21.15.5:0/2909198909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c2dba3e0 msgr2=0x55c4c2da5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:19.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f686f7fe640 1 --2- 172.21.15.5:0/2909198909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c2dba3e0 0x55c4c2da5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f686f7fe640 1 -- 172.21.15.5:0/2909198909 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4c2dba250 con 0x55c4c2dbacf0 2023-07-14T13:09:19.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f686f7fe640 1 --2- 172.21.15.5:0/2909198909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2dbacf0 0x55c4c2da6410 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f6868016040 tx=0x7f6868007050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7646ed707c36c2a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:19.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f68657fa640 1 -- 172.21.15.5:0/2909198909 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868001cd0 con 0x55c4c2dbacf0 2023-07-14T13:09:19.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f68657fa640 1 -- 172.21.15.5:0/2909198909 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6868001e30 con 0x55c4c2dbacf0 2023-07-14T13:09:19.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f68657fa640 1 -- 172.21.15.5:0/2909198909 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868014430 con 0x55c4c2dbacf0 2023-07-14T13:09:19.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f68787a5000 1 -- 172.21.15.5:0/2909198909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2dbacf0 msgr2=0x55c4c2da6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:19.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f68787a5000 1 --2- 172.21.15.5:0/2909198909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2dbacf0 0x55c4c2da6410 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f6868016040 tx=0x7f6868007050 comp rx=0 tx=0).stop 2023-07-14T13:09:19.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f68787a5000 1 -- 172.21.15.5:0/2909198909 shutdown_connections 2023-07-14T13:09:19.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f68787a5000 1 --2- 172.21.15.5:0/2909198909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2dbacf0 0x55c4c2da6410 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f68787a5000 1 --2- 172.21.15.5:0/2909198909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c2dba3e0 0x55c4c2da5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f68787a5000 1 --2- 172.21.15.5:0/2909198909 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c4c2d70d40 0x55c4c2da5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f68787a5000 1 -- 172.21.15.5:0/2909198909 >> 172.21.15.5:0/2909198909 conn(0x55c4c2d72a90 msgr2=0x55c4c2d77570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:19.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f68787a5000 1 -- 172.21.15.5:0/2909198909 shutdown_connections 2023-07-14T13:09:19.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f68787a5000 1 -- 172.21.15.5:0/2909198909 wait complete. 2023-07-14T13:09:19.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f68787a5000 1 -- start start 2023-07-14T13:09:19.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f68787a5000 1 Processor -- start 2023-07-14T13:09:19.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f68787a5000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c4c2d70d40 0x55c4c2dcd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:19.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f68787a5000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2dba3e0 0x55c4c2dd4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:19.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f68787a5000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c2dbacf0 0x55c4c2dd53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:19.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f68787a5000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4c2c58ca0 con 0x55c4c2dba3e0 2023-07-14T13:09:19.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f68787a5000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4c2b69390 con 0x55c4c2dbacf0 2023-07-14T13:09:19.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f68787a5000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c4c2c7b1e0 con 0x55c4c2d70d40 2023-07-14T13:09:19.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f68787a5000 10 client.0 _ll_register_callbacks cb 0x55c4c2d384b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:09:19.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f6867fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2dba3e0 0x55c4c2dd4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:19.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f6867fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2dba3e0 0x55c4c2dd4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53040/0 (socket says 172.21.15.5:53040) 2023-07-14T13:09:19.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f6867fff640 1 -- 172.21.15.5:0/1449866929 learned_addr learned my addr 172.21.15.5:0/1449866929 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:19.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f686effd640 1 --2- 172.21.15.5:0/1449866929 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c4c2d70d40 0x55c4c2dcd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:19.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f686f7fe640 1 --2- 172.21.15.5:0/1449866929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c2dbacf0 0x55c4c2dd53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:19.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f6867fff640 1 -- 172.21.15.5:0/1449866929 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c4c2d70d40 msgr2=0x55c4c2dcd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:19.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f6867fff640 1 --2- 172.21.15.5:0/1449866929 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c4c2d70d40 0x55c4c2dcd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f6867fff640 1 -- 172.21.15.5:0/1449866929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c2dbacf0 msgr2=0x55c4c2dd53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:19.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f6867fff640 1 --2- 172.21.15.5:0/1449866929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c2dbacf0 0x55c4c2dd53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f6867fff640 1 -- 172.21.15.5:0/1449866929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c4c28b6890 con 0x55c4c2dba3e0 2023-07-14T13:09:19.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f6867fff640 1 --2- 172.21.15.5:0/1449866929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2dba3e0 0x55c4c2dd4ea0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f685801c9a0 tx=0x7f6858008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63cc8145ff45ded9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:19.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.899+0000 7f684dffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-07-14T13:09:19.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f684dffb640 1 -- 172.21.15.5:0/1449866929 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68580c9a60 con 0x55c4c2dba3e0 2023-07-14T13:09:19.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f684dffb640 1 -- 172.21.15.5:0/1449866929 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f68580abca0 con 0x55c4c2dba3e0 2023-07-14T13:09:19.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f68787a5000 1 -- 172.21.15.5:0/1449866929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c4c2d78dd0 con 0x55c4c2dba3e0 2023-07-14T13:09:19.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f684dffb640 1 -- 172.21.15.5:0/1449866929 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68580c95a0 con 0x55c4c2dba3e0 2023-07-14T13:09:19.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f68787a5000 10 client.7299 fetch_fsmap learned FSMap version 41 2023-07-14T13:09:19.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f68787a5000 1 -- 172.21.15.5:0/1449866929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55c4c2b65020 con 0x55c4c2dba3e0 2023-07-14T13:09:19.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f684dffb640 1 -- 172.21.15.5:0/1449866929 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c4c2d78dd0 con 0x55c4c2dba3e0 2023-07-14T13:09:19.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f684dffb640 1 -- 172.21.15.5:0/1449866929 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 41) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f68580d1020 con 0x55c4c2dba3e0 2023-07-14T13:09:19.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f68787a5000 10 client.7299 fetch_fsmap finished waiting for FSMap version 41 2023-07-14T13:09:19.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f68787a5000 10 client.7299 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-14T13:09:19.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f68787a5000 20 client.7299 populate_metadata read hostname 'smithi005' 2023-07-14T13:09:19.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f68787a5000 1 --2- 172.21.15.5:0/1449866929 >> [v2:172.21.15.5:6833/2611471565,v1:172.21.15.5:6834/2611471565] conn(0x55c4c2e18900 0x55c4c2e18cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:19.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f68787a5000 4 client.7299 mds_command: new command op to 7104 tid=0[{"prefix": "status"}] 2023-07-14T13:09:19.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f68787a5000 1 -- 172.21.15.5:0/1449866929 --> [v2:172.21.15.5:6833/2611471565,v1:172.21.15.5:6834/2611471565] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c4c2bb8d50 con 0x55c4c2e18900 2023-07-14T13:09:19.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f686effd640 1 --2- 172.21.15.5:0/1449866929 >> [v2:172.21.15.5:6833/2611471565,v1:172.21.15.5:6834/2611471565] conn(0x55c4c2e18900 0x55c4c2e18cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:19.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f686effd640 1 --2- 172.21.15.5:0/1449866929 >> [v2:172.21.15.5:6833/2611471565,v1:172.21.15.5:6834/2611471565] conn(0x55c4c2e18900 0x55c4c2e18cd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b19be0a21b049833 server_cookie=d9708fa4740e2294 in_seq=0 out_seq=0 2023-07-14T13:09:19.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f684dffb640 10 client.7299 ms_handle_connect on v2:172.21.15.5:6833/2611471565 2023-07-14T13:09:19.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f684dffb640 1 -- 172.21.15.5:0/1449866929 <== mds.0 v2:172.21.15.5:6833/2611471565 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55c4c2bb8d50 con 0x55c4c2e18900 2023-07-14T13:09:19.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f684dffb640 10 client.7299 handle_command_reply: tid=0 2023-07-14T13:09:19.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f68787a5000 1 client.7299 shutdown 2023-07-14T13:09:19.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f68787a5000 1 -- 172.21.15.5:0/1449866929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2dba3e0 msgr2=0x55c4c2dd4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:19.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f68787a5000 1 --2- 172.21.15.5:0/1449866929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2dba3e0 0x55c4c2dd4ea0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f685801c9a0 tx=0x7f6858008040 comp rx=0 tx=0).stop 2023-07-14T13:09:19.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f68787a5000 1 -- 172.21.15.5:0/1449866929 shutdown_connections 2023-07-14T13:09:19.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f68787a5000 1 --2- 172.21.15.5:0/1449866929 >> [v2:172.21.15.5:6833/2611471565,v1:172.21.15.5:6834/2611471565] conn(0x55c4c2e18900 0x55c4c2e18cd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f68787a5000 1 --2- 172.21.15.5:0/1449866929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c4c2dbacf0 0x55c4c2dd53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f68787a5000 1 --2- 172.21.15.5:0/1449866929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c4c2dba3e0 0x55c4c2dd4ea0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f68787a5000 1 --2- 172.21.15.5:0/1449866929 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55c4c2d70d40 0x55c4c2dcd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f68787a5000 1 -- 172.21.15.5:0/1449866929 >> 172.21.15.5:0/1449866929 conn(0x55c4c2d72a90 msgr2=0x55c4c2d6a440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:19.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f684dffb640 0 client.7299 ms_handle_reset on v2:172.21.15.5:6833/2611471565 2023-07-14T13:09:19.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f68787a5000 1 -- 172.21.15.5:0/1449866929 shutdown_connections 2023-07-14T13:09:19.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f68787a5000 1 -- 172.21.15.5:0/1449866929 wait complete. 2023-07-14T13:09:19.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f68787a5000 20 client.7299 trim_cache size 0 max 16384 2023-07-14T13:09:19.942 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T13:09:19.942 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "22affb8d-e389-40f8-a764-dd40eb1759c8", 2023-07-14T13:09:19.943 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-07-14T13:09:19.943 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 7104, 2023-07-14T13:09:19.943 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-07-14T13:09:19.943 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-07-14T13:09:19.943 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-07-14T13:09:19.943 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 10.479819265, 2023-07-14T13:09:19.943 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 41, 2023-07-14T13:09:19.943 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 97, 2023-07-14T13:09:19.944 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 97, 2023-07-14T13:09:19.944 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 23.018901634999999 2023-07-14T13:09:19.944 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T13:09:19.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f687545c640 1 -- 172.21.15.5:0/4017230756 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f68500663d0 msgr2=0x7f6850068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:19.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f687545c640 1 --2- 172.21.15.5:0/4017230756 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f68500663d0 0x7f6850068880 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f68580af000 tx=0x7f68580a7000 comp rx=0 tx=0).stop 2023-07-14T13:09:19.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f687545c640 1 -- 172.21.15.5:0/4017230756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f687006b1e0 msgr2=0x7f68700c8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:19.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f687545c640 1 --2- 172.21.15.5:0/4017230756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f687006b1e0 0x7f68700c8160 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f686000d800 tx=0x7f686000dcc0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f687545c640 1 -- 172.21.15.5:0/4017230756 shutdown_connections 2023-07-14T13:09:19.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f687545c640 1 --2- 172.21.15.5:0/4017230756 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f68500663d0 0x7f6850068880 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f687545c640 1 --2- 172.21.15.5:0/4017230756 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68700c21f0 0x7f68701513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f687545c640 1 --2- 172.21.15.5:0/4017230756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6870070b70 0x7f68701f57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f687545c640 1 --2- 172.21.15.5:0/4017230756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f687006b1e0 0x7f68700c8160 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:19.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f687545c640 1 -- 172.21.15.5:0/4017230756 >> 172.21.15.5:0/4017230756 conn(0x7f68700afcf0 msgr2=0x7f68700ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:19.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f687545c640 1 -- 172.21.15.5:0/4017230756 shutdown_connections 2023-07-14T13:09:19.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:19.903+0000 7f687545c640 1 -- 172.21.15.5:0/4017230756 wait complete. 2023-07-14T13:09:19.954 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T13:09:20.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.067+0000 7f57d306d640 1 Processor -- start 2023-07-14T13:09:20.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.067+0000 7f57d306d640 1 -- start start 2023-07-14T13:09:20.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.067+0000 7f57d306d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f57cc15f500 0x7f57cc06cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:20.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.067+0000 7f57d306d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57cc06d430 0x7f57cc06a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:20.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.067+0000 7f57d306d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57cc06aa80 0x7f57cc0b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:20.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.067+0000 7f57d306d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57cc06af20 con 0x7f57cc06aa80 2023-07-14T13:09:20.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.067+0000 7f57d306d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57cc0cdc80 con 0x7f57cc15f500 2023-07-14T13:09:20.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.067+0000 7f57d306d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc06e4c0 con 0x7f57cc06d430 2023-07-14T13:09:20.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.067+0000 7f57d160a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57cc06aa80 0x7f57cc0b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:20.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.067+0000 7f57d160a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57cc06aa80 0x7f57cc0b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53048/0 (socket says 172.21.15.5:53048) 2023-07-14T13:09:20.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.067+0000 7f57d160a640 1 -- 172.21.15.5:0/1640315053 learned_addr learned my addr 172.21.15.5:0/1640315053 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:20.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.067+0000 7f57cbfff640 1 --2- 172.21.15.5:0/1640315053 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57cc06d430 0x7f57cc06a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:20.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.067+0000 7f57d0e09640 1 --2- 172.21.15.5:0/1640315053 >> v2:172.21.15.154:3300/0 conn(0x7f57cc15f500 0x7f57cc06cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:20.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.067+0000 7f57d160a640 1 -- 172.21.15.5:0/1640315053 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57cc06d430 msgr2=0x7f57cc06a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:20.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.067+0000 7f57d160a640 1 --2- 172.21.15.5:0/1640315053 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57cc06d430 0x7f57cc06a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:20.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.067+0000 7f57d160a640 1 -- 172.21.15.5:0/1640315053 >> v2:172.21.15.154:3300/0 conn(0x7f57cc15f500 msgr2=0x7f57cc06cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:20.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.067+0000 7f57d160a640 1 --2- 172.21.15.5:0/1640315053 >> v2:172.21.15.154:3300/0 conn(0x7f57cc15f500 0x7f57cc06cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:20.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.067+0000 7f57d160a640 1 -- 172.21.15.5:0/1640315053 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57cc06d940 con 0x7f57cc06aa80 2023-07-14T13:09:20.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.067+0000 7f57cbfff640 1 --2- 172.21.15.5:0/1640315053 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57cc06d430 0x7f57cc06a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:09:20.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.067+0000 7f57d0e09640 1 --2- 172.21.15.5:0/1640315053 >> v2:172.21.15.154:3300/0 conn(0x7f57cc15f500 0x7f57cc06cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:09:20.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.071+0000 7f57d160a640 1 --2- 172.21.15.5:0/1640315053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57cc06aa80 0x7f57cc0b1bc0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f57cc0b2c40 tx=0x7f57c401c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee76012350e5fec server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:20.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.071+0000 7f57cb7fe640 1 -- 172.21.15.5:0/1640315053 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c40a6490 con 0x7f57cc06aa80 2023-07-14T13:09:20.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.071+0000 7f57cb7fe640 1 -- 172.21.15.5:0/1640315053 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c40a65f0 con 0x7f57cc06aa80 2023-07-14T13:09:20.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.071+0000 7f57cb7fe640 1 -- 172.21.15.5:0/1640315053 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c40a6980 con 0x7f57cc06aa80 2023-07-14T13:09:20.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.071+0000 7f57d306d640 1 -- 172.21.15.5:0/1640315053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57cc06aa80 msgr2=0x7f57cc0b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:20.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.071+0000 7f57d306d640 1 --2- 172.21.15.5:0/1640315053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57cc06aa80 0x7f57cc0b1bc0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f57cc0b2c40 tx=0x7f57c401c710 comp rx=0 tx=0).stop 2023-07-14T13:09:20.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.071+0000 7f57d306d640 1 -- 172.21.15.5:0/1640315053 shutdown_connections 2023-07-14T13:09:20.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.071+0000 7f57d306d640 1 --2- 172.21.15.5:0/1640315053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57cc06aa80 0x7f57cc0b1bc0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:20.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.071+0000 7f57d306d640 1 --2- 172.21.15.5:0/1640315053 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57cc06d430 0x7f57cc06a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:20.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.071+0000 7f57d306d640 1 --2- 172.21.15.5:0/1640315053 >> v2:172.21.15.154:3300/0 conn(0x7f57cc15f500 0x7f57cc06cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:20.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.071+0000 7f57d306d640 1 -- 172.21.15.5:0/1640315053 >> 172.21.15.5:0/1640315053 conn(0x7f57cc0659d0 msgr2=0x7f57cc099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:20.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.071+0000 7f57d306d640 1 -- 172.21.15.5:0/1640315053 shutdown_connections 2023-07-14T13:09:20.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.071+0000 7f57d306d640 1 -- 172.21.15.5:0/1640315053 wait complete. 2023-07-14T13:09:20.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.075+0000 7f57d306d640 1 Processor -- start 2023-07-14T13:09:20.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.075+0000 7f57d306d640 1 -- start start 2023-07-14T13:09:20.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.075+0000 7f57d306d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57cc06aa80 0x7f57cc15e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:20.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.075+0000 7f57d306d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57cc06d430 0x7f57cc0ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:20.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.075+0000 7f57d306d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57cc15f500 0x7f57cc0ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:20.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.075+0000 7f57d306d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc15e750 con 0x7f57cc06aa80 2023-07-14T13:09:20.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.075+0000 7f57d306d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc0cd2a0 con 0x7f57cc15f500 2023-07-14T13:09:20.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.075+0000 7f57d306d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc0caec0 con 0x7f57cc06d430 2023-07-14T13:09:20.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.075+0000 7f57d0e09640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57cc06aa80 0x7f57cc15e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:20.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.075+0000 7f57d0e09640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57cc06aa80 0x7f57cc15e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53060/0 (socket says 172.21.15.5:53060) 2023-07-14T13:09:20.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.075+0000 7f57d0e09640 1 -- 172.21.15.5:0/3462210427 learned_addr learned my addr 172.21.15.5:0/3462210427 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:20.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.075+0000 7f57cbfff640 1 --2- 172.21.15.5:0/3462210427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57cc06d430 0x7f57cc0ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:20.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.075+0000 7f57d160a640 1 --2- 172.21.15.5:0/3462210427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57cc15f500 0x7f57cc0ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:20.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.075+0000 7f57d0e09640 1 -- 172.21.15.5:0/3462210427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57cc06d430 msgr2=0x7f57cc0ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:20.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.075+0000 7f57d0e09640 1 --2- 172.21.15.5:0/3462210427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57cc06d430 0x7f57cc0ccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:20.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.075+0000 7f57d0e09640 1 -- 172.21.15.5:0/3462210427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57cc15f500 msgr2=0x7f57cc0ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:20.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.075+0000 7f57d0e09640 1 --2- 172.21.15.5:0/3462210427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57cc15f500 0x7f57cc0ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:20.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.075+0000 7f57d0e09640 1 -- 172.21.15.5:0/3462210427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c4009b30 con 0x7f57cc06aa80 2023-07-14T13:09:20.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.075+0000 7f57d0e09640 1 --2- 172.21.15.5:0/3462210427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57cc06aa80 0x7f57cc15e210 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f57c000c7f0 tx=0x7f57c000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:20.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.075+0000 7f57c97fa640 1 -- 172.21.15.5:0/3462210427 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c0005ba0 con 0x7f57cc06aa80 2023-07-14T13:09:20.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.075+0000 7f57c97fa640 1 -- 172.21.15.5:0/3462210427 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c0005d00 con 0x7f57cc06aa80 2023-07-14T13:09:20.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.075+0000 7f57c97fa640 1 -- 172.21.15.5:0/3462210427 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c0006250 con 0x7f57cc06aa80 2023-07-14T13:09:20.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.075+0000 7f57d306d640 1 -- 172.21.15.5:0/3462210427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57cc0cb170 con 0x7f57cc06aa80 2023-07-14T13:09:20.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.075+0000 7f57d306d640 1 -- 172.21.15.5:0/3462210427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57cc0cb730 con 0x7f57cc06aa80 2023-07-14T13:09:20.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.079+0000 7f57d306d640 1 -- 172.21.15.5:0/3462210427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57cc0cb950 con 0x7f57cc06aa80 2023-07-14T13:09:20.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.079+0000 7f57c97fa640 1 -- 172.21.15.5:0/3462210427 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f57c00065c0 con 0x7f57cc06aa80 2023-07-14T13:09:20.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.079+0000 7f57c97fa640 1 --2- 172.21.15.5:0/3462210427 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f57b00663a0 0x7f57b0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:20.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.079+0000 7f57c97fa640 1 -- 172.21.15.5:0/3462210427 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f57c0084080 con 0x7f57cc06aa80 2023-07-14T13:09:20.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.079+0000 7f57cbfff640 1 --2- 172.21.15.5:0/3462210427 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f57b00663a0 0x7f57b0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:20.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.083+0000 7f57cbfff640 1 --2- 172.21.15.5:0/3462210427 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f57b00663a0 0x7f57b0068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f57cc0c6f10 tx=0x7f57b8008040 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:20.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.083+0000 7f57c97fa640 1 -- 172.21.15.5:0/3462210427 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f57c0051390 con 0x7f57cc06aa80 2023-07-14T13:09:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.271+0000 7f57d306d640 1 -- 172.21.15.5:0/3462210427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f57cc0678d0 con 0x7f57cc06aa80 2023-07-14T13:09:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.271+0000 7f57c97fa640 1 -- 172.21.15.5:0/3462210427 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v41) v1 ==== 53+0+73 (secure 0 0 0) 0x7f57c0006870 con 0x7f57cc06aa80 2023-07-14T13:09:20.302 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T13:09:20.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.271+0000 7f57d306d640 1 -- 172.21.15.5:0/3462210427 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f57b00663a0 msgr2=0x7f57b0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.271+0000 7f57d306d640 1 --2- 172.21.15.5:0/3462210427 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f57b00663a0 0x7f57b0068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f57cc0c6f10 tx=0x7f57b8008040 comp rx=0 tx=0).stop 2023-07-14T13:09:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.271+0000 7f57d306d640 1 -- 172.21.15.5:0/3462210427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57cc06aa80 msgr2=0x7f57cc15e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.271+0000 7f57d306d640 1 --2- 172.21.15.5:0/3462210427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57cc06aa80 0x7f57cc15e210 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f57c000c7f0 tx=0x7f57c000ccb0 comp rx=0 tx=0).stop 2023-07-14T13:09:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.271+0000 7f57d306d640 1 -- 172.21.15.5:0/3462210427 shutdown_connections 2023-07-14T13:09:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.271+0000 7f57d306d640 1 --2- 172.21.15.5:0/3462210427 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f57b00663a0 0x7f57b0068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.271+0000 7f57d306d640 1 --2- 172.21.15.5:0/3462210427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57cc15f500 0x7f57cc0ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.271+0000 7f57d306d640 1 --2- 172.21.15.5:0/3462210427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57cc06d430 0x7f57cc0ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.271+0000 7f57d306d640 1 --2- 172.21.15.5:0/3462210427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57cc06aa80 0x7f57cc15e210 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.271+0000 7f57d306d640 1 -- 172.21.15.5:0/3462210427 >> 172.21.15.5:0/3462210427 conn(0x7f57cc0659d0 msgr2=0x7f57cc0b19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.271+0000 7f57d306d640 1 -- 172.21.15.5:0/3462210427 shutdown_connections 2023-07-14T13:09:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:20.271+0000 7f57d306d640 1 -- 172.21.15.5:0/3462210427 wait complete. 2023-07-14T13:09:20.323 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-14T13:09:20.323 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T13:09:20.323 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-07-14T13:09:20.324 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-14T13:09:20.324 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-14T13:09:20.324 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-14T13:09:20.324 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-14T13:09:20.325 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T13:09:20.325 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T13:09:20.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:09:20.326 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-07-14T13:09:20.335 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T13:09:20.336 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T13:09:20.336 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T13:09:20.336 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:09:20.336 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-07-14T13:09:20.336 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:09:20.336 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T13:09:20.337 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-07-14T13:09:20.337 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2023-07-14T13:09:20.337 INFO:teuthology.orchestra.run.smithi005.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T13:09:20.337 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-07-14T13:09:20.337 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2023-07-14T13:09:20.337 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-14T13:09:20.337 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 41356sec preferred_lft 41356sec 2023-07-14T13:09:20.338 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-07-14T13:09:20.338 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:09:20.338 INFO:teuthology.orchestra.run.smithi005.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T13:09:20.338 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-07-14T13:09:20.338 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2023-07-14T13:09:20.338 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T13:09:20.338 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-07-14T13:09:20.338 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2023-07-14T13:09:20.339 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-14T13:09:20.339 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:96:b6:fb:c6 brd ff:ff:ff:ff:ff:ff 2023-07-14T13:09:20.339 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-14T13:09:20.339 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:09:20.339 INFO:teuthology.orchestra.run.smithi005.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T13:09:20.339 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-14T13:09:20.339 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T13:09:20.339 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:09:20.340 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-14T13:09:20.340 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:09:20.340 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T13:09:20.340 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T13:09:20.340 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-14T13:09:20.340 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:09:20.340 INFO:teuthology.orchestra.run.smithi005.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T13:09:20.341 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-14T13:09:20.341 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-14T13:09:20.341 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:09:20.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:09:20.342 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T13:09:20.403 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-07-14T13:09:20.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:09:20.405 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-07-14T13:09:20.461 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-07-14T13:09:20.461 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T13:09:20.461 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-14T13:09:20.462 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-14T13:09:20.462 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-14T13:09:20.462 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T13:09:20.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:09:20.463 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-07-14T13:09:20.463 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-07-14T13:09:20.463 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-14T13:09:20.464 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-14T13:09:20.464 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-14T13:09:20.464 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-07-14T13:09:20.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:09:20.561 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-07-14T13:09:20.570 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-14T13:09:20.570 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-14T13:09:20.571 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T13:09:20.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:09:20.572 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-07-14T13:09:20.633 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T13:09:20.633 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-14T13:09:20.688 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-14T13:09:20.689 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T13:09:20.689 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-14T13:09:20.745 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-14T13:09:20.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:09:20.746 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:09:20.840 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:09:20.841 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T13:09:20.841 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T13:09:20.856 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:09:20.856 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T13:09:20.856 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T13:09:20.857 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T13:09:20.857 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T13:09:20.866 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:09:20.866 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T13:09:20.867 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T13:09:20.867 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T13:09:20.867 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T13:09:20.867 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790" 2023-07-14T13:09:20.867 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790:/ 2023-07-14T13:09:20.867 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=22affb8d-e389-40f8-a764-dd40eb1759c8" will pass to kernel 2023-07-14T13:09:20.871 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T13:09:20.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:09:20.871 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-14T13:09:20.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:09:20.894 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T13:09:20.952 INFO:teuthology.orchestra.run.smithi005.stdout:client7308 2023-07-14T13:09:20.952 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:09:20.953 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:09:21.004 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-14T13:09:21.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.163+0000 7fed5b893640 1 Processor -- start 2023-07-14T13:09:21.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.163+0000 7fed5b893640 1 -- start start 2023-07-14T13:09:21.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.163+0000 7fed5b893640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fed54160330 0x7fed540cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:21.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.163+0000 7fed5b893640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed540c8940 0x7fed540ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:21.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.163+0000 7fed5b893640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed540c17d0 con 0x7fed540c0f80 2023-07-14T13:09:21.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.163+0000 7fed5b893640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed540c14f0 con 0x7fed54160330 2023-07-14T13:09:21.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.163+0000 7fed5b893640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed540cac10 con 0x7fed540c8940 2023-07-14T13:09:21.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.163+0000 7fed5962f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fed54160330 0x7fed540cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:21.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.163+0000 7fed59e30640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fed540c0f80 0x7fed540cd490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57610/0 (socket says 172.21.15.5:57610) 2023-07-14T13:09:21.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.163+0000 7fed59e30640 1 -- 172.21.15.5:0/2855384034 learned_addr learned my addr 172.21.15.5:0/2855384034 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:21.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.163+0000 7fed58e2e640 1 --2- 172.21.15.5:0/2855384034 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed540c8940 0x7fed540ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:21.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.163+0000 7fed5962f640 1 -- 172.21.15.5:0/2855384034 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed540c8940 msgr2=0x7fed540ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:21.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.163+0000 7fed4bfff640 1 -- 172.21.15.5:0/2855384034 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2963603822 0 0) 0x7fed540c17d0 con 0x7fed540c0f80 2023-07-14T13:09:21.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.163+0000 7fed5962f640 1 --2- 172.21.15.5:0/2855384034 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed540c8940 0x7fed540ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:21.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.163+0000 7fed5962f640 1 -- 172.21.15.5:0/2855384034 >> v1:172.21.15.5:6789/0 conn(0x7fed540c0f80 legacy=0x7fed540cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:21.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.163+0000 7fed5962f640 1 -- 172.21.15.5:0/2855384034 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed540caef0 con 0x7fed54160330 2023-07-14T13:09:21.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.163+0000 7fed58e2e640 1 --2- 172.21.15.5:0/2855384034 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed540c8940 0x7fed540ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:09:21.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.167+0000 7fed5962f640 1 --2- 172.21.15.5:0/2855384034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed54160330 0x7fed540cb6f0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fed500097c0 tx=0x7fed5001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8b057621fc4e4c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:21.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.167+0000 7fed4bfff640 1 -- 172.21.15.5:0/2855384034 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed500a8970 con 0x7fed54160330 2023-07-14T13:09:21.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.167+0000 7fed4bfff640 1 -- 172.21.15.5:0/2855384034 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed500a8ad0 con 0x7fed54160330 2023-07-14T13:09:21.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.167+0000 7fed4bfff640 1 -- 172.21.15.5:0/2855384034 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed500a8e60 con 0x7fed54160330 2023-07-14T13:09:21.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.167+0000 7fed5b893640 1 -- 172.21.15.5:0/2855384034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed54160330 msgr2=0x7fed540cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:21.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.167+0000 7fed5b893640 1 --2- 172.21.15.5:0/2855384034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed54160330 0x7fed540cb6f0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fed500097c0 tx=0x7fed5001ec70 comp rx=0 tx=0).stop 2023-07-14T13:09:21.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.167+0000 7fed5b893640 1 -- 172.21.15.5:0/2855384034 shutdown_connections 2023-07-14T13:09:21.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.167+0000 7fed5b893640 1 --2- 172.21.15.5:0/2855384034 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed540c8940 0x7fed540ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:21.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.167+0000 7fed5b893640 1 --2- 172.21.15.5:0/2855384034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed54160330 0x7fed540cb6f0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:21.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.167+0000 7fed5b893640 1 -- 172.21.15.5:0/2855384034 >> 172.21.15.5:0/2855384034 conn(0x7fed540afcf0 msgr2=0x7fed540b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:21.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.167+0000 7fed5b893640 1 -- 172.21.15.5:0/2855384034 shutdown_connections 2023-07-14T13:09:21.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.167+0000 7fed5b893640 1 -- 172.21.15.5:0/2855384034 wait complete. 2023-07-14T13:09:21.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.171+0000 7fed5b893640 1 Processor -- start 2023-07-14T13:09:21.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.171+0000 7fed5b893640 1 -- start start 2023-07-14T13:09:21.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.171+0000 7fed5b893640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed540c0f80 0x7fed54155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:21.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.171+0000 7fed5b893640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed540c8940 0x7fed54158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:21.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.171+0000 7fed5b893640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed54160330 0x7fed54158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:21.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.171+0000 7fed5b893640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed540c47c0 con 0x7fed540c8940 2023-07-14T13:09:21.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.171+0000 7fed5b893640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed54155970 con 0x7fed540c0f80 2023-07-14T13:09:21.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.171+0000 7fed5b893640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed541593d0 con 0x7fed54160330 2023-07-14T13:09:21.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.171+0000 7fed58e2e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed540c8940 0x7fed54158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:21.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.171+0000 7fed58e2e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed540c8940 0x7fed54158950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53066/0 (socket says 172.21.15.5:53066) 2023-07-14T13:09:21.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.171+0000 7fed58e2e640 1 -- 172.21.15.5:0/1432465834 learned_addr learned my addr 172.21.15.5:0/1432465834 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:21.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.171+0000 7fed59e30640 1 --2- 172.21.15.5:0/1432465834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed54160330 0x7fed54158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:21.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.171+0000 7fed5962f640 1 --2- 172.21.15.5:0/1432465834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed540c0f80 0x7fed54155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:21.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.171+0000 7fed58e2e640 1 -- 172.21.15.5:0/1432465834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed54160330 msgr2=0x7fed54158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:21.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.171+0000 7fed58e2e640 1 --2- 172.21.15.5:0/1432465834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed54160330 0x7fed54158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:21.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.171+0000 7fed58e2e640 1 -- 172.21.15.5:0/1432465834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed540c0f80 msgr2=0x7fed54155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:21.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.171+0000 7fed58e2e640 1 --2- 172.21.15.5:0/1432465834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed540c0f80 0x7fed54155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:21.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.171+0000 7fed58e2e640 1 -- 172.21.15.5:0/1432465834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed50009420 con 0x7fed540c8940 2023-07-14T13:09:21.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.171+0000 7fed5962f640 1 --2- 172.21.15.5:0/1432465834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed540c0f80 0x7fed54155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:21.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.171+0000 7fed58e2e640 1 --2- 172.21.15.5:0/1432465834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed540c8940 0x7fed54158950 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fed4400c7c0 tx=0x7fed4400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:21.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.171+0000 7fed49ffb640 1 -- 172.21.15.5:0/1432465834 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed44007a30 con 0x7fed540c8940 2023-07-14T13:09:21.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.171+0000 7fed49ffb640 1 -- 172.21.15.5:0/1432465834 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed44007b90 con 0x7fed540c8940 2023-07-14T13:09:21.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.171+0000 7fed49ffb640 1 -- 172.21.15.5:0/1432465834 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4400ce70 con 0x7fed540c8940 2023-07-14T13:09:21.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.171+0000 7fed5b893640 1 -- 172.21.15.5:0/1432465834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed540c3c40 con 0x7fed540c8940 2023-07-14T13:09:21.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.171+0000 7fed5b893640 1 -- 172.21.15.5:0/1432465834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed540c4200 con 0x7fed540c8940 2023-07-14T13:09:21.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.175+0000 7fed5b893640 1 -- 172.21.15.5:0/1432465834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed540678d0 con 0x7fed540c8940 2023-07-14T13:09:21.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.175+0000 7fed49ffb640 1 -- 172.21.15.5:0/1432465834 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fed440113f0 con 0x7fed540c8940 2023-07-14T13:09:21.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.175+0000 7fed49ffb640 1 --2- 172.21.15.5:0/1432465834 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fed380663a0 0x7fed38068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:21.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.175+0000 7fed49ffb640 1 -- 172.21.15.5:0/1432465834 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed44084420 con 0x7fed540c8940 2023-07-14T13:09:21.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.175+0000 7fed5962f640 1 --2- 172.21.15.5:0/1432465834 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fed380663a0 0x7fed38068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:21.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.175+0000 7fed5962f640 1 --2- 172.21.15.5:0/1432465834 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fed380663a0 0x7fed38068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fed500b2000 tx=0x7fed500aa070 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:21.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.179+0000 7fed49ffb640 1 -- 172.21.15.5:0/1432465834 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fed44051690 con 0x7fed540c8940 2023-07-14T13:09:21.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.355+0000 7fed5b893640 1 -- 172.21.15.5:0/1432465834 --> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fed54160700 con 0x7fed380663a0 2023-07-14T13:09:21.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.355+0000 7fed49ffb640 1 -- 172.21.15.5:0/1432465834 <== mgr.6691 v2:172.21.15.154:6832/3243469291 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fed50004140 con 0x7fed380663a0 2023-07-14T13:09:21.388 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-07-14T13:09:21.388 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:21.388 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs" 2023-07-14T13:09:21.388 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:21.388 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-07-14T13:09:21.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.359+0000 7fed5b893640 1 -- 172.21.15.5:0/1432465834 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fed380663a0 msgr2=0x7fed38068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:21.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.359+0000 7fed5b893640 1 --2- 172.21.15.5:0/1432465834 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fed380663a0 0x7fed38068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fed500b2000 tx=0x7fed500aa070 comp rx=0 tx=0).stop 2023-07-14T13:09:21.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.359+0000 7fed5b893640 1 -- 172.21.15.5:0/1432465834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed540c8940 msgr2=0x7fed54158950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:21.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.359+0000 7fed5b893640 1 --2- 172.21.15.5:0/1432465834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed540c8940 0x7fed54158950 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fed4400c7c0 tx=0x7fed4400cc80 comp rx=0 tx=0).stop 2023-07-14T13:09:21.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.359+0000 7fed5b893640 1 -- 172.21.15.5:0/1432465834 shutdown_connections 2023-07-14T13:09:21.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.359+0000 7fed5b893640 1 --2- 172.21.15.5:0/1432465834 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7fed380663a0 0x7fed38068850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:21.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.359+0000 7fed5b893640 1 --2- 172.21.15.5:0/1432465834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed54160330 0x7fed54158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:21.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.359+0000 7fed5b893640 1 --2- 172.21.15.5:0/1432465834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed540c8940 0x7fed54158950 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:21.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.359+0000 7fed5b893640 1 --2- 172.21.15.5:0/1432465834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed540c0f80 0x7fed54155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:21.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.359+0000 7fed5b893640 1 -- 172.21.15.5:0/1432465834 >> 172.21.15.5:0/1432465834 conn(0x7fed540afcf0 msgr2=0x7fed540cce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:21.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.359+0000 7fed5b893640 1 -- 172.21.15.5:0/1432465834 shutdown_connections 2023-07-14T13:09:21.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.359+0000 7fed5b893640 1 -- 172.21.15.5:0/1432465834 wait complete. 2023-07-14T13:09:21.409 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-14T13:09:21.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.527+0000 7f18e7711640 1 Processor -- start 2023-07-14T13:09:21.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.527+0000 7f18e7711640 1 -- start start 2023-07-14T13:09:21.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.527+0000 7f18e7711640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18e0164340 0x7f18e00cd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:21.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.527+0000 7f18e7711640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e00c89f0 con 0x7f18e006cf80 2023-07-14T13:09:21.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.527+0000 7f18e7711640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e00cbe50 con 0x7f18e01600b0 2023-07-14T13:09:21.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.527+0000 7f18e7711640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e00cc9d0 con 0x7f18e0164340 2023-07-14T13:09:21.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.527+0000 7f18e4cac640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18e0164340 0x7f18e00cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:21.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.527+0000 7f18e4cac640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18e0164340 0x7f18e00cd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53076/0 (socket says 172.21.15.5:53076) 2023-07-14T13:09:21.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.527+0000 7f18e4cac640 1 -- 172.21.15.5:0/620961882 learned_addr learned my addr 172.21.15.5:0/620961882 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:21.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.527+0000 7f18e5cae640 1 --1- 172.21.15.5:0/620961882 >> v1:172.21.15.5:6789/0 conn(0x7f18e006cf80 0x7f18e00c0b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57624/0 (socket says 172.21.15.5:57624) 2023-07-14T13:09:21.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.527+0000 7f18e4cac640 1 -- 172.21.15.5:0/620961882 >> v1:172.21.15.154:6789/0 conn(0x7f18e01600b0 legacy=0x7f18e0163c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:21.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.527+0000 7f18e4cac640 1 -- 172.21.15.5:0/620961882 >> v1:172.21.15.5:6789/0 conn(0x7f18e006cf80 legacy=0x7f18e00c0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:21.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.527+0000 7f18e4cac640 1 -- 172.21.15.5:0/620961882 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e00c9e20 con 0x7f18e0164340 2023-07-14T13:09:21.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.531+0000 7f18e4cac640 1 --2- 172.21.15.5:0/620961882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e0164340 0x7f18e00cd980 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f18d0009870 tx=0x7f18d001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc03e882191f6f65 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:21.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.531+0000 7f18d7fff640 1 -- 172.21.15.5:0/620961882 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d00aa430 con 0x7f18e0164340 2023-07-14T13:09:21.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.531+0000 7f18d7fff640 1 -- 172.21.15.5:0/620961882 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d00aa590 con 0x7f18e0164340 2023-07-14T13:09:21.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.531+0000 7f18d7fff640 1 -- 172.21.15.5:0/620961882 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d00aa920 con 0x7f18e0164340 2023-07-14T13:09:21.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.531+0000 7f18e7711640 1 -- 172.21.15.5:0/620961882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e0164340 msgr2=0x7f18e00cd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:21.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.531+0000 7f18e7711640 1 --2- 172.21.15.5:0/620961882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e0164340 0x7f18e00cd980 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f18d0009870 tx=0x7f18d001c4d0 comp rx=0 tx=0).stop 2023-07-14T13:09:21.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.531+0000 7f18e7711640 1 -- 172.21.15.5:0/620961882 shutdown_connections 2023-07-14T13:09:21.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.531+0000 7f18e7711640 1 --2- 172.21.15.5:0/620961882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e0164340 0x7f18e00cd980 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:21.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.531+0000 7f18e7711640 1 -- 172.21.15.5:0/620961882 >> 172.21.15.5:0/620961882 conn(0x7f18e00afac0 msgr2=0x7f18e00afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:21.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.531+0000 7f18e7711640 1 -- 172.21.15.5:0/620961882 shutdown_connections 2023-07-14T13:09:21.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.531+0000 7f18e7711640 1 -- 172.21.15.5:0/620961882 wait complete. 2023-07-14T13:09:21.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.535+0000 7f18e7711640 1 Processor -- start 2023-07-14T13:09:21.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.535+0000 7f18e7711640 1 -- start start 2023-07-14T13:09:21.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.535+0000 7f18e7711640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18e006cf80 0x7f18e0162490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:21.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.535+0000 7f18e7711640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18e01600b0 0x7f18e0154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:21.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.535+0000 7f18e7711640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e0164340 0x7f18e00c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:21.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.535+0000 7f18e7711640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e01552e0 con 0x7f18e0164340 2023-07-14T13:09:21.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.535+0000 7f18e7711640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e01629d0 con 0x7f18e006cf80 2023-07-14T13:09:21.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.535+0000 7f18e7711640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e01554d0 con 0x7f18e01600b0 2023-07-14T13:09:21.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.535+0000 7f18e5cae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e0164340 0x7f18e00c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:21.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.535+0000 7f18e5cae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e0164340 0x7f18e00c5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53080/0 (socket says 172.21.15.5:53080) 2023-07-14T13:09:21.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.535+0000 7f18e5cae640 1 -- 172.21.15.5:0/780376205 learned_addr learned my addr 172.21.15.5:0/780376205 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:21.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.535+0000 7f18e54ad640 1 --2- 172.21.15.5:0/780376205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18e006cf80 0x7f18e0162490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:21.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.535+0000 7f18e4cac640 1 --2- 172.21.15.5:0/780376205 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18e01600b0 0x7f18e0154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:21.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.535+0000 7f18e5cae640 1 -- 172.21.15.5:0/780376205 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18e01600b0 msgr2=0x7f18e0154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:21.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.535+0000 7f18e5cae640 1 --2- 172.21.15.5:0/780376205 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18e01600b0 0x7f18e0154110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:21.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.535+0000 7f18e5cae640 1 -- 172.21.15.5:0/780376205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18e006cf80 msgr2=0x7f18e0162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:21.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.535+0000 7f18e5cae640 1 --2- 172.21.15.5:0/780376205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18e006cf80 0x7f18e0162490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:21.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.535+0000 7f18e5cae640 1 -- 172.21.15.5:0/780376205 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d00094d0 con 0x7f18e0164340 2023-07-14T13:09:21.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.535+0000 7f18e5cae640 1 --2- 172.21.15.5:0/780376205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e0164340 0x7f18e00c5020 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f18d800c700 tx=0x7f18d800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:21.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.535+0000 7f18d5ffb640 1 -- 172.21.15.5:0/780376205 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d800ce10 con 0x7f18e0164340 2023-07-14T13:09:21.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.535+0000 7f18d5ffb640 1 -- 172.21.15.5:0/780376205 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d800a640 con 0x7f18e0164340 2023-07-14T13:09:21.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.535+0000 7f18d5ffb640 1 -- 172.21.15.5:0/780376205 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d800a9b0 con 0x7f18e0164340 2023-07-14T13:09:21.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.535+0000 7f18e7711640 1 -- 172.21.15.5:0/780376205 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e01557b0 con 0x7f18e0164340 2023-07-14T13:09:21.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.535+0000 7f18e7711640 1 -- 172.21.15.5:0/780376205 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e0155d70 con 0x7f18e0164340 2023-07-14T13:09:21.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.535+0000 7f18e7711640 1 -- 172.21.15.5:0/780376205 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e00678d0 con 0x7f18e0164340 2023-07-14T13:09:21.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.539+0000 7f18d5ffb640 1 -- 172.21.15.5:0/780376205 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f18d800ab10 con 0x7f18e0164340 2023-07-14T13:09:21.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.539+0000 7f18d5ffb640 1 --2- 172.21.15.5:0/780376205 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f18c40663a0 0x7f18c4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:21.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.539+0000 7f18d5ffb640 1 -- 172.21.15.5:0/780376205 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f18d8083660 con 0x7f18e0164340 2023-07-14T13:09:21.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.539+0000 7f18e54ad640 1 --2- 172.21.15.5:0/780376205 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f18c40663a0 0x7f18c4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:21.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.539+0000 7f18e54ad640 1 --2- 172.21.15.5:0/780376205 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f18c40663a0 0x7f18c4068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f18dc007fd0 tx=0x7f18dc007e40 comp rx=0 tx=0).ready entity=mgr.6691 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:21.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.543+0000 7f18d5ffb640 1 -- 172.21.15.5:0/780376205 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f18d80509e0 con 0x7f18e0164340 2023-07-14T13:09:21.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:21.735+0000 7f18e7711640 1 -- 172.21.15.5:0/780376205 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f18e0155f60 con 0x7f18e0164340 2023-07-14T13:09:22.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.515+0000 7f18d5ffb640 1 -- 172.21.15.5:0/780376205 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 38) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f18d8050db0 con 0x7f18e0164340 2023-07-14T13:09:22.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.519+0000 7f18d5ffb640 1 -- 172.21.15.5:0/780376205 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v38) v1 ==== 92+0+0 (secure 0 0 0) 0x7f18d8070bc0 con 0x7f18e0164340 2023-07-14T13:09:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.519+0000 7f18e7711640 1 -- 172.21.15.5:0/780376205 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f18c40663a0 msgr2=0x7f18c4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.519+0000 7f18e7711640 1 --2- 172.21.15.5:0/780376205 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f18c40663a0 0x7f18c4068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f18dc007fd0 tx=0x7f18dc007e40 comp rx=0 tx=0).stop 2023-07-14T13:09:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.519+0000 7f18e7711640 1 -- 172.21.15.5:0/780376205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e0164340 msgr2=0x7f18e00c5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.519+0000 7f18e7711640 1 --2- 172.21.15.5:0/780376205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e0164340 0x7f18e00c5020 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f18d800c700 tx=0x7f18d800cbc0 comp rx=0 tx=0).stop 2023-07-14T13:09:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.519+0000 7f18e7711640 1 -- 172.21.15.5:0/780376205 shutdown_connections 2023-07-14T13:09:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.519+0000 7f18e7711640 1 --2- 172.21.15.5:0/780376205 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f18c40663a0 0x7f18c4068850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.519+0000 7f18e7711640 1 --2- 172.21.15.5:0/780376205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e0164340 0x7f18e00c5020 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.519+0000 7f18e7711640 1 --2- 172.21.15.5:0/780376205 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18e01600b0 0x7f18e0154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.519+0000 7f18e7711640 1 --2- 172.21.15.5:0/780376205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18e006cf80 0x7f18e0162490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.519+0000 7f18e7711640 1 -- 172.21.15.5:0/780376205 >> 172.21.15.5:0/780376205 conn(0x7f18e00afac0 msgr2=0x7f18e00cdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.519+0000 7f18e7711640 1 -- 172.21.15.5:0/780376205 shutdown_connections 2023-07-14T13:09:22.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.523+0000 7f18e7711640 1 -- 172.21.15.5:0/780376205 wait complete. 2023-07-14T13:09:22.577 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-14T13:09:22.725 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:22.695+0000 7f10fc233180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:09:22.730 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:22.699+0000 7f9552646180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:09:22.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.703+0000 7f74b40d8640 1 Processor -- start 2023-07-14T13:09:22.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.703+0000 7f74b40d8640 1 -- start start 2023-07-14T13:09:22.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.703+0000 7f74b40d8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f74ac0d2fc0 0x7f74ac0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:22.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.703+0000 7f74b40d8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74ac0b04c0 con 0x7f74ac0d2300 2023-07-14T13:09:22.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.703+0000 7f74b40d8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74ac0d0aa0 con 0x7f74ac15bde0 2023-07-14T13:09:22.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.703+0000 7f74b40d8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74ac15c1b0 con 0x7f74ac0d2fc0 2023-07-14T13:09:22.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.703+0000 7f74b1673640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f74ac0d2fc0 0x7f74ac0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:22.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.703+0000 7f74b2675640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f74ac0d2300 0x7f74ac0cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57646/0 (socket says 172.21.15.5:57646) 2023-07-14T13:09:22.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.703+0000 7f74b2675640 1 -- 172.21.15.5:0/182191282 learned_addr learned my addr 172.21.15.5:0/182191282 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:22.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.707+0000 7f74b1673640 1 -- 172.21.15.5:0/182191282 >> v1:172.21.15.154:6789/0 conn(0x7f74ac15bde0 legacy=0x7f74ac0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:22.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.707+0000 7f74b1673640 1 -- 172.21.15.5:0/182191282 >> v1:172.21.15.5:6789/0 conn(0x7f74ac0d2300 legacy=0x7f74ac0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:22.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.707+0000 7f74b1673640 1 -- 172.21.15.5:0/182191282 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ac0afb90 con 0x7f74ac0d2fc0 2023-07-14T13:09:22.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.707+0000 7f74b1673640 1 --2- 172.21.15.5:0/182191282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74ac0d2fc0 0x7f74ac0b0950 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f749c0097c0 tx=0x7f749c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb31ba336eabf0c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:22.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.707+0000 7f74b0e72640 1 -- 172.21.15.5:0/182191282 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c0ab680 con 0x7f74ac0d2fc0 2023-07-14T13:09:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.707+0000 7f74b0e72640 1 -- 172.21.15.5:0/182191282 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749c0ab7e0 con 0x7f74ac0d2fc0 2023-07-14T13:09:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.707+0000 7f74b0e72640 1 -- 172.21.15.5:0/182191282 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c0abb70 con 0x7f74ac0d2fc0 2023-07-14T13:09:22.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.711+0000 7f74b40d8640 1 -- 172.21.15.5:0/182191282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74ac0d2fc0 msgr2=0x7f74ac0b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.711+0000 7f74b40d8640 1 --2- 172.21.15.5:0/182191282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74ac0d2fc0 0x7f74ac0b0950 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f749c0097c0 tx=0x7f749c01c480 comp rx=0 tx=0).stop 2023-07-14T13:09:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.711+0000 7f74b40d8640 1 -- 172.21.15.5:0/182191282 shutdown_connections 2023-07-14T13:09:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.711+0000 7f74b40d8640 1 --2- 172.21.15.5:0/182191282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74ac0d2fc0 0x7f74ac0b0950 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.711+0000 7f74b40d8640 1 -- 172.21.15.5:0/182191282 >> 172.21.15.5:0/182191282 conn(0x7f74ac0659d0 msgr2=0x7f74ac09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.711+0000 7f74b40d8640 1 -- 172.21.15.5:0/182191282 shutdown_connections 2023-07-14T13:09:22.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.711+0000 7f74b40d8640 1 -- 172.21.15.5:0/182191282 wait complete. 2023-07-14T13:09:22.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.711+0000 7f74b40d8640 1 Processor -- start 2023-07-14T13:09:22.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.711+0000 7f74b40d8640 1 -- start start 2023-07-14T13:09:22.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.711+0000 7f74b40d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74ac0d2300 0x7f74ac15d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:22.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.711+0000 7f74b40d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74ac0d2fc0 0x7f74ac0b1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:22.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.711+0000 7f74b40d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74ac15bde0 0x7f74ac0b75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:22.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.711+0000 7f74b40d8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac15dc10 con 0x7f74ac0d2fc0 2023-07-14T13:09:22.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.711+0000 7f74b40d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac0c7310 con 0x7f74ac15bde0 2023-07-14T13:09:22.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.711+0000 7f74b40d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac15d960 con 0x7f74ac0d2300 2023-07-14T13:09:22.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.711+0000 7f74b1673640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74ac0d2fc0 0x7f74ac0b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:22.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.711+0000 7f74b1673640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74ac0d2fc0 0x7f74ac0b1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53102/0 (socket says 172.21.15.5:53102) 2023-07-14T13:09:22.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.711+0000 7f74b1673640 1 -- 172.21.15.5:0/3823987489 learned_addr learned my addr 172.21.15.5:0/3823987489 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:22.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.711+0000 7f74b1e74640 1 --2- 172.21.15.5:0/3823987489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74ac0d2300 0x7f74ac15d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:22.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.711+0000 7f74b2675640 1 --2- 172.21.15.5:0/3823987489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74ac15bde0 0x7f74ac0b75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:22.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.711+0000 7f74b1673640 1 -- 172.21.15.5:0/3823987489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74ac0d2300 msgr2=0x7f74ac15d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.711+0000 7f74b1673640 1 --2- 172.21.15.5:0/3823987489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74ac0d2300 0x7f74ac15d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.711+0000 7f74b1673640 1 -- 172.21.15.5:0/3823987489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74ac15bde0 msgr2=0x7f74ac0b75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.711+0000 7f74b1673640 1 --2- 172.21.15.5:0/3823987489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74ac15bde0 0x7f74ac0b75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.711+0000 7f74b1673640 1 -- 172.21.15.5:0/3823987489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f749c009420 con 0x7f74ac0d2fc0 2023-07-14T13:09:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.715+0000 7f74b1673640 1 --2- 172.21.15.5:0/3823987489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74ac0d2fc0 0x7f74ac0b1190 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f749c0ad040 tx=0x7f749c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.715+0000 7f74a27fc640 1 -- 172.21.15.5:0/3823987489 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c0b5810 con 0x7f74ac0d2fc0 2023-07-14T13:09:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.715+0000 7f74a27fc640 1 -- 172.21.15.5:0/3823987489 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749c0b59b0 con 0x7f74ac0d2fc0 2023-07-14T13:09:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.715+0000 7f74a27fc640 1 -- 172.21.15.5:0/3823987489 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c0b5d60 con 0x7f74ac0d2fc0 2023-07-14T13:09:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.715+0000 7f74b40d8640 1 -- 172.21.15.5:0/3823987489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ac0c7520 con 0x7f74ac0d2fc0 2023-07-14T13:09:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.715+0000 7f74b40d8640 1 -- 172.21.15.5:0/3823987489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74ac0c7ae0 con 0x7f74ac0d2fc0 2023-07-14T13:09:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.715+0000 7f74b40d8640 1 -- 172.21.15.5:0/3823987489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74ac0678d0 con 0x7f74ac0d2fc0 2023-07-14T13:09:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.715+0000 7f74a27fc640 1 -- 172.21.15.5:0/3823987489 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f749c0b4390 con 0x7f74ac0d2fc0 2023-07-14T13:09:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.715+0000 7f74a27fc640 1 --2- 172.21.15.5:0/3823987489 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f74900663f0 0x7f74900688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.715+0000 7f74a27fc640 1 -- 172.21.15.5:0/3823987489 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f749c11ec80 con 0x7f74ac0d2fc0 2023-07-14T13:09:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.715+0000 7f74b1e74640 1 -- 172.21.15.5:0/3823987489 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f74900663f0 msgr2=0x7f74900688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3243469291 2023-07-14T13:09:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.715+0000 7f74b1e74640 1 --2- 172.21.15.5:0/3823987489 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f74900663f0 0x7f74900688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:09:22.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.719+0000 7f74a27fc640 1 -- 172.21.15.5:0/3823987489 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f749c0ebef0 con 0x7f74ac0d2fc0 2023-07-14T13:09:22.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.883+0000 7f74b40d8640 1 -- 172.21.15.5:0/3823987489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f74ac0ced80 con 0x7f74ac0d2fc0 2023-07-14T13:09:22.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.887+0000 7f74a27fc640 1 -- 172.21.15.5:0/3823987489 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f749c0ef510 con 0x7f74ac0d2fc0 2023-07-14T13:09:22.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.887+0000 7f74b40d8640 1 -- 172.21.15.5:0/3823987489 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f74900663f0 msgr2=0x7f74900688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:09:22.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.887+0000 7f74b40d8640 1 --2- 172.21.15.5:0/3823987489 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f74900663f0 0x7f74900688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.887+0000 7f74b40d8640 1 -- 172.21.15.5:0/3823987489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74ac0d2fc0 msgr2=0x7f74ac0b1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.887+0000 7f74b40d8640 1 --2- 172.21.15.5:0/3823987489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74ac0d2fc0 0x7f74ac0b1190 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f749c0ad040 tx=0x7f749c01acc0 comp rx=0 tx=0).stop 2023-07-14T13:09:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.887+0000 7f74b40d8640 1 -- 172.21.15.5:0/3823987489 shutdown_connections 2023-07-14T13:09:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.887+0000 7f74b40d8640 1 --2- 172.21.15.5:0/3823987489 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f74900663f0 0x7f74900688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.887+0000 7f74b40d8640 1 --2- 172.21.15.5:0/3823987489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74ac15bde0 0x7f74ac0b75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.887+0000 7f74b40d8640 1 --2- 172.21.15.5:0/3823987489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74ac0d2fc0 0x7f74ac0b1190 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:22.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.887+0000 7f74b40d8640 1 --2- 172.21.15.5:0/3823987489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74ac0d2300 0x7f74ac15d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:22.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.887+0000 7f74b40d8640 1 -- 172.21.15.5:0/3823987489 >> 172.21.15.5:0/3823987489 conn(0x7f74ac0659d0 msgr2=0x7f74ac0aefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:22.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.887+0000 7f74b40d8640 1 -- 172.21.15.5:0/3823987489 shutdown_connections 2023-07-14T13:09:22.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:22.887+0000 7f74b40d8640 1 -- 172.21.15.5:0/3823987489 wait complete. 2023-07-14T13:09:22.939 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-14T13:09:23.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.059+0000 7f624c900640 1 Processor -- start 2023-07-14T13:09:23.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.059+0000 7f624c900640 1 -- start start 2023-07-14T13:09:23.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.059+0000 7f624c900640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6248069430 0x7f6248069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:23.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.059+0000 7f624c900640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62480af2b0 0x7f624815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:23.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.059+0000 7f624c900640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6248159d70 con 0x7f6248070f30 2023-07-14T13:09:23.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.059+0000 7f624c900640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6248069d40 con 0x7f6248069430 2023-07-14T13:09:23.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.059+0000 7f624c900640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62480c9c60 con 0x7f62480af2b0 2023-07-14T13:09:23.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.059+0000 7f624659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6248069430 0x7f6248069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:23.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.059+0000 7f6245d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6248070f30 0x7f62480ad6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57658/0 (socket says 172.21.15.5:57658) 2023-07-14T13:09:23.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.059+0000 7f624659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6248069430 0x7f6248069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53110/0 (socket says 172.21.15.5:53110) 2023-07-14T13:09:23.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.059+0000 7f6245d9b640 1 -- 172.21.15.5:0/738331278 learned_addr learned my addr 172.21.15.5:0/738331278 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:23.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.059+0000 7f6246d9d640 1 --2- 172.21.15.5:0/738331278 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62480af2b0 0x7f624815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:23.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.059+0000 7f624659c640 1 -- 172.21.15.5:0/738331278 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62480af2b0 msgr2=0x7f624815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:23.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.059+0000 7f624659c640 1 --2- 172.21.15.5:0/738331278 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62480af2b0 0x7f624815a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:23.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.059+0000 7f624659c640 1 -- 172.21.15.5:0/738331278 >> v1:172.21.15.5:6789/0 conn(0x7f6248070f30 legacy=0x7f62480ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:23.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.059+0000 7f624659c640 1 -- 172.21.15.5:0/738331278 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62480c9f40 con 0x7f6248069430 2023-07-14T13:09:23.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.059+0000 7f624559a640 1 -- 172.21.15.5:0/738331278 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3157627639 0 0) 0x7f623c001120 con 0x7f6248070f30 2023-07-14T13:09:23.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.063+0000 7f624659c640 1 --2- 172.21.15.5:0/738331278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6248069430 0x7f6248069800 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f62380097c0 tx=0x7f623801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bea9a5a5eceb503 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:23.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.063+0000 7f624559a640 1 -- 172.21.15.5:0/738331278 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62380ab680 con 0x7f6248069430 2023-07-14T13:09:23.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.063+0000 7f624559a640 1 -- 172.21.15.5:0/738331278 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62380ab7e0 con 0x7f6248069430 2023-07-14T13:09:23.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.063+0000 7f624559a640 1 -- 172.21.15.5:0/738331278 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62380abb70 con 0x7f6248069430 2023-07-14T13:09:23.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.063+0000 7f624c900640 1 -- 172.21.15.5:0/738331278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6248069430 msgr2=0x7f6248069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:23.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.063+0000 7f624c900640 1 --2- 172.21.15.5:0/738331278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6248069430 0x7f6248069800 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f62380097c0 tx=0x7f623801c480 comp rx=0 tx=0).stop 2023-07-14T13:09:23.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.063+0000 7f624c900640 1 -- 172.21.15.5:0/738331278 shutdown_connections 2023-07-14T13:09:23.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.063+0000 7f624c900640 1 --2- 172.21.15.5:0/738331278 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62480af2b0 0x7f624815a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:23.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.063+0000 7f624c900640 1 --2- 172.21.15.5:0/738331278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6248069430 0x7f6248069800 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:23.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.063+0000 7f624c900640 1 -- 172.21.15.5:0/738331278 >> 172.21.15.5:0/738331278 conn(0x7f62480cde90 msgr2=0x7f62480ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:23.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.063+0000 7f624c900640 1 -- 172.21.15.5:0/738331278 shutdown_connections 2023-07-14T13:09:23.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.063+0000 7f624c900640 1 -- 172.21.15.5:0/738331278 wait complete. 2023-07-14T13:09:23.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.067+0000 7f624c900640 1 Processor -- start 2023-07-14T13:09:23.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.067+0000 7f624c900640 1 -- start start 2023-07-14T13:09:23.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.067+0000 7f624c900640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6248069430 0x7f62480ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:23.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.067+0000 7f624c900640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6248070f30 0x7f62480c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:23.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.067+0000 7f624c900640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62480af2b0 0x7f624813f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:23.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.067+0000 7f624c900640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6248154ee0 con 0x7f6248069430 2023-07-14T13:09:23.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.067+0000 7f624c900640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6248155d40 con 0x7f6248070f30 2023-07-14T13:09:23.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.067+0000 7f624c900640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6248155130 con 0x7f62480af2b0 2023-07-14T13:09:23.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.067+0000 7f624659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6248069430 0x7f62480ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:23.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.067+0000 7f624659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6248069430 0x7f62480ab890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53116/0 (socket says 172.21.15.5:53116) 2023-07-14T13:09:23.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.067+0000 7f624659c640 1 -- 172.21.15.5:0/1382565925 learned_addr learned my addr 172.21.15.5:0/1382565925 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:23.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.067+0000 7f6245d9b640 1 --2- 172.21.15.5:0/1382565925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6248070f30 0x7f62480c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:23.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.067+0000 7f6246d9d640 1 --2- 172.21.15.5:0/1382565925 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62480af2b0 0x7f624813f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:23.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.067+0000 7f624659c640 1 -- 172.21.15.5:0/1382565925 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62480af2b0 msgr2=0x7f624813f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:23.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.067+0000 7f624659c640 1 --2- 172.21.15.5:0/1382565925 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62480af2b0 0x7f624813f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:23.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.067+0000 7f624659c640 1 -- 172.21.15.5:0/1382565925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6248070f30 msgr2=0x7f62480c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:23.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.067+0000 7f624659c640 1 --2- 172.21.15.5:0/1382565925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6248070f30 0x7f62480c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:23.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.067+0000 7f624659c640 1 -- 172.21.15.5:0/1382565925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6238009420 con 0x7f6248069430 2023-07-14T13:09:23.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.067+0000 7f624659c640 1 --2- 172.21.15.5:0/1382565925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6248069430 0x7f62480ab890 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f623801a0b0 tx=0x7f623801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:23.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.067+0000 7f6236ffd640 1 -- 172.21.15.5:0/1382565925 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6238004220 con 0x7f6248069430 2023-07-14T13:09:23.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.067+0000 7f6236ffd640 1 -- 172.21.15.5:0/1382565925 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62380b9070 con 0x7f6248069430 2023-07-14T13:09:23.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.067+0000 7f6236ffd640 1 -- 172.21.15.5:0/1382565925 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6238003620 con 0x7f6248069430 2023-07-14T13:09:23.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.067+0000 7f624c900640 1 -- 172.21.15.5:0/1382565925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6248155410 con 0x7f6248069430 2023-07-14T13:09:23.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.067+0000 7f624c900640 1 -- 172.21.15.5:0/1382565925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62481559d0 con 0x7f6248069430 2023-07-14T13:09:23.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.071+0000 7f624c900640 1 -- 172.21.15.5:0/1382565925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62480678d0 con 0x7f6248069430 2023-07-14T13:09:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.071+0000 7f6236ffd640 1 -- 172.21.15.5:0/1382565925 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f6238003780 con 0x7f6248069430 2023-07-14T13:09:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.071+0000 7f6236ffd640 1 --2- 172.21.15.5:0/1382565925 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f62280663f0 0x7f62280688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.071+0000 7f6236ffd640 1 -- 172.21.15.5:0/1382565925 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f62380bb070 con 0x7f6248069430 2023-07-14T13:09:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.071+0000 7f6245d9b640 1 -- 172.21.15.5:0/1382565925 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f62280663f0 msgr2=0x7f62280688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3243469291 2023-07-14T13:09:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.071+0000 7f6245d9b640 1 --2- 172.21.15.5:0/1382565925 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f62280663f0 0x7f62280688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:09:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.075+0000 7f6236ffd640 1 -- 172.21.15.5:0/1382565925 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f62380ebeb0 con 0x7f6248069430 2023-07-14T13:09:23.148 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:23.115+0000 7f10fc233180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:09:23.179 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:23.147+0000 7f9552646180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:09:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.235+0000 7f624c900640 1 -- 172.21.15.5:0/1382565925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f62480aeb80 con 0x7f6248069430 2023-07-14T13:09:23.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.239+0000 7f6236ffd640 1 -- 172.21.15.5:0/1382565925 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v30)=0 v30) v1 ==== 133+0+0 (secure 0 0 0) 0x7f62380c40c0 con 0x7f6248069430 2023-07-14T13:09:23.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.243+0000 7f624c900640 1 -- 172.21.15.5:0/1382565925 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f62280663f0 msgr2=0x7f62280688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:09:23.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.243+0000 7f624c900640 1 --2- 172.21.15.5:0/1382565925 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f62280663f0 0x7f62280688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:23.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.243+0000 7f624c900640 1 -- 172.21.15.5:0/1382565925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6248069430 msgr2=0x7f62480ab890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:23.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.243+0000 7f624c900640 1 --2- 172.21.15.5:0/1382565925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6248069430 0x7f62480ab890 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f623801a0b0 tx=0x7f623801acc0 comp rx=0 tx=0).stop 2023-07-14T13:09:23.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.243+0000 7f624c900640 1 -- 172.21.15.5:0/1382565925 shutdown_connections 2023-07-14T13:09:23.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.243+0000 7f624c900640 1 --2- 172.21.15.5:0/1382565925 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f62280663f0 0x7f62280688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:23.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.243+0000 7f624c900640 1 --2- 172.21.15.5:0/1382565925 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62480af2b0 0x7f624813f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:23.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.243+0000 7f624c900640 1 --2- 172.21.15.5:0/1382565925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6248070f30 0x7f62480c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:23.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.243+0000 7f624c900640 1 --2- 172.21.15.5:0/1382565925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6248069430 0x7f62480ab890 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:23.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.243+0000 7f624c900640 1 -- 172.21.15.5:0/1382565925 >> 172.21.15.5:0/1382565925 conn(0x7f62480cde90 msgr2=0x7f62480cc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:23.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.243+0000 7f624c900640 1 -- 172.21.15.5:0/1382565925 shutdown_connections 2023-07-14T13:09:23.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.243+0000 7f624c900640 1 -- 172.21.15.5:0/1382565925 wait complete. 2023-07-14T13:09:23.292 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-07-14T13:09:23.301 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:23.271+0000 7f10fc233180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:09:23.341 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:23.311+0000 7f9552646180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:09:23.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.411+0000 7f2fe4c7b640 1 Processor -- start 2023-07-14T13:09:23.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.415+0000 7f2fe4c7b640 1 -- start start 2023-07-14T13:09:23.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.415+0000 7f2fe4c7b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2fe015bde0 0x7f2fe00d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:23.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.415+0000 7f2fe4c7b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe00b04c0 con 0x7f2fe00d2fc0 2023-07-14T13:09:23.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.415+0000 7f2fe4c7b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe00b1060 con 0x7f2fe00d2300 2023-07-14T13:09:23.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.415+0000 7f2fe4c7b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe015c1b0 con 0x7f2fe015bde0 2023-07-14T13:09:23.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.415+0000 7f2fde59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2fe015bde0 0x7f2fe00d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:23.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.415+0000 7f2fde59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2fe015bde0 0x7f2fe00d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53122/0 (socket says 172.21.15.5:53122) 2023-07-14T13:09:23.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.415+0000 7f2fde59c640 1 -- 172.21.15.5:0/3167867509 learned_addr learned my addr 172.21.15.5:0/3167867509 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:23.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.415+0000 7f2fddd9b640 1 --1- 172.21.15.5:0/3167867509 >> v1:172.21.15.5:6789/0 conn(0x7f2fe00d2fc0 0x7f2fe00b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57674/0 (socket says 172.21.15.5:57674) 2023-07-14T13:09:23.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.415+0000 7f2fde59c640 1 -- 172.21.15.5:0/3167867509 >> v1:172.21.15.154:6789/0 conn(0x7f2fe00d2300 legacy=0x7f2fe00cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:23.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.415+0000 7f2fde59c640 1 -- 172.21.15.5:0/3167867509 >> v1:172.21.15.5:6789/0 conn(0x7f2fe00d2fc0 legacy=0x7f2fe00b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:23.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.415+0000 7f2fde59c640 1 -- 172.21.15.5:0/3167867509 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe00d0aa0 con 0x7f2fe015bde0 2023-07-14T13:09:23.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.415+0000 7f2fdd59a640 1 -- 172.21.15.5:0/3167867509 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4081464509 0 0) 0x7f2fe00b04c0 con 0x7f2fe00d2fc0 2023-07-14T13:09:23.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.419+0000 7f2fde59c640 1 --2- 172.21.15.5:0/3167867509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fe015bde0 0x7f2fe00d0270 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0006fd0 tx=0x7f2fd001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93ad6cea6f1d69f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:23.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.419+0000 7f2fdd59a640 1 -- 172.21.15.5:0/3167867509 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd00aa680 con 0x7f2fe015bde0 2023-07-14T13:09:23.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.419+0000 7f2fdd59a640 1 -- 172.21.15.5:0/3167867509 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd00aa7e0 con 0x7f2fe015bde0 2023-07-14T13:09:23.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.419+0000 7f2fdd59a640 1 -- 172.21.15.5:0/3167867509 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd00aab70 con 0x7f2fe015bde0 2023-07-14T13:09:23.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.419+0000 7f2fe4c7b640 1 -- 172.21.15.5:0/3167867509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fe015bde0 msgr2=0x7f2fe00d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:23.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.419+0000 7f2fe4c7b640 1 --2- 172.21.15.5:0/3167867509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fe015bde0 0x7f2fe00d0270 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0006fd0 tx=0x7f2fd001c520 comp rx=0 tx=0).stop 2023-07-14T13:09:23.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.419+0000 7f2fe4c7b640 1 -- 172.21.15.5:0/3167867509 shutdown_connections 2023-07-14T13:09:23.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.419+0000 7f2fe4c7b640 1 --2- 172.21.15.5:0/3167867509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fe015bde0 0x7f2fe00d0270 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:23.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.419+0000 7f2fe4c7b640 1 -- 172.21.15.5:0/3167867509 >> 172.21.15.5:0/3167867509 conn(0x7f2fe00659d0 msgr2=0x7f2fe009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:23.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.419+0000 7f2fe4c7b640 1 -- 172.21.15.5:0/3167867509 shutdown_connections 2023-07-14T13:09:23.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.419+0000 7f2fe4c7b640 1 -- 172.21.15.5:0/3167867509 wait complete. 2023-07-14T13:09:23.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.423+0000 7f2fe4c7b640 1 Processor -- start 2023-07-14T13:09:23.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.423+0000 7f2fe4c7b640 1 -- start start 2023-07-14T13:09:23.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.423+0000 7f2fe4c7b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fe00d2300 0x7f2fe006b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:23.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.423+0000 7f2fe4c7b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2fe00d2fc0 0x7f2fe014d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:23.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.423+0000 7f2fe4c7b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fe015bde0 0x7f2fe01535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:23.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.423+0000 7f2fe4c7b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe006beb0 con 0x7f2fe00d2300 2023-07-14T13:09:23.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.423+0000 7f2fe4c7b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe00b2c70 con 0x7f2fe015bde0 2023-07-14T13:09:23.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.423+0000 7f2fe4c7b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe00b3510 con 0x7f2fe00d2fc0 2023-07-14T13:09:23.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.423+0000 7f2fde59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fe00d2300 0x7f2fe006b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:23.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.423+0000 7f2fde59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fe00d2300 0x7f2fe006b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53138/0 (socket says 172.21.15.5:53138) 2023-07-14T13:09:23.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.423+0000 7f2fde59c640 1 -- 172.21.15.5:0/1068295333 learned_addr learned my addr 172.21.15.5:0/1068295333 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:23.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.423+0000 7f2fddd9b640 1 --2- 172.21.15.5:0/1068295333 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2fe00d2fc0 0x7f2fe014d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:23.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.423+0000 7f2fded9d640 1 --2- 172.21.15.5:0/1068295333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fe015bde0 0x7f2fe01535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:23.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.423+0000 7f2fde59c640 1 -- 172.21.15.5:0/1068295333 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2fe00d2fc0 msgr2=0x7f2fe014d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:23.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.423+0000 7f2fde59c640 1 --2- 172.21.15.5:0/1068295333 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2fe00d2fc0 0x7f2fe014d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:23.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.423+0000 7f2fde59c640 1 -- 172.21.15.5:0/1068295333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fe015bde0 msgr2=0x7f2fe01535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:23.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.423+0000 7f2fde59c640 1 --2- 172.21.15.5:0/1068295333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fe015bde0 0x7f2fe01535d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:23.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.423+0000 7f2fde59c640 1 -- 172.21.15.5:0/1068295333 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd0009480 con 0x7f2fe00d2300 2023-07-14T13:09:23.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.423+0000 7f2fde59c640 1 --2- 172.21.15.5:0/1068295333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fe00d2300 0x7f2fe006b970 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f2fd001ca00 tx=0x7f2fd00192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:23.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.423+0000 7f2fceffd640 1 -- 172.21.15.5:0/1068295333 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd00aab50 con 0x7f2fe00d2300 2023-07-14T13:09:23.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.423+0000 7f2fceffd640 1 -- 172.21.15.5:0/1068295333 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd00aacb0 con 0x7f2fe00d2300 2023-07-14T13:09:23.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.423+0000 7f2fceffd640 1 -- 172.21.15.5:0/1068295333 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0003840 con 0x7f2fe00d2300 2023-07-14T13:09:23.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.423+0000 7f2fe4c7b640 1 -- 172.21.15.5:0/1068295333 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe00c8d90 con 0x7f2fe00d2300 2023-07-14T13:09:23.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.423+0000 7f2fe4c7b640 1 -- 172.21.15.5:0/1068295333 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe00b31a0 con 0x7f2fe00d2300 2023-07-14T13:09:23.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.423+0000 7f2fe4c7b640 1 -- 172.21.15.5:0/1068295333 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe00678d0 con 0x7f2fe00d2300 2023-07-14T13:09:23.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.427+0000 7f2fceffd640 1 -- 172.21.15.5:0/1068295333 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f2fd00039a0 con 0x7f2fe00d2300 2023-07-14T13:09:23.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.427+0000 7f2fceffd640 1 --2- 172.21.15.5:0/1068295333 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2fc0066420 0x7f2fc00688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:23.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.427+0000 7f2fceffd640 1 -- 172.21.15.5:0/1068295333 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2fd011e710 con 0x7f2fe00d2300 2023-07-14T13:09:23.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.427+0000 7f2fddd9b640 1 -- 172.21.15.5:0/1068295333 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2fc0066420 msgr2=0x7f2fc00688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3243469291 2023-07-14T13:09:23.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.427+0000 7f2fddd9b640 1 --2- 172.21.15.5:0/1068295333 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2fc0066420 0x7f2fc00688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:09:23.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.435+0000 7f2fceffd640 1 -- 172.21.15.5:0/1068295333 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2fd00eba10 con 0x7f2fe00d2300 2023-07-14T13:09:23.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.607+0000 7f2fe4c7b640 1 -- 172.21.15.5:0/1068295333 --> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2fe00d07b0 con 0x7f2fc0066420 2023-07-14T13:09:23.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.631+0000 7f2fddd9b640 1 -- 172.21.15.5:0/1068295333 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2fc0066420 msgr2=0x7f2fc00688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3243469291 2023-07-14T13:09:23.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:23.631+0000 7f2fddd9b640 1 --2- 172.21.15.5:0/1068295333 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2fc0066420 0x7f2fc00688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-14T13:09:23.786 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:23.755+0000 7f10fc233180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:09:23.845 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:23.811+0000 7f10fc233180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:09:23.854 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:23.823+0000 7f9552646180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:09:23.901 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:23.867+0000 7f10fc233180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:09:23.915 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:23.883+0000 7f9552646180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:09:23.973 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:23.943+0000 7f9552646180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:09:23.987 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:23.955+0000 7f10fc233180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:09:24.045 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:24.015+0000 7f10fc233180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:09:24.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:24.035+0000 7f2fddd9b640 1 -- 172.21.15.5:0/1068295333 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2fc0066420 msgr2=0x7f2fc00688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3243469291 2023-07-14T13:09:24.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:24.035+0000 7f2fddd9b640 1 --2- 172.21.15.5:0/1068295333 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2fc0066420 0x7f2fc00688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-14T13:09:24.065 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:24.035+0000 7f9552646180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:09:24.124 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:24.095+0000 7f9552646180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:09:24.130 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:24.099+0000 7f10fc233180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:09:24.187 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:24.155+0000 7f10fc233180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:09:24.212 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:24.179+0000 7f9552646180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:09:24.270 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:24.239+0000 7f9552646180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:09:24.330 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:24.299+0000 7f10fc233180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:09:24.388 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:24.355+0000 7f10fc233180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:09:24.419 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:24.387+0000 7f9552646180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:09:24.481 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:24.451+0000 7f9552646180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:09:24.632 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:09:24.632 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:09:24.632 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:09:24.639 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:24.607+0000 7f10fc233180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:09:24.730 INFO:tasks.ceph.mgr.y.smithi005.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:09:24.730 INFO:tasks.ceph.mgr.y.smithi005.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:09:24.730 INFO:tasks.ceph.mgr.y.smithi005.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:09:24.738 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:24.707+0000 7f9552646180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:09:24.773 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:24.743+0000 7f10fc233180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:09:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:24.839+0000 7f2fddd9b640 1 -- 172.21.15.5:0/1068295333 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2fc0066420 msgr2=0x7f2fc00688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3243469291 2023-07-14T13:09:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:24.839+0000 7f2fddd9b640 1 --2- 172.21.15.5:0/1068295333 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2fc0066420 0x7f2fc00688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-14T13:09:24.878 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:24.847+0000 7f9552646180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:09:24.899 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:24.867+0000 7f10fc233180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:09:24.971 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:24.939+0000 7f10fc233180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:09:25.009 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:24.979+0000 7f9552646180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:09:25.083 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:25.051+0000 7f9552646180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:09:25.106 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:25.075+0000 7f10fc233180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:09:25.224 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:25.191+0000 7f9552646180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:09:25.653 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:25.619+0000 7f10fc233180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:09:25.738 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:25.707+0000 7f10fc233180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:09:25.792 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:25.763+0000 7f9552646180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:09:25.880 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:25.851+0000 7f9552646180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:09:25.888 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:25.855+0000 7f10fc233180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:09:25.973 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:25.939+0000 7f10fc233180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:09:26.035 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:26.003+0000 7f9552646180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:09:26.122 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:26.091+0000 7f9552646180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:09:26.246 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:26.215+0000 7f10fc233180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:09:26.307 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:26.275+0000 7f10fc233180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:09:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:26.287+0000 7f2fceffd640 1 -- 172.21.15.5:0/1068295333 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 39) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f2fd00ebde0 con 0x7f2fe00d2300 2023-07-14T13:09:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:26.287+0000 7f2fceffd640 1 -- 172.21.15.5:0/1068295333 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2fc0066420 msgr2=0x7f2fc00688d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:09:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:26.287+0000 7f2fceffd640 1 --2- 172.21.15.5:0/1068295333 >> [v2:172.21.15.154:6832/3243469291,v1:172.21.15.154:6833/3243469291] conn(0x7f2fc0066420 0x7f2fc00688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:26.425 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:26.395+0000 7f9552646180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:09:26.442 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:26.411+0000 7f107b39b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:09:26.443 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:26.411+0000 7f107b39b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:09:26.443 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:26.411+0000 7f107b39b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:09:26.443 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:26.411+0000 7f107b39b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:09:26.443 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:26.411+0000 7f107b39b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:09:26.443 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:26.411+0000 7f107e3a1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:09:26.443 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:26.411+0000 7f107e3a1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:09:26.444 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:26.411+0000 7f107e3a1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:09:26.444 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:26.411+0000 7f107e3a1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:09:26.444 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:26.411+0000 7f107e3a1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:09:26.490 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:26.459+0000 7f9552646180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:09:27.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.295+0000 7f2fceffd640 1 -- 172.21.15.5:0/1068295333 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mgrmap(e 40) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f2fd011c610 con 0x7f2fe00d2300 2023-07-14T13:09:27.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.295+0000 7f2fceffd640 1 --2- 172.21.15.5:0/1068295333 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f2fc0033ce0 0x7f2fc00708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:27.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.295+0000 7f2fceffd640 1 -- 172.21.15.5:0/1068295333 --> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2fc00340b0 con 0x7f2fc0033ce0 2023-07-14T13:09:27.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.295+0000 7f2fddd9b640 1 --2- 172.21.15.5:0/1068295333 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f2fc0033ce0 0x7f2fc00708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:27.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.299+0000 7f2fddd9b640 1 --2- 172.21.15.5:0/1068295333 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f2fc0033ce0 0x7f2fc00708f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4007a90 tx=0x7f2fd40079e0 comp rx=0 tx=0).ready entity=mgr.6347 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:27.340 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:27.307+0000 7f10853af640 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-07-14T13:09:27.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.307+0000 7f2fceffd640 1 -- 172.21.15.5:0/1068295333 <== mgr.6347 v2:172.21.15.154:6832/714349479 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f2fc00340b0 con 0x7f2fc0033ce0 2023-07-14T13:09:27.340 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-07-14T13:09:27.349 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-07-14T13:09:27.350 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-14T13:09:27.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.471+0000 7f61b9537640 1 Processor -- start 2023-07-14T13:09:27.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.471+0000 7f61b9537640 1 -- start start 2023-07-14T13:09:27.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.471+0000 7f61b9537640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61b40b3df0 0x7f61b40b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:27.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.471+0000 7f61b9537640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f61b40c81b0 0x7f61b40c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:27.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.471+0000 7f61b9537640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61b40b4700 con 0x7f61b415bdb0 2023-07-14T13:09:27.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.471+0000 7f61b9537640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b40c85c0 con 0x7f61b40c81b0 2023-07-14T13:09:27.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.471+0000 7f61b9537640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b406baf0 con 0x7f61b40b3df0 2023-07-14T13:09:27.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.471+0000 7f61abfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f61b415bdb0 0x7f61b40c7aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57676/0 (socket says 172.21.15.5:57676) 2023-07-14T13:09:27.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.471+0000 7f61abfff640 1 -- 172.21.15.5:0/2422965125 learned_addr learned my addr 172.21.15.5:0/2422965125 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:27.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.471+0000 7f61b37fe640 1 --2- 172.21.15.5:0/2422965125 >> v2:172.21.15.5:3300/0 conn(0x7f61b40c81b0 0x7f61b40c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:27.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.475+0000 7f61b2ffd640 1 --2- 172.21.15.5:0/2422965125 >> v2:172.21.15.154:3300/0 conn(0x7f61b40b3df0 0x7f61b40b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:27.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.475+0000 7f61b37fe640 1 -- 172.21.15.5:0/2422965125 >> v2:172.21.15.154:3300/0 conn(0x7f61b40b3df0 msgr2=0x7f61b40b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:27.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.475+0000 7f61b37fe640 1 --2- 172.21.15.5:0/2422965125 >> v2:172.21.15.154:3300/0 conn(0x7f61b40b3df0 0x7f61b40b41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:27.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.475+0000 7f61b37fe640 1 -- 172.21.15.5:0/2422965125 >> v1:172.21.15.5:6789/0 conn(0x7f61b415bdb0 legacy=0x7f61b40c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:27.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.475+0000 7f61b37fe640 1 -- 172.21.15.5:0/2422965125 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b406bdd0 con 0x7f61b40c81b0 2023-07-14T13:09:27.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.475+0000 7f61b37fe640 1 --2- 172.21.15.5:0/2422965125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61b40c81b0 0x7f61b40c9ec0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f61b406af40 tx=0x7f61ac01c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a3c5be298782598 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.475+0000 7f61b27fc640 1 -- 172.21.15.5:0/2422965125 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac0a5800 con 0x7f61b40c81b0 2023-07-14T13:09:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.475+0000 7f61b27fc640 1 -- 172.21.15.5:0/2422965125 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ac0a5960 con 0x7f61b40c81b0 2023-07-14T13:09:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.475+0000 7f61b27fc640 1 -- 172.21.15.5:0/2422965125 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac0a5cf0 con 0x7f61b40c81b0 2023-07-14T13:09:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.475+0000 7f61b9537640 1 -- 172.21.15.5:0/2422965125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61b40c81b0 msgr2=0x7f61b40c9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.475+0000 7f61b9537640 1 --2- 172.21.15.5:0/2422965125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61b40c81b0 0x7f61b40c9ec0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f61b406af40 tx=0x7f61ac01c7a0 comp rx=0 tx=0).stop 2023-07-14T13:09:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.479+0000 7f61b9537640 1 -- 172.21.15.5:0/2422965125 shutdown_connections 2023-07-14T13:09:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.479+0000 7f61b9537640 1 --2- 172.21.15.5:0/2422965125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61b40c81b0 0x7f61b40c9ec0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.479+0000 7f61b9537640 1 --2- 172.21.15.5:0/2422965125 >> v2:172.21.15.154:3300/0 conn(0x7f61b40b3df0 0x7f61b40b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:27.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.479+0000 7f61b9537640 1 -- 172.21.15.5:0/2422965125 >> 172.21.15.5:0/2422965125 conn(0x7f61b40cf3c0 msgr2=0x7f61b40cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:27.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.479+0000 7f61b9537640 1 -- 172.21.15.5:0/2422965125 shutdown_connections 2023-07-14T13:09:27.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.479+0000 7f61b9537640 1 -- 172.21.15.5:0/2422965125 wait complete. 2023-07-14T13:09:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.479+0000 7f61b9537640 1 Processor -- start 2023-07-14T13:09:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.479+0000 7f61b9537640 1 -- start start 2023-07-14T13:09:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.479+0000 7f61b9537640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b40b3df0 0x7f61b414a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.479+0000 7f61b9537640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61b40c81b0 0x7f61b415e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:27.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.479+0000 7f61b9537640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61b415e720 0x7f61b415d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:27.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.479+0000 7f61b9537640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b415ebc0 con 0x7f61b415e720 2023-07-14T13:09:27.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.479+0000 7f61b9537640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b4156e40 con 0x7f61b40b3df0 2023-07-14T13:09:27.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.479+0000 7f61b9537640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b41570e0 con 0x7f61b40c81b0 2023-07-14T13:09:27.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.479+0000 7f61b37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61b415e720 0x7f61b415d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:27.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.479+0000 7f61b37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61b415e720 0x7f61b415d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53158/0 (socket says 172.21.15.5:53158) 2023-07-14T13:09:27.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.479+0000 7f61b37fe640 1 -- 172.21.15.5:0/3074645367 learned_addr learned my addr 172.21.15.5:0/3074645367 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.479+0000 7f61b2ffd640 1 --2- 172.21.15.5:0/3074645367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b40b3df0 0x7f61b414a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.479+0000 7f61abfff640 1 --2- 172.21.15.5:0/3074645367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61b40c81b0 0x7f61b415e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.479+0000 7f61b37fe640 1 -- 172.21.15.5:0/3074645367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61b40c81b0 msgr2=0x7f61b415e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.479+0000 7f61b37fe640 1 --2- 172.21.15.5:0/3074645367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61b40c81b0 0x7f61b415e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.479+0000 7f61b37fe640 1 -- 172.21.15.5:0/3074645367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b40b3df0 msgr2=0x7f61b414a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.479+0000 7f61b37fe640 1 --2- 172.21.15.5:0/3074645367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b40b3df0 0x7f61b414a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.479+0000 7f61b37fe640 1 -- 172.21.15.5:0/3074645367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ac009a70 con 0x7f61b415e720 2023-07-14T13:09:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.483+0000 7f61b37fe640 1 --2- 172.21.15.5:0/3074645367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61b415e720 0x7f61b415d3c0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0b0040 tx=0x7f61ac019540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.483+0000 7f61ab7fe640 1 -- 172.21.15.5:0/3074645367 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac0adc00 con 0x7f61b415e720 2023-07-14T13:09:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.483+0000 7f61ab7fe640 1 -- 172.21.15.5:0/3074645367 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ac0add60 con 0x7f61b415e720 2023-07-14T13:09:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.483+0000 7f61ab7fe640 1 -- 172.21.15.5:0/3074645367 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac0b9690 con 0x7f61b415e720 2023-07-14T13:09:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.483+0000 7f61b9537640 1 -- 172.21.15.5:0/3074645367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b41573c0 con 0x7f61b415e720 2023-07-14T13:09:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.483+0000 7f61b9537640 1 -- 172.21.15.5:0/3074645367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b4157980 con 0x7f61b415e720 2023-07-14T13:09:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.483+0000 7f61b9537640 1 -- 172.21.15.5:0/3074645367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b40b34c0 con 0x7f61b415e720 2023-07-14T13:09:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.483+0000 7f61ab7fe640 1 -- 172.21.15.5:0/3074645367 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 40) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f61ac0b97f0 con 0x7f61b415e720 2023-07-14T13:09:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.483+0000 7f61ab7fe640 1 --2- 172.21.15.5:0/3074645367 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f6194066150 0x7f6194068600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.483+0000 7f61ab7fe640 1 -- 172.21.15.5:0/3074645367 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f61ac11eb00 con 0x7f61b415e720 2023-07-14T13:09:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.483+0000 7f61b2ffd640 1 --2- 172.21.15.5:0/3074645367 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f6194066150 0x7f6194068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.487+0000 7f61b2ffd640 1 --2- 172.21.15.5:0/3074645367 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f6194066150 0x7f6194068600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f61a4007a60 tx=0x7f61a4008040 comp rx=0 tx=0).ready entity=mgr.6347 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:27.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.487+0000 7f61ab7fe640 1 -- 172.21.15.5:0/3074645367 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f61ac0ec210 con 0x7f61b415e720 2023-07-14T13:09:27.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:27.683+0000 7f61b9537640 1 -- 172.21.15.5:0/3074645367 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f61b4157b70 con 0x7f61b415e720 2023-07-14T13:09:28.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.303+0000 7f61ab7fe640 1 -- 172.21.15.5:0/3074645367 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 41) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f61ac0ec5e0 con 0x7f61b415e720 2023-07-14T13:09:28.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.303+0000 7f61ab7fe640 1 -- 172.21.15.5:0/3074645367 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v41) v1 ==== 93+0+0 (secure 0 0 0) 0x7f61ac105440 con 0x7f61b415e720 2023-07-14T13:09:28.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.307+0000 7f61b9537640 1 -- 172.21.15.5:0/3074645367 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f6194066150 msgr2=0x7f6194068600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:28.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.307+0000 7f61b9537640 1 --2- 172.21.15.5:0/3074645367 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f6194066150 0x7f6194068600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f61a4007a60 tx=0x7f61a4008040 comp rx=0 tx=0).stop 2023-07-14T13:09:28.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.307+0000 7f61b9537640 1 -- 172.21.15.5:0/3074645367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61b415e720 msgr2=0x7f61b415d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:28.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.307+0000 7f61b9537640 1 --2- 172.21.15.5:0/3074645367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61b415e720 0x7f61b415d3c0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0b0040 tx=0x7f61ac019540 comp rx=0 tx=0).stop 2023-07-14T13:09:28.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.307+0000 7f61b9537640 1 -- 172.21.15.5:0/3074645367 shutdown_connections 2023-07-14T13:09:28.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.307+0000 7f61b9537640 1 --2- 172.21.15.5:0/3074645367 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f6194066150 0x7f6194068600 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:28.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.307+0000 7f61b9537640 1 --2- 172.21.15.5:0/3074645367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61b415e720 0x7f61b415d3c0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:28.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.307+0000 7f61b9537640 1 --2- 172.21.15.5:0/3074645367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f61b40c81b0 0x7f61b415e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:28.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.307+0000 7f61b9537640 1 --2- 172.21.15.5:0/3074645367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b40b3df0 0x7f61b414a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:28.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.307+0000 7f61b9537640 1 -- 172.21.15.5:0/3074645367 >> 172.21.15.5:0/3074645367 conn(0x7f61b40cf3c0 msgr2=0x7f61b415a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:28.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.307+0000 7f61b9537640 1 -- 172.21.15.5:0/3074645367 shutdown_connections 2023-07-14T13:09:28.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.307+0000 7f61b9537640 1 -- 172.21.15.5:0/3074645367 wait complete. 2023-07-14T13:09:28.363 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T13:09:28.363 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:09:28.431 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:09:28.500 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T13:09:28.500 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:09:28.500 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:09:28.510 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:09:28.510 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:09:28.513 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:28.483+0000 7ff34ea76180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:09:28.516 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:28.487+0000 7ff153389180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:09:28.525 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:09:28.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.683+0000 7f6dab337640 1 Processor -- start 2023-07-14T13:09:28.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.683+0000 7f6dab337640 1 -- start start 2023-07-14T13:09:28.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.683+0000 7f6dab337640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6da415fd60 0x7f6da40d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:28.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.683+0000 7f6dab337640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6da40d1850 0x7f6da40d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:28.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.683+0000 7f6dab337640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6da40ccaf0 con 0x7f6da40b7c70 2023-07-14T13:09:28.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.683+0000 7f6dab337640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da40d1190 con 0x7f6da40d1850 2023-07-14T13:09:28.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.683+0000 7f6dab337640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da4160600 con 0x7f6da415fd60 2023-07-14T13:09:28.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.683+0000 7f6da90d3640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6da40b7c70 0x7f6da415f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57680/0 (socket says 172.21.15.5:57680) 2023-07-14T13:09:28.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.683+0000 7f6da90d3640 1 -- 172.21.15.5:0/593230362 learned_addr learned my addr 172.21.15.5:0/593230362 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:28.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.683+0000 7f6da98d4640 1 --2- 172.21.15.5:0/593230362 >> v2:172.21.15.5:3300/0 conn(0x7f6da40d1850 0x7f6da40d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:28.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.683+0000 7f6da88d2640 1 --2- 172.21.15.5:0/593230362 >> v2:172.21.15.154:3300/0 conn(0x7f6da415fd60 0x7f6da40d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:28.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.687+0000 7f6d9bfff640 1 -- 172.21.15.5:0/593230362 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1239282424 0 0) 0x7f6da40ccaf0 con 0x7f6da40b7c70 2023-07-14T13:09:28.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.687+0000 7f6d9bfff640 1 -- 172.21.15.5:0/593230362 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d90003530 con 0x7f6da40b7c70 2023-07-14T13:09:28.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.687+0000 7f6da98d4640 1 -- 172.21.15.5:0/593230362 >> v2:172.21.15.154:3300/0 conn(0x7f6da415fd60 msgr2=0x7f6da40d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:28.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.687+0000 7f6da98d4640 1 --2- 172.21.15.5:0/593230362 >> v2:172.21.15.154:3300/0 conn(0x7f6da415fd60 0x7f6da40d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:28.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.687+0000 7f6da98d4640 1 -- 172.21.15.5:0/593230362 >> v1:172.21.15.5:6789/0 conn(0x7f6da40b7c70 legacy=0x7f6da415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:28.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.687+0000 7f6da98d4640 1 -- 172.21.15.5:0/593230362 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da4160320 con 0x7f6da40d1850 2023-07-14T13:09:28.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.691+0000 7f6da98d4640 1 --2- 172.21.15.5:0/593230362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6da40d1850 0x7f6da40d1da0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f6da40b1180 tx=0x7f6d9c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc75a2a74c794cc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:28.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.691+0000 7f6d9bfff640 1 -- 172.21.15.5:0/593230362 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c0a59c0 con 0x7f6da40d1850 2023-07-14T13:09:28.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.691+0000 7f6d9bfff640 1 -- 172.21.15.5:0/593230362 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9c0a5b20 con 0x7f6da40d1850 2023-07-14T13:09:28.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.691+0000 7f6d9bfff640 1 -- 172.21.15.5:0/593230362 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c0a5e90 con 0x7f6da40d1850 2023-07-14T13:09:28.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.691+0000 7f6dab337640 1 -- 172.21.15.5:0/593230362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6da40d1850 msgr2=0x7f6da40d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:28.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.691+0000 7f6dab337640 1 --2- 172.21.15.5:0/593230362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6da40d1850 0x7f6da40d1da0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f6da40b1180 tx=0x7f6d9c01c8e0 comp rx=0 tx=0).stop 2023-07-14T13:09:28.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.691+0000 7f6dab337640 1 -- 172.21.15.5:0/593230362 shutdown_connections 2023-07-14T13:09:28.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.691+0000 7f6dab337640 1 --2- 172.21.15.5:0/593230362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6da40d1850 0x7f6da40d1da0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:28.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.691+0000 7f6dab337640 1 --2- 172.21.15.5:0/593230362 >> v2:172.21.15.154:3300/0 conn(0x7f6da415fd60 0x7f6da40d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:28.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.691+0000 7f6dab337640 1 -- 172.21.15.5:0/593230362 >> 172.21.15.5:0/593230362 conn(0x7f6da40650b0 msgr2=0x7f6da40654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:28.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.691+0000 7f6dab337640 1 -- 172.21.15.5:0/593230362 shutdown_connections 2023-07-14T13:09:28.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.691+0000 7f6dab337640 1 -- 172.21.15.5:0/593230362 wait complete. 2023-07-14T13:09:28.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.695+0000 7f6dab337640 1 Processor -- start 2023-07-14T13:09:28.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.695+0000 7f6dab337640 1 -- start start 2023-07-14T13:09:28.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.695+0000 7f6dab337640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6da40b7c70 0x7f6da415ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:28.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.695+0000 7f6dab337640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6da40d1850 0x7f6da41f77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:28.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.695+0000 7f6dab337640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6da415fd60 0x7f6da41f7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:28.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.695+0000 7f6dab337640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40c8090 con 0x7f6da415fd60 2023-07-14T13:09:28.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.695+0000 7f6dab337640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40c8930 con 0x7f6da40d1850 2023-07-14T13:09:28.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.695+0000 7f6dab337640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da41f8240 con 0x7f6da40b7c70 2023-07-14T13:09:28.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.695+0000 7f6da98d4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6da415fd60 0x7f6da41f7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:28.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.695+0000 7f6da88d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6da40d1850 0x7f6da41f77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:28.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.695+0000 7f6da98d4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6da415fd60 0x7f6da41f7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53190/0 (socket says 172.21.15.5:53190) 2023-07-14T13:09:28.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.695+0000 7f6da98d4640 1 -- 172.21.15.5:0/2703323234 learned_addr learned my addr 172.21.15.5:0/2703323234 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:28.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.695+0000 7f6da90d3640 1 --2- 172.21.15.5:0/2703323234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6da40b7c70 0x7f6da415ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:28.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.695+0000 7f6da98d4640 1 -- 172.21.15.5:0/2703323234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6da40b7c70 msgr2=0x7f6da415ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:28.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.695+0000 7f6da98d4640 1 --2- 172.21.15.5:0/2703323234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6da40b7c70 0x7f6da415ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:28.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.695+0000 7f6da98d4640 1 -- 172.21.15.5:0/2703323234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6da40d1850 msgr2=0x7f6da41f77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:28.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.695+0000 7f6da98d4640 1 --2- 172.21.15.5:0/2703323234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6da40d1850 0x7f6da41f77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:28.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.695+0000 7f6da98d4640 1 -- 172.21.15.5:0/2703323234 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c009a70 con 0x7f6da415fd60 2023-07-14T13:09:28.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.695+0000 7f6da88d2640 1 --2- 172.21.15.5:0/2703323234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6da40d1850 0x7f6da41f77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:09:28.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.695+0000 7f6da98d4640 1 --2- 172.21.15.5:0/2703323234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6da415fd60 0x7f6da41f7d00 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c01cdc0 tx=0x7f6d9c019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:28.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.695+0000 7f6d99ffb640 1 -- 172.21.15.5:0/2703323234 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c0bf070 con 0x7f6da415fd60 2023-07-14T13:09:28.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.695+0000 7f6d99ffb640 1 -- 172.21.15.5:0/2703323234 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9c009450 con 0x7f6da415fd60 2023-07-14T13:09:28.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.695+0000 7f6d99ffb640 1 -- 172.21.15.5:0/2703323234 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c007000 con 0x7f6da415fd60 2023-07-14T13:09:28.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.695+0000 7f6dab337640 1 -- 172.21.15.5:0/2703323234 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da41f84b0 con 0x7f6da415fd60 2023-07-14T13:09:28.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.695+0000 7f6dab337640 1 -- 172.21.15.5:0/2703323234 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da40c85c0 con 0x7f6da415fd60 2023-07-14T13:09:28.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.699+0000 7f6dab337640 1 -- 172.21.15.5:0/2703323234 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6da40678d0 con 0x7f6da415fd60 2023-07-14T13:09:28.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.699+0000 7f6d99ffb640 1 -- 172.21.15.5:0/2703323234 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 41) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f6d9c0b4050 con 0x7f6da415fd60 2023-07-14T13:09:28.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.699+0000 7f6d99ffb640 1 --2- 172.21.15.5:0/2703323234 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f6d88066430 0x7f6d880688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:28.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.699+0000 7f6d99ffb640 1 -- 172.21.15.5:0/2703323234 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f6d9c11e780 con 0x7f6da415fd60 2023-07-14T13:09:28.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.699+0000 7f6da90d3640 1 -- 172.21.15.5:0/2703323234 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f6d88066430 msgr2=0x7f6d880688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/714349479 2023-07-14T13:09:28.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.699+0000 7f6da90d3640 1 --2- 172.21.15.5:0/2703323234 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f6d88066430 0x7f6d880688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:09:28.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.703+0000 7f6d99ffb640 1 -- 172.21.15.5:0/2703323234 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6d9c0eb830 con 0x7f6da415fd60 2023-07-14T13:09:28.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.863+0000 7f6dab337640 1 -- 172.21.15.5:0/2703323234 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6da40d05b0 con 0x7f6da415fd60 2023-07-14T13:09:28.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.863+0000 7f6d99ffb640 1 -- 172.21.15.5:0/2703323234 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+18815 (secure 0 0 0) 0x7f6d9c0eee50 con 0x7f6da415fd60 2023-07-14T13:09:28.894 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:28.895 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":98,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:09:26.281007+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:09:06.567743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-14T13:09:07.824380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/1136667119":"2023-07-15T13:09:26.280972+0000","172.21.15.154:6833/3243469291":"2023-07-15T13:09:26.280972+0000","172.21.15.154:6832/3243469291":"2023-07-15T13:09:26.280972+0000","172.21.15.154:0/2054145215":"2023-07-15T13:09:26.280972+0000","172.21.15.154:0/3260672688":"2023-07-15T13:09:26.280972+0000","172.21.15.154:0/2925558673":"2023-07-15T13:09:26.280972+0000","172.21.15.154:0/3026075462":"2023-07-15T13:09:26.280972+0000","172.21.15.154:0/2368288551":"2023-07-15T13:09:26.280972+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:09:28.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.863+0000 7f6dab337640 1 -- 172.21.15.5:0/2703323234 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f6d88066430 msgr2=0x7f6d880688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:09:28.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.863+0000 7f6dab337640 1 --2- 172.21.15.5:0/2703323234 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f6d88066430 0x7f6d880688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:28.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.863+0000 7f6dab337640 1 -- 172.21.15.5:0/2703323234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6da415fd60 msgr2=0x7f6da41f7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:28.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.863+0000 7f6dab337640 1 --2- 172.21.15.5:0/2703323234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6da415fd60 0x7f6da41f7d00 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c01cdc0 tx=0x7f6d9c019680 comp rx=0 tx=0).stop 2023-07-14T13:09:28.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.867+0000 7f6dab337640 1 -- 172.21.15.5:0/2703323234 shutdown_connections 2023-07-14T13:09:28.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.867+0000 7f6dab337640 1 --2- 172.21.15.5:0/2703323234 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f6d88066430 0x7f6d880688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:28.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.867+0000 7f6dab337640 1 --2- 172.21.15.5:0/2703323234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6da415fd60 0x7f6da41f7d00 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:28.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.867+0000 7f6dab337640 1 --2- 172.21.15.5:0/2703323234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6da40d1850 0x7f6da41f77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:28.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.867+0000 7f6dab337640 1 --2- 172.21.15.5:0/2703323234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6da40b7c70 0x7f6da415ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:28.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.867+0000 7f6dab337640 1 -- 172.21.15.5:0/2703323234 >> 172.21.15.5:0/2703323234 conn(0x7f6da40650b0 msgr2=0x7f6da40cfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:28.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.867+0000 7f6dab337640 1 -- 172.21.15.5:0/2703323234 shutdown_connections 2023-07-14T13:09:28.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:28.867+0000 7f6dab337640 1 -- 172.21.15.5:0/2703323234 wait complete. 2023-07-14T13:09:28.917 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T13:09:06.567743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T13:09:07.824380+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:09:28.918 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:09:28.929 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:28.899+0000 7ff34ea76180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:09:28.967 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:28.935+0000 7ff153389180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:09:29.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.039+0000 7faa21419640 1 Processor -- start 2023-07-14T13:09:29.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.039+0000 7faa21419640 1 -- start start 2023-07-14T13:09:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.039+0000 7faa21419640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa1c0d2fc0 0x7faa1c0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.039+0000 7faa21419640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faa1c0d2300 0x7faa1c0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.039+0000 7faa21419640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa1c0b04c0 con 0x7faa1c15bde0 2023-07-14T13:09:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.039+0000 7faa21419640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa1c0d2ce0 con 0x7faa1c0d2300 2023-07-14T13:09:29.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.039+0000 7faa21419640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c15c1b0 con 0x7faa1c0d2fc0 2023-07-14T13:09:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.039+0000 7faa1affd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faa1c15bde0 0x7faa1c0d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53242/0 (socket says 172.21.15.5:53242) 2023-07-14T13:09:29.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.039+0000 7faa1affd640 1 -- 172.21.15.5:0/963491976 learned_addr learned my addr 172.21.15.5:0/963491976 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:29.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.039+0000 7faa1b7fe640 1 --2- 172.21.15.5:0/963491976 >> v2:172.21.15.154:3300/0 conn(0x7faa1c0d2300 0x7faa1c0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.039+0000 7faa13fff640 1 --2- 172.21.15.5:0/963491976 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa1c0d2fc0 0x7faa1c0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.039+0000 7faa1a7fc640 1 -- 172.21.15.5:0/963491976 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 62866257 0 0) 0x7faa1c0b04c0 con 0x7faa1c15bde0 2023-07-14T13:09:29.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.039+0000 7faa1a7fc640 1 -- 172.21.15.5:0/963491976 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa08003530 con 0x7faa1c15bde0 2023-07-14T13:09:29.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.039+0000 7faa1b7fe640 1 -- 172.21.15.5:0/963491976 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa1c0d2fc0 msgr2=0x7faa1c0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:29.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.039+0000 7faa1b7fe640 1 --2- 172.21.15.5:0/963491976 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa1c0d2fc0 0x7faa1c0b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.039+0000 7faa1b7fe640 1 -- 172.21.15.5:0/963491976 >> v1:172.21.15.5:6789/0 conn(0x7faa1c15bde0 legacy=0x7faa1c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:29.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.039+0000 7faa1b7fe640 1 -- 172.21.15.5:0/963491976 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1c0d0aa0 con 0x7faa1c0d2300 2023-07-14T13:09:29.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.039+0000 7faa13fff640 1 --2- 172.21.15.5:0/963491976 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa1c0d2fc0 0x7faa1c0b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:09:29.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.043+0000 7faa1b7fe640 1 --2- 172.21.15.5:0/963491976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa1c0d2300 0x7faa1c0d27a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7faa14009d90 tx=0x7faa1401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=581809cd43f85edd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:29.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.043+0000 7faa1a7fc640 1 -- 172.21.15.5:0/963491976 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa140a5a10 con 0x7faa1c0d2300 2023-07-14T13:09:29.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.043+0000 7faa1a7fc640 1 -- 172.21.15.5:0/963491976 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa140a5b70 con 0x7faa1c0d2300 2023-07-14T13:09:29.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.043+0000 7faa1a7fc640 1 -- 172.21.15.5:0/963491976 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa140ad440 con 0x7faa1c0d2300 2023-07-14T13:09:29.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.043+0000 7faa21419640 1 -- 172.21.15.5:0/963491976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa1c0d2300 msgr2=0x7faa1c0d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:29.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.043+0000 7faa21419640 1 --2- 172.21.15.5:0/963491976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa1c0d2300 0x7faa1c0d27a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7faa14009d90 tx=0x7faa1401c950 comp rx=0 tx=0).stop 2023-07-14T13:09:29.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.043+0000 7faa21419640 1 -- 172.21.15.5:0/963491976 shutdown_connections 2023-07-14T13:09:29.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.043+0000 7faa21419640 1 --2- 172.21.15.5:0/963491976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa1c0d2300 0x7faa1c0d27a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.043+0000 7faa21419640 1 --2- 172.21.15.5:0/963491976 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa1c0d2fc0 0x7faa1c0b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.043+0000 7faa21419640 1 -- 172.21.15.5:0/963491976 >> 172.21.15.5:0/963491976 conn(0x7faa1c0659d0 msgr2=0x7faa1c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:29.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.043+0000 7faa21419640 1 -- 172.21.15.5:0/963491976 shutdown_connections 2023-07-14T13:09:29.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.047+0000 7faa21419640 1 -- 172.21.15.5:0/963491976 wait complete. 2023-07-14T13:09:29.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.047+0000 7faa21419640 1 Processor -- start 2023-07-14T13:09:29.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.047+0000 7faa21419640 1 -- start start 2023-07-14T13:09:29.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.047+0000 7faa21419640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa1c0d2300 0x7faa1c15e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.047+0000 7faa21419640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa1c0d2fc0 0x7faa1c0c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.047+0000 7faa21419640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa1c15bde0 0x7faa1c158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.047+0000 7faa21419640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c0c81c0 con 0x7faa1c0d2fc0 2023-07-14T13:09:29.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.047+0000 7faa21419640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c152250 con 0x7faa1c15bde0 2023-07-14T13:09:29.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.047+0000 7faa21419640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c152530 con 0x7faa1c0d2300 2023-07-14T13:09:29.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.047+0000 7faa13fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa1c0d2fc0 0x7faa1c0c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.047+0000 7faa1affd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa1c0d2300 0x7faa1c15e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.047+0000 7faa1b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa1c15bde0 0x7faa1c158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.047+0000 7faa1b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa1c15bde0 0x7faa1c158250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:60594/0 (socket says 172.21.15.5:60594) 2023-07-14T13:09:29.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.047+0000 7faa1b7fe640 1 -- 172.21.15.5:0/3058397451 learned_addr learned my addr 172.21.15.5:0/3058397451 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:29.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.047+0000 7faa13fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa1c0d2fc0 0x7faa1c0c78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33578/0 (socket says 172.21.15.5:33578) 2023-07-14T13:09:29.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.047+0000 7faa1b7fe640 1 -- 172.21.15.5:0/3058397451 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa1c0d2300 msgr2=0x7faa1c15e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:29.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.047+0000 7faa1b7fe640 1 --2- 172.21.15.5:0/3058397451 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa1c0d2300 0x7faa1c15e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.047+0000 7faa1b7fe640 1 -- 172.21.15.5:0/3058397451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa1c0d2fc0 msgr2=0x7faa1c0c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:29.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.047+0000 7faa1b7fe640 1 --2- 172.21.15.5:0/3058397451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa1c0d2fc0 0x7faa1c0c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.047+0000 7faa1b7fe640 1 -- 172.21.15.5:0/3058397451 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa04009420 con 0x7faa1c15bde0 2023-07-14T13:09:29.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.047+0000 7faa1b7fe640 1 --2- 172.21.15.5:0/3058397451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa1c15bde0 0x7faa1c158250 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7faa1401a580 tx=0x7faa140196f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:29.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.051+0000 7faa137fe640 1 -- 172.21.15.5:0/3058397451 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa14007000 con 0x7faa1c15bde0 2023-07-14T13:09:29.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.051+0000 7faa137fe640 1 -- 172.21.15.5:0/3058397451 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa140aed30 con 0x7faa1c15bde0 2023-07-14T13:09:29.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.051+0000 7faa137fe640 1 -- 172.21.15.5:0/3058397451 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa140aeea0 con 0x7faa1c15bde0 2023-07-14T13:09:29.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.051+0000 7faa21419640 1 -- 172.21.15.5:0/3058397451 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa14009a70 con 0x7faa1c15bde0 2023-07-14T13:09:29.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.051+0000 7faa21419640 1 -- 172.21.15.5:0/3058397451 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1c152af0 con 0x7faa1c15bde0 2023-07-14T13:09:29.083 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:29.051+0000 7ff34ea76180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:09:29.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.051+0000 7faa21419640 1 -- 172.21.15.5:0/3058397451 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa1c152ce0 con 0x7faa1c15bde0 2023-07-14T13:09:29.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.051+0000 7faa137fe640 1 -- 172.21.15.5:0/3058397451 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 41) v1 ==== 85817+0+0 (secure 0 0 0) 0x7faa140b4050 con 0x7faa1c15bde0 2023-07-14T13:09:29.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.051+0000 7faa137fe640 1 --2- 172.21.15.5:0/3058397451 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fa9fc066430 0x7fa9fc0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.051+0000 7faa137fe640 1 -- 172.21.15.5:0/3058397451 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6406+0+0 (secure 0 0 0) 0x7faa1411fc90 con 0x7faa1c15bde0 2023-07-14T13:09:29.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.051+0000 7faa1affd640 1 -- 172.21.15.5:0/3058397451 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fa9fc066430 msgr2=0x7fa9fc0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/714349479 2023-07-14T13:09:29.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.051+0000 7faa1affd640 1 --2- 172.21.15.5:0/3058397451 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fa9fc066430 0x7fa9fc0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:09:29.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.055+0000 7faa137fe640 1 -- 172.21.15.5:0/3058397451 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7faa140ece00 con 0x7faa1c15bde0 2023-07-14T13:09:29.130 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:29.099+0000 7ff153389180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:09:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.215+0000 7faa21419640 1 -- 172.21.15.5:0/3058397451 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faa1c0678d0 con 0x7faa1c15bde0 2023-07-14T13:09:29.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.215+0000 7faa137fe640 1 -- 172.21.15.5:0/3058397451 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7faa14009450 con 0x7faa1c15bde0 2023-07-14T13:09:29.245 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:09:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.215+0000 7faa21419640 1 -- 172.21.15.5:0/3058397451 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fa9fc066430 msgr2=0x7fa9fc0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:09:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.215+0000 7faa21419640 1 --2- 172.21.15.5:0/3058397451 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fa9fc066430 0x7fa9fc0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.215+0000 7faa21419640 1 -- 172.21.15.5:0/3058397451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa1c15bde0 msgr2=0x7faa1c158250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.215+0000 7faa21419640 1 --2- 172.21.15.5:0/3058397451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa1c15bde0 0x7faa1c158250 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7faa1401a580 tx=0x7faa140196f0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.215+0000 7faa21419640 1 -- 172.21.15.5:0/3058397451 shutdown_connections 2023-07-14T13:09:29.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.215+0000 7faa21419640 1 --2- 172.21.15.5:0/3058397451 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fa9fc066430 0x7fa9fc0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.215+0000 7faa21419640 1 --2- 172.21.15.5:0/3058397451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa1c15bde0 0x7faa1c158250 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.215+0000 7faa21419640 1 --2- 172.21.15.5:0/3058397451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa1c0d2fc0 0x7faa1c0c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.215+0000 7faa21419640 1 --2- 172.21.15.5:0/3058397451 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa1c0d2300 0x7faa1c15e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.215+0000 7faa21419640 1 -- 172.21.15.5:0/3058397451 >> 172.21.15.5:0/3058397451 conn(0x7faa1c0659d0 msgr2=0x7faa1c0cdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:29.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.215+0000 7faa21419640 1 -- 172.21.15.5:0/3058397451 shutdown_connections 2023-07-14T13:09:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.215+0000 7faa21419640 1 -- 172.21.15.5:0/3058397451 wait complete. 2023-07-14T13:09:29.267 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:09:29.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.391+0000 7fc995e34640 1 Processor -- start 2023-07-14T13:09:29.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.391+0000 7fc995e34640 1 -- start start 2023-07-14T13:09:29.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.391+0000 7fc995e34640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc99015bde0 0x7fc9900d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.391+0000 7fc995e34640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9900b04c0 con 0x7fc9900d2300 2023-07-14T13:09:29.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.391+0000 7fc995e34640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9900b1060 con 0x7fc9900d2fc0 2023-07-14T13:09:29.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.391+0000 7fc995e34640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc99015c1b0 con 0x7fc99015bde0 2023-07-14T13:09:29.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.391+0000 7fc98ffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc9900d2300 0x7fc9900cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53254/0 (socket says 172.21.15.5:53254) 2023-07-14T13:09:29.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.391+0000 7fc98ffff640 1 -- 172.21.15.5:0/3356166470 learned_addr learned my addr 172.21.15.5:0/3356166470 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:29.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.391+0000 7fc98f7fe640 1 --2- 172.21.15.5:0/3356166470 >> v2:172.21.15.154:3300/0 conn(0x7fc99015bde0 0x7fc9900d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.391+0000 7fc98e7fc640 1 -- 172.21.15.5:0/3356166470 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602827698 0 0) 0x7fc9900b04c0 con 0x7fc9900d2300 2023-07-14T13:09:29.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.391+0000 7fc98e7fc640 1 -- 172.21.15.5:0/3356166470 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc978003530 con 0x7fc9900d2300 2023-07-14T13:09:29.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.391+0000 7fc98f7fe640 1 -- 172.21.15.5:0/3356166470 >> v1:172.21.15.154:6789/0 conn(0x7fc9900d2fc0 legacy=0x7fc9900b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:29.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.391+0000 7fc98f7fe640 1 -- 172.21.15.5:0/3356166470 >> v1:172.21.15.5:6789/0 conn(0x7fc9900d2300 legacy=0x7fc9900cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:29.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.391+0000 7fc98e7fc640 1 -- 172.21.15.5:0/3356166470 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944373740 0 0) 0x7fc9900b1060 con 0x7fc9900d2fc0 2023-07-14T13:09:29.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.391+0000 7fc98f7fe640 1 -- 172.21.15.5:0/3356166470 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9900d0aa0 con 0x7fc99015bde0 2023-07-14T13:09:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.395+0000 7fc98f7fe640 1 --2- 172.21.15.5:0/3356166470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc99015bde0 0x7fc9900d0270 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc9800097a0 tx=0x7fc98001c2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60d3a38049d96e90 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.395+0000 7fc98e7fc640 1 -- 172.21.15.5:0/3356166470 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc988001980 con 0x7fc99015bde0 2023-07-14T13:09:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.395+0000 7fc98e7fc640 1 -- 172.21.15.5:0/3356166470 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9800a7050 con 0x7fc99015bde0 2023-07-14T13:09:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.395+0000 7fc98e7fc640 1 -- 172.21.15.5:0/3356166470 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9800ab600 con 0x7fc99015bde0 2023-07-14T13:09:29.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.395+0000 7fc995e34640 1 -- 172.21.15.5:0/3356166470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc99015bde0 msgr2=0x7fc9900d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:29.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.395+0000 7fc995e34640 1 --2- 172.21.15.5:0/3356166470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc99015bde0 0x7fc9900d0270 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc9800097a0 tx=0x7fc98001c2a0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.395+0000 7fc995e34640 1 -- 172.21.15.5:0/3356166470 shutdown_connections 2023-07-14T13:09:29.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.395+0000 7fc995e34640 1 --2- 172.21.15.5:0/3356166470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc99015bde0 0x7fc9900d0270 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.395+0000 7fc995e34640 1 -- 172.21.15.5:0/3356166470 >> 172.21.15.5:0/3356166470 conn(0x7fc9900659d0 msgr2=0x7fc99009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:29.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.395+0000 7fc995e34640 1 -- 172.21.15.5:0/3356166470 shutdown_connections 2023-07-14T13:09:29.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.395+0000 7fc995e34640 1 -- 172.21.15.5:0/3356166470 wait complete. 2023-07-14T13:09:29.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.399+0000 7fc995e34640 1 Processor -- start 2023-07-14T13:09:29.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.399+0000 7fc995e34640 1 -- start start 2023-07-14T13:09:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.399+0000 7fc995e34640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9900d2300 0x7fc990152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.399+0000 7fc995e34640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9900d2fc0 0x7fc9900c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.399+0000 7fc995e34640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc99015bde0 0x7fc9900c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.399+0000 7fc995e34640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc990155660 con 0x7fc99015bde0 2023-07-14T13:09:29.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.399+0000 7fc995e34640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc990155940 con 0x7fc9900d2300 2023-07-14T13:09:29.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.399+0000 7fc995e34640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc990155c20 con 0x7fc9900d2fc0 2023-07-14T13:09:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.399+0000 7fc98ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc99015bde0 0x7fc9900c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.399+0000 7fc98f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9900d2300 0x7fc990152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.399+0000 7fc98ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc99015bde0 0x7fc9900c6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33586/0 (socket says 172.21.15.5:33586) 2023-07-14T13:09:29.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.399+0000 7fc98ffff640 1 -- 172.21.15.5:0/3372488833 learned_addr learned my addr 172.21.15.5:0/3372488833 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.399+0000 7fc98effd640 1 --2- 172.21.15.5:0/3372488833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9900d2fc0 0x7fc9900c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.399+0000 7fc98ffff640 1 -- 172.21.15.5:0/3372488833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9900d2fc0 msgr2=0x7fc9900c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.399+0000 7fc98ffff640 1 --2- 172.21.15.5:0/3372488833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9900d2fc0 0x7fc9900c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.399+0000 7fc98ffff640 1 -- 172.21.15.5:0/3372488833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9900d2300 msgr2=0x7fc990152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:29.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.399+0000 7fc98ffff640 1 --2- 172.21.15.5:0/3372488833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9900d2300 0x7fc990152b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.399+0000 7fc98ffff640 1 -- 172.21.15.5:0/3372488833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9800093b0 con 0x7fc99015bde0 2023-07-14T13:09:29.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.399+0000 7fc98f7fe640 1 --2- 172.21.15.5:0/3372488833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9900d2300 0x7fc990152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:09:29.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.399+0000 7fc98ffff640 1 --2- 172.21.15.5:0/3372488833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc99015bde0 0x7fc9900c6e00 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fc98800cac0 tx=0x7fc98800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:29.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.399+0000 7fc977fff640 1 -- 172.21.15.5:0/3372488833 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98800a930 con 0x7fc99015bde0 2023-07-14T13:09:29.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.399+0000 7fc977fff640 1 -- 172.21.15.5:0/3372488833 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98800aa90 con 0x7fc99015bde0 2023-07-14T13:09:29.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.399+0000 7fc995e34640 1 -- 172.21.15.5:0/3372488833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc990155f00 con 0x7fc99015bde0 2023-07-14T13:09:29.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.399+0000 7fc977fff640 1 -- 172.21.15.5:0/3372488833 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98800ae60 con 0x7fc99015bde0 2023-07-14T13:09:29.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.399+0000 7fc995e34640 1 -- 172.21.15.5:0/3372488833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc990153060 con 0x7fc99015bde0 2023-07-14T13:09:29.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.403+0000 7fc995e34640 1 -- 172.21.15.5:0/3372488833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9900678d0 con 0x7fc99015bde0 2023-07-14T13:09:29.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.403+0000 7fc977fff640 1 -- 172.21.15.5:0/3372488833 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 41) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fc9880070d0 con 0x7fc99015bde0 2023-07-14T13:09:29.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.403+0000 7fc977fff640 1 --2- 172.21.15.5:0/3372488833 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fc97c066460 0x7fc97c068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.403+0000 7fc977fff640 1 -- 172.21.15.5:0/3372488833 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fc988083870 con 0x7fc99015bde0 2023-07-14T13:09:29.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.403+0000 7fc98f7fe640 1 -- 172.21.15.5:0/3372488833 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fc97c066460 msgr2=0x7fc97c068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/714349479 2023-07-14T13:09:29.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.403+0000 7fc98f7fe640 1 --2- 172.21.15.5:0/3372488833 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fc97c066460 0x7fc97c068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:09:29.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.407+0000 7fc977fff640 1 -- 172.21.15.5:0/3372488833 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc9880509d0 con 0x7fc99015bde0 2023-07-14T13:09:29.563 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:29.531+0000 7ff34ea76180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:09:29.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.563+0000 7fc995e34640 1 -- 172.21.15.5:0/3372488833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc9901563b0 con 0x7fc99015bde0 2023-07-14T13:09:29.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.563+0000 7fc977fff640 1 -- 172.21.15.5:0/3372488833 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v98) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc988081e60 con 0x7fc99015bde0 2023-07-14T13:09:29.597 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:09:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.567+0000 7fc995e34640 1 -- 172.21.15.5:0/3372488833 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fc97c066460 msgr2=0x7fc97c068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:09:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.567+0000 7fc995e34640 1 --2- 172.21.15.5:0/3372488833 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fc97c066460 0x7fc97c068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.567+0000 7fc995e34640 1 -- 172.21.15.5:0/3372488833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc99015bde0 msgr2=0x7fc9900c6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.567+0000 7fc995e34640 1 --2- 172.21.15.5:0/3372488833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc99015bde0 0x7fc9900c6e00 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fc98800cac0 tx=0x7fc98800cf80 comp rx=0 tx=0).stop 2023-07-14T13:09:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.567+0000 7fc995e34640 1 -- 172.21.15.5:0/3372488833 shutdown_connections 2023-07-14T13:09:29.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.567+0000 7fc995e34640 1 --2- 172.21.15.5:0/3372488833 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fc97c066460 0x7fc97c068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.567+0000 7fc995e34640 1 --2- 172.21.15.5:0/3372488833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc99015bde0 0x7fc9900c6e00 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.567+0000 7fc995e34640 1 --2- 172.21.15.5:0/3372488833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9900d2fc0 0x7fc9900c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.567+0000 7fc995e34640 1 --2- 172.21.15.5:0/3372488833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9900d2300 0x7fc990152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.567+0000 7fc995e34640 1 -- 172.21.15.5:0/3372488833 >> 172.21.15.5:0/3372488833 conn(0x7fc9900659d0 msgr2=0x7fc9900aefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:29.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.567+0000 7fc995e34640 1 -- 172.21.15.5:0/3372488833 shutdown_connections 2023-07-14T13:09:29.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.567+0000 7fc995e34640 1 -- 172.21.15.5:0/3372488833 wait complete. 2023-07-14T13:09:29.620 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:29.587+0000 7ff34ea76180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:09:29.627 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T13:09:29.660 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:29.631+0000 7ff153389180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:09:29.675 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:29.643+0000 7ff34ea76180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:09:29.724 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:29.691+0000 7ff153389180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:09:29.760 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:29.727+0000 7ff34ea76180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:09:29.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.743+0000 7f97e3911640 1 Processor -- start 2023-07-14T13:09:29.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.743+0000 7f97e3911640 1 -- start start 2023-07-14T13:09:29.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.747+0000 7f97e3911640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97dc15bde0 0x7f97dc0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.747+0000 7f97e3911640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97dc0b04c0 con 0x7f97dc0d2300 2023-07-14T13:09:29.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.747+0000 7f97e3911640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97dc0b1060 con 0x7f97dc0d2fc0 2023-07-14T13:09:29.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.747+0000 7f97e3911640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc15c1b0 con 0x7f97dc15bde0 2023-07-14T13:09:29.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.747+0000 7f97e1eae640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f97dc0d2300 0x7f97dc0cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53266/0 (socket says 172.21.15.5:53266) 2023-07-14T13:09:29.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.747+0000 7f97e1eae640 1 -- 172.21.15.5:0/1272779678 learned_addr learned my addr 172.21.15.5:0/1272779678 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:29.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.747+0000 7f97e16ad640 1 --2- 172.21.15.5:0/1272779678 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97dc15bde0 0x7f97dc0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.747+0000 7f97d3fff640 1 -- 172.21.15.5:0/1272779678 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3210301148 0 0) 0x7f97dc0b1060 con 0x7f97dc0d2fc0 2023-07-14T13:09:29.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.747+0000 7f97d3fff640 1 -- 172.21.15.5:0/1272779678 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97c8003530 con 0x7f97dc0d2fc0 2023-07-14T13:09:29.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.747+0000 7f97e16ad640 1 -- 172.21.15.5:0/1272779678 >> v1:172.21.15.154:6789/0 conn(0x7f97dc0d2fc0 legacy=0x7f97dc0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:29.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.747+0000 7f97d3fff640 1 -- 172.21.15.5:0/1272779678 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020212173 0 0) 0x7f97dc0b04c0 con 0x7f97dc0d2300 2023-07-14T13:09:29.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.747+0000 7f97e16ad640 1 -- 172.21.15.5:0/1272779678 >> v1:172.21.15.5:6789/0 conn(0x7f97dc0d2300 legacy=0x7f97dc0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:29.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.747+0000 7f97e16ad640 1 -- 172.21.15.5:0/1272779678 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97dc0d0aa0 con 0x7f97dc15bde0 2023-07-14T13:09:29.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.751+0000 7f97e16ad640 1 --2- 172.21.15.5:0/1272779678 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97dc15bde0 0x7f97dc0d0270 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f97d80097d0 tx=0x7f97d801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77b1f176280132c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:29.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.751+0000 7f97d3fff640 1 -- 172.21.15.5:0/1272779678 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d80a6040 con 0x7f97dc15bde0 2023-07-14T13:09:29.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.751+0000 7f97d3fff640 1 -- 172.21.15.5:0/1272779678 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d80aa600 con 0x7f97dc15bde0 2023-07-14T13:09:29.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.751+0000 7f97d3fff640 1 -- 172.21.15.5:0/1272779678 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d80aa990 con 0x7f97dc15bde0 2023-07-14T13:09:29.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.751+0000 7f97e3911640 1 -- 172.21.15.5:0/1272779678 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97dc15bde0 msgr2=0x7f97dc0d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:29.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.751+0000 7f97e3911640 1 --2- 172.21.15.5:0/1272779678 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97dc15bde0 0x7f97dc0d0270 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f97d80097d0 tx=0x7f97d801c4a0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.751+0000 7f97e3911640 1 -- 172.21.15.5:0/1272779678 shutdown_connections 2023-07-14T13:09:29.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.751+0000 7f97e3911640 1 --2- 172.21.15.5:0/1272779678 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97dc15bde0 0x7f97dc0d0270 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.751+0000 7f97e3911640 1 -- 172.21.15.5:0/1272779678 >> 172.21.15.5:0/1272779678 conn(0x7f97dc0659d0 msgr2=0x7f97dc09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:29.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.751+0000 7f97e3911640 1 -- 172.21.15.5:0/1272779678 shutdown_connections 2023-07-14T13:09:29.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.751+0000 7f97e3911640 1 -- 172.21.15.5:0/1272779678 wait complete. 2023-07-14T13:09:29.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.755+0000 7f97e3911640 1 Processor -- start 2023-07-14T13:09:29.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.755+0000 7f97e3911640 1 -- start start 2023-07-14T13:09:29.786 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:29.755+0000 7ff153389180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:09:29.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.755+0000 7f97e3911640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97dc0d2300 0x7f97dc147300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.755+0000 7f97e3911640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97dc0d2fc0 0x7f97dc0caf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.755+0000 7f97e3911640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97dc15bde0 0x7f97dc0cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.755+0000 7f97e3911640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc0c8f20 con 0x7f97dc0d2300 2023-07-14T13:09:29.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.755+0000 7f97e3911640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc147840 con 0x7f97dc15bde0 2023-07-14T13:09:29.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.755+0000 7f97e3911640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc0c6b60 con 0x7f97dc0d2fc0 2023-07-14T13:09:29.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.755+0000 7f97e16ad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97dc0d2300 0x7f97dc147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.755+0000 7f97e16ad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97dc0d2300 0x7f97dc147300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33600/0 (socket says 172.21.15.5:33600) 2023-07-14T13:09:29.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.755+0000 7f97e16ad640 1 -- 172.21.15.5:0/2506693239 learned_addr learned my addr 172.21.15.5:0/2506693239 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:29.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.755+0000 7f97e1eae640 1 --2- 172.21.15.5:0/2506693239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97dc15bde0 0x7f97dc0cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.755+0000 7f97e0eac640 1 --2- 172.21.15.5:0/2506693239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97dc0d2fc0 0x7f97dc0caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.755+0000 7f97e16ad640 1 -- 172.21.15.5:0/2506693239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97dc0d2fc0 msgr2=0x7f97dc0caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:29.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.755+0000 7f97e16ad640 1 --2- 172.21.15.5:0/2506693239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97dc0d2fc0 0x7f97dc0caf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.755+0000 7f97e16ad640 1 -- 172.21.15.5:0/2506693239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97dc15bde0 msgr2=0x7f97dc0cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:29.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.755+0000 7f97e16ad640 1 --2- 172.21.15.5:0/2506693239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97dc15bde0 0x7f97dc0cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.755+0000 7f97e16ad640 1 -- 172.21.15.5:0/2506693239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d80093b0 con 0x7f97dc0d2300 2023-07-14T13:09:29.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.755+0000 7f97e16ad640 1 --2- 172.21.15.5:0/2506693239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97dc0d2300 0x7f97dc147300 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f97d80190b0 tx=0x7f97d8019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:29.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.759+0000 7f97d1ffb640 1 -- 172.21.15.5:0/2506693239 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d8005e70 con 0x7f97dc0d2300 2023-07-14T13:09:29.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.759+0000 7f97d1ffb640 1 -- 172.21.15.5:0/2506693239 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d80aa960 con 0x7f97dc0d2300 2023-07-14T13:09:29.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.759+0000 7f97e3911640 1 -- 172.21.15.5:0/2506693239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97dc14f470 con 0x7f97dc0d2300 2023-07-14T13:09:29.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.759+0000 7f97d1ffb640 1 -- 172.21.15.5:0/2506693239 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d80aad10 con 0x7f97dc0d2300 2023-07-14T13:09:29.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.759+0000 7f97e3911640 1 -- 172.21.15.5:0/2506693239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97dc14fa30 con 0x7f97dc0d2300 2023-07-14T13:09:29.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.759+0000 7f97e3911640 1 -- 172.21.15.5:0/2506693239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97dc0c6cd0 con 0x7f97dc0d2300 2023-07-14T13:09:29.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.759+0000 7f97d1ffb640 1 -- 172.21.15.5:0/2506693239 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 41) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f97d8006030 con 0x7f97dc0d2300 2023-07-14T13:09:29.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.763+0000 7f97d1ffb640 1 --2- 172.21.15.5:0/2506693239 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f97c0066430 0x7f97c00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.763+0000 7f97d1ffb640 1 -- 172.21.15.5:0/2506693239 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f97d811e840 con 0x7f97dc0d2300 2023-07-14T13:09:29.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.763+0000 7f97e0eac640 1 -- 172.21.15.5:0/2506693239 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f97c0066430 msgr2=0x7f97c00688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/714349479 2023-07-14T13:09:29.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.763+0000 7f97e0eac640 1 --2- 172.21.15.5:0/2506693239 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f97c0066430 0x7f97c00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:09:29.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.763+0000 7f97d1ffb640 1 -- 172.21.15.5:0/2506693239 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f97dc0c6cd0 con 0x7f97dc0d2300 2023-07-14T13:09:29.819 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:29.787+0000 7ff34ea76180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:09:29.881 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:29.851+0000 7ff153389180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:09:29.902 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:29.871+0000 7ff34ea76180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:09:29.941 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:29.911+0000 7ff153389180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:09:29.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.923+0000 7f97e3911640 1 -- 172.21.15.5:0/2506693239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f97dc0c6cd0 con 0x7f97dc0d2300 2023-07-14T13:09:29.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.923+0000 7f97d1ffb640 1 -- 172.21.15.5:0/2506693239 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v98) v1 ==== 104+0+11 (secure 0 0 0) 0x7f97dc0c6cd0 con 0x7f97dc0d2300 2023-07-14T13:09:29.954 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T13:09:29.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.923+0000 7f97e3911640 1 -- 172.21.15.5:0/2506693239 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f97c0066430 msgr2=0x7f97c00688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:09:29.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.927+0000 7f97e3911640 1 --2- 172.21.15.5:0/2506693239 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f97c0066430 0x7f97c00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.927+0000 7f97e3911640 1 -- 172.21.15.5:0/2506693239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97dc0d2300 msgr2=0x7f97dc147300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:29.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.927+0000 7f97e3911640 1 --2- 172.21.15.5:0/2506693239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97dc0d2300 0x7f97dc147300 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f97d80190b0 tx=0x7f97d8019240 comp rx=0 tx=0).stop 2023-07-14T13:09:29.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.927+0000 7f97e3911640 1 -- 172.21.15.5:0/2506693239 shutdown_connections 2023-07-14T13:09:29.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.927+0000 7f97e3911640 1 --2- 172.21.15.5:0/2506693239 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f97c0066430 0x7f97c00688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.927+0000 7f97e3911640 1 --2- 172.21.15.5:0/2506693239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97dc15bde0 0x7f97dc0cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.927+0000 7f97e3911640 1 --2- 172.21.15.5:0/2506693239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97dc0d2fc0 0x7f97dc0caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.927+0000 7f97e3911640 1 --2- 172.21.15.5:0/2506693239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97dc0d2300 0x7f97dc147300 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.927+0000 7f97e3911640 1 -- 172.21.15.5:0/2506693239 >> 172.21.15.5:0/2506693239 conn(0x7f97dc0659d0 msgr2=0x7f97dc0b51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:29.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.927+0000 7f97e3911640 1 -- 172.21.15.5:0/2506693239 shutdown_connections 2023-07-14T13:09:29.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:29.927+0000 7f97e3911640 1 -- 172.21.15.5:0/2506693239 wait complete. 2023-07-14T13:09:29.958 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:29.927+0000 7ff34ea76180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:09:29.976 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T13:09:30.031 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:29.999+0000 7ff153389180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:09:30.092 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:30.063+0000 7ff153389180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:09:30.100 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:30.067+0000 7ff34ea76180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:09:30.158 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:30.127+0000 7ff34ea76180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:09:30.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.135+0000 7fa0d98d8640 1 Processor -- start 2023-07-14T13:09:30.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.135+0000 7fa0d98d8640 1 -- start start 2023-07-14T13:09:30.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.139+0000 7fa0d98d8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0d40cba60 0x7fa0d40c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:30.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.139+0000 7fa0d98d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0d415b9c0 0x7fa0d40cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:30.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.139+0000 7fa0d98d8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d40cc370 con 0x7fa0d4158090 2023-07-14T13:09:30.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.139+0000 7fa0d98d8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d40c37e0 con 0x7fa0d40cba60 2023-07-14T13:09:30.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.139+0000 7fa0d98d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d40c3ac0 con 0x7fa0d415b9c0 2023-07-14T13:09:30.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.139+0000 7fa0d2ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0d40cba60 0x7fa0d40c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:30.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.139+0000 7fa0d2ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0d40cba60 0x7fa0d40c3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33608/0 (socket says 172.21.15.5:33608) 2023-07-14T13:09:30.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.139+0000 7fa0d2ffd640 1 -- 172.21.15.5:0/3877089158 learned_addr learned my addr 172.21.15.5:0/3877089158 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:30.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.139+0000 7fa0cbfff640 1 --2- 172.21.15.5:0/3877089158 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0d415b9c0 0x7fa0d40cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:30.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.139+0000 7fa0d2ffd640 1 -- 172.21.15.5:0/3877089158 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0d415b9c0 msgr2=0x7fa0d40cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:30.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.139+0000 7fa0d2ffd640 1 --2- 172.21.15.5:0/3877089158 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0d415b9c0 0x7fa0d40cbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:30.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.139+0000 7fa0d2ffd640 1 -- 172.21.15.5:0/3877089158 >> v1:172.21.15.5:6789/0 conn(0x7fa0d4158090 legacy=0x7fa0d4158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:30.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.139+0000 7fa0d2ffd640 1 -- 172.21.15.5:0/3877089158 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d40c3da0 con 0x7fa0d40cba60 2023-07-14T13:09:30.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.139+0000 7fa0d27fc640 1 -- 172.21.15.5:0/3877089158 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2027147561 0 0) 0x7fa0d40cc370 con 0x7fa0d4158090 2023-07-14T13:09:30.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.143+0000 7fa0d2ffd640 1 --2- 172.21.15.5:0/3877089158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0d40cba60 0x7fa0d40c3150 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4006fd0 tx=0x7fa0c401e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c7cb2a0cb75cd7a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:30.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.143+0000 7fa0d27fc640 1 -- 172.21.15.5:0/3877089158 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4004230 con 0x7fa0d40cba60 2023-07-14T13:09:30.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.143+0000 7fa0d27fc640 1 -- 172.21.15.5:0/3877089158 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c40ab070 con 0x7fa0d40cba60 2023-07-14T13:09:30.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.143+0000 7fa0d27fc640 1 -- 172.21.15.5:0/3877089158 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c40a76f0 con 0x7fa0d40cba60 2023-07-14T13:09:30.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.143+0000 7fa0d98d8640 1 -- 172.21.15.5:0/3877089158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0d40cba60 msgr2=0x7fa0d40c3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:30.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.143+0000 7fa0d98d8640 1 --2- 172.21.15.5:0/3877089158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0d40cba60 0x7fa0d40c3150 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4006fd0 tx=0x7fa0c401e880 comp rx=0 tx=0).stop 2023-07-14T13:09:30.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.143+0000 7fa0d98d8640 1 -- 172.21.15.5:0/3877089158 shutdown_connections 2023-07-14T13:09:30.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.143+0000 7fa0d98d8640 1 --2- 172.21.15.5:0/3877089158 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0d415b9c0 0x7fa0d40cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:30.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.143+0000 7fa0d98d8640 1 --2- 172.21.15.5:0/3877089158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0d40cba60 0x7fa0d40c3150 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:30.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.143+0000 7fa0d98d8640 1 -- 172.21.15.5:0/3877089158 >> 172.21.15.5:0/3877089158 conn(0x7fa0d40cde90 msgr2=0x7fa0d40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:30.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.143+0000 7fa0d98d8640 1 -- 172.21.15.5:0/3877089158 shutdown_connections 2023-07-14T13:09:30.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.143+0000 7fa0d98d8640 1 -- 172.21.15.5:0/3877089158 wait complete. 2023-07-14T13:09:30.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.143+0000 7fa0d98d8640 1 Processor -- start 2023-07-14T13:09:30.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.143+0000 7fa0d98d8640 1 -- start start 2023-07-14T13:09:30.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.147+0000 7fa0d98d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0d40cba60 0x7fa0d4145cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:30.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.147+0000 7fa0d98d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0d4158090 0x7fa0d4152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:30.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.147+0000 7fa0d98d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0d415b9c0 0x7fa0d4161fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:30.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.147+0000 7fa0d98d8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d41461f0 con 0x7fa0d415b9c0 2023-07-14T13:09:30.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.147+0000 7fa0d98d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d4151170 con 0x7fa0d4158090 2023-07-14T13:09:30.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.147+0000 7fa0d98d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d4151fd0 con 0x7fa0d40cba60 2023-07-14T13:09:30.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.147+0000 7fa0d37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0d415b9c0 0x7fa0d4161fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:30.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.147+0000 7fa0d2ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0d40cba60 0x7fa0d4145cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:30.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.147+0000 7fa0d2ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0d40cba60 0x7fa0d4145cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:39980/0 (socket says 172.21.15.5:39980) 2023-07-14T13:09:30.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.147+0000 7fa0d2ffd640 1 -- 172.21.15.5:0/161877876 learned_addr learned my addr 172.21.15.5:0/161877876 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:30.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.147+0000 7fa0cbfff640 1 --2- 172.21.15.5:0/161877876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0d4158090 0x7fa0d4152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:30.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.147+0000 7fa0d2ffd640 1 -- 172.21.15.5:0/161877876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0d4158090 msgr2=0x7fa0d4152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:30.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.147+0000 7fa0d2ffd640 1 --2- 172.21.15.5:0/161877876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0d4158090 0x7fa0d4152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:30.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.147+0000 7fa0d2ffd640 1 -- 172.21.15.5:0/161877876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0d415b9c0 msgr2=0x7fa0d4161fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:30.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.147+0000 7fa0d2ffd640 1 --2- 172.21.15.5:0/161877876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0d415b9c0 0x7fa0d4161fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:30.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.147+0000 7fa0d2ffd640 1 -- 172.21.15.5:0/161877876 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c400b780 con 0x7fa0d40cba60 2023-07-14T13:09:30.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.147+0000 7fa0d2ffd640 1 --2- 172.21.15.5:0/161877876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0d40cba60 0x7fa0d4145cb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4000c10 tx=0x7fa0c401b620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:30.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.147+0000 7fa0d0ff9640 1 -- 172.21.15.5:0/161877876 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c40a8990 con 0x7fa0d40cba60 2023-07-14T13:09:30.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.147+0000 7fa0d0ff9640 1 -- 172.21.15.5:0/161877876 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c40a8af0 con 0x7fa0d40cba60 2023-07-14T13:09:30.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.147+0000 7fa0d0ff9640 1 -- 172.21.15.5:0/161877876 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c40a8e60 con 0x7fa0d40cba60 2023-07-14T13:09:30.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.147+0000 7fa0d98d8640 1 -- 172.21.15.5:0/161877876 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d41513c0 con 0x7fa0d40cba60 2023-07-14T13:09:30.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.147+0000 7fa0d98d8640 1 -- 172.21.15.5:0/161877876 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d4151980 con 0x7fa0d40cba60 2023-07-14T13:09:30.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.147+0000 7fa0d98d8640 1 -- 172.21.15.5:0/161877876 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d40714b0 con 0x7fa0d40cba60 2023-07-14T13:09:30.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.151+0000 7fa0d0ff9640 1 -- 172.21.15.5:0/161877876 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 41) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fa0c4003620 con 0x7fa0d40cba60 2023-07-14T13:09:30.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.151+0000 7fa0d0ff9640 1 --2- 172.21.15.5:0/161877876 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fa0b4066460 0x7fa0b4068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:30.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.151+0000 7fa0d0ff9640 1 -- 172.21.15.5:0/161877876 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fa0c411def0 con 0x7fa0d40cba60 2023-07-14T13:09:30.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.151+0000 7fa0cbfff640 1 -- 172.21.15.5:0/161877876 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fa0b4066460 msgr2=0x7fa0b4068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/714349479 2023-07-14T13:09:30.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.151+0000 7fa0cbfff640 1 --2- 172.21.15.5:0/161877876 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fa0b4066460 0x7fa0b4068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:09:30.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.155+0000 7fa0d0ff9640 1 -- 172.21.15.5:0/161877876 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa0c40eb050 con 0x7fa0d40cba60 2023-07-14T13:09:30.246 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:30.215+0000 7ff153389180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:09:30.308 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:30.275+0000 7ff153389180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:09:30.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.315+0000 7fa0d98d8640 1 -- 172.21.15.5:0/161877876 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa0d40678d0 con 0x7fa0d40cba60 2023-07-14T13:09:30.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.315+0000 7fa0d0ff9640 1 -- 172.21.15.5:0/161877876 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa0c40be0a0 con 0x7fa0d40cba60 2023-07-14T13:09:30.346 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T13:09:30.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.315+0000 7fa0d98d8640 1 -- 172.21.15.5:0/161877876 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fa0b4066460 msgr2=0x7fa0b4068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:09:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.315+0000 7fa0d98d8640 1 --2- 172.21.15.5:0/161877876 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fa0b4066460 0x7fa0b4068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.315+0000 7fa0d98d8640 1 -- 172.21.15.5:0/161877876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0d40cba60 msgr2=0x7fa0d4145cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.315+0000 7fa0d98d8640 1 --2- 172.21.15.5:0/161877876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0d40cba60 0x7fa0d4145cb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4000c10 tx=0x7fa0c401b620 comp rx=0 tx=0).stop 2023-07-14T13:09:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.315+0000 7fa0d98d8640 1 -- 172.21.15.5:0/161877876 shutdown_connections 2023-07-14T13:09:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.315+0000 7fa0d98d8640 1 --2- 172.21.15.5:0/161877876 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fa0b4066460 0x7fa0b4068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.315+0000 7fa0d98d8640 1 --2- 172.21.15.5:0/161877876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0d415b9c0 0x7fa0d4161fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:30.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.315+0000 7fa0d98d8640 1 --2- 172.21.15.5:0/161877876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0d4158090 0x7fa0d4152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:30.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.315+0000 7fa0d98d8640 1 --2- 172.21.15.5:0/161877876 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0d40cba60 0x7fa0d4145cb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:30.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.315+0000 7fa0d98d8640 1 -- 172.21.15.5:0/161877876 >> 172.21.15.5:0/161877876 conn(0x7fa0d40cde90 msgr2=0x7fa0d415ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:30.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.315+0000 7fa0d98d8640 1 -- 172.21.15.5:0/161877876 shutdown_connections 2023-07-14T13:09:30.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.315+0000 7fa0d98d8640 1 -- 172.21.15.5:0/161877876 wait complete. 2023-07-14T13:09:30.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T13:09:30.399 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:09:30.399 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:09:30.400 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:09:30.407 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:30.375+0000 7ff34ea76180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:09:30.540 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:30.507+0000 7ff34ea76180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:09:30.566 INFO:tasks.ceph.mgr.y.smithi005.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:09:30.567 INFO:tasks.ceph.mgr.y.smithi005.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:09:30.567 INFO:tasks.ceph.mgr.y.smithi005.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:09:30.576 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:30.543+0000 7ff153389180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:09:30.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.559+0000 7fc88d0ec640 1 Processor -- start 2023-07-14T13:09:30.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.559+0000 7fc88d0ec640 1 -- start start 2023-07-14T13:09:30.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.559+0000 7fc88d0ec640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc8880b7c70 0x7fc8880d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:30.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.559+0000 7fc88d0ec640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8880d1850 0x7fc88815f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:30.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.559+0000 7fc88d0ec640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc8880d1300 0x7fc88815fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:30.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.559+0000 7fc88d0ec640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8880d1190 con 0x7fc8880b7c70 2023-07-14T13:09:30.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.559+0000 7fc88d0ec640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc888160600 con 0x7fc8880d1300 2023-07-14T13:09:30.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.559+0000 7fc88d0ec640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8881600d0 con 0x7fc8880d1850 2023-07-14T13:09:30.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.559+0000 7fc886d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc8880b7c70 0x7fc8880d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:30.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.559+0000 7fc886d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc8880b7c70 0x7fc8880d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33636/0 (socket says 172.21.15.5:33636) 2023-07-14T13:09:30.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.559+0000 7fc886d9d640 1 -- 172.21.15.5:0/1944412384 learned_addr learned my addr 172.21.15.5:0/1944412384 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:30.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.559+0000 7fc88759e640 1 --2- 172.21.15.5:0/1944412384 >> v2:172.21.15.154:3300/0 conn(0x7fc8880d1300 0x7fc88815fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:30.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.559+0000 7fc88659c640 1 --2- 172.21.15.5:0/1944412384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8880d1850 0x7fc88815f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:30.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.559+0000 7fc886d9d640 1 -- 172.21.15.5:0/1944412384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8880d1850 msgr2=0x7fc88815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:30.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.559+0000 7fc886d9d640 1 --2- 172.21.15.5:0/1944412384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8880d1850 0x7fc88815f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:30.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.559+0000 7fc886d9d640 1 -- 172.21.15.5:0/1944412384 >> v2:172.21.15.154:3300/0 conn(0x7fc8880d1300 msgr2=0x7fc88815fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:30.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.559+0000 7fc886d9d640 1 --2- 172.21.15.5:0/1944412384 >> v2:172.21.15.154:3300/0 conn(0x7fc8880d1300 0x7fc88815fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:30.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.559+0000 7fc886d9d640 1 -- 172.21.15.5:0/1944412384 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8880ccaf0 con 0x7fc8880b7c70 2023-07-14T13:09:30.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.559+0000 7fc88759e640 1 --2- 172.21.15.5:0/1944412384 >> v2:172.21.15.154:3300/0 conn(0x7fc8880d1300 0x7fc88815fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:09:30.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.563+0000 7fc886d9d640 1 --2- 172.21.15.5:0/1944412384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8880b7c70 0x7fc8880d0c50 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fc888069e40 tx=0x7fc87801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e6450149e3333e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:30.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.563+0000 7fc885d9b640 1 -- 172.21.15.5:0/1944412384 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8780ac600 con 0x7fc8880b7c70 2023-07-14T13:09:30.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.563+0000 7fc885d9b640 1 -- 172.21.15.5:0/1944412384 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8780a8050 con 0x7fc8880b7c70 2023-07-14T13:09:30.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.563+0000 7fc885d9b640 1 -- 172.21.15.5:0/1944412384 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8780ac980 con 0x7fc8880b7c70 2023-07-14T13:09:30.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.563+0000 7fc88d0ec640 1 -- 172.21.15.5:0/1944412384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8880b7c70 msgr2=0x7fc8880d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:30.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.563+0000 7fc88d0ec640 1 --2- 172.21.15.5:0/1944412384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8880b7c70 0x7fc8880d0c50 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fc888069e40 tx=0x7fc87801c4d0 comp rx=0 tx=0).stop 2023-07-14T13:09:30.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.563+0000 7fc88d0ec640 1 -- 172.21.15.5:0/1944412384 shutdown_connections 2023-07-14T13:09:30.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.563+0000 7fc88d0ec640 1 --2- 172.21.15.5:0/1944412384 >> v2:172.21.15.154:3300/0 conn(0x7fc8880d1300 0x7fc88815fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:30.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.563+0000 7fc88d0ec640 1 --2- 172.21.15.5:0/1944412384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8880d1850 0x7fc88815f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:30.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.563+0000 7fc88d0ec640 1 --2- 172.21.15.5:0/1944412384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8880b7c70 0x7fc8880d0c50 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:30.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.563+0000 7fc88d0ec640 1 -- 172.21.15.5:0/1944412384 >> 172.21.15.5:0/1944412384 conn(0x7fc8880650b0 msgr2=0x7fc8880654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:30.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.563+0000 7fc88d0ec640 1 -- 172.21.15.5:0/1944412384 shutdown_connections 2023-07-14T13:09:30.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.563+0000 7fc88d0ec640 1 -- 172.21.15.5:0/1944412384 wait complete. 2023-07-14T13:09:30.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.567+0000 7fc88d0ec640 1 Processor -- start 2023-07-14T13:09:30.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.567+0000 7fc88d0ec640 1 -- start start 2023-07-14T13:09:30.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.567+0000 7fc88d0ec640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8880b7c70 0x7fc888156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:30.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.567+0000 7fc88d0ec640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8880d1300 0x7fc88815aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:30.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.567+0000 7fc88d0ec640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8880d1850 0x7fc88815af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:30.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.567+0000 7fc88d0ec640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8880ca8a0 con 0x7fc8880d1300 2023-07-14T13:09:30.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.567+0000 7fc88d0ec640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc888157070 con 0x7fc8880d1850 2023-07-14T13:09:30.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.567+0000 7fc88d0ec640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc888143180 con 0x7fc8880b7c70 2023-07-14T13:09:30.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.567+0000 7fc88659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8880d1300 0x7fc88815aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:30.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.567+0000 7fc886d9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8880b7c70 0x7fc888156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:30.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.567+0000 7fc886d9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8880b7c70 0x7fc888156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:39998/0 (socket says 172.21.15.5:39998) 2023-07-14T13:09:30.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.567+0000 7fc886d9d640 1 -- 172.21.15.5:0/477130902 learned_addr learned my addr 172.21.15.5:0/477130902 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:30.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.567+0000 7fc88759e640 1 --2- 172.21.15.5:0/477130902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8880d1850 0x7fc88815af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:30.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.567+0000 7fc886d9d640 1 -- 172.21.15.5:0/477130902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8880d1850 msgr2=0x7fc88815af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:30.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.567+0000 7fc886d9d640 1 --2- 172.21.15.5:0/477130902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8880d1850 0x7fc88815af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:30.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.567+0000 7fc886d9d640 1 -- 172.21.15.5:0/477130902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8880d1300 msgr2=0x7fc88815aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:30.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.567+0000 7fc886d9d640 1 --2- 172.21.15.5:0/477130902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8880d1300 0x7fc88815aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:30.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.567+0000 7fc886d9d640 1 -- 172.21.15.5:0/477130902 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc880009a70 con 0x7fc8880b7c70 2023-07-14T13:09:30.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.567+0000 7fc886d9d640 1 --2- 172.21.15.5:0/477130902 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8880b7c70 0x7fc888156b30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc87801cd70 tx=0x7fc87801ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:30.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.567+0000 7fc86f7fe640 1 -- 172.21.15.5:0/477130902 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8780b7420 con 0x7fc8880b7c70 2023-07-14T13:09:30.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.567+0000 7fc86f7fe640 1 -- 172.21.15.5:0/477130902 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8780b75a0 con 0x7fc8880b7c70 2023-07-14T13:09:30.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.567+0000 7fc86f7fe640 1 -- 172.21.15.5:0/477130902 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8780b7950 con 0x7fc8880b7c70 2023-07-14T13:09:30.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.567+0000 7fc88d0ec640 1 -- 172.21.15.5:0/477130902 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8780094d0 con 0x7fc8880b7c70 2023-07-14T13:09:30.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.567+0000 7fc88d0ec640 1 -- 172.21.15.5:0/477130902 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8880cab00 con 0x7fc8880b7c70 2023-07-14T13:09:30.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.571+0000 7fc88d0ec640 1 -- 172.21.15.5:0/477130902 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8880678d0 con 0x7fc8880b7c70 2023-07-14T13:09:30.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.571+0000 7fc86f7fe640 1 -- 172.21.15.5:0/477130902 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 41) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fc8780b3040 con 0x7fc8880b7c70 2023-07-14T13:09:30.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.571+0000 7fc86f7fe640 1 --2- 172.21.15.5:0/477130902 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fc874066430 0x7fc8740688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:30.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.571+0000 7fc86f7fe640 1 -- 172.21.15.5:0/477130902 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fc87811e3b0 con 0x7fc8880b7c70 2023-07-14T13:09:30.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.571+0000 7fc88659c640 1 -- 172.21.15.5:0/477130902 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fc874066430 msgr2=0x7fc8740688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/714349479 2023-07-14T13:09:30.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.571+0000 7fc88659c640 1 --2- 172.21.15.5:0/477130902 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fc874066430 0x7fc8740688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:09:30.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.575+0000 7fc86f7fe640 1 -- 172.21.15.5:0/477130902 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc8780eb2a0 con 0x7fc8880b7c70 2023-07-14T13:09:30.667 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:30.635+0000 7ff34ea76180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:09:30.720 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:30.691+0000 7ff153389180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:09:30.738 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:30.707+0000 7ff34ea76180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:09:30.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.747+0000 7fc88d0ec640 1 -- 172.21.15.5:0/477130902 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc888065740 con 0x7fc8880b7c70 2023-07-14T13:09:30.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.747+0000 7fc86f7fe640 1 -- 172.21.15.5:0/477130902 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v98) v1 ==== 80+0+478 (secure 0 0 0) 0x7fc8780ee8c0 con 0x7fc8880b7c70 2023-07-14T13:09:30.777 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/1136667119 2023-07-15T13:09:26.280972+0000 2023-07-14T13:09:30.777 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:6833/3243469291 2023-07-15T13:09:26.280972+0000 2023-07-14T13:09:30.778 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:6832/3243469291 2023-07-15T13:09:26.280972+0000 2023-07-14T13:09:30.778 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/2054145215 2023-07-15T13:09:26.280972+0000 2023-07-14T13:09:30.778 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/3260672688 2023-07-15T13:09:26.280972+0000 2023-07-14T13:09:30.778 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/2925558673 2023-07-15T13:09:26.280972+0000 2023-07-14T13:09:30.778 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/3026075462 2023-07-15T13:09:26.280972+0000 2023-07-14T13:09:30.778 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/2368288551 2023-07-15T13:09:26.280972+0000 2023-07-14T13:09:30.779 INFO:teuthology.orchestra.run.smithi005.stderr:listed 8 entries 2023-07-14T13:09:30.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.747+0000 7fc88d0ec640 1 -- 172.21.15.5:0/477130902 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fc874066430 msgr2=0x7fc8740688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:09:30.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.747+0000 7fc88d0ec640 1 --2- 172.21.15.5:0/477130902 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fc874066430 0x7fc8740688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:30.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.747+0000 7fc88d0ec640 1 -- 172.21.15.5:0/477130902 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8880b7c70 msgr2=0x7fc888156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:30.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.747+0000 7fc88d0ec640 1 --2- 172.21.15.5:0/477130902 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8880b7c70 0x7fc888156b30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc87801cd70 tx=0x7fc87801ad10 comp rx=0 tx=0).stop 2023-07-14T13:09:30.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.747+0000 7fc88d0ec640 1 -- 172.21.15.5:0/477130902 shutdown_connections 2023-07-14T13:09:30.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.747+0000 7fc88d0ec640 1 --2- 172.21.15.5:0/477130902 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fc874066430 0x7fc8740688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:30.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.747+0000 7fc88d0ec640 1 --2- 172.21.15.5:0/477130902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8880d1850 0x7fc88815af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:30.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.747+0000 7fc88d0ec640 1 --2- 172.21.15.5:0/477130902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8880d1300 0x7fc88815aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:30.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.747+0000 7fc88d0ec640 1 --2- 172.21.15.5:0/477130902 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8880b7c70 0x7fc888156b30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:30.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.747+0000 7fc88d0ec640 1 -- 172.21.15.5:0/477130902 >> 172.21.15.5:0/477130902 conn(0x7fc8880650b0 msgr2=0x7fc8880b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:30.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.747+0000 7fc88d0ec640 1 -- 172.21.15.5:0/477130902 shutdown_connections 2023-07-14T13:09:30.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:30.747+0000 7fc88d0ec640 1 -- 172.21.15.5:0/477130902 wait complete. 2023-07-14T13:09:30.799 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-14T13:09:30.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:09:30.799 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-14T13:09:30.857 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:30.827+0000 7ff153389180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:09:30.860 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-07-14T13:09:30.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:09:30.861 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-14T13:09:30.870 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:09:30.871 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:09:30.873 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:30.843+0000 7ff34ea76180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:09:30.881 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:09:30.881 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:09:30.882 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:09:30.920 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:09:30.921 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:09:30.921 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:09:30.932 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:30.899+0000 7ff153389180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:09:30.933 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:09:30.934 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:09:31.077 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:31.047+0000 7ff153389180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:09:31.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.047+0000 7f25337db640 1 Processor -- start 2023-07-14T13:09:31.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.047+0000 7f25337db640 1 -- start start 2023-07-14T13:09:31.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.051+0000 7f25337db640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f252c0b7c70 0x7f252c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.051+0000 7f25337db640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f252c15fd60 0x7f252c0d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.051+0000 7f25337db640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f252c0ccaf0 con 0x7f252c0d1850 2023-07-14T13:09:31.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.051+0000 7f25337db640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f252c0d1190 con 0x7f252c15fd60 2023-07-14T13:09:31.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.051+0000 7f25337db640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f252c160600 con 0x7f252c0b7c70 2023-07-14T13:09:31.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.051+0000 7f2531577640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f252c0b7c70 0x7f252c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.051+0000 7f2530d76640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f252c0d1850 0x7f252c15f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:45466/0 (socket says 172.21.15.5:45466) 2023-07-14T13:09:31.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.051+0000 7f2531577640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f252c0b7c70 0x7f252c0d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:60656/0 (socket says 172.21.15.5:60656) 2023-07-14T13:09:31.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.051+0000 7f2530d76640 1 -- 172.21.15.5:0/2479805390 learned_addr learned my addr 172.21.15.5:0/2479805390 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:31.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.051+0000 7f2531d78640 1 --2- 172.21.15.5:0/2479805390 >> v2:172.21.15.5:3300/0 conn(0x7f252c15fd60 0x7f252c0d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.051+0000 7f2531577640 1 -- 172.21.15.5:0/2479805390 >> v2:172.21.15.5:3300/0 conn(0x7f252c15fd60 msgr2=0x7f252c0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:31.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.051+0000 7f2531577640 1 --2- 172.21.15.5:0/2479805390 >> v2:172.21.15.5:3300/0 conn(0x7f252c15fd60 0x7f252c0d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.051+0000 7f2531577640 1 -- 172.21.15.5:0/2479805390 >> v1:172.21.15.154:6789/0 conn(0x7f252c0d1850 legacy=0x7f252c15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:31.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.051+0000 7f2523fff640 1 -- 172.21.15.5:0/2479805390 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616969359 0 0) 0x7f252c0ccaf0 con 0x7f252c0d1850 2023-07-14T13:09:31.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.051+0000 7f2531577640 1 -- 172.21.15.5:0/2479805390 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252c160320 con 0x7f252c0b7c70 2023-07-14T13:09:31.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.055+0000 7f2531577640 1 --2- 172.21.15.5:0/2479805390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f252c0b7c70 0x7f252c0d0c50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f252c0b40a0 tx=0x7f252801c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56e66cc008430f3c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:31.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.055+0000 7f2523fff640 1 -- 172.21.15.5:0/2479805390 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25280ab650 con 0x7f252c0b7c70 2023-07-14T13:09:31.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.055+0000 7f2523fff640 1 -- 172.21.15.5:0/2479805390 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25280ab7b0 con 0x7f252c0b7c70 2023-07-14T13:09:31.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.055+0000 7f2523fff640 1 -- 172.21.15.5:0/2479805390 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25280abb40 con 0x7f252c0b7c70 2023-07-14T13:09:31.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.055+0000 7f25337db640 1 -- 172.21.15.5:0/2479805390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f252c0b7c70 msgr2=0x7f252c0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:31.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.055+0000 7f25337db640 1 --2- 172.21.15.5:0/2479805390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f252c0b7c70 0x7f252c0d0c50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f252c0b40a0 tx=0x7f252801c430 comp rx=0 tx=0).stop 2023-07-14T13:09:31.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.055+0000 7f25337db640 1 -- 172.21.15.5:0/2479805390 shutdown_connections 2023-07-14T13:09:31.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.055+0000 7f25337db640 1 --2- 172.21.15.5:0/2479805390 >> v2:172.21.15.5:3300/0 conn(0x7f252c15fd60 0x7f252c0d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.055+0000 7f25337db640 1 --2- 172.21.15.5:0/2479805390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f252c0b7c70 0x7f252c0d0c50 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.055+0000 7f25337db640 1 -- 172.21.15.5:0/2479805390 >> 172.21.15.5:0/2479805390 conn(0x7f252c0650b0 msgr2=0x7f252c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:31.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.055+0000 7f25337db640 1 -- 172.21.15.5:0/2479805390 shutdown_connections 2023-07-14T13:09:31.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.055+0000 7f25337db640 1 -- 172.21.15.5:0/2479805390 wait complete. 2023-07-14T13:09:31.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.059+0000 7f25337db640 1 Processor -- start 2023-07-14T13:09:31.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.059+0000 7f25337db640 1 -- start start 2023-07-14T13:09:31.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.059+0000 7f25337db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f252c0b7c70 0x7f252c157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.059+0000 7f25337db640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f252c0d1850 0x7f252c14f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.059+0000 7f25337db640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f252c15fd60 0x7f252c151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.059+0000 7f25337db640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252c1574b0 con 0x7f252c0b7c70 2023-07-14T13:09:31.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.059+0000 7f25337db640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252c1571d0 con 0x7f252c15fd60 2023-07-14T13:09:31.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.059+0000 7f25337db640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252c150a40 con 0x7f252c0d1850 2023-07-14T13:09:31.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.059+0000 7f2531577640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f252c0b7c70 0x7f252c157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.059+0000 7f2531577640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f252c0b7c70 0x7f252c157b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33660/0 (socket says 172.21.15.5:33660) 2023-07-14T13:09:31.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.059+0000 7f2531577640 1 -- 172.21.15.5:0/2340042652 learned_addr learned my addr 172.21.15.5:0/2340042652 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:31.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.059+0000 7f2530d76640 1 --2- 172.21.15.5:0/2340042652 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f252c0d1850 0x7f252c14f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.059+0000 7f2531d78640 1 --2- 172.21.15.5:0/2340042652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f252c15fd60 0x7f252c151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.059+0000 7f2531577640 1 -- 172.21.15.5:0/2340042652 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f252c0d1850 msgr2=0x7f252c14f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:31.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.059+0000 7f2531577640 1 --2- 172.21.15.5:0/2340042652 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f252c0d1850 0x7f252c14f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.059+0000 7f2531577640 1 -- 172.21.15.5:0/2340042652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f252c15fd60 msgr2=0x7f252c151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:31.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.059+0000 7f2531577640 1 --2- 172.21.15.5:0/2340042652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f252c15fd60 0x7f252c151f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.059+0000 7f2531577640 1 -- 172.21.15.5:0/2340042652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2528009420 con 0x7f252c0b7c70 2023-07-14T13:09:31.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.059+0000 7f2531577640 1 --2- 172.21.15.5:0/2340042652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f252c0b7c70 0x7f252c157b80 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f2528019040 tx=0x7f252801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:31.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.059+0000 7f2521ffb640 1 -- 172.21.15.5:0/2340042652 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25280bf610 con 0x7f252c0b7c70 2023-07-14T13:09:31.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.059+0000 7f2521ffb640 1 -- 172.21.15.5:0/2340042652 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25280bf770 con 0x7f252c0b7c70 2023-07-14T13:09:31.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.059+0000 7f2521ffb640 1 -- 172.21.15.5:0/2340042652 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25280bfb20 con 0x7f252c0b7c70 2023-07-14T13:09:31.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.059+0000 7f25337db640 1 -- 172.21.15.5:0/2340042652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f252c150d20 con 0x7f252c0b7c70 2023-07-14T13:09:31.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.059+0000 7f25337db640 1 -- 172.21.15.5:0/2340042652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252c151710 con 0x7f252c0b7c70 2023-07-14T13:09:31.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.063+0000 7f25337db640 1 -- 172.21.15.5:0/2340042652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f252c0678d0 con 0x7f252c0b7c70 2023-07-14T13:09:31.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.063+0000 7f2521ffb640 1 -- 172.21.15.5:0/2340042652 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 41) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f25280bfc80 con 0x7f252c0b7c70 2023-07-14T13:09:31.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.063+0000 7f2521ffb640 1 --2- 172.21.15.5:0/2340042652 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f2510066430 0x7f25100688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.063+0000 7f2521ffb640 1 -- 172.21.15.5:0/2340042652 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f252811eaa0 con 0x7f252c0b7c70 2023-07-14T13:09:31.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.063+0000 7f2530d76640 1 -- 172.21.15.5:0/2340042652 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f2510066430 msgr2=0x7f25100688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/714349479 2023-07-14T13:09:31.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.063+0000 7f2530d76640 1 --2- 172.21.15.5:0/2340042652 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f2510066430 0x7f25100688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:09:31.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.067+0000 7f2521ffb640 1 -- 172.21.15.5:0/2340042652 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f25280ebc00 con 0x7f252c0b7c70 2023-07-14T13:09:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.255+0000 7f25337db640 1 -- 172.21.15.5:0/2340042652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f252c1511d0 con 0x7f252c0b7c70 2023-07-14T13:09:31.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.255+0000 7f2521ffb640 1 -- 172.21.15.5:0/2340042652 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4702 (secure 0 0 0) 0x7f25280ef220 con 0x7f252c0b7c70 2023-07-14T13:09:31.288 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:31.289 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6901,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/747965975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":747965975},{"type":"v1","addr":"172.21.15.5:6835","nonce":747965975}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6907,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1902785181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1902785181},{"type":"v1","addr":"172.21.15.154:6835","nonce":1902785181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6916,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/90532135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":90532135},{"type":"v1","addr":"172.21.15.154:6837","nonce":90532135}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:09:08.828642+0000","modified":"2023-07-14T13:09:12.468790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7104},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7104":{"gid":7104,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6834/2611471565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2611471565},{"type":"v1","addr":"172.21.15.5:6834","nonce":2611471565}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-14T13:09:31.289 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 41 2023-07-14T13:09:31.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.259+0000 7f25337db640 1 -- 172.21.15.5:0/2340042652 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f2510066430 msgr2=0x7f25100688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:09:31.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.259+0000 7f25337db640 1 --2- 172.21.15.5:0/2340042652 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f2510066430 0x7f25100688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.259+0000 7f25337db640 1 -- 172.21.15.5:0/2340042652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f252c0b7c70 msgr2=0x7f252c157b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:31.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.259+0000 7f25337db640 1 --2- 172.21.15.5:0/2340042652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f252c0b7c70 0x7f252c157b80 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f2528019040 tx=0x7f252801ac70 comp rx=0 tx=0).stop 2023-07-14T13:09:31.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.259+0000 7f25337db640 1 -- 172.21.15.5:0/2340042652 shutdown_connections 2023-07-14T13:09:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.259+0000 7f25337db640 1 --2- 172.21.15.5:0/2340042652 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f2510066430 0x7f25100688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.259+0000 7f25337db640 1 --2- 172.21.15.5:0/2340042652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f252c15fd60 0x7f252c151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.259+0000 7f25337db640 1 --2- 172.21.15.5:0/2340042652 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f252c0d1850 0x7f252c14f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.259+0000 7f25337db640 1 --2- 172.21.15.5:0/2340042652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f252c0b7c70 0x7f252c157b80 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.259+0000 7f25337db640 1 -- 172.21.15.5:0/2340042652 >> 172.21.15.5:0/2340042652 conn(0x7f252c0650b0 msgr2=0x7f252c15f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.259+0000 7f25337db640 1 -- 172.21.15.5:0/2340042652 shutdown_connections 2023-07-14T13:09:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.259+0000 7f25337db640 1 -- 172.21.15.5:0/2340042652 wait complete. 2023-07-14T13:09:31.309 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:09:31.416 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:31.383+0000 7ff34ea76180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:09:31.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.427+0000 7fdb31b9d640 1 Processor -- start 2023-07-14T13:09:31.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.427+0000 7fdb31b9d640 1 -- start start 2023-07-14T13:09:31.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.427+0000 7fdb31b9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdb2c070b70 0x7fdb2c070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.427+0000 7fdb31b9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb2c06b1e0 0x7fdb2c0c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.427+0000 7fdb31b9d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb2c0cac70 con 0x7fdb2c0c21f0 2023-07-14T13:09:31.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.427+0000 7fdb31b9d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb2c071480 con 0x7fdb2c070b70 2023-07-14T13:09:31.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.427+0000 7fdb31b9d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c0ca060 con 0x7fdb2c06b1e0 2023-07-14T13:09:31.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.427+0000 7fdb2b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdb2c070b70 0x7fdb2c070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.427+0000 7fdb2b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdb2c070b70 0x7fdb2c070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33666/0 (socket says 172.21.15.5:33666) 2023-07-14T13:09:31.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.427+0000 7fdb2b7fe640 1 -- 172.21.15.5:0/2542661855 learned_addr learned my addr 172.21.15.5:0/2542661855 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:31.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.427+0000 7fdb2affd640 1 --2- 172.21.15.5:0/2542661855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb2c06b1e0 0x7fdb2c0c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.427+0000 7fdb2b7fe640 1 -- 172.21.15.5:0/2542661855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb2c06b1e0 msgr2=0x7fdb2c0c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:31.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.427+0000 7fdb2b7fe640 1 --2- 172.21.15.5:0/2542661855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb2c06b1e0 0x7fdb2c0c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.427+0000 7fdb2b7fe640 1 -- 172.21.15.5:0/2542661855 >> v1:172.21.15.154:6789/0 conn(0x7fdb2c0c21f0 legacy=0x7fdb2c0cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:31.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.427+0000 7fdb2b7fe640 1 -- 172.21.15.5:0/2542661855 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2c0ca340 con 0x7fdb2c070b70 2023-07-14T13:09:31.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.427+0000 7fdb2affd640 1 --2- 172.21.15.5:0/2542661855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb2c06b1e0 0x7fdb2c0c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:31.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.431+0000 7fdb2b7fe640 1 --2- 172.21.15.5:0/2542661855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb2c070b70 0x7fdb2c070f40 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c009870 tx=0x7fdb1c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e676e3a576865d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:31.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.431+0000 7fdb2a7fc640 1 -- 172.21.15.5:0/2542661855 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c0ab680 con 0x7fdb2c070b70 2023-07-14T13:09:31.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.431+0000 7fdb2a7fc640 1 -- 172.21.15.5:0/2542661855 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1c0ab7e0 con 0x7fdb2c070b70 2023-07-14T13:09:31.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.431+0000 7fdb2a7fc640 1 -- 172.21.15.5:0/2542661855 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c0abb70 con 0x7fdb2c070b70 2023-07-14T13:09:31.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.431+0000 7fdb31b9d640 1 -- 172.21.15.5:0/2542661855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb2c070b70 msgr2=0x7fdb2c070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:31.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.431+0000 7fdb31b9d640 1 --2- 172.21.15.5:0/2542661855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb2c070b70 0x7fdb2c070f40 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c009870 tx=0x7fdb1c01c480 comp rx=0 tx=0).stop 2023-07-14T13:09:31.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.431+0000 7fdb31b9d640 1 -- 172.21.15.5:0/2542661855 shutdown_connections 2023-07-14T13:09:31.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.431+0000 7fdb31b9d640 1 --2- 172.21.15.5:0/2542661855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb2c06b1e0 0x7fdb2c0c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.431+0000 7fdb31b9d640 1 --2- 172.21.15.5:0/2542661855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb2c070b70 0x7fdb2c070f40 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.431+0000 7fdb31b9d640 1 -- 172.21.15.5:0/2542661855 >> 172.21.15.5:0/2542661855 conn(0x7fdb2c0afcf0 msgr2=0x7fdb2c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:31.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.431+0000 7fdb31b9d640 1 -- 172.21.15.5:0/2542661855 shutdown_connections 2023-07-14T13:09:31.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.431+0000 7fdb31b9d640 1 -- 172.21.15.5:0/2542661855 wait complete. 2023-07-14T13:09:31.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.435+0000 7fdb31b9d640 1 Processor -- start 2023-07-14T13:09:31.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.435+0000 7fdb31b9d640 1 -- start start 2023-07-14T13:09:31.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.435+0000 7fdb31b9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb2c06b1e0 0x7fdb2c155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.435+0000 7fdb31b9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb2c070b70 0x7fdb2c0c3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.435+0000 7fdb31b9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb2c0c21f0 0x7fdb2c1523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.435+0000 7fdb31b9d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c154e90 con 0x7fdb2c070b70 2023-07-14T13:09:31.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.435+0000 7fdb31b9d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c0c3640 con 0x7fdb2c06b1e0 2023-07-14T13:09:31.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.435+0000 7fdb31b9d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c154560 con 0x7fdb2c0c21f0 2023-07-14T13:09:31.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.435+0000 7fdb2affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb2c070b70 0x7fdb2c0c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.435+0000 7fdb2affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb2c070b70 0x7fdb2c0c3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33672/0 (socket says 172.21.15.5:33672) 2023-07-14T13:09:31.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.435+0000 7fdb2affd640 1 -- 172.21.15.5:0/1790956739 learned_addr learned my addr 172.21.15.5:0/1790956739 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:31.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.435+0000 7fdb2b7fe640 1 --2- 172.21.15.5:0/1790956739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb2c06b1e0 0x7fdb2c155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.435+0000 7fdb2bfff640 1 --2- 172.21.15.5:0/1790956739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb2c0c21f0 0x7fdb2c1523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.435+0000 7fdb2affd640 1 -- 172.21.15.5:0/1790956739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb2c0c21f0 msgr2=0x7fdb2c1523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:31.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.435+0000 7fdb2affd640 1 --2- 172.21.15.5:0/1790956739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb2c0c21f0 0x7fdb2c1523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.435+0000 7fdb2affd640 1 -- 172.21.15.5:0/1790956739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb2c06b1e0 msgr2=0x7fdb2c155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:31.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.435+0000 7fdb2affd640 1 --2- 172.21.15.5:0/1790956739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb2c06b1e0 0x7fdb2c155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.435+0000 7fdb2affd640 1 -- 172.21.15.5:0/1790956739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1c0094d0 con 0x7fdb2c070b70 2023-07-14T13:09:31.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.435+0000 7fdb2affd640 1 --2- 172.21.15.5:0/1790956739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb2c070b70 0x7fdb2c0c3100 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fdb2000e810 tx=0x7fdb2000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:31.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.435+0000 7fdb13fff640 1 -- 172.21.15.5:0/1790956739 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2000c8d0 con 0x7fdb2c070b70 2023-07-14T13:09:31.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.435+0000 7fdb13fff640 1 -- 172.21.15.5:0/1790956739 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2000ca30 con 0x7fdb2c070b70 2023-07-14T13:09:31.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.435+0000 7fdb13fff640 1 -- 172.21.15.5:0/1790956739 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2000cdc0 con 0x7fdb2c070b70 2023-07-14T13:09:31.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.435+0000 7fdb31b9d640 1 -- 172.21.15.5:0/1790956739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb2c154840 con 0x7fdb2c070b70 2023-07-14T13:09:31.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.435+0000 7fdb31b9d640 1 -- 172.21.15.5:0/1790956739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb2c154210 con 0x7fdb2c070b70 2023-07-14T13:09:31.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.439+0000 7fdb31b9d640 1 -- 172.21.15.5:0/1790956739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb2c0715c0 con 0x7fdb2c070b70 2023-07-14T13:09:31.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.439+0000 7fdb13fff640 1 -- 172.21.15.5:0/1790956739 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 41) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fdb20013410 con 0x7fdb2c070b70 2023-07-14T13:09:31.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.439+0000 7fdb13fff640 1 --2- 172.21.15.5:0/1790956739 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fdb18066460 0x7fdb18068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.439+0000 7fdb13fff640 1 -- 172.21.15.5:0/1790956739 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fdb20083f70 con 0x7fdb2c070b70 2023-07-14T13:09:31.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.439+0000 7fdb2b7fe640 1 -- 172.21.15.5:0/1790956739 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fdb18066460 msgr2=0x7fdb18068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/714349479 2023-07-14T13:09:31.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.439+0000 7fdb2b7fe640 1 --2- 172.21.15.5:0/1790956739 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fdb18066460 0x7fdb18068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:09:31.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.443+0000 7fdb13fff640 1 -- 172.21.15.5:0/1790956739 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fdb20050fd0 con 0x7fdb2c070b70 2023-07-14T13:09:31.501 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:31.471+0000 7ff34ea76180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:09:31.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.603+0000 7fdb31b9d640 1 -- 172.21.15.5:0/1790956739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb2c0678d0 con 0x7fdb2c070b70 2023-07-14T13:09:31.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.603+0000 7fdb13fff640 1 -- 172.21.15.5:0/1790956739 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+18815 (secure 0 0 0) 0x7fdb20021090 con 0x7fdb2c070b70 2023-07-14T13:09:31.634 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:31.635 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":98,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:09:26.281007+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:09:06.567743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-14T13:09:07.824380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/1136667119":"2023-07-15T13:09:26.280972+0000","172.21.15.154:6833/3243469291":"2023-07-15T13:09:26.280972+0000","172.21.15.154:6832/3243469291":"2023-07-15T13:09:26.280972+0000","172.21.15.154:0/2054145215":"2023-07-15T13:09:26.280972+0000","172.21.15.154:0/3260672688":"2023-07-15T13:09:26.280972+0000","172.21.15.154:0/2925558673":"2023-07-15T13:09:26.280972+0000","172.21.15.154:0/3026075462":"2023-07-15T13:09:26.280972+0000","172.21.15.154:0/2368288551":"2023-07-15T13:09:26.280972+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:09:31.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.607+0000 7fdb31b9d640 1 -- 172.21.15.5:0/1790956739 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fdb18066460 msgr2=0x7fdb18068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:09:31.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.607+0000 7fdb31b9d640 1 --2- 172.21.15.5:0/1790956739 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fdb18066460 0x7fdb18068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.607+0000 7fdb31b9d640 1 -- 172.21.15.5:0/1790956739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb2c070b70 msgr2=0x7fdb2c0c3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:31.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.607+0000 7fdb31b9d640 1 --2- 172.21.15.5:0/1790956739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb2c070b70 0x7fdb2c0c3100 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fdb2000e810 tx=0x7fdb2000ecd0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.607+0000 7fdb31b9d640 1 -- 172.21.15.5:0/1790956739 shutdown_connections 2023-07-14T13:09:31.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.607+0000 7fdb31b9d640 1 --2- 172.21.15.5:0/1790956739 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7fdb18066460 0x7fdb18068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.607+0000 7fdb31b9d640 1 --2- 172.21.15.5:0/1790956739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdb2c0c21f0 0x7fdb2c1523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.607+0000 7fdb31b9d640 1 --2- 172.21.15.5:0/1790956739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb2c070b70 0x7fdb2c0c3100 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.607+0000 7fdb31b9d640 1 --2- 172.21.15.5:0/1790956739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb2c06b1e0 0x7fdb2c155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.607+0000 7fdb31b9d640 1 -- 172.21.15.5:0/1790956739 >> 172.21.15.5:0/1790956739 conn(0x7fdb2c0afcf0 msgr2=0x7fdb2c06b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:31.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.607+0000 7fdb31b9d640 1 -- 172.21.15.5:0/1790956739 shutdown_connections 2023-07-14T13:09:31.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.607+0000 7fdb31b9d640 1 -- 172.21.15.5:0/1790956739 wait complete. 2023-07-14T13:09:31.647 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:31.615+0000 7ff34ea76180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:09:31.657 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T13:09:06.567743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T13:09:07.824380+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:09:31.658 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:09:31.659 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:31.627+0000 7ff153389180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:09:31.731 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:31.699+0000 7ff34ea76180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:09:31.751 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:31.719+0000 7ff153389180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:09:31.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.779+0000 7f3365093640 1 Processor -- start 2023-07-14T13:09:31.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.779+0000 7f3365093640 1 -- start start 2023-07-14T13:09:31.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.779+0000 7f3365093640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f336015bde0 0x7f33600d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.779+0000 7f3365093640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33600d2fc0 0x7f33600b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.779+0000 7f3365093640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33600b04c0 con 0x7f33600d2300 2023-07-14T13:09:31.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.779+0000 7f3365093640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f336015c1b0 con 0x7f336015bde0 2023-07-14T13:09:31.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.779+0000 7f3365093640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33600d0aa0 con 0x7f33600d2fc0 2023-07-14T13:09:31.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.779+0000 7f335ed9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f336015bde0 0x7f33600d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.779+0000 7f335ed9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f336015bde0 0x7f33600d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33682/0 (socket says 172.21.15.5:33682) 2023-07-14T13:09:31.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.779+0000 7f335ed9d640 1 -- 172.21.15.5:0/1954211882 learned_addr learned my addr 172.21.15.5:0/1954211882 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:31.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.779+0000 7f335e59c640 1 --2- 172.21.15.5:0/1954211882 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33600d2fc0 0x7f33600b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.779+0000 7f335ed9d640 1 -- 172.21.15.5:0/1954211882 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33600d2fc0 msgr2=0x7f33600b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:31.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.779+0000 7f335ed9d640 1 --2- 172.21.15.5:0/1954211882 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33600d2fc0 0x7f33600b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.779+0000 7f335ed9d640 1 -- 172.21.15.5:0/1954211882 >> v1:172.21.15.154:6789/0 conn(0x7f33600d2300 legacy=0x7f33600cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:31.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.779+0000 7f335ed9d640 1 -- 172.21.15.5:0/1954211882 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33600afb90 con 0x7f336015bde0 2023-07-14T13:09:31.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.783+0000 7f335ed9d640 1 --2- 172.21.15.5:0/1954211882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f336015bde0 0x7f33600d0270 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f3350006fd0 tx=0x7f335001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb071a42b28130c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:31.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.783+0000 7f335dd9b640 1 -- 172.21.15.5:0/1954211882 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33500aa680 con 0x7f336015bde0 2023-07-14T13:09:31.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.783+0000 7f335dd9b640 1 -- 172.21.15.5:0/1954211882 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33500aa7e0 con 0x7f336015bde0 2023-07-14T13:09:31.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.783+0000 7f335dd9b640 1 -- 172.21.15.5:0/1954211882 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33500aab70 con 0x7f336015bde0 2023-07-14T13:09:31.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.783+0000 7f3365093640 1 -- 172.21.15.5:0/1954211882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f336015bde0 msgr2=0x7f33600d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:31.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.783+0000 7f3365093640 1 --2- 172.21.15.5:0/1954211882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f336015bde0 0x7f33600d0270 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f3350006fd0 tx=0x7f335001c520 comp rx=0 tx=0).stop 2023-07-14T13:09:31.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.783+0000 7f3365093640 1 -- 172.21.15.5:0/1954211882 shutdown_connections 2023-07-14T13:09:31.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.783+0000 7f3365093640 1 --2- 172.21.15.5:0/1954211882 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33600d2fc0 0x7f33600b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.783+0000 7f3365093640 1 --2- 172.21.15.5:0/1954211882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f336015bde0 0x7f33600d0270 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.783+0000 7f3365093640 1 -- 172.21.15.5:0/1954211882 >> 172.21.15.5:0/1954211882 conn(0x7f33600659d0 msgr2=0x7f336009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:31.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.783+0000 7f3365093640 1 -- 172.21.15.5:0/1954211882 shutdown_connections 2023-07-14T13:09:31.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.783+0000 7f3365093640 1 -- 172.21.15.5:0/1954211882 wait complete. 2023-07-14T13:09:31.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.787+0000 7f3365093640 1 Processor -- start 2023-07-14T13:09:31.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.787+0000 7f3365093640 1 -- start start 2023-07-14T13:09:31.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.787+0000 7f3365093640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33600d2300 0x7f33600ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.787+0000 7f3365093640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33600d2fc0 0x7f336015e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.787+0000 7f3365093640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f336015bde0 0x7f336015e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.787+0000 7f3365093640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336015d330 con 0x7f33600d2300 2023-07-14T13:09:31.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.787+0000 7f3365093640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336015c6b0 con 0x7f33600d2fc0 2023-07-14T13:09:31.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.787+0000 7f3365093640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336015c990 con 0x7f336015bde0 2023-07-14T13:09:31.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.787+0000 7f335ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33600d2300 0x7f33600ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.787+0000 7f335ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33600d2300 0x7f33600ca070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33686/0 (socket says 172.21.15.5:33686) 2023-07-14T13:09:31.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.787+0000 7f335ed9d640 1 -- 172.21.15.5:0/2533856829 learned_addr learned my addr 172.21.15.5:0/2533856829 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:31.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.787+0000 7f335f59e640 1 --2- 172.21.15.5:0/2533856829 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f336015bde0 0x7f336015e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.787+0000 7f335e59c640 1 --2- 172.21.15.5:0/2533856829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33600d2fc0 0x7f336015e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.787+0000 7f335ed9d640 1 -- 172.21.15.5:0/2533856829 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f336015bde0 msgr2=0x7f336015e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:31.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.787+0000 7f335ed9d640 1 --2- 172.21.15.5:0/2533856829 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f336015bde0 0x7f336015e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.787+0000 7f335ed9d640 1 -- 172.21.15.5:0/2533856829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33600d2fc0 msgr2=0x7f336015e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:31.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.787+0000 7f335ed9d640 1 --2- 172.21.15.5:0/2533856829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33600d2fc0 0x7f336015e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.787+0000 7f335ed9d640 1 -- 172.21.15.5:0/2533856829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3350009480 con 0x7f33600d2300 2023-07-14T13:09:31.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.787+0000 7f335ed9d640 1 --2- 172.21.15.5:0/2533856829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33600d2300 0x7f33600ca070 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f335001abd0 tx=0x7f33500192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:31.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.787+0000 7f33477fe640 1 -- 172.21.15.5:0/2533856829 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33500aab50 con 0x7f33600d2300 2023-07-14T13:09:31.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.787+0000 7f33477fe640 1 -- 172.21.15.5:0/2533856829 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33500aacb0 con 0x7f33600d2300 2023-07-14T13:09:31.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.787+0000 7f33477fe640 1 -- 172.21.15.5:0/2533856829 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3350003860 con 0x7f33600d2300 2023-07-14T13:09:31.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.787+0000 7f3365093640 1 -- 172.21.15.5:0/2533856829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f336015cc70 con 0x7f33600d2300 2023-07-14T13:09:31.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.787+0000 7f3365093640 1 -- 172.21.15.5:0/2533856829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f336015c2f0 con 0x7f33600d2300 2023-07-14T13:09:31.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.787+0000 7f3365093640 1 -- 172.21.15.5:0/2533856829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f336015d470 con 0x7f33600d2300 2023-07-14T13:09:31.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.791+0000 7f33477fe640 1 -- 172.21.15.5:0/2533856829 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 41) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f3350003bd0 con 0x7f33600d2300 2023-07-14T13:09:31.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.791+0000 7f33477fe640 1 --2- 172.21.15.5:0/2533856829 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f334c066430 0x7f334c0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.791+0000 7f33477fe640 1 -- 172.21.15.5:0/2533856829 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f335011ef90 con 0x7f33600d2300 2023-07-14T13:09:31.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.791+0000 7f335e59c640 1 -- 172.21.15.5:0/2533856829 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f334c066430 msgr2=0x7f334c0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/714349479 2023-07-14T13:09:31.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.791+0000 7f335e59c640 1 --2- 172.21.15.5:0/2533856829 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f334c066430 0x7f334c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:09:31.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.799+0000 7f33477fe640 1 -- 172.21.15.5:0/2533856829 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f336015d470 con 0x7f33600d2300 2023-07-14T13:09:31.914 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:31.883+0000 7ff153389180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:09:31.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.955+0000 7f3365093640 1 -- 172.21.15.5:0/2533856829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f336015d470 con 0x7f33600d2300 2023-07-14T13:09:31.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.955+0000 7f33477fe640 1 -- 172.21.15.5:0/2533856829 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7f336015d470 con 0x7f33600d2300 2023-07-14T13:09:31.987 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:09:31.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.959+0000 7f3365093640 1 -- 172.21.15.5:0/2533856829 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f334c066430 msgr2=0x7f334c0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:09:31.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.959+0000 7f3365093640 1 --2- 172.21.15.5:0/2533856829 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f334c066430 0x7f334c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.959+0000 7f3365093640 1 -- 172.21.15.5:0/2533856829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33600d2300 msgr2=0x7f33600ca070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:31.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.959+0000 7f3365093640 1 --2- 172.21.15.5:0/2533856829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33600d2300 0x7f33600ca070 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f335001abd0 tx=0x7f33500192c0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.959+0000 7f3365093640 1 -- 172.21.15.5:0/2533856829 shutdown_connections 2023-07-14T13:09:31.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.959+0000 7f3365093640 1 --2- 172.21.15.5:0/2533856829 >> [v2:172.21.15.154:6832/714349479,v1:172.21.15.154:6833/714349479] conn(0x7f334c066430 0x7f334c0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.959+0000 7f3365093640 1 --2- 172.21.15.5:0/2533856829 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f336015bde0 0x7f336015e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.959+0000 7f3365093640 1 --2- 172.21.15.5:0/2533856829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33600d2fc0 0x7f336015e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.959+0000 7f3365093640 1 --2- 172.21.15.5:0/2533856829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33600d2300 0x7f33600ca070 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.959+0000 7f3365093640 1 -- 172.21.15.5:0/2533856829 >> 172.21.15.5:0/2533856829 conn(0x7f33600659d0 msgr2=0x7f33601521c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:31.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.959+0000 7f3365093640 1 -- 172.21.15.5:0/2533856829 shutdown_connections 2023-07-14T13:09:31.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:31.959+0000 7f3365093640 1 -- 172.21.15.5:0/2533856829 wait complete. 2023-07-14T13:09:32.004 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:31.971+0000 7ff34ea76180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:09:32.004 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:31.975+0000 7ff153389180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:09:32.008 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:09:32.062 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:32.031+0000 7ff34ea76180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:09:32.144 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:32.111+0000 7ff2dabfd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:09:32.144 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:32.111+0000 7ff2dabfd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:09:32.144 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:32.111+0000 7ff2dabfd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:09:32.144 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:32.111+0000 7ff2dabfd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:09:32.145 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:32.111+0000 7ff2dabfd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:09:32.145 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:32.111+0000 7ff2d73f6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:09:32.145 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:32.111+0000 7ff2d73f6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:09:32.145 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:32.111+0000 7ff2d73f6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:09:32.145 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:32.111+0000 7ff2d73f6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:09:32.145 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:09:32.111+0000 7ff2d73f6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:09:32.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.139+0000 7f79df07b640 1 Processor -- start 2023-07-14T13:09:32.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.139+0000 7f79df07b640 1 -- start start 2023-07-14T13:09:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.139+0000 7f79df07b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f79d8160030 0x7f79d8166c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.139+0000 7f79df07b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d80aefc0 con 0x7f79d815be30 2023-07-14T13:09:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.139+0000 7f79df07b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d80af2a0 con 0x7f79d80b39f0 2023-07-14T13:09:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.139+0000 7f79df07b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d815c200 con 0x7f79d8160030 2023-07-14T13:09:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.139+0000 7f79dce17640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f79d815be30 0x7f79d80d0230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53280/0 (socket says 172.21.15.5:53280) 2023-07-14T13:09:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.139+0000 7f79dce17640 1 -- 172.21.15.5:0/2772695412 learned_addr learned my addr 172.21.15.5:0/2772695412 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.139+0000 7f79dd618640 1 --2- 172.21.15.5:0/2772695412 >> v2:172.21.15.5:3300/0 conn(0x7f79d8160030 0x7f79d8166c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.139+0000 7f79d77fe640 1 -- 172.21.15.5:0/2772695412 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1516532434 0 0) 0x7f79d80aefc0 con 0x7f79d815be30 2023-07-14T13:09:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.139+0000 7f79d77fe640 1 -- 172.21.15.5:0/2772695412 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79c8003530 con 0x7f79d815be30 2023-07-14T13:09:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.139+0000 7f79dd618640 1 -- 172.21.15.5:0/2772695412 >> v1:172.21.15.154:6789/0 conn(0x7f79d80b39f0 legacy=0x7f79d815f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.139+0000 7f79dd618640 1 -- 172.21.15.5:0/2772695412 >> v1:172.21.15.5:6789/0 conn(0x7f79d815be30 legacy=0x7f79d80d0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.139+0000 7f79dd618640 1 -- 172.21.15.5:0/2772695412 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d80d0940 con 0x7f79d8160030 2023-07-14T13:09:32.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.143+0000 7f79dd618640 1 --2- 172.21.15.5:0/2772695412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79d8160030 0x7f79d8166c50 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f79d0009d90 tx=0x7f79d001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e5a6a63aa945e1b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:32.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.143+0000 7f79d77fe640 1 -- 172.21.15.5:0/2772695412 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d00a59e0 con 0x7f79d8160030 2023-07-14T13:09:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.143+0000 7f79d77fe640 1 -- 172.21.15.5:0/2772695412 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d00a5b40 con 0x7f79d8160030 2023-07-14T13:09:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.143+0000 7f79d77fe640 1 -- 172.21.15.5:0/2772695412 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d00ad440 con 0x7f79d8160030 2023-07-14T13:09:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.143+0000 7f79df07b640 1 -- 172.21.15.5:0/2772695412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79d8160030 msgr2=0x7f79d8166c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:32.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.143+0000 7f79df07b640 1 --2- 172.21.15.5:0/2772695412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79d8160030 0x7f79d8166c50 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f79d0009d90 tx=0x7f79d001c920 comp rx=0 tx=0).stop 2023-07-14T13:09:32.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.143+0000 7f79df07b640 1 -- 172.21.15.5:0/2772695412 shutdown_connections 2023-07-14T13:09:32.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.143+0000 7f79df07b640 1 --2- 172.21.15.5:0/2772695412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79d8160030 0x7f79d8166c50 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.143+0000 7f79df07b640 1 -- 172.21.15.5:0/2772695412 >> 172.21.15.5:0/2772695412 conn(0x7f79d80659d0 msgr2=0x7f79d809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:32.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.143+0000 7f79df07b640 1 -- 172.21.15.5:0/2772695412 shutdown_connections 2023-07-14T13:09:32.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.143+0000 7f79df07b640 1 -- 172.21.15.5:0/2772695412 wait complete. 2023-07-14T13:09:32.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.147+0000 7f79df07b640 1 Processor -- start 2023-07-14T13:09:32.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.147+0000 7f79df07b640 1 -- start start 2023-07-14T13:09:32.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.147+0000 7f79df07b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79d80b39f0 0x7f79d815daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:32.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.147+0000 7f79df07b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79d815be30 0x7f79d809c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:32.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.147+0000 7f79df07b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79d8160030 0x7f79d814c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:32.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.147+0000 7f79df07b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d814cb70 con 0x7f79d80b39f0 2023-07-14T13:09:32.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.147+0000 7f79df07b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d80b5f60 con 0x7f79d815be30 2023-07-14T13:09:32.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.147+0000 7f79df07b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d814f590 con 0x7f79d8160030 2023-07-14T13:09:32.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.147+0000 7f79dce17640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79d80b39f0 0x7f79d815daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:32.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.147+0000 7f79dce17640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79d80b39f0 0x7f79d815daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33702/0 (socket says 172.21.15.5:33702) 2023-07-14T13:09:32.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.147+0000 7f79dce17640 1 -- 172.21.15.5:0/3386360910 learned_addr learned my addr 172.21.15.5:0/3386360910 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:32.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.147+0000 7f79d7fff640 1 --2- 172.21.15.5:0/3386360910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79d815be30 0x7f79d809c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.147+0000 7f79dd618640 1 --2- 172.21.15.5:0/3386360910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79d8160030 0x7f79d814c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.147+0000 7f79dce17640 1 -- 172.21.15.5:0/3386360910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79d8160030 msgr2=0x7f79d814c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.147+0000 7f79dce17640 1 --2- 172.21.15.5:0/3386360910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79d8160030 0x7f79d814c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.147+0000 7f79dce17640 1 -- 172.21.15.5:0/3386360910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79d815be30 msgr2=0x7f79d809c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.147+0000 7f79dce17640 1 --2- 172.21.15.5:0/3386360910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79d815be30 0x7f79d809c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.147+0000 7f79dce17640 1 -- 172.21.15.5:0/3386360910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d0009a70 con 0x7f79d80b39f0 2023-07-14T13:09:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.147+0000 7f79dce17640 1 --2- 172.21.15.5:0/3386360910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79d80b39f0 0x7f79d815daa0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00c4d0 tx=0x7f79cc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.147+0000 7f79d57fa640 1 -- 172.21.15.5:0/3386360910 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc005cf0 con 0x7f79d80b39f0 2023-07-14T13:09:32.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.147+0000 7f79d57fa640 1 -- 172.21.15.5:0/3386360910 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79cc005e50 con 0x7f79d80b39f0 2023-07-14T13:09:32.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.147+0000 7f79d57fa640 1 -- 172.21.15.5:0/3386360910 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc007270 con 0x7f79d80b39f0 2023-07-14T13:09:32.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.147+0000 7f79df07b640 1 -- 172.21.15.5:0/3386360910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d80b5350 con 0x7f79d80b39f0 2023-07-14T13:09:32.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.147+0000 7f79df07b640 1 -- 172.21.15.5:0/3386360910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d80b5910 con 0x7f79d80b39f0 2023-07-14T13:09:32.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.151+0000 7f79df07b640 1 -- 172.21.15.5:0/3386360910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d80678d0 con 0x7f79d80b39f0 2023-07-14T13:09:32.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.151+0000 7f79d57fa640 1 -- 172.21.15.5:0/3386360910 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 42) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f79cc0073d0 con 0x7f79d80b39f0 2023-07-14T13:09:32.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.151+0000 7f79d57fa640 1 -- 172.21.15.5:0/3386360910 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f79cc082fe0 con 0x7f79d80b39f0 2023-07-14T13:09:32.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.155+0000 7f79d57fa640 1 -- 172.21.15.5:0/3386360910 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f79cc050620 con 0x7f79d80b39f0 2023-07-14T13:09:32.312 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:32.279+0000 7ff153389180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:09:32.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.315+0000 7f79df07b640 1 -- 172.21.15.5:0/3386360910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f79d808c360 con 0x7f79d80b39f0 2023-07-14T13:09:32.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.315+0000 7f79d57fa640 1 -- 172.21.15.5:0/3386360910 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v99) v1 ==== 92+0+10 (secure 0 0 0) 0x7f79cc0170a0 con 0x7f79d80b39f0 2023-07-14T13:09:32.347 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:09:32.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.319+0000 7f79df07b640 1 -- 172.21.15.5:0/3386360910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79d80b39f0 msgr2=0x7f79d815daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:32.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.319+0000 7f79df07b640 1 --2- 172.21.15.5:0/3386360910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79d80b39f0 0x7f79d815daa0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00c4d0 tx=0x7f79cc00c990 comp rx=0 tx=0).stop 2023-07-14T13:09:32.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.319+0000 7f79df07b640 1 -- 172.21.15.5:0/3386360910 shutdown_connections 2023-07-14T13:09:32.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.319+0000 7f79df07b640 1 --2- 172.21.15.5:0/3386360910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79d8160030 0x7f79d814c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.319+0000 7f79df07b640 1 --2- 172.21.15.5:0/3386360910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79d815be30 0x7f79d809c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.319+0000 7f79df07b640 1 --2- 172.21.15.5:0/3386360910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79d80b39f0 0x7f79d815daa0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.319+0000 7f79df07b640 1 -- 172.21.15.5:0/3386360910 >> 172.21.15.5:0/3386360910 conn(0x7f79d80659d0 msgr2=0x7f79d80b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:32.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.319+0000 7f79df07b640 1 -- 172.21.15.5:0/3386360910 shutdown_connections 2023-07-14T13:09:32.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.319+0000 7f79df07b640 1 -- 172.21.15.5:0/3386360910 wait complete. 2023-07-14T13:09:32.369 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T13:09:32.379 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:09:32.347+0000 7ff153389180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:09:32.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.487+0000 7f84180e6640 1 Processor -- start 2023-07-14T13:09:32.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.491+0000 7f84180e6640 1 -- start start 2023-07-14T13:09:32.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.491+0000 7f84180e6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84100aeb40 0x7f841015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:32.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.491+0000 7f84180e6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f84100aef10 0x7f8410158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:32.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.491+0000 7f84180e6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8410159270 0x7f84100c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:32.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.491+0000 7f84180e6640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84101532b0 con 0x7f8410159270 2023-07-14T13:09:32.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.491+0000 7f84180e6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84100ca6f0 con 0x7f84100aef10 2023-07-14T13:09:32.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.491+0000 7f84180e6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84101599d0 con 0x7f84100aeb40 2023-07-14T13:09:32.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.491+0000 7f8416683640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8410159270 0x7f84100c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:32.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.491+0000 7f8416683640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8410159270 0x7f84100c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33708/0 (socket says 172.21.15.5:33708) 2023-07-14T13:09:32.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.491+0000 7f8416683640 1 -- 172.21.15.5:0/2503335537 learned_addr learned my addr 172.21.15.5:0/2503335537 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:32.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.491+0000 7f8415e82640 1 --2- 172.21.15.5:0/2503335537 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84100aeb40 0x7f841015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:32.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.491+0000 7f8415681640 1 --2- 172.21.15.5:0/2503335537 >> v2:172.21.15.154:3300/0 conn(0x7f84100aef10 0x7f8410158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:32.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.491+0000 7f8416683640 1 -- 172.21.15.5:0/2503335537 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84100aeb40 msgr2=0x7f841015cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:32.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.491+0000 7f8416683640 1 --2- 172.21.15.5:0/2503335537 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84100aeb40 0x7f841015cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.491+0000 7f8416683640 1 -- 172.21.15.5:0/2503335537 >> v2:172.21.15.154:3300/0 conn(0x7f84100aef10 msgr2=0x7f8410158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:32.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.491+0000 7f8416683640 1 --2- 172.21.15.5:0/2503335537 >> v2:172.21.15.154:3300/0 conn(0x7f84100aef10 0x7f8410158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.491+0000 7f8416683640 1 -- 172.21.15.5:0/2503335537 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8410159cb0 con 0x7f8410159270 2023-07-14T13:09:32.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.491+0000 7f8415681640 1 --2- 172.21.15.5:0/2503335537 >> v2:172.21.15.154:3300/0 conn(0x7f84100aef10 0x7f8410158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:32.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.495+0000 7f8416683640 1 --2- 172.21.15.5:0/2503335537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8410159270 0x7f84100c88c0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f841006ed50 tx=0x7f840801eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44cbebf83cb36ada server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:32.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.495+0000 7f8414e80640 1 -- 172.21.15.5:0/2503335537 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840800b2d0 con 0x7f8410159270 2023-07-14T13:09:32.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.495+0000 7f8414e80640 1 -- 172.21.15.5:0/2503335537 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840800b430 con 0x7f8410159270 2023-07-14T13:09:32.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.495+0000 7f8414e80640 1 -- 172.21.15.5:0/2503335537 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84080a7bc0 con 0x7f8410159270 2023-07-14T13:09:32.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.495+0000 7f84180e6640 1 -- 172.21.15.5:0/2503335537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8410159270 msgr2=0x7f84100c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:32.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.495+0000 7f84180e6640 1 --2- 172.21.15.5:0/2503335537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8410159270 0x7f84100c88c0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f841006ed50 tx=0x7f840801eb10 comp rx=0 tx=0).stop 2023-07-14T13:09:32.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.495+0000 7f84180e6640 1 -- 172.21.15.5:0/2503335537 shutdown_connections 2023-07-14T13:09:32.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.495+0000 7f84180e6640 1 --2- 172.21.15.5:0/2503335537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8410159270 0x7f84100c88c0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.495+0000 7f84180e6640 1 --2- 172.21.15.5:0/2503335537 >> v2:172.21.15.154:3300/0 conn(0x7f84100aef10 0x7f8410158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.495+0000 7f84180e6640 1 --2- 172.21.15.5:0/2503335537 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84100aeb40 0x7f841015cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.495+0000 7f84180e6640 1 -- 172.21.15.5:0/2503335537 >> 172.21.15.5:0/2503335537 conn(0x7f84100cde90 msgr2=0x7f84100ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:32.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.495+0000 7f84180e6640 1 -- 172.21.15.5:0/2503335537 shutdown_connections 2023-07-14T13:09:32.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.495+0000 7f84180e6640 1 -- 172.21.15.5:0/2503335537 wait complete. 2023-07-14T13:09:32.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.499+0000 7f84180e6640 1 Processor -- start 2023-07-14T13:09:32.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.499+0000 7f84180e6640 1 -- start start 2023-07-14T13:09:32.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.499+0000 7f84180e6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84100aeb40 0x7f8410158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:32.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.499+0000 7f84180e6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84100aef10 0x7f8410147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:32.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.499+0000 7f84180e6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8410159270 0x7f84100cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:32.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.499+0000 7f84180e6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8410157d40 con 0x7f84100aef10 2023-07-14T13:09:32.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.499+0000 7f84180e6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8410158850 con 0x7f8410159270 2023-07-14T13:09:32.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.499+0000 7f84180e6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8410148340 con 0x7f84100aeb40 2023-07-14T13:09:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.499+0000 7f8415681640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84100aef10 0x7f8410147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.499+0000 7f8415681640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84100aef10 0x7f8410147e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33716/0 (socket says 172.21.15.5:33716) 2023-07-14T13:09:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.499+0000 7f8415681640 1 -- 172.21.15.5:0/3191055226 learned_addr learned my addr 172.21.15.5:0/3191055226 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.499+0000 7f8415e82640 1 --2- 172.21.15.5:0/3191055226 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84100aeb40 0x7f8410158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.499+0000 7f8416683640 1 --2- 172.21.15.5:0/3191055226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8410159270 0x7f84100cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.499+0000 7f8415681640 1 -- 172.21.15.5:0/3191055226 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84100aeb40 msgr2=0x7f8410158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.499+0000 7f8415681640 1 --2- 172.21.15.5:0/3191055226 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84100aeb40 0x7f8410158310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.499+0000 7f8415681640 1 -- 172.21.15.5:0/3191055226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8410159270 msgr2=0x7f84100cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:32.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.499+0000 7f8415681640 1 --2- 172.21.15.5:0/3191055226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8410159270 0x7f84100cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.499+0000 7f8415681640 1 -- 172.21.15.5:0/3191055226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840800bd40 con 0x7f84100aef10 2023-07-14T13:09:32.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.499+0000 7f8415e82640 1 --2- 172.21.15.5:0/3191055226 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84100aeb40 0x7f8410158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:09:32.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.499+0000 7f8416683640 1 --2- 172.21.15.5:0/3191055226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8410159270 0x7f84100cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:09:32.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.499+0000 7f8415681640 1 --2- 172.21.15.5:0/3191055226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84100aef10 0x7f8410147e00 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f840000e810 tx=0x7f840000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:32.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.499+0000 7f84067fc640 1 -- 172.21.15.5:0/3191055226 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840000c8d0 con 0x7f84100aef10 2023-07-14T13:09:32.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.499+0000 7f84067fc640 1 -- 172.21.15.5:0/3191055226 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840000ca30 con 0x7f84100aef10 2023-07-14T13:09:32.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.499+0000 7f84067fc640 1 -- 172.21.15.5:0/3191055226 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840000cde0 con 0x7f84100aef10 2023-07-14T13:09:32.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.499+0000 7f84180e6640 1 -- 172.21.15.5:0/3191055226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8410157130 con 0x7f84100aef10 2023-07-14T13:09:32.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.499+0000 7f84180e6640 1 -- 172.21.15.5:0/3191055226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84101576f0 con 0x7f84100aef10 2023-07-14T13:09:32.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.499+0000 7f84180e6640 1 -- 172.21.15.5:0/3191055226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84100678d0 con 0x7f84100aef10 2023-07-14T13:09:32.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.503+0000 7f84067fc640 1 -- 172.21.15.5:0/3191055226 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 42) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f8400013410 con 0x7f84100aef10 2023-07-14T13:09:32.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.503+0000 7f84067fc640 1 -- 172.21.15.5:0/3191055226 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f8400083970 con 0x7f84100aef10 2023-07-14T13:09:32.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.507+0000 7f84067fc640 1 -- 172.21.15.5:0/3191055226 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f8400050e70 con 0x7f84100aef10 2023-07-14T13:09:32.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.659+0000 7f84180e6640 1 -- 172.21.15.5:0/3191055226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f84100c8b70 con 0x7f84100aef10 2023-07-14T13:09:32.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.659+0000 7f84067fc640 1 -- 172.21.15.5:0/3191055226 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v99) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8400054490 con 0x7f84100aef10 2023-07-14T13:09:32.691 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T13:09:32.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.663+0000 7f84180e6640 1 -- 172.21.15.5:0/3191055226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84100aef10 msgr2=0x7f8410147e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:32.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.663+0000 7f84180e6640 1 --2- 172.21.15.5:0/3191055226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84100aef10 0x7f8410147e00 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f840000e810 tx=0x7f840000ecd0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.663+0000 7f84180e6640 1 -- 172.21.15.5:0/3191055226 shutdown_connections 2023-07-14T13:09:32.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.663+0000 7f84180e6640 1 --2- 172.21.15.5:0/3191055226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8410159270 0x7f84100cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.663+0000 7f84180e6640 1 --2- 172.21.15.5:0/3191055226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84100aef10 0x7f8410147e00 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.663+0000 7f84180e6640 1 --2- 172.21.15.5:0/3191055226 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84100aeb40 0x7f8410158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.663+0000 7f84180e6640 1 -- 172.21.15.5:0/3191055226 >> 172.21.15.5:0/3191055226 conn(0x7f84100cde90 msgr2=0x7f84100c3990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:32.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.663+0000 7f84180e6640 1 -- 172.21.15.5:0/3191055226 shutdown_connections 2023-07-14T13:09:32.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.663+0000 7f84180e6640 1 -- 172.21.15.5:0/3191055226 wait complete. 2023-07-14T13:09:32.712 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T13:09:32.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.871+0000 7f4aaf493640 1 Processor -- start 2023-07-14T13:09:32.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.871+0000 7f4aaf493640 1 -- start start 2023-07-14T13:09:32.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.871+0000 7f4aaf493640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4aa806a440 0x7f4aa80b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:32.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.871+0000 7f4aaf493640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa806c040 con 0x7f4aa81453a0 2023-07-14T13:09:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.871+0000 7f4aaf493640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa8160600 con 0x7f4aa815f690 2023-07-14T13:09:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.871+0000 7f4aaf493640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa8160170 con 0x7f4aa806a440 2023-07-14T13:09:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.871+0000 7f4aada30640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4aa81453a0 0x7f4aa806c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53288/0 (socket says 172.21.15.5:53288) 2023-07-14T13:09:32.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.871+0000 7f4aada30640 1 -- 172.21.15.5:0/3979240061 learned_addr learned my addr 172.21.15.5:0/3979240061 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.871+0000 7f4aaca2e640 1 --2- 172.21.15.5:0/3979240061 >> v2:172.21.15.154:3300/0 conn(0x7f4aa806a440 0x7f4aa80b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.875+0000 7f4a9ffff640 1 -- 172.21.15.5:0/3979240061 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987347908 0 0) 0x7f4aa806c040 con 0x7f4aa81453a0 2023-07-14T13:09:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.875+0000 7f4a9ffff640 1 -- 172.21.15.5:0/3979240061 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a94003530 con 0x7f4aa81453a0 2023-07-14T13:09:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.875+0000 7f4aaca2e640 1 -- 172.21.15.5:0/3979240061 >> v1:172.21.15.154:6789/0 conn(0x7f4aa815f690 legacy=0x7f4aa815fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.875+0000 7f4aaca2e640 1 -- 172.21.15.5:0/3979240061 >> v1:172.21.15.5:6789/0 conn(0x7f4aa81453a0 legacy=0x7f4aa806c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:32.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.875+0000 7f4a9ffff640 1 -- 172.21.15.5:0/3979240061 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 886339874 0 0) 0x7f4a94003530 con 0x7f4aa81453a0 2023-07-14T13:09:32.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.875+0000 7f4aaca2e640 1 -- 172.21.15.5:0/3979240061 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa8160360 con 0x7f4aa806a440 2023-07-14T13:09:32.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.875+0000 7f4aaca2e640 1 --2- 172.21.15.5:0/3979240061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aa806a440 0x7f4aa80b1890 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4a980097c0 tx=0x7f4a9801c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee82a58d4c7f0a31 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:32.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.875+0000 7f4a9ffff640 1 -- 172.21.15.5:0/3979240061 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0001a00 con 0x7f4aa806a440 2023-07-14T13:09:32.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.875+0000 7f4a9ffff640 1 -- 172.21.15.5:0/3979240061 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a980a7050 con 0x7f4aa806a440 2023-07-14T13:09:32.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.875+0000 7f4a9ffff640 1 -- 172.21.15.5:0/3979240061 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a980ab620 con 0x7f4aa806a440 2023-07-14T13:09:32.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aaf493640 1 -- 172.21.15.5:0/3979240061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aa806a440 msgr2=0x7f4aa80b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:32.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aaf493640 1 --2- 172.21.15.5:0/3979240061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aa806a440 0x7f4aa80b1890 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4a980097c0 tx=0x7f4a9801c2e0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aaf493640 1 -- 172.21.15.5:0/3979240061 shutdown_connections 2023-07-14T13:09:32.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aaf493640 1 --2- 172.21.15.5:0/3979240061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aa806a440 0x7f4aa80b1890 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aaf493640 1 -- 172.21.15.5:0/3979240061 >> 172.21.15.5:0/3979240061 conn(0x7f4aa80b1210 msgr2=0x7f4aa80ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:32.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aaf493640 1 -- 172.21.15.5:0/3979240061 shutdown_connections 2023-07-14T13:09:32.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aaf493640 1 -- 172.21.15.5:0/3979240061 wait complete. 2023-07-14T13:09:32.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aaf493640 1 Processor -- start 2023-07-14T13:09:32.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aaf493640 1 -- start start 2023-07-14T13:09:32.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aaf493640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4aa806a440 0x7f4aa815c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:32.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aaf493640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aa81453a0 0x7f4aa815b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:32.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aaf493640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4aa815f690 0x7f4aa8143580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:32.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aaf493640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa815ba40 con 0x7f4aa806a440 2023-07-14T13:09:32.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aaf493640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa815e080 con 0x7f4aa81453a0 2023-07-14T13:09:32.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aaf493640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa815e360 con 0x7f4aa815f690 2023-07-14T13:09:32.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aad22f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4aa806a440 0x7f4aa815c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:32.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aad22f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4aa806a440 0x7f4aa815c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33720/0 (socket says 172.21.15.5:33720) 2023-07-14T13:09:32.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aad22f640 1 -- 172.21.15.5:0/2397606885 learned_addr learned my addr 172.21.15.5:0/2397606885 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:32.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aada30640 1 --2- 172.21.15.5:0/2397606885 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4aa815f690 0x7f4aa8143580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:32.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aaca2e640 1 --2- 172.21.15.5:0/2397606885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aa81453a0 0x7f4aa815b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:32.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aad22f640 1 -- 172.21.15.5:0/2397606885 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4aa815f690 msgr2=0x7f4aa8143580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:32.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aad22f640 1 --2- 172.21.15.5:0/2397606885 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4aa815f690 0x7f4aa8143580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aad22f640 1 -- 172.21.15.5:0/2397606885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aa81453a0 msgr2=0x7f4aa815b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:32.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aad22f640 1 --2- 172.21.15.5:0/2397606885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aa81453a0 0x7f4aa815b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aad22f640 1 -- 172.21.15.5:0/2397606885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a98009420 con 0x7f4aa806a440 2023-07-14T13:09:32.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aaca2e640 1 --2- 172.21.15.5:0/2397606885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aa81453a0 0x7f4aa815b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:32.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aada30640 1 --2- 172.21.15.5:0/2397606885 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4aa815f690 0x7f4aa8143580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:32.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.879+0000 7f4aad22f640 1 --2- 172.21.15.5:0/2397606885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4aa806a440 0x7f4aa815c0e0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f4aa400c500 tx=0x7f4aa400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:32.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.883+0000 7f4a9dffb640 1 -- 172.21.15.5:0/2397606885 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4005220 con 0x7f4aa806a440 2023-07-14T13:09:32.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.883+0000 7f4a9dffb640 1 -- 172.21.15.5:0/2397606885 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa4005380 con 0x7f4aa806a440 2023-07-14T13:09:32.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.883+0000 7f4a9dffb640 1 -- 172.21.15.5:0/2397606885 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4007270 con 0x7f4aa806a440 2023-07-14T13:09:32.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.883+0000 7f4aaf493640 1 -- 172.21.15.5:0/2397606885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa815e640 con 0x7f4aa806a440 2023-07-14T13:09:32.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.883+0000 7f4aaf493640 1 -- 172.21.15.5:0/2397606885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa8141d00 con 0x7f4aa806a440 2023-07-14T13:09:32.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.883+0000 7f4aaf493640 1 -- 172.21.15.5:0/2397606885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa8141b60 con 0x7f4aa806a440 2023-07-14T13:09:32.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.883+0000 7f4a9dffb640 1 -- 172.21.15.5:0/2397606885 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 42) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f4aa40073d0 con 0x7f4aa806a440 2023-07-14T13:09:32.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.883+0000 7f4a9dffb640 1 -- 172.21.15.5:0/2397606885 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f4aa4083560 con 0x7f4aa806a440 2023-07-14T13:09:32.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:32.887+0000 7f4a9dffb640 1 -- 172.21.15.5:0/2397606885 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4aa8141b60 con 0x7f4aa806a440 2023-07-14T13:09:33.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.043+0000 7f4aaf493640 1 -- 172.21.15.5:0/2397606885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4aa8141b60 con 0x7f4aa806a440 2023-07-14T13:09:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.047+0000 7f4a9dffb640 1 -- 172.21.15.5:0/2397606885 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 43) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f4aa4050490 con 0x7f4aa806a440 2023-07-14T13:09:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.047+0000 7f4a9dffb640 1 --2- 172.21.15.5:0/2397606885 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f4a8c06c090 0x7f4a8c06e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:33.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.047+0000 7f4aaca2e640 1 --2- 172.21.15.5:0/2397606885 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f4a8c06c090 0x7f4a8c06e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:33.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.047+0000 7f4a9dffb640 1 -- 172.21.15.5:0/2397606885 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v99) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4aa4070f80 con 0x7f4aa806a440 2023-07-14T13:09:33.080 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T13:09:33.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.051+0000 7f4aaf493640 1 -- 172.21.15.5:0/2397606885 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f4a8c06c090 msgr2=0x7f4a8c06e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:33.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.051+0000 7f4aaf493640 1 --2- 172.21.15.5:0/2397606885 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f4a8c06c090 0x7f4a8c06e470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7f4a980ad000 tx=0x7f4a98008040 comp rx=0 tx=0).stop 2023-07-14T13:09:33.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.051+0000 7f4aaf493640 1 -- 172.21.15.5:0/2397606885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4aa806a440 msgr2=0x7f4aa815c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:33.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.051+0000 7f4aaf493640 1 --2- 172.21.15.5:0/2397606885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4aa806a440 0x7f4aa815c0e0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f4aa400c500 tx=0x7f4aa400c9c0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.051+0000 7f4aaf493640 1 -- 172.21.15.5:0/2397606885 shutdown_connections 2023-07-14T13:09:33.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.051+0000 7f4aaf493640 1 --2- 172.21.15.5:0/2397606885 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f4a8c06c090 0x7f4a8c06e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.051+0000 7f4aaf493640 1 --2- 172.21.15.5:0/2397606885 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4aa815f690 0x7f4aa8143580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.051+0000 7f4aaf493640 1 --2- 172.21.15.5:0/2397606885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aa81453a0 0x7f4aa815b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.051+0000 7f4aaf493640 1 --2- 172.21.15.5:0/2397606885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4aa806a440 0x7f4aa815c0e0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.051+0000 7f4aaf493640 1 -- 172.21.15.5:0/2397606885 >> 172.21.15.5:0/2397606885 conn(0x7f4aa80b1210 msgr2=0x7f4aa813c750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:33.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.051+0000 7f4aaf493640 1 -- 172.21.15.5:0/2397606885 shutdown_connections 2023-07-14T13:09:33.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.051+0000 7f4aaf493640 1 -- 172.21.15.5:0/2397606885 wait complete. 2023-07-14T13:09:33.102 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:09:33.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.215+0000 7f5abf782640 1 Processor -- start 2023-07-14T13:09:33.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.215+0000 7f5abf782640 1 -- start start 2023-07-14T13:09:33.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.215+0000 7f5abf782640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ab80c9730 0x7f5ab81638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:33.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.215+0000 7f5abf782640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab80cc700 con 0x7f5ab80c8ad0 2023-07-14T13:09:33.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.215+0000 7f5abf782640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab80b0ff0 con 0x7f5ab8158ce0 2023-07-14T13:09:33.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.215+0000 7f5abf782640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab8070c80 con 0x7f5ab80c9730 2023-07-14T13:09:33.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.215+0000 7f5abdd1f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ab80c9730 0x7f5ab81638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:33.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.215+0000 7f5abdd1f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ab80c9730 0x7f5ab81638b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33732/0 (socket says 172.21.15.5:33732) 2023-07-14T13:09:33.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.215+0000 7f5abdd1f640 1 -- 172.21.15.5:0/2604684994 learned_addr learned my addr 172.21.15.5:0/2604684994 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:33.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.215+0000 7f5abdd1f640 1 -- 172.21.15.5:0/2604684994 >> v1:172.21.15.154:6789/0 conn(0x7f5ab8158ce0 legacy=0x7f5ab8070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:33.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.215+0000 7f5abdd1f640 1 -- 172.21.15.5:0/2604684994 >> v1:172.21.15.5:6789/0 conn(0x7f5ab80c8ad0 legacy=0x7f5ab80c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:33.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.219+0000 7f5abdd1f640 1 -- 172.21.15.5:0/2604684994 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab80cbdd0 con 0x7f5ab80c9730 2023-07-14T13:09:33.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.219+0000 7f5aaffff640 1 -- 172.21.15.5:0/2604684994 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4053795629 0 0) 0x7f5ab80cc700 con 0x7f5ab80c8ad0 2023-07-14T13:09:33.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.219+0000 7f5abdd1f640 1 --2- 172.21.15.5:0/2604684994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab80c9730 0x7f5ab81638b0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009e50 tx=0x7f5ab001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9510c2052a2308e4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:33.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.219+0000 7f5aaffff640 1 -- 172.21.15.5:0/2604684994 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab00a57a0 con 0x7f5ab80c9730 2023-07-14T13:09:33.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.219+0000 7f5aaffff640 1 -- 172.21.15.5:0/2604684994 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab00a5900 con 0x7f5ab80c9730 2023-07-14T13:09:33.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.219+0000 7f5aaffff640 1 -- 172.21.15.5:0/2604684994 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab00a5c90 con 0x7f5ab80c9730 2023-07-14T13:09:33.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.219+0000 7f5abf782640 1 -- 172.21.15.5:0/2604684994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab80c9730 msgr2=0x7f5ab81638b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:33.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.219+0000 7f5abf782640 1 --2- 172.21.15.5:0/2604684994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab80c9730 0x7f5ab81638b0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009e50 tx=0x7f5ab001c8c0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.219+0000 7f5abf782640 1 -- 172.21.15.5:0/2604684994 shutdown_connections 2023-07-14T13:09:33.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.219+0000 7f5abf782640 1 --2- 172.21.15.5:0/2604684994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab80c9730 0x7f5ab81638b0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.219+0000 7f5abf782640 1 -- 172.21.15.5:0/2604684994 >> 172.21.15.5:0/2604684994 conn(0x7f5ab80afcf0 msgr2=0x7f5ab80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:33.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.219+0000 7f5abf782640 1 -- 172.21.15.5:0/2604684994 shutdown_connections 2023-07-14T13:09:33.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.219+0000 7f5abf782640 1 -- 172.21.15.5:0/2604684994 wait complete. 2023-07-14T13:09:33.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.223+0000 7f5abf782640 1 Processor -- start 2023-07-14T13:09:33.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.223+0000 7f5abf782640 1 -- start start 2023-07-14T13:09:33.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.223+0000 7f5abf782640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ab80c8ad0 0x7f5ab814c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:33.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.223+0000 7f5abf782640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ab80c9730 0x7f5ab80b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:33.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.223+0000 7f5abf782640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab8158ce0 0x7f5ab80ce080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:33.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.223+0000 7f5abf782640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab80b2f40 con 0x7f5ab8158ce0 2023-07-14T13:09:33.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.223+0000 7f5abf782640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab814cdc0 con 0x7f5ab80c8ad0 2023-07-14T13:09:33.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.223+0000 7f5abf782640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab8150290 con 0x7f5ab80c9730 2023-07-14T13:09:33.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.223+0000 7f5abdd1f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab8158ce0 0x7f5ab80ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:33.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.223+0000 7f5abdd1f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab8158ce0 0x7f5ab80ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33746/0 (socket says 172.21.15.5:33746) 2023-07-14T13:09:33.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.223+0000 7f5abdd1f640 1 -- 172.21.15.5:0/39198095 learned_addr learned my addr 172.21.15.5:0/39198095 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:33.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.223+0000 7f5abd51e640 1 --2- 172.21.15.5:0/39198095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ab80c8ad0 0x7f5ab814c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:33.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.223+0000 7f5abcd1d640 1 --2- 172.21.15.5:0/39198095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ab80c9730 0x7f5ab80b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:33.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.223+0000 7f5abdd1f640 1 -- 172.21.15.5:0/39198095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ab80c9730 msgr2=0x7f5ab80b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:33.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.223+0000 7f5abdd1f640 1 --2- 172.21.15.5:0/39198095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ab80c9730 0x7f5ab80b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.223+0000 7f5abdd1f640 1 -- 172.21.15.5:0/39198095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ab80c8ad0 msgr2=0x7f5ab814c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.223+0000 7f5abdd1f640 1 --2- 172.21.15.5:0/39198095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ab80c8ad0 0x7f5ab814c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.223+0000 7f5abdd1f640 1 -- 172.21.15.5:0/39198095 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab0009b30 con 0x7f5ab8158ce0 2023-07-14T13:09:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.223+0000 7f5abdd1f640 1 --2- 172.21.15.5:0/39198095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab8158ce0 0x7f5ab80ce080 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f5ab00af040 tx=0x7f5ab0019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.227+0000 7f5aadffb640 1 -- 172.21.15.5:0/39198095 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab00b8470 con 0x7f5ab8158ce0 2023-07-14T13:09:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.227+0000 7f5aadffb640 1 -- 172.21.15.5:0/39198095 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab00b85d0 con 0x7f5ab8158ce0 2023-07-14T13:09:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.227+0000 7f5abf782640 1 -- 172.21.15.5:0/39198095 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab8150570 con 0x7f5ab8158ce0 2023-07-14T13:09:33.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.227+0000 7f5aadffb640 1 -- 172.21.15.5:0/39198095 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab00b8940 con 0x7f5ab8158ce0 2023-07-14T13:09:33.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.227+0000 7f5abf782640 1 -- 172.21.15.5:0/39198095 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab8150b30 con 0x7f5ab8158ce0 2023-07-14T13:09:33.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.227+0000 7f5abf782640 1 -- 172.21.15.5:0/39198095 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab80ca1a0 con 0x7f5ab8158ce0 2023-07-14T13:09:33.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.227+0000 7f5aadffb640 1 -- 172.21.15.5:0/39198095 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 43) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f5ab00b8aa0 con 0x7f5ab8158ce0 2023-07-14T13:09:33.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.227+0000 7f5aadffb640 1 --2- 172.21.15.5:0/39198095 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f5a9c0660d0 0x7f5a9c068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:33.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.227+0000 7f5aadffb640 1 -- 172.21.15.5:0/39198095 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f5ab011f040 con 0x7f5ab8158ce0 2023-07-14T13:09:33.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.231+0000 7f5abd51e640 1 --2- 172.21.15.5:0/39198095 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f5a9c0660d0 0x7f5a9c068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:33.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.231+0000 7f5abd51e640 1 --2- 172.21.15.5:0/39198095 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f5a9c0660d0 0x7f5a9c068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4007fd0 tx=0x7f5ab4009040 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:33.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.231+0000 7f5aadffb640 1 -- 172.21.15.5:0/39198095 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f5ab00ec500 con 0x7f5ab8158ce0 2023-07-14T13:09:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.423+0000 7f5abf782640 1 -- 172.21.15.5:0/39198095 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ab81503d0 con 0x7f5ab8158ce0 2023-07-14T13:09:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.423+0000 7f5aadffb640 1 -- 172.21.15.5:0/39198095 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4702 (secure 0 0 0) 0x7f5ab81503d0 con 0x7f5ab8158ce0 2023-07-14T13:09:33.454 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:33.454 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6901,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/747965975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":747965975},{"type":"v1","addr":"172.21.15.5:6835","nonce":747965975}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6907,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1902785181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1902785181},{"type":"v1","addr":"172.21.15.154:6835","nonce":1902785181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6916,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/90532135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":90532135},{"type":"v1","addr":"172.21.15.154:6837","nonce":90532135}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:09:08.828642+0000","modified":"2023-07-14T13:09:12.468790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7104},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7104":{"gid":7104,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6834/2611471565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2611471565},{"type":"v1","addr":"172.21.15.5:6834","nonce":2611471565}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-14T13:09:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 41 2023-07-14T13:09:33.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.423+0000 7f5abf782640 1 -- 172.21.15.5:0/39198095 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f5a9c0660d0 msgr2=0x7f5a9c068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:33.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.423+0000 7f5abf782640 1 --2- 172.21.15.5:0/39198095 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f5a9c0660d0 0x7f5a9c068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4007fd0 tx=0x7f5ab4009040 comp rx=0 tx=0).stop 2023-07-14T13:09:33.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.423+0000 7f5abf782640 1 -- 172.21.15.5:0/39198095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab8158ce0 msgr2=0x7f5ab80ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:33.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.423+0000 7f5abf782640 1 --2- 172.21.15.5:0/39198095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab8158ce0 0x7f5ab80ce080 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f5ab00af040 tx=0x7f5ab0019660 comp rx=0 tx=0).stop 2023-07-14T13:09:33.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.423+0000 7f5abf782640 1 -- 172.21.15.5:0/39198095 shutdown_connections 2023-07-14T13:09:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.423+0000 7f5abf782640 1 --2- 172.21.15.5:0/39198095 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f5a9c0660d0 0x7f5a9c068580 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.423+0000 7f5abf782640 1 --2- 172.21.15.5:0/39198095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ab8158ce0 0x7f5ab80ce080 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.423+0000 7f5abf782640 1 --2- 172.21.15.5:0/39198095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ab80c9730 0x7f5ab80b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.423+0000 7f5abf782640 1 --2- 172.21.15.5:0/39198095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ab80c8ad0 0x7f5ab814c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.423+0000 7f5abf782640 1 -- 172.21.15.5:0/39198095 >> 172.21.15.5:0/39198095 conn(0x7f5ab80afcf0 msgr2=0x7f5ab80ad6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.427+0000 7f5abf782640 1 -- 172.21.15.5:0/39198095 shutdown_connections 2023-07-14T13:09:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.427+0000 7f5abf782640 1 -- 172.21.15.5:0/39198095 wait complete. 2023-07-14T13:09:33.476 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:09:33.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e6a848640 1 Processor -- start 2023-07-14T13:09:33.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e6a848640 1 -- start start 2023-07-14T13:09:33.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e6a848640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7e640d06b0 0x7f7e640b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:33.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e6a848640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e640b2410 con 0x7f7e640b1f70 2023-07-14T13:09:33.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e6a848640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e640b26f0 con 0x7f7e64145430 2023-07-14T13:09:33.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e6a848640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e640b29d0 con 0x7f7e640d06b0 2023-07-14T13:09:33.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e68de5640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7e640b1f70 0x7f7e640d22e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53312/0 (socket says 172.21.15.5:53312) 2023-07-14T13:09:33.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e68de5640 1 -- 172.21.15.5:0/418681360 learned_addr learned my addr 172.21.15.5:0/418681360 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:33.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e63fff640 1 --2- 172.21.15.5:0/418681360 >> v2:172.21.15.154:3300/0 conn(0x7f7e640d06b0 0x7f7e640b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e62ffd640 1 -- 172.21.15.5:0/418681360 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525865415 0 0) 0x7f7e640b2410 con 0x7f7e640b1f70 2023-07-14T13:09:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e62ffd640 1 -- 172.21.15.5:0/418681360 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e4c003530 con 0x7f7e640b1f70 2023-07-14T13:09:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e62ffd640 1 -- 172.21.15.5:0/418681360 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2832687352 0 0) 0x7f7e640b26f0 con 0x7f7e64145430 2023-07-14T13:09:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e62ffd640 1 -- 172.21.15.5:0/418681360 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e640b2410 con 0x7f7e64145430 2023-07-14T13:09:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e62ffd640 1 -- 172.21.15.5:0/418681360 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2984107689 0 0) 0x7f7e4c003530 con 0x7f7e640b1f70 2023-07-14T13:09:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e62ffd640 1 -- 172.21.15.5:0/418681360 >> v2:172.21.15.154:3300/0 conn(0x7f7e640d06b0 msgr2=0x7f7e640b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e62ffd640 1 --2- 172.21.15.5:0/418681360 >> v2:172.21.15.154:3300/0 conn(0x7f7e640d06b0 0x7f7e640b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e62ffd640 1 -- 172.21.15.5:0/418681360 >> v1:172.21.15.154:6789/0 conn(0x7f7e64145430 legacy=0x7f7e640b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e62ffd640 1 -- 172.21.15.5:0/418681360 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e640b2cb0 con 0x7f7e640b1f70 2023-07-14T13:09:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e62ffd640 1 -- 172.21.15.5:0/418681360 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f7e5c001a00 con 0x7f7e640b1f70 2023-07-14T13:09:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e62ffd640 1 -- 172.21.15.5:0/418681360 >> v1:172.21.15.5:6789/0 conn(0x7f7e640b1f70 legacy=0x7f7e640d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e62ffd640 1 --2- 172.21.15.5:0/418681360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e4c003b60 0x7f7e4c003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e62ffd640 1 --2- 172.21.15.5:0/418681360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e4c0047d0 0x7f7e4c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e62ffd640 1 --2- 172.21.15.5:0/418681360 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e4c005180 0x7f7e4c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:33.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e62ffd640 1 -- 172.21.15.5:0/418681360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e640b29d0 con 0x7f7e4c003b60 2023-07-14T13:09:33.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e62ffd640 1 -- 172.21.15.5:0/418681360 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c00c060 con 0x7f7e4c0047d0 2023-07-14T13:09:33.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e62ffd640 1 -- 172.21.15.5:0/418681360 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c00c1f0 con 0x7f7e4c005180 2023-07-14T13:09:33.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e63fff640 1 --2- 172.21.15.5:0/418681360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e4c003b60 0x7f7e4c003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:33.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e637fe640 1 --2- 172.21.15.5:0/418681360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e4c0047d0 0x7f7e4c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:33.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e68de5640 1 --2- 172.21.15.5:0/418681360 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e4c005180 0x7f7e4c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.591+0000 7f7e63fff640 1 -- 172.21.15.5:0/418681360 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e4c005180 msgr2=0x7f7e4c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.595+0000 7f7e63fff640 1 --2- 172.21.15.5:0/418681360 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e4c005180 0x7f7e4c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.595+0000 7f7e63fff640 1 -- 172.21.15.5:0/418681360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e4c0047d0 msgr2=0x7f7e4c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.595+0000 7f7e63fff640 1 --2- 172.21.15.5:0/418681360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e4c0047d0 0x7f7e4c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.595+0000 7f7e63fff640 1 -- 172.21.15.5:0/418681360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4c003530 con 0x7f7e4c003b60 2023-07-14T13:09:33.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.595+0000 7f7e637fe640 1 --2- 172.21.15.5:0/418681360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e4c0047d0 0x7f7e4c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:33.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.595+0000 7f7e68de5640 1 -- 172.21.15.5:0/418681360 reap_dead start 2023-07-14T13:09:33.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.595+0000 7f7e63fff640 1 --2- 172.21.15.5:0/418681360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e4c003b60 0x7f7e4c003f50 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f7e54009ab0 tx=0x7f7e5401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24f06017aee4b9e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:33.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.595+0000 7f7e62ffd640 1 -- 172.21.15.5:0/418681360 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e540a64d0 con 0x7f7e4c003b60 2023-07-14T13:09:33.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.595+0000 7f7e62ffd640 1 -- 172.21.15.5:0/418681360 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e540a6630 con 0x7f7e4c003b60 2023-07-14T13:09:33.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.595+0000 7f7e62ffd640 1 -- 172.21.15.5:0/418681360 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e540a69e0 con 0x7f7e4c003b60 2023-07-14T13:09:33.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.595+0000 7f7e6a848640 1 -- 172.21.15.5:0/418681360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e4c003b60 msgr2=0x7f7e4c003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:33.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.595+0000 7f7e6a848640 1 --2- 172.21.15.5:0/418681360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e4c003b60 0x7f7e4c003f50 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f7e54009ab0 tx=0x7f7e5401c9e0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.595+0000 7f7e6a848640 1 -- 172.21.15.5:0/418681360 shutdown_connections 2023-07-14T13:09:33.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.595+0000 7f7e6a848640 1 --2- 172.21.15.5:0/418681360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e4c003b60 0x7f7e4c003f50 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.595+0000 7f7e6a848640 1 -- 172.21.15.5:0/418681360 >> 172.21.15.5:0/418681360 conn(0x7f7e640659d0 msgr2=0x7f7e6409b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:33.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.595+0000 7f7e6a848640 1 -- 172.21.15.5:0/418681360 shutdown_connections 2023-07-14T13:09:33.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.595+0000 7f7e6a848640 1 -- 172.21.15.5:0/418681360 wait complete. 2023-07-14T13:09:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.599+0000 7f7e6a848640 1 Processor -- start 2023-07-14T13:09:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.599+0000 7f7e6a848640 1 -- start start 2023-07-14T13:09:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.599+0000 7f7e6a848640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e4c003b60 0x7f7e640cf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.599+0000 7f7e6a848640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e640b7b80 0x7f7e6414bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.599+0000 7f7e6a848640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e6414c450 0x7f7e6414c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.599+0000 7f7e6a848640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e640cc150 con 0x7f7e6414c450 2023-07-14T13:09:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.599+0000 7f7e6a848640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e640b7ff0 con 0x7f7e4c003b60 2023-07-14T13:09:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.599+0000 7f7e6a848640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e640cf720 con 0x7f7e640b7b80 2023-07-14T13:09:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.599+0000 7f7e68de5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e6414c450 0x7f7e6414c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.599+0000 7f7e68de5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e6414c450 0x7f7e6414c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33774/0 (socket says 172.21.15.5:33774) 2023-07-14T13:09:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.599+0000 7f7e68de5640 1 -- 172.21.15.5:0/2500206507 learned_addr learned my addr 172.21.15.5:0/2500206507 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.599+0000 7f7e63fff640 1 --2- 172.21.15.5:0/2500206507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e4c003b60 0x7f7e640cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:33.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.599+0000 7f7e637fe640 1 --2- 172.21.15.5:0/2500206507 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e640b7b80 0x7f7e6414bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.599+0000 7f7e68de5640 1 -- 172.21.15.5:0/2500206507 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e640b7b80 msgr2=0x7f7e6414bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.599+0000 7f7e68de5640 1 --2- 172.21.15.5:0/2500206507 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e640b7b80 0x7f7e6414bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.599+0000 7f7e68de5640 1 -- 172.21.15.5:0/2500206507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e4c003b60 msgr2=0x7f7e640cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.599+0000 7f7e68de5640 1 --2- 172.21.15.5:0/2500206507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e4c003b60 0x7f7e640cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.599+0000 7f7e68de5640 1 -- 172.21.15.5:0/2500206507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e640cb7b0 con 0x7f7e6414c450 2023-07-14T13:09:33.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.599+0000 7f7e68de5640 1 --2- 172.21.15.5:0/2500206507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e6414c450 0x7f7e6414c8c0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f7e6408cb00 tx=0x7f7e5c0077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:33.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.599+0000 7f7e60ff9640 1 -- 172.21.15.5:0/2500206507 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c0114f0 con 0x7f7e6414c450 2023-07-14T13:09:33.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.599+0000 7f7e60ff9640 1 -- 172.21.15.5:0/2500206507 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c011650 con 0x7f7e6414c450 2023-07-14T13:09:33.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.599+0000 7f7e60ff9640 1 -- 172.21.15.5:0/2500206507 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c011a00 con 0x7f7e6414c450 2023-07-14T13:09:33.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.599+0000 7f7e6a848640 1 -- 172.21.15.5:0/2500206507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e640cba90 con 0x7f7e6414c450 2023-07-14T13:09:33.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.603+0000 7f7e6a848640 1 -- 172.21.15.5:0/2500206507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e640cc570 con 0x7f7e6414c450 2023-07-14T13:09:33.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.603+0000 7f7e6a848640 1 -- 172.21.15.5:0/2500206507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e640cc7f0 con 0x7f7e6414c450 2023-07-14T13:09:33.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.603+0000 7f7e60ff9640 1 -- 172.21.15.5:0/2500206507 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 43) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f7e5c011b60 con 0x7f7e6414c450 2023-07-14T13:09:33.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.603+0000 7f7e60ff9640 1 --2- 172.21.15.5:0/2500206507 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f7e500660d0 0x7f7e50068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:33.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.603+0000 7f7e60ff9640 1 -- 172.21.15.5:0/2500206507 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f7e5c083530 con 0x7f7e6414c450 2023-07-14T13:09:33.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.603+0000 7f7e63fff640 1 --2- 172.21.15.5:0/2500206507 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f7e500660d0 0x7f7e50068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:33.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.607+0000 7f7e63fff640 1 --2- 172.21.15.5:0/2500206507 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f7e500660d0 0x7f7e50068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7e540af000 tx=0x7f7e540046d0 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:33.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.607+0000 7f7e60ff9640 1 -- 172.21.15.5:0/2500206507 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7e5c0509f0 con 0x7f7e6414c450 2023-07-14T13:09:33.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.763+0000 7f7e6a848640 1 -- 172.21.15.5:0/2500206507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e640cc290 con 0x7f7e6414c450 2023-07-14T13:09:33.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.767+0000 7f7e60ff9640 1 -- 172.21.15.5:0/2500206507 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+19384 (secure 0 0 0) 0x7f7e640cc290 con 0x7f7e6414c450 2023-07-14T13:09:33.798 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:33.798 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":99,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:09:32.036436+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:09:06.567743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-14T13:09:07.824380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6833/714349479":"2023-07-15T13:09:32.036383+0000","172.21.15.154:0/2614825630":"2023-07-15T13:09:32.036383+0000","172.21.15.154:0/2071347872":"2023-07-15T13:09:32.036383+0000","172.21.15.154:0/2619796887":"2023-07-15T13:09:32.036383+0000","172.21.15.154:0/2739506244":"2023-07-15T13:09:32.036383+0000","172.21.15.154:0/2527354231":"2023-07-15T13:09:32.036383+0000","172.21.15.154:0/407312695":"2023-07-15T13:09:32.036383+0000","172.21.15.154:0/1136667119":"2023-07-15T13:09:26.280972+0000","172.21.15.154:6833/3243469291":"2023-07-15T13:09:26.280972+0000","172.21.15.154:6832/3243469291":"2023-07-15T13:09:26.280972+0000","172.21.15.154:0/2054145215":"2023-07-15T13:09:26.280972+0000","172.21.15.154:0/634367575":"2023-07-15T13:09:32.036383+0000","172.21.15.154:0/3260672688":"2023-07-15T13:09:26.280972+0000","172.21.15.154:0/2925558673":"2023-07-15T13:09:26.280972+0000","172.21.15.154:0/3026075462":"2023-07-15T13:09:26.280972+0000","172.21.15.154:6832/714349479":"2023-07-15T13:09:32.036383+0000","172.21.15.154:0/2368288551":"2023-07-15T13:09:26.280972+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:09:33.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.767+0000 7f7e6a848640 1 -- 172.21.15.5:0/2500206507 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f7e500660d0 msgr2=0x7f7e50068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:33.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.767+0000 7f7e6a848640 1 --2- 172.21.15.5:0/2500206507 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f7e500660d0 0x7f7e50068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7e540af000 tx=0x7f7e540046d0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.767+0000 7f7e6a848640 1 -- 172.21.15.5:0/2500206507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e6414c450 msgr2=0x7f7e6414c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:33.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.767+0000 7f7e6a848640 1 --2- 172.21.15.5:0/2500206507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e6414c450 0x7f7e6414c8c0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f7e6408cb00 tx=0x7f7e5c0077f0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.767+0000 7f7e6a848640 1 -- 172.21.15.5:0/2500206507 shutdown_connections 2023-07-14T13:09:33.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.767+0000 7f7e6a848640 1 --2- 172.21.15.5:0/2500206507 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f7e500660d0 0x7f7e50068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.767+0000 7f7e6a848640 1 --2- 172.21.15.5:0/2500206507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e6414c450 0x7f7e6414c8c0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.767+0000 7f7e6a848640 1 --2- 172.21.15.5:0/2500206507 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e640b7b80 0x7f7e6414bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.767+0000 7f7e6a848640 1 --2- 172.21.15.5:0/2500206507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e4c003b60 0x7f7e640cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.767+0000 7f7e6a848640 1 -- 172.21.15.5:0/2500206507 >> 172.21.15.5:0/2500206507 conn(0x7f7e640659d0 msgr2=0x7f7e6415fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:33.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.767+0000 7f7e6a848640 1 -- 172.21.15.5:0/2500206507 shutdown_connections 2023-07-14T13:09:33.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.767+0000 7f7e6a848640 1 -- 172.21.15.5:0/2500206507 wait complete. 2023-07-14T13:09:33.819 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-14T13:09:33.820 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:09:33.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.935+0000 7f811ab20640 1 Processor -- start 2023-07-14T13:09:33.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.935+0000 7f811ab20640 1 -- start start 2023-07-14T13:09:33.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.935+0000 7f811ab20640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f811415b9a0 0x7f811406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:33.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.935+0000 7f811ab20640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f811406bee0 0x7f81140b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:33.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.935+0000 7f811ab20640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f811406c330 con 0x7f81140b20b0 2023-07-14T13:09:33.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.935+0000 7f811ab20640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81140b28a0 con 0x7f811406bee0 2023-07-14T13:09:33.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.935+0000 7f811ab20640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81141604a0 con 0x7f811415b9a0 2023-07-14T13:09:33.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.935+0000 7f811931d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f811406bee0 0x7f81140b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:33.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.935+0000 7f811931d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f811406bee0 0x7f81140b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33784/0 (socket says 172.21.15.5:33784) 2023-07-14T13:09:33.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.935+0000 7f811931d640 1 -- 172.21.15.5:0/1610501145 learned_addr learned my addr 172.21.15.5:0/1610501145 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:33.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.935+0000 7f8119b1e640 1 --2- 172.21.15.5:0/1610501145 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f811415b9a0 0x7f811406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:33.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.935+0000 7f811931d640 1 -- 172.21.15.5:0/1610501145 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f811415b9a0 msgr2=0x7f811406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:33.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.935+0000 7f811931d640 1 --2- 172.21.15.5:0/1610501145 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f811415b9a0 0x7f811406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.935+0000 7f811931d640 1 -- 172.21.15.5:0/1610501145 >> v1:172.21.15.154:6789/0 conn(0x7f81140b20b0 legacy=0x7f81140cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:33.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.935+0000 7f811931d640 1 -- 172.21.15.5:0/1610501145 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811406b550 con 0x7f811406bee0 2023-07-14T13:09:33.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.935+0000 7f8119b1e640 1 --2- 172.21.15.5:0/1610501145 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f811415b9a0 0x7f811406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:09:33.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.939+0000 7f811931d640 1 --2- 172.21.15.5:0/1610501145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f811406bee0 0x7f81140b1b70 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f8104009870 tx=0x7f810401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9e4979f15d77e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:33.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.939+0000 7f8118b1c640 1 -- 172.21.15.5:0/1610501145 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81040ab600 con 0x7f811406bee0 2023-07-14T13:09:33.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.939+0000 7f8118b1c640 1 -- 172.21.15.5:0/1610501145 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81040ab760 con 0x7f811406bee0 2023-07-14T13:09:33.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.939+0000 7f8118b1c640 1 -- 172.21.15.5:0/1610501145 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81040abaf0 con 0x7f811406bee0 2023-07-14T13:09:33.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.939+0000 7f811ab20640 1 -- 172.21.15.5:0/1610501145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f811406bee0 msgr2=0x7f81140b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:33.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.939+0000 7f811ab20640 1 --2- 172.21.15.5:0/1610501145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f811406bee0 0x7f81140b1b70 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f8104009870 tx=0x7f810401c440 comp rx=0 tx=0).stop 2023-07-14T13:09:33.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.939+0000 7f811ab20640 1 -- 172.21.15.5:0/1610501145 shutdown_connections 2023-07-14T13:09:33.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.939+0000 7f811ab20640 1 --2- 172.21.15.5:0/1610501145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f811406bee0 0x7f81140b1b70 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.939+0000 7f811ab20640 1 --2- 172.21.15.5:0/1610501145 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f811415b9a0 0x7f811406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.939+0000 7f811ab20640 1 -- 172.21.15.5:0/1610501145 >> 172.21.15.5:0/1610501145 conn(0x7f81140cffa0 msgr2=0x7f81140d03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:33.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.939+0000 7f811ab20640 1 -- 172.21.15.5:0/1610501145 shutdown_connections 2023-07-14T13:09:33.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.939+0000 7f811ab20640 1 -- 172.21.15.5:0/1610501145 wait complete. 2023-07-14T13:09:33.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.939+0000 7f811ab20640 1 Processor -- start 2023-07-14T13:09:33.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.939+0000 7f811ab20640 1 -- start start 2023-07-14T13:09:33.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.943+0000 7f811ab20640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f811406bee0 0x7f811414e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:33.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.943+0000 7f811ab20640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81140b20b0 0x7f811414e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:33.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.943+0000 7f811ab20640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f811415b9a0 0x7f81141565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:33.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.943+0000 7f811ab20640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811414e690 con 0x7f811415b9a0 2023-07-14T13:09:33.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.943+0000 7f811ab20640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81141553d0 con 0x7f811406bee0 2023-07-14T13:09:33.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.943+0000 7f811ab20640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81141571a0 con 0x7f81140b20b0 2023-07-14T13:09:33.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.943+0000 7f811a31f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f811415b9a0 0x7f81141565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:33.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.943+0000 7f811a31f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f811415b9a0 0x7f81141565e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33792/0 (socket says 172.21.15.5:33792) 2023-07-14T13:09:33.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.943+0000 7f811a31f640 1 -- 172.21.15.5:0/492020930 learned_addr learned my addr 172.21.15.5:0/492020930 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:33.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.943+0000 7f811931d640 1 --2- 172.21.15.5:0/492020930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81140b20b0 0x7f811414e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:33.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.943+0000 7f8119b1e640 1 --2- 172.21.15.5:0/492020930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f811406bee0 0x7f811414e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:33.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.943+0000 7f811a31f640 1 -- 172.21.15.5:0/492020930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81140b20b0 msgr2=0x7f811414e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:33.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.943+0000 7f811a31f640 1 --2- 172.21.15.5:0/492020930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81140b20b0 0x7f811414e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.943+0000 7f811a31f640 1 -- 172.21.15.5:0/492020930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f811406bee0 msgr2=0x7f811414e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:33.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.943+0000 7f811a31f640 1 --2- 172.21.15.5:0/492020930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f811406bee0 0x7f811414e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:33.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.943+0000 7f811a31f640 1 -- 172.21.15.5:0/492020930 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81040094d0 con 0x7f811415b9a0 2023-07-14T13:09:33.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.943+0000 7f811a31f640 1 --2- 172.21.15.5:0/492020930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f811415b9a0 0x7f81141565e0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f810c00c780 tx=0x7f810c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:33.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.943+0000 7f810a7fc640 1 -- 172.21.15.5:0/492020930 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c004b70 con 0x7f811415b9a0 2023-07-14T13:09:33.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.943+0000 7f810a7fc640 1 -- 172.21.15.5:0/492020930 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810c00ce90 con 0x7f811415b9a0 2023-07-14T13:09:33.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.943+0000 7f811ab20640 1 -- 172.21.15.5:0/492020930 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8114157480 con 0x7f811415b9a0 2023-07-14T13:09:33.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.943+0000 7f810a7fc640 1 -- 172.21.15.5:0/492020930 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c00a850 con 0x7f811415b9a0 2023-07-14T13:09:33.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.943+0000 7f811ab20640 1 -- 172.21.15.5:0/492020930 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811414ff10 con 0x7f811415b9a0 2023-07-14T13:09:33.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.943+0000 7f811ab20640 1 -- 172.21.15.5:0/492020930 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8114155540 con 0x7f811415b9a0 2023-07-14T13:09:33.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.947+0000 7f810a7fc640 1 -- 172.21.15.5:0/492020930 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 43) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f810c00a9b0 con 0x7f811415b9a0 2023-07-14T13:09:33.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.947+0000 7f810a7fc640 1 --2- 172.21.15.5:0/492020930 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f80f80660d0 0x7f80f8068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:33.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.947+0000 7f810a7fc640 1 -- 172.21.15.5:0/492020930 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f810c083d10 con 0x7f811415b9a0 2023-07-14T13:09:33.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.947+0000 7f8119b1e640 1 --2- 172.21.15.5:0/492020930 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f80f80660d0 0x7f80f8068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:33.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.947+0000 7f8119b1e640 1 --2- 172.21.15.5:0/492020930 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f80f80660d0 0x7f80f8068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f81140b5270 tx=0x7f8110008040 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:33.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:33.951+0000 7f810a7fc640 1 -- 172.21.15.5:0/492020930 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f810c089020 con 0x7f811415b9a0 2023-07-14T13:09:34.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.143+0000 7f811ab20640 1 -- 172.21.15.5:0/492020930 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81140678d0 con 0x7f811415b9a0 2023-07-14T13:09:34.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.143+0000 7f810a7fc640 1 -- 172.21.15.5:0/492020930 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4702 (secure 0 0 0) 0x7f810c054c60 con 0x7f811415b9a0 2023-07-14T13:09:34.174 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:34.174 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6901,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/747965975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":747965975},{"type":"v1","addr":"172.21.15.5:6835","nonce":747965975}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6907,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1902785181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1902785181},{"type":"v1","addr":"172.21.15.154:6835","nonce":1902785181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6916,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/90532135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":90532135},{"type":"v1","addr":"172.21.15.154:6837","nonce":90532135}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:09:08.828642+0000","modified":"2023-07-14T13:09:12.468790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7104},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7104":{"gid":7104,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6834/2611471565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2611471565},{"type":"v1","addr":"172.21.15.5:6834","nonce":2611471565}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-14T13:09:34.175 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 41 2023-07-14T13:09:34.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.143+0000 7f811ab20640 1 -- 172.21.15.5:0/492020930 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f80f80660d0 msgr2=0x7f80f8068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:34.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.143+0000 7f811ab20640 1 --2- 172.21.15.5:0/492020930 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f80f80660d0 0x7f80f8068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f81140b5270 tx=0x7f8110008040 comp rx=0 tx=0).stop 2023-07-14T13:09:34.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.143+0000 7f811ab20640 1 -- 172.21.15.5:0/492020930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f811415b9a0 msgr2=0x7f81141565e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:34.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.143+0000 7f811ab20640 1 --2- 172.21.15.5:0/492020930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f811415b9a0 0x7f81141565e0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f810c00c780 tx=0x7f810c00cc40 comp rx=0 tx=0).stop 2023-07-14T13:09:34.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.143+0000 7f811ab20640 1 -- 172.21.15.5:0/492020930 shutdown_connections 2023-07-14T13:09:34.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.143+0000 7f811ab20640 1 --2- 172.21.15.5:0/492020930 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f80f80660d0 0x7f80f8068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:34.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.143+0000 7f811ab20640 1 --2- 172.21.15.5:0/492020930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f811415b9a0 0x7f81141565e0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:34.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.143+0000 7f811ab20640 1 --2- 172.21.15.5:0/492020930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81140b20b0 0x7f811414e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:34.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.143+0000 7f811ab20640 1 --2- 172.21.15.5:0/492020930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f811406bee0 0x7f811414e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:34.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.143+0000 7f811ab20640 1 -- 172.21.15.5:0/492020930 >> 172.21.15.5:0/492020930 conn(0x7f81140cffa0 msgr2=0x7f8114158790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:34.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.143+0000 7f811ab20640 1 -- 172.21.15.5:0/492020930 shutdown_connections 2023-07-14T13:09:34.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.143+0000 7f811ab20640 1 -- 172.21.15.5:0/492020930 wait complete. 2023-07-14T13:09:34.195 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:09:34.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.307+0000 7fbf4eccb640 1 Processor -- start 2023-07-14T13:09:34.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.307+0000 7fbf4eccb640 1 -- start start 2023-07-14T13:09:34.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf4eccb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbf48160330 0x7fbf480cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:34.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf4eccb640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf480c17d0 con 0x7fbf480c0f80 2023-07-14T13:09:34.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf4eccb640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf480c14f0 con 0x7fbf480c8940 2023-07-14T13:09:34.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf4eccb640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf480cdd70 con 0x7fbf48160330 2023-07-14T13:09:34.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf4d268640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbf480c0f80 0x7fbf480cd660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53316/0 (socket says 172.21.15.5:53316) 2023-07-14T13:09:34.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf4d268640 1 -- 172.21.15.5:0/2753662697 learned_addr learned my addr 172.21.15.5:0/2753662697 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:34.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf477fe640 1 -- 172.21.15.5:0/2753662697 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4030863057 0 0) 0x7fbf480c17d0 con 0x7fbf480c0f80 2023-07-14T13:09:34.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf477fe640 1 -- 172.21.15.5:0/2753662697 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf38003530 con 0x7fbf480c0f80 2023-07-14T13:09:34.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf4ca67640 1 --2- 172.21.15.5:0/2753662697 >> v2:172.21.15.154:3300/0 conn(0x7fbf48160330 0x7fbf480cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:34.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf477fe640 1 -- 172.21.15.5:0/2753662697 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2182040543 0 0) 0x7fbf38003530 con 0x7fbf480c0f80 2023-07-14T13:09:34.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf477fe640 1 -- 172.21.15.5:0/2753662697 >> v2:172.21.15.154:3300/0 conn(0x7fbf48160330 msgr2=0x7fbf480cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:34.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf477fe640 1 --2- 172.21.15.5:0/2753662697 >> v2:172.21.15.154:3300/0 conn(0x7fbf48160330 0x7fbf480cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:34.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf477fe640 1 -- 172.21.15.5:0/2753662697 >> v1:172.21.15.154:6789/0 conn(0x7fbf480c8940 legacy=0x7fbf480ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:34.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf477fe640 1 -- 172.21.15.5:0/2753662697 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf480cac10 con 0x7fbf480c0f80 2023-07-14T13:09:34.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf477fe640 1 -- 172.21.15.5:0/2753662697 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7fbf40001a00 con 0x7fbf480c0f80 2023-07-14T13:09:34.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf477fe640 1 -- 172.21.15.5:0/2753662697 >> v1:172.21.15.5:6789/0 conn(0x7fbf480c0f80 legacy=0x7fbf480cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:34.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf477fe640 1 --2- 172.21.15.5:0/2753662697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf38003980 0x7fbf38003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:34.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf477fe640 1 --2- 172.21.15.5:0/2753662697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf380047d0 0x7fbf38004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:34.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf477fe640 1 --2- 172.21.15.5:0/2753662697 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf38005180 0x7fbf3800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:34.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf477fe640 1 -- 172.21.15.5:0/2753662697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf480cdd70 con 0x7fbf38003980 2023-07-14T13:09:34.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf477fe640 1 -- 172.21.15.5:0/2753662697 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3800c0f0 con 0x7fbf380047d0 2023-07-14T13:09:34.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf477fe640 1 -- 172.21.15.5:0/2753662697 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3800c2b0 con 0x7fbf38005180 2023-07-14T13:09:34.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf4ca67640 1 --2- 172.21.15.5:0/2753662697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf38003980 0x7fbf38003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:34.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf47fff640 1 --2- 172.21.15.5:0/2753662697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf380047d0 0x7fbf38004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:34.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf4d268640 1 --2- 172.21.15.5:0/2753662697 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf38005180 0x7fbf3800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:34.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf4ca67640 1 -- 172.21.15.5:0/2753662697 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf38005180 msgr2=0x7fbf3800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:34.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf4ca67640 1 --2- 172.21.15.5:0/2753662697 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf38005180 0x7fbf3800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:34.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf4ca67640 1 -- 172.21.15.5:0/2753662697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf380047d0 msgr2=0x7fbf38004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:34.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf4ca67640 1 --2- 172.21.15.5:0/2753662697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf380047d0 0x7fbf38004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:34.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf4ca67640 1 -- 172.21.15.5:0/2753662697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf38003530 con 0x7fbf38003980 2023-07-14T13:09:34.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf47fff640 1 --2- 172.21.15.5:0/2753662697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf380047d0 0x7fbf38004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:34.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.311+0000 7fbf4d268640 1 -- 172.21.15.5:0/2753662697 reap_dead start 2023-07-14T13:09:34.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.315+0000 7fbf4ca67640 1 --2- 172.21.15.5:0/2753662697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf38003980 0x7fbf38003d90 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00ba30 tx=0x7fbf3c01c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab9bd52c595a3d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:34.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.315+0000 7fbf477fe640 1 -- 172.21.15.5:0/2753662697 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c0ac620 con 0x7fbf38003980 2023-07-14T13:09:34.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.315+0000 7fbf477fe640 1 -- 172.21.15.5:0/2753662697 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3c0a6040 con 0x7fbf38003980 2023-07-14T13:09:34.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.315+0000 7fbf477fe640 1 -- 172.21.15.5:0/2753662697 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c0ac9c0 con 0x7fbf38003980 2023-07-14T13:09:34.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.315+0000 7fbf4eccb640 1 -- 172.21.15.5:0/2753662697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf38003980 msgr2=0x7fbf38003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:34.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.315+0000 7fbf4eccb640 1 --2- 172.21.15.5:0/2753662697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf38003980 0x7fbf38003d90 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00ba30 tx=0x7fbf3c01c680 comp rx=0 tx=0).stop 2023-07-14T13:09:34.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.315+0000 7fbf4eccb640 1 -- 172.21.15.5:0/2753662697 shutdown_connections 2023-07-14T13:09:34.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.315+0000 7fbf4eccb640 1 --2- 172.21.15.5:0/2753662697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf38003980 0x7fbf38003d90 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:34.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.315+0000 7fbf4eccb640 1 -- 172.21.15.5:0/2753662697 >> 172.21.15.5:0/2753662697 conn(0x7fbf480afcf0 msgr2=0x7fbf480b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:34.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.315+0000 7fbf4eccb640 1 -- 172.21.15.5:0/2753662697 shutdown_connections 2023-07-14T13:09:34.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.315+0000 7fbf4eccb640 1 -- 172.21.15.5:0/2753662697 wait complete. 2023-07-14T13:09:34.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.315+0000 7fbf4eccb640 1 Processor -- start 2023-07-14T13:09:34.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.319+0000 7fbf4eccb640 1 -- start start 2023-07-14T13:09:34.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.319+0000 7fbf4eccb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf38003980 0x7fbf480c1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:34.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.319+0000 7fbf4eccb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf481577f0 0x7fbf48156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:34.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.319+0000 7fbf4eccb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf480b2d00 0x7fbf480b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:34.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.319+0000 7fbf4eccb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf480b36e0 con 0x7fbf481577f0 2023-07-14T13:09:34.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.319+0000 7fbf4eccb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf480c3610 con 0x7fbf480b2d00 2023-07-14T13:09:34.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.319+0000 7fbf4eccb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf480c2570 con 0x7fbf38003980 2023-07-14T13:09:34.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.319+0000 7fbf47fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf481577f0 0x7fbf48156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:34.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.319+0000 7fbf47fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf481577f0 0x7fbf48156ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33814/0 (socket says 172.21.15.5:33814) 2023-07-14T13:09:34.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.319+0000 7fbf47fff640 1 -- 172.21.15.5:0/2300965628 learned_addr learned my addr 172.21.15.5:0/2300965628 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:34.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.319+0000 7fbf4d268640 1 --2- 172.21.15.5:0/2300965628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf480b2d00 0x7fbf480b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:34.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.319+0000 7fbf4ca67640 1 --2- 172.21.15.5:0/2300965628 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf38003980 0x7fbf480c1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:34.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.319+0000 7fbf47fff640 1 -- 172.21.15.5:0/2300965628 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf38003980 msgr2=0x7fbf480c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:34.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.319+0000 7fbf47fff640 1 --2- 172.21.15.5:0/2300965628 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf38003980 0x7fbf480c1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:34.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.319+0000 7fbf47fff640 1 -- 172.21.15.5:0/2300965628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf480b2d00 msgr2=0x7fbf480b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:34.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.319+0000 7fbf47fff640 1 --2- 172.21.15.5:0/2300965628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf480b2d00 0x7fbf480b31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:34.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.319+0000 7fbf47fff640 1 -- 172.21.15.5:0/2300965628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf480c2850 con 0x7fbf481577f0 2023-07-14T13:09:34.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.319+0000 7fbf4ca67640 1 --2- 172.21.15.5:0/2300965628 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf38003980 0x7fbf480c1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:34.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.319+0000 7fbf47fff640 1 --2- 172.21.15.5:0/2300965628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf481577f0 0x7fbf48156ee0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fbf3400e550 tx=0x7fbf3400ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:34.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.319+0000 7fbf457fa640 1 -- 172.21.15.5:0/2300965628 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf340052e0 con 0x7fbf481577f0 2023-07-14T13:09:34.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.319+0000 7fbf457fa640 1 -- 172.21.15.5:0/2300965628 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf34005440 con 0x7fbf481577f0 2023-07-14T13:09:34.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.319+0000 7fbf457fa640 1 -- 172.21.15.5:0/2300965628 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf34003840 con 0x7fbf481577f0 2023-07-14T13:09:34.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.319+0000 7fbf4eccb640 1 -- 172.21.15.5:0/2300965628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf480c2b30 con 0x7fbf481577f0 2023-07-14T13:09:34.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.319+0000 7fbf4eccb640 1 -- 172.21.15.5:0/2300965628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf480c30f0 con 0x7fbf481577f0 2023-07-14T13:09:34.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.319+0000 7fbf4eccb640 1 -- 172.21.15.5:0/2300965628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf480c32b0 con 0x7fbf481577f0 2023-07-14T13:09:34.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.323+0000 7fbf457fa640 1 -- 172.21.15.5:0/2300965628 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 43) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fbf340039a0 con 0x7fbf481577f0 2023-07-14T13:09:34.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.323+0000 7fbf457fa640 1 --2- 172.21.15.5:0/2300965628 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fbf2c066100 0x7fbf2c0685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:34.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.323+0000 7fbf457fa640 1 -- 172.21.15.5:0/2300965628 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fbf340835d0 con 0x7fbf481577f0 2023-07-14T13:09:34.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.323+0000 7fbf4ca67640 1 --2- 172.21.15.5:0/2300965628 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fbf2c066100 0x7fbf2c0685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:34.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.327+0000 7fbf457fa640 1 -- 172.21.15.5:0/2300965628 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbf34050db0 con 0x7fbf481577f0 2023-07-14T13:09:34.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.327+0000 7fbf4ca67640 1 --2- 172.21.15.5:0/2300965628 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fbf2c066100 0x7fbf2c0685b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0b0000 tx=0x7fbf3c0b7040 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:34.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.331+0000 7fbf457fa640 1 -- 172.21.15.5:0/2300965628 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fbf3406dae0 con 0x7fbf481577f0 2023-07-14T13:09:34.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.519+0000 7fbf4eccb640 1 -- 172.21.15.5:0/2300965628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf480678d0 con 0x7fbf481577f0 2023-07-14T13:09:34.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.519+0000 7fbf457fa640 1 -- 172.21.15.5:0/2300965628 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4702 (secure 0 0 0) 0x7fbf340541e0 con 0x7fbf481577f0 2023-07-14T13:09:34.550 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:34.551 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6901,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/747965975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":747965975},{"type":"v1","addr":"172.21.15.5:6835","nonce":747965975}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6907,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1902785181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1902785181},{"type":"v1","addr":"172.21.15.154:6835","nonce":1902785181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6916,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/90532135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":90532135},{"type":"v1","addr":"172.21.15.154:6837","nonce":90532135}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:09:08.828642+0000","modified":"2023-07-14T13:09:12.468790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7104},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7104":{"gid":7104,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6834/2611471565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2611471565},{"type":"v1","addr":"172.21.15.5:6834","nonce":2611471565}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-14T13:09:34.551 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 41 2023-07-14T13:09:34.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.519+0000 7fbf4eccb640 1 -- 172.21.15.5:0/2300965628 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fbf2c066100 msgr2=0x7fbf2c0685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:34.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.519+0000 7fbf4eccb640 1 --2- 172.21.15.5:0/2300965628 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fbf2c066100 0x7fbf2c0685b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0b0000 tx=0x7fbf3c0b7040 comp rx=0 tx=0).stop 2023-07-14T13:09:34.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.519+0000 7fbf4eccb640 1 -- 172.21.15.5:0/2300965628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf481577f0 msgr2=0x7fbf48156ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:34.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.519+0000 7fbf4eccb640 1 --2- 172.21.15.5:0/2300965628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf481577f0 0x7fbf48156ee0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fbf3400e550 tx=0x7fbf3400ea10 comp rx=0 tx=0).stop 2023-07-14T13:09:34.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.519+0000 7fbf4eccb640 1 -- 172.21.15.5:0/2300965628 shutdown_connections 2023-07-14T13:09:34.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.519+0000 7fbf4eccb640 1 --2- 172.21.15.5:0/2300965628 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fbf2c066100 0x7fbf2c0685b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:34.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.519+0000 7fbf4eccb640 1 --2- 172.21.15.5:0/2300965628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf480b2d00 0x7fbf480b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:34.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.519+0000 7fbf4eccb640 1 --2- 172.21.15.5:0/2300965628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf481577f0 0x7fbf48156ee0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:34.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.519+0000 7fbf4eccb640 1 --2- 172.21.15.5:0/2300965628 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf38003980 0x7fbf480c1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:34.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.519+0000 7fbf4eccb640 1 -- 172.21.15.5:0/2300965628 >> 172.21.15.5:0/2300965628 conn(0x7fbf480afcf0 msgr2=0x7fbf480adc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:34.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.523+0000 7fbf4eccb640 1 -- 172.21.15.5:0/2300965628 shutdown_connections 2023-07-14T13:09:34.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.523+0000 7fbf4eccb640 1 -- 172.21.15.5:0/2300965628 wait complete. 2023-07-14T13:09:34.571 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:09:34.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.683+0000 7fa01686a640 1 Processor -- start 2023-07-14T13:09:34.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.683+0000 7fa01686a640 1 -- start start 2023-07-14T13:09:34.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa01686a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa01006b1e0 0x7fa0100c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:34.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa01686a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0100cac70 con 0x7fa010070b70 2023-07-14T13:09:34.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa01686a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0100ca060 con 0x7fa0100c21f0 2023-07-14T13:09:34.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa01686a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0100ca340 con 0x7fa01006b1e0 2023-07-14T13:09:34.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa00ffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa010070b70 0x7fa010070f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53328/0 (socket says 172.21.15.5:53328) 2023-07-14T13:09:34.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa00ffff640 1 -- 172.21.15.5:0/1006952673 learned_addr learned my addr 172.21.15.5:0/1006952673 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:34.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa00effd640 1 -- 172.21.15.5:0/1006952673 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010109420 0 0) 0x7fa0100cac70 con 0x7fa010070b70 2023-07-14T13:09:34.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa00f7fe640 1 --2- 172.21.15.5:0/1006952673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa01006b1e0 0x7fa0100c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:34.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa00effd640 1 -- 172.21.15.5:0/1006952673 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ff8003530 con 0x7fa010070b70 2023-07-14T13:09:34.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa00effd640 1 -- 172.21.15.5:0/1006952673 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 380819256 0 0) 0x7f9ff8003530 con 0x7fa010070b70 2023-07-14T13:09:34.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa00effd640 1 -- 172.21.15.5:0/1006952673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa01006b1e0 msgr2=0x7fa0100c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:34.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa00effd640 1 --2- 172.21.15.5:0/1006952673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa01006b1e0 0x7fa0100c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:34.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa00effd640 1 -- 172.21.15.5:0/1006952673 >> v1:172.21.15.154:6789/0 conn(0x7fa0100c21f0 legacy=0x7fa0100cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:34.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa00effd640 1 -- 172.21.15.5:0/1006952673 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0100ca620 con 0x7fa010070b70 2023-07-14T13:09:34.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa00effd640 1 -- 172.21.15.5:0/1006952673 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7fa000001680 con 0x7fa010070b70 2023-07-14T13:09:34.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa00effd640 1 -- 172.21.15.5:0/1006952673 >> v1:172.21.15.5:6789/0 conn(0x7fa010070b70 legacy=0x7fa010070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:34.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa00effd640 1 --2- 172.21.15.5:0/1006952673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ff80039b0 0x7f9ff8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:34.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa00effd640 1 --2- 172.21.15.5:0/1006952673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ff80047d0 0x7f9ff8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:34.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa00effd640 1 --2- 172.21.15.5:0/1006952673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa01006b1e0 0x7f9ff80051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:34.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa00effd640 1 -- 172.21.15.5:0/1006952673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0100ca340 con 0x7f9ff80047d0 2023-07-14T13:09:34.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa00effd640 1 -- 172.21.15.5:0/1006952673 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff800bac0 con 0x7f9ff80039b0 2023-07-14T13:09:34.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa00effd640 1 -- 172.21.15.5:0/1006952673 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff800bc80 con 0x7fa01006b1e0 2023-07-14T13:09:34.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa00f7fe640 1 --2- 172.21.15.5:0/1006952673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ff80047d0 0x7f9ff8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:34.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa00ffff640 1 --2- 172.21.15.5:0/1006952673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ff80039b0 0x7f9ff8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:34.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa014e07640 1 --2- 172.21.15.5:0/1006952673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa01006b1e0 0x7f9ff80051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:34.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa00f7fe640 1 -- 172.21.15.5:0/1006952673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa01006b1e0 msgr2=0x7f9ff80051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:34.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa00f7fe640 1 --2- 172.21.15.5:0/1006952673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa01006b1e0 0x7f9ff80051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:34.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa00f7fe640 1 -- 172.21.15.5:0/1006952673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ff80039b0 msgr2=0x7f9ff8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:34.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa00f7fe640 1 --2- 172.21.15.5:0/1006952673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ff80039b0 0x7f9ff8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:34.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.687+0000 7fa00f7fe640 1 -- 172.21.15.5:0/1006952673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff8003530 con 0x7f9ff80047d0 2023-07-14T13:09:34.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.691+0000 7fa00f7fe640 1 --2- 172.21.15.5:0/1006952673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ff80047d0 0x7f9ff8004c40 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fa004009ae0 tx=0x7fa00401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b693ba726281c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:34.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.691+0000 7fa00effd640 1 -- 172.21.15.5:0/1006952673 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0040a55f0 con 0x7f9ff80047d0 2023-07-14T13:09:34.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.691+0000 7fa00effd640 1 -- 172.21.15.5:0/1006952673 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0040a5750 con 0x7f9ff80047d0 2023-07-14T13:09:34.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.691+0000 7fa00effd640 1 -- 172.21.15.5:0/1006952673 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0040a5b00 con 0x7f9ff80047d0 2023-07-14T13:09:34.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.691+0000 7fa01686a640 1 -- 172.21.15.5:0/1006952673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ff80047d0 msgr2=0x7f9ff8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:34.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.691+0000 7fa01686a640 1 --2- 172.21.15.5:0/1006952673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ff80047d0 0x7f9ff8004c40 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fa004009ae0 tx=0x7fa00401ca20 comp rx=0 tx=0).stop 2023-07-14T13:09:34.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.691+0000 7fa014e07640 1 -- 172.21.15.5:0/1006952673 reap_dead start 2023-07-14T13:09:34.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.691+0000 7fa01686a640 1 -- 172.21.15.5:0/1006952673 shutdown_connections 2023-07-14T13:09:34.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.691+0000 7fa01686a640 1 -- 172.21.15.5:0/1006952673 >> 172.21.15.5:0/1006952673 conn(0x7fa0100afcf0 msgr2=0x7fa0100b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:34.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.691+0000 7fa01686a640 1 -- 172.21.15.5:0/1006952673 shutdown_connections 2023-07-14T13:09:34.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.691+0000 7fa01686a640 1 -- 172.21.15.5:0/1006952673 wait complete. 2023-07-14T13:09:34.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.691+0000 7fa01686a640 1 Processor -- start 2023-07-14T13:09:34.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.695+0000 7fa01686a640 1 -- start start 2023-07-14T13:09:34.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.695+0000 7fa01686a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ff80047d0 0x7fa01014f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:34.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.695+0000 7fa01686a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa01014b8f0 0x7fa010153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:34.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.695+0000 7fa01686a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa010163990 0x7fa010163e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:34.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.695+0000 7fa01686a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa010164370 con 0x7fa01014b8f0 2023-07-14T13:09:34.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.695+0000 7fa01686a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01014a120 con 0x7fa010163990 2023-07-14T13:09:34.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.695+0000 7fa01686a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01014fbc0 con 0x7f9ff80047d0 2023-07-14T13:09:34.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.695+0000 7fa00f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa01014b8f0 0x7fa010153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:34.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.695+0000 7fa00f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa01014b8f0 0x7fa010153900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33830/0 (socket says 172.21.15.5:33830) 2023-07-14T13:09:34.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.695+0000 7fa00f7fe640 1 -- 172.21.15.5:0/1300637202 learned_addr learned my addr 172.21.15.5:0/1300637202 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:34.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.695+0000 7fa00ffff640 1 --2- 172.21.15.5:0/1300637202 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ff80047d0 0x7fa01014f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:34.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.695+0000 7fa014e07640 1 --2- 172.21.15.5:0/1300637202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa010163990 0x7fa010163e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:34.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.695+0000 7fa00f7fe640 1 -- 172.21.15.5:0/1300637202 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ff80047d0 msgr2=0x7fa01014f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:34.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.695+0000 7fa00f7fe640 1 --2- 172.21.15.5:0/1300637202 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ff80047d0 0x7fa01014f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:34.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.695+0000 7fa00f7fe640 1 -- 172.21.15.5:0/1300637202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa010163990 msgr2=0x7fa010163e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:34.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.695+0000 7fa00f7fe640 1 --2- 172.21.15.5:0/1300637202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa010163990 0x7fa010163e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:34.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.695+0000 7fa00f7fe640 1 -- 172.21.15.5:0/1300637202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa010155280 con 0x7fa01014b8f0 2023-07-14T13:09:34.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.695+0000 7fa014e07640 1 --2- 172.21.15.5:0/1300637202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa010163990 0x7fa010163e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:09:34.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.695+0000 7fa00ffff640 1 --2- 172.21.15.5:0/1300637202 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ff80047d0 0x7fa01014f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:09:34.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.695+0000 7fa00f7fe640 1 --2- 172.21.15.5:0/1300637202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa01014b8f0 0x7fa010153900 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fa004009ae0 tx=0x7f9ff8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:34.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.695+0000 7fa00cff9640 1 -- 172.21.15.5:0/1300637202 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0040be070 con 0x7fa01014b8f0 2023-07-14T13:09:34.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.695+0000 7fa00cff9640 1 -- 172.21.15.5:0/1300637202 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00400f000 con 0x7fa01014b8f0 2023-07-14T13:09:34.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.695+0000 7fa00cff9640 1 -- 172.21.15.5:0/1300637202 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0040a55f0 con 0x7fa01014b8f0 2023-07-14T13:09:34.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.695+0000 7fa01686a640 1 -- 172.21.15.5:0/1300637202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0101541e0 con 0x7fa01014b8f0 2023-07-14T13:09:34.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.695+0000 7fa01686a640 1 -- 172.21.15.5:0/1300637202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0101547a0 con 0x7fa01014b8f0 2023-07-14T13:09:34.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.695+0000 7fa01686a640 1 -- 172.21.15.5:0/1300637202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0100678d0 con 0x7fa01014b8f0 2023-07-14T13:09:34.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.699+0000 7fa00cff9640 1 -- 172.21.15.5:0/1300637202 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa0040b4040 con 0x7fa01014b8f0 2023-07-14T13:09:34.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.699+0000 7fa00cff9640 1 --2- 172.21.15.5:0/1300637202 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f9ffc0663a0 0x7f9ffc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:34.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.699+0000 7fa00cff9640 1 -- 172.21.15.5:0/1300637202 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fa00411da90 con 0x7fa01014b8f0 2023-07-14T13:09:34.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.699+0000 7fa00ffff640 1 --2- 172.21.15.5:0/1300637202 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f9ffc0663a0 0x7f9ffc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:34.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.699+0000 7fa00ffff640 1 --2- 172.21.15.5:0/1300637202 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f9ffc0663a0 0x7f9ffc068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa000007d50 tx=0x7fa000009040 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:34.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.703+0000 7fa00cff9640 1 -- 172.21.15.5:0/1300637202 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa0040eabb0 con 0x7fa01014b8f0 2023-07-14T13:09:34.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.855+0000 7fa01686a640 1 -- 172.21.15.5:0/1300637202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0100c98c0 con 0x7fa01014b8f0 2023-07-14T13:09:34.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.859+0000 7fa00cff9640 1 -- 172.21.15.5:0/1300637202 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+19384 (secure 0 0 0) 0x7fa0040ee1d0 con 0x7fa01014b8f0 2023-07-14T13:09:34.889 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:34.890 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":99,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:09:32.036436+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:09:06.567743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-14T13:09:07.824380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6833/714349479":"2023-07-15T13:09:32.036383+0000","172.21.15.154:0/2614825630":"2023-07-15T13:09:32.036383+0000","172.21.15.154:0/2071347872":"2023-07-15T13:09:32.036383+0000","172.21.15.154:0/2619796887":"2023-07-15T13:09:32.036383+0000","172.21.15.154:0/2739506244":"2023-07-15T13:09:32.036383+0000","172.21.15.154:0/2527354231":"2023-07-15T13:09:32.036383+0000","172.21.15.154:0/407312695":"2023-07-15T13:09:32.036383+0000","172.21.15.154:0/1136667119":"2023-07-15T13:09:26.280972+0000","172.21.15.154:6833/3243469291":"2023-07-15T13:09:26.280972+0000","172.21.15.154:6832/3243469291":"2023-07-15T13:09:26.280972+0000","172.21.15.154:0/2054145215":"2023-07-15T13:09:26.280972+0000","172.21.15.154:0/634367575":"2023-07-15T13:09:32.036383+0000","172.21.15.154:0/3260672688":"2023-07-15T13:09:26.280972+0000","172.21.15.154:0/2925558673":"2023-07-15T13:09:26.280972+0000","172.21.15.154:0/3026075462":"2023-07-15T13:09:26.280972+0000","172.21.15.154:6832/714349479":"2023-07-15T13:09:32.036383+0000","172.21.15.154:0/2368288551":"2023-07-15T13:09:26.280972+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:09:34.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.859+0000 7fa01686a640 1 -- 172.21.15.5:0/1300637202 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f9ffc0663a0 msgr2=0x7f9ffc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:34.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.859+0000 7fa01686a640 1 --2- 172.21.15.5:0/1300637202 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f9ffc0663a0 0x7f9ffc068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa000007d50 tx=0x7fa000009040 comp rx=0 tx=0).stop 2023-07-14T13:09:34.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.859+0000 7fa01686a640 1 -- 172.21.15.5:0/1300637202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa01014b8f0 msgr2=0x7fa010153900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:34.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.859+0000 7fa01686a640 1 --2- 172.21.15.5:0/1300637202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa01014b8f0 0x7fa010153900 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fa004009ae0 tx=0x7f9ff8005800 comp rx=0 tx=0).stop 2023-07-14T13:09:34.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.859+0000 7fa01686a640 1 -- 172.21.15.5:0/1300637202 shutdown_connections 2023-07-14T13:09:34.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.859+0000 7fa01686a640 1 --2- 172.21.15.5:0/1300637202 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f9ffc0663a0 0x7f9ffc068850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:34.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.859+0000 7fa01686a640 1 --2- 172.21.15.5:0/1300637202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa010163990 0x7fa010163e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:34.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.859+0000 7fa01686a640 1 --2- 172.21.15.5:0/1300637202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa01014b8f0 0x7fa010153900 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:34.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.859+0000 7fa01686a640 1 --2- 172.21.15.5:0/1300637202 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9ff80047d0 0x7fa01014f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:34.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.859+0000 7fa01686a640 1 -- 172.21.15.5:0/1300637202 >> 172.21.15.5:0/1300637202 conn(0x7fa0100afcf0 msgr2=0x7fa0100c45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:34.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.859+0000 7fa01686a640 1 -- 172.21.15.5:0/1300637202 shutdown_connections 2023-07-14T13:09:34.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:34.859+0000 7fa01686a640 1 -- 172.21.15.5:0/1300637202 wait complete. 2023-07-14T13:09:34.911 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-14T13:09:35.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.023+0000 7f668ae7b640 1 Processor -- start 2023-07-14T13:09:35.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.023+0000 7f668ae7b640 1 -- start start 2023-07-14T13:09:35.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.027+0000 7f668ae7b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6684070b70 0x7f6684070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:35.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.027+0000 7f668ae7b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66840cac70 con 0x7f668406b1e0 2023-07-14T13:09:35.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.027+0000 7f668ae7b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6684071480 con 0x7f66840cb100 2023-07-14T13:09:35.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.027+0000 7f668ae7b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66840ca060 con 0x7f6684070b70 2023-07-14T13:09:35.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.027+0000 7f6683fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f668406b1e0 0x7f66840c1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53336/0 (socket says 172.21.15.5:53336) 2023-07-14T13:09:35.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.027+0000 7f6683fff640 1 -- 172.21.15.5:0/1377209382 learned_addr learned my addr 172.21.15.5:0/1377209382 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:35.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.027+0000 7f6688c17640 1 --2- 172.21.15.5:0/1377209382 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6684070b70 0x7f6684070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:35.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.027+0000 7f66837fe640 1 -- 172.21.15.5:0/1377209382 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1776941427 0 0) 0x7f66840cac70 con 0x7f668406b1e0 2023-07-14T13:09:35.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.027+0000 7f66837fe640 1 -- 172.21.15.5:0/1377209382 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6674003530 con 0x7f668406b1e0 2023-07-14T13:09:35.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.027+0000 7f6688c17640 1 -- 172.21.15.5:0/1377209382 >> v1:172.21.15.154:6789/0 conn(0x7f66840cb100 legacy=0x7f66841642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:35.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.027+0000 7f66837fe640 1 -- 172.21.15.5:0/1377209382 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3578776029 0 0) 0x7f6684071480 con 0x7f66840cb100 2023-07-14T13:09:35.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.027+0000 7f6688c17640 1 -- 172.21.15.5:0/1377209382 >> v1:172.21.15.5:6789/0 conn(0x7f668406b1e0 legacy=0x7f66840c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:35.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.027+0000 7f6688c17640 1 -- 172.21.15.5:0/1377209382 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66840ca340 con 0x7f6684070b70 2023-07-14T13:09:35.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.031+0000 7f6688c17640 1 --2- 172.21.15.5:0/1377209382 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6684070b70 0x7f6684070f40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f66780097f0 tx=0x7f667801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5835c7f604e01030 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:35.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.031+0000 7f66837fe640 1 -- 172.21.15.5:0/1377209382 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66780ab600 con 0x7f6684070b70 2023-07-14T13:09:35.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.031+0000 7f66837fe640 1 -- 172.21.15.5:0/1377209382 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66780ab760 con 0x7f6684070b70 2023-07-14T13:09:35.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.031+0000 7f66837fe640 1 -- 172.21.15.5:0/1377209382 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66780abad0 con 0x7f6684070b70 2023-07-14T13:09:35.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.031+0000 7f668ae7b640 1 -- 172.21.15.5:0/1377209382 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6684070b70 msgr2=0x7f6684070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:35.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.031+0000 7f668ae7b640 1 --2- 172.21.15.5:0/1377209382 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6684070b70 0x7f6684070f40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f66780097f0 tx=0x7f667801c400 comp rx=0 tx=0).stop 2023-07-14T13:09:35.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.031+0000 7f668ae7b640 1 -- 172.21.15.5:0/1377209382 shutdown_connections 2023-07-14T13:09:35.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.031+0000 7f668ae7b640 1 --2- 172.21.15.5:0/1377209382 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6684070b70 0x7f6684070f40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:35.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.031+0000 7f668ae7b640 1 -- 172.21.15.5:0/1377209382 >> 172.21.15.5:0/1377209382 conn(0x7f66840afcf0 msgr2=0x7f66840b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:35.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.031+0000 7f668ae7b640 1 -- 172.21.15.5:0/1377209382 shutdown_connections 2023-07-14T13:09:35.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.031+0000 7f668ae7b640 1 -- 172.21.15.5:0/1377209382 wait complete. 2023-07-14T13:09:35.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.031+0000 7f668ae7b640 1 Processor -- start 2023-07-14T13:09:35.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.031+0000 7f668ae7b640 1 -- start start 2023-07-14T13:09:35.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.035+0000 7f668ae7b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f668406b1e0 0x7f66840cd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:35.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.035+0000 7f668ae7b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6684070b70 0x7f6684155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:35.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.035+0000 7f668ae7b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66840cb100 0x7f668414d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:35.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.035+0000 7f668ae7b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6684156220 con 0x7f66840cb100 2023-07-14T13:09:35.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.035+0000 7f668ae7b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6684156500 con 0x7f6684070b70 2023-07-14T13:09:35.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.035+0000 7f668ae7b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66841567e0 con 0x7f668406b1e0 2023-07-14T13:09:35.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.035+0000 7f6689418640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66840cb100 0x7f668414d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:35.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.035+0000 7f6689418640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66840cb100 0x7f668414d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33832/0 (socket says 172.21.15.5:33832) 2023-07-14T13:09:35.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.035+0000 7f6689418640 1 -- 172.21.15.5:0/1035200436 learned_addr learned my addr 172.21.15.5:0/1035200436 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:35.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.035+0000 7f6683fff640 1 --2- 172.21.15.5:0/1035200436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6684070b70 0x7f6684155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:35.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.035+0000 7f6688c17640 1 --2- 172.21.15.5:0/1035200436 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f668406b1e0 0x7f66840cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:35.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.035+0000 7f6689418640 1 -- 172.21.15.5:0/1035200436 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f668406b1e0 msgr2=0x7f66840cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:35.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.035+0000 7f6689418640 1 --2- 172.21.15.5:0/1035200436 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f668406b1e0 0x7f66840cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:35.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.035+0000 7f6689418640 1 -- 172.21.15.5:0/1035200436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6684070b70 msgr2=0x7f6684155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:35.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.035+0000 7f6689418640 1 --2- 172.21.15.5:0/1035200436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6684070b70 0x7f6684155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:35.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.035+0000 7f6689418640 1 -- 172.21.15.5:0/1035200436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6678009420 con 0x7f66840cb100 2023-07-14T13:09:35.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.035+0000 7f6689418640 1 --2- 172.21.15.5:0/1035200436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66840cb100 0x7f668414d980 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f667c00c780 tx=0x7f667c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:35.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.035+0000 7f66817fa640 1 -- 172.21.15.5:0/1035200436 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c003db0 con 0x7f66840cb100 2023-07-14T13:09:35.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.035+0000 7f66817fa640 1 -- 172.21.15.5:0/1035200436 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667c00ce30 con 0x7f66840cb100 2023-07-14T13:09:35.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.035+0000 7f668ae7b640 1 -- 172.21.15.5:0/1035200436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6684156ac0 con 0x7f66840cb100 2023-07-14T13:09:35.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.035+0000 7f66817fa640 1 -- 172.21.15.5:0/1035200436 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c0052b0 con 0x7f66840cb100 2023-07-14T13:09:35.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.035+0000 7f668ae7b640 1 -- 172.21.15.5:0/1035200436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f668414dec0 con 0x7f66840cb100 2023-07-14T13:09:35.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.035+0000 7f668ae7b640 1 -- 172.21.15.5:0/1035200436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6684156fe0 con 0x7f66840cb100 2023-07-14T13:09:35.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.039+0000 7f66817fa640 1 -- 172.21.15.5:0/1035200436 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f667c005410 con 0x7f66840cb100 2023-07-14T13:09:35.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.039+0000 7f66817fa640 1 --2- 172.21.15.5:0/1035200436 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f66680663a0 0x7f6668068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:35.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.039+0000 7f66817fa640 1 -- 172.21.15.5:0/1035200436 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f667c083e20 con 0x7f66840cb100 2023-07-14T13:09:35.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.039+0000 7f6688c17640 1 --2- 172.21.15.5:0/1035200436 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f66680663a0 0x7f6668068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:35.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.039+0000 7f6688c17640 1 --2- 172.21.15.5:0/1035200436 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f66680663a0 0x7f6668068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f66780af000 tx=0x7f66780a7000 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:35.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.043+0000 7f66817fa640 1 -- 172.21.15.5:0/1035200436 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f667c050f60 con 0x7f66840cb100 2023-07-14T13:09:35.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.227+0000 7f668ae7b640 1 -- 172.21.15.5:0/1035200436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f66840678d0 con 0x7f66840cb100 2023-07-14T13:09:35.260 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-07-14T13:09:35.231+0000 7f17b1648640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-14T13:09:35.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.235+0000 7f66817fa640 1 -- 172.21.15.5:0/1035200436 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v42) v1 ==== 161+0+0 (secure 0 0 0) 0x7f667c054580 con 0x7f66840cb100 2023-07-14T13:09:35.267 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-14T13:09:35.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.239+0000 7f668ae7b640 1 -- 172.21.15.5:0/1035200436 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f66680663a0 msgr2=0x7f6668068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:35.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.239+0000 7f668ae7b640 1 --2- 172.21.15.5:0/1035200436 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f66680663a0 0x7f6668068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f66780af000 tx=0x7f66780a7000 comp rx=0 tx=0).stop 2023-07-14T13:09:35.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.239+0000 7f668ae7b640 1 -- 172.21.15.5:0/1035200436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66840cb100 msgr2=0x7f668414d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:35.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.239+0000 7f668ae7b640 1 --2- 172.21.15.5:0/1035200436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66840cb100 0x7f668414d980 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f667c00c780 tx=0x7f667c00cc40 comp rx=0 tx=0).stop 2023-07-14T13:09:35.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.239+0000 7f668ae7b640 1 -- 172.21.15.5:0/1035200436 shutdown_connections 2023-07-14T13:09:35.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.239+0000 7f668ae7b640 1 --2- 172.21.15.5:0/1035200436 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f66680663a0 0x7f6668068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:35.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.239+0000 7f668ae7b640 1 --2- 172.21.15.5:0/1035200436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66840cb100 0x7f668414d980 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:35.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.239+0000 7f668ae7b640 1 --2- 172.21.15.5:0/1035200436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6684070b70 0x7f6684155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:35.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.239+0000 7f668ae7b640 1 --2- 172.21.15.5:0/1035200436 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f668406b1e0 0x7f66840cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:35.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.239+0000 7f668ae7b640 1 -- 172.21.15.5:0/1035200436 >> 172.21.15.5:0/1035200436 conn(0x7f66840afcf0 msgr2=0x7f66840b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:35.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.239+0000 7f668ae7b640 1 -- 172.21.15.5:0/1035200436 shutdown_connections 2023-07-14T13:09:35.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.239+0000 7f668ae7b640 1 -- 172.21.15.5:0/1035200436 wait complete. 2023-07-14T13:09:35.272 INFO:tasks.ceph.mds.a.smithi005.stderr: -2668> 2023-07-14T13:09:12.739+0000 7fafff6fd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T13:09:35.288 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-14T13:09:35.320 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-07-14T13:09:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.407+0000 7f6aa1e48640 1 Processor -- start 2023-07-14T13:09:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.407+0000 7f6aa1e48640 1 -- start start 2023-07-14T13:09:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.407+0000 7f6aa1e48640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6a9c06a540 0x7f6a9c0cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.407+0000 7f6aa1e48640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6a9c06a910 0x7f6a9c0d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.407+0000 7f6aa1e48640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9c0cd1f0 con 0x7f6a9c1601f0 2023-07-14T13:09:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.407+0000 7f6aa1e48640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9c0cd4d0 con 0x7f6a9c06a540 2023-07-14T13:09:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.407+0000 7f6aa1e48640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9c0cd7b0 con 0x7f6a9c06a910 2023-07-14T13:09:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.407+0000 7f6a9b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6a9c06a540 0x7f6a9c0cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.407+0000 7f6a9b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6a9c06a540 0x7f6a9c0cdcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33860/0 (socket says 172.21.15.5:33860) 2023-07-14T13:09:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.407+0000 7f6a9b7fe640 1 -- 172.21.15.5:0/3459746243 learned_addr learned my addr 172.21.15.5:0/3459746243 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.407+0000 7f6a9bfff640 1 --2- 172.21.15.5:0/3459746243 >> v2:172.21.15.154:3300/0 conn(0x7f6a9c06a910 0x7f6a9c0d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.407+0000 7f6a9b7fe640 1 -- 172.21.15.5:0/3459746243 >> v2:172.21.15.154:3300/0 conn(0x7f6a9c06a910 msgr2=0x7f6a9c0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.407+0000 7f6a9b7fe640 1 --2- 172.21.15.5:0/3459746243 >> v2:172.21.15.154:3300/0 conn(0x7f6a9c06a910 0x7f6a9c0d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.407+0000 7f6a9b7fe640 1 -- 172.21.15.5:0/3459746243 >> v1:172.21.15.5:6789/0 conn(0x7f6a9c1601f0 legacy=0x7f6a9c0cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.407+0000 7f6a9b7fe640 1 -- 172.21.15.5:0/3459746243 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c0cfe40 con 0x7f6a9c06a540 2023-07-14T13:09:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.411+0000 7f6a9b7fe640 1 --2- 172.21.15.5:0/3459746243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a9c06a540 0x7f6a9c0cdcd0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c006fd0 tx=0x7f6a8c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10976303436dbc2f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.411+0000 7f6a9a7fc640 1 -- 172.21.15.5:0/3459746243 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c0ab600 con 0x7f6a9c06a540 2023-07-14T13:09:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.411+0000 7f6a9a7fc640 1 -- 172.21.15.5:0/3459746243 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8c0a7050 con 0x7f6a9c06a540 2023-07-14T13:09:35.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.411+0000 7f6a9a7fc640 1 -- 172.21.15.5:0/3459746243 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c0ab980 con 0x7f6a9c06a540 2023-07-14T13:09:35.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.411+0000 7f6aa1e48640 1 -- 172.21.15.5:0/3459746243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a9c06a540 msgr2=0x7f6a9c0cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:35.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.411+0000 7f6aa1e48640 1 --2- 172.21.15.5:0/3459746243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a9c06a540 0x7f6a9c0cdcd0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c006fd0 tx=0x7f6a8c01c3c0 comp rx=0 tx=0).stop 2023-07-14T13:09:35.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.411+0000 7f6aa1e48640 1 -- 172.21.15.5:0/3459746243 shutdown_connections 2023-07-14T13:09:35.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.411+0000 7f6aa1e48640 1 --2- 172.21.15.5:0/3459746243 >> v2:172.21.15.154:3300/0 conn(0x7f6a9c06a910 0x7f6a9c0d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:35.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.411+0000 7f6aa1e48640 1 --2- 172.21.15.5:0/3459746243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a9c06a540 0x7f6a9c0cdcd0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:35.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.411+0000 7f6aa1e48640 1 -- 172.21.15.5:0/3459746243 >> 172.21.15.5:0/3459746243 conn(0x7f6a9c099490 msgr2=0x7f6a9c089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:35.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.411+0000 7f6aa1e48640 1 -- 172.21.15.5:0/3459746243 shutdown_connections 2023-07-14T13:09:35.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.411+0000 7f6aa1e48640 1 -- 172.21.15.5:0/3459746243 wait complete. 2023-07-14T13:09:35.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.411+0000 7f6aa1e48640 1 Processor -- start 2023-07-14T13:09:35.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.411+0000 7f6aa1e48640 1 -- start start 2023-07-14T13:09:35.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.415+0000 7f6aa1e48640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a9c06a540 0x7f6a9c158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:35.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.415+0000 7f6aa1e48640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a9c06a910 0x7f6a9c156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:35.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.415+0000 7f6aa1e48640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a9c1601f0 0x7f6a9c0afef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:35.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.415+0000 7f6aa1e48640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c156fc0 con 0x7f6a9c06a910 2023-07-14T13:09:35.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.415+0000 7f6aa1e48640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c1572a0 con 0x7f6a9c1601f0 2023-07-14T13:09:35.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.415+0000 7f6aa1e48640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c157580 con 0x7f6a9c06a540 2023-07-14T13:09:35.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.415+0000 7f6a9affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a9c06a910 0x7f6a9c156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:35.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.415+0000 7f6a9affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a9c06a910 0x7f6a9c156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33870/0 (socket says 172.21.15.5:33870) 2023-07-14T13:09:35.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.415+0000 7f6a9affd640 1 -- 172.21.15.5:0/2933105035 learned_addr learned my addr 172.21.15.5:0/2933105035 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:35.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.415+0000 7f6a9bfff640 1 --2- 172.21.15.5:0/2933105035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a9c1601f0 0x7f6a9c0afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:35.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.415+0000 7f6a9b7fe640 1 --2- 172.21.15.5:0/2933105035 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a9c06a540 0x7f6a9c158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:35.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.415+0000 7f6a9affd640 1 -- 172.21.15.5:0/2933105035 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a9c06a540 msgr2=0x7f6a9c158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:35.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.415+0000 7f6a9affd640 1 --2- 172.21.15.5:0/2933105035 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a9c06a540 0x7f6a9c158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:35.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.415+0000 7f6a9affd640 1 -- 172.21.15.5:0/2933105035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a9c1601f0 msgr2=0x7f6a9c0afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:35.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.415+0000 7f6a9affd640 1 --2- 172.21.15.5:0/2933105035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a9c1601f0 0x7f6a9c0afef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:35.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.415+0000 7f6a9affd640 1 -- 172.21.15.5:0/2933105035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c009480 con 0x7f6a9c06a910 2023-07-14T13:09:35.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.415+0000 7f6a9b7fe640 1 --2- 172.21.15.5:0/2933105035 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a9c06a540 0x7f6a9c158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:09:35.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.415+0000 7f6a9affd640 1 --2- 172.21.15.5:0/2933105035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a9c06a910 0x7f6a9c156780 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f6a9000c390 tx=0x7f6a9000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:35.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.415+0000 7f6a83fff640 1 -- 172.21.15.5:0/2933105035 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a900052d0 con 0x7f6a9c06a910 2023-07-14T13:09:35.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.415+0000 7f6a83fff640 1 -- 172.21.15.5:0/2933105035 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a90005430 con 0x7f6a9c06a910 2023-07-14T13:09:35.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.415+0000 7f6aa1e48640 1 -- 172.21.15.5:0/2933105035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9c157860 con 0x7f6a9c06a910 2023-07-14T13:09:35.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.415+0000 7f6a83fff640 1 -- 172.21.15.5:0/2933105035 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a90003820 con 0x7f6a9c06a910 2023-07-14T13:09:35.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.415+0000 7f6aa1e48640 1 -- 172.21.15.5:0/2933105035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9c156cc0 con 0x7f6a9c06a910 2023-07-14T13:09:35.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.415+0000 7f6aa1e48640 1 -- 172.21.15.5:0/2933105035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a9c157d80 con 0x7f6a9c06a910 2023-07-14T13:09:35.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.419+0000 7f6a83fff640 1 -- 172.21.15.5:0/2933105035 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6a90003980 con 0x7f6a9c06a910 2023-07-14T13:09:35.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.419+0000 7f6a83fff640 1 --2- 172.21.15.5:0/2933105035 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f6a880663a0 0x7f6a88068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:35.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.419+0000 7f6a83fff640 1 -- 172.21.15.5:0/2933105035 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6879+0+0 (secure 0 0 0) 0x7f6a90083770 con 0x7f6a9c06a910 2023-07-14T13:09:35.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.419+0000 7f6a9b7fe640 1 --2- 172.21.15.5:0/2933105035 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f6a880663a0 0x7f6a88068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:35.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.419+0000 7f6a9b7fe640 1 --2- 172.21.15.5:0/2933105035 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f6a880663a0 0x7f6a88068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c0ad000 tx=0x7f6a8c0a6000 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:35.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.423+0000 7f6a83fff640 1 -- 172.21.15.5:0/2933105035 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6a9c157d80 con 0x7f6a9c06a910 2023-07-14T13:09:35.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:35.607+0000 7f6aa1e48640 1 -- 172.21.15.5:0/2933105035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6a9c157d80 con 0x7f6a9c06a910 2023-07-14T13:09:36.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.235+0000 7f6a83fff640 1 -- 172.21.15.5:0/2933105035 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v43) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6a9c157d80 con 0x7f6a9c06a910 2023-07-14T13:09:36.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.239+0000 7f6aa1e48640 1 -- 172.21.15.5:0/2933105035 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f6a880663a0 msgr2=0x7f6a88068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:36.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.239+0000 7f6aa1e48640 1 --2- 172.21.15.5:0/2933105035 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f6a880663a0 0x7f6a88068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c0ad000 tx=0x7f6a8c0a6000 comp rx=0 tx=0).stop 2023-07-14T13:09:36.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.239+0000 7f6aa1e48640 1 -- 172.21.15.5:0/2933105035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a9c06a910 msgr2=0x7f6a9c156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:36.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.239+0000 7f6aa1e48640 1 --2- 172.21.15.5:0/2933105035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a9c06a910 0x7f6a9c156780 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f6a9000c390 tx=0x7f6a9000c850 comp rx=0 tx=0).stop 2023-07-14T13:09:36.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.239+0000 7f6aa1e48640 1 -- 172.21.15.5:0/2933105035 shutdown_connections 2023-07-14T13:09:36.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.239+0000 7f6aa1e48640 1 --2- 172.21.15.5:0/2933105035 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f6a880663a0 0x7f6a88068850 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:36.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.239+0000 7f6aa1e48640 1 --2- 172.21.15.5:0/2933105035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a9c1601f0 0x7f6a9c0afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:36.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.239+0000 7f6aa1e48640 1 --2- 172.21.15.5:0/2933105035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a9c06a910 0x7f6a9c156780 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:36.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.239+0000 7f6aa1e48640 1 --2- 172.21.15.5:0/2933105035 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a9c06a540 0x7f6a9c158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:36.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.239+0000 7f6aa1e48640 1 -- 172.21.15.5:0/2933105035 >> 172.21.15.5:0/2933105035 conn(0x7f6a9c099490 msgr2=0x7f6a9c06ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:36.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.239+0000 7f6aa1e48640 1 -- 172.21.15.5:0/2933105035 shutdown_connections 2023-07-14T13:09:36.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.239+0000 7f6aa1e48640 1 -- 172.21.15.5:0/2933105035 wait complete. 2023-07-14T13:09:36.293 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-14T13:09:36.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.455+0000 7f2f7df40640 1 Processor -- start 2023-07-14T13:09:36.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.459+0000 7f2f7df40640 1 -- start start 2023-07-14T13:09:36.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.459+0000 7f2f7df40640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2f7815cef0 0x7f2f78158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:36.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.459+0000 7f2f7df40640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f781532b0 con 0x7f2f780aeb40 2023-07-14T13:09:36.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.459+0000 7f2f7df40640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f780ca6f0 con 0x7f2f78159270 2023-07-14T13:09:36.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.459+0000 7f2f7df40640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f7815d360 con 0x7f2f7815cef0 2023-07-14T13:09:36.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.459+0000 7f2f777fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2f780aeb40 0x7f2f780aef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53370/0 (socket says 172.21.15.5:53370) 2023-07-14T13:09:36.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.459+0000 7f2f777fe640 1 -- 172.21.15.5:0/1520049360 learned_addr learned my addr 172.21.15.5:0/1520049360 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:36.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.459+0000 7f2f76ffd640 1 --2- 172.21.15.5:0/1520049360 >> v2:172.21.15.154:3300/0 conn(0x7f2f7815cef0 0x7f2f78158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:36.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.459+0000 7f2f767fc640 1 -- 172.21.15.5:0/1520049360 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3706439055 0 0) 0x7f2f781532b0 con 0x7f2f780aeb40 2023-07-14T13:09:36.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.459+0000 7f2f767fc640 1 -- 172.21.15.5:0/1520049360 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f60003530 con 0x7f2f780aeb40 2023-07-14T13:09:36.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.459+0000 7f2f767fc640 1 -- 172.21.15.5:0/1520049360 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536134290 0 0) 0x7f2f780ca6f0 con 0x7f2f78159270 2023-07-14T13:09:36.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.459+0000 7f2f767fc640 1 -- 172.21.15.5:0/1520049360 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f781532b0 con 0x7f2f78159270 2023-07-14T13:09:36.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.459+0000 7f2f767fc640 1 -- 172.21.15.5:0/1520049360 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4107751991 0 0) 0x7f2f60003530 con 0x7f2f780aeb40 2023-07-14T13:09:36.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.459+0000 7f2f76ffd640 1 -- 172.21.15.5:0/1520049360 >> v1:172.21.15.154:6789/0 conn(0x7f2f78159270 legacy=0x7f2f780c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:36.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.459+0000 7f2f76ffd640 1 -- 172.21.15.5:0/1520049360 >> v1:172.21.15.5:6789/0 conn(0x7f2f780aeb40 legacy=0x7f2f780aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:36.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.459+0000 7f2f76ffd640 1 -- 172.21.15.5:0/1520049360 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f781599d0 con 0x7f2f7815cef0 2023-07-14T13:09:36.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.463+0000 7f2f76ffd640 1 --2- 172.21.15.5:0/1520049360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f7815cef0 0x7f2f78158d30 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0097c0 tx=0x7f2f6c01c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c610be3dd2587db server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:36.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.463+0000 7f2f767fc640 1 -- 172.21.15.5:0/1520049360 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f68001600 con 0x7f2f7815cef0 2023-07-14T13:09:36.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.463+0000 7f2f767fc640 1 -- 172.21.15.5:0/1520049360 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6c0a7050 con 0x7f2f7815cef0 2023-07-14T13:09:36.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.463+0000 7f2f767fc640 1 -- 172.21.15.5:0/1520049360 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c0ab620 con 0x7f2f7815cef0 2023-07-14T13:09:36.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.463+0000 7f2f7df40640 1 -- 172.21.15.5:0/1520049360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f7815cef0 msgr2=0x7f2f78158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:36.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.463+0000 7f2f7df40640 1 --2- 172.21.15.5:0/1520049360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f7815cef0 0x7f2f78158d30 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0097c0 tx=0x7f2f6c01c370 comp rx=0 tx=0).stop 2023-07-14T13:09:36.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.463+0000 7f2f7df40640 1 -- 172.21.15.5:0/1520049360 shutdown_connections 2023-07-14T13:09:36.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.463+0000 7f2f7df40640 1 --2- 172.21.15.5:0/1520049360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f7815cef0 0x7f2f78158d30 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:36.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.463+0000 7f2f7df40640 1 -- 172.21.15.5:0/1520049360 >> 172.21.15.5:0/1520049360 conn(0x7f2f780cde90 msgr2=0x7f2f780ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:36.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.463+0000 7f2f7df40640 1 -- 172.21.15.5:0/1520049360 shutdown_connections 2023-07-14T13:09:36.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.463+0000 7f2f7df40640 1 -- 172.21.15.5:0/1520049360 wait complete. 2023-07-14T13:09:36.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.467+0000 7f2f7df40640 1 Processor -- start 2023-07-14T13:09:36.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.467+0000 7f2f7df40640 1 -- start start 2023-07-14T13:09:36.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.467+0000 7f2f7df40640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f780aeb40 0x7f2f78144130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:36.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.467+0000 7f2f7df40640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f78159270 0x7f2f780c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:36.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.467+0000 7f2f7df40640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f7815cef0 0x7f2f7806f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:36.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.467+0000 7f2f7df40640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7806c460 con 0x7f2f78159270 2023-07-14T13:09:36.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.467+0000 7f2f7df40640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f78157b10 con 0x7f2f780aeb40 2023-07-14T13:09:36.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.467+0000 7f2f7df40640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7806be10 con 0x7f2f7815cef0 2023-07-14T13:09:36.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.467+0000 7f2f76ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f78159270 0x7f2f780c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:36.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.467+0000 7f2f76ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f78159270 0x7f2f780c3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33878/0 (socket says 172.21.15.5:33878) 2023-07-14T13:09:36.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.467+0000 7f2f76ffd640 1 -- 172.21.15.5:0/411890386 learned_addr learned my addr 172.21.15.5:0/411890386 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:36.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.467+0000 7f2f777fe640 1 --2- 172.21.15.5:0/411890386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f780aeb40 0x7f2f78144130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:36.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.467+0000 7f2f77fff640 1 --2- 172.21.15.5:0/411890386 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f7815cef0 0x7f2f7806f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:36.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.467+0000 7f2f76ffd640 1 -- 172.21.15.5:0/411890386 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f7815cef0 msgr2=0x7f2f7806f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:36.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.467+0000 7f2f76ffd640 1 --2- 172.21.15.5:0/411890386 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f7815cef0 0x7f2f7806f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:36.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.467+0000 7f2f76ffd640 1 -- 172.21.15.5:0/411890386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f780aeb40 msgr2=0x7f2f78144130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:36.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.467+0000 7f2f76ffd640 1 --2- 172.21.15.5:0/411890386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f780aeb40 0x7f2f78144130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:36.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.467+0000 7f2f76ffd640 1 -- 172.21.15.5:0/411890386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c009420 con 0x7f2f78159270 2023-07-14T13:09:36.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.467+0000 7f2f76ffd640 1 --2- 172.21.15.5:0/411890386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f78159270 0x7f2f780c3360 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0ae040 tx=0x7f2f6c019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:36.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.467+0000 7f2f5ffff640 1 -- 172.21.15.5:0/411890386 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c0abe70 con 0x7f2f78159270 2023-07-14T13:09:36.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.467+0000 7f2f5ffff640 1 -- 172.21.15.5:0/411890386 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6c004020 con 0x7f2f78159270 2023-07-14T13:09:36.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.467+0000 7f2f7df40640 1 -- 172.21.15.5:0/411890386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f7806c0f0 con 0x7f2f78159270 2023-07-14T13:09:36.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.467+0000 7f2f5ffff640 1 -- 172.21.15.5:0/411890386 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c004390 con 0x7f2f78159270 2023-07-14T13:09:36.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.467+0000 7f2f7df40640 1 -- 172.21.15.5:0/411890386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f781586e0 con 0x7f2f78159270 2023-07-14T13:09:36.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.471+0000 7f2f7df40640 1 -- 172.21.15.5:0/411890386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f781588d0 con 0x7f2f78159270 2023-07-14T13:09:36.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.471+0000 7f2f5ffff640 1 -- 172.21.15.5:0/411890386 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2f6c0b2040 con 0x7f2f78159270 2023-07-14T13:09:36.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.471+0000 7f2f5ffff640 1 --2- 172.21.15.5:0/411890386 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f2f640663d0 0x7f2f64068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:36.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.471+0000 7f2f5ffff640 1 -- 172.21.15.5:0/411890386 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6879+0+0 (secure 0 0 0) 0x7f2f6c11d170 con 0x7f2f78159270 2023-07-14T13:09:36.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.471+0000 7f2f777fe640 1 --2- 172.21.15.5:0/411890386 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f2f640663d0 0x7f2f64068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:36.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.471+0000 7f2f777fe640 1 --2- 172.21.15.5:0/411890386 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f2f640663d0 0x7f2f64068880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2f68005890 tx=0x7f2f68009040 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:36.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.475+0000 7f2f5ffff640 1 -- 172.21.15.5:0/411890386 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2f781588d0 con 0x7f2f78159270 2023-07-14T13:09:36.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:36.627+0000 7f2f7df40640 1 -- 172.21.15.5:0/411890386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2f7806bc70 con 0x7f2f78159270 2023-07-14T13:09:37.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.331+0000 7f2f5ffff640 1 -- 172.21.15.5:0/411890386 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v101) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2f7806bc70 con 0x7f2f78159270 2023-07-14T13:09:37.364 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-07-14T13:09:37.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.335+0000 7f2f7df40640 1 -- 172.21.15.5:0/411890386 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f2f640663d0 msgr2=0x7f2f64068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:37.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.335+0000 7f2f7df40640 1 --2- 172.21.15.5:0/411890386 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f2f640663d0 0x7f2f64068880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2f68005890 tx=0x7f2f68009040 comp rx=0 tx=0).stop 2023-07-14T13:09:37.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.335+0000 7f2f7df40640 1 -- 172.21.15.5:0/411890386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f78159270 msgr2=0x7f2f780c3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:37.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.335+0000 7f2f7df40640 1 --2- 172.21.15.5:0/411890386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f78159270 0x7f2f780c3360 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0ae040 tx=0x7f2f6c019110 comp rx=0 tx=0).stop 2023-07-14T13:09:37.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.335+0000 7f2f7df40640 1 -- 172.21.15.5:0/411890386 shutdown_connections 2023-07-14T13:09:37.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.335+0000 7f2f7df40640 1 --2- 172.21.15.5:0/411890386 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f2f640663d0 0x7f2f64068880 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:37.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.335+0000 7f2f7df40640 1 --2- 172.21.15.5:0/411890386 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f7815cef0 0x7f2f7806f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:37.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.335+0000 7f2f7df40640 1 --2- 172.21.15.5:0/411890386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f78159270 0x7f2f780c3360 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:37.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.335+0000 7f2f7df40640 1 --2- 172.21.15.5:0/411890386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f780aeb40 0x7f2f78144130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:37.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.335+0000 7f2f7df40640 1 -- 172.21.15.5:0/411890386 >> 172.21.15.5:0/411890386 conn(0x7f2f780cde90 msgr2=0x7f2f780ae360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:37.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.335+0000 7f2f7df40640 1 -- 172.21.15.5:0/411890386 shutdown_connections 2023-07-14T13:09:37.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.335+0000 7f2f7df40640 1 -- 172.21.15.5:0/411890386 wait complete. 2023-07-14T13:09:37.393 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-14T13:09:37.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.519+0000 7fd8d359e640 1 Processor -- start 2023-07-14T13:09:37.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.519+0000 7fd8d359e640 1 -- start start 2023-07-14T13:09:37.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.523+0000 7fd8d359e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd8d406c160 0x7fd8d415cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:37.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.523+0000 7fd8d359e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8d406c530 0x7fd8d40af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:37.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.523+0000 7fd8d359e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d4158f00 con 0x7fd8d40afd40 2023-07-14T13:09:37.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.523+0000 7fd8d359e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d40ca3a0 con 0x7fd8d406c160 2023-07-14T13:09:37.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.523+0000 7fd8d359e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d415d0f0 con 0x7fd8d406c530 2023-07-14T13:09:37.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.523+0000 7fd8d2d9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd8d40afd40 0x7fd8d40cc430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:45588/0 (socket says 172.21.15.5:45588) 2023-07-14T13:09:37.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.523+0000 7fd8d259c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd8d406c160 0x7fd8d415cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:37.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.523+0000 7fd8d2d9d640 1 -- 172.21.15.5:0/1541997747 learned_addr learned my addr 172.21.15.5:0/1541997747 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:37.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.523+0000 7fd8cbfff640 1 --2- 172.21.15.5:0/1541997747 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8d406c530 0x7fd8d40af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:37.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.523+0000 7fd8cbfff640 1 -- 172.21.15.5:0/1541997747 >> v2:172.21.15.154:3300/0 conn(0x7fd8d406c160 msgr2=0x7fd8d415cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:37.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.523+0000 7fd8cbfff640 1 --2- 172.21.15.5:0/1541997747 >> v2:172.21.15.154:3300/0 conn(0x7fd8d406c160 0x7fd8d415cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:37.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.523+0000 7fd8cbfff640 1 -- 172.21.15.5:0/1541997747 >> v1:172.21.15.154:6789/0 conn(0x7fd8d40afd40 legacy=0x7fd8d40cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:37.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.523+0000 7fd8cbfff640 1 -- 172.21.15.5:0/1541997747 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d41591e0 con 0x7fd8d406c530 2023-07-14T13:09:37.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.523+0000 7fd8d259c640 1 --2- 172.21.15.5:0/1541997747 >> v2:172.21.15.154:3300/0 conn(0x7fd8d406c160 0x7fd8d415cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:09:37.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.523+0000 7fd8d1d9b640 1 -- 172.21.15.5:0/1541997747 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 179385295 0 0) 0x7fd8d4158f00 con 0x7fd8d40afd40 2023-07-14T13:09:37.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.527+0000 7fd8cbfff640 1 --2- 172.21.15.5:0/1541997747 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8d406c530 0x7fd8d40af800 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc0097c0 tx=0x7fd8bc01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=707ed909edbc9687 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:37.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.527+0000 7fd8d1d9b640 1 -- 172.21.15.5:0/1541997747 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc0ab600 con 0x7fd8d406c530 2023-07-14T13:09:37.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.527+0000 7fd8d1d9b640 1 -- 172.21.15.5:0/1541997747 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8bc0a7050 con 0x7fd8d406c530 2023-07-14T13:09:37.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.527+0000 7fd8d1d9b640 1 -- 172.21.15.5:0/1541997747 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc0ab980 con 0x7fd8d406c530 2023-07-14T13:09:37.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.527+0000 7fd8d359e640 1 -- 172.21.15.5:0/1541997747 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8d406c530 msgr2=0x7fd8d40af800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:37.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.527+0000 7fd8d359e640 1 --2- 172.21.15.5:0/1541997747 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8d406c530 0x7fd8d40af800 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc0097c0 tx=0x7fd8bc01c3f0 comp rx=0 tx=0).stop 2023-07-14T13:09:37.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.527+0000 7fd8d359e640 1 -- 172.21.15.5:0/1541997747 shutdown_connections 2023-07-14T13:09:37.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.527+0000 7fd8d359e640 1 --2- 172.21.15.5:0/1541997747 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8d406c530 0x7fd8d40af800 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:37.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.527+0000 7fd8d359e640 1 --2- 172.21.15.5:0/1541997747 >> v2:172.21.15.154:3300/0 conn(0x7fd8d406c160 0x7fd8d415cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:37.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.527+0000 7fd8d359e640 1 -- 172.21.15.5:0/1541997747 >> 172.21.15.5:0/1541997747 conn(0x7fd8d40ca800 msgr2=0x7fd8d40cac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:37.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.527+0000 7fd8d359e640 1 -- 172.21.15.5:0/1541997747 shutdown_connections 2023-07-14T13:09:37.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.527+0000 7fd8d359e640 1 -- 172.21.15.5:0/1541997747 wait complete. 2023-07-14T13:09:37.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.527+0000 7fd8d359e640 1 Processor -- start 2023-07-14T13:09:37.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.527+0000 7fd8d359e640 1 -- start start 2023-07-14T13:09:37.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.531+0000 7fd8d359e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d406c160 0x7fd8d414f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:37.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.531+0000 7fd8d359e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8d406c530 0x7fd8d40c28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:37.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.531+0000 7fd8d359e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8d40afd40 0x7fd8d40ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:37.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.531+0000 7fd8d359e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d40c3d50 con 0x7fd8d406c160 2023-07-14T13:09:37.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.531+0000 7fd8d359e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d40c31d0 con 0x7fd8d406c530 2023-07-14T13:09:37.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.531+0000 7fd8d359e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d40c34b0 con 0x7fd8d40afd40 2023-07-14T13:09:37.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.531+0000 7fd8d259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d406c160 0x7fd8d414f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:37.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.531+0000 7fd8d259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d406c160 0x7fd8d414f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33880/0 (socket says 172.21.15.5:33880) 2023-07-14T13:09:37.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.531+0000 7fd8d259c640 1 -- 172.21.15.5:0/4010373796 learned_addr learned my addr 172.21.15.5:0/4010373796 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:37.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.531+0000 7fd8d2d9d640 1 --2- 172.21.15.5:0/4010373796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8d40afd40 0x7fd8d40ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:37.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.531+0000 7fd8cbfff640 1 --2- 172.21.15.5:0/4010373796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8d406c530 0x7fd8d40c28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:37.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.531+0000 7fd8d259c640 1 -- 172.21.15.5:0/4010373796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8d40afd40 msgr2=0x7fd8d40ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:37.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.531+0000 7fd8d259c640 1 --2- 172.21.15.5:0/4010373796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8d40afd40 0x7fd8d40ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:37.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.531+0000 7fd8d259c640 1 -- 172.21.15.5:0/4010373796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8d406c530 msgr2=0x7fd8d40c28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:37.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.531+0000 7fd8d259c640 1 --2- 172.21.15.5:0/4010373796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8d406c530 0x7fd8d40c28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:37.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.531+0000 7fd8d259c640 1 -- 172.21.15.5:0/4010373796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c4009420 con 0x7fd8d406c160 2023-07-14T13:09:37.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.531+0000 7fd8d2d9d640 1 --2- 172.21.15.5:0/4010373796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8d40afd40 0x7fd8d40ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:37.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.531+0000 7fd8d259c640 1 --2- 172.21.15.5:0/4010373796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d406c160 0x7fd8d414f3b0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fd8c400ebe0 tx=0x7fd8c400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:37.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.531+0000 7fd8caffd640 1 -- 172.21.15.5:0/4010373796 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c400eee0 con 0x7fd8d406c160 2023-07-14T13:09:37.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.531+0000 7fd8caffd640 1 -- 172.21.15.5:0/4010373796 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c400cc30 con 0x7fd8d406c160 2023-07-14T13:09:37.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.531+0000 7fd8caffd640 1 -- 172.21.15.5:0/4010373796 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4013470 con 0x7fd8d406c160 2023-07-14T13:09:37.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.531+0000 7fd8d359e640 1 -- 172.21.15.5:0/4010373796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8bc009420 con 0x7fd8d406c160 2023-07-14T13:09:37.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.531+0000 7fd8d359e640 1 -- 172.21.15.5:0/4010373796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d40c3a70 con 0x7fd8d406c160 2023-07-14T13:09:37.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.531+0000 7fd8d359e640 1 -- 172.21.15.5:0/4010373796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d4158ba0 con 0x7fd8d406c160 2023-07-14T13:09:37.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.531+0000 7fd8caffd640 1 -- 172.21.15.5:0/4010373796 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd8c40135d0 con 0x7fd8d406c160 2023-07-14T13:09:37.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.535+0000 7fd8caffd640 1 --2- 172.21.15.5:0/4010373796 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fd8b40663a0 0x7fd8b4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:37.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.535+0000 7fd8caffd640 1 -- 172.21.15.5:0/4010373796 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6441+0+0 (secure 0 0 0) 0x7fd8c40843a0 con 0x7fd8d406c160 2023-07-14T13:09:37.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.535+0000 7fd8cbfff640 1 --2- 172.21.15.5:0/4010373796 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fd8b40663a0 0x7fd8b4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:37.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.535+0000 7fd8cbfff640 1 --2- 172.21.15.5:0/4010373796 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fd8b40663a0 0x7fd8b4068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc0ad000 tx=0x7fd8bc0a6000 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:37.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.539+0000 7fd8caffd640 1 -- 172.21.15.5:0/4010373796 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd8c4054f80 con 0x7fd8d406c160 2023-07-14T13:09:37.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:37.695+0000 7fd8d359e640 1 -- 172.21.15.5:0/4010373796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd8d4071020 con 0x7fd8d406c160 2023-07-14T13:09:38.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.351+0000 7fd8caffd640 1 -- 172.21.15.5:0/4010373796 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v102) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd8c4054b10 con 0x7fd8d406c160 2023-07-14T13:09:38.382 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-07-14T13:09:38.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.355+0000 7fd8d359e640 1 -- 172.21.15.5:0/4010373796 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fd8b40663a0 msgr2=0x7fd8b4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:38.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.355+0000 7fd8d359e640 1 --2- 172.21.15.5:0/4010373796 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fd8b40663a0 0x7fd8b4068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc0ad000 tx=0x7fd8bc0a6000 comp rx=0 tx=0).stop 2023-07-14T13:09:38.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.355+0000 7fd8d359e640 1 -- 172.21.15.5:0/4010373796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d406c160 msgr2=0x7fd8d414f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.355+0000 7fd8d359e640 1 --2- 172.21.15.5:0/4010373796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d406c160 0x7fd8d414f3b0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fd8c400ebe0 tx=0x7fd8c400c520 comp rx=0 tx=0).stop 2023-07-14T13:09:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.355+0000 7fd8d359e640 1 -- 172.21.15.5:0/4010373796 shutdown_connections 2023-07-14T13:09:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.355+0000 7fd8d359e640 1 --2- 172.21.15.5:0/4010373796 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fd8b40663a0 0x7fd8b4068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.355+0000 7fd8d359e640 1 --2- 172.21.15.5:0/4010373796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8d40afd40 0x7fd8d40ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.355+0000 7fd8d359e640 1 --2- 172.21.15.5:0/4010373796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8d406c530 0x7fd8d40c28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:38.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.355+0000 7fd8d359e640 1 --2- 172.21.15.5:0/4010373796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8d406c160 0x7fd8d414f3b0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:38.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.355+0000 7fd8d359e640 1 -- 172.21.15.5:0/4010373796 >> 172.21.15.5:0/4010373796 conn(0x7fd8d40ca800 msgr2=0x7fd8d4070910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:38.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.355+0000 7fd8d359e640 1 -- 172.21.15.5:0/4010373796 shutdown_connections 2023-07-14T13:09:38.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.355+0000 7fd8d359e640 1 -- 172.21.15.5:0/4010373796 wait complete. 2023-07-14T13:09:38.410 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-14T13:09:38.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.527+0000 7ff333a0b640 1 Processor -- start 2023-07-14T13:09:38.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.527+0000 7ff333a0b640 1 -- start start 2023-07-14T13:09:38.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.531+0000 7ff333a0b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff32c14f090 0x7ff32c0afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:38.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.531+0000 7ff333a0b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff32c06fa40 0x7ff32c06fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:38.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.531+0000 7ff333a0b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff32c06ba60 con 0x7ff32c069430 2023-07-14T13:09:38.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.531+0000 7ff333a0b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff32c14f460 con 0x7ff32c06fa40 2023-07-14T13:09:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.531+0000 7ff333a0b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c0cd060 con 0x7ff32c14f090 2023-07-14T13:09:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.531+0000 7ff330fa6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff32c06fa40 0x7ff32c06fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.531+0000 7ff330fa6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff32c06fa40 0x7ff32c06fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33886/0 (socket says 172.21.15.5:33886) 2023-07-14T13:09:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.531+0000 7ff330fa6640 1 -- 172.21.15.5:0/2507952601 learned_addr learned my addr 172.21.15.5:0/2507952601 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.531+0000 7ff3317a7640 1 --2- 172.21.15.5:0/2507952601 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff32c14f090 0x7ff32c0afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.531+0000 7ff330fa6640 1 -- 172.21.15.5:0/2507952601 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff32c14f090 msgr2=0x7ff32c0afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.531+0000 7ff330fa6640 1 --2- 172.21.15.5:0/2507952601 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff32c14f090 0x7ff32c0afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.531+0000 7ff330fa6640 1 -- 172.21.15.5:0/2507952601 >> v1:172.21.15.154:6789/0 conn(0x7ff32c069430 legacy=0x7ff32c069870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.531+0000 7ff330fa6640 1 -- 172.21.15.5:0/2507952601 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c0703b0 con 0x7ff32c06fa40 2023-07-14T13:09:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.531+0000 7ff3317a7640 1 --2- 172.21.15.5:0/2507952601 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff32c14f090 0x7ff32c0afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:09:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.535+0000 7ff330fa6640 1 --2- 172.21.15.5:0/2507952601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32c06fa40 0x7ff32c06fe70 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00bb10 tx=0x7ff31c01ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f90613dc1a6536 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:38.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.535+0000 7ff323fff640 1 -- 172.21.15.5:0/2507952601 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c0a79e0 con 0x7ff32c06fa40 2023-07-14T13:09:38.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.535+0000 7ff323fff640 1 -- 172.21.15.5:0/2507952601 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31c0a7b40 con 0x7ff32c06fa40 2023-07-14T13:09:38.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.535+0000 7ff323fff640 1 -- 172.21.15.5:0/2507952601 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c0af440 con 0x7ff32c06fa40 2023-07-14T13:09:38.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.535+0000 7ff333a0b640 1 -- 172.21.15.5:0/2507952601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32c06fa40 msgr2=0x7ff32c06fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:38.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.535+0000 7ff333a0b640 1 --2- 172.21.15.5:0/2507952601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32c06fa40 0x7ff32c06fe70 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00bb10 tx=0x7ff31c01ebd0 comp rx=0 tx=0).stop 2023-07-14T13:09:38.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.535+0000 7ff333a0b640 1 -- 172.21.15.5:0/2507952601 shutdown_connections 2023-07-14T13:09:38.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.535+0000 7ff333a0b640 1 --2- 172.21.15.5:0/2507952601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32c06fa40 0x7ff32c06fe70 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:38.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.535+0000 7ff333a0b640 1 --2- 172.21.15.5:0/2507952601 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff32c14f090 0x7ff32c0afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:38.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.535+0000 7ff333a0b640 1 -- 172.21.15.5:0/2507952601 >> 172.21.15.5:0/2507952601 conn(0x7ff32c0b0490 msgr2=0x7ff32c0b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:38.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.535+0000 7ff333a0b640 1 -- 172.21.15.5:0/2507952601 shutdown_connections 2023-07-14T13:09:38.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.535+0000 7ff333a0b640 1 -- 172.21.15.5:0/2507952601 wait complete. 2023-07-14T13:09:38.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.535+0000 7ff333a0b640 1 Processor -- start 2023-07-14T13:09:38.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.535+0000 7ff333a0b640 1 -- start start 2023-07-14T13:09:38.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.539+0000 7ff333a0b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff32c069430 0x7ff32c141190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:38.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.539+0000 7ff333a0b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32c06fa40 0x7ff32c15a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:38.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.539+0000 7ff333a0b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff32c14f090 0x7ff32c14a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:38.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.539+0000 7ff333a0b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c159640 con 0x7ff32c06fa40 2023-07-14T13:09:38.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.539+0000 7ff333a0b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c159890 con 0x7ff32c069430 2023-07-14T13:09:38.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.539+0000 7ff333a0b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c159b70 con 0x7ff32c14f090 2023-07-14T13:09:38.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.539+0000 7ff330fa6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32c06fa40 0x7ff32c15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:38.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.539+0000 7ff330fa6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32c06fa40 0x7ff32c15a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33900/0 (socket says 172.21.15.5:33900) 2023-07-14T13:09:38.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.539+0000 7ff330fa6640 1 -- 172.21.15.5:0/3376753527 learned_addr learned my addr 172.21.15.5:0/3376753527 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:38.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.539+0000 7ff331fa8640 1 --2- 172.21.15.5:0/3376753527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff32c14f090 0x7ff32c14a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:38.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.539+0000 7ff3317a7640 1 --2- 172.21.15.5:0/3376753527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff32c069430 0x7ff32c141190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:38.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.539+0000 7ff330fa6640 1 -- 172.21.15.5:0/3376753527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff32c14f090 msgr2=0x7ff32c14a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:38.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.539+0000 7ff330fa6640 1 --2- 172.21.15.5:0/3376753527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff32c14f090 0x7ff32c14a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:38.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.539+0000 7ff330fa6640 1 -- 172.21.15.5:0/3376753527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff32c069430 msgr2=0x7ff32c141190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:38.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.539+0000 7ff330fa6640 1 --2- 172.21.15.5:0/3376753527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff32c069430 0x7ff32c141190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:38.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.539+0000 7ff330fa6640 1 -- 172.21.15.5:0/3376753527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31c00b770 con 0x7ff32c06fa40 2023-07-14T13:09:38.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.539+0000 7ff330fa6640 1 --2- 172.21.15.5:0/3376753527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32c06fa40 0x7ff32c15a930 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00b2c0 tx=0x7ff31c01b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:38.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.539+0000 7ff321ffb640 1 -- 172.21.15.5:0/3376753527 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c0a79e0 con 0x7ff32c06fa40 2023-07-14T13:09:38.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.539+0000 7ff321ffb640 1 -- 172.21.15.5:0/3376753527 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31c0ba440 con 0x7ff32c06fa40 2023-07-14T13:09:38.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.539+0000 7ff321ffb640 1 -- 172.21.15.5:0/3376753527 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c0ba810 con 0x7ff32c06fa40 2023-07-14T13:09:38.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.539+0000 7ff333a0b640 1 -- 172.21.15.5:0/3376753527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff32c159e50 con 0x7ff32c06fa40 2023-07-14T13:09:38.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.539+0000 7ff333a0b640 1 -- 172.21.15.5:0/3376753527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff32c15a410 con 0x7ff32c06fa40 2023-07-14T13:09:38.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.539+0000 7ff333a0b640 1 -- 172.21.15.5:0/3376753527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff32c0678d0 con 0x7ff32c06fa40 2023-07-14T13:09:38.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.543+0000 7ff321ffb640 1 -- 172.21.15.5:0/3376753527 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff31c0b93e0 con 0x7ff32c06fa40 2023-07-14T13:09:38.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.543+0000 7ff321ffb640 1 --2- 172.21.15.5:0/3376753527 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7ff3100663a0 0x7ff310068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:38.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.543+0000 7ff321ffb640 1 -- 172.21.15.5:0/3376753527 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6027+0+0 (secure 0 0 0) 0x7ff31c11e7e0 con 0x7ff32c06fa40 2023-07-14T13:09:38.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.543+0000 7ff3317a7640 1 --2- 172.21.15.5:0/3376753527 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7ff3100663a0 0x7ff310068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:38.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.543+0000 7ff3317a7640 1 --2- 172.21.15.5:0/3376753527 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7ff3100663a0 0x7ff310068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff328006fd0 tx=0x7ff328008040 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:38.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.547+0000 7ff321ffb640 1 -- 172.21.15.5:0/3376753527 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff31c0ebb80 con 0x7ff32c06fa40 2023-07-14T13:09:38.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.699+0000 7ff333a0b640 1 -- 172.21.15.5:0/3376753527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7ff32c072ba0 con 0x7ff32c06fa40 2023-07-14T13:09:38.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.703+0000 7ff321ffb640 1 -- 172.21.15.5:0/3376753527 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v31) v1 ==== 120+0+0 (secure 0 0 0) 0x7ff31c0ef1a0 con 0x7ff32c06fa40 2023-07-14T13:09:38.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.707+0000 7ff333a0b640 1 -- 172.21.15.5:0/3376753527 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7ff3100663a0 msgr2=0x7ff310068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:38.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.707+0000 7ff333a0b640 1 --2- 172.21.15.5:0/3376753527 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7ff3100663a0 0x7ff310068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff328006fd0 tx=0x7ff328008040 comp rx=0 tx=0).stop 2023-07-14T13:09:38.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.707+0000 7ff333a0b640 1 -- 172.21.15.5:0/3376753527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32c06fa40 msgr2=0x7ff32c15a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:38.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.707+0000 7ff333a0b640 1 --2- 172.21.15.5:0/3376753527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32c06fa40 0x7ff32c15a930 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00b2c0 tx=0x7ff31c01b970 comp rx=0 tx=0).stop 2023-07-14T13:09:38.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.707+0000 7ff333a0b640 1 -- 172.21.15.5:0/3376753527 shutdown_connections 2023-07-14T13:09:38.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.707+0000 7ff333a0b640 1 --2- 172.21.15.5:0/3376753527 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7ff3100663a0 0x7ff310068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:38.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.707+0000 7ff333a0b640 1 --2- 172.21.15.5:0/3376753527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff32c14f090 0x7ff32c14a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:38.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.707+0000 7ff333a0b640 1 --2- 172.21.15.5:0/3376753527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff32c06fa40 0x7ff32c15a930 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:38.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.707+0000 7ff333a0b640 1 --2- 172.21.15.5:0/3376753527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff32c069430 0x7ff32c141190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:38.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.707+0000 7ff333a0b640 1 -- 172.21.15.5:0/3376753527 >> 172.21.15.5:0/3376753527 conn(0x7ff32c0b0490 msgr2=0x7ff32c143e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:38.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.707+0000 7ff333a0b640 1 -- 172.21.15.5:0/3376753527 shutdown_connections 2023-07-14T13:09:38.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.707+0000 7ff333a0b640 1 -- 172.21.15.5:0/3376753527 wait complete. 2023-07-14T13:09:38.757 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-14T13:09:38.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.871+0000 7f0f1dc7b640 1 Processor -- start 2023-07-14T13:09:38.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.871+0000 7f0f1dc7b640 1 -- start start 2023-07-14T13:09:38.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f1dc7b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0f180cd670 0x7f0f180cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:38.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f1dc7b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f180b08d0 con 0x7f0f18158df0 2023-07-14T13:09:38.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f1dc7b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f18159cb0 con 0x7f0f18156560 2023-07-14T13:09:38.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f1dc7b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f181599d0 con 0x7f0f180cd670 2023-07-14T13:09:38.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f17fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0f18158df0 0x7f0f1806bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:53386/0 (socket says 172.21.15.5:53386) 2023-07-14T13:09:38.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f17fff640 1 -- 172.21.15.5:0/397667167 learned_addr learned my addr 172.21.15.5:0/397667167 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:38.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f0ffff640 1 --2- 172.21.15.5:0/397667167 >> v2:172.21.15.154:3300/0 conn(0x7f0f180cd670 0x7f0f180cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:38.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f16ffd640 1 -- 172.21.15.5:0/397667167 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3001468694 0 0) 0x7f0f180b08d0 con 0x7f0f18158df0 2023-07-14T13:09:38.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f16ffd640 1 -- 172.21.15.5:0/397667167 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f04005740 con 0x7f0f18158df0 2023-07-14T13:09:38.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f16ffd640 1 -- 172.21.15.5:0/397667167 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3662158816 0 0) 0x7f0f04005740 con 0x7f0f18158df0 2023-07-14T13:09:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f16ffd640 1 -- 172.21.15.5:0/397667167 >> v2:172.21.15.154:3300/0 conn(0x7f0f180cd670 msgr2=0x7f0f180cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f16ffd640 1 --2- 172.21.15.5:0/397667167 >> v2:172.21.15.154:3300/0 conn(0x7f0f180cd670 0x7f0f180cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f16ffd640 1 -- 172.21.15.5:0/397667167 >> v1:172.21.15.154:6789/0 conn(0x7f0f18156560 legacy=0x7f0f180ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f16ffd640 1 -- 172.21.15.5:0/397667167 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f180ca900 con 0x7f0f18158df0 2023-07-14T13:09:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f16ffd640 1 -- 172.21.15.5:0/397667167 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f0f10001a00 con 0x7f0f18158df0 2023-07-14T13:09:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f16ffd640 1 -- 172.21.15.5:0/397667167 >> v1:172.21.15.5:6789/0 conn(0x7f0f18158df0 legacy=0x7f0f1806bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f16ffd640 1 --2- 172.21.15.5:0/397667167 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f04005b90 0x7f0f04005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f16ffd640 1 --2- 172.21.15.5:0/397667167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f040069e0 0x7f0f04006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f16ffd640 1 --2- 172.21.15.5:0/397667167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f04007390 0x7f0f0400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f16ffd640 1 -- 172.21.15.5:0/397667167 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f181599d0 con 0x7f0f04007390 2023-07-14T13:09:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f16ffd640 1 -- 172.21.15.5:0/397667167 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0400e210 con 0x7f0f040069e0 2023-07-14T13:09:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f16ffd640 1 -- 172.21.15.5:0/397667167 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0400e3d0 con 0x7f0f04005b90 2023-07-14T13:09:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f0ffff640 1 --2- 172.21.15.5:0/397667167 >> v2:172.21.15.154:3300/0 conn(0x7f0f180cd670 0x7f0f180cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:09:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f17fff640 1 --2- 172.21.15.5:0/397667167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f04007390 0x7f0f0400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f177fe640 1 --2- 172.21.15.5:0/397667167 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f04005b90 0x7f0f04005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f0ffff640 1 --2- 172.21.15.5:0/397667167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f040069e0 0x7f0f04006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f17fff640 1 -- 172.21.15.5:0/397667167 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f04005b90 msgr2=0x7f0f04005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f17fff640 1 --2- 172.21.15.5:0/397667167 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f04005b90 0x7f0f04005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:38.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f17fff640 1 -- 172.21.15.5:0/397667167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f040069e0 msgr2=0x7f0f04006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:38.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f17fff640 1 --2- 172.21.15.5:0/397667167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f040069e0 0x7f0f04006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:38.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f17fff640 1 -- 172.21.15.5:0/397667167 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f04005740 con 0x7f0f04007390 2023-07-14T13:09:38.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.875+0000 7f0f177fe640 1 --2- 172.21.15.5:0/397667167 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f04005b90 0x7f0f04005fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:38.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.879+0000 7f0f17fff640 1 -- 172.21.15.5:0/397667167 reap_dead start 2023-07-14T13:09:38.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.879+0000 7f0f17fff640 1 --2- 172.21.15.5:0/397667167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f04007390 0x7f0f0400dba0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000a830 tx=0x7f0f1001d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a8c9fac227426e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:38.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.879+0000 7f0f16ffd640 1 -- 172.21.15.5:0/397667167 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f100072d0 con 0x7f0f04007390 2023-07-14T13:09:38.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.879+0000 7f0f16ffd640 1 -- 172.21.15.5:0/397667167 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f100a8070 con 0x7f0f04007390 2023-07-14T13:09:38.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.879+0000 7f0f16ffd640 1 -- 172.21.15.5:0/397667167 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f100076b0 con 0x7f0f04007390 2023-07-14T13:09:38.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.879+0000 7f0f1dc7b640 1 -- 172.21.15.5:0/397667167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f04007390 msgr2=0x7f0f0400dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:38.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.879+0000 7f0f1dc7b640 1 --2- 172.21.15.5:0/397667167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f04007390 0x7f0f0400dba0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000a830 tx=0x7f0f1001d340 comp rx=0 tx=0).stop 2023-07-14T13:09:38.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.879+0000 7f0f1dc7b640 1 -- 172.21.15.5:0/397667167 shutdown_connections 2023-07-14T13:09:38.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.879+0000 7f0f1dc7b640 1 --2- 172.21.15.5:0/397667167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f04007390 0x7f0f0400dba0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:38.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.879+0000 7f0f1dc7b640 1 -- 172.21.15.5:0/397667167 >> 172.21.15.5:0/397667167 conn(0x7f0f180afac0 msgr2=0x7f0f180afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:38.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.879+0000 7f0f1dc7b640 1 -- 172.21.15.5:0/397667167 shutdown_connections 2023-07-14T13:09:38.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.879+0000 7f0f1dc7b640 1 -- 172.21.15.5:0/397667167 wait complete. 2023-07-14T13:09:38.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.883+0000 7f0f1dc7b640 1 Processor -- start 2023-07-14T13:09:38.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.883+0000 7f0f1dc7b640 1 -- start start 2023-07-14T13:09:38.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.883+0000 7f0f1dc7b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f04007390 0x7f0f180b2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:38.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.883+0000 7f0f1dc7b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f18151bd0 0x7f0f1814ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:38.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.883+0000 7f0f1dc7b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f180b17d0 0x7f0f180b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:38.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.883+0000 7f0f1dc7b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f181ecf60 con 0x7f0f04007390 2023-07-14T13:09:38.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.883+0000 7f0f1dc7b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f18153d90 con 0x7f0f180b17d0 2023-07-14T13:09:38.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.883+0000 7f0f1dc7b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f181504f0 con 0x7f0f18151bd0 2023-07-14T13:09:38.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.883+0000 7f0f177fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f04007390 0x7f0f180b2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:38.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.883+0000 7f0f177fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f04007390 0x7f0f180b2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33912/0 (socket says 172.21.15.5:33912) 2023-07-14T13:09:38.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.883+0000 7f0f177fe640 1 -- 172.21.15.5:0/625707722 learned_addr learned my addr 172.21.15.5:0/625707722 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:38.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.883+0000 7f0f0ffff640 1 --2- 172.21.15.5:0/625707722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f18151bd0 0x7f0f1814ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:38.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.883+0000 7f0f17fff640 1 --2- 172.21.15.5:0/625707722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f180b17d0 0x7f0f180b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:38.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.883+0000 7f0f177fe640 1 -- 172.21.15.5:0/625707722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f18151bd0 msgr2=0x7f0f1814ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:38.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.883+0000 7f0f177fe640 1 --2- 172.21.15.5:0/625707722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f18151bd0 0x7f0f1814ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:38.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.883+0000 7f0f177fe640 1 -- 172.21.15.5:0/625707722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f180b17d0 msgr2=0x7f0f180b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:38.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.883+0000 7f0f177fe640 1 --2- 172.21.15.5:0/625707722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f180b17d0 0x7f0f180b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:38.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.883+0000 7f0f177fe640 1 -- 172.21.15.5:0/625707722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f180b1d90 con 0x7f0f04007390 2023-07-14T13:09:38.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.883+0000 7f0f177fe640 1 --2- 172.21.15.5:0/625707722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f04007390 0x7f0f180b2c40 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800e500 tx=0x7f0f0800e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:38.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.883+0000 7f0f14ff9640 1 -- 172.21.15.5:0/625707722 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f080052e0 con 0x7f0f04007390 2023-07-14T13:09:38.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.883+0000 7f0f14ff9640 1 -- 172.21.15.5:0/625707722 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f08005440 con 0x7f0f04007390 2023-07-14T13:09:38.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.883+0000 7f0f14ff9640 1 -- 172.21.15.5:0/625707722 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f08003820 con 0x7f0f04007390 2023-07-14T13:09:38.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.883+0000 7f0f1dc7b640 1 -- 172.21.15.5:0/625707722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f180b2070 con 0x7f0f04007390 2023-07-14T13:09:38.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.883+0000 7f0f1dc7b640 1 -- 172.21.15.5:0/625707722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f1815b730 con 0x7f0f04007390 2023-07-14T13:09:38.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.883+0000 7f0f1dc7b640 1 -- 172.21.15.5:0/625707722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f1815b2b0 con 0x7f0f04007390 2023-07-14T13:09:38.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.887+0000 7f0f14ff9640 1 -- 172.21.15.5:0/625707722 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0f08003980 con 0x7f0f04007390 2023-07-14T13:09:38.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.887+0000 7f0f14ff9640 1 --2- 172.21.15.5:0/625707722 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f0ef80663a0 0x7f0ef8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:38.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.887+0000 7f0f14ff9640 1 -- 172.21.15.5:0/625707722 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6027+0+0 (secure 0 0 0) 0x7f0f08083a90 con 0x7f0f04007390 2023-07-14T13:09:38.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.887+0000 7f0f0ffff640 1 --2- 172.21.15.5:0/625707722 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f0ef80663a0 0x7f0ef8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:38.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.887+0000 7f0f0ffff640 1 --2- 172.21.15.5:0/625707722 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f0ef80663a0 0x7f0ef8068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0f180ca610 tx=0x7f0f00009190 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:38.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:38.891+0000 7f0f14ff9640 1 -- 172.21.15.5:0/625707722 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f0f1815b2b0 con 0x7f0f04007390 2023-07-14T13:09:39.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.047+0000 7f0f1dc7b640 1 -- 172.21.15.5:0/625707722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0f1815b2b0 con 0x7f0f04007390 2023-07-14T13:09:39.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.051+0000 7f0f14ff9640 1 -- 172.21.15.5:0/625707722 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v32) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0f1815b2b0 con 0x7f0f04007390 2023-07-14T13:09:39.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.055+0000 7f0f1dc7b640 1 -- 172.21.15.5:0/625707722 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f0ef80663a0 msgr2=0x7f0ef8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:39.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.055+0000 7f0f1dc7b640 1 --2- 172.21.15.5:0/625707722 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f0ef80663a0 0x7f0ef8068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0f180ca610 tx=0x7f0f00009190 comp rx=0 tx=0).stop 2023-07-14T13:09:39.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.055+0000 7f0f1dc7b640 1 -- 172.21.15.5:0/625707722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f04007390 msgr2=0x7f0f180b2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:39.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.055+0000 7f0f1dc7b640 1 --2- 172.21.15.5:0/625707722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f04007390 0x7f0f180b2c40 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800e500 tx=0x7f0f0800e9c0 comp rx=0 tx=0).stop 2023-07-14T13:09:39.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.055+0000 7f0f1dc7b640 1 -- 172.21.15.5:0/625707722 shutdown_connections 2023-07-14T13:09:39.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.055+0000 7f0f1dc7b640 1 --2- 172.21.15.5:0/625707722 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f0ef80663a0 0x7f0ef8068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:39.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.055+0000 7f0f1dc7b640 1 --2- 172.21.15.5:0/625707722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f180b17d0 0x7f0f180b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:39.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.055+0000 7f0f1dc7b640 1 --2- 172.21.15.5:0/625707722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f18151bd0 0x7f0f1814ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:39.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.055+0000 7f0f1dc7b640 1 --2- 172.21.15.5:0/625707722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f04007390 0x7f0f180b2c40 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:39.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.055+0000 7f0f1dc7b640 1 -- 172.21.15.5:0/625707722 >> 172.21.15.5:0/625707722 conn(0x7f0f180afac0 msgr2=0x7f0f180ada10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:39.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.055+0000 7f0f1dc7b640 1 -- 172.21.15.5:0/625707722 shutdown_connections 2023-07-14T13:09:39.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.055+0000 7f0f1dc7b640 1 -- 172.21.15.5:0/625707722 wait complete. 2023-07-14T13:09:39.104 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-14T13:09:39.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.223+0000 7ff562774640 1 Processor -- start 2023-07-14T13:09:39.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.223+0000 7ff562774640 1 -- start start 2023-07-14T13:09:39.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.223+0000 7ff562774640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff55c1601f0 0x7ff55c0cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:39.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.223+0000 7ff562774640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff55c0cd1f0 con 0x7ff55c06a910 2023-07-14T13:09:39.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.223+0000 7ff562774640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff55c0cd4d0 con 0x7ff55c06a540 2023-07-14T13:09:39.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.223+0000 7ff562774640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff55c0cd7b0 con 0x7ff55c1601f0 2023-07-14T13:09:39.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.227+0000 7ff55b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff55c1601f0 0x7ff55c0cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:39.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.227+0000 7ff560d11640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff55c06a910 0x7ff55c0d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56566/0 (socket says 172.21.15.5:56566) 2023-07-14T13:09:39.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.227+0000 7ff560d11640 1 -- 172.21.15.5:0/1993921168 learned_addr learned my addr 172.21.15.5:0/1993921168 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:39.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.227+0000 7ff55b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff55c1601f0 0x7ff55c0cdcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48368/0 (socket says 172.21.15.5:48368) 2023-07-14T13:09:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.227+0000 7ff55b7fe640 1 -- 172.21.15.5:0/1993921168 >> v1:172.21.15.154:6789/0 conn(0x7ff55c06a540 legacy=0x7ff55c0cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.227+0000 7ff55b7fe640 1 -- 172.21.15.5:0/1993921168 >> v1:172.21.15.5:6789/0 conn(0x7ff55c06a910 legacy=0x7ff55c0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.227+0000 7ff55b7fe640 1 -- 172.21.15.5:0/1993921168 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55c0cfe40 con 0x7ff55c1601f0 2023-07-14T13:09:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.227+0000 7ff55affd640 1 -- 172.21.15.5:0/1993921168 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426845080 0 0) 0x7ff55c0cd1f0 con 0x7ff55c06a910 2023-07-14T13:09:39.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.227+0000 7ff55b7fe640 1 --2- 172.21.15.5:0/1993921168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff55c1601f0 0x7ff55c0cdcd0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7ff5500097c0 tx=0x7ff55001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d48ab0906a1c4b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.227+0000 7ff55affd640 1 -- 172.21.15.5:0/1993921168 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5500ad680 con 0x7ff55c1601f0 2023-07-14T13:09:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.227+0000 7ff55affd640 1 -- 172.21.15.5:0/1993921168 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5500ad7e0 con 0x7ff55c1601f0 2023-07-14T13:09:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.227+0000 7ff55affd640 1 -- 172.21.15.5:0/1993921168 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5500adb70 con 0x7ff55c1601f0 2023-07-14T13:09:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.231+0000 7ff562774640 1 -- 172.21.15.5:0/1993921168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff55c1601f0 msgr2=0x7ff55c0cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.231+0000 7ff562774640 1 --2- 172.21.15.5:0/1993921168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff55c1601f0 0x7ff55c0cdcd0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7ff5500097c0 tx=0x7ff55001c360 comp rx=0 tx=0).stop 2023-07-14T13:09:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.231+0000 7ff562774640 1 -- 172.21.15.5:0/1993921168 shutdown_connections 2023-07-14T13:09:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.231+0000 7ff562774640 1 --2- 172.21.15.5:0/1993921168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff55c1601f0 0x7ff55c0cdcd0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:39.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.231+0000 7ff562774640 1 -- 172.21.15.5:0/1993921168 >> 172.21.15.5:0/1993921168 conn(0x7ff55c099490 msgr2=0x7ff55c089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:39.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.231+0000 7ff562774640 1 -- 172.21.15.5:0/1993921168 shutdown_connections 2023-07-14T13:09:39.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.231+0000 7ff562774640 1 -- 172.21.15.5:0/1993921168 wait complete. 2023-07-14T13:09:39.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.231+0000 7ff562774640 1 Processor -- start 2023-07-14T13:09:39.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.231+0000 7ff562774640 1 -- start start 2023-07-14T13:09:39.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.231+0000 7ff562774640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff55c06a540 0x7ff55c14b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.231+0000 7ff562774640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff55c06a910 0x7ff55c14fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.231+0000 7ff562774640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff55c1601f0 0x7ff55c1f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.231+0000 7ff562774640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c1f5690 con 0x7ff55c06a540 2023-07-14T13:09:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.231+0000 7ff562774640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c1f5970 con 0x7ff55c06a910 2023-07-14T13:09:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.231+0000 7ff562774640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c1f5c50 con 0x7ff55c1601f0 2023-07-14T13:09:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.231+0000 7ff55bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff55c06a540 0x7ff55c14b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.231+0000 7ff55bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff55c06a540 0x7ff55c14b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48372/0 (socket says 172.21.15.5:48372) 2023-07-14T13:09:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.231+0000 7ff55bfff640 1 -- 172.21.15.5:0/620407428 learned_addr learned my addr 172.21.15.5:0/620407428 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:39.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.235+0000 7ff55bfff640 1 -- 172.21.15.5:0/620407428 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff55c1601f0 msgr2=0x7ff55c1f4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:39.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.235+0000 7ff55b7fe640 1 --2- 172.21.15.5:0/620407428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff55c06a910 0x7ff55c14fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:39.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.235+0000 7ff560d11640 1 --2- 172.21.15.5:0/620407428 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff55c1601f0 0x7ff55c1f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:39.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.235+0000 7ff55bfff640 1 --2- 172.21.15.5:0/620407428 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff55c1601f0 0x7ff55c1f4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:39.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.235+0000 7ff55bfff640 1 -- 172.21.15.5:0/620407428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff55c06a910 msgr2=0x7ff55c14fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:39.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.235+0000 7ff55bfff640 1 --2- 172.21.15.5:0/620407428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff55c06a910 0x7ff55c14fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:39.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.235+0000 7ff55bfff640 1 -- 172.21.15.5:0/620407428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff550009420 con 0x7ff55c06a540 2023-07-14T13:09:39.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.235+0000 7ff560d11640 1 --2- 172.21.15.5:0/620407428 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff55c1601f0 0x7ff55c1f4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:09:39.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.235+0000 7ff55b7fe640 1 --2- 172.21.15.5:0/620407428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff55c06a910 0x7ff55c14fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:09:39.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.235+0000 7ff55bfff640 1 --2- 172.21.15.5:0/620407428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff55c06a540 0x7ff55c14b0f0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7ff54c00c400 tx=0x7ff54c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:39.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.235+0000 7ff558ff9640 1 -- 172.21.15.5:0/620407428 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c0052d0 con 0x7ff55c06a540 2023-07-14T13:09:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.235+0000 7ff558ff9640 1 -- 172.21.15.5:0/620407428 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54c005430 con 0x7ff55c06a540 2023-07-14T13:09:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.235+0000 7ff558ff9640 1 -- 172.21.15.5:0/620407428 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c003890 con 0x7ff55c06a540 2023-07-14T13:09:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.235+0000 7ff562774640 1 -- 172.21.15.5:0/620407428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff55c159550 con 0x7ff55c06a540 2023-07-14T13:09:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.235+0000 7ff562774640 1 -- 172.21.15.5:0/620407428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff55c150410 con 0x7ff55c06a540 2023-07-14T13:09:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.235+0000 7ff562774640 1 -- 172.21.15.5:0/620407428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff55c159a70 con 0x7ff55c06a540 2023-07-14T13:09:39.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.235+0000 7ff558ff9640 1 -- 172.21.15.5:0/620407428 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff54c0039f0 con 0x7ff55c06a540 2023-07-14T13:09:39.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.239+0000 7ff558ff9640 1 --2- 172.21.15.5:0/620407428 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7ff5480663a0 0x7ff548068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:39.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.239+0000 7ff558ff9640 1 -- 172.21.15.5:0/620407428 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6027+0+0 (secure 0 0 0) 0x7ff54c083500 con 0x7ff55c06a540 2023-07-14T13:09:39.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.239+0000 7ff55b7fe640 1 --2- 172.21.15.5:0/620407428 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7ff5480663a0 0x7ff548068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:39.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.239+0000 7ff55b7fe640 1 --2- 172.21.15.5:0/620407428 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7ff5480663a0 0x7ff548068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff5500af000 tx=0x7ff5500a7000 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:39.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.243+0000 7ff558ff9640 1 -- 172.21.15.5:0/620407428 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff55c159a70 con 0x7ff55c06a540 2023-07-14T13:09:39.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.399+0000 7ff562774640 1 -- 172.21.15.5:0/620407428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7ff55c0678d0 con 0x7ff55c06a540 2023-07-14T13:09:39.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.403+0000 7ff558ff9640 1 -- 172.21.15.5:0/620407428 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v33) v1 ==== 115+0+0 (secure 0 0 0) 0x7ff54c0507f0 con 0x7ff55c06a540 2023-07-14T13:09:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.407+0000 7ff562774640 1 -- 172.21.15.5:0/620407428 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7ff5480663a0 msgr2=0x7ff548068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.407+0000 7ff562774640 1 --2- 172.21.15.5:0/620407428 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7ff5480663a0 0x7ff548068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff5500af000 tx=0x7ff5500a7000 comp rx=0 tx=0).stop 2023-07-14T13:09:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.407+0000 7ff562774640 1 -- 172.21.15.5:0/620407428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff55c06a540 msgr2=0x7ff55c14b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.407+0000 7ff562774640 1 --2- 172.21.15.5:0/620407428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff55c06a540 0x7ff55c14b0f0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7ff54c00c400 tx=0x7ff54c00c8c0 comp rx=0 tx=0).stop 2023-07-14T13:09:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.407+0000 7ff562774640 1 -- 172.21.15.5:0/620407428 shutdown_connections 2023-07-14T13:09:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.407+0000 7ff562774640 1 --2- 172.21.15.5:0/620407428 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7ff5480663a0 0x7ff548068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.407+0000 7ff562774640 1 --2- 172.21.15.5:0/620407428 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff55c1601f0 0x7ff55c1f4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:39.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.407+0000 7ff562774640 1 --2- 172.21.15.5:0/620407428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff55c06a910 0x7ff55c14fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.407+0000 7ff562774640 1 --2- 172.21.15.5:0/620407428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff55c06a540 0x7ff55c14b0f0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.407+0000 7ff562774640 1 -- 172.21.15.5:0/620407428 >> 172.21.15.5:0/620407428 conn(0x7ff55c099490 msgr2=0x7ff55c0cc600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.407+0000 7ff562774640 1 -- 172.21.15.5:0/620407428 shutdown_connections 2023-07-14T13:09:39.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.407+0000 7ff562774640 1 -- 172.21.15.5:0/620407428 wait complete. 2023-07-14T13:09:39.456 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-07-14T13:09:39.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.567+0000 7fb9f8818640 1 Processor -- start 2023-07-14T13:09:39.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.571+0000 7fb9f8818640 1 -- start start 2023-07-14T13:09:39.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.571+0000 7fb9f8818640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb9f406b1e0 0x7fb9f40c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:39.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.571+0000 7fb9f8818640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9f40c21f0 0x7fb9f40cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:39.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.571+0000 7fb9f8818640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f40cac70 con 0x7fb9f4070b70 2023-07-14T13:09:39.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.571+0000 7fb9f8818640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f40ca060 con 0x7fb9f406b1e0 2023-07-14T13:09:39.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.571+0000 7fb9f8818640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f40ca340 con 0x7fb9f40c21f0 2023-07-14T13:09:39.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.571+0000 7fb9ebfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb9f406b1e0 0x7fb9f40c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:39.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.571+0000 7fb9ebfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb9f406b1e0 0x7fb9f40c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48384/0 (socket says 172.21.15.5:48384) 2023-07-14T13:09:39.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.571+0000 7fb9ebfff640 1 -- 172.21.15.5:0/3172435492 learned_addr learned my addr 172.21.15.5:0/3172435492 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:39.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.571+0000 7fb9f259c640 1 --1- 172.21.15.5:0/3172435492 >> v1:172.21.15.154:6789/0 conn(0x7fb9f4070b70 0x7fb9f4070f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:46164/0 (socket says 172.21.15.5:46164) 2023-07-14T13:09:39.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.571+0000 7fb9f2d9d640 1 --2- 172.21.15.5:0/3172435492 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9f40c21f0 0x7fb9f40cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:39.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.571+0000 7fb9ebfff640 1 -- 172.21.15.5:0/3172435492 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9f40c21f0 msgr2=0x7fb9f40cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:39.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.571+0000 7fb9ebfff640 1 --2- 172.21.15.5:0/3172435492 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9f40c21f0 0x7fb9f40cb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:39.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.571+0000 7fb9ebfff640 1 -- 172.21.15.5:0/3172435492 >> v1:172.21.15.154:6789/0 conn(0x7fb9f4070b70 legacy=0x7fb9f4070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:39.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.571+0000 7fb9ebfff640 1 -- 172.21.15.5:0/3172435492 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f40ca620 con 0x7fb9f406b1e0 2023-07-14T13:09:39.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.575+0000 7fb9ebfff640 1 --2- 172.21.15.5:0/3172435492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f406b1e0 0x7fb9f40c1cb0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009870 tx=0x7fb9dc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80244d879e2f9f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:39.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.575+0000 7fb9f1d9b640 1 -- 172.21.15.5:0/3172435492 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc0a95f0 con 0x7fb9f406b1e0 2023-07-14T13:09:39.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.575+0000 7fb9f1d9b640 1 -- 172.21.15.5:0/3172435492 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc0a9750 con 0x7fb9f406b1e0 2023-07-14T13:09:39.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.575+0000 7fb9f1d9b640 1 -- 172.21.15.5:0/3172435492 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc0a9ae0 con 0x7fb9f406b1e0 2023-07-14T13:09:39.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.575+0000 7fb9f8818640 1 -- 172.21.15.5:0/3172435492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f406b1e0 msgr2=0x7fb9f40c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:39.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.575+0000 7fb9f8818640 1 --2- 172.21.15.5:0/3172435492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f406b1e0 0x7fb9f40c1cb0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009870 tx=0x7fb9dc01c510 comp rx=0 tx=0).stop 2023-07-14T13:09:39.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.575+0000 7fb9f8818640 1 -- 172.21.15.5:0/3172435492 shutdown_connections 2023-07-14T13:09:39.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.575+0000 7fb9f8818640 1 --2- 172.21.15.5:0/3172435492 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9f40c21f0 0x7fb9f40cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:39.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.575+0000 7fb9f8818640 1 --2- 172.21.15.5:0/3172435492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f406b1e0 0x7fb9f40c1cb0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:39.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.575+0000 7fb9f8818640 1 -- 172.21.15.5:0/3172435492 >> 172.21.15.5:0/3172435492 conn(0x7fb9f40afcf0 msgr2=0x7fb9f40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:39.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.575+0000 7fb9f8818640 1 -- 172.21.15.5:0/3172435492 shutdown_connections 2023-07-14T13:09:39.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.575+0000 7fb9f8818640 1 -- 172.21.15.5:0/3172435492 wait complete. 2023-07-14T13:09:39.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.575+0000 7fb9f8818640 1 Processor -- start 2023-07-14T13:09:39.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.579+0000 7fb9f8818640 1 -- start start 2023-07-14T13:09:39.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.579+0000 7fb9f8818640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f406b1e0 0x7fb9f4163a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:39.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.579+0000 7fb9f8818640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9f4070b70 0x7fb9f414d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:39.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.579+0000 7fb9f8818640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9f40c21f0 0x7fb9f40ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:39.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.579+0000 7fb9f8818640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f414f5f0 con 0x7fb9f406b1e0 2023-07-14T13:09:39.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.579+0000 7fb9f8818640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f414f070 con 0x7fb9f4070b70 2023-07-14T13:09:39.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.579+0000 7fb9f8818640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f414f310 con 0x7fb9f40c21f0 2023-07-14T13:09:39.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.579+0000 7fb9f259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f406b1e0 0x7fb9f4163a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:39.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.579+0000 7fb9f259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f406b1e0 0x7fb9f4163a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48386/0 (socket says 172.21.15.5:48386) 2023-07-14T13:09:39.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.579+0000 7fb9f259c640 1 -- 172.21.15.5:0/1335346307 learned_addr learned my addr 172.21.15.5:0/1335346307 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:39.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.579+0000 7fb9ebfff640 1 --2- 172.21.15.5:0/1335346307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9f4070b70 0x7fb9f414d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:39.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.579+0000 7fb9f2d9d640 1 --2- 172.21.15.5:0/1335346307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9f40c21f0 0x7fb9f40ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:39.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.579+0000 7fb9f259c640 1 -- 172.21.15.5:0/1335346307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9f40c21f0 msgr2=0x7fb9f40ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:39.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.579+0000 7fb9f259c640 1 --2- 172.21.15.5:0/1335346307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9f40c21f0 0x7fb9f40ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:39.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.579+0000 7fb9f259c640 1 -- 172.21.15.5:0/1335346307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9f4070b70 msgr2=0x7fb9f414d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:39.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.579+0000 7fb9f259c640 1 --2- 172.21.15.5:0/1335346307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9f4070b70 0x7fb9f414d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:39.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.579+0000 7fb9f259c640 1 -- 172.21.15.5:0/1335346307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc0094d0 con 0x7fb9f406b1e0 2023-07-14T13:09:39.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.579+0000 7fb9f259c640 1 --2- 172.21.15.5:0/1335346307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f406b1e0 0x7fb9f4163a90 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fb9e400c490 tx=0x7fb9e400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:39.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.579+0000 7fb9eaffd640 1 -- 172.21.15.5:0/1335346307 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4007480 con 0x7fb9f406b1e0 2023-07-14T13:09:39.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.579+0000 7fb9eaffd640 1 -- 172.21.15.5:0/1335346307 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e40075e0 con 0x7fb9f406b1e0 2023-07-14T13:09:39.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.579+0000 7fb9eaffd640 1 -- 172.21.15.5:0/1335346307 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4004a10 con 0x7fb9f406b1e0 2023-07-14T13:09:39.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.579+0000 7fb9f8818640 1 -- 172.21.15.5:0/1335346307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f414fa40 con 0x7fb9f406b1e0 2023-07-14T13:09:39.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.579+0000 7fb9f8818640 1 -- 172.21.15.5:0/1335346307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f414e5a0 con 0x7fb9f406b1e0 2023-07-14T13:09:39.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.579+0000 7fb9f8818640 1 -- 172.21.15.5:0/1335346307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f40678d0 con 0x7fb9f406b1e0 2023-07-14T13:09:39.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.583+0000 7fb9eaffd640 1 -- 172.21.15.5:0/1335346307 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb9e4004b70 con 0x7fb9f406b1e0 2023-07-14T13:09:39.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.583+0000 7fb9eaffd640 1 --2- 172.21.15.5:0/1335346307 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fb9d40663a0 0x7fb9d4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:39.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.583+0000 7fb9eaffd640 1 -- 172.21.15.5:0/1335346307 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6027+0+0 (secure 0 0 0) 0x7fb9e4082ff0 con 0x7fb9f406b1e0 2023-07-14T13:09:39.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.583+0000 7fb9ebfff640 1 --2- 172.21.15.5:0/1335346307 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fb9d40663a0 0x7fb9d4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:39.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.583+0000 7fb9ebfff640 1 --2- 172.21.15.5:0/1335346307 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fb9d40663a0 0x7fb9d4068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0ae000 tx=0x7fb9dc0b3040 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:39.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.587+0000 7fb9eaffd640 1 -- 172.21.15.5:0/1335346307 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb9e40b3720 con 0x7fb9f406b1e0 2023-07-14T13:09:39.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:39.795+0000 7fb9f8818640 1 -- 172.21.15.5:0/1335346307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7fb9f4066810 con 0x7fb9f406b1e0 2023-07-14T13:09:40.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.355+0000 7fb9eaffd640 1 -- 172.21.15.5:0/1335346307 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v637) v1 ==== 166+0+0 (secure 0 0 0) 0x7fb9e40180e0 con 0x7fb9f406b1e0 2023-07-14T13:09:40.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.355+0000 7fb9f8818640 1 -- 172.21.15.5:0/1335346307 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fb9d40663a0 msgr2=0x7fb9d4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:40.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.355+0000 7fb9f8818640 1 --2- 172.21.15.5:0/1335346307 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fb9d40663a0 0x7fb9d4068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0ae000 tx=0x7fb9dc0b3040 comp rx=0 tx=0).stop 2023-07-14T13:09:40.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.355+0000 7fb9f8818640 1 -- 172.21.15.5:0/1335346307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f406b1e0 msgr2=0x7fb9f4163a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:40.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.355+0000 7fb9f8818640 1 --2- 172.21.15.5:0/1335346307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f406b1e0 0x7fb9f4163a90 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fb9e400c490 tx=0x7fb9e400c950 comp rx=0 tx=0).stop 2023-07-14T13:09:40.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.355+0000 7fb9f8818640 1 -- 172.21.15.5:0/1335346307 shutdown_connections 2023-07-14T13:09:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.355+0000 7fb9f8818640 1 --2- 172.21.15.5:0/1335346307 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fb9d40663a0 0x7fb9d4068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.355+0000 7fb9f8818640 1 --2- 172.21.15.5:0/1335346307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9f40c21f0 0x7fb9f40ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.355+0000 7fb9f8818640 1 --2- 172.21.15.5:0/1335346307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9f4070b70 0x7fb9f414d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.355+0000 7fb9f8818640 1 --2- 172.21.15.5:0/1335346307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9f406b1e0 0x7fb9f4163a90 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.355+0000 7fb9f8818640 1 -- 172.21.15.5:0/1335346307 >> 172.21.15.5:0/1335346307 conn(0x7fb9f40afcf0 msgr2=0x7fb9f4159050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.355+0000 7fb9f8818640 1 -- 172.21.15.5:0/1335346307 shutdown_connections 2023-07-14T13:09:40.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.355+0000 7fb9f8818640 1 -- 172.21.15.5:0/1335346307 wait complete. 2023-07-14T13:09:40.407 INFO:tasks.cephfs_test_runner:Test listing snap schedules on a non-existing filesystem path failure ... ok 2023-07-14T13:09:40.408 INFO:tasks.cephfs_test_runner:Starting test: test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-14T13:09:40.408 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-07-14T13:09:40.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.523+0000 7f669fed8640 1 Processor -- start 2023-07-14T13:09:40.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.523+0000 7f669fed8640 1 -- start start 2023-07-14T13:09:40.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.527+0000 7f669fed8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6698158ce0 0x7f6698070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:40.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.527+0000 7f669fed8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f66980c8ad0 0x7f66980c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:40.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.527+0000 7f669fed8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66980cc700 con 0x7f66980c9560 2023-07-14T13:09:40.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.527+0000 7f669fed8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66980c99e0 con 0x7f66980c8ad0 2023-07-14T13:09:40.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.527+0000 7f669fed8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66980b0ff0 con 0x7f6698158ce0 2023-07-14T13:09:40.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.527+0000 7f669d473640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f66980c8ad0 0x7f66980c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:40.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.527+0000 7f669d473640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f66980c8ad0 0x7f66980c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48402/0 (socket says 172.21.15.5:48402) 2023-07-14T13:09:40.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.527+0000 7f669d473640 1 -- 172.21.15.5:0/1823902068 learned_addr learned my addr 172.21.15.5:0/1823902068 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:40.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.527+0000 7f669dc74640 1 --2- 172.21.15.5:0/1823902068 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6698158ce0 0x7f6698070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:40.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.527+0000 7f669d473640 1 -- 172.21.15.5:0/1823902068 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6698158ce0 msgr2=0x7f6698070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:40.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.527+0000 7f669d473640 1 --2- 172.21.15.5:0/1823902068 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6698158ce0 0x7f6698070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:40.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.527+0000 7f669d473640 1 -- 172.21.15.5:0/1823902068 >> v1:172.21.15.5:6789/0 conn(0x7f66980c9560 legacy=0x7f66980cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:40.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.527+0000 7f669d473640 1 -- 172.21.15.5:0/1823902068 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6698070c80 con 0x7f66980c8ad0 2023-07-14T13:09:40.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.527+0000 7f669cc72640 1 -- 172.21.15.5:0/1823902068 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601257590 0 0) 0x7f66980cc700 con 0x7f66980c9560 2023-07-14T13:09:40.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.531+0000 7f669d473640 1 --2- 172.21.15.5:0/1823902068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66980c8ad0 0x7f66980c9020 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f6688009870 tx=0x7f668801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2434db27036cf6b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:40.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.531+0000 7f669cc72640 1 -- 172.21.15.5:0/1823902068 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66980cba20 con 0x7f66980c8ad0 2023-07-14T13:09:40.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.531+0000 7f669cc72640 1 -- 172.21.15.5:0/1823902068 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66880ab5f0 con 0x7f66980c8ad0 2023-07-14T13:09:40.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.531+0000 7f669cc72640 1 -- 172.21.15.5:0/1823902068 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66880ab980 con 0x7f66980c8ad0 2023-07-14T13:09:40.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.531+0000 7f669fed8640 1 -- 172.21.15.5:0/1823902068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66980c8ad0 msgr2=0x7f66980c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:40.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.531+0000 7f669fed8640 1 --2- 172.21.15.5:0/1823902068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66980c8ad0 0x7f66980c9020 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f6688009870 tx=0x7f668801c3f0 comp rx=0 tx=0).stop 2023-07-14T13:09:40.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.531+0000 7f669fed8640 1 -- 172.21.15.5:0/1823902068 shutdown_connections 2023-07-14T13:09:40.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.531+0000 7f669fed8640 1 --2- 172.21.15.5:0/1823902068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66980c8ad0 0x7f66980c9020 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:40.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.531+0000 7f669fed8640 1 --2- 172.21.15.5:0/1823902068 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6698158ce0 0x7f6698070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:40.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.531+0000 7f669fed8640 1 -- 172.21.15.5:0/1823902068 >> 172.21.15.5:0/1823902068 conn(0x7f66980afcf0 msgr2=0x7f66980b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:40.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.531+0000 7f669fed8640 1 -- 172.21.15.5:0/1823902068 shutdown_connections 2023-07-14T13:09:40.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.531+0000 7f669fed8640 1 -- 172.21.15.5:0/1823902068 wait complete. 2023-07-14T13:09:40.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.531+0000 7f669fed8640 1 Processor -- start 2023-07-14T13:09:40.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.531+0000 7f669fed8640 1 -- start start 2023-07-14T13:09:40.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.531+0000 7f669fed8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66980c8ad0 0x7f66980b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:40.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.531+0000 7f669fed8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66980c9560 0x7f66981f1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:40.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.531+0000 7f669fed8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6698158ce0 0x7f669814dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:40.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.531+0000 7f669fed8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669814e850 con 0x7f66980c8ad0 2023-07-14T13:09:40.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.531+0000 7f669fed8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66981f26c0 con 0x7f66980c9560 2023-07-14T13:09:40.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.531+0000 7f669fed8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66981f29a0 con 0x7f6698158ce0 2023-07-14T13:09:40.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.535+0000 7f669dc74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66980c8ad0 0x7f66980b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:40.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.535+0000 7f669dc74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66980c8ad0 0x7f66980b1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48416/0 (socket says 172.21.15.5:48416) 2023-07-14T13:09:40.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.535+0000 7f669dc74640 1 -- 172.21.15.5:0/3170784174 learned_addr learned my addr 172.21.15.5:0/3170784174 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:40.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.535+0000 7f669d473640 1 --2- 172.21.15.5:0/3170784174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66980c9560 0x7f66981f1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:40.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.535+0000 7f669e475640 1 --2- 172.21.15.5:0/3170784174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6698158ce0 0x7f669814dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:40.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.535+0000 7f669dc74640 1 -- 172.21.15.5:0/3170784174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6698158ce0 msgr2=0x7f669814dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:40.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.535+0000 7f669dc74640 1 --2- 172.21.15.5:0/3170784174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6698158ce0 0x7f669814dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:40.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.535+0000 7f669dc74640 1 -- 172.21.15.5:0/3170784174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66980c9560 msgr2=0x7f66981f1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:40.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.535+0000 7f669dc74640 1 --2- 172.21.15.5:0/3170784174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66980c9560 0x7f66981f1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:40.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.535+0000 7f669dc74640 1 -- 172.21.15.5:0/3170784174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66880094d0 con 0x7f66980c8ad0 2023-07-14T13:09:40.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.535+0000 7f669d473640 1 --2- 172.21.15.5:0/3170784174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66980c9560 0x7f66981f1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:40.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.535+0000 7f669dc74640 1 --2- 172.21.15.5:0/3170784174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66980c8ad0 0x7f66980b1920 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f669400d5f0 tx=0x7f669400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:40.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.535+0000 7f668e7fc640 1 -- 172.21.15.5:0/3170784174 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66940125f0 con 0x7f66980c8ad0 2023-07-14T13:09:40.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.535+0000 7f668e7fc640 1 -- 172.21.15.5:0/3170784174 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6694012750 con 0x7f66980c8ad0 2023-07-14T13:09:40.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.535+0000 7f668e7fc640 1 -- 172.21.15.5:0/3170784174 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6694012ae0 con 0x7f66980c8ad0 2023-07-14T13:09:40.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.535+0000 7f669fed8640 1 -- 172.21.15.5:0/3170784174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669814eac0 con 0x7f66980c8ad0 2023-07-14T13:09:40.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.535+0000 7f669fed8640 1 -- 172.21.15.5:0/3170784174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66981f2c80 con 0x7f66980c8ad0 2023-07-14T13:09:40.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.535+0000 7f669fed8640 1 -- 172.21.15.5:0/3170784174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66980ca1a0 con 0x7f66980c8ad0 2023-07-14T13:09:40.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.535+0000 7f668e7fc640 1 -- 172.21.15.5:0/3170784174 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6694012c40 con 0x7f66980c8ad0 2023-07-14T13:09:40.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.535+0000 7f668e7fc640 1 --2- 172.21.15.5:0/3170784174 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f667c0663a0 0x7f667c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:40.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.539+0000 7f668e7fc640 1 -- 172.21.15.5:0/3170784174 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6027+0+0 (secure 0 0 0) 0x7f6694084360 con 0x7f66980c8ad0 2023-07-14T13:09:40.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.539+0000 7f669d473640 1 --2- 172.21.15.5:0/3170784174 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f667c0663a0 0x7f667c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:40.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.539+0000 7f669d473640 1 --2- 172.21.15.5:0/3170784174 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f667c0663a0 0x7f667c068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f66880af000 tx=0x7f66880a7000 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:40.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.539+0000 7f668e7fc640 1 -- 172.21.15.5:0/3170784174 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f66940516e0 con 0x7f66980c8ad0 2023-07-14T13:09:40.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:40.755+0000 7f669fed8640 1 -- 172.21.15.5:0/3170784174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7f66980678d0 con 0x7f66980c8ad0 2023-07-14T13:09:41.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.355+0000 7f668e7fc640 1 -- 172.21.15.5:0/3170784174 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v638) v1 ==== 186+0+0 (secure 0 0 0) 0x7f6694007380 con 0x7f66980c8ad0 2023-07-14T13:09:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.359+0000 7f669fed8640 1 -- 172.21.15.5:0/3170784174 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f667c0663a0 msgr2=0x7f667c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.359+0000 7f669fed8640 1 --2- 172.21.15.5:0/3170784174 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f667c0663a0 0x7f667c068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f66880af000 tx=0x7f66880a7000 comp rx=0 tx=0).stop 2023-07-14T13:09:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.359+0000 7f669fed8640 1 -- 172.21.15.5:0/3170784174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66980c8ad0 msgr2=0x7f66980b1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.359+0000 7f669fed8640 1 --2- 172.21.15.5:0/3170784174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66980c8ad0 0x7f66980b1920 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f669400d5f0 tx=0x7f669400dab0 comp rx=0 tx=0).stop 2023-07-14T13:09:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.359+0000 7f669fed8640 1 -- 172.21.15.5:0/3170784174 shutdown_connections 2023-07-14T13:09:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.359+0000 7f669fed8640 1 --2- 172.21.15.5:0/3170784174 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f667c0663a0 0x7f667c068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.359+0000 7f669fed8640 1 --2- 172.21.15.5:0/3170784174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6698158ce0 0x7f669814dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.359+0000 7f669fed8640 1 --2- 172.21.15.5:0/3170784174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66980c9560 0x7f66981f1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.359+0000 7f669fed8640 1 --2- 172.21.15.5:0/3170784174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66980c8ad0 0x7f66980b1920 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.359+0000 7f669fed8640 1 -- 172.21.15.5:0/3170784174 >> 172.21.15.5:0/3170784174 conn(0x7f66980afcf0 msgr2=0x7f66980ae7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.359+0000 7f669fed8640 1 -- 172.21.15.5:0/3170784174 shutdown_connections 2023-07-14T13:09:41.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.359+0000 7f669fed8640 1 -- 172.21.15.5:0/3170784174 wait complete. 2023-07-14T13:09:41.410 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-14T13:09:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.527+0000 7fd302dfa640 1 Processor -- start 2023-07-14T13:09:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.527+0000 7fd302dfa640 1 -- start start 2023-07-14T13:09:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.531+0000 7fd302dfa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd2fc06a540 0x7fd2fc06a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.531+0000 7fd302dfa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2fc0cf2e0 0x7fd2fc0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.531+0000 7fd302dfa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2fc0cb7a0 con 0x7fd2fc0cc9c0 2023-07-14T13:09:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.531+0000 7fd302dfa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2fc0d0920 con 0x7fd2fc06a540 2023-07-14T13:09:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.531+0000 7fd302dfa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc15bfd0 con 0x7fd2fc0cf2e0 2023-07-14T13:09:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.531+0000 7fd300b96640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd2fc06a540 0x7fd2fc06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.531+0000 7fd300b96640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd2fc06a540 0x7fd2fc06a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48422/0 (socket says 172.21.15.5:48422) 2023-07-14T13:09:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.531+0000 7fd300b96640 1 -- 172.21.15.5:0/4294345442 learned_addr learned my addr 172.21.15.5:0/4294345442 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.531+0000 7fd2fbfff640 1 --2- 172.21.15.5:0/4294345442 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2fc0cf2e0 0x7fd2fc0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:41.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.531+0000 7fd300b96640 1 -- 172.21.15.5:0/4294345442 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2fc0cf2e0 msgr2=0x7fd2fc0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:41.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.531+0000 7fd300b96640 1 --2- 172.21.15.5:0/4294345442 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2fc0cf2e0 0x7fd2fc0cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:41.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.531+0000 7fd300b96640 1 -- 172.21.15.5:0/4294345442 >> v1:172.21.15.154:6789/0 conn(0x7fd2fc0cc9c0 legacy=0x7fd2fc0cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:41.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.531+0000 7fd300b96640 1 -- 172.21.15.5:0/4294345442 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2fc06ae50 con 0x7fd2fc06a540 2023-07-14T13:09:41.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.535+0000 7fd300b96640 1 --2- 172.21.15.5:0/4294345442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2fc06a540 0x7fd2fc06a910 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0009870 tx=0x7fd2f001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31550b41c758bcfb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.535+0000 7fd2fb7fe640 1 -- 172.21.15.5:0/4294345442 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f00aa670 con 0x7fd2fc06a540 2023-07-14T13:09:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.535+0000 7fd2fb7fe640 1 -- 172.21.15.5:0/4294345442 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f00aa7d0 con 0x7fd2fc06a540 2023-07-14T13:09:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.535+0000 7fd2fb7fe640 1 -- 172.21.15.5:0/4294345442 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f00aab60 con 0x7fd2fc06a540 2023-07-14T13:09:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.535+0000 7fd302dfa640 1 -- 172.21.15.5:0/4294345442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2fc06a540 msgr2=0x7fd2fc06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.535+0000 7fd302dfa640 1 --2- 172.21.15.5:0/4294345442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2fc06a540 0x7fd2fc06a910 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0009870 tx=0x7fd2f001c510 comp rx=0 tx=0).stop 2023-07-14T13:09:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.535+0000 7fd302dfa640 1 -- 172.21.15.5:0/4294345442 shutdown_connections 2023-07-14T13:09:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.535+0000 7fd302dfa640 1 --2- 172.21.15.5:0/4294345442 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2fc0cf2e0 0x7fd2fc0cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:41.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.535+0000 7fd302dfa640 1 --2- 172.21.15.5:0/4294345442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2fc06a540 0x7fd2fc06a910 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:41.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.535+0000 7fd302dfa640 1 -- 172.21.15.5:0/4294345442 >> 172.21.15.5:0/4294345442 conn(0x7fd2fc099490 msgr2=0x7fd2fc089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:41.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.535+0000 7fd302dfa640 1 -- 172.21.15.5:0/4294345442 shutdown_connections 2023-07-14T13:09:41.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.535+0000 7fd302dfa640 1 -- 172.21.15.5:0/4294345442 wait complete. 2023-07-14T13:09:41.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.535+0000 7fd302dfa640 1 Processor -- start 2023-07-14T13:09:41.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.535+0000 7fd302dfa640 1 -- start start 2023-07-14T13:09:41.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.539+0000 7fd302dfa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2fc06a540 0x7fd2fc1516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:41.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.539+0000 7fd302dfa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2fc0cc9c0 0x7fd2fc15a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:41.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.539+0000 7fd302dfa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2fc0cf2e0 0x7fd2fc153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:41.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.539+0000 7fd302dfa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc154b00 con 0x7fd2fc0cf2e0 2023-07-14T13:09:41.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.539+0000 7fd302dfa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc1594a0 con 0x7fd2fc0cc9c0 2023-07-14T13:09:41.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.539+0000 7fd302dfa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc159780 con 0x7fd2fc06a540 2023-07-14T13:09:41.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.539+0000 7fd301397640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2fc0cf2e0 0x7fd2fc153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:41.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.539+0000 7fd301397640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2fc0cf2e0 0x7fd2fc153370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48432/0 (socket says 172.21.15.5:48432) 2023-07-14T13:09:41.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.539+0000 7fd301397640 1 -- 172.21.15.5:0/2115491600 learned_addr learned my addr 172.21.15.5:0/2115491600 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:41.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.539+0000 7fd2fbfff640 1 --2- 172.21.15.5:0/2115491600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2fc0cc9c0 0x7fd2fc15a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:41.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.539+0000 7fd300b96640 1 --2- 172.21.15.5:0/2115491600 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2fc06a540 0x7fd2fc1516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.539+0000 7fd301397640 1 -- 172.21.15.5:0/2115491600 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2fc06a540 msgr2=0x7fd2fc1516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.539+0000 7fd301397640 1 --2- 172.21.15.5:0/2115491600 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2fc06a540 0x7fd2fc1516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.539+0000 7fd301397640 1 -- 172.21.15.5:0/2115491600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2fc0cc9c0 msgr2=0x7fd2fc15a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.539+0000 7fd301397640 1 --2- 172.21.15.5:0/2115491600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2fc0cc9c0 0x7fd2fc15a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.539+0000 7fd301397640 1 -- 172.21.15.5:0/2115491600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f00094d0 con 0x7fd2fc0cf2e0 2023-07-14T13:09:41.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.539+0000 7fd301397640 1 --2- 172.21.15.5:0/2115491600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2fc0cf2e0 0x7fd2fc153370 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400c730 tx=0x7fd2f400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:41.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.539+0000 7fd2f97fa640 1 -- 172.21.15.5:0/2115491600 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4003b80 con 0x7fd2fc0cf2e0 2023-07-14T13:09:41.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.539+0000 7fd2f97fa640 1 -- 172.21.15.5:0/2115491600 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f4003ce0 con 0x7fd2fc0cf2e0 2023-07-14T13:09:41.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.539+0000 7fd2f97fa640 1 -- 172.21.15.5:0/2115491600 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4005310 con 0x7fd2fc0cf2e0 2023-07-14T13:09:41.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.539+0000 7fd302dfa640 1 -- 172.21.15.5:0/2115491600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2fc159a60 con 0x7fd2fc0cf2e0 2023-07-14T13:09:41.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.539+0000 7fd302dfa640 1 -- 172.21.15.5:0/2115491600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2fc151be0 con 0x7fd2fc0cf2e0 2023-07-14T13:09:41.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.539+0000 7fd302dfa640 1 -- 172.21.15.5:0/2115491600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2fc154c70 con 0x7fd2fc0cf2e0 2023-07-14T13:09:41.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.539+0000 7fd2f97fa640 1 -- 172.21.15.5:0/2115491600 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd2f4005680 con 0x7fd2fc0cf2e0 2023-07-14T13:09:41.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.543+0000 7fd2f97fa640 1 --2- 172.21.15.5:0/2115491600 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fd2e00663a0 0x7fd2e0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:41.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.543+0000 7fd2f97fa640 1 -- 172.21.15.5:0/2115491600 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6027+0+0 (secure 0 0 0) 0x7fd2f4083d50 con 0x7fd2fc0cf2e0 2023-07-14T13:09:41.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.543+0000 7fd300b96640 1 --2- 172.21.15.5:0/2115491600 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fd2e00663a0 0x7fd2e0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:41.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.543+0000 7fd300b96640 1 --2- 172.21.15.5:0/2115491600 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fd2e00663a0 0x7fd2e0068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00ae000 tx=0x7fd2f00b5040 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:41.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.547+0000 7fd2f97fa640 1 -- 172.21.15.5:0/2115491600 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd2f4087030 con 0x7fd2fc0cf2e0 2023-07-14T13:09:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.699+0000 7fd302dfa640 1 -- 172.21.15.5:0/2115491600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd2fc0678d0 con 0x7fd2fc0cf2e0 2023-07-14T13:09:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.707+0000 7fd2f97fa640 1 -- 172.21.15.5:0/2115491600 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd2f4051100 con 0x7fd2fc0cf2e0 2023-07-14T13:09:41.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.707+0000 7fd302dfa640 1 -- 172.21.15.5:0/2115491600 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fd2e00663a0 msgr2=0x7fd2e0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.707+0000 7fd302dfa640 1 --2- 172.21.15.5:0/2115491600 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fd2e00663a0 0x7fd2e0068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00ae000 tx=0x7fd2f00b5040 comp rx=0 tx=0).stop 2023-07-14T13:09:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.707+0000 7fd302dfa640 1 -- 172.21.15.5:0/2115491600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2fc0cf2e0 msgr2=0x7fd2fc153370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.707+0000 7fd302dfa640 1 --2- 172.21.15.5:0/2115491600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2fc0cf2e0 0x7fd2fc153370 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400c730 tx=0x7fd2f400cbf0 comp rx=0 tx=0).stop 2023-07-14T13:09:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.707+0000 7fd302dfa640 1 -- 172.21.15.5:0/2115491600 shutdown_connections 2023-07-14T13:09:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.707+0000 7fd302dfa640 1 --2- 172.21.15.5:0/2115491600 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fd2e00663a0 0x7fd2e0068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.707+0000 7fd302dfa640 1 --2- 172.21.15.5:0/2115491600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2fc0cf2e0 0x7fd2fc153370 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.707+0000 7fd302dfa640 1 --2- 172.21.15.5:0/2115491600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2fc0cc9c0 0x7fd2fc15a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.707+0000 7fd302dfa640 1 --2- 172.21.15.5:0/2115491600 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2fc06a540 0x7fd2fc1516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.707+0000 7fd302dfa640 1 -- 172.21.15.5:0/2115491600 >> 172.21.15.5:0/2115491600 conn(0x7fd2fc099490 msgr2=0x7fd2fc0b1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.707+0000 7fd302dfa640 1 -- 172.21.15.5:0/2115491600 shutdown_connections 2023-07-14T13:09:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:41.707+0000 7fd302dfa640 1 -- 172.21.15.5:0/2115491600 wait complete. 2023-07-14T13:09:41.758 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T13:09:41.758 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:09:41.830 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:09:41.892 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T13:09:41.892 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:09:41.893 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:09:41.902 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:09:41.902 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:09:41.903 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:09:41.912 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:09:41.912 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:09:41.913 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:09:41.952 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:09:41.953 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:09:41.953 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:09:41.965 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:09:41.965 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-14T13:09:41.966 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:09:42.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.107+0000 7f363d896640 1 Processor -- start 2023-07-14T13:09:42.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.107+0000 7f363d896640 1 -- start start 2023-07-14T13:09:42.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.111+0000 7f363d896640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f363815bc00 0x7f36380ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:42.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.111+0000 7f363d896640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3638069430 0x7f3638069830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:42.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.111+0000 7f363d896640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36380c9c30 con 0x7f3638160450 2023-07-14T13:09:42.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.111+0000 7f363d896640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36380c96b0 con 0x7f363815bc00 2023-07-14T13:09:42.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.111+0000 7f363d896640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f363815bfd0 con 0x7f3638069430 2023-07-14T13:09:42.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.111+0000 7f3636ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f363815bc00 0x7f36380ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:42.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.111+0000 7f362ffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3638160450 0x7f363806e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56594/0 (socket says 172.21.15.5:56594) 2023-07-14T13:09:42.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.111+0000 7f362ffff640 1 -- 172.21.15.5:0/441750859 learned_addr learned my addr 172.21.15.5:0/441750859 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:42.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.111+0000 7f3636ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f363815bc00 0x7f36380ce8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48434/0 (socket says 172.21.15.5:48434) 2023-07-14T13:09:42.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.111+0000 7f36377fe640 1 --2- 172.21.15.5:0/441750859 >> v2:172.21.15.154:3300/0 conn(0x7f3638069430 0x7f3638069830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:42.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.111+0000 7f3636ffd640 1 -- 172.21.15.5:0/441750859 >> v2:172.21.15.154:3300/0 conn(0x7f3638069430 msgr2=0x7f3638069830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:42.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.111+0000 7f3636ffd640 1 --2- 172.21.15.5:0/441750859 >> v2:172.21.15.154:3300/0 conn(0x7f3638069430 0x7f3638069830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:42.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.111+0000 7f3636ffd640 1 -- 172.21.15.5:0/441750859 >> v1:172.21.15.5:6789/0 conn(0x7f3638160450 legacy=0x7f363806e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:42.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.111+0000 7f3636ffd640 1 -- 172.21.15.5:0/441750859 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3638069d70 con 0x7f363815bc00 2023-07-14T13:09:42.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.111+0000 7f36377fe640 1 --2- 172.21.15.5:0/441750859 >> v2:172.21.15.154:3300/0 conn(0x7f3638069430 0x7f3638069830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:42.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.115+0000 7f3636ffd640 1 --2- 172.21.15.5:0/441750859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363815bc00 0x7f36380ce8f0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f36380ce4e0 tx=0x7f362801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199de16b31fd8781 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:42.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.115+0000 7f36367fc640 1 -- 172.21.15.5:0/441750859 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36280ab640 con 0x7f363815bc00 2023-07-14T13:09:42.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.115+0000 7f36367fc640 1 -- 172.21.15.5:0/441750859 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36280a7070 con 0x7f363815bc00 2023-07-14T13:09:42.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.115+0000 7f36367fc640 1 -- 172.21.15.5:0/441750859 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36280ab9c0 con 0x7f363815bc00 2023-07-14T13:09:42.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.115+0000 7f363d896640 1 -- 172.21.15.5:0/441750859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363815bc00 msgr2=0x7f36380ce8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:42.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.115+0000 7f363d896640 1 --2- 172.21.15.5:0/441750859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363815bc00 0x7f36380ce8f0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f36380ce4e0 tx=0x7f362801c440 comp rx=0 tx=0).stop 2023-07-14T13:09:42.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.115+0000 7f363d896640 1 -- 172.21.15.5:0/441750859 shutdown_connections 2023-07-14T13:09:42.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.115+0000 7f363d896640 1 --2- 172.21.15.5:0/441750859 >> v2:172.21.15.154:3300/0 conn(0x7f3638069430 0x7f3638069830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:42.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.115+0000 7f363d896640 1 --2- 172.21.15.5:0/441750859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363815bc00 0x7f36380ce8f0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:42.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.115+0000 7f363d896640 1 -- 172.21.15.5:0/441750859 >> 172.21.15.5:0/441750859 conn(0x7f36380b1840 msgr2=0x7f36380cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:42.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.115+0000 7f363d896640 1 -- 172.21.15.5:0/441750859 shutdown_connections 2023-07-14T13:09:42.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.115+0000 7f363d896640 1 -- 172.21.15.5:0/441750859 wait complete. 2023-07-14T13:09:42.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.115+0000 7f363d896640 1 Processor -- start 2023-07-14T13:09:42.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.115+0000 7f363d896640 1 -- start start 2023-07-14T13:09:42.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.119+0000 7f363d896640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3638069430 0x7f363815ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:42.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.119+0000 7f363d896640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f363815bc00 0x7f3638146e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:42.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.119+0000 7f363d896640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3638160450 0x7f3638151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:42.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.119+0000 7f363d896640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36381475e0 con 0x7f3638069430 2023-07-14T13:09:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.119+0000 7f363d896640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3638147360 con 0x7f3638160450 2023-07-14T13:09:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.119+0000 7f363d896640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f363815ccf0 con 0x7f363815bc00 2023-07-14T13:09:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.119+0000 7f3636ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3638069430 0x7f363815ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.119+0000 7f3636ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3638069430 0x7f363815ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48442/0 (socket says 172.21.15.5:48442) 2023-07-14T13:09:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.119+0000 7f3636ffd640 1 -- 172.21.15.5:0/1820869867 learned_addr learned my addr 172.21.15.5:0/1820869867 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:42.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.119+0000 7f362ffff640 1 --2- 172.21.15.5:0/1820869867 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f363815bc00 0x7f3638146e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.119+0000 7f36377fe640 1 --2- 172.21.15.5:0/1820869867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3638160450 0x7f3638151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.119+0000 7f3636ffd640 1 -- 172.21.15.5:0/1820869867 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f363815bc00 msgr2=0x7f3638146e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.119+0000 7f3636ffd640 1 --2- 172.21.15.5:0/1820869867 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f363815bc00 0x7f3638146e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.119+0000 7f3636ffd640 1 -- 172.21.15.5:0/1820869867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3638160450 msgr2=0x7f3638151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.119+0000 7f3636ffd640 1 --2- 172.21.15.5:0/1820869867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3638160450 0x7f3638151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:42.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.119+0000 7f3636ffd640 1 -- 172.21.15.5:0/1820869867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3628009420 con 0x7f3638069430 2023-07-14T13:09:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.119+0000 7f3636ffd640 1 --2- 172.21.15.5:0/1820869867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3638069430 0x7f363815ecb0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f3628019050 tx=0x7f362801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.119+0000 7f3634ff9640 1 -- 172.21.15.5:0/1820869867 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36280bf410 con 0x7f3638069430 2023-07-14T13:09:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.119+0000 7f3634ff9640 1 -- 172.21.15.5:0/1820869867 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36280bf590 con 0x7f3638069430 2023-07-14T13:09:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.119+0000 7f3634ff9640 1 -- 172.21.15.5:0/1820869867 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36280bf940 con 0x7f3638069430 2023-07-14T13:09:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.119+0000 7f363d896640 1 -- 172.21.15.5:0/1820869867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f363815cfd0 con 0x7f3638069430 2023-07-14T13:09:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.119+0000 7f363d896640 1 -- 172.21.15.5:0/1820869867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363815d590 con 0x7f3638069430 2023-07-14T13:09:42.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.119+0000 7f363d896640 1 -- 172.21.15.5:0/1820869867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36380b30b0 con 0x7f3638069430 2023-07-14T13:09:42.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.119+0000 7f3634ff9640 1 -- 172.21.15.5:0/1820869867 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f36280b5400 con 0x7f3638069430 2023-07-14T13:09:42.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.123+0000 7f3634ff9640 1 --2- 172.21.15.5:0/1820869867 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f36180663a0 0x7f3618068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:42.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.123+0000 7f3634ff9640 1 -- 172.21.15.5:0/1820869867 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6027+0+0 (secure 0 0 0) 0x7f362811e8c0 con 0x7f3638069430 2023-07-14T13:09:42.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.123+0000 7f362ffff640 1 --2- 172.21.15.5:0/1820869867 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f36180663a0 0x7f3618068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:42.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.123+0000 7f362ffff640 1 --2- 172.21.15.5:0/1820869867 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f36180663a0 0x7f3618068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f36381509a0 tx=0x7f3620009040 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:42.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.127+0000 7f3634ff9640 1 -- 172.21.15.5:0/1820869867 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f36280ebb30 con 0x7f3638069430 2023-07-14T13:09:42.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.311+0000 7f363d896640 1 -- 172.21.15.5:0/1820869867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36380c9890 con 0x7f3638069430 2023-07-14T13:09:42.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.311+0000 7f3634ff9640 1 -- 172.21.15.5:0/1820869867 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+3520 (secure 0 0 0) 0x7f36280ef150 con 0x7f3638069430 2023-07-14T13:09:42.343 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:42.343 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":43,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6901,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/747965975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":747965975},{"type":"v1","addr":"172.21.15.5:6835","nonce":747965975}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6907,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1902785181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1902785181},{"type":"v1","addr":"172.21.15.154:6835","nonce":1902785181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6916,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/90532135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":90532135},{"type":"v1","addr":"172.21.15.154:6837","nonce":90532135}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":7590,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/1235486368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1235486368},{"type":"v1","addr":"172.21.15.5:6834","nonce":1235486368}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[]} 2023-07-14T13:09:42.344 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 43 2023-07-14T13:09:42.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.315+0000 7f363d896640 1 -- 172.21.15.5:0/1820869867 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f36180663a0 msgr2=0x7f3618068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:42.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.315+0000 7f363d896640 1 --2- 172.21.15.5:0/1820869867 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f36180663a0 0x7f3618068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f36381509a0 tx=0x7f3620009040 comp rx=0 tx=0).stop 2023-07-14T13:09:42.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.315+0000 7f363d896640 1 -- 172.21.15.5:0/1820869867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3638069430 msgr2=0x7f363815ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:42.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.315+0000 7f363d896640 1 --2- 172.21.15.5:0/1820869867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3638069430 0x7f363815ecb0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f3628019050 tx=0x7f362801ac80 comp rx=0 tx=0).stop 2023-07-14T13:09:42.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.315+0000 7f363d896640 1 -- 172.21.15.5:0/1820869867 shutdown_connections 2023-07-14T13:09:42.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.315+0000 7f363d896640 1 --2- 172.21.15.5:0/1820869867 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f36180663a0 0x7f3618068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:42.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.315+0000 7f363d896640 1 --2- 172.21.15.5:0/1820869867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3638160450 0x7f3638151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:42.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.315+0000 7f363d896640 1 --2- 172.21.15.5:0/1820869867 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f363815bc00 0x7f3638146e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:42.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.315+0000 7f363d896640 1 --2- 172.21.15.5:0/1820869867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3638069430 0x7f363815ecb0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:42.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.315+0000 7f363d896640 1 -- 172.21.15.5:0/1820869867 >> 172.21.15.5:0/1820869867 conn(0x7f36380b1840 msgr2=0x7f363806de30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:42.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.315+0000 7f363d896640 1 -- 172.21.15.5:0/1820869867 shutdown_connections 2023-07-14T13:09:42.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.315+0000 7f363d896640 1 -- 172.21.15.5:0/1820869867 wait complete. 2023-07-14T13:09:42.364 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-14T13:09:42.364 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-14T13:09:42.365 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-14T13:09:42.365 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:09:42.365 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-14T13:09:42.365 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-14T13:09:42.366 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-14T13:09:42.366 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:09:42.366 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-14T13:09:42.366 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-14T13:09:42.366 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-14T13:09:42.367 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:09:42.367 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-14T13:09:42.367 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-14T13:09:42.368 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-14T13:09:42.368 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:09:42.376 INFO:tasks.ceph.mds.a:Stopped 2023-07-14T13:09:42.376 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-14T13:09:42.377 INFO:tasks.ceph.mds.c:Stopped 2023-07-14T13:09:42.377 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-14T13:09:42.381 INFO:tasks.ceph.mds.b:Stopped 2023-07-14T13:09:42.381 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-14T13:09:42.382 INFO:tasks.ceph.mds.d:Stopped 2023-07-14T13:09:42.383 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-14T13:09:42.423 INFO:tasks.ceph.mds.a:Started 2023-07-14T13:09:42.423 DEBUG:teuthology.parallel:result is None 2023-07-14T13:09:42.425 INFO:tasks.ceph.mds.c:Started 2023-07-14T13:09:42.425 DEBUG:teuthology.parallel:result is None 2023-07-14T13:09:42.431 INFO:tasks.ceph.mds.b:Started 2023-07-14T13:09:42.432 DEBUG:teuthology.parallel:result is None 2023-07-14T13:09:42.434 INFO:tasks.ceph.mds.d:Started 2023-07-14T13:09:42.434 DEBUG:teuthology.parallel:result is None 2023-07-14T13:09:42.435 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-14T13:09:42.512 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-07-14T13:09:42.514 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-07-14T13:09:42.525 INFO:tasks.ceph.mds.b.smithi154.stdout:starting mds.b at 2023-07-14T13:09:42.526 INFO:tasks.ceph.mds.d.smithi154.stdout:starting mds.d at 2023-07-14T13:09:42.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.555+0000 7f6449aca640 1 Processor -- start 2023-07-14T13:09:42.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.555+0000 7f6449aca640 1 -- start start 2023-07-14T13:09:42.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.555+0000 7f6449aca640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f64440c8ad0 0x7f64440c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.555+0000 7f6449aca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64440c9560 0x7f64440ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.555+0000 7f6449aca640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64440cc700 con 0x7f6444158ce0 2023-07-14T13:09:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.555+0000 7f6449aca640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64440c99e0 con 0x7f64440c8ad0 2023-07-14T13:09:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.555+0000 7f6449aca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64440b0ff0 con 0x7f64440c9560 2023-07-14T13:09:42.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.555+0000 7f64437fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6444158ce0 0x7f6444070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56606/0 (socket says 172.21.15.5:56606) 2023-07-14T13:09:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.555+0000 7f64437fe640 1 -- 172.21.15.5:0/2661792327 learned_addr learned my addr 172.21.15.5:0/2661792327 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:42.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.559+0000 7f6443fff640 1 --2- 172.21.15.5:0/2661792327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64440c9560 0x7f64440ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:42.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.559+0000 7f6442ffd640 1 --2- 172.21.15.5:0/2661792327 >> v2:172.21.15.154:3300/0 conn(0x7f64440c8ad0 0x7f64440c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:42.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.559+0000 7f64427fc640 1 -- 172.21.15.5:0/2661792327 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 561038931 0 0) 0x7f64440cc700 con 0x7f6444158ce0 2023-07-14T13:09:42.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.559+0000 7f64427fc640 1 -- 172.21.15.5:0/2661792327 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f642c003530 con 0x7f6444158ce0 2023-07-14T13:09:42.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.559+0000 7f6443fff640 1 -- 172.21.15.5:0/2661792327 >> v2:172.21.15.154:3300/0 conn(0x7f64440c8ad0 msgr2=0x7f64440c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:42.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.559+0000 7f6443fff640 1 --2- 172.21.15.5:0/2661792327 >> v2:172.21.15.154:3300/0 conn(0x7f64440c8ad0 0x7f64440c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:42.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.559+0000 7f6443fff640 1 -- 172.21.15.5:0/2661792327 >> v1:172.21.15.5:6789/0 conn(0x7f6444158ce0 legacy=0x7f6444070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:42.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.559+0000 7f6443fff640 1 -- 172.21.15.5:0/2661792327 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6444070c80 con 0x7f64440c9560 2023-07-14T13:09:42.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.559+0000 7f6443fff640 1 --2- 172.21.15.5:0/2661792327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64440c9560 0x7f64440ccb90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f643c009d90 tx=0x7f643c01c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8230284d468d5e57 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:42.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.559+0000 7f64427fc640 1 -- 172.21.15.5:0/2661792327 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c0a57d0 con 0x7f64440c9560 2023-07-14T13:09:42.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.559+0000 7f64427fc640 1 -- 172.21.15.5:0/2661792327 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643c0a5930 con 0x7f64440c9560 2023-07-14T13:09:42.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.559+0000 7f64427fc640 1 -- 172.21.15.5:0/2661792327 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c0a5cc0 con 0x7f64440c9560 2023-07-14T13:09:42.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.563+0000 7f6449aca640 1 -- 172.21.15.5:0/2661792327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64440c9560 msgr2=0x7f64440ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:42.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.563+0000 7f6449aca640 1 --2- 172.21.15.5:0/2661792327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64440c9560 0x7f64440ccb90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f643c009d90 tx=0x7f643c01c800 comp rx=0 tx=0).stop 2023-07-14T13:09:42.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.563+0000 7f6449aca640 1 -- 172.21.15.5:0/2661792327 shutdown_connections 2023-07-14T13:09:42.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.563+0000 7f6449aca640 1 --2- 172.21.15.5:0/2661792327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64440c9560 0x7f64440ccb90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:42.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.563+0000 7f6449aca640 1 --2- 172.21.15.5:0/2661792327 >> v2:172.21.15.154:3300/0 conn(0x7f64440c8ad0 0x7f64440c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:42.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.563+0000 7f6449aca640 1 -- 172.21.15.5:0/2661792327 >> 172.21.15.5:0/2661792327 conn(0x7f64440afcf0 msgr2=0x7f64440b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:42.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.563+0000 7f6449aca640 1 -- 172.21.15.5:0/2661792327 shutdown_connections 2023-07-14T13:09:42.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.563+0000 7f6449aca640 1 -- 172.21.15.5:0/2661792327 wait complete. 2023-07-14T13:09:42.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.563+0000 7f6449aca640 1 Processor -- start 2023-07-14T13:09:42.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.563+0000 7f6449aca640 1 -- start start 2023-07-14T13:09:42.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.563+0000 7f6449aca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64440c8ad0 0x7f644414f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:42.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.563+0000 7f6449aca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64440c9560 0x7f644406ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:42.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.563+0000 7f6449aca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6444158ce0 0x7f6444070460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:42.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.563+0000 7f6449aca640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644414fb10 con 0x7f64440c8ad0 2023-07-14T13:09:42.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.563+0000 7f6449aca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6444146e50 con 0x7f64440c9560 2023-07-14T13:09:42.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.563+0000 7f6449aca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6444147130 con 0x7f6444158ce0 2023-07-14T13:09:42.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.563+0000 7f64437fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64440c8ad0 0x7f644414f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:42.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.563+0000 7f6442ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64440c9560 0x7f644406ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:42.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.563+0000 7f64437fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64440c8ad0 0x7f644414f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48486/0 (socket says 172.21.15.5:48486) 2023-07-14T13:09:42.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.563+0000 7f64437fe640 1 -- 172.21.15.5:0/294348376 learned_addr learned my addr 172.21.15.5:0/294348376 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:42.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.563+0000 7f6443fff640 1 --2- 172.21.15.5:0/294348376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6444158ce0 0x7f6444070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:42.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.563+0000 7f64437fe640 1 -- 172.21.15.5:0/294348376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6444158ce0 msgr2=0x7f6444070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:42.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.563+0000 7f64437fe640 1 --2- 172.21.15.5:0/294348376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6444158ce0 0x7f6444070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:42.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.563+0000 7f64437fe640 1 -- 172.21.15.5:0/294348376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64440c9560 msgr2=0x7f644406ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:42.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.563+0000 7f64437fe640 1 --2- 172.21.15.5:0/294348376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64440c9560 0x7f644406ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:42.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.563+0000 7f64437fe640 1 -- 172.21.15.5:0/294348376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643c009a70 con 0x7f64440c8ad0 2023-07-14T13:09:42.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.567+0000 7f64437fe640 1 --2- 172.21.15.5:0/294348376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64440c8ad0 0x7f644414f5d0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f643400c450 tx=0x7f643400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:42.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.567+0000 7f642bfff640 1 -- 172.21.15.5:0/294348376 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6434005cf0 con 0x7f64440c8ad0 2023-07-14T13:09:42.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.567+0000 7f642bfff640 1 -- 172.21.15.5:0/294348376 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6434005e50 con 0x7f64440c8ad0 2023-07-14T13:09:42.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.567+0000 7f6449aca640 1 -- 172.21.15.5:0/294348376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f644414e710 con 0x7f64440c8ad0 2023-07-14T13:09:42.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.567+0000 7f642bfff640 1 -- 172.21.15.5:0/294348376 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6434007270 con 0x7f64440c8ad0 2023-07-14T13:09:42.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.567+0000 7f6449aca640 1 -- 172.21.15.5:0/294348376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f644414ecd0 con 0x7f64440c8ad0 2023-07-14T13:09:42.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.567+0000 7f6449aca640 1 -- 172.21.15.5:0/294348376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64440ca1a0 con 0x7f64440c8ad0 2023-07-14T13:09:42.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.567+0000 7f642bfff640 1 -- 172.21.15.5:0/294348376 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f64340073d0 con 0x7f64440c8ad0 2023-07-14T13:09:42.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.567+0000 7f642bfff640 1 --2- 172.21.15.5:0/294348376 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f64300663a0 0x7f6430068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:42.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.567+0000 7f642bfff640 1 -- 172.21.15.5:0/294348376 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6027+0+0 (secure 0 0 0) 0x7f6434083350 con 0x7f64440c8ad0 2023-07-14T13:09:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.571+0000 7f6442ffd640 1 --2- 172.21.15.5:0/294348376 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f64300663a0 0x7f6430068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:42.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.571+0000 7f6442ffd640 1 --2- 172.21.15.5:0/294348376 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f64300663a0 0x7f6430068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f64440aec30 tx=0x7f6438009190 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:42.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.571+0000 7f642bfff640 1 -- 172.21.15.5:0/294348376 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f64340506f0 con 0x7f64440c8ad0 2023-07-14T13:09:42.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:42.743+0000 7f6449aca640 1 -- 172.21.15.5:0/294348376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f644415c600 con 0x7f64440c8ad0 2023-07-14T13:09:43.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.727+0000 7f642bfff640 1 -- 172.21.15.5:0/294348376 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v107) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6434053d10 con 0x7f64440c8ad0 2023-07-14T13:09:43.758 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2023-07-14T13:09:43.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.731+0000 7f6449aca640 1 -- 172.21.15.5:0/294348376 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f64300663a0 msgr2=0x7f6430068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:43.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.731+0000 7f6449aca640 1 --2- 172.21.15.5:0/294348376 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f64300663a0 0x7f6430068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f64440aec30 tx=0x7f6438009190 comp rx=0 tx=0).stop 2023-07-14T13:09:43.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.731+0000 7f6449aca640 1 -- 172.21.15.5:0/294348376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64440c8ad0 msgr2=0x7f644414f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:43.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.731+0000 7f6449aca640 1 --2- 172.21.15.5:0/294348376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64440c8ad0 0x7f644414f5d0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f643400c450 tx=0x7f643400c910 comp rx=0 tx=0).stop 2023-07-14T13:09:43.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.731+0000 7f6449aca640 1 -- 172.21.15.5:0/294348376 shutdown_connections 2023-07-14T13:09:43.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.731+0000 7f6449aca640 1 --2- 172.21.15.5:0/294348376 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f64300663a0 0x7f6430068850 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.731+0000 7f6449aca640 1 --2- 172.21.15.5:0/294348376 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6444158ce0 0x7f6444070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.731+0000 7f6449aca640 1 --2- 172.21.15.5:0/294348376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64440c9560 0x7f644406ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.731+0000 7f6449aca640 1 --2- 172.21.15.5:0/294348376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64440c8ad0 0x7f644414f5d0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.731+0000 7f6449aca640 1 -- 172.21.15.5:0/294348376 >> 172.21.15.5:0/294348376 conn(0x7f64440afcf0 msgr2=0x7f64440add00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:43.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.731+0000 7f6449aca640 1 -- 172.21.15.5:0/294348376 shutdown_connections 2023-07-14T13:09:43.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.731+0000 7f6449aca640 1 -- 172.21.15.5:0/294348376 wait complete. 2023-07-14T13:09:43.785 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-14T13:09:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.903+0000 7f5287434640 1 Processor -- start 2023-07-14T13:09:43.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.903+0000 7f5287434640 1 -- start start 2023-07-14T13:09:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.903+0000 7f5287434640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f528015fd60 0x7f52800d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.903+0000 7f5287434640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f52800d1850 0x7f52800d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.903+0000 7f5287434640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52800ccaf0 con 0x7f52800b7c70 2023-07-14T13:09:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.903+0000 7f5287434640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52800d1190 con 0x7f52800d1850 2023-07-14T13:09:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.903+0000 7f5287434640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5280160600 con 0x7f528015fd60 2023-07-14T13:09:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.903+0000 7f52859d1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f52800d1850 0x7f52800d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.903+0000 7f52859d1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f52800d1850 0x7f52800d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48488/0 (socket says 172.21.15.5:48488) 2023-07-14T13:09:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.903+0000 7f52859d1640 1 -- 172.21.15.5:0/2902422364 learned_addr learned my addr 172.21.15.5:0/2902422364 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:43.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.903+0000 7f52849cf640 1 --2- 172.21.15.5:0/2902422364 >> v2:172.21.15.154:3300/0 conn(0x7f528015fd60 0x7f52800d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.903+0000 7f52859d1640 1 -- 172.21.15.5:0/2902422364 >> v2:172.21.15.154:3300/0 conn(0x7f528015fd60 msgr2=0x7f52800d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.903+0000 7f52859d1640 1 --2- 172.21.15.5:0/2902422364 >> v2:172.21.15.154:3300/0 conn(0x7f528015fd60 0x7f52800d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.903+0000 7f52859d1640 1 -- 172.21.15.5:0/2902422364 >> v1:172.21.15.154:6789/0 conn(0x7f52800b7c70 legacy=0x7f528015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.903+0000 7f52859d1640 1 -- 172.21.15.5:0/2902422364 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5280160320 con 0x7f52800d1850 2023-07-14T13:09:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.903+0000 7f52849cf640 1 --2- 172.21.15.5:0/2902422364 >> v2:172.21.15.154:3300/0 conn(0x7f528015fd60 0x7f52800d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:43.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.907+0000 7f52859d1640 1 --2- 172.21.15.5:0/2902422364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52800d1850 0x7f52800d1da0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f52800b1180 tx=0x7f527801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a612b66b94c4b6d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.907+0000 7f5277fff640 1 -- 172.21.15.5:0/2902422364 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52780a5880 con 0x7f52800d1850 2023-07-14T13:09:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.907+0000 7f5277fff640 1 -- 172.21.15.5:0/2902422364 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52780a59e0 con 0x7f52800d1850 2023-07-14T13:09:43.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.907+0000 7f5277fff640 1 -- 172.21.15.5:0/2902422364 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52780a5d70 con 0x7f52800d1850 2023-07-14T13:09:43.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.907+0000 7f5287434640 1 -- 172.21.15.5:0/2902422364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52800d1850 msgr2=0x7f52800d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:43.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.907+0000 7f5287434640 1 --2- 172.21.15.5:0/2902422364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52800d1850 0x7f52800d1da0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f52800b1180 tx=0x7f527801c9a0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.907+0000 7f5287434640 1 -- 172.21.15.5:0/2902422364 shutdown_connections 2023-07-14T13:09:43.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.907+0000 7f5287434640 1 --2- 172.21.15.5:0/2902422364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52800d1850 0x7f52800d1da0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.907+0000 7f5287434640 1 --2- 172.21.15.5:0/2902422364 >> v2:172.21.15.154:3300/0 conn(0x7f528015fd60 0x7f52800d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.907+0000 7f5287434640 1 -- 172.21.15.5:0/2902422364 >> 172.21.15.5:0/2902422364 conn(0x7f52800650b0 msgr2=0x7f52800654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:43.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.907+0000 7f5287434640 1 -- 172.21.15.5:0/2902422364 shutdown_connections 2023-07-14T13:09:43.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.907+0000 7f5287434640 1 -- 172.21.15.5:0/2902422364 wait complete. 2023-07-14T13:09:43.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.911+0000 7f5287434640 1 Processor -- start 2023-07-14T13:09:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.911+0000 7f5287434640 1 -- start start 2023-07-14T13:09:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.911+0000 7f5287434640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52800b7c70 0x7f528014d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.911+0000 7f5287434640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52800d1850 0x7f5280159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.911+0000 7f5287434640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f528015fd60 0x7f5280159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.911+0000 7f5287434640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528014dc00 con 0x7f52800b7c70 2023-07-14T13:09:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.911+0000 7f5287434640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52800b5570 con 0x7f528015fd60 2023-07-14T13:09:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.911+0000 7f5287434640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52801f4fc0 con 0x7f52800d1850 2023-07-14T13:09:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.911+0000 7f52851d0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52800b7c70 0x7f528014d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.911+0000 7f52851d0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52800b7c70 0x7f528014d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48502/0 (socket says 172.21.15.5:48502) 2023-07-14T13:09:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.911+0000 7f52851d0640 1 -- 172.21.15.5:0/444642414 learned_addr learned my addr 172.21.15.5:0/444642414 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.911+0000 7f52859d1640 1 --2- 172.21.15.5:0/444642414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f528015fd60 0x7f5280159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.911+0000 7f52849cf640 1 --2- 172.21.15.5:0/444642414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52800d1850 0x7f5280159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.911+0000 7f52851d0640 1 -- 172.21.15.5:0/444642414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52800d1850 msgr2=0x7f5280159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.911+0000 7f52851d0640 1 --2- 172.21.15.5:0/444642414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52800d1850 0x7f5280159640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.911+0000 7f52851d0640 1 -- 172.21.15.5:0/444642414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f528015fd60 msgr2=0x7f5280159b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.911+0000 7f52851d0640 1 --2- 172.21.15.5:0/444642414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f528015fd60 0x7f5280159b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.911+0000 7f52851d0640 1 -- 172.21.15.5:0/444642414 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5278009b30 con 0x7f52800b7c70 2023-07-14T13:09:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.911+0000 7f52851d0640 1 --2- 172.21.15.5:0/444642414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52800b7c70 0x7f528014d6c0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f527c00c3c0 tx=0x7f527c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.911+0000 7f5275ffb640 1 -- 172.21.15.5:0/444642414 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c0052d0 con 0x7f52800b7c70 2023-07-14T13:09:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.911+0000 7f5275ffb640 1 -- 172.21.15.5:0/444642414 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527c005430 con 0x7f52800b7c70 2023-07-14T13:09:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.911+0000 7f5275ffb640 1 -- 172.21.15.5:0/444642414 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c003840 con 0x7f52800b7c70 2023-07-14T13:09:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.911+0000 7f5287434640 1 -- 172.21.15.5:0/444642414 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52801f43d0 con 0x7f52800b7c70 2023-07-14T13:09:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.911+0000 7f5287434640 1 -- 172.21.15.5:0/444642414 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52801f4970 con 0x7f52800b7c70 2023-07-14T13:09:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.911+0000 7f5287434640 1 -- 172.21.15.5:0/444642414 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52800c92a0 con 0x7f52800b7c70 2023-07-14T13:09:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.915+0000 7f5275ffb640 1 -- 172.21.15.5:0/444642414 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f527c0039a0 con 0x7f52800b7c70 2023-07-14T13:09:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.915+0000 7f5275ffb640 1 --2- 172.21.15.5:0/444642414 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f52640663a0 0x7f5264068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.915+0000 7f5275ffb640 1 -- 172.21.15.5:0/444642414 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f527c083060 con 0x7f52800b7c70 2023-07-14T13:09:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.915+0000 7f52849cf640 1 --2- 172.21.15.5:0/444642414 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f52640663a0 0x7f5264068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:43.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.915+0000 7f52849cf640 1 --2- 172.21.15.5:0/444642414 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f52640663a0 0x7f5264068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f52800c5980 tx=0x7f5270008040 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:43.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:43.919+0000 7f5275ffb640 1 -- 172.21.15.5:0/444642414 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f527c0b3720 con 0x7f52800b7c70 2023-07-14T13:09:44.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.131+0000 7f5287434640 1 -- 172.21.15.5:0/444642414 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f52800678d0 con 0x7f52800b7c70 2023-07-14T13:09:44.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.131+0000 7f5275ffb640 1 -- 172.21.15.5:0/444642414 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f52800c92a0 con 0x7f52800b7c70 2023-07-14T13:09:44.163 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:44.163 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T13:09:44.163 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2023-07-14T13:09:44.164 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:44.164 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2023-07-14T13:09:44.164 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkGNTsMRAA5T/zjdynxEKmoNAAK0cChw==", 2023-07-14T13:09:44.164 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:44.165 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:09:44.165 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:09:44.165 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:09:44.166 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:44.166 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:44.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:44.166 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:44.167 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2023-07-14T13:09:44.167 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkqXNAAxAAb7bzXyE8cSS0A3Rz2de6TA==", 2023-07-14T13:09:44.167 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:44.167 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:09:44.168 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:09:44.168 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:09:44.168 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:44.168 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:44.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:44.169 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:44.169 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2023-07-14T13:09:44.169 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFk6NGUORAA+5odxrAlCCXYGc64nzFWwQ==", 2023-07-14T13:09:44.170 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:44.170 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:09:44.170 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:09:44.170 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:09:44.171 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:44.171 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:44.171 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:44.171 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:44.172 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2023-07-14T13:09:44.172 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkGh/BChAA5p9amLIC6ORC0JJov0bSVg==", 2023-07-14T13:09:44.172 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:44.173 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:09:44.173 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:09:44.173 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:09:44.173 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:44.174 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:44.174 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:44.174 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:44.174 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2023-07-14T13:09:44.175 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDlRLFkJ6MULhAAxExAqekc/gWudYBJ2sY4MQ==", 2023-07-14T13:09:44.175 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:44.175 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:09:44.175 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:09:44.176 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:44.176 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:44.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:44.176 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:44.177 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2023-07-14T13:09:44.177 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDoRLFksXGBNRAAFtHZt5OQw0aB6k3CkxOzZQ==", 2023-07-14T13:09:44.177 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:44.177 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:09:44.178 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:09:44.178 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:44.178 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:44.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:44.179 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:44.179 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2023-07-14T13:09:44.179 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDsRLFkaUH0ARAAkqgsKPX1dTSZQjn0cRxxRQ==", 2023-07-14T13:09:44.179 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:44.180 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:09:44.180 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:09:44.180 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:44.180 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:44.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:44.181 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:44.181 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2023-07-14T13:09:44.182 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDvRLFkvElJCRAAnox5LKwobP/1Qaf5d9UsjA==", 2023-07-14T13:09:44.182 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:44.182 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:09:44.182 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:09:44.183 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:44.183 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:44.183 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:44.183 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:44.184 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2023-07-14T13:09:44.184 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD1RLFkMNyyDxAA19dJkhhuSpcgVPQEyxb3lg==", 2023-07-14T13:09:44.184 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:44.184 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:09:44.185 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:09:44.185 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:44.185 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:44.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:44.186 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:44.186 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2023-07-14T13:09:44.186 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD4RLFkR8mTFhAAP5qUgUJI23XOvVAnNCSgRQ==", 2023-07-14T13:09:44.186 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:44.187 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:09:44.187 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:09:44.187 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:44.187 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:44.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:44.188 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:44.188 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2023-07-14T13:09:44.188 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD7RLFkpWL9HBAAo8MfszRnB4sHsDPPcRjCAg==", 2023-07-14T13:09:44.189 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:44.189 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:09:44.189 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:09:44.189 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:44.190 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:44.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:44.190 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:44.190 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2023-07-14T13:09:44.191 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD+RLFkL5cRIxAAF/4ndtYf0oiH3uhhDKnQQg==", 2023-07-14T13:09:44.191 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:44.191 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:09:44.191 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:09:44.192 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:44.192 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:44.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:44.193 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:44.193 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2023-07-14T13:09:44.193 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkCav/DhAA6SOiONAbTcWCnUZXcm7BcQ==", 2023-07-14T13:09:44.193 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:44.194 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:09:44.194 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2023-07-14T13:09:44.194 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-14T13:09:44.194 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:44.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:44.195 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:44.195 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2023-07-14T13:09:44.195 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkgS/hGBAAevMD2/lfNuaeV74w0Xj0Zw==", 2023-07-14T13:09:44.196 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:44.196 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:09:44.196 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T13:09:44.197 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T13:09:44.197 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T13:09:44.197 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:44.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:44.198 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:44.198 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2023-07-14T13:09:44.198 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkeBs4FRAAJ/UjIEKDajVyDb7PejPqAw==", 2023-07-14T13:09:44.198 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:44.199 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:09:44.199 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T13:09:44.199 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T13:09:44.199 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T13:09:44.200 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:44.200 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:44.200 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:44.201 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2023-07-14T13:09:44.201 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkSkDiHhAAV86wIrAVz3o/PI2CaBC44w==", 2023-07-14T13:09:44.201 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:44.201 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:09:44.202 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T13:09:44.202 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T13:09:44.202 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T13:09:44.202 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:44.203 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:44.203 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:44.203 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2023-07-14T13:09:44.203 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkk5IcFRAAThI0P1N8LsRetmwhHqSvdQ==", 2023-07-14T13:09:44.204 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:44.204 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T13:09:44.204 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:09:44.204 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:09:44.205 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:44.205 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:44.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:44.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:44.206 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2023-07-14T13:09:44.206 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkugeXLRAAEVAnLk/dldtqrpkdzQI3SA==", 2023-07-14T13:09:44.206 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:44.206 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T13:09:44.207 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-07-14T13:09:44.207 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:44.207 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:44.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:44.208 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:44.208 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2023-07-14T13:09:44.208 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkSvp/KRAAwvjYlrZYNeGbhCiDrTmnrA==", 2023-07-14T13:09:44.209 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:09:44.209 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T13:09:44.209 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-07-14T13:09:44.209 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:09:44.210 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:44.210 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:44.210 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-07-14T13:09:44.210 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T13:09:44.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.131+0000 7f5287434640 1 -- 172.21.15.5:0/444642414 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f52640663a0 msgr2=0x7f5264068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:44.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.131+0000 7f5287434640 1 --2- 172.21.15.5:0/444642414 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f52640663a0 0x7f5264068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f52800c5980 tx=0x7f5270008040 comp rx=0 tx=0).stop 2023-07-14T13:09:44.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.131+0000 7f5287434640 1 -- 172.21.15.5:0/444642414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52800b7c70 msgr2=0x7f528014d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:44.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.131+0000 7f5287434640 1 --2- 172.21.15.5:0/444642414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52800b7c70 0x7f528014d6c0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f527c00c3c0 tx=0x7f527c00c880 comp rx=0 tx=0).stop 2023-07-14T13:09:44.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.131+0000 7f5287434640 1 -- 172.21.15.5:0/444642414 shutdown_connections 2023-07-14T13:09:44.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.131+0000 7f5287434640 1 --2- 172.21.15.5:0/444642414 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f52640663a0 0x7f5264068850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:44.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.131+0000 7f5287434640 1 --2- 172.21.15.5:0/444642414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f528015fd60 0x7f5280159b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:44.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.131+0000 7f5287434640 1 --2- 172.21.15.5:0/444642414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52800d1850 0x7f5280159640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:44.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.131+0000 7f5287434640 1 --2- 172.21.15.5:0/444642414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52800b7c70 0x7f528014d6c0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:44.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.131+0000 7f5287434640 1 -- 172.21.15.5:0/444642414 >> 172.21.15.5:0/444642414 conn(0x7f52800650b0 msgr2=0x7f52800cfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:44.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.135+0000 7f5287434640 1 -- 172.21.15.5:0/444642414 shutdown_connections 2023-07-14T13:09:44.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.135+0000 7f5287434640 1 -- 172.21.15.5:0/444642414 wait complete. 2023-07-14T13:09:44.216 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:09:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.331+0000 7f5864159640 1 Processor -- start 2023-07-14T13:09:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.331+0000 7f5864159640 1 -- start start 2023-07-14T13:09:44.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.331+0000 7f5864159640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f585c0c8ad0 0x7f585c0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:44.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.331+0000 7f5864159640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f585c0c99c0 con 0x7f585c0c9560 2023-07-14T13:09:44.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.331+0000 7f5864159640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f585c0cc700 con 0x7f585c158ce0 2023-07-14T13:09:44.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.331+0000 7f5864159640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f585c0b0ff0 con 0x7f585c0c8ad0 2023-07-14T13:09:44.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.331+0000 7f58616f4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f585c0c8ad0 0x7f585c0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:44.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.331+0000 7f58616f4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f585c0c8ad0 0x7f585c0c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48508/0 (socket says 172.21.15.5:48508) 2023-07-14T13:09:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.331+0000 7f58616f4640 1 -- 172.21.15.5:0/2680899853 learned_addr learned my addr 172.21.15.5:0/2680899853 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.331+0000 7f58626f6640 1 --1- 172.21.15.5:0/2680899853 >> v1:172.21.15.5:6789/0 conn(0x7f585c0c9560 0x7f585c0ccb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56612/0 (socket says 172.21.15.5:56612) 2023-07-14T13:09:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.331+0000 7f58616f4640 1 -- 172.21.15.5:0/2680899853 >> v1:172.21.15.154:6789/0 conn(0x7f585c158ce0 legacy=0x7f585c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.331+0000 7f58616f4640 1 -- 172.21.15.5:0/2680899853 >> v1:172.21.15.5:6789/0 conn(0x7f585c0c9560 legacy=0x7f585c0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:44.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.331+0000 7f58616f4640 1 -- 172.21.15.5:0/2680899853 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585c070c80 con 0x7f585c0c8ad0 2023-07-14T13:09:44.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.331+0000 7f5860ef3640 1 -- 172.21.15.5:0/2680899853 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436709811 0 0) 0x7f585c0c99c0 con 0x7f585c0c9560 2023-07-14T13:09:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.335+0000 7f58616f4640 1 --2- 172.21.15.5:0/2680899853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f585c0c8ad0 0x7f585c0c9020 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f584c009870 tx=0x7f584c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57df16908f3de6b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.335+0000 7f5860ef3640 1 -- 172.21.15.5:0/2680899853 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c0ac410 con 0x7f585c0c8ad0 2023-07-14T13:09:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.335+0000 7f5860ef3640 1 -- 172.21.15.5:0/2680899853 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584c0ac570 con 0x7f585c0c8ad0 2023-07-14T13:09:44.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.335+0000 7f5860ef3640 1 -- 172.21.15.5:0/2680899853 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c0ac900 con 0x7f585c0c8ad0 2023-07-14T13:09:44.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.335+0000 7f5864159640 1 -- 172.21.15.5:0/2680899853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f585c0c8ad0 msgr2=0x7f585c0c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:44.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.335+0000 7f5864159640 1 --2- 172.21.15.5:0/2680899853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f585c0c8ad0 0x7f585c0c9020 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f584c009870 tx=0x7f584c01c3b0 comp rx=0 tx=0).stop 2023-07-14T13:09:44.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.335+0000 7f5864159640 1 -- 172.21.15.5:0/2680899853 shutdown_connections 2023-07-14T13:09:44.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.335+0000 7f5864159640 1 --2- 172.21.15.5:0/2680899853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f585c0c8ad0 0x7f585c0c9020 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:44.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.335+0000 7f5864159640 1 -- 172.21.15.5:0/2680899853 >> 172.21.15.5:0/2680899853 conn(0x7f585c0afcf0 msgr2=0x7f585c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:44.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.335+0000 7f5864159640 1 -- 172.21.15.5:0/2680899853 shutdown_connections 2023-07-14T13:09:44.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.335+0000 7f5864159640 1 -- 172.21.15.5:0/2680899853 wait complete. 2023-07-14T13:09:44.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.339+0000 7f5864159640 1 Processor -- start 2023-07-14T13:09:44.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.339+0000 7f5864159640 1 -- start start 2023-07-14T13:09:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.339+0000 7f5864159640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f585c0c8ad0 0x7f585c14ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.339+0000 7f5864159640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f585c0c9560 0x7f585c0c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.339+0000 7f5864159640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f585c158ce0 0x7f585c0c2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.339+0000 7f5864159640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c0b41c0 con 0x7f585c158ce0 2023-07-14T13:09:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.339+0000 7f5864159640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c0b3c00 con 0x7f585c0c8ad0 2023-07-14T13:09:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.339+0000 7f5864159640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585c0b3ee0 con 0x7f585c0c9560 2023-07-14T13:09:44.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.339+0000 7f58626f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f585c158ce0 0x7f585c0c2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:44.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.339+0000 7f58626f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f585c158ce0 0x7f585c0c2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48524/0 (socket says 172.21.15.5:48524) 2023-07-14T13:09:44.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.339+0000 7f58626f6640 1 -- 172.21.15.5:0/234069409 learned_addr learned my addr 172.21.15.5:0/234069409 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:44.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.339+0000 7f5861ef5640 1 --2- 172.21.15.5:0/234069409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f585c0c8ad0 0x7f585c14ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:44.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.339+0000 7f58616f4640 1 --2- 172.21.15.5:0/234069409 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f585c0c9560 0x7f585c0c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:44.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.339+0000 7f58626f6640 1 -- 172.21.15.5:0/234069409 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f585c0c9560 msgr2=0x7f585c0c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:44.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.339+0000 7f58626f6640 1 --2- 172.21.15.5:0/234069409 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f585c0c9560 0x7f585c0c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:44.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.339+0000 7f58626f6640 1 -- 172.21.15.5:0/234069409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f585c0c8ad0 msgr2=0x7f585c14ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:44.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.339+0000 7f58626f6640 1 --2- 172.21.15.5:0/234069409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f585c0c8ad0 0x7f585c14ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:44.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.339+0000 7f58626f6640 1 -- 172.21.15.5:0/234069409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584c0094d0 con 0x7f585c158ce0 2023-07-14T13:09:44.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.339+0000 7f58616f4640 1 --2- 172.21.15.5:0/234069409 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f585c0c9560 0x7f585c0c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:44.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.339+0000 7f58626f6640 1 --2- 172.21.15.5:0/234069409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f585c158ce0 0x7f585c0c2d60 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f5854002240 tx=0x7f585400c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:44.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.339+0000 7f58527fc640 1 -- 172.21.15.5:0/234069409 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585400ee50 con 0x7f585c158ce0 2023-07-14T13:09:44.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.339+0000 7f58527fc640 1 -- 172.21.15.5:0/234069409 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58540090d0 con 0x7f585c158ce0 2023-07-14T13:09:44.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.339+0000 7f58527fc640 1 -- 172.21.15.5:0/234069409 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5854009480 con 0x7f585c158ce0 2023-07-14T13:09:44.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.339+0000 7f5864159640 1 -- 172.21.15.5:0/234069409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585c0c2840 con 0x7f585c158ce0 2023-07-14T13:09:44.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.339+0000 7f5864159640 1 -- 172.21.15.5:0/234069409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585c143b50 con 0x7f585c158ce0 2023-07-14T13:09:44.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.339+0000 7f5864159640 1 -- 172.21.15.5:0/234069409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585c0c26a0 con 0x7f585c158ce0 2023-07-14T13:09:44.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.343+0000 7f58527fc640 1 -- 172.21.15.5:0/234069409 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f58540095e0 con 0x7f585c158ce0 2023-07-14T13:09:44.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.343+0000 7f58527fc640 1 --2- 172.21.15.5:0/234069409 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f58400663a0 0x7f5840068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:44.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.343+0000 7f58527fc640 1 -- 172.21.15.5:0/234069409 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5854085610 con 0x7f585c158ce0 2023-07-14T13:09:44.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.343+0000 7f5861ef5640 1 --2- 172.21.15.5:0/234069409 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f58400663a0 0x7f5840068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:44.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.343+0000 7f5861ef5640 1 --2- 172.21.15.5:0/234069409 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f58400663a0 0x7f5840068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f58580098e0 tx=0x7f5858009060 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:44.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.347+0000 7f58527fc640 1 -- 172.21.15.5:0/234069409 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f585c0c26a0 con 0x7f585c158ce0 2023-07-14T13:09:44.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.503+0000 7f5864159640 1 -- 172.21.15.5:0/234069409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f585c0c26a0 con 0x7f585c158ce0 2023-07-14T13:09:44.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.503+0000 7f58527fc640 1 -- 172.21.15.5:0/234069409 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+14593 (secure 0 0 0) 0x7f585c0c26a0 con 0x7f585c158ce0 2023-07-14T13:09:44.534 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:44.535 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":107,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:09:43.722817+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:09:44.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.503+0000 7f5864159640 1 -- 172.21.15.5:0/234069409 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f58400663a0 msgr2=0x7f5840068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:44.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.503+0000 7f5864159640 1 --2- 172.21.15.5:0/234069409 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f58400663a0 0x7f5840068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f58580098e0 tx=0x7f5858009060 comp rx=0 tx=0).stop 2023-07-14T13:09:44.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.507+0000 7f5864159640 1 -- 172.21.15.5:0/234069409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f585c158ce0 msgr2=0x7f585c0c2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:44.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.507+0000 7f5864159640 1 --2- 172.21.15.5:0/234069409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f585c158ce0 0x7f585c0c2d60 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f5854002240 tx=0x7f585400c430 comp rx=0 tx=0).stop 2023-07-14T13:09:44.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.507+0000 7f5864159640 1 -- 172.21.15.5:0/234069409 shutdown_connections 2023-07-14T13:09:44.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.507+0000 7f5864159640 1 --2- 172.21.15.5:0/234069409 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f58400663a0 0x7f5840068850 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:44.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.507+0000 7f5864159640 1 --2- 172.21.15.5:0/234069409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f585c158ce0 0x7f585c0c2d60 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:44.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.507+0000 7f5864159640 1 --2- 172.21.15.5:0/234069409 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f585c0c9560 0x7f585c0c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:44.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.507+0000 7f5864159640 1 --2- 172.21.15.5:0/234069409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f585c0c8ad0 0x7f585c14ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:44.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.507+0000 7f5864159640 1 -- 172.21.15.5:0/234069409 >> 172.21.15.5:0/234069409 conn(0x7f585c0afcf0 msgr2=0x7f585c0ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:44.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.507+0000 7f5864159640 1 -- 172.21.15.5:0/234069409 shutdown_connections 2023-07-14T13:09:44.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.507+0000 7f5864159640 1 -- 172.21.15.5:0/234069409 wait complete. 2023-07-14T13:09:44.556 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:09:44.556 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:09:44.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.671+0000 7f6bf2e6d640 1 Processor -- start 2023-07-14T13:09:44.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.671+0000 7f6bf2e6d640 1 -- start start 2023-07-14T13:09:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.675+0000 7f6bf2e6d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6bec069430 0x7f6bec069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.675+0000 7f6bf2e6d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6bec0af2b0 0x7f6bec15a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.675+0000 7f6bf2e6d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bec159d70 con 0x7f6bec070f30 2023-07-14T13:09:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.675+0000 7f6bf2e6d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bec069d40 con 0x7f6bec0af2b0 2023-07-14T13:09:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.675+0000 7f6bf2e6d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bec0c9c60 con 0x7f6bec069430 2023-07-14T13:09:44.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.675+0000 7f6bebfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6bec070f30 0x7f6bec0ad6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56624/0 (socket says 172.21.15.5:56624) 2023-07-14T13:09:44.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.675+0000 7f6bebfff640 1 -- 172.21.15.5:0/2533456666 learned_addr learned my addr 172.21.15.5:0/2533456666 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.675+0000 7f6bf140a640 1 --2- 172.21.15.5:0/2533456666 >> v2:172.21.15.5:3300/0 conn(0x7f6bec0af2b0 0x7f6bec15a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.675+0000 7f6bf0c09640 1 --2- 172.21.15.5:0/2533456666 >> v2:172.21.15.154:3300/0 conn(0x7f6bec069430 0x7f6bec069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.675+0000 7f6beb7fe640 1 -- 172.21.15.5:0/2533456666 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1658684921 0 0) 0x7f6bd8001120 con 0x7f6bec070f30 2023-07-14T13:09:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.675+0000 7f6beb7fe640 1 -- 172.21.15.5:0/2533456666 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bdc003530 con 0x7f6bec070f30 2023-07-14T13:09:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.675+0000 7f6bf140a640 1 -- 172.21.15.5:0/2533456666 >> v2:172.21.15.154:3300/0 conn(0x7f6bec069430 msgr2=0x7f6bec069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.675+0000 7f6bf140a640 1 --2- 172.21.15.5:0/2533456666 >> v2:172.21.15.154:3300/0 conn(0x7f6bec069430 0x7f6bec069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.675+0000 7f6bf140a640 1 -- 172.21.15.5:0/2533456666 >> v1:172.21.15.5:6789/0 conn(0x7f6bec070f30 legacy=0x7f6bec0ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.675+0000 7f6bf140a640 1 -- 172.21.15.5:0/2533456666 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bec0c9f40 con 0x7f6bec0af2b0 2023-07-14T13:09:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.679+0000 7f6bf140a640 1 --2- 172.21.15.5:0/2533456666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bec0af2b0 0x7f6bec15a1f0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f6bec071910 tx=0x7f6be401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e95571f4ac06cfa7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:44.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.679+0000 7f6beb7fe640 1 -- 172.21.15.5:0/2533456666 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be40a58e0 con 0x7f6bec0af2b0 2023-07-14T13:09:44.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.679+0000 7f6beb7fe640 1 -- 172.21.15.5:0/2533456666 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be40a5a40 con 0x7f6bec0af2b0 2023-07-14T13:09:44.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.679+0000 7f6beb7fe640 1 -- 172.21.15.5:0/2533456666 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be40a5db0 con 0x7f6bec0af2b0 2023-07-14T13:09:44.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.679+0000 7f6bf2e6d640 1 -- 172.21.15.5:0/2533456666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bec0af2b0 msgr2=0x7f6bec15a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:44.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.679+0000 7f6bf2e6d640 1 --2- 172.21.15.5:0/2533456666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bec0af2b0 0x7f6bec15a1f0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f6bec071910 tx=0x7f6be401c910 comp rx=0 tx=0).stop 2023-07-14T13:09:44.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.679+0000 7f6bf2e6d640 1 -- 172.21.15.5:0/2533456666 shutdown_connections 2023-07-14T13:09:44.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.679+0000 7f6bf2e6d640 1 --2- 172.21.15.5:0/2533456666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bec0af2b0 0x7f6bec15a1f0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:44.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.679+0000 7f6bf2e6d640 1 --2- 172.21.15.5:0/2533456666 >> v2:172.21.15.154:3300/0 conn(0x7f6bec069430 0x7f6bec069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:44.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.679+0000 7f6bf2e6d640 1 -- 172.21.15.5:0/2533456666 >> 172.21.15.5:0/2533456666 conn(0x7f6bec0cde90 msgr2=0x7f6bec0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.679+0000 7f6bf2e6d640 1 -- 172.21.15.5:0/2533456666 shutdown_connections 2023-07-14T13:09:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.679+0000 7f6bf2e6d640 1 -- 172.21.15.5:0/2533456666 wait complete. 2023-07-14T13:09:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.679+0000 7f6bf2e6d640 1 Processor -- start 2023-07-14T13:09:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.679+0000 7f6bf2e6d640 1 -- start start 2023-07-14T13:09:44.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.683+0000 7f6bf2e6d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bec069430 0x7f6bec0b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:44.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.683+0000 7f6bf2e6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bec070f30 0x7f6bec13d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:44.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.683+0000 7f6bf2e6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bec0af2b0 0x7f6bec0c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:44.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.683+0000 7f6bf2e6d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec14c360 con 0x7f6bec0af2b0 2023-07-14T13:09:44.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.683+0000 7f6bf2e6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec0b3c90 con 0x7f6bec070f30 2023-07-14T13:09:44.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.683+0000 7f6bf2e6d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec0b10d0 con 0x7f6bec069430 2023-07-14T13:09:44.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.683+0000 7f6bf140a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bec0af2b0 0x7f6bec0c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:44.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.683+0000 7f6bf140a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bec0af2b0 0x7f6bec0c4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48548/0 (socket says 172.21.15.5:48548) 2023-07-14T13:09:44.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.683+0000 7f6bf140a640 1 -- 172.21.15.5:0/3868928387 learned_addr learned my addr 172.21.15.5:0/3868928387 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.683+0000 7f6bf0c09640 1 --2- 172.21.15.5:0/3868928387 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bec069430 0x7f6bec0b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.683+0000 7f6bebfff640 1 --2- 172.21.15.5:0/3868928387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bec070f30 0x7f6bec13d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.683+0000 7f6bf140a640 1 -- 172.21.15.5:0/3868928387 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bec069430 msgr2=0x7f6bec0b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.683+0000 7f6bf140a640 1 --2- 172.21.15.5:0/3868928387 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bec069430 0x7f6bec0b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.683+0000 7f6bf140a640 1 -- 172.21.15.5:0/3868928387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bec070f30 msgr2=0x7f6bec13d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.683+0000 7f6bf140a640 1 --2- 172.21.15.5:0/3868928387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bec070f30 0x7f6bec13d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.683+0000 7f6bf140a640 1 -- 172.21.15.5:0/3868928387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be4009a70 con 0x7f6bec0af2b0 2023-07-14T13:09:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.683+0000 7f6bf140a640 1 --2- 172.21.15.5:0/3868928387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bec0af2b0 0x7f6bec0c4fd0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f6be401a540 tx=0x7f6be40196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.683+0000 7f6be97fa640 1 -- 172.21.15.5:0/3868928387 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4003ba0 con 0x7f6bec0af2b0 2023-07-14T13:09:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.683+0000 7f6be97fa640 1 -- 172.21.15.5:0/3868928387 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be4003d00 con 0x7f6bec0af2b0 2023-07-14T13:09:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.683+0000 7f6be97fa640 1 -- 172.21.15.5:0/3868928387 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4004240 con 0x7f6bec0af2b0 2023-07-14T13:09:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.683+0000 7f6bf2e6d640 1 -- 172.21.15.5:0/3868928387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bec14c550 con 0x7f6bec0af2b0 2023-07-14T13:09:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.683+0000 7f6bf2e6d640 1 -- 172.21.15.5:0/3868928387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bec14cb10 con 0x7f6bec0af2b0 2023-07-14T13:09:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.683+0000 7f6bf2e6d640 1 -- 172.21.15.5:0/3868928387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bec0678d0 con 0x7f6bec0af2b0 2023-07-14T13:09:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.683+0000 7f6be97fa640 1 -- 172.21.15.5:0/3868928387 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6be40b4070 con 0x7f6bec0af2b0 2023-07-14T13:09:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.687+0000 7f6be97fa640 1 --2- 172.21.15.5:0/3868928387 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f6bd00663a0 0x7f6bd0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.687+0000 7f6be97fa640 1 -- 172.21.15.5:0/3868928387 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6be411e7e0 con 0x7f6bec0af2b0 2023-07-14T13:09:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.687+0000 7f6bf0c09640 1 --2- 172.21.15.5:0/3868928387 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f6bd00663a0 0x7f6bd0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.687+0000 7f6bf0c09640 1 --2- 172.21.15.5:0/3868928387 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f6bd00663a0 0x7f6bd0068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0b1000 tx=0x7f6be0008040 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.691+0000 7f6be97fa640 1 -- 172.21.15.5:0/3868928387 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6be40ebe90 con 0x7f6bec0af2b0 2023-07-14T13:09:44.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.843+0000 7f6bf2e6d640 1 -- 172.21.15.5:0/3868928387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6bec070220 con 0x7f6bec0af2b0 2023-07-14T13:09:44.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.847+0000 7f6be97fa640 1 -- 172.21.15.5:0/3868928387 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v107) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6be40ef4b0 con 0x7f6bec0af2b0 2023-07-14T13:09:44.877 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:09:44.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.847+0000 7f6bf2e6d640 1 -- 172.21.15.5:0/3868928387 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f6bd00663a0 msgr2=0x7f6bd0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:44.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.847+0000 7f6bf2e6d640 1 --2- 172.21.15.5:0/3868928387 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f6bd00663a0 0x7f6bd0068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0b1000 tx=0x7f6be0008040 comp rx=0 tx=0).stop 2023-07-14T13:09:44.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.847+0000 7f6bf2e6d640 1 -- 172.21.15.5:0/3868928387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bec0af2b0 msgr2=0x7f6bec0c4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:44.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.847+0000 7f6bf2e6d640 1 --2- 172.21.15.5:0/3868928387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bec0af2b0 0x7f6bec0c4fd0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f6be401a540 tx=0x7f6be40196b0 comp rx=0 tx=0).stop 2023-07-14T13:09:44.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.847+0000 7f6bf2e6d640 1 -- 172.21.15.5:0/3868928387 shutdown_connections 2023-07-14T13:09:44.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.847+0000 7f6bf2e6d640 1 --2- 172.21.15.5:0/3868928387 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f6bd00663a0 0x7f6bd0068850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:44.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.847+0000 7f6bf2e6d640 1 --2- 172.21.15.5:0/3868928387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bec0af2b0 0x7f6bec0c4fd0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:44.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.847+0000 7f6bf2e6d640 1 --2- 172.21.15.5:0/3868928387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bec070f30 0x7f6bec13d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:44.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.847+0000 7f6bf2e6d640 1 --2- 172.21.15.5:0/3868928387 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bec069430 0x7f6bec0b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:44.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.847+0000 7f6bf2e6d640 1 -- 172.21.15.5:0/3868928387 >> 172.21.15.5:0/3868928387 conn(0x7f6bec0cde90 msgr2=0x7f6bec159190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:44.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.847+0000 7f6bf2e6d640 1 -- 172.21.15.5:0/3868928387 shutdown_connections 2023-07-14T13:09:44.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:44.847+0000 7f6bf2e6d640 1 -- 172.21.15.5:0/3868928387 wait complete. 2023-07-14T13:09:44.898 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:09:45.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.015+0000 7f901b434640 1 Processor -- start 2023-07-14T13:09:45.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.015+0000 7f901b434640 1 -- start start 2023-07-14T13:09:45.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.015+0000 7f901b434640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9014069430 0x7f9014069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:45.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.015+0000 7f901b434640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9014070f30 0x7f90140ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:45.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.015+0000 7f901b434640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9014159d70 con 0x7f90140af2b0 2023-07-14T13:09:45.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.015+0000 7f901b434640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9014069d40 con 0x7f9014070f30 2023-07-14T13:09:45.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.015+0000 7f901b434640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90140c9c60 con 0x7f9014069430 2023-07-14T13:09:45.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.015+0000 7f90189cf640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9014070f30 0x7f90140ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:45.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.015+0000 7f90199d1640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f90140af2b0 0x7f901415a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56628/0 (socket says 172.21.15.5:56628) 2023-07-14T13:09:45.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.015+0000 7f90199d1640 1 -- 172.21.15.5:0/2149750131 learned_addr learned my addr 172.21.15.5:0/2149750131 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:45.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.015+0000 7f90191d0640 1 --2- 172.21.15.5:0/2149750131 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9014069430 0x7f9014069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:45.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.015+0000 7f90189cf640 1 -- 172.21.15.5:0/2149750131 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9014069430 msgr2=0x7f9014069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:45.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.015+0000 7f90189cf640 1 --2- 172.21.15.5:0/2149750131 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9014069430 0x7f9014069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:45.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.015+0000 7f90189cf640 1 -- 172.21.15.5:0/2149750131 >> v1:172.21.15.5:6789/0 conn(0x7f90140af2b0 legacy=0x7f901415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:45.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.015+0000 7f90189cf640 1 -- 172.21.15.5:0/2149750131 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90140c9f40 con 0x7f9014070f30 2023-07-14T13:09:45.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.019+0000 7f90189cf640 1 --2- 172.21.15.5:0/2149750131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9014070f30 0x7f90140ad6f0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f90040097c0 tx=0x7f900401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=253f6d24392fa1e9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:45.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.019+0000 7f900bfff640 1 -- 172.21.15.5:0/2149750131 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90040ab680 con 0x7f9014070f30 2023-07-14T13:09:45.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.019+0000 7f900bfff640 1 -- 172.21.15.5:0/2149750131 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90040ab7e0 con 0x7f9014070f30 2023-07-14T13:09:45.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.019+0000 7f900bfff640 1 -- 172.21.15.5:0/2149750131 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90040abb70 con 0x7f9014070f30 2023-07-14T13:09:45.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.019+0000 7f901b434640 1 -- 172.21.15.5:0/2149750131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9014070f30 msgr2=0x7f90140ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:45.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.019+0000 7f901b434640 1 --2- 172.21.15.5:0/2149750131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9014070f30 0x7f90140ad6f0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f90040097c0 tx=0x7f900401c480 comp rx=0 tx=0).stop 2023-07-14T13:09:45.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.019+0000 7f901b434640 1 -- 172.21.15.5:0/2149750131 shutdown_connections 2023-07-14T13:09:45.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.019+0000 7f901b434640 1 --2- 172.21.15.5:0/2149750131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9014070f30 0x7f90140ad6f0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:45.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.019+0000 7f901b434640 1 --2- 172.21.15.5:0/2149750131 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9014069430 0x7f9014069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:45.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.019+0000 7f901b434640 1 -- 172.21.15.5:0/2149750131 >> 172.21.15.5:0/2149750131 conn(0x7f90140cde90 msgr2=0x7f90140ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:45.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.019+0000 7f901b434640 1 -- 172.21.15.5:0/2149750131 shutdown_connections 2023-07-14T13:09:45.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.019+0000 7f901b434640 1 -- 172.21.15.5:0/2149750131 wait complete. 2023-07-14T13:09:45.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.023+0000 7f901b434640 1 Processor -- start 2023-07-14T13:09:45.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.023+0000 7f901b434640 1 -- start start 2023-07-14T13:09:45.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.023+0000 7f901b434640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9014069430 0x7f9014144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:45.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.023+0000 7f901b434640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9014070f30 0x7f90140c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:45.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.023+0000 7f901b434640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90140af2b0 0x7f9014158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:45.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.023+0000 7f901b434640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90140c3100 con 0x7f90140af2b0 2023-07-14T13:09:45.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.023+0000 7f901b434640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9014144e50 con 0x7f9014070f30 2023-07-14T13:09:45.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.023+0000 7f901b434640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90140c2dd0 con 0x7f9014069430 2023-07-14T13:09:45.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.023+0000 7f90199d1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90140af2b0 0x7f9014158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:45.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.023+0000 7f90199d1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90140af2b0 0x7f9014158b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48574/0 (socket says 172.21.15.5:48574) 2023-07-14T13:09:45.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.023+0000 7f90199d1640 1 -- 172.21.15.5:0/1754529930 learned_addr learned my addr 172.21.15.5:0/1754529930 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:45.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.023+0000 7f90189cf640 1 --2- 172.21.15.5:0/1754529930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9014070f30 0x7f90140c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:45.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.023+0000 7f90191d0640 1 --2- 172.21.15.5:0/1754529930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9014069430 0x7f9014144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:45.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.023+0000 7f90199d1640 1 -- 172.21.15.5:0/1754529930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9014069430 msgr2=0x7f9014144910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:45.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.023+0000 7f90199d1640 1 --2- 172.21.15.5:0/1754529930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9014069430 0x7f9014144910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:45.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.023+0000 7f90199d1640 1 -- 172.21.15.5:0/1754529930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9014070f30 msgr2=0x7f90140c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:45.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.023+0000 7f90199d1640 1 --2- 172.21.15.5:0/1754529930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9014070f30 0x7f90140c6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:45.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.023+0000 7f90199d1640 1 -- 172.21.15.5:0/1754529930 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9004009420 con 0x7f90140af2b0 2023-07-14T13:09:45.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.023+0000 7f90199d1640 1 --2- 172.21.15.5:0/1754529930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90140af2b0 0x7f9014158b50 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f900c00cbc0 tx=0x7f900c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:45.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.023+0000 7f9009ffb640 1 -- 172.21.15.5:0/1754529930 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c00ad40 con 0x7f90140af2b0 2023-07-14T13:09:45.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.023+0000 7f9009ffb640 1 -- 172.21.15.5:0/1754529930 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900c012400 con 0x7f90140af2b0 2023-07-14T13:09:45.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.023+0000 7f9009ffb640 1 -- 172.21.15.5:0/1754529930 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c00aea0 con 0x7f90140af2b0 2023-07-14T13:09:45.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.023+0000 7f901b434640 1 -- 172.21.15.5:0/1754529930 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90140c7770 con 0x7f90140af2b0 2023-07-14T13:09:45.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.023+0000 7f901b434640 1 -- 172.21.15.5:0/1754529930 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90140c7d30 con 0x7f90140af2b0 2023-07-14T13:09:45.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.023+0000 7f901b434640 1 -- 172.21.15.5:0/1754529930 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90140c3270 con 0x7f90140af2b0 2023-07-14T13:09:45.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.027+0000 7f9009ffb640 1 -- 172.21.15.5:0/1754529930 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f900c007070 con 0x7f90140af2b0 2023-07-14T13:09:45.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.027+0000 7f9009ffb640 1 --2- 172.21.15.5:0/1754529930 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f8ff80663a0 0x7f8ff8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:45.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.027+0000 7f9009ffb640 1 -- 172.21.15.5:0/1754529930 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f900c0838b0 con 0x7f90140af2b0 2023-07-14T13:09:45.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.027+0000 7f90191d0640 1 --2- 172.21.15.5:0/1754529930 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f8ff80663a0 0x7f8ff8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:45.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.027+0000 7f90191d0640 1 --2- 172.21.15.5:0/1754529930 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f8ff80663a0 0x7f8ff8068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f901000b930 tx=0x7f9010008040 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:45.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.031+0000 7f9009ffb640 1 -- 172.21.15.5:0/1754529930 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f900c051010 con 0x7f90140af2b0 2023-07-14T13:09:45.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.187+0000 7f901b434640 1 -- 172.21.15.5:0/1754529930 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9014159d70 con 0x7f90140af2b0 2023-07-14T13:09:45.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.187+0000 7f9009ffb640 1 -- 172.21.15.5:0/1754529930 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v107) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9014159d70 con 0x7f90140af2b0 2023-07-14T13:09:45.218 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:09:45.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.187+0000 7f901b434640 1 -- 172.21.15.5:0/1754529930 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f8ff80663a0 msgr2=0x7f8ff8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:45.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.187+0000 7f901b434640 1 --2- 172.21.15.5:0/1754529930 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f8ff80663a0 0x7f8ff8068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f901000b930 tx=0x7f9010008040 comp rx=0 tx=0).stop 2023-07-14T13:09:45.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.187+0000 7f901b434640 1 -- 172.21.15.5:0/1754529930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90140af2b0 msgr2=0x7f9014158b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:45.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.187+0000 7f901b434640 1 --2- 172.21.15.5:0/1754529930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90140af2b0 0x7f9014158b50 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f900c00cbc0 tx=0x7f900c00a430 comp rx=0 tx=0).stop 2023-07-14T13:09:45.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.187+0000 7f901b434640 1 -- 172.21.15.5:0/1754529930 shutdown_connections 2023-07-14T13:09:45.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.187+0000 7f901b434640 1 --2- 172.21.15.5:0/1754529930 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f8ff80663a0 0x7f8ff8068850 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:45.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.187+0000 7f901b434640 1 --2- 172.21.15.5:0/1754529930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90140af2b0 0x7f9014158b50 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:45.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.187+0000 7f901b434640 1 --2- 172.21.15.5:0/1754529930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9014070f30 0x7f90140c6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:45.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.187+0000 7f901b434640 1 --2- 172.21.15.5:0/1754529930 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9014069430 0x7f9014144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:45.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.187+0000 7f901b434640 1 -- 172.21.15.5:0/1754529930 >> 172.21.15.5:0/1754529930 conn(0x7f90140cde90 msgr2=0x7f90140cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:45.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.187+0000 7f901b434640 1 -- 172.21.15.5:0/1754529930 shutdown_connections 2023-07-14T13:09:45.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.191+0000 7f901b434640 1 -- 172.21.15.5:0/1754529930 wait complete. 2023-07-14T13:09:45.239 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-14T13:09:45.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.351+0000 7fe5c449c640 1 Processor -- start 2023-07-14T13:09:45.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.351+0000 7fe5c449c640 1 -- start start 2023-07-14T13:09:45.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.351+0000 7fe5c449c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe5bc0c8ad0 0x7fe5bc0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:45.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.351+0000 7fe5c449c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5bc0c9560 0x7fe5bc0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:45.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.351+0000 7fe5c449c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5bc0cc700 con 0x7fe5bc158ce0 2023-07-14T13:09:45.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.351+0000 7fe5c449c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5bc0c99e0 con 0x7fe5bc0c8ad0 2023-07-14T13:09:45.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.351+0000 7fe5c449c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc0b0ff0 con 0x7fe5bc0c9560 2023-07-14T13:09:45.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.351+0000 7fe5c1a37640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe5bc0c8ad0 0x7fe5bc0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:45.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.351+0000 7fe5c1a37640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe5bc0c8ad0 0x7fe5bc0c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48590/0 (socket says 172.21.15.5:48590) 2023-07-14T13:09:45.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.351+0000 7fe5c1a37640 1 -- 172.21.15.5:0/1680021608 learned_addr learned my addr 172.21.15.5:0/1680021608 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:45.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.351+0000 7fe5c2a39640 1 --2- 172.21.15.5:0/1680021608 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5bc0c9560 0x7fe5bc0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:45.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.351+0000 7fe5c1a37640 1 -- 172.21.15.5:0/1680021608 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5bc0c9560 msgr2=0x7fe5bc0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:45.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.351+0000 7fe5c1a37640 1 --2- 172.21.15.5:0/1680021608 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5bc0c9560 0x7fe5bc0ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:45.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.351+0000 7fe5c1a37640 1 -- 172.21.15.5:0/1680021608 >> v1:172.21.15.154:6789/0 conn(0x7fe5bc158ce0 legacy=0x7fe5bc070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:45.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.351+0000 7fe5c1a37640 1 -- 172.21.15.5:0/1680021608 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc070c80 con 0x7fe5bc0c8ad0 2023-07-14T13:09:45.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.355+0000 7fe5c1a37640 1 --2- 172.21.15.5:0/1680021608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5bc0c8ad0 0x7fe5bc0c9020 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac009870 tx=0x7fe5ac01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7583bfaa632b6792 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:45.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.355+0000 7fe5c1236640 1 -- 172.21.15.5:0/1680021608 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac0ab5f0 con 0x7fe5bc0c8ad0 2023-07-14T13:09:45.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.355+0000 7fe5c1236640 1 -- 172.21.15.5:0/1680021608 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ac0ab750 con 0x7fe5bc0c8ad0 2023-07-14T13:09:45.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.355+0000 7fe5c1236640 1 -- 172.21.15.5:0/1680021608 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac0abae0 con 0x7fe5bc0c8ad0 2023-07-14T13:09:45.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.355+0000 7fe5c449c640 1 -- 172.21.15.5:0/1680021608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5bc0c8ad0 msgr2=0x7fe5bc0c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:45.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.355+0000 7fe5c449c640 1 --2- 172.21.15.5:0/1680021608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5bc0c8ad0 0x7fe5bc0c9020 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac009870 tx=0x7fe5ac01c3f0 comp rx=0 tx=0).stop 2023-07-14T13:09:45.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.355+0000 7fe5c449c640 1 -- 172.21.15.5:0/1680021608 shutdown_connections 2023-07-14T13:09:45.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.355+0000 7fe5c449c640 1 --2- 172.21.15.5:0/1680021608 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5bc0c9560 0x7fe5bc0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:45.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.355+0000 7fe5c449c640 1 --2- 172.21.15.5:0/1680021608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5bc0c8ad0 0x7fe5bc0c9020 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:45.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.355+0000 7fe5c449c640 1 -- 172.21.15.5:0/1680021608 >> 172.21.15.5:0/1680021608 conn(0x7fe5bc0afcf0 msgr2=0x7fe5bc0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:45.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.355+0000 7fe5c449c640 1 -- 172.21.15.5:0/1680021608 shutdown_connections 2023-07-14T13:09:45.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.355+0000 7fe5c449c640 1 -- 172.21.15.5:0/1680021608 wait complete. 2023-07-14T13:09:45.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.359+0000 7fe5c449c640 1 Processor -- start 2023-07-14T13:09:45.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.359+0000 7fe5c449c640 1 -- start start 2023-07-14T13:09:45.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.359+0000 7fe5c449c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5bc0c8ad0 0x7fe5bc0c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:45.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.359+0000 7fe5c449c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5bc0c9560 0x7fe5bc13b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:45.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.359+0000 7fe5c449c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5bc158ce0 0x7fe5bc13b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:45.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.359+0000 7fe5c449c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc148c80 con 0x7fe5bc158ce0 2023-07-14T13:09:45.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.359+0000 7fe5c449c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc0c53f0 con 0x7fe5bc0c9560 2023-07-14T13:09:45.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.359+0000 7fe5c449c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc0c56d0 con 0x7fe5bc0c8ad0 2023-07-14T13:09:45.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.359+0000 7fe5c2a39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5bc158ce0 0x7fe5bc13b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:45.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.359+0000 7fe5c2a39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5bc158ce0 0x7fe5bc13b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48604/0 (socket says 172.21.15.5:48604) 2023-07-14T13:09:45.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.359+0000 7fe5c2a39640 1 -- 172.21.15.5:0/2449509720 learned_addr learned my addr 172.21.15.5:0/2449509720 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:45.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.359+0000 7fe5c1a37640 1 --2- 172.21.15.5:0/2449509720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5bc0c9560 0x7fe5bc13b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:45.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.359+0000 7fe5c2238640 1 --2- 172.21.15.5:0/2449509720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5bc0c8ad0 0x7fe5bc0c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:45.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.359+0000 7fe5c2a39640 1 -- 172.21.15.5:0/2449509720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5bc0c8ad0 msgr2=0x7fe5bc0c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:45.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.359+0000 7fe5c2a39640 1 --2- 172.21.15.5:0/2449509720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5bc0c8ad0 0x7fe5bc0c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:45.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.359+0000 7fe5c2a39640 1 -- 172.21.15.5:0/2449509720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5bc0c9560 msgr2=0x7fe5bc13b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:45.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.359+0000 7fe5c2a39640 1 --2- 172.21.15.5:0/2449509720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5bc0c9560 0x7fe5bc13b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:45.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.359+0000 7fe5c2a39640 1 -- 172.21.15.5:0/2449509720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ac0094d0 con 0x7fe5bc158ce0 2023-07-14T13:09:45.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.359+0000 7fe5c1a37640 1 --2- 172.21.15.5:0/2449509720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5bc0c9560 0x7fe5bc13b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:45.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.359+0000 7fe5c2a39640 1 --2- 172.21.15.5:0/2449509720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5bc158ce0 0x7fe5bc13b170 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4007e40 tx=0x7fe5b400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:45.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.359+0000 7fe5b2ffd640 1 -- 172.21.15.5:0/2449509720 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4014620 con 0x7fe5bc158ce0 2023-07-14T13:09:45.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.359+0000 7fe5b2ffd640 1 -- 172.21.15.5:0/2449509720 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b400ee90 con 0x7fe5bc158ce0 2023-07-14T13:09:45.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.359+0000 7fe5b2ffd640 1 -- 172.21.15.5:0/2449509720 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b40149e0 con 0x7fe5bc158ce0 2023-07-14T13:09:45.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.359+0000 7fe5c449c640 1 -- 172.21.15.5:0/2449509720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5bc0b3640 con 0x7fe5bc158ce0 2023-07-14T13:09:45.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.359+0000 7fe5c449c640 1 -- 172.21.15.5:0/2449509720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5bc0b3e40 con 0x7fe5bc158ce0 2023-07-14T13:09:45.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.363+0000 7fe5c449c640 1 -- 172.21.15.5:0/2449509720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5bc0ca1a0 con 0x7fe5bc158ce0 2023-07-14T13:09:45.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.363+0000 7fe5b2ffd640 1 -- 172.21.15.5:0/2449509720 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe5b4014b40 con 0x7fe5bc158ce0 2023-07-14T13:09:45.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.363+0000 7fe5b2ffd640 1 --2- 172.21.15.5:0/2449509720 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fe5a00663a0 0x7fe5a0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:45.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.363+0000 7fe5b2ffd640 1 -- 172.21.15.5:0/2449509720 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe5b40844b0 con 0x7fe5bc158ce0 2023-07-14T13:09:45.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.363+0000 7fe5c2238640 1 --2- 172.21.15.5:0/2449509720 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fe5a00663a0 0x7fe5a0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:45.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.363+0000 7fe5c2238640 1 --2- 172.21.15.5:0/2449509720 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fe5a00663a0 0x7fe5a0068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8000f70 tx=0x7fe5b8009040 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:45.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.367+0000 7fe5b2ffd640 1 -- 172.21.15.5:0/2449509720 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe5b4051b60 con 0x7fe5bc158ce0 2023-07-14T13:09:45.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.523+0000 7fe5c449c640 1 -- 172.21.15.5:0/2449509720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe5bc0678d0 con 0x7fe5bc158ce0 2023-07-14T13:09:45.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.523+0000 7fe5b2ffd640 1 -- 172.21.15.5:0/2449509720 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v107) v1 ==== 84+0+126 (secure 0 0 0) 0x7fe5b4055180 con 0x7fe5bc158ce0 2023-07-14T13:09:45.556 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:45.556 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-07-14T13:09:45.556 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:45.556 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-07-14T13:09:45.556 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-07-14T13:09:45.556 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:09:45.556 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:09:45.557 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 2, 2023-07-14T13:09:45.557 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": "rbd" 2023-07-14T13:09:45.557 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:09:45.557 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-07-14T13:09:45.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.527+0000 7fe5c449c640 1 -- 172.21.15.5:0/2449509720 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fe5a00663a0 msgr2=0x7fe5a0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:45.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.527+0000 7fe5c449c640 1 --2- 172.21.15.5:0/2449509720 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fe5a00663a0 0x7fe5a0068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8000f70 tx=0x7fe5b8009040 comp rx=0 tx=0).stop 2023-07-14T13:09:45.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.527+0000 7fe5c449c640 1 -- 172.21.15.5:0/2449509720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5bc158ce0 msgr2=0x7fe5bc13b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:45.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.527+0000 7fe5c449c640 1 --2- 172.21.15.5:0/2449509720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5bc158ce0 0x7fe5bc13b170 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4007e40 tx=0x7fe5b400e4b0 comp rx=0 tx=0).stop 2023-07-14T13:09:45.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.527+0000 7fe5c449c640 1 -- 172.21.15.5:0/2449509720 shutdown_connections 2023-07-14T13:09:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.527+0000 7fe5c449c640 1 --2- 172.21.15.5:0/2449509720 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fe5a00663a0 0x7fe5a0068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.527+0000 7fe5c449c640 1 --2- 172.21.15.5:0/2449509720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5bc158ce0 0x7fe5bc13b170 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.527+0000 7fe5c449c640 1 --2- 172.21.15.5:0/2449509720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5bc0c9560 0x7fe5bc13b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.527+0000 7fe5c449c640 1 --2- 172.21.15.5:0/2449509720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5bc0c8ad0 0x7fe5bc0c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.527+0000 7fe5c449c640 1 -- 172.21.15.5:0/2449509720 >> 172.21.15.5:0/2449509720 conn(0x7fe5bc0afcf0 msgr2=0x7fe5bc0af5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:45.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.527+0000 7fe5c449c640 1 -- 172.21.15.5:0/2449509720 shutdown_connections 2023-07-14T13:09:45.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.527+0000 7fe5c449c640 1 -- 172.21.15.5:0/2449509720 wait complete. 2023-07-14T13:09:45.576 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-14T13:09:45.577 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-14T13:09:45.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.695+0000 7f93bb59e640 1 Processor -- start 2023-07-14T13:09:45.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.695+0000 7f93bb59e640 1 -- start start 2023-07-14T13:09:45.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.695+0000 7f93bb59e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f93bc15bb10 0x7f93bc0ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:45.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.695+0000 7f93bb59e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93bc0b11b0 0x7f93bc0cfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:45.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.695+0000 7f93bb59e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93bc0d0220 0x7f93bc0cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:45.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.695+0000 7f93bb59e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93bc0ce690 con 0x7f93bc0b11b0 2023-07-14T13:09:45.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.695+0000 7f93bb59e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93bc0d1fb0 con 0x7f93bc15bb10 2023-07-14T13:09:45.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.695+0000 7f93bb59e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc0d06a0 con 0x7f93bc0d0220 2023-07-14T13:09:45.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.695+0000 7f93b3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93bc0b11b0 0x7f93bc0cfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:45.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.695+0000 7f93b3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93bc0b11b0 0x7f93bc0cfce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48610/0 (socket says 172.21.15.5:48610) 2023-07-14T13:09:45.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.695+0000 7f93b3fff640 1 -- 172.21.15.5:0/3260453175 learned_addr learned my addr 172.21.15.5:0/3260453175 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:45.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.695+0000 7f93b3fff640 1 -- 172.21.15.5:0/3260453175 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93bc0d0220 msgr2=0x7f93bc0cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:45.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.695+0000 7f93b3fff640 1 --2- 172.21.15.5:0/3260453175 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93bc0d0220 0x7f93bc0cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:45.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.695+0000 7f93b3fff640 1 -- 172.21.15.5:0/3260453175 >> v2:172.21.15.154:3300/0 conn(0x7f93bc15bb10 msgr2=0x7f93bc0ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:45.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.695+0000 7f93ba59c640 1 --2- 172.21.15.5:0/3260453175 >> v2:172.21.15.154:3300/0 conn(0x7f93bc15bb10 0x7f93bc0ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:45.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.695+0000 7f93b3fff640 1 --2- 172.21.15.5:0/3260453175 >> v2:172.21.15.154:3300/0 conn(0x7f93bc15bb10 0x7f93bc0ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:45.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.695+0000 7f93b3fff640 1 -- 172.21.15.5:0/3260453175 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93bc0ceaa0 con 0x7f93bc0b11b0 2023-07-14T13:09:45.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.695+0000 7f93ba59c640 1 --2- 172.21.15.5:0/3260453175 >> v2:172.21.15.154:3300/0 conn(0x7f93bc15bb10 0x7f93bc0ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:09:45.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.699+0000 7f93b3fff640 1 --2- 172.21.15.5:0/3260453175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93bc0b11b0 0x7f93bc0cfce0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0b4ca0 tx=0x7f93a401c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338144ee89a4b092 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:45.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.699+0000 7f93b9d9b640 1 -- 172.21.15.5:0/3260453175 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a40ab600 con 0x7f93bc0b11b0 2023-07-14T13:09:45.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.699+0000 7f93b9d9b640 1 -- 172.21.15.5:0/3260453175 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a40a7050 con 0x7f93bc0b11b0 2023-07-14T13:09:45.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.699+0000 7f93b9d9b640 1 -- 172.21.15.5:0/3260453175 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a40ab980 con 0x7f93bc0b11b0 2023-07-14T13:09:45.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.699+0000 7f93bb59e640 1 -- 172.21.15.5:0/3260453175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93bc0b11b0 msgr2=0x7f93bc0cfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:45.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.699+0000 7f93bb59e640 1 --2- 172.21.15.5:0/3260453175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93bc0b11b0 0x7f93bc0cfce0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0b4ca0 tx=0x7f93a401c180 comp rx=0 tx=0).stop 2023-07-14T13:09:45.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.699+0000 7f93bb59e640 1 -- 172.21.15.5:0/3260453175 shutdown_connections 2023-07-14T13:09:45.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.699+0000 7f93bb59e640 1 --2- 172.21.15.5:0/3260453175 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93bc0d0220 0x7f93bc0cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:45.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.699+0000 7f93bb59e640 1 --2- 172.21.15.5:0/3260453175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93bc0b11b0 0x7f93bc0cfce0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:45.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.699+0000 7f93bb59e640 1 --2- 172.21.15.5:0/3260453175 >> v2:172.21.15.154:3300/0 conn(0x7f93bc15bb10 0x7f93bc0ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:45.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.699+0000 7f93bb59e640 1 -- 172.21.15.5:0/3260453175 >> 172.21.15.5:0/3260453175 conn(0x7f93bc09b480 msgr2=0x7f93bc0d2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:45.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.699+0000 7f93bb59e640 1 -- 172.21.15.5:0/3260453175 shutdown_connections 2023-07-14T13:09:45.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.699+0000 7f93bb59e640 1 -- 172.21.15.5:0/3260453175 wait complete. 2023-07-14T13:09:45.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.703+0000 7f93bb59e640 1 Processor -- start 2023-07-14T13:09:45.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.703+0000 7f93bb59e640 1 -- start start 2023-07-14T13:09:45.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.703+0000 7f93bb59e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93bc0b11b0 0x7f93bc0c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:45.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.703+0000 7f93bb59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93bc0d0220 0x7f93bc157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:45.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.703+0000 7f93bb59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93bc15bb10 0x7f93bc148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:45.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.703+0000 7f93bb59e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc14f7c0 con 0x7f93bc15bb10 2023-07-14T13:09:45.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.703+0000 7f93bb59e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc157490 con 0x7f93bc0d0220 2023-07-14T13:09:45.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.703+0000 7f93bb59e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc14fa10 con 0x7f93bc0b11b0 2023-07-14T13:09:45.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.703+0000 7f93bad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93bc15bb10 0x7f93bc148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:45.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.703+0000 7f93bad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93bc15bb10 0x7f93bc148cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48626/0 (socket says 172.21.15.5:48626) 2023-07-14T13:09:45.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.703+0000 7f93bad9d640 1 -- 172.21.15.5:0/3287535674 learned_addr learned my addr 172.21.15.5:0/3287535674 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:45.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.703+0000 7f93ba59c640 1 --2- 172.21.15.5:0/3287535674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93bc0b11b0 0x7f93bc0c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:45.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.703+0000 7f93b3fff640 1 --2- 172.21.15.5:0/3287535674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93bc0d0220 0x7f93bc157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:45.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.703+0000 7f93bad9d640 1 -- 172.21.15.5:0/3287535674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93bc0b11b0 msgr2=0x7f93bc0c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:45.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.703+0000 7f93bad9d640 1 --2- 172.21.15.5:0/3287535674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93bc0b11b0 0x7f93bc0c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:45.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.703+0000 7f93bad9d640 1 -- 172.21.15.5:0/3287535674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93bc0d0220 msgr2=0x7f93bc157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:45.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.703+0000 7f93bad9d640 1 --2- 172.21.15.5:0/3287535674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93bc0d0220 0x7f93bc157d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.703+0000 7f93bad9d640 1 -- 172.21.15.5:0/3287535674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a40094d0 con 0x7f93bc15bb10 2023-07-14T13:09:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.703+0000 7f93bad9d640 1 --2- 172.21.15.5:0/3287535674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93bc15bb10 0x7f93bc148cc0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f93b400b970 tx=0x7f93b400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.703+0000 7f93b2ffd640 1 -- 172.21.15.5:0/3287535674 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b400cb40 con 0x7f93bc15bb10 2023-07-14T13:09:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.703+0000 7f93b2ffd640 1 -- 172.21.15.5:0/3287535674 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b400ccc0 con 0x7f93bc15bb10 2023-07-14T13:09:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.703+0000 7f93b2ffd640 1 -- 172.21.15.5:0/3287535674 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4014680 con 0x7f93bc15bb10 2023-07-14T13:09:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.703+0000 7f93bb59e640 1 -- 172.21.15.5:0/3287535674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93bc14fcf0 con 0x7f93bc15bb10 2023-07-14T13:09:45.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.703+0000 7f93bb59e640 1 -- 172.21.15.5:0/3287535674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93bc1502b0 con 0x7f93bc15bb10 2023-07-14T13:09:45.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.703+0000 7f93bb59e640 1 -- 172.21.15.5:0/3287535674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93bc04e020 con 0x7f93bc15bb10 2023-07-14T13:09:45.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.707+0000 7f93b2ffd640 1 -- 172.21.15.5:0/3287535674 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f93b401d3b0 con 0x7f93bc15bb10 2023-07-14T13:09:45.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.707+0000 7f93b2ffd640 1 --2- 172.21.15.5:0/3287535674 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f939c0663a0 0x7f939c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:45.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.707+0000 7f93b2ffd640 1 -- 172.21.15.5:0/3287535674 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f93b4083b00 con 0x7f93bc15bb10 2023-07-14T13:09:45.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.707+0000 7f93ba59c640 1 --2- 172.21.15.5:0/3287535674 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f939c0663a0 0x7f939c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:45.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.707+0000 7f93ba59c640 1 --2- 172.21.15.5:0/3287535674 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f939c0663a0 0x7f939c068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0d2970 tx=0x7f93ac008040 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:45.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.711+0000 7f93b2ffd640 1 -- 172.21.15.5:0/3287535674 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f93b4085e60 con 0x7f93bc15bb10 2023-07-14T13:09:45.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:45.867+0000 7f93bb59e640 1 -- 172.21.15.5:0/3287535674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f93bc06a9d0 con 0x7f93bc15bb10 2023-07-14T13:09:46.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.747+0000 7f93b2ffd640 1 -- 172.21.15.5:0/3287535674 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v108) v1 ==== 138+0+0 (secure 0 0 0) 0x7f93b40190b0 con 0x7f93bc15bb10 2023-07-14T13:09:46.780 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-07-14T13:09:46.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.751+0000 7f93bb59e640 1 -- 172.21.15.5:0/3287535674 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f939c0663a0 msgr2=0x7f939c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:46.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.751+0000 7f93bb59e640 1 --2- 172.21.15.5:0/3287535674 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f939c0663a0 0x7f939c068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0d2970 tx=0x7f93ac008040 comp rx=0 tx=0).stop 2023-07-14T13:09:46.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.751+0000 7f93bb59e640 1 -- 172.21.15.5:0/3287535674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93bc15bb10 msgr2=0x7f93bc148cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:46.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.751+0000 7f93bb59e640 1 --2- 172.21.15.5:0/3287535674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93bc15bb10 0x7f93bc148cc0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f93b400b970 tx=0x7f93b400be30 comp rx=0 tx=0).stop 2023-07-14T13:09:46.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.751+0000 7f93bb59e640 1 -- 172.21.15.5:0/3287535674 shutdown_connections 2023-07-14T13:09:46.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.751+0000 7f93bb59e640 1 --2- 172.21.15.5:0/3287535674 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f939c0663a0 0x7f939c068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:46.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.751+0000 7f93bb59e640 1 --2- 172.21.15.5:0/3287535674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93bc15bb10 0x7f93bc148cc0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:46.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.751+0000 7f93bb59e640 1 --2- 172.21.15.5:0/3287535674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93bc0d0220 0x7f93bc157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:46.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.751+0000 7f93bb59e640 1 --2- 172.21.15.5:0/3287535674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f93bc0b11b0 0x7f93bc0c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:46.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.751+0000 7f93bb59e640 1 -- 172.21.15.5:0/3287535674 >> 172.21.15.5:0/3287535674 conn(0x7f93bc09b480 msgr2=0x7f93bc06aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:46.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.751+0000 7f93bb59e640 1 -- 172.21.15.5:0/3287535674 shutdown_connections 2023-07-14T13:09:46.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.755+0000 7f93bb59e640 1 -- 172.21.15.5:0/3287535674 wait complete. 2023-07-14T13:09:46.811 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-14T13:09:46.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.939+0000 7f7aa7448640 1 Processor -- start 2023-07-14T13:09:46.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.939+0000 7f7aa7448640 1 -- start start 2023-07-14T13:09:46.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.939+0000 7f7aa7448640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7aa015fc20 0x7f7aa00cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:46.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.939+0000 7f7aa7448640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7aa0070ed0 0x7f7aa0163c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:46.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.939+0000 7f7aa7448640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa0070b30 con 0x7f7aa006c240 2023-07-14T13:09:46.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.939+0000 7f7aa7448640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa0071370 con 0x7f7aa0070ed0 2023-07-14T13:09:46.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.939+0000 7f7aa7448640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa006b4c0 con 0x7f7aa015fc20 2023-07-14T13:09:46.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.939+0000 7f7aa59e5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7aa0070ed0 0x7f7aa0163c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:46.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.939+0000 7f7aa59e5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7aa0070ed0 0x7f7aa0163c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48638/0 (socket says 172.21.15.5:48638) 2023-07-14T13:09:46.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.939+0000 7f7aa59e5640 1 -- 172.21.15.5:0/940516156 learned_addr learned my addr 172.21.15.5:0/940516156 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:46.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.939+0000 7f7aa51e4640 1 --2- 172.21.15.5:0/940516156 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7aa015fc20 0x7f7aa00cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:46.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.939+0000 7f7aa59e5640 1 -- 172.21.15.5:0/940516156 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7aa015fc20 msgr2=0x7f7aa00cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:46.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.939+0000 7f7aa59e5640 1 --2- 172.21.15.5:0/940516156 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7aa015fc20 0x7f7aa00cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:46.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.939+0000 7f7aa59e5640 1 -- 172.21.15.5:0/940516156 >> v1:172.21.15.154:6789/0 conn(0x7f7aa006c240 legacy=0x7f7aa015fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:46.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.939+0000 7f7aa59e5640 1 -- 172.21.15.5:0/940516156 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa006b760 con 0x7f7aa0070ed0 2023-07-14T13:09:46.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.943+0000 7f7aa59e5640 1 --2- 172.21.15.5:0/940516156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa0070ed0 0x7f7aa0163c30 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009e50 tx=0x7f7a9801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7793ee414649de server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:46.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.943+0000 7f7a97fff640 1 -- 172.21.15.5:0/940516156 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a980a57c0 con 0x7f7aa0070ed0 2023-07-14T13:09:46.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.943+0000 7f7a97fff640 1 -- 172.21.15.5:0/940516156 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a980a5920 con 0x7f7aa0070ed0 2023-07-14T13:09:46.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.943+0000 7f7a97fff640 1 -- 172.21.15.5:0/940516156 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a980a5cb0 con 0x7f7aa0070ed0 2023-07-14T13:09:46.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.943+0000 7f7aa7448640 1 -- 172.21.15.5:0/940516156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa0070ed0 msgr2=0x7f7aa0163c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:46.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.943+0000 7f7aa7448640 1 --2- 172.21.15.5:0/940516156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa0070ed0 0x7f7aa0163c30 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009e50 tx=0x7f7a9801c9e0 comp rx=0 tx=0).stop 2023-07-14T13:09:46.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.943+0000 7f7aa7448640 1 -- 172.21.15.5:0/940516156 shutdown_connections 2023-07-14T13:09:46.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.943+0000 7f7aa7448640 1 --2- 172.21.15.5:0/940516156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa0070ed0 0x7f7aa0163c30 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:46.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.943+0000 7f7aa7448640 1 --2- 172.21.15.5:0/940516156 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7aa015fc20 0x7f7aa00cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:46.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.943+0000 7f7aa7448640 1 -- 172.21.15.5:0/940516156 >> 172.21.15.5:0/940516156 conn(0x7f7aa00afac0 msgr2=0x7f7aa00afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:46.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.943+0000 7f7aa7448640 1 -- 172.21.15.5:0/940516156 shutdown_connections 2023-07-14T13:09:46.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.943+0000 7f7aa7448640 1 -- 172.21.15.5:0/940516156 wait complete. 2023-07-14T13:09:46.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.947+0000 7f7aa7448640 1 Processor -- start 2023-07-14T13:09:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.947+0000 7f7aa7448640 1 -- start start 2023-07-14T13:09:46.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.947+0000 7f7aa7448640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7aa006c240 0x7f7aa0160730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.947+0000 7f7aa7448640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7aa0070ed0 0x7f7aa006f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.947+0000 7f7aa7448640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa015fc20 0x7f7aa0152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.947+0000 7f7aa7448640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa01561e0 con 0x7f7aa015fc20 2023-07-14T13:09:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.947+0000 7f7aa7448640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa0156430 con 0x7f7aa006c240 2023-07-14T13:09:46.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.947+0000 7f7aa7448640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa0156710 con 0x7f7aa0070ed0 2023-07-14T13:09:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.947+0000 7f7aa59e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa015fc20 0x7f7aa0152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:46.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.947+0000 7f7aa59e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa015fc20 0x7f7aa0152b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48640/0 (socket says 172.21.15.5:48640) 2023-07-14T13:09:46.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.947+0000 7f7aa59e5640 1 -- 172.21.15.5:0/3854254002 learned_addr learned my addr 172.21.15.5:0/3854254002 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:46.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.947+0000 7f7aa49e3640 1 --2- 172.21.15.5:0/3854254002 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7aa0070ed0 0x7f7aa006f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:46.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.947+0000 7f7aa51e4640 1 --2- 172.21.15.5:0/3854254002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7aa006c240 0x7f7aa0160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:46.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.947+0000 7f7aa59e5640 1 -- 172.21.15.5:0/3854254002 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7aa0070ed0 msgr2=0x7f7aa006f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:46.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.947+0000 7f7aa59e5640 1 --2- 172.21.15.5:0/3854254002 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7aa0070ed0 0x7f7aa006f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:46.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.947+0000 7f7aa59e5640 1 -- 172.21.15.5:0/3854254002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7aa006c240 msgr2=0x7f7aa0160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:46.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.947+0000 7f7aa59e5640 1 --2- 172.21.15.5:0/3854254002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7aa006c240 0x7f7aa0160730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:46.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.947+0000 7f7aa59e5640 1 -- 172.21.15.5:0/3854254002 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a98009b30 con 0x7f7aa015fc20 2023-07-14T13:09:46.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.947+0000 7f7aa49e3640 1 --2- 172.21.15.5:0/3854254002 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7aa0070ed0 0x7f7aa006f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:09:46.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.947+0000 7f7aa59e5640 1 --2- 172.21.15.5:0/3854254002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa015fc20 0x7f7aa0152b50 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f7a980af040 tx=0x7f7a98019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:46.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.947+0000 7f7a95ffb640 1 -- 172.21.15.5:0/3854254002 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a980b8670 con 0x7f7aa015fc20 2023-07-14T13:09:46.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.947+0000 7f7a95ffb640 1 -- 172.21.15.5:0/3854254002 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a980b87f0 con 0x7f7aa015fc20 2023-07-14T13:09:46.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.947+0000 7f7aa7448640 1 -- 172.21.15.5:0/3854254002 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa01569f0 con 0x7f7aa015fc20 2023-07-14T13:09:46.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.947+0000 7f7a95ffb640 1 -- 172.21.15.5:0/3854254002 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a980b8ba0 con 0x7f7aa015fc20 2023-07-14T13:09:46.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.947+0000 7f7aa7448640 1 -- 172.21.15.5:0/3854254002 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa0160c70 con 0x7f7aa015fc20 2023-07-14T13:09:46.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.951+0000 7f7aa7448640 1 -- 172.21.15.5:0/3854254002 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa00678d0 con 0x7f7aa015fc20 2023-07-14T13:09:46.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.951+0000 7f7a95ffb640 1 -- 172.21.15.5:0/3854254002 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7a980b8d00 con 0x7f7aa015fc20 2023-07-14T13:09:46.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.951+0000 7f7a95ffb640 1 --2- 172.21.15.5:0/3854254002 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f7a840663a0 0x7f7a84068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:46.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.951+0000 7f7a95ffb640 1 -- 172.21.15.5:0/3854254002 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f7a9811f420 con 0x7f7aa015fc20 2023-07-14T13:09:46.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.951+0000 7f7aa51e4640 1 --2- 172.21.15.5:0/3854254002 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f7a840663a0 0x7f7a84068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:46.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.951+0000 7f7aa51e4640 1 --2- 172.21.15.5:0/3854254002 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f7a840663a0 0x7f7a84068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c009a50 tx=0x7f7a9c008040 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:46.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:46.955+0000 7f7a95ffb640 1 -- 172.21.15.5:0/3854254002 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7a980eca10 con 0x7f7aa015fc20 2023-07-14T13:09:47.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.111+0000 7f7aa7448640 1 -- 172.21.15.5:0/3854254002 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7aa0156ea0 con 0x7f7aa015fc20 2023-07-14T13:09:47.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.751+0000 7f7a95ffb640 1 -- 172.21.15.5:0/3854254002 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v109) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7a980f0030 con 0x7f7aa015fc20 2023-07-14T13:09:47.783 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-07-14T13:09:47.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.767+0000 7f7aa7448640 1 -- 172.21.15.5:0/3854254002 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f7a840663a0 msgr2=0x7f7a84068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:47.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.767+0000 7f7aa7448640 1 --2- 172.21.15.5:0/3854254002 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f7a840663a0 0x7f7a84068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c009a50 tx=0x7f7a9c008040 comp rx=0 tx=0).stop 2023-07-14T13:09:47.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.767+0000 7f7aa7448640 1 -- 172.21.15.5:0/3854254002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa015fc20 msgr2=0x7f7aa0152b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:47.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.767+0000 7f7aa7448640 1 --2- 172.21.15.5:0/3854254002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa015fc20 0x7f7aa0152b50 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f7a980af040 tx=0x7f7a98019780 comp rx=0 tx=0).stop 2023-07-14T13:09:47.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.767+0000 7f7aa7448640 1 -- 172.21.15.5:0/3854254002 shutdown_connections 2023-07-14T13:09:47.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.767+0000 7f7aa7448640 1 --2- 172.21.15.5:0/3854254002 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f7a840663a0 0x7f7a84068850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:47.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.771+0000 7f7aa7448640 1 --2- 172.21.15.5:0/3854254002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa015fc20 0x7f7aa0152b50 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:47.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.771+0000 7f7aa7448640 1 --2- 172.21.15.5:0/3854254002 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7aa0070ed0 0x7f7aa006f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:47.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.771+0000 7f7aa7448640 1 --2- 172.21.15.5:0/3854254002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7aa006c240 0x7f7aa0160730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:47.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.771+0000 7f7aa7448640 1 -- 172.21.15.5:0/3854254002 >> 172.21.15.5:0/3854254002 conn(0x7f7aa00afac0 msgr2=0x7f7aa00cad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:47.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.775+0000 7f7aa7448640 1 -- 172.21.15.5:0/3854254002 shutdown_connections 2023-07-14T13:09:47.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.775+0000 7f7aa7448640 1 -- 172.21.15.5:0/3854254002 wait complete. 2023-07-14T13:09:47.828 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-14T13:09:47.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.947+0000 7f3d2eb96640 1 Processor -- start 2023-07-14T13:09:47.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.947+0000 7f3d2eb96640 1 -- start start 2023-07-14T13:09:47.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.947+0000 7f3d2eb96640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3d280aeb40 0x7f3d2815cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:47.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.947+0000 7f3d2eb96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d28159440 0x7f3d280c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:47.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.947+0000 7f3d2eb96640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d281532b0 con 0x7f3d280aef10 2023-07-14T13:09:47.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.947+0000 7f3d2eb96640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d280ca6f0 con 0x7f3d280aeb40 2023-07-14T13:09:47.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.947+0000 7f3d2eb96640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d281599d0 con 0x7f3d28159440 2023-07-14T13:09:47.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.947+0000 7f3d2d133640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d28159440 0x7f3d280c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:47.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.947+0000 7f3d2c932640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3d280aeb40 0x7f3d2815cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:47.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.947+0000 7f3d2d133640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d28159440 0x7f3d280c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:58376/0 (socket says 172.21.15.5:58376) 2023-07-14T13:09:47.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.947+0000 7f3d2d133640 1 -- 172.21.15.5:0/3261779515 learned_addr learned my addr 172.21.15.5:0/3261779515 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:47.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.947+0000 7f3d2d133640 1 -- 172.21.15.5:0/3261779515 >> v2:172.21.15.154:3300/0 conn(0x7f3d280aeb40 msgr2=0x7f3d2815cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.947+0000 7f3d2d133640 1 --2- 172.21.15.5:0/3261779515 >> v2:172.21.15.154:3300/0 conn(0x7f3d280aeb40 0x7f3d2815cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.947+0000 7f3d2d133640 1 -- 172.21.15.5:0/3261779515 >> v1:172.21.15.154:6789/0 conn(0x7f3d280aef10 legacy=0x7f3d28158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.947+0000 7f3d2d133640 1 -- 172.21.15.5:0/3261779515 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d28159cb0 con 0x7f3d28159440 2023-07-14T13:09:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.947+0000 7f3d2c932640 1 --2- 172.21.15.5:0/3261779515 >> v2:172.21.15.154:3300/0 conn(0x7f3d280aeb40 0x7f3d2815cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:09:47.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.951+0000 7f3d2d133640 1 --2- 172.21.15.5:0/3261779515 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d28159440 0x7f3d280c88c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3d2000d150 tx=0x7f3d2001eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e8959431c62bf95 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:47.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.951+0000 7f3d277fe640 1 -- 172.21.15.5:0/3261779515 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2000b2d0 con 0x7f3d28159440 2023-07-14T13:09:47.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.951+0000 7f3d277fe640 1 -- 172.21.15.5:0/3261779515 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2000b430 con 0x7f3d28159440 2023-07-14T13:09:47.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.951+0000 7f3d277fe640 1 -- 172.21.15.5:0/3261779515 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d200a7c40 con 0x7f3d28159440 2023-07-14T13:09:47.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.951+0000 7f3d2eb96640 1 -- 172.21.15.5:0/3261779515 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d28159440 msgr2=0x7f3d280c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:47.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.951+0000 7f3d2eb96640 1 --2- 172.21.15.5:0/3261779515 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d28159440 0x7f3d280c88c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3d2000d150 tx=0x7f3d2001eb50 comp rx=0 tx=0).stop 2023-07-14T13:09:47.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.951+0000 7f3d2eb96640 1 -- 172.21.15.5:0/3261779515 shutdown_connections 2023-07-14T13:09:47.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.951+0000 7f3d2eb96640 1 --2- 172.21.15.5:0/3261779515 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d28159440 0x7f3d280c88c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:47.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.951+0000 7f3d2eb96640 1 --2- 172.21.15.5:0/3261779515 >> v2:172.21.15.154:3300/0 conn(0x7f3d280aeb40 0x7f3d2815cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:47.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.951+0000 7f3d2eb96640 1 -- 172.21.15.5:0/3261779515 >> 172.21.15.5:0/3261779515 conn(0x7f3d280cde90 msgr2=0x7f3d280ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:47.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.951+0000 7f3d2eb96640 1 -- 172.21.15.5:0/3261779515 shutdown_connections 2023-07-14T13:09:47.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.951+0000 7f3d2eb96640 1 -- 172.21.15.5:0/3261779515 wait complete. 2023-07-14T13:09:47.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.955+0000 7f3d2eb96640 1 Processor -- start 2023-07-14T13:09:47.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.955+0000 7f3d2eb96640 1 -- start start 2023-07-14T13:09:47.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.955+0000 7f3d2eb96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d280aeb40 0x7f3d2814ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:47.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.955+0000 7f3d2eb96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d280aef10 0x7f3d2814d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:47.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.955+0000 7f3d2eb96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d28159440 0x7f3d28157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:47.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.955+0000 7f3d2eb96640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d280b1620 con 0x7f3d280aef10 2023-07-14T13:09:47.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.955+0000 7f3d2eb96640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d280701a0 con 0x7f3d280aeb40 2023-07-14T13:09:47.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.955+0000 7f3d2eb96640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2806fec0 con 0x7f3d28159440 2023-07-14T13:09:47.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.955+0000 7f3d27fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d280aef10 0x7f3d2814d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:47.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.955+0000 7f3d27fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d280aef10 0x7f3d2814d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48656/0 (socket says 172.21.15.5:48656) 2023-07-14T13:09:47.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.955+0000 7f3d27fff640 1 -- 172.21.15.5:0/57239851 learned_addr learned my addr 172.21.15.5:0/57239851 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:47.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.955+0000 7f3d2d133640 1 --2- 172.21.15.5:0/57239851 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d28159440 0x7f3d28157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:47.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.955+0000 7f3d2c932640 1 --2- 172.21.15.5:0/57239851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d280aeb40 0x7f3d2814ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:47.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.955+0000 7f3d27fff640 1 -- 172.21.15.5:0/57239851 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d28159440 msgr2=0x7f3d28157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:47.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.955+0000 7f3d27fff640 1 --2- 172.21.15.5:0/57239851 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d28159440 0x7f3d28157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:47.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.955+0000 7f3d27fff640 1 -- 172.21.15.5:0/57239851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d280aeb40 msgr2=0x7f3d2814ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:47.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.955+0000 7f3d27fff640 1 --2- 172.21.15.5:0/57239851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d280aeb40 0x7f3d2814ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:47.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.955+0000 7f3d27fff640 1 -- 172.21.15.5:0/57239851 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1c009420 con 0x7f3d280aef10 2023-07-14T13:09:47.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.955+0000 7f3d2c932640 1 --2- 172.21.15.5:0/57239851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d280aeb40 0x7f3d2814ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:09:47.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.955+0000 7f3d2d133640 1 --2- 172.21.15.5:0/57239851 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d28159440 0x7f3d28157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:09:47.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.955+0000 7f3d27fff640 1 --2- 172.21.15.5:0/57239851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d280aef10 0x7f3d2814d320 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f3d1400c500 tx=0x7f3d1400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:47.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.955+0000 7f3d257fa640 1 -- 172.21.15.5:0/57239851 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d14005220 con 0x7f3d280aef10 2023-07-14T13:09:47.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.955+0000 7f3d257fa640 1 -- 172.21.15.5:0/57239851 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d14005380 con 0x7f3d280aef10 2023-07-14T13:09:47.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.955+0000 7f3d257fa640 1 -- 172.21.15.5:0/57239851 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d14007270 con 0x7f3d280aef10 2023-07-14T13:09:47.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.955+0000 7f3d2eb96640 1 -- 172.21.15.5:0/57239851 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d2000bd40 con 0x7f3d280aef10 2023-07-14T13:09:47.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.955+0000 7f3d2eb96640 1 -- 172.21.15.5:0/57239851 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d280b12b0 con 0x7f3d280aef10 2023-07-14T13:09:47.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.959+0000 7f3d2eb96640 1 -- 172.21.15.5:0/57239851 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d280b17d0 con 0x7f3d280aef10 2023-07-14T13:09:47.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.959+0000 7f3d257fa640 1 -- 172.21.15.5:0/57239851 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3d140073d0 con 0x7f3d280aef10 2023-07-14T13:09:47.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.959+0000 7f3d257fa640 1 --2- 172.21.15.5:0/57239851 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f3d0c0663a0 0x7f3d0c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:47.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.959+0000 7f3d257fa640 1 -- 172.21.15.5:0/57239851 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f3d14084210 con 0x7f3d280aef10 2023-07-14T13:09:47.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.959+0000 7f3d2c932640 1 --2- 172.21.15.5:0/57239851 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f3d0c0663a0 0x7f3d0c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:47.992 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:09:47.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.963+0000 7f3d2c932640 1 --2- 172.21.15.5:0/57239851 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f3d0c0663a0 0x7f3d0c068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c009fd0 tx=0x7f3d1c009190 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:47.996 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:09:47.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:47.963+0000 7f3d257fa640 1 -- 172.21.15.5:0/57239851 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3d14051720 con 0x7f3d280aef10 2023-07-14T13:09:48.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.151+0000 7f3d2eb96640 1 -- 172.21.15.5:0/57239851 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3d280678d0 con 0x7f3d280aef10 2023-07-14T13:09:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.774+0000 7f3d257fa640 1 -- 172.21.15.5:0/57239851 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v45) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3d14054d40 con 0x7f3d280aef10 2023-07-14T13:09:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 13 and data pool 14 2023-07-14T13:09:48.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.794+0000 7f3d2eb96640 1 -- 172.21.15.5:0/57239851 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f3d0c0663a0 msgr2=0x7f3d0c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:48.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.794+0000 7f3d2eb96640 1 --2- 172.21.15.5:0/57239851 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f3d0c0663a0 0x7f3d0c068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c009fd0 tx=0x7f3d1c009190 comp rx=0 tx=0).stop 2023-07-14T13:09:48.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.794+0000 7f3d2eb96640 1 -- 172.21.15.5:0/57239851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d280aef10 msgr2=0x7f3d2814d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:48.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.794+0000 7f3d2eb96640 1 --2- 172.21.15.5:0/57239851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d280aef10 0x7f3d2814d320 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f3d1400c500 tx=0x7f3d1400c9c0 comp rx=0 tx=0).stop 2023-07-14T13:09:48.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.794+0000 7f3d2eb96640 1 -- 172.21.15.5:0/57239851 shutdown_connections 2023-07-14T13:09:48.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.794+0000 7f3d2eb96640 1 --2- 172.21.15.5:0/57239851 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f3d0c0663a0 0x7f3d0c068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:48.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.794+0000 7f3d2eb96640 1 --2- 172.21.15.5:0/57239851 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d28159440 0x7f3d28157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:48.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.794+0000 7f3d2eb96640 1 --2- 172.21.15.5:0/57239851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d280aef10 0x7f3d2814d320 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:48.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.794+0000 7f3d2eb96640 1 --2- 172.21.15.5:0/57239851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d280aeb40 0x7f3d2814ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:48.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.794+0000 7f3d2eb96640 1 -- 172.21.15.5:0/57239851 >> 172.21.15.5:0/57239851 conn(0x7f3d280cde90 msgr2=0x7f3d280ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:48.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.798+0000 7f3d2eb96640 1 -- 172.21.15.5:0/57239851 shutdown_connections 2023-07-14T13:09:48.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.798+0000 7f3d2eb96640 1 -- 172.21.15.5:0/57239851 wait complete. 2023-07-14T13:09:48.853 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:09:48.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.966+0000 7f953887b640 1 Processor -- start 2023-07-14T13:09:48.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.966+0000 7f953887b640 1 -- start start 2023-07-14T13:09:49.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.970+0000 7f953887b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f95340c8ad0 0x7f95340c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:49.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.970+0000 7f953887b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95340c99c0 con 0x7f9534158ce0 2023-07-14T13:09:49.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.970+0000 7f953887b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95340cc700 con 0x7f95340c9560 2023-07-14T13:09:49.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.970+0000 7f953887b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95340b0ff0 con 0x7f95340c8ad0 2023-07-14T13:09:49.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.970+0000 7f953259c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9534158ce0 0x7f9534070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56638/0 (socket says 172.21.15.5:56638) 2023-07-14T13:09:49.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.970+0000 7f953259c640 1 -- 172.21.15.5:0/3598370077 learned_addr learned my addr 172.21.15.5:0/3598370077 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:49.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.970+0000 7f952bfff640 1 --2- 172.21.15.5:0/3598370077 >> v2:172.21.15.5:3300/0 conn(0x7f95340c8ad0 0x7f95340c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:49.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.970+0000 7f9531d9b640 1 -- 172.21.15.5:0/3598370077 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450705725 0 0) 0x7f95340c99c0 con 0x7f9534158ce0 2023-07-14T13:09:49.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.970+0000 7f9531d9b640 1 -- 172.21.15.5:0/3598370077 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9520005740 con 0x7f9534158ce0 2023-07-14T13:09:49.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.970+0000 7f952bfff640 1 -- 172.21.15.5:0/3598370077 >> v1:172.21.15.154:6789/0 conn(0x7f95340c9560 legacy=0x7f95340ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:49.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.970+0000 7f952bfff640 1 -- 172.21.15.5:0/3598370077 >> v1:172.21.15.5:6789/0 conn(0x7f9534158ce0 legacy=0x7f9534070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:49.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.970+0000 7f952bfff640 1 -- 172.21.15.5:0/3598370077 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9534070c80 con 0x7f95340c8ad0 2023-07-14T13:09:49.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.970+0000 7f952bfff640 1 --2- 172.21.15.5:0/3598370077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95340c8ad0 0x7f95340c9020 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f951c0097c0 tx=0x7f951c01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51eadb145c002c0d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:49.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.974+0000 7f9531d9b640 1 -- 172.21.15.5:0/3598370077 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c0ab600 con 0x7f95340c8ad0 2023-07-14T13:09:49.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.974+0000 7f9531d9b640 1 -- 172.21.15.5:0/3598370077 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951c0a7050 con 0x7f95340c8ad0 2023-07-14T13:09:49.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.974+0000 7f9531d9b640 1 -- 172.21.15.5:0/3598370077 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c0ab980 con 0x7f95340c8ad0 2023-07-14T13:09:49.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.974+0000 7f953887b640 1 -- 172.21.15.5:0/3598370077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95340c8ad0 msgr2=0x7f95340c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:49.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.974+0000 7f953887b640 1 --2- 172.21.15.5:0/3598370077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95340c8ad0 0x7f95340c9020 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f951c0097c0 tx=0x7f951c01c330 comp rx=0 tx=0).stop 2023-07-14T13:09:49.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.974+0000 7f953887b640 1 -- 172.21.15.5:0/3598370077 shutdown_connections 2023-07-14T13:09:49.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.974+0000 7f953887b640 1 --2- 172.21.15.5:0/3598370077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95340c8ad0 0x7f95340c9020 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:49.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.974+0000 7f953887b640 1 -- 172.21.15.5:0/3598370077 >> 172.21.15.5:0/3598370077 conn(0x7f95340afcf0 msgr2=0x7f95340b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:49.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.974+0000 7f953887b640 1 -- 172.21.15.5:0/3598370077 shutdown_connections 2023-07-14T13:09:49.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.974+0000 7f953887b640 1 -- 172.21.15.5:0/3598370077 wait complete. 2023-07-14T13:09:49.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.974+0000 7f953887b640 1 Processor -- start 2023-07-14T13:09:49.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.974+0000 7f953887b640 1 -- start start 2023-07-14T13:09:49.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.974+0000 7f953887b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95340c8ad0 0x7f953415bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:49.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.974+0000 7f953887b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95340c9560 0x7f953414e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:49.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.974+0000 7f953887b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9534158ce0 0x7f95341569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:49.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.974+0000 7f953887b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953414f560 con 0x7f95340c9560 2023-07-14T13:09:49.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.974+0000 7f953887b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953414eaa0 con 0x7f95340c8ad0 2023-07-14T13:09:49.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.974+0000 7f953887b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9534156f30 con 0x7f9534158ce0 2023-07-14T13:09:49.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.974+0000 7f952bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95340c9560 0x7f953414e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:49.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.974+0000 7f952bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95340c9560 0x7f953414e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48670/0 (socket says 172.21.15.5:48670) 2023-07-14T13:09:49.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.974+0000 7f952bfff640 1 -- 172.21.15.5:0/1539096798 learned_addr learned my addr 172.21.15.5:0/1539096798 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:49.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.978+0000 7f953259c640 1 --2- 172.21.15.5:0/1539096798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95340c8ad0 0x7f953415bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:49.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.978+0000 7f9532d9d640 1 --2- 172.21.15.5:0/1539096798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9534158ce0 0x7f95341569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:49.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.978+0000 7f952bfff640 1 -- 172.21.15.5:0/1539096798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9534158ce0 msgr2=0x7f95341569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:49.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.978+0000 7f952bfff640 1 --2- 172.21.15.5:0/1539096798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9534158ce0 0x7f95341569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:49.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.978+0000 7f952bfff640 1 -- 172.21.15.5:0/1539096798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95340c8ad0 msgr2=0x7f953415bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:49.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.978+0000 7f952bfff640 1 --2- 172.21.15.5:0/1539096798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95340c8ad0 0x7f953415bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:49.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.978+0000 7f952bfff640 1 -- 172.21.15.5:0/1539096798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951c009420 con 0x7f95340c9560 2023-07-14T13:09:49.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.978+0000 7f953259c640 1 --2- 172.21.15.5:0/1539096798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95340c8ad0 0x7f953415bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:49.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.978+0000 7f952bfff640 1 --2- 172.21.15.5:0/1539096798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95340c9560 0x7f953414e560 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f951c0ae040 tx=0x7f951c0190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:49.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.978+0000 7f952affd640 1 -- 172.21.15.5:0/1539096798 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c0b4410 con 0x7f95340c9560 2023-07-14T13:09:49.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.978+0000 7f952affd640 1 -- 172.21.15.5:0/1539096798 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951c0b4570 con 0x7f95340c9560 2023-07-14T13:09:49.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.978+0000 7f953887b640 1 -- 172.21.15.5:0/1539096798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f953414eee0 con 0x7f95340c9560 2023-07-14T13:09:49.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.978+0000 7f952affd640 1 -- 172.21.15.5:0/1539096798 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c0b4920 con 0x7f95340c9560 2023-07-14T13:09:49.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.978+0000 7f953887b640 1 -- 172.21.15.5:0/1539096798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f953414f180 con 0x7f95340c9560 2023-07-14T13:09:49.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.978+0000 7f953887b640 1 -- 172.21.15.5:0/1539096798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f953414f6a0 con 0x7f95340c9560 2023-07-14T13:09:49.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.978+0000 7f952affd640 1 -- 172.21.15.5:0/1539096798 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f951c0b2040 con 0x7f95340c9560 2023-07-14T13:09:49.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.978+0000 7f952affd640 1 --2- 172.21.15.5:0/1539096798 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f95140663a0 0x7f9514068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:49.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.982+0000 7f952affd640 1 -- 172.21.15.5:0/1539096798 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f951c11dfe0 con 0x7f95340c9560 2023-07-14T13:09:49.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.982+0000 7f953259c640 1 --2- 172.21.15.5:0/1539096798 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f95140663a0 0x7f9514068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:49.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.982+0000 7f953259c640 1 --2- 172.21.15.5:0/1539096798 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f95140663a0 0x7f9514068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f95240011f0 tx=0x7f9524009040 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:49.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:48.982+0000 7f952affd640 1 -- 172.21.15.5:0/1539096798 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f953414f6a0 con 0x7f95340c9560 2023-07-14T13:09:49.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.138+0000 7f953887b640 1 -- 172.21.15.5:0/1539096798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f953414f6a0 con 0x7f95340c9560 2023-07-14T13:09:49.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.142+0000 7f952affd640 1 -- 172.21.15.5:0/1539096798 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+18270 (secure 0 0 0) 0x7f953414f6a0 con 0x7f95340c9560 2023-07-14T13:09:49.172 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:49.173 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":110,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:09:48.156124+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:09:45.916338+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-14T13:09:47.159234+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:09:49.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.142+0000 7f953887b640 1 -- 172.21.15.5:0/1539096798 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f95140663a0 msgr2=0x7f9514068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:49.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.142+0000 7f953887b640 1 --2- 172.21.15.5:0/1539096798 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f95140663a0 0x7f9514068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f95240011f0 tx=0x7f9524009040 comp rx=0 tx=0).stop 2023-07-14T13:09:49.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.142+0000 7f953887b640 1 -- 172.21.15.5:0/1539096798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95340c9560 msgr2=0x7f953414e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:49.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.142+0000 7f953887b640 1 --2- 172.21.15.5:0/1539096798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95340c9560 0x7f953414e560 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f951c0ae040 tx=0x7f951c0190d0 comp rx=0 tx=0).stop 2023-07-14T13:09:49.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.142+0000 7f953887b640 1 -- 172.21.15.5:0/1539096798 shutdown_connections 2023-07-14T13:09:49.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.142+0000 7f953887b640 1 --2- 172.21.15.5:0/1539096798 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f95140663a0 0x7f9514068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:49.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.142+0000 7f953887b640 1 --2- 172.21.15.5:0/1539096798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9534158ce0 0x7f95341569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:49.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.142+0000 7f953887b640 1 --2- 172.21.15.5:0/1539096798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95340c9560 0x7f953414e560 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:49.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.142+0000 7f953887b640 1 --2- 172.21.15.5:0/1539096798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95340c8ad0 0x7f953415bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:49.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.142+0000 7f953887b640 1 -- 172.21.15.5:0/1539096798 >> 172.21.15.5:0/1539096798 conn(0x7f95340afcf0 msgr2=0x7f95340ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:49.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.142+0000 7f953887b640 1 -- 172.21.15.5:0/1539096798 shutdown_connections 2023-07-14T13:09:49.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.142+0000 7f953887b640 1 -- 172.21.15.5:0/1539096798 wait complete. 2023-07-14T13:09:49.193 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:09:49.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f4921e93640 1 Processor -- start 2023-07-14T13:09:49.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f4921e93640 1 -- start start 2023-07-14T13:09:49.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f4921e93640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f491c0c9730 0x7f491c1638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:49.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f4921e93640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f491c0cc700 con 0x7f491c0c8ad0 2023-07-14T13:09:49.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f4921e93640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f491c0b0ff0 con 0x7f491c158ce0 2023-07-14T13:09:49.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f4921e93640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491c070c80 con 0x7f491c0c9730 2023-07-14T13:09:49.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491affd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f491c0c8ad0 0x7f491c0c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56652/0 (socket says 172.21.15.5:56652) 2023-07-14T13:09:49.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491affd640 1 -- 172.21.15.5:0/1613322481 learned_addr learned my addr 172.21.15.5:0/1613322481 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:49.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491bfff640 1 --2- 172.21.15.5:0/1613322481 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f491c0c9730 0x7f491c1638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:49.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491a7fc640 1 -- 172.21.15.5:0/1613322481 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3292971016 0 0) 0x7f491c0cc700 con 0x7f491c0c8ad0 2023-07-14T13:09:49.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491a7fc640 1 -- 172.21.15.5:0/1613322481 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4904005740 con 0x7f491c0c8ad0 2023-07-14T13:09:49.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491a7fc640 1 -- 172.21.15.5:0/1613322481 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3339587316 0 0) 0x7f491c0b0ff0 con 0x7f491c158ce0 2023-07-14T13:09:49.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491a7fc640 1 -- 172.21.15.5:0/1613322481 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f491c0cc700 con 0x7f491c158ce0 2023-07-14T13:09:49.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491a7fc640 1 -- 172.21.15.5:0/1613322481 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 440616500 0 0) 0x7f4904005740 con 0x7f491c0c8ad0 2023-07-14T13:09:49.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491a7fc640 1 -- 172.21.15.5:0/1613322481 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f491c0c9730 msgr2=0x7f491c1638b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:49.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491a7fc640 1 --2- 172.21.15.5:0/1613322481 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f491c0c9730 0x7f491c1638b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:49.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491a7fc640 1 -- 172.21.15.5:0/1613322481 >> v1:172.21.15.154:6789/0 conn(0x7f491c158ce0 legacy=0x7f491c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:49.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491a7fc640 1 -- 172.21.15.5:0/1613322481 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c0cbdd0 con 0x7f491c0c8ad0 2023-07-14T13:09:49.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491a7fc640 1 -- 172.21.15.5:0/1613322481 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f4910001680 con 0x7f491c0c8ad0 2023-07-14T13:09:49.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491bfff640 1 --2- 172.21.15.5:0/1613322481 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f491c0c9730 0x7f491c1638b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:09:49.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491a7fc640 1 -- 172.21.15.5:0/1613322481 >> v1:172.21.15.5:6789/0 conn(0x7f491c0c8ad0 legacy=0x7f491c0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:49.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491a7fc640 1 --2- 172.21.15.5:0/1613322481 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f491c0c9730 0x7f4904005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:49.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491a7fc640 1 --2- 172.21.15.5:0/1613322481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4904006290 0x7f49040069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:49.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491a7fc640 1 --2- 172.21.15.5:0/1613322481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4904006f20 0x7f4904007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:49.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491a7fc640 1 -- 172.21.15.5:0/1613322481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c070c80 con 0x7f4904006290 2023-07-14T13:09:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491a7fc640 1 -- 172.21.15.5:0/1613322481 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490400dd60 con 0x7f4904006f20 2023-07-14T13:09:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491a7fc640 1 -- 172.21.15.5:0/1613322481 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490400df20 con 0x7f491c0c9730 2023-07-14T13:09:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491affd640 1 --2- 172.21.15.5:0/1613322481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4904006290 0x7f49040069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491b7fe640 1 --2- 172.21.15.5:0/1613322481 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f491c0c9730 0x7f4904005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491bfff640 1 --2- 172.21.15.5:0/1613322481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4904006f20 0x7f4904007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:49.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491affd640 1 -- 172.21.15.5:0/1613322481 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f491c0c9730 msgr2=0x7f4904005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491affd640 1 --2- 172.21.15.5:0/1613322481 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f491c0c9730 0x7f4904005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491affd640 1 -- 172.21.15.5:0/1613322481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4904006f20 msgr2=0x7f4904007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491affd640 1 --2- 172.21.15.5:0/1613322481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4904006f20 0x7f4904007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:49.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.306+0000 7f491affd640 1 -- 172.21.15.5:0/1613322481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4914009a70 con 0x7f4904006290 2023-07-14T13:09:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.310+0000 7f491affd640 1 --2- 172.21.15.5:0/1613322481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4904006290 0x7f49040069e0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f491000c160 tx=0x7f491001cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e32c75bd6b26748 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:49.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.310+0000 7f491a7fc640 1 -- 172.21.15.5:0/1613322481 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49100058e0 con 0x7f4904006290 2023-07-14T13:09:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.310+0000 7f491a7fc640 1 -- 172.21.15.5:0/1613322481 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4910005a60 con 0x7f4904006290 2023-07-14T13:09:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.310+0000 7f491a7fc640 1 -- 172.21.15.5:0/1613322481 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4910005e50 con 0x7f4904006290 2023-07-14T13:09:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.310+0000 7f4921e93640 1 -- 172.21.15.5:0/1613322481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4904006290 msgr2=0x7f49040069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.310+0000 7f4921e93640 1 --2- 172.21.15.5:0/1613322481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4904006290 0x7f49040069e0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f491000c160 tx=0x7f491001cb70 comp rx=0 tx=0).stop 2023-07-14T13:09:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.310+0000 7f491bfff640 1 -- 172.21.15.5:0/1613322481 reap_dead start 2023-07-14T13:09:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.310+0000 7f4921e93640 1 -- 172.21.15.5:0/1613322481 shutdown_connections 2023-07-14T13:09:49.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.310+0000 7f4921e93640 1 -- 172.21.15.5:0/1613322481 >> 172.21.15.5:0/1613322481 conn(0x7f491c0afcf0 msgr2=0x7f491c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.310+0000 7f4921e93640 1 -- 172.21.15.5:0/1613322481 shutdown_connections 2023-07-14T13:09:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.310+0000 7f4921e93640 1 -- 172.21.15.5:0/1613322481 wait complete. 2023-07-14T13:09:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.314+0000 7f4921e93640 1 Processor -- start 2023-07-14T13:09:49.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.314+0000 7f4921e93640 1 -- start start 2023-07-14T13:09:49.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.314+0000 7f4921e93640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4904006290 0x7f491c153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:49.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.314+0000 7f4921e93640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f491c071100 0x7f491c0c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.314+0000 7f4921e93640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f491c0c2950 0x7f491c0c2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.314+0000 7f4921e93640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c0c3300 con 0x7f4904006290 2023-07-14T13:09:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.314+0000 7f4921e93640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c0c7b70 con 0x7f491c071100 2023-07-14T13:09:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.314+0000 7f4921e93640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491c0c8380 con 0x7f491c0c2950 2023-07-14T13:09:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.314+0000 7f491b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4904006290 0x7f491c153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.314+0000 7f491b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4904006290 0x7f491c153380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34920/0 (socket says 172.21.15.5:34920) 2023-07-14T13:09:49.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.314+0000 7f491b7fe640 1 -- 172.21.15.5:0/3182615579 learned_addr learned my addr 172.21.15.5:0/3182615579 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:49.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.314+0000 7f491affd640 1 --2- 172.21.15.5:0/3182615579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f491c071100 0x7f491c0c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:49.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.314+0000 7f491bfff640 1 --2- 172.21.15.5:0/3182615579 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f491c0c2950 0x7f491c0c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:49.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.314+0000 7f491b7fe640 1 -- 172.21.15.5:0/3182615579 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f491c0c2950 msgr2=0x7f491c0c2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:49.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.314+0000 7f491b7fe640 1 --2- 172.21.15.5:0/3182615579 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f491c0c2950 0x7f491c0c2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:49.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.314+0000 7f491b7fe640 1 -- 172.21.15.5:0/3182615579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f491c071100 msgr2=0x7f491c0c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:49.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.314+0000 7f491b7fe640 1 --2- 172.21.15.5:0/3182615579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f491c071100 0x7f491c0c1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:49.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.314+0000 7f491b7fe640 1 -- 172.21.15.5:0/3182615579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c0c7dc0 con 0x7f4904006290 2023-07-14T13:09:49.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.314+0000 7f491b7fe640 1 --2- 172.21.15.5:0/3182615579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4904006290 0x7f491c153380 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f490c00e570 tx=0x7f490c00ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:49.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.314+0000 7f4903fff640 1 -- 172.21.15.5:0/3182615579 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c0052e0 con 0x7f4904006290 2023-07-14T13:09:49.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.314+0000 7f4903fff640 1 -- 172.21.15.5:0/3182615579 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490c005460 con 0x7f4904006290 2023-07-14T13:09:49.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.314+0000 7f4903fff640 1 -- 172.21.15.5:0/3182615579 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c003840 con 0x7f4904006290 2023-07-14T13:09:49.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.314+0000 7f4921e93640 1 -- 172.21.15.5:0/3182615579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491c0c80a0 con 0x7f4904006290 2023-07-14T13:09:49.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.318+0000 7f4921e93640 1 -- 172.21.15.5:0/3182615579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f491c1538c0 con 0x7f4904006290 2023-07-14T13:09:49.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.318+0000 7f4921e93640 1 -- 172.21.15.5:0/3182615579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f491c0ca1a0 con 0x7f4904006290 2023-07-14T13:09:49.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.318+0000 7f4903fff640 1 -- 172.21.15.5:0/3182615579 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f490c0039a0 con 0x7f4904006290 2023-07-14T13:09:49.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.318+0000 7f4903fff640 1 --2- 172.21.15.5:0/3182615579 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f49080663a0 0x7f4908068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:49.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.318+0000 7f4903fff640 1 -- 172.21.15.5:0/3182615579 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f490c083b70 con 0x7f4904006290 2023-07-14T13:09:49.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.318+0000 7f491affd640 1 --2- 172.21.15.5:0/3182615579 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f49080663a0 0x7f4908068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:49.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.318+0000 7f491affd640 1 --2- 172.21.15.5:0/3182615579 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f49080663a0 0x7f4908068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f49100aa000 tx=0x7f4910001a00 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:49.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.322+0000 7f4903fff640 1 -- 172.21.15.5:0/3182615579 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f490c051020 con 0x7f4904006290 2023-07-14T13:09:49.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.478+0000 7f4921e93640 1 -- 172.21.15.5:0/3182615579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f491c0678d0 con 0x7f4904006290 2023-07-14T13:09:49.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.478+0000 7f4903fff640 1 -- 172.21.15.5:0/3182615579 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+18270 (secure 0 0 0) 0x7f490c054640 con 0x7f4904006290 2023-07-14T13:09:49.511 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:49.512 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":110,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:09:48.156124+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:09:45.916338+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-14T13:09:47.159234+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:09:49.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.482+0000 7f4921e93640 1 -- 172.21.15.5:0/3182615579 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f49080663a0 msgr2=0x7f4908068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:49.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.482+0000 7f4921e93640 1 --2- 172.21.15.5:0/3182615579 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f49080663a0 0x7f4908068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f49100aa000 tx=0x7f4910001a00 comp rx=0 tx=0).stop 2023-07-14T13:09:49.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.482+0000 7f4921e93640 1 -- 172.21.15.5:0/3182615579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4904006290 msgr2=0x7f491c153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:49.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.482+0000 7f4921e93640 1 --2- 172.21.15.5:0/3182615579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4904006290 0x7f491c153380 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f490c00e570 tx=0x7f490c00ea30 comp rx=0 tx=0).stop 2023-07-14T13:09:49.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.482+0000 7f4921e93640 1 -- 172.21.15.5:0/3182615579 shutdown_connections 2023-07-14T13:09:49.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.482+0000 7f4921e93640 1 --2- 172.21.15.5:0/3182615579 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f49080663a0 0x7f4908068850 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:49.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.482+0000 7f4921e93640 1 --2- 172.21.15.5:0/3182615579 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f491c0c2950 0x7f491c0c2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:49.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.482+0000 7f4921e93640 1 --2- 172.21.15.5:0/3182615579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f491c071100 0x7f491c0c1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:49.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.482+0000 7f4921e93640 1 --2- 172.21.15.5:0/3182615579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4904006290 0x7f491c153380 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:49.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.482+0000 7f4921e93640 1 -- 172.21.15.5:0/3182615579 >> 172.21.15.5:0/3182615579 conn(0x7f491c0afcf0 msgr2=0x7f491c070160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:49.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.482+0000 7f4921e93640 1 -- 172.21.15.5:0/3182615579 shutdown_connections 2023-07-14T13:09:49.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.482+0000 7f4921e93640 1 -- 172.21.15.5:0/3182615579 wait complete. 2023-07-14T13:09:49.533 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-14T13:09:49.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.646+0000 7fb92b937640 1 Processor -- start 2023-07-14T13:09:49.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.646+0000 7fb92b937640 1 -- start start 2023-07-14T13:09:49.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.650+0000 7fb92b937640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb924070a40 0x7fb924164580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:49.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.650+0000 7fb92b937640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb92406e810 con 0x7fb924069b40 2023-07-14T13:09:49.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.650+0000 7fb92b937640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb924071060 con 0x7fb924159be0 2023-07-14T13:09:49.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.650+0000 7fb92b937640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb92406e1c0 con 0x7fb924070a40 2023-07-14T13:09:49.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.650+0000 7fb928ed2640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb924069b40 0x7fb924070330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56654/0 (socket says 172.21.15.5:56654) 2023-07-14T13:09:49.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.650+0000 7fb928ed2640 1 -- 172.21.15.5:0/1758314958 learned_addr learned my addr 172.21.15.5:0/1758314958 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:49.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.650+0000 7fb929ed4640 1 --2- 172.21.15.5:0/1758314958 >> v2:172.21.15.154:3300/0 conn(0x7fb924070a40 0x7fb924164580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:49.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.650+0000 7fb91bfff640 1 -- 172.21.15.5:0/1758314958 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 787748682 0 0) 0x7fb92406e810 con 0x7fb924069b40 2023-07-14T13:09:49.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.650+0000 7fb91bfff640 1 -- 172.21.15.5:0/1758314958 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb910003530 con 0x7fb924069b40 2023-07-14T13:09:49.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.650+0000 7fb91bfff640 1 -- 172.21.15.5:0/1758314958 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2500733602 0 0) 0x7fb924071060 con 0x7fb924159be0 2023-07-14T13:09:49.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.650+0000 7fb91bfff640 1 -- 172.21.15.5:0/1758314958 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb92406e810 con 0x7fb924159be0 2023-07-14T13:09:49.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.650+0000 7fb91bfff640 1 -- 172.21.15.5:0/1758314958 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1924439522 0 0) 0x7fb910003530 con 0x7fb924069b40 2023-07-14T13:09:49.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.650+0000 7fb929ed4640 1 -- 172.21.15.5:0/1758314958 >> v1:172.21.15.154:6789/0 conn(0x7fb924159be0 legacy=0x7fb924069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:49.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.650+0000 7fb929ed4640 1 -- 172.21.15.5:0/1758314958 >> v1:172.21.15.5:6789/0 conn(0x7fb924069b40 legacy=0x7fb924070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:49.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.650+0000 7fb929ed4640 1 -- 172.21.15.5:0/1758314958 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb92406e4a0 con 0x7fb924070a40 2023-07-14T13:09:49.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.654+0000 7fb929ed4640 1 --2- 172.21.15.5:0/1758314958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb924070a40 0x7fb924164580 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb91c009d90 tx=0x7fb91c01c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=915824571e1566c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:49.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.654+0000 7fb91bfff640 1 -- 172.21.15.5:0/1758314958 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb914001680 con 0x7fb924070a40 2023-07-14T13:09:49.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.654+0000 7fb91bfff640 1 -- 172.21.15.5:0/1758314958 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91c0a55c0 con 0x7fb924070a40 2023-07-14T13:09:49.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.654+0000 7fb91bfff640 1 -- 172.21.15.5:0/1758314958 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91c0a5950 con 0x7fb924070a40 2023-07-14T13:09:49.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.654+0000 7fb92b937640 1 -- 172.21.15.5:0/1758314958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb924070a40 msgr2=0x7fb924164580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:49.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.654+0000 7fb92b937640 1 --2- 172.21.15.5:0/1758314958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb924070a40 0x7fb924164580 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb91c009d90 tx=0x7fb91c01c7a0 comp rx=0 tx=0).stop 2023-07-14T13:09:49.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.654+0000 7fb92b937640 1 -- 172.21.15.5:0/1758314958 shutdown_connections 2023-07-14T13:09:49.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.654+0000 7fb92b937640 1 --2- 172.21.15.5:0/1758314958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb924070a40 0x7fb924164580 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:49.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.654+0000 7fb92b937640 1 -- 172.21.15.5:0/1758314958 >> 172.21.15.5:0/1758314958 conn(0x7fb9240b1840 msgr2=0x7fb9240cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:49.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.654+0000 7fb92b937640 1 -- 172.21.15.5:0/1758314958 shutdown_connections 2023-07-14T13:09:49.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.654+0000 7fb92b937640 1 -- 172.21.15.5:0/1758314958 wait complete. 2023-07-14T13:09:49.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.654+0000 7fb92b937640 1 Processor -- start 2023-07-14T13:09:49.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.654+0000 7fb92b937640 1 -- start start 2023-07-14T13:09:49.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.658+0000 7fb92b937640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb924069b40 0x7fb9240cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:49.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.658+0000 7fb92b937640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb924070a40 0x7fb92414c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:49.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.658+0000 7fb92b937640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb924159be0 0x7fb924156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:49.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.658+0000 7fb92b937640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9240cd6e0 con 0x7fb924069b40 2023-07-14T13:09:49.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.658+0000 7fb92b937640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92414b660 con 0x7fb924070a40 2023-07-14T13:09:49.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.658+0000 7fb92b937640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb92414ca40 con 0x7fb924159be0 2023-07-14T13:09:49.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.658+0000 7fb9296d3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb924069b40 0x7fb9240cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:49.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.658+0000 7fb9296d3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb924069b40 0x7fb9240cdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34928/0 (socket says 172.21.15.5:34928) 2023-07-14T13:09:49.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.658+0000 7fb9296d3640 1 -- 172.21.15.5:0/3825660107 learned_addr learned my addr 172.21.15.5:0/3825660107 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:49.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.658+0000 7fb929ed4640 1 --2- 172.21.15.5:0/3825660107 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb924159be0 0x7fb924156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:49.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.658+0000 7fb928ed2640 1 --2- 172.21.15.5:0/3825660107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb924070a40 0x7fb92414c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:49.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.658+0000 7fb9296d3640 1 -- 172.21.15.5:0/3825660107 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb924159be0 msgr2=0x7fb924156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:49.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.658+0000 7fb9296d3640 1 --2- 172.21.15.5:0/3825660107 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb924159be0 0x7fb924156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:49.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.658+0000 7fb9296d3640 1 -- 172.21.15.5:0/3825660107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb924070a40 msgr2=0x7fb92414c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:49.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.658+0000 7fb9296d3640 1 --2- 172.21.15.5:0/3825660107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb924070a40 0x7fb92414c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:49.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.658+0000 7fb9296d3640 1 -- 172.21.15.5:0/3825660107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91c009a70 con 0x7fb924069b40 2023-07-14T13:09:49.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.658+0000 7fb929ed4640 1 --2- 172.21.15.5:0/3825660107 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb924159be0 0x7fb924156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:49.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.658+0000 7fb928ed2640 1 --2- 172.21.15.5:0/3825660107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb924070a40 0x7fb92414c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:49.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.658+0000 7fb9296d3640 1 --2- 172.21.15.5:0/3825660107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb924069b40 0x7fb9240cdb00 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fb92000c460 tx=0x7fb92000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:49.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.658+0000 7fb919ffb640 1 -- 172.21.15.5:0/3825660107 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9200052d0 con 0x7fb924069b40 2023-07-14T13:09:49.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.658+0000 7fb919ffb640 1 -- 172.21.15.5:0/3825660107 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb920005450 con 0x7fb924069b40 2023-07-14T13:09:49.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.658+0000 7fb919ffb640 1 -- 172.21.15.5:0/3825660107 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb920012870 con 0x7fb924069b40 2023-07-14T13:09:49.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.658+0000 7fb92b937640 1 -- 172.21.15.5:0/3825660107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9240ccd40 con 0x7fb924069b40 2023-07-14T13:09:49.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.658+0000 7fb92b937640 1 -- 172.21.15.5:0/3825660107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9240cd300 con 0x7fb924069b40 2023-07-14T13:09:49.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.658+0000 7fb92b937640 1 -- 172.21.15.5:0/3825660107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9240ce040 con 0x7fb924069b40 2023-07-14T13:09:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.662+0000 7fb919ffb640 1 -- 172.21.15.5:0/3825660107 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb9200129d0 con 0x7fb924069b40 2023-07-14T13:09:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.662+0000 7fb919ffb640 1 --2- 172.21.15.5:0/3825660107 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fb9080663a0 0x7fb908068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.662+0000 7fb919ffb640 1 -- 172.21.15.5:0/3825660107 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb9200839c0 con 0x7fb924069b40 2023-07-14T13:09:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.662+0000 7fb928ed2640 1 --2- 172.21.15.5:0/3825660107 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fb9080663a0 0x7fb908068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:49.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.662+0000 7fb928ed2640 1 --2- 172.21.15.5:0/3825660107 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fb9080663a0 0x7fb908068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb924164a90 tx=0x7fb914009040 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.666+0000 7fb919ffb640 1 -- 172.21.15.5:0/3825660107 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb920050d20 con 0x7fb924069b40 2023-07-14T13:09:49.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:49.854+0000 7fb92b937640 1 -- 172.21.15.5:0/3825660107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb9240678d0 con 0x7fb924069b40 2023-07-14T13:09:50.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.782+0000 7fb919ffb640 1 -- 172.21.15.5:0/3825660107 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v48) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb920054340 con 0x7fb924069b40 2023-07-14T13:09:50.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.786+0000 7fb92b937640 1 -- 172.21.15.5:0/3825660107 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fb9080663a0 msgr2=0x7fb908068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:50.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.786+0000 7fb92b937640 1 --2- 172.21.15.5:0/3825660107 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fb9080663a0 0x7fb908068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb924164a90 tx=0x7fb914009040 comp rx=0 tx=0).stop 2023-07-14T13:09:50.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.786+0000 7fb92b937640 1 -- 172.21.15.5:0/3825660107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb924069b40 msgr2=0x7fb9240cdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:50.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.786+0000 7fb92b937640 1 --2- 172.21.15.5:0/3825660107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb924069b40 0x7fb9240cdb00 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fb92000c460 tx=0x7fb92000c920 comp rx=0 tx=0).stop 2023-07-14T13:09:50.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.786+0000 7fb92b937640 1 -- 172.21.15.5:0/3825660107 shutdown_connections 2023-07-14T13:09:50.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.786+0000 7fb92b937640 1 --2- 172.21.15.5:0/3825660107 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fb9080663a0 0x7fb908068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:50.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.786+0000 7fb92b937640 1 --2- 172.21.15.5:0/3825660107 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb924159be0 0x7fb924156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:50.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.786+0000 7fb92b937640 1 --2- 172.21.15.5:0/3825660107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb924070a40 0x7fb92414c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:50.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.786+0000 7fb92b937640 1 --2- 172.21.15.5:0/3825660107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb924069b40 0x7fb9240cdb00 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:50.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.786+0000 7fb92b937640 1 -- 172.21.15.5:0/3825660107 >> 172.21.15.5:0/3825660107 conn(0x7fb9240b1840 msgr2=0x7fb9240cc470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:50.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.786+0000 7fb92b937640 1 -- 172.21.15.5:0/3825660107 shutdown_connections 2023-07-14T13:09:50.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.786+0000 7fb92b937640 1 -- 172.21.15.5:0/3825660107 wait complete. 2023-07-14T13:09:50.841 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-14T13:09:50.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-14T13:09:50.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.962+0000 7f90177fa640 1 Processor -- start 2023-07-14T13:09:50.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.962+0000 7f90177fa640 1 -- start start 2023-07-14T13:09:50.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.962+0000 7f90177fa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f90100af2b0 0x7f90100c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:50.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.962+0000 7f90177fa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90100cd120 0x7f90100cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.962+0000 7f90177fa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90100695b0 con 0x7f90100c3ac0 2023-07-14T13:09:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.962+0000 7f90177fa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9010069890 con 0x7f90100cd120 2023-07-14T13:09:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.962+0000 7f90177fa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9010069b70 con 0x7f90100af2b0 2023-07-14T13:09:50.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.962+0000 7f9015d97640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90100cd120 0x7f90100cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:50.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.962+0000 7f9015d97640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f90100cd120 0x7f90100cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34944/0 (socket says 172.21.15.5:34944) 2023-07-14T13:09:50.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.962+0000 7f9015d97640 1 -- 172.21.15.5:0/1036898423 learned_addr learned my addr 172.21.15.5:0/1036898423 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.962+0000 7f9015596640 1 --1- 172.21.15.5:0/1036898423 >> v1:172.21.15.5:6789/0 conn(0x7f90100c3ac0 0x7f90100ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56660/0 (socket says 172.21.15.5:56660) 2023-07-14T13:09:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.962+0000 7f9014d95640 1 --2- 172.21.15.5:0/1036898423 >> v2:172.21.15.154:3300/0 conn(0x7f90100af2b0 0x7f90100c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.962+0000 7f9015d97640 1 -- 172.21.15.5:0/1036898423 >> v2:172.21.15.154:3300/0 conn(0x7f90100af2b0 msgr2=0x7f90100c2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.962+0000 7f9015d97640 1 --2- 172.21.15.5:0/1036898423 >> v2:172.21.15.154:3300/0 conn(0x7f90100af2b0 0x7f90100c2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.962+0000 7f9015d97640 1 -- 172.21.15.5:0/1036898423 >> v1:172.21.15.5:6789/0 conn(0x7f90100c3ac0 legacy=0x7f90100ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.962+0000 7f9015d97640 1 -- 172.21.15.5:0/1036898423 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9010069e50 con 0x7f90100cd120 2023-07-14T13:09:51.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.966+0000 7f9015d97640 1 --2- 172.21.15.5:0/1036898423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90100cd120 0x7f90100cd570 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f9010071610 tx=0x7f900801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a7792a836ca91 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:51.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.966+0000 7f9007fff640 1 -- 172.21.15.5:0/1036898423 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90080a5710 con 0x7f90100cd120 2023-07-14T13:09:51.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.966+0000 7f9007fff640 1 -- 172.21.15.5:0/1036898423 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90080a5870 con 0x7f90100cd120 2023-07-14T13:09:51.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.966+0000 7f9007fff640 1 -- 172.21.15.5:0/1036898423 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90080a5c00 con 0x7f90100cd120 2023-07-14T13:09:51.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.966+0000 7f90177fa640 1 -- 172.21.15.5:0/1036898423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90100cd120 msgr2=0x7f90100cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:51.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.966+0000 7f90177fa640 1 --2- 172.21.15.5:0/1036898423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90100cd120 0x7f90100cd570 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f9010071610 tx=0x7f900801c940 comp rx=0 tx=0).stop 2023-07-14T13:09:51.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.966+0000 7f90177fa640 1 -- 172.21.15.5:0/1036898423 shutdown_connections 2023-07-14T13:09:51.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.966+0000 7f90177fa640 1 --2- 172.21.15.5:0/1036898423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90100cd120 0x7f90100cd570 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:51.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.966+0000 7f90177fa640 1 --2- 172.21.15.5:0/1036898423 >> v2:172.21.15.154:3300/0 conn(0x7f90100af2b0 0x7f90100c2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:51.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.966+0000 7f90177fa640 1 -- 172.21.15.5:0/1036898423 >> 172.21.15.5:0/1036898423 conn(0x7f90100cde90 msgr2=0x7f90100ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:51.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.966+0000 7f90177fa640 1 -- 172.21.15.5:0/1036898423 shutdown_connections 2023-07-14T13:09:51.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.966+0000 7f90177fa640 1 -- 172.21.15.5:0/1036898423 wait complete. 2023-07-14T13:09:51.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.970+0000 7f90177fa640 1 Processor -- start 2023-07-14T13:09:51.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.970+0000 7f90177fa640 1 -- start start 2023-07-14T13:09:51.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.970+0000 7f90177fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90100af2b0 0x7f9010152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:51.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.970+0000 7f90177fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90100c3ac0 0x7f9010148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:51.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.970+0000 7f90177fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90100cd120 0x7f9010155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:51.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.970+0000 7f90177fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90100b2e90 con 0x7f90100cd120 2023-07-14T13:09:51.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.970+0000 7f90177fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9010149480 con 0x7f90100c3ac0 2023-07-14T13:09:51.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.970+0000 7f90177fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90101560a0 con 0x7f90100af2b0 2023-07-14T13:09:51.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.970+0000 7f9015d97640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90100cd120 0x7f9010155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:51.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.970+0000 7f9015d97640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90100cd120 0x7f9010155b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34956/0 (socket says 172.21.15.5:34956) 2023-07-14T13:09:51.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.970+0000 7f9015d97640 1 -- 172.21.15.5:0/989571037 learned_addr learned my addr 172.21.15.5:0/989571037 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:51.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.970+0000 7f9015596640 1 --2- 172.21.15.5:0/989571037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90100af2b0 0x7f9010152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:51.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.970+0000 7f9014d95640 1 --2- 172.21.15.5:0/989571037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90100c3ac0 0x7f9010148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:51.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.970+0000 7f9015d97640 1 -- 172.21.15.5:0/989571037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90100af2b0 msgr2=0x7f9010152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:51.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.970+0000 7f9015d97640 1 --2- 172.21.15.5:0/989571037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90100af2b0 0x7f9010152900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:51.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.970+0000 7f9015d97640 1 -- 172.21.15.5:0/989571037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90100c3ac0 msgr2=0x7f9010148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:51.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.970+0000 7f9015d97640 1 --2- 172.21.15.5:0/989571037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90100c3ac0 0x7f9010148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:51.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.970+0000 7f9015d97640 1 -- 172.21.15.5:0/989571037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9008009b30 con 0x7f90100cd120 2023-07-14T13:09:51.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.970+0000 7f9015596640 1 --2- 172.21.15.5:0/989571037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90100af2b0 0x7f9010152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:51.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.970+0000 7f9015d97640 1 --2- 172.21.15.5:0/989571037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90100cd120 0x7f9010155b60 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f90080af040 tx=0x7f90080196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:51.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.970+0000 7f9005ffb640 1 -- 172.21.15.5:0/989571037 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90080a5710 con 0x7f90100cd120 2023-07-14T13:09:51.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.970+0000 7f9005ffb640 1 -- 172.21.15.5:0/989571037 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90080b8880 con 0x7f90100cd120 2023-07-14T13:09:51.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.970+0000 7f9005ffb640 1 -- 172.21.15.5:0/989571037 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90080b8c10 con 0x7f90100cd120 2023-07-14T13:09:51.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.970+0000 7f90177fa640 1 -- 172.21.15.5:0/989571037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9010152f10 con 0x7f90100cd120 2023-07-14T13:09:51.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.970+0000 7f90177fa640 1 -- 172.21.15.5:0/989571037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90101534d0 con 0x7f90100cd120 2023-07-14T13:09:51.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.974+0000 7f90177fa640 1 -- 172.21.15.5:0/989571037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90100b2fd0 con 0x7f90100cd120 2023-07-14T13:09:51.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.974+0000 7f9005ffb640 1 -- 172.21.15.5:0/989571037 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f90080b6440 con 0x7f90100cd120 2023-07-14T13:09:51.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.974+0000 7f9005ffb640 1 --2- 172.21.15.5:0/989571037 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f8ff40663a0 0x7f8ff4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:51.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.974+0000 7f9005ffb640 1 -- 172.21.15.5:0/989571037 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f900811f4c0 con 0x7f90100cd120 2023-07-14T13:09:51.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.974+0000 7f9015596640 1 --2- 172.21.15.5:0/989571037 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f8ff40663a0 0x7f8ff4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:51.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.978+0000 7f9015596640 1 --2- 172.21.15.5:0/989571037 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f8ff40663a0 0x7f8ff4068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f900c000f70 tx=0x7f900c007d50 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:51.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:50.978+0000 7f9005ffb640 1 -- 172.21.15.5:0/989571037 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f90100b2fd0 con 0x7f90100cd120 2023-07-14T13:09:51.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.170+0000 7f90177fa640 1 -- 172.21.15.5:0/989571037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f90100b2fd0 con 0x7f90100cd120 2023-07-14T13:09:51.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.790+0000 7f9005ffb640 1 -- 172.21.15.5:0/989571037 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v49) v1 ==== 122+0+0 (secure 0 0 0) 0x7f90100b2fd0 con 0x7f90100cd120 2023-07-14T13:09:51.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.790+0000 7f90177fa640 1 -- 172.21.15.5:0/989571037 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f8ff40663a0 msgr2=0x7f8ff4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:51.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.790+0000 7f90177fa640 1 --2- 172.21.15.5:0/989571037 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f8ff40663a0 0x7f8ff4068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f900c000f70 tx=0x7f900c007d50 comp rx=0 tx=0).stop 2023-07-14T13:09:51.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.790+0000 7f90177fa640 1 -- 172.21.15.5:0/989571037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90100cd120 msgr2=0x7f9010155b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:51.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.790+0000 7f90177fa640 1 --2- 172.21.15.5:0/989571037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90100cd120 0x7f9010155b60 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f90080af040 tx=0x7f90080196e0 comp rx=0 tx=0).stop 2023-07-14T13:09:51.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.790+0000 7f90177fa640 1 -- 172.21.15.5:0/989571037 shutdown_connections 2023-07-14T13:09:51.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.790+0000 7f90177fa640 1 --2- 172.21.15.5:0/989571037 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f8ff40663a0 0x7f8ff4068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:51.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.790+0000 7f90177fa640 1 --2- 172.21.15.5:0/989571037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90100cd120 0x7f9010155b60 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:51.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.790+0000 7f90177fa640 1 --2- 172.21.15.5:0/989571037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90100c3ac0 0x7f9010148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:51.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.790+0000 7f90177fa640 1 --2- 172.21.15.5:0/989571037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f90100af2b0 0x7f9010152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:51.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.790+0000 7f90177fa640 1 -- 172.21.15.5:0/989571037 >> 172.21.15.5:0/989571037 conn(0x7f90100cde90 msgr2=0x7f90100c3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:51.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.794+0000 7f90177fa640 1 -- 172.21.15.5:0/989571037 shutdown_connections 2023-07-14T13:09:51.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.794+0000 7f90177fa640 1 -- 172.21.15.5:0/989571037 wait complete. 2023-07-14T13:09:51.845 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-14T13:09:51.846 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:09:51.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.958+0000 7f7fb1093640 1 Processor -- start 2023-07-14T13:09:51.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.958+0000 7f7fb1093640 1 -- start start 2023-07-14T13:09:51.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.962+0000 7f7fb1093640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7fac069430 0x7f7fac069830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:51.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.962+0000 7f7fb1093640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fac0c9c30 con 0x7f7fac15bc00 2023-07-14T13:09:51.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.962+0000 7f7fb1093640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fac15bfd0 con 0x7f7fac160450 2023-07-14T13:09:51.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.962+0000 7f7fb1093640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fac0c96b0 con 0x7f7fac069430 2023-07-14T13:09:51.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.962+0000 7f7faad9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7fac15bc00 0x7f7fac0ce8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56672/0 (socket says 172.21.15.5:56672) 2023-07-14T13:09:51.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.962+0000 7f7faad9d640 1 -- 172.21.15.5:0/729198403 learned_addr learned my addr 172.21.15.5:0/729198403 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:51.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.962+0000 7f7fab59e640 1 --2- 172.21.15.5:0/729198403 >> v2:172.21.15.5:3300/0 conn(0x7f7fac069430 0x7f7fac069830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:51.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.962+0000 7f7fa9d9b640 1 -- 172.21.15.5:0/729198403 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3674900478 0 0) 0x7f7fac0c9c30 con 0x7f7fac15bc00 2023-07-14T13:09:51.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.962+0000 7f7fa9d9b640 1 -- 172.21.15.5:0/729198403 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f94003530 con 0x7f7fac15bc00 2023-07-14T13:09:51.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.962+0000 7f7fab59e640 1 -- 172.21.15.5:0/729198403 >> v1:172.21.15.154:6789/0 conn(0x7f7fac160450 legacy=0x7f7fac06e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:51.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.962+0000 7f7fab59e640 1 -- 172.21.15.5:0/729198403 >> v1:172.21.15.5:6789/0 conn(0x7f7fac15bc00 legacy=0x7f7fac0ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:51.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.962+0000 7f7fab59e640 1 -- 172.21.15.5:0/729198403 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac069d70 con 0x7f7fac069430 2023-07-14T13:09:51.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.966+0000 7f7fab59e640 1 --2- 172.21.15.5:0/729198403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fac069430 0x7f7fac069830 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009d90 tx=0x7f7fa401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8672a2138646e97 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:51.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.966+0000 7f7fa9d9b640 1 -- 172.21.15.5:0/729198403 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40a59a0 con 0x7f7fac069430 2023-07-14T13:09:51.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.966+0000 7f7fa9d9b640 1 -- 172.21.15.5:0/729198403 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa40a5b00 con 0x7f7fac069430 2023-07-14T13:09:51.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.966+0000 7f7fa9d9b640 1 -- 172.21.15.5:0/729198403 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40a5e70 con 0x7f7fac069430 2023-07-14T13:09:51.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.966+0000 7f7fb1093640 1 -- 172.21.15.5:0/729198403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fac069430 msgr2=0x7f7fac069830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:51.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.966+0000 7f7fb1093640 1 --2- 172.21.15.5:0/729198403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fac069430 0x7f7fac069830 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009d90 tx=0x7f7fa401c8e0 comp rx=0 tx=0).stop 2023-07-14T13:09:51.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.966+0000 7f7fb1093640 1 -- 172.21.15.5:0/729198403 shutdown_connections 2023-07-14T13:09:51.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.966+0000 7f7fb1093640 1 --2- 172.21.15.5:0/729198403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fac069430 0x7f7fac069830 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:51.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.966+0000 7f7fb1093640 1 -- 172.21.15.5:0/729198403 >> 172.21.15.5:0/729198403 conn(0x7f7fac0b1840 msgr2=0x7f7fac0cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:51.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.966+0000 7f7fb1093640 1 -- 172.21.15.5:0/729198403 shutdown_connections 2023-07-14T13:09:51.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.966+0000 7f7fb1093640 1 -- 172.21.15.5:0/729198403 wait complete. 2023-07-14T13:09:51.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.966+0000 7f7fb1093640 1 Processor -- start 2023-07-14T13:09:51.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.966+0000 7f7fb1093640 1 -- start start 2023-07-14T13:09:52.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.970+0000 7f7fb1093640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fac069430 0x7f7fac14efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:52.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.970+0000 7f7fb1093640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7fac15bc00 0x7f7fac06e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:52.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.970+0000 7f7fb1093640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fac160450 0x7f7fac14cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:52.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.970+0000 7f7fb1093640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac154fa0 con 0x7f7fac069430 2023-07-14T13:09:52.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.970+0000 7f7fb1093640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac14d010 con 0x7f7fac160450 2023-07-14T13:09:52.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.970+0000 7f7fb1093640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac15c2b0 con 0x7f7fac15bc00 2023-07-14T13:09:52.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.970+0000 7f7faad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fac069430 0x7f7fac14efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:52.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.970+0000 7f7faad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fac069430 0x7f7fac14efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34978/0 (socket says 172.21.15.5:34978) 2023-07-14T13:09:52.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.970+0000 7f7faad9d640 1 -- 172.21.15.5:0/3097682435 learned_addr learned my addr 172.21.15.5:0/3097682435 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:52.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.970+0000 7f7fab59e640 1 --2- 172.21.15.5:0/3097682435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fac160450 0x7f7fac14cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:52.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.970+0000 7f7faa59c640 1 --2- 172.21.15.5:0/3097682435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7fac15bc00 0x7f7fac06e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:52.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.970+0000 7f7faad9d640 1 -- 172.21.15.5:0/3097682435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7fac15bc00 msgr2=0x7f7fac06e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:52.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.970+0000 7f7faad9d640 1 --2- 172.21.15.5:0/3097682435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7fac15bc00 0x7f7fac06e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:52.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.970+0000 7f7faad9d640 1 -- 172.21.15.5:0/3097682435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fac160450 msgr2=0x7f7fac14cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:52.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.970+0000 7f7faad9d640 1 --2- 172.21.15.5:0/3097682435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fac160450 0x7f7fac14cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:52.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.970+0000 7f7faad9d640 1 -- 172.21.15.5:0/3097682435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa4009a70 con 0x7f7fac069430 2023-07-14T13:09:52.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.970+0000 7f7faa59c640 1 --2- 172.21.15.5:0/3097682435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7fac15bc00 0x7f7fac06e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:09:52.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.970+0000 7f7faad9d640 1 --2- 172.21.15.5:0/3097682435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fac069430 0x7f7fac14efc0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00c3c0 tx=0x7f7f9c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:52.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.970+0000 7f7f937fe640 1 -- 172.21.15.5:0/3097682435 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c005cf0 con 0x7f7fac069430 2023-07-14T13:09:52.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.970+0000 7f7f937fe640 1 -- 172.21.15.5:0/3097682435 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9c005e50 con 0x7f7fac069430 2023-07-14T13:09:52.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.970+0000 7f7fb1093640 1 -- 172.21.15.5:0/3097682435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fac1575f0 con 0x7f7fac069430 2023-07-14T13:09:52.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.970+0000 7f7f937fe640 1 -- 172.21.15.5:0/3097682435 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c0072f0 con 0x7f7fac069430 2023-07-14T13:09:52.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.970+0000 7f7fb1093640 1 -- 172.21.15.5:0/3097682435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fac152fe0 con 0x7f7fac069430 2023-07-14T13:09:52.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.970+0000 7f7fb1093640 1 -- 172.21.15.5:0/3097682435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fac072c30 con 0x7f7fac069430 2023-07-14T13:09:52.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.970+0000 7f7f937fe640 1 -- 172.21.15.5:0/3097682435 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7f9c007450 con 0x7f7fac069430 2023-07-14T13:09:52.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.974+0000 7f7f937fe640 1 --2- 172.21.15.5:0/3097682435 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f7f980663a0 0x7f7f98068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:52.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.974+0000 7f7f937fe640 1 -- 172.21.15.5:0/3097682435 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7f9c0835c0 con 0x7f7fac069430 2023-07-14T13:09:52.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.974+0000 7f7faa59c640 1 --2- 172.21.15.5:0/3097682435 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f7f980663a0 0x7f7f98068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:52.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.974+0000 7f7faa59c640 1 --2- 172.21.15.5:0/3097682435 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f7f980663a0 0x7f7f98068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7fac153fd0 tx=0x7f7fa0009040 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:52.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:51.978+0000 7f7f937fe640 1 -- 172.21.15.5:0/3097682435 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7f9c050800 con 0x7f7fac069430 2023-07-14T13:09:52.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.162+0000 7f7fb1093640 1 -- 172.21.15.5:0/3097682435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fac1531d0 con 0x7f7fac069430 2023-07-14T13:09:52.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.162+0000 7f7f937fe640 1 -- 172.21.15.5:0/3097682435 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4705 (secure 0 0 0) 0x7f7f9c017090 con 0x7f7fac069430 2023-07-14T13:09:52.196 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:52.196 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6575,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1957957644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1957957644},{"type":"v1","addr":"172.21.15.5:6835","nonce":1957957644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3439623726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3439623726},{"type":"v1","addr":"172.21.15.154:6837","nonce":3439623726}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7384,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/692576619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":692576619},{"type":"v1","addr":"172.21.15.154:6836","nonce":692576619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:09:48.156588+0000","modified":"2023-07-14T13:09:51.784254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7668},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7668":{"gid":7668,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/855157103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":855157103},{"type":"v1","addr":"172.21.15.5:6834","nonce":855157103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-14T13:09:52.196 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 49 2023-07-14T13:09:52.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.166+0000 7f7fb1093640 1 -- 172.21.15.5:0/3097682435 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f7f980663a0 msgr2=0x7f7f98068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:52.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.166+0000 7f7fb1093640 1 --2- 172.21.15.5:0/3097682435 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f7f980663a0 0x7f7f98068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7fac153fd0 tx=0x7f7fa0009040 comp rx=0 tx=0).stop 2023-07-14T13:09:52.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.166+0000 7f7fb1093640 1 -- 172.21.15.5:0/3097682435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fac069430 msgr2=0x7f7fac14efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:52.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.166+0000 7f7fb1093640 1 --2- 172.21.15.5:0/3097682435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fac069430 0x7f7fac14efc0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00c3c0 tx=0x7f7f9c00c880 comp rx=0 tx=0).stop 2023-07-14T13:09:52.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.166+0000 7f7fb1093640 1 -- 172.21.15.5:0/3097682435 shutdown_connections 2023-07-14T13:09:52.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.166+0000 7f7fb1093640 1 --2- 172.21.15.5:0/3097682435 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f7f980663a0 0x7f7f98068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:52.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.166+0000 7f7fb1093640 1 --2- 172.21.15.5:0/3097682435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fac160450 0x7f7fac14cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:52.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.166+0000 7f7fb1093640 1 --2- 172.21.15.5:0/3097682435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7fac15bc00 0x7f7fac06e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:52.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.166+0000 7f7fb1093640 1 --2- 172.21.15.5:0/3097682435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fac069430 0x7f7fac14efc0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:52.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.166+0000 7f7fb1093640 1 -- 172.21.15.5:0/3097682435 >> 172.21.15.5:0/3097682435 conn(0x7f7fac0b1840 msgr2=0x7f7fac153460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:52.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.166+0000 7f7fb1093640 1 -- 172.21.15.5:0/3097682435 shutdown_connections 2023-07-14T13:09:52.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.166+0000 7f7fb1093640 1 -- 172.21.15.5:0/3097682435 wait complete. 2023-07-14T13:09:52.217 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:09:52.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.330+0000 7f3132774640 1 Processor -- start 2023-07-14T13:09:52.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.330+0000 7f3132774640 1 -- start start 2023-07-14T13:09:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.330+0000 7f3132774640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f312c0c8ad0 0x7f312c0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.330+0000 7f3132774640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f312c0c9560 0x7f312c0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.330+0000 7f3132774640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f312c0c99c0 con 0x7f312c158ce0 2023-07-14T13:09:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.330+0000 7f3132774640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f312c0cc700 con 0x7f312c0c9560 2023-07-14T13:09:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.330+0000 7f3132774640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f312c0b0ff0 con 0x7f312c0c8ad0 2023-07-14T13:09:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.330+0000 7f312bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f312c158ce0 0x7f312c070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56682/0 (socket says 172.21.15.5:56682) 2023-07-14T13:09:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.330+0000 7f312bfff640 1 -- 172.21.15.5:0/2433381950 learned_addr learned my addr 172.21.15.5:0/2433381950 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.330+0000 7f3130d11640 1 --2- 172.21.15.5:0/2433381950 >> v2:172.21.15.5:3300/0 conn(0x7f312c0c9560 0x7f312c0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:52.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.330+0000 7f312b7fe640 1 --2- 172.21.15.5:0/2433381950 >> v2:172.21.15.154:3300/0 conn(0x7f312c0c8ad0 0x7f312c0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:52.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.330+0000 7f3130d11640 1 -- 172.21.15.5:0/2433381950 >> v2:172.21.15.154:3300/0 conn(0x7f312c0c8ad0 msgr2=0x7f312c0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:52.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.330+0000 7f3130d11640 1 --2- 172.21.15.5:0/2433381950 >> v2:172.21.15.154:3300/0 conn(0x7f312c0c8ad0 0x7f312c0c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.330+0000 7f3130d11640 1 -- 172.21.15.5:0/2433381950 >> v1:172.21.15.5:6789/0 conn(0x7f312c158ce0 legacy=0x7f312c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.330+0000 7f3130d11640 1 -- 172.21.15.5:0/2433381950 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312c070c80 con 0x7f312c0c9560 2023-07-14T13:09:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.330+0000 7f312affd640 1 -- 172.21.15.5:0/2433381950 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959790847 0 0) 0x7f312c0c99c0 con 0x7f312c158ce0 2023-07-14T13:09:52.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.334+0000 7f3130d11640 1 --2- 172.21.15.5:0/2433381950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f312c0c9560 0x7f312c0ccb90 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f312c0c1a30 tx=0x7f312401c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d159f2b18ed264 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.334+0000 7f312affd640 1 -- 172.21.15.5:0/2433381950 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31240a5790 con 0x7f312c0c9560 2023-07-14T13:09:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.334+0000 7f312affd640 1 -- 172.21.15.5:0/2433381950 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31240a58f0 con 0x7f312c0c9560 2023-07-14T13:09:52.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.334+0000 7f312affd640 1 -- 172.21.15.5:0/2433381950 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31240a5c80 con 0x7f312c0c9560 2023-07-14T13:09:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.334+0000 7f3132774640 1 -- 172.21.15.5:0/2433381950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f312c0c9560 msgr2=0x7f312c0ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.334+0000 7f3132774640 1 --2- 172.21.15.5:0/2433381950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f312c0c9560 0x7f312c0ccb90 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f312c0c1a30 tx=0x7f312401c7c0 comp rx=0 tx=0).stop 2023-07-14T13:09:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.334+0000 7f3132774640 1 -- 172.21.15.5:0/2433381950 shutdown_connections 2023-07-14T13:09:52.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.334+0000 7f3132774640 1 --2- 172.21.15.5:0/2433381950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f312c0c9560 0x7f312c0ccb90 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:52.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.334+0000 7f3132774640 1 --2- 172.21.15.5:0/2433381950 >> v2:172.21.15.154:3300/0 conn(0x7f312c0c8ad0 0x7f312c0c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:52.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.334+0000 7f3132774640 1 -- 172.21.15.5:0/2433381950 >> 172.21.15.5:0/2433381950 conn(0x7f312c0afcf0 msgr2=0x7f312c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:52.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.334+0000 7f3132774640 1 -- 172.21.15.5:0/2433381950 shutdown_connections 2023-07-14T13:09:52.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.334+0000 7f3132774640 1 -- 172.21.15.5:0/2433381950 wait complete. 2023-07-14T13:09:52.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.338+0000 7f3132774640 1 Processor -- start 2023-07-14T13:09:52.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.338+0000 7f3132774640 1 -- start start 2023-07-14T13:09:52.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.338+0000 7f3132774640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f312c0c8ad0 0x7f312c0c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:52.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.338+0000 7f3132774640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f312c0c9560 0x7f312c151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:52.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.338+0000 7f3132774640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f312c158ce0 0x7f312c14fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:52.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.338+0000 7f3132774640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c0c6850 con 0x7f312c158ce0 2023-07-14T13:09:52.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.338+0000 7f3132774640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c0c6b30 con 0x7f312c0c9560 2023-07-14T13:09:52.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.338+0000 7f3132774640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f312c0c6e10 con 0x7f312c0c8ad0 2023-07-14T13:09:52.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.338+0000 7f3130d11640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f312c158ce0 0x7f312c14fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.338+0000 7f3130d11640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f312c158ce0 0x7f312c14fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34986/0 (socket says 172.21.15.5:34986) 2023-07-14T13:09:52.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.338+0000 7f3130d11640 1 -- 172.21.15.5:0/185783687 learned_addr learned my addr 172.21.15.5:0/185783687 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:52.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.338+0000 7f312b7fe640 1 --2- 172.21.15.5:0/185783687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f312c0c9560 0x7f312c151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:52.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.338+0000 7f312bfff640 1 --2- 172.21.15.5:0/185783687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f312c0c8ad0 0x7f312c0c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:52.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.338+0000 7f3130d11640 1 -- 172.21.15.5:0/185783687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f312c0c8ad0 msgr2=0x7f312c0c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:52.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.338+0000 7f3130d11640 1 --2- 172.21.15.5:0/185783687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f312c0c8ad0 0x7f312c0c78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:52.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.338+0000 7f3130d11640 1 -- 172.21.15.5:0/185783687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f312c0c9560 msgr2=0x7f312c151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:52.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.338+0000 7f3130d11640 1 --2- 172.21.15.5:0/185783687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f312c0c9560 0x7f312c151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:52.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.338+0000 7f3130d11640 1 -- 172.21.15.5:0/185783687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3124009a70 con 0x7f312c158ce0 2023-07-14T13:09:52.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.338+0000 7f312b7fe640 1 --2- 172.21.15.5:0/185783687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f312c0c9560 0x7f312c151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:09:52.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.338+0000 7f312bfff640 1 --2- 172.21.15.5:0/185783687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f312c0c8ad0 0x7f312c0c78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:09:52.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.338+0000 7f3130d11640 1 --2- 172.21.15.5:0/185783687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f312c158ce0 0x7f312c14fe00 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f31240b0040 tx=0x7f3124019560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:52.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.338+0000 7f3128ff9640 1 -- 172.21.15.5:0/185783687 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31240b9650 con 0x7f312c158ce0 2023-07-14T13:09:52.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.338+0000 7f3128ff9640 1 -- 172.21.15.5:0/185783687 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31240b97b0 con 0x7f312c158ce0 2023-07-14T13:09:52.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.338+0000 7f3128ff9640 1 -- 172.21.15.5:0/185783687 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31240b9b60 con 0x7f312c158ce0 2023-07-14T13:09:52.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.338+0000 7f3132774640 1 -- 172.21.15.5:0/185783687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f312c0c70f0 con 0x7f312c158ce0 2023-07-14T13:09:52.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.338+0000 7f3132774640 1 -- 172.21.15.5:0/185783687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f312c151680 con 0x7f312c158ce0 2023-07-14T13:09:52.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.342+0000 7f3132774640 1 -- 172.21.15.5:0/185783687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f312c0ca1a0 con 0x7f312c158ce0 2023-07-14T13:09:52.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.342+0000 7f3128ff9640 1 -- 172.21.15.5:0/185783687 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f31240b9cc0 con 0x7f312c158ce0 2023-07-14T13:09:52.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.342+0000 7f3128ff9640 1 --2- 172.21.15.5:0/185783687 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f31180663a0 0x7f3118068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:52.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.342+0000 7f3128ff9640 1 -- 172.21.15.5:0/185783687 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f312411f190 con 0x7f312c158ce0 2023-07-14T13:09:52.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.342+0000 7f312bfff640 1 --2- 172.21.15.5:0/185783687 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f31180663a0 0x7f3118068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:52.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.342+0000 7f312bfff640 1 --2- 172.21.15.5:0/185783687 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f31180663a0 0x7f3118068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f311c007fd0 tx=0x7f311c009040 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:52.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.346+0000 7f3128ff9640 1 -- 172.21.15.5:0/185783687 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f31240ec590 con 0x7f312c158ce0 2023-07-14T13:09:52.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.502+0000 7f3132774640 1 -- 172.21.15.5:0/185783687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f312c0678d0 con 0x7f312c158ce0 2023-07-14T13:09:52.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.502+0000 7f3128ff9640 1 -- 172.21.15.5:0/185783687 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+18257 (secure 0 0 0) 0x7f31240bd090 con 0x7f312c158ce0 2023-07-14T13:09:52.535 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:52.535 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":111,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:09:49.753728+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:09:45.916338+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-14T13:09:47.159234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:09:52.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.506+0000 7f3132774640 1 -- 172.21.15.5:0/185783687 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f31180663a0 msgr2=0x7f3118068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:52.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.506+0000 7f3132774640 1 --2- 172.21.15.5:0/185783687 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f31180663a0 0x7f3118068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f311c007fd0 tx=0x7f311c009040 comp rx=0 tx=0).stop 2023-07-14T13:09:52.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.506+0000 7f3132774640 1 -- 172.21.15.5:0/185783687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f312c158ce0 msgr2=0x7f312c14fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:52.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.506+0000 7f3132774640 1 --2- 172.21.15.5:0/185783687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f312c158ce0 0x7f312c14fe00 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f31240b0040 tx=0x7f3124019560 comp rx=0 tx=0).stop 2023-07-14T13:09:52.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.506+0000 7f3132774640 1 -- 172.21.15.5:0/185783687 shutdown_connections 2023-07-14T13:09:52.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.506+0000 7f3132774640 1 --2- 172.21.15.5:0/185783687 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f31180663a0 0x7f3118068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:52.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.506+0000 7f3132774640 1 --2- 172.21.15.5:0/185783687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f312c158ce0 0x7f312c14fe00 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:52.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.506+0000 7f3132774640 1 --2- 172.21.15.5:0/185783687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f312c0c9560 0x7f312c151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:52.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.506+0000 7f3132774640 1 --2- 172.21.15.5:0/185783687 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f312c0c8ad0 0x7f312c0c78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:52.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.506+0000 7f3132774640 1 -- 172.21.15.5:0/185783687 >> 172.21.15.5:0/185783687 conn(0x7f312c0afcf0 msgr2=0x7f312c06ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:52.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.506+0000 7f3132774640 1 -- 172.21.15.5:0/185783687 shutdown_connections 2023-07-14T13:09:52.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.506+0000 7f3132774640 1 -- 172.21.15.5:0/185783687 wait complete. 2023-07-14T13:09:52.557 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-14T13:09:52.557 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:09:52.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f051ac93640 1 Processor -- start 2023-07-14T13:09:52.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f051ac93640 1 -- start start 2023-07-14T13:09:52.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f051ac93640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f05140b7990 0x7f05140d0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:52.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f051ac93640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05140d1840 0x7f05140d1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:52.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f051ac93640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05140b4840 con 0x7f05140d12f0 2023-07-14T13:09:52.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f051ac93640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05140cd060 con 0x7f05140b7990 2023-07-14T13:09:52.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f051ac93640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05140d1180 con 0x7f05140d1840 2023-07-14T13:09:52.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f0513fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f05140d12f0 0x7f051415f640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56684/0 (socket says 172.21.15.5:56684) 2023-07-14T13:09:52.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f0513fff640 1 -- 172.21.15.5:0/3299614837 learned_addr learned my addr 172.21.15.5:0/3299614837 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:52.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f0518a2f640 1 --2- 172.21.15.5:0/3299614837 >> v2:172.21.15.154:3300/0 conn(0x7f05140b7990 0x7f05140d0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:52.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f0519230640 1 --2- 172.21.15.5:0/3299614837 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05140d1840 0x7f05140d1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:52.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f05137fe640 1 -- 172.21.15.5:0/3299614837 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2227908870 0 0) 0x7f05140b4840 con 0x7f05140d12f0 2023-07-14T13:09:52.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f05137fe640 1 -- 172.21.15.5:0/3299614837 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0504003530 con 0x7f05140d12f0 2023-07-14T13:09:52.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f05137fe640 1 -- 172.21.15.5:0/3299614837 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 931993478 0 0) 0x7f0504003530 con 0x7f05140d12f0 2023-07-14T13:09:52.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f05137fe640 1 -- 172.21.15.5:0/3299614837 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05140d1840 msgr2=0x7f05140d1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:52.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f05137fe640 1 --2- 172.21.15.5:0/3299614837 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05140d1840 0x7f05140d1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:52.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f05137fe640 1 -- 172.21.15.5:0/3299614837 >> v2:172.21.15.154:3300/0 conn(0x7f05140b7990 msgr2=0x7f05140d0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:52.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f05137fe640 1 --2- 172.21.15.5:0/3299614837 >> v2:172.21.15.154:3300/0 conn(0x7f05140b7990 0x7f05140d0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:52.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f05137fe640 1 -- 172.21.15.5:0/3299614837 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05140ccae0 con 0x7f05140d12f0 2023-07-14T13:09:52.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f05137fe640 1 -- 172.21.15.5:0/3299614837 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f05000016a0 con 0x7f05140d12f0 2023-07-14T13:09:52.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f05137fe640 1 -- 172.21.15.5:0/3299614837 >> v1:172.21.15.5:6789/0 conn(0x7f05140d12f0 legacy=0x7f051415f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:52.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f05137fe640 1 --2- 172.21.15.5:0/3299614837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0504003980 0x7f0504003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:52.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f05137fe640 1 --2- 172.21.15.5:0/3299614837 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05140d1840 0x7f05040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:52.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f05137fe640 1 --2- 172.21.15.5:0/3299614837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0504004d10 0x7f0504005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:52.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f05137fe640 1 -- 172.21.15.5:0/3299614837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05140cd060 con 0x7f0504003980 2023-07-14T13:09:52.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f05137fe640 1 -- 172.21.15.5:0/3299614837 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050400b990 con 0x7f0504004d10 2023-07-14T13:09:52.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f05137fe640 1 -- 172.21.15.5:0/3299614837 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050400bad0 con 0x7f05140d1840 2023-07-14T13:09:52.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f0518a2f640 1 --2- 172.21.15.5:0/3299614837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0504003980 0x7f0504003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:52.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f0513fff640 1 --2- 172.21.15.5:0/3299614837 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05140d1840 0x7f05040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:52.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f0519230640 1 --2- 172.21.15.5:0/3299614837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0504004d10 0x7f0504005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:52.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f0518a2f640 1 -- 172.21.15.5:0/3299614837 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05140d1840 msgr2=0x7f05040047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:52.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f0518a2f640 1 --2- 172.21.15.5:0/3299614837 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05140d1840 0x7f05040047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:52.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f0518a2f640 1 -- 172.21.15.5:0/3299614837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0504004d10 msgr2=0x7f0504005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:52.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f0518a2f640 1 --2- 172.21.15.5:0/3299614837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0504004d10 0x7f0504005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:52.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f0518a2f640 1 -- 172.21.15.5:0/3299614837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0504003530 con 0x7f0504003980 2023-07-14T13:09:52.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.670+0000 7f0513fff640 1 --2- 172.21.15.5:0/3299614837 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05140d1840 0x7f05040047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:52.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.674+0000 7f0518a2f640 1 --2- 172.21.15.5:0/3299614837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0504003980 0x7f0504003d90 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f0508009ae0 tx=0x7f050801ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1843522e7683e77b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:52.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.674+0000 7f05137fe640 1 -- 172.21.15.5:0/3299614837 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05080a6470 con 0x7f0504003980 2023-07-14T13:09:52.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.674+0000 7f05137fe640 1 -- 172.21.15.5:0/3299614837 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05080a65d0 con 0x7f0504003980 2023-07-14T13:09:52.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.674+0000 7f05137fe640 1 -- 172.21.15.5:0/3299614837 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05080a6980 con 0x7f0504003980 2023-07-14T13:09:52.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.674+0000 7f051ac93640 1 -- 172.21.15.5:0/3299614837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0504003980 msgr2=0x7f0504003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:52.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.674+0000 7f051ac93640 1 --2- 172.21.15.5:0/3299614837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0504003980 0x7f0504003d90 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f0508009ae0 tx=0x7f050801ca90 comp rx=0 tx=0).stop 2023-07-14T13:09:52.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.674+0000 7f0519230640 1 -- 172.21.15.5:0/3299614837 reap_dead start 2023-07-14T13:09:52.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.674+0000 7f051ac93640 1 -- 172.21.15.5:0/3299614837 shutdown_connections 2023-07-14T13:09:52.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.674+0000 7f051ac93640 1 -- 172.21.15.5:0/3299614837 >> 172.21.15.5:0/3299614837 conn(0x7f05140650b0 msgr2=0x7f05140654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:52.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.674+0000 7f051ac93640 1 -- 172.21.15.5:0/3299614837 shutdown_connections 2023-07-14T13:09:52.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.674+0000 7f051ac93640 1 -- 172.21.15.5:0/3299614837 wait complete. 2023-07-14T13:09:52.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.678+0000 7f051ac93640 1 Processor -- start 2023-07-14T13:09:52.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.678+0000 7f051ac93640 1 -- start start 2023-07-14T13:09:52.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.678+0000 7f051ac93640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0504003980 0x7f0514148750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:52.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.678+0000 7f051ac93640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05140b5200 0x7f05140b5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:52.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.678+0000 7f051ac93640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05140c5b10 0x7f05140c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:52.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.678+0000 7f051ac93640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05140b5bb0 con 0x7f0504003980 2023-07-14T13:09:52.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.678+0000 7f051ac93640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0514148c90 con 0x7f05140c5b10 2023-07-14T13:09:52.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.678+0000 7f051ac93640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05140c6880 con 0x7f05140b5200 2023-07-14T13:09:52.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.678+0000 7f0518a2f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0504003980 0x7f0514148750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:52.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.678+0000 7f0518a2f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0504003980 0x7f0514148750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34994/0 (socket says 172.21.15.5:34994) 2023-07-14T13:09:52.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.678+0000 7f0518a2f640 1 -- 172.21.15.5:0/3740185922 learned_addr learned my addr 172.21.15.5:0/3740185922 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:52.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.678+0000 7f0518a2f640 1 -- 172.21.15.5:0/3740185922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05140b5200 msgr2=0x7f05140b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:52.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.678+0000 7f0518a2f640 1 --2- 172.21.15.5:0/3740185922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05140b5200 0x7f05140b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:52.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.678+0000 7f0518a2f640 1 -- 172.21.15.5:0/3740185922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05140c5b10 msgr2=0x7f05140c5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:52.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.678+0000 7f0518a2f640 1 --2- 172.21.15.5:0/3740185922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05140c5b10 0x7f05140c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:52.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.678+0000 7f0518a2f640 1 -- 172.21.15.5:0/3740185922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05140b7ee0 con 0x7f0504003980 2023-07-14T13:09:52.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.678+0000 7f0518a2f640 1 --2- 172.21.15.5:0/3740185922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0504003980 0x7f0514148750 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f0508009ae0 tx=0x7f0504005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:52.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.682+0000 7f05117fa640 1 -- 172.21.15.5:0/3740185922 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05080a6c40 con 0x7f0504003980 2023-07-14T13:09:52.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.682+0000 7f05117fa640 1 -- 172.21.15.5:0/3740185922 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05080a6da0 con 0x7f0504003980 2023-07-14T13:09:52.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.682+0000 7f051ac93640 1 -- 172.21.15.5:0/3740185922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05140c6b60 con 0x7f0504003980 2023-07-14T13:09:52.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.682+0000 7f05117fa640 1 -- 172.21.15.5:0/3740185922 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05080a7690 con 0x7f0504003980 2023-07-14T13:09:52.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.682+0000 7f051ac93640 1 -- 172.21.15.5:0/3740185922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05140c7120 con 0x7f0504003980 2023-07-14T13:09:52.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.682+0000 7f051ac93640 1 -- 172.21.15.5:0/3740185922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05140678d0 con 0x7f0504003980 2023-07-14T13:09:52.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.682+0000 7f05117fa640 1 -- 172.21.15.5:0/3740185922 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f05080a77f0 con 0x7f0504003980 2023-07-14T13:09:52.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.682+0000 7f05117fa640 1 --2- 172.21.15.5:0/3740185922 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f04f80663a0 0x7f04f8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:52.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.682+0000 7f05117fa640 1 -- 172.21.15.5:0/3740185922 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f050811e090 con 0x7f0504003980 2023-07-14T13:09:52.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.682+0000 7f0513fff640 1 --2- 172.21.15.5:0/3740185922 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f04f80663a0 0x7f04f8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:52.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.686+0000 7f0513fff640 1 --2- 172.21.15.5:0/3740185922 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f04f80663a0 0x7f04f8068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0500001230 tx=0x7f0500001160 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:52.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.686+0000 7f05117fa640 1 -- 172.21.15.5:0/3740185922 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f05080eb2f0 con 0x7f0504003980 2023-07-14T13:09:52.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.838+0000 7f051ac93640 1 -- 172.21.15.5:0/3740185922 --> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f05140b5bb0 con 0x7f04f80663a0 2023-07-14T13:09:52.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.850+0000 7f05117fa640 1 -- 172.21.15.5:0/3740185922 <== mgr.7156 v2:172.21.15.154:6832/1525189184 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306372 (secure 0 0 0) 0x7f050000e7b0 con 0x7f04f80663a0 2023-07-14T13:09:52.884 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:52.886 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:09:52.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.854+0000 7f051ac93640 1 -- 172.21.15.5:0/3740185922 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f04f80663a0 msgr2=0x7f04f8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:52.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.854+0000 7f051ac93640 1 --2- 172.21.15.5:0/3740185922 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f04f80663a0 0x7f04f8068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0500001230 tx=0x7f0500001160 comp rx=0 tx=0).stop 2023-07-14T13:09:52.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.854+0000 7f051ac93640 1 -- 172.21.15.5:0/3740185922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0504003980 msgr2=0x7f0514148750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:52.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.854+0000 7f051ac93640 1 --2- 172.21.15.5:0/3740185922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0504003980 0x7f0514148750 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f0508009ae0 tx=0x7f0504005800 comp rx=0 tx=0).stop 2023-07-14T13:09:52.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.854+0000 7f051ac93640 1 -- 172.21.15.5:0/3740185922 shutdown_connections 2023-07-14T13:09:52.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.854+0000 7f051ac93640 1 --2- 172.21.15.5:0/3740185922 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f04f80663a0 0x7f04f8068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:52.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.854+0000 7f051ac93640 1 --2- 172.21.15.5:0/3740185922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05140c5b10 0x7f05140c5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.854+0000 7f051ac93640 1 --2- 172.21.15.5:0/3740185922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05140b5200 0x7f05140b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.854+0000 7f051ac93640 1 --2- 172.21.15.5:0/3740185922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0504003980 0x7f0514148750 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.854+0000 7f051ac93640 1 -- 172.21.15.5:0/3740185922 >> 172.21.15.5:0/3740185922 conn(0x7f05140650b0 msgr2=0x7f05140b6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.854+0000 7f051ac93640 1 -- 172.21.15.5:0/3740185922 shutdown_connections 2023-07-14T13:09:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:52.854+0000 7f051ac93640 1 -- 172.21.15.5:0/3740185922 wait complete. 2023-07-14T13:09:52.905 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-14T13:09:52.065991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":338660,"kb_used_data":11556,"kb_used_omap":0,"kb_used_meta":327040,"kb_avail":754636060,"statfs":{"total":773094113280,"available":772747325440,"internally_reserved":0,"allocated":11833344,"data_stored":6536654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":334888960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.312346"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.760362+0000","last_change":"2023-07-14T13:09:47.760362+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.760362+0000","last_undegraded":"2023-07-14T13:09:47.760362+0000","last_fullsized":"2023-07-14T13:09:47.760362+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.761883+0000","last_change":"2023-07-14T13:09:47.761883+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.761883+0000","last_undegraded":"2023-07-14T13:09:47.761883+0000","last_fullsized":"2023-07-14T13:09:47.761883+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.758963+0000","last_change":"2023-07-14T13:09:47.758963+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.758963+0000","last_undegraded":"2023-07-14T13:09:47.758963+0000","last_fullsized":"2023-07-14T13:09:47.758963+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.765351+0000","last_change":"2023-07-14T13:09:47.765351+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.765351+0000","last_undegraded":"2023-07-14T13:09:47.765351+0000","last_fullsized":"2023-07-14T13:09:47.765351+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.757609+0000","last_change":"2023-07-14T13:09:47.757609+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.757609+0000","last_undegraded":"2023-07-14T13:09:47.757609+0000","last_fullsized":"2023-07-14T13:09:47.757609+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.760520+0000","last_change":"2023-07-14T13:09:47.760520+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.760520+0000","last_undegraded":"2023-07-14T13:09:47.760520+0000","last_fullsized":"2023-07-14T13:09:47.760520+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.766444+0000","last_change":"2023-07-14T13:09:47.766444+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.766444+0000","last_undegraded":"2023-07-14T13:09:47.766444+0000","last_fullsized":"2023-07-14T13:09:47.766444+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.760971+0000","last_change":"2023-07-14T13:09:47.760971+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.760971+0000","last_undegraded":"2023-07-14T13:09:47.760971+0000","last_fullsized":"2023-07-14T13:09:47.760971+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.757646+0000","last_change":"2023-07-14T13:09:47.757646+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.757646+0000","last_undegraded":"2023-07-14T13:09:47.757646+0000","last_fullsized":"2023-07-14T13:09:47.757646+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.756810+0000","last_change":"2023-07-14T13:09:47.756810+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.756810+0000","last_undegraded":"2023-07-14T13:09:47.756810+0000","last_fullsized":"2023-07-14T13:09:47.756810+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.760610+0000","last_change":"2023-07-14T13:09:47.760610+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.760610+0000","last_undegraded":"2023-07-14T13:09:47.760610+0000","last_fullsized":"2023-07-14T13:09:47.760610+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.757359+0000","last_change":"2023-07-14T13:09:47.757359+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.757359+0000","last_undegraded":"2023-07-14T13:09:47.757359+0000","last_fullsized":"2023-07-14T13:09:47.757359+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.763361+0000","last_change":"2023-07-14T13:09:47.763361+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.763361+0000","last_undegraded":"2023-07-14T13:09:47.763361+0000","last_fullsized":"2023-07-14T13:09:47.763361+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.759068+0000","last_change":"2023-07-14T13:09:47.759068+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.759068+0000","last_undegraded":"2023-07-14T13:09:47.759068+0000","last_fullsized":"2023-07-14T13:09:47.759068+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.761532+0000","last_change":"2023-07-14T13:09:47.761532+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.761532+0000","last_undegraded":"2023-07-14T13:09:47.761532+0000","last_fullsized":"2023-07-14T13:09:47.761532+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.758671+0000","last_change":"2023-07-14T13:09:47.758671+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.758671+0000","last_undegraded":"2023-07-14T13:09:47.758671+0000","last_fullsized":"2023-07-14T13:09:47.758671+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.766998+0000","last_change":"2023-07-14T13:09:47.766998+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.766998+0000","last_undegraded":"2023-07-14T13:09:47.766998+0000","last_fullsized":"2023-07-14T13:09:47.766998+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.759550+0000","last_change":"2023-07-14T13:09:47.759550+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.759550+0000","last_undegraded":"2023-07-14T13:09:47.759550+0000","last_fullsized":"2023-07-14T13:09:47.759550+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.759435+0000","last_change":"2023-07-14T13:09:47.759435+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.759435+0000","last_undegraded":"2023-07-14T13:09:47.759435+0000","last_fullsized":"2023-07-14T13:09:47.759435+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.764876+0000","last_change":"2023-07-14T13:09:47.764876+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.764876+0000","last_undegraded":"2023-07-14T13:09:47.764876+0000","last_fullsized":"2023-07-14T13:09:47.764876+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.758657+0000","last_change":"2023-07-14T13:09:47.758657+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.758657+0000","last_undegraded":"2023-07-14T13:09:47.758657+0000","last_fullsized":"2023-07-14T13:09:47.758657+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.758502+0000","last_change":"2023-07-14T13:09:47.758502+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.758502+0000","last_undegraded":"2023-07-14T13:09:47.758502+0000","last_fullsized":"2023-07-14T13:09:47.758502+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.764133+0000","last_change":"2023-07-14T13:09:47.764133+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.764133+0000","last_undegraded":"2023-07-14T13:09:47.764133+0000","last_fullsized":"2023-07-14T13:09:47.764133+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.758368+0000","last_change":"2023-07-14T13:09:47.758368+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.758368+0000","last_undegraded":"2023-07-14T13:09:47.758368+0000","last_fullsized":"2023-07-14T13:09:47.758368+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.763754+0000","last_change":"2023-07-14T13:09:47.763754+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.763754+0000","last_undegraded":"2023-07-14T13:09:47.763754+0000","last_fullsized":"2023-07-14T13:09:47.763754+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.759447+0000","last_change":"2023-07-14T13:09:47.759447+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.759447+0000","last_undegraded":"2023-07-14T13:09:47.759447+0000","last_fullsized":"2023-07-14T13:09:47.759447+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.756813+0000","last_change":"2023-07-14T13:09:47.756813+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.756813+0000","last_undegraded":"2023-07-14T13:09:47.756813+0000","last_fullsized":"2023-07-14T13:09:47.756813+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.764398+0000","last_change":"2023-07-14T13:09:47.764398+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.764398+0000","last_undegraded":"2023-07-14T13:09:47.764398+0000","last_fullsized":"2023-07-14T13:09:47.764398+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.766056+0000","last_change":"2023-07-14T13:09:47.766056+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.766056+0000","last_undegraded":"2023-07-14T13:09:47.766056+0000","last_fullsized":"2023-07-14T13:09:47.766056+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.757615+0000","last_change":"2023-07-14T13:09:47.757615+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.757615+0000","last_undegraded":"2023-07-14T13:09:47.757615+0000","last_fullsized":"2023-07-14T13:09:47.757615+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.763270+0000","last_change":"2023-07-14T13:09:47.763270+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.763270+0000","last_undegraded":"2023-07-14T13:09:47.763270+0000","last_fullsized":"2023-07-14T13:09:47.763270+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.758145+0000","last_change":"2023-07-14T13:09:47.758145+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.758145+0000","last_undegraded":"2023-07-14T13:09:47.758145+0000","last_fullsized":"2023-07-14T13:09:47.758145+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.764225+0000","last_change":"2023-07-14T13:09:47.764225+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.764225+0000","last_undegraded":"2023-07-14T13:09:47.764225+0000","last_fullsized":"2023-07-14T13:09:47.764225+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.782251+0000","last_change":"2023-07-14T13:09:47.780072+0000","last_active":"2023-07-14T13:09:47.782251+0000","last_peered":"2023-07-14T13:09:47.782251+0000","last_clean":"2023-07-14T13:09:47.782251+0000","last_became_active":"2023-07-14T13:09:47.779698+0000","last_became_peered":"2023-07-14T13:09:47.779698+0000","last_unstale":"2023-07-14T13:09:47.782251+0000","last_undegraded":"2023-07-14T13:09:47.782251+0000","last_fullsized":"2023-07-14T13:09:47.782251+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:56:49.048563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.766159+0000","last_change":"2023-07-14T13:09:47.766159+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.766159+0000","last_undegraded":"2023-07-14T13:09:47.766159+0000","last_fullsized":"2023-07-14T13:09:47.766159+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.773244+0000","last_change":"2023-07-14T13:09:47.771139+0000","last_active":"2023-07-14T13:09:47.773244+0000","last_peered":"2023-07-14T13:09:47.773244+0000","last_clean":"2023-07-14T13:09:47.773244+0000","last_became_active":"2023-07-14T13:09:47.770511+0000","last_became_peered":"2023-07-14T13:09:47.770511+0000","last_unstale":"2023-07-14T13:09:47.773244+0000","last_undegraded":"2023-07-14T13:09:47.773244+0000","last_fullsized":"2023-07-14T13:09:47.773244+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:53:30.860841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.765253+0000","last_change":"2023-07-14T13:09:47.765253+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.765253+0000","last_undegraded":"2023-07-14T13:09:47.765253+0000","last_fullsized":"2023-07-14T13:09:47.765253+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.775705+0000","last_change":"2023-07-14T13:09:47.774348+0000","last_active":"2023-07-14T13:09:47.775705+0000","last_peered":"2023-07-14T13:09:47.775705+0000","last_clean":"2023-07-14T13:09:47.775705+0000","last_became_active":"2023-07-14T13:09:47.773974+0000","last_became_peered":"2023-07-14T13:09:47.773974+0000","last_unstale":"2023-07-14T13:09:47.775705+0000","last_undegraded":"2023-07-14T13:09:47.775705+0000","last_fullsized":"2023-07-14T13:09:47.775705+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:42:05.547147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.763615+0000","last_change":"2023-07-14T13:09:47.763615+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.763615+0000","last_undegraded":"2023-07-14T13:09:47.763615+0000","last_fullsized":"2023-07-14T13:09:47.763615+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.779044+0000","last_change":"2023-07-14T13:09:47.777290+0000","last_active":"2023-07-14T13:09:47.779044+0000","last_peered":"2023-07-14T13:09:47.779044+0000","last_clean":"2023-07-14T13:09:47.779044+0000","last_became_active":"2023-07-14T13:09:47.776922+0000","last_became_peered":"2023-07-14T13:09:47.776922+0000","last_unstale":"2023-07-14T13:09:47.779044+0000","last_undegraded":"2023-07-14T13:09:47.779044+0000","last_fullsized":"2023-07-14T13:09:47.779044+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:52:54.956548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.760522+0000","last_change":"2023-07-14T13:09:47.760522+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.760522+0000","last_undegraded":"2023-07-14T13:09:47.760522+0000","last_fullsized":"2023-07-14T13:09:47.760522+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.771557+0000","last_change":"2023-07-14T13:09:47.769784+0000","last_active":"2023-07-14T13:09:47.771557+0000","last_peered":"2023-07-14T13:09:47.771557+0000","last_clean":"2023-07-14T13:09:47.771557+0000","last_became_active":"2023-07-14T13:09:47.769454+0000","last_became_peered":"2023-07-14T13:09:47.769454+0000","last_unstale":"2023-07-14T13:09:47.771557+0000","last_undegraded":"2023-07-14T13:09:47.771557+0000","last_fullsized":"2023-07-14T13:09:47.771557+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:47:04.435096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.763562+0000","last_change":"2023-07-14T13:09:47.763562+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.763562+0000","last_undegraded":"2023-07-14T13:09:47.763562+0000","last_fullsized":"2023-07-14T13:09:47.763562+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.774959+0000","last_change":"2023-07-14T13:09:47.769513+0000","last_active":"2023-07-14T13:09:47.774959+0000","last_peered":"2023-07-14T13:09:47.774959+0000","last_clean":"2023-07-14T13:09:47.774959+0000","last_became_active":"2023-07-14T13:09:47.769181+0000","last_became_peered":"2023-07-14T13:09:47.769181+0000","last_unstale":"2023-07-14T13:09:47.774959+0000","last_undegraded":"2023-07-14T13:09:47.774959+0000","last_fullsized":"2023-07-14T13:09:47.774959+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:37:23.085622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.760000+0000","last_change":"2023-07-14T13:09:47.760000+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.760000+0000","last_undegraded":"2023-07-14T13:09:47.760000+0000","last_fullsized":"2023-07-14T13:09:47.760000+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.774783+0000","last_change":"2023-07-14T13:09:47.773338+0000","last_active":"2023-07-14T13:09:47.774783+0000","last_peered":"2023-07-14T13:09:47.774783+0000","last_clean":"2023-07-14T13:09:47.774783+0000","last_became_active":"2023-07-14T13:09:47.773046+0000","last_became_peered":"2023-07-14T13:09:47.773046+0000","last_unstale":"2023-07-14T13:09:47.774783+0000","last_undegraded":"2023-07-14T13:09:47.774783+0000","last_fullsized":"2023-07-14T13:09:47.774783+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:06:46.095660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.762803+0000","last_change":"2023-07-14T13:09:47.762803+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.762803+0000","last_undegraded":"2023-07-14T13:09:47.762803+0000","last_fullsized":"2023-07-14T13:09:47.762803+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.781693+0000","last_change":"2023-07-14T13:09:47.780668+0000","last_active":"2023-07-14T13:09:47.781693+0000","last_peered":"2023-07-14T13:09:47.781693+0000","last_clean":"2023-07-14T13:09:47.781693+0000","last_became_active":"2023-07-14T13:09:47.780381+0000","last_became_peered":"2023-07-14T13:09:47.780381+0000","last_unstale":"2023-07-14T13:09:47.781693+0000","last_undegraded":"2023-07-14T13:09:47.781693+0000","last_fullsized":"2023-07-14T13:09:47.781693+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:18:49.457309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.758264+0000","last_change":"2023-07-14T13:09:47.758264+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.758264+0000","last_undegraded":"2023-07-14T13:09:47.758264+0000","last_fullsized":"2023-07-14T13:09:47.758264+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.772431+0000","last_change":"2023-07-14T13:09:47.771140+0000","last_active":"2023-07-14T13:09:47.772431+0000","last_peered":"2023-07-14T13:09:47.772431+0000","last_clean":"2023-07-14T13:09:47.772431+0000","last_became_active":"2023-07-14T13:09:47.770759+0000","last_became_peered":"2023-07-14T13:09:47.770759+0000","last_unstale":"2023-07-14T13:09:47.772431+0000","last_undegraded":"2023-07-14T13:09:47.772431+0000","last_fullsized":"2023-07-14T13:09:47.772431+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:24:03.560900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.764174+0000","last_change":"2023-07-14T13:09:47.764174+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.764174+0000","last_undegraded":"2023-07-14T13:09:47.764174+0000","last_fullsized":"2023-07-14T13:09:47.764174+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.777611+0000","last_change":"2023-07-14T13:09:47.774479+0000","last_active":"2023-07-14T13:09:47.777611+0000","last_peered":"2023-07-14T13:09:47.777611+0000","last_clean":"2023-07-14T13:09:47.777611+0000","last_became_active":"2023-07-14T13:09:47.774120+0000","last_became_peered":"2023-07-14T13:09:47.774120+0000","last_unstale":"2023-07-14T13:09:47.777611+0000","last_undegraded":"2023-07-14T13:09:47.777611+0000","last_fullsized":"2023-07-14T13:09:47.777611+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:38:34.753440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.759053+0000","last_change":"2023-07-14T13:09:47.759053+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.759053+0000","last_undegraded":"2023-07-14T13:09:47.759053+0000","last_fullsized":"2023-07-14T13:09:47.759053+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.781237+0000","last_change":"2023-07-14T13:09:47.780026+0000","last_active":"2023-07-14T13:09:47.781237+0000","last_peered":"2023-07-14T13:09:47.781237+0000","last_clean":"2023-07-14T13:09:47.781237+0000","last_became_active":"2023-07-14T13:09:47.779666+0000","last_became_peered":"2023-07-14T13:09:47.779666+0000","last_unstale":"2023-07-14T13:09:47.781237+0000","last_undegraded":"2023-07-14T13:09:47.781237+0000","last_fullsized":"2023-07-14T13:09:47.781237+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:25:17.781221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.763483+0000","last_change":"2023-07-14T13:09:47.763483+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.763483+0000","last_undegraded":"2023-07-14T13:09:47.763483+0000","last_fullsized":"2023-07-14T13:09:47.763483+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.779845+0000","last_change":"2023-07-14T13:09:47.774575+0000","last_active":"2023-07-14T13:09:47.779845+0000","last_peered":"2023-07-14T13:09:47.779845+0000","last_clean":"2023-07-14T13:09:47.779845+0000","last_became_active":"2023-07-14T13:09:47.774273+0000","last_became_peered":"2023-07-14T13:09:47.774273+0000","last_unstale":"2023-07-14T13:09:47.779845+0000","last_undegraded":"2023-07-14T13:09:47.779845+0000","last_fullsized":"2023-07-14T13:09:47.779845+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:25:27.493551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.759977+0000","last_change":"2023-07-14T13:09:47.759977+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.759977+0000","last_undegraded":"2023-07-14T13:09:47.759977+0000","last_fullsized":"2023-07-14T13:09:47.759977+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.781236+0000","last_change":"2023-07-14T13:09:47.780239+0000","last_active":"2023-07-14T13:09:47.781236+0000","last_peered":"2023-07-14T13:09:47.781236+0000","last_clean":"2023-07-14T13:09:47.781236+0000","last_became_active":"2023-07-14T13:09:47.779940+0000","last_became_peered":"2023-07-14T13:09:47.779940+0000","last_unstale":"2023-07-14T13:09:47.781236+0000","last_undegraded":"2023-07-14T13:09:47.781236+0000","last_fullsized":"2023-07-14T13:09:47.781236+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:08:39.506257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.757732+0000","last_change":"2023-07-14T13:09:47.757732+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.757732+0000","last_undegraded":"2023-07-14T13:09:47.757732+0000","last_fullsized":"2023-07-14T13:09:47.757732+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.779761+0000","last_change":"2023-07-14T13:09:47.773431+0000","last_active":"2023-07-14T13:09:47.779761+0000","last_peered":"2023-07-14T13:09:47.779761+0000","last_clean":"2023-07-14T13:09:47.779761+0000","last_became_active":"2023-07-14T13:09:47.773132+0000","last_became_peered":"2023-07-14T13:09:47.773132+0000","last_unstale":"2023-07-14T13:09:47.779761+0000","last_undegraded":"2023-07-14T13:09:47.779761+0000","last_fullsized":"2023-07-14T13:09:47.779761+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:00:32.740012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.757164+0000","last_change":"2023-07-14T13:09:47.757164+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.757164+0000","last_undegraded":"2023-07-14T13:09:47.757164+0000","last_fullsized":"2023-07-14T13:09:47.757164+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.774916+0000","last_change":"2023-07-14T13:09:47.769864+0000","last_active":"2023-07-14T13:09:47.774916+0000","last_peered":"2023-07-14T13:09:47.774916+0000","last_clean":"2023-07-14T13:09:47.774916+0000","last_became_active":"2023-07-14T13:09:47.769417+0000","last_became_peered":"2023-07-14T13:09:47.769417+0000","last_unstale":"2023-07-14T13:09:47.774916+0000","last_undegraded":"2023-07-14T13:09:47.774916+0000","last_fullsized":"2023-07-14T13:09:47.774916+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:29.887302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.756514+0000","last_change":"2023-07-14T13:09:47.756514+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.756514+0000","last_undegraded":"2023-07-14T13:09:47.756514+0000","last_fullsized":"2023-07-14T13:09:47.756514+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.774986+0000","last_change":"2023-07-14T13:09:47.770460+0000","last_active":"2023-07-14T13:09:47.774986+0000","last_peered":"2023-07-14T13:09:47.774986+0000","last_clean":"2023-07-14T13:09:47.774986+0000","last_became_active":"2023-07-14T13:09:47.770187+0000","last_became_peered":"2023-07-14T13:09:47.770187+0000","last_unstale":"2023-07-14T13:09:47.774986+0000","last_undegraded":"2023-07-14T13:09:47.774986+0000","last_fullsized":"2023-07-14T13:09:47.774986+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:39:21.924186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.763524+0000","last_change":"2023-07-14T13:09:47.763524+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.763524+0000","last_undegraded":"2023-07-14T13:09:47.763524+0000","last_fullsized":"2023-07-14T13:09:47.763524+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.776708+0000","last_change":"2023-07-14T13:09:47.775032+0000","last_active":"2023-07-14T13:09:47.776708+0000","last_peered":"2023-07-14T13:09:47.776708+0000","last_clean":"2023-07-14T13:09:47.776708+0000","last_became_active":"2023-07-14T13:09:47.774767+0000","last_became_peered":"2023-07-14T13:09:47.774767+0000","last_unstale":"2023-07-14T13:09:47.776708+0000","last_undegraded":"2023-07-14T13:09:47.776708+0000","last_fullsized":"2023-07-14T13:09:47.776708+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:10:48.069098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.765744+0000","last_change":"2023-07-14T13:09:47.765744+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.765744+0000","last_undegraded":"2023-07-14T13:09:47.765744+0000","last_fullsized":"2023-07-14T13:09:47.765744+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.773262+0000","last_change":"2023-07-14T13:09:47.771248+0000","last_active":"2023-07-14T13:09:47.773262+0000","last_peered":"2023-07-14T13:09:47.773262+0000","last_clean":"2023-07-14T13:09:47.773262+0000","last_became_active":"2023-07-14T13:09:47.770885+0000","last_became_peered":"2023-07-14T13:09:47.770885+0000","last_unstale":"2023-07-14T13:09:47.773262+0000","last_undegraded":"2023-07-14T13:09:47.773262+0000","last_fullsized":"2023-07-14T13:09:47.773262+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:37:30.072972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.759994+0000","last_change":"2023-07-14T13:09:47.759994+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.759994+0000","last_undegraded":"2023-07-14T13:09:47.759994+0000","last_fullsized":"2023-07-14T13:09:47.759994+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.780225+0000","last_change":"2023-07-14T13:09:47.777989+0000","last_active":"2023-07-14T13:09:47.780225+0000","last_peered":"2023-07-14T13:09:47.780225+0000","last_clean":"2023-07-14T13:09:47.780225+0000","last_became_active":"2023-07-14T13:09:47.777607+0000","last_became_peered":"2023-07-14T13:09:47.777607+0000","last_unstale":"2023-07-14T13:09:47.780225+0000","last_undegraded":"2023-07-14T13:09:47.780225+0000","last_fullsized":"2023-07-14T13:09:47.780225+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:20.906129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.762259+0000","last_change":"2023-07-14T13:09:47.762259+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.762259+0000","last_undegraded":"2023-07-14T13:09:47.762259+0000","last_fullsized":"2023-07-14T13:09:47.762259+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.774156+0000","last_change":"2023-07-14T13:09:47.770697+0000","last_active":"2023-07-14T13:09:47.774156+0000","last_peered":"2023-07-14T13:09:47.774156+0000","last_clean":"2023-07-14T13:09:47.774156+0000","last_became_active":"2023-07-14T13:09:47.770416+0000","last_became_peered":"2023-07-14T13:09:47.770416+0000","last_unstale":"2023-07-14T13:09:47.774156+0000","last_undegraded":"2023-07-14T13:09:47.774156+0000","last_fullsized":"2023-07-14T13:09:47.774156+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:49:23.152978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.756482+0000","last_change":"2023-07-14T13:09:47.756482+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.756482+0000","last_undegraded":"2023-07-14T13:09:47.756482+0000","last_fullsized":"2023-07-14T13:09:47.756482+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.779807+0000","last_change":"2023-07-14T13:09:47.773993+0000","last_active":"2023-07-14T13:09:47.779807+0000","last_peered":"2023-07-14T13:09:47.779807+0000","last_clean":"2023-07-14T13:09:47.779807+0000","last_became_active":"2023-07-14T13:09:47.773728+0000","last_became_peered":"2023-07-14T13:09:47.773728+0000","last_unstale":"2023-07-14T13:09:47.779807+0000","last_undegraded":"2023-07-14T13:09:47.779807+0000","last_fullsized":"2023-07-14T13:09:47.779807+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:32:30.697695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.757684+0000","last_change":"2023-07-14T13:09:47.757684+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.757684+0000","last_undegraded":"2023-07-14T13:09:47.757684+0000","last_fullsized":"2023-07-14T13:09:47.757684+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.779226+0000","last_change":"2023-07-14T13:09:47.777463+0000","last_active":"2023-07-14T13:09:47.779226+0000","last_peered":"2023-07-14T13:09:47.779226+0000","last_clean":"2023-07-14T13:09:47.779226+0000","last_became_active":"2023-07-14T13:09:47.777170+0000","last_became_peered":"2023-07-14T13:09:47.777170+0000","last_unstale":"2023-07-14T13:09:47.779226+0000","last_undegraded":"2023-07-14T13:09:47.779226+0000","last_fullsized":"2023-07-14T13:09:47.779226+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:07:29.398438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.762566+0000","last_change":"2023-07-14T13:09:47.762566+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.762566+0000","last_undegraded":"2023-07-14T13:09:47.762566+0000","last_fullsized":"2023-07-14T13:09:47.762566+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.774828+0000","last_change":"2023-07-14T13:09:47.773135+0000","last_active":"2023-07-14T13:09:47.774828+0000","last_peered":"2023-07-14T13:09:47.774828+0000","last_clean":"2023-07-14T13:09:47.774828+0000","last_became_active":"2023-07-14T13:09:47.772845+0000","last_became_peered":"2023-07-14T13:09:47.772845+0000","last_unstale":"2023-07-14T13:09:47.774828+0000","last_undegraded":"2023-07-14T13:09:47.774828+0000","last_fullsized":"2023-07-14T13:09:47.774828+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:29:44.821736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.759799+0000","last_change":"2023-07-14T13:09:47.759799+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.759799+0000","last_undegraded":"2023-07-14T13:09:47.759799+0000","last_fullsized":"2023-07-14T13:09:47.759799+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.779192+0000","last_change":"2023-07-14T13:09:47.778138+0000","last_active":"2023-07-14T13:09:47.779192+0000","last_peered":"2023-07-14T13:09:47.779192+0000","last_clean":"2023-07-14T13:09:47.779192+0000","last_became_active":"2023-07-14T13:09:47.777801+0000","last_became_peered":"2023-07-14T13:09:47.777801+0000","last_unstale":"2023-07-14T13:09:47.779192+0000","last_undegraded":"2023-07-14T13:09:47.779192+0000","last_fullsized":"2023-07-14T13:09:47.779192+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:14:39.893439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.768345+0000","last_change":"2023-07-14T13:09:47.768345+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.768345+0000","last_undegraded":"2023-07-14T13:09:47.768345+0000","last_fullsized":"2023-07-14T13:09:47.768345+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.776165+0000","last_change":"2023-07-14T13:09:47.773514+0000","last_active":"2023-07-14T13:09:47.776165+0000","last_peered":"2023-07-14T13:09:47.776165+0000","last_clean":"2023-07-14T13:09:47.776165+0000","last_became_active":"2023-07-14T13:09:47.773211+0000","last_became_peered":"2023-07-14T13:09:47.773211+0000","last_unstale":"2023-07-14T13:09:47.776165+0000","last_undegraded":"2023-07-14T13:09:47.776165+0000","last_fullsized":"2023-07-14T13:09:47.776165+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:57:29.617032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"99'205","reported_seq":643,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.765518+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:09:47.765518+0000","last_peered":"2023-07-14T13:09:47.765518+0000","last_clean":"2023-07-14T13:09:47.765518+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:09:47.765518+0000","last_undegraded":"2023-07-14T13:09:47.765518+0000","last_fullsized":"2023-07-14T13:09:47.765518+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:36:33.811572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.762067+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:09:47.762067+0000","last_peered":"2023-07-14T13:09:47.762067+0000","last_clean":"2023-07-14T13:09:47.762067+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:09:47.762067+0000","last_undegraded":"2023-07-14T13:09:47.762067+0000","last_fullsized":"2023-07-14T13:09:47.762067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:40:20.999404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.763399+0000","last_change":"2023-07-14T13:09:47.763399+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.763399+0000","last_undegraded":"2023-07-14T13:09:47.763399+0000","last_fullsized":"2023-07-14T13:09:47.763399+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.777830+0000","last_change":"2023-07-14T13:09:47.775769+0000","last_active":"2023-07-14T13:09:47.777830+0000","last_peered":"2023-07-14T13:09:47.777830+0000","last_clean":"2023-07-14T13:09:47.777830+0000","last_became_active":"2023-07-14T13:09:47.775476+0000","last_became_peered":"2023-07-14T13:09:47.775476+0000","last_unstale":"2023-07-14T13:09:47.777830+0000","last_undegraded":"2023-07-14T13:09:47.777830+0000","last_fullsized":"2023-07-14T13:09:47.777830+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:23.297437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.765408+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:09:47.765408+0000","last_peered":"2023-07-14T13:09:47.765408+0000","last_clean":"2023-07-14T13:09:47.765408+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:09:47.765408+0000","last_undegraded":"2023-07-14T13:09:47.765408+0000","last_fullsized":"2023-07-14T13:09:47.765408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:55:05.093080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.763905+0000","last_change":"2023-07-14T13:09:47.763905+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.763905+0000","last_undegraded":"2023-07-14T13:09:47.763905+0000","last_fullsized":"2023-07-14T13:09:47.763905+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.775809+0000","last_change":"2023-07-14T13:09:47.774372+0000","last_active":"2023-07-14T13:09:47.775809+0000","last_peered":"2023-07-14T13:09:47.775809+0000","last_clean":"2023-07-14T13:09:47.775809+0000","last_became_active":"2023-07-14T13:09:47.774044+0000","last_became_peered":"2023-07-14T13:09:47.774044+0000","last_unstale":"2023-07-14T13:09:47.775809+0000","last_undegraded":"2023-07-14T13:09:47.775809+0000","last_fullsized":"2023-07-14T13:09:47.775809+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:02:43.298987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.753420+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:09:47.753420+0000","last_peered":"2023-07-14T13:09:47.753420+0000","last_clean":"2023-07-14T13:09:47.753420+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:09:47.753420+0000","last_undegraded":"2023-07-14T13:09:47.753420+0000","last_fullsized":"2023-07-14T13:09:47.753420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:00:40.546057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.758830+0000","last_change":"2023-07-14T13:09:47.758830+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.758830+0000","last_undegraded":"2023-07-14T13:09:47.758830+0000","last_fullsized":"2023-07-14T13:09:47.758830+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.780203+0000","last_change":"2023-07-14T13:09:47.776207+0000","last_active":"2023-07-14T13:09:47.780203+0000","last_peered":"2023-07-14T13:09:47.780203+0000","last_clean":"2023-07-14T13:09:47.780203+0000","last_became_active":"2023-07-14T13:09:47.775865+0000","last_became_peered":"2023-07-14T13:09:47.775865+0000","last_unstale":"2023-07-14T13:09:47.780203+0000","last_undegraded":"2023-07-14T13:09:47.780203+0000","last_fullsized":"2023-07-14T13:09:47.780203+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:43:19.395013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.762223+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:09:47.762223+0000","last_peered":"2023-07-14T13:09:47.762223+0000","last_clean":"2023-07-14T13:09:47.762223+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:09:47.762223+0000","last_undegraded":"2023-07-14T13:09:47.762223+0000","last_fullsized":"2023-07-14T13:09:47.762223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:38:58.964127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.757587+0000","last_change":"2023-07-14T13:09:47.757587+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.757587+0000","last_undegraded":"2023-07-14T13:09:47.757587+0000","last_fullsized":"2023-07-14T13:09:47.757587+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.779166+0000","last_change":"2023-07-14T13:09:47.777379+0000","last_active":"2023-07-14T13:09:47.779166+0000","last_peered":"2023-07-14T13:09:47.779166+0000","last_clean":"2023-07-14T13:09:47.779166+0000","last_became_active":"2023-07-14T13:09:47.776990+0000","last_became_peered":"2023-07-14T13:09:47.776990+0000","last_unstale":"2023-07-14T13:09:47.779166+0000","last_undegraded":"2023-07-14T13:09:47.779166+0000","last_fullsized":"2023-07-14T13:09:47.779166+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:54:26.049260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.765626+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:09:47.765626+0000","last_peered":"2023-07-14T13:09:47.765626+0000","last_clean":"2023-07-14T13:09:47.765626+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:09:47.765626+0000","last_undegraded":"2023-07-14T13:09:47.765626+0000","last_fullsized":"2023-07-14T13:09:47.765626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:41:24.098277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.762762+0000","last_change":"2023-07-14T13:09:47.762762+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.762762+0000","last_undegraded":"2023-07-14T13:09:47.762762+0000","last_fullsized":"2023-07-14T13:09:47.762762+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.776749+0000","last_change":"2023-07-14T13:09:47.772443+0000","last_active":"2023-07-14T13:09:47.776749+0000","last_peered":"2023-07-14T13:09:47.776749+0000","last_clean":"2023-07-14T13:09:47.776749+0000","last_became_active":"2023-07-14T13:09:47.772118+0000","last_became_peered":"2023-07-14T13:09:47.772118+0000","last_unstale":"2023-07-14T13:09:47.776749+0000","last_undegraded":"2023-07-14T13:09:47.776749+0000","last_fullsized":"2023-07-14T13:09:47.776749+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:20:36.146987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.764941+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:09:47.764941+0000","last_peered":"2023-07-14T13:09:47.764941+0000","last_clean":"2023-07-14T13:09:47.764941+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:09:47.764941+0000","last_undegraded":"2023-07-14T13:09:47.764941+0000","last_fullsized":"2023-07-14T13:09:47.764941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:04:58.036443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.761769+0000","last_change":"2023-07-14T13:09:47.761769+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.761769+0000","last_undegraded":"2023-07-14T13:09:47.761769+0000","last_fullsized":"2023-07-14T13:09:47.761769+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.781662+0000","last_change":"2023-07-14T13:09:47.780048+0000","last_active":"2023-07-14T13:09:47.781662+0000","last_peered":"2023-07-14T13:09:47.781662+0000","last_clean":"2023-07-14T13:09:47.781662+0000","last_became_active":"2023-07-14T13:09:47.779564+0000","last_became_peered":"2023-07-14T13:09:47.779564+0000","last_unstale":"2023-07-14T13:09:47.781662+0000","last_undegraded":"2023-07-14T13:09:47.781662+0000","last_fullsized":"2023-07-14T13:09:47.781662+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:14:50.917717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.764568+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:09:47.764568+0000","last_peered":"2023-07-14T13:09:47.764568+0000","last_clean":"2023-07-14T13:09:47.764568+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:09:47.764568+0000","last_undegraded":"2023-07-14T13:09:47.764568+0000","last_fullsized":"2023-07-14T13:09:47.764568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:40:49.361870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.760318+0000","last_change":"2023-07-14T13:09:47.760318+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.760318+0000","last_undegraded":"2023-07-14T13:09:47.760318+0000","last_fullsized":"2023-07-14T13:09:47.760318+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.770286+0000","last_change":"2023-07-14T13:09:47.768621+0000","last_active":"2023-07-14T13:09:47.770286+0000","last_peered":"2023-07-14T13:09:47.770286+0000","last_clean":"2023-07-14T13:09:47.770286+0000","last_became_active":"2023-07-14T13:09:47.768335+0000","last_became_peered":"2023-07-14T13:09:47.768335+0000","last_unstale":"2023-07-14T13:09:47.770286+0000","last_undegraded":"2023-07-14T13:09:47.770286+0000","last_fullsized":"2023-07-14T13:09:47.770286+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:45:38.011247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.762983+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:09:47.762983+0000","last_peered":"2023-07-14T13:09:47.762983+0000","last_clean":"2023-07-14T13:09:47.762983+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:09:47.762983+0000","last_undegraded":"2023-07-14T13:09:47.762983+0000","last_fullsized":"2023-07-14T13:09:47.762983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:58:56.674915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575054,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59164,"kb_used_data":1876,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312676,"statfs":{"total":96636764160,"available":96576180224,"internally_reserved":0,"allocated":1921024,"data_stored":1257627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.70299999999999996,"15min":0.71699999999999997},"min":{"1min":0.46300000000000002,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.60799999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72099999999999997,"15min":0.73699999999999999},"min":{"1min":0.47199999999999998,"5min":0.434,"15min":0.434},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72499999999999998,"15min":0.745},"min":{"1min":0.436,"5min":0.436,"15min":0.40500000000000003},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.65600000000000003}]},{"osd":2,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.72999999999999998},"min":{"1min":0.51900000000000002,"5min":0.46999999999999997,"15min":0.42699999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.624},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72499999999999998,"15min":0.75},"min":{"1min":0.47999999999999998,"5min":0.47199999999999998,"15min":0.46899999999999997},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.53600000000000003}]},{"osd":3,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72499999999999998,"15min":0.73599999999999999},"min":{"1min":0.57999999999999996,"5min":0.503,"15min":0.46400000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72999999999999998,"15min":0.75600000000000001},"min":{"1min":0.47899999999999998,"5min":0.47299999999999998,"15min":0.41499999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68000000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55400000000000005,"15min":0.58099999999999996},"min":{"1min":0.44,"5min":0.318,"15min":0.318},"max":{"1min":0.74299999999999999,"5min":0.86299999999999999,"15min":1.022},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58899999999999997,"15min":0.60299999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.39300000000000002},"max":{"1min":0.84399999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.46600000000000003}]},{"osd":5,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98299999999999998},"last":0.442},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.628,"15min":0.65300000000000002},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82899999999999996,"5min":1.028,"15min":1.028},"last":0.42399999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.67300000000000004,"15min":0.69599999999999995},"min":{"1min":0.499,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89800000000000002,"5min":0.99299999999999999,"15min":1.0600000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64100000000000001,"15min":0.66900000000000004},"min":{"1min":0.46200000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81399999999999995,"5min":0.95799999999999996,"15min":1.04},"last":0.51100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575055,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32344,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1327104,"data_stored":667259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.48399999999999999,"5min":0.39500000000000002,"15min":0.38},"max":{"1min":0.874,"5min":0.96499999999999997,"15min":1.05},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.71299999999999997,"15min":0.73699999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.47399999999999998},"max":{"1min":0.86499999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.47399999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71699999999999997,"15min":0.745},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.379},"max":{"1min":0.81499999999999995,"5min":0.97199999999999998,"15min":1.0209999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69699999999999995,"15min":0.72299999999999998},"min":{"1min":0.55900000000000005,"5min":0.46999999999999997,"15min":0.44},"max":{"1min":0.85199999999999998,"5min":0.97099999999999997,"15min":1.077},"last":0.70099999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73899999999999999,"15min":0.752},"min":{"1min":0.55500000000000005,"5min":0.45900000000000002,"15min":0.40400000000000003},"max":{"1min":0.89700000000000002,"5min":0.95099999999999996,"15min":1.105},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.73599999999999999,"15min":0.751},"min":{"1min":0.441,"5min":0.441,"15min":0.42299999999999999},"max":{"1min":0.89500000000000002,"5min":0.99099999999999999,"15min":1.0900000000000001},"last":0.64600000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.748,"15min":0.77500000000000002},"min":{"1min":0.46000000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.93999999999999995,"5min":1.054,"15min":1.1359999999999999},"last":0.754},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74199999999999999,"15min":0.76300000000000001},"min":{"1min":0.50900000000000001,"5min":0.48399999999999999,"15min":0.45900000000000002},"max":{"1min":0.94599999999999995,"5min":0.99099999999999999,"15min":1.1080000000000001},"last":0.58499999999999996}]},{"osd":4,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56399999999999995,"15min":0.57299999999999995},"min":{"1min":0.39900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.83299999999999996,"5min":0.89900000000000002,"15min":0.97899999999999998},"last":0.627},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.439,"5min":0.38500000000000001,"15min":0.36099999999999999},"max":{"1min":0.87,"5min":1.012,"15min":1.0780000000000001},"last":0.72199999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.48699999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.88100000000000001,"5min":1.579,"15min":1.579},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67900000000000005,"15min":0.68999999999999995},"min":{"1min":0.46300000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90100000000000002,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.66600000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64400000000000002,"15min":0.65700000000000003},"min":{"1min":0.44700000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86399999999999999,"5min":1.0940000000000001,"15min":1.1200000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69599999999999995,"15min":0.70799999999999996},"min":{"1min":0.53400000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.92400000000000004,"5min":1.657,"15min":1.657},"last":0.74099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575054,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46296,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":44992,"kb_avail":94325544,"statfs":{"total":96636764160,"available":96589357056,"internally_reserved":0,"allocated":1327104,"data_stored":667259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46071808},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.70799999999999996,"15min":0.73099999999999998},"min":{"1min":0.376,"5min":0.36499999999999999,"15min":0.32400000000000001},"max":{"1min":0.91500000000000004,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68799999999999994,"15min":0.73299999999999998},"min":{"1min":0.41699999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.86099999999999999,"5min":1.083,"15min":1.083},"last":0.72699999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69899999999999995,"15min":0.72699999999999998},"min":{"1min":0.46899999999999997,"5min":0.44500000000000001,"15min":0.41099999999999998},"max":{"1min":0.85199999999999998,"5min":1.05,"15min":1.079},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73299999999999998,"15min":0.747},"min":{"1min":0.48999999999999999,"5min":0.48699999999999999,"15min":0.36799999999999999},"max":{"1min":0.94599999999999995,"5min":2.706,"15min":2.706},"last":0.745}]},{"osd":2,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71299999999999997,"15min":0.73899999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86299999999999999,"5min":1.212,"15min":1.212},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.70499999999999996,"15min":0.73499999999999999},"min":{"1min":0.44800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89200000000000002,"5min":1.181,"15min":1.181},"last":0.76100000000000001}]},{"osd":3,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73299999999999998,"15min":0.748},"min":{"1min":0.48599999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.876,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72799999999999998,"15min":0.76000000000000001},"min":{"1min":0.47299999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90800000000000003,"5min":1.304,"15min":1.304},"last":0.68300000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64000000000000001,"15min":0.629},"min":{"1min":0.437,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.85399999999999998,"5min":1.129,"15min":1.129},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.39900000000000002,"5min":0.36299999999999999,"15min":0.35899999999999999},"max":{"1min":0.84499999999999997,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.41899999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.60399999999999998,"15min":0.61399999999999999},"min":{"1min":0.41999999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90200000000000002,"5min":1.169,"15min":1.169},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.64400000000000002,"15min":0.64100000000000001},"min":{"1min":0.39400000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.83699999999999997,"5min":1.238,"15min":1.238},"last":0.55500000000000005}]},{"osd":7,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66100000000000003,"15min":0.64300000000000002},"min":{"1min":0.45500000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93300000000000005,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68200000000000005,"15min":0.67800000000000005},"min":{"1min":0.48999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90100000000000002,"5min":1.407,"15min":1.407},"last":0.53100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1339392,"data_stored":673887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.70899999999999996,"15min":0.72999999999999998},"min":{"1min":0.36899999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.90800000000000003,"5min":1.0129999999999999,"15min":1.411},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.435},"max":{"1min":0.85199999999999998,"5min":1.0640000000000001,"15min":1.1200000000000001},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.748,"15min":0.749},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92500000000000004,"5min":0.94699999999999995,"15min":1.077},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70999999999999996,"15min":0.73599999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89600000000000002,"5min":0.96399999999999997,"15min":1.0469999999999999},"last":0.503}]},{"osd":2,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.51800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91000000000000003,"5min":0.96499999999999997,"15min":1.091},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.76900000000000002,"15min":0.77400000000000002},"min":{"1min":0.46400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98099999999999998,"5min":1.0649999999999999,"15min":1.387},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.72999999999999998,"15min":0.746},"min":{"1min":0.53200000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.94699999999999995,"5min":0.997,"15min":1.008},"last":0.622},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.75800000000000001,"15min":0.77100000000000002},"min":{"1min":0.504,"5min":0.496,"15min":0.46800000000000003},"max":{"1min":0.875,"5min":1.024,"15min":1.0589999999999999},"last":0.47499999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61899999999999999,"15min":0.60499999999999998},"min":{"1min":0.49299999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.85299999999999998,"5min":0.95599999999999996,"15min":1.0029999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63300000000000001,"15min":0.61799999999999999},"min":{"1min":0.45900000000000002,"5min":0.41399999999999998,"15min":0.34599999999999997},"max":{"1min":0.93200000000000005,"5min":0.93600000000000005,"15min":0.95199999999999996},"last":0.69299999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.32300000000000001},"max":{"1min":0.96999999999999997,"5min":1.014,"15min":1.014},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68300000000000005,"15min":0.66900000000000004},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.374},"max":{"1min":0.86899999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.71499999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68899999999999995,"15min":0.66900000000000004},"min":{"1min":0.503,"5min":0.46000000000000002,"15min":0.39000000000000001},"max":{"1min":0.89400000000000002,"5min":0.94699999999999995,"15min":1.0349999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70999999999999996,"15min":0.69499999999999995},"min":{"1min":0.42799999999999999,"5min":0.40300000000000002,"15min":0.36899999999999999},"max":{"1min":0.91800000000000004,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.44}]}]},{"osd":3,"up_from":13,"seq":55834575054,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36452,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335388,"statfs":{"total":96636764160,"available":96599437312,"internally_reserved":0,"allocated":1339392,"data_stored":673887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.26200000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.84199999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.498,"15min":0.51500000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.60799999999999998,"5min":0.77300000000000002,"15min":1.0209999999999999},"last":0.63200000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47199999999999998,"15min":0.47499999999999998},"min":{"1min":0.33100000000000002,"5min":0.315,"15min":0.29599999999999999},"max":{"1min":0.63900000000000001,"5min":0.77200000000000002,"15min":0.79600000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67800000000000005,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.59299999999999997}]},{"osd":2,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54100000000000004,"15min":0.56999999999999995},"min":{"1min":0.38200000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.72399999999999998,"5min":0.82599999999999996,"15min":0.95899999999999996},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60699999999999998,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86599999999999999,"5min":1.663,"15min":1.663},"last":0.67900000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.748,"15min":0.76500000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":0.90900000000000003,"5min":1.284,"15min":1.284},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76800000000000002,"15min":0.78900000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.47699999999999998},"max":{"1min":1.0660000000000001,"5min":1.121,"15min":1.196},"last":0.78500000000000003}]},{"osd":5,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.52400000000000002},"max":{"1min":1.0229999999999999,"5min":1.306,"15min":1.306},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77900000000000003,"15min":0.79100000000000004},"min":{"1min":0.58099999999999996,"5min":0.372,"15min":0.372},"max":{"1min":0.97399999999999998,"5min":1.1870000000000001,"15min":1.2470000000000001},"last":0.76800000000000002}]},{"osd":6,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.76800000000000002,"15min":0.78000000000000003},"min":{"1min":0.50600000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96599999999999997,"5min":1.105,"15min":1.117},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.79700000000000004,"15min":0.81799999999999995},"min":{"1min":0.56299999999999994,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.93999999999999995,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.873}]},{"osd":7,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.83299999999999996,"15min":0.84099999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53100000000000003},"max":{"1min":0.89900000000000002,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.53500000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0009999999999999,"5min":1.595,"15min":1.595},"last":0.89300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575054,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58592,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313248,"statfs":{"total":96636764160,"available":96576765952,"internally_reserved":0,"allocated":1335296,"data_stored":672868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45900000000000002,"15min":0.46800000000000003},"min":{"1min":0.29199999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.84699999999999998,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.54200000000000004,"15min":0.53300000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.70799999999999996,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.68600000000000005}]},{"osd":1,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.48299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30399999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65500000000000003,"5min":2.7200000000000002,"15min":2.7200000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.55000000000000004,"15min":0.56299999999999994},"min":{"1min":0.36299999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78300000000000003,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":0.54400000000000004}]},{"osd":3,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.64500000000000002,"15min":0.60399999999999998},"min":{"1min":0.39500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71699999999999997,"5min":8.2530000000000001,"15min":8.2530000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89600000000000002,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.57199999999999995}]},{"osd":4,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.754,"15min":0.78100000000000003},"min":{"1min":0.53200000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.99399999999999999,"5min":1.0940000000000001,"15min":1.1499999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.56699999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0629999999999999,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.85699999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.84399999999999997,"15min":0.85799999999999998},"min":{"1min":0.58599999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1319999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82499999999999996,"15min":0.83999999999999997},"min":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.433},"max":{"1min":1.153,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.76300000000000001}]},{"osd":6,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.78700000000000003,"15min":0.80400000000000005},"min":{"1min":0.57299999999999995,"5min":0.48999999999999999,"15min":0.47599999999999998},"max":{"1min":0.93999999999999995,"5min":3.9849999999999999,"15min":3.9849999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80200000000000005,"15min":0.81299999999999994},"min":{"1min":0.60699999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0289999999999999,"5min":3.391,"15min":3.391},"last":0.63400000000000001}]},{"osd":7,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.79600000000000004,"15min":0.82199999999999995},"min":{"1min":0.55000000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.1759999999999999,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.81499999999999995,"15min":0.82299999999999995},"min":{"1min":0.60199999999999998,"5min":0.53200000000000003,"15min":0.50900000000000001},"max":{"1min":1.0940000000000001,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.78600000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575055,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36440,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335400,"statfs":{"total":96636764160,"available":96599449600,"internally_reserved":0,"allocated":1327104,"data_stored":667259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.29199999999999998,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.53700000000000003,"5min":0.65400000000000003,"15min":0.77200000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.28199999999999997,"15min":0.26500000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.64100000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47199999999999998,"15min":0.47299999999999998},"min":{"1min":0.34300000000000003,"5min":0.32100000000000001,"15min":0.29499999999999998},"max":{"1min":0.54200000000000004,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65100000000000002,"5min":1.014,"15min":1.014},"last":0.68700000000000006}]},{"osd":3,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.621,"15min":0.63600000000000001},"min":{"1min":0.48199999999999998,"5min":0.44700000000000001,"15min":0.437},"max":{"1min":0.73899999999999999,"5min":0.80500000000000005,"15min":0.96299999999999997},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56499999999999995,"15min":0.57999999999999996},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.749}]},{"osd":4,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77700000000000002,"15min":0.78400000000000003},"min":{"1min":0.55500000000000005,"5min":0.51600000000000001,"15min":0.40000000000000002},"max":{"1min":1.0409999999999999,"5min":1.2110000000000001,"15min":1.236},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77200000000000002,"15min":0.78600000000000003},"min":{"1min":0.57499999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.0309999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.80800000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.60799999999999998,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.55800000000000005,"5min":0.48599999999999999,"15min":0.48199999999999998},"max":{"1min":1.0940000000000001,"5min":1.2749999999999999,"15min":1.3600000000000001},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.53800000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1.0580000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.80500000000000005,"15min":0.81399999999999995},"min":{"1min":0.56100000000000005,"5min":0.52200000000000002,"15min":0.49199999999999999},"max":{"1min":1.1319999999999999,"5min":1.262,"15min":1.2969999999999999},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.47799999999999998},"max":{"1min":1.1479999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.82099999999999995,"15min":0.84099999999999997},"min":{"1min":0.58499999999999996,"5min":0.53700000000000003,"15min":0.52800000000000002},"max":{"1min":1.2070000000000001,"5min":1.327,"15min":1.327},"last":0.77000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575056,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37016,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334824,"statfs":{"total":96636764160,"available":96598859776,"internally_reserved":0,"allocated":1916928,"data_stored":1256608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.45600000000000002,"15min":0.44700000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.61199999999999999,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.49099999999999999,"15min":0.51500000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.27700000000000002},"max":{"1min":0.61799999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.38700000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.51900000000000002,"15min":0.51100000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69699999999999995,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.502,"5min":0.54000000000000004,"15min":0.55300000000000005},"min":{"1min":0.39800000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63800000000000001,"5min":0.80300000000000005,"15min":0.90300000000000002},"last":0.436}]},{"osd":3,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.504},"min":{"1min":0.36399999999999999,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.67600000000000005,"5min":0.72999999999999998,"15min":0.84999999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82899999999999996,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.49399999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76900000000000002,"15min":0.78800000000000003},"min":{"1min":0.56100000000000005,"5min":0.48399999999999999,"15min":0.44400000000000001},"max":{"1min":0.90500000000000003,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.53500000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.038,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.72699999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.77100000000000002,"15min":0.80600000000000005},"min":{"1min":0.55100000000000005,"5min":0.51800000000000002,"15min":0.47899999999999998},"max":{"1min":0.80500000000000005,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.56399999999999995,"5min":0.49299999999999999,"15min":0.47299999999999998},"max":{"1min":0.97299999999999998,"5min":1.325,"15min":1.325},"last":0.60699999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.79100000000000004,"15min":0.80600000000000005},"min":{"1min":0.53500000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91400000000000003,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78900000000000003,"15min":0.81499999999999995},"min":{"1min":0.58399999999999996,"5min":0.55500000000000005,"15min":0.41299999999999998},"max":{"1min":1.0900000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.628}]},{"osd":7,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.79800000000000004,"15min":0.83199999999999996},"min":{"1min":0.57699999999999996,"5min":0.503,"15min":0.45500000000000002},"max":{"1min":0.93799999999999994,"5min":1.171,"15min":1.2749999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.77100000000000002,"15min":0.81100000000000005},"min":{"1min":0.50600000000000001,"5min":0.502,"15min":0.497},"max":{"1min":0.95199999999999996,"5min":1.381,"15min":1.381},"last":0.69999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:09:52.912 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:09:53.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.062+0000 7f147cd12640 1 Processor -- start 2023-07-14T13:09:53.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.062+0000 7f147cd12640 1 -- start start 2023-07-14T13:09:53.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.062+0000 7f147cd12640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f147815f3f0 0x7f14780b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:53.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.062+0000 7f147cd12640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14780d0f60 con 0x7f14780b7bc0 2023-07-14T13:09:53.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.062+0000 7f147cd12640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14780b7ff0 con 0x7f14780d13f0 2023-07-14T13:09:53.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.062+0000 7f147cd12640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14780d0390 con 0x7f147815f3f0 2023-07-14T13:09:53.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.066+0000 7f1477fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f14780b7bc0 0x7f14780b5010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56696/0 (socket says 172.21.15.5:56696) 2023-07-14T13:09:53.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.066+0000 7f1477fff640 1 -- 172.21.15.5:0/2669023511 learned_addr learned my addr 172.21.15.5:0/2669023511 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:53.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.066+0000 7f14777fe640 1 --2- 172.21.15.5:0/2669023511 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f147815f3f0 0x7f14780b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:53.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.066+0000 7f14767fc640 1 -- 172.21.15.5:0/2669023511 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884429721 0 0) 0x7f14780d0f60 con 0x7f14780b7bc0 2023-07-14T13:09:53.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.066+0000 7f14767fc640 1 -- 172.21.15.5:0/2669023511 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1460003530 con 0x7f14780b7bc0 2023-07-14T13:09:53.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.066+0000 7f14767fc640 1 -- 172.21.15.5:0/2669023511 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 977761650 0 0) 0x7f14780b7ff0 con 0x7f14780d13f0 2023-07-14T13:09:53.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.066+0000 7f14767fc640 1 -- 172.21.15.5:0/2669023511 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14780d0f60 con 0x7f14780d13f0 2023-07-14T13:09:53.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.066+0000 7f14777fe640 1 -- 172.21.15.5:0/2669023511 >> v1:172.21.15.154:6789/0 conn(0x7f14780d13f0 legacy=0x7f14780cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:53.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.066+0000 7f14777fe640 1 -- 172.21.15.5:0/2669023511 >> v1:172.21.15.5:6789/0 conn(0x7f14780b7bc0 legacy=0x7f14780b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:53.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.066+0000 7f14777fe640 1 -- 172.21.15.5:0/2669023511 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14780d0630 con 0x7f147815f3f0 2023-07-14T13:09:53.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.066+0000 7f14777fe640 1 --2- 172.21.15.5:0/2669023511 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f147815f3f0 0x7f14780b7680 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f14680097f0 tx=0x7f146801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8da5b34cbcd9930 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:53.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.066+0000 7f14767fc640 1 -- 172.21.15.5:0/2669023511 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14680ab600 con 0x7f147815f3f0 2023-07-14T13:09:53.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.066+0000 7f14767fc640 1 -- 172.21.15.5:0/2669023511 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14680a7050 con 0x7f147815f3f0 2023-07-14T13:09:53.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.066+0000 7f14767fc640 1 -- 172.21.15.5:0/2669023511 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14680ab960 con 0x7f147815f3f0 2023-07-14T13:09:53.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.070+0000 7f147cd12640 1 -- 172.21.15.5:0/2669023511 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f147815f3f0 msgr2=0x7f14780b7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:53.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.070+0000 7f147cd12640 1 --2- 172.21.15.5:0/2669023511 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f147815f3f0 0x7f14780b7680 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f14680097f0 tx=0x7f146801c430 comp rx=0 tx=0).stop 2023-07-14T13:09:53.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.070+0000 7f147cd12640 1 -- 172.21.15.5:0/2669023511 shutdown_connections 2023-07-14T13:09:53.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.070+0000 7f147cd12640 1 --2- 172.21.15.5:0/2669023511 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f147815f3f0 0x7f14780b7680 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:53.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.070+0000 7f147cd12640 1 -- 172.21.15.5:0/2669023511 >> 172.21.15.5:0/2669023511 conn(0x7f1478069f50 msgr2=0x7f147806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:53.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.070+0000 7f147cd12640 1 -- 172.21.15.5:0/2669023511 shutdown_connections 2023-07-14T13:09:53.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.070+0000 7f147cd12640 1 -- 172.21.15.5:0/2669023511 wait complete. 2023-07-14T13:09:53.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.070+0000 7f147cd12640 1 Processor -- start 2023-07-14T13:09:53.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.070+0000 7f147cd12640 1 -- start start 2023-07-14T13:09:53.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.070+0000 7f147cd12640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14780b7bc0 0x7f1478157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:53.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.070+0000 7f147cd12640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14780d13f0 0x7f14780ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:53.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.070+0000 7f147cd12640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f147815f3f0 0x7f14780cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:53.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.070+0000 7f147cd12640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14780cbfe0 con 0x7f14780d13f0 2023-07-14T13:09:53.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.070+0000 7f147cd12640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14780c9290 con 0x7f147815f3f0 2023-07-14T13:09:53.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.070+0000 7f147cd12640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14780c9570 con 0x7f14780b7bc0 2023-07-14T13:09:53.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.074+0000 7f1476ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14780d13f0 0x7f14780ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:53.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.074+0000 7f14777fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14780b7bc0 0x7f1478157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:53.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.074+0000 7f1477fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f147815f3f0 0x7f14780cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:53.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.074+0000 7f1476ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14780d13f0 0x7f14780ca050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35004/0 (socket says 172.21.15.5:35004) 2023-07-14T13:09:53.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.074+0000 7f1476ffd640 1 -- 172.21.15.5:0/3572586582 learned_addr learned my addr 172.21.15.5:0/3572586582 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:53.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.074+0000 7f14777fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14780b7bc0 0x7f1478157370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:36518/0 (socket says 172.21.15.5:36518) 2023-07-14T13:09:53.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.074+0000 7f1476ffd640 1 -- 172.21.15.5:0/3572586582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14780b7bc0 msgr2=0x7f1478157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:53.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.074+0000 7f1476ffd640 1 --2- 172.21.15.5:0/3572586582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14780b7bc0 0x7f1478157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:53.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.074+0000 7f1476ffd640 1 -- 172.21.15.5:0/3572586582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f147815f3f0 msgr2=0x7f14780cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:53.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.074+0000 7f1476ffd640 1 --2- 172.21.15.5:0/3572586582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f147815f3f0 0x7f14780cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:53.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.074+0000 7f1476ffd640 1 -- 172.21.15.5:0/3572586582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1468009420 con 0x7f14780d13f0 2023-07-14T13:09:53.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.074+0000 7f1476ffd640 1 --2- 172.21.15.5:0/3572586582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14780d13f0 0x7f14780ca050 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f146c00c500 tx=0x7f146c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:53.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.074+0000 7f145ffff640 1 -- 172.21.15.5:0/3572586582 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c0052d0 con 0x7f14780d13f0 2023-07-14T13:09:53.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.074+0000 7f145ffff640 1 -- 172.21.15.5:0/3572586582 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146c005450 con 0x7f14780d13f0 2023-07-14T13:09:53.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.074+0000 7f147cd12640 1 -- 172.21.15.5:0/3572586582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14780c9850 con 0x7f14780d13f0 2023-07-14T13:09:53.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.074+0000 7f145ffff640 1 -- 172.21.15.5:0/3572586582 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c012870 con 0x7f14780d13f0 2023-07-14T13:09:53.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.074+0000 7f147cd12640 1 -- 172.21.15.5:0/3572586582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147814fdf0 con 0x7f14780d13f0 2023-07-14T13:09:53.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.074+0000 7f147cd12640 1 -- 172.21.15.5:0/3572586582 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14780678d0 con 0x7f14780d13f0 2023-07-14T13:09:53.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.074+0000 7f145ffff640 1 -- 172.21.15.5:0/3572586582 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f146c0129d0 con 0x7f14780d13f0 2023-07-14T13:09:53.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.078+0000 7f145ffff640 1 --2- 172.21.15.5:0/3572586582 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f14640663a0 0x7f1464068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:53.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.078+0000 7f145ffff640 1 -- 172.21.15.5:0/3572586582 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f146c083a10 con 0x7f14780d13f0 2023-07-14T13:09:53.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.078+0000 7f14777fe640 1 --2- 172.21.15.5:0/3572586582 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f14640663a0 0x7f1464068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:53.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.078+0000 7f14777fe640 1 --2- 172.21.15.5:0/3572586582 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f14640663a0 0x7f1464068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f147808a220 tx=0x7f14680a6000 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:53.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.078+0000 7f145ffff640 1 -- 172.21.15.5:0/3572586582 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f146c050da0 con 0x7f14780d13f0 2023-07-14T13:09:53.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.230+0000 7f147cd12640 1 -- 172.21.15.5:0/3572586582 --> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f147815f7c0 con 0x7f14640663a0 2023-07-14T13:09:53.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.238+0000 7f145ffff640 1 -- 172.21.15.5:0/3572586582 <== mgr.7156 v2:172.21.15.154:6832/1525189184 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306372 (secure 0 0 0) 0x7f14680042a0 con 0x7f14640663a0 2023-07-14T13:09:53.274 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:53.275 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:09:53.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.242+0000 7f147cd12640 1 -- 172.21.15.5:0/3572586582 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f14640663a0 msgr2=0x7f1464068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:53.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.242+0000 7f147cd12640 1 --2- 172.21.15.5:0/3572586582 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f14640663a0 0x7f1464068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f147808a220 tx=0x7f14680a6000 comp rx=0 tx=0).stop 2023-07-14T13:09:53.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.242+0000 7f147cd12640 1 -- 172.21.15.5:0/3572586582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14780d13f0 msgr2=0x7f14780ca050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:53.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.242+0000 7f147cd12640 1 --2- 172.21.15.5:0/3572586582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14780d13f0 0x7f14780ca050 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f146c00c500 tx=0x7f146c00c9c0 comp rx=0 tx=0).stop 2023-07-14T13:09:53.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.242+0000 7f147cd12640 1 -- 172.21.15.5:0/3572586582 shutdown_connections 2023-07-14T13:09:53.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.242+0000 7f147cd12640 1 --2- 172.21.15.5:0/3572586582 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f14640663a0 0x7f1464068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:53.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.242+0000 7f147cd12640 1 --2- 172.21.15.5:0/3572586582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f147815f3f0 0x7f14780cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:53.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.242+0000 7f147cd12640 1 --2- 172.21.15.5:0/3572586582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14780d13f0 0x7f14780ca050 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:53.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.242+0000 7f147cd12640 1 --2- 172.21.15.5:0/3572586582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f14780b7bc0 0x7f1478157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:53.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.242+0000 7f147cd12640 1 -- 172.21.15.5:0/3572586582 >> 172.21.15.5:0/3572586582 conn(0x7f1478069f50 msgr2=0x7f147806a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:53.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.242+0000 7f147cd12640 1 -- 172.21.15.5:0/3572586582 shutdown_connections 2023-07-14T13:09:53.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.242+0000 7f147cd12640 1 -- 172.21.15.5:0/3572586582 wait complete. 2023-07-14T13:09:53.295 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-14T13:09:52.065991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":338660,"kb_used_data":11556,"kb_used_omap":0,"kb_used_meta":327040,"kb_avail":754636060,"statfs":{"total":773094113280,"available":772747325440,"internally_reserved":0,"allocated":11833344,"data_stored":6536654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":334888960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.312346"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.760362+0000","last_change":"2023-07-14T13:09:47.760362+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.760362+0000","last_undegraded":"2023-07-14T13:09:47.760362+0000","last_fullsized":"2023-07-14T13:09:47.760362+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.761883+0000","last_change":"2023-07-14T13:09:47.761883+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.761883+0000","last_undegraded":"2023-07-14T13:09:47.761883+0000","last_fullsized":"2023-07-14T13:09:47.761883+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.758963+0000","last_change":"2023-07-14T13:09:47.758963+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.758963+0000","last_undegraded":"2023-07-14T13:09:47.758963+0000","last_fullsized":"2023-07-14T13:09:47.758963+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.765351+0000","last_change":"2023-07-14T13:09:47.765351+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.765351+0000","last_undegraded":"2023-07-14T13:09:47.765351+0000","last_fullsized":"2023-07-14T13:09:47.765351+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.757609+0000","last_change":"2023-07-14T13:09:47.757609+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.757609+0000","last_undegraded":"2023-07-14T13:09:47.757609+0000","last_fullsized":"2023-07-14T13:09:47.757609+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.760520+0000","last_change":"2023-07-14T13:09:47.760520+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.760520+0000","last_undegraded":"2023-07-14T13:09:47.760520+0000","last_fullsized":"2023-07-14T13:09:47.760520+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.766444+0000","last_change":"2023-07-14T13:09:47.766444+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.766444+0000","last_undegraded":"2023-07-14T13:09:47.766444+0000","last_fullsized":"2023-07-14T13:09:47.766444+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.760971+0000","last_change":"2023-07-14T13:09:47.760971+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.760971+0000","last_undegraded":"2023-07-14T13:09:47.760971+0000","last_fullsized":"2023-07-14T13:09:47.760971+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.757646+0000","last_change":"2023-07-14T13:09:47.757646+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.757646+0000","last_undegraded":"2023-07-14T13:09:47.757646+0000","last_fullsized":"2023-07-14T13:09:47.757646+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.756810+0000","last_change":"2023-07-14T13:09:47.756810+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.756810+0000","last_undegraded":"2023-07-14T13:09:47.756810+0000","last_fullsized":"2023-07-14T13:09:47.756810+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.760610+0000","last_change":"2023-07-14T13:09:47.760610+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.760610+0000","last_undegraded":"2023-07-14T13:09:47.760610+0000","last_fullsized":"2023-07-14T13:09:47.760610+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.757359+0000","last_change":"2023-07-14T13:09:47.757359+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.757359+0000","last_undegraded":"2023-07-14T13:09:47.757359+0000","last_fullsized":"2023-07-14T13:09:47.757359+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.763361+0000","last_change":"2023-07-14T13:09:47.763361+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.763361+0000","last_undegraded":"2023-07-14T13:09:47.763361+0000","last_fullsized":"2023-07-14T13:09:47.763361+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.759068+0000","last_change":"2023-07-14T13:09:47.759068+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.759068+0000","last_undegraded":"2023-07-14T13:09:47.759068+0000","last_fullsized":"2023-07-14T13:09:47.759068+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.761532+0000","last_change":"2023-07-14T13:09:47.761532+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.761532+0000","last_undegraded":"2023-07-14T13:09:47.761532+0000","last_fullsized":"2023-07-14T13:09:47.761532+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.758671+0000","last_change":"2023-07-14T13:09:47.758671+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.758671+0000","last_undegraded":"2023-07-14T13:09:47.758671+0000","last_fullsized":"2023-07-14T13:09:47.758671+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.766998+0000","last_change":"2023-07-14T13:09:47.766998+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.766998+0000","last_undegraded":"2023-07-14T13:09:47.766998+0000","last_fullsized":"2023-07-14T13:09:47.766998+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.759550+0000","last_change":"2023-07-14T13:09:47.759550+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.759550+0000","last_undegraded":"2023-07-14T13:09:47.759550+0000","last_fullsized":"2023-07-14T13:09:47.759550+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.759435+0000","last_change":"2023-07-14T13:09:47.759435+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.759435+0000","last_undegraded":"2023-07-14T13:09:47.759435+0000","last_fullsized":"2023-07-14T13:09:47.759435+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.764876+0000","last_change":"2023-07-14T13:09:47.764876+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.764876+0000","last_undegraded":"2023-07-14T13:09:47.764876+0000","last_fullsized":"2023-07-14T13:09:47.764876+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.758657+0000","last_change":"2023-07-14T13:09:47.758657+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.758657+0000","last_undegraded":"2023-07-14T13:09:47.758657+0000","last_fullsized":"2023-07-14T13:09:47.758657+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.758502+0000","last_change":"2023-07-14T13:09:47.758502+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.758502+0000","last_undegraded":"2023-07-14T13:09:47.758502+0000","last_fullsized":"2023-07-14T13:09:47.758502+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.764133+0000","last_change":"2023-07-14T13:09:47.764133+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.764133+0000","last_undegraded":"2023-07-14T13:09:47.764133+0000","last_fullsized":"2023-07-14T13:09:47.764133+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.758368+0000","last_change":"2023-07-14T13:09:47.758368+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.758368+0000","last_undegraded":"2023-07-14T13:09:47.758368+0000","last_fullsized":"2023-07-14T13:09:47.758368+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.763754+0000","last_change":"2023-07-14T13:09:47.763754+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.763754+0000","last_undegraded":"2023-07-14T13:09:47.763754+0000","last_fullsized":"2023-07-14T13:09:47.763754+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.759447+0000","last_change":"2023-07-14T13:09:47.759447+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.759447+0000","last_undegraded":"2023-07-14T13:09:47.759447+0000","last_fullsized":"2023-07-14T13:09:47.759447+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.756813+0000","last_change":"2023-07-14T13:09:47.756813+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.756813+0000","last_undegraded":"2023-07-14T13:09:47.756813+0000","last_fullsized":"2023-07-14T13:09:47.756813+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.764398+0000","last_change":"2023-07-14T13:09:47.764398+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.764398+0000","last_undegraded":"2023-07-14T13:09:47.764398+0000","last_fullsized":"2023-07-14T13:09:47.764398+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.766056+0000","last_change":"2023-07-14T13:09:47.766056+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.766056+0000","last_undegraded":"2023-07-14T13:09:47.766056+0000","last_fullsized":"2023-07-14T13:09:47.766056+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.757615+0000","last_change":"2023-07-14T13:09:47.757615+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.757615+0000","last_undegraded":"2023-07-14T13:09:47.757615+0000","last_fullsized":"2023-07-14T13:09:47.757615+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.763270+0000","last_change":"2023-07-14T13:09:47.763270+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.763270+0000","last_undegraded":"2023-07-14T13:09:47.763270+0000","last_fullsized":"2023-07-14T13:09:47.763270+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.758145+0000","last_change":"2023-07-14T13:09:47.758145+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.758145+0000","last_undegraded":"2023-07-14T13:09:47.758145+0000","last_fullsized":"2023-07-14T13:09:47.758145+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.764225+0000","last_change":"2023-07-14T13:09:47.764225+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.764225+0000","last_undegraded":"2023-07-14T13:09:47.764225+0000","last_fullsized":"2023-07-14T13:09:47.764225+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.782251+0000","last_change":"2023-07-14T13:09:47.780072+0000","last_active":"2023-07-14T13:09:47.782251+0000","last_peered":"2023-07-14T13:09:47.782251+0000","last_clean":"2023-07-14T13:09:47.782251+0000","last_became_active":"2023-07-14T13:09:47.779698+0000","last_became_peered":"2023-07-14T13:09:47.779698+0000","last_unstale":"2023-07-14T13:09:47.782251+0000","last_undegraded":"2023-07-14T13:09:47.782251+0000","last_fullsized":"2023-07-14T13:09:47.782251+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:56:49.048563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.766159+0000","last_change":"2023-07-14T13:09:47.766159+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.766159+0000","last_undegraded":"2023-07-14T13:09:47.766159+0000","last_fullsized":"2023-07-14T13:09:47.766159+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.773244+0000","last_change":"2023-07-14T13:09:47.771139+0000","last_active":"2023-07-14T13:09:47.773244+0000","last_peered":"2023-07-14T13:09:47.773244+0000","last_clean":"2023-07-14T13:09:47.773244+0000","last_became_active":"2023-07-14T13:09:47.770511+0000","last_became_peered":"2023-07-14T13:09:47.770511+0000","last_unstale":"2023-07-14T13:09:47.773244+0000","last_undegraded":"2023-07-14T13:09:47.773244+0000","last_fullsized":"2023-07-14T13:09:47.773244+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:53:30.860841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.765253+0000","last_change":"2023-07-14T13:09:47.765253+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.765253+0000","last_undegraded":"2023-07-14T13:09:47.765253+0000","last_fullsized":"2023-07-14T13:09:47.765253+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.775705+0000","last_change":"2023-07-14T13:09:47.774348+0000","last_active":"2023-07-14T13:09:47.775705+0000","last_peered":"2023-07-14T13:09:47.775705+0000","last_clean":"2023-07-14T13:09:47.775705+0000","last_became_active":"2023-07-14T13:09:47.773974+0000","last_became_peered":"2023-07-14T13:09:47.773974+0000","last_unstale":"2023-07-14T13:09:47.775705+0000","last_undegraded":"2023-07-14T13:09:47.775705+0000","last_fullsized":"2023-07-14T13:09:47.775705+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:42:05.547147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.763615+0000","last_change":"2023-07-14T13:09:47.763615+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.763615+0000","last_undegraded":"2023-07-14T13:09:47.763615+0000","last_fullsized":"2023-07-14T13:09:47.763615+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.779044+0000","last_change":"2023-07-14T13:09:47.777290+0000","last_active":"2023-07-14T13:09:47.779044+0000","last_peered":"2023-07-14T13:09:47.779044+0000","last_clean":"2023-07-14T13:09:47.779044+0000","last_became_active":"2023-07-14T13:09:47.776922+0000","last_became_peered":"2023-07-14T13:09:47.776922+0000","last_unstale":"2023-07-14T13:09:47.779044+0000","last_undegraded":"2023-07-14T13:09:47.779044+0000","last_fullsized":"2023-07-14T13:09:47.779044+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:52:54.956548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.760522+0000","last_change":"2023-07-14T13:09:47.760522+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.760522+0000","last_undegraded":"2023-07-14T13:09:47.760522+0000","last_fullsized":"2023-07-14T13:09:47.760522+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.771557+0000","last_change":"2023-07-14T13:09:47.769784+0000","last_active":"2023-07-14T13:09:47.771557+0000","last_peered":"2023-07-14T13:09:47.771557+0000","last_clean":"2023-07-14T13:09:47.771557+0000","last_became_active":"2023-07-14T13:09:47.769454+0000","last_became_peered":"2023-07-14T13:09:47.769454+0000","last_unstale":"2023-07-14T13:09:47.771557+0000","last_undegraded":"2023-07-14T13:09:47.771557+0000","last_fullsized":"2023-07-14T13:09:47.771557+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:47:04.435096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.763562+0000","last_change":"2023-07-14T13:09:47.763562+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.763562+0000","last_undegraded":"2023-07-14T13:09:47.763562+0000","last_fullsized":"2023-07-14T13:09:47.763562+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.774959+0000","last_change":"2023-07-14T13:09:47.769513+0000","last_active":"2023-07-14T13:09:47.774959+0000","last_peered":"2023-07-14T13:09:47.774959+0000","last_clean":"2023-07-14T13:09:47.774959+0000","last_became_active":"2023-07-14T13:09:47.769181+0000","last_became_peered":"2023-07-14T13:09:47.769181+0000","last_unstale":"2023-07-14T13:09:47.774959+0000","last_undegraded":"2023-07-14T13:09:47.774959+0000","last_fullsized":"2023-07-14T13:09:47.774959+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:37:23.085622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.760000+0000","last_change":"2023-07-14T13:09:47.760000+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.760000+0000","last_undegraded":"2023-07-14T13:09:47.760000+0000","last_fullsized":"2023-07-14T13:09:47.760000+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.774783+0000","last_change":"2023-07-14T13:09:47.773338+0000","last_active":"2023-07-14T13:09:47.774783+0000","last_peered":"2023-07-14T13:09:47.774783+0000","last_clean":"2023-07-14T13:09:47.774783+0000","last_became_active":"2023-07-14T13:09:47.773046+0000","last_became_peered":"2023-07-14T13:09:47.773046+0000","last_unstale":"2023-07-14T13:09:47.774783+0000","last_undegraded":"2023-07-14T13:09:47.774783+0000","last_fullsized":"2023-07-14T13:09:47.774783+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:06:46.095660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.762803+0000","last_change":"2023-07-14T13:09:47.762803+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.762803+0000","last_undegraded":"2023-07-14T13:09:47.762803+0000","last_fullsized":"2023-07-14T13:09:47.762803+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.781693+0000","last_change":"2023-07-14T13:09:47.780668+0000","last_active":"2023-07-14T13:09:47.781693+0000","last_peered":"2023-07-14T13:09:47.781693+0000","last_clean":"2023-07-14T13:09:47.781693+0000","last_became_active":"2023-07-14T13:09:47.780381+0000","last_became_peered":"2023-07-14T13:09:47.780381+0000","last_unstale":"2023-07-14T13:09:47.781693+0000","last_undegraded":"2023-07-14T13:09:47.781693+0000","last_fullsized":"2023-07-14T13:09:47.781693+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:18:49.457309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.758264+0000","last_change":"2023-07-14T13:09:47.758264+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.758264+0000","last_undegraded":"2023-07-14T13:09:47.758264+0000","last_fullsized":"2023-07-14T13:09:47.758264+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.772431+0000","last_change":"2023-07-14T13:09:47.771140+0000","last_active":"2023-07-14T13:09:47.772431+0000","last_peered":"2023-07-14T13:09:47.772431+0000","last_clean":"2023-07-14T13:09:47.772431+0000","last_became_active":"2023-07-14T13:09:47.770759+0000","last_became_peered":"2023-07-14T13:09:47.770759+0000","last_unstale":"2023-07-14T13:09:47.772431+0000","last_undegraded":"2023-07-14T13:09:47.772431+0000","last_fullsized":"2023-07-14T13:09:47.772431+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:24:03.560900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.764174+0000","last_change":"2023-07-14T13:09:47.764174+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.764174+0000","last_undegraded":"2023-07-14T13:09:47.764174+0000","last_fullsized":"2023-07-14T13:09:47.764174+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.777611+0000","last_change":"2023-07-14T13:09:47.774479+0000","last_active":"2023-07-14T13:09:47.777611+0000","last_peered":"2023-07-14T13:09:47.777611+0000","last_clean":"2023-07-14T13:09:47.777611+0000","last_became_active":"2023-07-14T13:09:47.774120+0000","last_became_peered":"2023-07-14T13:09:47.774120+0000","last_unstale":"2023-07-14T13:09:47.777611+0000","last_undegraded":"2023-07-14T13:09:47.777611+0000","last_fullsized":"2023-07-14T13:09:47.777611+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:38:34.753440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.759053+0000","last_change":"2023-07-14T13:09:47.759053+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.759053+0000","last_undegraded":"2023-07-14T13:09:47.759053+0000","last_fullsized":"2023-07-14T13:09:47.759053+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.781237+0000","last_change":"2023-07-14T13:09:47.780026+0000","last_active":"2023-07-14T13:09:47.781237+0000","last_peered":"2023-07-14T13:09:47.781237+0000","last_clean":"2023-07-14T13:09:47.781237+0000","last_became_active":"2023-07-14T13:09:47.779666+0000","last_became_peered":"2023-07-14T13:09:47.779666+0000","last_unstale":"2023-07-14T13:09:47.781237+0000","last_undegraded":"2023-07-14T13:09:47.781237+0000","last_fullsized":"2023-07-14T13:09:47.781237+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:25:17.781221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.763483+0000","last_change":"2023-07-14T13:09:47.763483+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.763483+0000","last_undegraded":"2023-07-14T13:09:47.763483+0000","last_fullsized":"2023-07-14T13:09:47.763483+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.779845+0000","last_change":"2023-07-14T13:09:47.774575+0000","last_active":"2023-07-14T13:09:47.779845+0000","last_peered":"2023-07-14T13:09:47.779845+0000","last_clean":"2023-07-14T13:09:47.779845+0000","last_became_active":"2023-07-14T13:09:47.774273+0000","last_became_peered":"2023-07-14T13:09:47.774273+0000","last_unstale":"2023-07-14T13:09:47.779845+0000","last_undegraded":"2023-07-14T13:09:47.779845+0000","last_fullsized":"2023-07-14T13:09:47.779845+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:25:27.493551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.759977+0000","last_change":"2023-07-14T13:09:47.759977+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.759977+0000","last_undegraded":"2023-07-14T13:09:47.759977+0000","last_fullsized":"2023-07-14T13:09:47.759977+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.781236+0000","last_change":"2023-07-14T13:09:47.780239+0000","last_active":"2023-07-14T13:09:47.781236+0000","last_peered":"2023-07-14T13:09:47.781236+0000","last_clean":"2023-07-14T13:09:47.781236+0000","last_became_active":"2023-07-14T13:09:47.779940+0000","last_became_peered":"2023-07-14T13:09:47.779940+0000","last_unstale":"2023-07-14T13:09:47.781236+0000","last_undegraded":"2023-07-14T13:09:47.781236+0000","last_fullsized":"2023-07-14T13:09:47.781236+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:08:39.506257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.757732+0000","last_change":"2023-07-14T13:09:47.757732+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.757732+0000","last_undegraded":"2023-07-14T13:09:47.757732+0000","last_fullsized":"2023-07-14T13:09:47.757732+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.779761+0000","last_change":"2023-07-14T13:09:47.773431+0000","last_active":"2023-07-14T13:09:47.779761+0000","last_peered":"2023-07-14T13:09:47.779761+0000","last_clean":"2023-07-14T13:09:47.779761+0000","last_became_active":"2023-07-14T13:09:47.773132+0000","last_became_peered":"2023-07-14T13:09:47.773132+0000","last_unstale":"2023-07-14T13:09:47.779761+0000","last_undegraded":"2023-07-14T13:09:47.779761+0000","last_fullsized":"2023-07-14T13:09:47.779761+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:00:32.740012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.757164+0000","last_change":"2023-07-14T13:09:47.757164+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.757164+0000","last_undegraded":"2023-07-14T13:09:47.757164+0000","last_fullsized":"2023-07-14T13:09:47.757164+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.774916+0000","last_change":"2023-07-14T13:09:47.769864+0000","last_active":"2023-07-14T13:09:47.774916+0000","last_peered":"2023-07-14T13:09:47.774916+0000","last_clean":"2023-07-14T13:09:47.774916+0000","last_became_active":"2023-07-14T13:09:47.769417+0000","last_became_peered":"2023-07-14T13:09:47.769417+0000","last_unstale":"2023-07-14T13:09:47.774916+0000","last_undegraded":"2023-07-14T13:09:47.774916+0000","last_fullsized":"2023-07-14T13:09:47.774916+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:29.887302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.756514+0000","last_change":"2023-07-14T13:09:47.756514+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.756514+0000","last_undegraded":"2023-07-14T13:09:47.756514+0000","last_fullsized":"2023-07-14T13:09:47.756514+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.774986+0000","last_change":"2023-07-14T13:09:47.770460+0000","last_active":"2023-07-14T13:09:47.774986+0000","last_peered":"2023-07-14T13:09:47.774986+0000","last_clean":"2023-07-14T13:09:47.774986+0000","last_became_active":"2023-07-14T13:09:47.770187+0000","last_became_peered":"2023-07-14T13:09:47.770187+0000","last_unstale":"2023-07-14T13:09:47.774986+0000","last_undegraded":"2023-07-14T13:09:47.774986+0000","last_fullsized":"2023-07-14T13:09:47.774986+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:39:21.924186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.763524+0000","last_change":"2023-07-14T13:09:47.763524+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.763524+0000","last_undegraded":"2023-07-14T13:09:47.763524+0000","last_fullsized":"2023-07-14T13:09:47.763524+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.776708+0000","last_change":"2023-07-14T13:09:47.775032+0000","last_active":"2023-07-14T13:09:47.776708+0000","last_peered":"2023-07-14T13:09:47.776708+0000","last_clean":"2023-07-14T13:09:47.776708+0000","last_became_active":"2023-07-14T13:09:47.774767+0000","last_became_peered":"2023-07-14T13:09:47.774767+0000","last_unstale":"2023-07-14T13:09:47.776708+0000","last_undegraded":"2023-07-14T13:09:47.776708+0000","last_fullsized":"2023-07-14T13:09:47.776708+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:10:48.069098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.765744+0000","last_change":"2023-07-14T13:09:47.765744+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.765744+0000","last_undegraded":"2023-07-14T13:09:47.765744+0000","last_fullsized":"2023-07-14T13:09:47.765744+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.773262+0000","last_change":"2023-07-14T13:09:47.771248+0000","last_active":"2023-07-14T13:09:47.773262+0000","last_peered":"2023-07-14T13:09:47.773262+0000","last_clean":"2023-07-14T13:09:47.773262+0000","last_became_active":"2023-07-14T13:09:47.770885+0000","last_became_peered":"2023-07-14T13:09:47.770885+0000","last_unstale":"2023-07-14T13:09:47.773262+0000","last_undegraded":"2023-07-14T13:09:47.773262+0000","last_fullsized":"2023-07-14T13:09:47.773262+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:37:30.072972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.759994+0000","last_change":"2023-07-14T13:09:47.759994+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.759994+0000","last_undegraded":"2023-07-14T13:09:47.759994+0000","last_fullsized":"2023-07-14T13:09:47.759994+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.780225+0000","last_change":"2023-07-14T13:09:47.777989+0000","last_active":"2023-07-14T13:09:47.780225+0000","last_peered":"2023-07-14T13:09:47.780225+0000","last_clean":"2023-07-14T13:09:47.780225+0000","last_became_active":"2023-07-14T13:09:47.777607+0000","last_became_peered":"2023-07-14T13:09:47.777607+0000","last_unstale":"2023-07-14T13:09:47.780225+0000","last_undegraded":"2023-07-14T13:09:47.780225+0000","last_fullsized":"2023-07-14T13:09:47.780225+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:20.906129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.762259+0000","last_change":"2023-07-14T13:09:47.762259+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.762259+0000","last_undegraded":"2023-07-14T13:09:47.762259+0000","last_fullsized":"2023-07-14T13:09:47.762259+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.774156+0000","last_change":"2023-07-14T13:09:47.770697+0000","last_active":"2023-07-14T13:09:47.774156+0000","last_peered":"2023-07-14T13:09:47.774156+0000","last_clean":"2023-07-14T13:09:47.774156+0000","last_became_active":"2023-07-14T13:09:47.770416+0000","last_became_peered":"2023-07-14T13:09:47.770416+0000","last_unstale":"2023-07-14T13:09:47.774156+0000","last_undegraded":"2023-07-14T13:09:47.774156+0000","last_fullsized":"2023-07-14T13:09:47.774156+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:49:23.152978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.756482+0000","last_change":"2023-07-14T13:09:47.756482+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.756482+0000","last_undegraded":"2023-07-14T13:09:47.756482+0000","last_fullsized":"2023-07-14T13:09:47.756482+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.779807+0000","last_change":"2023-07-14T13:09:47.773993+0000","last_active":"2023-07-14T13:09:47.779807+0000","last_peered":"2023-07-14T13:09:47.779807+0000","last_clean":"2023-07-14T13:09:47.779807+0000","last_became_active":"2023-07-14T13:09:47.773728+0000","last_became_peered":"2023-07-14T13:09:47.773728+0000","last_unstale":"2023-07-14T13:09:47.779807+0000","last_undegraded":"2023-07-14T13:09:47.779807+0000","last_fullsized":"2023-07-14T13:09:47.779807+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:32:30.697695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.757684+0000","last_change":"2023-07-14T13:09:47.757684+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.757684+0000","last_undegraded":"2023-07-14T13:09:47.757684+0000","last_fullsized":"2023-07-14T13:09:47.757684+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.779226+0000","last_change":"2023-07-14T13:09:47.777463+0000","last_active":"2023-07-14T13:09:47.779226+0000","last_peered":"2023-07-14T13:09:47.779226+0000","last_clean":"2023-07-14T13:09:47.779226+0000","last_became_active":"2023-07-14T13:09:47.777170+0000","last_became_peered":"2023-07-14T13:09:47.777170+0000","last_unstale":"2023-07-14T13:09:47.779226+0000","last_undegraded":"2023-07-14T13:09:47.779226+0000","last_fullsized":"2023-07-14T13:09:47.779226+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:07:29.398438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.762566+0000","last_change":"2023-07-14T13:09:47.762566+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.762566+0000","last_undegraded":"2023-07-14T13:09:47.762566+0000","last_fullsized":"2023-07-14T13:09:47.762566+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.774828+0000","last_change":"2023-07-14T13:09:47.773135+0000","last_active":"2023-07-14T13:09:47.774828+0000","last_peered":"2023-07-14T13:09:47.774828+0000","last_clean":"2023-07-14T13:09:47.774828+0000","last_became_active":"2023-07-14T13:09:47.772845+0000","last_became_peered":"2023-07-14T13:09:47.772845+0000","last_unstale":"2023-07-14T13:09:47.774828+0000","last_undegraded":"2023-07-14T13:09:47.774828+0000","last_fullsized":"2023-07-14T13:09:47.774828+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:29:44.821736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.759799+0000","last_change":"2023-07-14T13:09:47.759799+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.759799+0000","last_undegraded":"2023-07-14T13:09:47.759799+0000","last_fullsized":"2023-07-14T13:09:47.759799+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.779192+0000","last_change":"2023-07-14T13:09:47.778138+0000","last_active":"2023-07-14T13:09:47.779192+0000","last_peered":"2023-07-14T13:09:47.779192+0000","last_clean":"2023-07-14T13:09:47.779192+0000","last_became_active":"2023-07-14T13:09:47.777801+0000","last_became_peered":"2023-07-14T13:09:47.777801+0000","last_unstale":"2023-07-14T13:09:47.779192+0000","last_undegraded":"2023-07-14T13:09:47.779192+0000","last_fullsized":"2023-07-14T13:09:47.779192+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:14:39.893439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.768345+0000","last_change":"2023-07-14T13:09:47.768345+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.768345+0000","last_undegraded":"2023-07-14T13:09:47.768345+0000","last_fullsized":"2023-07-14T13:09:47.768345+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.776165+0000","last_change":"2023-07-14T13:09:47.773514+0000","last_active":"2023-07-14T13:09:47.776165+0000","last_peered":"2023-07-14T13:09:47.776165+0000","last_clean":"2023-07-14T13:09:47.776165+0000","last_became_active":"2023-07-14T13:09:47.773211+0000","last_became_peered":"2023-07-14T13:09:47.773211+0000","last_unstale":"2023-07-14T13:09:47.776165+0000","last_undegraded":"2023-07-14T13:09:47.776165+0000","last_fullsized":"2023-07-14T13:09:47.776165+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:57:29.617032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"99'205","reported_seq":643,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.765518+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:09:47.765518+0000","last_peered":"2023-07-14T13:09:47.765518+0000","last_clean":"2023-07-14T13:09:47.765518+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:09:47.765518+0000","last_undegraded":"2023-07-14T13:09:47.765518+0000","last_fullsized":"2023-07-14T13:09:47.765518+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:36:33.811572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.762067+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:09:47.762067+0000","last_peered":"2023-07-14T13:09:47.762067+0000","last_clean":"2023-07-14T13:09:47.762067+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:09:47.762067+0000","last_undegraded":"2023-07-14T13:09:47.762067+0000","last_fullsized":"2023-07-14T13:09:47.762067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:40:20.999404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.763399+0000","last_change":"2023-07-14T13:09:47.763399+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.763399+0000","last_undegraded":"2023-07-14T13:09:47.763399+0000","last_fullsized":"2023-07-14T13:09:47.763399+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.777830+0000","last_change":"2023-07-14T13:09:47.775769+0000","last_active":"2023-07-14T13:09:47.777830+0000","last_peered":"2023-07-14T13:09:47.777830+0000","last_clean":"2023-07-14T13:09:47.777830+0000","last_became_active":"2023-07-14T13:09:47.775476+0000","last_became_peered":"2023-07-14T13:09:47.775476+0000","last_unstale":"2023-07-14T13:09:47.777830+0000","last_undegraded":"2023-07-14T13:09:47.777830+0000","last_fullsized":"2023-07-14T13:09:47.777830+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:23.297437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.765408+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:09:47.765408+0000","last_peered":"2023-07-14T13:09:47.765408+0000","last_clean":"2023-07-14T13:09:47.765408+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:09:47.765408+0000","last_undegraded":"2023-07-14T13:09:47.765408+0000","last_fullsized":"2023-07-14T13:09:47.765408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:55:05.093080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.763905+0000","last_change":"2023-07-14T13:09:47.763905+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.763905+0000","last_undegraded":"2023-07-14T13:09:47.763905+0000","last_fullsized":"2023-07-14T13:09:47.763905+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.775809+0000","last_change":"2023-07-14T13:09:47.774372+0000","last_active":"2023-07-14T13:09:47.775809+0000","last_peered":"2023-07-14T13:09:47.775809+0000","last_clean":"2023-07-14T13:09:47.775809+0000","last_became_active":"2023-07-14T13:09:47.774044+0000","last_became_peered":"2023-07-14T13:09:47.774044+0000","last_unstale":"2023-07-14T13:09:47.775809+0000","last_undegraded":"2023-07-14T13:09:47.775809+0000","last_fullsized":"2023-07-14T13:09:47.775809+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:02:43.298987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.753420+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:09:47.753420+0000","last_peered":"2023-07-14T13:09:47.753420+0000","last_clean":"2023-07-14T13:09:47.753420+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:09:47.753420+0000","last_undegraded":"2023-07-14T13:09:47.753420+0000","last_fullsized":"2023-07-14T13:09:47.753420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:00:40.546057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.758830+0000","last_change":"2023-07-14T13:09:47.758830+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.758830+0000","last_undegraded":"2023-07-14T13:09:47.758830+0000","last_fullsized":"2023-07-14T13:09:47.758830+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.780203+0000","last_change":"2023-07-14T13:09:47.776207+0000","last_active":"2023-07-14T13:09:47.780203+0000","last_peered":"2023-07-14T13:09:47.780203+0000","last_clean":"2023-07-14T13:09:47.780203+0000","last_became_active":"2023-07-14T13:09:47.775865+0000","last_became_peered":"2023-07-14T13:09:47.775865+0000","last_unstale":"2023-07-14T13:09:47.780203+0000","last_undegraded":"2023-07-14T13:09:47.780203+0000","last_fullsized":"2023-07-14T13:09:47.780203+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:43:19.395013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.762223+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:09:47.762223+0000","last_peered":"2023-07-14T13:09:47.762223+0000","last_clean":"2023-07-14T13:09:47.762223+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:09:47.762223+0000","last_undegraded":"2023-07-14T13:09:47.762223+0000","last_fullsized":"2023-07-14T13:09:47.762223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:38:58.964127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.757587+0000","last_change":"2023-07-14T13:09:47.757587+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.757587+0000","last_undegraded":"2023-07-14T13:09:47.757587+0000","last_fullsized":"2023-07-14T13:09:47.757587+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.779166+0000","last_change":"2023-07-14T13:09:47.777379+0000","last_active":"2023-07-14T13:09:47.779166+0000","last_peered":"2023-07-14T13:09:47.779166+0000","last_clean":"2023-07-14T13:09:47.779166+0000","last_became_active":"2023-07-14T13:09:47.776990+0000","last_became_peered":"2023-07-14T13:09:47.776990+0000","last_unstale":"2023-07-14T13:09:47.779166+0000","last_undegraded":"2023-07-14T13:09:47.779166+0000","last_fullsized":"2023-07-14T13:09:47.779166+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:54:26.049260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.765626+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:09:47.765626+0000","last_peered":"2023-07-14T13:09:47.765626+0000","last_clean":"2023-07-14T13:09:47.765626+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:09:47.765626+0000","last_undegraded":"2023-07-14T13:09:47.765626+0000","last_fullsized":"2023-07-14T13:09:47.765626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:41:24.098277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.762762+0000","last_change":"2023-07-14T13:09:47.762762+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.762762+0000","last_undegraded":"2023-07-14T13:09:47.762762+0000","last_fullsized":"2023-07-14T13:09:47.762762+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.776749+0000","last_change":"2023-07-14T13:09:47.772443+0000","last_active":"2023-07-14T13:09:47.776749+0000","last_peered":"2023-07-14T13:09:47.776749+0000","last_clean":"2023-07-14T13:09:47.776749+0000","last_became_active":"2023-07-14T13:09:47.772118+0000","last_became_peered":"2023-07-14T13:09:47.772118+0000","last_unstale":"2023-07-14T13:09:47.776749+0000","last_undegraded":"2023-07-14T13:09:47.776749+0000","last_fullsized":"2023-07-14T13:09:47.776749+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:20:36.146987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.764941+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:09:47.764941+0000","last_peered":"2023-07-14T13:09:47.764941+0000","last_clean":"2023-07-14T13:09:47.764941+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:09:47.764941+0000","last_undegraded":"2023-07-14T13:09:47.764941+0000","last_fullsized":"2023-07-14T13:09:47.764941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:04:58.036443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.761769+0000","last_change":"2023-07-14T13:09:47.761769+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.761769+0000","last_undegraded":"2023-07-14T13:09:47.761769+0000","last_fullsized":"2023-07-14T13:09:47.761769+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.781662+0000","last_change":"2023-07-14T13:09:47.780048+0000","last_active":"2023-07-14T13:09:47.781662+0000","last_peered":"2023-07-14T13:09:47.781662+0000","last_clean":"2023-07-14T13:09:47.781662+0000","last_became_active":"2023-07-14T13:09:47.779564+0000","last_became_peered":"2023-07-14T13:09:47.779564+0000","last_unstale":"2023-07-14T13:09:47.781662+0000","last_undegraded":"2023-07-14T13:09:47.781662+0000","last_fullsized":"2023-07-14T13:09:47.781662+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:14:50.917717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.764568+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:09:47.764568+0000","last_peered":"2023-07-14T13:09:47.764568+0000","last_clean":"2023-07-14T13:09:47.764568+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:09:47.764568+0000","last_undegraded":"2023-07-14T13:09:47.764568+0000","last_fullsized":"2023-07-14T13:09:47.764568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:40:49.361870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.760318+0000","last_change":"2023-07-14T13:09:47.760318+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.760318+0000","last_undegraded":"2023-07-14T13:09:47.760318+0000","last_fullsized":"2023-07-14T13:09:47.760318+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.770286+0000","last_change":"2023-07-14T13:09:47.768621+0000","last_active":"2023-07-14T13:09:47.770286+0000","last_peered":"2023-07-14T13:09:47.770286+0000","last_clean":"2023-07-14T13:09:47.770286+0000","last_became_active":"2023-07-14T13:09:47.768335+0000","last_became_peered":"2023-07-14T13:09:47.768335+0000","last_unstale":"2023-07-14T13:09:47.770286+0000","last_undegraded":"2023-07-14T13:09:47.770286+0000","last_fullsized":"2023-07-14T13:09:47.770286+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:45:38.011247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.762983+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:09:47.762983+0000","last_peered":"2023-07-14T13:09:47.762983+0000","last_clean":"2023-07-14T13:09:47.762983+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:09:47.762983+0000","last_undegraded":"2023-07-14T13:09:47.762983+0000","last_fullsized":"2023-07-14T13:09:47.762983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:58:56.674915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575054,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59164,"kb_used_data":1876,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312676,"statfs":{"total":96636764160,"available":96576180224,"internally_reserved":0,"allocated":1921024,"data_stored":1257627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.70299999999999996,"15min":0.71699999999999997},"min":{"1min":0.46300000000000002,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.60799999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72099999999999997,"15min":0.73699999999999999},"min":{"1min":0.47199999999999998,"5min":0.434,"15min":0.434},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72499999999999998,"15min":0.745},"min":{"1min":0.436,"5min":0.436,"15min":0.40500000000000003},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.65600000000000003}]},{"osd":2,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.72999999999999998},"min":{"1min":0.51900000000000002,"5min":0.46999999999999997,"15min":0.42699999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.624},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72499999999999998,"15min":0.75},"min":{"1min":0.47999999999999998,"5min":0.47199999999999998,"15min":0.46899999999999997},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.53600000000000003}]},{"osd":3,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72499999999999998,"15min":0.73599999999999999},"min":{"1min":0.57999999999999996,"5min":0.503,"15min":0.46400000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72999999999999998,"15min":0.75600000000000001},"min":{"1min":0.47899999999999998,"5min":0.47299999999999998,"15min":0.41499999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68000000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55400000000000005,"15min":0.58099999999999996},"min":{"1min":0.44,"5min":0.318,"15min":0.318},"max":{"1min":0.74299999999999999,"5min":0.86299999999999999,"15min":1.022},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58899999999999997,"15min":0.60299999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.39300000000000002},"max":{"1min":0.84399999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.46600000000000003}]},{"osd":5,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98299999999999998},"last":0.442},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.628,"15min":0.65300000000000002},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82899999999999996,"5min":1.028,"15min":1.028},"last":0.42399999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.67300000000000004,"15min":0.69599999999999995},"min":{"1min":0.499,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89800000000000002,"5min":0.99299999999999999,"15min":1.0600000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64100000000000001,"15min":0.66900000000000004},"min":{"1min":0.46200000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81399999999999995,"5min":0.95799999999999996,"15min":1.04},"last":0.51100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575055,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32344,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1327104,"data_stored":667259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.48399999999999999,"5min":0.39500000000000002,"15min":0.38},"max":{"1min":0.874,"5min":0.96499999999999997,"15min":1.05},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.71299999999999997,"15min":0.73699999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.47399999999999998},"max":{"1min":0.86499999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.47399999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71699999999999997,"15min":0.745},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.379},"max":{"1min":0.81499999999999995,"5min":0.97199999999999998,"15min":1.0209999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69699999999999995,"15min":0.72299999999999998},"min":{"1min":0.55900000000000005,"5min":0.46999999999999997,"15min":0.44},"max":{"1min":0.85199999999999998,"5min":0.97099999999999997,"15min":1.077},"last":0.70099999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73899999999999999,"15min":0.752},"min":{"1min":0.55500000000000005,"5min":0.45900000000000002,"15min":0.40400000000000003},"max":{"1min":0.89700000000000002,"5min":0.95099999999999996,"15min":1.105},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.73599999999999999,"15min":0.751},"min":{"1min":0.441,"5min":0.441,"15min":0.42299999999999999},"max":{"1min":0.89500000000000002,"5min":0.99099999999999999,"15min":1.0900000000000001},"last":0.64600000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.748,"15min":0.77500000000000002},"min":{"1min":0.46000000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.93999999999999995,"5min":1.054,"15min":1.1359999999999999},"last":0.754},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74199999999999999,"15min":0.76300000000000001},"min":{"1min":0.50900000000000001,"5min":0.48399999999999999,"15min":0.45900000000000002},"max":{"1min":0.94599999999999995,"5min":0.99099999999999999,"15min":1.1080000000000001},"last":0.58499999999999996}]},{"osd":4,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56399999999999995,"15min":0.57299999999999995},"min":{"1min":0.39900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.83299999999999996,"5min":0.89900000000000002,"15min":0.97899999999999998},"last":0.627},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.439,"5min":0.38500000000000001,"15min":0.36099999999999999},"max":{"1min":0.87,"5min":1.012,"15min":1.0780000000000001},"last":0.72199999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.48699999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.88100000000000001,"5min":1.579,"15min":1.579},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67900000000000005,"15min":0.68999999999999995},"min":{"1min":0.46300000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90100000000000002,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.66600000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64400000000000002,"15min":0.65700000000000003},"min":{"1min":0.44700000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86399999999999999,"5min":1.0940000000000001,"15min":1.1200000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69599999999999995,"15min":0.70799999999999996},"min":{"1min":0.53400000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.92400000000000004,"5min":1.657,"15min":1.657},"last":0.74099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575054,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46296,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":44992,"kb_avail":94325544,"statfs":{"total":96636764160,"available":96589357056,"internally_reserved":0,"allocated":1327104,"data_stored":667259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46071808},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.70799999999999996,"15min":0.73099999999999998},"min":{"1min":0.376,"5min":0.36499999999999999,"15min":0.32400000000000001},"max":{"1min":0.91500000000000004,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68799999999999994,"15min":0.73299999999999998},"min":{"1min":0.41699999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.86099999999999999,"5min":1.083,"15min":1.083},"last":0.72699999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69899999999999995,"15min":0.72699999999999998},"min":{"1min":0.46899999999999997,"5min":0.44500000000000001,"15min":0.41099999999999998},"max":{"1min":0.85199999999999998,"5min":1.05,"15min":1.079},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73299999999999998,"15min":0.747},"min":{"1min":0.48999999999999999,"5min":0.48699999999999999,"15min":0.36799999999999999},"max":{"1min":0.94599999999999995,"5min":2.706,"15min":2.706},"last":0.745}]},{"osd":2,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71299999999999997,"15min":0.73899999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86299999999999999,"5min":1.212,"15min":1.212},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.70499999999999996,"15min":0.73499999999999999},"min":{"1min":0.44800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89200000000000002,"5min":1.181,"15min":1.181},"last":0.76100000000000001}]},{"osd":3,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73299999999999998,"15min":0.748},"min":{"1min":0.48599999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.876,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72799999999999998,"15min":0.76000000000000001},"min":{"1min":0.47299999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90800000000000003,"5min":1.304,"15min":1.304},"last":0.68300000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64000000000000001,"15min":0.629},"min":{"1min":0.437,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.85399999999999998,"5min":1.129,"15min":1.129},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.39900000000000002,"5min":0.36299999999999999,"15min":0.35899999999999999},"max":{"1min":0.84499999999999997,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.41899999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.60399999999999998,"15min":0.61399999999999999},"min":{"1min":0.41999999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90200000000000002,"5min":1.169,"15min":1.169},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.64400000000000002,"15min":0.64100000000000001},"min":{"1min":0.39400000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.83699999999999997,"5min":1.238,"15min":1.238},"last":0.55500000000000005}]},{"osd":7,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66100000000000003,"15min":0.64300000000000002},"min":{"1min":0.45500000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93300000000000005,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68200000000000005,"15min":0.67800000000000005},"min":{"1min":0.48999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90100000000000002,"5min":1.407,"15min":1.407},"last":0.53100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1339392,"data_stored":673887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.70899999999999996,"15min":0.72999999999999998},"min":{"1min":0.36899999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.90800000000000003,"5min":1.0129999999999999,"15min":1.411},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.435},"max":{"1min":0.85199999999999998,"5min":1.0640000000000001,"15min":1.1200000000000001},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.748,"15min":0.749},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92500000000000004,"5min":0.94699999999999995,"15min":1.077},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70999999999999996,"15min":0.73599999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89600000000000002,"5min":0.96399999999999997,"15min":1.0469999999999999},"last":0.503}]},{"osd":2,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.51800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91000000000000003,"5min":0.96499999999999997,"15min":1.091},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.76900000000000002,"15min":0.77400000000000002},"min":{"1min":0.46400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98099999999999998,"5min":1.0649999999999999,"15min":1.387},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.72999999999999998,"15min":0.746},"min":{"1min":0.53200000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.94699999999999995,"5min":0.997,"15min":1.008},"last":0.622},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.75800000000000001,"15min":0.77100000000000002},"min":{"1min":0.504,"5min":0.496,"15min":0.46800000000000003},"max":{"1min":0.875,"5min":1.024,"15min":1.0589999999999999},"last":0.47499999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61899999999999999,"15min":0.60499999999999998},"min":{"1min":0.49299999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.85299999999999998,"5min":0.95599999999999996,"15min":1.0029999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63300000000000001,"15min":0.61799999999999999},"min":{"1min":0.45900000000000002,"5min":0.41399999999999998,"15min":0.34599999999999997},"max":{"1min":0.93200000000000005,"5min":0.93600000000000005,"15min":0.95199999999999996},"last":0.69299999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.32300000000000001},"max":{"1min":0.96999999999999997,"5min":1.014,"15min":1.014},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68300000000000005,"15min":0.66900000000000004},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.374},"max":{"1min":0.86899999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.71499999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68899999999999995,"15min":0.66900000000000004},"min":{"1min":0.503,"5min":0.46000000000000002,"15min":0.39000000000000001},"max":{"1min":0.89400000000000002,"5min":0.94699999999999995,"15min":1.0349999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70999999999999996,"15min":0.69499999999999995},"min":{"1min":0.42799999999999999,"5min":0.40300000000000002,"15min":0.36899999999999999},"max":{"1min":0.91800000000000004,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.44}]}]},{"osd":3,"up_from":13,"seq":55834575054,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36452,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335388,"statfs":{"total":96636764160,"available":96599437312,"internally_reserved":0,"allocated":1339392,"data_stored":673887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.26200000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.84199999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.498,"15min":0.51500000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.60799999999999998,"5min":0.77300000000000002,"15min":1.0209999999999999},"last":0.63200000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47199999999999998,"15min":0.47499999999999998},"min":{"1min":0.33100000000000002,"5min":0.315,"15min":0.29599999999999999},"max":{"1min":0.63900000000000001,"5min":0.77200000000000002,"15min":0.79600000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67800000000000005,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.59299999999999997}]},{"osd":2,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54100000000000004,"15min":0.56999999999999995},"min":{"1min":0.38200000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.72399999999999998,"5min":0.82599999999999996,"15min":0.95899999999999996},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60699999999999998,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86599999999999999,"5min":1.663,"15min":1.663},"last":0.67900000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.748,"15min":0.76500000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":0.90900000000000003,"5min":1.284,"15min":1.284},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76800000000000002,"15min":0.78900000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.47699999999999998},"max":{"1min":1.0660000000000001,"5min":1.121,"15min":1.196},"last":0.78500000000000003}]},{"osd":5,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.52400000000000002},"max":{"1min":1.0229999999999999,"5min":1.306,"15min":1.306},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77900000000000003,"15min":0.79100000000000004},"min":{"1min":0.58099999999999996,"5min":0.372,"15min":0.372},"max":{"1min":0.97399999999999998,"5min":1.1870000000000001,"15min":1.2470000000000001},"last":0.76800000000000002}]},{"osd":6,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.76800000000000002,"15min":0.78000000000000003},"min":{"1min":0.50600000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96599999999999997,"5min":1.105,"15min":1.117},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.79700000000000004,"15min":0.81799999999999995},"min":{"1min":0.56299999999999994,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.93999999999999995,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.873}]},{"osd":7,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.83299999999999996,"15min":0.84099999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53100000000000003},"max":{"1min":0.89900000000000002,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.53500000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0009999999999999,"5min":1.595,"15min":1.595},"last":0.89300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575054,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58592,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313248,"statfs":{"total":96636764160,"available":96576765952,"internally_reserved":0,"allocated":1335296,"data_stored":672868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45900000000000002,"15min":0.46800000000000003},"min":{"1min":0.29199999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.84699999999999998,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.54200000000000004,"15min":0.53300000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.70799999999999996,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.68600000000000005}]},{"osd":1,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.48299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30399999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65500000000000003,"5min":2.7200000000000002,"15min":2.7200000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.55000000000000004,"15min":0.56299999999999994},"min":{"1min":0.36299999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78300000000000003,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":0.54400000000000004}]},{"osd":3,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.64500000000000002,"15min":0.60399999999999998},"min":{"1min":0.39500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71699999999999997,"5min":8.2530000000000001,"15min":8.2530000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89600000000000002,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.57199999999999995}]},{"osd":4,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.754,"15min":0.78100000000000003},"min":{"1min":0.53200000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.99399999999999999,"5min":1.0940000000000001,"15min":1.1499999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.56699999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0629999999999999,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.85699999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.84399999999999997,"15min":0.85799999999999998},"min":{"1min":0.58599999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1319999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82499999999999996,"15min":0.83999999999999997},"min":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.433},"max":{"1min":1.153,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.76300000000000001}]},{"osd":6,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.78700000000000003,"15min":0.80400000000000005},"min":{"1min":0.57299999999999995,"5min":0.48999999999999999,"15min":0.47599999999999998},"max":{"1min":0.93999999999999995,"5min":3.9849999999999999,"15min":3.9849999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80200000000000005,"15min":0.81299999999999994},"min":{"1min":0.60699999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0289999999999999,"5min":3.391,"15min":3.391},"last":0.63400000000000001}]},{"osd":7,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.79600000000000004,"15min":0.82199999999999995},"min":{"1min":0.55000000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.1759999999999999,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.81499999999999995,"15min":0.82299999999999995},"min":{"1min":0.60199999999999998,"5min":0.53200000000000003,"15min":0.50900000000000001},"max":{"1min":1.0940000000000001,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.78600000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575055,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36440,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335400,"statfs":{"total":96636764160,"available":96599449600,"internally_reserved":0,"allocated":1327104,"data_stored":667259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.29199999999999998,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.53700000000000003,"5min":0.65400000000000003,"15min":0.77200000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.28199999999999997,"15min":0.26500000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.64100000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47199999999999998,"15min":0.47299999999999998},"min":{"1min":0.34300000000000003,"5min":0.32100000000000001,"15min":0.29499999999999998},"max":{"1min":0.54200000000000004,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65100000000000002,"5min":1.014,"15min":1.014},"last":0.68700000000000006}]},{"osd":3,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.621,"15min":0.63600000000000001},"min":{"1min":0.48199999999999998,"5min":0.44700000000000001,"15min":0.437},"max":{"1min":0.73899999999999999,"5min":0.80500000000000005,"15min":0.96299999999999997},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56499999999999995,"15min":0.57999999999999996},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.749}]},{"osd":4,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77700000000000002,"15min":0.78400000000000003},"min":{"1min":0.55500000000000005,"5min":0.51600000000000001,"15min":0.40000000000000002},"max":{"1min":1.0409999999999999,"5min":1.2110000000000001,"15min":1.236},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77200000000000002,"15min":0.78600000000000003},"min":{"1min":0.57499999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.0309999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.80800000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.60799999999999998,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.55800000000000005,"5min":0.48599999999999999,"15min":0.48199999999999998},"max":{"1min":1.0940000000000001,"5min":1.2749999999999999,"15min":1.3600000000000001},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.53800000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1.0580000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.80500000000000005,"15min":0.81399999999999995},"min":{"1min":0.56100000000000005,"5min":0.52200000000000002,"15min":0.49199999999999999},"max":{"1min":1.1319999999999999,"5min":1.262,"15min":1.2969999999999999},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.47799999999999998},"max":{"1min":1.1479999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.82099999999999995,"15min":0.84099999999999997},"min":{"1min":0.58499999999999996,"5min":0.53700000000000003,"15min":0.52800000000000002},"max":{"1min":1.2070000000000001,"5min":1.327,"15min":1.327},"last":0.77000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575056,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37016,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334824,"statfs":{"total":96636764160,"available":96598859776,"internally_reserved":0,"allocated":1916928,"data_stored":1256608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.45600000000000002,"15min":0.44700000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.61199999999999999,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.49099999999999999,"15min":0.51500000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.27700000000000002},"max":{"1min":0.61799999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.38700000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.51900000000000002,"15min":0.51100000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69699999999999995,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.502,"5min":0.54000000000000004,"15min":0.55300000000000005},"min":{"1min":0.39800000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63800000000000001,"5min":0.80300000000000005,"15min":0.90300000000000002},"last":0.436}]},{"osd":3,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.504},"min":{"1min":0.36399999999999999,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.67600000000000005,"5min":0.72999999999999998,"15min":0.84999999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82899999999999996,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.49399999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76900000000000002,"15min":0.78800000000000003},"min":{"1min":0.56100000000000005,"5min":0.48399999999999999,"15min":0.44400000000000001},"max":{"1min":0.90500000000000003,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.53500000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.038,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.72699999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.77100000000000002,"15min":0.80600000000000005},"min":{"1min":0.55100000000000005,"5min":0.51800000000000002,"15min":0.47899999999999998},"max":{"1min":0.80500000000000005,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.56399999999999995,"5min":0.49299999999999999,"15min":0.47299999999999998},"max":{"1min":0.97299999999999998,"5min":1.325,"15min":1.325},"last":0.60699999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.79100000000000004,"15min":0.80600000000000005},"min":{"1min":0.53500000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91400000000000003,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78900000000000003,"15min":0.81499999999999995},"min":{"1min":0.58399999999999996,"5min":0.55500000000000005,"15min":0.41299999999999998},"max":{"1min":1.0900000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.628}]},{"osd":7,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.79800000000000004,"15min":0.83199999999999996},"min":{"1min":0.57699999999999996,"5min":0.503,"15min":0.45500000000000002},"max":{"1min":0.93799999999999994,"5min":1.171,"15min":1.2749999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.77100000000000002,"15min":0.81100000000000005},"min":{"1min":0.50600000000000001,"5min":0.502,"15min":0.497},"max":{"1min":0.95199999999999996,"5min":1.381,"15min":1.381},"last":0.69999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:09:53.302 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:09:53.400 INFO:tasks.ceph.mds.c.smithi005.stderr:2023-07-14T13:09:53.370+0000 7f73c4aa2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T13:09:53.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.446+0000 7fa4117c5640 1 Processor -- start 2023-07-14T13:09:53.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.446+0000 7fa4117c5640 1 -- start start 2023-07-14T13:09:53.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.450+0000 7fa4117c5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa40c06b1e0 0x7fa40c0c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:53.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.450+0000 7fa4117c5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa40c0c21f0 0x7fa40c0cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:53.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.450+0000 7fa4117c5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa40c0cac70 con 0x7fa40c070b70 2023-07-14T13:09:53.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.450+0000 7fa4117c5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa40c0ca060 con 0x7fa40c06b1e0 2023-07-14T13:09:53.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.450+0000 7fa4117c5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c0ca340 con 0x7fa40c0c21f0 2023-07-14T13:09:53.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.450+0000 7fa403fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa40c06b1e0 0x7fa40c0c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:53.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.450+0000 7fa403fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa40c06b1e0 0x7fa40c0c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35012/0 (socket says 172.21.15.5:35012) 2023-07-14T13:09:53.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.450+0000 7fa403fff640 1 -- 172.21.15.5:0/4152154142 learned_addr learned my addr 172.21.15.5:0/4152154142 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:53.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.450+0000 7fa40b7fe640 1 --2- 172.21.15.5:0/4152154142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa40c0c21f0 0x7fa40c0cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:53.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.450+0000 7fa403fff640 1 -- 172.21.15.5:0/4152154142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa40c0c21f0 msgr2=0x7fa40c0cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:53.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.450+0000 7fa403fff640 1 --2- 172.21.15.5:0/4152154142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa40c0c21f0 0x7fa40c0cb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:53.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.450+0000 7fa403fff640 1 -- 172.21.15.5:0/4152154142 >> v1:172.21.15.154:6789/0 conn(0x7fa40c070b70 legacy=0x7fa40c070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:53.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.450+0000 7fa403fff640 1 -- 172.21.15.5:0/4152154142 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40c0ca620 con 0x7fa40c06b1e0 2023-07-14T13:09:53.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.454+0000 7fa403fff640 1 --2- 172.21.15.5:0/4152154142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa40c06b1e0 0x7fa40c0c1cb0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4009870 tx=0x7fa3f401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc416cb5858daef8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:53.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.454+0000 7fa40a7fc640 1 -- 172.21.15.5:0/4152154142 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f40a95f0 con 0x7fa40c06b1e0 2023-07-14T13:09:53.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.454+0000 7fa40a7fc640 1 -- 172.21.15.5:0/4152154142 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f40a9750 con 0x7fa40c06b1e0 2023-07-14T13:09:53.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.454+0000 7fa40a7fc640 1 -- 172.21.15.5:0/4152154142 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f40a9ae0 con 0x7fa40c06b1e0 2023-07-14T13:09:53.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.454+0000 7fa4117c5640 1 -- 172.21.15.5:0/4152154142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa40c06b1e0 msgr2=0x7fa40c0c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:53.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.454+0000 7fa4117c5640 1 --2- 172.21.15.5:0/4152154142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa40c06b1e0 0x7fa40c0c1cb0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4009870 tx=0x7fa3f401c510 comp rx=0 tx=0).stop 2023-07-14T13:09:53.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.454+0000 7fa4117c5640 1 -- 172.21.15.5:0/4152154142 shutdown_connections 2023-07-14T13:09:53.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.454+0000 7fa4117c5640 1 --2- 172.21.15.5:0/4152154142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa40c0c21f0 0x7fa40c0cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:53.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.454+0000 7fa4117c5640 1 --2- 172.21.15.5:0/4152154142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa40c06b1e0 0x7fa40c0c1cb0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:53.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.454+0000 7fa4117c5640 1 -- 172.21.15.5:0/4152154142 >> 172.21.15.5:0/4152154142 conn(0x7fa40c0afcf0 msgr2=0x7fa40c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:53.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.454+0000 7fa4117c5640 1 -- 172.21.15.5:0/4152154142 shutdown_connections 2023-07-14T13:09:53.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.454+0000 7fa4117c5640 1 -- 172.21.15.5:0/4152154142 wait complete. 2023-07-14T13:09:53.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.454+0000 7fa4117c5640 1 Processor -- start 2023-07-14T13:09:53.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.454+0000 7fa4117c5640 1 -- start start 2023-07-14T13:09:53.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.458+0000 7fa4117c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa40c06b1e0 0x7fa40c14df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:53.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.458+0000 7fa4117c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa40c070b70 0x7fa40c156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:53.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.458+0000 7fa4117c5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa40c0c21f0 0x7fa40c0c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:53.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.458+0000 7fa4117c5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c158330 con 0x7fa40c06b1e0 2023-07-14T13:09:53.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.458+0000 7fa4117c5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c14ea00 con 0x7fa40c070b70 2023-07-14T13:09:53.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.458+0000 7fa4117c5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c159840 con 0x7fa40c0c21f0 2023-07-14T13:09:53.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.458+0000 7fa40affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa40c06b1e0 0x7fa40c14df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:53.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.458+0000 7fa40affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa40c06b1e0 0x7fa40c14df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35018/0 (socket says 172.21.15.5:35018) 2023-07-14T13:09:53.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.458+0000 7fa40affd640 1 -- 172.21.15.5:0/5445547 learned_addr learned my addr 172.21.15.5:0/5445547 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:53.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.458+0000 7fa403fff640 1 --2- 172.21.15.5:0/5445547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa40c070b70 0x7fa40c156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:53.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.458+0000 7fa40b7fe640 1 --2- 172.21.15.5:0/5445547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa40c0c21f0 0x7fa40c0c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:53.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.458+0000 7fa40affd640 1 -- 172.21.15.5:0/5445547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa40c0c21f0 msgr2=0x7fa40c0c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:53.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.458+0000 7fa40affd640 1 --2- 172.21.15.5:0/5445547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa40c0c21f0 0x7fa40c0c3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:53.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.458+0000 7fa40affd640 1 -- 172.21.15.5:0/5445547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa40c070b70 msgr2=0x7fa40c156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:53.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.458+0000 7fa40affd640 1 --2- 172.21.15.5:0/5445547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa40c070b70 0x7fa40c156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:53.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.458+0000 7fa40affd640 1 -- 172.21.15.5:0/5445547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f40094d0 con 0x7fa40c06b1e0 2023-07-14T13:09:53.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.458+0000 7fa403fff640 1 --2- 172.21.15.5:0/5445547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa40c070b70 0x7fa40c156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:53.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.458+0000 7fa40affd640 1 --2- 172.21.15.5:0/5445547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa40c06b1e0 0x7fa40c14df70 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc00c530 tx=0x7fa3fc00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:53.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.458+0000 7fa4037fe640 1 -- 172.21.15.5:0/5445547 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc005220 con 0x7fa40c06b1e0 2023-07-14T13:09:53.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.458+0000 7fa4037fe640 1 -- 172.21.15.5:0/5445547 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3fc005380 con 0x7fa40c06b1e0 2023-07-14T13:09:53.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.458+0000 7fa4117c5640 1 -- 172.21.15.5:0/5445547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa40c159280 con 0x7fa40c06b1e0 2023-07-14T13:09:53.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.458+0000 7fa4037fe640 1 -- 172.21.15.5:0/5445547 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc007270 con 0x7fa40c06b1e0 2023-07-14T13:09:53.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.458+0000 7fa4117c5640 1 -- 172.21.15.5:0/5445547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa40c14e690 con 0x7fa40c06b1e0 2023-07-14T13:09:53.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.458+0000 7fa4117c5640 1 -- 172.21.15.5:0/5445547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa40c0678d0 con 0x7fa40c06b1e0 2023-07-14T13:09:53.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.458+0000 7fa4037fe640 1 -- 172.21.15.5:0/5445547 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa3fc0073d0 con 0x7fa40c06b1e0 2023-07-14T13:09:53.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.462+0000 7fa4037fe640 1 --2- 172.21.15.5:0/5445547 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fa3ec0663d0 0x7fa3ec068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:53.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.462+0000 7fa4037fe640 1 -- 172.21.15.5:0/5445547 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa3fc0836e0 con 0x7fa40c06b1e0 2023-07-14T13:09:53.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.462+0000 7fa403fff640 1 --2- 172.21.15.5:0/5445547 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fa3ec0663d0 0x7fa3ec068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:53.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.462+0000 7fa403fff640 1 --2- 172.21.15.5:0/5445547 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fa3ec0663d0 0x7fa3ec068880 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40ae000 tx=0x7fa3f40b3040 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:53.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.466+0000 7fa4037fe640 1 -- 172.21.15.5:0/5445547 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa3fc050ac0 con 0x7fa40c06b1e0 2023-07-14T13:09:53.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.618+0000 7fa4117c5640 1 -- 172.21.15.5:0/5445547 --> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa40c0c9cf0 con 0x7fa3ec0663d0 2023-07-14T13:09:53.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.626+0000 7fa4037fe640 1 -- 172.21.15.5:0/5445547 <== mgr.7156 v2:172.21.15.154:6832/1525189184 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306372 (secure 0 0 0) 0x7fa3f40a93f0 con 0x7fa3ec0663d0 2023-07-14T13:09:53.661 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:53.663 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:09:53.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.630+0000 7fa4117c5640 1 -- 172.21.15.5:0/5445547 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fa3ec0663d0 msgr2=0x7fa3ec068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:53.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.630+0000 7fa4117c5640 1 --2- 172.21.15.5:0/5445547 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fa3ec0663d0 0x7fa3ec068880 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40ae000 tx=0x7fa3f40b3040 comp rx=0 tx=0).stop 2023-07-14T13:09:53.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.630+0000 7fa4117c5640 1 -- 172.21.15.5:0/5445547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa40c06b1e0 msgr2=0x7fa40c14df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:53.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.630+0000 7fa4117c5640 1 --2- 172.21.15.5:0/5445547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa40c06b1e0 0x7fa40c14df70 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc00c530 tx=0x7fa3fc00c9f0 comp rx=0 tx=0).stop 2023-07-14T13:09:53.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.630+0000 7fa4117c5640 1 -- 172.21.15.5:0/5445547 shutdown_connections 2023-07-14T13:09:53.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.630+0000 7fa4117c5640 1 --2- 172.21.15.5:0/5445547 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fa3ec0663d0 0x7fa3ec068880 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:53.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.630+0000 7fa4117c5640 1 --2- 172.21.15.5:0/5445547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa40c0c21f0 0x7fa40c0c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:53.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.630+0000 7fa4117c5640 1 --2- 172.21.15.5:0/5445547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa40c070b70 0x7fa40c156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:53.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.630+0000 7fa4117c5640 1 --2- 172.21.15.5:0/5445547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa40c06b1e0 0x7fa40c14df70 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:53.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.630+0000 7fa4117c5640 1 -- 172.21.15.5:0/5445547 >> 172.21.15.5:0/5445547 conn(0x7fa40c0afcf0 msgr2=0x7fa40c1526b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:53.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.630+0000 7fa4117c5640 1 -- 172.21.15.5:0/5445547 shutdown_connections 2023-07-14T13:09:53.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.630+0000 7fa4117c5640 1 -- 172.21.15.5:0/5445547 wait complete. 2023-07-14T13:09:53.682 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-14T13:09:52.065991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":338660,"kb_used_data":11556,"kb_used_omap":0,"kb_used_meta":327040,"kb_avail":754636060,"statfs":{"total":773094113280,"available":772747325440,"internally_reserved":0,"allocated":11833344,"data_stored":6536654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":334888960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.312346"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.760362+0000","last_change":"2023-07-14T13:09:47.760362+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.760362+0000","last_undegraded":"2023-07-14T13:09:47.760362+0000","last_fullsized":"2023-07-14T13:09:47.760362+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.761883+0000","last_change":"2023-07-14T13:09:47.761883+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.761883+0000","last_undegraded":"2023-07-14T13:09:47.761883+0000","last_fullsized":"2023-07-14T13:09:47.761883+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.758963+0000","last_change":"2023-07-14T13:09:47.758963+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.758963+0000","last_undegraded":"2023-07-14T13:09:47.758963+0000","last_fullsized":"2023-07-14T13:09:47.758963+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.765351+0000","last_change":"2023-07-14T13:09:47.765351+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.765351+0000","last_undegraded":"2023-07-14T13:09:47.765351+0000","last_fullsized":"2023-07-14T13:09:47.765351+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.757609+0000","last_change":"2023-07-14T13:09:47.757609+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.757609+0000","last_undegraded":"2023-07-14T13:09:47.757609+0000","last_fullsized":"2023-07-14T13:09:47.757609+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.760520+0000","last_change":"2023-07-14T13:09:47.760520+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.760520+0000","last_undegraded":"2023-07-14T13:09:47.760520+0000","last_fullsized":"2023-07-14T13:09:47.760520+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.766444+0000","last_change":"2023-07-14T13:09:47.766444+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.766444+0000","last_undegraded":"2023-07-14T13:09:47.766444+0000","last_fullsized":"2023-07-14T13:09:47.766444+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.760971+0000","last_change":"2023-07-14T13:09:47.760971+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.760971+0000","last_undegraded":"2023-07-14T13:09:47.760971+0000","last_fullsized":"2023-07-14T13:09:47.760971+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.757646+0000","last_change":"2023-07-14T13:09:47.757646+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.757646+0000","last_undegraded":"2023-07-14T13:09:47.757646+0000","last_fullsized":"2023-07-14T13:09:47.757646+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.756810+0000","last_change":"2023-07-14T13:09:47.756810+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.756810+0000","last_undegraded":"2023-07-14T13:09:47.756810+0000","last_fullsized":"2023-07-14T13:09:47.756810+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.760610+0000","last_change":"2023-07-14T13:09:47.760610+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.760610+0000","last_undegraded":"2023-07-14T13:09:47.760610+0000","last_fullsized":"2023-07-14T13:09:47.760610+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.757359+0000","last_change":"2023-07-14T13:09:47.757359+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.757359+0000","last_undegraded":"2023-07-14T13:09:47.757359+0000","last_fullsized":"2023-07-14T13:09:47.757359+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.763361+0000","last_change":"2023-07-14T13:09:47.763361+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.763361+0000","last_undegraded":"2023-07-14T13:09:47.763361+0000","last_fullsized":"2023-07-14T13:09:47.763361+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.759068+0000","last_change":"2023-07-14T13:09:47.759068+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.759068+0000","last_undegraded":"2023-07-14T13:09:47.759068+0000","last_fullsized":"2023-07-14T13:09:47.759068+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.761532+0000","last_change":"2023-07-14T13:09:47.761532+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.761532+0000","last_undegraded":"2023-07-14T13:09:47.761532+0000","last_fullsized":"2023-07-14T13:09:47.761532+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.758671+0000","last_change":"2023-07-14T13:09:47.758671+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.758671+0000","last_undegraded":"2023-07-14T13:09:47.758671+0000","last_fullsized":"2023-07-14T13:09:47.758671+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.766998+0000","last_change":"2023-07-14T13:09:47.766998+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.766998+0000","last_undegraded":"2023-07-14T13:09:47.766998+0000","last_fullsized":"2023-07-14T13:09:47.766998+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.759550+0000","last_change":"2023-07-14T13:09:47.759550+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.759550+0000","last_undegraded":"2023-07-14T13:09:47.759550+0000","last_fullsized":"2023-07-14T13:09:47.759550+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.759435+0000","last_change":"2023-07-14T13:09:47.759435+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.759435+0000","last_undegraded":"2023-07-14T13:09:47.759435+0000","last_fullsized":"2023-07-14T13:09:47.759435+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.764876+0000","last_change":"2023-07-14T13:09:47.764876+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.764876+0000","last_undegraded":"2023-07-14T13:09:47.764876+0000","last_fullsized":"2023-07-14T13:09:47.764876+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.758657+0000","last_change":"2023-07-14T13:09:47.758657+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.758657+0000","last_undegraded":"2023-07-14T13:09:47.758657+0000","last_fullsized":"2023-07-14T13:09:47.758657+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.758502+0000","last_change":"2023-07-14T13:09:47.758502+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.758502+0000","last_undegraded":"2023-07-14T13:09:47.758502+0000","last_fullsized":"2023-07-14T13:09:47.758502+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.764133+0000","last_change":"2023-07-14T13:09:47.764133+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.764133+0000","last_undegraded":"2023-07-14T13:09:47.764133+0000","last_fullsized":"2023-07-14T13:09:47.764133+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.758368+0000","last_change":"2023-07-14T13:09:47.758368+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.758368+0000","last_undegraded":"2023-07-14T13:09:47.758368+0000","last_fullsized":"2023-07-14T13:09:47.758368+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.763754+0000","last_change":"2023-07-14T13:09:47.763754+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.763754+0000","last_undegraded":"2023-07-14T13:09:47.763754+0000","last_fullsized":"2023-07-14T13:09:47.763754+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.759447+0000","last_change":"2023-07-14T13:09:47.759447+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.759447+0000","last_undegraded":"2023-07-14T13:09:47.759447+0000","last_fullsized":"2023-07-14T13:09:47.759447+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.756813+0000","last_change":"2023-07-14T13:09:47.756813+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.756813+0000","last_undegraded":"2023-07-14T13:09:47.756813+0000","last_fullsized":"2023-07-14T13:09:47.756813+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.764398+0000","last_change":"2023-07-14T13:09:47.764398+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.764398+0000","last_undegraded":"2023-07-14T13:09:47.764398+0000","last_fullsized":"2023-07-14T13:09:47.764398+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.766056+0000","last_change":"2023-07-14T13:09:47.766056+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.766056+0000","last_undegraded":"2023-07-14T13:09:47.766056+0000","last_fullsized":"2023-07-14T13:09:47.766056+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.757615+0000","last_change":"2023-07-14T13:09:47.757615+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.757615+0000","last_undegraded":"2023-07-14T13:09:47.757615+0000","last_fullsized":"2023-07-14T13:09:47.757615+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.763270+0000","last_change":"2023-07-14T13:09:47.763270+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.763270+0000","last_undegraded":"2023-07-14T13:09:47.763270+0000","last_fullsized":"2023-07-14T13:09:47.763270+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.758145+0000","last_change":"2023-07-14T13:09:47.758145+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.758145+0000","last_undegraded":"2023-07-14T13:09:47.758145+0000","last_fullsized":"2023-07-14T13:09:47.758145+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.764225+0000","last_change":"2023-07-14T13:09:47.764225+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.764225+0000","last_undegraded":"2023-07-14T13:09:47.764225+0000","last_fullsized":"2023-07-14T13:09:47.764225+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.782251+0000","last_change":"2023-07-14T13:09:47.780072+0000","last_active":"2023-07-14T13:09:47.782251+0000","last_peered":"2023-07-14T13:09:47.782251+0000","last_clean":"2023-07-14T13:09:47.782251+0000","last_became_active":"2023-07-14T13:09:47.779698+0000","last_became_peered":"2023-07-14T13:09:47.779698+0000","last_unstale":"2023-07-14T13:09:47.782251+0000","last_undegraded":"2023-07-14T13:09:47.782251+0000","last_fullsized":"2023-07-14T13:09:47.782251+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:56:49.048563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.766159+0000","last_change":"2023-07-14T13:09:47.766159+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.766159+0000","last_undegraded":"2023-07-14T13:09:47.766159+0000","last_fullsized":"2023-07-14T13:09:47.766159+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.773244+0000","last_change":"2023-07-14T13:09:47.771139+0000","last_active":"2023-07-14T13:09:47.773244+0000","last_peered":"2023-07-14T13:09:47.773244+0000","last_clean":"2023-07-14T13:09:47.773244+0000","last_became_active":"2023-07-14T13:09:47.770511+0000","last_became_peered":"2023-07-14T13:09:47.770511+0000","last_unstale":"2023-07-14T13:09:47.773244+0000","last_undegraded":"2023-07-14T13:09:47.773244+0000","last_fullsized":"2023-07-14T13:09:47.773244+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:53:30.860841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.765253+0000","last_change":"2023-07-14T13:09:47.765253+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.765253+0000","last_undegraded":"2023-07-14T13:09:47.765253+0000","last_fullsized":"2023-07-14T13:09:47.765253+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.775705+0000","last_change":"2023-07-14T13:09:47.774348+0000","last_active":"2023-07-14T13:09:47.775705+0000","last_peered":"2023-07-14T13:09:47.775705+0000","last_clean":"2023-07-14T13:09:47.775705+0000","last_became_active":"2023-07-14T13:09:47.773974+0000","last_became_peered":"2023-07-14T13:09:47.773974+0000","last_unstale":"2023-07-14T13:09:47.775705+0000","last_undegraded":"2023-07-14T13:09:47.775705+0000","last_fullsized":"2023-07-14T13:09:47.775705+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:42:05.547147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.763615+0000","last_change":"2023-07-14T13:09:47.763615+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.763615+0000","last_undegraded":"2023-07-14T13:09:47.763615+0000","last_fullsized":"2023-07-14T13:09:47.763615+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.779044+0000","last_change":"2023-07-14T13:09:47.777290+0000","last_active":"2023-07-14T13:09:47.779044+0000","last_peered":"2023-07-14T13:09:47.779044+0000","last_clean":"2023-07-14T13:09:47.779044+0000","last_became_active":"2023-07-14T13:09:47.776922+0000","last_became_peered":"2023-07-14T13:09:47.776922+0000","last_unstale":"2023-07-14T13:09:47.779044+0000","last_undegraded":"2023-07-14T13:09:47.779044+0000","last_fullsized":"2023-07-14T13:09:47.779044+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:52:54.956548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.760522+0000","last_change":"2023-07-14T13:09:47.760522+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.760522+0000","last_undegraded":"2023-07-14T13:09:47.760522+0000","last_fullsized":"2023-07-14T13:09:47.760522+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.771557+0000","last_change":"2023-07-14T13:09:47.769784+0000","last_active":"2023-07-14T13:09:47.771557+0000","last_peered":"2023-07-14T13:09:47.771557+0000","last_clean":"2023-07-14T13:09:47.771557+0000","last_became_active":"2023-07-14T13:09:47.769454+0000","last_became_peered":"2023-07-14T13:09:47.769454+0000","last_unstale":"2023-07-14T13:09:47.771557+0000","last_undegraded":"2023-07-14T13:09:47.771557+0000","last_fullsized":"2023-07-14T13:09:47.771557+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:47:04.435096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.763562+0000","last_change":"2023-07-14T13:09:47.763562+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.763562+0000","last_undegraded":"2023-07-14T13:09:47.763562+0000","last_fullsized":"2023-07-14T13:09:47.763562+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.774959+0000","last_change":"2023-07-14T13:09:47.769513+0000","last_active":"2023-07-14T13:09:47.774959+0000","last_peered":"2023-07-14T13:09:47.774959+0000","last_clean":"2023-07-14T13:09:47.774959+0000","last_became_active":"2023-07-14T13:09:47.769181+0000","last_became_peered":"2023-07-14T13:09:47.769181+0000","last_unstale":"2023-07-14T13:09:47.774959+0000","last_undegraded":"2023-07-14T13:09:47.774959+0000","last_fullsized":"2023-07-14T13:09:47.774959+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:37:23.085622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.760000+0000","last_change":"2023-07-14T13:09:47.760000+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.760000+0000","last_undegraded":"2023-07-14T13:09:47.760000+0000","last_fullsized":"2023-07-14T13:09:47.760000+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.774783+0000","last_change":"2023-07-14T13:09:47.773338+0000","last_active":"2023-07-14T13:09:47.774783+0000","last_peered":"2023-07-14T13:09:47.774783+0000","last_clean":"2023-07-14T13:09:47.774783+0000","last_became_active":"2023-07-14T13:09:47.773046+0000","last_became_peered":"2023-07-14T13:09:47.773046+0000","last_unstale":"2023-07-14T13:09:47.774783+0000","last_undegraded":"2023-07-14T13:09:47.774783+0000","last_fullsized":"2023-07-14T13:09:47.774783+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:06:46.095660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.762803+0000","last_change":"2023-07-14T13:09:47.762803+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.762803+0000","last_undegraded":"2023-07-14T13:09:47.762803+0000","last_fullsized":"2023-07-14T13:09:47.762803+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.781693+0000","last_change":"2023-07-14T13:09:47.780668+0000","last_active":"2023-07-14T13:09:47.781693+0000","last_peered":"2023-07-14T13:09:47.781693+0000","last_clean":"2023-07-14T13:09:47.781693+0000","last_became_active":"2023-07-14T13:09:47.780381+0000","last_became_peered":"2023-07-14T13:09:47.780381+0000","last_unstale":"2023-07-14T13:09:47.781693+0000","last_undegraded":"2023-07-14T13:09:47.781693+0000","last_fullsized":"2023-07-14T13:09:47.781693+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:18:49.457309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.758264+0000","last_change":"2023-07-14T13:09:47.758264+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.758264+0000","last_undegraded":"2023-07-14T13:09:47.758264+0000","last_fullsized":"2023-07-14T13:09:47.758264+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.772431+0000","last_change":"2023-07-14T13:09:47.771140+0000","last_active":"2023-07-14T13:09:47.772431+0000","last_peered":"2023-07-14T13:09:47.772431+0000","last_clean":"2023-07-14T13:09:47.772431+0000","last_became_active":"2023-07-14T13:09:47.770759+0000","last_became_peered":"2023-07-14T13:09:47.770759+0000","last_unstale":"2023-07-14T13:09:47.772431+0000","last_undegraded":"2023-07-14T13:09:47.772431+0000","last_fullsized":"2023-07-14T13:09:47.772431+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:24:03.560900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.764174+0000","last_change":"2023-07-14T13:09:47.764174+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.764174+0000","last_undegraded":"2023-07-14T13:09:47.764174+0000","last_fullsized":"2023-07-14T13:09:47.764174+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.777611+0000","last_change":"2023-07-14T13:09:47.774479+0000","last_active":"2023-07-14T13:09:47.777611+0000","last_peered":"2023-07-14T13:09:47.777611+0000","last_clean":"2023-07-14T13:09:47.777611+0000","last_became_active":"2023-07-14T13:09:47.774120+0000","last_became_peered":"2023-07-14T13:09:47.774120+0000","last_unstale":"2023-07-14T13:09:47.777611+0000","last_undegraded":"2023-07-14T13:09:47.777611+0000","last_fullsized":"2023-07-14T13:09:47.777611+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:38:34.753440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.759053+0000","last_change":"2023-07-14T13:09:47.759053+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.759053+0000","last_undegraded":"2023-07-14T13:09:47.759053+0000","last_fullsized":"2023-07-14T13:09:47.759053+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.781237+0000","last_change":"2023-07-14T13:09:47.780026+0000","last_active":"2023-07-14T13:09:47.781237+0000","last_peered":"2023-07-14T13:09:47.781237+0000","last_clean":"2023-07-14T13:09:47.781237+0000","last_became_active":"2023-07-14T13:09:47.779666+0000","last_became_peered":"2023-07-14T13:09:47.779666+0000","last_unstale":"2023-07-14T13:09:47.781237+0000","last_undegraded":"2023-07-14T13:09:47.781237+0000","last_fullsized":"2023-07-14T13:09:47.781237+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:25:17.781221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.763483+0000","last_change":"2023-07-14T13:09:47.763483+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.763483+0000","last_undegraded":"2023-07-14T13:09:47.763483+0000","last_fullsized":"2023-07-14T13:09:47.763483+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.779845+0000","last_change":"2023-07-14T13:09:47.774575+0000","last_active":"2023-07-14T13:09:47.779845+0000","last_peered":"2023-07-14T13:09:47.779845+0000","last_clean":"2023-07-14T13:09:47.779845+0000","last_became_active":"2023-07-14T13:09:47.774273+0000","last_became_peered":"2023-07-14T13:09:47.774273+0000","last_unstale":"2023-07-14T13:09:47.779845+0000","last_undegraded":"2023-07-14T13:09:47.779845+0000","last_fullsized":"2023-07-14T13:09:47.779845+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:25:27.493551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.759977+0000","last_change":"2023-07-14T13:09:47.759977+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.759977+0000","last_undegraded":"2023-07-14T13:09:47.759977+0000","last_fullsized":"2023-07-14T13:09:47.759977+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.781236+0000","last_change":"2023-07-14T13:09:47.780239+0000","last_active":"2023-07-14T13:09:47.781236+0000","last_peered":"2023-07-14T13:09:47.781236+0000","last_clean":"2023-07-14T13:09:47.781236+0000","last_became_active":"2023-07-14T13:09:47.779940+0000","last_became_peered":"2023-07-14T13:09:47.779940+0000","last_unstale":"2023-07-14T13:09:47.781236+0000","last_undegraded":"2023-07-14T13:09:47.781236+0000","last_fullsized":"2023-07-14T13:09:47.781236+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:08:39.506257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.757732+0000","last_change":"2023-07-14T13:09:47.757732+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.757732+0000","last_undegraded":"2023-07-14T13:09:47.757732+0000","last_fullsized":"2023-07-14T13:09:47.757732+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.779761+0000","last_change":"2023-07-14T13:09:47.773431+0000","last_active":"2023-07-14T13:09:47.779761+0000","last_peered":"2023-07-14T13:09:47.779761+0000","last_clean":"2023-07-14T13:09:47.779761+0000","last_became_active":"2023-07-14T13:09:47.773132+0000","last_became_peered":"2023-07-14T13:09:47.773132+0000","last_unstale":"2023-07-14T13:09:47.779761+0000","last_undegraded":"2023-07-14T13:09:47.779761+0000","last_fullsized":"2023-07-14T13:09:47.779761+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:00:32.740012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.757164+0000","last_change":"2023-07-14T13:09:47.757164+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.757164+0000","last_undegraded":"2023-07-14T13:09:47.757164+0000","last_fullsized":"2023-07-14T13:09:47.757164+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.774916+0000","last_change":"2023-07-14T13:09:47.769864+0000","last_active":"2023-07-14T13:09:47.774916+0000","last_peered":"2023-07-14T13:09:47.774916+0000","last_clean":"2023-07-14T13:09:47.774916+0000","last_became_active":"2023-07-14T13:09:47.769417+0000","last_became_peered":"2023-07-14T13:09:47.769417+0000","last_unstale":"2023-07-14T13:09:47.774916+0000","last_undegraded":"2023-07-14T13:09:47.774916+0000","last_fullsized":"2023-07-14T13:09:47.774916+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:29.887302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.756514+0000","last_change":"2023-07-14T13:09:47.756514+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.756514+0000","last_undegraded":"2023-07-14T13:09:47.756514+0000","last_fullsized":"2023-07-14T13:09:47.756514+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.774986+0000","last_change":"2023-07-14T13:09:47.770460+0000","last_active":"2023-07-14T13:09:47.774986+0000","last_peered":"2023-07-14T13:09:47.774986+0000","last_clean":"2023-07-14T13:09:47.774986+0000","last_became_active":"2023-07-14T13:09:47.770187+0000","last_became_peered":"2023-07-14T13:09:47.770187+0000","last_unstale":"2023-07-14T13:09:47.774986+0000","last_undegraded":"2023-07-14T13:09:47.774986+0000","last_fullsized":"2023-07-14T13:09:47.774986+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:39:21.924186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.763524+0000","last_change":"2023-07-14T13:09:47.763524+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.763524+0000","last_undegraded":"2023-07-14T13:09:47.763524+0000","last_fullsized":"2023-07-14T13:09:47.763524+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.776708+0000","last_change":"2023-07-14T13:09:47.775032+0000","last_active":"2023-07-14T13:09:47.776708+0000","last_peered":"2023-07-14T13:09:47.776708+0000","last_clean":"2023-07-14T13:09:47.776708+0000","last_became_active":"2023-07-14T13:09:47.774767+0000","last_became_peered":"2023-07-14T13:09:47.774767+0000","last_unstale":"2023-07-14T13:09:47.776708+0000","last_undegraded":"2023-07-14T13:09:47.776708+0000","last_fullsized":"2023-07-14T13:09:47.776708+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:10:48.069098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.765744+0000","last_change":"2023-07-14T13:09:47.765744+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.765744+0000","last_undegraded":"2023-07-14T13:09:47.765744+0000","last_fullsized":"2023-07-14T13:09:47.765744+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.773262+0000","last_change":"2023-07-14T13:09:47.771248+0000","last_active":"2023-07-14T13:09:47.773262+0000","last_peered":"2023-07-14T13:09:47.773262+0000","last_clean":"2023-07-14T13:09:47.773262+0000","last_became_active":"2023-07-14T13:09:47.770885+0000","last_became_peered":"2023-07-14T13:09:47.770885+0000","last_unstale":"2023-07-14T13:09:47.773262+0000","last_undegraded":"2023-07-14T13:09:47.773262+0000","last_fullsized":"2023-07-14T13:09:47.773262+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:37:30.072972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.759994+0000","last_change":"2023-07-14T13:09:47.759994+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.759994+0000","last_undegraded":"2023-07-14T13:09:47.759994+0000","last_fullsized":"2023-07-14T13:09:47.759994+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.780225+0000","last_change":"2023-07-14T13:09:47.777989+0000","last_active":"2023-07-14T13:09:47.780225+0000","last_peered":"2023-07-14T13:09:47.780225+0000","last_clean":"2023-07-14T13:09:47.780225+0000","last_became_active":"2023-07-14T13:09:47.777607+0000","last_became_peered":"2023-07-14T13:09:47.777607+0000","last_unstale":"2023-07-14T13:09:47.780225+0000","last_undegraded":"2023-07-14T13:09:47.780225+0000","last_fullsized":"2023-07-14T13:09:47.780225+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:20.906129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.762259+0000","last_change":"2023-07-14T13:09:47.762259+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.762259+0000","last_undegraded":"2023-07-14T13:09:47.762259+0000","last_fullsized":"2023-07-14T13:09:47.762259+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.774156+0000","last_change":"2023-07-14T13:09:47.770697+0000","last_active":"2023-07-14T13:09:47.774156+0000","last_peered":"2023-07-14T13:09:47.774156+0000","last_clean":"2023-07-14T13:09:47.774156+0000","last_became_active":"2023-07-14T13:09:47.770416+0000","last_became_peered":"2023-07-14T13:09:47.770416+0000","last_unstale":"2023-07-14T13:09:47.774156+0000","last_undegraded":"2023-07-14T13:09:47.774156+0000","last_fullsized":"2023-07-14T13:09:47.774156+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:49:23.152978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.756482+0000","last_change":"2023-07-14T13:09:47.756482+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.756482+0000","last_undegraded":"2023-07-14T13:09:47.756482+0000","last_fullsized":"2023-07-14T13:09:47.756482+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.779807+0000","last_change":"2023-07-14T13:09:47.773993+0000","last_active":"2023-07-14T13:09:47.779807+0000","last_peered":"2023-07-14T13:09:47.779807+0000","last_clean":"2023-07-14T13:09:47.779807+0000","last_became_active":"2023-07-14T13:09:47.773728+0000","last_became_peered":"2023-07-14T13:09:47.773728+0000","last_unstale":"2023-07-14T13:09:47.779807+0000","last_undegraded":"2023-07-14T13:09:47.779807+0000","last_fullsized":"2023-07-14T13:09:47.779807+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:32:30.697695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.757684+0000","last_change":"2023-07-14T13:09:47.757684+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.757684+0000","last_undegraded":"2023-07-14T13:09:47.757684+0000","last_fullsized":"2023-07-14T13:09:47.757684+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.779226+0000","last_change":"2023-07-14T13:09:47.777463+0000","last_active":"2023-07-14T13:09:47.779226+0000","last_peered":"2023-07-14T13:09:47.779226+0000","last_clean":"2023-07-14T13:09:47.779226+0000","last_became_active":"2023-07-14T13:09:47.777170+0000","last_became_peered":"2023-07-14T13:09:47.777170+0000","last_unstale":"2023-07-14T13:09:47.779226+0000","last_undegraded":"2023-07-14T13:09:47.779226+0000","last_fullsized":"2023-07-14T13:09:47.779226+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:07:29.398438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.762566+0000","last_change":"2023-07-14T13:09:47.762566+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.762566+0000","last_undegraded":"2023-07-14T13:09:47.762566+0000","last_fullsized":"2023-07-14T13:09:47.762566+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.774828+0000","last_change":"2023-07-14T13:09:47.773135+0000","last_active":"2023-07-14T13:09:47.774828+0000","last_peered":"2023-07-14T13:09:47.774828+0000","last_clean":"2023-07-14T13:09:47.774828+0000","last_became_active":"2023-07-14T13:09:47.772845+0000","last_became_peered":"2023-07-14T13:09:47.772845+0000","last_unstale":"2023-07-14T13:09:47.774828+0000","last_undegraded":"2023-07-14T13:09:47.774828+0000","last_fullsized":"2023-07-14T13:09:47.774828+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:29:44.821736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.759799+0000","last_change":"2023-07-14T13:09:47.759799+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.759799+0000","last_undegraded":"2023-07-14T13:09:47.759799+0000","last_fullsized":"2023-07-14T13:09:47.759799+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.779192+0000","last_change":"2023-07-14T13:09:47.778138+0000","last_active":"2023-07-14T13:09:47.779192+0000","last_peered":"2023-07-14T13:09:47.779192+0000","last_clean":"2023-07-14T13:09:47.779192+0000","last_became_active":"2023-07-14T13:09:47.777801+0000","last_became_peered":"2023-07-14T13:09:47.777801+0000","last_unstale":"2023-07-14T13:09:47.779192+0000","last_undegraded":"2023-07-14T13:09:47.779192+0000","last_fullsized":"2023-07-14T13:09:47.779192+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:14:39.893439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.768345+0000","last_change":"2023-07-14T13:09:47.768345+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.768345+0000","last_undegraded":"2023-07-14T13:09:47.768345+0000","last_fullsized":"2023-07-14T13:09:47.768345+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.776165+0000","last_change":"2023-07-14T13:09:47.773514+0000","last_active":"2023-07-14T13:09:47.776165+0000","last_peered":"2023-07-14T13:09:47.776165+0000","last_clean":"2023-07-14T13:09:47.776165+0000","last_became_active":"2023-07-14T13:09:47.773211+0000","last_became_peered":"2023-07-14T13:09:47.773211+0000","last_unstale":"2023-07-14T13:09:47.776165+0000","last_undegraded":"2023-07-14T13:09:47.776165+0000","last_fullsized":"2023-07-14T13:09:47.776165+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:57:29.617032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"99'205","reported_seq":643,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.765518+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:09:47.765518+0000","last_peered":"2023-07-14T13:09:47.765518+0000","last_clean":"2023-07-14T13:09:47.765518+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:09:47.765518+0000","last_undegraded":"2023-07-14T13:09:47.765518+0000","last_fullsized":"2023-07-14T13:09:47.765518+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:36:33.811572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.762067+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:09:47.762067+0000","last_peered":"2023-07-14T13:09:47.762067+0000","last_clean":"2023-07-14T13:09:47.762067+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:09:47.762067+0000","last_undegraded":"2023-07-14T13:09:47.762067+0000","last_fullsized":"2023-07-14T13:09:47.762067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:40:20.999404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.763399+0000","last_change":"2023-07-14T13:09:47.763399+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.763399+0000","last_undegraded":"2023-07-14T13:09:47.763399+0000","last_fullsized":"2023-07-14T13:09:47.763399+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.777830+0000","last_change":"2023-07-14T13:09:47.775769+0000","last_active":"2023-07-14T13:09:47.777830+0000","last_peered":"2023-07-14T13:09:47.777830+0000","last_clean":"2023-07-14T13:09:47.777830+0000","last_became_active":"2023-07-14T13:09:47.775476+0000","last_became_peered":"2023-07-14T13:09:47.775476+0000","last_unstale":"2023-07-14T13:09:47.777830+0000","last_undegraded":"2023-07-14T13:09:47.777830+0000","last_fullsized":"2023-07-14T13:09:47.777830+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:23.297437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.765408+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:09:47.765408+0000","last_peered":"2023-07-14T13:09:47.765408+0000","last_clean":"2023-07-14T13:09:47.765408+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:09:47.765408+0000","last_undegraded":"2023-07-14T13:09:47.765408+0000","last_fullsized":"2023-07-14T13:09:47.765408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:55:05.093080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.763905+0000","last_change":"2023-07-14T13:09:47.763905+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.763905+0000","last_undegraded":"2023-07-14T13:09:47.763905+0000","last_fullsized":"2023-07-14T13:09:47.763905+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.775809+0000","last_change":"2023-07-14T13:09:47.774372+0000","last_active":"2023-07-14T13:09:47.775809+0000","last_peered":"2023-07-14T13:09:47.775809+0000","last_clean":"2023-07-14T13:09:47.775809+0000","last_became_active":"2023-07-14T13:09:47.774044+0000","last_became_peered":"2023-07-14T13:09:47.774044+0000","last_unstale":"2023-07-14T13:09:47.775809+0000","last_undegraded":"2023-07-14T13:09:47.775809+0000","last_fullsized":"2023-07-14T13:09:47.775809+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:02:43.298987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.753420+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:09:47.753420+0000","last_peered":"2023-07-14T13:09:47.753420+0000","last_clean":"2023-07-14T13:09:47.753420+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:09:47.753420+0000","last_undegraded":"2023-07-14T13:09:47.753420+0000","last_fullsized":"2023-07-14T13:09:47.753420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:00:40.546057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.758830+0000","last_change":"2023-07-14T13:09:47.758830+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.758830+0000","last_undegraded":"2023-07-14T13:09:47.758830+0000","last_fullsized":"2023-07-14T13:09:47.758830+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.780203+0000","last_change":"2023-07-14T13:09:47.776207+0000","last_active":"2023-07-14T13:09:47.780203+0000","last_peered":"2023-07-14T13:09:47.780203+0000","last_clean":"2023-07-14T13:09:47.780203+0000","last_became_active":"2023-07-14T13:09:47.775865+0000","last_became_peered":"2023-07-14T13:09:47.775865+0000","last_unstale":"2023-07-14T13:09:47.780203+0000","last_undegraded":"2023-07-14T13:09:47.780203+0000","last_fullsized":"2023-07-14T13:09:47.780203+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:43:19.395013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.762223+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:09:47.762223+0000","last_peered":"2023-07-14T13:09:47.762223+0000","last_clean":"2023-07-14T13:09:47.762223+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:09:47.762223+0000","last_undegraded":"2023-07-14T13:09:47.762223+0000","last_fullsized":"2023-07-14T13:09:47.762223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:38:58.964127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.757587+0000","last_change":"2023-07-14T13:09:47.757587+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.757587+0000","last_undegraded":"2023-07-14T13:09:47.757587+0000","last_fullsized":"2023-07-14T13:09:47.757587+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.779166+0000","last_change":"2023-07-14T13:09:47.777379+0000","last_active":"2023-07-14T13:09:47.779166+0000","last_peered":"2023-07-14T13:09:47.779166+0000","last_clean":"2023-07-14T13:09:47.779166+0000","last_became_active":"2023-07-14T13:09:47.776990+0000","last_became_peered":"2023-07-14T13:09:47.776990+0000","last_unstale":"2023-07-14T13:09:47.779166+0000","last_undegraded":"2023-07-14T13:09:47.779166+0000","last_fullsized":"2023-07-14T13:09:47.779166+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:54:26.049260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.765626+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:09:47.765626+0000","last_peered":"2023-07-14T13:09:47.765626+0000","last_clean":"2023-07-14T13:09:47.765626+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:09:47.765626+0000","last_undegraded":"2023-07-14T13:09:47.765626+0000","last_fullsized":"2023-07-14T13:09:47.765626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:41:24.098277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.762762+0000","last_change":"2023-07-14T13:09:47.762762+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.762762+0000","last_undegraded":"2023-07-14T13:09:47.762762+0000","last_fullsized":"2023-07-14T13:09:47.762762+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.776749+0000","last_change":"2023-07-14T13:09:47.772443+0000","last_active":"2023-07-14T13:09:47.776749+0000","last_peered":"2023-07-14T13:09:47.776749+0000","last_clean":"2023-07-14T13:09:47.776749+0000","last_became_active":"2023-07-14T13:09:47.772118+0000","last_became_peered":"2023-07-14T13:09:47.772118+0000","last_unstale":"2023-07-14T13:09:47.776749+0000","last_undegraded":"2023-07-14T13:09:47.776749+0000","last_fullsized":"2023-07-14T13:09:47.776749+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:20:36.146987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.764941+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:09:47.764941+0000","last_peered":"2023-07-14T13:09:47.764941+0000","last_clean":"2023-07-14T13:09:47.764941+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:09:47.764941+0000","last_undegraded":"2023-07-14T13:09:47.764941+0000","last_fullsized":"2023-07-14T13:09:47.764941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:04:58.036443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.761769+0000","last_change":"2023-07-14T13:09:47.761769+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.761769+0000","last_undegraded":"2023-07-14T13:09:47.761769+0000","last_fullsized":"2023-07-14T13:09:47.761769+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.781662+0000","last_change":"2023-07-14T13:09:47.780048+0000","last_active":"2023-07-14T13:09:47.781662+0000","last_peered":"2023-07-14T13:09:47.781662+0000","last_clean":"2023-07-14T13:09:47.781662+0000","last_became_active":"2023-07-14T13:09:47.779564+0000","last_became_peered":"2023-07-14T13:09:47.779564+0000","last_unstale":"2023-07-14T13:09:47.781662+0000","last_undegraded":"2023-07-14T13:09:47.781662+0000","last_fullsized":"2023-07-14T13:09:47.781662+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:14:50.917717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":182,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.764568+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:09:47.764568+0000","last_peered":"2023-07-14T13:09:47.764568+0000","last_clean":"2023-07-14T13:09:47.764568+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:09:47.764568+0000","last_undegraded":"2023-07-14T13:09:47.764568+0000","last_fullsized":"2023-07-14T13:09:47.764568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:40:49.361870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":109,"state":"creating+peering","last_fresh":"2023-07-14T13:09:47.760318+0000","last_change":"2023-07-14T13:09:47.760318+0000","last_active":"2023-07-14T13:09:47.748039+0000","last_peered":"2023-07-14T13:09:47.748039+0000","last_clean":"2023-07-14T13:09:47.748039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:09:47.760318+0000","last_undegraded":"2023-07-14T13:09:47.760318+0000","last_fullsized":"2023-07-14T13:09:47.760318+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.770286+0000","last_change":"2023-07-14T13:09:47.768621+0000","last_active":"2023-07-14T13:09:47.770286+0000","last_peered":"2023-07-14T13:09:47.770286+0000","last_clean":"2023-07-14T13:09:47.770286+0000","last_became_active":"2023-07-14T13:09:47.768335+0000","last_became_peered":"2023-07-14T13:09:47.768335+0000","last_unstale":"2023-07-14T13:09:47.770286+0000","last_undegraded":"2023-07-14T13:09:47.770286+0000","last_fullsized":"2023-07-14T13:09:47.770286+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:45:38.011247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":172,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-07-14T13:09:47.762983+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:09:47.762983+0000","last_peered":"2023-07-14T13:09:47.762983+0000","last_clean":"2023-07-14T13:09:47.762983+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:09:47.762983+0000","last_undegraded":"2023-07-14T13:09:47.762983+0000","last_fullsized":"2023-07-14T13:09:47.762983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:58:56.674915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575054,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59164,"kb_used_data":1876,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312676,"statfs":{"total":96636764160,"available":96576180224,"internally_reserved":0,"allocated":1921024,"data_stored":1257627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.70299999999999996,"15min":0.71699999999999997},"min":{"1min":0.46300000000000002,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.60799999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72099999999999997,"15min":0.73699999999999999},"min":{"1min":0.47199999999999998,"5min":0.434,"15min":0.434},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72499999999999998,"15min":0.745},"min":{"1min":0.436,"5min":0.436,"15min":0.40500000000000003},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.65600000000000003}]},{"osd":2,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.72999999999999998},"min":{"1min":0.51900000000000002,"5min":0.46999999999999997,"15min":0.42699999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.624},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72499999999999998,"15min":0.75},"min":{"1min":0.47999999999999998,"5min":0.47199999999999998,"15min":0.46899999999999997},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.53600000000000003}]},{"osd":3,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72499999999999998,"15min":0.73599999999999999},"min":{"1min":0.57999999999999996,"5min":0.503,"15min":0.46400000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72999999999999998,"15min":0.75600000000000001},"min":{"1min":0.47899999999999998,"5min":0.47299999999999998,"15min":0.41499999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68000000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55400000000000005,"15min":0.58099999999999996},"min":{"1min":0.44,"5min":0.318,"15min":0.318},"max":{"1min":0.74299999999999999,"5min":0.86299999999999999,"15min":1.022},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58899999999999997,"15min":0.60299999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.39300000000000002},"max":{"1min":0.84399999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.46600000000000003}]},{"osd":5,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98299999999999998},"last":0.442},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.628,"15min":0.65300000000000002},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82899999999999996,"5min":1.028,"15min":1.028},"last":0.42399999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.67300000000000004,"15min":0.69599999999999995},"min":{"1min":0.499,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89800000000000002,"5min":0.99299999999999999,"15min":1.0600000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64100000000000001,"15min":0.66900000000000004},"min":{"1min":0.46200000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81399999999999995,"5min":0.95799999999999996,"15min":1.04},"last":0.51100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575055,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32344,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1327104,"data_stored":667259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.48399999999999999,"5min":0.39500000000000002,"15min":0.38},"max":{"1min":0.874,"5min":0.96499999999999997,"15min":1.05},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.71299999999999997,"15min":0.73699999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.47399999999999998},"max":{"1min":0.86499999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.47399999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71699999999999997,"15min":0.745},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.379},"max":{"1min":0.81499999999999995,"5min":0.97199999999999998,"15min":1.0209999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69699999999999995,"15min":0.72299999999999998},"min":{"1min":0.55900000000000005,"5min":0.46999999999999997,"15min":0.44},"max":{"1min":0.85199999999999998,"5min":0.97099999999999997,"15min":1.077},"last":0.70099999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73899999999999999,"15min":0.752},"min":{"1min":0.55500000000000005,"5min":0.45900000000000002,"15min":0.40400000000000003},"max":{"1min":0.89700000000000002,"5min":0.95099999999999996,"15min":1.105},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.73599999999999999,"15min":0.751},"min":{"1min":0.441,"5min":0.441,"15min":0.42299999999999999},"max":{"1min":0.89500000000000002,"5min":0.99099999999999999,"15min":1.0900000000000001},"last":0.64600000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.748,"15min":0.77500000000000002},"min":{"1min":0.46000000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.93999999999999995,"5min":1.054,"15min":1.1359999999999999},"last":0.754},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74199999999999999,"15min":0.76300000000000001},"min":{"1min":0.50900000000000001,"5min":0.48399999999999999,"15min":0.45900000000000002},"max":{"1min":0.94599999999999995,"5min":0.99099999999999999,"15min":1.1080000000000001},"last":0.58499999999999996}]},{"osd":4,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56399999999999995,"15min":0.57299999999999995},"min":{"1min":0.39900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.83299999999999996,"5min":0.89900000000000002,"15min":0.97899999999999998},"last":0.627},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.439,"5min":0.38500000000000001,"15min":0.36099999999999999},"max":{"1min":0.87,"5min":1.012,"15min":1.0780000000000001},"last":0.72199999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.48699999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.88100000000000001,"5min":1.579,"15min":1.579},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67900000000000005,"15min":0.68999999999999995},"min":{"1min":0.46300000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90100000000000002,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.66600000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64400000000000002,"15min":0.65700000000000003},"min":{"1min":0.44700000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86399999999999999,"5min":1.0940000000000001,"15min":1.1200000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69599999999999995,"15min":0.70799999999999996},"min":{"1min":0.53400000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.92400000000000004,"5min":1.657,"15min":1.657},"last":0.74099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575054,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46296,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":44992,"kb_avail":94325544,"statfs":{"total":96636764160,"available":96589357056,"internally_reserved":0,"allocated":1327104,"data_stored":667259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46071808},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.70799999999999996,"15min":0.73099999999999998},"min":{"1min":0.376,"5min":0.36499999999999999,"15min":0.32400000000000001},"max":{"1min":0.91500000000000004,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68799999999999994,"15min":0.73299999999999998},"min":{"1min":0.41699999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.86099999999999999,"5min":1.083,"15min":1.083},"last":0.72699999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69899999999999995,"15min":0.72699999999999998},"min":{"1min":0.46899999999999997,"5min":0.44500000000000001,"15min":0.41099999999999998},"max":{"1min":0.85199999999999998,"5min":1.05,"15min":1.079},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73299999999999998,"15min":0.747},"min":{"1min":0.48999999999999999,"5min":0.48699999999999999,"15min":0.36799999999999999},"max":{"1min":0.94599999999999995,"5min":2.706,"15min":2.706},"last":0.745}]},{"osd":2,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71299999999999997,"15min":0.73899999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86299999999999999,"5min":1.212,"15min":1.212},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.70499999999999996,"15min":0.73499999999999999},"min":{"1min":0.44800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89200000000000002,"5min":1.181,"15min":1.181},"last":0.76100000000000001}]},{"osd":3,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73299999999999998,"15min":0.748},"min":{"1min":0.48599999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.876,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72799999999999998,"15min":0.76000000000000001},"min":{"1min":0.47299999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90800000000000003,"5min":1.304,"15min":1.304},"last":0.68300000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64000000000000001,"15min":0.629},"min":{"1min":0.437,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.85399999999999998,"5min":1.129,"15min":1.129},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.39900000000000002,"5min":0.36299999999999999,"15min":0.35899999999999999},"max":{"1min":0.84499999999999997,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.41899999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.60399999999999998,"15min":0.61399999999999999},"min":{"1min":0.41999999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90200000000000002,"5min":1.169,"15min":1.169},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.64400000000000002,"15min":0.64100000000000001},"min":{"1min":0.39400000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.83699999999999997,"5min":1.238,"15min":1.238},"last":0.55500000000000005}]},{"osd":7,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66100000000000003,"15min":0.64300000000000002},"min":{"1min":0.45500000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93300000000000005,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68200000000000005,"15min":0.67800000000000005},"min":{"1min":0.48999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90100000000000002,"5min":1.407,"15min":1.407},"last":0.53100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1339392,"data_stored":673887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.70899999999999996,"15min":0.72999999999999998},"min":{"1min":0.36899999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.90800000000000003,"5min":1.0129999999999999,"15min":1.411},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.435},"max":{"1min":0.85199999999999998,"5min":1.0640000000000001,"15min":1.1200000000000001},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.748,"15min":0.749},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92500000000000004,"5min":0.94699999999999995,"15min":1.077},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70999999999999996,"15min":0.73599999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89600000000000002,"5min":0.96399999999999997,"15min":1.0469999999999999},"last":0.503}]},{"osd":2,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.51800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91000000000000003,"5min":0.96499999999999997,"15min":1.091},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.76900000000000002,"15min":0.77400000000000002},"min":{"1min":0.46400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98099999999999998,"5min":1.0649999999999999,"15min":1.387},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.72999999999999998,"15min":0.746},"min":{"1min":0.53200000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.94699999999999995,"5min":0.997,"15min":1.008},"last":0.622},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.75800000000000001,"15min":0.77100000000000002},"min":{"1min":0.504,"5min":0.496,"15min":0.46800000000000003},"max":{"1min":0.875,"5min":1.024,"15min":1.0589999999999999},"last":0.47499999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61899999999999999,"15min":0.60499999999999998},"min":{"1min":0.49299999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.85299999999999998,"5min":0.95599999999999996,"15min":1.0029999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63300000000000001,"15min":0.61799999999999999},"min":{"1min":0.45900000000000002,"5min":0.41399999999999998,"15min":0.34599999999999997},"max":{"1min":0.93200000000000005,"5min":0.93600000000000005,"15min":0.95199999999999996},"last":0.69299999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.32300000000000001},"max":{"1min":0.96999999999999997,"5min":1.014,"15min":1.014},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68300000000000005,"15min":0.66900000000000004},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.374},"max":{"1min":0.86899999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.71499999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68899999999999995,"15min":0.66900000000000004},"min":{"1min":0.503,"5min":0.46000000000000002,"15min":0.39000000000000001},"max":{"1min":0.89400000000000002,"5min":0.94699999999999995,"15min":1.0349999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70999999999999996,"15min":0.69499999999999995},"min":{"1min":0.42799999999999999,"5min":0.40300000000000002,"15min":0.36899999999999999},"max":{"1min":0.91800000000000004,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.44}]}]},{"osd":3,"up_from":13,"seq":55834575054,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36452,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335388,"statfs":{"total":96636764160,"available":96599437312,"internally_reserved":0,"allocated":1339392,"data_stored":673887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.26200000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.84199999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.498,"15min":0.51500000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.60799999999999998,"5min":0.77300000000000002,"15min":1.0209999999999999},"last":0.63200000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47199999999999998,"15min":0.47499999999999998},"min":{"1min":0.33100000000000002,"5min":0.315,"15min":0.29599999999999999},"max":{"1min":0.63900000000000001,"5min":0.77200000000000002,"15min":0.79600000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67800000000000005,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.59299999999999997}]},{"osd":2,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54100000000000004,"15min":0.56999999999999995},"min":{"1min":0.38200000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.72399999999999998,"5min":0.82599999999999996,"15min":0.95899999999999996},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60699999999999998,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86599999999999999,"5min":1.663,"15min":1.663},"last":0.67900000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.748,"15min":0.76500000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":0.90900000000000003,"5min":1.284,"15min":1.284},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76800000000000002,"15min":0.78900000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.47699999999999998},"max":{"1min":1.0660000000000001,"5min":1.121,"15min":1.196},"last":0.78500000000000003}]},{"osd":5,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.52400000000000002},"max":{"1min":1.0229999999999999,"5min":1.306,"15min":1.306},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77900000000000003,"15min":0.79100000000000004},"min":{"1min":0.58099999999999996,"5min":0.372,"15min":0.372},"max":{"1min":0.97399999999999998,"5min":1.1870000000000001,"15min":1.2470000000000001},"last":0.76800000000000002}]},{"osd":6,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.76800000000000002,"15min":0.78000000000000003},"min":{"1min":0.50600000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96599999999999997,"5min":1.105,"15min":1.117},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.79700000000000004,"15min":0.81799999999999995},"min":{"1min":0.56299999999999994,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.93999999999999995,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.873}]},{"osd":7,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.83299999999999996,"15min":0.84099999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53100000000000003},"max":{"1min":0.89900000000000002,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.53500000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0009999999999999,"5min":1.595,"15min":1.595},"last":0.89300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575054,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58592,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313248,"statfs":{"total":96636764160,"available":96576765952,"internally_reserved":0,"allocated":1335296,"data_stored":672868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45900000000000002,"15min":0.46800000000000003},"min":{"1min":0.29199999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.84699999999999998,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.54200000000000004,"15min":0.53300000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.70799999999999996,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.68600000000000005}]},{"osd":1,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.48299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30399999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65500000000000003,"5min":2.7200000000000002,"15min":2.7200000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.55000000000000004,"15min":0.56299999999999994},"min":{"1min":0.36299999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78300000000000003,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":0.54400000000000004}]},{"osd":3,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.64500000000000002,"15min":0.60399999999999998},"min":{"1min":0.39500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71699999999999997,"5min":8.2530000000000001,"15min":8.2530000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89600000000000002,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.57199999999999995}]},{"osd":4,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.754,"15min":0.78100000000000003},"min":{"1min":0.53200000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.99399999999999999,"5min":1.0940000000000001,"15min":1.1499999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.56699999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0629999999999999,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.85699999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.84399999999999997,"15min":0.85799999999999998},"min":{"1min":0.58599999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1319999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82499999999999996,"15min":0.83999999999999997},"min":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.433},"max":{"1min":1.153,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.76300000000000001}]},{"osd":6,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.78700000000000003,"15min":0.80400000000000005},"min":{"1min":0.57299999999999995,"5min":0.48999999999999999,"15min":0.47599999999999998},"max":{"1min":0.93999999999999995,"5min":3.9849999999999999,"15min":3.9849999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80200000000000005,"15min":0.81299999999999994},"min":{"1min":0.60699999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0289999999999999,"5min":3.391,"15min":3.391},"last":0.63400000000000001}]},{"osd":7,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.79600000000000004,"15min":0.82199999999999995},"min":{"1min":0.55000000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.1759999999999999,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.81499999999999995,"15min":0.82299999999999995},"min":{"1min":0.60199999999999998,"5min":0.53200000000000003,"15min":0.50900000000000001},"max":{"1min":1.0940000000000001,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.78600000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575055,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36440,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335400,"statfs":{"total":96636764160,"available":96599449600,"internally_reserved":0,"allocated":1327104,"data_stored":667259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.29199999999999998,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.53700000000000003,"5min":0.65400000000000003,"15min":0.77200000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.28199999999999997,"15min":0.26500000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.64100000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47199999999999998,"15min":0.47299999999999998},"min":{"1min":0.34300000000000003,"5min":0.32100000000000001,"15min":0.29499999999999998},"max":{"1min":0.54200000000000004,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65100000000000002,"5min":1.014,"15min":1.014},"last":0.68700000000000006}]},{"osd":3,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.621,"15min":0.63600000000000001},"min":{"1min":0.48199999999999998,"5min":0.44700000000000001,"15min":0.437},"max":{"1min":0.73899999999999999,"5min":0.80500000000000005,"15min":0.96299999999999997},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56499999999999995,"15min":0.57999999999999996},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.749}]},{"osd":4,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77700000000000002,"15min":0.78400000000000003},"min":{"1min":0.55500000000000005,"5min":0.51600000000000001,"15min":0.40000000000000002},"max":{"1min":1.0409999999999999,"5min":1.2110000000000001,"15min":1.236},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77200000000000002,"15min":0.78600000000000003},"min":{"1min":0.57499999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.0309999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.80800000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.60799999999999998,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.55800000000000005,"5min":0.48599999999999999,"15min":0.48199999999999998},"max":{"1min":1.0940000000000001,"5min":1.2749999999999999,"15min":1.3600000000000001},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.53800000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1.0580000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.80500000000000005,"15min":0.81399999999999995},"min":{"1min":0.56100000000000005,"5min":0.52200000000000002,"15min":0.49199999999999999},"max":{"1min":1.1319999999999999,"5min":1.262,"15min":1.2969999999999999},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.47799999999999998},"max":{"1min":1.1479999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.82099999999999995,"15min":0.84099999999999997},"min":{"1min":0.58499999999999996,"5min":0.53700000000000003,"15min":0.52800000000000002},"max":{"1min":1.2070000000000001,"5min":1.327,"15min":1.327},"last":0.77000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575056,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37016,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334824,"statfs":{"total":96636764160,"available":96598859776,"internally_reserved":0,"allocated":1916928,"data_stored":1256608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.45600000000000002,"15min":0.44700000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.61199999999999999,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.49099999999999999,"15min":0.51500000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.27700000000000002},"max":{"1min":0.61799999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.38700000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.51900000000000002,"15min":0.51100000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69699999999999995,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.502,"5min":0.54000000000000004,"15min":0.55300000000000005},"min":{"1min":0.39800000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63800000000000001,"5min":0.80300000000000005,"15min":0.90300000000000002},"last":0.436}]},{"osd":3,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.504},"min":{"1min":0.36399999999999999,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.67600000000000005,"5min":0.72999999999999998,"15min":0.84999999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82899999999999996,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.49399999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76900000000000002,"15min":0.78800000000000003},"min":{"1min":0.56100000000000005,"5min":0.48399999999999999,"15min":0.44400000000000001},"max":{"1min":0.90500000000000003,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.53500000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.038,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.72699999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.77100000000000002,"15min":0.80600000000000005},"min":{"1min":0.55100000000000005,"5min":0.51800000000000002,"15min":0.47899999999999998},"max":{"1min":0.80500000000000005,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.56399999999999995,"5min":0.49299999999999999,"15min":0.47299999999999998},"max":{"1min":0.97299999999999998,"5min":1.325,"15min":1.325},"last":0.60699999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.79100000000000004,"15min":0.80600000000000005},"min":{"1min":0.53500000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91400000000000003,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78900000000000003,"15min":0.81499999999999995},"min":{"1min":0.58399999999999996,"5min":0.55500000000000005,"15min":0.41299999999999998},"max":{"1min":1.0900000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.628}]},{"osd":7,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.79800000000000004,"15min":0.83199999999999996},"min":{"1min":0.57699999999999996,"5min":0.503,"15min":0.45500000000000002},"max":{"1min":0.93799999999999994,"5min":1.171,"15min":1.2749999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.77100000000000002,"15min":0.81100000000000005},"min":{"1min":0.50600000000000001,"5min":0.502,"15min":0.497},"max":{"1min":0.95199999999999996,"5min":1.381,"15min":1.381},"last":0.69999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:09:53.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3f is not active+clean 2023-07-14T13:09:53.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.760362+0000', 'last_change': '2023-07-14T13:09:47.760362+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.760362+0000', 'last_undegraded': '2023-07-14T13:09:47.760362+0000', 'last_fullsized': '2023-07-14T13:09:47.760362+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:09:53.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3e is not active+clean 2023-07-14T13:09:53.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.761883+0000', 'last_change': '2023-07-14T13:09:47.761883+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.761883+0000', 'last_undegraded': '2023-07-14T13:09:47.761883+0000', 'last_fullsized': '2023-07-14T13:09:47.761883+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:09:53.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3d is not active+clean 2023-07-14T13:09:53.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.758963+0000', 'last_change': '2023-07-14T13:09:47.758963+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.758963+0000', 'last_undegraded': '2023-07-14T13:09:47.758963+0000', 'last_fullsized': '2023-07-14T13:09:47.758963+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:09:53.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3c is not active+clean 2023-07-14T13:09:53.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.765351+0000', 'last_change': '2023-07-14T13:09:47.765351+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.765351+0000', 'last_undegraded': '2023-07-14T13:09:47.765351+0000', 'last_fullsized': '2023-07-14T13:09:47.765351+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:09:53.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3b is not active+clean 2023-07-14T13:09:53.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.757609+0000', 'last_change': '2023-07-14T13:09:47.757609+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.757609+0000', 'last_undegraded': '2023-07-14T13:09:47.757609+0000', 'last_fullsized': '2023-07-14T13:09:47.757609+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:09:53.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3a is not active+clean 2023-07-14T13:09:53.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.760520+0000', 'last_change': '2023-07-14T13:09:47.760520+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.760520+0000', 'last_undegraded': '2023-07-14T13:09:47.760520+0000', 'last_fullsized': '2023-07-14T13:09:47.760520+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:09:53.695 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.39 is not active+clean 2023-07-14T13:09:53.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.766444+0000', 'last_change': '2023-07-14T13:09:47.766444+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.766444+0000', 'last_undegraded': '2023-07-14T13:09:47.766444+0000', 'last_fullsized': '2023-07-14T13:09:47.766444+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:09:53.695 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.38 is not active+clean 2023-07-14T13:09:53.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.760971+0000', 'last_change': '2023-07-14T13:09:47.760971+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.760971+0000', 'last_undegraded': '2023-07-14T13:09:47.760971+0000', 'last_fullsized': '2023-07-14T13:09:47.760971+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:09:53.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.37 is not active+clean 2023-07-14T13:09:53.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.757646+0000', 'last_change': '2023-07-14T13:09:47.757646+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.757646+0000', 'last_undegraded': '2023-07-14T13:09:47.757646+0000', 'last_fullsized': '2023-07-14T13:09:47.757646+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:09:53.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.36 is not active+clean 2023-07-14T13:09:53.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.756810+0000', 'last_change': '2023-07-14T13:09:47.756810+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.756810+0000', 'last_undegraded': '2023-07-14T13:09:47.756810+0000', 'last_fullsized': '2023-07-14T13:09:47.756810+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:09:53.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.35 is not active+clean 2023-07-14T13:09:53.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.760610+0000', 'last_change': '2023-07-14T13:09:47.760610+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.760610+0000', 'last_undegraded': '2023-07-14T13:09:47.760610+0000', 'last_fullsized': '2023-07-14T13:09:47.760610+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:09:53.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.34 is not active+clean 2023-07-14T13:09:53.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.757359+0000', 'last_change': '2023-07-14T13:09:47.757359+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.757359+0000', 'last_undegraded': '2023-07-14T13:09:47.757359+0000', 'last_fullsized': '2023-07-14T13:09:47.757359+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:09:53.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.33 is not active+clean 2023-07-14T13:09:53.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.763361+0000', 'last_change': '2023-07-14T13:09:47.763361+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.763361+0000', 'last_undegraded': '2023-07-14T13:09:47.763361+0000', 'last_fullsized': '2023-07-14T13:09:47.763361+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:09:53.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.32 is not active+clean 2023-07-14T13:09:53.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.759068+0000', 'last_change': '2023-07-14T13:09:47.759068+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.759068+0000', 'last_undegraded': '2023-07-14T13:09:47.759068+0000', 'last_fullsized': '2023-07-14T13:09:47.759068+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:09:53.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.31 is not active+clean 2023-07-14T13:09:53.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.761532+0000', 'last_change': '2023-07-14T13:09:47.761532+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.761532+0000', 'last_undegraded': '2023-07-14T13:09:47.761532+0000', 'last_fullsized': '2023-07-14T13:09:47.761532+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:09:53.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.30 is not active+clean 2023-07-14T13:09:53.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.758671+0000', 'last_change': '2023-07-14T13:09:47.758671+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.758671+0000', 'last_undegraded': '2023-07-14T13:09:47.758671+0000', 'last_fullsized': '2023-07-14T13:09:47.758671+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:09:53.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2f is not active+clean 2023-07-14T13:09:53.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.766998+0000', 'last_change': '2023-07-14T13:09:47.766998+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.766998+0000', 'last_undegraded': '2023-07-14T13:09:47.766998+0000', 'last_fullsized': '2023-07-14T13:09:47.766998+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:09:53.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2e is not active+clean 2023-07-14T13:09:53.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.759550+0000', 'last_change': '2023-07-14T13:09:47.759550+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.759550+0000', 'last_undegraded': '2023-07-14T13:09:47.759550+0000', 'last_fullsized': '2023-07-14T13:09:47.759550+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:09:53.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2d is not active+clean 2023-07-14T13:09:53.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.759435+0000', 'last_change': '2023-07-14T13:09:47.759435+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.759435+0000', 'last_undegraded': '2023-07-14T13:09:47.759435+0000', 'last_fullsized': '2023-07-14T13:09:47.759435+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:09:53.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2c is not active+clean 2023-07-14T13:09:53.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.764876+0000', 'last_change': '2023-07-14T13:09:47.764876+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.764876+0000', 'last_undegraded': '2023-07-14T13:09:47.764876+0000', 'last_fullsized': '2023-07-14T13:09:47.764876+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:09:53.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2b is not active+clean 2023-07-14T13:09:53.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.758657+0000', 'last_change': '2023-07-14T13:09:47.758657+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.758657+0000', 'last_undegraded': '2023-07-14T13:09:47.758657+0000', 'last_fullsized': '2023-07-14T13:09:47.758657+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:09:53.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2a is not active+clean 2023-07-14T13:09:53.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.758502+0000', 'last_change': '2023-07-14T13:09:47.758502+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.758502+0000', 'last_undegraded': '2023-07-14T13:09:47.758502+0000', 'last_fullsized': '2023-07-14T13:09:47.758502+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:09:53.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.29 is not active+clean 2023-07-14T13:09:53.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.764133+0000', 'last_change': '2023-07-14T13:09:47.764133+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.764133+0000', 'last_undegraded': '2023-07-14T13:09:47.764133+0000', 'last_fullsized': '2023-07-14T13:09:47.764133+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:09:53.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.28 is not active+clean 2023-07-14T13:09:53.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.758368+0000', 'last_change': '2023-07-14T13:09:47.758368+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.758368+0000', 'last_undegraded': '2023-07-14T13:09:47.758368+0000', 'last_fullsized': '2023-07-14T13:09:47.758368+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:09:53.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.27 is not active+clean 2023-07-14T13:09:53.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.763754+0000', 'last_change': '2023-07-14T13:09:47.763754+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.763754+0000', 'last_undegraded': '2023-07-14T13:09:47.763754+0000', 'last_fullsized': '2023-07-14T13:09:47.763754+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:09:53.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.26 is not active+clean 2023-07-14T13:09:53.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.759447+0000', 'last_change': '2023-07-14T13:09:47.759447+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.759447+0000', 'last_undegraded': '2023-07-14T13:09:47.759447+0000', 'last_fullsized': '2023-07-14T13:09:47.759447+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:09:53.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.25 is not active+clean 2023-07-14T13:09:53.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.756813+0000', 'last_change': '2023-07-14T13:09:47.756813+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.756813+0000', 'last_undegraded': '2023-07-14T13:09:47.756813+0000', 'last_fullsized': '2023-07-14T13:09:47.756813+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:09:53.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.24 is not active+clean 2023-07-14T13:09:53.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.764398+0000', 'last_change': '2023-07-14T13:09:47.764398+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.764398+0000', 'last_undegraded': '2023-07-14T13:09:47.764398+0000', 'last_fullsized': '2023-07-14T13:09:47.764398+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:09:53.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.23 is not active+clean 2023-07-14T13:09:53.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.766056+0000', 'last_change': '2023-07-14T13:09:47.766056+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.766056+0000', 'last_undegraded': '2023-07-14T13:09:47.766056+0000', 'last_fullsized': '2023-07-14T13:09:47.766056+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:09:53.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.22 is not active+clean 2023-07-14T13:09:53.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.757615+0000', 'last_change': '2023-07-14T13:09:47.757615+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.757615+0000', 'last_undegraded': '2023-07-14T13:09:47.757615+0000', 'last_fullsized': '2023-07-14T13:09:47.757615+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:09:53.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.21 is not active+clean 2023-07-14T13:09:53.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.763270+0000', 'last_change': '2023-07-14T13:09:47.763270+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.763270+0000', 'last_undegraded': '2023-07-14T13:09:47.763270+0000', 'last_fullsized': '2023-07-14T13:09:47.763270+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:09:53.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.20 is not active+clean 2023-07-14T13:09:53.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.758145+0000', 'last_change': '2023-07-14T13:09:47.758145+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.758145+0000', 'last_undegraded': '2023-07-14T13:09:47.758145+0000', 'last_fullsized': '2023-07-14T13:09:47.758145+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:09:53.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1c is not active+clean 2023-07-14T13:09:53.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.764225+0000', 'last_change': '2023-07-14T13:09:47.764225+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.764225+0000', 'last_undegraded': '2023-07-14T13:09:47.764225+0000', 'last_fullsized': '2023-07-14T13:09:47.764225+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:09:53.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1d is not active+clean 2023-07-14T13:09:53.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.766159+0000', 'last_change': '2023-07-14T13:09:47.766159+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.766159+0000', 'last_undegraded': '2023-07-14T13:09:47.766159+0000', 'last_fullsized': '2023-07-14T13:09:47.766159+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:09:53.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1e is not active+clean 2023-07-14T13:09:53.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.765253+0000', 'last_change': '2023-07-14T13:09:47.765253+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.765253+0000', 'last_undegraded': '2023-07-14T13:09:47.765253+0000', 'last_fullsized': '2023-07-14T13:09:47.765253+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:09:53.719 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1f is not active+clean 2023-07-14T13:09:53.719 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.763615+0000', 'last_change': '2023-07-14T13:09:47.763615+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.763615+0000', 'last_undegraded': '2023-07-14T13:09:47.763615+0000', 'last_fullsized': '2023-07-14T13:09:47.763615+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:09:53.719 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.18 is not active+clean 2023-07-14T13:09:53.720 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.760522+0000', 'last_change': '2023-07-14T13:09:47.760522+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.760522+0000', 'last_undegraded': '2023-07-14T13:09:47.760522+0000', 'last_fullsized': '2023-07-14T13:09:47.760522+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:09:53.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.19 is not active+clean 2023-07-14T13:09:53.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.763562+0000', 'last_change': '2023-07-14T13:09:47.763562+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.763562+0000', 'last_undegraded': '2023-07-14T13:09:47.763562+0000', 'last_fullsized': '2023-07-14T13:09:47.763562+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:09:53.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1a is not active+clean 2023-07-14T13:09:53.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.760000+0000', 'last_change': '2023-07-14T13:09:47.760000+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.760000+0000', 'last_undegraded': '2023-07-14T13:09:47.760000+0000', 'last_fullsized': '2023-07-14T13:09:47.760000+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:09:53.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1b is not active+clean 2023-07-14T13:09:53.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.762803+0000', 'last_change': '2023-07-14T13:09:47.762803+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.762803+0000', 'last_undegraded': '2023-07-14T13:09:47.762803+0000', 'last_fullsized': '2023-07-14T13:09:47.762803+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:09:53.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.14 is not active+clean 2023-07-14T13:09:53.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.758264+0000', 'last_change': '2023-07-14T13:09:47.758264+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.758264+0000', 'last_undegraded': '2023-07-14T13:09:47.758264+0000', 'last_fullsized': '2023-07-14T13:09:47.758264+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:09:53.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.15 is not active+clean 2023-07-14T13:09:53.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.764174+0000', 'last_change': '2023-07-14T13:09:47.764174+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.764174+0000', 'last_undegraded': '2023-07-14T13:09:47.764174+0000', 'last_fullsized': '2023-07-14T13:09:47.764174+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:09:53.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.16 is not active+clean 2023-07-14T13:09:53.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.759053+0000', 'last_change': '2023-07-14T13:09:47.759053+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.759053+0000', 'last_undegraded': '2023-07-14T13:09:47.759053+0000', 'last_fullsized': '2023-07-14T13:09:47.759053+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:09:53.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.17 is not active+clean 2023-07-14T13:09:53.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.763483+0000', 'last_change': '2023-07-14T13:09:47.763483+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.763483+0000', 'last_undegraded': '2023-07-14T13:09:47.763483+0000', 'last_fullsized': '2023-07-14T13:09:47.763483+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:09:53.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.10 is not active+clean 2023-07-14T13:09:53.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.759977+0000', 'last_change': '2023-07-14T13:09:47.759977+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.759977+0000', 'last_undegraded': '2023-07-14T13:09:47.759977+0000', 'last_fullsized': '2023-07-14T13:09:47.759977+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:09:53.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.11 is not active+clean 2023-07-14T13:09:53.726 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.757732+0000', 'last_change': '2023-07-14T13:09:47.757732+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.757732+0000', 'last_undegraded': '2023-07-14T13:09:47.757732+0000', 'last_fullsized': '2023-07-14T13:09:47.757732+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:09:53.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.12 is not active+clean 2023-07-14T13:09:53.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.757164+0000', 'last_change': '2023-07-14T13:09:47.757164+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.757164+0000', 'last_undegraded': '2023-07-14T13:09:47.757164+0000', 'last_fullsized': '2023-07-14T13:09:47.757164+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:09:53.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.13 is not active+clean 2023-07-14T13:09:53.728 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.756514+0000', 'last_change': '2023-07-14T13:09:47.756514+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.756514+0000', 'last_undegraded': '2023-07-14T13:09:47.756514+0000', 'last_fullsized': '2023-07-14T13:09:47.756514+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:09:53.728 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.4 is not active+clean 2023-07-14T13:09:53.728 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.763524+0000', 'last_change': '2023-07-14T13:09:47.763524+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.763524+0000', 'last_undegraded': '2023-07-14T13:09:47.763524+0000', 'last_fullsized': '2023-07-14T13:09:47.763524+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:09:53.729 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.5 is not active+clean 2023-07-14T13:09:53.729 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.765744+0000', 'last_change': '2023-07-14T13:09:47.765744+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.765744+0000', 'last_undegraded': '2023-07-14T13:09:47.765744+0000', 'last_fullsized': '2023-07-14T13:09:47.765744+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:09:53.729 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.6 is not active+clean 2023-07-14T13:09:53.730 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.759994+0000', 'last_change': '2023-07-14T13:09:47.759994+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.759994+0000', 'last_undegraded': '2023-07-14T13:09:47.759994+0000', 'last_fullsized': '2023-07-14T13:09:47.759994+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:09:53.730 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.7 is not active+clean 2023-07-14T13:09:53.730 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.762259+0000', 'last_change': '2023-07-14T13:09:47.762259+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.762259+0000', 'last_undegraded': '2023-07-14T13:09:47.762259+0000', 'last_fullsized': '2023-07-14T13:09:47.762259+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:09:53.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.0 is not active+clean 2023-07-14T13:09:53.731 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.756482+0000', 'last_change': '2023-07-14T13:09:47.756482+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.756482+0000', 'last_undegraded': '2023-07-14T13:09:47.756482+0000', 'last_fullsized': '2023-07-14T13:09:47.756482+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:09:53.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1 is not active+clean 2023-07-14T13:09:53.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.757684+0000', 'last_change': '2023-07-14T13:09:47.757684+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.757684+0000', 'last_undegraded': '2023-07-14T13:09:47.757684+0000', 'last_fullsized': '2023-07-14T13:09:47.757684+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:09:53.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2 is not active+clean 2023-07-14T13:09:53.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.762566+0000', 'last_change': '2023-07-14T13:09:47.762566+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.762566+0000', 'last_undegraded': '2023-07-14T13:09:47.762566+0000', 'last_fullsized': '2023-07-14T13:09:47.762566+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:09:53.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3 is not active+clean 2023-07-14T13:09:53.733 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.759799+0000', 'last_change': '2023-07-14T13:09:47.759799+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.759799+0000', 'last_undegraded': '2023-07-14T13:09:47.759799+0000', 'last_fullsized': '2023-07-14T13:09:47.759799+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:09:53.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.f is not active+clean 2023-07-14T13:09:53.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.768345+0000', 'last_change': '2023-07-14T13:09:47.768345+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.768345+0000', 'last_undegraded': '2023-07-14T13:09:47.768345+0000', 'last_fullsized': '2023-07-14T13:09:47.768345+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:09:53.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.c is not active+clean 2023-07-14T13:09:53.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.763399+0000', 'last_change': '2023-07-14T13:09:47.763399+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.763399+0000', 'last_undegraded': '2023-07-14T13:09:47.763399+0000', 'last_fullsized': '2023-07-14T13:09:47.763399+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:09:53.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.d is not active+clean 2023-07-14T13:09:53.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.763905+0000', 'last_change': '2023-07-14T13:09:47.763905+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.763905+0000', 'last_undegraded': '2023-07-14T13:09:47.763905+0000', 'last_fullsized': '2023-07-14T13:09:47.763905+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:09:53.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.e is not active+clean 2023-07-14T13:09:53.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.758830+0000', 'last_change': '2023-07-14T13:09:47.758830+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.758830+0000', 'last_undegraded': '2023-07-14T13:09:47.758830+0000', 'last_fullsized': '2023-07-14T13:09:47.758830+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:09:53.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.8 is not active+clean 2023-07-14T13:09:53.737 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.757587+0000', 'last_change': '2023-07-14T13:09:47.757587+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.757587+0000', 'last_undegraded': '2023-07-14T13:09:47.757587+0000', 'last_fullsized': '2023-07-14T13:09:47.757587+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:09:53.737 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.9 is not active+clean 2023-07-14T13:09:53.737 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.762762+0000', 'last_change': '2023-07-14T13:09:47.762762+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.762762+0000', 'last_undegraded': '2023-07-14T13:09:47.762762+0000', 'last_fullsized': '2023-07-14T13:09:47.762762+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:09:53.738 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.a is not active+clean 2023-07-14T13:09:53.738 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.761769+0000', 'last_change': '2023-07-14T13:09:47.761769+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.761769+0000', 'last_undegraded': '2023-07-14T13:09:47.761769+0000', 'last_fullsized': '2023-07-14T13:09:47.761769+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:09:53.739 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.b is not active+clean 2023-07-14T13:09:53.739 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 109, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:09:47.760318+0000', 'last_change': '2023-07-14T13:09:47.760318+0000', 'last_active': '2023-07-14T13:09:47.748039+0000', 'last_peered': '2023-07-14T13:09:47.748039+0000', 'last_clean': '2023-07-14T13:09:47.748039+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:09:47.760318+0000', 'last_undegraded': '2023-07-14T13:09:47.760318+0000', 'last_fullsized': '2023-07-14T13:09:47.760318+0000', 'mapping_epoch': 109, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 109, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'last_clean_scrub_stamp': '2023-07-14T13:09:47.748039+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:09:53.740 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-14T13:09:53.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.850+0000 7fb0258d8640 1 Processor -- start 2023-07-14T13:09:53.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.850+0000 7fb0258d8640 1 -- start start 2023-07-14T13:09:53.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb0258d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0200c9730 0x7fb0201638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:53.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb0258d8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0200cc700 con 0x7fb0200c8ad0 2023-07-14T13:09:53.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb0258d8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0200b0ff0 con 0x7fb020158ce0 2023-07-14T13:09:53.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb0258d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb020070c80 con 0x7fb0200c9730 2023-07-14T13:09:53.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb017fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb0200c8ad0 0x7fb0200c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56712/0 (socket says 172.21.15.5:56712) 2023-07-14T13:09:53.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb017fff640 1 -- 172.21.15.5:0/2000005915 learned_addr learned my addr 172.21.15.5:0/2000005915 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:53.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb01f7fe640 1 --2- 172.21.15.5:0/2000005915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0200c9730 0x7fb0201638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:53.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb01e7fc640 1 -- 172.21.15.5:0/2000005915 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2453550829 0 0) 0x7fb0200cc700 con 0x7fb0200c8ad0 2023-07-14T13:09:53.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb01e7fc640 1 -- 172.21.15.5:0/2000005915 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb00c003530 con 0x7fb0200c8ad0 2023-07-14T13:09:53.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb01e7fc640 1 -- 172.21.15.5:0/2000005915 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534989741 0 0) 0x7fb0200b0ff0 con 0x7fb020158ce0 2023-07-14T13:09:53.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb01e7fc640 1 -- 172.21.15.5:0/2000005915 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0200cc700 con 0x7fb020158ce0 2023-07-14T13:09:53.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb01e7fc640 1 -- 172.21.15.5:0/2000005915 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3327790071 0 0) 0x7fb00c003530 con 0x7fb0200c8ad0 2023-07-14T13:09:53.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb01e7fc640 1 -- 172.21.15.5:0/2000005915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0200c9730 msgr2=0x7fb0201638b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:53.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb01e7fc640 1 --2- 172.21.15.5:0/2000005915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0200c9730 0x7fb0201638b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:53.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb01e7fc640 1 -- 172.21.15.5:0/2000005915 >> v1:172.21.15.154:6789/0 conn(0x7fb020158ce0 legacy=0x7fb020070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:53.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb01e7fc640 1 -- 172.21.15.5:0/2000005915 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0200cbdd0 con 0x7fb0200c8ad0 2023-07-14T13:09:53.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb01e7fc640 1 -- 172.21.15.5:0/2000005915 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7fb008001680 con 0x7fb0200c8ad0 2023-07-14T13:09:53.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb01e7fc640 1 -- 172.21.15.5:0/2000005915 >> v1:172.21.15.5:6789/0 conn(0x7fb0200c8ad0 legacy=0x7fb0200c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:53.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb01e7fc640 1 --2- 172.21.15.5:0/2000005915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0200c9730 0x7fb00c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:53.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb01e7fc640 1 --2- 172.21.15.5:0/2000005915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb00c0040a0 0x7fb00c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:53.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb01e7fc640 1 --2- 172.21.15.5:0/2000005915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb00c004d10 0x7fb00c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:53.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb01e7fc640 1 -- 172.21.15.5:0/2000005915 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb020070c80 con 0x7fb00c004d10 2023-07-14T13:09:53.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb01e7fc640 1 -- 172.21.15.5:0/2000005915 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c00dd90 con 0x7fb00c0040a0 2023-07-14T13:09:53.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb01e7fc640 1 -- 172.21.15.5:0/2000005915 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c00df50 con 0x7fb0200c9730 2023-07-14T13:09:53.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb01f7fe640 1 --2- 172.21.15.5:0/2000005915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb00c004d10 0x7fb00c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:53.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb017fff640 1 --2- 172.21.15.5:0/2000005915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb00c0040a0 0x7fb00c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:53.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb01effd640 1 --2- 172.21.15.5:0/2000005915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0200c9730 0x7fb00c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:53.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb01f7fe640 1 -- 172.21.15.5:0/2000005915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0200c9730 msgr2=0x7fb00c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:53.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb01f7fe640 1 --2- 172.21.15.5:0/2000005915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0200c9730 0x7fb00c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:53.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb01f7fe640 1 -- 172.21.15.5:0/2000005915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb00c0040a0 msgr2=0x7fb00c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:53.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb01f7fe640 1 --2- 172.21.15.5:0/2000005915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb00c0040a0 0x7fb00c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:53.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb01f7fe640 1 -- 172.21.15.5:0/2000005915 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00c003530 con 0x7fb00c004d10 2023-07-14T13:09:53.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.854+0000 7fb01effd640 1 --2- 172.21.15.5:0/2000005915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0200c9730 0x7fb00c003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:53.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.858+0000 7fb01f7fe640 1 --2- 172.21.15.5:0/2000005915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb00c004d10 0x7fb00c005180 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fb02006a410 tx=0x7fb01801cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5372caf1dd33ea8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:53.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.858+0000 7fb01e7fc640 1 -- 172.21.15.5:0/2000005915 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0180a5990 con 0x7fb00c004d10 2023-07-14T13:09:53.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.858+0000 7fb01e7fc640 1 -- 172.21.15.5:0/2000005915 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01800f040 con 0x7fb00c004d10 2023-07-14T13:09:53.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.858+0000 7fb01e7fc640 1 -- 172.21.15.5:0/2000005915 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0180a5d30 con 0x7fb00c004d10 2023-07-14T13:09:53.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.858+0000 7fb0258d8640 1 -- 172.21.15.5:0/2000005915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb00c004d10 msgr2=0x7fb00c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:53.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.858+0000 7fb0258d8640 1 --2- 172.21.15.5:0/2000005915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb00c004d10 0x7fb00c005180 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fb02006a410 tx=0x7fb01801cb90 comp rx=0 tx=0).stop 2023-07-14T13:09:53.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.858+0000 7fb01f7fe640 1 -- 172.21.15.5:0/2000005915 reap_dead start 2023-07-14T13:09:53.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.858+0000 7fb0258d8640 1 -- 172.21.15.5:0/2000005915 shutdown_connections 2023-07-14T13:09:53.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.858+0000 7fb0258d8640 1 -- 172.21.15.5:0/2000005915 >> 172.21.15.5:0/2000005915 conn(0x7fb0200afcf0 msgr2=0x7fb0200b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:53.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.858+0000 7fb0258d8640 1 -- 172.21.15.5:0/2000005915 shutdown_connections 2023-07-14T13:09:53.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.858+0000 7fb0258d8640 1 -- 172.21.15.5:0/2000005915 wait complete. 2023-07-14T13:09:53.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.862+0000 7fb0258d8640 1 Processor -- start 2023-07-14T13:09:53.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.862+0000 7fb0258d8640 1 -- start start 2023-07-14T13:09:53.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.862+0000 7fb0258d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb00c004d10 0x7fb0200c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:53.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.862+0000 7fb0258d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0200c8080 0x7fb020149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:53.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.862+0000 7fb0258d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb020147ee0 0x7fb020148360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:53.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.862+0000 7fb0258d8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0200c5de0 con 0x7fb0200c8080 2023-07-14T13:09:53.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.862+0000 7fb0258d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0200c5230 con 0x7fb020147ee0 2023-07-14T13:09:53.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.862+0000 7fb0258d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0200c5440 con 0x7fb00c004d10 2023-07-14T13:09:53.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.862+0000 7fb017fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0200c8080 0x7fb020149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:53.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.862+0000 7fb017fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0200c8080 0x7fb020149310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35034/0 (socket says 172.21.15.5:35034) 2023-07-14T13:09:53.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.862+0000 7fb017fff640 1 -- 172.21.15.5:0/3034774669 learned_addr learned my addr 172.21.15.5:0/3034774669 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:53.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.862+0000 7fb01effd640 1 --2- 172.21.15.5:0/3034774669 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb00c004d10 0x7fb0200c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:53.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.862+0000 7fb01f7fe640 1 --2- 172.21.15.5:0/3034774669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb020147ee0 0x7fb020148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:53.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.862+0000 7fb017fff640 1 -- 172.21.15.5:0/3034774669 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb00c004d10 msgr2=0x7fb0200c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:53.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.862+0000 7fb017fff640 1 --2- 172.21.15.5:0/3034774669 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb00c004d10 0x7fb0200c6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:53.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.862+0000 7fb017fff640 1 -- 172.21.15.5:0/3034774669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb020147ee0 msgr2=0x7fb020148360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:53.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.862+0000 7fb017fff640 1 --2- 172.21.15.5:0/3034774669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb020147ee0 0x7fb020148360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:53.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.862+0000 7fb017fff640 1 -- 172.21.15.5:0/3034774669 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0200c5720 con 0x7fb0200c8080 2023-07-14T13:09:53.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.862+0000 7fb017fff640 1 --2- 172.21.15.5:0/3034774669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0200c8080 0x7fb020149310 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fb008007310 tx=0x7fb008007710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:53.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.862+0000 7fb01cff9640 1 -- 172.21.15.5:0/3034774669 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0080015e0 con 0x7fb0200c8080 2023-07-14T13:09:53.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.862+0000 7fb01cff9640 1 -- 172.21.15.5:0/3034774669 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00800f9c0 con 0x7fb0200c8080 2023-07-14T13:09:53.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.862+0000 7fb01cff9640 1 -- 172.21.15.5:0/3034774669 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00800fd70 con 0x7fb0200c8080 2023-07-14T13:09:53.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.862+0000 7fb0258d8640 1 -- 172.21.15.5:0/3034774669 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0200c5a00 con 0x7fb0200c8080 2023-07-14T13:09:53.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.862+0000 7fb0258d8640 1 -- 172.21.15.5:0/3034774669 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb020149a20 con 0x7fb0200c8080 2023-07-14T13:09:53.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.862+0000 7fb0258d8640 1 -- 172.21.15.5:0/3034774669 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0200ca960 con 0x7fb0200c8080 2023-07-14T13:09:53.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.866+0000 7fb01cff9640 1 -- 172.21.15.5:0/3034774669 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb00801d460 con 0x7fb0200c8080 2023-07-14T13:09:53.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.866+0000 7fb01cff9640 1 --2- 172.21.15.5:0/3034774669 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fb000066370 0x7fb000068820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:53.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.866+0000 7fb01cff9640 1 -- 172.21.15.5:0/3034774669 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb008083e00 con 0x7fb0200c8080 2023-07-14T13:09:53.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.866+0000 7fb01effd640 1 --2- 172.21.15.5:0/3034774669 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fb000066370 0x7fb000068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:53.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.866+0000 7fb01effd640 1 --2- 172.21.15.5:0/3034774669 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fb000066370 0x7fb000068820 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb0200b11a0 tx=0x7fb010009040 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:53.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:53.870+0000 7fb01cff9640 1 -- 172.21.15.5:0/3034774669 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb008051160 con 0x7fb0200c8080 2023-07-14T13:09:54.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.078+0000 7fb0258d8640 1 -- 172.21.15.5:0/3034774669 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb0200c5f20 con 0x7fb0200c8080 2023-07-14T13:09:54.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.078+0000 7fb01cff9640 1 -- 172.21.15.5:0/3034774669 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3232 (secure 0 0 0) 0x7fb0200c5f20 con 0x7fb0200c8080 2023-07-14T13:09:54.110 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:54.111 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1053,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":111,"num_osds":8,"num_up_osds":8,"osd_up_since":1689339152,"num_in_osds":8,"osd_in_since":1689339143,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":346787840,"bytes_avail":772747325440,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":49,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":7668}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2023-07-14T13:09:36.062470+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-14T13:09:54.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.078+0000 7fb0258d8640 1 -- 172.21.15.5:0/3034774669 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fb000066370 msgr2=0x7fb000068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:54.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.078+0000 7fb0258d8640 1 --2- 172.21.15.5:0/3034774669 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fb000066370 0x7fb000068820 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb0200b11a0 tx=0x7fb010009040 comp rx=0 tx=0).stop 2023-07-14T13:09:54.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.078+0000 7fb0258d8640 1 -- 172.21.15.5:0/3034774669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0200c8080 msgr2=0x7fb020149310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:54.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.078+0000 7fb0258d8640 1 --2- 172.21.15.5:0/3034774669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0200c8080 0x7fb020149310 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fb008007310 tx=0x7fb008007710 comp rx=0 tx=0).stop 2023-07-14T13:09:54.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.078+0000 7fb0258d8640 1 -- 172.21.15.5:0/3034774669 shutdown_connections 2023-07-14T13:09:54.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.078+0000 7fb0258d8640 1 --2- 172.21.15.5:0/3034774669 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fb000066370 0x7fb000068820 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:54.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.078+0000 7fb0258d8640 1 --2- 172.21.15.5:0/3034774669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb020147ee0 0x7fb020148360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:54.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.078+0000 7fb0258d8640 1 --2- 172.21.15.5:0/3034774669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0200c8080 0x7fb020149310 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:54.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.078+0000 7fb0258d8640 1 --2- 172.21.15.5:0/3034774669 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb00c004d10 0x7fb0200c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:54.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.078+0000 7fb0258d8640 1 -- 172.21.15.5:0/3034774669 >> 172.21.15.5:0/3034774669 conn(0x7fb0200afcf0 msgr2=0x7fb0200b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:54.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.078+0000 7fb0258d8640 1 -- 172.21.15.5:0/3034774669 shutdown_connections 2023-07-14T13:09:54.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.082+0000 7fb0258d8640 1 -- 172.21.15.5:0/3034774669 wait complete. 2023-07-14T13:09:54.132 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-14T13:09:54.132 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:09:54.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.242+0000 7f4233648640 1 Processor -- start 2023-07-14T13:09:54.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.242+0000 7f4233648640 1 -- start start 2023-07-14T13:09:54.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.246+0000 7f4233648640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f422c06c430 0x7f422c0b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:54.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.246+0000 7f4233648640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f422c06e160 0x7f422c069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:54.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.246+0000 7f4233648640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f422c0b24f0 con 0x7f422c0ae1f0 2023-07-14T13:09:54.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.246+0000 7f4233648640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f422c0b27d0 con 0x7f422c06e160 2023-07-14T13:09:54.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.246+0000 7f4233648640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422c0b2ab0 con 0x7f422c06c430 2023-07-14T13:09:54.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.246+0000 7f4231be5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f422c06e160 0x7f422c069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:54.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.246+0000 7f4231be5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f422c06e160 0x7f422c069430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35042/0 (socket says 172.21.15.5:35042) 2023-07-14T13:09:54.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.246+0000 7f4231be5640 1 -- 172.21.15.5:0/2167250684 learned_addr learned my addr 172.21.15.5:0/2167250684 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:54.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.246+0000 7f4230be3640 1 --2- 172.21.15.5:0/2167250684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f422c06c430 0x7f422c0b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:54.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.246+0000 7f4231be5640 1 -- 172.21.15.5:0/2167250684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f422c06c430 msgr2=0x7f422c0b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:54.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.246+0000 7f4231be5640 1 --2- 172.21.15.5:0/2167250684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f422c06c430 0x7f422c0b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:54.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.246+0000 7f4231be5640 1 -- 172.21.15.5:0/2167250684 >> v1:172.21.15.154:6789/0 conn(0x7f422c0ae1f0 legacy=0x7f422c06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:54.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.246+0000 7f4231be5640 1 -- 172.21.15.5:0/2167250684 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c0b2d90 con 0x7f422c06e160 2023-07-14T13:09:54.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.246+0000 7f4230be3640 1 --2- 172.21.15.5:0/2167250684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f422c06c430 0x7f422c0b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:09:54.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.250+0000 7f4231be5640 1 --2- 172.21.15.5:0/2167250684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f422c06e160 0x7f422c069430 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f4224009e50 tx=0x7f422401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c4c5e2da27cb75 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:54.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.250+0000 7f4223fff640 1 -- 172.21.15.5:0/2167250684 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42240a57b0 con 0x7f422c06e160 2023-07-14T13:09:54.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.250+0000 7f4223fff640 1 -- 172.21.15.5:0/2167250684 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42240a5910 con 0x7f422c06e160 2023-07-14T13:09:54.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.250+0000 7f4223fff640 1 -- 172.21.15.5:0/2167250684 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42240a5ca0 con 0x7f422c06e160 2023-07-14T13:09:54.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.250+0000 7f4233648640 1 -- 172.21.15.5:0/2167250684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f422c06e160 msgr2=0x7f422c069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:54.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.250+0000 7f4233648640 1 --2- 172.21.15.5:0/2167250684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f422c06e160 0x7f422c069430 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f4224009e50 tx=0x7f422401c9a0 comp rx=0 tx=0).stop 2023-07-14T13:09:54.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.250+0000 7f4233648640 1 -- 172.21.15.5:0/2167250684 shutdown_connections 2023-07-14T13:09:54.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.250+0000 7f4233648640 1 --2- 172.21.15.5:0/2167250684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f422c06e160 0x7f422c069430 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:54.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.250+0000 7f4233648640 1 --2- 172.21.15.5:0/2167250684 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f422c06c430 0x7f422c0b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:54.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.250+0000 7f4233648640 1 -- 172.21.15.5:0/2167250684 >> 172.21.15.5:0/2167250684 conn(0x7f422c0b1300 msgr2=0x7f422c0ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:54.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.250+0000 7f4233648640 1 -- 172.21.15.5:0/2167250684 shutdown_connections 2023-07-14T13:09:54.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.250+0000 7f4233648640 1 -- 172.21.15.5:0/2167250684 wait complete. 2023-07-14T13:09:54.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.250+0000 7f4233648640 1 Processor -- start 2023-07-14T13:09:54.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.250+0000 7f4233648640 1 -- start start 2023-07-14T13:09:54.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.250+0000 7f4233648640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f422c06c430 0x7f422c13d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:54.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.250+0000 7f4233648640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f422c06e160 0x7f422c15c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:54.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.254+0000 7f4233648640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f422c0ae1f0 0x7f422c12dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:54.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.254+0000 7f4233648640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c13d720 con 0x7f422c06c430 2023-07-14T13:09:54.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.254+0000 7f4233648640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c15c5e0 con 0x7f422c0ae1f0 2023-07-14T13:09:54.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.254+0000 7f4233648640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422c13d980 con 0x7f422c06e160 2023-07-14T13:09:54.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.254+0000 7f42313e4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f422c06c430 0x7f422c13d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:54.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.254+0000 7f42313e4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f422c06c430 0x7f422c13d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35046/0 (socket says 172.21.15.5:35046) 2023-07-14T13:09:54.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.254+0000 7f42313e4640 1 -- 172.21.15.5:0/2253929266 learned_addr learned my addr 172.21.15.5:0/2253929266 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:54.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.254+0000 7f4230be3640 1 --2- 172.21.15.5:0/2253929266 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f422c06e160 0x7f422c15c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:54.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.254+0000 7f4231be5640 1 --2- 172.21.15.5:0/2253929266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f422c0ae1f0 0x7f422c12dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:54.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.254+0000 7f42313e4640 1 -- 172.21.15.5:0/2253929266 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f422c06e160 msgr2=0x7f422c15c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:54.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.254+0000 7f42313e4640 1 --2- 172.21.15.5:0/2253929266 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f422c06e160 0x7f422c15c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:54.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.254+0000 7f42313e4640 1 -- 172.21.15.5:0/2253929266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f422c0ae1f0 msgr2=0x7f422c12dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:54.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.254+0000 7f42313e4640 1 --2- 172.21.15.5:0/2253929266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f422c0ae1f0 0x7f422c12dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:54.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.254+0000 7f42313e4640 1 -- 172.21.15.5:0/2253929266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4224009b30 con 0x7f422c06c430 2023-07-14T13:09:54.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.254+0000 7f42313e4640 1 --2- 172.21.15.5:0/2253929266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f422c06c430 0x7f422c13d1e0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f422800b410 tx=0x7f422800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:54.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.254+0000 7f4221ffb640 1 -- 172.21.15.5:0/2253929266 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4228004020 con 0x7f422c06c430 2023-07-14T13:09:54.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.254+0000 7f4221ffb640 1 -- 172.21.15.5:0/2253929266 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4228004180 con 0x7f422c06c430 2023-07-14T13:09:54.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.254+0000 7f4221ffb640 1 -- 172.21.15.5:0/2253929266 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4228011630 con 0x7f422c06c430 2023-07-14T13:09:54.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.254+0000 7f4233648640 1 -- 172.21.15.5:0/2253929266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f422c0b3710 con 0x7f422c06c430 2023-07-14T13:09:54.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.254+0000 7f4233648640 1 -- 172.21.15.5:0/2253929266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f422c13df40 con 0x7f422c06c430 2023-07-14T13:09:54.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.254+0000 7f4233648640 1 -- 172.21.15.5:0/2253929266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f422c0678d0 con 0x7f422c06c430 2023-07-14T13:09:54.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.254+0000 7f4221ffb640 1 -- 172.21.15.5:0/2253929266 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4228011790 con 0x7f422c06c430 2023-07-14T13:09:54.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.258+0000 7f4221ffb640 1 --2- 172.21.15.5:0/2253929266 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f42100663a0 0x7f4210068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:54.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.258+0000 7f4221ffb640 1 -- 172.21.15.5:0/2253929266 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4228083b90 con 0x7f422c06c430 2023-07-14T13:09:54.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.258+0000 7f4230be3640 1 --2- 172.21.15.5:0/2253929266 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f42100663a0 0x7f4210068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:54.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.258+0000 7f4230be3640 1 --2- 172.21.15.5:0/2253929266 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f42100663a0 0x7f4210068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f422c15b9c0 tx=0x7f421c008040 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:54.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.258+0000 7f4221ffb640 1 -- 172.21.15.5:0/2253929266 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4228050f10 con 0x7f422c06c430 2023-07-14T13:09:54.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.410+0000 7f4233648640 1 -- 172.21.15.5:0/2253929266 --> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f422c0b3590 con 0x7f42100663a0 2023-07-14T13:09:54.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.418+0000 7f4221ffb640 1 -- 172.21.15.5:0/2253929266 <== mgr.7156 v2:172.21.15.154:6832/1525189184 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311732 (secure 0 0 0) 0x7f421c00c040 con 0x7f42100663a0 2023-07-14T13:09:54.454 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:54.455 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:09:54.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.422+0000 7f4233648640 1 -- 172.21.15.5:0/2253929266 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f42100663a0 msgr2=0x7f4210068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:54.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.422+0000 7f4233648640 1 --2- 172.21.15.5:0/2253929266 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f42100663a0 0x7f4210068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f422c15b9c0 tx=0x7f421c008040 comp rx=0 tx=0).stop 2023-07-14T13:09:54.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.422+0000 7f4233648640 1 -- 172.21.15.5:0/2253929266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f422c06c430 msgr2=0x7f422c13d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:54.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.422+0000 7f4233648640 1 --2- 172.21.15.5:0/2253929266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f422c06c430 0x7f422c13d1e0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f422800b410 tx=0x7f422800b8d0 comp rx=0 tx=0).stop 2023-07-14T13:09:54.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.422+0000 7f4233648640 1 -- 172.21.15.5:0/2253929266 shutdown_connections 2023-07-14T13:09:54.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.422+0000 7f4233648640 1 --2- 172.21.15.5:0/2253929266 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f42100663a0 0x7f4210068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:54.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.422+0000 7f4233648640 1 --2- 172.21.15.5:0/2253929266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f422c0ae1f0 0x7f422c12dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:54.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.422+0000 7f4233648640 1 --2- 172.21.15.5:0/2253929266 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f422c06e160 0x7f422c15c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:54.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.422+0000 7f4233648640 1 --2- 172.21.15.5:0/2253929266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f422c06c430 0x7f422c13d1e0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:54.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.422+0000 7f4233648640 1 -- 172.21.15.5:0/2253929266 >> 172.21.15.5:0/2253929266 conn(0x7f422c0b1300 msgr2=0x7f422c06bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:54.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.422+0000 7f4233648640 1 -- 172.21.15.5:0/2253929266 shutdown_connections 2023-07-14T13:09:54.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:54.422+0000 7f4233648640 1 -- 172.21.15.5:0/2253929266 wait complete. 2023-07-14T13:09:54.475 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-14T13:09:54.066530+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":364,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":244,"ondisk_log_size":244,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":205,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":338976,"kb_used_data":11872,"kb_used_omap":0,"kb_used_meta":327040,"kb_avail":754635744,"statfs":{"total":773094113280,"available":772747001856,"internally_reserved":0,"allocated":12156928,"data_stored":6684766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":334888960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.311844"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.758625+0000","last_change":"2023-07-14T13:09:48.784275+0000","last_active":"2023-07-14T13:09:49.758625+0000","last_peered":"2023-07-14T13:09:49.758625+0000","last_clean":"2023-07-14T13:09:49.758625+0000","last_became_active":"2023-07-14T13:09:48.783987+0000","last_became_peered":"2023-07-14T13:09:48.783987+0000","last_unstale":"2023-07-14T13:09:49.758625+0000","last_undegraded":"2023-07-14T13:09:49.758625+0000","last_fullsized":"2023-07-14T13:09:49.758625+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:18:03.038444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.583134+0000","last_change":"2023-07-14T13:09:48.787925+0000","last_active":"2023-07-14T13:09:50.583134+0000","last_peered":"2023-07-14T13:09:50.583134+0000","last_clean":"2023-07-14T13:09:50.583134+0000","last_became_active":"2023-07-14T13:09:48.787625+0000","last_became_peered":"2023-07-14T13:09:48.787625+0000","last_unstale":"2023-07-14T13:09:50.583134+0000","last_undegraded":"2023-07-14T13:09:50.583134+0000","last_fullsized":"2023-07-14T13:09:50.583134+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:54:00.081069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.758409+0000","last_change":"2023-07-14T13:09:48.782448+0000","last_active":"2023-07-14T13:09:49.758409+0000","last_peered":"2023-07-14T13:09:49.758409+0000","last_clean":"2023-07-14T13:09:49.758409+0000","last_became_active":"2023-07-14T13:09:48.782173+0000","last_became_peered":"2023-07-14T13:09:48.782173+0000","last_unstale":"2023-07-14T13:09:49.758409+0000","last_undegraded":"2023-07-14T13:09:49.758409+0000","last_fullsized":"2023-07-14T13:09:49.758409+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:12:47.477769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581874+0000","last_change":"2023-07-14T13:09:48.792550+0000","last_active":"2023-07-14T13:09:50.581874+0000","last_peered":"2023-07-14T13:09:50.581874+0000","last_clean":"2023-07-14T13:09:50.581874+0000","last_became_active":"2023-07-14T13:09:48.792248+0000","last_became_peered":"2023-07-14T13:09:48.792248+0000","last_unstale":"2023-07-14T13:09:50.581874+0000","last_undegraded":"2023-07-14T13:09:50.581874+0000","last_fullsized":"2023-07-14T13:09:50.581874+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:36:45.780154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762411+0000","last_change":"2023-07-14T13:09:48.773918+0000","last_active":"2023-07-14T13:09:49.762411+0000","last_peered":"2023-07-14T13:09:49.762411+0000","last_clean":"2023-07-14T13:09:49.762411+0000","last_became_active":"2023-07-14T13:09:48.773628+0000","last_became_peered":"2023-07-14T13:09:48.773628+0000","last_unstale":"2023-07-14T13:09:49.762411+0000","last_undegraded":"2023-07-14T13:09:49.762411+0000","last_fullsized":"2023-07-14T13:09:49.762411+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:12:01.392694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581540+0000","last_change":"2023-07-14T13:09:48.794164+0000","last_active":"2023-07-14T13:09:50.581540+0000","last_peered":"2023-07-14T13:09:50.581540+0000","last_clean":"2023-07-14T13:09:50.581540+0000","last_became_active":"2023-07-14T13:09:48.793829+0000","last_became_peered":"2023-07-14T13:09:48.793829+0000","last_unstale":"2023-07-14T13:09:50.581540+0000","last_undegraded":"2023-07-14T13:09:50.581540+0000","last_fullsized":"2023-07-14T13:09:50.581540+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:56:15.385891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.958738+0000","last_change":"2023-07-14T13:09:48.778739+0000","last_active":"2023-07-14T13:09:49.958738+0000","last_peered":"2023-07-14T13:09:49.958738+0000","last_clean":"2023-07-14T13:09:49.958738+0000","last_became_active":"2023-07-14T13:09:48.778417+0000","last_became_peered":"2023-07-14T13:09:48.778417+0000","last_unstale":"2023-07-14T13:09:49.958738+0000","last_undegraded":"2023-07-14T13:09:49.958738+0000","last_fullsized":"2023-07-14T13:09:49.958738+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:05:23.353389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582708+0000","last_change":"2023-07-14T13:09:48.794588+0000","last_active":"2023-07-14T13:09:50.582708+0000","last_peered":"2023-07-14T13:09:50.582708+0000","last_clean":"2023-07-14T13:09:50.582708+0000","last_became_active":"2023-07-14T13:09:48.794324+0000","last_became_peered":"2023-07-14T13:09:48.794324+0000","last_unstale":"2023-07-14T13:09:50.582708+0000","last_undegraded":"2023-07-14T13:09:50.582708+0000","last_fullsized":"2023-07-14T13:09:50.582708+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:13:36.045798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762797+0000","last_change":"2023-07-14T13:09:48.776355+0000","last_active":"2023-07-14T13:09:49.762797+0000","last_peered":"2023-07-14T13:09:49.762797+0000","last_clean":"2023-07-14T13:09:49.762797+0000","last_became_active":"2023-07-14T13:09:48.776035+0000","last_became_peered":"2023-07-14T13:09:48.776035+0000","last_unstale":"2023-07-14T13:09:49.762797+0000","last_undegraded":"2023-07-14T13:09:49.762797+0000","last_fullsized":"2023-07-14T13:09:49.762797+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:39.039742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581609+0000","last_change":"2023-07-14T13:09:48.771015+0000","last_active":"2023-07-14T13:09:50.581609+0000","last_peered":"2023-07-14T13:09:50.581609+0000","last_clean":"2023-07-14T13:09:50.581609+0000","last_became_active":"2023-07-14T13:09:48.770724+0000","last_became_peered":"2023-07-14T13:09:48.770724+0000","last_unstale":"2023-07-14T13:09:50.581609+0000","last_undegraded":"2023-07-14T13:09:50.581609+0000","last_fullsized":"2023-07-14T13:09:50.581609+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:16:52.893256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762705+0000","last_change":"2023-07-14T13:09:48.783502+0000","last_active":"2023-07-14T13:09:49.762705+0000","last_peered":"2023-07-14T13:09:49.762705+0000","last_clean":"2023-07-14T13:09:49.762705+0000","last_became_active":"2023-07-14T13:09:48.783236+0000","last_became_peered":"2023-07-14T13:09:48.783236+0000","last_unstale":"2023-07-14T13:09:49.762705+0000","last_undegraded":"2023-07-14T13:09:49.762705+0000","last_fullsized":"2023-07-14T13:09:49.762705+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:25:49.324291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582130+0000","last_change":"2023-07-14T13:09:48.777167+0000","last_active":"2023-07-14T13:09:50.582130+0000","last_peered":"2023-07-14T13:09:50.582130+0000","last_clean":"2023-07-14T13:09:50.582130+0000","last_became_active":"2023-07-14T13:09:48.776885+0000","last_became_peered":"2023-07-14T13:09:48.776885+0000","last_unstale":"2023-07-14T13:09:50.582130+0000","last_undegraded":"2023-07-14T13:09:50.582130+0000","last_fullsized":"2023-07-14T13:09:50.582130+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:32:52.552945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.583203+0000","last_change":"2023-07-14T13:09:48.776256+0000","last_active":"2023-07-14T13:09:50.583203+0000","last_peered":"2023-07-14T13:09:50.583203+0000","last_clean":"2023-07-14T13:09:50.583203+0000","last_became_active":"2023-07-14T13:09:48.775593+0000","last_became_peered":"2023-07-14T13:09:48.775593+0000","last_unstale":"2023-07-14T13:09:50.583203+0000","last_undegraded":"2023-07-14T13:09:50.583203+0000","last_fullsized":"2023-07-14T13:09:50.583203+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:49:22.743116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762091+0000","last_change":"2023-07-14T13:09:48.802821+0000","last_active":"2023-07-14T13:09:49.762091+0000","last_peered":"2023-07-14T13:09:49.762091+0000","last_clean":"2023-07-14T13:09:49.762091+0000","last_became_active":"2023-07-14T13:09:48.802432+0000","last_became_peered":"2023-07-14T13:09:48.802432+0000","last_unstale":"2023-07-14T13:09:49.762091+0000","last_undegraded":"2023-07-14T13:09:49.762091+0000","last_fullsized":"2023-07-14T13:09:49.762091+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:08:21.399227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582900+0000","last_change":"2023-07-14T13:09:48.791650+0000","last_active":"2023-07-14T13:09:50.582900+0000","last_peered":"2023-07-14T13:09:50.582900+0000","last_clean":"2023-07-14T13:09:50.582900+0000","last_became_active":"2023-07-14T13:09:48.791346+0000","last_became_peered":"2023-07-14T13:09:48.791346+0000","last_unstale":"2023-07-14T13:09:50.582900+0000","last_undegraded":"2023-07-14T13:09:50.582900+0000","last_fullsized":"2023-07-14T13:09:50.582900+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:58.104393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581015+0000","last_change":"2023-07-14T13:09:48.785994+0000","last_active":"2023-07-14T13:09:50.581015+0000","last_peered":"2023-07-14T13:09:50.581015+0000","last_clean":"2023-07-14T13:09:50.581015+0000","last_became_active":"2023-07-14T13:09:48.785468+0000","last_became_peered":"2023-07-14T13:09:48.785468+0000","last_unstale":"2023-07-14T13:09:50.581015+0000","last_undegraded":"2023-07-14T13:09:50.581015+0000","last_fullsized":"2023-07-14T13:09:50.581015+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:49:59.475172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582690+0000","last_change":"2023-07-14T13:09:48.786307+0000","last_active":"2023-07-14T13:09:50.582690+0000","last_peered":"2023-07-14T13:09:50.582690+0000","last_clean":"2023-07-14T13:09:50.582690+0000","last_became_active":"2023-07-14T13:09:48.785645+0000","last_became_peered":"2023-07-14T13:09:48.785645+0000","last_unstale":"2023-07-14T13:09:50.582690+0000","last_undegraded":"2023-07-14T13:09:50.582690+0000","last_fullsized":"2023-07-14T13:09:50.582690+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:53:40.523638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.758463+0000","last_change":"2023-07-14T13:09:48.777219+0000","last_active":"2023-07-14T13:09:49.758463+0000","last_peered":"2023-07-14T13:09:49.758463+0000","last_clean":"2023-07-14T13:09:49.758463+0000","last_became_active":"2023-07-14T13:09:48.776941+0000","last_became_peered":"2023-07-14T13:09:48.776941+0000","last_unstale":"2023-07-14T13:09:49.758463+0000","last_undegraded":"2023-07-14T13:09:49.758463+0000","last_fullsized":"2023-07-14T13:09:49.758463+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:30:20.748921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762753+0000","last_change":"2023-07-14T13:09:48.801862+0000","last_active":"2023-07-14T13:09:49.762753+0000","last_peered":"2023-07-14T13:09:49.762753+0000","last_clean":"2023-07-14T13:09:49.762753+0000","last_became_active":"2023-07-14T13:09:48.801538+0000","last_became_peered":"2023-07-14T13:09:48.801538+0000","last_unstale":"2023-07-14T13:09:49.762753+0000","last_undegraded":"2023-07-14T13:09:49.762753+0000","last_fullsized":"2023-07-14T13:09:49.762753+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:40:22.663795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582036+0000","last_change":"2023-07-14T13:09:48.791978+0000","last_active":"2023-07-14T13:09:50.582036+0000","last_peered":"2023-07-14T13:09:50.582036+0000","last_clean":"2023-07-14T13:09:50.582036+0000","last_became_active":"2023-07-14T13:09:48.791665+0000","last_became_peered":"2023-07-14T13:09:48.791665+0000","last_unstale":"2023-07-14T13:09:50.582036+0000","last_undegraded":"2023-07-14T13:09:50.582036+0000","last_fullsized":"2023-07-14T13:09:50.582036+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:55:30.763694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762255+0000","last_change":"2023-07-14T13:09:48.774012+0000","last_active":"2023-07-14T13:09:49.762255+0000","last_peered":"2023-07-14T13:09:49.762255+0000","last_clean":"2023-07-14T13:09:49.762255+0000","last_became_active":"2023-07-14T13:09:48.773713+0000","last_became_peered":"2023-07-14T13:09:48.773713+0000","last_unstale":"2023-07-14T13:09:49.762255+0000","last_undegraded":"2023-07-14T13:09:49.762255+0000","last_fullsized":"2023-07-14T13:09:49.762255+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:14:21.866770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762117+0000","last_change":"2023-07-14T13:09:48.802506+0000","last_active":"2023-07-14T13:09:49.762117+0000","last_peered":"2023-07-14T13:09:49.762117+0000","last_clean":"2023-07-14T13:09:49.762117+0000","last_became_active":"2023-07-14T13:09:48.802228+0000","last_became_peered":"2023-07-14T13:09:48.802228+0000","last_unstale":"2023-07-14T13:09:49.762117+0000","last_undegraded":"2023-07-14T13:09:49.762117+0000","last_fullsized":"2023-07-14T13:09:49.762117+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:18:27.224711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.086605+0000","last_change":"2023-07-14T13:09:48.794977+0000","last_active":"2023-07-14T13:09:50.086605+0000","last_peered":"2023-07-14T13:09:50.086605+0000","last_clean":"2023-07-14T13:09:50.086605+0000","last_became_active":"2023-07-14T13:09:48.794620+0000","last_became_peered":"2023-07-14T13:09:48.794620+0000","last_unstale":"2023-07-14T13:09:50.086605+0000","last_undegraded":"2023-07-14T13:09:50.086605+0000","last_fullsized":"2023-07-14T13:09:50.086605+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:12:01.392694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.758195+0000","last_change":"2023-07-14T13:09:48.778311+0000","last_active":"2023-07-14T13:09:49.758195+0000","last_peered":"2023-07-14T13:09:49.758195+0000","last_clean":"2023-07-14T13:09:49.758195+0000","last_became_active":"2023-07-14T13:09:48.777977+0000","last_became_peered":"2023-07-14T13:09:48.777977+0000","last_unstale":"2023-07-14T13:09:49.758195+0000","last_undegraded":"2023-07-14T13:09:49.758195+0000","last_fullsized":"2023-07-14T13:09:49.758195+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:55:42.450588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.583225+0000","last_change":"2023-07-14T13:09:48.776693+0000","last_active":"2023-07-14T13:09:50.583225+0000","last_peered":"2023-07-14T13:09:50.583225+0000","last_clean":"2023-07-14T13:09:50.583225+0000","last_became_active":"2023-07-14T13:09:48.776376+0000","last_became_peered":"2023-07-14T13:09:48.776376+0000","last_unstale":"2023-07-14T13:09:50.583225+0000","last_undegraded":"2023-07-14T13:09:50.583225+0000","last_fullsized":"2023-07-14T13:09:50.583225+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:00:13.742014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762639+0000","last_change":"2023-07-14T13:09:48.802111+0000","last_active":"2023-07-14T13:09:49.762639+0000","last_peered":"2023-07-14T13:09:49.762639+0000","last_clean":"2023-07-14T13:09:49.762639+0000","last_became_active":"2023-07-14T13:09:48.801765+0000","last_became_peered":"2023-07-14T13:09:48.801765+0000","last_unstale":"2023-07-14T13:09:49.762639+0000","last_undegraded":"2023-07-14T13:09:49.762639+0000","last_fullsized":"2023-07-14T13:09:49.762639+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:49:19.089644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581866+0000","last_change":"2023-07-14T13:09:48.763602+0000","last_active":"2023-07-14T13:09:50.581866+0000","last_peered":"2023-07-14T13:09:50.581866+0000","last_clean":"2023-07-14T13:09:50.581866+0000","last_became_active":"2023-07-14T13:09:48.763137+0000","last_became_peered":"2023-07-14T13:09:48.763137+0000","last_unstale":"2023-07-14T13:09:50.581866+0000","last_undegraded":"2023-07-14T13:09:50.581866+0000","last_fullsized":"2023-07-14T13:09:50.581866+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:39:50.096294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582191+0000","last_change":"2023-07-14T13:09:48.779751+0000","last_active":"2023-07-14T13:09:50.582191+0000","last_peered":"2023-07-14T13:09:50.582191+0000","last_clean":"2023-07-14T13:09:50.582191+0000","last_became_active":"2023-07-14T13:09:48.779441+0000","last_became_peered":"2023-07-14T13:09:48.779441+0000","last_unstale":"2023-07-14T13:09:50.582191+0000","last_undegraded":"2023-07-14T13:09:50.582191+0000","last_fullsized":"2023-07-14T13:09:50.582191+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:41:35.741449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.958899+0000","last_change":"2023-07-14T13:09:48.775358+0000","last_active":"2023-07-14T13:09:49.958899+0000","last_peered":"2023-07-14T13:09:49.958899+0000","last_clean":"2023-07-14T13:09:49.958899+0000","last_became_active":"2023-07-14T13:09:48.775051+0000","last_became_peered":"2023-07-14T13:09:48.775051+0000","last_unstale":"2023-07-14T13:09:49.958899+0000","last_undegraded":"2023-07-14T13:09:49.958899+0000","last_fullsized":"2023-07-14T13:09:49.958899+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:57:28.629923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762304+0000","last_change":"2023-07-14T13:09:48.774375+0000","last_active":"2023-07-14T13:09:49.762304+0000","last_peered":"2023-07-14T13:09:49.762304+0000","last_clean":"2023-07-14T13:09:49.762304+0000","last_became_active":"2023-07-14T13:09:48.774084+0000","last_became_peered":"2023-07-14T13:09:48.774084+0000","last_unstale":"2023-07-14T13:09:49.762304+0000","last_undegraded":"2023-07-14T13:09:49.762304+0000","last_fullsized":"2023-07-14T13:09:49.762304+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:09:14.783526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582767+0000","last_change":"2023-07-14T13:09:48.795332+0000","last_active":"2023-07-14T13:09:50.582767+0000","last_peered":"2023-07-14T13:09:50.582767+0000","last_clean":"2023-07-14T13:09:50.582767+0000","last_became_active":"2023-07-14T13:09:48.795041+0000","last_became_peered":"2023-07-14T13:09:48.795041+0000","last_unstale":"2023-07-14T13:09:50.582767+0000","last_undegraded":"2023-07-14T13:09:50.582767+0000","last_fullsized":"2023-07-14T13:09:50.582767+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:52:51.614993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581182+0000","last_change":"2023-07-14T13:09:48.777860+0000","last_active":"2023-07-14T13:09:50.581182+0000","last_peered":"2023-07-14T13:09:50.581182+0000","last_clean":"2023-07-14T13:09:50.581182+0000","last_became_active":"2023-07-14T13:09:48.777564+0000","last_became_peered":"2023-07-14T13:09:48.777564+0000","last_unstale":"2023-07-14T13:09:50.581182+0000","last_undegraded":"2023-07-14T13:09:50.581182+0000","last_fullsized":"2023-07-14T13:09:50.581182+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:09:29.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582794+0000","last_change":"2023-07-14T13:09:48.781946+0000","last_active":"2023-07-14T13:09:50.582794+0000","last_peered":"2023-07-14T13:09:50.582794+0000","last_clean":"2023-07-14T13:09:50.582794+0000","last_became_active":"2023-07-14T13:09:48.781640+0000","last_became_peered":"2023-07-14T13:09:48.781640+0000","last_unstale":"2023-07-14T13:09:50.582794+0000","last_undegraded":"2023-07-14T13:09:50.582794+0000","last_fullsized":"2023-07-14T13:09:50.582794+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:26:44.800018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"110'4","reported_seq":17,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.086927+0000","last_change":"2023-07-14T13:09:47.780072+0000","last_active":"2023-07-14T13:09:50.086927+0000","last_peered":"2023-07-14T13:09:50.086927+0000","last_clean":"2023-07-14T13:09:50.086927+0000","last_became_active":"2023-07-14T13:09:47.779698+0000","last_became_peered":"2023-07-14T13:09:47.779698+0000","last_unstale":"2023-07-14T13:09:50.086927+0000","last_undegraded":"2023-07-14T13:09:50.086927+0000","last_fullsized":"2023-07-14T13:09:50.086927+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:25:16.698165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581462+0000","last_change":"2023-07-14T13:09:48.771406+0000","last_active":"2023-07-14T13:09:50.581462+0000","last_peered":"2023-07-14T13:09:50.581462+0000","last_clean":"2023-07-14T13:09:50.581462+0000","last_became_active":"2023-07-14T13:09:48.771108+0000","last_became_peered":"2023-07-14T13:09:48.771108+0000","last_unstale":"2023-07-14T13:09:50.581462+0000","last_undegraded":"2023-07-14T13:09:50.581462+0000","last_fullsized":"2023-07-14T13:09:50.581462+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:33:00.422067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"110'1","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762911+0000","last_change":"2023-07-14T13:09:47.771139+0000","last_active":"2023-07-14T13:09:49.762911+0000","last_peered":"2023-07-14T13:09:49.762911+0000","last_clean":"2023-07-14T13:09:49.762911+0000","last_became_active":"2023-07-14T13:09:47.770511+0000","last_became_peered":"2023-07-14T13:09:47.770511+0000","last_unstale":"2023-07-14T13:09:49.762911+0000","last_undegraded":"2023-07-14T13:09:49.762911+0000","last_fullsized":"2023-07-14T13:09:49.762911+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:12.913674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.958991+0000","last_change":"2023-07-14T13:09:48.802042+0000","last_active":"2023-07-14T13:09:49.958991+0000","last_peered":"2023-07-14T13:09:49.958991+0000","last_clean":"2023-07-14T13:09:49.958991+0000","last_became_active":"2023-07-14T13:09:48.801617+0000","last_became_peered":"2023-07-14T13:09:48.801617+0000","last_unstale":"2023-07-14T13:09:49.958991+0000","last_undegraded":"2023-07-14T13:09:49.958991+0000","last_fullsized":"2023-07-14T13:09:49.958991+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:57.759762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"110'2","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.959102+0000","last_change":"2023-07-14T13:09:47.774348+0000","last_active":"2023-07-14T13:09:49.959102+0000","last_peered":"2023-07-14T13:09:49.959102+0000","last_clean":"2023-07-14T13:09:49.959102+0000","last_became_active":"2023-07-14T13:09:47.773974+0000","last_became_peered":"2023-07-14T13:09:47.773974+0000","last_unstale":"2023-07-14T13:09:49.959102+0000","last_undegraded":"2023-07-14T13:09:49.959102+0000","last_fullsized":"2023-07-14T13:09:49.959102+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:35:30.868632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582834+0000","last_change":"2023-07-14T13:09:48.776120+0000","last_active":"2023-07-14T13:09:50.582834+0000","last_peered":"2023-07-14T13:09:50.582834+0000","last_clean":"2023-07-14T13:09:50.582834+0000","last_became_active":"2023-07-14T13:09:48.775837+0000","last_became_peered":"2023-07-14T13:09:48.775837+0000","last_unstale":"2023-07-14T13:09:50.582834+0000","last_undegraded":"2023-07-14T13:09:50.582834+0000","last_fullsized":"2023-07-14T13:09:50.582834+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:05:41.704582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"110'2","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.086888+0000","last_change":"2023-07-14T13:09:47.777290+0000","last_active":"2023-07-14T13:09:50.086888+0000","last_peered":"2023-07-14T13:09:50.086888+0000","last_clean":"2023-07-14T13:09:50.086888+0000","last_became_active":"2023-07-14T13:09:47.776922+0000","last_became_peered":"2023-07-14T13:09:47.776922+0000","last_unstale":"2023-07-14T13:09:50.086888+0000","last_undegraded":"2023-07-14T13:09:50.086888+0000","last_fullsized":"2023-07-14T13:09:50.086888+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:38.029849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582227+0000","last_change":"2023-07-14T13:09:48.796538+0000","last_active":"2023-07-14T13:09:50.582227+0000","last_peered":"2023-07-14T13:09:50.582227+0000","last_clean":"2023-07-14T13:09:50.582227+0000","last_became_active":"2023-07-14T13:09:48.796192+0000","last_became_peered":"2023-07-14T13:09:48.796192+0000","last_unstale":"2023-07-14T13:09:50.582227+0000","last_undegraded":"2023-07-14T13:09:50.582227+0000","last_fullsized":"2023-07-14T13:09:50.582227+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:23:39.740670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"110'1","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762414+0000","last_change":"2023-07-14T13:09:47.769784+0000","last_active":"2023-07-14T13:09:49.762414+0000","last_peered":"2023-07-14T13:09:49.762414+0000","last_clean":"2023-07-14T13:09:49.762414+0000","last_became_active":"2023-07-14T13:09:47.769454+0000","last_became_peered":"2023-07-14T13:09:47.769454+0000","last_unstale":"2023-07-14T13:09:49.762414+0000","last_undegraded":"2023-07-14T13:09:49.762414+0000","last_fullsized":"2023-07-14T13:09:49.762414+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:42:04.191703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.086589+0000","last_change":"2023-07-14T13:09:48.775838+0000","last_active":"2023-07-14T13:09:50.086589+0000","last_peered":"2023-07-14T13:09:50.086589+0000","last_clean":"2023-07-14T13:09:50.086589+0000","last_became_active":"2023-07-14T13:09:48.775476+0000","last_became_peered":"2023-07-14T13:09:48.775476+0000","last_unstale":"2023-07-14T13:09:50.086589+0000","last_undegraded":"2023-07-14T13:09:50.086589+0000","last_fullsized":"2023-07-14T13:09:50.086589+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:09:14.783526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"110'1","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.583471+0000","last_change":"2023-07-14T13:09:47.769513+0000","last_active":"2023-07-14T13:09:50.583471+0000","last_peered":"2023-07-14T13:09:50.583471+0000","last_clean":"2023-07-14T13:09:50.583471+0000","last_became_active":"2023-07-14T13:09:47.769181+0000","last_became_peered":"2023-07-14T13:09:47.769181+0000","last_unstale":"2023-07-14T13:09:50.583471+0000","last_undegraded":"2023-07-14T13:09:50.583471+0000","last_fullsized":"2023-07-14T13:09:50.583471+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:33:41.072287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581698+0000","last_change":"2023-07-14T13:09:48.794110+0000","last_active":"2023-07-14T13:09:50.581698+0000","last_peered":"2023-07-14T13:09:50.581698+0000","last_clean":"2023-07-14T13:09:50.581698+0000","last_became_active":"2023-07-14T13:09:48.793819+0000","last_became_peered":"2023-07-14T13:09:48.793819+0000","last_unstale":"2023-07-14T13:09:50.581698+0000","last_undegraded":"2023-07-14T13:09:50.581698+0000","last_fullsized":"2023-07-14T13:09:50.581698+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:47:01.387757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.758333+0000","last_change":"2023-07-14T13:09:47.773338+0000","last_active":"2023-07-14T13:09:49.758333+0000","last_peered":"2023-07-14T13:09:49.758333+0000","last_clean":"2023-07-14T13:09:49.758333+0000","last_became_active":"2023-07-14T13:09:47.773046+0000","last_became_peered":"2023-07-14T13:09:47.773046+0000","last_unstale":"2023-07-14T13:09:49.758333+0000","last_undegraded":"2023-07-14T13:09:49.758333+0000","last_fullsized":"2023-07-14T13:09:49.758333+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:36:56.805878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.583236+0000","last_change":"2023-07-14T13:09:48.776478+0000","last_active":"2023-07-14T13:09:50.583236+0000","last_peered":"2023-07-14T13:09:50.583236+0000","last_clean":"2023-07-14T13:09:50.583236+0000","last_became_active":"2023-07-14T13:09:48.775944+0000","last_became_peered":"2023-07-14T13:09:48.775944+0000","last_unstale":"2023-07-14T13:09:50.583236+0000","last_undegraded":"2023-07-14T13:09:50.583236+0000","last_fullsized":"2023-07-14T13:09:50.583236+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:31:06.339110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.958662+0000","last_change":"2023-07-14T13:09:47.780668+0000","last_active":"2023-07-14T13:09:49.958662+0000","last_peered":"2023-07-14T13:09:49.958662+0000","last_clean":"2023-07-14T13:09:49.958662+0000","last_became_active":"2023-07-14T13:09:47.780381+0000","last_became_peered":"2023-07-14T13:09:47.780381+0000","last_unstale":"2023-07-14T13:09:49.958662+0000","last_undegraded":"2023-07-14T13:09:49.958662+0000","last_fullsized":"2023-07-14T13:09:49.958662+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:43:47.346035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762475+0000","last_change":"2023-07-14T13:09:48.779428+0000","last_active":"2023-07-14T13:09:49.762475+0000","last_peered":"2023-07-14T13:09:49.762475+0000","last_clean":"2023-07-14T13:09:49.762475+0000","last_became_active":"2023-07-14T13:09:48.778511+0000","last_became_peered":"2023-07-14T13:09:48.778511+0000","last_unstale":"2023-07-14T13:09:49.762475+0000","last_undegraded":"2023-07-14T13:09:49.762475+0000","last_fullsized":"2023-07-14T13:09:49.762475+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:24:45.826580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.583351+0000","last_change":"2023-07-14T13:09:47.771140+0000","last_active":"2023-07-14T13:09:50.583351+0000","last_peered":"2023-07-14T13:09:50.583351+0000","last_clean":"2023-07-14T13:09:50.583351+0000","last_became_active":"2023-07-14T13:09:47.770759+0000","last_became_peered":"2023-07-14T13:09:47.770759+0000","last_unstale":"2023-07-14T13:09:50.583351+0000","last_undegraded":"2023-07-14T13:09:50.583351+0000","last_fullsized":"2023-07-14T13:09:50.583351+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:08:15.893929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.959043+0000","last_change":"2023-07-14T13:09:48.780858+0000","last_active":"2023-07-14T13:09:49.959043+0000","last_peered":"2023-07-14T13:09:49.959043+0000","last_clean":"2023-07-14T13:09:49.959043+0000","last_became_active":"2023-07-14T13:09:48.780570+0000","last_became_peered":"2023-07-14T13:09:48.780570+0000","last_unstale":"2023-07-14T13:09:49.959043+0000","last_undegraded":"2023-07-14T13:09:49.959043+0000","last_fullsized":"2023-07-14T13:09:49.959043+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:42:35.317684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.758584+0000","last_change":"2023-07-14T13:09:47.774479+0000","last_active":"2023-07-14T13:09:49.758584+0000","last_peered":"2023-07-14T13:09:49.758584+0000","last_clean":"2023-07-14T13:09:49.758584+0000","last_became_active":"2023-07-14T13:09:47.774120+0000","last_became_peered":"2023-07-14T13:09:47.774120+0000","last_unstale":"2023-07-14T13:09:49.758584+0000","last_undegraded":"2023-07-14T13:09:49.758584+0000","last_fullsized":"2023-07-14T13:09:49.758584+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:20:46.152438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.758526+0000","last_change":"2023-07-14T13:09:48.775585+0000","last_active":"2023-07-14T13:09:49.758526+0000","last_peered":"2023-07-14T13:09:49.758526+0000","last_clean":"2023-07-14T13:09:49.758526+0000","last_became_active":"2023-07-14T13:09:48.775242+0000","last_became_peered":"2023-07-14T13:09:48.775242+0000","last_unstale":"2023-07-14T13:09:49.758526+0000","last_undegraded":"2023-07-14T13:09:49.758526+0000","last_fullsized":"2023-07-14T13:09:49.758526+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:28:56.646763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"110'3","reported_seq":16,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762926+0000","last_change":"2023-07-14T13:09:47.780026+0000","last_active":"2023-07-14T13:09:49.762926+0000","last_peered":"2023-07-14T13:09:49.762926+0000","last_clean":"2023-07-14T13:09:49.762926+0000","last_became_active":"2023-07-14T13:09:47.779666+0000","last_became_peered":"2023-07-14T13:09:47.779666+0000","last_unstale":"2023-07-14T13:09:49.762926+0000","last_undegraded":"2023-07-14T13:09:49.762926+0000","last_fullsized":"2023-07-14T13:09:49.762926+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:25:16.698165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582428+0000","last_change":"2023-07-14T13:09:48.790932+0000","last_active":"2023-07-14T13:09:50.582428+0000","last_peered":"2023-07-14T13:09:50.582428+0000","last_clean":"2023-07-14T13:09:50.582428+0000","last_became_active":"2023-07-14T13:09:48.781067+0000","last_became_peered":"2023-07-14T13:09:48.781067+0000","last_unstale":"2023-07-14T13:09:50.582428+0000","last_undegraded":"2023-07-14T13:09:50.582428+0000","last_fullsized":"2023-07-14T13:09:50.582428+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:08:22.889826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"110'6","reported_seq":19,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.583115+0000","last_change":"2023-07-14T13:09:47.774575+0000","last_active":"2023-07-14T13:09:50.583115+0000","last_peered":"2023-07-14T13:09:50.583115+0000","last_clean":"2023-07-14T13:09:50.583115+0000","last_became_active":"2023-07-14T13:09:47.774273+0000","last_became_peered":"2023-07-14T13:09:47.774273+0000","last_unstale":"2023-07-14T13:09:50.583115+0000","last_undegraded":"2023-07-14T13:09:50.583115+0000","last_fullsized":"2023-07-14T13:09:50.583115+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:25:47.457880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582396+0000","last_change":"2023-07-14T13:09:48.796570+0000","last_active":"2023-07-14T13:09:50.582396+0000","last_peered":"2023-07-14T13:09:50.582396+0000","last_clean":"2023-07-14T13:09:50.582396+0000","last_became_active":"2023-07-14T13:09:48.796211+0000","last_became_peered":"2023-07-14T13:09:48.796211+0000","last_unstale":"2023-07-14T13:09:50.582396+0000","last_undegraded":"2023-07-14T13:09:50.582396+0000","last_fullsized":"2023-07-14T13:09:50.582396+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:44:00.859758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"110'2","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.959148+0000","last_change":"2023-07-14T13:09:47.780239+0000","last_active":"2023-07-14T13:09:49.959148+0000","last_peered":"2023-07-14T13:09:49.959148+0000","last_clean":"2023-07-14T13:09:49.959148+0000","last_became_active":"2023-07-14T13:09:47.779940+0000","last_became_peered":"2023-07-14T13:09:47.779940+0000","last_unstale":"2023-07-14T13:09:49.959148+0000","last_undegraded":"2023-07-14T13:09:49.959148+0000","last_fullsized":"2023-07-14T13:09:49.959148+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:16:14.597527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762091+0000","last_change":"2023-07-14T13:09:48.776744+0000","last_active":"2023-07-14T13:09:49.762091+0000","last_peered":"2023-07-14T13:09:49.762091+0000","last_clean":"2023-07-14T13:09:49.762091+0000","last_became_active":"2023-07-14T13:09:48.776391+0000","last_became_peered":"2023-07-14T13:09:48.776391+0000","last_unstale":"2023-07-14T13:09:49.762091+0000","last_undegraded":"2023-07-14T13:09:49.762091+0000","last_fullsized":"2023-07-14T13:09:49.762091+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:35:42.126659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581837+0000","last_change":"2023-07-14T13:09:47.773431+0000","last_active":"2023-07-14T13:09:50.581837+0000","last_peered":"2023-07-14T13:09:50.581837+0000","last_clean":"2023-07-14T13:09:50.581837+0000","last_became_active":"2023-07-14T13:09:47.773132+0000","last_became_peered":"2023-07-14T13:09:47.773132+0000","last_unstale":"2023-07-14T13:09:50.581837+0000","last_undegraded":"2023-07-14T13:09:50.581837+0000","last_fullsized":"2023-07-14T13:09:50.581837+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:57:37.379413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581410+0000","last_change":"2023-07-14T13:09:48.801365+0000","last_active":"2023-07-14T13:09:50.581410+0000","last_peered":"2023-07-14T13:09:50.581410+0000","last_clean":"2023-07-14T13:09:50.581410+0000","last_became_active":"2023-07-14T13:09:48.801067+0000","last_became_peered":"2023-07-14T13:09:48.801067+0000","last_unstale":"2023-07-14T13:09:50.581410+0000","last_undegraded":"2023-07-14T13:09:50.581410+0000","last_fullsized":"2023-07-14T13:09:50.581410+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:17:00.118423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.583039+0000","last_change":"2023-07-14T13:09:47.769864+0000","last_active":"2023-07-14T13:09:50.583039+0000","last_peered":"2023-07-14T13:09:50.583039+0000","last_clean":"2023-07-14T13:09:50.583039+0000","last_became_active":"2023-07-14T13:09:47.769417+0000","last_became_peered":"2023-07-14T13:09:47.769417+0000","last_unstale":"2023-07-14T13:09:50.583039+0000","last_undegraded":"2023-07-14T13:09:50.583039+0000","last_fullsized":"2023-07-14T13:09:50.583039+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:54:47.051976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582286+0000","last_change":"2023-07-14T13:09:48.781818+0000","last_active":"2023-07-14T13:09:50.582286+0000","last_peered":"2023-07-14T13:09:50.582286+0000","last_clean":"2023-07-14T13:09:50.582286+0000","last_became_active":"2023-07-14T13:09:48.781547+0000","last_became_peered":"2023-07-14T13:09:48.781547+0000","last_unstale":"2023-07-14T13:09:50.582286+0000","last_undegraded":"2023-07-14T13:09:50.582286+0000","last_fullsized":"2023-07-14T13:09:50.582286+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:58:03.164586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"110'8","reported_seq":21,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582546+0000","last_change":"2023-07-14T13:09:47.770460+0000","last_active":"2023-07-14T13:09:50.582546+0000","last_peered":"2023-07-14T13:09:50.582546+0000","last_clean":"2023-07-14T13:09:50.582546+0000","last_became_active":"2023-07-14T13:09:47.770187+0000","last_became_peered":"2023-07-14T13:09:47.770187+0000","last_unstale":"2023-07-14T13:09:50.582546+0000","last_undegraded":"2023-07-14T13:09:50.582546+0000","last_fullsized":"2023-07-14T13:09:50.582546+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:04:47.746163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.086740+0000","last_change":"2023-07-14T13:09:48.770401+0000","last_active":"2023-07-14T13:09:50.086740+0000","last_peered":"2023-07-14T13:09:50.086740+0000","last_clean":"2023-07-14T13:09:50.086740+0000","last_became_active":"2023-07-14T13:09:48.770086+0000","last_became_peered":"2023-07-14T13:09:48.770086+0000","last_unstale":"2023-07-14T13:09:50.086740+0000","last_undegraded":"2023-07-14T13:09:50.086740+0000","last_fullsized":"2023-07-14T13:09:50.086740+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:42:05.201596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"110'2","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.959242+0000","last_change":"2023-07-14T13:09:47.775032+0000","last_active":"2023-07-14T13:09:49.959242+0000","last_peered":"2023-07-14T13:09:49.959242+0000","last_clean":"2023-07-14T13:09:49.959242+0000","last_became_active":"2023-07-14T13:09:47.774767+0000","last_became_peered":"2023-07-14T13:09:47.774767+0000","last_unstale":"2023-07-14T13:09:49.959242+0000","last_undegraded":"2023-07-14T13:09:49.959242+0000","last_fullsized":"2023-07-14T13:09:49.959242+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:42:28.996868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581639+0000","last_change":"2023-07-14T13:09:48.779297+0000","last_active":"2023-07-14T13:09:50.581639+0000","last_peered":"2023-07-14T13:09:50.581639+0000","last_clean":"2023-07-14T13:09:50.581639+0000","last_became_active":"2023-07-14T13:09:48.779029+0000","last_became_peered":"2023-07-14T13:09:48.779029+0000","last_unstale":"2023-07-14T13:09:50.581639+0000","last_undegraded":"2023-07-14T13:09:50.581639+0000","last_fullsized":"2023-07-14T13:09:50.581639+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:55:44.381636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"111'1","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.763009+0000","last_change":"2023-07-14T13:09:47.771248+0000","last_active":"2023-07-14T13:09:49.763009+0000","last_peered":"2023-07-14T13:09:49.763009+0000","last_clean":"2023-07-14T13:09:49.763009+0000","last_became_active":"2023-07-14T13:09:47.770885+0000","last_became_peered":"2023-07-14T13:09:47.770885+0000","last_unstale":"2023-07-14T13:09:49.763009+0000","last_undegraded":"2023-07-14T13:09:49.763009+0000","last_fullsized":"2023-07-14T13:09:49.763009+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:35:40.340246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582237+0000","last_change":"2023-07-14T13:09:48.774383+0000","last_active":"2023-07-14T13:09:50.582237+0000","last_peered":"2023-07-14T13:09:50.582237+0000","last_clean":"2023-07-14T13:09:50.582237+0000","last_became_active":"2023-07-14T13:09:48.774020+0000","last_became_peered":"2023-07-14T13:09:48.774020+0000","last_unstale":"2023-07-14T13:09:50.582237+0000","last_undegraded":"2023-07-14T13:09:50.582237+0000","last_fullsized":"2023-07-14T13:09:50.582237+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:07:44.853187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.763058+0000","last_change":"2023-07-14T13:09:47.777989+0000","last_active":"2023-07-14T13:09:49.763058+0000","last_peered":"2023-07-14T13:09:49.763058+0000","last_clean":"2023-07-14T13:09:49.763058+0000","last_became_active":"2023-07-14T13:09:47.777607+0000","last_became_peered":"2023-07-14T13:09:47.777607+0000","last_unstale":"2023-07-14T13:09:49.763058+0000","last_undegraded":"2023-07-14T13:09:49.763058+0000","last_fullsized":"2023-07-14T13:09:49.763058+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:04:53.112997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.583310+0000","last_change":"2023-07-14T13:09:48.781240+0000","last_active":"2023-07-14T13:09:50.583310+0000","last_peered":"2023-07-14T13:09:50.583310+0000","last_clean":"2023-07-14T13:09:50.583310+0000","last_became_active":"2023-07-14T13:09:48.780923+0000","last_became_peered":"2023-07-14T13:09:48.780923+0000","last_unstale":"2023-07-14T13:09:50.583310+0000","last_undegraded":"2023-07-14T13:09:50.583310+0000","last_fullsized":"2023-07-14T13:09:50.583310+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:36:41.491238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.086887+0000","last_change":"2023-07-14T13:09:47.770697+0000","last_active":"2023-07-14T13:09:50.086887+0000","last_peered":"2023-07-14T13:09:50.086887+0000","last_clean":"2023-07-14T13:09:50.086887+0000","last_became_active":"2023-07-14T13:09:47.770416+0000","last_became_peered":"2023-07-14T13:09:47.770416+0000","last_unstale":"2023-07-14T13:09:50.086887+0000","last_undegraded":"2023-07-14T13:09:50.086887+0000","last_fullsized":"2023-07-14T13:09:50.086887+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:40:21.653902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581076+0000","last_change":"2023-07-14T13:09:48.772403+0000","last_active":"2023-07-14T13:09:50.581076+0000","last_peered":"2023-07-14T13:09:50.581076+0000","last_clean":"2023-07-14T13:09:50.581076+0000","last_became_active":"2023-07-14T13:09:48.772086+0000","last_became_peered":"2023-07-14T13:09:48.772086+0000","last_unstale":"2023-07-14T13:09:50.581076+0000","last_undegraded":"2023-07-14T13:09:50.581076+0000","last_fullsized":"2023-07-14T13:09:50.581076+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:30:12.588596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581856+0000","last_change":"2023-07-14T13:09:47.773993+0000","last_active":"2023-07-14T13:09:50.581856+0000","last_peered":"2023-07-14T13:09:50.581856+0000","last_clean":"2023-07-14T13:09:50.581856+0000","last_became_active":"2023-07-14T13:09:47.773728+0000","last_became_peered":"2023-07-14T13:09:47.773728+0000","last_unstale":"2023-07-14T13:09:50.581856+0000","last_undegraded":"2023-07-14T13:09:50.581856+0000","last_fullsized":"2023-07-14T13:09:50.581856+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:43:59.735358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.758171+0000","last_change":"2023-07-14T13:09:48.801767+0000","last_active":"2023-07-14T13:09:49.758171+0000","last_peered":"2023-07-14T13:09:49.758171+0000","last_clean":"2023-07-14T13:09:49.758171+0000","last_became_active":"2023-07-14T13:09:48.801455+0000","last_became_peered":"2023-07-14T13:09:48.801455+0000","last_unstale":"2023-07-14T13:09:49.758171+0000","last_undegraded":"2023-07-14T13:09:49.758171+0000","last_fullsized":"2023-07-14T13:09:49.758171+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:07:36.936699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.583039+0000","last_change":"2023-07-14T13:09:47.777463+0000","last_active":"2023-07-14T13:09:50.583039+0000","last_peered":"2023-07-14T13:09:50.583039+0000","last_clean":"2023-07-14T13:09:50.583039+0000","last_became_active":"2023-07-14T13:09:47.777170+0000","last_became_peered":"2023-07-14T13:09:47.777170+0000","last_unstale":"2023-07-14T13:09:50.583039+0000","last_undegraded":"2023-07-14T13:09:50.583039+0000","last_fullsized":"2023-07-14T13:09:50.583039+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:38:57.821053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.086773+0000","last_change":"2023-07-14T13:09:48.796672+0000","last_active":"2023-07-14T13:09:50.086773+0000","last_peered":"2023-07-14T13:09:50.086773+0000","last_clean":"2023-07-14T13:09:50.086773+0000","last_became_active":"2023-07-14T13:09:48.796475+0000","last_became_peered":"2023-07-14T13:09:48.796475+0000","last_unstale":"2023-07-14T13:09:50.086773+0000","last_undegraded":"2023-07-14T13:09:50.086773+0000","last_fullsized":"2023-07-14T13:09:50.086773+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:25:49.324291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.086753+0000","last_change":"2023-07-14T13:09:47.773135+0000","last_active":"2023-07-14T13:09:50.086753+0000","last_peered":"2023-07-14T13:09:50.086753+0000","last_clean":"2023-07-14T13:09:50.086753+0000","last_became_active":"2023-07-14T13:09:47.772845+0000","last_became_peered":"2023-07-14T13:09:47.772845+0000","last_unstale":"2023-07-14T13:09:50.086753+0000","last_undegraded":"2023-07-14T13:09:50.086753+0000","last_fullsized":"2023-07-14T13:09:50.086753+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:24:44.816687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581713+0000","last_change":"2023-07-14T13:09:48.779930+0000","last_active":"2023-07-14T13:09:50.581713+0000","last_peered":"2023-07-14T13:09:50.581713+0000","last_clean":"2023-07-14T13:09:50.581713+0000","last_became_active":"2023-07-14T13:09:48.779625+0000","last_became_peered":"2023-07-14T13:09:48.779625+0000","last_unstale":"2023-07-14T13:09:50.581713+0000","last_undegraded":"2023-07-14T13:09:50.581713+0000","last_fullsized":"2023-07-14T13:09:50.581713+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:38:56.837892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.958742+0000","last_change":"2023-07-14T13:09:47.778138+0000","last_active":"2023-07-14T13:09:49.958742+0000","last_peered":"2023-07-14T13:09:49.958742+0000","last_clean":"2023-07-14T13:09:49.958742+0000","last_became_active":"2023-07-14T13:09:47.777801+0000","last_became_peered":"2023-07-14T13:09:47.777801+0000","last_unstale":"2023-07-14T13:09:49.958742+0000","last_undegraded":"2023-07-14T13:09:49.958742+0000","last_fullsized":"2023-07-14T13:09:49.958742+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:05:54.030706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.959128+0000","last_change":"2023-07-14T13:09:48.779037+0000","last_active":"2023-07-14T13:09:49.959128+0000","last_peered":"2023-07-14T13:09:49.959128+0000","last_clean":"2023-07-14T13:09:49.959128+0000","last_became_active":"2023-07-14T13:09:48.778756+0000","last_became_peered":"2023-07-14T13:09:48.778756+0000","last_unstale":"2023-07-14T13:09:49.959128+0000","last_undegraded":"2023-07-14T13:09:49.959128+0000","last_fullsized":"2023-07-14T13:09:49.959128+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:41:28.675808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582337+0000","last_change":"2023-07-14T13:09:47.773514+0000","last_active":"2023-07-14T13:09:50.582337+0000","last_peered":"2023-07-14T13:09:50.582337+0000","last_clean":"2023-07-14T13:09:50.582337+0000","last_became_active":"2023-07-14T13:09:47.773211+0000","last_became_peered":"2023-07-14T13:09:47.773211+0000","last_unstale":"2023-07-14T13:09:50.582337+0000","last_undegraded":"2023-07-14T13:09:50.582337+0000","last_fullsized":"2023-07-14T13:09:50.582337+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:37:11.398707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"99'205","reported_seq":647,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.958985+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:09:49.958985+0000","last_peered":"2023-07-14T13:09:49.958985+0000","last_clean":"2023-07-14T13:09:49.958985+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:09:49.958985+0000","last_undegraded":"2023-07-14T13:09:49.958985+0000","last_fullsized":"2023-07-14T13:09:49.958985+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:20:28.179997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":179,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.583034+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:09:50.583034+0000","last_peered":"2023-07-14T13:09:50.583034+0000","last_clean":"2023-07-14T13:09:50.583034+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:09:50.583034+0000","last_undegraded":"2023-07-14T13:09:50.583034+0000","last_fullsized":"2023-07-14T13:09:50.583034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:38:01.827917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582934+0000","last_change":"2023-07-14T13:09:48.778741+0000","last_active":"2023-07-14T13:09:50.582934+0000","last_peered":"2023-07-14T13:09:50.582934+0000","last_clean":"2023-07-14T13:09:50.582934+0000","last_became_active":"2023-07-14T13:09:48.778429+0000","last_became_peered":"2023-07-14T13:09:48.778429+0000","last_unstale":"2023-07-14T13:09:50.582934+0000","last_undegraded":"2023-07-14T13:09:50.582934+0000","last_fullsized":"2023-07-14T13:09:50.582934+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:03:23.437711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"110'1","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.086828+0000","last_change":"2023-07-14T13:09:47.775769+0000","last_active":"2023-07-14T13:09:50.086828+0000","last_peered":"2023-07-14T13:09:50.086828+0000","last_clean":"2023-07-14T13:09:50.086828+0000","last_became_active":"2023-07-14T13:09:47.775476+0000","last_became_peered":"2023-07-14T13:09:47.775476+0000","last_unstale":"2023-07-14T13:09:50.086828+0000","last_undegraded":"2023-07-14T13:09:50.086828+0000","last_fullsized":"2023-07-14T13:09:50.086828+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:29:19.391206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":179,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.958969+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:09:49.958969+0000","last_peered":"2023-07-14T13:09:49.958969+0000","last_clean":"2023-07-14T13:09:49.958969+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:09:49.958969+0000","last_undegraded":"2023-07-14T13:09:49.958969+0000","last_fullsized":"2023-07-14T13:09:49.958969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:28:02.872507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.086763+0000","last_change":"2023-07-14T13:09:48.769267+0000","last_active":"2023-07-14T13:09:50.086763+0000","last_peered":"2023-07-14T13:09:50.086763+0000","last_clean":"2023-07-14T13:09:50.086763+0000","last_became_active":"2023-07-14T13:09:48.768969+0000","last_became_peered":"2023-07-14T13:09:48.768969+0000","last_unstale":"2023-07-14T13:09:50.086763+0000","last_undegraded":"2023-07-14T13:09:50.086763+0000","last_fullsized":"2023-07-14T13:09:50.086763+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:49:19.089644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"110'2","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.959077+0000","last_change":"2023-07-14T13:09:47.774372+0000","last_active":"2023-07-14T13:09:49.959077+0000","last_peered":"2023-07-14T13:09:49.959077+0000","last_clean":"2023-07-14T13:09:49.959077+0000","last_became_active":"2023-07-14T13:09:47.774044+0000","last_became_peered":"2023-07-14T13:09:47.774044+0000","last_unstale":"2023-07-14T13:09:49.959077+0000","last_undegraded":"2023-07-14T13:09:49.959077+0000","last_fullsized":"2023-07-14T13:09:49.959077+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:17:21.829416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":175,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581242+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:09:50.581242+0000","last_peered":"2023-07-14T13:09:50.581242+0000","last_clean":"2023-07-14T13:09:50.581242+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:09:50.581242+0000","last_undegraded":"2023-07-14T13:09:50.581242+0000","last_fullsized":"2023-07-14T13:09:50.581242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:34:24.115777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762740+0000","last_change":"2023-07-14T13:09:48.775897+0000","last_active":"2023-07-14T13:09:49.762740+0000","last_peered":"2023-07-14T13:09:49.762740+0000","last_clean":"2023-07-14T13:09:49.762740+0000","last_became_active":"2023-07-14T13:09:48.775611+0000","last_became_peered":"2023-07-14T13:09:48.775611+0000","last_unstale":"2023-07-14T13:09:49.762740+0000","last_undegraded":"2023-07-14T13:09:49.762740+0000","last_fullsized":"2023-07-14T13:09:49.762740+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:29:20.401099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"110'1","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762990+0000","last_change":"2023-07-14T13:09:47.776207+0000","last_active":"2023-07-14T13:09:49.762990+0000","last_peered":"2023-07-14T13:09:49.762990+0000","last_clean":"2023-07-14T13:09:49.762990+0000","last_became_active":"2023-07-14T13:09:47.775865+0000","last_became_peered":"2023-07-14T13:09:47.775865+0000","last_unstale":"2023-07-14T13:09:49.762990+0000","last_undegraded":"2023-07-14T13:09:49.762990+0000","last_fullsized":"2023-07-14T13:09:49.762990+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:13:49.472946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":179,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.583019+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:09:50.583019+0000","last_peered":"2023-07-14T13:09:50.583019+0000","last_clean":"2023-07-14T13:09:50.583019+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:09:50.583019+0000","last_undegraded":"2023-07-14T13:09:50.583019+0000","last_fullsized":"2023-07-14T13:09:50.583019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:00:37.391268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581326+0000","last_change":"2023-07-14T13:09:48.797309+0000","last_active":"2023-07-14T13:09:50.581326+0000","last_peered":"2023-07-14T13:09:50.581326+0000","last_clean":"2023-07-14T13:09:50.581326+0000","last_became_active":"2023-07-14T13:09:48.796994+0000","last_became_peered":"2023-07-14T13:09:48.796994+0000","last_unstale":"2023-07-14T13:09:50.581326+0000","last_undegraded":"2023-07-14T13:09:50.581326+0000","last_fullsized":"2023-07-14T13:09:50.581326+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:48:25.133393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"110'2","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582897+0000","last_change":"2023-07-14T13:09:47.777379+0000","last_active":"2023-07-14T13:09:50.582897+0000","last_peered":"2023-07-14T13:09:50.582897+0000","last_clean":"2023-07-14T13:09:50.582897+0000","last_became_active":"2023-07-14T13:09:47.776990+0000","last_became_peered":"2023-07-14T13:09:47.776990+0000","last_unstale":"2023-07-14T13:09:50.582897+0000","last_undegraded":"2023-07-14T13:09:50.582897+0000","last_fullsized":"2023-07-14T13:09:50.582897+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:39:38.486319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":187,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582952+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:09:50.582952+0000","last_peered":"2023-07-14T13:09:50.582952+0000","last_clean":"2023-07-14T13:09:50.582952+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:09:50.582952+0000","last_undegraded":"2023-07-14T13:09:50.582952+0000","last_fullsized":"2023-07-14T13:09:50.582952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:45:12.396037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582769+0000","last_change":"2023-07-14T13:09:48.787932+0000","last_active":"2023-07-14T13:09:50.582769+0000","last_peered":"2023-07-14T13:09:50.582769+0000","last_clean":"2023-07-14T13:09:50.582769+0000","last_became_active":"2023-07-14T13:09:48.787582+0000","last_became_peered":"2023-07-14T13:09:48.787582+0000","last_unstale":"2023-07-14T13:09:50.582769+0000","last_undegraded":"2023-07-14T13:09:50.582769+0000","last_fullsized":"2023-07-14T13:09:50.582769+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:37:43.251674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581547+0000","last_change":"2023-07-14T13:09:47.772443+0000","last_active":"2023-07-14T13:09:50.581547+0000","last_peered":"2023-07-14T13:09:50.581547+0000","last_clean":"2023-07-14T13:09:50.581547+0000","last_became_active":"2023-07-14T13:09:47.772118+0000","last_became_peered":"2023-07-14T13:09:47.772118+0000","last_unstale":"2023-07-14T13:09:50.581547+0000","last_undegraded":"2023-07-14T13:09:50.581547+0000","last_fullsized":"2023-07-14T13:09:50.581547+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:04:04.658732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":179,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.959246+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:09:49.959246+0000","last_peered":"2023-07-14T13:09:49.959246+0000","last_clean":"2023-07-14T13:09:49.959246+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:09:49.959246+0000","last_undegraded":"2023-07-14T13:09:49.959246+0000","last_fullsized":"2023-07-14T13:09:49.959246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:44:01.779528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582864+0000","last_change":"2023-07-14T13:09:48.803096+0000","last_active":"2023-07-14T13:09:50.582864+0000","last_peered":"2023-07-14T13:09:50.582864+0000","last_clean":"2023-07-14T13:09:50.582864+0000","last_became_active":"2023-07-14T13:09:48.802791+0000","last_became_peered":"2023-07-14T13:09:48.802791+0000","last_unstale":"2023-07-14T13:09:50.582864+0000","last_undegraded":"2023-07-14T13:09:50.582864+0000","last_fullsized":"2023-07-14T13:09:50.582864+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:59:44.774708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582911+0000","last_change":"2023-07-14T13:09:47.780048+0000","last_active":"2023-07-14T13:09:50.582911+0000","last_peered":"2023-07-14T13:09:50.582911+0000","last_clean":"2023-07-14T13:09:50.582911+0000","last_became_active":"2023-07-14T13:09:47.779564+0000","last_became_peered":"2023-07-14T13:09:47.779564+0000","last_unstale":"2023-07-14T13:09:50.582911+0000","last_undegraded":"2023-07-14T13:09:50.582911+0000","last_fullsized":"2023-07-14T13:09:50.582911+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:55:19.517177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":186,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582888+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:09:50.582888+0000","last_peered":"2023-07-14T13:09:50.582888+0000","last_clean":"2023-07-14T13:09:50.582888+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:09:50.582888+0000","last_undegraded":"2023-07-14T13:09:50.582888+0000","last_fullsized":"2023-07-14T13:09:50.582888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:38:58.034205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581532+0000","last_change":"2023-07-14T13:09:48.774534+0000","last_active":"2023-07-14T13:09:50.581532+0000","last_peered":"2023-07-14T13:09:50.581532+0000","last_clean":"2023-07-14T13:09:50.581532+0000","last_became_active":"2023-07-14T13:09:48.774248+0000","last_became_peered":"2023-07-14T13:09:48.774248+0000","last_unstale":"2023-07-14T13:09:50.581532+0000","last_undegraded":"2023-07-14T13:09:50.581532+0000","last_fullsized":"2023-07-14T13:09:50.581532+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:23:16.082487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581206+0000","last_change":"2023-07-14T13:09:47.768621+0000","last_active":"2023-07-14T13:09:50.581206+0000","last_peered":"2023-07-14T13:09:50.581206+0000","last_clean":"2023-07-14T13:09:50.581206+0000","last_became_active":"2023-07-14T13:09:47.768335+0000","last_became_peered":"2023-07-14T13:09:47.768335+0000","last_unstale":"2023-07-14T13:09:50.581206+0000","last_undegraded":"2023-07-14T13:09:50.581206+0000","last_fullsized":"2023-07-14T13:09:50.581206+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:15:15.146765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":176,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.086949+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:09:50.086949+0000","last_peered":"2023-07-14T13:09:50.086949+0000","last_clean":"2023-07-14T13:09:50.086949+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:09:50.086949+0000","last_undegraded":"2023-07-14T13:09:50.086949+0000","last_fullsized":"2023-07-14T13:09:50.086949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:54:06.189061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575055,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59208,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312632,"statfs":{"total":96636764160,"available":96576135168,"internally_reserved":0,"allocated":1966080,"data_stored":1278092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.70299999999999996,"15min":0.71699999999999997},"min":{"1min":0.46300000000000002,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.91100000000000003}]},{"osd":1,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72099999999999997,"15min":0.73699999999999999},"min":{"1min":0.47199999999999998,"5min":0.434,"15min":0.434},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.88},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72499999999999998,"15min":0.745},"min":{"1min":0.436,"5min":0.436,"15min":0.40500000000000003},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.95599999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.72999999999999998},"min":{"1min":0.51900000000000002,"5min":0.46999999999999997,"15min":0.42699999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72499999999999998,"15min":0.75},"min":{"1min":0.47999999999999998,"5min":0.47199999999999998,"15min":0.46899999999999997},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.93300000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72499999999999998,"15min":0.73599999999999999},"min":{"1min":0.57999999999999996,"5min":0.503,"15min":0.46400000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72999999999999998,"15min":0.75600000000000001},"min":{"1min":0.47899999999999998,"5min":0.47299999999999998,"15min":0.41499999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":1.01}]},{"osd":4,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55400000000000005,"15min":0.58099999999999996},"min":{"1min":0.44,"5min":0.318,"15min":0.318},"max":{"1min":0.74299999999999999,"5min":0.86299999999999999,"15min":1.022},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58899999999999997,"15min":0.60299999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.39300000000000002},"max":{"1min":0.84399999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.754}]},{"osd":5,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98299999999999998},"last":0.629},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.628,"15min":0.65300000000000002},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82899999999999996,"5min":1.028,"15min":1.028},"last":0.59999999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.67300000000000004,"15min":0.69599999999999995},"min":{"1min":0.499,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89800000000000002,"5min":0.99299999999999999,"15min":1.0600000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64100000000000001,"15min":0.66900000000000004},"min":{"1min":0.46200000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81399999999999995,"5min":0.95799999999999996,"15min":1.04},"last":0.65900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575056,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1384448,"data_stored":689836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.48399999999999999,"5min":0.39500000000000002,"15min":0.38},"max":{"1min":0.874,"5min":0.96499999999999997,"15min":1.05},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.71299999999999997,"15min":0.73699999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.47399999999999998},"max":{"1min":0.86499999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.77700000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71699999999999997,"15min":0.745},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.379},"max":{"1min":0.81499999999999995,"5min":0.97199999999999998,"15min":1.0209999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69699999999999995,"15min":0.72299999999999998},"min":{"1min":0.55900000000000005,"5min":0.46999999999999997,"15min":0.44},"max":{"1min":0.85199999999999998,"5min":0.97099999999999997,"15min":1.077},"last":0.65600000000000003}]},{"osd":2,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73899999999999999,"15min":0.752},"min":{"1min":0.55500000000000005,"5min":0.45900000000000002,"15min":0.40400000000000003},"max":{"1min":0.89700000000000002,"5min":0.95099999999999996,"15min":1.105},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.73599999999999999,"15min":0.751},"min":{"1min":0.441,"5min":0.441,"15min":0.42299999999999999},"max":{"1min":0.89500000000000002,"5min":0.99099999999999999,"15min":1.0900000000000001},"last":0.71799999999999997}]},{"osd":3,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.748,"15min":0.77500000000000002},"min":{"1min":0.46000000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.93999999999999995,"5min":1.054,"15min":1.1359999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74199999999999999,"15min":0.76300000000000001},"min":{"1min":0.50900000000000001,"5min":0.48399999999999999,"15min":0.45900000000000002},"max":{"1min":0.94599999999999995,"5min":0.99099999999999999,"15min":1.1080000000000001},"last":0.68799999999999994}]},{"osd":4,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56399999999999995,"15min":0.57299999999999995},"min":{"1min":0.39900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.83299999999999996,"5min":0.89900000000000002,"15min":0.97899999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.439,"5min":0.38500000000000001,"15min":0.36099999999999999},"max":{"1min":0.87,"5min":1.012,"15min":1.0780000000000001},"last":0.53200000000000003}]},{"osd":5,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.48699999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.88100000000000001,"5min":1.579,"15min":1.579},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67900000000000005,"15min":0.68999999999999995},"min":{"1min":0.46300000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90100000000000002,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.48699999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64400000000000002,"15min":0.65700000000000003},"min":{"1min":0.44700000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86399999999999999,"5min":1.0940000000000001,"15min":1.1200000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69599999999999995,"15min":0.70799999999999996},"min":{"1min":0.53400000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.92400000000000004,"5min":1.657,"15min":1.657},"last":0.57199999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575055,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46332,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":44992,"kb_avail":94325508,"statfs":{"total":96636764160,"available":96589320192,"internally_reserved":0,"allocated":1363968,"data_stored":687668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46071808},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.70799999999999996,"15min":0.73099999999999998},"min":{"1min":0.376,"5min":0.36499999999999999,"15min":0.32400000000000001},"max":{"1min":0.91500000000000004,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68799999999999994,"15min":0.73299999999999998},"min":{"1min":0.41699999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.86099999999999999,"5min":1.083,"15min":1.083},"last":0.61099999999999999}]},{"osd":1,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69899999999999995,"15min":0.72699999999999998},"min":{"1min":0.46899999999999997,"5min":0.44500000000000001,"15min":0.41099999999999998},"max":{"1min":0.85199999999999998,"5min":1.05,"15min":1.079},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73299999999999998,"15min":0.747},"min":{"1min":0.48999999999999999,"5min":0.48699999999999999,"15min":0.36799999999999999},"max":{"1min":0.94599999999999995,"5min":2.706,"15min":2.706},"last":0.72999999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71299999999999997,"15min":0.73899999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86299999999999999,"5min":1.212,"15min":1.212},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.70499999999999996,"15min":0.73499999999999999},"min":{"1min":0.44800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89200000000000002,"5min":1.181,"15min":1.181},"last":0.58599999999999997}]},{"osd":3,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73299999999999998,"15min":0.748},"min":{"1min":0.48599999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.876,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.628},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72799999999999998,"15min":0.76000000000000001},"min":{"1min":0.47299999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90800000000000003,"5min":1.304,"15min":1.304},"last":0.71799999999999997}]},{"osd":4,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64000000000000001,"15min":0.629},"min":{"1min":0.437,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.85399999999999998,"5min":1.129,"15min":1.129},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.39900000000000002,"5min":0.36299999999999999,"15min":0.35899999999999999},"max":{"1min":0.84499999999999997,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.75700000000000001}]},{"osd":6,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.60399999999999998,"15min":0.61399999999999999},"min":{"1min":0.41999999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90200000000000002,"5min":1.169,"15min":1.169},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.64400000000000002,"15min":0.64100000000000001},"min":{"1min":0.39400000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.83699999999999997,"5min":1.238,"15min":1.238},"last":0.69899999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66100000000000003,"15min":0.64300000000000002},"min":{"1min":0.45500000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93300000000000005,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68200000000000005,"15min":0.67800000000000005},"min":{"1min":0.48999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90100000000000002,"5min":1.407,"15min":1.407},"last":0.66200000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575055,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1372160,"data_stored":687828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.70899999999999996,"15min":0.72999999999999998},"min":{"1min":0.36899999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.90800000000000003,"5min":1.0129999999999999,"15min":1.411},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.435},"max":{"1min":0.85199999999999998,"5min":1.0640000000000001,"15min":1.1200000000000001},"last":0.746}]},{"osd":1,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.748,"15min":0.749},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92500000000000004,"5min":0.94699999999999995,"15min":1.077},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70999999999999996,"15min":0.73599999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89600000000000002,"5min":0.96399999999999997,"15min":1.0469999999999999},"last":0.77100000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.51800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91000000000000003,"5min":0.96499999999999997,"15min":1.091},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.76900000000000002,"15min":0.77400000000000002},"min":{"1min":0.46400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98099999999999998,"5min":1.0649999999999999,"15min":1.387},"last":0.623}]},{"osd":3,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.72999999999999998,"15min":0.746},"min":{"1min":0.53200000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.94699999999999995,"5min":0.997,"15min":1.008},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.75800000000000001,"15min":0.77100000000000002},"min":{"1min":0.504,"5min":0.496,"15min":0.46800000000000003},"max":{"1min":0.875,"5min":1.024,"15min":1.0589999999999999},"last":0.73099999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61899999999999999,"15min":0.60499999999999998},"min":{"1min":0.49299999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.85299999999999998,"5min":0.95599999999999996,"15min":1.0029999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63300000000000001,"15min":0.61799999999999999},"min":{"1min":0.45900000000000002,"5min":0.41399999999999998,"15min":0.34599999999999997},"max":{"1min":0.93200000000000005,"5min":0.93600000000000005,"15min":0.95199999999999996},"last":0.84099999999999997}]},{"osd":6,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.32300000000000001},"max":{"1min":0.96999999999999997,"5min":1.014,"15min":1.014},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68300000000000005,"15min":0.66900000000000004},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.374},"max":{"1min":0.86899999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.71499999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68899999999999995,"15min":0.66900000000000004},"min":{"1min":0.503,"5min":0.46000000000000002,"15min":0.39000000000000001},"max":{"1min":0.89400000000000002,"5min":0.94699999999999995,"15min":1.0349999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70999999999999996,"15min":0.69499999999999995},"min":{"1min":0.42799999999999999,"5min":0.40300000000000002,"15min":0.36899999999999999},"max":{"1min":0.91800000000000004,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.78500000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575055,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36476,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335364,"statfs":{"total":96636764160,"available":96599412736,"internally_reserved":0,"allocated":1363968,"data_stored":687668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.26200000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.84199999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.498,"15min":0.51500000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.60799999999999998,"5min":0.77300000000000002,"15min":1.0209999999999999},"last":0.61599999999999999}]},{"osd":1,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47199999999999998,"15min":0.47499999999999998},"min":{"1min":0.33100000000000002,"5min":0.315,"15min":0.29599999999999999},"max":{"1min":0.63900000000000001,"5min":0.77200000000000002,"15min":0.79600000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67800000000000005,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.56399999999999995}]},{"osd":2,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54100000000000004,"15min":0.56999999999999995},"min":{"1min":0.38200000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.72399999999999998,"5min":0.82599999999999996,"15min":0.95899999999999996},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60699999999999998,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86599999999999999,"5min":1.663,"15min":1.663},"last":0.64600000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.748,"15min":0.76500000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":0.90900000000000003,"5min":1.284,"15min":1.284},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76800000000000002,"15min":0.78900000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.47699999999999998},"max":{"1min":1.0660000000000001,"5min":1.121,"15min":1.196},"last":0.88100000000000001}]},{"osd":5,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.52400000000000002},"max":{"1min":1.0229999999999999,"5min":1.306,"15min":1.306},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77900000000000003,"15min":0.79100000000000004},"min":{"1min":0.58099999999999996,"5min":0.372,"15min":0.372},"max":{"1min":0.97399999999999998,"5min":1.1870000000000001,"15min":1.2470000000000001},"last":0.71299999999999997}]},{"osd":6,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.76800000000000002,"15min":0.78000000000000003},"min":{"1min":0.50600000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96599999999999997,"5min":1.105,"15min":1.117},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.79700000000000004,"15min":0.81799999999999995},"min":{"1min":0.56299999999999994,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.93999999999999995,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.82999999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.83299999999999996,"15min":0.84099999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53100000000000003},"max":{"1min":0.89900000000000002,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.53500000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0009999999999999,"5min":1.595,"15min":1.595},"last":0.75}]}]},{"osd":2,"up_from":13,"seq":55834575055,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58616,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313224,"statfs":{"total":96636764160,"available":96576741376,"internally_reserved":0,"allocated":1359872,"data_stored":686649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45900000000000002,"15min":0.46800000000000003},"min":{"1min":0.29199999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.84699999999999998,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.443},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.54200000000000004,"15min":0.53300000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.70799999999999996,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.49199999999999999}]},{"osd":1,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.48299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30399999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65500000000000003,"5min":2.7200000000000002,"15min":2.7200000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.55000000000000004,"15min":0.56299999999999994},"min":{"1min":0.36299999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78300000000000003,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":0.42299999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.64500000000000002,"15min":0.60399999999999998},"min":{"1min":0.39500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71699999999999997,"5min":8.2530000000000001,"15min":8.2530000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89600000000000002,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.50700000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.754,"15min":0.78100000000000003},"min":{"1min":0.53200000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.99399999999999999,"5min":1.0940000000000001,"15min":1.1499999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.56699999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0629999999999999,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.57299999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.84399999999999997,"15min":0.85799999999999998},"min":{"1min":0.58599999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1319999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82499999999999996,"15min":0.83999999999999997},"min":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.433},"max":{"1min":1.153,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.74099999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.78700000000000003,"15min":0.80400000000000005},"min":{"1min":0.57299999999999995,"5min":0.48999999999999999,"15min":0.47599999999999998},"max":{"1min":0.93999999999999995,"5min":3.9849999999999999,"15min":3.9849999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80200000000000005,"15min":0.81299999999999994},"min":{"1min":0.60699999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0289999999999999,"5min":3.391,"15min":3.391},"last":0.67900000000000005}]},{"osd":7,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.79600000000000004,"15min":0.82199999999999995},"min":{"1min":0.55000000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.1759999999999999,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.81499999999999995,"15min":0.82299999999999995},"min":{"1min":0.60199999999999998,"5min":0.53200000000000003,"15min":0.50900000000000001},"max":{"1min":1.0940000000000001,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.629}]}]},{"osd":1,"up_from":13,"seq":55834575056,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36480,"kb_used_data":1336,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335360,"statfs":{"total":96636764160,"available":96599408640,"internally_reserved":0,"allocated":1368064,"data_stored":687738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.29199999999999998,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.53700000000000003,"5min":0.65400000000000003,"15min":0.77200000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.28199999999999997,"15min":0.26500000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.38100000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47199999999999998,"15min":0.47299999999999998},"min":{"1min":0.34300000000000003,"5min":0.32100000000000001,"15min":0.29499999999999998},"max":{"1min":0.54200000000000004,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65100000000000002,"5min":1.014,"15min":1.014},"last":0.45000000000000001}]},{"osd":3,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.621,"15min":0.63600000000000001},"min":{"1min":0.48199999999999998,"5min":0.44700000000000001,"15min":0.437},"max":{"1min":0.73899999999999999,"5min":0.80500000000000005,"15min":0.96299999999999997},"last":0.5},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56499999999999995,"15min":0.57999999999999996},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.433}]},{"osd":4,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77700000000000002,"15min":0.78400000000000003},"min":{"1min":0.55500000000000005,"5min":0.51600000000000001,"15min":0.40000000000000002},"max":{"1min":1.0409999999999999,"5min":1.2110000000000001,"15min":1.236},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77200000000000002,"15min":0.78600000000000003},"min":{"1min":0.57499999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.0309999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.81000000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.60799999999999998,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.55800000000000005,"5min":0.48599999999999999,"15min":0.48199999999999998},"max":{"1min":1.0940000000000001,"5min":1.2749999999999999,"15min":1.3600000000000001},"last":0.751}]},{"osd":6,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.53800000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1.0580000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.80500000000000005,"15min":0.81399999999999995},"min":{"1min":0.56100000000000005,"5min":0.52200000000000002,"15min":0.49199999999999999},"max":{"1min":1.1319999999999999,"5min":1.262,"15min":1.2969999999999999},"last":0.79100000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.47799999999999998},"max":{"1min":1.1479999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.82099999999999995,"15min":0.84099999999999997},"min":{"1min":0.58499999999999996,"5min":0.53700000000000003,"15min":0.52800000000000002},"max":{"1min":1.2070000000000001,"5min":1.327,"15min":1.327},"last":0.72499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575057,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37076,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334764,"statfs":{"total":96636764160,"available":96598798336,"internally_reserved":0,"allocated":1978368,"data_stored":1279287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.45600000000000002,"15min":0.44700000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.61199999999999999,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.49099999999999999,"15min":0.51500000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.27700000000000002},"max":{"1min":0.61799999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.51900000000000002,"15min":0.51100000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69699999999999995,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.54000000000000004,"15min":0.55300000000000005},"min":{"1min":0.39800000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63800000000000001,"5min":0.80300000000000005,"15min":0.90300000000000002},"last":0.45400000000000001}]},{"osd":3,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.504},"min":{"1min":0.36399999999999999,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.67600000000000005,"5min":0.72999999999999998,"15min":0.84999999999999998},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82899999999999996,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.438}]},{"osd":4,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76900000000000002,"15min":0.78800000000000003},"min":{"1min":0.56100000000000005,"5min":0.48399999999999999,"15min":0.44400000000000001},"max":{"1min":0.90500000000000003,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.53500000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.038,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.59399999999999997}]},{"osd":5,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.77100000000000002,"15min":0.80600000000000005},"min":{"1min":0.55100000000000005,"5min":0.51800000000000002,"15min":0.47899999999999998},"max":{"1min":0.80500000000000005,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.56399999999999995,"5min":0.49299999999999999,"15min":0.47299999999999998},"max":{"1min":0.97299999999999998,"5min":1.325,"15min":1.325},"last":0.55500000000000005}]},{"osd":6,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.79100000000000004,"15min":0.80600000000000005},"min":{"1min":0.53500000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91400000000000003,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78900000000000003,"15min":0.81499999999999995},"min":{"1min":0.58399999999999996,"5min":0.55500000000000005,"15min":0.41299999999999998},"max":{"1min":1.0900000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.65900000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.79800000000000004,"15min":0.83199999999999996},"min":{"1min":0.57699999999999996,"5min":0.503,"15min":0.45500000000000002},"max":{"1min":0.93799999999999994,"5min":1.171,"15min":1.2749999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.77100000000000002,"15min":0.81100000000000005},"min":{"1min":0.50600000000000001,"5min":0.502,"15min":0.497},"max":{"1min":0.95199999999999996,"5min":1.381,"15min":1.381},"last":0.58499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:09:57.484 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:09:57.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.610+0000 7fd24c418640 1 Processor -- start 2023-07-14T13:09:57.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.610+0000 7fd24c418640 1 -- start start 2023-07-14T13:09:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.610+0000 7fd24c418640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2440b1e60 0x7fd24406e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.610+0000 7fd24c418640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd24406e6a0 con 0x7fd24406c430 2023-07-14T13:09:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.610+0000 7fd24c418640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2440b2280 con 0x7fd2440ae1f0 2023-07-14T13:09:57.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.610+0000 7fd24c418640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2440b24f0 con 0x7fd2440b1e60 2023-07-14T13:09:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.614+0000 7fd2499b3640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd24406c430 0x7fd244069430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56726/0 (socket says 172.21.15.5:56726) 2023-07-14T13:09:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.614+0000 7fd2499b3640 1 -- 172.21.15.5:0/1529316130 learned_addr learned my addr 172.21.15.5:0/1529316130 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:57.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.614+0000 7fd24a9b5640 1 --2- 172.21.15.5:0/1529316130 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2440b1e60 0x7fd24406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.614+0000 7fd2491b2640 1 -- 172.21.15.5:0/1529316130 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 314713571 0 0) 0x7fd234001120 con 0x7fd24406c430 2023-07-14T13:09:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.614+0000 7fd2491b2640 1 -- 172.21.15.5:0/1529316130 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd230003530 con 0x7fd24406c430 2023-07-14T13:09:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.614+0000 7fd2491b2640 1 -- 172.21.15.5:0/1529316130 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2376901616 0 0) 0x7fd2440b2280 con 0x7fd2440ae1f0 2023-07-14T13:09:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.614+0000 7fd2491b2640 1 -- 172.21.15.5:0/1529316130 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd234001120 con 0x7fd2440ae1f0 2023-07-14T13:09:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.614+0000 7fd24a9b5640 1 -- 172.21.15.5:0/1529316130 >> v1:172.21.15.154:6789/0 conn(0x7fd2440ae1f0 legacy=0x7fd24406bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:57.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.614+0000 7fd24a9b5640 1 -- 172.21.15.5:0/1529316130 >> v1:172.21.15.5:6789/0 conn(0x7fd24406c430 legacy=0x7fd244069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.614+0000 7fd24a9b5640 1 -- 172.21.15.5:0/1529316130 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2440b27d0 con 0x7fd2440b1e60 2023-07-14T13:09:57.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.614+0000 7fd24a9b5640 1 --2- 172.21.15.5:0/1529316130 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2440b1e60 0x7fd24406e160 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd23c009dc0 tx=0x7fd23c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbfb534f724b9816 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:57.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.618+0000 7fd2491b2640 1 -- 172.21.15.5:0/1529316130 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c0a5a00 con 0x7fd2440b1e60 2023-07-14T13:09:57.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.618+0000 7fd2491b2640 1 -- 172.21.15.5:0/1529316130 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c0a5b60 con 0x7fd2440b1e60 2023-07-14T13:09:57.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.618+0000 7fd2491b2640 1 -- 172.21.15.5:0/1529316130 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c0ad440 con 0x7fd2440b1e60 2023-07-14T13:09:57.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.618+0000 7fd24c418640 1 -- 172.21.15.5:0/1529316130 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2440b1e60 msgr2=0x7fd24406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:57.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.618+0000 7fd24c418640 1 --2- 172.21.15.5:0/1529316130 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2440b1e60 0x7fd24406e160 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd23c009dc0 tx=0x7fd23c01c940 comp rx=0 tx=0).stop 2023-07-14T13:09:57.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.618+0000 7fd24c418640 1 -- 172.21.15.5:0/1529316130 shutdown_connections 2023-07-14T13:09:57.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.618+0000 7fd24c418640 1 --2- 172.21.15.5:0/1529316130 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2440b1e60 0x7fd24406e160 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.618+0000 7fd24c418640 1 -- 172.21.15.5:0/1529316130 >> 172.21.15.5:0/1529316130 conn(0x7fd2440b1300 msgr2=0x7fd2440ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.618+0000 7fd24c418640 1 -- 172.21.15.5:0/1529316130 shutdown_connections 2023-07-14T13:09:57.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.618+0000 7fd24c418640 1 -- 172.21.15.5:0/1529316130 wait complete. 2023-07-14T13:09:57.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.618+0000 7fd24c418640 1 Processor -- start 2023-07-14T13:09:57.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.618+0000 7fd24c418640 1 -- start start 2023-07-14T13:09:57.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.622+0000 7fd24c418640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd24406c430 0x7fd24413bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:57.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.622+0000 7fd24c418640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2440ae1f0 0x7fd24415b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:57.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.622+0000 7fd24c418640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2440b1e60 0x7fd2440cb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:57.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.622+0000 7fd24c418640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24413cdf0 con 0x7fd24406c430 2023-07-14T13:09:57.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.622+0000 7fd24c418640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24413c270 con 0x7fd2440b1e60 2023-07-14T13:09:57.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.622+0000 7fd24c418640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24413c550 con 0x7fd2440ae1f0 2023-07-14T13:09:57.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.622+0000 7fd24a1b4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd24406c430 0x7fd24413bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:57.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.622+0000 7fd24a1b4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd24406c430 0x7fd24413bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35048/0 (socket says 172.21.15.5:35048) 2023-07-14T13:09:57.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.622+0000 7fd24a1b4640 1 -- 172.21.15.5:0/3249929660 learned_addr learned my addr 172.21.15.5:0/3249929660 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:57.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.622+0000 7fd24a9b5640 1 --2- 172.21.15.5:0/3249929660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2440b1e60 0x7fd2440cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:57.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.622+0000 7fd2499b3640 1 --2- 172.21.15.5:0/3249929660 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2440ae1f0 0x7fd24415b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:57.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.622+0000 7fd24a1b4640 1 -- 172.21.15.5:0/3249929660 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2440ae1f0 msgr2=0x7fd24415b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:57.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.622+0000 7fd24a1b4640 1 --2- 172.21.15.5:0/3249929660 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2440ae1f0 0x7fd24415b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:57.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.622+0000 7fd24a1b4640 1 -- 172.21.15.5:0/3249929660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2440b1e60 msgr2=0x7fd2440cb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:57.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.622+0000 7fd24a1b4640 1 --2- 172.21.15.5:0/3249929660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2440b1e60 0x7fd2440cb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:57.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.622+0000 7fd24a1b4640 1 -- 172.21.15.5:0/3249929660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c009a70 con 0x7fd24406c430 2023-07-14T13:09:57.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.622+0000 7fd24a1b4640 1 --2- 172.21.15.5:0/3249929660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd24406c430 0x7fd24413bc00 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fd24000c490 tx=0x7fd24000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:57.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.622+0000 7fd23affd640 1 -- 172.21.15.5:0/3249929660 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2400052d0 con 0x7fd24406c430 2023-07-14T13:09:57.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.622+0000 7fd23affd640 1 -- 172.21.15.5:0/3249929660 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd240005430 con 0x7fd24406c430 2023-07-14T13:09:57.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.622+0000 7fd23affd640 1 -- 172.21.15.5:0/3249929660 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd240012870 con 0x7fd24406c430 2023-07-14T13:09:57.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.622+0000 7fd24c418640 1 -- 172.21.15.5:0/3249929660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2440b3710 con 0x7fd24406c430 2023-07-14T13:09:57.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.622+0000 7fd24c418640 1 -- 172.21.15.5:0/3249929660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24413cb10 con 0x7fd24406c430 2023-07-14T13:09:57.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.622+0000 7fd24c418640 1 -- 172.21.15.5:0/3249929660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2440678d0 con 0x7fd24406c430 2023-07-14T13:09:57.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.622+0000 7fd23affd640 1 -- 172.21.15.5:0/3249929660 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd2400129d0 con 0x7fd24406c430 2023-07-14T13:09:57.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.626+0000 7fd23affd640 1 --2- 172.21.15.5:0/3249929660 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fd2280663a0 0x7fd228068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:57.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.626+0000 7fd23affd640 1 -- 172.21.15.5:0/3249929660 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd240083910 con 0x7fd24406c430 2023-07-14T13:09:57.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.626+0000 7fd2499b3640 1 --2- 172.21.15.5:0/3249929660 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fd2280663a0 0x7fd228068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:57.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.626+0000 7fd2499b3640 1 --2- 172.21.15.5:0/3249929660 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fd2280663a0 0x7fd228068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd244144b60 tx=0x7fd234007d40 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:57.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.630+0000 7fd23affd640 1 -- 172.21.15.5:0/3249929660 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd240050d20 con 0x7fd24406c430 2023-07-14T13:09:57.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.782+0000 7fd24c418640 1 -- 172.21.15.5:0/3249929660 --> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2440b3590 con 0x7fd2280663a0 2023-07-14T13:09:57.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.790+0000 7fd23affd640 1 -- 172.21.15.5:0/3249929660 <== mgr.7156 v2:172.21.15.154:6832/1525189184 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311732 (secure 0 0 0) 0x7fd234005860 con 0x7fd2280663a0 2023-07-14T13:09:57.823 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:57.825 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:09:57.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.794+0000 7fd24c418640 1 -- 172.21.15.5:0/3249929660 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fd2280663a0 msgr2=0x7fd228068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:57.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.794+0000 7fd24c418640 1 --2- 172.21.15.5:0/3249929660 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fd2280663a0 0x7fd228068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd244144b60 tx=0x7fd234007d40 comp rx=0 tx=0).stop 2023-07-14T13:09:57.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.794+0000 7fd24c418640 1 -- 172.21.15.5:0/3249929660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd24406c430 msgr2=0x7fd24413bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:57.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.794+0000 7fd24c418640 1 --2- 172.21.15.5:0/3249929660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd24406c430 0x7fd24413bc00 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fd24000c490 tx=0x7fd24000c950 comp rx=0 tx=0).stop 2023-07-14T13:09:57.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.794+0000 7fd24c418640 1 -- 172.21.15.5:0/3249929660 shutdown_connections 2023-07-14T13:09:57.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.794+0000 7fd24c418640 1 --2- 172.21.15.5:0/3249929660 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fd2280663a0 0x7fd228068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:57.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.794+0000 7fd24c418640 1 --2- 172.21.15.5:0/3249929660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2440b1e60 0x7fd2440cb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:57.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.794+0000 7fd24c418640 1 --2- 172.21.15.5:0/3249929660 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2440ae1f0 0x7fd24415b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:57.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.794+0000 7fd24c418640 1 --2- 172.21.15.5:0/3249929660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd24406c430 0x7fd24413bc00 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:57.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.794+0000 7fd24c418640 1 -- 172.21.15.5:0/3249929660 >> 172.21.15.5:0/3249929660 conn(0x7fd2440b1300 msgr2=0x7fd244069430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:57.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.794+0000 7fd24c418640 1 -- 172.21.15.5:0/3249929660 shutdown_connections 2023-07-14T13:09:57.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:57.794+0000 7fd24c418640 1 -- 172.21.15.5:0/3249929660 wait complete. 2023-07-14T13:09:57.844 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-14T13:09:56.067249+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":364,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":244,"ondisk_log_size":244,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":205,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":338976,"kb_used_data":11872,"kb_used_omap":0,"kb_used_meta":327040,"kb_avail":754635744,"statfs":{"total":773094113280,"available":772747001856,"internally_reserved":0,"allocated":12156928,"data_stored":6684766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":334888960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002141"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.758625+0000","last_change":"2023-07-14T13:09:48.784275+0000","last_active":"2023-07-14T13:09:49.758625+0000","last_peered":"2023-07-14T13:09:49.758625+0000","last_clean":"2023-07-14T13:09:49.758625+0000","last_became_active":"2023-07-14T13:09:48.783987+0000","last_became_peered":"2023-07-14T13:09:48.783987+0000","last_unstale":"2023-07-14T13:09:49.758625+0000","last_undegraded":"2023-07-14T13:09:49.758625+0000","last_fullsized":"2023-07-14T13:09:49.758625+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:18:03.038444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.583134+0000","last_change":"2023-07-14T13:09:48.787925+0000","last_active":"2023-07-14T13:09:50.583134+0000","last_peered":"2023-07-14T13:09:50.583134+0000","last_clean":"2023-07-14T13:09:50.583134+0000","last_became_active":"2023-07-14T13:09:48.787625+0000","last_became_peered":"2023-07-14T13:09:48.787625+0000","last_unstale":"2023-07-14T13:09:50.583134+0000","last_undegraded":"2023-07-14T13:09:50.583134+0000","last_fullsized":"2023-07-14T13:09:50.583134+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:54:00.081069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.758409+0000","last_change":"2023-07-14T13:09:48.782448+0000","last_active":"2023-07-14T13:09:49.758409+0000","last_peered":"2023-07-14T13:09:49.758409+0000","last_clean":"2023-07-14T13:09:49.758409+0000","last_became_active":"2023-07-14T13:09:48.782173+0000","last_became_peered":"2023-07-14T13:09:48.782173+0000","last_unstale":"2023-07-14T13:09:49.758409+0000","last_undegraded":"2023-07-14T13:09:49.758409+0000","last_fullsized":"2023-07-14T13:09:49.758409+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:12:47.477769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581874+0000","last_change":"2023-07-14T13:09:48.792550+0000","last_active":"2023-07-14T13:09:50.581874+0000","last_peered":"2023-07-14T13:09:50.581874+0000","last_clean":"2023-07-14T13:09:50.581874+0000","last_became_active":"2023-07-14T13:09:48.792248+0000","last_became_peered":"2023-07-14T13:09:48.792248+0000","last_unstale":"2023-07-14T13:09:50.581874+0000","last_undegraded":"2023-07-14T13:09:50.581874+0000","last_fullsized":"2023-07-14T13:09:50.581874+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:36:45.780154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762411+0000","last_change":"2023-07-14T13:09:48.773918+0000","last_active":"2023-07-14T13:09:49.762411+0000","last_peered":"2023-07-14T13:09:49.762411+0000","last_clean":"2023-07-14T13:09:49.762411+0000","last_became_active":"2023-07-14T13:09:48.773628+0000","last_became_peered":"2023-07-14T13:09:48.773628+0000","last_unstale":"2023-07-14T13:09:49.762411+0000","last_undegraded":"2023-07-14T13:09:49.762411+0000","last_fullsized":"2023-07-14T13:09:49.762411+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:12:01.392694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581540+0000","last_change":"2023-07-14T13:09:48.794164+0000","last_active":"2023-07-14T13:09:50.581540+0000","last_peered":"2023-07-14T13:09:50.581540+0000","last_clean":"2023-07-14T13:09:50.581540+0000","last_became_active":"2023-07-14T13:09:48.793829+0000","last_became_peered":"2023-07-14T13:09:48.793829+0000","last_unstale":"2023-07-14T13:09:50.581540+0000","last_undegraded":"2023-07-14T13:09:50.581540+0000","last_fullsized":"2023-07-14T13:09:50.581540+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:56:15.385891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.958738+0000","last_change":"2023-07-14T13:09:48.778739+0000","last_active":"2023-07-14T13:09:49.958738+0000","last_peered":"2023-07-14T13:09:49.958738+0000","last_clean":"2023-07-14T13:09:49.958738+0000","last_became_active":"2023-07-14T13:09:48.778417+0000","last_became_peered":"2023-07-14T13:09:48.778417+0000","last_unstale":"2023-07-14T13:09:49.958738+0000","last_undegraded":"2023-07-14T13:09:49.958738+0000","last_fullsized":"2023-07-14T13:09:49.958738+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:05:23.353389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582708+0000","last_change":"2023-07-14T13:09:48.794588+0000","last_active":"2023-07-14T13:09:50.582708+0000","last_peered":"2023-07-14T13:09:50.582708+0000","last_clean":"2023-07-14T13:09:50.582708+0000","last_became_active":"2023-07-14T13:09:48.794324+0000","last_became_peered":"2023-07-14T13:09:48.794324+0000","last_unstale":"2023-07-14T13:09:50.582708+0000","last_undegraded":"2023-07-14T13:09:50.582708+0000","last_fullsized":"2023-07-14T13:09:50.582708+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:13:36.045798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762797+0000","last_change":"2023-07-14T13:09:48.776355+0000","last_active":"2023-07-14T13:09:49.762797+0000","last_peered":"2023-07-14T13:09:49.762797+0000","last_clean":"2023-07-14T13:09:49.762797+0000","last_became_active":"2023-07-14T13:09:48.776035+0000","last_became_peered":"2023-07-14T13:09:48.776035+0000","last_unstale":"2023-07-14T13:09:49.762797+0000","last_undegraded":"2023-07-14T13:09:49.762797+0000","last_fullsized":"2023-07-14T13:09:49.762797+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:39.039742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581609+0000","last_change":"2023-07-14T13:09:48.771015+0000","last_active":"2023-07-14T13:09:50.581609+0000","last_peered":"2023-07-14T13:09:50.581609+0000","last_clean":"2023-07-14T13:09:50.581609+0000","last_became_active":"2023-07-14T13:09:48.770724+0000","last_became_peered":"2023-07-14T13:09:48.770724+0000","last_unstale":"2023-07-14T13:09:50.581609+0000","last_undegraded":"2023-07-14T13:09:50.581609+0000","last_fullsized":"2023-07-14T13:09:50.581609+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:16:52.893256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762705+0000","last_change":"2023-07-14T13:09:48.783502+0000","last_active":"2023-07-14T13:09:49.762705+0000","last_peered":"2023-07-14T13:09:49.762705+0000","last_clean":"2023-07-14T13:09:49.762705+0000","last_became_active":"2023-07-14T13:09:48.783236+0000","last_became_peered":"2023-07-14T13:09:48.783236+0000","last_unstale":"2023-07-14T13:09:49.762705+0000","last_undegraded":"2023-07-14T13:09:49.762705+0000","last_fullsized":"2023-07-14T13:09:49.762705+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:25:49.324291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582130+0000","last_change":"2023-07-14T13:09:48.777167+0000","last_active":"2023-07-14T13:09:50.582130+0000","last_peered":"2023-07-14T13:09:50.582130+0000","last_clean":"2023-07-14T13:09:50.582130+0000","last_became_active":"2023-07-14T13:09:48.776885+0000","last_became_peered":"2023-07-14T13:09:48.776885+0000","last_unstale":"2023-07-14T13:09:50.582130+0000","last_undegraded":"2023-07-14T13:09:50.582130+0000","last_fullsized":"2023-07-14T13:09:50.582130+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:32:52.552945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.583203+0000","last_change":"2023-07-14T13:09:48.776256+0000","last_active":"2023-07-14T13:09:50.583203+0000","last_peered":"2023-07-14T13:09:50.583203+0000","last_clean":"2023-07-14T13:09:50.583203+0000","last_became_active":"2023-07-14T13:09:48.775593+0000","last_became_peered":"2023-07-14T13:09:48.775593+0000","last_unstale":"2023-07-14T13:09:50.583203+0000","last_undegraded":"2023-07-14T13:09:50.583203+0000","last_fullsized":"2023-07-14T13:09:50.583203+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:49:22.743116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762091+0000","last_change":"2023-07-14T13:09:48.802821+0000","last_active":"2023-07-14T13:09:49.762091+0000","last_peered":"2023-07-14T13:09:49.762091+0000","last_clean":"2023-07-14T13:09:49.762091+0000","last_became_active":"2023-07-14T13:09:48.802432+0000","last_became_peered":"2023-07-14T13:09:48.802432+0000","last_unstale":"2023-07-14T13:09:49.762091+0000","last_undegraded":"2023-07-14T13:09:49.762091+0000","last_fullsized":"2023-07-14T13:09:49.762091+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:08:21.399227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582900+0000","last_change":"2023-07-14T13:09:48.791650+0000","last_active":"2023-07-14T13:09:50.582900+0000","last_peered":"2023-07-14T13:09:50.582900+0000","last_clean":"2023-07-14T13:09:50.582900+0000","last_became_active":"2023-07-14T13:09:48.791346+0000","last_became_peered":"2023-07-14T13:09:48.791346+0000","last_unstale":"2023-07-14T13:09:50.582900+0000","last_undegraded":"2023-07-14T13:09:50.582900+0000","last_fullsized":"2023-07-14T13:09:50.582900+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:58.104393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581015+0000","last_change":"2023-07-14T13:09:48.785994+0000","last_active":"2023-07-14T13:09:50.581015+0000","last_peered":"2023-07-14T13:09:50.581015+0000","last_clean":"2023-07-14T13:09:50.581015+0000","last_became_active":"2023-07-14T13:09:48.785468+0000","last_became_peered":"2023-07-14T13:09:48.785468+0000","last_unstale":"2023-07-14T13:09:50.581015+0000","last_undegraded":"2023-07-14T13:09:50.581015+0000","last_fullsized":"2023-07-14T13:09:50.581015+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:49:59.475172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582690+0000","last_change":"2023-07-14T13:09:48.786307+0000","last_active":"2023-07-14T13:09:50.582690+0000","last_peered":"2023-07-14T13:09:50.582690+0000","last_clean":"2023-07-14T13:09:50.582690+0000","last_became_active":"2023-07-14T13:09:48.785645+0000","last_became_peered":"2023-07-14T13:09:48.785645+0000","last_unstale":"2023-07-14T13:09:50.582690+0000","last_undegraded":"2023-07-14T13:09:50.582690+0000","last_fullsized":"2023-07-14T13:09:50.582690+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:53:40.523638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.758463+0000","last_change":"2023-07-14T13:09:48.777219+0000","last_active":"2023-07-14T13:09:49.758463+0000","last_peered":"2023-07-14T13:09:49.758463+0000","last_clean":"2023-07-14T13:09:49.758463+0000","last_became_active":"2023-07-14T13:09:48.776941+0000","last_became_peered":"2023-07-14T13:09:48.776941+0000","last_unstale":"2023-07-14T13:09:49.758463+0000","last_undegraded":"2023-07-14T13:09:49.758463+0000","last_fullsized":"2023-07-14T13:09:49.758463+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:30:20.748921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762753+0000","last_change":"2023-07-14T13:09:48.801862+0000","last_active":"2023-07-14T13:09:49.762753+0000","last_peered":"2023-07-14T13:09:49.762753+0000","last_clean":"2023-07-14T13:09:49.762753+0000","last_became_active":"2023-07-14T13:09:48.801538+0000","last_became_peered":"2023-07-14T13:09:48.801538+0000","last_unstale":"2023-07-14T13:09:49.762753+0000","last_undegraded":"2023-07-14T13:09:49.762753+0000","last_fullsized":"2023-07-14T13:09:49.762753+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:40:22.663795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582036+0000","last_change":"2023-07-14T13:09:48.791978+0000","last_active":"2023-07-14T13:09:50.582036+0000","last_peered":"2023-07-14T13:09:50.582036+0000","last_clean":"2023-07-14T13:09:50.582036+0000","last_became_active":"2023-07-14T13:09:48.791665+0000","last_became_peered":"2023-07-14T13:09:48.791665+0000","last_unstale":"2023-07-14T13:09:50.582036+0000","last_undegraded":"2023-07-14T13:09:50.582036+0000","last_fullsized":"2023-07-14T13:09:50.582036+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:55:30.763694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762255+0000","last_change":"2023-07-14T13:09:48.774012+0000","last_active":"2023-07-14T13:09:49.762255+0000","last_peered":"2023-07-14T13:09:49.762255+0000","last_clean":"2023-07-14T13:09:49.762255+0000","last_became_active":"2023-07-14T13:09:48.773713+0000","last_became_peered":"2023-07-14T13:09:48.773713+0000","last_unstale":"2023-07-14T13:09:49.762255+0000","last_undegraded":"2023-07-14T13:09:49.762255+0000","last_fullsized":"2023-07-14T13:09:49.762255+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:14:21.866770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762117+0000","last_change":"2023-07-14T13:09:48.802506+0000","last_active":"2023-07-14T13:09:49.762117+0000","last_peered":"2023-07-14T13:09:49.762117+0000","last_clean":"2023-07-14T13:09:49.762117+0000","last_became_active":"2023-07-14T13:09:48.802228+0000","last_became_peered":"2023-07-14T13:09:48.802228+0000","last_unstale":"2023-07-14T13:09:49.762117+0000","last_undegraded":"2023-07-14T13:09:49.762117+0000","last_fullsized":"2023-07-14T13:09:49.762117+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:18:27.224711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.086605+0000","last_change":"2023-07-14T13:09:48.794977+0000","last_active":"2023-07-14T13:09:50.086605+0000","last_peered":"2023-07-14T13:09:50.086605+0000","last_clean":"2023-07-14T13:09:50.086605+0000","last_became_active":"2023-07-14T13:09:48.794620+0000","last_became_peered":"2023-07-14T13:09:48.794620+0000","last_unstale":"2023-07-14T13:09:50.086605+0000","last_undegraded":"2023-07-14T13:09:50.086605+0000","last_fullsized":"2023-07-14T13:09:50.086605+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:12:01.392694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.758195+0000","last_change":"2023-07-14T13:09:48.778311+0000","last_active":"2023-07-14T13:09:49.758195+0000","last_peered":"2023-07-14T13:09:49.758195+0000","last_clean":"2023-07-14T13:09:49.758195+0000","last_became_active":"2023-07-14T13:09:48.777977+0000","last_became_peered":"2023-07-14T13:09:48.777977+0000","last_unstale":"2023-07-14T13:09:49.758195+0000","last_undegraded":"2023-07-14T13:09:49.758195+0000","last_fullsized":"2023-07-14T13:09:49.758195+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:55:42.450588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.583225+0000","last_change":"2023-07-14T13:09:48.776693+0000","last_active":"2023-07-14T13:09:50.583225+0000","last_peered":"2023-07-14T13:09:50.583225+0000","last_clean":"2023-07-14T13:09:50.583225+0000","last_became_active":"2023-07-14T13:09:48.776376+0000","last_became_peered":"2023-07-14T13:09:48.776376+0000","last_unstale":"2023-07-14T13:09:50.583225+0000","last_undegraded":"2023-07-14T13:09:50.583225+0000","last_fullsized":"2023-07-14T13:09:50.583225+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:00:13.742014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762639+0000","last_change":"2023-07-14T13:09:48.802111+0000","last_active":"2023-07-14T13:09:49.762639+0000","last_peered":"2023-07-14T13:09:49.762639+0000","last_clean":"2023-07-14T13:09:49.762639+0000","last_became_active":"2023-07-14T13:09:48.801765+0000","last_became_peered":"2023-07-14T13:09:48.801765+0000","last_unstale":"2023-07-14T13:09:49.762639+0000","last_undegraded":"2023-07-14T13:09:49.762639+0000","last_fullsized":"2023-07-14T13:09:49.762639+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:49:19.089644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581866+0000","last_change":"2023-07-14T13:09:48.763602+0000","last_active":"2023-07-14T13:09:50.581866+0000","last_peered":"2023-07-14T13:09:50.581866+0000","last_clean":"2023-07-14T13:09:50.581866+0000","last_became_active":"2023-07-14T13:09:48.763137+0000","last_became_peered":"2023-07-14T13:09:48.763137+0000","last_unstale":"2023-07-14T13:09:50.581866+0000","last_undegraded":"2023-07-14T13:09:50.581866+0000","last_fullsized":"2023-07-14T13:09:50.581866+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:39:50.096294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582191+0000","last_change":"2023-07-14T13:09:48.779751+0000","last_active":"2023-07-14T13:09:50.582191+0000","last_peered":"2023-07-14T13:09:50.582191+0000","last_clean":"2023-07-14T13:09:50.582191+0000","last_became_active":"2023-07-14T13:09:48.779441+0000","last_became_peered":"2023-07-14T13:09:48.779441+0000","last_unstale":"2023-07-14T13:09:50.582191+0000","last_undegraded":"2023-07-14T13:09:50.582191+0000","last_fullsized":"2023-07-14T13:09:50.582191+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:41:35.741449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.958899+0000","last_change":"2023-07-14T13:09:48.775358+0000","last_active":"2023-07-14T13:09:49.958899+0000","last_peered":"2023-07-14T13:09:49.958899+0000","last_clean":"2023-07-14T13:09:49.958899+0000","last_became_active":"2023-07-14T13:09:48.775051+0000","last_became_peered":"2023-07-14T13:09:48.775051+0000","last_unstale":"2023-07-14T13:09:49.958899+0000","last_undegraded":"2023-07-14T13:09:49.958899+0000","last_fullsized":"2023-07-14T13:09:49.958899+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:57:28.629923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762304+0000","last_change":"2023-07-14T13:09:48.774375+0000","last_active":"2023-07-14T13:09:49.762304+0000","last_peered":"2023-07-14T13:09:49.762304+0000","last_clean":"2023-07-14T13:09:49.762304+0000","last_became_active":"2023-07-14T13:09:48.774084+0000","last_became_peered":"2023-07-14T13:09:48.774084+0000","last_unstale":"2023-07-14T13:09:49.762304+0000","last_undegraded":"2023-07-14T13:09:49.762304+0000","last_fullsized":"2023-07-14T13:09:49.762304+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:09:14.783526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582767+0000","last_change":"2023-07-14T13:09:48.795332+0000","last_active":"2023-07-14T13:09:50.582767+0000","last_peered":"2023-07-14T13:09:50.582767+0000","last_clean":"2023-07-14T13:09:50.582767+0000","last_became_active":"2023-07-14T13:09:48.795041+0000","last_became_peered":"2023-07-14T13:09:48.795041+0000","last_unstale":"2023-07-14T13:09:50.582767+0000","last_undegraded":"2023-07-14T13:09:50.582767+0000","last_fullsized":"2023-07-14T13:09:50.582767+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:52:51.614993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581182+0000","last_change":"2023-07-14T13:09:48.777860+0000","last_active":"2023-07-14T13:09:50.581182+0000","last_peered":"2023-07-14T13:09:50.581182+0000","last_clean":"2023-07-14T13:09:50.581182+0000","last_became_active":"2023-07-14T13:09:48.777564+0000","last_became_peered":"2023-07-14T13:09:48.777564+0000","last_unstale":"2023-07-14T13:09:50.581182+0000","last_undegraded":"2023-07-14T13:09:50.581182+0000","last_fullsized":"2023-07-14T13:09:50.581182+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:09:29.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582794+0000","last_change":"2023-07-14T13:09:48.781946+0000","last_active":"2023-07-14T13:09:50.582794+0000","last_peered":"2023-07-14T13:09:50.582794+0000","last_clean":"2023-07-14T13:09:50.582794+0000","last_became_active":"2023-07-14T13:09:48.781640+0000","last_became_peered":"2023-07-14T13:09:48.781640+0000","last_unstale":"2023-07-14T13:09:50.582794+0000","last_undegraded":"2023-07-14T13:09:50.582794+0000","last_fullsized":"2023-07-14T13:09:50.582794+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:26:44.800018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"110'4","reported_seq":17,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.086927+0000","last_change":"2023-07-14T13:09:47.780072+0000","last_active":"2023-07-14T13:09:50.086927+0000","last_peered":"2023-07-14T13:09:50.086927+0000","last_clean":"2023-07-14T13:09:50.086927+0000","last_became_active":"2023-07-14T13:09:47.779698+0000","last_became_peered":"2023-07-14T13:09:47.779698+0000","last_unstale":"2023-07-14T13:09:50.086927+0000","last_undegraded":"2023-07-14T13:09:50.086927+0000","last_fullsized":"2023-07-14T13:09:50.086927+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:25:16.698165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581462+0000","last_change":"2023-07-14T13:09:48.771406+0000","last_active":"2023-07-14T13:09:50.581462+0000","last_peered":"2023-07-14T13:09:50.581462+0000","last_clean":"2023-07-14T13:09:50.581462+0000","last_became_active":"2023-07-14T13:09:48.771108+0000","last_became_peered":"2023-07-14T13:09:48.771108+0000","last_unstale":"2023-07-14T13:09:50.581462+0000","last_undegraded":"2023-07-14T13:09:50.581462+0000","last_fullsized":"2023-07-14T13:09:50.581462+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:33:00.422067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"110'1","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762911+0000","last_change":"2023-07-14T13:09:47.771139+0000","last_active":"2023-07-14T13:09:49.762911+0000","last_peered":"2023-07-14T13:09:49.762911+0000","last_clean":"2023-07-14T13:09:49.762911+0000","last_became_active":"2023-07-14T13:09:47.770511+0000","last_became_peered":"2023-07-14T13:09:47.770511+0000","last_unstale":"2023-07-14T13:09:49.762911+0000","last_undegraded":"2023-07-14T13:09:49.762911+0000","last_fullsized":"2023-07-14T13:09:49.762911+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:12.913674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.958991+0000","last_change":"2023-07-14T13:09:48.802042+0000","last_active":"2023-07-14T13:09:49.958991+0000","last_peered":"2023-07-14T13:09:49.958991+0000","last_clean":"2023-07-14T13:09:49.958991+0000","last_became_active":"2023-07-14T13:09:48.801617+0000","last_became_peered":"2023-07-14T13:09:48.801617+0000","last_unstale":"2023-07-14T13:09:49.958991+0000","last_undegraded":"2023-07-14T13:09:49.958991+0000","last_fullsized":"2023-07-14T13:09:49.958991+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:57.759762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"110'2","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.959102+0000","last_change":"2023-07-14T13:09:47.774348+0000","last_active":"2023-07-14T13:09:49.959102+0000","last_peered":"2023-07-14T13:09:49.959102+0000","last_clean":"2023-07-14T13:09:49.959102+0000","last_became_active":"2023-07-14T13:09:47.773974+0000","last_became_peered":"2023-07-14T13:09:47.773974+0000","last_unstale":"2023-07-14T13:09:49.959102+0000","last_undegraded":"2023-07-14T13:09:49.959102+0000","last_fullsized":"2023-07-14T13:09:49.959102+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:35:30.868632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582834+0000","last_change":"2023-07-14T13:09:48.776120+0000","last_active":"2023-07-14T13:09:50.582834+0000","last_peered":"2023-07-14T13:09:50.582834+0000","last_clean":"2023-07-14T13:09:50.582834+0000","last_became_active":"2023-07-14T13:09:48.775837+0000","last_became_peered":"2023-07-14T13:09:48.775837+0000","last_unstale":"2023-07-14T13:09:50.582834+0000","last_undegraded":"2023-07-14T13:09:50.582834+0000","last_fullsized":"2023-07-14T13:09:50.582834+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:05:41.704582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"110'2","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.086888+0000","last_change":"2023-07-14T13:09:47.777290+0000","last_active":"2023-07-14T13:09:50.086888+0000","last_peered":"2023-07-14T13:09:50.086888+0000","last_clean":"2023-07-14T13:09:50.086888+0000","last_became_active":"2023-07-14T13:09:47.776922+0000","last_became_peered":"2023-07-14T13:09:47.776922+0000","last_unstale":"2023-07-14T13:09:50.086888+0000","last_undegraded":"2023-07-14T13:09:50.086888+0000","last_fullsized":"2023-07-14T13:09:50.086888+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:38.029849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582227+0000","last_change":"2023-07-14T13:09:48.796538+0000","last_active":"2023-07-14T13:09:50.582227+0000","last_peered":"2023-07-14T13:09:50.582227+0000","last_clean":"2023-07-14T13:09:50.582227+0000","last_became_active":"2023-07-14T13:09:48.796192+0000","last_became_peered":"2023-07-14T13:09:48.796192+0000","last_unstale":"2023-07-14T13:09:50.582227+0000","last_undegraded":"2023-07-14T13:09:50.582227+0000","last_fullsized":"2023-07-14T13:09:50.582227+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:23:39.740670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"110'1","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762414+0000","last_change":"2023-07-14T13:09:47.769784+0000","last_active":"2023-07-14T13:09:49.762414+0000","last_peered":"2023-07-14T13:09:49.762414+0000","last_clean":"2023-07-14T13:09:49.762414+0000","last_became_active":"2023-07-14T13:09:47.769454+0000","last_became_peered":"2023-07-14T13:09:47.769454+0000","last_unstale":"2023-07-14T13:09:49.762414+0000","last_undegraded":"2023-07-14T13:09:49.762414+0000","last_fullsized":"2023-07-14T13:09:49.762414+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:42:04.191703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.086589+0000","last_change":"2023-07-14T13:09:48.775838+0000","last_active":"2023-07-14T13:09:50.086589+0000","last_peered":"2023-07-14T13:09:50.086589+0000","last_clean":"2023-07-14T13:09:50.086589+0000","last_became_active":"2023-07-14T13:09:48.775476+0000","last_became_peered":"2023-07-14T13:09:48.775476+0000","last_unstale":"2023-07-14T13:09:50.086589+0000","last_undegraded":"2023-07-14T13:09:50.086589+0000","last_fullsized":"2023-07-14T13:09:50.086589+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:09:14.783526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"110'1","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.583471+0000","last_change":"2023-07-14T13:09:47.769513+0000","last_active":"2023-07-14T13:09:50.583471+0000","last_peered":"2023-07-14T13:09:50.583471+0000","last_clean":"2023-07-14T13:09:50.583471+0000","last_became_active":"2023-07-14T13:09:47.769181+0000","last_became_peered":"2023-07-14T13:09:47.769181+0000","last_unstale":"2023-07-14T13:09:50.583471+0000","last_undegraded":"2023-07-14T13:09:50.583471+0000","last_fullsized":"2023-07-14T13:09:50.583471+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:33:41.072287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581698+0000","last_change":"2023-07-14T13:09:48.794110+0000","last_active":"2023-07-14T13:09:50.581698+0000","last_peered":"2023-07-14T13:09:50.581698+0000","last_clean":"2023-07-14T13:09:50.581698+0000","last_became_active":"2023-07-14T13:09:48.793819+0000","last_became_peered":"2023-07-14T13:09:48.793819+0000","last_unstale":"2023-07-14T13:09:50.581698+0000","last_undegraded":"2023-07-14T13:09:50.581698+0000","last_fullsized":"2023-07-14T13:09:50.581698+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:47:01.387757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.758333+0000","last_change":"2023-07-14T13:09:47.773338+0000","last_active":"2023-07-14T13:09:49.758333+0000","last_peered":"2023-07-14T13:09:49.758333+0000","last_clean":"2023-07-14T13:09:49.758333+0000","last_became_active":"2023-07-14T13:09:47.773046+0000","last_became_peered":"2023-07-14T13:09:47.773046+0000","last_unstale":"2023-07-14T13:09:49.758333+0000","last_undegraded":"2023-07-14T13:09:49.758333+0000","last_fullsized":"2023-07-14T13:09:49.758333+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:36:56.805878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.583236+0000","last_change":"2023-07-14T13:09:48.776478+0000","last_active":"2023-07-14T13:09:50.583236+0000","last_peered":"2023-07-14T13:09:50.583236+0000","last_clean":"2023-07-14T13:09:50.583236+0000","last_became_active":"2023-07-14T13:09:48.775944+0000","last_became_peered":"2023-07-14T13:09:48.775944+0000","last_unstale":"2023-07-14T13:09:50.583236+0000","last_undegraded":"2023-07-14T13:09:50.583236+0000","last_fullsized":"2023-07-14T13:09:50.583236+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:31:06.339110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.958662+0000","last_change":"2023-07-14T13:09:47.780668+0000","last_active":"2023-07-14T13:09:49.958662+0000","last_peered":"2023-07-14T13:09:49.958662+0000","last_clean":"2023-07-14T13:09:49.958662+0000","last_became_active":"2023-07-14T13:09:47.780381+0000","last_became_peered":"2023-07-14T13:09:47.780381+0000","last_unstale":"2023-07-14T13:09:49.958662+0000","last_undegraded":"2023-07-14T13:09:49.958662+0000","last_fullsized":"2023-07-14T13:09:49.958662+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:43:47.346035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762475+0000","last_change":"2023-07-14T13:09:48.779428+0000","last_active":"2023-07-14T13:09:49.762475+0000","last_peered":"2023-07-14T13:09:49.762475+0000","last_clean":"2023-07-14T13:09:49.762475+0000","last_became_active":"2023-07-14T13:09:48.778511+0000","last_became_peered":"2023-07-14T13:09:48.778511+0000","last_unstale":"2023-07-14T13:09:49.762475+0000","last_undegraded":"2023-07-14T13:09:49.762475+0000","last_fullsized":"2023-07-14T13:09:49.762475+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:24:45.826580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.583351+0000","last_change":"2023-07-14T13:09:47.771140+0000","last_active":"2023-07-14T13:09:50.583351+0000","last_peered":"2023-07-14T13:09:50.583351+0000","last_clean":"2023-07-14T13:09:50.583351+0000","last_became_active":"2023-07-14T13:09:47.770759+0000","last_became_peered":"2023-07-14T13:09:47.770759+0000","last_unstale":"2023-07-14T13:09:50.583351+0000","last_undegraded":"2023-07-14T13:09:50.583351+0000","last_fullsized":"2023-07-14T13:09:50.583351+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:08:15.893929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.959043+0000","last_change":"2023-07-14T13:09:48.780858+0000","last_active":"2023-07-14T13:09:49.959043+0000","last_peered":"2023-07-14T13:09:49.959043+0000","last_clean":"2023-07-14T13:09:49.959043+0000","last_became_active":"2023-07-14T13:09:48.780570+0000","last_became_peered":"2023-07-14T13:09:48.780570+0000","last_unstale":"2023-07-14T13:09:49.959043+0000","last_undegraded":"2023-07-14T13:09:49.959043+0000","last_fullsized":"2023-07-14T13:09:49.959043+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:42:35.317684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.758584+0000","last_change":"2023-07-14T13:09:47.774479+0000","last_active":"2023-07-14T13:09:49.758584+0000","last_peered":"2023-07-14T13:09:49.758584+0000","last_clean":"2023-07-14T13:09:49.758584+0000","last_became_active":"2023-07-14T13:09:47.774120+0000","last_became_peered":"2023-07-14T13:09:47.774120+0000","last_unstale":"2023-07-14T13:09:49.758584+0000","last_undegraded":"2023-07-14T13:09:49.758584+0000","last_fullsized":"2023-07-14T13:09:49.758584+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:20:46.152438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.758526+0000","last_change":"2023-07-14T13:09:48.775585+0000","last_active":"2023-07-14T13:09:49.758526+0000","last_peered":"2023-07-14T13:09:49.758526+0000","last_clean":"2023-07-14T13:09:49.758526+0000","last_became_active":"2023-07-14T13:09:48.775242+0000","last_became_peered":"2023-07-14T13:09:48.775242+0000","last_unstale":"2023-07-14T13:09:49.758526+0000","last_undegraded":"2023-07-14T13:09:49.758526+0000","last_fullsized":"2023-07-14T13:09:49.758526+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:28:56.646763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"110'3","reported_seq":16,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762926+0000","last_change":"2023-07-14T13:09:47.780026+0000","last_active":"2023-07-14T13:09:49.762926+0000","last_peered":"2023-07-14T13:09:49.762926+0000","last_clean":"2023-07-14T13:09:49.762926+0000","last_became_active":"2023-07-14T13:09:47.779666+0000","last_became_peered":"2023-07-14T13:09:47.779666+0000","last_unstale":"2023-07-14T13:09:49.762926+0000","last_undegraded":"2023-07-14T13:09:49.762926+0000","last_fullsized":"2023-07-14T13:09:49.762926+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:25:16.698165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582428+0000","last_change":"2023-07-14T13:09:48.790932+0000","last_active":"2023-07-14T13:09:50.582428+0000","last_peered":"2023-07-14T13:09:50.582428+0000","last_clean":"2023-07-14T13:09:50.582428+0000","last_became_active":"2023-07-14T13:09:48.781067+0000","last_became_peered":"2023-07-14T13:09:48.781067+0000","last_unstale":"2023-07-14T13:09:50.582428+0000","last_undegraded":"2023-07-14T13:09:50.582428+0000","last_fullsized":"2023-07-14T13:09:50.582428+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:08:22.889826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"110'6","reported_seq":19,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.583115+0000","last_change":"2023-07-14T13:09:47.774575+0000","last_active":"2023-07-14T13:09:50.583115+0000","last_peered":"2023-07-14T13:09:50.583115+0000","last_clean":"2023-07-14T13:09:50.583115+0000","last_became_active":"2023-07-14T13:09:47.774273+0000","last_became_peered":"2023-07-14T13:09:47.774273+0000","last_unstale":"2023-07-14T13:09:50.583115+0000","last_undegraded":"2023-07-14T13:09:50.583115+0000","last_fullsized":"2023-07-14T13:09:50.583115+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:25:47.457880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582396+0000","last_change":"2023-07-14T13:09:48.796570+0000","last_active":"2023-07-14T13:09:50.582396+0000","last_peered":"2023-07-14T13:09:50.582396+0000","last_clean":"2023-07-14T13:09:50.582396+0000","last_became_active":"2023-07-14T13:09:48.796211+0000","last_became_peered":"2023-07-14T13:09:48.796211+0000","last_unstale":"2023-07-14T13:09:50.582396+0000","last_undegraded":"2023-07-14T13:09:50.582396+0000","last_fullsized":"2023-07-14T13:09:50.582396+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:44:00.859758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"110'2","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.959148+0000","last_change":"2023-07-14T13:09:47.780239+0000","last_active":"2023-07-14T13:09:49.959148+0000","last_peered":"2023-07-14T13:09:49.959148+0000","last_clean":"2023-07-14T13:09:49.959148+0000","last_became_active":"2023-07-14T13:09:47.779940+0000","last_became_peered":"2023-07-14T13:09:47.779940+0000","last_unstale":"2023-07-14T13:09:49.959148+0000","last_undegraded":"2023-07-14T13:09:49.959148+0000","last_fullsized":"2023-07-14T13:09:49.959148+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:16:14.597527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762091+0000","last_change":"2023-07-14T13:09:48.776744+0000","last_active":"2023-07-14T13:09:49.762091+0000","last_peered":"2023-07-14T13:09:49.762091+0000","last_clean":"2023-07-14T13:09:49.762091+0000","last_became_active":"2023-07-14T13:09:48.776391+0000","last_became_peered":"2023-07-14T13:09:48.776391+0000","last_unstale":"2023-07-14T13:09:49.762091+0000","last_undegraded":"2023-07-14T13:09:49.762091+0000","last_fullsized":"2023-07-14T13:09:49.762091+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:35:42.126659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581837+0000","last_change":"2023-07-14T13:09:47.773431+0000","last_active":"2023-07-14T13:09:50.581837+0000","last_peered":"2023-07-14T13:09:50.581837+0000","last_clean":"2023-07-14T13:09:50.581837+0000","last_became_active":"2023-07-14T13:09:47.773132+0000","last_became_peered":"2023-07-14T13:09:47.773132+0000","last_unstale":"2023-07-14T13:09:50.581837+0000","last_undegraded":"2023-07-14T13:09:50.581837+0000","last_fullsized":"2023-07-14T13:09:50.581837+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:57:37.379413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581410+0000","last_change":"2023-07-14T13:09:48.801365+0000","last_active":"2023-07-14T13:09:50.581410+0000","last_peered":"2023-07-14T13:09:50.581410+0000","last_clean":"2023-07-14T13:09:50.581410+0000","last_became_active":"2023-07-14T13:09:48.801067+0000","last_became_peered":"2023-07-14T13:09:48.801067+0000","last_unstale":"2023-07-14T13:09:50.581410+0000","last_undegraded":"2023-07-14T13:09:50.581410+0000","last_fullsized":"2023-07-14T13:09:50.581410+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:17:00.118423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.583039+0000","last_change":"2023-07-14T13:09:47.769864+0000","last_active":"2023-07-14T13:09:50.583039+0000","last_peered":"2023-07-14T13:09:50.583039+0000","last_clean":"2023-07-14T13:09:50.583039+0000","last_became_active":"2023-07-14T13:09:47.769417+0000","last_became_peered":"2023-07-14T13:09:47.769417+0000","last_unstale":"2023-07-14T13:09:50.583039+0000","last_undegraded":"2023-07-14T13:09:50.583039+0000","last_fullsized":"2023-07-14T13:09:50.583039+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:54:47.051976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582286+0000","last_change":"2023-07-14T13:09:48.781818+0000","last_active":"2023-07-14T13:09:50.582286+0000","last_peered":"2023-07-14T13:09:50.582286+0000","last_clean":"2023-07-14T13:09:50.582286+0000","last_became_active":"2023-07-14T13:09:48.781547+0000","last_became_peered":"2023-07-14T13:09:48.781547+0000","last_unstale":"2023-07-14T13:09:50.582286+0000","last_undegraded":"2023-07-14T13:09:50.582286+0000","last_fullsized":"2023-07-14T13:09:50.582286+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:58:03.164586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"110'8","reported_seq":21,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582546+0000","last_change":"2023-07-14T13:09:47.770460+0000","last_active":"2023-07-14T13:09:50.582546+0000","last_peered":"2023-07-14T13:09:50.582546+0000","last_clean":"2023-07-14T13:09:50.582546+0000","last_became_active":"2023-07-14T13:09:47.770187+0000","last_became_peered":"2023-07-14T13:09:47.770187+0000","last_unstale":"2023-07-14T13:09:50.582546+0000","last_undegraded":"2023-07-14T13:09:50.582546+0000","last_fullsized":"2023-07-14T13:09:50.582546+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:04:47.746163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.086740+0000","last_change":"2023-07-14T13:09:48.770401+0000","last_active":"2023-07-14T13:09:50.086740+0000","last_peered":"2023-07-14T13:09:50.086740+0000","last_clean":"2023-07-14T13:09:50.086740+0000","last_became_active":"2023-07-14T13:09:48.770086+0000","last_became_peered":"2023-07-14T13:09:48.770086+0000","last_unstale":"2023-07-14T13:09:50.086740+0000","last_undegraded":"2023-07-14T13:09:50.086740+0000","last_fullsized":"2023-07-14T13:09:50.086740+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:42:05.201596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"110'2","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.959242+0000","last_change":"2023-07-14T13:09:47.775032+0000","last_active":"2023-07-14T13:09:49.959242+0000","last_peered":"2023-07-14T13:09:49.959242+0000","last_clean":"2023-07-14T13:09:49.959242+0000","last_became_active":"2023-07-14T13:09:47.774767+0000","last_became_peered":"2023-07-14T13:09:47.774767+0000","last_unstale":"2023-07-14T13:09:49.959242+0000","last_undegraded":"2023-07-14T13:09:49.959242+0000","last_fullsized":"2023-07-14T13:09:49.959242+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:42:28.996868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581639+0000","last_change":"2023-07-14T13:09:48.779297+0000","last_active":"2023-07-14T13:09:50.581639+0000","last_peered":"2023-07-14T13:09:50.581639+0000","last_clean":"2023-07-14T13:09:50.581639+0000","last_became_active":"2023-07-14T13:09:48.779029+0000","last_became_peered":"2023-07-14T13:09:48.779029+0000","last_unstale":"2023-07-14T13:09:50.581639+0000","last_undegraded":"2023-07-14T13:09:50.581639+0000","last_fullsized":"2023-07-14T13:09:50.581639+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:55:44.381636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"111'1","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.763009+0000","last_change":"2023-07-14T13:09:47.771248+0000","last_active":"2023-07-14T13:09:49.763009+0000","last_peered":"2023-07-14T13:09:49.763009+0000","last_clean":"2023-07-14T13:09:49.763009+0000","last_became_active":"2023-07-14T13:09:47.770885+0000","last_became_peered":"2023-07-14T13:09:47.770885+0000","last_unstale":"2023-07-14T13:09:49.763009+0000","last_undegraded":"2023-07-14T13:09:49.763009+0000","last_fullsized":"2023-07-14T13:09:49.763009+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:35:40.340246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582237+0000","last_change":"2023-07-14T13:09:48.774383+0000","last_active":"2023-07-14T13:09:50.582237+0000","last_peered":"2023-07-14T13:09:50.582237+0000","last_clean":"2023-07-14T13:09:50.582237+0000","last_became_active":"2023-07-14T13:09:48.774020+0000","last_became_peered":"2023-07-14T13:09:48.774020+0000","last_unstale":"2023-07-14T13:09:50.582237+0000","last_undegraded":"2023-07-14T13:09:50.582237+0000","last_fullsized":"2023-07-14T13:09:50.582237+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:07:44.853187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.763058+0000","last_change":"2023-07-14T13:09:47.777989+0000","last_active":"2023-07-14T13:09:49.763058+0000","last_peered":"2023-07-14T13:09:49.763058+0000","last_clean":"2023-07-14T13:09:49.763058+0000","last_became_active":"2023-07-14T13:09:47.777607+0000","last_became_peered":"2023-07-14T13:09:47.777607+0000","last_unstale":"2023-07-14T13:09:49.763058+0000","last_undegraded":"2023-07-14T13:09:49.763058+0000","last_fullsized":"2023-07-14T13:09:49.763058+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:04:53.112997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.583310+0000","last_change":"2023-07-14T13:09:48.781240+0000","last_active":"2023-07-14T13:09:50.583310+0000","last_peered":"2023-07-14T13:09:50.583310+0000","last_clean":"2023-07-14T13:09:50.583310+0000","last_became_active":"2023-07-14T13:09:48.780923+0000","last_became_peered":"2023-07-14T13:09:48.780923+0000","last_unstale":"2023-07-14T13:09:50.583310+0000","last_undegraded":"2023-07-14T13:09:50.583310+0000","last_fullsized":"2023-07-14T13:09:50.583310+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:36:41.491238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.086887+0000","last_change":"2023-07-14T13:09:47.770697+0000","last_active":"2023-07-14T13:09:50.086887+0000","last_peered":"2023-07-14T13:09:50.086887+0000","last_clean":"2023-07-14T13:09:50.086887+0000","last_became_active":"2023-07-14T13:09:47.770416+0000","last_became_peered":"2023-07-14T13:09:47.770416+0000","last_unstale":"2023-07-14T13:09:50.086887+0000","last_undegraded":"2023-07-14T13:09:50.086887+0000","last_fullsized":"2023-07-14T13:09:50.086887+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:40:21.653902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581076+0000","last_change":"2023-07-14T13:09:48.772403+0000","last_active":"2023-07-14T13:09:50.581076+0000","last_peered":"2023-07-14T13:09:50.581076+0000","last_clean":"2023-07-14T13:09:50.581076+0000","last_became_active":"2023-07-14T13:09:48.772086+0000","last_became_peered":"2023-07-14T13:09:48.772086+0000","last_unstale":"2023-07-14T13:09:50.581076+0000","last_undegraded":"2023-07-14T13:09:50.581076+0000","last_fullsized":"2023-07-14T13:09:50.581076+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:30:12.588596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581856+0000","last_change":"2023-07-14T13:09:47.773993+0000","last_active":"2023-07-14T13:09:50.581856+0000","last_peered":"2023-07-14T13:09:50.581856+0000","last_clean":"2023-07-14T13:09:50.581856+0000","last_became_active":"2023-07-14T13:09:47.773728+0000","last_became_peered":"2023-07-14T13:09:47.773728+0000","last_unstale":"2023-07-14T13:09:50.581856+0000","last_undegraded":"2023-07-14T13:09:50.581856+0000","last_fullsized":"2023-07-14T13:09:50.581856+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:43:59.735358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.758171+0000","last_change":"2023-07-14T13:09:48.801767+0000","last_active":"2023-07-14T13:09:49.758171+0000","last_peered":"2023-07-14T13:09:49.758171+0000","last_clean":"2023-07-14T13:09:49.758171+0000","last_became_active":"2023-07-14T13:09:48.801455+0000","last_became_peered":"2023-07-14T13:09:48.801455+0000","last_unstale":"2023-07-14T13:09:49.758171+0000","last_undegraded":"2023-07-14T13:09:49.758171+0000","last_fullsized":"2023-07-14T13:09:49.758171+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:07:36.936699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.583039+0000","last_change":"2023-07-14T13:09:47.777463+0000","last_active":"2023-07-14T13:09:50.583039+0000","last_peered":"2023-07-14T13:09:50.583039+0000","last_clean":"2023-07-14T13:09:50.583039+0000","last_became_active":"2023-07-14T13:09:47.777170+0000","last_became_peered":"2023-07-14T13:09:47.777170+0000","last_unstale":"2023-07-14T13:09:50.583039+0000","last_undegraded":"2023-07-14T13:09:50.583039+0000","last_fullsized":"2023-07-14T13:09:50.583039+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:38:57.821053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.086773+0000","last_change":"2023-07-14T13:09:48.796672+0000","last_active":"2023-07-14T13:09:50.086773+0000","last_peered":"2023-07-14T13:09:50.086773+0000","last_clean":"2023-07-14T13:09:50.086773+0000","last_became_active":"2023-07-14T13:09:48.796475+0000","last_became_peered":"2023-07-14T13:09:48.796475+0000","last_unstale":"2023-07-14T13:09:50.086773+0000","last_undegraded":"2023-07-14T13:09:50.086773+0000","last_fullsized":"2023-07-14T13:09:50.086773+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:25:49.324291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.086753+0000","last_change":"2023-07-14T13:09:47.773135+0000","last_active":"2023-07-14T13:09:50.086753+0000","last_peered":"2023-07-14T13:09:50.086753+0000","last_clean":"2023-07-14T13:09:50.086753+0000","last_became_active":"2023-07-14T13:09:47.772845+0000","last_became_peered":"2023-07-14T13:09:47.772845+0000","last_unstale":"2023-07-14T13:09:50.086753+0000","last_undegraded":"2023-07-14T13:09:50.086753+0000","last_fullsized":"2023-07-14T13:09:50.086753+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:24:44.816687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581713+0000","last_change":"2023-07-14T13:09:48.779930+0000","last_active":"2023-07-14T13:09:50.581713+0000","last_peered":"2023-07-14T13:09:50.581713+0000","last_clean":"2023-07-14T13:09:50.581713+0000","last_became_active":"2023-07-14T13:09:48.779625+0000","last_became_peered":"2023-07-14T13:09:48.779625+0000","last_unstale":"2023-07-14T13:09:50.581713+0000","last_undegraded":"2023-07-14T13:09:50.581713+0000","last_fullsized":"2023-07-14T13:09:50.581713+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:38:56.837892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.958742+0000","last_change":"2023-07-14T13:09:47.778138+0000","last_active":"2023-07-14T13:09:49.958742+0000","last_peered":"2023-07-14T13:09:49.958742+0000","last_clean":"2023-07-14T13:09:49.958742+0000","last_became_active":"2023-07-14T13:09:47.777801+0000","last_became_peered":"2023-07-14T13:09:47.777801+0000","last_unstale":"2023-07-14T13:09:49.958742+0000","last_undegraded":"2023-07-14T13:09:49.958742+0000","last_fullsized":"2023-07-14T13:09:49.958742+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:05:54.030706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.959128+0000","last_change":"2023-07-14T13:09:48.779037+0000","last_active":"2023-07-14T13:09:49.959128+0000","last_peered":"2023-07-14T13:09:49.959128+0000","last_clean":"2023-07-14T13:09:49.959128+0000","last_became_active":"2023-07-14T13:09:48.778756+0000","last_became_peered":"2023-07-14T13:09:48.778756+0000","last_unstale":"2023-07-14T13:09:49.959128+0000","last_undegraded":"2023-07-14T13:09:49.959128+0000","last_fullsized":"2023-07-14T13:09:49.959128+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:41:28.675808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582337+0000","last_change":"2023-07-14T13:09:47.773514+0000","last_active":"2023-07-14T13:09:50.582337+0000","last_peered":"2023-07-14T13:09:50.582337+0000","last_clean":"2023-07-14T13:09:50.582337+0000","last_became_active":"2023-07-14T13:09:47.773211+0000","last_became_peered":"2023-07-14T13:09:47.773211+0000","last_unstale":"2023-07-14T13:09:50.582337+0000","last_undegraded":"2023-07-14T13:09:50.582337+0000","last_fullsized":"2023-07-14T13:09:50.582337+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:37:11.398707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"99'205","reported_seq":647,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.958985+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:09:49.958985+0000","last_peered":"2023-07-14T13:09:49.958985+0000","last_clean":"2023-07-14T13:09:49.958985+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:09:49.958985+0000","last_undegraded":"2023-07-14T13:09:49.958985+0000","last_fullsized":"2023-07-14T13:09:49.958985+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:20:28.179997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":179,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.583034+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:09:50.583034+0000","last_peered":"2023-07-14T13:09:50.583034+0000","last_clean":"2023-07-14T13:09:50.583034+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:09:50.583034+0000","last_undegraded":"2023-07-14T13:09:50.583034+0000","last_fullsized":"2023-07-14T13:09:50.583034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:38:01.827917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582934+0000","last_change":"2023-07-14T13:09:48.778741+0000","last_active":"2023-07-14T13:09:50.582934+0000","last_peered":"2023-07-14T13:09:50.582934+0000","last_clean":"2023-07-14T13:09:50.582934+0000","last_became_active":"2023-07-14T13:09:48.778429+0000","last_became_peered":"2023-07-14T13:09:48.778429+0000","last_unstale":"2023-07-14T13:09:50.582934+0000","last_undegraded":"2023-07-14T13:09:50.582934+0000","last_fullsized":"2023-07-14T13:09:50.582934+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:03:23.437711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"110'1","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.086828+0000","last_change":"2023-07-14T13:09:47.775769+0000","last_active":"2023-07-14T13:09:50.086828+0000","last_peered":"2023-07-14T13:09:50.086828+0000","last_clean":"2023-07-14T13:09:50.086828+0000","last_became_active":"2023-07-14T13:09:47.775476+0000","last_became_peered":"2023-07-14T13:09:47.775476+0000","last_unstale":"2023-07-14T13:09:50.086828+0000","last_undegraded":"2023-07-14T13:09:50.086828+0000","last_fullsized":"2023-07-14T13:09:50.086828+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:29:19.391206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":179,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.958969+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:09:49.958969+0000","last_peered":"2023-07-14T13:09:49.958969+0000","last_clean":"2023-07-14T13:09:49.958969+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:09:49.958969+0000","last_undegraded":"2023-07-14T13:09:49.958969+0000","last_fullsized":"2023-07-14T13:09:49.958969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:28:02.872507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.086763+0000","last_change":"2023-07-14T13:09:48.769267+0000","last_active":"2023-07-14T13:09:50.086763+0000","last_peered":"2023-07-14T13:09:50.086763+0000","last_clean":"2023-07-14T13:09:50.086763+0000","last_became_active":"2023-07-14T13:09:48.768969+0000","last_became_peered":"2023-07-14T13:09:48.768969+0000","last_unstale":"2023-07-14T13:09:50.086763+0000","last_undegraded":"2023-07-14T13:09:50.086763+0000","last_fullsized":"2023-07-14T13:09:50.086763+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:49:19.089644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"110'2","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.959077+0000","last_change":"2023-07-14T13:09:47.774372+0000","last_active":"2023-07-14T13:09:49.959077+0000","last_peered":"2023-07-14T13:09:49.959077+0000","last_clean":"2023-07-14T13:09:49.959077+0000","last_became_active":"2023-07-14T13:09:47.774044+0000","last_became_peered":"2023-07-14T13:09:47.774044+0000","last_unstale":"2023-07-14T13:09:49.959077+0000","last_undegraded":"2023-07-14T13:09:49.959077+0000","last_fullsized":"2023-07-14T13:09:49.959077+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:17:21.829416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":175,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581242+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:09:50.581242+0000","last_peered":"2023-07-14T13:09:50.581242+0000","last_clean":"2023-07-14T13:09:50.581242+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:09:50.581242+0000","last_undegraded":"2023-07-14T13:09:50.581242+0000","last_fullsized":"2023-07-14T13:09:50.581242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:34:24.115777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762740+0000","last_change":"2023-07-14T13:09:48.775897+0000","last_active":"2023-07-14T13:09:49.762740+0000","last_peered":"2023-07-14T13:09:49.762740+0000","last_clean":"2023-07-14T13:09:49.762740+0000","last_became_active":"2023-07-14T13:09:48.775611+0000","last_became_peered":"2023-07-14T13:09:48.775611+0000","last_unstale":"2023-07-14T13:09:49.762740+0000","last_undegraded":"2023-07-14T13:09:49.762740+0000","last_fullsized":"2023-07-14T13:09:49.762740+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:29:20.401099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"110'1","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.762990+0000","last_change":"2023-07-14T13:09:47.776207+0000","last_active":"2023-07-14T13:09:49.762990+0000","last_peered":"2023-07-14T13:09:49.762990+0000","last_clean":"2023-07-14T13:09:49.762990+0000","last_became_active":"2023-07-14T13:09:47.775865+0000","last_became_peered":"2023-07-14T13:09:47.775865+0000","last_unstale":"2023-07-14T13:09:49.762990+0000","last_undegraded":"2023-07-14T13:09:49.762990+0000","last_fullsized":"2023-07-14T13:09:49.762990+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:13:49.472946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":179,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.583019+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:09:50.583019+0000","last_peered":"2023-07-14T13:09:50.583019+0000","last_clean":"2023-07-14T13:09:50.583019+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:09:50.583019+0000","last_undegraded":"2023-07-14T13:09:50.583019+0000","last_fullsized":"2023-07-14T13:09:50.583019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:00:37.391268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581326+0000","last_change":"2023-07-14T13:09:48.797309+0000","last_active":"2023-07-14T13:09:50.581326+0000","last_peered":"2023-07-14T13:09:50.581326+0000","last_clean":"2023-07-14T13:09:50.581326+0000","last_became_active":"2023-07-14T13:09:48.796994+0000","last_became_peered":"2023-07-14T13:09:48.796994+0000","last_unstale":"2023-07-14T13:09:50.581326+0000","last_undegraded":"2023-07-14T13:09:50.581326+0000","last_fullsized":"2023-07-14T13:09:50.581326+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:48:25.133393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"110'2","reported_seq":15,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582897+0000","last_change":"2023-07-14T13:09:47.777379+0000","last_active":"2023-07-14T13:09:50.582897+0000","last_peered":"2023-07-14T13:09:50.582897+0000","last_clean":"2023-07-14T13:09:50.582897+0000","last_became_active":"2023-07-14T13:09:47.776990+0000","last_became_peered":"2023-07-14T13:09:47.776990+0000","last_unstale":"2023-07-14T13:09:50.582897+0000","last_undegraded":"2023-07-14T13:09:50.582897+0000","last_fullsized":"2023-07-14T13:09:50.582897+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:39:38.486319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":187,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582952+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:09:50.582952+0000","last_peered":"2023-07-14T13:09:50.582952+0000","last_clean":"2023-07-14T13:09:50.582952+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:09:50.582952+0000","last_undegraded":"2023-07-14T13:09:50.582952+0000","last_fullsized":"2023-07-14T13:09:50.582952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:45:12.396037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582769+0000","last_change":"2023-07-14T13:09:48.787932+0000","last_active":"2023-07-14T13:09:50.582769+0000","last_peered":"2023-07-14T13:09:50.582769+0000","last_clean":"2023-07-14T13:09:50.582769+0000","last_became_active":"2023-07-14T13:09:48.787582+0000","last_became_peered":"2023-07-14T13:09:48.787582+0000","last_unstale":"2023-07-14T13:09:50.582769+0000","last_undegraded":"2023-07-14T13:09:50.582769+0000","last_fullsized":"2023-07-14T13:09:50.582769+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:37:43.251674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581547+0000","last_change":"2023-07-14T13:09:47.772443+0000","last_active":"2023-07-14T13:09:50.581547+0000","last_peered":"2023-07-14T13:09:50.581547+0000","last_clean":"2023-07-14T13:09:50.581547+0000","last_became_active":"2023-07-14T13:09:47.772118+0000","last_became_peered":"2023-07-14T13:09:47.772118+0000","last_unstale":"2023-07-14T13:09:50.581547+0000","last_undegraded":"2023-07-14T13:09:50.581547+0000","last_fullsized":"2023-07-14T13:09:50.581547+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:04:04.658732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":179,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:49.959246+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:09:49.959246+0000","last_peered":"2023-07-14T13:09:49.959246+0000","last_clean":"2023-07-14T13:09:49.959246+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:09:49.959246+0000","last_undegraded":"2023-07-14T13:09:49.959246+0000","last_fullsized":"2023-07-14T13:09:49.959246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:44:01.779528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582864+0000","last_change":"2023-07-14T13:09:48.803096+0000","last_active":"2023-07-14T13:09:50.582864+0000","last_peered":"2023-07-14T13:09:50.582864+0000","last_clean":"2023-07-14T13:09:50.582864+0000","last_became_active":"2023-07-14T13:09:48.802791+0000","last_became_peered":"2023-07-14T13:09:48.802791+0000","last_unstale":"2023-07-14T13:09:50.582864+0000","last_undegraded":"2023-07-14T13:09:50.582864+0000","last_fullsized":"2023-07-14T13:09:50.582864+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:59:44.774708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582911+0000","last_change":"2023-07-14T13:09:47.780048+0000","last_active":"2023-07-14T13:09:50.582911+0000","last_peered":"2023-07-14T13:09:50.582911+0000","last_clean":"2023-07-14T13:09:50.582911+0000","last_became_active":"2023-07-14T13:09:47.779564+0000","last_became_peered":"2023-07-14T13:09:47.779564+0000","last_unstale":"2023-07-14T13:09:50.582911+0000","last_undegraded":"2023-07-14T13:09:50.582911+0000","last_fullsized":"2023-07-14T13:09:50.582911+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:55:19.517177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":186,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.582888+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:09:50.582888+0000","last_peered":"2023-07-14T13:09:50.582888+0000","last_clean":"2023-07-14T13:09:50.582888+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:09:50.582888+0000","last_undegraded":"2023-07-14T13:09:50.582888+0000","last_fullsized":"2023-07-14T13:09:50.582888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:38:58.034205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581532+0000","last_change":"2023-07-14T13:09:48.774534+0000","last_active":"2023-07-14T13:09:50.581532+0000","last_peered":"2023-07-14T13:09:50.581532+0000","last_clean":"2023-07-14T13:09:50.581532+0000","last_became_active":"2023-07-14T13:09:48.774248+0000","last_became_peered":"2023-07-14T13:09:48.774248+0000","last_unstale":"2023-07-14T13:09:50.581532+0000","last_undegraded":"2023-07-14T13:09:50.581532+0000","last_fullsized":"2023-07-14T13:09:50.581532+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:47.748039+0000","last_clean_scrub_stamp":"2023-07-14T13:09:47.748039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:23:16.082487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.581206+0000","last_change":"2023-07-14T13:09:47.768621+0000","last_active":"2023-07-14T13:09:50.581206+0000","last_peered":"2023-07-14T13:09:50.581206+0000","last_clean":"2023-07-14T13:09:50.581206+0000","last_became_active":"2023-07-14T13:09:47.768335+0000","last_became_peered":"2023-07-14T13:09:47.768335+0000","last_unstale":"2023-07-14T13:09:50.581206+0000","last_undegraded":"2023-07-14T13:09:50.581206+0000","last_fullsized":"2023-07-14T13:09:50.581206+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:09:46.738146+0000","last_clean_scrub_stamp":"2023-07-14T13:09:46.738146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:15:15.146765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":176,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-14T13:09:50.086949+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:09:50.086949+0000","last_peered":"2023-07-14T13:09:50.086949+0000","last_clean":"2023-07-14T13:09:50.086949+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:09:50.086949+0000","last_undegraded":"2023-07-14T13:09:50.086949+0000","last_fullsized":"2023-07-14T13:09:50.086949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:54:06.189061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575055,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59208,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312632,"statfs":{"total":96636764160,"available":96576135168,"internally_reserved":0,"allocated":1966080,"data_stored":1278092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.70299999999999996,"15min":0.71699999999999997},"min":{"1min":0.46300000000000002,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.91100000000000003}]},{"osd":1,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72099999999999997,"15min":0.73699999999999999},"min":{"1min":0.47199999999999998,"5min":0.434,"15min":0.434},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.88},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72499999999999998,"15min":0.745},"min":{"1min":0.436,"5min":0.436,"15min":0.40500000000000003},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.95599999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.72999999999999998},"min":{"1min":0.51900000000000002,"5min":0.46999999999999997,"15min":0.42699999999999999},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72499999999999998,"15min":0.75},"min":{"1min":0.47999999999999998,"5min":0.47199999999999998,"15min":0.46899999999999997},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.93300000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72499999999999998,"15min":0.73599999999999999},"min":{"1min":0.57999999999999996,"5min":0.503,"15min":0.46400000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72999999999999998,"15min":0.75600000000000001},"min":{"1min":0.47899999999999998,"5min":0.47299999999999998,"15min":0.41499999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":1.01}]},{"osd":4,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55400000000000005,"15min":0.58099999999999996},"min":{"1min":0.44,"5min":0.318,"15min":0.318},"max":{"1min":0.74299999999999999,"5min":0.86299999999999999,"15min":1.022},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58899999999999997,"15min":0.60299999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.39300000000000002},"max":{"1min":0.84399999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.754}]},{"osd":5,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98299999999999998},"last":0.629},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.628,"15min":0.65300000000000002},"min":{"1min":0.377,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82899999999999996,"5min":1.028,"15min":1.028},"last":0.59999999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.67300000000000004,"15min":0.69599999999999995},"min":{"1min":0.499,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89800000000000002,"5min":0.99299999999999999,"15min":1.0600000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64100000000000001,"15min":0.66900000000000004},"min":{"1min":0.46200000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81399999999999995,"5min":0.95799999999999996,"15min":1.04},"last":0.65900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575056,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1384448,"data_stored":689836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.48399999999999999,"5min":0.39500000000000002,"15min":0.38},"max":{"1min":0.874,"5min":0.96499999999999997,"15min":1.05},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.71299999999999997,"15min":0.73699999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.47399999999999998},"max":{"1min":0.86499999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.77700000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71699999999999997,"15min":0.745},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.379},"max":{"1min":0.81499999999999995,"5min":0.97199999999999998,"15min":1.0209999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69699999999999995,"15min":0.72299999999999998},"min":{"1min":0.55900000000000005,"5min":0.46999999999999997,"15min":0.44},"max":{"1min":0.85199999999999998,"5min":0.97099999999999997,"15min":1.077},"last":0.65600000000000003}]},{"osd":2,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73899999999999999,"15min":0.752},"min":{"1min":0.55500000000000005,"5min":0.45900000000000002,"15min":0.40400000000000003},"max":{"1min":0.89700000000000002,"5min":0.95099999999999996,"15min":1.105},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.73599999999999999,"15min":0.751},"min":{"1min":0.441,"5min":0.441,"15min":0.42299999999999999},"max":{"1min":0.89500000000000002,"5min":0.99099999999999999,"15min":1.0900000000000001},"last":0.71799999999999997}]},{"osd":3,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.748,"15min":0.77500000000000002},"min":{"1min":0.46000000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.93999999999999995,"5min":1.054,"15min":1.1359999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74199999999999999,"15min":0.76300000000000001},"min":{"1min":0.50900000000000001,"5min":0.48399999999999999,"15min":0.45900000000000002},"max":{"1min":0.94599999999999995,"5min":0.99099999999999999,"15min":1.1080000000000001},"last":0.68799999999999994}]},{"osd":4,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56399999999999995,"15min":0.57299999999999995},"min":{"1min":0.39900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.83299999999999996,"5min":0.89900000000000002,"15min":0.97899999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.439,"5min":0.38500000000000001,"15min":0.36099999999999999},"max":{"1min":0.87,"5min":1.012,"15min":1.0780000000000001},"last":0.53200000000000003}]},{"osd":5,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.48699999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.88100000000000001,"5min":1.579,"15min":1.579},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67900000000000005,"15min":0.68999999999999995},"min":{"1min":0.46300000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90100000000000002,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.48699999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:09:07 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64400000000000002,"15min":0.65700000000000003},"min":{"1min":0.44700000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86399999999999999,"5min":1.0940000000000001,"15min":1.1200000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69599999999999995,"15min":0.70799999999999996},"min":{"1min":0.53400000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.92400000000000004,"5min":1.657,"15min":1.657},"last":0.57199999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575055,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46332,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":44992,"kb_avail":94325508,"statfs":{"total":96636764160,"available":96589320192,"internally_reserved":0,"allocated":1363968,"data_stored":687668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46071808},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.70799999999999996,"15min":0.73099999999999998},"min":{"1min":0.376,"5min":0.36499999999999999,"15min":0.32400000000000001},"max":{"1min":0.91500000000000004,"5min":2.6699999999999999,"15min":2.6699999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68799999999999994,"15min":0.73299999999999998},"min":{"1min":0.41699999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.86099999999999999,"5min":1.083,"15min":1.083},"last":0.61099999999999999}]},{"osd":1,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69899999999999995,"15min":0.72699999999999998},"min":{"1min":0.46899999999999997,"5min":0.44500000000000001,"15min":0.41099999999999998},"max":{"1min":0.85199999999999998,"5min":1.05,"15min":1.079},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73299999999999998,"15min":0.747},"min":{"1min":0.48999999999999999,"5min":0.48699999999999999,"15min":0.36799999999999999},"max":{"1min":0.94599999999999995,"5min":2.706,"15min":2.706},"last":0.72999999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71299999999999997,"15min":0.73899999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86299999999999999,"5min":1.212,"15min":1.212},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.70499999999999996,"15min":0.73499999999999999},"min":{"1min":0.44800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89200000000000002,"5min":1.181,"15min":1.181},"last":0.58599999999999997}]},{"osd":3,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73299999999999998,"15min":0.748},"min":{"1min":0.48599999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.876,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.628},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.72799999999999998,"15min":0.76000000000000001},"min":{"1min":0.47299999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90800000000000003,"5min":1.304,"15min":1.304},"last":0.71799999999999997}]},{"osd":4,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64000000000000001,"15min":0.629},"min":{"1min":0.437,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.85399999999999998,"5min":1.129,"15min":1.129},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.39900000000000002,"5min":0.36299999999999999,"15min":0.35899999999999999},"max":{"1min":0.84499999999999997,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.75700000000000001}]},{"osd":6,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.60399999999999998,"15min":0.61399999999999999},"min":{"1min":0.41999999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90200000000000002,"5min":1.169,"15min":1.169},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.64400000000000002,"15min":0.64100000000000001},"min":{"1min":0.39400000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.83699999999999997,"5min":1.238,"15min":1.238},"last":0.69899999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:09:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66100000000000003,"15min":0.64300000000000002},"min":{"1min":0.45500000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93300000000000005,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68200000000000005,"15min":0.67800000000000005},"min":{"1min":0.48999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90100000000000002,"5min":1.407,"15min":1.407},"last":0.66200000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575055,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1372160,"data_stored":687828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.70899999999999996,"15min":0.72999999999999998},"min":{"1min":0.36899999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.90800000000000003,"5min":1.0129999999999999,"15min":1.411},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.435},"max":{"1min":0.85199999999999998,"5min":1.0640000000000001,"15min":1.1200000000000001},"last":0.746}]},{"osd":1,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.748,"15min":0.749},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92500000000000004,"5min":0.94699999999999995,"15min":1.077},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.70999999999999996,"15min":0.73599999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89600000000000002,"5min":0.96399999999999997,"15min":1.0469999999999999},"last":0.77100000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.72899999999999998,"15min":0.73399999999999999},"min":{"1min":0.51800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91000000000000003,"5min":0.96499999999999997,"15min":1.091},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.76900000000000002,"15min":0.77400000000000002},"min":{"1min":0.46400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98099999999999998,"5min":1.0649999999999999,"15min":1.387},"last":0.623}]},{"osd":3,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.72999999999999998,"15min":0.746},"min":{"1min":0.53200000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.94699999999999995,"5min":0.997,"15min":1.008},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.75800000000000001,"15min":0.77100000000000002},"min":{"1min":0.504,"5min":0.496,"15min":0.46800000000000003},"max":{"1min":0.875,"5min":1.024,"15min":1.0589999999999999},"last":0.73099999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61899999999999999,"15min":0.60499999999999998},"min":{"1min":0.49299999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.85299999999999998,"5min":0.95599999999999996,"15min":1.0029999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63300000000000001,"15min":0.61799999999999999},"min":{"1min":0.45900000000000002,"5min":0.41399999999999998,"15min":0.34599999999999997},"max":{"1min":0.93200000000000005,"5min":0.93600000000000005,"15min":0.95199999999999996},"last":0.84099999999999997}]},{"osd":6,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.32300000000000001},"max":{"1min":0.96999999999999997,"5min":1.014,"15min":1.014},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68300000000000005,"15min":0.66900000000000004},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.374},"max":{"1min":0.86899999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.71499999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68899999999999995,"15min":0.66900000000000004},"min":{"1min":0.503,"5min":0.46000000000000002,"15min":0.39000000000000001},"max":{"1min":0.89400000000000002,"5min":0.94699999999999995,"15min":1.0349999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70999999999999996,"15min":0.69499999999999995},"min":{"1min":0.42799999999999999,"5min":0.40300000000000002,"15min":0.36899999999999999},"max":{"1min":0.91800000000000004,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.78500000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575055,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36476,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335364,"statfs":{"total":96636764160,"available":96599412736,"internally_reserved":0,"allocated":1363968,"data_stored":687668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.26200000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.84199999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.498,"15min":0.51500000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.60799999999999998,"5min":0.77300000000000002,"15min":1.0209999999999999},"last":0.61599999999999999}]},{"osd":1,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47199999999999998,"15min":0.47499999999999998},"min":{"1min":0.33100000000000002,"5min":0.315,"15min":0.29599999999999999},"max":{"1min":0.63900000000000001,"5min":0.77200000000000002,"15min":0.79600000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67800000000000005,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.56399999999999995}]},{"osd":2,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54100000000000004,"15min":0.56999999999999995},"min":{"1min":0.38200000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.72399999999999998,"5min":0.82599999999999996,"15min":0.95899999999999996},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.60699999999999998,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86599999999999999,"5min":1.663,"15min":1.663},"last":0.64600000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.748,"15min":0.76500000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":0.90900000000000003,"5min":1.284,"15min":1.284},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76800000000000002,"15min":0.78900000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.47699999999999998},"max":{"1min":1.0660000000000001,"5min":1.121,"15min":1.196},"last":0.88100000000000001}]},{"osd":5,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.52400000000000002},"max":{"1min":1.0229999999999999,"5min":1.306,"15min":1.306},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77900000000000003,"15min":0.79100000000000004},"min":{"1min":0.58099999999999996,"5min":0.372,"15min":0.372},"max":{"1min":0.97399999999999998,"5min":1.1870000000000001,"15min":1.2470000000000001},"last":0.71299999999999997}]},{"osd":6,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.76800000000000002,"15min":0.78000000000000003},"min":{"1min":0.50600000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96599999999999997,"5min":1.105,"15min":1.117},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.79700000000000004,"15min":0.81799999999999995},"min":{"1min":0.56299999999999994,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.93999999999999995,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.82999999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.83299999999999996,"15min":0.84099999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53100000000000003},"max":{"1min":0.89900000000000002,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.53500000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0009999999999999,"5min":1.595,"15min":1.595},"last":0.75}]}]},{"osd":2,"up_from":13,"seq":55834575055,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58616,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313224,"statfs":{"total":96636764160,"available":96576741376,"internally_reserved":0,"allocated":1359872,"data_stored":686649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45900000000000002,"15min":0.46800000000000003},"min":{"1min":0.29199999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.84699999999999998,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.443},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.54200000000000004,"15min":0.53300000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.70799999999999996,"5min":2.5270000000000001,"15min":2.5270000000000001},"last":0.49199999999999999}]},{"osd":1,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.48299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30399999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65500000000000003,"5min":2.7200000000000002,"15min":2.7200000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.55000000000000004,"15min":0.56299999999999994},"min":{"1min":0.36299999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78300000000000003,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":0.42299999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.64500000000000002,"15min":0.60399999999999998},"min":{"1min":0.39500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71699999999999997,"5min":8.2530000000000001,"15min":8.2530000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89600000000000002,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.50700000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.754,"15min":0.78100000000000003},"min":{"1min":0.53200000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.99399999999999999,"5min":1.0940000000000001,"15min":1.1499999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.56699999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0629999999999999,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.57299999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.84399999999999997,"15min":0.85799999999999998},"min":{"1min":0.58599999999999997,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1319999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82499999999999996,"15min":0.83999999999999997},"min":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.433},"max":{"1min":1.153,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":0.74099999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.78700000000000003,"15min":0.80400000000000005},"min":{"1min":0.57299999999999995,"5min":0.48999999999999999,"15min":0.47599999999999998},"max":{"1min":0.93999999999999995,"5min":3.9849999999999999,"15min":3.9849999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80200000000000005,"15min":0.81299999999999994},"min":{"1min":0.60699999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0289999999999999,"5min":3.391,"15min":3.391},"last":0.67900000000000005}]},{"osd":7,"last update":"Fri Jul 14 13:09:06 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.79600000000000004,"15min":0.82199999999999995},"min":{"1min":0.55000000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.1759999999999999,"5min":2.5779999999999998,"15min":2.5779999999999998},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.81499999999999995,"15min":0.82299999999999995},"min":{"1min":0.60199999999999998,"5min":0.53200000000000003,"15min":0.50900000000000001},"max":{"1min":1.0940000000000001,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.629}]}]},{"osd":1,"up_from":13,"seq":55834575056,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36480,"kb_used_data":1336,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335360,"statfs":{"total":96636764160,"available":96599408640,"internally_reserved":0,"allocated":1368064,"data_stored":687738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.29199999999999998,"5min":0.26300000000000001,"15min":0.26100000000000001},"max":{"1min":0.53700000000000003,"5min":0.65400000000000003,"15min":0.77200000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.35699999999999998,"5min":0.28199999999999997,"15min":0.26500000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.38100000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47199999999999998,"15min":0.47299999999999998},"min":{"1min":0.34300000000000003,"5min":0.32100000000000001,"15min":0.29499999999999998},"max":{"1min":0.54200000000000004,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65100000000000002,"5min":1.014,"15min":1.014},"last":0.45000000000000001}]},{"osd":3,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.621,"15min":0.63600000000000001},"min":{"1min":0.48199999999999998,"5min":0.44700000000000001,"15min":0.437},"max":{"1min":0.73899999999999999,"5min":0.80500000000000005,"15min":0.96299999999999997},"last":0.5},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56499999999999995,"15min":0.57999999999999996},"min":{"1min":0.41399999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.433}]},{"osd":4,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77700000000000002,"15min":0.78400000000000003},"min":{"1min":0.55500000000000005,"5min":0.51600000000000001,"15min":0.40000000000000002},"max":{"1min":1.0409999999999999,"5min":1.2110000000000001,"15min":1.236},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77200000000000002,"15min":0.78600000000000003},"min":{"1min":0.57499999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.0309999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.81000000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.60799999999999998,"5min":0.48499999999999999,"15min":0.42599999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.55800000000000005,"5min":0.48599999999999999,"15min":0.48199999999999998},"max":{"1min":1.0940000000000001,"5min":1.2749999999999999,"15min":1.3600000000000001},"last":0.751}]},{"osd":6,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.53800000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1.0580000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.80500000000000005,"15min":0.81399999999999995},"min":{"1min":0.56100000000000005,"5min":0.52200000000000002,"15min":0.49199999999999999},"max":{"1min":1.1319999999999999,"5min":1.262,"15min":1.2969999999999999},"last":0.79100000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:09:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.47799999999999998},"max":{"1min":1.1479999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.82099999999999995,"15min":0.84099999999999997},"min":{"1min":0.58499999999999996,"5min":0.53700000000000003,"15min":0.52800000000000002},"max":{"1min":1.2070000000000001,"5min":1.327,"15min":1.327},"last":0.72499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575057,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37076,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334764,"statfs":{"total":96636764160,"available":96598798336,"internally_reserved":0,"allocated":1978368,"data_stored":1279287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.45600000000000002,"15min":0.44700000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.61199999999999999,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.49099999999999999,"15min":0.51500000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.27700000000000002},"max":{"1min":0.61799999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.51900000000000002,"15min":0.51100000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69699999999999995,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.54000000000000004,"15min":0.55300000000000005},"min":{"1min":0.39800000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63800000000000001,"5min":0.80300000000000005,"15min":0.90300000000000002},"last":0.45400000000000001}]},{"osd":3,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.504},"min":{"1min":0.36399999999999999,"5min":0.318,"15min":0.30299999999999999},"max":{"1min":0.67600000000000005,"5min":0.72999999999999998,"15min":0.84999999999999998},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82899999999999996,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.438}]},{"osd":4,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76900000000000002,"15min":0.78800000000000003},"min":{"1min":0.56100000000000005,"5min":0.48399999999999999,"15min":0.44400000000000001},"max":{"1min":0.90500000000000003,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.53500000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.038,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.59399999999999997}]},{"osd":5,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.77100000000000002,"15min":0.80600000000000005},"min":{"1min":0.55100000000000005,"5min":0.51800000000000002,"15min":0.47899999999999998},"max":{"1min":0.80500000000000005,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.56399999999999995,"5min":0.49299999999999999,"15min":0.47299999999999998},"max":{"1min":0.97299999999999998,"5min":1.325,"15min":1.325},"last":0.55500000000000005}]},{"osd":6,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.79100000000000004,"15min":0.80600000000000005},"min":{"1min":0.53500000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91400000000000003,"5min":2.3380000000000001,"15min":2.3380000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78900000000000003,"15min":0.81499999999999995},"min":{"1min":0.58399999999999996,"5min":0.55500000000000005,"15min":0.41299999999999998},"max":{"1min":1.0900000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.65900000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:09:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.79800000000000004,"15min":0.83199999999999996},"min":{"1min":0.57699999999999996,"5min":0.503,"15min":0.45500000000000002},"max":{"1min":0.93799999999999994,"5min":1.171,"15min":1.2749999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.77100000000000002,"15min":0.81100000000000005},"min":{"1min":0.50600000000000001,"5min":0.502,"15min":0.497},"max":{"1min":0.95199999999999996,"5min":1.381,"15min":1.381},"last":0.58499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:09:57.851 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-14T13:09:57.851 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-14T13:09:58.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.010+0000 7f8ed1540640 1 Processor -- start 2023-07-14T13:09:58.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.010+0000 7f8ed1540640 1 -- start start 2023-07-14T13:09:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.010+0000 7f8ed1540640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8ecc158a40 0x7f8ecc0cb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.010+0000 7f8ed1540640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8ecc0cd670 0x7f8ecc06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.010+0000 7f8ed1540640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ecc0c8e20 con 0x7f8ecc0c8940 2023-07-14T13:09:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.010+0000 7f8ed1540640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ecc0711b0 con 0x7f8ecc0cd670 2023-07-14T13:09:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.010+0000 7f8ed1540640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ecc0c9100 con 0x7f8ecc158a40 2023-07-14T13:09:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.010+0000 7f8ecb7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8ecc0cd670 0x7f8ecc06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.010+0000 7f8ecb7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8ecc0cd670 0x7f8ecc06fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35056/0 (socket says 172.21.15.5:35056) 2023-07-14T13:09:58.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.010+0000 7f8ecb7fe640 1 -- 172.21.15.5:0/2752926221 learned_addr learned my addr 172.21.15.5:0/2752926221 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.014+0000 7f8ecaffd640 1 --2- 172.21.15.5:0/2752926221 >> v2:172.21.15.154:3300/0 conn(0x7f8ecc158a40 0x7f8ecc0cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.014+0000 7f8ecb7fe640 1 -- 172.21.15.5:0/2752926221 >> v2:172.21.15.154:3300/0 conn(0x7f8ecc158a40 msgr2=0x7f8ecc0cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.014+0000 7f8ecb7fe640 1 --2- 172.21.15.5:0/2752926221 >> v2:172.21.15.154:3300/0 conn(0x7f8ecc158a40 0x7f8ecc0cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.014+0000 7f8ecb7fe640 1 -- 172.21.15.5:0/2752926221 >> v1:172.21.15.154:6789/0 conn(0x7f8ecc0c8940 legacy=0x7f8ecc0ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.014+0000 7f8ecb7fe640 1 -- 172.21.15.5:0/2752926221 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc0c93e0 con 0x7f8ecc0cd670 2023-07-14T13:09:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.014+0000 7f8ecaffd640 1 --2- 172.21.15.5:0/2752926221 >> v2:172.21.15.154:3300/0 conn(0x7f8ecc158a40 0x7f8ecc0cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:09:58.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.014+0000 7f8ecb7fe640 1 --2- 172.21.15.5:0/2752926221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ecc0cd670 0x7f8ecc06fc00 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc06b6c0 tx=0x7f8ec401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d839daa01ee51d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:58.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.014+0000 7f8eca7fc640 1 -- 172.21.15.5:0/2752926221 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec40a5820 con 0x7f8ecc0cd670 2023-07-14T13:09:58.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.014+0000 7f8eca7fc640 1 -- 172.21.15.5:0/2752926221 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec40a5980 con 0x7f8ecc0cd670 2023-07-14T13:09:58.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.014+0000 7f8eca7fc640 1 -- 172.21.15.5:0/2752926221 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec40a5d10 con 0x7f8ecc0cd670 2023-07-14T13:09:58.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.014+0000 7f8ed1540640 1 -- 172.21.15.5:0/2752926221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ecc0cd670 msgr2=0x7f8ecc06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:58.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.014+0000 7f8ed1540640 1 --2- 172.21.15.5:0/2752926221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ecc0cd670 0x7f8ecc06fc00 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc06b6c0 tx=0x7f8ec401c960 comp rx=0 tx=0).stop 2023-07-14T13:09:58.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.018+0000 7f8ed1540640 1 -- 172.21.15.5:0/2752926221 shutdown_connections 2023-07-14T13:09:58.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.018+0000 7f8ed1540640 1 --2- 172.21.15.5:0/2752926221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ecc0cd670 0x7f8ecc06fc00 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:58.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.018+0000 7f8ed1540640 1 --2- 172.21.15.5:0/2752926221 >> v2:172.21.15.154:3300/0 conn(0x7f8ecc158a40 0x7f8ecc0cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:58.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.018+0000 7f8ed1540640 1 -- 172.21.15.5:0/2752926221 >> 172.21.15.5:0/2752926221 conn(0x7f8ecc0afac0 msgr2=0x7f8ecc0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:58.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.018+0000 7f8ed1540640 1 -- 172.21.15.5:0/2752926221 shutdown_connections 2023-07-14T13:09:58.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.018+0000 7f8ed1540640 1 -- 172.21.15.5:0/2752926221 wait complete. 2023-07-14T13:09:58.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.018+0000 7f8ed1540640 1 Processor -- start 2023-07-14T13:09:58.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.018+0000 7f8ed1540640 1 -- start start 2023-07-14T13:09:58.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.018+0000 7f8ed1540640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ecc0c8940 0x7f8ecc0c2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:58.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.018+0000 7f8ed1540640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ecc0cd670 0x7f8ecc150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:58.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.018+0000 7f8ed1540640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ecc0b23e0 0x7f8ecc1509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:58.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.018+0000 7f8ed1540640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc0c32b0 con 0x7f8ecc0c8940 2023-07-14T13:09:58.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.018+0000 7f8ed1540640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc14fd40 con 0x7f8ecc0b23e0 2023-07-14T13:09:58.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.018+0000 7f8ed1540640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc15be10 con 0x7f8ecc0cd670 2023-07-14T13:09:58.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.018+0000 7f8ecaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ecc0c8940 0x7f8ecc0c2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:58.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.018+0000 7f8ecaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ecc0c8940 0x7f8ecc0c2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35068/0 (socket says 172.21.15.5:35068) 2023-07-14T13:09:58.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.018+0000 7f8ecaffd640 1 -- 172.21.15.5:0/2476086602 learned_addr learned my addr 172.21.15.5:0/2476086602 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:58.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.018+0000 7f8ecb7fe640 1 --2- 172.21.15.5:0/2476086602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ecc0b23e0 0x7f8ecc1509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:58.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.018+0000 7f8ec3fff640 1 --2- 172.21.15.5:0/2476086602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ecc0cd670 0x7f8ecc150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:58.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.018+0000 7f8ecaffd640 1 -- 172.21.15.5:0/2476086602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ecc0cd670 msgr2=0x7f8ecc150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:58.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.018+0000 7f8ecaffd640 1 --2- 172.21.15.5:0/2476086602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ecc0cd670 0x7f8ecc150460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:58.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.018+0000 7f8ecaffd640 1 -- 172.21.15.5:0/2476086602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ecc0b23e0 msgr2=0x7f8ecc1509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:58.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.018+0000 7f8ecaffd640 1 --2- 172.21.15.5:0/2476086602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ecc0b23e0 0x7f8ecc1509a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:58.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.018+0000 7f8ecaffd640 1 -- 172.21.15.5:0/2476086602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec4009b30 con 0x7f8ecc0c8940 2023-07-14T13:09:58.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.018+0000 7f8ecb7fe640 1 --2- 172.21.15.5:0/2476086602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ecc0b23e0 0x7f8ecc1509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:58.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.018+0000 7f8ecaffd640 1 --2- 172.21.15.5:0/2476086602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ecc0c8940 0x7f8ecc0c2d70 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00c7f0 tx=0x7f8ebc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:58.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.022+0000 7f8ec37fe640 1 -- 172.21.15.5:0/2476086602 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc0077c0 con 0x7f8ecc0c8940 2023-07-14T13:09:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.022+0000 7f8ec37fe640 1 -- 172.21.15.5:0/2476086602 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ebc007920 con 0x7f8ecc0c8940 2023-07-14T13:09:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.022+0000 7f8ec37fe640 1 -- 172.21.15.5:0/2476086602 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc007cd0 con 0x7f8ecc0c8940 2023-07-14T13:09:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.022+0000 7f8ed1540640 1 -- 172.21.15.5:0/2476086602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ecc0c40d0 con 0x7f8ecc0c8940 2023-07-14T13:09:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.022+0000 7f8ed1540640 1 -- 172.21.15.5:0/2476086602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ecc0c37a0 con 0x7f8ecc0c8940 2023-07-14T13:09:58.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.022+0000 7f8ed1540640 1 -- 172.21.15.5:0/2476086602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ecc0ca370 con 0x7f8ecc0c8940 2023-07-14T13:09:58.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.022+0000 7f8ec37fe640 1 -- 172.21.15.5:0/2476086602 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8ebc0113f0 con 0x7f8ecc0c8940 2023-07-14T13:09:58.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.022+0000 7f8ec37fe640 1 --2- 172.21.15.5:0/2476086602 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f8eac0663a0 0x7f8eac068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:58.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.022+0000 7f8ec37fe640 1 -- 172.21.15.5:0/2476086602 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8ebc084240 con 0x7f8ecc0c8940 2023-07-14T13:09:58.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.022+0000 7f8ec3fff640 1 --2- 172.21.15.5:0/2476086602 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f8eac0663a0 0x7f8eac068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:58.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.026+0000 7f8ec3fff640 1 --2- 172.21.15.5:0/2476086602 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f8eac0663a0 0x7f8eac068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc0ca2f0 tx=0x7f8eb4009040 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:58.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.026+0000 7f8ec37fe640 1 -- 172.21.15.5:0/2476086602 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f8ebc051490 con 0x7f8ecc0c8940 2023-07-14T13:09:58.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.238+0000 7f8ed1540640 1 -- 172.21.15.5:0/2476086602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f8ecc0678d0 con 0x7f8ecc0c8940 2023-07-14T13:09:58.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.242+0000 7f8ec37fe640 1 -- 172.21.15.5:0/2476086602 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+147 (secure 0 0 0) 0x7f8ebc054ab0 con 0x7f8ecc0c8940 2023-07-14T13:09:58.275 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-07-14T13:09:58.275 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDkRLFkCav/DhAA6SOiONAbTcWCnUZXcm7BcQ== 2023-07-14T13:09:58.276 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2023-07-14T13:09:58.276 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2023-07-14T13:09:58.276 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-14T13:09:58.276 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2023-07-14T13:09:58.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.246+0000 7f8ed1540640 1 -- 172.21.15.5:0/2476086602 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f8eac0663a0 msgr2=0x7f8eac068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:58.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.246+0000 7f8ed1540640 1 --2- 172.21.15.5:0/2476086602 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f8eac0663a0 0x7f8eac068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc0ca2f0 tx=0x7f8eb4009040 comp rx=0 tx=0).stop 2023-07-14T13:09:58.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.246+0000 7f8ed1540640 1 -- 172.21.15.5:0/2476086602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ecc0c8940 msgr2=0x7f8ecc0c2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:58.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.246+0000 7f8ed1540640 1 --2- 172.21.15.5:0/2476086602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ecc0c8940 0x7f8ecc0c2d70 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00c7f0 tx=0x7f8ebc00ccb0 comp rx=0 tx=0).stop 2023-07-14T13:09:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.246+0000 7f8ed1540640 1 -- 172.21.15.5:0/2476086602 shutdown_connections 2023-07-14T13:09:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.246+0000 7f8ed1540640 1 --2- 172.21.15.5:0/2476086602 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f8eac0663a0 0x7f8eac068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.246+0000 7f8ed1540640 1 --2- 172.21.15.5:0/2476086602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ecc0b23e0 0x7f8ecc1509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.246+0000 7f8ed1540640 1 --2- 172.21.15.5:0/2476086602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ecc0cd670 0x7f8ecc150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.246+0000 7f8ed1540640 1 --2- 172.21.15.5:0/2476086602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ecc0c8940 0x7f8ecc0c2d70 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.246+0000 7f8ed1540640 1 -- 172.21.15.5:0/2476086602 >> 172.21.15.5:0/2476086602 conn(0x7f8ecc0afac0 msgr2=0x7f8ecc0af1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.246+0000 7f8ed1540640 1 -- 172.21.15.5:0/2476086602 shutdown_connections 2023-07-14T13:09:58.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.246+0000 7f8ed1540640 1 -- 172.21.15.5:0/2476086602 wait complete. 2023-07-14T13:09:58.296 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:09:58.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe095f87640 1 Processor -- start 2023-07-14T13:09:58.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe095f87640 1 -- start start 2023-07-14T13:09:58.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe095f87640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0900b7d90 0x7fe0900cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:58.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe095f87640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0900d0f60 con 0x7fe09015f3f0 2023-07-14T13:09:58.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe095f87640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0900d0390 con 0x7fe0900d13f0 2023-07-14T13:09:58.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe095f87640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0900d0630 con 0x7fe0900b7d90 2023-07-14T13:09:58.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe094f85640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe09015f3f0 0x7fe0900b7680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56728/0 (socket says 172.21.15.5:56728) 2023-07-14T13:09:58.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe094f85640 1 -- 172.21.15.5:0/2284658716 learned_addr learned my addr 172.21.15.5:0/2284658716 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:09:58.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe08ffff640 1 --2- 172.21.15.5:0/2284658716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0900b7d90 0x7fe0900cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:58.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe08f7fe640 1 -- 172.21.15.5:0/2284658716 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723306220 0 0) 0x7fe0900d0f60 con 0x7fe09015f3f0 2023-07-14T13:09:58.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe08f7fe640 1 -- 172.21.15.5:0/2284658716 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe080003530 con 0x7fe09015f3f0 2023-07-14T13:09:58.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe08f7fe640 1 -- 172.21.15.5:0/2284658716 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677599530 0 0) 0x7fe0900d0390 con 0x7fe0900d13f0 2023-07-14T13:09:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe08f7fe640 1 -- 172.21.15.5:0/2284658716 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0900d0f60 con 0x7fe0900d13f0 2023-07-14T13:09:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe08f7fe640 1 -- 172.21.15.5:0/2284658716 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4065863560 0 0) 0x7fe080003530 con 0x7fe09015f3f0 2023-07-14T13:09:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe08f7fe640 1 -- 172.21.15.5:0/2284658716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0900b7d90 msgr2=0x7fe0900cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe08f7fe640 1 --2- 172.21.15.5:0/2284658716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0900b7d90 0x7fe0900cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe08f7fe640 1 -- 172.21.15.5:0/2284658716 >> v1:172.21.15.154:6789/0 conn(0x7fe0900d13f0 legacy=0x7fe0900ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe08f7fe640 1 -- 172.21.15.5:0/2284658716 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0900d0910 con 0x7fe09015f3f0 2023-07-14T13:09:58.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe08f7fe640 1 -- 172.21.15.5:0/2284658716 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7fe084001680 con 0x7fe09015f3f0 2023-07-14T13:09:58.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe08f7fe640 1 -- 172.21.15.5:0/2284658716 >> v1:172.21.15.5:6789/0 conn(0x7fe09015f3f0 legacy=0x7fe0900b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:58.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe08f7fe640 1 --2- 172.21.15.5:0/2284658716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe080003b40 0x7fe080003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:58.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe08f7fe640 1 --2- 172.21.15.5:0/2284658716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0800047d0 0x7fe080004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:58.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe08f7fe640 1 --2- 172.21.15.5:0/2284658716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe080005180 0x7fe08000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:58.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe08f7fe640 1 -- 172.21.15.5:0/2284658716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0900d0630 con 0x7fe080005180 2023-07-14T13:09:58.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe08f7fe640 1 -- 172.21.15.5:0/2284658716 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08000bfe0 con 0x7fe0800047d0 2023-07-14T13:09:58.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe08f7fe640 1 -- 172.21.15.5:0/2284658716 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08000c1a0 con 0x7fe080003b40 2023-07-14T13:09:58.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe08ffff640 1 --2- 172.21.15.5:0/2284658716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0900b7d90 0x7fe0900cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:09:58.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe095786640 1 --2- 172.21.15.5:0/2284658716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe080005180 0x7fe08000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:58.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe094f85640 1 --2- 172.21.15.5:0/2284658716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe080003b40 0x7fe080003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:58.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe08ffff640 1 --2- 172.21.15.5:0/2284658716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0800047d0 0x7fe080004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:58.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe095786640 1 -- 172.21.15.5:0/2284658716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe080003b40 msgr2=0x7fe080003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:58.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe095786640 1 --2- 172.21.15.5:0/2284658716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe080003b40 0x7fe080003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:58.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe095786640 1 -- 172.21.15.5:0/2284658716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0800047d0 msgr2=0x7fe080004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe095786640 1 --2- 172.21.15.5:0/2284658716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0800047d0 0x7fe080004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe095786640 1 -- 172.21.15.5:0/2284658716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe080003530 con 0x7fe080005180 2023-07-14T13:09:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.410+0000 7fe08ffff640 1 --2- 172.21.15.5:0/2284658716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0800047d0 0x7fe080004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:09:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.414+0000 7fe095786640 1 --2- 172.21.15.5:0/2284658716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe080005180 0x7fe08000b990 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fe088001fc0 tx=0x7fe08801f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d6ac24222459525 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.414+0000 7fe08f7fe640 1 -- 172.21.15.5:0/2284658716 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0880a8c70 con 0x7fe080005180 2023-07-14T13:09:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.414+0000 7fe08f7fe640 1 -- 172.21.15.5:0/2284658716 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0880a8dd0 con 0x7fe080005180 2023-07-14T13:09:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.414+0000 7fe08f7fe640 1 -- 172.21.15.5:0/2284658716 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe088003ba0 con 0x7fe080005180 2023-07-14T13:09:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.414+0000 7fe095f87640 1 -- 172.21.15.5:0/2284658716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe080005180 msgr2=0x7fe08000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:58.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.414+0000 7fe095f87640 1 --2- 172.21.15.5:0/2284658716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe080005180 0x7fe08000b990 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fe088001fc0 tx=0x7fe08801f050 comp rx=0 tx=0).stop 2023-07-14T13:09:58.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.414+0000 7fe095786640 1 -- 172.21.15.5:0/2284658716 reap_dead start 2023-07-14T13:09:58.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.414+0000 7fe095f87640 1 -- 172.21.15.5:0/2284658716 shutdown_connections 2023-07-14T13:09:58.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.414+0000 7fe095f87640 1 -- 172.21.15.5:0/2284658716 >> 172.21.15.5:0/2284658716 conn(0x7fe090069f50 msgr2=0x7fe09006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:58.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.414+0000 7fe095f87640 1 -- 172.21.15.5:0/2284658716 shutdown_connections 2023-07-14T13:09:58.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.414+0000 7fe095f87640 1 -- 172.21.15.5:0/2284658716 wait complete. 2023-07-14T13:09:58.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.418+0000 7fe095f87640 1 Processor -- start 2023-07-14T13:09:58.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.418+0000 7fe095f87640 1 -- start start 2023-07-14T13:09:58.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.418+0000 7fe095f87640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe080005180 0x7fe0901f0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.418+0000 7fe095f87640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe09014e280 0x7fe09014e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.418+0000 7fe095f87640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0900c7330 0x7fe0900c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.418+0000 7fe095f87640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0900c7ce0 con 0x7fe0900c7330 2023-07-14T13:09:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.418+0000 7fe095f87640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09014bf30 con 0x7fe09014e280 2023-07-14T13:09:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.418+0000 7fe095f87640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09014c1f0 con 0x7fe080005180 2023-07-14T13:09:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.418+0000 7fe095786640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0900c7330 0x7fe0900c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.418+0000 7fe095786640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0900c7330 0x7fe0900c77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35098/0 (socket says 172.21.15.5:35098) 2023-07-14T13:09:58.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.418+0000 7fe095786640 1 -- 172.21.15.5:0/400397535 learned_addr learned my addr 172.21.15.5:0/400397535 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:58.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.418+0000 7fe08ffff640 1 --2- 172.21.15.5:0/400397535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe09014e280 0x7fe09014e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:58.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.418+0000 7fe094f85640 1 --2- 172.21.15.5:0/400397535 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe080005180 0x7fe0901f0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:58.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.418+0000 7fe095786640 1 -- 172.21.15.5:0/400397535 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe080005180 msgr2=0x7fe0901f0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:58.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.418+0000 7fe095786640 1 --2- 172.21.15.5:0/400397535 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe080005180 0x7fe0901f0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:58.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.418+0000 7fe095786640 1 -- 172.21.15.5:0/400397535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe09014e280 msgr2=0x7fe09014e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:58.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.418+0000 7fe095786640 1 --2- 172.21.15.5:0/400397535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe09014e280 0x7fe09014e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:58.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.418+0000 7fe095786640 1 -- 172.21.15.5:0/400397535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe090152530 con 0x7fe0900c7330 2023-07-14T13:09:58.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.418+0000 7fe095786640 1 --2- 172.21.15.5:0/400397535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0900c7330 0x7fe0900c77a0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fe088001fc0 tx=0x7fe080005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:58.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.418+0000 7fe08d7fa640 1 -- 172.21.15.5:0/400397535 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe088007de0 con 0x7fe0900c7330 2023-07-14T13:09:58.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.418+0000 7fe08d7fa640 1 -- 172.21.15.5:0/400397535 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0880a8a70 con 0x7fe0900c7330 2023-07-14T13:09:58.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.418+0000 7fe08d7fa640 1 -- 172.21.15.5:0/400397535 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe088006d60 con 0x7fe0900c7330 2023-07-14T13:09:58.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.418+0000 7fe095f87640 1 -- 172.21.15.5:0/400397535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09014edd0 con 0x7fe0900c7330 2023-07-14T13:09:58.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.418+0000 7fe095f87640 1 -- 172.21.15.5:0/400397535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09014c4b0 con 0x7fe0900c7330 2023-07-14T13:09:58.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.422+0000 7fe095f87640 1 -- 172.21.15.5:0/400397535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0900c5850 con 0x7fe0900c7330 2023-07-14T13:09:58.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.422+0000 7fe08d7fa640 1 -- 172.21.15.5:0/400397535 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe0880050d0 con 0x7fe0900c7330 2023-07-14T13:09:58.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.422+0000 7fe08d7fa640 1 --2- 172.21.15.5:0/400397535 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fe0740663d0 0x7fe074068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:58.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.422+0000 7fe08d7fa640 1 -- 172.21.15.5:0/400397535 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe088120a90 con 0x7fe0900c7330 2023-07-14T13:09:58.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.422+0000 7fe094f85640 1 --2- 172.21.15.5:0/400397535 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fe0740663d0 0x7fe074068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:58.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.422+0000 7fe094f85640 1 --2- 172.21.15.5:0/400397535 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fe0740663d0 0x7fe074068880 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe084005ac0 tx=0x7fe084007040 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:58.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.426+0000 7fe08d7fa640 1 -- 172.21.15.5:0/400397535 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe0880ede10 con 0x7fe0900c7330 2023-07-14T13:09:58.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.614+0000 7fe095f87640 1 -- 172.21.15.5:0/400397535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0900c5850 con 0x7fe0900c7330 2023-07-14T13:09:58.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.614+0000 7fe08d7fa640 1 -- 172.21.15.5:0/400397535 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4705 (secure 0 0 0) 0x7fe0880c1070 con 0x7fe0900c7330 2023-07-14T13:09:58.647 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:09:58.647 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6575,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1957957644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1957957644},{"type":"v1","addr":"172.21.15.5:6835","nonce":1957957644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3439623726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3439623726},{"type":"v1","addr":"172.21.15.154:6837","nonce":3439623726}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7384,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/692576619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":692576619},{"type":"v1","addr":"172.21.15.154:6836","nonce":692576619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:09:48.156588+0000","modified":"2023-07-14T13:09:51.784254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7668},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7668":{"gid":7668,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/855157103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":855157103},{"type":"v1","addr":"172.21.15.5:6834","nonce":855157103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-14T13:09:58.647 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 49 2023-07-14T13:09:58.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.618+0000 7fe095f87640 1 -- 172.21.15.5:0/400397535 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fe0740663d0 msgr2=0x7fe074068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:58.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.618+0000 7fe095f87640 1 --2- 172.21.15.5:0/400397535 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fe0740663d0 0x7fe074068880 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe084005ac0 tx=0x7fe084007040 comp rx=0 tx=0).stop 2023-07-14T13:09:58.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.618+0000 7fe095f87640 1 -- 172.21.15.5:0/400397535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0900c7330 msgr2=0x7fe0900c77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:58.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.618+0000 7fe095f87640 1 --2- 172.21.15.5:0/400397535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0900c7330 0x7fe0900c77a0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fe088001fc0 tx=0x7fe080005800 comp rx=0 tx=0).stop 2023-07-14T13:09:58.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.618+0000 7fe095f87640 1 -- 172.21.15.5:0/400397535 shutdown_connections 2023-07-14T13:09:58.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.618+0000 7fe095f87640 1 --2- 172.21.15.5:0/400397535 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fe0740663d0 0x7fe074068880 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:58.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.618+0000 7fe095f87640 1 --2- 172.21.15.5:0/400397535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0900c7330 0x7fe0900c77a0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:58.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.618+0000 7fe095f87640 1 --2- 172.21.15.5:0/400397535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe09014e280 0x7fe09014e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:58.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.618+0000 7fe095f87640 1 --2- 172.21.15.5:0/400397535 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe080005180 0x7fe0901f0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:58.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.618+0000 7fe095f87640 1 -- 172.21.15.5:0/400397535 >> 172.21.15.5:0/400397535 conn(0x7fe090069f50 msgr2=0x7fe09006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:58.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.618+0000 7fe095f87640 1 -- 172.21.15.5:0/400397535 shutdown_connections 2023-07-14T13:09:58.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:58.618+0000 7fe095f87640 1 -- 172.21.15.5:0/400397535 wait complete. 2023-07-14T13:09:59.070 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-14T13:09:48.156588+0000', 'modified': '2023-07-14T13:09:51.784254+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7668}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7668': {'gid': 7668, 'name': 'c', 'rank': 0, 'incarnation': 45, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6834/855157103', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6832', 'nonce': 855157103}, {'type': 'v1', 'addr': '172.21.15.5:6834', 'nonce': 855157103}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-14T13:09:59.071 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-14T13:09:59.071 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-14T13:09:59.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.190+0000 7fc83a1fa640 1 Processor -- start 2023-07-14T13:09:59.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.190+0000 7fc83a1fa640 1 -- start start 2023-07-14T13:09:59.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.190+0000 7fc83a1fa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc8340c8ad0 0x7fc8340c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.190+0000 7fc83a1fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8340c9560 0x7fc8340ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.190+0000 7fc83a1fa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8340cc700 con 0x7fc834158ce0 2023-07-14T13:09:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.190+0000 7fc83a1fa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8340c99e0 con 0x7fc8340c8ad0 2023-07-14T13:09:59.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.190+0000 7fc83a1fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8340b0ff0 con 0x7fc8340c9560 2023-07-14T13:09:59.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.190+0000 7fc832ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc8340c8ad0 0x7fc8340c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:59.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.190+0000 7fc832ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc8340c8ad0 0x7fc8340c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38802/0 (socket says 172.21.15.5:38802) 2023-07-14T13:09:59.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.190+0000 7fc832ffd640 1 -- 172.21.15.5:0/1317775711 learned_addr learned my addr 172.21.15.5:0/1317775711 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:59.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.190+0000 7fc833fff640 1 --2- 172.21.15.5:0/1317775711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8340c9560 0x7fc8340ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:59.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.190+0000 7fc832ffd640 1 -- 172.21.15.5:0/1317775711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8340c9560 msgr2=0x7fc8340ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:59.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.190+0000 7fc832ffd640 1 --2- 172.21.15.5:0/1317775711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8340c9560 0x7fc8340ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.190+0000 7fc832ffd640 1 -- 172.21.15.5:0/1317775711 >> v1:172.21.15.154:6789/0 conn(0x7fc834158ce0 legacy=0x7fc834070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:59.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.190+0000 7fc832ffd640 1 -- 172.21.15.5:0/1317775711 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc834070c80 con 0x7fc8340c8ad0 2023-07-14T13:09:59.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.194+0000 7fc832ffd640 1 --2- 172.21.15.5:0/1317775711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8340c8ad0 0x7fc8340c9020 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fc828009870 tx=0x7fc82801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3e630ac2ba0e69 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:59.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.194+0000 7fc8327fc640 1 -- 172.21.15.5:0/1317775711 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8280ab5f0 con 0x7fc8340c8ad0 2023-07-14T13:09:59.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.194+0000 7fc8327fc640 1 -- 172.21.15.5:0/1317775711 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8280ab750 con 0x7fc8340c8ad0 2023-07-14T13:09:59.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.194+0000 7fc8327fc640 1 -- 172.21.15.5:0/1317775711 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8280abae0 con 0x7fc8340c8ad0 2023-07-14T13:09:59.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.194+0000 7fc83a1fa640 1 -- 172.21.15.5:0/1317775711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8340c8ad0 msgr2=0x7fc8340c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:59.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.194+0000 7fc83a1fa640 1 --2- 172.21.15.5:0/1317775711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8340c8ad0 0x7fc8340c9020 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fc828009870 tx=0x7fc82801c3f0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.194+0000 7fc83a1fa640 1 -- 172.21.15.5:0/1317775711 shutdown_connections 2023-07-14T13:09:59.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.194+0000 7fc83a1fa640 1 --2- 172.21.15.5:0/1317775711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8340c9560 0x7fc8340ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.194+0000 7fc83a1fa640 1 --2- 172.21.15.5:0/1317775711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8340c8ad0 0x7fc8340c9020 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.194+0000 7fc83a1fa640 1 -- 172.21.15.5:0/1317775711 >> 172.21.15.5:0/1317775711 conn(0x7fc8340afcf0 msgr2=0x7fc8340b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:59.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.194+0000 7fc83a1fa640 1 -- 172.21.15.5:0/1317775711 shutdown_connections 2023-07-14T13:09:59.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.194+0000 7fc83a1fa640 1 -- 172.21.15.5:0/1317775711 wait complete. 2023-07-14T13:09:59.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.194+0000 7fc83a1fa640 1 Processor -- start 2023-07-14T13:09:59.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.198+0000 7fc83a1fa640 1 -- start start 2023-07-14T13:09:59.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.198+0000 7fc83a1fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8340c8ad0 0x7fc83414a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:59.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.198+0000 7fc83a1fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8340c9560 0x7fc83415bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:59.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.198+0000 7fc83a1fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc834158ce0 0x7fc83414d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:59.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.198+0000 7fc83a1fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83414ace0 con 0x7fc8340c8ad0 2023-07-14T13:09:59.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.198+0000 7fc83a1fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83414afc0 con 0x7fc834158ce0 2023-07-14T13:09:59.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.198+0000 7fc83a1fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83414b2a0 con 0x7fc8340c9560 2023-07-14T13:09:59.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.198+0000 7fc8337fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8340c8ad0 0x7fc83414a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:59.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.198+0000 7fc8337fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8340c8ad0 0x7fc83414a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38812/0 (socket says 172.21.15.5:38812) 2023-07-14T13:09:59.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.198+0000 7fc8337fe640 1 -- 172.21.15.5:0/766359954 learned_addr learned my addr 172.21.15.5:0/766359954 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:59.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.198+0000 7fc832ffd640 1 --2- 172.21.15.5:0/766359954 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8340c9560 0x7fc83415bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:59.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.198+0000 7fc833fff640 1 --2- 172.21.15.5:0/766359954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc834158ce0 0x7fc83414d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.198+0000 7fc8337fe640 1 -- 172.21.15.5:0/766359954 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8340c9560 msgr2=0x7fc83415bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.198+0000 7fc8337fe640 1 --2- 172.21.15.5:0/766359954 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8340c9560 0x7fc83415bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.198+0000 7fc8337fe640 1 -- 172.21.15.5:0/766359954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc834158ce0 msgr2=0x7fc83414d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.198+0000 7fc8337fe640 1 --2- 172.21.15.5:0/766359954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc834158ce0 0x7fc83414d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.198+0000 7fc8337fe640 1 -- 172.21.15.5:0/766359954 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8280094d0 con 0x7fc8340c8ad0 2023-07-14T13:09:59.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.198+0000 7fc833fff640 1 --2- 172.21.15.5:0/766359954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc834158ce0 0x7fc83414d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:59.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.198+0000 7fc8337fe640 1 --2- 172.21.15.5:0/766359954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8340c8ad0 0x7fc83414a700 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fc82400c3c0 tx=0x7fc82400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:59.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.198+0000 7fc81bfff640 1 -- 172.21.15.5:0/766359954 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8240052d0 con 0x7fc8340c8ad0 2023-07-14T13:09:59.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.198+0000 7fc81bfff640 1 -- 172.21.15.5:0/766359954 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc824005430 con 0x7fc8340c8ad0 2023-07-14T13:09:59.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.198+0000 7fc81bfff640 1 -- 172.21.15.5:0/766359954 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc824003840 con 0x7fc8340c8ad0 2023-07-14T13:09:59.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.198+0000 7fc83a1fa640 1 -- 172.21.15.5:0/766359954 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83414b580 con 0x7fc8340c8ad0 2023-07-14T13:09:59.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.198+0000 7fc83a1fa640 1 -- 172.21.15.5:0/766359954 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83415c000 con 0x7fc8340c8ad0 2023-07-14T13:09:59.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.202+0000 7fc81bfff640 1 -- 172.21.15.5:0/766359954 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc8240039a0 con 0x7fc8340c8ad0 2023-07-14T13:09:59.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.202+0000 7fc81bfff640 1 --2- 172.21.15.5:0/766359954 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fc8200663a0 0x7fc820068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:59.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.202+0000 7fc81bfff640 1 -- 172.21.15.5:0/766359954 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc8240833b0 con 0x7fc8340c8ad0 2023-07-14T13:09:59.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.202+0000 7fc832ffd640 1 --2- 172.21.15.5:0/766359954 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fc8200663a0 0x7fc820068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:59.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.202+0000 7fc83d561000 1 Processor -- start 2023-07-14T13:09:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.202+0000 7fc83d561000 1 -- start start 2023-07-14T13:09:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.202+0000 7fc832ffd640 1 --2- 172.21.15.5:0/766359954 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fc8200663a0 0x7fc820068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc8280af000 tx=0x7fc8280b6040 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:59.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.202+0000 7fc83d561000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e859f80 0x561c3e85a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:59.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.202+0000 7fc83d561000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x561c3e85a890 0x561c3e8103f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:59.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.202+0000 7fc83d561000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c3e810930 0x561c3e810d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:59.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.202+0000 7fc83d561000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c3e6d7900 con 0x561c3e859f80 2023-07-14T13:09:59.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.202+0000 7fc83d561000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c3e6118c0 con 0x561c3e810930 2023-07-14T13:09:59.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.202+0000 7fc83d561000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c3e665360 con 0x561c3e85a890 2023-07-14T13:09:59.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.202+0000 7fc8337fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e859f80 0x561c3e85a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:59.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.202+0000 7fc8337fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e859f80 0x561c3e85a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38826/0 (socket says 172.21.15.5:38826) 2023-07-14T13:09:59.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.202+0000 7fc8337fe640 1 -- 172.21.15.5:0/2189785216 learned_addr learned my addr 172.21.15.5:0/2189785216 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:59.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.202+0000 7fc832ffd640 1 --2- 172.21.15.5:0/2189785216 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x561c3e85a890 0x561c3e8103f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:59.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.202+0000 7fc833fff640 1 --2- 172.21.15.5:0/2189785216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c3e810930 0x561c3e810d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:59.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc8337fe640 1 -- 172.21.15.5:0/2189785216 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x561c3e85a890 msgr2=0x561c3e8103f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:59.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc8337fe640 1 --2- 172.21.15.5:0/2189785216 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x561c3e85a890 0x561c3e8103f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc8337fe640 1 -- 172.21.15.5:0/2189785216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c3e810930 msgr2=0x561c3e810d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:59.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc8337fe640 1 --2- 172.21.15.5:0/2189785216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c3e810930 0x561c3e810d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc8337fe640 1 -- 172.21.15.5:0/2189785216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c3e35a890 con 0x561c3e859f80 2023-07-14T13:09:59.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc8337fe640 1 --2- 172.21.15.5:0/2189785216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e859f80 0x561c3e85a350 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fc82400c390 tx=0x7fc824058440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ab94cb32c04c43 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:59.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc8197fa640 1 -- 172.21.15.5:0/2189785216 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8240830d0 con 0x561c3e859f80 2023-07-14T13:09:59.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc8197fa640 1 -- 172.21.15.5:0/2189785216 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8240816d0 con 0x561c3e859f80 2023-07-14T13:09:59.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc8197fa640 1 -- 172.21.15.5:0/2189785216 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc824083230 con 0x561c3e859f80 2023-07-14T13:09:59.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc83d561000 1 -- 172.21.15.5:0/2189785216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e859f80 msgr2=0x561c3e85a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:59.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc83d561000 1 --2- 172.21.15.5:0/2189785216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e859f80 0x561c3e85a350 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fc82400c390 tx=0x7fc824058440 comp rx=0 tx=0).stop 2023-07-14T13:09:59.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc83d561000 1 -- 172.21.15.5:0/2189785216 shutdown_connections 2023-07-14T13:09:59.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc83d561000 1 --2- 172.21.15.5:0/2189785216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c3e810930 0x561c3e810d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc83d561000 1 --2- 172.21.15.5:0/2189785216 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x561c3e85a890 0x561c3e8103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc83d561000 1 --2- 172.21.15.5:0/2189785216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e859f80 0x561c3e85a350 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc83d561000 1 -- 172.21.15.5:0/2189785216 >> 172.21.15.5:0/2189785216 conn(0x561c3e816a90 msgr2=0x561c3e80ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:59.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc83d561000 1 -- 172.21.15.5:0/2189785216 shutdown_connections 2023-07-14T13:09:59.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc83d561000 1 -- 172.21.15.5:0/2189785216 wait complete. 2023-07-14T13:09:59.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc83d561000 1 -- start start 2023-07-14T13:09:59.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc83d561000 1 Processor -- start 2023-07-14T13:09:59.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc83d561000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x561c3e810930 0x561c3e8610b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:59.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc83d561000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c3e859f80 0x561c3e8615f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:59.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc83d561000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e85a890 0x561c3e81b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:59.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc83d561000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c3e65e400 con 0x561c3e85a890 2023-07-14T13:09:59.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc83d561000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c3e61ab60 con 0x561c3e859f80 2023-07-14T13:09:59.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc83d561000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c3e61a800 con 0x561c3e810930 2023-07-14T13:09:59.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc83d561000 10 client.0 _ll_register_callbacks cb 0x561c3e7fc2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:09:59.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc833fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e85a890 0x561c3e81b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:59.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc833fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e85a890 0x561c3e81b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38840/0 (socket says 172.21.15.5:38840) 2023-07-14T13:09:59.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc833fff640 1 -- 172.21.15.5:0/2123422784 learned_addr learned my addr 172.21.15.5:0/2123422784 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:59.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.206+0000 7fc832ffd640 1 --2- 172.21.15.5:0/2123422784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c3e859f80 0x561c3e8615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:59.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc8337fe640 1 --2- 172.21.15.5:0/2123422784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x561c3e810930 0x561c3e8610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:59.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc833fff640 1 -- 172.21.15.5:0/2123422784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x561c3e810930 msgr2=0x561c3e8610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:59.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc833fff640 1 --2- 172.21.15.5:0/2123422784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x561c3e810930 0x561c3e8610b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc833fff640 1 -- 172.21.15.5:0/2123422784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c3e859f80 msgr2=0x561c3e8615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc833fff640 1 --2- 172.21.15.5:0/2123422784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c3e859f80 0x561c3e8615f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc833fff640 1 -- 172.21.15.5:0/2123422784 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83415c000 con 0x561c3e85a890 2023-07-14T13:09:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc833fff640 1 --2- 172.21.15.5:0/2123422784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e85a890 0x561c3e81b570 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fc82c007de0 tx=0x7fc82c012610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5999a4bd85b7f9c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc8127fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-07-14T13:09:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc8127fc640 1 -- 172.21.15.5:0/2123422784 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c018670 con 0x561c3e85a890 2023-07-14T13:09:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc83d561000 1 -- 172.21.15.5:0/2123422784 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c3e625aa0 con 0x561c3e85a890 2023-07-14T13:09:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc8127fc640 1 -- 172.21.15.5:0/2123422784 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc82c0187d0 con 0x561c3e85a890 2023-07-14T13:09:59.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc8127fc640 1 -- 172.21.15.5:0/2123422784 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc82c012ea0 con 0x561c3e85a890 2023-07-14T13:09:59.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc83d561000 10 client.7851 fetch_fsmap learned FSMap version 49 2023-07-14T13:09:59.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc83d561000 1 -- 172.21.15.5:0/2123422784 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x561c3e622d90 con 0x561c3e85a890 2023-07-14T13:09:59.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc8127fc640 1 -- 172.21.15.5:0/2123422784 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561c3e625aa0 con 0x561c3e85a890 2023-07-14T13:09:59.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc8127fc640 1 -- 172.21.15.5:0/2123422784 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 49) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc82c014040 con 0x561c3e85a890 2023-07-14T13:09:59.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc83d561000 10 client.7851 fetch_fsmap finished waiting for FSMap version 49 2023-07-14T13:09:59.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc83d561000 10 client.7851 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T13:09:59.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc83d561000 20 client.7851 populate_metadata read hostname 'smithi005' 2023-07-14T13:09:59.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc83d561000 1 --2- 172.21.15.5:0/2123422784 >> [v2:172.21.15.5:6832/855157103,v1:172.21.15.5:6834/855157103] conn(0x561c3e81c310 0x561c3e81c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:59.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc83d561000 4 client.7851 mds_command: new command op to 7668 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:09:59.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc83d561000 1 -- 172.21.15.5:0/2123422784 --> [v2:172.21.15.5:6832/855157103,v1:172.21.15.5:6834/855157103] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561c3e68cf40 con 0x561c3e81c310 2023-07-14T13:09:59.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc8337fe640 1 --2- 172.21.15.5:0/2123422784 >> [v2:172.21.15.5:6832/855157103,v1:172.21.15.5:6834/855157103] conn(0x561c3e81c310 0x561c3e81c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:59.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc8337fe640 1 --2- 172.21.15.5:0/2123422784 >> [v2:172.21.15.5:6832/855157103,v1:172.21.15.5:6834/855157103] conn(0x561c3e81c310 0x561c3e81c6e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e8f3c63014f74cc server_cookie=465c91ac354e6e7d in_seq=0 out_seq=0 2023-07-14T13:09:59.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc8127fc640 10 client.7851 ms_handle_connect on v2:172.21.15.5:6832/855157103 2023-07-14T13:09:59.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc8127fc640 1 -- 172.21.15.5:0/2123422784 <== mds.0 v2:172.21.15.5:6832/855157103 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561c3e68cf40 con 0x561c3e81c310 2023-07-14T13:09:59.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc8127fc640 10 client.7851 handle_command_reply: tid=0 2023-07-14T13:09:59.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc83d561000 1 client.7851 shutdown 2023-07-14T13:09:59.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc83d561000 1 -- 172.21.15.5:0/2123422784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e85a890 msgr2=0x561c3e81b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:59.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc83d561000 1 --2- 172.21.15.5:0/2123422784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e85a890 0x561c3e81b570 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fc82c007de0 tx=0x7fc82c012610 comp rx=0 tx=0).stop 2023-07-14T13:09:59.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc83d561000 1 -- 172.21.15.5:0/2123422784 shutdown_connections 2023-07-14T13:09:59.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc83d561000 1 --2- 172.21.15.5:0/2123422784 >> [v2:172.21.15.5:6832/855157103,v1:172.21.15.5:6834/855157103] conn(0x561c3e81c310 0x561c3e81c6e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc83d561000 1 --2- 172.21.15.5:0/2123422784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e85a890 0x561c3e81b570 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc83d561000 1 --2- 172.21.15.5:0/2123422784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c3e859f80 0x561c3e8615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc8127fc640 0 client.7851 ms_handle_reset on v2:172.21.15.5:6832/855157103 2023-07-14T13:09:59.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc83d561000 1 --2- 172.21.15.5:0/2123422784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x561c3e810930 0x561c3e8610b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc83d561000 1 -- 172.21.15.5:0/2123422784 >> 172.21.15.5:0/2123422784 conn(0x561c3e816a90 msgr2=0x561c3e80f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:59.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc83d561000 1 -- 172.21.15.5:0/2123422784 shutdown_connections 2023-07-14T13:09:59.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc83d561000 1 -- 172.21.15.5:0/2123422784 wait complete. 2023-07-14T13:09:59.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.210+0000 7fc83d561000 20 client.7851 trim_cache size 0 max 16384 2023-07-14T13:09:59.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.226+0000 7fc83d561000 1 Processor -- start 2023-07-14T13:09:59.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.226+0000 7fc83d561000 1 -- start start 2023-07-14T13:09:59.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.226+0000 7fc83d561000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c3e810930 0x561c3e8b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:59.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.226+0000 7fc83d561000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e859f80 0x561c3e8b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:59.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc83d561000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x561c3e85a890 0x561c3e8b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:59.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc83d561000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c3e31b940 con 0x561c3e859f80 2023-07-14T13:09:59.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc83d561000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c3e62ce90 con 0x561c3e810930 2023-07-14T13:09:59.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc83d561000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c3e65d290 con 0x561c3e85a890 2023-07-14T13:09:59.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc832ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e859f80 0x561c3e8b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:59.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc832ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e859f80 0x561c3e8b3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38850/0 (socket says 172.21.15.5:38850) 2023-07-14T13:09:59.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc832ffd640 1 -- 172.21.15.5:0/2801480956 learned_addr learned my addr 172.21.15.5:0/2801480956 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:59.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc8337fe640 1 --2- 172.21.15.5:0/2801480956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c3e810930 0x561c3e8b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:59.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc833fff640 1 --2- 172.21.15.5:0/2801480956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x561c3e85a890 0x561c3e8b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:59.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc832ffd640 1 -- 172.21.15.5:0/2801480956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x561c3e85a890 msgr2=0x561c3e8b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:59.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc832ffd640 1 --2- 172.21.15.5:0/2801480956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x561c3e85a890 0x561c3e8b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc832ffd640 1 -- 172.21.15.5:0/2801480956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c3e810930 msgr2=0x561c3e8b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:59.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc832ffd640 1 --2- 172.21.15.5:0/2801480956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c3e810930 0x561c3e8b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc832ffd640 1 -- 172.21.15.5:0/2801480956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c3e813000 con 0x561c3e859f80 2023-07-14T13:09:59.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc832ffd640 1 --2- 172.21.15.5:0/2801480956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e859f80 0x561c3e8b3e80 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fc82801a020 tx=0x7fc828004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82446fac2cef9ce2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc819ffb640 1 -- 172.21.15.5:0/2801480956 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8280abdd0 con 0x561c3e859f80 2023-07-14T13:09:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc819ffb640 1 -- 172.21.15.5:0/2801480956 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8280c6040 con 0x561c3e859f80 2023-07-14T13:09:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc819ffb640 1 -- 172.21.15.5:0/2801480956 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828003820 con 0x561c3e859f80 2023-07-14T13:09:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc83d561000 1 -- 172.21.15.5:0/2801480956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e859f80 msgr2=0x561c3e8b3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc83d561000 1 --2- 172.21.15.5:0/2801480956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e859f80 0x561c3e8b3e80 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fc82801a020 tx=0x7fc828004740 comp rx=0 tx=0).stop 2023-07-14T13:09:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc83d561000 1 -- 172.21.15.5:0/2801480956 shutdown_connections 2023-07-14T13:09:59.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc83d561000 1 --2- 172.21.15.5:0/2801480956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x561c3e85a890 0x561c3e8b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc83d561000 1 --2- 172.21.15.5:0/2801480956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e859f80 0x561c3e8b3e80 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc83d561000 1 --2- 172.21.15.5:0/2801480956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c3e810930 0x561c3e8b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc83d561000 1 -- 172.21.15.5:0/2801480956 >> 172.21.15.5:0/2801480956 conn(0x561c3e816a90 msgr2=0x561c3e815b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:59.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc83d561000 1 -- 172.21.15.5:0/2801480956 shutdown_connections 2023-07-14T13:09:59.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc83d561000 1 -- 172.21.15.5:0/2801480956 wait complete. 2023-07-14T13:09:59.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc83d561000 1 -- start start 2023-07-14T13:09:59.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc83d561000 1 Processor -- start 2023-07-14T13:09:59.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc83d561000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c3e810930 0x561c3e85e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:59.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc83d561000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e859f80 0x561c3e85eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:59.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc83d561000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x561c3e85a890 0x561c3e85f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:59.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc83d561000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c3e867130 con 0x561c3e859f80 2023-07-14T13:09:59.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc83d561000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c3e62d3a0 con 0x561c3e810930 2023-07-14T13:09:59.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc83d561000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c3e61f7b0 con 0x561c3e85a890 2023-07-14T13:09:59.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.230+0000 7fc83d561000 10 client.0 _ll_register_callbacks cb 0x561c3e7dc4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:09:59.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc832ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e859f80 0x561c3e85eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:59.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc832ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e859f80 0x561c3e85eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38864/0 (socket says 172.21.15.5:38864) 2023-07-14T13:09:59.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc832ffd640 1 -- 172.21.15.5:0/1772912001 learned_addr learned my addr 172.21.15.5:0/1772912001 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:59.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc833fff640 1 --2- 172.21.15.5:0/1772912001 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x561c3e85a890 0x561c3e85f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:59.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc8337fe640 1 --2- 172.21.15.5:0/1772912001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c3e810930 0x561c3e85e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:59.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc832ffd640 1 -- 172.21.15.5:0/1772912001 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x561c3e85a890 msgr2=0x561c3e85f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:59.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc832ffd640 1 --2- 172.21.15.5:0/1772912001 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x561c3e85a890 0x561c3e85f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc832ffd640 1 -- 172.21.15.5:0/1772912001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c3e810930 msgr2=0x561c3e85e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:59.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc832ffd640 1 --2- 172.21.15.5:0/1772912001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c3e810930 0x561c3e85e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc832ffd640 1 -- 172.21.15.5:0/1772912001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc834070c80 con 0x561c3e859f80 2023-07-14T13:09:59.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc833fff640 1 --2- 172.21.15.5:0/1772912001 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x561c3e85a890 0x561c3e85f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:59.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc8337fe640 1 --2- 172.21.15.5:0/1772912001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c3e810930 0x561c3e85e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:59.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc832ffd640 1 --2- 172.21.15.5:0/1772912001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e859f80 0x561c3e85eb60 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fc8280cd040 tx=0x7fc8280046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7935a6647da94b20 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:59.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc8127fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-07-14T13:09:59.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc8127fc640 1 -- 172.21.15.5:0/1772912001 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828003bb0 con 0x561c3e859f80 2023-07-14T13:09:59.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc8127fc640 1 -- 172.21.15.5:0/1772912001 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc8280a8050 con 0x561c3e859f80 2023-07-14T13:09:59.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc83d561000 1 -- 172.21.15.5:0/1772912001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c3e65cd50 con 0x561c3e859f80 2023-07-14T13:09:59.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc8127fc640 1 -- 172.21.15.5:0/1772912001 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc828003d10 con 0x561c3e859f80 2023-07-14T13:09:59.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc83d561000 10 client.7857 fetch_fsmap learned FSMap version 49 2023-07-14T13:09:59.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc83d561000 1 -- 172.21.15.5:0/1772912001 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x561c3e609020 con 0x561c3e859f80 2023-07-14T13:09:59.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc8127fc640 1 -- 172.21.15.5:0/1772912001 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561c3e65cd50 con 0x561c3e859f80 2023-07-14T13:09:59.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc8127fc640 1 -- 172.21.15.5:0/1772912001 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 49) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc8280aa070 con 0x561c3e859f80 2023-07-14T13:09:59.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc83d561000 10 client.7857 fetch_fsmap finished waiting for FSMap version 49 2023-07-14T13:09:59.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc83d561000 10 client.7857 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T13:09:59.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc83d561000 20 client.7857 populate_metadata read hostname 'smithi005' 2023-07-14T13:09:59.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc83d561000 1 --2- 172.21.15.5:0/1772912001 >> [v2:172.21.15.5:6832/855157103,v1:172.21.15.5:6834/855157103] conn(0x561c3e8bdbc0 0x561c3e8bffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:59.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc83d561000 4 client.7857 mds_command: new command op to 7668 tid=0[{"prefix": "status"}] 2023-07-14T13:09:59.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc83d561000 1 -- 172.21.15.5:0/1772912001 --> [v2:172.21.15.5:6832/855157103,v1:172.21.15.5:6834/855157103] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561c3e6573e0 con 0x561c3e8bdbc0 2023-07-14T13:09:59.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc8337fe640 1 --2- 172.21.15.5:0/1772912001 >> [v2:172.21.15.5:6832/855157103,v1:172.21.15.5:6834/855157103] conn(0x561c3e8bdbc0 0x561c3e8bffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:59.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc8337fe640 1 --2- 172.21.15.5:0/1772912001 >> [v2:172.21.15.5:6832/855157103,v1:172.21.15.5:6834/855157103] conn(0x561c3e8bdbc0 0x561c3e8bffa0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24eb482d11f28d2d server_cookie=eee4c915a10be7e5 in_seq=0 out_seq=0 2023-07-14T13:09:59.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc8127fc640 10 client.7857 ms_handle_connect on v2:172.21.15.5:6832/855157103 2023-07-14T13:09:59.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc8127fc640 1 -- 172.21.15.5:0/1772912001 <== mds.0 v2:172.21.15.5:6832/855157103 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+321 (crc 0 0 0) 0x561c3e6573e0 con 0x561c3e8bdbc0 2023-07-14T13:09:59.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc8127fc640 10 client.7857 handle_command_reply: tid=0 2023-07-14T13:09:59.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc83d561000 1 client.7857 shutdown 2023-07-14T13:09:59.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc83d561000 1 -- 172.21.15.5:0/1772912001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e859f80 msgr2=0x561c3e85eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:59.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc83d561000 1 --2- 172.21.15.5:0/1772912001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e859f80 0x561c3e85eb60 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fc8280cd040 tx=0x7fc8280046d0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc83d561000 1 -- 172.21.15.5:0/1772912001 shutdown_connections 2023-07-14T13:09:59.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc83d561000 1 --2- 172.21.15.5:0/1772912001 >> [v2:172.21.15.5:6832/855157103,v1:172.21.15.5:6834/855157103] conn(0x561c3e8bdbc0 0x561c3e8bffa0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc83d561000 1 --2- 172.21.15.5:0/1772912001 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x561c3e85a890 0x561c3e85f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc83d561000 1 --2- 172.21.15.5:0/1772912001 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c3e859f80 0x561c3e85eb60 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc83d561000 1 --2- 172.21.15.5:0/1772912001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c3e810930 0x561c3e85e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc8127fc640 0 client.7857 ms_handle_reset on v2:172.21.15.5:6832/855157103 2023-07-14T13:09:59.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc83d561000 1 -- 172.21.15.5:0/1772912001 >> 172.21.15.5:0/1772912001 conn(0x561c3e816a90 msgr2=0x561c3e8588c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:59.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc83d561000 1 -- 172.21.15.5:0/1772912001 shutdown_connections 2023-07-14T13:09:59.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc83d561000 1 -- 172.21.15.5:0/1772912001 wait complete. 2023-07-14T13:09:59.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc83d561000 20 client.7857 trim_cache size 0 max 16384 2023-07-14T13:09:59.276 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T13:09:59.276 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "22affb8d-e389-40f8-a764-dd40eb1759c8", 2023-07-14T13:09:59.276 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-07-14T13:09:59.276 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 7668, 2023-07-14T13:09:59.276 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-07-14T13:09:59.276 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-07-14T13:09:59.276 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-07-14T13:09:59.277 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 10.468782636, 2023-07-14T13:09:59.277 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 49, 2023-07-14T13:09:59.277 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 111, 2023-07-14T13:09:59.277 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 111, 2023-07-14T13:09:59.277 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 16.750297004 2023-07-14T13:09:59.277 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T13:09:59.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc83a1fa640 1 -- 172.21.15.5:0/766359954 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fc8200663a0 msgr2=0x7fc820068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:59.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc83a1fa640 1 --2- 172.21.15.5:0/766359954 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fc8200663a0 0x7fc820068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc8280af000 tx=0x7fc8280b6040 comp rx=0 tx=0).stop 2023-07-14T13:09:59.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc83a1fa640 1 -- 172.21.15.5:0/766359954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8340c8ad0 msgr2=0x7fc83414a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:59.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.234+0000 7fc83a1fa640 1 --2- 172.21.15.5:0/766359954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8340c8ad0 0x7fc83414a700 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fc82400c3c0 tx=0x7fc82400c880 comp rx=0 tx=0).stop 2023-07-14T13:09:59.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.238+0000 7fc83a1fa640 1 -- 172.21.15.5:0/766359954 shutdown_connections 2023-07-14T13:09:59.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.238+0000 7fc83a1fa640 1 --2- 172.21.15.5:0/766359954 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fc8200663a0 0x7fc820068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.238+0000 7fc83a1fa640 1 --2- 172.21.15.5:0/766359954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc834158ce0 0x7fc83414d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.238+0000 7fc83a1fa640 1 --2- 172.21.15.5:0/766359954 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8340c9560 0x7fc83415bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.238+0000 7fc83a1fa640 1 --2- 172.21.15.5:0/766359954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8340c8ad0 0x7fc83414a700 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.238+0000 7fc83a1fa640 1 -- 172.21.15.5:0/766359954 >> 172.21.15.5:0/766359954 conn(0x7fc8340afcf0 msgr2=0x7fc8340ad6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:59.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.238+0000 7fc83a1fa640 1 -- 172.21.15.5:0/766359954 shutdown_connections 2023-07-14T13:09:59.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.238+0000 7fc83a1fa640 1 -- 172.21.15.5:0/766359954 wait complete. 2023-07-14T13:09:59.287 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T13:09:59.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.398+0000 7fcb21f03640 1 Processor -- start 2023-07-14T13:09:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.398+0000 7fcb21f03640 1 -- start start 2023-07-14T13:09:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.402+0000 7fcb21f03640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1c0c8ad0 0x7fcb1c0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.402+0000 7fcb21f03640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcb1c0c9560 0x7fcb1c0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.402+0000 7fcb21f03640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb1c0cc700 con 0x7fcb1c158ce0 2023-07-14T13:09:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.402+0000 7fcb21f03640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb1c0c99e0 con 0x7fcb1c0c9560 2023-07-14T13:09:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.402+0000 7fcb21f03640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c0b0ff0 con 0x7fcb1c0c8ad0 2023-07-14T13:09:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.402+0000 7fcb1bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcb1c0c9560 0x7fcb1c0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.402+0000 7fcb1bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcb1c0c9560 0x7fcb1c0ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38872/0 (socket says 172.21.15.5:38872) 2023-07-14T13:09:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.402+0000 7fcb1bfff640 1 -- 172.21.15.5:0/193446554 learned_addr learned my addr 172.21.15.5:0/193446554 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.402+0000 7fcb1b7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fcb1c158ce0 0x7fcb1c070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:48426/0 (socket says 172.21.15.5:48426) 2023-07-14T13:09:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.402+0000 7fcb1affd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1c0c8ad0 0x7fcb1c0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.402+0000 7fcb1bfff640 1 -- 172.21.15.5:0/193446554 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1c0c8ad0 msgr2=0x7fcb1c0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.402+0000 7fcb1bfff640 1 --2- 172.21.15.5:0/193446554 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1c0c8ad0 0x7fcb1c0c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.402+0000 7fcb1bfff640 1 -- 172.21.15.5:0/193446554 >> v1:172.21.15.154:6789/0 conn(0x7fcb1c158ce0 legacy=0x7fcb1c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.402+0000 7fcb1bfff640 1 -- 172.21.15.5:0/193446554 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb1c070c80 con 0x7fcb1c0c9560 2023-07-14T13:09:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.406+0000 7fcb1bfff640 1 --2- 172.21.15.5:0/193446554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb1c0c9560 0x7fcb1c0ccb90 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fcb14009e50 tx=0x7fcb1401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ea32cfd7b53469 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.406+0000 7fcb1a7fc640 1 -- 172.21.15.5:0/193446554 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb140a5690 con 0x7fcb1c0c9560 2023-07-14T13:09:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.406+0000 7fcb1a7fc640 1 -- 172.21.15.5:0/193446554 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb140a57f0 con 0x7fcb1c0c9560 2023-07-14T13:09:59.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.406+0000 7fcb1a7fc640 1 -- 172.21.15.5:0/193446554 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb140a5b80 con 0x7fcb1c0c9560 2023-07-14T13:09:59.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.406+0000 7fcb21f03640 1 -- 172.21.15.5:0/193446554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb1c0c9560 msgr2=0x7fcb1c0ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.406+0000 7fcb21f03640 1 --2- 172.21.15.5:0/193446554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb1c0c9560 0x7fcb1c0ccb90 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fcb14009e50 tx=0x7fcb1401c8c0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.406+0000 7fcb21f03640 1 -- 172.21.15.5:0/193446554 shutdown_connections 2023-07-14T13:09:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.406+0000 7fcb21f03640 1 --2- 172.21.15.5:0/193446554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb1c0c9560 0x7fcb1c0ccb90 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.406+0000 7fcb21f03640 1 --2- 172.21.15.5:0/193446554 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1c0c8ad0 0x7fcb1c0c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.406+0000 7fcb21f03640 1 -- 172.21.15.5:0/193446554 >> 172.21.15.5:0/193446554 conn(0x7fcb1c0afcf0 msgr2=0x7fcb1c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.406+0000 7fcb21f03640 1 -- 172.21.15.5:0/193446554 shutdown_connections 2023-07-14T13:09:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.406+0000 7fcb21f03640 1 -- 172.21.15.5:0/193446554 wait complete. 2023-07-14T13:09:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.406+0000 7fcb21f03640 1 Processor -- start 2023-07-14T13:09:59.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.406+0000 7fcb21f03640 1 -- start start 2023-07-14T13:09:59.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.406+0000 7fcb21f03640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb1c0c8ad0 0x7fcb1c1482f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:59.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.406+0000 7fcb21f03640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1c0c9560 0x7fcb1c1658c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:59.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.406+0000 7fcb21f03640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1c158ce0 0x7fcb1c14db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:59.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.406+0000 7fcb21f03640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c0c6430 con 0x7fcb1c0c8ad0 2023-07-14T13:09:59.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.406+0000 7fcb21f03640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c166e40 con 0x7fcb1c0c9560 2023-07-14T13:09:59.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.406+0000 7fcb21f03640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c0b1890 con 0x7fcb1c158ce0 2023-07-14T13:09:59.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.410+0000 7fcb1b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb1c0c8ad0 0x7fcb1c1482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:59.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.410+0000 7fcb1b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb1c0c8ad0 0x7fcb1c1482f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38884/0 (socket says 172.21.15.5:38884) 2023-07-14T13:09:59.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.410+0000 7fcb1b7fe640 1 -- 172.21.15.5:0/2591230388 learned_addr learned my addr 172.21.15.5:0/2591230388 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:09:59.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.410+0000 7fcb1affd640 1 --2- 172.21.15.5:0/2591230388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1c0c9560 0x7fcb1c1658c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:59.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.410+0000 7fcb1bfff640 1 --2- 172.21.15.5:0/2591230388 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1c158ce0 0x7fcb1c14db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:59.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.410+0000 7fcb1b7fe640 1 -- 172.21.15.5:0/2591230388 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1c158ce0 msgr2=0x7fcb1c14db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:59.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.410+0000 7fcb1b7fe640 1 --2- 172.21.15.5:0/2591230388 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1c158ce0 0x7fcb1c14db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.410+0000 7fcb1b7fe640 1 -- 172.21.15.5:0/2591230388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1c0c9560 msgr2=0x7fcb1c1658c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:59.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.410+0000 7fcb1b7fe640 1 --2- 172.21.15.5:0/2591230388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1c0c9560 0x7fcb1c1658c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.410+0000 7fcb1b7fe640 1 -- 172.21.15.5:0/2591230388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb14009b30 con 0x7fcb1c0c8ad0 2023-07-14T13:09:59.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.410+0000 7fcb1b7fe640 1 --2- 172.21.15.5:0/2591230388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb1c0c8ad0 0x7fcb1c1482f0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c00c430 tx=0x7fcb0c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.410+0000 7fcb03fff640 1 -- 172.21.15.5:0/2591230388 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c0074e0 con 0x7fcb1c0c8ad0 2023-07-14T13:09:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.410+0000 7fcb03fff640 1 -- 172.21.15.5:0/2591230388 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0c007640 con 0x7fcb1c0c8ad0 2023-07-14T13:09:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.410+0000 7fcb03fff640 1 -- 172.21.15.5:0/2591230388 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c004a10 con 0x7fcb1c0c8ad0 2023-07-14T13:09:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.410+0000 7fcb21f03640 1 -- 172.21.15.5:0/2591230388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb1c166230 con 0x7fcb1c0c8ad0 2023-07-14T13:09:59.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.410+0000 7fcb21f03640 1 -- 172.21.15.5:0/2591230388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb1c1667f0 con 0x7fcb1c0c8ad0 2023-07-14T13:09:59.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.410+0000 7fcb21f03640 1 -- 172.21.15.5:0/2591230388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb1c0ca1a0 con 0x7fcb1c0c8ad0 2023-07-14T13:09:59.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.410+0000 7fcb03fff640 1 -- 172.21.15.5:0/2591230388 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcb0c004b70 con 0x7fcb1c0c8ad0 2023-07-14T13:09:59.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.414+0000 7fcb03fff640 1 --2- 172.21.15.5:0/2591230388 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fcb080663d0 0x7fcb08068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.414+0000 7fcb03fff640 1 -- 172.21.15.5:0/2591230388 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcb0c0837a0 con 0x7fcb1c0c8ad0 2023-07-14T13:09:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.414+0000 7fcb1affd640 1 --2- 172.21.15.5:0/2591230388 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fcb080663d0 0x7fcb08068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.414+0000 7fcb1affd640 1 --2- 172.21.15.5:0/2591230388 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fcb080663d0 0x7fcb08068880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c1f7400 tx=0x7fcb10008040 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.418+0000 7fcb03fff640 1 -- 172.21.15.5:0/2591230388 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fcb0c050b20 con 0x7fcb1c0c8ad0 2023-07-14T13:09:59.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.606+0000 7fcb21f03640 1 -- 172.21.15.5:0/2591230388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcb1c0678d0 con 0x7fcb1c0c8ad0 2023-07-14T13:09:59.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.610+0000 7fcb03fff640 1 -- 172.21.15.5:0/2591230388 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcb0c054140 con 0x7fcb1c0c8ad0 2023-07-14T13:09:59.640 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T13:09:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.610+0000 7fcb21f03640 1 -- 172.21.15.5:0/2591230388 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fcb080663d0 msgr2=0x7fcb08068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.610+0000 7fcb21f03640 1 --2- 172.21.15.5:0/2591230388 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fcb080663d0 0x7fcb08068880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c1f7400 tx=0x7fcb10008040 comp rx=0 tx=0).stop 2023-07-14T13:09:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.610+0000 7fcb21f03640 1 -- 172.21.15.5:0/2591230388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb1c0c8ad0 msgr2=0x7fcb1c1482f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.610+0000 7fcb21f03640 1 --2- 172.21.15.5:0/2591230388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb1c0c8ad0 0x7fcb1c1482f0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c00c430 tx=0x7fcb0c00c8f0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.610+0000 7fcb21f03640 1 -- 172.21.15.5:0/2591230388 shutdown_connections 2023-07-14T13:09:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.610+0000 7fcb21f03640 1 --2- 172.21.15.5:0/2591230388 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fcb080663d0 0x7fcb08068880 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.610+0000 7fcb21f03640 1 --2- 172.21.15.5:0/2591230388 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb1c158ce0 0x7fcb1c14db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.610+0000 7fcb21f03640 1 --2- 172.21.15.5:0/2591230388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1c0c9560 0x7fcb1c1658c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.610+0000 7fcb21f03640 1 --2- 172.21.15.5:0/2591230388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb1c0c8ad0 0x7fcb1c1482f0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.610+0000 7fcb21f03640 1 -- 172.21.15.5:0/2591230388 >> 172.21.15.5:0/2591230388 conn(0x7fcb1c0afcf0 msgr2=0x7fcb1c150730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.610+0000 7fcb21f03640 1 -- 172.21.15.5:0/2591230388 shutdown_connections 2023-07-14T13:09:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:09:59.610+0000 7fcb21f03640 1 -- 172.21.15.5:0/2591230388 wait complete. 2023-07-14T13:09:59.661 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-14T13:09:59.662 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T13:09:59.662 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-07-14T13:09:59.663 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-14T13:09:59.663 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-14T13:09:59.663 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-14T13:09:59.664 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-14T13:09:59.664 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T13:09:59.665 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T13:09:59.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:09:59.665 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-07-14T13:09:59.676 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T13:09:59.676 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T13:09:59.676 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T13:09:59.676 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:09:59.677 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-07-14T13:09:59.677 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:09:59.677 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T13:09:59.677 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-07-14T13:09:59.677 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2023-07-14T13:09:59.677 INFO:teuthology.orchestra.run.smithi005.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T13:09:59.678 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-07-14T13:09:59.678 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2023-07-14T13:09:59.678 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-14T13:09:59.678 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 41317sec preferred_lft 41317sec 2023-07-14T13:09:59.678 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-07-14T13:09:59.678 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:09:59.678 INFO:teuthology.orchestra.run.smithi005.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T13:09:59.678 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-07-14T13:09:59.679 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2023-07-14T13:09:59.679 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T13:09:59.679 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-07-14T13:09:59.679 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2023-07-14T13:09:59.679 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-14T13:09:59.679 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:96:b6:fb:c6 brd ff:ff:ff:ff:ff:ff 2023-07-14T13:09:59.679 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-14T13:09:59.679 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:09:59.680 INFO:teuthology.orchestra.run.smithi005.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T13:09:59.680 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-14T13:09:59.680 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T13:09:59.680 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:09:59.680 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-14T13:09:59.680 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:09:59.681 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T13:09:59.681 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T13:09:59.681 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-14T13:09:59.681 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:09:59.681 INFO:teuthology.orchestra.run.smithi005.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T13:09:59.681 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-14T13:09:59.681 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-14T13:09:59.681 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:09:59.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:09:59.682 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T13:09:59.743 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-07-14T13:09:59.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:09:59.745 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-07-14T13:09:59.801 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-07-14T13:09:59.802 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T13:09:59.802 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-14T13:09:59.802 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-14T13:09:59.802 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-14T13:09:59.802 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T13:09:59.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:09:59.803 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-07-14T13:09:59.803 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-07-14T13:09:59.803 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-14T13:09:59.804 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-14T13:09:59.804 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-14T13:09:59.805 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-07-14T13:09:59.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:09:59.902 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-07-14T13:09:59.912 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-14T13:09:59.912 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-14T13:09:59.912 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T13:09:59.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:09:59.913 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-07-14T13:09:59.977 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T13:09:59.977 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-14T13:10:00.028 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-14T13:10:00.029 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T13:10:00.029 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-14T13:10:00.080 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-14T13:10:00.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:10:00.080 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:10:00.178 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:10:00.178 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T13:10:00.178 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T13:10:00.193 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:10:00.194 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T13:10:00.194 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T13:10:00.194 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T13:10:00.194 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T13:10:00.202 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:10:00.202 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T13:10:00.202 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T13:10:00.202 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T13:10:00.203 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T13:10:00.203 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790" 2023-07-14T13:10:00.203 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790:/ 2023-07-14T13:10:00.203 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=22affb8d-e389-40f8-a764-dd40eb1759c8" will pass to kernel 2023-07-14T13:10:00.206 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T13:10:00.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:10:00.207 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-14T13:10:00.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:10:00.230 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T13:10:00.290 INFO:teuthology.orchestra.run.smithi005.stdout:client7866 2023-07-14T13:10:00.291 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:10:00.292 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:10:00.341 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-14T13:10:00.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.502+0000 7ff581626640 1 Processor -- start 2023-07-14T13:10:00.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.502+0000 7ff581626640 1 -- start start 2023-07-14T13:10:00.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.502+0000 7ff581626640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff57c069430 0x7ff57c069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:00.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.502+0000 7ff581626640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff57c0b4bf0 con 0x7ff57c159c70 2023-07-14T13:10:00.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.502+0000 7ff581626640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff57c0ae8e0 con 0x7ff57c0cfd40 2023-07-14T13:10:00.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.502+0000 7ff581626640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c15e3c0 con 0x7ff57c069430 2023-07-14T13:10:00.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.502+0000 7ff573fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff57c159c70 0x7ff57c15d5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55022/0 (socket says 172.21.15.5:55022) 2023-07-14T13:10:00.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.502+0000 7ff573fff640 1 -- 172.21.15.5:0/4083596652 learned_addr learned my addr 172.21.15.5:0/4083596652 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:10:00.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.502+0000 7ff57affd640 1 --2- 172.21.15.5:0/4083596652 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff57c069430 0x7ff57c069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:00.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.502+0000 7ff57a7fc640 1 -- 172.21.15.5:0/4083596652 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 180599020 0 0) 0x7ff57c0b4bf0 con 0x7ff57c159c70 2023-07-14T13:10:00.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.502+0000 7ff57a7fc640 1 -- 172.21.15.5:0/4083596652 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff568003530 con 0x7ff57c159c70 2023-07-14T13:10:00.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.502+0000 7ff57a7fc640 1 -- 172.21.15.5:0/4083596652 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3701934016 0 0) 0x7ff57c0ae8e0 con 0x7ff57c0cfd40 2023-07-14T13:10:00.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.502+0000 7ff57a7fc640 1 -- 172.21.15.5:0/4083596652 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff57c0b4bf0 con 0x7ff57c0cfd40 2023-07-14T13:10:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.502+0000 7ff57affd640 1 -- 172.21.15.5:0/4083596652 >> v1:172.21.15.154:6789/0 conn(0x7ff57c0cfd40 legacy=0x7ff57c15dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.502+0000 7ff57affd640 1 -- 172.21.15.5:0/4083596652 >> v1:172.21.15.5:6789/0 conn(0x7ff57c159c70 legacy=0x7ff57c15d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.502+0000 7ff57affd640 1 -- 172.21.15.5:0/4083596652 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57c0ce980 con 0x7ff57c069430 2023-07-14T13:10:00.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.506+0000 7ff57affd640 1 --2- 172.21.15.5:0/4083596652 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff57c069430 0x7ff57c069800 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0097f0 tx=0x7ff56c01c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9321cc87d37119c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.506+0000 7ff57a7fc640 1 -- 172.21.15.5:0/4083596652 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c0ac600 con 0x7ff57c069430 2023-07-14T13:10:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.506+0000 7ff57a7fc640 1 -- 172.21.15.5:0/4083596652 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56c0a8050 con 0x7ff57c069430 2023-07-14T13:10:00.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.506+0000 7ff57a7fc640 1 -- 172.21.15.5:0/4083596652 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c0ac980 con 0x7ff57c069430 2023-07-14T13:10:00.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.506+0000 7ff581626640 1 -- 172.21.15.5:0/4083596652 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff57c069430 msgr2=0x7ff57c069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:00.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.506+0000 7ff581626640 1 --2- 172.21.15.5:0/4083596652 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff57c069430 0x7ff57c069800 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0097f0 tx=0x7ff56c01c3a0 comp rx=0 tx=0).stop 2023-07-14T13:10:00.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.506+0000 7ff581626640 1 -- 172.21.15.5:0/4083596652 shutdown_connections 2023-07-14T13:10:00.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.506+0000 7ff581626640 1 --2- 172.21.15.5:0/4083596652 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff57c069430 0x7ff57c069800 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:00.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.506+0000 7ff581626640 1 -- 172.21.15.5:0/4083596652 >> 172.21.15.5:0/4083596652 conn(0x7ff57c0b1840 msgr2=0x7ff57c0cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:00.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.506+0000 7ff581626640 1 -- 172.21.15.5:0/4083596652 shutdown_connections 2023-07-14T13:10:00.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.506+0000 7ff581626640 1 -- 172.21.15.5:0/4083596652 wait complete. 2023-07-14T13:10:00.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.510+0000 7ff581626640 1 Processor -- start 2023-07-14T13:10:00.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.510+0000 7ff581626640 1 -- start start 2023-07-14T13:10:00.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.510+0000 7ff581626640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff57c069430 0x7ff57c1439f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:00.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.510+0000 7ff581626640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff57c0cfd40 0x7ff57c0b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:00.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.510+0000 7ff581626640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff57c159c70 0x7ff57c0c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:00.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.510+0000 7ff581626640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c143f30 con 0x7ff57c069430 2023-07-14T13:10:00.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.510+0000 7ff581626640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c1441e0 con 0x7ff57c159c70 2023-07-14T13:10:00.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.510+0000 7ff581626640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c144480 con 0x7ff57c0cfd40 2023-07-14T13:10:00.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.510+0000 7ff57affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff57c069430 0x7ff57c1439f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:00.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.510+0000 7ff57affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff57c069430 0x7ff57c1439f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38888/0 (socket says 172.21.15.5:38888) 2023-07-14T13:10:00.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.510+0000 7ff57affd640 1 -- 172.21.15.5:0/1893554688 learned_addr learned my addr 172.21.15.5:0/1893554688 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:10:00.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.510+0000 7ff573fff640 1 --2- 172.21.15.5:0/1893554688 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff57c0cfd40 0x7ff57c0b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:00.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.510+0000 7ff57b7fe640 1 --2- 172.21.15.5:0/1893554688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff57c159c70 0x7ff57c0c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:00.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.510+0000 7ff57affd640 1 -- 172.21.15.5:0/1893554688 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff57c0cfd40 msgr2=0x7ff57c0b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:00.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.510+0000 7ff57affd640 1 --2- 172.21.15.5:0/1893554688 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff57c0cfd40 0x7ff57c0b37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:00.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.510+0000 7ff57affd640 1 -- 172.21.15.5:0/1893554688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff57c159c70 msgr2=0x7ff57c0c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:00.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.510+0000 7ff57affd640 1 --2- 172.21.15.5:0/1893554688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff57c159c70 0x7ff57c0c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:00.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.510+0000 7ff57affd640 1 -- 172.21.15.5:0/1893554688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c009420 con 0x7ff57c069430 2023-07-14T13:10:00.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.510+0000 7ff573fff640 1 --2- 172.21.15.5:0/1893554688 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff57c0cfd40 0x7ff57c0b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:10:00.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.510+0000 7ff57affd640 1 --2- 172.21.15.5:0/1893554688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff57c069430 0x7ff57c1439f0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0097f0 tx=0x7ff56c01abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:00.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.510+0000 7ff5737fe640 1 -- 172.21.15.5:0/1893554688 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c0b7620 con 0x7ff57c069430 2023-07-14T13:10:00.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.510+0000 7ff5737fe640 1 -- 172.21.15.5:0/1893554688 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56c0b7780 con 0x7ff57c069430 2023-07-14T13:10:00.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.510+0000 7ff5737fe640 1 -- 172.21.15.5:0/1893554688 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c0b7b30 con 0x7ff57c069430 2023-07-14T13:10:00.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.510+0000 7ff581626640 1 -- 172.21.15.5:0/1893554688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff57c144760 con 0x7ff57c069430 2023-07-14T13:10:00.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.510+0000 7ff581626640 1 -- 172.21.15.5:0/1893554688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff57c0c9990 con 0x7ff57c069430 2023-07-14T13:10:00.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.510+0000 7ff581626640 1 -- 172.21.15.5:0/1893554688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff57c14ed20 con 0x7ff57c069430 2023-07-14T13:10:00.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.514+0000 7ff5737fe640 1 -- 172.21.15.5:0/1893554688 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff56c0b3040 con 0x7ff57c069430 2023-07-14T13:10:00.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.514+0000 7ff5737fe640 1 --2- 172.21.15.5:0/1893554688 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7ff55c0663d0 0x7ff55c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:00.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.514+0000 7ff5737fe640 1 -- 172.21.15.5:0/1893554688 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff56c11e1f0 con 0x7ff57c069430 2023-07-14T13:10:00.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.514+0000 7ff573fff640 1 --2- 172.21.15.5:0/1893554688 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7ff55c0663d0 0x7ff55c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:00.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.514+0000 7ff573fff640 1 --2- 172.21.15.5:0/1893554688 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7ff55c0663d0 0x7ff55c068880 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff57c14b760 tx=0x7ff564009040 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:00.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.518+0000 7ff5737fe640 1 -- 172.21.15.5:0/1893554688 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff56c0eb3b0 con 0x7ff57c069430 2023-07-14T13:10:00.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.694+0000 7ff581626640 1 -- 172.21.15.5:0/1893554688 --> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff57c0b48c0 con 0x7ff55c0663d0 2023-07-14T13:10:00.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.694+0000 7ff5737fe640 1 -- 172.21.15.5:0/1893554688 <== mgr.7156 v2:172.21.15.154:6832/1525189184 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff564001480 con 0x7ff55c0663d0 2023-07-14T13:10:00.726 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-07-14T13:10:00.727 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:10:00.727 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs" 2023-07-14T13:10:00.727 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:10:00.727 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-07-14T13:10:00.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.698+0000 7ff581626640 1 -- 172.21.15.5:0/1893554688 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7ff55c0663d0 msgr2=0x7ff55c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:00.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.698+0000 7ff581626640 1 --2- 172.21.15.5:0/1893554688 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7ff55c0663d0 0x7ff55c068880 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff57c14b760 tx=0x7ff564009040 comp rx=0 tx=0).stop 2023-07-14T13:10:00.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.698+0000 7ff581626640 1 -- 172.21.15.5:0/1893554688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff57c069430 msgr2=0x7ff57c1439f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:00.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.698+0000 7ff581626640 1 --2- 172.21.15.5:0/1893554688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff57c069430 0x7ff57c1439f0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0097f0 tx=0x7ff56c01abe0 comp rx=0 tx=0).stop 2023-07-14T13:10:00.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.698+0000 7ff581626640 1 -- 172.21.15.5:0/1893554688 shutdown_connections 2023-07-14T13:10:00.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.698+0000 7ff581626640 1 --2- 172.21.15.5:0/1893554688 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7ff55c0663d0 0x7ff55c068880 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:00.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.698+0000 7ff581626640 1 --2- 172.21.15.5:0/1893554688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff57c159c70 0x7ff57c0c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:00.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.698+0000 7ff581626640 1 --2- 172.21.15.5:0/1893554688 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff57c0cfd40 0x7ff57c0b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:00.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.698+0000 7ff581626640 1 --2- 172.21.15.5:0/1893554688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff57c069430 0x7ff57c1439f0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:00.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.698+0000 7ff581626640 1 -- 172.21.15.5:0/1893554688 >> 172.21.15.5:0/1893554688 conn(0x7ff57c0b1840 msgr2=0x7ff57c070990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:00.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.698+0000 7ff581626640 1 -- 172.21.15.5:0/1893554688 shutdown_connections 2023-07-14T13:10:00.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.698+0000 7ff581626640 1 -- 172.21.15.5:0/1893554688 wait complete. 2023-07-14T13:10:00.748 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-14T13:10:00.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.862+0000 7f899c0ca640 1 Processor -- start 2023-07-14T13:10:00.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.862+0000 7f899c0ca640 1 -- start start 2023-07-14T13:10:00.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.862+0000 7f899c0ca640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8994159a70 0x7f89940ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:00.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.862+0000 7f899c0ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8994071030 0x7f89940c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:00.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.862+0000 7f899c0ca640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89940cbe50 con 0x7f899415e060 2023-07-14T13:10:00.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.862+0000 7f899c0ca640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89940cd660 con 0x7f8994159a70 2023-07-14T13:10:00.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.862+0000 7f899c0ca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89940cc0a0 con 0x7f8994071030 2023-07-14T13:10:00.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.866+0000 7f8999e66640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8994159a70 0x7f89940ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:00.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.866+0000 7f8999e66640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8994159a70 0x7f89940ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38898/0 (socket says 172.21.15.5:38898) 2023-07-14T13:10:00.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.866+0000 7f8999e66640 1 -- 172.21.15.5:0/406647301 learned_addr learned my addr 172.21.15.5:0/406647301 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:10:00.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.866+0000 7f8999665640 1 --1- 172.21.15.5:0/406647301 >> v1:172.21.15.5:6789/0 conn(0x7f899415e060 0x7f8994070920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55038/0 (socket says 172.21.15.5:55038) 2023-07-14T13:10:00.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.866+0000 7f8999e66640 1 -- 172.21.15.5:0/406647301 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8994071030 msgr2=0x7f89940c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:00.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.866+0000 7f899a667640 1 --2- 172.21.15.5:0/406647301 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8994071030 0x7f89940c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:00.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.866+0000 7f8999e66640 1 --2- 172.21.15.5:0/406647301 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8994071030 0x7f89940c9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:00.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.866+0000 7f8999e66640 1 -- 172.21.15.5:0/406647301 >> v1:172.21.15.5:6789/0 conn(0x7f899415e060 legacy=0x7f8994070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:00.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.866+0000 7f8999e66640 1 -- 172.21.15.5:0/406647301 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89940cc380 con 0x7f8994159a70 2023-07-14T13:10:00.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.866+0000 7f8998e64640 1 -- 172.21.15.5:0/406647301 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3874521714 0 0) 0x7f89940cbe50 con 0x7f899415e060 2023-07-14T13:10:00.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.866+0000 7f899a667640 1 --2- 172.21.15.5:0/406647301 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8994071030 0x7f89940c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:10:00.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.866+0000 7f8999e66640 1 --2- 172.21.15.5:0/406647301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8994159a70 0x7f89940ccff0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f8990009870 tx=0x7f899001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=117e74d44456d686 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:00.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.866+0000 7f8998e64640 1 -- 172.21.15.5:0/406647301 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89900ab610 con 0x7f8994159a70 2023-07-14T13:10:00.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.866+0000 7f8998e64640 1 -- 172.21.15.5:0/406647301 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89900ab770 con 0x7f8994159a70 2023-07-14T13:10:00.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.866+0000 7f8998e64640 1 -- 172.21.15.5:0/406647301 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89900abb00 con 0x7f8994159a70 2023-07-14T13:10:00.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.870+0000 7f899c0ca640 1 -- 172.21.15.5:0/406647301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8994159a70 msgr2=0x7f89940ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:00.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.870+0000 7f899c0ca640 1 --2- 172.21.15.5:0/406647301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8994159a70 0x7f89940ccff0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f8990009870 tx=0x7f899001c3f0 comp rx=0 tx=0).stop 2023-07-14T13:10:00.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.870+0000 7f899c0ca640 1 -- 172.21.15.5:0/406647301 shutdown_connections 2023-07-14T13:10:00.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.870+0000 7f899c0ca640 1 --2- 172.21.15.5:0/406647301 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8994071030 0x7f89940c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:00.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.870+0000 7f899c0ca640 1 --2- 172.21.15.5:0/406647301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8994159a70 0x7f89940ccff0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:00.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.870+0000 7f899c0ca640 1 -- 172.21.15.5:0/406647301 >> 172.21.15.5:0/406647301 conn(0x7f89940afac0 msgr2=0x7f89940afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:00.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.870+0000 7f899c0ca640 1 -- 172.21.15.5:0/406647301 shutdown_connections 2023-07-14T13:10:00.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.870+0000 7f899c0ca640 1 -- 172.21.15.5:0/406647301 wait complete. 2023-07-14T13:10:00.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.870+0000 7f899c0ca640 1 Processor -- start 2023-07-14T13:10:00.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.870+0000 7f899c0ca640 1 -- start start 2023-07-14T13:10:00.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.870+0000 7f899c0ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8994071030 0x7f899415a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:00.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.870+0000 7f899c0ca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8994159a70 0x7f899415ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:00.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.870+0000 7f899c0ca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f899415e060 0x7f89940c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:00.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.870+0000 7f899c0ca640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899415cfc0 con 0x7f8994159a70 2023-07-14T13:10:00.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.870+0000 7f899c0ca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89940c2430 con 0x7f899415e060 2023-07-14T13:10:00.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.870+0000 7f899c0ca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899415a7d0 con 0x7f8994071030 2023-07-14T13:10:00.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.870+0000 7f8999665640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8994159a70 0x7f899415ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:00.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.870+0000 7f8999665640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8994159a70 0x7f899415ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38904/0 (socket says 172.21.15.5:38904) 2023-07-14T13:10:00.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.870+0000 7f8999665640 1 -- 172.21.15.5:0/196275191 learned_addr learned my addr 172.21.15.5:0/196275191 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:10:00.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.870+0000 7f8999e66640 1 --2- 172.21.15.5:0/196275191 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8994071030 0x7f899415a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:00.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.870+0000 7f899a667640 1 --2- 172.21.15.5:0/196275191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f899415e060 0x7f89940c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:00.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.874+0000 7f8999665640 1 -- 172.21.15.5:0/196275191 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8994071030 msgr2=0x7f899415a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:00.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.874+0000 7f8999665640 1 --2- 172.21.15.5:0/196275191 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8994071030 0x7f899415a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:00.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.874+0000 7f8999665640 1 -- 172.21.15.5:0/196275191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f899415e060 msgr2=0x7f89940c9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:00.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.874+0000 7f8999665640 1 --2- 172.21.15.5:0/196275191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f899415e060 0x7f89940c9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:00.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.874+0000 7f8999665640 1 -- 172.21.15.5:0/196275191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89900094d0 con 0x7f8994159a70 2023-07-14T13:10:00.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.874+0000 7f8999665640 1 --2- 172.21.15.5:0/196275191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8994159a70 0x7f899415ca80 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f89840011f0 tx=0x7f898400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:00.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.874+0000 7f898a7fc640 1 -- 172.21.15.5:0/196275191 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89840074e0 con 0x7f8994159a70 2023-07-14T13:10:00.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.874+0000 7f898a7fc640 1 -- 172.21.15.5:0/196275191 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8984007640 con 0x7f8994159a70 2023-07-14T13:10:00.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.874+0000 7f899c0ca640 1 -- 172.21.15.5:0/196275191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89940c1b00 con 0x7f8994159a70 2023-07-14T13:10:00.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.874+0000 7f898a7fc640 1 -- 172.21.15.5:0/196275191 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8984004a10 con 0x7f8994159a70 2023-07-14T13:10:00.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.874+0000 7f899c0ca640 1 -- 172.21.15.5:0/196275191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89940c20c0 con 0x7f8994159a70 2023-07-14T13:10:00.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.874+0000 7f899c0ca640 1 -- 172.21.15.5:0/196275191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89940678d0 con 0x7f8994159a70 2023-07-14T13:10:00.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.874+0000 7f898a7fc640 1 -- 172.21.15.5:0/196275191 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 44) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8984004b70 con 0x7f8994159a70 2023-07-14T13:10:00.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.878+0000 7f898a7fc640 1 --2- 172.21.15.5:0/196275191 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f89780663a0 0x7f8978068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:00.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.878+0000 7f898a7fc640 1 -- 172.21.15.5:0/196275191 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8984083270 con 0x7f8994159a70 2023-07-14T13:10:00.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.878+0000 7f8999e66640 1 --2- 172.21.15.5:0/196275191 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f89780663a0 0x7f8978068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:00.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.878+0000 7f8999e66640 1 --2- 172.21.15.5:0/196275191 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f89780663a0 0x7f8978068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f89900af000 tx=0x7f89900a7000 comp rx=0 tx=0).ready entity=mgr.7156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:00.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:00.882+0000 7f898a7fc640 1 -- 172.21.15.5:0/196275191 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f8984050720 con 0x7f8994159a70 2023-07-14T13:10:01.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.074+0000 7f899c0ca640 1 -- 172.21.15.5:0/196275191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f89940cb360 con 0x7f8994159a70 2023-07-14T13:10:01.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.742+0000 7f898a7fc640 1 -- 172.21.15.5:0/196275191 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 45) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f8984050af0 con 0x7f8994159a70 2023-07-14T13:10:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.746+0000 7f898a7fc640 1 -- 172.21.15.5:0/196275191 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v45) v1 ==== 92+0+0 (secure 0 0 0) 0x7f898406fde0 con 0x7f8994159a70 2023-07-14T13:10:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.746+0000 7f899c0ca640 1 -- 172.21.15.5:0/196275191 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f89780663a0 msgr2=0x7f8978068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:01.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.746+0000 7f899c0ca640 1 --2- 172.21.15.5:0/196275191 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f89780663a0 0x7f8978068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f89900af000 tx=0x7f89900a7000 comp rx=0 tx=0).stop 2023-07-14T13:10:01.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.746+0000 7f899c0ca640 1 -- 172.21.15.5:0/196275191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8994159a70 msgr2=0x7f899415ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:01.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.746+0000 7f899c0ca640 1 --2- 172.21.15.5:0/196275191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8994159a70 0x7f899415ca80 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f89840011f0 tx=0x7f898400c9b0 comp rx=0 tx=0).stop 2023-07-14T13:10:01.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.750+0000 7f899c0ca640 1 -- 172.21.15.5:0/196275191 shutdown_connections 2023-07-14T13:10:01.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.750+0000 7f899c0ca640 1 --2- 172.21.15.5:0/196275191 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f89780663a0 0x7f8978068850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:01.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.750+0000 7f899c0ca640 1 --2- 172.21.15.5:0/196275191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f899415e060 0x7f89940c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:01.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.750+0000 7f899c0ca640 1 --2- 172.21.15.5:0/196275191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8994159a70 0x7f899415ca80 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:01.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.750+0000 7f899c0ca640 1 --2- 172.21.15.5:0/196275191 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8994071030 0x7f899415a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:01.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.750+0000 7f899c0ca640 1 -- 172.21.15.5:0/196275191 >> 172.21.15.5:0/196275191 conn(0x7f89940afac0 msgr2=0x7f899406b420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:01.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.750+0000 7f899c0ca640 1 -- 172.21.15.5:0/196275191 shutdown_connections 2023-07-14T13:10:01.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.750+0000 7f899c0ca640 1 -- 172.21.15.5:0/196275191 wait complete. 2023-07-14T13:10:01.812 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-14T13:10:01.951 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:01.922+0000 7f580a94f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:10:01.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.934+0000 7fca8ed03640 1 Processor -- start 2023-07-14T13:10:01.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.934+0000 7fca8ed03640 1 -- start start 2023-07-14T13:10:01.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.934+0000 7fca8ed03640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fca8815bde0 0x7fca880d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:01.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.934+0000 7fca8ed03640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca880d2fc0 0x7fca880b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:01.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.934+0000 7fca8ed03640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca880b04c0 con 0x7fca880d2300 2023-07-14T13:10:01.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.934+0000 7fca8ed03640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca8815c1b0 con 0x7fca880d2fc0 2023-07-14T13:10:01.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.934+0000 7fca8ed03640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca880d0aa0 con 0x7fca8815bde0 2023-07-14T13:10:01.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.934+0000 7fca87fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca880d2fc0 0x7fca880b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:01.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.934+0000 7fca87fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca880d2fc0 0x7fca880b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38922/0 (socket says 172.21.15.5:38922) 2023-07-14T13:10:01.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.934+0000 7fca87fff640 1 -- 172.21.15.5:0/1698317107 learned_addr learned my addr 172.21.15.5:0/1698317107 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:10:01.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.934+0000 7fca8d2a0640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fca880d2300 0x7fca880cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55052/0 (socket says 172.21.15.5:55052) 2023-07-14T13:10:01.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.934+0000 7fca8ca9f640 1 --2- 172.21.15.5:0/1698317107 >> v2:172.21.15.154:3300/0 conn(0x7fca8815bde0 0x7fca880d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:01.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.934+0000 7fca87fff640 1 -- 172.21.15.5:0/1698317107 >> v2:172.21.15.154:3300/0 conn(0x7fca8815bde0 msgr2=0x7fca880d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:01.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.934+0000 7fca87fff640 1 --2- 172.21.15.5:0/1698317107 >> v2:172.21.15.154:3300/0 conn(0x7fca8815bde0 0x7fca880d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:01.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.934+0000 7fca87fff640 1 -- 172.21.15.5:0/1698317107 >> v1:172.21.15.5:6789/0 conn(0x7fca880d2300 legacy=0x7fca880cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:01.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.934+0000 7fca87fff640 1 -- 172.21.15.5:0/1698317107 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca880afb90 con 0x7fca880d2fc0 2023-07-14T13:10:01.970 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:10:01.938+0000 7f3f39446180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:10:01.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.938+0000 7fca87fff640 1 --2- 172.21.15.5:0/1698317107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca880d2fc0 0x7fca880b0950 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fca8808b210 tx=0x7fca7401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1554e45a9b997cd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:01.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.938+0000 7fca877fe640 1 -- 172.21.15.5:0/1698317107 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca740aa660 con 0x7fca880d2fc0 2023-07-14T13:10:01.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.938+0000 7fca877fe640 1 -- 172.21.15.5:0/1698317107 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca740aa7c0 con 0x7fca880d2fc0 2023-07-14T13:10:01.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.938+0000 7fca877fe640 1 -- 172.21.15.5:0/1698317107 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca740aab50 con 0x7fca880d2fc0 2023-07-14T13:10:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.938+0000 7fca8ed03640 1 -- 172.21.15.5:0/1698317107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca880d2fc0 msgr2=0x7fca880b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.938+0000 7fca8ed03640 1 --2- 172.21.15.5:0/1698317107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca880d2fc0 0x7fca880b0950 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fca8808b210 tx=0x7fca7401c500 comp rx=0 tx=0).stop 2023-07-14T13:10:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.938+0000 7fca8ed03640 1 -- 172.21.15.5:0/1698317107 shutdown_connections 2023-07-14T13:10:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.938+0000 7fca8ed03640 1 --2- 172.21.15.5:0/1698317107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca880d2fc0 0x7fca880b0950 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.938+0000 7fca8ed03640 1 --2- 172.21.15.5:0/1698317107 >> v2:172.21.15.154:3300/0 conn(0x7fca8815bde0 0x7fca880d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.938+0000 7fca8ed03640 1 -- 172.21.15.5:0/1698317107 >> 172.21.15.5:0/1698317107 conn(0x7fca880659d0 msgr2=0x7fca8809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:01.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.938+0000 7fca8ed03640 1 -- 172.21.15.5:0/1698317107 shutdown_connections 2023-07-14T13:10:01.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.938+0000 7fca8ed03640 1 -- 172.21.15.5:0/1698317107 wait complete. 2023-07-14T13:10:01.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.942+0000 7fca8ed03640 1 Processor -- start 2023-07-14T13:10:01.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.942+0000 7fca8ed03640 1 -- start start 2023-07-14T13:10:01.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.942+0000 7fca8ed03640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca880d2300 0x7fca88151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:01.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.942+0000 7fca8ed03640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca880d2fc0 0x7fca880cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:01.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.942+0000 7fca8ed03640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca8815bde0 0x7fca88158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:01.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.942+0000 7fca8ed03640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca88151dc0 con 0x7fca880d2fc0 2023-07-14T13:10:01.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.942+0000 7fca8ed03640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca88151f90 con 0x7fca880d2300 2023-07-14T13:10:01.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.942+0000 7fca8ed03640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca880b51a0 con 0x7fca8815bde0 2023-07-14T13:10:01.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.942+0000 7fca87fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca880d2fc0 0x7fca880cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.942+0000 7fca87fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca880d2fc0 0x7fca880cb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38938/0 (socket says 172.21.15.5:38938) 2023-07-14T13:10:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.942+0000 7fca87fff640 1 -- 172.21.15.5:0/2771198342 learned_addr learned my addr 172.21.15.5:0/2771198342 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:10:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.942+0000 7fca8d2a0640 1 --2- 172.21.15.5:0/2771198342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca8815bde0 0x7fca88158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:01.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.942+0000 7fca8ca9f640 1 --2- 172.21.15.5:0/2771198342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca880d2300 0x7fca88151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:01.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.942+0000 7fca87fff640 1 -- 172.21.15.5:0/2771198342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca8815bde0 msgr2=0x7fca88158ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:01.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.942+0000 7fca87fff640 1 --2- 172.21.15.5:0/2771198342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca8815bde0 0x7fca88158ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:01.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.942+0000 7fca87fff640 1 -- 172.21.15.5:0/2771198342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca880d2300 msgr2=0x7fca88151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:01.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.942+0000 7fca87fff640 1 --2- 172.21.15.5:0/2771198342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca880d2300 0x7fca88151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:01.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.942+0000 7fca87fff640 1 -- 172.21.15.5:0/2771198342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca740094d0 con 0x7fca880d2fc0 2023-07-14T13:10:01.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.942+0000 7fca87fff640 1 --2- 172.21.15.5:0/2771198342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca880d2fc0 0x7fca880cb040 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fca74019110 tx=0x7fca7401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:01.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.942+0000 7fca857fa640 1 -- 172.21.15.5:0/2771198342 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca740b3800 con 0x7fca880d2fc0 2023-07-14T13:10:01.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.942+0000 7fca857fa640 1 -- 172.21.15.5:0/2771198342 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca740b3960 con 0x7fca880d2fc0 2023-07-14T13:10:01.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.942+0000 7fca8ed03640 1 -- 172.21.15.5:0/2771198342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca880b5480 con 0x7fca880d2fc0 2023-07-14T13:10:01.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.942+0000 7fca857fa640 1 -- 172.21.15.5:0/2771198342 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca740b3d10 con 0x7fca880d2fc0 2023-07-14T13:10:01.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.946+0000 7fca8ed03640 1 -- 172.21.15.5:0/2771198342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca880b5a40 con 0x7fca880d2fc0 2023-07-14T13:10:01.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.946+0000 7fca8ed03640 1 -- 172.21.15.5:0/2771198342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca880678d0 con 0x7fca880d2fc0 2023-07-14T13:10:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.946+0000 7fca857fa640 1 -- 172.21.15.5:0/2771198342 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 45) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fca740b2380 con 0x7fca880d2fc0 2023-07-14T13:10:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.946+0000 7fca857fa640 1 --2- 172.21.15.5:0/2771198342 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fca6c0663f0 0x7fca6c0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:01.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.946+0000 7fca857fa640 1 -- 172.21.15.5:0/2771198342 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fca740a6040 con 0x7fca880d2fc0 2023-07-14T13:10:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.946+0000 7fca8ca9f640 1 -- 172.21.15.5:0/2771198342 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fca6c0663f0 msgr2=0x7fca6c0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1525189184 2023-07-14T13:10:01.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.946+0000 7fca8ca9f640 1 --2- 172.21.15.5:0/2771198342 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fca6c0663f0 0x7fca6c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:10:01.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:01.954+0000 7fca857fa640 1 -- 172.21.15.5:0/2771198342 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fca740eba50 con 0x7fca880d2fc0 2023-07-14T13:10:02.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.110+0000 7fca8ed03640 1 -- 172.21.15.5:0/2771198342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fca880b7f90 con 0x7fca880d2fc0 2023-07-14T13:10:02.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.118+0000 7fca857fa640 1 -- 172.21.15.5:0/2771198342 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v35)=0 v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7fca740ef070 con 0x7fca880d2fc0 2023-07-14T13:10:02.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.122+0000 7fca8ed03640 1 -- 172.21.15.5:0/2771198342 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fca6c0663f0 msgr2=0x7fca6c0688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:10:02.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.122+0000 7fca8ed03640 1 --2- 172.21.15.5:0/2771198342 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fca6c0663f0 0x7fca6c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.122+0000 7fca8ed03640 1 -- 172.21.15.5:0/2771198342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca880d2fc0 msgr2=0x7fca880cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:02.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.122+0000 7fca8ed03640 1 --2- 172.21.15.5:0/2771198342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca880d2fc0 0x7fca880cb040 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fca74019110 tx=0x7fca7401ad40 comp rx=0 tx=0).stop 2023-07-14T13:10:02.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.122+0000 7fca8ed03640 1 -- 172.21.15.5:0/2771198342 shutdown_connections 2023-07-14T13:10:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.122+0000 7fca8ed03640 1 --2- 172.21.15.5:0/2771198342 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fca6c0663f0 0x7fca6c0688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.122+0000 7fca8ed03640 1 --2- 172.21.15.5:0/2771198342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fca8815bde0 0x7fca88158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.122+0000 7fca8ed03640 1 --2- 172.21.15.5:0/2771198342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca880d2fc0 0x7fca880cb040 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.122+0000 7fca8ed03640 1 --2- 172.21.15.5:0/2771198342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca880d2300 0x7fca88151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.122+0000 7fca8ed03640 1 -- 172.21.15.5:0/2771198342 >> 172.21.15.5:0/2771198342 conn(0x7fca880659d0 msgr2=0x7fca8815aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.122+0000 7fca8ed03640 1 -- 172.21.15.5:0/2771198342 shutdown_connections 2023-07-14T13:10:02.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.122+0000 7fca8ed03640 1 -- 172.21.15.5:0/2771198342 wait complete. 2023-07-14T13:10:02.174 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-14T13:10:02.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.290+0000 7f82b3cd8640 1 Processor -- start 2023-07-14T13:10:02.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.290+0000 7f82b3cd8640 1 -- start start 2023-07-14T13:10:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.290+0000 7f82b3cd8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f82ac15bde0 0x7f82ac0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.290+0000 7f82b3cd8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f82ac0d2300 0x7f82ac0d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.290+0000 7f82b3cd8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82ac0b04c0 con 0x7f82ac0d2fc0 2023-07-14T13:10:02.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.290+0000 7f82b3cd8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82ac15c1b0 con 0x7f82ac15bde0 2023-07-14T13:10:02.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.290+0000 7f82b3cd8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82ac0b1060 con 0x7f82ac0d2300 2023-07-14T13:10:02.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.290+0000 7f82b1a74640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f82ac15bde0 0x7f82ac0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.290+0000 7f82b1a74640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f82ac15bde0 0x7f82ac0d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38948/0 (socket says 172.21.15.5:38948) 2023-07-14T13:10:02.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.290+0000 7f82b1a74640 1 -- 172.21.15.5:0/1688313838 learned_addr learned my addr 172.21.15.5:0/1688313838 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:10:02.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.294+0000 7f82b2275640 1 --2- 172.21.15.5:0/1688313838 >> v2:172.21.15.154:3300/0 conn(0x7f82ac0d2300 0x7f82ac0d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.294+0000 7f82b1a74640 1 -- 172.21.15.5:0/1688313838 >> v2:172.21.15.154:3300/0 conn(0x7f82ac0d2300 msgr2=0x7f82ac0d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:02.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.294+0000 7f82b1a74640 1 --2- 172.21.15.5:0/1688313838 >> v2:172.21.15.154:3300/0 conn(0x7f82ac0d2300 0x7f82ac0d2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.294+0000 7f82b1a74640 1 -- 172.21.15.5:0/1688313838 >> v1:172.21.15.154:6789/0 conn(0x7f82ac0d2fc0 legacy=0x7f82ac0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:02.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.294+0000 7f82b1a74640 1 -- 172.21.15.5:0/1688313838 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ac0d2c80 con 0x7f82ac15bde0 2023-07-14T13:10:02.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.294+0000 7f82b1a74640 1 --2- 172.21.15.5:0/1688313838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82ac15bde0 0x7f82ac0d0270 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f82ac08c820 tx=0x7f82a801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e26f03e4432e527 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:02.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.294+0000 7f82b0a72640 1 -- 172.21.15.5:0/1688313838 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a80ab610 con 0x7f82ac15bde0 2023-07-14T13:10:02.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.294+0000 7f82b0a72640 1 -- 172.21.15.5:0/1688313838 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a80ab770 con 0x7f82ac15bde0 2023-07-14T13:10:02.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.294+0000 7f82b0a72640 1 -- 172.21.15.5:0/1688313838 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a80abb00 con 0x7f82ac15bde0 2023-07-14T13:10:02.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.298+0000 7f82b3cd8640 1 -- 172.21.15.5:0/1688313838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82ac15bde0 msgr2=0x7f82ac0d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:02.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.298+0000 7f82b3cd8640 1 --2- 172.21.15.5:0/1688313838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82ac15bde0 0x7f82ac0d0270 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f82ac08c820 tx=0x7f82a801c500 comp rx=0 tx=0).stop 2023-07-14T13:10:02.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.298+0000 7f82b3cd8640 1 -- 172.21.15.5:0/1688313838 shutdown_connections 2023-07-14T13:10:02.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.298+0000 7f82b3cd8640 1 --2- 172.21.15.5:0/1688313838 >> v2:172.21.15.154:3300/0 conn(0x7f82ac0d2300 0x7f82ac0d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.298+0000 7f82b3cd8640 1 --2- 172.21.15.5:0/1688313838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82ac15bde0 0x7f82ac0d0270 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.298+0000 7f82b3cd8640 1 -- 172.21.15.5:0/1688313838 >> 172.21.15.5:0/1688313838 conn(0x7f82ac0659d0 msgr2=0x7f82ac09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:02.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.298+0000 7f82b3cd8640 1 -- 172.21.15.5:0/1688313838 shutdown_connections 2023-07-14T13:10:02.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.298+0000 7f82b3cd8640 1 -- 172.21.15.5:0/1688313838 wait complete. 2023-07-14T13:10:02.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.298+0000 7f82b3cd8640 1 Processor -- start 2023-07-14T13:10:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.298+0000 7f82b3cd8640 1 -- start start 2023-07-14T13:10:02.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.302+0000 7f82b3cd8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82ac0d2300 0x7f82ac1f49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.302+0000 7f82b3cd8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82ac0d2fc0 0x7f82ac15aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.302+0000 7f82b3cd8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82ac15bde0 0x7f82ac15aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.302+0000 7f82b3cd8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac1f4f00 con 0x7f82ac0d2fc0 2023-07-14T13:10:02.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.302+0000 7f82b3cd8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac154580 con 0x7f82ac0d2300 2023-07-14T13:10:02.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.302+0000 7f82b3cd8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac0c9db0 con 0x7f82ac15bde0 2023-07-14T13:10:02.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.302+0000 7f82b1273640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82ac0d2fc0 0x7f82ac15aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.302+0000 7f82b1a74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82ac0d2300 0x7f82ac1f49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.302+0000 7f82b1a74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82ac0d2300 0x7f82ac1f49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:60476/0 (socket says 172.21.15.5:60476) 2023-07-14T13:10:02.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.302+0000 7f82b1a74640 1 -- 172.21.15.5:0/2660916670 learned_addr learned my addr 172.21.15.5:0/2660916670 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:10:02.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.302+0000 7f82b2275640 1 --2- 172.21.15.5:0/2660916670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82ac15bde0 0x7f82ac15aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.302+0000 7f82b1a74640 1 -- 172.21.15.5:0/2660916670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82ac15bde0 msgr2=0x7f82ac15aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:02.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.302+0000 7f82b1a74640 1 --2- 172.21.15.5:0/2660916670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82ac15bde0 0x7f82ac15aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.302+0000 7f82b1a74640 1 -- 172.21.15.5:0/2660916670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82ac0d2fc0 msgr2=0x7f82ac15aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:02.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.302+0000 7f82b1a74640 1 --2- 172.21.15.5:0/2660916670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82ac0d2fc0 0x7f82ac15aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.302+0000 7f82b1a74640 1 -- 172.21.15.5:0/2660916670 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a8009480 con 0x7f82ac0d2300 2023-07-14T13:10:02.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.302+0000 7f82b1a74640 1 --2- 172.21.15.5:0/2660916670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82ac0d2300 0x7f82ac1f49c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f82a801a130 tx=0x7f82a80192a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:02.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.302+0000 7f82a27fc640 1 -- 172.21.15.5:0/2660916670 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a8005ba0 con 0x7f82ac0d2300 2023-07-14T13:10:02.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.302+0000 7f82a27fc640 1 -- 172.21.15.5:0/2660916670 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a8005d00 con 0x7f82ac0d2300 2023-07-14T13:10:02.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.302+0000 7f82a27fc640 1 -- 172.21.15.5:0/2660916670 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a80abb00 con 0x7f82ac0d2300 2023-07-14T13:10:02.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.302+0000 7f82b3cd8640 1 -- 172.21.15.5:0/2660916670 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82ac0ca090 con 0x7f82ac0d2300 2023-07-14T13:10:02.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.302+0000 7f82b3cd8640 1 -- 172.21.15.5:0/2660916670 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82ac0ca650 con 0x7f82ac0d2300 2023-07-14T13:10:02.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.302+0000 7f82b3cd8640 1 -- 172.21.15.5:0/2660916670 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82ac0678d0 con 0x7f82ac0d2300 2023-07-14T13:10:02.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.306+0000 7f82a27fc640 1 -- 172.21.15.5:0/2660916670 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 45) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f82a8003620 con 0x7f82ac0d2300 2023-07-14T13:10:02.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.306+0000 7f82a27fc640 1 --2- 172.21.15.5:0/2660916670 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f82900663f0 0x7f82900688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.306+0000 7f82a27fc640 1 -- 172.21.15.5:0/2660916670 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f82a811de50 con 0x7f82ac0d2300 2023-07-14T13:10:02.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.306+0000 7f82b1273640 1 -- 172.21.15.5:0/2660916670 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f82900663f0 msgr2=0x7f82900688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1525189184 2023-07-14T13:10:02.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.306+0000 7f82b1273640 1 --2- 172.21.15.5:0/2660916670 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f82900663f0 0x7f82900688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:10:02.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.310+0000 7f82a27fc640 1 -- 172.21.15.5:0/2660916670 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f82a80eb0c0 con 0x7f82ac0d2300 2023-07-14T13:10:02.374 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:02.346+0000 7f580a94f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:10:02.422 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:10:02.390+0000 7f3f39446180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:10:02.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.470+0000 7f82b3cd8640 1 -- 172.21.15.5:0/2660916670 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f82ac073040 con 0x7f82ac0d2300 2023-07-14T13:10:02.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.474+0000 7f82a27fc640 1 -- 172.21.15.5:0/2660916670 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v36)=0 v36) v1 ==== 133+0+0 (secure 0 0 0) 0x7f82a80bc020 con 0x7f82ac0d2300 2023-07-14T13:10:02.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.478+0000 7f82b3cd8640 1 -- 172.21.15.5:0/2660916670 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f82900663f0 msgr2=0x7f82900688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:10:02.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.478+0000 7f82b3cd8640 1 --2- 172.21.15.5:0/2660916670 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f82900663f0 0x7f82900688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.478+0000 7f82b3cd8640 1 -- 172.21.15.5:0/2660916670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82ac0d2300 msgr2=0x7f82ac1f49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:02.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.478+0000 7f82b3cd8640 1 --2- 172.21.15.5:0/2660916670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82ac0d2300 0x7f82ac1f49c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f82a801a130 tx=0x7f82a80192a0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.478+0000 7f82b3cd8640 1 -- 172.21.15.5:0/2660916670 shutdown_connections 2023-07-14T13:10:02.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.478+0000 7f82b3cd8640 1 --2- 172.21.15.5:0/2660916670 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7f82900663f0 0x7f82900688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.478+0000 7f82b3cd8640 1 --2- 172.21.15.5:0/2660916670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82ac15bde0 0x7f82ac15aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.478+0000 7f82b3cd8640 1 --2- 172.21.15.5:0/2660916670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82ac0d2fc0 0x7f82ac15aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.478+0000 7f82b3cd8640 1 --2- 172.21.15.5:0/2660916670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82ac0d2300 0x7f82ac1f49c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.478+0000 7f82b3cd8640 1 -- 172.21.15.5:0/2660916670 >> 172.21.15.5:0/2660916670 conn(0x7f82ac0659d0 msgr2=0x7f82ac0ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:02.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.478+0000 7f82b3cd8640 1 -- 172.21.15.5:0/2660916670 shutdown_connections 2023-07-14T13:10:02.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.478+0000 7f82b3cd8640 1 -- 172.21.15.5:0/2660916670 wait complete. 2023-07-14T13:10:02.526 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:02.498+0000 7f580a94f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:10:02.530 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /bad-path 1M 2023-07-14T13:10:02.584 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:10:02.550+0000 7f3f39446180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:10:02.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.650+0000 7fa22b59d640 1 Processor -- start 2023-07-14T13:10:02.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.650+0000 7fa22b59d640 1 -- start start 2023-07-14T13:10:02.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.650+0000 7fa22b59d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa22415bde0 0x7fa2240d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.650+0000 7fa22b59d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2240d2fc0 0x7fa2240b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.650+0000 7fa22b59d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2240b04c0 con 0x7fa2240d2300 2023-07-14T13:10:02.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.650+0000 7fa22b59d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa22415c1b0 con 0x7fa22415bde0 2023-07-14T13:10:02.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.650+0000 7fa22b59d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2240d0aa0 con 0x7fa2240d2fc0 2023-07-14T13:10:02.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.650+0000 7fa228b38640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2240d2fc0 0x7fa2240b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.650+0000 7fa229339640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa22415bde0 0x7fa2240d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.650+0000 7fa228b38640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2240d2fc0 0x7fa2240b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:56022/0 (socket says 172.21.15.5:56022) 2023-07-14T13:10:02.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.650+0000 7fa228b38640 1 -- 172.21.15.5:0/3193140725 learned_addr learned my addr 172.21.15.5:0/3193140725 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:10:02.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.654+0000 7fa228b38640 1 -- 172.21.15.5:0/3193140725 >> v2:172.21.15.154:3300/0 conn(0x7fa22415bde0 msgr2=0x7fa2240d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:02.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.654+0000 7fa228b38640 1 --2- 172.21.15.5:0/3193140725 >> v2:172.21.15.154:3300/0 conn(0x7fa22415bde0 0x7fa2240d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.654+0000 7fa228b38640 1 -- 172.21.15.5:0/3193140725 >> v1:172.21.15.154:6789/0 conn(0x7fa2240d2300 legacy=0x7fa2240cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:02.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.654+0000 7fa228b38640 1 -- 172.21.15.5:0/3193140725 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2240afb90 con 0x7fa2240d2fc0 2023-07-14T13:10:02.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.654+0000 7fa229339640 1 --2- 172.21.15.5:0/3193140725 >> v2:172.21.15.154:3300/0 conn(0x7fa22415bde0 0x7fa2240d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:10:02.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.654+0000 7fa228b38640 1 --2- 172.21.15.5:0/3193140725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2240d2fc0 0x7fa2240b0950 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa214009870 tx=0x7fa21401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42d70bccdd3459c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:02.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.654+0000 7fa21bfff640 1 -- 172.21.15.5:0/3193140725 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2140a9400 con 0x7fa2240d2fc0 2023-07-14T13:10:02.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.654+0000 7fa21bfff640 1 -- 172.21.15.5:0/3193140725 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2140a9560 con 0x7fa2240d2fc0 2023-07-14T13:10:02.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.654+0000 7fa21bfff640 1 -- 172.21.15.5:0/3193140725 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2140a98f0 con 0x7fa2240d2fc0 2023-07-14T13:10:02.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.658+0000 7fa22b59d640 1 -- 172.21.15.5:0/3193140725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2240d2fc0 msgr2=0x7fa2240b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:02.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.658+0000 7fa22b59d640 1 --2- 172.21.15.5:0/3193140725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2240d2fc0 0x7fa2240b0950 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa214009870 tx=0x7fa21401c540 comp rx=0 tx=0).stop 2023-07-14T13:10:02.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.658+0000 7fa22b59d640 1 -- 172.21.15.5:0/3193140725 shutdown_connections 2023-07-14T13:10:02.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.658+0000 7fa22b59d640 1 --2- 172.21.15.5:0/3193140725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2240d2fc0 0x7fa2240b0950 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.658+0000 7fa22b59d640 1 --2- 172.21.15.5:0/3193140725 >> v2:172.21.15.154:3300/0 conn(0x7fa22415bde0 0x7fa2240d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.658+0000 7fa22b59d640 1 -- 172.21.15.5:0/3193140725 >> 172.21.15.5:0/3193140725 conn(0x7fa2240659d0 msgr2=0x7fa22409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:02.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.658+0000 7fa22b59d640 1 -- 172.21.15.5:0/3193140725 shutdown_connections 2023-07-14T13:10:02.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.658+0000 7fa22b59d640 1 -- 172.21.15.5:0/3193140725 wait complete. 2023-07-14T13:10:02.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.658+0000 7fa22b59d640 1 Processor -- start 2023-07-14T13:10:02.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.658+0000 7fa22b59d640 1 -- start start 2023-07-14T13:10:02.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.658+0000 7fa22b59d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2240d2300 0x7fa22415c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.658+0000 7fa22b59d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2240d2fc0 0x7fa2241f85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.658+0000 7fa22b59d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa22415bde0 0x7fa2240c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.658+0000 7fa22b59d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2240c8440 con 0x7fa22415bde0 2023-07-14T13:10:02.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.658+0000 7fa22b59d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2241f8b20 con 0x7fa2240d2300 2023-07-14T13:10:02.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.658+0000 7fa22b59d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22415cb80 con 0x7fa2240d2fc0 2023-07-14T13:10:02.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.658+0000 7fa229339640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2240d2300 0x7fa22415c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.658+0000 7fa229339640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2240d2300 0x7fa22415c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:60506/0 (socket says 172.21.15.5:60506) 2023-07-14T13:10:02.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.658+0000 7fa229b3a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa22415bde0 0x7fa2240c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.658+0000 7fa229339640 1 -- 172.21.15.5:0/2658631653 learned_addr learned my addr 172.21.15.5:0/2658631653 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:10:02.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.658+0000 7fa228b38640 1 --2- 172.21.15.5:0/2658631653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2240d2fc0 0x7fa2241f85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.662+0000 7fa229339640 1 -- 172.21.15.5:0/2658631653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2240d2fc0 msgr2=0x7fa2241f85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:02.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.662+0000 7fa229339640 1 --2- 172.21.15.5:0/2658631653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2240d2fc0 0x7fa2241f85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.662+0000 7fa229339640 1 -- 172.21.15.5:0/2658631653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa22415bde0 msgr2=0x7fa2240c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:02.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.662+0000 7fa229339640 1 --2- 172.21.15.5:0/2658631653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa22415bde0 0x7fa2240c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.662+0000 7fa229339640 1 -- 172.21.15.5:0/2658631653 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2200093b0 con 0x7fa2240d2300 2023-07-14T13:10:02.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.662+0000 7fa229339640 1 --2- 172.21.15.5:0/2658631653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2240d2300 0x7fa22415c5a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa22000ebe0 tx=0x7fa22000c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:02.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.662+0000 7fa219ffb640 1 -- 172.21.15.5:0/2658631653 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa220009760 con 0x7fa2240d2300 2023-07-14T13:10:02.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.662+0000 7fa219ffb640 1 -- 172.21.15.5:0/2658631653 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22000cc30 con 0x7fa2240d2300 2023-07-14T13:10:02.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.662+0000 7fa219ffb640 1 -- 172.21.15.5:0/2658631653 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22000eee0 con 0x7fa2240d2300 2023-07-14T13:10:02.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.662+0000 7fa22b59d640 1 -- 172.21.15.5:0/2658631653 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2140094d0 con 0x7fa2240d2300 2023-07-14T13:10:02.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.662+0000 7fa22b59d640 1 -- 172.21.15.5:0/2658631653 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2240c80d0 con 0x7fa2240d2300 2023-07-14T13:10:02.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.662+0000 7fa22b59d640 1 -- 172.21.15.5:0/2658631653 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2240678d0 con 0x7fa2240d2300 2023-07-14T13:10:02.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.662+0000 7fa219ffb640 1 -- 172.21.15.5:0/2658631653 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 45) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fa2200059a0 con 0x7fa2240d2300 2023-07-14T13:10:02.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.662+0000 7fa219ffb640 1 --2- 172.21.15.5:0/2658631653 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fa2080663f0 0x7fa2080688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.662+0000 7fa219ffb640 1 -- 172.21.15.5:0/2658631653 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa220084430 con 0x7fa2240d2300 2023-07-14T13:10:02.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.666+0000 7fa228b38640 1 -- 172.21.15.5:0/2658631653 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fa2080663f0 msgr2=0x7fa2080688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1525189184 2023-07-14T13:10:02.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.666+0000 7fa228b38640 1 --2- 172.21.15.5:0/2658631653 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fa2080663f0 0x7fa2080688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:10:02.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.670+0000 7fa219ffb640 1 -- 172.21.15.5:0/2658631653 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa2200517b0 con 0x7fa2240d2300 2023-07-14T13:10:02.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.842+0000 7fa22b59d640 1 -- 172.21.15.5:0/2658631653 --> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2240d07b0 con 0x7fa2080663f0 2023-07-14T13:10:02.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.870+0000 7fa228b38640 1 -- 172.21.15.5:0/2658631653 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fa2080663f0 msgr2=0x7fa2080688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1525189184 2023-07-14T13:10:02.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:02.870+0000 7fa228b38640 1 --2- 172.21.15.5:0/2658631653 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fa2080663f0 0x7fa2080688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-14T13:10:03.007 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:02.978+0000 7f580a94f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:10:03.067 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:03.038+0000 7f580a94f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:10:03.094 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:10:03.062+0000 7f3f39446180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:10:03.122 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:03.094+0000 7f580a94f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:10:03.156 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:10:03.122+0000 7f3f39446180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:10:03.208 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:03.178+0000 7f580a94f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:10:03.214 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:10:03.182+0000 7f3f39446180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:10:03.265 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:03.238+0000 7f580a94f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:10:03.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:03.274+0000 7fa228b38640 1 -- 172.21.15.5:0/2658631653 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fa2080663f0 msgr2=0x7fa2080688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1525189184 2023-07-14T13:10:03.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:03.274+0000 7fa228b38640 1 --2- 172.21.15.5:0/2658631653 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fa2080663f0 0x7fa2080688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-14T13:10:03.307 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:10:03.274+0000 7f3f39446180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:10:03.349 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:03.322+0000 7f580a94f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:10:03.366 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:10:03.334+0000 7f3f39446180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:10:03.406 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:03.378+0000 7f580a94f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:10:03.454 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:10:03.422+0000 7f3f39446180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:10:03.514 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:10:03.482+0000 7f3f39446180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:10:03.549 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:03.518+0000 7f580a94f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:10:03.607 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:03.578+0000 7f580a94f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:10:03.663 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:10:03.630+0000 7f3f39446180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:10:03.724 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:10:03.690+0000 7f3f39446180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:10:03.849 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:10:03.849 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:10:03.849 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:10:03.857 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:03.826+0000 7f580a94f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:10:03.975 INFO:tasks.ceph.mgr.y.smithi005.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:10:03.976 INFO:tasks.ceph.mgr.y.smithi005.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:10:03.976 INFO:tasks.ceph.mgr.y.smithi005.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:10:03.984 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:10:03.954+0000 7f3f39446180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:10:03.990 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:03.962+0000 7f580a94f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:10:04.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:04.078+0000 7fa228b38640 1 -- 172.21.15.5:0/2658631653 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fa2080663f0 msgr2=0x7fa2080688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1525189184 2023-07-14T13:10:04.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:04.078+0000 7fa228b38640 1 --2- 172.21.15.5:0/2658631653 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fa2080663f0 0x7fa2080688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-14T13:10:04.116 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:04.086+0000 7f580a94f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:10:04.126 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:10:04.094+0000 7f3f39446180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:10:04.186 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:04.158+0000 7f580a94f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:10:04.257 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:10:04.226+0000 7f3f39446180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:10:04.320 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:04.290+0000 7f580a94f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:10:04.330 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:10:04.298+0000 7f3f39446180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:10:04.471 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:10:04.438+0000 7f3f39446180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:10:04.859 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:04.830+0000 7f580a94f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:10:04.942 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:04.914+0000 7f580a94f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:10:05.041 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:10:05.010+0000 7f3f39446180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:10:05.089 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:05.058+0000 7f580a94f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:10:05.129 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:10:05.098+0000 7f3f39446180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:10:05.173 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:05.142+0000 7f580a94f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:10:05.283 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:10:05.250+0000 7f3f39446180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:10:05.370 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:10:05.338+0000 7f3f39446180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:10:05.441 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:05.410+0000 7f580a94f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:10:05.501 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:05.470+0000 7f580a94f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:10:05.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:05.482+0000 7fa219ffb640 1 -- 172.21.15.5:0/2658631653 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mgrmap(e 46) v1 ==== 85386+0+0 (secure 0 0 0) 0x7fa220051b80 con 0x7fa2240d2300 2023-07-14T13:10:05.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:05.482+0000 7fa219ffb640 1 -- 172.21.15.5:0/2658631653 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fa2080663f0 msgr2=0x7fa2080688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:10:05.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:05.482+0000 7fa219ffb640 1 --2- 172.21.15.5:0/2658631653 >> [v2:172.21.15.154:6832/1525189184,v1:172.21.15.154:6833/1525189184] conn(0x7fa2080663f0 0x7fa2080688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:05.637 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:05.606+0000 7f57899b0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:10:05.637 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:05.606+0000 7f57899b0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:10:05.637 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:05.606+0000 7f57899b0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:10:05.637 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:05.606+0000 7f57899b0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:10:05.638 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:05.606+0000 7f57899b0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:10:05.638 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:05.610+0000 7f578c9b6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:10:05.638 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:05.610+0000 7f578c9b6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:10:05.638 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:05.610+0000 7f578c9b6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:10:05.639 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:05.610+0000 7f578c9b6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:10:05.639 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:10:05.610+0000 7f578c9b6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:10:05.671 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:10:05.638+0000 7f3f39446180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:10:05.734 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:10:05.702+0000 7f3f39446180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:10:06.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.486+0000 7fa219ffb640 1 -- 172.21.15.5:0/2658631653 <== mon.1 v2:172.21.15.154:3300/0 8 ==== mgrmap(e 47) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fa220082750 con 0x7fa2240d2300 2023-07-14T13:10:06.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.490+0000 7fa219ffb640 1 --2- 172.21.15.5:0/2658631653 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7fa208033e90 0x7fa2080708c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:06.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.490+0000 7fa219ffb640 1 -- 172.21.15.5:0/2658631653 --> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa208034260 con 0x7fa208033e90 2023-07-14T13:10:06.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.490+0000 7fa228b38640 1 --2- 172.21.15.5:0/2658631653 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7fa208033e90 0x7fa2080708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:06.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.494+0000 7fa228b38640 1 --2- 172.21.15.5:0/2658631653 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7fa208033e90 0x7fa2080708c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa2140ae000 tx=0x7fa2140b3040 comp rx=0 tx=0).ready entity=mgr.6713 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:06.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.554+0000 7fa219ffb640 1 -- 172.21.15.5:0/2658631653 <== mgr.6713 v2:172.21.15.154:6832/1467987432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fa208034260 con 0x7fa208033e90 2023-07-14T13:10:06.589 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule set for path /bad-path 2023-07-14T13:10:06.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.558+0000 7fa22b59d640 1 -- 172.21.15.5:0/2658631653 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7fa208033e90 msgr2=0x7fa2080708c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:06.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.558+0000 7fa22b59d640 1 --2- 172.21.15.5:0/2658631653 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7fa208033e90 0x7fa2080708c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa2140ae000 tx=0x7fa2140b3040 comp rx=0 tx=0).stop 2023-07-14T13:10:06.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.558+0000 7fa22b59d640 1 -- 172.21.15.5:0/2658631653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2240d2300 msgr2=0x7fa22415c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:06.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.558+0000 7fa22b59d640 1 --2- 172.21.15.5:0/2658631653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2240d2300 0x7fa22415c5a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa22000ebe0 tx=0x7fa22000c520 comp rx=0 tx=0).stop 2023-07-14T13:10:06.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.558+0000 7fa229b3a640 1 -- 172.21.15.5:0/2658631653 reap_dead start 2023-07-14T13:10:06.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.558+0000 7fa22b59d640 1 -- 172.21.15.5:0/2658631653 shutdown_connections 2023-07-14T13:10:06.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.558+0000 7fa22b59d640 1 -- 172.21.15.5:0/2658631653 >> 172.21.15.5:0/2658631653 conn(0x7fa2240659d0 msgr2=0x7fa22406afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:06.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.558+0000 7fa22b59d640 1 -- 172.21.15.5:0/2658631653 shutdown_connections 2023-07-14T13:10:06.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.558+0000 7fa22b59d640 1 -- 172.21.15.5:0/2658631653 wait complete. 2023-07-14T13:10:06.611 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /bad-path 2023-07-14T13:10:06.612 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-07-14T13:10:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.730+0000 7eff312f9640 1 Processor -- start 2023-07-14T13:10:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.730+0000 7eff312f9640 1 -- start start 2023-07-14T13:10:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.730+0000 7eff312f9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7eff2c15f690 0x7eff2c0b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.730+0000 7eff312f9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7eff2c1453a0 0x7eff2c15fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.730+0000 7eff312f9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff2c06c040 con 0x7eff2c06c4d0 2023-07-14T13:10:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.730+0000 7eff312f9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff2c160600 con 0x7eff2c1453a0 2023-07-14T13:10:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.730+0000 7eff312f9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff2c160360 con 0x7eff2c15f690 2023-07-14T13:10:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.730+0000 7eff227fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7eff2c1453a0 0x7eff2c15fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.730+0000 7eff227fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7eff2c1453a0 0x7eff2c15fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38962/0 (socket says 172.21.15.5:38962) 2023-07-14T13:10:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.730+0000 7eff227fc640 1 -- 172.21.15.5:0/3352346730 learned_addr learned my addr 172.21.15.5:0/3352346730 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:10:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.730+0000 7eff2affd640 1 --2- 172.21.15.5:0/3352346730 >> v2:172.21.15.154:3300/0 conn(0x7eff2c15f690 0x7eff2c0b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.730+0000 7eff227fc640 1 -- 172.21.15.5:0/3352346730 >> v2:172.21.15.154:3300/0 conn(0x7eff2c15f690 msgr2=0x7eff2c0b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.730+0000 7eff227fc640 1 --2- 172.21.15.5:0/3352346730 >> v2:172.21.15.154:3300/0 conn(0x7eff2c15f690 0x7eff2c0b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:06.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.730+0000 7eff227fc640 1 -- 172.21.15.5:0/3352346730 >> v1:172.21.15.154:6789/0 conn(0x7eff2c06c4d0 legacy=0x7eff2c06c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:06.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.730+0000 7eff227fc640 1 -- 172.21.15.5:0/3352346730 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c06b9f0 con 0x7eff2c1453a0 2023-07-14T13:10:06.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.730+0000 7eff2affd640 1 --2- 172.21.15.5:0/3352346730 >> v2:172.21.15.154:3300/0 conn(0x7eff2c15f690 0x7eff2c0b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:10:06.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.734+0000 7eff227fc640 1 --2- 172.21.15.5:0/3352346730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff2c1453a0 0x7eff2c15fa60 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0aba90 tx=0x7eff1401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16bb5d2572d3764f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:06.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.734+0000 7eff2a7fc640 1 -- 172.21.15.5:0/3352346730 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff140a57b0 con 0x7eff2c1453a0 2023-07-14T13:10:06.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.734+0000 7eff2a7fc640 1 -- 172.21.15.5:0/3352346730 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff140a5910 con 0x7eff2c1453a0 2023-07-14T13:10:06.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.734+0000 7eff2a7fc640 1 -- 172.21.15.5:0/3352346730 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff140a5ca0 con 0x7eff2c1453a0 2023-07-14T13:10:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.734+0000 7eff312f9640 1 -- 172.21.15.5:0/3352346730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff2c1453a0 msgr2=0x7eff2c15fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.734+0000 7eff312f9640 1 --2- 172.21.15.5:0/3352346730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff2c1453a0 0x7eff2c15fa60 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0aba90 tx=0x7eff1401c8d0 comp rx=0 tx=0).stop 2023-07-14T13:10:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.734+0000 7eff312f9640 1 -- 172.21.15.5:0/3352346730 shutdown_connections 2023-07-14T13:10:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.734+0000 7eff312f9640 1 --2- 172.21.15.5:0/3352346730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff2c1453a0 0x7eff2c15fa60 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.734+0000 7eff312f9640 1 --2- 172.21.15.5:0/3352346730 >> v2:172.21.15.154:3300/0 conn(0x7eff2c15f690 0x7eff2c0b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.734+0000 7eff312f9640 1 -- 172.21.15.5:0/3352346730 >> 172.21.15.5:0/3352346730 conn(0x7eff2c0b1210 msgr2=0x7eff2c0ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.734+0000 7eff312f9640 1 -- 172.21.15.5:0/3352346730 shutdown_connections 2023-07-14T13:10:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.734+0000 7eff312f9640 1 -- 172.21.15.5:0/3352346730 wait complete. 2023-07-14T13:10:06.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.738+0000 7eff312f9640 1 Processor -- start 2023-07-14T13:10:06.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.738+0000 7eff312f9640 1 -- start start 2023-07-14T13:10:06.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.738+0000 7eff312f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff2c06c4d0 0x7eff2c0cded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:06.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.738+0000 7eff312f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff2c1453a0 0x7eff2c0aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:06.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.738+0000 7eff312f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff2c15f690 0x7eff2c0af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:06.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.738+0000 7eff312f9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c158900 con 0x7eff2c1453a0 2023-07-14T13:10:06.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.738+0000 7eff312f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c158be0 con 0x7eff2c15f690 2023-07-14T13:10:06.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.738+0000 7eff312f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c158ec0 con 0x7eff2c06c4d0 2023-07-14T13:10:06.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.738+0000 7eff227fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff2c1453a0 0x7eff2c0aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:06.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.738+0000 7eff227fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff2c1453a0 0x7eff2c0aeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38976/0 (socket says 172.21.15.5:38976) 2023-07-14T13:10:06.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.738+0000 7eff227fc640 1 -- 172.21.15.5:0/3788805609 learned_addr learned my addr 172.21.15.5:0/3788805609 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:10:06.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.738+0000 7eff2b7fe640 1 --2- 172.21.15.5:0/3788805609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff2c15f690 0x7eff2c0af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:06.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.738+0000 7eff2affd640 1 --2- 172.21.15.5:0/3788805609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff2c06c4d0 0x7eff2c0cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:06.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.738+0000 7eff227fc640 1 -- 172.21.15.5:0/3788805609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff2c06c4d0 msgr2=0x7eff2c0cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:06.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.738+0000 7eff227fc640 1 --2- 172.21.15.5:0/3788805609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff2c06c4d0 0x7eff2c0cded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:06.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.738+0000 7eff227fc640 1 -- 172.21.15.5:0/3788805609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff2c15f690 msgr2=0x7eff2c0af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:06.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.738+0000 7eff227fc640 1 --2- 172.21.15.5:0/3788805609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff2c15f690 0x7eff2c0af2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:06.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.738+0000 7eff227fc640 1 -- 172.21.15.5:0/3788805609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff14009b30 con 0x7eff2c1453a0 2023-07-14T13:10:06.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.738+0000 7eff227fc640 1 --2- 172.21.15.5:0/3788805609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff2c1453a0 0x7eff2c0aeda0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7eff140af040 tx=0x7eff14019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:06.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.738+0000 7eff23fff640 1 -- 172.21.15.5:0/3788805609 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff140b8670 con 0x7eff2c1453a0 2023-07-14T13:10:06.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.738+0000 7eff23fff640 1 -- 172.21.15.5:0/3788805609 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff140b87d0 con 0x7eff2c1453a0 2023-07-14T13:10:06.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.738+0000 7eff23fff640 1 -- 172.21.15.5:0/3788805609 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff140b8b80 con 0x7eff2c1453a0 2023-07-14T13:10:06.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.738+0000 7eff312f9640 1 -- 172.21.15.5:0/3788805609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff2c1591a0 con 0x7eff2c1453a0 2023-07-14T13:10:06.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.738+0000 7eff312f9640 1 -- 172.21.15.5:0/3788805609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2c157a40 con 0x7eff2c1453a0 2023-07-14T13:10:06.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.742+0000 7eff312f9640 1 -- 172.21.15.5:0/3788805609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff2c0678d0 con 0x7eff2c1453a0 2023-07-14T13:10:06.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.742+0000 7eff23fff640 1 -- 172.21.15.5:0/3788805609 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 47) v1 ==== 85513+0+0 (secure 0 0 0) 0x7eff140b8ce0 con 0x7eff2c1453a0 2023-07-14T13:10:06.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.742+0000 7eff23fff640 1 --2- 172.21.15.5:0/3788805609 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7eff0c066120 0x7eff0c0685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:06.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.742+0000 7eff23fff640 1 -- 172.21.15.5:0/3788805609 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6406+0+0 (secure 0 0 0) 0x7eff1411f270 con 0x7eff2c1453a0 2023-07-14T13:10:06.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.742+0000 7eff2affd640 1 --2- 172.21.15.5:0/3788805609 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7eff0c066120 0x7eff0c0685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:06.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.742+0000 7eff2affd640 1 --2- 172.21.15.5:0/3788805609 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7eff0c066120 0x7eff0c0685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00a9a0 tx=0x7eff1c008040 comp rx=0 tx=0).ready entity=mgr.6713 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:06.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.746+0000 7eff23fff640 1 -- 172.21.15.5:0/3788805609 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7eff140ec800 con 0x7eff2c1453a0 2023-07-14T13:10:06.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.922+0000 7eff312f9640 1 -- 172.21.15.5:0/3788805609 --> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff2c144fe0 con 0x7eff0c066120 2023-07-14T13:10:06.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.926+0000 7eff23fff640 1 -- 172.21.15.5:0/3788805609 <== mgr.6713 v2:172.21.15.154:6832/1467987432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+287 (secure 0 0 0) 0x7eff1c00a670 con 0x7eff0c066120 2023-07-14T13:10:06.961 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:10:06.961 INFO:teuthology.orchestra.run.smithi005.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T13:10:06", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-07-14T13:10:06.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.930+0000 7eff312f9640 1 -- 172.21.15.5:0/3788805609 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7eff0c066120 msgr2=0x7eff0c0685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:06.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.930+0000 7eff312f9640 1 --2- 172.21.15.5:0/3788805609 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7eff0c066120 0x7eff0c0685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00a9a0 tx=0x7eff1c008040 comp rx=0 tx=0).stop 2023-07-14T13:10:06.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.930+0000 7eff312f9640 1 -- 172.21.15.5:0/3788805609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff2c1453a0 msgr2=0x7eff2c0aeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:06.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.930+0000 7eff312f9640 1 --2- 172.21.15.5:0/3788805609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff2c1453a0 0x7eff2c0aeda0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7eff140af040 tx=0x7eff14019670 comp rx=0 tx=0).stop 2023-07-14T13:10:06.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.930+0000 7eff312f9640 1 -- 172.21.15.5:0/3788805609 shutdown_connections 2023-07-14T13:10:06.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.930+0000 7eff312f9640 1 --2- 172.21.15.5:0/3788805609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff2c15f690 0x7eff2c0af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:06.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.930+0000 7eff312f9640 1 --2- 172.21.15.5:0/3788805609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff2c1453a0 0x7eff2c0aeda0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:06.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.930+0000 7eff312f9640 1 --2- 172.21.15.5:0/3788805609 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7eff0c066120 0x7eff0c0685d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:06.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.930+0000 7eff312f9640 1 --2- 172.21.15.5:0/3788805609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff2c06c4d0 0x7eff2c0cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:06.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.930+0000 7eff312f9640 1 -- 172.21.15.5:0/3788805609 >> 172.21.15.5:0/3788805609 conn(0x7eff2c0b1210 msgr2=0x7eff2c140690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:06.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.930+0000 7eff312f9640 1 -- 172.21.15.5:0/3788805609 shutdown_connections 2023-07-14T13:10:06.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:10:06.930+0000 7eff312f9640 1 -- 172.21.15.5:0/3788805609 wait complete. 2023-07-14T13:10:06.982 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T13:10:06", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-07-14T13:10:18.048 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:10:18.052 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:10:48.119 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:10:48.123 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:11:00.600 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:00.568+0000 7f577c195640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:11:00.601 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:00.568+0000 7f577c195640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:11:00.601 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:00.568+0000 7f577c195640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:11:00.601 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:00.568+0000 7f577c195640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:11:00.601 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:00.568+0000 7f577c195640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:11:06.984 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-07-14T13:11:07.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.108+0000 7f2a04b96640 1 Processor -- start 2023-07-14T13:11:07.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.108+0000 7f2a04b96640 1 -- start start 2023-07-14T13:11:07.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.108+0000 7f2a04b96640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2a00070f30 0x7f2a000ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:07.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.108+0000 7f2a04b96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a000af2b0 0x7f2a0015a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:07.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.108+0000 7f2a04b96640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a00159d70 con 0x7f2a00069430 2023-07-14T13:11:07.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.108+0000 7f2a04b96640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a000c9c60 con 0x7f2a00070f30 2023-07-14T13:11:07.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.108+0000 7f2a04b96640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a000c9f40 con 0x7f2a000af2b0 2023-07-14T13:11:07.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.108+0000 7f29f7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2a00070f30 0x7f2a000ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:07.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.108+0000 7f29f7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2a00070f30 0x7f2a000ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40650/0 (socket says 172.21.15.5:40650) 2023-07-14T13:11:07.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.108+0000 7f29f7fff640 1 -- 172.21.15.5:0/3348819167 learned_addr learned my addr 172.21.15.5:0/3348819167 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:07.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.108+0000 7f29fed9d640 1 --2- 172.21.15.5:0/3348819167 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a000af2b0 0x7f2a0015a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:07.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.112+0000 7f29f7fff640 1 -- 172.21.15.5:0/3348819167 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a000af2b0 msgr2=0x7f2a0015a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:07.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.112+0000 7f29f7fff640 1 --2- 172.21.15.5:0/3348819167 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a000af2b0 0x7f2a0015a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:07.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.112+0000 7f29f7fff640 1 -- 172.21.15.5:0/3348819167 >> v1:172.21.15.154:6789/0 conn(0x7f2a00069430 legacy=0x7f2a00069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:07.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.112+0000 7f29f7fff640 1 -- 172.21.15.5:0/3348819167 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a000ca220 con 0x7f2a00070f30 2023-07-14T13:11:07.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.112+0000 7f29fed9d640 1 --2- 172.21.15.5:0/3348819167 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a000af2b0 0x7f2a0015a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:11:07.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.112+0000 7f29f7fff640 1 --2- 172.21.15.5:0/3348819167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a00070f30 0x7f2a000ad6f0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f29e8009870 tx=0x7f29e801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce0929d83f4cf8d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:07.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.112+0000 7f29fdd9b640 1 -- 172.21.15.5:0/3348819167 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e80a9400 con 0x7f2a00070f30 2023-07-14T13:11:07.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.112+0000 7f29fdd9b640 1 -- 172.21.15.5:0/3348819167 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e80a9560 con 0x7f2a00070f30 2023-07-14T13:11:07.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.112+0000 7f29fdd9b640 1 -- 172.21.15.5:0/3348819167 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e80a98f0 con 0x7f2a00070f30 2023-07-14T13:11:07.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.112+0000 7f2a04b96640 1 -- 172.21.15.5:0/3348819167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a00070f30 msgr2=0x7f2a000ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:07.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.112+0000 7f2a04b96640 1 --2- 172.21.15.5:0/3348819167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a00070f30 0x7f2a000ad6f0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f29e8009870 tx=0x7f29e801c540 comp rx=0 tx=0).stop 2023-07-14T13:11:07.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.116+0000 7f2a04b96640 1 -- 172.21.15.5:0/3348819167 shutdown_connections 2023-07-14T13:11:07.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.116+0000 7f2a04b96640 1 --2- 172.21.15.5:0/3348819167 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a000af2b0 0x7f2a0015a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:07.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.116+0000 7f2a04b96640 1 --2- 172.21.15.5:0/3348819167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a00070f30 0x7f2a000ad6f0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:07.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.116+0000 7f2a04b96640 1 -- 172.21.15.5:0/3348819167 >> 172.21.15.5:0/3348819167 conn(0x7f2a000cde90 msgr2=0x7f2a000ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:07.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.116+0000 7f2a04b96640 1 -- 172.21.15.5:0/3348819167 shutdown_connections 2023-07-14T13:11:07.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.116+0000 7f2a04b96640 1 -- 172.21.15.5:0/3348819167 wait complete. 2023-07-14T13:11:07.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.116+0000 7f2a04b96640 1 Processor -- start 2023-07-14T13:11:07.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.116+0000 7f2a04b96640 1 -- start start 2023-07-14T13:11:07.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.116+0000 7f2a04b96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a00069430 0x7f2a000c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:07.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.116+0000 7f2a04b96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a00070f30 0x7f2a00155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.116+0000 7f2a04b96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a000af2b0 0x7f2a00156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.116+0000 7f2a04b96640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a000ac2d0 con 0x7f2a00069430 2023-07-14T13:11:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.116+0000 7f2a04b96640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a000c4d10 con 0x7f2a00070f30 2023-07-14T13:11:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.116+0000 7f2a04b96640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a000c84e0 con 0x7f2a000af2b0 2023-07-14T13:11:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.116+0000 7f29fe59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a00069430 0x7f2a000c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.116+0000 7f29fe59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a00069430 0x7f2a000c47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40662/0 (socket says 172.21.15.5:40662) 2023-07-14T13:11:07.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.116+0000 7f29fe59c640 1 -- 172.21.15.5:0/3503654996 learned_addr learned my addr 172.21.15.5:0/3503654996 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:07.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.116+0000 7f29f7fff640 1 --2- 172.21.15.5:0/3503654996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a00070f30 0x7f2a00155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:07.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.116+0000 7f29fed9d640 1 --2- 172.21.15.5:0/3503654996 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a000af2b0 0x7f2a00156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:07.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.116+0000 7f29fe59c640 1 -- 172.21.15.5:0/3503654996 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a000af2b0 msgr2=0x7f2a00156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:07.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.116+0000 7f29fe59c640 1 --2- 172.21.15.5:0/3503654996 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a000af2b0 0x7f2a00156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:07.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.116+0000 7f29fe59c640 1 -- 172.21.15.5:0/3503654996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a00070f30 msgr2=0x7f2a00155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:07.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.116+0000 7f29fe59c640 1 --2- 172.21.15.5:0/3503654996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a00070f30 0x7f2a00155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:07.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.116+0000 7f29fe59c640 1 -- 172.21.15.5:0/3503654996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e80094d0 con 0x7f2a00069430 2023-07-14T13:11:07.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.120+0000 7f29fe59c640 1 --2- 172.21.15.5:0/3503654996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a00069430 0x7f2a000c47d0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f29f000c3c0 tx=0x7f29f000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:07.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.120+0000 7f29f6ffd640 1 -- 172.21.15.5:0/3503654996 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f00052d0 con 0x7f2a00069430 2023-07-14T13:11:07.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.120+0000 7f29f6ffd640 1 -- 172.21.15.5:0/3503654996 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f0005430 con 0x7f2a00069430 2023-07-14T13:11:07.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.120+0000 7f29f6ffd640 1 -- 172.21.15.5:0/3503654996 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f0003840 con 0x7f2a00069430 2023-07-14T13:11:07.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.120+0000 7f2a04b96640 1 -- 172.21.15.5:0/3503654996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a000b1380 con 0x7f2a00069430 2023-07-14T13:11:07.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.120+0000 7f2a04b96640 1 -- 172.21.15.5:0/3503654996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a000abc10 con 0x7f2a00069430 2023-07-14T13:11:07.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.120+0000 7f2a04b96640 1 -- 172.21.15.5:0/3503654996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a000678d0 con 0x7f2a00069430 2023-07-14T13:11:07.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.120+0000 7f29f6ffd640 1 -- 172.21.15.5:0/3503654996 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 49) v1 ==== 85891+0+0 (secure 0 0 0) 0x7f29f00039a0 con 0x7f2a00069430 2023-07-14T13:11:07.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.120+0000 7f29f6ffd640 1 --2- 172.21.15.5:0/3503654996 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f29e0066510 0x7f29e00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:07.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.120+0000 7f29f6ffd640 1 -- 172.21.15.5:0/3503654996 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f29f0083670 con 0x7f2a00069430 2023-07-14T13:11:07.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.120+0000 7f29f7fff640 1 --2- 172.21.15.5:0/3503654996 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f29e0066510 0x7f29e00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:07.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.124+0000 7f29f7fff640 1 --2- 172.21.15.5:0/3503654996 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f29e0066510 0x7f29e00689c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f29e80ae000 tx=0x7f29e80b3040 comp rx=0 tx=0).ready entity=mgr.6713 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:07.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.124+0000 7f29f6ffd640 1 -- 172.21.15.5:0/3503654996 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f29f00506b0 con 0x7f2a00069430 2023-07-14T13:11:07.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.300+0000 7f2a04b96640 1 -- 172.21.15.5:0/3503654996 --> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2a00157710 con 0x7f29e0066510 2023-07-14T13:11:07.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.312+0000 7f29f6ffd640 1 -- 172.21.15.5:0/3503654996 <== mgr.6713 v2:172.21.15.154:6832/1467987432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+288 (secure 0 0 0) 0x7f29e80a97d0 con 0x7f29e0066510 2023-07-14T13:11:07.347 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:11:07.347 INFO:teuthology.orchestra.run.smithi005.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T13:10:06", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-07-14T13:11:07.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.312+0000 7f2a04b96640 1 -- 172.21.15.5:0/3503654996 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f29e0066510 msgr2=0x7f29e00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:07.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.312+0000 7f2a04b96640 1 --2- 172.21.15.5:0/3503654996 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f29e0066510 0x7f29e00689c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f29e80ae000 tx=0x7f29e80b3040 comp rx=0 tx=0).stop 2023-07-14T13:11:07.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.312+0000 7f2a04b96640 1 -- 172.21.15.5:0/3503654996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a00069430 msgr2=0x7f2a000c47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:07.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.312+0000 7f2a04b96640 1 --2- 172.21.15.5:0/3503654996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a00069430 0x7f2a000c47d0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f29f000c3c0 tx=0x7f29f000c880 comp rx=0 tx=0).stop 2023-07-14T13:11:07.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.312+0000 7f2a04b96640 1 -- 172.21.15.5:0/3503654996 shutdown_connections 2023-07-14T13:11:07.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.312+0000 7f2a04b96640 1 --2- 172.21.15.5:0/3503654996 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f29e0066510 0x7f29e00689c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:07.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.312+0000 7f2a04b96640 1 --2- 172.21.15.5:0/3503654996 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a000af2b0 0x7f2a00156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:07.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.312+0000 7f2a04b96640 1 --2- 172.21.15.5:0/3503654996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a00070f30 0x7f2a00155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:07.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.312+0000 7f2a04b96640 1 --2- 172.21.15.5:0/3503654996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a00069430 0x7f2a000c47d0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:07.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.312+0000 7f2a04b96640 1 -- 172.21.15.5:0/3503654996 >> 172.21.15.5:0/3503654996 conn(0x7f2a000cde90 msgr2=0x7f2a0006c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:07.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.312+0000 7f2a04b96640 1 -- 172.21.15.5:0/3503654996 shutdown_connections 2023-07-14T13:11:07.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.312+0000 7f2a04b96640 1 -- 172.21.15.5:0/3503654996 wait complete. 2023-07-14T13:11:07.367 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T13:10:06", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-07-14T13:11:07.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /bad-path 2023-07-14T13:11:07.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.480+0000 7f2722a48640 1 Processor -- start 2023-07-14T13:11:07.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.480+0000 7f2722a48640 1 -- start start 2023-07-14T13:11:07.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.480+0000 7f2722a48640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f271c15bba0 0x7f271c0c4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:07.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.480+0000 7f2722a48640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f271c0c2d30 0x7f271c0acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:07.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.484+0000 7f2722a48640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f271c0ad280 0x7f271c0ab890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:07.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.484+0000 7f2722a48640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271c0ad700 con 0x7f271c0ad280 2023-07-14T13:11:07.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.484+0000 7f2722a48640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271c15bf70 con 0x7f271c15bba0 2023-07-14T13:11:07.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.484+0000 7f2722a48640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271c1600e0 con 0x7f271c0c2d30 2023-07-14T13:11:07.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.484+0000 7f2720fe5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f271c0ad280 0x7f271c0ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:07.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.484+0000 7f2720fe5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f271c0ad280 0x7f271c0ab890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40664/0 (socket says 172.21.15.5:40664) 2023-07-14T13:11:07.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.484+0000 7f2720fe5640 1 -- 172.21.15.5:0/3460025477 learned_addr learned my addr 172.21.15.5:0/3460025477 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:07.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.484+0000 7f271bfff640 1 --2- 172.21.15.5:0/3460025477 >> v2:172.21.15.154:3300/0 conn(0x7f271c15bba0 0x7f271c0c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.484+0000 7f271b7fe640 1 --2- 172.21.15.5:0/3460025477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f271c0c2d30 0x7f271c0acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.484+0000 7f2720fe5640 1 -- 172.21.15.5:0/3460025477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f271c0c2d30 msgr2=0x7f271c0acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.484+0000 7f2720fe5640 1 --2- 172.21.15.5:0/3460025477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f271c0c2d30 0x7f271c0acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.484+0000 7f2720fe5640 1 -- 172.21.15.5:0/3460025477 >> v2:172.21.15.154:3300/0 conn(0x7f271c15bba0 msgr2=0x7f271c0c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.484+0000 7f2720fe5640 1 --2- 172.21.15.5:0/3460025477 >> v2:172.21.15.154:3300/0 conn(0x7f271c15bba0 0x7f271c0c4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.484+0000 7f2720fe5640 1 -- 172.21.15.5:0/3460025477 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271c0c4d00 con 0x7f271c0ad280 2023-07-14T13:11:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.484+0000 7f271bfff640 1 --2- 172.21.15.5:0/3460025477 >> v2:172.21.15.154:3300/0 conn(0x7f271c15bba0 0x7f271c0c4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:11:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.484+0000 7f271b7fe640 1 --2- 172.21.15.5:0/3460025477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f271c0c2d30 0x7f271c0acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:11:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.484+0000 7f2720fe5640 1 --2- 172.21.15.5:0/3460025477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f271c0ad280 0x7f271c0ab890 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f271c06a4b0 tx=0x7f271401c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4eef4bc748d68d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.484+0000 7f271affd640 1 -- 172.21.15.5:0/3460025477 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27140a6450 con 0x7f271c0ad280 2023-07-14T13:11:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.484+0000 7f271affd640 1 -- 172.21.15.5:0/3460025477 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27140a65b0 con 0x7f271c0ad280 2023-07-14T13:11:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.484+0000 7f271affd640 1 -- 172.21.15.5:0/3460025477 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27140a6940 con 0x7f271c0ad280 2023-07-14T13:11:07.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.488+0000 7f2722a48640 1 -- 172.21.15.5:0/3460025477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f271c0ad280 msgr2=0x7f271c0ab890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:07.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.488+0000 7f2722a48640 1 --2- 172.21.15.5:0/3460025477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f271c0ad280 0x7f271c0ab890 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f271c06a4b0 tx=0x7f271401c5c0 comp rx=0 tx=0).stop 2023-07-14T13:11:07.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.488+0000 7f2722a48640 1 -- 172.21.15.5:0/3460025477 shutdown_connections 2023-07-14T13:11:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.488+0000 7f2722a48640 1 --2- 172.21.15.5:0/3460025477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f271c0ad280 0x7f271c0ab890 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.488+0000 7f2722a48640 1 --2- 172.21.15.5:0/3460025477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f271c0c2d30 0x7f271c0acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.488+0000 7f2722a48640 1 --2- 172.21.15.5:0/3460025477 >> v2:172.21.15.154:3300/0 conn(0x7f271c15bba0 0x7f271c0c4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.488+0000 7f2722a48640 1 -- 172.21.15.5:0/3460025477 >> 172.21.15.5:0/3460025477 conn(0x7f271c0cde90 msgr2=0x7f271c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.488+0000 7f2722a48640 1 -- 172.21.15.5:0/3460025477 shutdown_connections 2023-07-14T13:11:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.488+0000 7f2722a48640 1 -- 172.21.15.5:0/3460025477 wait complete. 2023-07-14T13:11:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.488+0000 7f2722a48640 1 Processor -- start 2023-07-14T13:11:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.488+0000 7f2722a48640 1 -- start start 2023-07-14T13:11:07.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.488+0000 7f2722a48640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f271c0ad280 0x7f271c13fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:07.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.488+0000 7f2722a48640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f271c0c2d30 0x7f271c13dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:07.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.488+0000 7f2722a48640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f271c15bba0 0x7f271c15e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:07.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.488+0000 7f2722a48640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271c15c8a0 con 0x7f271c0c2d30 2023-07-14T13:11:07.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.488+0000 7f2722a48640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271c140620 con 0x7f271c15bba0 2023-07-14T13:11:07.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.488+0000 7f2722a48640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271c140900 con 0x7f271c0ad280 2023-07-14T13:11:07.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.488+0000 7f271b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f271c0c2d30 0x7f271c13dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.488+0000 7f271b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f271c0c2d30 0x7f271c13dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40680/0 (socket says 172.21.15.5:40680) 2023-07-14T13:11:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.488+0000 7f271b7fe640 1 -- 172.21.15.5:0/85791944 learned_addr learned my addr 172.21.15.5:0/85791944 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.488+0000 7f2720fe5640 1 --2- 172.21.15.5:0/85791944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f271c15bba0 0x7f271c15e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.488+0000 7f271bfff640 1 --2- 172.21.15.5:0/85791944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f271c0ad280 0x7f271c13fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.492+0000 7f271b7fe640 1 -- 172.21.15.5:0/85791944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f271c0ad280 msgr2=0x7f271c13fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.492+0000 7f271b7fe640 1 --2- 172.21.15.5:0/85791944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f271c0ad280 0x7f271c13fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.492+0000 7f271b7fe640 1 -- 172.21.15.5:0/85791944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f271c15bba0 msgr2=0x7f271c15e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:07.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.492+0000 7f271b7fe640 1 --2- 172.21.15.5:0/85791944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f271c15bba0 0x7f271c15e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:07.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.492+0000 7f271b7fe640 1 -- 172.21.15.5:0/85791944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2714009b30 con 0x7f271c0c2d30 2023-07-14T13:11:07.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.492+0000 7f271b7fe640 1 --2- 172.21.15.5:0/85791944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f271c0c2d30 0x7f271c13dc60 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f271000c7f0 tx=0x7f271000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:07.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.492+0000 7f2718ff9640 1 -- 172.21.15.5:0/85791944 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710007820 con 0x7f271c0c2d30 2023-07-14T13:11:07.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.492+0000 7f2718ff9640 1 -- 172.21.15.5:0/85791944 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2710007980 con 0x7f271c0c2d30 2023-07-14T13:11:07.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.492+0000 7f2718ff9640 1 -- 172.21.15.5:0/85791944 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710007d30 con 0x7f271c0c2d30 2023-07-14T13:11:07.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.492+0000 7f2722a48640 1 -- 172.21.15.5:0/85791944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f271c140be0 con 0x7f271c0c2d30 2023-07-14T13:11:07.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.492+0000 7f2722a48640 1 -- 172.21.15.5:0/85791944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f271c15e0e0 con 0x7f271c0c2d30 2023-07-14T13:11:07.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.492+0000 7f2722a48640 1 -- 172.21.15.5:0/85791944 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f271c15dcc0 con 0x7f271c0c2d30 2023-07-14T13:11:07.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.492+0000 7f2718ff9640 1 -- 172.21.15.5:0/85791944 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 49) v1 ==== 85891+0+0 (secure 0 0 0) 0x7f27100113f0 con 0x7f271c0c2d30 2023-07-14T13:11:07.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.492+0000 7f2718ff9640 1 --2- 172.21.15.5:0/85791944 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f2708066510 0x7f27080689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:07.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.492+0000 7f2718ff9640 1 -- 172.21.15.5:0/85791944 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f2710084780 con 0x7f271c0c2d30 2023-07-14T13:11:07.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.496+0000 7f271bfff640 1 --2- 172.21.15.5:0/85791944 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f2708066510 0x7f27080689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:07.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.496+0000 7f271bfff640 1 --2- 172.21.15.5:0/85791944 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f2708066510 0x7f27080689c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f271c15b8e0 tx=0x7f270c008040 comp rx=0 tx=0).ready entity=mgr.6713 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:07.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.496+0000 7f2718ff9640 1 -- 172.21.15.5:0/85791944 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f271c15dcc0 con 0x7f271c0c2d30 2023-07-14T13:11:07.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.672+0000 7f2722a48640 1 -- 172.21.15.5:0/85791944 --> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""]}) v1 -- 0x7f271c15fd70 con 0x7f2708066510 2023-07-14T13:11:07.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.744+0000 7f2718ff9640 1 -- 172.21.15.5:0/85791944 <== mgr.6713 v2:172.21.15.154:6832/1467987432 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+36 (secure 0 0 0) 0x7f270c00c040 con 0x7f2708066510 2023-07-14T13:11:07.779 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule removed for path /bad-path 2023-07-14T13:11:07.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.744+0000 7f2722a48640 1 -- 172.21.15.5:0/85791944 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f2708066510 msgr2=0x7f27080689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:07.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.744+0000 7f2722a48640 1 --2- 172.21.15.5:0/85791944 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f2708066510 0x7f27080689c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f271c15b8e0 tx=0x7f270c008040 comp rx=0 tx=0).stop 2023-07-14T13:11:07.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.744+0000 7f2722a48640 1 -- 172.21.15.5:0/85791944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f271c0c2d30 msgr2=0x7f271c13dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:07.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.744+0000 7f2722a48640 1 --2- 172.21.15.5:0/85791944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f271c0c2d30 0x7f271c13dc60 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f271000c7f0 tx=0x7f271000ccb0 comp rx=0 tx=0).stop 2023-07-14T13:11:07.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.744+0000 7f2722a48640 1 -- 172.21.15.5:0/85791944 shutdown_connections 2023-07-14T13:11:07.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.744+0000 7f2722a48640 1 --2- 172.21.15.5:0/85791944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f271c15bba0 0x7f271c15e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:07.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.744+0000 7f2722a48640 1 --2- 172.21.15.5:0/85791944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f271c0c2d30 0x7f271c13dc60 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:07.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.744+0000 7f2722a48640 1 --2- 172.21.15.5:0/85791944 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f2708066510 0x7f27080689c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:07.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.744+0000 7f2722a48640 1 --2- 172.21.15.5:0/85791944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f271c0ad280 0x7f271c13fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:07.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.744+0000 7f2722a48640 1 -- 172.21.15.5:0/85791944 >> 172.21.15.5:0/85791944 conn(0x7f271c0cde90 msgr2=0x7f271c0acb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:07.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.744+0000 7f2722a48640 1 -- 172.21.15.5:0/85791944 shutdown_connections 2023-07-14T13:11:07.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.744+0000 7f2722a48640 1 -- 172.21.15.5:0/85791944 wait complete. 2023-07-14T13:11:07.800 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /bad-path 2023-07-14T13:11:07.800 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-14T13:11:07.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.912+0000 7fa25359e640 1 Processor -- start 2023-07-14T13:11:07.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.912+0000 7fa25359e640 1 -- start start 2023-07-14T13:11:07.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.912+0000 7fa25359e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa2540af8b0 0x7fa2540afc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:07.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.912+0000 7fa25359e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2540703a0 con 0x7fa25415c2a0 2023-07-14T13:11:07.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.912+0000 7fa25359e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2540b01c0 con 0x7fa2540c8db0 2023-07-14T13:11:07.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.912+0000 7fa25359e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa25415ce20 con 0x7fa2540af8b0 2023-07-14T13:11:07.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.912+0000 7fa24bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa25415c2a0 0x7fa25415c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45216/0 (socket says 172.21.15.5:45216) 2023-07-14T13:11:07.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.916+0000 7fa24bfff640 1 -- 172.21.15.5:0/1760490662 learned_addr learned my addr 172.21.15.5:0/1760490662 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:07.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.916+0000 7fa25259c640 1 --2- 172.21.15.5:0/1760490662 >> v2:172.21.15.154:3300/0 conn(0x7fa2540af8b0 0x7fa2540afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:07.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.916+0000 7fa251d9b640 1 -- 172.21.15.5:0/1760490662 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2742061722 0 0) 0x7fa23c001120 con 0x7fa25415c2a0 2023-07-14T13:11:07.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.916+0000 7fa251d9b640 1 -- 172.21.15.5:0/1760490662 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa240005740 con 0x7fa25415c2a0 2023-07-14T13:11:07.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.916+0000 7fa251d9b640 1 -- 172.21.15.5:0/1760490662 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3229815678 0 0) 0x7fa2540b01c0 con 0x7fa2540c8db0 2023-07-14T13:11:07.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.916+0000 7fa251d9b640 1 -- 172.21.15.5:0/1760490662 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa23c001120 con 0x7fa2540c8db0 2023-07-14T13:11:07.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.916+0000 7fa25259c640 1 -- 172.21.15.5:0/1760490662 >> v1:172.21.15.154:6789/0 conn(0x7fa2540c8db0 legacy=0x7fa2540c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:07.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.916+0000 7fa25259c640 1 -- 172.21.15.5:0/1760490662 >> v1:172.21.15.5:6789/0 conn(0x7fa25415c2a0 legacy=0x7fa25415c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:07.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.916+0000 7fa25259c640 1 -- 172.21.15.5:0/1760490662 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25415d010 con 0x7fa2540af8b0 2023-07-14T13:11:07.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.916+0000 7fa25259c640 1 --2- 172.21.15.5:0/1760490662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2540af8b0 0x7fa2540afc80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fa2440097c0 tx=0x7fa24401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b70b71d94493fe52 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:07.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.920+0000 7fa251d9b640 1 -- 172.21.15.5:0/1760490662 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa244004230 con 0x7fa2540af8b0 2023-07-14T13:11:07.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.920+0000 7fa251d9b640 1 -- 172.21.15.5:0/1760490662 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2440a7050 con 0x7fa2540af8b0 2023-07-14T13:11:07.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.920+0000 7fa251d9b640 1 -- 172.21.15.5:0/1760490662 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa244003620 con 0x7fa2540af8b0 2023-07-14T13:11:07.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.920+0000 7fa25359e640 1 -- 172.21.15.5:0/1760490662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2540af8b0 msgr2=0x7fa2540afc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:07.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.920+0000 7fa25359e640 1 --2- 172.21.15.5:0/1760490662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2540af8b0 0x7fa2540afc80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fa2440097c0 tx=0x7fa24401c450 comp rx=0 tx=0).stop 2023-07-14T13:11:07.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.920+0000 7fa25359e640 1 -- 172.21.15.5:0/1760490662 shutdown_connections 2023-07-14T13:11:07.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.920+0000 7fa25359e640 1 --2- 172.21.15.5:0/1760490662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2540af8b0 0x7fa2540afc80 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:07.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.920+0000 7fa25359e640 1 -- 172.21.15.5:0/1760490662 >> 172.21.15.5:0/1760490662 conn(0x7fa2540ca8b0 msgr2=0x7fa2540cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:07.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.920+0000 7fa25359e640 1 -- 172.21.15.5:0/1760490662 shutdown_connections 2023-07-14T13:11:07.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.920+0000 7fa25359e640 1 -- 172.21.15.5:0/1760490662 wait complete. 2023-07-14T13:11:07.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.920+0000 7fa25359e640 1 Processor -- start 2023-07-14T13:11:07.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.920+0000 7fa25359e640 1 -- start start 2023-07-14T13:11:07.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.920+0000 7fa25359e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2540af8b0 0x7fa25414ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:07.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.920+0000 7fa25359e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2540c8db0 0x7fa2540c23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:07.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.920+0000 7fa25359e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa25415c2a0 0x7fa2540ce070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:07.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.920+0000 7fa25359e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2540c2920 con 0x7fa25415c2a0 2023-07-14T13:11:07.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.920+0000 7fa25359e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25414f510 con 0x7fa2540af8b0 2023-07-14T13:11:07.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.920+0000 7fa25359e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25414f7f0 con 0x7fa2540c8db0 2023-07-14T13:11:07.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.920+0000 7fa252d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa25415c2a0 0x7fa2540ce070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:07.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.920+0000 7fa252d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa25415c2a0 0x7fa2540ce070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40688/0 (socket says 172.21.15.5:40688) 2023-07-14T13:11:07.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.920+0000 7fa252d9d640 1 -- 172.21.15.5:0/2707351785 learned_addr learned my addr 172.21.15.5:0/2707351785 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:07.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.924+0000 7fa24bfff640 1 --2- 172.21.15.5:0/2707351785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2540c8db0 0x7fa2540c23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:07.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.924+0000 7fa25259c640 1 --2- 172.21.15.5:0/2707351785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2540af8b0 0x7fa25414ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:07.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.924+0000 7fa252d9d640 1 -- 172.21.15.5:0/2707351785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2540c8db0 msgr2=0x7fa2540c23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:07.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.924+0000 7fa252d9d640 1 --2- 172.21.15.5:0/2707351785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2540c8db0 0x7fa2540c23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:07.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.924+0000 7fa252d9d640 1 -- 172.21.15.5:0/2707351785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2540af8b0 msgr2=0x7fa25414ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:07.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.924+0000 7fa252d9d640 1 --2- 172.21.15.5:0/2707351785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2540af8b0 0x7fa25414ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:07.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.924+0000 7fa252d9d640 1 -- 172.21.15.5:0/2707351785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa244009420 con 0x7fa25415c2a0 2023-07-14T13:11:07.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.924+0000 7fa252d9d640 1 --2- 172.21.15.5:0/2707351785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa25415c2a0 0x7fa2540ce070 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00c730 tx=0x7fa24c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:07.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.924+0000 7fa24affd640 1 -- 172.21.15.5:0/2707351785 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c003b80 con 0x7fa25415c2a0 2023-07-14T13:11:07.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.924+0000 7fa24affd640 1 -- 172.21.15.5:0/2707351785 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24c003ce0 con 0x7fa25415c2a0 2023-07-14T13:11:07.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.924+0000 7fa24affd640 1 -- 172.21.15.5:0/2707351785 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c00aa90 con 0x7fa25415c2a0 2023-07-14T13:11:07.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.924+0000 7fa25359e640 1 -- 172.21.15.5:0/2707351785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa25414fad0 con 0x7fa25415c2a0 2023-07-14T13:11:07.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.924+0000 7fa25359e640 1 -- 172.21.15.5:0/2707351785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa254150090 con 0x7fa25415c2a0 2023-07-14T13:11:07.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.924+0000 7fa25359e640 1 -- 172.21.15.5:0/2707351785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa25404e020 con 0x7fa25415c2a0 2023-07-14T13:11:07.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.924+0000 7fa24affd640 1 -- 172.21.15.5:0/2707351785 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 49) v1 ==== 85891+0+0 (secure 0 0 0) 0x7fa24c00abf0 con 0x7fa25415c2a0 2023-07-14T13:11:07.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.928+0000 7fa24affd640 1 --2- 172.21.15.5:0/2707351785 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7fa234066510 0x7fa2340689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:07.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.928+0000 7fa24affd640 1 -- 172.21.15.5:0/2707351785 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fa24c084090 con 0x7fa25415c2a0 2023-07-14T13:11:07.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.928+0000 7fa25259c640 1 --2- 172.21.15.5:0/2707351785 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7fa234066510 0x7fa2340689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:07.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.928+0000 7fa25259c640 1 --2- 172.21.15.5:0/2707351785 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7fa234066510 0x7fa2340689c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa2440ad000 tx=0x7fa244008040 comp rx=0 tx=0).ready entity=mgr.6713 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:07.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:07.932+0000 7fa24affd640 1 -- 172.21.15.5:0/2707351785 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa24c051080 con 0x7fa25415c2a0 2023-07-14T13:11:08.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:08.124+0000 7fa25359e640 1 -- 172.21.15.5:0/2707351785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fa2540c8960 con 0x7fa25415c2a0 2023-07-14T13:11:08.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:08.796+0000 7fa24affd640 1 -- 172.21.15.5:0/2707351785 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 50) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fa24c051450 con 0x7fa25415c2a0 2023-07-14T13:11:08.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:08.800+0000 7fa24affd640 1 -- 172.21.15.5:0/2707351785 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v50) v1 ==== 93+0+0 (secure 0 0 0) 0x7fa24c06f3b0 con 0x7fa25415c2a0 2023-07-14T13:11:08.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:08.800+0000 7fa25359e640 1 -- 172.21.15.5:0/2707351785 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7fa234066510 msgr2=0x7fa2340689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:08.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:08.800+0000 7fa25359e640 1 --2- 172.21.15.5:0/2707351785 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7fa234066510 0x7fa2340689c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa2440ad000 tx=0x7fa244008040 comp rx=0 tx=0).stop 2023-07-14T13:11:08.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:08.800+0000 7fa25359e640 1 -- 172.21.15.5:0/2707351785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa25415c2a0 msgr2=0x7fa2540ce070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:08.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:08.800+0000 7fa25359e640 1 --2- 172.21.15.5:0/2707351785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa25415c2a0 0x7fa2540ce070 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00c730 tx=0x7fa24c00cbf0 comp rx=0 tx=0).stop 2023-07-14T13:11:08.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:08.800+0000 7fa25359e640 1 -- 172.21.15.5:0/2707351785 shutdown_connections 2023-07-14T13:11:08.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:08.800+0000 7fa25359e640 1 --2- 172.21.15.5:0/2707351785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa25415c2a0 0x7fa2540ce070 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:08.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:08.800+0000 7fa25359e640 1 --2- 172.21.15.5:0/2707351785 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7fa234066510 0x7fa2340689c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:08.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:08.800+0000 7fa25359e640 1 --2- 172.21.15.5:0/2707351785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2540c8db0 0x7fa2540c23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:08.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:08.800+0000 7fa25359e640 1 --2- 172.21.15.5:0/2707351785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2540af8b0 0x7fa25414ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:08.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:08.800+0000 7fa25359e640 1 -- 172.21.15.5:0/2707351785 >> 172.21.15.5:0/2707351785 conn(0x7fa2540ca8b0 msgr2=0x7fa25415a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:08.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:08.800+0000 7fa25359e640 1 -- 172.21.15.5:0/2707351785 shutdown_connections 2023-07-14T13:11:08.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:08.800+0000 7fa25359e640 1 -- 172.21.15.5:0/2707351785 wait complete. 2023-07-14T13:11:08.861 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T13:11:08.862 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:11:08.933 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:11:08.985 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T13:11:08.986 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:11:08.986 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:11:09.003 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:11:09.004 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:11:09.013 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:08.980+0000 7f8ae9be6180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:11:09.016 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:08.980+0000 7f142a42c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:11:09.030 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:11:09.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.192+0000 7f016d340640 1 Processor -- start 2023-07-14T13:11:09.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.192+0000 7f016d340640 1 -- start start 2023-07-14T13:11:09.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.192+0000 7f016d340640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0168070b70 0x7f0168070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:09.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.192+0000 7f016d340640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01680cb100 0x7f01680cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:09.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.192+0000 7f016d340640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01680cac70 con 0x7f016806b1e0 2023-07-14T13:11:09.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.192+0000 7f016d340640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01680cbaa0 con 0x7f0168070b70 2023-07-14T13:11:09.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.192+0000 7f016d340640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0168071480 con 0x7f01680cb100 2023-07-14T13:11:09.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.192+0000 7f0166ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0168070b70 0x7f0168070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:09.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.192+0000 7f01677fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01680cb100 0x7f01680cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:09.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.192+0000 7f01677fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01680cb100 0x7f01680cb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:57138/0 (socket says 172.21.15.5:57138) 2023-07-14T13:11:09.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.192+0000 7f0166ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0168070b70 0x7f0168070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:43680/0 (socket says 172.21.15.5:43680) 2023-07-14T13:11:09.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.192+0000 7f01677fe640 1 -- 172.21.15.5:0/690614226 learned_addr learned my addr 172.21.15.5:0/690614226 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:09.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.192+0000 7f015e7fc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f016806b1e0 0x7f01680c1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:57890/0 (socket says 172.21.15.5:57890) 2023-07-14T13:11:09.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.192+0000 7f01677fe640 1 -- 172.21.15.5:0/690614226 >> v2:172.21.15.154:3300/0 conn(0x7f0168070b70 msgr2=0x7f0168070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:09.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.192+0000 7f01677fe640 1 --2- 172.21.15.5:0/690614226 >> v2:172.21.15.154:3300/0 conn(0x7f0168070b70 0x7f0168070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:09.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.192+0000 7f01677fe640 1 -- 172.21.15.5:0/690614226 >> v1:172.21.15.154:6789/0 conn(0x7f016806b1e0 legacy=0x7f01680c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:09.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.192+0000 7f01677fe640 1 -- 172.21.15.5:0/690614226 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01680ca060 con 0x7f01680cb100 2023-07-14T13:11:09.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.192+0000 7f01667fc640 1 -- 172.21.15.5:0/690614226 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2813377537 0 0) 0x7f01680cac70 con 0x7f016806b1e0 2023-07-14T13:11:09.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.192+0000 7f0166ffd640 1 --2- 172.21.15.5:0/690614226 >> v2:172.21.15.154:3300/0 conn(0x7f0168070b70 0x7f0168070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:11:09.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.196+0000 7f01677fe640 1 --2- 172.21.15.5:0/690614226 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01680cb100 0x7f01680cb560 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0160009870 tx=0x7f016001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97555442e8cb0b24 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:09.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.196+0000 7f01667fc640 1 -- 172.21.15.5:0/690614226 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01600aa670 con 0x7f01680cb100 2023-07-14T13:11:09.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.196+0000 7f01667fc640 1 -- 172.21.15.5:0/690614226 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01600aa7d0 con 0x7f01680cb100 2023-07-14T13:11:09.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.196+0000 7f01667fc640 1 -- 172.21.15.5:0/690614226 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01600aab60 con 0x7f01680cb100 2023-07-14T13:11:09.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.196+0000 7f016d340640 1 -- 172.21.15.5:0/690614226 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01680cb100 msgr2=0x7f01680cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:09.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.196+0000 7f016d340640 1 --2- 172.21.15.5:0/690614226 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01680cb100 0x7f01680cb560 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0160009870 tx=0x7f016001c510 comp rx=0 tx=0).stop 2023-07-14T13:11:09.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.196+0000 7f016d340640 1 -- 172.21.15.5:0/690614226 shutdown_connections 2023-07-14T13:11:09.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.196+0000 7f016d340640 1 --2- 172.21.15.5:0/690614226 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01680cb100 0x7f01680cb560 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:09.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.196+0000 7f016d340640 1 --2- 172.21.15.5:0/690614226 >> v2:172.21.15.154:3300/0 conn(0x7f0168070b70 0x7f0168070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:09.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.196+0000 7f016d340640 1 -- 172.21.15.5:0/690614226 >> 172.21.15.5:0/690614226 conn(0x7f01680afcf0 msgr2=0x7f01680b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:09.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.196+0000 7f016d340640 1 -- 172.21.15.5:0/690614226 shutdown_connections 2023-07-14T13:11:09.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.196+0000 7f016d340640 1 -- 172.21.15.5:0/690614226 wait complete. 2023-07-14T13:11:09.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.200+0000 7f016d340640 1 Processor -- start 2023-07-14T13:11:09.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.200+0000 7f016d340640 1 -- start start 2023-07-14T13:11:09.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.200+0000 7f016d340640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f016806b1e0 0x7f01681f3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:09.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.200+0000 7f016d340640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0168070b70 0x7f01681f68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:09.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.200+0000 7f016d340640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01680cb100 0x7f01680a9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:09.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.200+0000 7f016d340640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0168158ed0 con 0x7f0168070b70 2023-07-14T13:11:09.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.200+0000 7f016d340640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01680a7530 con 0x7f01680cb100 2023-07-14T13:11:09.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.200+0000 7f016d340640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01680a7810 con 0x7f016806b1e0 2023-07-14T13:11:09.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.200+0000 7f015e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0168070b70 0x7f01681f68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:09.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.200+0000 7f015e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0168070b70 0x7f01681f68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35540/0 (socket says 172.21.15.5:35540) 2023-07-14T13:11:09.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.200+0000 7f015e7fc640 1 -- 172.21.15.5:0/2610420057 learned_addr learned my addr 172.21.15.5:0/2610420057 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:09.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.200+0000 7f0166ffd640 1 --2- 172.21.15.5:0/2610420057 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f016806b1e0 0x7f01681f3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:09.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.200+0000 7f01677fe640 1 --2- 172.21.15.5:0/2610420057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01680cb100 0x7f01680a9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:09.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.200+0000 7f015e7fc640 1 -- 172.21.15.5:0/2610420057 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f016806b1e0 msgr2=0x7f01681f3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:09.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.200+0000 7f015e7fc640 1 --2- 172.21.15.5:0/2610420057 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f016806b1e0 0x7f01681f3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:09.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.200+0000 7f015e7fc640 1 -- 172.21.15.5:0/2610420057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01680cb100 msgr2=0x7f01680a9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:09.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.200+0000 7f015e7fc640 1 --2- 172.21.15.5:0/2610420057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01680cb100 0x7f01680a9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:09.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.200+0000 7f015e7fc640 1 -- 172.21.15.5:0/2610420057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0158009420 con 0x7f0168070b70 2023-07-14T13:11:09.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.200+0000 7f015e7fc640 1 --2- 172.21.15.5:0/2610420057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0168070b70 0x7f01681f68a0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f015000c7c0 tx=0x7f015000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:09.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.200+0000 7f015ffff640 1 -- 172.21.15.5:0/2610420057 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015000a640 con 0x7f0168070b70 2023-07-14T13:11:09.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.200+0000 7f015ffff640 1 -- 172.21.15.5:0/2610420057 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015000a7c0 con 0x7f0168070b70 2023-07-14T13:11:09.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.200+0000 7f016d340640 1 -- 172.21.15.5:0/2610420057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01600094d0 con 0x7f0168070b70 2023-07-14T13:11:09.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.200+0000 7f015ffff640 1 -- 172.21.15.5:0/2610420057 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015000ab70 con 0x7f0168070b70 2023-07-14T13:11:09.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.200+0000 7f016d340640 1 -- 172.21.15.5:0/2610420057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01680a7dd0 con 0x7f0168070b70 2023-07-14T13:11:09.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.204+0000 7f016d340640 1 -- 172.21.15.5:0/2610420057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01680678d0 con 0x7f0168070b70 2023-07-14T13:11:09.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.204+0000 7f015ffff640 1 -- 172.21.15.5:0/2610420057 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 50) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f015000acd0 con 0x7f0168070b70 2023-07-14T13:11:09.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.204+0000 7f015ffff640 1 --2- 172.21.15.5:0/2610420057 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f01480664c0 0x7f0148068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:09.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.204+0000 7f015ffff640 1 -- 172.21.15.5:0/2610420057 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f0150083bb0 con 0x7f0168070b70 2023-07-14T13:11:09.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.204+0000 7f0166ffd640 1 -- 172.21.15.5:0/2610420057 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f01480664c0 msgr2=0x7f0148068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1467987432 2023-07-14T13:11:09.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.204+0000 7f0166ffd640 1 --2- 172.21.15.5:0/2610420057 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f01480664c0 0x7f0148068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:11:09.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.208+0000 7f015ffff640 1 -- 172.21.15.5:0/2610420057 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f0150050b10 con 0x7f0168070b70 2023-07-14T13:11:09.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.364+0000 7f016d340640 1 -- 172.21.15.5:0/2610420057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01680c98c0 con 0x7f0168070b70 2023-07-14T13:11:09.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.368+0000 7f015ffff640 1 -- 172.21.15.5:0/2610420057 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+18959 (secure 0 0 0) 0x7f0150018090 con 0x7f0168070b70 2023-07-14T13:11:09.403 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:11:09.404 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":114,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:11:06.774022+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:09:45.916338+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-14T13:09:47.159234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.18","mappings":[{"from":1,"to":7}]},{"pgid":"14.2a","mappings":[{"from":1,"to":2}]},{"pgid":"14.32","mappings":[{"from":1,"to":5}]},{"pgid":"14.36","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/2790592485":"2023-07-15T13:10:05.475092+0000","172.21.15.154:0/3030719967":"2023-07-15T13:10:05.475092+0000","172.21.15.154:0/1189847216":"2023-07-15T13:10:05.475092+0000","172.21.15.154:0/199342422":"2023-07-15T13:10:05.475092+0000","172.21.15.154:6833/1525189184":"2023-07-15T13:10:05.475092+0000","172.21.15.154:6832/1525189184":"2023-07-15T13:10:05.475092+0000","172.21.15.154:0/3609928299":"2023-07-15T13:10:05.475092+0000","172.21.15.154:0/1625180439":"2023-07-15T13:10:05.475092+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:11:09.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.368+0000 7f016d340640 1 -- 172.21.15.5:0/2610420057 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f01480664c0 msgr2=0x7f0148068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:11:09.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.368+0000 7f016d340640 1 --2- 172.21.15.5:0/2610420057 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f01480664c0 0x7f0148068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:09.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.368+0000 7f016d340640 1 -- 172.21.15.5:0/2610420057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0168070b70 msgr2=0x7f01681f68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:09.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.368+0000 7f016d340640 1 --2- 172.21.15.5:0/2610420057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0168070b70 0x7f01681f68a0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f015000c7c0 tx=0x7f015000cc80 comp rx=0 tx=0).stop 2023-07-14T13:11:09.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.368+0000 7f016d340640 1 -- 172.21.15.5:0/2610420057 shutdown_connections 2023-07-14T13:11:09.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.368+0000 7f016d340640 1 --2- 172.21.15.5:0/2610420057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01680cb100 0x7f01680a9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:09.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.368+0000 7f016d340640 1 --2- 172.21.15.5:0/2610420057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0168070b70 0x7f01681f68a0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:09.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.368+0000 7f016d340640 1 --2- 172.21.15.5:0/2610420057 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f01480664c0 0x7f0148068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:09.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.368+0000 7f016d340640 1 --2- 172.21.15.5:0/2610420057 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f016806b1e0 0x7f01681f3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:09.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.368+0000 7f016d340640 1 -- 172.21.15.5:0/2610420057 >> 172.21.15.5:0/2610420057 conn(0x7f01680afcf0 msgr2=0x7f01680c3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:09.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.368+0000 7f016d340640 1 -- 172.21.15.5:0/2610420057 shutdown_connections 2023-07-14T13:11:09.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.368+0000 7f016d340640 1 -- 172.21.15.5:0/2610420057 wait complete. 2023-07-14T13:11:09.426 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T13:09:45.916338+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T13:09:47.159234+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:11:09.427 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:11:09.429 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:09.396+0000 7f8ae9be6180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:11:09.466 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:09.432+0000 7f142a42c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:11:09.578 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:09.544+0000 7f8ae9be6180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:11:09.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.544+0000 7f39d32d8640 1 Processor -- start 2023-07-14T13:11:09.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.544+0000 7f39d32d8640 1 -- start start 2023-07-14T13:11:09.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.548+0000 7f39d32d8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f39cc0d2fc0 0x7f39cc0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:09.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.548+0000 7f39d32d8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39cc0b04c0 con 0x7f39cc15bde0 2023-07-14T13:11:09.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.548+0000 7f39d32d8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39cc0d0aa0 con 0x7f39cc0d2300 2023-07-14T13:11:09.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.548+0000 7f39d32d8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39cc15c1b0 con 0x7f39cc0d2fc0 2023-07-14T13:11:09.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.548+0000 7f39d0873640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f39cc0d2fc0 0x7f39cc0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:09.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.548+0000 7f39d1074640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f39cc15bde0 0x7f39cc0d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43792/0 (socket says 172.21.15.5:43792) 2023-07-14T13:11:09.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.548+0000 7f39d1074640 1 -- 172.21.15.5:0/2272383583 learned_addr learned my addr 172.21.15.5:0/2272383583 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:09.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.548+0000 7f39c3fff640 1 -- 172.21.15.5:0/2272383583 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185477968 0 0) 0x7f39cc0b04c0 con 0x7f39cc15bde0 2023-07-14T13:11:09.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.548+0000 7f39c3fff640 1 -- 172.21.15.5:0/2272383583 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39b8003530 con 0x7f39cc15bde0 2023-07-14T13:11:09.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.548+0000 7f39d0873640 1 -- 172.21.15.5:0/2272383583 >> v1:172.21.15.154:6789/0 conn(0x7f39cc0d2300 legacy=0x7f39cc0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:09.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.548+0000 7f39d0873640 1 -- 172.21.15.5:0/2272383583 >> v1:172.21.15.5:6789/0 conn(0x7f39cc15bde0 legacy=0x7f39cc0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:09.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.548+0000 7f39d0873640 1 -- 172.21.15.5:0/2272383583 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39cc0afb90 con 0x7f39cc0d2fc0 2023-07-14T13:11:09.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.548+0000 7f39d0873640 1 --2- 172.21.15.5:0/2272383583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39cc0d2fc0 0x7f39cc0b0950 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0097c0 tx=0x7f39bc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354754e7e711fd03 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:09.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.552+0000 7f39c3fff640 1 -- 172.21.15.5:0/2272383583 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc0ab680 con 0x7f39cc0d2fc0 2023-07-14T13:11:09.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.552+0000 7f39c3fff640 1 -- 172.21.15.5:0/2272383583 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39bc0ab7e0 con 0x7f39cc0d2fc0 2023-07-14T13:11:09.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.552+0000 7f39c3fff640 1 -- 172.21.15.5:0/2272383583 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc0abb70 con 0x7f39cc0d2fc0 2023-07-14T13:11:09.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.552+0000 7f39d32d8640 1 -- 172.21.15.5:0/2272383583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39cc0d2fc0 msgr2=0x7f39cc0b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:09.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.552+0000 7f39d32d8640 1 --2- 172.21.15.5:0/2272383583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39cc0d2fc0 0x7f39cc0b0950 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0097c0 tx=0x7f39bc01c480 comp rx=0 tx=0).stop 2023-07-14T13:11:09.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.552+0000 7f39d32d8640 1 -- 172.21.15.5:0/2272383583 shutdown_connections 2023-07-14T13:11:09.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.552+0000 7f39d32d8640 1 --2- 172.21.15.5:0/2272383583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39cc0d2fc0 0x7f39cc0b0950 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:09.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.552+0000 7f39d32d8640 1 -- 172.21.15.5:0/2272383583 >> 172.21.15.5:0/2272383583 conn(0x7f39cc0659d0 msgr2=0x7f39cc09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:09.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.552+0000 7f39d32d8640 1 -- 172.21.15.5:0/2272383583 shutdown_connections 2023-07-14T13:11:09.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.552+0000 7f39d32d8640 1 -- 172.21.15.5:0/2272383583 wait complete. 2023-07-14T13:11:09.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.552+0000 7f39d32d8640 1 Processor -- start 2023-07-14T13:11:09.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.552+0000 7f39d32d8640 1 -- start start 2023-07-14T13:11:09.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.552+0000 7f39d32d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39cc0d2300 0x7f39cc0cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:09.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.552+0000 7f39d32d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39cc0d2fc0 0x7f39cc0cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:09.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.552+0000 7f39d32d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39cc15bde0 0x7f39cc0c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:09.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.552+0000 7f39d32d8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc0c6f00 con 0x7f39cc0d2300 2023-07-14T13:11:09.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.552+0000 7f39d32d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc1506d0 con 0x7f39cc0d2fc0 2023-07-14T13:11:09.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.552+0000 7f39d32d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc0cb2b0 con 0x7f39cc15bde0 2023-07-14T13:11:09.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.556+0000 7f39d1074640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39cc0d2300 0x7f39cc0cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:09.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.556+0000 7f39d1074640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39cc0d2300 0x7f39cc0cbd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35552/0 (socket says 172.21.15.5:35552) 2023-07-14T13:11:09.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.556+0000 7f39d1074640 1 -- 172.21.15.5:0/3972387547 learned_addr learned my addr 172.21.15.5:0/3972387547 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:09.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.556+0000 7f39d0873640 1 --2- 172.21.15.5:0/3972387547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39cc0d2fc0 0x7f39cc0cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:09.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.556+0000 7f39d1875640 1 --2- 172.21.15.5:0/3972387547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39cc15bde0 0x7f39cc0c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:09.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.556+0000 7f39d1074640 1 -- 172.21.15.5:0/3972387547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39cc15bde0 msgr2=0x7f39cc0c7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:09.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.556+0000 7f39d1074640 1 --2- 172.21.15.5:0/3972387547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39cc15bde0 0x7f39cc0c7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:09.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.556+0000 7f39d1074640 1 -- 172.21.15.5:0/3972387547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39cc0d2fc0 msgr2=0x7f39cc0cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:09.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.556+0000 7f39d1074640 1 --2- 172.21.15.5:0/3972387547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39cc0d2fc0 0x7f39cc0cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:09.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.556+0000 7f39d1074640 1 -- 172.21.15.5:0/3972387547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39bc009420 con 0x7f39cc0d2300 2023-07-14T13:11:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.556+0000 7f39d1875640 1 --2- 172.21.15.5:0/3972387547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39cc15bde0 0x7f39cc0c7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:11:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.556+0000 7f39d1074640 1 --2- 172.21.15.5:0/3972387547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39cc0d2300 0x7f39cc0cbd60 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f39c8001270 tx=0x7f39c800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.556+0000 7f39c1ffb640 1 -- 172.21.15.5:0/3972387547 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c8007270 con 0x7f39cc0d2300 2023-07-14T13:11:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.556+0000 7f39c1ffb640 1 -- 172.21.15.5:0/3972387547 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c80073d0 con 0x7f39cc0d2300 2023-07-14T13:11:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.556+0000 7f39c1ffb640 1 -- 172.21.15.5:0/3972387547 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c800ce50 con 0x7f39cc0d2300 2023-07-14T13:11:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.556+0000 7f39d32d8640 1 -- 172.21.15.5:0/3972387547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39cc0cb590 con 0x7f39cc0d2300 2023-07-14T13:11:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.556+0000 7f39d32d8640 1 -- 172.21.15.5:0/3972387547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39cc0c6b90 con 0x7f39cc0d2300 2023-07-14T13:11:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.556+0000 7f39d32d8640 1 -- 172.21.15.5:0/3972387547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39cc0678d0 con 0x7f39cc0d2300 2023-07-14T13:11:09.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.556+0000 7f39c1ffb640 1 -- 172.21.15.5:0/3972387547 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 50) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f39c80057b0 con 0x7f39cc0d2300 2023-07-14T13:11:09.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.560+0000 7f39c1ffb640 1 --2- 172.21.15.5:0/3972387547 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f39b00664c0 0x7f39b0068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:09.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.560+0000 7f39c1ffb640 1 -- 172.21.15.5:0/3972387547 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f39c8083960 con 0x7f39cc0d2300 2023-07-14T13:11:09.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.560+0000 7f39d0873640 1 -- 172.21.15.5:0/3972387547 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f39b00664c0 msgr2=0x7f39b0068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1467987432 2023-07-14T13:11:09.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.560+0000 7f39d0873640 1 --2- 172.21.15.5:0/3972387547 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f39b00664c0 0x7f39b0068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:11:09.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.560+0000 7f39c1ffb640 1 -- 172.21.15.5:0/3972387547 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f39c8054350 con 0x7f39cc0d2300 2023-07-14T13:11:09.629 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:09.592+0000 7f142a42c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:11:09.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.716+0000 7f39d32d8640 1 -- 172.21.15.5:0/3972387547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f39cc0b5ce0 con 0x7f39cc0d2300 2023-07-14T13:11:09.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.716+0000 7f39c1ffb640 1 -- 172.21.15.5:0/3972387547 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v114) v1 ==== 93+0+10 (secure 0 0 0) 0x7f39c80170a0 con 0x7f39cc0d2300 2023-07-14T13:11:09.753 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:11:09.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.720+0000 7f39d32d8640 1 -- 172.21.15.5:0/3972387547 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f39b00664c0 msgr2=0x7f39b0068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:11:09.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.720+0000 7f39d32d8640 1 --2- 172.21.15.5:0/3972387547 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f39b00664c0 0x7f39b0068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:09.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.720+0000 7f39d32d8640 1 -- 172.21.15.5:0/3972387547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39cc0d2300 msgr2=0x7f39cc0cbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:09.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.720+0000 7f39d32d8640 1 --2- 172.21.15.5:0/3972387547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39cc0d2300 0x7f39cc0cbd60 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f39c8001270 tx=0x7f39c800cb10 comp rx=0 tx=0).stop 2023-07-14T13:11:09.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.720+0000 7f39d32d8640 1 -- 172.21.15.5:0/3972387547 shutdown_connections 2023-07-14T13:11:09.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.720+0000 7f39d32d8640 1 --2- 172.21.15.5:0/3972387547 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f39b00664c0 0x7f39b0068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:09.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.720+0000 7f39d32d8640 1 --2- 172.21.15.5:0/3972387547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39cc15bde0 0x7f39cc0c7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:09.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.720+0000 7f39d32d8640 1 --2- 172.21.15.5:0/3972387547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39cc0d2fc0 0x7f39cc0cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:09.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.720+0000 7f39d32d8640 1 --2- 172.21.15.5:0/3972387547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39cc0d2300 0x7f39cc0cbd60 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:09.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.720+0000 7f39d32d8640 1 -- 172.21.15.5:0/3972387547 >> 172.21.15.5:0/3972387547 conn(0x7f39cc0659d0 msgr2=0x7f39cc0b46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:09.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.720+0000 7f39d32d8640 1 -- 172.21.15.5:0/3972387547 shutdown_connections 2023-07-14T13:11:09.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.720+0000 7f39d32d8640 1 -- 172.21.15.5:0/3972387547 wait complete. 2023-07-14T13:11:09.775 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:11:09.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.932+0000 7f1067d9d640 1 Processor -- start 2023-07-14T13:11:09.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.932+0000 7f1067d9d640 1 -- start start 2023-07-14T13:11:09.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.932+0000 7f1067d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f106015bde0 0x7f10600d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:09.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.936+0000 7f1067d9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10600d2fc0 0x7f10600b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:09.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.936+0000 7f1067d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f10600d2300 0x7f10600d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:09.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.936+0000 7f1067d9d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10600d2ce0 con 0x7f106015bde0 2023-07-14T13:11:09.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.936+0000 7f1067d9d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f106015c1b0 con 0x7f10600d2300 2023-07-14T13:11:09.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.936+0000 7f1067d9d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10600b04c0 con 0x7f10600d2fc0 2023-07-14T13:11:09.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.936+0000 7f1065b39640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f106015bde0 0x7f10600d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:09.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.936+0000 7f1065b39640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f106015bde0 0x7f10600d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35564/0 (socket says 172.21.15.5:35564) 2023-07-14T13:11:09.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.936+0000 7f1065b39640 1 -- 172.21.15.5:0/2247261483 learned_addr learned my addr 172.21.15.5:0/2247261483 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:09.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.936+0000 7f1065338640 1 --2- 172.21.15.5:0/2247261483 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10600d2fc0 0x7f10600b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:09.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.936+0000 7f106633a640 1 --2- 172.21.15.5:0/2247261483 >> v2:172.21.15.154:3300/0 conn(0x7f10600d2300 0x7f10600d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:09.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.936+0000 7f1065b39640 1 -- 172.21.15.5:0/2247261483 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10600d2fc0 msgr2=0x7f10600b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:09.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.936+0000 7f1065b39640 1 --2- 172.21.15.5:0/2247261483 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10600d2fc0 0x7f10600b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:09.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.936+0000 7f1065b39640 1 -- 172.21.15.5:0/2247261483 >> v2:172.21.15.154:3300/0 conn(0x7f10600d2300 msgr2=0x7f10600d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:09.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.936+0000 7f1065b39640 1 --2- 172.21.15.5:0/2247261483 >> v2:172.21.15.154:3300/0 conn(0x7f10600d2300 0x7f10600d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:09.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.936+0000 7f1065b39640 1 -- 172.21.15.5:0/2247261483 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10600d0aa0 con 0x7f106015bde0 2023-07-14T13:11:09.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.936+0000 7f1065b39640 1 --2- 172.21.15.5:0/2247261483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f106015bde0 0x7f10600d0270 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f10600b83f0 tx=0x7f105c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64fd6040d98083fa server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:09.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.936+0000 7f1064b37640 1 -- 172.21.15.5:0/2247261483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c0aa620 con 0x7f106015bde0 2023-07-14T13:11:09.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.936+0000 7f1064b37640 1 -- 172.21.15.5:0/2247261483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105c0aa780 con 0x7f106015bde0 2023-07-14T13:11:09.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.936+0000 7f1064b37640 1 -- 172.21.15.5:0/2247261483 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c0aab10 con 0x7f106015bde0 2023-07-14T13:11:09.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.940+0000 7f1067d9d640 1 -- 172.21.15.5:0/2247261483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f106015bde0 msgr2=0x7f10600d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:09.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.940+0000 7f1067d9d640 1 --2- 172.21.15.5:0/2247261483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f106015bde0 0x7f10600d0270 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f10600b83f0 tx=0x7f105c01c500 comp rx=0 tx=0).stop 2023-07-14T13:11:09.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.940+0000 7f1067d9d640 1 -- 172.21.15.5:0/2247261483 shutdown_connections 2023-07-14T13:11:09.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.940+0000 7f1067d9d640 1 --2- 172.21.15.5:0/2247261483 >> v2:172.21.15.154:3300/0 conn(0x7f10600d2300 0x7f10600d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:09.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.940+0000 7f1067d9d640 1 --2- 172.21.15.5:0/2247261483 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10600d2fc0 0x7f10600b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:09.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.940+0000 7f1067d9d640 1 --2- 172.21.15.5:0/2247261483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f106015bde0 0x7f10600d0270 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:09.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.940+0000 7f1067d9d640 1 -- 172.21.15.5:0/2247261483 >> 172.21.15.5:0/2247261483 conn(0x7f10600659d0 msgr2=0x7f106009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:09.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.940+0000 7f1067d9d640 1 -- 172.21.15.5:0/2247261483 shutdown_connections 2023-07-14T13:11:09.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.940+0000 7f1067d9d640 1 -- 172.21.15.5:0/2247261483 wait complete. 2023-07-14T13:11:09.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.940+0000 7f1067d9d640 1 Processor -- start 2023-07-14T13:11:09.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.940+0000 7f1067d9d640 1 -- start start 2023-07-14T13:11:09.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.940+0000 7f1067d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10600d2300 0x7f10600c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:09.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.940+0000 7f1067d9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10600d2fc0 0x7f106014fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:09.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.940+0000 7f1067d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f106015bde0 0x7f10600cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:09.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.940+0000 7f1067d9d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10600c8f30 con 0x7f106015bde0 2023-07-14T13:11:09.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.940+0000 7f1067d9d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10601516c0 con 0x7f10600d2300 2023-07-14T13:11:09.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.940+0000 7f1067d9d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1060150ab0 con 0x7f10600d2fc0 2023-07-14T13:11:09.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.944+0000 7f1065b39640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10600d2300 0x7f10600c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:09.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.944+0000 7f106633a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f106015bde0 0x7f10600cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:09.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.944+0000 7f1065b39640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10600d2300 0x7f10600c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:43720/0 (socket says 172.21.15.5:43720) 2023-07-14T13:11:09.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.944+0000 7f1065b39640 1 -- 172.21.15.5:0/2878119164 learned_addr learned my addr 172.21.15.5:0/2878119164 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:09.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.944+0000 7f1065338640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10600d2fc0 0x7f106014fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:09.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.944+0000 7f1065b39640 1 -- 172.21.15.5:0/2878119164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10600d2fc0 msgr2=0x7f106014fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:09.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.944+0000 7f1065b39640 1 --2- 172.21.15.5:0/2878119164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10600d2fc0 0x7f106014fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:09.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.944+0000 7f1065b39640 1 -- 172.21.15.5:0/2878119164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f106015bde0 msgr2=0x7f10600cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:09.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.944+0000 7f1065b39640 1 --2- 172.21.15.5:0/2878119164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f106015bde0 0x7f10600cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:09.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.944+0000 7f1065b39640 1 -- 172.21.15.5:0/2878119164 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c009480 con 0x7f10600d2300 2023-07-14T13:11:09.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.944+0000 7f1065b39640 1 --2- 172.21.15.5:0/2878119164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10600d2300 0x7f10600c89f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f105c01abb0 tx=0x7f105c0192a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:09.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.944+0000 7f10567fc640 1 -- 172.21.15.5:0/2878119164 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c004440 con 0x7f10600d2300 2023-07-14T13:11:09.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.944+0000 7f10567fc640 1 -- 172.21.15.5:0/2878119164 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105c0059a0 con 0x7f10600d2300 2023-07-14T13:11:09.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.944+0000 7f10567fc640 1 -- 172.21.15.5:0/2878119164 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c005d50 con 0x7f10600d2300 2023-07-14T13:11:09.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.944+0000 7f1067d9d640 1 -- 172.21.15.5:0/2878119164 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1060150d90 con 0x7f10600d2300 2023-07-14T13:11:09.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.944+0000 7f1067d9d640 1 -- 172.21.15.5:0/2878119164 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1060151350 con 0x7f10600d2300 2023-07-14T13:11:09.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.944+0000 7f1067d9d640 1 -- 172.21.15.5:0/2878119164 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10600678d0 con 0x7f10600d2300 2023-07-14T13:11:09.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.944+0000 7f10567fc640 1 -- 172.21.15.5:0/2878119164 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 50) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f105c0aa8f0 con 0x7f10600d2300 2023-07-14T13:11:09.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.944+0000 7f10567fc640 1 --2- 172.21.15.5:0/2878119164 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f10440664c0 0x7f1044068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:09.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.948+0000 7f10567fc640 1 -- 172.21.15.5:0/2878119164 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f105c11ea80 con 0x7f10600d2300 2023-07-14T13:11:09.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.948+0000 7f1065338640 1 -- 172.21.15.5:0/2878119164 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f10440664c0 msgr2=0x7f1044068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1467987432 2023-07-14T13:11:09.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.948+0000 7f1065338640 1 --2- 172.21.15.5:0/2878119164 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f10440664c0 0x7f1044068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:11:09.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:09.952+0000 7f10567fc640 1 -- 172.21.15.5:0/2878119164 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f105c0eb960 con 0x7f10600d2300 2023-07-14T13:11:10.063 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:10.032+0000 7f8ae9be6180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:11:10.121 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:10.088+0000 7f8ae9be6180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:11:10.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.108+0000 7f1067d9d640 1 -- 172.21.15.5:0/2878119164 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f106015f550 con 0x7f10600d2300 2023-07-14T13:11:10.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.108+0000 7f10567fc640 1 -- 172.21.15.5:0/2878119164 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v114) v1 ==== 92+0+10 (secure 0 0 0) 0x7f105c0c10a0 con 0x7f10600d2300 2023-07-14T13:11:10.143 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:11:10.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.108+0000 7f1067d9d640 1 -- 172.21.15.5:0/2878119164 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f10440664c0 msgr2=0x7f1044068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:11:10.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.108+0000 7f1067d9d640 1 --2- 172.21.15.5:0/2878119164 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f10440664c0 0x7f1044068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:10.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.108+0000 7f1067d9d640 1 -- 172.21.15.5:0/2878119164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10600d2300 msgr2=0x7f10600c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:10.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.108+0000 7f1067d9d640 1 --2- 172.21.15.5:0/2878119164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10600d2300 0x7f10600c89f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f105c01abb0 tx=0x7f105c0192a0 comp rx=0 tx=0).stop 2023-07-14T13:11:10.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.108+0000 7f1067d9d640 1 -- 172.21.15.5:0/2878119164 shutdown_connections 2023-07-14T13:11:10.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.108+0000 7f1067d9d640 1 --2- 172.21.15.5:0/2878119164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f106015bde0 0x7f10600cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:10.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.108+0000 7f1067d9d640 1 --2- 172.21.15.5:0/2878119164 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f10440664c0 0x7f1044068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:10.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.108+0000 7f1067d9d640 1 --2- 172.21.15.5:0/2878119164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10600d2fc0 0x7f106014fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:10.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.108+0000 7f1067d9d640 1 --2- 172.21.15.5:0/2878119164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10600d2300 0x7f10600c89f0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:10.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.108+0000 7f1067d9d640 1 -- 172.21.15.5:0/2878119164 >> 172.21.15.5:0/2878119164 conn(0x7f10600659d0 msgr2=0x7f10600ce530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:10.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.108+0000 7f1067d9d640 1 -- 172.21.15.5:0/2878119164 shutdown_connections 2023-07-14T13:11:10.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.108+0000 7f1067d9d640 1 -- 172.21.15.5:0/2878119164 wait complete. 2023-07-14T13:11:10.147 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:10.112+0000 7f142a42c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:11:10.166 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T13:11:10.177 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:10.144+0000 7f8ae9be6180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:11:10.211 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:10.176+0000 7f142a42c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:11:10.262 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:10.232+0000 7f8ae9be6180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:11:10.271 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:10.236+0000 7f142a42c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:11:10.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.284+0000 7fb745d74640 1 Processor -- start 2023-07-14T13:11:10.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.284+0000 7fb745d74640 1 -- start start 2023-07-14T13:11:10.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.284+0000 7fb745d74640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb74015bde0 0x7fb7400d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:10.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.284+0000 7fb745d74640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb7400d2fc0 0x7fb7400b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:10.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.284+0000 7fb745d74640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7400b04c0 con 0x7fb7400d2300 2023-07-14T13:11:10.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.284+0000 7fb745d74640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb74015c1b0 con 0x7fb7400d2fc0 2023-07-14T13:11:10.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.284+0000 7fb745d74640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7400d0aa0 con 0x7fb74015bde0 2023-07-14T13:11:10.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.284+0000 7fb73effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb7400d2fc0 0x7fb7400b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:10.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.284+0000 7fb73ffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb7400d2300 0x7fb7400cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43802/0 (socket says 172.21.15.5:43802) 2023-07-14T13:11:10.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.284+0000 7fb73ffff640 1 -- 172.21.15.5:0/3657471873 learned_addr learned my addr 172.21.15.5:0/3657471873 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:10.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.284+0000 7fb73f7fe640 1 --2- 172.21.15.5:0/3657471873 >> v2:172.21.15.154:3300/0 conn(0x7fb74015bde0 0x7fb7400d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:10.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.284+0000 7fb73effd640 1 -- 172.21.15.5:0/3657471873 >> v2:172.21.15.154:3300/0 conn(0x7fb74015bde0 msgr2=0x7fb7400d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:10.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.284+0000 7fb73effd640 1 --2- 172.21.15.5:0/3657471873 >> v2:172.21.15.154:3300/0 conn(0x7fb74015bde0 0x7fb7400d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:10.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.284+0000 7fb73effd640 1 -- 172.21.15.5:0/3657471873 >> v1:172.21.15.5:6789/0 conn(0x7fb7400d2300 legacy=0x7fb7400cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:10.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.284+0000 7fb73effd640 1 -- 172.21.15.5:0/3657471873 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7400afb90 con 0x7fb7400d2fc0 2023-07-14T13:11:10.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.284+0000 7fb73f7fe640 1 --2- 172.21.15.5:0/3657471873 >> v2:172.21.15.154:3300/0 conn(0x7fb74015bde0 0x7fb7400d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:11:10.322 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:10.288+0000 7f8ae9be6180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:11:10.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.288+0000 7fb73effd640 1 --2- 172.21.15.5:0/3657471873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7400d2fc0 0x7fb7400b0950 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fb74008b210 tx=0x7fb73401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c246d2a86679f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:10.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.288+0000 7fb73e7fc640 1 -- 172.21.15.5:0/3657471873 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7340ab660 con 0x7fb7400d2fc0 2023-07-14T13:11:10.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.288+0000 7fb73e7fc640 1 -- 172.21.15.5:0/3657471873 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7340ab7c0 con 0x7fb7400d2fc0 2023-07-14T13:11:10.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.288+0000 7fb73e7fc640 1 -- 172.21.15.5:0/3657471873 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7340abb50 con 0x7fb7400d2fc0 2023-07-14T13:11:10.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.288+0000 7fb745d74640 1 -- 172.21.15.5:0/3657471873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7400d2fc0 msgr2=0x7fb7400b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:10.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.288+0000 7fb745d74640 1 --2- 172.21.15.5:0/3657471873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7400d2fc0 0x7fb7400b0950 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fb74008b210 tx=0x7fb73401c460 comp rx=0 tx=0).stop 2023-07-14T13:11:10.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.288+0000 7fb745d74640 1 -- 172.21.15.5:0/3657471873 shutdown_connections 2023-07-14T13:11:10.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.288+0000 7fb745d74640 1 --2- 172.21.15.5:0/3657471873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7400d2fc0 0x7fb7400b0950 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:10.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.288+0000 7fb745d74640 1 --2- 172.21.15.5:0/3657471873 >> v2:172.21.15.154:3300/0 conn(0x7fb74015bde0 0x7fb7400d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:10.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.288+0000 7fb745d74640 1 -- 172.21.15.5:0/3657471873 >> 172.21.15.5:0/3657471873 conn(0x7fb7400659d0 msgr2=0x7fb74009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:10.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.288+0000 7fb745d74640 1 -- 172.21.15.5:0/3657471873 shutdown_connections 2023-07-14T13:11:10.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.288+0000 7fb745d74640 1 -- 172.21.15.5:0/3657471873 wait complete. 2023-07-14T13:11:10.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.292+0000 7fb745d74640 1 Processor -- start 2023-07-14T13:11:10.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.292+0000 7fb745d74640 1 -- start start 2023-07-14T13:11:10.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.292+0000 7fb745d74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7400d2300 0x7fb740151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:10.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.292+0000 7fb745d74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7400d2fc0 0x7fb7400cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:10.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.292+0000 7fb745d74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb74015bde0 0x7fb740158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:10.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.292+0000 7fb745d74640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb740151dc0 con 0x7fb74015bde0 2023-07-14T13:11:10.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.292+0000 7fb745d74640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb740151f90 con 0x7fb7400d2fc0 2023-07-14T13:11:10.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.292+0000 7fb745d74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7400b51a0 con 0x7fb7400d2300 2023-07-14T13:11:10.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.292+0000 7fb73ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb74015bde0 0x7fb740158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:10.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.292+0000 7fb73f7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7400d2300 0x7fb740151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:10.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.292+0000 7fb73effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7400d2fc0 0x7fb7400cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:10.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.292+0000 7fb73ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb74015bde0 0x7fb740158ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35584/0 (socket says 172.21.15.5:35584) 2023-07-14T13:11:10.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.292+0000 7fb73ffff640 1 -- 172.21.15.5:0/1038962720 learned_addr learned my addr 172.21.15.5:0/1038962720 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:10.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.292+0000 7fb73ffff640 1 -- 172.21.15.5:0/1038962720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7400d2300 msgr2=0x7fb740151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:10.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.292+0000 7fb73ffff640 1 --2- 172.21.15.5:0/1038962720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7400d2300 0x7fb740151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:10.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.292+0000 7fb73ffff640 1 -- 172.21.15.5:0/1038962720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7400d2fc0 msgr2=0x7fb7400cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:10.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.292+0000 7fb73ffff640 1 --2- 172.21.15.5:0/1038962720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7400d2fc0 0x7fb7400cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:10.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.292+0000 7fb73ffff640 1 -- 172.21.15.5:0/1038962720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7300093b0 con 0x7fb74015bde0 2023-07-14T13:11:10.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.292+0000 7fb73effd640 1 --2- 172.21.15.5:0/1038962720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7400d2fc0 0x7fb7400cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:11:10.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.292+0000 7fb73ffff640 1 --2- 172.21.15.5:0/1038962720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb74015bde0 0x7fb740158ed0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fb73800cbc0 tx=0x7fb73800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:10.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.292+0000 7fb727fff640 1 -- 172.21.15.5:0/1038962720 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73800ad40 con 0x7fb74015bde0 2023-07-14T13:11:10.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.292+0000 7fb727fff640 1 -- 172.21.15.5:0/1038962720 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb738012400 con 0x7fb74015bde0 2023-07-14T13:11:10.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.292+0000 7fb745d74640 1 -- 172.21.15.5:0/1038962720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb734009420 con 0x7fb74015bde0 2023-07-14T13:11:10.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.292+0000 7fb727fff640 1 -- 172.21.15.5:0/1038962720 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73800aea0 con 0x7fb74015bde0 2023-07-14T13:11:10.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.292+0000 7fb745d74640 1 -- 172.21.15.5:0/1038962720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7400b5760 con 0x7fb74015bde0 2023-07-14T13:11:10.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.296+0000 7fb745d74640 1 -- 172.21.15.5:0/1038962720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7400678d0 con 0x7fb74015bde0 2023-07-14T13:11:10.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.296+0000 7fb727fff640 1 -- 172.21.15.5:0/1038962720 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 50) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fb738007070 con 0x7fb74015bde0 2023-07-14T13:11:10.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.296+0000 7fb727fff640 1 --2- 172.21.15.5:0/1038962720 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7fb72c0664c0 0x7fb72c068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:10.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.296+0000 7fb727fff640 1 -- 172.21.15.5:0/1038962720 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fb738084270 con 0x7fb74015bde0 2023-07-14T13:11:10.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.296+0000 7fb73f7fe640 1 -- 172.21.15.5:0/1038962720 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7fb72c0664c0 msgr2=0x7fb72c068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1467987432 2023-07-14T13:11:10.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.296+0000 7fb73f7fe640 1 --2- 172.21.15.5:0/1038962720 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7fb72c0664c0 0x7fb72c068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:11:10.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.300+0000 7fb727fff640 1 -- 172.21.15.5:0/1038962720 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb7380511d0 con 0x7fb74015bde0 2023-07-14T13:11:10.366 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:10.332+0000 7f142a42c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:11:10.405 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:10.372+0000 7f8ae9be6180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:11:10.427 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:10.392+0000 7f142a42c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:11:10.461 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:10.428+0000 7f8ae9be6180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:11:10.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.456+0000 7fb745d74640 1 -- 172.21.15.5:0/1038962720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb7400b7f90 con 0x7fb74015bde0 2023-07-14T13:11:10.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.456+0000 7fb727fff640 1 -- 172.21.15.5:0/1038962720 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v114) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb7380547f0 con 0x7fb74015bde0 2023-07-14T13:11:10.493 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T13:11:10.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.460+0000 7fb745d74640 1 -- 172.21.15.5:0/1038962720 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7fb72c0664c0 msgr2=0x7fb72c068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:11:10.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.460+0000 7fb745d74640 1 --2- 172.21.15.5:0/1038962720 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7fb72c0664c0 0x7fb72c068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:10.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.460+0000 7fb745d74640 1 -- 172.21.15.5:0/1038962720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb74015bde0 msgr2=0x7fb740158ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:10.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.460+0000 7fb745d74640 1 --2- 172.21.15.5:0/1038962720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb74015bde0 0x7fb740158ed0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fb73800cbc0 tx=0x7fb73800a430 comp rx=0 tx=0).stop 2023-07-14T13:11:10.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.460+0000 7fb745d74640 1 -- 172.21.15.5:0/1038962720 shutdown_connections 2023-07-14T13:11:10.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.460+0000 7fb745d74640 1 --2- 172.21.15.5:0/1038962720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb74015bde0 0x7fb740158ed0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:10.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.460+0000 7fb745d74640 1 --2- 172.21.15.5:0/1038962720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7400d2fc0 0x7fb7400cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:10.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.460+0000 7fb745d74640 1 --2- 172.21.15.5:0/1038962720 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7fb72c0664c0 0x7fb72c068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:10.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.460+0000 7fb745d74640 1 --2- 172.21.15.5:0/1038962720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb7400d2300 0x7fb740151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:10.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.460+0000 7fb745d74640 1 -- 172.21.15.5:0/1038962720 >> 172.21.15.5:0/1038962720 conn(0x7fb7400659d0 msgr2=0x7fb74015aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:10.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.460+0000 7fb745d74640 1 -- 172.21.15.5:0/1038962720 shutdown_connections 2023-07-14T13:11:10.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.460+0000 7fb745d74640 1 -- 172.21.15.5:0/1038962720 wait complete. 2023-07-14T13:11:10.515 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T13:11:10.517 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:10.480+0000 7f142a42c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:11:10.579 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:10.544+0000 7f142a42c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:11:10.605 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:10.572+0000 7f8ae9be6180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:11:10.663 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:10.632+0000 7f8ae9be6180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:11:10.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.632+0000 7f66e75ad640 1 Processor -- start 2023-07-14T13:11:10.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.632+0000 7f66e75ad640 1 -- start start 2023-07-14T13:11:10.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.632+0000 7f66e75ad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66e015bde0 0x7f66e00d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:10.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.632+0000 7f66e75ad640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f66e00d2fc0 0x7f66e00b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:10.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.632+0000 7f66e75ad640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e00b04c0 con 0x7f66e00d2300 2023-07-14T13:11:10.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.632+0000 7f66e75ad640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e015c1b0 con 0x7f66e00d2fc0 2023-07-14T13:11:10.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.632+0000 7f66e75ad640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e00d0aa0 con 0x7f66e015bde0 2023-07-14T13:11:10.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.632+0000 7f66e4b48640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f66e00d2fc0 0x7f66e00b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:10.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.632+0000 7f66e5349640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66e015bde0 0x7f66e00d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:10.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.632+0000 7f66e4b48640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f66e00d2fc0 0x7f66e00b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:43752/0 (socket says 172.21.15.5:43752) 2023-07-14T13:11:10.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.632+0000 7f66e4b48640 1 -- 172.21.15.5:0/2812750803 learned_addr learned my addr 172.21.15.5:0/2812750803 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:10.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.632+0000 7f66e5349640 1 -- 172.21.15.5:0/2812750803 >> v2:172.21.15.154:3300/0 conn(0x7f66e00d2fc0 msgr2=0x7f66e00b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:10.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.632+0000 7f66e5349640 1 --2- 172.21.15.5:0/2812750803 >> v2:172.21.15.154:3300/0 conn(0x7f66e00d2fc0 0x7f66e00b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:10.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.632+0000 7f66e5349640 1 -- 172.21.15.5:0/2812750803 >> v1:172.21.15.154:6789/0 conn(0x7f66e00d2300 legacy=0x7f66e00cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:10.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.632+0000 7f66d7fff640 1 -- 172.21.15.5:0/2812750803 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 873011035 0 0) 0x7f66e00b04c0 con 0x7f66e00d2300 2023-07-14T13:11:10.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.632+0000 7f66e5349640 1 -- 172.21.15.5:0/2812750803 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e00afb90 con 0x7f66e015bde0 2023-07-14T13:11:10.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.632+0000 7f66e4b48640 1 --2- 172.21.15.5:0/2812750803 >> v2:172.21.15.154:3300/0 conn(0x7f66e00d2fc0 0x7f66e00b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:11:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.636+0000 7f66e5349640 1 --2- 172.21.15.5:0/2812750803 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66e015bde0 0x7f66e00d0270 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f66dc0097a0 tx=0x7f66dc01c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5efa91daad12a254 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.636+0000 7f66d7fff640 1 -- 172.21.15.5:0/2812750803 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc0ab660 con 0x7f66e015bde0 2023-07-14T13:11:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.636+0000 7f66d7fff640 1 -- 172.21.15.5:0/2812750803 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66dc0ab7c0 con 0x7f66e015bde0 2023-07-14T13:11:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.636+0000 7f66d7fff640 1 -- 172.21.15.5:0/2812750803 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc0abb50 con 0x7f66e015bde0 2023-07-14T13:11:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.636+0000 7f66e75ad640 1 -- 172.21.15.5:0/2812750803 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66e015bde0 msgr2=0x7f66e00d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.636+0000 7f66e75ad640 1 --2- 172.21.15.5:0/2812750803 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66e015bde0 0x7f66e00d0270 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f66dc0097a0 tx=0x7f66dc01c460 comp rx=0 tx=0).stop 2023-07-14T13:11:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.636+0000 7f66e75ad640 1 -- 172.21.15.5:0/2812750803 shutdown_connections 2023-07-14T13:11:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.636+0000 7f66e75ad640 1 --2- 172.21.15.5:0/2812750803 >> v2:172.21.15.154:3300/0 conn(0x7f66e00d2fc0 0x7f66e00b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:10.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.636+0000 7f66e75ad640 1 --2- 172.21.15.5:0/2812750803 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66e015bde0 0x7f66e00d0270 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:10.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.636+0000 7f66e75ad640 1 -- 172.21.15.5:0/2812750803 >> 172.21.15.5:0/2812750803 conn(0x7f66e00659d0 msgr2=0x7f66e009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:10.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.636+0000 7f66e75ad640 1 -- 172.21.15.5:0/2812750803 shutdown_connections 2023-07-14T13:11:10.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.636+0000 7f66e75ad640 1 -- 172.21.15.5:0/2812750803 wait complete. 2023-07-14T13:11:10.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.640+0000 7f66e75ad640 1 Processor -- start 2023-07-14T13:11:10.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.640+0000 7f66e75ad640 1 -- start start 2023-07-14T13:11:10.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.640+0000 7f66e75ad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66e00d2300 0x7f66e014f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:10.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.640+0000 7f66e75ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66e00d2fc0 0x7f66e00b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:10.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.640+0000 7f66e75ad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66e015bde0 0x7f66e014d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:10.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.640+0000 7f66e75ad640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e014ec70 con 0x7f66e015bde0 2023-07-14T13:11:10.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.640+0000 7f66e75ad640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e014dd90 con 0x7f66e00d2fc0 2023-07-14T13:11:10.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.640+0000 7f66e75ad640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e014e060 con 0x7f66e00d2300 2023-07-14T13:11:10.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.640+0000 7f66e5b4a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66e015bde0 0x7f66e014d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:10.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.640+0000 7f66e4b48640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66e00d2fc0 0x7f66e00b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.640+0000 7f66e5349640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66e00d2300 0x7f66e014f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.640+0000 7f66e4b48640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66e00d2fc0 0x7f66e00b65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:43766/0 (socket says 172.21.15.5:43766) 2023-07-14T13:11:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.640+0000 7f66e4b48640 1 -- 172.21.15.5:0/904248670 learned_addr learned my addr 172.21.15.5:0/904248670 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.640+0000 7f66e4b48640 1 -- 172.21.15.5:0/904248670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66e00d2300 msgr2=0x7f66e014f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.640+0000 7f66e4b48640 1 --2- 172.21.15.5:0/904248670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66e00d2300 0x7f66e014f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.640+0000 7f66e4b48640 1 -- 172.21.15.5:0/904248670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66e015bde0 msgr2=0x7f66e014d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.640+0000 7f66e4b48640 1 --2- 172.21.15.5:0/904248670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66e015bde0 0x7f66e014d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.640+0000 7f66e4b48640 1 -- 172.21.15.5:0/904248670 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d00094d0 con 0x7f66e00d2fc0 2023-07-14T13:11:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.640+0000 7f66e5b4a640 1 --2- 172.21.15.5:0/904248670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66e015bde0 0x7f66e014d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:11:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.640+0000 7f66e4b48640 1 --2- 172.21.15.5:0/904248670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66e00d2fc0 0x7f66e00b65e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f66d000e930 tx=0x7f66d000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.640+0000 7f66d5ffb640 1 -- 172.21.15.5:0/904248670 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d000ca00 con 0x7f66e00d2fc0 2023-07-14T13:11:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.640+0000 7f66d5ffb640 1 -- 172.21.15.5:0/904248670 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d000cb60 con 0x7f66e00d2fc0 2023-07-14T13:11:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.640+0000 7f66d5ffb640 1 -- 172.21.15.5:0/904248670 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d0013470 con 0x7f66e00d2fc0 2023-07-14T13:11:10.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.640+0000 7f66e75ad640 1 -- 172.21.15.5:0/904248670 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66dc0093b0 con 0x7f66e00d2fc0 2023-07-14T13:11:10.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.640+0000 7f66e75ad640 1 -- 172.21.15.5:0/904248670 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e014e620 con 0x7f66e00d2fc0 2023-07-14T13:11:10.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.644+0000 7f66e75ad640 1 -- 172.21.15.5:0/904248670 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e00678d0 con 0x7f66e00d2fc0 2023-07-14T13:11:10.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.644+0000 7f66d5ffb640 1 -- 172.21.15.5:0/904248670 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 50) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f66d00135d0 con 0x7f66e00d2fc0 2023-07-14T13:11:10.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.644+0000 7f66d5ffb640 1 --2- 172.21.15.5:0/904248670 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f66c40664c0 0x7f66c4068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:10.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.644+0000 7f66d5ffb640 1 -- 172.21.15.5:0/904248670 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f66d0084920 con 0x7f66e00d2fc0 2023-07-14T13:11:10.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.644+0000 7f66e5349640 1 -- 172.21.15.5:0/904248670 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f66c40664c0 msgr2=0x7f66c4068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1467987432 2023-07-14T13:11:10.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.644+0000 7f66e5349640 1 --2- 172.21.15.5:0/904248670 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f66c40664c0 0x7f66c4068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:11:10.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.648+0000 7f66d5ffb640 1 -- 172.21.15.5:0/904248670 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f66d0051880 con 0x7f66e00d2fc0 2023-07-14T13:11:10.733 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:10.696+0000 7f142a42c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:11:10.795 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:10.760+0000 7f142a42c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:11:10.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.804+0000 7f66e75ad640 1 -- 172.21.15.5:0/904248670 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f66e0152c40 con 0x7f66e00d2fc0 2023-07-14T13:11:10.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.812+0000 7f66d5ffb640 1 -- 172.21.15.5:0/904248670 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v114) v1 ==== 100+0+11 (secure 0 0 0) 0x7f66d0054ea0 con 0x7f66e00d2fc0 2023-07-14T13:11:10.849 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T13:11:10.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.816+0000 7f66e75ad640 1 -- 172.21.15.5:0/904248670 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f66c40664c0 msgr2=0x7f66c4068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:11:10.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.816+0000 7f66e75ad640 1 --2- 172.21.15.5:0/904248670 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f66c40664c0 0x7f66c4068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:10.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.816+0000 7f66e75ad640 1 -- 172.21.15.5:0/904248670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66e00d2fc0 msgr2=0x7f66e00b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:10.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.816+0000 7f66e75ad640 1 --2- 172.21.15.5:0/904248670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66e00d2fc0 0x7f66e00b65e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f66d000e930 tx=0x7f66d000edf0 comp rx=0 tx=0).stop 2023-07-14T13:11:10.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.816+0000 7f66e75ad640 1 -- 172.21.15.5:0/904248670 shutdown_connections 2023-07-14T13:11:10.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.816+0000 7f66e75ad640 1 --2- 172.21.15.5:0/904248670 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66e015bde0 0x7f66e014d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:10.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.816+0000 7f66e75ad640 1 --2- 172.21.15.5:0/904248670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66e00d2fc0 0x7f66e00b65e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:10.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.816+0000 7f66e75ad640 1 --2- 172.21.15.5:0/904248670 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f66c40664c0 0x7f66c4068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:10.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.816+0000 7f66e75ad640 1 --2- 172.21.15.5:0/904248670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f66e00d2300 0x7f66e014f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:10.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.816+0000 7f66e75ad640 1 -- 172.21.15.5:0/904248670 >> 172.21.15.5:0/904248670 conn(0x7f66e00659d0 msgr2=0x7f66e00cdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:10.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.816+0000 7f66e75ad640 1 -- 172.21.15.5:0/904248670 shutdown_connections 2023-07-14T13:11:10.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:10.816+0000 7f66e75ad640 1 -- 172.21.15.5:0/904248670 wait complete. 2023-07-14T13:11:10.870 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T13:11:10.906 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:11:10.906 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:11:10.906 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:11:10.914 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:10.884+0000 7f8ae9be6180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:11:11.049 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:11.016+0000 7f8ae9be6180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:11:11.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.016+0000 7f7432503640 1 Processor -- start 2023-07-14T13:11:11.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.016+0000 7f7432503640 1 -- start start 2023-07-14T13:11:11.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.016+0000 7f7432503640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f742c15fd60 0x7f742c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:11.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.016+0000 7f7432503640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f742c0ccaf0 con 0x7f742c0d1850 2023-07-14T13:11:11.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.016+0000 7f7432503640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f742c160320 con 0x7f742c0b7c70 2023-07-14T13:11:11.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.016+0000 7f7432503640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742c0d1190 con 0x7f742c15fd60 2023-07-14T13:11:11.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.016+0000 7f7430aa0640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f742c0d1850 0x7f742c0d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43804/0 (socket says 172.21.15.5:43804) 2023-07-14T13:11:11.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.016+0000 7f7430aa0640 1 -- 172.21.15.5:0/1974695674 learned_addr learned my addr 172.21.15.5:0/1974695674 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:11.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.016+0000 7f742b7fe640 1 --2- 172.21.15.5:0/1974695674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f742c15fd60 0x7f742c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:11.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.016+0000 7f742affd640 1 -- 172.21.15.5:0/1974695674 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1954742867 0 0) 0x7f742c160320 con 0x7f742c0b7c70 2023-07-14T13:11:11.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.016+0000 7f742affd640 1 -- 172.21.15.5:0/1974695674 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7414003530 con 0x7f742c0b7c70 2023-07-14T13:11:11.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.016+0000 7f742affd640 1 -- 172.21.15.5:0/1974695674 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 127007424 0 0) 0x7f742c0ccaf0 con 0x7f742c0d1850 2023-07-14T13:11:11.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.016+0000 7f742affd640 1 -- 172.21.15.5:0/1974695674 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f742c160320 con 0x7f742c0d1850 2023-07-14T13:11:11.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.016+0000 7f742b7fe640 1 -- 172.21.15.5:0/1974695674 >> v1:172.21.15.154:6789/0 conn(0x7f742c0b7c70 legacy=0x7f742c15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:11.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.016+0000 7f742b7fe640 1 -- 172.21.15.5:0/1974695674 >> v1:172.21.15.5:6789/0 conn(0x7f742c0d1850 legacy=0x7f742c0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:11.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.016+0000 7f742b7fe640 1 -- 172.21.15.5:0/1974695674 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742c0ccd90 con 0x7f742c15fd60 2023-07-14T13:11:11.055 INFO:tasks.ceph.mgr.y.smithi005.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:11:11.055 INFO:tasks.ceph.mgr.y.smithi005.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:11:11.055 INFO:tasks.ceph.mgr.y.smithi005.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:11:11.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.020+0000 7f742b7fe640 1 --2- 172.21.15.5:0/1974695674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f742c15fd60 0x7f742c0d0c50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f74200097f0 tx=0x7f742001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2791a0f0f574848d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:11.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.020+0000 7f742affd640 1 -- 172.21.15.5:0/1974695674 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74200ac630 con 0x7f742c15fd60 2023-07-14T13:11:11.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.020+0000 7f742affd640 1 -- 172.21.15.5:0/1974695674 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74200ac790 con 0x7f742c15fd60 2023-07-14T13:11:11.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.020+0000 7f742affd640 1 -- 172.21.15.5:0/1974695674 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74200acb00 con 0x7f742c15fd60 2023-07-14T13:11:11.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.020+0000 7f7432503640 1 -- 172.21.15.5:0/1974695674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f742c15fd60 msgr2=0x7f742c0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:11.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.020+0000 7f7432503640 1 --2- 172.21.15.5:0/1974695674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f742c15fd60 0x7f742c0d0c50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f74200097f0 tx=0x7f742001c4c0 comp rx=0 tx=0).stop 2023-07-14T13:11:11.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.024+0000 7f7432503640 1 -- 172.21.15.5:0/1974695674 shutdown_connections 2023-07-14T13:11:11.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.024+0000 7f7432503640 1 --2- 172.21.15.5:0/1974695674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f742c15fd60 0x7f742c0d0c50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:11.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.024+0000 7f7432503640 1 -- 172.21.15.5:0/1974695674 >> 172.21.15.5:0/1974695674 conn(0x7f742c0650b0 msgr2=0x7f742c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:11.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.024+0000 7f7432503640 1 -- 172.21.15.5:0/1974695674 shutdown_connections 2023-07-14T13:11:11.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.024+0000 7f7432503640 1 -- 172.21.15.5:0/1974695674 wait complete. 2023-07-14T13:11:11.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.024+0000 7f7432503640 1 Processor -- start 2023-07-14T13:11:11.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.024+0000 7f7432503640 1 -- start start 2023-07-14T13:11:11.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.028+0000 7f7432503640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f742c0b7c70 0x7f742c0ca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:11.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.028+0000 7f7432503640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f742c0d1850 0x7f742c0ca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:11.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.028+0000 7f7432503640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f742c15fd60 0x7f742c152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:11.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.028+0000 7f7432503640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c15cb00 con 0x7f742c15fd60 2023-07-14T13:11:11.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.028+0000 7f7432503640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c15dcf0 con 0x7f742c0d1850 2023-07-14T13:11:11.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.028+0000 7f7432503640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742c15c1d0 con 0x7f742c0b7c70 2023-07-14T13:11:11.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.028+0000 7f7430aa0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f742c15fd60 0x7f742c152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:11.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.028+0000 7f742b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f742c0d1850 0x7f742c0ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:11.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.028+0000 7f742bfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f742c0b7c70 0x7f742c0ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:11.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.028+0000 7f7430aa0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f742c15fd60 0x7f742c152320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35600/0 (socket says 172.21.15.5:35600) 2023-07-14T13:11:11.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.028+0000 7f7430aa0640 1 -- 172.21.15.5:0/1372390530 learned_addr learned my addr 172.21.15.5:0/1372390530 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:11.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.028+0000 7f7430aa0640 1 -- 172.21.15.5:0/1372390530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f742c0b7c70 msgr2=0x7f742c0ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:11.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.028+0000 7f7430aa0640 1 --2- 172.21.15.5:0/1372390530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f742c0b7c70 0x7f742c0ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:11.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.028+0000 7f7430aa0640 1 -- 172.21.15.5:0/1372390530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f742c0d1850 msgr2=0x7f742c0ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:11.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.028+0000 7f7430aa0640 1 --2- 172.21.15.5:0/1372390530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f742c0d1850 0x7f742c0ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:11.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.028+0000 7f7430aa0640 1 -- 172.21.15.5:0/1372390530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7420009420 con 0x7f742c15fd60 2023-07-14T13:11:11.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.028+0000 7f7430aa0640 1 --2- 172.21.15.5:0/1372390530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f742c15fd60 0x7f742c152320 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f742400caa0 tx=0x7f742400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:11.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.028+0000 7f7428ff9640 1 -- 172.21.15.5:0/1372390530 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742400ac00 con 0x7f742c15fd60 2023-07-14T13:11:11.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.028+0000 7f7428ff9640 1 -- 172.21.15.5:0/1372390530 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742400ad80 con 0x7f742c15fd60 2023-07-14T13:11:11.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.028+0000 7f7432503640 1 -- 172.21.15.5:0/1372390530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f742c15c4b0 con 0x7f742c15fd60 2023-07-14T13:11:11.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.028+0000 7f7428ff9640 1 -- 172.21.15.5:0/1372390530 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7424012640 con 0x7f742c15fd60 2023-07-14T13:11:11.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.028+0000 7f7432503640 1 -- 172.21.15.5:0/1372390530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f742c15cf90 con 0x7f742c15fd60 2023-07-14T13:11:11.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.028+0000 7f7432503640 1 -- 172.21.15.5:0/1372390530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f742c15cc70 con 0x7f742c15fd60 2023-07-14T13:11:11.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.032+0000 7f7428ff9640 1 -- 172.21.15.5:0/1372390530 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 50) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f7424007070 con 0x7f742c15fd60 2023-07-14T13:11:11.068 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:11.032+0000 7f142a42c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:11:11.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.032+0000 7f7428ff9640 1 --2- 172.21.15.5:0/1372390530 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f74180664c0 0x7f7418068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:11.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.032+0000 7f7428ff9640 1 -- 172.21.15.5:0/1372390530 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f7424084300 con 0x7f742c15fd60 2023-07-14T13:11:11.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.032+0000 7f742bfff640 1 -- 172.21.15.5:0/1372390530 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f74180664c0 msgr2=0x7f7418068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1467987432 2023-07-14T13:11:11.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.032+0000 7f742bfff640 1 --2- 172.21.15.5:0/1372390530 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f74180664c0 0x7f7418068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:11:11.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.036+0000 7f7428ff9640 1 -- 172.21.15.5:0/1372390530 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f74240511d0 con 0x7f742c15fd60 2023-07-14T13:11:11.175 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:11.144+0000 7f8ae9be6180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:11:11.208 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:11.172+0000 7f142a42c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:11:11.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.204+0000 7f7432503640 1 -- 172.21.15.5:0/1372390530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f742c0678d0 con 0x7f742c15fd60 2023-07-14T13:11:11.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.204+0000 7f7428ff9640 1 -- 172.21.15.5:0/1372390530 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v114) v1 ==== 80+0+477 (secure 0 0 0) 0x7f7424017020 con 0x7f742c15fd60 2023-07-14T13:11:11.241 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/2790592485 2023-07-15T13:10:05.475092+0000 2023-07-14T13:11:11.241 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/3030719967 2023-07-15T13:10:05.475092+0000 2023-07-14T13:11:11.242 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/1189847216 2023-07-15T13:10:05.475092+0000 2023-07-14T13:11:11.242 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/199342422 2023-07-15T13:10:05.475092+0000 2023-07-14T13:11:11.242 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:6833/1525189184 2023-07-15T13:10:05.475092+0000 2023-07-14T13:11:11.242 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:6832/1525189184 2023-07-15T13:10:05.475092+0000 2023-07-14T13:11:11.242 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/3609928299 2023-07-15T13:10:05.475092+0000 2023-07-14T13:11:11.242 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/1625180439 2023-07-15T13:10:05.475092+0000 2023-07-14T13:11:11.243 INFO:teuthology.orchestra.run.smithi005.stderr:listed 8 entries 2023-07-14T13:11:11.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.208+0000 7f7432503640 1 -- 172.21.15.5:0/1372390530 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f74180664c0 msgr2=0x7f7418068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:11:11.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.208+0000 7f7432503640 1 --2- 172.21.15.5:0/1372390530 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f74180664c0 0x7f7418068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:11.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.208+0000 7f7432503640 1 -- 172.21.15.5:0/1372390530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f742c15fd60 msgr2=0x7f742c152320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:11.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.208+0000 7f7432503640 1 --2- 172.21.15.5:0/1372390530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f742c15fd60 0x7f742c152320 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f742400caa0 tx=0x7f742400cf60 comp rx=0 tx=0).stop 2023-07-14T13:11:11.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.208+0000 7f7432503640 1 -- 172.21.15.5:0/1372390530 shutdown_connections 2023-07-14T13:11:11.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.208+0000 7f7432503640 1 --2- 172.21.15.5:0/1372390530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f742c15fd60 0x7f742c152320 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:11.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.208+0000 7f7432503640 1 --2- 172.21.15.5:0/1372390530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f742c0d1850 0x7f742c0ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:11.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.208+0000 7f7432503640 1 --2- 172.21.15.5:0/1372390530 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f74180664c0 0x7f7418068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:11.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.208+0000 7f7432503640 1 --2- 172.21.15.5:0/1372390530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f742c0b7c70 0x7f742c0ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:11.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.208+0000 7f7432503640 1 -- 172.21.15.5:0/1372390530 >> 172.21.15.5:0/1372390530 conn(0x7f742c0650b0 msgr2=0x7f742c0b6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:11.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.208+0000 7f7432503640 1 -- 172.21.15.5:0/1372390530 shutdown_connections 2023-07-14T13:11:11.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.208+0000 7f7432503640 1 -- 172.21.15.5:0/1372390530 wait complete. 2023-07-14T13:11:11.246 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:11.212+0000 7f8ae9be6180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:11:11.263 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-14T13:11:11.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:11:11.264 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-14T13:11:11.338 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-07-14T13:11:11.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:11:11.339 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-14T13:11:11.344 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:11.308+0000 7f142a42c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:11:11.350 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:11:11.350 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:11:11.360 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:11:11.360 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:11:11.361 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:11:11.379 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:11.348+0000 7f8ae9be6180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:11:11.402 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:11:11.402 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:11:11.403 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:11:11.412 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:11:11.412 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:11:11.419 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:11.384+0000 7f142a42c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:11:11.562 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:11.528+0000 7f142a42c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:11:11.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.528+0000 7fea02fd2640 1 Processor -- start 2023-07-14T13:11:11.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.528+0000 7fea02fd2640 1 -- start start 2023-07-14T13:11:11.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.532+0000 7fea02fd2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe9fc15bb40 0x7fe9fc0ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:11.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.532+0000 7fea02fd2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9fc0d1800 0x7fe9fc0cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:11.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.532+0000 7fea02fd2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9fc0ccc10 con 0x7fe9fc0cef60 2023-07-14T13:11:11.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.532+0000 7fea02fd2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9fc0ccef0 con 0x7fe9fc15bb40 2023-07-14T13:11:11.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.532+0000 7fea02fd2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc0d2880 con 0x7fe9fc0d1800 2023-07-14T13:11:11.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.532+0000 7fea0156f640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe9fc0cef60 0x7fe9fc15f530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43812/0 (socket says 172.21.15.5:43812) 2023-07-14T13:11:11.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.532+0000 7fea0156f640 1 -- 172.21.15.5:0/1607676802 learned_addr learned my addr 172.21.15.5:0/1607676802 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:11.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.532+0000 7fea00d6e640 1 --2- 172.21.15.5:0/1607676802 >> v2:172.21.15.154:3300/0 conn(0x7fe9fc15bb40 0x7fe9fc0ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:11.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.532+0000 7fe9fbfff640 1 --2- 172.21.15.5:0/1607676802 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9fc0d1800 0x7fe9fc0cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:11.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.532+0000 7fe9fb7fe640 1 -- 172.21.15.5:0/1607676802 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2585243207 0 0) 0x7fe9fc0ccc10 con 0x7fe9fc0cef60 2023-07-14T13:11:11.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.532+0000 7fe9fb7fe640 1 -- 172.21.15.5:0/1607676802 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9ec003530 con 0x7fe9fc0cef60 2023-07-14T13:11:11.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.532+0000 7fe9fbfff640 1 -- 172.21.15.5:0/1607676802 >> v2:172.21.15.154:3300/0 conn(0x7fe9fc15bb40 msgr2=0x7fe9fc0ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:11.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.532+0000 7fe9fbfff640 1 --2- 172.21.15.5:0/1607676802 >> v2:172.21.15.154:3300/0 conn(0x7fe9fc15bb40 0x7fe9fc0ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:11.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.532+0000 7fe9fbfff640 1 -- 172.21.15.5:0/1607676802 >> v1:172.21.15.5:6789/0 conn(0x7fe9fc0cef60 legacy=0x7fe9fc15f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:11.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.532+0000 7fe9fbfff640 1 -- 172.21.15.5:0/1607676802 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9fc0d2b60 con 0x7fe9fc0d1800 2023-07-14T13:11:11.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.532+0000 7fe9fbfff640 1 --2- 172.21.15.5:0/1607676802 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9fc0d1800 0x7fe9fc0cea20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe9e80097c0 tx=0x7fe9e801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c4fe37a1082e37 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:11.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.536+0000 7fe9fb7fe640 1 -- 172.21.15.5:0/1607676802 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e80ab620 con 0x7fe9fc0d1800 2023-07-14T13:11:11.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.536+0000 7fe9fb7fe640 1 -- 172.21.15.5:0/1607676802 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e80ab780 con 0x7fe9fc0d1800 2023-07-14T13:11:11.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.536+0000 7fe9fb7fe640 1 -- 172.21.15.5:0/1607676802 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e80abaf0 con 0x7fe9fc0d1800 2023-07-14T13:11:11.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.536+0000 7fea02fd2640 1 -- 172.21.15.5:0/1607676802 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9fc0d1800 msgr2=0x7fe9fc0cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:11.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.536+0000 7fea02fd2640 1 --2- 172.21.15.5:0/1607676802 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9fc0d1800 0x7fe9fc0cea20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe9e80097c0 tx=0x7fe9e801c480 comp rx=0 tx=0).stop 2023-07-14T13:11:11.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.536+0000 7fea02fd2640 1 -- 172.21.15.5:0/1607676802 shutdown_connections 2023-07-14T13:11:11.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.536+0000 7fea02fd2640 1 --2- 172.21.15.5:0/1607676802 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9fc0d1800 0x7fe9fc0cea20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:11.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.536+0000 7fea02fd2640 1 --2- 172.21.15.5:0/1607676802 >> v2:172.21.15.154:3300/0 conn(0x7fe9fc15bb40 0x7fe9fc0ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:11.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.536+0000 7fea02fd2640 1 -- 172.21.15.5:0/1607676802 >> 172.21.15.5:0/1607676802 conn(0x7fe9fc0650b0 msgr2=0x7fe9fc0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:11.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.536+0000 7fea02fd2640 1 -- 172.21.15.5:0/1607676802 shutdown_connections 2023-07-14T13:11:11.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.536+0000 7fea02fd2640 1 -- 172.21.15.5:0/1607676802 wait complete. 2023-07-14T13:11:11.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.536+0000 7fea02fd2640 1 Processor -- start 2023-07-14T13:11:11.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.536+0000 7fea02fd2640 1 -- start start 2023-07-14T13:11:11.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.536+0000 7fea02fd2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9fc0cef60 0x7fe9fc15c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:11.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.536+0000 7fea02fd2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9fc0d1800 0x7fe9fc150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:11.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.536+0000 7fea02fd2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9fc15bb40 0x7fe9fc0b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:11.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.536+0000 7fea02fd2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc0cc220 con 0x7fe9fc0d1800 2023-07-14T13:11:11.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.536+0000 7fea02fd2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc0cb9c0 con 0x7fe9fc15bb40 2023-07-14T13:11:11.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.536+0000 7fea02fd2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc0cbc60 con 0x7fe9fc0cef60 2023-07-14T13:11:11.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.540+0000 7fe9fbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9fc0d1800 0x7fe9fc150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:11.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.540+0000 7fea0156f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9fc15bb40 0x7fe9fc0b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:11.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.540+0000 7fe9fbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9fc0d1800 0x7fe9fc150560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35610/0 (socket says 172.21.15.5:35610) 2023-07-14T13:11:11.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.540+0000 7fea00d6e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9fc0cef60 0x7fe9fc15c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:11.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.540+0000 7fe9fbfff640 1 -- 172.21.15.5:0/1441935176 learned_addr learned my addr 172.21.15.5:0/1441935176 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:11.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.540+0000 7fe9fbfff640 1 -- 172.21.15.5:0/1441935176 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9fc0cef60 msgr2=0x7fe9fc15c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:11.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.540+0000 7fe9fbfff640 1 --2- 172.21.15.5:0/1441935176 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9fc0cef60 0x7fe9fc15c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:11.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.540+0000 7fe9fbfff640 1 -- 172.21.15.5:0/1441935176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9fc15bb40 msgr2=0x7fe9fc0b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:11.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.540+0000 7fe9fbfff640 1 --2- 172.21.15.5:0/1441935176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9fc15bb40 0x7fe9fc0b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:11.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.540+0000 7fe9fbfff640 1 -- 172.21.15.5:0/1441935176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e8009420 con 0x7fe9fc0d1800 2023-07-14T13:11:11.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.540+0000 7fea0156f640 1 --2- 172.21.15.5:0/1441935176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9fc15bb40 0x7fe9fc0b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:11:11.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.540+0000 7fe9fbfff640 1 --2- 172.21.15.5:0/1441935176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9fc0d1800 0x7fe9fc150560 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fe9e801cd20 tx=0x7fe9e801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:11.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.540+0000 7fe9f97fa640 1 -- 172.21.15.5:0/1441935176 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e80abaf0 con 0x7fe9fc0d1800 2023-07-14T13:11:11.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.540+0000 7fe9f97fa640 1 -- 172.21.15.5:0/1441935176 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e80abc50 con 0x7fe9fc0d1800 2023-07-14T13:11:11.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.540+0000 7fe9f97fa640 1 -- 172.21.15.5:0/1441935176 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e80b5400 con 0x7fe9fc0d1800 2023-07-14T13:11:11.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.540+0000 7fea02fd2640 1 -- 172.21.15.5:0/1441935176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9fc0cbf40 con 0x7fe9fc0d1800 2023-07-14T13:11:11.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.540+0000 7fea02fd2640 1 -- 172.21.15.5:0/1441935176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9fc15eb00 con 0x7fe9fc0d1800 2023-07-14T13:11:11.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.540+0000 7fea02fd2640 1 -- 172.21.15.5:0/1441935176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9fc0d2320 con 0x7fe9fc0d1800 2023-07-14T13:11:11.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.540+0000 7fe9f97fa640 1 -- 172.21.15.5:0/1441935176 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 50) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fe9e80b5560 con 0x7fe9fc0d1800 2023-07-14T13:11:11.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.544+0000 7fe9f97fa640 1 --2- 172.21.15.5:0/1441935176 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7fe9e00664c0 0x7fe9e0068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:11.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.544+0000 7fe9f97fa640 1 -- 172.21.15.5:0/1441935176 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fe9e811e770 con 0x7fe9fc0d1800 2023-07-14T13:11:11.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.544+0000 7fea00d6e640 1 -- 172.21.15.5:0/1441935176 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7fe9e00664c0 msgr2=0x7fe9e0068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1467987432 2023-07-14T13:11:11.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.544+0000 7fea00d6e640 1 --2- 172.21.15.5:0/1441935176 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7fe9e00664c0 0x7fe9e0068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:11:11.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.548+0000 7fe9f97fa640 1 -- 172.21.15.5:0/1441935176 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe9e80eb5c0 con 0x7fe9fc0d1800 2023-07-14T13:11:11.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.736+0000 7fea02fd2640 1 -- 172.21.15.5:0/1441935176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9fc15e680 con 0x7fe9fc0d1800 2023-07-14T13:11:11.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.736+0000 7fe9f97fa640 1 -- 172.21.15.5:0/1441935176 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4705 (secure 0 0 0) 0x7fe9fc15e680 con 0x7fe9fc0d1800 2023-07-14T13:11:11.774 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:11:11.774 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6575,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1957957644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1957957644},{"type":"v1","addr":"172.21.15.5:6835","nonce":1957957644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3439623726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3439623726},{"type":"v1","addr":"172.21.15.154:6837","nonce":3439623726}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7384,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/692576619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":692576619},{"type":"v1","addr":"172.21.15.154:6836","nonce":692576619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:09:48.156588+0000","modified":"2023-07-14T13:09:51.784254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7668},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7668":{"gid":7668,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/855157103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":855157103},{"type":"v1","addr":"172.21.15.5:6834","nonce":855157103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-14T13:11:11.774 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 49 2023-07-14T13:11:11.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.740+0000 7fea02fd2640 1 -- 172.21.15.5:0/1441935176 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7fe9e00664c0 msgr2=0x7fe9e0068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:11:11.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.740+0000 7fea02fd2640 1 --2- 172.21.15.5:0/1441935176 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7fe9e00664c0 0x7fe9e0068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:11.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.740+0000 7fea02fd2640 1 -- 172.21.15.5:0/1441935176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9fc0d1800 msgr2=0x7fe9fc150560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:11.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.740+0000 7fea02fd2640 1 --2- 172.21.15.5:0/1441935176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9fc0d1800 0x7fe9fc150560 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fe9e801cd20 tx=0x7fe9e801acc0 comp rx=0 tx=0).stop 2023-07-14T13:11:11.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.740+0000 7fea02fd2640 1 -- 172.21.15.5:0/1441935176 shutdown_connections 2023-07-14T13:11:11.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.740+0000 7fea02fd2640 1 --2- 172.21.15.5:0/1441935176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9fc15bb40 0x7fe9fc0b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:11.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.740+0000 7fea02fd2640 1 --2- 172.21.15.5:0/1441935176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9fc0d1800 0x7fe9fc150560 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:11.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.740+0000 7fea02fd2640 1 --2- 172.21.15.5:0/1441935176 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7fe9e00664c0 0x7fe9e0068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:11.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.740+0000 7fea02fd2640 1 --2- 172.21.15.5:0/1441935176 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9fc0cef60 0x7fe9fc15c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:11.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.740+0000 7fea02fd2640 1 -- 172.21.15.5:0/1441935176 >> 172.21.15.5:0/1441935176 conn(0x7fe9fc0650b0 msgr2=0x7fe9fc154850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:11.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.740+0000 7fea02fd2640 1 -- 172.21.15.5:0/1441935176 shutdown_connections 2023-07-14T13:11:11.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.740+0000 7fea02fd2640 1 -- 172.21.15.5:0/1441935176 wait complete. 2023-07-14T13:11:11.795 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:11:11.927 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:11.896+0000 7f8ae9be6180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:11:11.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.908+0000 7f2cd5974640 1 Processor -- start 2023-07-14T13:11:11.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.908+0000 7f2cd5974640 1 -- start start 2023-07-14T13:11:11.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.912+0000 7f2cd5974640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2cd0070b70 0x7f2cd0070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:11.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.912+0000 7f2cd5974640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd00cac70 con 0x7f2cd006b1e0 2023-07-14T13:11:11.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.912+0000 7f2cd5974640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd0071480 con 0x7f2cd00cb100 2023-07-14T13:11:11.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.912+0000 7f2cd5974640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd00ca060 con 0x7f2cd0070b70 2023-07-14T13:11:11.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.912+0000 7f2cc7fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2cd006b1e0 0x7f2cd00c1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43824/0 (socket says 172.21.15.5:43824) 2023-07-14T13:11:11.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.912+0000 7f2cc7fff640 1 -- 172.21.15.5:0/2495045462 learned_addr learned my addr 172.21.15.5:0/2495045462 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:11.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.912+0000 7f2cceffd640 1 --2- 172.21.15.5:0/2495045462 >> v2:172.21.15.154:3300/0 conn(0x7f2cd0070b70 0x7f2cd0070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:11.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.912+0000 7f2cce7fc640 1 -- 172.21.15.5:0/2495045462 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1299918259 0 0) 0x7f2cd00cac70 con 0x7f2cd006b1e0 2023-07-14T13:11:11.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.912+0000 7f2cce7fc640 1 -- 172.21.15.5:0/2495045462 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cbc003530 con 0x7f2cd006b1e0 2023-07-14T13:11:11.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.912+0000 7f2cce7fc640 1 -- 172.21.15.5:0/2495045462 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3363393714 0 0) 0x7f2cd0071480 con 0x7f2cd00cb100 2023-07-14T13:11:11.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.912+0000 7f2cce7fc640 1 -- 172.21.15.5:0/2495045462 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cd00cac70 con 0x7f2cd00cb100 2023-07-14T13:11:11.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.912+0000 7f2cceffd640 1 -- 172.21.15.5:0/2495045462 >> v1:172.21.15.154:6789/0 conn(0x7f2cd00cb100 legacy=0x7f2cd00cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:11.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.912+0000 7f2cceffd640 1 -- 172.21.15.5:0/2495045462 >> v1:172.21.15.5:6789/0 conn(0x7f2cd006b1e0 legacy=0x7f2cd00c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:11.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.912+0000 7f2cceffd640 1 -- 172.21.15.5:0/2495045462 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd00ca340 con 0x7f2cd0070b70 2023-07-14T13:11:11.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.916+0000 7f2cceffd640 1 --2- 172.21.15.5:0/2495045462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cd0070b70 0x7f2cd0070f40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2cc00097c0 tx=0x7f2cc001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb612f708561a920 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:11.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.916+0000 7f2cce7fc640 1 -- 172.21.15.5:0/2495045462 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc00ab650 con 0x7f2cd0070b70 2023-07-14T13:11:11.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.916+0000 7f2cce7fc640 1 -- 172.21.15.5:0/2495045462 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc00ab7b0 con 0x7f2cd0070b70 2023-07-14T13:11:11.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.916+0000 7f2cce7fc640 1 -- 172.21.15.5:0/2495045462 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc00abb20 con 0x7f2cd0070b70 2023-07-14T13:11:11.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.916+0000 7f2cd5974640 1 -- 172.21.15.5:0/2495045462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cd0070b70 msgr2=0x7f2cd0070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:11.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.916+0000 7f2cd5974640 1 --2- 172.21.15.5:0/2495045462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cd0070b70 0x7f2cd0070f40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2cc00097c0 tx=0x7f2cc001c450 comp rx=0 tx=0).stop 2023-07-14T13:11:11.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.916+0000 7f2cd5974640 1 -- 172.21.15.5:0/2495045462 shutdown_connections 2023-07-14T13:11:11.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.916+0000 7f2cd5974640 1 --2- 172.21.15.5:0/2495045462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cd0070b70 0x7f2cd0070f40 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:11.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.916+0000 7f2cd5974640 1 -- 172.21.15.5:0/2495045462 >> 172.21.15.5:0/2495045462 conn(0x7f2cd00afcf0 msgr2=0x7f2cd00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:11.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.916+0000 7f2cd5974640 1 -- 172.21.15.5:0/2495045462 shutdown_connections 2023-07-14T13:11:11.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.916+0000 7f2cd5974640 1 -- 172.21.15.5:0/2495045462 wait complete. 2023-07-14T13:11:11.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.916+0000 7f2cd5974640 1 Processor -- start 2023-07-14T13:11:11.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.916+0000 7f2cd5974640 1 -- start start 2023-07-14T13:11:11.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.920+0000 7f2cd5974640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cd006b1e0 0x7f2cd014f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:11.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.920+0000 7f2cd5974640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cd0070b70 0x7f2cd00c3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:11.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.920+0000 7f2cd5974640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cd00cb100 0x7f2cd00c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:11.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.920+0000 7f2cd5974640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd00c8190 con 0x7f2cd00cb100 2023-07-14T13:11:11.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.920+0000 7f2cd5974640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd00cdc40 con 0x7f2cd006b1e0 2023-07-14T13:11:11.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.920+0000 7f2cd5974640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd00cbed0 con 0x7f2cd0070b70 2023-07-14T13:11:11.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.920+0000 7f2cceffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cd006b1e0 0x7f2cd014f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:11.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.920+0000 7f2ccf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cd00cb100 0x7f2cd00c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:11.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.920+0000 7f2cceffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cd006b1e0 0x7f2cd014f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:43810/0 (socket says 172.21.15.5:43810) 2023-07-14T13:11:11.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.920+0000 7f2cceffd640 1 -- 172.21.15.5:0/2016378840 learned_addr learned my addr 172.21.15.5:0/2016378840 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:11.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.920+0000 7f2cc7fff640 1 --2- 172.21.15.5:0/2016378840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cd0070b70 0x7f2cd00c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:11.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.920+0000 7f2cceffd640 1 -- 172.21.15.5:0/2016378840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cd0070b70 msgr2=0x7f2cd00c3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:11.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.920+0000 7f2cceffd640 1 --2- 172.21.15.5:0/2016378840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cd0070b70 0x7f2cd00c3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:11.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.920+0000 7f2cceffd640 1 -- 172.21.15.5:0/2016378840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cd00cb100 msgr2=0x7f2cd00c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:11.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.920+0000 7f2cceffd640 1 --2- 172.21.15.5:0/2016378840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cd00cb100 0x7f2cd00c3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:11.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.920+0000 7f2cceffd640 1 -- 172.21.15.5:0/2016378840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc0009420 con 0x7f2cd006b1e0 2023-07-14T13:11:11.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.920+0000 7f2ccf7fe640 1 --2- 172.21.15.5:0/2016378840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cd00cb100 0x7f2cd00c3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:11:11.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.920+0000 7f2cceffd640 1 --2- 172.21.15.5:0/2016378840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cd006b1e0 0x7f2cd014f1b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0000c10 tx=0x7f2cc001ac90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:11.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.920+0000 7f2cccff9640 1 -- 172.21.15.5:0/2016378840 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc00bf610 con 0x7f2cd006b1e0 2023-07-14T13:11:11.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.920+0000 7f2cccff9640 1 -- 172.21.15.5:0/2016378840 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc00bf770 con 0x7f2cd006b1e0 2023-07-14T13:11:11.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.920+0000 7f2cccff9640 1 -- 172.21.15.5:0/2016378840 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc00bfae0 con 0x7f2cd006b1e0 2023-07-14T13:11:11.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.920+0000 7f2cd5974640 1 -- 172.21.15.5:0/2016378840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd00cc1b0 con 0x7f2cd006b1e0 2023-07-14T13:11:11.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.920+0000 7f2cd5974640 1 -- 172.21.15.5:0/2016378840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd00cc770 con 0x7f2cd006b1e0 2023-07-14T13:11:11.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.920+0000 7f2cd5974640 1 -- 172.21.15.5:0/2016378840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd00678d0 con 0x7f2cd006b1e0 2023-07-14T13:11:11.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.920+0000 7f2cccff9640 1 -- 172.21.15.5:0/2016378840 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 50) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f2cc00bfc40 con 0x7f2cd006b1e0 2023-07-14T13:11:11.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.924+0000 7f2cccff9640 1 --2- 172.21.15.5:0/2016378840 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f2cb00664c0 0x7f2cb0068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:11.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.924+0000 7f2cccff9640 1 -- 172.21.15.5:0/2016378840 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f2cc011f510 con 0x7f2cd006b1e0 2023-07-14T13:11:11.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.924+0000 7f2cc7fff640 1 -- 172.21.15.5:0/2016378840 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f2cb00664c0 msgr2=0x7f2cb0068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1467987432 2023-07-14T13:11:11.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.924+0000 7f2cc7fff640 1 --2- 172.21.15.5:0/2016378840 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f2cb00664c0 0x7f2cb0068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:11:11.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:11.928+0000 7f2cccff9640 1 -- 172.21.15.5:0/2016378840 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2cc00ec6a0 con 0x7f2cd006b1e0 2023-07-14T13:11:12.017 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:11.984+0000 7f8ae9be6180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:11:12.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.088+0000 7f2cd5974640 1 -- 172.21.15.5:0/2016378840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cd006cad0 con 0x7f2cd006b1e0 2023-07-14T13:11:12.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.088+0000 7f2cccff9640 1 -- 172.21.15.5:0/2016378840 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+18959 (secure 0 0 0) 0x7f2cc00efcc0 con 0x7f2cd006b1e0 2023-07-14T13:11:12.125 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:11:12.125 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":114,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:11:06.774022+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:09:45.916338+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-14T13:09:47.159234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.18","mappings":[{"from":1,"to":7}]},{"pgid":"14.2a","mappings":[{"from":1,"to":2}]},{"pgid":"14.32","mappings":[{"from":1,"to":5}]},{"pgid":"14.36","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/2790592485":"2023-07-15T13:10:05.475092+0000","172.21.15.154:0/3030719967":"2023-07-15T13:10:05.475092+0000","172.21.15.154:0/1189847216":"2023-07-15T13:10:05.475092+0000","172.21.15.154:0/199342422":"2023-07-15T13:10:05.475092+0000","172.21.15.154:6833/1525189184":"2023-07-15T13:10:05.475092+0000","172.21.15.154:6832/1525189184":"2023-07-15T13:10:05.475092+0000","172.21.15.154:0/3609928299":"2023-07-15T13:10:05.475092+0000","172.21.15.154:0/1625180439":"2023-07-15T13:10:05.475092+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:11:12.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.092+0000 7f2cd5974640 1 -- 172.21.15.5:0/2016378840 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f2cb00664c0 msgr2=0x7f2cb0068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:11:12.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.092+0000 7f2cd5974640 1 --2- 172.21.15.5:0/2016378840 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f2cb00664c0 0x7f2cb0068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:12.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.092+0000 7f2cd5974640 1 -- 172.21.15.5:0/2016378840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cd006b1e0 msgr2=0x7f2cd014f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:12.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.092+0000 7f2cd5974640 1 --2- 172.21.15.5:0/2016378840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cd006b1e0 0x7f2cd014f1b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0000c10 tx=0x7f2cc001ac90 comp rx=0 tx=0).stop 2023-07-14T13:11:12.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.092+0000 7f2cd5974640 1 -- 172.21.15.5:0/2016378840 shutdown_connections 2023-07-14T13:11:12.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.092+0000 7f2cd5974640 1 --2- 172.21.15.5:0/2016378840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cd00cb100 0x7f2cd00c3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:12.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.092+0000 7f2cd5974640 1 --2- 172.21.15.5:0/2016378840 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f2cb00664c0 0x7f2cb0068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:12.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.092+0000 7f2cd5974640 1 --2- 172.21.15.5:0/2016378840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cd0070b70 0x7f2cd00c3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:12.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.092+0000 7f2cd5974640 1 --2- 172.21.15.5:0/2016378840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cd006b1e0 0x7f2cd014f1b0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:12.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.092+0000 7f2cd5974640 1 -- 172.21.15.5:0/2016378840 >> 172.21.15.5:0/2016378840 conn(0x7f2cd00afcf0 msgr2=0x7f2cd00c1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:12.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.092+0000 7f2cd5974640 1 -- 172.21.15.5:0/2016378840 shutdown_connections 2023-07-14T13:11:12.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.092+0000 7f2cd5974640 1 -- 172.21.15.5:0/2016378840 wait complete. 2023-07-14T13:11:12.143 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:12.108+0000 7f142a42c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:11:12.147 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T13:09:45.916338+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T13:09:47.159234+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:11:12.148 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:11:12.165 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:12.132+0000 7f8ae9be6180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:11:12.235 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:12.200+0000 7f142a42c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:11:12.248 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:12.216+0000 7f8ae9be6180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:11:12.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.260+0000 7f860b87b640 1 Processor -- start 2023-07-14T13:11:12.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.260+0000 7f860b87b640 1 -- start start 2023-07-14T13:11:12.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.264+0000 7f860b87b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f860415bde0 0x7f86040d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:12.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.264+0000 7f860b87b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86040d2300 0x7f86040d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:12.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.264+0000 7f860b87b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86040b04c0 con 0x7f86040d2fc0 2023-07-14T13:11:12.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.264+0000 7f860b87b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f860415c1b0 con 0x7f860415bde0 2023-07-14T13:11:12.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.264+0000 7f860b87b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86040d2cc0 con 0x7f86040d2300 2023-07-14T13:11:12.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.264+0000 7f8609617640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f860415bde0 0x7f86040d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:12.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.264+0000 7f8609617640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f860415bde0 0x7f86040d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35620/0 (socket says 172.21.15.5:35620) 2023-07-14T13:11:12.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.264+0000 7f8609617640 1 -- 172.21.15.5:0/692395777 learned_addr learned my addr 172.21.15.5:0/692395777 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:12.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.264+0000 7f8609e18640 1 --2- 172.21.15.5:0/692395777 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86040d2300 0x7f86040d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:12.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.264+0000 7f8609617640 1 -- 172.21.15.5:0/692395777 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86040d2300 msgr2=0x7f86040d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:12.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.264+0000 7f8609617640 1 --2- 172.21.15.5:0/692395777 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86040d2300 0x7f86040d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:12.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.264+0000 7f8609617640 1 -- 172.21.15.5:0/692395777 >> v1:172.21.15.154:6789/0 conn(0x7f86040d2fc0 legacy=0x7f86040b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:12.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.264+0000 7f8609617640 1 -- 172.21.15.5:0/692395777 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86040b1060 con 0x7f860415bde0 2023-07-14T13:11:12.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.268+0000 7f8609617640 1 --2- 172.21.15.5:0/692395777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f860415bde0 0x7f86040d0270 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f8600006fd0 tx=0x7f860001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4403019132e0c05 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:12.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.268+0000 7f85fbfff640 1 -- 172.21.15.5:0/692395777 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000a7070 con 0x7f860415bde0 2023-07-14T13:11:12.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.268+0000 7f85fbfff640 1 -- 172.21.15.5:0/692395777 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86000ab430 con 0x7f860415bde0 2023-07-14T13:11:12.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.268+0000 7f85fbfff640 1 -- 172.21.15.5:0/692395777 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000ab7c0 con 0x7f860415bde0 2023-07-14T13:11:12.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.268+0000 7f860b87b640 1 -- 172.21.15.5:0/692395777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f860415bde0 msgr2=0x7f86040d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:12.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.268+0000 7f860b87b640 1 --2- 172.21.15.5:0/692395777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f860415bde0 0x7f86040d0270 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f8600006fd0 tx=0x7f860001c520 comp rx=0 tx=0).stop 2023-07-14T13:11:12.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.268+0000 7f860b87b640 1 -- 172.21.15.5:0/692395777 shutdown_connections 2023-07-14T13:11:12.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.268+0000 7f860b87b640 1 --2- 172.21.15.5:0/692395777 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86040d2300 0x7f86040d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:12.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.268+0000 7f860b87b640 1 --2- 172.21.15.5:0/692395777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f860415bde0 0x7f86040d0270 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:12.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.268+0000 7f860b87b640 1 -- 172.21.15.5:0/692395777 >> 172.21.15.5:0/692395777 conn(0x7f86040659d0 msgr2=0x7f860409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:12.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.268+0000 7f860b87b640 1 -- 172.21.15.5:0/692395777 shutdown_connections 2023-07-14T13:11:12.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.268+0000 7f860b87b640 1 -- 172.21.15.5:0/692395777 wait complete. 2023-07-14T13:11:12.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.268+0000 7f860b87b640 1 Processor -- start 2023-07-14T13:11:12.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.272+0000 7f860b87b640 1 -- start start 2023-07-14T13:11:12.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.272+0000 7f860b87b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86040d2300 0x7f86040b75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:12.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.272+0000 7f860b87b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86040d2fc0 0x7f8604155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:12.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.272+0000 7f860b87b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f860415bde0 0x7f86040cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:12.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.272+0000 7f860b87b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860415db20 con 0x7f86040d2fc0 2023-07-14T13:11:12.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.272+0000 7f860b87b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860415de00 con 0x7f860415bde0 2023-07-14T13:11:12.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.272+0000 7f860b87b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860415e0e0 con 0x7f86040d2300 2023-07-14T13:11:12.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.272+0000 7f8608e16640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86040d2fc0 0x7f8604155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:12.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.272+0000 7f8608e16640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86040d2fc0 0x7f8604155100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35636/0 (socket says 172.21.15.5:35636) 2023-07-14T13:11:12.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.272+0000 7f8608e16640 1 -- 172.21.15.5:0/3030013658 learned_addr learned my addr 172.21.15.5:0/3030013658 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:12.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.272+0000 7f8609617640 1 --2- 172.21.15.5:0/3030013658 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86040d2300 0x7f86040b75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:12.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.272+0000 7f8609e18640 1 --2- 172.21.15.5:0/3030013658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f860415bde0 0x7f86040cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:12.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.272+0000 7f8608e16640 1 -- 172.21.15.5:0/3030013658 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86040d2300 msgr2=0x7f86040b75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:12.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.272+0000 7f8608e16640 1 --2- 172.21.15.5:0/3030013658 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86040d2300 0x7f86040b75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:12.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.272+0000 7f8608e16640 1 -- 172.21.15.5:0/3030013658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f860415bde0 msgr2=0x7f86040cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:12.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.272+0000 7f8608e16640 1 --2- 172.21.15.5:0/3030013658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f860415bde0 0x7f86040cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:12.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.272+0000 7f8608e16640 1 -- 172.21.15.5:0/3030013658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8600009480 con 0x7f86040d2fc0 2023-07-14T13:11:12.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.272+0000 7f8609617640 1 --2- 172.21.15.5:0/3030013658 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86040d2300 0x7f86040b75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:11:12.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.272+0000 7f8608e16640 1 --2- 172.21.15.5:0/3030013658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86040d2fc0 0x7f8604155100 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f85f400c390 tx=0x7f85f400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:12.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.272+0000 7f85f9ffb640 1 -- 172.21.15.5:0/3030013658 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f40052d0 con 0x7f86040d2fc0 2023-07-14T13:11:12.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.272+0000 7f85f9ffb640 1 -- 172.21.15.5:0/3030013658 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f4005430 con 0x7f86040d2fc0 2023-07-14T13:11:12.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.272+0000 7f85f9ffb640 1 -- 172.21.15.5:0/3030013658 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f4003820 con 0x7f86040d2fc0 2023-07-14T13:11:12.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.272+0000 7f860b87b640 1 -- 172.21.15.5:0/3030013658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f860415e3c0 con 0x7f86040d2fc0 2023-07-14T13:11:12.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.272+0000 7f860b87b640 1 -- 172.21.15.5:0/3030013658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860415d7b0 con 0x7f86040d2fc0 2023-07-14T13:11:12.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.276+0000 7f860b87b640 1 -- 172.21.15.5:0/3030013658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86040678d0 con 0x7f86040d2fc0 2023-07-14T13:11:12.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.276+0000 7f85f9ffb640 1 -- 172.21.15.5:0/3030013658 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 50) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f85f4003980 con 0x7f86040d2fc0 2023-07-14T13:11:12.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.276+0000 7f85f9ffb640 1 --2- 172.21.15.5:0/3030013658 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f85e80664c0 0x7f85e8068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:12.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.276+0000 7f85f9ffb640 1 -- 172.21.15.5:0/3030013658 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f85f40836f0 con 0x7f86040d2fc0 2023-07-14T13:11:12.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.276+0000 7f8609617640 1 -- 172.21.15.5:0/3030013658 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f85e80664c0 msgr2=0x7f85e8068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1467987432 2023-07-14T13:11:12.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.276+0000 7f8609617640 1 --2- 172.21.15.5:0/3030013658 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f85e80664c0 0x7f85e8068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:11:12.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.280+0000 7f85f9ffb640 1 -- 172.21.15.5:0/3030013658 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f85f4050850 con 0x7f86040d2fc0 2023-07-14T13:11:12.395 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:12.360+0000 7f142a42c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:11:12.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.436+0000 7f860b87b640 1 -- 172.21.15.5:0/3030013658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f860415f550 con 0x7f86040d2fc0 2023-07-14T13:11:12.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.436+0000 7f85f9ffb640 1 -- 172.21.15.5:0/3030013658 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v114) v1 ==== 93+0+10 (secure 0 0 0) 0x7f85f4053e70 con 0x7f86040d2fc0 2023-07-14T13:11:12.473 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:11:12.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.440+0000 7f860b87b640 1 -- 172.21.15.5:0/3030013658 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f85e80664c0 msgr2=0x7f85e8068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:11:12.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.440+0000 7f860b87b640 1 --2- 172.21.15.5:0/3030013658 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f85e80664c0 0x7f85e8068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:12.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.440+0000 7f860b87b640 1 -- 172.21.15.5:0/3030013658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86040d2fc0 msgr2=0x7f8604155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:12.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.440+0000 7f860b87b640 1 --2- 172.21.15.5:0/3030013658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86040d2fc0 0x7f8604155100 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f85f400c390 tx=0x7f85f400c850 comp rx=0 tx=0).stop 2023-07-14T13:11:12.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.440+0000 7f860b87b640 1 -- 172.21.15.5:0/3030013658 shutdown_connections 2023-07-14T13:11:12.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.440+0000 7f860b87b640 1 --2- 172.21.15.5:0/3030013658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f860415bde0 0x7f86040cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:12.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.440+0000 7f860b87b640 1 --2- 172.21.15.5:0/3030013658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86040d2fc0 0x7f8604155100 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:12.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.440+0000 7f860b87b640 1 --2- 172.21.15.5:0/3030013658 >> [v2:172.21.15.154:6832/1467987432,v1:172.21.15.154:6833/1467987432] conn(0x7f85e80664c0 0x7f85e8068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:12.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.440+0000 7f860b87b640 1 --2- 172.21.15.5:0/3030013658 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86040d2300 0x7f86040b75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:12.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.440+0000 7f860b87b640 1 -- 172.21.15.5:0/3030013658 >> 172.21.15.5:0/3030013658 conn(0x7f86040659d0 msgr2=0x7f860406afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:12.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.440+0000 7f860b87b640 1 -- 172.21.15.5:0/3030013658 shutdown_connections 2023-07-14T13:11:12.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.440+0000 7f860b87b640 1 -- 172.21.15.5:0/3030013658 wait complete. 2023-07-14T13:11:12.484 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:12.448+0000 7f142a42c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:11:12.493 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:11:12.522 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:12.488+0000 7f8ae9be6180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:11:12.581 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:12.548+0000 7f8ae9be6180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:11:12.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.612+0000 7f176a834640 1 Processor -- start 2023-07-14T13:11:12.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.612+0000 7f176a834640 1 -- start start 2023-07-14T13:11:12.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.612+0000 7f176a834640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f176415f750 0x7f176415fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:12.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.612+0000 7f176a834640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f17640cb190 0x7f17640cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:12.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.616+0000 7f176a834640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1764160660 con 0x7f17640cc940 2023-07-14T13:11:12.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.616+0000 7f176a834640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17640cad70 con 0x7f17640cb190 2023-07-14T13:11:12.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.616+0000 7f176a834640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17640cf250 con 0x7f176415f750 2023-07-14T13:11:12.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.616+0000 7f176a033640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f17640cb190 0x7f17640cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:12.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.616+0000 7f176a033640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f17640cb190 0x7f17640cb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35638/0 (socket says 172.21.15.5:35638) 2023-07-14T13:11:12.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.616+0000 7f176a033640 1 -- 172.21.15.5:0/1340513807 learned_addr learned my addr 172.21.15.5:0/1340513807 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:12.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.616+0000 7f1769031640 1 --2- 172.21.15.5:0/1340513807 >> v2:172.21.15.154:3300/0 conn(0x7f176415f750 0x7f176415fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:12.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.616+0000 7f176a033640 1 -- 172.21.15.5:0/1340513807 >> v2:172.21.15.154:3300/0 conn(0x7f176415f750 msgr2=0x7f176415fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:12.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.616+0000 7f176a033640 1 --2- 172.21.15.5:0/1340513807 >> v2:172.21.15.154:3300/0 conn(0x7f176415f750 0x7f176415fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:12.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.616+0000 7f176a033640 1 -- 172.21.15.5:0/1340513807 >> v1:172.21.15.154:6789/0 conn(0x7f17640cc940 legacy=0x7f17640ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:12.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.616+0000 7f176a033640 1 -- 172.21.15.5:0/1340513807 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17641600f0 con 0x7f17640cb190 2023-07-14T13:11:12.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.620+0000 7f176a033640 1 --2- 172.21.15.5:0/1340513807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17640cb190 0x7f17640cb560 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f17640cd420 tx=0x7f175c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90defd6ffc513bf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:12.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.620+0000 7f1768830640 1 -- 172.21.15.5:0/1340513807 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c0a5890 con 0x7f17640cb190 2023-07-14T13:11:12.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.620+0000 7f1768830640 1 -- 172.21.15.5:0/1340513807 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175c0a59f0 con 0x7f17640cb190 2023-07-14T13:11:12.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.620+0000 7f1768830640 1 -- 172.21.15.5:0/1340513807 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c0a5d80 con 0x7f17640cb190 2023-07-14T13:11:12.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.620+0000 7f176a834640 1 -- 172.21.15.5:0/1340513807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17640cb190 msgr2=0x7f17640cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:12.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.620+0000 7f176a834640 1 --2- 172.21.15.5:0/1340513807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17640cb190 0x7f17640cb560 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f17640cd420 tx=0x7f175c01c9d0 comp rx=0 tx=0).stop 2023-07-14T13:11:12.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.620+0000 7f176a834640 1 -- 172.21.15.5:0/1340513807 shutdown_connections 2023-07-14T13:11:12.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.620+0000 7f176a834640 1 --2- 172.21.15.5:0/1340513807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17640cb190 0x7f17640cb560 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:12.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.620+0000 7f176a834640 1 --2- 172.21.15.5:0/1340513807 >> v2:172.21.15.154:3300/0 conn(0x7f176415f750 0x7f176415fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:12.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.620+0000 7f176a834640 1 -- 172.21.15.5:0/1340513807 >> 172.21.15.5:0/1340513807 conn(0x7f17640650b0 msgr2=0x7f17640654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:12.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.620+0000 7f176a834640 1 -- 172.21.15.5:0/1340513807 shutdown_connections 2023-07-14T13:11:12.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.620+0000 7f176a834640 1 -- 172.21.15.5:0/1340513807 wait complete. 2023-07-14T13:11:12.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.620+0000 7f176a834640 1 Processor -- start 2023-07-14T13:11:12.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.620+0000 7f176a834640 1 -- start start 2023-07-14T13:11:12.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.624+0000 7f176a834640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17640cb190 0x7f17640ac380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:12.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.624+0000 7f176a834640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17640cc940 0x7f17640c7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:12.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.624+0000 7f176a834640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f176415f750 0x7f17640c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:12.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.624+0000 7f176a834640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17640c7a80 con 0x7f17640cc940 2023-07-14T13:11:12.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.624+0000 7f176a834640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17640c7c80 con 0x7f17640cb190 2023-07-14T13:11:12.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.624+0000 7f176a834640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17640c7f60 con 0x7f176415f750 2023-07-14T13:11:12.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.624+0000 7f1769031640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17640cc940 0x7f17640c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:12.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.624+0000 7f1769031640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17640cc940 0x7f17640c7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35652/0 (socket says 172.21.15.5:35652) 2023-07-14T13:11:12.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.624+0000 7f1769031640 1 -- 172.21.15.5:0/1623257842 learned_addr learned my addr 172.21.15.5:0/1623257842 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:12.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.624+0000 7f176a033640 1 --2- 172.21.15.5:0/1623257842 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f176415f750 0x7f17640c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:12.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.624+0000 7f1769832640 1 --2- 172.21.15.5:0/1623257842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17640cb190 0x7f17640ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:12.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.624+0000 7f1769031640 1 -- 172.21.15.5:0/1623257842 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f176415f750 msgr2=0x7f17640c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:12.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.624+0000 7f1769031640 1 --2- 172.21.15.5:0/1623257842 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f176415f750 0x7f17640c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:12.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.624+0000 7f1769031640 1 -- 172.21.15.5:0/1623257842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17640cb190 msgr2=0x7f17640ac380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:12.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.624+0000 7f1769031640 1 --2- 172.21.15.5:0/1623257842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17640cb190 0x7f17640ac380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:12.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.624+0000 7f1769031640 1 -- 172.21.15.5:0/1623257842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c009b30 con 0x7f17640cc940 2023-07-14T13:11:12.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.624+0000 7f1769031640 1 --2- 172.21.15.5:0/1623257842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17640cc940 0x7f17640c7000 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f175400e870 tx=0x7f175400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:12.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.624+0000 7f175a7fc640 1 -- 172.21.15.5:0/1623257842 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1754009510 con 0x7f17640cc940 2023-07-14T13:11:12.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.624+0000 7f176a834640 1 -- 172.21.15.5:0/1623257842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17640c8240 con 0x7f17640cc940 2023-07-14T13:11:12.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.624+0000 7f175a7fc640 1 -- 172.21.15.5:0/1623257842 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175400eec0 con 0x7f17640cc940 2023-07-14T13:11:12.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.624+0000 7f175a7fc640 1 -- 172.21.15.5:0/1623257842 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175400cb40 con 0x7f17640cc940 2023-07-14T13:11:12.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.624+0000 7f176a834640 1 -- 172.21.15.5:0/1623257842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17640c8800 con 0x7f17640cc940 2023-07-14T13:11:12.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.624+0000 7f176a834640 1 -- 172.21.15.5:0/1623257842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f176404e020 con 0x7f17640cc940 2023-07-14T13:11:12.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.628+0000 7f175a7fc640 1 -- 172.21.15.5:0/1623257842 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 51) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f175400cca0 con 0x7f17640cc940 2023-07-14T13:11:12.663 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:12.632+0000 7f8a74567640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:11:12.663 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:12.632+0000 7f8a74567640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:11:12.664 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:12.632+0000 7f8a74567640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:11:12.664 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:12.632+0000 7f8a74567640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:11:12.664 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:12.632+0000 7f8a74567640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:11:12.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.628+0000 7f175a7fc640 1 -- 172.21.15.5:0/1623257842 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6952+0+0 (secure 0 0 0) 0x7f17540844b0 con 0x7f17640cc940 2023-07-14T13:11:12.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.632+0000 7f175a7fc640 1 -- 172.21.15.5:0/1623257842 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f1754051990 con 0x7f17640cc940 2023-07-14T13:11:12.668 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:12.636+0000 7f8a71d62640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:11:12.669 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:12.636+0000 7f8a71d62640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:11:12.669 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:12.636+0000 7f8a71d62640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:11:12.669 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:12.636+0000 7f8a71d62640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:11:12.669 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:12.636+0000 7f8a71d62640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:11:12.789 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:12.752+0000 7f142a42c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:11:12.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.788+0000 7f176a834640 1 -- 172.21.15.5:0/1623257842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f176406f9f0 con 0x7f17640cc940 2023-07-14T13:11:12.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.788+0000 7f175a7fc640 1 -- 172.21.15.5:0/1623257842 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v115) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1754054fb0 con 0x7f17640cc940 2023-07-14T13:11:12.825 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:11:12.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.792+0000 7f176a834640 1 -- 172.21.15.5:0/1623257842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17640cc940 msgr2=0x7f17640c7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:12.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.792+0000 7f176a834640 1 --2- 172.21.15.5:0/1623257842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17640cc940 0x7f17640c7000 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f175400e870 tx=0x7f175400ec70 comp rx=0 tx=0).stop 2023-07-14T13:11:12.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.792+0000 7f176a834640 1 -- 172.21.15.5:0/1623257842 shutdown_connections 2023-07-14T13:11:12.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.792+0000 7f176a834640 1 --2- 172.21.15.5:0/1623257842 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f176415f750 0x7f17640c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:12.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.792+0000 7f176a834640 1 --2- 172.21.15.5:0/1623257842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17640cc940 0x7f17640c7000 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:12.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.792+0000 7f176a834640 1 --2- 172.21.15.5:0/1623257842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17640cb190 0x7f17640ac380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:12.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.792+0000 7f176a834640 1 -- 172.21.15.5:0/1623257842 >> 172.21.15.5:0/1623257842 conn(0x7f17640650b0 msgr2=0x7f17640b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:12.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.792+0000 7f176a834640 1 -- 172.21.15.5:0/1623257842 shutdown_connections 2023-07-14T13:11:12.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.792+0000 7f176a834640 1 -- 172.21.15.5:0/1623257842 wait complete. 2023-07-14T13:11:12.847 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T13:11:12.854 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:12.820+0000 7f142a42c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:11:12.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.960+0000 7f36f4ad5640 1 Processor -- start 2023-07-14T13:11:12.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.960+0000 7f36f4ad5640 1 -- start start 2023-07-14T13:11:12.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.960+0000 7f36f4ad5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f36f00af8b0 0x7f36f00afc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:12.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.960+0000 7f36f4ad5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36f00c8db0 0x7f36f00c9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:12.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.960+0000 7f36f4ad5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f00703a0 con 0x7f36f015c2a0 2023-07-14T13:11:12.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.960+0000 7f36f4ad5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f015ce20 con 0x7f36f00af8b0 2023-07-14T13:11:12.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.960+0000 7f36f4ad5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f00b01c0 con 0x7f36f00c8db0 2023-07-14T13:11:12.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.960+0000 7f36ef7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f36f00af8b0 0x7f36f00afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:12.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.960+0000 7f36ef7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f36f00af8b0 0x7f36f00afc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35658/0 (socket says 172.21.15.5:35658) 2023-07-14T13:11:12.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.960+0000 7f36ef7fe640 1 -- 172.21.15.5:0/366843956 learned_addr learned my addr 172.21.15.5:0/366843956 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:12.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.964+0000 7f36effff640 1 --2- 172.21.15.5:0/366843956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36f00c8db0 0x7f36f00c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:12.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.964+0000 7f36ef7fe640 1 -- 172.21.15.5:0/366843956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36f00c8db0 msgr2=0x7f36f00c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:12.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.964+0000 7f36ef7fe640 1 --2- 172.21.15.5:0/366843956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36f00c8db0 0x7f36f00c9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:12.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.964+0000 7f36ef7fe640 1 -- 172.21.15.5:0/366843956 >> v1:172.21.15.154:6789/0 conn(0x7f36f015c2a0 legacy=0x7f36f015c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:12.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.964+0000 7f36ef7fe640 1 -- 172.21.15.5:0/366843956 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f015d010 con 0x7f36f00af8b0 2023-07-14T13:11:13.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.964+0000 7f36ef7fe640 1 --2- 172.21.15.5:0/366843956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f00af8b0 0x7f36f00afc80 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f36e000bb10 tx=0x7f36e001eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e265037f2208ad3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:13.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.964+0000 7f36ee7fc640 1 -- 172.21.15.5:0/366843956 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e00a7bd0 con 0x7f36f00af8b0 2023-07-14T13:11:13.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.964+0000 7f36ee7fc640 1 -- 172.21.15.5:0/366843956 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e00a7d30 con 0x7f36f00af8b0 2023-07-14T13:11:13.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.964+0000 7f36ee7fc640 1 -- 172.21.15.5:0/366843956 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e00a7ea0 con 0x7f36f00af8b0 2023-07-14T13:11:13.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.964+0000 7f36f4ad5640 1 -- 172.21.15.5:0/366843956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f00af8b0 msgr2=0x7f36f00afc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:13.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.964+0000 7f36f4ad5640 1 --2- 172.21.15.5:0/366843956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f00af8b0 0x7f36f00afc80 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f36e000bb10 tx=0x7f36e001eb40 comp rx=0 tx=0).stop 2023-07-14T13:11:13.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.968+0000 7f36f4ad5640 1 -- 172.21.15.5:0/366843956 shutdown_connections 2023-07-14T13:11:13.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.968+0000 7f36f4ad5640 1 --2- 172.21.15.5:0/366843956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36f00c8db0 0x7f36f00c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:13.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.968+0000 7f36f4ad5640 1 --2- 172.21.15.5:0/366843956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f00af8b0 0x7f36f00afc80 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:13.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.968+0000 7f36f4ad5640 1 -- 172.21.15.5:0/366843956 >> 172.21.15.5:0/366843956 conn(0x7f36f00ca8b0 msgr2=0x7f36f00cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:13.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.968+0000 7f36f4ad5640 1 -- 172.21.15.5:0/366843956 shutdown_connections 2023-07-14T13:11:13.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.968+0000 7f36f4ad5640 1 -- 172.21.15.5:0/366843956 wait complete. 2023-07-14T13:11:13.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.968+0000 7f36f4ad5640 1 Processor -- start 2023-07-14T13:11:13.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.968+0000 7f36f4ad5640 1 -- start start 2023-07-14T13:11:13.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.968+0000 7f36f4ad5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36f00af8b0 0x7f36f00b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:13.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.968+0000 7f36f4ad5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36f00c8db0 0x7f36f006c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:13.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.968+0000 7f36f4ad5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f015c2a0 0x7f36f014de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:13.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.968+0000 7f36f4ad5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f006b5f0 con 0x7f36f015c2a0 2023-07-14T13:11:13.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.968+0000 7f36f4ad5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f006b8b0 con 0x7f36f00af8b0 2023-07-14T13:11:13.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.968+0000 7f36f4ad5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f006bb90 con 0x7f36f00c8db0 2023-07-14T13:11:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.968+0000 7f36effff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f015c2a0 0x7f36f014de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.968+0000 7f36ef7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36f00af8b0 0x7f36f00b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.968+0000 7f36effff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f015c2a0 0x7f36f014de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35672/0 (socket says 172.21.15.5:35672) 2023-07-14T13:11:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.968+0000 7f36effff640 1 -- 172.21.15.5:0/1601617800 learned_addr learned my addr 172.21.15.5:0/1601617800 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.968+0000 7f36eeffd640 1 --2- 172.21.15.5:0/1601617800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36f00c8db0 0x7f36f006c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.968+0000 7f36effff640 1 -- 172.21.15.5:0/1601617800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36f00c8db0 msgr2=0x7f36f006c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.968+0000 7f36effff640 1 --2- 172.21.15.5:0/1601617800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36f00c8db0 0x7f36f006c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.968+0000 7f36effff640 1 -- 172.21.15.5:0/1601617800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36f00af8b0 msgr2=0x7f36f00b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:13.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.968+0000 7f36effff640 1 --2- 172.21.15.5:0/1601617800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36f00af8b0 0x7f36f00b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:13.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.968+0000 7f36effff640 1 -- 172.21.15.5:0/1601617800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e000b770 con 0x7f36f015c2a0 2023-07-14T13:11:13.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.968+0000 7f36ef7fe640 1 --2- 172.21.15.5:0/1601617800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36f00af8b0 0x7f36f00b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:11:13.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.968+0000 7f36eeffd640 1 --2- 172.21.15.5:0/1601617800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36f00c8db0 0x7f36f006c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:11:13.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.972+0000 7f36effff640 1 --2- 172.21.15.5:0/1601617800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f015c2a0 0x7f36f014de20 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f36e8007e40 tx=0x7f36e800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:13.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.972+0000 7f36d7fff640 1 -- 172.21.15.5:0/1601617800 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e8014620 con 0x7f36f015c2a0 2023-07-14T13:11:13.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.972+0000 7f36d7fff640 1 -- 172.21.15.5:0/1601617800 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e800ee90 con 0x7f36f015c2a0 2023-07-14T13:11:13.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.972+0000 7f36d7fff640 1 -- 172.21.15.5:0/1601617800 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e80149e0 con 0x7f36f015c2a0 2023-07-14T13:11:13.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.972+0000 7f36f4ad5640 1 -- 172.21.15.5:0/1601617800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f006be70 con 0x7f36f015c2a0 2023-07-14T13:11:13.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.972+0000 7f36f4ad5640 1 -- 172.21.15.5:0/1601617800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f006c430 con 0x7f36f015c2a0 2023-07-14T13:11:13.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.972+0000 7f36f4ad5640 1 -- 172.21.15.5:0/1601617800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f00b3e40 con 0x7f36f015c2a0 2023-07-14T13:11:13.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.972+0000 7f36d7fff640 1 -- 172.21.15.5:0/1601617800 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 51) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f36e8014b40 con 0x7f36f015c2a0 2023-07-14T13:11:13.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.972+0000 7f36d7fff640 1 -- 172.21.15.5:0/1601617800 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6952+0+0 (secure 0 0 0) 0x7f36e8084390 con 0x7f36f015c2a0 2023-07-14T13:11:13.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:12.976+0000 7f36d7fff640 1 -- 172.21.15.5:0/1601617800 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f36e8051990 con 0x7f36f015c2a0 2023-07-14T13:11:13.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.132+0000 7f36f4ad5640 1 -- 172.21.15.5:0/1601617800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f36f00cc0f0 con 0x7f36f015c2a0 2023-07-14T13:11:13.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.132+0000 7f36d7fff640 1 -- 172.21.15.5:0/1601617800 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v115) v1 ==== 104+0+11 (secure 0 0 0) 0x7f36e8054fb0 con 0x7f36f015c2a0 2023-07-14T13:11:13.169 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T13:11:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.136+0000 7f36f4ad5640 1 -- 172.21.15.5:0/1601617800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f015c2a0 msgr2=0x7f36f014de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.136+0000 7f36f4ad5640 1 --2- 172.21.15.5:0/1601617800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f015c2a0 0x7f36f014de20 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f36e8007e40 tx=0x7f36e800e4b0 comp rx=0 tx=0).stop 2023-07-14T13:11:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.136+0000 7f36f4ad5640 1 -- 172.21.15.5:0/1601617800 shutdown_connections 2023-07-14T13:11:13.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.136+0000 7f36f4ad5640 1 --2- 172.21.15.5:0/1601617800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36f015c2a0 0x7f36f014de20 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:13.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.136+0000 7f36f4ad5640 1 --2- 172.21.15.5:0/1601617800 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36f00c8db0 0x7f36f006c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:13.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.136+0000 7f36f4ad5640 1 --2- 172.21.15.5:0/1601617800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36f00af8b0 0x7f36f00b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:13.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.136+0000 7f36f4ad5640 1 -- 172.21.15.5:0/1601617800 >> 172.21.15.5:0/1601617800 conn(0x7f36f00ca8b0 msgr2=0x7f36f00cac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:13.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.136+0000 7f36f4ad5640 1 -- 172.21.15.5:0/1601617800 shutdown_connections 2023-07-14T13:11:13.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.136+0000 7f36f4ad5640 1 -- 172.21.15.5:0/1601617800 wait complete. 2023-07-14T13:11:13.189 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T13:11:13.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.344+0000 7fdc128ec640 1 Processor -- start 2023-07-14T13:11:13.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.344+0000 7fdc128ec640 1 -- start start 2023-07-14T13:11:13.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.344+0000 7fdc128ec640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc0c069430 0x7fdc0c069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:13.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.344+0000 7fdc128ec640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdc0c0af2b0 0x7fdc0c15a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:13.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.344+0000 7fdc128ec640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc0c159d70 con 0x7fdc0c070f30 2023-07-14T13:11:13.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.344+0000 7fdc128ec640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc0c069d40 con 0x7fdc0c0af2b0 2023-07-14T13:11:13.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.344+0000 7fdc128ec640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c0c9c60 con 0x7fdc0c069430 2023-07-14T13:11:13.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.348+0000 7fdc10e89640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdc0c0af2b0 0x7fdc0c15a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:13.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.348+0000 7fdc10e89640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdc0c0af2b0 0x7fdc0c15a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35682/0 (socket says 172.21.15.5:35682) 2023-07-14T13:11:13.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.348+0000 7fdc0bfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc0c069430 0x7fdc0c069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:13.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.348+0000 7fdc10e89640 1 -- 172.21.15.5:0/1565161917 learned_addr learned my addr 172.21.15.5:0/1565161917 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:13.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.348+0000 7fdc10e89640 1 -- 172.21.15.5:0/1565161917 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc0c069430 msgr2=0x7fdc0c069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:13.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.348+0000 7fdc10e89640 1 --2- 172.21.15.5:0/1565161917 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc0c069430 0x7fdc0c069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:13.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.348+0000 7fdc10e89640 1 -- 172.21.15.5:0/1565161917 >> v1:172.21.15.154:6789/0 conn(0x7fdc0c070f30 legacy=0x7fdc0c0ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:13.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.348+0000 7fdc10e89640 1 -- 172.21.15.5:0/1565161917 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0c0c9f40 con 0x7fdc0c0af2b0 2023-07-14T13:11:13.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.348+0000 7fdc10e89640 1 --2- 172.21.15.5:0/1565161917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc0c0af2b0 0x7fdc0c15a1f0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009e50 tx=0x7fdc0401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48236f2ffc250478 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:13.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.348+0000 7fdc0affd640 1 -- 172.21.15.5:0/1565161917 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc040a57f0 con 0x7fdc0c0af2b0 2023-07-14T13:11:13.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.348+0000 7fdc0affd640 1 -- 172.21.15.5:0/1565161917 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc040a5950 con 0x7fdc0c0af2b0 2023-07-14T13:11:13.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.348+0000 7fdc0affd640 1 -- 172.21.15.5:0/1565161917 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc040a5ce0 con 0x7fdc0c0af2b0 2023-07-14T13:11:13.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.352+0000 7fdc128ec640 1 -- 172.21.15.5:0/1565161917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc0c0af2b0 msgr2=0x7fdc0c15a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:13.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.352+0000 7fdc128ec640 1 --2- 172.21.15.5:0/1565161917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc0c0af2b0 0x7fdc0c15a1f0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009e50 tx=0x7fdc0401ca10 comp rx=0 tx=0).stop 2023-07-14T13:11:13.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.352+0000 7fdc128ec640 1 -- 172.21.15.5:0/1565161917 shutdown_connections 2023-07-14T13:11:13.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.352+0000 7fdc128ec640 1 --2- 172.21.15.5:0/1565161917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc0c0af2b0 0x7fdc0c15a1f0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:13.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.352+0000 7fdc128ec640 1 --2- 172.21.15.5:0/1565161917 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc0c069430 0x7fdc0c069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:13.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.352+0000 7fdc128ec640 1 -- 172.21.15.5:0/1565161917 >> 172.21.15.5:0/1565161917 conn(0x7fdc0c0cde90 msgr2=0x7fdc0c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:13.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.352+0000 7fdc128ec640 1 -- 172.21.15.5:0/1565161917 shutdown_connections 2023-07-14T13:11:13.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.352+0000 7fdc128ec640 1 -- 172.21.15.5:0/1565161917 wait complete. 2023-07-14T13:11:13.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.352+0000 7fdc128ec640 1 Processor -- start 2023-07-14T13:11:13.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.352+0000 7fdc128ec640 1 -- start start 2023-07-14T13:11:13.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.352+0000 7fdc128ec640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc0c069430 0x7fdc0c0ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:13.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.352+0000 7fdc128ec640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc0c070f30 0x7fdc0c06c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:13.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.352+0000 7fdc128ec640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc0c0af2b0 0x7fdc0c06c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:13.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.352+0000 7fdc128ec640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c06b190 con 0x7fdc0c070f30 2023-07-14T13:11:13.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.352+0000 7fdc128ec640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c06b430 con 0x7fdc0c0af2b0 2023-07-14T13:11:13.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.352+0000 7fdc128ec640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c06b710 con 0x7fdc0c069430 2023-07-14T13:11:13.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.352+0000 7fdc0b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc0c070f30 0x7fdc0c06c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:13.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.352+0000 7fdc0b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc0c070f30 0x7fdc0c06c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35692/0 (socket says 172.21.15.5:35692) 2023-07-14T13:11:13.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.352+0000 7fdc0bfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc0c069430 0x7fdc0c0ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:13.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.352+0000 7fdc0b7fe640 1 -- 172.21.15.5:0/2299891021 learned_addr learned my addr 172.21.15.5:0/2299891021 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:13.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.352+0000 7fdc10e89640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc0c0af2b0 0x7fdc0c06c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:13.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.352+0000 7fdc0b7fe640 1 -- 172.21.15.5:0/2299891021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc0c069430 msgr2=0x7fdc0c0ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:13.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.352+0000 7fdc0b7fe640 1 --2- 172.21.15.5:0/2299891021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc0c069430 0x7fdc0c0ab890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:13.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.352+0000 7fdc0b7fe640 1 -- 172.21.15.5:0/2299891021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc0c0af2b0 msgr2=0x7fdc0c06c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:13.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.352+0000 7fdc0b7fe640 1 --2- 172.21.15.5:0/2299891021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc0c0af2b0 0x7fdc0c06c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:13.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.352+0000 7fdc0b7fe640 1 -- 172.21.15.5:0/2299891021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc04009b30 con 0x7fdc0c070f30 2023-07-14T13:11:13.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.356+0000 7fdc0b7fe640 1 --2- 172.21.15.5:0/2299891021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc0c070f30 0x7fdc0c06c1f0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fdc0000c3c0 tx=0x7fdc0000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:13.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.356+0000 7fdc08ff9640 1 -- 172.21.15.5:0/2299891021 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc000052d0 con 0x7fdc0c070f30 2023-07-14T13:11:13.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.356+0000 7fdc08ff9640 1 -- 172.21.15.5:0/2299891021 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc00005430 con 0x7fdc0c070f30 2023-07-14T13:11:13.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.356+0000 7fdc128ec640 1 -- 172.21.15.5:0/2299891021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc0c06b9f0 con 0x7fdc0c070f30 2023-07-14T13:11:13.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.356+0000 7fdc08ff9640 1 -- 172.21.15.5:0/2299891021 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc00003840 con 0x7fdc0c070f30 2023-07-14T13:11:13.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.356+0000 7fdc128ec640 1 -- 172.21.15.5:0/2299891021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0c0abdd0 con 0x7fdc0c070f30 2023-07-14T13:11:13.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.356+0000 7fdc128ec640 1 -- 172.21.15.5:0/2299891021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc0c0ac020 con 0x7fdc0c070f30 2023-07-14T13:11:13.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.356+0000 7fdc08ff9640 1 -- 172.21.15.5:0/2299891021 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 51) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fdc000039a0 con 0x7fdc0c070f30 2023-07-14T13:11:13.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.356+0000 7fdc08ff9640 1 -- 172.21.15.5:0/2299891021 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6952+0+0 (secure 0 0 0) 0x7fdc00082ec0 con 0x7fdc0c070f30 2023-07-14T13:11:13.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.360+0000 7fdc08ff9640 1 -- 172.21.15.5:0/2299891021 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fdc000503d0 con 0x7fdc0c070f30 2023-07-14T13:11:13.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.512+0000 7fdc128ec640 1 -- 172.21.15.5:0/2299891021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdc0c159d70 con 0x7fdc0c070f30 2023-07-14T13:11:13.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.512+0000 7fdc08ff9640 1 -- 172.21.15.5:0/2299891021 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v115) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdc0c159d70 con 0x7fdc0c070f30 2023-07-14T13:11:13.549 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T13:11:13.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.516+0000 7fdc128ec640 1 -- 172.21.15.5:0/2299891021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc0c070f30 msgr2=0x7fdc0c06c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:13.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.516+0000 7fdc128ec640 1 --2- 172.21.15.5:0/2299891021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc0c070f30 0x7fdc0c06c1f0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fdc0000c3c0 tx=0x7fdc0000c880 comp rx=0 tx=0).stop 2023-07-14T13:11:13.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.516+0000 7fdc128ec640 1 -- 172.21.15.5:0/2299891021 shutdown_connections 2023-07-14T13:11:13.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.516+0000 7fdc128ec640 1 --2- 172.21.15.5:0/2299891021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc0c0af2b0 0x7fdc0c06c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:13.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.516+0000 7fdc128ec640 1 --2- 172.21.15.5:0/2299891021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc0c070f30 0x7fdc0c06c1f0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:13.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.516+0000 7fdc128ec640 1 --2- 172.21.15.5:0/2299891021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc0c069430 0x7fdc0c0ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:13.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.516+0000 7fdc128ec640 1 -- 172.21.15.5:0/2299891021 >> 172.21.15.5:0/2299891021 conn(0x7fdc0c0cde90 msgr2=0x7fdc0c155a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:13.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.516+0000 7fdc128ec640 1 -- 172.21.15.5:0/2299891021 shutdown_connections 2023-07-14T13:11:13.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.516+0000 7fdc128ec640 1 -- 172.21.15.5:0/2299891021 wait complete. 2023-07-14T13:11:13.570 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:11:13.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.684+0000 7fe230f37640 1 Processor -- start 2023-07-14T13:11:13.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.684+0000 7fe230f37640 1 -- start start 2023-07-14T13:11:13.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.684+0000 7fe230f37640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe22c0b7c70 0x7fe22c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.684+0000 7fe230f37640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22c0ccaf0 con 0x7fe22c15fd60 2023-07-14T13:11:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.684+0000 7fe230f37640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22c160320 con 0x7fe22c0d1850 2023-07-14T13:11:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.684+0000 7fe230f37640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c0d1190 con 0x7fe22c0b7c70 2023-07-14T13:11:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.684+0000 7fe22ad9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe22c15fd60 0x7fe22c0d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43826/0 (socket says 172.21.15.5:43826) 2023-07-14T13:11:13.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.684+0000 7fe22ad9d640 1 -- 172.21.15.5:0/68127734 learned_addr learned my addr 172.21.15.5:0/68127734 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:13.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.684+0000 7fe22a59c640 1 --2- 172.21.15.5:0/68127734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe22c0b7c70 0x7fe22c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:13.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.684+0000 7fe229d9b640 1 -- 172.21.15.5:0/68127734 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3151783115 0 0) 0x7fe22c0ccaf0 con 0x7fe22c15fd60 2023-07-14T13:11:13.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.684+0000 7fe229d9b640 1 -- 172.21.15.5:0/68127734 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe218003530 con 0x7fe22c15fd60 2023-07-14T13:11:13.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.688+0000 7fe229d9b640 1 -- 172.21.15.5:0/68127734 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 748155242 0 0) 0x7fe218003530 con 0x7fe22c15fd60 2023-07-14T13:11:13.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.688+0000 7fe229d9b640 1 -- 172.21.15.5:0/68127734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe22c0b7c70 msgr2=0x7fe22c0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:13.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.688+0000 7fe229d9b640 1 --2- 172.21.15.5:0/68127734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe22c0b7c70 0x7fe22c0d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:13.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.688+0000 7fe229d9b640 1 -- 172.21.15.5:0/68127734 >> v1:172.21.15.154:6789/0 conn(0x7fe22c0d1850 legacy=0x7fe22c15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:13.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.688+0000 7fe229d9b640 1 -- 172.21.15.5:0/68127734 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22c0ccd90 con 0x7fe22c15fd60 2023-07-14T13:11:13.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.688+0000 7fe229d9b640 1 -- 172.21.15.5:0/68127734 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7fe224001a00 con 0x7fe22c15fd60 2023-07-14T13:11:13.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.688+0000 7fe229d9b640 1 -- 172.21.15.5:0/68127734 >> v1:172.21.15.5:6789/0 conn(0x7fe22c15fd60 legacy=0x7fe22c0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:13.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.688+0000 7fe229d9b640 1 --2- 172.21.15.5:0/68127734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe22c0b7c70 0x7fe2180039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:13.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.688+0000 7fe229d9b640 1 --2- 172.21.15.5:0/68127734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe218003ef0 0x7fe2180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:13.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.688+0000 7fe229d9b640 1 --2- 172.21.15.5:0/68127734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe218004d10 0x7fe218005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:13.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.688+0000 7fe229d9b640 1 -- 172.21.15.5:0/68127734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21800b990 con 0x7fe218003ef0 2023-07-14T13:11:13.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.688+0000 7fe229d9b640 1 -- 172.21.15.5:0/68127734 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21800bb00 con 0x7fe218004d10 2023-07-14T13:11:13.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.688+0000 7fe229d9b640 1 -- 172.21.15.5:0/68127734 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21800bcc0 con 0x7fe22c0b7c70 2023-07-14T13:11:13.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.688+0000 7fe223fff640 1 --2- 172.21.15.5:0/68127734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe218003ef0 0x7fe2180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:13.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.688+0000 7fe22a59c640 1 --2- 172.21.15.5:0/68127734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe22c0b7c70 0x7fe2180039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:13.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.688+0000 7fe22ad9d640 1 --2- 172.21.15.5:0/68127734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe218004d10 0x7fe218005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:13.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.688+0000 7fe223fff640 1 -- 172.21.15.5:0/68127734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe22c0b7c70 msgr2=0x7fe2180039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:13.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.688+0000 7fe223fff640 1 --2- 172.21.15.5:0/68127734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe22c0b7c70 0x7fe2180039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:13.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.688+0000 7fe223fff640 1 -- 172.21.15.5:0/68127734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe218004d10 msgr2=0x7fe218005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:13.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.688+0000 7fe223fff640 1 --2- 172.21.15.5:0/68127734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe218004d10 0x7fe218005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:13.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.688+0000 7fe223fff640 1 -- 172.21.15.5:0/68127734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe218003530 con 0x7fe218003ef0 2023-07-14T13:11:13.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.688+0000 7fe22ad9d640 1 --2- 172.21.15.5:0/68127734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe218004d10 0x7fe218005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:11:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.688+0000 7fe223fff640 1 --2- 172.21.15.5:0/68127734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe218003ef0 0x7fe2180047d0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fe214001910 tx=0x7fe21401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ad4b948fc69a74 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.688+0000 7fe229d9b640 1 -- 172.21.15.5:0/68127734 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2140ab600 con 0x7fe218003ef0 2023-07-14T13:11:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.688+0000 7fe229d9b640 1 -- 172.21.15.5:0/68127734 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2140a7050 con 0x7fe218003ef0 2023-07-14T13:11:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.688+0000 7fe229d9b640 1 -- 172.21.15.5:0/68127734 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2140ab9c0 con 0x7fe218003ef0 2023-07-14T13:11:13.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.692+0000 7fe230f37640 1 -- 172.21.15.5:0/68127734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe218003ef0 msgr2=0x7fe2180047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:13.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.692+0000 7fe230f37640 1 --2- 172.21.15.5:0/68127734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe218003ef0 0x7fe2180047d0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fe214001910 tx=0x7fe21401c540 comp rx=0 tx=0).stop 2023-07-14T13:11:13.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.692+0000 7fe22ad9d640 1 -- 172.21.15.5:0/68127734 reap_dead start 2023-07-14T13:11:13.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.692+0000 7fe230f37640 1 -- 172.21.15.5:0/68127734 shutdown_connections 2023-07-14T13:11:13.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.692+0000 7fe230f37640 1 -- 172.21.15.5:0/68127734 >> 172.21.15.5:0/68127734 conn(0x7fe22c0650b0 msgr2=0x7fe22c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:13.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.692+0000 7fe230f37640 1 -- 172.21.15.5:0/68127734 shutdown_connections 2023-07-14T13:11:13.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.692+0000 7fe230f37640 1 -- 172.21.15.5:0/68127734 wait complete. 2023-07-14T13:11:13.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.692+0000 7fe230f37640 1 Processor -- start 2023-07-14T13:11:13.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.692+0000 7fe230f37640 1 -- start start 2023-07-14T13:11:13.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.692+0000 7fe230f37640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe22c14f310 0x7fe22c1f5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:13.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.692+0000 7fe230f37640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe22c1f5b70 0x7fe22c1f4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:13.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.692+0000 7fe230f37640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe22c1f49b0 0x7fe22c166910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:13.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.692+0000 7fe230f37640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c14fab0 con 0x7fe22c1f5b70 2023-07-14T13:11:13.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.692+0000 7fe230f37640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c1f4fa0 con 0x7fe22c14f310 2023-07-14T13:11:13.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.692+0000 7fe230f37640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c1f5280 con 0x7fe22c1f49b0 2023-07-14T13:11:13.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.692+0000 7fe223fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe22c1f5b70 0x7fe22c1f4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:13.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.692+0000 7fe223fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe22c1f5b70 0x7fe22c1f4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35708/0 (socket says 172.21.15.5:35708) 2023-07-14T13:11:13.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.692+0000 7fe223fff640 1 -- 172.21.15.5:0/4006894364 learned_addr learned my addr 172.21.15.5:0/4006894364 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:13.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.692+0000 7fe22ad9d640 1 --2- 172.21.15.5:0/4006894364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe22c1f49b0 0x7fe22c166910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:13.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.692+0000 7fe22a59c640 1 --2- 172.21.15.5:0/4006894364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe22c14f310 0x7fe22c1f5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:13.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.696+0000 7fe223fff640 1 -- 172.21.15.5:0/4006894364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe22c1f49b0 msgr2=0x7fe22c166910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:13.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.696+0000 7fe223fff640 1 --2- 172.21.15.5:0/4006894364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe22c1f49b0 0x7fe22c166910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:13.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.696+0000 7fe223fff640 1 -- 172.21.15.5:0/4006894364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe22c14f310 msgr2=0x7fe22c1f5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:13.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.696+0000 7fe223fff640 1 --2- 172.21.15.5:0/4006894364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe22c14f310 0x7fe22c1f5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:13.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.696+0000 7fe223fff640 1 -- 172.21.15.5:0/4006894364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22c14fcc0 con 0x7fe22c1f5b70 2023-07-14T13:11:13.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.696+0000 7fe223fff640 1 --2- 172.21.15.5:0/4006894364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe22c1f5b70 0x7fe22c1f4470 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fe21401c370 tx=0x7fe218005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:13.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.696+0000 7fe222ffd640 1 -- 172.21.15.5:0/4006894364 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe214003b10 con 0x7fe22c1f5b70 2023-07-14T13:11:13.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.696+0000 7fe222ffd640 1 -- 172.21.15.5:0/4006894364 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe214003c70 con 0x7fe22c1f5b70 2023-07-14T13:11:13.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.696+0000 7fe222ffd640 1 -- 172.21.15.5:0/4006894364 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2140067e0 con 0x7fe22c1f5b70 2023-07-14T13:11:13.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.696+0000 7fe230f37640 1 -- 172.21.15.5:0/4006894364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22c14ffa0 con 0x7fe22c1f5b70 2023-07-14T13:11:13.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.696+0000 7fe230f37640 1 -- 172.21.15.5:0/4006894364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22c14f6e0 con 0x7fe22c1f5b70 2023-07-14T13:11:13.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.696+0000 7fe230f37640 1 -- 172.21.15.5:0/4006894364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe22c0c9220 con 0x7fe22c1f5b70 2023-07-14T13:11:13.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.696+0000 7fe222ffd640 1 -- 172.21.15.5:0/4006894364 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 52) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fe2140b2040 con 0x7fe22c1f5b70 2023-07-14T13:11:13.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.696+0000 7fe222ffd640 1 --2- 172.21.15.5:0/4006894364 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe20c0660d0 0x7fe20c068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:13.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.696+0000 7fe222ffd640 1 -- 172.21.15.5:0/4006894364 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6952+0+0 (secure 0 0 0) 0x7fe21411c8f0 con 0x7fe22c1f5b70 2023-07-14T13:11:13.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.696+0000 7fe22a59c640 1 --2- 172.21.15.5:0/4006894364 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe20c0660d0 0x7fe20c068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:13.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.700+0000 7fe22a59c640 1 --2- 172.21.15.5:0/4006894364 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe20c0660d0 0x7fe20c068580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0b3840 tx=0x7fe21c009190 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:13.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.700+0000 7fe222ffd640 1 -- 172.21.15.5:0/4006894364 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe2140e9d20 con 0x7fe22c1f5b70 2023-07-14T13:11:13.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.896+0000 7fe230f37640 1 -- 172.21.15.5:0/4006894364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe22c150130 con 0x7fe22c1f5b70 2023-07-14T13:11:13.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.896+0000 7fe222ffd640 1 -- 172.21.15.5:0/4006894364 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4705 (secure 0 0 0) 0x7fe2140ed340 con 0x7fe22c1f5b70 2023-07-14T13:11:13.934 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:11:13.934 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6575,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1957957644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1957957644},{"type":"v1","addr":"172.21.15.5:6835","nonce":1957957644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3439623726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3439623726},{"type":"v1","addr":"172.21.15.154:6837","nonce":3439623726}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7384,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/692576619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":692576619},{"type":"v1","addr":"172.21.15.154:6836","nonce":692576619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:09:48.156588+0000","modified":"2023-07-14T13:09:51.784254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7668},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7668":{"gid":7668,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/855157103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":855157103},{"type":"v1","addr":"172.21.15.5:6834","nonce":855157103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-14T13:11:13.934 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 49 2023-07-14T13:11:13.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.900+0000 7fe230f37640 1 -- 172.21.15.5:0/4006894364 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe20c0660d0 msgr2=0x7fe20c068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:13.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.900+0000 7fe230f37640 1 --2- 172.21.15.5:0/4006894364 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe20c0660d0 0x7fe20c068580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0b3840 tx=0x7fe21c009190 comp rx=0 tx=0).stop 2023-07-14T13:11:13.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.900+0000 7fe230f37640 1 -- 172.21.15.5:0/4006894364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe22c1f5b70 msgr2=0x7fe22c1f4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:13.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.900+0000 7fe230f37640 1 --2- 172.21.15.5:0/4006894364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe22c1f5b70 0x7fe22c1f4470 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fe21401c370 tx=0x7fe218005800 comp rx=0 tx=0).stop 2023-07-14T13:11:13.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.900+0000 7fe230f37640 1 -- 172.21.15.5:0/4006894364 shutdown_connections 2023-07-14T13:11:13.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.900+0000 7fe230f37640 1 --2- 172.21.15.5:0/4006894364 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe20c0660d0 0x7fe20c068580 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:13.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.900+0000 7fe230f37640 1 --2- 172.21.15.5:0/4006894364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe22c1f49b0 0x7fe22c166910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:13.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.900+0000 7fe230f37640 1 --2- 172.21.15.5:0/4006894364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe22c1f5b70 0x7fe22c1f4470 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:13.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.900+0000 7fe230f37640 1 --2- 172.21.15.5:0/4006894364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe22c14f310 0x7fe22c1f5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:13.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.900+0000 7fe230f37640 1 -- 172.21.15.5:0/4006894364 >> 172.21.15.5:0/4006894364 conn(0x7fe22c0650b0 msgr2=0x7fe22c0b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:13.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.900+0000 7fe230f37640 1 -- 172.21.15.5:0/4006894364 shutdown_connections 2023-07-14T13:11:13.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:13.900+0000 7fe230f37640 1 -- 172.21.15.5:0/4006894364 wait complete. 2023-07-14T13:11:13.955 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:11:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.064+0000 7f5fd3a48640 1 Processor -- start 2023-07-14T13:11:14.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.064+0000 7f5fd3a48640 1 -- start start 2023-07-14T13:11:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.064+0000 7f5fd3a48640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5fcc158ce0 0x7f5fcc070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.064+0000 7f5fd3a48640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fcc0c9730 0x7f5fcc0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.064+0000 7f5fd3a48640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fcc0cc700 con 0x7f5fcc0c8ad0 2023-07-14T13:11:14.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.064+0000 7f5fd3a48640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fcc0b0ff0 con 0x7f5fcc158ce0 2023-07-14T13:11:14.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.064+0000 7f5fd3a48640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc070c80 con 0x7f5fcc0c9730 2023-07-14T13:11:14.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.064+0000 7f5fd17e4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5fcc158ce0 0x7f5fcc070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:14.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.064+0000 7f5fd17e4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5fcc158ce0 0x7f5fcc070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35722/0 (socket says 172.21.15.5:35722) 2023-07-14T13:11:14.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.064+0000 7f5fd17e4640 1 -- 172.21.15.5:0/3988493380 learned_addr learned my addr 172.21.15.5:0/3988493380 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:14.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.064+0000 7f5fd1fe5640 1 --2- 172.21.15.5:0/3988493380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fcc0c9730 0x7f5fcc0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.064+0000 7f5fd17e4640 1 -- 172.21.15.5:0/3988493380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fcc0c9730 msgr2=0x7f5fcc0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.064+0000 7f5fd17e4640 1 --2- 172.21.15.5:0/3988493380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fcc0c9730 0x7f5fcc0ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.064+0000 7f5fd17e4640 1 -- 172.21.15.5:0/3988493380 >> v1:172.21.15.154:6789/0 conn(0x7f5fcc0c8ad0 legacy=0x7f5fcc0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:14.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.064+0000 7f5fd17e4640 1 -- 172.21.15.5:0/3988493380 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc0cbdd0 con 0x7f5fcc158ce0 2023-07-14T13:11:14.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.068+0000 7f5fd17e4640 1 --2- 172.21.15.5:0/3988493380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fcc158ce0 0x7f5fcc070450 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009870 tx=0x7f5fc801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0ffc50cabfd4a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:14.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.068+0000 7f5fc3fff640 1 -- 172.21.15.5:0/3988493380 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc80ab600 con 0x7f5fcc158ce0 2023-07-14T13:11:14.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.068+0000 7f5fc3fff640 1 -- 172.21.15.5:0/3988493380 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc80a7050 con 0x7f5fcc158ce0 2023-07-14T13:11:14.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.068+0000 7f5fc3fff640 1 -- 172.21.15.5:0/3988493380 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc80ab980 con 0x7f5fcc158ce0 2023-07-14T13:11:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.068+0000 7f5fd3a48640 1 -- 172.21.15.5:0/3988493380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fcc158ce0 msgr2=0x7f5fcc070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.068+0000 7f5fd3a48640 1 --2- 172.21.15.5:0/3988493380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fcc158ce0 0x7f5fcc070450 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009870 tx=0x7f5fc801c3f0 comp rx=0 tx=0).stop 2023-07-14T13:11:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.068+0000 7f5fd3a48640 1 -- 172.21.15.5:0/3988493380 shutdown_connections 2023-07-14T13:11:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.068+0000 7f5fd3a48640 1 --2- 172.21.15.5:0/3988493380 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fcc0c9730 0x7f5fcc0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.068+0000 7f5fd3a48640 1 --2- 172.21.15.5:0/3988493380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fcc158ce0 0x7f5fcc070450 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:14.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.068+0000 7f5fd3a48640 1 -- 172.21.15.5:0/3988493380 >> 172.21.15.5:0/3988493380 conn(0x7f5fcc0afcf0 msgr2=0x7f5fcc0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.068+0000 7f5fd3a48640 1 -- 172.21.15.5:0/3988493380 shutdown_connections 2023-07-14T13:11:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.068+0000 7f5fd3a48640 1 -- 172.21.15.5:0/3988493380 wait complete. 2023-07-14T13:11:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.072+0000 7f5fd3a48640 1 Processor -- start 2023-07-14T13:11:14.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.072+0000 7f5fd3a48640 1 -- start start 2023-07-14T13:11:14.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.072+0000 7f5fd3a48640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fcc0c8ad0 0x7f5fcc14f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:14.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.072+0000 7f5fd3a48640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fcc0c9730 0x7f5fcc0b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:14.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.072+0000 7f5fd3a48640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fcc158ce0 0x7f5fcc0b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:14.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.072+0000 7f5fd3a48640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc1f5290 con 0x7f5fcc158ce0 2023-07-14T13:11:14.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.072+0000 7f5fd3a48640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc14fad0 con 0x7f5fcc0c9730 2023-07-14T13:11:14.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.072+0000 7f5fd3a48640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc1f4270 con 0x7f5fcc0c8ad0 2023-07-14T13:11:14.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.072+0000 7f5fd1fe5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fcc158ce0 0x7f5fcc0b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:14.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.072+0000 7f5fd1fe5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fcc158ce0 0x7f5fcc0b2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35728/0 (socket says 172.21.15.5:35728) 2023-07-14T13:11:14.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.072+0000 7f5fd1fe5640 1 -- 172.21.15.5:0/2093902796 learned_addr learned my addr 172.21.15.5:0/2093902796 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:14.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.072+0000 7f5fd17e4640 1 --2- 172.21.15.5:0/2093902796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fcc0c8ad0 0x7f5fcc14f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:14.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.072+0000 7f5fd0fe3640 1 --2- 172.21.15.5:0/2093902796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fcc0c9730 0x7f5fcc0b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.072+0000 7f5fd1fe5640 1 -- 172.21.15.5:0/2093902796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fcc0c8ad0 msgr2=0x7f5fcc14f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.072+0000 7f5fd1fe5640 1 --2- 172.21.15.5:0/2093902796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fcc0c8ad0 0x7f5fcc14f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.072+0000 7f5fd1fe5640 1 -- 172.21.15.5:0/2093902796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fcc0c9730 msgr2=0x7f5fcc0b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.072+0000 7f5fd1fe5640 1 --2- 172.21.15.5:0/2093902796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fcc0c9730 0x7f5fcc0b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.072+0000 7f5fd1fe5640 1 -- 172.21.15.5:0/2093902796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc80094d0 con 0x7f5fcc158ce0 2023-07-14T13:11:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.072+0000 7f5fd1fe5640 1 --2- 172.21.15.5:0/2093902796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fcc158ce0 0x7f5fcc0b2350 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f5fc400efc0 tx=0x7f5fc400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.072+0000 7f5fc1ffb640 1 -- 172.21.15.5:0/2093902796 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4009ca0 con 0x7f5fcc158ce0 2023-07-14T13:11:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.072+0000 7f5fc1ffb640 1 -- 172.21.15.5:0/2093902796 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc400f040 con 0x7f5fcc158ce0 2023-07-14T13:11:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.072+0000 7f5fc1ffb640 1 -- 172.21.15.5:0/2093902796 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc40146c0 con 0x7f5fcc158ce0 2023-07-14T13:11:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.072+0000 7f5fd3a48640 1 -- 172.21.15.5:0/2093902796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fcc1f44d0 con 0x7f5fcc158ce0 2023-07-14T13:11:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.072+0000 7f5fd3a48640 1 -- 172.21.15.5:0/2093902796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fcc1f4a90 con 0x7f5fcc158ce0 2023-07-14T13:11:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.076+0000 7f5fd3a48640 1 -- 172.21.15.5:0/2093902796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fcc0ca1a0 con 0x7f5fcc158ce0 2023-07-14T13:11:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.076+0000 7f5fc1ffb640 1 -- 172.21.15.5:0/2093902796 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 52) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f5fc4014820 con 0x7f5fcc158ce0 2023-07-14T13:11:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.076+0000 7f5fc1ffb640 1 --2- 172.21.15.5:0/2093902796 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f5fb00660d0 0x7f5fb0068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.076+0000 7f5fc1ffb640 1 -- 172.21.15.5:0/2093902796 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6952+0+0 (secure 0 0 0) 0x7f5fc4084af0 con 0x7f5fcc158ce0 2023-07-14T13:11:14.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.076+0000 7f5fd17e4640 1 --2- 172.21.15.5:0/2093902796 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f5fb00660d0 0x7f5fb0068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:14.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.076+0000 7f5fd17e4640 1 --2- 172.21.15.5:0/2093902796 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f5fb00660d0 0x7f5fb0068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5fc80ad000 tx=0x7f5fc80a4f90 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:14.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.080+0000 7f5fc1ffb640 1 -- 172.21.15.5:0/2093902796 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f5fc4051f10 con 0x7f5fcc158ce0 2023-07-14T13:11:14.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.236+0000 7f5fd3a48640 1 -- 172.21.15.5:0/2093902796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fcc0678d0 con 0x7f5fcc158ce0 2023-07-14T13:11:14.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.236+0000 7f5fc1ffb640 1 -- 172.21.15.5:0/2093902796 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) v1 ==== 74+0+19595 (secure 0 0 0) 0x7f5fc4055530 con 0x7f5fcc158ce0 2023-07-14T13:11:14.272 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:11:14.273 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":115,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:11:12.553790+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:09:45.916338+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-14T13:09:47.159234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.18","mappings":[{"from":1,"to":7}]},{"pgid":"14.2a","mappings":[{"from":1,"to":2}]},{"pgid":"14.32","mappings":[{"from":1,"to":5}]},{"pgid":"14.36","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6833/1467987432":"2023-07-15T13:11:12.553688+0000","172.21.15.154:6832/1467987432":"2023-07-15T13:11:12.553688+0000","172.21.15.154:0/4256904654":"2023-07-15T13:11:12.553688+0000","172.21.15.154:0/3137454277":"2023-07-15T13:11:12.553688+0000","172.21.15.154:0/1138549164":"2023-07-15T13:11:12.553688+0000","172.21.15.154:0/4244779392":"2023-07-15T13:11:12.553688+0000","172.21.15.154:0/3421544755":"2023-07-15T13:11:12.553688+0000","172.21.15.154:0/2790592485":"2023-07-15T13:10:05.475092+0000","172.21.15.154:0/3030719967":"2023-07-15T13:10:05.475092+0000","172.21.15.154:0/1189847216":"2023-07-15T13:10:05.475092+0000","172.21.15.154:0/199342422":"2023-07-15T13:10:05.475092+0000","172.21.15.154:6833/1525189184":"2023-07-15T13:10:05.475092+0000","172.21.15.154:0/1899652873":"2023-07-15T13:11:12.553688+0000","172.21.15.154:0/3866518532":"2023-07-15T13:11:12.553688+0000","172.21.15.154:6832/1525189184":"2023-07-15T13:10:05.475092+0000","172.21.15.154:0/3836120785":"2023-07-15T13:11:12.553688+0000","172.21.15.154:0/3609928299":"2023-07-15T13:10:05.475092+0000","172.21.15.154:0/1625180439":"2023-07-15T13:10:05.475092+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:11:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.240+0000 7f5fd3a48640 1 -- 172.21.15.5:0/2093902796 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f5fb00660d0 msgr2=0x7f5fb0068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.240+0000 7f5fd3a48640 1 --2- 172.21.15.5:0/2093902796 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f5fb00660d0 0x7f5fb0068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5fc80ad000 tx=0x7f5fc80a4f90 comp rx=0 tx=0).stop 2023-07-14T13:11:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.240+0000 7f5fd3a48640 1 -- 172.21.15.5:0/2093902796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fcc158ce0 msgr2=0x7f5fcc0b2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.240+0000 7f5fd3a48640 1 --2- 172.21.15.5:0/2093902796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fcc158ce0 0x7f5fcc0b2350 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f5fc400efc0 tx=0x7f5fc400c490 comp rx=0 tx=0).stop 2023-07-14T13:11:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.240+0000 7f5fd3a48640 1 -- 172.21.15.5:0/2093902796 shutdown_connections 2023-07-14T13:11:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.240+0000 7f5fd3a48640 1 --2- 172.21.15.5:0/2093902796 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f5fb00660d0 0x7f5fb0068580 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.240+0000 7f5fd3a48640 1 --2- 172.21.15.5:0/2093902796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fcc158ce0 0x7f5fcc0b2350 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.240+0000 7f5fd3a48640 1 --2- 172.21.15.5:0/2093902796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fcc0c9730 0x7f5fcc0b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.240+0000 7f5fd3a48640 1 --2- 172.21.15.5:0/2093902796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fcc0c8ad0 0x7f5fcc14f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:14.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.240+0000 7f5fd3a48640 1 -- 172.21.15.5:0/2093902796 >> 172.21.15.5:0/2093902796 conn(0x7f5fcc0afcf0 msgr2=0x7f5fcc070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.240+0000 7f5fd3a48640 1 -- 172.21.15.5:0/2093902796 shutdown_connections 2023-07-14T13:11:14.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.240+0000 7f5fd3a48640 1 -- 172.21.15.5:0/2093902796 wait complete. 2023-07-14T13:11:14.294 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-14T13:11:14.294 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:11:14.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.400+0000 7f10aec6d640 1 Processor -- start 2023-07-14T13:11:14.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.400+0000 7f10aec6d640 1 -- start start 2023-07-14T13:11:14.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.404+0000 7f10aec6d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10a815bdf0 0x7f10a80ca970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:14.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.404+0000 7f10aec6d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f10a815f970 0x7f10a815fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:14.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.404+0000 7f10aec6d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a8160330 con 0x7f10a806b1e0 2023-07-14T13:11:14.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.404+0000 7f10aec6d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a80cb2e0 con 0x7f10a815bdf0 2023-07-14T13:11:14.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.404+0000 7f10aec6d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a80cb5c0 con 0x7f10a815f970 2023-07-14T13:11:14.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.404+0000 7f10aca09640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10a815bdf0 0x7f10a80ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:14.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.404+0000 7f10aca09640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10a815bdf0 0x7f10a80ca970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35730/0 (socket says 172.21.15.5:35730) 2023-07-14T13:11:14.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.404+0000 7f10aca09640 1 -- 172.21.15.5:0/4179998870 learned_addr learned my addr 172.21.15.5:0/4179998870 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:14.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.404+0000 7f10aca09640 1 -- 172.21.15.5:0/4179998870 >> v2:172.21.15.154:3300/0 conn(0x7f10a815f970 msgr2=0x7f10a815fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:14.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.404+0000 7f10a7fff640 1 --2- 172.21.15.5:0/4179998870 >> v2:172.21.15.154:3300/0 conn(0x7f10a815f970 0x7f10a815fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:14.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.404+0000 7f10aca09640 1 --2- 172.21.15.5:0/4179998870 >> v2:172.21.15.154:3300/0 conn(0x7f10a815f970 0x7f10a815fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:14.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.404+0000 7f10aca09640 1 -- 172.21.15.5:0/4179998870 >> v1:172.21.15.5:6789/0 conn(0x7f10a806b1e0 legacy=0x7f10a806b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:14.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.404+0000 7f10aca09640 1 -- 172.21.15.5:0/4179998870 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a80cb8a0 con 0x7f10a815bdf0 2023-07-14T13:11:14.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.404+0000 7f10a77fe640 1 -- 172.21.15.5:0/4179998870 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3883523197 0 0) 0x7f10a00014a0 con 0x7f10a806b1e0 2023-07-14T13:11:14.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.404+0000 7f10a7fff640 1 --2- 172.21.15.5:0/4179998870 >> v2:172.21.15.154:3300/0 conn(0x7f10a815f970 0x7f10a815fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:11:14.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.408+0000 7f10aca09640 1 --2- 172.21.15.5:0/4179998870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10a815bdf0 0x7f10a80ca970 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f10a80adc10 tx=0x7f109c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af010d5ea027f984 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:14.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.408+0000 7f10a77fe640 1 -- 172.21.15.5:0/4179998870 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c0ab660 con 0x7f10a815bdf0 2023-07-14T13:11:14.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.408+0000 7f10a77fe640 1 -- 172.21.15.5:0/4179998870 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109c0ab7c0 con 0x7f10a815bdf0 2023-07-14T13:11:14.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.408+0000 7f10a77fe640 1 -- 172.21.15.5:0/4179998870 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c0abb50 con 0x7f10a815bdf0 2023-07-14T13:11:14.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.408+0000 7f10aec6d640 1 -- 172.21.15.5:0/4179998870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10a815bdf0 msgr2=0x7f10a80ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:14.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.408+0000 7f10aec6d640 1 --2- 172.21.15.5:0/4179998870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10a815bdf0 0x7f10a80ca970 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f10a80adc10 tx=0x7f109c01c440 comp rx=0 tx=0).stop 2023-07-14T13:11:14.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.408+0000 7f10aec6d640 1 -- 172.21.15.5:0/4179998870 shutdown_connections 2023-07-14T13:11:14.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.408+0000 7f10aec6d640 1 --2- 172.21.15.5:0/4179998870 >> v2:172.21.15.154:3300/0 conn(0x7f10a815f970 0x7f10a815fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:14.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.408+0000 7f10aec6d640 1 --2- 172.21.15.5:0/4179998870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10a815bdf0 0x7f10a80ca970 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:14.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.408+0000 7f10aec6d640 1 -- 172.21.15.5:0/4179998870 >> 172.21.15.5:0/4179998870 conn(0x7f10a80afcf0 msgr2=0x7f10a80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:14.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.408+0000 7f10aec6d640 1 -- 172.21.15.5:0/4179998870 shutdown_connections 2023-07-14T13:11:14.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.408+0000 7f10aec6d640 1 -- 172.21.15.5:0/4179998870 wait complete. 2023-07-14T13:11:14.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.408+0000 7f10aec6d640 1 Processor -- start 2023-07-14T13:11:14.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.408+0000 7f10aec6d640 1 -- start start 2023-07-14T13:11:14.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.412+0000 7f10aec6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a806b1e0 0x7f10a8150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:14.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.412+0000 7f10aec6d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10a815bdf0 0x7f10a815d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:14.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.412+0000 7f10aec6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10a815f970 0x7f10a80b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:14.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.412+0000 7f10aec6d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a815d230 con 0x7f10a815f970 2023-07-14T13:11:14.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.412+0000 7f10aec6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a815c620 con 0x7f10a806b1e0 2023-07-14T13:11:14.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.412+0000 7f10aec6d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a815c900 con 0x7f10a815bdf0 2023-07-14T13:11:14.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.412+0000 7f10ad20a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10a815f970 0x7f10a80b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:14.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.412+0000 7f10ad20a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10a815f970 0x7f10a80b0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35734/0 (socket says 172.21.15.5:35734) 2023-07-14T13:11:14.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.412+0000 7f10ad20a640 1 -- 172.21.15.5:0/1626906456 learned_addr learned my addr 172.21.15.5:0/1626906456 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:14.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.412+0000 7f10aca09640 1 --2- 172.21.15.5:0/1626906456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a806b1e0 0x7f10a8150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:14.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.412+0000 7f10a7fff640 1 --2- 172.21.15.5:0/1626906456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10a815bdf0 0x7f10a815d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:14.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.412+0000 7f10ad20a640 1 -- 172.21.15.5:0/1626906456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10a815bdf0 msgr2=0x7f10a815d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:14.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.412+0000 7f10ad20a640 1 --2- 172.21.15.5:0/1626906456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10a815bdf0 0x7f10a815d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:14.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.412+0000 7f10ad20a640 1 -- 172.21.15.5:0/1626906456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a806b1e0 msgr2=0x7f10a8150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:14.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.412+0000 7f10ad20a640 1 --2- 172.21.15.5:0/1626906456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a806b1e0 0x7f10a8150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:14.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.412+0000 7f10ad20a640 1 -- 172.21.15.5:0/1626906456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109c0094d0 con 0x7f10a815f970 2023-07-14T13:11:14.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.412+0000 7f10ad20a640 1 --2- 172.21.15.5:0/1626906456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10a815f970 0x7f10a80b0ff0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f10a000c7c0 tx=0x7f10a000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:14.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.412+0000 7f10a57fa640 1 -- 172.21.15.5:0/1626906456 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a0003db0 con 0x7f10a815f970 2023-07-14T13:11:14.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.412+0000 7f10a57fa640 1 -- 172.21.15.5:0/1626906456 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a0005070 con 0x7f10a815f970 2023-07-14T13:11:14.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.412+0000 7f10a57fa640 1 -- 172.21.15.5:0/1626906456 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a00054a0 con 0x7f10a815f970 2023-07-14T13:11:14.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.412+0000 7f10aec6d640 1 -- 172.21.15.5:0/1626906456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a815cbe0 con 0x7f10a815f970 2023-07-14T13:11:14.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.412+0000 7f10aec6d640 1 -- 172.21.15.5:0/1626906456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a81514b0 con 0x7f10a815f970 2023-07-14T13:11:14.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.412+0000 7f10aec6d640 1 -- 172.21.15.5:0/1626906456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a815d3e0 con 0x7f10a815f970 2023-07-14T13:11:14.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.412+0000 7f10a57fa640 1 -- 172.21.15.5:0/1626906456 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 52) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f10a0005600 con 0x7f10a815f970 2023-07-14T13:11:14.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.416+0000 7f10a57fa640 1 --2- 172.21.15.5:0/1626906456 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f108c0660d0 0x7f108c068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:14.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.416+0000 7f10a57fa640 1 -- 172.21.15.5:0/1626906456 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6952+0+0 (secure 0 0 0) 0x7f10a0083460 con 0x7f10a815f970 2023-07-14T13:11:14.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.416+0000 7f10aca09640 1 --2- 172.21.15.5:0/1626906456 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f108c0660d0 0x7f108c068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:14.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.416+0000 7f10aca09640 1 --2- 172.21.15.5:0/1626906456 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f108c0660d0 0x7f108c068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f109c0af000 tx=0x7f109c0b6040 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:14.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.420+0000 7f10a57fa640 1 -- 172.21.15.5:0/1626906456 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f10a815d3e0 con 0x7f10a815f970 2023-07-14T13:11:14.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.604+0000 7f10aec6d640 1 -- 172.21.15.5:0/1626906456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10a8160330 con 0x7f10a815f970 2023-07-14T13:11:14.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.608+0000 7f10a57fa640 1 -- 172.21.15.5:0/1626906456 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4705 (secure 0 0 0) 0x7f10a8160330 con 0x7f10a815f970 2023-07-14T13:11:14.642 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:11:14.642 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6575,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1957957644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1957957644},{"type":"v1","addr":"172.21.15.5:6835","nonce":1957957644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3439623726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3439623726},{"type":"v1","addr":"172.21.15.154:6837","nonce":3439623726}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7384,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/692576619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":692576619},{"type":"v1","addr":"172.21.15.154:6836","nonce":692576619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:09:48.156588+0000","modified":"2023-07-14T13:09:51.784254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7668},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7668":{"gid":7668,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/855157103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":855157103},{"type":"v1","addr":"172.21.15.5:6834","nonce":855157103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-14T13:11:14.643 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 49 2023-07-14T13:11:14.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.608+0000 7f10aec6d640 1 -- 172.21.15.5:0/1626906456 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f108c0660d0 msgr2=0x7f108c068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:14.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.608+0000 7f10aec6d640 1 --2- 172.21.15.5:0/1626906456 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f108c0660d0 0x7f108c068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f109c0af000 tx=0x7f109c0b6040 comp rx=0 tx=0).stop 2023-07-14T13:11:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.608+0000 7f10aec6d640 1 -- 172.21.15.5:0/1626906456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10a815f970 msgr2=0x7f10a80b0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:14.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.608+0000 7f10aec6d640 1 --2- 172.21.15.5:0/1626906456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10a815f970 0x7f10a80b0ff0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f10a000c7c0 tx=0x7f10a000cc80 comp rx=0 tx=0).stop 2023-07-14T13:11:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.608+0000 7f10aec6d640 1 -- 172.21.15.5:0/1626906456 shutdown_connections 2023-07-14T13:11:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.608+0000 7f10aec6d640 1 --2- 172.21.15.5:0/1626906456 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f108c0660d0 0x7f108c068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.608+0000 7f10aec6d640 1 --2- 172.21.15.5:0/1626906456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10a815f970 0x7f10a80b0ff0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.608+0000 7f10aec6d640 1 --2- 172.21.15.5:0/1626906456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f10a815bdf0 0x7f10a815d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.608+0000 7f10aec6d640 1 --2- 172.21.15.5:0/1626906456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10a806b1e0 0x7f10a8150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:14.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.608+0000 7f10aec6d640 1 -- 172.21.15.5:0/1626906456 >> 172.21.15.5:0/1626906456 conn(0x7f10a80afcf0 msgr2=0x7f10a80ae7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.608+0000 7f10aec6d640 1 -- 172.21.15.5:0/1626906456 shutdown_connections 2023-07-14T13:11:14.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.608+0000 7f10aec6d640 1 -- 172.21.15.5:0/1626906456 wait complete. 2023-07-14T13:11:14.663 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:11:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.772+0000 7fed4ddc5640 1 Processor -- start 2023-07-14T13:11:14.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.772+0000 7fed4ddc5640 1 -- start start 2023-07-14T13:11:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.772+0000 7fed4ddc5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fed48145430 0x7fed480b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.772+0000 7fed4ddc5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fed480b39f0 0x7fed480d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:14.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.772+0000 7fed4ddc5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed480b2140 con 0x7fed480d06b0 2023-07-14T13:11:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.772+0000 7fed4ddc5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed480b2410 con 0x7fed48145430 2023-07-14T13:11:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.772+0000 7fed4ddc5640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed480b26f0 con 0x7fed480b39f0 2023-07-14T13:11:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.772+0000 7fed46ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fed48145430 0x7fed480b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.772+0000 7fed46ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fed48145430 0x7fed480b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35740/0 (socket says 172.21.15.5:35740) 2023-07-14T13:11:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.772+0000 7fed46ffd640 1 -- 172.21.15.5:0/420436190 learned_addr learned my addr 172.21.15.5:0/420436190 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.772+0000 7fed477fe640 1 --1- 172.21.15.5:0/420436190 >> v1:172.21.15.5:6789/0 conn(0x7fed480d06b0 0x7fed480b1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43856/0 (socket says 172.21.15.5:43856) 2023-07-14T13:11:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.772+0000 7fed47fff640 1 --2- 172.21.15.5:0/420436190 >> v2:172.21.15.154:3300/0 conn(0x7fed480b39f0 0x7fed480d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.772+0000 7fed46ffd640 1 -- 172.21.15.5:0/420436190 >> v2:172.21.15.154:3300/0 conn(0x7fed480b39f0 msgr2=0x7fed480d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.772+0000 7fed46ffd640 1 --2- 172.21.15.5:0/420436190 >> v2:172.21.15.154:3300/0 conn(0x7fed480b39f0 0x7fed480d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.772+0000 7fed46ffd640 1 -- 172.21.15.5:0/420436190 >> v1:172.21.15.5:6789/0 conn(0x7fed480d06b0 legacy=0x7fed480b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.772+0000 7fed46ffd640 1 -- 172.21.15.5:0/420436190 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed480b29d0 con 0x7fed48145430 2023-07-14T13:11:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.772+0000 7fed47fff640 1 --2- 172.21.15.5:0/420436190 >> v2:172.21.15.154:3300/0 conn(0x7fed480b39f0 0x7fed480d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:11:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.772+0000 7fed467fc640 1 -- 172.21.15.5:0/420436190 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702743923 0 0) 0x7fed480b2140 con 0x7fed480d06b0 2023-07-14T13:11:14.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.776+0000 7fed46ffd640 1 --2- 172.21.15.5:0/420436190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed48145430 0x7fed480b34b0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fed4808cb00 tx=0x7fed3c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba8791434abef3b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:14.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.776+0000 7fed467fc640 1 -- 172.21.15.5:0/420436190 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c0ac640 con 0x7fed48145430 2023-07-14T13:11:14.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.776+0000 7fed467fc640 1 -- 172.21.15.5:0/420436190 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3c0ac7a0 con 0x7fed48145430 2023-07-14T13:11:14.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.776+0000 7fed467fc640 1 -- 172.21.15.5:0/420436190 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c0acb30 con 0x7fed48145430 2023-07-14T13:11:14.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.776+0000 7fed4ddc5640 1 -- 172.21.15.5:0/420436190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed48145430 msgr2=0x7fed480b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:14.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.776+0000 7fed4ddc5640 1 --2- 172.21.15.5:0/420436190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed48145430 0x7fed480b34b0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fed4808cb00 tx=0x7fed3c01c4d0 comp rx=0 tx=0).stop 2023-07-14T13:11:14.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.776+0000 7fed4ddc5640 1 -- 172.21.15.5:0/420436190 shutdown_connections 2023-07-14T13:11:14.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.776+0000 7fed4ddc5640 1 --2- 172.21.15.5:0/420436190 >> v2:172.21.15.154:3300/0 conn(0x7fed480b39f0 0x7fed480d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:14.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.776+0000 7fed4ddc5640 1 --2- 172.21.15.5:0/420436190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed48145430 0x7fed480b34b0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:14.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.776+0000 7fed4ddc5640 1 -- 172.21.15.5:0/420436190 >> 172.21.15.5:0/420436190 conn(0x7fed480659d0 msgr2=0x7fed4809b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:14.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.776+0000 7fed4ddc5640 1 -- 172.21.15.5:0/420436190 shutdown_connections 2023-07-14T13:11:14.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.776+0000 7fed4ddc5640 1 -- 172.21.15.5:0/420436190 wait complete. 2023-07-14T13:11:14.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.780+0000 7fed4ddc5640 1 Processor -- start 2023-07-14T13:11:14.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.780+0000 7fed4ddc5640 1 -- start start 2023-07-14T13:11:14.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.780+0000 7fed4ddc5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed480b39f0 0x7fed481f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.780+0000 7fed4ddc5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed480d06b0 0x7fed480c3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.780+0000 7fed4ddc5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed481f4390 0x7fed480c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.780+0000 7fed4ddc5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4806bea0 con 0x7fed480b39f0 2023-07-14T13:11:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.780+0000 7fed4ddc5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed480c3720 con 0x7fed481f4390 2023-07-14T13:11:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.780+0000 7fed4ddc5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4815e910 con 0x7fed480d06b0 2023-07-14T13:11:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.780+0000 7fed477fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed480b39f0 0x7fed481f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.780+0000 7fed477fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed480b39f0 0x7fed481f3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35750/0 (socket says 172.21.15.5:35750) 2023-07-14T13:11:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.780+0000 7fed477fe640 1 -- 172.21.15.5:0/272140976 learned_addr learned my addr 172.21.15.5:0/272140976 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.780+0000 7fed47fff640 1 --2- 172.21.15.5:0/272140976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed481f4390 0x7fed480c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.780+0000 7fed46ffd640 1 --2- 172.21.15.5:0/272140976 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed480d06b0 0x7fed480c3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.780+0000 7fed477fe640 1 -- 172.21.15.5:0/272140976 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed480d06b0 msgr2=0x7fed480c3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.780+0000 7fed477fe640 1 --2- 172.21.15.5:0/272140976 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed480d06b0 0x7fed480c3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.780+0000 7fed477fe640 1 -- 172.21.15.5:0/272140976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed481f4390 msgr2=0x7fed480c40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.780+0000 7fed477fe640 1 --2- 172.21.15.5:0/272140976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed481f4390 0x7fed480c40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:14.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.780+0000 7fed477fe640 1 -- 172.21.15.5:0/272140976 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3c0094d0 con 0x7fed480b39f0 2023-07-14T13:11:14.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.780+0000 7fed46ffd640 1 --2- 172.21.15.5:0/272140976 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed480d06b0 0x7fed480c3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:11:14.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.780+0000 7fed477fe640 1 --2- 172.21.15.5:0/272140976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed480b39f0 0x7fed481f3e50 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fed3800c550 tx=0x7fed3800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:14.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.780+0000 7fed2ffff640 1 -- 172.21.15.5:0/272140976 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed380074e0 con 0x7fed480b39f0 2023-07-14T13:11:14.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.780+0000 7fed2ffff640 1 -- 172.21.15.5:0/272140976 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed38007640 con 0x7fed480b39f0 2023-07-14T13:11:14.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.780+0000 7fed2ffff640 1 -- 172.21.15.5:0/272140976 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed380049f0 con 0x7fed480b39f0 2023-07-14T13:11:14.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.780+0000 7fed4ddc5640 1 -- 172.21.15.5:0/272140976 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4815e070 con 0x7fed480b39f0 2023-07-14T13:11:14.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.780+0000 7fed4ddc5640 1 -- 172.21.15.5:0/272140976 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4815e630 con 0x7fed480b39f0 2023-07-14T13:11:14.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.784+0000 7fed4ddc5640 1 -- 172.21.15.5:0/272140976 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed48072e70 con 0x7fed480b39f0 2023-07-14T13:11:14.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.784+0000 7fed2ffff640 1 -- 172.21.15.5:0/272140976 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 52) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fed38004b50 con 0x7fed480b39f0 2023-07-14T13:11:14.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.784+0000 7fed2ffff640 1 --2- 172.21.15.5:0/272140976 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fed34066100 0x7fed340685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:14.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.784+0000 7fed2ffff640 1 -- 172.21.15.5:0/272140976 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6952+0+0 (secure 0 0 0) 0x7fed38083060 con 0x7fed480b39f0 2023-07-14T13:11:14.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.784+0000 7fed46ffd640 1 --2- 172.21.15.5:0/272140976 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fed34066100 0x7fed340685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:14.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.784+0000 7fed46ffd640 1 --2- 172.21.15.5:0/272140976 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fed34066100 0x7fed340685b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0ae000 tx=0x7fed3c008040 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:14.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.788+0000 7fed2ffff640 1 -- 172.21.15.5:0/272140976 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fed38050410 con 0x7fed480b39f0 2023-07-14T13:11:14.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.824+0000 7fed2ffff640 1 -- 172.21.15.5:0/272140976 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fed380507e0 con 0x7fed480b39f0 2023-07-14T13:11:15.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.980+0000 7fed4ddc5640 1 -- 172.21.15.5:0/272140976 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed480678d0 con 0x7fed480b39f0 2023-07-14T13:11:15.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.980+0000 7fed2ffff640 1 -- 172.21.15.5:0/272140976 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4705 (secure 0 0 0) 0x7fed38018020 con 0x7fed480b39f0 2023-07-14T13:11:15.016 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:11:15.016 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6575,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1957957644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1957957644},{"type":"v1","addr":"172.21.15.5:6835","nonce":1957957644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3439623726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3439623726},{"type":"v1","addr":"172.21.15.154:6837","nonce":3439623726}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7384,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/692576619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":692576619},{"type":"v1","addr":"172.21.15.154:6836","nonce":692576619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:09:48.156588+0000","modified":"2023-07-14T13:09:51.784254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7668},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7668":{"gid":7668,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/855157103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":855157103},{"type":"v1","addr":"172.21.15.5:6834","nonce":855157103}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-14T13:11:15.017 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 49 2023-07-14T13:11:15.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.980+0000 7fed4ddc5640 1 -- 172.21.15.5:0/272140976 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fed34066100 msgr2=0x7fed340685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.980+0000 7fed4ddc5640 1 --2- 172.21.15.5:0/272140976 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fed34066100 0x7fed340685b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0ae000 tx=0x7fed3c008040 comp rx=0 tx=0).stop 2023-07-14T13:11:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.980+0000 7fed4ddc5640 1 -- 172.21.15.5:0/272140976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed480b39f0 msgr2=0x7fed481f3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.980+0000 7fed4ddc5640 1 --2- 172.21.15.5:0/272140976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed480b39f0 0x7fed481f3e50 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fed3800c550 tx=0x7fed3800ca10 comp rx=0 tx=0).stop 2023-07-14T13:11:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.980+0000 7fed4ddc5640 1 -- 172.21.15.5:0/272140976 shutdown_connections 2023-07-14T13:11:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.980+0000 7fed4ddc5640 1 --2- 172.21.15.5:0/272140976 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fed34066100 0x7fed340685b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.980+0000 7fed4ddc5640 1 --2- 172.21.15.5:0/272140976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed481f4390 0x7fed480c40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.980+0000 7fed4ddc5640 1 --2- 172.21.15.5:0/272140976 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed480d06b0 0x7fed480c3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.980+0000 7fed4ddc5640 1 --2- 172.21.15.5:0/272140976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed480b39f0 0x7fed481f3e50 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.980+0000 7fed4ddc5640 1 -- 172.21.15.5:0/272140976 >> 172.21.15.5:0/272140976 conn(0x7fed480659d0 msgr2=0x7fed480b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.980+0000 7fed4ddc5640 1 -- 172.21.15.5:0/272140976 shutdown_connections 2023-07-14T13:11:15.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:14.980+0000 7fed4ddc5640 1 -- 172.21.15.5:0/272140976 wait complete. 2023-07-14T13:11:15.036 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:11:15.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.144+0000 7f507ac93640 1 Processor -- start 2023-07-14T13:11:15.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.144+0000 7f507ac93640 1 -- start start 2023-07-14T13:11:15.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.144+0000 7f507ac93640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f50740c9730 0x7f50741638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.144+0000 7f507ac93640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50740cc700 con 0x7f50740c8ad0 2023-07-14T13:11:15.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.144+0000 7f507ac93640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50740b0ff0 con 0x7f5074158ce0 2023-07-14T13:11:15.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.144+0000 7f507ac93640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5074070c80 con 0x7f50740c9730 2023-07-14T13:11:15.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.144+0000 7f506bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f50740c8ad0 0x7f50740c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43866/0 (socket says 172.21.15.5:43866) 2023-07-14T13:11:15.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.144+0000 7f506bfff640 1 -- 172.21.15.5:0/4178965343 learned_addr learned my addr 172.21.15.5:0/4178965343 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:15.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.144+0000 7f5079230640 1 --2- 172.21.15.5:0/4178965343 >> v2:172.21.15.5:3300/0 conn(0x7f50740c9730 0x7f50741638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.144+0000 7f5079230640 1 -- 172.21.15.5:0/4178965343 >> v1:172.21.15.154:6789/0 conn(0x7f5074158ce0 legacy=0x7f5074070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:15.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.144+0000 7f5079230640 1 -- 172.21.15.5:0/4178965343 >> v1:172.21.15.5:6789/0 conn(0x7f50740c8ad0 legacy=0x7f50740c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:15.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.144+0000 7f506b7fe640 1 -- 172.21.15.5:0/4178965343 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325342620 0 0) 0x7f50740cc700 con 0x7f50740c8ad0 2023-07-14T13:11:15.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.144+0000 7f5079230640 1 -- 172.21.15.5:0/4178965343 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50740cbdd0 con 0x7f50740c9730 2023-07-14T13:11:15.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.148+0000 7f5079230640 1 --2- 172.21.15.5:0/4178965343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50740c9730 0x7f50741638b0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f506c009d90 tx=0x7f506c01c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d6e43c88eca9ce server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:15.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.148+0000 7f506b7fe640 1 -- 172.21.15.5:0/4178965343 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c0a58e0 con 0x7f50740c9730 2023-07-14T13:11:15.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.148+0000 7f506b7fe640 1 -- 172.21.15.5:0/4178965343 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506c0a5a40 con 0x7f50740c9730 2023-07-14T13:11:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.148+0000 7f506b7fe640 1 -- 172.21.15.5:0/4178965343 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c0a5dd0 con 0x7f50740c9730 2023-07-14T13:11:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.148+0000 7f507ac93640 1 -- 172.21.15.5:0/4178965343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50740c9730 msgr2=0x7f50741638b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.148+0000 7f507ac93640 1 --2- 172.21.15.5:0/4178965343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50740c9730 0x7f50741638b0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f506c009d90 tx=0x7f506c01c800 comp rx=0 tx=0).stop 2023-07-14T13:11:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.148+0000 7f507ac93640 1 -- 172.21.15.5:0/4178965343 shutdown_connections 2023-07-14T13:11:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.148+0000 7f507ac93640 1 --2- 172.21.15.5:0/4178965343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50740c9730 0x7f50741638b0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.148+0000 7f507ac93640 1 -- 172.21.15.5:0/4178965343 >> 172.21.15.5:0/4178965343 conn(0x7f50740afcf0 msgr2=0x7f50740b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.148+0000 7f507ac93640 1 -- 172.21.15.5:0/4178965343 shutdown_connections 2023-07-14T13:11:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.148+0000 7f507ac93640 1 -- 172.21.15.5:0/4178965343 wait complete. 2023-07-14T13:11:15.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.152+0000 7f507ac93640 1 Processor -- start 2023-07-14T13:11:15.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.152+0000 7f507ac93640 1 -- start start 2023-07-14T13:11:15.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.152+0000 7f507ac93640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50740c8ad0 0x7f5074156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.152+0000 7f507ac93640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50740c9730 0x7f507414db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.152+0000 7f507ac93640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5074158ce0 0x7f5074156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.152+0000 7f507ac93640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5074157d50 con 0x7f50740c8ad0 2023-07-14T13:11:15.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.152+0000 7f507ac93640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5074156180 con 0x7f50740c9730 2023-07-14T13:11:15.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.152+0000 7f507ac93640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5074157a70 con 0x7f5074158ce0 2023-07-14T13:11:15.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.152+0000 7f5078a2f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50740c8ad0 0x7f5074156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.152+0000 7f5078a2f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50740c8ad0 0x7f5074156610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35764/0 (socket says 172.21.15.5:35764) 2023-07-14T13:11:15.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.152+0000 7f5078a2f640 1 -- 172.21.15.5:0/1088843761 learned_addr learned my addr 172.21.15.5:0/1088843761 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:15.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.152+0000 7f506bfff640 1 --2- 172.21.15.5:0/1088843761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50740c9730 0x7f507414db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.152+0000 7f5079230640 1 --2- 172.21.15.5:0/1088843761 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5074158ce0 0x7f5074156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.152+0000 7f5078a2f640 1 -- 172.21.15.5:0/1088843761 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5074158ce0 msgr2=0x7f5074156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:15.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.152+0000 7f5078a2f640 1 --2- 172.21.15.5:0/1088843761 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5074158ce0 0x7f5074156fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.152+0000 7f5078a2f640 1 -- 172.21.15.5:0/1088843761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50740c9730 msgr2=0x7f507414db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:15.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.152+0000 7f5078a2f640 1 --2- 172.21.15.5:0/1088843761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50740c9730 0x7f507414db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.152+0000 7f5078a2f640 1 -- 172.21.15.5:0/1088843761 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c009a70 con 0x7f50740c8ad0 2023-07-14T13:11:15.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.152+0000 7f506bfff640 1 --2- 172.21.15.5:0/1088843761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50740c9730 0x7f507414db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:11:15.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.152+0000 7f5078a2f640 1 --2- 172.21.15.5:0/1088843761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50740c8ad0 0x7f5074156610 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f507000c3c0 tx=0x7f507000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:15.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.152+0000 7f50697fa640 1 -- 172.21.15.5:0/1088843761 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50700052d0 con 0x7f50740c8ad0 2023-07-14T13:11:15.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.152+0000 7f50697fa640 1 -- 172.21.15.5:0/1088843761 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5070005430 con 0x7f50740c8ad0 2023-07-14T13:11:15.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.152+0000 7f507ac93640 1 -- 172.21.15.5:0/1088843761 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5074155b30 con 0x7f50740c8ad0 2023-07-14T13:11:15.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.152+0000 7f50697fa640 1 -- 172.21.15.5:0/1088843761 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5070003840 con 0x7f50740c8ad0 2023-07-14T13:11:15.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.152+0000 7f507ac93640 1 -- 172.21.15.5:0/1088843761 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f507414e5f0 con 0x7f50740c8ad0 2023-07-14T13:11:15.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.156+0000 7f507ac93640 1 -- 172.21.15.5:0/1088843761 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50740ca1a0 con 0x7f50740c8ad0 2023-07-14T13:11:15.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.156+0000 7f50697fa640 1 -- 172.21.15.5:0/1088843761 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f50700039a0 con 0x7f50740c8ad0 2023-07-14T13:11:15.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.156+0000 7f50697fa640 1 --2- 172.21.15.5:0/1088843761 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f50600663d0 0x7f5060068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.156+0000 7f50697fa640 1 -- 172.21.15.5:0/1088843761 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6952+0+0 (secure 0 0 0) 0x7f5070083710 con 0x7f50740c8ad0 2023-07-14T13:11:15.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.156+0000 7f506bfff640 1 --2- 172.21.15.5:0/1088843761 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f50600663d0 0x7f5060068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.156+0000 7f506bfff640 1 --2- 172.21.15.5:0/1088843761 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f50600663d0 0x7f5060068880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5074156c50 tx=0x7f5064007df0 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:15.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.160+0000 7f50697fa640 1 -- 172.21.15.5:0/1088843761 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f50700506f0 con 0x7f50740c8ad0 2023-07-14T13:11:15.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.316+0000 7f507ac93640 1 -- 172.21.15.5:0/1088843761 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50741557c0 con 0x7f50740c8ad0 2023-07-14T13:11:15.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.316+0000 7f50697fa640 1 -- 172.21.15.5:0/1088843761 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) v1 ==== 74+0+19595 (secure 0 0 0) 0x7f5070053d10 con 0x7f50740c8ad0 2023-07-14T13:11:15.353 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:11:15.354 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":115,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:11:12.553790+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:09:45.916338+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-14T13:09:47.159234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.18","mappings":[{"from":1,"to":7}]},{"pgid":"14.2a","mappings":[{"from":1,"to":2}]},{"pgid":"14.32","mappings":[{"from":1,"to":5}]},{"pgid":"14.36","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6833/1467987432":"2023-07-15T13:11:12.553688+0000","172.21.15.154:6832/1467987432":"2023-07-15T13:11:12.553688+0000","172.21.15.154:0/4256904654":"2023-07-15T13:11:12.553688+0000","172.21.15.154:0/3137454277":"2023-07-15T13:11:12.553688+0000","172.21.15.154:0/1138549164":"2023-07-15T13:11:12.553688+0000","172.21.15.154:0/4244779392":"2023-07-15T13:11:12.553688+0000","172.21.15.154:0/3421544755":"2023-07-15T13:11:12.553688+0000","172.21.15.154:0/2790592485":"2023-07-15T13:10:05.475092+0000","172.21.15.154:0/3030719967":"2023-07-15T13:10:05.475092+0000","172.21.15.154:0/1189847216":"2023-07-15T13:10:05.475092+0000","172.21.15.154:0/199342422":"2023-07-15T13:10:05.475092+0000","172.21.15.154:6833/1525189184":"2023-07-15T13:10:05.475092+0000","172.21.15.154:0/1899652873":"2023-07-15T13:11:12.553688+0000","172.21.15.154:0/3866518532":"2023-07-15T13:11:12.553688+0000","172.21.15.154:6832/1525189184":"2023-07-15T13:10:05.475092+0000","172.21.15.154:0/3836120785":"2023-07-15T13:11:12.553688+0000","172.21.15.154:0/3609928299":"2023-07-15T13:10:05.475092+0000","172.21.15.154:0/1625180439":"2023-07-15T13:10:05.475092+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:11:15.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.320+0000 7f507ac93640 1 -- 172.21.15.5:0/1088843761 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f50600663d0 msgr2=0x7f5060068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:15.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.320+0000 7f507ac93640 1 --2- 172.21.15.5:0/1088843761 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f50600663d0 0x7f5060068880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5074156c50 tx=0x7f5064007df0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.320+0000 7f507ac93640 1 -- 172.21.15.5:0/1088843761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50740c8ad0 msgr2=0x7f5074156610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.320+0000 7f507ac93640 1 --2- 172.21.15.5:0/1088843761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50740c8ad0 0x7f5074156610 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f507000c3c0 tx=0x7f507000c880 comp rx=0 tx=0).stop 2023-07-14T13:11:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.320+0000 7f507ac93640 1 -- 172.21.15.5:0/1088843761 shutdown_connections 2023-07-14T13:11:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.320+0000 7f507ac93640 1 --2- 172.21.15.5:0/1088843761 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f50600663d0 0x7f5060068880 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.320+0000 7f507ac93640 1 --2- 172.21.15.5:0/1088843761 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5074158ce0 0x7f5074156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.320+0000 7f507ac93640 1 --2- 172.21.15.5:0/1088843761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50740c9730 0x7f507414db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.320+0000 7f507ac93640 1 --2- 172.21.15.5:0/1088843761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50740c8ad0 0x7f5074156610 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.320+0000 7f507ac93640 1 -- 172.21.15.5:0/1088843761 >> 172.21.15.5:0/1088843761 conn(0x7f50740afcf0 msgr2=0x7f50740cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:15.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.320+0000 7f507ac93640 1 -- 172.21.15.5:0/1088843761 shutdown_connections 2023-07-14T13:11:15.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.320+0000 7f507ac93640 1 -- 172.21.15.5:0/1088843761 wait complete. 2023-07-14T13:11:15.375 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-14T13:11:15.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.484+0000 7fbf47a34640 1 Processor -- start 2023-07-14T13:11:15.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.484+0000 7fbf47a34640 1 -- start start 2023-07-14T13:11:15.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.484+0000 7fbf47a34640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbf40160330 0x7fbf400cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.484+0000 7fbf47a34640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbf400c8940 0x7fbf400ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.484+0000 7fbf47a34640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf400c0f80 0x7fbf400cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.484+0000 7fbf47a34640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf400c17d0 con 0x7fbf40160330 2023-07-14T13:11:15.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.484+0000 7fbf47a34640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf400c14f0 con 0x7fbf400c8940 2023-07-14T13:11:15.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.484+0000 7fbf47a34640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf400cac10 con 0x7fbf400c0f80 2023-07-14T13:11:15.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.484+0000 7fbf457d0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbf40160330 0x7fbf400cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.484+0000 7fbf457d0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbf40160330 0x7fbf400cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35774/0 (socket says 172.21.15.5:35774) 2023-07-14T13:11:15.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.484+0000 7fbf457d0640 1 -- 172.21.15.5:0/60174333 learned_addr learned my addr 172.21.15.5:0/60174333 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:15.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.488+0000 7fbf44fcf640 1 --2- 172.21.15.5:0/60174333 >> v2:172.21.15.154:3300/0 conn(0x7fbf400c8940 0x7fbf400ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.488+0000 7fbf45fd1640 1 --2- 172.21.15.5:0/60174333 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf400c0f80 0x7fbf400cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.488+0000 7fbf457d0640 1 -- 172.21.15.5:0/60174333 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf400c0f80 msgr2=0x7fbf400cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:15.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.488+0000 7fbf457d0640 1 --2- 172.21.15.5:0/60174333 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf400c0f80 0x7fbf400cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.488+0000 7fbf457d0640 1 -- 172.21.15.5:0/60174333 >> v2:172.21.15.154:3300/0 conn(0x7fbf400c8940 msgr2=0x7fbf400ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:15.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.488+0000 7fbf457d0640 1 --2- 172.21.15.5:0/60174333 >> v2:172.21.15.154:3300/0 conn(0x7fbf400c8940 0x7fbf400ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.488+0000 7fbf457d0640 1 -- 172.21.15.5:0/60174333 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf400caef0 con 0x7fbf40160330 2023-07-14T13:11:15.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.488+0000 7fbf44fcf640 1 --2- 172.21.15.5:0/60174333 >> v2:172.21.15.154:3300/0 conn(0x7fbf400c8940 0x7fbf400ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:11:15.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.488+0000 7fbf457d0640 1 --2- 172.21.15.5:0/60174333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf40160330 0x7fbf400cb6f0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fbf4006f3a0 tx=0x7fbf3c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2113330ee2add2ea server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:15.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.488+0000 7fbf37fff640 1 -- 172.21.15.5:0/60174333 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c0a89b0 con 0x7fbf40160330 2023-07-14T13:11:15.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.488+0000 7fbf37fff640 1 -- 172.21.15.5:0/60174333 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3c0a8b10 con 0x7fbf40160330 2023-07-14T13:11:15.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.488+0000 7fbf37fff640 1 -- 172.21.15.5:0/60174333 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c0a8ea0 con 0x7fbf40160330 2023-07-14T13:11:15.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.488+0000 7fbf47a34640 1 -- 172.21.15.5:0/60174333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf40160330 msgr2=0x7fbf400cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:15.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.488+0000 7fbf47a34640 1 --2- 172.21.15.5:0/60174333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf40160330 0x7fbf400cb6f0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fbf4006f3a0 tx=0x7fbf3c01ecf0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.492+0000 7fbf47a34640 1 -- 172.21.15.5:0/60174333 shutdown_connections 2023-07-14T13:11:15.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.492+0000 7fbf47a34640 1 --2- 172.21.15.5:0/60174333 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf400c0f80 0x7fbf400cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.492+0000 7fbf47a34640 1 --2- 172.21.15.5:0/60174333 >> v2:172.21.15.154:3300/0 conn(0x7fbf400c8940 0x7fbf400ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.492+0000 7fbf47a34640 1 --2- 172.21.15.5:0/60174333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf40160330 0x7fbf400cb6f0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.492+0000 7fbf47a34640 1 -- 172.21.15.5:0/60174333 >> 172.21.15.5:0/60174333 conn(0x7fbf400afcf0 msgr2=0x7fbf400b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:15.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.492+0000 7fbf47a34640 1 -- 172.21.15.5:0/60174333 shutdown_connections 2023-07-14T13:11:15.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.492+0000 7fbf47a34640 1 -- 172.21.15.5:0/60174333 wait complete. 2023-07-14T13:11:15.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.492+0000 7fbf47a34640 1 Processor -- start 2023-07-14T13:11:15.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.492+0000 7fbf47a34640 1 -- start start 2023-07-14T13:11:15.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.492+0000 7fbf47a34640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf400c0f80 0x7fbf400c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.492+0000 7fbf47a34640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf400c8940 0x7fbf40149410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.492+0000 7fbf47a34640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf40160330 0x7fbf40149950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.492+0000 7fbf47a34640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf401625e0 con 0x7fbf400c0f80 2023-07-14T13:11:15.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.492+0000 7fbf47a34640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf401616f0 con 0x7fbf400c8940 2023-07-14T13:11:15.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.492+0000 7fbf47a34640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf401619d0 con 0x7fbf40160330 2023-07-14T13:11:15.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.492+0000 7fbf457d0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf400c0f80 0x7fbf400c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.492+0000 7fbf457d0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf400c0f80 0x7fbf400c5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35782/0 (socket says 172.21.15.5:35782) 2023-07-14T13:11:15.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.492+0000 7fbf457d0640 1 -- 172.21.15.5:0/3689984651 learned_addr learned my addr 172.21.15.5:0/3689984651 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:15.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.492+0000 7fbf44fcf640 1 --2- 172.21.15.5:0/3689984651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf400c8940 0x7fbf40149410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.492+0000 7fbf45fd1640 1 --2- 172.21.15.5:0/3689984651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf40160330 0x7fbf40149950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.492+0000 7fbf457d0640 1 -- 172.21.15.5:0/3689984651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf40160330 msgr2=0x7fbf40149950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:15.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.492+0000 7fbf457d0640 1 --2- 172.21.15.5:0/3689984651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf40160330 0x7fbf40149950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.492+0000 7fbf457d0640 1 -- 172.21.15.5:0/3689984651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf400c8940 msgr2=0x7fbf40149410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:15.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.492+0000 7fbf457d0640 1 --2- 172.21.15.5:0/3689984651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf400c8940 0x7fbf40149410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.492+0000 7fbf457d0640 1 -- 172.21.15.5:0/3689984651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3c0094d0 con 0x7fbf400c0f80 2023-07-14T13:11:15.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.496+0000 7fbf457d0640 1 --2- 172.21.15.5:0/3689984651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf400c0f80 0x7fbf400c5230 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c01d3a0 tx=0x7fbf3c01ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:15.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.496+0000 7fbf35ffb640 1 -- 172.21.15.5:0/3689984651 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c0ba600 con 0x7fbf400c0f80 2023-07-14T13:11:15.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.496+0000 7fbf35ffb640 1 -- 172.21.15.5:0/3689984651 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3c0ba760 con 0x7fbf400c0f80 2023-07-14T13:11:15.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.496+0000 7fbf47a34640 1 -- 172.21.15.5:0/3689984651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf40161cb0 con 0x7fbf400c0f80 2023-07-14T13:11:15.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.496+0000 7fbf35ffb640 1 -- 172.21.15.5:0/3689984651 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c0bab10 con 0x7fbf400c0f80 2023-07-14T13:11:15.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.496+0000 7fbf47a34640 1 -- 172.21.15.5:0/3689984651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf40162270 con 0x7fbf400c0f80 2023-07-14T13:11:15.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.496+0000 7fbf47a34640 1 -- 172.21.15.5:0/3689984651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf400678d0 con 0x7fbf400c0f80 2023-07-14T13:11:15.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.496+0000 7fbf35ffb640 1 -- 172.21.15.5:0/3689984651 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbf3c0bac70 con 0x7fbf400c0f80 2023-07-14T13:11:15.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.496+0000 7fbf35ffb640 1 --2- 172.21.15.5:0/3689984651 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fbf240663a0 0x7fbf24068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.496+0000 7fbf35ffb640 1 -- 172.21.15.5:0/3689984651 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6952+0+0 (secure 0 0 0) 0x7fbf3c122700 con 0x7fbf400c0f80 2023-07-14T13:11:15.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.500+0000 7fbf44fcf640 1 --2- 172.21.15.5:0/3689984651 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fbf240663a0 0x7fbf24068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.500+0000 7fbf44fcf640 1 --2- 172.21.15.5:0/3689984651 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fbf240663a0 0x7fbf24068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbf40070890 tx=0x7fbf30008040 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:15.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.500+0000 7fbf35ffb640 1 -- 172.21.15.5:0/3689984651 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fbf3c0ef710 con 0x7fbf400c0f80 2023-07-14T13:11:15.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.688+0000 7fbf47a34640 1 -- 172.21.15.5:0/3689984651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbf40066810 con 0x7fbf400c0f80 2023-07-14T13:11:15.725 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-07-14T13:11:15.688+0000 7f17b1648640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-14T13:11:15.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.696+0000 7fbf35ffb640 1 -- 172.21.15.5:0/3689984651 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v50) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbf3c0b5090 con 0x7fbf400c0f80 2023-07-14T13:11:15.730 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-14T13:11:15.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.696+0000 7fbf47a34640 1 -- 172.21.15.5:0/3689984651 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fbf240663a0 msgr2=0x7fbf24068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:15.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.696+0000 7fbf47a34640 1 --2- 172.21.15.5:0/3689984651 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fbf240663a0 0x7fbf24068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbf40070890 tx=0x7fbf30008040 comp rx=0 tx=0).stop 2023-07-14T13:11:15.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.696+0000 7fbf47a34640 1 -- 172.21.15.5:0/3689984651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf400c0f80 msgr2=0x7fbf400c5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:15.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.696+0000 7fbf47a34640 1 --2- 172.21.15.5:0/3689984651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf400c0f80 0x7fbf400c5230 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c01d3a0 tx=0x7fbf3c01ba90 comp rx=0 tx=0).stop 2023-07-14T13:11:15.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.696+0000 7fbf47a34640 1 -- 172.21.15.5:0/3689984651 shutdown_connections 2023-07-14T13:11:15.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.696+0000 7fbf47a34640 1 --2- 172.21.15.5:0/3689984651 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fbf240663a0 0x7fbf24068850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.696+0000 7fbf47a34640 1 --2- 172.21.15.5:0/3689984651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf40160330 0x7fbf40149950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.696+0000 7fbf47a34640 1 --2- 172.21.15.5:0/3689984651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf400c8940 0x7fbf40149410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.696+0000 7fbf47a34640 1 --2- 172.21.15.5:0/3689984651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf400c0f80 0x7fbf400c5230 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.696+0000 7fbf47a34640 1 -- 172.21.15.5:0/3689984651 >> 172.21.15.5:0/3689984651 conn(0x7fbf400afcf0 msgr2=0x7fbf40070de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:15.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.696+0000 7fbf47a34640 1 -- 172.21.15.5:0/3689984651 shutdown_connections 2023-07-14T13:11:15.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.696+0000 7fbf47a34640 1 -- 172.21.15.5:0/3689984651 wait complete. 2023-07-14T13:11:15.742 INFO:tasks.ceph.mds.c.smithi005.stderr: -6903> 2023-07-14T13:09:53.370+0000 7f73c4aa2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T13:11:15.752 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-14T13:11:15.793 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-07-14T13:11:15.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.868+0000 7f527c634640 1 Processor -- start 2023-07-14T13:11:15.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.868+0000 7f527c634640 1 -- start start 2023-07-14T13:11:15.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.868+0000 7f527c634640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f527406a540 0x7f52740cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.868+0000 7f527c634640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f527406a910 0x7f52740d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.868+0000 7f527c634640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52740cd1f0 con 0x7f52741601f0 2023-07-14T13:11:15.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.868+0000 7f527c634640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52740cd4d0 con 0x7f527406a910 2023-07-14T13:11:15.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.868+0000 7f527c634640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52740cd7b0 con 0x7f527406a540 2023-07-14T13:11:15.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.868+0000 7f5279bcf640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f52741601f0 0x7f52740cca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43884/0 (socket says 172.21.15.5:43884) 2023-07-14T13:11:15.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.868+0000 7f5279bcf640 1 -- 172.21.15.5:0/1179007425 learned_addr learned my addr 172.21.15.5:0/1179007425 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:15.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.868+0000 7f527abd1640 1 --2- 172.21.15.5:0/1179007425 >> v2:172.21.15.5:3300/0 conn(0x7f527406a910 0x7f52740d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.868+0000 7f527a3d0640 1 --2- 172.21.15.5:0/1179007425 >> v2:172.21.15.154:3300/0 conn(0x7f527406a540 0x7f52740cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.868+0000 7f52793ce640 1 -- 172.21.15.5:0/1179007425 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078740592 0 0) 0x7f52740cd1f0 con 0x7f52741601f0 2023-07-14T13:11:15.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.868+0000 7f527abd1640 1 -- 172.21.15.5:0/1179007425 >> v2:172.21.15.154:3300/0 conn(0x7f527406a540 msgr2=0x7f52740cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:15.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.868+0000 7f527abd1640 1 --2- 172.21.15.5:0/1179007425 >> v2:172.21.15.154:3300/0 conn(0x7f527406a540 0x7f52740cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.868+0000 7f527abd1640 1 -- 172.21.15.5:0/1179007425 >> v1:172.21.15.5:6789/0 conn(0x7f52741601f0 legacy=0x7f52740cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:15.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.868+0000 7f527abd1640 1 -- 172.21.15.5:0/1179007425 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52740cfe40 con 0x7f527406a910 2023-07-14T13:11:15.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.868+0000 7f527a3d0640 1 --2- 172.21.15.5:0/1179007425 >> v2:172.21.15.154:3300/0 conn(0x7f527406a540 0x7f52740cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:11:15.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.872+0000 7f527abd1640 1 --2- 172.21.15.5:0/1179007425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527406a910 0x7f52740d0360 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f526c009d90 tx=0x7f526c01c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0cc74a1bacb1db9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:15.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.872+0000 7f52793ce640 1 -- 172.21.15.5:0/1179007425 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0a66f0 con 0x7f527406a910 2023-07-14T13:11:15.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.872+0000 7f52793ce640 1 -- 172.21.15.5:0/1179007425 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526c0a6850 con 0x7f527406a910 2023-07-14T13:11:15.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.872+0000 7f52793ce640 1 -- 172.21.15.5:0/1179007425 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0a6be0 con 0x7f527406a910 2023-07-14T13:11:15.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.872+0000 7f527c634640 1 -- 172.21.15.5:0/1179007425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527406a910 msgr2=0x7f52740d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:15.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.872+0000 7f527c634640 1 --2- 172.21.15.5:0/1179007425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527406a910 0x7f52740d0360 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f526c009d90 tx=0x7f526c01c7f0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.872+0000 7f527c634640 1 -- 172.21.15.5:0/1179007425 shutdown_connections 2023-07-14T13:11:15.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.872+0000 7f527c634640 1 --2- 172.21.15.5:0/1179007425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527406a910 0x7f52740d0360 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.872+0000 7f527c634640 1 --2- 172.21.15.5:0/1179007425 >> v2:172.21.15.154:3300/0 conn(0x7f527406a540 0x7f52740cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.872+0000 7f527c634640 1 -- 172.21.15.5:0/1179007425 >> 172.21.15.5:0/1179007425 conn(0x7f5274099490 msgr2=0x7f5274089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:15.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.872+0000 7f527c634640 1 -- 172.21.15.5:0/1179007425 shutdown_connections 2023-07-14T13:11:15.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.872+0000 7f527c634640 1 -- 172.21.15.5:0/1179007425 wait complete. 2023-07-14T13:11:15.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.876+0000 7f527c634640 1 Processor -- start 2023-07-14T13:11:15.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.876+0000 7f527c634640 1 -- start start 2023-07-14T13:11:15.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.876+0000 7f527c634640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f527406a540 0x7f527414d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.876+0000 7f527c634640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527406a910 0x7f527415d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.876+0000 7f527c634640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52741601f0 0x7f527415f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.876+0000 7f527c634640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527414d650 con 0x7f527406a910 2023-07-14T13:11:15.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.876+0000 7f527c634640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527415da80 con 0x7f527406a540 2023-07-14T13:11:15.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.876+0000 7f527c634640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f527415f720 con 0x7f52741601f0 2023-07-14T13:11:15.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.876+0000 7f5279bcf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527406a910 0x7f527415d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.876+0000 7f5279bcf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527406a910 0x7f527415d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35800/0 (socket says 172.21.15.5:35800) 2023-07-14T13:11:15.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.876+0000 7f5279bcf640 1 -- 172.21.15.5:0/4183779663 learned_addr learned my addr 172.21.15.5:0/4183779663 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:15.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.876+0000 7f527abd1640 1 --2- 172.21.15.5:0/4183779663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52741601f0 0x7f527415f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.876+0000 7f527a3d0640 1 --2- 172.21.15.5:0/4183779663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f527406a540 0x7f527414d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.876+0000 7f5279bcf640 1 -- 172.21.15.5:0/4183779663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52741601f0 msgr2=0x7f527415f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:15.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.876+0000 7f5279bcf640 1 --2- 172.21.15.5:0/4183779663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52741601f0 0x7f527415f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.876+0000 7f5279bcf640 1 -- 172.21.15.5:0/4183779663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f527406a540 msgr2=0x7f527414d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:15.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.876+0000 7f5279bcf640 1 --2- 172.21.15.5:0/4183779663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f527406a540 0x7f527414d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.876+0000 7f5279bcf640 1 -- 172.21.15.5:0/4183779663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526c009a70 con 0x7f527406a910 2023-07-14T13:11:15.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.876+0000 7f5279bcf640 1 --2- 172.21.15.5:0/4183779663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527406a910 0x7f527415d540 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f526400c4b0 tx=0x7f526400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:15.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.876+0000 7f526affd640 1 -- 172.21.15.5:0/4183779663 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52640074e0 con 0x7f527406a910 2023-07-14T13:11:15.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.876+0000 7f526affd640 1 -- 172.21.15.5:0/4183779663 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5264007660 con 0x7f527406a910 2023-07-14T13:11:15.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.876+0000 7f526affd640 1 -- 172.21.15.5:0/4183779663 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5264004a30 con 0x7f527406a910 2023-07-14T13:11:15.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.876+0000 7f527c634640 1 -- 172.21.15.5:0/4183779663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52740ae110 con 0x7f527406a910 2023-07-14T13:11:15.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.876+0000 7f527c634640 1 -- 172.21.15.5:0/4183779663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f527415e270 con 0x7f527406a910 2023-07-14T13:11:15.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.876+0000 7f527c634640 1 -- 172.21.15.5:0/4183779663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52740678d0 con 0x7f527406a910 2023-07-14T13:11:15.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.880+0000 7f526affd640 1 -- 172.21.15.5:0/4183779663 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5264004b90 con 0x7f527406a910 2023-07-14T13:11:15.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.880+0000 7f526affd640 1 --2- 172.21.15.5:0/4183779663 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f52580663a0 0x7f5258068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.880+0000 7f526affd640 1 -- 172.21.15.5:0/4183779663 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 7038+0+0 (secure 0 0 0) 0x7f5264083400 con 0x7f527406a910 2023-07-14T13:11:15.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.880+0000 7f527a3d0640 1 --2- 172.21.15.5:0/4183779663 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f52580663a0 0x7f5258068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.880+0000 7f527a3d0640 1 --2- 172.21.15.5:0/4183779663 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f52580663a0 0x7f5258068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5270006fd0 tx=0x7f5270008040 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:15.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:15.884+0000 7f526affd640 1 -- 172.21.15.5:0/4183779663 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f5264050470 con 0x7f527406a910 2023-07-14T13:11:16.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.072+0000 7f527c634640 1 -- 172.21.15.5:0/4183779663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f52740999b0 con 0x7f527406a910 2023-07-14T13:11:16.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.756+0000 7f526affd640 1 -- 172.21.15.5:0/4183779663 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v51) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5264053a90 con 0x7f527406a910 2023-07-14T13:11:16.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.760+0000 7f527c634640 1 -- 172.21.15.5:0/4183779663 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f52580663a0 msgr2=0x7f5258068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:16.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.760+0000 7f527c634640 1 --2- 172.21.15.5:0/4183779663 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f52580663a0 0x7f5258068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5270006fd0 tx=0x7f5270008040 comp rx=0 tx=0).stop 2023-07-14T13:11:16.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.760+0000 7f527c634640 1 -- 172.21.15.5:0/4183779663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527406a910 msgr2=0x7f527415d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:16.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.760+0000 7f527c634640 1 --2- 172.21.15.5:0/4183779663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527406a910 0x7f527415d540 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f526400c4b0 tx=0x7f526400c970 comp rx=0 tx=0).stop 2023-07-14T13:11:16.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.760+0000 7f527c634640 1 -- 172.21.15.5:0/4183779663 shutdown_connections 2023-07-14T13:11:16.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.760+0000 7f527c634640 1 --2- 172.21.15.5:0/4183779663 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f52580663a0 0x7f5258068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:16.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.760+0000 7f527c634640 1 --2- 172.21.15.5:0/4183779663 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52741601f0 0x7f527415f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:16.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.760+0000 7f527c634640 1 --2- 172.21.15.5:0/4183779663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f527406a910 0x7f527415d540 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:16.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.760+0000 7f527c634640 1 --2- 172.21.15.5:0/4183779663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f527406a540 0x7f527414d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:16.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.760+0000 7f527c634640 1 -- 172.21.15.5:0/4183779663 >> 172.21.15.5:0/4183779663 conn(0x7f5274099490 msgr2=0x7f52740afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:16.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.760+0000 7f527c634640 1 -- 172.21.15.5:0/4183779663 shutdown_connections 2023-07-14T13:11:16.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.760+0000 7f527c634640 1 -- 172.21.15.5:0/4183779663 wait complete. 2023-07-14T13:11:16.818 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-14T13:11:17.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.980+0000 7f1a56acb640 1 Processor -- start 2023-07-14T13:11:17.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.980+0000 7f1a56acb640 1 -- start start 2023-07-14T13:11:17.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.980+0000 7f1a56acb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1a5015bde0 0x7f1a500d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:17.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.980+0000 7f1a56acb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1a500d2fc0 0x7f1a500b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:17.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.980+0000 7f1a56acb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a500d2300 0x7f1a500d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:17.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.980+0000 7f1a56acb640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a5015c1b0 con 0x7f1a5015bde0 2023-07-14T13:11:17.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.980+0000 7f1a56acb640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a500d2cc0 con 0x7f1a500d2fc0 2023-07-14T13:11:17.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.980+0000 7f1a56acb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a500b04c0 con 0x7f1a500d2300 2023-07-14T13:11:17.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.980+0000 7f1a54867640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1a5015bde0 0x7f1a500d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:17.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.980+0000 7f1a54867640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1a5015bde0 0x7f1a500d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35810/0 (socket says 172.21.15.5:35810) 2023-07-14T13:11:17.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.980+0000 7f1a54867640 1 -- 172.21.15.5:0/3446037638 learned_addr learned my addr 172.21.15.5:0/3446037638 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:17.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.980+0000 7f1a4ffff640 1 --2- 172.21.15.5:0/3446037638 >> v2:172.21.15.154:3300/0 conn(0x7f1a500d2fc0 0x7f1a500b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:17.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.980+0000 7f1a54867640 1 -- 172.21.15.5:0/3446037638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a500d2300 msgr2=0x7f1a500d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:17.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.980+0000 7f1a55068640 1 --2- 172.21.15.5:0/3446037638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a500d2300 0x7f1a500d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:17.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.980+0000 7f1a54867640 1 --2- 172.21.15.5:0/3446037638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a500d2300 0x7f1a500d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:17.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.980+0000 7f1a54867640 1 -- 172.21.15.5:0/3446037638 >> v2:172.21.15.154:3300/0 conn(0x7f1a500d2fc0 msgr2=0x7f1a500b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:17.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.980+0000 7f1a54867640 1 --2- 172.21.15.5:0/3446037638 >> v2:172.21.15.154:3300/0 conn(0x7f1a500d2fc0 0x7f1a500b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:17.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.980+0000 7f1a54867640 1 -- 172.21.15.5:0/3446037638 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a500d0aa0 con 0x7f1a5015bde0 2023-07-14T13:11:17.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.980+0000 7f1a4ffff640 1 --2- 172.21.15.5:0/3446037638 >> v2:172.21.15.154:3300/0 conn(0x7f1a500d2fc0 0x7f1a500b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:11:17.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.980+0000 7f1a55068640 1 --2- 172.21.15.5:0/3446037638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a500d2300 0x7f1a500d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:11:17.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.984+0000 7f1a54867640 1 --2- 172.21.15.5:0/3446037638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a5015bde0 0x7f1a500d0270 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f1a5008c600 tx=0x7f1a4401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31281a463b0a1ff4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:17.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.984+0000 7f1a4f7fe640 1 -- 172.21.15.5:0/3446037638 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a440aa620 con 0x7f1a5015bde0 2023-07-14T13:11:17.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.984+0000 7f1a4f7fe640 1 -- 172.21.15.5:0/3446037638 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a440aa780 con 0x7f1a5015bde0 2023-07-14T13:11:17.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.984+0000 7f1a4f7fe640 1 -- 172.21.15.5:0/3446037638 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a440aab10 con 0x7f1a5015bde0 2023-07-14T13:11:17.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.984+0000 7f1a56acb640 1 -- 172.21.15.5:0/3446037638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a5015bde0 msgr2=0x7f1a500d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:17.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.984+0000 7f1a56acb640 1 --2- 172.21.15.5:0/3446037638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a5015bde0 0x7f1a500d0270 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f1a5008c600 tx=0x7f1a4401c500 comp rx=0 tx=0).stop 2023-07-14T13:11:17.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.984+0000 7f1a56acb640 1 -- 172.21.15.5:0/3446037638 shutdown_connections 2023-07-14T13:11:17.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.984+0000 7f1a56acb640 1 --2- 172.21.15.5:0/3446037638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a500d2300 0x7f1a500d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:17.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.984+0000 7f1a56acb640 1 --2- 172.21.15.5:0/3446037638 >> v2:172.21.15.154:3300/0 conn(0x7f1a500d2fc0 0x7f1a500b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:17.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.984+0000 7f1a56acb640 1 --2- 172.21.15.5:0/3446037638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a5015bde0 0x7f1a500d0270 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:17.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.984+0000 7f1a56acb640 1 -- 172.21.15.5:0/3446037638 >> 172.21.15.5:0/3446037638 conn(0x7f1a500659d0 msgr2=0x7f1a5009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:17.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.984+0000 7f1a56acb640 1 -- 172.21.15.5:0/3446037638 shutdown_connections 2023-07-14T13:11:17.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.984+0000 7f1a56acb640 1 -- 172.21.15.5:0/3446037638 wait complete. 2023-07-14T13:11:17.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.988+0000 7f1a56acb640 1 Processor -- start 2023-07-14T13:11:17.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.988+0000 7f1a56acb640 1 -- start start 2023-07-14T13:11:17.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.988+0000 7f1a56acb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a500d2300 0x7f1a5014ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:17.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.988+0000 7f1a56acb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a500d2fc0 0x7f1a500ce610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:17.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.988+0000 7f1a56acb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a5015bde0 0x7f1a500c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:17.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.988+0000 7f1a56acb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a500b1410 con 0x7f1a500d2fc0 2023-07-14T13:11:17.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.988+0000 7f1a56acb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a501504b0 con 0x7f1a5015bde0 2023-07-14T13:11:17.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.988+0000 7f1a56acb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5015c820 con 0x7f1a500d2300 2023-07-14T13:11:17.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.988+0000 7f1a4ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a500d2fc0 0x7f1a500ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:17.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.988+0000 7f1a4ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a500d2fc0 0x7f1a500ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35816/0 (socket says 172.21.15.5:35816) 2023-07-14T13:11:17.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.988+0000 7f1a4ffff640 1 -- 172.21.15.5:0/480111520 learned_addr learned my addr 172.21.15.5:0/480111520 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:17.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.988+0000 7f1a54867640 1 --2- 172.21.15.5:0/480111520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a500d2300 0x7f1a5014ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:17.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.988+0000 7f1a55068640 1 --2- 172.21.15.5:0/480111520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a5015bde0 0x7f1a500c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:17.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.988+0000 7f1a4ffff640 1 -- 172.21.15.5:0/480111520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a500d2300 msgr2=0x7f1a5014ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:17.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.988+0000 7f1a4ffff640 1 --2- 172.21.15.5:0/480111520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a500d2300 0x7f1a5014ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:17.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.988+0000 7f1a4ffff640 1 -- 172.21.15.5:0/480111520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a5015bde0 msgr2=0x7f1a500c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:17.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.988+0000 7f1a4ffff640 1 --2- 172.21.15.5:0/480111520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a5015bde0 0x7f1a500c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:17.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.988+0000 7f1a4ffff640 1 -- 172.21.15.5:0/480111520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a44009480 con 0x7f1a500d2fc0 2023-07-14T13:11:17.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.988+0000 7f1a54867640 1 --2- 172.21.15.5:0/480111520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a500d2300 0x7f1a5014ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:11:17.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.988+0000 7f1a55068640 1 --2- 172.21.15.5:0/480111520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a5015bde0 0x7f1a500c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:11:17.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.988+0000 7f1a4ffff640 1 --2- 172.21.15.5:0/480111520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a500d2fc0 0x7f1a500ce610 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00c7f0 tx=0x7f1a3c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:17.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.992+0000 7f1a4d7fa640 1 -- 172.21.15.5:0/480111520 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c004220 con 0x7f1a500d2fc0 2023-07-14T13:11:17.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.992+0000 7f1a4d7fa640 1 -- 172.21.15.5:0/480111520 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3c004380 con 0x7f1a500d2fc0 2023-07-14T13:11:17.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.992+0000 7f1a4d7fa640 1 -- 172.21.15.5:0/480111520 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c003840 con 0x7f1a500d2fc0 2023-07-14T13:11:17.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.992+0000 7f1a56acb640 1 -- 172.21.15.5:0/480111520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5015cb00 con 0x7f1a500d2fc0 2023-07-14T13:11:17.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.992+0000 7f1a56acb640 1 -- 172.21.15.5:0/480111520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a500ceb50 con 0x7f1a500d2fc0 2023-07-14T13:11:17.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.992+0000 7f1a56acb640 1 -- 172.21.15.5:0/480111520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a500b15c0 con 0x7f1a500d2fc0 2023-07-14T13:11:17.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.992+0000 7f1a4d7fa640 1 -- 172.21.15.5:0/480111520 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1a3c003bb0 con 0x7f1a500d2fc0 2023-07-14T13:11:17.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.992+0000 7f1a4d7fa640 1 --2- 172.21.15.5:0/480111520 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f1a340663a0 0x7f1a34068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:17.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.992+0000 7f1a4d7fa640 1 -- 172.21.15.5:0/480111520 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 7038+0+0 (secure 0 0 0) 0x7f1a3c0842c0 con 0x7f1a500d2fc0 2023-07-14T13:11:17.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.992+0000 7f1a54867640 1 --2- 172.21.15.5:0/480111520 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f1a340663a0 0x7f1a34068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:17.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.996+0000 7f1a54867640 1 --2- 172.21.15.5:0/480111520 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f1a340663a0 0x7f1a34068850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1a440ae000 tx=0x7f1a440a7000 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:17.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:16.996+0000 7f1a4d7fa640 1 -- 172.21.15.5:0/480111520 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f1a3c051150 con 0x7f1a500d2fc0 2023-07-14T13:11:17.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:17.152+0000 7f1a56acb640 1 -- 172.21.15.5:0/480111520 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1a5015cfb0 con 0x7f1a500d2fc0 2023-07-14T13:11:17.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:17.836+0000 7f1a4d7fa640 1 -- 172.21.15.5:0/480111520 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v117) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1a3c003e60 con 0x7f1a500d2fc0 2023-07-14T13:11:17.871 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-07-14T13:11:17.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:17.840+0000 7f1a56acb640 1 -- 172.21.15.5:0/480111520 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f1a340663a0 msgr2=0x7f1a34068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:17.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:17.840+0000 7f1a56acb640 1 --2- 172.21.15.5:0/480111520 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f1a340663a0 0x7f1a34068850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1a440ae000 tx=0x7f1a440a7000 comp rx=0 tx=0).stop 2023-07-14T13:11:17.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:17.840+0000 7f1a56acb640 1 -- 172.21.15.5:0/480111520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a500d2fc0 msgr2=0x7f1a500ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:17.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:17.840+0000 7f1a56acb640 1 --2- 172.21.15.5:0/480111520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a500d2fc0 0x7f1a500ce610 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00c7f0 tx=0x7f1a3c00ccb0 comp rx=0 tx=0).stop 2023-07-14T13:11:17.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:17.840+0000 7f1a56acb640 1 -- 172.21.15.5:0/480111520 shutdown_connections 2023-07-14T13:11:17.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:17.840+0000 7f1a56acb640 1 --2- 172.21.15.5:0/480111520 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f1a340663a0 0x7f1a34068850 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:17.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:17.840+0000 7f1a56acb640 1 --2- 172.21.15.5:0/480111520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a5015bde0 0x7f1a500c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:17.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:17.840+0000 7f1a56acb640 1 --2- 172.21.15.5:0/480111520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a500d2fc0 0x7f1a500ce610 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:17.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:17.840+0000 7f1a56acb640 1 --2- 172.21.15.5:0/480111520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a500d2300 0x7f1a5014ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:17.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:17.840+0000 7f1a56acb640 1 -- 172.21.15.5:0/480111520 >> 172.21.15.5:0/480111520 conn(0x7f1a500659d0 msgr2=0x7f1a501523c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:17.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:17.840+0000 7f1a56acb640 1 -- 172.21.15.5:0/480111520 shutdown_connections 2023-07-14T13:11:17.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:17.840+0000 7f1a56acb640 1 -- 172.21.15.5:0/480111520 wait complete. 2023-07-14T13:11:17.899 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-14T13:11:18.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.016+0000 7ff96e06d640 1 Processor -- start 2023-07-14T13:11:18.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.016+0000 7ff96e06d640 1 -- start start 2023-07-14T13:11:18.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.016+0000 7ff96e06d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff96815bde0 0x7ff9680d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:18.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.016+0000 7ff96e06d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9680b04c0 con 0x7ff9680d2300 2023-07-14T13:11:18.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.016+0000 7ff96e06d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9680b1060 con 0x7ff9680d2fc0 2023-07-14T13:11:18.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.016+0000 7ff96e06d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96815c1b0 con 0x7ff96815bde0 2023-07-14T13:11:18.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.016+0000 7ff967fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff9680d2300 0x7ff9680cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43888/0 (socket says 172.21.15.5:43888) 2023-07-14T13:11:18.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.016+0000 7ff967fff640 1 -- 172.21.15.5:0/281065278 learned_addr learned my addr 172.21.15.5:0/281065278 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:18.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.016+0000 7ff9677fe640 1 --2- 172.21.15.5:0/281065278 >> v2:172.21.15.154:3300/0 conn(0x7ff96815bde0 0x7ff9680d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:18.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.016+0000 7ff9667fc640 1 -- 172.21.15.5:0/281065278 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 169716838 0 0) 0x7ff9680b04c0 con 0x7ff9680d2300 2023-07-14T13:11:18.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.016+0000 7ff9667fc640 1 -- 172.21.15.5:0/281065278 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff950003530 con 0x7ff9680d2300 2023-07-14T13:11:18.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.016+0000 7ff9667fc640 1 -- 172.21.15.5:0/281065278 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3884779408 0 0) 0x7ff9680b1060 con 0x7ff9680d2fc0 2023-07-14T13:11:18.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.016+0000 7ff9667fc640 1 -- 172.21.15.5:0/281065278 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9680b04c0 con 0x7ff9680d2fc0 2023-07-14T13:11:18.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.020+0000 7ff9677fe640 1 -- 172.21.15.5:0/281065278 >> v1:172.21.15.154:6789/0 conn(0x7ff9680d2fc0 legacy=0x7ff9680b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:18.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.020+0000 7ff9667fc640 1 -- 172.21.15.5:0/281065278 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3549217334 0 0) 0x7ff950003530 con 0x7ff9680d2300 2023-07-14T13:11:18.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.020+0000 7ff9677fe640 1 -- 172.21.15.5:0/281065278 >> v1:172.21.15.5:6789/0 conn(0x7ff9680d2300 legacy=0x7ff9680cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:18.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.020+0000 7ff9677fe640 1 -- 172.21.15.5:0/281065278 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9680d0aa0 con 0x7ff96815bde0 2023-07-14T13:11:18.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.020+0000 7ff9677fe640 1 --2- 172.21.15.5:0/281065278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff96815bde0 0x7ff9680d0270 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ff9580097a0 tx=0x7ff95801c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0e4392d4b3e46d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:18.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.020+0000 7ff9667fc640 1 -- 172.21.15.5:0/281065278 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9580ab660 con 0x7ff96815bde0 2023-07-14T13:11:18.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.020+0000 7ff9667fc640 1 -- 172.21.15.5:0/281065278 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9580ab7c0 con 0x7ff96815bde0 2023-07-14T13:11:18.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.020+0000 7ff9667fc640 1 -- 172.21.15.5:0/281065278 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9580abb50 con 0x7ff96815bde0 2023-07-14T13:11:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.020+0000 7ff96e06d640 1 -- 172.21.15.5:0/281065278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff96815bde0 msgr2=0x7ff9680d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.020+0000 7ff96e06d640 1 --2- 172.21.15.5:0/281065278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff96815bde0 0x7ff9680d0270 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ff9580097a0 tx=0x7ff95801c460 comp rx=0 tx=0).stop 2023-07-14T13:11:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.020+0000 7ff96e06d640 1 -- 172.21.15.5:0/281065278 shutdown_connections 2023-07-14T13:11:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.020+0000 7ff96e06d640 1 --2- 172.21.15.5:0/281065278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff96815bde0 0x7ff9680d0270 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.020+0000 7ff96e06d640 1 -- 172.21.15.5:0/281065278 >> 172.21.15.5:0/281065278 conn(0x7ff9680659d0 msgr2=0x7ff96809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.020+0000 7ff96e06d640 1 -- 172.21.15.5:0/281065278 shutdown_connections 2023-07-14T13:11:18.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.020+0000 7ff96e06d640 1 -- 172.21.15.5:0/281065278 wait complete. 2023-07-14T13:11:18.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.024+0000 7ff96e06d640 1 Processor -- start 2023-07-14T13:11:18.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.024+0000 7ff96e06d640 1 -- start start 2023-07-14T13:11:18.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.024+0000 7ff96e06d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9680d2300 0x7ff9680b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:18.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.024+0000 7ff96e06d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9680d2fc0 0x7ff96814d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:18.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.024+0000 7ff96e06d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff96815bde0 0x7ff968157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:18.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.024+0000 7ff96e06d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff968156a80 con 0x7ff9680d2300 2023-07-14T13:11:18.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.024+0000 7ff96e06d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9681f7b70 con 0x7ff9680d2fc0 2023-07-14T13:11:18.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.024+0000 7ff96e06d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9681f7e50 con 0x7ff96815bde0 2023-07-14T13:11:18.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.024+0000 7ff9677fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9680d2300 0x7ff9680b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:18.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.024+0000 7ff9677fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9680d2300 0x7ff9680b3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35824/0 (socket says 172.21.15.5:35824) 2023-07-14T13:11:18.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.024+0000 7ff9677fe640 1 -- 172.21.15.5:0/3022357013 learned_addr learned my addr 172.21.15.5:0/3022357013 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:18.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.024+0000 7ff9677fe640 1 -- 172.21.15.5:0/3022357013 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff96815bde0 msgr2=0x7ff968157260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:18.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.024+0000 7ff9677fe640 1 --2- 172.21.15.5:0/3022357013 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff96815bde0 0x7ff968157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:18.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.024+0000 7ff9677fe640 1 -- 172.21.15.5:0/3022357013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9680d2fc0 msgr2=0x7ff96814d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:18.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.024+0000 7ff966ffd640 1 --2- 172.21.15.5:0/3022357013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9680d2fc0 0x7ff96814d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:18.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.024+0000 7ff9677fe640 1 --2- 172.21.15.5:0/3022357013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9680d2fc0 0x7ff96814d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:18.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.024+0000 7ff9677fe640 1 -- 172.21.15.5:0/3022357013 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9580093b0 con 0x7ff9680d2300 2023-07-14T13:11:18.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.024+0000 7ff966ffd640 1 --2- 172.21.15.5:0/3022357013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9680d2fc0 0x7ff96814d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:11:18.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.024+0000 7ff9677fe640 1 --2- 172.21.15.5:0/3022357013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9680d2300 0x7ff9680b3b00 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7ff9580ad040 tx=0x7ff95801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:18.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.024+0000 7ff94ffff640 1 -- 172.21.15.5:0/3022357013 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff958004220 con 0x7ff9680d2300 2023-07-14T13:11:18.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.024+0000 7ff94ffff640 1 -- 172.21.15.5:0/3022357013 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff958004380 con 0x7ff9680d2300 2023-07-14T13:11:18.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.024+0000 7ff96e06d640 1 -- 172.21.15.5:0/3022357013 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9681f8130 con 0x7ff9680d2300 2023-07-14T13:11:18.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.024+0000 7ff94ffff640 1 -- 172.21.15.5:0/3022357013 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff958003840 con 0x7ff9680d2300 2023-07-14T13:11:18.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.028+0000 7ff96e06d640 1 -- 172.21.15.5:0/3022357013 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96814d9c0 con 0x7ff9680d2300 2023-07-14T13:11:18.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.028+0000 7ff96e06d640 1 -- 172.21.15.5:0/3022357013 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9680678d0 con 0x7ff9680d2300 2023-07-14T13:11:18.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.028+0000 7ff94ffff640 1 -- 172.21.15.5:0/3022357013 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff9580a9070 con 0x7ff9680d2300 2023-07-14T13:11:18.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.028+0000 7ff94ffff640 1 --2- 172.21.15.5:0/3022357013 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7ff9540663a0 0x7ff954068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:18.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.028+0000 7ff94ffff640 1 -- 172.21.15.5:0/3022357013 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6600+0+0 (secure 0 0 0) 0x7ff95811e180 con 0x7ff9680d2300 2023-07-14T13:11:18.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.028+0000 7ff966ffd640 1 --2- 172.21.15.5:0/3022357013 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7ff9540663a0 0x7ff954068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:18.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.032+0000 7ff966ffd640 1 --2- 172.21.15.5:0/3022357013 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7ff9540663a0 0x7ff954068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff9681f7a30 tx=0x7ff95c009040 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:18.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.032+0000 7ff94ffff640 1 -- 172.21.15.5:0/3022357013 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff9580eb2e0 con 0x7ff9680d2300 2023-07-14T13:11:18.173 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:11:18.177 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:11:18.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.192+0000 7ff96e06d640 1 -- 172.21.15.5:0/3022357013 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff9681f85e0 con 0x7ff9680d2300 2023-07-14T13:11:18.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.852+0000 7ff94ffff640 1 -- 172.21.15.5:0/3022357013 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v118) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff9580044f0 con 0x7ff9680d2300 2023-07-14T13:11:18.887 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-07-14T13:11:18.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.856+0000 7ff96e06d640 1 -- 172.21.15.5:0/3022357013 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7ff9540663a0 msgr2=0x7ff954068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:18.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.856+0000 7ff96e06d640 1 --2- 172.21.15.5:0/3022357013 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7ff9540663a0 0x7ff954068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff9681f7a30 tx=0x7ff95c009040 comp rx=0 tx=0).stop 2023-07-14T13:11:18.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.856+0000 7ff96e06d640 1 -- 172.21.15.5:0/3022357013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9680d2300 msgr2=0x7ff9680b3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:18.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.856+0000 7ff96e06d640 1 --2- 172.21.15.5:0/3022357013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9680d2300 0x7ff9680b3b00 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7ff9580ad040 tx=0x7ff95801aca0 comp rx=0 tx=0).stop 2023-07-14T13:11:18.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.856+0000 7ff96e06d640 1 -- 172.21.15.5:0/3022357013 shutdown_connections 2023-07-14T13:11:18.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.856+0000 7ff96e06d640 1 --2- 172.21.15.5:0/3022357013 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7ff9540663a0 0x7ff954068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:18.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.856+0000 7ff96e06d640 1 --2- 172.21.15.5:0/3022357013 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff96815bde0 0x7ff968157260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:18.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.856+0000 7ff96e06d640 1 --2- 172.21.15.5:0/3022357013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9680d2fc0 0x7ff96814d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:18.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.856+0000 7ff96e06d640 1 --2- 172.21.15.5:0/3022357013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9680d2300 0x7ff9680b3b00 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:18.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.856+0000 7ff96e06d640 1 -- 172.21.15.5:0/3022357013 >> 172.21.15.5:0/3022357013 conn(0x7ff9680659d0 msgr2=0x7ff9680cf320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:18.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.856+0000 7ff96e06d640 1 -- 172.21.15.5:0/3022357013 shutdown_connections 2023-07-14T13:11:18.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:18.856+0000 7ff96e06d640 1 -- 172.21.15.5:0/3022357013 wait complete. 2023-07-14T13:11:18.916 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-14T13:11:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.080+0000 7f2a6b093640 1 Processor -- start 2023-07-14T13:11:19.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.080+0000 7f2a6b093640 1 -- start start 2023-07-14T13:11:19.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.080+0000 7f2a6b093640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a64071030 0x7f2a640ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:19.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.080+0000 7f2a6b093640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a640cbe50 con 0x7f2a6415e060 2023-07-14T13:11:19.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.080+0000 7f2a6b093640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a640cd660 con 0x7f2a64159a70 2023-07-14T13:11:19.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.080+0000 7f2a6b093640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a640cc0a0 con 0x7f2a64071030 2023-07-14T13:11:19.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.080+0000 7f2a69630640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2a6415e060 0x7f2a640c9da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42322/0 (socket says 172.21.15.5:42322) 2023-07-14T13:11:19.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.080+0000 7f2a69630640 1 -- 172.21.15.5:0/3816045404 learned_addr learned my addr 172.21.15.5:0/3816045404 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:19.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.080+0000 7f2a63fff640 1 --2- 172.21.15.5:0/3816045404 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a64071030 0x7f2a640ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:19.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.080+0000 7f2a637fe640 1 -- 172.21.15.5:0/3816045404 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1465762664 0 0) 0x7f2a640cbe50 con 0x7f2a6415e060 2023-07-14T13:11:19.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.084+0000 7f2a637fe640 1 -- 172.21.15.5:0/3816045404 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a54003530 con 0x7f2a6415e060 2023-07-14T13:11:19.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.084+0000 7f2a637fe640 1 -- 172.21.15.5:0/3816045404 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2632621569 0 0) 0x7f2a640cd660 con 0x7f2a64159a70 2023-07-14T13:11:19.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.084+0000 7f2a637fe640 1 -- 172.21.15.5:0/3816045404 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a640cbe50 con 0x7f2a64159a70 2023-07-14T13:11:19.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.084+0000 7f2a637fe640 1 -- 172.21.15.5:0/3816045404 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 650705791 0 0) 0x7f2a54003530 con 0x7f2a6415e060 2023-07-14T13:11:19.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.084+0000 7f2a637fe640 1 -- 172.21.15.5:0/3816045404 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a64071030 msgr2=0x7f2a640ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:19.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.084+0000 7f2a637fe640 1 --2- 172.21.15.5:0/3816045404 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a64071030 0x7f2a640ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.084+0000 7f2a637fe640 1 -- 172.21.15.5:0/3816045404 >> v1:172.21.15.154:6789/0 conn(0x7f2a64159a70 legacy=0x7f2a64070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:19.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.084+0000 7f2a637fe640 1 -- 172.21.15.5:0/3816045404 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a640cc380 con 0x7f2a6415e060 2023-07-14T13:11:19.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.084+0000 7f2a637fe640 1 -- 172.21.15.5:0/3816045404 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f2a5c001980 con 0x7f2a6415e060 2023-07-14T13:11:19.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.084+0000 7f2a637fe640 1 -- 172.21.15.5:0/3816045404 >> v1:172.21.15.5:6789/0 conn(0x7f2a6415e060 legacy=0x7f2a640c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:19.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.084+0000 7f2a637fe640 1 --2- 172.21.15.5:0/3816045404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a54003b40 0x7f2a54003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:19.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.084+0000 7f2a637fe640 1 --2- 172.21.15.5:0/3816045404 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a64071030 0x7f2a540047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:19.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.084+0000 7f2a637fe640 1 --2- 172.21.15.5:0/3816045404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a54004d10 0x7f2a54005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:19.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.084+0000 7f2a637fe640 1 -- 172.21.15.5:0/3816045404 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a640cc0a0 con 0x7f2a54003b40 2023-07-14T13:11:19.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.084+0000 7f2a637fe640 1 -- 172.21.15.5:0/3816045404 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5400bb70 con 0x7f2a54004d10 2023-07-14T13:11:19.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.084+0000 7f2a637fe640 1 -- 172.21.15.5:0/3816045404 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5400bd30 con 0x7f2a64071030 2023-07-14T13:11:19.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.084+0000 7f2a68e2f640 1 --2- 172.21.15.5:0/3816045404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a54003b40 0x7f2a54003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:19.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.084+0000 7f2a63fff640 1 --2- 172.21.15.5:0/3816045404 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a64071030 0x7f2a540047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:19.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.084+0000 7f2a69630640 1 --2- 172.21.15.5:0/3816045404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a54004d10 0x7f2a54005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:19.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.084+0000 7f2a68e2f640 1 -- 172.21.15.5:0/3816045404 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a64071030 msgr2=0x7f2a540047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:19.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.084+0000 7f2a68e2f640 1 --2- 172.21.15.5:0/3816045404 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a64071030 0x7f2a540047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.084+0000 7f2a68e2f640 1 -- 172.21.15.5:0/3816045404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a54004d10 msgr2=0x7f2a54005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:19.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.084+0000 7f2a68e2f640 1 --2- 172.21.15.5:0/3816045404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a54004d10 0x7f2a54005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.084+0000 7f2a68e2f640 1 -- 172.21.15.5:0/3816045404 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a54003530 con 0x7f2a54003b40 2023-07-14T13:11:19.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.088+0000 7f2a68e2f640 1 --2- 172.21.15.5:0/3816045404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a54003b40 0x7f2a54003f30 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f2a580018d0 tx=0x7f2a5801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147fc04d4c559595 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:19.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.088+0000 7f2a637fe640 1 -- 172.21.15.5:0/3816045404 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a580052d0 con 0x7f2a54003b40 2023-07-14T13:11:19.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.088+0000 7f2a637fe640 1 -- 172.21.15.5:0/3816045404 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a58005450 con 0x7f2a54003b40 2023-07-14T13:11:19.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.088+0000 7f2a637fe640 1 -- 172.21.15.5:0/3816045404 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a58003840 con 0x7f2a54003b40 2023-07-14T13:11:19.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.088+0000 7f2a6b093640 1 -- 172.21.15.5:0/3816045404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a54003b40 msgr2=0x7f2a54003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:19.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.088+0000 7f2a6b093640 1 --2- 172.21.15.5:0/3816045404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a54003b40 0x7f2a54003f30 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f2a580018d0 tx=0x7f2a5801c530 comp rx=0 tx=0).stop 2023-07-14T13:11:19.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.088+0000 7f2a69630640 1 -- 172.21.15.5:0/3816045404 reap_dead start 2023-07-14T13:11:19.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.088+0000 7f2a6b093640 1 -- 172.21.15.5:0/3816045404 shutdown_connections 2023-07-14T13:11:19.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.088+0000 7f2a6b093640 1 -- 172.21.15.5:0/3816045404 >> 172.21.15.5:0/3816045404 conn(0x7f2a640afac0 msgr2=0x7f2a640afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:19.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.088+0000 7f2a6b093640 1 -- 172.21.15.5:0/3816045404 shutdown_connections 2023-07-14T13:11:19.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.088+0000 7f2a6b093640 1 -- 172.21.15.5:0/3816045404 wait complete. 2023-07-14T13:11:19.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.088+0000 7f2a6b093640 1 Processor -- start 2023-07-14T13:11:19.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.088+0000 7f2a6b093640 1 -- start start 2023-07-14T13:11:19.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.088+0000 7f2a6b093640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a54003b40 0x7f2a640c9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:19.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.088+0000 7f2a6b093640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a640b1e10 0x7f2a6415a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:19.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.092+0000 7f2a6b093640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a640b2280 0x7f2a6415ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:19.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.092+0000 7f2a6b093640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a640b27f0 con 0x7f2a640b2280 2023-07-14T13:11:19.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.092+0000 7f2a6b093640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a640b2ad0 con 0x7f2a640b1e10 2023-07-14T13:11:19.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.092+0000 7f2a6b093640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6415a150 con 0x7f2a54003b40 2023-07-14T13:11:19.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.092+0000 7f2a69630640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a640b2280 0x7f2a6415ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:19.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.092+0000 7f2a69630640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a640b2280 0x7f2a6415ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39982/0 (socket says 172.21.15.5:39982) 2023-07-14T13:11:19.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.092+0000 7f2a69630640 1 -- 172.21.15.5:0/1002152904 learned_addr learned my addr 172.21.15.5:0/1002152904 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:19.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.092+0000 7f2a68e2f640 1 --2- 172.21.15.5:0/1002152904 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a54003b40 0x7f2a640c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:19.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.092+0000 7f2a63fff640 1 --2- 172.21.15.5:0/1002152904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a640b1e10 0x7f2a6415a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:19.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.092+0000 7f2a69630640 1 -- 172.21.15.5:0/1002152904 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a54003b40 msgr2=0x7f2a640c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:19.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.092+0000 7f2a69630640 1 --2- 172.21.15.5:0/1002152904 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a54003b40 0x7f2a640c9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.092+0000 7f2a69630640 1 -- 172.21.15.5:0/1002152904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a640b1e10 msgr2=0x7f2a6415a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:19.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.092+0000 7f2a69630640 1 --2- 172.21.15.5:0/1002152904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a640b1e10 0x7f2a6415a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.092+0000 7f2a69630640 1 -- 172.21.15.5:0/1002152904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6415a430 con 0x7f2a640b2280 2023-07-14T13:11:19.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.092+0000 7f2a69630640 1 --2- 172.21.15.5:0/1002152904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a640b2280 0x7f2a6415ae90 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c001340 tx=0x7f2a5c007740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:19.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.092+0000 7f2a617fa640 1 -- 172.21.15.5:0/1002152904 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c007a90 con 0x7f2a640b2280 2023-07-14T13:11:19.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.092+0000 7f2a617fa640 1 -- 172.21.15.5:0/1002152904 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5c013600 con 0x7f2a640b2280 2023-07-14T13:11:19.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.092+0000 7f2a6b093640 1 -- 172.21.15.5:0/1002152904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a640b2db0 con 0x7f2a640b2280 2023-07-14T13:11:19.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.092+0000 7f2a617fa640 1 -- 172.21.15.5:0/1002152904 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c0139b0 con 0x7f2a640b2280 2023-07-14T13:11:19.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.092+0000 7f2a6b093640 1 -- 172.21.15.5:0/1002152904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a640b3730 con 0x7f2a640b2280 2023-07-14T13:11:19.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.092+0000 7f2a6b093640 1 -- 172.21.15.5:0/1002152904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a640678d0 con 0x7f2a640b2280 2023-07-14T13:11:19.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.092+0000 7f2a617fa640 1 -- 172.21.15.5:0/1002152904 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2a5c013b10 con 0x7f2a640b2280 2023-07-14T13:11:19.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.092+0000 7f2a617fa640 1 --2- 172.21.15.5:0/1002152904 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f2a480663a0 0x7f2a48068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:19.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.096+0000 7f2a617fa640 1 -- 172.21.15.5:0/1002152904 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f2a5c0831f0 con 0x7f2a640b2280 2023-07-14T13:11:19.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.096+0000 7f2a68e2f640 1 --2- 172.21.15.5:0/1002152904 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f2a480663a0 0x7f2a48068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:19.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.096+0000 7f2a68e2f640 1 --2- 172.21.15.5:0/1002152904 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f2a480663a0 0x7f2a48068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2a580ad000 tx=0x7f2a580a7000 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:19.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.096+0000 7f2a617fa640 1 -- 172.21.15.5:0/1002152904 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2a5c050560 con 0x7f2a640b2280 2023-07-14T13:11:19.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.256+0000 7f2a6b093640 1 -- 172.21.15.5:0/1002152904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f2a6406a150 con 0x7f2a640b2280 2023-07-14T13:11:19.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.260+0000 7f2a617fa640 1 -- 172.21.15.5:0/1002152904 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v37) v1 ==== 120+0+0 (secure 0 0 0) 0x7f2a5c053b80 con 0x7f2a640b2280 2023-07-14T13:11:19.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.260+0000 7f2a6b093640 1 -- 172.21.15.5:0/1002152904 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f2a480663a0 msgr2=0x7f2a48068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:19.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.260+0000 7f2a6b093640 1 --2- 172.21.15.5:0/1002152904 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f2a480663a0 0x7f2a48068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2a580ad000 tx=0x7f2a580a7000 comp rx=0 tx=0).stop 2023-07-14T13:11:19.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.260+0000 7f2a6b093640 1 -- 172.21.15.5:0/1002152904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a640b2280 msgr2=0x7f2a6415ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:19.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.260+0000 7f2a6b093640 1 --2- 172.21.15.5:0/1002152904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a640b2280 0x7f2a6415ae90 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c001340 tx=0x7f2a5c007740 comp rx=0 tx=0).stop 2023-07-14T13:11:19.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.260+0000 7f2a6b093640 1 -- 172.21.15.5:0/1002152904 shutdown_connections 2023-07-14T13:11:19.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.260+0000 7f2a6b093640 1 --2- 172.21.15.5:0/1002152904 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f2a480663a0 0x7f2a48068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.260+0000 7f2a6b093640 1 --2- 172.21.15.5:0/1002152904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a640b2280 0x7f2a6415ae90 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.260+0000 7f2a6b093640 1 --2- 172.21.15.5:0/1002152904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a640b1e10 0x7f2a6415a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.260+0000 7f2a6b093640 1 --2- 172.21.15.5:0/1002152904 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a54003b40 0x7f2a640c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.260+0000 7f2a6b093640 1 -- 172.21.15.5:0/1002152904 >> 172.21.15.5:0/1002152904 conn(0x7f2a640afac0 msgr2=0x7f2a6406f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:19.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.260+0000 7f2a6b093640 1 -- 172.21.15.5:0/1002152904 shutdown_connections 2023-07-14T13:11:19.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.260+0000 7f2a6b093640 1 -- 172.21.15.5:0/1002152904 wait complete. 2023-07-14T13:11:19.317 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-14T13:11:19.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.432+0000 7f6cff59e640 1 Processor -- start 2023-07-14T13:11:19.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.432+0000 7f6cff59e640 1 -- start start 2023-07-14T13:11:19.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.436+0000 7f6cff59e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d0015c360 0x7f6d00141100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:19.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.436+0000 7f6cff59e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6d0006f080 0x7f6d0006f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:19.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.436+0000 7f6cff59e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d0006fa20 con 0x7f6d0015b230 2023-07-14T13:11:19.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.436+0000 7f6cff59e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d00141900 con 0x7f6d0006f080 2023-07-14T13:11:19.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.436+0000 7f6cff59e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d000cbb80 con 0x7f6d0015c360 2023-07-14T13:11:19.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.436+0000 7f6cfed9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6d0006f080 0x7f6d0006f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:19.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.436+0000 7f6cfed9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6d0006f080 0x7f6d0006f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39984/0 (socket says 172.21.15.5:39984) 2023-07-14T13:11:19.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.436+0000 7f6cfed9d640 1 -- 172.21.15.5:0/208191178 learned_addr learned my addr 172.21.15.5:0/208191178 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:19.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.436+0000 7f6cf7fff640 1 --2- 172.21.15.5:0/208191178 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d0015c360 0x7f6d00141100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:19.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.436+0000 7f6cfed9d640 1 -- 172.21.15.5:0/208191178 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d0015c360 msgr2=0x7f6d00141100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:19.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.436+0000 7f6cfed9d640 1 --2- 172.21.15.5:0/208191178 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d0015c360 0x7f6d00141100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.436+0000 7f6cfed9d640 1 -- 172.21.15.5:0/208191178 >> v1:172.21.15.154:6789/0 conn(0x7f6d0015b230 legacy=0x7f6d00159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:19.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.436+0000 7f6cfed9d640 1 -- 172.21.15.5:0/208191178 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d000cbe60 con 0x7f6d0006f080 2023-07-14T13:11:19.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.440+0000 7f6cfed9d640 1 --2- 172.21.15.5:0/208191178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0006f080 0x7f6d0006f4e0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800af60 tx=0x7f6cf801da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2b270c57757335 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:19.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.440+0000 7f6cfdd9b640 1 -- 172.21.15.5:0/208191178 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf800a2d0 con 0x7f6d0006f080 2023-07-14T13:11:19.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.440+0000 7f6cfdd9b640 1 -- 172.21.15.5:0/208191178 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf80a67f0 con 0x7f6d0006f080 2023-07-14T13:11:19.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.440+0000 7f6cfdd9b640 1 -- 172.21.15.5:0/208191178 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf80a6b80 con 0x7f6d0006f080 2023-07-14T13:11:19.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.440+0000 7f6cff59e640 1 -- 172.21.15.5:0/208191178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0006f080 msgr2=0x7f6d0006f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:19.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.440+0000 7f6cff59e640 1 --2- 172.21.15.5:0/208191178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0006f080 0x7f6d0006f4e0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800af60 tx=0x7f6cf801da80 comp rx=0 tx=0).stop 2023-07-14T13:11:19.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.440+0000 7f6cff59e640 1 -- 172.21.15.5:0/208191178 shutdown_connections 2023-07-14T13:11:19.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.440+0000 7f6cff59e640 1 --2- 172.21.15.5:0/208191178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0006f080 0x7f6d0006f4e0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.440+0000 7f6cff59e640 1 --2- 172.21.15.5:0/208191178 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d0015c360 0x7f6d00141100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.440+0000 7f6cff59e640 1 -- 172.21.15.5:0/208191178 >> 172.21.15.5:0/208191178 conn(0x7f6d000ca8b0 msgr2=0x7f6d000cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:19.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.440+0000 7f6cff59e640 1 -- 172.21.15.5:0/208191178 shutdown_connections 2023-07-14T13:11:19.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.440+0000 7f6cff59e640 1 -- 172.21.15.5:0/208191178 wait complete. 2023-07-14T13:11:19.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.440+0000 7f6cff59e640 1 Processor -- start 2023-07-14T13:11:19.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.440+0000 7f6cff59e640 1 -- start start 2023-07-14T13:11:19.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.440+0000 7f6cff59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0006f080 0x7f6d000c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:19.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.444+0000 7f6cff59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d0015b230 0x7f6d00157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:19.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.444+0000 7f6cff59e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d0015c360 0x7f6d000c9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:19.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.444+0000 7f6cff59e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d000c11c0 con 0x7f6d0006f080 2023-07-14T13:11:19.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.444+0000 7f6cff59e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d001561f0 con 0x7f6d0015b230 2023-07-14T13:11:19.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.444+0000 7f6cff59e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d00156440 con 0x7f6d0015c360 2023-07-14T13:11:19.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.444+0000 7f6cfe59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0006f080 0x7f6d000c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:19.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.444+0000 7f6cfe59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0006f080 0x7f6d000c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39990/0 (socket says 172.21.15.5:39990) 2023-07-14T13:11:19.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.444+0000 7f6cfe59c640 1 -- 172.21.15.5:0/3631632596 learned_addr learned my addr 172.21.15.5:0/3631632596 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:19.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.444+0000 7f6cf7fff640 1 --2- 172.21.15.5:0/3631632596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d0015b230 0x7f6d00157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:19.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.444+0000 7f6cfed9d640 1 --2- 172.21.15.5:0/3631632596 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d0015c360 0x7f6d000c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:19.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.444+0000 7f6cfe59c640 1 -- 172.21.15.5:0/3631632596 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d0015c360 msgr2=0x7f6d000c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:19.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.444+0000 7f6cfe59c640 1 --2- 172.21.15.5:0/3631632596 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d0015c360 0x7f6d000c9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.444+0000 7f6cfe59c640 1 -- 172.21.15.5:0/3631632596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d0015b230 msgr2=0x7f6d00157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.444+0000 7f6cfe59c640 1 --2- 172.21.15.5:0/3631632596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d0015b230 0x7f6d00157530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.444+0000 7f6cfe59c640 1 -- 172.21.15.5:0/3631632596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf800ac40 con 0x7f6d0006f080 2023-07-14T13:11:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.444+0000 7f6cfe59c640 1 --2- 172.21.15.5:0/3631632596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0006f080 0x7f6d000c0c80 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000c500 tx=0x7f6cf000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.444+0000 7f6cf6ffd640 1 -- 172.21.15.5:0/3631632596 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0005220 con 0x7f6d0006f080 2023-07-14T13:11:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.444+0000 7f6cf6ffd640 1 -- 172.21.15.5:0/3631632596 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf0005380 con 0x7f6d0006f080 2023-07-14T13:11:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.444+0000 7f6cf6ffd640 1 -- 172.21.15.5:0/3631632596 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0007270 con 0x7f6d0006f080 2023-07-14T13:11:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.444+0000 7f6cff59e640 1 -- 172.21.15.5:0/3631632596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d00156720 con 0x7f6d0006f080 2023-07-14T13:11:19.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.444+0000 7f6cff59e640 1 -- 172.21.15.5:0/3631632596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d00156ce0 con 0x7f6d0006f080 2023-07-14T13:11:19.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.444+0000 7f6cff59e640 1 -- 172.21.15.5:0/3631632596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d0004e020 con 0x7f6d0006f080 2023-07-14T13:11:19.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.444+0000 7f6cf6ffd640 1 -- 172.21.15.5:0/3631632596 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6cf00073d0 con 0x7f6d0006f080 2023-07-14T13:11:19.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.448+0000 7f6cf6ffd640 1 --2- 172.21.15.5:0/3631632596 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f6ce00663a0 0x7f6ce0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:19.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.448+0000 7f6cf6ffd640 1 -- 172.21.15.5:0/3631632596 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f6cf0083700 con 0x7f6d0006f080 2023-07-14T13:11:19.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.448+0000 7f6cf7fff640 1 --2- 172.21.15.5:0/3631632596 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f6ce00663a0 0x7f6ce0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:19.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.448+0000 7f6cf7fff640 1 --2- 172.21.15.5:0/3631632596 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f6ce00663a0 0x7f6ce0068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6d00141360 tx=0x7f6ce8009190 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:19.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.452+0000 7f6cf6ffd640 1 -- 172.21.15.5:0/3631632596 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6cf0050a80 con 0x7f6d0006f080 2023-07-14T13:11:19.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.604+0000 7f6cff59e640 1 -- 172.21.15.5:0/3631632596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6d000b0720 con 0x7f6d0006f080 2023-07-14T13:11:19.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.612+0000 7f6cf6ffd640 1 -- 172.21.15.5:0/3631632596 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v38) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6cf00540a0 con 0x7f6d0006f080 2023-07-14T13:11:19.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.612+0000 7f6cff59e640 1 -- 172.21.15.5:0/3631632596 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f6ce00663a0 msgr2=0x7f6ce0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:19.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.612+0000 7f6cff59e640 1 --2- 172.21.15.5:0/3631632596 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f6ce00663a0 0x7f6ce0068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6d00141360 tx=0x7f6ce8009190 comp rx=0 tx=0).stop 2023-07-14T13:11:19.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.612+0000 7f6cff59e640 1 -- 172.21.15.5:0/3631632596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0006f080 msgr2=0x7f6d000c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:19.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.612+0000 7f6cff59e640 1 --2- 172.21.15.5:0/3631632596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0006f080 0x7f6d000c0c80 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000c500 tx=0x7f6cf000c9c0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.612+0000 7f6cff59e640 1 -- 172.21.15.5:0/3631632596 shutdown_connections 2023-07-14T13:11:19.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.612+0000 7f6cff59e640 1 --2- 172.21.15.5:0/3631632596 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f6ce00663a0 0x7f6ce0068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.612+0000 7f6cff59e640 1 --2- 172.21.15.5:0/3631632596 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d0015c360 0x7f6d000c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.612+0000 7f6cff59e640 1 --2- 172.21.15.5:0/3631632596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d0015b230 0x7f6d00157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.612+0000 7f6cff59e640 1 --2- 172.21.15.5:0/3631632596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d0006f080 0x7f6d000c0c80 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.612+0000 7f6cff59e640 1 -- 172.21.15.5:0/3631632596 >> 172.21.15.5:0/3631632596 conn(0x7f6d000ca8b0 msgr2=0x7f6d00159460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:19.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.612+0000 7f6cff59e640 1 -- 172.21.15.5:0/3631632596 shutdown_connections 2023-07-14T13:11:19.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.612+0000 7f6cff59e640 1 -- 172.21.15.5:0/3631632596 wait complete. 2023-07-14T13:11:19.667 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-14T13:11:19.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.776+0000 7fae349d2640 1 Processor -- start 2023-07-14T13:11:19.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.776+0000 7fae349d2640 1 -- start start 2023-07-14T13:11:19.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.776+0000 7fae349d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae300cc960 0x7fae300ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:19.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.776+0000 7fae349d2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae30160750 0x7fae3015c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:19.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.776+0000 7fae349d2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae300cd270 con 0x7fae300b1620 2023-07-14T13:11:19.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.776+0000 7fae349d2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae300cf710 con 0x7fae30160750 2023-07-14T13:11:19.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.776+0000 7fae349d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae300cf430 con 0x7fae300cc960 2023-07-14T13:11:19.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.776+0000 7fae2f59e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae30160750 0x7fae3015c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:19.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.776+0000 7fae2f59e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae30160750 0x7fae3015c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40006/0 (socket says 172.21.15.5:40006) 2023-07-14T13:11:19.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.776+0000 7fae2f59e640 1 -- 172.21.15.5:0/2171622826 learned_addr learned my addr 172.21.15.5:0/2171622826 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:19.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.780+0000 7fae2ed9d640 1 --2- 172.21.15.5:0/2171622826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae300cc960 0x7fae300ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:19.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.780+0000 7fae2f59e640 1 -- 172.21.15.5:0/2171622826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae300cc960 msgr2=0x7fae300ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:19.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.780+0000 7fae2f59e640 1 --2- 172.21.15.5:0/2171622826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae300cc960 0x7fae300ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.780+0000 7fae2f59e640 1 -- 172.21.15.5:0/2171622826 >> v1:172.21.15.154:6789/0 conn(0x7fae300b1620 legacy=0x7fae300ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:19.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.780+0000 7fae2f59e640 1 -- 172.21.15.5:0/2171622826 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3015fc70 con 0x7fae30160750 2023-07-14T13:11:19.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.780+0000 7fae2f59e640 1 --2- 172.21.15.5:0/2171622826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae30160750 0x7fae3015c310 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fae28009e50 tx=0x7fae2801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d292b031ee93ecf0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:19.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.780+0000 7fae2dd9b640 1 -- 172.21.15.5:0/2171622826 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae280a58a0 con 0x7fae30160750 2023-07-14T13:11:19.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.780+0000 7fae2dd9b640 1 -- 172.21.15.5:0/2171622826 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae280a5a00 con 0x7fae30160750 2023-07-14T13:11:19.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.780+0000 7fae2dd9b640 1 -- 172.21.15.5:0/2171622826 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae280a5d90 con 0x7fae30160750 2023-07-14T13:11:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.784+0000 7fae349d2640 1 -- 172.21.15.5:0/2171622826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae30160750 msgr2=0x7fae3015c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.784+0000 7fae349d2640 1 --2- 172.21.15.5:0/2171622826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae30160750 0x7fae3015c310 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fae28009e50 tx=0x7fae2801c9e0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.784+0000 7fae349d2640 1 -- 172.21.15.5:0/2171622826 shutdown_connections 2023-07-14T13:11:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.784+0000 7fae349d2640 1 --2- 172.21.15.5:0/2171622826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae30160750 0x7fae3015c310 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.784+0000 7fae349d2640 1 --2- 172.21.15.5:0/2171622826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae300cc960 0x7fae300ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.784+0000 7fae349d2640 1 -- 172.21.15.5:0/2171622826 >> 172.21.15.5:0/2171622826 conn(0x7fae30069f50 msgr2=0x7fae3006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:19.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.784+0000 7fae349d2640 1 -- 172.21.15.5:0/2171622826 shutdown_connections 2023-07-14T13:11:19.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.784+0000 7fae349d2640 1 -- 172.21.15.5:0/2171622826 wait complete. 2023-07-14T13:11:19.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.784+0000 7fae349d2640 1 Processor -- start 2023-07-14T13:11:19.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.784+0000 7fae349d2640 1 -- start start 2023-07-14T13:11:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.784+0000 7fae349d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae300b1620 0x7fae3015b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.784+0000 7fae349d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae300cc960 0x7fae300c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.784+0000 7fae349d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae30160750 0x7fae30155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.784+0000 7fae349d2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae300c9a60 con 0x7fae30160750 2023-07-14T13:11:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.784+0000 7fae349d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae300c87b0 con 0x7fae300cc960 2023-07-14T13:11:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.784+0000 7fae349d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae300c9410 con 0x7fae300b1620 2023-07-14T13:11:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.784+0000 7fae2f59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae30160750 0x7fae30155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.784+0000 7fae2f59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae30160750 0x7fae30155500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40016/0 (socket says 172.21.15.5:40016) 2023-07-14T13:11:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.784+0000 7fae2f59e640 1 -- 172.21.15.5:0/1541290446 learned_addr learned my addr 172.21.15.5:0/1541290446 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.784+0000 7fae2ed9d640 1 --2- 172.21.15.5:0/1541290446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae300b1620 0x7fae3015b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.784+0000 7fae2e59c640 1 --2- 172.21.15.5:0/1541290446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae300cc960 0x7fae300c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.784+0000 7fae2f59e640 1 -- 172.21.15.5:0/1541290446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae300b1620 msgr2=0x7fae3015b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.784+0000 7fae2f59e640 1 --2- 172.21.15.5:0/1541290446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae300b1620 0x7fae3015b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.784+0000 7fae2f59e640 1 -- 172.21.15.5:0/1541290446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae300cc960 msgr2=0x7fae300c7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.784+0000 7fae2f59e640 1 --2- 172.21.15.5:0/1541290446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae300cc960 0x7fae300c7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.784+0000 7fae2f59e640 1 -- 172.21.15.5:0/1541290446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae28009b30 con 0x7fae30160750 2023-07-14T13:11:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.788+0000 7fae2f59e640 1 --2- 172.21.15.5:0/1541290446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae30160750 0x7fae30155500 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fae280af040 tx=0x7fae28019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.788+0000 7fae177fe640 1 -- 172.21.15.5:0/1541290446 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae280b8670 con 0x7fae30160750 2023-07-14T13:11:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.788+0000 7fae177fe640 1 -- 172.21.15.5:0/1541290446 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae280b87d0 con 0x7fae30160750 2023-07-14T13:11:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.788+0000 7fae177fe640 1 -- 172.21.15.5:0/1541290446 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae280b8b80 con 0x7fae30160750 2023-07-14T13:11:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.788+0000 7fae349d2640 1 -- 172.21.15.5:0/1541290446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae300c96f0 con 0x7fae30160750 2023-07-14T13:11:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.788+0000 7fae349d2640 1 -- 172.21.15.5:0/1541290446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3015bbd0 con 0x7fae30160750 2023-07-14T13:11:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.788+0000 7fae349d2640 1 -- 172.21.15.5:0/1541290446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae300c9bd0 con 0x7fae30160750 2023-07-14T13:11:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.788+0000 7fae177fe640 1 -- 172.21.15.5:0/1541290446 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fae280b8ce0 con 0x7fae30160750 2023-07-14T13:11:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.788+0000 7fae177fe640 1 --2- 172.21.15.5:0/1541290446 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fae1c0663a0 0x7fae1c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.792+0000 7fae177fe640 1 -- 172.21.15.5:0/1541290446 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fae2811f3b0 con 0x7fae30160750 2023-07-14T13:11:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.792+0000 7fae2ed9d640 1 --2- 172.21.15.5:0/1541290446 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fae1c0663a0 0x7fae1c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.792+0000 7fae2ed9d640 1 --2- 172.21.15.5:0/1541290446 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fae1c0663a0 0x7fae1c068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fae20009b60 tx=0x7fae20009190 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.796+0000 7fae177fe640 1 -- 172.21.15.5:0/1541290446 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fae280ec8e0 con 0x7fae30160750 2023-07-14T13:11:19.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.948+0000 7fae349d2640 1 -- 172.21.15.5:0/1541290446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fae3004e020 con 0x7fae30160750 2023-07-14T13:11:19.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.952+0000 7fae177fe640 1 -- 172.21.15.5:0/1541290446 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v39) v1 ==== 115+0+0 (secure 0 0 0) 0x7fae280eff00 con 0x7fae30160750 2023-07-14T13:11:19.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.956+0000 7fae349d2640 1 -- 172.21.15.5:0/1541290446 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fae1c0663a0 msgr2=0x7fae1c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:19.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.956+0000 7fae349d2640 1 --2- 172.21.15.5:0/1541290446 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fae1c0663a0 0x7fae1c068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fae20009b60 tx=0x7fae20009190 comp rx=0 tx=0).stop 2023-07-14T13:11:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.956+0000 7fae349d2640 1 -- 172.21.15.5:0/1541290446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae30160750 msgr2=0x7fae30155500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.956+0000 7fae349d2640 1 --2- 172.21.15.5:0/1541290446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae30160750 0x7fae30155500 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fae280af040 tx=0x7fae28019780 comp rx=0 tx=0).stop 2023-07-14T13:11:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.956+0000 7fae349d2640 1 -- 172.21.15.5:0/1541290446 shutdown_connections 2023-07-14T13:11:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.956+0000 7fae349d2640 1 --2- 172.21.15.5:0/1541290446 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fae1c0663a0 0x7fae1c068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.956+0000 7fae349d2640 1 --2- 172.21.15.5:0/1541290446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae30160750 0x7fae30155500 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.956+0000 7fae349d2640 1 --2- 172.21.15.5:0/1541290446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae300cc960 0x7fae300c7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.956+0000 7fae349d2640 1 --2- 172.21.15.5:0/1541290446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae300b1620 0x7fae3015b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:19.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.956+0000 7fae349d2640 1 -- 172.21.15.5:0/1541290446 >> 172.21.15.5:0/1541290446 conn(0x7fae30069f50 msgr2=0x7fae3015db50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:19.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.956+0000 7fae349d2640 1 -- 172.21.15.5:0/1541290446 shutdown_connections 2023-07-14T13:11:19.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:19.956+0000 7fae349d2640 1 -- 172.21.15.5:0/1541290446 wait complete. 2023-07-14T13:11:20.011 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-07-14T13:11:20.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.120+0000 7f02bab37640 1 Processor -- start 2023-07-14T13:11:20.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.120+0000 7f02bab37640 1 -- start start 2023-07-14T13:11:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.120+0000 7f02bab37640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f02b415fd60 0x7f02b40d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.120+0000 7f02bab37640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02b40d1850 0x7f02b40d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.120+0000 7f02bab37640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b40ccaf0 con 0x7f02b40b7c70 2023-07-14T13:11:20.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.120+0000 7f02bab37640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b40d1190 con 0x7f02b415fd60 2023-07-14T13:11:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.120+0000 7f02bab37640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b4160600 con 0x7f02b40d1850 2023-07-14T13:11:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.120+0000 7f02b90d4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02b40d1850 0x7f02b40d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.120+0000 7f02b3fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f02b415fd60 0x7f02b40d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.120+0000 7f02b90d4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02b40d1850 0x7f02b40d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:43794/0 (socket says 172.21.15.5:43794) 2023-07-14T13:11:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.120+0000 7f02b90d4640 1 -- 172.21.15.5:0/4284657455 learned_addr learned my addr 172.21.15.5:0/4284657455 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.120+0000 7f02b88d3640 1 --1- 172.21.15.5:0/4284657455 >> v1:172.21.15.154:6789/0 conn(0x7f02b40b7c70 0x7f02b415f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:55696/0 (socket says 172.21.15.5:55696) 2023-07-14T13:11:20.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.120+0000 7f02b90d4640 1 -- 172.21.15.5:0/4284657455 >> v2:172.21.15.154:3300/0 conn(0x7f02b415fd60 msgr2=0x7f02b40d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.120+0000 7f02b90d4640 1 --2- 172.21.15.5:0/4284657455 >> v2:172.21.15.154:3300/0 conn(0x7f02b415fd60 0x7f02b40d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.120+0000 7f02b90d4640 1 -- 172.21.15.5:0/4284657455 >> v1:172.21.15.154:6789/0 conn(0x7f02b40b7c70 legacy=0x7f02b415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:20.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.120+0000 7f02b90d4640 1 -- 172.21.15.5:0/4284657455 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b4160320 con 0x7f02b40d1850 2023-07-14T13:11:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.124+0000 7f02b90d4640 1 --2- 172.21.15.5:0/4284657455 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02b40d1850 0x7f02b40d1da0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f02ac009e50 tx=0x7f02ac01c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=738ae2ce7836f9f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:20.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.124+0000 7f02b37fe640 1 -- 172.21.15.5:0/4284657455 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac0a58d0 con 0x7f02b40d1850 2023-07-14T13:11:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.124+0000 7f02b37fe640 1 -- 172.21.15.5:0/4284657455 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ac0a5a30 con 0x7f02b40d1850 2023-07-14T13:11:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.124+0000 7f02b37fe640 1 -- 172.21.15.5:0/4284657455 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac0a5dc0 con 0x7f02b40d1850 2023-07-14T13:11:20.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.124+0000 7f02bab37640 1 -- 172.21.15.5:0/4284657455 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02b40d1850 msgr2=0x7f02b40d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:20.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.124+0000 7f02bab37640 1 --2- 172.21.15.5:0/4284657455 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02b40d1850 0x7f02b40d1da0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f02ac009e50 tx=0x7f02ac01c9e0 comp rx=0 tx=0).stop 2023-07-14T13:11:20.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.124+0000 7f02bab37640 1 -- 172.21.15.5:0/4284657455 shutdown_connections 2023-07-14T13:11:20.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.124+0000 7f02bab37640 1 --2- 172.21.15.5:0/4284657455 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02b40d1850 0x7f02b40d1da0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:20.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.124+0000 7f02bab37640 1 --2- 172.21.15.5:0/4284657455 >> v2:172.21.15.154:3300/0 conn(0x7f02b415fd60 0x7f02b40d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:20.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.124+0000 7f02bab37640 1 -- 172.21.15.5:0/4284657455 >> 172.21.15.5:0/4284657455 conn(0x7f02b40650b0 msgr2=0x7f02b40654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:20.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.124+0000 7f02bab37640 1 -- 172.21.15.5:0/4284657455 shutdown_connections 2023-07-14T13:11:20.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.124+0000 7f02bab37640 1 -- 172.21.15.5:0/4284657455 wait complete. 2023-07-14T13:11:20.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.128+0000 7f02bab37640 1 Processor -- start 2023-07-14T13:11:20.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.128+0000 7f02bab37640 1 -- start start 2023-07-14T13:11:20.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.128+0000 7f02bab37640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02b40b7c70 0x7f02b40cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:20.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.128+0000 7f02bab37640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02b40d1850 0x7f02b415aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.128+0000 7f02bab37640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02b415fd60 0x7f02b415b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.128+0000 7f02bab37640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b414bc70 con 0x7f02b415fd60 2023-07-14T13:11:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.128+0000 7f02bab37640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b40c9e00 con 0x7f02b40b7c70 2023-07-14T13:11:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.128+0000 7f02bab37640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b414ad10 con 0x7f02b40d1850 2023-07-14T13:11:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.128+0000 7f02b90d4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02b415fd60 0x7f02b415b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.128+0000 7f02b90d4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02b415fd60 0x7f02b415b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40028/0 (socket says 172.21.15.5:40028) 2023-07-14T13:11:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.128+0000 7f02b90d4640 1 -- 172.21.15.5:0/1580083046 learned_addr learned my addr 172.21.15.5:0/1580083046 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:20.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.128+0000 7f02b88d3640 1 --2- 172.21.15.5:0/1580083046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02b40b7c70 0x7f02b40cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:20.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.128+0000 7f02b3fff640 1 --2- 172.21.15.5:0/1580083046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02b40d1850 0x7f02b415aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:20.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.128+0000 7f02b90d4640 1 -- 172.21.15.5:0/1580083046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02b40d1850 msgr2=0x7f02b415aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:20.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.128+0000 7f02b90d4640 1 --2- 172.21.15.5:0/1580083046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02b40d1850 0x7f02b415aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:20.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.128+0000 7f02b90d4640 1 -- 172.21.15.5:0/1580083046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02b40b7c70 msgr2=0x7f02b40cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:20.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.128+0000 7f02b90d4640 1 --2- 172.21.15.5:0/1580083046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02b40b7c70 0x7f02b40cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:20.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.128+0000 7f02b90d4640 1 -- 172.21.15.5:0/1580083046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ac009b30 con 0x7f02b415fd60 2023-07-14T13:11:20.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.128+0000 7f02b90d4640 1 --2- 172.21.15.5:0/1580083046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02b415fd60 0x7f02b415b1e0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f02ac0af040 tx=0x7f02ac019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:20.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.128+0000 7f02b17fa640 1 -- 172.21.15.5:0/1580083046 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac0b8670 con 0x7f02b415fd60 2023-07-14T13:11:20.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.128+0000 7f02b17fa640 1 -- 172.21.15.5:0/1580083046 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ac0b87f0 con 0x7f02b415fd60 2023-07-14T13:11:20.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.128+0000 7f02bab37640 1 -- 172.21.15.5:0/1580083046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b414aff0 con 0x7f02b415fd60 2023-07-14T13:11:20.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.128+0000 7f02b17fa640 1 -- 172.21.15.5:0/1580083046 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac0b8ba0 con 0x7f02b415fd60 2023-07-14T13:11:20.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.132+0000 7f02bab37640 1 -- 172.21.15.5:0/1580083046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b414b5b0 con 0x7f02b415fd60 2023-07-14T13:11:20.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.132+0000 7f02bab37640 1 -- 172.21.15.5:0/1580083046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b414bdb0 con 0x7f02b415fd60 2023-07-14T13:11:20.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.132+0000 7f02b17fa640 1 -- 172.21.15.5:0/1580083046 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f02ac0b8d00 con 0x7f02b415fd60 2023-07-14T13:11:20.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.132+0000 7f02b17fa640 1 --2- 172.21.15.5:0/1580083046 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f02980663a0 0x7f0298068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:20.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.132+0000 7f02b17fa640 1 -- 172.21.15.5:0/1580083046 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f02ac11f360 con 0x7f02b415fd60 2023-07-14T13:11:20.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.132+0000 7f02b88d3640 1 --2- 172.21.15.5:0/1580083046 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f02980663a0 0x7f0298068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:20.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.132+0000 7f02b88d3640 1 --2- 172.21.15.5:0/1580083046 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f02980663a0 0x7f0298068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f02a8000f70 tx=0x7f02a8007e50 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:20.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.136+0000 7f02b17fa640 1 -- 172.21.15.5:0/1580083046 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f02b414bdb0 con 0x7f02b415fd60 2023-07-14T13:11:20.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.352+0000 7f02bab37640 1 -- 172.21.15.5:0/1580083046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7f02b414bdb0 con 0x7f02b415fd60 2023-07-14T13:11:20.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.852+0000 7f02b17fa640 1 -- 172.21.15.5:0/1580083046 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v706) v1 ==== 183+0+0 (secure 0 0 0) 0x7f02b414bdb0 con 0x7f02b415fd60 2023-07-14T13:11:20.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.856+0000 7f02bab37640 1 -- 172.21.15.5:0/1580083046 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f02980663a0 msgr2=0x7f0298068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:20.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.856+0000 7f02bab37640 1 --2- 172.21.15.5:0/1580083046 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f02980663a0 0x7f0298068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f02a8000f70 tx=0x7f02a8007e50 comp rx=0 tx=0).stop 2023-07-14T13:11:20.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.856+0000 7f02bab37640 1 -- 172.21.15.5:0/1580083046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02b415fd60 msgr2=0x7f02b415b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:20.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.856+0000 7f02bab37640 1 --2- 172.21.15.5:0/1580083046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02b415fd60 0x7f02b415b1e0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f02ac0af040 tx=0x7f02ac019780 comp rx=0 tx=0).stop 2023-07-14T13:11:20.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.856+0000 7f02bab37640 1 -- 172.21.15.5:0/1580083046 shutdown_connections 2023-07-14T13:11:20.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.856+0000 7f02bab37640 1 --2- 172.21.15.5:0/1580083046 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f02980663a0 0x7f0298068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:20.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.856+0000 7f02bab37640 1 --2- 172.21.15.5:0/1580083046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02b415fd60 0x7f02b415b1e0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:20.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.856+0000 7f02bab37640 1 --2- 172.21.15.5:0/1580083046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02b40d1850 0x7f02b415aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:20.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.856+0000 7f02bab37640 1 --2- 172.21.15.5:0/1580083046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02b40b7c70 0x7f02b40cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:20.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.856+0000 7f02bab37640 1 -- 172.21.15.5:0/1580083046 >> 172.21.15.5:0/1580083046 conn(0x7f02b40650b0 msgr2=0x7f02b40b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:20.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.856+0000 7f02bab37640 1 -- 172.21.15.5:0/1580083046 shutdown_connections 2023-07-14T13:11:20.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:20.856+0000 7f02bab37640 1 -- 172.21.15.5:0/1580083046 wait complete. 2023-07-14T13:11:20.913 INFO:tasks.cephfs_test_runner:test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) ... ok 2023-07-14T13:11:20.914 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test existence of a scheduled snapshot 2023-07-14T13:11:20.914 INFO:tasks.cephfs_test_runner:test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-14T13:11:20.914 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-07-14T13:11:21.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.024+0000 7fce56d96640 1 Processor -- start 2023-07-14T13:11:21.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.024+0000 7fce56d96640 1 -- start start 2023-07-14T13:11:21.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce56d96640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fce500c8ad0 0x7fce500c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:21.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce56d96640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce500c99c0 con 0x7fce500c9560 2023-07-14T13:11:21.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce56d96640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce500cc700 con 0x7fce50158ce0 2023-07-14T13:11:21.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce56d96640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce500b0ff0 con 0x7fce500c8ad0 2023-07-14T13:11:21.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce55333640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fce500c9560 0x7fce500ccb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42338/0 (socket says 172.21.15.5:42338) 2023-07-14T13:11:21.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce55333640 1 -- 172.21.15.5:0/3155185911 learned_addr learned my addr 172.21.15.5:0/3155185911 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:21.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce4ffff640 1 --2- 172.21.15.5:0/3155185911 >> v2:172.21.15.154:3300/0 conn(0x7fce500c8ad0 0x7fce500c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:21.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce4f7fe640 1 -- 172.21.15.5:0/3155185911 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 165336513 0 0) 0x7fce500c99c0 con 0x7fce500c9560 2023-07-14T13:11:21.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce4f7fe640 1 -- 172.21.15.5:0/3155185911 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce40003530 con 0x7fce500c9560 2023-07-14T13:11:21.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce4f7fe640 1 -- 172.21.15.5:0/3155185911 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3133138891 0 0) 0x7fce40003530 con 0x7fce500c9560 2023-07-14T13:11:21.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce4f7fe640 1 -- 172.21.15.5:0/3155185911 >> v2:172.21.15.154:3300/0 conn(0x7fce500c8ad0 msgr2=0x7fce500c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:21.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce4f7fe640 1 --2- 172.21.15.5:0/3155185911 >> v2:172.21.15.154:3300/0 conn(0x7fce500c8ad0 0x7fce500c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:21.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce4f7fe640 1 -- 172.21.15.5:0/3155185911 >> v1:172.21.15.154:6789/0 conn(0x7fce50158ce0 legacy=0x7fce50070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:21.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce4f7fe640 1 -- 172.21.15.5:0/3155185911 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce50070c80 con 0x7fce500c9560 2023-07-14T13:11:21.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce4f7fe640 1 -- 172.21.15.5:0/3155185911 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7fce48001a00 con 0x7fce500c9560 2023-07-14T13:11:21.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce4f7fe640 1 -- 172.21.15.5:0/3155185911 >> v1:172.21.15.5:6789/0 conn(0x7fce500c9560 legacy=0x7fce500ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:21.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce4f7fe640 1 --2- 172.21.15.5:0/3155185911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce40003980 0x7fce40003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:21.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce4f7fe640 1 --2- 172.21.15.5:0/3155185911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce400047d0 0x7fce40004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:21.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce4f7fe640 1 --2- 172.21.15.5:0/3155185911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce400052a0 0x7fce4000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:21.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce4f7fe640 1 -- 172.21.15.5:0/3155185911 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce500b0ff0 con 0x7fce40003980 2023-07-14T13:11:21.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce4f7fe640 1 -- 172.21.15.5:0/3155185911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4000e3e0 con 0x7fce400047d0 2023-07-14T13:11:21.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce4f7fe640 1 -- 172.21.15.5:0/3155185911 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4000e5a0 con 0x7fce400052a0 2023-07-14T13:11:21.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce54b32640 1 --2- 172.21.15.5:0/3155185911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce40003980 0x7fce40003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:21.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce4ffff640 1 --2- 172.21.15.5:0/3155185911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce400047d0 0x7fce40004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:21.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce55333640 1 --2- 172.21.15.5:0/3155185911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce400052a0 0x7fce4000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:21.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce54b32640 1 -- 172.21.15.5:0/3155185911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce400052a0 msgr2=0x7fce4000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:21.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce54b32640 1 --2- 172.21.15.5:0/3155185911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce400052a0 0x7fce4000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:21.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce54b32640 1 -- 172.21.15.5:0/3155185911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce400047d0 msgr2=0x7fce40004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:21.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce54b32640 1 --2- 172.21.15.5:0/3155185911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce400047d0 0x7fce40004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:21.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce54b32640 1 -- 172.21.15.5:0/3155185911 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce40003530 con 0x7fce40003980 2023-07-14T13:11:21.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.028+0000 7fce55333640 1 -- 172.21.15.5:0/3155185911 reap_dead start 2023-07-14T13:11:21.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.032+0000 7fce54b32640 1 --2- 172.21.15.5:0/3155185911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce40003980 0x7fce40003d90 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fce44001780 tx=0x7fce4401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a2997b118a66cc5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:21.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.032+0000 7fce4f7fe640 1 -- 172.21.15.5:0/3155185911 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce440052d0 con 0x7fce40003980 2023-07-14T13:11:21.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.032+0000 7fce4f7fe640 1 -- 172.21.15.5:0/3155185911 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce440a7050 con 0x7fce40003980 2023-07-14T13:11:21.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.032+0000 7fce4f7fe640 1 -- 172.21.15.5:0/3155185911 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce44003600 con 0x7fce40003980 2023-07-14T13:11:21.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.032+0000 7fce56d96640 1 -- 172.21.15.5:0/3155185911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce40003980 msgr2=0x7fce40003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:21.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.032+0000 7fce56d96640 1 --2- 172.21.15.5:0/3155185911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce40003980 0x7fce40003d90 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fce44001780 tx=0x7fce4401c3d0 comp rx=0 tx=0).stop 2023-07-14T13:11:21.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.032+0000 7fce56d96640 1 -- 172.21.15.5:0/3155185911 shutdown_connections 2023-07-14T13:11:21.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.032+0000 7fce56d96640 1 --2- 172.21.15.5:0/3155185911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce40003980 0x7fce40003d90 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:21.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.032+0000 7fce56d96640 1 -- 172.21.15.5:0/3155185911 >> 172.21.15.5:0/3155185911 conn(0x7fce500afcf0 msgr2=0x7fce500b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:21.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.032+0000 7fce56d96640 1 -- 172.21.15.5:0/3155185911 shutdown_connections 2023-07-14T13:11:21.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.032+0000 7fce56d96640 1 -- 172.21.15.5:0/3155185911 wait complete. 2023-07-14T13:11:21.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.032+0000 7fce56d96640 1 Processor -- start 2023-07-14T13:11:21.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.036+0000 7fce56d96640 1 -- start start 2023-07-14T13:11:21.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.036+0000 7fce56d96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce40003980 0x7fce5015b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:21.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.036+0000 7fce56d96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce500c5230 0x7fce5014d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:21.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.036+0000 7fce56d96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce501537f0 0x7fce500c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:21.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.036+0000 7fce56d96640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce500af380 con 0x7fce40003980 2023-07-14T13:11:21.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.036+0000 7fce56d96640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5015c170 con 0x7fce500c5230 2023-07-14T13:11:21.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.036+0000 7fce56d96640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce500c2fb0 con 0x7fce501537f0 2023-07-14T13:11:21.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.036+0000 7fce54b32640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce40003980 0x7fce5015b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:21.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.036+0000 7fce54b32640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce40003980 0x7fce5015b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40044/0 (socket says 172.21.15.5:40044) 2023-07-14T13:11:21.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.036+0000 7fce54b32640 1 -- 172.21.15.5:0/2813914863 learned_addr learned my addr 172.21.15.5:0/2813914863 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:21.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.036+0000 7fce4ffff640 1 --2- 172.21.15.5:0/2813914863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce500c5230 0x7fce5014d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:21.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.036+0000 7fce55333640 1 --2- 172.21.15.5:0/2813914863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce501537f0 0x7fce500c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:21.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.036+0000 7fce54b32640 1 -- 172.21.15.5:0/2813914863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce501537f0 msgr2=0x7fce500c3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:21.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.036+0000 7fce54b32640 1 --2- 172.21.15.5:0/2813914863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce501537f0 0x7fce500c3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:21.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.036+0000 7fce54b32640 1 -- 172.21.15.5:0/2813914863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce500c5230 msgr2=0x7fce5014d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:21.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.036+0000 7fce54b32640 1 --2- 172.21.15.5:0/2813914863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce500c5230 0x7fce5014d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:21.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.036+0000 7fce54b32640 1 -- 172.21.15.5:0/2813914863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce500c3250 con 0x7fce40003980 2023-07-14T13:11:21.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.036+0000 7fce54b32640 1 --2- 172.21.15.5:0/2813914863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce40003980 0x7fce5015b920 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fce4401c200 tx=0x7fce40005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:21.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.036+0000 7fce4d7fa640 1 -- 172.21.15.5:0/2813914863 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce44007230 con 0x7fce40003980 2023-07-14T13:11:21.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.036+0000 7fce4d7fa640 1 -- 172.21.15.5:0/2813914863 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce440a4e90 con 0x7fce40003980 2023-07-14T13:11:21.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.036+0000 7fce4d7fa640 1 -- 172.21.15.5:0/2813914863 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce440075d0 con 0x7fce40003980 2023-07-14T13:11:21.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.036+0000 7fce56d96640 1 -- 172.21.15.5:0/2813914863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce500c3530 con 0x7fce40003980 2023-07-14T13:11:21.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.036+0000 7fce56d96640 1 -- 172.21.15.5:0/2813914863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5015be60 con 0x7fce40003980 2023-07-14T13:11:21.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.036+0000 7fce56d96640 1 -- 172.21.15.5:0/2813914863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce500678d0 con 0x7fce40003980 2023-07-14T13:11:21.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.040+0000 7fce4d7fa640 1 -- 172.21.15.5:0/2813914863 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fce440067e0 con 0x7fce40003980 2023-07-14T13:11:21.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.040+0000 7fce4d7fa640 1 --2- 172.21.15.5:0/2813914863 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fce340663a0 0x7fce34068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:21.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.040+0000 7fce4d7fa640 1 -- 172.21.15.5:0/2813914863 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fce4411ded0 con 0x7fce40003980 2023-07-14T13:11:21.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.040+0000 7fce4ffff640 1 --2- 172.21.15.5:0/2813914863 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fce340663a0 0x7fce34068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:21.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.040+0000 7fce4ffff640 1 --2- 172.21.15.5:0/2813914863 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fce340663a0 0x7fce34068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fce50153cf0 tx=0x7fce3c009190 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:21.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.044+0000 7fce4d7fa640 1 -- 172.21.15.5:0/2813914863 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fce440eb1a0 con 0x7fce40003980 2023-07-14T13:11:21.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.252+0000 7fce56d96640 1 -- 172.21.15.5:0/2813914863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7fce500ca120 con 0x7fce40003980 2023-07-14T13:11:21.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.856+0000 7fce4d7fa640 1 -- 172.21.15.5:0/2813914863 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v707) v1 ==== 151+0+0 (secure 0 0 0) 0x7fce440ee7c0 con 0x7fce40003980 2023-07-14T13:11:21.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.856+0000 7fce56d96640 1 -- 172.21.15.5:0/2813914863 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fce340663a0 msgr2=0x7fce34068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:21.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.856+0000 7fce56d96640 1 --2- 172.21.15.5:0/2813914863 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fce340663a0 0x7fce34068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fce50153cf0 tx=0x7fce3c009190 comp rx=0 tx=0).stop 2023-07-14T13:11:21.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.856+0000 7fce56d96640 1 -- 172.21.15.5:0/2813914863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce40003980 msgr2=0x7fce5015b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:21.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.856+0000 7fce56d96640 1 --2- 172.21.15.5:0/2813914863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce40003980 0x7fce5015b920 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fce4401c200 tx=0x7fce40005800 comp rx=0 tx=0).stop 2023-07-14T13:11:21.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.856+0000 7fce56d96640 1 -- 172.21.15.5:0/2813914863 shutdown_connections 2023-07-14T13:11:21.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.856+0000 7fce56d96640 1 --2- 172.21.15.5:0/2813914863 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fce340663a0 0x7fce34068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:21.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.856+0000 7fce56d96640 1 --2- 172.21.15.5:0/2813914863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce501537f0 0x7fce500c3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:21.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.856+0000 7fce56d96640 1 --2- 172.21.15.5:0/2813914863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce500c5230 0x7fce5014d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:21.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.856+0000 7fce56d96640 1 --2- 172.21.15.5:0/2813914863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce40003980 0x7fce5015b920 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:21.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.856+0000 7fce56d96640 1 -- 172.21.15.5:0/2813914863 >> 172.21.15.5:0/2813914863 conn(0x7fce500afcf0 msgr2=0x7fce500cb310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:21.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.856+0000 7fce56d96640 1 -- 172.21.15.5:0/2813914863 shutdown_connections 2023-07-14T13:11:21.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:21.856+0000 7fce56d96640 1 -- 172.21.15.5:0/2813914863 wait complete. 2023-07-14T13:11:21.913 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-14T13:11:22.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.024+0000 7fdc8edad640 1 Processor -- start 2023-07-14T13:11:22.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.024+0000 7fdc8edad640 1 -- start start 2023-07-14T13:11:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.028+0000 7fdc8edad640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdc88069430 0x7fdc88069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.028+0000 7fdc8edad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc880af2b0 0x7fdc8815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:22.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.028+0000 7fdc8edad640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc88159d70 con 0x7fdc88070f30 2023-07-14T13:11:22.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.028+0000 7fdc8edad640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc88069d40 con 0x7fdc88069430 2023-07-14T13:11:22.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.028+0000 7fdc8edad640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc880c9c60 con 0x7fdc880af2b0 2023-07-14T13:11:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.028+0000 7fdc8cb49640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdc88069430 0x7fdc88069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.028+0000 7fdc8cb49640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdc88069430 0x7fdc88069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40054/0 (socket says 172.21.15.5:40054) 2023-07-14T13:11:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.028+0000 7fdc8cb49640 1 -- 172.21.15.5:0/678818572 learned_addr learned my addr 172.21.15.5:0/678818572 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.028+0000 7fdc87fff640 1 --1- 172.21.15.5:0/678818572 >> v1:172.21.15.5:6789/0 conn(0x7fdc88070f30 0x7fdc880ad6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42344/0 (socket says 172.21.15.5:42344) 2023-07-14T13:11:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.028+0000 7fdc8d34a640 1 --2- 172.21.15.5:0/678818572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc880af2b0 0x7fdc8815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:22.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.028+0000 7fdc8cb49640 1 -- 172.21.15.5:0/678818572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc880af2b0 msgr2=0x7fdc8815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:22.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.028+0000 7fdc8cb49640 1 --2- 172.21.15.5:0/678818572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc880af2b0 0x7fdc8815a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:22.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.028+0000 7fdc8cb49640 1 -- 172.21.15.5:0/678818572 >> v1:172.21.15.5:6789/0 conn(0x7fdc88070f30 legacy=0x7fdc880ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:22.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.028+0000 7fdc8cb49640 1 -- 172.21.15.5:0/678818572 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc880c9f40 con 0x7fdc88069430 2023-07-14T13:11:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.032+0000 7fdc8cb49640 1 --2- 172.21.15.5:0/678818572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc88069430 0x7fdc88069800 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c009870 tx=0x7fdc7c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa21d9fe8062fb1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.032+0000 7fdc877fe640 1 -- 172.21.15.5:0/678818572 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c0ab650 con 0x7fdc88069430 2023-07-14T13:11:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.032+0000 7fdc877fe640 1 -- 172.21.15.5:0/678818572 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7c0ab7b0 con 0x7fdc88069430 2023-07-14T13:11:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.032+0000 7fdc877fe640 1 -- 172.21.15.5:0/678818572 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c0abb40 con 0x7fdc88069430 2023-07-14T13:11:22.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.032+0000 7fdc8edad640 1 -- 172.21.15.5:0/678818572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc88069430 msgr2=0x7fdc88069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:22.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.032+0000 7fdc8edad640 1 --2- 172.21.15.5:0/678818572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc88069430 0x7fdc88069800 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c009870 tx=0x7fdc7c01c540 comp rx=0 tx=0).stop 2023-07-14T13:11:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.032+0000 7fdc8edad640 1 -- 172.21.15.5:0/678818572 shutdown_connections 2023-07-14T13:11:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.032+0000 7fdc8edad640 1 --2- 172.21.15.5:0/678818572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc880af2b0 0x7fdc8815a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.032+0000 7fdc8edad640 1 --2- 172.21.15.5:0/678818572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc88069430 0x7fdc88069800 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.032+0000 7fdc8edad640 1 -- 172.21.15.5:0/678818572 >> 172.21.15.5:0/678818572 conn(0x7fdc880cde90 msgr2=0x7fdc880ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:22.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.032+0000 7fdc8edad640 1 -- 172.21.15.5:0/678818572 shutdown_connections 2023-07-14T13:11:22.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.032+0000 7fdc8edad640 1 -- 172.21.15.5:0/678818572 wait complete. 2023-07-14T13:11:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.032+0000 7fdc8edad640 1 Processor -- start 2023-07-14T13:11:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.032+0000 7fdc8edad640 1 -- start start 2023-07-14T13:11:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.036+0000 7fdc8edad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc88069430 0x7fdc88150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.036+0000 7fdc8edad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc88070f30 0x7fdc880cb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.036+0000 7fdc8edad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc880af2b0 0x7fdc880cb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.036+0000 7fdc8edad640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc881530e0 con 0x7fdc88070f30 2023-07-14T13:11:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.036+0000 7fdc8edad640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc88155550 con 0x7fdc88069430 2023-07-14T13:11:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.036+0000 7fdc8edad640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc88155830 con 0x7fdc880af2b0 2023-07-14T13:11:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.036+0000 7fdc87fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc88070f30 0x7fdc880cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.036+0000 7fdc87fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc88070f30 0x7fdc880cb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40060/0 (socket says 172.21.15.5:40060) 2023-07-14T13:11:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.036+0000 7fdc87fff640 1 -- 172.21.15.5:0/492971735 learned_addr learned my addr 172.21.15.5:0/492971735 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.036+0000 7fdc8d34a640 1 --2- 172.21.15.5:0/492971735 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc880af2b0 0x7fdc880cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:22.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.036+0000 7fdc8cb49640 1 --2- 172.21.15.5:0/492971735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc88069430 0x7fdc88150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:22.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.036+0000 7fdc87fff640 1 -- 172.21.15.5:0/492971735 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc880af2b0 msgr2=0x7fdc880cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:22.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.036+0000 7fdc87fff640 1 --2- 172.21.15.5:0/492971735 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc880af2b0 0x7fdc880cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:22.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.036+0000 7fdc87fff640 1 -- 172.21.15.5:0/492971735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc88069430 msgr2=0x7fdc88150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:22.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.036+0000 7fdc87fff640 1 --2- 172.21.15.5:0/492971735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc88069430 0x7fdc88150bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:22.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.036+0000 7fdc87fff640 1 -- 172.21.15.5:0/492971735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc7c0094d0 con 0x7fdc88070f30 2023-07-14T13:11:22.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.036+0000 7fdc8cb49640 1 --2- 172.21.15.5:0/492971735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc88069430 0x7fdc88150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:11:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.036+0000 7fdc87fff640 1 --2- 172.21.15.5:0/492971735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc88070f30 0x7fdc880cb230 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400c490 tx=0x7fdc7400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.036+0000 7fdc857fa640 1 -- 172.21.15.5:0/492971735 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc74007480 con 0x7fdc88070f30 2023-07-14T13:11:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.036+0000 7fdc857fa640 1 -- 172.21.15.5:0/492971735 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc740075e0 con 0x7fdc88070f30 2023-07-14T13:11:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.036+0000 7fdc8edad640 1 -- 172.21.15.5:0/492971735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc88155b10 con 0x7fdc88070f30 2023-07-14T13:11:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.036+0000 7fdc857fa640 1 -- 172.21.15.5:0/492971735 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc74004a10 con 0x7fdc88070f30 2023-07-14T13:11:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.036+0000 7fdc8edad640 1 -- 172.21.15.5:0/492971735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc88151110 con 0x7fdc88070f30 2023-07-14T13:11:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.036+0000 7fdc8edad640 1 -- 172.21.15.5:0/492971735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc880678d0 con 0x7fdc88070f30 2023-07-14T13:11:22.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.036+0000 7fdc857fa640 1 -- 172.21.15.5:0/492971735 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdc74004b70 con 0x7fdc88070f30 2023-07-14T13:11:22.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.040+0000 7fdc857fa640 1 --2- 172.21.15.5:0/492971735 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fdc6c0663a0 0x7fdc6c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:22.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.040+0000 7fdc857fa640 1 -- 172.21.15.5:0/492971735 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fdc74083130 con 0x7fdc88070f30 2023-07-14T13:11:22.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.040+0000 7fdc8cb49640 1 --2- 172.21.15.5:0/492971735 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fdc6c0663a0 0x7fdc6c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:22.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.040+0000 7fdc8cb49640 1 --2- 172.21.15.5:0/492971735 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fdc6c0663a0 0x7fdc6c068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c0af000 tx=0x7fdc7c008040 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:22.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.044+0000 7fdc857fa640 1 -- 172.21.15.5:0/492971735 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fdc74050490 con 0x7fdc88070f30 2023-07-14T13:11:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.200+0000 7fdc8edad640 1 -- 172.21.15.5:0/492971735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fdc88159d70 con 0x7fdc88070f30 2023-07-14T13:11:22.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.208+0000 7fdc857fa640 1 -- 172.21.15.5:0/492971735 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdc88159d70 con 0x7fdc88070f30 2023-07-14T13:11:22.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.208+0000 7fdc8edad640 1 -- 172.21.15.5:0/492971735 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fdc6c0663a0 msgr2=0x7fdc6c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:22.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.208+0000 7fdc8edad640 1 --2- 172.21.15.5:0/492971735 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fdc6c0663a0 0x7fdc6c068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c0af000 tx=0x7fdc7c008040 comp rx=0 tx=0).stop 2023-07-14T13:11:22.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.208+0000 7fdc8edad640 1 -- 172.21.15.5:0/492971735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc88070f30 msgr2=0x7fdc880cb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:22.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.208+0000 7fdc8edad640 1 --2- 172.21.15.5:0/492971735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc88070f30 0x7fdc880cb230 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400c490 tx=0x7fdc7400c950 comp rx=0 tx=0).stop 2023-07-14T13:11:22.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.208+0000 7fdc8edad640 1 -- 172.21.15.5:0/492971735 shutdown_connections 2023-07-14T13:11:22.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.208+0000 7fdc8edad640 1 --2- 172.21.15.5:0/492971735 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fdc6c0663a0 0x7fdc6c068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:22.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.208+0000 7fdc8edad640 1 --2- 172.21.15.5:0/492971735 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc880af2b0 0x7fdc880cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:22.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.208+0000 7fdc8edad640 1 --2- 172.21.15.5:0/492971735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc88070f30 0x7fdc880cb230 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:22.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.208+0000 7fdc8edad640 1 --2- 172.21.15.5:0/492971735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc88069430 0x7fdc88150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:22.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.208+0000 7fdc8edad640 1 -- 172.21.15.5:0/492971735 >> 172.21.15.5:0/492971735 conn(0x7fdc880cde90 msgr2=0x7fdc880c34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:22.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.208+0000 7fdc8edad640 1 -- 172.21.15.5:0/492971735 shutdown_connections 2023-07-14T13:11:22.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.208+0000 7fdc8edad640 1 -- 172.21.15.5:0/492971735 wait complete. 2023-07-14T13:11:22.263 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T13:11:22.264 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:11:22.324 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:11:22.401 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T13:11:22.401 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:11:22.401 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:11:22.411 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:11:22.412 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:11:22.412 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:11:22.421 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:11:22.422 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:11:22.422 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:11:22.462 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:11:22.462 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:11:22.463 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:11:22.474 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:11:22.475 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-14T13:11:22.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:11:22.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.612+0000 7fe81d648640 1 Processor -- start 2023-07-14T13:11:22.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.612+0000 7fe81d648640 1 -- start start 2023-07-14T13:11:22.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.616+0000 7fe81d648640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe818070b70 0x7fe818070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:22.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.616+0000 7fe81d648640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe81806b1e0 0x7fe8180c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:22.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.616+0000 7fe81d648640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe8180c21f0 0x7fe8180cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:22.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.616+0000 7fe81d648640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8180cac70 con 0x7fe818070b70 2023-07-14T13:11:22.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.616+0000 7fe81d648640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe818071480 con 0x7fe8180c21f0 2023-07-14T13:11:22.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.616+0000 7fe81d648640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8180ca060 con 0x7fe81806b1e0 2023-07-14T13:11:22.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.616+0000 7fe816ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe818070b70 0x7fe818070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:22.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.616+0000 7fe816ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe818070b70 0x7fe818070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40076/0 (socket says 172.21.15.5:40076) 2023-07-14T13:11:22.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.616+0000 7fe816ffd640 1 -- 172.21.15.5:0/1728896960 learned_addr learned my addr 172.21.15.5:0/1728896960 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:22.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.616+0000 7fe8177fe640 1 --2- 172.21.15.5:0/1728896960 >> v2:172.21.15.154:3300/0 conn(0x7fe8180c21f0 0x7fe8180cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:22.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.616+0000 7fe80ffff640 1 --2- 172.21.15.5:0/1728896960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe81806b1e0 0x7fe8180c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:22.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.616+0000 7fe816ffd640 1 -- 172.21.15.5:0/1728896960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe81806b1e0 msgr2=0x7fe8180c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:22.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.616+0000 7fe816ffd640 1 --2- 172.21.15.5:0/1728896960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe81806b1e0 0x7fe8180c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:22.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.616+0000 7fe816ffd640 1 -- 172.21.15.5:0/1728896960 >> v2:172.21.15.154:3300/0 conn(0x7fe8180c21f0 msgr2=0x7fe8180cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:22.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.616+0000 7fe816ffd640 1 --2- 172.21.15.5:0/1728896960 >> v2:172.21.15.154:3300/0 conn(0x7fe8180c21f0 0x7fe8180cb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:22.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.616+0000 7fe816ffd640 1 -- 172.21.15.5:0/1728896960 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8180ca340 con 0x7fe818070b70 2023-07-14T13:11:22.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.616+0000 7fe80ffff640 1 --2- 172.21.15.5:0/1728896960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe81806b1e0 0x7fe8180c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:11:22.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.620+0000 7fe816ffd640 1 --2- 172.21.15.5:0/1728896960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe818070b70 0x7fe818070f40 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fe81806a2c0 tx=0x7fe80801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d69a84df1b042a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:22.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.620+0000 7fe8167fc640 1 -- 172.21.15.5:0/1728896960 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8080ab620 con 0x7fe818070b70 2023-07-14T13:11:22.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.620+0000 7fe8167fc640 1 -- 172.21.15.5:0/1728896960 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8080ab780 con 0x7fe818070b70 2023-07-14T13:11:22.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.620+0000 7fe8167fc640 1 -- 172.21.15.5:0/1728896960 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8080abb10 con 0x7fe818070b70 2023-07-14T13:11:22.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.620+0000 7fe81d648640 1 -- 172.21.15.5:0/1728896960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe818070b70 msgr2=0x7fe818070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:22.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.620+0000 7fe81d648640 1 --2- 172.21.15.5:0/1728896960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe818070b70 0x7fe818070f40 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fe81806a2c0 tx=0x7fe80801c440 comp rx=0 tx=0).stop 2023-07-14T13:11:22.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.620+0000 7fe81d648640 1 -- 172.21.15.5:0/1728896960 shutdown_connections 2023-07-14T13:11:22.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.620+0000 7fe81d648640 1 --2- 172.21.15.5:0/1728896960 >> v2:172.21.15.154:3300/0 conn(0x7fe8180c21f0 0x7fe8180cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:22.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.620+0000 7fe81d648640 1 --2- 172.21.15.5:0/1728896960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe81806b1e0 0x7fe8180c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:22.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.620+0000 7fe81d648640 1 --2- 172.21.15.5:0/1728896960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe818070b70 0x7fe818070f40 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:22.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.620+0000 7fe81d648640 1 -- 172.21.15.5:0/1728896960 >> 172.21.15.5:0/1728896960 conn(0x7fe8180afcf0 msgr2=0x7fe8180b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:22.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.620+0000 7fe81d648640 1 -- 172.21.15.5:0/1728896960 shutdown_connections 2023-07-14T13:11:22.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.620+0000 7fe81d648640 1 -- 172.21.15.5:0/1728896960 wait complete. 2023-07-14T13:11:22.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.620+0000 7fe81d648640 1 Processor -- start 2023-07-14T13:11:22.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.620+0000 7fe81d648640 1 -- start start 2023-07-14T13:11:22.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.620+0000 7fe81d648640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe81806b1e0 0x7fe818162c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:22.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.620+0000 7fe81d648640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe818070b70 0x7fe818157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:22.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.624+0000 7fe81d648640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8180c21f0 0x7fe8180cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:22.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.624+0000 7fe81d648640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8180ac300 con 0x7fe818070b70 2023-07-14T13:11:22.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.624+0000 7fe81d648640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe818163250 con 0x7fe8180c21f0 2023-07-14T13:11:22.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.624+0000 7fe81d648640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8180ab9d0 con 0x7fe81806b1e0 2023-07-14T13:11:22.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.624+0000 7fe80ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe818070b70 0x7fe818157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:22.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.624+0000 7fe80ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe818070b70 0x7fe818157680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40078/0 (socket says 172.21.15.5:40078) 2023-07-14T13:11:22.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.624+0000 7fe80ffff640 1 -- 172.21.15.5:0/1985002809 learned_addr learned my addr 172.21.15.5:0/1985002809 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:22.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.624+0000 7fe816ffd640 1 --2- 172.21.15.5:0/1985002809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe81806b1e0 0x7fe818162c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:22.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.624+0000 7fe8177fe640 1 --2- 172.21.15.5:0/1985002809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8180c21f0 0x7fe8180cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:22.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.624+0000 7fe80ffff640 1 -- 172.21.15.5:0/1985002809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe81806b1e0 msgr2=0x7fe818162c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:22.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.624+0000 7fe80ffff640 1 --2- 172.21.15.5:0/1985002809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe81806b1e0 0x7fe818162c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:22.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.624+0000 7fe80ffff640 1 -- 172.21.15.5:0/1985002809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8180c21f0 msgr2=0x7fe8180cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:22.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.624+0000 7fe80ffff640 1 --2- 172.21.15.5:0/1985002809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8180c21f0 0x7fe8180cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:22.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.624+0000 7fe80ffff640 1 -- 172.21.15.5:0/1985002809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8080094d0 con 0x7fe818070b70 2023-07-14T13:11:22.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.624+0000 7fe80ffff640 1 --2- 172.21.15.5:0/1985002809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe818070b70 0x7fe818157680 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fe80000e810 tx=0x7fe80000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:22.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.624+0000 7fe80f7fe640 1 -- 172.21.15.5:0/1985002809 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe800004030 con 0x7fe818070b70 2023-07-14T13:11:22.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.624+0000 7fe80f7fe640 1 -- 172.21.15.5:0/1985002809 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe800004190 con 0x7fe818070b70 2023-07-14T13:11:22.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.624+0000 7fe81d648640 1 -- 172.21.15.5:0/1985002809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8180abcb0 con 0x7fe818070b70 2023-07-14T13:11:22.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.624+0000 7fe80f7fe640 1 -- 172.21.15.5:0/1985002809 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe800004520 con 0x7fe818070b70 2023-07-14T13:11:22.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.624+0000 7fe81d648640 1 -- 172.21.15.5:0/1985002809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8180cdce0 con 0x7fe818070b70 2023-07-14T13:11:22.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.624+0000 7fe81d648640 1 -- 172.21.15.5:0/1985002809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8180ac470 con 0x7fe818070b70 2023-07-14T13:11:22.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.624+0000 7fe80f7fe640 1 -- 172.21.15.5:0/1985002809 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe80000c6d0 con 0x7fe818070b70 2023-07-14T13:11:22.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.628+0000 7fe80f7fe640 1 --2- 172.21.15.5:0/1985002809 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe7f80663a0 0x7fe7f8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:22.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.628+0000 7fe80f7fe640 1 -- 172.21.15.5:0/1985002809 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fe800083a80 con 0x7fe818070b70 2023-07-14T13:11:22.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.628+0000 7fe816ffd640 1 --2- 172.21.15.5:0/1985002809 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe7f80663a0 0x7fe7f8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:22.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.628+0000 7fe816ffd640 1 --2- 172.21.15.5:0/1985002809 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe7f80663a0 0x7fe7f8068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe8080af000 tx=0x7fe8080b6040 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:22.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.632+0000 7fe80f7fe640 1 -- 172.21.15.5:0/1985002809 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe800050e10 con 0x7fe818070b70 2023-07-14T13:11:22.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.820+0000 7fe81d648640 1 -- 172.21.15.5:0/1985002809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8180678d0 con 0x7fe818070b70 2023-07-14T13:11:22.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.820+0000 7fe80f7fe640 1 -- 172.21.15.5:0/1985002809 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+3523 (secure 0 0 0) 0x7fe800020de0 con 0x7fe818070b70 2023-07-14T13:11:22.856 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:11:22.856 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":51,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6575,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1957957644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1957957644},{"type":"v1","addr":"172.21.15.5:6835","nonce":1957957644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3439623726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3439623726},{"type":"v1","addr":"172.21.15.154:6837","nonce":3439623726}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":7384,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/692576619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":692576619},{"type":"v1","addr":"172.21.15.154:6836","nonce":692576619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":8157,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/825690678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":825690678},{"type":"v1","addr":"172.21.15.5:6834","nonce":825690678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[]} 2023-07-14T13:11:22.856 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 51 2023-07-14T13:11:22.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.820+0000 7fe81d648640 1 -- 172.21.15.5:0/1985002809 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe7f80663a0 msgr2=0x7fe7f8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:22.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.820+0000 7fe81d648640 1 --2- 172.21.15.5:0/1985002809 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe7f80663a0 0x7fe7f8068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe8080af000 tx=0x7fe8080b6040 comp rx=0 tx=0).stop 2023-07-14T13:11:22.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.820+0000 7fe81d648640 1 -- 172.21.15.5:0/1985002809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe818070b70 msgr2=0x7fe818157680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:22.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.820+0000 7fe81d648640 1 --2- 172.21.15.5:0/1985002809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe818070b70 0x7fe818157680 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fe80000e810 tx=0x7fe80000ecd0 comp rx=0 tx=0).stop 2023-07-14T13:11:22.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.820+0000 7fe81d648640 1 -- 172.21.15.5:0/1985002809 shutdown_connections 2023-07-14T13:11:22.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.820+0000 7fe81d648640 1 --2- 172.21.15.5:0/1985002809 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe7f80663a0 0x7fe7f8068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:22.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.820+0000 7fe81d648640 1 --2- 172.21.15.5:0/1985002809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8180c21f0 0x7fe8180cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:22.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.820+0000 7fe81d648640 1 --2- 172.21.15.5:0/1985002809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe818070b70 0x7fe818157680 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:22.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.820+0000 7fe81d648640 1 --2- 172.21.15.5:0/1985002809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe81806b1e0 0x7fe818162c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:22.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.820+0000 7fe81d648640 1 -- 172.21.15.5:0/1985002809 >> 172.21.15.5:0/1985002809 conn(0x7fe8180afcf0 msgr2=0x7fe8180c4410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:22.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.820+0000 7fe81d648640 1 -- 172.21.15.5:0/1985002809 shutdown_connections 2023-07-14T13:11:22.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:22.820+0000 7fe81d648640 1 -- 172.21.15.5:0/1985002809 wait complete. 2023-07-14T13:11:22.878 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-14T13:11:22.878 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-14T13:11:22.879 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-14T13:11:22.879 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:11:22.880 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-14T13:11:22.880 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-14T13:11:22.881 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-14T13:11:22.881 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:11:22.881 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-14T13:11:22.882 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-14T13:11:22.882 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-14T13:11:22.882 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:11:22.883 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-14T13:11:22.883 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-14T13:11:22.884 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-14T13:11:22.884 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:11:22.892 INFO:tasks.ceph.mds.a:Stopped 2023-07-14T13:11:22.892 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-14T13:11:22.893 INFO:tasks.ceph.mds.c:Stopped 2023-07-14T13:11:22.893 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-14T13:11:22.897 INFO:tasks.ceph.mds.b:Stopped 2023-07-14T13:11:22.897 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-14T13:11:22.898 INFO:tasks.ceph.mds.d:Stopped 2023-07-14T13:11:22.899 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-14T13:11:22.940 INFO:tasks.ceph.mds.a:Started 2023-07-14T13:11:22.941 DEBUG:teuthology.parallel:result is None 2023-07-14T13:11:22.943 INFO:tasks.ceph.mds.c:Started 2023-07-14T13:11:22.944 DEBUG:teuthology.parallel:result is None 2023-07-14T13:11:22.945 INFO:tasks.ceph.mds.b:Started 2023-07-14T13:11:22.946 DEBUG:teuthology.parallel:result is None 2023-07-14T13:11:22.948 INFO:tasks.ceph.mds.d:Started 2023-07-14T13:11:22.949 DEBUG:teuthology.parallel:result is None 2023-07-14T13:11:22.949 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-14T13:11:23.029 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-07-14T13:11:23.035 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-07-14T13:11:23.038 INFO:tasks.ceph.mds.d.smithi154.stdout:starting mds.d at 2023-07-14T13:11:23.039 INFO:tasks.ceph.mds.b.smithi154.stdout:starting mds.b at 2023-07-14T13:11:23.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.064+0000 7f1422dfa640 1 Processor -- start 2023-07-14T13:11:23.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.064+0000 7f1422dfa640 1 -- start start 2023-07-14T13:11:23.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.064+0000 7f1422dfa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f141c15fd60 0x7f141c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:23.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.064+0000 7f1422dfa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f141c0ccaf0 con 0x7f141c0b7c70 2023-07-14T13:11:23.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.064+0000 7f1422dfa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f141c160320 con 0x7f141c0d1850 2023-07-14T13:11:23.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.064+0000 7f1422dfa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f141c0d1190 con 0x7f141c15fd60 2023-07-14T13:11:23.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.064+0000 7f1420b96640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f141c0b7c70 0x7f141c15f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42366/0 (socket says 172.21.15.5:42366) 2023-07-14T13:11:23.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.064+0000 7f1420b96640 1 -- 172.21.15.5:0/2841986164 learned_addr learned my addr 172.21.15.5:0/2841986164 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:23.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.064+0000 7f141bfff640 1 --2- 172.21.15.5:0/2841986164 >> v2:172.21.15.154:3300/0 conn(0x7f141c15fd60 0x7f141c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:23.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.064+0000 7f141b7fe640 1 -- 172.21.15.5:0/2841986164 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3982026886 0 0) 0x7f141c0ccaf0 con 0x7f141c0b7c70 2023-07-14T13:11:23.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.064+0000 7f141b7fe640 1 -- 172.21.15.5:0/2841986164 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f140c003530 con 0x7f141c0b7c70 2023-07-14T13:11:23.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.064+0000 7f141b7fe640 1 -- 172.21.15.5:0/2841986164 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1746076241 0 0) 0x7f141c160320 con 0x7f141c0d1850 2023-07-14T13:11:23.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.064+0000 7f141b7fe640 1 -- 172.21.15.5:0/2841986164 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f141c0ccaf0 con 0x7f141c0d1850 2023-07-14T13:11:23.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.064+0000 7f141bfff640 1 -- 172.21.15.5:0/2841986164 >> v1:172.21.15.154:6789/0 conn(0x7f141c0d1850 legacy=0x7f141c0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:23.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.064+0000 7f141bfff640 1 -- 172.21.15.5:0/2841986164 >> v1:172.21.15.5:6789/0 conn(0x7f141c0b7c70 legacy=0x7f141c15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:23.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.064+0000 7f141bfff640 1 -- 172.21.15.5:0/2841986164 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c0ccd90 con 0x7f141c15fd60 2023-07-14T13:11:23.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.068+0000 7f141bfff640 1 --2- 172.21.15.5:0/2841986164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f141c15fd60 0x7f141c0d0c50 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f14080097c0 tx=0x7f140801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7470a940cf2eef79 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.068+0000 7f141b7fe640 1 -- 172.21.15.5:0/2841986164 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14080a8050 con 0x7f141c15fd60 2023-07-14T13:11:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.068+0000 7f141b7fe640 1 -- 172.21.15.5:0/2841986164 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14080ac5f0 con 0x7f141c15fd60 2023-07-14T13:11:23.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.068+0000 7f141b7fe640 1 -- 172.21.15.5:0/2841986164 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14080ac980 con 0x7f141c15fd60 2023-07-14T13:11:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.068+0000 7f1422dfa640 1 -- 172.21.15.5:0/2841986164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f141c15fd60 msgr2=0x7f141c0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.068+0000 7f1422dfa640 1 --2- 172.21.15.5:0/2841986164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f141c15fd60 0x7f141c0d0c50 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f14080097c0 tx=0x7f140801c480 comp rx=0 tx=0).stop 2023-07-14T13:11:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.068+0000 7f1422dfa640 1 -- 172.21.15.5:0/2841986164 shutdown_connections 2023-07-14T13:11:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.068+0000 7f1422dfa640 1 --2- 172.21.15.5:0/2841986164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f141c15fd60 0x7f141c0d0c50 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.068+0000 7f1422dfa640 1 -- 172.21.15.5:0/2841986164 >> 172.21.15.5:0/2841986164 conn(0x7f141c0650b0 msgr2=0x7f141c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.068+0000 7f1422dfa640 1 -- 172.21.15.5:0/2841986164 shutdown_connections 2023-07-14T13:11:23.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.068+0000 7f1422dfa640 1 -- 172.21.15.5:0/2841986164 wait complete. 2023-07-14T13:11:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.072+0000 7f1422dfa640 1 Processor -- start 2023-07-14T13:11:23.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.072+0000 7f1422dfa640 1 -- start start 2023-07-14T13:11:23.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.072+0000 7f1422dfa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f141c0b7c70 0x7f141c148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:23.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.072+0000 7f1422dfa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f141c0d1850 0x7f141c0c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:23.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.072+0000 7f1422dfa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f141c15fd60 0x7f141c0c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:23.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.072+0000 7f1422dfa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c14a080 con 0x7f141c0b7c70 2023-07-14T13:11:23.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.072+0000 7f1422dfa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c149210 con 0x7f141c0d1850 2023-07-14T13:11:23.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.072+0000 7f1422dfa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141c149470 con 0x7f141c15fd60 2023-07-14T13:11:23.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.072+0000 7f1420b96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f141c0b7c70 0x7f141c148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:23.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.072+0000 7f1420b96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f141c0b7c70 0x7f141c148cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40106/0 (socket says 172.21.15.5:40106) 2023-07-14T13:11:23.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.072+0000 7f1420b96640 1 -- 172.21.15.5:0/1631199331 learned_addr learned my addr 172.21.15.5:0/1631199331 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:23.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.072+0000 7f1421397640 1 --2- 172.21.15.5:0/1631199331 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f141c15fd60 0x7f141c0c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:23.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.072+0000 7f141bfff640 1 --2- 172.21.15.5:0/1631199331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f141c0d1850 0x7f141c0c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:23.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.072+0000 7f1420b96640 1 -- 172.21.15.5:0/1631199331 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f141c15fd60 msgr2=0x7f141c0c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:23.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.072+0000 7f1420b96640 1 --2- 172.21.15.5:0/1631199331 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f141c15fd60 0x7f141c0c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:23.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.072+0000 7f1420b96640 1 -- 172.21.15.5:0/1631199331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f141c0d1850 msgr2=0x7f141c0c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:23.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.072+0000 7f1420b96640 1 --2- 172.21.15.5:0/1631199331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f141c0d1850 0x7f141c0c4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:23.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.072+0000 7f1420b96640 1 -- 172.21.15.5:0/1631199331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1408009420 con 0x7f141c0b7c70 2023-07-14T13:11:23.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.072+0000 7f1421397640 1 --2- 172.21.15.5:0/1631199331 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f141c15fd60 0x7f141c0c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:11:23.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.072+0000 7f1420b96640 1 --2- 172.21.15.5:0/1631199331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f141c0b7c70 0x7f141c148cd0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f141000c420 tx=0x7f141000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:23.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.072+0000 7f14197fa640 1 -- 172.21.15.5:0/1631199331 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1410005cf0 con 0x7f141c0b7c70 2023-07-14T13:11:23.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.072+0000 7f14197fa640 1 -- 172.21.15.5:0/1631199331 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1410005e50 con 0x7f141c0b7c70 2023-07-14T13:11:23.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.072+0000 7f14197fa640 1 -- 172.21.15.5:0/1631199331 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1410007310 con 0x7f141c0b7c70 2023-07-14T13:11:23.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.072+0000 7f1422dfa640 1 -- 172.21.15.5:0/1631199331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f141c149750 con 0x7f141c0b7c70 2023-07-14T13:11:23.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.072+0000 7f1422dfa640 1 -- 172.21.15.5:0/1631199331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141c149d10 con 0x7f141c0b7c70 2023-07-14T13:11:23.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.076+0000 7f1422dfa640 1 -- 172.21.15.5:0/1631199331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f141c0678d0 con 0x7f141c0b7c70 2023-07-14T13:11:23.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.076+0000 7f14197fa640 1 -- 172.21.15.5:0/1631199331 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1410007470 con 0x7f141c0b7c70 2023-07-14T13:11:23.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.076+0000 7f14197fa640 1 --2- 172.21.15.5:0/1631199331 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f14000663a0 0x7f1400068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:23.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.076+0000 7f14197fa640 1 -- 172.21.15.5:0/1631199331 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f1410083530 con 0x7f141c0b7c70 2023-07-14T13:11:23.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.076+0000 7f141bfff640 1 --2- 172.21.15.5:0/1631199331 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f14000663a0 0x7f1400068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:23.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.076+0000 7f141bfff640 1 --2- 172.21.15.5:0/1631199331 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f14000663a0 0x7f1400068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f14080ae000 tx=0x7f14080a7000 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:23.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.080+0000 7f14197fa640 1 -- 172.21.15.5:0/1631199331 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f14100507f0 con 0x7f141c0b7c70 2023-07-14T13:11:23.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:23.252+0000 7f1422dfa640 1 -- 172.21.15.5:0/1631199331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f141c0b5130 con 0x7f141c0b7c70 2023-07-14T13:11:24.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.228+0000 7f14197fa640 1 -- 172.21.15.5:0/1631199331 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v123) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1410053e10 con 0x7f141c0b7c70 2023-07-14T13:11:24.264 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2023-07-14T13:11:24.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.232+0000 7f1422dfa640 1 -- 172.21.15.5:0/1631199331 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f14000663a0 msgr2=0x7f1400068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:24.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.232+0000 7f1422dfa640 1 --2- 172.21.15.5:0/1631199331 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f14000663a0 0x7f1400068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f14080ae000 tx=0x7f14080a7000 comp rx=0 tx=0).stop 2023-07-14T13:11:24.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.232+0000 7f1422dfa640 1 -- 172.21.15.5:0/1631199331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f141c0b7c70 msgr2=0x7f141c148cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:24.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.232+0000 7f1422dfa640 1 --2- 172.21.15.5:0/1631199331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f141c0b7c70 0x7f141c148cd0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f141000c420 tx=0x7f141000c8e0 comp rx=0 tx=0).stop 2023-07-14T13:11:24.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.232+0000 7f1422dfa640 1 -- 172.21.15.5:0/1631199331 shutdown_connections 2023-07-14T13:11:24.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.232+0000 7f1422dfa640 1 --2- 172.21.15.5:0/1631199331 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f14000663a0 0x7f1400068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:24.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.232+0000 7f1422dfa640 1 --2- 172.21.15.5:0/1631199331 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f141c15fd60 0x7f141c0c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:24.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.232+0000 7f1422dfa640 1 --2- 172.21.15.5:0/1631199331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f141c0d1850 0x7f141c0c4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:24.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.232+0000 7f1422dfa640 1 --2- 172.21.15.5:0/1631199331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f141c0b7c70 0x7f141c148cd0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:24.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.232+0000 7f1422dfa640 1 -- 172.21.15.5:0/1631199331 >> 172.21.15.5:0/1631199331 conn(0x7f141c0650b0 msgr2=0x7f141c157050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:24.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.232+0000 7f1422dfa640 1 -- 172.21.15.5:0/1631199331 shutdown_connections 2023-07-14T13:11:24.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.232+0000 7f1422dfa640 1 -- 172.21.15.5:0/1631199331 wait complete. 2023-07-14T13:11:24.292 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-14T13:11:24.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.408+0000 7fa35dbfa640 1 Processor -- start 2023-07-14T13:11:24.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.408+0000 7fa35dbfa640 1 -- start start 2023-07-14T13:11:24.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.408+0000 7fa35dbfa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa35815fdf0 0x7fa3580c9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:24.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.408+0000 7fa35dbfa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3580cb080 con 0x7fa35815bdf0 2023-07-14T13:11:24.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.408+0000 7fa35dbfa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3580cb2e0 con 0x7fa35815f970 2023-07-14T13:11:24.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.408+0000 7fa35dbfa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3580cb5c0 con 0x7fa35815fdf0 2023-07-14T13:11:24.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.408+0000 7fa3577fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa35815bdf0 0x7fa3580ca970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42372/0 (socket says 172.21.15.5:42372) 2023-07-14T13:11:24.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.408+0000 7fa3577fe640 1 -- 172.21.15.5:0/535799385 learned_addr learned my addr 172.21.15.5:0/535799385 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:24.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.408+0000 7fa357fff640 1 --2- 172.21.15.5:0/535799385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa35815fdf0 0x7fa3580c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:24.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.412+0000 7fa356ffd640 1 -- 172.21.15.5:0/535799385 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137518958 0 0) 0x7fa3580cb080 con 0x7fa35815bdf0 2023-07-14T13:11:24.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.412+0000 7fa356ffd640 1 -- 172.21.15.5:0/535799385 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa344003530 con 0x7fa35815bdf0 2023-07-14T13:11:24.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.412+0000 7fa356ffd640 1 -- 172.21.15.5:0/535799385 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296618648 0 0) 0x7fa3580cb2e0 con 0x7fa35815f970 2023-07-14T13:11:24.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.412+0000 7fa356ffd640 1 -- 172.21.15.5:0/535799385 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3580cb080 con 0x7fa35815f970 2023-07-14T13:11:24.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.412+0000 7fa357fff640 1 -- 172.21.15.5:0/535799385 >> v1:172.21.15.154:6789/0 conn(0x7fa35815f970 legacy=0x7fa3580c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:24.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.412+0000 7fa357fff640 1 -- 172.21.15.5:0/535799385 >> v1:172.21.15.5:6789/0 conn(0x7fa35815bdf0 legacy=0x7fa3580ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:24.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.412+0000 7fa357fff640 1 -- 172.21.15.5:0/535799385 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3580cb8a0 con 0x7fa35815fdf0 2023-07-14T13:11:24.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.412+0000 7fa357fff640 1 --2- 172.21.15.5:0/535799385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa35815fdf0 0x7fa3580c9580 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa350009dc0 tx=0x7fa35001d310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c9fea2b9b10a0ec server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:24.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.412+0000 7fa356ffd640 1 -- 172.21.15.5:0/535799385 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3500a5990 con 0x7fa35815fdf0 2023-07-14T13:11:24.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.412+0000 7fa356ffd640 1 -- 172.21.15.5:0/535799385 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3500a5af0 con 0x7fa35815fdf0 2023-07-14T13:11:24.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.412+0000 7fa356ffd640 1 -- 172.21.15.5:0/535799385 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3500a5e80 con 0x7fa35815fdf0 2023-07-14T13:11:24.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.416+0000 7fa35dbfa640 1 -- 172.21.15.5:0/535799385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa35815fdf0 msgr2=0x7fa3580c9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:24.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.416+0000 7fa35dbfa640 1 --2- 172.21.15.5:0/535799385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa35815fdf0 0x7fa3580c9580 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa350009dc0 tx=0x7fa35001d310 comp rx=0 tx=0).stop 2023-07-14T13:11:24.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.416+0000 7fa35dbfa640 1 -- 172.21.15.5:0/535799385 shutdown_connections 2023-07-14T13:11:24.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.416+0000 7fa35dbfa640 1 --2- 172.21.15.5:0/535799385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa35815fdf0 0x7fa3580c9580 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:24.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.416+0000 7fa35dbfa640 1 -- 172.21.15.5:0/535799385 >> 172.21.15.5:0/535799385 conn(0x7fa3580afcf0 msgr2=0x7fa3580b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:24.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.416+0000 7fa35dbfa640 1 -- 172.21.15.5:0/535799385 shutdown_connections 2023-07-14T13:11:24.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.416+0000 7fa35dbfa640 1 -- 172.21.15.5:0/535799385 wait complete. 2023-07-14T13:11:24.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.416+0000 7fa35dbfa640 1 Processor -- start 2023-07-14T13:11:24.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.416+0000 7fa35dbfa640 1 -- start start 2023-07-14T13:11:24.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.416+0000 7fa35dbfa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa35815bdf0 0x7fa358152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:24.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.416+0000 7fa35dbfa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa35815f970 0x7fa358148e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:24.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.416+0000 7fa35dbfa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa35815fdf0 0x7fa35814b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:24.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.416+0000 7fa35dbfa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35814cab0 con 0x7fa35815bdf0 2023-07-14T13:11:24.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.416+0000 7fa35dbfa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35814bea0 con 0x7fa35815f970 2023-07-14T13:11:24.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.416+0000 7fa35dbfa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35814c180 con 0x7fa35815fdf0 2023-07-14T13:11:24.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.416+0000 7fa3577fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa35815bdf0 0x7fa358152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:24.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.416+0000 7fa3577fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa35815bdf0 0x7fa358152470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40108/0 (socket says 172.21.15.5:40108) 2023-07-14T13:11:24.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.416+0000 7fa3577fe640 1 -- 172.21.15.5:0/1333205150 learned_addr learned my addr 172.21.15.5:0/1333205150 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:24.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.416+0000 7fa357fff640 1 --2- 172.21.15.5:0/1333205150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa35815fdf0 0x7fa35814b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:24.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.416+0000 7fa34ffff640 1 --2- 172.21.15.5:0/1333205150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa35815f970 0x7fa358148e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:24.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.416+0000 7fa3577fe640 1 -- 172.21.15.5:0/1333205150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa35815fdf0 msgr2=0x7fa35814b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:24.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.416+0000 7fa3577fe640 1 --2- 172.21.15.5:0/1333205150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa35815fdf0 0x7fa35814b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:24.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.416+0000 7fa3577fe640 1 -- 172.21.15.5:0/1333205150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa35815f970 msgr2=0x7fa358148e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:24.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.416+0000 7fa3577fe640 1 --2- 172.21.15.5:0/1333205150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa35815f970 0x7fa358148e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:24.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.416+0000 7fa3577fe640 1 -- 172.21.15.5:0/1333205150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa350009a70 con 0x7fa35815bdf0 2023-07-14T13:11:24.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.416+0000 7fa3577fe640 1 --2- 172.21.15.5:0/1333205150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa35815bdf0 0x7fa358152470 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fa34800c420 tx=0x7fa34800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:24.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.420+0000 7fa354ff9640 1 -- 172.21.15.5:0/1333205150 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa348005cf0 con 0x7fa35815bdf0 2023-07-14T13:11:24.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.420+0000 7fa354ff9640 1 -- 172.21.15.5:0/1333205150 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa348005e50 con 0x7fa35815bdf0 2023-07-14T13:11:24.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.420+0000 7fa354ff9640 1 -- 172.21.15.5:0/1333205150 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa348007310 con 0x7fa35815bdf0 2023-07-14T13:11:24.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.420+0000 7fa35dbfa640 1 -- 172.21.15.5:0/1333205150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa35814c460 con 0x7fa35815bdf0 2023-07-14T13:11:24.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.420+0000 7fa35dbfa640 1 -- 172.21.15.5:0/1333205150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3581493d0 con 0x7fa35815bdf0 2023-07-14T13:11:24.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.420+0000 7fa35dbfa640 1 -- 172.21.15.5:0/1333205150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3580678d0 con 0x7fa35815bdf0 2023-07-14T13:11:24.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.420+0000 7fa354ff9640 1 -- 172.21.15.5:0/1333205150 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa348007470 con 0x7fa35815bdf0 2023-07-14T13:11:24.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.420+0000 7fa354ff9640 1 --2- 172.21.15.5:0/1333205150 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fa3380663a0 0x7fa338068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:24.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.420+0000 7fa354ff9640 1 -- 172.21.15.5:0/1333205150 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa3480830d0 con 0x7fa35815bdf0 2023-07-14T13:11:24.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.420+0000 7fa34ffff640 1 --2- 172.21.15.5:0/1333205150 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fa3380663a0 0x7fa338068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:24.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.424+0000 7fa34ffff640 1 --2- 172.21.15.5:0/1333205150 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fa3380663a0 0x7fa338068850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa3581f7960 tx=0x7fa340009040 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:24.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.424+0000 7fa354ff9640 1 -- 172.21.15.5:0/1333205150 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa3480507a0 con 0x7fa35815bdf0 2023-07-14T13:11:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.639+0000 7fa35dbfa640 1 -- 172.21.15.5:0/1333205150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa35806c380 con 0x7fa35815bdf0 2023-07-14T13:11:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.639+0000 7fa354ff9640 1 -- 172.21.15.5:0/1333205150 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fa348053dc0 con 0x7fa35815bdf0 2023-07-14T13:11:24.675 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:11:24.675 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T13:11:24.675 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2023-07-14T13:11:24.676 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:11:24.676 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2023-07-14T13:11:24.676 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkGNTsMRAA5T/zjdynxEKmoNAAK0cChw==", 2023-07-14T13:11:24.676 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:11:24.676 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:11:24.676 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:11:24.676 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:11:24.677 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:11:24.677 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:11:24.677 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:11:24.677 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:11:24.677 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2023-07-14T13:11:24.677 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkqXNAAxAAb7bzXyE8cSS0A3Rz2de6TA==", 2023-07-14T13:11:24.677 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:11:24.677 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:11:24.678 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:11:24.678 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:11:24.678 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:11:24.678 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:11:24.678 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:11:24.678 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:11:24.678 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2023-07-14T13:11:24.678 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFk6NGUORAA+5odxrAlCCXYGc64nzFWwQ==", 2023-07-14T13:11:24.679 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:11:24.679 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:11:24.679 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:11:24.679 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:11:24.679 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:11:24.679 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:11:24.679 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:11:24.679 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:11:24.680 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2023-07-14T13:11:24.680 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkGh/BChAA5p9amLIC6ORC0JJov0bSVg==", 2023-07-14T13:11:24.680 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:11:24.680 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:11:24.680 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:11:24.680 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:11:24.680 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:11:24.681 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:11:24.681 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:11:24.681 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:11:24.681 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2023-07-14T13:11:24.681 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDlRLFkJ6MULhAAxExAqekc/gWudYBJ2sY4MQ==", 2023-07-14T13:11:24.681 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:11:24.681 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:11:24.681 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:11:24.682 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:11:24.682 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:11:24.682 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:11:24.682 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:11:24.682 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2023-07-14T13:11:24.682 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDoRLFksXGBNRAAFtHZt5OQw0aB6k3CkxOzZQ==", 2023-07-14T13:11:24.682 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:11:24.682 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:11:24.683 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:11:24.683 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:11:24.683 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:11:24.683 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:11:24.683 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:11:24.683 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2023-07-14T13:11:24.683 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDsRLFkaUH0ARAAkqgsKPX1dTSZQjn0cRxxRQ==", 2023-07-14T13:11:24.683 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:11:24.684 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:11:24.684 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:11:24.684 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:11:24.684 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:11:24.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:11:24.684 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:11:24.684 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2023-07-14T13:11:24.685 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDvRLFkvElJCRAAnox5LKwobP/1Qaf5d9UsjA==", 2023-07-14T13:11:24.685 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:11:24.685 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:11:24.685 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:11:24.685 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:11:24.685 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:11:24.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:11:24.686 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:11:24.686 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2023-07-14T13:11:24.686 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD1RLFkMNyyDxAA19dJkhhuSpcgVPQEyxb3lg==", 2023-07-14T13:11:24.686 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:11:24.686 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:11:24.686 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:11:24.687 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:11:24.687 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:11:24.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:11:24.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:11:24.687 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2023-07-14T13:11:24.687 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD4RLFkR8mTFhAAP5qUgUJI23XOvVAnNCSgRQ==", 2023-07-14T13:11:24.687 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:11:24.687 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:11:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:11:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:11:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:11:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:11:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:11:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2023-07-14T13:11:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD7RLFkpWL9HBAAo8MfszRnB4sHsDPPcRjCAg==", 2023-07-14T13:11:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:11:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:11:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:11:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:11:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:11:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:11:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:11:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2023-07-14T13:11:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD+RLFkL5cRIxAAF/4ndtYf0oiH3uhhDKnQQg==", 2023-07-14T13:11:24.690 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:11:24.690 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:11:24.690 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:11:24.690 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:11:24.690 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:11:24.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:11:24.690 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:11:24.691 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2023-07-14T13:11:24.691 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkCav/DhAA6SOiONAbTcWCnUZXcm7BcQ==", 2023-07-14T13:11:24.691 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:11:24.691 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:11:24.691 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2023-07-14T13:11:24.691 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-14T13:11:24.691 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:11:24.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:11:24.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:11:24.692 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2023-07-14T13:11:24.692 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkgS/hGBAAevMD2/lfNuaeV74w0Xj0Zw==", 2023-07-14T13:11:24.692 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:11:24.692 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:11:24.692 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T13:11:24.692 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T13:11:24.692 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T13:11:24.693 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:11:24.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:11:24.693 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:11:24.693 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2023-07-14T13:11:24.693 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkeBs4FRAAJ/UjIEKDajVyDb7PejPqAw==", 2023-07-14T13:11:24.693 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:11:24.693 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:11:24.693 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T13:11:24.694 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T13:11:24.694 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T13:11:24.694 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:11:24.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:11:24.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:11:24.694 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2023-07-14T13:11:24.694 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkSkDiHhAAV86wIrAVz3o/PI2CaBC44w==", 2023-07-14T13:11:24.694 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:11:24.695 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:11:24.695 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T13:11:24.695 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T13:11:24.695 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T13:11:24.695 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:11:24.695 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:11:24.695 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:11:24.695 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2023-07-14T13:11:24.696 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkk5IcFRAAThI0P1N8LsRetmwhHqSvdQ==", 2023-07-14T13:11:24.696 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:11:24.696 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T13:11:24.696 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:11:24.696 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:11:24.696 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:11:24.696 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:11:24.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:11:24.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:11:24.697 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2023-07-14T13:11:24.697 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkugeXLRAAEVAnLk/dldtqrpkdzQI3SA==", 2023-07-14T13:11:24.697 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:11:24.697 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T13:11:24.697 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-07-14T13:11:24.697 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:11:24.698 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:11:24.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:11:24.698 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:11:24.698 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2023-07-14T13:11:24.698 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkSvp/KRAAwvjYlrZYNeGbhCiDrTmnrA==", 2023-07-14T13:11:24.698 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:11:24.698 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T13:11:24.698 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-07-14T13:11:24.699 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:11:24.699 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:11:24.699 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:11:24.699 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-07-14T13:11:24.699 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T13:11:24.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.639+0000 7fa35dbfa640 1 -- 172.21.15.5:0/1333205150 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fa3380663a0 msgr2=0x7fa338068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:24.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.639+0000 7fa35dbfa640 1 --2- 172.21.15.5:0/1333205150 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fa3380663a0 0x7fa338068850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa3581f7960 tx=0x7fa340009040 comp rx=0 tx=0).stop 2023-07-14T13:11:24.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.639+0000 7fa35dbfa640 1 -- 172.21.15.5:0/1333205150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa35815bdf0 msgr2=0x7fa358152470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:24.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.639+0000 7fa35dbfa640 1 --2- 172.21.15.5:0/1333205150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa35815bdf0 0x7fa358152470 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fa34800c420 tx=0x7fa34800c8e0 comp rx=0 tx=0).stop 2023-07-14T13:11:24.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.639+0000 7fa35dbfa640 1 -- 172.21.15.5:0/1333205150 shutdown_connections 2023-07-14T13:11:24.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.639+0000 7fa35dbfa640 1 --2- 172.21.15.5:0/1333205150 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fa3380663a0 0x7fa338068850 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:24.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.639+0000 7fa35dbfa640 1 --2- 172.21.15.5:0/1333205150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa35815fdf0 0x7fa35814b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:24.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.639+0000 7fa35dbfa640 1 --2- 172.21.15.5:0/1333205150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa35815f970 0x7fa358148e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:24.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.639+0000 7fa35dbfa640 1 --2- 172.21.15.5:0/1333205150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa35815bdf0 0x7fa358152470 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:24.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.639+0000 7fa35dbfa640 1 -- 172.21.15.5:0/1333205150 >> 172.21.15.5:0/1333205150 conn(0x7fa3580afcf0 msgr2=0x7fa3580ab8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:24.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.639+0000 7fa35dbfa640 1 -- 172.21.15.5:0/1333205150 shutdown_connections 2023-07-14T13:11:24.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.639+0000 7fa35dbfa640 1 -- 172.21.15.5:0/1333205150 wait complete. 2023-07-14T13:11:24.703 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:11:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.811+0000 7f02debfa640 1 Processor -- start 2023-07-14T13:11:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.811+0000 7f02debfa640 1 -- start start 2023-07-14T13:11:24.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.811+0000 7f02debfa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f02d8070b70 0x7f02d8070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.811+0000 7f02debfa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02d806b1e0 0x7f02d80c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.811+0000 7f02debfa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02d80cac70 con 0x7f02d80c21f0 2023-07-14T13:11:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.811+0000 7f02debfa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d8071480 con 0x7f02d8070b70 2023-07-14T13:11:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.811+0000 7f02debfa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d80ca060 con 0x7f02d806b1e0 2023-07-14T13:11:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.815+0000 7f02dc996640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f02d8070b70 0x7f02d8070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.815+0000 7f02dd197640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f02d80c21f0 0x7f02d80cb100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:55730/0 (socket says 172.21.15.5:55730) 2023-07-14T13:11:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.815+0000 7f02dd197640 1 -- 172.21.15.5:0/3330378390 learned_addr learned my addr 172.21.15.5:0/3330378390 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.815+0000 7f02d7fff640 1 --2- 172.21.15.5:0/3330378390 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02d806b1e0 0x7f02d80c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.815+0000 7f02d7fff640 1 -- 172.21.15.5:0/3330378390 >> v2:172.21.15.5:3300/0 conn(0x7f02d8070b70 msgr2=0x7f02d8070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:24.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.815+0000 7f02d7fff640 1 --2- 172.21.15.5:0/3330378390 >> v2:172.21.15.5:3300/0 conn(0x7f02d8070b70 0x7f02d8070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:24.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.815+0000 7f02d7fff640 1 -- 172.21.15.5:0/3330378390 >> v1:172.21.15.154:6789/0 conn(0x7f02d80c21f0 legacy=0x7f02d80cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:24.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.815+0000 7f02d7fff640 1 -- 172.21.15.5:0/3330378390 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d80ca340 con 0x7f02d806b1e0 2023-07-14T13:11:24.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.815+0000 7f02d77fe640 1 -- 172.21.15.5:0/3330378390 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2261074657 0 0) 0x7f02d80cac70 con 0x7f02d80c21f0 2023-07-14T13:11:24.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.815+0000 7f02dc996640 1 --2- 172.21.15.5:0/3330378390 >> v2:172.21.15.5:3300/0 conn(0x7f02d8070b70 0x7f02d8070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:11:24.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.815+0000 7f02d7fff640 1 --2- 172.21.15.5:0/3330378390 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02d806b1e0 0x7f02d80c1cb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f02c40097c0 tx=0x7f02c401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9c3dca4cc88b060 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:24.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.819+0000 7f02d77fe640 1 -- 172.21.15.5:0/3330378390 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c40ac640 con 0x7f02d806b1e0 2023-07-14T13:11:24.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.819+0000 7f02d77fe640 1 -- 172.21.15.5:0/3330378390 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c40ac7a0 con 0x7f02d806b1e0 2023-07-14T13:11:24.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.819+0000 7f02d77fe640 1 -- 172.21.15.5:0/3330378390 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c40acb30 con 0x7f02d806b1e0 2023-07-14T13:11:24.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.819+0000 7f02debfa640 1 -- 172.21.15.5:0/3330378390 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02d806b1e0 msgr2=0x7f02d80c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:24.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.819+0000 7f02debfa640 1 --2- 172.21.15.5:0/3330378390 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02d806b1e0 0x7f02d80c1cb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f02c40097c0 tx=0x7f02c401c3e0 comp rx=0 tx=0).stop 2023-07-14T13:11:24.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.819+0000 7f02debfa640 1 -- 172.21.15.5:0/3330378390 shutdown_connections 2023-07-14T13:11:24.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.819+0000 7f02debfa640 1 --2- 172.21.15.5:0/3330378390 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02d806b1e0 0x7f02d80c1cb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.819+0000 7f02debfa640 1 --2- 172.21.15.5:0/3330378390 >> v2:172.21.15.5:3300/0 conn(0x7f02d8070b70 0x7f02d8070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.819+0000 7f02debfa640 1 -- 172.21.15.5:0/3330378390 >> 172.21.15.5:0/3330378390 conn(0x7f02d80afcf0 msgr2=0x7f02d80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.819+0000 7f02debfa640 1 -- 172.21.15.5:0/3330378390 shutdown_connections 2023-07-14T13:11:24.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.819+0000 7f02debfa640 1 -- 172.21.15.5:0/3330378390 wait complete. 2023-07-14T13:11:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.819+0000 7f02debfa640 1 Processor -- start 2023-07-14T13:11:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.819+0000 7f02debfa640 1 -- start start 2023-07-14T13:11:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.819+0000 7f02debfa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02d806b1e0 0x7f02d81576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.819+0000 7f02debfa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02d8070b70 0x7f02d814f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.819+0000 7f02debfa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02d80c21f0 0x7f02d8158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.819+0000 7f02debfa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d80cc870 con 0x7f02d806b1e0 2023-07-14T13:11:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.823+0000 7f02debfa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d80cbed0 con 0x7f02d8070b70 2023-07-14T13:11:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.823+0000 7f02debfa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d80cc1b0 con 0x7f02d80c21f0 2023-07-14T13:11:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.823+0000 7f02dc996640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02d806b1e0 0x7f02d81576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.823+0000 7f02dc996640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02d806b1e0 0x7f02d81576d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40118/0 (socket says 172.21.15.5:40118) 2023-07-14T13:11:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.823+0000 7f02dc996640 1 -- 172.21.15.5:0/2974060288 learned_addr learned my addr 172.21.15.5:0/2974060288 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.823+0000 7f02dd197640 1 --2- 172.21.15.5:0/2974060288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02d80c21f0 0x7f02d8158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.823+0000 7f02d7fff640 1 --2- 172.21.15.5:0/2974060288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02d8070b70 0x7f02d814f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:24.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.823+0000 7f02dc996640 1 -- 172.21.15.5:0/2974060288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02d80c21f0 msgr2=0x7f02d8158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:24.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.823+0000 7f02dc996640 1 --2- 172.21.15.5:0/2974060288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02d80c21f0 0x7f02d8158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:24.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.823+0000 7f02dc996640 1 -- 172.21.15.5:0/2974060288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02d8070b70 msgr2=0x7f02d814f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:24.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.823+0000 7f02dc996640 1 --2- 172.21.15.5:0/2974060288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02d8070b70 0x7f02d814f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:24.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.823+0000 7f02dc996640 1 -- 172.21.15.5:0/2974060288 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02cc009420 con 0x7f02d806b1e0 2023-07-14T13:11:24.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.823+0000 7f02dc996640 1 --2- 172.21.15.5:0/2974060288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02d806b1e0 0x7f02d81576d0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00ebe0 tx=0x7f02cc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:24.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.823+0000 7f02d57fa640 1 -- 172.21.15.5:0/2974060288 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc00eee0 con 0x7f02d806b1e0 2023-07-14T13:11:24.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.823+0000 7f02d57fa640 1 -- 172.21.15.5:0/2974060288 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02cc00cc30 con 0x7f02d806b1e0 2023-07-14T13:11:24.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.823+0000 7f02debfa640 1 -- 172.21.15.5:0/2974060288 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c4009420 con 0x7f02d806b1e0 2023-07-14T13:11:24.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.823+0000 7f02d57fa640 1 -- 172.21.15.5:0/2974060288 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc013470 con 0x7f02d806b1e0 2023-07-14T13:11:24.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.823+0000 7f02debfa640 1 -- 172.21.15.5:0/2974060288 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d81f4350 con 0x7f02d806b1e0 2023-07-14T13:11:24.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.823+0000 7f02debfa640 1 -- 172.21.15.5:0/2974060288 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d80678d0 con 0x7f02d806b1e0 2023-07-14T13:11:24.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.823+0000 7f02d57fa640 1 -- 172.21.15.5:0/2974060288 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f02cc0135d0 con 0x7f02d806b1e0 2023-07-14T13:11:24.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.827+0000 7f02d57fa640 1 --2- 172.21.15.5:0/2974060288 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f02bc0663d0 0x7f02bc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:24.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.827+0000 7f02d57fa640 1 -- 172.21.15.5:0/2974060288 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f02cc0845b0 con 0x7f02d806b1e0 2023-07-14T13:11:24.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.827+0000 7f02d7fff640 1 --2- 172.21.15.5:0/2974060288 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f02bc0663d0 0x7f02bc068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:24.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.827+0000 7f02d7fff640 1 --2- 172.21.15.5:0/2974060288 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f02bc0663d0 0x7f02bc068880 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f02c40ae000 tx=0x7f02c4008040 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:24.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.827+0000 7f02d57fa640 1 -- 172.21.15.5:0/2974060288 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f02cc051d00 con 0x7f02d806b1e0 2023-07-14T13:11:25.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.983+0000 7f02debfa640 1 -- 172.21.15.5:0/2974060288 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02d80c98c0 con 0x7f02d806b1e0 2023-07-14T13:11:25.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.987+0000 7f02d57fa640 1 -- 172.21.15.5:0/2974060288 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+14601 (secure 0 0 0) 0x7f02cc055320 con 0x7f02d806b1e0 2023-07-14T13:11:25.022 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:11:25.022 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":123,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:11:24.227593+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:11:25.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.987+0000 7f02debfa640 1 -- 172.21.15.5:0/2974060288 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f02bc0663d0 msgr2=0x7f02bc068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:25.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.987+0000 7f02debfa640 1 --2- 172.21.15.5:0/2974060288 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f02bc0663d0 0x7f02bc068880 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f02c40ae000 tx=0x7f02c4008040 comp rx=0 tx=0).stop 2023-07-14T13:11:25.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.987+0000 7f02debfa640 1 -- 172.21.15.5:0/2974060288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02d806b1e0 msgr2=0x7f02d81576d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:25.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.987+0000 7f02debfa640 1 --2- 172.21.15.5:0/2974060288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02d806b1e0 0x7f02d81576d0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00ebe0 tx=0x7f02cc00c520 comp rx=0 tx=0).stop 2023-07-14T13:11:25.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.987+0000 7f02debfa640 1 -- 172.21.15.5:0/2974060288 shutdown_connections 2023-07-14T13:11:25.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.987+0000 7f02debfa640 1 --2- 172.21.15.5:0/2974060288 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f02bc0663d0 0x7f02bc068880 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.987+0000 7f02debfa640 1 --2- 172.21.15.5:0/2974060288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02d80c21f0 0x7f02d8158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.987+0000 7f02debfa640 1 --2- 172.21.15.5:0/2974060288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02d8070b70 0x7f02d814f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.987+0000 7f02debfa640 1 --2- 172.21.15.5:0/2974060288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02d806b1e0 0x7f02d81576d0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.987+0000 7f02debfa640 1 -- 172.21.15.5:0/2974060288 >> 172.21.15.5:0/2974060288 conn(0x7f02d80afcf0 msgr2=0x7f02d8155bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:25.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.987+0000 7f02debfa640 1 -- 172.21.15.5:0/2974060288 shutdown_connections 2023-07-14T13:11:25.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:24.987+0000 7f02debfa640 1 -- 172.21.15.5:0/2974060288 wait complete. 2023-07-14T13:11:25.044 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:11:25.045 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:11:25.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.155+0000 7f6fec893640 1 Processor -- start 2023-07-14T13:11:25.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.155+0000 7f6fec893640 1 -- start start 2023-07-14T13:11:25.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.155+0000 7f6fec893640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6fe815bde0 0x7f6fe80d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:25.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.155+0000 7f6fec893640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6fe80d2fc0 0x7f6fe80b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:25.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.155+0000 7f6fec893640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fe80d2300 0x7f6fe80d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:25.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.155+0000 7f6fec893640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe815c1b0 con 0x7f6fe80d2fc0 2023-07-14T13:11:25.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.155+0000 7f6fec893640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe80d2cc0 con 0x7f6fe815bde0 2023-07-14T13:11:25.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.155+0000 7f6fec893640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe80b04c0 con 0x7f6fe80d2300 2023-07-14T13:11:25.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.155+0000 7f6fdffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6fe80d2fc0 0x7f6fe80b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:25.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.155+0000 7f6fdffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6fe80d2fc0 0x7f6fe80b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40126/0 (socket says 172.21.15.5:40126) 2023-07-14T13:11:25.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.155+0000 7f6fdffff640 1 -- 172.21.15.5:0/3241581983 learned_addr learned my addr 172.21.15.5:0/3241581983 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:25.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.155+0000 7f6fdffff640 1 -- 172.21.15.5:0/3241581983 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fe80d2300 msgr2=0x7f6fe80d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:25.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.155+0000 7f6fdffff640 1 --2- 172.21.15.5:0/3241581983 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fe80d2300 0x7f6fe80d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.155+0000 7f6fe659c640 1 --2- 172.21.15.5:0/3241581983 >> v2:172.21.15.154:3300/0 conn(0x7f6fe815bde0 0x7f6fe80d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:25.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.155+0000 7f6fdffff640 1 -- 172.21.15.5:0/3241581983 >> v2:172.21.15.154:3300/0 conn(0x7f6fe815bde0 msgr2=0x7f6fe80d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:25.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.155+0000 7f6fdffff640 1 --2- 172.21.15.5:0/3241581983 >> v2:172.21.15.154:3300/0 conn(0x7f6fe815bde0 0x7f6fe80d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.155+0000 7f6fdffff640 1 -- 172.21.15.5:0/3241581983 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe80d0aa0 con 0x7f6fe80d2fc0 2023-07-14T13:11:25.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.155+0000 7f6fe659c640 1 --2- 172.21.15.5:0/3241581983 >> v2:172.21.15.154:3300/0 conn(0x7f6fe815bde0 0x7f6fe80d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:11:25.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.159+0000 7f6fdffff640 1 --2- 172.21.15.5:0/3241581983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe80d2fc0 0x7f6fe80b0950 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f6fe808b210 tx=0x7f6fd001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f1eff019ba88f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:25.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.159+0000 7f6fe5d9b640 1 -- 172.21.15.5:0/3241581983 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd00aa620 con 0x7f6fe80d2fc0 2023-07-14T13:11:25.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.159+0000 7f6fe5d9b640 1 -- 172.21.15.5:0/3241581983 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd00aa780 con 0x7f6fe80d2fc0 2023-07-14T13:11:25.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.159+0000 7f6fe5d9b640 1 -- 172.21.15.5:0/3241581983 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd00aab10 con 0x7f6fe80d2fc0 2023-07-14T13:11:25.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.159+0000 7f6fec893640 1 -- 172.21.15.5:0/3241581983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe80d2fc0 msgr2=0x7f6fe80b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:25.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.159+0000 7f6fec893640 1 --2- 172.21.15.5:0/3241581983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe80d2fc0 0x7f6fe80b0950 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f6fe808b210 tx=0x7f6fd001c500 comp rx=0 tx=0).stop 2023-07-14T13:11:25.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.159+0000 7f6fec893640 1 -- 172.21.15.5:0/3241581983 shutdown_connections 2023-07-14T13:11:25.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.159+0000 7f6fec893640 1 --2- 172.21.15.5:0/3241581983 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fe80d2300 0x7f6fe80d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.159+0000 7f6fec893640 1 --2- 172.21.15.5:0/3241581983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe80d2fc0 0x7f6fe80b0950 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.159+0000 7f6fec893640 1 --2- 172.21.15.5:0/3241581983 >> v2:172.21.15.154:3300/0 conn(0x7f6fe815bde0 0x7f6fe80d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.159+0000 7f6fec893640 1 -- 172.21.15.5:0/3241581983 >> 172.21.15.5:0/3241581983 conn(0x7f6fe80659d0 msgr2=0x7f6fe809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:25.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.159+0000 7f6fec893640 1 -- 172.21.15.5:0/3241581983 shutdown_connections 2023-07-14T13:11:25.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.159+0000 7f6fec893640 1 -- 172.21.15.5:0/3241581983 wait complete. 2023-07-14T13:11:25.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.163+0000 7f6fec893640 1 Processor -- start 2023-07-14T13:11:25.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.163+0000 7f6fec893640 1 -- start start 2023-07-14T13:11:25.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.163+0000 7f6fec893640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fe80d2300 0x7f6fe80c51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:25.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.163+0000 7f6fec893640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fe80d2fc0 0x7f6fe80c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:25.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.163+0000 7f6fec893640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe815bde0 0x7f6fe814cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:25.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.163+0000 7f6fec893640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe80c5710 con 0x7f6fe815bde0 2023-07-14T13:11:25.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.163+0000 7f6fec893640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe80b54b0 con 0x7f6fe80d2fc0 2023-07-14T13:11:25.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.163+0000 7f6fec893640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe80c5fb0 con 0x7f6fe80d2300 2023-07-14T13:11:25.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.163+0000 7f6fe6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe815bde0 0x7f6fe814cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:25.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.163+0000 7f6fe6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe815bde0 0x7f6fe814cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40134/0 (socket says 172.21.15.5:40134) 2023-07-14T13:11:25.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.163+0000 7f6fe6d9d640 1 -- 172.21.15.5:0/852749591 learned_addr learned my addr 172.21.15.5:0/852749591 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:25.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.163+0000 7f6fe659c640 1 --2- 172.21.15.5:0/852749591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fe80d2300 0x7f6fe80c51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:25.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.163+0000 7f6fdffff640 1 --2- 172.21.15.5:0/852749591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fe80d2fc0 0x7f6fe80c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:25.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.163+0000 7f6fe6d9d640 1 -- 172.21.15.5:0/852749591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fe80d2300 msgr2=0x7f6fe80c51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:25.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.163+0000 7f6fe6d9d640 1 --2- 172.21.15.5:0/852749591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fe80d2300 0x7f6fe80c51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.163+0000 7f6fe6d9d640 1 -- 172.21.15.5:0/852749591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fe80d2fc0 msgr2=0x7f6fe80c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:25.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.163+0000 7f6fe6d9d640 1 --2- 172.21.15.5:0/852749591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fe80d2fc0 0x7f6fe80c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.163+0000 7f6fe6d9d640 1 -- 172.21.15.5:0/852749591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd00094d0 con 0x7f6fe815bde0 2023-07-14T13:11:25.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.163+0000 7f6fe6d9d640 1 --2- 172.21.15.5:0/852749591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe815bde0 0x7f6fe814cf40 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f6fe000b970 tx=0x7f6fe000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:25.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.163+0000 7f6fdeffd640 1 -- 172.21.15.5:0/852749591 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe000cb40 con 0x7f6fe815bde0 2023-07-14T13:11:25.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.163+0000 7f6fdeffd640 1 -- 172.21.15.5:0/852749591 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe000ccc0 con 0x7f6fe815bde0 2023-07-14T13:11:25.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.163+0000 7f6fdeffd640 1 -- 172.21.15.5:0/852749591 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0014680 con 0x7f6fe815bde0 2023-07-14T13:11:25.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.163+0000 7f6fec893640 1 -- 172.21.15.5:0/852749591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe80c6290 con 0x7f6fe815bde0 2023-07-14T13:11:25.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.163+0000 7f6fec893640 1 -- 172.21.15.5:0/852749591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe80c8ae0 con 0x7f6fe815bde0 2023-07-14T13:11:25.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.167+0000 7f6fec893640 1 -- 172.21.15.5:0/852749591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe80678d0 con 0x7f6fe815bde0 2023-07-14T13:11:25.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.167+0000 7f6fdeffd640 1 -- 172.21.15.5:0/852749591 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6fe001d3b0 con 0x7f6fe815bde0 2023-07-14T13:11:25.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.167+0000 7f6fdeffd640 1 --2- 172.21.15.5:0/852749591 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f6fc80663d0 0x7f6fc8068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:25.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.167+0000 7f6fdeffd640 1 -- 172.21.15.5:0/852749591 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6fe0083b10 con 0x7f6fe815bde0 2023-07-14T13:11:25.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.167+0000 7f6fe659c640 1 --2- 172.21.15.5:0/852749591 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f6fc80663d0 0x7f6fc8068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:25.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.171+0000 7f6fe659c640 1 --2- 172.21.15.5:0/852749591 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f6fc80663d0 0x7f6fc8068880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6fd800a990 tx=0x7f6fd8008040 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:25.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.171+0000 7f6fdeffd640 1 -- 172.21.15.5:0/852749591 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6fe0054bc0 con 0x7f6fe815bde0 2023-07-14T13:11:25.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.327+0000 7f6fec893640 1 -- 172.21.15.5:0/852749591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6fe80c8cd0 con 0x7f6fe815bde0 2023-07-14T13:11:25.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.327+0000 7f6fdeffd640 1 -- 172.21.15.5:0/852749591 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v123) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6fe0019020 con 0x7f6fe815bde0 2023-07-14T13:11:25.365 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:11:25.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.327+0000 7f6fec893640 1 -- 172.21.15.5:0/852749591 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f6fc80663d0 msgr2=0x7f6fc8068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:25.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.327+0000 7f6fec893640 1 --2- 172.21.15.5:0/852749591 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f6fc80663d0 0x7f6fc8068880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6fd800a990 tx=0x7f6fd8008040 comp rx=0 tx=0).stop 2023-07-14T13:11:25.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.327+0000 7f6fec893640 1 -- 172.21.15.5:0/852749591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe815bde0 msgr2=0x7f6fe814cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:25.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.327+0000 7f6fec893640 1 --2- 172.21.15.5:0/852749591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe815bde0 0x7f6fe814cf40 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f6fe000b970 tx=0x7f6fe000be30 comp rx=0 tx=0).stop 2023-07-14T13:11:25.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.331+0000 7f6fec893640 1 -- 172.21.15.5:0/852749591 shutdown_connections 2023-07-14T13:11:25.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.331+0000 7f6fec893640 1 --2- 172.21.15.5:0/852749591 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f6fc80663d0 0x7f6fc8068880 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.331+0000 7f6fec893640 1 --2- 172.21.15.5:0/852749591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fe815bde0 0x7f6fe814cf40 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.331+0000 7f6fec893640 1 --2- 172.21.15.5:0/852749591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6fe80d2fc0 0x7f6fe80c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.331+0000 7f6fec893640 1 --2- 172.21.15.5:0/852749591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6fe80d2300 0x7f6fe80c51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.331+0000 7f6fec893640 1 -- 172.21.15.5:0/852749591 >> 172.21.15.5:0/852749591 conn(0x7f6fe80659d0 msgr2=0x7f6fe806afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:25.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.331+0000 7f6fec893640 1 -- 172.21.15.5:0/852749591 shutdown_connections 2023-07-14T13:11:25.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.331+0000 7f6fec893640 1 -- 172.21.15.5:0/852749591 wait complete. 2023-07-14T13:11:25.385 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:11:25.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.495+0000 7fe9e63f6640 1 Processor -- start 2023-07-14T13:11:25.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.499+0000 7fe9e63f6640 1 -- start start 2023-07-14T13:11:25.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.499+0000 7fe9e63f6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe9e015f690 0x7fe9e00b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:25.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.499+0000 7fe9e63f6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9e01453a0 0x7fe9e015fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:25.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.499+0000 7fe9e63f6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe9e006c4d0 0x7fe9e006c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:25.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.499+0000 7fe9e63f6640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e006c040 con 0x7fe9e006c4d0 2023-07-14T13:11:25.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.499+0000 7fe9e63f6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e0160600 con 0x7fe9e015f690 2023-07-14T13:11:25.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.499+0000 7fe9e63f6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e0160360 con 0x7fe9e01453a0 2023-07-14T13:11:25.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.499+0000 7fe9e4993640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe9e006c4d0 0x7fe9e006c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:25.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.499+0000 7fe9e4993640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe9e006c4d0 0x7fe9e006c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40146/0 (socket says 172.21.15.5:40146) 2023-07-14T13:11:25.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.499+0000 7fe9e4993640 1 -- 172.21.15.5:0/326040307 learned_addr learned my addr 172.21.15.5:0/326040307 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:25.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.499+0000 7fe9dffff640 1 --2- 172.21.15.5:0/326040307 >> v2:172.21.15.154:3300/0 conn(0x7fe9e015f690 0x7fe9e00b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:25.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.499+0000 7fe9df7fe640 1 --2- 172.21.15.5:0/326040307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9e01453a0 0x7fe9e015fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:25.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.499+0000 7fe9e4993640 1 -- 172.21.15.5:0/326040307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9e01453a0 msgr2=0x7fe9e015fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:25.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.499+0000 7fe9e4993640 1 --2- 172.21.15.5:0/326040307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9e01453a0 0x7fe9e015fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.499+0000 7fe9e4993640 1 -- 172.21.15.5:0/326040307 >> v2:172.21.15.154:3300/0 conn(0x7fe9e015f690 msgr2=0x7fe9e00b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:25.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.499+0000 7fe9e4993640 1 --2- 172.21.15.5:0/326040307 >> v2:172.21.15.154:3300/0 conn(0x7fe9e015f690 0x7fe9e00b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.499+0000 7fe9e4993640 1 -- 172.21.15.5:0/326040307 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e006b9f0 con 0x7fe9e006c4d0 2023-07-14T13:11:25.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.503+0000 7fe9e4993640 1 --2- 172.21.15.5:0/326040307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9e006c4d0 0x7fe9e006c950 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fe9e00aba90 tx=0x7fe9d801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c864d0258656a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:25.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.503+0000 7fe9deffd640 1 -- 172.21.15.5:0/326040307 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80a56a0 con 0x7fe9e006c4d0 2023-07-14T13:11:25.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.503+0000 7fe9deffd640 1 -- 172.21.15.5:0/326040307 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d80a5800 con 0x7fe9e006c4d0 2023-07-14T13:11:25.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.503+0000 7fe9deffd640 1 -- 172.21.15.5:0/326040307 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80a5b90 con 0x7fe9e006c4d0 2023-07-14T13:11:25.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.503+0000 7fe9e63f6640 1 -- 172.21.15.5:0/326040307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9e006c4d0 msgr2=0x7fe9e006c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:25.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.503+0000 7fe9e63f6640 1 --2- 172.21.15.5:0/326040307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9e006c4d0 0x7fe9e006c950 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fe9e00aba90 tx=0x7fe9d801c910 comp rx=0 tx=0).stop 2023-07-14T13:11:25.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.503+0000 7fe9e63f6640 1 -- 172.21.15.5:0/326040307 shutdown_connections 2023-07-14T13:11:25.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.503+0000 7fe9e63f6640 1 --2- 172.21.15.5:0/326040307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9e006c4d0 0x7fe9e006c950 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.503+0000 7fe9e63f6640 1 --2- 172.21.15.5:0/326040307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9e01453a0 0x7fe9e015fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.503+0000 7fe9e63f6640 1 --2- 172.21.15.5:0/326040307 >> v2:172.21.15.154:3300/0 conn(0x7fe9e015f690 0x7fe9e00b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.503+0000 7fe9e63f6640 1 -- 172.21.15.5:0/326040307 >> 172.21.15.5:0/326040307 conn(0x7fe9e00b1210 msgr2=0x7fe9e00ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:25.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.503+0000 7fe9e63f6640 1 -- 172.21.15.5:0/326040307 shutdown_connections 2023-07-14T13:11:25.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.503+0000 7fe9e63f6640 1 -- 172.21.15.5:0/326040307 wait complete. 2023-07-14T13:11:25.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.503+0000 7fe9e63f6640 1 Processor -- start 2023-07-14T13:11:25.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.507+0000 7fe9e63f6640 1 -- start start 2023-07-14T13:11:25.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.507+0000 7fe9e63f6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9e006c4d0 0x7fe9e013eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:25.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.507+0000 7fe9e63f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9e01453a0 0x7fe9e0137630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:25.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.507+0000 7fe9e63f6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e015f690 0x7fe9e0135650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:25.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.507+0000 7fe9e63f6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e00ce690 con 0x7fe9e01453a0 2023-07-14T13:11:25.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.507+0000 7fe9e63f6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e015d680 con 0x7fe9e015f690 2023-07-14T13:11:25.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.507+0000 7fe9e63f6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e01441d0 con 0x7fe9e006c4d0 2023-07-14T13:11:25.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.507+0000 7fe9df7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9e01453a0 0x7fe9e0137630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:25.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.507+0000 7fe9df7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9e01453a0 0x7fe9e0137630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40148/0 (socket says 172.21.15.5:40148) 2023-07-14T13:11:25.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.507+0000 7fe9df7fe640 1 -- 172.21.15.5:0/851334162 learned_addr learned my addr 172.21.15.5:0/851334162 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:25.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.507+0000 7fe9dffff640 1 --2- 172.21.15.5:0/851334162 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9e006c4d0 0x7fe9e013eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:25.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.507+0000 7fe9e4993640 1 --2- 172.21.15.5:0/851334162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e015f690 0x7fe9e0135650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:25.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.507+0000 7fe9df7fe640 1 -- 172.21.15.5:0/851334162 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9e006c4d0 msgr2=0x7fe9e013eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:25.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.507+0000 7fe9df7fe640 1 --2- 172.21.15.5:0/851334162 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9e006c4d0 0x7fe9e013eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.507+0000 7fe9df7fe640 1 -- 172.21.15.5:0/851334162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e015f690 msgr2=0x7fe9e0135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.507+0000 7fe9df7fe640 1 --2- 172.21.15.5:0/851334162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e015f690 0x7fe9e0135650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.507+0000 7fe9df7fe640 1 -- 172.21.15.5:0/851334162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d8009b30 con 0x7fe9e01453a0 2023-07-14T13:11:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.507+0000 7fe9df7fe640 1 --2- 172.21.15.5:0/851334162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9e01453a0 0x7fe9e0137630 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fe9d400d830 tx=0x7fe9d400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.507+0000 7fe9dcff9640 1 -- 172.21.15.5:0/851334162 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d400be10 con 0x7fe9e01453a0 2023-07-14T13:11:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.507+0000 7fe9dcff9640 1 -- 172.21.15.5:0/851334162 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d40098b0 con 0x7fe9e01453a0 2023-07-14T13:11:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.507+0000 7fe9dcff9640 1 -- 172.21.15.5:0/851334162 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4009a40 con 0x7fe9e01453a0 2023-07-14T13:11:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.507+0000 7fe9e63f6640 1 -- 172.21.15.5:0/851334162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e01439c0 con 0x7fe9e01453a0 2023-07-14T13:11:25.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.507+0000 7fe9e63f6640 1 -- 172.21.15.5:0/851334162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e0143c10 con 0x7fe9e01453a0 2023-07-14T13:11:25.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.507+0000 7fe9e63f6640 1 -- 172.21.15.5:0/851334162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e015d8f0 con 0x7fe9e01453a0 2023-07-14T13:11:25.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.511+0000 7fe9dcff9640 1 -- 172.21.15.5:0/851334162 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe9d4009ba0 con 0x7fe9e01453a0 2023-07-14T13:11:25.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.511+0000 7fe9dcff9640 1 --2- 172.21.15.5:0/851334162 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe9cc0663a0 0x7fe9cc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:25.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.511+0000 7fe9dcff9640 1 -- 172.21.15.5:0/851334162 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe9d4083d70 con 0x7fe9e01453a0 2023-07-14T13:11:25.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.511+0000 7fe9dffff640 1 --2- 172.21.15.5:0/851334162 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe9cc0663a0 0x7fe9cc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:25.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.511+0000 7fe9dffff640 1 --2- 172.21.15.5:0/851334162 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe9cc0663a0 0x7fe9cc068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0140980 tx=0x7fe9d0008040 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:25.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.515+0000 7fe9dcff9640 1 -- 172.21.15.5:0/851334162 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe9d40514d0 con 0x7fe9e01453a0 2023-07-14T13:11:25.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.671+0000 7fe9e63f6640 1 -- 172.21.15.5:0/851334162 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe9e015d140 con 0x7fe9e01453a0 2023-07-14T13:11:25.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.671+0000 7fe9dcff9640 1 -- 172.21.15.5:0/851334162 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v123) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe9e015d140 con 0x7fe9e01453a0 2023-07-14T13:11:25.707 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:11:25.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.671+0000 7fe9e63f6640 1 -- 172.21.15.5:0/851334162 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe9cc0663a0 msgr2=0x7fe9cc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:25.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.671+0000 7fe9e63f6640 1 --2- 172.21.15.5:0/851334162 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe9cc0663a0 0x7fe9cc068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0140980 tx=0x7fe9d0008040 comp rx=0 tx=0).stop 2023-07-14T13:11:25.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.671+0000 7fe9e63f6640 1 -- 172.21.15.5:0/851334162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9e01453a0 msgr2=0x7fe9e0137630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:25.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.671+0000 7fe9e63f6640 1 --2- 172.21.15.5:0/851334162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9e01453a0 0x7fe9e0137630 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fe9d400d830 tx=0x7fe9d400dcf0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.671+0000 7fe9e63f6640 1 -- 172.21.15.5:0/851334162 shutdown_connections 2023-07-14T13:11:25.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.671+0000 7fe9e63f6640 1 --2- 172.21.15.5:0/851334162 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe9cc0663a0 0x7fe9cc068850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.671+0000 7fe9e63f6640 1 --2- 172.21.15.5:0/851334162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e015f690 0x7fe9e0135650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.671+0000 7fe9e63f6640 1 --2- 172.21.15.5:0/851334162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe9e01453a0 0x7fe9e0137630 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.671+0000 7fe9e63f6640 1 --2- 172.21.15.5:0/851334162 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9e006c4d0 0x7fe9e013eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.671+0000 7fe9e63f6640 1 -- 172.21.15.5:0/851334162 >> 172.21.15.5:0/851334162 conn(0x7fe9e00b1210 msgr2=0x7fe9e013e320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:25.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.671+0000 7fe9e63f6640 1 -- 172.21.15.5:0/851334162 shutdown_connections 2023-07-14T13:11:25.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.671+0000 7fe9e63f6640 1 -- 172.21.15.5:0/851334162 wait complete. 2023-07-14T13:11:25.728 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-14T13:11:25.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.835+0000 7f8eaf26d640 1 Processor -- start 2023-07-14T13:11:25.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.839+0000 7f8eaf26d640 1 -- start start 2023-07-14T13:11:25.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.839+0000 7f8eaf26d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8ea8158ce0 0x7f8ea8070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:25.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.839+0000 7f8eaf26d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8ea80c9730 0x7f8ea80ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:25.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.839+0000 7f8eaf26d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea80cc700 con 0x7f8ea80c8ad0 2023-07-14T13:11:25.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.839+0000 7f8eaf26d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea80b0ff0 con 0x7f8ea8158ce0 2023-07-14T13:11:25.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.839+0000 7f8eaf26d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea8070c80 con 0x7f8ea80c9730 2023-07-14T13:11:25.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.839+0000 7f8ead009640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8ea8158ce0 0x7f8ea8070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:25.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.839+0000 7f8ead009640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8ea8158ce0 0x7f8ea8070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40160/0 (socket says 172.21.15.5:40160) 2023-07-14T13:11:25.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.839+0000 7f8ead009640 1 -- 172.21.15.5:0/88211661 learned_addr learned my addr 172.21.15.5:0/88211661 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:25.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.839+0000 7f8ead80a640 1 --2- 172.21.15.5:0/88211661 >> v2:172.21.15.154:3300/0 conn(0x7f8ea80c9730 0x7f8ea80ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:25.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.839+0000 7f8ead009640 1 -- 172.21.15.5:0/88211661 >> v2:172.21.15.154:3300/0 conn(0x7f8ea80c9730 msgr2=0x7f8ea80ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:25.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.839+0000 7f8ead009640 1 --2- 172.21.15.5:0/88211661 >> v2:172.21.15.154:3300/0 conn(0x7f8ea80c9730 0x7f8ea80ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.839+0000 7f8ead009640 1 -- 172.21.15.5:0/88211661 >> v1:172.21.15.154:6789/0 conn(0x7f8ea80c8ad0 legacy=0x7f8ea80c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:25.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.839+0000 7f8ead009640 1 -- 172.21.15.5:0/88211661 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea80cbdd0 con 0x7f8ea8158ce0 2023-07-14T13:11:25.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.839+0000 7f8ead80a640 1 --2- 172.21.15.5:0/88211661 >> v2:172.21.15.154:3300/0 conn(0x7f8ea80c9730 0x7f8ea80ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:11:25.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.843+0000 7f8ead009640 1 --2- 172.21.15.5:0/88211661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ea8158ce0 0x7f8ea8070450 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80b0d70 tx=0x7f8ea401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45be4c528a11957c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:25.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.843+0000 7f8e9ffff640 1 -- 172.21.15.5:0/88211661 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40ab600 con 0x7f8ea8158ce0 2023-07-14T13:11:25.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.843+0000 7f8e9ffff640 1 -- 172.21.15.5:0/88211661 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea40a7050 con 0x7f8ea8158ce0 2023-07-14T13:11:25.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.843+0000 7f8e9ffff640 1 -- 172.21.15.5:0/88211661 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40ab980 con 0x7f8ea8158ce0 2023-07-14T13:11:25.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.843+0000 7f8eaf26d640 1 -- 172.21.15.5:0/88211661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ea8158ce0 msgr2=0x7f8ea8070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:25.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.843+0000 7f8eaf26d640 1 --2- 172.21.15.5:0/88211661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ea8158ce0 0x7f8ea8070450 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80b0d70 tx=0x7f8ea401c370 comp rx=0 tx=0).stop 2023-07-14T13:11:25.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.843+0000 7f8eaf26d640 1 -- 172.21.15.5:0/88211661 shutdown_connections 2023-07-14T13:11:25.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.843+0000 7f8eaf26d640 1 --2- 172.21.15.5:0/88211661 >> v2:172.21.15.154:3300/0 conn(0x7f8ea80c9730 0x7f8ea80ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.843+0000 7f8eaf26d640 1 --2- 172.21.15.5:0/88211661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ea8158ce0 0x7f8ea8070450 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.843+0000 7f8eaf26d640 1 -- 172.21.15.5:0/88211661 >> 172.21.15.5:0/88211661 conn(0x7f8ea80afcf0 msgr2=0x7f8ea80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:25.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.843+0000 7f8eaf26d640 1 -- 172.21.15.5:0/88211661 shutdown_connections 2023-07-14T13:11:25.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.843+0000 7f8eaf26d640 1 -- 172.21.15.5:0/88211661 wait complete. 2023-07-14T13:11:25.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.843+0000 7f8eaf26d640 1 Processor -- start 2023-07-14T13:11:25.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.843+0000 7f8eaf26d640 1 -- start start 2023-07-14T13:11:25.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.847+0000 7f8eaf26d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ea80c8ad0 0x7f8ea8147ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:25.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.847+0000 7f8eaf26d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ea80c9730 0x7f8ea814c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:25.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.847+0000 7f8eaf26d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ea8158ce0 0x7f8ea814c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:25.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.847+0000 7f8eaf26d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea8148010 con 0x7f8ea8158ce0 2023-07-14T13:11:25.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.847+0000 7f8eaf26d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea80c75d0 con 0x7f8ea80c9730 2023-07-14T13:11:25.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.847+0000 7f8eaf26d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea80c78b0 con 0x7f8ea80c8ad0 2023-07-14T13:11:25.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.847+0000 7f8ead80a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ea8158ce0 0x7f8ea814c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:25.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.847+0000 7f8ead80a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ea8158ce0 0x7f8ea814c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40170/0 (socket says 172.21.15.5:40170) 2023-07-14T13:11:25.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.847+0000 7f8ead80a640 1 -- 172.21.15.5:0/3716899388 learned_addr learned my addr 172.21.15.5:0/3716899388 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:25.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.847+0000 7f8ead009640 1 --2- 172.21.15.5:0/3716899388 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ea80c8ad0 0x7f8ea8147ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:25.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.847+0000 7f8eac808640 1 --2- 172.21.15.5:0/3716899388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ea80c9730 0x7f8ea814c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:25.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.847+0000 7f8ead80a640 1 -- 172.21.15.5:0/3716899388 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ea80c8ad0 msgr2=0x7f8ea8147ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:25.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.847+0000 7f8ead80a640 1 --2- 172.21.15.5:0/3716899388 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ea80c8ad0 0x7f8ea8147ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.847+0000 7f8ead80a640 1 -- 172.21.15.5:0/3716899388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ea80c9730 msgr2=0x7f8ea814c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:25.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.847+0000 7f8ead80a640 1 --2- 172.21.15.5:0/3716899388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ea80c9730 0x7f8ea814c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:25.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.847+0000 7f8ead80a640 1 -- 172.21.15.5:0/3716899388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea40094d0 con 0x7f8ea8158ce0 2023-07-14T13:11:25.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.847+0000 7f8ead80a640 1 --2- 172.21.15.5:0/3716899388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ea8158ce0 0x7f8ea814c8d0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000ce80 tx=0x7f8ea000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:25.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.847+0000 7f8e9dffb640 1 -- 172.21.15.5:0/3716899388 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea000d840 con 0x7f8ea8158ce0 2023-07-14T13:11:25.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.847+0000 7f8e9dffb640 1 -- 172.21.15.5:0/3716899388 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea000d9e0 con 0x7f8ea8158ce0 2023-07-14T13:11:25.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.847+0000 7f8eaf26d640 1 -- 172.21.15.5:0/3716899388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea80c7b90 con 0x7f8ea8158ce0 2023-07-14T13:11:25.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.847+0000 7f8e9dffb640 1 -- 172.21.15.5:0/3716899388 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea000dd90 con 0x7f8ea8158ce0 2023-07-14T13:11:25.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.847+0000 7f8eaf26d640 1 -- 172.21.15.5:0/3716899388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea80c8150 con 0x7f8ea8158ce0 2023-07-14T13:11:25.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.847+0000 7f8eaf26d640 1 -- 172.21.15.5:0/3716899388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea80ca1a0 con 0x7f8ea8158ce0 2023-07-14T13:11:25.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.851+0000 7f8e9dffb640 1 -- 172.21.15.5:0/3716899388 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8ea0015440 con 0x7f8ea8158ce0 2023-07-14T13:11:25.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.851+0000 7f8e9dffb640 1 --2- 172.21.15.5:0/3716899388 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f8e8c0663d0 0x7f8e8c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:25.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.851+0000 7f8e9dffb640 1 -- 172.21.15.5:0/3716899388 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8ea00844d0 con 0x7f8ea8158ce0 2023-07-14T13:11:25.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.851+0000 7f8ead009640 1 --2- 172.21.15.5:0/3716899388 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f8e8c0663d0 0x7f8e8c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:25.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.851+0000 7f8ead009640 1 --2- 172.21.15.5:0/3716899388 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f8e8c0663d0 0x7f8e8c068880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40ad000 tx=0x7f8ea4008040 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:25.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:25.855+0000 7f8e9dffb640 1 -- 172.21.15.5:0/3716899388 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f8ea0051ba0 con 0x7f8ea8158ce0 2023-07-14T13:11:26.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.011+0000 7f8eaf26d640 1 -- 172.21.15.5:0/3716899388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8ea80b1130 con 0x7f8ea8158ce0 2023-07-14T13:11:26.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.011+0000 7f8e9dffb640 1 -- 172.21.15.5:0/3716899388 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v123) v1 ==== 84+0+126 (secure 0 0 0) 0x7f8ea80b1130 con 0x7f8ea8158ce0 2023-07-14T13:11:26.049 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:11:26.049 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-07-14T13:11:26.049 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:11:26.049 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-07-14T13:11:26.049 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-07-14T13:11:26.049 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:11:26.049 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:11:26.050 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 2, 2023-07-14T13:11:26.050 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": "rbd" 2023-07-14T13:11:26.050 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:11:26.050 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-07-14T13:11:26.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.015+0000 7f8eaf26d640 1 -- 172.21.15.5:0/3716899388 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f8e8c0663d0 msgr2=0x7f8e8c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:26.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.015+0000 7f8eaf26d640 1 --2- 172.21.15.5:0/3716899388 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f8e8c0663d0 0x7f8e8c068880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40ad000 tx=0x7f8ea4008040 comp rx=0 tx=0).stop 2023-07-14T13:11:26.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.015+0000 7f8eaf26d640 1 -- 172.21.15.5:0/3716899388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ea8158ce0 msgr2=0x7f8ea814c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:26.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.015+0000 7f8eaf26d640 1 --2- 172.21.15.5:0/3716899388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ea8158ce0 0x7f8ea814c8d0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000ce80 tx=0x7f8ea000a710 comp rx=0 tx=0).stop 2023-07-14T13:11:26.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.015+0000 7f8eaf26d640 1 -- 172.21.15.5:0/3716899388 shutdown_connections 2023-07-14T13:11:26.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.015+0000 7f8eaf26d640 1 --2- 172.21.15.5:0/3716899388 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f8e8c0663d0 0x7f8e8c068880 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:26.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.015+0000 7f8eaf26d640 1 --2- 172.21.15.5:0/3716899388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ea8158ce0 0x7f8ea814c8d0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:26.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.015+0000 7f8eaf26d640 1 --2- 172.21.15.5:0/3716899388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ea80c9730 0x7f8ea814c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:26.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.015+0000 7f8eaf26d640 1 --2- 172.21.15.5:0/3716899388 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8ea80c8ad0 0x7f8ea8147ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:26.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.015+0000 7f8eaf26d640 1 -- 172.21.15.5:0/3716899388 >> 172.21.15.5:0/3716899388 conn(0x7f8ea80afcf0 msgr2=0x7f8ea8070dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:26.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.015+0000 7f8eaf26d640 1 -- 172.21.15.5:0/3716899388 shutdown_connections 2023-07-14T13:11:26.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.015+0000 7f8eaf26d640 1 -- 172.21.15.5:0/3716899388 wait complete. 2023-07-14T13:11:26.069 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-14T13:11:26.070 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-14T13:11:26.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.179+0000 7f253546d640 1 Processor -- start 2023-07-14T13:11:26.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.183+0000 7f253546d640 1 -- start start 2023-07-14T13:11:26.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.183+0000 7f253546d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f253006a540 0x7f253006a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:26.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.183+0000 7f253546d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25300cf2e0 0x7f25300cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:26.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.183+0000 7f253546d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f25300cc9c0 0x7f25300cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:26.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.183+0000 7f253546d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25300d0920 con 0x7f253006a540 2023-07-14T13:11:26.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.183+0000 7f253546d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f253015bfd0 con 0x7f25300cc9c0 2023-07-14T13:11:26.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.183+0000 7f253546d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253006ae50 con 0x7f25300cf2e0 2023-07-14T13:11:26.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.183+0000 7f252effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f253006a540 0x7f253006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:26.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.183+0000 7f252effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f253006a540 0x7f253006a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40178/0 (socket says 172.21.15.5:40178) 2023-07-14T13:11:26.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.183+0000 7f252effd640 1 -- 172.21.15.5:0/3723377614 learned_addr learned my addr 172.21.15.5:0/3723377614 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:26.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.183+0000 7f252f7fe640 1 --2- 172.21.15.5:0/3723377614 >> v2:172.21.15.154:3300/0 conn(0x7f25300cc9c0 0x7f25300cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:26.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.183+0000 7f2527fff640 1 --2- 172.21.15.5:0/3723377614 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25300cf2e0 0x7f25300cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:26.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.183+0000 7f252effd640 1 -- 172.21.15.5:0/3723377614 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25300cf2e0 msgr2=0x7f25300cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:26.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.183+0000 7f252effd640 1 --2- 172.21.15.5:0/3723377614 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25300cf2e0 0x7f25300cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:26.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.183+0000 7f252effd640 1 -- 172.21.15.5:0/3723377614 >> v2:172.21.15.154:3300/0 conn(0x7f25300cc9c0 msgr2=0x7f25300cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:26.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.183+0000 7f252effd640 1 --2- 172.21.15.5:0/3723377614 >> v2:172.21.15.154:3300/0 conn(0x7f25300cc9c0 0x7f25300cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:26.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.183+0000 7f252effd640 1 -- 172.21.15.5:0/3723377614 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25300cfd10 con 0x7f253006a540 2023-07-14T13:11:26.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.183+0000 7f2527fff640 1 --2- 172.21.15.5:0/3723377614 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25300cf2e0 0x7f25300cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:11:26.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.187+0000 7f252effd640 1 --2- 172.21.15.5:0/3723377614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253006a540 0x7f253006a910 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f25300cc780 tx=0x7f252001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2236c479ee25a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:26.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.187+0000 7f252e7fc640 1 -- 172.21.15.5:0/3723377614 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25200aa5f0 con 0x7f253006a540 2023-07-14T13:11:26.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.187+0000 7f252e7fc640 1 -- 172.21.15.5:0/3723377614 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25200aa750 con 0x7f253006a540 2023-07-14T13:11:26.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.187+0000 7f252e7fc640 1 -- 172.21.15.5:0/3723377614 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25200aaae0 con 0x7f253006a540 2023-07-14T13:11:26.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.187+0000 7f253546d640 1 -- 172.21.15.5:0/3723377614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253006a540 msgr2=0x7f253006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:26.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.187+0000 7f253546d640 1 --2- 172.21.15.5:0/3723377614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253006a540 0x7f253006a910 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f25300cc780 tx=0x7f252001c4d0 comp rx=0 tx=0).stop 2023-07-14T13:11:26.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.187+0000 7f253546d640 1 -- 172.21.15.5:0/3723377614 shutdown_connections 2023-07-14T13:11:26.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.187+0000 7f253546d640 1 --2- 172.21.15.5:0/3723377614 >> v2:172.21.15.154:3300/0 conn(0x7f25300cc9c0 0x7f25300cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:26.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.187+0000 7f253546d640 1 --2- 172.21.15.5:0/3723377614 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25300cf2e0 0x7f25300cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:26.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.187+0000 7f253546d640 1 --2- 172.21.15.5:0/3723377614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f253006a540 0x7f253006a910 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:26.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.187+0000 7f253546d640 1 -- 172.21.15.5:0/3723377614 >> 172.21.15.5:0/3723377614 conn(0x7f2530099490 msgr2=0x7f2530089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:26.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.187+0000 7f253546d640 1 -- 172.21.15.5:0/3723377614 shutdown_connections 2023-07-14T13:11:26.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.187+0000 7f253546d640 1 -- 172.21.15.5:0/3723377614 wait complete. 2023-07-14T13:11:26.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.187+0000 7f253546d640 1 Processor -- start 2023-07-14T13:11:26.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.187+0000 7f253546d640 1 -- start start 2023-07-14T13:11:26.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.191+0000 7f253546d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f253006a540 0x7f25301531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:26.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.191+0000 7f253546d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25300cc9c0 0x7f2530159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:26.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.191+0000 7f253546d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25300cf2e0 0x7f253015a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:26.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.191+0000 7f253546d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2530153a20 con 0x7f25300cc9c0 2023-07-14T13:11:26.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.191+0000 7f253546d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2530153d00 con 0x7f253006a540 2023-07-14T13:11:26.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.191+0000 7f253546d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2530153fe0 con 0x7f25300cf2e0 2023-07-14T13:11:26.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.191+0000 7f2527fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25300cc9c0 0x7f2530159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:26.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.191+0000 7f2527fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25300cc9c0 0x7f2530159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40184/0 (socket says 172.21.15.5:40184) 2023-07-14T13:11:26.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.191+0000 7f252effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f253006a540 0x7f25301531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:26.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.191+0000 7f2527fff640 1 -- 172.21.15.5:0/1364514307 learned_addr learned my addr 172.21.15.5:0/1364514307 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:26.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.191+0000 7f252f7fe640 1 --2- 172.21.15.5:0/1364514307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25300cf2e0 0x7f253015a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:26.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.191+0000 7f2527fff640 1 -- 172.21.15.5:0/1364514307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25300cf2e0 msgr2=0x7f253015a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:26.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.191+0000 7f2527fff640 1 --2- 172.21.15.5:0/1364514307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25300cf2e0 0x7f253015a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:26.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.191+0000 7f2527fff640 1 -- 172.21.15.5:0/1364514307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f253006a540 msgr2=0x7f25301531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:26.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.191+0000 7f2527fff640 1 --2- 172.21.15.5:0/1364514307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f253006a540 0x7f25301531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:26.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.191+0000 7f2527fff640 1 -- 172.21.15.5:0/1364514307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25200094d0 con 0x7f25300cc9c0 2023-07-14T13:11:26.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.191+0000 7f2527fff640 1 --2- 172.21.15.5:0/1364514307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25300cc9c0 0x7f2530159c10 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f251800d800 tx=0x7f251800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:26.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.191+0000 7f25277fe640 1 -- 172.21.15.5:0/1364514307 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25180096c0 con 0x7f25300cc9c0 2023-07-14T13:11:26.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.191+0000 7f25277fe640 1 -- 172.21.15.5:0/1364514307 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2518009820 con 0x7f25300cc9c0 2023-07-14T13:11:26.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.191+0000 7f25277fe640 1 -- 172.21.15.5:0/1364514307 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2518009bd0 con 0x7f25300cc9c0 2023-07-14T13:11:26.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.191+0000 7f253546d640 1 -- 172.21.15.5:0/1364514307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25301542c0 con 0x7f25300cc9c0 2023-07-14T13:11:26.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.191+0000 7f253546d640 1 -- 172.21.15.5:0/1364514307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2530153730 con 0x7f25300cc9c0 2023-07-14T13:11:26.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.191+0000 7f253546d640 1 -- 172.21.15.5:0/1364514307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25300678d0 con 0x7f25300cc9c0 2023-07-14T13:11:26.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.195+0000 7f25277fe640 1 -- 172.21.15.5:0/1364514307 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2518009d30 con 0x7f25300cc9c0 2023-07-14T13:11:26.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.195+0000 7f25277fe640 1 --2- 172.21.15.5:0/1364514307 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f25100663a0 0x7f2510068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:26.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.195+0000 7f25277fe640 1 -- 172.21.15.5:0/1364514307 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f25180841f0 con 0x7f25300cc9c0 2023-07-14T13:11:26.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.195+0000 7f252effd640 1 --2- 172.21.15.5:0/1364514307 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f25100663a0 0x7f2510068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:26.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.195+0000 7f252effd640 1 --2- 172.21.15.5:0/1364514307 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f25100663a0 0x7f2510068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f25200ae000 tx=0x7f25200b5040 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:26.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.199+0000 7f25277fe640 1 -- 172.21.15.5:0/1364514307 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f25180518c0 con 0x7f25300cc9c0 2023-07-14T13:11:26.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.351+0000 7f253546d640 1 -- 172.21.15.5:0/1364514307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2530070990 con 0x7f25300cc9c0 2023-07-14T13:11:26.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.875+0000 7f25277fe640 1 -- 172.21.15.5:0/1364514307 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v124) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2518054ee0 con 0x7f25300cc9c0 2023-07-14T13:11:26.914 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-07-14T13:11:26.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.879+0000 7f253546d640 1 -- 172.21.15.5:0/1364514307 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f25100663a0 msgr2=0x7f2510068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:26.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.879+0000 7f253546d640 1 --2- 172.21.15.5:0/1364514307 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f25100663a0 0x7f2510068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f25200ae000 tx=0x7f25200b5040 comp rx=0 tx=0).stop 2023-07-14T13:11:26.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.879+0000 7f253546d640 1 -- 172.21.15.5:0/1364514307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25300cc9c0 msgr2=0x7f2530159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:26.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.879+0000 7f253546d640 1 --2- 172.21.15.5:0/1364514307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25300cc9c0 0x7f2530159c10 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f251800d800 tx=0x7f251800dcc0 comp rx=0 tx=0).stop 2023-07-14T13:11:26.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.879+0000 7f253546d640 1 -- 172.21.15.5:0/1364514307 shutdown_connections 2023-07-14T13:11:26.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.879+0000 7f253546d640 1 --2- 172.21.15.5:0/1364514307 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f25100663a0 0x7f2510068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:26.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.879+0000 7f253546d640 1 --2- 172.21.15.5:0/1364514307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25300cf2e0 0x7f253015a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:26.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.879+0000 7f253546d640 1 --2- 172.21.15.5:0/1364514307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25300cc9c0 0x7f2530159c10 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:26.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.879+0000 7f253546d640 1 --2- 172.21.15.5:0/1364514307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f253006a540 0x7f25301531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:26.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.879+0000 7f253546d640 1 -- 172.21.15.5:0/1364514307 >> 172.21.15.5:0/1364514307 conn(0x7f2530099490 msgr2=0x7f25300acf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:26.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.883+0000 7f253546d640 1 -- 172.21.15.5:0/1364514307 shutdown_connections 2023-07-14T13:11:26.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:26.883+0000 7f253546d640 1 -- 172.21.15.5:0/1364514307 wait complete. 2023-07-14T13:11:26.943 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-14T13:11:27.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f276e52c640 1 Processor -- start 2023-07-14T13:11:27.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f276e52c640 1 -- start start 2023-07-14T13:11:27.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f276e52c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27680b38d0 0x7f2768070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:27.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f276e52c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27680cc900 con 0x7f27680cb360 2023-07-14T13:11:27.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f276e52c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27680ccbe0 con 0x7f27680cd490 2023-07-14T13:11:27.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f276e52c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f276815d780 con 0x7f27680b38d0 2023-07-14T13:11:27.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f2767fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f27680cb360 0x7f276815df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42388/0 (socket says 172.21.15.5:42388) 2023-07-14T13:11:27.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f2767fff640 1 -- 172.21.15.5:0/3734228385 learned_addr learned my addr 172.21.15.5:0/3734228385 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:27.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f2766ffd640 1 -- 172.21.15.5:0/3734228385 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1946946912 0 0) 0x7f27680cc900 con 0x7f27680cb360 2023-07-14T13:11:27.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f27677fe640 1 --2- 172.21.15.5:0/3734228385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27680b38d0 0x7f2768070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:27.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f2766ffd640 1 -- 172.21.15.5:0/3734228385 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2750003530 con 0x7f27680cb360 2023-07-14T13:11:27.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f2766ffd640 1 -- 172.21.15.5:0/3734228385 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3114230641 0 0) 0x7f2750003530 con 0x7f27680cb360 2023-07-14T13:11:27.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f2766ffd640 1 -- 172.21.15.5:0/3734228385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27680b38d0 msgr2=0x7f2768070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:27.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f2766ffd640 1 --2- 172.21.15.5:0/3734228385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27680b38d0 0x7f2768070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:27.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f2766ffd640 1 -- 172.21.15.5:0/3734228385 >> v1:172.21.15.154:6789/0 conn(0x7f27680cd490 legacy=0x7f27680c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:27.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f2766ffd640 1 -- 172.21.15.5:0/3734228385 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276815da60 con 0x7f27680cb360 2023-07-14T13:11:27.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f2766ffd640 1 -- 172.21.15.5:0/3734228385 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f2758001680 con 0x7f27680cb360 2023-07-14T13:11:27.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f2766ffd640 1 -- 172.21.15.5:0/3734228385 >> v1:172.21.15.5:6789/0 conn(0x7f27680cb360 legacy=0x7f276815df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:27.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f2766ffd640 1 --2- 172.21.15.5:0/3734228385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27500039b0 0x7f2750003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:27.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f2766ffd640 1 --2- 172.21.15.5:0/3734228385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27680b38d0 0x7f27500047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:27.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f2766ffd640 1 --2- 172.21.15.5:0/3734228385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2750004d10 0x7f2750005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:27.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f2766ffd640 1 -- 172.21.15.5:0/3734228385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276815d780 con 0x7f2750004d10 2023-07-14T13:11:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f2766ffd640 1 -- 172.21.15.5:0/3734228385 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275000bad0 con 0x7f27500039b0 2023-07-14T13:11:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f2766ffd640 1 -- 172.21.15.5:0/3734228385 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275000bc90 con 0x7f27680b38d0 2023-07-14T13:11:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f276cac9640 1 --2- 172.21.15.5:0/3734228385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2750004d10 0x7f2750005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f27677fe640 1 --2- 172.21.15.5:0/3734228385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27680b38d0 0x7f27500047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f2767fff640 1 --2- 172.21.15.5:0/3734228385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27500039b0 0x7f2750003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f276cac9640 1 -- 172.21.15.5:0/3734228385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27680b38d0 msgr2=0x7f27500047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f276cac9640 1 --2- 172.21.15.5:0/3734228385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27680b38d0 0x7f27500047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:27.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f276cac9640 1 -- 172.21.15.5:0/3734228385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27500039b0 msgr2=0x7f2750003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:27.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f276cac9640 1 --2- 172.21.15.5:0/3734228385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27500039b0 0x7f2750003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:27.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.063+0000 7f276cac9640 1 -- 172.21.15.5:0/3734228385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2750003530 con 0x7f2750004d10 2023-07-14T13:11:27.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.067+0000 7f276cac9640 1 --2- 172.21.15.5:0/3734228385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2750004d10 0x7f2750005180 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f2760001e40 tx=0x7f276001c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf3935e08d1e8761 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:27.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.067+0000 7f2766ffd640 1 -- 172.21.15.5:0/3734228385 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2760003b80 con 0x7f2750004d10 2023-07-14T13:11:27.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.067+0000 7f2766ffd640 1 -- 172.21.15.5:0/3734228385 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2760003ce0 con 0x7f2750004d10 2023-07-14T13:11:27.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.067+0000 7f2766ffd640 1 -- 172.21.15.5:0/3734228385 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27600052c0 con 0x7f2750004d10 2023-07-14T13:11:27.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.067+0000 7f276e52c640 1 -- 172.21.15.5:0/3734228385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2750004d10 msgr2=0x7f2750005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:27.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.067+0000 7f276e52c640 1 --2- 172.21.15.5:0/3734228385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2750004d10 0x7f2750005180 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f2760001e40 tx=0x7f276001c740 comp rx=0 tx=0).stop 2023-07-14T13:11:27.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.067+0000 7f276cac9640 1 -- 172.21.15.5:0/3734228385 reap_dead start 2023-07-14T13:11:27.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.067+0000 7f276e52c640 1 -- 172.21.15.5:0/3734228385 shutdown_connections 2023-07-14T13:11:27.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.067+0000 7f276e52c640 1 -- 172.21.15.5:0/3734228385 >> 172.21.15.5:0/3734228385 conn(0x7f27680afac0 msgr2=0x7f27680afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:27.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.067+0000 7f276e52c640 1 -- 172.21.15.5:0/3734228385 shutdown_connections 2023-07-14T13:11:27.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.067+0000 7f276e52c640 1 -- 172.21.15.5:0/3734228385 wait complete. 2023-07-14T13:11:27.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.067+0000 7f276e52c640 1 Processor -- start 2023-07-14T13:11:27.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.067+0000 7f276e52c640 1 -- start start 2023-07-14T13:11:27.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.071+0000 7f276e52c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2750004d10 0x7f2768157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:27.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.071+0000 7f276e52c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27680af600 0x7f27681f40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:27.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.071+0000 7f276e52c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2768157da0 0x7f27681f45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:27.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.071+0000 7f276e52c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27680c2130 con 0x7f27680af600 2023-07-14T13:11:27.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.071+0000 7f276e52c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27680a9200 con 0x7f2768157da0 2023-07-14T13:11:27.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.071+0000 7f276e52c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27680c17b0 con 0x7f2750004d10 2023-07-14T13:11:27.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.071+0000 7f27677fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27680af600 0x7f27681f40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:27.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.071+0000 7f27677fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27680af600 0x7f27681f40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40210/0 (socket says 172.21.15.5:40210) 2023-07-14T13:11:27.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.071+0000 7f27677fe640 1 -- 172.21.15.5:0/1521548712 learned_addr learned my addr 172.21.15.5:0/1521548712 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:27.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.071+0000 7f2767fff640 1 --2- 172.21.15.5:0/1521548712 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2750004d10 0x7f2768157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:27.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.071+0000 7f276cac9640 1 --2- 172.21.15.5:0/1521548712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2768157da0 0x7f27681f45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:27.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.071+0000 7f27677fe640 1 -- 172.21.15.5:0/1521548712 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2750004d10 msgr2=0x7f2768157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:27.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.071+0000 7f27677fe640 1 --2- 172.21.15.5:0/1521548712 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2750004d10 0x7f2768157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:27.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.071+0000 7f27677fe640 1 -- 172.21.15.5:0/1521548712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2768157da0 msgr2=0x7f27681f45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:27.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.071+0000 7f27677fe640 1 --2- 172.21.15.5:0/1521548712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2768157da0 0x7f27681f45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:27.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.071+0000 7f27677fe640 1 -- 172.21.15.5:0/1521548712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27681f4ec0 con 0x7f27680af600 2023-07-14T13:11:27.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.071+0000 7f27677fe640 1 --2- 172.21.15.5:0/1521548712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27680af600 0x7f27681f40b0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f275c011a00 tx=0x7f275c011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:27.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.071+0000 7f2764ff9640 1 -- 172.21.15.5:0/1521548712 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c00faf0 con 0x7f27680af600 2023-07-14T13:11:27.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.071+0000 7f2764ff9640 1 -- 172.21.15.5:0/1521548712 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275c00fc50 con 0x7f27680af600 2023-07-14T13:11:27.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.071+0000 7f2764ff9640 1 -- 172.21.15.5:0/1521548712 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c014440 con 0x7f27680af600 2023-07-14T13:11:27.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.071+0000 7f276e52c640 1 -- 172.21.15.5:0/1521548712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27680c1a70 con 0x7f27680af600 2023-07-14T13:11:27.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.071+0000 7f276e52c640 1 -- 172.21.15.5:0/1521548712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2768157ab0 con 0x7f27680af600 2023-07-14T13:11:27.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.071+0000 7f276e52c640 1 -- 172.21.15.5:0/1521548712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27680c2270 con 0x7f27680af600 2023-07-14T13:11:27.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.071+0000 7f2764ff9640 1 -- 172.21.15.5:0/1521548712 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f275c0145a0 con 0x7f27680af600 2023-07-14T13:11:27.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.075+0000 7f2764ff9640 1 --2- 172.21.15.5:0/1521548712 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f27540663a0 0x7f2754068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:27.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.075+0000 7f2764ff9640 1 -- 172.21.15.5:0/1521548712 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f275c084470 con 0x7f27680af600 2023-07-14T13:11:27.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.075+0000 7f2767fff640 1 --2- 172.21.15.5:0/1521548712 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f27540663a0 0x7f2754068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:27.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.075+0000 7f2767fff640 1 --2- 172.21.15.5:0/1521548712 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f27540663a0 0x7f2754068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2758000f70 tx=0x7f2758000ee0 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:27.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.079+0000 7f2764ff9640 1 -- 172.21.15.5:0/1521548712 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f27680c2270 con 0x7f27680af600 2023-07-14T13:11:27.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.239+0000 7f276e52c640 1 -- 172.21.15.5:0/1521548712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f27680678d0 con 0x7f27680af600 2023-07-14T13:11:27.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.887+0000 7f2764ff9640 1 -- 172.21.15.5:0/1521548712 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v125) v1 ==== 170+0+0 (secure 0 0 0) 0x7f275c0519e0 con 0x7f27680af600 2023-07-14T13:11:27.919 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-07-14T13:11:27.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.899+0000 7f276e52c640 1 -- 172.21.15.5:0/1521548712 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f27540663a0 msgr2=0x7f2754068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:27.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.899+0000 7f276e52c640 1 --2- 172.21.15.5:0/1521548712 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f27540663a0 0x7f2754068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2758000f70 tx=0x7f2758000ee0 comp rx=0 tx=0).stop 2023-07-14T13:11:27.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.899+0000 7f276e52c640 1 -- 172.21.15.5:0/1521548712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27680af600 msgr2=0x7f27681f40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:27.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.899+0000 7f276e52c640 1 --2- 172.21.15.5:0/1521548712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27680af600 0x7f27681f40b0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f275c011a00 tx=0x7f275c011e00 comp rx=0 tx=0).stop 2023-07-14T13:11:27.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.899+0000 7f276e52c640 1 -- 172.21.15.5:0/1521548712 shutdown_connections 2023-07-14T13:11:27.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.899+0000 7f276e52c640 1 --2- 172.21.15.5:0/1521548712 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f27540663a0 0x7f2754068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:27.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.899+0000 7f276e52c640 1 --2- 172.21.15.5:0/1521548712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2768157da0 0x7f27681f45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:27.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.903+0000 7f276e52c640 1 --2- 172.21.15.5:0/1521548712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27680af600 0x7f27681f40b0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:27.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.903+0000 7f276e52c640 1 --2- 172.21.15.5:0/1521548712 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2750004d10 0x7f2768157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:27.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.903+0000 7f276e52c640 1 -- 172.21.15.5:0/1521548712 >> 172.21.15.5:0/1521548712 conn(0x7f27680afac0 msgr2=0x7f2768070920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:27.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.903+0000 7f276e52c640 1 -- 172.21.15.5:0/1521548712 shutdown_connections 2023-07-14T13:11:27.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:27.903+0000 7f276e52c640 1 -- 172.21.15.5:0/1521548712 wait complete. 2023-07-14T13:11:27.963 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-14T13:11:28.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.079+0000 7fd05a234640 1 Processor -- start 2023-07-14T13:11:28.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.079+0000 7fd05a234640 1 -- start start 2023-07-14T13:11:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.083+0000 7fd05a234640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd05406a440 0x7fd0540b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.083+0000 7fd05a234640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd0541453a0 0x7fd05406c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.083+0000 7fd05a234640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd05406c040 con 0x7fd05415f690 2023-07-14T13:11:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.083+0000 7fd05a234640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd054160170 con 0x7fd0541453a0 2023-07-14T13:11:28.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.083+0000 7fd05a234640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd054160600 con 0x7fd05406a440 2023-07-14T13:11:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.083+0000 7fd0537fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd05415f690 0x7fd05415fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42402/0 (socket says 172.21.15.5:42402) 2023-07-14T13:11:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.083+0000 7fd0537fe640 1 -- 172.21.15.5:0/3892766840 learned_addr learned my addr 172.21.15.5:0/3892766840 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:28.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.083+0000 7fd053fff640 1 --2- 172.21.15.5:0/3892766840 >> v2:172.21.15.5:3300/0 conn(0x7fd0541453a0 0x7fd05406c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.083+0000 7fd052ffd640 1 --2- 172.21.15.5:0/3892766840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd05406a440 0x7fd0540b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.083+0000 7fd0527fc640 1 -- 172.21.15.5:0/3892766840 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002850758 0 0) 0x7fd05406c040 con 0x7fd05415f690 2023-07-14T13:11:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.083+0000 7fd0527fc640 1 -- 172.21.15.5:0/3892766840 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd03c003530 con 0x7fd05415f690 2023-07-14T13:11:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.083+0000 7fd053fff640 1 -- 172.21.15.5:0/3892766840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd05406a440 msgr2=0x7fd0540b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.083+0000 7fd053fff640 1 --2- 172.21.15.5:0/3892766840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd05406a440 0x7fd0540b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.083+0000 7fd053fff640 1 -- 172.21.15.5:0/3892766840 >> v1:172.21.15.5:6789/0 conn(0x7fd05415f690 legacy=0x7fd05415fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:28.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.083+0000 7fd053fff640 1 -- 172.21.15.5:0/3892766840 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd054160360 con 0x7fd0541453a0 2023-07-14T13:11:28.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.087+0000 7fd053fff640 1 --2- 172.21.15.5:0/3892766840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0541453a0 0x7fd05406c4d0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009d90 tx=0x7fd04c01c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e4483744f4c2d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:28.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.087+0000 7fd0527fc640 1 -- 172.21.15.5:0/3892766840 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0a6690 con 0x7fd0541453a0 2023-07-14T13:11:28.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.087+0000 7fd0527fc640 1 -- 172.21.15.5:0/3892766840 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04c0a67f0 con 0x7fd0541453a0 2023-07-14T13:11:28.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.087+0000 7fd0527fc640 1 -- 172.21.15.5:0/3892766840 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0a6b80 con 0x7fd0541453a0 2023-07-14T13:11:28.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.087+0000 7fd05a234640 1 -- 172.21.15.5:0/3892766840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0541453a0 msgr2=0x7fd05406c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:28.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.087+0000 7fd05a234640 1 --2- 172.21.15.5:0/3892766840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0541453a0 0x7fd05406c4d0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009d90 tx=0x7fd04c01c6b0 comp rx=0 tx=0).stop 2023-07-14T13:11:28.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.087+0000 7fd05a234640 1 -- 172.21.15.5:0/3892766840 shutdown_connections 2023-07-14T13:11:28.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.087+0000 7fd05a234640 1 --2- 172.21.15.5:0/3892766840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0541453a0 0x7fd05406c4d0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:28.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.087+0000 7fd05a234640 1 --2- 172.21.15.5:0/3892766840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd05406a440 0x7fd0540b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:28.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.087+0000 7fd05a234640 1 -- 172.21.15.5:0/3892766840 >> 172.21.15.5:0/3892766840 conn(0x7fd0540b1210 msgr2=0x7fd0540ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:28.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.087+0000 7fd05a234640 1 -- 172.21.15.5:0/3892766840 shutdown_connections 2023-07-14T13:11:28.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.087+0000 7fd05a234640 1 -- 172.21.15.5:0/3892766840 wait complete. 2023-07-14T13:11:28.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.087+0000 7fd05a234640 1 Processor -- start 2023-07-14T13:11:28.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.087+0000 7fd05a234640 1 -- start start 2023-07-14T13:11:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.091+0000 7fd05a234640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd05406a440 0x7fd05413f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.091+0000 7fd05a234640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0541453a0 0x7fd05413d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.091+0000 7fd05a234640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd05415f690 0x7fd05413ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.091+0000 7fd05a234640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05415eff0 con 0x7fd05415f690 2023-07-14T13:11:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.091+0000 7fd05a234640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05415dc70 con 0x7fd05406a440 2023-07-14T13:11:28.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.091+0000 7fd05a234640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd05415df50 con 0x7fd0541453a0 2023-07-14T13:11:28.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.091+0000 7fd053fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd05415f690 0x7fd05413ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:28.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.091+0000 7fd053fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd05415f690 0x7fd05413ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40228/0 (socket says 172.21.15.5:40228) 2023-07-14T13:11:28.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.091+0000 7fd053fff640 1 -- 172.21.15.5:0/2373894590 learned_addr learned my addr 172.21.15.5:0/2373894590 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:28.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.091+0000 7fd0537fe640 1 --2- 172.21.15.5:0/2373894590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd05406a440 0x7fd05413f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:28.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.091+0000 7fd052ffd640 1 --2- 172.21.15.5:0/2373894590 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0541453a0 0x7fd05413d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:28.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.091+0000 7fd053fff640 1 -- 172.21.15.5:0/2373894590 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0541453a0 msgr2=0x7fd05413d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:28.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.091+0000 7fd053fff640 1 --2- 172.21.15.5:0/2373894590 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0541453a0 0x7fd05413d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:28.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.091+0000 7fd053fff640 1 -- 172.21.15.5:0/2373894590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd05406a440 msgr2=0x7fd05413f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:28.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.091+0000 7fd053fff640 1 --2- 172.21.15.5:0/2373894590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd05406a440 0x7fd05413f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:28.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.091+0000 7fd053fff640 1 -- 172.21.15.5:0/2373894590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04c009a70 con 0x7fd05415f690 2023-07-14T13:11:28.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.091+0000 7fd053fff640 1 --2- 172.21.15.5:0/2373894590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd05415f690 0x7fd05413ddc0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009d90 tx=0x7fd04c019450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:28.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.091+0000 7fd03bfff640 1 -- 172.21.15.5:0/2373894590 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0b7070 con 0x7fd05415f690 2023-07-14T13:11:28.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.091+0000 7fd03bfff640 1 -- 172.21.15.5:0/2373894590 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04c0a7470 con 0x7fd05415f690 2023-07-14T13:11:28.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.091+0000 7fd03bfff640 1 -- 172.21.15.5:0/2373894590 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0a7820 con 0x7fd05415f690 2023-07-14T13:11:28.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.091+0000 7fd05a234640 1 -- 172.21.15.5:0/2373894590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd05415e230 con 0x7fd05415f690 2023-07-14T13:11:28.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.091+0000 7fd05a234640 1 -- 172.21.15.5:0/2373894590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd05415e7f0 con 0x7fd05415f690 2023-07-14T13:11:28.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.091+0000 7fd05a234640 1 -- 172.21.15.5:0/2373894590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0540678d0 con 0x7fd05415f690 2023-07-14T13:11:28.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.095+0000 7fd03bfff640 1 -- 172.21.15.5:0/2373894590 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd04c0a7980 con 0x7fd05415f690 2023-07-14T13:11:28.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.095+0000 7fd03bfff640 1 --2- 172.21.15.5:0/2373894590 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fd0400663a0 0x7fd040068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:28.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.095+0000 7fd03bfff640 1 -- 172.21.15.5:0/2373894590 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fd04c11e6c0 con 0x7fd05415f690 2023-07-14T13:11:28.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.095+0000 7fd0537fe640 1 --2- 172.21.15.5:0/2373894590 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fd0400663a0 0x7fd040068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:28.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.095+0000 7fd0537fe640 1 --2- 172.21.15.5:0/2373894590 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fd0400663a0 0x7fd040068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd0440011f0 tx=0x7fd044007d40 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:28.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.099+0000 7fd03bfff640 1 -- 172.21.15.5:0/2373894590 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd04c0ebaa0 con 0x7fd05415f690 2023-07-14T13:11:28.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.283+0000 7fd05a234640 1 -- 172.21.15.5:0/2373894590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd0540cf300 con 0x7fd05415f690 2023-07-14T13:11:28.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.943+0000 7fd03bfff640 1 -- 172.21.15.5:0/2373894590 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v53) v1 ==== 174+0+0 (secure 0 0 0) 0x7fd04c0ef0c0 con 0x7fd05415f690 2023-07-14T13:11:28.977 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 15 and data pool 16 2023-07-14T13:11:28.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.951+0000 7fd05a234640 1 -- 172.21.15.5:0/2373894590 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fd0400663a0 msgr2=0x7fd040068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:28.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.951+0000 7fd05a234640 1 --2- 172.21.15.5:0/2373894590 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fd0400663a0 0x7fd040068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd0440011f0 tx=0x7fd044007d40 comp rx=0 tx=0).stop 2023-07-14T13:11:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.951+0000 7fd05a234640 1 -- 172.21.15.5:0/2373894590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd05415f690 msgr2=0x7fd05413ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.951+0000 7fd05a234640 1 --2- 172.21.15.5:0/2373894590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd05415f690 0x7fd05413ddc0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009d90 tx=0x7fd04c019450 comp rx=0 tx=0).stop 2023-07-14T13:11:28.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.951+0000 7fd05a234640 1 -- 172.21.15.5:0/2373894590 shutdown_connections 2023-07-14T13:11:28.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.951+0000 7fd05a234640 1 --2- 172.21.15.5:0/2373894590 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fd0400663a0 0x7fd040068850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:28.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.951+0000 7fd05a234640 1 --2- 172.21.15.5:0/2373894590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd05415f690 0x7fd05413ddc0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:28.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.951+0000 7fd05a234640 1 --2- 172.21.15.5:0/2373894590 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0541453a0 0x7fd05413d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:28.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.951+0000 7fd05a234640 1 --2- 172.21.15.5:0/2373894590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd05406a440 0x7fd05413f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:28.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.951+0000 7fd05a234640 1 -- 172.21.15.5:0/2373894590 >> 172.21.15.5:0/2373894590 conn(0x7fd0540b1210 msgr2=0x7fd0540b3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:28.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.951+0000 7fd05a234640 1 -- 172.21.15.5:0/2373894590 shutdown_connections 2023-07-14T13:11:28.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:28.951+0000 7fd05a234640 1 -- 172.21.15.5:0/2373894590 wait complete. 2023-07-14T13:11:29.009 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:11:29.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.123+0000 7f68f3537640 1 Processor -- start 2023-07-14T13:11:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.123+0000 7f68f3537640 1 -- start start 2023-07-14T13:11:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.127+0000 7f68f3537640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68ec0afee0 0x7f68ec15d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.127+0000 7f68f3537640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68ec15ae40 con 0x7f68ec0b02b0 2023-07-14T13:11:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.127+0000 7f68f3537640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68ec15dc60 con 0x7f68ec0b3000 2023-07-14T13:11:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.127+0000 7f68f3537640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec15e500 con 0x7f68ec0afee0 2023-07-14T13:11:29.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.127+0000 7f68f0ad2640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f68ec0b02b0 0x7f68ec15a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46046/0 (socket says 172.21.15.5:46046) 2023-07-14T13:11:29.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.127+0000 7f68f0ad2640 1 -- 172.21.15.5:0/2728085915 learned_addr learned my addr 172.21.15.5:0/2728085915 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.127+0000 7f68f12d3640 1 --2- 172.21.15.5:0/2728085915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68ec0afee0 0x7f68ec15d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.127+0000 7f68e3fff640 1 -- 172.21.15.5:0/2728085915 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3216378022 0 0) 0x7f68ec15ae40 con 0x7f68ec0b02b0 2023-07-14T13:11:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.127+0000 7f68e3fff640 1 -- 172.21.15.5:0/2728085915 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68d8003530 con 0x7f68ec0b02b0 2023-07-14T13:11:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.127+0000 7f68e3fff640 1 -- 172.21.15.5:0/2728085915 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1017341432 0 0) 0x7f68ec15dc60 con 0x7f68ec0b3000 2023-07-14T13:11:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.127+0000 7f68e3fff640 1 -- 172.21.15.5:0/2728085915 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68ec15ae40 con 0x7f68ec0b3000 2023-07-14T13:11:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.127+0000 7f68f12d3640 1 -- 172.21.15.5:0/2728085915 >> v1:172.21.15.154:6789/0 conn(0x7f68ec0b3000 legacy=0x7f68ec0b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.127+0000 7f68f12d3640 1 -- 172.21.15.5:0/2728085915 >> v1:172.21.15.5:6789/0 conn(0x7f68ec0b02b0 legacy=0x7f68ec15a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:29.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.127+0000 7f68f12d3640 1 -- 172.21.15.5:0/2728085915 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ec15df40 con 0x7f68ec0afee0 2023-07-14T13:11:29.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.131+0000 7f68f12d3640 1 --2- 172.21.15.5:0/2728085915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68ec0afee0 0x7f68ec15d5f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f68e80097f0 tx=0x7f68e801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5afe3a5f655d220a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:29.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.131+0000 7f68e3fff640 1 -- 172.21.15.5:0/2728085915 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e80ab600 con 0x7f68ec0afee0 2023-07-14T13:11:29.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.131+0000 7f68e3fff640 1 -- 172.21.15.5:0/2728085915 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e80a7050 con 0x7f68ec0afee0 2023-07-14T13:11:29.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.131+0000 7f68e3fff640 1 -- 172.21.15.5:0/2728085915 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e80ab980 con 0x7f68ec0afee0 2023-07-14T13:11:29.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.131+0000 7f68f3537640 1 -- 172.21.15.5:0/2728085915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68ec0afee0 msgr2=0x7f68ec15d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:29.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.131+0000 7f68f3537640 1 --2- 172.21.15.5:0/2728085915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68ec0afee0 0x7f68ec15d5f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f68e80097f0 tx=0x7f68e801c430 comp rx=0 tx=0).stop 2023-07-14T13:11:29.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.131+0000 7f68f3537640 1 -- 172.21.15.5:0/2728085915 shutdown_connections 2023-07-14T13:11:29.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.131+0000 7f68f3537640 1 --2- 172.21.15.5:0/2728085915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68ec0afee0 0x7f68ec15d5f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.131+0000 7f68f3537640 1 -- 172.21.15.5:0/2728085915 >> 172.21.15.5:0/2728085915 conn(0x7f68ec06c7b0 msgr2=0x7f68ec06cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:29.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.131+0000 7f68f3537640 1 -- 172.21.15.5:0/2728085915 shutdown_connections 2023-07-14T13:11:29.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.131+0000 7f68f3537640 1 -- 172.21.15.5:0/2728085915 wait complete. 2023-07-14T13:11:29.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.131+0000 7f68f3537640 1 Processor -- start 2023-07-14T13:11:29.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.131+0000 7f68f3537640 1 -- start start 2023-07-14T13:11:29.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.135+0000 7f68f3537640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68ec0afee0 0x7f68ec0ac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.135+0000 7f68f3537640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68ec0b02b0 0x7f68ec070e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.135+0000 7f68f3537640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68ec0b3000 0x7f68ec14c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.135+0000 7f68f3537640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec0acf10 con 0x7f68ec0b3000 2023-07-14T13:11:29.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.135+0000 7f68f3537640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec0ab930 con 0x7f68ec0afee0 2023-07-14T13:11:29.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.135+0000 7f68f3537640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec0abc10 con 0x7f68ec0b02b0 2023-07-14T13:11:29.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.135+0000 7f68f1ad4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68ec0b3000 0x7f68ec14c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.135+0000 7f68f12d3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68ec0afee0 0x7f68ec0ac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.135+0000 7f68f0ad2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68ec0b02b0 0x7f68ec070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.135+0000 7f68f1ad4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68ec0b3000 0x7f68ec14c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57322/0 (socket says 172.21.15.5:57322) 2023-07-14T13:11:29.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.135+0000 7f68f1ad4640 1 -- 172.21.15.5:0/956118139 learned_addr learned my addr 172.21.15.5:0/956118139 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:29.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.135+0000 7f68f12d3640 1 --2- 172.21.15.5:0/956118139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68ec0afee0 0x7f68ec0ac9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:51524/0 (socket says 172.21.15.5:51524) 2023-07-14T13:11:29.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.135+0000 7f68f1ad4640 1 -- 172.21.15.5:0/956118139 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68ec0b02b0 msgr2=0x7f68ec070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:29.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.135+0000 7f68f1ad4640 1 --2- 172.21.15.5:0/956118139 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68ec0b02b0 0x7f68ec070e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.135+0000 7f68f1ad4640 1 -- 172.21.15.5:0/956118139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68ec0afee0 msgr2=0x7f68ec0ac9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:29.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.135+0000 7f68f1ad4640 1 --2- 172.21.15.5:0/956118139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68ec0afee0 0x7f68ec0ac9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.135+0000 7f68f1ad4640 1 -- 172.21.15.5:0/956118139 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e8009420 con 0x7f68ec0b3000 2023-07-14T13:11:29.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.135+0000 7f68f12d3640 1 --2- 172.21.15.5:0/956118139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68ec0afee0 0x7f68ec0ac9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:11:29.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.135+0000 7f68f1ad4640 1 --2- 172.21.15.5:0/956118139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68ec0b3000 0x7f68ec14c300 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f68e400c730 tx=0x7f68e400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:29.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.135+0000 7f68e1ffb640 1 -- 172.21.15.5:0/956118139 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e4003b80 con 0x7f68ec0b3000 2023-07-14T13:11:29.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.135+0000 7f68e1ffb640 1 -- 172.21.15.5:0/956118139 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e4003ce0 con 0x7f68ec0b3000 2023-07-14T13:11:29.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.135+0000 7f68f3537640 1 -- 172.21.15.5:0/956118139 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68ec0abef0 con 0x7f68ec0b3000 2023-07-14T13:11:29.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.135+0000 7f68e1ffb640 1 -- 172.21.15.5:0/956118139 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e400aa90 con 0x7f68ec0b3000 2023-07-14T13:11:29.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.135+0000 7f68f3537640 1 -- 172.21.15.5:0/956118139 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68ec0ac4b0 con 0x7f68ec0b3000 2023-07-14T13:11:29.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.135+0000 7f68f3537640 1 -- 172.21.15.5:0/956118139 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68ec0678d0 con 0x7f68ec0b3000 2023-07-14T13:11:29.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.135+0000 7f68e1ffb640 1 -- 172.21.15.5:0/956118139 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f68e400abf0 con 0x7f68ec0b3000 2023-07-14T13:11:29.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.139+0000 7f68e1ffb640 1 --2- 172.21.15.5:0/956118139 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f68d00663a0 0x7f68d0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.139+0000 7f68e1ffb640 1 -- 172.21.15.5:0/956118139 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f68e4083c30 con 0x7f68ec0b3000 2023-07-14T13:11:29.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.139+0000 7f68f12d3640 1 --2- 172.21.15.5:0/956118139 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f68d00663a0 0x7f68d0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.139+0000 7f68f12d3640 1 --2- 172.21.15.5:0/956118139 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f68d00663a0 0x7f68d0068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f68e80ad000 tx=0x7f68e80a6000 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:29.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.143+0000 7f68e1ffb640 1 -- 172.21.15.5:0/956118139 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f68e4050fc0 con 0x7f68ec0b3000 2023-07-14T13:11:29.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.299+0000 7f68f3537640 1 -- 172.21.15.5:0/956118139 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68ec0cbc70 con 0x7f68ec0b3000 2023-07-14T13:11:29.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.299+0000 7f68e1ffb640 1 -- 172.21.15.5:0/956118139 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+18258 (secure 0 0 0) 0x7f68e40545e0 con 0x7f68ec0b3000 2023-07-14T13:11:29.333 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:11:29.333 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":126,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:11:28.286863+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:11:26.406551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-14T13:11:27.287297+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:11:29.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.303+0000 7f68f3537640 1 -- 172.21.15.5:0/956118139 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f68d00663a0 msgr2=0x7f68d0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:29.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.303+0000 7f68f3537640 1 --2- 172.21.15.5:0/956118139 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f68d00663a0 0x7f68d0068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f68e80ad000 tx=0x7f68e80a6000 comp rx=0 tx=0).stop 2023-07-14T13:11:29.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.303+0000 7f68f3537640 1 -- 172.21.15.5:0/956118139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68ec0b3000 msgr2=0x7f68ec14c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:29.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.303+0000 7f68f3537640 1 --2- 172.21.15.5:0/956118139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68ec0b3000 0x7f68ec14c300 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f68e400c730 tx=0x7f68e400cbf0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.303+0000 7f68f3537640 1 -- 172.21.15.5:0/956118139 shutdown_connections 2023-07-14T13:11:29.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.303+0000 7f68f3537640 1 --2- 172.21.15.5:0/956118139 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f68d00663a0 0x7f68d0068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.303+0000 7f68f3537640 1 --2- 172.21.15.5:0/956118139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68ec0b3000 0x7f68ec14c300 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.303+0000 7f68f3537640 1 --2- 172.21.15.5:0/956118139 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68ec0b02b0 0x7f68ec070e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.303+0000 7f68f3537640 1 --2- 172.21.15.5:0/956118139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68ec0afee0 0x7f68ec0ac9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.303+0000 7f68f3537640 1 -- 172.21.15.5:0/956118139 >> 172.21.15.5:0/956118139 conn(0x7f68ec06c7b0 msgr2=0x7f68ec0ae3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:29.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.303+0000 7f68f3537640 1 -- 172.21.15.5:0/956118139 shutdown_connections 2023-07-14T13:11:29.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.303+0000 7f68f3537640 1 -- 172.21.15.5:0/956118139 wait complete. 2023-07-14T13:11:29.354 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:11:29.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.467+0000 7fee83796640 1 Processor -- start 2023-07-14T13:11:29.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.467+0000 7fee83796640 1 -- start start 2023-07-14T13:11:29.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.467+0000 7fee83796640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee7c0b7990 0x7fee7c0d0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.467+0000 7fee83796640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fee7c0d1840 0x7fee7c0d1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.467+0000 7fee83796640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee7c0b4840 con 0x7fee7c0d12f0 2023-07-14T13:11:29.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.467+0000 7fee83796640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee7c0cd060 con 0x7fee7c0d1840 2023-07-14T13:11:29.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.467+0000 7fee83796640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c0d1180 con 0x7fee7c0b7990 2023-07-14T13:11:29.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.467+0000 7fee81d33640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fee7c0d1840 0x7fee7c0d1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.467+0000 7fee81d33640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fee7c0d1840 0x7fee7c0d1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57326/0 (socket says 172.21.15.5:57326) 2023-07-14T13:11:29.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.467+0000 7fee81d33640 1 -- 172.21.15.5:0/1274308354 learned_addr learned my addr 172.21.15.5:0/1274308354 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:29.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.467+0000 7fee81532640 1 --2- 172.21.15.5:0/1274308354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee7c0b7990 0x7fee7c0d0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.467+0000 7fee81d33640 1 -- 172.21.15.5:0/1274308354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee7c0b7990 msgr2=0x7fee7c0d0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:29.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.467+0000 7fee81d33640 1 --2- 172.21.15.5:0/1274308354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee7c0b7990 0x7fee7c0d0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.467+0000 7fee81d33640 1 -- 172.21.15.5:0/1274308354 >> v1:172.21.15.154:6789/0 conn(0x7fee7c0d12f0 legacy=0x7fee7c15f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:29.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.467+0000 7fee81d33640 1 -- 172.21.15.5:0/1274308354 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7c0ccae0 con 0x7fee7c0d1840 2023-07-14T13:11:29.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.471+0000 7fee81d33640 1 --2- 172.21.15.5:0/1274308354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee7c0d1840 0x7fee7c0d1d90 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fee74009e80 tx=0x7fee7401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f986bcd81772f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:29.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.471+0000 7fee73fff640 1 -- 172.21.15.5:0/1274308354 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee740a5590 con 0x7fee7c0d1840 2023-07-14T13:11:29.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.471+0000 7fee73fff640 1 -- 172.21.15.5:0/1274308354 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee740a56f0 con 0x7fee7c0d1840 2023-07-14T13:11:29.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.471+0000 7fee73fff640 1 -- 172.21.15.5:0/1274308354 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee740a5a80 con 0x7fee7c0d1840 2023-07-14T13:11:29.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.471+0000 7fee83796640 1 -- 172.21.15.5:0/1274308354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee7c0d1840 msgr2=0x7fee7c0d1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:29.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.471+0000 7fee83796640 1 --2- 172.21.15.5:0/1274308354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee7c0d1840 0x7fee7c0d1d90 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fee74009e80 tx=0x7fee7401c8d0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.471+0000 7fee83796640 1 -- 172.21.15.5:0/1274308354 shutdown_connections 2023-07-14T13:11:29.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.471+0000 7fee83796640 1 --2- 172.21.15.5:0/1274308354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee7c0d1840 0x7fee7c0d1d90 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.471+0000 7fee83796640 1 --2- 172.21.15.5:0/1274308354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee7c0b7990 0x7fee7c0d0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.471+0000 7fee83796640 1 -- 172.21.15.5:0/1274308354 >> 172.21.15.5:0/1274308354 conn(0x7fee7c0650b0 msgr2=0x7fee7c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:29.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.471+0000 7fee83796640 1 -- 172.21.15.5:0/1274308354 shutdown_connections 2023-07-14T13:11:29.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.471+0000 7fee83796640 1 -- 172.21.15.5:0/1274308354 wait complete. 2023-07-14T13:11:29.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.475+0000 7fee83796640 1 Processor -- start 2023-07-14T13:11:29.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.475+0000 7fee83796640 1 -- start start 2023-07-14T13:11:29.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.475+0000 7fee83796640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee7c0b7990 0x7fee7c0cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.475+0000 7fee83796640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee7c0d12f0 0x7fee7c157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.475+0000 7fee83796640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee7c0d1840 0x7fee7c15f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.475+0000 7fee83796640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c157e70 con 0x7fee7c0d12f0 2023-07-14T13:11:29.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.475+0000 7fee83796640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c0c9980 con 0x7fee7c0b7990 2023-07-14T13:11:29.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.475+0000 7fee83796640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c0c9c60 con 0x7fee7c0d1840 2023-07-14T13:11:29.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.475+0000 7fee80d31640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee7c0d12f0 0x7fee7c157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.475+0000 7fee80d31640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee7c0d12f0 0x7fee7c157570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57330/0 (socket says 172.21.15.5:57330) 2023-07-14T13:11:29.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.475+0000 7fee80d31640 1 -- 172.21.15.5:0/2523776807 learned_addr learned my addr 172.21.15.5:0/2523776807 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:29.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.475+0000 7fee81532640 1 --2- 172.21.15.5:0/2523776807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee7c0b7990 0x7fee7c0cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.475+0000 7fee81d33640 1 --2- 172.21.15.5:0/2523776807 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee7c0d1840 0x7fee7c15f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.475+0000 7fee80d31640 1 -- 172.21.15.5:0/2523776807 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee7c0d1840 msgr2=0x7fee7c15f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:29.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.475+0000 7fee80d31640 1 --2- 172.21.15.5:0/2523776807 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee7c0d1840 0x7fee7c15f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.475+0000 7fee80d31640 1 -- 172.21.15.5:0/2523776807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee7c0b7990 msgr2=0x7fee7c0cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:29.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.475+0000 7fee80d31640 1 --2- 172.21.15.5:0/2523776807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee7c0b7990 0x7fee7c0cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.475+0000 7fee80d31640 1 -- 172.21.15.5:0/2523776807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee74009b30 con 0x7fee7c0d12f0 2023-07-14T13:11:29.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.475+0000 7fee81d33640 1 --2- 172.21.15.5:0/2523776807 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee7c0d1840 0x7fee7c15f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:11:29.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.475+0000 7fee80d31640 1 --2- 172.21.15.5:0/2523776807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee7c0d12f0 0x7fee7c157570 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fee6c00c3c0 tx=0x7fee6c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:29.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.475+0000 7fee71ffb640 1 -- 172.21.15.5:0/2523776807 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c0052d0 con 0x7fee7c0d12f0 2023-07-14T13:11:29.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.475+0000 7fee71ffb640 1 -- 172.21.15.5:0/2523776807 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6c005430 con 0x7fee7c0d12f0 2023-07-14T13:11:29.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.475+0000 7fee71ffb640 1 -- 172.21.15.5:0/2523776807 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c003840 con 0x7fee7c0d12f0 2023-07-14T13:11:29.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.475+0000 7fee83796640 1 -- 172.21.15.5:0/2523776807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7c0b7ee0 con 0x7fee7c0d12f0 2023-07-14T13:11:29.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.475+0000 7fee83796640 1 -- 172.21.15.5:0/2523776807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7c0ca220 con 0x7fee7c0d12f0 2023-07-14T13:11:29.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.479+0000 7fee83796640 1 -- 172.21.15.5:0/2523776807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7c157fe0 con 0x7fee7c0d12f0 2023-07-14T13:11:29.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.479+0000 7fee71ffb640 1 -- 172.21.15.5:0/2523776807 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fee6c0039a0 con 0x7fee7c0d12f0 2023-07-14T13:11:29.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.479+0000 7fee71ffb640 1 --2- 172.21.15.5:0/2523776807 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fee600663d0 0x7fee60068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.479+0000 7fee71ffb640 1 -- 172.21.15.5:0/2523776807 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fee6c083400 con 0x7fee7c0d12f0 2023-07-14T13:11:29.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.479+0000 7fee81532640 1 --2- 172.21.15.5:0/2523776807 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fee600663d0 0x7fee60068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.479+0000 7fee81532640 1 --2- 172.21.15.5:0/2523776807 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fee600663d0 0x7fee60068880 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fee78009ac0 tx=0x7fee78009190 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:29.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.483+0000 7fee71ffb640 1 -- 172.21.15.5:0/2523776807 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fee6c0506f0 con 0x7fee7c0d12f0 2023-07-14T13:11:29.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.643+0000 7fee83796640 1 -- 172.21.15.5:0/2523776807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee7c0678d0 con 0x7fee7c0d12f0 2023-07-14T13:11:29.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.643+0000 7fee71ffb640 1 -- 172.21.15.5:0/2523776807 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+18258 (secure 0 0 0) 0x7fee6c053d10 con 0x7fee7c0d12f0 2023-07-14T13:11:29.678 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:11:29.679 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":126,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:11:28.286863+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:11:26.406551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-14T13:11:27.287297+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:11:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.647+0000 7fee83796640 1 -- 172.21.15.5:0/2523776807 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fee600663d0 msgr2=0x7fee60068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.647+0000 7fee83796640 1 --2- 172.21.15.5:0/2523776807 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fee600663d0 0x7fee60068880 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fee78009ac0 tx=0x7fee78009190 comp rx=0 tx=0).stop 2023-07-14T13:11:29.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.647+0000 7fee83796640 1 -- 172.21.15.5:0/2523776807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee7c0d12f0 msgr2=0x7fee7c157570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.647+0000 7fee83796640 1 --2- 172.21.15.5:0/2523776807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee7c0d12f0 0x7fee7c157570 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fee6c00c3c0 tx=0x7fee6c00c880 comp rx=0 tx=0).stop 2023-07-14T13:11:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.647+0000 7fee83796640 1 -- 172.21.15.5:0/2523776807 shutdown_connections 2023-07-14T13:11:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.647+0000 7fee83796640 1 --2- 172.21.15.5:0/2523776807 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fee600663d0 0x7fee60068880 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.647+0000 7fee83796640 1 --2- 172.21.15.5:0/2523776807 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee7c0d1840 0x7fee7c15f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.647+0000 7fee83796640 1 --2- 172.21.15.5:0/2523776807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee7c0d12f0 0x7fee7c157570 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.647+0000 7fee83796640 1 --2- 172.21.15.5:0/2523776807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee7c0b7990 0x7fee7c0cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.647+0000 7fee83796640 1 -- 172.21.15.5:0/2523776807 >> 172.21.15.5:0/2523776807 conn(0x7fee7c0650b0 msgr2=0x7fee7c065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:29.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.647+0000 7fee83796640 1 -- 172.21.15.5:0/2523776807 shutdown_connections 2023-07-14T13:11:29.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.647+0000 7fee83796640 1 -- 172.21.15.5:0/2523776807 wait complete. 2023-07-14T13:11:29.700 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-14T13:11:29.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.815+0000 7fe351648640 1 Processor -- start 2023-07-14T13:11:29.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.815+0000 7fe351648640 1 -- start start 2023-07-14T13:11:29.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.815+0000 7fe351648640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe34c0cf710 0x7fe34c0caea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.815+0000 7fe351648640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe34c0d0920 con 0x7fe34c06a540 2023-07-14T13:11:29.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.815+0000 7fe351648640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe34c15bfd0 con 0x7fe34c0cf2e0 2023-07-14T13:11:29.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.815+0000 7fe351648640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe34c0cfd10 con 0x7fe34c0cf710 2023-07-14T13:11:29.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.815+0000 7fe34b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe34c0cf710 0x7fe34c0caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.815+0000 7fe34b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe34c0cf710 0x7fe34c0caea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57338/0 (socket says 172.21.15.5:57338) 2023-07-14T13:11:29.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.815+0000 7fe34b7fe640 1 -- 172.21.15.5:0/1131344171 learned_addr learned my addr 172.21.15.5:0/1131344171 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:29.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.815+0000 7fe34affd640 1 --1- 172.21.15.5:0/1131344171 >> v1:172.21.15.5:6789/0 conn(0x7fe34c06a540 0x7fe34c06a910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46056/0 (socket says 172.21.15.5:46056) 2023-07-14T13:11:29.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.819+0000 7fe34b7fe640 1 -- 172.21.15.5:0/1131344171 >> v1:172.21.15.154:6789/0 conn(0x7fe34c0cf2e0 legacy=0x7fe34c0ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:29.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.819+0000 7fe34b7fe640 1 -- 172.21.15.5:0/1131344171 >> v1:172.21.15.5:6789/0 conn(0x7fe34c06a540 legacy=0x7fe34c06a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:29.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.819+0000 7fe34b7fe640 1 -- 172.21.15.5:0/1131344171 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe34c0cfff0 con 0x7fe34c0cf710 2023-07-14T13:11:29.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.819+0000 7fe34b7fe640 1 --2- 172.21.15.5:0/1131344171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe34c0cf710 0x7fe34c0caea0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fe344009e50 tx=0x7fe34401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68408122a4bbaea7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:29.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.819+0000 7fe34a7fc640 1 -- 172.21.15.5:0/1131344171 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3440a5770 con 0x7fe34c0cf710 2023-07-14T13:11:29.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.819+0000 7fe34a7fc640 1 -- 172.21.15.5:0/1131344171 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3440a58d0 con 0x7fe34c0cf710 2023-07-14T13:11:29.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.819+0000 7fe34a7fc640 1 -- 172.21.15.5:0/1131344171 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3440a5c60 con 0x7fe34c0cf710 2023-07-14T13:11:29.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.819+0000 7fe351648640 1 -- 172.21.15.5:0/1131344171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe34c0cf710 msgr2=0x7fe34c0caea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:29.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.819+0000 7fe351648640 1 --2- 172.21.15.5:0/1131344171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe34c0cf710 0x7fe34c0caea0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fe344009e50 tx=0x7fe34401c9a0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.823+0000 7fe351648640 1 -- 172.21.15.5:0/1131344171 shutdown_connections 2023-07-14T13:11:29.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.823+0000 7fe351648640 1 --2- 172.21.15.5:0/1131344171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe34c0cf710 0x7fe34c0caea0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.823+0000 7fe351648640 1 -- 172.21.15.5:0/1131344171 >> 172.21.15.5:0/1131344171 conn(0x7fe34c099490 msgr2=0x7fe34c089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:29.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.823+0000 7fe351648640 1 -- 172.21.15.5:0/1131344171 shutdown_connections 2023-07-14T13:11:29.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.823+0000 7fe351648640 1 -- 172.21.15.5:0/1131344171 wait complete. 2023-07-14T13:11:29.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.823+0000 7fe351648640 1 Processor -- start 2023-07-14T13:11:29.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.823+0000 7fe351648640 1 -- start start 2023-07-14T13:11:29.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.823+0000 7fe351648640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe34c06a540 0x7fe34c14d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.823+0000 7fe351648640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe34c0cf2e0 0x7fe34c158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.823+0000 7fe351648640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe34c0cf710 0x7fe34c14ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.823+0000 7fe351648640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c15acc0 con 0x7fe34c0cf710 2023-07-14T13:11:29.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.823+0000 7fe351648640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c0b1a00 con 0x7fe34c06a540 2023-07-14T13:11:29.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.823+0000 7fe351648640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c14df50 con 0x7fe34c0cf2e0 2023-07-14T13:11:29.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.823+0000 7fe34b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe34c0cf710 0x7fe34c14ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.823+0000 7fe34b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe34c0cf710 0x7fe34c14ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57352/0 (socket says 172.21.15.5:57352) 2023-07-14T13:11:29.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.823+0000 7fe34b7fe640 1 -- 172.21.15.5:0/3238078792 learned_addr learned my addr 172.21.15.5:0/3238078792 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:29.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.823+0000 7fe34affd640 1 --2- 172.21.15.5:0/3238078792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe34c06a540 0x7fe34c14d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.823+0000 7fe343fff640 1 --2- 172.21.15.5:0/3238078792 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe34c0cf2e0 0x7fe34c158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.823+0000 7fe34b7fe640 1 -- 172.21.15.5:0/3238078792 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe34c0cf2e0 msgr2=0x7fe34c158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:29.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.823+0000 7fe34b7fe640 1 --2- 172.21.15.5:0/3238078792 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe34c0cf2e0 0x7fe34c158210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.823+0000 7fe34b7fe640 1 -- 172.21.15.5:0/3238078792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe34c06a540 msgr2=0x7fe34c14d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:29.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.823+0000 7fe34b7fe640 1 --2- 172.21.15.5:0/3238078792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe34c06a540 0x7fe34c14d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.823+0000 7fe34b7fe640 1 -- 172.21.15.5:0/3238078792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe344009b30 con 0x7fe34c0cf710 2023-07-14T13:11:29.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.823+0000 7fe34b7fe640 1 --2- 172.21.15.5:0/3238078792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe34c0cf710 0x7fe34c14ad80 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fe344009e50 tx=0x7fe344019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:29.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.823+0000 7fe3437fe640 1 -- 172.21.15.5:0/3238078792 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3440b8640 con 0x7fe34c0cf710 2023-07-14T13:11:29.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.827+0000 7fe3437fe640 1 -- 172.21.15.5:0/3238078792 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3440b87a0 con 0x7fe34c0cf710 2023-07-14T13:11:29.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.827+0000 7fe3437fe640 1 -- 172.21.15.5:0/3238078792 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3440b8b50 con 0x7fe34c0cf710 2023-07-14T13:11:29.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.827+0000 7fe351648640 1 -- 172.21.15.5:0/3238078792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe34c0b1720 con 0x7fe34c0cf710 2023-07-14T13:11:29.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.827+0000 7fe351648640 1 -- 172.21.15.5:0/3238078792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe34c15b1b0 con 0x7fe34c0cf710 2023-07-14T13:11:29.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.827+0000 7fe351648640 1 -- 172.21.15.5:0/3238078792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe34c0678d0 con 0x7fe34c0cf710 2023-07-14T13:11:29.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.827+0000 7fe3437fe640 1 -- 172.21.15.5:0/3238078792 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe3440b8cb0 con 0x7fe34c0cf710 2023-07-14T13:11:29.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.827+0000 7fe3437fe640 1 --2- 172.21.15.5:0/3238078792 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe32c0663a0 0x7fe32c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.827+0000 7fe3437fe640 1 -- 172.21.15.5:0/3238078792 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe34411f260 con 0x7fe34c0cf710 2023-07-14T13:11:29.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.827+0000 7fe34affd640 1 --2- 172.21.15.5:0/3238078792 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe32c0663a0 0x7fe32c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.831+0000 7fe34affd640 1 --2- 172.21.15.5:0/3238078792 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe32c0663a0 0x7fe32c068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe33c000f70 tx=0x7fe33c007c90 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:29.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:29.831+0000 7fe3437fe640 1 -- 172.21.15.5:0/3238078792 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe3440ec6e0 con 0x7fe34c0cf710 2023-07-14T13:11:30.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:30.023+0000 7fe351648640 1 -- 172.21.15.5:0/3238078792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe34c0b2a90 con 0x7fe34c0cf710 2023-07-14T13:11:30.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:30.943+0000 7fe3437fe640 1 -- 172.21.15.5:0/3238078792 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v56) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe3440efd00 con 0x7fe34c0cf710 2023-07-14T13:11:30.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:30.947+0000 7fe351648640 1 -- 172.21.15.5:0/3238078792 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe32c0663a0 msgr2=0x7fe32c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:30.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:30.947+0000 7fe351648640 1 --2- 172.21.15.5:0/3238078792 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe32c0663a0 0x7fe32c068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe33c000f70 tx=0x7fe33c007c90 comp rx=0 tx=0).stop 2023-07-14T13:11:30.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:30.947+0000 7fe351648640 1 -- 172.21.15.5:0/3238078792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe34c0cf710 msgr2=0x7fe34c14ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:30.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:30.947+0000 7fe351648640 1 --2- 172.21.15.5:0/3238078792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe34c0cf710 0x7fe34c14ad80 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fe344009e50 tx=0x7fe344019740 comp rx=0 tx=0).stop 2023-07-14T13:11:30.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:30.947+0000 7fe351648640 1 -- 172.21.15.5:0/3238078792 shutdown_connections 2023-07-14T13:11:30.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:30.947+0000 7fe351648640 1 --2- 172.21.15.5:0/3238078792 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe32c0663a0 0x7fe32c068850 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:30.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:30.947+0000 7fe351648640 1 --2- 172.21.15.5:0/3238078792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe34c0cf710 0x7fe34c14ad80 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:30.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:30.947+0000 7fe351648640 1 --2- 172.21.15.5:0/3238078792 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe34c0cf2e0 0x7fe34c158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:30.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:30.947+0000 7fe351648640 1 --2- 172.21.15.5:0/3238078792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe34c06a540 0x7fe34c14d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:30.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:30.947+0000 7fe351648640 1 -- 172.21.15.5:0/3238078792 >> 172.21.15.5:0/3238078792 conn(0x7fe34c099490 msgr2=0x7fe34c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:30.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:30.947+0000 7fe351648640 1 -- 172.21.15.5:0/3238078792 shutdown_connections 2023-07-14T13:11:30.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:30.947+0000 7fe351648640 1 -- 172.21.15.5:0/3238078792 wait complete. 2023-07-14T13:11:31.002 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-14T13:11:31.002 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-14T13:11:31.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.123+0000 7fe7a42ca640 1 Processor -- start 2023-07-14T13:11:31.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.123+0000 7fe7a42ca640 1 -- start start 2023-07-14T13:11:31.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.123+0000 7fe7a42ca640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe79c0aeb40 0x7fe79c15cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:31.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.123+0000 7fe7a42ca640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe79c0aef10 0x7fe79c158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:31.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.123+0000 7fe7a42ca640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79c1532b0 con 0x7fe79c159270 2023-07-14T13:11:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.123+0000 7fe7a42ca640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79c0ca6f0 con 0x7fe79c0aeb40 2023-07-14T13:11:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.123+0000 7fe7a42ca640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79c1599d0 con 0x7fe79c0aef10 2023-07-14T13:11:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.123+0000 7fe7a2066640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe79c0aeb40 0x7fe79c15cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.123+0000 7fe7a2066640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe79c0aeb40 0x7fe79c15cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57364/0 (socket says 172.21.15.5:57364) 2023-07-14T13:11:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.123+0000 7fe7a2066640 1 -- 172.21.15.5:0/3706011972 learned_addr learned my addr 172.21.15.5:0/3706011972 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.123+0000 7fe7a1865640 1 --2- 172.21.15.5:0/3706011972 >> v2:172.21.15.154:3300/0 conn(0x7fe79c0aef10 0x7fe79c158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.123+0000 7fe7a2066640 1 -- 172.21.15.5:0/3706011972 >> v2:172.21.15.154:3300/0 conn(0x7fe79c0aef10 msgr2=0x7fe79c158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.123+0000 7fe7a2066640 1 --2- 172.21.15.5:0/3706011972 >> v2:172.21.15.154:3300/0 conn(0x7fe79c0aef10 0x7fe79c158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.123+0000 7fe7a2066640 1 -- 172.21.15.5:0/3706011972 >> v1:172.21.15.154:6789/0 conn(0x7fe79c159270 legacy=0x7fe79c0c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.123+0000 7fe7a2066640 1 -- 172.21.15.5:0/3706011972 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79c159cb0 con 0x7fe79c0aeb40 2023-07-14T13:11:31.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.127+0000 7fe7a2066640 1 --2- 172.21.15.5:0/3706011972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe79c0aeb40 0x7fe79c15cef0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fe79c0cee90 tx=0x7fe79801e610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372ba370c740cd8e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.127+0000 7fe7a1064640 1 -- 172.21.15.5:0/3706011972 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7980aa640 con 0x7fe79c0aeb40 2023-07-14T13:11:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.127+0000 7fe7a1064640 1 -- 172.21.15.5:0/3706011972 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7980aa7a0 con 0x7fe79c0aeb40 2023-07-14T13:11:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.127+0000 7fe7a1064640 1 -- 172.21.15.5:0/3706011972 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7980aab30 con 0x7fe79c0aeb40 2023-07-14T13:11:31.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.127+0000 7fe7a42ca640 1 -- 172.21.15.5:0/3706011972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe79c0aeb40 msgr2=0x7fe79c15cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:31.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.127+0000 7fe7a42ca640 1 --2- 172.21.15.5:0/3706011972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe79c0aeb40 0x7fe79c15cef0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fe79c0cee90 tx=0x7fe79801e610 comp rx=0 tx=0).stop 2023-07-14T13:11:31.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.127+0000 7fe7a42ca640 1 -- 172.21.15.5:0/3706011972 shutdown_connections 2023-07-14T13:11:31.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.127+0000 7fe7a42ca640 1 --2- 172.21.15.5:0/3706011972 >> v2:172.21.15.154:3300/0 conn(0x7fe79c0aef10 0x7fe79c158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:31.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.127+0000 7fe7a42ca640 1 --2- 172.21.15.5:0/3706011972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe79c0aeb40 0x7fe79c15cef0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:31.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.127+0000 7fe7a42ca640 1 -- 172.21.15.5:0/3706011972 >> 172.21.15.5:0/3706011972 conn(0x7fe79c0cde90 msgr2=0x7fe79c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:31.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.127+0000 7fe7a42ca640 1 -- 172.21.15.5:0/3706011972 shutdown_connections 2023-07-14T13:11:31.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.127+0000 7fe7a42ca640 1 -- 172.21.15.5:0/3706011972 wait complete. 2023-07-14T13:11:31.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.131+0000 7fe7a42ca640 1 Processor -- start 2023-07-14T13:11:31.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.131+0000 7fe7a42ca640 1 -- start start 2023-07-14T13:11:31.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.131+0000 7fe7a42ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe79c0aeb40 0x7fe79c1f3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:31.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.131+0000 7fe7a42ca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe79c0aef10 0x7fe79c06b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:31.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.131+0000 7fe7a42ca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe79c159270 0x7fe79c0abc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:31.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.131+0000 7fe7a42ca640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c1569a0 con 0x7fe79c159270 2023-07-14T13:11:31.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.131+0000 7fe7a42ca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c156f60 con 0x7fe79c0aef10 2023-07-14T13:11:31.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.131+0000 7fe7a42ca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c1f40b0 con 0x7fe79c0aeb40 2023-07-14T13:11:31.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.131+0000 7fe7a2867640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe79c159270 0x7fe79c0abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.131+0000 7fe7a2867640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe79c159270 0x7fe79c0abc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57378/0 (socket says 172.21.15.5:57378) 2023-07-14T13:11:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.131+0000 7fe7a2867640 1 -- 172.21.15.5:0/2887282123 learned_addr learned my addr 172.21.15.5:0/2887282123 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.131+0000 7fe7a1865640 1 --2- 172.21.15.5:0/2887282123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe79c0aef10 0x7fe79c06b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.131+0000 7fe7a2066640 1 --2- 172.21.15.5:0/2887282123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe79c0aeb40 0x7fe79c1f3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.131+0000 7fe7a2867640 1 -- 172.21.15.5:0/2887282123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe79c0aeb40 msgr2=0x7fe79c1f3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.131+0000 7fe7a2867640 1 --2- 172.21.15.5:0/2887282123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe79c0aeb40 0x7fe79c1f3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.131+0000 7fe7a2867640 1 -- 172.21.15.5:0/2887282123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe79c0aef10 msgr2=0x7fe79c06b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.131+0000 7fe7a2867640 1 --2- 172.21.15.5:0/2887282123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe79c0aef10 0x7fe79c06b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.131+0000 7fe7a2867640 1 -- 172.21.15.5:0/2887282123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7980094d0 con 0x7fe79c159270 2023-07-14T13:11:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.131+0000 7fe7a2867640 1 --2- 172.21.15.5:0/2887282123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe79c159270 0x7fe79c0abc70 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fe79400b9a0 tx=0x7fe79400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.131+0000 7fe792ffd640 1 -- 172.21.15.5:0/2887282123 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79400cba0 con 0x7fe79c159270 2023-07-14T13:11:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.131+0000 7fe792ffd640 1 -- 172.21.15.5:0/2887282123 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79400cd00 con 0x7fe79c159270 2023-07-14T13:11:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.131+0000 7fe792ffd640 1 -- 172.21.15.5:0/2887282123 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe794014680 con 0x7fe79c159270 2023-07-14T13:11:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.131+0000 7fe7a42ca640 1 -- 172.21.15.5:0/2887282123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79c06bc90 con 0x7fe79c159270 2023-07-14T13:11:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.131+0000 7fe7a42ca640 1 -- 172.21.15.5:0/2887282123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79c156b80 con 0x7fe79c159270 2023-07-14T13:11:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.131+0000 7fe7a42ca640 1 -- 172.21.15.5:0/2887282123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79c06c1b0 con 0x7fe79c159270 2023-07-14T13:11:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.135+0000 7fe792ffd640 1 -- 172.21.15.5:0/2887282123 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe79401d3b0 con 0x7fe79c159270 2023-07-14T13:11:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.135+0000 7fe792ffd640 1 --2- 172.21.15.5:0/2887282123 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe7800663a0 0x7fe780068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.135+0000 7fe792ffd640 1 -- 172.21.15.5:0/2887282123 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe794083cb0 con 0x7fe79c159270 2023-07-14T13:11:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.135+0000 7fe7a2066640 1 --2- 172.21.15.5:0/2887282123 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe7800663a0 0x7fe780068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:31.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.135+0000 7fe7a2066640 1 --2- 172.21.15.5:0/2887282123 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe7800663a0 0x7fe780068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe7980b1000 tx=0x7fe798008040 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:31.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.139+0000 7fe792ffd640 1 -- 172.21.15.5:0/2887282123 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe79c06c1b0 con 0x7fe79c159270 2023-07-14T13:11:31.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.327+0000 7fe7a42ca640 1 -- 172.21.15.5:0/2887282123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe79c06c1b0 con 0x7fe79c159270 2023-07-14T13:11:31.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.951+0000 7fe792ffd640 1 -- 172.21.15.5:0/2887282123 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v57) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe79c06c1b0 con 0x7fe79c159270 2023-07-14T13:11:31.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.955+0000 7fe7a42ca640 1 -- 172.21.15.5:0/2887282123 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe7800663a0 msgr2=0x7fe780068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:31.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.955+0000 7fe7a42ca640 1 --2- 172.21.15.5:0/2887282123 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe7800663a0 0x7fe780068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe7980b1000 tx=0x7fe798008040 comp rx=0 tx=0).stop 2023-07-14T13:11:31.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.955+0000 7fe7a42ca640 1 -- 172.21.15.5:0/2887282123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe79c159270 msgr2=0x7fe79c0abc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:31.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.955+0000 7fe7a42ca640 1 --2- 172.21.15.5:0/2887282123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe79c159270 0x7fe79c0abc70 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fe79400b9a0 tx=0x7fe79400be60 comp rx=0 tx=0).stop 2023-07-14T13:11:31.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.955+0000 7fe7a42ca640 1 -- 172.21.15.5:0/2887282123 shutdown_connections 2023-07-14T13:11:31.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.955+0000 7fe7a42ca640 1 --2- 172.21.15.5:0/2887282123 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fe7800663a0 0x7fe780068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:31.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.955+0000 7fe7a42ca640 1 --2- 172.21.15.5:0/2887282123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe79c159270 0x7fe79c0abc70 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:31.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.955+0000 7fe7a42ca640 1 --2- 172.21.15.5:0/2887282123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe79c0aef10 0x7fe79c06b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:31.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.955+0000 7fe7a42ca640 1 --2- 172.21.15.5:0/2887282123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe79c0aeb40 0x7fe79c1f3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:31.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.955+0000 7fe7a42ca640 1 -- 172.21.15.5:0/2887282123 >> 172.21.15.5:0/2887282123 conn(0x7fe79c0cde90 msgr2=0x7fe79c0c88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:31.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.955+0000 7fe7a42ca640 1 -- 172.21.15.5:0/2887282123 shutdown_connections 2023-07-14T13:11:31.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:31.955+0000 7fe7a42ca640 1 -- 172.21.15.5:0/2887282123 wait complete. 2023-07-14T13:11:32.008 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-14T13:11:32.009 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:11:32.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.123+0000 7f2de7226640 1 Processor -- start 2023-07-14T13:11:32.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.123+0000 7f2de7226640 1 -- start start 2023-07-14T13:11:32.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.123+0000 7f2de7226640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2de006a540 0x7f2de006a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:32.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.123+0000 7f2de7226640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2de00ce0f0 0x7f2de00ce570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.123+0000 7f2de7226640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de00cdc80 con 0x7f2de015f500 2023-07-14T13:11:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.123+0000 7f2de7226640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de006af00 con 0x7f2de006a540 2023-07-14T13:11:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.123+0000 7f2de7226640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de006e4c0 con 0x7f2de00ce0f0 2023-07-14T13:11:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.123+0000 7f2de4fc2640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2de015f500 0x7f2de006cef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46060/0 (socket says 172.21.15.5:46060) 2023-07-14T13:11:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.123+0000 7f2de4fc2640 1 -- 172.21.15.5:0/727206521 learned_addr learned my addr 172.21.15.5:0/727206521 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:32.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.123+0000 7f2ddffff640 1 --2- 172.21.15.5:0/727206521 >> v2:172.21.15.154:3300/0 conn(0x7f2de006a540 0x7f2de006a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:32.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.123+0000 7f2ddf7fe640 1 -- 172.21.15.5:0/727206521 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541062682 0 0) 0x7f2de00cdc80 con 0x7f2de015f500 2023-07-14T13:11:32.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.123+0000 7f2de57c3640 1 --2- 172.21.15.5:0/727206521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2de00ce0f0 0x7f2de00ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:32.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.123+0000 7f2ddf7fe640 1 -- 172.21.15.5:0/727206521 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dd0003530 con 0x7f2de015f500 2023-07-14T13:11:32.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.127+0000 7f2ddf7fe640 1 -- 172.21.15.5:0/727206521 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 256362889 0 0) 0x7f2dd0003530 con 0x7f2de015f500 2023-07-14T13:11:32.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.127+0000 7f2ddf7fe640 1 -- 172.21.15.5:0/727206521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2de00ce0f0 msgr2=0x7f2de00ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:32.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.127+0000 7f2ddf7fe640 1 --2- 172.21.15.5:0/727206521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2de00ce0f0 0x7f2de00ce570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:32.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.127+0000 7f2ddf7fe640 1 -- 172.21.15.5:0/727206521 >> v2:172.21.15.154:3300/0 conn(0x7f2de006a540 msgr2=0x7f2de006a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:32.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.127+0000 7f2ddf7fe640 1 --2- 172.21.15.5:0/727206521 >> v2:172.21.15.154:3300/0 conn(0x7f2de006a540 0x7f2de006a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:32.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.127+0000 7f2ddf7fe640 1 -- 172.21.15.5:0/727206521 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de006d940 con 0x7f2de015f500 2023-07-14T13:11:32.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.127+0000 7f2ddf7fe640 1 -- 172.21.15.5:0/727206521 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f2dd4001800 con 0x7f2de015f500 2023-07-14T13:11:32.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.127+0000 7f2ddf7fe640 1 -- 172.21.15.5:0/727206521 >> v1:172.21.15.5:6789/0 conn(0x7f2de015f500 legacy=0x7f2de006cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:32.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.127+0000 7f2ddf7fe640 1 --2- 172.21.15.5:0/727206521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2de00ce0f0 0x7f2dd0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.127+0000 7f2ddf7fe640 1 --2- 172.21.15.5:0/727206521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd0003f00 0x7f2dd00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.127+0000 7f2ddf7fe640 1 --2- 172.21.15.5:0/727206521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2dd0004d10 0x7f2dd0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.127+0000 7f2ddf7fe640 1 -- 172.21.15.5:0/727206521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de006af00 con 0x7f2dd0004d10 2023-07-14T13:11:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.127+0000 7f2ddf7fe640 1 -- 172.21.15.5:0/727206521 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de006e4c0 con 0x7f2dd0003f00 2023-07-14T13:11:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.127+0000 7f2ddf7fe640 1 -- 172.21.15.5:0/727206521 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd000b990 con 0x7f2de00ce0f0 2023-07-14T13:11:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.127+0000 7f2ddffff640 1 --2- 172.21.15.5:0/727206521 >> v2:172.21.15.154:3300/0 conn(0x7f2de006a540 0x7f2de006a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:11:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.127+0000 7f2de57c3640 1 --2- 172.21.15.5:0/727206521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2dd0004d10 0x7f2dd0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.127+0000 7f2de4fc2640 1 --2- 172.21.15.5:0/727206521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2de00ce0f0 0x7f2dd0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.127+0000 7f2ddffff640 1 --2- 172.21.15.5:0/727206521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd0003f00 0x7f2dd00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.127+0000 7f2de57c3640 1 -- 172.21.15.5:0/727206521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2de00ce0f0 msgr2=0x7f2dd0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.127+0000 7f2de57c3640 1 --2- 172.21.15.5:0/727206521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2de00ce0f0 0x7f2dd0003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.127+0000 7f2de57c3640 1 -- 172.21.15.5:0/727206521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd0003f00 msgr2=0x7f2dd00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.127+0000 7f2de57c3640 1 --2- 172.21.15.5:0/727206521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2dd0003f00 0x7f2dd00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.127+0000 7f2de57c3640 1 -- 172.21.15.5:0/727206521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd0003530 con 0x7f2dd0004d10 2023-07-14T13:11:32.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.127+0000 7f2de57c3640 1 --2- 172.21.15.5:0/727206521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2dd0004d10 0x7f2dd0005180 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8009fc0 tx=0x7f2dd801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3c60f70d1633ee server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:32.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.131+0000 7f2ddf7fe640 1 -- 172.21.15.5:0/727206521 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd80a5c70 con 0x7f2dd0004d10 2023-07-14T13:11:32.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.131+0000 7f2ddf7fe640 1 -- 172.21.15.5:0/727206521 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd800f040 con 0x7f2dd0004d10 2023-07-14T13:11:32.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.131+0000 7f2ddf7fe640 1 -- 172.21.15.5:0/727206521 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd80ad440 con 0x7f2dd0004d10 2023-07-14T13:11:32.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.131+0000 7f2de7226640 1 -- 172.21.15.5:0/727206521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2dd0004d10 msgr2=0x7f2dd0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:32.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.131+0000 7f2de7226640 1 --2- 172.21.15.5:0/727206521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2dd0004d10 0x7f2dd0005180 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8009fc0 tx=0x7f2dd801cc60 comp rx=0 tx=0).stop 2023-07-14T13:11:32.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.131+0000 7f2de57c3640 1 -- 172.21.15.5:0/727206521 reap_dead start 2023-07-14T13:11:32.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.131+0000 7f2de7226640 1 -- 172.21.15.5:0/727206521 shutdown_connections 2023-07-14T13:11:32.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.131+0000 7f2de7226640 1 -- 172.21.15.5:0/727206521 >> 172.21.15.5:0/727206521 conn(0x7f2de00659d0 msgr2=0x7f2de0099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:32.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.131+0000 7f2de7226640 1 -- 172.21.15.5:0/727206521 shutdown_connections 2023-07-14T13:11:32.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.131+0000 7f2de7226640 1 -- 172.21.15.5:0/727206521 wait complete. 2023-07-14T13:11:32.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.131+0000 7f2de7226640 1 Processor -- start 2023-07-14T13:11:32.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.131+0000 7f2de7226640 1 -- start start 2023-07-14T13:11:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.131+0000 7f2de7226640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2dd0004d10 0x7f2de00c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.131+0000 7f2de7226640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2de01533f0 0x7f2de01493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.131+0000 7f2de7226640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2de00ca6e0 0x7f2de00b3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.131+0000 7f2de7226640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de00c4590 con 0x7f2dd0004d10 2023-07-14T13:11:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.131+0000 7f2de7226640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de00c4da0 con 0x7f2de01533f0 2023-07-14T13:11:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.131+0000 7f2de7226640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de00c6870 con 0x7f2de00ca6e0 2023-07-14T13:11:32.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.135+0000 7f2de4fc2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2dd0004d10 0x7f2de00c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.135+0000 7f2de4fc2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2dd0004d10 0x7f2de00c6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57390/0 (socket says 172.21.15.5:57390) 2023-07-14T13:11:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.135+0000 7f2de4fc2640 1 -- 172.21.15.5:0/147966494 learned_addr learned my addr 172.21.15.5:0/147966494 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.135+0000 7f2de57c3640 1 --2- 172.21.15.5:0/147966494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2de00ca6e0 0x7f2de00b3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.135+0000 7f2ddffff640 1 --2- 172.21.15.5:0/147966494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2de01533f0 0x7f2de01493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.135+0000 7f2de4fc2640 1 -- 172.21.15.5:0/147966494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2de00ca6e0 msgr2=0x7f2de00b3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.135+0000 7f2de4fc2640 1 --2- 172.21.15.5:0/147966494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2de00ca6e0 0x7f2de00b3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:32.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.135+0000 7f2de4fc2640 1 -- 172.21.15.5:0/147966494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2de01533f0 msgr2=0x7f2de01493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.135+0000 7f2de4fc2640 1 --2- 172.21.15.5:0/147966494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2de01533f0 0x7f2de01493c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.135+0000 7f2de4fc2640 1 -- 172.21.15.5:0/147966494 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de00c47e0 con 0x7f2dd0004d10 2023-07-14T13:11:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.135+0000 7f2de4fc2640 1 --2- 172.21.15.5:0/147966494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2dd0004d10 0x7f2de00c6220 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400fb60 tx=0x7f2dd400d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.135+0000 7f2ddd7fa640 1 -- 172.21.15.5:0/147966494 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd400fe60 con 0x7f2dd0004d10 2023-07-14T13:11:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.135+0000 7f2ddd7fa640 1 -- 172.21.15.5:0/147966494 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd400dc30 con 0x7f2dd0004d10 2023-07-14T13:11:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.135+0000 7f2de7226640 1 -- 172.21.15.5:0/147966494 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de00c4ac0 con 0x7f2dd0004d10 2023-07-14T13:11:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.135+0000 7f2ddd7fa640 1 -- 172.21.15.5:0/147966494 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd40070d0 con 0x7f2dd0004d10 2023-07-14T13:11:32.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.135+0000 7f2de7226640 1 -- 172.21.15.5:0/147966494 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de0155120 con 0x7f2dd0004d10 2023-07-14T13:11:32.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.135+0000 7f2de7226640 1 -- 172.21.15.5:0/147966494 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de0155340 con 0x7f2dd0004d10 2023-07-14T13:11:32.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.135+0000 7f2ddd7fa640 1 -- 172.21.15.5:0/147966494 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2dd4007230 con 0x7f2dd0004d10 2023-07-14T13:11:32.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.135+0000 7f2ddd7fa640 1 --2- 172.21.15.5:0/147966494 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f2dc40663f0 0x7f2dc40688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.139+0000 7f2ddd7fa640 1 -- 172.21.15.5:0/147966494 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2dd4083f80 con 0x7f2dd0004d10 2023-07-14T13:11:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.139+0000 7f2ddffff640 1 --2- 172.21.15.5:0/147966494 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f2dc40663f0 0x7f2dc40688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.139+0000 7f2ddffff640 1 --2- 172.21.15.5:0/147966494 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f2dc40663f0 0x7f2dc40688a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2de00ae940 tx=0x7f2dcc009190 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:32.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.139+0000 7f2ddd7fa640 1 -- 172.21.15.5:0/147966494 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2dd4051510 con 0x7f2dd0004d10 2023-07-14T13:11:32.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.327+0000 7f2de7226640 1 -- 172.21.15.5:0/147966494 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2de006e1b0 con 0x7f2dd0004d10 2023-07-14T13:11:32.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.331+0000 7f2ddd7fa640 1 -- 172.21.15.5:0/147966494 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4708 (secure 0 0 0) 0x7f2dd4054b30 con 0x7f2dd0004d10 2023-07-14T13:11:32.363 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:11:32.363 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6980,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2963267082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2963267082},{"type":"v1","addr":"172.21.15.154:6836","nonce":2963267082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7885,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1576178254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1576178254},{"type":"v1","addr":"172.21.15.154:6837","nonce":1576178254}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/849067278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":849067278},{"type":"v1","addr":"172.21.15.5:6833","nonce":849067278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:11:28.287189+0000","modified":"2023-07-14T13:11:31.942546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1610819689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1610819689},{"type":"v1","addr":"172.21.15.5:6835","nonce":1610819689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-14T13:11:32.363 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 57 2023-07-14T13:11:32.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.331+0000 7f2de7226640 1 -- 172.21.15.5:0/147966494 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f2dc40663f0 msgr2=0x7f2dc40688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:32.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.331+0000 7f2de7226640 1 --2- 172.21.15.5:0/147966494 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f2dc40663f0 0x7f2dc40688a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2de00ae940 tx=0x7f2dcc009190 comp rx=0 tx=0).stop 2023-07-14T13:11:32.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.331+0000 7f2de7226640 1 -- 172.21.15.5:0/147966494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2dd0004d10 msgr2=0x7f2de00c6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:32.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.331+0000 7f2de7226640 1 --2- 172.21.15.5:0/147966494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2dd0004d10 0x7f2de00c6220 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400fb60 tx=0x7f2dd400d520 comp rx=0 tx=0).stop 2023-07-14T13:11:32.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.331+0000 7f2de7226640 1 -- 172.21.15.5:0/147966494 shutdown_connections 2023-07-14T13:11:32.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.331+0000 7f2de7226640 1 --2- 172.21.15.5:0/147966494 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f2dc40663f0 0x7f2dc40688a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:32.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.331+0000 7f2de7226640 1 --2- 172.21.15.5:0/147966494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2de00ca6e0 0x7f2de00b3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:32.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.331+0000 7f2de7226640 1 --2- 172.21.15.5:0/147966494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2de01533f0 0x7f2de01493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:32.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.331+0000 7f2de7226640 1 --2- 172.21.15.5:0/147966494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2dd0004d10 0x7f2de00c6220 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:32.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.331+0000 7f2de7226640 1 -- 172.21.15.5:0/147966494 >> 172.21.15.5:0/147966494 conn(0x7f2de00659d0 msgr2=0x7f2de00adc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:32.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.331+0000 7f2de7226640 1 -- 172.21.15.5:0/147966494 shutdown_connections 2023-07-14T13:11:32.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.331+0000 7f2de7226640 1 -- 172.21.15.5:0/147966494 wait complete. 2023-07-14T13:11:32.384 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:11:32.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.495+0000 7f8083d74640 1 Processor -- start 2023-07-14T13:11:32.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.495+0000 7f8083d74640 1 -- start start 2023-07-14T13:11:32.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.495+0000 7f8083d74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f807c0c8940 0x7f807c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:32.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.495+0000 7f8083d74640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f807c0c0f80 0x7f807c0cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:32.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.495+0000 7f8083d74640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f807c0c17d0 con 0x7f807c160330 2023-07-14T13:11:32.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.495+0000 7f8083d74640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f807c0c14f0 con 0x7f807c0c0f80 2023-07-14T13:11:32.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.495+0000 7f8083d74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f807c0cac10 con 0x7f807c0c8940 2023-07-14T13:11:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.495+0000 7f808130f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f807c0c8940 0x7f807c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.495+0000 7f8082311640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f807c0c0f80 0x7f807c0cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.499+0000 7f808130f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f807c0c8940 0x7f807c0cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:47192/0 (socket says 172.21.15.5:47192) 2023-07-14T13:11:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.499+0000 7f808130f640 1 -- 172.21.15.5:0/108270667 learned_addr learned my addr 172.21.15.5:0/108270667 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.499+0000 7f808130f640 1 -- 172.21.15.5:0/108270667 >> v2:172.21.15.154:3300/0 conn(0x7f807c0c0f80 msgr2=0x7f807c0cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.499+0000 7f808130f640 1 --2- 172.21.15.5:0/108270667 >> v2:172.21.15.154:3300/0 conn(0x7f807c0c0f80 0x7f807c0cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:32.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.499+0000 7f808130f640 1 -- 172.21.15.5:0/108270667 >> v1:172.21.15.154:6789/0 conn(0x7f807c160330 legacy=0x7f807c0ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:32.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.499+0000 7f808130f640 1 -- 172.21.15.5:0/108270667 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807c0caef0 con 0x7f807c0c8940 2023-07-14T13:11:32.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.499+0000 7f8082311640 1 --2- 172.21.15.5:0/108270667 >> v2:172.21.15.154:3300/0 conn(0x7f807c0c0f80 0x7f807c0cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:11:32.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.499+0000 7f808130f640 1 --2- 172.21.15.5:0/108270667 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f807c0c8940 0x7f807c0cb6f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f806c009870 tx=0x7f806c01ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66fdb82e9a98bad4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:32.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.499+0000 7f8080b0e640 1 -- 172.21.15.5:0/108270667 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c0a8a30 con 0x7f807c0c8940 2023-07-14T13:11:32.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.499+0000 7f8080b0e640 1 -- 172.21.15.5:0/108270667 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806c0a8b90 con 0x7f807c0c8940 2023-07-14T13:11:32.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.499+0000 7f8080b0e640 1 -- 172.21.15.5:0/108270667 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c0b0440 con 0x7f807c0c8940 2023-07-14T13:11:32.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.503+0000 7f8083d74640 1 -- 172.21.15.5:0/108270667 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f807c0c8940 msgr2=0x7f807c0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:32.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.503+0000 7f8083d74640 1 --2- 172.21.15.5:0/108270667 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f807c0c8940 0x7f807c0cb6f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f806c009870 tx=0x7f806c01ed30 comp rx=0 tx=0).stop 2023-07-14T13:11:32.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.503+0000 7f8083d74640 1 -- 172.21.15.5:0/108270667 shutdown_connections 2023-07-14T13:11:32.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.503+0000 7f8083d74640 1 --2- 172.21.15.5:0/108270667 >> v2:172.21.15.154:3300/0 conn(0x7f807c0c0f80 0x7f807c0cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:32.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.503+0000 7f8083d74640 1 --2- 172.21.15.5:0/108270667 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f807c0c8940 0x7f807c0cb6f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:32.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.503+0000 7f8083d74640 1 -- 172.21.15.5:0/108270667 >> 172.21.15.5:0/108270667 conn(0x7f807c0afcf0 msgr2=0x7f807c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:32.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.503+0000 7f8083d74640 1 -- 172.21.15.5:0/108270667 shutdown_connections 2023-07-14T13:11:32.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.503+0000 7f8083d74640 1 -- 172.21.15.5:0/108270667 wait complete. 2023-07-14T13:11:32.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.503+0000 7f8083d74640 1 Processor -- start 2023-07-14T13:11:32.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.503+0000 7f8083d74640 1 -- start start 2023-07-14T13:11:32.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.503+0000 7f8083d74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f807c0c0f80 0x7f807c15caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:32.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.503+0000 7f8083d74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f807c0c8940 0x7f807c0c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:32.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.503+0000 7f8083d74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f807c160330 0x7f807c0cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:32.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.503+0000 7f8083d74640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807c1f6a80 con 0x7f807c160330 2023-07-14T13:11:32.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.503+0000 7f8083d74640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807c1f6d70 con 0x7f807c0c0f80 2023-07-14T13:11:32.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.503+0000 7f8083d74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f807c15d030 con 0x7f807c0c8940 2023-07-14T13:11:32.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.503+0000 7f8082311640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f807c160330 0x7f807c0cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:32.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.503+0000 7f8082311640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f807c160330 0x7f807c0cc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57400/0 (socket says 172.21.15.5:57400) 2023-07-14T13:11:32.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.503+0000 7f8082311640 1 -- 172.21.15.5:0/3006341746 learned_addr learned my addr 172.21.15.5:0/3006341746 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:32.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.503+0000 7f808130f640 1 --2- 172.21.15.5:0/3006341746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f807c0c8940 0x7f807c0c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:32.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.503+0000 7f8081b10640 1 --2- 172.21.15.5:0/3006341746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f807c0c0f80 0x7f807c15caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:32.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.503+0000 7f8082311640 1 -- 172.21.15.5:0/3006341746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f807c0c8940 msgr2=0x7f807c0c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:32.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.503+0000 7f8082311640 1 --2- 172.21.15.5:0/3006341746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f807c0c8940 0x7f807c0c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:32.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.503+0000 7f8082311640 1 -- 172.21.15.5:0/3006341746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f807c0c0f80 msgr2=0x7f807c15caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:32.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.503+0000 7f8082311640 1 --2- 172.21.15.5:0/3006341746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f807c0c0f80 0x7f807c15caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:32.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.503+0000 7f8082311640 1 -- 172.21.15.5:0/3006341746 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8074009a70 con 0x7f807c160330 2023-07-14T13:11:32.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.507+0000 7f8082311640 1 --2- 172.21.15.5:0/3006341746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f807c160330 0x7f807c0cc2b0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f807400efc0 tx=0x7f8074009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:32.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.507+0000 7f80727fc640 1 -- 172.21.15.5:0/3006341746 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8074009d70 con 0x7f807c160330 2023-07-14T13:11:32.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.507+0000 7f80727fc640 1 -- 172.21.15.5:0/3006341746 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807400f040 con 0x7f807c160330 2023-07-14T13:11:32.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.507+0000 7f80727fc640 1 -- 172.21.15.5:0/3006341746 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80740039a0 con 0x7f807c160330 2023-07-14T13:11:32.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.507+0000 7f8083d74640 1 -- 172.21.15.5:0/3006341746 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f806c0094d0 con 0x7f807c160330 2023-07-14T13:11:32.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.507+0000 7f8083d74640 1 -- 172.21.15.5:0/3006341746 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f807c1f60e0 con 0x7f807c160330 2023-07-14T13:11:32.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.507+0000 7f8083d74640 1 -- 172.21.15.5:0/3006341746 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f807c0678d0 con 0x7f807c160330 2023-07-14T13:11:32.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.507+0000 7f80727fc640 1 -- 172.21.15.5:0/3006341746 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f80740144a0 con 0x7f807c160330 2023-07-14T13:11:32.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.507+0000 7f80727fc640 1 --2- 172.21.15.5:0/3006341746 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f80600663a0 0x7f8060068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:32.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.507+0000 7f80727fc640 1 -- 172.21.15.5:0/3006341746 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8074084b70 con 0x7f807c160330 2023-07-14T13:11:32.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.507+0000 7f8081b10640 1 --2- 172.21.15.5:0/3006341746 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f80600663a0 0x7f8060068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:32.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.511+0000 7f8081b10640 1 --2- 172.21.15.5:0/3006341746 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f80600663a0 0x7f8060068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8078007fd0 tx=0x7f8078009040 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:32.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.511+0000 7f80727fc640 1 -- 172.21.15.5:0/3006341746 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f8074051de0 con 0x7f807c160330 2023-07-14T13:11:32.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.667+0000 7f8083d74640 1 -- 172.21.15.5:0/3006341746 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f807c06c380 con 0x7f807c160330 2023-07-14T13:11:32.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.667+0000 7f80727fc640 1 -- 172.21.15.5:0/3006341746 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+18245 (secure 0 0 0) 0x7f8074055400 con 0x7f807c160330 2023-07-14T13:11:32.702 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:11:32.702 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":127,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:11:29.927086+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:11:26.406551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-14T13:11:27.287297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:11:32.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.671+0000 7f8083d74640 1 -- 172.21.15.5:0/3006341746 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f80600663a0 msgr2=0x7f8060068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:32.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.671+0000 7f8083d74640 1 --2- 172.21.15.5:0/3006341746 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f80600663a0 0x7f8060068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8078007fd0 tx=0x7f8078009040 comp rx=0 tx=0).stop 2023-07-14T13:11:32.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.671+0000 7f8083d74640 1 -- 172.21.15.5:0/3006341746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f807c160330 msgr2=0x7f807c0cc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:32.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.671+0000 7f8083d74640 1 --2- 172.21.15.5:0/3006341746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f807c160330 0x7f807c0cc2b0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f807400efc0 tx=0x7f8074009f90 comp rx=0 tx=0).stop 2023-07-14T13:11:32.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.671+0000 7f8083d74640 1 -- 172.21.15.5:0/3006341746 shutdown_connections 2023-07-14T13:11:32.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.671+0000 7f8083d74640 1 --2- 172.21.15.5:0/3006341746 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f80600663a0 0x7f8060068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:32.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.671+0000 7f8083d74640 1 --2- 172.21.15.5:0/3006341746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f807c160330 0x7f807c0cc2b0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:32.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.671+0000 7f8083d74640 1 --2- 172.21.15.5:0/3006341746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f807c0c8940 0x7f807c0c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:32.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.671+0000 7f8083d74640 1 --2- 172.21.15.5:0/3006341746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f807c0c0f80 0x7f807c15caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:32.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.671+0000 7f8083d74640 1 -- 172.21.15.5:0/3006341746 >> 172.21.15.5:0/3006341746 conn(0x7f807c0afcf0 msgr2=0x7f807c070220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:32.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.671+0000 7f8083d74640 1 -- 172.21.15.5:0/3006341746 shutdown_connections 2023-07-14T13:11:32.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.671+0000 7f8083d74640 1 -- 172.21.15.5:0/3006341746 wait complete. 2023-07-14T13:11:32.723 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-14T13:11:32.723 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:11:32.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.835+0000 7f67714ca640 1 Processor -- start 2023-07-14T13:11:32.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.835+0000 7f67714ca640 1 -- start start 2023-07-14T13:11:32.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.835+0000 7f67714ca640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f676c0cdc80 0x7f676c0ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:32.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.835+0000 7f67714ca640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f676c0ad0d0 0x7f676c0ad530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:32.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.835+0000 7f67714ca640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f676c0ce5f0 con 0x7f676c15d0c0 2023-07-14T13:11:32.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.835+0000 7f67714ca640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f676c06d940 con 0x7f676c0ad0d0 2023-07-14T13:11:32.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.835+0000 7f67714ca640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f676c06dc20 con 0x7f676c0cdc80 2023-07-14T13:11:32.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.835+0000 7f676b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f676c0ad0d0 0x7f676c0ad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:32.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.835+0000 7f676b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f676c0ad0d0 0x7f676c0ad530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57406/0 (socket says 172.21.15.5:57406) 2023-07-14T13:11:32.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.835+0000 7f676b7fe640 1 -- 172.21.15.5:0/2113721112 learned_addr learned my addr 172.21.15.5:0/2113721112 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:32.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.839+0000 7f6763fff640 1 --2- 172.21.15.5:0/2113721112 >> v2:172.21.15.154:3300/0 conn(0x7f676c0cdc80 0x7f676c0ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:32.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.839+0000 7f676b7fe640 1 -- 172.21.15.5:0/2113721112 >> v2:172.21.15.154:3300/0 conn(0x7f676c0cdc80 msgr2=0x7f676c0ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:32.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.839+0000 7f676b7fe640 1 --2- 172.21.15.5:0/2113721112 >> v2:172.21.15.154:3300/0 conn(0x7f676c0cdc80 0x7f676c0ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:32.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.839+0000 7f676b7fe640 1 -- 172.21.15.5:0/2113721112 >> v1:172.21.15.154:6789/0 conn(0x7f676c15d0c0 legacy=0x7f676c06cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:32.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.839+0000 7f676b7fe640 1 -- 172.21.15.5:0/2113721112 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676c06df00 con 0x7f676c0ad0d0 2023-07-14T13:11:32.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.839+0000 7f676b7fe640 1 --2- 172.21.15.5:0/2113721112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f676c0ad0d0 0x7f676c0ad530 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f676c0d1190 tx=0x7f676401c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e8f53102d1a66f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:32.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.839+0000 7f676a7fc640 1 -- 172.21.15.5:0/2113721112 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67640a56d0 con 0x7f676c0ad0d0 2023-07-14T13:11:32.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.839+0000 7f676a7fc640 1 -- 172.21.15.5:0/2113721112 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67640a5830 con 0x7f676c0ad0d0 2023-07-14T13:11:32.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.839+0000 7f676a7fc640 1 -- 172.21.15.5:0/2113721112 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67640a5bc0 con 0x7f676c0ad0d0 2023-07-14T13:11:32.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.839+0000 7f67714ca640 1 -- 172.21.15.5:0/2113721112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f676c0ad0d0 msgr2=0x7f676c0ad530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:32.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.839+0000 7f67714ca640 1 --2- 172.21.15.5:0/2113721112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f676c0ad0d0 0x7f676c0ad530 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f676c0d1190 tx=0x7f676401c990 comp rx=0 tx=0).stop 2023-07-14T13:11:32.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.843+0000 7f67714ca640 1 -- 172.21.15.5:0/2113721112 shutdown_connections 2023-07-14T13:11:32.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.843+0000 7f67714ca640 1 --2- 172.21.15.5:0/2113721112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f676c0ad0d0 0x7f676c0ad530 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:32.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.843+0000 7f67714ca640 1 --2- 172.21.15.5:0/2113721112 >> v2:172.21.15.154:3300/0 conn(0x7f676c0cdc80 0x7f676c0ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:32.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.843+0000 7f67714ca640 1 -- 172.21.15.5:0/2113721112 >> 172.21.15.5:0/2113721112 conn(0x7f676c0659d0 msgr2=0x7f676c099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:32.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.843+0000 7f67714ca640 1 -- 172.21.15.5:0/2113721112 shutdown_connections 2023-07-14T13:11:32.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.843+0000 7f67714ca640 1 -- 172.21.15.5:0/2113721112 wait complete. 2023-07-14T13:11:32.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.843+0000 7f67714ca640 1 Processor -- start 2023-07-14T13:11:32.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.843+0000 7f67714ca640 1 -- start start 2023-07-14T13:11:32.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.843+0000 7f67714ca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f676c0ad0d0 0x7f676c0cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:32.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.843+0000 7f67714ca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f676c0cdc80 0x7f676c151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:32.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.843+0000 7f67714ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f676c15d0c0 0x7f676c0c5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:32.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.843+0000 7f67714ca640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676c0cbe00 con 0x7f676c0cdc80 2023-07-14T13:11:32.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.843+0000 7f67714ca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676c0cc760 con 0x7f676c0ad0d0 2023-07-14T13:11:32.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.843+0000 7f67714ca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676c151bb0 con 0x7f676c15d0c0 2023-07-14T13:11:32.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.843+0000 7f6763fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f676c0cdc80 0x7f676c151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:32.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.843+0000 7f6763fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f676c0cdc80 0x7f676c151670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57408/0 (socket says 172.21.15.5:57408) 2023-07-14T13:11:32.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.843+0000 7f6763fff640 1 -- 172.21.15.5:0/2903383453 learned_addr learned my addr 172.21.15.5:0/2903383453 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:32.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.843+0000 7f676affd640 1 --2- 172.21.15.5:0/2903383453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f676c0ad0d0 0x7f676c0cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:32.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.843+0000 7f676b7fe640 1 --2- 172.21.15.5:0/2903383453 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f676c15d0c0 0x7f676c0c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:32.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.843+0000 7f6763fff640 1 -- 172.21.15.5:0/2903383453 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f676c15d0c0 msgr2=0x7f676c0c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:32.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.843+0000 7f6763fff640 1 --2- 172.21.15.5:0/2903383453 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f676c15d0c0 0x7f676c0c5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:32.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.843+0000 7f6763fff640 1 -- 172.21.15.5:0/2903383453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f676c0ad0d0 msgr2=0x7f676c0cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:32.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.843+0000 7f6763fff640 1 --2- 172.21.15.5:0/2903383453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f676c0ad0d0 0x7f676c0cc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:32.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.843+0000 7f6763fff640 1 -- 172.21.15.5:0/2903383453 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6764009b30 con 0x7f676c0cdc80 2023-07-14T13:11:32.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.843+0000 7f6763fff640 1 --2- 172.21.15.5:0/2903383453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f676c0cdc80 0x7f676c151670 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f675400d830 tx=0x7f675400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:32.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.847+0000 7f67637fe640 1 -- 172.21.15.5:0/2903383453 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675400b6c0 con 0x7f676c0cdc80 2023-07-14T13:11:32.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.847+0000 7f67637fe640 1 -- 172.21.15.5:0/2903383453 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675400b820 con 0x7f676c0cdc80 2023-07-14T13:11:32.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.847+0000 7f67637fe640 1 -- 172.21.15.5:0/2903383453 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675400bb90 con 0x7f676c0cdc80 2023-07-14T13:11:32.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.847+0000 7f67714ca640 1 -- 172.21.15.5:0/2903383453 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f676c0cd590 con 0x7f676c0cdc80 2023-07-14T13:11:32.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.847+0000 7f67714ca640 1 -- 172.21.15.5:0/2903383453 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f676c0cb740 con 0x7f676c0cdc80 2023-07-14T13:11:32.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.847+0000 7f67714ca640 1 -- 172.21.15.5:0/2903383453 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f676c0678d0 con 0x7f676c0cdc80 2023-07-14T13:11:32.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.847+0000 7f67637fe640 1 -- 172.21.15.5:0/2903383453 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f675401e460 con 0x7f676c0cdc80 2023-07-14T13:11:32.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.847+0000 7f67637fe640 1 --2- 172.21.15.5:0/2903383453 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f674c0663a0 0x7f674c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:32.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.847+0000 7f67637fe640 1 -- 172.21.15.5:0/2903383453 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f67540844b0 con 0x7f676c0cdc80 2023-07-14T13:11:32.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.851+0000 7f676affd640 1 --2- 172.21.15.5:0/2903383453 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f674c0663a0 0x7f674c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:32.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.851+0000 7f676affd640 1 --2- 172.21.15.5:0/2903383453 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f674c0663a0 0x7f674c068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f675c006fd0 tx=0x7f675c009060 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:32.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:32.851+0000 7f67637fe640 1 -- 172.21.15.5:0/2903383453 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f67540518c0 con 0x7f676c0cdc80 2023-07-14T13:11:33.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.003+0000 7f67714ca640 1 -- 172.21.15.5:0/2903383453 --> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f676c06d600 con 0x7f674c0663a0 2023-07-14T13:11:33.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.015+0000 7f67637fe640 1 -- 172.21.15.5:0/2903383453 <== mgr.7657 v2:172.21.15.154:6832/938367911 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306369 (secure 0 0 0) 0x7f675c009550 con 0x7f674c0663a0 2023-07-14T13:11:33.051 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:11:33.052 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:11:33.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.019+0000 7f67714ca640 1 -- 172.21.15.5:0/2903383453 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f674c0663a0 msgr2=0x7f674c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:33.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.019+0000 7f67714ca640 1 --2- 172.21.15.5:0/2903383453 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f674c0663a0 0x7f674c068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f675c006fd0 tx=0x7f675c009060 comp rx=0 tx=0).stop 2023-07-14T13:11:33.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.019+0000 7f67714ca640 1 -- 172.21.15.5:0/2903383453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f676c0cdc80 msgr2=0x7f676c151670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:33.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.019+0000 7f67714ca640 1 --2- 172.21.15.5:0/2903383453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f676c0cdc80 0x7f676c151670 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f675400d830 tx=0x7f675400dcf0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.019+0000 7f67714ca640 1 -- 172.21.15.5:0/2903383453 shutdown_connections 2023-07-14T13:11:33.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.019+0000 7f67714ca640 1 --2- 172.21.15.5:0/2903383453 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f674c0663a0 0x7f674c068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.019+0000 7f67714ca640 1 --2- 172.21.15.5:0/2903383453 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f676c15d0c0 0x7f676c0c5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.019+0000 7f67714ca640 1 --2- 172.21.15.5:0/2903383453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f676c0cdc80 0x7f676c151670 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.019+0000 7f67714ca640 1 --2- 172.21.15.5:0/2903383453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f676c0ad0d0 0x7f676c0cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.019+0000 7f67714ca640 1 -- 172.21.15.5:0/2903383453 >> 172.21.15.5:0/2903383453 conn(0x7f676c0659d0 msgr2=0x7f676c06cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:33.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.019+0000 7f67714ca640 1 -- 172.21.15.5:0/2903383453 shutdown_connections 2023-07-14T13:11:33.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.019+0000 7f67714ca640 1 -- 172.21.15.5:0/2903383453 wait complete. 2023-07-14T13:11:33.071 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-14T13:11:32.582052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":340308,"kb_used_data":13204,"kb_used_omap":0,"kb_used_meta":327040,"kb_avail":754634412,"statfs":{"total":773094113280,"available":772745637888,"internally_reserved":0,"allocated":13520896,"data_stored":7424598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":334888960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.698344"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.895795+0000","last_change":"2023-07-14T13:11:27.895795+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.895795+0000","last_undegraded":"2023-07-14T13:11:27.895795+0000","last_fullsized":"2023-07-14T13:11:27.895795+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.907157+0000","last_change":"2023-07-14T13:11:27.907157+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.907157+0000","last_undegraded":"2023-07-14T13:11:27.907157+0000","last_fullsized":"2023-07-14T13:11:27.907157+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896573+0000","last_change":"2023-07-14T13:11:27.896573+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896573+0000","last_undegraded":"2023-07-14T13:11:27.896573+0000","last_fullsized":"2023-07-14T13:11:27.896573+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.892922+0000","last_change":"2023-07-14T13:11:27.892922+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.892922+0000","last_undegraded":"2023-07-14T13:11:27.892922+0000","last_fullsized":"2023-07-14T13:11:27.892922+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.895434+0000","last_change":"2023-07-14T13:11:27.895434+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.895434+0000","last_undegraded":"2023-07-14T13:11:27.895434+0000","last_fullsized":"2023-07-14T13:11:27.895434+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.905271+0000","last_change":"2023-07-14T13:11:27.905271+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.905271+0000","last_undegraded":"2023-07-14T13:11:27.905271+0000","last_fullsized":"2023-07-14T13:11:27.905271+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.904249+0000","last_change":"2023-07-14T13:11:27.904249+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.904249+0000","last_undegraded":"2023-07-14T13:11:27.904249+0000","last_fullsized":"2023-07-14T13:11:27.904249+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.897193+0000","last_change":"2023-07-14T13:11:27.897193+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.897193+0000","last_undegraded":"2023-07-14T13:11:27.897193+0000","last_fullsized":"2023-07-14T13:11:27.897193+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.907895+0000","last_change":"2023-07-14T13:11:27.907895+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.907895+0000","last_undegraded":"2023-07-14T13:11:27.907895+0000","last_fullsized":"2023-07-14T13:11:27.907895+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.893865+0000","last_change":"2023-07-14T13:11:27.893865+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.893865+0000","last_undegraded":"2023-07-14T13:11:27.893865+0000","last_fullsized":"2023-07-14T13:11:27.893865+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.901834+0000","last_change":"2023-07-14T13:11:27.901834+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.901834+0000","last_undegraded":"2023-07-14T13:11:27.901834+0000","last_fullsized":"2023-07-14T13:11:27.901834+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.894943+0000","last_change":"2023-07-14T13:11:27.894943+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.894943+0000","last_undegraded":"2023-07-14T13:11:27.894943+0000","last_fullsized":"2023-07-14T13:11:27.894943+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.891406+0000","last_change":"2023-07-14T13:11:27.891406+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.891406+0000","last_undegraded":"2023-07-14T13:11:27.891406+0000","last_fullsized":"2023-07-14T13:11:27.891406+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896301+0000","last_change":"2023-07-14T13:11:27.896301+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896301+0000","last_undegraded":"2023-07-14T13:11:27.896301+0000","last_fullsized":"2023-07-14T13:11:27.896301+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896227+0000","last_change":"2023-07-14T13:11:27.896227+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896227+0000","last_undegraded":"2023-07-14T13:11:27.896227+0000","last_fullsized":"2023-07-14T13:11:27.896227+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896163+0000","last_change":"2023-07-14T13:11:27.896163+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896163+0000","last_undegraded":"2023-07-14T13:11:27.896163+0000","last_fullsized":"2023-07-14T13:11:27.896163+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.895290+0000","last_change":"2023-07-14T13:11:27.895290+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.895290+0000","last_undegraded":"2023-07-14T13:11:27.895290+0000","last_fullsized":"2023-07-14T13:11:27.895290+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.906686+0000","last_change":"2023-07-14T13:11:27.906686+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.906686+0000","last_undegraded":"2023-07-14T13:11:27.906686+0000","last_fullsized":"2023-07-14T13:11:27.906686+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896085+0000","last_change":"2023-07-14T13:11:27.896085+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896085+0000","last_undegraded":"2023-07-14T13:11:27.896085+0000","last_fullsized":"2023-07-14T13:11:27.896085+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.892998+0000","last_change":"2023-07-14T13:11:27.892998+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.892998+0000","last_undegraded":"2023-07-14T13:11:27.892998+0000","last_fullsized":"2023-07-14T13:11:27.892998+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896165+0000","last_change":"2023-07-14T13:11:27.896165+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896165+0000","last_undegraded":"2023-07-14T13:11:27.896165+0000","last_fullsized":"2023-07-14T13:11:27.896165+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.897491+0000","last_change":"2023-07-14T13:11:27.897491+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.897491+0000","last_undegraded":"2023-07-14T13:11:27.897491+0000","last_fullsized":"2023-07-14T13:11:27.897491+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.890634+0000","last_change":"2023-07-14T13:11:27.890634+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.890634+0000","last_undegraded":"2023-07-14T13:11:27.890634+0000","last_fullsized":"2023-07-14T13:11:27.890634+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.895068+0000","last_change":"2023-07-14T13:11:27.895068+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.895068+0000","last_undegraded":"2023-07-14T13:11:27.895068+0000","last_fullsized":"2023-07-14T13:11:27.895068+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.892645+0000","last_change":"2023-07-14T13:11:27.892645+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.892645+0000","last_undegraded":"2023-07-14T13:11:27.892645+0000","last_fullsized":"2023-07-14T13:11:27.892645+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.894405+0000","last_change":"2023-07-14T13:11:27.894405+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.894405+0000","last_undegraded":"2023-07-14T13:11:27.894405+0000","last_fullsized":"2023-07-14T13:11:27.894405+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.901319+0000","last_change":"2023-07-14T13:11:27.901319+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.901319+0000","last_undegraded":"2023-07-14T13:11:27.901319+0000","last_fullsized":"2023-07-14T13:11:27.901319+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.907554+0000","last_change":"2023-07-14T13:11:27.907554+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.907554+0000","last_undegraded":"2023-07-14T13:11:27.907554+0000","last_fullsized":"2023-07-14T13:11:27.907554+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.893622+0000","last_change":"2023-07-14T13:11:27.893622+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.893622+0000","last_undegraded":"2023-07-14T13:11:27.893622+0000","last_fullsized":"2023-07-14T13:11:27.893622+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.894205+0000","last_change":"2023-07-14T13:11:27.894205+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.894205+0000","last_undegraded":"2023-07-14T13:11:27.894205+0000","last_fullsized":"2023-07-14T13:11:27.894205+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.903653+0000","last_change":"2023-07-14T13:11:27.903653+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.903653+0000","last_undegraded":"2023-07-14T13:11:27.903653+0000","last_fullsized":"2023-07-14T13:11:27.903653+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896718+0000","last_change":"2023-07-14T13:11:27.896718+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896718+0000","last_undegraded":"2023-07-14T13:11:27.896718+0000","last_fullsized":"2023-07-14T13:11:27.896718+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.890117+0000","last_change":"2023-07-14T13:11:27.890117+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.890117+0000","last_undegraded":"2023-07-14T13:11:27.890117+0000","last_fullsized":"2023-07-14T13:11:27.890117+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.914043+0000","last_change":"2023-07-14T13:11:27.912001+0000","last_active":"2023-07-14T13:11:27.914043+0000","last_peered":"2023-07-14T13:11:27.914043+0000","last_clean":"2023-07-14T13:11:27.914043+0000","last_became_active":"2023-07-14T13:11:27.911416+0000","last_became_peered":"2023-07-14T13:11:27.911416+0000","last_unstale":"2023-07-14T13:11:27.914043+0000","last_undegraded":"2023-07-14T13:11:27.914043+0000","last_fullsized":"2023-07-14T13:11:27.914043+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:06:23.094335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.892755+0000","last_change":"2023-07-14T13:11:27.892755+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.892755+0000","last_undegraded":"2023-07-14T13:11:27.892755+0000","last_fullsized":"2023-07-14T13:11:27.892755+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.912220+0000","last_change":"2023-07-14T13:11:27.908608+0000","last_active":"2023-07-14T13:11:27.912220+0000","last_peered":"2023-07-14T13:11:27.912220+0000","last_clean":"2023-07-14T13:11:27.912220+0000","last_became_active":"2023-07-14T13:11:27.908336+0000","last_became_peered":"2023-07-14T13:11:27.908336+0000","last_unstale":"2023-07-14T13:11:27.912220+0000","last_undegraded":"2023-07-14T13:11:27.912220+0000","last_fullsized":"2023-07-14T13:11:27.912220+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:41:02.058425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.892949+0000","last_change":"2023-07-14T13:11:27.892949+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.892949+0000","last_undegraded":"2023-07-14T13:11:27.892949+0000","last_fullsized":"2023-07-14T13:11:27.892949+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.911273+0000","last_change":"2023-07-14T13:11:27.909451+0000","last_active":"2023-07-14T13:11:27.911273+0000","last_peered":"2023-07-14T13:11:27.911273+0000","last_clean":"2023-07-14T13:11:27.911273+0000","last_became_active":"2023-07-14T13:11:27.909180+0000","last_became_peered":"2023-07-14T13:11:27.909180+0000","last_unstale":"2023-07-14T13:11:27.911273+0000","last_undegraded":"2023-07-14T13:11:27.911273+0000","last_fullsized":"2023-07-14T13:11:27.911273+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:17:10.167032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.897580+0000","last_change":"2023-07-14T13:11:27.897580+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.897580+0000","last_undegraded":"2023-07-14T13:11:27.897580+0000","last_fullsized":"2023-07-14T13:11:27.897580+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.907950+0000","last_change":"2023-07-14T13:11:27.902198+0000","last_active":"2023-07-14T13:11:27.907950+0000","last_peered":"2023-07-14T13:11:27.907950+0000","last_clean":"2023-07-14T13:11:27.907950+0000","last_became_active":"2023-07-14T13:11:27.901878+0000","last_became_peered":"2023-07-14T13:11:27.901878+0000","last_unstale":"2023-07-14T13:11:27.907950+0000","last_undegraded":"2023-07-14T13:11:27.907950+0000","last_fullsized":"2023-07-14T13:11:27.907950+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:24:24.888974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.892486+0000","last_change":"2023-07-14T13:11:27.892486+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.892486+0000","last_undegraded":"2023-07-14T13:11:27.892486+0000","last_fullsized":"2023-07-14T13:11:27.892486+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.917311+0000","last_change":"2023-07-14T13:11:27.915760+0000","last_active":"2023-07-14T13:11:27.917311+0000","last_peered":"2023-07-14T13:11:27.917311+0000","last_clean":"2023-07-14T13:11:27.917311+0000","last_became_active":"2023-07-14T13:11:27.915444+0000","last_became_peered":"2023-07-14T13:11:27.915444+0000","last_unstale":"2023-07-14T13:11:27.917311+0000","last_undegraded":"2023-07-14T13:11:27.917311+0000","last_fullsized":"2023-07-14T13:11:27.917311+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:07:12.354729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.890139+0000","last_change":"2023-07-14T13:11:27.890139+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.890139+0000","last_undegraded":"2023-07-14T13:11:27.890139+0000","last_fullsized":"2023-07-14T13:11:27.890139+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.906142+0000","last_change":"2023-07-14T13:11:27.904817+0000","last_active":"2023-07-14T13:11:27.906142+0000","last_peered":"2023-07-14T13:11:27.906142+0000","last_clean":"2023-07-14T13:11:27.906142+0000","last_became_active":"2023-07-14T13:11:27.904417+0000","last_became_peered":"2023-07-14T13:11:27.904417+0000","last_unstale":"2023-07-14T13:11:27.906142+0000","last_undegraded":"2023-07-14T13:11:27.906142+0000","last_fullsized":"2023-07-14T13:11:27.906142+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:34:55.739790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.906115+0000","last_change":"2023-07-14T13:11:27.906115+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.906115+0000","last_undegraded":"2023-07-14T13:11:27.906115+0000","last_fullsized":"2023-07-14T13:11:27.906115+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.909872+0000","last_change":"2023-07-14T13:11:27.904887+0000","last_active":"2023-07-14T13:11:27.909872+0000","last_peered":"2023-07-14T13:11:27.909872+0000","last_clean":"2023-07-14T13:11:27.909872+0000","last_became_active":"2023-07-14T13:11:27.904566+0000","last_became_peered":"2023-07-14T13:11:27.904566+0000","last_unstale":"2023-07-14T13:11:27.909872+0000","last_undegraded":"2023-07-14T13:11:27.909872+0000","last_fullsized":"2023-07-14T13:11:27.909872+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:21:34.987957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.891818+0000","last_change":"2023-07-14T13:11:27.891818+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.891818+0000","last_undegraded":"2023-07-14T13:11:27.891818+0000","last_fullsized":"2023-07-14T13:11:27.891818+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.909052+0000","last_change":"2023-07-14T13:11:27.903404+0000","last_active":"2023-07-14T13:11:27.909052+0000","last_peered":"2023-07-14T13:11:27.909052+0000","last_clean":"2023-07-14T13:11:27.909052+0000","last_became_active":"2023-07-14T13:11:27.903115+0000","last_became_peered":"2023-07-14T13:11:27.903115+0000","last_unstale":"2023-07-14T13:11:27.909052+0000","last_undegraded":"2023-07-14T13:11:27.909052+0000","last_fullsized":"2023-07-14T13:11:27.909052+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:49.123489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.890934+0000","last_change":"2023-07-14T13:11:27.890934+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.890934+0000","last_undegraded":"2023-07-14T13:11:27.890934+0000","last_fullsized":"2023-07-14T13:11:27.890934+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.909707+0000","last_change":"2023-07-14T13:11:27.904996+0000","last_active":"2023-07-14T13:11:27.909707+0000","last_peered":"2023-07-14T13:11:27.909707+0000","last_clean":"2023-07-14T13:11:27.909707+0000","last_became_active":"2023-07-14T13:11:27.904702+0000","last_became_peered":"2023-07-14T13:11:27.904702+0000","last_unstale":"2023-07-14T13:11:27.909707+0000","last_undegraded":"2023-07-14T13:11:27.909707+0000","last_fullsized":"2023-07-14T13:11:27.909707+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:44.896082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.897030+0000","last_change":"2023-07-14T13:11:27.897030+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.897030+0000","last_undegraded":"2023-07-14T13:11:27.897030+0000","last_fullsized":"2023-07-14T13:11:27.897030+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.905277+0000","last_change":"2023-07-14T13:11:27.900517+0000","last_active":"2023-07-14T13:11:27.905277+0000","last_peered":"2023-07-14T13:11:27.905277+0000","last_clean":"2023-07-14T13:11:27.905277+0000","last_became_active":"2023-07-14T13:11:27.900219+0000","last_became_peered":"2023-07-14T13:11:27.900219+0000","last_unstale":"2023-07-14T13:11:27.905277+0000","last_undegraded":"2023-07-14T13:11:27.905277+0000","last_fullsized":"2023-07-14T13:11:27.905277+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:35:12.791399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.892585+0000","last_change":"2023-07-14T13:11:27.892585+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.892585+0000","last_undegraded":"2023-07-14T13:11:27.892585+0000","last_fullsized":"2023-07-14T13:11:27.892585+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.915102+0000","last_change":"2023-07-14T13:11:27.911972+0000","last_active":"2023-07-14T13:11:27.915102+0000","last_peered":"2023-07-14T13:11:27.915102+0000","last_clean":"2023-07-14T13:11:27.915102+0000","last_became_active":"2023-07-14T13:11:27.911403+0000","last_became_peered":"2023-07-14T13:11:27.911403+0000","last_unstale":"2023-07-14T13:11:27.915102+0000","last_undegraded":"2023-07-14T13:11:27.915102+0000","last_fullsized":"2023-07-14T13:11:27.915102+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:06:40.624907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.894417+0000","last_change":"2023-07-14T13:11:27.894417+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.894417+0000","last_undegraded":"2023-07-14T13:11:27.894417+0000","last_fullsized":"2023-07-14T13:11:27.894417+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.916428+0000","last_change":"2023-07-14T13:11:27.910905+0000","last_active":"2023-07-14T13:11:27.916428+0000","last_peered":"2023-07-14T13:11:27.916428+0000","last_clean":"2023-07-14T13:11:27.916428+0000","last_became_active":"2023-07-14T13:11:27.910550+0000","last_became_peered":"2023-07-14T13:11:27.910550+0000","last_unstale":"2023-07-14T13:11:27.916428+0000","last_undegraded":"2023-07-14T13:11:27.916428+0000","last_fullsized":"2023-07-14T13:11:27.916428+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:39:22.376019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.897040+0000","last_change":"2023-07-14T13:11:27.897040+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.897040+0000","last_undegraded":"2023-07-14T13:11:27.897040+0000","last_fullsized":"2023-07-14T13:11:27.897040+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.909316+0000","last_change":"2023-07-14T13:11:27.907025+0000","last_active":"2023-07-14T13:11:27.909316+0000","last_peered":"2023-07-14T13:11:27.909316+0000","last_clean":"2023-07-14T13:11:27.909316+0000","last_became_active":"2023-07-14T13:11:27.906711+0000","last_became_peered":"2023-07-14T13:11:27.906711+0000","last_unstale":"2023-07-14T13:11:27.909316+0000","last_undegraded":"2023-07-14T13:11:27.909316+0000","last_fullsized":"2023-07-14T13:11:27.909316+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:14:56.592264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.908446+0000","last_change":"2023-07-14T13:11:27.908446+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.908446+0000","last_undegraded":"2023-07-14T13:11:27.908446+0000","last_fullsized":"2023-07-14T13:11:27.908446+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.909012+0000","last_change":"2023-07-14T13:11:27.905683+0000","last_active":"2023-07-14T13:11:27.909012+0000","last_peered":"2023-07-14T13:11:27.909012+0000","last_clean":"2023-07-14T13:11:27.909012+0000","last_became_active":"2023-07-14T13:11:27.905382+0000","last_became_peered":"2023-07-14T13:11:27.905382+0000","last_unstale":"2023-07-14T13:11:27.909012+0000","last_undegraded":"2023-07-14T13:11:27.909012+0000","last_fullsized":"2023-07-14T13:11:27.909012+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:43:45.681385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896451+0000","last_change":"2023-07-14T13:11:27.896451+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896451+0000","last_undegraded":"2023-07-14T13:11:27.896451+0000","last_fullsized":"2023-07-14T13:11:27.896451+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.902777+0000","last_change":"2023-07-14T13:11:27.899284+0000","last_active":"2023-07-14T13:11:27.902777+0000","last_peered":"2023-07-14T13:11:27.902777+0000","last_clean":"2023-07-14T13:11:27.902777+0000","last_became_active":"2023-07-14T13:11:27.899000+0000","last_became_peered":"2023-07-14T13:11:27.899000+0000","last_unstale":"2023-07-14T13:11:27.902777+0000","last_undegraded":"2023-07-14T13:11:27.902777+0000","last_fullsized":"2023-07-14T13:11:27.902777+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:58:20.832900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.890579+0000","last_change":"2023-07-14T13:11:27.890579+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.890579+0000","last_undegraded":"2023-07-14T13:11:27.890579+0000","last_fullsized":"2023-07-14T13:11:27.890579+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.905742+0000","last_change":"2023-07-14T13:11:27.903246+0000","last_active":"2023-07-14T13:11:27.905742+0000","last_peered":"2023-07-14T13:11:27.905742+0000","last_clean":"2023-07-14T13:11:27.905742+0000","last_became_active":"2023-07-14T13:11:27.902770+0000","last_became_peered":"2023-07-14T13:11:27.902770+0000","last_unstale":"2023-07-14T13:11:27.905742+0000","last_undegraded":"2023-07-14T13:11:27.905742+0000","last_fullsized":"2023-07-14T13:11:27.905742+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:50:25.947325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.891456+0000","last_change":"2023-07-14T13:11:27.891456+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.891456+0000","last_undegraded":"2023-07-14T13:11:27.891456+0000","last_fullsized":"2023-07-14T13:11:27.891456+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.909255+0000","last_change":"2023-07-14T13:11:27.907026+0000","last_active":"2023-07-14T13:11:27.909255+0000","last_peered":"2023-07-14T13:11:27.909255+0000","last_clean":"2023-07-14T13:11:27.909255+0000","last_became_active":"2023-07-14T13:11:27.906738+0000","last_became_peered":"2023-07-14T13:11:27.906738+0000","last_unstale":"2023-07-14T13:11:27.909255+0000","last_undegraded":"2023-07-14T13:11:27.909255+0000","last_fullsized":"2023-07-14T13:11:27.909255+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:32:25.336512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.892862+0000","last_change":"2023-07-14T13:11:27.892862+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.892862+0000","last_undegraded":"2023-07-14T13:11:27.892862+0000","last_fullsized":"2023-07-14T13:11:27.892862+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.905879+0000","last_change":"2023-07-14T13:11:27.902133+0000","last_active":"2023-07-14T13:11:27.905879+0000","last_peered":"2023-07-14T13:11:27.905879+0000","last_clean":"2023-07-14T13:11:27.905879+0000","last_became_active":"2023-07-14T13:11:27.901863+0000","last_became_peered":"2023-07-14T13:11:27.901863+0000","last_unstale":"2023-07-14T13:11:27.905879+0000","last_undegraded":"2023-07-14T13:11:27.905879+0000","last_fullsized":"2023-07-14T13:11:27.905879+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:43:08.536956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.893258+0000","last_change":"2023-07-14T13:11:27.893258+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.893258+0000","last_undegraded":"2023-07-14T13:11:27.893258+0000","last_fullsized":"2023-07-14T13:11:27.893258+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.920078+0000","last_change":"2023-07-14T13:11:27.917285+0000","last_active":"2023-07-14T13:11:27.920078+0000","last_peered":"2023-07-14T13:11:27.920078+0000","last_clean":"2023-07-14T13:11:27.920078+0000","last_became_active":"2023-07-14T13:11:27.916997+0000","last_became_peered":"2023-07-14T13:11:27.916997+0000","last_unstale":"2023-07-14T13:11:27.920078+0000","last_undegraded":"2023-07-14T13:11:27.920078+0000","last_fullsized":"2023-07-14T13:11:27.920078+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:41:18.620557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.899765+0000","last_change":"2023-07-14T13:11:27.899765+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.899765+0000","last_undegraded":"2023-07-14T13:11:27.899765+0000","last_fullsized":"2023-07-14T13:11:27.899765+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.912804+0000","last_change":"2023-07-14T13:11:27.911728+0000","last_active":"2023-07-14T13:11:27.912804+0000","last_peered":"2023-07-14T13:11:27.912804+0000","last_clean":"2023-07-14T13:11:27.912804+0000","last_became_active":"2023-07-14T13:11:27.911418+0000","last_became_peered":"2023-07-14T13:11:27.911418+0000","last_unstale":"2023-07-14T13:11:27.912804+0000","last_undegraded":"2023-07-14T13:11:27.912804+0000","last_fullsized":"2023-07-14T13:11:27.912804+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:20:43.667484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.897064+0000","last_change":"2023-07-14T13:11:27.897064+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.897064+0000","last_undegraded":"2023-07-14T13:11:27.897064+0000","last_fullsized":"2023-07-14T13:11:27.897064+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.914420+0000","last_change":"2023-07-14T13:11:27.911575+0000","last_active":"2023-07-14T13:11:27.914420+0000","last_peered":"2023-07-14T13:11:27.914420+0000","last_clean":"2023-07-14T13:11:27.914420+0000","last_became_active":"2023-07-14T13:11:27.911267+0000","last_became_peered":"2023-07-14T13:11:27.911267+0000","last_unstale":"2023-07-14T13:11:27.914420+0000","last_undegraded":"2023-07-14T13:11:27.914420+0000","last_fullsized":"2023-07-14T13:11:27.914420+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:25:31.252394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.897503+0000","last_change":"2023-07-14T13:11:27.897503+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.897503+0000","last_undegraded":"2023-07-14T13:11:27.897503+0000","last_fullsized":"2023-07-14T13:11:27.897503+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.906425+0000","last_change":"2023-07-14T13:11:27.902540+0000","last_active":"2023-07-14T13:11:27.906425+0000","last_peered":"2023-07-14T13:11:27.906425+0000","last_clean":"2023-07-14T13:11:27.906425+0000","last_became_active":"2023-07-14T13:11:27.902204+0000","last_became_peered":"2023-07-14T13:11:27.902204+0000","last_unstale":"2023-07-14T13:11:27.906425+0000","last_undegraded":"2023-07-14T13:11:27.906425+0000","last_fullsized":"2023-07-14T13:11:27.906425+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:13:17.808147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896887+0000","last_change":"2023-07-14T13:11:27.896887+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896887+0000","last_undegraded":"2023-07-14T13:11:27.896887+0000","last_fullsized":"2023-07-14T13:11:27.896887+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.915599+0000","last_change":"2023-07-14T13:11:27.913333+0000","last_active":"2023-07-14T13:11:27.915599+0000","last_peered":"2023-07-14T13:11:27.915599+0000","last_clean":"2023-07-14T13:11:27.915599+0000","last_became_active":"2023-07-14T13:11:27.912829+0000","last_became_peered":"2023-07-14T13:11:27.912829+0000","last_unstale":"2023-07-14T13:11:27.915599+0000","last_undegraded":"2023-07-14T13:11:27.915599+0000","last_fullsized":"2023-07-14T13:11:27.915599+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:19:04.528705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.899166+0000","last_change":"2023-07-14T13:11:27.899166+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.899166+0000","last_undegraded":"2023-07-14T13:11:27.899166+0000","last_fullsized":"2023-07-14T13:11:27.899166+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.904105+0000","last_change":"2023-07-14T13:11:27.899057+0000","last_active":"2023-07-14T13:11:27.904105+0000","last_peered":"2023-07-14T13:11:27.904105+0000","last_clean":"2023-07-14T13:11:27.904105+0000","last_became_active":"2023-07-14T13:11:27.898776+0000","last_became_peered":"2023-07-14T13:11:27.898776+0000","last_unstale":"2023-07-14T13:11:27.904105+0000","last_undegraded":"2023-07-14T13:11:27.904105+0000","last_fullsized":"2023-07-14T13:11:27.904105+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:27:27.592118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896877+0000","last_change":"2023-07-14T13:11:27.896877+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896877+0000","last_undegraded":"2023-07-14T13:11:27.896877+0000","last_fullsized":"2023-07-14T13:11:27.896877+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.912020+0000","last_change":"2023-07-14T13:11:27.908040+0000","last_active":"2023-07-14T13:11:27.912020+0000","last_peered":"2023-07-14T13:11:27.912020+0000","last_clean":"2023-07-14T13:11:27.912020+0000","last_became_active":"2023-07-14T13:11:27.907724+0000","last_became_peered":"2023-07-14T13:11:27.907724+0000","last_unstale":"2023-07-14T13:11:27.912020+0000","last_undegraded":"2023-07-14T13:11:27.912020+0000","last_fullsized":"2023-07-14T13:11:27.912020+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:39:03.219860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"115'227","reported_seq":748,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.898154+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:11:27.898154+0000","last_peered":"2023-07-14T13:11:27.898154+0000","last_clean":"2023-07-14T13:11:27.898154+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:11:27.898154+0000","last_undegraded":"2023-07-14T13:11:27.898154+0000","last_fullsized":"2023-07-14T13:11:27.898154+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:16:06.966073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":200,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.902725+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:11:27.902725+0000","last_peered":"2023-07-14T13:11:27.902725+0000","last_clean":"2023-07-14T13:11:27.902725+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:11:27.902725+0000","last_undegraded":"2023-07-14T13:11:27.902725+0000","last_fullsized":"2023-07-14T13:11:27.902725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:34:45.578849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.904732+0000","last_change":"2023-07-14T13:11:27.904732+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.904732+0000","last_undegraded":"2023-07-14T13:11:27.904732+0000","last_fullsized":"2023-07-14T13:11:27.904732+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.909643+0000","last_change":"2023-07-14T13:11:27.908313+0000","last_active":"2023-07-14T13:11:27.909643+0000","last_peered":"2023-07-14T13:11:27.909643+0000","last_clean":"2023-07-14T13:11:27.909643+0000","last_became_active":"2023-07-14T13:11:27.907979+0000","last_became_peered":"2023-07-14T13:11:27.907979+0000","last_unstale":"2023-07-14T13:11:27.909643+0000","last_undegraded":"2023-07-14T13:11:27.909643+0000","last_fullsized":"2023-07-14T13:11:27.909643+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:32:04.663850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":202,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.898025+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:11:27.898025+0000","last_peered":"2023-07-14T13:11:27.898025+0000","last_clean":"2023-07-14T13:11:27.898025+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:11:27.898025+0000","last_undegraded":"2023-07-14T13:11:27.898025+0000","last_fullsized":"2023-07-14T13:11:27.898025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:03:58.434300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.894928+0000","last_change":"2023-07-14T13:11:27.894928+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.894928+0000","last_undegraded":"2023-07-14T13:11:27.894928+0000","last_fullsized":"2023-07-14T13:11:27.894928+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.915342+0000","last_change":"2023-07-14T13:11:27.914507+0000","last_active":"2023-07-14T13:11:27.915342+0000","last_peered":"2023-07-14T13:11:27.915342+0000","last_clean":"2023-07-14T13:11:27.915342+0000","last_became_active":"2023-07-14T13:11:27.914211+0000","last_became_peered":"2023-07-14T13:11:27.914211+0000","last_unstale":"2023-07-14T13:11:27.915342+0000","last_undegraded":"2023-07-14T13:11:27.915342+0000","last_fullsized":"2023-07-14T13:11:27.915342+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:24:53.822108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":200,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.893049+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:11:27.893049+0000","last_peered":"2023-07-14T13:11:27.893049+0000","last_clean":"2023-07-14T13:11:27.893049+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:11:27.893049+0000","last_undegraded":"2023-07-14T13:11:27.893049+0000","last_fullsized":"2023-07-14T13:11:27.893049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:55:05.131842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.892546+0000","last_change":"2023-07-14T13:11:27.892546+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.892546+0000","last_undegraded":"2023-07-14T13:11:27.892546+0000","last_fullsized":"2023-07-14T13:11:27.892546+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.916712+0000","last_change":"2023-07-14T13:11:27.914767+0000","last_active":"2023-07-14T13:11:27.916712+0000","last_peered":"2023-07-14T13:11:27.916712+0000","last_clean":"2023-07-14T13:11:27.916712+0000","last_became_active":"2023-07-14T13:11:27.914404+0000","last_became_peered":"2023-07-14T13:11:27.914404+0000","last_unstale":"2023-07-14T13:11:27.916712+0000","last_undegraded":"2023-07-14T13:11:27.916712+0000","last_fullsized":"2023-07-14T13:11:27.916712+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:01:23.899054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":200,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.902678+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:11:27.902678+0000","last_peered":"2023-07-14T13:11:27.902678+0000","last_clean":"2023-07-14T13:11:27.902678+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:11:27.902678+0000","last_undegraded":"2023-07-14T13:11:27.902678+0000","last_fullsized":"2023-07-14T13:11:27.902678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:56:31.177858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.893399+0000","last_change":"2023-07-14T13:11:27.893399+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.893399+0000","last_undegraded":"2023-07-14T13:11:27.893399+0000","last_fullsized":"2023-07-14T13:11:27.893399+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.916623+0000","last_change":"2023-07-14T13:11:27.913529+0000","last_active":"2023-07-14T13:11:27.916623+0000","last_peered":"2023-07-14T13:11:27.916623+0000","last_clean":"2023-07-14T13:11:27.916623+0000","last_became_active":"2023-07-14T13:11:27.913229+0000","last_became_peered":"2023-07-14T13:11:27.913229+0000","last_unstale":"2023-07-14T13:11:27.916623+0000","last_undegraded":"2023-07-14T13:11:27.916623+0000","last_fullsized":"2023-07-14T13:11:27.916623+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:30.739338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":211,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.898183+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:11:27.898183+0000","last_peered":"2023-07-14T13:11:27.898183+0000","last_clean":"2023-07-14T13:11:27.898183+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:11:27.898183+0000","last_undegraded":"2023-07-14T13:11:27.898183+0000","last_fullsized":"2023-07-14T13:11:27.898183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:05:13.588773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.893394+0000","last_change":"2023-07-14T13:11:27.893394+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.893394+0000","last_undegraded":"2023-07-14T13:11:27.893394+0000","last_fullsized":"2023-07-14T13:11:27.893394+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.905477+0000","last_change":"2023-07-14T13:11:27.904242+0000","last_active":"2023-07-14T13:11:27.905477+0000","last_peered":"2023-07-14T13:11:27.905477+0000","last_clean":"2023-07-14T13:11:27.905477+0000","last_became_active":"2023-07-14T13:11:27.903918+0000","last_became_peered":"2023-07-14T13:11:27.903918+0000","last_unstale":"2023-07-14T13:11:27.905477+0000","last_undegraded":"2023-07-14T13:11:27.905477+0000","last_fullsized":"2023-07-14T13:11:27.905477+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:29:52.431360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":201,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.900033+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:11:27.900033+0000","last_peered":"2023-07-14T13:11:27.900033+0000","last_clean":"2023-07-14T13:11:27.900033+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:11:27.900033+0000","last_undegraded":"2023-07-14T13:11:27.900033+0000","last_fullsized":"2023-07-14T13:11:27.900033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:38:49.370231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.891144+0000","last_change":"2023-07-14T13:11:27.891144+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.891144+0000","last_undegraded":"2023-07-14T13:11:27.891144+0000","last_fullsized":"2023-07-14T13:11:27.891144+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.907212+0000","last_change":"2023-07-14T13:11:27.905304+0000","last_active":"2023-07-14T13:11:27.907212+0000","last_peered":"2023-07-14T13:11:27.907212+0000","last_clean":"2023-07-14T13:11:27.907212+0000","last_became_active":"2023-07-14T13:11:27.904926+0000","last_became_peered":"2023-07-14T13:11:27.904926+0000","last_unstale":"2023-07-14T13:11:27.907212+0000","last_undegraded":"2023-07-14T13:11:27.907212+0000","last_fullsized":"2023-07-14T13:11:27.907212+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:56:10.021540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":211,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.894238+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:11:27.894238+0000","last_peered":"2023-07-14T13:11:27.894238+0000","last_clean":"2023-07-14T13:11:27.894238+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:11:27.894238+0000","last_undegraded":"2023-07-14T13:11:27.894238+0000","last_fullsized":"2023-07-14T13:11:27.894238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:59:45.531447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.891660+0000","last_change":"2023-07-14T13:11:27.891660+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.891660+0000","last_undegraded":"2023-07-14T13:11:27.891660+0000","last_fullsized":"2023-07-14T13:11:27.891660+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.912271+0000","last_change":"2023-07-14T13:11:27.909085+0000","last_active":"2023-07-14T13:11:27.912271+0000","last_peered":"2023-07-14T13:11:27.912271+0000","last_clean":"2023-07-14T13:11:27.912271+0000","last_became_active":"2023-07-14T13:11:27.908811+0000","last_became_peered":"2023-07-14T13:11:27.908811+0000","last_unstale":"2023-07-14T13:11:27.912271+0000","last_undegraded":"2023-07-14T13:11:27.912271+0000","last_fullsized":"2023-07-14T13:11:27.912271+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:53:08.517311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":203,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.909391+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:11:27.909391+0000","last_peered":"2023-07-14T13:11:27.909391+0000","last_clean":"2023-07-14T13:11:27.909391+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:11:27.909391+0000","last_undegraded":"2023-07-14T13:11:27.909391+0000","last_fullsized":"2023-07-14T13:11:27.909391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:38:12.792564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575073,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59376,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312464,"statfs":{"total":96636764160,"available":96575963136,"internally_reserved":0,"allocated":2138112,"data_stored":1371934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.70799999999999996,"15min":0.70999999999999996},"min":{"1min":0.53300000000000003,"5min":0.372,"15min":0.33900000000000002},"max":{"1min":0.95899999999999996,"5min":1.262,"15min":1.262},"last":0.5},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71999999999999997,"15min":0.72899999999999998},"min":{"1min":0.51500000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.55100000000000005}]},{"osd":1,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72399999999999998,"15min":0.73599999999999999},"min":{"1min":0.48199999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.872,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.72899999999999998,"15min":0.74399999999999999},"min":{"1min":0.59799999999999998,"5min":0.436,"15min":0.40500000000000003},"max":{"1min":0.97599999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.58299999999999996,"5min":0.46100000000000002,"15min":0.42699999999999999},"max":{"1min":0.96099999999999997,"5min":1.073,"15min":1.073},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.73899999999999999,"15min":0.753},"min":{"1min":0.57999999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89600000000000002,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.70499999999999996}]},{"osd":3,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.58899999999999997,"5min":0.503,"15min":0.46400000000000002},"max":{"1min":0.90900000000000003,"5min":1.161,"15min":1.161},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.73999999999999999,"15min":0.75600000000000001},"min":{"1min":0.60299999999999998,"5min":0.47899999999999998,"15min":0.41499999999999998},"max":{"1min":0.91800000000000004,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.755}]},{"osd":4,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55800000000000005,"15min":0.57799999999999996},"min":{"1min":0.44500000000000001,"5min":0.39100000000000001,"15min":0.318},"max":{"1min":0.874,"5min":0.874,"15min":1.022},"last":0.628},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.47399999999999998,"5min":0.40600000000000003,"15min":0.39300000000000002},"max":{"1min":0.76500000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.77400000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.52100000000000002,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.82199999999999995,"5min":0.98099999999999998,"15min":0.98299999999999998},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.64700000000000002},"min":{"1min":0.44,"5min":0.377,"15min":0.34100000000000003},"max":{"1min":0.80700000000000005,"5min":1.028,"15min":1.028},"last":0.80500000000000005}]},{"osd":6,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67600000000000005,"15min":0.69099999999999995},"min":{"1min":0.48499999999999999,"5min":0.45200000000000001,"15min":0.42699999999999999},"max":{"1min":0.85799999999999998,"5min":0.99299999999999999,"15min":1.0489999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.68000000000000005,"15min":0.67500000000000004},"min":{"1min":0.47499999999999998,"5min":0.46200000000000002,"15min":0.36299999999999999},"max":{"1min":4.1130000000000004,"5min":4.1130000000000004,"15min":4.1130000000000004},"last":0.85799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575074,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":1508,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":1544192,"data_stored":781566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71599999999999997,"15min":0.73099999999999998},"min":{"1min":0.50800000000000001,"5min":0.39500000000000002,"15min":0.38},"max":{"1min":0.90100000000000002,"5min":0.95899999999999996,"15min":0.996},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.70199999999999996,"15min":0.72699999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89500000000000002,"5min":0.98199999999999998,"15min":1.0800000000000001},"last":0.55700000000000005}]},{"osd":1,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70899999999999996,"15min":0.73699999999999999},"min":{"1min":0.497,"5min":0.42299999999999999,"15min":0.379},"max":{"1min":0.84399999999999997,"5min":0.97199999999999998,"15min":1.0209999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.70199999999999996,"15min":0.72099999999999997},"min":{"1min":0.60599999999999998,"5min":0.47499999999999998,"15min":0.46999999999999997},"max":{"1min":0.88100000000000001,"5min":0.91400000000000003,"15min":1.077},"last":0.64400000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72699999999999998,"15min":0.749},"min":{"1min":0.56100000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.874,"5min":0.95099999999999996,"15min":1.105},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.48499999999999999,"5min":0.441,"15min":0.441},"max":{"1min":0.97999999999999998,"5min":0.99099999999999999,"15min":1.0900000000000001},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.75,"15min":0.77200000000000002},"min":{"1min":0.61499999999999999,"5min":0.46000000000000002,"15min":0.434},"max":{"1min":0.92200000000000004,"5min":1.054,"15min":1.1359999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.71899999999999997,"15min":0.754},"min":{"1min":0.56999999999999995,"5min":0.50900000000000001,"15min":0.48399999999999999},"max":{"1min":0.871,"5min":0.94799999999999995,"15min":1.1080000000000001},"last":0.624}]},{"osd":4,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57399999999999995,"15min":0.57499999999999996},"min":{"1min":0.45900000000000002,"5min":0.39900000000000002,"15min":0.317},"max":{"1min":0.76300000000000001,"5min":0.89900000000000002,"15min":0.97899999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.48299999999999998,"5min":0.439,"15min":0.38500000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":1.0780000000000001},"last":0.69199999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.497,"5min":0.45200000000000001,"15min":0.37},"max":{"1min":0.78100000000000003,"5min":0.96599999999999997,"15min":1.579},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.50800000000000001,"5min":0.46300000000000002,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.81999999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67400000000000004,"15min":0.65900000000000003},"min":{"1min":0.47899999999999998,"5min":0.437,"15min":0.34599999999999997},"max":{"1min":0.93899999999999995,"5min":1.0940000000000001,"15min":1.1200000000000001},"last":0.75},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71299999999999997,"15min":0.71199999999999997},"min":{"1min":0.59699999999999998,"5min":0.48899999999999999,"15min":0.36199999999999999},"max":{"1min":0.92000000000000004,"5min":1.0209999999999999,"15min":1.657},"last":0.68500000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575073,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46508,"kb_used_data":1508,"kb_used_omap":0,"kb_used_meta":44992,"kb_avail":94325332,"statfs":{"total":96636764160,"available":96589139968,"internally_reserved":0,"allocated":1544192,"data_stored":781566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46071808},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.69399999999999995,"15min":0.72499999999999998},"min":{"1min":0.44400000000000001,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":0.88800000000000001,"5min":0.91500000000000004,"15min":2.6699999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.71299999999999997,"15min":0.72799999999999998},"min":{"1min":0.56799999999999995,"5min":0.41699999999999998,"15min":0.32800000000000001},"max":{"1min":0.98299999999999998,"5min":1.083,"15min":1.083},"last":0.83999999999999997}]},{"osd":1,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.69399999999999995,"15min":0.72099999999999997},"min":{"1min":0.49399999999999999,"5min":0.45900000000000002,"15min":0.41099999999999998},"max":{"1min":0.95799999999999996,"5min":1.05,"15min":1.079},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72099999999999997,"15min":0.74299999999999999},"min":{"1min":0.55000000000000004,"5min":0.48999999999999999,"15min":0.36799999999999999},"max":{"1min":0.92500000000000004,"5min":0.95899999999999996,"15min":2.706},"last":0.76000000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.71499999999999997,"15min":0.73299999999999998},"min":{"1min":0.58699999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.93999999999999995,"5min":1.212,"15min":1.212},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.70999999999999996,"15min":0.73099999999999998},"min":{"1min":0.60999999999999999,"5min":0.44800000000000001,"15min":0.433},"max":{"1min":0.90900000000000003,"5min":1.181,"15min":1.181},"last":0.68100000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.72499999999999998,"15min":0.74399999999999999},"min":{"1min":0.64300000000000002,"5min":0.41799999999999998,"15min":0.377},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":2.7389999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.72799999999999998,"15min":0.75800000000000001},"min":{"1min":0.61799999999999999,"5min":0.47299999999999998,"15min":0.39700000000000002},"max":{"1min":0.89500000000000002,"5min":1.304,"15min":1.304},"last":0.78000000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63800000000000001,"15min":0.627},"min":{"1min":0.49399999999999999,"5min":0.38,"15min":0.28599999999999998},"max":{"1min":0.871,"5min":1.129,"15min":1.129},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66600000000000004,"15min":0.68000000000000005},"min":{"1min":0.499,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85899999999999999,"5min":0.86799999999999999,"15min":2.7719999999999998},"last":0.71899999999999997}]},{"osd":6,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59399999999999997,"15min":0.60599999999999998},"min":{"1min":0.46500000000000002,"5min":0.34599999999999997,"15min":0.32700000000000001},"max":{"1min":0.68300000000000005,"5min":1.169,"15min":1.169},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.47999999999999998,"5min":0.39400000000000002,"15min":0.34300000000000003},"max":{"1min":0.83999999999999997,"5min":1.238,"15min":1.238},"last":0.61899999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.45400000000000001,"5min":0.36899999999999999,"15min":0.32900000000000001},"max":{"1min":0.92200000000000004,"5min":1.026,"15min":3.0230000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67200000000000004,"15min":0.67500000000000004},"min":{"1min":0.46500000000000002,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.85099999999999998,"5min":1.2589999999999999,"15min":1.407},"last":0.65200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575073,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":1508,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":1544192,"data_stored":781566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.70199999999999996,"15min":0.72799999999999998},"min":{"1min":0.53800000000000003,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":1.411},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72799999999999998,"15min":0.73099999999999998},"min":{"1min":0.46999999999999997,"5min":0.45100000000000001,"15min":0.435},"max":{"1min":0.88,"5min":1.0089999999999999,"15min":1.1200000000000001},"last":0.91500000000000004}]},{"osd":1,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72799999999999998,"15min":0.746},"min":{"1min":0.53100000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89300000000000002,"5min":0.94699999999999995,"15min":1.077},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71499999999999997,"15min":0.73299999999999998},"min":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89800000000000002,"5min":0.96399999999999997,"15min":1.0469999999999999},"last":0.94999999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71499999999999997,"15min":0.73099999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.35199999999999998},"max":{"1min":0.872,"5min":0.96499999999999997,"15min":1.091},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.77000000000000002},"min":{"1min":0.63200000000000001,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.86299999999999999,"5min":1.04,"15min":1.387},"last":0.83199999999999996}]},{"osd":3,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72699999999999998,"15min":0.74399999999999999},"min":{"1min":0.53200000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89400000000000002,"5min":0.997,"15min":1.008},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.748,"15min":0.76800000000000002},"min":{"1min":0.51400000000000001,"5min":0.47499999999999998,"15min":0.46800000000000003},"max":{"1min":1.002,"5min":1.002,"15min":1.0589999999999999},"last":0.93100000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.378},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":1.0029999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.64500000000000002,"15min":0.622},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.34599999999999997},"max":{"1min":0.79600000000000004,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.60099999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.34899999999999998,"15min":0.32300000000000001},"max":{"1min":0.876,"5min":0.96999999999999997,"15min":1.014},"last":0.626},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.374},"max":{"1min":0.85199999999999998,"5min":0.98299999999999998,"15min":1.0289999999999999},"last":0.73999999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70799999999999996,"15min":0.67300000000000004},"min":{"1min":0.55300000000000005,"5min":0.502,"15min":0.39000000000000001},"max":{"1min":0.84899999999999998,"5min":1.0049999999999999,"15min":1.0349999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.50700000000000001,"5min":0.42799999999999999,"15min":0.36899999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0629999999999999},"last":0.71299999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575073,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36640,"kb_used_data":1496,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335200,"statfs":{"total":96636764160,"available":96599244800,"internally_reserved":0,"allocated":1531904,"data_stored":774938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45300000000000001,"15min":0.44900000000000001},"min":{"1min":0.34799999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.59999999999999998,"5min":0.78600000000000003,"15min":0.84199999999999997},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.51100000000000001,"15min":0.51400000000000001},"min":{"1min":0.33200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.40699999999999997}]},{"osd":1,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.378,"5min":0.32000000000000001,"15min":0.315},"max":{"1min":0.67800000000000005,"5min":0.873,"15min":0.873},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.53700000000000003,"15min":0.54100000000000004},"min":{"1min":0.41699999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.753,"5min":0.753,"15min":1.0029999999999999},"last":0.36099999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56100000000000005,"15min":0.57199999999999995},"min":{"1min":0.44400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.90400000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.47599999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88100000000000001,"5min":1.02,"15min":1.663},"last":0.42899999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.75900000000000001,"15min":0.75700000000000001},"min":{"1min":0.56200000000000006,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":0.96899999999999997,"5min":1.151,"15min":1.284},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.78100000000000003,"15min":0.78200000000000003},"min":{"1min":0.60499999999999998,"5min":0.51900000000000002,"15min":0.47699999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.79300000000000004,"15min":0.79200000000000004},"min":{"1min":0.60399999999999998,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.306},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.60899999999999999,"5min":0.55000000000000004,"15min":0.372},"max":{"1min":1.018,"5min":1.1870000000000001,"15min":1.2470000000000001},"last":0.52000000000000002}]},{"osd":6,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77300000000000002,"15min":0.77200000000000002},"min":{"1min":0.52400000000000002,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.117},"last":0.629},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.80600000000000005,"15min":0.81399999999999995},"min":{"1min":0.63700000000000001,"5min":0.56299999999999994,"15min":0.54200000000000004},"max":{"1min":1.1000000000000001,"5min":1.129,"15min":1.2589999999999999},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81100000000000005,"15min":0.83199999999999996},"min":{"1min":0.66100000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.095,"5min":1.1519999999999999,"15min":2.4910000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.81200000000000006,"15min":0.82299999999999995},"min":{"1min":0.65100000000000002,"5min":0.53500000000000003,"15min":0.51600000000000001},"max":{"1min":1.1359999999999999,"5min":1.1379999999999999,"15min":1.595},"last":0.65000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575073,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58792,"kb_used_data":1504,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313048,"statfs":{"total":96636764160,"available":96576561152,"internally_reserved":0,"allocated":1540096,"data_stored":780547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.35499999999999998,"5min":0.29199999999999998,"15min":0.24199999999999999},"max":{"1min":0.75700000000000001,"5min":0.84699999999999998,"15min":1.3169999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51400000000000001,"15min":0.53500000000000003},"min":{"1min":0.372,"5min":0.318,"15min":0.318},"max":{"1min":0.69899999999999995,"5min":0.80800000000000005,"15min":2.5270000000000001},"last":0.51100000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46700000000000003,"15min":0.47299999999999998},"min":{"1min":0.34200000000000003,"5min":0.30399999999999999,"15min":0.29999999999999999},"max":{"1min":0.72599999999999998,"5min":0.77200000000000002,"15min":2.7200000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.52800000000000002,"15min":0.56200000000000006},"min":{"1min":0.46400000000000002,"5min":0.36299999999999999,"15min":0.35999999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":2.6110000000000002},"last":0.45800000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55700000000000005,"15min":0.60399999999999998},"min":{"1min":0.5,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70699999999999996,"5min":0.81899999999999995,"15min":8.2530000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53800000000000003,"15min":0.55200000000000005},"min":{"1min":0.44400000000000001,"5min":0.36899999999999999,"15min":0.33300000000000002},"max":{"1min":0.65700000000000003,"5min":0.89600000000000002,"15min":1.2150000000000001},"last":0.52900000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.753,"15min":0.77800000000000002},"min":{"1min":0.57299999999999995,"5min":0.53200000000000003,"15min":0.48399999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.1499999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.747,"15min":0.79100000000000004},"min":{"1min":0.60399999999999998,"5min":0.52900000000000003,"15min":0.47999999999999998},"max":{"1min":1.03,"5min":1.0629999999999999,"15min":2.3170000000000002},"last":0.72299999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.81000000000000005,"15min":0.85499999999999998},"min":{"1min":0.65500000000000003,"5min":0.56399999999999995,"15min":0.49399999999999999},"max":{"1min":1.087,"5min":1.1319999999999999,"15min":3.1139999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.79800000000000004,"15min":0.84099999999999997},"min":{"1min":0.61799999999999999,"5min":0.56200000000000006,"15min":0.433},"max":{"1min":1.0940000000000001,"5min":1.153,"15min":2.6850000000000001},"last":0.93100000000000005}]},{"osd":6,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.751,"15min":0.79900000000000004},"min":{"1min":0.65200000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.038,"5min":1.038,"15min":3.9849999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.76900000000000002,"15min":0.81100000000000005},"min":{"1min":0.627,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1100000000000001,"5min":1.1419999999999999,"15min":3.391},"last":0.97099999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.77100000000000002,"15min":0.81799999999999995},"min":{"1min":0.56000000000000005,"5min":0.52300000000000002,"15min":0.5},"max":{"1min":1.0549999999999999,"5min":1.1759999999999999,"15min":2.5779999999999998},"last":1.022},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.78900000000000003,"15min":0.82199999999999995},"min":{"1min":0.57499999999999996,"5min":0.52800000000000002,"15min":0.50900000000000001},"max":{"1min":1.0529999999999999,"5min":1.0940000000000001,"15min":2.5939999999999999},"last":0.83199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575074,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36652,"kb_used_data":1508,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335188,"statfs":{"total":96636764160,"available":96599232512,"internally_reserved":0,"allocated":1544192,"data_stored":781566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.435,"15min":0.433},"min":{"1min":0.29199999999999998,"5min":0.28399999999999997,"15min":0.26100000000000001},"max":{"1min":0.63900000000000001,"5min":0.65400000000000003,"15min":0.77200000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.88900000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.48099999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46300000000000002,"15min":0.47199999999999998},"min":{"1min":0.371,"5min":0.317,"15min":0.317},"max":{"1min":0.67300000000000004,"5min":0.69199999999999995,"15min":1.0409999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.39400000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":1.014},"last":0.61899999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60899999999999999,"15min":0.63200000000000001},"min":{"1min":0.45000000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.76300000000000001,"5min":0.80300000000000005,"15min":0.96299999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.57399999999999995},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79200000000000004,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.54100000000000004}]},{"osd":4,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76900000000000002,"15min":0.78700000000000003},"min":{"1min":0.56799999999999995,"5min":0.51200000000000001,"15min":0.48899999999999999},"max":{"1min":0.98199999999999998,"5min":1.2110000000000001,"15min":1.236},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.63,"5min":0.54700000000000004,"15min":0.502},"max":{"1min":1,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.873}]},{"osd":5,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.45200000000000001},"max":{"1min":1.097,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.63700000000000001,"5min":0.51500000000000001,"15min":0.48599999999999999},"max":{"1min":0.99099999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.78200000000000003}]},{"osd":6,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.56599999999999995,"5min":0.53800000000000003,"15min":0.503},"max":{"1min":1.071,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.81399999999999995,"15min":0.81699999999999995},"min":{"1min":0.56399999999999995,"5min":0.497,"15min":0.497},"max":{"1min":1.0880000000000001,"5min":1.262,"15min":1.262},"last":0.81200000000000006}]},{"osd":7,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.80000000000000004,"15min":0.80200000000000005},"min":{"1min":0.61599999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.048,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.878,"5min":0.83299999999999996,"15min":0.84499999999999997},"min":{"1min":0.68899999999999995,"5min":0.58499999999999996,"15min":0.52800000000000002},"max":{"1min":1.1160000000000001,"5min":1.327,"15min":1.327},"last":0.74099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575075,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37228,"kb_used_data":2084,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334612,"statfs":{"total":96636764160,"available":96598642688,"internally_reserved":0,"allocated":2134016,"data_stored":1370915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.33300000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":2.2450000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.48799999999999999,"15min":0.51100000000000001},"min":{"1min":0.35699999999999998,"5min":0.30099999999999999,"15min":0.27700000000000002},"max":{"1min":0.74199999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.36699999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.495,"15min":0.51200000000000001},"min":{"1min":0.35999999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.60799999999999998,"5min":0.84499999999999997,"15min":2.2989999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53200000000000003,"15min":0.55000000000000004},"min":{"1min":0.40400000000000003,"5min":0.34899999999999998,"15min":0.29899999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.90300000000000002},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.498,"15min":0.505},"min":{"1min":0.44400000000000001,"5min":0.32700000000000001,"15min":0.30299999999999999},"max":{"1min":0.58299999999999996,"5min":0.72999999999999998,"15min":0.84999999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56799999999999995,"15min":0.58799999999999997},"min":{"1min":0.47199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.71799999999999997,"5min":0.92700000000000005,"15min":2.4100000000000001},"last":0.54500000000000004}]},{"osd":4,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.745,"15min":0.78100000000000003},"min":{"1min":0.54500000000000004,"5min":0.48399999999999999,"15min":0.44400000000000001},"max":{"1min":1.0309999999999999,"5min":1.21,"15min":1.3640000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.75600000000000001,"15min":0.79500000000000004},"min":{"1min":0.60199999999999998,"5min":0.52300000000000002,"15min":0.44900000000000001},"max":{"1min":0.90000000000000002,"5min":1.0589999999999999,"15min":2.4460000000000002},"last":0.68300000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.751,"15min":0.79600000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.47899999999999998},"max":{"1min":0.95899999999999996,"5min":1.0669999999999999,"15min":1.3839999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.75900000000000001,"15min":0.79200000000000004},"min":{"1min":0.55800000000000005,"5min":0.5,"15min":0.47299999999999998},"max":{"1min":1.05,"5min":1.069,"15min":1.325},"last":0.69799999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76700000000000002,"15min":0.79800000000000004},"min":{"1min":0.63500000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.97499999999999998,"5min":1.05,"15min":2.3380000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.75800000000000001,"15min":0.80300000000000005},"min":{"1min":0.58599999999999997,"5min":0.51000000000000001,"15min":0.41299999999999998},"max":{"1min":1.012,"5min":1.0900000000000001,"15min":1.3440000000000001},"last":0.65700000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.77700000000000002,"15min":0.82199999999999995},"min":{"1min":0.58499999999999996,"5min":0.52800000000000002,"15min":0.45500000000000002},"max":{"1min":0.95299999999999996,"5min":1.1180000000000001,"15min":1.2749999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.75700000000000001,"15min":0.80400000000000005},"min":{"1min":0.60599999999999998,"5min":0.502,"15min":0.497},"max":{"1min":1.0640000000000001,"5min":1.0880000000000001,"15min":1.381},"last":0.73999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:11:33.121 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:11:33.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.231+0000 7facd8396640 1 Processor -- start 2023-07-14T13:11:33.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.231+0000 7facd8396640 1 -- start start 2023-07-14T13:11:33.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.235+0000 7facd8396640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7facd00c8ad0 0x7facd00c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.235+0000 7facd8396640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7facd00c9560 0x7facd00ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.235+0000 7facd8396640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd00c99c0 con 0x7facd0158ce0 2023-07-14T13:11:33.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.235+0000 7facd8396640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd00cc700 con 0x7facd00c9560 2023-07-14T13:11:33.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.235+0000 7facd8396640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd00b0ff0 con 0x7facd00c8ad0 2023-07-14T13:11:33.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.235+0000 7facd6933640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7facd00c9560 0x7facd00ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.235+0000 7facd6132640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7facd0158ce0 0x7facd0070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46076/0 (socket says 172.21.15.5:46076) 2023-07-14T13:11:33.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.235+0000 7facd6132640 1 -- 172.21.15.5:0/411372089 learned_addr learned my addr 172.21.15.5:0/411372089 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:33.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.235+0000 7facd5931640 1 --2- 172.21.15.5:0/411372089 >> v2:172.21.15.154:3300/0 conn(0x7facd00c8ad0 0x7facd00c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.235+0000 7facd6933640 1 -- 172.21.15.5:0/411372089 >> v2:172.21.15.154:3300/0 conn(0x7facd00c8ad0 msgr2=0x7facd00c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:33.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.235+0000 7facd6933640 1 --2- 172.21.15.5:0/411372089 >> v2:172.21.15.154:3300/0 conn(0x7facd00c8ad0 0x7facd00c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.235+0000 7facd6933640 1 -- 172.21.15.5:0/411372089 >> v1:172.21.15.5:6789/0 conn(0x7facd0158ce0 legacy=0x7facd0070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:33.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.235+0000 7facd5130640 1 -- 172.21.15.5:0/411372089 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895803534 0 0) 0x7facd00c99c0 con 0x7facd0158ce0 2023-07-14T13:11:33.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.235+0000 7facd6933640 1 -- 172.21.15.5:0/411372089 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd0070c80 con 0x7facd00c9560 2023-07-14T13:11:33.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.235+0000 7facd6933640 1 --2- 172.21.15.5:0/411372089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd00c9560 0x7facd00ccb90 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7facd00c1a30 tx=0x7facc801c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125474ad841ed71b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:33.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.239+0000 7facd5130640 1 -- 172.21.15.5:0/411372089 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc80a5790 con 0x7facd00c9560 2023-07-14T13:11:33.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.239+0000 7facd5130640 1 -- 172.21.15.5:0/411372089 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc80a58f0 con 0x7facd00c9560 2023-07-14T13:11:33.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.239+0000 7facd5130640 1 -- 172.21.15.5:0/411372089 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc80a5c80 con 0x7facd00c9560 2023-07-14T13:11:33.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.239+0000 7facd8396640 1 -- 172.21.15.5:0/411372089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd00c9560 msgr2=0x7facd00ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:33.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.239+0000 7facd8396640 1 --2- 172.21.15.5:0/411372089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd00c9560 0x7facd00ccb90 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7facd00c1a30 tx=0x7facc801c7c0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.239+0000 7facd8396640 1 -- 172.21.15.5:0/411372089 shutdown_connections 2023-07-14T13:11:33.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.239+0000 7facd8396640 1 --2- 172.21.15.5:0/411372089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd00c9560 0x7facd00ccb90 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.239+0000 7facd8396640 1 --2- 172.21.15.5:0/411372089 >> v2:172.21.15.154:3300/0 conn(0x7facd00c8ad0 0x7facd00c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.239+0000 7facd8396640 1 -- 172.21.15.5:0/411372089 >> 172.21.15.5:0/411372089 conn(0x7facd00afcf0 msgr2=0x7facd00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:33.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.239+0000 7facd8396640 1 -- 172.21.15.5:0/411372089 shutdown_connections 2023-07-14T13:11:33.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.239+0000 7facd8396640 1 -- 172.21.15.5:0/411372089 wait complete. 2023-07-14T13:11:33.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.239+0000 7facd8396640 1 Processor -- start 2023-07-14T13:11:33.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.239+0000 7facd8396640 1 -- start start 2023-07-14T13:11:33.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.239+0000 7facd8396640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd00c8ad0 0x7facd00ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.239+0000 7facd8396640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facd00c9560 0x7facd01f8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.239+0000 7facd8396640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facd0158ce0 0x7facd00c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.239+0000 7facd8396640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd015aad0 con 0x7facd00c8ad0 2023-07-14T13:11:33.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.239+0000 7facd8396640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd01f8860 con 0x7facd00c9560 2023-07-14T13:11:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.239+0000 7facd8396640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd00ae5e0 con 0x7facd0158ce0 2023-07-14T13:11:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.239+0000 7facd6132640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd00c8ad0 0x7facd00ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.239+0000 7facd6132640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd00c8ad0 0x7facd00ad6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57422/0 (socket says 172.21.15.5:57422) 2023-07-14T13:11:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.239+0000 7facd6132640 1 -- 172.21.15.5:0/2828787775 learned_addr learned my addr 172.21.15.5:0/2828787775 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.243+0000 7facd5931640 1 --2- 172.21.15.5:0/2828787775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facd00c9560 0x7facd01f8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.243+0000 7facd6933640 1 --2- 172.21.15.5:0/2828787775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facd0158ce0 0x7facd00c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.243+0000 7facd6132640 1 -- 172.21.15.5:0/2828787775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facd0158ce0 msgr2=0x7facd00c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:33.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.243+0000 7facd6132640 1 --2- 172.21.15.5:0/2828787775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facd0158ce0 0x7facd00c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.243+0000 7facd6132640 1 -- 172.21.15.5:0/2828787775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facd00c9560 msgr2=0x7facd01f8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:33.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.243+0000 7facd6132640 1 --2- 172.21.15.5:0/2828787775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facd00c9560 0x7facd01f8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.243+0000 7facd6132640 1 -- 172.21.15.5:0/2828787775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc8009a70 con 0x7facd00c8ad0 2023-07-14T13:11:33.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.243+0000 7facd6933640 1 --2- 172.21.15.5:0/2828787775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facd0158ce0 0x7facd00c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:11:33.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.243+0000 7facd6132640 1 --2- 172.21.15.5:0/2828787775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd00c8ad0 0x7facd00ad6a0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7faccc00c480 tx=0x7faccc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:33.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.243+0000 7facc6ffd640 1 -- 172.21.15.5:0/2828787775 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc0074e0 con 0x7facd00c8ad0 2023-07-14T13:11:33.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.243+0000 7facc6ffd640 1 -- 172.21.15.5:0/2828787775 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc007660 con 0x7facd00c8ad0 2023-07-14T13:11:33.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.243+0000 7facd8396640 1 -- 172.21.15.5:0/2828787775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd00c65d0 con 0x7facd00c8ad0 2023-07-14T13:11:33.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.243+0000 7facc6ffd640 1 -- 172.21.15.5:0/2828787775 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc004a30 con 0x7facd00c8ad0 2023-07-14T13:11:33.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.243+0000 7facd8396640 1 -- 172.21.15.5:0/2828787775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd00ae020 con 0x7facd00c8ad0 2023-07-14T13:11:33.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.243+0000 7facd8396640 1 -- 172.21.15.5:0/2828787775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd00ca1a0 con 0x7facd00c8ad0 2023-07-14T13:11:33.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.243+0000 7facc6ffd640 1 -- 172.21.15.5:0/2828787775 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7faccc004b90 con 0x7facd00c8ad0 2023-07-14T13:11:33.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.243+0000 7facc6ffd640 1 --2- 172.21.15.5:0/2828787775 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7facb40663a0 0x7facb4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.243+0000 7facc6ffd640 1 -- 172.21.15.5:0/2828787775 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faccc082f70 con 0x7facd00c8ad0 2023-07-14T13:11:33.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.247+0000 7facd5931640 1 --2- 172.21.15.5:0/2828787775 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7facb40663a0 0x7facb4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.247+0000 7facd5931640 1 --2- 172.21.15.5:0/2828787775 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7facb40663a0 0x7facb4068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7facd00c7f60 tx=0x7facc0009190 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:33.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.247+0000 7facc6ffd640 1 -- 172.21.15.5:0/2828787775 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7faccc0b3720 con 0x7facd00c8ad0 2023-07-14T13:11:33.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.399+0000 7facd8396640 1 -- 172.21.15.5:0/2828787775 --> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7facd00cc390 con 0x7facb40663a0 2023-07-14T13:11:33.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.407+0000 7facc6ffd640 1 -- 172.21.15.5:0/2828787775 <== mgr.7657 v2:172.21.15.154:6832/938367911 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306369 (secure 0 0 0) 0x7facc0011a30 con 0x7facb40663a0 2023-07-14T13:11:33.444 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:11:33.445 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:11:33.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.411+0000 7facd8396640 1 -- 172.21.15.5:0/2828787775 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7facb40663a0 msgr2=0x7facb4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:33.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.411+0000 7facd8396640 1 --2- 172.21.15.5:0/2828787775 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7facb40663a0 0x7facb4068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7facd00c7f60 tx=0x7facc0009190 comp rx=0 tx=0).stop 2023-07-14T13:11:33.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.411+0000 7facd8396640 1 -- 172.21.15.5:0/2828787775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd00c8ad0 msgr2=0x7facd00ad6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:33.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.411+0000 7facd8396640 1 --2- 172.21.15.5:0/2828787775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd00c8ad0 0x7facd00ad6a0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7faccc00c480 tx=0x7faccc00c940 comp rx=0 tx=0).stop 2023-07-14T13:11:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.411+0000 7facd8396640 1 -- 172.21.15.5:0/2828787775 shutdown_connections 2023-07-14T13:11:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.411+0000 7facd8396640 1 --2- 172.21.15.5:0/2828787775 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7facb40663a0 0x7facb4068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.411+0000 7facd8396640 1 --2- 172.21.15.5:0/2828787775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7facd0158ce0 0x7facd00c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.411+0000 7facd8396640 1 --2- 172.21.15.5:0/2828787775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facd00c9560 0x7facd01f8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.411+0000 7facd8396640 1 --2- 172.21.15.5:0/2828787775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd00c8ad0 0x7facd00ad6a0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.411+0000 7facd8396640 1 -- 172.21.15.5:0/2828787775 >> 172.21.15.5:0/2828787775 conn(0x7facd00afcf0 msgr2=0x7facd00ca610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:33.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.411+0000 7facd8396640 1 -- 172.21.15.5:0/2828787775 shutdown_connections 2023-07-14T13:11:33.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.411+0000 7facd8396640 1 -- 172.21.15.5:0/2828787775 wait complete. 2023-07-14T13:11:33.465 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-14T13:11:32.582052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":340308,"kb_used_data":13204,"kb_used_omap":0,"kb_used_meta":327040,"kb_avail":754634412,"statfs":{"total":773094113280,"available":772745637888,"internally_reserved":0,"allocated":13520896,"data_stored":7424598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":334888960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.698344"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.895795+0000","last_change":"2023-07-14T13:11:27.895795+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.895795+0000","last_undegraded":"2023-07-14T13:11:27.895795+0000","last_fullsized":"2023-07-14T13:11:27.895795+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.907157+0000","last_change":"2023-07-14T13:11:27.907157+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.907157+0000","last_undegraded":"2023-07-14T13:11:27.907157+0000","last_fullsized":"2023-07-14T13:11:27.907157+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896573+0000","last_change":"2023-07-14T13:11:27.896573+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896573+0000","last_undegraded":"2023-07-14T13:11:27.896573+0000","last_fullsized":"2023-07-14T13:11:27.896573+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.892922+0000","last_change":"2023-07-14T13:11:27.892922+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.892922+0000","last_undegraded":"2023-07-14T13:11:27.892922+0000","last_fullsized":"2023-07-14T13:11:27.892922+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.895434+0000","last_change":"2023-07-14T13:11:27.895434+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.895434+0000","last_undegraded":"2023-07-14T13:11:27.895434+0000","last_fullsized":"2023-07-14T13:11:27.895434+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.905271+0000","last_change":"2023-07-14T13:11:27.905271+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.905271+0000","last_undegraded":"2023-07-14T13:11:27.905271+0000","last_fullsized":"2023-07-14T13:11:27.905271+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.904249+0000","last_change":"2023-07-14T13:11:27.904249+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.904249+0000","last_undegraded":"2023-07-14T13:11:27.904249+0000","last_fullsized":"2023-07-14T13:11:27.904249+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.897193+0000","last_change":"2023-07-14T13:11:27.897193+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.897193+0000","last_undegraded":"2023-07-14T13:11:27.897193+0000","last_fullsized":"2023-07-14T13:11:27.897193+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.907895+0000","last_change":"2023-07-14T13:11:27.907895+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.907895+0000","last_undegraded":"2023-07-14T13:11:27.907895+0000","last_fullsized":"2023-07-14T13:11:27.907895+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.893865+0000","last_change":"2023-07-14T13:11:27.893865+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.893865+0000","last_undegraded":"2023-07-14T13:11:27.893865+0000","last_fullsized":"2023-07-14T13:11:27.893865+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.901834+0000","last_change":"2023-07-14T13:11:27.901834+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.901834+0000","last_undegraded":"2023-07-14T13:11:27.901834+0000","last_fullsized":"2023-07-14T13:11:27.901834+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.894943+0000","last_change":"2023-07-14T13:11:27.894943+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.894943+0000","last_undegraded":"2023-07-14T13:11:27.894943+0000","last_fullsized":"2023-07-14T13:11:27.894943+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.891406+0000","last_change":"2023-07-14T13:11:27.891406+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.891406+0000","last_undegraded":"2023-07-14T13:11:27.891406+0000","last_fullsized":"2023-07-14T13:11:27.891406+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896301+0000","last_change":"2023-07-14T13:11:27.896301+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896301+0000","last_undegraded":"2023-07-14T13:11:27.896301+0000","last_fullsized":"2023-07-14T13:11:27.896301+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896227+0000","last_change":"2023-07-14T13:11:27.896227+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896227+0000","last_undegraded":"2023-07-14T13:11:27.896227+0000","last_fullsized":"2023-07-14T13:11:27.896227+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896163+0000","last_change":"2023-07-14T13:11:27.896163+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896163+0000","last_undegraded":"2023-07-14T13:11:27.896163+0000","last_fullsized":"2023-07-14T13:11:27.896163+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.895290+0000","last_change":"2023-07-14T13:11:27.895290+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.895290+0000","last_undegraded":"2023-07-14T13:11:27.895290+0000","last_fullsized":"2023-07-14T13:11:27.895290+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.906686+0000","last_change":"2023-07-14T13:11:27.906686+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.906686+0000","last_undegraded":"2023-07-14T13:11:27.906686+0000","last_fullsized":"2023-07-14T13:11:27.906686+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896085+0000","last_change":"2023-07-14T13:11:27.896085+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896085+0000","last_undegraded":"2023-07-14T13:11:27.896085+0000","last_fullsized":"2023-07-14T13:11:27.896085+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.892998+0000","last_change":"2023-07-14T13:11:27.892998+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.892998+0000","last_undegraded":"2023-07-14T13:11:27.892998+0000","last_fullsized":"2023-07-14T13:11:27.892998+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896165+0000","last_change":"2023-07-14T13:11:27.896165+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896165+0000","last_undegraded":"2023-07-14T13:11:27.896165+0000","last_fullsized":"2023-07-14T13:11:27.896165+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.897491+0000","last_change":"2023-07-14T13:11:27.897491+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.897491+0000","last_undegraded":"2023-07-14T13:11:27.897491+0000","last_fullsized":"2023-07-14T13:11:27.897491+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.890634+0000","last_change":"2023-07-14T13:11:27.890634+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.890634+0000","last_undegraded":"2023-07-14T13:11:27.890634+0000","last_fullsized":"2023-07-14T13:11:27.890634+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.895068+0000","last_change":"2023-07-14T13:11:27.895068+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.895068+0000","last_undegraded":"2023-07-14T13:11:27.895068+0000","last_fullsized":"2023-07-14T13:11:27.895068+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.892645+0000","last_change":"2023-07-14T13:11:27.892645+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.892645+0000","last_undegraded":"2023-07-14T13:11:27.892645+0000","last_fullsized":"2023-07-14T13:11:27.892645+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.894405+0000","last_change":"2023-07-14T13:11:27.894405+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.894405+0000","last_undegraded":"2023-07-14T13:11:27.894405+0000","last_fullsized":"2023-07-14T13:11:27.894405+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.901319+0000","last_change":"2023-07-14T13:11:27.901319+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.901319+0000","last_undegraded":"2023-07-14T13:11:27.901319+0000","last_fullsized":"2023-07-14T13:11:27.901319+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.907554+0000","last_change":"2023-07-14T13:11:27.907554+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.907554+0000","last_undegraded":"2023-07-14T13:11:27.907554+0000","last_fullsized":"2023-07-14T13:11:27.907554+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.893622+0000","last_change":"2023-07-14T13:11:27.893622+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.893622+0000","last_undegraded":"2023-07-14T13:11:27.893622+0000","last_fullsized":"2023-07-14T13:11:27.893622+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.894205+0000","last_change":"2023-07-14T13:11:27.894205+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.894205+0000","last_undegraded":"2023-07-14T13:11:27.894205+0000","last_fullsized":"2023-07-14T13:11:27.894205+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.903653+0000","last_change":"2023-07-14T13:11:27.903653+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.903653+0000","last_undegraded":"2023-07-14T13:11:27.903653+0000","last_fullsized":"2023-07-14T13:11:27.903653+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896718+0000","last_change":"2023-07-14T13:11:27.896718+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896718+0000","last_undegraded":"2023-07-14T13:11:27.896718+0000","last_fullsized":"2023-07-14T13:11:27.896718+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.890117+0000","last_change":"2023-07-14T13:11:27.890117+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.890117+0000","last_undegraded":"2023-07-14T13:11:27.890117+0000","last_fullsized":"2023-07-14T13:11:27.890117+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.914043+0000","last_change":"2023-07-14T13:11:27.912001+0000","last_active":"2023-07-14T13:11:27.914043+0000","last_peered":"2023-07-14T13:11:27.914043+0000","last_clean":"2023-07-14T13:11:27.914043+0000","last_became_active":"2023-07-14T13:11:27.911416+0000","last_became_peered":"2023-07-14T13:11:27.911416+0000","last_unstale":"2023-07-14T13:11:27.914043+0000","last_undegraded":"2023-07-14T13:11:27.914043+0000","last_fullsized":"2023-07-14T13:11:27.914043+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:06:23.094335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.892755+0000","last_change":"2023-07-14T13:11:27.892755+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.892755+0000","last_undegraded":"2023-07-14T13:11:27.892755+0000","last_fullsized":"2023-07-14T13:11:27.892755+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.912220+0000","last_change":"2023-07-14T13:11:27.908608+0000","last_active":"2023-07-14T13:11:27.912220+0000","last_peered":"2023-07-14T13:11:27.912220+0000","last_clean":"2023-07-14T13:11:27.912220+0000","last_became_active":"2023-07-14T13:11:27.908336+0000","last_became_peered":"2023-07-14T13:11:27.908336+0000","last_unstale":"2023-07-14T13:11:27.912220+0000","last_undegraded":"2023-07-14T13:11:27.912220+0000","last_fullsized":"2023-07-14T13:11:27.912220+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:41:02.058425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.892949+0000","last_change":"2023-07-14T13:11:27.892949+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.892949+0000","last_undegraded":"2023-07-14T13:11:27.892949+0000","last_fullsized":"2023-07-14T13:11:27.892949+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.911273+0000","last_change":"2023-07-14T13:11:27.909451+0000","last_active":"2023-07-14T13:11:27.911273+0000","last_peered":"2023-07-14T13:11:27.911273+0000","last_clean":"2023-07-14T13:11:27.911273+0000","last_became_active":"2023-07-14T13:11:27.909180+0000","last_became_peered":"2023-07-14T13:11:27.909180+0000","last_unstale":"2023-07-14T13:11:27.911273+0000","last_undegraded":"2023-07-14T13:11:27.911273+0000","last_fullsized":"2023-07-14T13:11:27.911273+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:17:10.167032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.897580+0000","last_change":"2023-07-14T13:11:27.897580+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.897580+0000","last_undegraded":"2023-07-14T13:11:27.897580+0000","last_fullsized":"2023-07-14T13:11:27.897580+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.907950+0000","last_change":"2023-07-14T13:11:27.902198+0000","last_active":"2023-07-14T13:11:27.907950+0000","last_peered":"2023-07-14T13:11:27.907950+0000","last_clean":"2023-07-14T13:11:27.907950+0000","last_became_active":"2023-07-14T13:11:27.901878+0000","last_became_peered":"2023-07-14T13:11:27.901878+0000","last_unstale":"2023-07-14T13:11:27.907950+0000","last_undegraded":"2023-07-14T13:11:27.907950+0000","last_fullsized":"2023-07-14T13:11:27.907950+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:24:24.888974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.892486+0000","last_change":"2023-07-14T13:11:27.892486+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.892486+0000","last_undegraded":"2023-07-14T13:11:27.892486+0000","last_fullsized":"2023-07-14T13:11:27.892486+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.917311+0000","last_change":"2023-07-14T13:11:27.915760+0000","last_active":"2023-07-14T13:11:27.917311+0000","last_peered":"2023-07-14T13:11:27.917311+0000","last_clean":"2023-07-14T13:11:27.917311+0000","last_became_active":"2023-07-14T13:11:27.915444+0000","last_became_peered":"2023-07-14T13:11:27.915444+0000","last_unstale":"2023-07-14T13:11:27.917311+0000","last_undegraded":"2023-07-14T13:11:27.917311+0000","last_fullsized":"2023-07-14T13:11:27.917311+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:07:12.354729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.890139+0000","last_change":"2023-07-14T13:11:27.890139+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.890139+0000","last_undegraded":"2023-07-14T13:11:27.890139+0000","last_fullsized":"2023-07-14T13:11:27.890139+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.906142+0000","last_change":"2023-07-14T13:11:27.904817+0000","last_active":"2023-07-14T13:11:27.906142+0000","last_peered":"2023-07-14T13:11:27.906142+0000","last_clean":"2023-07-14T13:11:27.906142+0000","last_became_active":"2023-07-14T13:11:27.904417+0000","last_became_peered":"2023-07-14T13:11:27.904417+0000","last_unstale":"2023-07-14T13:11:27.906142+0000","last_undegraded":"2023-07-14T13:11:27.906142+0000","last_fullsized":"2023-07-14T13:11:27.906142+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:34:55.739790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.906115+0000","last_change":"2023-07-14T13:11:27.906115+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.906115+0000","last_undegraded":"2023-07-14T13:11:27.906115+0000","last_fullsized":"2023-07-14T13:11:27.906115+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.909872+0000","last_change":"2023-07-14T13:11:27.904887+0000","last_active":"2023-07-14T13:11:27.909872+0000","last_peered":"2023-07-14T13:11:27.909872+0000","last_clean":"2023-07-14T13:11:27.909872+0000","last_became_active":"2023-07-14T13:11:27.904566+0000","last_became_peered":"2023-07-14T13:11:27.904566+0000","last_unstale":"2023-07-14T13:11:27.909872+0000","last_undegraded":"2023-07-14T13:11:27.909872+0000","last_fullsized":"2023-07-14T13:11:27.909872+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:21:34.987957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.891818+0000","last_change":"2023-07-14T13:11:27.891818+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.891818+0000","last_undegraded":"2023-07-14T13:11:27.891818+0000","last_fullsized":"2023-07-14T13:11:27.891818+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.909052+0000","last_change":"2023-07-14T13:11:27.903404+0000","last_active":"2023-07-14T13:11:27.909052+0000","last_peered":"2023-07-14T13:11:27.909052+0000","last_clean":"2023-07-14T13:11:27.909052+0000","last_became_active":"2023-07-14T13:11:27.903115+0000","last_became_peered":"2023-07-14T13:11:27.903115+0000","last_unstale":"2023-07-14T13:11:27.909052+0000","last_undegraded":"2023-07-14T13:11:27.909052+0000","last_fullsized":"2023-07-14T13:11:27.909052+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:49.123489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.890934+0000","last_change":"2023-07-14T13:11:27.890934+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.890934+0000","last_undegraded":"2023-07-14T13:11:27.890934+0000","last_fullsized":"2023-07-14T13:11:27.890934+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.909707+0000","last_change":"2023-07-14T13:11:27.904996+0000","last_active":"2023-07-14T13:11:27.909707+0000","last_peered":"2023-07-14T13:11:27.909707+0000","last_clean":"2023-07-14T13:11:27.909707+0000","last_became_active":"2023-07-14T13:11:27.904702+0000","last_became_peered":"2023-07-14T13:11:27.904702+0000","last_unstale":"2023-07-14T13:11:27.909707+0000","last_undegraded":"2023-07-14T13:11:27.909707+0000","last_fullsized":"2023-07-14T13:11:27.909707+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:44.896082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.897030+0000","last_change":"2023-07-14T13:11:27.897030+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.897030+0000","last_undegraded":"2023-07-14T13:11:27.897030+0000","last_fullsized":"2023-07-14T13:11:27.897030+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.905277+0000","last_change":"2023-07-14T13:11:27.900517+0000","last_active":"2023-07-14T13:11:27.905277+0000","last_peered":"2023-07-14T13:11:27.905277+0000","last_clean":"2023-07-14T13:11:27.905277+0000","last_became_active":"2023-07-14T13:11:27.900219+0000","last_became_peered":"2023-07-14T13:11:27.900219+0000","last_unstale":"2023-07-14T13:11:27.905277+0000","last_undegraded":"2023-07-14T13:11:27.905277+0000","last_fullsized":"2023-07-14T13:11:27.905277+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:35:12.791399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.892585+0000","last_change":"2023-07-14T13:11:27.892585+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.892585+0000","last_undegraded":"2023-07-14T13:11:27.892585+0000","last_fullsized":"2023-07-14T13:11:27.892585+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.915102+0000","last_change":"2023-07-14T13:11:27.911972+0000","last_active":"2023-07-14T13:11:27.915102+0000","last_peered":"2023-07-14T13:11:27.915102+0000","last_clean":"2023-07-14T13:11:27.915102+0000","last_became_active":"2023-07-14T13:11:27.911403+0000","last_became_peered":"2023-07-14T13:11:27.911403+0000","last_unstale":"2023-07-14T13:11:27.915102+0000","last_undegraded":"2023-07-14T13:11:27.915102+0000","last_fullsized":"2023-07-14T13:11:27.915102+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:06:40.624907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.894417+0000","last_change":"2023-07-14T13:11:27.894417+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.894417+0000","last_undegraded":"2023-07-14T13:11:27.894417+0000","last_fullsized":"2023-07-14T13:11:27.894417+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.916428+0000","last_change":"2023-07-14T13:11:27.910905+0000","last_active":"2023-07-14T13:11:27.916428+0000","last_peered":"2023-07-14T13:11:27.916428+0000","last_clean":"2023-07-14T13:11:27.916428+0000","last_became_active":"2023-07-14T13:11:27.910550+0000","last_became_peered":"2023-07-14T13:11:27.910550+0000","last_unstale":"2023-07-14T13:11:27.916428+0000","last_undegraded":"2023-07-14T13:11:27.916428+0000","last_fullsized":"2023-07-14T13:11:27.916428+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:39:22.376019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.897040+0000","last_change":"2023-07-14T13:11:27.897040+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.897040+0000","last_undegraded":"2023-07-14T13:11:27.897040+0000","last_fullsized":"2023-07-14T13:11:27.897040+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.909316+0000","last_change":"2023-07-14T13:11:27.907025+0000","last_active":"2023-07-14T13:11:27.909316+0000","last_peered":"2023-07-14T13:11:27.909316+0000","last_clean":"2023-07-14T13:11:27.909316+0000","last_became_active":"2023-07-14T13:11:27.906711+0000","last_became_peered":"2023-07-14T13:11:27.906711+0000","last_unstale":"2023-07-14T13:11:27.909316+0000","last_undegraded":"2023-07-14T13:11:27.909316+0000","last_fullsized":"2023-07-14T13:11:27.909316+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:14:56.592264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.908446+0000","last_change":"2023-07-14T13:11:27.908446+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.908446+0000","last_undegraded":"2023-07-14T13:11:27.908446+0000","last_fullsized":"2023-07-14T13:11:27.908446+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.909012+0000","last_change":"2023-07-14T13:11:27.905683+0000","last_active":"2023-07-14T13:11:27.909012+0000","last_peered":"2023-07-14T13:11:27.909012+0000","last_clean":"2023-07-14T13:11:27.909012+0000","last_became_active":"2023-07-14T13:11:27.905382+0000","last_became_peered":"2023-07-14T13:11:27.905382+0000","last_unstale":"2023-07-14T13:11:27.909012+0000","last_undegraded":"2023-07-14T13:11:27.909012+0000","last_fullsized":"2023-07-14T13:11:27.909012+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:43:45.681385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896451+0000","last_change":"2023-07-14T13:11:27.896451+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896451+0000","last_undegraded":"2023-07-14T13:11:27.896451+0000","last_fullsized":"2023-07-14T13:11:27.896451+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.902777+0000","last_change":"2023-07-14T13:11:27.899284+0000","last_active":"2023-07-14T13:11:27.902777+0000","last_peered":"2023-07-14T13:11:27.902777+0000","last_clean":"2023-07-14T13:11:27.902777+0000","last_became_active":"2023-07-14T13:11:27.899000+0000","last_became_peered":"2023-07-14T13:11:27.899000+0000","last_unstale":"2023-07-14T13:11:27.902777+0000","last_undegraded":"2023-07-14T13:11:27.902777+0000","last_fullsized":"2023-07-14T13:11:27.902777+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:58:20.832900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.890579+0000","last_change":"2023-07-14T13:11:27.890579+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.890579+0000","last_undegraded":"2023-07-14T13:11:27.890579+0000","last_fullsized":"2023-07-14T13:11:27.890579+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.905742+0000","last_change":"2023-07-14T13:11:27.903246+0000","last_active":"2023-07-14T13:11:27.905742+0000","last_peered":"2023-07-14T13:11:27.905742+0000","last_clean":"2023-07-14T13:11:27.905742+0000","last_became_active":"2023-07-14T13:11:27.902770+0000","last_became_peered":"2023-07-14T13:11:27.902770+0000","last_unstale":"2023-07-14T13:11:27.905742+0000","last_undegraded":"2023-07-14T13:11:27.905742+0000","last_fullsized":"2023-07-14T13:11:27.905742+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:50:25.947325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.891456+0000","last_change":"2023-07-14T13:11:27.891456+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.891456+0000","last_undegraded":"2023-07-14T13:11:27.891456+0000","last_fullsized":"2023-07-14T13:11:27.891456+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.909255+0000","last_change":"2023-07-14T13:11:27.907026+0000","last_active":"2023-07-14T13:11:27.909255+0000","last_peered":"2023-07-14T13:11:27.909255+0000","last_clean":"2023-07-14T13:11:27.909255+0000","last_became_active":"2023-07-14T13:11:27.906738+0000","last_became_peered":"2023-07-14T13:11:27.906738+0000","last_unstale":"2023-07-14T13:11:27.909255+0000","last_undegraded":"2023-07-14T13:11:27.909255+0000","last_fullsized":"2023-07-14T13:11:27.909255+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:32:25.336512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.892862+0000","last_change":"2023-07-14T13:11:27.892862+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.892862+0000","last_undegraded":"2023-07-14T13:11:27.892862+0000","last_fullsized":"2023-07-14T13:11:27.892862+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.905879+0000","last_change":"2023-07-14T13:11:27.902133+0000","last_active":"2023-07-14T13:11:27.905879+0000","last_peered":"2023-07-14T13:11:27.905879+0000","last_clean":"2023-07-14T13:11:27.905879+0000","last_became_active":"2023-07-14T13:11:27.901863+0000","last_became_peered":"2023-07-14T13:11:27.901863+0000","last_unstale":"2023-07-14T13:11:27.905879+0000","last_undegraded":"2023-07-14T13:11:27.905879+0000","last_fullsized":"2023-07-14T13:11:27.905879+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:43:08.536956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.893258+0000","last_change":"2023-07-14T13:11:27.893258+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.893258+0000","last_undegraded":"2023-07-14T13:11:27.893258+0000","last_fullsized":"2023-07-14T13:11:27.893258+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.920078+0000","last_change":"2023-07-14T13:11:27.917285+0000","last_active":"2023-07-14T13:11:27.920078+0000","last_peered":"2023-07-14T13:11:27.920078+0000","last_clean":"2023-07-14T13:11:27.920078+0000","last_became_active":"2023-07-14T13:11:27.916997+0000","last_became_peered":"2023-07-14T13:11:27.916997+0000","last_unstale":"2023-07-14T13:11:27.920078+0000","last_undegraded":"2023-07-14T13:11:27.920078+0000","last_fullsized":"2023-07-14T13:11:27.920078+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:41:18.620557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.899765+0000","last_change":"2023-07-14T13:11:27.899765+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.899765+0000","last_undegraded":"2023-07-14T13:11:27.899765+0000","last_fullsized":"2023-07-14T13:11:27.899765+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.912804+0000","last_change":"2023-07-14T13:11:27.911728+0000","last_active":"2023-07-14T13:11:27.912804+0000","last_peered":"2023-07-14T13:11:27.912804+0000","last_clean":"2023-07-14T13:11:27.912804+0000","last_became_active":"2023-07-14T13:11:27.911418+0000","last_became_peered":"2023-07-14T13:11:27.911418+0000","last_unstale":"2023-07-14T13:11:27.912804+0000","last_undegraded":"2023-07-14T13:11:27.912804+0000","last_fullsized":"2023-07-14T13:11:27.912804+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:20:43.667484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.897064+0000","last_change":"2023-07-14T13:11:27.897064+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.897064+0000","last_undegraded":"2023-07-14T13:11:27.897064+0000","last_fullsized":"2023-07-14T13:11:27.897064+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.914420+0000","last_change":"2023-07-14T13:11:27.911575+0000","last_active":"2023-07-14T13:11:27.914420+0000","last_peered":"2023-07-14T13:11:27.914420+0000","last_clean":"2023-07-14T13:11:27.914420+0000","last_became_active":"2023-07-14T13:11:27.911267+0000","last_became_peered":"2023-07-14T13:11:27.911267+0000","last_unstale":"2023-07-14T13:11:27.914420+0000","last_undegraded":"2023-07-14T13:11:27.914420+0000","last_fullsized":"2023-07-14T13:11:27.914420+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:25:31.252394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.897503+0000","last_change":"2023-07-14T13:11:27.897503+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.897503+0000","last_undegraded":"2023-07-14T13:11:27.897503+0000","last_fullsized":"2023-07-14T13:11:27.897503+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.906425+0000","last_change":"2023-07-14T13:11:27.902540+0000","last_active":"2023-07-14T13:11:27.906425+0000","last_peered":"2023-07-14T13:11:27.906425+0000","last_clean":"2023-07-14T13:11:27.906425+0000","last_became_active":"2023-07-14T13:11:27.902204+0000","last_became_peered":"2023-07-14T13:11:27.902204+0000","last_unstale":"2023-07-14T13:11:27.906425+0000","last_undegraded":"2023-07-14T13:11:27.906425+0000","last_fullsized":"2023-07-14T13:11:27.906425+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:13:17.808147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896887+0000","last_change":"2023-07-14T13:11:27.896887+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896887+0000","last_undegraded":"2023-07-14T13:11:27.896887+0000","last_fullsized":"2023-07-14T13:11:27.896887+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.915599+0000","last_change":"2023-07-14T13:11:27.913333+0000","last_active":"2023-07-14T13:11:27.915599+0000","last_peered":"2023-07-14T13:11:27.915599+0000","last_clean":"2023-07-14T13:11:27.915599+0000","last_became_active":"2023-07-14T13:11:27.912829+0000","last_became_peered":"2023-07-14T13:11:27.912829+0000","last_unstale":"2023-07-14T13:11:27.915599+0000","last_undegraded":"2023-07-14T13:11:27.915599+0000","last_fullsized":"2023-07-14T13:11:27.915599+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:19:04.528705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.899166+0000","last_change":"2023-07-14T13:11:27.899166+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.899166+0000","last_undegraded":"2023-07-14T13:11:27.899166+0000","last_fullsized":"2023-07-14T13:11:27.899166+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.904105+0000","last_change":"2023-07-14T13:11:27.899057+0000","last_active":"2023-07-14T13:11:27.904105+0000","last_peered":"2023-07-14T13:11:27.904105+0000","last_clean":"2023-07-14T13:11:27.904105+0000","last_became_active":"2023-07-14T13:11:27.898776+0000","last_became_peered":"2023-07-14T13:11:27.898776+0000","last_unstale":"2023-07-14T13:11:27.904105+0000","last_undegraded":"2023-07-14T13:11:27.904105+0000","last_fullsized":"2023-07-14T13:11:27.904105+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:27:27.592118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896877+0000","last_change":"2023-07-14T13:11:27.896877+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896877+0000","last_undegraded":"2023-07-14T13:11:27.896877+0000","last_fullsized":"2023-07-14T13:11:27.896877+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.912020+0000","last_change":"2023-07-14T13:11:27.908040+0000","last_active":"2023-07-14T13:11:27.912020+0000","last_peered":"2023-07-14T13:11:27.912020+0000","last_clean":"2023-07-14T13:11:27.912020+0000","last_became_active":"2023-07-14T13:11:27.907724+0000","last_became_peered":"2023-07-14T13:11:27.907724+0000","last_unstale":"2023-07-14T13:11:27.912020+0000","last_undegraded":"2023-07-14T13:11:27.912020+0000","last_fullsized":"2023-07-14T13:11:27.912020+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:39:03.219860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"115'227","reported_seq":748,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.898154+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:11:27.898154+0000","last_peered":"2023-07-14T13:11:27.898154+0000","last_clean":"2023-07-14T13:11:27.898154+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:11:27.898154+0000","last_undegraded":"2023-07-14T13:11:27.898154+0000","last_fullsized":"2023-07-14T13:11:27.898154+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:16:06.966073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":200,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.902725+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:11:27.902725+0000","last_peered":"2023-07-14T13:11:27.902725+0000","last_clean":"2023-07-14T13:11:27.902725+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:11:27.902725+0000","last_undegraded":"2023-07-14T13:11:27.902725+0000","last_fullsized":"2023-07-14T13:11:27.902725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:34:45.578849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.904732+0000","last_change":"2023-07-14T13:11:27.904732+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.904732+0000","last_undegraded":"2023-07-14T13:11:27.904732+0000","last_fullsized":"2023-07-14T13:11:27.904732+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.909643+0000","last_change":"2023-07-14T13:11:27.908313+0000","last_active":"2023-07-14T13:11:27.909643+0000","last_peered":"2023-07-14T13:11:27.909643+0000","last_clean":"2023-07-14T13:11:27.909643+0000","last_became_active":"2023-07-14T13:11:27.907979+0000","last_became_peered":"2023-07-14T13:11:27.907979+0000","last_unstale":"2023-07-14T13:11:27.909643+0000","last_undegraded":"2023-07-14T13:11:27.909643+0000","last_fullsized":"2023-07-14T13:11:27.909643+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:32:04.663850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":202,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.898025+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:11:27.898025+0000","last_peered":"2023-07-14T13:11:27.898025+0000","last_clean":"2023-07-14T13:11:27.898025+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:11:27.898025+0000","last_undegraded":"2023-07-14T13:11:27.898025+0000","last_fullsized":"2023-07-14T13:11:27.898025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:03:58.434300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.894928+0000","last_change":"2023-07-14T13:11:27.894928+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.894928+0000","last_undegraded":"2023-07-14T13:11:27.894928+0000","last_fullsized":"2023-07-14T13:11:27.894928+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.915342+0000","last_change":"2023-07-14T13:11:27.914507+0000","last_active":"2023-07-14T13:11:27.915342+0000","last_peered":"2023-07-14T13:11:27.915342+0000","last_clean":"2023-07-14T13:11:27.915342+0000","last_became_active":"2023-07-14T13:11:27.914211+0000","last_became_peered":"2023-07-14T13:11:27.914211+0000","last_unstale":"2023-07-14T13:11:27.915342+0000","last_undegraded":"2023-07-14T13:11:27.915342+0000","last_fullsized":"2023-07-14T13:11:27.915342+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:24:53.822108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":200,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.893049+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:11:27.893049+0000","last_peered":"2023-07-14T13:11:27.893049+0000","last_clean":"2023-07-14T13:11:27.893049+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:11:27.893049+0000","last_undegraded":"2023-07-14T13:11:27.893049+0000","last_fullsized":"2023-07-14T13:11:27.893049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:55:05.131842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.892546+0000","last_change":"2023-07-14T13:11:27.892546+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.892546+0000","last_undegraded":"2023-07-14T13:11:27.892546+0000","last_fullsized":"2023-07-14T13:11:27.892546+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.916712+0000","last_change":"2023-07-14T13:11:27.914767+0000","last_active":"2023-07-14T13:11:27.916712+0000","last_peered":"2023-07-14T13:11:27.916712+0000","last_clean":"2023-07-14T13:11:27.916712+0000","last_became_active":"2023-07-14T13:11:27.914404+0000","last_became_peered":"2023-07-14T13:11:27.914404+0000","last_unstale":"2023-07-14T13:11:27.916712+0000","last_undegraded":"2023-07-14T13:11:27.916712+0000","last_fullsized":"2023-07-14T13:11:27.916712+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:01:23.899054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":200,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.902678+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:11:27.902678+0000","last_peered":"2023-07-14T13:11:27.902678+0000","last_clean":"2023-07-14T13:11:27.902678+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:11:27.902678+0000","last_undegraded":"2023-07-14T13:11:27.902678+0000","last_fullsized":"2023-07-14T13:11:27.902678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:56:31.177858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.893399+0000","last_change":"2023-07-14T13:11:27.893399+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.893399+0000","last_undegraded":"2023-07-14T13:11:27.893399+0000","last_fullsized":"2023-07-14T13:11:27.893399+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.916623+0000","last_change":"2023-07-14T13:11:27.913529+0000","last_active":"2023-07-14T13:11:27.916623+0000","last_peered":"2023-07-14T13:11:27.916623+0000","last_clean":"2023-07-14T13:11:27.916623+0000","last_became_active":"2023-07-14T13:11:27.913229+0000","last_became_peered":"2023-07-14T13:11:27.913229+0000","last_unstale":"2023-07-14T13:11:27.916623+0000","last_undegraded":"2023-07-14T13:11:27.916623+0000","last_fullsized":"2023-07-14T13:11:27.916623+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:30.739338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":211,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.898183+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:11:27.898183+0000","last_peered":"2023-07-14T13:11:27.898183+0000","last_clean":"2023-07-14T13:11:27.898183+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:11:27.898183+0000","last_undegraded":"2023-07-14T13:11:27.898183+0000","last_fullsized":"2023-07-14T13:11:27.898183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:05:13.588773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.893394+0000","last_change":"2023-07-14T13:11:27.893394+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.893394+0000","last_undegraded":"2023-07-14T13:11:27.893394+0000","last_fullsized":"2023-07-14T13:11:27.893394+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.905477+0000","last_change":"2023-07-14T13:11:27.904242+0000","last_active":"2023-07-14T13:11:27.905477+0000","last_peered":"2023-07-14T13:11:27.905477+0000","last_clean":"2023-07-14T13:11:27.905477+0000","last_became_active":"2023-07-14T13:11:27.903918+0000","last_became_peered":"2023-07-14T13:11:27.903918+0000","last_unstale":"2023-07-14T13:11:27.905477+0000","last_undegraded":"2023-07-14T13:11:27.905477+0000","last_fullsized":"2023-07-14T13:11:27.905477+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:29:52.431360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":201,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.900033+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:11:27.900033+0000","last_peered":"2023-07-14T13:11:27.900033+0000","last_clean":"2023-07-14T13:11:27.900033+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:11:27.900033+0000","last_undegraded":"2023-07-14T13:11:27.900033+0000","last_fullsized":"2023-07-14T13:11:27.900033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:38:49.370231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.891144+0000","last_change":"2023-07-14T13:11:27.891144+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.891144+0000","last_undegraded":"2023-07-14T13:11:27.891144+0000","last_fullsized":"2023-07-14T13:11:27.891144+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.907212+0000","last_change":"2023-07-14T13:11:27.905304+0000","last_active":"2023-07-14T13:11:27.907212+0000","last_peered":"2023-07-14T13:11:27.907212+0000","last_clean":"2023-07-14T13:11:27.907212+0000","last_became_active":"2023-07-14T13:11:27.904926+0000","last_became_peered":"2023-07-14T13:11:27.904926+0000","last_unstale":"2023-07-14T13:11:27.907212+0000","last_undegraded":"2023-07-14T13:11:27.907212+0000","last_fullsized":"2023-07-14T13:11:27.907212+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:56:10.021540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":211,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.894238+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:11:27.894238+0000","last_peered":"2023-07-14T13:11:27.894238+0000","last_clean":"2023-07-14T13:11:27.894238+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:11:27.894238+0000","last_undegraded":"2023-07-14T13:11:27.894238+0000","last_fullsized":"2023-07-14T13:11:27.894238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:59:45.531447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.891660+0000","last_change":"2023-07-14T13:11:27.891660+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.891660+0000","last_undegraded":"2023-07-14T13:11:27.891660+0000","last_fullsized":"2023-07-14T13:11:27.891660+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.912271+0000","last_change":"2023-07-14T13:11:27.909085+0000","last_active":"2023-07-14T13:11:27.912271+0000","last_peered":"2023-07-14T13:11:27.912271+0000","last_clean":"2023-07-14T13:11:27.912271+0000","last_became_active":"2023-07-14T13:11:27.908811+0000","last_became_peered":"2023-07-14T13:11:27.908811+0000","last_unstale":"2023-07-14T13:11:27.912271+0000","last_undegraded":"2023-07-14T13:11:27.912271+0000","last_fullsized":"2023-07-14T13:11:27.912271+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:53:08.517311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":203,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.909391+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:11:27.909391+0000","last_peered":"2023-07-14T13:11:27.909391+0000","last_clean":"2023-07-14T13:11:27.909391+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:11:27.909391+0000","last_undegraded":"2023-07-14T13:11:27.909391+0000","last_fullsized":"2023-07-14T13:11:27.909391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:38:12.792564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575073,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59376,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312464,"statfs":{"total":96636764160,"available":96575963136,"internally_reserved":0,"allocated":2138112,"data_stored":1371934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.70799999999999996,"15min":0.70999999999999996},"min":{"1min":0.53300000000000003,"5min":0.372,"15min":0.33900000000000002},"max":{"1min":0.95899999999999996,"5min":1.262,"15min":1.262},"last":0.5},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71999999999999997,"15min":0.72899999999999998},"min":{"1min":0.51500000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.55100000000000005}]},{"osd":1,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72399999999999998,"15min":0.73599999999999999},"min":{"1min":0.48199999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.872,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.72899999999999998,"15min":0.74399999999999999},"min":{"1min":0.59799999999999998,"5min":0.436,"15min":0.40500000000000003},"max":{"1min":0.97599999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.58299999999999996,"5min":0.46100000000000002,"15min":0.42699999999999999},"max":{"1min":0.96099999999999997,"5min":1.073,"15min":1.073},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.73899999999999999,"15min":0.753},"min":{"1min":0.57999999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89600000000000002,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.70499999999999996}]},{"osd":3,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.58899999999999997,"5min":0.503,"15min":0.46400000000000002},"max":{"1min":0.90900000000000003,"5min":1.161,"15min":1.161},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.73999999999999999,"15min":0.75600000000000001},"min":{"1min":0.60299999999999998,"5min":0.47899999999999998,"15min":0.41499999999999998},"max":{"1min":0.91800000000000004,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.755}]},{"osd":4,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55800000000000005,"15min":0.57799999999999996},"min":{"1min":0.44500000000000001,"5min":0.39100000000000001,"15min":0.318},"max":{"1min":0.874,"5min":0.874,"15min":1.022},"last":0.628},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.47399999999999998,"5min":0.40600000000000003,"15min":0.39300000000000002},"max":{"1min":0.76500000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.77400000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.52100000000000002,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.82199999999999995,"5min":0.98099999999999998,"15min":0.98299999999999998},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.64700000000000002},"min":{"1min":0.44,"5min":0.377,"15min":0.34100000000000003},"max":{"1min":0.80700000000000005,"5min":1.028,"15min":1.028},"last":0.80500000000000005}]},{"osd":6,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67600000000000005,"15min":0.69099999999999995},"min":{"1min":0.48499999999999999,"5min":0.45200000000000001,"15min":0.42699999999999999},"max":{"1min":0.85799999999999998,"5min":0.99299999999999999,"15min":1.0489999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.68000000000000005,"15min":0.67500000000000004},"min":{"1min":0.47499999999999998,"5min":0.46200000000000002,"15min":0.36299999999999999},"max":{"1min":4.1130000000000004,"5min":4.1130000000000004,"15min":4.1130000000000004},"last":0.85799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575074,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":1508,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":1544192,"data_stored":781566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71599999999999997,"15min":0.73099999999999998},"min":{"1min":0.50800000000000001,"5min":0.39500000000000002,"15min":0.38},"max":{"1min":0.90100000000000002,"5min":0.95899999999999996,"15min":0.996},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.70199999999999996,"15min":0.72699999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89500000000000002,"5min":0.98199999999999998,"15min":1.0800000000000001},"last":0.55700000000000005}]},{"osd":1,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70899999999999996,"15min":0.73699999999999999},"min":{"1min":0.497,"5min":0.42299999999999999,"15min":0.379},"max":{"1min":0.84399999999999997,"5min":0.97199999999999998,"15min":1.0209999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.70199999999999996,"15min":0.72099999999999997},"min":{"1min":0.60599999999999998,"5min":0.47499999999999998,"15min":0.46999999999999997},"max":{"1min":0.88100000000000001,"5min":0.91400000000000003,"15min":1.077},"last":0.64400000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72699999999999998,"15min":0.749},"min":{"1min":0.56100000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.874,"5min":0.95099999999999996,"15min":1.105},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.48499999999999999,"5min":0.441,"15min":0.441},"max":{"1min":0.97999999999999998,"5min":0.99099999999999999,"15min":1.0900000000000001},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.75,"15min":0.77200000000000002},"min":{"1min":0.61499999999999999,"5min":0.46000000000000002,"15min":0.434},"max":{"1min":0.92200000000000004,"5min":1.054,"15min":1.1359999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.71899999999999997,"15min":0.754},"min":{"1min":0.56999999999999995,"5min":0.50900000000000001,"15min":0.48399999999999999},"max":{"1min":0.871,"5min":0.94799999999999995,"15min":1.1080000000000001},"last":0.624}]},{"osd":4,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57399999999999995,"15min":0.57499999999999996},"min":{"1min":0.45900000000000002,"5min":0.39900000000000002,"15min":0.317},"max":{"1min":0.76300000000000001,"5min":0.89900000000000002,"15min":0.97899999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.48299999999999998,"5min":0.439,"15min":0.38500000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":1.0780000000000001},"last":0.69199999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.497,"5min":0.45200000000000001,"15min":0.37},"max":{"1min":0.78100000000000003,"5min":0.96599999999999997,"15min":1.579},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.50800000000000001,"5min":0.46300000000000002,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.81999999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67400000000000004,"15min":0.65900000000000003},"min":{"1min":0.47899999999999998,"5min":0.437,"15min":0.34599999999999997},"max":{"1min":0.93899999999999995,"5min":1.0940000000000001,"15min":1.1200000000000001},"last":0.75},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71299999999999997,"15min":0.71199999999999997},"min":{"1min":0.59699999999999998,"5min":0.48899999999999999,"15min":0.36199999999999999},"max":{"1min":0.92000000000000004,"5min":1.0209999999999999,"15min":1.657},"last":0.68500000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575073,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46508,"kb_used_data":1508,"kb_used_omap":0,"kb_used_meta":44992,"kb_avail":94325332,"statfs":{"total":96636764160,"available":96589139968,"internally_reserved":0,"allocated":1544192,"data_stored":781566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46071808},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.69399999999999995,"15min":0.72499999999999998},"min":{"1min":0.44400000000000001,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":0.88800000000000001,"5min":0.91500000000000004,"15min":2.6699999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.71299999999999997,"15min":0.72799999999999998},"min":{"1min":0.56799999999999995,"5min":0.41699999999999998,"15min":0.32800000000000001},"max":{"1min":0.98299999999999998,"5min":1.083,"15min":1.083},"last":0.83999999999999997}]},{"osd":1,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.69399999999999995,"15min":0.72099999999999997},"min":{"1min":0.49399999999999999,"5min":0.45900000000000002,"15min":0.41099999999999998},"max":{"1min":0.95799999999999996,"5min":1.05,"15min":1.079},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72099999999999997,"15min":0.74299999999999999},"min":{"1min":0.55000000000000004,"5min":0.48999999999999999,"15min":0.36799999999999999},"max":{"1min":0.92500000000000004,"5min":0.95899999999999996,"15min":2.706},"last":0.76000000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.71499999999999997,"15min":0.73299999999999998},"min":{"1min":0.58699999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.93999999999999995,"5min":1.212,"15min":1.212},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.70999999999999996,"15min":0.73099999999999998},"min":{"1min":0.60999999999999999,"5min":0.44800000000000001,"15min":0.433},"max":{"1min":0.90900000000000003,"5min":1.181,"15min":1.181},"last":0.68100000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.72499999999999998,"15min":0.74399999999999999},"min":{"1min":0.64300000000000002,"5min":0.41799999999999998,"15min":0.377},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":2.7389999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.72799999999999998,"15min":0.75800000000000001},"min":{"1min":0.61799999999999999,"5min":0.47299999999999998,"15min":0.39700000000000002},"max":{"1min":0.89500000000000002,"5min":1.304,"15min":1.304},"last":0.78000000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63800000000000001,"15min":0.627},"min":{"1min":0.49399999999999999,"5min":0.38,"15min":0.28599999999999998},"max":{"1min":0.871,"5min":1.129,"15min":1.129},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66600000000000004,"15min":0.68000000000000005},"min":{"1min":0.499,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85899999999999999,"5min":0.86799999999999999,"15min":2.7719999999999998},"last":0.71899999999999997}]},{"osd":6,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59399999999999997,"15min":0.60599999999999998},"min":{"1min":0.46500000000000002,"5min":0.34599999999999997,"15min":0.32700000000000001},"max":{"1min":0.68300000000000005,"5min":1.169,"15min":1.169},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.47999999999999998,"5min":0.39400000000000002,"15min":0.34300000000000003},"max":{"1min":0.83999999999999997,"5min":1.238,"15min":1.238},"last":0.61899999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.45400000000000001,"5min":0.36899999999999999,"15min":0.32900000000000001},"max":{"1min":0.92200000000000004,"5min":1.026,"15min":3.0230000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67200000000000004,"15min":0.67500000000000004},"min":{"1min":0.46500000000000002,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.85099999999999998,"5min":1.2589999999999999,"15min":1.407},"last":0.65200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575073,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":1508,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":1544192,"data_stored":781566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.70199999999999996,"15min":0.72799999999999998},"min":{"1min":0.53800000000000003,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":1.411},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72799999999999998,"15min":0.73099999999999998},"min":{"1min":0.46999999999999997,"5min":0.45100000000000001,"15min":0.435},"max":{"1min":0.88,"5min":1.0089999999999999,"15min":1.1200000000000001},"last":0.91500000000000004}]},{"osd":1,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72799999999999998,"15min":0.746},"min":{"1min":0.53100000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89300000000000002,"5min":0.94699999999999995,"15min":1.077},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71499999999999997,"15min":0.73299999999999998},"min":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89800000000000002,"5min":0.96399999999999997,"15min":1.0469999999999999},"last":0.94999999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71499999999999997,"15min":0.73099999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.35199999999999998},"max":{"1min":0.872,"5min":0.96499999999999997,"15min":1.091},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.77000000000000002},"min":{"1min":0.63200000000000001,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.86299999999999999,"5min":1.04,"15min":1.387},"last":0.83199999999999996}]},{"osd":3,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72699999999999998,"15min":0.74399999999999999},"min":{"1min":0.53200000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89400000000000002,"5min":0.997,"15min":1.008},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.748,"15min":0.76800000000000002},"min":{"1min":0.51400000000000001,"5min":0.47499999999999998,"15min":0.46800000000000003},"max":{"1min":1.002,"5min":1.002,"15min":1.0589999999999999},"last":0.93100000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.378},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":1.0029999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.64500000000000002,"15min":0.622},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.34599999999999997},"max":{"1min":0.79600000000000004,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.60099999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.34899999999999998,"15min":0.32300000000000001},"max":{"1min":0.876,"5min":0.96999999999999997,"15min":1.014},"last":0.626},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.374},"max":{"1min":0.85199999999999998,"5min":0.98299999999999998,"15min":1.0289999999999999},"last":0.73999999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70799999999999996,"15min":0.67300000000000004},"min":{"1min":0.55300000000000005,"5min":0.502,"15min":0.39000000000000001},"max":{"1min":0.84899999999999998,"5min":1.0049999999999999,"15min":1.0349999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.50700000000000001,"5min":0.42799999999999999,"15min":0.36899999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0629999999999999},"last":0.71299999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575073,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36640,"kb_used_data":1496,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335200,"statfs":{"total":96636764160,"available":96599244800,"internally_reserved":0,"allocated":1531904,"data_stored":774938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45300000000000001,"15min":0.44900000000000001},"min":{"1min":0.34799999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.59999999999999998,"5min":0.78600000000000003,"15min":0.84199999999999997},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.51100000000000001,"15min":0.51400000000000001},"min":{"1min":0.33200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.40699999999999997}]},{"osd":1,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.378,"5min":0.32000000000000001,"15min":0.315},"max":{"1min":0.67800000000000005,"5min":0.873,"15min":0.873},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.53700000000000003,"15min":0.54100000000000004},"min":{"1min":0.41699999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.753,"5min":0.753,"15min":1.0029999999999999},"last":0.36099999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56100000000000005,"15min":0.57199999999999995},"min":{"1min":0.44400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.90400000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.47599999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88100000000000001,"5min":1.02,"15min":1.663},"last":0.42899999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.75900000000000001,"15min":0.75700000000000001},"min":{"1min":0.56200000000000006,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":0.96899999999999997,"5min":1.151,"15min":1.284},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.78100000000000003,"15min":0.78200000000000003},"min":{"1min":0.60499999999999998,"5min":0.51900000000000002,"15min":0.47699999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.79300000000000004,"15min":0.79200000000000004},"min":{"1min":0.60399999999999998,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.306},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.60899999999999999,"5min":0.55000000000000004,"15min":0.372},"max":{"1min":1.018,"5min":1.1870000000000001,"15min":1.2470000000000001},"last":0.52000000000000002}]},{"osd":6,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77300000000000002,"15min":0.77200000000000002},"min":{"1min":0.52400000000000002,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.117},"last":0.629},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.80600000000000005,"15min":0.81399999999999995},"min":{"1min":0.63700000000000001,"5min":0.56299999999999994,"15min":0.54200000000000004},"max":{"1min":1.1000000000000001,"5min":1.129,"15min":1.2589999999999999},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81100000000000005,"15min":0.83199999999999996},"min":{"1min":0.66100000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.095,"5min":1.1519999999999999,"15min":2.4910000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.81200000000000006,"15min":0.82299999999999995},"min":{"1min":0.65100000000000002,"5min":0.53500000000000003,"15min":0.51600000000000001},"max":{"1min":1.1359999999999999,"5min":1.1379999999999999,"15min":1.595},"last":0.65000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575073,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58792,"kb_used_data":1504,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313048,"statfs":{"total":96636764160,"available":96576561152,"internally_reserved":0,"allocated":1540096,"data_stored":780547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.35499999999999998,"5min":0.29199999999999998,"15min":0.24199999999999999},"max":{"1min":0.75700000000000001,"5min":0.84699999999999998,"15min":1.3169999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51400000000000001,"15min":0.53500000000000003},"min":{"1min":0.372,"5min":0.318,"15min":0.318},"max":{"1min":0.69899999999999995,"5min":0.80800000000000005,"15min":2.5270000000000001},"last":0.51100000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46700000000000003,"15min":0.47299999999999998},"min":{"1min":0.34200000000000003,"5min":0.30399999999999999,"15min":0.29999999999999999},"max":{"1min":0.72599999999999998,"5min":0.77200000000000002,"15min":2.7200000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.52800000000000002,"15min":0.56200000000000006},"min":{"1min":0.46400000000000002,"5min":0.36299999999999999,"15min":0.35999999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":2.6110000000000002},"last":0.45800000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55700000000000005,"15min":0.60399999999999998},"min":{"1min":0.5,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70699999999999996,"5min":0.81899999999999995,"15min":8.2530000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53800000000000003,"15min":0.55200000000000005},"min":{"1min":0.44400000000000001,"5min":0.36899999999999999,"15min":0.33300000000000002},"max":{"1min":0.65700000000000003,"5min":0.89600000000000002,"15min":1.2150000000000001},"last":0.52900000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.753,"15min":0.77800000000000002},"min":{"1min":0.57299999999999995,"5min":0.53200000000000003,"15min":0.48399999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.1499999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.747,"15min":0.79100000000000004},"min":{"1min":0.60399999999999998,"5min":0.52900000000000003,"15min":0.47999999999999998},"max":{"1min":1.03,"5min":1.0629999999999999,"15min":2.3170000000000002},"last":0.72299999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.81000000000000005,"15min":0.85499999999999998},"min":{"1min":0.65500000000000003,"5min":0.56399999999999995,"15min":0.49399999999999999},"max":{"1min":1.087,"5min":1.1319999999999999,"15min":3.1139999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.79800000000000004,"15min":0.84099999999999997},"min":{"1min":0.61799999999999999,"5min":0.56200000000000006,"15min":0.433},"max":{"1min":1.0940000000000001,"5min":1.153,"15min":2.6850000000000001},"last":0.93100000000000005}]},{"osd":6,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.751,"15min":0.79900000000000004},"min":{"1min":0.65200000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.038,"5min":1.038,"15min":3.9849999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.76900000000000002,"15min":0.81100000000000005},"min":{"1min":0.627,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1100000000000001,"5min":1.1419999999999999,"15min":3.391},"last":0.97099999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.77100000000000002,"15min":0.81799999999999995},"min":{"1min":0.56000000000000005,"5min":0.52300000000000002,"15min":0.5},"max":{"1min":1.0549999999999999,"5min":1.1759999999999999,"15min":2.5779999999999998},"last":1.022},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.78900000000000003,"15min":0.82199999999999995},"min":{"1min":0.57499999999999996,"5min":0.52800000000000002,"15min":0.50900000000000001},"max":{"1min":1.0529999999999999,"5min":1.0940000000000001,"15min":2.5939999999999999},"last":0.83199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575074,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36652,"kb_used_data":1508,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335188,"statfs":{"total":96636764160,"available":96599232512,"internally_reserved":0,"allocated":1544192,"data_stored":781566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.435,"15min":0.433},"min":{"1min":0.29199999999999998,"5min":0.28399999999999997,"15min":0.26100000000000001},"max":{"1min":0.63900000000000001,"5min":0.65400000000000003,"15min":0.77200000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.88900000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.48099999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46300000000000002,"15min":0.47199999999999998},"min":{"1min":0.371,"5min":0.317,"15min":0.317},"max":{"1min":0.67300000000000004,"5min":0.69199999999999995,"15min":1.0409999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.39400000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":1.014},"last":0.61899999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60899999999999999,"15min":0.63200000000000001},"min":{"1min":0.45000000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.76300000000000001,"5min":0.80300000000000005,"15min":0.96299999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.57399999999999995},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79200000000000004,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.54100000000000004}]},{"osd":4,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76900000000000002,"15min":0.78700000000000003},"min":{"1min":0.56799999999999995,"5min":0.51200000000000001,"15min":0.48899999999999999},"max":{"1min":0.98199999999999998,"5min":1.2110000000000001,"15min":1.236},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.63,"5min":0.54700000000000004,"15min":0.502},"max":{"1min":1,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.873}]},{"osd":5,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.45200000000000001},"max":{"1min":1.097,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.63700000000000001,"5min":0.51500000000000001,"15min":0.48599999999999999},"max":{"1min":0.99099999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.78200000000000003}]},{"osd":6,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.56599999999999995,"5min":0.53800000000000003,"15min":0.503},"max":{"1min":1.071,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.81399999999999995,"15min":0.81699999999999995},"min":{"1min":0.56399999999999995,"5min":0.497,"15min":0.497},"max":{"1min":1.0880000000000001,"5min":1.262,"15min":1.262},"last":0.81200000000000006}]},{"osd":7,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.80000000000000004,"15min":0.80200000000000005},"min":{"1min":0.61599999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.048,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.878,"5min":0.83299999999999996,"15min":0.84499999999999997},"min":{"1min":0.68899999999999995,"5min":0.58499999999999996,"15min":0.52800000000000002},"max":{"1min":1.1160000000000001,"5min":1.327,"15min":1.327},"last":0.74099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575075,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37228,"kb_used_data":2084,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334612,"statfs":{"total":96636764160,"available":96598642688,"internally_reserved":0,"allocated":2134016,"data_stored":1370915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.33300000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":2.2450000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.48799999999999999,"15min":0.51100000000000001},"min":{"1min":0.35699999999999998,"5min":0.30099999999999999,"15min":0.27700000000000002},"max":{"1min":0.74199999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.36699999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.495,"15min":0.51200000000000001},"min":{"1min":0.35999999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.60799999999999998,"5min":0.84499999999999997,"15min":2.2989999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53200000000000003,"15min":0.55000000000000004},"min":{"1min":0.40400000000000003,"5min":0.34899999999999998,"15min":0.29899999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.90300000000000002},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.498,"15min":0.505},"min":{"1min":0.44400000000000001,"5min":0.32700000000000001,"15min":0.30299999999999999},"max":{"1min":0.58299999999999996,"5min":0.72999999999999998,"15min":0.84999999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56799999999999995,"15min":0.58799999999999997},"min":{"1min":0.47199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.71799999999999997,"5min":0.92700000000000005,"15min":2.4100000000000001},"last":0.54500000000000004}]},{"osd":4,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.745,"15min":0.78100000000000003},"min":{"1min":0.54500000000000004,"5min":0.48399999999999999,"15min":0.44400000000000001},"max":{"1min":1.0309999999999999,"5min":1.21,"15min":1.3640000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.75600000000000001,"15min":0.79500000000000004},"min":{"1min":0.60199999999999998,"5min":0.52300000000000002,"15min":0.44900000000000001},"max":{"1min":0.90000000000000002,"5min":1.0589999999999999,"15min":2.4460000000000002},"last":0.68300000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.751,"15min":0.79600000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.47899999999999998},"max":{"1min":0.95899999999999996,"5min":1.0669999999999999,"15min":1.3839999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.75900000000000001,"15min":0.79200000000000004},"min":{"1min":0.55800000000000005,"5min":0.5,"15min":0.47299999999999998},"max":{"1min":1.05,"5min":1.069,"15min":1.325},"last":0.69799999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76700000000000002,"15min":0.79800000000000004},"min":{"1min":0.63500000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.97499999999999998,"5min":1.05,"15min":2.3380000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.75800000000000001,"15min":0.80300000000000005},"min":{"1min":0.58599999999999997,"5min":0.51000000000000001,"15min":0.41299999999999998},"max":{"1min":1.012,"5min":1.0900000000000001,"15min":1.3440000000000001},"last":0.65700000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.77700000000000002,"15min":0.82199999999999995},"min":{"1min":0.58499999999999996,"5min":0.52800000000000002,"15min":0.45500000000000002},"max":{"1min":0.95299999999999996,"5min":1.1180000000000001,"15min":1.2749999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.75700000000000001,"15min":0.80400000000000005},"min":{"1min":0.60599999999999998,"5min":0.502,"15min":0.497},"max":{"1min":1.0640000000000001,"5min":1.0880000000000001,"15min":1.381},"last":0.73999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:11:33.472 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:11:33.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.615+0000 7fc8871fa640 1 Processor -- start 2023-07-14T13:11:33.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.615+0000 7fc8871fa640 1 -- start start 2023-07-14T13:11:33.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.615+0000 7fc8871fa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc8800d1840 0x7fc8800d0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.615+0000 7fc8871fa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8800b4840 con 0x7fc8800d12f0 2023-07-14T13:11:33.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.615+0000 7fc8871fa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8800ccae0 con 0x7fc8800b7990 2023-07-14T13:11:33.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.615+0000 7fc8871fa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8800cd060 con 0x7fc8800d1840 2023-07-14T13:11:33.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.615+0000 7fc87ffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc8800d12f0 0x7fc8800d1d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46078/0 (socket says 172.21.15.5:46078) 2023-07-14T13:11:33.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.615+0000 7fc87ffff640 1 -- 172.21.15.5:0/3490151855 learned_addr learned my addr 172.21.15.5:0/3490151855 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:33.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.619+0000 7fc885797640 1 --2- 172.21.15.5:0/3490151855 >> v2:172.21.15.154:3300/0 conn(0x7fc8800d1840 0x7fc8800d0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.619+0000 7fc87f7fe640 1 -- 172.21.15.5:0/3490151855 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105895944 0 0) 0x7fc8800b4840 con 0x7fc8800d12f0 2023-07-14T13:11:33.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.619+0000 7fc87f7fe640 1 -- 172.21.15.5:0/3490151855 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc870003530 con 0x7fc8800d12f0 2023-07-14T13:11:33.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.619+0000 7fc87f7fe640 1 -- 172.21.15.5:0/3490151855 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 276530504 0 0) 0x7fc870003530 con 0x7fc8800d12f0 2023-07-14T13:11:33.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.619+0000 7fc885797640 1 -- 172.21.15.5:0/3490151855 >> v1:172.21.15.154:6789/0 conn(0x7fc8800b7990 legacy=0x7fc88015f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:33.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.619+0000 7fc885797640 1 -- 172.21.15.5:0/3490151855 >> v1:172.21.15.5:6789/0 conn(0x7fc8800d12f0 legacy=0x7fc8800d1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:33.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.619+0000 7fc885797640 1 -- 172.21.15.5:0/3490151855 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc880160310 con 0x7fc8800d1840 2023-07-14T13:11:33.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.619+0000 7fc885797640 1 --2- 172.21.15.5:0/3490151855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8800d1840 0x7fc8800d0c40 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc878009d90 tx=0x7fc87801c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3abf951704e9224 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:33.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.619+0000 7fc87f7fe640 1 -- 172.21.15.5:0/3490151855 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c001680 con 0x7fc8800d1840 2023-07-14T13:11:33.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.619+0000 7fc87f7fe640 1 -- 172.21.15.5:0/3490151855 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8780a6430 con 0x7fc8800d1840 2023-07-14T13:11:33.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.619+0000 7fc87f7fe640 1 -- 172.21.15.5:0/3490151855 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8780a67a0 con 0x7fc8800d1840 2023-07-14T13:11:33.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.623+0000 7fc8871fa640 1 -- 172.21.15.5:0/3490151855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8800d1840 msgr2=0x7fc8800d0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:33.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.623+0000 7fc8871fa640 1 --2- 172.21.15.5:0/3490151855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8800d1840 0x7fc8800d0c40 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc878009d90 tx=0x7fc87801c7e0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.623+0000 7fc8871fa640 1 -- 172.21.15.5:0/3490151855 shutdown_connections 2023-07-14T13:11:33.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.623+0000 7fc8871fa640 1 --2- 172.21.15.5:0/3490151855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8800d1840 0x7fc8800d0c40 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.623+0000 7fc8871fa640 1 -- 172.21.15.5:0/3490151855 >> 172.21.15.5:0/3490151855 conn(0x7fc8800650b0 msgr2=0x7fc8800654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:33.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.623+0000 7fc8871fa640 1 -- 172.21.15.5:0/3490151855 shutdown_connections 2023-07-14T13:11:33.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.623+0000 7fc8871fa640 1 -- 172.21.15.5:0/3490151855 wait complete. 2023-07-14T13:11:33.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.623+0000 7fc8871fa640 1 Processor -- start 2023-07-14T13:11:33.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.623+0000 7fc8871fa640 1 -- start start 2023-07-14T13:11:33.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.623+0000 7fc8871fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8800b7990 0x7fc880154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.623+0000 7fc8871fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8800d12f0 0x7fc8800cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.623+0000 7fc8871fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8800d1840 0x7fc8800ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.623+0000 7fc8871fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8800ca2e0 con 0x7fc8800d1840 2023-07-14T13:11:33.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.623+0000 7fc8871fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88015ee90 con 0x7fc8800b7990 2023-07-14T13:11:33.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.623+0000 7fc8871fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8800cc230 con 0x7fc8800d12f0 2023-07-14T13:11:33.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.623+0000 7fc885797640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8800d1840 0x7fc8800ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.623+0000 7fc885797640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8800d1840 0x7fc8800ca700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57428/0 (socket says 172.21.15.5:57428) 2023-07-14T13:11:33.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.623+0000 7fc885797640 1 -- 172.21.15.5:0/1899334625 learned_addr learned my addr 172.21.15.5:0/1899334625 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:33.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.627+0000 7fc884f96640 1 --2- 172.21.15.5:0/1899334625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8800b7990 0x7fc880154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.627+0000 7fc885797640 1 -- 172.21.15.5:0/1899334625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8800d12f0 msgr2=0x7fc8800cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:33.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.627+0000 7fc885797640 1 --2- 172.21.15.5:0/1899334625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8800d12f0 0x7fc8800cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.627+0000 7fc885797640 1 -- 172.21.15.5:0/1899334625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8800b7990 msgr2=0x7fc880154e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:33.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.627+0000 7fc885797640 1 --2- 172.21.15.5:0/1899334625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8800b7990 0x7fc880154e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.627+0000 7fc885797640 1 -- 172.21.15.5:0/1899334625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc878009a70 con 0x7fc8800d1840 2023-07-14T13:11:33.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.627+0000 7fc884f96640 1 --2- 172.21.15.5:0/1899334625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8800b7990 0x7fc880154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:11:33.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.627+0000 7fc885797640 1 --2- 172.21.15.5:0/1899334625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8800d1840 0x7fc8800ca700 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fc8780193f0 tx=0x7fc878019580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:33.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.627+0000 7fc87d7fa640 1 -- 172.21.15.5:0/1899334625 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8780044d0 con 0x7fc8800d1840 2023-07-14T13:11:33.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.627+0000 7fc87d7fa640 1 -- 172.21.15.5:0/1899334625 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8780b5070 con 0x7fc8800d1840 2023-07-14T13:11:33.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.627+0000 7fc87d7fa640 1 -- 172.21.15.5:0/1899334625 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc878004830 con 0x7fc8800d1840 2023-07-14T13:11:33.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.627+0000 7fc8871fa640 1 -- 172.21.15.5:0/1899334625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc88015e8d0 con 0x7fc8800d1840 2023-07-14T13:11:33.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.627+0000 7fc8871fa640 1 -- 172.21.15.5:0/1899334625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8800c9f00 con 0x7fc8800d1840 2023-07-14T13:11:33.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.627+0000 7fc8871fa640 1 -- 172.21.15.5:0/1899334625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8800ca420 con 0x7fc8800d1840 2023-07-14T13:11:33.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.627+0000 7fc87d7fa640 1 -- 172.21.15.5:0/1899334625 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc8780a65a0 con 0x7fc8800d1840 2023-07-14T13:11:33.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.627+0000 7fc87d7fa640 1 --2- 172.21.15.5:0/1899334625 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fc8640663a0 0x7fc864068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.627+0000 7fc87d7fa640 1 -- 172.21.15.5:0/1899334625 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc87811eb60 con 0x7fc8800d1840 2023-07-14T13:11:33.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.631+0000 7fc884f96640 1 --2- 172.21.15.5:0/1899334625 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fc8640663a0 0x7fc864068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.631+0000 7fc884f96640 1 --2- 172.21.15.5:0/1899334625 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fc8640663a0 0x7fc864068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc874000f70 tx=0x7fc874009040 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:33.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.631+0000 7fc87d7fa640 1 -- 172.21.15.5:0/1899334625 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc8800ca420 con 0x7fc8800d1840 2023-07-14T13:11:33.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.783+0000 7fc8871fa640 1 -- 172.21.15.5:0/1899334625 --> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc8801605f0 con 0x7fc8640663a0 2023-07-14T13:11:33.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.791+0000 7fc87d7fa640 1 -- 172.21.15.5:0/1899334625 <== mgr.7657 v2:172.21.15.154:6832/938367911 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306369 (secure 0 0 0) 0x7fc87400d520 con 0x7fc8640663a0 2023-07-14T13:11:33.828 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:11:33.829 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:11:33.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.795+0000 7fc8871fa640 1 -- 172.21.15.5:0/1899334625 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fc8640663a0 msgr2=0x7fc864068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:33.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.795+0000 7fc8871fa640 1 --2- 172.21.15.5:0/1899334625 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fc8640663a0 0x7fc864068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc874000f70 tx=0x7fc874009040 comp rx=0 tx=0).stop 2023-07-14T13:11:33.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.795+0000 7fc8871fa640 1 -- 172.21.15.5:0/1899334625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8800d1840 msgr2=0x7fc8800ca700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:33.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.795+0000 7fc8871fa640 1 --2- 172.21.15.5:0/1899334625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8800d1840 0x7fc8800ca700 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fc8780193f0 tx=0x7fc878019580 comp rx=0 tx=0).stop 2023-07-14T13:11:33.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.795+0000 7fc8871fa640 1 -- 172.21.15.5:0/1899334625 shutdown_connections 2023-07-14T13:11:33.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.795+0000 7fc8871fa640 1 --2- 172.21.15.5:0/1899334625 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fc8640663a0 0x7fc864068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.795+0000 7fc8871fa640 1 --2- 172.21.15.5:0/1899334625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8800d1840 0x7fc8800ca700 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.795+0000 7fc8871fa640 1 --2- 172.21.15.5:0/1899334625 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8800d12f0 0x7fc8800cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.795+0000 7fc8871fa640 1 --2- 172.21.15.5:0/1899334625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8800b7990 0x7fc880154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.795+0000 7fc8871fa640 1 -- 172.21.15.5:0/1899334625 >> 172.21.15.5:0/1899334625 conn(0x7fc8800650b0 msgr2=0x7fc8800ce500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:33.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.795+0000 7fc8871fa640 1 -- 172.21.15.5:0/1899334625 shutdown_connections 2023-07-14T13:11:33.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:33.795+0000 7fc8871fa640 1 -- 172.21.15.5:0/1899334625 wait complete. 2023-07-14T13:11:33.848 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-14T13:11:32.582052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":340308,"kb_used_data":13204,"kb_used_omap":0,"kb_used_meta":327040,"kb_avail":754634412,"statfs":{"total":773094113280,"available":772745637888,"internally_reserved":0,"allocated":13520896,"data_stored":7424598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":334888960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.698344"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.895795+0000","last_change":"2023-07-14T13:11:27.895795+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.895795+0000","last_undegraded":"2023-07-14T13:11:27.895795+0000","last_fullsized":"2023-07-14T13:11:27.895795+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.907157+0000","last_change":"2023-07-14T13:11:27.907157+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.907157+0000","last_undegraded":"2023-07-14T13:11:27.907157+0000","last_fullsized":"2023-07-14T13:11:27.907157+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896573+0000","last_change":"2023-07-14T13:11:27.896573+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896573+0000","last_undegraded":"2023-07-14T13:11:27.896573+0000","last_fullsized":"2023-07-14T13:11:27.896573+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.892922+0000","last_change":"2023-07-14T13:11:27.892922+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.892922+0000","last_undegraded":"2023-07-14T13:11:27.892922+0000","last_fullsized":"2023-07-14T13:11:27.892922+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.895434+0000","last_change":"2023-07-14T13:11:27.895434+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.895434+0000","last_undegraded":"2023-07-14T13:11:27.895434+0000","last_fullsized":"2023-07-14T13:11:27.895434+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.905271+0000","last_change":"2023-07-14T13:11:27.905271+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.905271+0000","last_undegraded":"2023-07-14T13:11:27.905271+0000","last_fullsized":"2023-07-14T13:11:27.905271+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.904249+0000","last_change":"2023-07-14T13:11:27.904249+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.904249+0000","last_undegraded":"2023-07-14T13:11:27.904249+0000","last_fullsized":"2023-07-14T13:11:27.904249+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.897193+0000","last_change":"2023-07-14T13:11:27.897193+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.897193+0000","last_undegraded":"2023-07-14T13:11:27.897193+0000","last_fullsized":"2023-07-14T13:11:27.897193+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.907895+0000","last_change":"2023-07-14T13:11:27.907895+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.907895+0000","last_undegraded":"2023-07-14T13:11:27.907895+0000","last_fullsized":"2023-07-14T13:11:27.907895+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.893865+0000","last_change":"2023-07-14T13:11:27.893865+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.893865+0000","last_undegraded":"2023-07-14T13:11:27.893865+0000","last_fullsized":"2023-07-14T13:11:27.893865+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.901834+0000","last_change":"2023-07-14T13:11:27.901834+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.901834+0000","last_undegraded":"2023-07-14T13:11:27.901834+0000","last_fullsized":"2023-07-14T13:11:27.901834+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.894943+0000","last_change":"2023-07-14T13:11:27.894943+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.894943+0000","last_undegraded":"2023-07-14T13:11:27.894943+0000","last_fullsized":"2023-07-14T13:11:27.894943+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.891406+0000","last_change":"2023-07-14T13:11:27.891406+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.891406+0000","last_undegraded":"2023-07-14T13:11:27.891406+0000","last_fullsized":"2023-07-14T13:11:27.891406+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896301+0000","last_change":"2023-07-14T13:11:27.896301+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896301+0000","last_undegraded":"2023-07-14T13:11:27.896301+0000","last_fullsized":"2023-07-14T13:11:27.896301+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896227+0000","last_change":"2023-07-14T13:11:27.896227+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896227+0000","last_undegraded":"2023-07-14T13:11:27.896227+0000","last_fullsized":"2023-07-14T13:11:27.896227+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896163+0000","last_change":"2023-07-14T13:11:27.896163+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896163+0000","last_undegraded":"2023-07-14T13:11:27.896163+0000","last_fullsized":"2023-07-14T13:11:27.896163+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.895290+0000","last_change":"2023-07-14T13:11:27.895290+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.895290+0000","last_undegraded":"2023-07-14T13:11:27.895290+0000","last_fullsized":"2023-07-14T13:11:27.895290+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.906686+0000","last_change":"2023-07-14T13:11:27.906686+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.906686+0000","last_undegraded":"2023-07-14T13:11:27.906686+0000","last_fullsized":"2023-07-14T13:11:27.906686+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896085+0000","last_change":"2023-07-14T13:11:27.896085+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896085+0000","last_undegraded":"2023-07-14T13:11:27.896085+0000","last_fullsized":"2023-07-14T13:11:27.896085+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.892998+0000","last_change":"2023-07-14T13:11:27.892998+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.892998+0000","last_undegraded":"2023-07-14T13:11:27.892998+0000","last_fullsized":"2023-07-14T13:11:27.892998+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896165+0000","last_change":"2023-07-14T13:11:27.896165+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896165+0000","last_undegraded":"2023-07-14T13:11:27.896165+0000","last_fullsized":"2023-07-14T13:11:27.896165+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.897491+0000","last_change":"2023-07-14T13:11:27.897491+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.897491+0000","last_undegraded":"2023-07-14T13:11:27.897491+0000","last_fullsized":"2023-07-14T13:11:27.897491+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.890634+0000","last_change":"2023-07-14T13:11:27.890634+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.890634+0000","last_undegraded":"2023-07-14T13:11:27.890634+0000","last_fullsized":"2023-07-14T13:11:27.890634+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.895068+0000","last_change":"2023-07-14T13:11:27.895068+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.895068+0000","last_undegraded":"2023-07-14T13:11:27.895068+0000","last_fullsized":"2023-07-14T13:11:27.895068+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.892645+0000","last_change":"2023-07-14T13:11:27.892645+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.892645+0000","last_undegraded":"2023-07-14T13:11:27.892645+0000","last_fullsized":"2023-07-14T13:11:27.892645+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.894405+0000","last_change":"2023-07-14T13:11:27.894405+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.894405+0000","last_undegraded":"2023-07-14T13:11:27.894405+0000","last_fullsized":"2023-07-14T13:11:27.894405+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.901319+0000","last_change":"2023-07-14T13:11:27.901319+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.901319+0000","last_undegraded":"2023-07-14T13:11:27.901319+0000","last_fullsized":"2023-07-14T13:11:27.901319+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.907554+0000","last_change":"2023-07-14T13:11:27.907554+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.907554+0000","last_undegraded":"2023-07-14T13:11:27.907554+0000","last_fullsized":"2023-07-14T13:11:27.907554+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.893622+0000","last_change":"2023-07-14T13:11:27.893622+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.893622+0000","last_undegraded":"2023-07-14T13:11:27.893622+0000","last_fullsized":"2023-07-14T13:11:27.893622+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.894205+0000","last_change":"2023-07-14T13:11:27.894205+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.894205+0000","last_undegraded":"2023-07-14T13:11:27.894205+0000","last_fullsized":"2023-07-14T13:11:27.894205+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.903653+0000","last_change":"2023-07-14T13:11:27.903653+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.903653+0000","last_undegraded":"2023-07-14T13:11:27.903653+0000","last_fullsized":"2023-07-14T13:11:27.903653+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896718+0000","last_change":"2023-07-14T13:11:27.896718+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896718+0000","last_undegraded":"2023-07-14T13:11:27.896718+0000","last_fullsized":"2023-07-14T13:11:27.896718+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.890117+0000","last_change":"2023-07-14T13:11:27.890117+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.890117+0000","last_undegraded":"2023-07-14T13:11:27.890117+0000","last_fullsized":"2023-07-14T13:11:27.890117+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.914043+0000","last_change":"2023-07-14T13:11:27.912001+0000","last_active":"2023-07-14T13:11:27.914043+0000","last_peered":"2023-07-14T13:11:27.914043+0000","last_clean":"2023-07-14T13:11:27.914043+0000","last_became_active":"2023-07-14T13:11:27.911416+0000","last_became_peered":"2023-07-14T13:11:27.911416+0000","last_unstale":"2023-07-14T13:11:27.914043+0000","last_undegraded":"2023-07-14T13:11:27.914043+0000","last_fullsized":"2023-07-14T13:11:27.914043+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:06:23.094335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.892755+0000","last_change":"2023-07-14T13:11:27.892755+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.892755+0000","last_undegraded":"2023-07-14T13:11:27.892755+0000","last_fullsized":"2023-07-14T13:11:27.892755+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.912220+0000","last_change":"2023-07-14T13:11:27.908608+0000","last_active":"2023-07-14T13:11:27.912220+0000","last_peered":"2023-07-14T13:11:27.912220+0000","last_clean":"2023-07-14T13:11:27.912220+0000","last_became_active":"2023-07-14T13:11:27.908336+0000","last_became_peered":"2023-07-14T13:11:27.908336+0000","last_unstale":"2023-07-14T13:11:27.912220+0000","last_undegraded":"2023-07-14T13:11:27.912220+0000","last_fullsized":"2023-07-14T13:11:27.912220+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:41:02.058425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.892949+0000","last_change":"2023-07-14T13:11:27.892949+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.892949+0000","last_undegraded":"2023-07-14T13:11:27.892949+0000","last_fullsized":"2023-07-14T13:11:27.892949+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.911273+0000","last_change":"2023-07-14T13:11:27.909451+0000","last_active":"2023-07-14T13:11:27.911273+0000","last_peered":"2023-07-14T13:11:27.911273+0000","last_clean":"2023-07-14T13:11:27.911273+0000","last_became_active":"2023-07-14T13:11:27.909180+0000","last_became_peered":"2023-07-14T13:11:27.909180+0000","last_unstale":"2023-07-14T13:11:27.911273+0000","last_undegraded":"2023-07-14T13:11:27.911273+0000","last_fullsized":"2023-07-14T13:11:27.911273+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:17:10.167032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.897580+0000","last_change":"2023-07-14T13:11:27.897580+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.897580+0000","last_undegraded":"2023-07-14T13:11:27.897580+0000","last_fullsized":"2023-07-14T13:11:27.897580+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.907950+0000","last_change":"2023-07-14T13:11:27.902198+0000","last_active":"2023-07-14T13:11:27.907950+0000","last_peered":"2023-07-14T13:11:27.907950+0000","last_clean":"2023-07-14T13:11:27.907950+0000","last_became_active":"2023-07-14T13:11:27.901878+0000","last_became_peered":"2023-07-14T13:11:27.901878+0000","last_unstale":"2023-07-14T13:11:27.907950+0000","last_undegraded":"2023-07-14T13:11:27.907950+0000","last_fullsized":"2023-07-14T13:11:27.907950+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:24:24.888974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.892486+0000","last_change":"2023-07-14T13:11:27.892486+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.892486+0000","last_undegraded":"2023-07-14T13:11:27.892486+0000","last_fullsized":"2023-07-14T13:11:27.892486+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.917311+0000","last_change":"2023-07-14T13:11:27.915760+0000","last_active":"2023-07-14T13:11:27.917311+0000","last_peered":"2023-07-14T13:11:27.917311+0000","last_clean":"2023-07-14T13:11:27.917311+0000","last_became_active":"2023-07-14T13:11:27.915444+0000","last_became_peered":"2023-07-14T13:11:27.915444+0000","last_unstale":"2023-07-14T13:11:27.917311+0000","last_undegraded":"2023-07-14T13:11:27.917311+0000","last_fullsized":"2023-07-14T13:11:27.917311+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:07:12.354729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.890139+0000","last_change":"2023-07-14T13:11:27.890139+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.890139+0000","last_undegraded":"2023-07-14T13:11:27.890139+0000","last_fullsized":"2023-07-14T13:11:27.890139+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.906142+0000","last_change":"2023-07-14T13:11:27.904817+0000","last_active":"2023-07-14T13:11:27.906142+0000","last_peered":"2023-07-14T13:11:27.906142+0000","last_clean":"2023-07-14T13:11:27.906142+0000","last_became_active":"2023-07-14T13:11:27.904417+0000","last_became_peered":"2023-07-14T13:11:27.904417+0000","last_unstale":"2023-07-14T13:11:27.906142+0000","last_undegraded":"2023-07-14T13:11:27.906142+0000","last_fullsized":"2023-07-14T13:11:27.906142+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:34:55.739790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.906115+0000","last_change":"2023-07-14T13:11:27.906115+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.906115+0000","last_undegraded":"2023-07-14T13:11:27.906115+0000","last_fullsized":"2023-07-14T13:11:27.906115+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.909872+0000","last_change":"2023-07-14T13:11:27.904887+0000","last_active":"2023-07-14T13:11:27.909872+0000","last_peered":"2023-07-14T13:11:27.909872+0000","last_clean":"2023-07-14T13:11:27.909872+0000","last_became_active":"2023-07-14T13:11:27.904566+0000","last_became_peered":"2023-07-14T13:11:27.904566+0000","last_unstale":"2023-07-14T13:11:27.909872+0000","last_undegraded":"2023-07-14T13:11:27.909872+0000","last_fullsized":"2023-07-14T13:11:27.909872+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:21:34.987957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.891818+0000","last_change":"2023-07-14T13:11:27.891818+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.891818+0000","last_undegraded":"2023-07-14T13:11:27.891818+0000","last_fullsized":"2023-07-14T13:11:27.891818+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.909052+0000","last_change":"2023-07-14T13:11:27.903404+0000","last_active":"2023-07-14T13:11:27.909052+0000","last_peered":"2023-07-14T13:11:27.909052+0000","last_clean":"2023-07-14T13:11:27.909052+0000","last_became_active":"2023-07-14T13:11:27.903115+0000","last_became_peered":"2023-07-14T13:11:27.903115+0000","last_unstale":"2023-07-14T13:11:27.909052+0000","last_undegraded":"2023-07-14T13:11:27.909052+0000","last_fullsized":"2023-07-14T13:11:27.909052+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:49.123489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.890934+0000","last_change":"2023-07-14T13:11:27.890934+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.890934+0000","last_undegraded":"2023-07-14T13:11:27.890934+0000","last_fullsized":"2023-07-14T13:11:27.890934+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.909707+0000","last_change":"2023-07-14T13:11:27.904996+0000","last_active":"2023-07-14T13:11:27.909707+0000","last_peered":"2023-07-14T13:11:27.909707+0000","last_clean":"2023-07-14T13:11:27.909707+0000","last_became_active":"2023-07-14T13:11:27.904702+0000","last_became_peered":"2023-07-14T13:11:27.904702+0000","last_unstale":"2023-07-14T13:11:27.909707+0000","last_undegraded":"2023-07-14T13:11:27.909707+0000","last_fullsized":"2023-07-14T13:11:27.909707+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:44.896082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.897030+0000","last_change":"2023-07-14T13:11:27.897030+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.897030+0000","last_undegraded":"2023-07-14T13:11:27.897030+0000","last_fullsized":"2023-07-14T13:11:27.897030+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.905277+0000","last_change":"2023-07-14T13:11:27.900517+0000","last_active":"2023-07-14T13:11:27.905277+0000","last_peered":"2023-07-14T13:11:27.905277+0000","last_clean":"2023-07-14T13:11:27.905277+0000","last_became_active":"2023-07-14T13:11:27.900219+0000","last_became_peered":"2023-07-14T13:11:27.900219+0000","last_unstale":"2023-07-14T13:11:27.905277+0000","last_undegraded":"2023-07-14T13:11:27.905277+0000","last_fullsized":"2023-07-14T13:11:27.905277+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:35:12.791399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.892585+0000","last_change":"2023-07-14T13:11:27.892585+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.892585+0000","last_undegraded":"2023-07-14T13:11:27.892585+0000","last_fullsized":"2023-07-14T13:11:27.892585+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.915102+0000","last_change":"2023-07-14T13:11:27.911972+0000","last_active":"2023-07-14T13:11:27.915102+0000","last_peered":"2023-07-14T13:11:27.915102+0000","last_clean":"2023-07-14T13:11:27.915102+0000","last_became_active":"2023-07-14T13:11:27.911403+0000","last_became_peered":"2023-07-14T13:11:27.911403+0000","last_unstale":"2023-07-14T13:11:27.915102+0000","last_undegraded":"2023-07-14T13:11:27.915102+0000","last_fullsized":"2023-07-14T13:11:27.915102+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:06:40.624907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.894417+0000","last_change":"2023-07-14T13:11:27.894417+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.894417+0000","last_undegraded":"2023-07-14T13:11:27.894417+0000","last_fullsized":"2023-07-14T13:11:27.894417+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.916428+0000","last_change":"2023-07-14T13:11:27.910905+0000","last_active":"2023-07-14T13:11:27.916428+0000","last_peered":"2023-07-14T13:11:27.916428+0000","last_clean":"2023-07-14T13:11:27.916428+0000","last_became_active":"2023-07-14T13:11:27.910550+0000","last_became_peered":"2023-07-14T13:11:27.910550+0000","last_unstale":"2023-07-14T13:11:27.916428+0000","last_undegraded":"2023-07-14T13:11:27.916428+0000","last_fullsized":"2023-07-14T13:11:27.916428+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:39:22.376019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.897040+0000","last_change":"2023-07-14T13:11:27.897040+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.897040+0000","last_undegraded":"2023-07-14T13:11:27.897040+0000","last_fullsized":"2023-07-14T13:11:27.897040+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.909316+0000","last_change":"2023-07-14T13:11:27.907025+0000","last_active":"2023-07-14T13:11:27.909316+0000","last_peered":"2023-07-14T13:11:27.909316+0000","last_clean":"2023-07-14T13:11:27.909316+0000","last_became_active":"2023-07-14T13:11:27.906711+0000","last_became_peered":"2023-07-14T13:11:27.906711+0000","last_unstale":"2023-07-14T13:11:27.909316+0000","last_undegraded":"2023-07-14T13:11:27.909316+0000","last_fullsized":"2023-07-14T13:11:27.909316+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:14:56.592264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.908446+0000","last_change":"2023-07-14T13:11:27.908446+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.908446+0000","last_undegraded":"2023-07-14T13:11:27.908446+0000","last_fullsized":"2023-07-14T13:11:27.908446+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.909012+0000","last_change":"2023-07-14T13:11:27.905683+0000","last_active":"2023-07-14T13:11:27.909012+0000","last_peered":"2023-07-14T13:11:27.909012+0000","last_clean":"2023-07-14T13:11:27.909012+0000","last_became_active":"2023-07-14T13:11:27.905382+0000","last_became_peered":"2023-07-14T13:11:27.905382+0000","last_unstale":"2023-07-14T13:11:27.909012+0000","last_undegraded":"2023-07-14T13:11:27.909012+0000","last_fullsized":"2023-07-14T13:11:27.909012+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:43:45.681385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896451+0000","last_change":"2023-07-14T13:11:27.896451+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896451+0000","last_undegraded":"2023-07-14T13:11:27.896451+0000","last_fullsized":"2023-07-14T13:11:27.896451+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.902777+0000","last_change":"2023-07-14T13:11:27.899284+0000","last_active":"2023-07-14T13:11:27.902777+0000","last_peered":"2023-07-14T13:11:27.902777+0000","last_clean":"2023-07-14T13:11:27.902777+0000","last_became_active":"2023-07-14T13:11:27.899000+0000","last_became_peered":"2023-07-14T13:11:27.899000+0000","last_unstale":"2023-07-14T13:11:27.902777+0000","last_undegraded":"2023-07-14T13:11:27.902777+0000","last_fullsized":"2023-07-14T13:11:27.902777+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:58:20.832900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.890579+0000","last_change":"2023-07-14T13:11:27.890579+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.890579+0000","last_undegraded":"2023-07-14T13:11:27.890579+0000","last_fullsized":"2023-07-14T13:11:27.890579+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.905742+0000","last_change":"2023-07-14T13:11:27.903246+0000","last_active":"2023-07-14T13:11:27.905742+0000","last_peered":"2023-07-14T13:11:27.905742+0000","last_clean":"2023-07-14T13:11:27.905742+0000","last_became_active":"2023-07-14T13:11:27.902770+0000","last_became_peered":"2023-07-14T13:11:27.902770+0000","last_unstale":"2023-07-14T13:11:27.905742+0000","last_undegraded":"2023-07-14T13:11:27.905742+0000","last_fullsized":"2023-07-14T13:11:27.905742+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:50:25.947325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.891456+0000","last_change":"2023-07-14T13:11:27.891456+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.891456+0000","last_undegraded":"2023-07-14T13:11:27.891456+0000","last_fullsized":"2023-07-14T13:11:27.891456+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.909255+0000","last_change":"2023-07-14T13:11:27.907026+0000","last_active":"2023-07-14T13:11:27.909255+0000","last_peered":"2023-07-14T13:11:27.909255+0000","last_clean":"2023-07-14T13:11:27.909255+0000","last_became_active":"2023-07-14T13:11:27.906738+0000","last_became_peered":"2023-07-14T13:11:27.906738+0000","last_unstale":"2023-07-14T13:11:27.909255+0000","last_undegraded":"2023-07-14T13:11:27.909255+0000","last_fullsized":"2023-07-14T13:11:27.909255+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:32:25.336512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.892862+0000","last_change":"2023-07-14T13:11:27.892862+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.892862+0000","last_undegraded":"2023-07-14T13:11:27.892862+0000","last_fullsized":"2023-07-14T13:11:27.892862+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.905879+0000","last_change":"2023-07-14T13:11:27.902133+0000","last_active":"2023-07-14T13:11:27.905879+0000","last_peered":"2023-07-14T13:11:27.905879+0000","last_clean":"2023-07-14T13:11:27.905879+0000","last_became_active":"2023-07-14T13:11:27.901863+0000","last_became_peered":"2023-07-14T13:11:27.901863+0000","last_unstale":"2023-07-14T13:11:27.905879+0000","last_undegraded":"2023-07-14T13:11:27.905879+0000","last_fullsized":"2023-07-14T13:11:27.905879+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:43:08.536956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.893258+0000","last_change":"2023-07-14T13:11:27.893258+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.893258+0000","last_undegraded":"2023-07-14T13:11:27.893258+0000","last_fullsized":"2023-07-14T13:11:27.893258+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.920078+0000","last_change":"2023-07-14T13:11:27.917285+0000","last_active":"2023-07-14T13:11:27.920078+0000","last_peered":"2023-07-14T13:11:27.920078+0000","last_clean":"2023-07-14T13:11:27.920078+0000","last_became_active":"2023-07-14T13:11:27.916997+0000","last_became_peered":"2023-07-14T13:11:27.916997+0000","last_unstale":"2023-07-14T13:11:27.920078+0000","last_undegraded":"2023-07-14T13:11:27.920078+0000","last_fullsized":"2023-07-14T13:11:27.920078+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:41:18.620557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.899765+0000","last_change":"2023-07-14T13:11:27.899765+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.899765+0000","last_undegraded":"2023-07-14T13:11:27.899765+0000","last_fullsized":"2023-07-14T13:11:27.899765+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.912804+0000","last_change":"2023-07-14T13:11:27.911728+0000","last_active":"2023-07-14T13:11:27.912804+0000","last_peered":"2023-07-14T13:11:27.912804+0000","last_clean":"2023-07-14T13:11:27.912804+0000","last_became_active":"2023-07-14T13:11:27.911418+0000","last_became_peered":"2023-07-14T13:11:27.911418+0000","last_unstale":"2023-07-14T13:11:27.912804+0000","last_undegraded":"2023-07-14T13:11:27.912804+0000","last_fullsized":"2023-07-14T13:11:27.912804+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:20:43.667484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.897064+0000","last_change":"2023-07-14T13:11:27.897064+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.897064+0000","last_undegraded":"2023-07-14T13:11:27.897064+0000","last_fullsized":"2023-07-14T13:11:27.897064+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.914420+0000","last_change":"2023-07-14T13:11:27.911575+0000","last_active":"2023-07-14T13:11:27.914420+0000","last_peered":"2023-07-14T13:11:27.914420+0000","last_clean":"2023-07-14T13:11:27.914420+0000","last_became_active":"2023-07-14T13:11:27.911267+0000","last_became_peered":"2023-07-14T13:11:27.911267+0000","last_unstale":"2023-07-14T13:11:27.914420+0000","last_undegraded":"2023-07-14T13:11:27.914420+0000","last_fullsized":"2023-07-14T13:11:27.914420+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:25:31.252394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.897503+0000","last_change":"2023-07-14T13:11:27.897503+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.897503+0000","last_undegraded":"2023-07-14T13:11:27.897503+0000","last_fullsized":"2023-07-14T13:11:27.897503+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.906425+0000","last_change":"2023-07-14T13:11:27.902540+0000","last_active":"2023-07-14T13:11:27.906425+0000","last_peered":"2023-07-14T13:11:27.906425+0000","last_clean":"2023-07-14T13:11:27.906425+0000","last_became_active":"2023-07-14T13:11:27.902204+0000","last_became_peered":"2023-07-14T13:11:27.902204+0000","last_unstale":"2023-07-14T13:11:27.906425+0000","last_undegraded":"2023-07-14T13:11:27.906425+0000","last_fullsized":"2023-07-14T13:11:27.906425+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:13:17.808147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896887+0000","last_change":"2023-07-14T13:11:27.896887+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896887+0000","last_undegraded":"2023-07-14T13:11:27.896887+0000","last_fullsized":"2023-07-14T13:11:27.896887+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.915599+0000","last_change":"2023-07-14T13:11:27.913333+0000","last_active":"2023-07-14T13:11:27.915599+0000","last_peered":"2023-07-14T13:11:27.915599+0000","last_clean":"2023-07-14T13:11:27.915599+0000","last_became_active":"2023-07-14T13:11:27.912829+0000","last_became_peered":"2023-07-14T13:11:27.912829+0000","last_unstale":"2023-07-14T13:11:27.915599+0000","last_undegraded":"2023-07-14T13:11:27.915599+0000","last_fullsized":"2023-07-14T13:11:27.915599+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:19:04.528705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.899166+0000","last_change":"2023-07-14T13:11:27.899166+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.899166+0000","last_undegraded":"2023-07-14T13:11:27.899166+0000","last_fullsized":"2023-07-14T13:11:27.899166+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.904105+0000","last_change":"2023-07-14T13:11:27.899057+0000","last_active":"2023-07-14T13:11:27.904105+0000","last_peered":"2023-07-14T13:11:27.904105+0000","last_clean":"2023-07-14T13:11:27.904105+0000","last_became_active":"2023-07-14T13:11:27.898776+0000","last_became_peered":"2023-07-14T13:11:27.898776+0000","last_unstale":"2023-07-14T13:11:27.904105+0000","last_undegraded":"2023-07-14T13:11:27.904105+0000","last_fullsized":"2023-07-14T13:11:27.904105+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:27:27.592118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.896877+0000","last_change":"2023-07-14T13:11:27.896877+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.896877+0000","last_undegraded":"2023-07-14T13:11:27.896877+0000","last_fullsized":"2023-07-14T13:11:27.896877+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.912020+0000","last_change":"2023-07-14T13:11:27.908040+0000","last_active":"2023-07-14T13:11:27.912020+0000","last_peered":"2023-07-14T13:11:27.912020+0000","last_clean":"2023-07-14T13:11:27.912020+0000","last_became_active":"2023-07-14T13:11:27.907724+0000","last_became_peered":"2023-07-14T13:11:27.907724+0000","last_unstale":"2023-07-14T13:11:27.912020+0000","last_undegraded":"2023-07-14T13:11:27.912020+0000","last_fullsized":"2023-07-14T13:11:27.912020+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:39:03.219860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"115'227","reported_seq":748,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.898154+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:11:27.898154+0000","last_peered":"2023-07-14T13:11:27.898154+0000","last_clean":"2023-07-14T13:11:27.898154+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:11:27.898154+0000","last_undegraded":"2023-07-14T13:11:27.898154+0000","last_fullsized":"2023-07-14T13:11:27.898154+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:16:06.966073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":200,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.902725+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:11:27.902725+0000","last_peered":"2023-07-14T13:11:27.902725+0000","last_clean":"2023-07-14T13:11:27.902725+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:11:27.902725+0000","last_undegraded":"2023-07-14T13:11:27.902725+0000","last_fullsized":"2023-07-14T13:11:27.902725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:34:45.578849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.904732+0000","last_change":"2023-07-14T13:11:27.904732+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.904732+0000","last_undegraded":"2023-07-14T13:11:27.904732+0000","last_fullsized":"2023-07-14T13:11:27.904732+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.909643+0000","last_change":"2023-07-14T13:11:27.908313+0000","last_active":"2023-07-14T13:11:27.909643+0000","last_peered":"2023-07-14T13:11:27.909643+0000","last_clean":"2023-07-14T13:11:27.909643+0000","last_became_active":"2023-07-14T13:11:27.907979+0000","last_became_peered":"2023-07-14T13:11:27.907979+0000","last_unstale":"2023-07-14T13:11:27.909643+0000","last_undegraded":"2023-07-14T13:11:27.909643+0000","last_fullsized":"2023-07-14T13:11:27.909643+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:32:04.663850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":202,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.898025+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:11:27.898025+0000","last_peered":"2023-07-14T13:11:27.898025+0000","last_clean":"2023-07-14T13:11:27.898025+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:11:27.898025+0000","last_undegraded":"2023-07-14T13:11:27.898025+0000","last_fullsized":"2023-07-14T13:11:27.898025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:03:58.434300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.894928+0000","last_change":"2023-07-14T13:11:27.894928+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.894928+0000","last_undegraded":"2023-07-14T13:11:27.894928+0000","last_fullsized":"2023-07-14T13:11:27.894928+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.915342+0000","last_change":"2023-07-14T13:11:27.914507+0000","last_active":"2023-07-14T13:11:27.915342+0000","last_peered":"2023-07-14T13:11:27.915342+0000","last_clean":"2023-07-14T13:11:27.915342+0000","last_became_active":"2023-07-14T13:11:27.914211+0000","last_became_peered":"2023-07-14T13:11:27.914211+0000","last_unstale":"2023-07-14T13:11:27.915342+0000","last_undegraded":"2023-07-14T13:11:27.915342+0000","last_fullsized":"2023-07-14T13:11:27.915342+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:24:53.822108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":200,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.893049+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:11:27.893049+0000","last_peered":"2023-07-14T13:11:27.893049+0000","last_clean":"2023-07-14T13:11:27.893049+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:11:27.893049+0000","last_undegraded":"2023-07-14T13:11:27.893049+0000","last_fullsized":"2023-07-14T13:11:27.893049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:55:05.131842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.892546+0000","last_change":"2023-07-14T13:11:27.892546+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.892546+0000","last_undegraded":"2023-07-14T13:11:27.892546+0000","last_fullsized":"2023-07-14T13:11:27.892546+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.916712+0000","last_change":"2023-07-14T13:11:27.914767+0000","last_active":"2023-07-14T13:11:27.916712+0000","last_peered":"2023-07-14T13:11:27.916712+0000","last_clean":"2023-07-14T13:11:27.916712+0000","last_became_active":"2023-07-14T13:11:27.914404+0000","last_became_peered":"2023-07-14T13:11:27.914404+0000","last_unstale":"2023-07-14T13:11:27.916712+0000","last_undegraded":"2023-07-14T13:11:27.916712+0000","last_fullsized":"2023-07-14T13:11:27.916712+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:01:23.899054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":200,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.902678+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:11:27.902678+0000","last_peered":"2023-07-14T13:11:27.902678+0000","last_clean":"2023-07-14T13:11:27.902678+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:11:27.902678+0000","last_undegraded":"2023-07-14T13:11:27.902678+0000","last_fullsized":"2023-07-14T13:11:27.902678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:56:31.177858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.893399+0000","last_change":"2023-07-14T13:11:27.893399+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.893399+0000","last_undegraded":"2023-07-14T13:11:27.893399+0000","last_fullsized":"2023-07-14T13:11:27.893399+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.916623+0000","last_change":"2023-07-14T13:11:27.913529+0000","last_active":"2023-07-14T13:11:27.916623+0000","last_peered":"2023-07-14T13:11:27.916623+0000","last_clean":"2023-07-14T13:11:27.916623+0000","last_became_active":"2023-07-14T13:11:27.913229+0000","last_became_peered":"2023-07-14T13:11:27.913229+0000","last_unstale":"2023-07-14T13:11:27.916623+0000","last_undegraded":"2023-07-14T13:11:27.916623+0000","last_fullsized":"2023-07-14T13:11:27.916623+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:30.739338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":211,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.898183+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:11:27.898183+0000","last_peered":"2023-07-14T13:11:27.898183+0000","last_clean":"2023-07-14T13:11:27.898183+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:11:27.898183+0000","last_undegraded":"2023-07-14T13:11:27.898183+0000","last_fullsized":"2023-07-14T13:11:27.898183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:05:13.588773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.893394+0000","last_change":"2023-07-14T13:11:27.893394+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.893394+0000","last_undegraded":"2023-07-14T13:11:27.893394+0000","last_fullsized":"2023-07-14T13:11:27.893394+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.905477+0000","last_change":"2023-07-14T13:11:27.904242+0000","last_active":"2023-07-14T13:11:27.905477+0000","last_peered":"2023-07-14T13:11:27.905477+0000","last_clean":"2023-07-14T13:11:27.905477+0000","last_became_active":"2023-07-14T13:11:27.903918+0000","last_became_peered":"2023-07-14T13:11:27.903918+0000","last_unstale":"2023-07-14T13:11:27.905477+0000","last_undegraded":"2023-07-14T13:11:27.905477+0000","last_fullsized":"2023-07-14T13:11:27.905477+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:29:52.431360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":201,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.900033+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:11:27.900033+0000","last_peered":"2023-07-14T13:11:27.900033+0000","last_clean":"2023-07-14T13:11:27.900033+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:11:27.900033+0000","last_undegraded":"2023-07-14T13:11:27.900033+0000","last_fullsized":"2023-07-14T13:11:27.900033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:38:49.370231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.891144+0000","last_change":"2023-07-14T13:11:27.891144+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.891144+0000","last_undegraded":"2023-07-14T13:11:27.891144+0000","last_fullsized":"2023-07-14T13:11:27.891144+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.907212+0000","last_change":"2023-07-14T13:11:27.905304+0000","last_active":"2023-07-14T13:11:27.907212+0000","last_peered":"2023-07-14T13:11:27.907212+0000","last_clean":"2023-07-14T13:11:27.907212+0000","last_became_active":"2023-07-14T13:11:27.904926+0000","last_became_peered":"2023-07-14T13:11:27.904926+0000","last_unstale":"2023-07-14T13:11:27.907212+0000","last_undegraded":"2023-07-14T13:11:27.907212+0000","last_fullsized":"2023-07-14T13:11:27.907212+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:56:10.021540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":211,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.894238+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:11:27.894238+0000","last_peered":"2023-07-14T13:11:27.894238+0000","last_clean":"2023-07-14T13:11:27.894238+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:11:27.894238+0000","last_undegraded":"2023-07-14T13:11:27.894238+0000","last_fullsized":"2023-07-14T13:11:27.894238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:59:45.531447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2023-07-14T13:11:27.891660+0000","last_change":"2023-07-14T13:11:27.891660+0000","last_active":"2023-07-14T13:11:27.879637+0000","last_peered":"2023-07-14T13:11:27.879637+0000","last_clean":"2023-07-14T13:11:27.879637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:11:27.891660+0000","last_undegraded":"2023-07-14T13:11:27.891660+0000","last_fullsized":"2023-07-14T13:11:27.891660+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.912271+0000","last_change":"2023-07-14T13:11:27.909085+0000","last_active":"2023-07-14T13:11:27.912271+0000","last_peered":"2023-07-14T13:11:27.912271+0000","last_clean":"2023-07-14T13:11:27.912271+0000","last_became_active":"2023-07-14T13:11:27.908811+0000","last_became_peered":"2023-07-14T13:11:27.908811+0000","last_unstale":"2023-07-14T13:11:27.912271+0000","last_undegraded":"2023-07-14T13:11:27.912271+0000","last_fullsized":"2023-07-14T13:11:27.912271+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:53:08.517311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":203,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-07-14T13:11:27.909391+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:11:27.909391+0000","last_peered":"2023-07-14T13:11:27.909391+0000","last_clean":"2023-07-14T13:11:27.909391+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:11:27.909391+0000","last_undegraded":"2023-07-14T13:11:27.909391+0000","last_fullsized":"2023-07-14T13:11:27.909391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:38:12.792564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575073,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59376,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312464,"statfs":{"total":96636764160,"available":96575963136,"internally_reserved":0,"allocated":2138112,"data_stored":1371934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.70799999999999996,"15min":0.70999999999999996},"min":{"1min":0.53300000000000003,"5min":0.372,"15min":0.33900000000000002},"max":{"1min":0.95899999999999996,"5min":1.262,"15min":1.262},"last":0.5},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71999999999999997,"15min":0.72899999999999998},"min":{"1min":0.51500000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.55100000000000005}]},{"osd":1,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72399999999999998,"15min":0.73599999999999999},"min":{"1min":0.48199999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.872,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.72899999999999998,"15min":0.74399999999999999},"min":{"1min":0.59799999999999998,"5min":0.436,"15min":0.40500000000000003},"max":{"1min":0.97599999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.58299999999999996,"5min":0.46100000000000002,"15min":0.42699999999999999},"max":{"1min":0.96099999999999997,"5min":1.073,"15min":1.073},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.73899999999999999,"15min":0.753},"min":{"1min":0.57999999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89600000000000002,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.70499999999999996}]},{"osd":3,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.58899999999999997,"5min":0.503,"15min":0.46400000000000002},"max":{"1min":0.90900000000000003,"5min":1.161,"15min":1.161},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.73999999999999999,"15min":0.75600000000000001},"min":{"1min":0.60299999999999998,"5min":0.47899999999999998,"15min":0.41499999999999998},"max":{"1min":0.91800000000000004,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.755}]},{"osd":4,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55800000000000005,"15min":0.57799999999999996},"min":{"1min":0.44500000000000001,"5min":0.39100000000000001,"15min":0.318},"max":{"1min":0.874,"5min":0.874,"15min":1.022},"last":0.628},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.47399999999999998,"5min":0.40600000000000003,"15min":0.39300000000000002},"max":{"1min":0.76500000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.77400000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.52100000000000002,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.82199999999999995,"5min":0.98099999999999998,"15min":0.98299999999999998},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.64700000000000002},"min":{"1min":0.44,"5min":0.377,"15min":0.34100000000000003},"max":{"1min":0.80700000000000005,"5min":1.028,"15min":1.028},"last":0.80500000000000005}]},{"osd":6,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67600000000000005,"15min":0.69099999999999995},"min":{"1min":0.48499999999999999,"5min":0.45200000000000001,"15min":0.42699999999999999},"max":{"1min":0.85799999999999998,"5min":0.99299999999999999,"15min":1.0489999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.68000000000000005,"15min":0.67500000000000004},"min":{"1min":0.47499999999999998,"5min":0.46200000000000002,"15min":0.36299999999999999},"max":{"1min":4.1130000000000004,"5min":4.1130000000000004,"15min":4.1130000000000004},"last":0.85799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575074,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":1508,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":1544192,"data_stored":781566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71599999999999997,"15min":0.73099999999999998},"min":{"1min":0.50800000000000001,"5min":0.39500000000000002,"15min":0.38},"max":{"1min":0.90100000000000002,"5min":0.95899999999999996,"15min":0.996},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.70199999999999996,"15min":0.72699999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89500000000000002,"5min":0.98199999999999998,"15min":1.0800000000000001},"last":0.55700000000000005}]},{"osd":1,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70899999999999996,"15min":0.73699999999999999},"min":{"1min":0.497,"5min":0.42299999999999999,"15min":0.379},"max":{"1min":0.84399999999999997,"5min":0.97199999999999998,"15min":1.0209999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.70199999999999996,"15min":0.72099999999999997},"min":{"1min":0.60599999999999998,"5min":0.47499999999999998,"15min":0.46999999999999997},"max":{"1min":0.88100000000000001,"5min":0.91400000000000003,"15min":1.077},"last":0.64400000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72699999999999998,"15min":0.749},"min":{"1min":0.56100000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.874,"5min":0.95099999999999996,"15min":1.105},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.48499999999999999,"5min":0.441,"15min":0.441},"max":{"1min":0.97999999999999998,"5min":0.99099999999999999,"15min":1.0900000000000001},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.75,"15min":0.77200000000000002},"min":{"1min":0.61499999999999999,"5min":0.46000000000000002,"15min":0.434},"max":{"1min":0.92200000000000004,"5min":1.054,"15min":1.1359999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.71899999999999997,"15min":0.754},"min":{"1min":0.56999999999999995,"5min":0.50900000000000001,"15min":0.48399999999999999},"max":{"1min":0.871,"5min":0.94799999999999995,"15min":1.1080000000000001},"last":0.624}]},{"osd":4,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57399999999999995,"15min":0.57499999999999996},"min":{"1min":0.45900000000000002,"5min":0.39900000000000002,"15min":0.317},"max":{"1min":0.76300000000000001,"5min":0.89900000000000002,"15min":0.97899999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.48299999999999998,"5min":0.439,"15min":0.38500000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":1.0780000000000001},"last":0.69199999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.497,"5min":0.45200000000000001,"15min":0.37},"max":{"1min":0.78100000000000003,"5min":0.96599999999999997,"15min":1.579},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.50800000000000001,"5min":0.46300000000000002,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.81999999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67400000000000004,"15min":0.65900000000000003},"min":{"1min":0.47899999999999998,"5min":0.437,"15min":0.34599999999999997},"max":{"1min":0.93899999999999995,"5min":1.0940000000000001,"15min":1.1200000000000001},"last":0.75},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71299999999999997,"15min":0.71199999999999997},"min":{"1min":0.59699999999999998,"5min":0.48899999999999999,"15min":0.36199999999999999},"max":{"1min":0.92000000000000004,"5min":1.0209999999999999,"15min":1.657},"last":0.68500000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575073,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46508,"kb_used_data":1508,"kb_used_omap":0,"kb_used_meta":44992,"kb_avail":94325332,"statfs":{"total":96636764160,"available":96589139968,"internally_reserved":0,"allocated":1544192,"data_stored":781566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46071808},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.69399999999999995,"15min":0.72499999999999998},"min":{"1min":0.44400000000000001,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":0.88800000000000001,"5min":0.91500000000000004,"15min":2.6699999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.71299999999999997,"15min":0.72799999999999998},"min":{"1min":0.56799999999999995,"5min":0.41699999999999998,"15min":0.32800000000000001},"max":{"1min":0.98299999999999998,"5min":1.083,"15min":1.083},"last":0.83999999999999997}]},{"osd":1,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.69399999999999995,"15min":0.72099999999999997},"min":{"1min":0.49399999999999999,"5min":0.45900000000000002,"15min":0.41099999999999998},"max":{"1min":0.95799999999999996,"5min":1.05,"15min":1.079},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72099999999999997,"15min":0.74299999999999999},"min":{"1min":0.55000000000000004,"5min":0.48999999999999999,"15min":0.36799999999999999},"max":{"1min":0.92500000000000004,"5min":0.95899999999999996,"15min":2.706},"last":0.76000000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.71499999999999997,"15min":0.73299999999999998},"min":{"1min":0.58699999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.93999999999999995,"5min":1.212,"15min":1.212},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.70999999999999996,"15min":0.73099999999999998},"min":{"1min":0.60999999999999999,"5min":0.44800000000000001,"15min":0.433},"max":{"1min":0.90900000000000003,"5min":1.181,"15min":1.181},"last":0.68100000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.72499999999999998,"15min":0.74399999999999999},"min":{"1min":0.64300000000000002,"5min":0.41799999999999998,"15min":0.377},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":2.7389999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.72799999999999998,"15min":0.75800000000000001},"min":{"1min":0.61799999999999999,"5min":0.47299999999999998,"15min":0.39700000000000002},"max":{"1min":0.89500000000000002,"5min":1.304,"15min":1.304},"last":0.78000000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63800000000000001,"15min":0.627},"min":{"1min":0.49399999999999999,"5min":0.38,"15min":0.28599999999999998},"max":{"1min":0.871,"5min":1.129,"15min":1.129},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66600000000000004,"15min":0.68000000000000005},"min":{"1min":0.499,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85899999999999999,"5min":0.86799999999999999,"15min":2.7719999999999998},"last":0.71899999999999997}]},{"osd":6,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59399999999999997,"15min":0.60599999999999998},"min":{"1min":0.46500000000000002,"5min":0.34599999999999997,"15min":0.32700000000000001},"max":{"1min":0.68300000000000005,"5min":1.169,"15min":1.169},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.47999999999999998,"5min":0.39400000000000002,"15min":0.34300000000000003},"max":{"1min":0.83999999999999997,"5min":1.238,"15min":1.238},"last":0.61899999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.45400000000000001,"5min":0.36899999999999999,"15min":0.32900000000000001},"max":{"1min":0.92200000000000004,"5min":1.026,"15min":3.0230000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67200000000000004,"15min":0.67500000000000004},"min":{"1min":0.46500000000000002,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.85099999999999998,"5min":1.2589999999999999,"15min":1.407},"last":0.65200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575073,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":1508,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":1544192,"data_stored":781566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.70199999999999996,"15min":0.72799999999999998},"min":{"1min":0.53800000000000003,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":1.411},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72799999999999998,"15min":0.73099999999999998},"min":{"1min":0.46999999999999997,"5min":0.45100000000000001,"15min":0.435},"max":{"1min":0.88,"5min":1.0089999999999999,"15min":1.1200000000000001},"last":0.91500000000000004}]},{"osd":1,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72799999999999998,"15min":0.746},"min":{"1min":0.53100000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89300000000000002,"5min":0.94699999999999995,"15min":1.077},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71499999999999997,"15min":0.73299999999999998},"min":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89800000000000002,"5min":0.96399999999999997,"15min":1.0469999999999999},"last":0.94999999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71499999999999997,"15min":0.73099999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.35199999999999998},"max":{"1min":0.872,"5min":0.96499999999999997,"15min":1.091},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.77000000000000002},"min":{"1min":0.63200000000000001,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.86299999999999999,"5min":1.04,"15min":1.387},"last":0.83199999999999996}]},{"osd":3,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72699999999999998,"15min":0.74399999999999999},"min":{"1min":0.53200000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89400000000000002,"5min":0.997,"15min":1.008},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.748,"15min":0.76800000000000002},"min":{"1min":0.51400000000000001,"5min":0.47499999999999998,"15min":0.46800000000000003},"max":{"1min":1.002,"5min":1.002,"15min":1.0589999999999999},"last":0.93100000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.378},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":1.0029999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.64500000000000002,"15min":0.622},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.34599999999999997},"max":{"1min":0.79600000000000004,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.60099999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.34899999999999998,"15min":0.32300000000000001},"max":{"1min":0.876,"5min":0.96999999999999997,"15min":1.014},"last":0.626},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.374},"max":{"1min":0.85199999999999998,"5min":0.98299999999999998,"15min":1.0289999999999999},"last":0.73999999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70799999999999996,"15min":0.67300000000000004},"min":{"1min":0.55300000000000005,"5min":0.502,"15min":0.39000000000000001},"max":{"1min":0.84899999999999998,"5min":1.0049999999999999,"15min":1.0349999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.50700000000000001,"5min":0.42799999999999999,"15min":0.36899999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0629999999999999},"last":0.71299999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575073,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36640,"kb_used_data":1496,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335200,"statfs":{"total":96636764160,"available":96599244800,"internally_reserved":0,"allocated":1531904,"data_stored":774938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45300000000000001,"15min":0.44900000000000001},"min":{"1min":0.34799999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.59999999999999998,"5min":0.78600000000000003,"15min":0.84199999999999997},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.51100000000000001,"15min":0.51400000000000001},"min":{"1min":0.33200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.40699999999999997}]},{"osd":1,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.378,"5min":0.32000000000000001,"15min":0.315},"max":{"1min":0.67800000000000005,"5min":0.873,"15min":0.873},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.53700000000000003,"15min":0.54100000000000004},"min":{"1min":0.41699999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.753,"5min":0.753,"15min":1.0029999999999999},"last":0.36099999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56100000000000005,"15min":0.57199999999999995},"min":{"1min":0.44400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.90400000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.47599999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88100000000000001,"5min":1.02,"15min":1.663},"last":0.42899999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.75900000000000001,"15min":0.75700000000000001},"min":{"1min":0.56200000000000006,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":0.96899999999999997,"5min":1.151,"15min":1.284},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.78100000000000003,"15min":0.78200000000000003},"min":{"1min":0.60499999999999998,"5min":0.51900000000000002,"15min":0.47699999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.79300000000000004,"15min":0.79200000000000004},"min":{"1min":0.60399999999999998,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.306},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.60899999999999999,"5min":0.55000000000000004,"15min":0.372},"max":{"1min":1.018,"5min":1.1870000000000001,"15min":1.2470000000000001},"last":0.52000000000000002}]},{"osd":6,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77300000000000002,"15min":0.77200000000000002},"min":{"1min":0.52400000000000002,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.117},"last":0.629},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.80600000000000005,"15min":0.81399999999999995},"min":{"1min":0.63700000000000001,"5min":0.56299999999999994,"15min":0.54200000000000004},"max":{"1min":1.1000000000000001,"5min":1.129,"15min":1.2589999999999999},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81100000000000005,"15min":0.83199999999999996},"min":{"1min":0.66100000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.095,"5min":1.1519999999999999,"15min":2.4910000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.81200000000000006,"15min":0.82299999999999995},"min":{"1min":0.65100000000000002,"5min":0.53500000000000003,"15min":0.51600000000000001},"max":{"1min":1.1359999999999999,"5min":1.1379999999999999,"15min":1.595},"last":0.65000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575073,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58792,"kb_used_data":1504,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313048,"statfs":{"total":96636764160,"available":96576561152,"internally_reserved":0,"allocated":1540096,"data_stored":780547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.35499999999999998,"5min":0.29199999999999998,"15min":0.24199999999999999},"max":{"1min":0.75700000000000001,"5min":0.84699999999999998,"15min":1.3169999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51400000000000001,"15min":0.53500000000000003},"min":{"1min":0.372,"5min":0.318,"15min":0.318},"max":{"1min":0.69899999999999995,"5min":0.80800000000000005,"15min":2.5270000000000001},"last":0.51100000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46700000000000003,"15min":0.47299999999999998},"min":{"1min":0.34200000000000003,"5min":0.30399999999999999,"15min":0.29999999999999999},"max":{"1min":0.72599999999999998,"5min":0.77200000000000002,"15min":2.7200000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.52800000000000002,"15min":0.56200000000000006},"min":{"1min":0.46400000000000002,"5min":0.36299999999999999,"15min":0.35999999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":2.6110000000000002},"last":0.45800000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55700000000000005,"15min":0.60399999999999998},"min":{"1min":0.5,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70699999999999996,"5min":0.81899999999999995,"15min":8.2530000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53800000000000003,"15min":0.55200000000000005},"min":{"1min":0.44400000000000001,"5min":0.36899999999999999,"15min":0.33300000000000002},"max":{"1min":0.65700000000000003,"5min":0.89600000000000002,"15min":1.2150000000000001},"last":0.52900000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.753,"15min":0.77800000000000002},"min":{"1min":0.57299999999999995,"5min":0.53200000000000003,"15min":0.48399999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.1499999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.747,"15min":0.79100000000000004},"min":{"1min":0.60399999999999998,"5min":0.52900000000000003,"15min":0.47999999999999998},"max":{"1min":1.03,"5min":1.0629999999999999,"15min":2.3170000000000002},"last":0.72299999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.81000000000000005,"15min":0.85499999999999998},"min":{"1min":0.65500000000000003,"5min":0.56399999999999995,"15min":0.49399999999999999},"max":{"1min":1.087,"5min":1.1319999999999999,"15min":3.1139999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.79800000000000004,"15min":0.84099999999999997},"min":{"1min":0.61799999999999999,"5min":0.56200000000000006,"15min":0.433},"max":{"1min":1.0940000000000001,"5min":1.153,"15min":2.6850000000000001},"last":0.93100000000000005}]},{"osd":6,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.751,"15min":0.79900000000000004},"min":{"1min":0.65200000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.038,"5min":1.038,"15min":3.9849999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.76900000000000002,"15min":0.81100000000000005},"min":{"1min":0.627,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1100000000000001,"5min":1.1419999999999999,"15min":3.391},"last":0.97099999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.77100000000000002,"15min":0.81799999999999995},"min":{"1min":0.56000000000000005,"5min":0.52300000000000002,"15min":0.5},"max":{"1min":1.0549999999999999,"5min":1.1759999999999999,"15min":2.5779999999999998},"last":1.022},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.78900000000000003,"15min":0.82199999999999995},"min":{"1min":0.57499999999999996,"5min":0.52800000000000002,"15min":0.50900000000000001},"max":{"1min":1.0529999999999999,"5min":1.0940000000000001,"15min":2.5939999999999999},"last":0.83199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575074,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36652,"kb_used_data":1508,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335188,"statfs":{"total":96636764160,"available":96599232512,"internally_reserved":0,"allocated":1544192,"data_stored":781566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.435,"15min":0.433},"min":{"1min":0.29199999999999998,"5min":0.28399999999999997,"15min":0.26100000000000001},"max":{"1min":0.63900000000000001,"5min":0.65400000000000003,"15min":0.77200000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.88900000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.48099999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46300000000000002,"15min":0.47199999999999998},"min":{"1min":0.371,"5min":0.317,"15min":0.317},"max":{"1min":0.67300000000000004,"5min":0.69199999999999995,"15min":1.0409999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.39400000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":1.014},"last":0.61899999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60899999999999999,"15min":0.63200000000000001},"min":{"1min":0.45000000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.76300000000000001,"5min":0.80300000000000005,"15min":0.96299999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.57399999999999995},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79200000000000004,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.54100000000000004}]},{"osd":4,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76900000000000002,"15min":0.78700000000000003},"min":{"1min":0.56799999999999995,"5min":0.51200000000000001,"15min":0.48899999999999999},"max":{"1min":0.98199999999999998,"5min":1.2110000000000001,"15min":1.236},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.63,"5min":0.54700000000000004,"15min":0.502},"max":{"1min":1,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.873}]},{"osd":5,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.45200000000000001},"max":{"1min":1.097,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.63700000000000001,"5min":0.51500000000000001,"15min":0.48599999999999999},"max":{"1min":0.99099999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.78200000000000003}]},{"osd":6,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.56599999999999995,"5min":0.53800000000000003,"15min":0.503},"max":{"1min":1.071,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.81399999999999995,"15min":0.81699999999999995},"min":{"1min":0.56399999999999995,"5min":0.497,"15min":0.497},"max":{"1min":1.0880000000000001,"5min":1.262,"15min":1.262},"last":0.81200000000000006}]},{"osd":7,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.80000000000000004,"15min":0.80200000000000005},"min":{"1min":0.61599999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.048,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.878,"5min":0.83299999999999996,"15min":0.84499999999999997},"min":{"1min":0.68899999999999995,"5min":0.58499999999999996,"15min":0.52800000000000002},"max":{"1min":1.1160000000000001,"5min":1.327,"15min":1.327},"last":0.74099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575075,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37228,"kb_used_data":2084,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334612,"statfs":{"total":96636764160,"available":96598642688,"internally_reserved":0,"allocated":2134016,"data_stored":1370915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.33300000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":2.2450000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.48799999999999999,"15min":0.51100000000000001},"min":{"1min":0.35699999999999998,"5min":0.30099999999999999,"15min":0.27700000000000002},"max":{"1min":0.74199999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.36699999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.495,"15min":0.51200000000000001},"min":{"1min":0.35999999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.60799999999999998,"5min":0.84499999999999997,"15min":2.2989999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53200000000000003,"15min":0.55000000000000004},"min":{"1min":0.40400000000000003,"5min":0.34899999999999998,"15min":0.29899999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.90300000000000002},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.498,"15min":0.505},"min":{"1min":0.44400000000000001,"5min":0.32700000000000001,"15min":0.30299999999999999},"max":{"1min":0.58299999999999996,"5min":0.72999999999999998,"15min":0.84999999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56799999999999995,"15min":0.58799999999999997},"min":{"1min":0.47199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.71799999999999997,"5min":0.92700000000000005,"15min":2.4100000000000001},"last":0.54500000000000004}]},{"osd":4,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.745,"15min":0.78100000000000003},"min":{"1min":0.54500000000000004,"5min":0.48399999999999999,"15min":0.44400000000000001},"max":{"1min":1.0309999999999999,"5min":1.21,"15min":1.3640000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.75600000000000001,"15min":0.79500000000000004},"min":{"1min":0.60199999999999998,"5min":0.52300000000000002,"15min":0.44900000000000001},"max":{"1min":0.90000000000000002,"5min":1.0589999999999999,"15min":2.4460000000000002},"last":0.68300000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.751,"15min":0.79600000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.47899999999999998},"max":{"1min":0.95899999999999996,"5min":1.0669999999999999,"15min":1.3839999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.75900000000000001,"15min":0.79200000000000004},"min":{"1min":0.55800000000000005,"5min":0.5,"15min":0.47299999999999998},"max":{"1min":1.05,"5min":1.069,"15min":1.325},"last":0.69799999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76700000000000002,"15min":0.79800000000000004},"min":{"1min":0.63500000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.97499999999999998,"5min":1.05,"15min":2.3380000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.75800000000000001,"15min":0.80300000000000005},"min":{"1min":0.58599999999999997,"5min":0.51000000000000001,"15min":0.41299999999999998},"max":{"1min":1.012,"5min":1.0900000000000001,"15min":1.3440000000000001},"last":0.65700000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.77700000000000002,"15min":0.82199999999999995},"min":{"1min":0.58499999999999996,"5min":0.52800000000000002,"15min":0.45500000000000002},"max":{"1min":0.95299999999999996,"5min":1.1180000000000001,"15min":1.2749999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.75700000000000001,"15min":0.80400000000000005},"min":{"1min":0.60599999999999998,"5min":0.502,"15min":0.497},"max":{"1min":1.0640000000000001,"5min":1.0880000000000001,"15min":1.381},"last":0.73999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:11:33.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3f is not active+clean 2023-07-14T13:11:33.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.895795+0000', 'last_change': '2023-07-14T13:11:27.895795+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.895795+0000', 'last_undegraded': '2023-07-14T13:11:27.895795+0000', 'last_fullsized': '2023-07-14T13:11:27.895795+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:11:33.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3e is not active+clean 2023-07-14T13:11:33.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.907157+0000', 'last_change': '2023-07-14T13:11:27.907157+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.907157+0000', 'last_undegraded': '2023-07-14T13:11:27.907157+0000', 'last_fullsized': '2023-07-14T13:11:27.907157+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:11:33.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3d is not active+clean 2023-07-14T13:11:33.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.896573+0000', 'last_change': '2023-07-14T13:11:27.896573+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.896573+0000', 'last_undegraded': '2023-07-14T13:11:27.896573+0000', 'last_fullsized': '2023-07-14T13:11:27.896573+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:11:33.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3c is not active+clean 2023-07-14T13:11:33.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.892922+0000', 'last_change': '2023-07-14T13:11:27.892922+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.892922+0000', 'last_undegraded': '2023-07-14T13:11:27.892922+0000', 'last_fullsized': '2023-07-14T13:11:27.892922+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:11:33.859 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3b is not active+clean 2023-07-14T13:11:33.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.895434+0000', 'last_change': '2023-07-14T13:11:27.895434+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.895434+0000', 'last_undegraded': '2023-07-14T13:11:27.895434+0000', 'last_fullsized': '2023-07-14T13:11:27.895434+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:11:33.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3a is not active+clean 2023-07-14T13:11:33.860 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.905271+0000', 'last_change': '2023-07-14T13:11:27.905271+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.905271+0000', 'last_undegraded': '2023-07-14T13:11:27.905271+0000', 'last_fullsized': '2023-07-14T13:11:27.905271+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:11:33.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.39 is not active+clean 2023-07-14T13:11:33.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.904249+0000', 'last_change': '2023-07-14T13:11:27.904249+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.904249+0000', 'last_undegraded': '2023-07-14T13:11:27.904249+0000', 'last_fullsized': '2023-07-14T13:11:27.904249+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:11:33.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.38 is not active+clean 2023-07-14T13:11:33.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.897193+0000', 'last_change': '2023-07-14T13:11:27.897193+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.897193+0000', 'last_undegraded': '2023-07-14T13:11:27.897193+0000', 'last_fullsized': '2023-07-14T13:11:27.897193+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:11:33.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.37 is not active+clean 2023-07-14T13:11:33.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.907895+0000', 'last_change': '2023-07-14T13:11:27.907895+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.907895+0000', 'last_undegraded': '2023-07-14T13:11:27.907895+0000', 'last_fullsized': '2023-07-14T13:11:27.907895+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:11:33.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.36 is not active+clean 2023-07-14T13:11:33.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.893865+0000', 'last_change': '2023-07-14T13:11:27.893865+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.893865+0000', 'last_undegraded': '2023-07-14T13:11:27.893865+0000', 'last_fullsized': '2023-07-14T13:11:27.893865+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:11:33.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.35 is not active+clean 2023-07-14T13:11:33.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.901834+0000', 'last_change': '2023-07-14T13:11:27.901834+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.901834+0000', 'last_undegraded': '2023-07-14T13:11:27.901834+0000', 'last_fullsized': '2023-07-14T13:11:27.901834+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:11:33.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.34 is not active+clean 2023-07-14T13:11:33.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.894943+0000', 'last_change': '2023-07-14T13:11:27.894943+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.894943+0000', 'last_undegraded': '2023-07-14T13:11:27.894943+0000', 'last_fullsized': '2023-07-14T13:11:27.894943+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:11:33.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.33 is not active+clean 2023-07-14T13:11:33.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.891406+0000', 'last_change': '2023-07-14T13:11:27.891406+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.891406+0000', 'last_undegraded': '2023-07-14T13:11:27.891406+0000', 'last_fullsized': '2023-07-14T13:11:27.891406+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:11:33.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.32 is not active+clean 2023-07-14T13:11:33.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.896301+0000', 'last_change': '2023-07-14T13:11:27.896301+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.896301+0000', 'last_undegraded': '2023-07-14T13:11:27.896301+0000', 'last_fullsized': '2023-07-14T13:11:27.896301+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:11:33.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.31 is not active+clean 2023-07-14T13:11:33.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.896227+0000', 'last_change': '2023-07-14T13:11:27.896227+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.896227+0000', 'last_undegraded': '2023-07-14T13:11:27.896227+0000', 'last_fullsized': '2023-07-14T13:11:27.896227+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:11:33.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.30 is not active+clean 2023-07-14T13:11:33.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.896163+0000', 'last_change': '2023-07-14T13:11:27.896163+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.896163+0000', 'last_undegraded': '2023-07-14T13:11:27.896163+0000', 'last_fullsized': '2023-07-14T13:11:27.896163+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:11:33.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2f is not active+clean 2023-07-14T13:11:33.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.895290+0000', 'last_change': '2023-07-14T13:11:27.895290+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.895290+0000', 'last_undegraded': '2023-07-14T13:11:27.895290+0000', 'last_fullsized': '2023-07-14T13:11:27.895290+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:11:33.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2e is not active+clean 2023-07-14T13:11:33.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.906686+0000', 'last_change': '2023-07-14T13:11:27.906686+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.906686+0000', 'last_undegraded': '2023-07-14T13:11:27.906686+0000', 'last_fullsized': '2023-07-14T13:11:27.906686+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:11:33.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2d is not active+clean 2023-07-14T13:11:33.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.896085+0000', 'last_change': '2023-07-14T13:11:27.896085+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.896085+0000', 'last_undegraded': '2023-07-14T13:11:27.896085+0000', 'last_fullsized': '2023-07-14T13:11:27.896085+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:11:33.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2c is not active+clean 2023-07-14T13:11:33.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.892998+0000', 'last_change': '2023-07-14T13:11:27.892998+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.892998+0000', 'last_undegraded': '2023-07-14T13:11:27.892998+0000', 'last_fullsized': '2023-07-14T13:11:27.892998+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:11:33.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2b is not active+clean 2023-07-14T13:11:33.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.896165+0000', 'last_change': '2023-07-14T13:11:27.896165+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.896165+0000', 'last_undegraded': '2023-07-14T13:11:27.896165+0000', 'last_fullsized': '2023-07-14T13:11:27.896165+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:11:33.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2a is not active+clean 2023-07-14T13:11:33.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.897491+0000', 'last_change': '2023-07-14T13:11:27.897491+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.897491+0000', 'last_undegraded': '2023-07-14T13:11:27.897491+0000', 'last_fullsized': '2023-07-14T13:11:27.897491+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:11:33.873 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.29 is not active+clean 2023-07-14T13:11:33.873 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.890634+0000', 'last_change': '2023-07-14T13:11:27.890634+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.890634+0000', 'last_undegraded': '2023-07-14T13:11:27.890634+0000', 'last_fullsized': '2023-07-14T13:11:27.890634+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:11:33.874 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.28 is not active+clean 2023-07-14T13:11:33.875 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.895068+0000', 'last_change': '2023-07-14T13:11:27.895068+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.895068+0000', 'last_undegraded': '2023-07-14T13:11:27.895068+0000', 'last_fullsized': '2023-07-14T13:11:27.895068+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:11:33.876 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.27 is not active+clean 2023-07-14T13:11:33.876 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.892645+0000', 'last_change': '2023-07-14T13:11:27.892645+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.892645+0000', 'last_undegraded': '2023-07-14T13:11:27.892645+0000', 'last_fullsized': '2023-07-14T13:11:27.892645+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:11:33.876 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.26 is not active+clean 2023-07-14T13:11:33.877 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.894405+0000', 'last_change': '2023-07-14T13:11:27.894405+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.894405+0000', 'last_undegraded': '2023-07-14T13:11:27.894405+0000', 'last_fullsized': '2023-07-14T13:11:27.894405+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:11:33.877 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.25 is not active+clean 2023-07-14T13:11:33.877 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.901319+0000', 'last_change': '2023-07-14T13:11:27.901319+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.901319+0000', 'last_undegraded': '2023-07-14T13:11:27.901319+0000', 'last_fullsized': '2023-07-14T13:11:27.901319+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:11:33.878 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.24 is not active+clean 2023-07-14T13:11:33.878 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.907554+0000', 'last_change': '2023-07-14T13:11:27.907554+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.907554+0000', 'last_undegraded': '2023-07-14T13:11:27.907554+0000', 'last_fullsized': '2023-07-14T13:11:27.907554+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:11:33.878 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.23 is not active+clean 2023-07-14T13:11:33.879 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.893622+0000', 'last_change': '2023-07-14T13:11:27.893622+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.893622+0000', 'last_undegraded': '2023-07-14T13:11:27.893622+0000', 'last_fullsized': '2023-07-14T13:11:27.893622+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:11:33.879 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.22 is not active+clean 2023-07-14T13:11:33.879 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.894205+0000', 'last_change': '2023-07-14T13:11:27.894205+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.894205+0000', 'last_undegraded': '2023-07-14T13:11:27.894205+0000', 'last_fullsized': '2023-07-14T13:11:27.894205+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:11:33.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.21 is not active+clean 2023-07-14T13:11:33.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.903653+0000', 'last_change': '2023-07-14T13:11:27.903653+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.903653+0000', 'last_undegraded': '2023-07-14T13:11:27.903653+0000', 'last_fullsized': '2023-07-14T13:11:27.903653+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:11:33.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.20 is not active+clean 2023-07-14T13:11:33.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.896718+0000', 'last_change': '2023-07-14T13:11:27.896718+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.896718+0000', 'last_undegraded': '2023-07-14T13:11:27.896718+0000', 'last_fullsized': '2023-07-14T13:11:27.896718+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:11:33.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.0 is not active+clean 2023-07-14T13:11:33.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.890117+0000', 'last_change': '2023-07-14T13:11:27.890117+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.890117+0000', 'last_undegraded': '2023-07-14T13:11:27.890117+0000', 'last_fullsized': '2023-07-14T13:11:27.890117+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:11:33.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1 is not active+clean 2023-07-14T13:11:33.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.892755+0000', 'last_change': '2023-07-14T13:11:27.892755+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.892755+0000', 'last_undegraded': '2023-07-14T13:11:27.892755+0000', 'last_fullsized': '2023-07-14T13:11:27.892755+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:11:33.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2 is not active+clean 2023-07-14T13:11:33.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.892949+0000', 'last_change': '2023-07-14T13:11:27.892949+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.892949+0000', 'last_undegraded': '2023-07-14T13:11:27.892949+0000', 'last_fullsized': '2023-07-14T13:11:27.892949+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:11:33.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3 is not active+clean 2023-07-14T13:11:33.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.897580+0000', 'last_change': '2023-07-14T13:11:27.897580+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.897580+0000', 'last_undegraded': '2023-07-14T13:11:27.897580+0000', 'last_fullsized': '2023-07-14T13:11:27.897580+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:11:33.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.4 is not active+clean 2023-07-14T13:11:33.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.892486+0000', 'last_change': '2023-07-14T13:11:27.892486+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.892486+0000', 'last_undegraded': '2023-07-14T13:11:27.892486+0000', 'last_fullsized': '2023-07-14T13:11:27.892486+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:11:33.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.5 is not active+clean 2023-07-14T13:11:33.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.890139+0000', 'last_change': '2023-07-14T13:11:27.890139+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.890139+0000', 'last_undegraded': '2023-07-14T13:11:27.890139+0000', 'last_fullsized': '2023-07-14T13:11:27.890139+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:11:33.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.6 is not active+clean 2023-07-14T13:11:33.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.906115+0000', 'last_change': '2023-07-14T13:11:27.906115+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.906115+0000', 'last_undegraded': '2023-07-14T13:11:27.906115+0000', 'last_fullsized': '2023-07-14T13:11:27.906115+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:11:33.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.7 is not active+clean 2023-07-14T13:11:33.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.891818+0000', 'last_change': '2023-07-14T13:11:27.891818+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.891818+0000', 'last_undegraded': '2023-07-14T13:11:27.891818+0000', 'last_fullsized': '2023-07-14T13:11:27.891818+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:11:33.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.8 is not active+clean 2023-07-14T13:11:33.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.890934+0000', 'last_change': '2023-07-14T13:11:27.890934+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.890934+0000', 'last_undegraded': '2023-07-14T13:11:27.890934+0000', 'last_fullsized': '2023-07-14T13:11:27.890934+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:11:33.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.9 is not active+clean 2023-07-14T13:11:33.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.897030+0000', 'last_change': '2023-07-14T13:11:27.897030+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.897030+0000', 'last_undegraded': '2023-07-14T13:11:27.897030+0000', 'last_fullsized': '2023-07-14T13:11:27.897030+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:11:33.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.a is not active+clean 2023-07-14T13:11:33.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.892585+0000', 'last_change': '2023-07-14T13:11:27.892585+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.892585+0000', 'last_undegraded': '2023-07-14T13:11:27.892585+0000', 'last_fullsized': '2023-07-14T13:11:27.892585+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:11:33.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.b is not active+clean 2023-07-14T13:11:33.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.894417+0000', 'last_change': '2023-07-14T13:11:27.894417+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.894417+0000', 'last_undegraded': '2023-07-14T13:11:27.894417+0000', 'last_fullsized': '2023-07-14T13:11:27.894417+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:11:33.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.c is not active+clean 2023-07-14T13:11:33.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.897040+0000', 'last_change': '2023-07-14T13:11:27.897040+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.897040+0000', 'last_undegraded': '2023-07-14T13:11:27.897040+0000', 'last_fullsized': '2023-07-14T13:11:27.897040+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:11:33.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.d is not active+clean 2023-07-14T13:11:33.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.908446+0000', 'last_change': '2023-07-14T13:11:27.908446+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.908446+0000', 'last_undegraded': '2023-07-14T13:11:27.908446+0000', 'last_fullsized': '2023-07-14T13:11:27.908446+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:11:33.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.e is not active+clean 2023-07-14T13:11:33.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.896451+0000', 'last_change': '2023-07-14T13:11:27.896451+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.896451+0000', 'last_undegraded': '2023-07-14T13:11:27.896451+0000', 'last_fullsized': '2023-07-14T13:11:27.896451+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:11:33.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.f is not active+clean 2023-07-14T13:11:33.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.890579+0000', 'last_change': '2023-07-14T13:11:27.890579+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.890579+0000', 'last_undegraded': '2023-07-14T13:11:27.890579+0000', 'last_fullsized': '2023-07-14T13:11:27.890579+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:11:33.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.18 is not active+clean 2023-07-14T13:11:33.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.891456+0000', 'last_change': '2023-07-14T13:11:27.891456+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.891456+0000', 'last_undegraded': '2023-07-14T13:11:27.891456+0000', 'last_fullsized': '2023-07-14T13:11:27.891456+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:11:33.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.19 is not active+clean 2023-07-14T13:11:33.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.892862+0000', 'last_change': '2023-07-14T13:11:27.892862+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.892862+0000', 'last_undegraded': '2023-07-14T13:11:27.892862+0000', 'last_fullsized': '2023-07-14T13:11:27.892862+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:11:33.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1a is not active+clean 2023-07-14T13:11:33.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.893258+0000', 'last_change': '2023-07-14T13:11:27.893258+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.893258+0000', 'last_undegraded': '2023-07-14T13:11:27.893258+0000', 'last_fullsized': '2023-07-14T13:11:27.893258+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:11:33.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1b is not active+clean 2023-07-14T13:11:33.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.899765+0000', 'last_change': '2023-07-14T13:11:27.899765+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.899765+0000', 'last_undegraded': '2023-07-14T13:11:27.899765+0000', 'last_fullsized': '2023-07-14T13:11:27.899765+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:11:33.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1c is not active+clean 2023-07-14T13:11:33.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.897064+0000', 'last_change': '2023-07-14T13:11:27.897064+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.897064+0000', 'last_undegraded': '2023-07-14T13:11:27.897064+0000', 'last_fullsized': '2023-07-14T13:11:27.897064+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:11:33.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1d is not active+clean 2023-07-14T13:11:33.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.897503+0000', 'last_change': '2023-07-14T13:11:27.897503+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.897503+0000', 'last_undegraded': '2023-07-14T13:11:27.897503+0000', 'last_fullsized': '2023-07-14T13:11:27.897503+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:11:33.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1e is not active+clean 2023-07-14T13:11:33.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.896887+0000', 'last_change': '2023-07-14T13:11:27.896887+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.896887+0000', 'last_undegraded': '2023-07-14T13:11:27.896887+0000', 'last_fullsized': '2023-07-14T13:11:27.896887+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:11:33.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1f is not active+clean 2023-07-14T13:11:33.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.899166+0000', 'last_change': '2023-07-14T13:11:27.899166+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.899166+0000', 'last_undegraded': '2023-07-14T13:11:27.899166+0000', 'last_fullsized': '2023-07-14T13:11:27.899166+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:11:33.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.11 is not active+clean 2023-07-14T13:11:33.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.896877+0000', 'last_change': '2023-07-14T13:11:27.896877+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.896877+0000', 'last_undegraded': '2023-07-14T13:11:27.896877+0000', 'last_fullsized': '2023-07-14T13:11:27.896877+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:11:33.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.12 is not active+clean 2023-07-14T13:11:33.899 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.904732+0000', 'last_change': '2023-07-14T13:11:27.904732+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.904732+0000', 'last_undegraded': '2023-07-14T13:11:27.904732+0000', 'last_fullsized': '2023-07-14T13:11:27.904732+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:11:33.899 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.13 is not active+clean 2023-07-14T13:11:33.899 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.894928+0000', 'last_change': '2023-07-14T13:11:27.894928+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.894928+0000', 'last_undegraded': '2023-07-14T13:11:27.894928+0000', 'last_fullsized': '2023-07-14T13:11:27.894928+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:11:33.900 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.10 is not active+clean 2023-07-14T13:11:33.900 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.892546+0000', 'last_change': '2023-07-14T13:11:27.892546+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.892546+0000', 'last_undegraded': '2023-07-14T13:11:27.892546+0000', 'last_fullsized': '2023-07-14T13:11:27.892546+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:11:33.900 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.16 is not active+clean 2023-07-14T13:11:33.901 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.893399+0000', 'last_change': '2023-07-14T13:11:27.893399+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.893399+0000', 'last_undegraded': '2023-07-14T13:11:27.893399+0000', 'last_fullsized': '2023-07-14T13:11:27.893399+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:11:33.901 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.17 is not active+clean 2023-07-14T13:11:33.901 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.893394+0000', 'last_change': '2023-07-14T13:11:27.893394+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.893394+0000', 'last_undegraded': '2023-07-14T13:11:27.893394+0000', 'last_fullsized': '2023-07-14T13:11:27.893394+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:11:33.902 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.14 is not active+clean 2023-07-14T13:11:33.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.891144+0000', 'last_change': '2023-07-14T13:11:27.891144+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.891144+0000', 'last_undegraded': '2023-07-14T13:11:27.891144+0000', 'last_fullsized': '2023-07-14T13:11:27.891144+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:11:33.902 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.15 is not active+clean 2023-07-14T13:11:33.903 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:11:27.891660+0000', 'last_change': '2023-07-14T13:11:27.891660+0000', 'last_active': '2023-07-14T13:11:27.879637+0000', 'last_peered': '2023-07-14T13:11:27.879637+0000', 'last_clean': '2023-07-14T13:11:27.879637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:11:27.891660+0000', 'last_undegraded': '2023-07-14T13:11:27.891660+0000', 'last_fullsized': '2023-07-14T13:11:27.891660+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'last_clean_scrub_stamp': '2023-07-14T13:11:27.879637+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:11:33.903 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-14T13:11:33.908 INFO:tasks.ceph.mds.c.smithi005.stderr:2023-07-14T13:11:33.875+0000 7f5ab58f6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T13:11:34.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.015+0000 7fb6b6340640 1 Processor -- start 2023-07-14T13:11:34.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.015+0000 7fb6b6340640 1 -- start start 2023-07-14T13:11:34.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.015+0000 7fb6b6340640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb6b0070b70 0x7fb6b0070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:34.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.015+0000 7fb6b6340640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6b006b1e0 0x7fb6b00c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:34.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.015+0000 7fb6b6340640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6b00cac70 con 0x7fb6b00c21f0 2023-07-14T13:11:34.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.015+0000 7fb6b6340640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6b0071480 con 0x7fb6b0070b70 2023-07-14T13:11:34.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.015+0000 7fb6b6340640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b00ca060 con 0x7fb6b006b1e0 2023-07-14T13:11:34.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.015+0000 7fb6b48dd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb6b00c21f0 0x7fb6b00cb100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46082/0 (socket says 172.21.15.5:46082) 2023-07-14T13:11:34.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.015+0000 7fb6b48dd640 1 -- 172.21.15.5:0/131571168 learned_addr learned my addr 172.21.15.5:0/131571168 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:34.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.015+0000 7fb6affff640 1 --2- 172.21.15.5:0/131571168 >> v2:172.21.15.154:3300/0 conn(0x7fb6b0070b70 0x7fb6b0070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:34.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.015+0000 7fb6af7fe640 1 --2- 172.21.15.5:0/131571168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6b006b1e0 0x7fb6b00c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:34.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.015+0000 7fb6aeffd640 1 -- 172.21.15.5:0/131571168 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 928153895 0 0) 0x7fb6b00cac70 con 0x7fb6b00c21f0 2023-07-14T13:11:34.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.015+0000 7fb6aeffd640 1 -- 172.21.15.5:0/131571168 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb698003530 con 0x7fb6b00c21f0 2023-07-14T13:11:34.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.015+0000 7fb6af7fe640 1 -- 172.21.15.5:0/131571168 >> v2:172.21.15.154:3300/0 conn(0x7fb6b0070b70 msgr2=0x7fb6b0070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:34.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.015+0000 7fb6af7fe640 1 --2- 172.21.15.5:0/131571168 >> v2:172.21.15.154:3300/0 conn(0x7fb6b0070b70 0x7fb6b0070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:34.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.015+0000 7fb6aeffd640 1 -- 172.21.15.5:0/131571168 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2943798935 0 0) 0x7fb698003530 con 0x7fb6b00c21f0 2023-07-14T13:11:34.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.015+0000 7fb6af7fe640 1 -- 172.21.15.5:0/131571168 >> v1:172.21.15.5:6789/0 conn(0x7fb6b00c21f0 legacy=0x7fb6b00cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:34.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.019+0000 7fb6af7fe640 1 -- 172.21.15.5:0/131571168 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b00ca340 con 0x7fb6b006b1e0 2023-07-14T13:11:34.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.019+0000 7fb6affff640 1 --2- 172.21.15.5:0/131571168 >> v2:172.21.15.154:3300/0 conn(0x7fb6b0070b70 0x7fb6b0070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:11:34.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.019+0000 7fb6af7fe640 1 --2- 172.21.15.5:0/131571168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6b006b1e0 0x7fb6b00c1cb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40097c0 tx=0x7fb6a401c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3be77603424ca842 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:34.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.019+0000 7fb6aeffd640 1 -- 172.21.15.5:0/131571168 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a8001a00 con 0x7fb6b006b1e0 2023-07-14T13:11:34.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.019+0000 7fb6aeffd640 1 -- 172.21.15.5:0/131571168 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a40a7050 con 0x7fb6b006b1e0 2023-07-14T13:11:34.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.019+0000 7fb6aeffd640 1 -- 172.21.15.5:0/131571168 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a40ab620 con 0x7fb6b006b1e0 2023-07-14T13:11:34.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.019+0000 7fb6b6340640 1 -- 172.21.15.5:0/131571168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6b006b1e0 msgr2=0x7fb6b00c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:34.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.019+0000 7fb6b6340640 1 --2- 172.21.15.5:0/131571168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6b006b1e0 0x7fb6b00c1cb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40097c0 tx=0x7fb6a401c2e0 comp rx=0 tx=0).stop 2023-07-14T13:11:34.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.023+0000 7fb6b6340640 1 -- 172.21.15.5:0/131571168 shutdown_connections 2023-07-14T13:11:34.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.023+0000 7fb6b6340640 1 --2- 172.21.15.5:0/131571168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6b006b1e0 0x7fb6b00c1cb0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:34.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.023+0000 7fb6b6340640 1 --2- 172.21.15.5:0/131571168 >> v2:172.21.15.154:3300/0 conn(0x7fb6b0070b70 0x7fb6b0070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:34.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.023+0000 7fb6b6340640 1 -- 172.21.15.5:0/131571168 >> 172.21.15.5:0/131571168 conn(0x7fb6b00afcf0 msgr2=0x7fb6b00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:34.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.023+0000 7fb6b6340640 1 -- 172.21.15.5:0/131571168 shutdown_connections 2023-07-14T13:11:34.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.023+0000 7fb6b6340640 1 -- 172.21.15.5:0/131571168 wait complete. 2023-07-14T13:11:34.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.023+0000 7fb6b6340640 1 Processor -- start 2023-07-14T13:11:34.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.023+0000 7fb6b6340640 1 -- start start 2023-07-14T13:11:34.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.023+0000 7fb6b6340640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b006b1e0 0x7fb6b0152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:34.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.023+0000 7fb6b6340640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6b0070b70 0x7fb6b014bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:34.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.023+0000 7fb6b6340640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6b00c21f0 0x7fb6b01557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:34.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.023+0000 7fb6b6340640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b0153370 con 0x7fb6b006b1e0 2023-07-14T13:11:34.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.023+0000 7fb6b6340640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b0153090 con 0x7fb6b0070b70 2023-07-14T13:11:34.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.023+0000 7fb6b6340640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b0154d00 con 0x7fb6b00c21f0 2023-07-14T13:11:34.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.023+0000 7fb6affff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b006b1e0 0x7fb6b0152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:34.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.023+0000 7fb6affff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b006b1e0 0x7fb6b0152840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57436/0 (socket says 172.21.15.5:57436) 2023-07-14T13:11:34.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.023+0000 7fb6affff640 1 -- 172.21.15.5:0/2597901892 learned_addr learned my addr 172.21.15.5:0/2597901892 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:34.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.023+0000 7fb6b48dd640 1 --2- 172.21.15.5:0/2597901892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6b00c21f0 0x7fb6b01557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:34.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.023+0000 7fb6af7fe640 1 --2- 172.21.15.5:0/2597901892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6b0070b70 0x7fb6b014bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:34.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.023+0000 7fb6affff640 1 -- 172.21.15.5:0/2597901892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6b00c21f0 msgr2=0x7fb6b01557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:34.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.023+0000 7fb6affff640 1 --2- 172.21.15.5:0/2597901892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6b00c21f0 0x7fb6b01557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:34.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.023+0000 7fb6affff640 1 -- 172.21.15.5:0/2597901892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6b0070b70 msgr2=0x7fb6b014bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:34.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.023+0000 7fb6affff640 1 --2- 172.21.15.5:0/2597901892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6b0070b70 0x7fb6b014bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:34.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.023+0000 7fb6affff640 1 -- 172.21.15.5:0/2597901892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a0009420 con 0x7fb6b006b1e0 2023-07-14T13:11:34.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.027+0000 7fb6affff640 1 --2- 172.21.15.5:0/2597901892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b006b1e0 0x7fb6b0152840 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fb6a000ebe0 tx=0x7fb6a000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:34.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.027+0000 7fb6acff9640 1 -- 172.21.15.5:0/2597901892 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a000eee0 con 0x7fb6b006b1e0 2023-07-14T13:11:34.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.027+0000 7fb6acff9640 1 -- 172.21.15.5:0/2597901892 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a000cc30 con 0x7fb6b006b1e0 2023-07-14T13:11:34.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.027+0000 7fb6acff9640 1 -- 172.21.15.5:0/2597901892 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0013470 con 0x7fb6b006b1e0 2023-07-14T13:11:34.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.027+0000 7fb6b6340640 1 -- 172.21.15.5:0/2597901892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a4009420 con 0x7fb6b006b1e0 2023-07-14T13:11:34.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.027+0000 7fb6b6340640 1 -- 172.21.15.5:0/2597901892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b01552c0 con 0x7fb6b006b1e0 2023-07-14T13:11:34.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.027+0000 7fb6b6340640 1 -- 172.21.15.5:0/2597901892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6b00678d0 con 0x7fb6b006b1e0 2023-07-14T13:11:34.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.027+0000 7fb6acff9640 1 -- 172.21.15.5:0/2597901892 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb6a00135d0 con 0x7fb6b006b1e0 2023-07-14T13:11:34.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.027+0000 7fb6acff9640 1 --2- 172.21.15.5:0/2597901892 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fb69c0663a0 0x7fb69c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:34.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.027+0000 7fb6acff9640 1 -- 172.21.15.5:0/2597901892 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb6a00840e0 con 0x7fb6b006b1e0 2023-07-14T13:11:34.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.031+0000 7fb6af7fe640 1 --2- 172.21.15.5:0/2597901892 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fb69c0663a0 0x7fb69c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:34.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.031+0000 7fb6af7fe640 1 --2- 172.21.15.5:0/2597901892 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fb69c0663a0 0x7fb69c068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40ad000 tx=0x7fb6a4008040 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:34.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.031+0000 7fb6acff9640 1 -- 172.21.15.5:0/2597901892 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb6a00514f0 con 0x7fb6b006b1e0 2023-07-14T13:11:34.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.239+0000 7fb6b6340640 1 -- 172.21.15.5:0/2597901892 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb6b00c98c0 con 0x7fb6b006b1e0 2023-07-14T13:11:34.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.243+0000 7fb6acff9640 1 -- 172.21.15.5:0/2597901892 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3232 (secure 0 0 0) 0x7fb6a0054b10 con 0x7fb6b006b1e0 2023-07-14T13:11:34.274 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:11:34.274 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1153,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":127,"num_osds":8,"num_up_osds":8,"osd_up_since":1689339152,"num_in_osds":8,"osd_in_since":1689339143,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":348475392,"bytes_avail":772745637888,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":57,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8247}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2023-07-14T13:11:16.578454+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-14T13:11:34.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.243+0000 7fb6b6340640 1 -- 172.21.15.5:0/2597901892 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fb69c0663a0 msgr2=0x7fb69c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:34.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.243+0000 7fb6b6340640 1 --2- 172.21.15.5:0/2597901892 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fb69c0663a0 0x7fb69c068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb6a40ad000 tx=0x7fb6a4008040 comp rx=0 tx=0).stop 2023-07-14T13:11:34.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.243+0000 7fb6b6340640 1 -- 172.21.15.5:0/2597901892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b006b1e0 msgr2=0x7fb6b0152840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:34.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.243+0000 7fb6b6340640 1 --2- 172.21.15.5:0/2597901892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b006b1e0 0x7fb6b0152840 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fb6a000ebe0 tx=0x7fb6a000c520 comp rx=0 tx=0).stop 2023-07-14T13:11:34.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.243+0000 7fb6b6340640 1 -- 172.21.15.5:0/2597901892 shutdown_connections 2023-07-14T13:11:34.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.243+0000 7fb6b6340640 1 --2- 172.21.15.5:0/2597901892 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fb69c0663a0 0x7fb69c068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:34.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.243+0000 7fb6b6340640 1 --2- 172.21.15.5:0/2597901892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb6b00c21f0 0x7fb6b01557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:34.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.243+0000 7fb6b6340640 1 --2- 172.21.15.5:0/2597901892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6b0070b70 0x7fb6b014bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:34.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.243+0000 7fb6b6340640 1 --2- 172.21.15.5:0/2597901892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6b006b1e0 0x7fb6b0152840 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:34.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.243+0000 7fb6b6340640 1 -- 172.21.15.5:0/2597901892 >> 172.21.15.5:0/2597901892 conn(0x7fb6b00afcf0 msgr2=0x7fb6b00cd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:34.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.243+0000 7fb6b6340640 1 -- 172.21.15.5:0/2597901892 shutdown_connections 2023-07-14T13:11:34.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.243+0000 7fb6b6340640 1 -- 172.21.15.5:0/2597901892 wait complete. 2023-07-14T13:11:34.296 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-14T13:11:34.296 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:11:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.407+0000 7f8b3a8f9640 1 Processor -- start 2023-07-14T13:11:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.407+0000 7f8b3a8f9640 1 -- start start 2023-07-14T13:11:34.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.407+0000 7f8b3a8f9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8b34158ce0 0x7f8b34070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:34.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.407+0000 7f8b3a8f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b340c9730 0x7f8b340ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:34.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.407+0000 7f8b3a8f9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b340cc700 con 0x7f8b340c8ad0 2023-07-14T13:11:34.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.407+0000 7f8b3a8f9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b340b0ff0 con 0x7f8b34158ce0 2023-07-14T13:11:34.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.407+0000 7f8b3a8f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b34070c80 con 0x7f8b340c9730 2023-07-14T13:11:34.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.407+0000 7f8b337fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8b340c8ad0 0x7f8b340c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46086/0 (socket says 172.21.15.5:46086) 2023-07-14T13:11:34.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.407+0000 7f8b337fe640 1 -- 172.21.15.5:0/1106054793 learned_addr learned my addr 172.21.15.5:0/1106054793 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:34.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.411+0000 7f8b38e96640 1 --2- 172.21.15.5:0/1106054793 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b340c9730 0x7f8b340ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:34.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.411+0000 7f8b33fff640 1 --2- 172.21.15.5:0/1106054793 >> v2:172.21.15.154:3300/0 conn(0x7f8b34158ce0 0x7f8b34070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:34.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.411+0000 7f8b32ffd640 1 -- 172.21.15.5:0/1106054793 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3381911432 0 0) 0x7f8b340cc700 con 0x7f8b340c8ad0 2023-07-14T13:11:34.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.411+0000 7f8b32ffd640 1 -- 172.21.15.5:0/1106054793 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b1c003530 con 0x7f8b340c8ad0 2023-07-14T13:11:34.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.411+0000 7f8b32ffd640 1 -- 172.21.15.5:0/1106054793 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3252168748 0 0) 0x7f8b1c003530 con 0x7f8b340c8ad0 2023-07-14T13:11:34.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.411+0000 7f8b32ffd640 1 -- 172.21.15.5:0/1106054793 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b340c9730 msgr2=0x7f8b340ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.411+0000 7f8b32ffd640 1 --2- 172.21.15.5:0/1106054793 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b340c9730 0x7f8b340ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.411+0000 7f8b32ffd640 1 -- 172.21.15.5:0/1106054793 >> v2:172.21.15.154:3300/0 conn(0x7f8b34158ce0 msgr2=0x7f8b34070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.411+0000 7f8b32ffd640 1 --2- 172.21.15.5:0/1106054793 >> v2:172.21.15.154:3300/0 conn(0x7f8b34158ce0 0x7f8b34070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.411+0000 7f8b32ffd640 1 -- 172.21.15.5:0/1106054793 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b340cbdd0 con 0x7f8b340c8ad0 2023-07-14T13:11:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.411+0000 7f8b32ffd640 1 -- 172.21.15.5:0/1106054793 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f8b28001680 con 0x7f8b340c8ad0 2023-07-14T13:11:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.411+0000 7f8b32ffd640 1 -- 172.21.15.5:0/1106054793 >> v1:172.21.15.5:6789/0 conn(0x7f8b340c8ad0 legacy=0x7f8b340c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.411+0000 7f8b32ffd640 1 --2- 172.21.15.5:0/1106054793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b1c003980 0x7f8b1c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:34.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.411+0000 7f8b32ffd640 1 --2- 172.21.15.5:0/1106054793 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b340c9730 0x7f8b1c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:34.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.411+0000 7f8b32ffd640 1 --2- 172.21.15.5:0/1106054793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b1c004d10 0x7f8b1c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:34.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.411+0000 7f8b32ffd640 1 -- 172.21.15.5:0/1106054793 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b340b0ff0 con 0x7f8b1c004d10 2023-07-14T13:11:34.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.411+0000 7f8b32ffd640 1 -- 172.21.15.5:0/1106054793 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b34070c80 con 0x7f8b1c003980 2023-07-14T13:11:34.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.411+0000 7f8b32ffd640 1 -- 172.21.15.5:0/1106054793 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c00dc50 con 0x7f8b340c9730 2023-07-14T13:11:34.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.411+0000 7f8b38e96640 1 --2- 172.21.15.5:0/1106054793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b1c004d10 0x7f8b1c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:34.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.411+0000 7f8b33fff640 1 --2- 172.21.15.5:0/1106054793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b1c003980 0x7f8b1c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:34.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.411+0000 7f8b337fe640 1 --2- 172.21.15.5:0/1106054793 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b340c9730 0x7f8b1c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:34.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.411+0000 7f8b38e96640 1 -- 172.21.15.5:0/1106054793 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b340c9730 msgr2=0x7f8b1c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:34.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.411+0000 7f8b38e96640 1 --2- 172.21.15.5:0/1106054793 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b340c9730 0x7f8b1c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:34.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.411+0000 7f8b38e96640 1 -- 172.21.15.5:0/1106054793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b1c003980 msgr2=0x7f8b1c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:34.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.411+0000 7f8b38e96640 1 --2- 172.21.15.5:0/1106054793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b1c003980 0x7f8b1c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:34.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.411+0000 7f8b38e96640 1 -- 172.21.15.5:0/1106054793 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c003530 con 0x7f8b1c004d10 2023-07-14T13:11:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.415+0000 7f8b38e96640 1 --2- 172.21.15.5:0/1106054793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b1c004d10 0x7f8b1c005180 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f8b340b0d90 tx=0x7f8b2c01cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc6fea57bd709bb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.415+0000 7f8b32ffd640 1 -- 172.21.15.5:0/1106054793 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c0a59d0 con 0x7f8b1c004d10 2023-07-14T13:11:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.415+0000 7f8b32ffd640 1 -- 172.21.15.5:0/1106054793 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2c00f040 con 0x7f8b1c004d10 2023-07-14T13:11:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.415+0000 7f8b32ffd640 1 -- 172.21.15.5:0/1106054793 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c0a5d70 con 0x7f8b1c004d10 2023-07-14T13:11:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.415+0000 7f8b3a8f9640 1 -- 172.21.15.5:0/1106054793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b1c004d10 msgr2=0x7f8b1c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.415+0000 7f8b3a8f9640 1 --2- 172.21.15.5:0/1106054793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b1c004d10 0x7f8b1c005180 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f8b340b0d90 tx=0x7f8b2c01cbd0 comp rx=0 tx=0).stop 2023-07-14T13:11:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.415+0000 7f8b38e96640 1 -- 172.21.15.5:0/1106054793 reap_dead start 2023-07-14T13:11:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.415+0000 7f8b3a8f9640 1 -- 172.21.15.5:0/1106054793 shutdown_connections 2023-07-14T13:11:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.415+0000 7f8b3a8f9640 1 -- 172.21.15.5:0/1106054793 >> 172.21.15.5:0/1106054793 conn(0x7f8b340afcf0 msgr2=0x7f8b340b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.415+0000 7f8b3a8f9640 1 -- 172.21.15.5:0/1106054793 shutdown_connections 2023-07-14T13:11:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.415+0000 7f8b3a8f9640 1 -- 172.21.15.5:0/1106054793 wait complete. 2023-07-14T13:11:34.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.415+0000 7f8b3a8f9640 1 Processor -- start 2023-07-14T13:11:34.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.415+0000 7f8b3a8f9640 1 -- start start 2023-07-14T13:11:34.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.415+0000 7f8b3a8f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b1c004d10 0x7f8b34154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:34.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.415+0000 7f8b3a8f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b340b1e90 0x7f8b340c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:34.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.415+0000 7f8b3a8f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b340c48e0 0x7f8b340b3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:34.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.415+0000 7f8b3a8f9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b340c3a60 con 0x7f8b340c48e0 2023-07-14T13:11:34.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.415+0000 7f8b3a8f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b340b2420 con 0x7f8b340b1e90 2023-07-14T13:11:34.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.415+0000 7f8b3a8f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b340b2700 con 0x7f8b1c004d10 2023-07-14T13:11:34.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.419+0000 7f8b38e96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b340c48e0 0x7f8b340b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:34.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.419+0000 7f8b38e96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b340c48e0 0x7f8b340b3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57468/0 (socket says 172.21.15.5:57468) 2023-07-14T13:11:34.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.419+0000 7f8b38e96640 1 -- 172.21.15.5:0/4216175726 learned_addr learned my addr 172.21.15.5:0/4216175726 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:34.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.419+0000 7f8b337fe640 1 --2- 172.21.15.5:0/4216175726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b340b1e90 0x7f8b340c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:34.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.419+0000 7f8b33fff640 1 --2- 172.21.15.5:0/4216175726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b1c004d10 0x7f8b34154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:34.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.419+0000 7f8b38e96640 1 -- 172.21.15.5:0/4216175726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b1c004d10 msgr2=0x7f8b34154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:34.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.419+0000 7f8b38e96640 1 --2- 172.21.15.5:0/4216175726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b1c004d10 0x7f8b34154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:34.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.419+0000 7f8b38e96640 1 -- 172.21.15.5:0/4216175726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b340b1e90 msgr2=0x7f8b340c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:34.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.419+0000 7f8b38e96640 1 --2- 172.21.15.5:0/4216175726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b340b1e90 0x7f8b340c43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:34.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.419+0000 7f8b38e96640 1 -- 172.21.15.5:0/4216175726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b340b29e0 con 0x7f8b340c48e0 2023-07-14T13:11:34.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.419+0000 7f8b38e96640 1 --2- 172.21.15.5:0/4216175726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b340c48e0 0x7f8b340b3670 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c002240 tx=0x7f8b2c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:34.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.419+0000 7f8b30ff9640 1 -- 172.21.15.5:0/4216175726 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c0039a0 con 0x7f8b340c48e0 2023-07-14T13:11:34.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.419+0000 7f8b30ff9640 1 -- 172.21.15.5:0/4216175726 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2c003b00 con 0x7f8b340c48e0 2023-07-14T13:11:34.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.419+0000 7f8b30ff9640 1 -- 172.21.15.5:0/4216175726 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c003e70 con 0x7f8b340c48e0 2023-07-14T13:11:34.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.419+0000 7f8b3a8f9640 1 -- 172.21.15.5:0/4216175726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b340b2cc0 con 0x7f8b340c48e0 2023-07-14T13:11:34.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.419+0000 7f8b3a8f9640 1 -- 172.21.15.5:0/4216175726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b340b3bb0 con 0x7f8b340c48e0 2023-07-14T13:11:34.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.419+0000 7f8b3a8f9640 1 -- 172.21.15.5:0/4216175726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b340ca1a0 con 0x7f8b340c48e0 2023-07-14T13:11:34.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.419+0000 7f8b30ff9640 1 -- 172.21.15.5:0/4216175726 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8b2c0b4040 con 0x7f8b340c48e0 2023-07-14T13:11:34.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.423+0000 7f8b30ff9640 1 --2- 172.21.15.5:0/4216175726 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f8b200663d0 0x7f8b20068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:34.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.423+0000 7f8b30ff9640 1 -- 172.21.15.5:0/4216175726 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8b2c11d5f0 con 0x7f8b340c48e0 2023-07-14T13:11:34.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.423+0000 7f8b33fff640 1 --2- 172.21.15.5:0/4216175726 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f8b200663d0 0x7f8b20068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:34.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.423+0000 7f8b33fff640 1 --2- 172.21.15.5:0/4216175726 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f8b200663d0 0x7f8b20068880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8b340c69d0 tx=0x7f8b24009190 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:34.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.423+0000 7f8b30ff9640 1 -- 172.21.15.5:0/4216175726 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f8b2c0ea9a0 con 0x7f8b340c48e0 2023-07-14T13:11:34.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.579+0000 7f8b3a8f9640 1 -- 172.21.15.5:0/4216175726 --> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b341590b0 con 0x7f8b200663d0 2023-07-14T13:11:34.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.587+0000 7f8b30ff9640 1 -- 172.21.15.5:0/4216175726 <== mgr.7657 v2:172.21.15.154:6832/938367911 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311738 (secure 0 0 0) 0x7f8b24019070 con 0x7f8b200663d0 2023-07-14T13:11:34.626 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:11:34.627 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:11:34.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.591+0000 7f8b3a8f9640 1 -- 172.21.15.5:0/4216175726 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f8b200663d0 msgr2=0x7f8b20068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:34.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.591+0000 7f8b3a8f9640 1 --2- 172.21.15.5:0/4216175726 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f8b200663d0 0x7f8b20068880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8b340c69d0 tx=0x7f8b24009190 comp rx=0 tx=0).stop 2023-07-14T13:11:34.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.591+0000 7f8b3a8f9640 1 -- 172.21.15.5:0/4216175726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b340c48e0 msgr2=0x7f8b340b3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:34.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.591+0000 7f8b3a8f9640 1 --2- 172.21.15.5:0/4216175726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b340c48e0 0x7f8b340b3670 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c002240 tx=0x7f8b2c009750 comp rx=0 tx=0).stop 2023-07-14T13:11:34.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.591+0000 7f8b3a8f9640 1 -- 172.21.15.5:0/4216175726 shutdown_connections 2023-07-14T13:11:34.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.591+0000 7f8b3a8f9640 1 --2- 172.21.15.5:0/4216175726 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f8b200663d0 0x7f8b20068880 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:34.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.591+0000 7f8b3a8f9640 1 --2- 172.21.15.5:0/4216175726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b340c48e0 0x7f8b340b3670 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:34.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.591+0000 7f8b3a8f9640 1 --2- 172.21.15.5:0/4216175726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b340b1e90 0x7f8b340c43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:34.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.591+0000 7f8b3a8f9640 1 --2- 172.21.15.5:0/4216175726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b1c004d10 0x7f8b34154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:34.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.591+0000 7f8b3a8f9640 1 -- 172.21.15.5:0/4216175726 >> 172.21.15.5:0/4216175726 conn(0x7f8b340afcf0 msgr2=0x7f8b3406ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:34.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.591+0000 7f8b3a8f9640 1 -- 172.21.15.5:0/4216175726 shutdown_connections 2023-07-14T13:11:34.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:34.591+0000 7f8b3a8f9640 1 -- 172.21.15.5:0/4216175726 wait complete. 2023-07-14T13:11:34.644 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-14T13:11:34.582561+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":404,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":266,"ondisk_log_size":266,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":202,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":340576,"kb_used_data":13472,"kb_used_omap":0,"kb_used_meta":327040,"kb_avail":754634144,"statfs":{"total":773094113280,"available":772745363456,"internally_reserved":0,"allocated":13795328,"data_stored":7546198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":334888960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.695059"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117720+0000","last_change":"2023-07-14T13:11:28.937505+0000","last_active":"2023-07-14T13:11:30.117720+0000","last_peered":"2023-07-14T13:11:30.117720+0000","last_clean":"2023-07-14T13:11:30.117720+0000","last_became_active":"2023-07-14T13:11:28.937183+0000","last_became_peered":"2023-07-14T13:11:28.937183+0000","last_unstale":"2023-07-14T13:11:30.117720+0000","last_undegraded":"2023-07-14T13:11:30.117720+0000","last_fullsized":"2023-07-14T13:11:30.117720+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:58:02.301291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120835+0000","last_change":"2023-07-14T13:11:28.932438+0000","last_active":"2023-07-14T13:11:30.120835+0000","last_peered":"2023-07-14T13:11:30.120835+0000","last_clean":"2023-07-14T13:11:30.120835+0000","last_became_active":"2023-07-14T13:11:28.932140+0000","last_became_peered":"2023-07-14T13:11:28.932140+0000","last_unstale":"2023-07-14T13:11:30.120835+0000","last_undegraded":"2023-07-14T13:11:30.120835+0000","last_fullsized":"2023-07-14T13:11:30.120835+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:30:57.128682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117283+0000","last_change":"2023-07-14T13:11:28.937015+0000","last_active":"2023-07-14T13:11:30.117283+0000","last_peered":"2023-07-14T13:11:30.117283+0000","last_clean":"2023-07-14T13:11:30.117283+0000","last_became_active":"2023-07-14T13:11:28.936673+0000","last_became_peered":"2023-07-14T13:11:28.936673+0000","last_unstale":"2023-07-14T13:11:30.117283+0000","last_undegraded":"2023-07-14T13:11:30.117283+0000","last_fullsized":"2023-07-14T13:11:30.117283+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:51:41.805311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116581+0000","last_change":"2023-07-14T13:11:28.938214+0000","last_active":"2023-07-14T13:11:30.116581+0000","last_peered":"2023-07-14T13:11:30.116581+0000","last_clean":"2023-07-14T13:11:30.116581+0000","last_became_active":"2023-07-14T13:11:28.937731+0000","last_became_peered":"2023-07-14T13:11:28.937731+0000","last_unstale":"2023-07-14T13:11:30.116581+0000","last_undegraded":"2023-07-14T13:11:30.116581+0000","last_fullsized":"2023-07-14T13:11:30.116581+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:03:51.951611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.938417+0000","last_change":"2023-07-14T13:11:28.933026+0000","last_active":"2023-07-14T13:11:29.938417+0000","last_peered":"2023-07-14T13:11:29.938417+0000","last_clean":"2023-07-14T13:11:29.938417+0000","last_became_active":"2023-07-14T13:11:28.932630+0000","last_became_peered":"2023-07-14T13:11:28.932630+0000","last_unstale":"2023-07-14T13:11:29.938417+0000","last_undegraded":"2023-07-14T13:11:29.938417+0000","last_fullsized":"2023-07-14T13:11:29.938417+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:24:50.470926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120102+0000","last_change":"2023-07-14T13:11:28.936823+0000","last_active":"2023-07-14T13:11:30.120102+0000","last_peered":"2023-07-14T13:11:30.120102+0000","last_clean":"2023-07-14T13:11:30.120102+0000","last_became_active":"2023-07-14T13:11:28.933367+0000","last_became_peered":"2023-07-14T13:11:28.933367+0000","last_unstale":"2023-07-14T13:11:30.120102+0000","last_undegraded":"2023-07-14T13:11:30.120102+0000","last_fullsized":"2023-07-14T13:11:30.120102+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:07:55.568201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120212+0000","last_change":"2023-07-14T13:11:28.936472+0000","last_active":"2023-07-14T13:11:30.120212+0000","last_peered":"2023-07-14T13:11:30.120212+0000","last_clean":"2023-07-14T13:11:30.120212+0000","last_became_active":"2023-07-14T13:11:28.933301+0000","last_became_peered":"2023-07-14T13:11:28.933301+0000","last_unstale":"2023-07-14T13:11:30.120212+0000","last_undegraded":"2023-07-14T13:11:30.120212+0000","last_fullsized":"2023-07-14T13:11:30.120212+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:28:29.164683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116032+0000","last_change":"2023-07-14T13:11:28.932903+0000","last_active":"2023-07-14T13:11:30.116032+0000","last_peered":"2023-07-14T13:11:30.116032+0000","last_clean":"2023-07-14T13:11:30.116032+0000","last_became_active":"2023-07-14T13:11:28.932332+0000","last_became_peered":"2023-07-14T13:11:28.932332+0000","last_unstale":"2023-07-14T13:11:30.116032+0000","last_undegraded":"2023-07-14T13:11:30.116032+0000","last_fullsized":"2023-07-14T13:11:30.116032+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:57:10.895292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.121412+0000","last_change":"2023-07-14T13:11:28.943138+0000","last_active":"2023-07-14T13:11:30.121412+0000","last_peered":"2023-07-14T13:11:30.121412+0000","last_clean":"2023-07-14T13:11:30.121412+0000","last_became_active":"2023-07-14T13:11:28.942855+0000","last_became_peered":"2023-07-14T13:11:28.942855+0000","last_unstale":"2023-07-14T13:11:30.121412+0000","last_undegraded":"2023-07-14T13:11:30.121412+0000","last_fullsized":"2023-07-14T13:11:30.121412+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:38:54.506417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.938760+0000","last_change":"2023-07-14T13:11:28.940823+0000","last_active":"2023-07-14T13:11:29.938760+0000","last_peered":"2023-07-14T13:11:29.938760+0000","last_clean":"2023-07-14T13:11:29.938760+0000","last_became_active":"2023-07-14T13:11:28.940556+0000","last_became_peered":"2023-07-14T13:11:28.940556+0000","last_unstale":"2023-07-14T13:11:29.938760+0000","last_undegraded":"2023-07-14T13:11:29.938760+0000","last_fullsized":"2023-07-14T13:11:29.938760+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:47:20.135231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120742+0000","last_change":"2023-07-14T13:11:28.944863+0000","last_active":"2023-07-14T13:11:30.120742+0000","last_peered":"2023-07-14T13:11:30.120742+0000","last_clean":"2023-07-14T13:11:30.120742+0000","last_became_active":"2023-07-14T13:11:28.944482+0000","last_became_peered":"2023-07-14T13:11:28.944482+0000","last_unstale":"2023-07-14T13:11:30.120742+0000","last_undegraded":"2023-07-14T13:11:30.120742+0000","last_fullsized":"2023-07-14T13:11:30.120742+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:34:55.653766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.943472+0000","last_change":"2023-07-14T13:11:28.945658+0000","last_active":"2023-07-14T13:11:29.943472+0000","last_peered":"2023-07-14T13:11:29.943472+0000","last_clean":"2023-07-14T13:11:29.943472+0000","last_became_active":"2023-07-14T13:11:28.945365+0000","last_became_peered":"2023-07-14T13:11:28.945365+0000","last_unstale":"2023-07-14T13:11:29.943472+0000","last_undegraded":"2023-07-14T13:11:29.943472+0000","last_fullsized":"2023-07-14T13:11:29.943472+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:23:25.248124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116678+0000","last_change":"2023-07-14T13:11:28.938807+0000","last_active":"2023-07-14T13:11:30.116678+0000","last_peered":"2023-07-14T13:11:30.116678+0000","last_clean":"2023-07-14T13:11:30.116678+0000","last_became_active":"2023-07-14T13:11:28.938531+0000","last_became_peered":"2023-07-14T13:11:28.938531+0000","last_unstale":"2023-07-14T13:11:30.116678+0000","last_undegraded":"2023-07-14T13:11:30.116678+0000","last_fullsized":"2023-07-14T13:11:30.116678+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:02:12.615212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.119899+0000","last_change":"2023-07-14T13:11:28.941055+0000","last_active":"2023-07-14T13:11:30.119899+0000","last_peered":"2023-07-14T13:11:30.119899+0000","last_clean":"2023-07-14T13:11:30.119899+0000","last_became_active":"2023-07-14T13:11:28.940793+0000","last_became_peered":"2023-07-14T13:11:28.940793+0000","last_unstale":"2023-07-14T13:11:30.119899+0000","last_undegraded":"2023-07-14T13:11:30.119899+0000","last_fullsized":"2023-07-14T13:11:30.119899+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:06:11.358013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.121007+0000","last_change":"2023-07-14T13:11:28.939981+0000","last_active":"2023-07-14T13:11:30.121007+0000","last_peered":"2023-07-14T13:11:30.121007+0000","last_clean":"2023-07-14T13:11:30.121007+0000","last_became_active":"2023-07-14T13:11:28.939716+0000","last_became_peered":"2023-07-14T13:11:28.939716+0000","last_unstale":"2023-07-14T13:11:30.121007+0000","last_undegraded":"2023-07-14T13:11:30.121007+0000","last_fullsized":"2023-07-14T13:11:30.121007+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:16:31.731466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.119767+0000","last_change":"2023-07-14T13:11:28.933967+0000","last_active":"2023-07-14T13:11:30.119767+0000","last_peered":"2023-07-14T13:11:30.119767+0000","last_clean":"2023-07-14T13:11:30.119767+0000","last_became_active":"2023-07-14T13:11:28.933687+0000","last_became_peered":"2023-07-14T13:11:28.933687+0000","last_unstale":"2023-07-14T13:11:30.119767+0000","last_undegraded":"2023-07-14T13:11:30.119767+0000","last_fullsized":"2023-07-14T13:11:30.119767+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:07:02.680334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117793+0000","last_change":"2023-07-14T13:11:28.939066+0000","last_active":"2023-07-14T13:11:30.117793+0000","last_peered":"2023-07-14T13:11:30.117793+0000","last_clean":"2023-07-14T13:11:30.117793+0000","last_became_active":"2023-07-14T13:11:28.938421+0000","last_became_peered":"2023-07-14T13:11:28.938421+0000","last_unstale":"2023-07-14T13:11:30.117793+0000","last_undegraded":"2023-07-14T13:11:30.117793+0000","last_fullsized":"2023-07-14T13:11:30.117793+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:58:27.623214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120976+0000","last_change":"2023-07-14T13:11:28.936571+0000","last_active":"2023-07-14T13:11:30.120976+0000","last_peered":"2023-07-14T13:11:30.120976+0000","last_clean":"2023-07-14T13:11:30.120976+0000","last_became_active":"2023-07-14T13:11:28.933226+0000","last_became_peered":"2023-07-14T13:11:28.933226+0000","last_unstale":"2023-07-14T13:11:30.120976+0000","last_undegraded":"2023-07-14T13:11:30.120976+0000","last_fullsized":"2023-07-14T13:11:30.120976+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:39.146219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117419+0000","last_change":"2023-07-14T13:11:28.942536+0000","last_active":"2023-07-14T13:11:30.117419+0000","last_peered":"2023-07-14T13:11:30.117419+0000","last_clean":"2023-07-14T13:11:30.117419+0000","last_became_active":"2023-07-14T13:11:28.941912+0000","last_became_peered":"2023-07-14T13:11:28.941912+0000","last_unstale":"2023-07-14T13:11:30.117419+0000","last_undegraded":"2023-07-14T13:11:30.117419+0000","last_fullsized":"2023-07-14T13:11:30.117419+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:08:16.990146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.943662+0000","last_change":"2023-07-14T13:11:28.934993+0000","last_active":"2023-07-14T13:11:29.943662+0000","last_peered":"2023-07-14T13:11:29.943662+0000","last_clean":"2023-07-14T13:11:29.943662+0000","last_became_active":"2023-07-14T13:11:28.934694+0000","last_became_peered":"2023-07-14T13:11:28.934694+0000","last_unstale":"2023-07-14T13:11:29.943662+0000","last_undegraded":"2023-07-14T13:11:29.943662+0000","last_fullsized":"2023-07-14T13:11:29.943662+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:02:30.834694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116661+0000","last_change":"2023-07-14T13:11:28.939892+0000","last_active":"2023-07-14T13:11:30.116661+0000","last_peered":"2023-07-14T13:11:30.116661+0000","last_clean":"2023-07-14T13:11:30.116661+0000","last_became_active":"2023-07-14T13:11:28.939375+0000","last_became_peered":"2023-07-14T13:11:28.939375+0000","last_unstale":"2023-07-14T13:11:30.116661+0000","last_undegraded":"2023-07-14T13:11:30.116661+0000","last_fullsized":"2023-07-14T13:11:30.116661+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:38:52.540198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.938356+0000","last_change":"2023-07-14T13:11:28.942536+0000","last_active":"2023-07-14T13:11:29.938356+0000","last_peered":"2023-07-14T13:11:29.938356+0000","last_clean":"2023-07-14T13:11:29.938356+0000","last_became_active":"2023-07-14T13:11:28.942263+0000","last_became_peered":"2023-07-14T13:11:28.942263+0000","last_unstale":"2023-07-14T13:11:29.938356+0000","last_undegraded":"2023-07-14T13:11:29.938356+0000","last_fullsized":"2023-07-14T13:11:29.938356+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:05:52.518762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116543+0000","last_change":"2023-07-14T13:11:28.936877+0000","last_active":"2023-07-14T13:11:30.116543+0000","last_peered":"2023-07-14T13:11:30.116543+0000","last_clean":"2023-07-14T13:11:30.116543+0000","last_became_active":"2023-07-14T13:11:28.936544+0000","last_became_peered":"2023-07-14T13:11:28.936544+0000","last_unstale":"2023-07-14T13:11:30.116543+0000","last_undegraded":"2023-07-14T13:11:30.116543+0000","last_fullsized":"2023-07-14T13:11:30.116543+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:49:35.976553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.938485+0000","last_change":"2023-07-14T13:11:28.930506+0000","last_active":"2023-07-14T13:11:29.938485+0000","last_peered":"2023-07-14T13:11:29.938485+0000","last_clean":"2023-07-14T13:11:29.938485+0000","last_became_active":"2023-07-14T13:11:28.930210+0000","last_became_peered":"2023-07-14T13:11:28.930210+0000","last_unstale":"2023-07-14T13:11:29.938485+0000","last_undegraded":"2023-07-14T13:11:29.938485+0000","last_fullsized":"2023-07-14T13:11:29.938485+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:21:12.219751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.943426+0000","last_change":"2023-07-14T13:11:28.942344+0000","last_active":"2023-07-14T13:11:29.943426+0000","last_peered":"2023-07-14T13:11:29.943426+0000","last_clean":"2023-07-14T13:11:29.943426+0000","last_became_active":"2023-07-14T13:11:28.942086+0000","last_became_peered":"2023-07-14T13:11:28.942086+0000","last_unstale":"2023-07-14T13:11:29.943426+0000","last_undegraded":"2023-07-14T13:11:29.943426+0000","last_fullsized":"2023-07-14T13:11:29.943426+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:52:34.146671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.943543+0000","last_change":"2023-07-14T13:11:28.943678+0000","last_active":"2023-07-14T13:11:29.943543+0000","last_peered":"2023-07-14T13:11:29.943543+0000","last_clean":"2023-07-14T13:11:29.943543+0000","last_became_active":"2023-07-14T13:11:28.943402+0000","last_became_peered":"2023-07-14T13:11:28.943402+0000","last_unstale":"2023-07-14T13:11:29.943543+0000","last_undegraded":"2023-07-14T13:11:29.943543+0000","last_fullsized":"2023-07-14T13:11:29.943543+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:03:51.951611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120864+0000","last_change":"2023-07-14T13:11:28.936224+0000","last_active":"2023-07-14T13:11:30.120864+0000","last_peered":"2023-07-14T13:11:30.120864+0000","last_clean":"2023-07-14T13:11:30.120864+0000","last_became_active":"2023-07-14T13:11:28.935811+0000","last_became_peered":"2023-07-14T13:11:28.935811+0000","last_unstale":"2023-07-14T13:11:30.120864+0000","last_undegraded":"2023-07-14T13:11:30.120864+0000","last_fullsized":"2023-07-14T13:11:30.120864+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:29:26.184090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120270+0000","last_change":"2023-07-14T13:11:28.937333+0000","last_active":"2023-07-14T13:11:30.120270+0000","last_peered":"2023-07-14T13:11:30.120270+0000","last_clean":"2023-07-14T13:11:30.120270+0000","last_became_active":"2023-07-14T13:11:28.936918+0000","last_became_peered":"2023-07-14T13:11:28.936918+0000","last_unstale":"2023-07-14T13:11:30.120270+0000","last_undegraded":"2023-07-14T13:11:30.120270+0000","last_fullsized":"2023-07-14T13:11:30.120270+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:44:08.954326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116795+0000","last_change":"2023-07-14T13:11:28.927105+0000","last_active":"2023-07-14T13:11:30.116795+0000","last_peered":"2023-07-14T13:11:30.116795+0000","last_clean":"2023-07-14T13:11:30.116795+0000","last_became_active":"2023-07-14T13:11:28.926773+0000","last_became_peered":"2023-07-14T13:11:28.926773+0000","last_unstale":"2023-07-14T13:11:30.116795+0000","last_undegraded":"2023-07-14T13:11:30.116795+0000","last_fullsized":"2023-07-14T13:11:30.116795+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:03.021424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.943234+0000","last_change":"2023-07-14T13:11:28.942020+0000","last_active":"2023-07-14T13:11:29.943234+0000","last_peered":"2023-07-14T13:11:29.943234+0000","last_clean":"2023-07-14T13:11:29.943234+0000","last_became_active":"2023-07-14T13:11:28.941664+0000","last_became_peered":"2023-07-14T13:11:28.941664+0000","last_unstale":"2023-07-14T13:11:29.943234+0000","last_undegraded":"2023-07-14T13:11:29.943234+0000","last_fullsized":"2023-07-14T13:11:29.943234+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:02:12.615212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120358+0000","last_change":"2023-07-14T13:11:28.930417+0000","last_active":"2023-07-14T13:11:30.120358+0000","last_peered":"2023-07-14T13:11:30.120358+0000","last_clean":"2023-07-14T13:11:30.120358+0000","last_became_active":"2023-07-14T13:11:28.929973+0000","last_became_peered":"2023-07-14T13:11:28.929973+0000","last_unstale":"2023-07-14T13:11:30.120358+0000","last_undegraded":"2023-07-14T13:11:30.120358+0000","last_fullsized":"2023-07-14T13:11:30.120358+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:33:25.503154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116659+0000","last_change":"2023-07-14T13:11:28.933847+0000","last_active":"2023-07-14T13:11:30.116659+0000","last_peered":"2023-07-14T13:11:30.116659+0000","last_clean":"2023-07-14T13:11:30.116659+0000","last_became_active":"2023-07-14T13:11:28.933462+0000","last_became_peered":"2023-07-14T13:11:28.933462+0000","last_unstale":"2023-07-14T13:11:30.116659+0000","last_undegraded":"2023-07-14T13:11:30.116659+0000","last_fullsized":"2023-07-14T13:11:30.116659+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:25:19.872268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117224+0000","last_change":"2023-07-14T13:11:28.941609+0000","last_active":"2023-07-14T13:11:30.117224+0000","last_peered":"2023-07-14T13:11:30.117224+0000","last_clean":"2023-07-14T13:11:30.117224+0000","last_became_active":"2023-07-14T13:11:28.941318+0000","last_became_peered":"2023-07-14T13:11:28.941318+0000","last_unstale":"2023-07-14T13:11:30.117224+0000","last_undegraded":"2023-07-14T13:11:30.117224+0000","last_fullsized":"2023-07-14T13:11:30.117224+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:38:27.906860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"126'4","reported_seq":17,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117096+0000","last_change":"2023-07-14T13:11:27.912001+0000","last_active":"2023-07-14T13:11:30.117096+0000","last_peered":"2023-07-14T13:11:30.117096+0000","last_clean":"2023-07-14T13:11:30.117096+0000","last_became_active":"2023-07-14T13:11:27.911416+0000","last_became_peered":"2023-07-14T13:11:27.911416+0000","last_unstale":"2023-07-14T13:11:30.117096+0000","last_undegraded":"2023-07-14T13:11:30.117096+0000","last_fullsized":"2023-07-14T13:11:30.117096+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:41:01.159408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116780+0000","last_change":"2023-07-14T13:11:28.932160+0000","last_active":"2023-07-14T13:11:30.116780+0000","last_peered":"2023-07-14T13:11:30.116780+0000","last_clean":"2023-07-14T13:11:30.116780+0000","last_became_active":"2023-07-14T13:11:28.931854+0000","last_became_peered":"2023-07-14T13:11:28.931854+0000","last_unstale":"2023-07-14T13:11:30.116780+0000","last_undegraded":"2023-07-14T13:11:30.116780+0000","last_fullsized":"2023-07-14T13:11:30.116780+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:45:40.991356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"126'1","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117565+0000","last_change":"2023-07-14T13:11:27.908608+0000","last_active":"2023-07-14T13:11:30.117565+0000","last_peered":"2023-07-14T13:11:30.117565+0000","last_clean":"2023-07-14T13:11:30.117565+0000","last_became_active":"2023-07-14T13:11:27.908336+0000","last_became_peered":"2023-07-14T13:11:27.908336+0000","last_unstale":"2023-07-14T13:11:30.117565+0000","last_undegraded":"2023-07-14T13:11:30.117565+0000","last_fullsized":"2023-07-14T13:11:30.117565+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:40:09.057376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.943566+0000","last_change":"2023-07-14T13:11:28.934926+0000","last_active":"2023-07-14T13:11:29.943566+0000","last_peered":"2023-07-14T13:11:29.943566+0000","last_clean":"2023-07-14T13:11:29.943566+0000","last_became_active":"2023-07-14T13:11:28.934614+0000","last_became_peered":"2023-07-14T13:11:28.934614+0000","last_unstale":"2023-07-14T13:11:29.943566+0000","last_undegraded":"2023-07-14T13:11:29.943566+0000","last_fullsized":"2023-07-14T13:11:29.943566+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:50:51.874884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"126'2","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.943628+0000","last_change":"2023-07-14T13:11:27.909451+0000","last_active":"2023-07-14T13:11:29.943628+0000","last_peered":"2023-07-14T13:11:29.943628+0000","last_clean":"2023-07-14T13:11:29.943628+0000","last_became_active":"2023-07-14T13:11:27.909180+0000","last_became_peered":"2023-07-14T13:11:27.909180+0000","last_unstale":"2023-07-14T13:11:29.943628+0000","last_undegraded":"2023-07-14T13:11:29.943628+0000","last_fullsized":"2023-07-14T13:11:29.943628+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:41:01.159408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.121035+0000","last_change":"2023-07-14T13:11:28.936619+0000","last_active":"2023-07-14T13:11:30.121035+0000","last_peered":"2023-07-14T13:11:30.121035+0000","last_clean":"2023-07-14T13:11:30.121035+0000","last_became_active":"2023-07-14T13:11:28.936351+0000","last_became_peered":"2023-07-14T13:11:28.936351+0000","last_unstale":"2023-07-14T13:11:30.121035+0000","last_undegraded":"2023-07-14T13:11:30.121035+0000","last_fullsized":"2023-07-14T13:11:30.121035+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:23:15.836746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"126'2","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.938855+0000","last_change":"2023-07-14T13:11:27.902198+0000","last_active":"2023-07-14T13:11:29.938855+0000","last_peered":"2023-07-14T13:11:29.938855+0000","last_clean":"2023-07-14T13:11:29.938855+0000","last_became_active":"2023-07-14T13:11:27.901878+0000","last_became_peered":"2023-07-14T13:11:27.901878+0000","last_unstale":"2023-07-14T13:11:29.938855+0000","last_undegraded":"2023-07-14T13:11:29.938855+0000","last_fullsized":"2023-07-14T13:11:29.938855+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:08:17.592126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116710+0000","last_change":"2023-07-14T13:11:28.939010+0000","last_active":"2023-07-14T13:11:30.116710+0000","last_peered":"2023-07-14T13:11:30.116710+0000","last_clean":"2023-07-14T13:11:30.116710+0000","last_became_active":"2023-07-14T13:11:28.938156+0000","last_became_peered":"2023-07-14T13:11:28.938156+0000","last_unstale":"2023-07-14T13:11:30.116710+0000","last_undegraded":"2023-07-14T13:11:30.116710+0000","last_fullsized":"2023-07-14T13:11:30.116710+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:50:51.874884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"126'1","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.119935+0000","last_change":"2023-07-14T13:11:27.915760+0000","last_active":"2023-07-14T13:11:30.119935+0000","last_peered":"2023-07-14T13:11:30.119935+0000","last_clean":"2023-07-14T13:11:30.119935+0000","last_became_active":"2023-07-14T13:11:27.915444+0000","last_became_peered":"2023-07-14T13:11:27.915444+0000","last_unstale":"2023-07-14T13:11:30.119935+0000","last_undegraded":"2023-07-14T13:11:30.119935+0000","last_fullsized":"2023-07-14T13:11:30.119935+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:45:50.882715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117549+0000","last_change":"2023-07-14T13:11:28.942716+0000","last_active":"2023-07-14T13:11:30.117549+0000","last_peered":"2023-07-14T13:11:30.117549+0000","last_clean":"2023-07-14T13:11:30.117549+0000","last_became_active":"2023-07-14T13:11:28.942265+0000","last_became_peered":"2023-07-14T13:11:28.942265+0000","last_unstale":"2023-07-14T13:11:30.117549+0000","last_undegraded":"2023-07-14T13:11:30.117549+0000","last_fullsized":"2023-07-14T13:11:30.117549+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:56:27.033366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"126'1","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120584+0000","last_change":"2023-07-14T13:11:27.904817+0000","last_active":"2023-07-14T13:11:30.120584+0000","last_peered":"2023-07-14T13:11:30.120584+0000","last_clean":"2023-07-14T13:11:30.120584+0000","last_became_active":"2023-07-14T13:11:27.904417+0000","last_became_peered":"2023-07-14T13:11:27.904417+0000","last_unstale":"2023-07-14T13:11:30.120584+0000","last_undegraded":"2023-07-14T13:11:30.120584+0000","last_fullsized":"2023-07-14T13:11:30.120584+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:32:34.457116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.121113+0000","last_change":"2023-07-14T13:11:28.937605+0000","last_active":"2023-07-14T13:11:30.121113+0000","last_peered":"2023-07-14T13:11:30.121113+0000","last_clean":"2023-07-14T13:11:30.121113+0000","last_became_active":"2023-07-14T13:11:28.937304+0000","last_became_peered":"2023-07-14T13:11:28.937304+0000","last_unstale":"2023-07-14T13:11:30.121113+0000","last_undegraded":"2023-07-14T13:11:30.121113+0000","last_fullsized":"2023-07-14T13:11:30.121113+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:21:06.348199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.943065+0000","last_change":"2023-07-14T13:11:27.904887+0000","last_active":"2023-07-14T13:11:29.943065+0000","last_peered":"2023-07-14T13:11:29.943065+0000","last_clean":"2023-07-14T13:11:29.943065+0000","last_became_active":"2023-07-14T13:11:27.904566+0000","last_became_peered":"2023-07-14T13:11:27.904566+0000","last_unstale":"2023-07-14T13:11:29.943065+0000","last_undegraded":"2023-07-14T13:11:29.943065+0000","last_fullsized":"2023-07-14T13:11:29.943065+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:03:54.991807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116981+0000","last_change":"2023-07-14T13:11:28.935923+0000","last_active":"2023-07-14T13:11:30.116981+0000","last_peered":"2023-07-14T13:11:30.116981+0000","last_clean":"2023-07-14T13:11:30.116981+0000","last_became_active":"2023-07-14T13:11:28.935609+0000","last_became_peered":"2023-07-14T13:11:28.935609+0000","last_unstale":"2023-07-14T13:11:30.116981+0000","last_undegraded":"2023-07-14T13:11:30.116981+0000","last_fullsized":"2023-07-14T13:11:30.116981+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:52:25.032576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116224+0000","last_change":"2023-07-14T13:11:27.903404+0000","last_active":"2023-07-14T13:11:30.116224+0000","last_peered":"2023-07-14T13:11:30.116224+0000","last_clean":"2023-07-14T13:11:30.116224+0000","last_became_active":"2023-07-14T13:11:27.903115+0000","last_became_peered":"2023-07-14T13:11:27.903115+0000","last_unstale":"2023-07-14T13:11:30.116224+0000","last_undegraded":"2023-07-14T13:11:30.116224+0000","last_fullsized":"2023-07-14T13:11:30.116224+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:03:54.991807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117082+0000","last_change":"2023-07-14T13:11:28.930562+0000","last_active":"2023-07-14T13:11:30.117082+0000","last_peered":"2023-07-14T13:11:30.117082+0000","last_clean":"2023-07-14T13:11:30.117082+0000","last_became_active":"2023-07-14T13:11:28.930253+0000","last_became_peered":"2023-07-14T13:11:28.930253+0000","last_unstale":"2023-07-14T13:11:30.117082+0000","last_undegraded":"2023-07-14T13:11:30.117082+0000","last_fullsized":"2023-07-14T13:11:30.117082+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:46:28.800518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.943564+0000","last_change":"2023-07-14T13:11:27.904996+0000","last_active":"2023-07-14T13:11:29.943564+0000","last_peered":"2023-07-14T13:11:29.943564+0000","last_clean":"2023-07-14T13:11:29.943564+0000","last_became_active":"2023-07-14T13:11:27.904702+0000","last_became_peered":"2023-07-14T13:11:27.904702+0000","last_unstale":"2023-07-14T13:11:29.943564+0000","last_undegraded":"2023-07-14T13:11:29.943564+0000","last_fullsized":"2023-07-14T13:11:29.943564+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:52:24.025324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.938314+0000","last_change":"2023-07-14T13:11:28.933993+0000","last_active":"2023-07-14T13:11:29.938314+0000","last_peered":"2023-07-14T13:11:29.938314+0000","last_clean":"2023-07-14T13:11:29.938314+0000","last_became_active":"2023-07-14T13:11:28.933686+0000","last_became_peered":"2023-07-14T13:11:28.933686+0000","last_unstale":"2023-07-14T13:11:29.938314+0000","last_undegraded":"2023-07-14T13:11:29.938314+0000","last_fullsized":"2023-07-14T13:11:29.938314+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:39:10.653914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116363+0000","last_change":"2023-07-14T13:11:27.900517+0000","last_active":"2023-07-14T13:11:30.116363+0000","last_peered":"2023-07-14T13:11:30.116363+0000","last_clean":"2023-07-14T13:11:30.116363+0000","last_became_active":"2023-07-14T13:11:27.900219+0000","last_became_peered":"2023-07-14T13:11:27.900219+0000","last_unstale":"2023-07-14T13:11:30.116363+0000","last_undegraded":"2023-07-14T13:11:30.116363+0000","last_fullsized":"2023-07-14T13:11:30.116363+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:10:05.871392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117423+0000","last_change":"2023-07-14T13:11:28.931301+0000","last_active":"2023-07-14T13:11:30.117423+0000","last_peered":"2023-07-14T13:11:30.117423+0000","last_clean":"2023-07-14T13:11:30.117423+0000","last_became_active":"2023-07-14T13:11:28.930986+0000","last_became_peered":"2023-07-14T13:11:28.930986+0000","last_unstale":"2023-07-14T13:11:30.117423+0000","last_undegraded":"2023-07-14T13:11:30.117423+0000","last_fullsized":"2023-07-14T13:11:30.117423+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:51:02.874714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"126'3","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120048+0000","last_change":"2023-07-14T13:11:27.911972+0000","last_active":"2023-07-14T13:11:30.120048+0000","last_peered":"2023-07-14T13:11:30.120048+0000","last_clean":"2023-07-14T13:11:30.120048+0000","last_became_active":"2023-07-14T13:11:27.911403+0000","last_became_peered":"2023-07-14T13:11:27.911403+0000","last_unstale":"2023-07-14T13:11:30.120048+0000","last_undegraded":"2023-07-14T13:11:30.120048+0000","last_fullsized":"2023-07-14T13:11:30.120048+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:25:24.234724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.938558+0000","last_change":"2023-07-14T13:11:28.931169+0000","last_active":"2023-07-14T13:11:29.938558+0000","last_peered":"2023-07-14T13:11:29.938558+0000","last_clean":"2023-07-14T13:11:29.938558+0000","last_became_active":"2023-07-14T13:11:28.930676+0000","last_became_peered":"2023-07-14T13:11:28.930676+0000","last_unstale":"2023-07-14T13:11:29.938558+0000","last_undegraded":"2023-07-14T13:11:29.938558+0000","last_fullsized":"2023-07-14T13:11:29.938558+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:43:50.415372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"126'6","reported_seq":19,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120511+0000","last_change":"2023-07-14T13:11:27.910905+0000","last_active":"2023-07-14T13:11:30.120511+0000","last_peered":"2023-07-14T13:11:30.120511+0000","last_clean":"2023-07-14T13:11:30.120511+0000","last_became_active":"2023-07-14T13:11:27.910550+0000","last_became_peered":"2023-07-14T13:11:27.910550+0000","last_unstale":"2023-07-14T13:11:30.120511+0000","last_undegraded":"2023-07-14T13:11:30.120511+0000","last_fullsized":"2023-07-14T13:11:30.120511+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:07:37.058280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120380+0000","last_change":"2023-07-14T13:11:28.940926+0000","last_active":"2023-07-14T13:11:30.120380+0000","last_peered":"2023-07-14T13:11:30.120380+0000","last_clean":"2023-07-14T13:11:30.120380+0000","last_became_active":"2023-07-14T13:11:28.940642+0000","last_became_peered":"2023-07-14T13:11:28.940642+0000","last_unstale":"2023-07-14T13:11:30.120380+0000","last_undegraded":"2023-07-14T13:11:30.120380+0000","last_fullsized":"2023-07-14T13:11:30.120380+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:39:00.032356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"126'2","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.938609+0000","last_change":"2023-07-14T13:11:27.907025+0000","last_active":"2023-07-14T13:11:29.938609+0000","last_peered":"2023-07-14T13:11:29.938609+0000","last_clean":"2023-07-14T13:11:29.938609+0000","last_became_active":"2023-07-14T13:11:27.906711+0000","last_became_peered":"2023-07-14T13:11:27.906711+0000","last_unstale":"2023-07-14T13:11:29.938609+0000","last_undegraded":"2023-07-14T13:11:29.938609+0000","last_fullsized":"2023-07-14T13:11:29.938609+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:35:47.101875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120385+0000","last_change":"2023-07-14T13:11:28.943363+0000","last_active":"2023-07-14T13:11:30.120385+0000","last_peered":"2023-07-14T13:11:30.120385+0000","last_clean":"2023-07-14T13:11:30.120385+0000","last_became_active":"2023-07-14T13:11:28.943055+0000","last_became_peered":"2023-07-14T13:11:28.943055+0000","last_unstale":"2023-07-14T13:11:30.120385+0000","last_undegraded":"2023-07-14T13:11:30.120385+0000","last_fullsized":"2023-07-14T13:11:30.120385+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:33:22.445712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116543+0000","last_change":"2023-07-14T13:11:27.905683+0000","last_active":"2023-07-14T13:11:30.116543+0000","last_peered":"2023-07-14T13:11:30.116543+0000","last_clean":"2023-07-14T13:11:30.116543+0000","last_became_active":"2023-07-14T13:11:27.905382+0000","last_became_peered":"2023-07-14T13:11:27.905382+0000","last_unstale":"2023-07-14T13:11:30.116543+0000","last_undegraded":"2023-07-14T13:11:30.116543+0000","last_fullsized":"2023-07-14T13:11:30.116543+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:23:24.240872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117437+0000","last_change":"2023-07-14T13:11:28.933124+0000","last_active":"2023-07-14T13:11:30.117437+0000","last_peered":"2023-07-14T13:11:30.117437+0000","last_clean":"2023-07-14T13:11:30.117437+0000","last_became_active":"2023-07-14T13:11:28.932820+0000","last_became_peered":"2023-07-14T13:11:28.932820+0000","last_unstale":"2023-07-14T13:11:30.117437+0000","last_undegraded":"2023-07-14T13:11:30.117437+0000","last_fullsized":"2023-07-14T13:11:30.117437+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:32:46.470708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116910+0000","last_change":"2023-07-14T13:11:27.899284+0000","last_active":"2023-07-14T13:11:30.116910+0000","last_peered":"2023-07-14T13:11:30.116910+0000","last_clean":"2023-07-14T13:11:30.116910+0000","last_became_active":"2023-07-14T13:11:27.899000+0000","last_became_peered":"2023-07-14T13:11:27.899000+0000","last_unstale":"2023-07-14T13:11:30.116910+0000","last_undegraded":"2023-07-14T13:11:30.116910+0000","last_fullsized":"2023-07-14T13:11:30.116910+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:15:15.170144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117841+0000","last_change":"2023-07-14T13:11:28.939255+0000","last_active":"2023-07-14T13:11:30.117841+0000","last_peered":"2023-07-14T13:11:30.117841+0000","last_clean":"2023-07-14T13:11:30.117841+0000","last_became_active":"2023-07-14T13:11:28.938797+0000","last_became_peered":"2023-07-14T13:11:28.938797+0000","last_unstale":"2023-07-14T13:11:30.117841+0000","last_undegraded":"2023-07-14T13:11:30.117841+0000","last_fullsized":"2023-07-14T13:11:30.117841+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:28:08.697938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"126'8","reported_seq":21,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.943029+0000","last_change":"2023-07-14T13:11:27.903246+0000","last_active":"2023-07-14T13:11:29.943029+0000","last_peered":"2023-07-14T13:11:29.943029+0000","last_clean":"2023-07-14T13:11:29.943029+0000","last_became_active":"2023-07-14T13:11:27.902770+0000","last_became_peered":"2023-07-14T13:11:27.902770+0000","last_unstale":"2023-07-14T13:11:29.943029+0000","last_undegraded":"2023-07-14T13:11:29.943029+0000","last_fullsized":"2023-07-14T13:11:29.943029+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:28:27.449887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116964+0000","last_change":"2023-07-14T13:11:28.937180+0000","last_active":"2023-07-14T13:11:30.116964+0000","last_peered":"2023-07-14T13:11:30.116964+0000","last_clean":"2023-07-14T13:11:30.116964+0000","last_became_active":"2023-07-14T13:11:28.936870+0000","last_became_peered":"2023-07-14T13:11:28.936870+0000","last_unstale":"2023-07-14T13:11:30.116964+0000","last_undegraded":"2023-07-14T13:11:30.116964+0000","last_fullsized":"2023-07-14T13:11:30.116964+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:35:31.974211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"126'2","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.938858+0000","last_change":"2023-07-14T13:11:27.907026+0000","last_active":"2023-07-14T13:11:29.938858+0000","last_peered":"2023-07-14T13:11:29.938858+0000","last_clean":"2023-07-14T13:11:29.938858+0000","last_became_active":"2023-07-14T13:11:27.906738+0000","last_became_peered":"2023-07-14T13:11:27.906738+0000","last_unstale":"2023-07-14T13:11:29.938858+0000","last_undegraded":"2023-07-14T13:11:29.938858+0000","last_fullsized":"2023-07-14T13:11:29.938858+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:58:01.913584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.942974+0000","last_change":"2023-07-14T13:11:28.940162+0000","last_active":"2023-07-14T13:11:29.942974+0000","last_peered":"2023-07-14T13:11:29.942974+0000","last_clean":"2023-07-14T13:11:29.942974+0000","last_became_active":"2023-07-14T13:11:28.939905+0000","last_became_peered":"2023-07-14T13:11:28.939905+0000","last_unstale":"2023-07-14T13:11:29.942974+0000","last_undegraded":"2023-07-14T13:11:29.942974+0000","last_fullsized":"2023-07-14T13:11:29.942974+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:27:21.166621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"127'1","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116525+0000","last_change":"2023-07-14T13:11:27.902133+0000","last_active":"2023-07-14T13:11:30.116525+0000","last_peered":"2023-07-14T13:11:30.116525+0000","last_clean":"2023-07-14T13:11:30.116525+0000","last_became_active":"2023-07-14T13:11:27.901863+0000","last_became_peered":"2023-07-14T13:11:27.901863+0000","last_unstale":"2023-07-14T13:11:30.116525+0000","last_undegraded":"2023-07-14T13:11:30.116525+0000","last_fullsized":"2023-07-14T13:11:30.116525+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:46:24.149647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116421+0000","last_change":"2023-07-14T13:11:28.943918+0000","last_active":"2023-07-14T13:11:30.116421+0000","last_peered":"2023-07-14T13:11:30.116421+0000","last_clean":"2023-07-14T13:11:30.116421+0000","last_became_active":"2023-07-14T13:11:28.943568+0000","last_became_peered":"2023-07-14T13:11:28.943568+0000","last_unstale":"2023-07-14T13:11:30.116421+0000","last_undegraded":"2023-07-14T13:11:30.116421+0000","last_fullsized":"2023-07-14T13:11:30.116421+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:52:34.146671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120680+0000","last_change":"2023-07-14T13:11:27.917285+0000","last_active":"2023-07-14T13:11:30.120680+0000","last_peered":"2023-07-14T13:11:30.120680+0000","last_clean":"2023-07-14T13:11:30.120680+0000","last_became_active":"2023-07-14T13:11:27.916997+0000","last_became_peered":"2023-07-14T13:11:27.916997+0000","last_unstale":"2023-07-14T13:11:30.120680+0000","last_undegraded":"2023-07-14T13:11:30.120680+0000","last_fullsized":"2023-07-14T13:11:30.120680+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:35:32.561915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120890+0000","last_change":"2023-07-14T13:11:28.938937+0000","last_active":"2023-07-14T13:11:30.120890+0000","last_peered":"2023-07-14T13:11:30.120890+0000","last_clean":"2023-07-14T13:11:30.120890+0000","last_became_active":"2023-07-14T13:11:28.938671+0000","last_became_peered":"2023-07-14T13:11:28.938671+0000","last_unstale":"2023-07-14T13:11:30.120890+0000","last_undegraded":"2023-07-14T13:11:30.120890+0000","last_fullsized":"2023-07-14T13:11:30.120890+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:02:53.319655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.938654+0000","last_change":"2023-07-14T13:11:27.911728+0000","last_active":"2023-07-14T13:11:29.938654+0000","last_peered":"2023-07-14T13:11:29.938654+0000","last_clean":"2023-07-14T13:11:29.938654+0000","last_became_active":"2023-07-14T13:11:27.911418+0000","last_became_peered":"2023-07-14T13:11:27.911418+0000","last_unstale":"2023-07-14T13:11:29.938654+0000","last_undegraded":"2023-07-14T13:11:29.938654+0000","last_fullsized":"2023-07-14T13:11:29.938654+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:40:07.962210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117550+0000","last_change":"2023-07-14T13:11:28.931175+0000","last_active":"2023-07-14T13:11:30.117550+0000","last_peered":"2023-07-14T13:11:30.117550+0000","last_clean":"2023-07-14T13:11:30.117550+0000","last_became_active":"2023-07-14T13:11:28.930839+0000","last_became_peered":"2023-07-14T13:11:28.930839+0000","last_unstale":"2023-07-14T13:11:30.117550+0000","last_undegraded":"2023-07-14T13:11:30.117550+0000","last_fullsized":"2023-07-14T13:11:30.117550+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:47:08.860374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.943399+0000","last_change":"2023-07-14T13:11:27.911575+0000","last_active":"2023-07-14T13:11:29.943399+0000","last_peered":"2023-07-14T13:11:29.943399+0000","last_clean":"2023-07-14T13:11:29.943399+0000","last_became_active":"2023-07-14T13:11:27.911267+0000","last_became_peered":"2023-07-14T13:11:27.911267+0000","last_unstale":"2023-07-14T13:11:29.943399+0000","last_undegraded":"2023-07-14T13:11:29.943399+0000","last_fullsized":"2023-07-14T13:11:29.943399+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:00:39.677797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117690+0000","last_change":"2023-07-14T13:11:28.931587+0000","last_active":"2023-07-14T13:11:30.117690+0000","last_peered":"2023-07-14T13:11:30.117690+0000","last_clean":"2023-07-14T13:11:30.117690+0000","last_became_active":"2023-07-14T13:11:28.931307+0000","last_became_peered":"2023-07-14T13:11:28.931307+0000","last_unstale":"2023-07-14T13:11:30.117690+0000","last_undegraded":"2023-07-14T13:11:30.117690+0000","last_fullsized":"2023-07-14T13:11:30.117690+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:29:42.483886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117543+0000","last_change":"2023-07-14T13:11:27.902540+0000","last_active":"2023-07-14T13:11:30.117543+0000","last_peered":"2023-07-14T13:11:30.117543+0000","last_clean":"2023-07-14T13:11:30.117543+0000","last_became_active":"2023-07-14T13:11:27.902204+0000","last_became_peered":"2023-07-14T13:11:27.902204+0000","last_unstale":"2023-07-14T13:11:30.117543+0000","last_undegraded":"2023-07-14T13:11:30.117543+0000","last_fullsized":"2023-07-14T13:11:30.117543+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:35:21.206525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120289+0000","last_change":"2023-07-14T13:11:28.941797+0000","last_active":"2023-07-14T13:11:30.120289+0000","last_peered":"2023-07-14T13:11:30.120289+0000","last_clean":"2023-07-14T13:11:30.120289+0000","last_became_active":"2023-07-14T13:11:28.939690+0000","last_became_peered":"2023-07-14T13:11:28.939690+0000","last_unstale":"2023-07-14T13:11:30.120289+0000","last_undegraded":"2023-07-14T13:11:30.120289+0000","last_fullsized":"2023-07-14T13:11:30.120289+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:13.206762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120657+0000","last_change":"2023-07-14T13:11:27.913333+0000","last_active":"2023-07-14T13:11:30.120657+0000","last_peered":"2023-07-14T13:11:30.120657+0000","last_clean":"2023-07-14T13:11:30.120657+0000","last_became_active":"2023-07-14T13:11:27.912829+0000","last_became_peered":"2023-07-14T13:11:27.912829+0000","last_unstale":"2023-07-14T13:11:30.120657+0000","last_undegraded":"2023-07-14T13:11:30.120657+0000","last_fullsized":"2023-07-14T13:11:30.120657+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:44:46.390813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.121218+0000","last_change":"2023-07-14T13:11:28.940851+0000","last_active":"2023-07-14T13:11:30.121218+0000","last_peered":"2023-07-14T13:11:30.121218+0000","last_clean":"2023-07-14T13:11:30.121218+0000","last_became_active":"2023-07-14T13:11:28.940348+0000","last_became_peered":"2023-07-14T13:11:28.940348+0000","last_unstale":"2023-07-14T13:11:30.121218+0000","last_undegraded":"2023-07-14T13:11:30.121218+0000","last_fullsized":"2023-07-14T13:11:30.121218+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:12:41.071859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117047+0000","last_change":"2023-07-14T13:11:27.899057+0000","last_active":"2023-07-14T13:11:30.117047+0000","last_peered":"2023-07-14T13:11:30.117047+0000","last_clean":"2023-07-14T13:11:30.117047+0000","last_became_active":"2023-07-14T13:11:27.898776+0000","last_became_peered":"2023-07-14T13:11:27.898776+0000","last_unstale":"2023-07-14T13:11:30.117047+0000","last_undegraded":"2023-07-14T13:11:30.117047+0000","last_fullsized":"2023-07-14T13:11:30.117047+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:56:27.186214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.121121+0000","last_change":"2023-07-14T13:11:28.943789+0000","last_active":"2023-07-14T13:11:30.121121+0000","last_peered":"2023-07-14T13:11:30.121121+0000","last_clean":"2023-07-14T13:11:30.121121+0000","last_became_active":"2023-07-14T13:11:28.941236+0000","last_became_peered":"2023-07-14T13:11:28.941236+0000","last_unstale":"2023-07-14T13:11:30.121121+0000","last_undegraded":"2023-07-14T13:11:30.121121+0000","last_fullsized":"2023-07-14T13:11:30.121121+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:45:18.172334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"126'2","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117707+0000","last_change":"2023-07-14T13:11:27.908040+0000","last_active":"2023-07-14T13:11:30.117707+0000","last_peered":"2023-07-14T13:11:30.117707+0000","last_clean":"2023-07-14T13:11:30.117707+0000","last_became_active":"2023-07-14T13:11:27.907724+0000","last_became_peered":"2023-07-14T13:11:27.907724+0000","last_unstale":"2023-07-14T13:11:30.117707+0000","last_undegraded":"2023-07-14T13:11:30.117707+0000","last_fullsized":"2023-07-14T13:11:30.117707+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:01:00.985725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"115'227","reported_seq":752,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120058+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:11:30.120058+0000","last_peered":"2023-07-14T13:11:30.120058+0000","last_clean":"2023-07-14T13:11:30.120058+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:11:30.120058+0000","last_undegraded":"2023-07-14T13:11:30.120058+0000","last_fullsized":"2023-07-14T13:11:30.120058+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:09:51.989754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":204,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.121204+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:11:30.121204+0000","last_peered":"2023-07-14T13:11:30.121204+0000","last_clean":"2023-07-14T13:11:30.121204+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:11:30.121204+0000","last_undegraded":"2023-07-14T13:11:30.121204+0000","last_fullsized":"2023-07-14T13:11:30.121204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:54:46.655941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120466+0000","last_change":"2023-07-14T13:11:28.931213+0000","last_active":"2023-07-14T13:11:30.120466+0000","last_peered":"2023-07-14T13:11:30.120466+0000","last_clean":"2023-07-14T13:11:30.120466+0000","last_became_active":"2023-07-14T13:11:28.930001+0000","last_became_peered":"2023-07-14T13:11:28.930001+0000","last_unstale":"2023-07-14T13:11:30.120466+0000","last_undegraded":"2023-07-14T13:11:30.120466+0000","last_fullsized":"2023-07-14T13:11:30.120466+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:01:43.531111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"126'1","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120201+0000","last_change":"2023-07-14T13:11:27.908313+0000","last_active":"2023-07-14T13:11:30.120201+0000","last_peered":"2023-07-14T13:11:30.120201+0000","last_clean":"2023-07-14T13:11:30.120201+0000","last_became_active":"2023-07-14T13:11:27.907979+0000","last_became_peered":"2023-07-14T13:11:27.907979+0000","last_unstale":"2023-07-14T13:11:30.120201+0000","last_undegraded":"2023-07-14T13:11:30.120201+0000","last_fullsized":"2023-07-14T13:11:30.120201+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:58:38.165136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":206,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.119921+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:11:30.119921+0000","last_peered":"2023-07-14T13:11:30.119921+0000","last_clean":"2023-07-14T13:11:30.119921+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:11:30.119921+0000","last_undegraded":"2023-07-14T13:11:30.119921+0000","last_fullsized":"2023-07-14T13:11:30.119921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:43:38.557144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.938481+0000","last_change":"2023-07-14T13:11:28.930957+0000","last_active":"2023-07-14T13:11:29.938481+0000","last_peered":"2023-07-14T13:11:29.938481+0000","last_clean":"2023-07-14T13:11:29.938481+0000","last_became_active":"2023-07-14T13:11:28.929641+0000","last_became_peered":"2023-07-14T13:11:28.929641+0000","last_unstale":"2023-07-14T13:11:29.938481+0000","last_undegraded":"2023-07-14T13:11:29.938481+0000","last_fullsized":"2023-07-14T13:11:29.938481+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:32:19.211196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120497+0000","last_change":"2023-07-14T13:11:27.914507+0000","last_active":"2023-07-14T13:11:30.120497+0000","last_peered":"2023-07-14T13:11:30.120497+0000","last_clean":"2023-07-14T13:11:30.120497+0000","last_became_active":"2023-07-14T13:11:27.914211+0000","last_became_peered":"2023-07-14T13:11:27.914211+0000","last_unstale":"2023-07-14T13:11:30.120497+0000","last_undegraded":"2023-07-14T13:11:30.120497+0000","last_fullsized":"2023-07-14T13:11:30.120497+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:59:08.038793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":204,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117025+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:11:30.117025+0000","last_peered":"2023-07-14T13:11:30.117025+0000","last_clean":"2023-07-14T13:11:30.117025+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:11:30.117025+0000","last_undegraded":"2023-07-14T13:11:30.117025+0000","last_fullsized":"2023-07-14T13:11:30.117025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:45:12.396037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116802+0000","last_change":"2023-07-14T13:11:28.929982+0000","last_active":"2023-07-14T13:11:30.116802+0000","last_peered":"2023-07-14T13:11:30.116802+0000","last_clean":"2023-07-14T13:11:30.116802+0000","last_became_active":"2023-07-14T13:11:28.929451+0000","last_became_peered":"2023-07-14T13:11:28.929451+0000","last_unstale":"2023-07-14T13:11:30.116802+0000","last_undegraded":"2023-07-14T13:11:30.116802+0000","last_fullsized":"2023-07-14T13:11:30.116802+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:06:28.887654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"126'1","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.121465+0000","last_change":"2023-07-14T13:11:27.914767+0000","last_active":"2023-07-14T13:11:30.121465+0000","last_peered":"2023-07-14T13:11:30.121465+0000","last_clean":"2023-07-14T13:11:30.121465+0000","last_became_active":"2023-07-14T13:11:27.914404+0000","last_became_peered":"2023-07-14T13:11:27.914404+0000","last_unstale":"2023-07-14T13:11:30.121465+0000","last_undegraded":"2023-07-14T13:11:30.121465+0000","last_fullsized":"2023-07-14T13:11:30.121465+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:59:59.953370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":204,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120635+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:11:30.120635+0000","last_peered":"2023-07-14T13:11:30.120635+0000","last_clean":"2023-07-14T13:11:30.120635+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:11:30.120635+0000","last_undegraded":"2023-07-14T13:11:30.120635+0000","last_fullsized":"2023-07-14T13:11:30.120635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:57:30.412352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116416+0000","last_change":"2023-07-14T13:11:28.942188+0000","last_active":"2023-07-14T13:11:30.116416+0000","last_peered":"2023-07-14T13:11:30.116416+0000","last_clean":"2023-07-14T13:11:30.116416+0000","last_became_active":"2023-07-14T13:11:28.941882+0000","last_became_peered":"2023-07-14T13:11:28.941882+0000","last_unstale":"2023-07-14T13:11:30.116416+0000","last_undegraded":"2023-07-14T13:11:30.116416+0000","last_fullsized":"2023-07-14T13:11:30.116416+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:00:40.685050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120531+0000","last_change":"2023-07-14T13:11:27.913529+0000","last_active":"2023-07-14T13:11:30.120531+0000","last_peered":"2023-07-14T13:11:30.120531+0000","last_clean":"2023-07-14T13:11:30.120531+0000","last_became_active":"2023-07-14T13:11:27.913229+0000","last_became_peered":"2023-07-14T13:11:27.913229+0000","last_unstale":"2023-07-14T13:11:30.120531+0000","last_undegraded":"2023-07-14T13:11:30.120531+0000","last_fullsized":"2023-07-14T13:11:30.120531+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:40:59.094780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":215,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.938841+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:11:29.938841+0000","last_peered":"2023-07-14T13:11:29.938841+0000","last_clean":"2023-07-14T13:11:29.938841+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:11:29.938841+0000","last_undegraded":"2023-07-14T13:11:29.938841+0000","last_fullsized":"2023-07-14T13:11:29.938841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:28:26.621273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116546+0000","last_change":"2023-07-14T13:11:28.924646+0000","last_active":"2023-07-14T13:11:30.116546+0000","last_peered":"2023-07-14T13:11:30.116546+0000","last_clean":"2023-07-14T13:11:30.116546+0000","last_became_active":"2023-07-14T13:11:28.924307+0000","last_became_peered":"2023-07-14T13:11:28.924307+0000","last_unstale":"2023-07-14T13:11:30.116546+0000","last_undegraded":"2023-07-14T13:11:30.116546+0000","last_fullsized":"2023-07-14T13:11:30.116546+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:43:15.873047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116925+0000","last_change":"2023-07-14T13:11:27.904242+0000","last_active":"2023-07-14T13:11:30.116925+0000","last_peered":"2023-07-14T13:11:30.116925+0000","last_clean":"2023-07-14T13:11:30.116925+0000","last_became_active":"2023-07-14T13:11:27.903918+0000","last_became_peered":"2023-07-14T13:11:27.903918+0000","last_unstale":"2023-07-14T13:11:30.116925+0000","last_undegraded":"2023-07-14T13:11:30.116925+0000","last_fullsized":"2023-07-14T13:11:30.116925+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:54:37.228739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120333+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:11:30.120333+0000","last_peered":"2023-07-14T13:11:30.120333+0000","last_clean":"2023-07-14T13:11:30.120333+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:11:30.120333+0000","last_undegraded":"2023-07-14T13:11:30.120333+0000","last_fullsized":"2023-07-14T13:11:30.120333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:16:22.857387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117337+0000","last_change":"2023-07-14T13:11:28.940158+0000","last_active":"2023-07-14T13:11:30.117337+0000","last_peered":"2023-07-14T13:11:30.117337+0000","last_clean":"2023-07-14T13:11:30.117337+0000","last_became_active":"2023-07-14T13:11:28.939719+0000","last_became_peered":"2023-07-14T13:11:28.939719+0000","last_unstale":"2023-07-14T13:11:30.117337+0000","last_undegraded":"2023-07-14T13:11:30.117337+0000","last_fullsized":"2023-07-14T13:11:30.117337+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:25:56.439424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"126'2","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116914+0000","last_change":"2023-07-14T13:11:27.905304+0000","last_active":"2023-07-14T13:11:30.116914+0000","last_peered":"2023-07-14T13:11:30.116914+0000","last_clean":"2023-07-14T13:11:30.116914+0000","last_became_active":"2023-07-14T13:11:27.904926+0000","last_became_peered":"2023-07-14T13:11:27.904926+0000","last_unstale":"2023-07-14T13:11:30.116914+0000","last_undegraded":"2023-07-14T13:11:30.116914+0000","last_fullsized":"2023-07-14T13:11:30.116914+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:57:44.893056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":215,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.938768+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:11:29.938768+0000","last_peered":"2023-07-14T13:11:29.938768+0000","last_clean":"2023-07-14T13:11:29.938768+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:11:29.938768+0000","last_undegraded":"2023-07-14T13:11:29.938768+0000","last_fullsized":"2023-07-14T13:11:29.938768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:29:58.259633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117452+0000","last_change":"2023-07-14T13:11:28.929859+0000","last_active":"2023-07-14T13:11:30.117452+0000","last_peered":"2023-07-14T13:11:30.117452+0000","last_clean":"2023-07-14T13:11:30.117452+0000","last_became_active":"2023-07-14T13:11:28.929550+0000","last_became_peered":"2023-07-14T13:11:28.929550+0000","last_unstale":"2023-07-14T13:11:30.117452+0000","last_undegraded":"2023-07-14T13:11:30.117452+0000","last_fullsized":"2023-07-14T13:11:30.117452+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:37:25.923437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117676+0000","last_change":"2023-07-14T13:11:27.909085+0000","last_active":"2023-07-14T13:11:30.117676+0000","last_peered":"2023-07-14T13:11:30.117676+0000","last_clean":"2023-07-14T13:11:30.117676+0000","last_became_active":"2023-07-14T13:11:27.908811+0000","last_became_peered":"2023-07-14T13:11:27.908811+0000","last_unstale":"2023-07-14T13:11:30.117676+0000","last_undegraded":"2023-07-14T13:11:30.117676+0000","last_fullsized":"2023-07-14T13:11:30.117676+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:37:27.900884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":207,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.121542+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:11:30.121542+0000","last_peered":"2023-07-14T13:11:30.121542+0000","last_clean":"2023-07-14T13:11:30.121542+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:11:30.121542+0000","last_undegraded":"2023-07-14T13:11:30.121542+0000","last_fullsized":"2023-07-14T13:11:30.121542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:31:29.565002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575074,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59408,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312432,"statfs":{"total":96636764160,"available":96575930368,"internally_reserved":0,"allocated":2170880,"data_stored":1385875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.70799999999999996,"15min":0.70999999999999996},"min":{"1min":0.53300000000000003,"5min":0.372,"15min":0.33900000000000002},"max":{"1min":0.95899999999999996,"5min":1.262,"15min":1.262},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71999999999999997,"15min":0.72899999999999998},"min":{"1min":0.51500000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.746}]},{"osd":1,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72399999999999998,"15min":0.73599999999999999},"min":{"1min":0.48199999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.872,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.72899999999999998,"15min":0.74399999999999999},"min":{"1min":0.59799999999999998,"5min":0.436,"15min":0.40500000000000003},"max":{"1min":0.97599999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.70299999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.58299999999999996,"5min":0.46100000000000002,"15min":0.42699999999999999},"max":{"1min":0.96099999999999997,"5min":1.073,"15min":1.073},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.73899999999999999,"15min":0.753},"min":{"1min":0.57999999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89600000000000002,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.80600000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.58899999999999997,"5min":0.503,"15min":0.46400000000000002},"max":{"1min":0.90900000000000003,"5min":1.161,"15min":1.161},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.73999999999999999,"15min":0.75600000000000001},"min":{"1min":0.60299999999999998,"5min":0.47899999999999998,"15min":0.41499999999999998},"max":{"1min":0.91800000000000004,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.72299999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55800000000000005,"15min":0.57799999999999996},"min":{"1min":0.44500000000000001,"5min":0.39100000000000001,"15min":0.318},"max":{"1min":0.874,"5min":0.874,"15min":1.022},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.47399999999999998,"5min":0.40600000000000003,"15min":0.39300000000000002},"max":{"1min":0.76500000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.52900000000000003}]},{"osd":5,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.52100000000000002,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.82199999999999995,"5min":0.98099999999999998,"15min":0.98299999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.64700000000000002},"min":{"1min":0.44,"5min":0.377,"15min":0.34100000000000003},"max":{"1min":0.80700000000000005,"5min":1.028,"15min":1.028},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67600000000000005,"15min":0.69099999999999995},"min":{"1min":0.48499999999999999,"5min":0.45200000000000001,"15min":0.42699999999999999},"max":{"1min":0.85799999999999998,"5min":0.99299999999999999,"15min":1.0489999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.68000000000000005,"15min":0.67500000000000004},"min":{"1min":0.47499999999999998,"5min":0.46200000000000002,"15min":0.36299999999999999},"max":{"1min":4.1130000000000004,"5min":4.1130000000000004,"15min":4.1130000000000004},"last":0.58499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575075,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32600,"kb_used_data":1552,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339240,"statfs":{"total":96636764160,"available":96603381760,"internally_reserved":0,"allocated":1589248,"data_stored":797515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71599999999999997,"15min":0.73099999999999998},"min":{"1min":0.50800000000000001,"5min":0.39500000000000002,"15min":0.38},"max":{"1min":0.90100000000000002,"5min":0.95899999999999996,"15min":0.996},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.70199999999999996,"15min":0.72699999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89500000000000002,"5min":0.98199999999999998,"15min":1.0800000000000001},"last":0.76500000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70899999999999996,"15min":0.73699999999999999},"min":{"1min":0.497,"5min":0.42299999999999999,"15min":0.379},"max":{"1min":0.84399999999999997,"5min":0.97199999999999998,"15min":1.0209999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.70199999999999996,"15min":0.72099999999999997},"min":{"1min":0.60599999999999998,"5min":0.47499999999999998,"15min":0.46999999999999997},"max":{"1min":0.88100000000000001,"5min":0.91400000000000003,"15min":1.077},"last":0.73499999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72699999999999998,"15min":0.749},"min":{"1min":0.56100000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.874,"5min":0.95099999999999996,"15min":1.105},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.48499999999999999,"5min":0.441,"15min":0.441},"max":{"1min":0.97999999999999998,"5min":0.99099999999999999,"15min":1.0900000000000001},"last":0.83499999999999996}]},{"osd":3,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.75,"15min":0.77200000000000002},"min":{"1min":0.61499999999999999,"5min":0.46000000000000002,"15min":0.434},"max":{"1min":0.92200000000000004,"5min":1.054,"15min":1.1359999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.71899999999999997,"15min":0.754},"min":{"1min":0.56999999999999995,"5min":0.50900000000000001,"15min":0.48399999999999999},"max":{"1min":0.871,"5min":0.94799999999999995,"15min":1.1080000000000001},"last":0.81299999999999994}]},{"osd":4,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57399999999999995,"15min":0.57499999999999996},"min":{"1min":0.45900000000000002,"5min":0.39900000000000002,"15min":0.317},"max":{"1min":0.76300000000000001,"5min":0.89900000000000002,"15min":0.97899999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.48299999999999998,"5min":0.439,"15min":0.38500000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":1.0780000000000001},"last":0.57799999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.497,"5min":0.45200000000000001,"15min":0.37},"max":{"1min":0.78100000000000003,"5min":0.96599999999999997,"15min":1.579},"last":0.622},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.50800000000000001,"5min":0.46300000000000002,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.65000000000000002}]},{"osd":7,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67400000000000004,"15min":0.65900000000000003},"min":{"1min":0.47899999999999998,"5min":0.437,"15min":0.34599999999999997},"max":{"1min":0.93899999999999995,"5min":1.0940000000000001,"15min":1.1200000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71299999999999997,"15min":0.71199999999999997},"min":{"1min":0.59699999999999998,"5min":0.48899999999999999,"15min":0.36199999999999999},"max":{"1min":0.92000000000000004,"5min":1.0209999999999999,"15min":1.657},"last":0.70699999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575074,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46532,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":44992,"kb_avail":94325308,"statfs":{"total":96636764160,"available":96589115392,"internally_reserved":0,"allocated":1568768,"data_stored":795347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46071808},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.69399999999999995,"15min":0.72499999999999998},"min":{"1min":0.44400000000000001,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":0.88800000000000001,"5min":0.91500000000000004,"15min":2.6699999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.71299999999999997,"15min":0.72799999999999998},"min":{"1min":0.56799999999999995,"5min":0.41699999999999998,"15min":0.32800000000000001},"max":{"1min":0.98299999999999998,"5min":1.083,"15min":1.083},"last":0.69699999999999995}]},{"osd":1,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.69399999999999995,"15min":0.72099999999999997},"min":{"1min":0.49399999999999999,"5min":0.45900000000000002,"15min":0.41099999999999998},"max":{"1min":0.95799999999999996,"5min":1.05,"15min":1.079},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72099999999999997,"15min":0.74299999999999999},"min":{"1min":0.55000000000000004,"5min":0.48999999999999999,"15min":0.36799999999999999},"max":{"1min":0.92500000000000004,"5min":0.95899999999999996,"15min":2.706},"last":0.74299999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.71499999999999997,"15min":0.73299999999999998},"min":{"1min":0.58699999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.93999999999999995,"5min":1.212,"15min":1.212},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.70999999999999996,"15min":0.73099999999999998},"min":{"1min":0.60999999999999999,"5min":0.44800000000000001,"15min":0.433},"max":{"1min":0.90900000000000003,"5min":1.181,"15min":1.181},"last":0.78900000000000003}]},{"osd":3,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.72499999999999998,"15min":0.74399999999999999},"min":{"1min":0.64300000000000002,"5min":0.41799999999999998,"15min":0.377},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":2.7389999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.72799999999999998,"15min":0.75800000000000001},"min":{"1min":0.61799999999999999,"5min":0.47299999999999998,"15min":0.39700000000000002},"max":{"1min":0.89500000000000002,"5min":1.304,"15min":1.304},"last":0.752}]},{"osd":4,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63800000000000001,"15min":0.627},"min":{"1min":0.49399999999999999,"5min":0.38,"15min":0.28599999999999998},"max":{"1min":0.871,"5min":1.129,"15min":1.129},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66600000000000004,"15min":0.68000000000000005},"min":{"1min":0.499,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85899999999999999,"5min":0.86799999999999999,"15min":2.7719999999999998},"last":0.77400000000000002}]},{"osd":6,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59399999999999997,"15min":0.60599999999999998},"min":{"1min":0.46500000000000002,"5min":0.34599999999999997,"15min":0.32700000000000001},"max":{"1min":0.68300000000000005,"5min":1.169,"15min":1.169},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.47999999999999998,"5min":0.39400000000000002,"15min":0.34300000000000003},"max":{"1min":0.83999999999999997,"5min":1.238,"15min":1.238},"last":0.71699999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.45400000000000001,"5min":0.36899999999999999,"15min":0.32900000000000001},"max":{"1min":0.92200000000000004,"5min":1.026,"15min":3.0230000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67200000000000004,"15min":0.67500000000000004},"min":{"1min":0.46500000000000002,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.85099999999999998,"5min":1.2589999999999999,"15min":1.407},"last":0.85799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575074,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32588,"kb_used_data":1540,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1576960,"data_stored":795439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.70199999999999996,"15min":0.72799999999999998},"min":{"1min":0.53800000000000003,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":1.411},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72799999999999998,"15min":0.73099999999999998},"min":{"1min":0.46999999999999997,"5min":0.45100000000000001,"15min":0.435},"max":{"1min":0.88,"5min":1.0089999999999999,"15min":1.1200000000000001},"last":0.64900000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72799999999999998,"15min":0.746},"min":{"1min":0.53100000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89300000000000002,"5min":0.94699999999999995,"15min":1.077},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71499999999999997,"15min":0.73299999999999998},"min":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89800000000000002,"5min":0.96399999999999997,"15min":1.0469999999999999},"last":0.68700000000000006}]},{"osd":2,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71499999999999997,"15min":0.73099999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.35199999999999998},"max":{"1min":0.872,"5min":0.96499999999999997,"15min":1.091},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.77000000000000002},"min":{"1min":0.63200000000000001,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.86299999999999999,"5min":1.04,"15min":1.387},"last":0.74199999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72699999999999998,"15min":0.74399999999999999},"min":{"1min":0.53200000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89400000000000002,"5min":0.997,"15min":1.008},"last":0.874},{"interface":"front","average":{"1min":0.752,"5min":0.748,"15min":0.76800000000000002},"min":{"1min":0.51400000000000001,"5min":0.47499999999999998,"15min":0.46800000000000003},"max":{"1min":1.002,"5min":1.002,"15min":1.0589999999999999},"last":0.77300000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.378},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":1.0029999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.64500000000000002,"15min":0.622},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.34599999999999997},"max":{"1min":0.79600000000000004,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.81899999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.34899999999999998,"15min":0.32300000000000001},"max":{"1min":0.876,"5min":0.96999999999999997,"15min":1.014},"last":0.751},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.374},"max":{"1min":0.85199999999999998,"5min":0.98299999999999998,"15min":1.0289999999999999},"last":0.79200000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70799999999999996,"15min":0.67300000000000004},"min":{"1min":0.55300000000000005,"5min":0.502,"15min":0.39000000000000001},"max":{"1min":0.84899999999999998,"5min":1.0049999999999999,"15min":1.0349999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.50700000000000001,"5min":0.42799999999999999,"15min":0.36899999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0629999999999999},"last":0.85999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575074,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36680,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335160,"statfs":{"total":96636764160,"available":96599203840,"internally_reserved":0,"allocated":1572864,"data_stored":795929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45300000000000001,"15min":0.44900000000000001},"min":{"1min":0.34799999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.59999999999999998,"5min":0.78600000000000003,"15min":0.84199999999999997},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.51100000000000001,"15min":0.51400000000000001},"min":{"1min":0.33200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.53100000000000003}]},{"osd":1,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.378,"5min":0.32000000000000001,"15min":0.315},"max":{"1min":0.67800000000000005,"5min":0.873,"15min":0.873},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.53700000000000003,"15min":0.54100000000000004},"min":{"1min":0.41699999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.753,"5min":0.753,"15min":1.0029999999999999},"last":0.38900000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56100000000000005,"15min":0.57199999999999995},"min":{"1min":0.44400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.90400000000000003},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.47599999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88100000000000001,"5min":1.02,"15min":1.663},"last":0.48999999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.75900000000000001,"15min":0.75700000000000001},"min":{"1min":0.56200000000000006,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":0.96899999999999997,"5min":1.151,"15min":1.284},"last":0.627},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.78100000000000003,"15min":0.78200000000000003},"min":{"1min":0.60499999999999998,"5min":0.51900000000000002,"15min":0.47699999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.58299999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.79300000000000004,"15min":0.79200000000000004},"min":{"1min":0.60399999999999998,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.306},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.60899999999999999,"5min":0.55000000000000004,"15min":0.372},"max":{"1min":1.018,"5min":1.1870000000000001,"15min":1.2470000000000001},"last":0.60999999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77300000000000002,"15min":0.77200000000000002},"min":{"1min":0.52400000000000002,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.117},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.80600000000000005,"15min":0.81399999999999995},"min":{"1min":0.63700000000000001,"5min":0.56299999999999994,"15min":0.54200000000000004},"max":{"1min":1.1000000000000001,"5min":1.129,"15min":1.2589999999999999},"last":0.63900000000000001}]},{"osd":7,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81100000000000005,"15min":0.83199999999999996},"min":{"1min":0.66100000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.095,"5min":1.1519999999999999,"15min":2.4910000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.81200000000000006,"15min":0.82299999999999995},"min":{"1min":0.65100000000000002,"5min":0.53500000000000003,"15min":0.51600000000000001},"max":{"1min":1.1359999999999999,"5min":1.1379999999999999,"15min":1.595},"last":0.65000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575074,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58820,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313020,"statfs":{"total":96636764160,"available":96576532480,"internally_reserved":0,"allocated":1568768,"data_stored":794362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.35499999999999998,"5min":0.29199999999999998,"15min":0.24199999999999999},"max":{"1min":0.75700000000000001,"5min":0.84699999999999998,"15min":1.3169999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51400000000000001,"15min":0.53500000000000003},"min":{"1min":0.372,"5min":0.318,"15min":0.318},"max":{"1min":0.69899999999999995,"5min":0.80800000000000005,"15min":2.5270000000000001},"last":0.57899999999999996}]},{"osd":1,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46700000000000003,"15min":0.47299999999999998},"min":{"1min":0.34200000000000003,"5min":0.30399999999999999,"15min":0.29999999999999999},"max":{"1min":0.72599999999999998,"5min":0.77200000000000002,"15min":2.7200000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.52800000000000002,"15min":0.56200000000000006},"min":{"1min":0.46400000000000002,"5min":0.36299999999999999,"15min":0.35999999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":2.6110000000000002},"last":0.49199999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55700000000000005,"15min":0.60399999999999998},"min":{"1min":0.5,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70699999999999996,"5min":0.81899999999999995,"15min":8.2530000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53800000000000003,"15min":0.55200000000000005},"min":{"1min":0.44400000000000001,"5min":0.36899999999999999,"15min":0.33300000000000002},"max":{"1min":0.65700000000000003,"5min":0.89600000000000002,"15min":1.2150000000000001},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.753,"15min":0.77800000000000002},"min":{"1min":0.57299999999999995,"5min":0.53200000000000003,"15min":0.48399999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.1499999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.747,"15min":0.79100000000000004},"min":{"1min":0.60399999999999998,"5min":0.52900000000000003,"15min":0.47999999999999998},"max":{"1min":1.03,"5min":1.0629999999999999,"15min":2.3170000000000002},"last":0.77200000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.81000000000000005,"15min":0.85499999999999998},"min":{"1min":0.65500000000000003,"5min":0.56399999999999995,"15min":0.49399999999999999},"max":{"1min":1.087,"5min":1.1319999999999999,"15min":3.1139999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.79800000000000004,"15min":0.84099999999999997},"min":{"1min":0.61799999999999999,"5min":0.56200000000000006,"15min":0.433},"max":{"1min":1.0940000000000001,"5min":1.153,"15min":2.6850000000000001},"last":0.81899999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.751,"15min":0.79900000000000004},"min":{"1min":0.65200000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.038,"5min":1.038,"15min":3.9849999999999999},"last":0.872},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.76900000000000002,"15min":0.81100000000000005},"min":{"1min":0.627,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1100000000000001,"5min":1.1419999999999999,"15min":3.391},"last":0.73099999999999998}]},{"osd":7,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.77100000000000002,"15min":0.81799999999999995},"min":{"1min":0.56000000000000005,"5min":0.52300000000000002,"15min":0.5},"max":{"1min":1.0549999999999999,"5min":1.1759999999999999,"15min":2.5779999999999998},"last":0.746},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.78900000000000003,"15min":0.82199999999999995},"min":{"1min":0.57499999999999996,"5min":0.52800000000000002,"15min":0.50900000000000001},"max":{"1min":1.0529999999999999,"5min":1.0940000000000001,"15min":2.5939999999999999},"last":0.84899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575075,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36680,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335160,"statfs":{"total":96636764160,"available":96599203840,"internally_reserved":0,"allocated":1572864,"data_stored":795381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.435,"15min":0.433},"min":{"1min":0.29199999999999998,"5min":0.28399999999999997,"15min":0.26100000000000001},"max":{"1min":0.63900000000000001,"5min":0.65400000000000003,"15min":0.77200000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.88900000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.44900000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46300000000000002,"15min":0.47199999999999998},"min":{"1min":0.371,"5min":0.317,"15min":0.317},"max":{"1min":0.67300000000000004,"5min":0.69199999999999995,"15min":1.0409999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.39400000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":1.014},"last":0.57799999999999996}]},{"osd":3,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60899999999999999,"15min":0.63200000000000001},"min":{"1min":0.45000000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.76300000000000001,"5min":0.80300000000000005,"15min":0.96299999999999997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.57399999999999995},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79200000000000004,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.63600000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76900000000000002,"15min":0.78700000000000003},"min":{"1min":0.56799999999999995,"5min":0.51200000000000001,"15min":0.48899999999999999},"max":{"1min":0.98199999999999998,"5min":1.2110000000000001,"15min":1.236},"last":0.878},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.63,"5min":0.54700000000000004,"15min":0.502},"max":{"1min":1,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.89500000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.45200000000000001},"max":{"1min":1.097,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.63700000000000001,"5min":0.51500000000000001,"15min":0.48599999999999999},"max":{"1min":0.99099999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.046}]},{"osd":6,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.56599999999999995,"5min":0.53800000000000003,"15min":0.503},"max":{"1min":1.071,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.81399999999999995,"15min":0.81699999999999995},"min":{"1min":0.56399999999999995,"5min":0.497,"15min":0.497},"max":{"1min":1.0880000000000001,"5min":1.262,"15min":1.262},"last":0.93899999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.80000000000000004,"15min":0.80200000000000005},"min":{"1min":0.61599999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.048,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.878,"5min":0.83299999999999996,"15min":0.84499999999999997},"min":{"1min":0.68899999999999995,"5min":0.58499999999999996,"15min":0.52800000000000002},"max":{"1min":1.1160000000000001,"5min":1.327,"15min":1.327},"last":0.79900000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575076,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37268,"kb_used_data":2124,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334572,"statfs":{"total":96636764160,"available":96598601728,"internally_reserved":0,"allocated":2174976,"data_stored":1386350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.33300000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":2.2450000000000001},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.48799999999999999,"15min":0.51100000000000001},"min":{"1min":0.35699999999999998,"5min":0.30099999999999999,"15min":0.27700000000000002},"max":{"1min":0.74199999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.45000000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.495,"15min":0.51200000000000001},"min":{"1min":0.35999999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.60799999999999998,"5min":0.84499999999999997,"15min":2.2989999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53200000000000003,"15min":0.55000000000000004},"min":{"1min":0.40400000000000003,"5min":0.34899999999999998,"15min":0.29899999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.90300000000000002},"last":0.64700000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.498,"15min":0.505},"min":{"1min":0.44400000000000001,"5min":0.32700000000000001,"15min":0.30299999999999999},"max":{"1min":0.58299999999999996,"5min":0.72999999999999998,"15min":0.84999999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56799999999999995,"15min":0.58799999999999997},"min":{"1min":0.47199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.71799999999999997,"5min":0.92700000000000005,"15min":2.4100000000000001},"last":0.42399999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.745,"15min":0.78100000000000003},"min":{"1min":0.54500000000000004,"5min":0.48399999999999999,"15min":0.44400000000000001},"max":{"1min":1.0309999999999999,"5min":1.21,"15min":1.3640000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.75600000000000001,"15min":0.79500000000000004},"min":{"1min":0.60199999999999998,"5min":0.52300000000000002,"15min":0.44900000000000001},"max":{"1min":0.90000000000000002,"5min":1.0589999999999999,"15min":2.4460000000000002},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.751,"15min":0.79600000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.47899999999999998},"max":{"1min":0.95899999999999996,"5min":1.0669999999999999,"15min":1.3839999999999999},"last":0.62},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.75900000000000001,"15min":0.79200000000000004},"min":{"1min":0.55800000000000005,"5min":0.5,"15min":0.47299999999999998},"max":{"1min":1.05,"5min":1.069,"15min":1.325},"last":0.66800000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76700000000000002,"15min":0.79800000000000004},"min":{"1min":0.63500000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.97499999999999998,"5min":1.05,"15min":2.3380000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.75800000000000001,"15min":0.80300000000000005},"min":{"1min":0.58599999999999997,"5min":0.51000000000000001,"15min":0.41299999999999998},"max":{"1min":1.012,"5min":1.0900000000000001,"15min":1.3440000000000001},"last":0.55600000000000005}]},{"osd":7,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.77700000000000002,"15min":0.82199999999999995},"min":{"1min":0.58499999999999996,"5min":0.52800000000000002,"15min":0.45500000000000002},"max":{"1min":0.95299999999999996,"5min":1.1180000000000001,"15min":1.2749999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.75700000000000001,"15min":0.80400000000000005},"min":{"1min":0.60599999999999998,"5min":0.502,"15min":0.497},"max":{"1min":1.0640000000000001,"5min":1.0880000000000001,"15min":1.381},"last":0.63300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:11:37.653 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:11:37.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.775+0000 7f51f5d96640 1 Processor -- start 2023-07-14T13:11:37.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.775+0000 7f51f5d96640 1 -- start start 2023-07-14T13:11:37.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.775+0000 7f51f5d96640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f51f00d1850 0x7f51f00d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:37.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.775+0000 7f51f5d96640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f00ccaf0 con 0x7f51f015fd60 2023-07-14T13:11:37.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.775+0000 7f51f5d96640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f0160320 con 0x7f51f00b7c70 2023-07-14T13:11:37.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.775+0000 7f51f5d96640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f00d1190 con 0x7f51f00d1850 2023-07-14T13:11:37.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.775+0000 7f51effff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f51f00d1850 0x7f51f00d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:37.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.779+0000 7f51effff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f51f00d1850 0x7f51f00d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57480/0 (socket says 172.21.15.5:57480) 2023-07-14T13:11:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.779+0000 7f51effff640 1 -- 172.21.15.5:0/3229451198 learned_addr learned my addr 172.21.15.5:0/3229451198 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.779+0000 7f51effff640 1 -- 172.21.15.5:0/3229451198 >> v1:172.21.15.154:6789/0 conn(0x7f51f00b7c70 legacy=0x7f51f015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.779+0000 7f51effff640 1 -- 172.21.15.5:0/3229451198 >> v1:172.21.15.5:6789/0 conn(0x7f51f015fd60 legacy=0x7f51f00d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:37.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.779+0000 7f51effff640 1 -- 172.21.15.5:0/3229451198 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f00ccd90 con 0x7f51f00d1850 2023-07-14T13:11:37.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.779+0000 7f51effff640 1 --2- 172.21.15.5:0/3229451198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f00d1850 0x7f51f00d0c50 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009e50 tx=0x7f51e801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0f375e63be1d93 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:37.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.779+0000 7f51ee7fc640 1 -- 172.21.15.5:0/3229451198 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e80a57f0 con 0x7f51f00d1850 2023-07-14T13:11:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.779+0000 7f51ee7fc640 1 -- 172.21.15.5:0/3229451198 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e80a5950 con 0x7f51f00d1850 2023-07-14T13:11:37.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.779+0000 7f51ee7fc640 1 -- 172.21.15.5:0/3229451198 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e80a5ce0 con 0x7f51f00d1850 2023-07-14T13:11:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.779+0000 7f51f5d96640 1 -- 172.21.15.5:0/3229451198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f00d1850 msgr2=0x7f51f00d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:37.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.779+0000 7f51f5d96640 1 --2- 172.21.15.5:0/3229451198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f00d1850 0x7f51f00d0c50 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009e50 tx=0x7f51e801ca10 comp rx=0 tx=0).stop 2023-07-14T13:11:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.783+0000 7f51f5d96640 1 -- 172.21.15.5:0/3229451198 shutdown_connections 2023-07-14T13:11:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.783+0000 7f51f5d96640 1 --2- 172.21.15.5:0/3229451198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f00d1850 0x7f51f00d0c50 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:37.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.783+0000 7f51f5d96640 1 -- 172.21.15.5:0/3229451198 >> 172.21.15.5:0/3229451198 conn(0x7f51f00650b0 msgr2=0x7f51f00654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.783+0000 7f51f5d96640 1 -- 172.21.15.5:0/3229451198 shutdown_connections 2023-07-14T13:11:37.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.783+0000 7f51f5d96640 1 -- 172.21.15.5:0/3229451198 wait complete. 2023-07-14T13:11:37.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.783+0000 7f51f5d96640 1 Processor -- start 2023-07-14T13:11:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.783+0000 7f51f5d96640 1 -- start start 2023-07-14T13:11:37.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.783+0000 7f51f5d96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51f00b7c70 0x7f51f01558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.783+0000 7f51f5d96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f00d1850 0x7f51f014cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.783+0000 7f51f5d96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51f015fd60 0x7f51f00c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.783+0000 7f51f5d96640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f0155df0 con 0x7f51f00d1850 2023-07-14T13:11:37.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.783+0000 7f51f5d96640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f014f240 con 0x7f51f00b7c70 2023-07-14T13:11:37.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.783+0000 7f51f5d96640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f014d110 con 0x7f51f015fd60 2023-07-14T13:11:37.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.783+0000 7f51eeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f00d1850 0x7f51f014cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:37.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.783+0000 7f51eeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f00d1850 0x7f51f014cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57492/0 (socket says 172.21.15.5:57492) 2023-07-14T13:11:37.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.783+0000 7f51eeffd640 1 -- 172.21.15.5:0/857815648 learned_addr learned my addr 172.21.15.5:0/857815648 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:37.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.783+0000 7f51effff640 1 --2- 172.21.15.5:0/857815648 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51f015fd60 0x7f51f00c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:37.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.783+0000 7f51ef7fe640 1 --2- 172.21.15.5:0/857815648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51f00b7c70 0x7f51f01558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:37.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.783+0000 7f51eeffd640 1 -- 172.21.15.5:0/857815648 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51f015fd60 msgr2=0x7f51f00c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:37.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.783+0000 7f51eeffd640 1 --2- 172.21.15.5:0/857815648 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51f015fd60 0x7f51f00c6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.783+0000 7f51eeffd640 1 -- 172.21.15.5:0/857815648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51f00b7c70 msgr2=0x7f51f01558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.783+0000 7f51eeffd640 1 --2- 172.21.15.5:0/857815648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51f00b7c70 0x7f51f01558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.783+0000 7f51eeffd640 1 -- 172.21.15.5:0/857815648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e8009b30 con 0x7f51f00d1850 2023-07-14T13:11:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.783+0000 7f51effff640 1 --2- 172.21.15.5:0/857815648 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51f015fd60 0x7f51f00c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:11:37.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.787+0000 7f51eeffd640 1 --2- 172.21.15.5:0/857815648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f00d1850 0x7f51f014cbd0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f51e400c500 tx=0x7f51e400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.787+0000 7f51d7fff640 1 -- 172.21.15.5:0/857815648 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e4005220 con 0x7f51f00d1850 2023-07-14T13:11:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.787+0000 7f51d7fff640 1 -- 172.21.15.5:0/857815648 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e4005380 con 0x7f51f00d1850 2023-07-14T13:11:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.787+0000 7f51d7fff640 1 -- 172.21.15.5:0/857815648 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e4007270 con 0x7f51f00d1850 2023-07-14T13:11:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.787+0000 7f51f5d96640 1 -- 172.21.15.5:0/857815648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f014e630 con 0x7f51f00d1850 2023-07-14T13:11:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.787+0000 7f51f5d96640 1 -- 172.21.15.5:0/857815648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f014ebf0 con 0x7f51f00d1850 2023-07-14T13:11:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.787+0000 7f51f5d96640 1 -- 172.21.15.5:0/857815648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f00b3c20 con 0x7f51f00d1850 2023-07-14T13:11:37.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.787+0000 7f51d7fff640 1 -- 172.21.15.5:0/857815648 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f51e40073d0 con 0x7f51f00d1850 2023-07-14T13:11:37.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.787+0000 7f51d7fff640 1 --2- 172.21.15.5:0/857815648 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f51dc0663a0 0x7f51dc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:37.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.787+0000 7f51d7fff640 1 -- 172.21.15.5:0/857815648 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f51e4083880 con 0x7f51f00d1850 2023-07-14T13:11:37.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.787+0000 7f51ef7fe640 1 --2- 172.21.15.5:0/857815648 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f51dc0663a0 0x7f51dc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:37.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.791+0000 7f51ef7fe640 1 --2- 172.21.15.5:0/857815648 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f51dc0663a0 0x7f51dc068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f51f00c5910 tx=0x7f51e0009040 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:37.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.791+0000 7f51d7fff640 1 -- 172.21.15.5:0/857815648 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f51e4050b60 con 0x7f51f00d1850 2023-07-14T13:11:37.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.947+0000 7f51f5d96640 1 -- 172.21.15.5:0/857815648 --> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f51f00678d0 con 0x7f51dc0663a0 2023-07-14T13:11:37.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.955+0000 7f51d7fff640 1 -- 172.21.15.5:0/857815648 <== mgr.7657 v2:172.21.15.154:6832/938367911 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311738 (secure 0 0 0) 0x7f51f00678d0 con 0x7f51dc0663a0 2023-07-14T13:11:37.991 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:11:37.993 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:11:37.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.959+0000 7f51f5d96640 1 -- 172.21.15.5:0/857815648 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f51dc0663a0 msgr2=0x7f51dc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:37.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.959+0000 7f51f5d96640 1 --2- 172.21.15.5:0/857815648 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f51dc0663a0 0x7f51dc068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f51f00c5910 tx=0x7f51e0009040 comp rx=0 tx=0).stop 2023-07-14T13:11:37.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.959+0000 7f51f5d96640 1 -- 172.21.15.5:0/857815648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f00d1850 msgr2=0x7f51f014cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:37.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.959+0000 7f51f5d96640 1 --2- 172.21.15.5:0/857815648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f00d1850 0x7f51f014cbd0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f51e400c500 tx=0x7f51e400c9c0 comp rx=0 tx=0).stop 2023-07-14T13:11:37.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.959+0000 7f51f5d96640 1 -- 172.21.15.5:0/857815648 shutdown_connections 2023-07-14T13:11:37.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.959+0000 7f51f5d96640 1 --2- 172.21.15.5:0/857815648 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f51dc0663a0 0x7f51dc068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:37.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.959+0000 7f51f5d96640 1 --2- 172.21.15.5:0/857815648 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51f015fd60 0x7f51f00c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:37.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.959+0000 7f51f5d96640 1 --2- 172.21.15.5:0/857815648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51f00d1850 0x7f51f014cbd0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:37.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.959+0000 7f51f5d96640 1 --2- 172.21.15.5:0/857815648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51f00b7c70 0x7f51f01558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:37.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.959+0000 7f51f5d96640 1 -- 172.21.15.5:0/857815648 >> 172.21.15.5:0/857815648 conn(0x7f51f00650b0 msgr2=0x7f51f00cfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:37.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.959+0000 7f51f5d96640 1 -- 172.21.15.5:0/857815648 shutdown_connections 2023-07-14T13:11:37.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:37.959+0000 7f51f5d96640 1 -- 172.21.15.5:0/857815648 wait complete. 2023-07-14T13:11:38.011 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-14T13:11:36.583321+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":404,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":266,"ondisk_log_size":266,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":202,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":340576,"kb_used_data":13472,"kb_used_omap":0,"kb_used_meta":327040,"kb_avail":754634144,"statfs":{"total":773094113280,"available":772745363456,"internally_reserved":0,"allocated":13795328,"data_stored":7546198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":334888960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002321"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117720+0000","last_change":"2023-07-14T13:11:28.937505+0000","last_active":"2023-07-14T13:11:30.117720+0000","last_peered":"2023-07-14T13:11:30.117720+0000","last_clean":"2023-07-14T13:11:30.117720+0000","last_became_active":"2023-07-14T13:11:28.937183+0000","last_became_peered":"2023-07-14T13:11:28.937183+0000","last_unstale":"2023-07-14T13:11:30.117720+0000","last_undegraded":"2023-07-14T13:11:30.117720+0000","last_fullsized":"2023-07-14T13:11:30.117720+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:58:02.301291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120835+0000","last_change":"2023-07-14T13:11:28.932438+0000","last_active":"2023-07-14T13:11:30.120835+0000","last_peered":"2023-07-14T13:11:30.120835+0000","last_clean":"2023-07-14T13:11:30.120835+0000","last_became_active":"2023-07-14T13:11:28.932140+0000","last_became_peered":"2023-07-14T13:11:28.932140+0000","last_unstale":"2023-07-14T13:11:30.120835+0000","last_undegraded":"2023-07-14T13:11:30.120835+0000","last_fullsized":"2023-07-14T13:11:30.120835+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:30:57.128682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117283+0000","last_change":"2023-07-14T13:11:28.937015+0000","last_active":"2023-07-14T13:11:30.117283+0000","last_peered":"2023-07-14T13:11:30.117283+0000","last_clean":"2023-07-14T13:11:30.117283+0000","last_became_active":"2023-07-14T13:11:28.936673+0000","last_became_peered":"2023-07-14T13:11:28.936673+0000","last_unstale":"2023-07-14T13:11:30.117283+0000","last_undegraded":"2023-07-14T13:11:30.117283+0000","last_fullsized":"2023-07-14T13:11:30.117283+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:51:41.805311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116581+0000","last_change":"2023-07-14T13:11:28.938214+0000","last_active":"2023-07-14T13:11:30.116581+0000","last_peered":"2023-07-14T13:11:30.116581+0000","last_clean":"2023-07-14T13:11:30.116581+0000","last_became_active":"2023-07-14T13:11:28.937731+0000","last_became_peered":"2023-07-14T13:11:28.937731+0000","last_unstale":"2023-07-14T13:11:30.116581+0000","last_undegraded":"2023-07-14T13:11:30.116581+0000","last_fullsized":"2023-07-14T13:11:30.116581+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:03:51.951611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.938417+0000","last_change":"2023-07-14T13:11:28.933026+0000","last_active":"2023-07-14T13:11:29.938417+0000","last_peered":"2023-07-14T13:11:29.938417+0000","last_clean":"2023-07-14T13:11:29.938417+0000","last_became_active":"2023-07-14T13:11:28.932630+0000","last_became_peered":"2023-07-14T13:11:28.932630+0000","last_unstale":"2023-07-14T13:11:29.938417+0000","last_undegraded":"2023-07-14T13:11:29.938417+0000","last_fullsized":"2023-07-14T13:11:29.938417+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:24:50.470926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120102+0000","last_change":"2023-07-14T13:11:28.936823+0000","last_active":"2023-07-14T13:11:30.120102+0000","last_peered":"2023-07-14T13:11:30.120102+0000","last_clean":"2023-07-14T13:11:30.120102+0000","last_became_active":"2023-07-14T13:11:28.933367+0000","last_became_peered":"2023-07-14T13:11:28.933367+0000","last_unstale":"2023-07-14T13:11:30.120102+0000","last_undegraded":"2023-07-14T13:11:30.120102+0000","last_fullsized":"2023-07-14T13:11:30.120102+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:07:55.568201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120212+0000","last_change":"2023-07-14T13:11:28.936472+0000","last_active":"2023-07-14T13:11:30.120212+0000","last_peered":"2023-07-14T13:11:30.120212+0000","last_clean":"2023-07-14T13:11:30.120212+0000","last_became_active":"2023-07-14T13:11:28.933301+0000","last_became_peered":"2023-07-14T13:11:28.933301+0000","last_unstale":"2023-07-14T13:11:30.120212+0000","last_undegraded":"2023-07-14T13:11:30.120212+0000","last_fullsized":"2023-07-14T13:11:30.120212+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:28:29.164683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116032+0000","last_change":"2023-07-14T13:11:28.932903+0000","last_active":"2023-07-14T13:11:30.116032+0000","last_peered":"2023-07-14T13:11:30.116032+0000","last_clean":"2023-07-14T13:11:30.116032+0000","last_became_active":"2023-07-14T13:11:28.932332+0000","last_became_peered":"2023-07-14T13:11:28.932332+0000","last_unstale":"2023-07-14T13:11:30.116032+0000","last_undegraded":"2023-07-14T13:11:30.116032+0000","last_fullsized":"2023-07-14T13:11:30.116032+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:57:10.895292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.121412+0000","last_change":"2023-07-14T13:11:28.943138+0000","last_active":"2023-07-14T13:11:30.121412+0000","last_peered":"2023-07-14T13:11:30.121412+0000","last_clean":"2023-07-14T13:11:30.121412+0000","last_became_active":"2023-07-14T13:11:28.942855+0000","last_became_peered":"2023-07-14T13:11:28.942855+0000","last_unstale":"2023-07-14T13:11:30.121412+0000","last_undegraded":"2023-07-14T13:11:30.121412+0000","last_fullsized":"2023-07-14T13:11:30.121412+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:38:54.506417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.938760+0000","last_change":"2023-07-14T13:11:28.940823+0000","last_active":"2023-07-14T13:11:29.938760+0000","last_peered":"2023-07-14T13:11:29.938760+0000","last_clean":"2023-07-14T13:11:29.938760+0000","last_became_active":"2023-07-14T13:11:28.940556+0000","last_became_peered":"2023-07-14T13:11:28.940556+0000","last_unstale":"2023-07-14T13:11:29.938760+0000","last_undegraded":"2023-07-14T13:11:29.938760+0000","last_fullsized":"2023-07-14T13:11:29.938760+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:47:20.135231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120742+0000","last_change":"2023-07-14T13:11:28.944863+0000","last_active":"2023-07-14T13:11:30.120742+0000","last_peered":"2023-07-14T13:11:30.120742+0000","last_clean":"2023-07-14T13:11:30.120742+0000","last_became_active":"2023-07-14T13:11:28.944482+0000","last_became_peered":"2023-07-14T13:11:28.944482+0000","last_unstale":"2023-07-14T13:11:30.120742+0000","last_undegraded":"2023-07-14T13:11:30.120742+0000","last_fullsized":"2023-07-14T13:11:30.120742+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:34:55.653766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.943472+0000","last_change":"2023-07-14T13:11:28.945658+0000","last_active":"2023-07-14T13:11:29.943472+0000","last_peered":"2023-07-14T13:11:29.943472+0000","last_clean":"2023-07-14T13:11:29.943472+0000","last_became_active":"2023-07-14T13:11:28.945365+0000","last_became_peered":"2023-07-14T13:11:28.945365+0000","last_unstale":"2023-07-14T13:11:29.943472+0000","last_undegraded":"2023-07-14T13:11:29.943472+0000","last_fullsized":"2023-07-14T13:11:29.943472+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:23:25.248124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116678+0000","last_change":"2023-07-14T13:11:28.938807+0000","last_active":"2023-07-14T13:11:30.116678+0000","last_peered":"2023-07-14T13:11:30.116678+0000","last_clean":"2023-07-14T13:11:30.116678+0000","last_became_active":"2023-07-14T13:11:28.938531+0000","last_became_peered":"2023-07-14T13:11:28.938531+0000","last_unstale":"2023-07-14T13:11:30.116678+0000","last_undegraded":"2023-07-14T13:11:30.116678+0000","last_fullsized":"2023-07-14T13:11:30.116678+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:02:12.615212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.119899+0000","last_change":"2023-07-14T13:11:28.941055+0000","last_active":"2023-07-14T13:11:30.119899+0000","last_peered":"2023-07-14T13:11:30.119899+0000","last_clean":"2023-07-14T13:11:30.119899+0000","last_became_active":"2023-07-14T13:11:28.940793+0000","last_became_peered":"2023-07-14T13:11:28.940793+0000","last_unstale":"2023-07-14T13:11:30.119899+0000","last_undegraded":"2023-07-14T13:11:30.119899+0000","last_fullsized":"2023-07-14T13:11:30.119899+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:06:11.358013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.121007+0000","last_change":"2023-07-14T13:11:28.939981+0000","last_active":"2023-07-14T13:11:30.121007+0000","last_peered":"2023-07-14T13:11:30.121007+0000","last_clean":"2023-07-14T13:11:30.121007+0000","last_became_active":"2023-07-14T13:11:28.939716+0000","last_became_peered":"2023-07-14T13:11:28.939716+0000","last_unstale":"2023-07-14T13:11:30.121007+0000","last_undegraded":"2023-07-14T13:11:30.121007+0000","last_fullsized":"2023-07-14T13:11:30.121007+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:16:31.731466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.119767+0000","last_change":"2023-07-14T13:11:28.933967+0000","last_active":"2023-07-14T13:11:30.119767+0000","last_peered":"2023-07-14T13:11:30.119767+0000","last_clean":"2023-07-14T13:11:30.119767+0000","last_became_active":"2023-07-14T13:11:28.933687+0000","last_became_peered":"2023-07-14T13:11:28.933687+0000","last_unstale":"2023-07-14T13:11:30.119767+0000","last_undegraded":"2023-07-14T13:11:30.119767+0000","last_fullsized":"2023-07-14T13:11:30.119767+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:07:02.680334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117793+0000","last_change":"2023-07-14T13:11:28.939066+0000","last_active":"2023-07-14T13:11:30.117793+0000","last_peered":"2023-07-14T13:11:30.117793+0000","last_clean":"2023-07-14T13:11:30.117793+0000","last_became_active":"2023-07-14T13:11:28.938421+0000","last_became_peered":"2023-07-14T13:11:28.938421+0000","last_unstale":"2023-07-14T13:11:30.117793+0000","last_undegraded":"2023-07-14T13:11:30.117793+0000","last_fullsized":"2023-07-14T13:11:30.117793+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:58:27.623214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120976+0000","last_change":"2023-07-14T13:11:28.936571+0000","last_active":"2023-07-14T13:11:30.120976+0000","last_peered":"2023-07-14T13:11:30.120976+0000","last_clean":"2023-07-14T13:11:30.120976+0000","last_became_active":"2023-07-14T13:11:28.933226+0000","last_became_peered":"2023-07-14T13:11:28.933226+0000","last_unstale":"2023-07-14T13:11:30.120976+0000","last_undegraded":"2023-07-14T13:11:30.120976+0000","last_fullsized":"2023-07-14T13:11:30.120976+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:39.146219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117419+0000","last_change":"2023-07-14T13:11:28.942536+0000","last_active":"2023-07-14T13:11:30.117419+0000","last_peered":"2023-07-14T13:11:30.117419+0000","last_clean":"2023-07-14T13:11:30.117419+0000","last_became_active":"2023-07-14T13:11:28.941912+0000","last_became_peered":"2023-07-14T13:11:28.941912+0000","last_unstale":"2023-07-14T13:11:30.117419+0000","last_undegraded":"2023-07-14T13:11:30.117419+0000","last_fullsized":"2023-07-14T13:11:30.117419+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:08:16.990146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.943662+0000","last_change":"2023-07-14T13:11:28.934993+0000","last_active":"2023-07-14T13:11:29.943662+0000","last_peered":"2023-07-14T13:11:29.943662+0000","last_clean":"2023-07-14T13:11:29.943662+0000","last_became_active":"2023-07-14T13:11:28.934694+0000","last_became_peered":"2023-07-14T13:11:28.934694+0000","last_unstale":"2023-07-14T13:11:29.943662+0000","last_undegraded":"2023-07-14T13:11:29.943662+0000","last_fullsized":"2023-07-14T13:11:29.943662+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:02:30.834694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116661+0000","last_change":"2023-07-14T13:11:28.939892+0000","last_active":"2023-07-14T13:11:30.116661+0000","last_peered":"2023-07-14T13:11:30.116661+0000","last_clean":"2023-07-14T13:11:30.116661+0000","last_became_active":"2023-07-14T13:11:28.939375+0000","last_became_peered":"2023-07-14T13:11:28.939375+0000","last_unstale":"2023-07-14T13:11:30.116661+0000","last_undegraded":"2023-07-14T13:11:30.116661+0000","last_fullsized":"2023-07-14T13:11:30.116661+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:38:52.540198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.938356+0000","last_change":"2023-07-14T13:11:28.942536+0000","last_active":"2023-07-14T13:11:29.938356+0000","last_peered":"2023-07-14T13:11:29.938356+0000","last_clean":"2023-07-14T13:11:29.938356+0000","last_became_active":"2023-07-14T13:11:28.942263+0000","last_became_peered":"2023-07-14T13:11:28.942263+0000","last_unstale":"2023-07-14T13:11:29.938356+0000","last_undegraded":"2023-07-14T13:11:29.938356+0000","last_fullsized":"2023-07-14T13:11:29.938356+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:05:52.518762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116543+0000","last_change":"2023-07-14T13:11:28.936877+0000","last_active":"2023-07-14T13:11:30.116543+0000","last_peered":"2023-07-14T13:11:30.116543+0000","last_clean":"2023-07-14T13:11:30.116543+0000","last_became_active":"2023-07-14T13:11:28.936544+0000","last_became_peered":"2023-07-14T13:11:28.936544+0000","last_unstale":"2023-07-14T13:11:30.116543+0000","last_undegraded":"2023-07-14T13:11:30.116543+0000","last_fullsized":"2023-07-14T13:11:30.116543+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:49:35.976553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.938485+0000","last_change":"2023-07-14T13:11:28.930506+0000","last_active":"2023-07-14T13:11:29.938485+0000","last_peered":"2023-07-14T13:11:29.938485+0000","last_clean":"2023-07-14T13:11:29.938485+0000","last_became_active":"2023-07-14T13:11:28.930210+0000","last_became_peered":"2023-07-14T13:11:28.930210+0000","last_unstale":"2023-07-14T13:11:29.938485+0000","last_undegraded":"2023-07-14T13:11:29.938485+0000","last_fullsized":"2023-07-14T13:11:29.938485+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:21:12.219751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.943426+0000","last_change":"2023-07-14T13:11:28.942344+0000","last_active":"2023-07-14T13:11:29.943426+0000","last_peered":"2023-07-14T13:11:29.943426+0000","last_clean":"2023-07-14T13:11:29.943426+0000","last_became_active":"2023-07-14T13:11:28.942086+0000","last_became_peered":"2023-07-14T13:11:28.942086+0000","last_unstale":"2023-07-14T13:11:29.943426+0000","last_undegraded":"2023-07-14T13:11:29.943426+0000","last_fullsized":"2023-07-14T13:11:29.943426+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:52:34.146671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.943543+0000","last_change":"2023-07-14T13:11:28.943678+0000","last_active":"2023-07-14T13:11:29.943543+0000","last_peered":"2023-07-14T13:11:29.943543+0000","last_clean":"2023-07-14T13:11:29.943543+0000","last_became_active":"2023-07-14T13:11:28.943402+0000","last_became_peered":"2023-07-14T13:11:28.943402+0000","last_unstale":"2023-07-14T13:11:29.943543+0000","last_undegraded":"2023-07-14T13:11:29.943543+0000","last_fullsized":"2023-07-14T13:11:29.943543+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:03:51.951611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120864+0000","last_change":"2023-07-14T13:11:28.936224+0000","last_active":"2023-07-14T13:11:30.120864+0000","last_peered":"2023-07-14T13:11:30.120864+0000","last_clean":"2023-07-14T13:11:30.120864+0000","last_became_active":"2023-07-14T13:11:28.935811+0000","last_became_peered":"2023-07-14T13:11:28.935811+0000","last_unstale":"2023-07-14T13:11:30.120864+0000","last_undegraded":"2023-07-14T13:11:30.120864+0000","last_fullsized":"2023-07-14T13:11:30.120864+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:29:26.184090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120270+0000","last_change":"2023-07-14T13:11:28.937333+0000","last_active":"2023-07-14T13:11:30.120270+0000","last_peered":"2023-07-14T13:11:30.120270+0000","last_clean":"2023-07-14T13:11:30.120270+0000","last_became_active":"2023-07-14T13:11:28.936918+0000","last_became_peered":"2023-07-14T13:11:28.936918+0000","last_unstale":"2023-07-14T13:11:30.120270+0000","last_undegraded":"2023-07-14T13:11:30.120270+0000","last_fullsized":"2023-07-14T13:11:30.120270+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:44:08.954326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116795+0000","last_change":"2023-07-14T13:11:28.927105+0000","last_active":"2023-07-14T13:11:30.116795+0000","last_peered":"2023-07-14T13:11:30.116795+0000","last_clean":"2023-07-14T13:11:30.116795+0000","last_became_active":"2023-07-14T13:11:28.926773+0000","last_became_peered":"2023-07-14T13:11:28.926773+0000","last_unstale":"2023-07-14T13:11:30.116795+0000","last_undegraded":"2023-07-14T13:11:30.116795+0000","last_fullsized":"2023-07-14T13:11:30.116795+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:03.021424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.943234+0000","last_change":"2023-07-14T13:11:28.942020+0000","last_active":"2023-07-14T13:11:29.943234+0000","last_peered":"2023-07-14T13:11:29.943234+0000","last_clean":"2023-07-14T13:11:29.943234+0000","last_became_active":"2023-07-14T13:11:28.941664+0000","last_became_peered":"2023-07-14T13:11:28.941664+0000","last_unstale":"2023-07-14T13:11:29.943234+0000","last_undegraded":"2023-07-14T13:11:29.943234+0000","last_fullsized":"2023-07-14T13:11:29.943234+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:02:12.615212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120358+0000","last_change":"2023-07-14T13:11:28.930417+0000","last_active":"2023-07-14T13:11:30.120358+0000","last_peered":"2023-07-14T13:11:30.120358+0000","last_clean":"2023-07-14T13:11:30.120358+0000","last_became_active":"2023-07-14T13:11:28.929973+0000","last_became_peered":"2023-07-14T13:11:28.929973+0000","last_unstale":"2023-07-14T13:11:30.120358+0000","last_undegraded":"2023-07-14T13:11:30.120358+0000","last_fullsized":"2023-07-14T13:11:30.120358+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:33:25.503154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116659+0000","last_change":"2023-07-14T13:11:28.933847+0000","last_active":"2023-07-14T13:11:30.116659+0000","last_peered":"2023-07-14T13:11:30.116659+0000","last_clean":"2023-07-14T13:11:30.116659+0000","last_became_active":"2023-07-14T13:11:28.933462+0000","last_became_peered":"2023-07-14T13:11:28.933462+0000","last_unstale":"2023-07-14T13:11:30.116659+0000","last_undegraded":"2023-07-14T13:11:30.116659+0000","last_fullsized":"2023-07-14T13:11:30.116659+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:25:19.872268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117224+0000","last_change":"2023-07-14T13:11:28.941609+0000","last_active":"2023-07-14T13:11:30.117224+0000","last_peered":"2023-07-14T13:11:30.117224+0000","last_clean":"2023-07-14T13:11:30.117224+0000","last_became_active":"2023-07-14T13:11:28.941318+0000","last_became_peered":"2023-07-14T13:11:28.941318+0000","last_unstale":"2023-07-14T13:11:30.117224+0000","last_undegraded":"2023-07-14T13:11:30.117224+0000","last_fullsized":"2023-07-14T13:11:30.117224+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:38:27.906860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"126'4","reported_seq":17,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117096+0000","last_change":"2023-07-14T13:11:27.912001+0000","last_active":"2023-07-14T13:11:30.117096+0000","last_peered":"2023-07-14T13:11:30.117096+0000","last_clean":"2023-07-14T13:11:30.117096+0000","last_became_active":"2023-07-14T13:11:27.911416+0000","last_became_peered":"2023-07-14T13:11:27.911416+0000","last_unstale":"2023-07-14T13:11:30.117096+0000","last_undegraded":"2023-07-14T13:11:30.117096+0000","last_fullsized":"2023-07-14T13:11:30.117096+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:41:01.159408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116780+0000","last_change":"2023-07-14T13:11:28.932160+0000","last_active":"2023-07-14T13:11:30.116780+0000","last_peered":"2023-07-14T13:11:30.116780+0000","last_clean":"2023-07-14T13:11:30.116780+0000","last_became_active":"2023-07-14T13:11:28.931854+0000","last_became_peered":"2023-07-14T13:11:28.931854+0000","last_unstale":"2023-07-14T13:11:30.116780+0000","last_undegraded":"2023-07-14T13:11:30.116780+0000","last_fullsized":"2023-07-14T13:11:30.116780+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:45:40.991356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"126'1","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117565+0000","last_change":"2023-07-14T13:11:27.908608+0000","last_active":"2023-07-14T13:11:30.117565+0000","last_peered":"2023-07-14T13:11:30.117565+0000","last_clean":"2023-07-14T13:11:30.117565+0000","last_became_active":"2023-07-14T13:11:27.908336+0000","last_became_peered":"2023-07-14T13:11:27.908336+0000","last_unstale":"2023-07-14T13:11:30.117565+0000","last_undegraded":"2023-07-14T13:11:30.117565+0000","last_fullsized":"2023-07-14T13:11:30.117565+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:40:09.057376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.943566+0000","last_change":"2023-07-14T13:11:28.934926+0000","last_active":"2023-07-14T13:11:29.943566+0000","last_peered":"2023-07-14T13:11:29.943566+0000","last_clean":"2023-07-14T13:11:29.943566+0000","last_became_active":"2023-07-14T13:11:28.934614+0000","last_became_peered":"2023-07-14T13:11:28.934614+0000","last_unstale":"2023-07-14T13:11:29.943566+0000","last_undegraded":"2023-07-14T13:11:29.943566+0000","last_fullsized":"2023-07-14T13:11:29.943566+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:50:51.874884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"126'2","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.943628+0000","last_change":"2023-07-14T13:11:27.909451+0000","last_active":"2023-07-14T13:11:29.943628+0000","last_peered":"2023-07-14T13:11:29.943628+0000","last_clean":"2023-07-14T13:11:29.943628+0000","last_became_active":"2023-07-14T13:11:27.909180+0000","last_became_peered":"2023-07-14T13:11:27.909180+0000","last_unstale":"2023-07-14T13:11:29.943628+0000","last_undegraded":"2023-07-14T13:11:29.943628+0000","last_fullsized":"2023-07-14T13:11:29.943628+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:41:01.159408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.121035+0000","last_change":"2023-07-14T13:11:28.936619+0000","last_active":"2023-07-14T13:11:30.121035+0000","last_peered":"2023-07-14T13:11:30.121035+0000","last_clean":"2023-07-14T13:11:30.121035+0000","last_became_active":"2023-07-14T13:11:28.936351+0000","last_became_peered":"2023-07-14T13:11:28.936351+0000","last_unstale":"2023-07-14T13:11:30.121035+0000","last_undegraded":"2023-07-14T13:11:30.121035+0000","last_fullsized":"2023-07-14T13:11:30.121035+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:23:15.836746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"126'2","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.938855+0000","last_change":"2023-07-14T13:11:27.902198+0000","last_active":"2023-07-14T13:11:29.938855+0000","last_peered":"2023-07-14T13:11:29.938855+0000","last_clean":"2023-07-14T13:11:29.938855+0000","last_became_active":"2023-07-14T13:11:27.901878+0000","last_became_peered":"2023-07-14T13:11:27.901878+0000","last_unstale":"2023-07-14T13:11:29.938855+0000","last_undegraded":"2023-07-14T13:11:29.938855+0000","last_fullsized":"2023-07-14T13:11:29.938855+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:08:17.592126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116710+0000","last_change":"2023-07-14T13:11:28.939010+0000","last_active":"2023-07-14T13:11:30.116710+0000","last_peered":"2023-07-14T13:11:30.116710+0000","last_clean":"2023-07-14T13:11:30.116710+0000","last_became_active":"2023-07-14T13:11:28.938156+0000","last_became_peered":"2023-07-14T13:11:28.938156+0000","last_unstale":"2023-07-14T13:11:30.116710+0000","last_undegraded":"2023-07-14T13:11:30.116710+0000","last_fullsized":"2023-07-14T13:11:30.116710+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:50:51.874884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"126'1","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.119935+0000","last_change":"2023-07-14T13:11:27.915760+0000","last_active":"2023-07-14T13:11:30.119935+0000","last_peered":"2023-07-14T13:11:30.119935+0000","last_clean":"2023-07-14T13:11:30.119935+0000","last_became_active":"2023-07-14T13:11:27.915444+0000","last_became_peered":"2023-07-14T13:11:27.915444+0000","last_unstale":"2023-07-14T13:11:30.119935+0000","last_undegraded":"2023-07-14T13:11:30.119935+0000","last_fullsized":"2023-07-14T13:11:30.119935+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:45:50.882715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117549+0000","last_change":"2023-07-14T13:11:28.942716+0000","last_active":"2023-07-14T13:11:30.117549+0000","last_peered":"2023-07-14T13:11:30.117549+0000","last_clean":"2023-07-14T13:11:30.117549+0000","last_became_active":"2023-07-14T13:11:28.942265+0000","last_became_peered":"2023-07-14T13:11:28.942265+0000","last_unstale":"2023-07-14T13:11:30.117549+0000","last_undegraded":"2023-07-14T13:11:30.117549+0000","last_fullsized":"2023-07-14T13:11:30.117549+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:56:27.033366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"126'1","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120584+0000","last_change":"2023-07-14T13:11:27.904817+0000","last_active":"2023-07-14T13:11:30.120584+0000","last_peered":"2023-07-14T13:11:30.120584+0000","last_clean":"2023-07-14T13:11:30.120584+0000","last_became_active":"2023-07-14T13:11:27.904417+0000","last_became_peered":"2023-07-14T13:11:27.904417+0000","last_unstale":"2023-07-14T13:11:30.120584+0000","last_undegraded":"2023-07-14T13:11:30.120584+0000","last_fullsized":"2023-07-14T13:11:30.120584+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:32:34.457116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.121113+0000","last_change":"2023-07-14T13:11:28.937605+0000","last_active":"2023-07-14T13:11:30.121113+0000","last_peered":"2023-07-14T13:11:30.121113+0000","last_clean":"2023-07-14T13:11:30.121113+0000","last_became_active":"2023-07-14T13:11:28.937304+0000","last_became_peered":"2023-07-14T13:11:28.937304+0000","last_unstale":"2023-07-14T13:11:30.121113+0000","last_undegraded":"2023-07-14T13:11:30.121113+0000","last_fullsized":"2023-07-14T13:11:30.121113+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:21:06.348199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.943065+0000","last_change":"2023-07-14T13:11:27.904887+0000","last_active":"2023-07-14T13:11:29.943065+0000","last_peered":"2023-07-14T13:11:29.943065+0000","last_clean":"2023-07-14T13:11:29.943065+0000","last_became_active":"2023-07-14T13:11:27.904566+0000","last_became_peered":"2023-07-14T13:11:27.904566+0000","last_unstale":"2023-07-14T13:11:29.943065+0000","last_undegraded":"2023-07-14T13:11:29.943065+0000","last_fullsized":"2023-07-14T13:11:29.943065+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:03:54.991807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116981+0000","last_change":"2023-07-14T13:11:28.935923+0000","last_active":"2023-07-14T13:11:30.116981+0000","last_peered":"2023-07-14T13:11:30.116981+0000","last_clean":"2023-07-14T13:11:30.116981+0000","last_became_active":"2023-07-14T13:11:28.935609+0000","last_became_peered":"2023-07-14T13:11:28.935609+0000","last_unstale":"2023-07-14T13:11:30.116981+0000","last_undegraded":"2023-07-14T13:11:30.116981+0000","last_fullsized":"2023-07-14T13:11:30.116981+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:52:25.032576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116224+0000","last_change":"2023-07-14T13:11:27.903404+0000","last_active":"2023-07-14T13:11:30.116224+0000","last_peered":"2023-07-14T13:11:30.116224+0000","last_clean":"2023-07-14T13:11:30.116224+0000","last_became_active":"2023-07-14T13:11:27.903115+0000","last_became_peered":"2023-07-14T13:11:27.903115+0000","last_unstale":"2023-07-14T13:11:30.116224+0000","last_undegraded":"2023-07-14T13:11:30.116224+0000","last_fullsized":"2023-07-14T13:11:30.116224+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:03:54.991807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117082+0000","last_change":"2023-07-14T13:11:28.930562+0000","last_active":"2023-07-14T13:11:30.117082+0000","last_peered":"2023-07-14T13:11:30.117082+0000","last_clean":"2023-07-14T13:11:30.117082+0000","last_became_active":"2023-07-14T13:11:28.930253+0000","last_became_peered":"2023-07-14T13:11:28.930253+0000","last_unstale":"2023-07-14T13:11:30.117082+0000","last_undegraded":"2023-07-14T13:11:30.117082+0000","last_fullsized":"2023-07-14T13:11:30.117082+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:46:28.800518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.943564+0000","last_change":"2023-07-14T13:11:27.904996+0000","last_active":"2023-07-14T13:11:29.943564+0000","last_peered":"2023-07-14T13:11:29.943564+0000","last_clean":"2023-07-14T13:11:29.943564+0000","last_became_active":"2023-07-14T13:11:27.904702+0000","last_became_peered":"2023-07-14T13:11:27.904702+0000","last_unstale":"2023-07-14T13:11:29.943564+0000","last_undegraded":"2023-07-14T13:11:29.943564+0000","last_fullsized":"2023-07-14T13:11:29.943564+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:52:24.025324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.938314+0000","last_change":"2023-07-14T13:11:28.933993+0000","last_active":"2023-07-14T13:11:29.938314+0000","last_peered":"2023-07-14T13:11:29.938314+0000","last_clean":"2023-07-14T13:11:29.938314+0000","last_became_active":"2023-07-14T13:11:28.933686+0000","last_became_peered":"2023-07-14T13:11:28.933686+0000","last_unstale":"2023-07-14T13:11:29.938314+0000","last_undegraded":"2023-07-14T13:11:29.938314+0000","last_fullsized":"2023-07-14T13:11:29.938314+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:39:10.653914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116363+0000","last_change":"2023-07-14T13:11:27.900517+0000","last_active":"2023-07-14T13:11:30.116363+0000","last_peered":"2023-07-14T13:11:30.116363+0000","last_clean":"2023-07-14T13:11:30.116363+0000","last_became_active":"2023-07-14T13:11:27.900219+0000","last_became_peered":"2023-07-14T13:11:27.900219+0000","last_unstale":"2023-07-14T13:11:30.116363+0000","last_undegraded":"2023-07-14T13:11:30.116363+0000","last_fullsized":"2023-07-14T13:11:30.116363+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:10:05.871392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117423+0000","last_change":"2023-07-14T13:11:28.931301+0000","last_active":"2023-07-14T13:11:30.117423+0000","last_peered":"2023-07-14T13:11:30.117423+0000","last_clean":"2023-07-14T13:11:30.117423+0000","last_became_active":"2023-07-14T13:11:28.930986+0000","last_became_peered":"2023-07-14T13:11:28.930986+0000","last_unstale":"2023-07-14T13:11:30.117423+0000","last_undegraded":"2023-07-14T13:11:30.117423+0000","last_fullsized":"2023-07-14T13:11:30.117423+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:51:02.874714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"126'3","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120048+0000","last_change":"2023-07-14T13:11:27.911972+0000","last_active":"2023-07-14T13:11:30.120048+0000","last_peered":"2023-07-14T13:11:30.120048+0000","last_clean":"2023-07-14T13:11:30.120048+0000","last_became_active":"2023-07-14T13:11:27.911403+0000","last_became_peered":"2023-07-14T13:11:27.911403+0000","last_unstale":"2023-07-14T13:11:30.120048+0000","last_undegraded":"2023-07-14T13:11:30.120048+0000","last_fullsized":"2023-07-14T13:11:30.120048+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:25:24.234724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.938558+0000","last_change":"2023-07-14T13:11:28.931169+0000","last_active":"2023-07-14T13:11:29.938558+0000","last_peered":"2023-07-14T13:11:29.938558+0000","last_clean":"2023-07-14T13:11:29.938558+0000","last_became_active":"2023-07-14T13:11:28.930676+0000","last_became_peered":"2023-07-14T13:11:28.930676+0000","last_unstale":"2023-07-14T13:11:29.938558+0000","last_undegraded":"2023-07-14T13:11:29.938558+0000","last_fullsized":"2023-07-14T13:11:29.938558+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:43:50.415372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"126'6","reported_seq":19,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120511+0000","last_change":"2023-07-14T13:11:27.910905+0000","last_active":"2023-07-14T13:11:30.120511+0000","last_peered":"2023-07-14T13:11:30.120511+0000","last_clean":"2023-07-14T13:11:30.120511+0000","last_became_active":"2023-07-14T13:11:27.910550+0000","last_became_peered":"2023-07-14T13:11:27.910550+0000","last_unstale":"2023-07-14T13:11:30.120511+0000","last_undegraded":"2023-07-14T13:11:30.120511+0000","last_fullsized":"2023-07-14T13:11:30.120511+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:07:37.058280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120380+0000","last_change":"2023-07-14T13:11:28.940926+0000","last_active":"2023-07-14T13:11:30.120380+0000","last_peered":"2023-07-14T13:11:30.120380+0000","last_clean":"2023-07-14T13:11:30.120380+0000","last_became_active":"2023-07-14T13:11:28.940642+0000","last_became_peered":"2023-07-14T13:11:28.940642+0000","last_unstale":"2023-07-14T13:11:30.120380+0000","last_undegraded":"2023-07-14T13:11:30.120380+0000","last_fullsized":"2023-07-14T13:11:30.120380+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:39:00.032356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"126'2","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.938609+0000","last_change":"2023-07-14T13:11:27.907025+0000","last_active":"2023-07-14T13:11:29.938609+0000","last_peered":"2023-07-14T13:11:29.938609+0000","last_clean":"2023-07-14T13:11:29.938609+0000","last_became_active":"2023-07-14T13:11:27.906711+0000","last_became_peered":"2023-07-14T13:11:27.906711+0000","last_unstale":"2023-07-14T13:11:29.938609+0000","last_undegraded":"2023-07-14T13:11:29.938609+0000","last_fullsized":"2023-07-14T13:11:29.938609+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:35:47.101875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120385+0000","last_change":"2023-07-14T13:11:28.943363+0000","last_active":"2023-07-14T13:11:30.120385+0000","last_peered":"2023-07-14T13:11:30.120385+0000","last_clean":"2023-07-14T13:11:30.120385+0000","last_became_active":"2023-07-14T13:11:28.943055+0000","last_became_peered":"2023-07-14T13:11:28.943055+0000","last_unstale":"2023-07-14T13:11:30.120385+0000","last_undegraded":"2023-07-14T13:11:30.120385+0000","last_fullsized":"2023-07-14T13:11:30.120385+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:33:22.445712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116543+0000","last_change":"2023-07-14T13:11:27.905683+0000","last_active":"2023-07-14T13:11:30.116543+0000","last_peered":"2023-07-14T13:11:30.116543+0000","last_clean":"2023-07-14T13:11:30.116543+0000","last_became_active":"2023-07-14T13:11:27.905382+0000","last_became_peered":"2023-07-14T13:11:27.905382+0000","last_unstale":"2023-07-14T13:11:30.116543+0000","last_undegraded":"2023-07-14T13:11:30.116543+0000","last_fullsized":"2023-07-14T13:11:30.116543+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:23:24.240872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117437+0000","last_change":"2023-07-14T13:11:28.933124+0000","last_active":"2023-07-14T13:11:30.117437+0000","last_peered":"2023-07-14T13:11:30.117437+0000","last_clean":"2023-07-14T13:11:30.117437+0000","last_became_active":"2023-07-14T13:11:28.932820+0000","last_became_peered":"2023-07-14T13:11:28.932820+0000","last_unstale":"2023-07-14T13:11:30.117437+0000","last_undegraded":"2023-07-14T13:11:30.117437+0000","last_fullsized":"2023-07-14T13:11:30.117437+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:32:46.470708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116910+0000","last_change":"2023-07-14T13:11:27.899284+0000","last_active":"2023-07-14T13:11:30.116910+0000","last_peered":"2023-07-14T13:11:30.116910+0000","last_clean":"2023-07-14T13:11:30.116910+0000","last_became_active":"2023-07-14T13:11:27.899000+0000","last_became_peered":"2023-07-14T13:11:27.899000+0000","last_unstale":"2023-07-14T13:11:30.116910+0000","last_undegraded":"2023-07-14T13:11:30.116910+0000","last_fullsized":"2023-07-14T13:11:30.116910+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:15:15.170144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117841+0000","last_change":"2023-07-14T13:11:28.939255+0000","last_active":"2023-07-14T13:11:30.117841+0000","last_peered":"2023-07-14T13:11:30.117841+0000","last_clean":"2023-07-14T13:11:30.117841+0000","last_became_active":"2023-07-14T13:11:28.938797+0000","last_became_peered":"2023-07-14T13:11:28.938797+0000","last_unstale":"2023-07-14T13:11:30.117841+0000","last_undegraded":"2023-07-14T13:11:30.117841+0000","last_fullsized":"2023-07-14T13:11:30.117841+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:28:08.697938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"126'8","reported_seq":21,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.943029+0000","last_change":"2023-07-14T13:11:27.903246+0000","last_active":"2023-07-14T13:11:29.943029+0000","last_peered":"2023-07-14T13:11:29.943029+0000","last_clean":"2023-07-14T13:11:29.943029+0000","last_became_active":"2023-07-14T13:11:27.902770+0000","last_became_peered":"2023-07-14T13:11:27.902770+0000","last_unstale":"2023-07-14T13:11:29.943029+0000","last_undegraded":"2023-07-14T13:11:29.943029+0000","last_fullsized":"2023-07-14T13:11:29.943029+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:28:27.449887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116964+0000","last_change":"2023-07-14T13:11:28.937180+0000","last_active":"2023-07-14T13:11:30.116964+0000","last_peered":"2023-07-14T13:11:30.116964+0000","last_clean":"2023-07-14T13:11:30.116964+0000","last_became_active":"2023-07-14T13:11:28.936870+0000","last_became_peered":"2023-07-14T13:11:28.936870+0000","last_unstale":"2023-07-14T13:11:30.116964+0000","last_undegraded":"2023-07-14T13:11:30.116964+0000","last_fullsized":"2023-07-14T13:11:30.116964+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:35:31.974211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"126'2","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.938858+0000","last_change":"2023-07-14T13:11:27.907026+0000","last_active":"2023-07-14T13:11:29.938858+0000","last_peered":"2023-07-14T13:11:29.938858+0000","last_clean":"2023-07-14T13:11:29.938858+0000","last_became_active":"2023-07-14T13:11:27.906738+0000","last_became_peered":"2023-07-14T13:11:27.906738+0000","last_unstale":"2023-07-14T13:11:29.938858+0000","last_undegraded":"2023-07-14T13:11:29.938858+0000","last_fullsized":"2023-07-14T13:11:29.938858+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:58:01.913584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.942974+0000","last_change":"2023-07-14T13:11:28.940162+0000","last_active":"2023-07-14T13:11:29.942974+0000","last_peered":"2023-07-14T13:11:29.942974+0000","last_clean":"2023-07-14T13:11:29.942974+0000","last_became_active":"2023-07-14T13:11:28.939905+0000","last_became_peered":"2023-07-14T13:11:28.939905+0000","last_unstale":"2023-07-14T13:11:29.942974+0000","last_undegraded":"2023-07-14T13:11:29.942974+0000","last_fullsized":"2023-07-14T13:11:29.942974+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:27:21.166621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"127'1","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116525+0000","last_change":"2023-07-14T13:11:27.902133+0000","last_active":"2023-07-14T13:11:30.116525+0000","last_peered":"2023-07-14T13:11:30.116525+0000","last_clean":"2023-07-14T13:11:30.116525+0000","last_became_active":"2023-07-14T13:11:27.901863+0000","last_became_peered":"2023-07-14T13:11:27.901863+0000","last_unstale":"2023-07-14T13:11:30.116525+0000","last_undegraded":"2023-07-14T13:11:30.116525+0000","last_fullsized":"2023-07-14T13:11:30.116525+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:46:24.149647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116421+0000","last_change":"2023-07-14T13:11:28.943918+0000","last_active":"2023-07-14T13:11:30.116421+0000","last_peered":"2023-07-14T13:11:30.116421+0000","last_clean":"2023-07-14T13:11:30.116421+0000","last_became_active":"2023-07-14T13:11:28.943568+0000","last_became_peered":"2023-07-14T13:11:28.943568+0000","last_unstale":"2023-07-14T13:11:30.116421+0000","last_undegraded":"2023-07-14T13:11:30.116421+0000","last_fullsized":"2023-07-14T13:11:30.116421+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:52:34.146671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120680+0000","last_change":"2023-07-14T13:11:27.917285+0000","last_active":"2023-07-14T13:11:30.120680+0000","last_peered":"2023-07-14T13:11:30.120680+0000","last_clean":"2023-07-14T13:11:30.120680+0000","last_became_active":"2023-07-14T13:11:27.916997+0000","last_became_peered":"2023-07-14T13:11:27.916997+0000","last_unstale":"2023-07-14T13:11:30.120680+0000","last_undegraded":"2023-07-14T13:11:30.120680+0000","last_fullsized":"2023-07-14T13:11:30.120680+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:35:32.561915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120890+0000","last_change":"2023-07-14T13:11:28.938937+0000","last_active":"2023-07-14T13:11:30.120890+0000","last_peered":"2023-07-14T13:11:30.120890+0000","last_clean":"2023-07-14T13:11:30.120890+0000","last_became_active":"2023-07-14T13:11:28.938671+0000","last_became_peered":"2023-07-14T13:11:28.938671+0000","last_unstale":"2023-07-14T13:11:30.120890+0000","last_undegraded":"2023-07-14T13:11:30.120890+0000","last_fullsized":"2023-07-14T13:11:30.120890+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:02:53.319655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.938654+0000","last_change":"2023-07-14T13:11:27.911728+0000","last_active":"2023-07-14T13:11:29.938654+0000","last_peered":"2023-07-14T13:11:29.938654+0000","last_clean":"2023-07-14T13:11:29.938654+0000","last_became_active":"2023-07-14T13:11:27.911418+0000","last_became_peered":"2023-07-14T13:11:27.911418+0000","last_unstale":"2023-07-14T13:11:29.938654+0000","last_undegraded":"2023-07-14T13:11:29.938654+0000","last_fullsized":"2023-07-14T13:11:29.938654+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:40:07.962210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117550+0000","last_change":"2023-07-14T13:11:28.931175+0000","last_active":"2023-07-14T13:11:30.117550+0000","last_peered":"2023-07-14T13:11:30.117550+0000","last_clean":"2023-07-14T13:11:30.117550+0000","last_became_active":"2023-07-14T13:11:28.930839+0000","last_became_peered":"2023-07-14T13:11:28.930839+0000","last_unstale":"2023-07-14T13:11:30.117550+0000","last_undegraded":"2023-07-14T13:11:30.117550+0000","last_fullsized":"2023-07-14T13:11:30.117550+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:47:08.860374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.943399+0000","last_change":"2023-07-14T13:11:27.911575+0000","last_active":"2023-07-14T13:11:29.943399+0000","last_peered":"2023-07-14T13:11:29.943399+0000","last_clean":"2023-07-14T13:11:29.943399+0000","last_became_active":"2023-07-14T13:11:27.911267+0000","last_became_peered":"2023-07-14T13:11:27.911267+0000","last_unstale":"2023-07-14T13:11:29.943399+0000","last_undegraded":"2023-07-14T13:11:29.943399+0000","last_fullsized":"2023-07-14T13:11:29.943399+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:00:39.677797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117690+0000","last_change":"2023-07-14T13:11:28.931587+0000","last_active":"2023-07-14T13:11:30.117690+0000","last_peered":"2023-07-14T13:11:30.117690+0000","last_clean":"2023-07-14T13:11:30.117690+0000","last_became_active":"2023-07-14T13:11:28.931307+0000","last_became_peered":"2023-07-14T13:11:28.931307+0000","last_unstale":"2023-07-14T13:11:30.117690+0000","last_undegraded":"2023-07-14T13:11:30.117690+0000","last_fullsized":"2023-07-14T13:11:30.117690+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:29:42.483886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117543+0000","last_change":"2023-07-14T13:11:27.902540+0000","last_active":"2023-07-14T13:11:30.117543+0000","last_peered":"2023-07-14T13:11:30.117543+0000","last_clean":"2023-07-14T13:11:30.117543+0000","last_became_active":"2023-07-14T13:11:27.902204+0000","last_became_peered":"2023-07-14T13:11:27.902204+0000","last_unstale":"2023-07-14T13:11:30.117543+0000","last_undegraded":"2023-07-14T13:11:30.117543+0000","last_fullsized":"2023-07-14T13:11:30.117543+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:35:21.206525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120289+0000","last_change":"2023-07-14T13:11:28.941797+0000","last_active":"2023-07-14T13:11:30.120289+0000","last_peered":"2023-07-14T13:11:30.120289+0000","last_clean":"2023-07-14T13:11:30.120289+0000","last_became_active":"2023-07-14T13:11:28.939690+0000","last_became_peered":"2023-07-14T13:11:28.939690+0000","last_unstale":"2023-07-14T13:11:30.120289+0000","last_undegraded":"2023-07-14T13:11:30.120289+0000","last_fullsized":"2023-07-14T13:11:30.120289+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:13.206762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120657+0000","last_change":"2023-07-14T13:11:27.913333+0000","last_active":"2023-07-14T13:11:30.120657+0000","last_peered":"2023-07-14T13:11:30.120657+0000","last_clean":"2023-07-14T13:11:30.120657+0000","last_became_active":"2023-07-14T13:11:27.912829+0000","last_became_peered":"2023-07-14T13:11:27.912829+0000","last_unstale":"2023-07-14T13:11:30.120657+0000","last_undegraded":"2023-07-14T13:11:30.120657+0000","last_fullsized":"2023-07-14T13:11:30.120657+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:44:46.390813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.121218+0000","last_change":"2023-07-14T13:11:28.940851+0000","last_active":"2023-07-14T13:11:30.121218+0000","last_peered":"2023-07-14T13:11:30.121218+0000","last_clean":"2023-07-14T13:11:30.121218+0000","last_became_active":"2023-07-14T13:11:28.940348+0000","last_became_peered":"2023-07-14T13:11:28.940348+0000","last_unstale":"2023-07-14T13:11:30.121218+0000","last_undegraded":"2023-07-14T13:11:30.121218+0000","last_fullsized":"2023-07-14T13:11:30.121218+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:12:41.071859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117047+0000","last_change":"2023-07-14T13:11:27.899057+0000","last_active":"2023-07-14T13:11:30.117047+0000","last_peered":"2023-07-14T13:11:30.117047+0000","last_clean":"2023-07-14T13:11:30.117047+0000","last_became_active":"2023-07-14T13:11:27.898776+0000","last_became_peered":"2023-07-14T13:11:27.898776+0000","last_unstale":"2023-07-14T13:11:30.117047+0000","last_undegraded":"2023-07-14T13:11:30.117047+0000","last_fullsized":"2023-07-14T13:11:30.117047+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:56:27.186214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.121121+0000","last_change":"2023-07-14T13:11:28.943789+0000","last_active":"2023-07-14T13:11:30.121121+0000","last_peered":"2023-07-14T13:11:30.121121+0000","last_clean":"2023-07-14T13:11:30.121121+0000","last_became_active":"2023-07-14T13:11:28.941236+0000","last_became_peered":"2023-07-14T13:11:28.941236+0000","last_unstale":"2023-07-14T13:11:30.121121+0000","last_undegraded":"2023-07-14T13:11:30.121121+0000","last_fullsized":"2023-07-14T13:11:30.121121+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:45:18.172334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"126'2","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117707+0000","last_change":"2023-07-14T13:11:27.908040+0000","last_active":"2023-07-14T13:11:30.117707+0000","last_peered":"2023-07-14T13:11:30.117707+0000","last_clean":"2023-07-14T13:11:30.117707+0000","last_became_active":"2023-07-14T13:11:27.907724+0000","last_became_peered":"2023-07-14T13:11:27.907724+0000","last_unstale":"2023-07-14T13:11:30.117707+0000","last_undegraded":"2023-07-14T13:11:30.117707+0000","last_fullsized":"2023-07-14T13:11:30.117707+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:01:00.985725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"115'227","reported_seq":752,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120058+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:11:30.120058+0000","last_peered":"2023-07-14T13:11:30.120058+0000","last_clean":"2023-07-14T13:11:30.120058+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:11:30.120058+0000","last_undegraded":"2023-07-14T13:11:30.120058+0000","last_fullsized":"2023-07-14T13:11:30.120058+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:09:51.989754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":204,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.121204+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:11:30.121204+0000","last_peered":"2023-07-14T13:11:30.121204+0000","last_clean":"2023-07-14T13:11:30.121204+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:11:30.121204+0000","last_undegraded":"2023-07-14T13:11:30.121204+0000","last_fullsized":"2023-07-14T13:11:30.121204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:54:46.655941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120466+0000","last_change":"2023-07-14T13:11:28.931213+0000","last_active":"2023-07-14T13:11:30.120466+0000","last_peered":"2023-07-14T13:11:30.120466+0000","last_clean":"2023-07-14T13:11:30.120466+0000","last_became_active":"2023-07-14T13:11:28.930001+0000","last_became_peered":"2023-07-14T13:11:28.930001+0000","last_unstale":"2023-07-14T13:11:30.120466+0000","last_undegraded":"2023-07-14T13:11:30.120466+0000","last_fullsized":"2023-07-14T13:11:30.120466+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:01:43.531111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"126'1","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120201+0000","last_change":"2023-07-14T13:11:27.908313+0000","last_active":"2023-07-14T13:11:30.120201+0000","last_peered":"2023-07-14T13:11:30.120201+0000","last_clean":"2023-07-14T13:11:30.120201+0000","last_became_active":"2023-07-14T13:11:27.907979+0000","last_became_peered":"2023-07-14T13:11:27.907979+0000","last_unstale":"2023-07-14T13:11:30.120201+0000","last_undegraded":"2023-07-14T13:11:30.120201+0000","last_fullsized":"2023-07-14T13:11:30.120201+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:58:38.165136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":206,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.119921+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:11:30.119921+0000","last_peered":"2023-07-14T13:11:30.119921+0000","last_clean":"2023-07-14T13:11:30.119921+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:11:30.119921+0000","last_undegraded":"2023-07-14T13:11:30.119921+0000","last_fullsized":"2023-07-14T13:11:30.119921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:43:38.557144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.938481+0000","last_change":"2023-07-14T13:11:28.930957+0000","last_active":"2023-07-14T13:11:29.938481+0000","last_peered":"2023-07-14T13:11:29.938481+0000","last_clean":"2023-07-14T13:11:29.938481+0000","last_became_active":"2023-07-14T13:11:28.929641+0000","last_became_peered":"2023-07-14T13:11:28.929641+0000","last_unstale":"2023-07-14T13:11:29.938481+0000","last_undegraded":"2023-07-14T13:11:29.938481+0000","last_fullsized":"2023-07-14T13:11:29.938481+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:32:19.211196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120497+0000","last_change":"2023-07-14T13:11:27.914507+0000","last_active":"2023-07-14T13:11:30.120497+0000","last_peered":"2023-07-14T13:11:30.120497+0000","last_clean":"2023-07-14T13:11:30.120497+0000","last_became_active":"2023-07-14T13:11:27.914211+0000","last_became_peered":"2023-07-14T13:11:27.914211+0000","last_unstale":"2023-07-14T13:11:30.120497+0000","last_undegraded":"2023-07-14T13:11:30.120497+0000","last_fullsized":"2023-07-14T13:11:30.120497+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:59:08.038793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":204,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117025+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:11:30.117025+0000","last_peered":"2023-07-14T13:11:30.117025+0000","last_clean":"2023-07-14T13:11:30.117025+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:11:30.117025+0000","last_undegraded":"2023-07-14T13:11:30.117025+0000","last_fullsized":"2023-07-14T13:11:30.117025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:45:12.396037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116802+0000","last_change":"2023-07-14T13:11:28.929982+0000","last_active":"2023-07-14T13:11:30.116802+0000","last_peered":"2023-07-14T13:11:30.116802+0000","last_clean":"2023-07-14T13:11:30.116802+0000","last_became_active":"2023-07-14T13:11:28.929451+0000","last_became_peered":"2023-07-14T13:11:28.929451+0000","last_unstale":"2023-07-14T13:11:30.116802+0000","last_undegraded":"2023-07-14T13:11:30.116802+0000","last_fullsized":"2023-07-14T13:11:30.116802+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:06:28.887654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"126'1","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.121465+0000","last_change":"2023-07-14T13:11:27.914767+0000","last_active":"2023-07-14T13:11:30.121465+0000","last_peered":"2023-07-14T13:11:30.121465+0000","last_clean":"2023-07-14T13:11:30.121465+0000","last_became_active":"2023-07-14T13:11:27.914404+0000","last_became_peered":"2023-07-14T13:11:27.914404+0000","last_unstale":"2023-07-14T13:11:30.121465+0000","last_undegraded":"2023-07-14T13:11:30.121465+0000","last_fullsized":"2023-07-14T13:11:30.121465+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:59:59.953370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":204,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120635+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:11:30.120635+0000","last_peered":"2023-07-14T13:11:30.120635+0000","last_clean":"2023-07-14T13:11:30.120635+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:11:30.120635+0000","last_undegraded":"2023-07-14T13:11:30.120635+0000","last_fullsized":"2023-07-14T13:11:30.120635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:57:30.412352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116416+0000","last_change":"2023-07-14T13:11:28.942188+0000","last_active":"2023-07-14T13:11:30.116416+0000","last_peered":"2023-07-14T13:11:30.116416+0000","last_clean":"2023-07-14T13:11:30.116416+0000","last_became_active":"2023-07-14T13:11:28.941882+0000","last_became_peered":"2023-07-14T13:11:28.941882+0000","last_unstale":"2023-07-14T13:11:30.116416+0000","last_undegraded":"2023-07-14T13:11:30.116416+0000","last_fullsized":"2023-07-14T13:11:30.116416+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:00:40.685050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120531+0000","last_change":"2023-07-14T13:11:27.913529+0000","last_active":"2023-07-14T13:11:30.120531+0000","last_peered":"2023-07-14T13:11:30.120531+0000","last_clean":"2023-07-14T13:11:30.120531+0000","last_became_active":"2023-07-14T13:11:27.913229+0000","last_became_peered":"2023-07-14T13:11:27.913229+0000","last_unstale":"2023-07-14T13:11:30.120531+0000","last_undegraded":"2023-07-14T13:11:30.120531+0000","last_fullsized":"2023-07-14T13:11:30.120531+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:40:59.094780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":215,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.938841+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:11:29.938841+0000","last_peered":"2023-07-14T13:11:29.938841+0000","last_clean":"2023-07-14T13:11:29.938841+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:11:29.938841+0000","last_undegraded":"2023-07-14T13:11:29.938841+0000","last_fullsized":"2023-07-14T13:11:29.938841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:28:26.621273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116546+0000","last_change":"2023-07-14T13:11:28.924646+0000","last_active":"2023-07-14T13:11:30.116546+0000","last_peered":"2023-07-14T13:11:30.116546+0000","last_clean":"2023-07-14T13:11:30.116546+0000","last_became_active":"2023-07-14T13:11:28.924307+0000","last_became_peered":"2023-07-14T13:11:28.924307+0000","last_unstale":"2023-07-14T13:11:30.116546+0000","last_undegraded":"2023-07-14T13:11:30.116546+0000","last_fullsized":"2023-07-14T13:11:30.116546+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:43:15.873047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116925+0000","last_change":"2023-07-14T13:11:27.904242+0000","last_active":"2023-07-14T13:11:30.116925+0000","last_peered":"2023-07-14T13:11:30.116925+0000","last_clean":"2023-07-14T13:11:30.116925+0000","last_became_active":"2023-07-14T13:11:27.903918+0000","last_became_peered":"2023-07-14T13:11:27.903918+0000","last_unstale":"2023-07-14T13:11:30.116925+0000","last_undegraded":"2023-07-14T13:11:30.116925+0000","last_fullsized":"2023-07-14T13:11:30.116925+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:54:37.228739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.120333+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:11:30.120333+0000","last_peered":"2023-07-14T13:11:30.120333+0000","last_clean":"2023-07-14T13:11:30.120333+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:11:30.120333+0000","last_undegraded":"2023-07-14T13:11:30.120333+0000","last_fullsized":"2023-07-14T13:11:30.120333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:16:22.857387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117337+0000","last_change":"2023-07-14T13:11:28.940158+0000","last_active":"2023-07-14T13:11:30.117337+0000","last_peered":"2023-07-14T13:11:30.117337+0000","last_clean":"2023-07-14T13:11:30.117337+0000","last_became_active":"2023-07-14T13:11:28.939719+0000","last_became_peered":"2023-07-14T13:11:28.939719+0000","last_unstale":"2023-07-14T13:11:30.117337+0000","last_undegraded":"2023-07-14T13:11:30.117337+0000","last_fullsized":"2023-07-14T13:11:30.117337+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:25:56.439424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"126'2","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.116914+0000","last_change":"2023-07-14T13:11:27.905304+0000","last_active":"2023-07-14T13:11:30.116914+0000","last_peered":"2023-07-14T13:11:30.116914+0000","last_clean":"2023-07-14T13:11:30.116914+0000","last_became_active":"2023-07-14T13:11:27.904926+0000","last_became_peered":"2023-07-14T13:11:27.904926+0000","last_unstale":"2023-07-14T13:11:30.116914+0000","last_undegraded":"2023-07-14T13:11:30.116914+0000","last_fullsized":"2023-07-14T13:11:30.116914+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:57:44.893056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":215,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:29.938768+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:11:29.938768+0000","last_peered":"2023-07-14T13:11:29.938768+0000","last_clean":"2023-07-14T13:11:29.938768+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:11:29.938768+0000","last_undegraded":"2023-07-14T13:11:29.938768+0000","last_fullsized":"2023-07-14T13:11:29.938768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:29:58.259633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":11,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117452+0000","last_change":"2023-07-14T13:11:28.929859+0000","last_active":"2023-07-14T13:11:30.117452+0000","last_peered":"2023-07-14T13:11:30.117452+0000","last_clean":"2023-07-14T13:11:30.117452+0000","last_became_active":"2023-07-14T13:11:28.929550+0000","last_became_peered":"2023-07-14T13:11:28.929550+0000","last_unstale":"2023-07-14T13:11:30.117452+0000","last_undegraded":"2023-07-14T13:11:30.117452+0000","last_fullsized":"2023-07-14T13:11:30.117452+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:27.879637+0000","last_clean_scrub_stamp":"2023-07-14T13:11:27.879637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:37:25.923437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.117676+0000","last_change":"2023-07-14T13:11:27.909085+0000","last_active":"2023-07-14T13:11:30.117676+0000","last_peered":"2023-07-14T13:11:30.117676+0000","last_clean":"2023-07-14T13:11:30.117676+0000","last_became_active":"2023-07-14T13:11:27.908811+0000","last_became_peered":"2023-07-14T13:11:27.908811+0000","last_unstale":"2023-07-14T13:11:30.117676+0000","last_undegraded":"2023-07-14T13:11:30.117676+0000","last_fullsized":"2023-07-14T13:11:30.117676+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:11:26.872384+0000","last_clean_scrub_stamp":"2023-07-14T13:11:26.872384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:37:27.900884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":207,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-14T13:11:30.121542+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:11:30.121542+0000","last_peered":"2023-07-14T13:11:30.121542+0000","last_clean":"2023-07-14T13:11:30.121542+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:11:30.121542+0000","last_undegraded":"2023-07-14T13:11:30.121542+0000","last_fullsized":"2023-07-14T13:11:30.121542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:31:29.565002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575074,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59408,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312432,"statfs":{"total":96636764160,"available":96575930368,"internally_reserved":0,"allocated":2170880,"data_stored":1385875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.70799999999999996,"15min":0.70999999999999996},"min":{"1min":0.53300000000000003,"5min":0.372,"15min":0.33900000000000002},"max":{"1min":0.95899999999999996,"5min":1.262,"15min":1.262},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71999999999999997,"15min":0.72899999999999998},"min":{"1min":0.51500000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93999999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.746}]},{"osd":1,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72399999999999998,"15min":0.73599999999999999},"min":{"1min":0.48199999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.872,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.72899999999999998,"15min":0.74399999999999999},"min":{"1min":0.59799999999999998,"5min":0.436,"15min":0.40500000000000003},"max":{"1min":0.97599999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.70299999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.58299999999999996,"5min":0.46100000000000002,"15min":0.42699999999999999},"max":{"1min":0.96099999999999997,"5min":1.073,"15min":1.073},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.73899999999999999,"15min":0.753},"min":{"1min":0.57999999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89600000000000002,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.80600000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.58899999999999997,"5min":0.503,"15min":0.46400000000000002},"max":{"1min":0.90900000000000003,"5min":1.161,"15min":1.161},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.73999999999999999,"15min":0.75600000000000001},"min":{"1min":0.60299999999999998,"5min":0.47899999999999998,"15min":0.41499999999999998},"max":{"1min":0.91800000000000004,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.72299999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55800000000000005,"15min":0.57799999999999996},"min":{"1min":0.44500000000000001,"5min":0.39100000000000001,"15min":0.318},"max":{"1min":0.874,"5min":0.874,"15min":1.022},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.47399999999999998,"5min":0.40600000000000003,"15min":0.39300000000000002},"max":{"1min":0.76500000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.52900000000000003}]},{"osd":5,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.52100000000000002,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.82199999999999995,"5min":0.98099999999999998,"15min":0.98299999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.64700000000000002},"min":{"1min":0.44,"5min":0.377,"15min":0.34100000000000003},"max":{"1min":0.80700000000000005,"5min":1.028,"15min":1.028},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67600000000000005,"15min":0.69099999999999995},"min":{"1min":0.48499999999999999,"5min":0.45200000000000001,"15min":0.42699999999999999},"max":{"1min":0.85799999999999998,"5min":0.99299999999999999,"15min":1.0489999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.68000000000000005,"15min":0.67500000000000004},"min":{"1min":0.47499999999999998,"5min":0.46200000000000002,"15min":0.36299999999999999},"max":{"1min":4.1130000000000004,"5min":4.1130000000000004,"15min":4.1130000000000004},"last":0.58499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575075,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32600,"kb_used_data":1552,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339240,"statfs":{"total":96636764160,"available":96603381760,"internally_reserved":0,"allocated":1589248,"data_stored":797515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71599999999999997,"15min":0.73099999999999998},"min":{"1min":0.50800000000000001,"5min":0.39500000000000002,"15min":0.38},"max":{"1min":0.90100000000000002,"5min":0.95899999999999996,"15min":0.996},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.70199999999999996,"15min":0.72699999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89500000000000002,"5min":0.98199999999999998,"15min":1.0800000000000001},"last":0.76500000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70899999999999996,"15min":0.73699999999999999},"min":{"1min":0.497,"5min":0.42299999999999999,"15min":0.379},"max":{"1min":0.84399999999999997,"5min":0.97199999999999998,"15min":1.0209999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.70199999999999996,"15min":0.72099999999999997},"min":{"1min":0.60599999999999998,"5min":0.47499999999999998,"15min":0.46999999999999997},"max":{"1min":0.88100000000000001,"5min":0.91400000000000003,"15min":1.077},"last":0.73499999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72699999999999998,"15min":0.749},"min":{"1min":0.56100000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.874,"5min":0.95099999999999996,"15min":1.105},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.48499999999999999,"5min":0.441,"15min":0.441},"max":{"1min":0.97999999999999998,"5min":0.99099999999999999,"15min":1.0900000000000001},"last":0.83499999999999996}]},{"osd":3,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.75,"15min":0.77200000000000002},"min":{"1min":0.61499999999999999,"5min":0.46000000000000002,"15min":0.434},"max":{"1min":0.92200000000000004,"5min":1.054,"15min":1.1359999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.71899999999999997,"15min":0.754},"min":{"1min":0.56999999999999995,"5min":0.50900000000000001,"15min":0.48399999999999999},"max":{"1min":0.871,"5min":0.94799999999999995,"15min":1.1080000000000001},"last":0.81299999999999994}]},{"osd":4,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57399999999999995,"15min":0.57499999999999996},"min":{"1min":0.45900000000000002,"5min":0.39900000000000002,"15min":0.317},"max":{"1min":0.76300000000000001,"5min":0.89900000000000002,"15min":0.97899999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.48299999999999998,"5min":0.439,"15min":0.38500000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":1.0780000000000001},"last":0.57799999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.497,"5min":0.45200000000000001,"15min":0.37},"max":{"1min":0.78100000000000003,"5min":0.96599999999999997,"15min":1.579},"last":0.622},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.50800000000000001,"5min":0.46300000000000002,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.65000000000000002}]},{"osd":7,"last update":"Fri Jul 14 13:11:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67400000000000004,"15min":0.65900000000000003},"min":{"1min":0.47899999999999998,"5min":0.437,"15min":0.34599999999999997},"max":{"1min":0.93899999999999995,"5min":1.0940000000000001,"15min":1.1200000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71299999999999997,"15min":0.71199999999999997},"min":{"1min":0.59699999999999998,"5min":0.48899999999999999,"15min":0.36199999999999999},"max":{"1min":0.92000000000000004,"5min":1.0209999999999999,"15min":1.657},"last":0.70699999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575074,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46532,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":44992,"kb_avail":94325308,"statfs":{"total":96636764160,"available":96589115392,"internally_reserved":0,"allocated":1568768,"data_stored":795347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46071808},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.69399999999999995,"15min":0.72499999999999998},"min":{"1min":0.44400000000000001,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":0.88800000000000001,"5min":0.91500000000000004,"15min":2.6699999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.71299999999999997,"15min":0.72799999999999998},"min":{"1min":0.56799999999999995,"5min":0.41699999999999998,"15min":0.32800000000000001},"max":{"1min":0.98299999999999998,"5min":1.083,"15min":1.083},"last":0.69699999999999995}]},{"osd":1,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.69399999999999995,"15min":0.72099999999999997},"min":{"1min":0.49399999999999999,"5min":0.45900000000000002,"15min":0.41099999999999998},"max":{"1min":0.95799999999999996,"5min":1.05,"15min":1.079},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72099999999999997,"15min":0.74299999999999999},"min":{"1min":0.55000000000000004,"5min":0.48999999999999999,"15min":0.36799999999999999},"max":{"1min":0.92500000000000004,"5min":0.95899999999999996,"15min":2.706},"last":0.74299999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.71499999999999997,"15min":0.73299999999999998},"min":{"1min":0.58699999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.93999999999999995,"5min":1.212,"15min":1.212},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.70999999999999996,"15min":0.73099999999999998},"min":{"1min":0.60999999999999999,"5min":0.44800000000000001,"15min":0.433},"max":{"1min":0.90900000000000003,"5min":1.181,"15min":1.181},"last":0.78900000000000003}]},{"osd":3,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.72499999999999998,"15min":0.74399999999999999},"min":{"1min":0.64300000000000002,"5min":0.41799999999999998,"15min":0.377},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":2.7389999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.72799999999999998,"15min":0.75800000000000001},"min":{"1min":0.61799999999999999,"5min":0.47299999999999998,"15min":0.39700000000000002},"max":{"1min":0.89500000000000002,"5min":1.304,"15min":1.304},"last":0.752}]},{"osd":4,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63800000000000001,"15min":0.627},"min":{"1min":0.49399999999999999,"5min":0.38,"15min":0.28599999999999998},"max":{"1min":0.871,"5min":1.129,"15min":1.129},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66600000000000004,"15min":0.68000000000000005},"min":{"1min":0.499,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85899999999999999,"5min":0.86799999999999999,"15min":2.7719999999999998},"last":0.77400000000000002}]},{"osd":6,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59399999999999997,"15min":0.60599999999999998},"min":{"1min":0.46500000000000002,"5min":0.34599999999999997,"15min":0.32700000000000001},"max":{"1min":0.68300000000000005,"5min":1.169,"15min":1.169},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.47999999999999998,"5min":0.39400000000000002,"15min":0.34300000000000003},"max":{"1min":0.83999999999999997,"5min":1.238,"15min":1.238},"last":0.71699999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.45400000000000001,"5min":0.36899999999999999,"15min":0.32900000000000001},"max":{"1min":0.92200000000000004,"5min":1.026,"15min":3.0230000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67200000000000004,"15min":0.67500000000000004},"min":{"1min":0.46500000000000002,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.85099999999999998,"5min":1.2589999999999999,"15min":1.407},"last":0.85799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575074,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32588,"kb_used_data":1540,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1576960,"data_stored":795439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.70199999999999996,"15min":0.72799999999999998},"min":{"1min":0.53800000000000003,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":1.411},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72799999999999998,"15min":0.73099999999999998},"min":{"1min":0.46999999999999997,"5min":0.45100000000000001,"15min":0.435},"max":{"1min":0.88,"5min":1.0089999999999999,"15min":1.1200000000000001},"last":0.64900000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72799999999999998,"15min":0.746},"min":{"1min":0.53100000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89300000000000002,"5min":0.94699999999999995,"15min":1.077},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71499999999999997,"15min":0.73299999999999998},"min":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89800000000000002,"5min":0.96399999999999997,"15min":1.0469999999999999},"last":0.68700000000000006}]},{"osd":2,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71499999999999997,"15min":0.73099999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.35199999999999998},"max":{"1min":0.872,"5min":0.96499999999999997,"15min":1.091},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.77000000000000002},"min":{"1min":0.63200000000000001,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.86299999999999999,"5min":1.04,"15min":1.387},"last":0.74199999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72699999999999998,"15min":0.74399999999999999},"min":{"1min":0.53200000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89400000000000002,"5min":0.997,"15min":1.008},"last":0.874},{"interface":"front","average":{"1min":0.752,"5min":0.748,"15min":0.76800000000000002},"min":{"1min":0.51400000000000001,"5min":0.47499999999999998,"15min":0.46800000000000003},"max":{"1min":1.002,"5min":1.002,"15min":1.0589999999999999},"last":0.77300000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.378},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":1.0029999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.64500000000000002,"15min":0.622},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.34599999999999997},"max":{"1min":0.79600000000000004,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.81899999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.34899999999999998,"15min":0.32300000000000001},"max":{"1min":0.876,"5min":0.96999999999999997,"15min":1.014},"last":0.751},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.374},"max":{"1min":0.85199999999999998,"5min":0.98299999999999998,"15min":1.0289999999999999},"last":0.79200000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70799999999999996,"15min":0.67300000000000004},"min":{"1min":0.55300000000000005,"5min":0.502,"15min":0.39000000000000001},"max":{"1min":0.84899999999999998,"5min":1.0049999999999999,"15min":1.0349999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.50700000000000001,"5min":0.42799999999999999,"15min":0.36899999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0629999999999999},"last":0.85999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575074,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36680,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335160,"statfs":{"total":96636764160,"available":96599203840,"internally_reserved":0,"allocated":1572864,"data_stored":795929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45300000000000001,"15min":0.44900000000000001},"min":{"1min":0.34799999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.59999999999999998,"5min":0.78600000000000003,"15min":0.84199999999999997},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.51100000000000001,"15min":0.51400000000000001},"min":{"1min":0.33200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.53100000000000003}]},{"osd":1,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.378,"5min":0.32000000000000001,"15min":0.315},"max":{"1min":0.67800000000000005,"5min":0.873,"15min":0.873},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.53700000000000003,"15min":0.54100000000000004},"min":{"1min":0.41699999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.753,"5min":0.753,"15min":1.0029999999999999},"last":0.38900000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56100000000000005,"15min":0.57199999999999995},"min":{"1min":0.44400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.90400000000000003},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.47599999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.88100000000000001,"5min":1.02,"15min":1.663},"last":0.48999999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.75900000000000001,"15min":0.75700000000000001},"min":{"1min":0.56200000000000006,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":0.96899999999999997,"5min":1.151,"15min":1.284},"last":0.627},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.78100000000000003,"15min":0.78200000000000003},"min":{"1min":0.60499999999999998,"5min":0.51900000000000002,"15min":0.47699999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.58299999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.79300000000000004,"15min":0.79200000000000004},"min":{"1min":0.60399999999999998,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.306},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78100000000000003,"15min":0.78400000000000003},"min":{"1min":0.60899999999999999,"5min":0.55000000000000004,"15min":0.372},"max":{"1min":1.018,"5min":1.1870000000000001,"15min":1.2470000000000001},"last":0.60999999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77300000000000002,"15min":0.77200000000000002},"min":{"1min":0.52400000000000002,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.117},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.80600000000000005,"15min":0.81399999999999995},"min":{"1min":0.63700000000000001,"5min":0.56299999999999994,"15min":0.54200000000000004},"max":{"1min":1.1000000000000001,"5min":1.129,"15min":1.2589999999999999},"last":0.63900000000000001}]},{"osd":7,"last update":"Fri Jul 14 13:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81100000000000005,"15min":0.83199999999999996},"min":{"1min":0.66100000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.095,"5min":1.1519999999999999,"15min":2.4910000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.81200000000000006,"15min":0.82299999999999995},"min":{"1min":0.65100000000000002,"5min":0.53500000000000003,"15min":0.51600000000000001},"max":{"1min":1.1359999999999999,"5min":1.1379999999999999,"15min":1.595},"last":0.65000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575074,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58820,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313020,"statfs":{"total":96636764160,"available":96576532480,"internally_reserved":0,"allocated":1568768,"data_stored":794362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.35499999999999998,"5min":0.29199999999999998,"15min":0.24199999999999999},"max":{"1min":0.75700000000000001,"5min":0.84699999999999998,"15min":1.3169999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51400000000000001,"15min":0.53500000000000003},"min":{"1min":0.372,"5min":0.318,"15min":0.318},"max":{"1min":0.69899999999999995,"5min":0.80800000000000005,"15min":2.5270000000000001},"last":0.57899999999999996}]},{"osd":1,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46700000000000003,"15min":0.47299999999999998},"min":{"1min":0.34200000000000003,"5min":0.30399999999999999,"15min":0.29999999999999999},"max":{"1min":0.72599999999999998,"5min":0.77200000000000002,"15min":2.7200000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.52800000000000002,"15min":0.56200000000000006},"min":{"1min":0.46400000000000002,"5min":0.36299999999999999,"15min":0.35999999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":2.6110000000000002},"last":0.49199999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55700000000000005,"15min":0.60399999999999998},"min":{"1min":0.5,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70699999999999996,"5min":0.81899999999999995,"15min":8.2530000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53800000000000003,"15min":0.55200000000000005},"min":{"1min":0.44400000000000001,"5min":0.36899999999999999,"15min":0.33300000000000002},"max":{"1min":0.65700000000000003,"5min":0.89600000000000002,"15min":1.2150000000000001},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.753,"15min":0.77800000000000002},"min":{"1min":0.57299999999999995,"5min":0.53200000000000003,"15min":0.48399999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.1499999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.747,"15min":0.79100000000000004},"min":{"1min":0.60399999999999998,"5min":0.52900000000000003,"15min":0.47999999999999998},"max":{"1min":1.03,"5min":1.0629999999999999,"15min":2.3170000000000002},"last":0.77200000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.81000000000000005,"15min":0.85499999999999998},"min":{"1min":0.65500000000000003,"5min":0.56399999999999995,"15min":0.49399999999999999},"max":{"1min":1.087,"5min":1.1319999999999999,"15min":3.1139999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.79800000000000004,"15min":0.84099999999999997},"min":{"1min":0.61799999999999999,"5min":0.56200000000000006,"15min":0.433},"max":{"1min":1.0940000000000001,"5min":1.153,"15min":2.6850000000000001},"last":0.81899999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.751,"15min":0.79900000000000004},"min":{"1min":0.65200000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.038,"5min":1.038,"15min":3.9849999999999999},"last":0.872},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.76900000000000002,"15min":0.81100000000000005},"min":{"1min":0.627,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1100000000000001,"5min":1.1419999999999999,"15min":3.391},"last":0.73099999999999998}]},{"osd":7,"last update":"Fri Jul 14 13:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.77100000000000002,"15min":0.81799999999999995},"min":{"1min":0.56000000000000005,"5min":0.52300000000000002,"15min":0.5},"max":{"1min":1.0549999999999999,"5min":1.1759999999999999,"15min":2.5779999999999998},"last":0.746},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.78900000000000003,"15min":0.82199999999999995},"min":{"1min":0.57499999999999996,"5min":0.52800000000000002,"15min":0.50900000000000001},"max":{"1min":1.0529999999999999,"5min":1.0940000000000001,"15min":2.5939999999999999},"last":0.84899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575075,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36680,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335160,"statfs":{"total":96636764160,"available":96599203840,"internally_reserved":0,"allocated":1572864,"data_stored":795381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.435,"15min":0.433},"min":{"1min":0.29199999999999998,"5min":0.28399999999999997,"15min":0.26100000000000001},"max":{"1min":0.63900000000000001,"5min":0.65400000000000003,"15min":0.77200000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.51400000000000001,"15min":0.50700000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.88900000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.44900000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46300000000000002,"15min":0.47199999999999998},"min":{"1min":0.371,"5min":0.317,"15min":0.317},"max":{"1min":0.67300000000000004,"5min":0.69199999999999995,"15min":1.0409999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.39400000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":1.014},"last":0.57799999999999996}]},{"osd":3,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60899999999999999,"15min":0.63200000000000001},"min":{"1min":0.45000000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.76300000000000001,"5min":0.80300000000000005,"15min":0.96299999999999997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.57399999999999995},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79200000000000004,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.63600000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76900000000000002,"15min":0.78700000000000003},"min":{"1min":0.56799999999999995,"5min":0.51200000000000001,"15min":0.48899999999999999},"max":{"1min":0.98199999999999998,"5min":1.2110000000000001,"15min":1.236},"last":0.878},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.63,"5min":0.54700000000000004,"15min":0.502},"max":{"1min":1,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.89500000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.45200000000000001},"max":{"1min":1.097,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.63700000000000001,"5min":0.51500000000000001,"15min":0.48599999999999999},"max":{"1min":0.99099999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.046}]},{"osd":6,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.56599999999999995,"5min":0.53800000000000003,"15min":0.503},"max":{"1min":1.071,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.81399999999999995,"15min":0.81699999999999995},"min":{"1min":0.56399999999999995,"5min":0.497,"15min":0.497},"max":{"1min":1.0880000000000001,"5min":1.262,"15min":1.262},"last":0.93899999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.80000000000000004,"15min":0.80200000000000005},"min":{"1min":0.61599999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.048,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.878,"5min":0.83299999999999996,"15min":0.84499999999999997},"min":{"1min":0.68899999999999995,"5min":0.58499999999999996,"15min":0.52800000000000002},"max":{"1min":1.1160000000000001,"5min":1.327,"15min":1.327},"last":0.79900000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575076,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37268,"kb_used_data":2124,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334572,"statfs":{"total":96636764160,"available":96598601728,"internally_reserved":0,"allocated":2174976,"data_stored":1386350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.33300000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":2.2450000000000001},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.48799999999999999,"15min":0.51100000000000001},"min":{"1min":0.35699999999999998,"5min":0.30099999999999999,"15min":0.27700000000000002},"max":{"1min":0.74199999999999999,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.45000000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.495,"15min":0.51200000000000001},"min":{"1min":0.35999999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.60799999999999998,"5min":0.84499999999999997,"15min":2.2989999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53200000000000003,"15min":0.55000000000000004},"min":{"1min":0.40400000000000003,"5min":0.34899999999999998,"15min":0.29899999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.90300000000000002},"last":0.64700000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.498,"15min":0.505},"min":{"1min":0.44400000000000001,"5min":0.32700000000000001,"15min":0.30299999999999999},"max":{"1min":0.58299999999999996,"5min":0.72999999999999998,"15min":0.84999999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56799999999999995,"15min":0.58799999999999997},"min":{"1min":0.47199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.71799999999999997,"5min":0.92700000000000005,"15min":2.4100000000000001},"last":0.42399999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.745,"15min":0.78100000000000003},"min":{"1min":0.54500000000000004,"5min":0.48399999999999999,"15min":0.44400000000000001},"max":{"1min":1.0309999999999999,"5min":1.21,"15min":1.3640000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.75600000000000001,"15min":0.79500000000000004},"min":{"1min":0.60199999999999998,"5min":0.52300000000000002,"15min":0.44900000000000001},"max":{"1min":0.90000000000000002,"5min":1.0589999999999999,"15min":2.4460000000000002},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.751,"15min":0.79600000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.47899999999999998},"max":{"1min":0.95899999999999996,"5min":1.0669999999999999,"15min":1.3839999999999999},"last":0.62},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.75900000000000001,"15min":0.79200000000000004},"min":{"1min":0.55800000000000005,"5min":0.5,"15min":0.47299999999999998},"max":{"1min":1.05,"5min":1.069,"15min":1.325},"last":0.66800000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76700000000000002,"15min":0.79800000000000004},"min":{"1min":0.63500000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.97499999999999998,"5min":1.05,"15min":2.3380000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.75800000000000001,"15min":0.80300000000000005},"min":{"1min":0.58599999999999997,"5min":0.51000000000000001,"15min":0.41299999999999998},"max":{"1min":1.012,"5min":1.0900000000000001,"15min":1.3440000000000001},"last":0.55600000000000005}]},{"osd":7,"last update":"Fri Jul 14 13:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.77700000000000002,"15min":0.82199999999999995},"min":{"1min":0.58499999999999996,"5min":0.52800000000000002,"15min":0.45500000000000002},"max":{"1min":0.95299999999999996,"5min":1.1180000000000001,"15min":1.2749999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.75700000000000001,"15min":0.80400000000000005},"min":{"1min":0.60599999999999998,"5min":0.502,"15min":0.497},"max":{"1min":1.0640000000000001,"5min":1.0880000000000001,"15min":1.381},"last":0.63300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:11:38.018 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-14T13:11:38.018 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-14T13:11:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.171+0000 7f654219d640 1 Processor -- start 2023-07-14T13:11:38.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.171+0000 7f654219d640 1 -- start start 2023-07-14T13:11:38.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.171+0000 7f654219d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f653c0cb360 0x7f653c15df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:38.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.171+0000 7f654219d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f653c0cc900 con 0x7f653c0b38d0 2023-07-14T13:11:38.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.171+0000 7f654219d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f653c0ccbe0 con 0x7f653c0cd490 2023-07-14T13:11:38.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.171+0000 7f654219d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f653c15d780 con 0x7f653c0cb360 2023-07-14T13:11:38.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.171+0000 7f653affd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f653c0b38d0 0x7f653c070920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46098/0 (socket says 172.21.15.5:46098) 2023-07-14T13:11:38.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.171+0000 7f653affd640 1 -- 172.21.15.5:0/496430392 learned_addr learned my addr 172.21.15.5:0/496430392 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.171+0000 7f653b7fe640 1 --2- 172.21.15.5:0/496430392 >> v2:172.21.15.154:3300/0 conn(0x7f653c0cb360 0x7f653c15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.171+0000 7f653a7fc640 1 -- 172.21.15.5:0/496430392 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2424294460 0 0) 0x7f653c0cc900 con 0x7f653c0b38d0 2023-07-14T13:11:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.171+0000 7f653a7fc640 1 -- 172.21.15.5:0/496430392 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6524003530 con 0x7f653c0b38d0 2023-07-14T13:11:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.171+0000 7f653a7fc640 1 -- 172.21.15.5:0/496430392 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1507095173 0 0) 0x7f6524003530 con 0x7f653c0b38d0 2023-07-14T13:11:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.171+0000 7f653a7fc640 1 -- 172.21.15.5:0/496430392 >> v2:172.21.15.154:3300/0 conn(0x7f653c0cb360 msgr2=0x7f653c15df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.171+0000 7f653a7fc640 1 --2- 172.21.15.5:0/496430392 >> v2:172.21.15.154:3300/0 conn(0x7f653c0cb360 0x7f653c15df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.171+0000 7f653a7fc640 1 -- 172.21.15.5:0/496430392 >> v1:172.21.15.154:6789/0 conn(0x7f653c0cd490 legacy=0x7f653c0c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.171+0000 7f653a7fc640 1 -- 172.21.15.5:0/496430392 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653c15da60 con 0x7f653c0b38d0 2023-07-14T13:11:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.171+0000 7f653a7fc640 1 -- 172.21.15.5:0/496430392 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f6530001680 con 0x7f653c0b38d0 2023-07-14T13:11:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.171+0000 7f653a7fc640 1 -- 172.21.15.5:0/496430392 >> v1:172.21.15.5:6789/0 conn(0x7f653c0b38d0 legacy=0x7f653c070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.171+0000 7f653a7fc640 1 --2- 172.21.15.5:0/496430392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6524003980 0x7f6524003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.171+0000 7f653a7fc640 1 --2- 172.21.15.5:0/496430392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65240047d0 0x7f6524004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.171+0000 7f653a7fc640 1 --2- 172.21.15.5:0/496430392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65240052a0 0x7f652400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.171+0000 7f653a7fc640 1 -- 172.21.15.5:0/496430392 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c15d780 con 0x7f65240047d0 2023-07-14T13:11:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.171+0000 7f653a7fc640 1 -- 172.21.15.5:0/496430392 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652400c1d0 con 0x7f6524003980 2023-07-14T13:11:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.171+0000 7f653a7fc640 1 -- 172.21.15.5:0/496430392 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652400c390 con 0x7f65240052a0 2023-07-14T13:11:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.171+0000 7f653affd640 1 --2- 172.21.15.5:0/496430392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65240047d0 0x7f6524004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.175+0000 7f653b7fe640 1 --2- 172.21.15.5:0/496430392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6524003980 0x7f6524003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.175+0000 7f653bfff640 1 --2- 172.21.15.5:0/496430392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65240052a0 0x7f652400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:38.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.175+0000 7f653affd640 1 -- 172.21.15.5:0/496430392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65240052a0 msgr2=0x7f652400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:38.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.175+0000 7f653affd640 1 --2- 172.21.15.5:0/496430392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65240052a0 0x7f652400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:38.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.175+0000 7f653affd640 1 -- 172.21.15.5:0/496430392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6524003980 msgr2=0x7f6524003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:38.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.175+0000 7f653affd640 1 --2- 172.21.15.5:0/496430392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6524003980 0x7f6524003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:38.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.175+0000 7f653affd640 1 -- 172.21.15.5:0/496430392 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6524003530 con 0x7f65240047d0 2023-07-14T13:11:38.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.175+0000 7f653bfff640 1 -- 172.21.15.5:0/496430392 reap_dead start 2023-07-14T13:11:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.175+0000 7f653affd640 1 --2- 172.21.15.5:0/496430392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65240047d0 0x7f6524004c40 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f653000c210 tx=0x7f653001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c5499809b01d16a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.175+0000 7f653a7fc640 1 -- 172.21.15.5:0/496430392 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65300058e0 con 0x7f65240047d0 2023-07-14T13:11:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.175+0000 7f653a7fc640 1 -- 172.21.15.5:0/496430392 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653c15e5a0 con 0x7f65240047d0 2023-07-14T13:11:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.175+0000 7f653a7fc640 1 -- 172.21.15.5:0/496430392 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6530005d00 con 0x7f65240047d0 2023-07-14T13:11:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.175+0000 7f654219d640 1 -- 172.21.15.5:0/496430392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65240047d0 msgr2=0x7f6524004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.175+0000 7f654219d640 1 --2- 172.21.15.5:0/496430392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65240047d0 0x7f6524004c40 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f653000c210 tx=0x7f653001c900 comp rx=0 tx=0).stop 2023-07-14T13:11:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.179+0000 7f654219d640 1 -- 172.21.15.5:0/496430392 shutdown_connections 2023-07-14T13:11:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.179+0000 7f654219d640 1 --2- 172.21.15.5:0/496430392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65240047d0 0x7f6524004c40 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.179+0000 7f654219d640 1 -- 172.21.15.5:0/496430392 >> 172.21.15.5:0/496430392 conn(0x7f653c0afac0 msgr2=0x7f653c0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.179+0000 7f654219d640 1 -- 172.21.15.5:0/496430392 shutdown_connections 2023-07-14T13:11:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.179+0000 7f654219d640 1 -- 172.21.15.5:0/496430392 wait complete. 2023-07-14T13:11:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.179+0000 7f654219d640 1 Processor -- start 2023-07-14T13:11:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.179+0000 7f654219d640 1 -- start start 2023-07-14T13:11:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.179+0000 7f654219d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65240047d0 0x7f653c155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.179+0000 7f654219d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f653c14ed90 0x7f653c1462f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.179+0000 7f654219d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f653c0ca010 0x7f653c0ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.179+0000 7f654219d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c0ca9c0 con 0x7f65240047d0 2023-07-14T13:11:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.179+0000 7f654219d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c14f610 con 0x7f653c0ca010 2023-07-14T13:11:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.179+0000 7f654219d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653c1599b0 con 0x7f653c14ed90 2023-07-14T13:11:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.179+0000 7f653b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65240047d0 0x7f653c155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.179+0000 7f653b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65240047d0 0x7f653c155a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57518/0 (socket says 172.21.15.5:57518) 2023-07-14T13:11:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.179+0000 7f653b7fe640 1 -- 172.21.15.5:0/3304894289 learned_addr learned my addr 172.21.15.5:0/3304894289 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.179+0000 7f653affd640 1 --2- 172.21.15.5:0/3304894289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f653c14ed90 0x7f653c1462f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.179+0000 7f653bfff640 1 --2- 172.21.15.5:0/3304894289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f653c0ca010 0x7f653c0ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:38.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.179+0000 7f653b7fe640 1 -- 172.21.15.5:0/3304894289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f653c14ed90 msgr2=0x7f653c1462f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:38.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.179+0000 7f653b7fe640 1 --2- 172.21.15.5:0/3304894289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f653c14ed90 0x7f653c1462f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:38.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.179+0000 7f653b7fe640 1 -- 172.21.15.5:0/3304894289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f653c0ca010 msgr2=0x7f653c0ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:38.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.179+0000 7f653b7fe640 1 --2- 172.21.15.5:0/3304894289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f653c0ca010 0x7f653c0ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:38.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.179+0000 7f653b7fe640 1 -- 172.21.15.5:0/3304894289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653c155fa0 con 0x7f65240047d0 2023-07-14T13:11:38.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.179+0000 7f653bfff640 1 --2- 172.21.15.5:0/3304894289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f653c0ca010 0x7f653c0ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:11:38.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.183+0000 7f653b7fe640 1 --2- 172.21.15.5:0/3304894289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65240047d0 0x7f653c155a60 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f652c011ad0 tx=0x7f652c011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:38.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.183+0000 7f6523fff640 1 -- 172.21.15.5:0/3304894289 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c00fb50 con 0x7f65240047d0 2023-07-14T13:11:38.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.183+0000 7f6523fff640 1 -- 172.21.15.5:0/3304894289 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652c00fcb0 con 0x7f65240047d0 2023-07-14T13:11:38.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.183+0000 7f6523fff640 1 -- 172.21.15.5:0/3304894289 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c014440 con 0x7f65240047d0 2023-07-14T13:11:38.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.183+0000 7f654219d640 1 -- 172.21.15.5:0/3304894289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f653c156260 con 0x7f65240047d0 2023-07-14T13:11:38.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.183+0000 7f654219d640 1 -- 172.21.15.5:0/3304894289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f653c159640 con 0x7f65240047d0 2023-07-14T13:11:38.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.183+0000 7f654219d640 1 -- 172.21.15.5:0/3304894289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f653c0678d0 con 0x7f65240047d0 2023-07-14T13:11:38.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.183+0000 7f6523fff640 1 -- 172.21.15.5:0/3304894289 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f652c0145c0 con 0x7f65240047d0 2023-07-14T13:11:38.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.183+0000 7f6523fff640 1 --2- 172.21.15.5:0/3304894289 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f65280663a0 0x7f6528068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:38.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.183+0000 7f6523fff640 1 -- 172.21.15.5:0/3304894289 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f652c084640 con 0x7f65240047d0 2023-07-14T13:11:38.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.183+0000 7f653affd640 1 --2- 172.21.15.5:0/3304894289 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f65280663a0 0x7f6528068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:38.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.187+0000 7f653affd640 1 --2- 172.21.15.5:0/3304894289 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f65280663a0 0x7f6528068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f65300ac000 tx=0x7f6530006040 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:38.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.187+0000 7f6523fff640 1 -- 172.21.15.5:0/3304894289 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f652c051a40 con 0x7f65240047d0 2023-07-14T13:11:38.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.395+0000 7f654219d640 1 -- 172.21.15.5:0/3304894289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f653c0cd270 con 0x7f65240047d0 2023-07-14T13:11:38.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.403+0000 7f6523fff640 1 -- 172.21.15.5:0/3304894289 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+147 (secure 0 0 0) 0x7f652c055060 con 0x7f65240047d0 2023-07-14T13:11:38.436 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-07-14T13:11:38.436 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDkRLFkCav/DhAA6SOiONAbTcWCnUZXcm7BcQ== 2023-07-14T13:11:38.436 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2023-07-14T13:11:38.436 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2023-07-14T13:11:38.436 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-14T13:11:38.437 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2023-07-14T13:11:38.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.403+0000 7f654219d640 1 -- 172.21.15.5:0/3304894289 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f65280663a0 msgr2=0x7f6528068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:38.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.403+0000 7f654219d640 1 --2- 172.21.15.5:0/3304894289 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f65280663a0 0x7f6528068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f65300ac000 tx=0x7f6530006040 comp rx=0 tx=0).stop 2023-07-14T13:11:38.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.403+0000 7f654219d640 1 -- 172.21.15.5:0/3304894289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65240047d0 msgr2=0x7f653c155a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:38.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.403+0000 7f654219d640 1 --2- 172.21.15.5:0/3304894289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65240047d0 0x7f653c155a60 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f652c011ad0 tx=0x7f652c011f90 comp rx=0 tx=0).stop 2023-07-14T13:11:38.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.403+0000 7f654219d640 1 -- 172.21.15.5:0/3304894289 shutdown_connections 2023-07-14T13:11:38.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.403+0000 7f654219d640 1 --2- 172.21.15.5:0/3304894289 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f65280663a0 0x7f6528068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:38.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.403+0000 7f654219d640 1 --2- 172.21.15.5:0/3304894289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f653c0ca010 0x7f653c0ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:38.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.403+0000 7f654219d640 1 --2- 172.21.15.5:0/3304894289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f653c14ed90 0x7f653c1462f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:38.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.403+0000 7f654219d640 1 --2- 172.21.15.5:0/3304894289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65240047d0 0x7f653c155a60 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:38.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.403+0000 7f654219d640 1 -- 172.21.15.5:0/3304894289 >> 172.21.15.5:0/3304894289 conn(0x7f653c0afac0 msgr2=0x7f653c0b0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:38.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.403+0000 7f654219d640 1 -- 172.21.15.5:0/3304894289 shutdown_connections 2023-07-14T13:11:38.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.403+0000 7f654219d640 1 -- 172.21.15.5:0/3304894289 wait complete. 2023-07-14T13:11:38.457 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:11:38.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.567+0000 7f62fbb74640 1 Processor -- start 2023-07-14T13:11:38.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.567+0000 7f62fbb74640 1 -- start start 2023-07-14T13:11:38.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.567+0000 7f62fbb74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62f4158ce0 0x7f62f4070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:38.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.567+0000 7f62fbb74640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f62f40c8ad0 0x7f62f40c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:38.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.571+0000 7f62fbb74640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f40cc700 con 0x7f62f40c9560 2023-07-14T13:11:38.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.571+0000 7f62fbb74640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f40c99e0 con 0x7f62f40c8ad0 2023-07-14T13:11:38.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.571+0000 7f62fbb74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40b0ff0 con 0x7f62f4158ce0 2023-07-14T13:11:38.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.571+0000 7f62f910f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f62f40c8ad0 0x7f62f40c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:38.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.571+0000 7f62fa111640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f62f40c9560 0x7f62f40cab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46104/0 (socket says 172.21.15.5:46104) 2023-07-14T13:11:38.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.571+0000 7f62fa111640 1 -- 172.21.15.5:0/105635372 learned_addr learned my addr 172.21.15.5:0/105635372 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:38.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.571+0000 7f62f9910640 1 --2- 172.21.15.5:0/105635372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62f4158ce0 0x7f62f4070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:38.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.571+0000 7f62f910f640 1 -- 172.21.15.5:0/105635372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62f4158ce0 msgr2=0x7f62f4070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:38.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.571+0000 7f62f910f640 1 --2- 172.21.15.5:0/105635372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62f4158ce0 0x7f62f4070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:38.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.571+0000 7f62f910f640 1 -- 172.21.15.5:0/105635372 >> v1:172.21.15.5:6789/0 conn(0x7f62f40c9560 legacy=0x7f62f40cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:38.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.571+0000 7f62f910f640 1 -- 172.21.15.5:0/105635372 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f4070c80 con 0x7f62f40c8ad0 2023-07-14T13:11:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.571+0000 7f62f890e640 1 -- 172.21.15.5:0/105635372 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525316478 0 0) 0x7f62f40cc700 con 0x7f62f40c9560 2023-07-14T13:11:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.571+0000 7f62f9910640 1 --2- 172.21.15.5:0/105635372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62f4158ce0 0x7f62f4070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:11:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.571+0000 7f62f910f640 1 --2- 172.21.15.5:0/105635372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62f40c8ad0 0x7f62f40c9020 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f62e40097c0 tx=0x7f62e401c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75af5af1c03be0ea server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.575+0000 7f62f890e640 1 -- 172.21.15.5:0/105635372 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f40cba20 con 0x7f62f40c8ad0 2023-07-14T13:11:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.575+0000 7f62f890e640 1 -- 172.21.15.5:0/105635372 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e40a7050 con 0x7f62f40c8ad0 2023-07-14T13:11:38.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.575+0000 7f62f890e640 1 -- 172.21.15.5:0/105635372 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e40ab820 con 0x7f62f40c8ad0 2023-07-14T13:11:38.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.575+0000 7f62fbb74640 1 -- 172.21.15.5:0/105635372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62f40c8ad0 msgr2=0x7f62f40c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:38.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.575+0000 7f62fbb74640 1 --2- 172.21.15.5:0/105635372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62f40c8ad0 0x7f62f40c9020 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f62e40097c0 tx=0x7f62e401c330 comp rx=0 tx=0).stop 2023-07-14T13:11:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.575+0000 7f62fbb74640 1 -- 172.21.15.5:0/105635372 shutdown_connections 2023-07-14T13:11:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.575+0000 7f62fbb74640 1 --2- 172.21.15.5:0/105635372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62f40c8ad0 0x7f62f40c9020 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.575+0000 7f62fbb74640 1 --2- 172.21.15.5:0/105635372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62f4158ce0 0x7f62f4070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.575+0000 7f62fbb74640 1 -- 172.21.15.5:0/105635372 >> 172.21.15.5:0/105635372 conn(0x7f62f40afcf0 msgr2=0x7f62f40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.575+0000 7f62fbb74640 1 -- 172.21.15.5:0/105635372 shutdown_connections 2023-07-14T13:11:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.575+0000 7f62fbb74640 1 -- 172.21.15.5:0/105635372 wait complete. 2023-07-14T13:11:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.575+0000 7f62fbb74640 1 Processor -- start 2023-07-14T13:11:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.575+0000 7f62fbb74640 1 -- start start 2023-07-14T13:11:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.575+0000 7f62fbb74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62f40c8ad0 0x7f62f40ac2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.575+0000 7f62fbb74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62f40c9560 0x7f62f4149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.575+0000 7f62fbb74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62f4158ce0 0x7f62f40b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.575+0000 7f62fbb74640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40c6290 con 0x7f62f40c9560 2023-07-14T13:11:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.575+0000 7f62fbb74640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40acb00 con 0x7f62f40c8ad0 2023-07-14T13:11:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.575+0000 7f62fbb74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40acde0 con 0x7f62f4158ce0 2023-07-14T13:11:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.579+0000 7f62f910f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62f40c9560 0x7f62f4149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:38.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.579+0000 7f62f910f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62f40c9560 0x7f62f4149f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57534/0 (socket says 172.21.15.5:57534) 2023-07-14T13:11:38.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.579+0000 7f62f910f640 1 -- 172.21.15.5:0/1539268351 learned_addr learned my addr 172.21.15.5:0/1539268351 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:38.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.579+0000 7f62fa111640 1 --2- 172.21.15.5:0/1539268351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62f4158ce0 0x7f62f40b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:38.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.579+0000 7f62f9910640 1 --2- 172.21.15.5:0/1539268351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62f40c8ad0 0x7f62f40ac2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:38.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.579+0000 7f62f910f640 1 -- 172.21.15.5:0/1539268351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62f4158ce0 msgr2=0x7f62f40b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:38.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.579+0000 7f62f910f640 1 --2- 172.21.15.5:0/1539268351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62f4158ce0 0x7f62f40b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:38.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.579+0000 7f62f910f640 1 -- 172.21.15.5:0/1539268351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62f40c8ad0 msgr2=0x7f62f40ac2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:38.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.579+0000 7f62f910f640 1 --2- 172.21.15.5:0/1539268351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62f40c8ad0 0x7f62f40ac2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:38.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.579+0000 7f62f910f640 1 -- 172.21.15.5:0/1539268351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e4009420 con 0x7f62f40c9560 2023-07-14T13:11:38.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.579+0000 7f62f9910640 1 --2- 172.21.15.5:0/1539268351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62f40c8ad0 0x7f62f40ac2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:11:38.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.579+0000 7f62f910f640 1 --2- 172.21.15.5:0/1539268351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62f40c9560 0x7f62f4149f30 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f62e40ae040 tx=0x7f62e40190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:38.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.579+0000 7f62ea7fc640 1 -- 172.21.15.5:0/1539268351 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e40b4610 con 0x7f62f40c9560 2023-07-14T13:11:38.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.579+0000 7f62ea7fc640 1 -- 172.21.15.5:0/1539268351 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e40abe90 con 0x7f62f40c9560 2023-07-14T13:11:38.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.579+0000 7f62ea7fc640 1 -- 172.21.15.5:0/1539268351 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e40b49d0 con 0x7f62f40c9560 2023-07-14T13:11:38.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.579+0000 7f62fbb74640 1 -- 172.21.15.5:0/1539268351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f40ad0c0 con 0x7f62f40c9560 2023-07-14T13:11:38.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.579+0000 7f62fbb74640 1 -- 172.21.15.5:0/1539268351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f40ac7f0 con 0x7f62f40c9560 2023-07-14T13:11:38.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.579+0000 7f62fbb74640 1 -- 172.21.15.5:0/1539268351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f4072d90 con 0x7f62f40c9560 2023-07-14T13:11:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.579+0000 7f62ea7fc640 1 -- 172.21.15.5:0/1539268351 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f62e40b2040 con 0x7f62f40c9560 2023-07-14T13:11:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.583+0000 7f62ea7fc640 1 --2- 172.21.15.5:0/1539268351 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f62d80663a0 0x7f62d8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.583+0000 7f62ea7fc640 1 -- 172.21.15.5:0/1539268351 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f62e411e090 con 0x7f62f40c9560 2023-07-14T13:11:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.583+0000 7f62f9910640 1 --2- 172.21.15.5:0/1539268351 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f62d80663a0 0x7f62d8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.583+0000 7f62f9910640 1 --2- 172.21.15.5:0/1539268351 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f62d80663a0 0x7f62d8068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f62f0009970 tx=0x7f62f0008040 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:38.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.583+0000 7f62ea7fc640 1 -- 172.21.15.5:0/1539268351 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f62e40eb250 con 0x7f62f40c9560 2023-07-14T13:11:38.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.771+0000 7f62fbb74640 1 -- 172.21.15.5:0/1539268351 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62f40ca1a0 con 0x7f62f40c9560 2023-07-14T13:11:38.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.771+0000 7f62ea7fc640 1 -- 172.21.15.5:0/1539268351 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4708 (secure 0 0 0) 0x7f62e40ee870 con 0x7f62f40c9560 2023-07-14T13:11:38.806 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:11:38.806 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6980,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2963267082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2963267082},{"type":"v1","addr":"172.21.15.154:6836","nonce":2963267082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7885,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1576178254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1576178254},{"type":"v1","addr":"172.21.15.154:6837","nonce":1576178254}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/849067278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":849067278},{"type":"v1","addr":"172.21.15.5:6833","nonce":849067278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:11:28.287189+0000","modified":"2023-07-14T13:11:31.942546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1610819689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1610819689},{"type":"v1","addr":"172.21.15.5:6835","nonce":1610819689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-14T13:11:38.806 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 57 2023-07-14T13:11:38.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.775+0000 7f62fbb74640 1 -- 172.21.15.5:0/1539268351 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f62d80663a0 msgr2=0x7f62d8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:38.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.775+0000 7f62fbb74640 1 --2- 172.21.15.5:0/1539268351 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f62d80663a0 0x7f62d8068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f62f0009970 tx=0x7f62f0008040 comp rx=0 tx=0).stop 2023-07-14T13:11:38.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.775+0000 7f62fbb74640 1 -- 172.21.15.5:0/1539268351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62f40c9560 msgr2=0x7f62f4149f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:38.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.775+0000 7f62fbb74640 1 --2- 172.21.15.5:0/1539268351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62f40c9560 0x7f62f4149f30 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f62e40ae040 tx=0x7f62e40190d0 comp rx=0 tx=0).stop 2023-07-14T13:11:38.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.775+0000 7f62fbb74640 1 -- 172.21.15.5:0/1539268351 shutdown_connections 2023-07-14T13:11:38.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.775+0000 7f62fbb74640 1 --2- 172.21.15.5:0/1539268351 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f62d80663a0 0x7f62d8068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:38.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.775+0000 7f62fbb74640 1 --2- 172.21.15.5:0/1539268351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62f4158ce0 0x7f62f40b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:38.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.775+0000 7f62fbb74640 1 --2- 172.21.15.5:0/1539268351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62f40c9560 0x7f62f4149f30 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:38.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.775+0000 7f62fbb74640 1 --2- 172.21.15.5:0/1539268351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62f40c8ad0 0x7f62f40ac2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:38.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.775+0000 7f62fbb74640 1 -- 172.21.15.5:0/1539268351 >> 172.21.15.5:0/1539268351 conn(0x7f62f40afcf0 msgr2=0x7f62f41507b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:38.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.775+0000 7f62fbb74640 1 -- 172.21.15.5:0/1539268351 shutdown_connections 2023-07-14T13:11:38.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:38.775+0000 7f62fbb74640 1 -- 172.21.15.5:0/1539268351 wait complete. 2023-07-14T13:11:39.229 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 57, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-14T13:11:28.287189+0000', 'modified': '2023-07-14T13:11:31.942546+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8247}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8247': {'gid': 8247, 'name': 'c', 'rank': 0, 'incarnation': 53, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6835/1610819689', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6834', 'nonce': 1610819689}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 1610819689}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-14T13:11:39.229 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-14T13:11:39.229 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-14T13:11:39.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.343+0000 7fccf8248640 1 Processor -- start 2023-07-14T13:11:39.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.343+0000 7fccf8248640 1 -- start start 2023-07-14T13:11:39.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf8248640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fccf0160330 0x7fccf00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf8248640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccf00c0f80 0x7fccf00cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf8248640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf00c17d0 con 0x7fccf00c8940 2023-07-14T13:11:39.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf8248640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf00c14f0 con 0x7fccf0160330 2023-07-14T13:11:39.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf8248640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf00cac10 con 0x7fccf00c0f80 2023-07-14T13:11:39.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf57e3640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fccf00c8940 0x7fccf00ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56264/0 (socket says 172.21.15.5:56264) 2023-07-14T13:11:39.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf57e3640 1 -- 172.21.15.5:0/3708391918 learned_addr learned my addr 172.21.15.5:0/3708391918 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:39.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf5fe4640 1 --2- 172.21.15.5:0/3708391918 >> v2:172.21.15.154:3300/0 conn(0x7fccf0160330 0x7fccf00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf67e5640 1 --2- 172.21.15.5:0/3708391918 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccf00c0f80 0x7fccf00cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf4fe2640 1 -- 172.21.15.5:0/3708391918 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2429402027 0 0) 0x7fccf00c17d0 con 0x7fccf00c8940 2023-07-14T13:11:39.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf4fe2640 1 -- 172.21.15.5:0/3708391918 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccdc003530 con 0x7fccf00c8940 2023-07-14T13:11:39.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf4fe2640 1 -- 172.21.15.5:0/3708391918 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3789110485 0 0) 0x7fccdc003530 con 0x7fccf00c8940 2023-07-14T13:11:39.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf4fe2640 1 -- 172.21.15.5:0/3708391918 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccf00c0f80 msgr2=0x7fccf00cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:39.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf4fe2640 1 --2- 172.21.15.5:0/3708391918 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccf00c0f80 0x7fccf00cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf4fe2640 1 -- 172.21.15.5:0/3708391918 >> v2:172.21.15.154:3300/0 conn(0x7fccf0160330 msgr2=0x7fccf00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:39.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf4fe2640 1 --2- 172.21.15.5:0/3708391918 >> v2:172.21.15.154:3300/0 conn(0x7fccf0160330 0x7fccf00cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf4fe2640 1 -- 172.21.15.5:0/3708391918 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf00caef0 con 0x7fccf00c8940 2023-07-14T13:11:39.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf4fe2640 1 -- 172.21.15.5:0/3708391918 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7fcce00016a0 con 0x7fccf00c8940 2023-07-14T13:11:39.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf4fe2640 1 -- 172.21.15.5:0/3708391918 >> v1:172.21.15.5:6789/0 conn(0x7fccf00c8940 legacy=0x7fccf00ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:39.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf4fe2640 1 --2- 172.21.15.5:0/3708391918 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccf00c0f80 0x7fccdc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf4fe2640 1 --2- 172.21.15.5:0/3708391918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccdc003f00 0x7fccdc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf4fe2640 1 --2- 172.21.15.5:0/3708391918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccdc004d10 0x7fccdc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf4fe2640 1 -- 172.21.15.5:0/3708391918 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf00c14f0 con 0x7fccdc003f00 2023-07-14T13:11:39.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf4fe2640 1 -- 172.21.15.5:0/3708391918 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf00cac10 con 0x7fccdc004d10 2023-07-14T13:11:39.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf4fe2640 1 -- 172.21.15.5:0/3708391918 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc00b9c0 con 0x7fccf00c0f80 2023-07-14T13:11:39.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf57e3640 1 --2- 172.21.15.5:0/3708391918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccdc003f00 0x7fccdc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf5fe4640 1 --2- 172.21.15.5:0/3708391918 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccf00c0f80 0x7fccdc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf67e5640 1 --2- 172.21.15.5:0/3708391918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccdc004d10 0x7fccdc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf57e3640 1 -- 172.21.15.5:0/3708391918 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccf00c0f80 msgr2=0x7fccdc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:39.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf57e3640 1 --2- 172.21.15.5:0/3708391918 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccf00c0f80 0x7fccdc003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf57e3640 1 -- 172.21.15.5:0/3708391918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccdc004d10 msgr2=0x7fccdc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:39.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf57e3640 1 --2- 172.21.15.5:0/3708391918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccdc004d10 0x7fccdc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf57e3640 1 -- 172.21.15.5:0/3708391918 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc003530 con 0x7fccdc003f00 2023-07-14T13:11:39.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.347+0000 7fccf5fe4640 1 --2- 172.21.15.5:0/3708391918 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccf00c0f80 0x7fccdc003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:11:39.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.351+0000 7fccf57e3640 1 --2- 172.21.15.5:0/3708391918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccdc003f00 0x7fccdc0047d0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fcce000c210 tx=0x7fcce001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20091ec76d635eae server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:39.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.351+0000 7fccf4fe2640 1 -- 172.21.15.5:0/3708391918 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce00a5940 con 0x7fccdc003f00 2023-07-14T13:11:39.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.351+0000 7fccf4fe2640 1 -- 172.21.15.5:0/3708391918 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce00a5aa0 con 0x7fccdc003f00 2023-07-14T13:11:39.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.351+0000 7fccf4fe2640 1 -- 172.21.15.5:0/3708391918 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce00a5e50 con 0x7fccdc003f00 2023-07-14T13:11:39.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.351+0000 7fccf8248640 1 -- 172.21.15.5:0/3708391918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccdc003f00 msgr2=0x7fccdc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:39.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.351+0000 7fccf8248640 1 --2- 172.21.15.5:0/3708391918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccdc003f00 0x7fccdc0047d0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fcce000c210 tx=0x7fcce001cc40 comp rx=0 tx=0).stop 2023-07-14T13:11:39.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.351+0000 7fccf67e5640 1 -- 172.21.15.5:0/3708391918 reap_dead start 2023-07-14T13:11:39.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.351+0000 7fccf8248640 1 -- 172.21.15.5:0/3708391918 shutdown_connections 2023-07-14T13:11:39.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.351+0000 7fccf8248640 1 -- 172.21.15.5:0/3708391918 >> 172.21.15.5:0/3708391918 conn(0x7fccf00afcf0 msgr2=0x7fccf00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:39.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.351+0000 7fccf8248640 1 -- 172.21.15.5:0/3708391918 shutdown_connections 2023-07-14T13:11:39.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.351+0000 7fccf8248640 1 -- 172.21.15.5:0/3708391918 wait complete. 2023-07-14T13:11:39.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.351+0000 7fccf8248640 1 Processor -- start 2023-07-14T13:11:39.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.351+0000 7fccf8248640 1 -- start start 2023-07-14T13:11:39.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.355+0000 7fccf8248640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccdc003f00 0x7fccf01f69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.355+0000 7fccf8248640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccf00b18e0 0x7fccf00b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.355+0000 7fccf8248640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf00c2980 0x7fccf00c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.355+0000 7fccf8248640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf00c6280 con 0x7fccf00c2980 2023-07-14T13:11:39.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.355+0000 7fccf8248640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf00c64d0 con 0x7fccdc003f00 2023-07-14T13:11:39.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.355+0000 7fccf8248640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf00c67b0 con 0x7fccf00b18e0 2023-07-14T13:11:39.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.355+0000 7fccf67e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf00c2980 0x7fccf00c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.355+0000 7fccf67e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf00c2980 0x7fccf00c7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40668/0 (socket says 172.21.15.5:40668) 2023-07-14T13:11:39.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.355+0000 7fccf67e5640 1 -- 172.21.15.5:0/2058542132 learned_addr learned my addr 172.21.15.5:0/2058542132 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:39.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.355+0000 7fccf5fe4640 1 --2- 172.21.15.5:0/2058542132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccdc003f00 0x7fccf01f69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.355+0000 7fccf57e3640 1 --2- 172.21.15.5:0/2058542132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccf00b18e0 0x7fccf00b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.355+0000 7fccf67e5640 1 -- 172.21.15.5:0/2058542132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccf00b18e0 msgr2=0x7fccf00b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:39.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.355+0000 7fccf67e5640 1 --2- 172.21.15.5:0/2058542132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccf00b18e0 0x7fccf00b37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.355+0000 7fccf67e5640 1 -- 172.21.15.5:0/2058542132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccdc003f00 msgr2=0x7fccf01f69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:39.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.355+0000 7fccf67e5640 1 --2- 172.21.15.5:0/2058542132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccdc003f00 0x7fccf01f69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.355+0000 7fccf67e5640 1 -- 172.21.15.5:0/2058542132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf00c6a90 con 0x7fccf00c2980 2023-07-14T13:11:39.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.355+0000 7fccf67e5640 1 --2- 172.21.15.5:0/2058542132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf00c2980 0x7fccf00c7290 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fccf00cab40 tx=0x7fcce8011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:39.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.355+0000 7fcce67fc640 1 -- 172.21.15.5:0/2058542132 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce800e040 con 0x7fccf00c2980 2023-07-14T13:11:39.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.355+0000 7fcce67fc640 1 -- 172.21.15.5:0/2058542132 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce800f040 con 0x7fccf00c2980 2023-07-14T13:11:39.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.355+0000 7fcce67fc640 1 -- 172.21.15.5:0/2058542132 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce8015a80 con 0x7fccf00c2980 2023-07-14T13:11:39.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.355+0000 7fccf8248640 1 -- 172.21.15.5:0/2058542132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf00c6d70 con 0x7fccf00c2980 2023-07-14T13:11:39.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.355+0000 7fccf8248640 1 -- 172.21.15.5:0/2058542132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf00b3d20 con 0x7fccf00c2980 2023-07-14T13:11:39.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.359+0000 7fcce67fc640 1 -- 172.21.15.5:0/2058542132 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcce8015be0 con 0x7fccf00c2980 2023-07-14T13:11:39.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.359+0000 7fcce67fc640 1 --2- 172.21.15.5:0/2058542132 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fccd40663a0 0x7fccd4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.359+0000 7fcce67fc640 1 -- 172.21.15.5:0/2058542132 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcce8083ce0 con 0x7fccf00c2980 2023-07-14T13:11:39.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.359+0000 7fccf5fe4640 1 --2- 172.21.15.5:0/2058542132 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fccd40663a0 0x7fccd4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.359+0000 7fccfb5a8000 1 Processor -- start 2023-07-14T13:11:39.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.359+0000 7fccf5fe4640 1 --2- 172.21.15.5:0/2058542132 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fccd40663a0 0x7fccd4068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fccec006f90 tx=0x7fccec008040 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:39.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.359+0000 7fccfb5a8000 1 -- start start 2023-07-14T13:11:39.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.359+0000 7fccfb5a8000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558b92e07f80 0x558b92e08350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.359+0000 7fccfb5a8000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b92e08890 0x558b92dbe3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.359+0000 7fccfb5a8000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92dbe930 0x558b92dbed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.359+0000 7fccfb5a8000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b92c85900 con 0x558b92dbe930 2023-07-14T13:11:39.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.359+0000 7fccfb5a8000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b92bbf8c0 con 0x558b92e08890 2023-07-14T13:11:39.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.359+0000 7fccfb5a8000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x558b92c13360 con 0x558b92e07f80 2023-07-14T13:11:39.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.359+0000 7fccf67e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92dbe930 0x558b92dbed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.359+0000 7fccf67e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92dbe930 0x558b92dbed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40674/0 (socket says 172.21.15.5:40674) 2023-07-14T13:11:39.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccf67e5640 1 -- 172.21.15.5:0/2482800545 learned_addr learned my addr 172.21.15.5:0/2482800545 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:39.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccf5fe4640 1 --2- 172.21.15.5:0/2482800545 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558b92e07f80 0x558b92e08350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccf57e3640 1 --2- 172.21.15.5:0/2482800545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b92e08890 0x558b92dbe3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccf67e5640 1 -- 172.21.15.5:0/2482800545 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558b92e07f80 msgr2=0x558b92e08350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:39.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccf67e5640 1 --2- 172.21.15.5:0/2482800545 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558b92e07f80 0x558b92e08350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccf67e5640 1 -- 172.21.15.5:0/2482800545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b92e08890 msgr2=0x558b92dbe3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:39.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccf67e5640 1 --2- 172.21.15.5:0/2482800545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b92e08890 0x558b92dbe3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccf67e5640 1 -- 172.21.15.5:0/2482800545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b92908890 con 0x558b92dbe930 2023-07-14T13:11:39.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccf67e5640 1 --2- 172.21.15.5:0/2482800545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92dbe930 0x558b92dbed00 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fcce8002240 tx=0x7fcce8054ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f6a65d7e7145f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:39.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccd37fe640 1 -- 172.21.15.5:0/2482800545 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce8053100 con 0x558b92dbe930 2023-07-14T13:11:39.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccd37fe640 1 -- 172.21.15.5:0/2482800545 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce8015e90 con 0x558b92dbe930 2023-07-14T13:11:39.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccd37fe640 1 -- 172.21.15.5:0/2482800545 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce8054390 con 0x558b92dbe930 2023-07-14T13:11:39.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccfb5a8000 1 -- 172.21.15.5:0/2482800545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92dbe930 msgr2=0x558b92dbed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:39.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccfb5a8000 1 --2- 172.21.15.5:0/2482800545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92dbe930 0x558b92dbed00 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fcce8002240 tx=0x7fcce8054ba0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccfb5a8000 1 -- 172.21.15.5:0/2482800545 shutdown_connections 2023-07-14T13:11:39.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccfb5a8000 1 --2- 172.21.15.5:0/2482800545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92dbe930 0x558b92dbed00 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccfb5a8000 1 --2- 172.21.15.5:0/2482800545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b92e08890 0x558b92dbe3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccfb5a8000 1 --2- 172.21.15.5:0/2482800545 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558b92e07f80 0x558b92e08350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccfb5a8000 1 -- 172.21.15.5:0/2482800545 >> 172.21.15.5:0/2482800545 conn(0x558b92dc4a90 msgr2=0x558b92dbccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:39.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccfb5a8000 1 -- 172.21.15.5:0/2482800545 shutdown_connections 2023-07-14T13:11:39.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccfb5a8000 1 -- 172.21.15.5:0/2482800545 wait complete. 2023-07-14T13:11:39.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccfb5a8000 1 -- start start 2023-07-14T13:11:39.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccfb5a8000 1 Processor -- start 2023-07-14T13:11:39.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccfb5a8000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b92dbe930 0x558b92dc9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccfb5a8000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558b92e07f80 0x558b92dc9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccfb5a8000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92e08890 0x558b92dca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccfb5a8000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b92c0c400 con 0x558b92e08890 2023-07-14T13:11:39.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccfb5a8000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b92bc8b60 con 0x558b92dbe930 2023-07-14T13:11:39.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccfb5a8000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x558b92bc8800 con 0x558b92e07f80 2023-07-14T13:11:39.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccfb5a8000 10 client.0 _ll_register_callbacks cb 0x558b92daa2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:11:39.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.363+0000 7fccf67e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92e08890 0x558b92dca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccf67e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92e08890 0x558b92dca3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40678/0 (socket says 172.21.15.5:40678) 2023-07-14T13:11:39.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccf67e5640 1 -- 172.21.15.5:0/2517397548 learned_addr learned my addr 172.21.15.5:0/2517397548 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:39.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccf57e3640 1 --2- 172.21.15.5:0/2517397548 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558b92e07f80 0x558b92dc9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccf5fe4640 1 --2- 172.21.15.5:0/2517397548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b92dbe930 0x558b92dc9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccf67e5640 1 -- 172.21.15.5:0/2517397548 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558b92e07f80 msgr2=0x558b92dc9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:39.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccf67e5640 1 --2- 172.21.15.5:0/2517397548 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558b92e07f80 0x558b92dc9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccf67e5640 1 -- 172.21.15.5:0/2517397548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b92dbe930 msgr2=0x558b92dc9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:39.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccf67e5640 1 --2- 172.21.15.5:0/2517397548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b92dbe930 0x558b92dc9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccf67e5640 1 -- 172.21.15.5:0/2517397548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf00b3d20 con 0x558b92e08890 2023-07-14T13:11:39.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccf67e5640 1 --2- 172.21.15.5:0/2517397548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92e08890 0x558b92dca3e0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fcce8002240 tx=0x7fcce8050fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c026cf0568e9f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:39.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccd0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-07-14T13:11:39.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccd0ff9640 1 -- 172.21.15.5:0/2517397548 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce8080070 con 0x558b92e08890 2023-07-14T13:11:39.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccfb5a8000 1 -- 172.21.15.5:0/2517397548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558b92bd3aa0 con 0x558b92e08890 2023-07-14T13:11:39.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccd0ff9640 1 -- 172.21.15.5:0/2517397548 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(127..127 src has 1..127) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcce8053100 con 0x558b92e08890 2023-07-14T13:11:39.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccd0ff9640 1 -- 172.21.15.5:0/2517397548 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcce8082210 con 0x558b92e08890 2023-07-14T13:11:39.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccfb5a8000 10 client.8415 fetch_fsmap learned FSMap version 57 2023-07-14T13:11:39.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccfb5a8000 1 -- 172.21.15.5:0/2517397548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x558b92bd0d90 con 0x558b92e08890 2023-07-14T13:11:39.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccd0ff9640 1 -- 172.21.15.5:0/2517397548 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558b92bd3aa0 con 0x558b92e08890 2023-07-14T13:11:39.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccd0ff9640 1 -- 172.21.15.5:0/2517397548 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 57) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fcce8005d20 con 0x558b92e08890 2023-07-14T13:11:39.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccfb5a8000 10 client.8415 fetch_fsmap finished waiting for FSMap version 57 2023-07-14T13:11:39.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccfb5a8000 10 client.8415 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T13:11:39.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccfb5a8000 20 client.8415 populate_metadata read hostname 'smithi005' 2023-07-14T13:11:39.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccfb5a8000 1 --2- 172.21.15.5:0/2517397548 >> [v2:172.21.15.5:6834/1610819689,v1:172.21.15.5:6835/1610819689] conn(0x558b92dcacb0 0x558b92e194d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccfb5a8000 4 client.8415 mds_command: new command op to 8247 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:11:39.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccfb5a8000 1 -- 172.21.15.5:0/2517397548 --> [v2:172.21.15.5:6834/1610819689,v1:172.21.15.5:6835/1610819689] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558b92c3af40 con 0x558b92dcacb0 2023-07-14T13:11:39.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccf5fe4640 1 --2- 172.21.15.5:0/2517397548 >> [v2:172.21.15.5:6834/1610819689,v1:172.21.15.5:6835/1610819689] conn(0x558b92dcacb0 0x558b92e194d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccf5fe4640 1 --2- 172.21.15.5:0/2517397548 >> [v2:172.21.15.5:6834/1610819689,v1:172.21.15.5:6835/1610819689] conn(0x558b92dcacb0 0x558b92e194d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af66bea1c742c1f0 server_cookie=ed3ff2574d82994a in_seq=0 out_seq=0 2023-07-14T13:11:39.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccd0ff9640 10 client.8415 ms_handle_connect on v2:172.21.15.5:6834/1610819689 2023-07-14T13:11:39.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccd0ff9640 1 -- 172.21.15.5:0/2517397548 <== mds.0 v2:172.21.15.5:6834/1610819689 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x558b92c3af40 con 0x558b92dcacb0 2023-07-14T13:11:39.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccd0ff9640 10 client.8415 handle_command_reply: tid=0 2023-07-14T13:11:39.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccfb5a8000 1 client.8415 shutdown 2023-07-14T13:11:39.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccfb5a8000 1 -- 172.21.15.5:0/2517397548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92e08890 msgr2=0x558b92dca3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:39.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccfb5a8000 1 --2- 172.21.15.5:0/2517397548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92e08890 0x558b92dca3e0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fcce8002240 tx=0x7fcce8050fe0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccfb5a8000 1 -- 172.21.15.5:0/2517397548 shutdown_connections 2023-07-14T13:11:39.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccfb5a8000 1 --2- 172.21.15.5:0/2517397548 >> [v2:172.21.15.5:6834/1610819689,v1:172.21.15.5:6835/1610819689] conn(0x558b92dcacb0 0x558b92e194d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccfb5a8000 1 --2- 172.21.15.5:0/2517397548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92e08890 0x558b92dca3e0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccfb5a8000 1 --2- 172.21.15.5:0/2517397548 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558b92e07f80 0x558b92dc9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccd0ff9640 0 client.8415 ms_handle_reset on v2:172.21.15.5:6834/1610819689 2023-07-14T13:11:39.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccfb5a8000 1 --2- 172.21.15.5:0/2517397548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b92dbe930 0x558b92dc9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccfb5a8000 1 -- 172.21.15.5:0/2517397548 >> 172.21.15.5:0/2517397548 conn(0x558b92dc4a90 msgr2=0x558b92dbd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:39.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccfb5a8000 1 -- 172.21.15.5:0/2517397548 shutdown_connections 2023-07-14T13:11:39.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccfb5a8000 1 -- 172.21.15.5:0/2517397548 wait complete. 2023-07-14T13:11:39.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.367+0000 7fccfb5a8000 20 client.8415 trim_cache size 0 max 16384 2023-07-14T13:11:39.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.383+0000 7fccfb5a8000 1 Processor -- start 2023-07-14T13:11:39.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.383+0000 7fccfb5a8000 1 -- start start 2023-07-14T13:11:39.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccfb5a8000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92dc4a90 0x558b92e076a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccfb5a8000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b92dbe930 0x558b92e1a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccfb5a8000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558b92e07f80 0x558b92e1aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccfb5a8000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b928c9940 con 0x558b92dc4a90 2023-07-14T13:11:39.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccfb5a8000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b92dc2c20 con 0x558b92dbe930 2023-07-14T13:11:39.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccfb5a8000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x558b92c09800 con 0x558b92e07f80 2023-07-14T13:11:39.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccf5fe4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92dc4a90 0x558b92e076a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccf5fe4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92dc4a90 0x558b92e076a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40684/0 (socket says 172.21.15.5:40684) 2023-07-14T13:11:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccf5fe4640 1 -- 172.21.15.5:0/2325103433 learned_addr learned my addr 172.21.15.5:0/2325103433 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccf67e5640 1 --2- 172.21.15.5:0/2325103433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558b92e07f80 0x558b92e1aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccf57e3640 1 --2- 172.21.15.5:0/2325103433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b92dbe930 0x558b92e1a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccf5fe4640 1 -- 172.21.15.5:0/2325103433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558b92e07f80 msgr2=0x558b92e1aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccf5fe4640 1 --2- 172.21.15.5:0/2325103433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558b92e07f80 0x558b92e1aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccf5fe4640 1 -- 172.21.15.5:0/2325103433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b92dbe930 msgr2=0x558b92e1a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:39.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccf5fe4640 1 --2- 172.21.15.5:0/2325103433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b92dbe930 0x558b92e1a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccf5fe4640 1 -- 172.21.15.5:0/2325103433 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b92bb7020 con 0x558b92dc4a90 2023-07-14T13:11:39.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccf5fe4640 1 --2- 172.21.15.5:0/2325103433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92dc4a90 0x558b92e076a0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x558b92dc7d60 tx=0x7fccec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa35e249c661c187 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:39.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccd3fff640 1 -- 172.21.15.5:0/2325103433 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec029040 con 0x558b92dc4a90 2023-07-14T13:11:39.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccd3fff640 1 -- 172.21.15.5:0/2325103433 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccec02fe10 con 0x558b92dc4a90 2023-07-14T13:11:39.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccd3fff640 1 -- 172.21.15.5:0/2325103433 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec02f610 con 0x558b92dc4a90 2023-07-14T13:11:39.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccfb5a8000 1 -- 172.21.15.5:0/2325103433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92dc4a90 msgr2=0x558b92e076a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:39.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccfb5a8000 1 --2- 172.21.15.5:0/2325103433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92dc4a90 0x558b92e076a0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x558b92dc7d60 tx=0x7fccec017000 comp rx=0 tx=0).stop 2023-07-14T13:11:39.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccfb5a8000 1 -- 172.21.15.5:0/2325103433 shutdown_connections 2023-07-14T13:11:39.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccfb5a8000 1 --2- 172.21.15.5:0/2325103433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558b92e07f80 0x558b92e1aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccfb5a8000 1 --2- 172.21.15.5:0/2325103433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b92dbe930 0x558b92e1a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccfb5a8000 1 --2- 172.21.15.5:0/2325103433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92dc4a90 0x558b92e076a0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccfb5a8000 1 -- 172.21.15.5:0/2325103433 >> 172.21.15.5:0/2325103433 conn(0x558b92dc1d30 msgr2=0x558b92dc40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccfb5a8000 1 -- 172.21.15.5:0/2325103433 shutdown_connections 2023-07-14T13:11:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccfb5a8000 1 -- 172.21.15.5:0/2325103433 wait complete. 2023-07-14T13:11:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccfb5a8000 1 -- start start 2023-07-14T13:11:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccfb5a8000 1 Processor -- start 2023-07-14T13:11:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccfb5a8000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558b92dbe930 0x558b92e65560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccfb5a8000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b92dc4a90 0x558b92e65aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccfb5a8000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92e07f80 0x558b92e19be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccfb5a8000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b92ba9b00 con 0x558b92e07f80 2023-07-14T13:11:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccfb5a8000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b92dbe450 con 0x558b92dc4a90 2023-07-14T13:11:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccfb5a8000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x558b92c4f600 con 0x558b92dbe930 2023-07-14T13:11:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.387+0000 7fccfb5a8000 10 client.0 _ll_register_callbacks cb 0x558b92d8a4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:11:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccf67e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92e07f80 0x558b92e19be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccf67e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92e07f80 0x558b92e19be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40690/0 (socket says 172.21.15.5:40690) 2023-07-14T13:11:39.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccf67e5640 1 -- 172.21.15.5:0/252398504 learned_addr learned my addr 172.21.15.5:0/252398504 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:39.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccf5fe4640 1 --2- 172.21.15.5:0/252398504 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558b92dbe930 0x558b92e65560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccf57e3640 1 --2- 172.21.15.5:0/252398504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b92dc4a90 0x558b92e65aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccf67e5640 1 -- 172.21.15.5:0/252398504 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558b92dbe930 msgr2=0x558b92e65560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccf67e5640 1 --2- 172.21.15.5:0/252398504 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558b92dbe930 0x558b92e65560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccf67e5640 1 -- 172.21.15.5:0/252398504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b92dc4a90 msgr2=0x558b92e65aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccf67e5640 1 --2- 172.21.15.5:0/252398504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b92dc4a90 0x558b92e65aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccf67e5640 1 -- 172.21.15.5:0/252398504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccec02f9c0 con 0x558b92e07f80 2023-07-14T13:11:39.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccf67e5640 1 --2- 172.21.15.5:0/252398504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92e07f80 0x558b92e19be0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fcce8054c30 tx=0x7fcce8051110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cbe4843cdfc60da server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccd0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-07-14T13:11:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccd0ff9640 1 -- 172.21.15.5:0/252398504 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce8080070 con 0x558b92e07f80 2023-07-14T13:11:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccd0ff9640 1 -- 172.21.15.5:0/252398504 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(127..127 src has 1..127) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcce8053100 con 0x558b92e07f80 2023-07-14T13:11:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccfb5a8000 1 -- 172.21.15.5:0/252398504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558b92c0ad50 con 0x558b92e07f80 2023-07-14T13:11:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccd0ff9640 1 -- 172.21.15.5:0/252398504 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcce8082210 con 0x558b92e07f80 2023-07-14T13:11:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccfb5a8000 10 client.8421 fetch_fsmap learned FSMap version 57 2023-07-14T13:11:39.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccfb5a8000 1 -- 172.21.15.5:0/252398504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x558b92908cc0 con 0x558b92e07f80 2023-07-14T13:11:39.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccd0ff9640 1 -- 172.21.15.5:0/252398504 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558b92c0ad50 con 0x558b92e07f80 2023-07-14T13:11:39.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccd0ff9640 1 -- 172.21.15.5:0/252398504 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 57) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fcce8005d20 con 0x558b92e07f80 2023-07-14T13:11:39.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccfb5a8000 10 client.8421 fetch_fsmap finished waiting for FSMap version 57 2023-07-14T13:11:39.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccfb5a8000 10 client.8421 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T13:11:39.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccfb5a8000 20 client.8421 populate_metadata read hostname 'smithi005' 2023-07-14T13:11:39.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccfb5a8000 1 --2- 172.21.15.5:0/252398504 >> [v2:172.21.15.5:6834/1610819689,v1:172.21.15.5:6835/1610819689] conn(0x558b92e08890 0x558b92e1a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccfb5a8000 4 client.8421 mds_command: new command op to 8247 tid=0[{"prefix": "status"}] 2023-07-14T13:11:39.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccfb5a8000 1 -- 172.21.15.5:0/252398504 --> [v2:172.21.15.5:6834/1610819689,v1:172.21.15.5:6835/1610819689] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558b92c053e0 con 0x558b92e08890 2023-07-14T13:11:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccf5fe4640 1 --2- 172.21.15.5:0/252398504 >> [v2:172.21.15.5:6834/1610819689,v1:172.21.15.5:6835/1610819689] conn(0x558b92e08890 0x558b92e1a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccf5fe4640 1 --2- 172.21.15.5:0/252398504 >> [v2:172.21.15.5:6834/1610819689,v1:172.21.15.5:6835/1610819689] conn(0x558b92e08890 0x558b92e1a5a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=324b8821307ef36d server_cookie=a5ca546375ae0683 in_seq=0 out_seq=0 2023-07-14T13:11:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccd0ff9640 10 client.8421 ms_handle_connect on v2:172.21.15.5:6834/1610819689 2023-07-14T13:11:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccd0ff9640 1 -- 172.21.15.5:0/252398504 <== mds.0 v2:172.21.15.5:6834/1610819689 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+321 (crc 0 0 0) 0x558b92c053e0 con 0x558b92e08890 2023-07-14T13:11:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccd0ff9640 10 client.8421 handle_command_reply: tid=0 2023-07-14T13:11:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccfb5a8000 1 client.8421 shutdown 2023-07-14T13:11:39.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccfb5a8000 1 -- 172.21.15.5:0/252398504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92e07f80 msgr2=0x558b92e19be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccfb5a8000 1 --2- 172.21.15.5:0/252398504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92e07f80 0x558b92e19be0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fcce8054c30 tx=0x7fcce8051110 comp rx=0 tx=0).stop 2023-07-14T13:11:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccfb5a8000 1 -- 172.21.15.5:0/252398504 shutdown_connections 2023-07-14T13:11:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccfb5a8000 1 --2- 172.21.15.5:0/252398504 >> [v2:172.21.15.5:6834/1610819689,v1:172.21.15.5:6835/1610819689] conn(0x558b92e08890 0x558b92e1a5a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccfb5a8000 1 --2- 172.21.15.5:0/252398504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558b92e07f80 0x558b92e19be0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccfb5a8000 1 --2- 172.21.15.5:0/252398504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b92dc4a90 0x558b92e65aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccfb5a8000 1 --2- 172.21.15.5:0/252398504 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558b92dbe930 0x558b92e65560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccd0ff9640 0 client.8421 ms_handle_reset on v2:172.21.15.5:6834/1610819689 2023-07-14T13:11:39.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccfb5a8000 1 -- 172.21.15.5:0/252398504 >> 172.21.15.5:0/252398504 conn(0x558b92dc1d30 msgr2=0x558b92e05250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:39.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccfb5a8000 1 -- 172.21.15.5:0/252398504 shutdown_connections 2023-07-14T13:11:39.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccfb5a8000 1 -- 172.21.15.5:0/252398504 wait complete. 2023-07-14T13:11:39.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccfb5a8000 20 client.8421 trim_cache size 0 max 16384 2023-07-14T13:11:39.433 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T13:11:39.433 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "22affb8d-e389-40f8-a764-dd40eb1759c8", 2023-07-14T13:11:39.434 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-07-14T13:11:39.434 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 8247, 2023-07-14T13:11:39.434 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-07-14T13:11:39.434 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-07-14T13:11:39.434 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-07-14T13:11:39.434 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 10.462178285, 2023-07-14T13:11:39.434 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 57, 2023-07-14T13:11:39.435 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 127, 2023-07-14T13:11:39.435 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 127, 2023-07-14T13:11:39.435 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 16.385950202 2023-07-14T13:11:39.435 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T13:11:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccf8248640 1 -- 172.21.15.5:0/2058542132 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fccd40663a0 msgr2=0x7fccd4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccf8248640 1 --2- 172.21.15.5:0/2058542132 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fccd40663a0 0x7fccd4068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fccec006f90 tx=0x7fccec008040 comp rx=0 tx=0).stop 2023-07-14T13:11:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccf8248640 1 -- 172.21.15.5:0/2058542132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf00c2980 msgr2=0x7fccf00c7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccf8248640 1 --2- 172.21.15.5:0/2058542132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf00c2980 0x7fccf00c7290 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fccf00cab40 tx=0x7fcce8011cb0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccf8248640 1 -- 172.21.15.5:0/2058542132 shutdown_connections 2023-07-14T13:11:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccf8248640 1 --2- 172.21.15.5:0/2058542132 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fccd40663a0 0x7fccd4068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccf8248640 1 --2- 172.21.15.5:0/2058542132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf00c2980 0x7fccf00c7290 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccf8248640 1 --2- 172.21.15.5:0/2058542132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fccf00b18e0 0x7fccf00b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccf8248640 1 --2- 172.21.15.5:0/2058542132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccdc003f00 0x7fccf01f69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.391+0000 7fccf8248640 1 -- 172.21.15.5:0/2058542132 >> 172.21.15.5:0/2058542132 conn(0x7fccf00afcf0 msgr2=0x7fccf00ae7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.395+0000 7fccf8248640 1 -- 172.21.15.5:0/2058542132 shutdown_connections 2023-07-14T13:11:39.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.395+0000 7fccf8248640 1 -- 172.21.15.5:0/2058542132 wait complete. 2023-07-14T13:11:39.445 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T13:11:39.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.555+0000 7fd231782640 1 Processor -- start 2023-07-14T13:11:39.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.555+0000 7fd231782640 1 -- start start 2023-07-14T13:11:39.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.559+0000 7fd231782640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd22c0c9730 0x7fd22c1638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.559+0000 7fd231782640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd22c0cc700 con 0x7fd22c158ce0 2023-07-14T13:11:39.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.559+0000 7fd231782640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd22c0b0ff0 con 0x7fd22c0c8ad0 2023-07-14T13:11:39.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.559+0000 7fd231782640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd22c070c80 con 0x7fd22c0c9730 2023-07-14T13:11:39.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.559+0000 7fd22affd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd22c158ce0 0x7fd22c070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56274/0 (socket says 172.21.15.5:56274) 2023-07-14T13:11:39.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.559+0000 7fd22affd640 1 -- 172.21.15.5:0/2789852328 learned_addr learned my addr 172.21.15.5:0/2789852328 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:39.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.559+0000 7fd22b7fe640 1 --2- 172.21.15.5:0/2789852328 >> v2:172.21.15.5:3300/0 conn(0x7fd22c0c9730 0x7fd22c1638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.559+0000 7fd22a7fc640 1 -- 172.21.15.5:0/2789852328 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1954210944 0 0) 0x7fd22c0cc700 con 0x7fd22c158ce0 2023-07-14T13:11:39.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.559+0000 7fd22b7fe640 1 -- 172.21.15.5:0/2789852328 >> v1:172.21.15.154:6789/0 conn(0x7fd22c0c8ad0 legacy=0x7fd22c0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:39.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.559+0000 7fd22b7fe640 1 -- 172.21.15.5:0/2789852328 >> v1:172.21.15.5:6789/0 conn(0x7fd22c158ce0 legacy=0x7fd22c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:39.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.559+0000 7fd22b7fe640 1 -- 172.21.15.5:0/2789852328 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c0cbdd0 con 0x7fd22c0c9730 2023-07-14T13:11:39.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.563+0000 7fd22b7fe640 1 --2- 172.21.15.5:0/2789852328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd22c0c9730 0x7fd22c1638b0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fd224009d90 tx=0x7fd22401c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73cfc8204d7a39ef server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:39.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.563+0000 7fd22a7fc640 1 -- 172.21.15.5:0/2789852328 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2240a57d0 con 0x7fd22c0c9730 2023-07-14T13:11:39.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.563+0000 7fd22a7fc640 1 -- 172.21.15.5:0/2789852328 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2240a5930 con 0x7fd22c0c9730 2023-07-14T13:11:39.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.563+0000 7fd22a7fc640 1 -- 172.21.15.5:0/2789852328 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2240a5cc0 con 0x7fd22c0c9730 2023-07-14T13:11:39.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.563+0000 7fd231782640 1 -- 172.21.15.5:0/2789852328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd22c0c9730 msgr2=0x7fd22c1638b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:39.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.563+0000 7fd231782640 1 --2- 172.21.15.5:0/2789852328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd22c0c9730 0x7fd22c1638b0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fd224009d90 tx=0x7fd22401c800 comp rx=0 tx=0).stop 2023-07-14T13:11:39.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.563+0000 7fd231782640 1 -- 172.21.15.5:0/2789852328 shutdown_connections 2023-07-14T13:11:39.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.563+0000 7fd231782640 1 --2- 172.21.15.5:0/2789852328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd22c0c9730 0x7fd22c1638b0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.563+0000 7fd231782640 1 -- 172.21.15.5:0/2789852328 >> 172.21.15.5:0/2789852328 conn(0x7fd22c0afcf0 msgr2=0x7fd22c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:39.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.563+0000 7fd231782640 1 -- 172.21.15.5:0/2789852328 shutdown_connections 2023-07-14T13:11:39.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.563+0000 7fd231782640 1 -- 172.21.15.5:0/2789852328 wait complete. 2023-07-14T13:11:39.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.563+0000 7fd231782640 1 Processor -- start 2023-07-14T13:11:39.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.563+0000 7fd231782640 1 -- start start 2023-07-14T13:11:39.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.563+0000 7fd231782640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd22c0c8ad0 0x7fd22c14d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.563+0000 7fd231782640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd22c0c9730 0x7fd22c0ce620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.563+0000 7fd231782640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd22c158ce0 0x7fd22c0ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.563+0000 7fd231782640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c0af8b0 con 0x7fd22c0c8ad0 2023-07-14T13:11:39.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.563+0000 7fd231782640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c0ae590 con 0x7fd22c0c9730 2023-07-14T13:11:39.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.563+0000 7fd231782640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c0ad6a0 con 0x7fd22c158ce0 2023-07-14T13:11:39.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.567+0000 7fd22affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd22c0c8ad0 0x7fd22c14d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.567+0000 7fd22affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd22c0c8ad0 0x7fd22c14d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40700/0 (socket says 172.21.15.5:40700) 2023-07-14T13:11:39.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.567+0000 7fd22affd640 1 -- 172.21.15.5:0/1281036305 learned_addr learned my addr 172.21.15.5:0/1281036305 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:39.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.567+0000 7fd22b7fe640 1 --2- 172.21.15.5:0/1281036305 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd22c158ce0 0x7fd22c0ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.567+0000 7fd223fff640 1 --2- 172.21.15.5:0/1281036305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd22c0c9730 0x7fd22c0ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.567+0000 7fd22affd640 1 -- 172.21.15.5:0/1281036305 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd22c158ce0 msgr2=0x7fd22c0ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:39.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.567+0000 7fd22affd640 1 --2- 172.21.15.5:0/1281036305 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd22c158ce0 0x7fd22c0ceb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.567+0000 7fd22affd640 1 -- 172.21.15.5:0/1281036305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd22c0c9730 msgr2=0x7fd22c0ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:39.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.567+0000 7fd22affd640 1 --2- 172.21.15.5:0/1281036305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd22c0c9730 0x7fd22c0ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.567+0000 7fd22affd640 1 -- 172.21.15.5:0/1281036305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd224009a70 con 0x7fd22c0c8ad0 2023-07-14T13:11:39.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.567+0000 7fd22affd640 1 --2- 172.21.15.5:0/1281036305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd22c0c8ad0 0x7fd22c14d890 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fd21c00c410 tx=0x7fd21c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:39.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.567+0000 7fd2237fe640 1 -- 172.21.15.5:0/1281036305 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c0074e0 con 0x7fd22c0c8ad0 2023-07-14T13:11:39.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.567+0000 7fd2237fe640 1 -- 172.21.15.5:0/1281036305 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21c007640 con 0x7fd22c0c8ad0 2023-07-14T13:11:39.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.567+0000 7fd2237fe640 1 -- 172.21.15.5:0/1281036305 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c004a30 con 0x7fd22c0c8ad0 2023-07-14T13:11:39.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.567+0000 7fd231782640 1 -- 172.21.15.5:0/1281036305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd22c0ad980 con 0x7fd22c0c8ad0 2023-07-14T13:11:39.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.567+0000 7fd231782640 1 -- 172.21.15.5:0/1281036305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd22c0adf40 con 0x7fd22c0c8ad0 2023-07-14T13:11:39.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.567+0000 7fd231782640 1 -- 172.21.15.5:0/1281036305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd22c0ca1a0 con 0x7fd22c0c8ad0 2023-07-14T13:11:39.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.567+0000 7fd2237fe640 1 -- 172.21.15.5:0/1281036305 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd21c004b90 con 0x7fd22c0c8ad0 2023-07-14T13:11:39.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.567+0000 7fd2237fe640 1 --2- 172.21.15.5:0/1281036305 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fd20c0663d0 0x7fd20c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:39.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.571+0000 7fd2237fe640 1 -- 172.21.15.5:0/1281036305 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd21c083b30 con 0x7fd22c0c8ad0 2023-07-14T13:11:39.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.571+0000 7fd223fff640 1 --2- 172.21.15.5:0/1281036305 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fd20c0663d0 0x7fd20c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:39.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.571+0000 7fd223fff640 1 --2- 172.21.15.5:0/1281036305 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fd20c0663d0 0x7fd20c068880 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd22c14ec90 tx=0x7fd214009040 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:39.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.571+0000 7fd2237fe640 1 -- 172.21.15.5:0/1281036305 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd21c050eb0 con 0x7fd22c0c8ad0 2023-07-14T13:11:39.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.763+0000 7fd231782640 1 -- 172.21.15.5:0/1281036305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd22c0678d0 con 0x7fd22c0c8ad0 2023-07-14T13:11:39.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.763+0000 7fd2237fe640 1 -- 172.21.15.5:0/1281036305 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v57) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd21c0544d0 con 0x7fd22c0c8ad0 2023-07-14T13:11:39.795 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T13:11:39.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.763+0000 7fd231782640 1 -- 172.21.15.5:0/1281036305 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fd20c0663d0 msgr2=0x7fd20c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:39.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.763+0000 7fd231782640 1 --2- 172.21.15.5:0/1281036305 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fd20c0663d0 0x7fd20c068880 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd22c14ec90 tx=0x7fd214009040 comp rx=0 tx=0).stop 2023-07-14T13:11:39.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.763+0000 7fd231782640 1 -- 172.21.15.5:0/1281036305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd22c0c8ad0 msgr2=0x7fd22c14d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:39.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.763+0000 7fd231782640 1 --2- 172.21.15.5:0/1281036305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd22c0c8ad0 0x7fd22c14d890 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fd21c00c410 tx=0x7fd21c00c8d0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.763+0000 7fd231782640 1 -- 172.21.15.5:0/1281036305 shutdown_connections 2023-07-14T13:11:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.763+0000 7fd231782640 1 --2- 172.21.15.5:0/1281036305 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fd20c0663d0 0x7fd20c068880 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.763+0000 7fd231782640 1 --2- 172.21.15.5:0/1281036305 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd22c158ce0 0x7fd22c0ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.763+0000 7fd231782640 1 --2- 172.21.15.5:0/1281036305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd22c0c9730 0x7fd22c0ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.763+0000 7fd231782640 1 --2- 172.21.15.5:0/1281036305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd22c0c8ad0 0x7fd22c14d890 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.763+0000 7fd231782640 1 -- 172.21.15.5:0/1281036305 >> 172.21.15.5:0/1281036305 conn(0x7fd22c0afcf0 msgr2=0x7fd22c06ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.763+0000 7fd231782640 1 -- 172.21.15.5:0/1281036305 shutdown_connections 2023-07-14T13:11:39.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:39.763+0000 7fd231782640 1 -- 172.21.15.5:0/1281036305 wait complete. 2023-07-14T13:11:39.817 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-14T13:11:39.817 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T13:11:39.818 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-07-14T13:11:39.818 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-14T13:11:39.819 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-14T13:11:39.819 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-14T13:11:39.819 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-14T13:11:39.820 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T13:11:39.820 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T13:11:39.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:11:39.821 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-07-14T13:11:39.832 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T13:11:39.832 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T13:11:39.832 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T13:11:39.833 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:11:39.833 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-07-14T13:11:39.833 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:11:39.833 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T13:11:39.833 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-07-14T13:11:39.834 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2023-07-14T13:11:39.834 INFO:teuthology.orchestra.run.smithi005.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T13:11:39.834 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-07-14T13:11:39.834 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2023-07-14T13:11:39.834 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-14T13:11:39.835 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 41216sec preferred_lft 41216sec 2023-07-14T13:11:39.835 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-07-14T13:11:39.835 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:11:39.835 INFO:teuthology.orchestra.run.smithi005.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T13:11:39.835 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-07-14T13:11:39.836 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2023-07-14T13:11:39.836 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T13:11:39.836 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-07-14T13:11:39.836 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2023-07-14T13:11:39.837 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-14T13:11:39.837 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:96:b6:fb:c6 brd ff:ff:ff:ff:ff:ff 2023-07-14T13:11:39.837 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-14T13:11:39.837 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:11:39.837 INFO:teuthology.orchestra.run.smithi005.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T13:11:39.837 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-14T13:11:39.838 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T13:11:39.838 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:11:39.838 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-14T13:11:39.838 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:11:39.838 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T13:11:39.838 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T13:11:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-14T13:11:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:11:39.839 INFO:teuthology.orchestra.run.smithi005.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T13:11:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-14T13:11:39.839 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-14T13:11:39.840 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:11:39.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:11:39.841 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T13:11:39.894 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-07-14T13:11:39.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:11:39.896 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-07-14T13:11:39.951 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-07-14T13:11:39.952 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T13:11:39.952 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-14T13:11:39.952 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-14T13:11:39.952 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-14T13:11:39.952 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T13:11:39.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:11:39.953 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-07-14T13:11:39.954 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-07-14T13:11:39.954 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-14T13:11:39.954 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-14T13:11:39.955 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-14T13:11:39.955 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-07-14T13:11:40.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:11:40.048 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-07-14T13:11:40.058 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-14T13:11:40.058 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-14T13:11:40.058 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T13:11:40.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:11:40.059 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-07-14T13:11:40.127 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T13:11:40.128 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-14T13:11:40.182 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-14T13:11:40.182 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T13:11:40.183 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-14T13:11:40.234 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-14T13:11:40.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:11:40.235 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:11:40.330 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:11:40.330 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T13:11:40.330 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T13:11:40.345 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:11:40.346 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T13:11:40.346 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T13:11:40.346 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T13:11:40.346 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T13:11:40.353 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:11:40.354 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T13:11:40.354 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T13:11:40.354 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T13:11:40.354 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T13:11:40.354 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790" 2023-07-14T13:11:40.355 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790:/ 2023-07-14T13:11:40.355 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=22affb8d-e389-40f8-a764-dd40eb1759c8" will pass to kernel 2023-07-14T13:11:40.357 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T13:11:40.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:11:40.358 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-14T13:11:40.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:11:40.381 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T13:11:40.444 INFO:teuthology.orchestra.run.smithi005.stdout:client8433 2023-07-14T13:11:40.445 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:11:40.445 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:11:40.494 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-14T13:11:40.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.647+0000 7f3bf37d2640 1 Processor -- start 2023-07-14T13:11:40.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.651+0000 7f3bf37d2640 1 -- start start 2023-07-14T13:11:40.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.651+0000 7f3bf37d2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3bec0c8ad0 0x7f3bec0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:40.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.651+0000 7f3bf37d2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3bec0c9560 0x7f3bec0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:40.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.651+0000 7f3bf37d2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bec0c99c0 con 0x7f3bec158ce0 2023-07-14T13:11:40.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.651+0000 7f3bf37d2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bec0cc700 con 0x7f3bec0c8ad0 2023-07-14T13:11:40.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.651+0000 7f3bf37d2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bec0b0ff0 con 0x7f3bec0c9560 2023-07-14T13:11:40.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.651+0000 7f3bf156e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3bec158ce0 0x7f3bec070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56284/0 (socket says 172.21.15.5:56284) 2023-07-14T13:11:40.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.651+0000 7f3bf156e640 1 -- 172.21.15.5:0/1557297523 learned_addr learned my addr 172.21.15.5:0/1557297523 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:40.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.651+0000 7f3bf0d6d640 1 --2- 172.21.15.5:0/1557297523 >> v2:172.21.15.5:3300/0 conn(0x7f3bec0c8ad0 0x7f3bec0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:40.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.651+0000 7f3bf1d6f640 1 --2- 172.21.15.5:0/1557297523 >> v2:172.21.15.154:3300/0 conn(0x7f3bec0c9560 0x7f3bec0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:40.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.651+0000 7f3bf0d6d640 1 -- 172.21.15.5:0/1557297523 >> v2:172.21.15.154:3300/0 conn(0x7f3bec0c9560 msgr2=0x7f3bec0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:40.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.651+0000 7f3bf0d6d640 1 --2- 172.21.15.5:0/1557297523 >> v2:172.21.15.154:3300/0 conn(0x7f3bec0c9560 0x7f3bec0ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:40.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.651+0000 7f3bf0d6d640 1 -- 172.21.15.5:0/1557297523 >> v1:172.21.15.5:6789/0 conn(0x7f3bec158ce0 legacy=0x7f3bec070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:40.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.651+0000 7f3bf0d6d640 1 -- 172.21.15.5:0/1557297523 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bec070c80 con 0x7f3bec0c8ad0 2023-07-14T13:11:40.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.651+0000 7f3be3fff640 1 -- 172.21.15.5:0/1557297523 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649334544 0 0) 0x7f3bec0c99c0 con 0x7f3bec158ce0 2023-07-14T13:11:40.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.655+0000 7f3bf0d6d640 1 --2- 172.21.15.5:0/1557297523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bec0c8ad0 0x7f3bec0c9020 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f3bec0b0d70 tx=0x7f3bdc01c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a58724d600f0f94 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:40.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.655+0000 7f3be3fff640 1 -- 172.21.15.5:0/1557297523 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc0ac640 con 0x7f3bec0c8ad0 2023-07-14T13:11:40.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.655+0000 7f3be3fff640 1 -- 172.21.15.5:0/1557297523 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bdc0ac7a0 con 0x7f3bec0c8ad0 2023-07-14T13:11:40.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.655+0000 7f3be3fff640 1 -- 172.21.15.5:0/1557297523 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc0acb30 con 0x7f3bec0c8ad0 2023-07-14T13:11:40.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.655+0000 7f3bf37d2640 1 -- 172.21.15.5:0/1557297523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bec0c8ad0 msgr2=0x7f3bec0c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:40.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.655+0000 7f3bf37d2640 1 --2- 172.21.15.5:0/1557297523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bec0c8ad0 0x7f3bec0c9020 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f3bec0b0d70 tx=0x7f3bdc01c310 comp rx=0 tx=0).stop 2023-07-14T13:11:40.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.655+0000 7f3bf37d2640 1 -- 172.21.15.5:0/1557297523 shutdown_connections 2023-07-14T13:11:40.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.655+0000 7f3bf37d2640 1 --2- 172.21.15.5:0/1557297523 >> v2:172.21.15.154:3300/0 conn(0x7f3bec0c9560 0x7f3bec0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:40.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.655+0000 7f3bf37d2640 1 --2- 172.21.15.5:0/1557297523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bec0c8ad0 0x7f3bec0c9020 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:40.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.655+0000 7f3bf37d2640 1 -- 172.21.15.5:0/1557297523 >> 172.21.15.5:0/1557297523 conn(0x7f3bec0afcf0 msgr2=0x7f3bec0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:40.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.655+0000 7f3bf37d2640 1 -- 172.21.15.5:0/1557297523 shutdown_connections 2023-07-14T13:11:40.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.655+0000 7f3bf37d2640 1 -- 172.21.15.5:0/1557297523 wait complete. 2023-07-14T13:11:40.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.655+0000 7f3bf37d2640 1 Processor -- start 2023-07-14T13:11:40.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.659+0000 7f3bf37d2640 1 -- start start 2023-07-14T13:11:40.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.659+0000 7f3bf37d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bec0c8ad0 0x7f3bec152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:40.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.659+0000 7f3bf37d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bec0c9560 0x7f3bec146190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.659+0000 7f3bf37d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bec158ce0 0x7f3bec1442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.659+0000 7f3bf37d2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec1466d0 con 0x7f3bec158ce0 2023-07-14T13:11:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.659+0000 7f3bf37d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec0ab8a0 con 0x7f3bec0c8ad0 2023-07-14T13:11:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.659+0000 7f3bf37d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec0abb80 con 0x7f3bec0c9560 2023-07-14T13:11:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.659+0000 7f3bf1d6f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bec158ce0 0x7f3bec1442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.659+0000 7f3bf1d6f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bec158ce0 0x7f3bec1442e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40716/0 (socket says 172.21.15.5:40716) 2023-07-14T13:11:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.659+0000 7f3bf1d6f640 1 -- 172.21.15.5:0/2857667042 learned_addr learned my addr 172.21.15.5:0/2857667042 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.659+0000 7f3bf1d6f640 1 -- 172.21.15.5:0/2857667042 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bec0c9560 msgr2=0x7f3bec146190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:40.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.659+0000 7f3bf1d6f640 1 --2- 172.21.15.5:0/2857667042 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bec0c9560 0x7f3bec146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:40.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.659+0000 7f3bf1d6f640 1 -- 172.21.15.5:0/2857667042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bec0c8ad0 msgr2=0x7f3bec152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:40.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.659+0000 7f3bf1d6f640 1 --2- 172.21.15.5:0/2857667042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bec0c8ad0 0x7f3bec152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:40.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.659+0000 7f3bf1d6f640 1 -- 172.21.15.5:0/2857667042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc009420 con 0x7f3bec158ce0 2023-07-14T13:11:40.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.659+0000 7f3bf1d6f640 1 --2- 172.21.15.5:0/2857667042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bec158ce0 0x7f3bec1442e0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f3be400efc0 tx=0x7f3be400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:40.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.659+0000 7f3be1ffb640 1 -- 172.21.15.5:0/2857667042 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be4014480 con 0x7f3bec158ce0 2023-07-14T13:11:40.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.659+0000 7f3be1ffb640 1 -- 172.21.15.5:0/2857667042 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be400f040 con 0x7f3bec158ce0 2023-07-14T13:11:40.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.659+0000 7f3be1ffb640 1 -- 172.21.15.5:0/2857667042 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be4014820 con 0x7f3bec158ce0 2023-07-14T13:11:40.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.659+0000 7f3bf37d2640 1 -- 172.21.15.5:0/2857667042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bec152870 con 0x7f3bec158ce0 2023-07-14T13:11:40.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.659+0000 7f3bf37d2640 1 -- 172.21.15.5:0/2857667042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bec152e30 con 0x7f3bec158ce0 2023-07-14T13:11:40.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.659+0000 7f3bf37d2640 1 -- 172.21.15.5:0/2857667042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bec0ca1a0 con 0x7f3bec158ce0 2023-07-14T13:11:40.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.663+0000 7f3be1ffb640 1 -- 172.21.15.5:0/2857667042 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3be4014980 con 0x7f3bec158ce0 2023-07-14T13:11:40.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.663+0000 7f3be1ffb640 1 --2- 172.21.15.5:0/2857667042 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f3bd00663d0 0x7f3bd0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:40.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.663+0000 7f3be1ffb640 1 -- 172.21.15.5:0/2857667042 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3be4084b90 con 0x7f3bec158ce0 2023-07-14T13:11:40.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.663+0000 7f3bf156e640 1 --2- 172.21.15.5:0/2857667042 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f3bd00663d0 0x7f3bd0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:40.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.663+0000 7f3bf156e640 1 --2- 172.21.15.5:0/2857667042 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f3bd00663d0 0x7f3bd0068880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3be80015a0 tx=0x7f3be8007970 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.667+0000 7f3be1ffb640 1 -- 172.21.15.5:0/2857667042 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3be4051df0 con 0x7f3bec158ce0 2023-07-14T13:11:40.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.843+0000 7f3bf37d2640 1 -- 172.21.15.5:0/2857667042 --> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f3bec153020 con 0x7f3bd00663d0 2023-07-14T13:11:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.843+0000 7f3be1ffb640 1 -- 172.21.15.5:0/2857667042 <== mgr.7657 v2:172.21.15.154:6832/938367911 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f3bec153020 con 0x7f3bd00663d0 2023-07-14T13:11:40.878 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-07-14T13:11:40.878 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:11:40.878 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs" 2023-07-14T13:11:40.878 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:11:40.879 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-07-14T13:11:40.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.847+0000 7f3bf37d2640 1 -- 172.21.15.5:0/2857667042 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f3bd00663d0 msgr2=0x7f3bd0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:40.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.847+0000 7f3bf37d2640 1 --2- 172.21.15.5:0/2857667042 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f3bd00663d0 0x7f3bd0068880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3be80015a0 tx=0x7f3be8007970 comp rx=0 tx=0).stop 2023-07-14T13:11:40.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.847+0000 7f3bf37d2640 1 -- 172.21.15.5:0/2857667042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bec158ce0 msgr2=0x7f3bec1442e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:40.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.847+0000 7f3bf37d2640 1 --2- 172.21.15.5:0/2857667042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bec158ce0 0x7f3bec1442e0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f3be400efc0 tx=0x7f3be400c490 comp rx=0 tx=0).stop 2023-07-14T13:11:40.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.847+0000 7f3bf37d2640 1 -- 172.21.15.5:0/2857667042 shutdown_connections 2023-07-14T13:11:40.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.847+0000 7f3bf37d2640 1 --2- 172.21.15.5:0/2857667042 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f3bd00663d0 0x7f3bd0068880 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:40.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.847+0000 7f3bf37d2640 1 --2- 172.21.15.5:0/2857667042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bec158ce0 0x7f3bec1442e0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:40.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.847+0000 7f3bf37d2640 1 --2- 172.21.15.5:0/2857667042 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bec0c9560 0x7f3bec146190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:40.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.847+0000 7f3bf37d2640 1 --2- 172.21.15.5:0/2857667042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bec0c8ad0 0x7f3bec152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:40.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.847+0000 7f3bf37d2640 1 -- 172.21.15.5:0/2857667042 >> 172.21.15.5:0/2857667042 conn(0x7f3bec0afcf0 msgr2=0x7f3bec155770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:40.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.847+0000 7f3bf37d2640 1 -- 172.21.15.5:0/2857667042 shutdown_connections 2023-07-14T13:11:40.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:40.847+0000 7f3bf37d2640 1 -- 172.21.15.5:0/2857667042 wait complete. 2023-07-14T13:11:40.900 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-14T13:11:41.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffbaed9d640 1 Processor -- start 2023-07-14T13:11:41.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffbaed9d640 1 -- start start 2023-07-14T13:11:41.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffbaed9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffba806e700 0x7ffba806c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:41.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffbaed9d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba80c6140 con 0x7ffba80ce620 2023-07-14T13:11:41.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffbaed9d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba806dab0 con 0x7ffba815c050 2023-07-14T13:11:41.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffbaed9d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba806c3f0 con 0x7ffba806e700 2023-07-14T13:11:41.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffbacb39640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ffba80ce620 0x7ffba80ce9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56290/0 (socket says 172.21.15.5:56290) 2023-07-14T13:11:41.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffbacb39640 1 -- 172.21.15.5:0/3910762223 learned_addr learned my addr 172.21.15.5:0/3910762223 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:41.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffbad33a640 1 --2- 172.21.15.5:0/3910762223 >> v2:172.21.15.154:3300/0 conn(0x7ffba806e700 0x7ffba806c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:41.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffba77fe640 1 -- 172.21.15.5:0/3910762223 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 251687114 0 0) 0x7ffba80c6140 con 0x7ffba80ce620 2023-07-14T13:11:41.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffba77fe640 1 -- 172.21.15.5:0/3910762223 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb98003530 con 0x7ffba80ce620 2023-07-14T13:11:41.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffba77fe640 1 -- 172.21.15.5:0/3910762223 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1600122201 0 0) 0x7ffb98003530 con 0x7ffba80ce620 2023-07-14T13:11:41.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffba77fe640 1 -- 172.21.15.5:0/3910762223 >> v2:172.21.15.154:3300/0 conn(0x7ffba806e700 msgr2=0x7ffba806c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:41.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffba77fe640 1 --2- 172.21.15.5:0/3910762223 >> v2:172.21.15.154:3300/0 conn(0x7ffba806e700 0x7ffba806c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:41.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffba77fe640 1 -- 172.21.15.5:0/3910762223 >> v1:172.21.15.154:6789/0 conn(0x7ffba815c050 legacy=0x7ffba815f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:41.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffba77fe640 1 -- 172.21.15.5:0/3910762223 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba806dd90 con 0x7ffba80ce620 2023-07-14T13:11:41.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffba77fe640 1 -- 172.21.15.5:0/3910762223 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7ffb9c001680 con 0x7ffba80ce620 2023-07-14T13:11:41.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffba77fe640 1 -- 172.21.15.5:0/3910762223 >> v1:172.21.15.5:6789/0 conn(0x7ffba80ce620 legacy=0x7ffba80ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:41.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffba77fe640 1 --2- 172.21.15.5:0/3910762223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb98003980 0x7ffb98003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:41.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffba77fe640 1 --2- 172.21.15.5:0/3910762223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb980047d0 0x7ffb98004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:41.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffba77fe640 1 --2- 172.21.15.5:0/3910762223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb98005180 0x7ffb9800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:41.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffba77fe640 1 -- 172.21.15.5:0/3910762223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9800bfd0 con 0x7ffb98005180 2023-07-14T13:11:41.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffba77fe640 1 -- 172.21.15.5:0/3910762223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9800c140 con 0x7ffb980047d0 2023-07-14T13:11:41.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffba77fe640 1 -- 172.21.15.5:0/3910762223 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9800c300 con 0x7ffb98003980 2023-07-14T13:11:41.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffbad33a640 1 --2- 172.21.15.5:0/3910762223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb98005180 0x7ffb9800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:41.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffbacb39640 1 --2- 172.21.15.5:0/3910762223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb98003980 0x7ffb98003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffba7fff640 1 --2- 172.21.15.5:0/3910762223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb980047d0 0x7ffb98004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffbad33a640 1 -- 172.21.15.5:0/3910762223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb98003980 msgr2=0x7ffb98003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffbad33a640 1 --2- 172.21.15.5:0/3910762223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb98003980 0x7ffb98003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffbad33a640 1 -- 172.21.15.5:0/3910762223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb980047d0 msgr2=0x7ffb98004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffbad33a640 1 --2- 172.21.15.5:0/3910762223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb980047d0 0x7ffb98004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffbad33a640 1 -- 172.21.15.5:0/3910762223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb98003530 con 0x7ffb98005180 2023-07-14T13:11:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.015+0000 7ffbacb39640 1 --2- 172.21.15.5:0/3910762223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb98003980 0x7ffb98003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:11:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.019+0000 7ffbad33a640 1 -- 172.21.15.5:0/3910762223 reap_dead start 2023-07-14T13:11:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.019+0000 7ffbad33a640 1 --2- 172.21.15.5:0/3910762223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb98005180 0x7ffb9800b990 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009fc0 tx=0x7ffba001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af13e5634a24fa0a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.019+0000 7ffba77fe640 1 -- 172.21.15.5:0/3910762223 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba00a5cb0 con 0x7ffb98005180 2023-07-14T13:11:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.019+0000 7ffba77fe640 1 -- 172.21.15.5:0/3910762223 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba000f040 con 0x7ffb98005180 2023-07-14T13:11:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.019+0000 7ffba77fe640 1 -- 172.21.15.5:0/3910762223 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba0003be0 con 0x7ffb98005180 2023-07-14T13:11:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.019+0000 7ffbaed9d640 1 -- 172.21.15.5:0/3910762223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb98005180 msgr2=0x7ffb9800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.019+0000 7ffbaed9d640 1 --2- 172.21.15.5:0/3910762223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb98005180 0x7ffb9800b990 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009fc0 tx=0x7ffba001cca0 comp rx=0 tx=0).stop 2023-07-14T13:11:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.019+0000 7ffbaed9d640 1 -- 172.21.15.5:0/3910762223 shutdown_connections 2023-07-14T13:11:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.019+0000 7ffbaed9d640 1 --2- 172.21.15.5:0/3910762223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb98005180 0x7ffb9800b990 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.019+0000 7ffbaed9d640 1 -- 172.21.15.5:0/3910762223 >> 172.21.15.5:0/3910762223 conn(0x7ffba80cc9a0 msgr2=0x7ffba80cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.019+0000 7ffbaed9d640 1 -- 172.21.15.5:0/3910762223 shutdown_connections 2023-07-14T13:11:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.019+0000 7ffbaed9d640 1 -- 172.21.15.5:0/3910762223 wait complete. 2023-07-14T13:11:41.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.023+0000 7ffbaed9d640 1 Processor -- start 2023-07-14T13:11:41.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.023+0000 7ffbaed9d640 1 -- start start 2023-07-14T13:11:41.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.023+0000 7ffbaed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb98005180 0x7ffba81f1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:41.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.023+0000 7ffbaed9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffba81543b0 0x7ffba80c4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:41.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.023+0000 7ffbaed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffba81e1b40 0x7ffba81e1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:41.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.023+0000 7ffbaed9d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba8154820 con 0x7ffb98005180 2023-07-14T13:11:41.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.023+0000 7ffbaed9d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba81e24f0 con 0x7ffba81e1b40 2023-07-14T13:11:41.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.023+0000 7ffbaed9d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba80c5d00 con 0x7ffba81543b0 2023-07-14T13:11:41.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.023+0000 7ffbacb39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb98005180 0x7ffba81f1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:41.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.023+0000 7ffbacb39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb98005180 0x7ffba81f1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40732/0 (socket says 172.21.15.5:40732) 2023-07-14T13:11:41.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.023+0000 7ffbacb39640 1 -- 172.21.15.5:0/582533753 learned_addr learned my addr 172.21.15.5:0/582533753 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:41.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.023+0000 7ffba7fff640 1 --2- 172.21.15.5:0/582533753 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffba81543b0 0x7ffba80c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:41.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.023+0000 7ffbad33a640 1 --2- 172.21.15.5:0/582533753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffba81e1b40 0x7ffba81e1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:41.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.023+0000 7ffbacb39640 1 -- 172.21.15.5:0/582533753 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffba81543b0 msgr2=0x7ffba80c4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:41.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.023+0000 7ffbacb39640 1 --2- 172.21.15.5:0/582533753 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffba81543b0 0x7ffba80c4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:41.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.023+0000 7ffbacb39640 1 -- 172.21.15.5:0/582533753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffba81e1b40 msgr2=0x7ffba81e1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:41.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.023+0000 7ffbacb39640 1 --2- 172.21.15.5:0/582533753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffba81e1b40 0x7ffba81e1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:41.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.023+0000 7ffbacb39640 1 -- 172.21.15.5:0/582533753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba80c5180 con 0x7ffb98005180 2023-07-14T13:11:41.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.023+0000 7ffba7fff640 1 --2- 172.21.15.5:0/582533753 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffba81543b0 0x7ffba80c4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:11:41.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.023+0000 7ffbacb39640 1 --2- 172.21.15.5:0/582533753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb98005180 0x7ffba81f1f40 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c00e7e0 tx=0x7ffb9c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:41.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.023+0000 7ffba57fa640 1 -- 172.21.15.5:0/582533753 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c00ee90 con 0x7ffb98005180 2023-07-14T13:11:41.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.023+0000 7ffba57fa640 1 -- 172.21.15.5:0/582533753 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb9c00c8d0 con 0x7ffb98005180 2023-07-14T13:11:41.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.023+0000 7ffba57fa640 1 -- 172.21.15.5:0/582533753 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c00cc60 con 0x7ffb98005180 2023-07-14T13:11:41.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.023+0000 7ffbaed9d640 1 -- 172.21.15.5:0/582533753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba80c5460 con 0x7ffb98005180 2023-07-14T13:11:41.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.023+0000 7ffbaed9d640 1 -- 172.21.15.5:0/582533753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba80c5a20 con 0x7ffb98005180 2023-07-14T13:11:41.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.027+0000 7ffbaed9d640 1 -- 172.21.15.5:0/582533753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba80c2e50 con 0x7ffb98005180 2023-07-14T13:11:41.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.027+0000 7ffba57fa640 1 -- 172.21.15.5:0/582533753 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 53) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ffb9c01d460 con 0x7ffb98005180 2023-07-14T13:11:41.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.027+0000 7ffba57fa640 1 --2- 172.21.15.5:0/582533753 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7ffb8c0663a0 0x7ffb8c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:41.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.027+0000 7ffba57fa640 1 -- 172.21.15.5:0/582533753 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffb9c083df0 con 0x7ffb98005180 2023-07-14T13:11:41.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.027+0000 7ffba7fff640 1 --2- 172.21.15.5:0/582533753 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7ffb8c0663a0 0x7ffb8c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:41.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.027+0000 7ffba7fff640 1 --2- 172.21.15.5:0/582533753 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7ffb8c0663a0 0x7ffb8c068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffba80b52e0 tx=0x7ffb94009040 comp rx=0 tx=0).ready entity=mgr.7657 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:41.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.031+0000 7ffba57fa640 1 -- 172.21.15.5:0/582533753 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ffba80c2e50 con 0x7ffb98005180 2023-07-14T13:11:41.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.227+0000 7ffbaed9d640 1 -- 172.21.15.5:0/582533753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7ffba80c2e50 con 0x7ffb98005180 2023-07-14T13:11:41.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.787+0000 7ffba57fa640 1 -- 172.21.15.5:0/582533753 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 54) v1 ==== 85777+0+0 (secure 0 0 0) 0x7ffb9c051520 con 0x7ffb98005180 2023-07-14T13:11:41.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.787+0000 7ffba57fa640 1 -- 172.21.15.5:0/582533753 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v54) v1 ==== 92+0+0 (secure 0 0 0) 0x7ffb9c051150 con 0x7ffb98005180 2023-07-14T13:11:41.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.791+0000 7ffbaed9d640 1 -- 172.21.15.5:0/582533753 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7ffb8c0663a0 msgr2=0x7ffb8c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:41.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.791+0000 7ffbaed9d640 1 --2- 172.21.15.5:0/582533753 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7ffb8c0663a0 0x7ffb8c068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffba80b52e0 tx=0x7ffb94009040 comp rx=0 tx=0).stop 2023-07-14T13:11:41.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.791+0000 7ffbaed9d640 1 -- 172.21.15.5:0/582533753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb98005180 msgr2=0x7ffba81f1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:41.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.791+0000 7ffbaed9d640 1 --2- 172.21.15.5:0/582533753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb98005180 0x7ffba81f1f40 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c00e7e0 tx=0x7ffb9c00eca0 comp rx=0 tx=0).stop 2023-07-14T13:11:41.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.791+0000 7ffbaed9d640 1 -- 172.21.15.5:0/582533753 shutdown_connections 2023-07-14T13:11:41.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.791+0000 7ffbaed9d640 1 --2- 172.21.15.5:0/582533753 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7ffb8c0663a0 0x7ffb8c068850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:41.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.791+0000 7ffbaed9d640 1 --2- 172.21.15.5:0/582533753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffba81e1b40 0x7ffba81e1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:41.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.791+0000 7ffbaed9d640 1 --2- 172.21.15.5:0/582533753 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffba81543b0 0x7ffba80c4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:41.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.791+0000 7ffbaed9d640 1 --2- 172.21.15.5:0/582533753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb98005180 0x7ffba81f1f40 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:41.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.791+0000 7ffbaed9d640 1 -- 172.21.15.5:0/582533753 >> 172.21.15.5:0/582533753 conn(0x7ffba80cc9a0 msgr2=0x7ffba80ac010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:41.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.791+0000 7ffbaed9d640 1 -- 172.21.15.5:0/582533753 shutdown_connections 2023-07-14T13:11:41.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.791+0000 7ffbaed9d640 1 -- 172.21.15.5:0/582533753 wait complete. 2023-07-14T13:11:41.845 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-14T13:11:41.994 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:41.959+0000 7f6c59a0a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:11:41.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.963+0000 7fc13c20b640 1 Processor -- start 2023-07-14T13:11:41.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.963+0000 7fc13c20b640 1 -- start start 2023-07-14T13:11:41.998 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:41.967+0000 7f0b460e9180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:11:41.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.967+0000 7fc13c20b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc134069430 0x7fc134069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.967+0000 7fc13c20b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc134070f30 0x7fc1340ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.967+0000 7fc13c20b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc134159d70 con 0x7fc1340af2b0 2023-07-14T13:11:42.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.967+0000 7fc13c20b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc134069d40 con 0x7fc134069430 2023-07-14T13:11:42.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.967+0000 7fc13c20b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1340c9c60 con 0x7fc134070f30 2023-07-14T13:11:42.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.967+0000 7fc139fa7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc134069430 0x7fc134069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.967+0000 7fc139fa7640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc134069430 0x7fc134069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40752/0 (socket says 172.21.15.5:40752) 2023-07-14T13:11:42.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.967+0000 7fc139fa7640 1 -- 172.21.15.5:0/2387799646 learned_addr learned my addr 172.21.15.5:0/2387799646 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:42.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.967+0000 7fc1397a6640 1 --2- 172.21.15.5:0/2387799646 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc134070f30 0x7fc1340ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.967+0000 7fc139fa7640 1 -- 172.21.15.5:0/2387799646 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc134070f30 msgr2=0x7fc1340ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:42.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.967+0000 7fc139fa7640 1 --2- 172.21.15.5:0/2387799646 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc134070f30 0x7fc1340ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.967+0000 7fc139fa7640 1 -- 172.21.15.5:0/2387799646 >> v1:172.21.15.154:6789/0 conn(0x7fc1340af2b0 legacy=0x7fc13415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:42.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.967+0000 7fc139fa7640 1 -- 172.21.15.5:0/2387799646 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1340c9f40 con 0x7fc134069430 2023-07-14T13:11:42.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.971+0000 7fc139fa7640 1 --2- 172.21.15.5:0/2387799646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc134069430 0x7fc134069800 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fc130009870 tx=0x7fc13001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e707e81c54132b35 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:42.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.971+0000 7fc138fa5640 1 -- 172.21.15.5:0/2387799646 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1300ab650 con 0x7fc134069430 2023-07-14T13:11:42.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.971+0000 7fc138fa5640 1 -- 172.21.15.5:0/2387799646 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1300ab7b0 con 0x7fc134069430 2023-07-14T13:11:42.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.971+0000 7fc138fa5640 1 -- 172.21.15.5:0/2387799646 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1300abb40 con 0x7fc134069430 2023-07-14T13:11:42.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.971+0000 7fc13c20b640 1 -- 172.21.15.5:0/2387799646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc134069430 msgr2=0x7fc134069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:42.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.971+0000 7fc13c20b640 1 --2- 172.21.15.5:0/2387799646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc134069430 0x7fc134069800 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fc130009870 tx=0x7fc13001c540 comp rx=0 tx=0).stop 2023-07-14T13:11:42.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.971+0000 7fc13c20b640 1 -- 172.21.15.5:0/2387799646 shutdown_connections 2023-07-14T13:11:42.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.971+0000 7fc13c20b640 1 --2- 172.21.15.5:0/2387799646 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc134070f30 0x7fc1340ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.971+0000 7fc13c20b640 1 --2- 172.21.15.5:0/2387799646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc134069430 0x7fc134069800 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.971+0000 7fc13c20b640 1 -- 172.21.15.5:0/2387799646 >> 172.21.15.5:0/2387799646 conn(0x7fc1340cde90 msgr2=0x7fc1340ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:42.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.971+0000 7fc13c20b640 1 -- 172.21.15.5:0/2387799646 shutdown_connections 2023-07-14T13:11:42.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.971+0000 7fc13c20b640 1 -- 172.21.15.5:0/2387799646 wait complete. 2023-07-14T13:11:42.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.971+0000 7fc13c20b640 1 Processor -- start 2023-07-14T13:11:42.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.971+0000 7fc13c20b640 1 -- start start 2023-07-14T13:11:42.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.975+0000 7fc13c20b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc134069430 0x7fc134159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.975+0000 7fc13c20b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc134070f30 0x7fc1340ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.975+0000 7fc13c20b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1340af2b0 0x7fc134152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.975+0000 7fc13c20b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc134157000 con 0x7fc1340af2b0 2023-07-14T13:11:42.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.975+0000 7fc13c20b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1340acb80 con 0x7fc134069430 2023-07-14T13:11:42.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.975+0000 7fc13c20b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1340ac8a0 con 0x7fc134070f30 2023-07-14T13:11:42.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.975+0000 7fc13a7a8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1340af2b0 0x7fc134152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.975+0000 7fc13a7a8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1340af2b0 0x7fc134152410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40756/0 (socket says 172.21.15.5:40756) 2023-07-14T13:11:42.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.975+0000 7fc13a7a8640 1 -- 172.21.15.5:0/685872682 learned_addr learned my addr 172.21.15.5:0/685872682 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:42.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.975+0000 7fc1397a6640 1 --2- 172.21.15.5:0/685872682 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc134070f30 0x7fc1340ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.975+0000 7fc139fa7640 1 --2- 172.21.15.5:0/685872682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc134069430 0x7fc134159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.975+0000 7fc13a7a8640 1 -- 172.21.15.5:0/685872682 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc134070f30 msgr2=0x7fc1340ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:42.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.975+0000 7fc13a7a8640 1 --2- 172.21.15.5:0/685872682 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc134070f30 0x7fc1340ac1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.975+0000 7fc13a7a8640 1 -- 172.21.15.5:0/685872682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc134069430 msgr2=0x7fc134159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:42.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.975+0000 7fc13a7a8640 1 --2- 172.21.15.5:0/685872682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc134069430 0x7fc134159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.975+0000 7fc13a7a8640 1 -- 172.21.15.5:0/685872682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1300094d0 con 0x7fc1340af2b0 2023-07-14T13:11:42.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.975+0000 7fc13a7a8640 1 --2- 172.21.15.5:0/685872682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1340af2b0 0x7fc134152410 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fc12c00c770 tx=0x7fc12c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:42.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.975+0000 7fc12a7fc640 1 -- 172.21.15.5:0/685872682 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c003b80 con 0x7fc1340af2b0 2023-07-14T13:11:42.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.975+0000 7fc12a7fc640 1 -- 172.21.15.5:0/685872682 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12c003ce0 con 0x7fc1340af2b0 2023-07-14T13:11:42.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.975+0000 7fc12a7fc640 1 -- 172.21.15.5:0/685872682 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c00aa90 con 0x7fc1340af2b0 2023-07-14T13:11:42.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.975+0000 7fc13c20b640 1 -- 172.21.15.5:0/685872682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc134156520 con 0x7fc1340af2b0 2023-07-14T13:11:42.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.975+0000 7fc13c20b640 1 -- 172.21.15.5:0/685872682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc134156ae0 con 0x7fc1340af2b0 2023-07-14T13:11:42.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.975+0000 7fc13c20b640 1 -- 172.21.15.5:0/685872682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1340678d0 con 0x7fc1340af2b0 2023-07-14T13:11:42.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.979+0000 7fc12a7fc640 1 -- 172.21.15.5:0/685872682 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 54) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fc12c00abf0 con 0x7fc1340af2b0 2023-07-14T13:11:42.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.979+0000 7fc12a7fc640 1 --2- 172.21.15.5:0/685872682 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fc1180663f0 0x7fc1180688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.979+0000 7fc12a7fc640 1 -- 172.21.15.5:0/685872682 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc12c083ae0 con 0x7fc1340af2b0 2023-07-14T13:11:42.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.979+0000 7fc139fa7640 1 -- 172.21.15.5:0/685872682 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fc1180663f0 msgr2=0x7fc1180688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/938367911 2023-07-14T13:11:42.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.979+0000 7fc139fa7640 1 --2- 172.21.15.5:0/685872682 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fc1180663f0 0x7fc1180688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:11:42.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:41.983+0000 7fc12a7fc640 1 -- 172.21.15.5:0/685872682 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc12c050ef0 con 0x7fc1340af2b0 2023-07-14T13:11:42.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.139+0000 7fc13c20b640 1 -- 172.21.15.5:0/685872682 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fc134159d70 con 0x7fc1340af2b0 2023-07-14T13:11:42.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.147+0000 7fc12a7fc640 1 -- 172.21.15.5:0/685872682 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v41)=0 v41) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc134159d70 con 0x7fc1340af2b0 2023-07-14T13:11:42.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.147+0000 7fc13c20b640 1 -- 172.21.15.5:0/685872682 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fc1180663f0 msgr2=0x7fc1180688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:11:42.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.147+0000 7fc13c20b640 1 --2- 172.21.15.5:0/685872682 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fc1180663f0 0x7fc1180688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.147+0000 7fc13c20b640 1 -- 172.21.15.5:0/685872682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1340af2b0 msgr2=0x7fc134152410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:42.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.147+0000 7fc13c20b640 1 --2- 172.21.15.5:0/685872682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1340af2b0 0x7fc134152410 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fc12c00c770 tx=0x7fc12c00cc30 comp rx=0 tx=0).stop 2023-07-14T13:11:42.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.147+0000 7fc13c20b640 1 -- 172.21.15.5:0/685872682 shutdown_connections 2023-07-14T13:11:42.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.147+0000 7fc13c20b640 1 --2- 172.21.15.5:0/685872682 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fc1180663f0 0x7fc1180688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.147+0000 7fc13c20b640 1 --2- 172.21.15.5:0/685872682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1340af2b0 0x7fc134152410 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.147+0000 7fc13c20b640 1 --2- 172.21.15.5:0/685872682 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc134070f30 0x7fc1340ac1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.147+0000 7fc13c20b640 1 --2- 172.21.15.5:0/685872682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc134069430 0x7fc134159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.147+0000 7fc13c20b640 1 -- 172.21.15.5:0/685872682 >> 172.21.15.5:0/685872682 conn(0x7fc1340cde90 msgr2=0x7fc1341580d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:42.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.147+0000 7fc13c20b640 1 -- 172.21.15.5:0/685872682 shutdown_connections 2023-07-14T13:11:42.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.147+0000 7fc13c20b640 1 -- 172.21.15.5:0/685872682 wait complete. 2023-07-14T13:11:42.200 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-14T13:11:42.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.315+0000 7f68d6d37640 1 Processor -- start 2023-07-14T13:11:42.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.315+0000 7f68d6d37640 1 -- start start 2023-07-14T13:11:42.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.315+0000 7f68d6d37640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f68d015bde0 0x7f68d00d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.315+0000 7f68d6d37640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68d00d2fc0 0x7f68d00b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.315+0000 7f68d6d37640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f68d00d2300 0x7f68d00d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.315+0000 7f68d6d37640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d00d2ce0 con 0x7f68d015bde0 2023-07-14T13:11:42.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.315+0000 7f68d6d37640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d015c1b0 con 0x7f68d00d2300 2023-07-14T13:11:42.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.315+0000 7f68d6d37640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d00b04c0 con 0x7f68d00d2fc0 2023-07-14T13:11:42.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.315+0000 7f68d4ad3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f68d015bde0 0x7f68d00d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.315+0000 7f68d4ad3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f68d015bde0 0x7f68d00d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40764/0 (socket says 172.21.15.5:40764) 2023-07-14T13:11:42.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.315+0000 7f68d4ad3640 1 -- 172.21.15.5:0/3078369573 learned_addr learned my addr 172.21.15.5:0/3078369573 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:42.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.319+0000 7f68cffff640 1 --2- 172.21.15.5:0/3078369573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68d00d2fc0 0x7f68d00b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.319+0000 7f68d52d4640 1 --2- 172.21.15.5:0/3078369573 >> v2:172.21.15.154:3300/0 conn(0x7f68d00d2300 0x7f68d00d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.319+0000 7f68d4ad3640 1 -- 172.21.15.5:0/3078369573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68d00d2fc0 msgr2=0x7f68d00b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:42.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.319+0000 7f68d4ad3640 1 --2- 172.21.15.5:0/3078369573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68d00d2fc0 0x7f68d00b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.319+0000 7f68d4ad3640 1 -- 172.21.15.5:0/3078369573 >> v2:172.21.15.154:3300/0 conn(0x7f68d00d2300 msgr2=0x7f68d00d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:42.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.319+0000 7f68d4ad3640 1 --2- 172.21.15.5:0/3078369573 >> v2:172.21.15.154:3300/0 conn(0x7f68d00d2300 0x7f68d00d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.319+0000 7f68d4ad3640 1 -- 172.21.15.5:0/3078369573 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d00d0aa0 con 0x7f68d015bde0 2023-07-14T13:11:42.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.319+0000 7f68cffff640 1 --2- 172.21.15.5:0/3078369573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68d00d2fc0 0x7f68d00b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:11:42.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.319+0000 7f68d52d4640 1 --2- 172.21.15.5:0/3078369573 >> v2:172.21.15.154:3300/0 conn(0x7f68d00d2300 0x7f68d00d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:11:42.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.319+0000 7f68d4ad3640 1 --2- 172.21.15.5:0/3078369573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68d015bde0 0x7f68d00d0270 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f68d00b83f0 tx=0x7f68c401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1268e83e012b3075 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:42.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.319+0000 7f68cf7fe640 1 -- 172.21.15.5:0/3078369573 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c40aa620 con 0x7f68d015bde0 2023-07-14T13:11:42.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.319+0000 7f68cf7fe640 1 -- 172.21.15.5:0/3078369573 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c40aa780 con 0x7f68d015bde0 2023-07-14T13:11:42.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.319+0000 7f68cf7fe640 1 -- 172.21.15.5:0/3078369573 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c40aab10 con 0x7f68d015bde0 2023-07-14T13:11:42.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.323+0000 7f68d6d37640 1 -- 172.21.15.5:0/3078369573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68d015bde0 msgr2=0x7f68d00d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:42.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.323+0000 7f68d6d37640 1 --2- 172.21.15.5:0/3078369573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68d015bde0 0x7f68d00d0270 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f68d00b83f0 tx=0x7f68c401c500 comp rx=0 tx=0).stop 2023-07-14T13:11:42.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.323+0000 7f68d6d37640 1 -- 172.21.15.5:0/3078369573 shutdown_connections 2023-07-14T13:11:42.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.323+0000 7f68d6d37640 1 --2- 172.21.15.5:0/3078369573 >> v2:172.21.15.154:3300/0 conn(0x7f68d00d2300 0x7f68d00d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.323+0000 7f68d6d37640 1 --2- 172.21.15.5:0/3078369573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68d00d2fc0 0x7f68d00b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.323+0000 7f68d6d37640 1 --2- 172.21.15.5:0/3078369573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68d015bde0 0x7f68d00d0270 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.323+0000 7f68d6d37640 1 -- 172.21.15.5:0/3078369573 >> 172.21.15.5:0/3078369573 conn(0x7f68d00659d0 msgr2=0x7f68d009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:42.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.323+0000 7f68d6d37640 1 -- 172.21.15.5:0/3078369573 shutdown_connections 2023-07-14T13:11:42.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.323+0000 7f68d6d37640 1 -- 172.21.15.5:0/3078369573 wait complete. 2023-07-14T13:11:42.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.323+0000 7f68d6d37640 1 Processor -- start 2023-07-14T13:11:42.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.323+0000 7f68d6d37640 1 -- start start 2023-07-14T13:11:42.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.323+0000 7f68d6d37640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68d00d2300 0x7f68d015ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.323+0000 7f68d6d37640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68d00d2fc0 0x7f68d00b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.323+0000 7f68d6d37640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68d015bde0 0x7f68d0152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.323+0000 7f68d6d37640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d00c9540 con 0x7f68d00d2300 2023-07-14T13:11:42.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.323+0000 7f68d6d37640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d0152d10 con 0x7f68d015bde0 2023-07-14T13:11:42.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.323+0000 7f68d6d37640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d00b60f0 con 0x7f68d00d2fc0 2023-07-14T13:11:42.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.323+0000 7f68d4ad3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68d00d2300 0x7f68d015ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.323+0000 7f68d4ad3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68d00d2300 0x7f68d015ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40774/0 (socket says 172.21.15.5:40774) 2023-07-14T13:11:42.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.323+0000 7f68d4ad3640 1 -- 172.21.15.5:0/3764140708 learned_addr learned my addr 172.21.15.5:0/3764140708 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:42.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.323+0000 7f68d52d4640 1 --2- 172.21.15.5:0/3764140708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68d015bde0 0x7f68d0152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.323+0000 7f68cffff640 1 --2- 172.21.15.5:0/3764140708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68d00d2fc0 0x7f68d00b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.327+0000 7f68d4ad3640 1 -- 172.21.15.5:0/3764140708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68d00d2fc0 msgr2=0x7f68d00b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:42.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.327+0000 7f68d4ad3640 1 --2- 172.21.15.5:0/3764140708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68d00d2fc0 0x7f68d00b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.327+0000 7f68d4ad3640 1 -- 172.21.15.5:0/3764140708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68d015bde0 msgr2=0x7f68d0152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:42.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.327+0000 7f68d4ad3640 1 --2- 172.21.15.5:0/3764140708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68d015bde0 0x7f68d0152540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.327+0000 7f68d4ad3640 1 -- 172.21.15.5:0/3764140708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c4009470 con 0x7f68d00d2300 2023-07-14T13:11:42.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.327+0000 7f68d52d4640 1 --2- 172.21.15.5:0/3764140708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68d015bde0 0x7f68d0152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:11:42.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.327+0000 7f68d4ad3640 1 --2- 172.21.15.5:0/3764140708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68d00d2300 0x7f68d015ed30 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f68c40ac040 tx=0x7f68c401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:42.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.327+0000 7f68cd7fa640 1 -- 172.21.15.5:0/3764140708 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c40bd3f0 con 0x7f68d00d2300 2023-07-14T13:11:42.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.327+0000 7f68cd7fa640 1 -- 172.21.15.5:0/3764140708 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c40bd570 con 0x7f68d00d2300 2023-07-14T13:11:42.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.327+0000 7f68cd7fa640 1 -- 172.21.15.5:0/3764140708 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c40bd920 con 0x7f68d00d2300 2023-07-14T13:11:42.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.327+0000 7f68d6d37640 1 -- 172.21.15.5:0/3764140708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d00b6370 con 0x7f68d00d2300 2023-07-14T13:11:42.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.327+0000 7f68d6d37640 1 -- 172.21.15.5:0/3764140708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d0153240 con 0x7f68d00d2300 2023-07-14T13:11:42.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.327+0000 7f68d6d37640 1 -- 172.21.15.5:0/3764140708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d00678d0 con 0x7f68d00d2300 2023-07-14T13:11:42.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.327+0000 7f68cd7fa640 1 -- 172.21.15.5:0/3764140708 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 54) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f68c40b33f0 con 0x7f68d00d2300 2023-07-14T13:11:42.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.327+0000 7f68cd7fa640 1 --2- 172.21.15.5:0/3764140708 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f68b40663f0 0x7f68b40688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.331+0000 7f68cd7fa640 1 -- 172.21.15.5:0/3764140708 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f68c411e340 con 0x7f68d00d2300 2023-07-14T13:11:42.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.331+0000 7f68cffff640 1 -- 172.21.15.5:0/3764140708 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f68b40663f0 msgr2=0x7f68b40688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/938367911 2023-07-14T13:11:42.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.331+0000 7f68cffff640 1 --2- 172.21.15.5:0/3764140708 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f68b40663f0 0x7f68b40688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:11:42.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.335+0000 7f68cd7fa640 1 -- 172.21.15.5:0/3764140708 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f68c40eb770 con 0x7f68d00d2300 2023-07-14T13:11:42.412 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:42.379+0000 7f6c59a0a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:11:42.451 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:42.419+0000 7f0b460e9180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:11:42.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.495+0000 7f68d6d37640 1 -- 172.21.15.5:0/3764140708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f68d00d0780 con 0x7f68d00d2300 2023-07-14T13:11:42.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.503+0000 7f68cd7fa640 1 -- 172.21.15.5:0/3764140708 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v42)=0 v42) v1 ==== 133+0+0 (secure 0 0 0) 0x7f68c40eed90 con 0x7f68d00d2300 2023-07-14T13:11:42.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.503+0000 7f68d6d37640 1 -- 172.21.15.5:0/3764140708 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f68b40663f0 msgr2=0x7f68b40688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:11:42.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.503+0000 7f68d6d37640 1 --2- 172.21.15.5:0/3764140708 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f68b40663f0 0x7f68b40688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.503+0000 7f68d6d37640 1 -- 172.21.15.5:0/3764140708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68d00d2300 msgr2=0x7f68d015ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:42.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.503+0000 7f68d6d37640 1 --2- 172.21.15.5:0/3764140708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68d00d2300 0x7f68d015ed30 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f68c40ac040 tx=0x7f68c401ad40 comp rx=0 tx=0).stop 2023-07-14T13:11:42.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.503+0000 7f68d6d37640 1 -- 172.21.15.5:0/3764140708 shutdown_connections 2023-07-14T13:11:42.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.503+0000 7f68d6d37640 1 --2- 172.21.15.5:0/3764140708 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7f68b40663f0 0x7f68b40688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.503+0000 7f68d6d37640 1 --2- 172.21.15.5:0/3764140708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68d015bde0 0x7f68d0152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.503+0000 7f68d6d37640 1 --2- 172.21.15.5:0/3764140708 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68d00d2fc0 0x7f68d00b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.503+0000 7f68d6d37640 1 --2- 172.21.15.5:0/3764140708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68d00d2300 0x7f68d015ed30 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.503+0000 7f68d6d37640 1 -- 172.21.15.5:0/3764140708 >> 172.21.15.5:0/3764140708 conn(0x7f68d00659d0 msgr2=0x7f68d006b480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:42.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.503+0000 7f68d6d37640 1 -- 172.21.15.5:0/3764140708 shutdown_connections 2023-07-14T13:11:42.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.503+0000 7f68d6d37640 1 -- 172.21.15.5:0/3764140708 wait complete. 2023-07-14T13:11:42.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:11:42.558 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-14T13:11:42.564 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:42.531+0000 7f6c59a0a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:11:42.574 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-07-14T13:11:42.614 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:42.579+0000 7f0b460e9180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:11:42.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.731+0000 7fc881b96640 1 Processor -- start 2023-07-14T13:11:42.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.731+0000 7fc881b96640 1 -- start start 2023-07-14T13:11:42.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.731+0000 7fc881b96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc87c15bde0 0x7fc87c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.731+0000 7fc881b96640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc87c0d2fc0 0x7fc87c0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.731+0000 7fc881b96640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc87c0b04c0 con 0x7fc87c0d2300 2023-07-14T13:11:42.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.731+0000 7fc881b96640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc87c15c1b0 con 0x7fc87c0d2fc0 2023-07-14T13:11:42.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.731+0000 7fc881b96640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c0d0aa0 con 0x7fc87c15bde0 2023-07-14T13:11:42.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.731+0000 7fc87bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc87c0d2300 0x7fc87c0cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:56302/0 (socket says 172.21.15.5:56302) 2023-07-14T13:11:42.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.731+0000 7fc87bfff640 1 -- 172.21.15.5:0/1300746239 learned_addr learned my addr 172.21.15.5:0/1300746239 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:11:42.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.731+0000 7fc87affd640 1 --2- 172.21.15.5:0/1300746239 >> v2:172.21.15.154:3300/0 conn(0x7fc87c0d2fc0 0x7fc87c0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.731+0000 7fc87b7fe640 1 --2- 172.21.15.5:0/1300746239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc87c15bde0 0x7fc87c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.731+0000 7fc87a7fc640 1 -- 172.21.15.5:0/1300746239 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195034812 0 0) 0x7fc87c0b04c0 con 0x7fc87c0d2300 2023-07-14T13:11:42.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.731+0000 7fc87a7fc640 1 -- 172.21.15.5:0/1300746239 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc864003530 con 0x7fc87c0d2300 2023-07-14T13:11:42.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.731+0000 7fc87b7fe640 1 -- 172.21.15.5:0/1300746239 >> v2:172.21.15.154:3300/0 conn(0x7fc87c0d2fc0 msgr2=0x7fc87c0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:42.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.731+0000 7fc87b7fe640 1 --2- 172.21.15.5:0/1300746239 >> v2:172.21.15.154:3300/0 conn(0x7fc87c0d2fc0 0x7fc87c0b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.731+0000 7fc87b7fe640 1 -- 172.21.15.5:0/1300746239 >> v1:172.21.15.5:6789/0 conn(0x7fc87c0d2300 legacy=0x7fc87c0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:42.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.731+0000 7fc87b7fe640 1 -- 172.21.15.5:0/1300746239 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87c0afb90 con 0x7fc87c15bde0 2023-07-14T13:11:42.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.735+0000 7fc87b7fe640 1 --2- 172.21.15.5:0/1300746239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc87c15bde0 0x7fc87c0d0270 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc86c0097a0 tx=0x7fc86c01c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7815a588c9f8b806 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:42.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.735+0000 7fc87a7fc640 1 -- 172.21.15.5:0/1300746239 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c0ab660 con 0x7fc87c15bde0 2023-07-14T13:11:42.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.735+0000 7fc87a7fc640 1 -- 172.21.15.5:0/1300746239 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86c0ab7c0 con 0x7fc87c15bde0 2023-07-14T13:11:42.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.735+0000 7fc87a7fc640 1 -- 172.21.15.5:0/1300746239 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c0abb50 con 0x7fc87c15bde0 2023-07-14T13:11:42.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.735+0000 7fc881b96640 1 -- 172.21.15.5:0/1300746239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc87c15bde0 msgr2=0x7fc87c0d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:42.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.735+0000 7fc881b96640 1 --2- 172.21.15.5:0/1300746239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc87c15bde0 0x7fc87c0d0270 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc86c0097a0 tx=0x7fc86c01c460 comp rx=0 tx=0).stop 2023-07-14T13:11:42.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.735+0000 7fc881b96640 1 -- 172.21.15.5:0/1300746239 shutdown_connections 2023-07-14T13:11:42.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.735+0000 7fc881b96640 1 --2- 172.21.15.5:0/1300746239 >> v2:172.21.15.154:3300/0 conn(0x7fc87c0d2fc0 0x7fc87c0b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.735+0000 7fc881b96640 1 --2- 172.21.15.5:0/1300746239 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc87c15bde0 0x7fc87c0d0270 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.735+0000 7fc881b96640 1 -- 172.21.15.5:0/1300746239 >> 172.21.15.5:0/1300746239 conn(0x7fc87c0659d0 msgr2=0x7fc87c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:42.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.735+0000 7fc881b96640 1 -- 172.21.15.5:0/1300746239 shutdown_connections 2023-07-14T13:11:42.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.735+0000 7fc881b96640 1 -- 172.21.15.5:0/1300746239 wait complete. 2023-07-14T13:11:42.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.739+0000 7fc881b96640 1 Processor -- start 2023-07-14T13:11:42.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.739+0000 7fc881b96640 1 -- start start 2023-07-14T13:11:42.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.739+0000 7fc881b96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc87c0d2300 0x7fc87c154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.739+0000 7fc881b96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc87c0d2fc0 0x7fc87c154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.739+0000 7fc881b96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc87c15bde0 0x7fc87c15e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.739+0000 7fc881b96640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c0b5be0 con 0x7fc87c0d2300 2023-07-14T13:11:42.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.739+0000 7fc881b96640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c15f180 con 0x7fc87c15bde0 2023-07-14T13:11:42.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.739+0000 7fc881b96640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c0b52b0 con 0x7fc87c0d2fc0 2023-07-14T13:11:42.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.739+0000 7fc87b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc87c0d2300 0x7fc87c154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.739+0000 7fc87b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc87c0d2300 0x7fc87c154a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40784/0 (socket says 172.21.15.5:40784) 2023-07-14T13:11:42.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.739+0000 7fc87b7fe640 1 -- 172.21.15.5:0/3226297947 learned_addr learned my addr 172.21.15.5:0/3226297947 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:42.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.739+0000 7fc87affd640 1 --2- 172.21.15.5:0/3226297947 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc87c0d2fc0 0x7fc87c154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.739+0000 7fc87bfff640 1 --2- 172.21.15.5:0/3226297947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc87c15bde0 0x7fc87c15e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.739+0000 7fc87b7fe640 1 -- 172.21.15.5:0/3226297947 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc87c0d2fc0 msgr2=0x7fc87c154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:42.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.739+0000 7fc87b7fe640 1 --2- 172.21.15.5:0/3226297947 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc87c0d2fc0 0x7fc87c154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.739+0000 7fc87b7fe640 1 -- 172.21.15.5:0/3226297947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc87c15bde0 msgr2=0x7fc87c15e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:42.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.739+0000 7fc87b7fe640 1 --2- 172.21.15.5:0/3226297947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc87c15bde0 0x7fc87c15e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.739+0000 7fc87b7fe640 1 -- 172.21.15.5:0/3226297947 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86c0093b0 con 0x7fc87c0d2300 2023-07-14T13:11:42.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.739+0000 7fc87affd640 1 --2- 172.21.15.5:0/3226297947 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc87c0d2fc0 0x7fc87c154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:11:42.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.739+0000 7fc87b7fe640 1 --2- 172.21.15.5:0/3226297947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc87c0d2300 0x7fc87c154a50 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fc86c01ab10 tx=0x7fc86c019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:42.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.743+0000 7fc863fff640 1 -- 172.21.15.5:0/3226297947 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c005e70 con 0x7fc87c0d2300 2023-07-14T13:11:42.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.743+0000 7fc863fff640 1 -- 172.21.15.5:0/3226297947 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86c0ab930 con 0x7fc87c0d2300 2023-07-14T13:11:42.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.743+0000 7fc881b96640 1 -- 172.21.15.5:0/3226297947 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc87c0b5590 con 0x7fc87c0d2300 2023-07-14T13:11:42.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.743+0000 7fc863fff640 1 -- 172.21.15.5:0/3226297947 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c0abd00 con 0x7fc87c0d2300 2023-07-14T13:11:42.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.743+0000 7fc881b96640 1 -- 172.21.15.5:0/3226297947 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc87c15cbe0 con 0x7fc87c0d2300 2023-07-14T13:11:42.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.743+0000 7fc881b96640 1 -- 172.21.15.5:0/3226297947 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc87c0678d0 con 0x7fc87c0d2300 2023-07-14T13:11:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.743+0000 7fc863fff640 1 -- 172.21.15.5:0/3226297947 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 54) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fc86c0a9070 con 0x7fc87c0d2300 2023-07-14T13:11:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.743+0000 7fc863fff640 1 --2- 172.21.15.5:0/3226297947 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fc8680663f0 0x7fc8680688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.743+0000 7fc863fff640 1 -- 172.21.15.5:0/3226297947 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc86c11e4d0 con 0x7fc87c0d2300 2023-07-14T13:11:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.743+0000 7fc87affd640 1 -- 172.21.15.5:0/3226297947 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fc8680663f0 msgr2=0x7fc8680688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/938367911 2023-07-14T13:11:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.743+0000 7fc87affd640 1 --2- 172.21.15.5:0/3226297947 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fc8680663f0 0x7fc8680688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:11:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.747+0000 7fc863fff640 1 -- 172.21.15.5:0/3226297947 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc86c0eb720 con 0x7fc87c0d2300 2023-07-14T13:11:42.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.923+0000 7fc881b96640 1 -- 172.21.15.5:0/3226297947 --> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc87c0b5a40 con 0x7fc8680663f0 2023-07-14T13:11:42.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.947+0000 7fc87affd640 1 -- 172.21.15.5:0/3226297947 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fc8680663f0 msgr2=0x7fc8680688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/938367911 2023-07-14T13:11:42.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:42.947+0000 7fc87affd640 1 --2- 172.21.15.5:0/3226297947 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fc8680663f0 0x7fc8680688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-14T13:11:43.044 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:43.011+0000 7f6c59a0a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:11:43.103 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:43.071+0000 7f6c59a0a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:11:43.129 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:43.095+0000 7f0b460e9180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:11:43.159 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:43.127+0000 7f6c59a0a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:11:43.192 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:43.159+0000 7f0b460e9180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:11:43.245 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:43.211+0000 7f6c59a0a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:11:43.250 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:43.219+0000 7f0b460e9180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:11:43.303 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:43.271+0000 7f6c59a0a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:11:43.343 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:43.311+0000 7f0b460e9180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:11:43.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:43.351+0000 7fc87affd640 1 -- 172.21.15.5:0/3226297947 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fc8680663f0 msgr2=0x7fc8680688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/938367911 2023-07-14T13:11:43.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:43.351+0000 7fc87affd640 1 --2- 172.21.15.5:0/3226297947 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fc8680663f0 0x7fc8680688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-14T13:11:43.388 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:43.355+0000 7f6c59a0a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:11:43.402 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:43.371+0000 7f0b460e9180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:11:43.444 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:43.411+0000 7f6c59a0a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:11:43.491 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:43.459+0000 7f0b460e9180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:11:43.551 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:43.519+0000 7f0b460e9180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:11:43.587 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:43.555+0000 7f6c59a0a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:11:43.644 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:43.611+0000 7f6c59a0a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:11:43.701 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:43.667+0000 7f0b460e9180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:11:43.761 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:43.727+0000 7f0b460e9180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:11:43.883 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:11:43.884 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:11:43.884 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:11:43.892 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:43.859+0000 7f6c59a0a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:11:44.014 INFO:tasks.ceph.mgr.y.smithi005.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:11:44.014 INFO:tasks.ceph.mgr.y.smithi005.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:11:44.014 INFO:tasks.ceph.mgr.y.smithi005.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:11:44.023 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:43.991+0000 7f0b460e9180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:11:44.027 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:43.995+0000 7f6c59a0a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:11:44.153 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:44.119+0000 7f6c59a0a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:11:44.165 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:44.131+0000 7f0b460e9180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:11:44.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:44.155+0000 7fc87affd640 1 -- 172.21.15.5:0/3226297947 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fc8680663f0 msgr2=0x7fc8680688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/938367911 2023-07-14T13:11:44.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:44.155+0000 7fc87affd640 1 --2- 172.21.15.5:0/3226297947 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fc8680663f0 0x7fc8680688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-14T13:11:44.222 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:44.191+0000 7f6c59a0a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:11:44.297 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:44.263+0000 7f0b460e9180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:11:44.356 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:44.323+0000 7f6c59a0a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:11:44.371 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:44.339+0000 7f0b460e9180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:11:44.512 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:44.479+0000 7f0b460e9180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:11:44.893 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:44.859+0000 7f6c59a0a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:11:44.980 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:44.947+0000 7f6c59a0a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:11:45.087 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:45.055+0000 7f0b460e9180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:11:45.129 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:45.095+0000 7f6c59a0a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:11:45.176 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:45.143+0000 7f0b460e9180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:11:45.211 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:45.179+0000 7f6c59a0a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:11:45.331 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:45.299+0000 7f0b460e9180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:11:45.420 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:45.387+0000 7f0b460e9180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:11:45.479 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:45.447+0000 7f6c59a0a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:11:45.539 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:45.507+0000 7f6c59a0a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:11:45.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:45.519+0000 7fc863fff640 1 -- 172.21.15.5:0/3226297947 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 55) v1 ==== 85386+0+0 (secure 0 0 0) 0x7fc86c0ebaf0 con 0x7fc87c0d2300 2023-07-14T13:11:45.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:45.519+0000 7fc863fff640 1 -- 172.21.15.5:0/3226297947 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fc8680663f0 msgr2=0x7fc8680688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:11:45.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:45.519+0000 7fc863fff640 1 --2- 172.21.15.5:0/3226297947 >> [v2:172.21.15.154:6832/938367911,v1:172.21.15.154:6833/938367911] conn(0x7fc8680663f0 0x7fc8680688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:45.680 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:45.647+0000 7f6bdba6e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:11:45.681 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:45.647+0000 7f6bdba6e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:11:45.681 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:45.647+0000 7f6bdba6e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:11:45.681 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:45.647+0000 7f6bdba6e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:11:45.681 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:45.647+0000 7f6bdba6e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:11:45.682 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:45.647+0000 7f6bd7a66640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:11:45.682 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:45.647+0000 7f6bd7a66640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:11:45.682 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:45.647+0000 7f6bd7a66640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:11:45.682 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:45.647+0000 7f6bd7a66640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:11:45.682 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:11:45.647+0000 7f6bd7a66640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:11:45.726 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:45.691+0000 7f0b460e9180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:11:45.790 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:11:45.755+0000 7f0b460e9180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:11:46.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.527+0000 7fc863fff640 1 -- 172.21.15.5:0/3226297947 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mgrmap(e 56) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fc86c102cb0 con 0x7fc87c0d2300 2023-07-14T13:11:46.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.527+0000 7fc863fff640 1 --2- 172.21.15.5:0/3226297947 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7fc868033e90 0x7fc8680708c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:46.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.527+0000 7fc863fff640 1 -- 172.21.15.5:0/3226297947 --> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc868034260 con 0x7fc868033e90 2023-07-14T13:11:46.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.527+0000 7fc87affd640 1 --2- 172.21.15.5:0/3226297947 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7fc868033e90 0x7fc8680708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:46.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.531+0000 7fc87affd640 1 --2- 172.21.15.5:0/3226297947 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7fc868033e90 0x7fc8680708c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc87c070fe0 tx=0x7fc870009190 comp rx=0 tx=0).ready entity=mgr.7118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:46.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.591+0000 7fc863fff640 1 -- 172.21.15.5:0/3226297947 <== mgr.7118 v2:172.21.15.154:6832/3453046028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc868034260 con 0x7fc868033e90 2023-07-14T13:11:46.625 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule set for path snap_test_dir1 2023-07-14T13:11:46.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.595+0000 7fc881b96640 1 -- 172.21.15.5:0/3226297947 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7fc868033e90 msgr2=0x7fc8680708c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:46.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.595+0000 7fc881b96640 1 --2- 172.21.15.5:0/3226297947 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7fc868033e90 0x7fc8680708c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc87c070fe0 tx=0x7fc870009190 comp rx=0 tx=0).stop 2023-07-14T13:11:46.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.595+0000 7fc881b96640 1 -- 172.21.15.5:0/3226297947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc87c0d2300 msgr2=0x7fc87c154a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:46.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.595+0000 7fc881b96640 1 --2- 172.21.15.5:0/3226297947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc87c0d2300 0x7fc87c154a50 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fc86c01ab10 tx=0x7fc86c019200 comp rx=0 tx=0).stop 2023-07-14T13:11:46.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.595+0000 7fc87bfff640 1 -- 172.21.15.5:0/3226297947 reap_dead start 2023-07-14T13:11:46.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.595+0000 7fc881b96640 1 -- 172.21.15.5:0/3226297947 shutdown_connections 2023-07-14T13:11:46.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.595+0000 7fc881b96640 1 -- 172.21.15.5:0/3226297947 >> 172.21.15.5:0/3226297947 conn(0x7fc87c0659d0 msgr2=0x7fc87c0ce470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:46.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.595+0000 7fc881b96640 1 -- 172.21.15.5:0/3226297947 shutdown_connections 2023-07-14T13:11:46.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.595+0000 7fc881b96640 1 -- 172.21.15.5:0/3226297947 wait complete. 2023-07-14T13:11:46.649 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-14T13:11:46.650 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-07-14-13_12_00 in ~14s... 2023-07-14T13:11:46.651 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-07-14T13:11:46.651 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-07-14T13:11:46.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.767+0000 7ff128974640 1 Processor -- start 2023-07-14T13:11:46.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.767+0000 7ff128974640 1 -- start start 2023-07-14T13:11:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.767+0000 7ff128974640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff12406a440 0x7ff1240b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.767+0000 7ff128974640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff1241453a0 0x7ff12406c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:46.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.767+0000 7ff128974640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff12406c040 con 0x7ff12415f690 2023-07-14T13:11:46.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.767+0000 7ff128974640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff124160170 con 0x7ff1241453a0 2023-07-14T13:11:46.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.767+0000 7ff128974640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff124160600 con 0x7ff12406a440 2023-07-14T13:11:46.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.771+0000 7ff122d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff1241453a0 0x7ff12406c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:46.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.771+0000 7ff122d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff1241453a0 0x7ff12406c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40798/0 (socket says 172.21.15.5:40798) 2023-07-14T13:11:46.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.771+0000 7ff122d9d640 1 -- 172.21.15.5:0/3518411381 learned_addr learned my addr 172.21.15.5:0/3518411381 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:46.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.771+0000 7ff11bfff640 1 --2- 172.21.15.5:0/3518411381 >> v2:172.21.15.154:3300/0 conn(0x7ff12406a440 0x7ff1240b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:46.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.771+0000 7ff122d9d640 1 -- 172.21.15.5:0/3518411381 >> v2:172.21.15.154:3300/0 conn(0x7ff12406a440 msgr2=0x7ff1240b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:46.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.771+0000 7ff122d9d640 1 --2- 172.21.15.5:0/3518411381 >> v2:172.21.15.154:3300/0 conn(0x7ff12406a440 0x7ff1240b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:46.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.771+0000 7ff122d9d640 1 -- 172.21.15.5:0/3518411381 >> v1:172.21.15.154:6789/0 conn(0x7ff12415f690 legacy=0x7ff12415fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:46.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.771+0000 7ff122d9d640 1 -- 172.21.15.5:0/3518411381 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff124160360 con 0x7ff1241453a0 2023-07-14T13:11:46.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.771+0000 7ff122d9d640 1 --2- 172.21.15.5:0/3518411381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1241453a0 0x7ff12406c4d0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7ff124070f70 tx=0x7ff11c01c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578f966f497deb25 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:46.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.771+0000 7ff121d9b640 1 -- 172.21.15.5:0/3518411381 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c0a6510 con 0x7ff1241453a0 2023-07-14T13:11:46.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.771+0000 7ff121d9b640 1 -- 172.21.15.5:0/3518411381 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11c0a6670 con 0x7ff1241453a0 2023-07-14T13:11:46.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.771+0000 7ff121d9b640 1 -- 172.21.15.5:0/3518411381 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c0a6a00 con 0x7ff1241453a0 2023-07-14T13:11:46.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff128974640 1 -- 172.21.15.5:0/3518411381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1241453a0 msgr2=0x7ff12406c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:46.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff128974640 1 --2- 172.21.15.5:0/3518411381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1241453a0 0x7ff12406c4d0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7ff124070f70 tx=0x7ff11c01c730 comp rx=0 tx=0).stop 2023-07-14T13:11:46.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff128974640 1 -- 172.21.15.5:0/3518411381 shutdown_connections 2023-07-14T13:11:46.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff128974640 1 --2- 172.21.15.5:0/3518411381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1241453a0 0x7ff12406c4d0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:46.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff128974640 1 --2- 172.21.15.5:0/3518411381 >> v2:172.21.15.154:3300/0 conn(0x7ff12406a440 0x7ff1240b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:46.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff128974640 1 -- 172.21.15.5:0/3518411381 >> 172.21.15.5:0/3518411381 conn(0x7ff1240b1210 msgr2=0x7ff1240ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:46.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff128974640 1 -- 172.21.15.5:0/3518411381 shutdown_connections 2023-07-14T13:11:46.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff128974640 1 -- 172.21.15.5:0/3518411381 wait complete. 2023-07-14T13:11:46.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff128974640 1 Processor -- start 2023-07-14T13:11:46.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff128974640 1 -- start start 2023-07-14T13:11:46.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff128974640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff12406a440 0x7ff12415e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:46.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff128974640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1241453a0 0x7ff12415b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:46.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff128974640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12415f690 0x7ff12413dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:46.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff128974640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12413e710 con 0x7ff12415f690 2023-07-14T13:11:46.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff128974640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12413cba0 con 0x7ff12406a440 2023-07-14T13:11:46.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff128974640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12413ce80 con 0x7ff1241453a0 2023-07-14T13:11:46.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff122d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12415f690 0x7ff12413dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:46.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff122d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12415f690 0x7ff12413dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40802/0 (socket says 172.21.15.5:40802) 2023-07-14T13:11:46.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff122d9d640 1 -- 172.21.15.5:0/3314418996 learned_addr learned my addr 172.21.15.5:0/3314418996 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:11:46.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff11bfff640 1 --2- 172.21.15.5:0/3314418996 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1241453a0 0x7ff12415b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:46.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff12259c640 1 --2- 172.21.15.5:0/3314418996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff12406a440 0x7ff12415e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:46.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff122d9d640 1 -- 172.21.15.5:0/3314418996 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1241453a0 msgr2=0x7ff12415b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:46.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff122d9d640 1 --2- 172.21.15.5:0/3314418996 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1241453a0 0x7ff12415b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:46.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff122d9d640 1 -- 172.21.15.5:0/3314418996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff12406a440 msgr2=0x7ff12415e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:46.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff122d9d640 1 --2- 172.21.15.5:0/3314418996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff12406a440 0x7ff12415e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:46.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff122d9d640 1 -- 172.21.15.5:0/3314418996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11c009b30 con 0x7ff12415f690 2023-07-14T13:11:46.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff11bfff640 1 --2- 172.21.15.5:0/3314418996 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1241453a0 0x7ff12415b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:11:46.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.775+0000 7ff12259c640 1 --2- 172.21.15.5:0/3314418996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff12406a440 0x7ff12415e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:11:46.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.779+0000 7ff122d9d640 1 --2- 172.21.15.5:0/3314418996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12415f690 0x7ff12413dc40 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7ff11c019340 tx=0x7ff11c0194d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:46.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.779+0000 7ff11affd640 1 -- 172.21.15.5:0/3314418996 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c0b4070 con 0x7ff12415f690 2023-07-14T13:11:46.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.779+0000 7ff11affd640 1 -- 172.21.15.5:0/3314418996 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11c009150 con 0x7ff12415f690 2023-07-14T13:11:46.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.779+0000 7ff128974640 1 -- 172.21.15.5:0/3314418996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff12413d160 con 0x7ff12415f690 2023-07-14T13:11:46.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.779+0000 7ff11affd640 1 -- 172.21.15.5:0/3314418996 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c0a6a40 con 0x7ff12415f690 2023-07-14T13:11:46.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.779+0000 7ff128974640 1 -- 172.21.15.5:0/3314418996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff12413d720 con 0x7ff12415f690 2023-07-14T13:11:46.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.779+0000 7ff128974640 1 -- 172.21.15.5:0/3314418996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1240678d0 con 0x7ff12415f690 2023-07-14T13:11:46.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.779+0000 7ff11affd640 1 -- 172.21.15.5:0/3314418996 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 56) v1 ==== 85513+0+0 (secure 0 0 0) 0x7ff11c0b8070 con 0x7ff12415f690 2023-07-14T13:11:46.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.779+0000 7ff11affd640 1 --2- 172.21.15.5:0/3314418996 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7ff104066120 0x7ff1040685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:46.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.779+0000 7ff11affd640 1 -- 172.21.15.5:0/3314418996 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6406+0+0 (secure 0 0 0) 0x7ff11c0aa070 con 0x7ff12415f690 2023-07-14T13:11:46.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.779+0000 7ff12259c640 1 --2- 172.21.15.5:0/3314418996 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7ff104066120 0x7ff1040685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:46.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.783+0000 7ff12259c640 1 --2- 172.21.15.5:0/3314418996 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7ff104066120 0x7ff1040685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff124144470 tx=0x7ff114009040 comp rx=0 tx=0).ready entity=mgr.7118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:46.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.783+0000 7ff11affd640 1 -- 172.21.15.5:0/3314418996 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff11c0eacc0 con 0x7ff12415f690 2023-07-14T13:11:46.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.955+0000 7ff128974640 1 -- 172.21.15.5:0/3314418996 --> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff12413cff0 con 0x7ff104066120 2023-07-14T13:11:46.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.963+0000 7ff11affd640 1 -- 172.21.15.5:0/3314418996 <== mgr.7118 v2:172.21.15.154:6832/3453046028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+66 (secure 0 0 0) 0x7ff12413cff0 con 0x7ff104066120 2023-07-14T13:11:46.997 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:11:46.997 INFO:teuthology.orchestra.run.smithi005.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-07-14T13:11:46.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.967+0000 7ff128974640 1 -- 172.21.15.5:0/3314418996 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7ff104066120 msgr2=0x7ff1040685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:46.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.967+0000 7ff128974640 1 --2- 172.21.15.5:0/3314418996 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7ff104066120 0x7ff1040685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff124144470 tx=0x7ff114009040 comp rx=0 tx=0).stop 2023-07-14T13:11:46.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.967+0000 7ff128974640 1 -- 172.21.15.5:0/3314418996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12415f690 msgr2=0x7ff12413dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.967+0000 7ff128974640 1 --2- 172.21.15.5:0/3314418996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12415f690 0x7ff12413dc40 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7ff11c019340 tx=0x7ff11c0194d0 comp rx=0 tx=0).stop 2023-07-14T13:11:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.967+0000 7ff128974640 1 -- 172.21.15.5:0/3314418996 shutdown_connections 2023-07-14T13:11:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.967+0000 7ff128974640 1 --2- 172.21.15.5:0/3314418996 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7ff104066120 0x7ff1040685d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.967+0000 7ff128974640 1 --2- 172.21.15.5:0/3314418996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12415f690 0x7ff12413dc40 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.967+0000 7ff128974640 1 --2- 172.21.15.5:0/3314418996 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1241453a0 0x7ff12415b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.967+0000 7ff128974640 1 --2- 172.21.15.5:0/3314418996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff12406a440 0x7ff12415e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.967+0000 7ff128974640 1 -- 172.21.15.5:0/3314418996 >> 172.21.15.5:0/3314418996 conn(0x7ff1240b1210 msgr2=0x7ff1240b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:47.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.967+0000 7ff128974640 1 -- 172.21.15.5:0/3314418996 shutdown_connections 2023-07-14T13:11:47.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:11:46.967+0000 7ff128974640 1 -- 172.21.15.5:0/3314418996 wait complete. 2023-07-14T13:11:47.019 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-07-14T13:11:47.019 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{}]} 2023-07-14T13:11:47.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:11:47.020 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:11:47.030 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:11:47.031 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:11:47.031 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:11:48.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:11:48.033 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:11:48.044 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:11:48.044 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:11:48.044 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:11:48.238 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:11:48.242 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:11:49.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:11:49.046 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:11:49.059 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:11:49.059 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:11:49.059 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:11:50.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:11:50.061 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:11:50.075 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:11:50.076 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:11:50.077 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:11:51.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:11:51.080 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:11:51.092 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:11:51.092 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:11:51.092 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:11:52.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:11:52.094 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:11:52.107 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:11:52.107 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:11:52.108 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:11:53.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:11:53.110 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:11:53.122 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:11:53.122 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:11:53.123 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:11:54.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:11:54.124 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:11:54.136 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:11:54.136 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:11:54.137 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:11:55.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:11:55.139 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:11:55.151 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:11:55.152 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:11:55.152 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:11:56.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:11:56.154 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:11:56.168 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:11:56.168 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:11:56.169 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:11:57.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:11:57.170 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:11:57.182 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:11:57.182 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:11:57.183 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:11:58.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:11:58.184 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:11:58.196 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:11:58.196 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:11:58.196 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:11:59.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:11:59.197 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:11:59.209 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:11:59.209 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:11:59.210 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:12:00.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:12:00.211 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:12:00.223 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:12:00.224 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:12:00.224 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:12:00.637 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:00.603+0000 7f6bcb24d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:00.638 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:00.603+0000 7f6bcb24d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:00.638 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:00.603+0000 7f6bcb24d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:00.638 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:00.603+0000 7f6bcb24d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:00.638 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:00.603+0000 7f6bcb24d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:01.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:12:01.227 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:12:01.238 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_12_00_UTC 2023-07-14T13:12:01.239 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_12_00_UTC'} 2023-07-14T13:12:01.239 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-07-14-13_12_00_UTC'} 2023-07-14T13:12:01.239 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:12:01.240 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-07-14-13_12_00_UTC'] 2023-07-14T13:12:01.240 DEBUG:tasks.cephfs.test_snap_schedules:exec=1689340306.6505713, now = 1689340321.2404466, timo = 14 2023-07-14T13:12:02.242 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-07-14T13:12:02.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.366+0000 7f78099fa640 1 Processor -- start 2023-07-14T13:12:02.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.366+0000 7f78099fa640 1 -- start start 2023-07-14T13:12:02.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.370+0000 7f78099fa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78040aeb40 0x7f780415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:02.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.370+0000 7f78099fa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78041532b0 con 0x7f78040aef10 2023-07-14T13:12:02.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.370+0000 7f78099fa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78040ca6f0 con 0x7f7804159440 2023-07-14T13:12:02.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.370+0000 7f78099fa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78041599d0 con 0x7f78040aeb40 2023-07-14T13:12:02.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.370+0000 7f78027fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f78040aef10 0x7f7804158d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46834/0 (socket says 172.21.15.5:46834) 2023-07-14T13:12:02.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.370+0000 7f78027fc640 1 -- 172.21.15.5:0/1445511311 learned_addr learned my addr 172.21.15.5:0/1445511311 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:02.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.370+0000 7f7802ffd640 1 --2- 172.21.15.5:0/1445511311 >> v2:172.21.15.154:3300/0 conn(0x7f78040aeb40 0x7f780415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:02.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.370+0000 7f7801ffb640 1 -- 172.21.15.5:0/1445511311 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994192400 0 0) 0x7f78041532b0 con 0x7f78040aef10 2023-07-14T13:12:02.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.370+0000 7f7801ffb640 1 -- 172.21.15.5:0/1445511311 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77ec005740 con 0x7f78040aef10 2023-07-14T13:12:02.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.370+0000 7f7801ffb640 1 -- 172.21.15.5:0/1445511311 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642725785 0 0) 0x7f78040ca6f0 con 0x7f7804159440 2023-07-14T13:12:02.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.370+0000 7f7801ffb640 1 -- 172.21.15.5:0/1445511311 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78041532b0 con 0x7f7804159440 2023-07-14T13:12:02.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.370+0000 7f7802ffd640 1 -- 172.21.15.5:0/1445511311 >> v1:172.21.15.154:6789/0 conn(0x7f7804159440 legacy=0x7f78040c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:02.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.370+0000 7f7802ffd640 1 -- 172.21.15.5:0/1445511311 >> v1:172.21.15.5:6789/0 conn(0x7f78040aef10 legacy=0x7f7804158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:02.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.370+0000 7f7802ffd640 1 -- 172.21.15.5:0/1445511311 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7804159cb0 con 0x7f78040aeb40 2023-07-14T13:12:02.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.374+0000 7f7802ffd640 1 --2- 172.21.15.5:0/1445511311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78040aeb40 0x7f780415cef0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f77f40097c0 tx=0x7f77f401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8236cfbfb02bed8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:02.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.374+0000 7f7801ffb640 1 -- 172.21.15.5:0/1445511311 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f40ac620 con 0x7f78040aeb40 2023-07-14T13:12:02.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.374+0000 7f7801ffb640 1 -- 172.21.15.5:0/1445511311 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f40ac780 con 0x7f78040aeb40 2023-07-14T13:12:02.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.374+0000 7f7801ffb640 1 -- 172.21.15.5:0/1445511311 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f40acb10 con 0x7f78040aeb40 2023-07-14T13:12:02.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.374+0000 7f78099fa640 1 -- 172.21.15.5:0/1445511311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78040aeb40 msgr2=0x7f780415cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:02.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.374+0000 7f78099fa640 1 --2- 172.21.15.5:0/1445511311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78040aeb40 0x7f780415cef0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f77f40097c0 tx=0x7f77f401c3c0 comp rx=0 tx=0).stop 2023-07-14T13:12:02.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.374+0000 7f78099fa640 1 -- 172.21.15.5:0/1445511311 shutdown_connections 2023-07-14T13:12:02.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.374+0000 7f78099fa640 1 --2- 172.21.15.5:0/1445511311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78040aeb40 0x7f780415cef0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:02.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.374+0000 7f78099fa640 1 -- 172.21.15.5:0/1445511311 >> 172.21.15.5:0/1445511311 conn(0x7f78040cde90 msgr2=0x7f78040ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:02.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.374+0000 7f78099fa640 1 -- 172.21.15.5:0/1445511311 shutdown_connections 2023-07-14T13:12:02.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.374+0000 7f78099fa640 1 -- 172.21.15.5:0/1445511311 wait complete. 2023-07-14T13:12:02.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.374+0000 7f78099fa640 1 Processor -- start 2023-07-14T13:12:02.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.374+0000 7f78099fa640 1 -- start start 2023-07-14T13:12:02.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.374+0000 7f78099fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78040aeb40 0x7f780414bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:02.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.378+0000 7f78099fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78040aef10 0x7f7804157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:02.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.378+0000 7f78099fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7804159440 0x7f78040cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:02.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.378+0000 7f78099fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780414f9b0 con 0x7f78040aef10 2023-07-14T13:12:02.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.378+0000 7f78099fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780414ed30 con 0x7f7804159440 2023-07-14T13:12:02.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.378+0000 7f78099fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780414f010 con 0x7f78040aeb40 2023-07-14T13:12:02.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.378+0000 7f78027fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78040aef10 0x7f7804157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:02.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.378+0000 7f78027fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78040aef10 0x7f7804157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35848/0 (socket says 172.21.15.5:35848) 2023-07-14T13:12:02.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.378+0000 7f78027fc640 1 -- 172.21.15.5:0/802104978 learned_addr learned my addr 172.21.15.5:0/802104978 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:02.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.378+0000 7f7802ffd640 1 --2- 172.21.15.5:0/802104978 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78040aeb40 0x7f780414bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:02.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.378+0000 7f78037fe640 1 --2- 172.21.15.5:0/802104978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7804159440 0x7f78040cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:02.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.378+0000 7f78027fc640 1 -- 172.21.15.5:0/802104978 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78040aeb40 msgr2=0x7f780414bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:02.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.378+0000 7f78027fc640 1 --2- 172.21.15.5:0/802104978 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78040aeb40 0x7f780414bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:02.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.378+0000 7f78027fc640 1 -- 172.21.15.5:0/802104978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7804159440 msgr2=0x7f78040cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:02.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.378+0000 7f78027fc640 1 --2- 172.21.15.5:0/802104978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7804159440 0x7f78040cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:02.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.378+0000 7f78027fc640 1 -- 172.21.15.5:0/802104978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f4009420 con 0x7f78040aef10 2023-07-14T13:12:02.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.378+0000 7f7802ffd640 1 --2- 172.21.15.5:0/802104978 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78040aeb40 0x7f780414bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:02.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.378+0000 7f78037fe640 1 --2- 172.21.15.5:0/802104978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7804159440 0x7f78040cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.378+0000 7f78027fc640 1 --2- 172.21.15.5:0/802104978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78040aef10 0x7f7804157a40 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f77f800c4d0 tx=0x7f77f800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.378+0000 7f77ebfff640 1 -- 172.21.15.5:0/802104978 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f8005cf0 con 0x7f78040aef10 2023-07-14T13:12:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.378+0000 7f77ebfff640 1 -- 172.21.15.5:0/802104978 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f8005e50 con 0x7f78040aef10 2023-07-14T13:12:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.378+0000 7f78099fa640 1 -- 172.21.15.5:0/802104978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780414f2f0 con 0x7f78040aef10 2023-07-14T13:12:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.378+0000 7f77ebfff640 1 -- 172.21.15.5:0/802104978 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f80072b0 con 0x7f78040aef10 2023-07-14T13:12:02.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.378+0000 7f78099fa640 1 -- 172.21.15.5:0/802104978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780414e9e0 con 0x7f78040aef10 2023-07-14T13:12:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.378+0000 7f78099fa640 1 -- 172.21.15.5:0/802104978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78040678d0 con 0x7f78040aef10 2023-07-14T13:12:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.378+0000 7f77ebfff640 1 -- 172.21.15.5:0/802104978 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 58) v1 ==== 85891+0+0 (secure 0 0 0) 0x7f77f8007410 con 0x7f78040aef10 2023-07-14T13:12:02.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.382+0000 7f77ebfff640 1 --2- 172.21.15.5:0/802104978 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f77f0066510 0x7f77f00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:02.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.382+0000 7f77ebfff640 1 -- 172.21.15.5:0/802104978 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f77f80839f0 con 0x7f78040aef10 2023-07-14T13:12:02.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.382+0000 7f7802ffd640 1 --2- 172.21.15.5:0/802104978 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f77f0066510 0x7f77f00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:02.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.382+0000 7f7802ffd640 1 --2- 172.21.15.5:0/802104978 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f77f0066510 0x7f77f00689c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f77f40ae000 tx=0x7f77f40a7000 comp rx=0 tx=0).ready entity=mgr.7118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:02.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.386+0000 7f77ebfff640 1 -- 172.21.15.5:0/802104978 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f77f8050920 con 0x7f78040aef10 2023-07-14T13:12:02.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.562+0000 7f78099fa640 1 -- 172.21.15.5:0/802104978 --> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f780415c9d0 con 0x7f77f0066510 2023-07-14T13:12:02.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.634+0000 7f77ebfff640 1 -- 172.21.15.5:0/802104978 <== mgr.7118 v2:172.21.15.154:6832/3453046028 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f77f40bd0c0 con 0x7f77f0066510 2023-07-14T13:12:02.667 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule removed for path snap_test_dir1 2023-07-14T13:12:02.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.634+0000 7f78099fa640 1 -- 172.21.15.5:0/802104978 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f77f0066510 msgr2=0x7f77f00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:02.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.634+0000 7f78099fa640 1 --2- 172.21.15.5:0/802104978 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f77f0066510 0x7f77f00689c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f77f40ae000 tx=0x7f77f40a7000 comp rx=0 tx=0).stop 2023-07-14T13:12:02.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.634+0000 7f78099fa640 1 -- 172.21.15.5:0/802104978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78040aef10 msgr2=0x7f7804157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:02.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.634+0000 7f78099fa640 1 --2- 172.21.15.5:0/802104978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78040aef10 0x7f7804157a40 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f77f800c4d0 tx=0x7f77f800c990 comp rx=0 tx=0).stop 2023-07-14T13:12:02.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.634+0000 7f78099fa640 1 -- 172.21.15.5:0/802104978 shutdown_connections 2023-07-14T13:12:02.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.634+0000 7f78099fa640 1 --2- 172.21.15.5:0/802104978 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f77f0066510 0x7f77f00689c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:02.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.634+0000 7f78099fa640 1 --2- 172.21.15.5:0/802104978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7804159440 0x7f78040cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:02.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.634+0000 7f78099fa640 1 --2- 172.21.15.5:0/802104978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78040aef10 0x7f7804157a40 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:02.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.634+0000 7f78099fa640 1 --2- 172.21.15.5:0/802104978 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78040aeb40 0x7f780414bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:02.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.634+0000 7f78099fa640 1 -- 172.21.15.5:0/802104978 >> 172.21.15.5:0/802104978 conn(0x7f78040cde90 msgr2=0x7f78040ad8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:02.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.634+0000 7f78099fa640 1 -- 172.21.15.5:0/802104978 shutdown_connections 2023-07-14T13:12:02.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.634+0000 7f78099fa640 1 -- 172.21.15.5:0/802104978 wait complete. 2023-07-14T13:12:02.687 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-07-14T13:12:02.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:12:02.688 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:12:02.697 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_12_00_UTC 2023-07-14T13:12:02.699 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-14-13_12_00_UTC 2023-07-14T13:12:02.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:12:02.700 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-14-13_12_00_UTC) 2023-07-14T13:12:02.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:12:02.757 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-14T13:12:02.810 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-14T13:12:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.966+0000 7f4a9f996640 1 Processor -- start 2023-07-14T13:12:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.966+0000 7f4a9f996640 1 -- start start 2023-07-14T13:12:03.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.966+0000 7f4a9f996640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4a9806cc80 0x7f4a98069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:03.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.966+0000 7f4a9f996640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a9815bd50 0x7f4a9806d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:03.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.966+0000 7f4a9f996640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a98069970 con 0x7f4a9806fcf0 2023-07-14T13:12:03.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.966+0000 7f4a9f996640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a9806d590 con 0x7f4a9806cc80 2023-07-14T13:12:03.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.966+0000 7f4a9f996640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9815fa90 con 0x7f4a9815bd50 2023-07-14T13:12:03.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.966+0000 7f4a9d732640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4a9806cc80 0x7f4a98069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:03.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.966+0000 7f4a9df33640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4a9806fcf0 0x7f4a9815c480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46836/0 (socket says 172.21.15.5:46836) 2023-07-14T13:12:03.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.966+0000 7f4a9df33640 1 -- 172.21.15.5:0/2921577407 learned_addr learned my addr 172.21.15.5:0/2921577407 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:03.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.966+0000 7f4a9cf31640 1 --2- 172.21.15.5:0/2921577407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a9815bd50 0x7f4a9806d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:03.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.970+0000 7f4a9d732640 1 -- 172.21.15.5:0/2921577407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a9815bd50 msgr2=0x7f4a9806d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:03.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.970+0000 7f4a9d732640 1 --2- 172.21.15.5:0/2921577407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a9815bd50 0x7f4a9806d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.970+0000 7f4a9d732640 1 -- 172.21.15.5:0/2921577407 >> v1:172.21.15.5:6789/0 conn(0x7f4a9806fcf0 legacy=0x7f4a9815c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:03.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.970+0000 7f4a8ffff640 1 -- 172.21.15.5:0/2921577407 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1065184552 0 0) 0x7f4a98069970 con 0x7f4a9806fcf0 2023-07-14T13:12:03.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.970+0000 7f4a9d732640 1 -- 172.21.15.5:0/2921577407 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9815fd70 con 0x7f4a9806cc80 2023-07-14T13:12:03.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.970+0000 7f4a9cf31640 1 --2- 172.21.15.5:0/2921577407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a9815bd50 0x7f4a9806d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:03.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.970+0000 7f4a9d732640 1 --2- 172.21.15.5:0/2921577407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a9806cc80 0x7f4a98069430 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f4a940097c0 tx=0x7f4a9401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af80787f78ced491 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:03.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.970+0000 7f4a8ffff640 1 -- 172.21.15.5:0/2921577407 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a940ad660 con 0x7f4a9806cc80 2023-07-14T13:12:03.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.970+0000 7f4a8ffff640 1 -- 172.21.15.5:0/2921577407 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a940ad7c0 con 0x7f4a9806cc80 2023-07-14T13:12:03.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.970+0000 7f4a8ffff640 1 -- 172.21.15.5:0/2921577407 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a940adb50 con 0x7f4a9806cc80 2023-07-14T13:12:03.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.970+0000 7f4a9f996640 1 -- 172.21.15.5:0/2921577407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a9806cc80 msgr2=0x7f4a98069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:03.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.970+0000 7f4a9f996640 1 --2- 172.21.15.5:0/2921577407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a9806cc80 0x7f4a98069430 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f4a940097c0 tx=0x7f4a9401c450 comp rx=0 tx=0).stop 2023-07-14T13:12:03.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.970+0000 7f4a9f996640 1 -- 172.21.15.5:0/2921577407 shutdown_connections 2023-07-14T13:12:03.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.970+0000 7f4a9f996640 1 --2- 172.21.15.5:0/2921577407 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a9815bd50 0x7f4a9806d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.970+0000 7f4a9f996640 1 --2- 172.21.15.5:0/2921577407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a9806cc80 0x7f4a98069430 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.970+0000 7f4a9f996640 1 -- 172.21.15.5:0/2921577407 >> 172.21.15.5:0/2921577407 conn(0x7f4a980b0490 msgr2=0x7f4a980b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:03.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.974+0000 7f4a9f996640 1 -- 172.21.15.5:0/2921577407 shutdown_connections 2023-07-14T13:12:03.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.974+0000 7f4a9f996640 1 -- 172.21.15.5:0/2921577407 wait complete. 2023-07-14T13:12:03.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.974+0000 7f4a9f996640 1 Processor -- start 2023-07-14T13:12:03.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.974+0000 7f4a9f996640 1 -- start start 2023-07-14T13:12:03.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.974+0000 7f4a9f996640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a9806cc80 0x7f4a98153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:03.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.974+0000 7f4a9f996640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a9806fcf0 0x7f4a98158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:03.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.974+0000 7f4a9f996640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a9815bd50 0x7f4a981505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:03.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.974+0000 7f4a9f996640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9814fb50 con 0x7f4a9815bd50 2023-07-14T13:12:03.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.974+0000 7f4a9f996640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a980ce0f0 con 0x7f4a9806fcf0 2023-07-14T13:12:03.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.974+0000 7f4a9f996640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a981518b0 con 0x7f4a9806cc80 2023-07-14T13:12:03.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.974+0000 7f4a9df33640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a9815bd50 0x7f4a981505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:03.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.974+0000 7f4a9df33640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a9815bd50 0x7f4a981505a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35860/0 (socket says 172.21.15.5:35860) 2023-07-14T13:12:03.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.974+0000 7f4a9df33640 1 -- 172.21.15.5:0/3580174706 learned_addr learned my addr 172.21.15.5:0/3580174706 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:03.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.974+0000 7f4a9d732640 1 --2- 172.21.15.5:0/3580174706 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a9806cc80 0x7f4a98153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:03.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.974+0000 7f4a9cf31640 1 --2- 172.21.15.5:0/3580174706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a9806fcf0 0x7f4a98158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:03.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.974+0000 7f4a9df33640 1 -- 172.21.15.5:0/3580174706 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a9806cc80 msgr2=0x7f4a98153ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:03.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.974+0000 7f4a9df33640 1 --2- 172.21.15.5:0/3580174706 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a9806cc80 0x7f4a98153ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.974+0000 7f4a9df33640 1 -- 172.21.15.5:0/3580174706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a9806fcf0 msgr2=0x7f4a98158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:03.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.974+0000 7f4a9df33640 1 --2- 172.21.15.5:0/3580174706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a9806fcf0 0x7f4a98158de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.974+0000 7f4a9df33640 1 -- 172.21.15.5:0/3580174706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a94009420 con 0x7f4a9815bd50 2023-07-14T13:12:03.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.974+0000 7f4a9df33640 1 --2- 172.21.15.5:0/3580174706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a9815bd50 0x7f4a981505a0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000c780 tx=0x7f4a9000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:03.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.974+0000 7f4a8dffb640 1 -- 172.21.15.5:0/3580174706 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9000ce90 con 0x7f4a9815bd50 2023-07-14T13:12:03.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.974+0000 7f4a8dffb640 1 -- 172.21.15.5:0/3580174706 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9000a640 con 0x7f4a9815bd50 2023-07-14T13:12:03.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.974+0000 7f4a8dffb640 1 -- 172.21.15.5:0/3580174706 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9000a9d0 con 0x7f4a9815bd50 2023-07-14T13:12:03.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.974+0000 7f4a9f996640 1 -- 172.21.15.5:0/3580174706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a98151b90 con 0x7f4a9815bd50 2023-07-14T13:12:03.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.978+0000 7f4a9f996640 1 -- 172.21.15.5:0/3580174706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a98150080 con 0x7f4a9815bd50 2023-07-14T13:12:03.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.978+0000 7f4a9f996640 1 -- 172.21.15.5:0/3580174706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a981502a0 con 0x7f4a9815bd50 2023-07-14T13:12:03.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.978+0000 7f4a8dffb640 1 -- 172.21.15.5:0/3580174706 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 58) v1 ==== 85891+0+0 (secure 0 0 0) 0x7f4a9000ab30 con 0x7f4a9815bd50 2023-07-14T13:12:03.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.978+0000 7f4a8dffb640 1 --2- 172.21.15.5:0/3580174706 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f4a7c066540 0x7f4a7c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:03.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.978+0000 7f4a8dffb640 1 -- 172.21.15.5:0/3580174706 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f4a90083690 con 0x7f4a9815bd50 2023-07-14T13:12:03.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.978+0000 7f4a9d732640 1 --2- 172.21.15.5:0/3580174706 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f4a7c066540 0x7f4a7c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:03.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.982+0000 7f4a9d732640 1 --2- 172.21.15.5:0/3580174706 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f4a7c066540 0x7f4a7c0689f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4a940af000 tx=0x7f4a94008040 comp rx=0 tx=0).ready entity=mgr.7118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:03.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:02.982+0000 7f4a8dffb640 1 -- 172.21.15.5:0/3580174706 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4a900506f0 con 0x7f4a9815bd50 2023-07-14T13:12:03.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:03.178+0000 7f4a9f996640 1 -- 172.21.15.5:0/3580174706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f4a980678d0 con 0x7f4a9815bd50 2023-07-14T13:12:03.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:03.810+0000 7f4a8dffb640 1 -- 172.21.15.5:0/3580174706 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 59) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f4a90050ac0 con 0x7f4a9815bd50 2023-07-14T13:12:03.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:03.814+0000 7f4a8dffb640 1 -- 172.21.15.5:0/3580174706 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v59) v1 ==== 93+0+0 (secure 0 0 0) 0x7f4a90071ad0 con 0x7f4a9815bd50 2023-07-14T13:12:03.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:03.818+0000 7f4a9f996640 1 -- 172.21.15.5:0/3580174706 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f4a7c066540 msgr2=0x7f4a7c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:03.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:03.818+0000 7f4a9f996640 1 --2- 172.21.15.5:0/3580174706 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f4a7c066540 0x7f4a7c0689f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4a940af000 tx=0x7f4a94008040 comp rx=0 tx=0).stop 2023-07-14T13:12:03.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:03.818+0000 7f4a9f996640 1 -- 172.21.15.5:0/3580174706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a9815bd50 msgr2=0x7f4a981505a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:03.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:03.818+0000 7f4a9f996640 1 --2- 172.21.15.5:0/3580174706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a9815bd50 0x7f4a981505a0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000c780 tx=0x7f4a9000cc40 comp rx=0 tx=0).stop 2023-07-14T13:12:03.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:03.818+0000 7f4a9f996640 1 -- 172.21.15.5:0/3580174706 shutdown_connections 2023-07-14T13:12:03.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:03.818+0000 7f4a9f996640 1 --2- 172.21.15.5:0/3580174706 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f4a7c066540 0x7f4a7c0689f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:03.818+0000 7f4a9f996640 1 --2- 172.21.15.5:0/3580174706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a9815bd50 0x7f4a981505a0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:03.818+0000 7f4a9f996640 1 --2- 172.21.15.5:0/3580174706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a9806fcf0 0x7f4a98158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:03.818+0000 7f4a9f996640 1 --2- 172.21.15.5:0/3580174706 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4a9806cc80 0x7f4a98153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:03.818+0000 7f4a9f996640 1 -- 172.21.15.5:0/3580174706 >> 172.21.15.5:0/3580174706 conn(0x7f4a980b0490 msgr2=0x7f4a9806a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:03.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:03.818+0000 7f4a9f996640 1 -- 172.21.15.5:0/3580174706 shutdown_connections 2023-07-14T13:12:03.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:03.818+0000 7f4a9f996640 1 -- 172.21.15.5:0/3580174706 wait complete. 2023-07-14T13:12:03.874 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T13:12:03.875 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:12:03.933 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:12:03.989 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T13:12:03.989 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:12:03.990 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:12:03.998 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:12:03.999 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:12:04.028 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:03.995+0000 7fbc78a53180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:12:04.028 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:03.994+0000 7f6a8a42d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:12:04.037 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:12:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.190+0000 7f1c21ddf640 1 Processor -- start 2023-07-14T13:12:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.190+0000 7f1c21ddf640 1 -- start start 2023-07-14T13:12:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.190+0000 7f1c21ddf640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c1c0d06b0 0x7f1c1c0b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.190+0000 7f1c21ddf640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1c1c0b1f70 0x7f1c1c0d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.190+0000 7f1c21ddf640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c1c0b2410 con 0x7f1c1c145430 2023-07-14T13:12:04.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.190+0000 7f1c21ddf640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1c0b26f0 con 0x7f1c1c0b1f70 2023-07-14T13:12:04.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.190+0000 7f1c21ddf640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c0b29d0 con 0x7f1c1c0d06b0 2023-07-14T13:12:04.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.190+0000 7f1c1bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1c1c0b1f70 0x7f1c1c0d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:04.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.190+0000 7f1c1affd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1c1c145430 0x7f1c1c0b34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46838/0 (socket says 172.21.15.5:46838) 2023-07-14T13:12:04.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.190+0000 7f1c1affd640 1 -- 172.21.15.5:0/1589975188 learned_addr learned my addr 172.21.15.5:0/1589975188 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:04.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.190+0000 7f1c1b7fe640 1 --2- 172.21.15.5:0/1589975188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c1c0d06b0 0x7f1c1c0b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:04.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.194+0000 7f1c1bfff640 1 -- 172.21.15.5:0/1589975188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c1c0d06b0 msgr2=0x7f1c1c0b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:04.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.194+0000 7f1c1bfff640 1 --2- 172.21.15.5:0/1589975188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c1c0d06b0 0x7f1c1c0b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:04.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.194+0000 7f1c1bfff640 1 -- 172.21.15.5:0/1589975188 >> v1:172.21.15.5:6789/0 conn(0x7f1c1c145430 legacy=0x7f1c1c0b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:04.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.194+0000 7f1c1bfff640 1 -- 172.21.15.5:0/1589975188 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c0b2cb0 con 0x7f1c1c0b1f70 2023-07-14T13:12:04.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.198+0000 7f1c1bfff640 1 --2- 172.21.15.5:0/1589975188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c0b1f70 0x7f1c1c0d22e0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009d90 tx=0x7f1c1401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23c6e1cd1d31d57 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:04.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.198+0000 7f1c1a7fc640 1 -- 172.21.15.5:0/1589975188 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c140a58f0 con 0x7f1c1c0b1f70 2023-07-14T13:12:04.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.198+0000 7f1c1a7fc640 1 -- 172.21.15.5:0/1589975188 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c140a5a50 con 0x7f1c1c0b1f70 2023-07-14T13:12:04.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.198+0000 7f1c1a7fc640 1 -- 172.21.15.5:0/1589975188 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c140a5de0 con 0x7f1c1c0b1f70 2023-07-14T13:12:04.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.198+0000 7f1c21ddf640 1 -- 172.21.15.5:0/1589975188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c0b1f70 msgr2=0x7f1c1c0d22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:04.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.198+0000 7f1c21ddf640 1 --2- 172.21.15.5:0/1589975188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c0b1f70 0x7f1c1c0d22e0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009d90 tx=0x7f1c1401c920 comp rx=0 tx=0).stop 2023-07-14T13:12:04.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.198+0000 7f1c21ddf640 1 -- 172.21.15.5:0/1589975188 shutdown_connections 2023-07-14T13:12:04.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.198+0000 7f1c21ddf640 1 --2- 172.21.15.5:0/1589975188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c0b1f70 0x7f1c1c0d22e0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:04.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.198+0000 7f1c21ddf640 1 --2- 172.21.15.5:0/1589975188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c1c0d06b0 0x7f1c1c0b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:04.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.198+0000 7f1c21ddf640 1 -- 172.21.15.5:0/1589975188 >> 172.21.15.5:0/1589975188 conn(0x7f1c1c0659d0 msgr2=0x7f1c1c09b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:04.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.198+0000 7f1c21ddf640 1 -- 172.21.15.5:0/1589975188 shutdown_connections 2023-07-14T13:12:04.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.198+0000 7f1c21ddf640 1 -- 172.21.15.5:0/1589975188 wait complete. 2023-07-14T13:12:04.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.202+0000 7f1c21ddf640 1 Processor -- start 2023-07-14T13:12:04.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.202+0000 7f1c21ddf640 1 -- start start 2023-07-14T13:12:04.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.202+0000 7f1c21ddf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c1c0b1f70 0x7f1c1c0c4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:04.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.202+0000 7f1c21ddf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c0d06b0 0x7f1c1c142590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:04.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.202+0000 7f1c21ddf640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c1c0c5510 0x7f1c1c142ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:04.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.202+0000 7f1c21ddf640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c144cd0 con 0x7f1c1c0d06b0 2023-07-14T13:12:04.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.202+0000 7f1c21ddf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c154f50 con 0x7f1c1c0b1f70 2023-07-14T13:12:04.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.202+0000 7f1c21ddf640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c155230 con 0x7f1c1c0c5510 2023-07-14T13:12:04.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.202+0000 7f1c1affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c0d06b0 0x7f1c1c142590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:04.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.202+0000 7f1c1affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c0d06b0 0x7f1c1c142590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35886/0 (socket says 172.21.15.5:35886) 2023-07-14T13:12:04.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.202+0000 7f1c1affd640 1 -- 172.21.15.5:0/4174778143 learned_addr learned my addr 172.21.15.5:0/4174778143 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:04.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.202+0000 7f1c1bfff640 1 --2- 172.21.15.5:0/4174778143 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c1c0c5510 0x7f1c1c142ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:04.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.202+0000 7f1c1b7fe640 1 --2- 172.21.15.5:0/4174778143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c1c0b1f70 0x7f1c1c0c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:04.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.202+0000 7f1c1affd640 1 -- 172.21.15.5:0/4174778143 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c1c0c5510 msgr2=0x7f1c1c142ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:04.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.202+0000 7f1c1affd640 1 --2- 172.21.15.5:0/4174778143 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c1c0c5510 0x7f1c1c142ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:04.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.202+0000 7f1c1affd640 1 -- 172.21.15.5:0/4174778143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c1c0b1f70 msgr2=0x7f1c1c0c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:04.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.202+0000 7f1c1affd640 1 --2- 172.21.15.5:0/4174778143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c1c0b1f70 0x7f1c1c0c4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:04.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.202+0000 7f1c1affd640 1 -- 172.21.15.5:0/4174778143 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c14009a70 con 0x7f1c1c0d06b0 2023-07-14T13:12:04.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.206+0000 7f1c1affd640 1 --2- 172.21.15.5:0/4174778143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c0d06b0 0x7f1c1c142590 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000c500 tx=0x7f1c1000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:04.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.206+0000 7f1c03fff640 1 -- 172.21.15.5:0/4174778143 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10005cf0 con 0x7f1c1c0d06b0 2023-07-14T13:12:04.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.206+0000 7f1c03fff640 1 -- 172.21.15.5:0/4174778143 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c10005e50 con 0x7f1c1c0d06b0 2023-07-14T13:12:04.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.206+0000 7f1c03fff640 1 -- 172.21.15.5:0/4174778143 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c100072f0 con 0x7f1c1c0d06b0 2023-07-14T13:12:04.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.206+0000 7f1c21ddf640 1 -- 172.21.15.5:0/4174778143 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1c155510 con 0x7f1c1c0d06b0 2023-07-14T13:12:04.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.206+0000 7f1c21ddf640 1 -- 172.21.15.5:0/4174778143 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1c0c4cb0 con 0x7f1c1c0d06b0 2023-07-14T13:12:04.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.206+0000 7f1c21ddf640 1 -- 172.21.15.5:0/4174778143 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c1c072e70 con 0x7f1c1c0d06b0 2023-07-14T13:12:04.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.206+0000 7f1c03fff640 1 -- 172.21.15.5:0/4174778143 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 59) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f1c10007450 con 0x7f1c1c0d06b0 2023-07-14T13:12:04.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.206+0000 7f1c03fff640 1 --2- 172.21.15.5:0/4174778143 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f1c080664c0 0x7f1c08068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:04.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.206+0000 7f1c03fff640 1 -- 172.21.15.5:0/4174778143 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f1c10083840 con 0x7f1c1c0d06b0 2023-07-14T13:12:04.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.206+0000 7f1c1b7fe640 1 -- 172.21.15.5:0/4174778143 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f1c080664c0 msgr2=0x7f1c08068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3453046028 2023-07-14T13:12:04.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.206+0000 7f1c1b7fe640 1 --2- 172.21.15.5:0/4174778143 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f1c080664c0 0x7f1c08068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:12:04.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.214+0000 7f1c03fff640 1 -- 172.21.15.5:0/4174778143 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f1c100508a0 con 0x7f1c1c0d06b0 2023-07-14T13:12:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.374+0000 7f1c21ddf640 1 -- 172.21.15.5:0/4174778143 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c1c0678d0 con 0x7f1c1c0d06b0 2023-07-14T13:12:04.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.378+0000 7f1c03fff640 1 -- 172.21.15.5:0/4174778143 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+18750 (secure 0 0 0) 0x7f1c10053ec0 con 0x7f1c1c0d06b0 2023-07-14T13:12:04.411 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:04.411 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":128,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:11:45.510842+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:11:26.406551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-14T13:11:27.287297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/629835727":"2023-07-15T13:11:45.510811+0000","172.21.15.154:0/2051265191":"2023-07-15T13:11:45.510811+0000","172.21.15.154:6833/938367911":"2023-07-15T13:11:45.510811+0000","172.21.15.154:6832/938367911":"2023-07-15T13:11:45.510811+0000","172.21.15.154:0/270189207":"2023-07-15T13:11:45.510811+0000","172.21.15.154:0/3646451858":"2023-07-15T13:11:45.510811+0000","172.21.15.154:0/2058838315":"2023-07-15T13:11:45.510811+0000","172.21.15.154:0/1164555553":"2023-07-15T13:11:45.510811+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:12:04.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.378+0000 7f1c21ddf640 1 -- 172.21.15.5:0/4174778143 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f1c080664c0 msgr2=0x7f1c08068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:12:04.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.378+0000 7f1c21ddf640 1 --2- 172.21.15.5:0/4174778143 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f1c080664c0 0x7f1c08068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:04.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.378+0000 7f1c21ddf640 1 -- 172.21.15.5:0/4174778143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c0d06b0 msgr2=0x7f1c1c142590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:04.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.378+0000 7f1c21ddf640 1 --2- 172.21.15.5:0/4174778143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c0d06b0 0x7f1c1c142590 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000c500 tx=0x7f1c1000c9c0 comp rx=0 tx=0).stop 2023-07-14T13:12:04.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.378+0000 7f1c21ddf640 1 -- 172.21.15.5:0/4174778143 shutdown_connections 2023-07-14T13:12:04.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.378+0000 7f1c21ddf640 1 --2- 172.21.15.5:0/4174778143 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f1c080664c0 0x7f1c08068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:04.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.378+0000 7f1c21ddf640 1 --2- 172.21.15.5:0/4174778143 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c1c0c5510 0x7f1c1c142ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:04.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.378+0000 7f1c21ddf640 1 --2- 172.21.15.5:0/4174778143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c0d06b0 0x7f1c1c142590 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:04.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.378+0000 7f1c21ddf640 1 --2- 172.21.15.5:0/4174778143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c1c0b1f70 0x7f1c1c0c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:04.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.378+0000 7f1c21ddf640 1 -- 172.21.15.5:0/4174778143 >> 172.21.15.5:0/4174778143 conn(0x7f1c1c0659d0 msgr2=0x7f1c1c15cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:04.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.378+0000 7f1c21ddf640 1 -- 172.21.15.5:0/4174778143 shutdown_connections 2023-07-14T13:12:04.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.378+0000 7f1c21ddf640 1 -- 172.21.15.5:0/4174778143 wait complete. 2023-07-14T13:12:04.435 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T13:11:26.406551+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '126', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T13:11:27.287297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '127', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:12:04.436 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:12:04.444 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:04.411+0000 7fbc78a53180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:12:04.481 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:04.446+0000 7f6a8a42d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:12:04.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.550+0000 7fa582163640 1 Processor -- start 2023-07-14T13:12:04.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.550+0000 7fa582163640 1 -- start start 2023-07-14T13:12:04.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.554+0000 7fa582163640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa57c0cc960 0x7fa57c0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:04.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.554+0000 7fa582163640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa57c0b1620 0x7fa57c0ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:04.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.554+0000 7fa582163640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa57c0cd270 con 0x7fa57c160750 2023-07-14T13:12:04.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.554+0000 7fa582163640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa57c0cf710 con 0x7fa57c0b1620 2023-07-14T13:12:04.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.554+0000 7fa582163640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c0cf430 con 0x7fa57c0cc960 2023-07-14T13:12:04.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.554+0000 7fa580960640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa57c0b1620 0x7fa57c0ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:04.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.554+0000 7fa580960640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa57c0b1620 0x7fa57c0ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35888/0 (socket says 172.21.15.5:35888) 2023-07-14T13:12:04.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.554+0000 7fa580960640 1 -- 172.21.15.5:0/1099499536 learned_addr learned my addr 172.21.15.5:0/1099499536 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:04.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.554+0000 7fa581161640 1 --2- 172.21.15.5:0/1099499536 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa57c0cc960 0x7fa57c0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:04.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.554+0000 7fa580960640 1 -- 172.21.15.5:0/1099499536 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa57c0cc960 msgr2=0x7fa57c0ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:04.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.554+0000 7fa580960640 1 --2- 172.21.15.5:0/1099499536 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa57c0cc960 0x7fa57c0ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:04.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.554+0000 7fa580960640 1 -- 172.21.15.5:0/1099499536 >> v1:172.21.15.5:6789/0 conn(0x7fa57c160750 legacy=0x7fa57c0b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:04.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.554+0000 7fa580960640 1 -- 172.21.15.5:0/1099499536 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa57c15fc70 con 0x7fa57c0b1620 2023-07-14T13:12:04.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.558+0000 7fa580960640 1 --2- 172.21.15.5:0/1099499536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa57c0b1620 0x7fa57c0ce950 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fa56c009870 tx=0x7fa56c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be71c2aac38296f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:04.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.558+0000 7fa573fff640 1 -- 172.21.15.5:0/1099499536 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c0aa670 con 0x7fa57c0b1620 2023-07-14T13:12:04.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.558+0000 7fa573fff640 1 -- 172.21.15.5:0/1099499536 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56c0aa7d0 con 0x7fa57c0b1620 2023-07-14T13:12:04.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.558+0000 7fa573fff640 1 -- 172.21.15.5:0/1099499536 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c0aab60 con 0x7fa57c0b1620 2023-07-14T13:12:04.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.558+0000 7fa582163640 1 -- 172.21.15.5:0/1099499536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa57c0b1620 msgr2=0x7fa57c0ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:04.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.558+0000 7fa582163640 1 --2- 172.21.15.5:0/1099499536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa57c0b1620 0x7fa57c0ce950 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fa56c009870 tx=0x7fa56c01c510 comp rx=0 tx=0).stop 2023-07-14T13:12:04.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.558+0000 7fa582163640 1 -- 172.21.15.5:0/1099499536 shutdown_connections 2023-07-14T13:12:04.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.558+0000 7fa582163640 1 --2- 172.21.15.5:0/1099499536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa57c0b1620 0x7fa57c0ce950 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:04.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.558+0000 7fa582163640 1 --2- 172.21.15.5:0/1099499536 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa57c0cc960 0x7fa57c0ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:04.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.558+0000 7fa582163640 1 -- 172.21.15.5:0/1099499536 >> 172.21.15.5:0/1099499536 conn(0x7fa57c069f50 msgr2=0x7fa57c06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:04.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.558+0000 7fa582163640 1 -- 172.21.15.5:0/1099499536 shutdown_connections 2023-07-14T13:12:04.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.558+0000 7fa582163640 1 -- 172.21.15.5:0/1099499536 wait complete. 2023-07-14T13:12:04.594 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:04.559+0000 7fbc78a53180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:12:04.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.558+0000 7fa582163640 1 Processor -- start 2023-07-14T13:12:04.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.558+0000 7fa582163640 1 -- start start 2023-07-14T13:12:04.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.558+0000 7fa582163640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa57c0b1620 0x7fa57c0d2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:04.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.562+0000 7fa582163640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa57c0cc960 0x7fa57c1f5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:04.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.562+0000 7fa582163640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa57c160750 0x7fa57c1521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:04.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.562+0000 7fa582163640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c15a8e0 con 0x7fa57c0b1620 2023-07-14T13:12:04.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.562+0000 7fa582163640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c0b1db0 con 0x7fa57c0cc960 2023-07-14T13:12:04.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.562+0000 7fa582163640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c0b2090 con 0x7fa57c160750 2023-07-14T13:12:04.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.562+0000 7fa581161640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa57c0b1620 0x7fa57c0d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:04.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.562+0000 7fa581161640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa57c0b1620 0x7fa57c0d2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35890/0 (socket says 172.21.15.5:35890) 2023-07-14T13:12:04.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.562+0000 7fa581161640 1 -- 172.21.15.5:0/2855509760 learned_addr learned my addr 172.21.15.5:0/2855509760 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:04.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.562+0000 7fa580960640 1 --2- 172.21.15.5:0/2855509760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa57c0cc960 0x7fa57c1f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:04.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.562+0000 7fa581962640 1 --2- 172.21.15.5:0/2855509760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa57c160750 0x7fa57c1521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:04.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.562+0000 7fa581161640 1 -- 172.21.15.5:0/2855509760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa57c160750 msgr2=0x7fa57c1521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:04.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.562+0000 7fa581161640 1 --2- 172.21.15.5:0/2855509760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa57c160750 0x7fa57c1521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:04.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.562+0000 7fa581161640 1 -- 172.21.15.5:0/2855509760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa57c0cc960 msgr2=0x7fa57c1f5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:04.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.562+0000 7fa581161640 1 --2- 172.21.15.5:0/2855509760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa57c0cc960 0x7fa57c1f5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:04.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.562+0000 7fa581161640 1 -- 172.21.15.5:0/2855509760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56c0094d0 con 0x7fa57c0b1620 2023-07-14T13:12:04.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.562+0000 7fa581161640 1 --2- 172.21.15.5:0/2855509760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa57c0b1620 0x7fa57c0d2870 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fa57800e930 tx=0x7fa57800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:04.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.562+0000 7fa571ffb640 1 -- 172.21.15.5:0/2855509760 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa578009690 con 0x7fa57c0b1620 2023-07-14T13:12:04.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.562+0000 7fa571ffb640 1 -- 172.21.15.5:0/2855509760 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57800ca00 con 0x7fa57c0b1620 2023-07-14T13:12:04.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.562+0000 7fa571ffb640 1 -- 172.21.15.5:0/2855509760 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57800cd70 con 0x7fa57c0b1620 2023-07-14T13:12:04.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.562+0000 7fa582163640 1 -- 172.21.15.5:0/2855509760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa57c0b2370 con 0x7fa57c0b1620 2023-07-14T13:12:04.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.562+0000 7fa582163640 1 -- 172.21.15.5:0/2855509760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa57c0b2930 con 0x7fa57c0b1620 2023-07-14T13:12:04.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.562+0000 7fa582163640 1 -- 172.21.15.5:0/2855509760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa57c04e020 con 0x7fa57c0b1620 2023-07-14T13:12:04.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.562+0000 7fa571ffb640 1 -- 172.21.15.5:0/2855509760 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 59) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fa578013470 con 0x7fa57c0b1620 2023-07-14T13:12:04.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.566+0000 7fa571ffb640 1 --2- 172.21.15.5:0/2855509760 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7fa5600664c0 0x7fa560068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:04.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.566+0000 7fa571ffb640 1 -- 172.21.15.5:0/2855509760 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fa578084510 con 0x7fa57c0b1620 2023-07-14T13:12:04.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.566+0000 7fa580960640 1 -- 172.21.15.5:0/2855509760 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7fa5600664c0 msgr2=0x7fa560068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3453046028 2023-07-14T13:12:04.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.566+0000 7fa580960640 1 --2- 172.21.15.5:0/2855509760 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7fa5600664c0 0x7fa560068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:12:04.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.570+0000 7fa571ffb640 1 -- 172.21.15.5:0/2855509760 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa5780515a0 con 0x7fa57c0b1620 2023-07-14T13:12:04.645 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:04.610+0000 7f6a8a42d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:12:04.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.726+0000 7fa582163640 1 -- 172.21.15.5:0/2855509760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa57c0cfad0 con 0x7fa57c0b1620 2023-07-14T13:12:04.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.730+0000 7fa571ffb640 1 -- 172.21.15.5:0/2855509760 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v128) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa578054bc0 con 0x7fa57c0b1620 2023-07-14T13:12:04.763 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:12:04.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.730+0000 7fa582163640 1 -- 172.21.15.5:0/2855509760 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7fa5600664c0 msgr2=0x7fa560068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:12:04.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.730+0000 7fa582163640 1 --2- 172.21.15.5:0/2855509760 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7fa5600664c0 0x7fa560068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:04.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.730+0000 7fa582163640 1 -- 172.21.15.5:0/2855509760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa57c0b1620 msgr2=0x7fa57c0d2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:04.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.730+0000 7fa582163640 1 --2- 172.21.15.5:0/2855509760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa57c0b1620 0x7fa57c0d2870 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fa57800e930 tx=0x7fa57800edf0 comp rx=0 tx=0).stop 2023-07-14T13:12:04.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.730+0000 7fa582163640 1 -- 172.21.15.5:0/2855509760 shutdown_connections 2023-07-14T13:12:04.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.730+0000 7fa582163640 1 --2- 172.21.15.5:0/2855509760 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7fa5600664c0 0x7fa560068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:04.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.730+0000 7fa582163640 1 --2- 172.21.15.5:0/2855509760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa57c160750 0x7fa57c1521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:04.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.730+0000 7fa582163640 1 --2- 172.21.15.5:0/2855509760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa57c0cc960 0x7fa57c1f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:04.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.730+0000 7fa582163640 1 --2- 172.21.15.5:0/2855509760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa57c0b1620 0x7fa57c0d2870 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:04.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.730+0000 7fa582163640 1 -- 172.21.15.5:0/2855509760 >> 172.21.15.5:0/2855509760 conn(0x7fa57c069f50 msgr2=0x7fa57c155b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:04.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.730+0000 7fa582163640 1 -- 172.21.15.5:0/2855509760 shutdown_connections 2023-07-14T13:12:04.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.730+0000 7fa582163640 1 -- 172.21.15.5:0/2855509760 wait complete. 2023-07-14T13:12:04.785 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:12:04.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.942+0000 7f6e32434640 1 Processor -- start 2023-07-14T13:12:04.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.942+0000 7f6e32434640 1 -- start start 2023-07-14T13:12:04.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.942+0000 7f6e32434640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e2c15bde0 0x7f6e2c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:04.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.942+0000 7f6e32434640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6e2c0d2300 0x7f6e2c0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:04.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.942+0000 7f6e32434640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e2c0b04c0 con 0x7f6e2c0d2fc0 2023-07-14T13:12:04.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.942+0000 7f6e32434640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e2c0d2ce0 con 0x7f6e2c0d2300 2023-07-14T13:12:04.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.942+0000 7f6e32434640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c15c1b0 con 0x7f6e2c15bde0 2023-07-14T13:12:04.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.942+0000 7f6e2bfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e2c15bde0 0x7f6e2c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:04.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.942+0000 7f6e309d1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6e2c0d2300 0x7f6e2c0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:04.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.942+0000 7f6e2bfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e2c15bde0 0x7f6e2c0d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:57950/0 (socket says 172.21.15.5:57950) 2023-07-14T13:12:04.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.942+0000 7f6e2bfff640 1 -- 172.21.15.5:0/2074886432 learned_addr learned my addr 172.21.15.5:0/2074886432 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:04.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.942+0000 7f6e2bfff640 1 -- 172.21.15.5:0/2074886432 >> v2:172.21.15.154:3300/0 conn(0x7f6e2c0d2300 msgr2=0x7f6e2c0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:04.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.942+0000 7f6e2bfff640 1 --2- 172.21.15.5:0/2074886432 >> v2:172.21.15.154:3300/0 conn(0x7f6e2c0d2300 0x7f6e2c0d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:04.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.942+0000 7f6e2bfff640 1 -- 172.21.15.5:0/2074886432 >> v1:172.21.15.154:6789/0 conn(0x7f6e2c0d2fc0 legacy=0x7f6e2c0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:04.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.942+0000 7f6e2bfff640 1 -- 172.21.15.5:0/2074886432 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2c0b1060 con 0x7f6e2c15bde0 2023-07-14T13:12:04.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.946+0000 7f6e2bfff640 1 --2- 172.21.15.5:0/2074886432 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e2c15bde0 0x7f6e2c0d0270 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c006fd0 tx=0x7f6e1c01c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a889e28c46cbda89 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:04.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.946+0000 7f6e2affd640 1 -- 172.21.15.5:0/2074886432 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c0a7070 con 0x7f6e2c15bde0 2023-07-14T13:12:04.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.946+0000 7f6e2affd640 1 -- 172.21.15.5:0/2074886432 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1c0ab430 con 0x7f6e2c15bde0 2023-07-14T13:12:04.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.946+0000 7f6e2affd640 1 -- 172.21.15.5:0/2074886432 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c0ab7c0 con 0x7f6e2c15bde0 2023-07-14T13:12:04.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.946+0000 7f6e32434640 1 -- 172.21.15.5:0/2074886432 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e2c15bde0 msgr2=0x7f6e2c0d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:04.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.946+0000 7f6e32434640 1 --2- 172.21.15.5:0/2074886432 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e2c15bde0 0x7f6e2c0d0270 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c006fd0 tx=0x7f6e1c01c520 comp rx=0 tx=0).stop 2023-07-14T13:12:04.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.946+0000 7f6e32434640 1 -- 172.21.15.5:0/2074886432 shutdown_connections 2023-07-14T13:12:04.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.946+0000 7f6e32434640 1 --2- 172.21.15.5:0/2074886432 >> v2:172.21.15.154:3300/0 conn(0x7f6e2c0d2300 0x7f6e2c0d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:04.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.946+0000 7f6e32434640 1 --2- 172.21.15.5:0/2074886432 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e2c15bde0 0x7f6e2c0d0270 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:04.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.946+0000 7f6e32434640 1 -- 172.21.15.5:0/2074886432 >> 172.21.15.5:0/2074886432 conn(0x7f6e2c0659d0 msgr2=0x7f6e2c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:04.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.946+0000 7f6e32434640 1 -- 172.21.15.5:0/2074886432 shutdown_connections 2023-07-14T13:12:04.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.946+0000 7f6e32434640 1 -- 172.21.15.5:0/2074886432 wait complete. 2023-07-14T13:12:04.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.950+0000 7f6e32434640 1 Processor -- start 2023-07-14T13:12:04.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.950+0000 7f6e32434640 1 -- start start 2023-07-14T13:12:04.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.950+0000 7f6e32434640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e2c0d2300 0x7f6e2c0c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:04.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.950+0000 7f6e32434640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e2c0d2fc0 0x7f6e2c0c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:04.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.950+0000 7f6e32434640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e2c15bde0 0x7f6e2c14cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:04.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.950+0000 7f6e32434640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c14cc00 con 0x7f6e2c15bde0 2023-07-14T13:12:04.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.950+0000 7f6e32434640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c13a2f0 con 0x7f6e2c0d2300 2023-07-14T13:12:04.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.950+0000 7f6e32434640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c13a5d0 con 0x7f6e2c0d2fc0 2023-07-14T13:12:04.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.950+0000 7f6e309d1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e2c15bde0 0x7f6e2c14cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:04.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.950+0000 7f6e2bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e2c0d2300 0x7f6e2c0c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:04.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.950+0000 7f6e2bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e2c0d2300 0x7f6e2c0c5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:36730/0 (socket says 172.21.15.5:36730) 2023-07-14T13:12:04.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.950+0000 7f6e2bfff640 1 -- 172.21.15.5:0/3135740806 learned_addr learned my addr 172.21.15.5:0/3135740806 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:04.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.950+0000 7f6e2b7fe640 1 --2- 172.21.15.5:0/3135740806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e2c0d2fc0 0x7f6e2c0c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:04.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.950+0000 7f6e2bfff640 1 -- 172.21.15.5:0/3135740806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e2c0d2fc0 msgr2=0x7f6e2c0c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:04.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.950+0000 7f6e2bfff640 1 --2- 172.21.15.5:0/3135740806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e2c0d2fc0 0x7f6e2c0c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:04.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.950+0000 7f6e2bfff640 1 -- 172.21.15.5:0/3135740806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e2c15bde0 msgr2=0x7f6e2c14cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:04.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.950+0000 7f6e2bfff640 1 --2- 172.21.15.5:0/3135740806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e2c15bde0 0x7f6e2c14cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:04.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.950+0000 7f6e2bfff640 1 -- 172.21.15.5:0/3135740806 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1c009480 con 0x7f6e2c0d2300 2023-07-14T13:12:04.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.950+0000 7f6e2bfff640 1 --2- 172.21.15.5:0/3135740806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e2c0d2300 0x7f6e2c0c5ff0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c0ad040 tx=0x7f6e1c0192c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:04.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.950+0000 7f6e28ff9640 1 -- 172.21.15.5:0/3135740806 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c003bf0 con 0x7f6e2c0d2300 2023-07-14T13:12:04.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.950+0000 7f6e28ff9640 1 -- 172.21.15.5:0/3135740806 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1c003d50 con 0x7f6e2c0d2300 2023-07-14T13:12:04.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.950+0000 7f6e28ff9640 1 -- 172.21.15.5:0/3135740806 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c0ab7a0 con 0x7f6e2c0d2300 2023-07-14T13:12:04.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.950+0000 7f6e32434640 1 -- 172.21.15.5:0/3135740806 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e2c13a8b0 con 0x7f6e2c0d2300 2023-07-14T13:12:04.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.950+0000 7f6e32434640 1 -- 172.21.15.5:0/3135740806 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e2c13ae70 con 0x7f6e2c0d2300 2023-07-14T13:12:04.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.954+0000 7f6e32434640 1 -- 172.21.15.5:0/3135740806 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e2c13b060 con 0x7f6e2c0d2300 2023-07-14T13:12:04.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.954+0000 7f6e28ff9640 1 -- 172.21.15.5:0/3135740806 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 59) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f6e1c0ab900 con 0x7f6e2c0d2300 2023-07-14T13:12:04.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.954+0000 7f6e28ff9640 1 --2- 172.21.15.5:0/3135740806 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f6e180664c0 0x7f6e18068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:04.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.954+0000 7f6e28ff9640 1 -- 172.21.15.5:0/3135740806 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f6e1c11e990 con 0x7f6e2c0d2300 2023-07-14T13:12:04.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.954+0000 7f6e2b7fe640 1 -- 172.21.15.5:0/3135740806 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f6e180664c0 msgr2=0x7f6e18068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3453046028 2023-07-14T13:12:04.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.954+0000 7f6e2b7fe640 1 --2- 172.21.15.5:0/3135740806 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f6e180664c0 0x7f6e18068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:12:04.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:04.962+0000 7f6e28ff9640 1 -- 172.21.15.5:0/3135740806 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6e1c0eb8d0 con 0x7f6e2c0d2300 2023-07-14T13:12:05.075 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:05.043+0000 7fbc78a53180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:12:05.134 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:05.099+0000 7fbc78a53180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:12:05.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.118+0000 7f6e32434640 1 -- 172.21.15.5:0/3135740806 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6e2c0678d0 con 0x7f6e2c0d2300 2023-07-14T13:12:05.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.122+0000 7f6e28ff9640 1 -- 172.21.15.5:0/3135740806 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v128) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6e1c0eeef0 con 0x7f6e2c0d2300 2023-07-14T13:12:05.155 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:12:05.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.122+0000 7f6e32434640 1 -- 172.21.15.5:0/3135740806 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f6e180664c0 msgr2=0x7f6e18068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:12:05.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.122+0000 7f6e32434640 1 --2- 172.21.15.5:0/3135740806 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f6e180664c0 0x7f6e18068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:05.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.122+0000 7f6e32434640 1 -- 172.21.15.5:0/3135740806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e2c0d2300 msgr2=0x7f6e2c0c5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:05.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.122+0000 7f6e32434640 1 --2- 172.21.15.5:0/3135740806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e2c0d2300 0x7f6e2c0c5ff0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c0ad040 tx=0x7f6e1c0192c0 comp rx=0 tx=0).stop 2023-07-14T13:12:05.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.122+0000 7f6e32434640 1 -- 172.21.15.5:0/3135740806 shutdown_connections 2023-07-14T13:12:05.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.122+0000 7f6e32434640 1 --2- 172.21.15.5:0/3135740806 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f6e180664c0 0x7f6e18068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:05.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.122+0000 7f6e32434640 1 --2- 172.21.15.5:0/3135740806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e2c15bde0 0x7f6e2c14cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:05.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.122+0000 7f6e32434640 1 --2- 172.21.15.5:0/3135740806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6e2c0d2fc0 0x7f6e2c0c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:05.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.122+0000 7f6e32434640 1 --2- 172.21.15.5:0/3135740806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e2c0d2300 0x7f6e2c0c5ff0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:05.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.122+0000 7f6e32434640 1 -- 172.21.15.5:0/3135740806 >> 172.21.15.5:0/3135740806 conn(0x7f6e2c0659d0 msgr2=0x7f6e2c06afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:05.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.122+0000 7f6e32434640 1 -- 172.21.15.5:0/3135740806 shutdown_connections 2023-07-14T13:12:05.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.122+0000 7f6e32434640 1 -- 172.21.15.5:0/3135740806 wait complete. 2023-07-14T13:12:05.159 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:05.122+0000 7f6a8a42d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:12:05.177 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T13:12:05.189 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:05.155+0000 7fbc78a53180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:12:05.222 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:05.186+0000 7f6a8a42d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:12:05.274 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:05.239+0000 7fbc78a53180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:12:05.321 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:05.246+0000 7f6a8a42d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:12:05.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.290+0000 7f2539ba9640 1 Processor -- start 2023-07-14T13:12:05.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.294+0000 7f2539ba9640 1 -- start start 2023-07-14T13:12:05.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.294+0000 7f2539ba9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f25340b1620 0x7f25340ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:05.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.294+0000 7f2539ba9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2534160750 0x7f253415c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:05.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.294+0000 7f2539ba9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25340cf430 con 0x7f25340cc960 2023-07-14T13:12:05.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.294+0000 7f2539ba9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25340cf710 con 0x7f25340b1620 2023-07-14T13:12:05.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.294+0000 7f2539ba9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253415fc70 con 0x7f2534160750 2023-07-14T13:12:05.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.294+0000 7f2533fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f25340b1620 0x7f25340ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:05.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.294+0000 7f2533fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f25340b1620 0x7f25340ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:36738/0 (socket says 172.21.15.5:36738) 2023-07-14T13:12:05.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.294+0000 7f2533fff640 1 -- 172.21.15.5:0/2861984667 learned_addr learned my addr 172.21.15.5:0/2861984667 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:05.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.294+0000 7f25393a8640 1 --2- 172.21.15.5:0/2861984667 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2534160750 0x7f253415c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:05.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.294+0000 7f2533fff640 1 -- 172.21.15.5:0/2861984667 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2534160750 msgr2=0x7f253415c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:05.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.294+0000 7f2533fff640 1 --2- 172.21.15.5:0/2861984667 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2534160750 0x7f253415c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:05.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.294+0000 7f2533fff640 1 -- 172.21.15.5:0/2861984667 >> v1:172.21.15.154:6789/0 conn(0x7f25340cc960 legacy=0x7f25340ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:05.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.294+0000 7f2533fff640 1 -- 172.21.15.5:0/2861984667 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253415ff50 con 0x7f25340b1620 2023-07-14T13:12:05.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.298+0000 7f2533fff640 1 --2- 172.21.15.5:0/2861984667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25340b1620 0x7f25340ce950 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f2520009870 tx=0x7f252001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=913036bf23f5f0ae server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:05.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.298+0000 7f25337fe640 1 -- 172.21.15.5:0/2861984667 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25200a95f0 con 0x7f25340b1620 2023-07-14T13:12:05.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.298+0000 7f25337fe640 1 -- 172.21.15.5:0/2861984667 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25200a9750 con 0x7f25340b1620 2023-07-14T13:12:05.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.298+0000 7f25337fe640 1 -- 172.21.15.5:0/2861984667 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25200a9ae0 con 0x7f25340b1620 2023-07-14T13:12:05.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.298+0000 7f2539ba9640 1 -- 172.21.15.5:0/2861984667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25340b1620 msgr2=0x7f25340ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:05.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.298+0000 7f2539ba9640 1 --2- 172.21.15.5:0/2861984667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25340b1620 0x7f25340ce950 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f2520009870 tx=0x7f252001c510 comp rx=0 tx=0).stop 2023-07-14T13:12:05.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.298+0000 7f2539ba9640 1 -- 172.21.15.5:0/2861984667 shutdown_connections 2023-07-14T13:12:05.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.298+0000 7f2539ba9640 1 --2- 172.21.15.5:0/2861984667 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2534160750 0x7f253415c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:05.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.298+0000 7f2539ba9640 1 --2- 172.21.15.5:0/2861984667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25340b1620 0x7f25340ce950 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:05.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.298+0000 7f2539ba9640 1 -- 172.21.15.5:0/2861984667 >> 172.21.15.5:0/2861984667 conn(0x7f2534069f50 msgr2=0x7f253406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:05.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.298+0000 7f2539ba9640 1 -- 172.21.15.5:0/2861984667 shutdown_connections 2023-07-14T13:12:05.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.298+0000 7f2539ba9640 1 -- 172.21.15.5:0/2861984667 wait complete. 2023-07-14T13:12:05.335 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:05.299+0000 7fbc78a53180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:12:05.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.298+0000 7f2539ba9640 1 Processor -- start 2023-07-14T13:12:05.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.298+0000 7f2539ba9640 1 -- start start 2023-07-14T13:12:05.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.302+0000 7f2539ba9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25340b1620 0x7f2534153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:05.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.302+0000 7f2539ba9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25340cc960 0x7f25340c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:05.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.302+0000 7f2539ba9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2534160750 0x7f25340c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:05.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.302+0000 7f2539ba9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25340c6ed0 con 0x7f25340cc960 2023-07-14T13:12:05.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.302+0000 7f2539ba9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25340c6860 con 0x7f2534160750 2023-07-14T13:12:05.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.302+0000 7f2539ba9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25340c6b40 con 0x7f25340b1620 2023-07-14T13:12:05.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.302+0000 7f2533fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25340cc960 0x7f25340c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:05.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.302+0000 7f2538ba7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25340b1620 0x7f2534153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:05.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.302+0000 7f2533fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25340cc960 0x7f25340c5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35910/0 (socket says 172.21.15.5:35910) 2023-07-14T13:12:05.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.302+0000 7f2533fff640 1 -- 172.21.15.5:0/1964022487 learned_addr learned my addr 172.21.15.5:0/1964022487 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:05.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.302+0000 7f25393a8640 1 --2- 172.21.15.5:0/1964022487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2534160750 0x7f25340c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:05.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.302+0000 7f2533fff640 1 -- 172.21.15.5:0/1964022487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25340b1620 msgr2=0x7f2534153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:05.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.302+0000 7f2533fff640 1 --2- 172.21.15.5:0/1964022487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25340b1620 0x7f2534153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:05.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.302+0000 7f2533fff640 1 -- 172.21.15.5:0/1964022487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2534160750 msgr2=0x7f25340c6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:05.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.302+0000 7f2533fff640 1 --2- 172.21.15.5:0/1964022487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2534160750 0x7f25340c6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:05.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.302+0000 7f2533fff640 1 -- 172.21.15.5:0/1964022487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25200094d0 con 0x7f25340cc960 2023-07-14T13:12:05.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.302+0000 7f25393a8640 1 --2- 172.21.15.5:0/1964022487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2534160750 0x7f25340c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:05.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.302+0000 7f2538ba7640 1 --2- 172.21.15.5:0/1964022487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25340b1620 0x7f2534153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:05.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.302+0000 7f2533fff640 1 --2- 172.21.15.5:0/1964022487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25340cc960 0x7f25340c5cf0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f25200ab040 tx=0x7f252001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:05.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.302+0000 7f25317fa640 1 -- 172.21.15.5:0/1964022487 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25200b1800 con 0x7f25340cc960 2023-07-14T13:12:05.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.302+0000 7f25317fa640 1 -- 172.21.15.5:0/1964022487 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25200b1960 con 0x7f25340cc960 2023-07-14T13:12:05.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.302+0000 7f25317fa640 1 -- 172.21.15.5:0/1964022487 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25200b1cf0 con 0x7f25340cc960 2023-07-14T13:12:05.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.302+0000 7f2539ba9640 1 -- 172.21.15.5:0/1964022487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25340c7120 con 0x7f25340cc960 2023-07-14T13:12:05.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.302+0000 7f2539ba9640 1 -- 172.21.15.5:0/1964022487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25340cc1a0 con 0x7f25340cc960 2023-07-14T13:12:05.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.302+0000 7f2539ba9640 1 -- 172.21.15.5:0/1964022487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f253404e020 con 0x7f25340cc960 2023-07-14T13:12:05.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.306+0000 7f25317fa640 1 -- 172.21.15.5:0/1964022487 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 59) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f25200a8350 con 0x7f25340cc960 2023-07-14T13:12:05.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.306+0000 7f25317fa640 1 --2- 172.21.15.5:0/1964022487 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f25180664c0 0x7f2518068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:05.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.306+0000 7f25317fa640 1 -- 172.21.15.5:0/1964022487 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f252011ee10 con 0x7f25340cc960 2023-07-14T13:12:05.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.306+0000 7f2538ba7640 1 -- 172.21.15.5:0/1964022487 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f25180664c0 msgr2=0x7f2518068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3453046028 2023-07-14T13:12:05.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.306+0000 7f2538ba7640 1 --2- 172.21.15.5:0/1964022487 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f25180664c0 0x7f2518068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:12:05.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.310+0000 7f25317fa640 1 -- 172.21.15.5:0/1964022487 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2520122030 con 0x7f25340cc960 2023-07-14T13:12:05.376 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:05.342+0000 7f6a8a42d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:12:05.417 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:05.383+0000 7fbc78a53180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:12:05.436 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:05.402+0000 7f6a8a42d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:12:05.473 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:05.439+0000 7fbc78a53180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:12:05.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.462+0000 7f2539ba9640 1 -- 172.21.15.5:0/1964022487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f25340c6c80 con 0x7f25340cc960 2023-07-14T13:12:05.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.462+0000 7f25317fa640 1 -- 172.21.15.5:0/1964022487 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v128) v1 ==== 104+0+11 (secure 0 0 0) 0x7f25200ebce0 con 0x7f25340cc960 2023-07-14T13:12:05.499 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T13:12:05.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.466+0000 7f2539ba9640 1 -- 172.21.15.5:0/1964022487 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f25180664c0 msgr2=0x7f2518068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:12:05.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.466+0000 7f2539ba9640 1 --2- 172.21.15.5:0/1964022487 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f25180664c0 0x7f2518068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:05.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.466+0000 7f2539ba9640 1 -- 172.21.15.5:0/1964022487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25340cc960 msgr2=0x7f25340c5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:05.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.466+0000 7f2539ba9640 1 --2- 172.21.15.5:0/1964022487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25340cc960 0x7f25340c5cf0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f25200ab040 tx=0x7f252001ad50 comp rx=0 tx=0).stop 2023-07-14T13:12:05.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.466+0000 7f2539ba9640 1 -- 172.21.15.5:0/1964022487 shutdown_connections 2023-07-14T13:12:05.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.466+0000 7f2539ba9640 1 --2- 172.21.15.5:0/1964022487 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f25180664c0 0x7f2518068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:05.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.466+0000 7f2539ba9640 1 --2- 172.21.15.5:0/1964022487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2534160750 0x7f25340c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:05.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.466+0000 7f2539ba9640 1 --2- 172.21.15.5:0/1964022487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25340cc960 0x7f25340c5cf0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:05.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.466+0000 7f2539ba9640 1 --2- 172.21.15.5:0/1964022487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25340b1620 0x7f2534153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:05.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.466+0000 7f2539ba9640 1 -- 172.21.15.5:0/1964022487 >> 172.21.15.5:0/1964022487 conn(0x7f2534069f50 msgr2=0x7f25340ccd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:05.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.466+0000 7f2539ba9640 1 -- 172.21.15.5:0/1964022487 shutdown_connections 2023-07-14T13:12:05.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.466+0000 7f2539ba9640 1 -- 172.21.15.5:0/1964022487 wait complete. 2023-07-14T13:12:05.521 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T13:12:05.527 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:05.494+0000 7f6a8a42d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:12:05.590 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:05.554+0000 7f6a8a42d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:12:05.615 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:05.583+0000 7fbc78a53180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:12:05.673 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:05.639+0000 7fbc78a53180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:12:05.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.642+0000 7f82a9619640 1 Processor -- start 2023-07-14T13:12:05.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.642+0000 7f82a9619640 1 -- start start 2023-07-14T13:12:05.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.646+0000 7f82a9619640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f82a40b1620 0x7f82a40ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:05.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.646+0000 7f82a9619640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82a4160750 0x7f82a415c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:05.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.646+0000 7f82a9619640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a40cf430 con 0x7f82a40cc960 2023-07-14T13:12:05.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.646+0000 7f82a9619640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a40cf710 con 0x7f82a40b1620 2023-07-14T13:12:05.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.646+0000 7f82a9619640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a415fc70 con 0x7f82a4160750 2023-07-14T13:12:05.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.646+0000 7f82a3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f82a40cc960 0x7f82a40ccd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46848/0 (socket says 172.21.15.5:46848) 2023-07-14T13:12:05.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.646+0000 7f82a3fff640 1 -- 172.21.15.5:0/3197504744 learned_addr learned my addr 172.21.15.5:0/3197504744 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:05.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.646+0000 7f82a37fe640 1 --2- 172.21.15.5:0/3197504744 >> v2:172.21.15.154:3300/0 conn(0x7f82a40b1620 0x7f82a40ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:05.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.646+0000 7f82a8e18640 1 --2- 172.21.15.5:0/3197504744 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82a4160750 0x7f82a415c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:05.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.646+0000 7f82a2ffd640 1 -- 172.21.15.5:0/3197504744 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 739626672 0 0) 0x7f82a40cf430 con 0x7f82a40cc960 2023-07-14T13:12:05.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.646+0000 7f82a2ffd640 1 -- 172.21.15.5:0/3197504744 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f828c003530 con 0x7f82a40cc960 2023-07-14T13:12:05.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.646+0000 7f82a8e18640 1 -- 172.21.15.5:0/3197504744 >> v2:172.21.15.154:3300/0 conn(0x7f82a40b1620 msgr2=0x7f82a40ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:05.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.646+0000 7f82a8e18640 1 --2- 172.21.15.5:0/3197504744 >> v2:172.21.15.154:3300/0 conn(0x7f82a40b1620 0x7f82a40ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:05.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.646+0000 7f82a8e18640 1 -- 172.21.15.5:0/3197504744 >> v1:172.21.15.5:6789/0 conn(0x7f82a40cc960 legacy=0x7f82a40ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:05.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.646+0000 7f82a8e18640 1 -- 172.21.15.5:0/3197504744 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a415ff50 con 0x7f82a4160750 2023-07-14T13:12:05.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.646+0000 7f82a37fe640 1 --2- 172.21.15.5:0/3197504744 >> v2:172.21.15.154:3300/0 conn(0x7f82a40b1620 0x7f82a40ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:05.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.650+0000 7f82a8e18640 1 --2- 172.21.15.5:0/3197504744 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82a4160750 0x7f82a415c310 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f829c009d90 tx=0x7f829c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d01564e598d400c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:05.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.650+0000 7f82a2ffd640 1 -- 172.21.15.5:0/3197504744 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c0a5a00 con 0x7f82a4160750 2023-07-14T13:12:05.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.650+0000 7f82a2ffd640 1 -- 172.21.15.5:0/3197504744 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829c0a5b60 con 0x7f82a4160750 2023-07-14T13:12:05.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.650+0000 7f82a2ffd640 1 -- 172.21.15.5:0/3197504744 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c0ad440 con 0x7f82a4160750 2023-07-14T13:12:05.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.650+0000 7f82a9619640 1 -- 172.21.15.5:0/3197504744 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82a4160750 msgr2=0x7f82a415c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:05.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.650+0000 7f82a9619640 1 --2- 172.21.15.5:0/3197504744 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82a4160750 0x7f82a415c310 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f829c009d90 tx=0x7f829c01c920 comp rx=0 tx=0).stop 2023-07-14T13:12:05.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.650+0000 7f82a9619640 1 -- 172.21.15.5:0/3197504744 shutdown_connections 2023-07-14T13:12:05.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.650+0000 7f82a9619640 1 --2- 172.21.15.5:0/3197504744 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82a4160750 0x7f82a415c310 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:05.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.650+0000 7f82a9619640 1 --2- 172.21.15.5:0/3197504744 >> v2:172.21.15.154:3300/0 conn(0x7f82a40b1620 0x7f82a40ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:05.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.650+0000 7f82a9619640 1 -- 172.21.15.5:0/3197504744 >> 172.21.15.5:0/3197504744 conn(0x7f82a4069f50 msgr2=0x7f82a406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:05.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.650+0000 7f82a9619640 1 -- 172.21.15.5:0/3197504744 shutdown_connections 2023-07-14T13:12:05.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.650+0000 7f82a9619640 1 -- 172.21.15.5:0/3197504744 wait complete. 2023-07-14T13:12:05.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.650+0000 7f82a9619640 1 Processor -- start 2023-07-14T13:12:05.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.650+0000 7f82a9619640 1 -- start start 2023-07-14T13:12:05.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.654+0000 7f82a9619640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82a40b1620 0x7f82a4151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:05.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.654+0000 7f82a9619640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82a40cc960 0x7f82a40b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:05.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.654+0000 7f82a9619640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82a4160750 0x7f82a40b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:05.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.654+0000 7f82a9619640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a4151c30 con 0x7f82a4160750 2023-07-14T13:12:05.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.654+0000 7f82a9619640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a4151a50 con 0x7f82a40b1620 2023-07-14T13:12:05.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.654+0000 7f82a9619640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a4151e80 con 0x7f82a40cc960 2023-07-14T13:12:05.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.654+0000 7f82a8e18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82a4160750 0x7f82a40b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:05.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.654+0000 7f82a8e18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82a4160750 0x7f82a40b4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35926/0 (socket says 172.21.15.5:35926) 2023-07-14T13:12:05.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.654+0000 7f82a3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82a40b1620 0x7f82a4151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:05.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.654+0000 7f82a8e18640 1 -- 172.21.15.5:0/45161555 learned_addr learned my addr 172.21.15.5:0/45161555 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:05.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.654+0000 7f82a37fe640 1 --2- 172.21.15.5:0/45161555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82a40cc960 0x7f82a40b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:05.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.654+0000 7f82a8e18640 1 -- 172.21.15.5:0/45161555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82a40cc960 msgr2=0x7f82a40b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:05.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.654+0000 7f82a8e18640 1 --2- 172.21.15.5:0/45161555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82a40cc960 0x7f82a40b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:05.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.654+0000 7f82a8e18640 1 -- 172.21.15.5:0/45161555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82a40b1620 msgr2=0x7f82a4151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:05.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.654+0000 7f82a8e18640 1 --2- 172.21.15.5:0/45161555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82a40b1620 0x7f82a4151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:05.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.654+0000 7f82a8e18640 1 -- 172.21.15.5:0/45161555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8298009420 con 0x7f82a4160750 2023-07-14T13:12:05.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.654+0000 7f82a8e18640 1 --2- 172.21.15.5:0/45161555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82a4160750 0x7f82a40b4ff0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f829c01afd0 tx=0x7f829c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:05.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.654+0000 7f82a0ff9640 1 -- 172.21.15.5:0/45161555 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c0ade70 con 0x7f82a4160750 2023-07-14T13:12:05.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.654+0000 7f82a0ff9640 1 -- 172.21.15.5:0/45161555 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829c009450 con 0x7f82a4160750 2023-07-14T13:12:05.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.654+0000 7f82a9619640 1 -- 172.21.15.5:0/45161555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f829c009a70 con 0x7f82a4160750 2023-07-14T13:12:05.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.654+0000 7f82a0ff9640 1 -- 172.21.15.5:0/45161555 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c0b7610 con 0x7f82a4160750 2023-07-14T13:12:05.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.654+0000 7f82a9619640 1 -- 172.21.15.5:0/45161555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a4152440 con 0x7f82a4160750 2023-07-14T13:12:05.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.654+0000 7f82a9619640 1 -- 172.21.15.5:0/45161555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a404e020 con 0x7f82a4160750 2023-07-14T13:12:05.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.658+0000 7f82a0ff9640 1 -- 172.21.15.5:0/45161555 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 59) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f829c0b4050 con 0x7f82a4160750 2023-07-14T13:12:05.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.658+0000 7f82a0ff9640 1 --2- 172.21.15.5:0/45161555 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f82900664f0 0x7f82900689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:05.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.658+0000 7f82a0ff9640 1 -- 172.21.15.5:0/45161555 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f829c11f9a0 con 0x7f82a4160750 2023-07-14T13:12:05.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.658+0000 7f82a3fff640 1 -- 172.21.15.5:0/45161555 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f82900664f0 msgr2=0x7f82900689a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3453046028 2023-07-14T13:12:05.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.658+0000 7f82a3fff640 1 --2- 172.21.15.5:0/45161555 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f82900664f0 0x7f82900689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:12:05.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.662+0000 7f82a0ff9640 1 -- 172.21.15.5:0/45161555 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f829c0eca00 con 0x7f82a4160750 2023-07-14T13:12:05.745 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:05.710+0000 7f6a8a42d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:12:05.807 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:05.774+0000 7f6a8a42d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:12:05.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.818+0000 7f82a9619640 1 -- 172.21.15.5:0/45161555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f82a40cfad0 con 0x7f82a4160750 2023-07-14T13:12:05.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.818+0000 7f82a0ff9640 1 -- 172.21.15.5:0/45161555 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v128) v1 ==== 100+0+11 (secure 0 0 0) 0x7f829c0f0020 con 0x7f82a4160750 2023-07-14T13:12:05.853 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T13:12:05.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.822+0000 7f82a9619640 1 -- 172.21.15.5:0/45161555 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f82900664f0 msgr2=0x7f82900689a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:12:05.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.822+0000 7f82a9619640 1 --2- 172.21.15.5:0/45161555 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f82900664f0 0x7f82900689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:05.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.822+0000 7f82a9619640 1 -- 172.21.15.5:0/45161555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82a4160750 msgr2=0x7f82a40b4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:05.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.822+0000 7f82a9619640 1 --2- 172.21.15.5:0/45161555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82a4160750 0x7f82a40b4ff0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f829c01afd0 tx=0x7f829c0196c0 comp rx=0 tx=0).stop 2023-07-14T13:12:05.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.822+0000 7f82a9619640 1 -- 172.21.15.5:0/45161555 shutdown_connections 2023-07-14T13:12:05.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.822+0000 7f82a9619640 1 --2- 172.21.15.5:0/45161555 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f82900664f0 0x7f82900689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:05.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.822+0000 7f82a9619640 1 --2- 172.21.15.5:0/45161555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82a4160750 0x7f82a40b4ff0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:05.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.822+0000 7f82a9619640 1 --2- 172.21.15.5:0/45161555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f82a40cc960 0x7f82a40b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:05.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.822+0000 7f82a9619640 1 --2- 172.21.15.5:0/45161555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82a40b1620 0x7f82a4151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:05.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.822+0000 7f82a9619640 1 -- 172.21.15.5:0/45161555 >> 172.21.15.5:0/45161555 conn(0x7f82a4069f50 msgr2=0x7f82a40b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:05.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.822+0000 7f82a9619640 1 -- 172.21.15.5:0/45161555 shutdown_connections 2023-07-14T13:12:05.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:05.822+0000 7f82a9619640 1 -- 172.21.15.5:0/45161555 wait complete. 2023-07-14T13:12:05.875 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T13:12:05.917 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:12:05.917 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:12:05.917 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:12:05.925 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:05.891+0000 7fbc78a53180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:12:06.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.022+0000 7fbf7251e640 1 Processor -- start 2023-07-14T13:12:06.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.022+0000 7fbf7251e640 1 -- start start 2023-07-14T13:12:06.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.026+0000 7fbf7251e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbf6c0b7c70 0x7fbf6c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:06.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.026+0000 7fbf7251e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbf6c0d1850 0x7fbf6c15f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:06.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.026+0000 7fbf7251e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf6c0d1300 0x7fbf6c15fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:06.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.026+0000 7fbf7251e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf6c0d1190 con 0x7fbf6c0d1850 2023-07-14T13:12:06.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.026+0000 7fbf7251e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf6c160600 con 0x7fbf6c0b7c70 2023-07-14T13:12:06.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.026+0000 7fbf7251e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c1600d0 con 0x7fbf6c0d1300 2023-07-14T13:12:06.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.026+0000 7fbf6b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbf6c0d1850 0x7fbf6c15f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:06.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.026+0000 7fbf6b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbf6c0d1850 0x7fbf6c15f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35942/0 (socket says 172.21.15.5:35942) 2023-07-14T13:12:06.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.026+0000 7fbf6b7fe640 1 -- 172.21.15.5:0/3535065593 learned_addr learned my addr 172.21.15.5:0/3535065593 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:06.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.026+0000 7fbf70abb640 1 --2- 172.21.15.5:0/3535065593 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf6c0d1300 0x7fbf6c15fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:06.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.026+0000 7fbf6bfff640 1 --2- 172.21.15.5:0/3535065593 >> v2:172.21.15.154:3300/0 conn(0x7fbf6c0b7c70 0x7fbf6c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:06.061 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:06.027+0000 7fbc78a53180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:12:06.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.026+0000 7fbf6b7fe640 1 -- 172.21.15.5:0/3535065593 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf6c0d1300 msgr2=0x7fbf6c15fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:06.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.026+0000 7fbf6b7fe640 1 --2- 172.21.15.5:0/3535065593 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf6c0d1300 0x7fbf6c15fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.026+0000 7fbf6b7fe640 1 -- 172.21.15.5:0/3535065593 >> v2:172.21.15.154:3300/0 conn(0x7fbf6c0b7c70 msgr2=0x7fbf6c0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:06.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.026+0000 7fbf6b7fe640 1 --2- 172.21.15.5:0/3535065593 >> v2:172.21.15.154:3300/0 conn(0x7fbf6c0b7c70 0x7fbf6c0d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.026+0000 7fbf6b7fe640 1 -- 172.21.15.5:0/3535065593 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6c0ccaf0 con 0x7fbf6c0d1850 2023-07-14T13:12:06.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.026+0000 7fbf6b7fe640 1 --2- 172.21.15.5:0/3535065593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf6c0d1850 0x7fbf6c15f650 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c0b40a0 tx=0x7fbf6001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24cccfe7f1987a1c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:06.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.030+0000 7fbf6affd640 1 -- 172.21.15.5:0/3535065593 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf600ac600 con 0x7fbf6c0d1850 2023-07-14T13:12:06.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.030+0000 7fbf6affd640 1 -- 172.21.15.5:0/3535065593 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf600a8050 con 0x7fbf6c0d1850 2023-07-14T13:12:06.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.030+0000 7fbf6affd640 1 -- 172.21.15.5:0/3535065593 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf600ac980 con 0x7fbf6c0d1850 2023-07-14T13:12:06.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.030+0000 7fbf7251e640 1 -- 172.21.15.5:0/3535065593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf6c0d1850 msgr2=0x7fbf6c15f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:06.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.030+0000 7fbf7251e640 1 --2- 172.21.15.5:0/3535065593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf6c0d1850 0x7fbf6c15f650 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c0b40a0 tx=0x7fbf6001c4d0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.030+0000 7fbf7251e640 1 -- 172.21.15.5:0/3535065593 shutdown_connections 2023-07-14T13:12:06.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.030+0000 7fbf7251e640 1 --2- 172.21.15.5:0/3535065593 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf6c0d1300 0x7fbf6c15fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.030+0000 7fbf7251e640 1 --2- 172.21.15.5:0/3535065593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf6c0d1850 0x7fbf6c15f650 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.030+0000 7fbf7251e640 1 --2- 172.21.15.5:0/3535065593 >> v2:172.21.15.154:3300/0 conn(0x7fbf6c0b7c70 0x7fbf6c0d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.030+0000 7fbf7251e640 1 -- 172.21.15.5:0/3535065593 >> 172.21.15.5:0/3535065593 conn(0x7fbf6c0650b0 msgr2=0x7fbf6c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:06.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.030+0000 7fbf7251e640 1 -- 172.21.15.5:0/3535065593 shutdown_connections 2023-07-14T13:12:06.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.030+0000 7fbf7251e640 1 -- 172.21.15.5:0/3535065593 wait complete. 2023-07-14T13:12:06.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.030+0000 7fbf7251e640 1 Processor -- start 2023-07-14T13:12:06.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.030+0000 7fbf7251e640 1 -- start start 2023-07-14T13:12:06.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.030+0000 7fbf7251e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf6c0b7c70 0x7fbf6c1f6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:06.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.034+0000 7fbf7251e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf6c0d1300 0x7fbf6c15e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:06.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.034+0000 7fbf7251e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf6c0d1850 0x7fbf6c0c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:06.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.034+0000 7fbf7251e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c0c6640 con 0x7fbf6c0d1850 2023-07-14T13:12:06.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.034+0000 7fbf7251e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c0c5e30 con 0x7fbf6c0d1300 2023-07-14T13:12:06.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.034+0000 7fbf7251e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c0c80b0 con 0x7fbf6c0b7c70 2023-07-14T13:12:06.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.034+0000 7fbf70abb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf6c0d1850 0x7fbf6c0c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:06.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.034+0000 7fbf6bfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf6c0b7c70 0x7fbf6c1f6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:06.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.034+0000 7fbf70abb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf6c0d1850 0x7fbf6c0c8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35952/0 (socket says 172.21.15.5:35952) 2023-07-14T13:12:06.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.034+0000 7fbf70abb640 1 -- 172.21.15.5:0/2340980403 learned_addr learned my addr 172.21.15.5:0/2340980403 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:06.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.034+0000 7fbf6b7fe640 1 --2- 172.21.15.5:0/2340980403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf6c0d1300 0x7fbf6c15e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:06.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.034+0000 7fbf6bfff640 1 -- 172.21.15.5:0/2340980403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf6c0d1300 msgr2=0x7fbf6c15e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:06.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.034+0000 7fbf6bfff640 1 --2- 172.21.15.5:0/2340980403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf6c0d1300 0x7fbf6c15e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.034+0000 7fbf6bfff640 1 -- 172.21.15.5:0/2340980403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf6c0d1850 msgr2=0x7fbf6c0c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:06.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.034+0000 7fbf6bfff640 1 --2- 172.21.15.5:0/2340980403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf6c0d1850 0x7fbf6c0c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.034+0000 7fbf6bfff640 1 -- 172.21.15.5:0/2340980403 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf600094d0 con 0x7fbf6c0b7c70 2023-07-14T13:12:06.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.034+0000 7fbf70abb640 1 --2- 172.21.15.5:0/2340980403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf6c0d1850 0x7fbf6c0c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:06.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.034+0000 7fbf6bfff640 1 --2- 172.21.15.5:0/2340980403 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf6c0b7c70 0x7fbf6c1f6a80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c00e870 tx=0x7fbf5c00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:06.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.034+0000 7fbf68ff9640 1 -- 172.21.15.5:0/2340980403 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c0095d0 con 0x7fbf6c0b7c70 2023-07-14T13:12:06.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.034+0000 7fbf68ff9640 1 -- 172.21.15.5:0/2340980403 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5c00c940 con 0x7fbf6c0b7c70 2023-07-14T13:12:06.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.034+0000 7fbf7251e640 1 -- 172.21.15.5:0/2340980403 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf6c0c6080 con 0x7fbf6c0b7c70 2023-07-14T13:12:06.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.034+0000 7fbf68ff9640 1 -- 172.21.15.5:0/2340980403 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c00ccb0 con 0x7fbf6c0b7c70 2023-07-14T13:12:06.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.034+0000 7fbf7251e640 1 -- 172.21.15.5:0/2340980403 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf6c0c7d40 con 0x7fbf6c0b7c70 2023-07-14T13:12:06.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.034+0000 7fbf7251e640 1 -- 172.21.15.5:0/2340980403 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf6c0678d0 con 0x7fbf6c0b7c70 2023-07-14T13:12:06.071 INFO:tasks.ceph.mgr.y.smithi005.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:12:06.072 INFO:tasks.ceph.mgr.y.smithi005.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:12:06.072 INFO:tasks.ceph.mgr.y.smithi005.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:12:06.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.034+0000 7fbf68ff9640 1 -- 172.21.15.5:0/2340980403 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 59) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fbf5c013470 con 0x7fbf6c0b7c70 2023-07-14T13:12:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.038+0000 7fbf68ff9640 1 --2- 172.21.15.5:0/2340980403 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7fbf580664f0 0x7fbf580689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.038+0000 7fbf68ff9640 1 -- 172.21.15.5:0/2340980403 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fbf5c0843a0 con 0x7fbf6c0b7c70 2023-07-14T13:12:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.038+0000 7fbf6b7fe640 1 -- 172.21.15.5:0/2340980403 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7fbf580664f0 msgr2=0x7fbf580689a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3453046028 2023-07-14T13:12:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.038+0000 7fbf6b7fe640 1 --2- 172.21.15.5:0/2340980403 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7fbf580664f0 0x7fbf580689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:12:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.042+0000 7fbf68ff9640 1 -- 172.21.15.5:0/2340980403 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fbf5c051410 con 0x7fbf6c0b7c70 2023-07-14T13:12:06.079 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:06.046+0000 7f6a8a42d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:12:06.186 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:06.151+0000 7fbc78a53180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:12:06.221 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:06.186+0000 7f6a8a42d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:12:06.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.210+0000 7fbf7251e640 1 -- 172.21.15.5:0/2340980403 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbf6c0b7090 con 0x7fbf6c0b7c70 2023-07-14T13:12:06.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.210+0000 7fbf68ff9640 1 -- 172.21.15.5:0/2340980403 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v128) v1 ==== 80+0+474 (secure 0 0 0) 0x7fbf5c054a30 con 0x7fbf6c0b7c70 2023-07-14T13:12:06.244 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/629835727 2023-07-15T13:11:45.510811+0000 2023-07-14T13:12:06.244 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/2051265191 2023-07-15T13:11:45.510811+0000 2023-07-14T13:12:06.244 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:6833/938367911 2023-07-15T13:11:45.510811+0000 2023-07-14T13:12:06.245 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:6832/938367911 2023-07-15T13:11:45.510811+0000 2023-07-14T13:12:06.245 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/270189207 2023-07-15T13:11:45.510811+0000 2023-07-14T13:12:06.245 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/3646451858 2023-07-15T13:11:45.510811+0000 2023-07-14T13:12:06.245 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/2058838315 2023-07-15T13:11:45.510811+0000 2023-07-14T13:12:06.245 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/1164555553 2023-07-15T13:11:45.510811+0000 2023-07-14T13:12:06.245 INFO:teuthology.orchestra.run.smithi005.stderr:listed 8 entries 2023-07-14T13:12:06.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.210+0000 7fbf7251e640 1 -- 172.21.15.5:0/2340980403 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7fbf580664f0 msgr2=0x7fbf580689a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:12:06.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.210+0000 7fbf7251e640 1 --2- 172.21.15.5:0/2340980403 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7fbf580664f0 0x7fbf580689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.210+0000 7fbf7251e640 1 -- 172.21.15.5:0/2340980403 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf6c0b7c70 msgr2=0x7fbf6c1f6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:06.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.210+0000 7fbf7251e640 1 --2- 172.21.15.5:0/2340980403 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf6c0b7c70 0x7fbf6c1f6a80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c00e870 tx=0x7fbf5c00ed30 comp rx=0 tx=0).stop 2023-07-14T13:12:06.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.210+0000 7fbf7251e640 1 -- 172.21.15.5:0/2340980403 shutdown_connections 2023-07-14T13:12:06.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.210+0000 7fbf7251e640 1 --2- 172.21.15.5:0/2340980403 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7fbf580664f0 0x7fbf580689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.210+0000 7fbf7251e640 1 --2- 172.21.15.5:0/2340980403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf6c0d1850 0x7fbf6c0c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.210+0000 7fbf7251e640 1 --2- 172.21.15.5:0/2340980403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf6c0d1300 0x7fbf6c15e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.210+0000 7fbf7251e640 1 --2- 172.21.15.5:0/2340980403 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbf6c0b7c70 0x7fbf6c1f6a80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.210+0000 7fbf7251e640 1 -- 172.21.15.5:0/2340980403 >> 172.21.15.5:0/2340980403 conn(0x7fbf6c0650b0 msgr2=0x7fbf6c0cfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:06.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.210+0000 7fbf7251e640 1 -- 172.21.15.5:0/2340980403 shutdown_connections 2023-07-14T13:12:06.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.210+0000 7fbf7251e640 1 -- 172.21.15.5:0/2340980403 wait complete. 2023-07-14T13:12:06.256 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:06.223+0000 7fbc78a53180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:12:06.266 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-14T13:12:06.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:12:06.267 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-14T13:12:06.327 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-07-14T13:12:06.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:12:06.328 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-14T13:12:06.337 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:12:06.337 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:12:06.346 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:12:06.347 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:12:06.347 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:12:06.357 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:06.322+0000 7f6a8a42d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:12:06.365 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:12:06.366 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:12:06.366 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:12:06.393 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:06.359+0000 7fbc78a53180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:12:06.398 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:12:06.398 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:12:06.432 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:06.398+0000 7f6a8a42d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:12:06.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.518+0000 7f086309c640 1 Processor -- start 2023-07-14T13:12:06.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.518+0000 7f086309c640 1 -- start start 2023-07-14T13:12:06.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.518+0000 7f086309c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f085c15fd60 0x7f085c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:06.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.518+0000 7f086309c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f085c0ccaf0 con 0x7f085c0b7c70 2023-07-14T13:12:06.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.518+0000 7f086309c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f085c160320 con 0x7f085c0d1850 2023-07-14T13:12:06.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.518+0000 7f086309c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f085c0d1190 con 0x7f085c15fd60 2023-07-14T13:12:06.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.518+0000 7f0860e38640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f085c0b7c70 0x7f085c15f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46860/0 (socket says 172.21.15.5:46860) 2023-07-14T13:12:06.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.518+0000 7f0860e38640 1 -- 172.21.15.5:0/4205157166 learned_addr learned my addr 172.21.15.5:0/4205157166 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:06.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.518+0000 7f085bfff640 1 --2- 172.21.15.5:0/4205157166 >> v2:172.21.15.154:3300/0 conn(0x7f085c15fd60 0x7f085c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:06.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.518+0000 7f085b7fe640 1 -- 172.21.15.5:0/4205157166 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028094353 0 0) 0x7f085c0ccaf0 con 0x7f085c0b7c70 2023-07-14T13:12:06.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.518+0000 7f085b7fe640 1 -- 172.21.15.5:0/4205157166 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f084c003530 con 0x7f085c0b7c70 2023-07-14T13:12:06.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.518+0000 7f085bfff640 1 -- 172.21.15.5:0/4205157166 >> v1:172.21.15.154:6789/0 conn(0x7f085c0d1850 legacy=0x7f085c0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:06.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.518+0000 7f085bfff640 1 -- 172.21.15.5:0/4205157166 >> v1:172.21.15.5:6789/0 conn(0x7f085c0b7c70 legacy=0x7f085c15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:06.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.518+0000 7f085bfff640 1 -- 172.21.15.5:0/4205157166 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085c0ccd90 con 0x7f085c15fd60 2023-07-14T13:12:06.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.526+0000 7f085bfff640 1 --2- 172.21.15.5:0/4205157166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f085c15fd60 0x7f085c0d0c50 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f08480097c0 tx=0x7f084801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4541fe87ca54374e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:06.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.526+0000 7f085b7fe640 1 -- 172.21.15.5:0/4205157166 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480a8050 con 0x7f085c15fd60 2023-07-14T13:12:06.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.526+0000 7f085b7fe640 1 -- 172.21.15.5:0/4205157166 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08480ac5f0 con 0x7f085c15fd60 2023-07-14T13:12:06.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.526+0000 7f085b7fe640 1 -- 172.21.15.5:0/4205157166 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480ac980 con 0x7f085c15fd60 2023-07-14T13:12:06.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.526+0000 7f086309c640 1 -- 172.21.15.5:0/4205157166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f085c15fd60 msgr2=0x7f085c0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:06.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.526+0000 7f086309c640 1 --2- 172.21.15.5:0/4205157166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f085c15fd60 0x7f085c0d0c50 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f08480097c0 tx=0x7f084801c480 comp rx=0 tx=0).stop 2023-07-14T13:12:06.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.526+0000 7f086309c640 1 -- 172.21.15.5:0/4205157166 shutdown_connections 2023-07-14T13:12:06.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.526+0000 7f086309c640 1 --2- 172.21.15.5:0/4205157166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f085c15fd60 0x7f085c0d0c50 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.526+0000 7f086309c640 1 -- 172.21.15.5:0/4205157166 >> 172.21.15.5:0/4205157166 conn(0x7f085c0650b0 msgr2=0x7f085c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:06.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.526+0000 7f086309c640 1 -- 172.21.15.5:0/4205157166 shutdown_connections 2023-07-14T13:12:06.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.526+0000 7f086309c640 1 -- 172.21.15.5:0/4205157166 wait complete. 2023-07-14T13:12:06.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.526+0000 7f086309c640 1 Processor -- start 2023-07-14T13:12:06.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.526+0000 7f086309c640 1 -- start start 2023-07-14T13:12:06.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.530+0000 7f086309c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f085c0b7c70 0x7f085c150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:06.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.530+0000 7f086309c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f085c0d1850 0x7f085c153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:06.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.530+0000 7f086309c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f085c15fd60 0x7f085c153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:06.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.530+0000 7f086309c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085c15df50 con 0x7f085c15fd60 2023-07-14T13:12:06.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.530+0000 7f086309c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085c15ced0 con 0x7f085c0b7c70 2023-07-14T13:12:06.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.530+0000 7f086309c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085c15d1b0 con 0x7f085c0d1850 2023-07-14T13:12:06.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.530+0000 7f0861639640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f085c15fd60 0x7f085c153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:06.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.530+0000 7f0861639640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f085c15fd60 0x7f085c153c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35964/0 (socket says 172.21.15.5:35964) 2023-07-14T13:12:06.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.530+0000 7f0861639640 1 -- 172.21.15.5:0/3909708410 learned_addr learned my addr 172.21.15.5:0/3909708410 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:06.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.530+0000 7f0860e38640 1 --2- 172.21.15.5:0/3909708410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f085c0b7c70 0x7f085c150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:06.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.530+0000 7f085bfff640 1 --2- 172.21.15.5:0/3909708410 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f085c0d1850 0x7f085c153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:06.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.530+0000 7f0861639640 1 -- 172.21.15.5:0/3909708410 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f085c0d1850 msgr2=0x7f085c153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:06.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.530+0000 7f0861639640 1 --2- 172.21.15.5:0/3909708410 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f085c0d1850 0x7f085c153740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.530+0000 7f0861639640 1 -- 172.21.15.5:0/3909708410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f085c0b7c70 msgr2=0x7f085c150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:06.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.530+0000 7f0861639640 1 --2- 172.21.15.5:0/3909708410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f085c0b7c70 0x7f085c150b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.530+0000 7f0861639640 1 -- 172.21.15.5:0/3909708410 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0848009420 con 0x7f085c15fd60 2023-07-14T13:12:06.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.530+0000 7f0861639640 1 --2- 172.21.15.5:0/3909708410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f085c15fd60 0x7f085c153c80 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f085400c730 tx=0x7f085400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:06.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.530+0000 7f08597fa640 1 -- 172.21.15.5:0/3909708410 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0854003b80 con 0x7f085c15fd60 2023-07-14T13:12:06.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.530+0000 7f08597fa640 1 -- 172.21.15.5:0/3909708410 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0854003ce0 con 0x7f085c15fd60 2023-07-14T13:12:06.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.530+0000 7f086309c640 1 -- 172.21.15.5:0/3909708410 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f085c15d490 con 0x7f085c15fd60 2023-07-14T13:12:06.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.530+0000 7f08597fa640 1 -- 172.21.15.5:0/3909708410 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085400aa30 con 0x7f085c15fd60 2023-07-14T13:12:06.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.530+0000 7f086309c640 1 -- 172.21.15.5:0/3909708410 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f085c15da50 con 0x7f085c15fd60 2023-07-14T13:12:06.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.530+0000 7f086309c640 1 -- 172.21.15.5:0/3909708410 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f085c15dc10 con 0x7f085c15fd60 2023-07-14T13:12:06.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.530+0000 7f08597fa640 1 -- 172.21.15.5:0/3909708410 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 59) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f085400ab90 con 0x7f085c15fd60 2023-07-14T13:12:06.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.534+0000 7f08597fa640 1 --2- 172.21.15.5:0/3909708410 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f08400664f0 0x7f08400689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:06.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.534+0000 7f08597fa640 1 -- 172.21.15.5:0/3909708410 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f0854083fe0 con 0x7f085c15fd60 2023-07-14T13:12:06.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.534+0000 7f0860e38640 1 -- 172.21.15.5:0/3909708410 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f08400664f0 msgr2=0x7f08400689a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3453046028 2023-07-14T13:12:06.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.534+0000 7f0860e38640 1 --2- 172.21.15.5:0/3909708410 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f08400664f0 0x7f08400689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:12:06.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.538+0000 7f08597fa640 1 -- 172.21.15.5:0/3909708410 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f0854050f90 con 0x7f085c15fd60 2023-07-14T13:12:06.580 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:06.546+0000 7f6a8a42d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:12:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.726+0000 7f086309c640 1 -- 172.21.15.5:0/3909708410 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f085c0678d0 con 0x7f085c15fd60 2023-07-14T13:12:06.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.726+0000 7f08597fa640 1 -- 172.21.15.5:0/3909708410 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4708 (secure 0 0 0) 0x7f08540545b0 con 0x7f085c15fd60 2023-07-14T13:12:06.761 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:06.761 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6980,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2963267082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2963267082},{"type":"v1","addr":"172.21.15.154:6836","nonce":2963267082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7885,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1576178254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1576178254},{"type":"v1","addr":"172.21.15.154:6837","nonce":1576178254}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/849067278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":849067278},{"type":"v1","addr":"172.21.15.5:6833","nonce":849067278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:11:28.287189+0000","modified":"2023-07-14T13:11:31.942546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1610819689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1610819689},{"type":"v1","addr":"172.21.15.5:6835","nonce":1610819689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-14T13:12:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 57 2023-07-14T13:12:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.726+0000 7f086309c640 1 -- 172.21.15.5:0/3909708410 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f08400664f0 msgr2=0x7f08400689a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:12:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.726+0000 7f086309c640 1 --2- 172.21.15.5:0/3909708410 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f08400664f0 0x7f08400689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.726+0000 7f086309c640 1 -- 172.21.15.5:0/3909708410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f085c15fd60 msgr2=0x7f085c153c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.726+0000 7f086309c640 1 --2- 172.21.15.5:0/3909708410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f085c15fd60 0x7f085c153c80 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f085400c730 tx=0x7f085400cbf0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.726+0000 7f086309c640 1 -- 172.21.15.5:0/3909708410 shutdown_connections 2023-07-14T13:12:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.726+0000 7f086309c640 1 --2- 172.21.15.5:0/3909708410 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f08400664f0 0x7f08400689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.726+0000 7f086309c640 1 --2- 172.21.15.5:0/3909708410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f085c15fd60 0x7f085c153c80 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.726+0000 7f086309c640 1 --2- 172.21.15.5:0/3909708410 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f085c0d1850 0x7f085c153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.726+0000 7f086309c640 1 --2- 172.21.15.5:0/3909708410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f085c0b7c70 0x7f085c150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.726+0000 7f086309c640 1 -- 172.21.15.5:0/3909708410 >> 172.21.15.5:0/3909708410 conn(0x7f085c0650b0 msgr2=0x7f085c0b6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.726+0000 7f086309c640 1 -- 172.21.15.5:0/3909708410 shutdown_connections 2023-07-14T13:12:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.726+0000 7f086309c640 1 -- 172.21.15.5:0/3909708410 wait complete. 2023-07-14T13:12:06.782 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:12:06.932 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:06.899+0000 7fbc78a53180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:12:06.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.934+0000 7f79acfad640 1 Processor -- start 2023-07-14T13:12:06.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.934+0000 7f79acfad640 1 -- start start 2023-07-14T13:12:06.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.934+0000 7f79acfad640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f79a80b7c70 0x7f79a80d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:06.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.934+0000 7f79acfad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79a80d1850 0x7f79a815f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:06.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.934+0000 7f79acfad640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f79a80d1300 0x7f79a815fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:06.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.934+0000 7f79acfad640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a80d1190 con 0x7f79a80d1300 2023-07-14T13:12:06.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.934+0000 7f79acfad640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a8160600 con 0x7f79a80b7c70 2023-07-14T13:12:06.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.934+0000 7f79acfad640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a81600d0 con 0x7f79a80d1850 2023-07-14T13:12:06.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.934+0000 7f79a6d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f79a80d1300 0x7f79a815fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:06.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.934+0000 7f79a6d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f79a80d1300 0x7f79a815fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35970/0 (socket says 172.21.15.5:35970) 2023-07-14T13:12:06.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.934+0000 7f79a6d9d640 1 -- 172.21.15.5:0/3204814668 learned_addr learned my addr 172.21.15.5:0/3204814668 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:06.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.934+0000 7f799ffff640 1 --2- 172.21.15.5:0/3204814668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79a80d1850 0x7f79a815f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:06.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.934+0000 7f79a659c640 1 --2- 172.21.15.5:0/3204814668 >> v2:172.21.15.154:3300/0 conn(0x7f79a80b7c70 0x7f79a80d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:06.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.938+0000 7f79a6d9d640 1 -- 172.21.15.5:0/3204814668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79a80d1850 msgr2=0x7f79a815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:06.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.938+0000 7f79a6d9d640 1 --2- 172.21.15.5:0/3204814668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79a80d1850 0x7f79a815f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.938+0000 7f79a6d9d640 1 -- 172.21.15.5:0/3204814668 >> v2:172.21.15.154:3300/0 conn(0x7f79a80b7c70 msgr2=0x7f79a80d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:06.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.938+0000 7f79a6d9d640 1 --2- 172.21.15.5:0/3204814668 >> v2:172.21.15.154:3300/0 conn(0x7f79a80b7c70 0x7f79a80d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.938+0000 7f79a6d9d640 1 -- 172.21.15.5:0/3204814668 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a80ccaf0 con 0x7f79a80d1300 2023-07-14T13:12:06.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.938+0000 7f79a659c640 1 --2- 172.21.15.5:0/3204814668 >> v2:172.21.15.154:3300/0 conn(0x7f79a80b7c70 0x7f79a80d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:06.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.938+0000 7f79a6d9d640 1 --2- 172.21.15.5:0/3204814668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79a80d1300 0x7f79a815fb90 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f79a80b40a0 tx=0x7f79a001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d1968938a0fb07 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:06.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.938+0000 7f79a5d9b640 1 -- 172.21.15.5:0/3204814668 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a00a5730 con 0x7f79a80d1300 2023-07-14T13:12:06.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.938+0000 7f79a5d9b640 1 -- 172.21.15.5:0/3204814668 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a00a5890 con 0x7f79a80d1300 2023-07-14T13:12:06.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.938+0000 7f79a5d9b640 1 -- 172.21.15.5:0/3204814668 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a00a5c20 con 0x7f79a80d1300 2023-07-14T13:12:06.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.938+0000 7f79acfad640 1 -- 172.21.15.5:0/3204814668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79a80d1300 msgr2=0x7f79a815fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:06.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.938+0000 7f79acfad640 1 --2- 172.21.15.5:0/3204814668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79a80d1300 0x7f79a815fb90 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f79a80b40a0 tx=0x7f79a001c9a0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.942+0000 7f79acfad640 1 -- 172.21.15.5:0/3204814668 shutdown_connections 2023-07-14T13:12:06.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.942+0000 7f79acfad640 1 --2- 172.21.15.5:0/3204814668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79a80d1300 0x7f79a815fb90 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.942+0000 7f79acfad640 1 --2- 172.21.15.5:0/3204814668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79a80d1850 0x7f79a815f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.942+0000 7f79acfad640 1 --2- 172.21.15.5:0/3204814668 >> v2:172.21.15.154:3300/0 conn(0x7f79a80b7c70 0x7f79a80d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.942+0000 7f79acfad640 1 -- 172.21.15.5:0/3204814668 >> 172.21.15.5:0/3204814668 conn(0x7f79a80650b0 msgr2=0x7f79a80654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:06.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.942+0000 7f79acfad640 1 -- 172.21.15.5:0/3204814668 shutdown_connections 2023-07-14T13:12:06.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.942+0000 7f79acfad640 1 -- 172.21.15.5:0/3204814668 wait complete. 2023-07-14T13:12:06.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.942+0000 7f79acfad640 1 Processor -- start 2023-07-14T13:12:06.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.942+0000 7f79acfad640 1 -- start start 2023-07-14T13:12:06.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.942+0000 7f79acfad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79a80b7c70 0x7f79a81f8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:06.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.942+0000 7f79acfad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79a80d1300 0x7f79a815dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:06.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.942+0000 7f79acfad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79a80d1850 0x7f79a81f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:06.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.942+0000 7f79acfad640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a81f4ad0 con 0x7f79a80d1850 2023-07-14T13:12:06.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.942+0000 7f79acfad640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a81f4db0 con 0x7f79a80d1300 2023-07-14T13:12:06.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.942+0000 7f79acfad640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a81f7540 con 0x7f79a80b7c70 2023-07-14T13:12:06.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.942+0000 7f79a6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79a80d1850 0x7f79a81f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:06.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.942+0000 7f799ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79a80d1300 0x7f79a815dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:06.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.942+0000 7f79a6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79a80d1850 0x7f79a81f3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35980/0 (socket says 172.21.15.5:35980) 2023-07-14T13:12:06.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.942+0000 7f79a6d9d640 1 -- 172.21.15.5:0/1026174859 learned_addr learned my addr 172.21.15.5:0/1026174859 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:06.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.942+0000 7f79a659c640 1 --2- 172.21.15.5:0/1026174859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79a80b7c70 0x7f79a81f8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:06.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.942+0000 7f79a6d9d640 1 -- 172.21.15.5:0/1026174859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79a80b7c70 msgr2=0x7f79a81f8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:06.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.942+0000 7f79a6d9d640 1 --2- 172.21.15.5:0/1026174859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79a80b7c70 0x7f79a81f8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.942+0000 7f79a6d9d640 1 -- 172.21.15.5:0/1026174859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79a80d1300 msgr2=0x7f79a815dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:06.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.942+0000 7f79a6d9d640 1 --2- 172.21.15.5:0/1026174859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79a80d1300 0x7f79a815dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:06.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.942+0000 7f79a6d9d640 1 -- 172.21.15.5:0/1026174859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a0009b30 con 0x7f79a80d1850 2023-07-14T13:12:06.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.946+0000 7f79a6d9d640 1 --2- 172.21.15.5:0/1026174859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79a80d1850 0x7f79a81f3f60 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f79a001b050 tx=0x7f79a0019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:06.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.946+0000 7f799effd640 1 -- 172.21.15.5:0/1026174859 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a00b8670 con 0x7f79a80d1850 2023-07-14T13:12:06.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.946+0000 7f799effd640 1 -- 172.21.15.5:0/1026174859 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a00b8810 con 0x7f79a80d1850 2023-07-14T13:12:06.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.946+0000 7f799effd640 1 -- 172.21.15.5:0/1026174859 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a00b8bc0 con 0x7f79a80d1850 2023-07-14T13:12:06.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.946+0000 7f79acfad640 1 -- 172.21.15.5:0/1026174859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a81f7820 con 0x7f79a80d1850 2023-07-14T13:12:06.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.946+0000 7f79acfad640 1 -- 172.21.15.5:0/1026174859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a80c7fe0 con 0x7f79a80d1850 2023-07-14T13:12:06.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.946+0000 7f79acfad640 1 -- 172.21.15.5:0/1026174859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a80678d0 con 0x7f79a80d1850 2023-07-14T13:12:06.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.946+0000 7f799effd640 1 -- 172.21.15.5:0/1026174859 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 59) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f79a00b8d20 con 0x7f79a80d1850 2023-07-14T13:12:06.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.950+0000 7f799effd640 1 --2- 172.21.15.5:0/1026174859 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f79880664c0 0x7f7988068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:06.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.950+0000 7f799effd640 1 -- 172.21.15.5:0/1026174859 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f79a011f920 con 0x7f79a80d1850 2023-07-14T13:12:06.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.950+0000 7f79a659c640 1 -- 172.21.15.5:0/1026174859 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f79880664c0 msgr2=0x7f7988068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3453046028 2023-07-14T13:12:06.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.950+0000 7f79a659c640 1 --2- 172.21.15.5:0/1026174859 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f79880664c0 0x7f7988068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:12:06.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:06.954+0000 7f799effd640 1 -- 172.21.15.5:0/1026174859 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f79a00ecad0 con 0x7f79a80d1850 2023-07-14T13:12:07.017 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:06.983+0000 7fbc78a53180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:12:07.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.114+0000 7f79acfad640 1 -- 172.21.15.5:0/1026174859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79a80c5bb0 con 0x7f79a80d1850 2023-07-14T13:12:07.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.114+0000 7f799effd640 1 -- 172.21.15.5:0/1026174859 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+18750 (secure 0 0 0) 0x7f79a00f00f0 con 0x7f79a80d1850 2023-07-14T13:12:07.148 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:07.149 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":128,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:11:45.510842+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:11:26.406551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-14T13:11:27.287297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/629835727":"2023-07-15T13:11:45.510811+0000","172.21.15.154:0/2051265191":"2023-07-15T13:11:45.510811+0000","172.21.15.154:6833/938367911":"2023-07-15T13:11:45.510811+0000","172.21.15.154:6832/938367911":"2023-07-15T13:11:45.510811+0000","172.21.15.154:0/270189207":"2023-07-15T13:11:45.510811+0000","172.21.15.154:0/3646451858":"2023-07-15T13:11:45.510811+0000","172.21.15.154:0/2058838315":"2023-07-15T13:11:45.510811+0000","172.21.15.154:0/1164555553":"2023-07-15T13:11:45.510811+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:12:07.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.114+0000 7f79acfad640 1 -- 172.21.15.5:0/1026174859 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f79880664c0 msgr2=0x7f7988068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:12:07.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.114+0000 7f79acfad640 1 --2- 172.21.15.5:0/1026174859 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f79880664c0 0x7f7988068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:07.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.114+0000 7f79acfad640 1 -- 172.21.15.5:0/1026174859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79a80d1850 msgr2=0x7f79a81f3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:07.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.114+0000 7f79acfad640 1 --2- 172.21.15.5:0/1026174859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79a80d1850 0x7f79a81f3f60 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f79a001b050 tx=0x7f79a0019740 comp rx=0 tx=0).stop 2023-07-14T13:12:07.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.114+0000 7f79acfad640 1 -- 172.21.15.5:0/1026174859 shutdown_connections 2023-07-14T13:12:07.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.114+0000 7f79acfad640 1 --2- 172.21.15.5:0/1026174859 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7f79880664c0 0x7f7988068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:07.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.114+0000 7f79acfad640 1 --2- 172.21.15.5:0/1026174859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79a80d1850 0x7f79a81f3f60 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:07.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.114+0000 7f79acfad640 1 --2- 172.21.15.5:0/1026174859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79a80d1300 0x7f79a815dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:07.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.114+0000 7f79acfad640 1 --2- 172.21.15.5:0/1026174859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79a80b7c70 0x7f79a81f8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:07.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.114+0000 7f79acfad640 1 -- 172.21.15.5:0/1026174859 >> 172.21.15.5:0/1026174859 conn(0x7f79a80650b0 msgr2=0x7f79a80cfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:07.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.114+0000 7f79acfad640 1 -- 172.21.15.5:0/1026174859 shutdown_connections 2023-07-14T13:12:07.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.114+0000 7f79acfad640 1 -- 172.21.15.5:0/1026174859 wait complete. 2023-07-14T13:12:07.164 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:07.130+0000 7f6a8a42d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:12:07.165 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:07.131+0000 7fbc78a53180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:12:07.170 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T13:11:26.406551+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '126', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T13:11:27.287297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '127', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:12:07.171 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:12:07.248 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:07.215+0000 7fbc78a53180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:12:07.256 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:07.222+0000 7f6a8a42d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:12:07.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.286+0000 7fec8fd40640 1 Processor -- start 2023-07-14T13:12:07.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.286+0000 7fec8fd40640 1 -- start start 2023-07-14T13:12:07.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.290+0000 7fec8fd40640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fec8815bde0 0x7fec880d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:07.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.290+0000 7fec8fd40640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fec880d2300 0x7fec880d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:07.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.290+0000 7fec8fd40640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec880b04c0 con 0x7fec880d2fc0 2023-07-14T13:12:07.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.290+0000 7fec8fd40640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec8815c1b0 con 0x7fec880d2300 2023-07-14T13:12:07.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.290+0000 7fec8fd40640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec880b1060 con 0x7fec8815bde0 2023-07-14T13:12:07.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.290+0000 7fec8e2dd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fec880d2300 0x7fec880d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:07.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.290+0000 7fec8e2dd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fec880d2300 0x7fec880d2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35994/0 (socket says 172.21.15.5:35994) 2023-07-14T13:12:07.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.290+0000 7fec8e2dd640 1 -- 172.21.15.5:0/4086335844 learned_addr learned my addr 172.21.15.5:0/4086335844 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:07.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.290+0000 7fec8dadc640 1 --2- 172.21.15.5:0/4086335844 >> v2:172.21.15.154:3300/0 conn(0x7fec8815bde0 0x7fec880d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:07.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.290+0000 7fec8e2dd640 1 -- 172.21.15.5:0/4086335844 >> v2:172.21.15.154:3300/0 conn(0x7fec8815bde0 msgr2=0x7fec880d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:07.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.290+0000 7fec8e2dd640 1 --2- 172.21.15.5:0/4086335844 >> v2:172.21.15.154:3300/0 conn(0x7fec8815bde0 0x7fec880d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:07.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.290+0000 7fec8e2dd640 1 -- 172.21.15.5:0/4086335844 >> v1:172.21.15.154:6789/0 conn(0x7fec880d2fc0 legacy=0x7fec880b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:07.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.290+0000 7fec8e2dd640 1 -- 172.21.15.5:0/4086335844 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec880d2c80 con 0x7fec880d2300 2023-07-14T13:12:07.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.294+0000 7fec8e2dd640 1 --2- 172.21.15.5:0/4086335844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec880d2300 0x7fec880d2740 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fec8808b210 tx=0x7fec8001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2da6e091975c1f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:07.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.294+0000 7fec8cada640 1 -- 172.21.15.5:0/4086335844 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec800a57a0 con 0x7fec880d2300 2023-07-14T13:12:07.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.294+0000 7fec8cada640 1 -- 172.21.15.5:0/4086335844 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec800a5900 con 0x7fec880d2300 2023-07-14T13:12:07.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.294+0000 7fec8cada640 1 -- 172.21.15.5:0/4086335844 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec800a5c90 con 0x7fec880d2300 2023-07-14T13:12:07.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.294+0000 7fec8fd40640 1 -- 172.21.15.5:0/4086335844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec880d2300 msgr2=0x7fec880d2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:07.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.294+0000 7fec8fd40640 1 --2- 172.21.15.5:0/4086335844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec880d2300 0x7fec880d2740 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fec8808b210 tx=0x7fec8001c9d0 comp rx=0 tx=0).stop 2023-07-14T13:12:07.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.294+0000 7fec8fd40640 1 -- 172.21.15.5:0/4086335844 shutdown_connections 2023-07-14T13:12:07.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.294+0000 7fec8fd40640 1 --2- 172.21.15.5:0/4086335844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec880d2300 0x7fec880d2740 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:07.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.294+0000 7fec8fd40640 1 --2- 172.21.15.5:0/4086335844 >> v2:172.21.15.154:3300/0 conn(0x7fec8815bde0 0x7fec880d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:07.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.294+0000 7fec8fd40640 1 -- 172.21.15.5:0/4086335844 >> 172.21.15.5:0/4086335844 conn(0x7fec880659d0 msgr2=0x7fec8809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:07.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.294+0000 7fec8fd40640 1 -- 172.21.15.5:0/4086335844 shutdown_connections 2023-07-14T13:12:07.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.294+0000 7fec8fd40640 1 -- 172.21.15.5:0/4086335844 wait complete. 2023-07-14T13:12:07.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.294+0000 7fec8fd40640 1 Processor -- start 2023-07-14T13:12:07.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.294+0000 7fec8fd40640 1 -- start start 2023-07-14T13:12:07.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.298+0000 7fec8fd40640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec880d2300 0x7fec880c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:07.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.298+0000 7fec8fd40640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec880d2fc0 0x7fec880cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:07.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.298+0000 7fec8fd40640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec8815bde0 0x7fec880cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:07.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.298+0000 7fec8fd40640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec880ca340 con 0x7fec880d2fc0 2023-07-14T13:12:07.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.298+0000 7fec8fd40640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec88152910 con 0x7fec8815bde0 2023-07-14T13:12:07.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.298+0000 7fec8fd40640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec880b80e0 con 0x7fec880d2300 2023-07-14T13:12:07.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.298+0000 7fec8d2db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec880d2fc0 0x7fec880cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:07.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.298+0000 7fec8d2db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec880d2fc0 0x7fec880cb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36008/0 (socket says 172.21.15.5:36008) 2023-07-14T13:12:07.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.298+0000 7fec8d2db640 1 -- 172.21.15.5:0/4156388392 learned_addr learned my addr 172.21.15.5:0/4156388392 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:07.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.298+0000 7fec8dadc640 1 --2- 172.21.15.5:0/4156388392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec880d2300 0x7fec880c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:07.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.298+0000 7fec8e2dd640 1 --2- 172.21.15.5:0/4156388392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec8815bde0 0x7fec880cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:07.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.298+0000 7fec8d2db640 1 -- 172.21.15.5:0/4156388392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec880d2300 msgr2=0x7fec880c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:07.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.298+0000 7fec8d2db640 1 --2- 172.21.15.5:0/4156388392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec880d2300 0x7fec880c9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:07.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.298+0000 7fec8d2db640 1 -- 172.21.15.5:0/4156388392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec8815bde0 msgr2=0x7fec880cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:07.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.298+0000 7fec8d2db640 1 --2- 172.21.15.5:0/4156388392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec8815bde0 0x7fec880cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:07.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.298+0000 7fec8d2db640 1 -- 172.21.15.5:0/4156388392 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec80009b30 con 0x7fec880d2fc0 2023-07-14T13:12:07.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.298+0000 7fec8d2db640 1 --2- 172.21.15.5:0/4156388392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec880d2fc0 0x7fec880cb2f0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fec7800c4d0 tx=0x7fec7800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:07.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.298+0000 7fec7e7fc640 1 -- 172.21.15.5:0/4156388392 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec780052d0 con 0x7fec880d2fc0 2023-07-14T13:12:07.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.298+0000 7fec7e7fc640 1 -- 172.21.15.5:0/4156388392 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec78005430 con 0x7fec880d2fc0 2023-07-14T13:12:07.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.298+0000 7fec7e7fc640 1 -- 172.21.15.5:0/4156388392 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec78012830 con 0x7fec880d2fc0 2023-07-14T13:12:07.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.298+0000 7fec8fd40640 1 -- 172.21.15.5:0/4156388392 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec880ca530 con 0x7fec880d2fc0 2023-07-14T13:12:07.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.298+0000 7fec8fd40640 1 -- 172.21.15.5:0/4156388392 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec880caaf0 con 0x7fec880d2fc0 2023-07-14T13:12:07.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.298+0000 7fec8fd40640 1 -- 172.21.15.5:0/4156388392 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec88152a80 con 0x7fec880d2fc0 2023-07-14T13:12:07.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.298+0000 7fec7e7fc640 1 -- 172.21.15.5:0/4156388392 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 59) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fec78012990 con 0x7fec880d2fc0 2023-07-14T13:12:07.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.302+0000 7fec7e7fc640 1 --2- 172.21.15.5:0/4156388392 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7fec6c0664f0 0x7fec6c0689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:07.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.302+0000 7fec7e7fc640 1 -- 172.21.15.5:0/4156388392 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fec78083c40 con 0x7fec880d2fc0 2023-07-14T13:12:07.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.302+0000 7fec8dadc640 1 -- 172.21.15.5:0/4156388392 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7fec6c0664f0 msgr2=0x7fec6c0689a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3453046028 2023-07-14T13:12:07.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.302+0000 7fec8dadc640 1 --2- 172.21.15.5:0/4156388392 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7fec6c0664f0 0x7fec6c0689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:12:07.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.306+0000 7fec7e7fc640 1 -- 172.21.15.5:0/4156388392 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fec78050ca0 con 0x7fec880d2fc0 2023-07-14T13:12:07.416 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:07.382+0000 7f6a8a42d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:12:07.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.462+0000 7fec8fd40640 1 -- 172.21.15.5:0/4156388392 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fec880678d0 con 0x7fec880d2fc0 2023-07-14T13:12:07.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.462+0000 7fec7e7fc640 1 -- 172.21.15.5:0/4156388392 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v128) v1 ==== 93+0+10 (secure 0 0 0) 0x7fec780542c0 con 0x7fec880d2fc0 2023-07-14T13:12:07.497 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:12:07.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.462+0000 7fec8fd40640 1 -- 172.21.15.5:0/4156388392 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7fec6c0664f0 msgr2=0x7fec6c0689a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:12:07.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.462+0000 7fec8fd40640 1 --2- 172.21.15.5:0/4156388392 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7fec6c0664f0 0x7fec6c0689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:07.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.462+0000 7fec8fd40640 1 -- 172.21.15.5:0/4156388392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec880d2fc0 msgr2=0x7fec880cb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:07.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.462+0000 7fec8fd40640 1 --2- 172.21.15.5:0/4156388392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec880d2fc0 0x7fec880cb2f0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fec7800c4d0 tx=0x7fec7800c990 comp rx=0 tx=0).stop 2023-07-14T13:12:07.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.466+0000 7fec8fd40640 1 -- 172.21.15.5:0/4156388392 shutdown_connections 2023-07-14T13:12:07.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.466+0000 7fec8fd40640 1 --2- 172.21.15.5:0/4156388392 >> [v2:172.21.15.154:6832/3453046028,v1:172.21.15.154:6833/3453046028] conn(0x7fec6c0664f0 0x7fec6c0689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:07.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.466+0000 7fec8fd40640 1 --2- 172.21.15.5:0/4156388392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec8815bde0 0x7fec880cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:07.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.466+0000 7fec8fd40640 1 --2- 172.21.15.5:0/4156388392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec880d2fc0 0x7fec880cb2f0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:07.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.466+0000 7fec8fd40640 1 --2- 172.21.15.5:0/4156388392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec880d2300 0x7fec880c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:07.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.466+0000 7fec8fd40640 1 -- 172.21.15.5:0/4156388392 >> 172.21.15.5:0/4156388392 conn(0x7fec880659d0 msgr2=0x7fec880cf490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:07.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.466+0000 7fec8fd40640 1 -- 172.21.15.5:0/4156388392 shutdown_connections 2023-07-14T13:12:07.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.466+0000 7fec8fd40640 1 -- 172.21.15.5:0/4156388392 wait complete. 2023-07-14T13:12:07.504 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:07.470+0000 7f6a8a42d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:12:07.518 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:12:07.519 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:07.483+0000 7fbc78a53180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:12:07.578 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:07.547+0000 7fbc78a53180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:12:07.660 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:07.627+0000 7fbc0413c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:07.661 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:07.627+0000 7fbc0413c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:07.661 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:07.627+0000 7fbc0413c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:07.661 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:07.627+0000 7fbc0413c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:07.661 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:07.627+0000 7fbc0413c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:07.662 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:07.627+0000 7fbc00935640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:07.662 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:07.627+0000 7fbc00935640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:07.662 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:07.627+0000 7fbc00935640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:07.662 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:07.627+0000 7fbc00935640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:07.662 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:07.627+0000 7fbc00935640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:07.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.642+0000 7f05aa5c5640 1 Processor -- start 2023-07-14T13:12:07.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.642+0000 7f05aa5c5640 1 -- start start 2023-07-14T13:12:07.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.642+0000 7f05aa5c5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f05a415bde0 0x7f05a40d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:07.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.642+0000 7f05aa5c5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f05a40d2fc0 0x7f05a40b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:07.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.642+0000 7f05aa5c5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05a40d2300 0x7f05a40d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:07.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.642+0000 7f05aa5c5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a415c1b0 con 0x7f05a415bde0 2023-07-14T13:12:07.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.642+0000 7f05aa5c5640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a40d2cc0 con 0x7f05a40d2fc0 2023-07-14T13:12:07.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.642+0000 7f05aa5c5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a40b04c0 con 0x7f05a40d2300 2023-07-14T13:12:07.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.642+0000 7f05a3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f05a415bde0 0x7f05a40d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:07.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.642+0000 7f05a3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f05a415bde0 0x7f05a40d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36016/0 (socket says 172.21.15.5:36016) 2023-07-14T13:12:07.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.642+0000 7f05a3fff640 1 -- 172.21.15.5:0/2170767263 learned_addr learned my addr 172.21.15.5:0/2170767263 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:07.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.642+0000 7f05a37fe640 1 --2- 172.21.15.5:0/2170767263 >> v2:172.21.15.154:3300/0 conn(0x7f05a40d2fc0 0x7f05a40b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:07.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.642+0000 7f05a8b62640 1 --2- 172.21.15.5:0/2170767263 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05a40d2300 0x7f05a40d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:07.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.642+0000 7f05a3fff640 1 -- 172.21.15.5:0/2170767263 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05a40d2300 msgr2=0x7f05a40d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:07.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.642+0000 7f05a3fff640 1 --2- 172.21.15.5:0/2170767263 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05a40d2300 0x7f05a40d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:07.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.642+0000 7f05a3fff640 1 -- 172.21.15.5:0/2170767263 >> v2:172.21.15.154:3300/0 conn(0x7f05a40d2fc0 msgr2=0x7f05a40b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:07.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.642+0000 7f05a3fff640 1 --2- 172.21.15.5:0/2170767263 >> v2:172.21.15.154:3300/0 conn(0x7f05a40d2fc0 0x7f05a40b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:07.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.642+0000 7f05a3fff640 1 -- 172.21.15.5:0/2170767263 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a40d0aa0 con 0x7f05a415bde0 2023-07-14T13:12:07.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.642+0000 7f05a8b62640 1 --2- 172.21.15.5:0/2170767263 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05a40d2300 0x7f05a40d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:07.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.646+0000 7f05a3fff640 1 --2- 172.21.15.5:0/2170767263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a415bde0 0x7f05a40d0270 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f05a408c600 tx=0x7f059401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326b2ae969f09b03 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:07.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.646+0000 7f05a2ffd640 1 -- 172.21.15.5:0/2170767263 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05940aa620 con 0x7f05a415bde0 2023-07-14T13:12:07.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.646+0000 7f05a2ffd640 1 -- 172.21.15.5:0/2170767263 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05940aa780 con 0x7f05a415bde0 2023-07-14T13:12:07.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.646+0000 7f05a2ffd640 1 -- 172.21.15.5:0/2170767263 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05940aab10 con 0x7f05a415bde0 2023-07-14T13:12:07.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.646+0000 7f05aa5c5640 1 -- 172.21.15.5:0/2170767263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a415bde0 msgr2=0x7f05a40d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:07.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.646+0000 7f05aa5c5640 1 --2- 172.21.15.5:0/2170767263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a415bde0 0x7f05a40d0270 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f05a408c600 tx=0x7f059401c500 comp rx=0 tx=0).stop 2023-07-14T13:12:07.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.646+0000 7f05aa5c5640 1 -- 172.21.15.5:0/2170767263 shutdown_connections 2023-07-14T13:12:07.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.646+0000 7f05aa5c5640 1 --2- 172.21.15.5:0/2170767263 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05a40d2300 0x7f05a40d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:07.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.646+0000 7f05aa5c5640 1 --2- 172.21.15.5:0/2170767263 >> v2:172.21.15.154:3300/0 conn(0x7f05a40d2fc0 0x7f05a40b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:07.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.646+0000 7f05aa5c5640 1 --2- 172.21.15.5:0/2170767263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a415bde0 0x7f05a40d0270 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:07.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.646+0000 7f05aa5c5640 1 -- 172.21.15.5:0/2170767263 >> 172.21.15.5:0/2170767263 conn(0x7f05a40659d0 msgr2=0x7f05a409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:07.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.646+0000 7f05aa5c5640 1 -- 172.21.15.5:0/2170767263 shutdown_connections 2023-07-14T13:12:07.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.646+0000 7f05aa5c5640 1 -- 172.21.15.5:0/2170767263 wait complete. 2023-07-14T13:12:07.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.650+0000 7f05aa5c5640 1 Processor -- start 2023-07-14T13:12:07.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.650+0000 7f05aa5c5640 1 -- start start 2023-07-14T13:12:07.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.650+0000 7f05aa5c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a40d2300 0x7f05a40c6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:07.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.650+0000 7f05aa5c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05a40d2fc0 0x7f05a40cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:07.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.650+0000 7f05aa5c5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05a415bde0 0x7f05a40b6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:07.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.650+0000 7f05aa5c5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a40b61f0 con 0x7f05a40d2300 2023-07-14T13:12:07.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.650+0000 7f05aa5c5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a40b6a00 con 0x7f05a40d2fc0 2023-07-14T13:12:07.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.650+0000 7f05aa5c5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a40b6440 con 0x7f05a415bde0 2023-07-14T13:12:07.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.650+0000 7f05a3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a40d2300 0x7f05a40c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:07.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.650+0000 7f05a3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a40d2300 0x7f05a40c6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36026/0 (socket says 172.21.15.5:36026) 2023-07-14T13:12:07.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.650+0000 7f05a3fff640 1 -- 172.21.15.5:0/3826337451 learned_addr learned my addr 172.21.15.5:0/3826337451 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:07.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.650+0000 7f05a8b62640 1 --2- 172.21.15.5:0/3826337451 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05a415bde0 0x7f05a40b6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:07.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.650+0000 7f05a37fe640 1 --2- 172.21.15.5:0/3826337451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05a40d2fc0 0x7f05a40cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:07.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.650+0000 7f05a3fff640 1 -- 172.21.15.5:0/3826337451 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05a415bde0 msgr2=0x7f05a40b6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:07.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.650+0000 7f05a3fff640 1 --2- 172.21.15.5:0/3826337451 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05a415bde0 0x7f05a40b6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:07.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.650+0000 7f05a3fff640 1 -- 172.21.15.5:0/3826337451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05a40d2fc0 msgr2=0x7f05a40cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:07.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.650+0000 7f05a3fff640 1 --2- 172.21.15.5:0/3826337451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05a40d2fc0 0x7f05a40cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:07.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.650+0000 7f05a3fff640 1 -- 172.21.15.5:0/3826337451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0594009480 con 0x7f05a40d2300 2023-07-14T13:12:07.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.650+0000 7f05a3fff640 1 --2- 172.21.15.5:0/3826337451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a40d2300 0x7f05a40c6400 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f059401cda0 tx=0x7f05940192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:07.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.654+0000 7f05a0ff9640 1 -- 172.21.15.5:0/3826337451 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05940044d0 con 0x7f05a40d2300 2023-07-14T13:12:07.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.654+0000 7f05a0ff9640 1 -- 172.21.15.5:0/3826337451 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05940059a0 con 0x7f05a40d2300 2023-07-14T13:12:07.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.654+0000 7f05aa5c5640 1 -- 172.21.15.5:0/3826337451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a40b6720 con 0x7f05a40d2300 2023-07-14T13:12:07.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.654+0000 7f05a0ff9640 1 -- 172.21.15.5:0/3826337451 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0594005d50 con 0x7f05a40d2300 2023-07-14T13:12:07.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.654+0000 7f05aa5c5640 1 -- 172.21.15.5:0/3826337451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a40b2000 con 0x7f05a40d2300 2023-07-14T13:12:07.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.654+0000 7f05aa5c5640 1 -- 172.21.15.5:0/3826337451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a40678d0 con 0x7f05a40d2300 2023-07-14T13:12:07.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.654+0000 7f05a0ff9640 1 -- 172.21.15.5:0/3826337451 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 60) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f05940aa8f0 con 0x7f05a40d2300 2023-07-14T13:12:07.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.654+0000 7f05a0ff9640 1 -- 172.21.15.5:0/3826337451 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6836+0+0 (secure 0 0 0) 0x7f059411dff0 con 0x7f05a40d2300 2023-07-14T13:12:07.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.658+0000 7f05a0ff9640 1 -- 172.21.15.5:0/3826337451 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f05940eb600 con 0x7f05a40d2300 2023-07-14T13:12:07.813 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:07.778+0000 7f6a8a42d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:12:07.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.818+0000 7f05aa5c5640 1 -- 172.21.15.5:0/3826337451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f05a40cd700 con 0x7f05a40d2300 2023-07-14T13:12:07.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.818+0000 7f05a0ff9640 1 -- 172.21.15.5:0/3826337451 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v129) v1 ==== 92+0+10 (secure 0 0 0) 0x7f05940c1020 con 0x7f05a40d2300 2023-07-14T13:12:07.852 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:12:07.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.818+0000 7f05aa5c5640 1 -- 172.21.15.5:0/3826337451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a40d2300 msgr2=0x7f05a40c6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:07.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.818+0000 7f05aa5c5640 1 --2- 172.21.15.5:0/3826337451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a40d2300 0x7f05a40c6400 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f059401cda0 tx=0x7f05940192a0 comp rx=0 tx=0).stop 2023-07-14T13:12:07.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.818+0000 7f05aa5c5640 1 -- 172.21.15.5:0/3826337451 shutdown_connections 2023-07-14T13:12:07.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.818+0000 7f05aa5c5640 1 --2- 172.21.15.5:0/3826337451 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05a415bde0 0x7f05a40b6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:07.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.818+0000 7f05aa5c5640 1 --2- 172.21.15.5:0/3826337451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05a40d2fc0 0x7f05a40cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:07.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.818+0000 7f05aa5c5640 1 --2- 172.21.15.5:0/3826337451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a40d2300 0x7f05a40c6400 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:07.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.818+0000 7f05aa5c5640 1 -- 172.21.15.5:0/3826337451 >> 172.21.15.5:0/3826337451 conn(0x7f05a40659d0 msgr2=0x7f05a41523c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:07.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.818+0000 7f05aa5c5640 1 -- 172.21.15.5:0/3826337451 shutdown_connections 2023-07-14T13:12:07.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.818+0000 7f05aa5c5640 1 -- 172.21.15.5:0/3826337451 wait complete. 2023-07-14T13:12:07.874 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T13:12:07.880 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:07.846+0000 7f6a8a42d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:12:08.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.986+0000 7f3af9b37640 1 Processor -- start 2023-07-14T13:12:08.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.986+0000 7f3af9b37640 1 -- start start 2023-07-14T13:12:08.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.990+0000 7f3af9b37640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3af41453a0 0x7f3af40b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.990+0000 7f3af9b37640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af406c040 con 0x7f3af406a440 2023-07-14T13:12:08.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.990+0000 7f3af9b37640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af4160600 con 0x7f3af415f690 2023-07-14T13:12:08.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.990+0000 7f3af9b37640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af4160170 con 0x7f3af41453a0 2023-07-14T13:12:08.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.990+0000 7f3af2ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3af406a440 0x7f3af406c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46874/0 (socket says 172.21.15.5:46874) 2023-07-14T13:12:08.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.990+0000 7f3af2ffd640 1 -- 172.21.15.5:0/2733540813 learned_addr learned my addr 172.21.15.5:0/2733540813 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:08.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.990+0000 7f3af3fff640 1 --2- 172.21.15.5:0/2733540813 >> v2:172.21.15.154:3300/0 conn(0x7f3af41453a0 0x7f3af40b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.990+0000 7f3af27fc640 1 -- 172.21.15.5:0/2733540813 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3649646689 0 0) 0x7f3af406c040 con 0x7f3af406a440 2023-07-14T13:12:08.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.990+0000 7f3af27fc640 1 -- 172.21.15.5:0/2733540813 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3adc003530 con 0x7f3af406a440 2023-07-14T13:12:08.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.990+0000 7f3af27fc640 1 -- 172.21.15.5:0/2733540813 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3972046862 0 0) 0x7f3af4160600 con 0x7f3af415f690 2023-07-14T13:12:08.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.990+0000 7f3af3fff640 1 -- 172.21.15.5:0/2733540813 >> v1:172.21.15.154:6789/0 conn(0x7f3af415f690 legacy=0x7f3af415fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:08.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.990+0000 7f3af3fff640 1 -- 172.21.15.5:0/2733540813 >> v1:172.21.15.5:6789/0 conn(0x7f3af406a440 legacy=0x7f3af406c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:08.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.990+0000 7f3af3fff640 1 -- 172.21.15.5:0/2733540813 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af4160360 con 0x7f3af41453a0 2023-07-14T13:12:08.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.994+0000 7f3af3fff640 1 --2- 172.21.15.5:0/2733540813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3af41453a0 0x7f3af40b1890 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f3aec009d90 tx=0x7f3aec01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9c3fd0a9d26e3fc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:08.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.994+0000 7f3af27fc640 1 -- 172.21.15.5:0/2733540813 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec0a5860 con 0x7f3af41453a0 2023-07-14T13:12:08.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.994+0000 7f3af27fc640 1 -- 172.21.15.5:0/2733540813 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aec0a59c0 con 0x7f3af41453a0 2023-07-14T13:12:08.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.994+0000 7f3af27fc640 1 -- 172.21.15.5:0/2733540813 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec0a5d50 con 0x7f3af41453a0 2023-07-14T13:12:08.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.994+0000 7f3af9b37640 1 -- 172.21.15.5:0/2733540813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3af41453a0 msgr2=0x7f3af40b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:08.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.994+0000 7f3af9b37640 1 --2- 172.21.15.5:0/2733540813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3af41453a0 0x7f3af40b1890 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f3aec009d90 tx=0x7f3aec01c890 comp rx=0 tx=0).stop 2023-07-14T13:12:08.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.994+0000 7f3af9b37640 1 -- 172.21.15.5:0/2733540813 shutdown_connections 2023-07-14T13:12:08.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.994+0000 7f3af9b37640 1 --2- 172.21.15.5:0/2733540813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3af41453a0 0x7f3af40b1890 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.994+0000 7f3af9b37640 1 -- 172.21.15.5:0/2733540813 >> 172.21.15.5:0/2733540813 conn(0x7f3af40b1210 msgr2=0x7f3af40ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:08.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.994+0000 7f3af9b37640 1 -- 172.21.15.5:0/2733540813 shutdown_connections 2023-07-14T13:12:08.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.994+0000 7f3af9b37640 1 -- 172.21.15.5:0/2733540813 wait complete. 2023-07-14T13:12:08.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.994+0000 7f3af9b37640 1 Processor -- start 2023-07-14T13:12:08.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.994+0000 7f3af9b37640 1 -- start start 2023-07-14T13:12:08.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.998+0000 7f3af9b37640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3af406a440 0x7f3af415d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.998+0000 7f3af9b37640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3af41453a0 0x7f3af415e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.998+0000 7f3af9b37640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3af415f690 0x7f3af41f7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.998+0000 7f3af9b37640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af415ce90 con 0x7f3af41453a0 2023-07-14T13:12:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.998+0000 7f3af9b37640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af415d860 con 0x7f3af415f690 2023-07-14T13:12:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.998+0000 7f3af9b37640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af415c280 con 0x7f3af406a440 2023-07-14T13:12:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.998+0000 7f3af2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3af41453a0 0x7f3af415e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.998+0000 7f3af2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3af41453a0 0x7f3af415e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36032/0 (socket says 172.21.15.5:36032) 2023-07-14T13:12:08.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.998+0000 7f3af2ffd640 1 -- 172.21.15.5:0/2639101562 learned_addr learned my addr 172.21.15.5:0/2639101562 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:08.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.998+0000 7f3af3fff640 1 --2- 172.21.15.5:0/2639101562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3af415f690 0x7f3af41f7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.998+0000 7f3af37fe640 1 --2- 172.21.15.5:0/2639101562 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3af406a440 0x7f3af415d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.998+0000 7f3af2ffd640 1 -- 172.21.15.5:0/2639101562 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3af406a440 msgr2=0x7f3af415d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:08.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.998+0000 7f3af2ffd640 1 --2- 172.21.15.5:0/2639101562 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3af406a440 0x7f3af415d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.998+0000 7f3af2ffd640 1 -- 172.21.15.5:0/2639101562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3af415f690 msgr2=0x7f3af41f7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:08.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.998+0000 7f3af2ffd640 1 --2- 172.21.15.5:0/2639101562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3af415f690 0x7f3af41f7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.998+0000 7f3af2ffd640 1 -- 172.21.15.5:0/2639101562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aec009a70 con 0x7f3af41453a0 2023-07-14T13:12:08.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.998+0000 7f3af2ffd640 1 --2- 172.21.15.5:0/2639101562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3af41453a0 0x7f3af415e6f0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f3ae800c3c0 tx=0x7f3ae800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:08.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.998+0000 7f3adbfff640 1 -- 172.21.15.5:0/2639101562 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8005cf0 con 0x7f3af41453a0 2023-07-14T13:12:08.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.998+0000 7f3adbfff640 1 -- 172.21.15.5:0/2639101562 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae8005e50 con 0x7f3af41453a0 2023-07-14T13:12:08.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.998+0000 7f3af9b37640 1 -- 172.21.15.5:0/2639101562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af415c560 con 0x7f3af41453a0 2023-07-14T13:12:08.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.998+0000 7f3adbfff640 1 -- 172.21.15.5:0/2639101562 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae80072f0 con 0x7f3af41453a0 2023-07-14T13:12:08.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.998+0000 7f3af9b37640 1 -- 172.21.15.5:0/2639101562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af415cb20 con 0x7f3af41453a0 2023-07-14T13:12:08.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.998+0000 7f3af9b37640 1 -- 172.21.15.5:0/2639101562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af415d040 con 0x7f3af41453a0 2023-07-14T13:12:08.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:07.998+0000 7f3adbfff640 1 -- 172.21.15.5:0/2639101562 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 60) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f3ae8007450 con 0x7f3af41453a0 2023-07-14T13:12:08.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.002+0000 7f3adbfff640 1 -- 172.21.15.5:0/2639101562 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6836+0+0 (secure 0 0 0) 0x7f3ae8083070 con 0x7f3af41453a0 2023-07-14T13:12:08.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.006+0000 7f3adbfff640 1 -- 172.21.15.5:0/2639101562 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3af415d040 con 0x7f3af41453a0 2023-07-14T13:12:08.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.158+0000 7f3af9b37640 1 -- 172.21.15.5:0/2639101562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3af40678d0 con 0x7f3af41453a0 2023-07-14T13:12:08.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.162+0000 7f3adbfff640 1 -- 172.21.15.5:0/2639101562 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v129) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3ae8050660 con 0x7f3af41453a0 2023-07-14T13:12:08.195 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T13:12:08.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.162+0000 7f3af9b37640 1 -- 172.21.15.5:0/2639101562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3af41453a0 msgr2=0x7f3af415e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:08.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.162+0000 7f3af9b37640 1 --2- 172.21.15.5:0/2639101562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3af41453a0 0x7f3af415e6f0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f3ae800c3c0 tx=0x7f3ae800c880 comp rx=0 tx=0).stop 2023-07-14T13:12:08.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.162+0000 7f3af9b37640 1 -- 172.21.15.5:0/2639101562 shutdown_connections 2023-07-14T13:12:08.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.162+0000 7f3af9b37640 1 --2- 172.21.15.5:0/2639101562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3af415f690 0x7f3af41f7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.162+0000 7f3af9b37640 1 --2- 172.21.15.5:0/2639101562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3af41453a0 0x7f3af415e6f0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.162+0000 7f3af9b37640 1 --2- 172.21.15.5:0/2639101562 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3af406a440 0x7f3af415d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.162+0000 7f3af9b37640 1 -- 172.21.15.5:0/2639101562 >> 172.21.15.5:0/2639101562 conn(0x7f3af40b1210 msgr2=0x7f3af40b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:08.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.162+0000 7f3af9b37640 1 -- 172.21.15.5:0/2639101562 shutdown_connections 2023-07-14T13:12:08.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.162+0000 7f3af9b37640 1 -- 172.21.15.5:0/2639101562 wait complete. 2023-07-14T13:12:08.216 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T13:12:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.370+0000 7f0204912640 1 Processor -- start 2023-07-14T13:12:08.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.370+0000 7f0204912640 1 -- start start 2023-07-14T13:12:08.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.370+0000 7f0204912640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02000b1620 0x7f02000ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.370+0000 7f0204912640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0200160750 0x7f020015c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.370+0000 7f0204912640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02000cf430 con 0x7f02000cc960 2023-07-14T13:12:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.370+0000 7f0204912640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02000cf710 con 0x7f0200160750 2023-07-14T13:12:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.370+0000 7f0204912640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020015fc70 con 0x7f02000b1620 2023-07-14T13:12:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.370+0000 7f01ff7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f02000cc960 0x7f02000ccd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46876/0 (socket says 172.21.15.5:46876) 2023-07-14T13:12:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.370+0000 7f01ff7fe640 1 -- 172.21.15.5:0/1982520298 learned_addr learned my addr 172.21.15.5:0/1982520298 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:08.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.370+0000 7f01fffff640 1 --2- 172.21.15.5:0/1982520298 >> v2:172.21.15.154:3300/0 conn(0x7f0200160750 0x7f020015c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.370+0000 7f01feffd640 1 --2- 172.21.15.5:0/1982520298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02000b1620 0x7f02000ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.370+0000 7f01fe7fc640 1 -- 172.21.15.5:0/1982520298 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998410635 0 0) 0x7f02000cf430 con 0x7f02000cc960 2023-07-14T13:12:08.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.370+0000 7f01fe7fc640 1 -- 172.21.15.5:0/1982520298 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01e8003530 con 0x7f02000cc960 2023-07-14T13:12:08.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.370+0000 7f01fffff640 1 -- 172.21.15.5:0/1982520298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02000b1620 msgr2=0x7f02000ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:08.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.370+0000 7f01fffff640 1 --2- 172.21.15.5:0/1982520298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02000b1620 0x7f02000ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.370+0000 7f01fffff640 1 -- 172.21.15.5:0/1982520298 >> v1:172.21.15.5:6789/0 conn(0x7f02000cc960 legacy=0x7f02000ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:08.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.370+0000 7f01fffff640 1 -- 172.21.15.5:0/1982520298 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020015ff50 con 0x7f0200160750 2023-07-14T13:12:08.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.374+0000 7f01fffff640 1 --2- 172.21.15.5:0/1982520298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0200160750 0x7f020015c310 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f01f8009d90 tx=0x7f01f801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=797a5dd73b662ba5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:08.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.374+0000 7f01fe7fc640 1 -- 172.21.15.5:0/1982520298 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f80a5a00 con 0x7f0200160750 2023-07-14T13:12:08.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.374+0000 7f01fe7fc640 1 -- 172.21.15.5:0/1982520298 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f80a5b60 con 0x7f0200160750 2023-07-14T13:12:08.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.374+0000 7f01fe7fc640 1 -- 172.21.15.5:0/1982520298 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f80ad440 con 0x7f0200160750 2023-07-14T13:12:08.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.374+0000 7f0204912640 1 -- 172.21.15.5:0/1982520298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0200160750 msgr2=0x7f020015c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:08.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.374+0000 7f0204912640 1 --2- 172.21.15.5:0/1982520298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0200160750 0x7f020015c310 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f01f8009d90 tx=0x7f01f801c920 comp rx=0 tx=0).stop 2023-07-14T13:12:08.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.374+0000 7f0204912640 1 -- 172.21.15.5:0/1982520298 shutdown_connections 2023-07-14T13:12:08.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.374+0000 7f0204912640 1 --2- 172.21.15.5:0/1982520298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0200160750 0x7f020015c310 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.374+0000 7f0204912640 1 --2- 172.21.15.5:0/1982520298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f02000b1620 0x7f02000ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.374+0000 7f0204912640 1 -- 172.21.15.5:0/1982520298 >> 172.21.15.5:0/1982520298 conn(0x7f0200069f50 msgr2=0x7f020006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:08.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.374+0000 7f0204912640 1 -- 172.21.15.5:0/1982520298 shutdown_connections 2023-07-14T13:12:08.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.374+0000 7f0204912640 1 -- 172.21.15.5:0/1982520298 wait complete. 2023-07-14T13:12:08.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.378+0000 7f0204912640 1 Processor -- start 2023-07-14T13:12:08.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.378+0000 7f0204912640 1 -- start start 2023-07-14T13:12:08.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.378+0000 7f0204912640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02000b1620 0x7f020014ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.378+0000 7f0204912640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02000cc960 0x7f02000b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.378+0000 7f0204912640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0200160750 0x7f02000b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.378+0000 7f0204912640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020014d410 con 0x7f02000cc960 2023-07-14T13:12:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.378+0000 7f0204912640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02001f46b0 con 0x7f02000b1620 2023-07-14T13:12:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.378+0000 7f0204912640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02001f43d0 con 0x7f0200160750 2023-07-14T13:12:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.378+0000 7f01feffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02000cc960 0x7f02000b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.378+0000 7f01feffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02000cc960 0x7f02000b19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36042/0 (socket says 172.21.15.5:36042) 2023-07-14T13:12:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.378+0000 7f01feffd640 1 -- 172.21.15.5:0/4187611976 learned_addr learned my addr 172.21.15.5:0/4187611976 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.378+0000 7f01fffff640 1 --2- 172.21.15.5:0/4187611976 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0200160750 0x7f02000b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.378+0000 7f01ff7fe640 1 --2- 172.21.15.5:0/4187611976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02000b1620 0x7f020014ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.378+0000 7f01feffd640 1 -- 172.21.15.5:0/4187611976 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0200160750 msgr2=0x7f02000b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.378+0000 7f01feffd640 1 --2- 172.21.15.5:0/4187611976 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0200160750 0x7f02000b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.378+0000 7f01feffd640 1 -- 172.21.15.5:0/4187611976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02000b1620 msgr2=0x7f020014ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.378+0000 7f01feffd640 1 --2- 172.21.15.5:0/4187611976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02000b1620 0x7f020014ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.378+0000 7f01feffd640 1 -- 172.21.15.5:0/4187611976 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f8009a70 con 0x7f02000cc960 2023-07-14T13:12:08.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.378+0000 7f01feffd640 1 --2- 172.21.15.5:0/4187611976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02000cc960 0x7f02000b19f0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f01f400e930 tx=0x7f01f400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:08.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.378+0000 7f01e7fff640 1 -- 172.21.15.5:0/4187611976 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f4009690 con 0x7f02000cc960 2023-07-14T13:12:08.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.378+0000 7f01e7fff640 1 -- 172.21.15.5:0/4187611976 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f400ca00 con 0x7f02000cc960 2023-07-14T13:12:08.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.378+0000 7f01e7fff640 1 -- 172.21.15.5:0/4187611976 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f400cd70 con 0x7f02000cc960 2023-07-14T13:12:08.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.378+0000 7f0204912640 1 -- 172.21.15.5:0/4187611976 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02001f55c0 con 0x7f02000cc960 2023-07-14T13:12:08.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.378+0000 7f0204912640 1 -- 172.21.15.5:0/4187611976 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02001f5b80 con 0x7f02000cc960 2023-07-14T13:12:08.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.382+0000 7f0204912640 1 -- 172.21.15.5:0/4187611976 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f020004e020 con 0x7f02000cc960 2023-07-14T13:12:08.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.382+0000 7f01e7fff640 1 -- 172.21.15.5:0/4187611976 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 60) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f01f4013470 con 0x7f02000cc960 2023-07-14T13:12:08.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.382+0000 7f01e7fff640 1 -- 172.21.15.5:0/4187611976 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6836+0+0 (secure 0 0 0) 0x7f01f4083d80 con 0x7f02000cc960 2023-07-14T13:12:08.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.386+0000 7f01e7fff640 1 -- 172.21.15.5:0/4187611976 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f01f4051310 con 0x7f02000cc960 2023-07-14T13:12:08.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.538+0000 7f0204912640 1 -- 172.21.15.5:0/4187611976 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f02000cfad0 con 0x7f02000cc960 2023-07-14T13:12:08.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.542+0000 7f01e7fff640 1 -- 172.21.15.5:0/4187611976 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v129) v1 ==== 100+0+11 (secure 0 0 0) 0x7f01f40170a0 con 0x7f02000cc960 2023-07-14T13:12:08.575 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T13:12:08.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.542+0000 7f0204912640 1 -- 172.21.15.5:0/4187611976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02000cc960 msgr2=0x7f02000b19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:08.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.542+0000 7f0204912640 1 --2- 172.21.15.5:0/4187611976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02000cc960 0x7f02000b19f0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f01f400e930 tx=0x7f01f400edf0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.542+0000 7f0204912640 1 -- 172.21.15.5:0/4187611976 shutdown_connections 2023-07-14T13:12:08.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.542+0000 7f0204912640 1 --2- 172.21.15.5:0/4187611976 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0200160750 0x7f02000b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.542+0000 7f0204912640 1 --2- 172.21.15.5:0/4187611976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02000cc960 0x7f02000b19f0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.542+0000 7f0204912640 1 --2- 172.21.15.5:0/4187611976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02000b1620 0x7f020014ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.542+0000 7f0204912640 1 -- 172.21.15.5:0/4187611976 >> 172.21.15.5:0/4187611976 conn(0x7f0200069f50 msgr2=0x7f020015eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:08.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.542+0000 7f0204912640 1 -- 172.21.15.5:0/4187611976 shutdown_connections 2023-07-14T13:12:08.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.542+0000 7f0204912640 1 -- 172.21.15.5:0/4187611976 wait complete. 2023-07-14T13:12:08.600 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:12:08.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.710+0000 7f4c46912640 1 Processor -- start 2023-07-14T13:12:08.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.714+0000 7f4c46912640 1 -- start start 2023-07-14T13:12:08.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.714+0000 7f4c46912640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4c400b7d90 0x7f4c400cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.714+0000 7f4c46912640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4c400d13f0 0x7f4c400ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.714+0000 7f4c46912640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c400d0f60 con 0x7f4c4015f3f0 2023-07-14T13:12:08.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.714+0000 7f4c46912640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c400d0390 con 0x7f4c400d13f0 2023-07-14T13:12:08.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.714+0000 7f4c46912640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c400d0630 con 0x7f4c400b7d90 2023-07-14T13:12:08.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.714+0000 7f4c46111640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4c400d13f0 0x7f4c400ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.714+0000 7f4c46111640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4c400d13f0 0x7f4c400ccee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36044/0 (socket says 172.21.15.5:36044) 2023-07-14T13:12:08.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.714+0000 7f4c46111640 1 -- 172.21.15.5:0/4135825964 learned_addr learned my addr 172.21.15.5:0/4135825964 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:08.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.714+0000 7f4c4510f640 1 --2- 172.21.15.5:0/4135825964 >> v2:172.21.15.154:3300/0 conn(0x7f4c400b7d90 0x7f4c400cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.714+0000 7f4c46111640 1 -- 172.21.15.5:0/4135825964 >> v2:172.21.15.154:3300/0 conn(0x7f4c400b7d90 msgr2=0x7f4c400cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:08.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.714+0000 7f4c46111640 1 --2- 172.21.15.5:0/4135825964 >> v2:172.21.15.154:3300/0 conn(0x7f4c400b7d90 0x7f4c400cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.714+0000 7f4c46111640 1 -- 172.21.15.5:0/4135825964 >> v1:172.21.15.154:6789/0 conn(0x7f4c4015f3f0 legacy=0x7f4c400b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:08.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.714+0000 7f4c46111640 1 -- 172.21.15.5:0/4135825964 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c400d0910 con 0x7f4c400d13f0 2023-07-14T13:12:08.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.718+0000 7f4c46111640 1 --2- 172.21.15.5:0/4135825964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c400d13f0 0x7f4c400ccee0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f4c400c5cc0 tx=0x7f4c3801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb8b272e4b5d600 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:08.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.718+0000 7f4c4490e640 1 -- 172.21.15.5:0/4135825964 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c380a55f0 con 0x7f4c400d13f0 2023-07-14T13:12:08.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.718+0000 7f4c4490e640 1 -- 172.21.15.5:0/4135825964 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c380a5750 con 0x7f4c400d13f0 2023-07-14T13:12:08.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.718+0000 7f4c4490e640 1 -- 172.21.15.5:0/4135825964 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c380a5ae0 con 0x7f4c400d13f0 2023-07-14T13:12:08.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.718+0000 7f4c46912640 1 -- 172.21.15.5:0/4135825964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c400d13f0 msgr2=0x7f4c400ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:08.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.718+0000 7f4c46912640 1 --2- 172.21.15.5:0/4135825964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c400d13f0 0x7f4c400ccee0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f4c400c5cc0 tx=0x7f4c3801c8b0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.718+0000 7f4c46912640 1 -- 172.21.15.5:0/4135825964 shutdown_connections 2023-07-14T13:12:08.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.718+0000 7f4c46912640 1 --2- 172.21.15.5:0/4135825964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c400d13f0 0x7f4c400ccee0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.718+0000 7f4c46912640 1 --2- 172.21.15.5:0/4135825964 >> v2:172.21.15.154:3300/0 conn(0x7f4c400b7d90 0x7f4c400cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.718+0000 7f4c46912640 1 -- 172.21.15.5:0/4135825964 >> 172.21.15.5:0/4135825964 conn(0x7f4c40069f50 msgr2=0x7f4c4006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:08.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.718+0000 7f4c46912640 1 -- 172.21.15.5:0/4135825964 shutdown_connections 2023-07-14T13:12:08.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.718+0000 7f4c46912640 1 -- 172.21.15.5:0/4135825964 wait complete. 2023-07-14T13:12:08.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.718+0000 7f4c46912640 1 Processor -- start 2023-07-14T13:12:08.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.718+0000 7f4c46912640 1 -- start start 2023-07-14T13:12:08.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.722+0000 7f4c46912640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c400b7d90 0x7f4c4015c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.722+0000 7f4c46912640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c400d13f0 0x7f4c40151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.722+0000 7f4c46912640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c4015f3f0 0x7f4c40156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.722+0000 7f4c46912640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c400cc310 con 0x7f4c400b7d90 2023-07-14T13:12:08.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.722+0000 7f4c46912640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c40152400 con 0x7f4c4015f3f0 2023-07-14T13:12:08.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.722+0000 7f4c46912640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c40151a30 con 0x7f4c400d13f0 2023-07-14T13:12:08.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.722+0000 7f4c45910640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c400b7d90 0x7f4c4015c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.722+0000 7f4c45910640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c400b7d90 0x7f4c4015c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36052/0 (socket says 172.21.15.5:36052) 2023-07-14T13:12:08.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.722+0000 7f4c45910640 1 -- 172.21.15.5:0/2138171599 learned_addr learned my addr 172.21.15.5:0/2138171599 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:08.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.722+0000 7f4c4510f640 1 --2- 172.21.15.5:0/2138171599 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c400d13f0 0x7f4c40151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.722+0000 7f4c46111640 1 --2- 172.21.15.5:0/2138171599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c4015f3f0 0x7f4c40156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.722+0000 7f4c45910640 1 -- 172.21.15.5:0/2138171599 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c400d13f0 msgr2=0x7f4c40151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:08.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.722+0000 7f4c45910640 1 --2- 172.21.15.5:0/2138171599 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c400d13f0 0x7f4c40151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.722+0000 7f4c45910640 1 -- 172.21.15.5:0/2138171599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c4015f3f0 msgr2=0x7f4c40156890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:08.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.722+0000 7f4c45910640 1 --2- 172.21.15.5:0/2138171599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c4015f3f0 0x7f4c40156890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.722+0000 7f4c45910640 1 -- 172.21.15.5:0/2138171599 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c38009b30 con 0x7f4c400b7d90 2023-07-14T13:12:08.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.722+0000 7f4c45910640 1 --2- 172.21.15.5:0/2138171599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c400b7d90 0x7f4c4015c3f0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c00c3f0 tx=0x7f4c3c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:08.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.722+0000 7f4c367fc640 1 -- 172.21.15.5:0/2138171599 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c0052d0 con 0x7f4c400b7d90 2023-07-14T13:12:08.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.722+0000 7f4c367fc640 1 -- 172.21.15.5:0/2138171599 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3c005430 con 0x7f4c400b7d90 2023-07-14T13:12:08.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.722+0000 7f4c367fc640 1 -- 172.21.15.5:0/2138171599 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c003840 con 0x7f4c400b7d90 2023-07-14T13:12:08.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.722+0000 7f4c46912640 1 -- 172.21.15.5:0/2138171599 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c40151100 con 0x7f4c400b7d90 2023-07-14T13:12:08.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.722+0000 7f4c46912640 1 -- 172.21.15.5:0/2138171599 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c401516c0 con 0x7f4c400b7d90 2023-07-14T13:12:08.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.722+0000 7f4c46912640 1 -- 172.21.15.5:0/2138171599 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c400678d0 con 0x7f4c400b7d90 2023-07-14T13:12:08.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.726+0000 7f4c367fc640 1 -- 172.21.15.5:0/2138171599 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 61) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f4c3c0039a0 con 0x7f4c400b7d90 2023-07-14T13:12:08.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.726+0000 7f4c367fc640 1 --2- 172.21.15.5:0/2138171599 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f4c240660d0 0x7f4c24068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.726+0000 7f4c367fc640 1 -- 172.21.15.5:0/2138171599 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6892+0+0 (secure 0 0 0) 0x7f4c3c0831f0 con 0x7f4c400b7d90 2023-07-14T13:12:08.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.726+0000 7f4c4510f640 1 --2- 172.21.15.5:0/2138171599 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f4c240660d0 0x7f4c24068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.726+0000 7f4c4510f640 1 --2- 172.21.15.5:0/2138171599 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f4c240660d0 0x7f4c24068580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4c400cc4c0 tx=0x7f4c30008040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:08.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.730+0000 7f4c367fc640 1 -- 172.21.15.5:0/2138171599 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4c3c050650 con 0x7f4c400b7d90 2023-07-14T13:12:08.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.918+0000 7f4c46912640 1 -- 172.21.15.5:0/2138171599 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c40089fb0 con 0x7f4c400b7d90 2023-07-14T13:12:08.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.918+0000 7f4c367fc640 1 -- 172.21.15.5:0/2138171599 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4708 (secure 0 0 0) 0x7f4c3c053c70 con 0x7f4c400b7d90 2023-07-14T13:12:08.953 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:08.953 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6980,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2963267082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2963267082},{"type":"v1","addr":"172.21.15.154:6836","nonce":2963267082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7885,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1576178254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1576178254},{"type":"v1","addr":"172.21.15.154:6837","nonce":1576178254}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/849067278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":849067278},{"type":"v1","addr":"172.21.15.5:6833","nonce":849067278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:11:28.287189+0000","modified":"2023-07-14T13:11:31.942546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1610819689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1610819689},{"type":"v1","addr":"172.21.15.5:6835","nonce":1610819689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-14T13:12:08.953 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 57 2023-07-14T13:12:08.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.918+0000 7f4c46912640 1 -- 172.21.15.5:0/2138171599 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f4c240660d0 msgr2=0x7f4c24068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:08.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.918+0000 7f4c46912640 1 --2- 172.21.15.5:0/2138171599 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f4c240660d0 0x7f4c24068580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4c400cc4c0 tx=0x7f4c30008040 comp rx=0 tx=0).stop 2023-07-14T13:12:08.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.918+0000 7f4c46912640 1 -- 172.21.15.5:0/2138171599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c400b7d90 msgr2=0x7f4c4015c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:08.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.918+0000 7f4c46912640 1 --2- 172.21.15.5:0/2138171599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c400b7d90 0x7f4c4015c3f0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c00c3f0 tx=0x7f4c3c00c8b0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.922+0000 7f4c46912640 1 -- 172.21.15.5:0/2138171599 shutdown_connections 2023-07-14T13:12:08.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.922+0000 7f4c46912640 1 --2- 172.21.15.5:0/2138171599 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f4c240660d0 0x7f4c24068580 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.922+0000 7f4c46912640 1 --2- 172.21.15.5:0/2138171599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c4015f3f0 0x7f4c40156890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.922+0000 7f4c46912640 1 --2- 172.21.15.5:0/2138171599 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c400d13f0 0x7f4c40151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.922+0000 7f4c46912640 1 --2- 172.21.15.5:0/2138171599 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c400b7d90 0x7f4c4015c3f0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.922+0000 7f4c46912640 1 -- 172.21.15.5:0/2138171599 >> 172.21.15.5:0/2138171599 conn(0x7f4c40069f50 msgr2=0x7f4c4006a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:08.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.922+0000 7f4c46912640 1 -- 172.21.15.5:0/2138171599 shutdown_connections 2023-07-14T13:12:08.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:08.922+0000 7f4c46912640 1 -- 172.21.15.5:0/2138171599 wait complete. 2023-07-14T13:12:08.977 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:12:09.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.086+0000 7f1d93248640 1 Processor -- start 2023-07-14T13:12:09.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.086+0000 7f1d93248640 1 -- start start 2023-07-14T13:12:09.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.086+0000 7f1d93248640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1d8c070b70 0x7f1d8c070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:09.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.086+0000 7f1d93248640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8c0cac70 con 0x7f1d8c06b1e0 2023-07-14T13:12:09.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.086+0000 7f1d93248640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8c071480 con 0x7f1d8c0cb100 2023-07-14T13:12:09.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.086+0000 7f1d93248640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d8c0ca060 con 0x7f1d8c070b70 2023-07-14T13:12:09.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.090+0000 7f1d90fe4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1d8c070b70 0x7f1d8c070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:09.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.090+0000 7f1d8bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1d8c06b1e0 0x7f1d8c0c1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52502/0 (socket says 172.21.15.5:52502) 2023-07-14T13:12:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.090+0000 7f1d90fe4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1d8c070b70 0x7f1d8c070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44982/0 (socket says 172.21.15.5:44982) 2023-07-14T13:12:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.090+0000 7f1d8bfff640 1 -- 172.21.15.5:0/3354556262 learned_addr learned my addr 172.21.15.5:0/3354556262 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.090+0000 7f1d90fe4640 1 -- 172.21.15.5:0/3354556262 >> v1:172.21.15.154:6789/0 conn(0x7f1d8c0cb100 legacy=0x7f1d8c0cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.090+0000 7f1d90fe4640 1 -- 172.21.15.5:0/3354556262 >> v1:172.21.15.5:6789/0 conn(0x7f1d8c06b1e0 legacy=0x7f1d8c0c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:09.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.090+0000 7f1d90fe4640 1 -- 172.21.15.5:0/3354556262 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8c0ca340 con 0x7f1d8c070b70 2023-07-14T13:12:09.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.090+0000 7f1d90fe4640 1 --2- 172.21.15.5:0/3354556262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8c070b70 0x7f1d8c070f40 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f1d800097c0 tx=0x7f1d8001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abaa7a97dc05f537 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:09.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.090+0000 7f1d8b7fe640 1 -- 172.21.15.5:0/3354556262 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d800ab650 con 0x7f1d8c070b70 2023-07-14T13:12:09.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.090+0000 7f1d8b7fe640 1 -- 172.21.15.5:0/3354556262 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d800ab7b0 con 0x7f1d8c070b70 2023-07-14T13:12:09.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.090+0000 7f1d8b7fe640 1 -- 172.21.15.5:0/3354556262 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d800abb40 con 0x7f1d8c070b70 2023-07-14T13:12:09.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.094+0000 7f1d93248640 1 -- 172.21.15.5:0/3354556262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8c070b70 msgr2=0x7f1d8c070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:09.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.094+0000 7f1d93248640 1 --2- 172.21.15.5:0/3354556262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8c070b70 0x7f1d8c070f40 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f1d800097c0 tx=0x7f1d8001c450 comp rx=0 tx=0).stop 2023-07-14T13:12:09.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.094+0000 7f1d93248640 1 -- 172.21.15.5:0/3354556262 shutdown_connections 2023-07-14T13:12:09.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.094+0000 7f1d93248640 1 --2- 172.21.15.5:0/3354556262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8c070b70 0x7f1d8c070f40 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:09.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.094+0000 7f1d93248640 1 -- 172.21.15.5:0/3354556262 >> 172.21.15.5:0/3354556262 conn(0x7f1d8c0afcf0 msgr2=0x7f1d8c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:09.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.094+0000 7f1d93248640 1 -- 172.21.15.5:0/3354556262 shutdown_connections 2023-07-14T13:12:09.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.094+0000 7f1d93248640 1 -- 172.21.15.5:0/3354556262 wait complete. 2023-07-14T13:12:09.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.094+0000 7f1d93248640 1 Processor -- start 2023-07-14T13:12:09.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.094+0000 7f1d93248640 1 -- start start 2023-07-14T13:12:09.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.094+0000 7f1d93248640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d8c06b1e0 0x7f1d8c14b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:09.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.094+0000 7f1d93248640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8c070b70 0x7f1d8c158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:09.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.094+0000 7f1d93248640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d8c0cb100 0x7f1d8c156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:09.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.094+0000 7f1d93248640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c14bc90 con 0x7f1d8c070b70 2023-07-14T13:12:09.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.094+0000 7f1d93248640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c155ea0 con 0x7f1d8c06b1e0 2023-07-14T13:12:09.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.094+0000 7f1d93248640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c156180 con 0x7f1d8c0cb100 2023-07-14T13:12:09.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.094+0000 7f1d8bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8c070b70 0x7f1d8c158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:09.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.094+0000 7f1d8bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8c070b70 0x7f1d8c158b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44998/0 (socket says 172.21.15.5:44998) 2023-07-14T13:12:09.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.094+0000 7f1d8bfff640 1 -- 172.21.15.5:0/4086790946 learned_addr learned my addr 172.21.15.5:0/4086790946 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:09.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.094+0000 7f1d917e5640 1 --2- 172.21.15.5:0/4086790946 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d8c0cb100 0x7f1d8c156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:09.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.094+0000 7f1d90fe4640 1 --2- 172.21.15.5:0/4086790946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d8c06b1e0 0x7f1d8c14b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:09.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.098+0000 7f1d8bfff640 1 -- 172.21.15.5:0/4086790946 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d8c0cb100 msgr2=0x7f1d8c156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:09.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.098+0000 7f1d8bfff640 1 --2- 172.21.15.5:0/4086790946 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d8c0cb100 0x7f1d8c156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:09.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.098+0000 7f1d8bfff640 1 -- 172.21.15.5:0/4086790946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d8c06b1e0 msgr2=0x7f1d8c14b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:09.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.098+0000 7f1d8bfff640 1 --2- 172.21.15.5:0/4086790946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d8c06b1e0 0x7f1d8c14b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:09.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.098+0000 7f1d8bfff640 1 -- 172.21.15.5:0/4086790946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d80009420 con 0x7f1d8c070b70 2023-07-14T13:12:09.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.098+0000 7f1d8bfff640 1 --2- 172.21.15.5:0/4086790946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8c070b70 0x7f1d8c158b10 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f1d7800c500 tx=0x7f1d7800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:09.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.098+0000 7f1d897fa640 1 -- 172.21.15.5:0/4086790946 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78005cf0 con 0x7f1d8c070b70 2023-07-14T13:12:09.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.098+0000 7f1d897fa640 1 -- 172.21.15.5:0/4086790946 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d78005e50 con 0x7f1d8c070b70 2023-07-14T13:12:09.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.098+0000 7f1d897fa640 1 -- 172.21.15.5:0/4086790946 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d780072f0 con 0x7f1d8c070b70 2023-07-14T13:12:09.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.098+0000 7f1d93248640 1 -- 172.21.15.5:0/4086790946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8c156460 con 0x7f1d8c070b70 2023-07-14T13:12:09.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.098+0000 7f1d93248640 1 -- 172.21.15.5:0/4086790946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8c156a20 con 0x7f1d8c070b70 2023-07-14T13:12:09.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.098+0000 7f1d93248640 1 -- 172.21.15.5:0/4086790946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d8c0678d0 con 0x7f1d8c070b70 2023-07-14T13:12:09.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.098+0000 7f1d897fa640 1 -- 172.21.15.5:0/4086790946 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 61) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f1d78007450 con 0x7f1d8c070b70 2023-07-14T13:12:09.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.098+0000 7f1d897fa640 1 --2- 172.21.15.5:0/4086790946 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f1d70066100 0x7f1d700685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:09.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.098+0000 7f1d897fa640 1 -- 172.21.15.5:0/4086790946 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6892+0+0 (secure 0 0 0) 0x7f1d78083280 con 0x7f1d8c070b70 2023-07-14T13:12:09.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.098+0000 7f1d90fe4640 1 --2- 172.21.15.5:0/4086790946 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f1d70066100 0x7f1d700685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:09.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.102+0000 7f1d90fe4640 1 --2- 172.21.15.5:0/4086790946 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f1d70066100 0x7f1d700685b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1d800af000 tx=0x7f1d800a7000 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:09.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.102+0000 7f1d897fa640 1 -- 172.21.15.5:0/4086790946 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f1d780506e0 con 0x7f1d8c070b70 2023-07-14T13:12:09.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.266+0000 7f1d93248640 1 -- 172.21.15.5:0/4086790946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d8c0c98c0 con 0x7f1d8c070b70 2023-07-14T13:12:09.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.266+0000 7f1d897fa640 1 -- 172.21.15.5:0/4086790946 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+19494 (secure 0 0 0) 0x7f1d78053d00 con 0x7f1d8c070b70 2023-07-14T13:12:09.302 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:09.302 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":130,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:12:08.554240+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:11:26.406551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-14T13:11:27.287297+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":130,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/605230019":"2023-07-15T13:12:07.549938+0000","172.21.15.154:0/437515910":"2023-07-15T13:12:07.549938+0000","172.21.15.154:0/3556608890":"2023-07-15T13:12:07.549938+0000","172.21.15.154:0/3390635630":"2023-07-15T13:12:07.549938+0000","172.21.15.154:0/1759662901":"2023-07-15T13:12:07.549938+0000","172.21.15.154:0/2920441378":"2023-07-15T13:12:07.549938+0000","172.21.15.154:0/767517454":"2023-07-15T13:12:07.549938+0000","172.21.15.154:6832/3453046028":"2023-07-15T13:12:07.549938+0000","172.21.15.154:6833/3453046028":"2023-07-15T13:12:07.549938+0000","172.21.15.154:0/629835727":"2023-07-15T13:11:45.510811+0000","172.21.15.154:0/3965225123":"2023-07-15T13:12:07.549938+0000","172.21.15.154:0/2051265191":"2023-07-15T13:11:45.510811+0000","172.21.15.154:6833/938367911":"2023-07-15T13:11:45.510811+0000","172.21.15.154:6832/938367911":"2023-07-15T13:11:45.510811+0000","172.21.15.154:0/270189207":"2023-07-15T13:11:45.510811+0000","172.21.15.154:0/3646451858":"2023-07-15T13:11:45.510811+0000","172.21.15.154:0/2058838315":"2023-07-15T13:11:45.510811+0000","172.21.15.154:0/1164555553":"2023-07-15T13:11:45.510811+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:12:09.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.270+0000 7f1d93248640 1 -- 172.21.15.5:0/4086790946 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f1d70066100 msgr2=0x7f1d700685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:09.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.270+0000 7f1d93248640 1 --2- 172.21.15.5:0/4086790946 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f1d70066100 0x7f1d700685b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1d800af000 tx=0x7f1d800a7000 comp rx=0 tx=0).stop 2023-07-14T13:12:09.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.270+0000 7f1d93248640 1 -- 172.21.15.5:0/4086790946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8c070b70 msgr2=0x7f1d8c158b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:09.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.270+0000 7f1d93248640 1 --2- 172.21.15.5:0/4086790946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8c070b70 0x7f1d8c158b10 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f1d7800c500 tx=0x7f1d7800c9c0 comp rx=0 tx=0).stop 2023-07-14T13:12:09.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.270+0000 7f1d93248640 1 -- 172.21.15.5:0/4086790946 shutdown_connections 2023-07-14T13:12:09.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.270+0000 7f1d93248640 1 --2- 172.21.15.5:0/4086790946 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f1d70066100 0x7f1d700685b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:09.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.270+0000 7f1d93248640 1 --2- 172.21.15.5:0/4086790946 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d8c0cb100 0x7f1d8c156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:09.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.270+0000 7f1d93248640 1 --2- 172.21.15.5:0/4086790946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8c070b70 0x7f1d8c158b10 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:09.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.270+0000 7f1d93248640 1 --2- 172.21.15.5:0/4086790946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d8c06b1e0 0x7f1d8c14b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:09.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.270+0000 7f1d93248640 1 -- 172.21.15.5:0/4086790946 >> 172.21.15.5:0/4086790946 conn(0x7f1d8c0afcf0 msgr2=0x7f1d8c0b0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:09.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.270+0000 7f1d93248640 1 -- 172.21.15.5:0/4086790946 shutdown_connections 2023-07-14T13:12:09.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.270+0000 7f1d93248640 1 -- 172.21.15.5:0/4086790946 wait complete. 2023-07-14T13:12:09.323 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-14T13:12:09.323 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:12:09.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.434+0000 7fbeb359e640 1 Processor -- start 2023-07-14T13:12:09.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.434+0000 7fbeb359e640 1 -- start start 2023-07-14T13:12:09.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.434+0000 7fbeb359e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbeb415f3f0 0x7fbeb40b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:09.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.434+0000 7fbeb359e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbeb40d13f0 0x7fbeb40b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:09.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.434+0000 7fbeb359e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeb40d0f60 con 0x7fbeb40cc9a0 2023-07-14T13:12:09.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.434+0000 7fbeb359e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeb40cd510 con 0x7fbeb40d13f0 2023-07-14T13:12:09.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.434+0000 7fbeb359e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeb40d0390 con 0x7fbeb415f3f0 2023-07-14T13:12:09.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.434+0000 7fbeb1d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbeb40d13f0 0x7fbeb40b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:09.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.434+0000 7fbeb1d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbeb40d13f0 0x7fbeb40b7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45000/0 (socket says 172.21.15.5:45000) 2023-07-14T13:12:09.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.434+0000 7fbeb1d9b640 1 -- 172.21.15.5:0/1012456606 learned_addr learned my addr 172.21.15.5:0/1012456606 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:09.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.434+0000 7fbeb259c640 1 --2- 172.21.15.5:0/1012456606 >> v2:172.21.15.154:3300/0 conn(0x7fbeb415f3f0 0x7fbeb40b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:09.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.434+0000 7fbeb259c640 1 -- 172.21.15.5:0/1012456606 >> v2:172.21.15.5:3300/0 conn(0x7fbeb40d13f0 msgr2=0x7fbeb40b7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:09.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.434+0000 7fbeb259c640 1 --2- 172.21.15.5:0/1012456606 >> v2:172.21.15.5:3300/0 conn(0x7fbeb40d13f0 0x7fbeb40b7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:09.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.434+0000 7fbeb259c640 1 -- 172.21.15.5:0/1012456606 >> v1:172.21.15.154:6789/0 conn(0x7fbeb40cc9a0 legacy=0x7fbeb40cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:09.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.434+0000 7fbeb259c640 1 -- 172.21.15.5:0/1012456606 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb40d0630 con 0x7fbeb415f3f0 2023-07-14T13:12:09.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.434+0000 7fbeb159a640 1 -- 172.21.15.5:0/1012456606 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4018912828 0 0) 0x7fbeb40d0f60 con 0x7fbeb40cc9a0 2023-07-14T13:12:09.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.434+0000 7fbeb1d9b640 1 --2- 172.21.15.5:0/1012456606 >> v2:172.21.15.5:3300/0 conn(0x7fbeb40d13f0 0x7fbeb40b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:09.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.438+0000 7fbeb259c640 1 --2- 172.21.15.5:0/1012456606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbeb415f3f0 0x7fbeb40b7680 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fbeb40cf890 tx=0x7fbea401c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a0046516810c6da server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:09.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.438+0000 7fbeb159a640 1 -- 172.21.15.5:0/1012456606 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea40ab600 con 0x7fbeb415f3f0 2023-07-14T13:12:09.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.438+0000 7fbeb159a640 1 -- 172.21.15.5:0/1012456606 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea40a7050 con 0x7fbeb415f3f0 2023-07-14T13:12:09.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.438+0000 7fbeb159a640 1 -- 172.21.15.5:0/1012456606 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea40ab980 con 0x7fbeb415f3f0 2023-07-14T13:12:09.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.438+0000 7fbeb359e640 1 -- 172.21.15.5:0/1012456606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbeb415f3f0 msgr2=0x7fbeb40b7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:09.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.438+0000 7fbeb359e640 1 --2- 172.21.15.5:0/1012456606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbeb415f3f0 0x7fbeb40b7680 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fbeb40cf890 tx=0x7fbea401c3d0 comp rx=0 tx=0).stop 2023-07-14T13:12:09.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.438+0000 7fbeb359e640 1 -- 172.21.15.5:0/1012456606 shutdown_connections 2023-07-14T13:12:09.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.438+0000 7fbeb359e640 1 --2- 172.21.15.5:0/1012456606 >> v2:172.21.15.5:3300/0 conn(0x7fbeb40d13f0 0x7fbeb40b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:09.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.438+0000 7fbeb359e640 1 --2- 172.21.15.5:0/1012456606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbeb415f3f0 0x7fbeb40b7680 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:09.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.438+0000 7fbeb359e640 1 -- 172.21.15.5:0/1012456606 >> 172.21.15.5:0/1012456606 conn(0x7fbeb4069f50 msgr2=0x7fbeb406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:09.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.438+0000 7fbeb359e640 1 -- 172.21.15.5:0/1012456606 shutdown_connections 2023-07-14T13:12:09.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.438+0000 7fbeb359e640 1 -- 172.21.15.5:0/1012456606 wait complete. 2023-07-14T13:12:09.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.442+0000 7fbeb359e640 1 Processor -- start 2023-07-14T13:12:09.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.442+0000 7fbeb359e640 1 -- start start 2023-07-14T13:12:09.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.442+0000 7fbeb359e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbeb40cc9a0 0x7fbeb40c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:09.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.442+0000 7fbeb359e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbeb40d13f0 0x7fbeb4157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:09.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.442+0000 7fbeb359e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbeb415f3f0 0x7fbeb415a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:09.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.442+0000 7fbeb359e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb41564c0 con 0x7fbeb415f3f0 2023-07-14T13:12:09.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.442+0000 7fbeb359e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb41575a0 con 0x7fbeb40cc9a0 2023-07-14T13:12:09.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.442+0000 7fbeb359e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb4158060 con 0x7fbeb40d13f0 2023-07-14T13:12:09.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.442+0000 7fbeb2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbeb415f3f0 0x7fbeb415a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:09.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.442+0000 7fbeb2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbeb415f3f0 0x7fbeb415a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45004/0 (socket says 172.21.15.5:45004) 2023-07-14T13:12:09.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.442+0000 7fbeb2d9d640 1 -- 172.21.15.5:0/112414305 learned_addr learned my addr 172.21.15.5:0/112414305 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:09.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.442+0000 7fbeb259c640 1 --2- 172.21.15.5:0/112414305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbeb40cc9a0 0x7fbeb40c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:09.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.442+0000 7fbeb1d9b640 1 --2- 172.21.15.5:0/112414305 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbeb40d13f0 0x7fbeb4157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:09.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.442+0000 7fbeb2d9d640 1 -- 172.21.15.5:0/112414305 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbeb40d13f0 msgr2=0x7fbeb4157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:09.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.442+0000 7fbeb2d9d640 1 --2- 172.21.15.5:0/112414305 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbeb40d13f0 0x7fbeb4157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:09.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.442+0000 7fbeb2d9d640 1 -- 172.21.15.5:0/112414305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbeb40cc9a0 msgr2=0x7fbeb40c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:09.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.442+0000 7fbeb2d9d640 1 --2- 172.21.15.5:0/112414305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbeb40cc9a0 0x7fbeb40c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:09.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.442+0000 7fbeb2d9d640 1 -- 172.21.15.5:0/112414305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea80094d0 con 0x7fbeb415f3f0 2023-07-14T13:12:09.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.442+0000 7fbeb2d9d640 1 --2- 172.21.15.5:0/112414305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbeb415f3f0 0x7fbeb415a070 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00c780 tx=0x7fbeac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:09.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.442+0000 7fbea2ffd640 1 -- 172.21.15.5:0/112414305 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac003db0 con 0x7fbeb415f3f0 2023-07-14T13:12:09.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.442+0000 7fbea2ffd640 1 -- 172.21.15.5:0/112414305 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeac00ce90 con 0x7fbeb415f3f0 2023-07-14T13:12:09.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.442+0000 7fbea2ffd640 1 -- 172.21.15.5:0/112414305 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac0052b0 con 0x7fbeb415f3f0 2023-07-14T13:12:09.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.442+0000 7fbeb359e640 1 -- 172.21.15.5:0/112414305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea4009420 con 0x7fbeb415f3f0 2023-07-14T13:12:09.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.442+0000 7fbeb359e640 1 -- 172.21.15.5:0/112414305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeb4158620 con 0x7fbeb415f3f0 2023-07-14T13:12:09.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.442+0000 7fbeb359e640 1 -- 172.21.15.5:0/112414305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeb4158e20 con 0x7fbeb415f3f0 2023-07-14T13:12:09.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.446+0000 7fbea2ffd640 1 -- 172.21.15.5:0/112414305 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 61) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fbeac005410 con 0x7fbeb415f3f0 2023-07-14T13:12:09.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.446+0000 7fbea2ffd640 1 --2- 172.21.15.5:0/112414305 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fbe940660d0 0x7fbe94068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:09.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.446+0000 7fbea2ffd640 1 -- 172.21.15.5:0/112414305 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6892+0+0 (secure 0 0 0) 0x7fbeac083ae0 con 0x7fbeb415f3f0 2023-07-14T13:12:09.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.446+0000 7fbeb259c640 1 --2- 172.21.15.5:0/112414305 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fbe940660d0 0x7fbe94068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:09.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.446+0000 7fbeb259c640 1 --2- 172.21.15.5:0/112414305 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fbe940660d0 0x7fbe94068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbea40ad000 tx=0x7fbea40a6000 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:09.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.450+0000 7fbea2ffd640 1 -- 172.21.15.5:0/112414305 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fbeb4158e20 con 0x7fbeb415f3f0 2023-07-14T13:12:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.638+0000 7fbeb359e640 1 -- 172.21.15.5:0/112414305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbeb4158e20 con 0x7fbeb415f3f0 2023-07-14T13:12:09.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.638+0000 7fbea2ffd640 1 -- 172.21.15.5:0/112414305 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4708 (secure 0 0 0) 0x7fbeb4158e20 con 0x7fbeb415f3f0 2023-07-14T13:12:09.672 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:09.673 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6980,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2963267082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2963267082},{"type":"v1","addr":"172.21.15.154:6836","nonce":2963267082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7885,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1576178254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1576178254},{"type":"v1","addr":"172.21.15.154:6837","nonce":1576178254}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/849067278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":849067278},{"type":"v1","addr":"172.21.15.5:6833","nonce":849067278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:11:28.287189+0000","modified":"2023-07-14T13:11:31.942546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1610819689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1610819689},{"type":"v1","addr":"172.21.15.5:6835","nonce":1610819689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-14T13:12:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 57 2023-07-14T13:12:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.638+0000 7fbeb359e640 1 -- 172.21.15.5:0/112414305 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fbe940660d0 msgr2=0x7fbe94068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.638+0000 7fbeb359e640 1 --2- 172.21.15.5:0/112414305 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fbe940660d0 0x7fbe94068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbea40ad000 tx=0x7fbea40a6000 comp rx=0 tx=0).stop 2023-07-14T13:12:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.638+0000 7fbeb359e640 1 -- 172.21.15.5:0/112414305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbeb415f3f0 msgr2=0x7fbeb415a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.638+0000 7fbeb359e640 1 --2- 172.21.15.5:0/112414305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbeb415f3f0 0x7fbeb415a070 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00c780 tx=0x7fbeac00cc40 comp rx=0 tx=0).stop 2023-07-14T13:12:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.638+0000 7fbeb359e640 1 -- 172.21.15.5:0/112414305 shutdown_connections 2023-07-14T13:12:09.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.638+0000 7fbeb359e640 1 --2- 172.21.15.5:0/112414305 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fbe940660d0 0x7fbe94068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:09.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.638+0000 7fbeb359e640 1 --2- 172.21.15.5:0/112414305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbeb415f3f0 0x7fbeb415a070 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:09.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.638+0000 7fbeb359e640 1 --2- 172.21.15.5:0/112414305 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbeb40d13f0 0x7fbeb4157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:09.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.638+0000 7fbeb359e640 1 --2- 172.21.15.5:0/112414305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbeb40cc9a0 0x7fbeb40c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:09.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.638+0000 7fbeb359e640 1 -- 172.21.15.5:0/112414305 >> 172.21.15.5:0/112414305 conn(0x7fbeb4069f50 msgr2=0x7fbeb40b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:09.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.638+0000 7fbeb359e640 1 -- 172.21.15.5:0/112414305 shutdown_connections 2023-07-14T13:12:09.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.638+0000 7fbeb359e640 1 -- 172.21.15.5:0/112414305 wait complete. 2023-07-14T13:12:09.693 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:12:09.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.802+0000 7fbe38834640 1 Processor -- start 2023-07-14T13:12:09.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.802+0000 7fbe38834640 1 -- start start 2023-07-14T13:12:09.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.802+0000 7fbe38834640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe340c8ad0 0x7fbe340c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:09.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.802+0000 7fbe38834640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe340cc700 con 0x7fbe340c9560 2023-07-14T13:12:09.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.802+0000 7fbe38834640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe340b0ff0 con 0x7fbe34158ce0 2023-07-14T13:12:09.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.802+0000 7fbe38834640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe340c99e0 con 0x7fbe340c8ad0 2023-07-14T13:12:09.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.802+0000 7fbe32d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbe340c9560 0x7fbe340ccb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52510/0 (socket says 172.21.15.5:52510) 2023-07-14T13:12:09.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.802+0000 7fbe32d9d640 1 -- 172.21.15.5:0/88361125 learned_addr learned my addr 172.21.15.5:0/88361125 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:09.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.802+0000 7fbe2bfff640 1 --2- 172.21.15.5:0/88361125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe340c8ad0 0x7fbe340c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:09.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.802+0000 7fbe31d9b640 1 -- 172.21.15.5:0/88361125 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134408319 0 0) 0x7fbe340cc700 con 0x7fbe340c9560 2023-07-14T13:12:09.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.802+0000 7fbe31d9b640 1 -- 172.21.15.5:0/88361125 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe20003530 con 0x7fbe340c9560 2023-07-14T13:12:09.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.802+0000 7fbe31d9b640 1 -- 172.21.15.5:0/88361125 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3597088800 0 0) 0x7fbe340b0ff0 con 0x7fbe34158ce0 2023-07-14T13:12:09.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.802+0000 7fbe31d9b640 1 -- 172.21.15.5:0/88361125 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe340cc700 con 0x7fbe34158ce0 2023-07-14T13:12:09.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.802+0000 7fbe2bfff640 1 -- 172.21.15.5:0/88361125 >> v1:172.21.15.154:6789/0 conn(0x7fbe34158ce0 legacy=0x7fbe34070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:09.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.806+0000 7fbe2bfff640 1 -- 172.21.15.5:0/88361125 >> v1:172.21.15.5:6789/0 conn(0x7fbe340c9560 legacy=0x7fbe340ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:09.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.806+0000 7fbe2bfff640 1 -- 172.21.15.5:0/88361125 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe34070c80 con 0x7fbe340c8ad0 2023-07-14T13:12:09.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.806+0000 7fbe2bfff640 1 --2- 172.21.15.5:0/88361125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe340c8ad0 0x7fbe340c9020 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0097f0 tx=0x7fbe1c01c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=490e5ec578a7c720 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:09.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.806+0000 7fbe31d9b640 1 -- 172.21.15.5:0/88361125 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c0ab600 con 0x7fbe340c8ad0 2023-07-14T13:12:09.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.806+0000 7fbe31d9b640 1 -- 172.21.15.5:0/88361125 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1c0a7050 con 0x7fbe340c8ad0 2023-07-14T13:12:09.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.806+0000 7fbe31d9b640 1 -- 172.21.15.5:0/88361125 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c0ab980 con 0x7fbe340c8ad0 2023-07-14T13:12:09.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.806+0000 7fbe38834640 1 -- 172.21.15.5:0/88361125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe340c8ad0 msgr2=0x7fbe340c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:09.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.806+0000 7fbe38834640 1 --2- 172.21.15.5:0/88361125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe340c8ad0 0x7fbe340c9020 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0097f0 tx=0x7fbe1c01c370 comp rx=0 tx=0).stop 2023-07-14T13:12:09.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.806+0000 7fbe38834640 1 -- 172.21.15.5:0/88361125 shutdown_connections 2023-07-14T13:12:09.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.806+0000 7fbe38834640 1 --2- 172.21.15.5:0/88361125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe340c8ad0 0x7fbe340c9020 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:09.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.806+0000 7fbe38834640 1 -- 172.21.15.5:0/88361125 >> 172.21.15.5:0/88361125 conn(0x7fbe340afcf0 msgr2=0x7fbe340b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:09.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.806+0000 7fbe38834640 1 -- 172.21.15.5:0/88361125 shutdown_connections 2023-07-14T13:12:09.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.806+0000 7fbe38834640 1 -- 172.21.15.5:0/88361125 wait complete. 2023-07-14T13:12:09.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.810+0000 7fbe38834640 1 Processor -- start 2023-07-14T13:12:09.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.810+0000 7fbe38834640 1 -- start start 2023-07-14T13:12:09.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.810+0000 7fbe38834640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe340c8ad0 0x7fbe341f3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:09.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.810+0000 7fbe38834640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe340c9560 0x7fbe340c2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:09.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.810+0000 7fbe38834640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe34158ce0 0x7fbe3414d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:09.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.810+0000 7fbe38834640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe340c3750 con 0x7fbe34158ce0 2023-07-14T13:12:09.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.810+0000 7fbe38834640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe340c3a30 con 0x7fbe340c9560 2023-07-14T13:12:09.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.810+0000 7fbe38834640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe340c3d10 con 0x7fbe340c8ad0 2023-07-14T13:12:09.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.810+0000 7fbe32d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe34158ce0 0x7fbe3414d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:09.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.810+0000 7fbe32d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe34158ce0 0x7fbe3414d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45018/0 (socket says 172.21.15.5:45018) 2023-07-14T13:12:09.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.810+0000 7fbe32d9d640 1 -- 172.21.15.5:0/1747901287 learned_addr learned my addr 172.21.15.5:0/1747901287 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:09.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.810+0000 7fbe2bfff640 1 --2- 172.21.15.5:0/1747901287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe340c9560 0x7fbe340c2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:09.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.810+0000 7fbe3259c640 1 --2- 172.21.15.5:0/1747901287 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe340c8ad0 0x7fbe341f3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:09.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.810+0000 7fbe32d9d640 1 -- 172.21.15.5:0/1747901287 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe340c8ad0 msgr2=0x7fbe341f3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:09.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.810+0000 7fbe32d9d640 1 --2- 172.21.15.5:0/1747901287 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe340c8ad0 0x7fbe341f3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:09.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.810+0000 7fbe32d9d640 1 -- 172.21.15.5:0/1747901287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe340c9560 msgr2=0x7fbe340c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:09.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.810+0000 7fbe32d9d640 1 --2- 172.21.15.5:0/1747901287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe340c9560 0x7fbe340c2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:09.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.810+0000 7fbe32d9d640 1 -- 172.21.15.5:0/1747901287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c009420 con 0x7fbe34158ce0 2023-07-14T13:12:09.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.810+0000 7fbe32d9d640 1 --2- 172.21.15.5:0/1747901287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe34158ce0 0x7fbe3414d1f0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c00caa0 tx=0x7fbe2c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:09.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.810+0000 7fbe2affd640 1 -- 172.21.15.5:0/1747901287 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c00ac00 con 0x7fbe34158ce0 2023-07-14T13:12:09.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.814+0000 7fbe2affd640 1 -- 172.21.15.5:0/1747901287 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2c00ad60 con 0x7fbe34158ce0 2023-07-14T13:12:09.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.814+0000 7fbe2affd640 1 -- 172.21.15.5:0/1747901287 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c012620 con 0x7fbe34158ce0 2023-07-14T13:12:09.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.814+0000 7fbe38834640 1 -- 172.21.15.5:0/1747901287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe34159d20 con 0x7fbe34158ce0 2023-07-14T13:12:09.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.814+0000 7fbe38834640 1 -- 172.21.15.5:0/1747901287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe340c3370 con 0x7fbe34158ce0 2023-07-14T13:12:09.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.814+0000 7fbe38834640 1 -- 172.21.15.5:0/1747901287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe340ca1a0 con 0x7fbe34158ce0 2023-07-14T13:12:09.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.814+0000 7fbe2affd640 1 -- 172.21.15.5:0/1747901287 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 61) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fbe2c007070 con 0x7fbe34158ce0 2023-07-14T13:12:09.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.814+0000 7fbe2affd640 1 --2- 172.21.15.5:0/1747901287 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fbe140660d0 0x7fbe14068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:09.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.814+0000 7fbe2affd640 1 -- 172.21.15.5:0/1747901287 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6892+0+0 (secure 0 0 0) 0x7fbe2c083c60 con 0x7fbe34158ce0 2023-07-14T13:12:09.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.814+0000 7fbe3259c640 1 --2- 172.21.15.5:0/1747901287 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fbe140660d0 0x7fbe14068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:09.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.814+0000 7fbe3259c640 1 --2- 172.21.15.5:0/1747901287 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fbe140660d0 0x7fbe14068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbe240011f0 tx=0x7fbe24009040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:09.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.818+0000 7fbe2affd640 1 -- 172.21.15.5:0/1747901287 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fbe2c0510c0 con 0x7fbe34158ce0 2023-07-14T13:12:09.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:09.838+0000 7fbe2affd640 1 -- 172.21.15.5:0/1747901287 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbe2c051490 con 0x7fbe34158ce0 2023-07-14T13:12:10.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.010+0000 7fbe38834640 1 -- 172.21.15.5:0/1747901287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe34159f60 con 0x7fbe34158ce0 2023-07-14T13:12:10.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.010+0000 7fbe2affd640 1 -- 172.21.15.5:0/1747901287 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4708 (secure 0 0 0) 0x7fbe34159f60 con 0x7fbe34158ce0 2023-07-14T13:12:10.045 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:10.045 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6980,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2963267082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2963267082},{"type":"v1","addr":"172.21.15.154:6836","nonce":2963267082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7885,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1576178254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1576178254},{"type":"v1","addr":"172.21.15.154:6837","nonce":1576178254}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/849067278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":849067278},{"type":"v1","addr":"172.21.15.5:6833","nonce":849067278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:11:28.287189+0000","modified":"2023-07-14T13:11:31.942546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8247":{"gid":8247,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/1610819689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1610819689},{"type":"v1","addr":"172.21.15.5:6835","nonce":1610819689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-14T13:12:10.046 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 57 2023-07-14T13:12:10.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.010+0000 7fbe38834640 1 -- 172.21.15.5:0/1747901287 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fbe140660d0 msgr2=0x7fbe14068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:10.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.010+0000 7fbe38834640 1 --2- 172.21.15.5:0/1747901287 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fbe140660d0 0x7fbe14068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbe240011f0 tx=0x7fbe24009040 comp rx=0 tx=0).stop 2023-07-14T13:12:10.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.010+0000 7fbe38834640 1 -- 172.21.15.5:0/1747901287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe34158ce0 msgr2=0x7fbe3414d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:10.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.010+0000 7fbe38834640 1 --2- 172.21.15.5:0/1747901287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe34158ce0 0x7fbe3414d1f0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c00caa0 tx=0x7fbe2c00cf60 comp rx=0 tx=0).stop 2023-07-14T13:12:10.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.010+0000 7fbe38834640 1 -- 172.21.15.5:0/1747901287 shutdown_connections 2023-07-14T13:12:10.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.010+0000 7fbe38834640 1 --2- 172.21.15.5:0/1747901287 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fbe140660d0 0x7fbe14068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.010+0000 7fbe38834640 1 --2- 172.21.15.5:0/1747901287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe34158ce0 0x7fbe3414d1f0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.010+0000 7fbe38834640 1 --2- 172.21.15.5:0/1747901287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe340c9560 0x7fbe340c2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.010+0000 7fbe38834640 1 --2- 172.21.15.5:0/1747901287 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe340c8ad0 0x7fbe341f3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.010+0000 7fbe38834640 1 -- 172.21.15.5:0/1747901287 >> 172.21.15.5:0/1747901287 conn(0x7fbe340afcf0 msgr2=0x7fbe340af230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:10.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.014+0000 7fbe38834640 1 -- 172.21.15.5:0/1747901287 shutdown_connections 2023-07-14T13:12:10.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.014+0000 7fbe38834640 1 -- 172.21.15.5:0/1747901287 wait complete. 2023-07-14T13:12:10.066 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:12:10.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.178+0000 7f821ed98640 1 Processor -- start 2023-07-14T13:12:10.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.178+0000 7f821ed98640 1 -- start start 2023-07-14T13:12:10.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.178+0000 7f821ed98640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f821815f3f0 0x7f82180b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:10.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.178+0000 7f821ed98640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f82180b7bc0 0x7f82180cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:10.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.178+0000 7f821ed98640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82180d0f60 con 0x7f82180d13f0 2023-07-14T13:12:10.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.178+0000 7f821ed98640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82180b7ff0 con 0x7f82180b7bc0 2023-07-14T13:12:10.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.178+0000 7f821ed98640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82180d0390 con 0x7f821815f3f0 2023-07-14T13:12:10.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.178+0000 7f821e597640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f82180b7bc0 0x7f82180cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:10.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.178+0000 7f821e597640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f82180b7bc0 0x7f82180cd0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45032/0 (socket says 172.21.15.5:45032) 2023-07-14T13:12:10.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.178+0000 7f821e597640 1 -- 172.21.15.5:0/3923557 learned_addr learned my addr 172.21.15.5:0/3923557 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:10.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.178+0000 7f821d595640 1 --1- 172.21.15.5:0/3923557 >> v1:172.21.15.154:6789/0 conn(0x7f82180d13f0 0x7f82180cc9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:33144/0 (socket says 172.21.15.5:33144) 2023-07-14T13:12:10.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.178+0000 7f821dd96640 1 --2- 172.21.15.5:0/3923557 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f821815f3f0 0x7f82180b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:10.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.178+0000 7f821e597640 1 -- 172.21.15.5:0/3923557 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f821815f3f0 msgr2=0x7f82180b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:10.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.178+0000 7f821e597640 1 --2- 172.21.15.5:0/3923557 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f821815f3f0 0x7f82180b7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.178+0000 7f821e597640 1 -- 172.21.15.5:0/3923557 >> v1:172.21.15.154:6789/0 conn(0x7f82180d13f0 legacy=0x7f82180cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:10.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.178+0000 7f821cd94640 1 -- 172.21.15.5:0/3923557 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1059203720 0 0) 0x7f82180d0f60 con 0x7f82180d13f0 2023-07-14T13:12:10.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.178+0000 7f821e597640 1 -- 172.21.15.5:0/3923557 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82180d0630 con 0x7f82180b7bc0 2023-07-14T13:12:10.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.182+0000 7f821e597640 1 --2- 172.21.15.5:0/3923557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82180b7bc0 0x7f82180cd0b0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f8210009e50 tx=0x7f821001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c83030ea06f93f79 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:10.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.182+0000 7f821cd94640 1 -- 172.21.15.5:0/3923557 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82100a5730 con 0x7f82180b7bc0 2023-07-14T13:12:10.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.182+0000 7f821cd94640 1 -- 172.21.15.5:0/3923557 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82100a5890 con 0x7f82180b7bc0 2023-07-14T13:12:10.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.182+0000 7f821cd94640 1 -- 172.21.15.5:0/3923557 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82100a5c20 con 0x7f82180b7bc0 2023-07-14T13:12:10.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.182+0000 7f821ed98640 1 -- 172.21.15.5:0/3923557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82180b7bc0 msgr2=0x7f82180cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:10.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.182+0000 7f821ed98640 1 --2- 172.21.15.5:0/3923557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82180b7bc0 0x7f82180cd0b0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f8210009e50 tx=0x7f821001c980 comp rx=0 tx=0).stop 2023-07-14T13:12:10.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.182+0000 7f821ed98640 1 -- 172.21.15.5:0/3923557 shutdown_connections 2023-07-14T13:12:10.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.182+0000 7f821ed98640 1 --2- 172.21.15.5:0/3923557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82180b7bc0 0x7f82180cd0b0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.182+0000 7f821ed98640 1 --2- 172.21.15.5:0/3923557 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f821815f3f0 0x7f82180b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.182+0000 7f821ed98640 1 -- 172.21.15.5:0/3923557 >> 172.21.15.5:0/3923557 conn(0x7f8218069f50 msgr2=0x7f821806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:10.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.182+0000 7f821ed98640 1 -- 172.21.15.5:0/3923557 shutdown_connections 2023-07-14T13:12:10.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.182+0000 7f821ed98640 1 -- 172.21.15.5:0/3923557 wait complete. 2023-07-14T13:12:10.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.182+0000 7f821ed98640 1 Processor -- start 2023-07-14T13:12:10.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.186+0000 7f821ed98640 1 -- start start 2023-07-14T13:12:10.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.186+0000 7f821ed98640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82180b7bc0 0x7f8218153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:10.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.186+0000 7f821ed98640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82180d13f0 0x7f82180c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:10.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.186+0000 7f821ed98640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f821815f3f0 0x7f821815c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:10.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.186+0000 7f821ed98640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82181546f0 con 0x7f82180d13f0 2023-07-14T13:12:10.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.186+0000 7f821ed98640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82180cbee0 con 0x7f82180b7bc0 2023-07-14T13:12:10.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.186+0000 7f821ed98640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8218152f80 con 0x7f821815f3f0 2023-07-14T13:12:10.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.186+0000 7f821d595640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82180d13f0 0x7f82180c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:10.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.186+0000 7f821d595640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82180d13f0 0x7f82180c94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45034/0 (socket says 172.21.15.5:45034) 2023-07-14T13:12:10.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.186+0000 7f821d595640 1 -- 172.21.15.5:0/2136923089 learned_addr learned my addr 172.21.15.5:0/2136923089 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:10.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.186+0000 7f821dd96640 1 --2- 172.21.15.5:0/2136923089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82180b7bc0 0x7f8218153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:10.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.186+0000 7f821e597640 1 --2- 172.21.15.5:0/2136923089 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f821815f3f0 0x7f821815c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:10.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.186+0000 7f821d595640 1 -- 172.21.15.5:0/2136923089 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f821815f3f0 msgr2=0x7f821815c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:10.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.186+0000 7f821d595640 1 --2- 172.21.15.5:0/2136923089 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f821815f3f0 0x7f821815c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.186+0000 7f821d595640 1 -- 172.21.15.5:0/2136923089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82180b7bc0 msgr2=0x7f8218153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:10.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.186+0000 7f821d595640 1 --2- 172.21.15.5:0/2136923089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82180b7bc0 0x7f8218153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.186+0000 7f821d595640 1 -- 172.21.15.5:0/2136923089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8210009b30 con 0x7f82180d13f0 2023-07-14T13:12:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.186+0000 7f821d595640 1 --2- 172.21.15.5:0/2136923089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82180d13f0 0x7f82180c94f0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f82080011f0 tx=0x7f820800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.186+0000 7f820e7fc640 1 -- 172.21.15.5:0/2136923089 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82080074e0 con 0x7f82180d13f0 2023-07-14T13:12:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.186+0000 7f820e7fc640 1 -- 172.21.15.5:0/2136923089 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8208007640 con 0x7f82180d13f0 2023-07-14T13:12:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.186+0000 7f820e7fc640 1 -- 172.21.15.5:0/2136923089 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8208004a10 con 0x7f82180d13f0 2023-07-14T13:12:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.186+0000 7f821ed98640 1 -- 172.21.15.5:0/2136923089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8218153260 con 0x7f82180d13f0 2023-07-14T13:12:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.186+0000 7f821ed98640 1 -- 172.21.15.5:0/2136923089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8218153fa0 con 0x7f82180d13f0 2023-07-14T13:12:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.186+0000 7f821ed98640 1 -- 172.21.15.5:0/2136923089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82180678d0 con 0x7f82180d13f0 2023-07-14T13:12:10.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.190+0000 7f820e7fc640 1 -- 172.21.15.5:0/2136923089 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8208004b70 con 0x7f82180d13f0 2023-07-14T13:12:10.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.190+0000 7f820e7fc640 1 --2- 172.21.15.5:0/2136923089 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f81fc0663a0 0x7f81fc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:10.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.190+0000 7f820e7fc640 1 -- 172.21.15.5:0/2136923089 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6892+0+0 (secure 0 0 0) 0x7f8208083410 con 0x7f82180d13f0 2023-07-14T13:12:10.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.190+0000 7f821dd96640 1 --2- 172.21.15.5:0/2136923089 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f81fc0663a0 0x7f81fc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:10.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.190+0000 7f821dd96640 1 --2- 172.21.15.5:0/2136923089 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f81fc0663a0 0x7f81fc068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8214009ac0 tx=0x7f8214009190 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:10.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.194+0000 7f820e7fc640 1 -- 172.21.15.5:0/2136923089 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f82080504f0 con 0x7f82180d13f0 2023-07-14T13:12:10.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.350+0000 7f821ed98640 1 -- 172.21.15.5:0/2136923089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8218153710 con 0x7f82180d13f0 2023-07-14T13:12:10.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.350+0000 7f820e7fc640 1 -- 172.21.15.5:0/2136923089 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+19494 (secure 0 0 0) 0x7f8208018090 con 0x7f82180d13f0 2023-07-14T13:12:10.386 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:10.387 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":130,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:12:08.554240+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:11:26.406551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-14T13:11:27.287297+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":130,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/605230019":"2023-07-15T13:12:07.549938+0000","172.21.15.154:0/437515910":"2023-07-15T13:12:07.549938+0000","172.21.15.154:0/3556608890":"2023-07-15T13:12:07.549938+0000","172.21.15.154:0/3390635630":"2023-07-15T13:12:07.549938+0000","172.21.15.154:0/1759662901":"2023-07-15T13:12:07.549938+0000","172.21.15.154:0/2920441378":"2023-07-15T13:12:07.549938+0000","172.21.15.154:0/767517454":"2023-07-15T13:12:07.549938+0000","172.21.15.154:6832/3453046028":"2023-07-15T13:12:07.549938+0000","172.21.15.154:6833/3453046028":"2023-07-15T13:12:07.549938+0000","172.21.15.154:0/629835727":"2023-07-15T13:11:45.510811+0000","172.21.15.154:0/3965225123":"2023-07-15T13:12:07.549938+0000","172.21.15.154:0/2051265191":"2023-07-15T13:11:45.510811+0000","172.21.15.154:6833/938367911":"2023-07-15T13:11:45.510811+0000","172.21.15.154:6832/938367911":"2023-07-15T13:11:45.510811+0000","172.21.15.154:0/270189207":"2023-07-15T13:11:45.510811+0000","172.21.15.154:0/3646451858":"2023-07-15T13:11:45.510811+0000","172.21.15.154:0/2058838315":"2023-07-15T13:11:45.510811+0000","172.21.15.154:0/1164555553":"2023-07-15T13:11:45.510811+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:12:10.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.354+0000 7f821ed98640 1 -- 172.21.15.5:0/2136923089 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f81fc0663a0 msgr2=0x7f81fc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:10.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.354+0000 7f821ed98640 1 --2- 172.21.15.5:0/2136923089 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f81fc0663a0 0x7f81fc068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8214009ac0 tx=0x7f8214009190 comp rx=0 tx=0).stop 2023-07-14T13:12:10.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.354+0000 7f821ed98640 1 -- 172.21.15.5:0/2136923089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82180d13f0 msgr2=0x7f82180c94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:10.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.354+0000 7f821ed98640 1 --2- 172.21.15.5:0/2136923089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82180d13f0 0x7f82180c94f0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f82080011f0 tx=0x7f820800c9b0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.354+0000 7f821ed98640 1 -- 172.21.15.5:0/2136923089 shutdown_connections 2023-07-14T13:12:10.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.354+0000 7f821ed98640 1 --2- 172.21.15.5:0/2136923089 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f81fc0663a0 0x7f81fc068850 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.354+0000 7f821ed98640 1 --2- 172.21.15.5:0/2136923089 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f821815f3f0 0x7f821815c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.354+0000 7f821ed98640 1 --2- 172.21.15.5:0/2136923089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82180d13f0 0x7f82180c94f0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.354+0000 7f821ed98640 1 --2- 172.21.15.5:0/2136923089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82180b7bc0 0x7f8218153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.354+0000 7f821ed98640 1 -- 172.21.15.5:0/2136923089 >> 172.21.15.5:0/2136923089 conn(0x7f8218069f50 msgr2=0x7f82180b4430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:10.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.354+0000 7f821ed98640 1 -- 172.21.15.5:0/2136923089 shutdown_connections 2023-07-14T13:12:10.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.354+0000 7f821ed98640 1 -- 172.21.15.5:0/2136923089 wait complete. 2023-07-14T13:12:10.407 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-14T13:12:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.518+0000 7f27e1d82640 1 Processor -- start 2023-07-14T13:12:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.518+0000 7f27e1d82640 1 -- start start 2023-07-14T13:12:10.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.518+0000 7f27e1d82640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f27dc0c8ad0 0x7f27dc0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:10.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.518+0000 7f27e1d82640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27dc0c9560 0x7f27dc0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.518+0000 7f27e1d82640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27dc0c99c0 con 0x7f27dc158ce0 2023-07-14T13:12:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.518+0000 7f27e1d82640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27dc0cc700 con 0x7f27dc0c9560 2023-07-14T13:12:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.518+0000 7f27e1d82640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27dc0b0ff0 con 0x7f27dc0c8ad0 2023-07-14T13:12:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.518+0000 7f27db7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f27dc158ce0 0x7f27dc070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52520/0 (socket says 172.21.15.5:52520) 2023-07-14T13:12:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.518+0000 7f27db7fe640 1 -- 172.21.15.5:0/2439484681 learned_addr learned my addr 172.21.15.5:0/2439484681 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.518+0000 7f27dbfff640 1 --2- 172.21.15.5:0/2439484681 >> v2:172.21.15.5:3300/0 conn(0x7f27dc0c9560 0x7f27dc0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.518+0000 7f27daffd640 1 --2- 172.21.15.5:0/2439484681 >> v2:172.21.15.154:3300/0 conn(0x7f27dc0c8ad0 0x7f27dc0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.518+0000 7f27dbfff640 1 -- 172.21.15.5:0/2439484681 >> v2:172.21.15.154:3300/0 conn(0x7f27dc0c8ad0 msgr2=0x7f27dc0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.518+0000 7f27dbfff640 1 --2- 172.21.15.5:0/2439484681 >> v2:172.21.15.154:3300/0 conn(0x7f27dc0c8ad0 0x7f27dc0c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.518+0000 7f27dbfff640 1 -- 172.21.15.5:0/2439484681 >> v1:172.21.15.5:6789/0 conn(0x7f27dc158ce0 legacy=0x7f27dc070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:10.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.518+0000 7f27dbfff640 1 -- 172.21.15.5:0/2439484681 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27dc070c80 con 0x7f27dc0c9560 2023-07-14T13:12:10.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.518+0000 7f27da7fc640 1 -- 172.21.15.5:0/2439484681 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3475383441 0 0) 0x7f27dc0c99c0 con 0x7f27dc158ce0 2023-07-14T13:12:10.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.522+0000 7f27dbfff640 1 --2- 172.21.15.5:0/2439484681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27dc0c9560 0x7f27dc0ccb90 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f27dc0c1a30 tx=0x7f27d401c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c8b9c52b161fb1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:10.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.522+0000 7f27da7fc640 1 -- 172.21.15.5:0/2439484681 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d40a5790 con 0x7f27dc0c9560 2023-07-14T13:12:10.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.522+0000 7f27da7fc640 1 -- 172.21.15.5:0/2439484681 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d40a58f0 con 0x7f27dc0c9560 2023-07-14T13:12:10.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.522+0000 7f27da7fc640 1 -- 172.21.15.5:0/2439484681 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d40a5c80 con 0x7f27dc0c9560 2023-07-14T13:12:10.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.522+0000 7f27e1d82640 1 -- 172.21.15.5:0/2439484681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27dc0c9560 msgr2=0x7f27dc0ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:10.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.522+0000 7f27e1d82640 1 --2- 172.21.15.5:0/2439484681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27dc0c9560 0x7f27dc0ccb90 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f27dc0c1a30 tx=0x7f27d401c7c0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.522+0000 7f27e1d82640 1 -- 172.21.15.5:0/2439484681 shutdown_connections 2023-07-14T13:12:10.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.522+0000 7f27e1d82640 1 --2- 172.21.15.5:0/2439484681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27dc0c9560 0x7f27dc0ccb90 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.522+0000 7f27e1d82640 1 --2- 172.21.15.5:0/2439484681 >> v2:172.21.15.154:3300/0 conn(0x7f27dc0c8ad0 0x7f27dc0c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.522+0000 7f27e1d82640 1 -- 172.21.15.5:0/2439484681 >> 172.21.15.5:0/2439484681 conn(0x7f27dc0afcf0 msgr2=0x7f27dc0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:10.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.522+0000 7f27e1d82640 1 -- 172.21.15.5:0/2439484681 shutdown_connections 2023-07-14T13:12:10.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.522+0000 7f27e1d82640 1 -- 172.21.15.5:0/2439484681 wait complete. 2023-07-14T13:12:10.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.526+0000 7f27e1d82640 1 Processor -- start 2023-07-14T13:12:10.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.526+0000 7f27e1d82640 1 -- start start 2023-07-14T13:12:10.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.526+0000 7f27e1d82640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27dc0c8ad0 0x7f27dc14ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:10.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.526+0000 7f27e1d82640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27dc0c9560 0x7f27dc14f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:10.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.526+0000 7f27e1d82640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27dc158ce0 0x7f27dc0b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:10.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.526+0000 7f27e1d82640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc0c2280 con 0x7f27dc0c9560 2023-07-14T13:12:10.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.526+0000 7f27e1d82640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc0c2560 con 0x7f27dc158ce0 2023-07-14T13:12:10.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.526+0000 7f27e1d82640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc0c2840 con 0x7f27dc0c8ad0 2023-07-14T13:12:10.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.526+0000 7f27daffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27dc0c9560 0x7f27dc14f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:10.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.526+0000 7f27daffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27dc0c9560 0x7f27dc14f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45046/0 (socket says 172.21.15.5:45046) 2023-07-14T13:12:10.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.526+0000 7f27daffd640 1 -- 172.21.15.5:0/140003723 learned_addr learned my addr 172.21.15.5:0/140003723 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:10.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.526+0000 7f27db7fe640 1 --2- 172.21.15.5:0/140003723 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27dc0c8ad0 0x7f27dc14ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:10.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.526+0000 7f27dbfff640 1 --2- 172.21.15.5:0/140003723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27dc158ce0 0x7f27dc0b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:10.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.526+0000 7f27daffd640 1 -- 172.21.15.5:0/140003723 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27dc0c8ad0 msgr2=0x7f27dc14ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:10.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.526+0000 7f27daffd640 1 --2- 172.21.15.5:0/140003723 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27dc0c8ad0 0x7f27dc14ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.526+0000 7f27daffd640 1 -- 172.21.15.5:0/140003723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27dc158ce0 msgr2=0x7f27dc0b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.526+0000 7f27daffd640 1 --2- 172.21.15.5:0/140003723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27dc158ce0 0x7f27dc0b2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.526+0000 7f27daffd640 1 -- 172.21.15.5:0/140003723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d4009a70 con 0x7f27dc0c9560 2023-07-14T13:12:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.526+0000 7f27daffd640 1 --2- 172.21.15.5:0/140003723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27dc0c9560 0x7f27dc14f440 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f27d000d800 tx=0x7f27d000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.526+0000 7f27c3fff640 1 -- 172.21.15.5:0/140003723 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d000b6c0 con 0x7f27dc0c9560 2023-07-14T13:12:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.526+0000 7f27c3fff640 1 -- 172.21.15.5:0/140003723 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d000b820 con 0x7f27dc0c9560 2023-07-14T13:12:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.526+0000 7f27c3fff640 1 -- 172.21.15.5:0/140003723 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d000bb90 con 0x7f27dc0c9560 2023-07-14T13:12:10.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.526+0000 7f27e1d82640 1 -- 172.21.15.5:0/140003723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27dc0c2b20 con 0x7f27dc0c9560 2023-07-14T13:12:10.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.526+0000 7f27e1d82640 1 -- 172.21.15.5:0/140003723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27dc1455d0 con 0x7f27dc0c9560 2023-07-14T13:12:10.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.530+0000 7f27e1d82640 1 -- 172.21.15.5:0/140003723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27dc0ca1a0 con 0x7f27dc0c9560 2023-07-14T13:12:10.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.530+0000 7f27c3fff640 1 -- 172.21.15.5:0/140003723 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f27d000bcf0 con 0x7f27dc0c9560 2023-07-14T13:12:10.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.530+0000 7f27c3fff640 1 --2- 172.21.15.5:0/140003723 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f27c80663a0 0x7f27c8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:10.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.530+0000 7f27c3fff640 1 -- 172.21.15.5:0/140003723 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6892+0+0 (secure 0 0 0) 0x7f27d0084550 con 0x7f27dc0c9560 2023-07-14T13:12:10.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.530+0000 7f27db7fe640 1 --2- 172.21.15.5:0/140003723 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f27c80663a0 0x7f27c8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:10.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.530+0000 7f27db7fe640 1 --2- 172.21.15.5:0/140003723 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f27c80663a0 0x7f27c8068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f27cc000f70 tx=0x7f27cc007df0 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:10.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.534+0000 7f27c3fff640 1 -- 172.21.15.5:0/140003723 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f27d0055150 con 0x7f27dc0c9560 2023-07-14T13:12:10.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.722+0000 7f27e1d82640 1 -- 172.21.15.5:0/140003723 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f27dc0678d0 con 0x7f27dc0c9560 2023-07-14T13:12:10.759 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-07-14T13:12:10.726+0000 7f17b1648640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-14T13:12:10.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.730+0000 7f27c3fff640 1 -- 172.21.15.5:0/140003723 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v58) v1 ==== 161+0+0 (secure 0 0 0) 0x7f27d0054ce0 con 0x7f27dc0c9560 2023-07-14T13:12:10.765 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-14T13:12:10.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.730+0000 7f27e1d82640 1 -- 172.21.15.5:0/140003723 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f27c80663a0 msgr2=0x7f27c8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:10.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.730+0000 7f27e1d82640 1 --2- 172.21.15.5:0/140003723 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f27c80663a0 0x7f27c8068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f27cc000f70 tx=0x7f27cc007df0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.730+0000 7f27e1d82640 1 -- 172.21.15.5:0/140003723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27dc0c9560 msgr2=0x7f27dc14f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:10.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.730+0000 7f27e1d82640 1 --2- 172.21.15.5:0/140003723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27dc0c9560 0x7f27dc14f440 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f27d000d800 tx=0x7f27d000dcc0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.730+0000 7f27e1d82640 1 -- 172.21.15.5:0/140003723 shutdown_connections 2023-07-14T13:12:10.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.730+0000 7f27e1d82640 1 --2- 172.21.15.5:0/140003723 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f27c80663a0 0x7f27c8068850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.730+0000 7f27e1d82640 1 --2- 172.21.15.5:0/140003723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27dc158ce0 0x7f27dc0b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.730+0000 7f27e1d82640 1 --2- 172.21.15.5:0/140003723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27dc0c9560 0x7f27dc14f440 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.730+0000 7f27e1d82640 1 --2- 172.21.15.5:0/140003723 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27dc0c8ad0 0x7f27dc14ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.730+0000 7f27e1d82640 1 -- 172.21.15.5:0/140003723 >> 172.21.15.5:0/140003723 conn(0x7f27dc0afcf0 msgr2=0x7f27dc06ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:10.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.734+0000 7f27e1d82640 1 -- 172.21.15.5:0/140003723 shutdown_connections 2023-07-14T13:12:10.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.734+0000 7f27e1d82640 1 -- 172.21.15.5:0/140003723 wait complete. 2023-07-14T13:12:10.775 INFO:tasks.ceph.mds.c.smithi005.stderr: -6701> 2023-07-14T13:11:33.875+0000 7f5ab58f6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T13:12:10.787 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-14T13:12:10.827 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-07-14T13:12:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.902+0000 7f174ff59640 1 Processor -- start 2023-07-14T13:12:10.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.902+0000 7f174ff59640 1 -- start start 2023-07-14T13:12:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.902+0000 7f174ff59640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1748159890 0x7f174815e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:10.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.902+0000 7f174ff59640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f17480cd7c0 0x7f1748070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:10.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.902+0000 7f174ff59640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1748159c60 0x7f1748070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:10.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.902+0000 7f174ff59640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174815e5c0 con 0x7f1748159c60 2023-07-14T13:12:10.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.902+0000 7f174ff59640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1748071410 con 0x7f17480cd7c0 2023-07-14T13:12:10.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.902+0000 7f174ff59640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17480cbf80 con 0x7f1748159890 2023-07-14T13:12:10.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.902+0000 7f174e4f6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1748159c60 0x7f1748070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:10.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.902+0000 7f174e4f6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1748159c60 0x7f1748070ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45070/0 (socket says 172.21.15.5:45070) 2023-07-14T13:12:10.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.902+0000 7f174e4f6640 1 -- 172.21.15.5:0/3367170520 learned_addr learned my addr 172.21.15.5:0/3367170520 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:10.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.902+0000 7f174d4f4640 1 --2- 172.21.15.5:0/3367170520 >> v2:172.21.15.154:3300/0 conn(0x7f17480cd7c0 0x7f1748070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:10.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.902+0000 7f174dcf5640 1 --2- 172.21.15.5:0/3367170520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1748159890 0x7f174815e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:10.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.902+0000 7f174e4f6640 1 -- 172.21.15.5:0/3367170520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1748159890 msgr2=0x7f174815e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:10.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.902+0000 7f174e4f6640 1 --2- 172.21.15.5:0/3367170520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1748159890 0x7f174815e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.902+0000 7f174e4f6640 1 -- 172.21.15.5:0/3367170520 >> v2:172.21.15.154:3300/0 conn(0x7f17480cd7c0 msgr2=0x7f1748070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:10.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.902+0000 7f174e4f6640 1 --2- 172.21.15.5:0/3367170520 >> v2:172.21.15.154:3300/0 conn(0x7f17480cd7c0 0x7f1748070990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.902+0000 7f174e4f6640 1 -- 172.21.15.5:0/3367170520 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17480cc260 con 0x7f1748159c60 2023-07-14T13:12:10.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.906+0000 7f174e4f6640 1 --2- 172.21.15.5:0/3367170520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1748159c60 0x7f1748070ed0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f17480660b0 tx=0x7f174001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d8ea891aba4ce0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:10.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.906+0000 7f174ccf3640 1 -- 172.21.15.5:0/3367170520 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17400a5700 con 0x7f1748159c60 2023-07-14T13:12:10.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.906+0000 7f174ccf3640 1 -- 172.21.15.5:0/3367170520 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17400a5860 con 0x7f1748159c60 2023-07-14T13:12:10.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.906+0000 7f174ccf3640 1 -- 172.21.15.5:0/3367170520 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17400a5bf0 con 0x7f1748159c60 2023-07-14T13:12:10.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.906+0000 7f174ff59640 1 -- 172.21.15.5:0/3367170520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1748159c60 msgr2=0x7f1748070ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:10.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.906+0000 7f174ff59640 1 --2- 172.21.15.5:0/3367170520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1748159c60 0x7f1748070ed0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f17480660b0 tx=0x7f174001c880 comp rx=0 tx=0).stop 2023-07-14T13:12:10.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.906+0000 7f174ff59640 1 -- 172.21.15.5:0/3367170520 shutdown_connections 2023-07-14T13:12:10.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.906+0000 7f174ff59640 1 --2- 172.21.15.5:0/3367170520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1748159c60 0x7f1748070ed0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.906+0000 7f174ff59640 1 --2- 172.21.15.5:0/3367170520 >> v2:172.21.15.154:3300/0 conn(0x7f17480cd7c0 0x7f1748070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.906+0000 7f174ff59640 1 --2- 172.21.15.5:0/3367170520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1748159890 0x7f174815e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.906+0000 7f174ff59640 1 -- 172.21.15.5:0/3367170520 >> 172.21.15.5:0/3367170520 conn(0x7f17480afac0 msgr2=0x7f17480afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:10.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.906+0000 7f174ff59640 1 -- 172.21.15.5:0/3367170520 shutdown_connections 2023-07-14T13:12:10.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.906+0000 7f174ff59640 1 -- 172.21.15.5:0/3367170520 wait complete. 2023-07-14T13:12:10.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.910+0000 7f174ff59640 1 Processor -- start 2023-07-14T13:12:10.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.910+0000 7f174ff59640 1 -- start start 2023-07-14T13:12:10.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.910+0000 7f174ff59640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17480cd7c0 0x7f17480b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:10.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.910+0000 7f174ff59640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1748159890 0x7f17480b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:10.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.910+0000 7f174ff59640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1748159c60 0x7f17480cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:10.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.910+0000 7f174ff59640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1748153540 con 0x7f1748159c60 2023-07-14T13:12:10.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.910+0000 7f174ff59640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1748152f30 con 0x7f17480cd7c0 2023-07-14T13:12:10.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.910+0000 7f174ff59640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17480b37f0 con 0x7f1748159890 2023-07-14T13:12:10.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.910+0000 7f174e4f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1748159c60 0x7f17480cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:10.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.910+0000 7f174e4f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1748159c60 0x7f17480cdf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45078/0 (socket says 172.21.15.5:45078) 2023-07-14T13:12:10.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.910+0000 7f174e4f6640 1 -- 172.21.15.5:0/2922682987 learned_addr learned my addr 172.21.15.5:0/2922682987 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:10.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.910+0000 7f174dcf5640 1 --2- 172.21.15.5:0/2922682987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17480cd7c0 0x7f17480b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:10.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.910+0000 7f174d4f4640 1 --2- 172.21.15.5:0/2922682987 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1748159890 0x7f17480b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:10.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.910+0000 7f174e4f6640 1 -- 172.21.15.5:0/2922682987 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1748159890 msgr2=0x7f17480b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:10.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.910+0000 7f174e4f6640 1 --2- 172.21.15.5:0/2922682987 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1748159890 0x7f17480b2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.910+0000 7f174e4f6640 1 -- 172.21.15.5:0/2922682987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17480cd7c0 msgr2=0x7f17480b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:10.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.910+0000 7f174e4f6640 1 --2- 172.21.15.5:0/2922682987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17480cd7c0 0x7f17480b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:10.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.910+0000 7f174e4f6640 1 -- 172.21.15.5:0/2922682987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1740009b30 con 0x7f1748159c60 2023-07-14T13:12:10.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.910+0000 7f174dcf5640 1 --2- 172.21.15.5:0/2922682987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17480cd7c0 0x7f17480b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:10.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.910+0000 7f174d4f4640 1 --2- 172.21.15.5:0/2922682987 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1748159890 0x7f17480b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:10.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.910+0000 7f174e4f6640 1 --2- 172.21.15.5:0/2922682987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1748159c60 0x7f17480cdf30 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f17400af040 tx=0x7f1740019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:10.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.910+0000 7f173e7fc640 1 -- 172.21.15.5:0/2922682987 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17400a5700 con 0x7f1748159c60 2023-07-14T13:12:10.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.910+0000 7f173e7fc640 1 -- 172.21.15.5:0/2922682987 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17400b8690 con 0x7f1748159c60 2023-07-14T13:12:10.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.910+0000 7f173e7fc640 1 -- 172.21.15.5:0/2922682987 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17400b8a40 con 0x7f1748159c60 2023-07-14T13:12:10.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.910+0000 7f174ff59640 1 -- 172.21.15.5:0/2922682987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17480b3ad0 con 0x7f1748159c60 2023-07-14T13:12:10.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.910+0000 7f174ff59640 1 -- 172.21.15.5:0/2922682987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17480b1820 con 0x7f1748159c60 2023-07-14T13:12:10.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.914+0000 7f174ff59640 1 -- 172.21.15.5:0/2922682987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17480b19b0 con 0x7f1748159c60 2023-07-14T13:12:10.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.914+0000 7f173e7fc640 1 -- 172.21.15.5:0/2922682987 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f17400b8ba0 con 0x7f1748159c60 2023-07-14T13:12:10.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.914+0000 7f173e7fc640 1 --2- 172.21.15.5:0/2922682987 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f172c0663a0 0x7f172c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:10.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.914+0000 7f173e7fc640 1 -- 172.21.15.5:0/2922682987 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6950+0+0 (secure 0 0 0) 0x7f174011f6b0 con 0x7f1748159c60 2023-07-14T13:12:10.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.914+0000 7f174dcf5640 1 --2- 172.21.15.5:0/2922682987 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f172c0663a0 0x7f172c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:10.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.914+0000 7f174dcf5640 1 --2- 172.21.15.5:0/2922682987 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f172c0663a0 0x7f172c068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1744009b30 tx=0x7f1744008040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:10.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:10.918+0000 7f173e7fc640 1 -- 172.21.15.5:0/2922682987 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f17400ec720 con 0x7f1748159c60 2023-07-14T13:12:11.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.106+0000 7f174ff59640 1 -- 172.21.15.5:0/2922682987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f17480678d0 con 0x7f1748159c60 2023-07-14T13:12:11.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.774+0000 7f173e7fc640 1 -- 172.21.15.5:0/2922682987 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v59) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1740009510 con 0x7f1748159c60 2023-07-14T13:12:11.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.778+0000 7f174ff59640 1 -- 172.21.15.5:0/2922682987 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f172c0663a0 msgr2=0x7f172c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:11.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.778+0000 7f174ff59640 1 --2- 172.21.15.5:0/2922682987 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f172c0663a0 0x7f172c068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1744009b30 tx=0x7f1744008040 comp rx=0 tx=0).stop 2023-07-14T13:12:11.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.778+0000 7f174ff59640 1 -- 172.21.15.5:0/2922682987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1748159c60 msgr2=0x7f17480cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:11.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.778+0000 7f174ff59640 1 --2- 172.21.15.5:0/2922682987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1748159c60 0x7f17480cdf30 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f17400af040 tx=0x7f1740019620 comp rx=0 tx=0).stop 2023-07-14T13:12:11.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.778+0000 7f174ff59640 1 -- 172.21.15.5:0/2922682987 shutdown_connections 2023-07-14T13:12:11.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.778+0000 7f174ff59640 1 --2- 172.21.15.5:0/2922682987 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f172c0663a0 0x7f172c068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:11.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.778+0000 7f174ff59640 1 --2- 172.21.15.5:0/2922682987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1748159c60 0x7f17480cdf30 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:11.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.778+0000 7f174ff59640 1 --2- 172.21.15.5:0/2922682987 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1748159890 0x7f17480b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:11.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.778+0000 7f174ff59640 1 --2- 172.21.15.5:0/2922682987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f17480cd7c0 0x7f17480b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:11.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.778+0000 7f174ff59640 1 -- 172.21.15.5:0/2922682987 >> 172.21.15.5:0/2922682987 conn(0x7f17480afac0 msgr2=0x7f17481554a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:11.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.778+0000 7f174ff59640 1 -- 172.21.15.5:0/2922682987 shutdown_connections 2023-07-14T13:12:11.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.778+0000 7f174ff59640 1 -- 172.21.15.5:0/2922682987 wait complete. 2023-07-14T13:12:11.836 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-14T13:12:12.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.998+0000 7f214f59e640 1 Processor -- start 2023-07-14T13:12:12.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.998+0000 7f214f59e640 1 -- start start 2023-07-14T13:12:12.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.998+0000 7f214f59e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f215015bb10 0x7f21500ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:12.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.998+0000 7f214f59e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f21500b11b0 0x7f21500cfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:12.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.998+0000 7f214f59e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21500ceaa0 con 0x7f21500d0220 2023-07-14T13:12:12.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.998+0000 7f214f59e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21500ce690 con 0x7f21500b11b0 2023-07-14T13:12:12.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.998+0000 7f214f59e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21500d1fb0 con 0x7f215015bb10 2023-07-14T13:12:12.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.998+0000 7f2147fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f21500b11b0 0x7f21500cfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:12.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.998+0000 7f214ed9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f21500d0220 0x7f21500cc760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52538/0 (socket says 172.21.15.5:52538) 2023-07-14T13:12:12.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.998+0000 7f214ed9d640 1 -- 172.21.15.5:0/1607239702 learned_addr learned my addr 172.21.15.5:0/1607239702 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:12.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.998+0000 7f2147fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f21500b11b0 0x7f21500cfce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45086/0 (socket says 172.21.15.5:45086) 2023-07-14T13:12:12.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.998+0000 7f2147fff640 1 -- 172.21.15.5:0/1607239702 >> v2:172.21.15.154:3300/0 conn(0x7f215015bb10 msgr2=0x7f21500ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:12.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.998+0000 7f214e59c640 1 --2- 172.21.15.5:0/1607239702 >> v2:172.21.15.154:3300/0 conn(0x7f215015bb10 0x7f21500ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:12.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.998+0000 7f2147fff640 1 --2- 172.21.15.5:0/1607239702 >> v2:172.21.15.154:3300/0 conn(0x7f215015bb10 0x7f21500ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:12.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.998+0000 7f214dd9b640 1 -- 172.21.15.5:0/1607239702 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2086472327 0 0) 0x7f21500ceaa0 con 0x7f21500d0220 2023-07-14T13:12:12.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.998+0000 7f2147fff640 1 -- 172.21.15.5:0/1607239702 >> v1:172.21.15.5:6789/0 conn(0x7f21500d0220 legacy=0x7f21500cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:12.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.998+0000 7f2147fff640 1 -- 172.21.15.5:0/1607239702 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21500ced80 con 0x7f21500b11b0 2023-07-14T13:12:12.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:11.998+0000 7f214e59c640 1 --2- 172.21.15.5:0/1607239702 >> v2:172.21.15.154:3300/0 conn(0x7f215015bb10 0x7f21500ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:12:12.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.002+0000 7f2147fff640 1 --2- 172.21.15.5:0/1607239702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21500b11b0 0x7f21500cfce0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f21500b4ca0 tx=0x7f213801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339063a14ab92960 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:12.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.002+0000 7f214dd9b640 1 -- 172.21.15.5:0/1607239702 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21380ab600 con 0x7f21500b11b0 2023-07-14T13:12:12.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.002+0000 7f214dd9b640 1 -- 172.21.15.5:0/1607239702 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21380a7050 con 0x7f21500b11b0 2023-07-14T13:12:12.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.002+0000 7f214dd9b640 1 -- 172.21.15.5:0/1607239702 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21380ab980 con 0x7f21500b11b0 2023-07-14T13:12:12.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.002+0000 7f214f59e640 1 -- 172.21.15.5:0/1607239702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21500b11b0 msgr2=0x7f21500cfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:12.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.002+0000 7f214f59e640 1 --2- 172.21.15.5:0/1607239702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21500b11b0 0x7f21500cfce0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f21500b4ca0 tx=0x7f213801c3d0 comp rx=0 tx=0).stop 2023-07-14T13:12:12.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.002+0000 7f214f59e640 1 -- 172.21.15.5:0/1607239702 shutdown_connections 2023-07-14T13:12:12.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.002+0000 7f214f59e640 1 --2- 172.21.15.5:0/1607239702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21500b11b0 0x7f21500cfce0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:12.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.002+0000 7f214f59e640 1 --2- 172.21.15.5:0/1607239702 >> v2:172.21.15.154:3300/0 conn(0x7f215015bb10 0x7f21500ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:12.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.002+0000 7f214f59e640 1 -- 172.21.15.5:0/1607239702 >> 172.21.15.5:0/1607239702 conn(0x7f215009b480 msgr2=0x7f21500d2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:12.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.002+0000 7f214f59e640 1 -- 172.21.15.5:0/1607239702 shutdown_connections 2023-07-14T13:12:12.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.002+0000 7f214f59e640 1 -- 172.21.15.5:0/1607239702 wait complete. 2023-07-14T13:12:12.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.006+0000 7f214f59e640 1 Processor -- start 2023-07-14T13:12:12.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.006+0000 7f214f59e640 1 -- start start 2023-07-14T13:12:12.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.006+0000 7f214f59e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21500b11b0 0x7f215006a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:12.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.006+0000 7f214f59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21500d0220 0x7f2150151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:12.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.006+0000 7f214f59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f215015bb10 0x7f21501535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:12.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.006+0000 7f214f59e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21501531a0 con 0x7f21500d0220 2023-07-14T13:12:12.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.006+0000 7f214f59e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2150151660 con 0x7f215015bb10 2023-07-14T13:12:12.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.006+0000 7f214f59e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21500ce450 con 0x7f21500b11b0 2023-07-14T13:12:12.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.006+0000 7f2147fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21500d0220 0x7f2150151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.006+0000 7f2147fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21500d0220 0x7f2150151120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45094/0 (socket says 172.21.15.5:45094) 2023-07-14T13:12:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.006+0000 7f2147fff640 1 -- 172.21.15.5:0/1937437316 learned_addr learned my addr 172.21.15.5:0/1937437316 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.006+0000 7f214e59c640 1 --2- 172.21.15.5:0/1937437316 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21500b11b0 0x7f215006a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.006+0000 7f214ed9d640 1 --2- 172.21.15.5:0/1937437316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f215015bb10 0x7f21501535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.006+0000 7f2147fff640 1 -- 172.21.15.5:0/1937437316 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21500b11b0 msgr2=0x7f215006a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.006+0000 7f2147fff640 1 --2- 172.21.15.5:0/1937437316 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21500b11b0 0x7f215006a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.006+0000 7f2147fff640 1 -- 172.21.15.5:0/1937437316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f215015bb10 msgr2=0x7f21501535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.006+0000 7f2147fff640 1 --2- 172.21.15.5:0/1937437316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f215015bb10 0x7f21501535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.006+0000 7f2147fff640 1 -- 172.21.15.5:0/1937437316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2138009420 con 0x7f21500d0220 2023-07-14T13:12:12.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.006+0000 7f2147fff640 1 --2- 172.21.15.5:0/1937437316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21500d0220 0x7f2150151120 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f21380ae040 tx=0x7f2138019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.006+0000 7f2146ffd640 1 -- 172.21.15.5:0/1937437316 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21380b4840 con 0x7f21500d0220 2023-07-14T13:12:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.006+0000 7f2146ffd640 1 -- 172.21.15.5:0/1937437316 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21380b49c0 con 0x7f21500d0220 2023-07-14T13:12:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.006+0000 7f214f59e640 1 -- 172.21.15.5:0/1937437316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2150152800 con 0x7f21500d0220 2023-07-14T13:12:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.006+0000 7f2146ffd640 1 -- 172.21.15.5:0/1937437316 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21380b4d70 con 0x7f21500d0220 2023-07-14T13:12:12.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.006+0000 7f214f59e640 1 -- 172.21.15.5:0/1937437316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2150152dc0 con 0x7f21500d0220 2023-07-14T13:12:12.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.006+0000 7f214f59e640 1 -- 172.21.15.5:0/1937437316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21501532e0 con 0x7f21500d0220 2023-07-14T13:12:12.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.010+0000 7f2146ffd640 1 -- 172.21.15.5:0/1937437316 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f21380b2040 con 0x7f21500d0220 2023-07-14T13:12:12.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.010+0000 7f2146ffd640 1 --2- 172.21.15.5:0/1937437316 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f21300663a0 0x7f2130068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:12.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.010+0000 7f2146ffd640 1 -- 172.21.15.5:0/1937437316 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6950+0+0 (secure 0 0 0) 0x7f213811e730 con 0x7f21500d0220 2023-07-14T13:12:12.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.010+0000 7f214e59c640 1 --2- 172.21.15.5:0/1937437316 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f21300663a0 0x7f2130068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:12.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.010+0000 7f214e59c640 1 --2- 172.21.15.5:0/1937437316 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f21300663a0 0x7f2130068850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2140006fd0 tx=0x7f2140008040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:12.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.014+0000 7f2146ffd640 1 -- 172.21.15.5:0/1937437316 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f21380eb6a0 con 0x7f21500d0220 2023-07-14T13:12:12.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.170+0000 7f214f59e640 1 -- 172.21.15.5:0/1937437316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f215004e020 con 0x7f21500d0220 2023-07-14T13:12:12.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.850+0000 7f2146ffd640 1 -- 172.21.15.5:0/1937437316 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v132) v1 ==== 181+0+0 (secure 0 0 0) 0x7f21380eecc0 con 0x7f21500d0220 2023-07-14T13:12:12.884 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-07-14T13:12:12.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.854+0000 7f214f59e640 1 -- 172.21.15.5:0/1937437316 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f21300663a0 msgr2=0x7f2130068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:12.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.854+0000 7f214f59e640 1 --2- 172.21.15.5:0/1937437316 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f21300663a0 0x7f2130068850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2140006fd0 tx=0x7f2140008040 comp rx=0 tx=0).stop 2023-07-14T13:12:12.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.854+0000 7f214f59e640 1 -- 172.21.15.5:0/1937437316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21500d0220 msgr2=0x7f2150151120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:12.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.854+0000 7f214f59e640 1 --2- 172.21.15.5:0/1937437316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21500d0220 0x7f2150151120 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f21380ae040 tx=0x7f2138019170 comp rx=0 tx=0).stop 2023-07-14T13:12:12.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.854+0000 7f214f59e640 1 -- 172.21.15.5:0/1937437316 shutdown_connections 2023-07-14T13:12:12.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.854+0000 7f214f59e640 1 --2- 172.21.15.5:0/1937437316 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f21300663a0 0x7f2130068850 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:12.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.854+0000 7f214f59e640 1 --2- 172.21.15.5:0/1937437316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f215015bb10 0x7f21501535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:12.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.854+0000 7f214f59e640 1 --2- 172.21.15.5:0/1937437316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21500d0220 0x7f2150151120 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:12.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.854+0000 7f214f59e640 1 --2- 172.21.15.5:0/1937437316 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f21500b11b0 0x7f215006a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:12.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.854+0000 7f214f59e640 1 -- 172.21.15.5:0/1937437316 >> 172.21.15.5:0/1937437316 conn(0x7f215009b480 msgr2=0x7f215006b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:12.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.854+0000 7f214f59e640 1 -- 172.21.15.5:0/1937437316 shutdown_connections 2023-07-14T13:12:12.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:12.854+0000 7f214f59e640 1 -- 172.21.15.5:0/1937437316 wait complete. 2023-07-14T13:12:12.911 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-14T13:12:13.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.030+0000 7f86bb26d640 1 Processor -- start 2023-07-14T13:12:13.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.030+0000 7f86bb26d640 1 -- start start 2023-07-14T13:12:13.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.030+0000 7f86bb26d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86b4069430 0x7f86b4069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.030+0000 7f86bb26d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f86b4070f30 0x7f86b40ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.030+0000 7f86bb26d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86b40af2b0 0x7f86b415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.030+0000 7f86bb26d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b4159d70 con 0x7f86b4069430 2023-07-14T13:12:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.030+0000 7f86bb26d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b4069d40 con 0x7f86b4070f30 2023-07-14T13:12:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.030+0000 7f86bb26d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b40c9c60 con 0x7f86b40af2b0 2023-07-14T13:12:13.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.030+0000 7f86b9009640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86b4069430 0x7f86b4069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:13.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.030+0000 7f86b9009640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86b4069430 0x7f86b4069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45100/0 (socket says 172.21.15.5:45100) 2023-07-14T13:12:13.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.030+0000 7f86b9009640 1 -- 172.21.15.5:0/4285013931 learned_addr learned my addr 172.21.15.5:0/4285013931 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:13.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.030+0000 7f86b980a640 1 --2- 172.21.15.5:0/4285013931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86b40af2b0 0x7f86b415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:13.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.030+0000 7f86b8808640 1 --2- 172.21.15.5:0/4285013931 >> v2:172.21.15.154:3300/0 conn(0x7f86b4070f30 0x7f86b40ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:13.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.030+0000 7f86b9009640 1 -- 172.21.15.5:0/4285013931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86b40af2b0 msgr2=0x7f86b415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:13.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.030+0000 7f86b9009640 1 --2- 172.21.15.5:0/4285013931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86b40af2b0 0x7f86b415a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:13.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.030+0000 7f86b9009640 1 -- 172.21.15.5:0/4285013931 >> v2:172.21.15.154:3300/0 conn(0x7f86b4070f30 msgr2=0x7f86b40ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:13.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.030+0000 7f86b9009640 1 --2- 172.21.15.5:0/4285013931 >> v2:172.21.15.154:3300/0 conn(0x7f86b4070f30 0x7f86b40ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:13.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.030+0000 7f86b9009640 1 -- 172.21.15.5:0/4285013931 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b40c9f40 con 0x7f86b4069430 2023-07-14T13:12:13.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.030+0000 7f86b980a640 1 --2- 172.21.15.5:0/4285013931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86b40af2b0 0x7f86b415a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:13.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.030+0000 7f86b8808640 1 --2- 172.21.15.5:0/4285013931 >> v2:172.21.15.154:3300/0 conn(0x7f86b4070f30 0x7f86b40ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:13.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.034+0000 7f86b9009640 1 --2- 172.21.15.5:0/4285013931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b4069430 0x7f86b4069800 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f86b40c9830 tx=0x7f86b001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d7ca687af4466e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:13.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.034+0000 7f86abfff640 1 -- 172.21.15.5:0/4285013931 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b00ac630 con 0x7f86b4069430 2023-07-14T13:12:13.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.034+0000 7f86abfff640 1 -- 172.21.15.5:0/4285013931 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b00ac790 con 0x7f86b4069430 2023-07-14T13:12:13.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.034+0000 7f86abfff640 1 -- 172.21.15.5:0/4285013931 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b00acb20 con 0x7f86b4069430 2023-07-14T13:12:13.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.034+0000 7f86bb26d640 1 -- 172.21.15.5:0/4285013931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b4069430 msgr2=0x7f86b4069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:13.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.034+0000 7f86bb26d640 1 --2- 172.21.15.5:0/4285013931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b4069430 0x7f86b4069800 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f86b40c9830 tx=0x7f86b001c500 comp rx=0 tx=0).stop 2023-07-14T13:12:13.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.034+0000 7f86bb26d640 1 -- 172.21.15.5:0/4285013931 shutdown_connections 2023-07-14T13:12:13.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.034+0000 7f86bb26d640 1 --2- 172.21.15.5:0/4285013931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86b40af2b0 0x7f86b415a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:13.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.034+0000 7f86bb26d640 1 --2- 172.21.15.5:0/4285013931 >> v2:172.21.15.154:3300/0 conn(0x7f86b4070f30 0x7f86b40ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:13.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.034+0000 7f86bb26d640 1 --2- 172.21.15.5:0/4285013931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b4069430 0x7f86b4069800 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:13.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.034+0000 7f86bb26d640 1 -- 172.21.15.5:0/4285013931 >> 172.21.15.5:0/4285013931 conn(0x7f86b40cde90 msgr2=0x7f86b40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:13.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.034+0000 7f86bb26d640 1 -- 172.21.15.5:0/4285013931 shutdown_connections 2023-07-14T13:12:13.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.038+0000 7f86bb26d640 1 -- 172.21.15.5:0/4285013931 wait complete. 2023-07-14T13:12:13.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.038+0000 7f86bb26d640 1 Processor -- start 2023-07-14T13:12:13.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.038+0000 7f86bb26d640 1 -- start start 2023-07-14T13:12:13.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.042+0000 7f86bb26d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86b4069430 0x7f86b40c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:13.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.042+0000 7f86bb26d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86b4070f30 0x7f86b4151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:13.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.042+0000 7f86bb26d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b40af2b0 0x7f86b40c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:13.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.042+0000 7f86bb26d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b41549f0 con 0x7f86b40af2b0 2023-07-14T13:12:13.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.042+0000 7f86bb26d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b41546a0 con 0x7f86b4069430 2023-07-14T13:12:13.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.042+0000 7f86bb26d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b40c7650 con 0x7f86b4070f30 2023-07-14T13:12:13.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.042+0000 7f86b980a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b40af2b0 0x7f86b40c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:13.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.042+0000 7f86b980a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b40af2b0 0x7f86b40c50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45110/0 (socket says 172.21.15.5:45110) 2023-07-14T13:12:13.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.042+0000 7f86b980a640 1 -- 172.21.15.5:0/1308635829 learned_addr learned my addr 172.21.15.5:0/1308635829 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:13.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.042+0000 7f86b9009640 1 --2- 172.21.15.5:0/1308635829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86b4069430 0x7f86b40c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:13.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.042+0000 7f86b8808640 1 --2- 172.21.15.5:0/1308635829 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86b4070f30 0x7f86b4151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:13.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.042+0000 7f86b980a640 1 -- 172.21.15.5:0/1308635829 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86b4070f30 msgr2=0x7f86b4151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:13.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.042+0000 7f86b980a640 1 --2- 172.21.15.5:0/1308635829 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86b4070f30 0x7f86b4151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:13.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.042+0000 7f86b980a640 1 -- 172.21.15.5:0/1308635829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86b4069430 msgr2=0x7f86b40c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:13.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.042+0000 7f86b980a640 1 --2- 172.21.15.5:0/1308635829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86b4069430 0x7f86b40c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:13.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.042+0000 7f86b980a640 1 -- 172.21.15.5:0/1308635829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b00094d0 con 0x7f86b40af2b0 2023-07-14T13:12:13.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.042+0000 7f86b9009640 1 --2- 172.21.15.5:0/1308635829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86b4069430 0x7f86b40c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:13.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.042+0000 7f86b980a640 1 --2- 172.21.15.5:0/1308635829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b40af2b0 0x7f86b40c50f0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f86ac007ea0 tx=0x7f86ac007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:13.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.042+0000 7f86a9ffb640 1 -- 172.21.15.5:0/1308635829 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac003ba0 con 0x7f86b40af2b0 2023-07-14T13:12:13.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.042+0000 7f86a9ffb640 1 -- 172.21.15.5:0/1308635829 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ac00f040 con 0x7f86b40af2b0 2023-07-14T13:12:13.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.042+0000 7f86a9ffb640 1 -- 172.21.15.5:0/1308635829 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac00de70 con 0x7f86b40af2b0 2023-07-14T13:12:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.042+0000 7f86bb26d640 1 -- 172.21.15.5:0/1308635829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b4152d60 con 0x7f86b40af2b0 2023-07-14T13:12:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.042+0000 7f86bb26d640 1 -- 172.21.15.5:0/1308635829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b40c7b80 con 0x7f86b40af2b0 2023-07-14T13:12:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.046+0000 7f86bb26d640 1 -- 172.21.15.5:0/1308635829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b4154b30 con 0x7f86b40af2b0 2023-07-14T13:12:13.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.046+0000 7f86a9ffb640 1 -- 172.21.15.5:0/1308635829 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f86ac004030 con 0x7f86b40af2b0 2023-07-14T13:12:13.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.046+0000 7f86a9ffb640 1 --2- 172.21.15.5:0/1308635829 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f86980663a0 0x7f8698068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:13.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.046+0000 7f86a9ffb640 1 -- 172.21.15.5:0/1308635829 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f86ac084380 con 0x7f86b40af2b0 2023-07-14T13:12:13.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.046+0000 7f86b9009640 1 --2- 172.21.15.5:0/1308635829 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f86980663a0 0x7f8698068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:13.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.046+0000 7f86b9009640 1 --2- 172.21.15.5:0/1308635829 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f86980663a0 0x7f8698068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f86b00ae000 tx=0x7f86b00a7000 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:13.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.050+0000 7f86a9ffb640 1 -- 172.21.15.5:0/1308635829 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f86b4154b30 con 0x7f86b40af2b0 2023-07-14T13:12:13.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.202+0000 7f86bb26d640 1 -- 172.21.15.5:0/1308635829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f86b4154b30 con 0x7f86b40af2b0 2023-07-14T13:12:13.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.862+0000 7f86a9ffb640 1 -- 172.21.15.5:0/1308635829 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v133) v1 ==== 169+0+0 (secure 0 0 0) 0x7f86b4154b30 con 0x7f86b40af2b0 2023-07-14T13:12:13.899 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-07-14T13:12:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.866+0000 7f86bb26d640 1 -- 172.21.15.5:0/1308635829 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f86980663a0 msgr2=0x7f8698068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.866+0000 7f86bb26d640 1 --2- 172.21.15.5:0/1308635829 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f86980663a0 0x7f8698068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f86b00ae000 tx=0x7f86b00a7000 comp rx=0 tx=0).stop 2023-07-14T13:12:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.866+0000 7f86bb26d640 1 -- 172.21.15.5:0/1308635829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b40af2b0 msgr2=0x7f86b40c50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.866+0000 7f86bb26d640 1 --2- 172.21.15.5:0/1308635829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b40af2b0 0x7f86b40c50f0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f86ac007ea0 tx=0x7f86ac007f90 comp rx=0 tx=0).stop 2023-07-14T13:12:13.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.866+0000 7f86bb26d640 1 -- 172.21.15.5:0/1308635829 shutdown_connections 2023-07-14T13:12:13.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.866+0000 7f86bb26d640 1 --2- 172.21.15.5:0/1308635829 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f86980663a0 0x7f8698068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:13.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.866+0000 7f86bb26d640 1 --2- 172.21.15.5:0/1308635829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b40af2b0 0x7f86b40c50f0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:13.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.866+0000 7f86bb26d640 1 --2- 172.21.15.5:0/1308635829 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86b4070f30 0x7f86b4151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:13.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.866+0000 7f86bb26d640 1 --2- 172.21.15.5:0/1308635829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86b4069430 0x7f86b40c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:13.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.866+0000 7f86bb26d640 1 -- 172.21.15.5:0/1308635829 >> 172.21.15.5:0/1308635829 conn(0x7f86b40cde90 msgr2=0x7f86b406b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:13.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.866+0000 7f86bb26d640 1 -- 172.21.15.5:0/1308635829 shutdown_connections 2023-07-14T13:12:13.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:13.866+0000 7f86bb26d640 1 -- 172.21.15.5:0/1308635829 wait complete. 2023-07-14T13:12:13.930 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-14T13:12:14.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.046+0000 7fe5f42f9640 1 Processor -- start 2023-07-14T13:12:14.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.046+0000 7fe5f42f9640 1 -- start start 2023-07-14T13:12:14.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.046+0000 7fe5f42f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5ec159500 0x7fe5ec0cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:14.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.046+0000 7fe5f42f9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5ec0b08d0 con 0x7fe5ec0cd670 2023-07-14T13:12:14.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.046+0000 7fe5f42f9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5ec159cb0 con 0x7fe5ec156560 2023-07-14T13:12:14.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.046+0000 7fe5f42f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec1599d0 con 0x7fe5ec159500 2023-07-14T13:12:14.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.046+0000 7fe5f1894640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe5ec0cd670 0x7fe5ec158df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52546/0 (socket says 172.21.15.5:52546) 2023-07-14T13:12:14.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.046+0000 7fe5f1894640 1 -- 172.21.15.5:0/111278661 learned_addr learned my addr 172.21.15.5:0/111278661 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:14.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.046+0000 7fe5f2896640 1 --2- 172.21.15.5:0/111278661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5ec159500 0x7fe5ec0cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:14.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.046+0000 7fe5f1093640 1 -- 172.21.15.5:0/111278661 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2652390455 0 0) 0x7fe5ec0b08d0 con 0x7fe5ec0cd670 2023-07-14T13:12:14.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.046+0000 7fe5f1093640 1 -- 172.21.15.5:0/111278661 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5d8005740 con 0x7fe5ec0cd670 2023-07-14T13:12:14.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.046+0000 7fe5f1093640 1 -- 172.21.15.5:0/111278661 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2624405832 0 0) 0x7fe5ec159cb0 con 0x7fe5ec156560 2023-07-14T13:12:14.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.046+0000 7fe5f1093640 1 -- 172.21.15.5:0/111278661 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5ec0b08d0 con 0x7fe5ec156560 2023-07-14T13:12:14.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.046+0000 7fe5f1093640 1 -- 172.21.15.5:0/111278661 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3127520947 0 0) 0x7fe5d8005740 con 0x7fe5ec0cd670 2023-07-14T13:12:14.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.046+0000 7fe5f1093640 1 -- 172.21.15.5:0/111278661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5ec159500 msgr2=0x7fe5ec0cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:14.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.046+0000 7fe5f1093640 1 --2- 172.21.15.5:0/111278661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5ec159500 0x7fe5ec0cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.046+0000 7fe5f1093640 1 -- 172.21.15.5:0/111278661 >> v1:172.21.15.154:6789/0 conn(0x7fe5ec156560 legacy=0x7fe5ec0ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:14.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.046+0000 7fe5f1093640 1 -- 172.21.15.5:0/111278661 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec0ca900 con 0x7fe5ec0cd670 2023-07-14T13:12:14.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.046+0000 7fe5f1093640 1 -- 172.21.15.5:0/111278661 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7fe5dc001680 con 0x7fe5ec0cd670 2023-07-14T13:12:14.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.046+0000 7fe5f1093640 1 -- 172.21.15.5:0/111278661 >> v1:172.21.15.5:6789/0 conn(0x7fe5ec0cd670 legacy=0x7fe5ec158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:14.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.046+0000 7fe5f1093640 1 --2- 172.21.15.5:0/111278661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5d8005d50 0x7fe5d8006140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:14.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.046+0000 7fe5f1093640 1 --2- 172.21.15.5:0/111278661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5ec159500 0x7fe5d80069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:14.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.046+0000 7fe5f1093640 1 --2- 172.21.15.5:0/111278661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5d8006f20 0x7fe5d8007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:14.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.046+0000 7fe5f1093640 1 -- 172.21.15.5:0/111278661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec1599d0 con 0x7fe5d8006f20 2023-07-14T13:12:14.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.046+0000 7fe5f1093640 1 -- 172.21.15.5:0/111278661 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d800dc50 con 0x7fe5d8005d50 2023-07-14T13:12:14.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.046+0000 7fe5f1093640 1 -- 172.21.15.5:0/111278661 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d800dde0 con 0x7fe5ec159500 2023-07-14T13:12:14.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.046+0000 7fe5f2896640 1 --2- 172.21.15.5:0/111278661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5d8006f20 0x7fe5d8007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:14.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.050+0000 7fe5f2095640 1 --2- 172.21.15.5:0/111278661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5d8005d50 0x7fe5d8006140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:14.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.050+0000 7fe5f1894640 1 --2- 172.21.15.5:0/111278661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5ec159500 0x7fe5d80069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.050+0000 7fe5f2896640 1 -- 172.21.15.5:0/111278661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5ec159500 msgr2=0x7fe5d80069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.050+0000 7fe5f2896640 1 --2- 172.21.15.5:0/111278661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5ec159500 0x7fe5d80069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.050+0000 7fe5f2896640 1 -- 172.21.15.5:0/111278661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5d8005d50 msgr2=0x7fe5d8006140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.050+0000 7fe5f2896640 1 --2- 172.21.15.5:0/111278661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5d8005d50 0x7fe5d8006140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.050+0000 7fe5f2896640 1 -- 172.21.15.5:0/111278661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d8005740 con 0x7fe5d8006f20 2023-07-14T13:12:14.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.050+0000 7fe5f1894640 1 --2- 172.21.15.5:0/111278661 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5ec159500 0x7fe5d80069e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.050+0000 7fe5f2896640 1 --2- 172.21.15.5:0/111278661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5d8006f20 0x7fe5d8007390 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4009f90 tx=0x7fe5e401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125ae503d17793a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.050+0000 7fe5f1093640 1 -- 172.21.15.5:0/111278661 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e40a5b20 con 0x7fe5d8006f20 2023-07-14T13:12:14.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.050+0000 7fe5f1093640 1 -- 172.21.15.5:0/111278661 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e400f040 con 0x7fe5d8006f20 2023-07-14T13:12:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.050+0000 7fe5f1093640 1 -- 172.21.15.5:0/111278661 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e40ad440 con 0x7fe5d8006f20 2023-07-14T13:12:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.050+0000 7fe5f42f9640 1 -- 172.21.15.5:0/111278661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5d8006f20 msgr2=0x7fe5d8007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.050+0000 7fe5f42f9640 1 --2- 172.21.15.5:0/111278661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5d8006f20 0x7fe5d8007390 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4009f90 tx=0x7fe5e401cc20 comp rx=0 tx=0).stop 2023-07-14T13:12:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.050+0000 7fe5f2896640 1 -- 172.21.15.5:0/111278661 reap_dead start 2023-07-14T13:12:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.054+0000 7fe5f42f9640 1 -- 172.21.15.5:0/111278661 shutdown_connections 2023-07-14T13:12:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.054+0000 7fe5f42f9640 1 -- 172.21.15.5:0/111278661 >> 172.21.15.5:0/111278661 conn(0x7fe5ec0afac0 msgr2=0x7fe5ec0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:14.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.054+0000 7fe5f42f9640 1 -- 172.21.15.5:0/111278661 shutdown_connections 2023-07-14T13:12:14.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.054+0000 7fe5f42f9640 1 -- 172.21.15.5:0/111278661 wait complete. 2023-07-14T13:12:14.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.054+0000 7fe5f42f9640 1 Processor -- start 2023-07-14T13:12:14.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.054+0000 7fe5f42f9640 1 -- start start 2023-07-14T13:12:14.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.054+0000 7fe5f42f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5d8006f20 0x7fe5ec0b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.054+0000 7fe5f42f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5ec1f1ed0 0x7fe5ec1579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.054+0000 7fe5f42f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5ec1f0ac0 0x7fe5ec0b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.054+0000 7fe5f42f9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec1584e0 con 0x7fe5ec1f1ed0 2023-07-14T13:12:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.054+0000 7fe5f42f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec158200 con 0x7fe5d8006f20 2023-07-14T13:12:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.054+0000 7fe5f42f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec0b0ef0 con 0x7fe5ec1f0ac0 2023-07-14T13:12:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.054+0000 7fe5f1894640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5ec1f1ed0 0x7fe5ec1579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:14.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.054+0000 7fe5f1894640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5ec1f1ed0 0x7fe5ec1579b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45116/0 (socket says 172.21.15.5:45116) 2023-07-14T13:12:14.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.054+0000 7fe5f1894640 1 -- 172.21.15.5:0/3598039475 learned_addr learned my addr 172.21.15.5:0/3598039475 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:14.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.054+0000 7fe5f2095640 1 --2- 172.21.15.5:0/3598039475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5d8006f20 0x7fe5ec0b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:14.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.054+0000 7fe5f2896640 1 --2- 172.21.15.5:0/3598039475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5ec1f0ac0 0x7fe5ec0b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:14.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.054+0000 7fe5f1894640 1 -- 172.21.15.5:0/3598039475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5ec1f0ac0 msgr2=0x7fe5ec0b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:14.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.054+0000 7fe5f1894640 1 --2- 172.21.15.5:0/3598039475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5ec1f0ac0 0x7fe5ec0b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.054+0000 7fe5f1894640 1 -- 172.21.15.5:0/3598039475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5d8006f20 msgr2=0x7fe5ec0b19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:14.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.054+0000 7fe5f1894640 1 --2- 172.21.15.5:0/3598039475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5d8006f20 0x7fe5ec0b19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.054+0000 7fe5f1894640 1 -- 172.21.15.5:0/3598039475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec0b11d0 con 0x7fe5ec1f1ed0 2023-07-14T13:12:14.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.058+0000 7fe5f1894640 1 --2- 172.21.15.5:0/3598039475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5ec1f1ed0 0x7fe5ec1579b0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc011980 tx=0x7fe5dc011d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:14.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.058+0000 7fe5e2ffd640 1 -- 172.21.15.5:0/3598039475 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc00fb60 con 0x7fe5ec1f1ed0 2023-07-14T13:12:14.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.058+0000 7fe5e2ffd640 1 -- 172.21.15.5:0/3598039475 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5dc00fcc0 con 0x7fe5ec1f1ed0 2023-07-14T13:12:14.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.058+0000 7fe5f42f9640 1 -- 172.21.15.5:0/3598039475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5ec0b14b0 con 0x7fe5ec1f1ed0 2023-07-14T13:12:14.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.058+0000 7fe5e2ffd640 1 -- 172.21.15.5:0/3598039475 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc015610 con 0x7fe5ec1f1ed0 2023-07-14T13:12:14.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.058+0000 7fe5f42f9640 1 -- 172.21.15.5:0/3598039475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5ec1f0f60 con 0x7fe5ec1f1ed0 2023-07-14T13:12:14.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.058+0000 7fe5f42f9640 1 -- 172.21.15.5:0/3598039475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5ec0b16f0 con 0x7fe5ec1f1ed0 2023-07-14T13:12:14.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.058+0000 7fe5e2ffd640 1 -- 172.21.15.5:0/3598039475 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe5dc015770 con 0x7fe5ec1f1ed0 2023-07-14T13:12:14.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.058+0000 7fe5e2ffd640 1 --2- 172.21.15.5:0/3598039475 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fe5d00663d0 0x7fe5d0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:14.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.058+0000 7fe5e2ffd640 1 -- 172.21.15.5:0/3598039475 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6098+0+0 (secure 0 0 0) 0x7fe5dc086fd0 con 0x7fe5ec1f1ed0 2023-07-14T13:12:14.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.062+0000 7fe5f2095640 1 --2- 172.21.15.5:0/3598039475 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fe5d00663d0 0x7fe5d0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:14.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.062+0000 7fe5f2095640 1 --2- 172.21.15.5:0/3598039475 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fe5d00663d0 0x7fe5d0068880 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0cd500 tx=0x7fe5e8009040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:14.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.062+0000 7fe5e2ffd640 1 -- 172.21.15.5:0/3598039475 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe5ec0b16f0 con 0x7fe5ec1f1ed0 2023-07-14T13:12:14.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.222+0000 7fe5f42f9640 1 -- 172.21.15.5:0/3598039475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fe5ec0b16f0 con 0x7fe5ec1f1ed0 2023-07-14T13:12:14.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.238+0000 7fe5e2ffd640 1 -- 172.21.15.5:0/3598039475 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v43) v1 ==== 120+0+0 (secure 0 0 0) 0x7fe5ec0b16f0 con 0x7fe5ec1f1ed0 2023-07-14T13:12:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.242+0000 7fe5f42f9640 1 -- 172.21.15.5:0/3598039475 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fe5d00663d0 msgr2=0x7fe5d0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.242+0000 7fe5f42f9640 1 --2- 172.21.15.5:0/3598039475 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fe5d00663d0 0x7fe5d0068880 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0cd500 tx=0x7fe5e8009040 comp rx=0 tx=0).stop 2023-07-14T13:12:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.242+0000 7fe5f42f9640 1 -- 172.21.15.5:0/3598039475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5ec1f1ed0 msgr2=0x7fe5ec1579b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.242+0000 7fe5f42f9640 1 --2- 172.21.15.5:0/3598039475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5ec1f1ed0 0x7fe5ec1579b0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc011980 tx=0x7fe5dc011d80 comp rx=0 tx=0).stop 2023-07-14T13:12:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.242+0000 7fe5f42f9640 1 -- 172.21.15.5:0/3598039475 shutdown_connections 2023-07-14T13:12:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.242+0000 7fe5f42f9640 1 --2- 172.21.15.5:0/3598039475 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fe5d00663d0 0x7fe5d0068880 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.242+0000 7fe5f42f9640 1 --2- 172.21.15.5:0/3598039475 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5ec1f0ac0 0x7fe5ec0b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.242+0000 7fe5f42f9640 1 --2- 172.21.15.5:0/3598039475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5ec1f1ed0 0x7fe5ec1579b0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.242+0000 7fe5f42f9640 1 --2- 172.21.15.5:0/3598039475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5d8006f20 0x7fe5ec0b19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.242+0000 7fe5f42f9640 1 -- 172.21.15.5:0/3598039475 >> 172.21.15.5:0/3598039475 conn(0x7fe5ec0afac0 msgr2=0x7fe5ec06c400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.242+0000 7fe5f42f9640 1 -- 172.21.15.5:0/3598039475 shutdown_connections 2023-07-14T13:12:14.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.242+0000 7fe5f42f9640 1 -- 172.21.15.5:0/3598039475 wait complete. 2023-07-14T13:12:14.296 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-14T13:12:14.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.410+0000 7fc033d74640 1 Processor -- start 2023-07-14T13:12:14.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.410+0000 7fc033d74640 1 -- start start 2023-07-14T13:12:14.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.410+0000 7fc033d74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc02c1600b0 0x7fc02c0cd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:14.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.410+0000 7fc033d74640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc02c164340 0x7fc02c0c0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:14.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.410+0000 7fc033d74640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc02c0c89f0 con 0x7fc02c06cf80 2023-07-14T13:12:14.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.410+0000 7fc033d74640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc02c0cbe50 con 0x7fc02c164340 2023-07-14T13:12:14.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.410+0000 7fc033d74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c0cc9d0 con 0x7fc02c1600b0 2023-07-14T13:12:14.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.410+0000 7fc031b10640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc02c1600b0 0x7fc02c0cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:14.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.410+0000 7fc031b10640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc02c1600b0 0x7fc02c0cd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:55136/0 (socket says 172.21.15.5:55136) 2023-07-14T13:12:14.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.410+0000 7fc032311640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc02c164340 0x7fc02c0c0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:14.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.410+0000 7fc031b10640 1 -- 172.21.15.5:0/1807816944 learned_addr learned my addr 172.21.15.5:0/1807816944 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:14.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.410+0000 7fc03130f640 1 --1- 172.21.15.5:0/1807816944 >> v1:172.21.15.154:6789/0 conn(0x7fc02c06cf80 0x7fc02c163c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:33174/0 (socket says 172.21.15.5:33174) 2023-07-14T13:12:14.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.410+0000 7fc031b10640 1 -- 172.21.15.5:0/1807816944 >> v2:172.21.15.154:3300/0 conn(0x7fc02c164340 msgr2=0x7fc02c0c0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:14.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.410+0000 7fc031b10640 1 --2- 172.21.15.5:0/1807816944 >> v2:172.21.15.154:3300/0 conn(0x7fc02c164340 0x7fc02c0c0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.410+0000 7fc031b10640 1 -- 172.21.15.5:0/1807816944 >> v1:172.21.15.154:6789/0 conn(0x7fc02c06cf80 legacy=0x7fc02c163c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:14.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.410+0000 7fc031b10640 1 -- 172.21.15.5:0/1807816944 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc02c0c9e20 con 0x7fc02c1600b0 2023-07-14T13:12:14.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.410+0000 7fc032311640 1 --2- 172.21.15.5:0/1807816944 >> v2:172.21.15.154:3300/0 conn(0x7fc02c164340 0x7fc02c0c0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:14.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.414+0000 7fc031b10640 1 --2- 172.21.15.5:0/1807816944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc02c1600b0 0x7fc02c0cd980 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc0280098a0 tx=0x7fc02801c340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ade97145ba740e2b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:14.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.414+0000 7fc030b0e640 1 -- 172.21.15.5:0/1807816944 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0280ab600 con 0x7fc02c1600b0 2023-07-14T13:12:14.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.414+0000 7fc030b0e640 1 -- 172.21.15.5:0/1807816944 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0280a7050 con 0x7fc02c1600b0 2023-07-14T13:12:14.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.414+0000 7fc030b0e640 1 -- 172.21.15.5:0/1807816944 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0280ab980 con 0x7fc02c1600b0 2023-07-14T13:12:14.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.414+0000 7fc033d74640 1 -- 172.21.15.5:0/1807816944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc02c1600b0 msgr2=0x7fc02c0cd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:14.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.414+0000 7fc033d74640 1 --2- 172.21.15.5:0/1807816944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc02c1600b0 0x7fc02c0cd980 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc0280098a0 tx=0x7fc02801c340 comp rx=0 tx=0).stop 2023-07-14T13:12:14.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.414+0000 7fc033d74640 1 -- 172.21.15.5:0/1807816944 shutdown_connections 2023-07-14T13:12:14.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.414+0000 7fc033d74640 1 --2- 172.21.15.5:0/1807816944 >> v2:172.21.15.154:3300/0 conn(0x7fc02c164340 0x7fc02c0c0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.414+0000 7fc033d74640 1 --2- 172.21.15.5:0/1807816944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc02c1600b0 0x7fc02c0cd980 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.414+0000 7fc033d74640 1 -- 172.21.15.5:0/1807816944 >> 172.21.15.5:0/1807816944 conn(0x7fc02c0afac0 msgr2=0x7fc02c0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:14.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.414+0000 7fc033d74640 1 -- 172.21.15.5:0/1807816944 shutdown_connections 2023-07-14T13:12:14.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.414+0000 7fc033d74640 1 -- 172.21.15.5:0/1807816944 wait complete. 2023-07-14T13:12:14.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.418+0000 7fc033d74640 1 Processor -- start 2023-07-14T13:12:14.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.418+0000 7fc033d74640 1 -- start start 2023-07-14T13:12:14.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.418+0000 7fc033d74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc02c06cf80 0x7fc02c1563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:14.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.418+0000 7fc033d74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc02c1600b0 0x7fc02c1536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:14.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.418+0000 7fc033d74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc02c164340 0x7fc02c158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:14.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.418+0000 7fc033d74640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c158160 con 0x7fc02c06cf80 2023-07-14T13:12:14.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.418+0000 7fc033d74640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c1574e0 con 0x7fc02c1600b0 2023-07-14T13:12:14.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.418+0000 7fc033d74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c1577c0 con 0x7fc02c164340 2023-07-14T13:12:14.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.418+0000 7fc031b10640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc02c06cf80 0x7fc02c1563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:14.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.418+0000 7fc031b10640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc02c06cf80 0x7fc02c1563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45126/0 (socket says 172.21.15.5:45126) 2023-07-14T13:12:14.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.418+0000 7fc031b10640 1 -- 172.21.15.5:0/1851744721 learned_addr learned my addr 172.21.15.5:0/1851744721 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:14.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.418+0000 7fc032311640 1 --2- 172.21.15.5:0/1851744721 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc02c164340 0x7fc02c158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:14.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.418+0000 7fc03130f640 1 --2- 172.21.15.5:0/1851744721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc02c1600b0 0x7fc02c1536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:14.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.418+0000 7fc031b10640 1 -- 172.21.15.5:0/1851744721 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc02c164340 msgr2=0x7fc02c158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:14.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.418+0000 7fc031b10640 1 --2- 172.21.15.5:0/1851744721 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc02c164340 0x7fc02c158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.418+0000 7fc031b10640 1 -- 172.21.15.5:0/1851744721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc02c1600b0 msgr2=0x7fc02c1536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:14.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.418+0000 7fc031b10640 1 --2- 172.21.15.5:0/1851744721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc02c1600b0 0x7fc02c1536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.418+0000 7fc031b10640 1 -- 172.21.15.5:0/1851744721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc024009a70 con 0x7fc02c06cf80 2023-07-14T13:12:14.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.418+0000 7fc031b10640 1 --2- 172.21.15.5:0/1851744721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc02c06cf80 0x7fc02c1563b0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fc028019f70 tx=0x7fc0280190e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:14.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.418+0000 7fc0227fc640 1 -- 172.21.15.5:0/1851744721 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0280b5400 con 0x7fc02c06cf80 2023-07-14T13:12:14.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.418+0000 7fc0227fc640 1 -- 172.21.15.5:0/1851744721 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0280b5560 con 0x7fc02c06cf80 2023-07-14T13:12:14.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.418+0000 7fc033d74640 1 -- 172.21.15.5:0/1851744721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0280094d0 con 0x7fc02c06cf80 2023-07-14T13:12:14.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.418+0000 7fc0227fc640 1 -- 172.21.15.5:0/1851744721 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0280b58f0 con 0x7fc02c06cf80 2023-07-14T13:12:14.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.418+0000 7fc033d74640 1 -- 172.21.15.5:0/1851744721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc02c157d80 con 0x7fc02c06cf80 2023-07-14T13:12:14.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.418+0000 7fc033d74640 1 -- 172.21.15.5:0/1851744721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc02c0ad820 con 0x7fc02c06cf80 2023-07-14T13:12:14.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.422+0000 7fc0227fc640 1 -- 172.21.15.5:0/1851744721 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc0280b5a50 con 0x7fc02c06cf80 2023-07-14T13:12:14.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.422+0000 7fc0227fc640 1 --2- 172.21.15.5:0/1851744721 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fc0100663a0 0x7fc010068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.422+0000 7fc0227fc640 1 -- 172.21.15.5:0/1851744721 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6098+0+0 (secure 0 0 0) 0x7fc02811d400 con 0x7fc02c06cf80 2023-07-14T13:12:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.422+0000 7fc03130f640 1 --2- 172.21.15.5:0/1851744721 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fc0100663a0 0x7fc010068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:14.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.422+0000 7fc03130f640 1 --2- 172.21.15.5:0/1851744721 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fc0100663a0 0x7fc010068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc02c157090 tx=0x7fc01c007cf0 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.426+0000 7fc0227fc640 1 -- 172.21.15.5:0/1851744721 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc0280ea630 con 0x7fc02c06cf80 2023-07-14T13:12:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.582+0000 7fc033d74640 1 -- 172.21.15.5:0/1851744721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc02c1583d0 con 0x7fc02c06cf80 2023-07-14T13:12:14.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.586+0000 7fc0227fc640 1 -- 172.21.15.5:0/1851744721 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v44) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc0280edc50 con 0x7fc02c06cf80 2023-07-14T13:12:14.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.590+0000 7fc033d74640 1 -- 172.21.15.5:0/1851744721 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fc0100663a0 msgr2=0x7fc010068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:14.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.590+0000 7fc033d74640 1 --2- 172.21.15.5:0/1851744721 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fc0100663a0 0x7fc010068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc02c157090 tx=0x7fc01c007cf0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.590+0000 7fc033d74640 1 -- 172.21.15.5:0/1851744721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc02c06cf80 msgr2=0x7fc02c1563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:14.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.590+0000 7fc033d74640 1 --2- 172.21.15.5:0/1851744721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc02c06cf80 0x7fc02c1563b0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fc028019f70 tx=0x7fc0280190e0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.590+0000 7fc033d74640 1 -- 172.21.15.5:0/1851744721 shutdown_connections 2023-07-14T13:12:14.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.590+0000 7fc033d74640 1 --2- 172.21.15.5:0/1851744721 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fc0100663a0 0x7fc010068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.590+0000 7fc033d74640 1 --2- 172.21.15.5:0/1851744721 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc02c164340 0x7fc02c158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.590+0000 7fc033d74640 1 --2- 172.21.15.5:0/1851744721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc02c1600b0 0x7fc02c1536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.590+0000 7fc033d74640 1 --2- 172.21.15.5:0/1851744721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc02c06cf80 0x7fc02c1563b0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.590+0000 7fc033d74640 1 -- 172.21.15.5:0/1851744721 >> 172.21.15.5:0/1851744721 conn(0x7fc02c0afac0 msgr2=0x7fc02c0cacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:14.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.590+0000 7fc033d74640 1 -- 172.21.15.5:0/1851744721 shutdown_connections 2023-07-14T13:12:14.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.590+0000 7fc033d74640 1 -- 172.21.15.5:0/1851744721 wait complete. 2023-07-14T13:12:14.643 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-14T13:12:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.754+0000 7fc59d26d640 1 Processor -- start 2023-07-14T13:12:14.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.754+0000 7fc59d26d640 1 -- start start 2023-07-14T13:12:14.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.754+0000 7fc59d26d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc598071030 0x7fc5980ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:14.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.754+0000 7fc59d26d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59815e060 0x7fc5980c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:14.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.754+0000 7fc59d26d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5980cbe50 con 0x7fc598159a70 2023-07-14T13:12:14.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.754+0000 7fc59d26d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5980cd660 con 0x7fc598071030 2023-07-14T13:12:14.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.754+0000 7fc59d26d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5980cc0a0 con 0x7fc59815e060 2023-07-14T13:12:14.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.758+0000 7fc58ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc598071030 0x7fc5980ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:14.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.758+0000 7fc596ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc598159a70 0x7fc598070920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52548/0 (socket says 172.21.15.5:52548) 2023-07-14T13:12:14.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.758+0000 7fc596ffd640 1 -- 172.21.15.5:0/428047121 learned_addr learned my addr 172.21.15.5:0/428047121 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:14.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.758+0000 7fc5977fe640 1 --2- 172.21.15.5:0/428047121 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59815e060 0x7fc5980c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:14.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.758+0000 7fc58ffff640 1 -- 172.21.15.5:0/428047121 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59815e060 msgr2=0x7fc5980c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:14.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.758+0000 7fc58ffff640 1 --2- 172.21.15.5:0/428047121 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59815e060 0x7fc5980c9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.758+0000 7fc58ffff640 1 -- 172.21.15.5:0/428047121 >> v1:172.21.15.5:6789/0 conn(0x7fc598159a70 legacy=0x7fc598070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:14.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.758+0000 7fc58ffff640 1 -- 172.21.15.5:0/428047121 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5980cc380 con 0x7fc598071030 2023-07-14T13:12:14.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.758+0000 7fc5967fc640 1 -- 172.21.15.5:0/428047121 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207118595 0 0) 0x7fc5980cbe50 con 0x7fc598159a70 2023-07-14T13:12:14.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.758+0000 7fc58ffff640 1 --2- 172.21.15.5:0/428047121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc598071030 0x7fc5980ccff0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fc5800097c0 tx=0x7fc58001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2404cb4c5d6b5036 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:14.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.758+0000 7fc5967fc640 1 -- 172.21.15.5:0/428047121 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5800ab600 con 0x7fc598071030 2023-07-14T13:12:14.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.758+0000 7fc5967fc640 1 -- 172.21.15.5:0/428047121 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5800a7050 con 0x7fc598071030 2023-07-14T13:12:14.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.758+0000 7fc5967fc640 1 -- 172.21.15.5:0/428047121 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5800ab980 con 0x7fc598071030 2023-07-14T13:12:14.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.762+0000 7fc59d26d640 1 -- 172.21.15.5:0/428047121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc598071030 msgr2=0x7fc5980ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:14.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.762+0000 7fc59d26d640 1 --2- 172.21.15.5:0/428047121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc598071030 0x7fc5980ccff0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fc5800097c0 tx=0x7fc58001c330 comp rx=0 tx=0).stop 2023-07-14T13:12:14.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.762+0000 7fc59d26d640 1 -- 172.21.15.5:0/428047121 shutdown_connections 2023-07-14T13:12:14.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.762+0000 7fc59d26d640 1 --2- 172.21.15.5:0/428047121 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59815e060 0x7fc5980c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.762+0000 7fc59d26d640 1 --2- 172.21.15.5:0/428047121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc598071030 0x7fc5980ccff0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.762+0000 7fc59d26d640 1 -- 172.21.15.5:0/428047121 >> 172.21.15.5:0/428047121 conn(0x7fc5980afac0 msgr2=0x7fc5980afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:14.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.762+0000 7fc59d26d640 1 -- 172.21.15.5:0/428047121 shutdown_connections 2023-07-14T13:12:14.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.762+0000 7fc59d26d640 1 -- 172.21.15.5:0/428047121 wait complete. 2023-07-14T13:12:14.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.762+0000 7fc59d26d640 1 Processor -- start 2023-07-14T13:12:14.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.762+0000 7fc59d26d640 1 -- start start 2023-07-14T13:12:14.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.762+0000 7fc59d26d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc598071030 0x7fc59814e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:14.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.762+0000 7fc59d26d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc598159a70 0x7fc59815c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:14.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.762+0000 7fc59d26d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59815e060 0x7fc598154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:14.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.762+0000 7fc59d26d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59806ca50 con 0x7fc598071030 2023-07-14T13:12:14.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.762+0000 7fc59d26d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59815c0b0 con 0x7fc598159a70 2023-07-14T13:12:14.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.762+0000 7fc59d26d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59815b4a0 con 0x7fc59815e060 2023-07-14T13:12:14.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.762+0000 7fc596ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc598071030 0x7fc59814e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:14.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.762+0000 7fc596ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc598071030 0x7fc59814e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45154/0 (socket says 172.21.15.5:45154) 2023-07-14T13:12:14.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.762+0000 7fc596ffd640 1 -- 172.21.15.5:0/2575663688 learned_addr learned my addr 172.21.15.5:0/2575663688 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:14.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.762+0000 7fc5977fe640 1 --2- 172.21.15.5:0/2575663688 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59815e060 0x7fc598154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:14.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.762+0000 7fc596ffd640 1 -- 172.21.15.5:0/2575663688 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59815e060 msgr2=0x7fc598154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:14.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.762+0000 7fc596ffd640 1 --2- 172.21.15.5:0/2575663688 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59815e060 0x7fc598154e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.762+0000 7fc58ffff640 1 --2- 172.21.15.5:0/2575663688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc598159a70 0x7fc59815c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:14.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.762+0000 7fc596ffd640 1 -- 172.21.15.5:0/2575663688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc598159a70 msgr2=0x7fc59815c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:14.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.762+0000 7fc596ffd640 1 --2- 172.21.15.5:0/2575663688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc598159a70 0x7fc59815c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.762+0000 7fc596ffd640 1 -- 172.21.15.5:0/2575663688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc580009420 con 0x7fc598071030 2023-07-14T13:12:14.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.762+0000 7fc5977fe640 1 --2- 172.21.15.5:0/2575663688 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59815e060 0x7fc598154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:12:14.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.766+0000 7fc596ffd640 1 --2- 172.21.15.5:0/2575663688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc598071030 0x7fc59814e350 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fc58800c480 tx=0x7fc58800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:14.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.766+0000 7fc58f7fe640 1 -- 172.21.15.5:0/2575663688 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5880074e0 con 0x7fc598071030 2023-07-14T13:12:14.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.766+0000 7fc58f7fe640 1 -- 172.21.15.5:0/2575663688 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc588007660 con 0x7fc598071030 2023-07-14T13:12:14.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.766+0000 7fc58f7fe640 1 -- 172.21.15.5:0/2575663688 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc588004a30 con 0x7fc598071030 2023-07-14T13:12:14.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.766+0000 7fc59d26d640 1 -- 172.21.15.5:0/2575663688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc59815b780 con 0x7fc598071030 2023-07-14T13:12:14.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.766+0000 7fc59d26d640 1 -- 172.21.15.5:0/2575663688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59815bd40 con 0x7fc598071030 2023-07-14T13:12:14.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.766+0000 7fc59d26d640 1 -- 172.21.15.5:0/2575663688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5980678d0 con 0x7fc598071030 2023-07-14T13:12:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.766+0000 7fc58f7fe640 1 -- 172.21.15.5:0/2575663688 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc588004b90 con 0x7fc598071030 2023-07-14T13:12:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.766+0000 7fc58f7fe640 1 --2- 172.21.15.5:0/2575663688 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fc5780663a0 0x7fc578068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.766+0000 7fc58f7fe640 1 -- 172.21.15.5:0/2575663688 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6098+0+0 (secure 0 0 0) 0x7fc5880830c0 con 0x7fc598071030 2023-07-14T13:12:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.766+0000 7fc58ffff640 1 --2- 172.21.15.5:0/2575663688 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fc5780663a0 0x7fc578068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:14.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.770+0000 7fc58ffff640 1 --2- 172.21.15.5:0/2575663688 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fc5780663a0 0x7fc578068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc5800ad000 tx=0x7fc580008040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:14.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.770+0000 7fc58f7fe640 1 -- 172.21.15.5:0/2575663688 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc588053e80 con 0x7fc598071030 2023-07-14T13:12:14.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.926+0000 7fc59d26d640 1 -- 172.21.15.5:0/2575663688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fc598163d30 con 0x7fc598071030 2023-07-14T13:12:14.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.930+0000 7fc58f7fe640 1 -- 172.21.15.5:0/2575663688 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v45) v1 ==== 115+0+0 (secure 0 0 0) 0x7fc5880180b0 con 0x7fc598071030 2023-07-14T13:12:14.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.934+0000 7fc59d26d640 1 -- 172.21.15.5:0/2575663688 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fc5780663a0 msgr2=0x7fc578068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:14.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.934+0000 7fc59d26d640 1 --2- 172.21.15.5:0/2575663688 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fc5780663a0 0x7fc578068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc5800ad000 tx=0x7fc580008040 comp rx=0 tx=0).stop 2023-07-14T13:12:14.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.934+0000 7fc59d26d640 1 -- 172.21.15.5:0/2575663688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc598071030 msgr2=0x7fc59814e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:14.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.934+0000 7fc59d26d640 1 --2- 172.21.15.5:0/2575663688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc598071030 0x7fc59814e350 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fc58800c480 tx=0x7fc58800c940 comp rx=0 tx=0).stop 2023-07-14T13:12:14.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.934+0000 7fc59d26d640 1 -- 172.21.15.5:0/2575663688 shutdown_connections 2023-07-14T13:12:14.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.934+0000 7fc59d26d640 1 --2- 172.21.15.5:0/2575663688 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fc5780663a0 0x7fc578068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.934+0000 7fc59d26d640 1 --2- 172.21.15.5:0/2575663688 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc59815e060 0x7fc598154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.934+0000 7fc59d26d640 1 --2- 172.21.15.5:0/2575663688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc598159a70 0x7fc59815c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.934+0000 7fc59d26d640 1 --2- 172.21.15.5:0/2575663688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc598071030 0x7fc59814e350 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:14.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.934+0000 7fc59d26d640 1 -- 172.21.15.5:0/2575663688 >> 172.21.15.5:0/2575663688 conn(0x7fc5980afac0 msgr2=0x7fc5980aee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:14.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.934+0000 7fc59d26d640 1 -- 172.21.15.5:0/2575663688 shutdown_connections 2023-07-14T13:12:14.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:14.934+0000 7fc59d26d640 1 -- 172.21.15.5:0/2575663688 wait complete. 2023-07-14T13:12:14.988 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-07-14T13:12:15.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.098+0000 7f7dd9b74640 1 Processor -- start 2023-07-14T13:12:15.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.098+0000 7f7dd9b74640 1 -- start start 2023-07-14T13:12:15.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.098+0000 7f7dd9b74640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7dd415bc00 0x7f7dd40ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:15.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.098+0000 7f7dd9b74640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7dd4069430 0x7f7dd4069830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:15.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.098+0000 7f7dd9b74640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd40c9c30 con 0x7f7dd4160450 2023-07-14T13:12:15.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.098+0000 7f7dd9b74640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd40c96b0 con 0x7f7dd415bc00 2023-07-14T13:12:15.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.098+0000 7f7dd9b74640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd415bfd0 con 0x7f7dd4069430 2023-07-14T13:12:15.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.098+0000 7f7dd37fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7dd415bc00 0x7f7dd40ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:15.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.098+0000 7f7dd37fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7dd415bc00 0x7f7dd40ce8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45156/0 (socket says 172.21.15.5:45156) 2023-07-14T13:12:15.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.098+0000 7f7dd37fe640 1 -- 172.21.15.5:0/872737450 learned_addr learned my addr 172.21.15.5:0/872737450 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.098+0000 7f7dd3fff640 1 --2- 172.21.15.5:0/872737450 >> v2:172.21.15.154:3300/0 conn(0x7f7dd4069430 0x7f7dd4069830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.098+0000 7f7dd37fe640 1 -- 172.21.15.5:0/872737450 >> v2:172.21.15.154:3300/0 conn(0x7f7dd4069430 msgr2=0x7f7dd4069830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.098+0000 7f7dd37fe640 1 --2- 172.21.15.5:0/872737450 >> v2:172.21.15.154:3300/0 conn(0x7f7dd4069430 0x7f7dd4069830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.098+0000 7f7dd37fe640 1 -- 172.21.15.5:0/872737450 >> v1:172.21.15.154:6789/0 conn(0x7f7dd4160450 legacy=0x7f7dd406e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.098+0000 7f7dd37fe640 1 -- 172.21.15.5:0/872737450 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd4069d70 con 0x7f7dd415bc00 2023-07-14T13:12:15.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.102+0000 7f7dd37fe640 1 --2- 172.21.15.5:0/872737450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd415bc00 0x7f7dd40ce8f0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40ce4e0 tx=0x7f7dc401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7129f6532f2f6950 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:15.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.102+0000 7f7dd27fc640 1 -- 172.21.15.5:0/872737450 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40aa640 con 0x7f7dd415bc00 2023-07-14T13:12:15.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.102+0000 7f7dd27fc640 1 -- 172.21.15.5:0/872737450 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc40aa7a0 con 0x7f7dd415bc00 2023-07-14T13:12:15.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.102+0000 7f7dd27fc640 1 -- 172.21.15.5:0/872737450 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40aab30 con 0x7f7dd415bc00 2023-07-14T13:12:15.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.102+0000 7f7dd9b74640 1 -- 172.21.15.5:0/872737450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd415bc00 msgr2=0x7f7dd40ce8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:15.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.102+0000 7f7dd9b74640 1 --2- 172.21.15.5:0/872737450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd415bc00 0x7f7dd40ce8f0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40ce4e0 tx=0x7f7dc401c4e0 comp rx=0 tx=0).stop 2023-07-14T13:12:15.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.102+0000 7f7dd9b74640 1 -- 172.21.15.5:0/872737450 shutdown_connections 2023-07-14T13:12:15.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.102+0000 7f7dd9b74640 1 --2- 172.21.15.5:0/872737450 >> v2:172.21.15.154:3300/0 conn(0x7f7dd4069430 0x7f7dd4069830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:15.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.102+0000 7f7dd9b74640 1 --2- 172.21.15.5:0/872737450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd415bc00 0x7f7dd40ce8f0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:15.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.102+0000 7f7dd9b74640 1 -- 172.21.15.5:0/872737450 >> 172.21.15.5:0/872737450 conn(0x7f7dd40b1840 msgr2=0x7f7dd40cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:15.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.102+0000 7f7dd9b74640 1 -- 172.21.15.5:0/872737450 shutdown_connections 2023-07-14T13:12:15.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.102+0000 7f7dd9b74640 1 -- 172.21.15.5:0/872737450 wait complete. 2023-07-14T13:12:15.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.106+0000 7f7dd9b74640 1 Processor -- start 2023-07-14T13:12:15.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.106+0000 7f7dd9b74640 1 -- start start 2023-07-14T13:12:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.106+0000 7f7dd9b74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd4069430 0x7f7dd40b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.106+0000 7f7dd9b74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dd415bc00 0x7f7dd40c2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.106+0000 7f7dd9b74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7dd4160450 0x7f7dd40c2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.106+0000 7f7dd9b74640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40c3ce0 con 0x7f7dd4069430 2023-07-14T13:12:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.106+0000 7f7dd9b74640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40c30d0 con 0x7f7dd415bc00 2023-07-14T13:12:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.106+0000 7f7dd9b74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40c3370 con 0x7f7dd4160450 2023-07-14T13:12:15.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.106+0000 7f7dd37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd4069430 0x7f7dd40b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:15.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.106+0000 7f7dd37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd4069430 0x7f7dd40b49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45168/0 (socket says 172.21.15.5:45168) 2023-07-14T13:12:15.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.106+0000 7f7dd37fe640 1 -- 172.21.15.5:0/3361434183 learned_addr learned my addr 172.21.15.5:0/3361434183 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:15.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.106+0000 7f7dd3fff640 1 --2- 172.21.15.5:0/3361434183 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7dd4160450 0x7f7dd40c2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:15.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.106+0000 7f7dd2ffd640 1 --2- 172.21.15.5:0/3361434183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dd415bc00 0x7f7dd40c2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:15.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.106+0000 7f7dd37fe640 1 -- 172.21.15.5:0/3361434183 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7dd4160450 msgr2=0x7f7dd40c2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:15.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.106+0000 7f7dd37fe640 1 --2- 172.21.15.5:0/3361434183 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7dd4160450 0x7f7dd40c2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:15.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.106+0000 7f7dd37fe640 1 -- 172.21.15.5:0/3361434183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dd415bc00 msgr2=0x7f7dd40c2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:15.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.106+0000 7f7dd37fe640 1 --2- 172.21.15.5:0/3361434183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dd415bc00 0x7f7dd40c2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:15.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.106+0000 7f7dd37fe640 1 -- 172.21.15.5:0/3361434183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc40094d0 con 0x7f7dd4069430 2023-07-14T13:12:15.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.106+0000 7f7dd2ffd640 1 --2- 172.21.15.5:0/3361434183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dd415bc00 0x7f7dd40c2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:15.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.106+0000 7f7dd37fe640 1 --2- 172.21.15.5:0/3361434183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd4069430 0x7f7dd40b49b0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f7dc40190f0 tx=0x7f7dc401ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:15.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.110+0000 7f7dbbfff640 1 -- 172.21.15.5:0/3361434183 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40aa640 con 0x7f7dd4069430 2023-07-14T13:12:15.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.110+0000 7f7dbbfff640 1 -- 172.21.15.5:0/3361434183 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc40bd5f0 con 0x7f7dd4069430 2023-07-14T13:12:15.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.110+0000 7f7dbbfff640 1 -- 172.21.15.5:0/3361434183 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40bd9a0 con 0x7f7dd4069430 2023-07-14T13:12:15.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.110+0000 7f7dd9b74640 1 -- 172.21.15.5:0/3361434183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd40c3650 con 0x7f7dd4069430 2023-07-14T13:12:15.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.110+0000 7f7dd9b74640 1 -- 172.21.15.5:0/3361434183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd40c3f30 con 0x7f7dd4069430 2023-07-14T13:12:15.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.110+0000 7f7dd9b74640 1 -- 172.21.15.5:0/3361434183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd40678d0 con 0x7f7dd4069430 2023-07-14T13:12:15.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.110+0000 7f7dbbfff640 1 -- 172.21.15.5:0/3361434183 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7dc40a8050 con 0x7f7dd4069430 2023-07-14T13:12:15.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.110+0000 7f7dbbfff640 1 --2- 172.21.15.5:0/3361434183 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f7dc00663a0 0x7f7dc0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:15.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.110+0000 7f7dbbfff640 1 -- 172.21.15.5:0/3361434183 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6098+0+0 (secure 0 0 0) 0x7f7dc411e090 con 0x7f7dd4069430 2023-07-14T13:12:15.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.110+0000 7f7dd2ffd640 1 --2- 172.21.15.5:0/3361434183 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f7dc00663a0 0x7f7dc0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:15.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.110+0000 7f7dd2ffd640 1 --2- 172.21.15.5:0/3361434183 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f7dc00663a0 0x7f7dc0068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40b2490 tx=0x7f7dc8009040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:15.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.114+0000 7f7dbbfff640 1 -- 172.21.15.5:0/3361434183 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7dc40eb2d0 con 0x7f7dd4069430 2023-07-14T13:12:15.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.322+0000 7f7dd9b74640 1 -- 172.21.15.5:0/3361434183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7f7dd40b0430 con 0x7f7dd4069430 2023-07-14T13:12:15.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.866+0000 7f7dbbfff640 1 -- 172.21.15.5:0/3361434183 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v749) v1 ==== 148+0+0 (secure 0 0 0) 0x7f7dc40ee8f0 con 0x7f7dd4069430 2023-07-14T13:12:15.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.866+0000 7f7dd9b74640 1 -- 172.21.15.5:0/3361434183 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f7dc00663a0 msgr2=0x7f7dc0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:15.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.866+0000 7f7dd9b74640 1 --2- 172.21.15.5:0/3361434183 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f7dc00663a0 0x7f7dc0068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40b2490 tx=0x7f7dc8009040 comp rx=0 tx=0).stop 2023-07-14T13:12:15.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.866+0000 7f7dd9b74640 1 -- 172.21.15.5:0/3361434183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd4069430 msgr2=0x7f7dd40b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:15.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.866+0000 7f7dd9b74640 1 --2- 172.21.15.5:0/3361434183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd4069430 0x7f7dd40b49b0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f7dc40190f0 tx=0x7f7dc401ad20 comp rx=0 tx=0).stop 2023-07-14T13:12:15.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.866+0000 7f7dd9b74640 1 -- 172.21.15.5:0/3361434183 shutdown_connections 2023-07-14T13:12:15.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.866+0000 7f7dd9b74640 1 --2- 172.21.15.5:0/3361434183 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f7dc00663a0 0x7f7dc0068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:15.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.866+0000 7f7dd9b74640 1 --2- 172.21.15.5:0/3361434183 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7dd4160450 0x7f7dd40c2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:15.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.866+0000 7f7dd9b74640 1 --2- 172.21.15.5:0/3361434183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dd415bc00 0x7f7dd40c2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:15.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.866+0000 7f7dd9b74640 1 --2- 172.21.15.5:0/3361434183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd4069430 0x7f7dd40b49b0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:15.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.866+0000 7f7dd9b74640 1 -- 172.21.15.5:0/3361434183 >> 172.21.15.5:0/3361434183 conn(0x7f7dd40b1840 msgr2=0x7f7dd406d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:15.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.866+0000 7f7dd9b74640 1 -- 172.21.15.5:0/3361434183 shutdown_connections 2023-07-14T13:12:15.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:15.866+0000 7f7dd9b74640 1 -- 172.21.15.5:0/3361434183 wait complete. 2023-07-14T13:12:15.923 INFO:tasks.cephfs_test_runner:Test existence of a scheduled snapshot ... ok 2023-07-14T13:12:15.923 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules post removal of a schedule 2023-07-14T13:12:15.924 INFO:tasks.cephfs_test_runner:test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-14T13:12:15.924 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-07-14T13:12:16.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.038+0000 7f2b59648640 1 Processor -- start 2023-07-14T13:12:16.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.038+0000 7f2b59648640 1 -- start start 2023-07-14T13:12:16.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.038+0000 7f2b59648640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2b54158ce0 0x7f2b54070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:16.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.038+0000 7f2b59648640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b540cc700 con 0x7f2b540c9730 2023-07-14T13:12:16.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.038+0000 7f2b59648640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b540b0ff0 con 0x7f2b540c8ad0 2023-07-14T13:12:16.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.038+0000 7f2b59648640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b54070c80 con 0x7f2b54158ce0 2023-07-14T13:12:16.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.038+0000 7f2b52ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2b54158ce0 0x7f2b54070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:16.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.038+0000 7f2b52ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2b54158ce0 0x7f2b54070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45172/0 (socket says 172.21.15.5:45172) 2023-07-14T13:12:16.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.038+0000 7f2b52ffd640 1 -- 172.21.15.5:0/2770725616 learned_addr learned my addr 172.21.15.5:0/2770725616 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:16.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.038+0000 7f2b537fe640 1 --1- 172.21.15.5:0/2770725616 >> v1:172.21.15.5:6789/0 conn(0x7f2b540c9730 0x7f2b540ccb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52554/0 (socket says 172.21.15.5:52554) 2023-07-14T13:12:16.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.038+0000 7f2b52ffd640 1 -- 172.21.15.5:0/2770725616 >> v1:172.21.15.154:6789/0 conn(0x7f2b540c8ad0 legacy=0x7f2b540c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:16.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.038+0000 7f2b52ffd640 1 -- 172.21.15.5:0/2770725616 >> v1:172.21.15.5:6789/0 conn(0x7f2b540c9730 legacy=0x7f2b540ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:16.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.038+0000 7f2b52ffd640 1 -- 172.21.15.5:0/2770725616 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b540cbdd0 con 0x7f2b54158ce0 2023-07-14T13:12:16.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.038+0000 7f2b527fc640 1 -- 172.21.15.5:0/2770725616 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554105408 0 0) 0x7f2b540cc700 con 0x7f2b540c9730 2023-07-14T13:12:16.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.042+0000 7f2b52ffd640 1 --2- 172.21.15.5:0/2770725616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b54158ce0 0x7f2b54070450 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009870 tx=0x7f2b4401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6737bcbe5bb37b0a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:16.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.042+0000 7f2b527fc640 1 -- 172.21.15.5:0/2770725616 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b440ab600 con 0x7f2b54158ce0 2023-07-14T13:12:16.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.042+0000 7f2b527fc640 1 -- 172.21.15.5:0/2770725616 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b440a7050 con 0x7f2b54158ce0 2023-07-14T13:12:16.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.042+0000 7f2b527fc640 1 -- 172.21.15.5:0/2770725616 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b440ab980 con 0x7f2b54158ce0 2023-07-14T13:12:16.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.042+0000 7f2b59648640 1 -- 172.21.15.5:0/2770725616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b54158ce0 msgr2=0x7f2b54070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:16.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.042+0000 7f2b59648640 1 --2- 172.21.15.5:0/2770725616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b54158ce0 0x7f2b54070450 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009870 tx=0x7f2b4401c3f0 comp rx=0 tx=0).stop 2023-07-14T13:12:16.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.042+0000 7f2b59648640 1 -- 172.21.15.5:0/2770725616 shutdown_connections 2023-07-14T13:12:16.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.042+0000 7f2b59648640 1 --2- 172.21.15.5:0/2770725616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b54158ce0 0x7f2b54070450 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:16.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.042+0000 7f2b59648640 1 -- 172.21.15.5:0/2770725616 >> 172.21.15.5:0/2770725616 conn(0x7f2b540afcf0 msgr2=0x7f2b540b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:16.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.042+0000 7f2b59648640 1 -- 172.21.15.5:0/2770725616 shutdown_connections 2023-07-14T13:12:16.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.042+0000 7f2b59648640 1 -- 172.21.15.5:0/2770725616 wait complete. 2023-07-14T13:12:16.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.042+0000 7f2b59648640 1 Processor -- start 2023-07-14T13:12:16.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.046+0000 7f2b59648640 1 -- start start 2023-07-14T13:12:16.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.046+0000 7f2b59648640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b540c8ad0 0x7f2b541f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:16.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.046+0000 7f2b59648640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b540c9730 0x7f2b541f5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:16.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.046+0000 7f2b59648640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b54158ce0 0x7f2b541f6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:16.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.046+0000 7f2b59648640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5414b770 con 0x7f2b540c9730 2023-07-14T13:12:16.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.046+0000 7f2b59648640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b54146290 con 0x7f2b54158ce0 2023-07-14T13:12:16.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.046+0000 7f2b59648640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b54149d80 con 0x7f2b540c8ad0 2023-07-14T13:12:16.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.046+0000 7f2b4bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b540c9730 0x7f2b541f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:16.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.046+0000 7f2b4bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b540c9730 0x7f2b541f5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45182/0 (socket says 172.21.15.5:45182) 2023-07-14T13:12:16.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.046+0000 7f2b4bfff640 1 -- 172.21.15.5:0/3274689105 learned_addr learned my addr 172.21.15.5:0/3274689105 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:16.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.046+0000 7f2b52ffd640 1 --2- 172.21.15.5:0/3274689105 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b540c8ad0 0x7f2b541f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:16.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.046+0000 7f2b537fe640 1 --2- 172.21.15.5:0/3274689105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b54158ce0 0x7f2b541f6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:16.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.046+0000 7f2b4bfff640 1 -- 172.21.15.5:0/3274689105 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b540c8ad0 msgr2=0x7f2b541f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:16.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.046+0000 7f2b4bfff640 1 --2- 172.21.15.5:0/3274689105 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b540c8ad0 0x7f2b541f4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:16.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.046+0000 7f2b4bfff640 1 -- 172.21.15.5:0/3274689105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b54158ce0 msgr2=0x7f2b541f6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:16.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.046+0000 7f2b4bfff640 1 --2- 172.21.15.5:0/3274689105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b54158ce0 0x7f2b541f6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:16.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.046+0000 7f2b4bfff640 1 -- 172.21.15.5:0/3274689105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b440094d0 con 0x7f2b540c9730 2023-07-14T13:12:16.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.046+0000 7f2b537fe640 1 --2- 172.21.15.5:0/3274689105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b54158ce0 0x7f2b541f6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:16.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.046+0000 7f2b4bfff640 1 --2- 172.21.15.5:0/3274689105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b540c9730 0x7f2b541f5430 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c00c500 tx=0x7f2b3c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:16.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.046+0000 7f2b4b7fe640 1 -- 172.21.15.5:0/3274689105 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c005220 con 0x7f2b540c9730 2023-07-14T13:12:16.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.046+0000 7f2b4b7fe640 1 -- 172.21.15.5:0/3274689105 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3c005380 con 0x7f2b540c9730 2023-07-14T13:12:16.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.046+0000 7f2b59648640 1 -- 172.21.15.5:0/3274689105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b540c8550 con 0x7f2b540c9730 2023-07-14T13:12:16.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.046+0000 7f2b4b7fe640 1 -- 172.21.15.5:0/3274689105 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c007270 con 0x7f2b540c9730 2023-07-14T13:12:16.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.046+0000 7f2b59648640 1 -- 172.21.15.5:0/3274689105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b540c8270 con 0x7f2b540c9730 2023-07-14T13:12:16.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.046+0000 7f2b59648640 1 -- 172.21.15.5:0/3274689105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b540ca1a0 con 0x7f2b540c9730 2023-07-14T13:12:16.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.050+0000 7f2b4b7fe640 1 -- 172.21.15.5:0/3274689105 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2b3c0073d0 con 0x7f2b540c9730 2023-07-14T13:12:16.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.050+0000 7f2b4b7fe640 1 --2- 172.21.15.5:0/3274689105 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f2b340663a0 0x7f2b34068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:16.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.050+0000 7f2b4b7fe640 1 -- 172.21.15.5:0/3274689105 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6098+0+0 (secure 0 0 0) 0x7f2b3c083770 con 0x7f2b540c9730 2023-07-14T13:12:16.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.050+0000 7f2b52ffd640 1 --2- 172.21.15.5:0/3274689105 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f2b340663a0 0x7f2b34068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:16.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.050+0000 7f2b52ffd640 1 --2- 172.21.15.5:0/3274689105 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f2b340663a0 0x7f2b34068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2b440ad000 tx=0x7f2b440a4f90 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:16.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.054+0000 7f2b4b7fe640 1 -- 172.21.15.5:0/3274689105 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2b3c050ac0 con 0x7f2b540c9730 2023-07-14T13:12:16.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.262+0000 7f2b59648640 1 -- 172.21.15.5:0/3274689105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7f2b541f5230 con 0x7f2b540c9730 2023-07-14T13:12:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.866+0000 7f2b4b7fe640 1 -- 172.21.15.5:0/3274689105 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v750) v1 ==== 177+0+0 (secure 0 0 0) 0x7f2b3c0540e0 con 0x7f2b540c9730 2023-07-14T13:12:16.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.870+0000 7f2b59648640 1 -- 172.21.15.5:0/3274689105 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f2b340663a0 msgr2=0x7f2b34068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:16.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.870+0000 7f2b59648640 1 --2- 172.21.15.5:0/3274689105 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f2b340663a0 0x7f2b34068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2b440ad000 tx=0x7f2b440a4f90 comp rx=0 tx=0).stop 2023-07-14T13:12:16.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.870+0000 7f2b59648640 1 -- 172.21.15.5:0/3274689105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b540c9730 msgr2=0x7f2b541f5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:16.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.870+0000 7f2b59648640 1 --2- 172.21.15.5:0/3274689105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b540c9730 0x7f2b541f5430 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c00c500 tx=0x7f2b3c00c9c0 comp rx=0 tx=0).stop 2023-07-14T13:12:16.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.870+0000 7f2b59648640 1 -- 172.21.15.5:0/3274689105 shutdown_connections 2023-07-14T13:12:16.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.870+0000 7f2b59648640 1 --2- 172.21.15.5:0/3274689105 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f2b340663a0 0x7f2b34068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:16.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.870+0000 7f2b59648640 1 --2- 172.21.15.5:0/3274689105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b54158ce0 0x7f2b541f6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:16.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.870+0000 7f2b59648640 1 --2- 172.21.15.5:0/3274689105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b540c9730 0x7f2b541f5430 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:16.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.870+0000 7f2b59648640 1 --2- 172.21.15.5:0/3274689105 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b540c8ad0 0x7f2b541f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:16.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.870+0000 7f2b59648640 1 -- 172.21.15.5:0/3274689105 >> 172.21.15.5:0/3274689105 conn(0x7f2b540afcf0 msgr2=0x7f2b540ca610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:16.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.870+0000 7f2b59648640 1 -- 172.21.15.5:0/3274689105 shutdown_connections 2023-07-14T13:12:16.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:16.870+0000 7f2b59648640 1 -- 172.21.15.5:0/3274689105 wait complete. 2023-07-14T13:12:16.927 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-14T13:12:17.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.042+0000 7ff132c6d640 1 Processor -- start 2023-07-14T13:12:17.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.042+0000 7ff132c6d640 1 -- start start 2023-07-14T13:12:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.042+0000 7ff132c6d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff12c0d2fc0 0x7ff12c0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.042+0000 7ff132c6d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff12c0b04c0 con 0x7ff12c15bde0 2023-07-14T13:12:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.046+0000 7ff132c6d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff12c0d0aa0 con 0x7ff12c0d2300 2023-07-14T13:12:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.046+0000 7ff132c6d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff12c15c1b0 con 0x7ff12c0d2fc0 2023-07-14T13:12:17.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.046+0000 7ff130a09640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff12c15bde0 0x7ff12c0d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52570/0 (socket says 172.21.15.5:52570) 2023-07-14T13:12:17.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.046+0000 7ff130a09640 1 -- 172.21.15.5:0/3951812637 learned_addr learned my addr 172.21.15.5:0/3951812637 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:17.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.046+0000 7ff12bfff640 1 --2- 172.21.15.5:0/3951812637 >> v2:172.21.15.5:3300/0 conn(0x7ff12c0d2fc0 0x7ff12c0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:17.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.046+0000 7ff12b7fe640 1 -- 172.21.15.5:0/3951812637 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408622748 0 0) 0x7ff12c0b04c0 con 0x7ff12c15bde0 2023-07-14T13:12:17.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.046+0000 7ff12b7fe640 1 -- 172.21.15.5:0/3951812637 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff11c003530 con 0x7ff12c15bde0 2023-07-14T13:12:17.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.046+0000 7ff12bfff640 1 -- 172.21.15.5:0/3951812637 >> v1:172.21.15.154:6789/0 conn(0x7ff12c0d2300 legacy=0x7ff12c0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:17.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.046+0000 7ff12bfff640 1 -- 172.21.15.5:0/3951812637 >> v1:172.21.15.5:6789/0 conn(0x7ff12c15bde0 legacy=0x7ff12c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:17.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.046+0000 7ff12bfff640 1 -- 172.21.15.5:0/3951812637 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12c0afb90 con 0x7ff12c0d2fc0 2023-07-14T13:12:17.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.046+0000 7ff12bfff640 1 --2- 172.21.15.5:0/3951812637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12c0d2fc0 0x7ff12c0b0950 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7ff1180097c0 tx=0x7ff11801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04e5422cbb5a147 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:17.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.046+0000 7ff12b7fe640 1 -- 172.21.15.5:0/3951812637 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1180ab680 con 0x7ff12c0d2fc0 2023-07-14T13:12:17.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.046+0000 7ff12b7fe640 1 -- 172.21.15.5:0/3951812637 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1180ab7e0 con 0x7ff12c0d2fc0 2023-07-14T13:12:17.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.046+0000 7ff12b7fe640 1 -- 172.21.15.5:0/3951812637 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1180abb70 con 0x7ff12c0d2fc0 2023-07-14T13:12:17.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.050+0000 7ff132c6d640 1 -- 172.21.15.5:0/3951812637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12c0d2fc0 msgr2=0x7ff12c0b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:17.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.050+0000 7ff132c6d640 1 --2- 172.21.15.5:0/3951812637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12c0d2fc0 0x7ff12c0b0950 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7ff1180097c0 tx=0x7ff11801c480 comp rx=0 tx=0).stop 2023-07-14T13:12:17.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.050+0000 7ff132c6d640 1 -- 172.21.15.5:0/3951812637 shutdown_connections 2023-07-14T13:12:17.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.050+0000 7ff132c6d640 1 --2- 172.21.15.5:0/3951812637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12c0d2fc0 0x7ff12c0b0950 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:17.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.050+0000 7ff132c6d640 1 -- 172.21.15.5:0/3951812637 >> 172.21.15.5:0/3951812637 conn(0x7ff12c0659d0 msgr2=0x7ff12c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:17.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.050+0000 7ff132c6d640 1 -- 172.21.15.5:0/3951812637 shutdown_connections 2023-07-14T13:12:17.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.050+0000 7ff132c6d640 1 -- 172.21.15.5:0/3951812637 wait complete. 2023-07-14T13:12:17.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.050+0000 7ff132c6d640 1 Processor -- start 2023-07-14T13:12:17.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.050+0000 7ff132c6d640 1 -- start start 2023-07-14T13:12:17.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.050+0000 7ff132c6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff12c0d2300 0x7ff12c0cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:17.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.050+0000 7ff132c6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12c0d2fc0 0x7ff12c0cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:17.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.050+0000 7ff132c6d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff12c15bde0 0x7ff12c0c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:17.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.050+0000 7ff132c6d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c0c6f00 con 0x7ff12c0d2fc0 2023-07-14T13:12:17.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.050+0000 7ff132c6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c1506d0 con 0x7ff12c0d2300 2023-07-14T13:12:17.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.050+0000 7ff132c6d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c0cb2b0 con 0x7ff12c15bde0 2023-07-14T13:12:17.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.050+0000 7ff12bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12c0d2fc0 0x7ff12c0cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:17.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.050+0000 7ff12bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12c0d2fc0 0x7ff12c0cdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45198/0 (socket says 172.21.15.5:45198) 2023-07-14T13:12:17.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.050+0000 7ff12bfff640 1 -- 172.21.15.5:0/1126462321 learned_addr learned my addr 172.21.15.5:0/1126462321 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:17.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.050+0000 7ff130a09640 1 --2- 172.21.15.5:0/1126462321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff12c0d2300 0x7ff12c0cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:17.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.054+0000 7ff13120a640 1 --2- 172.21.15.5:0/1126462321 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff12c15bde0 0x7ff12c0c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:17.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.054+0000 7ff12bfff640 1 -- 172.21.15.5:0/1126462321 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff12c15bde0 msgr2=0x7ff12c0c7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:17.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.054+0000 7ff12bfff640 1 --2- 172.21.15.5:0/1126462321 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff12c15bde0 0x7ff12c0c7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:17.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.054+0000 7ff12bfff640 1 -- 172.21.15.5:0/1126462321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff12c0d2300 msgr2=0x7ff12c0cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:17.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.054+0000 7ff12bfff640 1 --2- 172.21.15.5:0/1126462321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff12c0d2300 0x7ff12c0cbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:17.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.054+0000 7ff12bfff640 1 -- 172.21.15.5:0/1126462321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff118009420 con 0x7ff12c0d2fc0 2023-07-14T13:12:17.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.054+0000 7ff12bfff640 1 --2- 172.21.15.5:0/1126462321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12c0d2fc0 0x7ff12c0cdd00 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7ff1180ad040 tx=0x7ff11801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:17.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.054+0000 7ff1297fa640 1 -- 172.21.15.5:0/1126462321 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1180b5810 con 0x7ff12c0d2fc0 2023-07-14T13:12:17.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.054+0000 7ff1297fa640 1 -- 172.21.15.5:0/1126462321 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1180b59b0 con 0x7ff12c0d2fc0 2023-07-14T13:12:17.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.054+0000 7ff1297fa640 1 -- 172.21.15.5:0/1126462321 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1180b5d60 con 0x7ff12c0d2fc0 2023-07-14T13:12:17.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.054+0000 7ff132c6d640 1 -- 172.21.15.5:0/1126462321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff12c0cb590 con 0x7ff12c0d2fc0 2023-07-14T13:12:17.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.054+0000 7ff132c6d640 1 -- 172.21.15.5:0/1126462321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff12c0c6b90 con 0x7ff12c0d2fc0 2023-07-14T13:12:17.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.054+0000 7ff132c6d640 1 -- 172.21.15.5:0/1126462321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff12c0c7070 con 0x7ff12c0d2fc0 2023-07-14T13:12:17.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.054+0000 7ff1297fa640 1 -- 172.21.15.5:0/1126462321 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff1180b4390 con 0x7ff12c0d2fc0 2023-07-14T13:12:17.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.054+0000 7ff1297fa640 1 --2- 172.21.15.5:0/1126462321 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7ff1100663a0 0x7ff110068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:17.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.054+0000 7ff1297fa640 1 -- 172.21.15.5:0/1126462321 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6098+0+0 (secure 0 0 0) 0x7ff11811ea40 con 0x7ff12c0d2fc0 2023-07-14T13:12:17.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.058+0000 7ff130a09640 1 --2- 172.21.15.5:0/1126462321 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7ff1100663a0 0x7ff110068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:17.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.058+0000 7ff130a09640 1 --2- 172.21.15.5:0/1126462321 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7ff1100663a0 0x7ff110068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff1200010f0 tx=0x7ff120007bf0 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:17.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.058+0000 7ff1297fa640 1 -- 172.21.15.5:0/1126462321 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff1180ebc80 con 0x7ff12c0d2fc0 2023-07-14T13:12:17.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.214+0000 7ff132c6d640 1 -- 172.21.15.5:0/1126462321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff12c0b0e60 con 0x7ff12c0d2fc0 2023-07-14T13:12:17.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.222+0000 7ff1297fa640 1 -- 172.21.15.5:0/1126462321 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v46)=0 v46) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff1180ab640 con 0x7ff12c0d2fc0 2023-07-14T13:12:17.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.222+0000 7ff132c6d640 1 -- 172.21.15.5:0/1126462321 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7ff1100663a0 msgr2=0x7ff110068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:17.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.222+0000 7ff132c6d640 1 --2- 172.21.15.5:0/1126462321 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7ff1100663a0 0x7ff110068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff1200010f0 tx=0x7ff120007bf0 comp rx=0 tx=0).stop 2023-07-14T13:12:17.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.222+0000 7ff132c6d640 1 -- 172.21.15.5:0/1126462321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12c0d2fc0 msgr2=0x7ff12c0cdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:17.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.222+0000 7ff132c6d640 1 --2- 172.21.15.5:0/1126462321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12c0d2fc0 0x7ff12c0cdd00 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7ff1180ad040 tx=0x7ff11801acc0 comp rx=0 tx=0).stop 2023-07-14T13:12:17.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.222+0000 7ff132c6d640 1 -- 172.21.15.5:0/1126462321 shutdown_connections 2023-07-14T13:12:17.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.222+0000 7ff132c6d640 1 --2- 172.21.15.5:0/1126462321 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7ff1100663a0 0x7ff110068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:17.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.222+0000 7ff132c6d640 1 --2- 172.21.15.5:0/1126462321 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff12c15bde0 0x7ff12c0c7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:17.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.222+0000 7ff132c6d640 1 --2- 172.21.15.5:0/1126462321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12c0d2fc0 0x7ff12c0cdd00 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:17.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.222+0000 7ff132c6d640 1 --2- 172.21.15.5:0/1126462321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff12c0d2300 0x7ff12c0cbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:17.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.222+0000 7ff132c6d640 1 -- 172.21.15.5:0/1126462321 >> 172.21.15.5:0/1126462321 conn(0x7ff12c0659d0 msgr2=0x7ff12c0b46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:17.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.222+0000 7ff132c6d640 1 -- 172.21.15.5:0/1126462321 shutdown_connections 2023-07-14T13:12:17.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.222+0000 7ff132c6d640 1 -- 172.21.15.5:0/1126462321 wait complete. 2023-07-14T13:12:17.277 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T13:12:17.278 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:12:17.326 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:12:17.389 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T13:12:17.389 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:12:17.390 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:12:17.399 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:12:17.399 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:12:17.400 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:12:17.409 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:12:17.410 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:12:17.410 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:12:17.450 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:12:17.451 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:12:17.451 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:12:17.462 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:12:17.462 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-14T13:12:17.462 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:12:17.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.598+0000 7f89e11d2640 1 Processor -- start 2023-07-14T13:12:17.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.598+0000 7f89e11d2640 1 -- start start 2023-07-14T13:12:17.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.602+0000 7f89e11d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89dc0cdcd0 0x7f89dc0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:17.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.602+0000 7f89e11d2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f89dc0ca750 0x7f89dc0cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:17.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.602+0000 7f89e11d2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89dc0cfaf0 con 0x7f89dc06a540 2023-07-14T13:12:17.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.602+0000 7f89e11d2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89dc0cef10 con 0x7f89dc0ca750 2023-07-14T13:12:17.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.602+0000 7f89e11d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc0cfdd0 con 0x7f89dc0cdcd0 2023-07-14T13:12:17.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.602+0000 7f89dad9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f89dc06a540 0x7f89dc06a910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52586/0 (socket says 172.21.15.5:52586) 2023-07-14T13:12:17.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.602+0000 7f89dad9d640 1 -- 172.21.15.5:0/144297377 learned_addr learned my addr 172.21.15.5:0/144297377 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:17.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.602+0000 7f89db59e640 1 --2- 172.21.15.5:0/144297377 >> v2:172.21.15.5:3300/0 conn(0x7f89dc0ca750 0x7f89dc0cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:17.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.602+0000 7f89d3fff640 1 --2- 172.21.15.5:0/144297377 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89dc0cdcd0 0x7f89dc0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:17.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.602+0000 7f89db59e640 1 -- 172.21.15.5:0/144297377 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89dc0cdcd0 msgr2=0x7f89dc0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:17.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.602+0000 7f89db59e640 1 --2- 172.21.15.5:0/144297377 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89dc0cdcd0 0x7f89dc0cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:17.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.602+0000 7f89db59e640 1 -- 172.21.15.5:0/144297377 >> v1:172.21.15.5:6789/0 conn(0x7f89dc06a540 legacy=0x7f89dc06a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:17.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.602+0000 7f89db59e640 1 -- 172.21.15.5:0/144297377 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc0d00b0 con 0x7f89dc0ca750 2023-07-14T13:12:17.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.602+0000 7f89da59c640 1 -- 172.21.15.5:0/144297377 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561050741 0 0) 0x7f89dc0cfaf0 con 0x7f89dc06a540 2023-07-14T13:12:17.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.602+0000 7f89db59e640 1 --2- 172.21.15.5:0/144297377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89dc0ca750 0x7f89dc0cabd0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009d90 tx=0x7f89d401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f368cd9cfdaa376 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:17.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.606+0000 7f89da59c640 1 -- 172.21.15.5:0/144297377 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d40a59e0 con 0x7f89dc0ca750 2023-07-14T13:12:17.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.606+0000 7f89da59c640 1 -- 172.21.15.5:0/144297377 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d40a5b40 con 0x7f89dc0ca750 2023-07-14T13:12:17.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.606+0000 7f89da59c640 1 -- 172.21.15.5:0/144297377 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d40ad440 con 0x7f89dc0ca750 2023-07-14T13:12:17.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.606+0000 7f89e11d2640 1 -- 172.21.15.5:0/144297377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89dc0ca750 msgr2=0x7f89dc0cabd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:17.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.606+0000 7f89e11d2640 1 --2- 172.21.15.5:0/144297377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89dc0ca750 0x7f89dc0cabd0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009d90 tx=0x7f89d401c920 comp rx=0 tx=0).stop 2023-07-14T13:12:17.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.606+0000 7f89e11d2640 1 -- 172.21.15.5:0/144297377 shutdown_connections 2023-07-14T13:12:17.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.606+0000 7f89e11d2640 1 --2- 172.21.15.5:0/144297377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89dc0ca750 0x7f89dc0cabd0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:17.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.606+0000 7f89e11d2640 1 --2- 172.21.15.5:0/144297377 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89dc0cdcd0 0x7f89dc0cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:17.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.606+0000 7f89e11d2640 1 -- 172.21.15.5:0/144297377 >> 172.21.15.5:0/144297377 conn(0x7f89dc099490 msgr2=0x7f89dc089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:17.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.606+0000 7f89e11d2640 1 -- 172.21.15.5:0/144297377 shutdown_connections 2023-07-14T13:12:17.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.606+0000 7f89e11d2640 1 -- 172.21.15.5:0/144297377 wait complete. 2023-07-14T13:12:17.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.606+0000 7f89e11d2640 1 Processor -- start 2023-07-14T13:12:17.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.606+0000 7f89e11d2640 1 -- start start 2023-07-14T13:12:17.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.606+0000 7f89e11d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89dc06a540 0x7f89dc0c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:17.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.606+0000 7f89e11d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89dc0ca750 0x7f89dc152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:17.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.606+0000 7f89e11d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89dc0cdcd0 0x7f89dc153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:17.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.606+0000 7f89e11d2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc15cc10 con 0x7f89dc0cdcd0 2023-07-14T13:12:17.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.606+0000 7f89e11d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc15c300 con 0x7f89dc0ca750 2023-07-14T13:12:17.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.606+0000 7f89e11d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc154090 con 0x7f89dc06a540 2023-07-14T13:12:17.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.606+0000 7f89db59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89dc0cdcd0 0x7f89dc153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:17.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.606+0000 7f89db59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89dc0cdcd0 0x7f89dc153860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45228/0 (socket says 172.21.15.5:45228) 2023-07-14T13:12:17.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.606+0000 7f89db59e640 1 -- 172.21.15.5:0/610696806 learned_addr learned my addr 172.21.15.5:0/610696806 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:17.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.606+0000 7f89dad9d640 1 --2- 172.21.15.5:0/610696806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89dc06a540 0x7f89dc0c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:17.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.606+0000 7f89d3fff640 1 --2- 172.21.15.5:0/610696806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89dc0ca750 0x7f89dc152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:17.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.610+0000 7f89db59e640 1 -- 172.21.15.5:0/610696806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89dc06a540 msgr2=0x7f89dc0c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:17.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.610+0000 7f89db59e640 1 --2- 172.21.15.5:0/610696806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89dc06a540 0x7f89dc0c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:17.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.610+0000 7f89db59e640 1 -- 172.21.15.5:0/610696806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89dc0ca750 msgr2=0x7f89dc152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:17.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.610+0000 7f89db59e640 1 --2- 172.21.15.5:0/610696806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89dc0ca750 0x7f89dc152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:17.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.610+0000 7f89db59e640 1 -- 172.21.15.5:0/610696806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d4009a70 con 0x7f89dc0cdcd0 2023-07-14T13:12:17.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.610+0000 7f89dad9d640 1 --2- 172.21.15.5:0/610696806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89dc06a540 0x7f89dc0c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:17.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.610+0000 7f89d3fff640 1 --2- 172.21.15.5:0/610696806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89dc0ca750 0x7f89dc152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:17.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.610+0000 7f89db59e640 1 --2- 172.21.15.5:0/610696806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89dc0cdcd0 0x7f89dc153860 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f89d401afd0 tx=0x7f89d40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:17.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.610+0000 7f89d37fe640 1 -- 172.21.15.5:0/610696806 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d40add90 con 0x7f89dc0cdcd0 2023-07-14T13:12:17.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.610+0000 7f89d37fe640 1 -- 172.21.15.5:0/610696806 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d4009450 con 0x7f89dc0cdcd0 2023-07-14T13:12:17.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.610+0000 7f89d37fe640 1 -- 172.21.15.5:0/610696806 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d40b9670 con 0x7f89dc0cdcd0 2023-07-14T13:12:17.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.610+0000 7f89e11d2640 1 -- 172.21.15.5:0/610696806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89dc15c5c0 con 0x7f89dc0cdcd0 2023-07-14T13:12:17.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.610+0000 7f89e11d2640 1 -- 172.21.15.5:0/610696806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89dc153da0 con 0x7f89dc0cdcd0 2023-07-14T13:12:17.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.610+0000 7f89e11d2640 1 -- 172.21.15.5:0/610696806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89dc15cd80 con 0x7f89dc0cdcd0 2023-07-14T13:12:17.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.610+0000 7f89d37fe640 1 -- 172.21.15.5:0/610696806 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f89d40b97d0 con 0x7f89dc0cdcd0 2023-07-14T13:12:17.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.610+0000 7f89d37fe640 1 --2- 172.21.15.5:0/610696806 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f89bc0663a0 0x7f89bc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:17.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.610+0000 7f89d37fe640 1 -- 172.21.15.5:0/610696806 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6098+0+0 (secure 0 0 0) 0x7f89d411f6c0 con 0x7f89dc0cdcd0 2023-07-14T13:12:17.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.614+0000 7f89dad9d640 1 --2- 172.21.15.5:0/610696806 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f89bc0663a0 0x7f89bc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:17.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.614+0000 7f89dad9d640 1 --2- 172.21.15.5:0/610696806 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f89bc0663a0 0x7f89bc068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f89cc007fd0 tx=0x7f89cc009040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:17.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.614+0000 7f89d37fe640 1 -- 172.21.15.5:0/610696806 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f89d40ec9f0 con 0x7f89dc0cdcd0 2023-07-14T13:12:17.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.802+0000 7f89e11d2640 1 -- 172.21.15.5:0/610696806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f89dc0678d0 con 0x7f89dc0cdcd0 2023-07-14T13:12:17.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.802+0000 7f89d37fe640 1 -- 172.21.15.5:0/610696806 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f89d40bdde0 con 0x7f89dc0cdcd0 2023-07-14T13:12:17.838 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:17.838 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":59,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6980,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2963267082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2963267082},{"type":"v1","addr":"172.21.15.154:6836","nonce":2963267082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7885,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1576178254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1576178254},{"type":"v1","addr":"172.21.15.154:6837","nonce":1576178254}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/849067278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":849067278},{"type":"v1","addr":"172.21.15.5:6833","nonce":849067278}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8715,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1798199179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1798199179},{"type":"v1","addr":"172.21.15.5:6835","nonce":1798199179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[]} 2023-07-14T13:12:17.839 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 59 2023-07-14T13:12:17.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.806+0000 7f89e11d2640 1 -- 172.21.15.5:0/610696806 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f89bc0663a0 msgr2=0x7f89bc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.806+0000 7f89e11d2640 1 --2- 172.21.15.5:0/610696806 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f89bc0663a0 0x7f89bc068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f89cc007fd0 tx=0x7f89cc009040 comp rx=0 tx=0).stop 2023-07-14T13:12:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.806+0000 7f89e11d2640 1 -- 172.21.15.5:0/610696806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89dc0cdcd0 msgr2=0x7f89dc153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.806+0000 7f89e11d2640 1 --2- 172.21.15.5:0/610696806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89dc0cdcd0 0x7f89dc153860 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f89d401afd0 tx=0x7f89d40196c0 comp rx=0 tx=0).stop 2023-07-14T13:12:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.806+0000 7f89e11d2640 1 -- 172.21.15.5:0/610696806 shutdown_connections 2023-07-14T13:12:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.806+0000 7f89e11d2640 1 --2- 172.21.15.5:0/610696806 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f89bc0663a0 0x7f89bc068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.806+0000 7f89e11d2640 1 --2- 172.21.15.5:0/610696806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89dc0cdcd0 0x7f89dc153860 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.806+0000 7f89e11d2640 1 --2- 172.21.15.5:0/610696806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89dc0ca750 0x7f89dc152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.806+0000 7f89e11d2640 1 --2- 172.21.15.5:0/610696806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89dc06a540 0x7f89dc0c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:17.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.806+0000 7f89e11d2640 1 -- 172.21.15.5:0/610696806 >> 172.21.15.5:0/610696806 conn(0x7f89dc099490 msgr2=0x7f89dc0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:17.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.806+0000 7f89e11d2640 1 -- 172.21.15.5:0/610696806 shutdown_connections 2023-07-14T13:12:17.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:17.806+0000 7f89e11d2640 1 -- 172.21.15.5:0/610696806 wait complete. 2023-07-14T13:12:17.859 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-14T13:12:17.859 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-14T13:12:17.860 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-14T13:12:17.860 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:12:17.860 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-14T13:12:17.861 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-14T13:12:17.861 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-14T13:12:17.861 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:12:17.861 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-14T13:12:17.861 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-14T13:12:17.862 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-14T13:12:17.862 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:12:17.862 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-14T13:12:17.862 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-14T13:12:17.863 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-14T13:12:17.863 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:12:17.872 INFO:tasks.ceph.mds.a:Stopped 2023-07-14T13:12:17.873 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-14T13:12:17.873 INFO:tasks.ceph.mds.c:Stopped 2023-07-14T13:12:17.874 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-14T13:12:17.878 INFO:tasks.ceph.mds.b:Stopped 2023-07-14T13:12:17.878 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-14T13:12:17.879 INFO:tasks.ceph.mds.d:Stopped 2023-07-14T13:12:17.879 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-14T13:12:17.921 INFO:tasks.ceph.mds.a:Started 2023-07-14T13:12:17.922 DEBUG:teuthology.parallel:result is None 2023-07-14T13:12:17.923 INFO:tasks.ceph.mds.c:Started 2023-07-14T13:12:17.924 DEBUG:teuthology.parallel:result is None 2023-07-14T13:12:17.925 INFO:tasks.ceph.mds.b:Started 2023-07-14T13:12:17.925 DEBUG:teuthology.parallel:result is None 2023-07-14T13:12:17.927 INFO:tasks.ceph.mds.d:Started 2023-07-14T13:12:17.927 DEBUG:teuthology.parallel:result is None 2023-07-14T13:12:17.928 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-14T13:12:18.011 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-07-14T13:12:18.013 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-07-14T13:12:18.016 INFO:tasks.ceph.mds.d.smithi154.stdout:starting mds.d at 2023-07-14T13:12:18.016 INFO:tasks.ceph.mds.b.smithi154.stdout:starting mds.b at 2023-07-14T13:12:18.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.042+0000 7f504d99f640 1 Processor -- start 2023-07-14T13:12:18.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.042+0000 7f504d99f640 1 -- start start 2023-07-14T13:12:18.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.042+0000 7f504d99f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5048158ce0 0x7f5048070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:18.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.042+0000 7f504d99f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f50480c8ad0 0x7f50480c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:18.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.042+0000 7f504d99f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50480c99c0 con 0x7f50480c9560 2023-07-14T13:12:18.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.046+0000 7f504d99f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50480cc700 con 0x7f5048158ce0 2023-07-14T13:12:18.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.046+0000 7f504d99f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50480b0ff0 con 0x7f50480c8ad0 2023-07-14T13:12:18.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.046+0000 7f5046ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5048158ce0 0x7f5048070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:18.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.046+0000 7f5046ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5048158ce0 0x7f5048070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45264/0 (socket says 172.21.15.5:45264) 2023-07-14T13:12:18.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.046+0000 7f5046ffd640 1 -- 172.21.15.5:0/2507400283 learned_addr learned my addr 172.21.15.5:0/2507400283 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:18.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.046+0000 7f50467fc640 1 --2- 172.21.15.5:0/2507400283 >> v2:172.21.15.154:3300/0 conn(0x7f50480c8ad0 0x7f50480c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:18.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.046+0000 7f5046ffd640 1 -- 172.21.15.5:0/2507400283 >> v2:172.21.15.154:3300/0 conn(0x7f50480c8ad0 msgr2=0x7f50480c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:18.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.046+0000 7f5046ffd640 1 --2- 172.21.15.5:0/2507400283 >> v2:172.21.15.154:3300/0 conn(0x7f50480c8ad0 0x7f50480c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:18.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.046+0000 7f5046ffd640 1 -- 172.21.15.5:0/2507400283 >> v1:172.21.15.5:6789/0 conn(0x7f50480c9560 legacy=0x7f50480cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:18.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.046+0000 7f5046ffd640 1 -- 172.21.15.5:0/2507400283 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5048070c80 con 0x7f5048158ce0 2023-07-14T13:12:18.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.046+0000 7f5046ffd640 1 --2- 172.21.15.5:0/2507400283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5048158ce0 0x7f5048070450 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f50480c1a30 tx=0x7f503801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a2698098ef58e31 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:18.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.050+0000 7f5045ffb640 1 -- 172.21.15.5:0/2507400283 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50480cba20 con 0x7f5048158ce0 2023-07-14T13:12:18.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.050+0000 7f5045ffb640 1 -- 172.21.15.5:0/2507400283 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50380a7050 con 0x7f5048158ce0 2023-07-14T13:12:18.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.050+0000 7f5045ffb640 1 -- 172.21.15.5:0/2507400283 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50380ab820 con 0x7f5048158ce0 2023-07-14T13:12:18.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.050+0000 7f504d99f640 1 -- 172.21.15.5:0/2507400283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5048158ce0 msgr2=0x7f5048070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:18.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.050+0000 7f504d99f640 1 --2- 172.21.15.5:0/2507400283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5048158ce0 0x7f5048070450 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f50480c1a30 tx=0x7f503801c3b0 comp rx=0 tx=0).stop 2023-07-14T13:12:18.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.050+0000 7f504d99f640 1 -- 172.21.15.5:0/2507400283 shutdown_connections 2023-07-14T13:12:18.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.050+0000 7f504d99f640 1 --2- 172.21.15.5:0/2507400283 >> v2:172.21.15.154:3300/0 conn(0x7f50480c8ad0 0x7f50480c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:18.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.050+0000 7f504d99f640 1 --2- 172.21.15.5:0/2507400283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5048158ce0 0x7f5048070450 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:18.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.050+0000 7f504d99f640 1 -- 172.21.15.5:0/2507400283 >> 172.21.15.5:0/2507400283 conn(0x7f50480afcf0 msgr2=0x7f50480b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:18.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.050+0000 7f504d99f640 1 -- 172.21.15.5:0/2507400283 shutdown_connections 2023-07-14T13:12:18.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.050+0000 7f504d99f640 1 -- 172.21.15.5:0/2507400283 wait complete. 2023-07-14T13:12:18.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.050+0000 7f504d99f640 1 Processor -- start 2023-07-14T13:12:18.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.050+0000 7f504d99f640 1 -- start start 2023-07-14T13:12:18.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.050+0000 7f504d99f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50480c8ad0 0x7f50480c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:18.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.050+0000 7f504d99f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50480c9560 0x7f5048143370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:18.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.050+0000 7f504d99f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5048158ce0 0x7f50481438b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:18.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.050+0000 7f504d99f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5048143df0 con 0x7f5048158ce0 2023-07-14T13:12:18.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.050+0000 7f504d99f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5048150400 con 0x7f50480c9560 2023-07-14T13:12:18.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.050+0000 7f504d99f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504814d2f0 con 0x7f50480c8ad0 2023-07-14T13:12:18.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.050+0000 7f50477fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5048158ce0 0x7f50481438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:18.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.050+0000 7f50477fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5048158ce0 0x7f50481438b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45270/0 (socket says 172.21.15.5:45270) 2023-07-14T13:12:18.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.050+0000 7f50477fe640 1 -- 172.21.15.5:0/2522220753 learned_addr learned my addr 172.21.15.5:0/2522220753 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:18.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.050+0000 7f5046ffd640 1 --2- 172.21.15.5:0/2522220753 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50480c8ad0 0x7f50480c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:18.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.050+0000 7f50467fc640 1 --2- 172.21.15.5:0/2522220753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50480c9560 0x7f5048143370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:18.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.054+0000 7f50477fe640 1 -- 172.21.15.5:0/2522220753 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50480c8ad0 msgr2=0x7f50480c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:18.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.054+0000 7f50477fe640 1 --2- 172.21.15.5:0/2522220753 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50480c8ad0 0x7f50480c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:18.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.054+0000 7f50477fe640 1 -- 172.21.15.5:0/2522220753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50480c9560 msgr2=0x7f5048143370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:18.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.054+0000 7f50477fe640 1 --2- 172.21.15.5:0/2522220753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50480c9560 0x7f5048143370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:18.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.054+0000 7f50477fe640 1 -- 172.21.15.5:0/2522220753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50380094d0 con 0x7f5048158ce0 2023-07-14T13:12:18.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.054+0000 7f50477fe640 1 --2- 172.21.15.5:0/2522220753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5048158ce0 0x7f50481438b0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f504000c730 tx=0x7f504000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:18.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.054+0000 7f502ffff640 1 -- 172.21.15.5:0/2522220753 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5040003b80 con 0x7f5048158ce0 2023-07-14T13:12:18.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.054+0000 7f502ffff640 1 -- 172.21.15.5:0/2522220753 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5040003ce0 con 0x7f5048158ce0 2023-07-14T13:12:18.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.054+0000 7f502ffff640 1 -- 172.21.15.5:0/2522220753 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504000aa30 con 0x7f5048158ce0 2023-07-14T13:12:18.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.054+0000 7f504d99f640 1 -- 172.21.15.5:0/2522220753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f504814d5d0 con 0x7f5048158ce0 2023-07-14T13:12:18.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.054+0000 7f504d99f640 1 -- 172.21.15.5:0/2522220753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5048150930 con 0x7f5048158ce0 2023-07-14T13:12:18.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.054+0000 7f504d99f640 1 -- 172.21.15.5:0/2522220753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50480ca1a0 con 0x7f5048158ce0 2023-07-14T13:12:18.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.054+0000 7f502ffff640 1 -- 172.21.15.5:0/2522220753 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f504000ab90 con 0x7f5048158ce0 2023-07-14T13:12:18.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.054+0000 7f502ffff640 1 --2- 172.21.15.5:0/2522220753 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f50340663a0 0x7f5034068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:18.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.054+0000 7f502ffff640 1 -- 172.21.15.5:0/2522220753 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6098+0+0 (secure 0 0 0) 0x7f5040083a70 con 0x7f5048158ce0 2023-07-14T13:12:18.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.058+0000 7f5046ffd640 1 --2- 172.21.15.5:0/2522220753 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f50340663a0 0x7f5034068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:18.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.058+0000 7f5046ffd640 1 --2- 172.21.15.5:0/2522220753 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f50340663a0 0x7f5034068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f50380ad000 tx=0x7f50380a6000 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:18.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.058+0000 7f502ffff640 1 -- 172.21.15.5:0/2522220753 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f5040050ef0 con 0x7f5048158ce0 2023-07-14T13:12:18.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:18.230+0000 7f504d99f640 1 -- 172.21.15.5:0/2522220753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f50480678d0 con 0x7f5048158ce0 2023-07-14T13:12:18.315 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:12:18.319 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:12:19.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.242+0000 7f502ffff640 1 -- 172.21.15.5:0/2522220753 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v138) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5040054510 con 0x7f5048158ce0 2023-07-14T13:12:19.277 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2023-07-14T13:12:19.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.246+0000 7f504d99f640 1 -- 172.21.15.5:0/2522220753 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f50340663a0 msgr2=0x7f5034068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:19.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.246+0000 7f504d99f640 1 --2- 172.21.15.5:0/2522220753 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f50340663a0 0x7f5034068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f50380ad000 tx=0x7f50380a6000 comp rx=0 tx=0).stop 2023-07-14T13:12:19.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.246+0000 7f504d99f640 1 -- 172.21.15.5:0/2522220753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5048158ce0 msgr2=0x7f50481438b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:19.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.246+0000 7f504d99f640 1 --2- 172.21.15.5:0/2522220753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5048158ce0 0x7f50481438b0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f504000c730 tx=0x7f504000cbf0 comp rx=0 tx=0).stop 2023-07-14T13:12:19.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.246+0000 7f504d99f640 1 -- 172.21.15.5:0/2522220753 shutdown_connections 2023-07-14T13:12:19.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.246+0000 7f504d99f640 1 --2- 172.21.15.5:0/2522220753 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f50340663a0 0x7f5034068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:19.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.246+0000 7f504d99f640 1 --2- 172.21.15.5:0/2522220753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5048158ce0 0x7f50481438b0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:19.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.246+0000 7f504d99f640 1 --2- 172.21.15.5:0/2522220753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50480c9560 0x7f5048143370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:19.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.246+0000 7f504d99f640 1 --2- 172.21.15.5:0/2522220753 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50480c8ad0 0x7f50480c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:19.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.246+0000 7f504d99f640 1 -- 172.21.15.5:0/2522220753 >> 172.21.15.5:0/2522220753 conn(0x7f50480afcf0 msgr2=0x7f5048156e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:19.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.246+0000 7f504d99f640 1 -- 172.21.15.5:0/2522220753 shutdown_connections 2023-07-14T13:12:19.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.246+0000 7f504d99f640 1 -- 172.21.15.5:0/2522220753 wait complete. 2023-07-14T13:12:19.302 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-14T13:12:19.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.418+0000 7f895cbd2640 1 Processor -- start 2023-07-14T13:12:19.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.418+0000 7f895cbd2640 1 -- start start 2023-07-14T13:12:19.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.418+0000 7f895cbd2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f895815f3f0 0x7f89580b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:19.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.418+0000 7f895cbd2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89580b7bc0 0x7f89580cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:19.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.418+0000 7f895cbd2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89580b8020 con 0x7f89580d13f0 2023-07-14T13:12:19.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.418+0000 7f895cbd2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89580d0f60 con 0x7f895815f3f0 2023-07-14T13:12:19.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.418+0000 7f895cbd2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89580d0390 con 0x7f89580b7bc0 2023-07-14T13:12:19.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.418+0000 7f89577fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f895815f3f0 0x7f89580b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:19.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.418+0000 7f89577fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f895815f3f0 0x7f89580b7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59728/0 (socket says 172.21.15.5:59728) 2023-07-14T13:12:19.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.418+0000 7f89577fe640 1 -- 172.21.15.5:0/4231455716 learned_addr learned my addr 172.21.15.5:0/4231455716 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:19.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.418+0000 7f8957fff640 1 --2- 172.21.15.5:0/4231455716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89580b7bc0 0x7f89580cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:19.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.418+0000 7f89577fe640 1 -- 172.21.15.5:0/4231455716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89580b7bc0 msgr2=0x7f89580cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:19.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.418+0000 7f89577fe640 1 --2- 172.21.15.5:0/4231455716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89580b7bc0 0x7f89580cd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:19.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.418+0000 7f89577fe640 1 -- 172.21.15.5:0/4231455716 >> v1:172.21.15.5:6789/0 conn(0x7f89580d13f0 legacy=0x7f89580cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:19.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.418+0000 7f89577fe640 1 -- 172.21.15.5:0/4231455716 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89580d0630 con 0x7f895815f3f0 2023-07-14T13:12:19.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.422+0000 7f89577fe640 1 --2- 172.21.15.5:0/4231455716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f895815f3f0 0x7f89580b7680 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f8948009870 tx=0x7f894801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b81f945762309a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:19.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.422+0000 7f89567fc640 1 -- 172.21.15.5:0/4231455716 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89480ac600 con 0x7f895815f3f0 2023-07-14T13:12:19.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.422+0000 7f89567fc640 1 -- 172.21.15.5:0/4231455716 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89480a8050 con 0x7f895815f3f0 2023-07-14T13:12:19.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.422+0000 7f89567fc640 1 -- 172.21.15.5:0/4231455716 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89480ac980 con 0x7f895815f3f0 2023-07-14T13:12:19.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.422+0000 7f895cbd2640 1 -- 172.21.15.5:0/4231455716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f895815f3f0 msgr2=0x7f89580b7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:19.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.422+0000 7f895cbd2640 1 --2- 172.21.15.5:0/4231455716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f895815f3f0 0x7f89580b7680 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f8948009870 tx=0x7f894801c4b0 comp rx=0 tx=0).stop 2023-07-14T13:12:19.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.422+0000 7f895cbd2640 1 -- 172.21.15.5:0/4231455716 shutdown_connections 2023-07-14T13:12:19.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.422+0000 7f895cbd2640 1 --2- 172.21.15.5:0/4231455716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89580b7bc0 0x7f89580cd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:19.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.422+0000 7f895cbd2640 1 --2- 172.21.15.5:0/4231455716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f895815f3f0 0x7f89580b7680 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:19.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.422+0000 7f895cbd2640 1 -- 172.21.15.5:0/4231455716 >> 172.21.15.5:0/4231455716 conn(0x7f8958069f50 msgr2=0x7f895806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:19.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.422+0000 7f895cbd2640 1 -- 172.21.15.5:0/4231455716 shutdown_connections 2023-07-14T13:12:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.422+0000 7f895cbd2640 1 -- 172.21.15.5:0/4231455716 wait complete. 2023-07-14T13:12:19.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.422+0000 7f895cbd2640 1 Processor -- start 2023-07-14T13:12:19.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.422+0000 7f895cbd2640 1 -- start start 2023-07-14T13:12:19.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.426+0000 7f895cbd2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89580b7bc0 0x7f895814d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:19.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.426+0000 7f895cbd2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89580d13f0 0x7f895814e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:19.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.426+0000 7f895cbd2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f895815f3f0 0x7f89580d1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:19.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.426+0000 7f895cbd2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895815db60 con 0x7f895815f3f0 2023-07-14T13:12:19.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.426+0000 7f895cbd2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895815cac0 con 0x7f89580d13f0 2023-07-14T13:12:19.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.426+0000 7f895cbd2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895815cda0 con 0x7f89580b7bc0 2023-07-14T13:12:19.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.426+0000 7f8957fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f895815f3f0 0x7f89580d1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:19.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.426+0000 7f8957fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f895815f3f0 0x7f89580d1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59732/0 (socket says 172.21.15.5:59732) 2023-07-14T13:12:19.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.426+0000 7f8957fff640 1 -- 172.21.15.5:0/709821669 learned_addr learned my addr 172.21.15.5:0/709821669 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:19.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.426+0000 7f8956ffd640 1 --2- 172.21.15.5:0/709821669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89580d13f0 0x7f895814e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:19.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.426+0000 7f89577fe640 1 --2- 172.21.15.5:0/709821669 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89580b7bc0 0x7f895814d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:19.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.426+0000 7f8957fff640 1 -- 172.21.15.5:0/709821669 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89580b7bc0 msgr2=0x7f895814d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:19.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.426+0000 7f8957fff640 1 --2- 172.21.15.5:0/709821669 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89580b7bc0 0x7f895814d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:19.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.426+0000 7f8957fff640 1 -- 172.21.15.5:0/709821669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89580d13f0 msgr2=0x7f895814e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:19.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.426+0000 7f8957fff640 1 --2- 172.21.15.5:0/709821669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89580d13f0 0x7f895814e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:19.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.426+0000 7f8957fff640 1 -- 172.21.15.5:0/709821669 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89480094d0 con 0x7f895815f3f0 2023-07-14T13:12:19.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.426+0000 7f8957fff640 1 --2- 172.21.15.5:0/709821669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f895815f3f0 0x7f89580d1ee0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f895000efc0 tx=0x7f895000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:19.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.426+0000 7f893ffff640 1 -- 172.21.15.5:0/709821669 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950014480 con 0x7f895815f3f0 2023-07-14T13:12:19.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.426+0000 7f893ffff640 1 -- 172.21.15.5:0/709821669 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895000f040 con 0x7f895815f3f0 2023-07-14T13:12:19.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.426+0000 7f895cbd2640 1 -- 172.21.15.5:0/709821669 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f895815d080 con 0x7f895815f3f0 2023-07-14T13:12:19.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.426+0000 7f893ffff640 1 -- 172.21.15.5:0/709821669 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950014820 con 0x7f895815f3f0 2023-07-14T13:12:19.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.426+0000 7f895cbd2640 1 -- 172.21.15.5:0/709821669 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f895815d640 con 0x7f895815f3f0 2023-07-14T13:12:19.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.426+0000 7f895cbd2640 1 -- 172.21.15.5:0/709821669 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f895815d860 con 0x7f895815f3f0 2023-07-14T13:12:19.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.426+0000 7f893ffff640 1 -- 172.21.15.5:0/709821669 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8950014980 con 0x7f895815f3f0 2023-07-14T13:12:19.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.430+0000 7f893ffff640 1 --2- 172.21.15.5:0/709821669 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f89440663a0 0x7f8944068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:19.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.430+0000 7f893ffff640 1 -- 172.21.15.5:0/709821669 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f8950084790 con 0x7f895815f3f0 2023-07-14T13:12:19.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.430+0000 7f89577fe640 1 --2- 172.21.15.5:0/709821669 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f89440663a0 0x7f8944068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:19.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.430+0000 7f89577fe640 1 --2- 172.21.15.5:0/709821669 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f89440663a0 0x7f8944068850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f89480ae000 tx=0x7f89480a7000 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:19.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.434+0000 7f893ffff640 1 -- 172.21.15.5:0/709821669 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f8950051d30 con 0x7f895815f3f0 2023-07-14T13:12:19.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.638+0000 7f895cbd2640 1 -- 172.21.15.5:0/709821669 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f89580678d0 con 0x7f895815f3f0 2023-07-14T13:12:19.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.642+0000 7f893ffff640 1 -- 172.21.15.5:0/709821669 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f8950055350 con 0x7f895815f3f0 2023-07-14T13:12:19.676 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:19.676 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T13:12:19.676 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2023-07-14T13:12:19.676 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:19.677 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2023-07-14T13:12:19.677 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkGNTsMRAA5T/zjdynxEKmoNAAK0cChw==", 2023-07-14T13:12:19.677 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:19.677 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:12:19.677 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:12:19.677 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:12:19.677 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:19.678 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:19.678 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:19.678 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:19.678 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2023-07-14T13:12:19.678 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkqXNAAxAAb7bzXyE8cSS0A3Rz2de6TA==", 2023-07-14T13:12:19.678 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:19.678 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:12:19.679 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:12:19.679 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:12:19.679 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:19.679 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:19.679 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:19.679 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:19.679 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2023-07-14T13:12:19.680 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFk6NGUORAA+5odxrAlCCXYGc64nzFWwQ==", 2023-07-14T13:12:19.680 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:19.680 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:12:19.680 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:12:19.680 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:12:19.680 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:19.681 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:19.681 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:19.681 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:19.681 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2023-07-14T13:12:19.681 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkGh/BChAA5p9amLIC6ORC0JJov0bSVg==", 2023-07-14T13:12:19.681 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:19.681 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:12:19.682 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:12:19.682 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:12:19.682 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:19.682 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:19.682 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:19.682 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:19.682 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2023-07-14T13:12:19.683 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDlRLFkJ6MULhAAxExAqekc/gWudYBJ2sY4MQ==", 2023-07-14T13:12:19.683 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:19.683 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:12:19.683 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:12:19.683 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:19.683 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:19.683 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:19.684 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:19.684 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2023-07-14T13:12:19.684 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDoRLFksXGBNRAAFtHZt5OQw0aB6k3CkxOzZQ==", 2023-07-14T13:12:19.684 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:19.684 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:12:19.684 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:12:19.684 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:19.685 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:19.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:19.685 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:19.685 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2023-07-14T13:12:19.685 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDsRLFkaUH0ARAAkqgsKPX1dTSZQjn0cRxxRQ==", 2023-07-14T13:12:19.686 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:19.686 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:12:19.686 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:12:19.686 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:19.686 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:19.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:19.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:19.687 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2023-07-14T13:12:19.687 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDvRLFkvElJCRAAnox5LKwobP/1Qaf5d9UsjA==", 2023-07-14T13:12:19.687 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:19.687 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:12:19.687 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:12:19.688 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:19.688 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:19.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:19.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:19.688 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2023-07-14T13:12:19.688 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD1RLFkMNyyDxAA19dJkhhuSpcgVPQEyxb3lg==", 2023-07-14T13:12:19.689 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:19.689 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:12:19.689 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:12:19.689 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:19.689 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:19.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:19.690 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:19.690 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2023-07-14T13:12:19.690 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD4RLFkR8mTFhAAP5qUgUJI23XOvVAnNCSgRQ==", 2023-07-14T13:12:19.690 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:19.690 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:12:19.690 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:12:19.690 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:19.691 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:19.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:19.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:19.691 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2023-07-14T13:12:19.691 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD7RLFkpWL9HBAAo8MfszRnB4sHsDPPcRjCAg==", 2023-07-14T13:12:19.691 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:19.691 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:12:19.691 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:12:19.692 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:19.692 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:19.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:19.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:19.692 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2023-07-14T13:12:19.692 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD+RLFkL5cRIxAAF/4ndtYf0oiH3uhhDKnQQg==", 2023-07-14T13:12:19.693 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:19.693 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:12:19.693 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:12:19.693 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:19.693 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:19.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:19.693 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:19.694 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2023-07-14T13:12:19.694 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkCav/DhAA6SOiONAbTcWCnUZXcm7BcQ==", 2023-07-14T13:12:19.694 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:19.694 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:12:19.694 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2023-07-14T13:12:19.694 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-14T13:12:19.694 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:19.695 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:19.695 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:19.695 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2023-07-14T13:12:19.695 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkgS/hGBAAevMD2/lfNuaeV74w0Xj0Zw==", 2023-07-14T13:12:19.695 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:19.696 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:12:19.696 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T13:12:19.696 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T13:12:19.696 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T13:12:19.696 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:19.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:19.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:19.697 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2023-07-14T13:12:19.697 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkeBs4FRAAJ/UjIEKDajVyDb7PejPqAw==", 2023-07-14T13:12:19.698 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:19.698 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:12:19.698 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T13:12:19.699 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T13:12:19.699 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T13:12:19.699 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:19.699 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:19.700 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:19.700 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2023-07-14T13:12:19.700 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkSkDiHhAAV86wIrAVz3o/PI2CaBC44w==", 2023-07-14T13:12:19.701 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:19.701 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:12:19.701 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T13:12:19.702 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T13:12:19.702 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T13:12:19.702 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:19.702 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:19.703 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:19.703 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2023-07-14T13:12:19.703 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkk5IcFRAAThI0P1N8LsRetmwhHqSvdQ==", 2023-07-14T13:12:19.703 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:19.703 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T13:12:19.703 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:12:19.703 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:12:19.704 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:19.704 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:19.704 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:19.704 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:19.704 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2023-07-14T13:12:19.704 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkugeXLRAAEVAnLk/dldtqrpkdzQI3SA==", 2023-07-14T13:12:19.704 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:19.705 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T13:12:19.705 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-07-14T13:12:19.705 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:19.705 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:19.705 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:19.705 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:19.705 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2023-07-14T13:12:19.706 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkSvp/KRAAwvjYlrZYNeGbhCiDrTmnrA==", 2023-07-14T13:12:19.706 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:19.706 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T13:12:19.706 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-07-14T13:12:19.706 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:19.706 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:19.706 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:19.707 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-07-14T13:12:19.707 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T13:12:19.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.642+0000 7f895cbd2640 1 -- 172.21.15.5:0/709821669 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f89440663a0 msgr2=0x7f8944068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:19.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.642+0000 7f895cbd2640 1 --2- 172.21.15.5:0/709821669 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f89440663a0 0x7f8944068850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f89480ae000 tx=0x7f89480a7000 comp rx=0 tx=0).stop 2023-07-14T13:12:19.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.642+0000 7f895cbd2640 1 -- 172.21.15.5:0/709821669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f895815f3f0 msgr2=0x7f89580d1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:19.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.642+0000 7f895cbd2640 1 --2- 172.21.15.5:0/709821669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f895815f3f0 0x7f89580d1ee0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f895000efc0 tx=0x7f895000c490 comp rx=0 tx=0).stop 2023-07-14T13:12:19.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.642+0000 7f895cbd2640 1 -- 172.21.15.5:0/709821669 shutdown_connections 2023-07-14T13:12:19.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.642+0000 7f895cbd2640 1 --2- 172.21.15.5:0/709821669 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f89440663a0 0x7f8944068850 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:19.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.642+0000 7f895cbd2640 1 --2- 172.21.15.5:0/709821669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f895815f3f0 0x7f89580d1ee0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:19.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.642+0000 7f895cbd2640 1 --2- 172.21.15.5:0/709821669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89580d13f0 0x7f895814e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:19.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.642+0000 7f895cbd2640 1 --2- 172.21.15.5:0/709821669 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89580b7bc0 0x7f895814d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:19.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.642+0000 7f895cbd2640 1 -- 172.21.15.5:0/709821669 >> 172.21.15.5:0/709821669 conn(0x7f8958069f50 msgr2=0x7f89580c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:19.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.642+0000 7f895cbd2640 1 -- 172.21.15.5:0/709821669 shutdown_connections 2023-07-14T13:12:19.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.642+0000 7f895cbd2640 1 -- 172.21.15.5:0/709821669 wait complete. 2023-07-14T13:12:19.710 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:12:19.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.818+0000 7fa35a9fa640 1 Processor -- start 2023-07-14T13:12:19.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.818+0000 7fa35a9fa640 1 -- start start 2023-07-14T13:12:19.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.822+0000 7fa35a9fa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa354158ce0 0x7fa354070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:19.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.822+0000 7fa35a9fa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3540c9730 0x7fa3540ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:19.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.822+0000 7fa35a9fa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3540cc700 con 0x7fa3540c8ad0 2023-07-14T13:12:19.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.822+0000 7fa35a9fa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3540b0ff0 con 0x7fa3540c9730 2023-07-14T13:12:19.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.822+0000 7fa35a9fa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa354070c80 con 0x7fa354158ce0 2023-07-14T13:12:19.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.822+0000 7fa358f97640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3540c9730 0x7fa3540ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:19.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.822+0000 7fa358f97640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3540c9730 0x7fa3540ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59746/0 (socket says 172.21.15.5:59746) 2023-07-14T13:12:19.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.822+0000 7fa358f97640 1 -- 172.21.15.5:0/1847454468 learned_addr learned my addr 172.21.15.5:0/1847454468 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:19.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.822+0000 7fa353fff640 1 --2- 172.21.15.5:0/1847454468 >> v2:172.21.15.154:3300/0 conn(0x7fa354158ce0 0x7fa354070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:19.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.822+0000 7fa358f97640 1 -- 172.21.15.5:0/1847454468 >> v2:172.21.15.154:3300/0 conn(0x7fa354158ce0 msgr2=0x7fa354070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:19.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.822+0000 7fa358f97640 1 --2- 172.21.15.5:0/1847454468 >> v2:172.21.15.154:3300/0 conn(0x7fa354158ce0 0x7fa354070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:19.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.822+0000 7fa358f97640 1 -- 172.21.15.5:0/1847454468 >> v1:172.21.15.154:6789/0 conn(0x7fa3540c8ad0 legacy=0x7fa3540c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:19.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.822+0000 7fa358f97640 1 -- 172.21.15.5:0/1847454468 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3540cbdd0 con 0x7fa3540c9730 2023-07-14T13:12:19.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.826+0000 7fa358f97640 1 --2- 172.21.15.5:0/1847454468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3540c9730 0x7fa3540ccb90 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fa354071be0 tx=0x7fa34c01ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1b4e7fcd11ea30 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:19.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.826+0000 7fa352ffd640 1 -- 172.21.15.5:0/1847454468 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c0a7870 con 0x7fa3540c9730 2023-07-14T13:12:19.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.826+0000 7fa352ffd640 1 -- 172.21.15.5:0/1847454468 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34c0a79d0 con 0x7fa3540c9730 2023-07-14T13:12:19.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.826+0000 7fa352ffd640 1 -- 172.21.15.5:0/1847454468 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c0a7d60 con 0x7fa3540c9730 2023-07-14T13:12:19.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.826+0000 7fa35a9fa640 1 -- 172.21.15.5:0/1847454468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3540c9730 msgr2=0x7fa3540ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:19.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.826+0000 7fa35a9fa640 1 --2- 172.21.15.5:0/1847454468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3540c9730 0x7fa3540ccb90 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fa354071be0 tx=0x7fa34c01ea90 comp rx=0 tx=0).stop 2023-07-14T13:12:19.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.826+0000 7fa35a9fa640 1 -- 172.21.15.5:0/1847454468 shutdown_connections 2023-07-14T13:12:19.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.826+0000 7fa35a9fa640 1 --2- 172.21.15.5:0/1847454468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3540c9730 0x7fa3540ccb90 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:19.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.826+0000 7fa35a9fa640 1 --2- 172.21.15.5:0/1847454468 >> v2:172.21.15.154:3300/0 conn(0x7fa354158ce0 0x7fa354070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:19.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.826+0000 7fa35a9fa640 1 -- 172.21.15.5:0/1847454468 >> 172.21.15.5:0/1847454468 conn(0x7fa3540afcf0 msgr2=0x7fa3540b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:19.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.826+0000 7fa35a9fa640 1 -- 172.21.15.5:0/1847454468 shutdown_connections 2023-07-14T13:12:19.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.826+0000 7fa35a9fa640 1 -- 172.21.15.5:0/1847454468 wait complete. 2023-07-14T13:12:19.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.826+0000 7fa35a9fa640 1 Processor -- start 2023-07-14T13:12:19.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.826+0000 7fa35a9fa640 1 -- start start 2023-07-14T13:12:19.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.826+0000 7fa35a9fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3540c8ad0 0x7fa35414e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:19.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.826+0000 7fa35a9fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3540c9730 0x7fa3540c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:19.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.826+0000 7fa35a9fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa354158ce0 0x7fa35414ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:19.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.826+0000 7fa35a9fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3541593d0 con 0x7fa3540c8ad0 2023-07-14T13:12:19.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.826+0000 7fa35a9fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3540c6180 con 0x7fa3540c9730 2023-07-14T13:12:19.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.826+0000 7fa35a9fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35414b0d0 con 0x7fa354158ce0 2023-07-14T13:12:19.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.830+0000 7fa353fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3540c8ad0 0x7fa35414e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:19.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.830+0000 7fa353fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3540c8ad0 0x7fa35414e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59752/0 (socket says 172.21.15.5:59752) 2023-07-14T13:12:19.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.830+0000 7fa353fff640 1 -- 172.21.15.5:0/4247165344 learned_addr learned my addr 172.21.15.5:0/4247165344 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:19.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.830+0000 7fa358f97640 1 --2- 172.21.15.5:0/4247165344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa354158ce0 0x7fa35414ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:19.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.830+0000 7fa3537fe640 1 --2- 172.21.15.5:0/4247165344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3540c9730 0x7fa3540c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:19.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.830+0000 7fa353fff640 1 -- 172.21.15.5:0/4247165344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa354158ce0 msgr2=0x7fa35414ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:19.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.830+0000 7fa353fff640 1 --2- 172.21.15.5:0/4247165344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa354158ce0 0x7fa35414ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:19.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.830+0000 7fa353fff640 1 -- 172.21.15.5:0/4247165344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3540c9730 msgr2=0x7fa3540c5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:19.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.830+0000 7fa353fff640 1 --2- 172.21.15.5:0/4247165344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3540c9730 0x7fa3540c5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:19.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.830+0000 7fa353fff640 1 -- 172.21.15.5:0/4247165344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34c009b30 con 0x7fa3540c8ad0 2023-07-14T13:12:19.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.830+0000 7fa353fff640 1 --2- 172.21.15.5:0/4247165344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3540c8ad0 0x7fa35414e820 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fa34400e870 tx=0x7fa34400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:19.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.830+0000 7fa350ff9640 1 -- 172.21.15.5:0/4247165344 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa344009510 con 0x7fa3540c8ad0 2023-07-14T13:12:19.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.830+0000 7fa350ff9640 1 -- 172.21.15.5:0/4247165344 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34400eec0 con 0x7fa3540c8ad0 2023-07-14T13:12:19.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.830+0000 7fa35a9fa640 1 -- 172.21.15.5:0/4247165344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3540c63c0 con 0x7fa3540c8ad0 2023-07-14T13:12:19.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.830+0000 7fa350ff9640 1 -- 172.21.15.5:0/4247165344 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34400cb40 con 0x7fa3540c8ad0 2023-07-14T13:12:19.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.830+0000 7fa35a9fa640 1 -- 172.21.15.5:0/4247165344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3540c6980 con 0x7fa3540c8ad0 2023-07-14T13:12:19.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.830+0000 7fa35a9fa640 1 -- 172.21.15.5:0/4247165344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3540ca1a0 con 0x7fa3540c8ad0 2023-07-14T13:12:19.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.830+0000 7fa350ff9640 1 -- 172.21.15.5:0/4247165344 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa34400cca0 con 0x7fa3540c8ad0 2023-07-14T13:12:19.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.834+0000 7fa350ff9640 1 --2- 172.21.15.5:0/4247165344 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fa3400663a0 0x7fa340068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:19.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.834+0000 7fa350ff9640 1 -- 172.21.15.5:0/4247165344 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5238+0+0 (secure 0 0 0) 0x7fa344083cf0 con 0x7fa3540c8ad0 2023-07-14T13:12:19.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.834+0000 7fa3537fe640 1 --2- 172.21.15.5:0/4247165344 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fa3400663a0 0x7fa340068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:19.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.834+0000 7fa3537fe640 1 --2- 172.21.15.5:0/4247165344 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fa3400663a0 0x7fa340068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa35414e310 tx=0x7fa348009040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:19.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.834+0000 7fa350ff9640 1 -- 172.21.15.5:0/4247165344 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa344051320 con 0x7fa3540c8ad0 2023-07-14T13:12:20.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.994+0000 7fa35a9fa640 1 -- 172.21.15.5:0/4247165344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3541590b0 con 0x7fa3540c8ad0 2023-07-14T13:12:20.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.994+0000 7fa350ff9640 1 -- 172.21.15.5:0/4247165344 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+14645 (secure 0 0 0) 0x7fa344054940 con 0x7fa3540c8ad0 2023-07-14T13:12:20.030 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:20.030 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":138,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:12:19.239467+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:12:20.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.998+0000 7fa35a9fa640 1 -- 172.21.15.5:0/4247165344 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fa3400663a0 msgr2=0x7fa340068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:20.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.998+0000 7fa35a9fa640 1 --2- 172.21.15.5:0/4247165344 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fa3400663a0 0x7fa340068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa35414e310 tx=0x7fa348009040 comp rx=0 tx=0).stop 2023-07-14T13:12:20.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.998+0000 7fa35a9fa640 1 -- 172.21.15.5:0/4247165344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3540c8ad0 msgr2=0x7fa35414e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:20.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.998+0000 7fa35a9fa640 1 --2- 172.21.15.5:0/4247165344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3540c8ad0 0x7fa35414e820 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fa34400e870 tx=0x7fa34400ec70 comp rx=0 tx=0).stop 2023-07-14T13:12:20.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.998+0000 7fa35a9fa640 1 -- 172.21.15.5:0/4247165344 shutdown_connections 2023-07-14T13:12:20.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.998+0000 7fa35a9fa640 1 --2- 172.21.15.5:0/4247165344 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fa3400663a0 0x7fa340068850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.998+0000 7fa35a9fa640 1 --2- 172.21.15.5:0/4247165344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa354158ce0 0x7fa35414ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.998+0000 7fa35a9fa640 1 --2- 172.21.15.5:0/4247165344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3540c9730 0x7fa3540c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.998+0000 7fa35a9fa640 1 --2- 172.21.15.5:0/4247165344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3540c8ad0 0x7fa35414e820 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.998+0000 7fa35a9fa640 1 -- 172.21.15.5:0/4247165344 >> 172.21.15.5:0/4247165344 conn(0x7fa3540afcf0 msgr2=0x7fa35406be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:20.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.998+0000 7fa35a9fa640 1 -- 172.21.15.5:0/4247165344 shutdown_connections 2023-07-14T13:12:20.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:19.998+0000 7fa35a9fa640 1 -- 172.21.15.5:0/4247165344 wait complete. 2023-07-14T13:12:20.051 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:12:20.052 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:12:20.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.162+0000 7f2e21a6d640 1 Processor -- start 2023-07-14T13:12:20.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.162+0000 7f2e21a6d640 1 -- start start 2023-07-14T13:12:20.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.166+0000 7f2e21a6d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e1c15cef0 0x7f2e1c158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:20.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.166+0000 7f2e21a6d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2e1c159270 0x7f2e1c0c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:20.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.166+0000 7f2e21a6d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1c1532b0 con 0x7f2e1c0aeb40 2023-07-14T13:12:20.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.166+0000 7f2e21a6d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e1c15d360 con 0x7f2e1c15cef0 2023-07-14T13:12:20.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.166+0000 7f2e21a6d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e1c0ca6f0 con 0x7f2e1c159270 2023-07-14T13:12:20.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.166+0000 7f2e1affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e1c15cef0 0x7f2e1c158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:20.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.166+0000 7f2e1affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e1c15cef0 0x7f2e1c158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59758/0 (socket says 172.21.15.5:59758) 2023-07-14T13:12:20.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.166+0000 7f2e1affd640 1 -- 172.21.15.5:0/2157169031 learned_addr learned my addr 172.21.15.5:0/2157169031 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:20.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.166+0000 7f2e1affd640 1 -- 172.21.15.5:0/2157169031 >> v2:172.21.15.154:3300/0 conn(0x7f2e1c159270 msgr2=0x7f2e1c0c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:20.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.166+0000 7f2e1bfff640 1 --2- 172.21.15.5:0/2157169031 >> v2:172.21.15.154:3300/0 conn(0x7f2e1c159270 0x7f2e1c0c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:20.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.166+0000 7f2e1affd640 1 --2- 172.21.15.5:0/2157169031 >> v2:172.21.15.154:3300/0 conn(0x7f2e1c159270 0x7f2e1c0c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.166+0000 7f2e1affd640 1 -- 172.21.15.5:0/2157169031 >> v1:172.21.15.5:6789/0 conn(0x7f2e1c0aeb40 legacy=0x7f2e1c0aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:20.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.166+0000 7f2e1a7fc640 1 -- 172.21.15.5:0/2157169031 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3941260380 0 0) 0x7f2e1c1532b0 con 0x7f2e1c0aeb40 2023-07-14T13:12:20.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.166+0000 7f2e1affd640 1 -- 172.21.15.5:0/2157169031 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1c1599d0 con 0x7f2e1c15cef0 2023-07-14T13:12:20.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.166+0000 7f2e1bfff640 1 --2- 172.21.15.5:0/2157169031 >> v2:172.21.15.154:3300/0 conn(0x7f2e1c159270 0x7f2e1c0c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:12:20.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.170+0000 7f2e1affd640 1 --2- 172.21.15.5:0/2157169031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1c15cef0 0x7f2e1c158d30 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c0c8690 tx=0x7f2e1001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc371148d5c6cc7a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:20.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.170+0000 7f2e1a7fc640 1 -- 172.21.15.5:0/2157169031 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e100aa430 con 0x7f2e1c15cef0 2023-07-14T13:12:20.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.170+0000 7f2e1a7fc640 1 -- 172.21.15.5:0/2157169031 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e100aa590 con 0x7f2e1c15cef0 2023-07-14T13:12:20.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.170+0000 7f2e1a7fc640 1 -- 172.21.15.5:0/2157169031 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e100aa920 con 0x7f2e1c15cef0 2023-07-14T13:12:20.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.170+0000 7f2e21a6d640 1 -- 172.21.15.5:0/2157169031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1c15cef0 msgr2=0x7f2e1c158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:20.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.170+0000 7f2e21a6d640 1 --2- 172.21.15.5:0/2157169031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1c15cef0 0x7f2e1c158d30 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c0c8690 tx=0x7f2e1001c4d0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.170+0000 7f2e21a6d640 1 -- 172.21.15.5:0/2157169031 shutdown_connections 2023-07-14T13:12:20.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.170+0000 7f2e21a6d640 1 --2- 172.21.15.5:0/2157169031 >> v2:172.21.15.154:3300/0 conn(0x7f2e1c159270 0x7f2e1c0c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.170+0000 7f2e21a6d640 1 --2- 172.21.15.5:0/2157169031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1c15cef0 0x7f2e1c158d30 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.170+0000 7f2e21a6d640 1 -- 172.21.15.5:0/2157169031 >> 172.21.15.5:0/2157169031 conn(0x7f2e1c0cde90 msgr2=0x7f2e1c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:20.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.170+0000 7f2e21a6d640 1 -- 172.21.15.5:0/2157169031 shutdown_connections 2023-07-14T13:12:20.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.170+0000 7f2e21a6d640 1 -- 172.21.15.5:0/2157169031 wait complete. 2023-07-14T13:12:20.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.170+0000 7f2e21a6d640 1 Processor -- start 2023-07-14T13:12:20.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.170+0000 7f2e21a6d640 1 -- start start 2023-07-14T13:12:20.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.174+0000 7f2e21a6d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e1c0aeb40 0x7f2e1c157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:20.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.174+0000 7f2e21a6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1c159270 0x7f2e1c145040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:20.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.174+0000 7f2e21a6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e1c15cef0 0x7f2e1c06f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:20.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.174+0000 7f2e21a6d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c14ee50 con 0x7f2e1c159270 2023-07-14T13:12:20.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.174+0000 7f2e21a6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c156e10 con 0x7f2e1c15cef0 2023-07-14T13:12:20.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.174+0000 7f2e21a6d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c145580 con 0x7f2e1c0aeb40 2023-07-14T13:12:20.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.174+0000 7f2e1affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1c159270 0x7f2e1c145040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:20.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.174+0000 7f2e1affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1c159270 0x7f2e1c145040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59764/0 (socket says 172.21.15.5:59764) 2023-07-14T13:12:20.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.174+0000 7f2e1affd640 1 -- 172.21.15.5:0/304619267 learned_addr learned my addr 172.21.15.5:0/304619267 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:20.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.174+0000 7f2e1bfff640 1 --2- 172.21.15.5:0/304619267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e1c15cef0 0x7f2e1c06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:20.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.174+0000 7f2e1b7fe640 1 --2- 172.21.15.5:0/304619267 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e1c0aeb40 0x7f2e1c157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:20.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.174+0000 7f2e1affd640 1 -- 172.21.15.5:0/304619267 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e1c0aeb40 msgr2=0x7f2e1c157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:20.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.174+0000 7f2e1affd640 1 --2- 172.21.15.5:0/304619267 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e1c0aeb40 0x7f2e1c157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.174+0000 7f2e1affd640 1 -- 172.21.15.5:0/304619267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e1c15cef0 msgr2=0x7f2e1c06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:20.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.174+0000 7f2e1affd640 1 --2- 172.21.15.5:0/304619267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e1c15cef0 0x7f2e1c06f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.174+0000 7f2e1affd640 1 -- 172.21.15.5:0/304619267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e100094d0 con 0x7f2e1c159270 2023-07-14T13:12:20.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.174+0000 7f2e1affd640 1 --2- 172.21.15.5:0/304619267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1c159270 0x7f2e1c145040 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f2e100190e0 tx=0x7f2e1001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:20.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.174+0000 7f2e03fff640 1 -- 172.21.15.5:0/304619267 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e100b3800 con 0x7f2e1c159270 2023-07-14T13:12:20.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.174+0000 7f2e03fff640 1 -- 172.21.15.5:0/304619267 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e100b3960 con 0x7f2e1c159270 2023-07-14T13:12:20.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.174+0000 7f2e03fff640 1 -- 172.21.15.5:0/304619267 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e100b3cf0 con 0x7f2e1c159270 2023-07-14T13:12:20.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.174+0000 7f2e21a6d640 1 -- 172.21.15.5:0/304619267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e1c1570b0 con 0x7f2e1c159270 2023-07-14T13:12:20.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.174+0000 7f2e21a6d640 1 -- 172.21.15.5:0/304619267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e1c157670 con 0x7f2e1c159270 2023-07-14T13:12:20.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.174+0000 7f2e21a6d640 1 -- 172.21.15.5:0/304619267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e1c0678d0 con 0x7f2e1c159270 2023-07-14T13:12:20.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.174+0000 7f2e03fff640 1 -- 172.21.15.5:0/304619267 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2e1c0c9610 con 0x7f2e1c159270 2023-07-14T13:12:20.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.178+0000 7f2e03fff640 1 --2- 172.21.15.5:0/304619267 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f2e080663a0 0x7f2e08068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:20.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.178+0000 7f2e03fff640 1 -- 172.21.15.5:0/304619267 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f2e1011dd20 con 0x7f2e1c159270 2023-07-14T13:12:20.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.178+0000 7f2e1b7fe640 1 --2- 172.21.15.5:0/304619267 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f2e080663a0 0x7f2e08068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:20.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.178+0000 7f2e1b7fe640 1 --2- 172.21.15.5:0/304619267 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f2e080663a0 0x7f2e08068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c000f70 tx=0x7f2e0c009040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:20.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.182+0000 7f2e03fff640 1 -- 172.21.15.5:0/304619267 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2e100eb350 con 0x7f2e1c159270 2023-07-14T13:12:20.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.338+0000 7f2e21a6d640 1 -- 172.21.15.5:0/304619267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2e1c0c2ee0 con 0x7f2e1c159270 2023-07-14T13:12:20.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.338+0000 7f2e03fff640 1 -- 172.21.15.5:0/304619267 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v138) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2e100c3020 con 0x7f2e1c159270 2023-07-14T13:12:20.372 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:12:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.338+0000 7f2e21a6d640 1 -- 172.21.15.5:0/304619267 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f2e080663a0 msgr2=0x7f2e08068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:20.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.338+0000 7f2e21a6d640 1 --2- 172.21.15.5:0/304619267 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f2e080663a0 0x7f2e08068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c000f70 tx=0x7f2e0c009040 comp rx=0 tx=0).stop 2023-07-14T13:12:20.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.338+0000 7f2e21a6d640 1 -- 172.21.15.5:0/304619267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1c159270 msgr2=0x7f2e1c145040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:20.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.338+0000 7f2e21a6d640 1 --2- 172.21.15.5:0/304619267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1c159270 0x7f2e1c145040 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f2e100190e0 tx=0x7f2e1001ad10 comp rx=0 tx=0).stop 2023-07-14T13:12:20.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.338+0000 7f2e21a6d640 1 -- 172.21.15.5:0/304619267 shutdown_connections 2023-07-14T13:12:20.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.338+0000 7f2e21a6d640 1 --2- 172.21.15.5:0/304619267 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f2e080663a0 0x7f2e08068850 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.338+0000 7f2e21a6d640 1 --2- 172.21.15.5:0/304619267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e1c15cef0 0x7f2e1c06f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.338+0000 7f2e21a6d640 1 --2- 172.21.15.5:0/304619267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e1c159270 0x7f2e1c145040 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.338+0000 7f2e21a6d640 1 --2- 172.21.15.5:0/304619267 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e1c0aeb40 0x7f2e1c157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.338+0000 7f2e21a6d640 1 -- 172.21.15.5:0/304619267 >> 172.21.15.5:0/304619267 conn(0x7f2e1c0cde90 msgr2=0x7f2e1c0c3990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:20.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.338+0000 7f2e21a6d640 1 -- 172.21.15.5:0/304619267 shutdown_connections 2023-07-14T13:12:20.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.338+0000 7f2e21a6d640 1 -- 172.21.15.5:0/304619267 wait complete. 2023-07-14T13:12:20.393 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:12:20.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.506+0000 7fb1b0f37640 1 Processor -- start 2023-07-14T13:12:20.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.506+0000 7fb1b0f37640 1 -- start start 2023-07-14T13:12:20.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.506+0000 7fb1b0f37640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb1ac069430 0x7fb1ac0cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:20.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.506+0000 7fb1b0f37640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb1ac160030 0x7fb1ac069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:20.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.506+0000 7fb1b0f37640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac069d40 con 0x7fb1ac070330 2023-07-14T13:12:20.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.506+0000 7fb1b0f37640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1ac0cb7d0 con 0x7fb1ac069430 2023-07-14T13:12:20.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.506+0000 7fb1b0f37640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1ac06c510 con 0x7fb1ac160030 2023-07-14T13:12:20.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.506+0000 7fb1aa59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb1ac069430 0x7fb1ac0cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:20.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.506+0000 7fb1aa59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb1ac069430 0x7fb1ac0cb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59774/0 (socket says 172.21.15.5:59774) 2023-07-14T13:12:20.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.506+0000 7fb1aa59c640 1 -- 172.21.15.5:0/1950035642 learned_addr learned my addr 172.21.15.5:0/1950035642 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:20.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.506+0000 7fb1a9d9b640 1 --2- 172.21.15.5:0/1950035642 >> v2:172.21.15.154:3300/0 conn(0x7fb1ac160030 0x7fb1ac069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:20.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.506+0000 7fb1aa59c640 1 -- 172.21.15.5:0/1950035642 >> v2:172.21.15.154:3300/0 conn(0x7fb1ac160030 msgr2=0x7fb1ac069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:20.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.506+0000 7fb1aa59c640 1 --2- 172.21.15.5:0/1950035642 >> v2:172.21.15.154:3300/0 conn(0x7fb1ac160030 0x7fb1ac069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.506+0000 7fb1aa59c640 1 -- 172.21.15.5:0/1950035642 >> v1:172.21.15.5:6789/0 conn(0x7fb1ac070330 legacy=0x7fb1ac070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:20.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.506+0000 7fb1aa59c640 1 -- 172.21.15.5:0/1950035642 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac06c7f0 con 0x7fb1ac069430 2023-07-14T13:12:20.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.510+0000 7fb1aa59c640 1 --2- 172.21.15.5:0/1950035642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1ac069430 0x7fb1ac0cb0f0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac065f00 tx=0x7fb19c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c9c6d1f712a062 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:20.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.510+0000 7fb1a959a640 1 -- 172.21.15.5:0/1950035642 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c0ab640 con 0x7fb1ac069430 2023-07-14T13:12:20.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.510+0000 7fb1a959a640 1 -- 172.21.15.5:0/1950035642 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19c0a7070 con 0x7fb1ac069430 2023-07-14T13:12:20.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.510+0000 7fb1a959a640 1 -- 172.21.15.5:0/1950035642 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c0ab9c0 con 0x7fb1ac069430 2023-07-14T13:12:20.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.510+0000 7fb1b0f37640 1 -- 172.21.15.5:0/1950035642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1ac069430 msgr2=0x7fb1ac0cb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:20.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.510+0000 7fb1b0f37640 1 --2- 172.21.15.5:0/1950035642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1ac069430 0x7fb1ac0cb0f0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac065f00 tx=0x7fb19c01c440 comp rx=0 tx=0).stop 2023-07-14T13:12:20.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.510+0000 7fb1b0f37640 1 -- 172.21.15.5:0/1950035642 shutdown_connections 2023-07-14T13:12:20.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.510+0000 7fb1b0f37640 1 --2- 172.21.15.5:0/1950035642 >> v2:172.21.15.154:3300/0 conn(0x7fb1ac160030 0x7fb1ac069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.510+0000 7fb1b0f37640 1 --2- 172.21.15.5:0/1950035642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1ac069430 0x7fb1ac0cb0f0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.510+0000 7fb1b0f37640 1 -- 172.21.15.5:0/1950035642 >> 172.21.15.5:0/1950035642 conn(0x7fb1ac0b1840 msgr2=0x7fb1ac0cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:20.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.510+0000 7fb1b0f37640 1 -- 172.21.15.5:0/1950035642 shutdown_connections 2023-07-14T13:12:20.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.510+0000 7fb1b0f37640 1 -- 172.21.15.5:0/1950035642 wait complete. 2023-07-14T13:12:20.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.514+0000 7fb1b0f37640 1 Processor -- start 2023-07-14T13:12:20.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.514+0000 7fb1b0f37640 1 -- start start 2023-07-14T13:12:20.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.514+0000 7fb1b0f37640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1ac069430 0x7fb1ac0b0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:20.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.514+0000 7fb1b0f37640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac070330 0x7fb1ac06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:20.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.514+0000 7fb1b0f37640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1ac160030 0x7fb1ac06d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:20.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.514+0000 7fb1b0f37640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac15cf40 con 0x7fb1ac160030 2023-07-14T13:12:20.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.514+0000 7fb1b0f37640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac15bea0 con 0x7fb1ac070330 2023-07-14T13:12:20.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.514+0000 7fb1b0f37640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac15c180 con 0x7fb1ac069430 2023-07-14T13:12:20.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.514+0000 7fb1aad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1ac160030 0x7fb1ac06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:20.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.514+0000 7fb1aad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1ac160030 0x7fb1ac06d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59782/0 (socket says 172.21.15.5:59782) 2023-07-14T13:12:20.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.514+0000 7fb1aad9d640 1 -- 172.21.15.5:0/2788276668 learned_addr learned my addr 172.21.15.5:0/2788276668 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:20.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.514+0000 7fb1aa59c640 1 --2- 172.21.15.5:0/2788276668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1ac069430 0x7fb1ac0b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:20.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.514+0000 7fb1a9d9b640 1 --2- 172.21.15.5:0/2788276668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac070330 0x7fb1ac06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:20.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.514+0000 7fb1aad9d640 1 -- 172.21.15.5:0/2788276668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1ac069430 msgr2=0x7fb1ac0b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:20.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.514+0000 7fb1aad9d640 1 --2- 172.21.15.5:0/2788276668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1ac069430 0x7fb1ac0b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.514+0000 7fb1aad9d640 1 -- 172.21.15.5:0/2788276668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac070330 msgr2=0x7fb1ac06d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:20.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.514+0000 7fb1aad9d640 1 --2- 172.21.15.5:0/2788276668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac070330 0x7fb1ac06d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.514+0000 7fb1aad9d640 1 -- 172.21.15.5:0/2788276668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c0094d0 con 0x7fb1ac160030 2023-07-14T13:12:20.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.514+0000 7fb1aad9d640 1 --2- 172.21.15.5:0/2788276668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1ac160030 0x7fb1ac06d710 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fb1a400c730 tx=0x7fb1a400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:20.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.514+0000 7fb19affd640 1 -- 172.21.15.5:0/2788276668 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4003b80 con 0x7fb1ac160030 2023-07-14T13:12:20.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.514+0000 7fb19affd640 1 -- 172.21.15.5:0/2788276668 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a4003ce0 con 0x7fb1ac160030 2023-07-14T13:12:20.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.514+0000 7fb19affd640 1 -- 172.21.15.5:0/2788276668 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a400aa30 con 0x7fb1ac160030 2023-07-14T13:12:20.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.514+0000 7fb1b0f37640 1 -- 172.21.15.5:0/2788276668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ac1605b0 con 0x7fb1ac160030 2023-07-14T13:12:20.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.514+0000 7fb1b0f37640 1 -- 172.21.15.5:0/2788276668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ac15c740 con 0x7fb1ac160030 2023-07-14T13:12:20.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.518+0000 7fb1b0f37640 1 -- 172.21.15.5:0/2788276668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1ac0678d0 con 0x7fb1ac160030 2023-07-14T13:12:20.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.518+0000 7fb19affd640 1 -- 172.21.15.5:0/2788276668 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb1a400ab90 con 0x7fb1ac160030 2023-07-14T13:12:20.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.518+0000 7fb19affd640 1 --2- 172.21.15.5:0/2788276668 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fb18c0663a0 0x7fb18c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:20.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.518+0000 7fb19affd640 1 -- 172.21.15.5:0/2788276668 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5238+0+0 (secure 0 0 0) 0x7fb1a4083820 con 0x7fb1ac160030 2023-07-14T13:12:20.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.518+0000 7fb1aa59c640 1 --2- 172.21.15.5:0/2788276668 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fb18c0663a0 0x7fb18c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:20.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.518+0000 7fb1aa59c640 1 --2- 172.21.15.5:0/2788276668 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fb18c0663a0 0x7fb18c068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb19c0af000 tx=0x7fb19c0b6040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:20.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.522+0000 7fb19affd640 1 -- 172.21.15.5:0/2788276668 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb1a4050f60 con 0x7fb1ac160030 2023-07-14T13:12:20.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.678+0000 7fb1b0f37640 1 -- 172.21.15.5:0/2788276668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb1ac0ccbe0 con 0x7fb1ac160030 2023-07-14T13:12:20.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.678+0000 7fb19affd640 1 -- 172.21.15.5:0/2788276668 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v138) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb1a4054580 con 0x7fb1ac160030 2023-07-14T13:12:20.715 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:12:20.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.682+0000 7fb1b0f37640 1 -- 172.21.15.5:0/2788276668 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fb18c0663a0 msgr2=0x7fb18c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:20.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.682+0000 7fb1b0f37640 1 --2- 172.21.15.5:0/2788276668 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fb18c0663a0 0x7fb18c068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb19c0af000 tx=0x7fb19c0b6040 comp rx=0 tx=0).stop 2023-07-14T13:12:20.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.682+0000 7fb1b0f37640 1 -- 172.21.15.5:0/2788276668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1ac160030 msgr2=0x7fb1ac06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:20.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.682+0000 7fb1b0f37640 1 --2- 172.21.15.5:0/2788276668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1ac160030 0x7fb1ac06d710 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fb1a400c730 tx=0x7fb1a400cbf0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.682+0000 7fb1b0f37640 1 -- 172.21.15.5:0/2788276668 shutdown_connections 2023-07-14T13:12:20.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.682+0000 7fb1b0f37640 1 --2- 172.21.15.5:0/2788276668 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fb18c0663a0 0x7fb18c068850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.682+0000 7fb1b0f37640 1 --2- 172.21.15.5:0/2788276668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1ac160030 0x7fb1ac06d710 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.682+0000 7fb1b0f37640 1 --2- 172.21.15.5:0/2788276668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1ac070330 0x7fb1ac06d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.682+0000 7fb1b0f37640 1 --2- 172.21.15.5:0/2788276668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1ac069430 0x7fb1ac0b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.682+0000 7fb1b0f37640 1 -- 172.21.15.5:0/2788276668 >> 172.21.15.5:0/2788276668 conn(0x7fb1ac0b1840 msgr2=0x7fb1ac0ccf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:20.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.682+0000 7fb1b0f37640 1 -- 172.21.15.5:0/2788276668 shutdown_connections 2023-07-14T13:12:20.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.682+0000 7fb1b0f37640 1 -- 172.21.15.5:0/2788276668 wait complete. 2023-07-14T13:12:20.736 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-14T13:12:20.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.854+0000 7fcbe23fa640 1 Processor -- start 2023-07-14T13:12:20.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.854+0000 7fcbe23fa640 1 -- start start 2023-07-14T13:12:20.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.858+0000 7fcbe23fa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcbdc0b7990 0x7fcbdc0d0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:20.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.858+0000 7fcbe23fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbdc0d1840 0x7fcbdc0d1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:20.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.858+0000 7fcbe23fa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbdc0b4840 con 0x7fcbdc0d12f0 2023-07-14T13:12:20.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.858+0000 7fcbe23fa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbdc0cd060 con 0x7fcbdc0b7990 2023-07-14T13:12:20.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.858+0000 7fcbe23fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc0d1180 con 0x7fcbdc0d1840 2023-07-14T13:12:20.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.858+0000 7fcbdb7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcbdc0d12f0 0x7fcbdc15f640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57666/0 (socket says 172.21.15.5:57666) 2023-07-14T13:12:20.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.858+0000 7fcbdb7fe640 1 -- 172.21.15.5:0/2728617329 learned_addr learned my addr 172.21.15.5:0/2728617329 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:20.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.858+0000 7fcbdbfff640 1 --2- 172.21.15.5:0/2728617329 >> v2:172.21.15.154:3300/0 conn(0x7fcbdc0b7990 0x7fcbdc0d0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:20.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.858+0000 7fcbe0997640 1 --2- 172.21.15.5:0/2728617329 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbdc0d1840 0x7fcbdc0d1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:20.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.858+0000 7fcbdaffd640 1 -- 172.21.15.5:0/2728617329 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2306918268 0 0) 0x7fcbdc0b4840 con 0x7fcbdc0d12f0 2023-07-14T13:12:20.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.858+0000 7fcbdaffd640 1 -- 172.21.15.5:0/2728617329 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbc4003530 con 0x7fcbdc0d12f0 2023-07-14T13:12:20.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.858+0000 7fcbdbfff640 1 -- 172.21.15.5:0/2728617329 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbdc0d1840 msgr2=0x7fcbdc0d1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:20.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.858+0000 7fcbdbfff640 1 --2- 172.21.15.5:0/2728617329 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbdc0d1840 0x7fcbdc0d1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.858+0000 7fcbdbfff640 1 -- 172.21.15.5:0/2728617329 >> v1:172.21.15.5:6789/0 conn(0x7fcbdc0d12f0 legacy=0x7fcbdc15f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:20.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.858+0000 7fcbdbfff640 1 -- 172.21.15.5:0/2728617329 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc0ccae0 con 0x7fcbdc0b7990 2023-07-14T13:12:20.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.862+0000 7fcbdbfff640 1 --2- 172.21.15.5:0/2728617329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbdc0b7990 0x7fcbdc0d0c40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc0097c0 tx=0x7fcbcc01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d879098382de790c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:20.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.862+0000 7fcbdaffd640 1 -- 172.21.15.5:0/2728617329 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc0ab600 con 0x7fcbdc0b7990 2023-07-14T13:12:20.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.862+0000 7fcbdaffd640 1 -- 172.21.15.5:0/2728617329 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbcc0a7050 con 0x7fcbdc0b7990 2023-07-14T13:12:20.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.862+0000 7fcbdaffd640 1 -- 172.21.15.5:0/2728617329 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc0ab980 con 0x7fcbdc0b7990 2023-07-14T13:12:20.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.862+0000 7fcbe23fa640 1 -- 172.21.15.5:0/2728617329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbdc0b7990 msgr2=0x7fcbdc0d0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:20.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.862+0000 7fcbe23fa640 1 --2- 172.21.15.5:0/2728617329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbdc0b7990 0x7fcbdc0d0c40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc0097c0 tx=0x7fcbcc01c3f0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.862+0000 7fcbe23fa640 1 -- 172.21.15.5:0/2728617329 shutdown_connections 2023-07-14T13:12:20.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.862+0000 7fcbe23fa640 1 --2- 172.21.15.5:0/2728617329 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbdc0d1840 0x7fcbdc0d1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.862+0000 7fcbe23fa640 1 --2- 172.21.15.5:0/2728617329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbdc0b7990 0x7fcbdc0d0c40 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.862+0000 7fcbe23fa640 1 -- 172.21.15.5:0/2728617329 >> 172.21.15.5:0/2728617329 conn(0x7fcbdc0650b0 msgr2=0x7fcbdc0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:20.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.862+0000 7fcbe23fa640 1 -- 172.21.15.5:0/2728617329 shutdown_connections 2023-07-14T13:12:20.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.862+0000 7fcbe23fa640 1 -- 172.21.15.5:0/2728617329 wait complete. 2023-07-14T13:12:20.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.862+0000 7fcbe23fa640 1 Processor -- start 2023-07-14T13:12:20.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.866+0000 7fcbe23fa640 1 -- start start 2023-07-14T13:12:20.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.866+0000 7fcbe23fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbdc0b7990 0x7fcbdc0b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:20.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.866+0000 7fcbe23fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbdc0d12f0 0x7fcbdc0b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:20.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.866+0000 7fcbe23fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbdc0d1840 0x7fcbdc152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:20.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.866+0000 7fcbe23fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc15c770 con 0x7fcbdc0d1840 2023-07-14T13:12:20.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.866+0000 7fcbe23fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc15c0f0 con 0x7fcbdc0b7990 2023-07-14T13:12:20.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.866+0000 7fcbe23fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc15eaa0 con 0x7fcbdc0d12f0 2023-07-14T13:12:20.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.866+0000 7fcbe0997640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbdc0d1840 0x7fcbdc152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:20.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.866+0000 7fcbe0997640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbdc0d1840 0x7fcbdc152e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59792/0 (socket says 172.21.15.5:59792) 2023-07-14T13:12:20.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.866+0000 7fcbe0997640 1 -- 172.21.15.5:0/961045054 learned_addr learned my addr 172.21.15.5:0/961045054 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:20.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.866+0000 7fcbdbfff640 1 --2- 172.21.15.5:0/961045054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbdc0b7990 0x7fcbdc0b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:20.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.866+0000 7fcbdb7fe640 1 --2- 172.21.15.5:0/961045054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbdc0d12f0 0x7fcbdc0b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:20.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.866+0000 7fcbe0997640 1 -- 172.21.15.5:0/961045054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbdc0d12f0 msgr2=0x7fcbdc0b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:20.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.866+0000 7fcbe0997640 1 --2- 172.21.15.5:0/961045054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbdc0d12f0 0x7fcbdc0b1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.866+0000 7fcbe0997640 1 -- 172.21.15.5:0/961045054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbdc0b7990 msgr2=0x7fcbdc0b69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:20.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.866+0000 7fcbe0997640 1 --2- 172.21.15.5:0/961045054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbdc0b7990 0x7fcbdc0b69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:20.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.866+0000 7fcbe0997640 1 -- 172.21.15.5:0/961045054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbcc009420 con 0x7fcbdc0d1840 2023-07-14T13:12:20.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.866+0000 7fcbe0997640 1 --2- 172.21.15.5:0/961045054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbdc0d1840 0x7fcbdc152e00 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400efc0 tx=0x7fcbd400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:20.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.866+0000 7fcbd8ff9640 1 -- 172.21.15.5:0/961045054 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4014480 con 0x7fcbdc0d1840 2023-07-14T13:12:20.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.866+0000 7fcbd8ff9640 1 -- 172.21.15.5:0/961045054 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd400f040 con 0x7fcbdc0d1840 2023-07-14T13:12:20.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.866+0000 7fcbd8ff9640 1 -- 172.21.15.5:0/961045054 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4014820 con 0x7fcbdc0d1840 2023-07-14T13:12:20.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.866+0000 7fcbe23fa640 1 -- 172.21.15.5:0/961045054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbdc0b7ee0 con 0x7fcbdc0d1840 2023-07-14T13:12:20.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.866+0000 7fcbe23fa640 1 -- 172.21.15.5:0/961045054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbdc15c390 con 0x7fcbdc0d1840 2023-07-14T13:12:20.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.866+0000 7fcbe23fa640 1 -- 172.21.15.5:0/961045054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbdc15c8b0 con 0x7fcbdc0d1840 2023-07-14T13:12:20.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.870+0000 7fcbd8ff9640 1 -- 172.21.15.5:0/961045054 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcbd4014980 con 0x7fcbdc0d1840 2023-07-14T13:12:20.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.870+0000 7fcbd8ff9640 1 --2- 172.21.15.5:0/961045054 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fcbc80663d0 0x7fcbc8068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:20.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.870+0000 7fcbd8ff9640 1 -- 172.21.15.5:0/961045054 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5238+0+0 (secure 0 0 0) 0x7fcbd4084700 con 0x7fcbdc0d1840 2023-07-14T13:12:20.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.870+0000 7fcbdbfff640 1 --2- 172.21.15.5:0/961045054 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fcbc80663d0 0x7fcbc8068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:20.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.870+0000 7fcbdbfff640 1 --2- 172.21.15.5:0/961045054 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fcbc80663d0 0x7fcbc8068880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc0ad000 tx=0x7fcbcc008040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:20.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:20.878+0000 7fcbd8ff9640 1 -- 172.21.15.5:0/961045054 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fcbdc15c8b0 con 0x7fcbdc0d1840 2023-07-14T13:12:21.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.038+0000 7fcbe23fa640 1 -- 172.21.15.5:0/961045054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fcbdc15c8b0 con 0x7fcbdc0d1840 2023-07-14T13:12:21.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.038+0000 7fcbd8ff9640 1 -- 172.21.15.5:0/961045054 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v138) v1 ==== 84+0+126 (secure 0 0 0) 0x7fcbd4018090 con 0x7fcbdc0d1840 2023-07-14T13:12:21.073 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:21.073 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-07-14T13:12:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-07-14T13:12:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-07-14T13:12:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 2, 2023-07-14T13:12:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": "rbd" 2023-07-14T13:12:21.075 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:21.075 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-07-14T13:12:21.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.042+0000 7fcbe23fa640 1 -- 172.21.15.5:0/961045054 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fcbc80663d0 msgr2=0x7fcbc8068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:21.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.042+0000 7fcbe23fa640 1 --2- 172.21.15.5:0/961045054 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fcbc80663d0 0x7fcbc8068880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc0ad000 tx=0x7fcbcc008040 comp rx=0 tx=0).stop 2023-07-14T13:12:21.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.042+0000 7fcbe23fa640 1 -- 172.21.15.5:0/961045054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbdc0d1840 msgr2=0x7fcbdc152e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:21.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.042+0000 7fcbe23fa640 1 --2- 172.21.15.5:0/961045054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbdc0d1840 0x7fcbdc152e00 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400efc0 tx=0x7fcbd400c490 comp rx=0 tx=0).stop 2023-07-14T13:12:21.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.042+0000 7fcbe23fa640 1 -- 172.21.15.5:0/961045054 shutdown_connections 2023-07-14T13:12:21.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.042+0000 7fcbe23fa640 1 --2- 172.21.15.5:0/961045054 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fcbc80663d0 0x7fcbc8068880 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.042+0000 7fcbe23fa640 1 --2- 172.21.15.5:0/961045054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcbdc0d1840 0x7fcbdc152e00 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.042+0000 7fcbe23fa640 1 --2- 172.21.15.5:0/961045054 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcbdc0d12f0 0x7fcbdc0b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.042+0000 7fcbe23fa640 1 --2- 172.21.15.5:0/961045054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcbdc0b7990 0x7fcbdc0b69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.042+0000 7fcbe23fa640 1 -- 172.21.15.5:0/961045054 >> 172.21.15.5:0/961045054 conn(0x7fcbdc0650b0 msgr2=0x7fcbdc065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:21.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.042+0000 7fcbe23fa640 1 -- 172.21.15.5:0/961045054 shutdown_connections 2023-07-14T13:12:21.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.042+0000 7fcbe23fa640 1 -- 172.21.15.5:0/961045054 wait complete. 2023-07-14T13:12:21.095 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-14T13:12:21.095 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-14T13:12:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.206+0000 7fd06c759640 1 Processor -- start 2023-07-14T13:12:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.206+0000 7fd06c759640 1 -- start start 2023-07-14T13:12:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.210+0000 7fd06c759640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd06415cef0 0x7fd064158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.210+0000 7fd06c759640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd064159270 0x7fd0640c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.210+0000 7fd06c759640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0641532b0 con 0x7fd0640aeb40 2023-07-14T13:12:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.210+0000 7fd06c759640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06415d360 con 0x7fd064159270 2023-07-14T13:12:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.210+0000 7fd06c759640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0640ca6f0 con 0x7fd06415cef0 2023-07-14T13:12:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.210+0000 7fd06acf6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd064159270 0x7fd0640c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.210+0000 7fd06acf6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd064159270 0x7fd0640c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59800/0 (socket says 172.21.15.5:59800) 2023-07-14T13:12:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.210+0000 7fd06acf6640 1 -- 172.21.15.5:0/2400492517 learned_addr learned my addr 172.21.15.5:0/2400492517 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:21.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.210+0000 7fd069cf4640 1 --2- 172.21.15.5:0/2400492517 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd06415cef0 0x7fd064158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:21.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.210+0000 7fd06acf6640 1 -- 172.21.15.5:0/2400492517 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd06415cef0 msgr2=0x7fd064158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:21.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.210+0000 7fd06acf6640 1 --2- 172.21.15.5:0/2400492517 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd06415cef0 0x7fd064158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.210+0000 7fd06acf6640 1 -- 172.21.15.5:0/2400492517 >> v1:172.21.15.5:6789/0 conn(0x7fd0640aeb40 legacy=0x7fd0640aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:21.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.210+0000 7fd06acf6640 1 -- 172.21.15.5:0/2400492517 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0641599d0 con 0x7fd064159270 2023-07-14T13:12:21.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.214+0000 7fd06acf6640 1 --2- 172.21.15.5:0/2400492517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd064159270 0x7fd0640c88c0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fd05c009e50 tx=0x7fd05c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8c57b707795e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:21.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.214+0000 7fd0694f3640 1 -- 172.21.15.5:0/2400492517 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c0a58a0 con 0x7fd064159270 2023-07-14T13:12:21.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.214+0000 7fd0694f3640 1 -- 172.21.15.5:0/2400492517 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c0a5a00 con 0x7fd064159270 2023-07-14T13:12:21.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.214+0000 7fd0694f3640 1 -- 172.21.15.5:0/2400492517 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c0a5d90 con 0x7fd064159270 2023-07-14T13:12:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.214+0000 7fd06c759640 1 -- 172.21.15.5:0/2400492517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd064159270 msgr2=0x7fd0640c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.214+0000 7fd06c759640 1 --2- 172.21.15.5:0/2400492517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd064159270 0x7fd0640c88c0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fd05c009e50 tx=0x7fd05c01c9e0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.214+0000 7fd06c759640 1 -- 172.21.15.5:0/2400492517 shutdown_connections 2023-07-14T13:12:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.214+0000 7fd06c759640 1 --2- 172.21.15.5:0/2400492517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd064159270 0x7fd0640c88c0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.214+0000 7fd06c759640 1 --2- 172.21.15.5:0/2400492517 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd06415cef0 0x7fd064158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.214+0000 7fd06c759640 1 -- 172.21.15.5:0/2400492517 >> 172.21.15.5:0/2400492517 conn(0x7fd0640cde90 msgr2=0x7fd0640ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:21.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.214+0000 7fd06c759640 1 -- 172.21.15.5:0/2400492517 shutdown_connections 2023-07-14T13:12:21.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.214+0000 7fd06c759640 1 -- 172.21.15.5:0/2400492517 wait complete. 2023-07-14T13:12:21.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.214+0000 7fd06c759640 1 Processor -- start 2023-07-14T13:12:21.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.214+0000 7fd06c759640 1 -- start start 2023-07-14T13:12:21.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.218+0000 7fd06c759640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0640aeb40 0x7fd064158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:21.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.218+0000 7fd06c759640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd064159270 0x7fd06413f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:21.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.218+0000 7fd06c759640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd06415cef0 0x7fd0641569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:21.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.218+0000 7fd06c759640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0641580e0 con 0x7fd064159270 2023-07-14T13:12:21.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.218+0000 7fd06c759640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06413fe90 con 0x7fd06415cef0 2023-07-14T13:12:21.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.218+0000 7fd06c759640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd064157460 con 0x7fd0640aeb40 2023-07-14T13:12:21.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.218+0000 7fd069cf4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd064159270 0x7fd06413f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:21.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.218+0000 7fd069cf4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd064159270 0x7fd06413f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59802/0 (socket says 172.21.15.5:59802) 2023-07-14T13:12:21.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.218+0000 7fd069cf4640 1 -- 172.21.15.5:0/3103788235 learned_addr learned my addr 172.21.15.5:0/3103788235 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:21.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.218+0000 7fd06a4f5640 1 --2- 172.21.15.5:0/3103788235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0640aeb40 0x7fd064158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:21.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.218+0000 7fd06acf6640 1 --2- 172.21.15.5:0/3103788235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd06415cef0 0x7fd0641569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:21.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.218+0000 7fd069cf4640 1 -- 172.21.15.5:0/3103788235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0640aeb40 msgr2=0x7fd064158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:21.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.218+0000 7fd069cf4640 1 --2- 172.21.15.5:0/3103788235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0640aeb40 0x7fd064158500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.218+0000 7fd069cf4640 1 -- 172.21.15.5:0/3103788235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd06415cef0 msgr2=0x7fd0641569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:21.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.218+0000 7fd069cf4640 1 --2- 172.21.15.5:0/3103788235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd06415cef0 0x7fd0641569a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.218+0000 7fd069cf4640 1 -- 172.21.15.5:0/3103788235 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd05c009b30 con 0x7fd064159270 2023-07-14T13:12:21.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.218+0000 7fd069cf4640 1 --2- 172.21.15.5:0/3103788235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd064159270 0x7fd06413f950 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fd05400e960 tx=0x7fd05400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:21.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.218+0000 7fd05affd640 1 -- 172.21.15.5:0/3103788235 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd054009690 con 0x7fd064159270 2023-07-14T13:12:21.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.218+0000 7fd05affd640 1 -- 172.21.15.5:0/3103788235 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05400ca00 con 0x7fd064159270 2023-07-14T13:12:21.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.218+0000 7fd05affd640 1 -- 172.21.15.5:0/3103788235 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05400cd70 con 0x7fd064159270 2023-07-14T13:12:21.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.218+0000 7fd06c759640 1 -- 172.21.15.5:0/3103788235 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd064157740 con 0x7fd064159270 2023-07-14T13:12:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.218+0000 7fd06c759640 1 -- 172.21.15.5:0/3103788235 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd064157d00 con 0x7fd064159270 2023-07-14T13:12:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.218+0000 7fd06c759640 1 -- 172.21.15.5:0/3103788235 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0640678d0 con 0x7fd064159270 2023-07-14T13:12:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.222+0000 7fd05affd640 1 -- 172.21.15.5:0/3103788235 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd054013470 con 0x7fd064159270 2023-07-14T13:12:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.222+0000 7fd05affd640 1 --2- 172.21.15.5:0/3103788235 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fd0480663a0 0x7fd048068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.222+0000 7fd05affd640 1 -- 172.21.15.5:0/3103788235 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5238+0+0 (secure 0 0 0) 0x7fd054083d00 con 0x7fd064159270 2023-07-14T13:12:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.222+0000 7fd06a4f5640 1 --2- 172.21.15.5:0/3103788235 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fd0480663a0 0x7fd048068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:21.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.222+0000 7fd06a4f5640 1 --2- 172.21.15.5:0/3103788235 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fd0480663a0 0x7fd048068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd060007fd0 tx=0x7fd060009040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:21.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.226+0000 7fd05affd640 1 -- 172.21.15.5:0/3103788235 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd054051440 con 0x7fd064159270 2023-07-14T13:12:21.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.382+0000 7fd06c759640 1 -- 172.21.15.5:0/3103788235 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd0640c2ee0 con 0x7fd064159270 2023-07-14T13:12:21.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.890+0000 7fd05affd640 1 -- 172.21.15.5:0/3103788235 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v139) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd0540170b0 con 0x7fd064159270 2023-07-14T13:12:21.926 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-07-14T13:12:21.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.894+0000 7fd06c759640 1 -- 172.21.15.5:0/3103788235 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fd0480663a0 msgr2=0x7fd048068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:21.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.894+0000 7fd06c759640 1 --2- 172.21.15.5:0/3103788235 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fd0480663a0 0x7fd048068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd060007fd0 tx=0x7fd060009040 comp rx=0 tx=0).stop 2023-07-14T13:12:21.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.894+0000 7fd06c759640 1 -- 172.21.15.5:0/3103788235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd064159270 msgr2=0x7fd06413f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:21.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.894+0000 7fd06c759640 1 --2- 172.21.15.5:0/3103788235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd064159270 0x7fd06413f950 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fd05400e960 tx=0x7fd05400ee20 comp rx=0 tx=0).stop 2023-07-14T13:12:21.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.894+0000 7fd06c759640 1 -- 172.21.15.5:0/3103788235 shutdown_connections 2023-07-14T13:12:21.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.894+0000 7fd06c759640 1 --2- 172.21.15.5:0/3103788235 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fd0480663a0 0x7fd048068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.894+0000 7fd06c759640 1 --2- 172.21.15.5:0/3103788235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd06415cef0 0x7fd0641569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.894+0000 7fd06c759640 1 --2- 172.21.15.5:0/3103788235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd064159270 0x7fd06413f950 secure :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fd05400e960 tx=0x7fd05400ee20 comp rx=0 tx=0).stop 2023-07-14T13:12:21.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.894+0000 7fd06c759640 1 --2- 172.21.15.5:0/3103788235 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0640aeb40 0x7fd064158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.894+0000 7fd06c759640 1 -- 172.21.15.5:0/3103788235 >> 172.21.15.5:0/3103788235 conn(0x7fd0640cde90 msgr2=0x7fd0640aef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:21.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.894+0000 7fd06c759640 1 -- 172.21.15.5:0/3103788235 shutdown_connections 2023-07-14T13:12:21.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:21.898+0000 7fd06c759640 1 -- 172.21.15.5:0/3103788235 wait complete. 2023-07-14T13:12:21.953 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-14T13:12:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.070+0000 7f1d8c0ca640 1 Processor -- start 2023-07-14T13:12:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.070+0000 7f1d8c0ca640 1 -- start start 2023-07-14T13:12:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.070+0000 7f1d8c0ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d8406cce0 0x7f1d840c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.070+0000 7f1d8c0ca640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d840cb9c0 con 0x7f1d840cb560 2023-07-14T13:12:22.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.070+0000 7f1d8c0ca640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d840c9730 con 0x7f1d841588f0 2023-07-14T13:12:22.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.070+0000 7f1d8c0ca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d840cc830 con 0x7f1d8406cce0 2023-07-14T13:12:22.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.070+0000 7f1d89665640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1d840cb560 0x7f1d8406c5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57686/0 (socket says 172.21.15.5:57686) 2023-07-14T13:12:22.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.070+0000 7f1d89665640 1 -- 172.21.15.5:0/295069623 learned_addr learned my addr 172.21.15.5:0/295069623 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.070+0000 7f1d8a667640 1 --2- 172.21.15.5:0/295069623 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d8406cce0 0x7f1d840c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.074+0000 7f1d88e64640 1 -- 172.21.15.5:0/295069623 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930864152 0 0) 0x7f1d840cb9c0 con 0x7f1d840cb560 2023-07-14T13:12:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.074+0000 7f1d88e64640 1 -- 172.21.15.5:0/295069623 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d70005740 con 0x7f1d840cb560 2023-07-14T13:12:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.074+0000 7f1d88e64640 1 -- 172.21.15.5:0/295069623 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2572355075 0 0) 0x7f1d840c9730 con 0x7f1d841588f0 2023-07-14T13:12:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.074+0000 7f1d88e64640 1 -- 172.21.15.5:0/295069623 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d840cb9c0 con 0x7f1d841588f0 2023-07-14T13:12:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.074+0000 7f1d88e64640 1 -- 172.21.15.5:0/295069623 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2670746150 0 0) 0x7f1d70005740 con 0x7f1d840cb560 2023-07-14T13:12:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.074+0000 7f1d88e64640 1 -- 172.21.15.5:0/295069623 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d8406cce0 msgr2=0x7f1d840c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.074+0000 7f1d88e64640 1 --2- 172.21.15.5:0/295069623 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d8406cce0 0x7f1d840c91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.074+0000 7f1d88e64640 1 -- 172.21.15.5:0/295069623 >> v1:172.21.15.154:6789/0 conn(0x7f1d841588f0 legacy=0x7f1d8406f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.074+0000 7f1d88e64640 1 -- 172.21.15.5:0/295069623 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d840cbf40 con 0x7f1d840cb560 2023-07-14T13:12:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.074+0000 7f1d88e64640 1 -- 172.21.15.5:0/295069623 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f1d74001680 con 0x7f1d840cb560 2023-07-14T13:12:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.074+0000 7f1d88e64640 1 -- 172.21.15.5:0/295069623 >> v1:172.21.15.5:6789/0 conn(0x7f1d840cb560 legacy=0x7f1d8406c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.074+0000 7f1d88e64640 1 --2- 172.21.15.5:0/295069623 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d8406cce0 0x7f1d70005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.074+0000 7f1d88e64640 1 --2- 172.21.15.5:0/295069623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d700062b0 0x7f1d700069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.074+0000 7f1d88e64640 1 --2- 172.21.15.5:0/295069623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d70006f20 0x7f1d70007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.074+0000 7f1d88e64640 1 -- 172.21.15.5:0/295069623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d840cc830 con 0x7f1d70006f20 2023-07-14T13:12:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.074+0000 7f1d88e64640 1 -- 172.21.15.5:0/295069623 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7000dc50 con 0x7f1d700062b0 2023-07-14T13:12:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.074+0000 7f1d88e64640 1 -- 172.21.15.5:0/295069623 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7000de10 con 0x7f1d8406cce0 2023-07-14T13:12:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.074+0000 7f1d8a667640 1 --2- 172.21.15.5:0/295069623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d70006f20 0x7f1d70007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.074+0000 7f1d89e66640 1 --2- 172.21.15.5:0/295069623 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d8406cce0 0x7f1d70005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.074+0000 7f1d89665640 1 --2- 172.21.15.5:0/295069623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d700062b0 0x7f1d700069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.074+0000 7f1d8a667640 1 -- 172.21.15.5:0/295069623 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d8406cce0 msgr2=0x7f1d70005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.074+0000 7f1d8a667640 1 --2- 172.21.15.5:0/295069623 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d8406cce0 0x7f1d70005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.074+0000 7f1d8a667640 1 -- 172.21.15.5:0/295069623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d700062b0 msgr2=0x7f1d700069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.074+0000 7f1d8a667640 1 --2- 172.21.15.5:0/295069623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d700062b0 0x7f1d700069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.074+0000 7f1d8a667640 1 -- 172.21.15.5:0/295069623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d70005740 con 0x7f1d70006f20 2023-07-14T13:12:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.078+0000 7f1d8a667640 1 --2- 172.21.15.5:0/295069623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d70006f20 0x7f1d70007390 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f1d840adb10 tx=0x7f1d7c01cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53afe8edb50c7b3d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.078+0000 7f1d88e64640 1 -- 172.21.15.5:0/295069623 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c0a5c10 con 0x7f1d70006f20 2023-07-14T13:12:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.078+0000 7f1d88e64640 1 -- 172.21.15.5:0/295069623 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7c00f040 con 0x7f1d70006f20 2023-07-14T13:12:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.078+0000 7f1d88e64640 1 -- 172.21.15.5:0/295069623 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c0ad440 con 0x7f1d70006f20 2023-07-14T13:12:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.078+0000 7f1d8c0ca640 1 -- 172.21.15.5:0/295069623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d70006f20 msgr2=0x7f1d70007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.078+0000 7f1d8c0ca640 1 --2- 172.21.15.5:0/295069623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d70006f20 0x7f1d70007390 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f1d840adb10 tx=0x7f1d7c01cc00 comp rx=0 tx=0).stop 2023-07-14T13:12:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.078+0000 7f1d8a667640 1 -- 172.21.15.5:0/295069623 reap_dead start 2023-07-14T13:12:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.078+0000 7f1d8c0ca640 1 -- 172.21.15.5:0/295069623 shutdown_connections 2023-07-14T13:12:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.078+0000 7f1d8c0ca640 1 -- 172.21.15.5:0/295069623 >> 172.21.15.5:0/295069623 conn(0x7f1d840afc10 msgr2=0x7f1d840b0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.078+0000 7f1d8c0ca640 1 -- 172.21.15.5:0/295069623 shutdown_connections 2023-07-14T13:12:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.078+0000 7f1d8c0ca640 1 -- 172.21.15.5:0/295069623 wait complete. 2023-07-14T13:12:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.078+0000 7f1d8c0ca640 1 Processor -- start 2023-07-14T13:12:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.078+0000 7f1d8c0ca640 1 -- start start 2023-07-14T13:12:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.078+0000 7f1d8c0ca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d70006f20 0x7f1d84149600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.078+0000 7f1d8c0ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d840c44d0 0x7f1d84149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.082+0000 7f1d8c0ca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8414a240 0x7f1d8406b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.082+0000 7f1d8c0ca640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d84149b40 con 0x7f1d8414a240 2023-07-14T13:12:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.082+0000 7f1d8c0ca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d840c4940 con 0x7f1d70006f20 2023-07-14T13:12:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.082+0000 7f1d8c0ca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d840c5230 con 0x7f1d840c44d0 2023-07-14T13:12:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.082+0000 7f1d8a667640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8414a240 0x7f1d8406b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:22.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.082+0000 7f1d8a667640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8414a240 0x7f1d8406b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59830/0 (socket says 172.21.15.5:59830) 2023-07-14T13:12:22.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.082+0000 7f1d8a667640 1 -- 172.21.15.5:0/2770395692 learned_addr learned my addr 172.21.15.5:0/2770395692 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:22.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.082+0000 7f1d8a667640 1 -- 172.21.15.5:0/2770395692 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d840c44d0 msgr2=0x7f1d84149d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:22.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.082+0000 7f1d8a667640 1 --2- 172.21.15.5:0/2770395692 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d840c44d0 0x7f1d84149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:22.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.082+0000 7f1d8a667640 1 -- 172.21.15.5:0/2770395692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d70006f20 msgr2=0x7f1d84149600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:22.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.082+0000 7f1d8a667640 1 --2- 172.21.15.5:0/2770395692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d70006f20 0x7f1d84149600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:22.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.082+0000 7f1d8a667640 1 -- 172.21.15.5:0/2770395692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d840c5510 con 0x7f1d8414a240 2023-07-14T13:12:22.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.082+0000 7f1d8a667640 1 --2- 172.21.15.5:0/2770395692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8414a240 0x7f1d8406b4c0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c002240 tx=0x7f1d7c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:22.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.082+0000 7f1d7a7fc640 1 -- 172.21.15.5:0/2770395692 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c0039a0 con 0x7f1d8414a240 2023-07-14T13:12:22.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.082+0000 7f1d7a7fc640 1 -- 172.21.15.5:0/2770395692 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7c003b00 con 0x7f1d8414a240 2023-07-14T13:12:22.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.082+0000 7f1d7a7fc640 1 -- 172.21.15.5:0/2770395692 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c0ae950 con 0x7f1d8414a240 2023-07-14T13:12:22.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.082+0000 7f1d8c0ca640 1 -- 172.21.15.5:0/2770395692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d840c57f0 con 0x7f1d8414a240 2023-07-14T13:12:22.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.082+0000 7f1d8c0ca640 1 -- 172.21.15.5:0/2770395692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8406ba00 con 0x7f1d8414a240 2023-07-14T13:12:22.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.082+0000 7f1d67fff640 1 -- 172.21.15.5:0/2770395692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d840cc4a0 con 0x7f1d8414a240 2023-07-14T13:12:22.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.082+0000 7f1d7a7fc640 1 -- 172.21.15.5:0/2770395692 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1d7c0b4040 con 0x7f1d8414a240 2023-07-14T13:12:22.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.086+0000 7f1d7a7fc640 1 --2- 172.21.15.5:0/2770395692 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f1d680663d0 0x7f1d68068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:22.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.086+0000 7f1d7a7fc640 1 -- 172.21.15.5:0/2770395692 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5608+0+0 (secure 0 0 0) 0x7f1d7c11d860 con 0x7f1d8414a240 2023-07-14T13:12:22.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.086+0000 7f1d89e66640 1 --2- 172.21.15.5:0/2770395692 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f1d680663d0 0x7f1d68068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:22.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.086+0000 7f1d89e66640 1 --2- 172.21.15.5:0/2770395692 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f1d680663d0 0x7f1d68068880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1d800079b0 tx=0x7f1d80009040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.090+0000 7f1d7a7fc640 1 -- 172.21.15.5:0/2770395692 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f1d840cc4a0 con 0x7f1d8414a240 2023-07-14T13:12:22.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.242+0000 7f1d67fff640 1 -- 172.21.15.5:0/2770395692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1d840cc4a0 con 0x7f1d8414a240 2023-07-14T13:12:22.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.902+0000 7f1d7a7fc640 1 -- 172.21.15.5:0/2770395692 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v140) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1d840cc4a0 con 0x7f1d8414a240 2023-07-14T13:12:22.937 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-07-14T13:12:22.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.918+0000 7f1d67fff640 1 -- 172.21.15.5:0/2770395692 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f1d680663d0 msgr2=0x7f1d68068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:22.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.918+0000 7f1d67fff640 1 --2- 172.21.15.5:0/2770395692 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f1d680663d0 0x7f1d68068880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1d800079b0 tx=0x7f1d80009040 comp rx=0 tx=0).stop 2023-07-14T13:12:22.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.918+0000 7f1d67fff640 1 -- 172.21.15.5:0/2770395692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8414a240 msgr2=0x7f1d8406b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:22.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.918+0000 7f1d67fff640 1 --2- 172.21.15.5:0/2770395692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8414a240 0x7f1d8406b4c0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c002240 tx=0x7f1d7c009750 comp rx=0 tx=0).stop 2023-07-14T13:12:22.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.922+0000 7f1d67fff640 1 -- 172.21.15.5:0/2770395692 shutdown_connections 2023-07-14T13:12:22.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.922+0000 7f1d67fff640 1 --2- 172.21.15.5:0/2770395692 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f1d680663d0 0x7f1d68068880 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.922+0000 7f1d67fff640 1 --2- 172.21.15.5:0/2770395692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1d8414a240 0x7f1d8406b4c0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.922+0000 7f1d67fff640 1 --2- 172.21.15.5:0/2770395692 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1d840c44d0 0x7f1d84149d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.922+0000 7f1d67fff640 1 --2- 172.21.15.5:0/2770395692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d70006f20 0x7f1d84149600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.922+0000 7f1d67fff640 1 -- 172.21.15.5:0/2770395692 >> 172.21.15.5:0/2770395692 conn(0x7f1d840afc10 msgr2=0x7f1d8406f700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:22.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.926+0000 7f1d67fff640 1 -- 172.21.15.5:0/2770395692 shutdown_connections 2023-07-14T13:12:22.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:22.926+0000 7f1d67fff640 1 -- 172.21.15.5:0/2770395692 wait complete. 2023-07-14T13:12:22.984 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-14T13:12:23.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.102+0000 7f889ee96640 1 Processor -- start 2023-07-14T13:12:23.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.102+0000 7f889ee96640 1 -- start start 2023-07-14T13:12:23.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.102+0000 7f889ee96640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f889815bde0 0x7f88980d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:23.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.102+0000 7f889ee96640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f88980d2fc0 0x7f88980b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:23.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.102+0000 7f889ee96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88980d2300 0x7f88980d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:23.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.102+0000 7f889ee96640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f889815c1b0 con 0x7f889815bde0 2023-07-14T13:12:23.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.102+0000 7f889ee96640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88980d2cc0 con 0x7f88980d2fc0 2023-07-14T13:12:23.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.102+0000 7f889ee96640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88980b04c0 con 0x7f88980d2300 2023-07-14T13:12:23.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.102+0000 7f889cc32640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f889815bde0 0x7f88980d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:23.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.102+0000 7f889cc32640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f889815bde0 0x7f88980d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59832/0 (socket says 172.21.15.5:59832) 2023-07-14T13:12:23.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.102+0000 7f889cc32640 1 -- 172.21.15.5:0/142257621 learned_addr learned my addr 172.21.15.5:0/142257621 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:23.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.102+0000 7f889d433640 1 --2- 172.21.15.5:0/142257621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88980d2300 0x7f88980d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.102+0000 7f8897fff640 1 --2- 172.21.15.5:0/142257621 >> v2:172.21.15.154:3300/0 conn(0x7f88980d2fc0 0x7f88980b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.102+0000 7f889cc32640 1 -- 172.21.15.5:0/142257621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88980d2300 msgr2=0x7f88980d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.102+0000 7f889cc32640 1 --2- 172.21.15.5:0/142257621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88980d2300 0x7f88980d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.102+0000 7f889cc32640 1 -- 172.21.15.5:0/142257621 >> v2:172.21.15.154:3300/0 conn(0x7f88980d2fc0 msgr2=0x7f88980b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:23.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.102+0000 7f889cc32640 1 --2- 172.21.15.5:0/142257621 >> v2:172.21.15.154:3300/0 conn(0x7f88980d2fc0 0x7f88980b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:23.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.102+0000 7f889cc32640 1 -- 172.21.15.5:0/142257621 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88980d0aa0 con 0x7f889815bde0 2023-07-14T13:12:23.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.106+0000 7f889cc32640 1 --2- 172.21.15.5:0/142257621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f889815bde0 0x7f88980d0270 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f889808c600 tx=0x7f888c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6329e8e79c4d7761 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:23.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.106+0000 7f88977fe640 1 -- 172.21.15.5:0/142257621 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c0aa620 con 0x7f889815bde0 2023-07-14T13:12:23.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.106+0000 7f88977fe640 1 -- 172.21.15.5:0/142257621 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888c0aa780 con 0x7f889815bde0 2023-07-14T13:12:23.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.106+0000 7f88977fe640 1 -- 172.21.15.5:0/142257621 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c0aab10 con 0x7f889815bde0 2023-07-14T13:12:23.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.106+0000 7f889ee96640 1 -- 172.21.15.5:0/142257621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f889815bde0 msgr2=0x7f88980d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:23.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.106+0000 7f889ee96640 1 --2- 172.21.15.5:0/142257621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f889815bde0 0x7f88980d0270 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f889808c600 tx=0x7f888c01c500 comp rx=0 tx=0).stop 2023-07-14T13:12:23.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.106+0000 7f889ee96640 1 -- 172.21.15.5:0/142257621 shutdown_connections 2023-07-14T13:12:23.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.106+0000 7f889ee96640 1 --2- 172.21.15.5:0/142257621 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88980d2300 0x7f88980d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:23.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.106+0000 7f889ee96640 1 --2- 172.21.15.5:0/142257621 >> v2:172.21.15.154:3300/0 conn(0x7f88980d2fc0 0x7f88980b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:23.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.106+0000 7f889ee96640 1 --2- 172.21.15.5:0/142257621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f889815bde0 0x7f88980d0270 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:23.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.106+0000 7f889ee96640 1 -- 172.21.15.5:0/142257621 >> 172.21.15.5:0/142257621 conn(0x7f88980659d0 msgr2=0x7f889809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:23.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.106+0000 7f889ee96640 1 -- 172.21.15.5:0/142257621 shutdown_connections 2023-07-14T13:12:23.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.106+0000 7f889ee96640 1 -- 172.21.15.5:0/142257621 wait complete. 2023-07-14T13:12:23.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.110+0000 7f889ee96640 1 Processor -- start 2023-07-14T13:12:23.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.110+0000 7f889ee96640 1 -- start start 2023-07-14T13:12:23.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.110+0000 7f889ee96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88980d2300 0x7f8898155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:23.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.110+0000 7f889ee96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88980d2fc0 0x7f8898144e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:23.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.110+0000 7f889ee96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f889815bde0 0x7f88980cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:23.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.110+0000 7f889ee96640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8898156330 con 0x7f88980d2300 2023-07-14T13:12:23.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.110+0000 7f889ee96640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88981573e0 con 0x7f889815bde0 2023-07-14T13:12:23.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.110+0000 7f889ee96640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8898145370 con 0x7f88980d2fc0 2023-07-14T13:12:23.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.110+0000 7f889cc32640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88980d2300 0x7f8898155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:23.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.110+0000 7f889cc32640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88980d2300 0x7f8898155df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59840/0 (socket says 172.21.15.5:59840) 2023-07-14T13:12:23.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.110+0000 7f889cc32640 1 -- 172.21.15.5:0/36017592 learned_addr learned my addr 172.21.15.5:0/36017592 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:23.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.110+0000 7f8897fff640 1 --2- 172.21.15.5:0/36017592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88980d2fc0 0x7f8898144e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:23.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.110+0000 7f889d433640 1 --2- 172.21.15.5:0/36017592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f889815bde0 0x7f88980cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:23.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.110+0000 7f889cc32640 1 -- 172.21.15.5:0/36017592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88980d2fc0 msgr2=0x7f8898144e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:23.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.110+0000 7f889cc32640 1 --2- 172.21.15.5:0/36017592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88980d2fc0 0x7f8898144e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:23.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.110+0000 7f889cc32640 1 -- 172.21.15.5:0/36017592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f889815bde0 msgr2=0x7f88980cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.110+0000 7f889cc32640 1 --2- 172.21.15.5:0/36017592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f889815bde0 0x7f88980cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.110+0000 7f889cc32640 1 -- 172.21.15.5:0/36017592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888c009480 con 0x7f88980d2300 2023-07-14T13:12:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.110+0000 7f8897fff640 1 --2- 172.21.15.5:0/36017592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88980d2fc0 0x7f8898144e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.110+0000 7f889cc32640 1 --2- 172.21.15.5:0/36017592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88980d2300 0x7f8898155df0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f888c01c9e0 tx=0x7f888c0192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.110+0000 7f88957fa640 1 -- 172.21.15.5:0/36017592 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c0059a0 con 0x7f88980d2300 2023-07-14T13:12:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.110+0000 7f88957fa640 1 -- 172.21.15.5:0/36017592 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888c005b20 con 0x7f88980d2300 2023-07-14T13:12:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.110+0000 7f889ee96640 1 -- 172.21.15.5:0/36017592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88981567d0 con 0x7f88980d2300 2023-07-14T13:12:23.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.110+0000 7f88957fa640 1 -- 172.21.15.5:0/36017592 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c0aa8f0 con 0x7f88980d2300 2023-07-14T13:12:23.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.110+0000 7f889ee96640 1 -- 172.21.15.5:0/36017592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8898156d90 con 0x7f88980d2300 2023-07-14T13:12:23.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.110+0000 7f889ee96640 1 -- 172.21.15.5:0/36017592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88980678d0 con 0x7f88980d2300 2023-07-14T13:12:23.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.114+0000 7f88957fa640 1 -- 172.21.15.5:0/36017592 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f888c0aaa50 con 0x7f88980d2300 2023-07-14T13:12:23.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.114+0000 7f88957fa640 1 --2- 172.21.15.5:0/36017592 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f887c0663d0 0x7f887c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:23.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.114+0000 7f88957fa640 1 -- 172.21.15.5:0/36017592 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5990+0+0 (secure 0 0 0) 0x7f888c11df50 con 0x7f88980d2300 2023-07-14T13:12:23.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.114+0000 7f8897fff640 1 --2- 172.21.15.5:0/36017592 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f887c0663d0 0x7f887c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:23.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.118+0000 7f8897fff640 1 --2- 172.21.15.5:0/36017592 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f887c0663d0 0x7f887c068880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f88980b73b0 tx=0x7f8884008040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:23.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.122+0000 7f88957fa640 1 -- 172.21.15.5:0/36017592 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f888c0eb290 con 0x7f88980d2300 2023-07-14T13:12:23.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.310+0000 7f889ee96640 1 -- 172.21.15.5:0/36017592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f88980b5ae0 con 0x7f88980d2300 2023-07-14T13:12:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.926+0000 7f88957fa640 1 -- 172.21.15.5:0/36017592 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v61) v1 ==== 174+0+0 (secure 0 0 0) 0x7f888c0bd070 con 0x7f88980d2300 2023-07-14T13:12:23.970 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 17 and data pool 18 2023-07-14T13:12:23.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.942+0000 7f889ee96640 1 -- 172.21.15.5:0/36017592 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f887c0663d0 msgr2=0x7f887c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:23.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.942+0000 7f889ee96640 1 --2- 172.21.15.5:0/36017592 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f887c0663d0 0x7f887c068880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f88980b73b0 tx=0x7f8884008040 comp rx=0 tx=0).stop 2023-07-14T13:12:23.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.942+0000 7f889ee96640 1 -- 172.21.15.5:0/36017592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88980d2300 msgr2=0x7f8898155df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:23.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.942+0000 7f889ee96640 1 --2- 172.21.15.5:0/36017592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88980d2300 0x7f8898155df0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f888c01c9e0 tx=0x7f888c0192a0 comp rx=0 tx=0).stop 2023-07-14T13:12:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.942+0000 7f889ee96640 1 -- 172.21.15.5:0/36017592 shutdown_connections 2023-07-14T13:12:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.942+0000 7f889ee96640 1 --2- 172.21.15.5:0/36017592 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f887c0663d0 0x7f887c068880 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.942+0000 7f889ee96640 1 --2- 172.21.15.5:0/36017592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f889815bde0 0x7f88980cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.942+0000 7f889ee96640 1 --2- 172.21.15.5:0/36017592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88980d2fc0 0x7f8898144e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.942+0000 7f889ee96640 1 --2- 172.21.15.5:0/36017592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88980d2300 0x7f8898155df0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.942+0000 7f889ee96640 1 -- 172.21.15.5:0/36017592 >> 172.21.15.5:0/36017592 conn(0x7f88980659d0 msgr2=0x7f889815ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.942+0000 7f889ee96640 1 -- 172.21.15.5:0/36017592 shutdown_connections 2023-07-14T13:12:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:23.942+0000 7f889ee96640 1 -- 172.21.15.5:0/36017592 wait complete. 2023-07-14T13:12:24.002 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:12:24.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.114+0000 7f2a80dfa640 1 Processor -- start 2023-07-14T13:12:24.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.114+0000 7f2a80dfa640 1 -- start start 2023-07-14T13:12:24.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.114+0000 7f2a80dfa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2a7c0d1850 0x7f2a7c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:24.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.114+0000 7f2a80dfa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7c0ccaf0 con 0x7f2a7c0b7c70 2023-07-14T13:12:24.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.114+0000 7f2a80dfa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7c160320 con 0x7f2a7c15fd60 2023-07-14T13:12:24.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.114+0000 7f2a80dfa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a7c0d1190 con 0x7f2a7c0d1850 2023-07-14T13:12:24.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.114+0000 7f2a7ad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2a7c0d1850 0x7f2a7c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:24.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.114+0000 7f2a7ad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2a7c0d1850 0x7f2a7c0d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59850/0 (socket says 172.21.15.5:59850) 2023-07-14T13:12:24.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.114+0000 7f2a7ad9d640 1 -- 172.21.15.5:0/912955913 learned_addr learned my addr 172.21.15.5:0/912955913 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:24.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.114+0000 7f2a7ad9d640 1 -- 172.21.15.5:0/912955913 >> v1:172.21.15.154:6789/0 conn(0x7f2a7c15fd60 legacy=0x7f2a7c0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:24.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.114+0000 7f2a7ad9d640 1 -- 172.21.15.5:0/912955913 >> v1:172.21.15.5:6789/0 conn(0x7f2a7c0b7c70 legacy=0x7f2a7c15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:24.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.114+0000 7f2a7ad9d640 1 -- 172.21.15.5:0/912955913 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c0ccd90 con 0x7f2a7c0d1850 2023-07-14T13:12:24.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.118+0000 7f2a7ad9d640 1 --2- 172.21.15.5:0/912955913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a7c0d1850 0x7f2a7c0d0c50 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f2a74009e50 tx=0x7f2a7401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7bfe2b6ceb2064 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:24.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.118+0000 7f2a79d9b640 1 -- 172.21.15.5:0/912955913 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a740a57f0 con 0x7f2a7c0d1850 2023-07-14T13:12:24.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.118+0000 7f2a79d9b640 1 -- 172.21.15.5:0/912955913 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a740a5950 con 0x7f2a7c0d1850 2023-07-14T13:12:24.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.118+0000 7f2a79d9b640 1 -- 172.21.15.5:0/912955913 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a740a5ce0 con 0x7f2a7c0d1850 2023-07-14T13:12:24.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.118+0000 7f2a80dfa640 1 -- 172.21.15.5:0/912955913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a7c0d1850 msgr2=0x7f2a7c0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:24.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.118+0000 7f2a80dfa640 1 --2- 172.21.15.5:0/912955913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a7c0d1850 0x7f2a7c0d0c50 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f2a74009e50 tx=0x7f2a7401ca10 comp rx=0 tx=0).stop 2023-07-14T13:12:24.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.118+0000 7f2a80dfa640 1 -- 172.21.15.5:0/912955913 shutdown_connections 2023-07-14T13:12:24.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.118+0000 7f2a80dfa640 1 --2- 172.21.15.5:0/912955913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a7c0d1850 0x7f2a7c0d0c50 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:24.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.118+0000 7f2a80dfa640 1 -- 172.21.15.5:0/912955913 >> 172.21.15.5:0/912955913 conn(0x7f2a7c0650b0 msgr2=0x7f2a7c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:24.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.118+0000 7f2a80dfa640 1 -- 172.21.15.5:0/912955913 shutdown_connections 2023-07-14T13:12:24.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.118+0000 7f2a80dfa640 1 -- 172.21.15.5:0/912955913 wait complete. 2023-07-14T13:12:24.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.122+0000 7f2a80dfa640 1 Processor -- start 2023-07-14T13:12:24.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.122+0000 7f2a80dfa640 1 -- start start 2023-07-14T13:12:24.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.122+0000 7f2a80dfa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a7c0b7c70 0x7f2a7c14c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:24.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.122+0000 7f2a80dfa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a7c0d1850 0x7f2a7c15e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:24.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.122+0000 7f2a80dfa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a7c15fd60 0x7f2a7c0c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:24.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.122+0000 7f2a80dfa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c0c86f0 con 0x7f2a7c15fd60 2023-07-14T13:12:24.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.122+0000 7f2a80dfa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c15e100 con 0x7f2a7c0b7c70 2023-07-14T13:12:24.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.122+0000 7f2a80dfa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c0c9030 con 0x7f2a7c0d1850 2023-07-14T13:12:24.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.122+0000 7f2a7ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a7c15fd60 0x7f2a7c0c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:24.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.122+0000 7f2a7ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a7c15fd60 0x7f2a7c0c9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59866/0 (socket says 172.21.15.5:59866) 2023-07-14T13:12:24.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.122+0000 7f2a7ad9d640 1 -- 172.21.15.5:0/2702809590 learned_addr learned my addr 172.21.15.5:0/2702809590 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:24.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.122+0000 7f2a73fff640 1 --2- 172.21.15.5:0/2702809590 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a7c0d1850 0x7f2a7c15e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:24.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.122+0000 7f2a7a59c640 1 --2- 172.21.15.5:0/2702809590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a7c0b7c70 0x7f2a7c14c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:24.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.122+0000 7f2a7ad9d640 1 -- 172.21.15.5:0/2702809590 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a7c0d1850 msgr2=0x7f2a7c15e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:24.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.122+0000 7f2a7ad9d640 1 --2- 172.21.15.5:0/2702809590 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a7c0d1850 0x7f2a7c15e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:24.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.122+0000 7f2a7ad9d640 1 -- 172.21.15.5:0/2702809590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a7c0b7c70 msgr2=0x7f2a7c14c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:24.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.122+0000 7f2a7ad9d640 1 --2- 172.21.15.5:0/2702809590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a7c0b7c70 0x7f2a7c14c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:24.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.122+0000 7f2a7ad9d640 1 -- 172.21.15.5:0/2702809590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a74009b30 con 0x7f2a7c15fd60 2023-07-14T13:12:24.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.122+0000 7f2a7ad9d640 1 --2- 172.21.15.5:0/2702809590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a7c15fd60 0x7f2a7c0c9a90 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f2a740af040 tx=0x7f2a740197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:24.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.122+0000 7f2a72ffd640 1 -- 172.21.15.5:0/2702809590 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a740b8880 con 0x7f2a7c15fd60 2023-07-14T13:12:24.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.122+0000 7f2a72ffd640 1 -- 172.21.15.5:0/2702809590 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a740b8a00 con 0x7f2a7c15fd60 2023-07-14T13:12:24.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.122+0000 7f2a80dfa640 1 -- 172.21.15.5:0/2702809590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a7c0c6f00 con 0x7f2a7c15fd60 2023-07-14T13:12:24.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.122+0000 7f2a72ffd640 1 -- 172.21.15.5:0/2702809590 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a740b8db0 con 0x7f2a7c15fd60 2023-07-14T13:12:24.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.122+0000 7f2a80dfa640 1 -- 172.21.15.5:0/2702809590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a7c0c74c0 con 0x7f2a7c15fd60 2023-07-14T13:12:24.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.122+0000 7f2a80dfa640 1 -- 172.21.15.5:0/2702809590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a7c0c76b0 con 0x7f2a7c15fd60 2023-07-14T13:12:24.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.126+0000 7f2a72ffd640 1 -- 172.21.15.5:0/2702809590 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2a740c3460 con 0x7f2a7c15fd60 2023-07-14T13:12:24.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.126+0000 7f2a72ffd640 1 --2- 172.21.15.5:0/2702809590 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f2a5c0663a0 0x7f2a5c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:24.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.126+0000 7f2a72ffd640 1 -- 172.21.15.5:0/2702809590 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f2a7411f4e0 con 0x7f2a7c15fd60 2023-07-14T13:12:24.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.126+0000 7f2a7a59c640 1 --2- 172.21.15.5:0/2702809590 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f2a5c0663a0 0x7f2a5c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:24.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.126+0000 7f2a7a59c640 1 --2- 172.21.15.5:0/2702809590 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f2a5c0663a0 0x7f2a5c068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0b26e0 tx=0x7f2a6c009040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:24.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.130+0000 7f2a72ffd640 1 -- 172.21.15.5:0/2702809590 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2a740ec850 con 0x7f2a7c15fd60 2023-07-14T13:12:24.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.286+0000 7f2a80dfa640 1 -- 172.21.15.5:0/2702809590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a7c0678d0 con 0x7f2a7c15fd60 2023-07-14T13:12:24.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.286+0000 7f2a72ffd640 1 -- 172.21.15.5:0/2702809590 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+18370 (secure 0 0 0) 0x7f2a740efe70 con 0x7f2a7c15fd60 2023-07-14T13:12:24.321 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:24.321 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":141,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:12:23.316096+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:12:21.430786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-14T13:12:22.293915+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:12:24.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.286+0000 7f2a80dfa640 1 -- 172.21.15.5:0/2702809590 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f2a5c0663a0 msgr2=0x7f2a5c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:24.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.286+0000 7f2a80dfa640 1 --2- 172.21.15.5:0/2702809590 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f2a5c0663a0 0x7f2a5c068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0b26e0 tx=0x7f2a6c009040 comp rx=0 tx=0).stop 2023-07-14T13:12:24.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.286+0000 7f2a80dfa640 1 -- 172.21.15.5:0/2702809590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a7c15fd60 msgr2=0x7f2a7c0c9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:24.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.286+0000 7f2a80dfa640 1 --2- 172.21.15.5:0/2702809590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a7c15fd60 0x7f2a7c0c9a90 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f2a740af040 tx=0x7f2a740197b0 comp rx=0 tx=0).stop 2023-07-14T13:12:24.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.286+0000 7f2a80dfa640 1 -- 172.21.15.5:0/2702809590 shutdown_connections 2023-07-14T13:12:24.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.286+0000 7f2a80dfa640 1 --2- 172.21.15.5:0/2702809590 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f2a5c0663a0 0x7f2a5c068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:24.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.286+0000 7f2a80dfa640 1 --2- 172.21.15.5:0/2702809590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a7c15fd60 0x7f2a7c0c9a90 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:24.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.286+0000 7f2a80dfa640 1 --2- 172.21.15.5:0/2702809590 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a7c0d1850 0x7f2a7c15e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:24.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.286+0000 7f2a80dfa640 1 --2- 172.21.15.5:0/2702809590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a7c0b7c70 0x7f2a7c14c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:24.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.286+0000 7f2a80dfa640 1 -- 172.21.15.5:0/2702809590 >> 172.21.15.5:0/2702809590 conn(0x7f2a7c0650b0 msgr2=0x7f2a7c0b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:24.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.290+0000 7f2a80dfa640 1 -- 172.21.15.5:0/2702809590 shutdown_connections 2023-07-14T13:12:24.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.290+0000 7f2a80dfa640 1 -- 172.21.15.5:0/2702809590 wait complete. 2023-07-14T13:12:24.343 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:12:24.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.450+0000 7f1a9cd11640 1 Processor -- start 2023-07-14T13:12:24.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.450+0000 7f1a9cd11640 1 -- start start 2023-07-14T13:12:24.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.454+0000 7f1a9cd11640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1a98070b70 0x7f1a98070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:24.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.454+0000 7f1a9cd11640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a980cb100 0x7f1a980cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:24.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.454+0000 7f1a9cd11640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a980cac70 con 0x7f1a9806b1e0 2023-07-14T13:12:24.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.454+0000 7f1a9cd11640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a980cbaa0 con 0x7f1a98070b70 2023-07-14T13:12:24.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.454+0000 7f1a9cd11640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a98071480 con 0x7f1a980cb100 2023-07-14T13:12:24.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.454+0000 7f1a9659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1a98070b70 0x7f1a98070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:24.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.454+0000 7f1a9659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1a98070b70 0x7f1a98070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59874/0 (socket says 172.21.15.5:59874) 2023-07-14T13:12:24.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.454+0000 7f1a9659c640 1 -- 172.21.15.5:0/1330857171 learned_addr learned my addr 172.21.15.5:0/1330857171 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:24.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.454+0000 7f1a96d9d640 1 --2- 172.21.15.5:0/1330857171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a980cb100 0x7f1a980cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:24.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.454+0000 7f1a9659c640 1 -- 172.21.15.5:0/1330857171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a980cb100 msgr2=0x7f1a980cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:24.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.454+0000 7f1a9659c640 1 --2- 172.21.15.5:0/1330857171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a980cb100 0x7f1a980cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:24.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.454+0000 7f1a9659c640 1 -- 172.21.15.5:0/1330857171 >> v1:172.21.15.154:6789/0 conn(0x7f1a9806b1e0 legacy=0x7f1a980c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:24.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.454+0000 7f1a9659c640 1 -- 172.21.15.5:0/1330857171 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a980ca060 con 0x7f1a98070b70 2023-07-14T13:12:24.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.458+0000 7f1a9659c640 1 --2- 172.21.15.5:0/1330857171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a98070b70 0x7f1a98070f40 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009870 tx=0x7f1a8801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b02aff42ed364b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:24.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.458+0000 7f1a95d9b640 1 -- 172.21.15.5:0/1330857171 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a880aa670 con 0x7f1a98070b70 2023-07-14T13:12:24.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.458+0000 7f1a95d9b640 1 -- 172.21.15.5:0/1330857171 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a880aa7d0 con 0x7f1a98070b70 2023-07-14T13:12:24.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.458+0000 7f1a95d9b640 1 -- 172.21.15.5:0/1330857171 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a880aab60 con 0x7f1a98070b70 2023-07-14T13:12:24.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.458+0000 7f1a9cd11640 1 -- 172.21.15.5:0/1330857171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a98070b70 msgr2=0x7f1a98070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:24.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.458+0000 7f1a9cd11640 1 --2- 172.21.15.5:0/1330857171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a98070b70 0x7f1a98070f40 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009870 tx=0x7f1a8801c510 comp rx=0 tx=0).stop 2023-07-14T13:12:24.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.458+0000 7f1a9cd11640 1 -- 172.21.15.5:0/1330857171 shutdown_connections 2023-07-14T13:12:24.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.458+0000 7f1a9cd11640 1 --2- 172.21.15.5:0/1330857171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a980cb100 0x7f1a980cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:24.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.458+0000 7f1a9cd11640 1 --2- 172.21.15.5:0/1330857171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a98070b70 0x7f1a98070f40 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:24.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.458+0000 7f1a9cd11640 1 -- 172.21.15.5:0/1330857171 >> 172.21.15.5:0/1330857171 conn(0x7f1a980afcf0 msgr2=0x7f1a980b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:24.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.458+0000 7f1a9cd11640 1 -- 172.21.15.5:0/1330857171 shutdown_connections 2023-07-14T13:12:24.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.458+0000 7f1a9cd11640 1 -- 172.21.15.5:0/1330857171 wait complete. 2023-07-14T13:12:24.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.458+0000 7f1a9cd11640 1 Processor -- start 2023-07-14T13:12:24.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.458+0000 7f1a9cd11640 1 -- start start 2023-07-14T13:12:24.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.462+0000 7f1a9cd11640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a9806b1e0 0x7f1a98151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:24.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.462+0000 7f1a9cd11640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a98070b70 0x7f1a98158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:24.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.462+0000 7f1a9cd11640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a980cb100 0x7f1a980b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:24.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.462+0000 7f1a9cd11640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a981543c0 con 0x7f1a98070b70 2023-07-14T13:12:24.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.462+0000 7f1a9cd11640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a981537b0 con 0x7f1a9806b1e0 2023-07-14T13:12:24.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.462+0000 7f1a9cd11640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a98153a90 con 0x7f1a980cb100 2023-07-14T13:12:24.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.462+0000 7f1a8ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a98070b70 0x7f1a98158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:24.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.462+0000 7f1a8ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a98070b70 0x7f1a98158d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59882/0 (socket says 172.21.15.5:59882) 2023-07-14T13:12:24.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.462+0000 7f1a8ffff640 1 -- 172.21.15.5:0/4102876870 learned_addr learned my addr 172.21.15.5:0/4102876870 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:24.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.462+0000 7f1a9659c640 1 --2- 172.21.15.5:0/4102876870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a9806b1e0 0x7f1a98151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:24.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.462+0000 7f1a96d9d640 1 --2- 172.21.15.5:0/4102876870 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a980cb100 0x7f1a980b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:24.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.462+0000 7f1a8ffff640 1 -- 172.21.15.5:0/4102876870 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a980cb100 msgr2=0x7f1a980b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:24.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.462+0000 7f1a8ffff640 1 --2- 172.21.15.5:0/4102876870 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a980cb100 0x7f1a980b2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:24.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.462+0000 7f1a8ffff640 1 -- 172.21.15.5:0/4102876870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a9806b1e0 msgr2=0x7f1a98151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:24.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.462+0000 7f1a8ffff640 1 --2- 172.21.15.5:0/4102876870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a9806b1e0 0x7f1a98151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:24.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.462+0000 7f1a8ffff640 1 -- 172.21.15.5:0/4102876870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a880094d0 con 0x7f1a98070b70 2023-07-14T13:12:24.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.462+0000 7f1a9659c640 1 --2- 172.21.15.5:0/4102876870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a9806b1e0 0x7f1a98151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:24.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.462+0000 7f1a8ffff640 1 --2- 172.21.15.5:0/4102876870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a98070b70 0x7f1a98158d40 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f1a8000c3c0 tx=0x7f1a8000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:24.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.462+0000 7f1a8effd640 1 -- 172.21.15.5:0/4102876870 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a800052d0 con 0x7f1a98070b70 2023-07-14T13:12:24.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.462+0000 7f1a8effd640 1 -- 172.21.15.5:0/4102876870 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a80005430 con 0x7f1a98070b70 2023-07-14T13:12:24.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.462+0000 7f1a8effd640 1 -- 172.21.15.5:0/4102876870 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a80003840 con 0x7f1a98070b70 2023-07-14T13:12:24.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.462+0000 7f1a9cd11640 1 -- 172.21.15.5:0/4102876870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a98153d70 con 0x7f1a98070b70 2023-07-14T13:12:24.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.462+0000 7f1a9cd11640 1 -- 172.21.15.5:0/4102876870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a98151db0 con 0x7f1a98070b70 2023-07-14T13:12:24.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.462+0000 7f1a9cd11640 1 -- 172.21.15.5:0/4102876870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a980cbd30 con 0x7f1a98070b70 2023-07-14T13:12:24.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.462+0000 7f1a8effd640 1 -- 172.21.15.5:0/4102876870 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1a800039a0 con 0x7f1a98070b70 2023-07-14T13:12:24.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.466+0000 7f1a8effd640 1 --2- 172.21.15.5:0/4102876870 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f1a780663a0 0x7f1a78068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:24.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.466+0000 7f1a8effd640 1 -- 172.21.15.5:0/4102876870 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f1a800833c0 con 0x7f1a98070b70 2023-07-14T13:12:24.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.466+0000 7f1a9659c640 1 --2- 172.21.15.5:0/4102876870 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f1a780663a0 0x7f1a78068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:24.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.466+0000 7f1a9659c640 1 --2- 172.21.15.5:0/4102876870 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f1a780663a0 0x7f1a78068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1a880ae000 tx=0x7f1a880a7000 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:24.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.470+0000 7f1a8effd640 1 -- 172.21.15.5:0/4102876870 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f1a980cbd30 con 0x7f1a98070b70 2023-07-14T13:12:24.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.622+0000 7f1a9cd11640 1 -- 172.21.15.5:0/4102876870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a980cbd30 con 0x7f1a98070b70 2023-07-14T13:12:24.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.626+0000 7f1a8effd640 1 -- 172.21.15.5:0/4102876870 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+18370 (secure 0 0 0) 0x7f1a980cbd30 con 0x7f1a98070b70 2023-07-14T13:12:24.660 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:24.660 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":141,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:12:23.316096+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:12:21.430786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-14T13:12:22.293915+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:12:24.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.626+0000 7f1a9cd11640 1 -- 172.21.15.5:0/4102876870 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f1a780663a0 msgr2=0x7f1a78068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:24.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.626+0000 7f1a9cd11640 1 --2- 172.21.15.5:0/4102876870 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f1a780663a0 0x7f1a78068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1a880ae000 tx=0x7f1a880a7000 comp rx=0 tx=0).stop 2023-07-14T13:12:24.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.626+0000 7f1a9cd11640 1 -- 172.21.15.5:0/4102876870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a98070b70 msgr2=0x7f1a98158d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:24.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.626+0000 7f1a9cd11640 1 --2- 172.21.15.5:0/4102876870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a98070b70 0x7f1a98158d40 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f1a8000c3c0 tx=0x7f1a8000c880 comp rx=0 tx=0).stop 2023-07-14T13:12:24.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.626+0000 7f1a9cd11640 1 -- 172.21.15.5:0/4102876870 shutdown_connections 2023-07-14T13:12:24.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.626+0000 7f1a9cd11640 1 --2- 172.21.15.5:0/4102876870 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f1a780663a0 0x7f1a78068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:24.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.626+0000 7f1a9cd11640 1 --2- 172.21.15.5:0/4102876870 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a980cb100 0x7f1a980b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:24.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.626+0000 7f1a9cd11640 1 --2- 172.21.15.5:0/4102876870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a98070b70 0x7f1a98158d40 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:24.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.626+0000 7f1a9cd11640 1 --2- 172.21.15.5:0/4102876870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a9806b1e0 0x7f1a98151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:24.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.626+0000 7f1a9cd11640 1 -- 172.21.15.5:0/4102876870 >> 172.21.15.5:0/4102876870 conn(0x7f1a980afcf0 msgr2=0x7f1a980b26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:24.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.626+0000 7f1a9cd11640 1 -- 172.21.15.5:0/4102876870 shutdown_connections 2023-07-14T13:12:24.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.626+0000 7f1a9cd11640 1 -- 172.21.15.5:0/4102876870 wait complete. 2023-07-14T13:12:24.681 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-14T13:12:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.794+0000 7fb089648640 1 Processor -- start 2023-07-14T13:12:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.794+0000 7fb089648640 1 -- start start 2023-07-14T13:12:24.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.794+0000 7fb089648640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0841649a0 0x7fb084166d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.794+0000 7fb089648640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0840cb570 con 0x7fb0840cb0f0 2023-07-14T13:12:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.794+0000 7fb089648640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0840cb7d0 con 0x7fb084069430 2023-07-14T13:12:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.794+0000 7fb089648640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08406c510 con 0x7fb0841649a0 2023-07-14T13:12:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.794+0000 7fb07bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb0840cb0f0 0x7fb084069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57694/0 (socket says 172.21.15.5:57694) 2023-07-14T13:12:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.794+0000 7fb07bfff640 1 -- 172.21.15.5:0/3118979059 learned_addr learned my addr 172.21.15.5:0/3118979059 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:24.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.794+0000 7fb0837fe640 1 --2- 172.21.15.5:0/3118979059 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0841649a0 0x7fb084166d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:24.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.794+0000 7fb0827fc640 1 -- 172.21.15.5:0/3118979059 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 819676421 0 0) 0x7fb0840cb570 con 0x7fb0840cb0f0 2023-07-14T13:12:24.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.794+0000 7fb0827fc640 1 -- 172.21.15.5:0/3118979059 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb070003530 con 0x7fb0840cb0f0 2023-07-14T13:12:24.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.794+0000 7fb0827fc640 1 -- 172.21.15.5:0/3118979059 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1985257619 0 0) 0x7fb0840cb7d0 con 0x7fb084069430 2023-07-14T13:12:24.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.794+0000 7fb0837fe640 1 -- 172.21.15.5:0/3118979059 >> v1:172.21.15.154:6789/0 conn(0x7fb084069430 legacy=0x7fb084160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:24.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.794+0000 7fb0837fe640 1 -- 172.21.15.5:0/3118979059 >> v1:172.21.15.5:6789/0 conn(0x7fb0840cb0f0 legacy=0x7fb084069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:24.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.794+0000 7fb0837fe640 1 -- 172.21.15.5:0/3118979059 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08406c7f0 con 0x7fb0841649a0 2023-07-14T13:12:24.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.798+0000 7fb0837fe640 1 --2- 172.21.15.5:0/3118979059 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0841649a0 0x7fb084166d80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009dc0 tx=0x7fb07c01c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1481ea03e84e07d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.798+0000 7fb0827fc640 1 -- 172.21.15.5:0/3118979059 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c0a5970 con 0x7fb0841649a0 2023-07-14T13:12:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.798+0000 7fb0827fc640 1 -- 172.21.15.5:0/3118979059 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c0a5ad0 con 0x7fb0841649a0 2023-07-14T13:12:24.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.798+0000 7fb0827fc640 1 -- 172.21.15.5:0/3118979059 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c0a5e40 con 0x7fb0841649a0 2023-07-14T13:12:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.798+0000 7fb089648640 1 -- 172.21.15.5:0/3118979059 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0841649a0 msgr2=0x7fb084166d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.798+0000 7fb089648640 1 --2- 172.21.15.5:0/3118979059 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0841649a0 0x7fb084166d80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009dc0 tx=0x7fb07c01c8b0 comp rx=0 tx=0).stop 2023-07-14T13:12:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.798+0000 7fb089648640 1 -- 172.21.15.5:0/3118979059 shutdown_connections 2023-07-14T13:12:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.798+0000 7fb089648640 1 --2- 172.21.15.5:0/3118979059 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb0841649a0 0x7fb084166d80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.798+0000 7fb089648640 1 -- 172.21.15.5:0/3118979059 >> 172.21.15.5:0/3118979059 conn(0x7fb0840b1840 msgr2=0x7fb0840cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.798+0000 7fb089648640 1 -- 172.21.15.5:0/3118979059 shutdown_connections 2023-07-14T13:12:24.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.798+0000 7fb089648640 1 -- 172.21.15.5:0/3118979059 wait complete. 2023-07-14T13:12:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.802+0000 7fb089648640 1 Processor -- start 2023-07-14T13:12:24.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.802+0000 7fb089648640 1 -- start start 2023-07-14T13:12:24.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.802+0000 7fb089648640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb084069430 0x7fb0840b4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:24.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.802+0000 7fb089648640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0840cb0f0 0x7fb0840c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:24.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.802+0000 7fb089648640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0841649a0 0x7fb084070230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:24.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.802+0000 7fb089648640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840b4c60 con 0x7fb0841649a0 2023-07-14T13:12:24.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.802+0000 7fb089648640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840b25b0 con 0x7fb0840cb0f0 2023-07-14T13:12:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.802+0000 7fb089648640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb084165b60 con 0x7fb084069430 2023-07-14T13:12:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.802+0000 7fb0837fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0841649a0 0x7fb084070230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.802+0000 7fb0837fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0841649a0 0x7fb084070230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59898/0 (socket says 172.21.15.5:59898) 2023-07-14T13:12:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.802+0000 7fb0837fe640 1 -- 172.21.15.5:0/1134817512 learned_addr learned my addr 172.21.15.5:0/1134817512 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.802+0000 7fb082ffd640 1 --2- 172.21.15.5:0/1134817512 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb084069430 0x7fb0840b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.802+0000 7fb07bfff640 1 --2- 172.21.15.5:0/1134817512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0840cb0f0 0x7fb0840c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.802+0000 7fb0837fe640 1 -- 172.21.15.5:0/1134817512 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb084069430 msgr2=0x7fb0840b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.802+0000 7fb0837fe640 1 --2- 172.21.15.5:0/1134817512 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb084069430 0x7fb0840b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.802+0000 7fb0837fe640 1 -- 172.21.15.5:0/1134817512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0840cb0f0 msgr2=0x7fb0840c7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.802+0000 7fb0837fe640 1 --2- 172.21.15.5:0/1134817512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0840cb0f0 0x7fb0840c7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.802+0000 7fb0837fe640 1 -- 172.21.15.5:0/1134817512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c009a70 con 0x7fb0841649a0 2023-07-14T13:12:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.802+0000 7fb07bfff640 1 --2- 172.21.15.5:0/1134817512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0840cb0f0 0x7fb0840c7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:12:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.802+0000 7fb0837fe640 1 --2- 172.21.15.5:0/1134817512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0841649a0 0x7fb084070230 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fb07c01cd90 tx=0x7fb07c019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.802+0000 7fb07b7fe640 1 -- 172.21.15.5:0/1134817512 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c0adcd0 con 0x7fb0841649a0 2023-07-14T13:12:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.802+0000 7fb07b7fe640 1 -- 172.21.15.5:0/1134817512 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c0ade30 con 0x7fb0841649a0 2023-07-14T13:12:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.802+0000 7fb07b7fe640 1 -- 172.21.15.5:0/1134817512 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c0b7630 con 0x7fb0841649a0 2023-07-14T13:12:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.802+0000 7fb089648640 1 -- 172.21.15.5:0/1134817512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb084165e40 con 0x7fb0841649a0 2023-07-14T13:12:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.802+0000 7fb089648640 1 -- 172.21.15.5:0/1134817512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb084166400 con 0x7fb0841649a0 2023-07-14T13:12:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.802+0000 7fb089648640 1 -- 172.21.15.5:0/1134817512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0840b2770 con 0x7fb0841649a0 2023-07-14T13:12:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.806+0000 7fb07b7fe640 1 -- 172.21.15.5:0/1134817512 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb07c0b4050 con 0x7fb0841649a0 2023-07-14T13:12:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.806+0000 7fb07b7fe640 1 --2- 172.21.15.5:0/1134817512 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fb0640663a0 0x7fb064068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.806+0000 7fb07b7fe640 1 -- 172.21.15.5:0/1134817512 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fb07c11f4a0 con 0x7fb0841649a0 2023-07-14T13:12:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.806+0000 7fb082ffd640 1 --2- 172.21.15.5:0/1134817512 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fb0640663a0 0x7fb064068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.806+0000 7fb082ffd640 1 --2- 172.21.15.5:0/1134817512 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fb0640663a0 0x7fb064068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb074000f70 tx=0x7fb074009040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.810+0000 7fb07b7fe640 1 -- 172.21.15.5:0/1134817512 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb07c0ec8f0 con 0x7fb0841649a0 2023-07-14T13:12:25.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:24.998+0000 7fb089648640 1 -- 172.21.15.5:0/1134817512 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb0840b4da0 con 0x7fb0841649a0 2023-07-14T13:12:25.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:25.929+0000 7fb07b7fe640 1 -- 172.21.15.5:0/1134817512 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v64) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb07c0eff10 con 0x7fb0841649a0 2023-07-14T13:12:25.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:25.933+0000 7fb089648640 1 -- 172.21.15.5:0/1134817512 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fb0640663a0 msgr2=0x7fb064068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:25.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:25.933+0000 7fb089648640 1 --2- 172.21.15.5:0/1134817512 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fb0640663a0 0x7fb064068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb074000f70 tx=0x7fb074009040 comp rx=0 tx=0).stop 2023-07-14T13:12:25.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:25.933+0000 7fb089648640 1 -- 172.21.15.5:0/1134817512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0841649a0 msgr2=0x7fb084070230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:25.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:25.933+0000 7fb089648640 1 --2- 172.21.15.5:0/1134817512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0841649a0 0x7fb084070230 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fb07c01cd90 tx=0x7fb07c019650 comp rx=0 tx=0).stop 2023-07-14T13:12:25.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:25.933+0000 7fb089648640 1 -- 172.21.15.5:0/1134817512 shutdown_connections 2023-07-14T13:12:25.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:25.933+0000 7fb089648640 1 --2- 172.21.15.5:0/1134817512 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fb0640663a0 0x7fb064068850 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:25.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:25.933+0000 7fb089648640 1 --2- 172.21.15.5:0/1134817512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0841649a0 0x7fb084070230 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:25.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:25.933+0000 7fb089648640 1 --2- 172.21.15.5:0/1134817512 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0840cb0f0 0x7fb0840c7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:25.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:25.933+0000 7fb089648640 1 --2- 172.21.15.5:0/1134817512 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb084069430 0x7fb0840b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:25.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:25.933+0000 7fb089648640 1 -- 172.21.15.5:0/1134817512 >> 172.21.15.5:0/1134817512 conn(0x7fb0840b1840 msgr2=0x7fb084070fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:25.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:25.933+0000 7fb089648640 1 -- 172.21.15.5:0/1134817512 shutdown_connections 2023-07-14T13:12:25.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:25.933+0000 7fb089648640 1 -- 172.21.15.5:0/1134817512 wait complete. 2023-07-14T13:12:25.993 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-14T13:12:25.993 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-14T13:12:26.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.109+0000 7f84bcc34640 1 Processor -- start 2023-07-14T13:12:26.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.109+0000 7f84bcc34640 1 -- start start 2023-07-14T13:12:26.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.113+0000 7f84bcc34640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f84b8070f30 0x7f84b80ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:26.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.113+0000 7f84bcc34640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84b80af2b0 0x7f84b815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:26.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.113+0000 7f84bcc34640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b8159d70 con 0x7f84b8069430 2023-07-14T13:12:26.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.113+0000 7f84bcc34640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b80c9c60 con 0x7f84b8070f30 2023-07-14T13:12:26.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.113+0000 7f84bcc34640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b80c9f40 con 0x7f84b80af2b0 2023-07-14T13:12:26.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.113+0000 7f84affff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f84b8070f30 0x7f84b80ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:26.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.113+0000 7f84b6d9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84b80af2b0 0x7f84b815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:26.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.113+0000 7f84affff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f84b8070f30 0x7f84b80ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:48202/0 (socket says 172.21.15.5:48202) 2023-07-14T13:12:26.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.113+0000 7f84affff640 1 -- 172.21.15.5:0/912989848 learned_addr learned my addr 172.21.15.5:0/912989848 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:26.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.113+0000 7f84affff640 1 -- 172.21.15.5:0/912989848 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84b80af2b0 msgr2=0x7f84b815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:26.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.113+0000 7f84affff640 1 --2- 172.21.15.5:0/912989848 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84b80af2b0 0x7f84b815a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:26.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.113+0000 7f84affff640 1 -- 172.21.15.5:0/912989848 >> v1:172.21.15.154:6789/0 conn(0x7f84b8069430 legacy=0x7f84b8069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:26.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.113+0000 7f84affff640 1 -- 172.21.15.5:0/912989848 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b80ca220 con 0x7f84b8070f30 2023-07-14T13:12:26.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.117+0000 7f84affff640 1 --2- 172.21.15.5:0/912989848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84b8070f30 0x7f84b80ad6f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009870 tx=0x7f84a001c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c27c86d1f116dc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:26.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.117+0000 7f84b5d9b640 1 -- 172.21.15.5:0/912989848 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a00a9400 con 0x7f84b8070f30 2023-07-14T13:12:26.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.117+0000 7f84b5d9b640 1 -- 172.21.15.5:0/912989848 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a00a9560 con 0x7f84b8070f30 2023-07-14T13:12:26.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.117+0000 7f84b5d9b640 1 -- 172.21.15.5:0/912989848 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a00a98f0 con 0x7f84b8070f30 2023-07-14T13:12:26.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.117+0000 7f84bcc34640 1 -- 172.21.15.5:0/912989848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84b8070f30 msgr2=0x7f84b80ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:26.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.117+0000 7f84bcc34640 1 --2- 172.21.15.5:0/912989848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84b8070f30 0x7f84b80ad6f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009870 tx=0x7f84a001c540 comp rx=0 tx=0).stop 2023-07-14T13:12:26.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.117+0000 7f84bcc34640 1 -- 172.21.15.5:0/912989848 shutdown_connections 2023-07-14T13:12:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.117+0000 7f84bcc34640 1 --2- 172.21.15.5:0/912989848 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84b80af2b0 0x7f84b815a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.117+0000 7f84bcc34640 1 --2- 172.21.15.5:0/912989848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84b8070f30 0x7f84b80ad6f0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.117+0000 7f84bcc34640 1 -- 172.21.15.5:0/912989848 >> 172.21.15.5:0/912989848 conn(0x7f84b80cde90 msgr2=0x7f84b80ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.117+0000 7f84bcc34640 1 -- 172.21.15.5:0/912989848 shutdown_connections 2023-07-14T13:12:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.117+0000 7f84bcc34640 1 -- 172.21.15.5:0/912989848 wait complete. 2023-07-14T13:12:26.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.117+0000 7f84bcc34640 1 Processor -- start 2023-07-14T13:12:26.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.117+0000 7f84bcc34640 1 -- start start 2023-07-14T13:12:26.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.121+0000 7f84bcc34640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84b8069430 0x7f84b814fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:26.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.121+0000 7f84bcc34640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84b8070f30 0x7f84b8153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:26.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.121+0000 7f84bcc34640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84b80af2b0 0x7f84b8154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:26.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.121+0000 7f84bcc34640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b80c7c40 con 0x7f84b8070f30 2023-07-14T13:12:26.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.121+0000 7f84bcc34640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b81f5010 con 0x7f84b80af2b0 2023-07-14T13:12:26.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.121+0000 7f84bcc34640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b81f4d30 con 0x7f84b8069430 2023-07-14T13:12:26.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.121+0000 7f84affff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84b8070f30 0x7f84b8153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:26.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.121+0000 7f84affff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84b8070f30 0x7f84b8153d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59914/0 (socket says 172.21.15.5:59914) 2023-07-14T13:12:26.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.121+0000 7f84affff640 1 -- 172.21.15.5:0/2034044699 learned_addr learned my addr 172.21.15.5:0/2034044699 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:26.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.121+0000 7f84b6d9d640 1 --2- 172.21.15.5:0/2034044699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84b80af2b0 0x7f84b8154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:26.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.121+0000 7f84b659c640 1 --2- 172.21.15.5:0/2034044699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84b8069430 0x7f84b814fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:26.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.121+0000 7f84affff640 1 -- 172.21.15.5:0/2034044699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84b8069430 msgr2=0x7f84b814fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:26.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.121+0000 7f84affff640 1 --2- 172.21.15.5:0/2034044699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84b8069430 0x7f84b814fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:26.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.121+0000 7f84affff640 1 -- 172.21.15.5:0/2034044699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84b80af2b0 msgr2=0x7f84b8154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:26.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.121+0000 7f84affff640 1 --2- 172.21.15.5:0/2034044699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84b80af2b0 0x7f84b8154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:26.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.121+0000 7f84affff640 1 -- 172.21.15.5:0/2034044699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a00094d0 con 0x7f84b8070f30 2023-07-14T13:12:26.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.121+0000 7f84affff640 1 --2- 172.21.15.5:0/2034044699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84b8070f30 0x7f84b8153d10 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f84a001abf0 tx=0x7f84a001ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:26.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.121+0000 7f84aeffd640 1 -- 172.21.15.5:0/2034044699 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a00a9400 con 0x7f84b8070f30 2023-07-14T13:12:26.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.121+0000 7f84aeffd640 1 -- 172.21.15.5:0/2034044699 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a00b1820 con 0x7f84b8070f30 2023-07-14T13:12:26.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.121+0000 7f84aeffd640 1 -- 172.21.15.5:0/2034044699 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a00b1bd0 con 0x7f84b8070f30 2023-07-14T13:12:26.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.121+0000 7f84bcc34640 1 -- 172.21.15.5:0/2034044699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b81f77e0 con 0x7f84b8070f30 2023-07-14T13:12:26.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.121+0000 7f84bcc34640 1 -- 172.21.15.5:0/2034044699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b81f7da0 con 0x7f84b8070f30 2023-07-14T13:12:26.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.121+0000 7f84bcc34640 1 -- 172.21.15.5:0/2034044699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b80678d0 con 0x7f84b8070f30 2023-07-14T13:12:26.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.125+0000 7f84aeffd640 1 -- 172.21.15.5:0/2034044699 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f84a00b1d30 con 0x7f84b8070f30 2023-07-14T13:12:26.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.125+0000 7f84aeffd640 1 --2- 172.21.15.5:0/2034044699 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f84980663a0 0x7f8498068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:26.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.125+0000 7f84aeffd640 1 -- 172.21.15.5:0/2034044699 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f84a011e630 con 0x7f84b8070f30 2023-07-14T13:12:26.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.125+0000 7f84b659c640 1 --2- 172.21.15.5:0/2034044699 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f84980663a0 0x7f8498068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:26.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.125+0000 7f84b659c640 1 --2- 172.21.15.5:0/2034044699 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f84980663a0 0x7f8498068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f84a8000f70 tx=0x7f84a8009040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:26.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.129+0000 7f84aeffd640 1 -- 172.21.15.5:0/2034044699 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f84a00eb980 con 0x7f84b8070f30 2023-07-14T13:12:26.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.321+0000 7f84bcc34640 1 -- 172.21.15.5:0/2034044699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f84b80cd160 con 0x7f84b8070f30 2023-07-14T13:12:26.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.933+0000 7f84aeffd640 1 -- 172.21.15.5:0/2034044699 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v65) v1 ==== 122+0+0 (secure 0 0 0) 0x7f84a00a6020 con 0x7f84b8070f30 2023-07-14T13:12:26.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.933+0000 7f84bcc34640 1 -- 172.21.15.5:0/2034044699 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f84980663a0 msgr2=0x7f8498068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:26.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.933+0000 7f84bcc34640 1 --2- 172.21.15.5:0/2034044699 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f84980663a0 0x7f8498068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f84a8000f70 tx=0x7f84a8009040 comp rx=0 tx=0).stop 2023-07-14T13:12:26.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.933+0000 7f84bcc34640 1 -- 172.21.15.5:0/2034044699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84b8070f30 msgr2=0x7f84b8153d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:26.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.933+0000 7f84bcc34640 1 --2- 172.21.15.5:0/2034044699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84b8070f30 0x7f84b8153d10 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f84a001abf0 tx=0x7f84a001ad80 comp rx=0 tx=0).stop 2023-07-14T13:12:26.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.937+0000 7f84bcc34640 1 -- 172.21.15.5:0/2034044699 shutdown_connections 2023-07-14T13:12:26.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.937+0000 7f84bcc34640 1 --2- 172.21.15.5:0/2034044699 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f84980663a0 0x7f8498068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:26.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.937+0000 7f84bcc34640 1 --2- 172.21.15.5:0/2034044699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84b80af2b0 0x7f84b8154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:26.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.937+0000 7f84bcc34640 1 --2- 172.21.15.5:0/2034044699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84b8070f30 0x7f84b8153d10 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:26.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.937+0000 7f84bcc34640 1 --2- 172.21.15.5:0/2034044699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84b8069430 0x7f84b814fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:26.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.937+0000 7f84bcc34640 1 -- 172.21.15.5:0/2034044699 >> 172.21.15.5:0/2034044699 conn(0x7f84b80cde90 msgr2=0x7f84b806fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:26.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.937+0000 7f84bcc34640 1 -- 172.21.15.5:0/2034044699 shutdown_connections 2023-07-14T13:12:26.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:26.937+0000 7f84bcc34640 1 -- 172.21.15.5:0/2034044699 wait complete. 2023-07-14T13:12:26.994 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-14T13:12:26.995 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:12:27.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.109+0000 7f207e8d8640 1 Processor -- start 2023-07-14T13:12:27.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.109+0000 7f207e8d8640 1 -- start start 2023-07-14T13:12:27.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.109+0000 7f207e8d8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f20780b7c70 0x7f20780d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:27.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.109+0000 7f207e8d8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f20780d1850 0x7f207815f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:27.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.109+0000 7f207e8d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20780d1300 0x7f207815fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:27.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.109+0000 7f207e8d8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20780d1190 con 0x7f20780b7c70 2023-07-14T13:12:27.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.109+0000 7f207e8d8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2078160600 con 0x7f20780d1850 2023-07-14T13:12:27.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.109+0000 7f207e8d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20781600d0 con 0x7f20780d1300 2023-07-14T13:12:27.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.109+0000 7f2077fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f20780b7c70 0x7f20780d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:27.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.109+0000 7f2077fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f20780b7c70 0x7f20780d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59926/0 (socket says 172.21.15.5:59926) 2023-07-14T13:12:27.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.109+0000 7f2077fff640 1 -- 172.21.15.5:0/2796600079 learned_addr learned my addr 172.21.15.5:0/2796600079 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:27.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.109+0000 7f207ce75640 1 --2- 172.21.15.5:0/2796600079 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20780d1300 0x7f207815fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:27.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.109+0000 7f20777fe640 1 --2- 172.21.15.5:0/2796600079 >> v2:172.21.15.154:3300/0 conn(0x7f20780d1850 0x7f207815f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:27.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.109+0000 7f2077fff640 1 -- 172.21.15.5:0/2796600079 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20780d1300 msgr2=0x7f207815fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:27.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.109+0000 7f2077fff640 1 --2- 172.21.15.5:0/2796600079 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20780d1300 0x7f207815fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:27.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.109+0000 7f2077fff640 1 -- 172.21.15.5:0/2796600079 >> v2:172.21.15.154:3300/0 conn(0x7f20780d1850 msgr2=0x7f207815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:27.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.109+0000 7f2077fff640 1 --2- 172.21.15.5:0/2796600079 >> v2:172.21.15.154:3300/0 conn(0x7f20780d1850 0x7f207815f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:27.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.109+0000 7f2077fff640 1 -- 172.21.15.5:0/2796600079 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20780ccaf0 con 0x7f20780b7c70 2023-07-14T13:12:27.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.109+0000 7f20777fe640 1 --2- 172.21.15.5:0/2796600079 >> v2:172.21.15.154:3300/0 conn(0x7f20780d1850 0x7f207815f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:27.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.113+0000 7f2077fff640 1 --2- 172.21.15.5:0/2796600079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20780b7c70 0x7f20780d0c50 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f20780b1180 tx=0x7f206801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf74297dc8fd5ef server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:27.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.113+0000 7f2076ffd640 1 -- 172.21.15.5:0/2796600079 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20680ac600 con 0x7f20780b7c70 2023-07-14T13:12:27.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.113+0000 7f2076ffd640 1 -- 172.21.15.5:0/2796600079 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20680a8050 con 0x7f20780b7c70 2023-07-14T13:12:27.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.113+0000 7f2076ffd640 1 -- 172.21.15.5:0/2796600079 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20680ac980 con 0x7f20780b7c70 2023-07-14T13:12:27.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.113+0000 7f207e8d8640 1 -- 172.21.15.5:0/2796600079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20780b7c70 msgr2=0x7f20780d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:27.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.113+0000 7f207e8d8640 1 --2- 172.21.15.5:0/2796600079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20780b7c70 0x7f20780d0c50 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f20780b1180 tx=0x7f206801c4d0 comp rx=0 tx=0).stop 2023-07-14T13:12:27.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.113+0000 7f207e8d8640 1 -- 172.21.15.5:0/2796600079 shutdown_connections 2023-07-14T13:12:27.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.113+0000 7f207e8d8640 1 --2- 172.21.15.5:0/2796600079 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20780d1300 0x7f207815fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:27.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.113+0000 7f207e8d8640 1 --2- 172.21.15.5:0/2796600079 >> v2:172.21.15.154:3300/0 conn(0x7f20780d1850 0x7f207815f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:27.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.113+0000 7f207e8d8640 1 --2- 172.21.15.5:0/2796600079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20780b7c70 0x7f20780d0c50 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:27.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.113+0000 7f207e8d8640 1 -- 172.21.15.5:0/2796600079 >> 172.21.15.5:0/2796600079 conn(0x7f20780650b0 msgr2=0x7f20780654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:27.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.113+0000 7f207e8d8640 1 -- 172.21.15.5:0/2796600079 shutdown_connections 2023-07-14T13:12:27.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.113+0000 7f207e8d8640 1 -- 172.21.15.5:0/2796600079 wait complete. 2023-07-14T13:12:27.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.117+0000 7f207e8d8640 1 Processor -- start 2023-07-14T13:12:27.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.117+0000 7f207e8d8640 1 -- start start 2023-07-14T13:12:27.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.117+0000 7f207e8d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20780b7c70 0x7f20780c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:27.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.117+0000 7f207e8d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20780d1300 0x7f20780b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:27.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.117+0000 7f207e8d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20780d1850 0x7f20781f68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:27.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.117+0000 7f207e8d8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20780c8460 con 0x7f20780d1850 2023-07-14T13:12:27.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.117+0000 7f207e8d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20780b6700 con 0x7f20780d1300 2023-07-14T13:12:27.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.117+0000 7f207e8d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f207815c500 con 0x7f20780b7c70 2023-07-14T13:12:27.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.117+0000 7f207ce75640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20780d1850 0x7f20781f68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:27.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.117+0000 7f207ce75640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20780d1850 0x7f20781f68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59936/0 (socket says 172.21.15.5:59936) 2023-07-14T13:12:27.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.117+0000 7f207ce75640 1 -- 172.21.15.5:0/2512447913 learned_addr learned my addr 172.21.15.5:0/2512447913 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:27.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.117+0000 7f207ce75640 1 -- 172.21.15.5:0/2512447913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20780b7c70 msgr2=0x7f20780c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:27.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.117+0000 7f207ce75640 1 --2- 172.21.15.5:0/2512447913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20780b7c70 0x7f20780c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:27.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.117+0000 7f207ce75640 1 -- 172.21.15.5:0/2512447913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20780d1300 msgr2=0x7f20780b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:27.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.117+0000 7f207ce75640 1 --2- 172.21.15.5:0/2512447913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20780d1300 0x7f20780b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:27.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.117+0000 7f207ce75640 1 -- 172.21.15.5:0/2512447913 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20680094d0 con 0x7f20780d1850 2023-07-14T13:12:27.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.117+0000 7f207ce75640 1 --2- 172.21.15.5:0/2512447913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20780d1850 0x7f20781f68b0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f2070009dd0 tx=0x7f207000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:27.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.117+0000 7f2074ff9640 1 -- 172.21.15.5:0/2512447913 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2070014480 con 0x7f20780d1850 2023-07-14T13:12:27.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.117+0000 7f2074ff9640 1 -- 172.21.15.5:0/2512447913 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207000f040 con 0x7f20780d1850 2023-07-14T13:12:27.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.117+0000 7f207e8d8640 1 -- 172.21.15.5:0/2512447913 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20780c8c10 con 0x7f20780d1850 2023-07-14T13:12:27.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.117+0000 7f2074ff9640 1 -- 172.21.15.5:0/2512447913 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2070014820 con 0x7f20780d1850 2023-07-14T13:12:27.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.117+0000 7f207e8d8640 1 -- 172.21.15.5:0/2512447913 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20780c8930 con 0x7f20780d1850 2023-07-14T13:12:27.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.121+0000 7f207e8d8640 1 -- 172.21.15.5:0/2512447913 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20780678d0 con 0x7f20780d1850 2023-07-14T13:12:27.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.121+0000 7f2074ff9640 1 -- 172.21.15.5:0/2512447913 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2070014980 con 0x7f20780d1850 2023-07-14T13:12:27.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.121+0000 7f2074ff9640 1 --2- 172.21.15.5:0/2512447913 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f20640663a0 0x7f2064068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:27.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.121+0000 7f2074ff9640 1 -- 172.21.15.5:0/2512447913 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f2070084c40 con 0x7f20780d1850 2023-07-14T13:12:27.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.121+0000 7f2077fff640 1 --2- 172.21.15.5:0/2512447913 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f20640663a0 0x7f2064068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:27.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.121+0000 7f2077fff640 1 --2- 172.21.15.5:0/2512447913 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f20640663a0 0x7f2064068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f20680ae000 tx=0x7f2068008040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:27.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.125+0000 7f2074ff9640 1 -- 172.21.15.5:0/2512447913 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2070051e80 con 0x7f20780d1850 2023-07-14T13:12:27.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.313+0000 7f207e8d8640 1 -- 172.21.15.5:0/2512447913 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f207815c640 con 0x7f20780d1850 2023-07-14T13:12:27.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.313+0000 7f2074ff9640 1 -- 172.21.15.5:0/2512447913 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4711 (secure 0 0 0) 0x7f20700554a0 con 0x7f20780d1850 2023-07-14T13:12:27.349 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:27.350 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7373,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3424293950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3424293950},{"type":"v1","addr":"172.21.15.5:6834","nonce":3424293950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7379,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/1672977104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1672977104},{"type":"v1","addr":"172.21.15.154:6836","nonce":1672977104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":8401,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2517721716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2517721716},{"type":"v1","addr":"172.21.15.154:6837","nonce":2517721716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:12:23.316419+0000","modified":"2023-07-14T13:12:26.932428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8808},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8808":{"gid":8808,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/4283823156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":4283823156},{"type":"v1","addr":"172.21.15.5:6835","nonce":4283823156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-14T13:12:27.351 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 65 2023-07-14T13:12:27.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.313+0000 7f207e8d8640 1 -- 172.21.15.5:0/2512447913 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f20640663a0 msgr2=0x7f2064068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:27.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.313+0000 7f207e8d8640 1 --2- 172.21.15.5:0/2512447913 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f20640663a0 0x7f2064068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f20680ae000 tx=0x7f2068008040 comp rx=0 tx=0).stop 2023-07-14T13:12:27.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.313+0000 7f207e8d8640 1 -- 172.21.15.5:0/2512447913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20780d1850 msgr2=0x7f20781f68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:27.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.313+0000 7f207e8d8640 1 --2- 172.21.15.5:0/2512447913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20780d1850 0x7f20781f68b0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f2070009dd0 tx=0x7f207000c490 comp rx=0 tx=0).stop 2023-07-14T13:12:27.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.313+0000 7f207e8d8640 1 -- 172.21.15.5:0/2512447913 shutdown_connections 2023-07-14T13:12:27.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.313+0000 7f207e8d8640 1 --2- 172.21.15.5:0/2512447913 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f20640663a0 0x7f2064068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:27.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.313+0000 7f207e8d8640 1 --2- 172.21.15.5:0/2512447913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20780d1850 0x7f20781f68b0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:27.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.313+0000 7f207e8d8640 1 --2- 172.21.15.5:0/2512447913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20780d1300 0x7f20780b61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:27.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.313+0000 7f207e8d8640 1 --2- 172.21.15.5:0/2512447913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f20780b7c70 0x7f20780c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:27.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.313+0000 7f207e8d8640 1 -- 172.21.15.5:0/2512447913 >> 172.21.15.5:0/2512447913 conn(0x7f20780650b0 msgr2=0x7f20780b2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:27.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.313+0000 7f207e8d8640 1 -- 172.21.15.5:0/2512447913 shutdown_connections 2023-07-14T13:12:27.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.313+0000 7f207e8d8640 1 -- 172.21.15.5:0/2512447913 wait complete. 2023-07-14T13:12:27.370 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:12:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.477+0000 7f13eb093640 1 Processor -- start 2023-07-14T13:12:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.477+0000 7f13eb093640 1 -- start start 2023-07-14T13:12:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.481+0000 7f13eb093640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f13e415bc00 0x7f13e40ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.481+0000 7f13eb093640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e40c9c30 con 0x7f13e4069430 2023-07-14T13:12:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.481+0000 7f13eb093640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e415bfd0 con 0x7f13e4160450 2023-07-14T13:12:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.481+0000 7f13eb093640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e40c96b0 con 0x7f13e415bc00 2023-07-14T13:12:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.481+0000 7f13e9630640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f13e4069430 0x7f13e4069830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57700/0 (socket says 172.21.15.5:57700) 2023-07-14T13:12:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.481+0000 7f13e9630640 1 -- 172.21.15.5:0/2576454027 learned_addr learned my addr 172.21.15.5:0/2576454027 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.481+0000 7f13e8e2f640 1 --2- 172.21.15.5:0/2576454027 >> v2:172.21.15.154:3300/0 conn(0x7f13e415bc00 0x7f13e40ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.481+0000 7f13e37fe640 1 -- 172.21.15.5:0/2576454027 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333402817 0 0) 0x7f13e40c9c30 con 0x7f13e4069430 2023-07-14T13:12:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.481+0000 7f13e37fe640 1 -- 172.21.15.5:0/2576454027 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13d4003530 con 0x7f13e4069430 2023-07-14T13:12:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.481+0000 7f13e37fe640 1 -- 172.21.15.5:0/2576454027 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276094501 0 0) 0x7f13e415bfd0 con 0x7f13e4160450 2023-07-14T13:12:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.481+0000 7f13e37fe640 1 -- 172.21.15.5:0/2576454027 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13e40c9c30 con 0x7f13e4160450 2023-07-14T13:12:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.481+0000 7f13e8e2f640 1 -- 172.21.15.5:0/2576454027 >> v1:172.21.15.154:6789/0 conn(0x7f13e4160450 legacy=0x7f13e406e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:27.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.481+0000 7f13e37fe640 1 -- 172.21.15.5:0/2576454027 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1641464855 0 0) 0x7f13d4003530 con 0x7f13e4069430 2023-07-14T13:12:27.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.481+0000 7f13e8e2f640 1 -- 172.21.15.5:0/2576454027 >> v1:172.21.15.5:6789/0 conn(0x7f13e4069430 legacy=0x7f13e4069830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:27.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.481+0000 7f13e8e2f640 1 -- 172.21.15.5:0/2576454027 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e40cee30 con 0x7f13e415bc00 2023-07-14T13:12:27.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.485+0000 7f13e8e2f640 1 --2- 172.21.15.5:0/2576454027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13e415bc00 0x7f13e40ce8f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f13d80097c0 tx=0x7f13d801c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b728dea8dbe7047 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:27.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.485+0000 7f13e37fe640 1 -- 172.21.15.5:0/2576454027 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc001a00 con 0x7f13e415bc00 2023-07-14T13:12:27.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.485+0000 7f13e37fe640 1 -- 172.21.15.5:0/2576454027 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d80a7050 con 0x7f13e415bc00 2023-07-14T13:12:27.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.485+0000 7f13e37fe640 1 -- 172.21.15.5:0/2576454027 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d80ab620 con 0x7f13e415bc00 2023-07-14T13:12:27.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.485+0000 7f13eb093640 1 -- 172.21.15.5:0/2576454027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13e415bc00 msgr2=0x7f13e40ce8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:27.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.485+0000 7f13eb093640 1 --2- 172.21.15.5:0/2576454027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13e415bc00 0x7f13e40ce8f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f13d80097c0 tx=0x7f13d801c370 comp rx=0 tx=0).stop 2023-07-14T13:12:27.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.485+0000 7f13eb093640 1 -- 172.21.15.5:0/2576454027 shutdown_connections 2023-07-14T13:12:27.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.485+0000 7f13eb093640 1 --2- 172.21.15.5:0/2576454027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13e415bc00 0x7f13e40ce8f0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:27.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.485+0000 7f13eb093640 1 -- 172.21.15.5:0/2576454027 >> 172.21.15.5:0/2576454027 conn(0x7f13e40b1840 msgr2=0x7f13e40cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:27.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.485+0000 7f13eb093640 1 -- 172.21.15.5:0/2576454027 shutdown_connections 2023-07-14T13:12:27.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.485+0000 7f13eb093640 1 -- 172.21.15.5:0/2576454027 wait complete. 2023-07-14T13:12:27.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.485+0000 7f13eb093640 1 Processor -- start 2023-07-14T13:12:27.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.485+0000 7f13eb093640 1 -- start start 2023-07-14T13:12:27.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.489+0000 7f13eb093640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e4069430 0x7f13e4144920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:27.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.489+0000 7f13eb093640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13e415bc00 0x7f13e406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:27.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.489+0000 7f13eb093640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13e4160450 0x7f13e406d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:27.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.489+0000 7f13eb093640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e4150dc0 con 0x7f13e4069430 2023-07-14T13:12:27.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.489+0000 7f13eb093640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e4150240 con 0x7f13e4160450 2023-07-14T13:12:27.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.489+0000 7f13eb093640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e4150520 con 0x7f13e415bc00 2023-07-14T13:12:27.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.489+0000 7f13e8e2f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e4069430 0x7f13e4144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:27.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.489+0000 7f13e8e2f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e4069430 0x7f13e4144920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59946/0 (socket says 172.21.15.5:59946) 2023-07-14T13:12:27.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.489+0000 7f13e8e2f640 1 -- 172.21.15.5:0/3057606206 learned_addr learned my addr 172.21.15.5:0/3057606206 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:27.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.489+0000 7f13e3fff640 1 --2- 172.21.15.5:0/3057606206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13e415bc00 0x7f13e406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:27.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.489+0000 7f13e9630640 1 --2- 172.21.15.5:0/3057606206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13e4160450 0x7f13e406d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:27.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.489+0000 7f13e8e2f640 1 -- 172.21.15.5:0/3057606206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13e415bc00 msgr2=0x7f13e406d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:27.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.489+0000 7f13e8e2f640 1 --2- 172.21.15.5:0/3057606206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13e415bc00 0x7f13e406d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:27.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.489+0000 7f13e8e2f640 1 -- 172.21.15.5:0/3057606206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13e4160450 msgr2=0x7f13e406d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:27.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.489+0000 7f13e8e2f640 1 --2- 172.21.15.5:0/3057606206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13e4160450 0x7f13e406d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:27.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.489+0000 7f13e8e2f640 1 -- 172.21.15.5:0/3057606206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d8009420 con 0x7f13e4069430 2023-07-14T13:12:27.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.489+0000 7f13e9630640 1 --2- 172.21.15.5:0/3057606206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13e4160450 0x7f13e406d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:27.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.489+0000 7f13e8e2f640 1 --2- 172.21.15.5:0/3057606206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e4069430 0x7f13e4144920 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f13d80ae040 tx=0x7f13d8019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:27.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.489+0000 7f13e17fa640 1 -- 172.21.15.5:0/3057606206 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d80bb070 con 0x7f13e4069430 2023-07-14T13:12:27.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.489+0000 7f13e17fa640 1 -- 172.21.15.5:0/3057606206 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d80abc70 con 0x7f13e4069430 2023-07-14T13:12:27.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.489+0000 7f13e17fa640 1 -- 172.21.15.5:0/3057606206 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d8004020 con 0x7f13e4069430 2023-07-14T13:12:27.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.489+0000 7f13eb093640 1 -- 172.21.15.5:0/3057606206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e4150800 con 0x7f13e4069430 2023-07-14T13:12:27.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.489+0000 7f13eb093640 1 -- 172.21.15.5:0/3057606206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e4144e60 con 0x7f13e4069430 2023-07-14T13:12:27.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.489+0000 7f13eb093640 1 -- 172.21.15.5:0/3057606206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e40678d0 con 0x7f13e4069430 2023-07-14T13:12:27.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.489+0000 7f13e17fa640 1 -- 172.21.15.5:0/3057606206 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f13d80b2040 con 0x7f13e4069430 2023-07-14T13:12:27.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.493+0000 7f13e17fa640 1 --2- 172.21.15.5:0/3057606206 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f13c80663a0 0x7f13c8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:27.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.493+0000 7f13e17fa640 1 -- 172.21.15.5:0/3057606206 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f13d811d700 con 0x7f13e4069430 2023-07-14T13:12:27.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.493+0000 7f13e3fff640 1 --2- 172.21.15.5:0/3057606206 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f13c80663a0 0x7f13c8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:27.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.493+0000 7f13e3fff640 1 --2- 172.21.15.5:0/3057606206 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f13c80663a0 0x7f13c8068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f13e40af390 tx=0x7f13d0009040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:27.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.497+0000 7f13e17fa640 1 -- 172.21.15.5:0/3057606206 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f13d80ea940 con 0x7f13e4069430 2023-07-14T13:12:27.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.653+0000 7f13eb093640 1 -- 172.21.15.5:0/3057606206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13e40ae8d0 con 0x7f13e4069430 2023-07-14T13:12:27.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.657+0000 7f13e17fa640 1 -- 172.21.15.5:0/3057606206 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+18357 (secure 0 0 0) 0x7f13d80edf60 con 0x7f13e4069430 2023-07-14T13:12:27.693 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:27.693 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":142,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:12:24.915612+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:12:21.430786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-14T13:12:22.293915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:12:27.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.657+0000 7f13eb093640 1 -- 172.21.15.5:0/3057606206 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f13c80663a0 msgr2=0x7f13c8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:27.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.657+0000 7f13eb093640 1 --2- 172.21.15.5:0/3057606206 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f13c80663a0 0x7f13c8068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f13e40af390 tx=0x7f13d0009040 comp rx=0 tx=0).stop 2023-07-14T13:12:27.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.657+0000 7f13eb093640 1 -- 172.21.15.5:0/3057606206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e4069430 msgr2=0x7f13e4144920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:27.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.657+0000 7f13eb093640 1 --2- 172.21.15.5:0/3057606206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e4069430 0x7f13e4144920 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f13d80ae040 tx=0x7f13d8019110 comp rx=0 tx=0).stop 2023-07-14T13:12:27.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.657+0000 7f13eb093640 1 -- 172.21.15.5:0/3057606206 shutdown_connections 2023-07-14T13:12:27.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.657+0000 7f13eb093640 1 --2- 172.21.15.5:0/3057606206 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f13c80663a0 0x7f13c8068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:27.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.657+0000 7f13eb093640 1 --2- 172.21.15.5:0/3057606206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13e4160450 0x7f13e406d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:27.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.657+0000 7f13eb093640 1 --2- 172.21.15.5:0/3057606206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13e415bc00 0x7f13e406d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:27.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.657+0000 7f13eb093640 1 --2- 172.21.15.5:0/3057606206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e4069430 0x7f13e4144920 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:27.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.657+0000 7f13eb093640 1 -- 172.21.15.5:0/3057606206 >> 172.21.15.5:0/3057606206 conn(0x7f13e40b1840 msgr2=0x7f13e406c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:27.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.657+0000 7f13eb093640 1 -- 172.21.15.5:0/3057606206 shutdown_connections 2023-07-14T13:12:27.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.657+0000 7f13eb093640 1 -- 172.21.15.5:0/3057606206 wait complete. 2023-07-14T13:12:27.714 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-14T13:12:27.714 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:12:27.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.821+0000 7f53bdfd2640 1 Processor -- start 2023-07-14T13:12:27.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.821+0000 7f53bdfd2640 1 -- start start 2023-07-14T13:12:27.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.821+0000 7f53bdfd2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f53b80ae1f0 0x7f53b80b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:27.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.821+0000 7f53bdfd2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f53b806e160 0x7f53b806bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.821+0000 7f53bdfd2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b806a440 con 0x7f53b806c260 2023-07-14T13:12:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.821+0000 7f53bdfd2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b806c660 con 0x7f53b80ae1f0 2023-07-14T13:12:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.821+0000 7f53bdfd2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b80b24f0 con 0x7f53b806e160 2023-07-14T13:12:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.821+0000 7f53b77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f53b80ae1f0 0x7f53b80b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.821+0000 7f53b77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f53b80ae1f0 0x7f53b80b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59948/0 (socket says 172.21.15.5:59948) 2023-07-14T13:12:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.821+0000 7f53b77fe640 1 -- 172.21.15.5:0/3378708662 learned_addr learned my addr 172.21.15.5:0/3378708662 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:27.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.821+0000 7f53b6ffd640 1 --2- 172.21.15.5:0/3378708662 >> v2:172.21.15.154:3300/0 conn(0x7f53b806e160 0x7f53b806bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:27.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.825+0000 7f53b77fe640 1 -- 172.21.15.5:0/3378708662 >> v2:172.21.15.154:3300/0 conn(0x7f53b806e160 msgr2=0x7f53b806bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:27.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.825+0000 7f53b77fe640 1 --2- 172.21.15.5:0/3378708662 >> v2:172.21.15.154:3300/0 conn(0x7f53b806e160 0x7f53b806bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:27.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.825+0000 7f53b77fe640 1 -- 172.21.15.5:0/3378708662 >> v1:172.21.15.5:6789/0 conn(0x7f53b806c260 legacy=0x7f53b815f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:27.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.825+0000 7f53b77fe640 1 -- 172.21.15.5:0/3378708662 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b80b27d0 con 0x7f53b80ae1f0 2023-07-14T13:12:27.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.825+0000 7f53b77fe640 1 --2- 172.21.15.5:0/3378708662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53b80ae1f0 0x7f53b80b1e60 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f53b80cf720 tx=0x7f53a801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9c471a1d9030b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:27.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.825+0000 7f53b67fc640 1 -- 172.21.15.5:0/3378708662 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a80ab5f0 con 0x7f53b80ae1f0 2023-07-14T13:12:27.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.825+0000 7f53b67fc640 1 -- 172.21.15.5:0/3378708662 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a80ab750 con 0x7f53b80ae1f0 2023-07-14T13:12:27.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.825+0000 7f53b67fc640 1 -- 172.21.15.5:0/3378708662 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a80abae0 con 0x7f53b80ae1f0 2023-07-14T13:12:27.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.825+0000 7f53bdfd2640 1 -- 172.21.15.5:0/3378708662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53b80ae1f0 msgr2=0x7f53b80b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:27.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.825+0000 7f53bdfd2640 1 --2- 172.21.15.5:0/3378708662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53b80ae1f0 0x7f53b80b1e60 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f53b80cf720 tx=0x7f53a801c4d0 comp rx=0 tx=0).stop 2023-07-14T13:12:27.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.825+0000 7f53bdfd2640 1 -- 172.21.15.5:0/3378708662 shutdown_connections 2023-07-14T13:12:27.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.825+0000 7f53bdfd2640 1 --2- 172.21.15.5:0/3378708662 >> v2:172.21.15.154:3300/0 conn(0x7f53b806e160 0x7f53b806bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:27.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.825+0000 7f53bdfd2640 1 --2- 172.21.15.5:0/3378708662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53b80ae1f0 0x7f53b80b1e60 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:27.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.825+0000 7f53bdfd2640 1 -- 172.21.15.5:0/3378708662 >> 172.21.15.5:0/3378708662 conn(0x7f53b80b1300 msgr2=0x7f53b80ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:27.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.829+0000 7f53bdfd2640 1 -- 172.21.15.5:0/3378708662 shutdown_connections 2023-07-14T13:12:27.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.829+0000 7f53bdfd2640 1 -- 172.21.15.5:0/3378708662 wait complete. 2023-07-14T13:12:27.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.829+0000 7f53bdfd2640 1 Processor -- start 2023-07-14T13:12:27.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.829+0000 7f53bdfd2640 1 -- start start 2023-07-14T13:12:27.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.829+0000 7f53bdfd2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b806c260 0x7f53b815d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:27.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.829+0000 7f53bdfd2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53b806e160 0x7f53b80cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:27.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.829+0000 7f53bdfd2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53b80ae1f0 0x7f53b80cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:27.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.829+0000 7f53bdfd2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b80afca0 con 0x7f53b806e160 2023-07-14T13:12:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.829+0000 7f53bdfd2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b80aff80 con 0x7f53b806c260 2023-07-14T13:12:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.829+0000 7f53bdfd2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b81f47d0 con 0x7f53b80ae1f0 2023-07-14T13:12:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.829+0000 7f53b6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53b806e160 0x7f53b80cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.829+0000 7f53b6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53b806e160 0x7f53b80cbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59962/0 (socket says 172.21.15.5:59962) 2023-07-14T13:12:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.829+0000 7f53b6ffd640 1 -- 172.21.15.5:0/137384126 learned_addr learned my addr 172.21.15.5:0/137384126 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.829+0000 7f53b7fff640 1 --2- 172.21.15.5:0/137384126 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53b80ae1f0 0x7f53b80cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:27.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.829+0000 7f53b77fe640 1 --2- 172.21.15.5:0/137384126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b806c260 0x7f53b815d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:27.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.829+0000 7f53b6ffd640 1 -- 172.21.15.5:0/137384126 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53b80ae1f0 msgr2=0x7f53b80cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.829+0000 7f53b6ffd640 1 --2- 172.21.15.5:0/137384126 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53b80ae1f0 0x7f53b80cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.829+0000 7f53b6ffd640 1 -- 172.21.15.5:0/137384126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b806c260 msgr2=0x7f53b815d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.829+0000 7f53b6ffd640 1 --2- 172.21.15.5:0/137384126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b806c260 0x7f53b815d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.829+0000 7f53b6ffd640 1 -- 172.21.15.5:0/137384126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a80094d0 con 0x7f53b806e160 2023-07-14T13:12:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.829+0000 7f53b7fff640 1 --2- 172.21.15.5:0/137384126 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53b80ae1f0 0x7f53b80cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:27.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.829+0000 7f53b77fe640 1 --2- 172.21.15.5:0/137384126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b806c260 0x7f53b815d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.829+0000 7f53b6ffd640 1 --2- 172.21.15.5:0/137384126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53b806e160 0x7f53b80cbda0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f53ac00e930 tx=0x7f53ac00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.833+0000 7f539ffff640 1 -- 172.21.15.5:0/137384126 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac009690 con 0x7f53b806e160 2023-07-14T13:12:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.833+0000 7f539ffff640 1 -- 172.21.15.5:0/137384126 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ac00ca00 con 0x7f53b806e160 2023-07-14T13:12:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.833+0000 7f53bdfd2640 1 -- 172.21.15.5:0/137384126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b81f4ab0 con 0x7f53b806e160 2023-07-14T13:12:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.833+0000 7f539ffff640 1 -- 172.21.15.5:0/137384126 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac00cd70 con 0x7f53b806e160 2023-07-14T13:12:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.833+0000 7f53bdfd2640 1 -- 172.21.15.5:0/137384126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b815daf0 con 0x7f53b806e160 2023-07-14T13:12:27.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.833+0000 7f53bdfd2640 1 -- 172.21.15.5:0/137384126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b81f4c40 con 0x7f53b806e160 2023-07-14T13:12:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.833+0000 7f539ffff640 1 -- 172.21.15.5:0/137384126 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f53ac013470 con 0x7f53b806e160 2023-07-14T13:12:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.833+0000 7f539ffff640 1 --2- 172.21.15.5:0/137384126 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f53a40663a0 0x7f53a4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:27.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.833+0000 7f539ffff640 1 -- 172.21.15.5:0/137384126 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f53ac084200 con 0x7f53b806e160 2023-07-14T13:12:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.833+0000 7f53b77fe640 1 --2- 172.21.15.5:0/137384126 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f53a40663a0 0x7f53a4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:27.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.837+0000 7f53b77fe640 1 --2- 172.21.15.5:0/137384126 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f53a40663a0 0x7f53a4068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f53a80af000 tx=0x7f53a80a7000 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:27.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.837+0000 7f539ffff640 1 -- 172.21.15.5:0/137384126 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f53ac051570 con 0x7f53b806e160 2023-07-14T13:12:28.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:27.989+0000 7f53bdfd2640 1 -- 172.21.15.5:0/137384126 --> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f53b806e560 con 0x7f53a40663a0 2023-07-14T13:12:28.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.001+0000 7f539ffff640 1 -- 172.21.15.5:0/137384126 <== mgr.7202 v2:172.21.15.154:6832/3769132865 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306119 (secure 0 0 0) 0x7f53a80ab8c0 con 0x7f53a40663a0 2023-07-14T13:12:28.040 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:28.041 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:12:28.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.005+0000 7f53bdfd2640 1 -- 172.21.15.5:0/137384126 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f53a40663a0 msgr2=0x7f53a4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:28.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.005+0000 7f53bdfd2640 1 --2- 172.21.15.5:0/137384126 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f53a40663a0 0x7f53a4068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f53a80af000 tx=0x7f53a80a7000 comp rx=0 tx=0).stop 2023-07-14T13:12:28.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.005+0000 7f53bdfd2640 1 -- 172.21.15.5:0/137384126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53b806e160 msgr2=0x7f53b80cbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:28.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.005+0000 7f53bdfd2640 1 --2- 172.21.15.5:0/137384126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53b806e160 0x7f53b80cbda0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f53ac00e930 tx=0x7f53ac00edf0 comp rx=0 tx=0).stop 2023-07-14T13:12:28.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.005+0000 7f53bdfd2640 1 -- 172.21.15.5:0/137384126 shutdown_connections 2023-07-14T13:12:28.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.005+0000 7f53bdfd2640 1 --2- 172.21.15.5:0/137384126 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f53a40663a0 0x7f53a4068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:28.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.005+0000 7f53bdfd2640 1 --2- 172.21.15.5:0/137384126 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53b80ae1f0 0x7f53b80cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:28.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.005+0000 7f53bdfd2640 1 --2- 172.21.15.5:0/137384126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53b806e160 0x7f53b80cbda0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:28.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.005+0000 7f53bdfd2640 1 --2- 172.21.15.5:0/137384126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b806c260 0x7f53b815d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:28.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.005+0000 7f53bdfd2640 1 -- 172.21.15.5:0/137384126 >> 172.21.15.5:0/137384126 conn(0x7f53b80b1300 msgr2=0x7f53b806a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:28.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.005+0000 7f53bdfd2640 1 -- 172.21.15.5:0/137384126 shutdown_connections 2023-07-14T13:12:28.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.005+0000 7f53bdfd2640 1 -- 172.21.15.5:0/137384126 wait complete. 2023-07-14T13:12:28.060 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-14T13:12:27.580927+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":354100,"kb_used_data":14708,"kb_used_omap":0,"kb_used_meta":339328,"kb_avail":754620620,"statfs":{"total":773094113280,"available":772731514880,"internally_reserved":0,"allocated":15060992,"data_stored":8232618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":347471872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.683924"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.921634+0000","last_change":"2023-07-14T13:12:22.921634+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.921634+0000","last_undegraded":"2023-07-14T13:12:22.921634+0000","last_fullsized":"2023-07-14T13:12:22.921634+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.914942+0000","last_change":"2023-07-14T13:12:22.914942+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.914942+0000","last_undegraded":"2023-07-14T13:12:22.914942+0000","last_fullsized":"2023-07-14T13:12:22.914942+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.912221+0000","last_change":"2023-07-14T13:12:22.912221+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.912221+0000","last_undegraded":"2023-07-14T13:12:22.912221+0000","last_fullsized":"2023-07-14T13:12:22.912221+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.914791+0000","last_change":"2023-07-14T13:12:22.914791+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.914791+0000","last_undegraded":"2023-07-14T13:12:22.914791+0000","last_fullsized":"2023-07-14T13:12:22.914791+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.921391+0000","last_change":"2023-07-14T13:12:22.921391+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.921391+0000","last_undegraded":"2023-07-14T13:12:22.921391+0000","last_fullsized":"2023-07-14T13:12:22.921391+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.911078+0000","last_change":"2023-07-14T13:12:22.911078+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.911078+0000","last_undegraded":"2023-07-14T13:12:22.911078+0000","last_fullsized":"2023-07-14T13:12:22.911078+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.910643+0000","last_change":"2023-07-14T13:12:22.910643+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.910643+0000","last_undegraded":"2023-07-14T13:12:22.910643+0000","last_fullsized":"2023-07-14T13:12:22.910643+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.912745+0000","last_change":"2023-07-14T13:12:22.912745+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.912745+0000","last_undegraded":"2023-07-14T13:12:22.912745+0000","last_fullsized":"2023-07-14T13:12:22.912745+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.916440+0000","last_change":"2023-07-14T13:12:22.916440+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.916440+0000","last_undegraded":"2023-07-14T13:12:22.916440+0000","last_fullsized":"2023-07-14T13:12:22.916440+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.909705+0000","last_change":"2023-07-14T13:12:22.909705+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.909705+0000","last_undegraded":"2023-07-14T13:12:22.909705+0000","last_fullsized":"2023-07-14T13:12:22.909705+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.921599+0000","last_change":"2023-07-14T13:12:22.921599+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.921599+0000","last_undegraded":"2023-07-14T13:12:22.921599+0000","last_fullsized":"2023-07-14T13:12:22.921599+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.913503+0000","last_change":"2023-07-14T13:12:22.913503+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.913503+0000","last_undegraded":"2023-07-14T13:12:22.913503+0000","last_fullsized":"2023-07-14T13:12:22.913503+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.908889+0000","last_change":"2023-07-14T13:12:22.908889+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.908889+0000","last_undegraded":"2023-07-14T13:12:22.908889+0000","last_fullsized":"2023-07-14T13:12:22.908889+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.918157+0000","last_change":"2023-07-14T13:12:22.918157+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.918157+0000","last_undegraded":"2023-07-14T13:12:22.918157+0000","last_fullsized":"2023-07-14T13:12:22.918157+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.922362+0000","last_change":"2023-07-14T13:12:22.922362+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.922362+0000","last_undegraded":"2023-07-14T13:12:22.922362+0000","last_fullsized":"2023-07-14T13:12:22.922362+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.911369+0000","last_change":"2023-07-14T13:12:22.911369+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.911369+0000","last_undegraded":"2023-07-14T13:12:22.911369+0000","last_fullsized":"2023-07-14T13:12:22.911369+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.909224+0000","last_change":"2023-07-14T13:12:22.909224+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.909224+0000","last_undegraded":"2023-07-14T13:12:22.909224+0000","last_fullsized":"2023-07-14T13:12:22.909224+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.914405+0000","last_change":"2023-07-14T13:12:22.914405+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.914405+0000","last_undegraded":"2023-07-14T13:12:22.914405+0000","last_fullsized":"2023-07-14T13:12:22.914405+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.917896+0000","last_change":"2023-07-14T13:12:22.917896+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.917896+0000","last_undegraded":"2023-07-14T13:12:22.917896+0000","last_fullsized":"2023-07-14T13:12:22.917896+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.910687+0000","last_change":"2023-07-14T13:12:22.910687+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.910687+0000","last_undegraded":"2023-07-14T13:12:22.910687+0000","last_fullsized":"2023-07-14T13:12:22.910687+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.916401+0000","last_change":"2023-07-14T13:12:22.916401+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.916401+0000","last_undegraded":"2023-07-14T13:12:22.916401+0000","last_fullsized":"2023-07-14T13:12:22.916401+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.921056+0000","last_change":"2023-07-14T13:12:22.921056+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.921056+0000","last_undegraded":"2023-07-14T13:12:22.921056+0000","last_fullsized":"2023-07-14T13:12:22.921056+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.914616+0000","last_change":"2023-07-14T13:12:22.914616+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.914616+0000","last_undegraded":"2023-07-14T13:12:22.914616+0000","last_fullsized":"2023-07-14T13:12:22.914616+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.912264+0000","last_change":"2023-07-14T13:12:22.912264+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.912264+0000","last_undegraded":"2023-07-14T13:12:22.912264+0000","last_fullsized":"2023-07-14T13:12:22.912264+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.913552+0000","last_change":"2023-07-14T13:12:22.913552+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.913552+0000","last_undegraded":"2023-07-14T13:12:22.913552+0000","last_fullsized":"2023-07-14T13:12:22.913552+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.910524+0000","last_change":"2023-07-14T13:12:22.910524+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.910524+0000","last_undegraded":"2023-07-14T13:12:22.910524+0000","last_fullsized":"2023-07-14T13:12:22.910524+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.915798+0000","last_change":"2023-07-14T13:12:22.915798+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.915798+0000","last_undegraded":"2023-07-14T13:12:22.915798+0000","last_fullsized":"2023-07-14T13:12:22.915798+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.913041+0000","last_change":"2023-07-14T13:12:22.913041+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.913041+0000","last_undegraded":"2023-07-14T13:12:22.913041+0000","last_fullsized":"2023-07-14T13:12:22.913041+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.913586+0000","last_change":"2023-07-14T13:12:22.913586+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.913586+0000","last_undegraded":"2023-07-14T13:12:22.913586+0000","last_fullsized":"2023-07-14T13:12:22.913586+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.910071+0000","last_change":"2023-07-14T13:12:22.910071+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.910071+0000","last_undegraded":"2023-07-14T13:12:22.910071+0000","last_fullsized":"2023-07-14T13:12:22.910071+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.911426+0000","last_change":"2023-07-14T13:12:22.911426+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.911426+0000","last_undegraded":"2023-07-14T13:12:22.911426+0000","last_fullsized":"2023-07-14T13:12:22.911426+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.911697+0000","last_change":"2023-07-14T13:12:22.911697+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.911697+0000","last_undegraded":"2023-07-14T13:12:22.911697+0000","last_fullsized":"2023-07-14T13:12:22.911697+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.909364+0000","last_change":"2023-07-14T13:12:22.909364+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.909364+0000","last_undegraded":"2023-07-14T13:12:22.909364+0000","last_fullsized":"2023-07-14T13:12:22.909364+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.935368+0000","last_change":"2023-07-14T13:12:22.932726+0000","last_active":"2023-07-14T13:12:22.935368+0000","last_peered":"2023-07-14T13:12:22.935368+0000","last_clean":"2023-07-14T13:12:22.935368+0000","last_became_active":"2023-07-14T13:12:22.932398+0000","last_became_peered":"2023-07-14T13:12:22.932398+0000","last_unstale":"2023-07-14T13:12:22.935368+0000","last_undegraded":"2023-07-14T13:12:22.935368+0000","last_fullsized":"2023-07-14T13:12:22.935368+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:15:52.769714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.909091+0000","last_change":"2023-07-14T13:12:22.909091+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.909091+0000","last_undegraded":"2023-07-14T13:12:22.909091+0000","last_fullsized":"2023-07-14T13:12:22.909091+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.927429+0000","last_change":"2023-07-14T13:12:22.920816+0000","last_active":"2023-07-14T13:12:22.927429+0000","last_peered":"2023-07-14T13:12:22.927429+0000","last_clean":"2023-07-14T13:12:22.927429+0000","last_became_active":"2023-07-14T13:12:22.918830+0000","last_became_peered":"2023-07-14T13:12:22.918830+0000","last_unstale":"2023-07-14T13:12:22.927429+0000","last_undegraded":"2023-07-14T13:12:22.927429+0000","last_fullsized":"2023-07-14T13:12:22.927429+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:36:04.726809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.912583+0000","last_change":"2023-07-14T13:12:22.912583+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.912583+0000","last_undegraded":"2023-07-14T13:12:22.912583+0000","last_fullsized":"2023-07-14T13:12:22.912583+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.933303+0000","last_change":"2023-07-14T13:12:22.929668+0000","last_active":"2023-07-14T13:12:22.933303+0000","last_peered":"2023-07-14T13:12:22.933303+0000","last_clean":"2023-07-14T13:12:22.933303+0000","last_became_active":"2023-07-14T13:12:22.929296+0000","last_became_peered":"2023-07-14T13:12:22.929296+0000","last_unstale":"2023-07-14T13:12:22.933303+0000","last_undegraded":"2023-07-14T13:12:22.933303+0000","last_fullsized":"2023-07-14T13:12:22.933303+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:16:59.861984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.914814+0000","last_change":"2023-07-14T13:12:22.914814+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.914814+0000","last_undegraded":"2023-07-14T13:12:22.914814+0000","last_fullsized":"2023-07-14T13:12:22.914814+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.929815+0000","last_change":"2023-07-14T13:12:22.923046+0000","last_active":"2023-07-14T13:12:22.929815+0000","last_peered":"2023-07-14T13:12:22.929815+0000","last_clean":"2023-07-14T13:12:22.929815+0000","last_became_active":"2023-07-14T13:12:22.922783+0000","last_became_peered":"2023-07-14T13:12:22.922783+0000","last_unstale":"2023-07-14T13:12:22.929815+0000","last_undegraded":"2023-07-14T13:12:22.929815+0000","last_fullsized":"2023-07-14T13:12:22.929815+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:13:07.210080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.907985+0000","last_change":"2023-07-14T13:12:22.907985+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.907985+0000","last_undegraded":"2023-07-14T13:12:22.907985+0000","last_fullsized":"2023-07-14T13:12:22.907985+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.935422+0000","last_change":"2023-07-14T13:12:22.932158+0000","last_active":"2023-07-14T13:12:22.935422+0000","last_peered":"2023-07-14T13:12:22.935422+0000","last_clean":"2023-07-14T13:12:22.935422+0000","last_became_active":"2023-07-14T13:12:22.931753+0000","last_became_peered":"2023-07-14T13:12:22.931753+0000","last_unstale":"2023-07-14T13:12:22.935422+0000","last_undegraded":"2023-07-14T13:12:22.935422+0000","last_fullsized":"2023-07-14T13:12:22.935422+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:36:42.112446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.921862+0000","last_change":"2023-07-14T13:12:22.921862+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.921862+0000","last_undegraded":"2023-07-14T13:12:22.921862+0000","last_fullsized":"2023-07-14T13:12:22.921862+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.927809+0000","last_change":"2023-07-14T13:12:22.923614+0000","last_active":"2023-07-14T13:12:22.927809+0000","last_peered":"2023-07-14T13:12:22.927809+0000","last_clean":"2023-07-14T13:12:22.927809+0000","last_became_active":"2023-07-14T13:12:22.923312+0000","last_became_peered":"2023-07-14T13:12:22.923312+0000","last_unstale":"2023-07-14T13:12:22.927809+0000","last_undegraded":"2023-07-14T13:12:22.927809+0000","last_fullsized":"2023-07-14T13:12:22.927809+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:46:19.955743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.909458+0000","last_change":"2023-07-14T13:12:22.909458+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.909458+0000","last_undegraded":"2023-07-14T13:12:22.909458+0000","last_fullsized":"2023-07-14T13:12:22.909458+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.927247+0000","last_change":"2023-07-14T13:12:22.923307+0000","last_active":"2023-07-14T13:12:22.927247+0000","last_peered":"2023-07-14T13:12:22.927247+0000","last_clean":"2023-07-14T13:12:22.927247+0000","last_became_active":"2023-07-14T13:12:22.922942+0000","last_became_peered":"2023-07-14T13:12:22.922942+0000","last_unstale":"2023-07-14T13:12:22.927247+0000","last_undegraded":"2023-07-14T13:12:22.927247+0000","last_fullsized":"2023-07-14T13:12:22.927247+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:37:51.826743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.908398+0000","last_change":"2023-07-14T13:12:22.908398+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.908398+0000","last_undegraded":"2023-07-14T13:12:22.908398+0000","last_fullsized":"2023-07-14T13:12:22.908398+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.929646+0000","last_change":"2023-07-14T13:12:22.924153+0000","last_active":"2023-07-14T13:12:22.929646+0000","last_peered":"2023-07-14T13:12:22.929646+0000","last_clean":"2023-07-14T13:12:22.929646+0000","last_became_active":"2023-07-14T13:12:22.923877+0000","last_became_peered":"2023-07-14T13:12:22.923877+0000","last_unstale":"2023-07-14T13:12:22.929646+0000","last_undegraded":"2023-07-14T13:12:22.929646+0000","last_fullsized":"2023-07-14T13:12:22.929646+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:58:25.336605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.911832+0000","last_change":"2023-07-14T13:12:22.911832+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.911832+0000","last_undegraded":"2023-07-14T13:12:22.911832+0000","last_fullsized":"2023-07-14T13:12:22.911832+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.927426+0000","last_change":"2023-07-14T13:12:22.920785+0000","last_active":"2023-07-14T13:12:22.927426+0000","last_peered":"2023-07-14T13:12:22.927426+0000","last_clean":"2023-07-14T13:12:22.927426+0000","last_became_active":"2023-07-14T13:12:22.920453+0000","last_became_peered":"2023-07-14T13:12:22.920453+0000","last_unstale":"2023-07-14T13:12:22.927426+0000","last_undegraded":"2023-07-14T13:12:22.927426+0000","last_fullsized":"2023-07-14T13:12:22.927426+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:17:25.734784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.920524+0000","last_change":"2023-07-14T13:12:22.920524+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.920524+0000","last_undegraded":"2023-07-14T13:12:22.920524+0000","last_fullsized":"2023-07-14T13:12:22.920524+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.923584+0000","last_change":"2023-07-14T13:12:22.922475+0000","last_active":"2023-07-14T13:12:22.923584+0000","last_peered":"2023-07-14T13:12:22.923584+0000","last_clean":"2023-07-14T13:12:22.923584+0000","last_became_active":"2023-07-14T13:12:22.922174+0000","last_became_peered":"2023-07-14T13:12:22.922174+0000","last_unstale":"2023-07-14T13:12:22.923584+0000","last_undegraded":"2023-07-14T13:12:22.923584+0000","last_fullsized":"2023-07-14T13:12:22.923584+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:55:25.302543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.908467+0000","last_change":"2023-07-14T13:12:22.908467+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.908467+0000","last_undegraded":"2023-07-14T13:12:22.908467+0000","last_fullsized":"2023-07-14T13:12:22.908467+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.933284+0000","last_change":"2023-07-14T13:12:22.929389+0000","last_active":"2023-07-14T13:12:22.933284+0000","last_peered":"2023-07-14T13:12:22.933284+0000","last_clean":"2023-07-14T13:12:22.933284+0000","last_became_active":"2023-07-14T13:12:22.929005+0000","last_became_peered":"2023-07-14T13:12:22.929005+0000","last_unstale":"2023-07-14T13:12:22.933284+0000","last_undegraded":"2023-07-14T13:12:22.933284+0000","last_fullsized":"2023-07-14T13:12:22.933284+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:32:45.606297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.911429+0000","last_change":"2023-07-14T13:12:22.911429+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.911429+0000","last_undegraded":"2023-07-14T13:12:22.911429+0000","last_fullsized":"2023-07-14T13:12:22.911429+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.933160+0000","last_change":"2023-07-14T13:12:22.929144+0000","last_active":"2023-07-14T13:12:22.933160+0000","last_peered":"2023-07-14T13:12:22.933160+0000","last_clean":"2023-07-14T13:12:22.933160+0000","last_became_active":"2023-07-14T13:12:22.928845+0000","last_became_peered":"2023-07-14T13:12:22.928845+0000","last_unstale":"2023-07-14T13:12:22.933160+0000","last_undegraded":"2023-07-14T13:12:22.933160+0000","last_fullsized":"2023-07-14T13:12:22.933160+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:35.675380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.910902+0000","last_change":"2023-07-14T13:12:22.910902+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.910902+0000","last_undegraded":"2023-07-14T13:12:22.910902+0000","last_fullsized":"2023-07-14T13:12:22.910902+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.930872+0000","last_change":"2023-07-14T13:12:22.929261+0000","last_active":"2023-07-14T13:12:22.930872+0000","last_peered":"2023-07-14T13:12:22.930872+0000","last_clean":"2023-07-14T13:12:22.930872+0000","last_became_active":"2023-07-14T13:12:22.928961+0000","last_became_peered":"2023-07-14T13:12:22.928961+0000","last_unstale":"2023-07-14T13:12:22.930872+0000","last_undegraded":"2023-07-14T13:12:22.930872+0000","last_fullsized":"2023-07-14T13:12:22.930872+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:39:55.963756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.909619+0000","last_change":"2023-07-14T13:12:22.909619+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.909619+0000","last_undegraded":"2023-07-14T13:12:22.909619+0000","last_fullsized":"2023-07-14T13:12:22.909619+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.933336+0000","last_change":"2023-07-14T13:12:22.931434+0000","last_active":"2023-07-14T13:12:22.933336+0000","last_peered":"2023-07-14T13:12:22.933336+0000","last_clean":"2023-07-14T13:12:22.933336+0000","last_became_active":"2023-07-14T13:12:22.931004+0000","last_became_peered":"2023-07-14T13:12:22.931004+0000","last_unstale":"2023-07-14T13:12:22.933336+0000","last_undegraded":"2023-07-14T13:12:22.933336+0000","last_fullsized":"2023-07-14T13:12:22.933336+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:47:41.118725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.908947+0000","last_change":"2023-07-14T13:12:22.908947+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.908947+0000","last_undegraded":"2023-07-14T13:12:22.908947+0000","last_fullsized":"2023-07-14T13:12:22.908947+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.930433+0000","last_change":"2023-07-14T13:12:22.928525+0000","last_active":"2023-07-14T13:12:22.930433+0000","last_peered":"2023-07-14T13:12:22.930433+0000","last_clean":"2023-07-14T13:12:22.930433+0000","last_became_active":"2023-07-14T13:12:22.928254+0000","last_became_peered":"2023-07-14T13:12:22.928254+0000","last_unstale":"2023-07-14T13:12:22.930433+0000","last_undegraded":"2023-07-14T13:12:22.930433+0000","last_fullsized":"2023-07-14T13:12:22.930433+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:35:23.471165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.911426+0000","last_change":"2023-07-14T13:12:22.911426+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.911426+0000","last_undegraded":"2023-07-14T13:12:22.911426+0000","last_fullsized":"2023-07-14T13:12:22.911426+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.932205+0000","last_change":"2023-07-14T13:12:22.926412+0000","last_active":"2023-07-14T13:12:22.932205+0000","last_peered":"2023-07-14T13:12:22.932205+0000","last_clean":"2023-07-14T13:12:22.932205+0000","last_became_active":"2023-07-14T13:12:22.925771+0000","last_became_peered":"2023-07-14T13:12:22.925771+0000","last_unstale":"2023-07-14T13:12:22.932205+0000","last_undegraded":"2023-07-14T13:12:22.932205+0000","last_fullsized":"2023-07-14T13:12:22.932205+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:56:32.388227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.912579+0000","last_change":"2023-07-14T13:12:22.912579+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.912579+0000","last_undegraded":"2023-07-14T13:12:22.912579+0000","last_fullsized":"2023-07-14T13:12:22.912579+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.930761+0000","last_change":"2023-07-14T13:12:22.927390+0000","last_active":"2023-07-14T13:12:22.930761+0000","last_peered":"2023-07-14T13:12:22.930761+0000","last_clean":"2023-07-14T13:12:22.930761+0000","last_became_active":"2023-07-14T13:12:22.927081+0000","last_became_peered":"2023-07-14T13:12:22.927081+0000","last_unstale":"2023-07-14T13:12:22.930761+0000","last_undegraded":"2023-07-14T13:12:22.930761+0000","last_fullsized":"2023-07-14T13:12:22.930761+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:59.167504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.907525+0000","last_change":"2023-07-14T13:12:22.907525+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.907525+0000","last_undegraded":"2023-07-14T13:12:22.907525+0000","last_fullsized":"2023-07-14T13:12:22.907525+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.930233+0000","last_change":"2023-07-14T13:12:22.927740+0000","last_active":"2023-07-14T13:12:22.930233+0000","last_peered":"2023-07-14T13:12:22.930233+0000","last_clean":"2023-07-14T13:12:22.930233+0000","last_became_active":"2023-07-14T13:12:22.927419+0000","last_became_peered":"2023-07-14T13:12:22.927419+0000","last_unstale":"2023-07-14T13:12:22.930233+0000","last_undegraded":"2023-07-14T13:12:22.930233+0000","last_fullsized":"2023-07-14T13:12:22.930233+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:42:30.256640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.914915+0000","last_change":"2023-07-14T13:12:22.914915+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.914915+0000","last_undegraded":"2023-07-14T13:12:22.914915+0000","last_fullsized":"2023-07-14T13:12:22.914915+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.928781+0000","last_change":"2023-07-14T13:12:22.926828+0000","last_active":"2023-07-14T13:12:22.928781+0000","last_peered":"2023-07-14T13:12:22.928781+0000","last_clean":"2023-07-14T13:12:22.928781+0000","last_became_active":"2023-07-14T13:12:22.926532+0000","last_became_peered":"2023-07-14T13:12:22.926532+0000","last_unstale":"2023-07-14T13:12:22.928781+0000","last_undegraded":"2023-07-14T13:12:22.928781+0000","last_fullsized":"2023-07-14T13:12:22.928781+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:27.875338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.910320+0000","last_change":"2023-07-14T13:12:22.910320+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.910320+0000","last_undegraded":"2023-07-14T13:12:22.910320+0000","last_fullsized":"2023-07-14T13:12:22.910320+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.930787+0000","last_change":"2023-07-14T13:12:22.928393+0000","last_active":"2023-07-14T13:12:22.930787+0000","last_peered":"2023-07-14T13:12:22.930787+0000","last_clean":"2023-07-14T13:12:22.930787+0000","last_became_active":"2023-07-14T13:12:22.928069+0000","last_became_peered":"2023-07-14T13:12:22.928069+0000","last_unstale":"2023-07-14T13:12:22.930787+0000","last_undegraded":"2023-07-14T13:12:22.930787+0000","last_fullsized":"2023-07-14T13:12:22.930787+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:52:26.822243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.909148+0000","last_change":"2023-07-14T13:12:22.909148+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.909148+0000","last_undegraded":"2023-07-14T13:12:22.909148+0000","last_fullsized":"2023-07-14T13:12:22.909148+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.932673+0000","last_change":"2023-07-14T13:12:22.926375+0000","last_active":"2023-07-14T13:12:22.932673+0000","last_peered":"2023-07-14T13:12:22.932673+0000","last_clean":"2023-07-14T13:12:22.932673+0000","last_became_active":"2023-07-14T13:12:22.926097+0000","last_became_peered":"2023-07-14T13:12:22.926097+0000","last_unstale":"2023-07-14T13:12:22.932673+0000","last_undegraded":"2023-07-14T13:12:22.932673+0000","last_fullsized":"2023-07-14T13:12:22.932673+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:41:02.972781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.909154+0000","last_change":"2023-07-14T13:12:22.909154+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.909154+0000","last_undegraded":"2023-07-14T13:12:22.909154+0000","last_fullsized":"2023-07-14T13:12:22.909154+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.932914+0000","last_change":"2023-07-14T13:12:22.928830+0000","last_active":"2023-07-14T13:12:22.932914+0000","last_peered":"2023-07-14T13:12:22.932914+0000","last_clean":"2023-07-14T13:12:22.932914+0000","last_became_active":"2023-07-14T13:12:22.928458+0000","last_became_peered":"2023-07-14T13:12:22.928458+0000","last_unstale":"2023-07-14T13:12:22.932914+0000","last_undegraded":"2023-07-14T13:12:22.932914+0000","last_fullsized":"2023-07-14T13:12:22.932914+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:44:44.418690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.915122+0000","last_change":"2023-07-14T13:12:22.915122+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.915122+0000","last_undegraded":"2023-07-14T13:12:22.915122+0000","last_fullsized":"2023-07-14T13:12:22.915122+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.929573+0000","last_change":"2023-07-14T13:12:22.924885+0000","last_active":"2023-07-14T13:12:22.929573+0000","last_peered":"2023-07-14T13:12:22.929573+0000","last_clean":"2023-07-14T13:12:22.929573+0000","last_became_active":"2023-07-14T13:12:22.924441+0000","last_became_peered":"2023-07-14T13:12:22.924441+0000","last_unstale":"2023-07-14T13:12:22.929573+0000","last_undegraded":"2023-07-14T13:12:22.929573+0000","last_fullsized":"2023-07-14T13:12:22.929573+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:02:11.936198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.907380+0000","last_change":"2023-07-14T13:12:22.907380+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.907380+0000","last_undegraded":"2023-07-14T13:12:22.907380+0000","last_fullsized":"2023-07-14T13:12:22.907380+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.932224+0000","last_change":"2023-07-14T13:12:22.926905+0000","last_active":"2023-07-14T13:12:22.932224+0000","last_peered":"2023-07-14T13:12:22.932224+0000","last_clean":"2023-07-14T13:12:22.932224+0000","last_became_active":"2023-07-14T13:12:22.926579+0000","last_became_peered":"2023-07-14T13:12:22.926579+0000","last_unstale":"2023-07-14T13:12:22.932224+0000","last_undegraded":"2023-07-14T13:12:22.932224+0000","last_fullsized":"2023-07-14T13:12:22.932224+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:47:41.849069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.915949+0000","last_change":"2023-07-14T13:12:22.915949+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.915949+0000","last_undegraded":"2023-07-14T13:12:22.915949+0000","last_fullsized":"2023-07-14T13:12:22.915949+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.931185+0000","last_change":"2023-07-14T13:12:22.929600+0000","last_active":"2023-07-14T13:12:22.931185+0000","last_peered":"2023-07-14T13:12:22.931185+0000","last_clean":"2023-07-14T13:12:22.931185+0000","last_became_active":"2023-07-14T13:12:22.929310+0000","last_became_peered":"2023-07-14T13:12:22.929310+0000","last_unstale":"2023-07-14T13:12:22.931185+0000","last_undegraded":"2023-07-14T13:12:22.931185+0000","last_fullsized":"2023-07-14T13:12:22.931185+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:23:45.496444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"129'249","reported_seq":852,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.915653+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:12:22.915653+0000","last_peered":"2023-07-14T13:12:22.915653+0000","last_clean":"2023-07-14T13:12:22.915653+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:12:22.915653+0000","last_undegraded":"2023-07-14T13:12:22.915653+0000","last_fullsized":"2023-07-14T13:12:22.915653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:40:02.311140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":224,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.914119+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:12:22.914119+0000","last_peered":"2023-07-14T13:12:22.914119+0000","last_clean":"2023-07-14T13:12:22.914119+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:12:22.914119+0000","last_undegraded":"2023-07-14T13:12:22.914119+0000","last_fullsized":"2023-07-14T13:12:22.914119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:58:25.383198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.915442+0000","last_change":"2023-07-14T13:12:22.915442+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.915442+0000","last_undegraded":"2023-07-14T13:12:22.915442+0000","last_fullsized":"2023-07-14T13:12:22.915442+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.931190+0000","last_change":"2023-07-14T13:12:22.929681+0000","last_active":"2023-07-14T13:12:22.931190+0000","last_peered":"2023-07-14T13:12:22.931190+0000","last_clean":"2023-07-14T13:12:22.931190+0000","last_became_active":"2023-07-14T13:12:22.929406+0000","last_became_peered":"2023-07-14T13:12:22.929406+0000","last_unstale":"2023-07-14T13:12:22.931190+0000","last_undegraded":"2023-07-14T13:12:22.931190+0000","last_fullsized":"2023-07-14T13:12:22.931190+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:03:13.962974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":228,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.914816+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:12:22.914816+0000","last_peered":"2023-07-14T13:12:22.914816+0000","last_clean":"2023-07-14T13:12:22.914816+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:12:22.914816+0000","last_undegraded":"2023-07-14T13:12:22.914816+0000","last_fullsized":"2023-07-14T13:12:22.914816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:00.709746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.908014+0000","last_change":"2023-07-14T13:12:22.908014+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.908014+0000","last_undegraded":"2023-07-14T13:12:22.908014+0000","last_fullsized":"2023-07-14T13:12:22.908014+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.929091+0000","last_change":"2023-07-14T13:12:22.924565+0000","last_active":"2023-07-14T13:12:22.929091+0000","last_peered":"2023-07-14T13:12:22.929091+0000","last_clean":"2023-07-14T13:12:22.929091+0000","last_became_active":"2023-07-14T13:12:22.924067+0000","last_became_peered":"2023-07-14T13:12:22.924067+0000","last_unstale":"2023-07-14T13:12:22.929091+0000","last_undegraded":"2023-07-14T13:12:22.929091+0000","last_fullsized":"2023-07-14T13:12:22.929091+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:41:00.498547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":226,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.907399+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:12:22.907399+0000","last_peered":"2023-07-14T13:12:22.907399+0000","last_clean":"2023-07-14T13:12:22.907399+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:12:22.907399+0000","last_undegraded":"2023-07-14T13:12:22.907399+0000","last_fullsized":"2023-07-14T13:12:22.907399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:11:10.601154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.910272+0000","last_change":"2023-07-14T13:12:22.910272+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.910272+0000","last_undegraded":"2023-07-14T13:12:22.910272+0000","last_fullsized":"2023-07-14T13:12:22.910272+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.930392+0000","last_change":"2023-07-14T13:12:22.927281+0000","last_active":"2023-07-14T13:12:22.930392+0000","last_peered":"2023-07-14T13:12:22.930392+0000","last_clean":"2023-07-14T13:12:22.930392+0000","last_became_active":"2023-07-14T13:12:22.926987+0000","last_became_peered":"2023-07-14T13:12:22.926987+0000","last_unstale":"2023-07-14T13:12:22.930392+0000","last_undegraded":"2023-07-14T13:12:22.930392+0000","last_fullsized":"2023-07-14T13:12:22.930392+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:13:56.663119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":224,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.914252+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:12:22.914252+0000","last_peered":"2023-07-14T13:12:22.914252+0000","last_clean":"2023-07-14T13:12:22.914252+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:12:22.914252+0000","last_undegraded":"2023-07-14T13:12:22.914252+0000","last_fullsized":"2023-07-14T13:12:22.914252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:04:17.778038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.915998+0000","last_change":"2023-07-14T13:12:22.915998+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.915998+0000","last_undegraded":"2023-07-14T13:12:22.915998+0000","last_fullsized":"2023-07-14T13:12:22.915998+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.928805+0000","last_change":"2023-07-14T13:12:22.926462+0000","last_active":"2023-07-14T13:12:22.928805+0000","last_peered":"2023-07-14T13:12:22.928805+0000","last_clean":"2023-07-14T13:12:22.928805+0000","last_became_active":"2023-07-14T13:12:22.926168+0000","last_became_peered":"2023-07-14T13:12:22.926168+0000","last_unstale":"2023-07-14T13:12:22.928805+0000","last_undegraded":"2023-07-14T13:12:22.928805+0000","last_fullsized":"2023-07-14T13:12:22.928805+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:36:23.597546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":236,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.904286+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:12:22.904286+0000","last_peered":"2023-07-14T13:12:22.904286+0000","last_clean":"2023-07-14T13:12:22.904286+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:12:22.904286+0000","last_undegraded":"2023-07-14T13:12:22.904286+0000","last_fullsized":"2023-07-14T13:12:22.904286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:39:51.306284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.912244+0000","last_change":"2023-07-14T13:12:22.912244+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.912244+0000","last_undegraded":"2023-07-14T13:12:22.912244+0000","last_fullsized":"2023-07-14T13:12:22.912244+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.927372+0000","last_change":"2023-07-14T13:12:22.922833+0000","last_active":"2023-07-14T13:12:22.927372+0000","last_peered":"2023-07-14T13:12:22.927372+0000","last_clean":"2023-07-14T13:12:22.927372+0000","last_became_active":"2023-07-14T13:12:22.922520+0000","last_became_peered":"2023-07-14T13:12:22.922520+0000","last_unstale":"2023-07-14T13:12:22.927372+0000","last_undegraded":"2023-07-14T13:12:22.927372+0000","last_fullsized":"2023-07-14T13:12:22.927372+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:49:35.637130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":228,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.917411+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:12:22.917411+0000","last_peered":"2023-07-14T13:12:22.917411+0000","last_clean":"2023-07-14T13:12:22.917411+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:12:22.917411+0000","last_undegraded":"2023-07-14T13:12:22.917411+0000","last_fullsized":"2023-07-14T13:12:22.917411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:22:14.236318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.912765+0000","last_change":"2023-07-14T13:12:22.912765+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.912765+0000","last_undegraded":"2023-07-14T13:12:22.912765+0000","last_fullsized":"2023-07-14T13:12:22.912765+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.928043+0000","last_change":"2023-07-14T13:12:22.924751+0000","last_active":"2023-07-14T13:12:22.928043+0000","last_peered":"2023-07-14T13:12:22.928043+0000","last_clean":"2023-07-14T13:12:22.928043+0000","last_became_active":"2023-07-14T13:12:22.924479+0000","last_became_peered":"2023-07-14T13:12:22.924479+0000","last_unstale":"2023-07-14T13:12:22.928043+0000","last_undegraded":"2023-07-14T13:12:22.928043+0000","last_fullsized":"2023-07-14T13:12:22.928043+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:27:08.709009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":236,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.904287+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:12:22.904287+0000","last_peered":"2023-07-14T13:12:22.904287+0000","last_clean":"2023-07-14T13:12:22.904287+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:12:22.904287+0000","last_undegraded":"2023-07-14T13:12:22.904287+0000","last_fullsized":"2023-07-14T13:12:22.904287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:09:58.237621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.912085+0000","last_change":"2023-07-14T13:12:22.912085+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.912085+0000","last_undegraded":"2023-07-14T13:12:22.912085+0000","last_fullsized":"2023-07-14T13:12:22.912085+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.929807+0000","last_change":"2023-07-14T13:12:22.925040+0000","last_active":"2023-07-14T13:12:22.929807+0000","last_peered":"2023-07-14T13:12:22.929807+0000","last_clean":"2023-07-14T13:12:22.929807+0000","last_became_active":"2023-07-14T13:12:22.924712+0000","last_became_peered":"2023-07-14T13:12:22.924712+0000","last_unstale":"2023-07-14T13:12:22.929807+0000","last_undegraded":"2023-07-14T13:12:22.929807+0000","last_fullsized":"2023-07-14T13:12:22.929807+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:36:04.651057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":228,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.917713+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:12:22.917713+0000","last_peered":"2023-07-14T13:12:22.917713+0000","last_clean":"2023-07-14T13:12:22.917713+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:12:22.917713+0000","last_undegraded":"2023-07-14T13:12:22.917713+0000","last_fullsized":"2023-07-14T13:12:22.917713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:15:41.601743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575083,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59552,"kb_used_data":2264,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312288,"statfs":{"total":96636764160,"available":96575782912,"internally_reserved":0,"allocated":2318336,"data_stored":1466284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.68999999999999995,"15min":0.70699999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.84199999999999997,"5min":1.262,"15min":1.262},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71699999999999997,"15min":0.72899999999999998},"min":{"1min":0.54100000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.67600000000000005}]},{"osd":1,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.70599999999999996,"15min":0.72999999999999998},"min":{"1min":0.44,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83799999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72799999999999998,"15min":0.74299999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71199999999999997,"15min":0.72599999999999998},"min":{"1min":0.48999999999999999,"5min":0.46100000000000002,"15min":0.42699999999999999},"max":{"1min":0.91500000000000004,"5min":1.073,"15min":1.073},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.753},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84899999999999998,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.85099999999999998}]},{"osd":3,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.72699999999999998,"15min":0.73599999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.091,"5min":1.161,"15min":1.161},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73999999999999999,"15min":0.75600000000000001},"min":{"1min":0.51100000000000001,"5min":0.47899999999999998,"15min":0.41499999999999998},"max":{"1min":0.94899999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.81799999999999995}]},{"osd":4,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56899999999999995,"15min":0.57899999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.318},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.022},"last":0.433},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.40000000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.47299999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.42699999999999999,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.91000000000000003,"5min":0.98099999999999998,"15min":0.98299999999999998},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63100000000000001,"15min":0.64900000000000002},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.34100000000000003},"max":{"1min":0.80500000000000005,"5min":1.028,"15min":1.028},"last":0.58899999999999997}]},{"osd":6,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.42699999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.0489999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.68100000000000005,"15min":0.67700000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.36299999999999999},"max":{"1min":1.151,"5min":4.1130000000000004,"15min":4.1130000000000004},"last":0.64500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575084,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32744,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339096,"statfs":{"total":96636764160,"available":96603234304,"internally_reserved":0,"allocated":1736704,"data_stored":882572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70699999999999996,"15min":0.72699999999999998},"min":{"1min":0.496,"5min":0.47899999999999998,"15min":0.38},"max":{"1min":0.89300000000000002,"5min":0.90400000000000003,"15min":0.996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69999999999999996,"15min":0.72399999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88100000000000001,"5min":0.98199999999999998,"15min":1.0800000000000001},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70099999999999996,"15min":0.73299999999999998},"min":{"1min":0.48499999999999999,"5min":0.42299999999999999,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.0209999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69199999999999995,"15min":0.71899999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82999999999999996,"5min":0.88100000000000001,"15min":1.077},"last":0.625}]},{"osd":2,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.746},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.45900000000000002},"max":{"1min":0.872,"5min":0.95099999999999996,"15min":1.105},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71799999999999997,"15min":0.745},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.92100000000000004,"5min":0.99099999999999999,"15min":1.0900000000000001},"last":0.64000000000000001}]},{"osd":3,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72899999999999998,"15min":0.76600000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89300000000000002,"5min":1.054,"15min":1.1359999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71399999999999997,"15min":0.753},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93600000000000005,"5min":0.94799999999999995,"15min":1.1080000000000001},"last":0.86699999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.502},{"interface":"front","average":{"1min":0.628,"5min":0.63900000000000001,"15min":0.63600000000000001},"min":{"1min":0.47499999999999998,"5min":0.439,"15min":0.38500000000000001},"max":{"1min":0.79800000000000004,"5min":0.95499999999999996,"15min":1.0780000000000001},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63,"15min":0.64000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":1.579},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48199999999999998,"5min":0.46300000000000002,"15min":0.42399999999999999},"max":{"1min":0.85599999999999998,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.78000000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66000000000000003,"15min":0.65900000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91800000000000004,"5min":1.0940000000000001,"15min":1.1200000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.36199999999999999},"max":{"1min":0.90400000000000003,"5min":1.0209999999999999,"15min":1.657},"last":0.68000000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575083,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50792,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321048,"statfs":{"total":96636764160,"available":96584753152,"internally_reserved":0,"allocated":1736704,"data_stored":882572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68799999999999994,"15min":0.72199999999999998},"min":{"1min":0.45400000000000001,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":2.6699999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.46500000000000002,"5min":0.41699999999999998,"15min":0.32800000000000001},"max":{"1min":0.86799999999999999,"5min":1.083,"15min":1.083},"last":0.51000000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68899999999999995,"15min":0.71799999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44500000000000001},"max":{"1min":0.93600000000000005,"5min":1.05,"15min":1.079},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.71499999999999997,"15min":0.73899999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.36799999999999999},"max":{"1min":0.873,"5min":0.94599999999999995,"15min":2.706},"last":0.46300000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70899999999999996,"15min":0.72799999999999998},"min":{"1min":0.41199999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90700000000000003,"5min":1.212,"15min":1.212},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70799999999999996,"15min":0.72699999999999998},"min":{"1min":0.497,"5min":0.44800000000000001,"15min":0.433},"max":{"1min":0.94599999999999995,"5min":1.181,"15min":1.181},"last":0.48899999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72499999999999998,"15min":0.74199999999999999},"min":{"1min":0.53900000000000003,"5min":0.41799999999999998,"15min":0.377},"max":{"1min":0.88600000000000001,"5min":0.95199999999999996,"15min":2.7389999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73099999999999998,"15min":0.753},"min":{"1min":0.51600000000000001,"5min":0.47299999999999998,"15min":0.39700000000000002},"max":{"1min":0.94499999999999995,"5min":1.304,"15min":1.304},"last":0.79600000000000004}]},{"osd":4,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.628,"15min":0.628},"min":{"1min":0.38500000000000001,"5min":0.38,"15min":0.28599999999999998},"max":{"1min":0.85599999999999998,"5min":1.129,"15min":1.129},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.69099999999999995,"15min":0.68400000000000005},"min":{"1min":0.53700000000000003,"5min":0.39900000000000002,"15min":0.36299999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":2.7719999999999998},"last":0.53400000000000003}]},{"osd":6,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60199999999999998,"15min":0.60599999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.32700000000000001},"max":{"1min":0.89700000000000002,"5min":1.169,"15min":1.169},"last":0.63},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42599999999999999,"5min":0.39400000000000002,"15min":0.34300000000000003},"max":{"1min":0.91000000000000003,"5min":1.238,"15min":1.238},"last":0.66700000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64600000000000002,"15min":0.64300000000000002},"min":{"1min":0.40899999999999997,"5min":0.36899999999999999,"15min":0.32900000000000001},"max":{"1min":0.90800000000000003,"5min":1.026,"15min":3.0230000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68300000000000005,"15min":0.67700000000000005},"min":{"1min":0.49399999999999999,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.98199999999999998,"5min":1.2589999999999999,"15min":1.407},"last":0.82699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575083,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36840,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335000,"statfs":{"total":96636764160,"available":96599040000,"internally_reserved":0,"allocated":1736704,"data_stored":882572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.70599999999999996,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.411},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.45600000000000002,"5min":0.45100000000000001,"15min":0.435},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.1200000000000001},"last":0.56899999999999995}]},{"osd":1,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71199999999999997,"15min":0.74399999999999999},"min":{"1min":0.496,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84099999999999997,"5min":0.92500000000000004,"15min":1.077},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70399999999999996,"15min":0.72999999999999998},"min":{"1min":0.52700000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.0469999999999999},"last":0.66500000000000004}]},{"osd":2,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.71999999999999997,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.42199999999999999,"15min":0.35199999999999998},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72099999999999997,"15min":0.76400000000000001},"min":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.86699999999999999,"5min":0.98199999999999998,"15min":1.387},"last":0.52200000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.49399999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89700000000000002,"5min":0.95399999999999996,"15min":1.008},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.74099999999999999,"15min":0.76600000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46800000000000003},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.60799999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.378},"max":{"1min":0.92200000000000004,"5min":0.92400000000000004,"15min":0.97099999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.40400000000000003,"15min":0.34599999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.35599999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.014},"last":0.496},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67900000000000005,"15min":0.67000000000000004},"min":{"1min":0.48599999999999999,"5min":0.443,"15min":0.374},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.0289999999999999},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.69899999999999995,"15min":0.67200000000000004},"min":{"1min":0.51300000000000001,"5min":0.502,"15min":0.39000000000000001},"max":{"1min":0.91700000000000004,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.69799999999999995},"min":{"1min":0.48199999999999998,"5min":0.42799999999999999,"15min":0.40300000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.54600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575083,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36840,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335000,"statfs":{"total":96636764160,"available":96599040000,"internally_reserved":0,"allocated":1736704,"data_stored":882572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.44400000000000001,"15min":0.44900000000000001},"min":{"1min":0.25600000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.63100000000000001,"5min":0.78600000000000003,"15min":0.84199999999999997},"last":0.374},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.49299999999999999,"15min":0.51100000000000001},"min":{"1min":0.312,"5min":0.307,"15min":0.307},"max":{"1min":0.66700000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.44600000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47399999999999998,"15min":0.47999999999999998},"min":{"1min":0.32300000000000001,"5min":0.32000000000000001,"15min":0.315},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.0029999999999999},"last":0.42099999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55800000000000005,"15min":0.57199999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.58299999999999996,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.36799999999999999},"max":{"1min":0.81599999999999995,"5min":0.88100000000000001,"15min":1.663},"last":0.498}]},{"osd":4,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.72699999999999998,"15min":0.755},"min":{"1min":0.53000000000000003,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.284},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.52700000000000002,"5min":0.51900000000000002,"15min":0.47699999999999998},"max":{"1min":0.96899999999999997,"5min":1.175,"15min":1.175},"last":0.77000000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76600000000000001,"15min":0.78700000000000003},"min":{"1min":0.54900000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.05,"5min":1.0629999999999999,"15min":1.306},"last":0.747},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.754,"15min":0.78200000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.372},"max":{"1min":1.121,"5min":1.121,"15min":1.2470000000000001},"last":0.86299999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.746,"15min":0.76900000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48099999999999998},"max":{"1min":1.0680000000000001,"5min":1.113,"15min":1.117},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.78700000000000003,"15min":0.81100000000000005},"min":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.54200000000000004},"max":{"1min":1.133,"5min":1.133,"15min":1.2589999999999999},"last":0.84899999999999998}]},{"osd":7,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.78300000000000003,"15min":0.82799999999999996},"min":{"1min":0.58399999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.159,"5min":1.159,"15min":2.4910000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.78100000000000003,"15min":0.81799999999999995},"min":{"1min":0.57599999999999996,"5min":0.53500000000000003,"15min":0.51600000000000001},"max":{"1min":1.0960000000000001,"5min":1.1359999999999999,"15min":1.595},"last":0.89500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575083,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58980,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312860,"statfs":{"total":96636764160,"available":96576368640,"internally_reserved":0,"allocated":1732608,"data_stored":881553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46200000000000002,"15min":0.46400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.80400000000000005,"5min":0.84699999999999998,"15min":1.3169999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.50800000000000001,"15min":0.53300000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67300000000000004,"5min":0.80800000000000005,"15min":2.5270000000000001},"last":0.66400000000000003}]},{"osd":1,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.47699999999999998,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.29999999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":2.7200000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.55700000000000005},"min":{"1min":0.39900000000000002,"5min":0.36299999999999999,"15min":0.35999999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":2.6110000000000002},"last":0.62}]},{"osd":3,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55100000000000005,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.755,"5min":0.755,"15min":8.2530000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.77000000000000002,"5min":0.89600000000000002,"15min":1.2150000000000001},"last":0.64500000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.73999999999999999,"15min":0.76900000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.48399999999999999},"max":{"1min":0.91100000000000003,"5min":1.0840000000000001,"15min":1.1499999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73999999999999999,"15min":0.78100000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.47999999999999998},"max":{"1min":0.92900000000000005,"5min":1.0629999999999999,"15min":2.3170000000000002},"last":0.92300000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.79900000000000004,"15min":0.84699999999999998},"min":{"1min":0.58399999999999996,"5min":0.56399999999999995,"15min":0.49399999999999999},"max":{"1min":1.0029999999999999,"5min":1.1319999999999999,"15min":3.1139999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.78900000000000003,"15min":0.83299999999999996},"min":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.55600000000000005},"max":{"1min":1.03,"5min":1.153,"15min":2.6850000000000001},"last":0.93999999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.73999999999999999,"15min":0.79100000000000004},"min":{"1min":0.52900000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98299999999999998,"5min":1.038,"15min":3.9849999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75900000000000001,"15min":0.80200000000000005},"min":{"1min":0.53900000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":3.391},"last":0.89200000000000002}]},{"osd":7,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.76000000000000001,"15min":0.80900000000000005},"min":{"1min":0.56200000000000006,"5min":0.52300000000000002,"15min":0.5},"max":{"1min":1.022,"5min":1.1759999999999999,"15min":2.5779999999999998},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.78200000000000003,"15min":0.81799999999999995},"min":{"1min":0.57099999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.736,"5min":1.736,"15min":2.5939999999999999},"last":0.84899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575084,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36840,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335000,"statfs":{"total":96636764160,"available":96599040000,"internally_reserved":0,"allocated":1736704,"data_stored":882572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42899999999999999,"15min":0.432},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26100000000000001},"max":{"1min":0.56000000000000005,"5min":0.65400000000000003,"15min":0.77200000000000002},"last":0.377},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.34999999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.74399999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.55600000000000005}]},{"osd":2,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.35899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.63700000000000001,"5min":0.69199999999999995,"15min":1.0409999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.51700000000000002},"min":{"1min":0.32100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73199999999999998,"5min":0.77900000000000003,"15min":1.014},"last":0.436}]},{"osd":3,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60799999999999998,"15min":0.628},"min":{"1min":0.502,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.746,"5min":0.80300000000000005,"15min":0.96299999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55300000000000005,"15min":0.57099999999999995},"min":{"1min":0.41299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69899999999999995,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.59199999999999997}]},{"osd":4,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76400000000000001,"15min":0.78300000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48899999999999999},"max":{"1min":1.155,"5min":1.2110000000000001,"15min":1.236},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79000000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0640000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.64100000000000001}]},{"osd":5,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77700000000000002,"15min":0.78500000000000003},"min":{"1min":0.56000000000000005,"5min":0.52500000000000002,"15min":0.45200000000000001},"max":{"1min":1.1020000000000001,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.624},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.79600000000000004,"15min":0.80300000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.48599999999999999},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.85299999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.55900000000000005,"5min":0.53800000000000003,"15min":0.503},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.2170000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79900000000000004,"15min":0.81799999999999995},"min":{"1min":0.53700000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.94399999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.58499999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82699999999999996,"15min":0.84199999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.99199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575085,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41512,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330328,"statfs":{"total":96636764160,"available":96594255872,"internally_reserved":0,"allocated":2326528,"data_stored":1471921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.27300000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.59199999999999997,"5min":0.79600000000000004,"15min":2.2450000000000001},"last":0.247},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.48299999999999998,"15min":0.50800000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27700000000000002},"max":{"1min":0.72999999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.29399999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.504,"15min":0.51400000000000001},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68200000000000005,"5min":0.84499999999999997,"15min":2.2989999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52800000000000002,"15min":0.54700000000000004},"min":{"1min":0.39100000000000001,"5min":0.34899999999999998,"15min":0.29899999999999999},"max":{"1min":0.71199999999999997,"5min":0.83599999999999997,"15min":0.90300000000000002},"last":0.38100000000000001}]},{"osd":3,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.505,"15min":0.505},"min":{"1min":0.35199999999999998,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.84999999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57799999999999996,"15min":0.58999999999999997},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76600000000000001,"5min":0.92700000000000005,"15min":2.4100000000000001},"last":0.36399999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74399999999999999,"15min":0.77800000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1220000000000001,"5min":1.21,"15min":1.3640000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.75700000000000001,"15min":0.79300000000000004},"min":{"1min":0.57599999999999996,"5min":0.53500000000000003,"15min":0.44900000000000001},"max":{"1min":1.0289999999999999,"5min":1.0589999999999999,"15min":2.4460000000000002},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75600000000000001,"15min":0.79400000000000004},"min":{"1min":0.62,"5min":0.54200000000000004,"15min":0.47899999999999998},"max":{"1min":1.044,"5min":1.0669999999999999,"15min":1.3839999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.59399999999999997,"5min":0.5,"15min":0.48399999999999999},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.325},"last":0.86499999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77100000000000002,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.147,"5min":1.147,"15min":2.3380000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.755,"15min":0.79900000000000004},"min":{"1min":0.55600000000000005,"5min":0.51000000000000001,"15min":0.50600000000000001},"max":{"1min":0.97899999999999998,"5min":1.0900000000000001,"15min":1.3440000000000001},"last":0.71599999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76300000000000001,"15min":0.81599999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.503},"max":{"1min":1.016,"5min":1.1180000000000001,"15min":1.2749999999999999},"last":0.752},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.77200000000000002,"15min":0.80500000000000005},"min":{"1min":0.56000000000000005,"5min":0.50600000000000001,"15min":0.502},"max":{"1min":1.077,"5min":1.0880000000000001,"15min":1.381},"last":0.72499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:12:28.068 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:12:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.209+0000 7f4ce2b00640 1 Processor -- start 2023-07-14T13:12:28.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.209+0000 7f4ce2b00640 1 -- start start 2023-07-14T13:12:28.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.213+0000 7f4ce2b00640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4cdc0c8ad0 0x7f4cdc0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:28.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.213+0000 7f4ce2b00640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cdc0c9560 0x7f4cdc0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.213+0000 7f4ce2b00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cdc0cc700 con 0x7f4cdc158ce0 2023-07-14T13:12:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.213+0000 7f4ce2b00640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cdc0c99e0 con 0x7f4cdc0c8ad0 2023-07-14T13:12:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.213+0000 7f4ce2b00640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc0b0ff0 con 0x7f4cdc0c9560 2023-07-14T13:12:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.213+0000 7f4ce089c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4cdc158ce0 0x7f4cdc070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57716/0 (socket says 172.21.15.5:57716) 2023-07-14T13:12:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.213+0000 7f4ce089c640 1 -- 172.21.15.5:0/1300372159 learned_addr learned my addr 172.21.15.5:0/1300372159 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.213+0000 7f4cdbfff640 1 --2- 172.21.15.5:0/1300372159 >> v2:172.21.15.154:3300/0 conn(0x7f4cdc0c8ad0 0x7f4cdc0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.213+0000 7f4ce109d640 1 --2- 172.21.15.5:0/1300372159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cdc0c9560 0x7f4cdc0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.213+0000 7f4cdb7fe640 1 -- 172.21.15.5:0/1300372159 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477990238 0 0) 0x7f4cdc0cc700 con 0x7f4cdc158ce0 2023-07-14T13:12:28.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.213+0000 7f4cdb7fe640 1 -- 172.21.15.5:0/1300372159 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ccc005740 con 0x7f4cdc158ce0 2023-07-14T13:12:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.213+0000 7f4cdb7fe640 1 -- 172.21.15.5:0/1300372159 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 929951178 0 0) 0x7f4ccc005740 con 0x7f4cdc158ce0 2023-07-14T13:12:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.213+0000 7f4cdbfff640 1 -- 172.21.15.5:0/1300372159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cdc0c9560 msgr2=0x7f4cdc0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.213+0000 7f4cdbfff640 1 --2- 172.21.15.5:0/1300372159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cdc0c9560 0x7f4cdc0ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.213+0000 7f4cdbfff640 1 -- 172.21.15.5:0/1300372159 >> v1:172.21.15.5:6789/0 conn(0x7f4cdc158ce0 legacy=0x7f4cdc070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.213+0000 7f4cdbfff640 1 -- 172.21.15.5:0/1300372159 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cdc070c80 con 0x7f4cdc0c8ad0 2023-07-14T13:12:28.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.213+0000 7f4ce109d640 1 --2- 172.21.15.5:0/1300372159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cdc0c9560 0x7f4cdc0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:28.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.217+0000 7f4cdbfff640 1 --2- 172.21.15.5:0/1300372159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cdc0c8ad0 0x7f4cdc0c9020 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f4cc80097c0 tx=0x7f4cc801c250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97e742893fe7ff9b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.217+0000 7f4cdb7fe640 1 -- 172.21.15.5:0/1300372159 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd0001680 con 0x7f4cdc0c8ad0 2023-07-14T13:12:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.217+0000 7f4cdb7fe640 1 -- 172.21.15.5:0/1300372159 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc80a7050 con 0x7f4cdc0c8ad0 2023-07-14T13:12:28.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.217+0000 7f4cdb7fe640 1 -- 172.21.15.5:0/1300372159 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc80ab620 con 0x7f4cdc0c8ad0 2023-07-14T13:12:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.217+0000 7f4ce2b00640 1 -- 172.21.15.5:0/1300372159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cdc0c8ad0 msgr2=0x7f4cdc0c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.217+0000 7f4ce2b00640 1 --2- 172.21.15.5:0/1300372159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cdc0c8ad0 0x7f4cdc0c9020 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f4cc80097c0 tx=0x7f4cc801c250 comp rx=0 tx=0).stop 2023-07-14T13:12:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.217+0000 7f4ce2b00640 1 -- 172.21.15.5:0/1300372159 shutdown_connections 2023-07-14T13:12:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.217+0000 7f4ce2b00640 1 --2- 172.21.15.5:0/1300372159 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cdc0c9560 0x7f4cdc0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.217+0000 7f4ce2b00640 1 --2- 172.21.15.5:0/1300372159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cdc0c8ad0 0x7f4cdc0c9020 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.217+0000 7f4ce2b00640 1 -- 172.21.15.5:0/1300372159 >> 172.21.15.5:0/1300372159 conn(0x7f4cdc0afcf0 msgr2=0x7f4cdc0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:28.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.217+0000 7f4ce2b00640 1 -- 172.21.15.5:0/1300372159 shutdown_connections 2023-07-14T13:12:28.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.217+0000 7f4ce2b00640 1 -- 172.21.15.5:0/1300372159 wait complete. 2023-07-14T13:12:28.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.217+0000 7f4ce2b00640 1 Processor -- start 2023-07-14T13:12:28.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.217+0000 7f4ce2b00640 1 -- start start 2023-07-14T13:12:28.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.221+0000 7f4ce2b00640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cdc0c8ad0 0x7f4cdc1445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.221+0000 7f4ce2b00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cdc0c9560 0x7f4cdc15ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.221+0000 7f4ce2b00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cdc158ce0 0x7f4cdc0b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.221+0000 7f4ce2b00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc15c1a0 con 0x7f4cdc158ce0 2023-07-14T13:12:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.221+0000 7f4ce2b00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc15b900 con 0x7f4cdc0c9560 2023-07-14T13:12:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.221+0000 7f4ce2b00640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc15bbe0 con 0x7f4cdc0c8ad0 2023-07-14T13:12:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.221+0000 7f4ce109d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cdc158ce0 0x7f4cdc0b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.221+0000 7f4ce109d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cdc158ce0 0x7f4cdc0b16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59964/0 (socket says 172.21.15.5:59964) 2023-07-14T13:12:28.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.221+0000 7f4ce109d640 1 -- 172.21.15.5:0/3427752125 learned_addr learned my addr 172.21.15.5:0/3427752125 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:28.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.221+0000 7f4ce089c640 1 --2- 172.21.15.5:0/3427752125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cdc0c8ad0 0x7f4cdc1445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:28.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.221+0000 7f4cdbfff640 1 --2- 172.21.15.5:0/3427752125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cdc0c9560 0x7f4cdc15ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:28.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.221+0000 7f4ce109d640 1 -- 172.21.15.5:0/3427752125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cdc0c8ad0 msgr2=0x7f4cdc1445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:28.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.221+0000 7f4ce109d640 1 --2- 172.21.15.5:0/3427752125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cdc0c8ad0 0x7f4cdc1445c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:28.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.221+0000 7f4ce109d640 1 -- 172.21.15.5:0/3427752125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cdc0c9560 msgr2=0x7f4cdc15ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:28.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.221+0000 7f4ce109d640 1 --2- 172.21.15.5:0/3427752125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cdc0c9560 0x7f4cdc15ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:28.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.221+0000 7f4ce109d640 1 -- 172.21.15.5:0/3427752125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd4009a70 con 0x7f4cdc158ce0 2023-07-14T13:12:28.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.221+0000 7f4ce109d640 1 --2- 172.21.15.5:0/3427752125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cdc158ce0 0x7f4cdc0b16f0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400efc0 tx=0x7f4cd4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:28.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.221+0000 7f4cd97fa640 1 -- 172.21.15.5:0/3427752125 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4009d70 con 0x7f4cdc158ce0 2023-07-14T13:12:28.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.221+0000 7f4cd97fa640 1 -- 172.21.15.5:0/3427752125 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd400f040 con 0x7f4cdc158ce0 2023-07-14T13:12:28.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.221+0000 7f4cd97fa640 1 -- 172.21.15.5:0/3427752125 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd40039a0 con 0x7f4cdc158ce0 2023-07-14T13:12:28.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.221+0000 7f4ce2b00640 1 -- 172.21.15.5:0/3427752125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cc8009420 con 0x7f4cdc158ce0 2023-07-14T13:12:28.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.221+0000 7f4ce2b00640 1 -- 172.21.15.5:0/3427752125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cdc0b11d0 con 0x7f4cdc158ce0 2023-07-14T13:12:28.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.221+0000 7f4ce2b00640 1 -- 172.21.15.5:0/3427752125 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cdc0ca1a0 con 0x7f4cdc158ce0 2023-07-14T13:12:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.221+0000 7f4cd97fa640 1 -- 172.21.15.5:0/3427752125 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4cd40144a0 con 0x7f4cdc158ce0 2023-07-14T13:12:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.225+0000 7f4cd97fa640 1 --2- 172.21.15.5:0/3427752125 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f4cc00663a0 0x7f4cc0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.225+0000 7f4cd97fa640 1 -- 172.21.15.5:0/3427752125 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f4cd4084be0 con 0x7f4cdc158ce0 2023-07-14T13:12:28.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.225+0000 7f4ce089c640 1 --2- 172.21.15.5:0/3427752125 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f4cc00663a0 0x7f4cc0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:28.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.225+0000 7f4ce089c640 1 --2- 172.21.15.5:0/3427752125 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f4cc00663a0 0x7f4cc0068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0001ec0 tx=0x7f4cd00019c0 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:28.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.229+0000 7f4cd97fa640 1 -- 172.21.15.5:0/3427752125 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4cd4051e30 con 0x7f4cdc158ce0 2023-07-14T13:12:28.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.377+0000 7f4ce2b00640 1 -- 172.21.15.5:0/3427752125 --> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4cdc1590b0 con 0x7f4cc00663a0 2023-07-14T13:12:28.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.389+0000 7f4cd97fa640 1 -- 172.21.15.5:0/3427752125 <== mgr.7202 v2:172.21.15.154:6832/3769132865 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306119 (secure 0 0 0) 0x7f4cd00058e0 con 0x7f4cc00663a0 2023-07-14T13:12:28.425 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:28.426 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:12:28.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.389+0000 7f4ce2b00640 1 -- 172.21.15.5:0/3427752125 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f4cc00663a0 msgr2=0x7f4cc0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:28.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.389+0000 7f4ce2b00640 1 --2- 172.21.15.5:0/3427752125 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f4cc00663a0 0x7f4cc0068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0001ec0 tx=0x7f4cd00019c0 comp rx=0 tx=0).stop 2023-07-14T13:12:28.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.389+0000 7f4ce2b00640 1 -- 172.21.15.5:0/3427752125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cdc158ce0 msgr2=0x7f4cdc0b16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:28.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.389+0000 7f4ce2b00640 1 --2- 172.21.15.5:0/3427752125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cdc158ce0 0x7f4cdc0b16f0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400efc0 tx=0x7f4cd4009f90 comp rx=0 tx=0).stop 2023-07-14T13:12:28.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.389+0000 7f4ce2b00640 1 -- 172.21.15.5:0/3427752125 shutdown_connections 2023-07-14T13:12:28.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.389+0000 7f4ce2b00640 1 --2- 172.21.15.5:0/3427752125 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f4cc00663a0 0x7f4cc0068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:28.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.389+0000 7f4ce2b00640 1 --2- 172.21.15.5:0/3427752125 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cdc158ce0 0x7f4cdc0b16f0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:28.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.389+0000 7f4ce2b00640 1 --2- 172.21.15.5:0/3427752125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4cdc0c9560 0x7f4cdc15ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:28.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.389+0000 7f4ce2b00640 1 --2- 172.21.15.5:0/3427752125 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cdc0c8ad0 0x7f4cdc1445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:28.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.389+0000 7f4ce2b00640 1 -- 172.21.15.5:0/3427752125 >> 172.21.15.5:0/3427752125 conn(0x7f4cdc0afcf0 msgr2=0x7f4cdc151270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:28.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.389+0000 7f4ce2b00640 1 -- 172.21.15.5:0/3427752125 shutdown_connections 2023-07-14T13:12:28.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.389+0000 7f4ce2b00640 1 -- 172.21.15.5:0/3427752125 wait complete. 2023-07-14T13:12:28.445 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-14T13:12:27.580927+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":354100,"kb_used_data":14708,"kb_used_omap":0,"kb_used_meta":339328,"kb_avail":754620620,"statfs":{"total":773094113280,"available":772731514880,"internally_reserved":0,"allocated":15060992,"data_stored":8232618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":347471872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.683924"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.921634+0000","last_change":"2023-07-14T13:12:22.921634+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.921634+0000","last_undegraded":"2023-07-14T13:12:22.921634+0000","last_fullsized":"2023-07-14T13:12:22.921634+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.914942+0000","last_change":"2023-07-14T13:12:22.914942+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.914942+0000","last_undegraded":"2023-07-14T13:12:22.914942+0000","last_fullsized":"2023-07-14T13:12:22.914942+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.912221+0000","last_change":"2023-07-14T13:12:22.912221+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.912221+0000","last_undegraded":"2023-07-14T13:12:22.912221+0000","last_fullsized":"2023-07-14T13:12:22.912221+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.914791+0000","last_change":"2023-07-14T13:12:22.914791+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.914791+0000","last_undegraded":"2023-07-14T13:12:22.914791+0000","last_fullsized":"2023-07-14T13:12:22.914791+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.921391+0000","last_change":"2023-07-14T13:12:22.921391+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.921391+0000","last_undegraded":"2023-07-14T13:12:22.921391+0000","last_fullsized":"2023-07-14T13:12:22.921391+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.911078+0000","last_change":"2023-07-14T13:12:22.911078+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.911078+0000","last_undegraded":"2023-07-14T13:12:22.911078+0000","last_fullsized":"2023-07-14T13:12:22.911078+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.910643+0000","last_change":"2023-07-14T13:12:22.910643+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.910643+0000","last_undegraded":"2023-07-14T13:12:22.910643+0000","last_fullsized":"2023-07-14T13:12:22.910643+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.912745+0000","last_change":"2023-07-14T13:12:22.912745+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.912745+0000","last_undegraded":"2023-07-14T13:12:22.912745+0000","last_fullsized":"2023-07-14T13:12:22.912745+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.916440+0000","last_change":"2023-07-14T13:12:22.916440+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.916440+0000","last_undegraded":"2023-07-14T13:12:22.916440+0000","last_fullsized":"2023-07-14T13:12:22.916440+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.909705+0000","last_change":"2023-07-14T13:12:22.909705+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.909705+0000","last_undegraded":"2023-07-14T13:12:22.909705+0000","last_fullsized":"2023-07-14T13:12:22.909705+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.921599+0000","last_change":"2023-07-14T13:12:22.921599+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.921599+0000","last_undegraded":"2023-07-14T13:12:22.921599+0000","last_fullsized":"2023-07-14T13:12:22.921599+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.913503+0000","last_change":"2023-07-14T13:12:22.913503+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.913503+0000","last_undegraded":"2023-07-14T13:12:22.913503+0000","last_fullsized":"2023-07-14T13:12:22.913503+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.908889+0000","last_change":"2023-07-14T13:12:22.908889+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.908889+0000","last_undegraded":"2023-07-14T13:12:22.908889+0000","last_fullsized":"2023-07-14T13:12:22.908889+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.918157+0000","last_change":"2023-07-14T13:12:22.918157+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.918157+0000","last_undegraded":"2023-07-14T13:12:22.918157+0000","last_fullsized":"2023-07-14T13:12:22.918157+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.922362+0000","last_change":"2023-07-14T13:12:22.922362+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.922362+0000","last_undegraded":"2023-07-14T13:12:22.922362+0000","last_fullsized":"2023-07-14T13:12:22.922362+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.911369+0000","last_change":"2023-07-14T13:12:22.911369+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.911369+0000","last_undegraded":"2023-07-14T13:12:22.911369+0000","last_fullsized":"2023-07-14T13:12:22.911369+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.909224+0000","last_change":"2023-07-14T13:12:22.909224+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.909224+0000","last_undegraded":"2023-07-14T13:12:22.909224+0000","last_fullsized":"2023-07-14T13:12:22.909224+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.914405+0000","last_change":"2023-07-14T13:12:22.914405+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.914405+0000","last_undegraded":"2023-07-14T13:12:22.914405+0000","last_fullsized":"2023-07-14T13:12:22.914405+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.917896+0000","last_change":"2023-07-14T13:12:22.917896+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.917896+0000","last_undegraded":"2023-07-14T13:12:22.917896+0000","last_fullsized":"2023-07-14T13:12:22.917896+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.910687+0000","last_change":"2023-07-14T13:12:22.910687+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.910687+0000","last_undegraded":"2023-07-14T13:12:22.910687+0000","last_fullsized":"2023-07-14T13:12:22.910687+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.916401+0000","last_change":"2023-07-14T13:12:22.916401+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.916401+0000","last_undegraded":"2023-07-14T13:12:22.916401+0000","last_fullsized":"2023-07-14T13:12:22.916401+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.921056+0000","last_change":"2023-07-14T13:12:22.921056+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.921056+0000","last_undegraded":"2023-07-14T13:12:22.921056+0000","last_fullsized":"2023-07-14T13:12:22.921056+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.914616+0000","last_change":"2023-07-14T13:12:22.914616+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.914616+0000","last_undegraded":"2023-07-14T13:12:22.914616+0000","last_fullsized":"2023-07-14T13:12:22.914616+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.912264+0000","last_change":"2023-07-14T13:12:22.912264+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.912264+0000","last_undegraded":"2023-07-14T13:12:22.912264+0000","last_fullsized":"2023-07-14T13:12:22.912264+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.913552+0000","last_change":"2023-07-14T13:12:22.913552+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.913552+0000","last_undegraded":"2023-07-14T13:12:22.913552+0000","last_fullsized":"2023-07-14T13:12:22.913552+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.910524+0000","last_change":"2023-07-14T13:12:22.910524+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.910524+0000","last_undegraded":"2023-07-14T13:12:22.910524+0000","last_fullsized":"2023-07-14T13:12:22.910524+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.915798+0000","last_change":"2023-07-14T13:12:22.915798+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.915798+0000","last_undegraded":"2023-07-14T13:12:22.915798+0000","last_fullsized":"2023-07-14T13:12:22.915798+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.913041+0000","last_change":"2023-07-14T13:12:22.913041+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.913041+0000","last_undegraded":"2023-07-14T13:12:22.913041+0000","last_fullsized":"2023-07-14T13:12:22.913041+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.913586+0000","last_change":"2023-07-14T13:12:22.913586+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.913586+0000","last_undegraded":"2023-07-14T13:12:22.913586+0000","last_fullsized":"2023-07-14T13:12:22.913586+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.910071+0000","last_change":"2023-07-14T13:12:22.910071+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.910071+0000","last_undegraded":"2023-07-14T13:12:22.910071+0000","last_fullsized":"2023-07-14T13:12:22.910071+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.911426+0000","last_change":"2023-07-14T13:12:22.911426+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.911426+0000","last_undegraded":"2023-07-14T13:12:22.911426+0000","last_fullsized":"2023-07-14T13:12:22.911426+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.911697+0000","last_change":"2023-07-14T13:12:22.911697+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.911697+0000","last_undegraded":"2023-07-14T13:12:22.911697+0000","last_fullsized":"2023-07-14T13:12:22.911697+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.909364+0000","last_change":"2023-07-14T13:12:22.909364+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.909364+0000","last_undegraded":"2023-07-14T13:12:22.909364+0000","last_fullsized":"2023-07-14T13:12:22.909364+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.935368+0000","last_change":"2023-07-14T13:12:22.932726+0000","last_active":"2023-07-14T13:12:22.935368+0000","last_peered":"2023-07-14T13:12:22.935368+0000","last_clean":"2023-07-14T13:12:22.935368+0000","last_became_active":"2023-07-14T13:12:22.932398+0000","last_became_peered":"2023-07-14T13:12:22.932398+0000","last_unstale":"2023-07-14T13:12:22.935368+0000","last_undegraded":"2023-07-14T13:12:22.935368+0000","last_fullsized":"2023-07-14T13:12:22.935368+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:15:52.769714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.909091+0000","last_change":"2023-07-14T13:12:22.909091+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.909091+0000","last_undegraded":"2023-07-14T13:12:22.909091+0000","last_fullsized":"2023-07-14T13:12:22.909091+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.927429+0000","last_change":"2023-07-14T13:12:22.920816+0000","last_active":"2023-07-14T13:12:22.927429+0000","last_peered":"2023-07-14T13:12:22.927429+0000","last_clean":"2023-07-14T13:12:22.927429+0000","last_became_active":"2023-07-14T13:12:22.918830+0000","last_became_peered":"2023-07-14T13:12:22.918830+0000","last_unstale":"2023-07-14T13:12:22.927429+0000","last_undegraded":"2023-07-14T13:12:22.927429+0000","last_fullsized":"2023-07-14T13:12:22.927429+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:36:04.726809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.912583+0000","last_change":"2023-07-14T13:12:22.912583+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.912583+0000","last_undegraded":"2023-07-14T13:12:22.912583+0000","last_fullsized":"2023-07-14T13:12:22.912583+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.933303+0000","last_change":"2023-07-14T13:12:22.929668+0000","last_active":"2023-07-14T13:12:22.933303+0000","last_peered":"2023-07-14T13:12:22.933303+0000","last_clean":"2023-07-14T13:12:22.933303+0000","last_became_active":"2023-07-14T13:12:22.929296+0000","last_became_peered":"2023-07-14T13:12:22.929296+0000","last_unstale":"2023-07-14T13:12:22.933303+0000","last_undegraded":"2023-07-14T13:12:22.933303+0000","last_fullsized":"2023-07-14T13:12:22.933303+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:16:59.861984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.914814+0000","last_change":"2023-07-14T13:12:22.914814+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.914814+0000","last_undegraded":"2023-07-14T13:12:22.914814+0000","last_fullsized":"2023-07-14T13:12:22.914814+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.929815+0000","last_change":"2023-07-14T13:12:22.923046+0000","last_active":"2023-07-14T13:12:22.929815+0000","last_peered":"2023-07-14T13:12:22.929815+0000","last_clean":"2023-07-14T13:12:22.929815+0000","last_became_active":"2023-07-14T13:12:22.922783+0000","last_became_peered":"2023-07-14T13:12:22.922783+0000","last_unstale":"2023-07-14T13:12:22.929815+0000","last_undegraded":"2023-07-14T13:12:22.929815+0000","last_fullsized":"2023-07-14T13:12:22.929815+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:13:07.210080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.907985+0000","last_change":"2023-07-14T13:12:22.907985+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.907985+0000","last_undegraded":"2023-07-14T13:12:22.907985+0000","last_fullsized":"2023-07-14T13:12:22.907985+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.935422+0000","last_change":"2023-07-14T13:12:22.932158+0000","last_active":"2023-07-14T13:12:22.935422+0000","last_peered":"2023-07-14T13:12:22.935422+0000","last_clean":"2023-07-14T13:12:22.935422+0000","last_became_active":"2023-07-14T13:12:22.931753+0000","last_became_peered":"2023-07-14T13:12:22.931753+0000","last_unstale":"2023-07-14T13:12:22.935422+0000","last_undegraded":"2023-07-14T13:12:22.935422+0000","last_fullsized":"2023-07-14T13:12:22.935422+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:36:42.112446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.921862+0000","last_change":"2023-07-14T13:12:22.921862+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.921862+0000","last_undegraded":"2023-07-14T13:12:22.921862+0000","last_fullsized":"2023-07-14T13:12:22.921862+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.927809+0000","last_change":"2023-07-14T13:12:22.923614+0000","last_active":"2023-07-14T13:12:22.927809+0000","last_peered":"2023-07-14T13:12:22.927809+0000","last_clean":"2023-07-14T13:12:22.927809+0000","last_became_active":"2023-07-14T13:12:22.923312+0000","last_became_peered":"2023-07-14T13:12:22.923312+0000","last_unstale":"2023-07-14T13:12:22.927809+0000","last_undegraded":"2023-07-14T13:12:22.927809+0000","last_fullsized":"2023-07-14T13:12:22.927809+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:46:19.955743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.909458+0000","last_change":"2023-07-14T13:12:22.909458+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.909458+0000","last_undegraded":"2023-07-14T13:12:22.909458+0000","last_fullsized":"2023-07-14T13:12:22.909458+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.927247+0000","last_change":"2023-07-14T13:12:22.923307+0000","last_active":"2023-07-14T13:12:22.927247+0000","last_peered":"2023-07-14T13:12:22.927247+0000","last_clean":"2023-07-14T13:12:22.927247+0000","last_became_active":"2023-07-14T13:12:22.922942+0000","last_became_peered":"2023-07-14T13:12:22.922942+0000","last_unstale":"2023-07-14T13:12:22.927247+0000","last_undegraded":"2023-07-14T13:12:22.927247+0000","last_fullsized":"2023-07-14T13:12:22.927247+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:37:51.826743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.908398+0000","last_change":"2023-07-14T13:12:22.908398+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.908398+0000","last_undegraded":"2023-07-14T13:12:22.908398+0000","last_fullsized":"2023-07-14T13:12:22.908398+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.929646+0000","last_change":"2023-07-14T13:12:22.924153+0000","last_active":"2023-07-14T13:12:22.929646+0000","last_peered":"2023-07-14T13:12:22.929646+0000","last_clean":"2023-07-14T13:12:22.929646+0000","last_became_active":"2023-07-14T13:12:22.923877+0000","last_became_peered":"2023-07-14T13:12:22.923877+0000","last_unstale":"2023-07-14T13:12:22.929646+0000","last_undegraded":"2023-07-14T13:12:22.929646+0000","last_fullsized":"2023-07-14T13:12:22.929646+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:58:25.336605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.911832+0000","last_change":"2023-07-14T13:12:22.911832+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.911832+0000","last_undegraded":"2023-07-14T13:12:22.911832+0000","last_fullsized":"2023-07-14T13:12:22.911832+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.927426+0000","last_change":"2023-07-14T13:12:22.920785+0000","last_active":"2023-07-14T13:12:22.927426+0000","last_peered":"2023-07-14T13:12:22.927426+0000","last_clean":"2023-07-14T13:12:22.927426+0000","last_became_active":"2023-07-14T13:12:22.920453+0000","last_became_peered":"2023-07-14T13:12:22.920453+0000","last_unstale":"2023-07-14T13:12:22.927426+0000","last_undegraded":"2023-07-14T13:12:22.927426+0000","last_fullsized":"2023-07-14T13:12:22.927426+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:17:25.734784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.920524+0000","last_change":"2023-07-14T13:12:22.920524+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.920524+0000","last_undegraded":"2023-07-14T13:12:22.920524+0000","last_fullsized":"2023-07-14T13:12:22.920524+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.923584+0000","last_change":"2023-07-14T13:12:22.922475+0000","last_active":"2023-07-14T13:12:22.923584+0000","last_peered":"2023-07-14T13:12:22.923584+0000","last_clean":"2023-07-14T13:12:22.923584+0000","last_became_active":"2023-07-14T13:12:22.922174+0000","last_became_peered":"2023-07-14T13:12:22.922174+0000","last_unstale":"2023-07-14T13:12:22.923584+0000","last_undegraded":"2023-07-14T13:12:22.923584+0000","last_fullsized":"2023-07-14T13:12:22.923584+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:55:25.302543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.908467+0000","last_change":"2023-07-14T13:12:22.908467+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.908467+0000","last_undegraded":"2023-07-14T13:12:22.908467+0000","last_fullsized":"2023-07-14T13:12:22.908467+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.933284+0000","last_change":"2023-07-14T13:12:22.929389+0000","last_active":"2023-07-14T13:12:22.933284+0000","last_peered":"2023-07-14T13:12:22.933284+0000","last_clean":"2023-07-14T13:12:22.933284+0000","last_became_active":"2023-07-14T13:12:22.929005+0000","last_became_peered":"2023-07-14T13:12:22.929005+0000","last_unstale":"2023-07-14T13:12:22.933284+0000","last_undegraded":"2023-07-14T13:12:22.933284+0000","last_fullsized":"2023-07-14T13:12:22.933284+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:32:45.606297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.911429+0000","last_change":"2023-07-14T13:12:22.911429+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.911429+0000","last_undegraded":"2023-07-14T13:12:22.911429+0000","last_fullsized":"2023-07-14T13:12:22.911429+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.933160+0000","last_change":"2023-07-14T13:12:22.929144+0000","last_active":"2023-07-14T13:12:22.933160+0000","last_peered":"2023-07-14T13:12:22.933160+0000","last_clean":"2023-07-14T13:12:22.933160+0000","last_became_active":"2023-07-14T13:12:22.928845+0000","last_became_peered":"2023-07-14T13:12:22.928845+0000","last_unstale":"2023-07-14T13:12:22.933160+0000","last_undegraded":"2023-07-14T13:12:22.933160+0000","last_fullsized":"2023-07-14T13:12:22.933160+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:35.675380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.910902+0000","last_change":"2023-07-14T13:12:22.910902+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.910902+0000","last_undegraded":"2023-07-14T13:12:22.910902+0000","last_fullsized":"2023-07-14T13:12:22.910902+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.930872+0000","last_change":"2023-07-14T13:12:22.929261+0000","last_active":"2023-07-14T13:12:22.930872+0000","last_peered":"2023-07-14T13:12:22.930872+0000","last_clean":"2023-07-14T13:12:22.930872+0000","last_became_active":"2023-07-14T13:12:22.928961+0000","last_became_peered":"2023-07-14T13:12:22.928961+0000","last_unstale":"2023-07-14T13:12:22.930872+0000","last_undegraded":"2023-07-14T13:12:22.930872+0000","last_fullsized":"2023-07-14T13:12:22.930872+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:39:55.963756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.909619+0000","last_change":"2023-07-14T13:12:22.909619+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.909619+0000","last_undegraded":"2023-07-14T13:12:22.909619+0000","last_fullsized":"2023-07-14T13:12:22.909619+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.933336+0000","last_change":"2023-07-14T13:12:22.931434+0000","last_active":"2023-07-14T13:12:22.933336+0000","last_peered":"2023-07-14T13:12:22.933336+0000","last_clean":"2023-07-14T13:12:22.933336+0000","last_became_active":"2023-07-14T13:12:22.931004+0000","last_became_peered":"2023-07-14T13:12:22.931004+0000","last_unstale":"2023-07-14T13:12:22.933336+0000","last_undegraded":"2023-07-14T13:12:22.933336+0000","last_fullsized":"2023-07-14T13:12:22.933336+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:47:41.118725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.908947+0000","last_change":"2023-07-14T13:12:22.908947+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.908947+0000","last_undegraded":"2023-07-14T13:12:22.908947+0000","last_fullsized":"2023-07-14T13:12:22.908947+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.930433+0000","last_change":"2023-07-14T13:12:22.928525+0000","last_active":"2023-07-14T13:12:22.930433+0000","last_peered":"2023-07-14T13:12:22.930433+0000","last_clean":"2023-07-14T13:12:22.930433+0000","last_became_active":"2023-07-14T13:12:22.928254+0000","last_became_peered":"2023-07-14T13:12:22.928254+0000","last_unstale":"2023-07-14T13:12:22.930433+0000","last_undegraded":"2023-07-14T13:12:22.930433+0000","last_fullsized":"2023-07-14T13:12:22.930433+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:35:23.471165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.911426+0000","last_change":"2023-07-14T13:12:22.911426+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.911426+0000","last_undegraded":"2023-07-14T13:12:22.911426+0000","last_fullsized":"2023-07-14T13:12:22.911426+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.932205+0000","last_change":"2023-07-14T13:12:22.926412+0000","last_active":"2023-07-14T13:12:22.932205+0000","last_peered":"2023-07-14T13:12:22.932205+0000","last_clean":"2023-07-14T13:12:22.932205+0000","last_became_active":"2023-07-14T13:12:22.925771+0000","last_became_peered":"2023-07-14T13:12:22.925771+0000","last_unstale":"2023-07-14T13:12:22.932205+0000","last_undegraded":"2023-07-14T13:12:22.932205+0000","last_fullsized":"2023-07-14T13:12:22.932205+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:56:32.388227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.912579+0000","last_change":"2023-07-14T13:12:22.912579+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.912579+0000","last_undegraded":"2023-07-14T13:12:22.912579+0000","last_fullsized":"2023-07-14T13:12:22.912579+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.930761+0000","last_change":"2023-07-14T13:12:22.927390+0000","last_active":"2023-07-14T13:12:22.930761+0000","last_peered":"2023-07-14T13:12:22.930761+0000","last_clean":"2023-07-14T13:12:22.930761+0000","last_became_active":"2023-07-14T13:12:22.927081+0000","last_became_peered":"2023-07-14T13:12:22.927081+0000","last_unstale":"2023-07-14T13:12:22.930761+0000","last_undegraded":"2023-07-14T13:12:22.930761+0000","last_fullsized":"2023-07-14T13:12:22.930761+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:59.167504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.907525+0000","last_change":"2023-07-14T13:12:22.907525+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.907525+0000","last_undegraded":"2023-07-14T13:12:22.907525+0000","last_fullsized":"2023-07-14T13:12:22.907525+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.930233+0000","last_change":"2023-07-14T13:12:22.927740+0000","last_active":"2023-07-14T13:12:22.930233+0000","last_peered":"2023-07-14T13:12:22.930233+0000","last_clean":"2023-07-14T13:12:22.930233+0000","last_became_active":"2023-07-14T13:12:22.927419+0000","last_became_peered":"2023-07-14T13:12:22.927419+0000","last_unstale":"2023-07-14T13:12:22.930233+0000","last_undegraded":"2023-07-14T13:12:22.930233+0000","last_fullsized":"2023-07-14T13:12:22.930233+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:42:30.256640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.914915+0000","last_change":"2023-07-14T13:12:22.914915+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.914915+0000","last_undegraded":"2023-07-14T13:12:22.914915+0000","last_fullsized":"2023-07-14T13:12:22.914915+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.928781+0000","last_change":"2023-07-14T13:12:22.926828+0000","last_active":"2023-07-14T13:12:22.928781+0000","last_peered":"2023-07-14T13:12:22.928781+0000","last_clean":"2023-07-14T13:12:22.928781+0000","last_became_active":"2023-07-14T13:12:22.926532+0000","last_became_peered":"2023-07-14T13:12:22.926532+0000","last_unstale":"2023-07-14T13:12:22.928781+0000","last_undegraded":"2023-07-14T13:12:22.928781+0000","last_fullsized":"2023-07-14T13:12:22.928781+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:27.875338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.910320+0000","last_change":"2023-07-14T13:12:22.910320+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.910320+0000","last_undegraded":"2023-07-14T13:12:22.910320+0000","last_fullsized":"2023-07-14T13:12:22.910320+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.930787+0000","last_change":"2023-07-14T13:12:22.928393+0000","last_active":"2023-07-14T13:12:22.930787+0000","last_peered":"2023-07-14T13:12:22.930787+0000","last_clean":"2023-07-14T13:12:22.930787+0000","last_became_active":"2023-07-14T13:12:22.928069+0000","last_became_peered":"2023-07-14T13:12:22.928069+0000","last_unstale":"2023-07-14T13:12:22.930787+0000","last_undegraded":"2023-07-14T13:12:22.930787+0000","last_fullsized":"2023-07-14T13:12:22.930787+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:52:26.822243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.909148+0000","last_change":"2023-07-14T13:12:22.909148+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.909148+0000","last_undegraded":"2023-07-14T13:12:22.909148+0000","last_fullsized":"2023-07-14T13:12:22.909148+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.932673+0000","last_change":"2023-07-14T13:12:22.926375+0000","last_active":"2023-07-14T13:12:22.932673+0000","last_peered":"2023-07-14T13:12:22.932673+0000","last_clean":"2023-07-14T13:12:22.932673+0000","last_became_active":"2023-07-14T13:12:22.926097+0000","last_became_peered":"2023-07-14T13:12:22.926097+0000","last_unstale":"2023-07-14T13:12:22.932673+0000","last_undegraded":"2023-07-14T13:12:22.932673+0000","last_fullsized":"2023-07-14T13:12:22.932673+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:41:02.972781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.909154+0000","last_change":"2023-07-14T13:12:22.909154+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.909154+0000","last_undegraded":"2023-07-14T13:12:22.909154+0000","last_fullsized":"2023-07-14T13:12:22.909154+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.932914+0000","last_change":"2023-07-14T13:12:22.928830+0000","last_active":"2023-07-14T13:12:22.932914+0000","last_peered":"2023-07-14T13:12:22.932914+0000","last_clean":"2023-07-14T13:12:22.932914+0000","last_became_active":"2023-07-14T13:12:22.928458+0000","last_became_peered":"2023-07-14T13:12:22.928458+0000","last_unstale":"2023-07-14T13:12:22.932914+0000","last_undegraded":"2023-07-14T13:12:22.932914+0000","last_fullsized":"2023-07-14T13:12:22.932914+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:44:44.418690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.915122+0000","last_change":"2023-07-14T13:12:22.915122+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.915122+0000","last_undegraded":"2023-07-14T13:12:22.915122+0000","last_fullsized":"2023-07-14T13:12:22.915122+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.929573+0000","last_change":"2023-07-14T13:12:22.924885+0000","last_active":"2023-07-14T13:12:22.929573+0000","last_peered":"2023-07-14T13:12:22.929573+0000","last_clean":"2023-07-14T13:12:22.929573+0000","last_became_active":"2023-07-14T13:12:22.924441+0000","last_became_peered":"2023-07-14T13:12:22.924441+0000","last_unstale":"2023-07-14T13:12:22.929573+0000","last_undegraded":"2023-07-14T13:12:22.929573+0000","last_fullsized":"2023-07-14T13:12:22.929573+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:02:11.936198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.907380+0000","last_change":"2023-07-14T13:12:22.907380+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.907380+0000","last_undegraded":"2023-07-14T13:12:22.907380+0000","last_fullsized":"2023-07-14T13:12:22.907380+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.932224+0000","last_change":"2023-07-14T13:12:22.926905+0000","last_active":"2023-07-14T13:12:22.932224+0000","last_peered":"2023-07-14T13:12:22.932224+0000","last_clean":"2023-07-14T13:12:22.932224+0000","last_became_active":"2023-07-14T13:12:22.926579+0000","last_became_peered":"2023-07-14T13:12:22.926579+0000","last_unstale":"2023-07-14T13:12:22.932224+0000","last_undegraded":"2023-07-14T13:12:22.932224+0000","last_fullsized":"2023-07-14T13:12:22.932224+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:47:41.849069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.915949+0000","last_change":"2023-07-14T13:12:22.915949+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.915949+0000","last_undegraded":"2023-07-14T13:12:22.915949+0000","last_fullsized":"2023-07-14T13:12:22.915949+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.931185+0000","last_change":"2023-07-14T13:12:22.929600+0000","last_active":"2023-07-14T13:12:22.931185+0000","last_peered":"2023-07-14T13:12:22.931185+0000","last_clean":"2023-07-14T13:12:22.931185+0000","last_became_active":"2023-07-14T13:12:22.929310+0000","last_became_peered":"2023-07-14T13:12:22.929310+0000","last_unstale":"2023-07-14T13:12:22.931185+0000","last_undegraded":"2023-07-14T13:12:22.931185+0000","last_fullsized":"2023-07-14T13:12:22.931185+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:23:45.496444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"129'249","reported_seq":852,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.915653+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:12:22.915653+0000","last_peered":"2023-07-14T13:12:22.915653+0000","last_clean":"2023-07-14T13:12:22.915653+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:12:22.915653+0000","last_undegraded":"2023-07-14T13:12:22.915653+0000","last_fullsized":"2023-07-14T13:12:22.915653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:40:02.311140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":224,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.914119+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:12:22.914119+0000","last_peered":"2023-07-14T13:12:22.914119+0000","last_clean":"2023-07-14T13:12:22.914119+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:12:22.914119+0000","last_undegraded":"2023-07-14T13:12:22.914119+0000","last_fullsized":"2023-07-14T13:12:22.914119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:58:25.383198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.915442+0000","last_change":"2023-07-14T13:12:22.915442+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.915442+0000","last_undegraded":"2023-07-14T13:12:22.915442+0000","last_fullsized":"2023-07-14T13:12:22.915442+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.931190+0000","last_change":"2023-07-14T13:12:22.929681+0000","last_active":"2023-07-14T13:12:22.931190+0000","last_peered":"2023-07-14T13:12:22.931190+0000","last_clean":"2023-07-14T13:12:22.931190+0000","last_became_active":"2023-07-14T13:12:22.929406+0000","last_became_peered":"2023-07-14T13:12:22.929406+0000","last_unstale":"2023-07-14T13:12:22.931190+0000","last_undegraded":"2023-07-14T13:12:22.931190+0000","last_fullsized":"2023-07-14T13:12:22.931190+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:03:13.962974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":228,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.914816+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:12:22.914816+0000","last_peered":"2023-07-14T13:12:22.914816+0000","last_clean":"2023-07-14T13:12:22.914816+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:12:22.914816+0000","last_undegraded":"2023-07-14T13:12:22.914816+0000","last_fullsized":"2023-07-14T13:12:22.914816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:00.709746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.908014+0000","last_change":"2023-07-14T13:12:22.908014+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.908014+0000","last_undegraded":"2023-07-14T13:12:22.908014+0000","last_fullsized":"2023-07-14T13:12:22.908014+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.929091+0000","last_change":"2023-07-14T13:12:22.924565+0000","last_active":"2023-07-14T13:12:22.929091+0000","last_peered":"2023-07-14T13:12:22.929091+0000","last_clean":"2023-07-14T13:12:22.929091+0000","last_became_active":"2023-07-14T13:12:22.924067+0000","last_became_peered":"2023-07-14T13:12:22.924067+0000","last_unstale":"2023-07-14T13:12:22.929091+0000","last_undegraded":"2023-07-14T13:12:22.929091+0000","last_fullsized":"2023-07-14T13:12:22.929091+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:41:00.498547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":226,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.907399+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:12:22.907399+0000","last_peered":"2023-07-14T13:12:22.907399+0000","last_clean":"2023-07-14T13:12:22.907399+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:12:22.907399+0000","last_undegraded":"2023-07-14T13:12:22.907399+0000","last_fullsized":"2023-07-14T13:12:22.907399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:11:10.601154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.910272+0000","last_change":"2023-07-14T13:12:22.910272+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.910272+0000","last_undegraded":"2023-07-14T13:12:22.910272+0000","last_fullsized":"2023-07-14T13:12:22.910272+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.930392+0000","last_change":"2023-07-14T13:12:22.927281+0000","last_active":"2023-07-14T13:12:22.930392+0000","last_peered":"2023-07-14T13:12:22.930392+0000","last_clean":"2023-07-14T13:12:22.930392+0000","last_became_active":"2023-07-14T13:12:22.926987+0000","last_became_peered":"2023-07-14T13:12:22.926987+0000","last_unstale":"2023-07-14T13:12:22.930392+0000","last_undegraded":"2023-07-14T13:12:22.930392+0000","last_fullsized":"2023-07-14T13:12:22.930392+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:13:56.663119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":224,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.914252+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:12:22.914252+0000","last_peered":"2023-07-14T13:12:22.914252+0000","last_clean":"2023-07-14T13:12:22.914252+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:12:22.914252+0000","last_undegraded":"2023-07-14T13:12:22.914252+0000","last_fullsized":"2023-07-14T13:12:22.914252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:04:17.778038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.915998+0000","last_change":"2023-07-14T13:12:22.915998+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.915998+0000","last_undegraded":"2023-07-14T13:12:22.915998+0000","last_fullsized":"2023-07-14T13:12:22.915998+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.928805+0000","last_change":"2023-07-14T13:12:22.926462+0000","last_active":"2023-07-14T13:12:22.928805+0000","last_peered":"2023-07-14T13:12:22.928805+0000","last_clean":"2023-07-14T13:12:22.928805+0000","last_became_active":"2023-07-14T13:12:22.926168+0000","last_became_peered":"2023-07-14T13:12:22.926168+0000","last_unstale":"2023-07-14T13:12:22.928805+0000","last_undegraded":"2023-07-14T13:12:22.928805+0000","last_fullsized":"2023-07-14T13:12:22.928805+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:36:23.597546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":236,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.904286+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:12:22.904286+0000","last_peered":"2023-07-14T13:12:22.904286+0000","last_clean":"2023-07-14T13:12:22.904286+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:12:22.904286+0000","last_undegraded":"2023-07-14T13:12:22.904286+0000","last_fullsized":"2023-07-14T13:12:22.904286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:39:51.306284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.912244+0000","last_change":"2023-07-14T13:12:22.912244+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.912244+0000","last_undegraded":"2023-07-14T13:12:22.912244+0000","last_fullsized":"2023-07-14T13:12:22.912244+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.927372+0000","last_change":"2023-07-14T13:12:22.922833+0000","last_active":"2023-07-14T13:12:22.927372+0000","last_peered":"2023-07-14T13:12:22.927372+0000","last_clean":"2023-07-14T13:12:22.927372+0000","last_became_active":"2023-07-14T13:12:22.922520+0000","last_became_peered":"2023-07-14T13:12:22.922520+0000","last_unstale":"2023-07-14T13:12:22.927372+0000","last_undegraded":"2023-07-14T13:12:22.927372+0000","last_fullsized":"2023-07-14T13:12:22.927372+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:49:35.637130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":228,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.917411+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:12:22.917411+0000","last_peered":"2023-07-14T13:12:22.917411+0000","last_clean":"2023-07-14T13:12:22.917411+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:12:22.917411+0000","last_undegraded":"2023-07-14T13:12:22.917411+0000","last_fullsized":"2023-07-14T13:12:22.917411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:22:14.236318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.912765+0000","last_change":"2023-07-14T13:12:22.912765+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.912765+0000","last_undegraded":"2023-07-14T13:12:22.912765+0000","last_fullsized":"2023-07-14T13:12:22.912765+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.928043+0000","last_change":"2023-07-14T13:12:22.924751+0000","last_active":"2023-07-14T13:12:22.928043+0000","last_peered":"2023-07-14T13:12:22.928043+0000","last_clean":"2023-07-14T13:12:22.928043+0000","last_became_active":"2023-07-14T13:12:22.924479+0000","last_became_peered":"2023-07-14T13:12:22.924479+0000","last_unstale":"2023-07-14T13:12:22.928043+0000","last_undegraded":"2023-07-14T13:12:22.928043+0000","last_fullsized":"2023-07-14T13:12:22.928043+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:27:08.709009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":236,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.904287+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:12:22.904287+0000","last_peered":"2023-07-14T13:12:22.904287+0000","last_clean":"2023-07-14T13:12:22.904287+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:12:22.904287+0000","last_undegraded":"2023-07-14T13:12:22.904287+0000","last_fullsized":"2023-07-14T13:12:22.904287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:09:58.237621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.912085+0000","last_change":"2023-07-14T13:12:22.912085+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.912085+0000","last_undegraded":"2023-07-14T13:12:22.912085+0000","last_fullsized":"2023-07-14T13:12:22.912085+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.929807+0000","last_change":"2023-07-14T13:12:22.925040+0000","last_active":"2023-07-14T13:12:22.929807+0000","last_peered":"2023-07-14T13:12:22.929807+0000","last_clean":"2023-07-14T13:12:22.929807+0000","last_became_active":"2023-07-14T13:12:22.924712+0000","last_became_peered":"2023-07-14T13:12:22.924712+0000","last_unstale":"2023-07-14T13:12:22.929807+0000","last_undegraded":"2023-07-14T13:12:22.929807+0000","last_fullsized":"2023-07-14T13:12:22.929807+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:36:04.651057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":228,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.917713+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:12:22.917713+0000","last_peered":"2023-07-14T13:12:22.917713+0000","last_clean":"2023-07-14T13:12:22.917713+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:12:22.917713+0000","last_undegraded":"2023-07-14T13:12:22.917713+0000","last_fullsized":"2023-07-14T13:12:22.917713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:15:41.601743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575083,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59552,"kb_used_data":2264,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312288,"statfs":{"total":96636764160,"available":96575782912,"internally_reserved":0,"allocated":2318336,"data_stored":1466284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.68999999999999995,"15min":0.70699999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.84199999999999997,"5min":1.262,"15min":1.262},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71699999999999997,"15min":0.72899999999999998},"min":{"1min":0.54100000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.67600000000000005}]},{"osd":1,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.70599999999999996,"15min":0.72999999999999998},"min":{"1min":0.44,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83799999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72799999999999998,"15min":0.74299999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71199999999999997,"15min":0.72599999999999998},"min":{"1min":0.48999999999999999,"5min":0.46100000000000002,"15min":0.42699999999999999},"max":{"1min":0.91500000000000004,"5min":1.073,"15min":1.073},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.753},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84899999999999998,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.85099999999999998}]},{"osd":3,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.72699999999999998,"15min":0.73599999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.091,"5min":1.161,"15min":1.161},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73999999999999999,"15min":0.75600000000000001},"min":{"1min":0.51100000000000001,"5min":0.47899999999999998,"15min":0.41499999999999998},"max":{"1min":0.94899999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.81799999999999995}]},{"osd":4,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56899999999999995,"15min":0.57899999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.318},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.022},"last":0.433},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.40000000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.47299999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.42699999999999999,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.91000000000000003,"5min":0.98099999999999998,"15min":0.98299999999999998},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63100000000000001,"15min":0.64900000000000002},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.34100000000000003},"max":{"1min":0.80500000000000005,"5min":1.028,"15min":1.028},"last":0.58899999999999997}]},{"osd":6,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.42699999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.0489999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.68100000000000005,"15min":0.67700000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.36299999999999999},"max":{"1min":1.151,"5min":4.1130000000000004,"15min":4.1130000000000004},"last":0.64500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575084,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32744,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339096,"statfs":{"total":96636764160,"available":96603234304,"internally_reserved":0,"allocated":1736704,"data_stored":882572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70699999999999996,"15min":0.72699999999999998},"min":{"1min":0.496,"5min":0.47899999999999998,"15min":0.38},"max":{"1min":0.89300000000000002,"5min":0.90400000000000003,"15min":0.996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69999999999999996,"15min":0.72399999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88100000000000001,"5min":0.98199999999999998,"15min":1.0800000000000001},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70099999999999996,"15min":0.73299999999999998},"min":{"1min":0.48499999999999999,"5min":0.42299999999999999,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.0209999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69199999999999995,"15min":0.71899999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82999999999999996,"5min":0.88100000000000001,"15min":1.077},"last":0.625}]},{"osd":2,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.746},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.45900000000000002},"max":{"1min":0.872,"5min":0.95099999999999996,"15min":1.105},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71799999999999997,"15min":0.745},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.92100000000000004,"5min":0.99099999999999999,"15min":1.0900000000000001},"last":0.64000000000000001}]},{"osd":3,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72899999999999998,"15min":0.76600000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89300000000000002,"5min":1.054,"15min":1.1359999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71399999999999997,"15min":0.753},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93600000000000005,"5min":0.94799999999999995,"15min":1.1080000000000001},"last":0.86699999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.502},{"interface":"front","average":{"1min":0.628,"5min":0.63900000000000001,"15min":0.63600000000000001},"min":{"1min":0.47499999999999998,"5min":0.439,"15min":0.38500000000000001},"max":{"1min":0.79800000000000004,"5min":0.95499999999999996,"15min":1.0780000000000001},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63,"15min":0.64000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":1.579},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48199999999999998,"5min":0.46300000000000002,"15min":0.42399999999999999},"max":{"1min":0.85599999999999998,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.78000000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66000000000000003,"15min":0.65900000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91800000000000004,"5min":1.0940000000000001,"15min":1.1200000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.36199999999999999},"max":{"1min":0.90400000000000003,"5min":1.0209999999999999,"15min":1.657},"last":0.68000000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575083,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50792,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321048,"statfs":{"total":96636764160,"available":96584753152,"internally_reserved":0,"allocated":1736704,"data_stored":882572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68799999999999994,"15min":0.72199999999999998},"min":{"1min":0.45400000000000001,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":2.6699999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.46500000000000002,"5min":0.41699999999999998,"15min":0.32800000000000001},"max":{"1min":0.86799999999999999,"5min":1.083,"15min":1.083},"last":0.51000000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68899999999999995,"15min":0.71799999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44500000000000001},"max":{"1min":0.93600000000000005,"5min":1.05,"15min":1.079},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.71499999999999997,"15min":0.73899999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.36799999999999999},"max":{"1min":0.873,"5min":0.94599999999999995,"15min":2.706},"last":0.46300000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70899999999999996,"15min":0.72799999999999998},"min":{"1min":0.41199999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90700000000000003,"5min":1.212,"15min":1.212},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70799999999999996,"15min":0.72699999999999998},"min":{"1min":0.497,"5min":0.44800000000000001,"15min":0.433},"max":{"1min":0.94599999999999995,"5min":1.181,"15min":1.181},"last":0.48899999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72499999999999998,"15min":0.74199999999999999},"min":{"1min":0.53900000000000003,"5min":0.41799999999999998,"15min":0.377},"max":{"1min":0.88600000000000001,"5min":0.95199999999999996,"15min":2.7389999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73099999999999998,"15min":0.753},"min":{"1min":0.51600000000000001,"5min":0.47299999999999998,"15min":0.39700000000000002},"max":{"1min":0.94499999999999995,"5min":1.304,"15min":1.304},"last":0.79600000000000004}]},{"osd":4,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.628,"15min":0.628},"min":{"1min":0.38500000000000001,"5min":0.38,"15min":0.28599999999999998},"max":{"1min":0.85599999999999998,"5min":1.129,"15min":1.129},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.69099999999999995,"15min":0.68400000000000005},"min":{"1min":0.53700000000000003,"5min":0.39900000000000002,"15min":0.36299999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":2.7719999999999998},"last":0.53400000000000003}]},{"osd":6,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60199999999999998,"15min":0.60599999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.32700000000000001},"max":{"1min":0.89700000000000002,"5min":1.169,"15min":1.169},"last":0.63},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42599999999999999,"5min":0.39400000000000002,"15min":0.34300000000000003},"max":{"1min":0.91000000000000003,"5min":1.238,"15min":1.238},"last":0.66700000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64600000000000002,"15min":0.64300000000000002},"min":{"1min":0.40899999999999997,"5min":0.36899999999999999,"15min":0.32900000000000001},"max":{"1min":0.90800000000000003,"5min":1.026,"15min":3.0230000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68300000000000005,"15min":0.67700000000000005},"min":{"1min":0.49399999999999999,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.98199999999999998,"5min":1.2589999999999999,"15min":1.407},"last":0.82699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575083,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36840,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335000,"statfs":{"total":96636764160,"available":96599040000,"internally_reserved":0,"allocated":1736704,"data_stored":882572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.70599999999999996,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.411},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.45600000000000002,"5min":0.45100000000000001,"15min":0.435},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.1200000000000001},"last":0.56899999999999995}]},{"osd":1,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71199999999999997,"15min":0.74399999999999999},"min":{"1min":0.496,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84099999999999997,"5min":0.92500000000000004,"15min":1.077},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70399999999999996,"15min":0.72999999999999998},"min":{"1min":0.52700000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.0469999999999999},"last":0.66500000000000004}]},{"osd":2,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.71999999999999997,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.42199999999999999,"15min":0.35199999999999998},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72099999999999997,"15min":0.76400000000000001},"min":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.86699999999999999,"5min":0.98199999999999998,"15min":1.387},"last":0.52200000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.49399999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89700000000000002,"5min":0.95399999999999996,"15min":1.008},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.74099999999999999,"15min":0.76600000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46800000000000003},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.60799999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.378},"max":{"1min":0.92200000000000004,"5min":0.92400000000000004,"15min":0.97099999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.40400000000000003,"15min":0.34599999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.35599999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.014},"last":0.496},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67900000000000005,"15min":0.67000000000000004},"min":{"1min":0.48599999999999999,"5min":0.443,"15min":0.374},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.0289999999999999},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.69899999999999995,"15min":0.67200000000000004},"min":{"1min":0.51300000000000001,"5min":0.502,"15min":0.39000000000000001},"max":{"1min":0.91700000000000004,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.69799999999999995},"min":{"1min":0.48199999999999998,"5min":0.42799999999999999,"15min":0.40300000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.54600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575083,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36840,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335000,"statfs":{"total":96636764160,"available":96599040000,"internally_reserved":0,"allocated":1736704,"data_stored":882572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.44400000000000001,"15min":0.44900000000000001},"min":{"1min":0.25600000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.63100000000000001,"5min":0.78600000000000003,"15min":0.84199999999999997},"last":0.374},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.49299999999999999,"15min":0.51100000000000001},"min":{"1min":0.312,"5min":0.307,"15min":0.307},"max":{"1min":0.66700000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.44600000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47399999999999998,"15min":0.47999999999999998},"min":{"1min":0.32300000000000001,"5min":0.32000000000000001,"15min":0.315},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.0029999999999999},"last":0.42099999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55800000000000005,"15min":0.57199999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.58299999999999996,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.36799999999999999},"max":{"1min":0.81599999999999995,"5min":0.88100000000000001,"15min":1.663},"last":0.498}]},{"osd":4,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.72699999999999998,"15min":0.755},"min":{"1min":0.53000000000000003,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.284},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.52700000000000002,"5min":0.51900000000000002,"15min":0.47699999999999998},"max":{"1min":0.96899999999999997,"5min":1.175,"15min":1.175},"last":0.77000000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76600000000000001,"15min":0.78700000000000003},"min":{"1min":0.54900000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.05,"5min":1.0629999999999999,"15min":1.306},"last":0.747},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.754,"15min":0.78200000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.372},"max":{"1min":1.121,"5min":1.121,"15min":1.2470000000000001},"last":0.86299999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.746,"15min":0.76900000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48099999999999998},"max":{"1min":1.0680000000000001,"5min":1.113,"15min":1.117},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.78700000000000003,"15min":0.81100000000000005},"min":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.54200000000000004},"max":{"1min":1.133,"5min":1.133,"15min":1.2589999999999999},"last":0.84899999999999998}]},{"osd":7,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.78300000000000003,"15min":0.82799999999999996},"min":{"1min":0.58399999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.159,"5min":1.159,"15min":2.4910000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.78100000000000003,"15min":0.81799999999999995},"min":{"1min":0.57599999999999996,"5min":0.53500000000000003,"15min":0.51600000000000001},"max":{"1min":1.0960000000000001,"5min":1.1359999999999999,"15min":1.595},"last":0.89500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575083,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58980,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312860,"statfs":{"total":96636764160,"available":96576368640,"internally_reserved":0,"allocated":1732608,"data_stored":881553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46200000000000002,"15min":0.46400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.80400000000000005,"5min":0.84699999999999998,"15min":1.3169999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.50800000000000001,"15min":0.53300000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67300000000000004,"5min":0.80800000000000005,"15min":2.5270000000000001},"last":0.66400000000000003}]},{"osd":1,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.47699999999999998,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.29999999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":2.7200000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.55700000000000005},"min":{"1min":0.39900000000000002,"5min":0.36299999999999999,"15min":0.35999999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":2.6110000000000002},"last":0.62}]},{"osd":3,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55100000000000005,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.755,"5min":0.755,"15min":8.2530000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.77000000000000002,"5min":0.89600000000000002,"15min":1.2150000000000001},"last":0.64500000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.73999999999999999,"15min":0.76900000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.48399999999999999},"max":{"1min":0.91100000000000003,"5min":1.0840000000000001,"15min":1.1499999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73999999999999999,"15min":0.78100000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.47999999999999998},"max":{"1min":0.92900000000000005,"5min":1.0629999999999999,"15min":2.3170000000000002},"last":0.92300000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.79900000000000004,"15min":0.84699999999999998},"min":{"1min":0.58399999999999996,"5min":0.56399999999999995,"15min":0.49399999999999999},"max":{"1min":1.0029999999999999,"5min":1.1319999999999999,"15min":3.1139999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.78900000000000003,"15min":0.83299999999999996},"min":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.55600000000000005},"max":{"1min":1.03,"5min":1.153,"15min":2.6850000000000001},"last":0.93999999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.73999999999999999,"15min":0.79100000000000004},"min":{"1min":0.52900000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98299999999999998,"5min":1.038,"15min":3.9849999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75900000000000001,"15min":0.80200000000000005},"min":{"1min":0.53900000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":3.391},"last":0.89200000000000002}]},{"osd":7,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.76000000000000001,"15min":0.80900000000000005},"min":{"1min":0.56200000000000006,"5min":0.52300000000000002,"15min":0.5},"max":{"1min":1.022,"5min":1.1759999999999999,"15min":2.5779999999999998},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.78200000000000003,"15min":0.81799999999999995},"min":{"1min":0.57099999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.736,"5min":1.736,"15min":2.5939999999999999},"last":0.84899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575084,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36840,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335000,"statfs":{"total":96636764160,"available":96599040000,"internally_reserved":0,"allocated":1736704,"data_stored":882572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42899999999999999,"15min":0.432},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26100000000000001},"max":{"1min":0.56000000000000005,"5min":0.65400000000000003,"15min":0.77200000000000002},"last":0.377},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.34999999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.74399999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.55600000000000005}]},{"osd":2,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.35899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.63700000000000001,"5min":0.69199999999999995,"15min":1.0409999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.51700000000000002},"min":{"1min":0.32100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73199999999999998,"5min":0.77900000000000003,"15min":1.014},"last":0.436}]},{"osd":3,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60799999999999998,"15min":0.628},"min":{"1min":0.502,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.746,"5min":0.80300000000000005,"15min":0.96299999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55300000000000005,"15min":0.57099999999999995},"min":{"1min":0.41299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69899999999999995,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.59199999999999997}]},{"osd":4,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76400000000000001,"15min":0.78300000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48899999999999999},"max":{"1min":1.155,"5min":1.2110000000000001,"15min":1.236},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79000000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0640000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.64100000000000001}]},{"osd":5,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77700000000000002,"15min":0.78500000000000003},"min":{"1min":0.56000000000000005,"5min":0.52500000000000002,"15min":0.45200000000000001},"max":{"1min":1.1020000000000001,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.624},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.79600000000000004,"15min":0.80300000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.48599999999999999},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.85299999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.55900000000000005,"5min":0.53800000000000003,"15min":0.503},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.2170000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79900000000000004,"15min":0.81799999999999995},"min":{"1min":0.53700000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.94399999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.58499999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82699999999999996,"15min":0.84199999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.99199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575085,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41512,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330328,"statfs":{"total":96636764160,"available":96594255872,"internally_reserved":0,"allocated":2326528,"data_stored":1471921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.27300000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.59199999999999997,"5min":0.79600000000000004,"15min":2.2450000000000001},"last":0.247},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.48299999999999998,"15min":0.50800000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27700000000000002},"max":{"1min":0.72999999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.29399999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.504,"15min":0.51400000000000001},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68200000000000005,"5min":0.84499999999999997,"15min":2.2989999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52800000000000002,"15min":0.54700000000000004},"min":{"1min":0.39100000000000001,"5min":0.34899999999999998,"15min":0.29899999999999999},"max":{"1min":0.71199999999999997,"5min":0.83599999999999997,"15min":0.90300000000000002},"last":0.38100000000000001}]},{"osd":3,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.505,"15min":0.505},"min":{"1min":0.35199999999999998,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.84999999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57799999999999996,"15min":0.58999999999999997},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76600000000000001,"5min":0.92700000000000005,"15min":2.4100000000000001},"last":0.36399999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74399999999999999,"15min":0.77800000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1220000000000001,"5min":1.21,"15min":1.3640000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.75700000000000001,"15min":0.79300000000000004},"min":{"1min":0.57599999999999996,"5min":0.53500000000000003,"15min":0.44900000000000001},"max":{"1min":1.0289999999999999,"5min":1.0589999999999999,"15min":2.4460000000000002},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75600000000000001,"15min":0.79400000000000004},"min":{"1min":0.62,"5min":0.54200000000000004,"15min":0.47899999999999998},"max":{"1min":1.044,"5min":1.0669999999999999,"15min":1.3839999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.59399999999999997,"5min":0.5,"15min":0.48399999999999999},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.325},"last":0.86499999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77100000000000002,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.147,"5min":1.147,"15min":2.3380000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.755,"15min":0.79900000000000004},"min":{"1min":0.55600000000000005,"5min":0.51000000000000001,"15min":0.50600000000000001},"max":{"1min":0.97899999999999998,"5min":1.0900000000000001,"15min":1.3440000000000001},"last":0.71599999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76300000000000001,"15min":0.81599999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.503},"max":{"1min":1.016,"5min":1.1180000000000001,"15min":1.2749999999999999},"last":0.752},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.77200000000000002,"15min":0.80500000000000005},"min":{"1min":0.56000000000000005,"5min":0.50600000000000001,"15min":0.502},"max":{"1min":1.077,"5min":1.0880000000000001,"15min":1.381},"last":0.72499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:12:28.453 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:12:28.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.597+0000 7f9dba1ad640 1 Processor -- start 2023-07-14T13:12:28.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.597+0000 7f9dba1ad640 1 -- start start 2023-07-14T13:12:28.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.601+0000 7f9dba1ad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db406b1e0 0x7f9db40c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:28.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.601+0000 7f9dba1ad640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9db40c21f0 0x7f9db40cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:28.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.601+0000 7f9dba1ad640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db40cac70 con 0x7f9db4070b70 2023-07-14T13:12:28.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.601+0000 7f9dba1ad640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db40ca060 con 0x7f9db40c21f0 2023-07-14T13:12:28.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.601+0000 7f9dba1ad640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db40ca340 con 0x7f9db406b1e0 2023-07-14T13:12:28.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.601+0000 7f9db3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9db40c21f0 0x7f9db40cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:28.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.601+0000 7f9db3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9db40c21f0 0x7f9db40cb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59966/0 (socket says 172.21.15.5:59966) 2023-07-14T13:12:28.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.601+0000 7f9db3fff640 1 -- 172.21.15.5:0/3723556674 learned_addr learned my addr 172.21.15.5:0/3723556674 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:28.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.601+0000 7f9db2ffd640 1 --2- 172.21.15.5:0/3723556674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db406b1e0 0x7f9db40c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:28.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.601+0000 7f9db3fff640 1 -- 172.21.15.5:0/3723556674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db406b1e0 msgr2=0x7f9db40c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:28.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.601+0000 7f9db3fff640 1 --2- 172.21.15.5:0/3723556674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db406b1e0 0x7f9db40c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:28.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.601+0000 7f9db3fff640 1 -- 172.21.15.5:0/3723556674 >> v1:172.21.15.154:6789/0 conn(0x7f9db4070b70 legacy=0x7f9db4070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:28.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.601+0000 7f9db3fff640 1 -- 172.21.15.5:0/3723556674 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db40ca620 con 0x7f9db40c21f0 2023-07-14T13:12:28.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.601+0000 7f9db3fff640 1 --2- 172.21.15.5:0/3723556674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9db40c21f0 0x7f9db40cb100 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009e50 tx=0x7f9dac01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ef1a8813b1fadb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:28.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.605+0000 7f9db27fc640 1 -- 172.21.15.5:0/3723556674 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac0a5830 con 0x7f9db40c21f0 2023-07-14T13:12:28.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.605+0000 7f9db27fc640 1 -- 172.21.15.5:0/3723556674 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac0a5990 con 0x7f9db40c21f0 2023-07-14T13:12:28.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.605+0000 7f9db27fc640 1 -- 172.21.15.5:0/3723556674 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac0a5d20 con 0x7f9db40c21f0 2023-07-14T13:12:28.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.605+0000 7f9dba1ad640 1 -- 172.21.15.5:0/3723556674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9db40c21f0 msgr2=0x7f9db40cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:28.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.605+0000 7f9dba1ad640 1 --2- 172.21.15.5:0/3723556674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9db40c21f0 0x7f9db40cb100 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009e50 tx=0x7f9dac01c950 comp rx=0 tx=0).stop 2023-07-14T13:12:28.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.605+0000 7f9dba1ad640 1 -- 172.21.15.5:0/3723556674 shutdown_connections 2023-07-14T13:12:28.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.605+0000 7f9dba1ad640 1 --2- 172.21.15.5:0/3723556674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9db40c21f0 0x7f9db40cb100 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:28.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.605+0000 7f9dba1ad640 1 --2- 172.21.15.5:0/3723556674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db406b1e0 0x7f9db40c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:28.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.605+0000 7f9dba1ad640 1 -- 172.21.15.5:0/3723556674 >> 172.21.15.5:0/3723556674 conn(0x7f9db40afcf0 msgr2=0x7f9db40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:28.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.605+0000 7f9dba1ad640 1 -- 172.21.15.5:0/3723556674 shutdown_connections 2023-07-14T13:12:28.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.605+0000 7f9dba1ad640 1 -- 172.21.15.5:0/3723556674 wait complete. 2023-07-14T13:12:28.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.605+0000 7f9dba1ad640 1 Processor -- start 2023-07-14T13:12:28.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.605+0000 7f9dba1ad640 1 -- start start 2023-07-14T13:12:28.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.605+0000 7f9dba1ad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9db406b1e0 0x7f9db4155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:28.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.605+0000 7f9dba1ad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db4070b70 0x7f9db4155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:28.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.605+0000 7f9dba1ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db40c21f0 0x7f9db414a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:28.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.605+0000 7f9dba1ad640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db40b1c20 con 0x7f9db406b1e0 2023-07-14T13:12:28.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.605+0000 7f9dba1ad640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db414b050 con 0x7f9db40c21f0 2023-07-14T13:12:28.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.605+0000 7f9dba1ad640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db414b330 con 0x7f9db4070b70 2023-07-14T13:12:28.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.605+0000 7f9db37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9db406b1e0 0x7f9db4155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:28.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.605+0000 7f9db37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9db406b1e0 0x7f9db4155a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59982/0 (socket says 172.21.15.5:59982) 2023-07-14T13:12:28.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.605+0000 7f9db37fe640 1 -- 172.21.15.5:0/3893781027 learned_addr learned my addr 172.21.15.5:0/3893781027 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:28.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.605+0000 7f9db2ffd640 1 --2- 172.21.15.5:0/3893781027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db4070b70 0x7f9db4155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:28.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.609+0000 7f9db3fff640 1 --2- 172.21.15.5:0/3893781027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db40c21f0 0x7f9db414a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:28.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.609+0000 7f9db37fe640 1 -- 172.21.15.5:0/3893781027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db4070b70 msgr2=0x7f9db4155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:28.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.609+0000 7f9db37fe640 1 --2- 172.21.15.5:0/3893781027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db4070b70 0x7f9db4155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:28.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.609+0000 7f9db37fe640 1 -- 172.21.15.5:0/3893781027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db40c21f0 msgr2=0x7f9db414a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:28.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.609+0000 7f9db37fe640 1 --2- 172.21.15.5:0/3893781027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db40c21f0 0x7f9db414a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:28.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.609+0000 7f9db37fe640 1 -- 172.21.15.5:0/3893781027 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac009b30 con 0x7f9db406b1e0 2023-07-14T13:12:28.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.609+0000 7f9db37fe640 1 --2- 172.21.15.5:0/3893781027 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9db406b1e0 0x7f9db4155a00 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f9da400c500 tx=0x7f9da400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:28.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.609+0000 7f9d9bfff640 1 -- 172.21.15.5:0/3893781027 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da4005220 con 0x7f9db406b1e0 2023-07-14T13:12:28.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.609+0000 7f9d9bfff640 1 -- 172.21.15.5:0/3893781027 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da4005380 con 0x7f9db406b1e0 2023-07-14T13:12:28.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.609+0000 7f9d9bfff640 1 -- 172.21.15.5:0/3893781027 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da4007270 con 0x7f9db406b1e0 2023-07-14T13:12:28.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.609+0000 7f9dba1ad640 1 -- 172.21.15.5:0/3893781027 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db414b610 con 0x7f9db406b1e0 2023-07-14T13:12:28.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.609+0000 7f9dba1ad640 1 -- 172.21.15.5:0/3893781027 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db40c28d0 con 0x7f9db406b1e0 2023-07-14T13:12:28.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.609+0000 7f9dba1ad640 1 -- 172.21.15.5:0/3893781027 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db40678d0 con 0x7f9db406b1e0 2023-07-14T13:12:28.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.609+0000 7f9d9bfff640 1 -- 172.21.15.5:0/3893781027 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9da40073d0 con 0x7f9db406b1e0 2023-07-14T13:12:28.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.609+0000 7f9d9bfff640 1 --2- 172.21.15.5:0/3893781027 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f9da00663d0 0x7f9da0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:28.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.609+0000 7f9d9bfff640 1 -- 172.21.15.5:0/3893781027 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f9da40836d0 con 0x7f9db406b1e0 2023-07-14T13:12:28.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.613+0000 7f9db2ffd640 1 --2- 172.21.15.5:0/3893781027 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f9da00663d0 0x7f9da0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:28.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.613+0000 7f9db2ffd640 1 --2- 172.21.15.5:0/3893781027 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f9da00663d0 0x7f9da0068880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9db40c1720 tx=0x7f9da8008040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:28.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.613+0000 7f9d9bfff640 1 -- 172.21.15.5:0/3893781027 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9da4050a40 con 0x7f9db406b1e0 2023-07-14T13:12:28.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.765+0000 7f9dba1ad640 1 -- 172.21.15.5:0/3893781027 --> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9db40c9cf0 con 0x7f9da00663d0 2023-07-14T13:12:28.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.777+0000 7f9d9bfff640 1 -- 172.21.15.5:0/3893781027 <== mgr.7202 v2:172.21.15.154:6832/3769132865 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306119 (secure 0 0 0) 0x7f9da8010960 con 0x7f9da00663d0 2023-07-14T13:12:28.813 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:28.814 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:12:28.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.777+0000 7f9dba1ad640 1 -- 172.21.15.5:0/3893781027 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f9da00663d0 msgr2=0x7f9da0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:28.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.777+0000 7f9dba1ad640 1 --2- 172.21.15.5:0/3893781027 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f9da00663d0 0x7f9da0068880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9db40c1720 tx=0x7f9da8008040 comp rx=0 tx=0).stop 2023-07-14T13:12:28.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.777+0000 7f9dba1ad640 1 -- 172.21.15.5:0/3893781027 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9db406b1e0 msgr2=0x7f9db4155a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:28.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.777+0000 7f9dba1ad640 1 --2- 172.21.15.5:0/3893781027 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9db406b1e0 0x7f9db4155a00 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f9da400c500 tx=0x7f9da400c9c0 comp rx=0 tx=0).stop 2023-07-14T13:12:28.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.777+0000 7f9dba1ad640 1 -- 172.21.15.5:0/3893781027 shutdown_connections 2023-07-14T13:12:28.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.777+0000 7f9dba1ad640 1 --2- 172.21.15.5:0/3893781027 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f9da00663d0 0x7f9da0068880 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:28.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.777+0000 7f9dba1ad640 1 --2- 172.21.15.5:0/3893781027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db40c21f0 0x7f9db414a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:28.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.777+0000 7f9dba1ad640 1 --2- 172.21.15.5:0/3893781027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db4070b70 0x7f9db4155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:28.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.777+0000 7f9dba1ad640 1 --2- 172.21.15.5:0/3893781027 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9db406b1e0 0x7f9db4155a00 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:28.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.777+0000 7f9dba1ad640 1 -- 172.21.15.5:0/3893781027 >> 172.21.15.5:0/3893781027 conn(0x7f9db40afcf0 msgr2=0x7f9db40b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:28.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.777+0000 7f9dba1ad640 1 -- 172.21.15.5:0/3893781027 shutdown_connections 2023-07-14T13:12:28.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.777+0000 7f9dba1ad640 1 -- 172.21.15.5:0/3893781027 wait complete. 2023-07-14T13:12:28.834 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-14T13:12:27.580927+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":354100,"kb_used_data":14708,"kb_used_omap":0,"kb_used_meta":339328,"kb_avail":754620620,"statfs":{"total":773094113280,"available":772731514880,"internally_reserved":0,"allocated":15060992,"data_stored":8232618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":347471872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.683924"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.921634+0000","last_change":"2023-07-14T13:12:22.921634+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.921634+0000","last_undegraded":"2023-07-14T13:12:22.921634+0000","last_fullsized":"2023-07-14T13:12:22.921634+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.914942+0000","last_change":"2023-07-14T13:12:22.914942+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.914942+0000","last_undegraded":"2023-07-14T13:12:22.914942+0000","last_fullsized":"2023-07-14T13:12:22.914942+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.912221+0000","last_change":"2023-07-14T13:12:22.912221+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.912221+0000","last_undegraded":"2023-07-14T13:12:22.912221+0000","last_fullsized":"2023-07-14T13:12:22.912221+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.914791+0000","last_change":"2023-07-14T13:12:22.914791+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.914791+0000","last_undegraded":"2023-07-14T13:12:22.914791+0000","last_fullsized":"2023-07-14T13:12:22.914791+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.921391+0000","last_change":"2023-07-14T13:12:22.921391+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.921391+0000","last_undegraded":"2023-07-14T13:12:22.921391+0000","last_fullsized":"2023-07-14T13:12:22.921391+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.911078+0000","last_change":"2023-07-14T13:12:22.911078+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.911078+0000","last_undegraded":"2023-07-14T13:12:22.911078+0000","last_fullsized":"2023-07-14T13:12:22.911078+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.910643+0000","last_change":"2023-07-14T13:12:22.910643+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.910643+0000","last_undegraded":"2023-07-14T13:12:22.910643+0000","last_fullsized":"2023-07-14T13:12:22.910643+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.912745+0000","last_change":"2023-07-14T13:12:22.912745+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.912745+0000","last_undegraded":"2023-07-14T13:12:22.912745+0000","last_fullsized":"2023-07-14T13:12:22.912745+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.916440+0000","last_change":"2023-07-14T13:12:22.916440+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.916440+0000","last_undegraded":"2023-07-14T13:12:22.916440+0000","last_fullsized":"2023-07-14T13:12:22.916440+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.909705+0000","last_change":"2023-07-14T13:12:22.909705+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.909705+0000","last_undegraded":"2023-07-14T13:12:22.909705+0000","last_fullsized":"2023-07-14T13:12:22.909705+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.921599+0000","last_change":"2023-07-14T13:12:22.921599+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.921599+0000","last_undegraded":"2023-07-14T13:12:22.921599+0000","last_fullsized":"2023-07-14T13:12:22.921599+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.913503+0000","last_change":"2023-07-14T13:12:22.913503+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.913503+0000","last_undegraded":"2023-07-14T13:12:22.913503+0000","last_fullsized":"2023-07-14T13:12:22.913503+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.908889+0000","last_change":"2023-07-14T13:12:22.908889+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.908889+0000","last_undegraded":"2023-07-14T13:12:22.908889+0000","last_fullsized":"2023-07-14T13:12:22.908889+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.918157+0000","last_change":"2023-07-14T13:12:22.918157+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.918157+0000","last_undegraded":"2023-07-14T13:12:22.918157+0000","last_fullsized":"2023-07-14T13:12:22.918157+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.922362+0000","last_change":"2023-07-14T13:12:22.922362+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.922362+0000","last_undegraded":"2023-07-14T13:12:22.922362+0000","last_fullsized":"2023-07-14T13:12:22.922362+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.911369+0000","last_change":"2023-07-14T13:12:22.911369+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.911369+0000","last_undegraded":"2023-07-14T13:12:22.911369+0000","last_fullsized":"2023-07-14T13:12:22.911369+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.909224+0000","last_change":"2023-07-14T13:12:22.909224+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.909224+0000","last_undegraded":"2023-07-14T13:12:22.909224+0000","last_fullsized":"2023-07-14T13:12:22.909224+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.914405+0000","last_change":"2023-07-14T13:12:22.914405+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.914405+0000","last_undegraded":"2023-07-14T13:12:22.914405+0000","last_fullsized":"2023-07-14T13:12:22.914405+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.917896+0000","last_change":"2023-07-14T13:12:22.917896+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.917896+0000","last_undegraded":"2023-07-14T13:12:22.917896+0000","last_fullsized":"2023-07-14T13:12:22.917896+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.910687+0000","last_change":"2023-07-14T13:12:22.910687+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.910687+0000","last_undegraded":"2023-07-14T13:12:22.910687+0000","last_fullsized":"2023-07-14T13:12:22.910687+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.916401+0000","last_change":"2023-07-14T13:12:22.916401+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.916401+0000","last_undegraded":"2023-07-14T13:12:22.916401+0000","last_fullsized":"2023-07-14T13:12:22.916401+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.921056+0000","last_change":"2023-07-14T13:12:22.921056+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.921056+0000","last_undegraded":"2023-07-14T13:12:22.921056+0000","last_fullsized":"2023-07-14T13:12:22.921056+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.914616+0000","last_change":"2023-07-14T13:12:22.914616+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.914616+0000","last_undegraded":"2023-07-14T13:12:22.914616+0000","last_fullsized":"2023-07-14T13:12:22.914616+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.912264+0000","last_change":"2023-07-14T13:12:22.912264+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.912264+0000","last_undegraded":"2023-07-14T13:12:22.912264+0000","last_fullsized":"2023-07-14T13:12:22.912264+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.913552+0000","last_change":"2023-07-14T13:12:22.913552+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.913552+0000","last_undegraded":"2023-07-14T13:12:22.913552+0000","last_fullsized":"2023-07-14T13:12:22.913552+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.910524+0000","last_change":"2023-07-14T13:12:22.910524+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.910524+0000","last_undegraded":"2023-07-14T13:12:22.910524+0000","last_fullsized":"2023-07-14T13:12:22.910524+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.915798+0000","last_change":"2023-07-14T13:12:22.915798+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.915798+0000","last_undegraded":"2023-07-14T13:12:22.915798+0000","last_fullsized":"2023-07-14T13:12:22.915798+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.913041+0000","last_change":"2023-07-14T13:12:22.913041+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.913041+0000","last_undegraded":"2023-07-14T13:12:22.913041+0000","last_fullsized":"2023-07-14T13:12:22.913041+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.913586+0000","last_change":"2023-07-14T13:12:22.913586+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.913586+0000","last_undegraded":"2023-07-14T13:12:22.913586+0000","last_fullsized":"2023-07-14T13:12:22.913586+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.910071+0000","last_change":"2023-07-14T13:12:22.910071+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.910071+0000","last_undegraded":"2023-07-14T13:12:22.910071+0000","last_fullsized":"2023-07-14T13:12:22.910071+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.911426+0000","last_change":"2023-07-14T13:12:22.911426+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.911426+0000","last_undegraded":"2023-07-14T13:12:22.911426+0000","last_fullsized":"2023-07-14T13:12:22.911426+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.911697+0000","last_change":"2023-07-14T13:12:22.911697+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.911697+0000","last_undegraded":"2023-07-14T13:12:22.911697+0000","last_fullsized":"2023-07-14T13:12:22.911697+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.909364+0000","last_change":"2023-07-14T13:12:22.909364+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.909364+0000","last_undegraded":"2023-07-14T13:12:22.909364+0000","last_fullsized":"2023-07-14T13:12:22.909364+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.935368+0000","last_change":"2023-07-14T13:12:22.932726+0000","last_active":"2023-07-14T13:12:22.935368+0000","last_peered":"2023-07-14T13:12:22.935368+0000","last_clean":"2023-07-14T13:12:22.935368+0000","last_became_active":"2023-07-14T13:12:22.932398+0000","last_became_peered":"2023-07-14T13:12:22.932398+0000","last_unstale":"2023-07-14T13:12:22.935368+0000","last_undegraded":"2023-07-14T13:12:22.935368+0000","last_fullsized":"2023-07-14T13:12:22.935368+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:15:52.769714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.909091+0000","last_change":"2023-07-14T13:12:22.909091+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.909091+0000","last_undegraded":"2023-07-14T13:12:22.909091+0000","last_fullsized":"2023-07-14T13:12:22.909091+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.927429+0000","last_change":"2023-07-14T13:12:22.920816+0000","last_active":"2023-07-14T13:12:22.927429+0000","last_peered":"2023-07-14T13:12:22.927429+0000","last_clean":"2023-07-14T13:12:22.927429+0000","last_became_active":"2023-07-14T13:12:22.918830+0000","last_became_peered":"2023-07-14T13:12:22.918830+0000","last_unstale":"2023-07-14T13:12:22.927429+0000","last_undegraded":"2023-07-14T13:12:22.927429+0000","last_fullsized":"2023-07-14T13:12:22.927429+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:36:04.726809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.912583+0000","last_change":"2023-07-14T13:12:22.912583+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.912583+0000","last_undegraded":"2023-07-14T13:12:22.912583+0000","last_fullsized":"2023-07-14T13:12:22.912583+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.933303+0000","last_change":"2023-07-14T13:12:22.929668+0000","last_active":"2023-07-14T13:12:22.933303+0000","last_peered":"2023-07-14T13:12:22.933303+0000","last_clean":"2023-07-14T13:12:22.933303+0000","last_became_active":"2023-07-14T13:12:22.929296+0000","last_became_peered":"2023-07-14T13:12:22.929296+0000","last_unstale":"2023-07-14T13:12:22.933303+0000","last_undegraded":"2023-07-14T13:12:22.933303+0000","last_fullsized":"2023-07-14T13:12:22.933303+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:16:59.861984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.914814+0000","last_change":"2023-07-14T13:12:22.914814+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.914814+0000","last_undegraded":"2023-07-14T13:12:22.914814+0000","last_fullsized":"2023-07-14T13:12:22.914814+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.929815+0000","last_change":"2023-07-14T13:12:22.923046+0000","last_active":"2023-07-14T13:12:22.929815+0000","last_peered":"2023-07-14T13:12:22.929815+0000","last_clean":"2023-07-14T13:12:22.929815+0000","last_became_active":"2023-07-14T13:12:22.922783+0000","last_became_peered":"2023-07-14T13:12:22.922783+0000","last_unstale":"2023-07-14T13:12:22.929815+0000","last_undegraded":"2023-07-14T13:12:22.929815+0000","last_fullsized":"2023-07-14T13:12:22.929815+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:13:07.210080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.907985+0000","last_change":"2023-07-14T13:12:22.907985+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.907985+0000","last_undegraded":"2023-07-14T13:12:22.907985+0000","last_fullsized":"2023-07-14T13:12:22.907985+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.935422+0000","last_change":"2023-07-14T13:12:22.932158+0000","last_active":"2023-07-14T13:12:22.935422+0000","last_peered":"2023-07-14T13:12:22.935422+0000","last_clean":"2023-07-14T13:12:22.935422+0000","last_became_active":"2023-07-14T13:12:22.931753+0000","last_became_peered":"2023-07-14T13:12:22.931753+0000","last_unstale":"2023-07-14T13:12:22.935422+0000","last_undegraded":"2023-07-14T13:12:22.935422+0000","last_fullsized":"2023-07-14T13:12:22.935422+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:36:42.112446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.921862+0000","last_change":"2023-07-14T13:12:22.921862+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.921862+0000","last_undegraded":"2023-07-14T13:12:22.921862+0000","last_fullsized":"2023-07-14T13:12:22.921862+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.927809+0000","last_change":"2023-07-14T13:12:22.923614+0000","last_active":"2023-07-14T13:12:22.927809+0000","last_peered":"2023-07-14T13:12:22.927809+0000","last_clean":"2023-07-14T13:12:22.927809+0000","last_became_active":"2023-07-14T13:12:22.923312+0000","last_became_peered":"2023-07-14T13:12:22.923312+0000","last_unstale":"2023-07-14T13:12:22.927809+0000","last_undegraded":"2023-07-14T13:12:22.927809+0000","last_fullsized":"2023-07-14T13:12:22.927809+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:46:19.955743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.909458+0000","last_change":"2023-07-14T13:12:22.909458+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.909458+0000","last_undegraded":"2023-07-14T13:12:22.909458+0000","last_fullsized":"2023-07-14T13:12:22.909458+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.927247+0000","last_change":"2023-07-14T13:12:22.923307+0000","last_active":"2023-07-14T13:12:22.927247+0000","last_peered":"2023-07-14T13:12:22.927247+0000","last_clean":"2023-07-14T13:12:22.927247+0000","last_became_active":"2023-07-14T13:12:22.922942+0000","last_became_peered":"2023-07-14T13:12:22.922942+0000","last_unstale":"2023-07-14T13:12:22.927247+0000","last_undegraded":"2023-07-14T13:12:22.927247+0000","last_fullsized":"2023-07-14T13:12:22.927247+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:37:51.826743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.908398+0000","last_change":"2023-07-14T13:12:22.908398+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.908398+0000","last_undegraded":"2023-07-14T13:12:22.908398+0000","last_fullsized":"2023-07-14T13:12:22.908398+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.929646+0000","last_change":"2023-07-14T13:12:22.924153+0000","last_active":"2023-07-14T13:12:22.929646+0000","last_peered":"2023-07-14T13:12:22.929646+0000","last_clean":"2023-07-14T13:12:22.929646+0000","last_became_active":"2023-07-14T13:12:22.923877+0000","last_became_peered":"2023-07-14T13:12:22.923877+0000","last_unstale":"2023-07-14T13:12:22.929646+0000","last_undegraded":"2023-07-14T13:12:22.929646+0000","last_fullsized":"2023-07-14T13:12:22.929646+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:58:25.336605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.911832+0000","last_change":"2023-07-14T13:12:22.911832+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.911832+0000","last_undegraded":"2023-07-14T13:12:22.911832+0000","last_fullsized":"2023-07-14T13:12:22.911832+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.927426+0000","last_change":"2023-07-14T13:12:22.920785+0000","last_active":"2023-07-14T13:12:22.927426+0000","last_peered":"2023-07-14T13:12:22.927426+0000","last_clean":"2023-07-14T13:12:22.927426+0000","last_became_active":"2023-07-14T13:12:22.920453+0000","last_became_peered":"2023-07-14T13:12:22.920453+0000","last_unstale":"2023-07-14T13:12:22.927426+0000","last_undegraded":"2023-07-14T13:12:22.927426+0000","last_fullsized":"2023-07-14T13:12:22.927426+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:17:25.734784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.920524+0000","last_change":"2023-07-14T13:12:22.920524+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.920524+0000","last_undegraded":"2023-07-14T13:12:22.920524+0000","last_fullsized":"2023-07-14T13:12:22.920524+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.923584+0000","last_change":"2023-07-14T13:12:22.922475+0000","last_active":"2023-07-14T13:12:22.923584+0000","last_peered":"2023-07-14T13:12:22.923584+0000","last_clean":"2023-07-14T13:12:22.923584+0000","last_became_active":"2023-07-14T13:12:22.922174+0000","last_became_peered":"2023-07-14T13:12:22.922174+0000","last_unstale":"2023-07-14T13:12:22.923584+0000","last_undegraded":"2023-07-14T13:12:22.923584+0000","last_fullsized":"2023-07-14T13:12:22.923584+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:55:25.302543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.908467+0000","last_change":"2023-07-14T13:12:22.908467+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.908467+0000","last_undegraded":"2023-07-14T13:12:22.908467+0000","last_fullsized":"2023-07-14T13:12:22.908467+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.933284+0000","last_change":"2023-07-14T13:12:22.929389+0000","last_active":"2023-07-14T13:12:22.933284+0000","last_peered":"2023-07-14T13:12:22.933284+0000","last_clean":"2023-07-14T13:12:22.933284+0000","last_became_active":"2023-07-14T13:12:22.929005+0000","last_became_peered":"2023-07-14T13:12:22.929005+0000","last_unstale":"2023-07-14T13:12:22.933284+0000","last_undegraded":"2023-07-14T13:12:22.933284+0000","last_fullsized":"2023-07-14T13:12:22.933284+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:32:45.606297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.911429+0000","last_change":"2023-07-14T13:12:22.911429+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.911429+0000","last_undegraded":"2023-07-14T13:12:22.911429+0000","last_fullsized":"2023-07-14T13:12:22.911429+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.933160+0000","last_change":"2023-07-14T13:12:22.929144+0000","last_active":"2023-07-14T13:12:22.933160+0000","last_peered":"2023-07-14T13:12:22.933160+0000","last_clean":"2023-07-14T13:12:22.933160+0000","last_became_active":"2023-07-14T13:12:22.928845+0000","last_became_peered":"2023-07-14T13:12:22.928845+0000","last_unstale":"2023-07-14T13:12:22.933160+0000","last_undegraded":"2023-07-14T13:12:22.933160+0000","last_fullsized":"2023-07-14T13:12:22.933160+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:35.675380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.910902+0000","last_change":"2023-07-14T13:12:22.910902+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.910902+0000","last_undegraded":"2023-07-14T13:12:22.910902+0000","last_fullsized":"2023-07-14T13:12:22.910902+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.930872+0000","last_change":"2023-07-14T13:12:22.929261+0000","last_active":"2023-07-14T13:12:22.930872+0000","last_peered":"2023-07-14T13:12:22.930872+0000","last_clean":"2023-07-14T13:12:22.930872+0000","last_became_active":"2023-07-14T13:12:22.928961+0000","last_became_peered":"2023-07-14T13:12:22.928961+0000","last_unstale":"2023-07-14T13:12:22.930872+0000","last_undegraded":"2023-07-14T13:12:22.930872+0000","last_fullsized":"2023-07-14T13:12:22.930872+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:39:55.963756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.909619+0000","last_change":"2023-07-14T13:12:22.909619+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.909619+0000","last_undegraded":"2023-07-14T13:12:22.909619+0000","last_fullsized":"2023-07-14T13:12:22.909619+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.933336+0000","last_change":"2023-07-14T13:12:22.931434+0000","last_active":"2023-07-14T13:12:22.933336+0000","last_peered":"2023-07-14T13:12:22.933336+0000","last_clean":"2023-07-14T13:12:22.933336+0000","last_became_active":"2023-07-14T13:12:22.931004+0000","last_became_peered":"2023-07-14T13:12:22.931004+0000","last_unstale":"2023-07-14T13:12:22.933336+0000","last_undegraded":"2023-07-14T13:12:22.933336+0000","last_fullsized":"2023-07-14T13:12:22.933336+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:47:41.118725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.908947+0000","last_change":"2023-07-14T13:12:22.908947+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.908947+0000","last_undegraded":"2023-07-14T13:12:22.908947+0000","last_fullsized":"2023-07-14T13:12:22.908947+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.930433+0000","last_change":"2023-07-14T13:12:22.928525+0000","last_active":"2023-07-14T13:12:22.930433+0000","last_peered":"2023-07-14T13:12:22.930433+0000","last_clean":"2023-07-14T13:12:22.930433+0000","last_became_active":"2023-07-14T13:12:22.928254+0000","last_became_peered":"2023-07-14T13:12:22.928254+0000","last_unstale":"2023-07-14T13:12:22.930433+0000","last_undegraded":"2023-07-14T13:12:22.930433+0000","last_fullsized":"2023-07-14T13:12:22.930433+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:35:23.471165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.911426+0000","last_change":"2023-07-14T13:12:22.911426+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.911426+0000","last_undegraded":"2023-07-14T13:12:22.911426+0000","last_fullsized":"2023-07-14T13:12:22.911426+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.932205+0000","last_change":"2023-07-14T13:12:22.926412+0000","last_active":"2023-07-14T13:12:22.932205+0000","last_peered":"2023-07-14T13:12:22.932205+0000","last_clean":"2023-07-14T13:12:22.932205+0000","last_became_active":"2023-07-14T13:12:22.925771+0000","last_became_peered":"2023-07-14T13:12:22.925771+0000","last_unstale":"2023-07-14T13:12:22.932205+0000","last_undegraded":"2023-07-14T13:12:22.932205+0000","last_fullsized":"2023-07-14T13:12:22.932205+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:56:32.388227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.912579+0000","last_change":"2023-07-14T13:12:22.912579+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.912579+0000","last_undegraded":"2023-07-14T13:12:22.912579+0000","last_fullsized":"2023-07-14T13:12:22.912579+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.930761+0000","last_change":"2023-07-14T13:12:22.927390+0000","last_active":"2023-07-14T13:12:22.930761+0000","last_peered":"2023-07-14T13:12:22.930761+0000","last_clean":"2023-07-14T13:12:22.930761+0000","last_became_active":"2023-07-14T13:12:22.927081+0000","last_became_peered":"2023-07-14T13:12:22.927081+0000","last_unstale":"2023-07-14T13:12:22.930761+0000","last_undegraded":"2023-07-14T13:12:22.930761+0000","last_fullsized":"2023-07-14T13:12:22.930761+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:59.167504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.907525+0000","last_change":"2023-07-14T13:12:22.907525+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.907525+0000","last_undegraded":"2023-07-14T13:12:22.907525+0000","last_fullsized":"2023-07-14T13:12:22.907525+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.930233+0000","last_change":"2023-07-14T13:12:22.927740+0000","last_active":"2023-07-14T13:12:22.930233+0000","last_peered":"2023-07-14T13:12:22.930233+0000","last_clean":"2023-07-14T13:12:22.930233+0000","last_became_active":"2023-07-14T13:12:22.927419+0000","last_became_peered":"2023-07-14T13:12:22.927419+0000","last_unstale":"2023-07-14T13:12:22.930233+0000","last_undegraded":"2023-07-14T13:12:22.930233+0000","last_fullsized":"2023-07-14T13:12:22.930233+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:42:30.256640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.914915+0000","last_change":"2023-07-14T13:12:22.914915+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.914915+0000","last_undegraded":"2023-07-14T13:12:22.914915+0000","last_fullsized":"2023-07-14T13:12:22.914915+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.928781+0000","last_change":"2023-07-14T13:12:22.926828+0000","last_active":"2023-07-14T13:12:22.928781+0000","last_peered":"2023-07-14T13:12:22.928781+0000","last_clean":"2023-07-14T13:12:22.928781+0000","last_became_active":"2023-07-14T13:12:22.926532+0000","last_became_peered":"2023-07-14T13:12:22.926532+0000","last_unstale":"2023-07-14T13:12:22.928781+0000","last_undegraded":"2023-07-14T13:12:22.928781+0000","last_fullsized":"2023-07-14T13:12:22.928781+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:27.875338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.910320+0000","last_change":"2023-07-14T13:12:22.910320+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.910320+0000","last_undegraded":"2023-07-14T13:12:22.910320+0000","last_fullsized":"2023-07-14T13:12:22.910320+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.930787+0000","last_change":"2023-07-14T13:12:22.928393+0000","last_active":"2023-07-14T13:12:22.930787+0000","last_peered":"2023-07-14T13:12:22.930787+0000","last_clean":"2023-07-14T13:12:22.930787+0000","last_became_active":"2023-07-14T13:12:22.928069+0000","last_became_peered":"2023-07-14T13:12:22.928069+0000","last_unstale":"2023-07-14T13:12:22.930787+0000","last_undegraded":"2023-07-14T13:12:22.930787+0000","last_fullsized":"2023-07-14T13:12:22.930787+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:52:26.822243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.909148+0000","last_change":"2023-07-14T13:12:22.909148+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.909148+0000","last_undegraded":"2023-07-14T13:12:22.909148+0000","last_fullsized":"2023-07-14T13:12:22.909148+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.932673+0000","last_change":"2023-07-14T13:12:22.926375+0000","last_active":"2023-07-14T13:12:22.932673+0000","last_peered":"2023-07-14T13:12:22.932673+0000","last_clean":"2023-07-14T13:12:22.932673+0000","last_became_active":"2023-07-14T13:12:22.926097+0000","last_became_peered":"2023-07-14T13:12:22.926097+0000","last_unstale":"2023-07-14T13:12:22.932673+0000","last_undegraded":"2023-07-14T13:12:22.932673+0000","last_fullsized":"2023-07-14T13:12:22.932673+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:41:02.972781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.909154+0000","last_change":"2023-07-14T13:12:22.909154+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.909154+0000","last_undegraded":"2023-07-14T13:12:22.909154+0000","last_fullsized":"2023-07-14T13:12:22.909154+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.932914+0000","last_change":"2023-07-14T13:12:22.928830+0000","last_active":"2023-07-14T13:12:22.932914+0000","last_peered":"2023-07-14T13:12:22.932914+0000","last_clean":"2023-07-14T13:12:22.932914+0000","last_became_active":"2023-07-14T13:12:22.928458+0000","last_became_peered":"2023-07-14T13:12:22.928458+0000","last_unstale":"2023-07-14T13:12:22.932914+0000","last_undegraded":"2023-07-14T13:12:22.932914+0000","last_fullsized":"2023-07-14T13:12:22.932914+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:44:44.418690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.915122+0000","last_change":"2023-07-14T13:12:22.915122+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.915122+0000","last_undegraded":"2023-07-14T13:12:22.915122+0000","last_fullsized":"2023-07-14T13:12:22.915122+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.929573+0000","last_change":"2023-07-14T13:12:22.924885+0000","last_active":"2023-07-14T13:12:22.929573+0000","last_peered":"2023-07-14T13:12:22.929573+0000","last_clean":"2023-07-14T13:12:22.929573+0000","last_became_active":"2023-07-14T13:12:22.924441+0000","last_became_peered":"2023-07-14T13:12:22.924441+0000","last_unstale":"2023-07-14T13:12:22.929573+0000","last_undegraded":"2023-07-14T13:12:22.929573+0000","last_fullsized":"2023-07-14T13:12:22.929573+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:02:11.936198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.907380+0000","last_change":"2023-07-14T13:12:22.907380+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.907380+0000","last_undegraded":"2023-07-14T13:12:22.907380+0000","last_fullsized":"2023-07-14T13:12:22.907380+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.932224+0000","last_change":"2023-07-14T13:12:22.926905+0000","last_active":"2023-07-14T13:12:22.932224+0000","last_peered":"2023-07-14T13:12:22.932224+0000","last_clean":"2023-07-14T13:12:22.932224+0000","last_became_active":"2023-07-14T13:12:22.926579+0000","last_became_peered":"2023-07-14T13:12:22.926579+0000","last_unstale":"2023-07-14T13:12:22.932224+0000","last_undegraded":"2023-07-14T13:12:22.932224+0000","last_fullsized":"2023-07-14T13:12:22.932224+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:47:41.849069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.915949+0000","last_change":"2023-07-14T13:12:22.915949+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.915949+0000","last_undegraded":"2023-07-14T13:12:22.915949+0000","last_fullsized":"2023-07-14T13:12:22.915949+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.931185+0000","last_change":"2023-07-14T13:12:22.929600+0000","last_active":"2023-07-14T13:12:22.931185+0000","last_peered":"2023-07-14T13:12:22.931185+0000","last_clean":"2023-07-14T13:12:22.931185+0000","last_became_active":"2023-07-14T13:12:22.929310+0000","last_became_peered":"2023-07-14T13:12:22.929310+0000","last_unstale":"2023-07-14T13:12:22.931185+0000","last_undegraded":"2023-07-14T13:12:22.931185+0000","last_fullsized":"2023-07-14T13:12:22.931185+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:23:45.496444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"129'249","reported_seq":852,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.915653+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:12:22.915653+0000","last_peered":"2023-07-14T13:12:22.915653+0000","last_clean":"2023-07-14T13:12:22.915653+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:12:22.915653+0000","last_undegraded":"2023-07-14T13:12:22.915653+0000","last_fullsized":"2023-07-14T13:12:22.915653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:40:02.311140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":224,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.914119+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:12:22.914119+0000","last_peered":"2023-07-14T13:12:22.914119+0000","last_clean":"2023-07-14T13:12:22.914119+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:12:22.914119+0000","last_undegraded":"2023-07-14T13:12:22.914119+0000","last_fullsized":"2023-07-14T13:12:22.914119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:58:25.383198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.915442+0000","last_change":"2023-07-14T13:12:22.915442+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.915442+0000","last_undegraded":"2023-07-14T13:12:22.915442+0000","last_fullsized":"2023-07-14T13:12:22.915442+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.931190+0000","last_change":"2023-07-14T13:12:22.929681+0000","last_active":"2023-07-14T13:12:22.931190+0000","last_peered":"2023-07-14T13:12:22.931190+0000","last_clean":"2023-07-14T13:12:22.931190+0000","last_became_active":"2023-07-14T13:12:22.929406+0000","last_became_peered":"2023-07-14T13:12:22.929406+0000","last_unstale":"2023-07-14T13:12:22.931190+0000","last_undegraded":"2023-07-14T13:12:22.931190+0000","last_fullsized":"2023-07-14T13:12:22.931190+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:03:13.962974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":228,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.914816+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:12:22.914816+0000","last_peered":"2023-07-14T13:12:22.914816+0000","last_clean":"2023-07-14T13:12:22.914816+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:12:22.914816+0000","last_undegraded":"2023-07-14T13:12:22.914816+0000","last_fullsized":"2023-07-14T13:12:22.914816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:00.709746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.908014+0000","last_change":"2023-07-14T13:12:22.908014+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.908014+0000","last_undegraded":"2023-07-14T13:12:22.908014+0000","last_fullsized":"2023-07-14T13:12:22.908014+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.929091+0000","last_change":"2023-07-14T13:12:22.924565+0000","last_active":"2023-07-14T13:12:22.929091+0000","last_peered":"2023-07-14T13:12:22.929091+0000","last_clean":"2023-07-14T13:12:22.929091+0000","last_became_active":"2023-07-14T13:12:22.924067+0000","last_became_peered":"2023-07-14T13:12:22.924067+0000","last_unstale":"2023-07-14T13:12:22.929091+0000","last_undegraded":"2023-07-14T13:12:22.929091+0000","last_fullsized":"2023-07-14T13:12:22.929091+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:41:00.498547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":226,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.907399+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:12:22.907399+0000","last_peered":"2023-07-14T13:12:22.907399+0000","last_clean":"2023-07-14T13:12:22.907399+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:12:22.907399+0000","last_undegraded":"2023-07-14T13:12:22.907399+0000","last_fullsized":"2023-07-14T13:12:22.907399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:11:10.601154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.910272+0000","last_change":"2023-07-14T13:12:22.910272+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.910272+0000","last_undegraded":"2023-07-14T13:12:22.910272+0000","last_fullsized":"2023-07-14T13:12:22.910272+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.930392+0000","last_change":"2023-07-14T13:12:22.927281+0000","last_active":"2023-07-14T13:12:22.930392+0000","last_peered":"2023-07-14T13:12:22.930392+0000","last_clean":"2023-07-14T13:12:22.930392+0000","last_became_active":"2023-07-14T13:12:22.926987+0000","last_became_peered":"2023-07-14T13:12:22.926987+0000","last_unstale":"2023-07-14T13:12:22.930392+0000","last_undegraded":"2023-07-14T13:12:22.930392+0000","last_fullsized":"2023-07-14T13:12:22.930392+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:13:56.663119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":224,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.914252+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:12:22.914252+0000","last_peered":"2023-07-14T13:12:22.914252+0000","last_clean":"2023-07-14T13:12:22.914252+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:12:22.914252+0000","last_undegraded":"2023-07-14T13:12:22.914252+0000","last_fullsized":"2023-07-14T13:12:22.914252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:04:17.778038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.915998+0000","last_change":"2023-07-14T13:12:22.915998+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.915998+0000","last_undegraded":"2023-07-14T13:12:22.915998+0000","last_fullsized":"2023-07-14T13:12:22.915998+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.928805+0000","last_change":"2023-07-14T13:12:22.926462+0000","last_active":"2023-07-14T13:12:22.928805+0000","last_peered":"2023-07-14T13:12:22.928805+0000","last_clean":"2023-07-14T13:12:22.928805+0000","last_became_active":"2023-07-14T13:12:22.926168+0000","last_became_peered":"2023-07-14T13:12:22.926168+0000","last_unstale":"2023-07-14T13:12:22.928805+0000","last_undegraded":"2023-07-14T13:12:22.928805+0000","last_fullsized":"2023-07-14T13:12:22.928805+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:36:23.597546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":236,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.904286+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:12:22.904286+0000","last_peered":"2023-07-14T13:12:22.904286+0000","last_clean":"2023-07-14T13:12:22.904286+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:12:22.904286+0000","last_undegraded":"2023-07-14T13:12:22.904286+0000","last_fullsized":"2023-07-14T13:12:22.904286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:39:51.306284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.912244+0000","last_change":"2023-07-14T13:12:22.912244+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.912244+0000","last_undegraded":"2023-07-14T13:12:22.912244+0000","last_fullsized":"2023-07-14T13:12:22.912244+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.927372+0000","last_change":"2023-07-14T13:12:22.922833+0000","last_active":"2023-07-14T13:12:22.927372+0000","last_peered":"2023-07-14T13:12:22.927372+0000","last_clean":"2023-07-14T13:12:22.927372+0000","last_became_active":"2023-07-14T13:12:22.922520+0000","last_became_peered":"2023-07-14T13:12:22.922520+0000","last_unstale":"2023-07-14T13:12:22.927372+0000","last_undegraded":"2023-07-14T13:12:22.927372+0000","last_fullsized":"2023-07-14T13:12:22.927372+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:49:35.637130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":228,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.917411+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:12:22.917411+0000","last_peered":"2023-07-14T13:12:22.917411+0000","last_clean":"2023-07-14T13:12:22.917411+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:12:22.917411+0000","last_undegraded":"2023-07-14T13:12:22.917411+0000","last_fullsized":"2023-07-14T13:12:22.917411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:22:14.236318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.912765+0000","last_change":"2023-07-14T13:12:22.912765+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.912765+0000","last_undegraded":"2023-07-14T13:12:22.912765+0000","last_fullsized":"2023-07-14T13:12:22.912765+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.928043+0000","last_change":"2023-07-14T13:12:22.924751+0000","last_active":"2023-07-14T13:12:22.928043+0000","last_peered":"2023-07-14T13:12:22.928043+0000","last_clean":"2023-07-14T13:12:22.928043+0000","last_became_active":"2023-07-14T13:12:22.924479+0000","last_became_peered":"2023-07-14T13:12:22.924479+0000","last_unstale":"2023-07-14T13:12:22.928043+0000","last_undegraded":"2023-07-14T13:12:22.928043+0000","last_fullsized":"2023-07-14T13:12:22.928043+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:27:08.709009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":236,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.904287+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:12:22.904287+0000","last_peered":"2023-07-14T13:12:22.904287+0000","last_clean":"2023-07-14T13:12:22.904287+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:12:22.904287+0000","last_undegraded":"2023-07-14T13:12:22.904287+0000","last_fullsized":"2023-07-14T13:12:22.904287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:09:58.237621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2023-07-14T13:12:22.912085+0000","last_change":"2023-07-14T13:12:22.912085+0000","last_active":"2023-07-14T13:12:22.892583+0000","last_peered":"2023-07-14T13:12:22.892583+0000","last_clean":"2023-07-14T13:12:22.892583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:12:22.912085+0000","last_undegraded":"2023-07-14T13:12:22.912085+0000","last_fullsized":"2023-07-14T13:12:22.912085+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.929807+0000","last_change":"2023-07-14T13:12:22.925040+0000","last_active":"2023-07-14T13:12:22.929807+0000","last_peered":"2023-07-14T13:12:22.929807+0000","last_clean":"2023-07-14T13:12:22.929807+0000","last_became_active":"2023-07-14T13:12:22.924712+0000","last_became_peered":"2023-07-14T13:12:22.924712+0000","last_unstale":"2023-07-14T13:12:22.929807+0000","last_undegraded":"2023-07-14T13:12:22.929807+0000","last_fullsized":"2023-07-14T13:12:22.929807+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:36:04.651057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":228,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-07-14T13:12:22.917713+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:12:22.917713+0000","last_peered":"2023-07-14T13:12:22.917713+0000","last_clean":"2023-07-14T13:12:22.917713+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:12:22.917713+0000","last_undegraded":"2023-07-14T13:12:22.917713+0000","last_fullsized":"2023-07-14T13:12:22.917713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:15:41.601743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575083,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59552,"kb_used_data":2264,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312288,"statfs":{"total":96636764160,"available":96575782912,"internally_reserved":0,"allocated":2318336,"data_stored":1466284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.68999999999999995,"15min":0.70699999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.84199999999999997,"5min":1.262,"15min":1.262},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71699999999999997,"15min":0.72899999999999998},"min":{"1min":0.54100000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.67600000000000005}]},{"osd":1,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.70599999999999996,"15min":0.72999999999999998},"min":{"1min":0.44,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83799999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72799999999999998,"15min":0.74299999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71199999999999997,"15min":0.72599999999999998},"min":{"1min":0.48999999999999999,"5min":0.46100000000000002,"15min":0.42699999999999999},"max":{"1min":0.91500000000000004,"5min":1.073,"15min":1.073},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.753},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84899999999999998,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.85099999999999998}]},{"osd":3,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.72699999999999998,"15min":0.73599999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.091,"5min":1.161,"15min":1.161},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73999999999999999,"15min":0.75600000000000001},"min":{"1min":0.51100000000000001,"5min":0.47899999999999998,"15min":0.41499999999999998},"max":{"1min":0.94899999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.81799999999999995}]},{"osd":4,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56899999999999995,"15min":0.57899999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.318},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.022},"last":0.433},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.40000000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.47299999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.42699999999999999,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.91000000000000003,"5min":0.98099999999999998,"15min":0.98299999999999998},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63100000000000001,"15min":0.64900000000000002},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.34100000000000003},"max":{"1min":0.80500000000000005,"5min":1.028,"15min":1.028},"last":0.58899999999999997}]},{"osd":6,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.42699999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.0489999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.68100000000000005,"15min":0.67700000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.36299999999999999},"max":{"1min":1.151,"5min":4.1130000000000004,"15min":4.1130000000000004},"last":0.64500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575084,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32744,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339096,"statfs":{"total":96636764160,"available":96603234304,"internally_reserved":0,"allocated":1736704,"data_stored":882572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70699999999999996,"15min":0.72699999999999998},"min":{"1min":0.496,"5min":0.47899999999999998,"15min":0.38},"max":{"1min":0.89300000000000002,"5min":0.90400000000000003,"15min":0.996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69999999999999996,"15min":0.72399999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88100000000000001,"5min":0.98199999999999998,"15min":1.0800000000000001},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70099999999999996,"15min":0.73299999999999998},"min":{"1min":0.48499999999999999,"5min":0.42299999999999999,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.0209999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69199999999999995,"15min":0.71899999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82999999999999996,"5min":0.88100000000000001,"15min":1.077},"last":0.625}]},{"osd":2,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.746},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.45900000000000002},"max":{"1min":0.872,"5min":0.95099999999999996,"15min":1.105},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71799999999999997,"15min":0.745},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.92100000000000004,"5min":0.99099999999999999,"15min":1.0900000000000001},"last":0.64000000000000001}]},{"osd":3,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72899999999999998,"15min":0.76600000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89300000000000002,"5min":1.054,"15min":1.1359999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71399999999999997,"15min":0.753},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93600000000000005,"5min":0.94799999999999995,"15min":1.1080000000000001},"last":0.86699999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.502},{"interface":"front","average":{"1min":0.628,"5min":0.63900000000000001,"15min":0.63600000000000001},"min":{"1min":0.47499999999999998,"5min":0.439,"15min":0.38500000000000001},"max":{"1min":0.79800000000000004,"5min":0.95499999999999996,"15min":1.0780000000000001},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63,"15min":0.64000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":1.579},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48199999999999998,"5min":0.46300000000000002,"15min":0.42399999999999999},"max":{"1min":0.85599999999999998,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.78000000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66000000000000003,"15min":0.65900000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91800000000000004,"5min":1.0940000000000001,"15min":1.1200000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.36199999999999999},"max":{"1min":0.90400000000000003,"5min":1.0209999999999999,"15min":1.657},"last":0.68000000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575083,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50792,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321048,"statfs":{"total":96636764160,"available":96584753152,"internally_reserved":0,"allocated":1736704,"data_stored":882572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68799999999999994,"15min":0.72199999999999998},"min":{"1min":0.45400000000000001,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":2.6699999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.46500000000000002,"5min":0.41699999999999998,"15min":0.32800000000000001},"max":{"1min":0.86799999999999999,"5min":1.083,"15min":1.083},"last":0.51000000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68899999999999995,"15min":0.71799999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44500000000000001},"max":{"1min":0.93600000000000005,"5min":1.05,"15min":1.079},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.71499999999999997,"15min":0.73899999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.36799999999999999},"max":{"1min":0.873,"5min":0.94599999999999995,"15min":2.706},"last":0.46300000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70899999999999996,"15min":0.72799999999999998},"min":{"1min":0.41199999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90700000000000003,"5min":1.212,"15min":1.212},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70799999999999996,"15min":0.72699999999999998},"min":{"1min":0.497,"5min":0.44800000000000001,"15min":0.433},"max":{"1min":0.94599999999999995,"5min":1.181,"15min":1.181},"last":0.48899999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72499999999999998,"15min":0.74199999999999999},"min":{"1min":0.53900000000000003,"5min":0.41799999999999998,"15min":0.377},"max":{"1min":0.88600000000000001,"5min":0.95199999999999996,"15min":2.7389999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73099999999999998,"15min":0.753},"min":{"1min":0.51600000000000001,"5min":0.47299999999999998,"15min":0.39700000000000002},"max":{"1min":0.94499999999999995,"5min":1.304,"15min":1.304},"last":0.79600000000000004}]},{"osd":4,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.628,"15min":0.628},"min":{"1min":0.38500000000000001,"5min":0.38,"15min":0.28599999999999998},"max":{"1min":0.85599999999999998,"5min":1.129,"15min":1.129},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.69099999999999995,"15min":0.68400000000000005},"min":{"1min":0.53700000000000003,"5min":0.39900000000000002,"15min":0.36299999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":2.7719999999999998},"last":0.53400000000000003}]},{"osd":6,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60199999999999998,"15min":0.60599999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.32700000000000001},"max":{"1min":0.89700000000000002,"5min":1.169,"15min":1.169},"last":0.63},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42599999999999999,"5min":0.39400000000000002,"15min":0.34300000000000003},"max":{"1min":0.91000000000000003,"5min":1.238,"15min":1.238},"last":0.66700000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64600000000000002,"15min":0.64300000000000002},"min":{"1min":0.40899999999999997,"5min":0.36899999999999999,"15min":0.32900000000000001},"max":{"1min":0.90800000000000003,"5min":1.026,"15min":3.0230000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68300000000000005,"15min":0.67700000000000005},"min":{"1min":0.49399999999999999,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.98199999999999998,"5min":1.2589999999999999,"15min":1.407},"last":0.82699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575083,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36840,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335000,"statfs":{"total":96636764160,"available":96599040000,"internally_reserved":0,"allocated":1736704,"data_stored":882572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.70599999999999996,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.411},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.45600000000000002,"5min":0.45100000000000001,"15min":0.435},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.1200000000000001},"last":0.56899999999999995}]},{"osd":1,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71199999999999997,"15min":0.74399999999999999},"min":{"1min":0.496,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84099999999999997,"5min":0.92500000000000004,"15min":1.077},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70399999999999996,"15min":0.72999999999999998},"min":{"1min":0.52700000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.0469999999999999},"last":0.66500000000000004}]},{"osd":2,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.71999999999999997,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.42199999999999999,"15min":0.35199999999999998},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72099999999999997,"15min":0.76400000000000001},"min":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.86699999999999999,"5min":0.98199999999999998,"15min":1.387},"last":0.52200000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.49399999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89700000000000002,"5min":0.95399999999999996,"15min":1.008},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.74099999999999999,"15min":0.76600000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46800000000000003},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.60799999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.378},"max":{"1min":0.92200000000000004,"5min":0.92400000000000004,"15min":0.97099999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.40400000000000003,"15min":0.34599999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.35599999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.014},"last":0.496},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67900000000000005,"15min":0.67000000000000004},"min":{"1min":0.48599999999999999,"5min":0.443,"15min":0.374},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.0289999999999999},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.69899999999999995,"15min":0.67200000000000004},"min":{"1min":0.51300000000000001,"5min":0.502,"15min":0.39000000000000001},"max":{"1min":0.91700000000000004,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.69799999999999995},"min":{"1min":0.48199999999999998,"5min":0.42799999999999999,"15min":0.40300000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.54600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575083,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36840,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335000,"statfs":{"total":96636764160,"available":96599040000,"internally_reserved":0,"allocated":1736704,"data_stored":882572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.44400000000000001,"15min":0.44900000000000001},"min":{"1min":0.25600000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.63100000000000001,"5min":0.78600000000000003,"15min":0.84199999999999997},"last":0.374},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.49299999999999999,"15min":0.51100000000000001},"min":{"1min":0.312,"5min":0.307,"15min":0.307},"max":{"1min":0.66700000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.44600000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47399999999999998,"15min":0.47999999999999998},"min":{"1min":0.32300000000000001,"5min":0.32000000000000001,"15min":0.315},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.0029999999999999},"last":0.42099999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55800000000000005,"15min":0.57199999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.58299999999999996,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.36799999999999999},"max":{"1min":0.81599999999999995,"5min":0.88100000000000001,"15min":1.663},"last":0.498}]},{"osd":4,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.72699999999999998,"15min":0.755},"min":{"1min":0.53000000000000003,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.284},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.52700000000000002,"5min":0.51900000000000002,"15min":0.47699999999999998},"max":{"1min":0.96899999999999997,"5min":1.175,"15min":1.175},"last":0.77000000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76600000000000001,"15min":0.78700000000000003},"min":{"1min":0.54900000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.05,"5min":1.0629999999999999,"15min":1.306},"last":0.747},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.754,"15min":0.78200000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.372},"max":{"1min":1.121,"5min":1.121,"15min":1.2470000000000001},"last":0.86299999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.746,"15min":0.76900000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48099999999999998},"max":{"1min":1.0680000000000001,"5min":1.113,"15min":1.117},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.78700000000000003,"15min":0.81100000000000005},"min":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.54200000000000004},"max":{"1min":1.133,"5min":1.133,"15min":1.2589999999999999},"last":0.84899999999999998}]},{"osd":7,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.78300000000000003,"15min":0.82799999999999996},"min":{"1min":0.58399999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.159,"5min":1.159,"15min":2.4910000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.78100000000000003,"15min":0.81799999999999995},"min":{"1min":0.57599999999999996,"5min":0.53500000000000003,"15min":0.51600000000000001},"max":{"1min":1.0960000000000001,"5min":1.1359999999999999,"15min":1.595},"last":0.89500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575083,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58980,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312860,"statfs":{"total":96636764160,"available":96576368640,"internally_reserved":0,"allocated":1732608,"data_stored":881553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46200000000000002,"15min":0.46400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.80400000000000005,"5min":0.84699999999999998,"15min":1.3169999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.50800000000000001,"15min":0.53300000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67300000000000004,"5min":0.80800000000000005,"15min":2.5270000000000001},"last":0.66400000000000003}]},{"osd":1,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.47699999999999998,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.29999999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":2.7200000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.55700000000000005},"min":{"1min":0.39900000000000002,"5min":0.36299999999999999,"15min":0.35999999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":2.6110000000000002},"last":0.62}]},{"osd":3,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55100000000000005,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.755,"5min":0.755,"15min":8.2530000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.77000000000000002,"5min":0.89600000000000002,"15min":1.2150000000000001},"last":0.64500000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.73999999999999999,"15min":0.76900000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.48399999999999999},"max":{"1min":0.91100000000000003,"5min":1.0840000000000001,"15min":1.1499999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73999999999999999,"15min":0.78100000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.47999999999999998},"max":{"1min":0.92900000000000005,"5min":1.0629999999999999,"15min":2.3170000000000002},"last":0.92300000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.79900000000000004,"15min":0.84699999999999998},"min":{"1min":0.58399999999999996,"5min":0.56399999999999995,"15min":0.49399999999999999},"max":{"1min":1.0029999999999999,"5min":1.1319999999999999,"15min":3.1139999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.78900000000000003,"15min":0.83299999999999996},"min":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.55600000000000005},"max":{"1min":1.03,"5min":1.153,"15min":2.6850000000000001},"last":0.93999999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.73999999999999999,"15min":0.79100000000000004},"min":{"1min":0.52900000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98299999999999998,"5min":1.038,"15min":3.9849999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75900000000000001,"15min":0.80200000000000005},"min":{"1min":0.53900000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":3.391},"last":0.89200000000000002}]},{"osd":7,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.76000000000000001,"15min":0.80900000000000005},"min":{"1min":0.56200000000000006,"5min":0.52300000000000002,"15min":0.5},"max":{"1min":1.022,"5min":1.1759999999999999,"15min":2.5779999999999998},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.78200000000000003,"15min":0.81799999999999995},"min":{"1min":0.57099999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.736,"5min":1.736,"15min":2.5939999999999999},"last":0.84899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575084,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36840,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335000,"statfs":{"total":96636764160,"available":96599040000,"internally_reserved":0,"allocated":1736704,"data_stored":882572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42899999999999999,"15min":0.432},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26100000000000001},"max":{"1min":0.56000000000000005,"5min":0.65400000000000003,"15min":0.77200000000000002},"last":0.377},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.34999999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.74399999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.55600000000000005}]},{"osd":2,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.35899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.63700000000000001,"5min":0.69199999999999995,"15min":1.0409999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.51700000000000002},"min":{"1min":0.32100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73199999999999998,"5min":0.77900000000000003,"15min":1.014},"last":0.436}]},{"osd":3,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60799999999999998,"15min":0.628},"min":{"1min":0.502,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.746,"5min":0.80300000000000005,"15min":0.96299999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55300000000000005,"15min":0.57099999999999995},"min":{"1min":0.41299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69899999999999995,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.59199999999999997}]},{"osd":4,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76400000000000001,"15min":0.78300000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48899999999999999},"max":{"1min":1.155,"5min":1.2110000000000001,"15min":1.236},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79000000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0640000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.64100000000000001}]},{"osd":5,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77700000000000002,"15min":0.78500000000000003},"min":{"1min":0.56000000000000005,"5min":0.52500000000000002,"15min":0.45200000000000001},"max":{"1min":1.1020000000000001,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.624},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.79600000000000004,"15min":0.80300000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.48599999999999999},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.85299999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.55900000000000005,"5min":0.53800000000000003,"15min":0.503},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.2170000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79900000000000004,"15min":0.81799999999999995},"min":{"1min":0.53700000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.94399999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.58499999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82699999999999996,"15min":0.84199999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.99199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575085,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41512,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330328,"statfs":{"total":96636764160,"available":96594255872,"internally_reserved":0,"allocated":2326528,"data_stored":1471921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.27300000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.59199999999999997,"5min":0.79600000000000004,"15min":2.2450000000000001},"last":0.247},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.48299999999999998,"15min":0.50800000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27700000000000002},"max":{"1min":0.72999999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.29399999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.504,"15min":0.51400000000000001},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68200000000000005,"5min":0.84499999999999997,"15min":2.2989999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52800000000000002,"15min":0.54700000000000004},"min":{"1min":0.39100000000000001,"5min":0.34899999999999998,"15min":0.29899999999999999},"max":{"1min":0.71199999999999997,"5min":0.83599999999999997,"15min":0.90300000000000002},"last":0.38100000000000001}]},{"osd":3,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.505,"15min":0.505},"min":{"1min":0.35199999999999998,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.84999999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57799999999999996,"15min":0.58999999999999997},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76600000000000001,"5min":0.92700000000000005,"15min":2.4100000000000001},"last":0.36399999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74399999999999999,"15min":0.77800000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1220000000000001,"5min":1.21,"15min":1.3640000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.75700000000000001,"15min":0.79300000000000004},"min":{"1min":0.57599999999999996,"5min":0.53500000000000003,"15min":0.44900000000000001},"max":{"1min":1.0289999999999999,"5min":1.0589999999999999,"15min":2.4460000000000002},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75600000000000001,"15min":0.79400000000000004},"min":{"1min":0.62,"5min":0.54200000000000004,"15min":0.47899999999999998},"max":{"1min":1.044,"5min":1.0669999999999999,"15min":1.3839999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.59399999999999997,"5min":0.5,"15min":0.48399999999999999},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.325},"last":0.86499999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77100000000000002,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.147,"5min":1.147,"15min":2.3380000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.755,"15min":0.79900000000000004},"min":{"1min":0.55600000000000005,"5min":0.51000000000000001,"15min":0.50600000000000001},"max":{"1min":0.97899999999999998,"5min":1.0900000000000001,"15min":1.3440000000000001},"last":0.71599999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76300000000000001,"15min":0.81599999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.503},"max":{"1min":1.016,"5min":1.1180000000000001,"15min":1.2749999999999999},"last":0.752},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.77200000000000002,"15min":0.80500000000000005},"min":{"1min":0.56000000000000005,"5min":0.50600000000000001,"15min":0.502},"max":{"1min":1.077,"5min":1.0880000000000001,"15min":1.381},"last":0.72499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:12:28.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3f is not active+clean 2023-07-14T13:12:28.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.921634+0000', 'last_change': '2023-07-14T13:12:22.921634+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.921634+0000', 'last_undegraded': '2023-07-14T13:12:22.921634+0000', 'last_fullsized': '2023-07-14T13:12:22.921634+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:12:28.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3e is not active+clean 2023-07-14T13:12:28.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.914942+0000', 'last_change': '2023-07-14T13:12:22.914942+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.914942+0000', 'last_undegraded': '2023-07-14T13:12:22.914942+0000', 'last_fullsized': '2023-07-14T13:12:22.914942+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:12:28.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3d is not active+clean 2023-07-14T13:12:28.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.912221+0000', 'last_change': '2023-07-14T13:12:22.912221+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.912221+0000', 'last_undegraded': '2023-07-14T13:12:22.912221+0000', 'last_fullsized': '2023-07-14T13:12:22.912221+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:12:28.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3c is not active+clean 2023-07-14T13:12:28.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.914791+0000', 'last_change': '2023-07-14T13:12:22.914791+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.914791+0000', 'last_undegraded': '2023-07-14T13:12:22.914791+0000', 'last_fullsized': '2023-07-14T13:12:22.914791+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:12:28.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3b is not active+clean 2023-07-14T13:12:28.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.921391+0000', 'last_change': '2023-07-14T13:12:22.921391+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.921391+0000', 'last_undegraded': '2023-07-14T13:12:22.921391+0000', 'last_fullsized': '2023-07-14T13:12:22.921391+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:12:28.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3a is not active+clean 2023-07-14T13:12:28.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.911078+0000', 'last_change': '2023-07-14T13:12:22.911078+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.911078+0000', 'last_undegraded': '2023-07-14T13:12:22.911078+0000', 'last_fullsized': '2023-07-14T13:12:22.911078+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:12:28.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.39 is not active+clean 2023-07-14T13:12:28.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.910643+0000', 'last_change': '2023-07-14T13:12:22.910643+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.910643+0000', 'last_undegraded': '2023-07-14T13:12:22.910643+0000', 'last_fullsized': '2023-07-14T13:12:22.910643+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:12:28.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.38 is not active+clean 2023-07-14T13:12:28.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.912745+0000', 'last_change': '2023-07-14T13:12:22.912745+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.912745+0000', 'last_undegraded': '2023-07-14T13:12:22.912745+0000', 'last_fullsized': '2023-07-14T13:12:22.912745+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:12:28.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.37 is not active+clean 2023-07-14T13:12:28.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.916440+0000', 'last_change': '2023-07-14T13:12:22.916440+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.916440+0000', 'last_undegraded': '2023-07-14T13:12:22.916440+0000', 'last_fullsized': '2023-07-14T13:12:22.916440+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:12:28.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.36 is not active+clean 2023-07-14T13:12:28.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.909705+0000', 'last_change': '2023-07-14T13:12:22.909705+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.909705+0000', 'last_undegraded': '2023-07-14T13:12:22.909705+0000', 'last_fullsized': '2023-07-14T13:12:22.909705+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:12:28.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.35 is not active+clean 2023-07-14T13:12:28.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.921599+0000', 'last_change': '2023-07-14T13:12:22.921599+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.921599+0000', 'last_undegraded': '2023-07-14T13:12:22.921599+0000', 'last_fullsized': '2023-07-14T13:12:22.921599+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:12:28.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.34 is not active+clean 2023-07-14T13:12:28.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.913503+0000', 'last_change': '2023-07-14T13:12:22.913503+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.913503+0000', 'last_undegraded': '2023-07-14T13:12:22.913503+0000', 'last_fullsized': '2023-07-14T13:12:22.913503+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:12:28.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.33 is not active+clean 2023-07-14T13:12:28.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.908889+0000', 'last_change': '2023-07-14T13:12:22.908889+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.908889+0000', 'last_undegraded': '2023-07-14T13:12:22.908889+0000', 'last_fullsized': '2023-07-14T13:12:22.908889+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:12:28.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.32 is not active+clean 2023-07-14T13:12:28.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.918157+0000', 'last_change': '2023-07-14T13:12:22.918157+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.918157+0000', 'last_undegraded': '2023-07-14T13:12:22.918157+0000', 'last_fullsized': '2023-07-14T13:12:22.918157+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:12:28.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.31 is not active+clean 2023-07-14T13:12:28.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.922362+0000', 'last_change': '2023-07-14T13:12:22.922362+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.922362+0000', 'last_undegraded': '2023-07-14T13:12:22.922362+0000', 'last_fullsized': '2023-07-14T13:12:22.922362+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:12:28.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.30 is not active+clean 2023-07-14T13:12:28.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.911369+0000', 'last_change': '2023-07-14T13:12:22.911369+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.911369+0000', 'last_undegraded': '2023-07-14T13:12:22.911369+0000', 'last_fullsized': '2023-07-14T13:12:22.911369+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:12:28.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2f is not active+clean 2023-07-14T13:12:28.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.909224+0000', 'last_change': '2023-07-14T13:12:22.909224+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.909224+0000', 'last_undegraded': '2023-07-14T13:12:22.909224+0000', 'last_fullsized': '2023-07-14T13:12:22.909224+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:12:28.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2e is not active+clean 2023-07-14T13:12:28.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.914405+0000', 'last_change': '2023-07-14T13:12:22.914405+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.914405+0000', 'last_undegraded': '2023-07-14T13:12:22.914405+0000', 'last_fullsized': '2023-07-14T13:12:22.914405+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:12:28.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2d is not active+clean 2023-07-14T13:12:28.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.917896+0000', 'last_change': '2023-07-14T13:12:22.917896+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.917896+0000', 'last_undegraded': '2023-07-14T13:12:22.917896+0000', 'last_fullsized': '2023-07-14T13:12:22.917896+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:12:28.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2c is not active+clean 2023-07-14T13:12:28.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.910687+0000', 'last_change': '2023-07-14T13:12:22.910687+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.910687+0000', 'last_undegraded': '2023-07-14T13:12:22.910687+0000', 'last_fullsized': '2023-07-14T13:12:22.910687+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:12:28.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2b is not active+clean 2023-07-14T13:12:28.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.916401+0000', 'last_change': '2023-07-14T13:12:22.916401+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.916401+0000', 'last_undegraded': '2023-07-14T13:12:22.916401+0000', 'last_fullsized': '2023-07-14T13:12:22.916401+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:12:28.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2a is not active+clean 2023-07-14T13:12:28.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.921056+0000', 'last_change': '2023-07-14T13:12:22.921056+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.921056+0000', 'last_undegraded': '2023-07-14T13:12:22.921056+0000', 'last_fullsized': '2023-07-14T13:12:22.921056+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:12:28.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.29 is not active+clean 2023-07-14T13:12:28.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.914616+0000', 'last_change': '2023-07-14T13:12:22.914616+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.914616+0000', 'last_undegraded': '2023-07-14T13:12:22.914616+0000', 'last_fullsized': '2023-07-14T13:12:22.914616+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:12:28.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.28 is not active+clean 2023-07-14T13:12:28.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.912264+0000', 'last_change': '2023-07-14T13:12:22.912264+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.912264+0000', 'last_undegraded': '2023-07-14T13:12:22.912264+0000', 'last_fullsized': '2023-07-14T13:12:22.912264+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:12:28.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.27 is not active+clean 2023-07-14T13:12:28.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.913552+0000', 'last_change': '2023-07-14T13:12:22.913552+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.913552+0000', 'last_undegraded': '2023-07-14T13:12:22.913552+0000', 'last_fullsized': '2023-07-14T13:12:22.913552+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:12:28.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.26 is not active+clean 2023-07-14T13:12:28.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.910524+0000', 'last_change': '2023-07-14T13:12:22.910524+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.910524+0000', 'last_undegraded': '2023-07-14T13:12:22.910524+0000', 'last_fullsized': '2023-07-14T13:12:22.910524+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:12:28.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.25 is not active+clean 2023-07-14T13:12:28.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.915798+0000', 'last_change': '2023-07-14T13:12:22.915798+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.915798+0000', 'last_undegraded': '2023-07-14T13:12:22.915798+0000', 'last_fullsized': '2023-07-14T13:12:22.915798+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:12:28.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.24 is not active+clean 2023-07-14T13:12:28.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.913041+0000', 'last_change': '2023-07-14T13:12:22.913041+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.913041+0000', 'last_undegraded': '2023-07-14T13:12:22.913041+0000', 'last_fullsized': '2023-07-14T13:12:22.913041+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:12:28.859 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.23 is not active+clean 2023-07-14T13:12:28.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.913586+0000', 'last_change': '2023-07-14T13:12:22.913586+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.913586+0000', 'last_undegraded': '2023-07-14T13:12:22.913586+0000', 'last_fullsized': '2023-07-14T13:12:22.913586+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:12:28.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.22 is not active+clean 2023-07-14T13:12:28.860 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.910071+0000', 'last_change': '2023-07-14T13:12:22.910071+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.910071+0000', 'last_undegraded': '2023-07-14T13:12:22.910071+0000', 'last_fullsized': '2023-07-14T13:12:22.910071+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:12:28.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.21 is not active+clean 2023-07-14T13:12:28.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.911426+0000', 'last_change': '2023-07-14T13:12:22.911426+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.911426+0000', 'last_undegraded': '2023-07-14T13:12:22.911426+0000', 'last_fullsized': '2023-07-14T13:12:22.911426+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:12:28.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.20 is not active+clean 2023-07-14T13:12:28.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.911697+0000', 'last_change': '2023-07-14T13:12:22.911697+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.911697+0000', 'last_undegraded': '2023-07-14T13:12:22.911697+0000', 'last_fullsized': '2023-07-14T13:12:22.911697+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:12:28.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1c is not active+clean 2023-07-14T13:12:28.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.909364+0000', 'last_change': '2023-07-14T13:12:22.909364+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.909364+0000', 'last_undegraded': '2023-07-14T13:12:22.909364+0000', 'last_fullsized': '2023-07-14T13:12:22.909364+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:12:28.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1d is not active+clean 2023-07-14T13:12:28.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.909091+0000', 'last_change': '2023-07-14T13:12:22.909091+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.909091+0000', 'last_undegraded': '2023-07-14T13:12:22.909091+0000', 'last_fullsized': '2023-07-14T13:12:22.909091+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:12:28.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1e is not active+clean 2023-07-14T13:12:28.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.912583+0000', 'last_change': '2023-07-14T13:12:22.912583+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.912583+0000', 'last_undegraded': '2023-07-14T13:12:22.912583+0000', 'last_fullsized': '2023-07-14T13:12:22.912583+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:12:28.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1f is not active+clean 2023-07-14T13:12:28.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.914814+0000', 'last_change': '2023-07-14T13:12:22.914814+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.914814+0000', 'last_undegraded': '2023-07-14T13:12:22.914814+0000', 'last_fullsized': '2023-07-14T13:12:22.914814+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:12:28.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.18 is not active+clean 2023-07-14T13:12:28.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.907985+0000', 'last_change': '2023-07-14T13:12:22.907985+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.907985+0000', 'last_undegraded': '2023-07-14T13:12:22.907985+0000', 'last_fullsized': '2023-07-14T13:12:22.907985+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:12:28.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.19 is not active+clean 2023-07-14T13:12:28.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.921862+0000', 'last_change': '2023-07-14T13:12:22.921862+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.921862+0000', 'last_undegraded': '2023-07-14T13:12:22.921862+0000', 'last_fullsized': '2023-07-14T13:12:22.921862+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:12:28.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1a is not active+clean 2023-07-14T13:12:28.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.909458+0000', 'last_change': '2023-07-14T13:12:22.909458+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.909458+0000', 'last_undegraded': '2023-07-14T13:12:22.909458+0000', 'last_fullsized': '2023-07-14T13:12:22.909458+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:12:28.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1b is not active+clean 2023-07-14T13:12:28.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.908398+0000', 'last_change': '2023-07-14T13:12:22.908398+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.908398+0000', 'last_undegraded': '2023-07-14T13:12:22.908398+0000', 'last_fullsized': '2023-07-14T13:12:22.908398+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:12:28.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.c is not active+clean 2023-07-14T13:12:28.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.911832+0000', 'last_change': '2023-07-14T13:12:22.911832+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.911832+0000', 'last_undegraded': '2023-07-14T13:12:22.911832+0000', 'last_fullsized': '2023-07-14T13:12:22.911832+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:12:28.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.d is not active+clean 2023-07-14T13:12:28.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.920524+0000', 'last_change': '2023-07-14T13:12:22.920524+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.920524+0000', 'last_undegraded': '2023-07-14T13:12:22.920524+0000', 'last_fullsized': '2023-07-14T13:12:22.920524+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:12:28.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.e is not active+clean 2023-07-14T13:12:28.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.908467+0000', 'last_change': '2023-07-14T13:12:22.908467+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.908467+0000', 'last_undegraded': '2023-07-14T13:12:22.908467+0000', 'last_fullsized': '2023-07-14T13:12:22.908467+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:12:28.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.f is not active+clean 2023-07-14T13:12:28.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.911429+0000', 'last_change': '2023-07-14T13:12:22.911429+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.911429+0000', 'last_undegraded': '2023-07-14T13:12:22.911429+0000', 'last_fullsized': '2023-07-14T13:12:22.911429+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:12:28.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.8 is not active+clean 2023-07-14T13:12:28.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.910902+0000', 'last_change': '2023-07-14T13:12:22.910902+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.910902+0000', 'last_undegraded': '2023-07-14T13:12:22.910902+0000', 'last_fullsized': '2023-07-14T13:12:22.910902+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:12:28.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.9 is not active+clean 2023-07-14T13:12:28.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.909619+0000', 'last_change': '2023-07-14T13:12:22.909619+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.909619+0000', 'last_undegraded': '2023-07-14T13:12:22.909619+0000', 'last_fullsized': '2023-07-14T13:12:22.909619+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:12:28.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.a is not active+clean 2023-07-14T13:12:28.871 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.908947+0000', 'last_change': '2023-07-14T13:12:22.908947+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.908947+0000', 'last_undegraded': '2023-07-14T13:12:22.908947+0000', 'last_fullsized': '2023-07-14T13:12:22.908947+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:12:28.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.b is not active+clean 2023-07-14T13:12:28.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.911426+0000', 'last_change': '2023-07-14T13:12:22.911426+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.911426+0000', 'last_undegraded': '2023-07-14T13:12:22.911426+0000', 'last_fullsized': '2023-07-14T13:12:22.911426+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:12:28.872 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.4 is not active+clean 2023-07-14T13:12:28.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.912579+0000', 'last_change': '2023-07-14T13:12:22.912579+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.912579+0000', 'last_undegraded': '2023-07-14T13:12:22.912579+0000', 'last_fullsized': '2023-07-14T13:12:22.912579+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:12:28.873 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.5 is not active+clean 2023-07-14T13:12:28.873 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.907525+0000', 'last_change': '2023-07-14T13:12:22.907525+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.907525+0000', 'last_undegraded': '2023-07-14T13:12:22.907525+0000', 'last_fullsized': '2023-07-14T13:12:22.907525+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:12:28.873 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.6 is not active+clean 2023-07-14T13:12:28.874 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.914915+0000', 'last_change': '2023-07-14T13:12:22.914915+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.914915+0000', 'last_undegraded': '2023-07-14T13:12:22.914915+0000', 'last_fullsized': '2023-07-14T13:12:22.914915+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:12:28.874 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.7 is not active+clean 2023-07-14T13:12:28.874 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.910320+0000', 'last_change': '2023-07-14T13:12:22.910320+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.910320+0000', 'last_undegraded': '2023-07-14T13:12:22.910320+0000', 'last_fullsized': '2023-07-14T13:12:22.910320+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:12:28.875 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.0 is not active+clean 2023-07-14T13:12:28.875 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.909148+0000', 'last_change': '2023-07-14T13:12:22.909148+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.909148+0000', 'last_undegraded': '2023-07-14T13:12:22.909148+0000', 'last_fullsized': '2023-07-14T13:12:22.909148+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:12:28.875 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1 is not active+clean 2023-07-14T13:12:28.875 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.909154+0000', 'last_change': '2023-07-14T13:12:22.909154+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.909154+0000', 'last_undegraded': '2023-07-14T13:12:22.909154+0000', 'last_fullsized': '2023-07-14T13:12:22.909154+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:12:28.876 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2 is not active+clean 2023-07-14T13:12:28.876 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.915122+0000', 'last_change': '2023-07-14T13:12:22.915122+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.915122+0000', 'last_undegraded': '2023-07-14T13:12:22.915122+0000', 'last_fullsized': '2023-07-14T13:12:22.915122+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:12:28.876 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3 is not active+clean 2023-07-14T13:12:28.877 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.907380+0000', 'last_change': '2023-07-14T13:12:22.907380+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.907380+0000', 'last_undegraded': '2023-07-14T13:12:22.907380+0000', 'last_fullsized': '2023-07-14T13:12:22.907380+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:12:28.877 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.13 is not active+clean 2023-07-14T13:12:28.877 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.915949+0000', 'last_change': '2023-07-14T13:12:22.915949+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.915949+0000', 'last_undegraded': '2023-07-14T13:12:22.915949+0000', 'last_fullsized': '2023-07-14T13:12:22.915949+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:12:28.878 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.10 is not active+clean 2023-07-14T13:12:28.878 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.915442+0000', 'last_change': '2023-07-14T13:12:22.915442+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.915442+0000', 'last_undegraded': '2023-07-14T13:12:22.915442+0000', 'last_fullsized': '2023-07-14T13:12:22.915442+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:12:28.878 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.11 is not active+clean 2023-07-14T13:12:28.879 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.908014+0000', 'last_change': '2023-07-14T13:12:22.908014+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.908014+0000', 'last_undegraded': '2023-07-14T13:12:22.908014+0000', 'last_fullsized': '2023-07-14T13:12:22.908014+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:12:28.879 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.12 is not active+clean 2023-07-14T13:12:28.879 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.910272+0000', 'last_change': '2023-07-14T13:12:22.910272+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.910272+0000', 'last_undegraded': '2023-07-14T13:12:22.910272+0000', 'last_fullsized': '2023-07-14T13:12:22.910272+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:12:28.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.14 is not active+clean 2023-07-14T13:12:28.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.915998+0000', 'last_change': '2023-07-14T13:12:22.915998+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.915998+0000', 'last_undegraded': '2023-07-14T13:12:22.915998+0000', 'last_fullsized': '2023-07-14T13:12:22.915998+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:12:28.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.15 is not active+clean 2023-07-14T13:12:28.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.912244+0000', 'last_change': '2023-07-14T13:12:22.912244+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.912244+0000', 'last_undegraded': '2023-07-14T13:12:22.912244+0000', 'last_fullsized': '2023-07-14T13:12:22.912244+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:12:28.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.16 is not active+clean 2023-07-14T13:12:28.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.912765+0000', 'last_change': '2023-07-14T13:12:22.912765+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.912765+0000', 'last_undegraded': '2023-07-14T13:12:22.912765+0000', 'last_fullsized': '2023-07-14T13:12:22.912765+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:12:28.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.17 is not active+clean 2023-07-14T13:12:28.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:12:22.912085+0000', 'last_change': '2023-07-14T13:12:22.912085+0000', 'last_active': '2023-07-14T13:12:22.892583+0000', 'last_peered': '2023-07-14T13:12:22.892583+0000', 'last_clean': '2023-07-14T13:12:22.892583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:12:22.912085+0000', 'last_undegraded': '2023-07-14T13:12:22.912085+0000', 'last_fullsized': '2023-07-14T13:12:22.912085+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'last_clean_scrub_stamp': '2023-07-14T13:12:22.892583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:12:28.883 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-14T13:12:28.912 INFO:tasks.ceph.mds.c.smithi005.stderr:2023-07-14T13:12:28.877+0000 7f04c59e9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T13:12:29.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.989+0000 7f9575cd8640 1 Processor -- start 2023-07-14T13:12:29.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.989+0000 7f9575cd8640 1 -- start start 2023-07-14T13:12:29.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.993+0000 7f9575cd8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f957015fd60 0x7f95700d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:29.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.993+0000 7f9575cd8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95700ccaf0 con 0x7f95700d1850 2023-07-14T13:12:29.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.993+0000 7f9575cd8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9570160320 con 0x7f95700b7c70 2023-07-14T13:12:29.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.993+0000 7f9575cd8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95700d1190 con 0x7f957015fd60 2023-07-14T13:12:29.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.993+0000 7f956ffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f95700d1850 0x7f95700d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57730/0 (socket says 172.21.15.5:57730) 2023-07-14T13:12:29.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.993+0000 7f956ffff640 1 -- 172.21.15.5:0/2554541498 learned_addr learned my addr 172.21.15.5:0/2554541498 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:29.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.993+0000 7f956effd640 1 --2- 172.21.15.5:0/2554541498 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f957015fd60 0x7f95700d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:29.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.993+0000 7f956e7fc640 1 -- 172.21.15.5:0/2554541498 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304307146 0 0) 0x7f95700ccaf0 con 0x7f95700d1850 2023-07-14T13:12:29.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.993+0000 7f956e7fc640 1 -- 172.21.15.5:0/2554541498 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9558003530 con 0x7f95700d1850 2023-07-14T13:12:29.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.993+0000 7f956e7fc640 1 -- 172.21.15.5:0/2554541498 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028717954 0 0) 0x7f9570160320 con 0x7f95700b7c70 2023-07-14T13:12:29.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.993+0000 7f956e7fc640 1 -- 172.21.15.5:0/2554541498 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95700ccaf0 con 0x7f95700b7c70 2023-07-14T13:12:29.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.993+0000 7f956effd640 1 -- 172.21.15.5:0/2554541498 >> v1:172.21.15.154:6789/0 conn(0x7f95700b7c70 legacy=0x7f957015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:29.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.993+0000 7f956e7fc640 1 -- 172.21.15.5:0/2554541498 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1783965931 0 0) 0x7f9558003530 con 0x7f95700d1850 2023-07-14T13:12:29.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.993+0000 7f956effd640 1 -- 172.21.15.5:0/2554541498 >> v1:172.21.15.5:6789/0 conn(0x7f95700d1850 legacy=0x7f95700d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:29.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.993+0000 7f956effd640 1 -- 172.21.15.5:0/2554541498 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95700ccd90 con 0x7f957015fd60 2023-07-14T13:12:29.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.997+0000 7f956effd640 1 --2- 172.21.15.5:0/2554541498 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f957015fd60 0x7f95700d0c50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f95640097f0 tx=0x7f956401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c36840ded56aae server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:29.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.997+0000 7f956e7fc640 1 -- 172.21.15.5:0/2554541498 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9568001a00 con 0x7f957015fd60 2023-07-14T13:12:29.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.997+0000 7f956e7fc640 1 -- 172.21.15.5:0/2554541498 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95640a7050 con 0x7f957015fd60 2023-07-14T13:12:29.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.997+0000 7f956e7fc640 1 -- 172.21.15.5:0/2554541498 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95640ab620 con 0x7f957015fd60 2023-07-14T13:12:29.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.997+0000 7f9575cd8640 1 -- 172.21.15.5:0/2554541498 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f957015fd60 msgr2=0x7f95700d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:29.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.997+0000 7f9575cd8640 1 --2- 172.21.15.5:0/2554541498 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f957015fd60 0x7f95700d0c50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f95640097f0 tx=0x7f956401c3e0 comp rx=0 tx=0).stop 2023-07-14T13:12:29.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.997+0000 7f9575cd8640 1 -- 172.21.15.5:0/2554541498 shutdown_connections 2023-07-14T13:12:29.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.997+0000 7f9575cd8640 1 --2- 172.21.15.5:0/2554541498 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f957015fd60 0x7f95700d0c50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:29.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.997+0000 7f9575cd8640 1 -- 172.21.15.5:0/2554541498 >> 172.21.15.5:0/2554541498 conn(0x7f95700650b0 msgr2=0x7f95700654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:29.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.997+0000 7f9575cd8640 1 -- 172.21.15.5:0/2554541498 shutdown_connections 2023-07-14T13:12:29.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.997+0000 7f9575cd8640 1 -- 172.21.15.5:0/2554541498 wait complete. 2023-07-14T13:12:29.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.997+0000 7f9575cd8640 1 Processor -- start 2023-07-14T13:12:29.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:28.997+0000 7f9575cd8640 1 -- start start 2023-07-14T13:12:29.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.001+0000 7f9575cd8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95700b7c70 0x7f957014d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:29.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.001+0000 7f9575cd8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95700d1850 0x7f957015d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:29.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.001+0000 7f9575cd8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f957015fd60 0x7f9570155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:29.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.001+0000 7f9575cd8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9570151d00 con 0x7f95700d1850 2023-07-14T13:12:29.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.001+0000 7f9575cd8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957015db10 con 0x7f95700b7c70 2023-07-14T13:12:29.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.001+0000 7f9575cd8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f957015ddf0 con 0x7f957015fd60 2023-07-14T13:12:29.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.001+0000 7f956effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95700d1850 0x7f957015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:29.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.001+0000 7f956effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95700d1850 0x7f957015d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59988/0 (socket says 172.21.15.5:59988) 2023-07-14T13:12:29.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.001+0000 7f956effd640 1 -- 172.21.15.5:0/216508457 learned_addr learned my addr 172.21.15.5:0/216508457 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:29.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.001+0000 7f956f7fe640 1 --2- 172.21.15.5:0/216508457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95700b7c70 0x7f957014d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:29.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.001+0000 7f956ffff640 1 --2- 172.21.15.5:0/216508457 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f957015fd60 0x7f9570155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:29.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.001+0000 7f956effd640 1 -- 172.21.15.5:0/216508457 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f957015fd60 msgr2=0x7f9570155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:29.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.001+0000 7f956effd640 1 --2- 172.21.15.5:0/216508457 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f957015fd60 0x7f9570155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:29.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.001+0000 7f956effd640 1 -- 172.21.15.5:0/216508457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95700b7c70 msgr2=0x7f957014d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:29.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.001+0000 7f956effd640 1 --2- 172.21.15.5:0/216508457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95700b7c70 0x7f957014d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:29.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.001+0000 7f956effd640 1 -- 172.21.15.5:0/216508457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9564009420 con 0x7f95700d1850 2023-07-14T13:12:29.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.001+0000 7f956effd640 1 --2- 172.21.15.5:0/216508457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95700d1850 0x7f957015d020 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f95640097f0 tx=0x7f9564019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:29.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.001+0000 7f9557fff640 1 -- 172.21.15.5:0/216508457 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564004220 con 0x7f95700d1850 2023-07-14T13:12:29.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.001+0000 7f9557fff640 1 -- 172.21.15.5:0/216508457 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9564004380 con 0x7f95700d1850 2023-07-14T13:12:29.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.001+0000 7f9557fff640 1 -- 172.21.15.5:0/216508457 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564003820 con 0x7f95700d1850 2023-07-14T13:12:29.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.001+0000 7f9575cd8640 1 -- 172.21.15.5:0/216508457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95701516b0 con 0x7f95700d1850 2023-07-14T13:12:29.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.001+0000 7f9575cd8640 1 -- 172.21.15.5:0/216508457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f957014de10 con 0x7f95700d1850 2023-07-14T13:12:29.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.001+0000 7f9575cd8640 1 -- 172.21.15.5:0/216508457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95700678d0 con 0x7f95700d1850 2023-07-14T13:12:29.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.005+0000 7f9557fff640 1 -- 172.21.15.5:0/216508457 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f95640b2050 con 0x7f95700d1850 2023-07-14T13:12:29.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.005+0000 7f9557fff640 1 --2- 172.21.15.5:0/216508457 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f955c0663a0 0x7f955c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:29.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.005+0000 7f9557fff640 1 -- 172.21.15.5:0/216508457 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f956411db70 con 0x7f95700d1850 2023-07-14T13:12:29.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.005+0000 7f956f7fe640 1 --2- 172.21.15.5:0/216508457 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f955c0663a0 0x7f955c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:29.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.005+0000 7f956f7fe640 1 --2- 172.21.15.5:0/216508457 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f955c0663a0 0x7f955c068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f95600011f0 tx=0x7f9560009040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.009+0000 7f9557fff640 1 -- 172.21.15.5:0/216508457 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f95640eae50 con 0x7f95700d1850 2023-07-14T13:12:29.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.217+0000 7f9575cd8640 1 -- 172.21.15.5:0/216508457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f95700658a0 con 0x7f95700d1850 2023-07-14T13:12:29.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.217+0000 7f9557fff640 1 -- 172.21.15.5:0/216508457 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3232 (secure 0 0 0) 0x7f95640bbcb0 con 0x7f95700d1850 2023-07-14T13:12:29.254 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:29.254 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1208,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1689339152,"num_in_osds":8,"osd_in_since":1689339143,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":362598400,"bytes_avail":772731514880,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":65,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8808}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":13,"modified":"2023-07-14T13:12:11.576773+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-14T13:12:29.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.221+0000 7f9575cd8640 1 -- 172.21.15.5:0/216508457 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f955c0663a0 msgr2=0x7f955c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:29.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.221+0000 7f9575cd8640 1 --2- 172.21.15.5:0/216508457 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f955c0663a0 0x7f955c068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f95600011f0 tx=0x7f9560009040 comp rx=0 tx=0).stop 2023-07-14T13:12:29.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.221+0000 7f9575cd8640 1 -- 172.21.15.5:0/216508457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95700d1850 msgr2=0x7f957015d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:29.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.221+0000 7f9575cd8640 1 --2- 172.21.15.5:0/216508457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95700d1850 0x7f957015d020 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f95640097f0 tx=0x7f9564019180 comp rx=0 tx=0).stop 2023-07-14T13:12:29.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.221+0000 7f9575cd8640 1 -- 172.21.15.5:0/216508457 shutdown_connections 2023-07-14T13:12:29.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.221+0000 7f9575cd8640 1 --2- 172.21.15.5:0/216508457 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f955c0663a0 0x7f955c068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:29.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.221+0000 7f9575cd8640 1 --2- 172.21.15.5:0/216508457 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f957015fd60 0x7f9570155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.221+0000 7f9575cd8640 1 --2- 172.21.15.5:0/216508457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95700d1850 0x7f957015d020 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.221+0000 7f9575cd8640 1 --2- 172.21.15.5:0/216508457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95700b7c70 0x7f957014d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.221+0000 7f9575cd8640 1 -- 172.21.15.5:0/216508457 >> 172.21.15.5:0/216508457 conn(0x7f95700650b0 msgr2=0x7f95700b7270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.221+0000 7f9575cd8640 1 -- 172.21.15.5:0/216508457 shutdown_connections 2023-07-14T13:12:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.221+0000 7f9575cd8640 1 -- 172.21.15.5:0/216508457 wait complete. 2023-07-14T13:12:29.275 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-14T13:12:29.275 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:12:29.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.425+0000 7fc0042f9640 1 Processor -- start 2023-07-14T13:12:29.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.425+0000 7fc0042f9640 1 -- start start 2023-07-14T13:12:29.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.425+0000 7fc0042f9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbffc15f970 0x7fbffc15fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:29.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.425+0000 7fc0042f9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbffc0c8e70 0x7fbffc0c9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:29.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.425+0000 7fc0042f9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbffc160330 con 0x7fbffc15bdf0 2023-07-14T13:12:29.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.425+0000 7fc0042f9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbffc0cb080 con 0x7fbffc15f970 2023-07-14T13:12:29.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.425+0000 7fc0042f9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbffc0cb2e0 con 0x7fbffc0c8e70 2023-07-14T13:12:29.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.429+0000 7fc001894640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbffc15f970 0x7fbffc15fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:29.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.429+0000 7fc001894640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbffc15f970 0x7fbffc15fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55128/0 (socket says 172.21.15.5:55128) 2023-07-14T13:12:29.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.429+0000 7fc001894640 1 -- 172.21.15.5:0/3919131673 learned_addr learned my addr 172.21.15.5:0/3919131673 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.429+0000 7fc002896640 1 --2- 172.21.15.5:0/3919131673 >> v2:172.21.15.154:3300/0 conn(0x7fbffc0c8e70 0x7fbffc0c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.429+0000 7fc001894640 1 -- 172.21.15.5:0/3919131673 >> v2:172.21.15.154:3300/0 conn(0x7fbffc0c8e70 msgr2=0x7fbffc0c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.429+0000 7fc001894640 1 --2- 172.21.15.5:0/3919131673 >> v2:172.21.15.154:3300/0 conn(0x7fbffc0c8e70 0x7fbffc0c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.429+0000 7fc001894640 1 -- 172.21.15.5:0/3919131673 >> v1:172.21.15.5:6789/0 conn(0x7fbffc15bdf0 legacy=0x7fbffc0ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:29.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.429+0000 7fc001894640 1 -- 172.21.15.5:0/3919131673 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbffc0cb5c0 con 0x7fbffc15f970 2023-07-14T13:12:29.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.429+0000 7fc001894640 1 --2- 172.21.15.5:0/3919131673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbffc15f970 0x7fbffc15fdf0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0c51c0 tx=0x7fbfec01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ecf835fb8368b6b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:29.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.429+0000 7fc001093640 1 -- 172.21.15.5:0/3919131673 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0ab640 con 0x7fbffc15f970 2023-07-14T13:12:29.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.429+0000 7fc001093640 1 -- 172.21.15.5:0/3919131673 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfec0a7070 con 0x7fbffc15f970 2023-07-14T13:12:29.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.429+0000 7fc001093640 1 -- 172.21.15.5:0/3919131673 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0ab9c0 con 0x7fbffc15f970 2023-07-14T13:12:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.433+0000 7fc0042f9640 1 -- 172.21.15.5:0/3919131673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbffc15f970 msgr2=0x7fbffc15fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.433+0000 7fc0042f9640 1 --2- 172.21.15.5:0/3919131673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbffc15f970 0x7fbffc15fdf0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0c51c0 tx=0x7fbfec01c440 comp rx=0 tx=0).stop 2023-07-14T13:12:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.433+0000 7fc0042f9640 1 -- 172.21.15.5:0/3919131673 shutdown_connections 2023-07-14T13:12:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.433+0000 7fc0042f9640 1 --2- 172.21.15.5:0/3919131673 >> v2:172.21.15.154:3300/0 conn(0x7fbffc0c8e70 0x7fbffc0c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.433+0000 7fc0042f9640 1 --2- 172.21.15.5:0/3919131673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbffc15f970 0x7fbffc15fdf0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:29.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.433+0000 7fc0042f9640 1 -- 172.21.15.5:0/3919131673 >> 172.21.15.5:0/3919131673 conn(0x7fbffc0afcf0 msgr2=0x7fbffc0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:29.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.433+0000 7fc0042f9640 1 -- 172.21.15.5:0/3919131673 shutdown_connections 2023-07-14T13:12:29.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.433+0000 7fc0042f9640 1 -- 172.21.15.5:0/3919131673 wait complete. 2023-07-14T13:12:29.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.433+0000 7fc0042f9640 1 Processor -- start 2023-07-14T13:12:29.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.433+0000 7fc0042f9640 1 -- start start 2023-07-14T13:12:29.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.433+0000 7fc0042f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbffc0c8e70 0x7fbffc1f6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:29.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.433+0000 7fc0042f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbffc15bdf0 0x7fbffc1f3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:29.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.433+0000 7fc0042f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbffc15f970 0x7fbffc158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:29.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.433+0000 7fc0042f9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc0b29b0 con 0x7fbffc0c8e70 2023-07-14T13:12:29.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.433+0000 7fc0042f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc1f51c0 con 0x7fbffc15bdf0 2023-07-14T13:12:29.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.433+0000 7fc0042f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc1f4920 con 0x7fbffc15f970 2023-07-14T13:12:29.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.433+0000 7fc002095640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbffc0c8e70 0x7fbffc1f6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:29.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.433+0000 7fc002095640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbffc0c8e70 0x7fbffc1f6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55140/0 (socket says 172.21.15.5:55140) 2023-07-14T13:12:29.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.433+0000 7fc002095640 1 -- 172.21.15.5:0/456742604 learned_addr learned my addr 172.21.15.5:0/456742604 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:29.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.433+0000 7fc001894640 1 --2- 172.21.15.5:0/456742604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbffc15bdf0 0x7fbffc1f3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.433+0000 7fc002896640 1 --2- 172.21.15.5:0/456742604 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbffc15f970 0x7fbffc158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.433+0000 7fc002095640 1 -- 172.21.15.5:0/456742604 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbffc15f970 msgr2=0x7fbffc158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.433+0000 7fc002095640 1 --2- 172.21.15.5:0/456742604 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbffc15f970 0x7fbffc158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.433+0000 7fc002095640 1 -- 172.21.15.5:0/456742604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbffc15bdf0 msgr2=0x7fbffc1f3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.433+0000 7fc002095640 1 --2- 172.21.15.5:0/456742604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbffc15bdf0 0x7fbffc1f3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.433+0000 7fc002095640 1 -- 172.21.15.5:0/456742604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfec0094d0 con 0x7fbffc0c8e70 2023-07-14T13:12:29.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.437+0000 7fc002896640 1 --2- 172.21.15.5:0/456742604 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbffc15f970 0x7fbffc158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.437+0000 7fc001894640 1 --2- 172.21.15.5:0/456742604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbffc15bdf0 0x7fbffc1f3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.437+0000 7fc002095640 1 --2- 172.21.15.5:0/456742604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbffc0c8e70 0x7fbffc1f6ef0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fbff800c500 tx=0x7fbff800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.437+0000 7fbff2ffd640 1 -- 172.21.15.5:0/456742604 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff8005220 con 0x7fbffc0c8e70 2023-07-14T13:12:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.437+0000 7fbff2ffd640 1 -- 172.21.15.5:0/456742604 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff8005380 con 0x7fbffc0c8e70 2023-07-14T13:12:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.437+0000 7fbff2ffd640 1 -- 172.21.15.5:0/456742604 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff8007270 con 0x7fbffc0c8e70 2023-07-14T13:12:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.437+0000 7fc0042f9640 1 -- 172.21.15.5:0/456742604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbffc1f4c00 con 0x7fbffc0c8e70 2023-07-14T13:12:29.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.437+0000 7fc0042f9640 1 -- 172.21.15.5:0/456742604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbffc1f44c0 con 0x7fbffc0c8e70 2023-07-14T13:12:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.437+0000 7fc0042f9640 1 -- 172.21.15.5:0/456742604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbffc0b2710 con 0x7fbffc0c8e70 2023-07-14T13:12:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.437+0000 7fbff2ffd640 1 -- 172.21.15.5:0/456742604 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbff80073d0 con 0x7fbffc0c8e70 2023-07-14T13:12:29.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.437+0000 7fbff2ffd640 1 --2- 172.21.15.5:0/456742604 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fbfe00663a0 0x7fbfe0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:29.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.437+0000 7fbff2ffd640 1 -- 172.21.15.5:0/456742604 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fbff8083670 con 0x7fbffc0c8e70 2023-07-14T13:12:29.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.437+0000 7fc001894640 1 --2- 172.21.15.5:0/456742604 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fbfe00663a0 0x7fbfe0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:29.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.441+0000 7fc001894640 1 --2- 172.21.15.5:0/456742604 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fbfe00663a0 0x7fbfe0068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbfec0af000 tx=0x7fbfec0a7000 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:29.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.441+0000 7fbff2ffd640 1 -- 172.21.15.5:0/456742604 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fbffc0b2710 con 0x7fbffc0c8e70 2023-07-14T13:12:29.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.597+0000 7fc0042f9640 1 -- 172.21.15.5:0/456742604 --> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbffc15c1c0 con 0x7fbfe00663a0 2023-07-14T13:12:29.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.605+0000 7fbff2ffd640 1 -- 172.21.15.5:0/456742604 <== mgr.7202 v2:172.21.15.154:6832/3769132865 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311524 (secure 0 0 0) 0x7fbfec0ab6c0 con 0x7fbfe00663a0 2023-07-14T13:12:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:29.644 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:12:29.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.609+0000 7fc0042f9640 1 -- 172.21.15.5:0/456742604 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fbfe00663a0 msgr2=0x7fbfe0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:29.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.609+0000 7fc0042f9640 1 --2- 172.21.15.5:0/456742604 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fbfe00663a0 0x7fbfe0068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbfec0af000 tx=0x7fbfec0a7000 comp rx=0 tx=0).stop 2023-07-14T13:12:29.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.609+0000 7fc0042f9640 1 -- 172.21.15.5:0/456742604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbffc0c8e70 msgr2=0x7fbffc1f6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:29.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.609+0000 7fc0042f9640 1 --2- 172.21.15.5:0/456742604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbffc0c8e70 0x7fbffc1f6ef0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fbff800c500 tx=0x7fbff800c9c0 comp rx=0 tx=0).stop 2023-07-14T13:12:29.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.609+0000 7fc0042f9640 1 -- 172.21.15.5:0/456742604 shutdown_connections 2023-07-14T13:12:29.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.609+0000 7fc0042f9640 1 --2- 172.21.15.5:0/456742604 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fbfe00663a0 0x7fbfe0068850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:29.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.609+0000 7fc0042f9640 1 --2- 172.21.15.5:0/456742604 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbffc15f970 0x7fbffc158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:29.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.609+0000 7fc0042f9640 1 --2- 172.21.15.5:0/456742604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbffc15bdf0 0x7fbffc1f3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:29.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.609+0000 7fc0042f9640 1 --2- 172.21.15.5:0/456742604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbffc0c8e70 0x7fbffc1f6ef0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:29.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.609+0000 7fc0042f9640 1 -- 172.21.15.5:0/456742604 >> 172.21.15.5:0/456742604 conn(0x7fbffc0afcf0 msgr2=0x7fbffc0ae090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:29.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.609+0000 7fc0042f9640 1 -- 172.21.15.5:0/456742604 shutdown_connections 2023-07-14T13:12:29.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:29.609+0000 7fc0042f9640 1 -- 172.21.15.5:0/456742604 wait complete. 2023-07-14T13:12:29.664 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-14T13:12:29.581530+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":444,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":288,"ondisk_log_size":288,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":204,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":354368,"kb_used_data":14976,"kb_used_omap":0,"kb_used_meta":339328,"kb_avail":754620352,"statfs":{"total":773094113280,"available":772731240448,"internally_reserved":0,"allocated":15335424,"data_stored":8354694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":347471872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":58,"apply_latency_ms":58,"commit_latency_ns":58000000,"apply_latency_ns":58000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.672361"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.928688+0000","last_change":"2023-07-14T13:12:23.941215+0000","last_active":"2023-07-14T13:12:25.928688+0000","last_peered":"2023-07-14T13:12:25.928688+0000","last_clean":"2023-07-14T13:12:25.928688+0000","last_became_active":"2023-07-14T13:12:23.940959+0000","last_became_peered":"2023-07-14T13:12:23.940959+0000","last_unstale":"2023-07-14T13:12:25.928688+0000","last_undegraded":"2023-07-14T13:12:25.928688+0000","last_fullsized":"2023-07-14T13:12:25.928688+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:54:43.484272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.925163+0000","last_change":"2023-07-14T13:12:23.921986+0000","last_active":"2023-07-14T13:12:24.925163+0000","last_peered":"2023-07-14T13:12:24.925163+0000","last_clean":"2023-07-14T13:12:24.925163+0000","last_became_active":"2023-07-14T13:12:23.921698+0000","last_became_peered":"2023-07-14T13:12:23.921698+0000","last_unstale":"2023-07-14T13:12:24.925163+0000","last_undegraded":"2023-07-14T13:12:24.925163+0000","last_fullsized":"2023-07-14T13:12:24.925163+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:54:28.457899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.925686+0000","last_change":"2023-07-14T13:12:23.932855+0000","last_active":"2023-07-14T13:12:24.925686+0000","last_peered":"2023-07-14T13:12:24.925686+0000","last_clean":"2023-07-14T13:12:24.925686+0000","last_became_active":"2023-07-14T13:12:23.932099+0000","last_became_peered":"2023-07-14T13:12:23.932099+0000","last_unstale":"2023-07-14T13:12:24.925686+0000","last_undegraded":"2023-07-14T13:12:24.925686+0000","last_fullsized":"2023-07-14T13:12:24.925686+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:54:43.484272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931543+0000","last_change":"2023-07-14T13:12:23.933624+0000","last_active":"2023-07-14T13:12:24.931543+0000","last_peered":"2023-07-14T13:12:24.931543+0000","last_clean":"2023-07-14T13:12:24.931543+0000","last_became_active":"2023-07-14T13:12:23.933331+0000","last_became_peered":"2023-07-14T13:12:23.933331+0000","last_unstale":"2023-07-14T13:12:24.931543+0000","last_undegraded":"2023-07-14T13:12:24.931543+0000","last_fullsized":"2023-07-14T13:12:24.931543+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:40:16.702693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.928378+0000","last_change":"2023-07-14T13:12:23.937571+0000","last_active":"2023-07-14T13:12:25.928378+0000","last_peered":"2023-07-14T13:12:25.928378+0000","last_clean":"2023-07-14T13:12:25.928378+0000","last_became_active":"2023-07-14T13:12:23.937303+0000","last_became_peered":"2023-07-14T13:12:23.937303+0000","last_unstale":"2023-07-14T13:12:25.928378+0000","last_undegraded":"2023-07-14T13:12:25.928378+0000","last_fullsized":"2023-07-14T13:12:25.928378+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:01:09.308214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.924041+0000","last_change":"2023-07-14T13:12:23.923758+0000","last_active":"2023-07-14T13:12:25.924041+0000","last_peered":"2023-07-14T13:12:25.924041+0000","last_clean":"2023-07-14T13:12:25.924041+0000","last_became_active":"2023-07-14T13:12:23.923475+0000","last_became_peered":"2023-07-14T13:12:23.923475+0000","last_unstale":"2023-07-14T13:12:25.924041+0000","last_undegraded":"2023-07-14T13:12:25.924041+0000","last_fullsized":"2023-07-14T13:12:25.924041+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:38:42.573060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.923882+0000","last_change":"2023-07-14T13:12:23.928569+0000","last_active":"2023-07-14T13:12:25.923882+0000","last_peered":"2023-07-14T13:12:25.923882+0000","last_clean":"2023-07-14T13:12:25.923882+0000","last_became_active":"2023-07-14T13:12:23.928246+0000","last_became_peered":"2023-07-14T13:12:23.928246+0000","last_unstale":"2023-07-14T13:12:25.923882+0000","last_undegraded":"2023-07-14T13:12:25.923882+0000","last_fullsized":"2023-07-14T13:12:25.923882+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:45:33.322916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.924875+0000","last_change":"2023-07-14T13:12:23.932453+0000","last_active":"2023-07-14T13:12:24.924875+0000","last_peered":"2023-07-14T13:12:24.924875+0000","last_clean":"2023-07-14T13:12:24.924875+0000","last_became_active":"2023-07-14T13:12:23.932166+0000","last_became_peered":"2023-07-14T13:12:23.932166+0000","last_unstale":"2023-07-14T13:12:24.924875+0000","last_undegraded":"2023-07-14T13:12:24.924875+0000","last_fullsized":"2023-07-14T13:12:24.924875+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:01:48.127696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.932096+0000","last_change":"2023-07-14T13:12:23.929874+0000","last_active":"2023-07-14T13:12:24.932096+0000","last_peered":"2023-07-14T13:12:24.932096+0000","last_clean":"2023-07-14T13:12:24.932096+0000","last_became_active":"2023-07-14T13:12:23.929569+0000","last_became_peered":"2023-07-14T13:12:23.929569+0000","last_unstale":"2023-07-14T13:12:24.932096+0000","last_undegraded":"2023-07-14T13:12:24.932096+0000","last_fullsized":"2023-07-14T13:12:24.932096+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:01:36.007882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250495+0000","last_change":"2023-07-14T13:12:23.925220+0000","last_active":"2023-07-14T13:12:25.250495+0000","last_peered":"2023-07-14T13:12:25.250495+0000","last_clean":"2023-07-14T13:12:25.250495+0000","last_became_active":"2023-07-14T13:12:23.924918+0000","last_became_peered":"2023-07-14T13:12:23.924918+0000","last_unstale":"2023-07-14T13:12:25.250495+0000","last_undegraded":"2023-07-14T13:12:25.250495+0000","last_fullsized":"2023-07-14T13:12:25.250495+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:49:36.646758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.928492+0000","last_change":"2023-07-14T13:12:23.939608+0000","last_active":"2023-07-14T13:12:25.928492+0000","last_peered":"2023-07-14T13:12:25.928492+0000","last_clean":"2023-07-14T13:12:25.928492+0000","last_became_active":"2023-07-14T13:12:23.938707+0000","last_became_peered":"2023-07-14T13:12:23.938707+0000","last_unstale":"2023-07-14T13:12:25.928492+0000","last_undegraded":"2023-07-14T13:12:25.928492+0000","last_fullsized":"2023-07-14T13:12:25.928492+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:27:13.989928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.924613+0000","last_change":"2023-07-14T13:12:23.937137+0000","last_active":"2023-07-14T13:12:25.924613+0000","last_peered":"2023-07-14T13:12:25.924613+0000","last_clean":"2023-07-14T13:12:25.924613+0000","last_became_active":"2023-07-14T13:12:23.936788+0000","last_became_peered":"2023-07-14T13:12:23.936788+0000","last_unstale":"2023-07-14T13:12:25.924613+0000","last_undegraded":"2023-07-14T13:12:25.924613+0000","last_fullsized":"2023-07-14T13:12:25.924613+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:30:15.451661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250303+0000","last_change":"2023-07-14T13:12:23.928431+0000","last_active":"2023-07-14T13:12:25.250303+0000","last_peered":"2023-07-14T13:12:25.250303+0000","last_clean":"2023-07-14T13:12:25.250303+0000","last_became_active":"2023-07-14T13:12:23.928166+0000","last_became_peered":"2023-07-14T13:12:23.928166+0000","last_unstale":"2023-07-14T13:12:25.250303+0000","last_undegraded":"2023-07-14T13:12:25.250303+0000","last_fullsized":"2023-07-14T13:12:25.250303+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:12:40.802261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.925190+0000","last_change":"2023-07-14T13:12:23.935291+0000","last_active":"2023-07-14T13:12:24.925190+0000","last_peered":"2023-07-14T13:12:24.925190+0000","last_clean":"2023-07-14T13:12:24.925190+0000","last_became_active":"2023-07-14T13:12:23.933830+0000","last_became_peered":"2023-07-14T13:12:23.933830+0000","last_unstale":"2023-07-14T13:12:24.925190+0000","last_undegraded":"2023-07-14T13:12:24.925190+0000","last_fullsized":"2023-07-14T13:12:24.925190+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:37:26.540133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.928203+0000","last_change":"2023-07-14T13:12:23.940466+0000","last_active":"2023-07-14T13:12:25.928203+0000","last_peered":"2023-07-14T13:12:25.928203+0000","last_clean":"2023-07-14T13:12:25.928203+0000","last_became_active":"2023-07-14T13:12:23.940225+0000","last_became_peered":"2023-07-14T13:12:23.940225+0000","last_unstale":"2023-07-14T13:12:25.928203+0000","last_undegraded":"2023-07-14T13:12:25.928203+0000","last_fullsized":"2023-07-14T13:12:25.928203+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:07:06.136907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.923687+0000","last_change":"2023-07-14T13:12:23.926709+0000","last_active":"2023-07-14T13:12:25.923687+0000","last_peered":"2023-07-14T13:12:25.923687+0000","last_clean":"2023-07-14T13:12:25.923687+0000","last_became_active":"2023-07-14T13:12:23.926405+0000","last_became_peered":"2023-07-14T13:12:23.926405+0000","last_unstale":"2023-07-14T13:12:25.923687+0000","last_undegraded":"2023-07-14T13:12:25.923687+0000","last_fullsized":"2023-07-14T13:12:25.923687+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:46:17.252094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250605+0000","last_change":"2023-07-14T13:12:23.928245+0000","last_active":"2023-07-14T13:12:25.250605+0000","last_peered":"2023-07-14T13:12:25.250605+0000","last_clean":"2023-07-14T13:12:25.250605+0000","last_became_active":"2023-07-14T13:12:23.927941+0000","last_became_peered":"2023-07-14T13:12:23.927941+0000","last_unstale":"2023-07-14T13:12:25.250605+0000","last_undegraded":"2023-07-14T13:12:25.250605+0000","last_fullsized":"2023-07-14T13:12:25.250605+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:24:00.657088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.925232+0000","last_change":"2023-07-14T13:12:23.921930+0000","last_active":"2023-07-14T13:12:24.925232+0000","last_peered":"2023-07-14T13:12:24.925232+0000","last_clean":"2023-07-14T13:12:24.925232+0000","last_became_active":"2023-07-14T13:12:23.921641+0000","last_became_peered":"2023-07-14T13:12:23.921641+0000","last_unstale":"2023-07-14T13:12:24.925232+0000","last_undegraded":"2023-07-14T13:12:24.925232+0000","last_fullsized":"2023-07-14T13:12:24.925232+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:07:06.136907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.113350+0000","last_change":"2023-07-14T13:12:23.933175+0000","last_active":"2023-07-14T13:12:25.113350+0000","last_peered":"2023-07-14T13:12:25.113350+0000","last_clean":"2023-07-14T13:12:25.113350+0000","last_became_active":"2023-07-14T13:12:23.932908+0000","last_became_peered":"2023-07-14T13:12:23.932908+0000","last_unstale":"2023-07-14T13:12:25.113350+0000","last_undegraded":"2023-07-14T13:12:25.113350+0000","last_fullsized":"2023-07-14T13:12:25.113350+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:49:41.138683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.341484+0000","last_change":"2023-07-14T13:12:23.927375+0000","last_active":"2023-07-14T13:12:25.341484+0000","last_peered":"2023-07-14T13:12:25.341484+0000","last_clean":"2023-07-14T13:12:25.341484+0000","last_became_active":"2023-07-14T13:12:23.927060+0000","last_became_peered":"2023-07-14T13:12:23.927060+0000","last_unstale":"2023-07-14T13:12:25.341484+0000","last_undegraded":"2023-07-14T13:12:25.341484+0000","last_fullsized":"2023-07-14T13:12:25.341484+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:52:36.818258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931649+0000","last_change":"2023-07-14T13:12:23.929152+0000","last_active":"2023-07-14T13:12:24.931649+0000","last_peered":"2023-07-14T13:12:24.931649+0000","last_clean":"2023-07-14T13:12:24.931649+0000","last_became_active":"2023-07-14T13:12:23.928564+0000","last_became_peered":"2023-07-14T13:12:23.928564+0000","last_unstale":"2023-07-14T13:12:24.931649+0000","last_undegraded":"2023-07-14T13:12:24.931649+0000","last_fullsized":"2023-07-14T13:12:24.931649+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:39:46.478174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.928471+0000","last_change":"2023-07-14T13:12:23.946607+0000","last_active":"2023-07-14T13:12:25.928471+0000","last_peered":"2023-07-14T13:12:25.928471+0000","last_clean":"2023-07-14T13:12:25.928471+0000","last_became_active":"2023-07-14T13:12:23.946319+0000","last_became_peered":"2023-07-14T13:12:23.946319+0000","last_unstale":"2023-07-14T13:12:25.928471+0000","last_undegraded":"2023-07-14T13:12:25.928471+0000","last_fullsized":"2023-07-14T13:12:25.928471+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:00:49.629574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931430+0000","last_change":"2023-07-14T13:12:23.930471+0000","last_active":"2023-07-14T13:12:24.931430+0000","last_peered":"2023-07-14T13:12:24.931430+0000","last_clean":"2023-07-14T13:12:24.931430+0000","last_became_active":"2023-07-14T13:12:23.930174+0000","last_became_peered":"2023-07-14T13:12:23.930174+0000","last_unstale":"2023-07-14T13:12:24.931430+0000","last_undegraded":"2023-07-14T13:12:24.931430+0000","last_fullsized":"2023-07-14T13:12:24.931430+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:46:32.685769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.654990+0000","last_change":"2023-07-14T13:12:23.937925+0000","last_active":"2023-07-14T13:12:25.654990+0000","last_peered":"2023-07-14T13:12:25.654990+0000","last_clean":"2023-07-14T13:12:25.654990+0000","last_became_active":"2023-07-14T13:12:23.937459+0000","last_became_peered":"2023-07-14T13:12:23.937459+0000","last_unstale":"2023-07-14T13:12:25.654990+0000","last_undegraded":"2023-07-14T13:12:25.654990+0000","last_fullsized":"2023-07-14T13:12:25.654990+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:16:54.746314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655643+0000","last_change":"2023-07-14T13:12:23.940698+0000","last_active":"2023-07-14T13:12:25.655643+0000","last_peered":"2023-07-14T13:12:25.655643+0000","last_clean":"2023-07-14T13:12:25.655643+0000","last_became_active":"2023-07-14T13:12:23.940425+0000","last_became_peered":"2023-07-14T13:12:23.940425+0000","last_unstale":"2023-07-14T13:12:25.655643+0000","last_undegraded":"2023-07-14T13:12:25.655643+0000","last_fullsized":"2023-07-14T13:12:25.655643+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:00:48.445424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.341576+0000","last_change":"2023-07-14T13:12:23.927243+0000","last_active":"2023-07-14T13:12:25.341576+0000","last_peered":"2023-07-14T13:12:25.341576+0000","last_clean":"2023-07-14T13:12:25.341576+0000","last_became_active":"2023-07-14T13:12:23.926378+0000","last_became_peered":"2023-07-14T13:12:23.926378+0000","last_unstale":"2023-07-14T13:12:25.341576+0000","last_undegraded":"2023-07-14T13:12:25.341576+0000","last_fullsized":"2023-07-14T13:12:25.341576+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:09:12.003092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.113413+0000","last_change":"2023-07-14T13:12:23.933116+0000","last_active":"2023-07-14T13:12:25.113413+0000","last_peered":"2023-07-14T13:12:25.113413+0000","last_clean":"2023-07-14T13:12:25.113413+0000","last_became_active":"2023-07-14T13:12:23.932605+0000","last_became_peered":"2023-07-14T13:12:23.932605+0000","last_unstale":"2023-07-14T13:12:25.113413+0000","last_undegraded":"2023-07-14T13:12:25.113413+0000","last_fullsized":"2023-07-14T13:12:25.113413+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:48:09.500323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.924601+0000","last_change":"2023-07-14T13:12:23.926165+0000","last_active":"2023-07-14T13:12:25.924601+0000","last_peered":"2023-07-14T13:12:25.924601+0000","last_clean":"2023-07-14T13:12:25.924601+0000","last_became_active":"2023-07-14T13:12:23.925669+0000","last_became_peered":"2023-07-14T13:12:23.925669+0000","last_unstale":"2023-07-14T13:12:25.924601+0000","last_undegraded":"2023-07-14T13:12:25.924601+0000","last_fullsized":"2023-07-14T13:12:25.924601+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:18:47.512349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.341560+0000","last_change":"2023-07-14T13:12:23.918366+0000","last_active":"2023-07-14T13:12:25.341560+0000","last_peered":"2023-07-14T13:12:25.341560+0000","last_clean":"2023-07-14T13:12:25.341560+0000","last_became_active":"2023-07-14T13:12:23.918041+0000","last_became_peered":"2023-07-14T13:12:23.918041+0000","last_unstale":"2023-07-14T13:12:25.341560+0000","last_undegraded":"2023-07-14T13:12:25.341560+0000","last_fullsized":"2023-07-14T13:12:25.341560+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:26:51.452370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.925329+0000","last_change":"2023-07-14T13:12:23.934870+0000","last_active":"2023-07-14T13:12:24.925329+0000","last_peered":"2023-07-14T13:12:24.925329+0000","last_clean":"2023-07-14T13:12:24.925329+0000","last_became_active":"2023-07-14T13:12:23.933072+0000","last_became_peered":"2023-07-14T13:12:23.933072+0000","last_unstale":"2023-07-14T13:12:24.925329+0000","last_undegraded":"2023-07-14T13:12:24.925329+0000","last_fullsized":"2023-07-14T13:12:24.925329+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:00:49.629574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655220+0000","last_change":"2023-07-14T13:12:23.930126+0000","last_active":"2023-07-14T13:12:25.655220+0000","last_peered":"2023-07-14T13:12:25.655220+0000","last_clean":"2023-07-14T13:12:25.655220+0000","last_became_active":"2023-07-14T13:12:23.929790+0000","last_became_peered":"2023-07-14T13:12:23.929790+0000","last_unstale":"2023-07-14T13:12:25.655220+0000","last_undegraded":"2023-07-14T13:12:25.655220+0000","last_fullsized":"2023-07-14T13:12:25.655220+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:39:59.100500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655019+0000","last_change":"2023-07-14T13:12:23.937727+0000","last_active":"2023-07-14T13:12:25.655019+0000","last_peered":"2023-07-14T13:12:25.655019+0000","last_clean":"2023-07-14T13:12:25.655019+0000","last_became_active":"2023-07-14T13:12:23.937079+0000","last_became_peered":"2023-07-14T13:12:23.937079+0000","last_unstale":"2023-07-14T13:12:25.655019+0000","last_undegraded":"2023-07-14T13:12:25.655019+0000","last_fullsized":"2023-07-14T13:12:25.655019+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:16:39.230296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250512+0000","last_change":"2023-07-14T13:12:23.929978+0000","last_active":"2023-07-14T13:12:25.250512+0000","last_peered":"2023-07-14T13:12:25.250512+0000","last_clean":"2023-07-14T13:12:25.250512+0000","last_became_active":"2023-07-14T13:12:23.929692+0000","last_became_peered":"2023-07-14T13:12:23.929692+0000","last_unstale":"2023-07-14T13:12:25.250512+0000","last_undegraded":"2023-07-14T13:12:25.250512+0000","last_fullsized":"2023-07-14T13:12:25.250512+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:37:52.836371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"141'4","reported_seq":17,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.113169+0000","last_change":"2023-07-14T13:12:22.932726+0000","last_active":"2023-07-14T13:12:25.113169+0000","last_peered":"2023-07-14T13:12:25.113169+0000","last_clean":"2023-07-14T13:12:25.113169+0000","last_became_active":"2023-07-14T13:12:22.932398+0000","last_became_peered":"2023-07-14T13:12:22.932398+0000","last_unstale":"2023-07-14T13:12:25.113169+0000","last_undegraded":"2023-07-14T13:12:25.113169+0000","last_fullsized":"2023-07-14T13:12:25.113169+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:41:02.972781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.924348+0000","last_change":"2023-07-14T13:12:23.923432+0000","last_active":"2023-07-14T13:12:25.924348+0000","last_peered":"2023-07-14T13:12:25.924348+0000","last_clean":"2023-07-14T13:12:25.924348+0000","last_became_active":"2023-07-14T13:12:23.923121+0000","last_became_peered":"2023-07-14T13:12:23.923121+0000","last_unstale":"2023-07-14T13:12:25.924348+0000","last_undegraded":"2023-07-14T13:12:25.924348+0000","last_fullsized":"2023-07-14T13:12:25.924348+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:59:10.857348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"141'1","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250606+0000","last_change":"2023-07-14T13:12:22.920816+0000","last_active":"2023-07-14T13:12:25.250606+0000","last_peered":"2023-07-14T13:12:25.250606+0000","last_clean":"2023-07-14T13:12:25.250606+0000","last_became_active":"2023-07-14T13:12:22.918830+0000","last_became_peered":"2023-07-14T13:12:22.918830+0000","last_unstale":"2023-07-14T13:12:25.250606+0000","last_undegraded":"2023-07-14T13:12:25.250606+0000","last_fullsized":"2023-07-14T13:12:25.250606+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:51:49.189062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655335+0000","last_change":"2023-07-14T13:12:23.930140+0000","last_active":"2023-07-14T13:12:25.655335+0000","last_peered":"2023-07-14T13:12:25.655335+0000","last_clean":"2023-07-14T13:12:25.655335+0000","last_became_active":"2023-07-14T13:12:23.929864+0000","last_became_peered":"2023-07-14T13:12:23.929864+0000","last_unstale":"2023-07-14T13:12:25.655335+0000","last_undegraded":"2023-07-14T13:12:25.655335+0000","last_fullsized":"2023-07-14T13:12:25.655335+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:10:45.565912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"141'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931928+0000","last_change":"2023-07-14T13:12:22.929668+0000","last_active":"2023-07-14T13:12:24.931928+0000","last_peered":"2023-07-14T13:12:24.931928+0000","last_clean":"2023-07-14T13:12:24.931928+0000","last_became_active":"2023-07-14T13:12:22.929296+0000","last_became_peered":"2023-07-14T13:12:22.929296+0000","last_unstale":"2023-07-14T13:12:24.931928+0000","last_undegraded":"2023-07-14T13:12:24.931928+0000","last_fullsized":"2023-07-14T13:12:24.931928+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:40:13.285925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.932170+0000","last_change":"2023-07-14T13:12:23.927807+0000","last_active":"2023-07-14T13:12:24.932170+0000","last_peered":"2023-07-14T13:12:24.932170+0000","last_clean":"2023-07-14T13:12:24.932170+0000","last_became_active":"2023-07-14T13:12:23.927531+0000","last_became_peered":"2023-07-14T13:12:23.927531+0000","last_unstale":"2023-07-14T13:12:24.932170+0000","last_undegraded":"2023-07-14T13:12:24.932170+0000","last_fullsized":"2023-07-14T13:12:24.932170+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:33:25.146342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"141'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250628+0000","last_change":"2023-07-14T13:12:22.923046+0000","last_active":"2023-07-14T13:12:25.250628+0000","last_peered":"2023-07-14T13:12:25.250628+0000","last_clean":"2023-07-14T13:12:25.250628+0000","last_became_active":"2023-07-14T13:12:22.922783+0000","last_became_peered":"2023-07-14T13:12:22.922783+0000","last_unstale":"2023-07-14T13:12:25.250628+0000","last_undegraded":"2023-07-14T13:12:25.250628+0000","last_fullsized":"2023-07-14T13:12:25.250628+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:11:10.940211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250752+0000","last_change":"2023-07-14T13:12:23.932084+0000","last_active":"2023-07-14T13:12:25.250752+0000","last_peered":"2023-07-14T13:12:25.250752+0000","last_clean":"2023-07-14T13:12:25.250752+0000","last_became_active":"2023-07-14T13:12:23.931757+0000","last_became_peered":"2023-07-14T13:12:23.931757+0000","last_unstale":"2023-07-14T13:12:25.250752+0000","last_undegraded":"2023-07-14T13:12:25.250752+0000","last_fullsized":"2023-07-14T13:12:25.250752+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:16:15.801648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"141'1","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.928303+0000","last_change":"2023-07-14T13:12:22.932158+0000","last_active":"2023-07-14T13:12:25.928303+0000","last_peered":"2023-07-14T13:12:25.928303+0000","last_clean":"2023-07-14T13:12:25.928303+0000","last_became_active":"2023-07-14T13:12:22.931753+0000","last_became_peered":"2023-07-14T13:12:22.931753+0000","last_unstale":"2023-07-14T13:12:25.928303+0000","last_undegraded":"2023-07-14T13:12:25.928303+0000","last_fullsized":"2023-07-14T13:12:25.928303+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:05:51.061780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.928189+0000","last_change":"2023-07-14T13:12:23.932362+0000","last_active":"2023-07-14T13:12:25.928189+0000","last_peered":"2023-07-14T13:12:25.928189+0000","last_clean":"2023-07-14T13:12:25.928189+0000","last_became_active":"2023-07-14T13:12:23.932038+0000","last_became_peered":"2023-07-14T13:12:23.932038+0000","last_unstale":"2023-07-14T13:12:25.928189+0000","last_undegraded":"2023-07-14T13:12:25.928189+0000","last_fullsized":"2023-07-14T13:12:25.928189+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:37:26.540133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"141'1","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.923972+0000","last_change":"2023-07-14T13:12:22.923614+0000","last_active":"2023-07-14T13:12:25.923972+0000","last_peered":"2023-07-14T13:12:25.923972+0000","last_clean":"2023-07-14T13:12:25.923972+0000","last_became_active":"2023-07-14T13:12:22.923312+0000","last_became_peered":"2023-07-14T13:12:22.923312+0000","last_unstale":"2023-07-14T13:12:25.923972+0000","last_undegraded":"2023-07-14T13:12:25.923972+0000","last_fullsized":"2023-07-14T13:12:25.923972+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:31:35.766939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.925456+0000","last_change":"2023-07-14T13:12:23.929136+0000","last_active":"2023-07-14T13:12:24.925456+0000","last_peered":"2023-07-14T13:12:24.925456+0000","last_clean":"2023-07-14T13:12:24.925456+0000","last_became_active":"2023-07-14T13:12:23.928854+0000","last_became_peered":"2023-07-14T13:12:23.928854+0000","last_unstale":"2023-07-14T13:12:24.925456+0000","last_undegraded":"2023-07-14T13:12:24.925456+0000","last_fullsized":"2023-07-14T13:12:24.925456+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:27:00.710016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655274+0000","last_change":"2023-07-14T13:12:22.923307+0000","last_active":"2023-07-14T13:12:25.655274+0000","last_peered":"2023-07-14T13:12:25.655274+0000","last_clean":"2023-07-14T13:12:25.655274+0000","last_became_active":"2023-07-14T13:12:22.922942+0000","last_became_peered":"2023-07-14T13:12:22.922942+0000","last_unstale":"2023-07-14T13:12:25.655274+0000","last_undegraded":"2023-07-14T13:12:25.655274+0000","last_fullsized":"2023-07-14T13:12:25.655274+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:58:17.174165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250541+0000","last_change":"2023-07-14T13:12:23.935370+0000","last_active":"2023-07-14T13:12:25.250541+0000","last_peered":"2023-07-14T13:12:25.250541+0000","last_clean":"2023-07-14T13:12:25.250541+0000","last_became_active":"2023-07-14T13:12:23.935100+0000","last_became_peered":"2023-07-14T13:12:23.935100+0000","last_unstale":"2023-07-14T13:12:25.250541+0000","last_undegraded":"2023-07-14T13:12:25.250541+0000","last_fullsized":"2023-07-14T13:12:25.250541+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:18:08.262248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.923957+0000","last_change":"2023-07-14T13:12:22.924153+0000","last_active":"2023-07-14T13:12:25.923957+0000","last_peered":"2023-07-14T13:12:25.923957+0000","last_clean":"2023-07-14T13:12:25.923957+0000","last_became_active":"2023-07-14T13:12:22.923877+0000","last_became_peered":"2023-07-14T13:12:22.923877+0000","last_unstale":"2023-07-14T13:12:25.923957+0000","last_undegraded":"2023-07-14T13:12:25.923957+0000","last_fullsized":"2023-07-14T13:12:25.923957+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:51:11.092588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655494+0000","last_change":"2023-07-14T13:12:23.932778+0000","last_active":"2023-07-14T13:12:25.655494+0000","last_peered":"2023-07-14T13:12:25.655494+0000","last_clean":"2023-07-14T13:12:25.655494+0000","last_became_active":"2023-07-14T13:12:23.932481+0000","last_became_peered":"2023-07-14T13:12:23.932481+0000","last_unstale":"2023-07-14T13:12:25.655494+0000","last_undegraded":"2023-07-14T13:12:25.655494+0000","last_fullsized":"2023-07-14T13:12:25.655494+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:36:15.509679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"141'1","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250652+0000","last_change":"2023-07-14T13:12:22.920785+0000","last_active":"2023-07-14T13:12:25.250652+0000","last_peered":"2023-07-14T13:12:25.250652+0000","last_clean":"2023-07-14T13:12:25.250652+0000","last_became_active":"2023-07-14T13:12:22.920453+0000","last_became_peered":"2023-07-14T13:12:22.920453+0000","last_unstale":"2023-07-14T13:12:25.250652+0000","last_undegraded":"2023-07-14T13:12:25.250652+0000","last_fullsized":"2023-07-14T13:12:25.250652+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:52:34.516167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.928723+0000","last_change":"2023-07-14T13:12:23.950444+0000","last_active":"2023-07-14T13:12:25.928723+0000","last_peered":"2023-07-14T13:12:25.928723+0000","last_clean":"2023-07-14T13:12:25.928723+0000","last_became_active":"2023-07-14T13:12:23.950150+0000","last_became_peered":"2023-07-14T13:12:23.950150+0000","last_unstale":"2023-07-14T13:12:25.928723+0000","last_undegraded":"2023-07-14T13:12:25.928723+0000","last_fullsized":"2023-07-14T13:12:25.928723+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:21:38.629053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"141'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.341669+0000","last_change":"2023-07-14T13:12:22.922475+0000","last_active":"2023-07-14T13:12:25.341669+0000","last_peered":"2023-07-14T13:12:25.341669+0000","last_clean":"2023-07-14T13:12:25.341669+0000","last_became_active":"2023-07-14T13:12:22.922174+0000","last_became_peered":"2023-07-14T13:12:22.922174+0000","last_unstale":"2023-07-14T13:12:25.341669+0000","last_undegraded":"2023-07-14T13:12:25.341669+0000","last_fullsized":"2023-07-14T13:12:25.341669+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:38:19.926755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.924696+0000","last_change":"2023-07-14T13:12:23.934309+0000","last_active":"2023-07-14T13:12:25.924696+0000","last_peered":"2023-07-14T13:12:25.924696+0000","last_clean":"2023-07-14T13:12:25.924696+0000","last_became_active":"2023-07-14T13:12:23.933997+0000","last_became_peered":"2023-07-14T13:12:23.933997+0000","last_unstale":"2023-07-14T13:12:25.924696+0000","last_undegraded":"2023-07-14T13:12:25.924696+0000","last_fullsized":"2023-07-14T13:12:25.924696+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:56:42.302251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"141'1","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931939+0000","last_change":"2023-07-14T13:12:22.929389+0000","last_active":"2023-07-14T13:12:24.931939+0000","last_peered":"2023-07-14T13:12:24.931939+0000","last_clean":"2023-07-14T13:12:24.931939+0000","last_became_active":"2023-07-14T13:12:22.929005+0000","last_became_peered":"2023-07-14T13:12:22.929005+0000","last_unstale":"2023-07-14T13:12:24.931939+0000","last_undegraded":"2023-07-14T13:12:24.931939+0000","last_fullsized":"2023-07-14T13:12:24.931939+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:43:42.158206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655797+0000","last_change":"2023-07-14T13:12:23.931550+0000","last_active":"2023-07-14T13:12:25.655797+0000","last_peered":"2023-07-14T13:12:25.655797+0000","last_clean":"2023-07-14T13:12:25.655797+0000","last_became_active":"2023-07-14T13:12:23.931271+0000","last_became_peered":"2023-07-14T13:12:23.931271+0000","last_unstale":"2023-07-14T13:12:25.655797+0000","last_undegraded":"2023-07-14T13:12:25.655797+0000","last_fullsized":"2023-07-14T13:12:25.655797+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:55:55.449018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931707+0000","last_change":"2023-07-14T13:12:22.929144+0000","last_active":"2023-07-14T13:12:24.931707+0000","last_peered":"2023-07-14T13:12:24.931707+0000","last_clean":"2023-07-14T13:12:24.931707+0000","last_became_active":"2023-07-14T13:12:22.928845+0000","last_became_peered":"2023-07-14T13:12:22.928845+0000","last_unstale":"2023-07-14T13:12:24.931707+0000","last_undegraded":"2023-07-14T13:12:24.931707+0000","last_fullsized":"2023-07-14T13:12:24.931707+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:15:34.928835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.923688+0000","last_change":"2023-07-14T13:12:23.934325+0000","last_active":"2023-07-14T13:12:25.923688+0000","last_peered":"2023-07-14T13:12:25.923688+0000","last_clean":"2023-07-14T13:12:25.923688+0000","last_became_active":"2023-07-14T13:12:23.933972+0000","last_became_peered":"2023-07-14T13:12:23.933972+0000","last_unstale":"2023-07-14T13:12:25.923688+0000","last_undegraded":"2023-07-14T13:12:25.923688+0000","last_fullsized":"2023-07-14T13:12:25.923688+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:55:48.173796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"141'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.924096+0000","last_change":"2023-07-14T13:12:22.929261+0000","last_active":"2023-07-14T13:12:25.924096+0000","last_peered":"2023-07-14T13:12:25.924096+0000","last_clean":"2023-07-14T13:12:25.924096+0000","last_became_active":"2023-07-14T13:12:22.928961+0000","last_became_peered":"2023-07-14T13:12:22.928961+0000","last_unstale":"2023-07-14T13:12:25.924096+0000","last_undegraded":"2023-07-14T13:12:25.924096+0000","last_fullsized":"2023-07-14T13:12:25.924096+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:25:09.165376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.924892+0000","last_change":"2023-07-14T13:12:23.926403+0000","last_active":"2023-07-14T13:12:24.924892+0000","last_peered":"2023-07-14T13:12:24.924892+0000","last_clean":"2023-07-14T13:12:24.924892+0000","last_became_active":"2023-07-14T13:12:23.926116+0000","last_became_peered":"2023-07-14T13:12:23.926116+0000","last_unstale":"2023-07-14T13:12:24.924892+0000","last_undegraded":"2023-07-14T13:12:24.924892+0000","last_fullsized":"2023-07-14T13:12:24.924892+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:32:20.873209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931419+0000","last_change":"2023-07-14T13:12:22.931434+0000","last_active":"2023-07-14T13:12:24.931419+0000","last_peered":"2023-07-14T13:12:24.931419+0000","last_clean":"2023-07-14T13:12:24.931419+0000","last_became_active":"2023-07-14T13:12:22.931004+0000","last_became_peered":"2023-07-14T13:12:22.931004+0000","last_unstale":"2023-07-14T13:12:24.931419+0000","last_undegraded":"2023-07-14T13:12:24.931419+0000","last_fullsized":"2023-07-14T13:12:24.931419+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:19:51.969743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.925678+0000","last_change":"2023-07-14T13:12:23.935109+0000","last_active":"2023-07-14T13:12:24.925678+0000","last_peered":"2023-07-14T13:12:24.925678+0000","last_clean":"2023-07-14T13:12:24.925678+0000","last_became_active":"2023-07-14T13:12:23.933488+0000","last_became_peered":"2023-07-14T13:12:23.933488+0000","last_unstale":"2023-07-14T13:12:24.925678+0000","last_undegraded":"2023-07-14T13:12:24.925678+0000","last_fullsized":"2023-07-14T13:12:24.925678+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:11:53.094678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.925082+0000","last_change":"2023-07-14T13:12:22.928525+0000","last_active":"2023-07-14T13:12:24.925082+0000","last_peered":"2023-07-14T13:12:24.925082+0000","last_clean":"2023-07-14T13:12:24.925082+0000","last_became_active":"2023-07-14T13:12:22.928254+0000","last_became_peered":"2023-07-14T13:12:22.928254+0000","last_unstale":"2023-07-14T13:12:24.925082+0000","last_undegraded":"2023-07-14T13:12:24.925082+0000","last_fullsized":"2023-07-14T13:12:24.925082+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:16:13.047280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655319+0000","last_change":"2023-07-14T13:12:23.931496+0000","last_active":"2023-07-14T13:12:25.655319+0000","last_peered":"2023-07-14T13:12:25.655319+0000","last_clean":"2023-07-14T13:12:25.655319+0000","last_became_active":"2023-07-14T13:12:23.930916+0000","last_became_peered":"2023-07-14T13:12:23.930916+0000","last_unstale":"2023-07-14T13:12:25.655319+0000","last_undegraded":"2023-07-14T13:12:25.655319+0000","last_fullsized":"2023-07-14T13:12:25.655319+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:59.482026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931136+0000","last_change":"2023-07-14T13:12:22.926412+0000","last_active":"2023-07-14T13:12:24.931136+0000","last_peered":"2023-07-14T13:12:24.931136+0000","last_clean":"2023-07-14T13:12:24.931136+0000","last_became_active":"2023-07-14T13:12:22.925771+0000","last_became_peered":"2023-07-14T13:12:22.925771+0000","last_unstale":"2023-07-14T13:12:24.931136+0000","last_undegraded":"2023-07-14T13:12:24.931136+0000","last_fullsized":"2023-07-14T13:12:24.931136+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:44:32.003609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.924776+0000","last_change":"2023-07-14T13:12:23.928742+0000","last_active":"2023-07-14T13:12:25.924776+0000","last_peered":"2023-07-14T13:12:25.924776+0000","last_clean":"2023-07-14T13:12:25.924776+0000","last_became_active":"2023-07-14T13:12:23.928212+0000","last_became_peered":"2023-07-14T13:12:23.928212+0000","last_unstale":"2023-07-14T13:12:25.924776+0000","last_undegraded":"2023-07-14T13:12:25.924776+0000","last_fullsized":"2023-07-14T13:12:25.924776+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:21:19.029532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"141'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.924687+0000","last_change":"2023-07-14T13:12:22.927390+0000","last_active":"2023-07-14T13:12:25.924687+0000","last_peered":"2023-07-14T13:12:25.924687+0000","last_clean":"2023-07-14T13:12:25.924687+0000","last_became_active":"2023-07-14T13:12:22.927081+0000","last_became_peered":"2023-07-14T13:12:22.927081+0000","last_unstale":"2023-07-14T13:12:25.924687+0000","last_undegraded":"2023-07-14T13:12:25.924687+0000","last_fullsized":"2023-07-14T13:12:25.924687+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:03:44.145468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250463+0000","last_change":"2023-07-14T13:12:23.932309+0000","last_active":"2023-07-14T13:12:25.250463+0000","last_peered":"2023-07-14T13:12:25.250463+0000","last_clean":"2023-07-14T13:12:25.250463+0000","last_became_active":"2023-07-14T13:12:23.931410+0000","last_became_peered":"2023-07-14T13:12:23.931410+0000","last_unstale":"2023-07-14T13:12:25.250463+0000","last_undegraded":"2023-07-14T13:12:25.250463+0000","last_fullsized":"2023-07-14T13:12:25.250463+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:43:09.357995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"142'1","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.113137+0000","last_change":"2023-07-14T13:12:22.927740+0000","last_active":"2023-07-14T13:12:25.113137+0000","last_peered":"2023-07-14T13:12:25.113137+0000","last_clean":"2023-07-14T13:12:25.113137+0000","last_became_active":"2023-07-14T13:12:22.927419+0000","last_became_peered":"2023-07-14T13:12:22.927419+0000","last_unstale":"2023-07-14T13:12:25.113137+0000","last_undegraded":"2023-07-14T13:12:25.113137+0000","last_fullsized":"2023-07-14T13:12:25.113137+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:44:44.418690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931944+0000","last_change":"2023-07-14T13:12:23.939638+0000","last_active":"2023-07-14T13:12:24.931944+0000","last_peered":"2023-07-14T13:12:24.931944+0000","last_clean":"2023-07-14T13:12:24.931944+0000","last_became_active":"2023-07-14T13:12:23.939315+0000","last_became_peered":"2023-07-14T13:12:23.939315+0000","last_unstale":"2023-07-14T13:12:24.931944+0000","last_undegraded":"2023-07-14T13:12:24.931944+0000","last_fullsized":"2023-07-14T13:12:24.931944+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:12:12.984128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.113539+0000","last_change":"2023-07-14T13:12:22.926828+0000","last_active":"2023-07-14T13:12:25.113539+0000","last_peered":"2023-07-14T13:12:25.113539+0000","last_clean":"2023-07-14T13:12:25.113539+0000","last_became_active":"2023-07-14T13:12:22.926532+0000","last_became_peered":"2023-07-14T13:12:22.926532+0000","last_unstale":"2023-07-14T13:12:25.113539+0000","last_undegraded":"2023-07-14T13:12:25.113539+0000","last_fullsized":"2023-07-14T13:12:25.113539+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:58:56.924154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.341686+0000","last_change":"2023-07-14T13:12:23.927050+0000","last_active":"2023-07-14T13:12:25.341686+0000","last_peered":"2023-07-14T13:12:25.341686+0000","last_clean":"2023-07-14T13:12:25.341686+0000","last_became_active":"2023-07-14T13:12:23.926748+0000","last_became_peered":"2023-07-14T13:12:23.926748+0000","last_unstale":"2023-07-14T13:12:25.341686+0000","last_undegraded":"2023-07-14T13:12:25.341686+0000","last_fullsized":"2023-07-14T13:12:25.341686+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:57:22.046312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.924823+0000","last_change":"2023-07-14T13:12:22.928393+0000","last_active":"2023-07-14T13:12:25.924823+0000","last_peered":"2023-07-14T13:12:25.924823+0000","last_clean":"2023-07-14T13:12:25.924823+0000","last_became_active":"2023-07-14T13:12:22.928069+0000","last_became_peered":"2023-07-14T13:12:22.928069+0000","last_unstale":"2023-07-14T13:12:25.924823+0000","last_undegraded":"2023-07-14T13:12:25.924823+0000","last_fullsized":"2023-07-14T13:12:25.924823+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:23:40.303722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.923872+0000","last_change":"2023-07-14T13:12:23.930024+0000","last_active":"2023-07-14T13:12:25.923872+0000","last_peered":"2023-07-14T13:12:25.923872+0000","last_clean":"2023-07-14T13:12:25.923872+0000","last_became_active":"2023-07-14T13:12:23.929662+0000","last_became_peered":"2023-07-14T13:12:23.929662+0000","last_unstale":"2023-07-14T13:12:25.923872+0000","last_undegraded":"2023-07-14T13:12:25.923872+0000","last_fullsized":"2023-07-14T13:12:25.923872+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:34.817667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.928474+0000","last_change":"2023-07-14T13:12:22.926375+0000","last_active":"2023-07-14T13:12:25.928474+0000","last_peered":"2023-07-14T13:12:25.928474+0000","last_clean":"2023-07-14T13:12:25.928474+0000","last_became_active":"2023-07-14T13:12:22.926097+0000","last_became_peered":"2023-07-14T13:12:22.926097+0000","last_unstale":"2023-07-14T13:12:25.928474+0000","last_undegraded":"2023-07-14T13:12:25.928474+0000","last_fullsized":"2023-07-14T13:12:25.928474+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:26:59.700388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.924958+0000","last_change":"2023-07-14T13:12:23.932543+0000","last_active":"2023-07-14T13:12:24.924958+0000","last_peered":"2023-07-14T13:12:24.924958+0000","last_clean":"2023-07-14T13:12:24.924958+0000","last_became_active":"2023-07-14T13:12:23.932099+0000","last_became_peered":"2023-07-14T13:12:23.932099+0000","last_unstale":"2023-07-14T13:12:24.924958+0000","last_undegraded":"2023-07-14T13:12:24.924958+0000","last_fullsized":"2023-07-14T13:12:24.924958+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:25:49.842307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.928641+0000","last_change":"2023-07-14T13:12:22.928830+0000","last_active":"2023-07-14T13:12:25.928641+0000","last_peered":"2023-07-14T13:12:25.928641+0000","last_clean":"2023-07-14T13:12:25.928641+0000","last_became_active":"2023-07-14T13:12:22.928458+0000","last_became_peered":"2023-07-14T13:12:22.928458+0000","last_unstale":"2023-07-14T13:12:25.928641+0000","last_undegraded":"2023-07-14T13:12:25.928641+0000","last_fullsized":"2023-07-14T13:12:25.928641+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:11:52.085049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931309+0000","last_change":"2023-07-14T13:12:23.934915+0000","last_active":"2023-07-14T13:12:24.931309+0000","last_peered":"2023-07-14T13:12:24.931309+0000","last_clean":"2023-07-14T13:12:24.931309+0000","last_became_active":"2023-07-14T13:12:23.934602+0000","last_became_peered":"2023-07-14T13:12:23.934602+0000","last_unstale":"2023-07-14T13:12:24.931309+0000","last_undegraded":"2023-07-14T13:12:24.931309+0000","last_fullsized":"2023-07-14T13:12:24.931309+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:59:04.140295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.923948+0000","last_change":"2023-07-14T13:12:22.924885+0000","last_active":"2023-07-14T13:12:25.923948+0000","last_peered":"2023-07-14T13:12:25.923948+0000","last_clean":"2023-07-14T13:12:25.923948+0000","last_became_active":"2023-07-14T13:12:22.924441+0000","last_became_peered":"2023-07-14T13:12:22.924441+0000","last_unstale":"2023-07-14T13:12:25.923948+0000","last_undegraded":"2023-07-14T13:12:25.923948+0000","last_fullsized":"2023-07-14T13:12:25.923948+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:48:51.510190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250476+0000","last_change":"2023-07-14T13:12:23.921136+0000","last_active":"2023-07-14T13:12:25.250476+0000","last_peered":"2023-07-14T13:12:25.250476+0000","last_clean":"2023-07-14T13:12:25.250476+0000","last_became_active":"2023-07-14T13:12:23.920857+0000","last_became_peered":"2023-07-14T13:12:23.920857+0000","last_unstale":"2023-07-14T13:12:25.250476+0000","last_undegraded":"2023-07-14T13:12:25.250476+0000","last_fullsized":"2023-07-14T13:12:25.250476+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:27:09.718637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931141+0000","last_change":"2023-07-14T13:12:22.926905+0000","last_active":"2023-07-14T13:12:24.931141+0000","last_peered":"2023-07-14T13:12:24.931141+0000","last_clean":"2023-07-14T13:12:24.931141+0000","last_became_active":"2023-07-14T13:12:22.926579+0000","last_became_peered":"2023-07-14T13:12:22.926579+0000","last_unstale":"2023-07-14T13:12:24.931141+0000","last_undegraded":"2023-07-14T13:12:24.931141+0000","last_fullsized":"2023-07-14T13:12:24.931141+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:37:37.042148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931678+0000","last_change":"2023-07-14T13:12:23.929341+0000","last_active":"2023-07-14T13:12:24.931678+0000","last_peered":"2023-07-14T13:12:24.931678+0000","last_clean":"2023-07-14T13:12:24.931678+0000","last_became_active":"2023-07-14T13:12:23.928895+0000","last_became_peered":"2023-07-14T13:12:23.928895+0000","last_unstale":"2023-07-14T13:12:24.931678+0000","last_undegraded":"2023-07-14T13:12:24.931678+0000","last_fullsized":"2023-07-14T13:12:24.931678+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:11:10.949805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"141'8","reported_seq":21,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.924947+0000","last_change":"2023-07-14T13:12:22.929600+0000","last_active":"2023-07-14T13:12:24.924947+0000","last_peered":"2023-07-14T13:12:24.924947+0000","last_clean":"2023-07-14T13:12:24.924947+0000","last_became_active":"2023-07-14T13:12:22.929310+0000","last_became_peered":"2023-07-14T13:12:22.929310+0000","last_unstale":"2023-07-14T13:12:24.924947+0000","last_undegraded":"2023-07-14T13:12:24.924947+0000","last_fullsized":"2023-07-14T13:12:24.924947+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:53:11.459050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"129'249","reported_seq":856,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931452+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:12:24.931452+0000","last_peered":"2023-07-14T13:12:24.931452+0000","last_clean":"2023-07-14T13:12:24.931452+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:12:24.931452+0000","last_undegraded":"2023-07-14T13:12:24.931452+0000","last_fullsized":"2023-07-14T13:12:24.931452+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:21:47.600102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":228,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655453+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:12:25.655453+0000","last_peered":"2023-07-14T13:12:25.655453+0000","last_clean":"2023-07-14T13:12:25.655453+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:12:25.655453+0000","last_undegraded":"2023-07-14T13:12:25.655453+0000","last_fullsized":"2023-07-14T13:12:25.655453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:18:01.972641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.113439+0000","last_change":"2023-07-14T13:12:23.944309+0000","last_active":"2023-07-14T13:12:25.113439+0000","last_peered":"2023-07-14T13:12:25.113439+0000","last_clean":"2023-07-14T13:12:25.113439+0000","last_became_active":"2023-07-14T13:12:23.943945+0000","last_became_peered":"2023-07-14T13:12:23.943945+0000","last_unstale":"2023-07-14T13:12:25.113439+0000","last_undegraded":"2023-07-14T13:12:25.113439+0000","last_fullsized":"2023-07-14T13:12:25.113439+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:09:13.612325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"141'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.925238+0000","last_change":"2023-07-14T13:12:22.929681+0000","last_active":"2023-07-14T13:12:24.925238+0000","last_peered":"2023-07-14T13:12:24.925238+0000","last_clean":"2023-07-14T13:12:24.925238+0000","last_became_active":"2023-07-14T13:12:22.929406+0000","last_became_peered":"2023-07-14T13:12:22.929406+0000","last_unstale":"2023-07-14T13:12:24.925238+0000","last_undegraded":"2023-07-14T13:12:24.925238+0000","last_fullsized":"2023-07-14T13:12:24.925238+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:05:51.061780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":232,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931324+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:12:24.931324+0000","last_peered":"2023-07-14T13:12:24.931324+0000","last_clean":"2023-07-14T13:12:24.931324+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:12:24.931324+0000","last_undegraded":"2023-07-14T13:12:24.931324+0000","last_fullsized":"2023-07-14T13:12:24.931324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:17:15.868940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250327+0000","last_change":"2023-07-14T13:12:23.925157+0000","last_active":"2023-07-14T13:12:25.250327+0000","last_peered":"2023-07-14T13:12:25.250327+0000","last_clean":"2023-07-14T13:12:25.250327+0000","last_became_active":"2023-07-14T13:12:23.924877+0000","last_became_peered":"2023-07-14T13:12:23.924877+0000","last_unstale":"2023-07-14T13:12:25.250327+0000","last_undegraded":"2023-07-14T13:12:25.250327+0000","last_fullsized":"2023-07-14T13:12:25.250327+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:54:01.846060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.925728+0000","last_change":"2023-07-14T13:12:22.924565+0000","last_active":"2023-07-14T13:12:24.925728+0000","last_peered":"2023-07-14T13:12:24.925728+0000","last_clean":"2023-07-14T13:12:24.925728+0000","last_became_active":"2023-07-14T13:12:22.924067+0000","last_became_peered":"2023-07-14T13:12:22.924067+0000","last_unstale":"2023-07-14T13:12:24.925728+0000","last_undegraded":"2023-07-14T13:12:24.925728+0000","last_fullsized":"2023-07-14T13:12:24.925728+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:21:37.619425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":230,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.341258+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:12:25.341258+0000","last_peered":"2023-07-14T13:12:25.341258+0000","last_clean":"2023-07-14T13:12:25.341258+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:12:25.341258+0000","last_undegraded":"2023-07-14T13:12:25.341258+0000","last_fullsized":"2023-07-14T13:12:25.341258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:27:40.934414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.341376+0000","last_change":"2023-07-14T13:12:23.935663+0000","last_active":"2023-07-14T13:12:25.341376+0000","last_peered":"2023-07-14T13:12:25.341376+0000","last_clean":"2023-07-14T13:12:25.341376+0000","last_became_active":"2023-07-14T13:12:23.935393+0000","last_became_peered":"2023-07-14T13:12:23.935393+0000","last_unstale":"2023-07-14T13:12:25.341376+0000","last_undegraded":"2023-07-14T13:12:25.341376+0000","last_fullsized":"2023-07-14T13:12:25.341376+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:39:22.919806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.925024+0000","last_change":"2023-07-14T13:12:22.927281+0000","last_active":"2023-07-14T13:12:24.925024+0000","last_peered":"2023-07-14T13:12:24.925024+0000","last_clean":"2023-07-14T13:12:24.925024+0000","last_became_active":"2023-07-14T13:12:22.926987+0000","last_became_peered":"2023-07-14T13:12:22.926987+0000","last_unstale":"2023-07-14T13:12:24.925024+0000","last_undegraded":"2023-07-14T13:12:24.925024+0000","last_fullsized":"2023-07-14T13:12:24.925024+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:35:50.750361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":228,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655229+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:12:25.655229+0000","last_peered":"2023-07-14T13:12:25.655229+0000","last_clean":"2023-07-14T13:12:25.655229+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:12:25.655229+0000","last_undegraded":"2023-07-14T13:12:25.655229+0000","last_fullsized":"2023-07-14T13:12:25.655229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:57:29.776942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.113152+0000","last_change":"2023-07-14T13:12:23.933825+0000","last_active":"2023-07-14T13:12:25.113152+0000","last_peered":"2023-07-14T13:12:25.113152+0000","last_clean":"2023-07-14T13:12:25.113152+0000","last_became_active":"2023-07-14T13:12:23.933461+0000","last_became_peered":"2023-07-14T13:12:23.933461+0000","last_unstale":"2023-07-14T13:12:25.113152+0000","last_undegraded":"2023-07-14T13:12:25.113152+0000","last_fullsized":"2023-07-14T13:12:25.113152+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:36:43.122074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.113189+0000","last_change":"2023-07-14T13:12:22.926462+0000","last_active":"2023-07-14T13:12:25.113189+0000","last_peered":"2023-07-14T13:12:25.113189+0000","last_clean":"2023-07-14T13:12:25.113189+0000","last_became_active":"2023-07-14T13:12:22.926168+0000","last_became_peered":"2023-07-14T13:12:22.926168+0000","last_unstale":"2023-07-14T13:12:25.113189+0000","last_undegraded":"2023-07-14T13:12:25.113189+0000","last_fullsized":"2023-07-14T13:12:25.113189+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:48:14.138549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":240,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250674+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:12:25.250674+0000","last_peered":"2023-07-14T13:12:25.250674+0000","last_clean":"2023-07-14T13:12:25.250674+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:12:25.250674+0000","last_undegraded":"2023-07-14T13:12:25.250674+0000","last_fullsized":"2023-07-14T13:12:25.250674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:39:26.451120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655585+0000","last_change":"2023-07-14T13:12:23.942407+0000","last_active":"2023-07-14T13:12:25.655585+0000","last_peered":"2023-07-14T13:12:25.655585+0000","last_clean":"2023-07-14T13:12:25.655585+0000","last_became_active":"2023-07-14T13:12:23.942065+0000","last_became_peered":"2023-07-14T13:12:23.942065+0000","last_unstale":"2023-07-14T13:12:25.655585+0000","last_undegraded":"2023-07-14T13:12:25.655585+0000","last_fullsized":"2023-07-14T13:12:25.655585+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:47:09.702453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655478+0000","last_change":"2023-07-14T13:12:22.922833+0000","last_active":"2023-07-14T13:12:25.655478+0000","last_peered":"2023-07-14T13:12:25.655478+0000","last_clean":"2023-07-14T13:12:25.655478+0000","last_became_active":"2023-07-14T13:12:22.922520+0000","last_became_peered":"2023-07-14T13:12:22.922520+0000","last_unstale":"2023-07-14T13:12:25.655478+0000","last_undegraded":"2023-07-14T13:12:25.655478+0000","last_fullsized":"2023-07-14T13:12:25.655478+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:35:30.928340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":232,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.932096+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:12:24.932096+0000","last_peered":"2023-07-14T13:12:24.932096+0000","last_clean":"2023-07-14T13:12:24.932096+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:12:24.932096+0000","last_undegraded":"2023-07-14T13:12:24.932096+0000","last_fullsized":"2023-07-14T13:12:24.932096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:05:08.461443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.925289+0000","last_change":"2023-07-14T13:12:23.932685+0000","last_active":"2023-07-14T13:12:24.925289+0000","last_peered":"2023-07-14T13:12:24.925289+0000","last_clean":"2023-07-14T13:12:24.925289+0000","last_became_active":"2023-07-14T13:12:23.932351+0000","last_became_peered":"2023-07-14T13:12:23.932351+0000","last_unstale":"2023-07-14T13:12:24.925289+0000","last_undegraded":"2023-07-14T13:12:24.925289+0000","last_fullsized":"2023-07-14T13:12:24.925289+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:01:09.308214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"141'3","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655609+0000","last_change":"2023-07-14T13:12:22.924751+0000","last_active":"2023-07-14T13:12:25.655609+0000","last_peered":"2023-07-14T13:12:25.655609+0000","last_clean":"2023-07-14T13:12:25.655609+0000","last_became_active":"2023-07-14T13:12:22.924479+0000","last_became_peered":"2023-07-14T13:12:22.924479+0000","last_unstale":"2023-07-14T13:12:25.655609+0000","last_undegraded":"2023-07-14T13:12:25.655609+0000","last_fullsized":"2023-07-14T13:12:25.655609+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:15:41.806178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":240,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250620+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:12:25.250620+0000","last_peered":"2023-07-14T13:12:25.250620+0000","last_clean":"2023-07-14T13:12:25.250620+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:12:25.250620+0000","last_undegraded":"2023-07-14T13:12:25.250620+0000","last_fullsized":"2023-07-14T13:12:25.250620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:15:43.607286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655721+0000","last_change":"2023-07-14T13:12:23.930478+0000","last_active":"2023-07-14T13:12:25.655721+0000","last_peered":"2023-07-14T13:12:25.655721+0000","last_clean":"2023-07-14T13:12:25.655721+0000","last_became_active":"2023-07-14T13:12:23.930209+0000","last_became_peered":"2023-07-14T13:12:23.930209+0000","last_unstale":"2023-07-14T13:12:25.655721+0000","last_undegraded":"2023-07-14T13:12:25.655721+0000","last_fullsized":"2023-07-14T13:12:25.655721+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:45:58.759709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"141'6","reported_seq":19,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.925528+0000","last_change":"2023-07-14T13:12:22.925040+0000","last_active":"2023-07-14T13:12:24.925528+0000","last_peered":"2023-07-14T13:12:24.925528+0000","last_clean":"2023-07-14T13:12:24.925528+0000","last_became_active":"2023-07-14T13:12:22.924712+0000","last_became_peered":"2023-07-14T13:12:22.924712+0000","last_unstale":"2023-07-14T13:12:24.925528+0000","last_undegraded":"2023-07-14T13:12:24.925528+0000","last_fullsized":"2023-07-14T13:12:24.925528+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:27:12.980300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":232,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.112750+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:12:25.112750+0000","last_peered":"2023-07-14T13:12:25.112750+0000","last_clean":"2023-07-14T13:12:25.112750+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:12:25.112750+0000","last_undegraded":"2023-07-14T13:12:25.112750+0000","last_fullsized":"2023-07-14T13:12:25.112750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:02:24.353646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575084,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59604,"kb_used_data":2316,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312236,"statfs":{"total":96636764160,"available":96575729664,"internally_reserved":0,"allocated":2371584,"data_stored":1487553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.68999999999999995,"15min":0.70699999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.84199999999999997,"5min":1.262,"15min":1.262},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71699999999999997,"15min":0.72899999999999998},"min":{"1min":0.54100000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.73299999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.70599999999999996,"15min":0.72999999999999998},"min":{"1min":0.44,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83799999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72799999999999998,"15min":0.74299999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.82299999999999995}]},{"osd":2,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71199999999999997,"15min":0.72599999999999998},"min":{"1min":0.48999999999999999,"5min":0.46100000000000002,"15min":0.42699999999999999},"max":{"1min":0.91500000000000004,"5min":1.073,"15min":1.073},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.753},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84899999999999998,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.72699999999999998,"15min":0.73599999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.091,"5min":1.161,"15min":1.161},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73999999999999999,"15min":0.75600000000000001},"min":{"1min":0.51100000000000001,"5min":0.47899999999999998,"15min":0.41499999999999998},"max":{"1min":0.94899999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.76000000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56899999999999995,"15min":0.57899999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.318},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.022},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.40000000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.66400000000000003}]},{"osd":5,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.42699999999999999,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.91000000000000003,"5min":0.98099999999999998,"15min":0.98299999999999998},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63100000000000001,"15min":0.64900000000000002},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.34100000000000003},"max":{"1min":0.80500000000000005,"5min":1.028,"15min":1.028},"last":0.85299999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.42699999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.0489999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.68100000000000005,"15min":0.67700000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.36299999999999999},"max":{"1min":1.151,"5min":4.1130000000000004,"15min":4.1130000000000004},"last":0.70999999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575085,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1765376,"data_stored":896991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70699999999999996,"15min":0.72699999999999998},"min":{"1min":0.496,"5min":0.47899999999999998,"15min":0.38},"max":{"1min":0.89300000000000002,"5min":0.90400000000000003,"15min":0.996},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69999999999999996,"15min":0.72399999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88100000000000001,"5min":0.98199999999999998,"15min":1.0800000000000001},"last":0.501}]},{"osd":1,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70099999999999996,"15min":0.73299999999999998},"min":{"1min":0.48499999999999999,"5min":0.42299999999999999,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.0209999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69199999999999995,"15min":0.71899999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82999999999999996,"5min":0.88100000000000001,"15min":1.077},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.746},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.45900000000000002},"max":{"1min":0.872,"5min":0.95099999999999996,"15min":1.105},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71799999999999997,"15min":0.745},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.92100000000000004,"5min":0.99099999999999999,"15min":1.0900000000000001},"last":0.745}]},{"osd":3,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72899999999999998,"15min":0.76600000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89300000000000002,"5min":1.054,"15min":1.1359999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71399999999999997,"15min":0.753},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93600000000000005,"5min":0.94799999999999995,"15min":1.1080000000000001},"last":0.67100000000000004}]},{"osd":4,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.63900000000000001,"15min":0.63600000000000001},"min":{"1min":0.47499999999999998,"5min":0.439,"15min":0.38500000000000001},"max":{"1min":0.79800000000000004,"5min":0.95499999999999996,"15min":1.0780000000000001},"last":0.59999999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63,"15min":0.64000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":1.579},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48199999999999998,"5min":0.46300000000000002,"15min":0.42399999999999999},"max":{"1min":0.85599999999999998,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.72499999999999998}]},{"osd":7,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66000000000000003,"15min":0.65900000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91800000000000004,"5min":1.0940000000000001,"15min":1.1200000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.36199999999999999},"max":{"1min":0.90400000000000003,"5min":1.0209999999999999,"15min":1.657},"last":0.70199999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575084,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50824,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321016,"statfs":{"total":96636764160,"available":96584720384,"internally_reserved":0,"allocated":1769472,"data_stored":896569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68799999999999994,"15min":0.72199999999999998},"min":{"1min":0.45400000000000001,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":2.6699999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.46500000000000002,"5min":0.41699999999999998,"15min":0.32800000000000001},"max":{"1min":0.86799999999999999,"5min":1.083,"15min":1.083},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68899999999999995,"15min":0.71799999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44500000000000001},"max":{"1min":0.93600000000000005,"5min":1.05,"15min":1.079},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.71499999999999997,"15min":0.73899999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.36799999999999999},"max":{"1min":0.873,"5min":0.94599999999999995,"15min":2.706},"last":0.80200000000000005}]},{"osd":2,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70899999999999996,"15min":0.72799999999999998},"min":{"1min":0.41199999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90700000000000003,"5min":1.212,"15min":1.212},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70799999999999996,"15min":0.72699999999999998},"min":{"1min":0.497,"5min":0.44800000000000001,"15min":0.433},"max":{"1min":0.94599999999999995,"5min":1.181,"15min":1.181},"last":0.85099999999999998}]},{"osd":3,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72499999999999998,"15min":0.74199999999999999},"min":{"1min":0.53900000000000003,"5min":0.41799999999999998,"15min":0.377},"max":{"1min":0.88600000000000001,"5min":0.95199999999999996,"15min":2.7389999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73099999999999998,"15min":0.753},"min":{"1min":0.51600000000000001,"5min":0.47299999999999998,"15min":0.39700000000000002},"max":{"1min":0.94499999999999995,"5min":1.304,"15min":1.304},"last":0.88400000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.628,"15min":0.628},"min":{"1min":0.38500000000000001,"5min":0.38,"15min":0.28599999999999998},"max":{"1min":0.85599999999999998,"5min":1.129,"15min":1.129},"last":0.751},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.69099999999999995,"15min":0.68400000000000005},"min":{"1min":0.53700000000000003,"5min":0.39900000000000002,"15min":0.36299999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":2.7719999999999998},"last":0.46300000000000002}]},{"osd":6,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60199999999999998,"15min":0.60599999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.32700000000000001},"max":{"1min":0.89700000000000002,"5min":1.169,"15min":1.169},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42599999999999999,"5min":0.39400000000000002,"15min":0.34300000000000003},"max":{"1min":0.91000000000000003,"5min":1.238,"15min":1.238},"last":0.90800000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64600000000000002,"15min":0.64300000000000002},"min":{"1min":0.40899999999999997,"5min":0.36899999999999999,"15min":0.32900000000000001},"max":{"1min":0.90800000000000003,"5min":1.026,"15min":3.0230000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68300000000000005,"15min":0.67700000000000005},"min":{"1min":0.49399999999999999,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.98199999999999998,"5min":1.2589999999999999,"15min":1.407},"last":0.54200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575084,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36876,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334964,"statfs":{"total":96636764160,"available":96599003136,"internally_reserved":0,"allocated":1773568,"data_stored":897973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.70599999999999996,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.411},"last":0.747},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.45600000000000002,"5min":0.45100000000000001,"15min":0.435},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.1200000000000001},"last":0.66700000000000004}]},{"osd":1,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71199999999999997,"15min":0.74399999999999999},"min":{"1min":0.496,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84099999999999997,"5min":0.92500000000000004,"15min":1.077},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70399999999999996,"15min":0.72999999999999998},"min":{"1min":0.52700000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.0469999999999999},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.71999999999999997,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.42199999999999999,"15min":0.35199999999999998},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72099999999999997,"15min":0.76400000000000001},"min":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.86699999999999999,"5min":0.98199999999999998,"15min":1.387},"last":0.72999999999999998}]},{"osd":3,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.49399999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89700000000000002,"5min":0.95399999999999996,"15min":1.008},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.74099999999999999,"15min":0.76600000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46800000000000003},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.69799999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.378},"max":{"1min":0.92200000000000004,"5min":0.92400000000000004,"15min":0.97099999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.40400000000000003,"15min":0.34599999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.71399999999999997}]},{"osd":6,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.014},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67900000000000005,"15min":0.67000000000000004},"min":{"1min":0.48599999999999999,"5min":0.443,"15min":0.374},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.0289999999999999},"last":0.59699999999999998}]},{"osd":7,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.69899999999999995,"15min":0.67200000000000004},"min":{"1min":0.51300000000000001,"5min":0.502,"15min":0.39000000000000001},"max":{"1min":0.91700000000000004,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.69799999999999995},"min":{"1min":0.48199999999999998,"5min":0.42799999999999999,"15min":0.40300000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.50800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575084,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36880,"kb_used_data":1736,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334960,"statfs":{"total":96636764160,"available":96598999040,"internally_reserved":0,"allocated":1777664,"data_stored":898007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.44400000000000001,"15min":0.44900000000000001},"min":{"1min":0.25600000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.63100000000000001,"5min":0.78600000000000003,"15min":0.84199999999999997},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.49299999999999999,"15min":0.51100000000000001},"min":{"1min":0.312,"5min":0.307,"15min":0.307},"max":{"1min":0.66700000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.34100000000000003}]},{"osd":1,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47399999999999998,"15min":0.47999999999999998},"min":{"1min":0.32300000000000001,"5min":0.32000000000000001,"15min":0.315},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.38},{"interface":"front","average":{"1min":0.503,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.0029999999999999},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55800000000000005,"15min":0.57199999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.58299999999999996,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.36799999999999999},"max":{"1min":0.81599999999999995,"5min":0.88100000000000001,"15min":1.663},"last":0.70599999999999996}]},{"osd":4,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.72699999999999998,"15min":0.755},"min":{"1min":0.53000000000000003,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.284},"last":0.627},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.52700000000000002,"5min":0.51900000000000002,"15min":0.47699999999999998},"max":{"1min":0.96899999999999997,"5min":1.175,"15min":1.175},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76600000000000001,"15min":0.78700000000000003},"min":{"1min":0.54900000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.05,"5min":1.0629999999999999,"15min":1.306},"last":0.62},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.754,"15min":0.78200000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.372},"max":{"1min":1.121,"5min":1.121,"15min":1.2470000000000001},"last":0.752}]},{"osd":6,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.746,"15min":0.76900000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48099999999999998},"max":{"1min":1.0680000000000001,"5min":1.113,"15min":1.117},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.78700000000000003,"15min":0.81100000000000005},"min":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.54200000000000004},"max":{"1min":1.133,"5min":1.133,"15min":1.2589999999999999},"last":0.57299999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.78300000000000003,"15min":0.82799999999999996},"min":{"1min":0.58399999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.159,"5min":1.159,"15min":2.4910000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.78100000000000003,"15min":0.81799999999999995},"min":{"1min":0.57599999999999996,"5min":0.53500000000000003,"15min":0.51600000000000001},"max":{"1min":1.0960000000000001,"5min":1.1359999999999999,"15min":1.595},"last":0.58699999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575084,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59004,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312836,"statfs":{"total":96636764160,"available":96576344064,"internally_reserved":0,"allocated":1757184,"data_stored":895390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46200000000000002,"15min":0.46400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.80400000000000005,"5min":0.84699999999999998,"15min":1.3169999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.50800000000000001,"15min":0.53300000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67300000000000004,"5min":0.80800000000000005,"15min":2.5270000000000001},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.47699999999999998,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.29999999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":2.7200000000000002},"last":0.375},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.55700000000000005},"min":{"1min":0.39900000000000002,"5min":0.36299999999999999,"15min":0.35999999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":2.6110000000000002},"last":1.1279999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55100000000000005,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.755,"5min":0.755,"15min":8.2530000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.77000000000000002,"5min":0.89600000000000002,"15min":1.2150000000000001},"last":0.437}]},{"osd":4,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.73999999999999999,"15min":0.76900000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.48399999999999999},"max":{"1min":0.91100000000000003,"5min":1.0840000000000001,"15min":1.1499999999999999},"last":0.626},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73999999999999999,"15min":0.78100000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.47999999999999998},"max":{"1min":0.92900000000000005,"5min":1.0629999999999999,"15min":2.3170000000000002},"last":1.258}]},{"osd":5,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.79900000000000004,"15min":0.84699999999999998},"min":{"1min":0.58399999999999996,"5min":0.56399999999999995,"15min":0.49399999999999999},"max":{"1min":1.0029999999999999,"5min":1.1319999999999999,"15min":3.1139999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.78900000000000003,"15min":0.83299999999999996},"min":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.55600000000000005},"max":{"1min":1.03,"5min":1.153,"15min":2.6850000000000001},"last":0.64600000000000002}]},{"osd":6,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.73999999999999999,"15min":0.79100000000000004},"min":{"1min":0.52900000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98299999999999998,"5min":1.038,"15min":3.9849999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75900000000000001,"15min":0.80200000000000005},"min":{"1min":0.53900000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":3.391},"last":0.70899999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.76000000000000001,"15min":0.80900000000000005},"min":{"1min":0.56200000000000006,"5min":0.52300000000000002,"15min":0.5},"max":{"1min":1.022,"5min":1.1759999999999999,"15min":2.5779999999999998},"last":1.3},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.78200000000000003,"15min":0.81799999999999995},"min":{"1min":0.57099999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.736,"5min":1.736,"15min":2.5939999999999999},"last":0.69299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575085,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36868,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334972,"statfs":{"total":96636764160,"available":96599011328,"internally_reserved":0,"allocated":1765376,"data_stored":896431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42899999999999999,"15min":0.432},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26100000000000001},"max":{"1min":0.56000000000000005,"5min":0.65400000000000003,"15min":0.77200000000000002},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.34999999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.74399999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.36799999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.35899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.63700000000000001,"5min":0.69199999999999995,"15min":1.0409999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.51700000000000002},"min":{"1min":0.32100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73199999999999998,"5min":0.77900000000000003,"15min":1.014},"last":0.54600000000000004}]},{"osd":3,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60799999999999998,"15min":0.628},"min":{"1min":0.502,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.746,"5min":0.80300000000000005,"15min":0.96299999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55300000000000005,"15min":0.57099999999999995},"min":{"1min":0.41299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69899999999999995,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.50900000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76400000000000001,"15min":0.78300000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48899999999999999},"max":{"1min":1.155,"5min":1.2110000000000001,"15min":1.236},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79000000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0640000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.95599999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77700000000000002,"15min":0.78500000000000003},"min":{"1min":0.56000000000000005,"5min":0.52500000000000002,"15min":0.45200000000000001},"max":{"1min":1.1020000000000001,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.79600000000000004,"15min":0.80300000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.48599999999999999},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.74399999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.55900000000000005,"5min":0.53800000000000003,"15min":0.503},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.2170000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79900000000000004,"15min":0.81799999999999995},"min":{"1min":0.53700000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.80500000000000005}]},{"osd":7,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.58499999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82699999999999996,"15min":0.84199999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.86799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575086,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41540,"kb_used_data":2300,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330300,"statfs":{"total":96636764160,"available":96594227200,"internally_reserved":0,"allocated":2355200,"data_stored":1485780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.27300000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.59199999999999997,"5min":0.79600000000000004,"15min":2.2450000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.48299999999999998,"15min":0.50800000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27700000000000002},"max":{"1min":0.72999999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.46100000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.504,"15min":0.51400000000000001},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68200000000000005,"5min":0.84499999999999997,"15min":2.2989999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52800000000000002,"15min":0.54700000000000004},"min":{"1min":0.39100000000000001,"5min":0.34899999999999998,"15min":0.29899999999999999},"max":{"1min":0.71199999999999997,"5min":0.83599999999999997,"15min":0.90300000000000002},"last":0.56399999999999995}]},{"osd":3,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.505,"15min":0.505},"min":{"1min":0.35199999999999998,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.84999999999999998},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57799999999999996,"15min":0.58999999999999997},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76600000000000001,"5min":0.92700000000000005,"15min":2.4100000000000001},"last":0.44}]},{"osd":4,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74399999999999999,"15min":0.77800000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1220000000000001,"5min":1.21,"15min":1.3640000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.75700000000000001,"15min":0.79300000000000004},"min":{"1min":0.57599999999999996,"5min":0.53500000000000003,"15min":0.44900000000000001},"max":{"1min":1.0289999999999999,"5min":1.0589999999999999,"15min":2.4460000000000002},"last":0.63400000000000001}]},{"osd":5,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75600000000000001,"15min":0.79400000000000004},"min":{"1min":0.62,"5min":0.54200000000000004,"15min":0.47899999999999998},"max":{"1min":1.044,"5min":1.0669999999999999,"15min":1.3839999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.59399999999999997,"5min":0.5,"15min":0.48399999999999999},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.325},"last":0.73999999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77100000000000002,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.147,"5min":1.147,"15min":2.3380000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.755,"15min":0.79900000000000004},"min":{"1min":0.55600000000000005,"5min":0.51000000000000001,"15min":0.50600000000000001},"max":{"1min":0.97899999999999998,"5min":1.0900000000000001,"15min":1.3440000000000001},"last":0.78400000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76300000000000001,"15min":0.81599999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.503},"max":{"1min":1.016,"5min":1.1180000000000001,"15min":1.2749999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.77200000000000002,"15min":0.80500000000000005},"min":{"1min":0.56000000000000005,"5min":0.50600000000000001,"15min":0.502},"max":{"1min":1.077,"5min":1.0880000000000001,"15min":1.381},"last":0.76900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:12:32.672 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:12:32.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.793+0000 7fde5a23a640 1 Processor -- start 2023-07-14T13:12:32.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.793+0000 7fde5a23a640 1 -- start start 2023-07-14T13:12:32.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.793+0000 7fde5a23a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fde540b7d90 0x7fde540cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:32.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.793+0000 7fde5a23a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fde540d13f0 0x7fde540ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:32.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.793+0000 7fde5a23a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde540d0f60 con 0x7fde5415f3f0 2023-07-14T13:12:32.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.793+0000 7fde5a23a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde540d0390 con 0x7fde540b7d90 2023-07-14T13:12:32.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.793+0000 7fde5a23a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde540d0630 con 0x7fde540d13f0 2023-07-14T13:12:32.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.793+0000 7fde58a37640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fde540b7d90 0x7fde540cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:32.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.793+0000 7fde58a37640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fde540b7d90 0x7fde540cc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55152/0 (socket says 172.21.15.5:55152) 2023-07-14T13:12:32.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.793+0000 7fde58a37640 1 -- 172.21.15.5:0/869055413 learned_addr learned my addr 172.21.15.5:0/869055413 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:32.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.793+0000 7fde59a39640 1 --2- 172.21.15.5:0/869055413 >> v2:172.21.15.154:3300/0 conn(0x7fde540d13f0 0x7fde540ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:32.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.793+0000 7fde58a37640 1 -- 172.21.15.5:0/869055413 >> v2:172.21.15.154:3300/0 conn(0x7fde540d13f0 msgr2=0x7fde540ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:32.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.793+0000 7fde58a37640 1 --2- 172.21.15.5:0/869055413 >> v2:172.21.15.154:3300/0 conn(0x7fde540d13f0 0x7fde540ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:32.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.793+0000 7fde58a37640 1 -- 172.21.15.5:0/869055413 >> v1:172.21.15.154:6789/0 conn(0x7fde5415f3f0 legacy=0x7fde540b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:32.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.793+0000 7fde58a37640 1 -- 172.21.15.5:0/869055413 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde540d0910 con 0x7fde540b7d90 2023-07-14T13:12:32.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.797+0000 7fde58a37640 1 --2- 172.21.15.5:0/869055413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde540b7d90 0x7fde540cc9a0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fde540cd910 tx=0x7fde4401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80d5e1a4b083144 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:32.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.797+0000 7fde4bfff640 1 -- 172.21.15.5:0/869055413 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde440ab600 con 0x7fde540b7d90 2023-07-14T13:12:32.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.797+0000 7fde4bfff640 1 -- 172.21.15.5:0/869055413 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde440a7050 con 0x7fde540b7d90 2023-07-14T13:12:32.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.797+0000 7fde4bfff640 1 -- 172.21.15.5:0/869055413 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde440ab980 con 0x7fde540b7d90 2023-07-14T13:12:32.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.797+0000 7fde5a23a640 1 -- 172.21.15.5:0/869055413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde540b7d90 msgr2=0x7fde540cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:32.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.797+0000 7fde5a23a640 1 --2- 172.21.15.5:0/869055413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde540b7d90 0x7fde540cc9a0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fde540cd910 tx=0x7fde4401c3e0 comp rx=0 tx=0).stop 2023-07-14T13:12:32.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.797+0000 7fde5a23a640 1 -- 172.21.15.5:0/869055413 shutdown_connections 2023-07-14T13:12:32.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.797+0000 7fde5a23a640 1 --2- 172.21.15.5:0/869055413 >> v2:172.21.15.154:3300/0 conn(0x7fde540d13f0 0x7fde540ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:32.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.797+0000 7fde5a23a640 1 --2- 172.21.15.5:0/869055413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde540b7d90 0x7fde540cc9a0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:32.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.797+0000 7fde5a23a640 1 -- 172.21.15.5:0/869055413 >> 172.21.15.5:0/869055413 conn(0x7fde54069f50 msgr2=0x7fde5406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:32.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.797+0000 7fde5a23a640 1 -- 172.21.15.5:0/869055413 shutdown_connections 2023-07-14T13:12:32.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.797+0000 7fde5a23a640 1 -- 172.21.15.5:0/869055413 wait complete. 2023-07-14T13:12:32.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.801+0000 7fde5a23a640 1 Processor -- start 2023-07-14T13:12:32.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.801+0000 7fde5a23a640 1 -- start start 2023-07-14T13:12:32.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.801+0000 7fde5a23a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde540b7d90 0x7fde54142630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:32.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.801+0000 7fde5a23a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde540d13f0 0x7fde540ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:32.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.801+0000 7fde5a23a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde5415f3f0 0x7fde5415e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:32.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.801+0000 7fde5a23a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde540ca280 con 0x7fde540b7d90 2023-07-14T13:12:32.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.801+0000 7fde5a23a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde54142b70 con 0x7fde540d13f0 2023-07-14T13:12:32.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.801+0000 7fde5a23a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde540c9670 con 0x7fde5415f3f0 2023-07-14T13:12:32.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.801+0000 7fde59238640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde540b7d90 0x7fde54142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:32.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.801+0000 7fde59238640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde540b7d90 0x7fde54142630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55164/0 (socket says 172.21.15.5:55164) 2023-07-14T13:12:32.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.801+0000 7fde59238640 1 -- 172.21.15.5:0/2315817814 learned_addr learned my addr 172.21.15.5:0/2315817814 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:32.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.801+0000 7fde58a37640 1 --2- 172.21.15.5:0/2315817814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde540d13f0 0x7fde540ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:32.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.801+0000 7fde59a39640 1 --2- 172.21.15.5:0/2315817814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde5415f3f0 0x7fde5415e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:32.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.801+0000 7fde59238640 1 -- 172.21.15.5:0/2315817814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde5415f3f0 msgr2=0x7fde5415e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:32.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.801+0000 7fde59238640 1 --2- 172.21.15.5:0/2315817814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde5415f3f0 0x7fde5415e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:32.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.801+0000 7fde59238640 1 -- 172.21.15.5:0/2315817814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde540d13f0 msgr2=0x7fde540ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:32.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.801+0000 7fde59238640 1 --2- 172.21.15.5:0/2315817814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde540d13f0 0x7fde540ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:32.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.801+0000 7fde59238640 1 -- 172.21.15.5:0/2315817814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde440094d0 con 0x7fde540b7d90 2023-07-14T13:12:32.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.801+0000 7fde59238640 1 --2- 172.21.15.5:0/2315817814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde540b7d90 0x7fde54142630 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fde5000c3c0 tx=0x7fde5000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:32.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.801+0000 7fde49ffb640 1 -- 172.21.15.5:0/2315817814 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde500052d0 con 0x7fde540b7d90 2023-07-14T13:12:32.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.801+0000 7fde49ffb640 1 -- 172.21.15.5:0/2315817814 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde50005430 con 0x7fde540b7d90 2023-07-14T13:12:32.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.801+0000 7fde49ffb640 1 -- 172.21.15.5:0/2315817814 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde50003840 con 0x7fde540b7d90 2023-07-14T13:12:32.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.801+0000 7fde5a23a640 1 -- 172.21.15.5:0/2315817814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde540c9950 con 0x7fde540b7d90 2023-07-14T13:12:32.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.801+0000 7fde5a23a640 1 -- 172.21.15.5:0/2315817814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde540c9f10 con 0x7fde540b7d90 2023-07-14T13:12:32.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.805+0000 7fde5a23a640 1 -- 172.21.15.5:0/2315817814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde540678d0 con 0x7fde540b7d90 2023-07-14T13:12:32.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.805+0000 7fde49ffb640 1 -- 172.21.15.5:0/2315817814 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fde500039a0 con 0x7fde540b7d90 2023-07-14T13:12:32.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.805+0000 7fde49ffb640 1 --2- 172.21.15.5:0/2315817814 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fde380663a0 0x7fde38068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:32.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.805+0000 7fde49ffb640 1 -- 172.21.15.5:0/2315817814 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fde50083460 con 0x7fde540b7d90 2023-07-14T13:12:32.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.805+0000 7fde58a37640 1 --2- 172.21.15.5:0/2315817814 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fde380663a0 0x7fde38068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:32.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.805+0000 7fde58a37640 1 --2- 172.21.15.5:0/2315817814 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fde380663a0 0x7fde38068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fde440ad000 tx=0x7fde44008040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:32.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.809+0000 7fde49ffb640 1 -- 172.21.15.5:0/2315817814 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fde50050730 con 0x7fde540b7d90 2023-07-14T13:12:33.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.965+0000 7fde5a23a640 1 -- 172.21.15.5:0/2315817814 --> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fde540cd420 con 0x7fde380663a0 2023-07-14T13:12:33.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.973+0000 7fde49ffb640 1 -- 172.21.15.5:0/2315817814 <== mgr.7202 v2:172.21.15.154:6832/3769132865 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311524 (secure 0 0 0) 0x7fde440bb090 con 0x7fde380663a0 2023-07-14T13:12:33.011 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:33.013 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:12:33.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.977+0000 7fde5a23a640 1 -- 172.21.15.5:0/2315817814 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fde380663a0 msgr2=0x7fde38068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:33.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.977+0000 7fde5a23a640 1 --2- 172.21.15.5:0/2315817814 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fde380663a0 0x7fde38068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fde440ad000 tx=0x7fde44008040 comp rx=0 tx=0).stop 2023-07-14T13:12:33.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.977+0000 7fde5a23a640 1 -- 172.21.15.5:0/2315817814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde540b7d90 msgr2=0x7fde54142630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:33.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.977+0000 7fde5a23a640 1 --2- 172.21.15.5:0/2315817814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde540b7d90 0x7fde54142630 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fde5000c3c0 tx=0x7fde5000c880 comp rx=0 tx=0).stop 2023-07-14T13:12:33.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.977+0000 7fde5a23a640 1 -- 172.21.15.5:0/2315817814 shutdown_connections 2023-07-14T13:12:33.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.977+0000 7fde5a23a640 1 --2- 172.21.15.5:0/2315817814 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fde380663a0 0x7fde38068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.977+0000 7fde5a23a640 1 --2- 172.21.15.5:0/2315817814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde5415f3f0 0x7fde5415e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.977+0000 7fde5a23a640 1 --2- 172.21.15.5:0/2315817814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde540d13f0 0x7fde540ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.977+0000 7fde5a23a640 1 --2- 172.21.15.5:0/2315817814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde540b7d90 0x7fde54142630 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.977+0000 7fde5a23a640 1 -- 172.21.15.5:0/2315817814 >> 172.21.15.5:0/2315817814 conn(0x7fde54069f50 msgr2=0x7fde540b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:33.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.977+0000 7fde5a23a640 1 -- 172.21.15.5:0/2315817814 shutdown_connections 2023-07-14T13:12:33.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:32.977+0000 7fde5a23a640 1 -- 172.21.15.5:0/2315817814 wait complete. 2023-07-14T13:12:33.032 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-14T13:12:31.582166+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":444,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":288,"ondisk_log_size":288,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":204,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":354368,"kb_used_data":14976,"kb_used_omap":0,"kb_used_meta":339328,"kb_avail":754620352,"statfs":{"total":773094113280,"available":772731240448,"internally_reserved":0,"allocated":15335424,"data_stored":8354694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":347471872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":58,"apply_latency_ms":58,"commit_latency_ns":58000000,"apply_latency_ns":58000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002406"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.928688+0000","last_change":"2023-07-14T13:12:23.941215+0000","last_active":"2023-07-14T13:12:25.928688+0000","last_peered":"2023-07-14T13:12:25.928688+0000","last_clean":"2023-07-14T13:12:25.928688+0000","last_became_active":"2023-07-14T13:12:23.940959+0000","last_became_peered":"2023-07-14T13:12:23.940959+0000","last_unstale":"2023-07-14T13:12:25.928688+0000","last_undegraded":"2023-07-14T13:12:25.928688+0000","last_fullsized":"2023-07-14T13:12:25.928688+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:54:43.484272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.925163+0000","last_change":"2023-07-14T13:12:23.921986+0000","last_active":"2023-07-14T13:12:24.925163+0000","last_peered":"2023-07-14T13:12:24.925163+0000","last_clean":"2023-07-14T13:12:24.925163+0000","last_became_active":"2023-07-14T13:12:23.921698+0000","last_became_peered":"2023-07-14T13:12:23.921698+0000","last_unstale":"2023-07-14T13:12:24.925163+0000","last_undegraded":"2023-07-14T13:12:24.925163+0000","last_fullsized":"2023-07-14T13:12:24.925163+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:54:28.457899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.925686+0000","last_change":"2023-07-14T13:12:23.932855+0000","last_active":"2023-07-14T13:12:24.925686+0000","last_peered":"2023-07-14T13:12:24.925686+0000","last_clean":"2023-07-14T13:12:24.925686+0000","last_became_active":"2023-07-14T13:12:23.932099+0000","last_became_peered":"2023-07-14T13:12:23.932099+0000","last_unstale":"2023-07-14T13:12:24.925686+0000","last_undegraded":"2023-07-14T13:12:24.925686+0000","last_fullsized":"2023-07-14T13:12:24.925686+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:54:43.484272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931543+0000","last_change":"2023-07-14T13:12:23.933624+0000","last_active":"2023-07-14T13:12:24.931543+0000","last_peered":"2023-07-14T13:12:24.931543+0000","last_clean":"2023-07-14T13:12:24.931543+0000","last_became_active":"2023-07-14T13:12:23.933331+0000","last_became_peered":"2023-07-14T13:12:23.933331+0000","last_unstale":"2023-07-14T13:12:24.931543+0000","last_undegraded":"2023-07-14T13:12:24.931543+0000","last_fullsized":"2023-07-14T13:12:24.931543+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:40:16.702693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.928378+0000","last_change":"2023-07-14T13:12:23.937571+0000","last_active":"2023-07-14T13:12:25.928378+0000","last_peered":"2023-07-14T13:12:25.928378+0000","last_clean":"2023-07-14T13:12:25.928378+0000","last_became_active":"2023-07-14T13:12:23.937303+0000","last_became_peered":"2023-07-14T13:12:23.937303+0000","last_unstale":"2023-07-14T13:12:25.928378+0000","last_undegraded":"2023-07-14T13:12:25.928378+0000","last_fullsized":"2023-07-14T13:12:25.928378+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:01:09.308214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.924041+0000","last_change":"2023-07-14T13:12:23.923758+0000","last_active":"2023-07-14T13:12:25.924041+0000","last_peered":"2023-07-14T13:12:25.924041+0000","last_clean":"2023-07-14T13:12:25.924041+0000","last_became_active":"2023-07-14T13:12:23.923475+0000","last_became_peered":"2023-07-14T13:12:23.923475+0000","last_unstale":"2023-07-14T13:12:25.924041+0000","last_undegraded":"2023-07-14T13:12:25.924041+0000","last_fullsized":"2023-07-14T13:12:25.924041+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:38:42.573060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.923882+0000","last_change":"2023-07-14T13:12:23.928569+0000","last_active":"2023-07-14T13:12:25.923882+0000","last_peered":"2023-07-14T13:12:25.923882+0000","last_clean":"2023-07-14T13:12:25.923882+0000","last_became_active":"2023-07-14T13:12:23.928246+0000","last_became_peered":"2023-07-14T13:12:23.928246+0000","last_unstale":"2023-07-14T13:12:25.923882+0000","last_undegraded":"2023-07-14T13:12:25.923882+0000","last_fullsized":"2023-07-14T13:12:25.923882+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:45:33.322916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.924875+0000","last_change":"2023-07-14T13:12:23.932453+0000","last_active":"2023-07-14T13:12:24.924875+0000","last_peered":"2023-07-14T13:12:24.924875+0000","last_clean":"2023-07-14T13:12:24.924875+0000","last_became_active":"2023-07-14T13:12:23.932166+0000","last_became_peered":"2023-07-14T13:12:23.932166+0000","last_unstale":"2023-07-14T13:12:24.924875+0000","last_undegraded":"2023-07-14T13:12:24.924875+0000","last_fullsized":"2023-07-14T13:12:24.924875+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:01:48.127696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.932096+0000","last_change":"2023-07-14T13:12:23.929874+0000","last_active":"2023-07-14T13:12:24.932096+0000","last_peered":"2023-07-14T13:12:24.932096+0000","last_clean":"2023-07-14T13:12:24.932096+0000","last_became_active":"2023-07-14T13:12:23.929569+0000","last_became_peered":"2023-07-14T13:12:23.929569+0000","last_unstale":"2023-07-14T13:12:24.932096+0000","last_undegraded":"2023-07-14T13:12:24.932096+0000","last_fullsized":"2023-07-14T13:12:24.932096+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:01:36.007882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250495+0000","last_change":"2023-07-14T13:12:23.925220+0000","last_active":"2023-07-14T13:12:25.250495+0000","last_peered":"2023-07-14T13:12:25.250495+0000","last_clean":"2023-07-14T13:12:25.250495+0000","last_became_active":"2023-07-14T13:12:23.924918+0000","last_became_peered":"2023-07-14T13:12:23.924918+0000","last_unstale":"2023-07-14T13:12:25.250495+0000","last_undegraded":"2023-07-14T13:12:25.250495+0000","last_fullsized":"2023-07-14T13:12:25.250495+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:49:36.646758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.928492+0000","last_change":"2023-07-14T13:12:23.939608+0000","last_active":"2023-07-14T13:12:25.928492+0000","last_peered":"2023-07-14T13:12:25.928492+0000","last_clean":"2023-07-14T13:12:25.928492+0000","last_became_active":"2023-07-14T13:12:23.938707+0000","last_became_peered":"2023-07-14T13:12:23.938707+0000","last_unstale":"2023-07-14T13:12:25.928492+0000","last_undegraded":"2023-07-14T13:12:25.928492+0000","last_fullsized":"2023-07-14T13:12:25.928492+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:27:13.989928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.924613+0000","last_change":"2023-07-14T13:12:23.937137+0000","last_active":"2023-07-14T13:12:25.924613+0000","last_peered":"2023-07-14T13:12:25.924613+0000","last_clean":"2023-07-14T13:12:25.924613+0000","last_became_active":"2023-07-14T13:12:23.936788+0000","last_became_peered":"2023-07-14T13:12:23.936788+0000","last_unstale":"2023-07-14T13:12:25.924613+0000","last_undegraded":"2023-07-14T13:12:25.924613+0000","last_fullsized":"2023-07-14T13:12:25.924613+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:30:15.451661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250303+0000","last_change":"2023-07-14T13:12:23.928431+0000","last_active":"2023-07-14T13:12:25.250303+0000","last_peered":"2023-07-14T13:12:25.250303+0000","last_clean":"2023-07-14T13:12:25.250303+0000","last_became_active":"2023-07-14T13:12:23.928166+0000","last_became_peered":"2023-07-14T13:12:23.928166+0000","last_unstale":"2023-07-14T13:12:25.250303+0000","last_undegraded":"2023-07-14T13:12:25.250303+0000","last_fullsized":"2023-07-14T13:12:25.250303+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:12:40.802261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.925190+0000","last_change":"2023-07-14T13:12:23.935291+0000","last_active":"2023-07-14T13:12:24.925190+0000","last_peered":"2023-07-14T13:12:24.925190+0000","last_clean":"2023-07-14T13:12:24.925190+0000","last_became_active":"2023-07-14T13:12:23.933830+0000","last_became_peered":"2023-07-14T13:12:23.933830+0000","last_unstale":"2023-07-14T13:12:24.925190+0000","last_undegraded":"2023-07-14T13:12:24.925190+0000","last_fullsized":"2023-07-14T13:12:24.925190+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:37:26.540133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.928203+0000","last_change":"2023-07-14T13:12:23.940466+0000","last_active":"2023-07-14T13:12:25.928203+0000","last_peered":"2023-07-14T13:12:25.928203+0000","last_clean":"2023-07-14T13:12:25.928203+0000","last_became_active":"2023-07-14T13:12:23.940225+0000","last_became_peered":"2023-07-14T13:12:23.940225+0000","last_unstale":"2023-07-14T13:12:25.928203+0000","last_undegraded":"2023-07-14T13:12:25.928203+0000","last_fullsized":"2023-07-14T13:12:25.928203+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:07:06.136907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.923687+0000","last_change":"2023-07-14T13:12:23.926709+0000","last_active":"2023-07-14T13:12:25.923687+0000","last_peered":"2023-07-14T13:12:25.923687+0000","last_clean":"2023-07-14T13:12:25.923687+0000","last_became_active":"2023-07-14T13:12:23.926405+0000","last_became_peered":"2023-07-14T13:12:23.926405+0000","last_unstale":"2023-07-14T13:12:25.923687+0000","last_undegraded":"2023-07-14T13:12:25.923687+0000","last_fullsized":"2023-07-14T13:12:25.923687+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:46:17.252094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250605+0000","last_change":"2023-07-14T13:12:23.928245+0000","last_active":"2023-07-14T13:12:25.250605+0000","last_peered":"2023-07-14T13:12:25.250605+0000","last_clean":"2023-07-14T13:12:25.250605+0000","last_became_active":"2023-07-14T13:12:23.927941+0000","last_became_peered":"2023-07-14T13:12:23.927941+0000","last_unstale":"2023-07-14T13:12:25.250605+0000","last_undegraded":"2023-07-14T13:12:25.250605+0000","last_fullsized":"2023-07-14T13:12:25.250605+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:24:00.657088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.925232+0000","last_change":"2023-07-14T13:12:23.921930+0000","last_active":"2023-07-14T13:12:24.925232+0000","last_peered":"2023-07-14T13:12:24.925232+0000","last_clean":"2023-07-14T13:12:24.925232+0000","last_became_active":"2023-07-14T13:12:23.921641+0000","last_became_peered":"2023-07-14T13:12:23.921641+0000","last_unstale":"2023-07-14T13:12:24.925232+0000","last_undegraded":"2023-07-14T13:12:24.925232+0000","last_fullsized":"2023-07-14T13:12:24.925232+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:07:06.136907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.113350+0000","last_change":"2023-07-14T13:12:23.933175+0000","last_active":"2023-07-14T13:12:25.113350+0000","last_peered":"2023-07-14T13:12:25.113350+0000","last_clean":"2023-07-14T13:12:25.113350+0000","last_became_active":"2023-07-14T13:12:23.932908+0000","last_became_peered":"2023-07-14T13:12:23.932908+0000","last_unstale":"2023-07-14T13:12:25.113350+0000","last_undegraded":"2023-07-14T13:12:25.113350+0000","last_fullsized":"2023-07-14T13:12:25.113350+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:49:41.138683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.341484+0000","last_change":"2023-07-14T13:12:23.927375+0000","last_active":"2023-07-14T13:12:25.341484+0000","last_peered":"2023-07-14T13:12:25.341484+0000","last_clean":"2023-07-14T13:12:25.341484+0000","last_became_active":"2023-07-14T13:12:23.927060+0000","last_became_peered":"2023-07-14T13:12:23.927060+0000","last_unstale":"2023-07-14T13:12:25.341484+0000","last_undegraded":"2023-07-14T13:12:25.341484+0000","last_fullsized":"2023-07-14T13:12:25.341484+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:52:36.818258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931649+0000","last_change":"2023-07-14T13:12:23.929152+0000","last_active":"2023-07-14T13:12:24.931649+0000","last_peered":"2023-07-14T13:12:24.931649+0000","last_clean":"2023-07-14T13:12:24.931649+0000","last_became_active":"2023-07-14T13:12:23.928564+0000","last_became_peered":"2023-07-14T13:12:23.928564+0000","last_unstale":"2023-07-14T13:12:24.931649+0000","last_undegraded":"2023-07-14T13:12:24.931649+0000","last_fullsized":"2023-07-14T13:12:24.931649+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:39:46.478174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.928471+0000","last_change":"2023-07-14T13:12:23.946607+0000","last_active":"2023-07-14T13:12:25.928471+0000","last_peered":"2023-07-14T13:12:25.928471+0000","last_clean":"2023-07-14T13:12:25.928471+0000","last_became_active":"2023-07-14T13:12:23.946319+0000","last_became_peered":"2023-07-14T13:12:23.946319+0000","last_unstale":"2023-07-14T13:12:25.928471+0000","last_undegraded":"2023-07-14T13:12:25.928471+0000","last_fullsized":"2023-07-14T13:12:25.928471+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:00:49.629574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931430+0000","last_change":"2023-07-14T13:12:23.930471+0000","last_active":"2023-07-14T13:12:24.931430+0000","last_peered":"2023-07-14T13:12:24.931430+0000","last_clean":"2023-07-14T13:12:24.931430+0000","last_became_active":"2023-07-14T13:12:23.930174+0000","last_became_peered":"2023-07-14T13:12:23.930174+0000","last_unstale":"2023-07-14T13:12:24.931430+0000","last_undegraded":"2023-07-14T13:12:24.931430+0000","last_fullsized":"2023-07-14T13:12:24.931430+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:46:32.685769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.654990+0000","last_change":"2023-07-14T13:12:23.937925+0000","last_active":"2023-07-14T13:12:25.654990+0000","last_peered":"2023-07-14T13:12:25.654990+0000","last_clean":"2023-07-14T13:12:25.654990+0000","last_became_active":"2023-07-14T13:12:23.937459+0000","last_became_peered":"2023-07-14T13:12:23.937459+0000","last_unstale":"2023-07-14T13:12:25.654990+0000","last_undegraded":"2023-07-14T13:12:25.654990+0000","last_fullsized":"2023-07-14T13:12:25.654990+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:16:54.746314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655643+0000","last_change":"2023-07-14T13:12:23.940698+0000","last_active":"2023-07-14T13:12:25.655643+0000","last_peered":"2023-07-14T13:12:25.655643+0000","last_clean":"2023-07-14T13:12:25.655643+0000","last_became_active":"2023-07-14T13:12:23.940425+0000","last_became_peered":"2023-07-14T13:12:23.940425+0000","last_unstale":"2023-07-14T13:12:25.655643+0000","last_undegraded":"2023-07-14T13:12:25.655643+0000","last_fullsized":"2023-07-14T13:12:25.655643+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:00:48.445424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.341576+0000","last_change":"2023-07-14T13:12:23.927243+0000","last_active":"2023-07-14T13:12:25.341576+0000","last_peered":"2023-07-14T13:12:25.341576+0000","last_clean":"2023-07-14T13:12:25.341576+0000","last_became_active":"2023-07-14T13:12:23.926378+0000","last_became_peered":"2023-07-14T13:12:23.926378+0000","last_unstale":"2023-07-14T13:12:25.341576+0000","last_undegraded":"2023-07-14T13:12:25.341576+0000","last_fullsized":"2023-07-14T13:12:25.341576+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:09:12.003092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.113413+0000","last_change":"2023-07-14T13:12:23.933116+0000","last_active":"2023-07-14T13:12:25.113413+0000","last_peered":"2023-07-14T13:12:25.113413+0000","last_clean":"2023-07-14T13:12:25.113413+0000","last_became_active":"2023-07-14T13:12:23.932605+0000","last_became_peered":"2023-07-14T13:12:23.932605+0000","last_unstale":"2023-07-14T13:12:25.113413+0000","last_undegraded":"2023-07-14T13:12:25.113413+0000","last_fullsized":"2023-07-14T13:12:25.113413+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:48:09.500323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.924601+0000","last_change":"2023-07-14T13:12:23.926165+0000","last_active":"2023-07-14T13:12:25.924601+0000","last_peered":"2023-07-14T13:12:25.924601+0000","last_clean":"2023-07-14T13:12:25.924601+0000","last_became_active":"2023-07-14T13:12:23.925669+0000","last_became_peered":"2023-07-14T13:12:23.925669+0000","last_unstale":"2023-07-14T13:12:25.924601+0000","last_undegraded":"2023-07-14T13:12:25.924601+0000","last_fullsized":"2023-07-14T13:12:25.924601+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:18:47.512349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.341560+0000","last_change":"2023-07-14T13:12:23.918366+0000","last_active":"2023-07-14T13:12:25.341560+0000","last_peered":"2023-07-14T13:12:25.341560+0000","last_clean":"2023-07-14T13:12:25.341560+0000","last_became_active":"2023-07-14T13:12:23.918041+0000","last_became_peered":"2023-07-14T13:12:23.918041+0000","last_unstale":"2023-07-14T13:12:25.341560+0000","last_undegraded":"2023-07-14T13:12:25.341560+0000","last_fullsized":"2023-07-14T13:12:25.341560+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:26:51.452370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.925329+0000","last_change":"2023-07-14T13:12:23.934870+0000","last_active":"2023-07-14T13:12:24.925329+0000","last_peered":"2023-07-14T13:12:24.925329+0000","last_clean":"2023-07-14T13:12:24.925329+0000","last_became_active":"2023-07-14T13:12:23.933072+0000","last_became_peered":"2023-07-14T13:12:23.933072+0000","last_unstale":"2023-07-14T13:12:24.925329+0000","last_undegraded":"2023-07-14T13:12:24.925329+0000","last_fullsized":"2023-07-14T13:12:24.925329+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:00:49.629574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655220+0000","last_change":"2023-07-14T13:12:23.930126+0000","last_active":"2023-07-14T13:12:25.655220+0000","last_peered":"2023-07-14T13:12:25.655220+0000","last_clean":"2023-07-14T13:12:25.655220+0000","last_became_active":"2023-07-14T13:12:23.929790+0000","last_became_peered":"2023-07-14T13:12:23.929790+0000","last_unstale":"2023-07-14T13:12:25.655220+0000","last_undegraded":"2023-07-14T13:12:25.655220+0000","last_fullsized":"2023-07-14T13:12:25.655220+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:39:59.100500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655019+0000","last_change":"2023-07-14T13:12:23.937727+0000","last_active":"2023-07-14T13:12:25.655019+0000","last_peered":"2023-07-14T13:12:25.655019+0000","last_clean":"2023-07-14T13:12:25.655019+0000","last_became_active":"2023-07-14T13:12:23.937079+0000","last_became_peered":"2023-07-14T13:12:23.937079+0000","last_unstale":"2023-07-14T13:12:25.655019+0000","last_undegraded":"2023-07-14T13:12:25.655019+0000","last_fullsized":"2023-07-14T13:12:25.655019+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:16:39.230296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250512+0000","last_change":"2023-07-14T13:12:23.929978+0000","last_active":"2023-07-14T13:12:25.250512+0000","last_peered":"2023-07-14T13:12:25.250512+0000","last_clean":"2023-07-14T13:12:25.250512+0000","last_became_active":"2023-07-14T13:12:23.929692+0000","last_became_peered":"2023-07-14T13:12:23.929692+0000","last_unstale":"2023-07-14T13:12:25.250512+0000","last_undegraded":"2023-07-14T13:12:25.250512+0000","last_fullsized":"2023-07-14T13:12:25.250512+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:37:52.836371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"141'4","reported_seq":17,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.113169+0000","last_change":"2023-07-14T13:12:22.932726+0000","last_active":"2023-07-14T13:12:25.113169+0000","last_peered":"2023-07-14T13:12:25.113169+0000","last_clean":"2023-07-14T13:12:25.113169+0000","last_became_active":"2023-07-14T13:12:22.932398+0000","last_became_peered":"2023-07-14T13:12:22.932398+0000","last_unstale":"2023-07-14T13:12:25.113169+0000","last_undegraded":"2023-07-14T13:12:25.113169+0000","last_fullsized":"2023-07-14T13:12:25.113169+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:41:02.972781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.924348+0000","last_change":"2023-07-14T13:12:23.923432+0000","last_active":"2023-07-14T13:12:25.924348+0000","last_peered":"2023-07-14T13:12:25.924348+0000","last_clean":"2023-07-14T13:12:25.924348+0000","last_became_active":"2023-07-14T13:12:23.923121+0000","last_became_peered":"2023-07-14T13:12:23.923121+0000","last_unstale":"2023-07-14T13:12:25.924348+0000","last_undegraded":"2023-07-14T13:12:25.924348+0000","last_fullsized":"2023-07-14T13:12:25.924348+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:59:10.857348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"141'1","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250606+0000","last_change":"2023-07-14T13:12:22.920816+0000","last_active":"2023-07-14T13:12:25.250606+0000","last_peered":"2023-07-14T13:12:25.250606+0000","last_clean":"2023-07-14T13:12:25.250606+0000","last_became_active":"2023-07-14T13:12:22.918830+0000","last_became_peered":"2023-07-14T13:12:22.918830+0000","last_unstale":"2023-07-14T13:12:25.250606+0000","last_undegraded":"2023-07-14T13:12:25.250606+0000","last_fullsized":"2023-07-14T13:12:25.250606+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:51:49.189062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655335+0000","last_change":"2023-07-14T13:12:23.930140+0000","last_active":"2023-07-14T13:12:25.655335+0000","last_peered":"2023-07-14T13:12:25.655335+0000","last_clean":"2023-07-14T13:12:25.655335+0000","last_became_active":"2023-07-14T13:12:23.929864+0000","last_became_peered":"2023-07-14T13:12:23.929864+0000","last_unstale":"2023-07-14T13:12:25.655335+0000","last_undegraded":"2023-07-14T13:12:25.655335+0000","last_fullsized":"2023-07-14T13:12:25.655335+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:10:45.565912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"141'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931928+0000","last_change":"2023-07-14T13:12:22.929668+0000","last_active":"2023-07-14T13:12:24.931928+0000","last_peered":"2023-07-14T13:12:24.931928+0000","last_clean":"2023-07-14T13:12:24.931928+0000","last_became_active":"2023-07-14T13:12:22.929296+0000","last_became_peered":"2023-07-14T13:12:22.929296+0000","last_unstale":"2023-07-14T13:12:24.931928+0000","last_undegraded":"2023-07-14T13:12:24.931928+0000","last_fullsized":"2023-07-14T13:12:24.931928+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:40:13.285925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.932170+0000","last_change":"2023-07-14T13:12:23.927807+0000","last_active":"2023-07-14T13:12:24.932170+0000","last_peered":"2023-07-14T13:12:24.932170+0000","last_clean":"2023-07-14T13:12:24.932170+0000","last_became_active":"2023-07-14T13:12:23.927531+0000","last_became_peered":"2023-07-14T13:12:23.927531+0000","last_unstale":"2023-07-14T13:12:24.932170+0000","last_undegraded":"2023-07-14T13:12:24.932170+0000","last_fullsized":"2023-07-14T13:12:24.932170+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:33:25.146342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"141'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250628+0000","last_change":"2023-07-14T13:12:22.923046+0000","last_active":"2023-07-14T13:12:25.250628+0000","last_peered":"2023-07-14T13:12:25.250628+0000","last_clean":"2023-07-14T13:12:25.250628+0000","last_became_active":"2023-07-14T13:12:22.922783+0000","last_became_peered":"2023-07-14T13:12:22.922783+0000","last_unstale":"2023-07-14T13:12:25.250628+0000","last_undegraded":"2023-07-14T13:12:25.250628+0000","last_fullsized":"2023-07-14T13:12:25.250628+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:11:10.940211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250752+0000","last_change":"2023-07-14T13:12:23.932084+0000","last_active":"2023-07-14T13:12:25.250752+0000","last_peered":"2023-07-14T13:12:25.250752+0000","last_clean":"2023-07-14T13:12:25.250752+0000","last_became_active":"2023-07-14T13:12:23.931757+0000","last_became_peered":"2023-07-14T13:12:23.931757+0000","last_unstale":"2023-07-14T13:12:25.250752+0000","last_undegraded":"2023-07-14T13:12:25.250752+0000","last_fullsized":"2023-07-14T13:12:25.250752+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:16:15.801648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"141'1","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.928303+0000","last_change":"2023-07-14T13:12:22.932158+0000","last_active":"2023-07-14T13:12:25.928303+0000","last_peered":"2023-07-14T13:12:25.928303+0000","last_clean":"2023-07-14T13:12:25.928303+0000","last_became_active":"2023-07-14T13:12:22.931753+0000","last_became_peered":"2023-07-14T13:12:22.931753+0000","last_unstale":"2023-07-14T13:12:25.928303+0000","last_undegraded":"2023-07-14T13:12:25.928303+0000","last_fullsized":"2023-07-14T13:12:25.928303+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:05:51.061780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.928189+0000","last_change":"2023-07-14T13:12:23.932362+0000","last_active":"2023-07-14T13:12:25.928189+0000","last_peered":"2023-07-14T13:12:25.928189+0000","last_clean":"2023-07-14T13:12:25.928189+0000","last_became_active":"2023-07-14T13:12:23.932038+0000","last_became_peered":"2023-07-14T13:12:23.932038+0000","last_unstale":"2023-07-14T13:12:25.928189+0000","last_undegraded":"2023-07-14T13:12:25.928189+0000","last_fullsized":"2023-07-14T13:12:25.928189+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:37:26.540133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"141'1","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.923972+0000","last_change":"2023-07-14T13:12:22.923614+0000","last_active":"2023-07-14T13:12:25.923972+0000","last_peered":"2023-07-14T13:12:25.923972+0000","last_clean":"2023-07-14T13:12:25.923972+0000","last_became_active":"2023-07-14T13:12:22.923312+0000","last_became_peered":"2023-07-14T13:12:22.923312+0000","last_unstale":"2023-07-14T13:12:25.923972+0000","last_undegraded":"2023-07-14T13:12:25.923972+0000","last_fullsized":"2023-07-14T13:12:25.923972+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:31:35.766939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.925456+0000","last_change":"2023-07-14T13:12:23.929136+0000","last_active":"2023-07-14T13:12:24.925456+0000","last_peered":"2023-07-14T13:12:24.925456+0000","last_clean":"2023-07-14T13:12:24.925456+0000","last_became_active":"2023-07-14T13:12:23.928854+0000","last_became_peered":"2023-07-14T13:12:23.928854+0000","last_unstale":"2023-07-14T13:12:24.925456+0000","last_undegraded":"2023-07-14T13:12:24.925456+0000","last_fullsized":"2023-07-14T13:12:24.925456+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:27:00.710016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655274+0000","last_change":"2023-07-14T13:12:22.923307+0000","last_active":"2023-07-14T13:12:25.655274+0000","last_peered":"2023-07-14T13:12:25.655274+0000","last_clean":"2023-07-14T13:12:25.655274+0000","last_became_active":"2023-07-14T13:12:22.922942+0000","last_became_peered":"2023-07-14T13:12:22.922942+0000","last_unstale":"2023-07-14T13:12:25.655274+0000","last_undegraded":"2023-07-14T13:12:25.655274+0000","last_fullsized":"2023-07-14T13:12:25.655274+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:58:17.174165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250541+0000","last_change":"2023-07-14T13:12:23.935370+0000","last_active":"2023-07-14T13:12:25.250541+0000","last_peered":"2023-07-14T13:12:25.250541+0000","last_clean":"2023-07-14T13:12:25.250541+0000","last_became_active":"2023-07-14T13:12:23.935100+0000","last_became_peered":"2023-07-14T13:12:23.935100+0000","last_unstale":"2023-07-14T13:12:25.250541+0000","last_undegraded":"2023-07-14T13:12:25.250541+0000","last_fullsized":"2023-07-14T13:12:25.250541+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:18:08.262248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.923957+0000","last_change":"2023-07-14T13:12:22.924153+0000","last_active":"2023-07-14T13:12:25.923957+0000","last_peered":"2023-07-14T13:12:25.923957+0000","last_clean":"2023-07-14T13:12:25.923957+0000","last_became_active":"2023-07-14T13:12:22.923877+0000","last_became_peered":"2023-07-14T13:12:22.923877+0000","last_unstale":"2023-07-14T13:12:25.923957+0000","last_undegraded":"2023-07-14T13:12:25.923957+0000","last_fullsized":"2023-07-14T13:12:25.923957+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:51:11.092588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655494+0000","last_change":"2023-07-14T13:12:23.932778+0000","last_active":"2023-07-14T13:12:25.655494+0000","last_peered":"2023-07-14T13:12:25.655494+0000","last_clean":"2023-07-14T13:12:25.655494+0000","last_became_active":"2023-07-14T13:12:23.932481+0000","last_became_peered":"2023-07-14T13:12:23.932481+0000","last_unstale":"2023-07-14T13:12:25.655494+0000","last_undegraded":"2023-07-14T13:12:25.655494+0000","last_fullsized":"2023-07-14T13:12:25.655494+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:36:15.509679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"141'1","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250652+0000","last_change":"2023-07-14T13:12:22.920785+0000","last_active":"2023-07-14T13:12:25.250652+0000","last_peered":"2023-07-14T13:12:25.250652+0000","last_clean":"2023-07-14T13:12:25.250652+0000","last_became_active":"2023-07-14T13:12:22.920453+0000","last_became_peered":"2023-07-14T13:12:22.920453+0000","last_unstale":"2023-07-14T13:12:25.250652+0000","last_undegraded":"2023-07-14T13:12:25.250652+0000","last_fullsized":"2023-07-14T13:12:25.250652+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:52:34.516167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.928723+0000","last_change":"2023-07-14T13:12:23.950444+0000","last_active":"2023-07-14T13:12:25.928723+0000","last_peered":"2023-07-14T13:12:25.928723+0000","last_clean":"2023-07-14T13:12:25.928723+0000","last_became_active":"2023-07-14T13:12:23.950150+0000","last_became_peered":"2023-07-14T13:12:23.950150+0000","last_unstale":"2023-07-14T13:12:25.928723+0000","last_undegraded":"2023-07-14T13:12:25.928723+0000","last_fullsized":"2023-07-14T13:12:25.928723+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:21:38.629053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"141'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.341669+0000","last_change":"2023-07-14T13:12:22.922475+0000","last_active":"2023-07-14T13:12:25.341669+0000","last_peered":"2023-07-14T13:12:25.341669+0000","last_clean":"2023-07-14T13:12:25.341669+0000","last_became_active":"2023-07-14T13:12:22.922174+0000","last_became_peered":"2023-07-14T13:12:22.922174+0000","last_unstale":"2023-07-14T13:12:25.341669+0000","last_undegraded":"2023-07-14T13:12:25.341669+0000","last_fullsized":"2023-07-14T13:12:25.341669+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:38:19.926755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.924696+0000","last_change":"2023-07-14T13:12:23.934309+0000","last_active":"2023-07-14T13:12:25.924696+0000","last_peered":"2023-07-14T13:12:25.924696+0000","last_clean":"2023-07-14T13:12:25.924696+0000","last_became_active":"2023-07-14T13:12:23.933997+0000","last_became_peered":"2023-07-14T13:12:23.933997+0000","last_unstale":"2023-07-14T13:12:25.924696+0000","last_undegraded":"2023-07-14T13:12:25.924696+0000","last_fullsized":"2023-07-14T13:12:25.924696+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:56:42.302251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"141'1","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931939+0000","last_change":"2023-07-14T13:12:22.929389+0000","last_active":"2023-07-14T13:12:24.931939+0000","last_peered":"2023-07-14T13:12:24.931939+0000","last_clean":"2023-07-14T13:12:24.931939+0000","last_became_active":"2023-07-14T13:12:22.929005+0000","last_became_peered":"2023-07-14T13:12:22.929005+0000","last_unstale":"2023-07-14T13:12:24.931939+0000","last_undegraded":"2023-07-14T13:12:24.931939+0000","last_fullsized":"2023-07-14T13:12:24.931939+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:43:42.158206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655797+0000","last_change":"2023-07-14T13:12:23.931550+0000","last_active":"2023-07-14T13:12:25.655797+0000","last_peered":"2023-07-14T13:12:25.655797+0000","last_clean":"2023-07-14T13:12:25.655797+0000","last_became_active":"2023-07-14T13:12:23.931271+0000","last_became_peered":"2023-07-14T13:12:23.931271+0000","last_unstale":"2023-07-14T13:12:25.655797+0000","last_undegraded":"2023-07-14T13:12:25.655797+0000","last_fullsized":"2023-07-14T13:12:25.655797+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:55:55.449018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931707+0000","last_change":"2023-07-14T13:12:22.929144+0000","last_active":"2023-07-14T13:12:24.931707+0000","last_peered":"2023-07-14T13:12:24.931707+0000","last_clean":"2023-07-14T13:12:24.931707+0000","last_became_active":"2023-07-14T13:12:22.928845+0000","last_became_peered":"2023-07-14T13:12:22.928845+0000","last_unstale":"2023-07-14T13:12:24.931707+0000","last_undegraded":"2023-07-14T13:12:24.931707+0000","last_fullsized":"2023-07-14T13:12:24.931707+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:15:34.928835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.923688+0000","last_change":"2023-07-14T13:12:23.934325+0000","last_active":"2023-07-14T13:12:25.923688+0000","last_peered":"2023-07-14T13:12:25.923688+0000","last_clean":"2023-07-14T13:12:25.923688+0000","last_became_active":"2023-07-14T13:12:23.933972+0000","last_became_peered":"2023-07-14T13:12:23.933972+0000","last_unstale":"2023-07-14T13:12:25.923688+0000","last_undegraded":"2023-07-14T13:12:25.923688+0000","last_fullsized":"2023-07-14T13:12:25.923688+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:55:48.173796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"141'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.924096+0000","last_change":"2023-07-14T13:12:22.929261+0000","last_active":"2023-07-14T13:12:25.924096+0000","last_peered":"2023-07-14T13:12:25.924096+0000","last_clean":"2023-07-14T13:12:25.924096+0000","last_became_active":"2023-07-14T13:12:22.928961+0000","last_became_peered":"2023-07-14T13:12:22.928961+0000","last_unstale":"2023-07-14T13:12:25.924096+0000","last_undegraded":"2023-07-14T13:12:25.924096+0000","last_fullsized":"2023-07-14T13:12:25.924096+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:25:09.165376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.924892+0000","last_change":"2023-07-14T13:12:23.926403+0000","last_active":"2023-07-14T13:12:24.924892+0000","last_peered":"2023-07-14T13:12:24.924892+0000","last_clean":"2023-07-14T13:12:24.924892+0000","last_became_active":"2023-07-14T13:12:23.926116+0000","last_became_peered":"2023-07-14T13:12:23.926116+0000","last_unstale":"2023-07-14T13:12:24.924892+0000","last_undegraded":"2023-07-14T13:12:24.924892+0000","last_fullsized":"2023-07-14T13:12:24.924892+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:32:20.873209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931419+0000","last_change":"2023-07-14T13:12:22.931434+0000","last_active":"2023-07-14T13:12:24.931419+0000","last_peered":"2023-07-14T13:12:24.931419+0000","last_clean":"2023-07-14T13:12:24.931419+0000","last_became_active":"2023-07-14T13:12:22.931004+0000","last_became_peered":"2023-07-14T13:12:22.931004+0000","last_unstale":"2023-07-14T13:12:24.931419+0000","last_undegraded":"2023-07-14T13:12:24.931419+0000","last_fullsized":"2023-07-14T13:12:24.931419+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:19:51.969743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.925678+0000","last_change":"2023-07-14T13:12:23.935109+0000","last_active":"2023-07-14T13:12:24.925678+0000","last_peered":"2023-07-14T13:12:24.925678+0000","last_clean":"2023-07-14T13:12:24.925678+0000","last_became_active":"2023-07-14T13:12:23.933488+0000","last_became_peered":"2023-07-14T13:12:23.933488+0000","last_unstale":"2023-07-14T13:12:24.925678+0000","last_undegraded":"2023-07-14T13:12:24.925678+0000","last_fullsized":"2023-07-14T13:12:24.925678+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:11:53.094678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.925082+0000","last_change":"2023-07-14T13:12:22.928525+0000","last_active":"2023-07-14T13:12:24.925082+0000","last_peered":"2023-07-14T13:12:24.925082+0000","last_clean":"2023-07-14T13:12:24.925082+0000","last_became_active":"2023-07-14T13:12:22.928254+0000","last_became_peered":"2023-07-14T13:12:22.928254+0000","last_unstale":"2023-07-14T13:12:24.925082+0000","last_undegraded":"2023-07-14T13:12:24.925082+0000","last_fullsized":"2023-07-14T13:12:24.925082+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:16:13.047280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655319+0000","last_change":"2023-07-14T13:12:23.931496+0000","last_active":"2023-07-14T13:12:25.655319+0000","last_peered":"2023-07-14T13:12:25.655319+0000","last_clean":"2023-07-14T13:12:25.655319+0000","last_became_active":"2023-07-14T13:12:23.930916+0000","last_became_peered":"2023-07-14T13:12:23.930916+0000","last_unstale":"2023-07-14T13:12:25.655319+0000","last_undegraded":"2023-07-14T13:12:25.655319+0000","last_fullsized":"2023-07-14T13:12:25.655319+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:31:59.482026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931136+0000","last_change":"2023-07-14T13:12:22.926412+0000","last_active":"2023-07-14T13:12:24.931136+0000","last_peered":"2023-07-14T13:12:24.931136+0000","last_clean":"2023-07-14T13:12:24.931136+0000","last_became_active":"2023-07-14T13:12:22.925771+0000","last_became_peered":"2023-07-14T13:12:22.925771+0000","last_unstale":"2023-07-14T13:12:24.931136+0000","last_undegraded":"2023-07-14T13:12:24.931136+0000","last_fullsized":"2023-07-14T13:12:24.931136+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:44:32.003609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.924776+0000","last_change":"2023-07-14T13:12:23.928742+0000","last_active":"2023-07-14T13:12:25.924776+0000","last_peered":"2023-07-14T13:12:25.924776+0000","last_clean":"2023-07-14T13:12:25.924776+0000","last_became_active":"2023-07-14T13:12:23.928212+0000","last_became_peered":"2023-07-14T13:12:23.928212+0000","last_unstale":"2023-07-14T13:12:25.924776+0000","last_undegraded":"2023-07-14T13:12:25.924776+0000","last_fullsized":"2023-07-14T13:12:25.924776+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:21:19.029532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"141'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.924687+0000","last_change":"2023-07-14T13:12:22.927390+0000","last_active":"2023-07-14T13:12:25.924687+0000","last_peered":"2023-07-14T13:12:25.924687+0000","last_clean":"2023-07-14T13:12:25.924687+0000","last_became_active":"2023-07-14T13:12:22.927081+0000","last_became_peered":"2023-07-14T13:12:22.927081+0000","last_unstale":"2023-07-14T13:12:25.924687+0000","last_undegraded":"2023-07-14T13:12:25.924687+0000","last_fullsized":"2023-07-14T13:12:25.924687+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:03:44.145468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250463+0000","last_change":"2023-07-14T13:12:23.932309+0000","last_active":"2023-07-14T13:12:25.250463+0000","last_peered":"2023-07-14T13:12:25.250463+0000","last_clean":"2023-07-14T13:12:25.250463+0000","last_became_active":"2023-07-14T13:12:23.931410+0000","last_became_peered":"2023-07-14T13:12:23.931410+0000","last_unstale":"2023-07-14T13:12:25.250463+0000","last_undegraded":"2023-07-14T13:12:25.250463+0000","last_fullsized":"2023-07-14T13:12:25.250463+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:43:09.357995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"142'1","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.113137+0000","last_change":"2023-07-14T13:12:22.927740+0000","last_active":"2023-07-14T13:12:25.113137+0000","last_peered":"2023-07-14T13:12:25.113137+0000","last_clean":"2023-07-14T13:12:25.113137+0000","last_became_active":"2023-07-14T13:12:22.927419+0000","last_became_peered":"2023-07-14T13:12:22.927419+0000","last_unstale":"2023-07-14T13:12:25.113137+0000","last_undegraded":"2023-07-14T13:12:25.113137+0000","last_fullsized":"2023-07-14T13:12:25.113137+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:44:44.418690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931944+0000","last_change":"2023-07-14T13:12:23.939638+0000","last_active":"2023-07-14T13:12:24.931944+0000","last_peered":"2023-07-14T13:12:24.931944+0000","last_clean":"2023-07-14T13:12:24.931944+0000","last_became_active":"2023-07-14T13:12:23.939315+0000","last_became_peered":"2023-07-14T13:12:23.939315+0000","last_unstale":"2023-07-14T13:12:24.931944+0000","last_undegraded":"2023-07-14T13:12:24.931944+0000","last_fullsized":"2023-07-14T13:12:24.931944+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:12:12.984128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.113539+0000","last_change":"2023-07-14T13:12:22.926828+0000","last_active":"2023-07-14T13:12:25.113539+0000","last_peered":"2023-07-14T13:12:25.113539+0000","last_clean":"2023-07-14T13:12:25.113539+0000","last_became_active":"2023-07-14T13:12:22.926532+0000","last_became_peered":"2023-07-14T13:12:22.926532+0000","last_unstale":"2023-07-14T13:12:25.113539+0000","last_undegraded":"2023-07-14T13:12:25.113539+0000","last_fullsized":"2023-07-14T13:12:25.113539+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:58:56.924154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.341686+0000","last_change":"2023-07-14T13:12:23.927050+0000","last_active":"2023-07-14T13:12:25.341686+0000","last_peered":"2023-07-14T13:12:25.341686+0000","last_clean":"2023-07-14T13:12:25.341686+0000","last_became_active":"2023-07-14T13:12:23.926748+0000","last_became_peered":"2023-07-14T13:12:23.926748+0000","last_unstale":"2023-07-14T13:12:25.341686+0000","last_undegraded":"2023-07-14T13:12:25.341686+0000","last_fullsized":"2023-07-14T13:12:25.341686+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:57:22.046312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.924823+0000","last_change":"2023-07-14T13:12:22.928393+0000","last_active":"2023-07-14T13:12:25.924823+0000","last_peered":"2023-07-14T13:12:25.924823+0000","last_clean":"2023-07-14T13:12:25.924823+0000","last_became_active":"2023-07-14T13:12:22.928069+0000","last_became_peered":"2023-07-14T13:12:22.928069+0000","last_unstale":"2023-07-14T13:12:25.924823+0000","last_undegraded":"2023-07-14T13:12:25.924823+0000","last_fullsized":"2023-07-14T13:12:25.924823+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:23:40.303722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.923872+0000","last_change":"2023-07-14T13:12:23.930024+0000","last_active":"2023-07-14T13:12:25.923872+0000","last_peered":"2023-07-14T13:12:25.923872+0000","last_clean":"2023-07-14T13:12:25.923872+0000","last_became_active":"2023-07-14T13:12:23.929662+0000","last_became_peered":"2023-07-14T13:12:23.929662+0000","last_unstale":"2023-07-14T13:12:25.923872+0000","last_undegraded":"2023-07-14T13:12:25.923872+0000","last_fullsized":"2023-07-14T13:12:25.923872+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:59:34.817667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.928474+0000","last_change":"2023-07-14T13:12:22.926375+0000","last_active":"2023-07-14T13:12:25.928474+0000","last_peered":"2023-07-14T13:12:25.928474+0000","last_clean":"2023-07-14T13:12:25.928474+0000","last_became_active":"2023-07-14T13:12:22.926097+0000","last_became_peered":"2023-07-14T13:12:22.926097+0000","last_unstale":"2023-07-14T13:12:25.928474+0000","last_undegraded":"2023-07-14T13:12:25.928474+0000","last_fullsized":"2023-07-14T13:12:25.928474+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:26:59.700388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.924958+0000","last_change":"2023-07-14T13:12:23.932543+0000","last_active":"2023-07-14T13:12:24.924958+0000","last_peered":"2023-07-14T13:12:24.924958+0000","last_clean":"2023-07-14T13:12:24.924958+0000","last_became_active":"2023-07-14T13:12:23.932099+0000","last_became_peered":"2023-07-14T13:12:23.932099+0000","last_unstale":"2023-07-14T13:12:24.924958+0000","last_undegraded":"2023-07-14T13:12:24.924958+0000","last_fullsized":"2023-07-14T13:12:24.924958+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:25:49.842307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.928641+0000","last_change":"2023-07-14T13:12:22.928830+0000","last_active":"2023-07-14T13:12:25.928641+0000","last_peered":"2023-07-14T13:12:25.928641+0000","last_clean":"2023-07-14T13:12:25.928641+0000","last_became_active":"2023-07-14T13:12:22.928458+0000","last_became_peered":"2023-07-14T13:12:22.928458+0000","last_unstale":"2023-07-14T13:12:25.928641+0000","last_undegraded":"2023-07-14T13:12:25.928641+0000","last_fullsized":"2023-07-14T13:12:25.928641+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:11:52.085049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931309+0000","last_change":"2023-07-14T13:12:23.934915+0000","last_active":"2023-07-14T13:12:24.931309+0000","last_peered":"2023-07-14T13:12:24.931309+0000","last_clean":"2023-07-14T13:12:24.931309+0000","last_became_active":"2023-07-14T13:12:23.934602+0000","last_became_peered":"2023-07-14T13:12:23.934602+0000","last_unstale":"2023-07-14T13:12:24.931309+0000","last_undegraded":"2023-07-14T13:12:24.931309+0000","last_fullsized":"2023-07-14T13:12:24.931309+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:59:04.140295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.923948+0000","last_change":"2023-07-14T13:12:22.924885+0000","last_active":"2023-07-14T13:12:25.923948+0000","last_peered":"2023-07-14T13:12:25.923948+0000","last_clean":"2023-07-14T13:12:25.923948+0000","last_became_active":"2023-07-14T13:12:22.924441+0000","last_became_peered":"2023-07-14T13:12:22.924441+0000","last_unstale":"2023-07-14T13:12:25.923948+0000","last_undegraded":"2023-07-14T13:12:25.923948+0000","last_fullsized":"2023-07-14T13:12:25.923948+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:48:51.510190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250476+0000","last_change":"2023-07-14T13:12:23.921136+0000","last_active":"2023-07-14T13:12:25.250476+0000","last_peered":"2023-07-14T13:12:25.250476+0000","last_clean":"2023-07-14T13:12:25.250476+0000","last_became_active":"2023-07-14T13:12:23.920857+0000","last_became_peered":"2023-07-14T13:12:23.920857+0000","last_unstale":"2023-07-14T13:12:25.250476+0000","last_undegraded":"2023-07-14T13:12:25.250476+0000","last_fullsized":"2023-07-14T13:12:25.250476+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:27:09.718637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931141+0000","last_change":"2023-07-14T13:12:22.926905+0000","last_active":"2023-07-14T13:12:24.931141+0000","last_peered":"2023-07-14T13:12:24.931141+0000","last_clean":"2023-07-14T13:12:24.931141+0000","last_became_active":"2023-07-14T13:12:22.926579+0000","last_became_peered":"2023-07-14T13:12:22.926579+0000","last_unstale":"2023-07-14T13:12:24.931141+0000","last_undegraded":"2023-07-14T13:12:24.931141+0000","last_fullsized":"2023-07-14T13:12:24.931141+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:37:37.042148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931678+0000","last_change":"2023-07-14T13:12:23.929341+0000","last_active":"2023-07-14T13:12:24.931678+0000","last_peered":"2023-07-14T13:12:24.931678+0000","last_clean":"2023-07-14T13:12:24.931678+0000","last_became_active":"2023-07-14T13:12:23.928895+0000","last_became_peered":"2023-07-14T13:12:23.928895+0000","last_unstale":"2023-07-14T13:12:24.931678+0000","last_undegraded":"2023-07-14T13:12:24.931678+0000","last_fullsized":"2023-07-14T13:12:24.931678+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:11:10.949805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"141'8","reported_seq":21,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.924947+0000","last_change":"2023-07-14T13:12:22.929600+0000","last_active":"2023-07-14T13:12:24.924947+0000","last_peered":"2023-07-14T13:12:24.924947+0000","last_clean":"2023-07-14T13:12:24.924947+0000","last_became_active":"2023-07-14T13:12:22.929310+0000","last_became_peered":"2023-07-14T13:12:22.929310+0000","last_unstale":"2023-07-14T13:12:24.924947+0000","last_undegraded":"2023-07-14T13:12:24.924947+0000","last_fullsized":"2023-07-14T13:12:24.924947+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:53:11.459050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"129'249","reported_seq":856,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931452+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:12:24.931452+0000","last_peered":"2023-07-14T13:12:24.931452+0000","last_clean":"2023-07-14T13:12:24.931452+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:12:24.931452+0000","last_undegraded":"2023-07-14T13:12:24.931452+0000","last_fullsized":"2023-07-14T13:12:24.931452+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:21:47.600102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":228,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655453+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:12:25.655453+0000","last_peered":"2023-07-14T13:12:25.655453+0000","last_clean":"2023-07-14T13:12:25.655453+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:12:25.655453+0000","last_undegraded":"2023-07-14T13:12:25.655453+0000","last_fullsized":"2023-07-14T13:12:25.655453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:18:01.972641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.113439+0000","last_change":"2023-07-14T13:12:23.944309+0000","last_active":"2023-07-14T13:12:25.113439+0000","last_peered":"2023-07-14T13:12:25.113439+0000","last_clean":"2023-07-14T13:12:25.113439+0000","last_became_active":"2023-07-14T13:12:23.943945+0000","last_became_peered":"2023-07-14T13:12:23.943945+0000","last_unstale":"2023-07-14T13:12:25.113439+0000","last_undegraded":"2023-07-14T13:12:25.113439+0000","last_fullsized":"2023-07-14T13:12:25.113439+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:09:13.612325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"141'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.925238+0000","last_change":"2023-07-14T13:12:22.929681+0000","last_active":"2023-07-14T13:12:24.925238+0000","last_peered":"2023-07-14T13:12:24.925238+0000","last_clean":"2023-07-14T13:12:24.925238+0000","last_became_active":"2023-07-14T13:12:22.929406+0000","last_became_peered":"2023-07-14T13:12:22.929406+0000","last_unstale":"2023-07-14T13:12:24.925238+0000","last_undegraded":"2023-07-14T13:12:24.925238+0000","last_fullsized":"2023-07-14T13:12:24.925238+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:05:51.061780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":232,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.931324+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:12:24.931324+0000","last_peered":"2023-07-14T13:12:24.931324+0000","last_clean":"2023-07-14T13:12:24.931324+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:12:24.931324+0000","last_undegraded":"2023-07-14T13:12:24.931324+0000","last_fullsized":"2023-07-14T13:12:24.931324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:17:15.868940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250327+0000","last_change":"2023-07-14T13:12:23.925157+0000","last_active":"2023-07-14T13:12:25.250327+0000","last_peered":"2023-07-14T13:12:25.250327+0000","last_clean":"2023-07-14T13:12:25.250327+0000","last_became_active":"2023-07-14T13:12:23.924877+0000","last_became_peered":"2023-07-14T13:12:23.924877+0000","last_unstale":"2023-07-14T13:12:25.250327+0000","last_undegraded":"2023-07-14T13:12:25.250327+0000","last_fullsized":"2023-07-14T13:12:25.250327+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:54:01.846060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.925728+0000","last_change":"2023-07-14T13:12:22.924565+0000","last_active":"2023-07-14T13:12:24.925728+0000","last_peered":"2023-07-14T13:12:24.925728+0000","last_clean":"2023-07-14T13:12:24.925728+0000","last_became_active":"2023-07-14T13:12:22.924067+0000","last_became_peered":"2023-07-14T13:12:22.924067+0000","last_unstale":"2023-07-14T13:12:24.925728+0000","last_undegraded":"2023-07-14T13:12:24.925728+0000","last_fullsized":"2023-07-14T13:12:24.925728+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:21:37.619425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":230,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.341258+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:12:25.341258+0000","last_peered":"2023-07-14T13:12:25.341258+0000","last_clean":"2023-07-14T13:12:25.341258+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:12:25.341258+0000","last_undegraded":"2023-07-14T13:12:25.341258+0000","last_fullsized":"2023-07-14T13:12:25.341258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:27:40.934414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.341376+0000","last_change":"2023-07-14T13:12:23.935663+0000","last_active":"2023-07-14T13:12:25.341376+0000","last_peered":"2023-07-14T13:12:25.341376+0000","last_clean":"2023-07-14T13:12:25.341376+0000","last_became_active":"2023-07-14T13:12:23.935393+0000","last_became_peered":"2023-07-14T13:12:23.935393+0000","last_unstale":"2023-07-14T13:12:25.341376+0000","last_undegraded":"2023-07-14T13:12:25.341376+0000","last_fullsized":"2023-07-14T13:12:25.341376+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:39:22.919806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.925024+0000","last_change":"2023-07-14T13:12:22.927281+0000","last_active":"2023-07-14T13:12:24.925024+0000","last_peered":"2023-07-14T13:12:24.925024+0000","last_clean":"2023-07-14T13:12:24.925024+0000","last_became_active":"2023-07-14T13:12:22.926987+0000","last_became_peered":"2023-07-14T13:12:22.926987+0000","last_unstale":"2023-07-14T13:12:24.925024+0000","last_undegraded":"2023-07-14T13:12:24.925024+0000","last_fullsized":"2023-07-14T13:12:24.925024+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:35:50.750361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":228,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655229+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:12:25.655229+0000","last_peered":"2023-07-14T13:12:25.655229+0000","last_clean":"2023-07-14T13:12:25.655229+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:12:25.655229+0000","last_undegraded":"2023-07-14T13:12:25.655229+0000","last_fullsized":"2023-07-14T13:12:25.655229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:57:29.776942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.113152+0000","last_change":"2023-07-14T13:12:23.933825+0000","last_active":"2023-07-14T13:12:25.113152+0000","last_peered":"2023-07-14T13:12:25.113152+0000","last_clean":"2023-07-14T13:12:25.113152+0000","last_became_active":"2023-07-14T13:12:23.933461+0000","last_became_peered":"2023-07-14T13:12:23.933461+0000","last_unstale":"2023-07-14T13:12:25.113152+0000","last_undegraded":"2023-07-14T13:12:25.113152+0000","last_fullsized":"2023-07-14T13:12:25.113152+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:36:43.122074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.113189+0000","last_change":"2023-07-14T13:12:22.926462+0000","last_active":"2023-07-14T13:12:25.113189+0000","last_peered":"2023-07-14T13:12:25.113189+0000","last_clean":"2023-07-14T13:12:25.113189+0000","last_became_active":"2023-07-14T13:12:22.926168+0000","last_became_peered":"2023-07-14T13:12:22.926168+0000","last_unstale":"2023-07-14T13:12:25.113189+0000","last_undegraded":"2023-07-14T13:12:25.113189+0000","last_fullsized":"2023-07-14T13:12:25.113189+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:48:14.138549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":240,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250674+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:12:25.250674+0000","last_peered":"2023-07-14T13:12:25.250674+0000","last_clean":"2023-07-14T13:12:25.250674+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:12:25.250674+0000","last_undegraded":"2023-07-14T13:12:25.250674+0000","last_fullsized":"2023-07-14T13:12:25.250674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:39:26.451120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655585+0000","last_change":"2023-07-14T13:12:23.942407+0000","last_active":"2023-07-14T13:12:25.655585+0000","last_peered":"2023-07-14T13:12:25.655585+0000","last_clean":"2023-07-14T13:12:25.655585+0000","last_became_active":"2023-07-14T13:12:23.942065+0000","last_became_peered":"2023-07-14T13:12:23.942065+0000","last_unstale":"2023-07-14T13:12:25.655585+0000","last_undegraded":"2023-07-14T13:12:25.655585+0000","last_fullsized":"2023-07-14T13:12:25.655585+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:47:09.702453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655478+0000","last_change":"2023-07-14T13:12:22.922833+0000","last_active":"2023-07-14T13:12:25.655478+0000","last_peered":"2023-07-14T13:12:25.655478+0000","last_clean":"2023-07-14T13:12:25.655478+0000","last_became_active":"2023-07-14T13:12:22.922520+0000","last_became_peered":"2023-07-14T13:12:22.922520+0000","last_unstale":"2023-07-14T13:12:25.655478+0000","last_undegraded":"2023-07-14T13:12:25.655478+0000","last_fullsized":"2023-07-14T13:12:25.655478+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:35:30.928340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":232,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.932096+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:12:24.932096+0000","last_peered":"2023-07-14T13:12:24.932096+0000","last_clean":"2023-07-14T13:12:24.932096+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:12:24.932096+0000","last_undegraded":"2023-07-14T13:12:24.932096+0000","last_fullsized":"2023-07-14T13:12:24.932096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:05:08.461443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.925289+0000","last_change":"2023-07-14T13:12:23.932685+0000","last_active":"2023-07-14T13:12:24.925289+0000","last_peered":"2023-07-14T13:12:24.925289+0000","last_clean":"2023-07-14T13:12:24.925289+0000","last_became_active":"2023-07-14T13:12:23.932351+0000","last_became_peered":"2023-07-14T13:12:23.932351+0000","last_unstale":"2023-07-14T13:12:24.925289+0000","last_undegraded":"2023-07-14T13:12:24.925289+0000","last_fullsized":"2023-07-14T13:12:24.925289+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:01:09.308214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"141'3","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655609+0000","last_change":"2023-07-14T13:12:22.924751+0000","last_active":"2023-07-14T13:12:25.655609+0000","last_peered":"2023-07-14T13:12:25.655609+0000","last_clean":"2023-07-14T13:12:25.655609+0000","last_became_active":"2023-07-14T13:12:22.924479+0000","last_became_peered":"2023-07-14T13:12:22.924479+0000","last_unstale":"2023-07-14T13:12:25.655609+0000","last_undegraded":"2023-07-14T13:12:25.655609+0000","last_fullsized":"2023-07-14T13:12:25.655609+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:15:41.806178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":240,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.250620+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:12:25.250620+0000","last_peered":"2023-07-14T13:12:25.250620+0000","last_clean":"2023-07-14T13:12:25.250620+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:12:25.250620+0000","last_undegraded":"2023-07-14T13:12:25.250620+0000","last_fullsized":"2023-07-14T13:12:25.250620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:15:43.607286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.655721+0000","last_change":"2023-07-14T13:12:23.930478+0000","last_active":"2023-07-14T13:12:25.655721+0000","last_peered":"2023-07-14T13:12:25.655721+0000","last_clean":"2023-07-14T13:12:25.655721+0000","last_became_active":"2023-07-14T13:12:23.930209+0000","last_became_peered":"2023-07-14T13:12:23.930209+0000","last_unstale":"2023-07-14T13:12:25.655721+0000","last_undegraded":"2023-07-14T13:12:25.655721+0000","last_fullsized":"2023-07-14T13:12:25.655721+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:22.892583+0000","last_clean_scrub_stamp":"2023-07-14T13:12:22.892583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:45:58.759709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"141'6","reported_seq":19,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:24.925528+0000","last_change":"2023-07-14T13:12:22.925040+0000","last_active":"2023-07-14T13:12:24.925528+0000","last_peered":"2023-07-14T13:12:24.925528+0000","last_clean":"2023-07-14T13:12:24.925528+0000","last_became_active":"2023-07-14T13:12:22.924712+0000","last_became_peered":"2023-07-14T13:12:22.924712+0000","last_unstale":"2023-07-14T13:12:24.925528+0000","last_undegraded":"2023-07-14T13:12:24.925528+0000","last_fullsized":"2023-07-14T13:12:24.925528+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:12:21.882955+0000","last_clean_scrub_stamp":"2023-07-14T13:12:21.882955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:27:12.980300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":232,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-14T13:12:25.112750+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:12:25.112750+0000","last_peered":"2023-07-14T13:12:25.112750+0000","last_clean":"2023-07-14T13:12:25.112750+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:12:25.112750+0000","last_undegraded":"2023-07-14T13:12:25.112750+0000","last_fullsized":"2023-07-14T13:12:25.112750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:02:24.353646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575084,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59604,"kb_used_data":2316,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312236,"statfs":{"total":96636764160,"available":96575729664,"internally_reserved":0,"allocated":2371584,"data_stored":1487553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.68999999999999995,"15min":0.70699999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.84199999999999997,"5min":1.262,"15min":1.262},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71699999999999997,"15min":0.72899999999999998},"min":{"1min":0.54100000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.73299999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.70599999999999996,"15min":0.72999999999999998},"min":{"1min":0.44,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83799999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72799999999999998,"15min":0.74299999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.82299999999999995}]},{"osd":2,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71199999999999997,"15min":0.72599999999999998},"min":{"1min":0.48999999999999999,"5min":0.46100000000000002,"15min":0.42699999999999999},"max":{"1min":0.91500000000000004,"5min":1.073,"15min":1.073},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.753},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84899999999999998,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.72699999999999998,"15min":0.73599999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.091,"5min":1.161,"15min":1.161},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73999999999999999,"15min":0.75600000000000001},"min":{"1min":0.51100000000000001,"5min":0.47899999999999998,"15min":0.41499999999999998},"max":{"1min":0.94899999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.76000000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56899999999999995,"15min":0.57899999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.318},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.022},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.40000000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.66400000000000003}]},{"osd":5,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.42699999999999999,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.91000000000000003,"5min":0.98099999999999998,"15min":0.98299999999999998},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63100000000000001,"15min":0.64900000000000002},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.34100000000000003},"max":{"1min":0.80500000000000005,"5min":1.028,"15min":1.028},"last":0.85299999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.42699999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.0489999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.68100000000000005,"15min":0.67700000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.36299999999999999},"max":{"1min":1.151,"5min":4.1130000000000004,"15min":4.1130000000000004},"last":0.70999999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575085,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1765376,"data_stored":896991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70699999999999996,"15min":0.72699999999999998},"min":{"1min":0.496,"5min":0.47899999999999998,"15min":0.38},"max":{"1min":0.89300000000000002,"5min":0.90400000000000003,"15min":0.996},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69999999999999996,"15min":0.72399999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88100000000000001,"5min":0.98199999999999998,"15min":1.0800000000000001},"last":0.501}]},{"osd":1,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70099999999999996,"15min":0.73299999999999998},"min":{"1min":0.48499999999999999,"5min":0.42299999999999999,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.0209999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69199999999999995,"15min":0.71899999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82999999999999996,"5min":0.88100000000000001,"15min":1.077},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.746},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.45900000000000002},"max":{"1min":0.872,"5min":0.95099999999999996,"15min":1.105},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71799999999999997,"15min":0.745},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.92100000000000004,"5min":0.99099999999999999,"15min":1.0900000000000001},"last":0.745}]},{"osd":3,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72899999999999998,"15min":0.76600000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89300000000000002,"5min":1.054,"15min":1.1359999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71399999999999997,"15min":0.753},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93600000000000005,"5min":0.94799999999999995,"15min":1.1080000000000001},"last":0.67100000000000004}]},{"osd":4,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.63900000000000001,"15min":0.63600000000000001},"min":{"1min":0.47499999999999998,"5min":0.439,"15min":0.38500000000000001},"max":{"1min":0.79800000000000004,"5min":0.95499999999999996,"15min":1.0780000000000001},"last":0.59999999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63,"15min":0.64000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":1.579},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48199999999999998,"5min":0.46300000000000002,"15min":0.42399999999999999},"max":{"1min":0.85599999999999998,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.72499999999999998}]},{"osd":7,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66000000000000003,"15min":0.65900000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91800000000000004,"5min":1.0940000000000001,"15min":1.1200000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.36199999999999999},"max":{"1min":0.90400000000000003,"5min":1.0209999999999999,"15min":1.657},"last":0.70199999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575084,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50824,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321016,"statfs":{"total":96636764160,"available":96584720384,"internally_reserved":0,"allocated":1769472,"data_stored":896569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68799999999999994,"15min":0.72199999999999998},"min":{"1min":0.45400000000000001,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":2.6699999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.46500000000000002,"5min":0.41699999999999998,"15min":0.32800000000000001},"max":{"1min":0.86799999999999999,"5min":1.083,"15min":1.083},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68899999999999995,"15min":0.71799999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44500000000000001},"max":{"1min":0.93600000000000005,"5min":1.05,"15min":1.079},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.71499999999999997,"15min":0.73899999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.36799999999999999},"max":{"1min":0.873,"5min":0.94599999999999995,"15min":2.706},"last":0.80200000000000005}]},{"osd":2,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70899999999999996,"15min":0.72799999999999998},"min":{"1min":0.41199999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90700000000000003,"5min":1.212,"15min":1.212},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70799999999999996,"15min":0.72699999999999998},"min":{"1min":0.497,"5min":0.44800000000000001,"15min":0.433},"max":{"1min":0.94599999999999995,"5min":1.181,"15min":1.181},"last":0.85099999999999998}]},{"osd":3,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72499999999999998,"15min":0.74199999999999999},"min":{"1min":0.53900000000000003,"5min":0.41799999999999998,"15min":0.377},"max":{"1min":0.88600000000000001,"5min":0.95199999999999996,"15min":2.7389999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73099999999999998,"15min":0.753},"min":{"1min":0.51600000000000001,"5min":0.47299999999999998,"15min":0.39700000000000002},"max":{"1min":0.94499999999999995,"5min":1.304,"15min":1.304},"last":0.88400000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.628,"15min":0.628},"min":{"1min":0.38500000000000001,"5min":0.38,"15min":0.28599999999999998},"max":{"1min":0.85599999999999998,"5min":1.129,"15min":1.129},"last":0.751},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.69099999999999995,"15min":0.68400000000000005},"min":{"1min":0.53700000000000003,"5min":0.39900000000000002,"15min":0.36299999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":2.7719999999999998},"last":0.46300000000000002}]},{"osd":6,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60199999999999998,"15min":0.60599999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.32700000000000001},"max":{"1min":0.89700000000000002,"5min":1.169,"15min":1.169},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42599999999999999,"5min":0.39400000000000002,"15min":0.34300000000000003},"max":{"1min":0.91000000000000003,"5min":1.238,"15min":1.238},"last":0.90800000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64600000000000002,"15min":0.64300000000000002},"min":{"1min":0.40899999999999997,"5min":0.36899999999999999,"15min":0.32900000000000001},"max":{"1min":0.90800000000000003,"5min":1.026,"15min":3.0230000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68300000000000005,"15min":0.67700000000000005},"min":{"1min":0.49399999999999999,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.98199999999999998,"5min":1.2589999999999999,"15min":1.407},"last":0.54200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575084,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36876,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334964,"statfs":{"total":96636764160,"available":96599003136,"internally_reserved":0,"allocated":1773568,"data_stored":897973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.70599999999999996,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.411},"last":0.747},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.45600000000000002,"5min":0.45100000000000001,"15min":0.435},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.1200000000000001},"last":0.66700000000000004}]},{"osd":1,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71199999999999997,"15min":0.74399999999999999},"min":{"1min":0.496,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84099999999999997,"5min":0.92500000000000004,"15min":1.077},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70399999999999996,"15min":0.72999999999999998},"min":{"1min":0.52700000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.0469999999999999},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.71999999999999997,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.42199999999999999,"15min":0.35199999999999998},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72099999999999997,"15min":0.76400000000000001},"min":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.86699999999999999,"5min":0.98199999999999998,"15min":1.387},"last":0.72999999999999998}]},{"osd":3,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.49399999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89700000000000002,"5min":0.95399999999999996,"15min":1.008},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.74099999999999999,"15min":0.76600000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46800000000000003},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.69799999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.378},"max":{"1min":0.92200000000000004,"5min":0.92400000000000004,"15min":0.97099999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.40400000000000003,"15min":0.34599999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.71399999999999997}]},{"osd":6,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.014},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67900000000000005,"15min":0.67000000000000004},"min":{"1min":0.48599999999999999,"5min":0.443,"15min":0.374},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.0289999999999999},"last":0.59699999999999998}]},{"osd":7,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.69899999999999995,"15min":0.67200000000000004},"min":{"1min":0.51300000000000001,"5min":0.502,"15min":0.39000000000000001},"max":{"1min":0.91700000000000004,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.69799999999999995},"min":{"1min":0.48199999999999998,"5min":0.42799999999999999,"15min":0.40300000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.50800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575084,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36880,"kb_used_data":1736,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334960,"statfs":{"total":96636764160,"available":96598999040,"internally_reserved":0,"allocated":1777664,"data_stored":898007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.44400000000000001,"15min":0.44900000000000001},"min":{"1min":0.25600000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.63100000000000001,"5min":0.78600000000000003,"15min":0.84199999999999997},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.49299999999999999,"15min":0.51100000000000001},"min":{"1min":0.312,"5min":0.307,"15min":0.307},"max":{"1min":0.66700000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.34100000000000003}]},{"osd":1,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47399999999999998,"15min":0.47999999999999998},"min":{"1min":0.32300000000000001,"5min":0.32000000000000001,"15min":0.315},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.38},{"interface":"front","average":{"1min":0.503,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.0029999999999999},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55800000000000005,"15min":0.57199999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.58299999999999996,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.36799999999999999},"max":{"1min":0.81599999999999995,"5min":0.88100000000000001,"15min":1.663},"last":0.70599999999999996}]},{"osd":4,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.72699999999999998,"15min":0.755},"min":{"1min":0.53000000000000003,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.284},"last":0.627},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.52700000000000002,"5min":0.51900000000000002,"15min":0.47699999999999998},"max":{"1min":0.96899999999999997,"5min":1.175,"15min":1.175},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76600000000000001,"15min":0.78700000000000003},"min":{"1min":0.54900000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.05,"5min":1.0629999999999999,"15min":1.306},"last":0.62},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.754,"15min":0.78200000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.372},"max":{"1min":1.121,"5min":1.121,"15min":1.2470000000000001},"last":0.752}]},{"osd":6,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.746,"15min":0.76900000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48099999999999998},"max":{"1min":1.0680000000000001,"5min":1.113,"15min":1.117},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.78700000000000003,"15min":0.81100000000000005},"min":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.54200000000000004},"max":{"1min":1.133,"5min":1.133,"15min":1.2589999999999999},"last":0.57299999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.78300000000000003,"15min":0.82799999999999996},"min":{"1min":0.58399999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.159,"5min":1.159,"15min":2.4910000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.78100000000000003,"15min":0.81799999999999995},"min":{"1min":0.57599999999999996,"5min":0.53500000000000003,"15min":0.51600000000000001},"max":{"1min":1.0960000000000001,"5min":1.1359999999999999,"15min":1.595},"last":0.58699999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575084,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59004,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312836,"statfs":{"total":96636764160,"available":96576344064,"internally_reserved":0,"allocated":1757184,"data_stored":895390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46200000000000002,"15min":0.46400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.80400000000000005,"5min":0.84699999999999998,"15min":1.3169999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.50800000000000001,"15min":0.53300000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67300000000000004,"5min":0.80800000000000005,"15min":2.5270000000000001},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.47699999999999998,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.29999999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":2.7200000000000002},"last":0.375},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.55700000000000005},"min":{"1min":0.39900000000000002,"5min":0.36299999999999999,"15min":0.35999999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":2.6110000000000002},"last":1.1279999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55100000000000005,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.755,"5min":0.755,"15min":8.2530000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.77000000000000002,"5min":0.89600000000000002,"15min":1.2150000000000001},"last":0.437}]},{"osd":4,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.73999999999999999,"15min":0.76900000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.48399999999999999},"max":{"1min":0.91100000000000003,"5min":1.0840000000000001,"15min":1.1499999999999999},"last":0.626},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73999999999999999,"15min":0.78100000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.47999999999999998},"max":{"1min":0.92900000000000005,"5min":1.0629999999999999,"15min":2.3170000000000002},"last":1.258}]},{"osd":5,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.79900000000000004,"15min":0.84699999999999998},"min":{"1min":0.58399999999999996,"5min":0.56399999999999995,"15min":0.49399999999999999},"max":{"1min":1.0029999999999999,"5min":1.1319999999999999,"15min":3.1139999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.78900000000000003,"15min":0.83299999999999996},"min":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.55600000000000005},"max":{"1min":1.03,"5min":1.153,"15min":2.6850000000000001},"last":0.64600000000000002}]},{"osd":6,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.73999999999999999,"15min":0.79100000000000004},"min":{"1min":0.52900000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98299999999999998,"5min":1.038,"15min":3.9849999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75900000000000001,"15min":0.80200000000000005},"min":{"1min":0.53900000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":3.391},"last":0.70899999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.76000000000000001,"15min":0.80900000000000005},"min":{"1min":0.56200000000000006,"5min":0.52300000000000002,"15min":0.5},"max":{"1min":1.022,"5min":1.1759999999999999,"15min":2.5779999999999998},"last":1.3},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.78200000000000003,"15min":0.81799999999999995},"min":{"1min":0.57099999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.736,"5min":1.736,"15min":2.5939999999999999},"last":0.69299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575085,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36868,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334972,"statfs":{"total":96636764160,"available":96599011328,"internally_reserved":0,"allocated":1765376,"data_stored":896431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42899999999999999,"15min":0.432},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26100000000000001},"max":{"1min":0.56000000000000005,"5min":0.65400000000000003,"15min":0.77200000000000002},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.34999999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.74399999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.36799999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.35899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.63700000000000001,"5min":0.69199999999999995,"15min":1.0409999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.51700000000000002},"min":{"1min":0.32100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73199999999999998,"5min":0.77900000000000003,"15min":1.014},"last":0.54600000000000004}]},{"osd":3,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60799999999999998,"15min":0.628},"min":{"1min":0.502,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.746,"5min":0.80300000000000005,"15min":0.96299999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55300000000000005,"15min":0.57099999999999995},"min":{"1min":0.41299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69899999999999995,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.50900000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76400000000000001,"15min":0.78300000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48899999999999999},"max":{"1min":1.155,"5min":1.2110000000000001,"15min":1.236},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79000000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0640000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.95599999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77700000000000002,"15min":0.78500000000000003},"min":{"1min":0.56000000000000005,"5min":0.52500000000000002,"15min":0.45200000000000001},"max":{"1min":1.1020000000000001,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.79600000000000004,"15min":0.80300000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.48599999999999999},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.74399999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.55900000000000005,"5min":0.53800000000000003,"15min":0.503},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.2170000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79900000000000004,"15min":0.81799999999999995},"min":{"1min":0.53700000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.80500000000000005}]},{"osd":7,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.58499999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82699999999999996,"15min":0.84199999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.86799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575086,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41540,"kb_used_data":2300,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330300,"statfs":{"total":96636764160,"available":96594227200,"internally_reserved":0,"allocated":2355200,"data_stored":1485780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.27300000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.59199999999999997,"5min":0.79600000000000004,"15min":2.2450000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.48299999999999998,"15min":0.50800000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27700000000000002},"max":{"1min":0.72999999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.46100000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.504,"15min":0.51400000000000001},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68200000000000005,"5min":0.84499999999999997,"15min":2.2989999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52800000000000002,"15min":0.54700000000000004},"min":{"1min":0.39100000000000001,"5min":0.34899999999999998,"15min":0.29899999999999999},"max":{"1min":0.71199999999999997,"5min":0.83599999999999997,"15min":0.90300000000000002},"last":0.56399999999999995}]},{"osd":3,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.505,"15min":0.505},"min":{"1min":0.35199999999999998,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.84999999999999998},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57799999999999996,"15min":0.58999999999999997},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76600000000000001,"5min":0.92700000000000005,"15min":2.4100000000000001},"last":0.44}]},{"osd":4,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74399999999999999,"15min":0.77800000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1220000000000001,"5min":1.21,"15min":1.3640000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.75700000000000001,"15min":0.79300000000000004},"min":{"1min":0.57599999999999996,"5min":0.53500000000000003,"15min":0.44900000000000001},"max":{"1min":1.0289999999999999,"5min":1.0589999999999999,"15min":2.4460000000000002},"last":0.63400000000000001}]},{"osd":5,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75600000000000001,"15min":0.79400000000000004},"min":{"1min":0.62,"5min":0.54200000000000004,"15min":0.47899999999999998},"max":{"1min":1.044,"5min":1.0669999999999999,"15min":1.3839999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.59399999999999997,"5min":0.5,"15min":0.48399999999999999},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.325},"last":0.73999999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77100000000000002,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.147,"5min":1.147,"15min":2.3380000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.755,"15min":0.79900000000000004},"min":{"1min":0.55600000000000005,"5min":0.51000000000000001,"15min":0.50600000000000001},"max":{"1min":0.97899999999999998,"5min":1.0900000000000001,"15min":1.3440000000000001},"last":0.78400000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76300000000000001,"15min":0.81599999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.503},"max":{"1min":1.016,"5min":1.1180000000000001,"15min":1.2749999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.77200000000000002,"15min":0.80500000000000005},"min":{"1min":0.56000000000000005,"5min":0.50600000000000001,"15min":0.502},"max":{"1min":1.077,"5min":1.0880000000000001,"15min":1.381},"last":0.76900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:12:33.039 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-14T13:12:33.039 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-14T13:12:33.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.189+0000 7f01dd8f9640 1 Processor -- start 2023-07-14T13:12:33.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.189+0000 7f01dd8f9640 1 -- start start 2023-07-14T13:12:33.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.189+0000 7f01dd8f9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f01d80d0250 0x7f01d80d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.189+0000 7f01dd8f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01d80d2820 0x7f01d80b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.189+0000 7f01dd8f9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d80d0aa0 con 0x7f01d815bec0 2023-07-14T13:12:33.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.189+0000 7f01dd8f9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d80d2ca0 con 0x7f01d80d0250 2023-07-14T13:12:33.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.189+0000 7f01dd8f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d80d07c0 con 0x7f01d80d2820 2023-07-14T13:12:33.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.193+0000 7f01d6ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f01d815bec0 0x7f01d80cf610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48962/0 (socket says 172.21.15.5:48962) 2023-07-14T13:12:33.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.193+0000 7f01d6ffd640 1 -- 172.21.15.5:0/259204791 learned_addr learned my addr 172.21.15.5:0/259204791 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:33.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.193+0000 7f01cffff640 1 --2- 172.21.15.5:0/259204791 >> v2:172.21.15.5:3300/0 conn(0x7f01d80d0250 0x7f01d80d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.193+0000 7f01d77fe640 1 --2- 172.21.15.5:0/259204791 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01d80d2820 0x7f01d80b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.193+0000 7f01d67fc640 1 -- 172.21.15.5:0/259204791 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2317023825 0 0) 0x7f01c8001120 con 0x7f01d815bec0 2023-07-14T13:12:33.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.193+0000 7f01d67fc640 1 -- 172.21.15.5:0/259204791 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01c4003530 con 0x7f01d815bec0 2023-07-14T13:12:33.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.193+0000 7f01cffff640 1 -- 172.21.15.5:0/259204791 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01d80d2820 msgr2=0x7f01d80b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:33.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.193+0000 7f01cffff640 1 --2- 172.21.15.5:0/259204791 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01d80d2820 0x7f01d80b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.193+0000 7f01cffff640 1 -- 172.21.15.5:0/259204791 >> v1:172.21.15.5:6789/0 conn(0x7f01d815bec0 legacy=0x7f01d80cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:33.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.193+0000 7f01cffff640 1 -- 172.21.15.5:0/259204791 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d80b1dc0 con 0x7f01d80d0250 2023-07-14T13:12:33.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.193+0000 7f01d77fe640 1 --2- 172.21.15.5:0/259204791 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01d80d2820 0x7f01d80b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:33.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.193+0000 7f01cffff640 1 --2- 172.21.15.5:0/259204791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01d80d0250 0x7f01d80d22e0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f01c00097c0 tx=0x7f01c001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b4be9f4bcdd659 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:33.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.193+0000 7f01d67fc640 1 -- 172.21.15.5:0/259204791 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c00ab650 con 0x7f01d80d0250 2023-07-14T13:12:33.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.193+0000 7f01d67fc640 1 -- 172.21.15.5:0/259204791 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c00ab7b0 con 0x7f01d80d0250 2023-07-14T13:12:33.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.193+0000 7f01d67fc640 1 -- 172.21.15.5:0/259204791 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c00abb40 con 0x7f01d80d0250 2023-07-14T13:12:33.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01dd8f9640 1 -- 172.21.15.5:0/259204791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01d80d0250 msgr2=0x7f01d80d22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:33.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01dd8f9640 1 --2- 172.21.15.5:0/259204791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01d80d0250 0x7f01d80d22e0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f01c00097c0 tx=0x7f01c001c450 comp rx=0 tx=0).stop 2023-07-14T13:12:33.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01dd8f9640 1 -- 172.21.15.5:0/259204791 shutdown_connections 2023-07-14T13:12:33.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01dd8f9640 1 --2- 172.21.15.5:0/259204791 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01d80d2820 0x7f01d80b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01dd8f9640 1 --2- 172.21.15.5:0/259204791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01d80d0250 0x7f01d80d22e0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01dd8f9640 1 -- 172.21.15.5:0/259204791 >> 172.21.15.5:0/259204791 conn(0x7f01d80659d0 msgr2=0x7f01d809b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:33.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01dd8f9640 1 -- 172.21.15.5:0/259204791 shutdown_connections 2023-07-14T13:12:33.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01dd8f9640 1 -- 172.21.15.5:0/259204791 wait complete. 2023-07-14T13:12:33.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01dd8f9640 1 Processor -- start 2023-07-14T13:12:33.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01dd8f9640 1 -- start start 2023-07-14T13:12:33.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01dd8f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01d80d0250 0x7f01d80b5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01dd8f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01d80d2820 0x7f01d815cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01dd8f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01d815bec0 0x7f01d80b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01dd8f9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d815de60 con 0x7f01d80d0250 2023-07-14T13:12:33.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01dd8f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d815d8a0 con 0x7f01d815bec0 2023-07-14T13:12:33.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01dd8f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d815db80 con 0x7f01d80d2820 2023-07-14T13:12:33.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01d6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01d80d0250 0x7f01d80b5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01d6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01d80d0250 0x7f01d80b5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55178/0 (socket says 172.21.15.5:55178) 2023-07-14T13:12:33.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01d6ffd640 1 -- 172.21.15.5:0/181289114 learned_addr learned my addr 172.21.15.5:0/181289114 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:33.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01cffff640 1 --2- 172.21.15.5:0/181289114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01d80d2820 0x7f01d815cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01d6ffd640 1 -- 172.21.15.5:0/181289114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01d80d2820 msgr2=0x7f01d815cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:33.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01d77fe640 1 --2- 172.21.15.5:0/181289114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01d815bec0 0x7f01d80b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01d6ffd640 1 --2- 172.21.15.5:0/181289114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01d80d2820 0x7f01d815cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01d6ffd640 1 -- 172.21.15.5:0/181289114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01d815bec0 msgr2=0x7f01d80b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:33.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01d6ffd640 1 --2- 172.21.15.5:0/181289114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01d815bec0 0x7f01d80b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01d6ffd640 1 -- 172.21.15.5:0/181289114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c0009420 con 0x7f01d80d0250 2023-07-14T13:12:33.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01cffff640 1 --2- 172.21.15.5:0/181289114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01d80d2820 0x7f01d815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:12:33.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.197+0000 7f01d77fe640 1 --2- 172.21.15.5:0/181289114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01d815bec0 0x7f01d80b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:12:33.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.201+0000 7f01d6ffd640 1 --2- 172.21.15.5:0/181289114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01d80d0250 0x7f01d80b5b20 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f01c800c420 tx=0x7f01c800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:33.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.201+0000 7f01d4ff9640 1 -- 172.21.15.5:0/181289114 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c8005cf0 con 0x7f01d80d0250 2023-07-14T13:12:33.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.201+0000 7f01d4ff9640 1 -- 172.21.15.5:0/181289114 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c8005e50 con 0x7f01d80d0250 2023-07-14T13:12:33.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.201+0000 7f01d4ff9640 1 -- 172.21.15.5:0/181289114 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c80072f0 con 0x7f01d80d0250 2023-07-14T13:12:33.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.201+0000 7f01dd8f9640 1 -- 172.21.15.5:0/181289114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d80b5320 con 0x7f01d80d0250 2023-07-14T13:12:33.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.201+0000 7f01dd8f9640 1 -- 172.21.15.5:0/181289114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d80b6060 con 0x7f01d80d0250 2023-07-14T13:12:33.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.201+0000 7f01dd8f9640 1 -- 172.21.15.5:0/181289114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d80b5180 con 0x7f01d80d0250 2023-07-14T13:12:33.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.201+0000 7f01d4ff9640 1 -- 172.21.15.5:0/181289114 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f01c8007450 con 0x7f01d80d0250 2023-07-14T13:12:33.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.201+0000 7f01d4ff9640 1 --2- 172.21.15.5:0/181289114 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f01b80663a0 0x7f01b8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.201+0000 7f01d4ff9640 1 -- 172.21.15.5:0/181289114 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f01c8083420 con 0x7f01d80d0250 2023-07-14T13:12:33.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.205+0000 7f01cffff640 1 --2- 172.21.15.5:0/181289114 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f01b80663a0 0x7f01b8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.205+0000 7f01cffff640 1 --2- 172.21.15.5:0/181289114 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f01b80663a0 0x7f01b8068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f01c00af000 tx=0x7f01c0008040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:33.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.209+0000 7f01d4ff9640 1 -- 172.21.15.5:0/181289114 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f01d80b5180 con 0x7f01d80d0250 2023-07-14T13:12:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.413+0000 7f01dd8f9640 1 -- 172.21.15.5:0/181289114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f01d80d0aa0 con 0x7f01d80d0250 2023-07-14T13:12:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.421+0000 7f01d4ff9640 1 -- 172.21.15.5:0/181289114 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+147 (secure 0 0 0) 0x7f01d80d0aa0 con 0x7f01d80d0250 2023-07-14T13:12:33.456 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-07-14T13:12:33.456 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDkRLFkCav/DhAA6SOiONAbTcWCnUZXcm7BcQ== 2023-07-14T13:12:33.456 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2023-07-14T13:12:33.456 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2023-07-14T13:12:33.457 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-14T13:12:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2023-07-14T13:12:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.421+0000 7f01dd8f9640 1 -- 172.21.15.5:0/181289114 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f01b80663a0 msgr2=0x7f01b8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.421+0000 7f01dd8f9640 1 --2- 172.21.15.5:0/181289114 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f01b80663a0 0x7f01b8068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f01c00af000 tx=0x7f01c0008040 comp rx=0 tx=0).stop 2023-07-14T13:12:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.421+0000 7f01dd8f9640 1 -- 172.21.15.5:0/181289114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01d80d0250 msgr2=0x7f01d80b5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.421+0000 7f01dd8f9640 1 --2- 172.21.15.5:0/181289114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01d80d0250 0x7f01d80b5b20 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f01c800c420 tx=0x7f01c800c8e0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.421+0000 7f01dd8f9640 1 -- 172.21.15.5:0/181289114 shutdown_connections 2023-07-14T13:12:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.421+0000 7f01dd8f9640 1 --2- 172.21.15.5:0/181289114 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f01b80663a0 0x7f01b8068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.421+0000 7f01dd8f9640 1 --2- 172.21.15.5:0/181289114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01d815bec0 0x7f01d80b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.421+0000 7f01dd8f9640 1 --2- 172.21.15.5:0/181289114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f01d80d2820 0x7f01d815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.421+0000 7f01dd8f9640 1 --2- 172.21.15.5:0/181289114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01d80d0250 0x7f01d80b5b20 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.421+0000 7f01dd8f9640 1 -- 172.21.15.5:0/181289114 >> 172.21.15.5:0/181289114 conn(0x7f01d80659d0 msgr2=0x7f01d8072420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.421+0000 7f01dd8f9640 1 -- 172.21.15.5:0/181289114 shutdown_connections 2023-07-14T13:12:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.421+0000 7f01dd8f9640 1 -- 172.21.15.5:0/181289114 wait complete. 2023-07-14T13:12:33.477 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:12:33.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.585+0000 7f9e68696640 1 Processor -- start 2023-07-14T13:12:33.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.585+0000 7f9e68696640 1 -- start start 2023-07-14T13:12:33.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.585+0000 7f9e68696640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9e60070c60 0x7f9e6006b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.585+0000 7f9e68696640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e600ced40 0x7f9e6006b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.585+0000 7f9e68696640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e600cd3c0 con 0x7f9e60070890 2023-07-14T13:12:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.585+0000 7f9e68696640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e600cdf40 con 0x7f9e60070c60 2023-07-14T13:12:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.585+0000 7f9e68696640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e600cd6a0 con 0x7f9e600ced40 2023-07-14T13:12:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.585+0000 7f9e65c31640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9e60070c60 0x7f9e6006b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.585+0000 7f9e65c31640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9e60070c60 0x7f9e6006b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55190/0 (socket says 172.21.15.5:55190) 2023-07-14T13:12:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.585+0000 7f9e65c31640 1 -- 172.21.15.5:0/433520234 learned_addr learned my addr 172.21.15.5:0/433520234 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.585+0000 7f9e66c33640 1 --2- 172.21.15.5:0/433520234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e600ced40 0x7f9e6006b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.585+0000 7f9e65430640 1 -- 172.21.15.5:0/433520234 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3210947184 0 0) 0x7f9e600cd3c0 con 0x7f9e60070890 2023-07-14T13:12:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.589+0000 7f9e65430640 1 -- 172.21.15.5:0/433520234 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e4c003510 con 0x7f9e60070890 2023-07-14T13:12:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.589+0000 7f9e65c31640 1 -- 172.21.15.5:0/433520234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e600ced40 msgr2=0x7f9e6006b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.589+0000 7f9e65c31640 1 --2- 172.21.15.5:0/433520234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e600ced40 0x7f9e6006b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.589+0000 7f9e65c31640 1 -- 172.21.15.5:0/433520234 >> v1:172.21.15.154:6789/0 conn(0x7f9e60070890 legacy=0x7f9e6016c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.589+0000 7f9e65c31640 1 -- 172.21.15.5:0/433520234 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e600cd980 con 0x7f9e60070c60 2023-07-14T13:12:33.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.589+0000 7f9e65c31640 1 --2- 172.21.15.5:0/433520234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e60070c60 0x7f9e6006b1e0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f9e50014fb0 tx=0x7f9e50024ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5111d3558e83d02 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:33.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.589+0000 7f9e65430640 1 -- 172.21.15.5:0/433520234 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e500b5440 con 0x7f9e60070c60 2023-07-14T13:12:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.589+0000 7f9e65430640 1 -- 172.21.15.5:0/433520234 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e500b55a0 con 0x7f9e60070c60 2023-07-14T13:12:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.589+0000 7f9e65430640 1 -- 172.21.15.5:0/433520234 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e500b5910 con 0x7f9e60070c60 2023-07-14T13:12:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.593+0000 7f9e68696640 1 -- 172.21.15.5:0/433520234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e60070c60 msgr2=0x7f9e6006b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.593+0000 7f9e68696640 1 --2- 172.21.15.5:0/433520234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e60070c60 0x7f9e6006b1e0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f9e50014fb0 tx=0x7f9e50024ef0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.593+0000 7f9e68696640 1 -- 172.21.15.5:0/433520234 shutdown_connections 2023-07-14T13:12:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.593+0000 7f9e68696640 1 --2- 172.21.15.5:0/433520234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e600ced40 0x7f9e6006b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.593+0000 7f9e68696640 1 --2- 172.21.15.5:0/433520234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e60070c60 0x7f9e6006b1e0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.593+0000 7f9e68696640 1 -- 172.21.15.5:0/433520234 >> 172.21.15.5:0/433520234 conn(0x7f9e600b0980 msgr2=0x7f9e600ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.593+0000 7f9e68696640 1 -- 172.21.15.5:0/433520234 shutdown_connections 2023-07-14T13:12:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.593+0000 7f9e68696640 1 -- 172.21.15.5:0/433520234 wait complete. 2023-07-14T13:12:33.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.593+0000 7f9e68696640 1 Processor -- start 2023-07-14T13:12:33.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.593+0000 7f9e68696640 1 -- start start 2023-07-14T13:12:33.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.593+0000 7f9e68696640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e60070890 0x7f9e601651a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.593+0000 7f9e68696640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e600ced40 0x7f9e600ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.593+0000 7f9e68696640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e600b3cb0 0x7f9e6016a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.593+0000 7f9e68696640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e600c5230 con 0x7f9e600b3cb0 2023-07-14T13:12:33.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.593+0000 7f9e68696640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e601656e0 con 0x7f9e600ced40 2023-07-14T13:12:33.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.593+0000 7f9e68696640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e600c5440 con 0x7f9e60070890 2023-07-14T13:12:33.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.593+0000 7f9e66c33640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e600b3cb0 0x7f9e6016a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.593+0000 7f9e66c33640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e600b3cb0 0x7f9e6016a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55194/0 (socket says 172.21.15.5:55194) 2023-07-14T13:12:33.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.593+0000 7f9e66c33640 1 -- 172.21.15.5:0/2649680711 learned_addr learned my addr 172.21.15.5:0/2649680711 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:33.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.593+0000 7f9e65c31640 1 --2- 172.21.15.5:0/2649680711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e600ced40 0x7f9e600ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.593+0000 7f9e66432640 1 --2- 172.21.15.5:0/2649680711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e60070890 0x7f9e601651a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.593+0000 7f9e66c33640 1 -- 172.21.15.5:0/2649680711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e60070890 msgr2=0x7f9e601651a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:33.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.593+0000 7f9e66c33640 1 --2- 172.21.15.5:0/2649680711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e60070890 0x7f9e601651a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.593+0000 7f9e66c33640 1 -- 172.21.15.5:0/2649680711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e600ced40 msgr2=0x7f9e600ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:33.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.593+0000 7f9e66c33640 1 --2- 172.21.15.5:0/2649680711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e600ced40 0x7f9e600ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.593+0000 7f9e66c33640 1 -- 172.21.15.5:0/2649680711 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e50014c10 con 0x7f9e600b3cb0 2023-07-14T13:12:33.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.593+0000 7f9e66c33640 1 --2- 172.21.15.5:0/2649680711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e600b3cb0 0x7f9e6016a300 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f9e5800fb60 tx=0x7f9e5800d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.597+0000 7f9e56ffd640 1 -- 172.21.15.5:0/2649680711 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5800de40 con 0x7f9e600b3cb0 2023-07-14T13:12:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.597+0000 7f9e56ffd640 1 -- 172.21.15.5:0/2649680711 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5800fc50 con 0x7f9e600b3cb0 2023-07-14T13:12:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.597+0000 7f9e56ffd640 1 -- 172.21.15.5:0/2649680711 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e58014470 con 0x7f9e600b3cb0 2023-07-14T13:12:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.597+0000 7f9e68696640 1 -- 172.21.15.5:0/2649680711 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e600c5720 con 0x7f9e600b3cb0 2023-07-14T13:12:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.597+0000 7f9e68696640 1 -- 172.21.15.5:0/2649680711 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e600c7df0 con 0x7f9e600b3cb0 2023-07-14T13:12:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.597+0000 7f9e68696640 1 -- 172.21.15.5:0/2649680711 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e600678d0 con 0x7f9e600b3cb0 2023-07-14T13:12:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.597+0000 7f9e56ffd640 1 -- 172.21.15.5:0/2649680711 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9e580145d0 con 0x7f9e600b3cb0 2023-07-14T13:12:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.597+0000 7f9e56ffd640 1 --2- 172.21.15.5:0/2649680711 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f9e440663a0 0x7f9e44068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.597+0000 7f9e56ffd640 1 -- 172.21.15.5:0/2649680711 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f9e58084610 con 0x7f9e600b3cb0 2023-07-14T13:12:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.597+0000 7f9e66432640 1 --2- 172.21.15.5:0/2649680711 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f9e440663a0 0x7f9e44068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.601+0000 7f9e66432640 1 --2- 172.21.15.5:0/2649680711 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f9e440663a0 0x7f9e44068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c0017c0 tx=0x7f9e5c009040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:33.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.601+0000 7f9e56ffd640 1 -- 172.21.15.5:0/2649680711 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9e58055400 con 0x7f9e600b3cb0 2023-07-14T13:12:33.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.789+0000 7f9e68696640 1 -- 172.21.15.5:0/2649680711 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e600c7fe0 con 0x7f9e600b3cb0 2023-07-14T13:12:33.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.789+0000 7f9e56ffd640 1 -- 172.21.15.5:0/2649680711 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4711 (secure 0 0 0) 0x7f9e58054f90 con 0x7f9e600b3cb0 2023-07-14T13:12:33.825 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:33.825 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7373,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3424293950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3424293950},{"type":"v1","addr":"172.21.15.5:6834","nonce":3424293950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7379,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/1672977104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1672977104},{"type":"v1","addr":"172.21.15.154:6836","nonce":1672977104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":8401,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2517721716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2517721716},{"type":"v1","addr":"172.21.15.154:6837","nonce":2517721716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:12:23.316419+0000","modified":"2023-07-14T13:12:26.932428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8808},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8808":{"gid":8808,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/4283823156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":4283823156},{"type":"v1","addr":"172.21.15.5:6835","nonce":4283823156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-14T13:12:33.825 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 65 2023-07-14T13:12:33.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.789+0000 7f9e68696640 1 -- 172.21.15.5:0/2649680711 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f9e440663a0 msgr2=0x7f9e44068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:33.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.789+0000 7f9e68696640 1 --2- 172.21.15.5:0/2649680711 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f9e440663a0 0x7f9e44068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c0017c0 tx=0x7f9e5c009040 comp rx=0 tx=0).stop 2023-07-14T13:12:33.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.789+0000 7f9e68696640 1 -- 172.21.15.5:0/2649680711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e600b3cb0 msgr2=0x7f9e6016a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:33.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.789+0000 7f9e68696640 1 --2- 172.21.15.5:0/2649680711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e600b3cb0 0x7f9e6016a300 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f9e5800fb60 tx=0x7f9e5800d520 comp rx=0 tx=0).stop 2023-07-14T13:12:33.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.789+0000 7f9e68696640 1 -- 172.21.15.5:0/2649680711 shutdown_connections 2023-07-14T13:12:33.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.789+0000 7f9e68696640 1 --2- 172.21.15.5:0/2649680711 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f9e440663a0 0x7f9e44068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.789+0000 7f9e68696640 1 --2- 172.21.15.5:0/2649680711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e600b3cb0 0x7f9e6016a300 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.789+0000 7f9e68696640 1 --2- 172.21.15.5:0/2649680711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e600ced40 0x7f9e600ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.789+0000 7f9e68696640 1 --2- 172.21.15.5:0/2649680711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e60070890 0x7f9e601651a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.789+0000 7f9e68696640 1 -- 172.21.15.5:0/2649680711 >> 172.21.15.5:0/2649680711 conn(0x7f9e600b0980 msgr2=0x7f9e60089580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:33.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.789+0000 7f9e68696640 1 -- 172.21.15.5:0/2649680711 shutdown_connections 2023-07-14T13:12:33.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:33.789+0000 7f9e68696640 1 -- 172.21.15.5:0/2649680711 wait complete. 2023-07-14T13:12:34.248 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 65, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-14T13:12:23.316419+0000', 'modified': '2023-07-14T13:12:26.932428+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8808}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8808': {'gid': 8808, 'name': 'c', 'rank': 0, 'incarnation': 61, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6835/4283823156', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6833', 'nonce': 4283823156}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 4283823156}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-14T13:12:34.249 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-14T13:12:34.249 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-14T13:12:34.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.361+0000 7fbe2f20b640 1 Processor -- start 2023-07-14T13:12:34.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.361+0000 7fbe2f20b640 1 -- start start 2023-07-14T13:12:34.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.361+0000 7fbe2f20b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe28070b70 0x7fbe28070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:34.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.361+0000 7fbe2f20b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbe2806b1e0 0x7fbe280c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:34.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.361+0000 7fbe2f20b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe280cac70 con 0x7fbe280c21f0 2023-07-14T13:12:34.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.361+0000 7fbe2f20b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe28071480 con 0x7fbe2806b1e0 2023-07-14T13:12:34.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.361+0000 7fbe2f20b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe280ca060 con 0x7fbe28070b70 2023-07-14T13:12:34.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.361+0000 7fbe2d7a8640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbe280c21f0 0x7fbe280cb100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48970/0 (socket says 172.21.15.5:48970) 2023-07-14T13:12:34.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.365+0000 7fbe2d7a8640 1 -- 172.21.15.5:0/84581132 learned_addr learned my addr 172.21.15.5:0/84581132 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:34.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.365+0000 7fbe27fff640 1 --2- 172.21.15.5:0/84581132 >> v2:172.21.15.154:3300/0 conn(0x7fbe2806b1e0 0x7fbe280c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:34.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.365+0000 7fbe2cfa7640 1 --2- 172.21.15.5:0/84581132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe28070b70 0x7fbe28070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:34.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.365+0000 7fbe277fe640 1 -- 172.21.15.5:0/84581132 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998065824 0 0) 0x7fbe280cac70 con 0x7fbe280c21f0 2023-07-14T13:12:34.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.365+0000 7fbe277fe640 1 -- 172.21.15.5:0/84581132 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe18003530 con 0x7fbe280c21f0 2023-07-14T13:12:34.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.365+0000 7fbe27fff640 1 -- 172.21.15.5:0/84581132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe28070b70 msgr2=0x7fbe28070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:34.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.365+0000 7fbe27fff640 1 --2- 172.21.15.5:0/84581132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe28070b70 0x7fbe28070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.365+0000 7fbe27fff640 1 -- 172.21.15.5:0/84581132 >> v1:172.21.15.5:6789/0 conn(0x7fbe280c21f0 legacy=0x7fbe280cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:34.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.365+0000 7fbe277fe640 1 -- 172.21.15.5:0/84581132 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2578323053 0 0) 0x7fbe18003530 con 0x7fbe280c21f0 2023-07-14T13:12:34.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.365+0000 7fbe27fff640 1 -- 172.21.15.5:0/84581132 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe280ca340 con 0x7fbe2806b1e0 2023-07-14T13:12:34.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.365+0000 7fbe2cfa7640 1 --2- 172.21.15.5:0/84581132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe28070b70 0x7fbe28070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:34.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.365+0000 7fbe27fff640 1 --2- 172.21.15.5:0/84581132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe2806b1e0 0x7fbe280c1cb0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fbe140097c0 tx=0x7fbe1401c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec72bc7c8fa1f629 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:34.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.365+0000 7fbe277fe640 1 -- 172.21.15.5:0/84581132 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe20001a00 con 0x7fbe2806b1e0 2023-07-14T13:12:34.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.365+0000 7fbe277fe640 1 -- 172.21.15.5:0/84581132 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe140a7050 con 0x7fbe2806b1e0 2023-07-14T13:12:34.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.369+0000 7fbe277fe640 1 -- 172.21.15.5:0/84581132 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe140ab620 con 0x7fbe2806b1e0 2023-07-14T13:12:34.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.369+0000 7fbe2f20b640 1 -- 172.21.15.5:0/84581132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe2806b1e0 msgr2=0x7fbe280c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:34.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.369+0000 7fbe2f20b640 1 --2- 172.21.15.5:0/84581132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe2806b1e0 0x7fbe280c1cb0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fbe140097c0 tx=0x7fbe1401c2e0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.369+0000 7fbe2f20b640 1 -- 172.21.15.5:0/84581132 shutdown_connections 2023-07-14T13:12:34.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.369+0000 7fbe2f20b640 1 --2- 172.21.15.5:0/84581132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe2806b1e0 0x7fbe280c1cb0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.369+0000 7fbe2f20b640 1 --2- 172.21.15.5:0/84581132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe28070b70 0x7fbe28070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.369+0000 7fbe2f20b640 1 -- 172.21.15.5:0/84581132 >> 172.21.15.5:0/84581132 conn(0x7fbe280afcf0 msgr2=0x7fbe280b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:34.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.369+0000 7fbe2f20b640 1 -- 172.21.15.5:0/84581132 shutdown_connections 2023-07-14T13:12:34.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.369+0000 7fbe2f20b640 1 -- 172.21.15.5:0/84581132 wait complete. 2023-07-14T13:12:34.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.369+0000 7fbe2f20b640 1 Processor -- start 2023-07-14T13:12:34.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.369+0000 7fbe2f20b640 1 -- start start 2023-07-14T13:12:34.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.369+0000 7fbe2f20b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe2806b1e0 0x7fbe280a76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:34.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.369+0000 7fbe2f20b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe28070b70 0x7fbe281f4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:34.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.369+0000 7fbe2f20b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe280c21f0 0x7fbe280b2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:34.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.369+0000 7fbe2f20b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe281542a0 con 0x7fbe28070b70 2023-07-14T13:12:34.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.369+0000 7fbe2f20b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe280b14f0 con 0x7fbe2806b1e0 2023-07-14T13:12:34.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.369+0000 7fbe2f20b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe280b17d0 con 0x7fbe280c21f0 2023-07-14T13:12:34.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.369+0000 7fbe27fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe28070b70 0x7fbe281f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:34.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.369+0000 7fbe27fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe28070b70 0x7fbe281f4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55198/0 (socket says 172.21.15.5:55198) 2023-07-14T13:12:34.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.369+0000 7fbe27fff640 1 -- 172.21.15.5:0/2939900473 learned_addr learned my addr 172.21.15.5:0/2939900473 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:34.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.369+0000 7fbe2cfa7640 1 --2- 172.21.15.5:0/2939900473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe2806b1e0 0x7fbe280a76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:34.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.369+0000 7fbe2d7a8640 1 --2- 172.21.15.5:0/2939900473 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe280c21f0 0x7fbe280b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:34.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.373+0000 7fbe27fff640 1 -- 172.21.15.5:0/2939900473 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe280c21f0 msgr2=0x7fbe280b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:34.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.373+0000 7fbe27fff640 1 --2- 172.21.15.5:0/2939900473 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe280c21f0 0x7fbe280b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.373+0000 7fbe27fff640 1 -- 172.21.15.5:0/2939900473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe2806b1e0 msgr2=0x7fbe280a76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:34.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.373+0000 7fbe27fff640 1 --2- 172.21.15.5:0/2939900473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe2806b1e0 0x7fbe280a76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.373+0000 7fbe27fff640 1 -- 172.21.15.5:0/2939900473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c009420 con 0x7fbe28070b70 2023-07-14T13:12:34.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.373+0000 7fbe27fff640 1 --2- 172.21.15.5:0/2939900473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe28070b70 0x7fbe281f4910 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fbe1401a990 tx=0x7fbe14019080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:34.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.373+0000 7fbe257fa640 1 -- 172.21.15.5:0/2939900473 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe140b4410 con 0x7fbe28070b70 2023-07-14T13:12:34.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.373+0000 7fbe257fa640 1 -- 172.21.15.5:0/2939900473 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe140b4590 con 0x7fbe28070b70 2023-07-14T13:12:34.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.373+0000 7fbe257fa640 1 -- 172.21.15.5:0/2939900473 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe140b4940 con 0x7fbe28070b70 2023-07-14T13:12:34.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.373+0000 7fbe2f20b640 1 -- 172.21.15.5:0/2939900473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe14009420 con 0x7fbe28070b70 2023-07-14T13:12:34.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.373+0000 7fbe2f20b640 1 -- 172.21.15.5:0/2939900473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe280b1d90 con 0x7fbe28070b70 2023-07-14T13:12:34.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.373+0000 7fbe257fa640 1 -- 172.21.15.5:0/2939900473 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbe140b2040 con 0x7fbe28070b70 2023-07-14T13:12:34.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe257fa640 1 --2- 172.21.15.5:0/2939900473 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fbe0c0663a0 0x7fbe0c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:34.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe257fa640 1 -- 172.21.15.5:0/2939900473 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fbe1411dfd0 con 0x7fbe28070b70 2023-07-14T13:12:34.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe3256c000 1 Processor -- start 2023-07-14T13:12:34.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe2cfa7640 1 --2- 172.21.15.5:0/2939900473 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fbe0c0663a0 0x7fbe0c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:34.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe3256c000 1 -- start start 2023-07-14T13:12:34.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe2cfa7640 1 --2- 172.21.15.5:0/2939900473 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fbe0c0663a0 0x7fbe0c068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbe281638b0 tx=0x7fbe1c009190 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:34.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe3256c000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb8b0f80 0x558bdb8b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:34.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe3256c000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bdb8b1890 0x558bdb8673f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:34.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe3256c000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558bdb867930 0x558bdb867d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:34.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe3256c000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bdb72e900 con 0x558bdb8b0f80 2023-07-14T13:12:34.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe3256c000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bdb6688c0 con 0x558bdb8b1890 2023-07-14T13:12:34.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe3256c000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x558bdb6bc360 con 0x558bdb867930 2023-07-14T13:12:34.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe2cfa7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb8b0f80 0x558bdb8b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:34.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe2cfa7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb8b0f80 0x558bdb8b1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55206/0 (socket says 172.21.15.5:55206) 2023-07-14T13:12:34.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe2cfa7640 1 -- 172.21.15.5:0/3080360335 learned_addr learned my addr 172.21.15.5:0/3080360335 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:34.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe2d7a8640 1 --2- 172.21.15.5:0/3080360335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558bdb867930 0x558bdb867d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:34.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe27fff640 1 --2- 172.21.15.5:0/3080360335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bdb8b1890 0x558bdb8673f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:34.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe2cfa7640 1 -- 172.21.15.5:0/3080360335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558bdb867930 msgr2=0x558bdb867d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:34.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe2cfa7640 1 --2- 172.21.15.5:0/3080360335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558bdb867930 0x558bdb867d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe2cfa7640 1 -- 172.21.15.5:0/3080360335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bdb8b1890 msgr2=0x558bdb8673f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:34.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe2cfa7640 1 --2- 172.21.15.5:0/3080360335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bdb8b1890 0x558bdb8673f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe2cfa7640 1 -- 172.21.15.5:0/3080360335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558bdb3b1890 con 0x558bdb8b0f80 2023-07-14T13:12:34.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe27fff640 1 --2- 172.21.15.5:0/3080360335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bdb8b1890 0x558bdb8673f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:34.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe2cfa7640 1 --2- 172.21.15.5:0/3080360335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb8b0f80 0x558bdb8b1350 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c006a60 tx=0x7fbe1c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53611f70cd2b45ca server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:34.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe127fc640 1 -- 172.21.15.5:0/3080360335 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c014d70 con 0x558bdb8b0f80 2023-07-14T13:12:34.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe127fc640 1 -- 172.21.15.5:0/3080360335 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1c0213f0 con 0x558bdb8b0f80 2023-07-14T13:12:34.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe127fc640 1 -- 172.21.15.5:0/3080360335 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c021760 con 0x558bdb8b0f80 2023-07-14T13:12:34.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe3256c000 1 -- 172.21.15.5:0/3080360335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb8b0f80 msgr2=0x558bdb8b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:34.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe3256c000 1 --2- 172.21.15.5:0/3080360335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb8b0f80 0x558bdb8b1350 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c006a60 tx=0x7fbe1c014000 comp rx=0 tx=0).stop 2023-07-14T13:12:34.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe3256c000 1 -- 172.21.15.5:0/3080360335 shutdown_connections 2023-07-14T13:12:34.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe3256c000 1 --2- 172.21.15.5:0/3080360335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558bdb867930 0x558bdb867d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe3256c000 1 --2- 172.21.15.5:0/3080360335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bdb8b1890 0x558bdb8673f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe3256c000 1 --2- 172.21.15.5:0/3080360335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb8b0f80 0x558bdb8b1350 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe3256c000 1 -- 172.21.15.5:0/3080360335 >> 172.21.15.5:0/3080360335 conn(0x558bdb86da90 msgr2=0x558bdb865cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:34.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe3256c000 1 -- 172.21.15.5:0/3080360335 shutdown_connections 2023-07-14T13:12:34.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.377+0000 7fbe3256c000 1 -- 172.21.15.5:0/3080360335 wait complete. 2023-07-14T13:12:34.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe3256c000 1 -- start start 2023-07-14T13:12:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe3256c000 1 Processor -- start 2023-07-14T13:12:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe3256c000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bdb867930 0x558bdb8b7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe3256c000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558bdb8b0f80 0x558bdb8b8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe3256c000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb8b1890 0x558bdb872570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe3256c000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bdb6b5400 con 0x558bdb8b1890 2023-07-14T13:12:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe3256c000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bdb671b60 con 0x558bdb867930 2023-07-14T13:12:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe3256c000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x558bdb671800 con 0x558bdb8b0f80 2023-07-14T13:12:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe3256c000 10 client.0 _ll_register_callbacks cb 0x558bdb8532c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:12:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe2d7a8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb8b1890 0x558bdb872570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe2d7a8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb8b1890 0x558bdb872570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55222/0 (socket says 172.21.15.5:55222) 2023-07-14T13:12:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe2d7a8640 1 -- 172.21.15.5:0/4065755304 learned_addr learned my addr 172.21.15.5:0/4065755304 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe27fff640 1 --2- 172.21.15.5:0/4065755304 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558bdb8b0f80 0x558bdb8b8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe2cfa7640 1 --2- 172.21.15.5:0/4065755304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bdb867930 0x558bdb8b7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe2d7a8640 1 -- 172.21.15.5:0/4065755304 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558bdb8b0f80 msgr2=0x558bdb8b8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe2d7a8640 1 --2- 172.21.15.5:0/4065755304 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558bdb8b0f80 0x558bdb8b8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe2d7a8640 1 -- 172.21.15.5:0/4065755304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bdb867930 msgr2=0x558bdb8b7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe2d7a8640 1 --2- 172.21.15.5:0/4065755304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bdb867930 0x558bdb8b7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe2d7a8640 1 -- 172.21.15.5:0/4065755304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe1c009cf0 con 0x558bdb8b1890 2023-07-14T13:12:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe2d7a8640 1 --2- 172.21.15.5:0/4065755304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb8b1890 0x558bdb872570 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fbe280c25f0 tx=0x7fbe20010610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a215f2a616bfac server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe077fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-07-14T13:12:34.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe077fe640 1 -- 172.21.15.5:0/4065755304 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe20010c10 con 0x558bdb8b1890 2023-07-14T13:12:34.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe077fe640 1 -- 172.21.15.5:0/4065755304 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fbe20010d70 con 0x558bdb8b1890 2023-07-14T13:12:34.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe3256c000 1 -- 172.21.15.5:0/4065755304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558bdb67caa0 con 0x558bdb8b1890 2023-07-14T13:12:34.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe077fe640 1 -- 172.21.15.5:0/4065755304 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe200070d0 con 0x558bdb8b1890 2023-07-14T13:12:34.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe3256c000 10 client.8976 fetch_fsmap learned FSMap version 65 2023-07-14T13:12:34.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe3256c000 1 -- 172.21.15.5:0/4065755304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x558bdb679d90 con 0x558bdb8b1890 2023-07-14T13:12:34.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe077fe640 1 -- 172.21.15.5:0/4065755304 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558bdb67caa0 con 0x558bdb8b1890 2023-07-14T13:12:34.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe077fe640 1 -- 172.21.15.5:0/4065755304 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 65) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fbe20007230 con 0x558bdb8b1890 2023-07-14T13:12:34.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe3256c000 10 client.8976 fetch_fsmap finished waiting for FSMap version 65 2023-07-14T13:12:34.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe3256c000 10 client.8976 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T13:12:34.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe3256c000 20 client.8976 populate_metadata read hostname 'smithi005' 2023-07-14T13:12:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe3256c000 1 --2- 172.21.15.5:0/4065755304 >> [v2:172.21.15.5:6833/4283823156,v1:172.21.15.5:6835/4283823156] conn(0x558bdb872f80 0x558bdb873350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe3256c000 4 client.8976 mds_command: new command op to 8808 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:12:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.381+0000 7fbe3256c000 1 -- 172.21.15.5:0/4065755304 --> [v2:172.21.15.5:6833/4283823156,v1:172.21.15.5:6835/4283823156] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558bdb6e3f40 con 0x558bdb872f80 2023-07-14T13:12:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.385+0000 7fbe2cfa7640 1 --2- 172.21.15.5:0/4065755304 >> [v2:172.21.15.5:6833/4283823156,v1:172.21.15.5:6835/4283823156] conn(0x558bdb872f80 0x558bdb873350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.385+0000 7fbe2cfa7640 1 --2- 172.21.15.5:0/4065755304 >> [v2:172.21.15.5:6833/4283823156,v1:172.21.15.5:6835/4283823156] conn(0x558bdb872f80 0x558bdb873350 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b9c35c8aaae278c server_cookie=37fdff4aa90fe96a in_seq=0 out_seq=0 2023-07-14T13:12:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.385+0000 7fbe077fe640 10 client.8976 ms_handle_connect on v2:172.21.15.5:6833/4283823156 2023-07-14T13:12:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.385+0000 7fbe077fe640 1 -- 172.21.15.5:0/4065755304 <== mds.0 v2:172.21.15.5:6833/4283823156 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x558bdb6e3f40 con 0x558bdb872f80 2023-07-14T13:12:34.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.385+0000 7fbe077fe640 10 client.8976 handle_command_reply: tid=0 2023-07-14T13:12:34.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.385+0000 7fbe3256c000 1 client.8976 shutdown 2023-07-14T13:12:34.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.385+0000 7fbe3256c000 1 -- 172.21.15.5:0/4065755304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb8b1890 msgr2=0x558bdb872570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:34.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.385+0000 7fbe3256c000 1 --2- 172.21.15.5:0/4065755304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb8b1890 0x558bdb872570 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fbe280c25f0 tx=0x7fbe20010610 comp rx=0 tx=0).stop 2023-07-14T13:12:34.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.385+0000 7fbe3256c000 1 -- 172.21.15.5:0/4065755304 shutdown_connections 2023-07-14T13:12:34.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.385+0000 7fbe3256c000 1 --2- 172.21.15.5:0/4065755304 >> [v2:172.21.15.5:6833/4283823156,v1:172.21.15.5:6835/4283823156] conn(0x558bdb872f80 0x558bdb873350 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.385+0000 7fbe3256c000 1 --2- 172.21.15.5:0/4065755304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb8b1890 0x558bdb872570 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.385+0000 7fbe3256c000 1 --2- 172.21.15.5:0/4065755304 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558bdb8b0f80 0x558bdb8b8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.385+0000 7fbe3256c000 1 --2- 172.21.15.5:0/4065755304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bdb867930 0x558bdb8b7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.385+0000 7fbe077fe640 0 client.8976 ms_handle_reset on v2:172.21.15.5:6833/4283823156 2023-07-14T13:12:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.385+0000 7fbe3256c000 1 -- 172.21.15.5:0/4065755304 >> 172.21.15.5:0/4065755304 conn(0x558bdb86da90 msgr2=0x558bdb8663d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.385+0000 7fbe3256c000 1 -- 172.21.15.5:0/4065755304 shutdown_connections 2023-07-14T13:12:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.385+0000 7fbe3256c000 1 -- 172.21.15.5:0/4065755304 wait complete. 2023-07-14T13:12:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.385+0000 7fbe3256c000 20 client.8976 trim_cache size 0 max 16384 2023-07-14T13:12:34.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.401+0000 7fbe3256c000 1 Processor -- start 2023-07-14T13:12:34.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.401+0000 7fbe3256c000 1 -- start start 2023-07-14T13:12:34.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.401+0000 7fbe3256c000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb867930 0x558bdb90a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:34.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.401+0000 7fbe3256c000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bdb8b0f80 0x558bdb90aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.401+0000 7fbe3256c000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558bdb8b1890 0x558bdb90afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.401+0000 7fbe3256c000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bdb372940 con 0x558bdb867930 2023-07-14T13:12:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.401+0000 7fbe3256c000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bdb867450 con 0x558bdb8b0f80 2023-07-14T13:12:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.401+0000 7fbe3256c000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x558bdb8c76a0 con 0x558bdb8b1890 2023-07-14T13:12:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.401+0000 7fbe2cfa7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb867930 0x558bdb90a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.401+0000 7fbe2cfa7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb867930 0x558bdb90a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55234/0 (socket says 172.21.15.5:55234) 2023-07-14T13:12:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.401+0000 7fbe2cfa7640 1 -- 172.21.15.5:0/238382357 learned_addr learned my addr 172.21.15.5:0/238382357 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.401+0000 7fbe2d7a8640 1 --2- 172.21.15.5:0/238382357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558bdb8b1890 0x558bdb90afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.401+0000 7fbe27fff640 1 --2- 172.21.15.5:0/238382357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bdb8b0f80 0x558bdb90aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.401+0000 7fbe2cfa7640 1 -- 172.21.15.5:0/238382357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558bdb8b1890 msgr2=0x558bdb90afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:34.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.401+0000 7fbe2cfa7640 1 --2- 172.21.15.5:0/238382357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558bdb8b1890 0x558bdb90afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.401+0000 7fbe2cfa7640 1 -- 172.21.15.5:0/238382357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bdb8b0f80 msgr2=0x558bdb90aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:34.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.401+0000 7fbe2cfa7640 1 --2- 172.21.15.5:0/238382357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bdb8b0f80 0x558bdb90aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.401+0000 7fbe2cfa7640 1 -- 172.21.15.5:0/238382357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558bdb660020 con 0x558bdb867930 2023-07-14T13:12:34.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.401+0000 7fbe2cfa7640 1 --2- 172.21.15.5:0/238382357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb867930 0x558bdb90a520 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c006a30 tx=0x7fbe1c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa166c87c411406 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:34.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.401+0000 7fbe12ffd640 1 -- 172.21.15.5:0/238382357 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c030070 con 0x558bdb867930 2023-07-14T13:12:34.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.401+0000 7fbe12ffd640 1 -- 172.21.15.5:0/238382357 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1c031040 con 0x558bdb867930 2023-07-14T13:12:34.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.401+0000 7fbe12ffd640 1 -- 172.21.15.5:0/238382357 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c034780 con 0x558bdb867930 2023-07-14T13:12:34.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.401+0000 7fbe3256c000 1 -- 172.21.15.5:0/238382357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb867930 msgr2=0x558bdb90a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:34.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.401+0000 7fbe3256c000 1 --2- 172.21.15.5:0/238382357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb867930 0x558bdb90a520 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c006a30 tx=0x7fbe1c016000 comp rx=0 tx=0).stop 2023-07-14T13:12:34.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe3256c000 1 -- 172.21.15.5:0/238382357 shutdown_connections 2023-07-14T13:12:34.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe3256c000 1 --2- 172.21.15.5:0/238382357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558bdb8b1890 0x558bdb90afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe3256c000 1 --2- 172.21.15.5:0/238382357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bdb8b0f80 0x558bdb90aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe3256c000 1 --2- 172.21.15.5:0/238382357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb867930 0x558bdb90a520 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe3256c000 1 -- 172.21.15.5:0/238382357 >> 172.21.15.5:0/238382357 conn(0x558bdb86da90 msgr2=0x558bdb86cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:34.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe3256c000 1 -- 172.21.15.5:0/238382357 shutdown_connections 2023-07-14T13:12:34.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe3256c000 1 -- 172.21.15.5:0/238382357 wait complete. 2023-07-14T13:12:34.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe3256c000 1 -- start start 2023-07-14T13:12:34.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe3256c000 1 Processor -- start 2023-07-14T13:12:34.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe3256c000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558bdb867930 0x558bdb8b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:34.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe3256c000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bdb8b0f80 0x558bdb8b5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:34.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe3256c000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb8b1890 0x558bdb8b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:34.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe3256c000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bdb6bd5f0 con 0x558bdb8b1890 2023-07-14T13:12:34.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe3256c000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bdb65ba80 con 0x558bdb8b0f80 2023-07-14T13:12:34.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe3256c000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x558bdb662f90 con 0x558bdb867930 2023-07-14T13:12:34.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe3256c000 10 client.0 _ll_register_callbacks cb 0x558bdb8334b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:12:34.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe2d7a8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb8b1890 0x558bdb8b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:34.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe2d7a8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb8b1890 0x558bdb8b5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55238/0 (socket says 172.21.15.5:55238) 2023-07-14T13:12:34.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe27fff640 1 --2- 172.21.15.5:0/1908189175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bdb8b0f80 0x558bdb8b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:34.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe2d7a8640 1 -- 172.21.15.5:0/1908189175 learned_addr learned my addr 172.21.15.5:0/1908189175 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe2cfa7640 1 --2- 172.21.15.5:0/1908189175 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558bdb867930 0x558bdb8b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe2d7a8640 1 -- 172.21.15.5:0/1908189175 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558bdb867930 msgr2=0x558bdb8b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe2d7a8640 1 --2- 172.21.15.5:0/1908189175 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558bdb867930 0x558bdb8b53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe2d7a8640 1 -- 172.21.15.5:0/1908189175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bdb8b0f80 msgr2=0x558bdb8b5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe2d7a8640 1 --2- 172.21.15.5:0/1908189175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bdb8b0f80 0x558bdb8b5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe2d7a8640 1 -- 172.21.15.5:0/1908189175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558bdb3b1890 con 0x558bdb8b1890 2023-07-14T13:12:34.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe27fff640 1 --2- 172.21.15.5:0/1908189175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bdb8b0f80 0x558bdb8b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe2d7a8640 1 --2- 172.21.15.5:0/1908189175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb8b1890 0x558bdb8b5e50 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fbe20001590 tx=0x7fbe20005b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebda6d9cf3419ca server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe077fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-07-14T13:12:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe077fe640 1 -- 172.21.15.5:0/1908189175 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2002c070 con 0x558bdb8b1890 2023-07-14T13:12:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe3256c000 1 -- 172.21.15.5:0/1908189175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558bdb6b3d50 con 0x558bdb8b1890 2023-07-14T13:12:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe077fe640 1 -- 172.21.15.5:0/1908189175 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fbe20010040 con 0x558bdb8b1890 2023-07-14T13:12:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe077fe640 1 -- 172.21.15.5:0/1908189175 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe20001c20 con 0x558bdb8b1890 2023-07-14T13:12:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe3256c000 10 client.8982 fetch_fsmap learned FSMap version 65 2023-07-14T13:12:34.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.405+0000 7fbe3256c000 1 -- 172.21.15.5:0/1908189175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x558bdb3b1cc0 con 0x558bdb8b1890 2023-07-14T13:12:34.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe077fe640 1 -- 172.21.15.5:0/1908189175 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558bdb6b3d50 con 0x558bdb8b1890 2023-07-14T13:12:34.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe077fe640 1 -- 172.21.15.5:0/1908189175 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 65) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fbe20007900 con 0x558bdb8b1890 2023-07-14T13:12:34.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe3256c000 10 client.8982 fetch_fsmap finished waiting for FSMap version 65 2023-07-14T13:12:34.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe3256c000 10 client.8982 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T13:12:34.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe3256c000 20 client.8982 populate_metadata read hostname 'smithi005' 2023-07-14T13:12:34.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe3256c000 1 --2- 172.21.15.5:0/1908189175 >> [v2:172.21.15.5:6833/4283823156,v1:172.21.15.5:6835/4283823156] conn(0x558bdb9147a0 0x558bdb916b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:34.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe3256c000 4 client.8982 mds_command: new command op to 8808 tid=0[{"prefix": "status"}] 2023-07-14T13:12:34.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe3256c000 1 -- 172.21.15.5:0/1908189175 --> [v2:172.21.15.5:6833/4283823156,v1:172.21.15.5:6835/4283823156] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558bdb6ae3e0 con 0x558bdb9147a0 2023-07-14T13:12:34.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe2cfa7640 1 --2- 172.21.15.5:0/1908189175 >> [v2:172.21.15.5:6833/4283823156,v1:172.21.15.5:6835/4283823156] conn(0x558bdb9147a0 0x558bdb916b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:34.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe077fe640 10 client.8982 ms_handle_connect on v2:172.21.15.5:6833/4283823156 2023-07-14T13:12:34.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe2cfa7640 1 --2- 172.21.15.5:0/1908189175 >> [v2:172.21.15.5:6833/4283823156,v1:172.21.15.5:6835/4283823156] conn(0x558bdb9147a0 0x558bdb916b80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28479b3a49223961 server_cookie=c7774f9e363e3ac3 in_seq=0 out_seq=0 2023-07-14T13:12:34.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe077fe640 1 -- 172.21.15.5:0/1908189175 <== mds.0 v2:172.21.15.5:6833/4283823156 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x558bdb6ae3e0 con 0x558bdb9147a0 2023-07-14T13:12:34.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe077fe640 10 client.8982 handle_command_reply: tid=0 2023-07-14T13:12:34.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe3256c000 1 client.8982 shutdown 2023-07-14T13:12:34.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe3256c000 1 -- 172.21.15.5:0/1908189175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb8b1890 msgr2=0x558bdb8b5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:34.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe3256c000 1 --2- 172.21.15.5:0/1908189175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb8b1890 0x558bdb8b5e50 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fbe20001590 tx=0x7fbe20005b80 comp rx=0 tx=0).stop 2023-07-14T13:12:34.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe3256c000 1 -- 172.21.15.5:0/1908189175 shutdown_connections 2023-07-14T13:12:34.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe3256c000 1 --2- 172.21.15.5:0/1908189175 >> [v2:172.21.15.5:6833/4283823156,v1:172.21.15.5:6835/4283823156] conn(0x558bdb9147a0 0x558bdb916b80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe3256c000 1 --2- 172.21.15.5:0/1908189175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558bdb8b1890 0x558bdb8b5e50 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe3256c000 1 --2- 172.21.15.5:0/1908189175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bdb8b0f80 0x558bdb8b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe3256c000 1 --2- 172.21.15.5:0/1908189175 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x558bdb867930 0x558bdb8b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe3256c000 1 -- 172.21.15.5:0/1908189175 >> 172.21.15.5:0/1908189175 conn(0x558bdb86da90 msgr2=0x558bdb8af530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:34.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe077fe640 0 client.8982 ms_handle_reset on v2:172.21.15.5:6833/4283823156 2023-07-14T13:12:34.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe3256c000 1 -- 172.21.15.5:0/1908189175 shutdown_connections 2023-07-14T13:12:34.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe3256c000 1 -- 172.21.15.5:0/1908189175 wait complete. 2023-07-14T13:12:34.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe3256c000 20 client.8982 trim_cache size 0 max 16384 2023-07-14T13:12:34.453 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T13:12:34.453 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "22affb8d-e389-40f8-a764-dd40eb1759c8", 2023-07-14T13:12:34.454 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-07-14T13:12:34.454 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 8808, 2023-07-14T13:12:34.454 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-07-14T13:12:34.454 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-07-14T13:12:34.454 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-07-14T13:12:34.454 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 10.496002617, 2023-07-14T13:12:34.454 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 65, 2023-07-14T13:12:34.454 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 142, 2023-07-14T13:12:34.455 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 142, 2023-07-14T13:12:34.455 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 16.427251551000001 2023-07-14T13:12:34.455 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T13:12:34.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe2f20b640 1 -- 172.21.15.5:0/2939900473 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fbe0c0663a0 msgr2=0x7fbe0c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:34.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe2f20b640 1 --2- 172.21.15.5:0/2939900473 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fbe0c0663a0 0x7fbe0c068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbe281638b0 tx=0x7fbe1c009190 comp rx=0 tx=0).stop 2023-07-14T13:12:34.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe2f20b640 1 -- 172.21.15.5:0/2939900473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe28070b70 msgr2=0x7fbe281f4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:34.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe2f20b640 1 --2- 172.21.15.5:0/2939900473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe28070b70 0x7fbe281f4910 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fbe1401a990 tx=0x7fbe14019080 comp rx=0 tx=0).stop 2023-07-14T13:12:34.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe2f20b640 1 -- 172.21.15.5:0/2939900473 shutdown_connections 2023-07-14T13:12:34.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe2f20b640 1 --2- 172.21.15.5:0/2939900473 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fbe0c0663a0 0x7fbe0c068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe2f20b640 1 --2- 172.21.15.5:0/2939900473 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe280c21f0 0x7fbe280b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe2f20b640 1 --2- 172.21.15.5:0/2939900473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe28070b70 0x7fbe281f4910 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe2f20b640 1 --2- 172.21.15.5:0/2939900473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe2806b1e0 0x7fbe280a76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe2f20b640 1 -- 172.21.15.5:0/2939900473 >> 172.21.15.5:0/2939900473 conn(0x7fbe280afcf0 msgr2=0x7fbe280c41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:34.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe2f20b640 1 -- 172.21.15.5:0/2939900473 shutdown_connections 2023-07-14T13:12:34.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.409+0000 7fbe2f20b640 1 -- 172.21.15.5:0/2939900473 wait complete. 2023-07-14T13:12:34.465 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T13:12:34.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.573+0000 7f423cb03640 1 Processor -- start 2023-07-14T13:12:34.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.573+0000 7f423cb03640 1 -- start start 2023-07-14T13:12:34.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.573+0000 7f423cb03640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f42380c8ad0 0x7f42380c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:34.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.573+0000 7f423cb03640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42380c99c0 con 0x7f42380c9560 2023-07-14T13:12:34.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.573+0000 7f423cb03640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42380cc700 con 0x7f4238158ce0 2023-07-14T13:12:34.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.573+0000 7f423cb03640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42380b0ff0 con 0x7f42380c8ad0 2023-07-14T13:12:34.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.573+0000 7f422ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f42380c8ad0 0x7f42380c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:34.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.573+0000 7f422ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f42380c8ad0 0x7f42380c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55250/0 (socket says 172.21.15.5:55250) 2023-07-14T13:12:34.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.573+0000 7f422ffff640 1 -- 172.21.15.5:0/1004171126 learned_addr learned my addr 172.21.15.5:0/1004171126 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:34.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.577+0000 7f422ffff640 1 -- 172.21.15.5:0/1004171126 >> v1:172.21.15.154:6789/0 conn(0x7f4238158ce0 legacy=0x7f4238070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:34.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.577+0000 7f422ffff640 1 -- 172.21.15.5:0/1004171126 >> v1:172.21.15.5:6789/0 conn(0x7f42380c9560 legacy=0x7f42380ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:34.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.577+0000 7f422ffff640 1 -- 172.21.15.5:0/1004171126 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4238070c80 con 0x7f42380c8ad0 2023-07-14T13:12:34.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.577+0000 7f422ffff640 1 --2- 172.21.15.5:0/1004171126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42380c8ad0 0x7f42380c9020 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f4220009870 tx=0x7f422001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3e042f461190cb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:34.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.577+0000 7f4235d9b640 1 -- 172.21.15.5:0/1004171126 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42200ab5f0 con 0x7f42380c8ad0 2023-07-14T13:12:34.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.577+0000 7f4235d9b640 1 -- 172.21.15.5:0/1004171126 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42200ab750 con 0x7f42380c8ad0 2023-07-14T13:12:34.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.577+0000 7f4235d9b640 1 -- 172.21.15.5:0/1004171126 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42200abae0 con 0x7f42380c8ad0 2023-07-14T13:12:34.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.577+0000 7f423cb03640 1 -- 172.21.15.5:0/1004171126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42380c8ad0 msgr2=0x7f42380c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:34.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.577+0000 7f423cb03640 1 --2- 172.21.15.5:0/1004171126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42380c8ad0 0x7f42380c9020 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f4220009870 tx=0x7f422001c3f0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.577+0000 7f423cb03640 1 -- 172.21.15.5:0/1004171126 shutdown_connections 2023-07-14T13:12:34.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.577+0000 7f423cb03640 1 --2- 172.21.15.5:0/1004171126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42380c8ad0 0x7f42380c9020 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.577+0000 7f423cb03640 1 -- 172.21.15.5:0/1004171126 >> 172.21.15.5:0/1004171126 conn(0x7f42380afcf0 msgr2=0x7f42380b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:34.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.581+0000 7f423cb03640 1 -- 172.21.15.5:0/1004171126 shutdown_connections 2023-07-14T13:12:34.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.581+0000 7f423cb03640 1 -- 172.21.15.5:0/1004171126 wait complete. 2023-07-14T13:12:34.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.581+0000 7f423cb03640 1 Processor -- start 2023-07-14T13:12:34.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.581+0000 7f423cb03640 1 -- start start 2023-07-14T13:12:34.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.581+0000 7f423cb03640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42380c8ad0 0x7f423814c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:34.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.581+0000 7f423cb03640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42380c9560 0x7f423814bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:34.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.581+0000 7f423cb03640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4238158ce0 0x7f42380b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:34.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.581+0000 7f423cb03640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42380adee0 con 0x7f42380c8ad0 2023-07-14T13:12:34.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.581+0000 7f423cb03640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423814c050 con 0x7f42380c9560 2023-07-14T13:12:34.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.581+0000 7f423cb03640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42380ae130 con 0x7f4238158ce0 2023-07-14T13:12:34.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.581+0000 7f423659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42380c8ad0 0x7f423814c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:34.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.581+0000 7f423659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42380c8ad0 0x7f423814c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55264/0 (socket says 172.21.15.5:55264) 2023-07-14T13:12:34.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.581+0000 7f423659c640 1 -- 172.21.15.5:0/810267312 learned_addr learned my addr 172.21.15.5:0/810267312 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:34.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.581+0000 7f422ffff640 1 --2- 172.21.15.5:0/810267312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42380c9560 0x7f423814bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:34.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.581+0000 7f4236d9d640 1 --2- 172.21.15.5:0/810267312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4238158ce0 0x7f42380b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:34.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.581+0000 7f423659c640 1 -- 172.21.15.5:0/810267312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4238158ce0 msgr2=0x7f42380b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:34.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.581+0000 7f423659c640 1 --2- 172.21.15.5:0/810267312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4238158ce0 0x7f42380b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.581+0000 7f423659c640 1 -- 172.21.15.5:0/810267312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42380c9560 msgr2=0x7f423814bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:34.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.581+0000 7f423659c640 1 --2- 172.21.15.5:0/810267312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42380c9560 0x7f423814bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.581+0000 7f423659c640 1 -- 172.21.15.5:0/810267312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42200094d0 con 0x7f42380c8ad0 2023-07-14T13:12:34.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.581+0000 7f423659c640 1 --2- 172.21.15.5:0/810267312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42380c8ad0 0x7f423814c770 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f422800c500 tx=0x7f422800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:34.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.585+0000 7f422effd640 1 -- 172.21.15.5:0/810267312 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4228005220 con 0x7f42380c8ad0 2023-07-14T13:12:34.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.585+0000 7f422effd640 1 -- 172.21.15.5:0/810267312 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4228005380 con 0x7f42380c8ad0 2023-07-14T13:12:34.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.585+0000 7f422effd640 1 -- 172.21.15.5:0/810267312 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4228007270 con 0x7f42380c8ad0 2023-07-14T13:12:34.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.585+0000 7f423cb03640 1 -- 172.21.15.5:0/810267312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42380ae410 con 0x7f42380c8ad0 2023-07-14T13:12:34.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.585+0000 7f423cb03640 1 -- 172.21.15.5:0/810267312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42380ae9d0 con 0x7f42380c8ad0 2023-07-14T13:12:34.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.585+0000 7f423cb03640 1 -- 172.21.15.5:0/810267312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42380ca1a0 con 0x7f42380c8ad0 2023-07-14T13:12:34.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.585+0000 7f422effd640 1 -- 172.21.15.5:0/810267312 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f42280073d0 con 0x7f42380c8ad0 2023-07-14T13:12:34.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.585+0000 7f422effd640 1 --2- 172.21.15.5:0/810267312 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f42180663d0 0x7f4218068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:34.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.585+0000 7f422effd640 1 -- 172.21.15.5:0/810267312 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f42280835e0 con 0x7f42380c8ad0 2023-07-14T13:12:34.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.589+0000 7f422ffff640 1 --2- 172.21.15.5:0/810267312 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f42180663d0 0x7f4218068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:34.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.589+0000 7f422ffff640 1 --2- 172.21.15.5:0/810267312 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f42180663d0 0x7f4218068880 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f42200af000 tx=0x7f42200b6040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:34.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.589+0000 7f422effd640 1 -- 172.21.15.5:0/810267312 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f42280509f0 con 0x7f42380c8ad0 2023-07-14T13:12:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.777+0000 7f423cb03640 1 -- 172.21.15.5:0/810267312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f42380678d0 con 0x7f42380c8ad0 2023-07-14T13:12:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.781+0000 7f422effd640 1 -- 172.21.15.5:0/810267312 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v65) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4228054010 con 0x7f42380c8ad0 2023-07-14T13:12:34.816 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T13:12:34.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.781+0000 7f423cb03640 1 -- 172.21.15.5:0/810267312 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f42180663d0 msgr2=0x7f4218068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:34.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.781+0000 7f423cb03640 1 --2- 172.21.15.5:0/810267312 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f42180663d0 0x7f4218068880 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f42200af000 tx=0x7f42200b6040 comp rx=0 tx=0).stop 2023-07-14T13:12:34.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.781+0000 7f423cb03640 1 -- 172.21.15.5:0/810267312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42380c8ad0 msgr2=0x7f423814c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:34.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.781+0000 7f423cb03640 1 --2- 172.21.15.5:0/810267312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42380c8ad0 0x7f423814c770 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f422800c500 tx=0x7f422800c9c0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.781+0000 7f423cb03640 1 -- 172.21.15.5:0/810267312 shutdown_connections 2023-07-14T13:12:34.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.781+0000 7f423cb03640 1 --2- 172.21.15.5:0/810267312 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f42180663d0 0x7f4218068880 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.781+0000 7f423cb03640 1 --2- 172.21.15.5:0/810267312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4238158ce0 0x7f42380b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.781+0000 7f423cb03640 1 --2- 172.21.15.5:0/810267312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42380c9560 0x7f423814bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.781+0000 7f423cb03640 1 --2- 172.21.15.5:0/810267312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42380c8ad0 0x7f423814c770 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:34.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.781+0000 7f423cb03640 1 -- 172.21.15.5:0/810267312 >> 172.21.15.5:0/810267312 conn(0x7f42380afcf0 msgr2=0x7f42380ab8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:34.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.781+0000 7f423cb03640 1 -- 172.21.15.5:0/810267312 shutdown_connections 2023-07-14T13:12:34.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:34.781+0000 7f423cb03640 1 -- 172.21.15.5:0/810267312 wait complete. 2023-07-14T13:12:34.836 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-14T13:12:34.837 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T13:12:34.837 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-07-14T13:12:34.837 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-14T13:12:34.838 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-14T13:12:34.838 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-14T13:12:34.838 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-14T13:12:34.838 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T13:12:34.839 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T13:12:34.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:12:34.839 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-07-14T13:12:34.849 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T13:12:34.850 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T13:12:34.850 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T13:12:34.850 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:12:34.850 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-07-14T13:12:34.850 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:12:34.850 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T13:12:34.851 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-07-14T13:12:34.851 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2023-07-14T13:12:34.851 INFO:teuthology.orchestra.run.smithi005.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T13:12:34.851 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-07-14T13:12:34.851 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2023-07-14T13:12:34.851 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-14T13:12:34.851 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 41161sec preferred_lft 41161sec 2023-07-14T13:12:34.852 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-07-14T13:12:34.852 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:12:34.852 INFO:teuthology.orchestra.run.smithi005.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T13:12:34.852 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-07-14T13:12:34.852 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2023-07-14T13:12:34.852 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T13:12:34.852 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-07-14T13:12:34.852 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2023-07-14T13:12:34.853 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-14T13:12:34.853 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:96:b6:fb:c6 brd ff:ff:ff:ff:ff:ff 2023-07-14T13:12:34.853 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-14T13:12:34.853 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:12:34.853 INFO:teuthology.orchestra.run.smithi005.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T13:12:34.853 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-14T13:12:34.853 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T13:12:34.854 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:12:34.854 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-14T13:12:34.854 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:12:34.854 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T13:12:34.854 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T13:12:34.854 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-14T13:12:34.854 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:12:34.854 INFO:teuthology.orchestra.run.smithi005.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T13:12:34.855 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-14T13:12:34.855 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-14T13:12:34.855 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:12:34.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:12:34.856 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T13:12:34.918 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-07-14T13:12:34.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:12:34.921 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-07-14T13:12:34.972 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-07-14T13:12:34.972 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T13:12:34.972 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-14T13:12:34.973 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-14T13:12:34.973 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-14T13:12:34.973 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T13:12:34.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:12:34.973 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-07-14T13:12:34.974 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-07-14T13:12:34.974 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-14T13:12:34.974 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-14T13:12:34.975 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-14T13:12:34.975 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-07-14T13:12:35.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:12:35.069 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-07-14T13:12:35.079 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-14T13:12:35.080 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-14T13:12:35.080 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T13:12:35.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:12:35.081 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-07-14T13:12:35.144 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T13:12:35.145 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-14T13:12:35.195 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-14T13:12:35.196 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T13:12:35.196 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-14T13:12:35.246 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-14T13:12:35.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:12:35.248 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:12:35.338 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:12:35.339 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T13:12:35.339 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T13:12:35.354 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:12:35.354 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T13:12:35.354 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T13:12:35.354 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T13:12:35.354 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T13:12:35.363 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:12:35.363 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T13:12:35.363 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T13:12:35.363 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T13:12:35.364 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T13:12:35.364 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790" 2023-07-14T13:12:35.364 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790:/ 2023-07-14T13:12:35.364 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=22affb8d-e389-40f8-a764-dd40eb1759c8" will pass to kernel 2023-07-14T13:12:35.367 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T13:12:35.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:12:35.367 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-14T13:12:35.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:12:35.389 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T13:12:35.450 INFO:teuthology.orchestra.run.smithi005.stdout:client8551 2023-07-14T13:12:35.451 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:12:35.451 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:12:35.499 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-14T13:12:35.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.649+0000 7f8d868f9640 1 Processor -- start 2023-07-14T13:12:35.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.653+0000 7f8d868f9640 1 -- start start 2023-07-14T13:12:35.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.653+0000 7f8d868f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d80070b70 0x7f8d80070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:35.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.653+0000 7f8d868f9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8d800cb100 0x7f8d800cb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:35.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.653+0000 7f8d868f9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d800cbac0 con 0x7f8d8006b1e0 2023-07-14T13:12:35.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.653+0000 7f8d868f9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d800cac70 con 0x7f8d800cb100 2023-07-14T13:12:35.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.653+0000 7f8d868f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d80071480 con 0x7f8d80070b70 2023-07-14T13:12:35.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.653+0000 7f8d84e96640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8d800cb100 0x7f8d800cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:35.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.653+0000 7f8d84e96640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8d800cb100 0x7f8d800cb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55266/0 (socket says 172.21.15.5:55266) 2023-07-14T13:12:35.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.653+0000 7f8d84e96640 1 -- 172.21.15.5:0/668725157 learned_addr learned my addr 172.21.15.5:0/668725157 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:35.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.653+0000 7f8d7ffff640 1 --2- 172.21.15.5:0/668725157 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d80070b70 0x7f8d80070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:35.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.653+0000 7f8d84e96640 1 -- 172.21.15.5:0/668725157 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d80070b70 msgr2=0x7f8d80070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:35.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.653+0000 7f8d84e96640 1 --2- 172.21.15.5:0/668725157 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d80070b70 0x7f8d80070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.653+0000 7f8d84e96640 1 -- 172.21.15.5:0/668725157 >> v1:172.21.15.154:6789/0 conn(0x7f8d8006b1e0 legacy=0x7f8d800c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:35.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.653+0000 7f8d84e96640 1 -- 172.21.15.5:0/668725157 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d800ca060 con 0x7f8d800cb100 2023-07-14T13:12:35.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.657+0000 7f8d84e96640 1 --2- 172.21.15.5:0/668725157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d800cb100 0x7f8d800cb580 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f8d78009e50 tx=0x7f8d7801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=699108303b1ea267 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:35.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.657+0000 7f8d7f7fe640 1 -- 172.21.15.5:0/668725157 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d780a5810 con 0x7f8d800cb100 2023-07-14T13:12:35.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.657+0000 7f8d7f7fe640 1 -- 172.21.15.5:0/668725157 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d780a5970 con 0x7f8d800cb100 2023-07-14T13:12:35.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.657+0000 7f8d7f7fe640 1 -- 172.21.15.5:0/668725157 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d780a5d00 con 0x7f8d800cb100 2023-07-14T13:12:35.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.657+0000 7f8d868f9640 1 -- 172.21.15.5:0/668725157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d800cb100 msgr2=0x7f8d800cb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:35.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.657+0000 7f8d868f9640 1 --2- 172.21.15.5:0/668725157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d800cb100 0x7f8d800cb580 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f8d78009e50 tx=0x7f8d7801c950 comp rx=0 tx=0).stop 2023-07-14T13:12:35.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.657+0000 7f8d868f9640 1 -- 172.21.15.5:0/668725157 shutdown_connections 2023-07-14T13:12:35.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.657+0000 7f8d868f9640 1 --2- 172.21.15.5:0/668725157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d800cb100 0x7f8d800cb580 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.657+0000 7f8d868f9640 1 --2- 172.21.15.5:0/668725157 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d80070b70 0x7f8d80070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.657+0000 7f8d868f9640 1 -- 172.21.15.5:0/668725157 >> 172.21.15.5:0/668725157 conn(0x7f8d800afcf0 msgr2=0x7f8d800b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:35.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.657+0000 7f8d868f9640 1 -- 172.21.15.5:0/668725157 shutdown_connections 2023-07-14T13:12:35.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.657+0000 7f8d868f9640 1 -- 172.21.15.5:0/668725157 wait complete. 2023-07-14T13:12:35.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.657+0000 7f8d868f9640 1 Processor -- start 2023-07-14T13:12:35.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.657+0000 7f8d868f9640 1 -- start start 2023-07-14T13:12:35.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.661+0000 7f8d868f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d8006b1e0 0x7f8d800a9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:35.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.661+0000 7f8d868f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d80070b70 0x7f8d80156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:35.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.661+0000 7f8d868f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d800cb100 0x7f8d801f7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:35.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.661+0000 7f8d868f9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d800a9be0 con 0x7f8d800cb100 2023-07-14T13:12:35.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.661+0000 7f8d868f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d801f7ff0 con 0x7f8d80070b70 2023-07-14T13:12:35.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.661+0000 7f8d868f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d800a9820 con 0x7f8d8006b1e0 2023-07-14T13:12:35.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.661+0000 7f8d84e96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d800cb100 0x7f8d801f7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:35.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.661+0000 7f8d84e96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d800cb100 0x7f8d801f7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55276/0 (socket says 172.21.15.5:55276) 2023-07-14T13:12:35.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.661+0000 7f8d84e96640 1 -- 172.21.15.5:0/1135925523 learned_addr learned my addr 172.21.15.5:0/1135925523 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:35.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.661+0000 7f8d7ffff640 1 --2- 172.21.15.5:0/1135925523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d8006b1e0 0x7f8d800a9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:35.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.661+0000 7f8d77fff640 1 --2- 172.21.15.5:0/1135925523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d80070b70 0x7f8d80156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:35.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.661+0000 7f8d84e96640 1 -- 172.21.15.5:0/1135925523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d8006b1e0 msgr2=0x7f8d800a9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:35.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.661+0000 7f8d84e96640 1 --2- 172.21.15.5:0/1135925523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d8006b1e0 0x7f8d800a9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.661+0000 7f8d84e96640 1 -- 172.21.15.5:0/1135925523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d80070b70 msgr2=0x7f8d80156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:35.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.661+0000 7f8d84e96640 1 --2- 172.21.15.5:0/1135925523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d80070b70 0x7f8d80156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.661+0000 7f8d84e96640 1 -- 172.21.15.5:0/1135925523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d78009b30 con 0x7f8d800cb100 2023-07-14T13:12:35.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.661+0000 7f8d84e96640 1 --2- 172.21.15.5:0/1135925523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d800cb100 0x7f8d801f7ab0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f8d7801a580 tx=0x7f8d780196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:35.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.661+0000 7f8d7d7fa640 1 -- 172.21.15.5:0/1135925523 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d780b8670 con 0x7f8d800cb100 2023-07-14T13:12:35.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.661+0000 7f8d7d7fa640 1 -- 172.21.15.5:0/1135925523 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d780b87d0 con 0x7f8d800cb100 2023-07-14T13:12:35.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.661+0000 7f8d7d7fa640 1 -- 172.21.15.5:0/1135925523 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d780b8b80 con 0x7f8d800cb100 2023-07-14T13:12:35.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.661+0000 7f8d868f9640 1 -- 172.21.15.5:0/1135925523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d801f8290 con 0x7f8d800cb100 2023-07-14T13:12:35.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.661+0000 7f8d868f9640 1 -- 172.21.15.5:0/1135925523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d801f8850 con 0x7f8d800cb100 2023-07-14T13:12:35.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.661+0000 7f8d868f9640 1 -- 172.21.15.5:0/1135925523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d800a9d20 con 0x7f8d800cb100 2023-07-14T13:12:35.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.665+0000 7f8d7d7fa640 1 -- 172.21.15.5:0/1135925523 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8d780b8ce0 con 0x7f8d800cb100 2023-07-14T13:12:35.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.665+0000 7f8d7d7fa640 1 --2- 172.21.15.5:0/1135925523 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f8d600663a0 0x7f8d60068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:35.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.665+0000 7f8d7d7fa640 1 -- 172.21.15.5:0/1135925523 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f8d7811f530 con 0x7f8d800cb100 2023-07-14T13:12:35.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.665+0000 7f8d7ffff640 1 --2- 172.21.15.5:0/1135925523 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f8d600663a0 0x7f8d60068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:35.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.665+0000 7f8d7ffff640 1 --2- 172.21.15.5:0/1135925523 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f8d600663a0 0x7f8d60068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8d7000b9d0 tx=0x7f8d70008040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:35.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.669+0000 7f8d7d7fa640 1 -- 172.21.15.5:0/1135925523 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f8d800a9d20 con 0x7f8d800cb100 2023-07-14T13:12:35.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.845+0000 7f8d868f9640 1 -- 172.21.15.5:0/1135925523 --> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d801f89e0 con 0x7f8d600663a0 2023-07-14T13:12:35.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.845+0000 7f8d7d7fa640 1 -- 172.21.15.5:0/1135925523 <== mgr.7202 v2:172.21.15.154:6832/3769132865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f8d801f89e0 con 0x7f8d600663a0 2023-07-14T13:12:35.882 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-07-14T13:12:35.883 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:35.883 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs" 2023-07-14T13:12:35.883 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:35.883 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-07-14T13:12:35.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.849+0000 7f8d868f9640 1 -- 172.21.15.5:0/1135925523 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f8d600663a0 msgr2=0x7f8d60068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:35.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.849+0000 7f8d868f9640 1 --2- 172.21.15.5:0/1135925523 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f8d600663a0 0x7f8d60068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8d7000b9d0 tx=0x7f8d70008040 comp rx=0 tx=0).stop 2023-07-14T13:12:35.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.849+0000 7f8d868f9640 1 -- 172.21.15.5:0/1135925523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d800cb100 msgr2=0x7f8d801f7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:35.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.849+0000 7f8d868f9640 1 --2- 172.21.15.5:0/1135925523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d800cb100 0x7f8d801f7ab0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f8d7801a580 tx=0x7f8d780196f0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.849+0000 7f8d868f9640 1 -- 172.21.15.5:0/1135925523 shutdown_connections 2023-07-14T13:12:35.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.849+0000 7f8d868f9640 1 --2- 172.21.15.5:0/1135925523 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f8d600663a0 0x7f8d60068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.849+0000 7f8d868f9640 1 --2- 172.21.15.5:0/1135925523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d800cb100 0x7f8d801f7ab0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.849+0000 7f8d868f9640 1 --2- 172.21.15.5:0/1135925523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d80070b70 0x7f8d80156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.849+0000 7f8d868f9640 1 --2- 172.21.15.5:0/1135925523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8d8006b1e0 0x7f8d800a9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.849+0000 7f8d868f9640 1 -- 172.21.15.5:0/1135925523 >> 172.21.15.5:0/1135925523 conn(0x7f8d800afcf0 msgr2=0x7f8d800c2980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:35.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.849+0000 7f8d868f9640 1 -- 172.21.15.5:0/1135925523 shutdown_connections 2023-07-14T13:12:35.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:35.849+0000 7f8d868f9640 1 -- 172.21.15.5:0/1135925523 wait complete. 2023-07-14T13:12:35.904 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-14T13:12:36.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.013+0000 7fdaf7b00640 1 Processor -- start 2023-07-14T13:12:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.013+0000 7fdaf7b00640 1 -- start start 2023-07-14T13:12:36.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.017+0000 7fdaf7b00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdaf00cd980 0x7fdaf006cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:36.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.017+0000 7fdaf7b00640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf00c89f0 con 0x7fdaf0164340 2023-07-14T13:12:36.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.017+0000 7fdaf7b00640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf00cbe50 con 0x7fdaf01600b0 2023-07-14T13:12:36.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.017+0000 7fdaf7b00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf00cdd80 con 0x7fdaf00cd980 2023-07-14T13:12:36.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.017+0000 7fdaf509b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdaf0164340 0x7fdaf00c0b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:48990/0 (socket says 172.21.15.5:48990) 2023-07-14T13:12:36.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.017+0000 7fdaf509b640 1 -- 172.21.15.5:0/3802292289 learned_addr learned my addr 172.21.15.5:0/3802292289 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:36.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.017+0000 7fdaf609d640 1 --2- 172.21.15.5:0/3802292289 >> v2:172.21.15.5:3300/0 conn(0x7fdaf00cd980 0x7fdaf006cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:36.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.017+0000 7fdaf609d640 1 -- 172.21.15.5:0/3802292289 >> v1:172.21.15.154:6789/0 conn(0x7fdaf01600b0 legacy=0x7fdaf0163c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:36.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.017+0000 7fdaf609d640 1 -- 172.21.15.5:0/3802292289 >> v1:172.21.15.5:6789/0 conn(0x7fdaf0164340 legacy=0x7fdaf00c0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:36.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.017+0000 7fdaf609d640 1 -- 172.21.15.5:0/3802292289 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf00cc9d0 con 0x7fdaf00cd980 2023-07-14T13:12:36.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.017+0000 7fdaf609d640 1 --2- 172.21.15.5:0/3802292289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaf00cd980 0x7fdaf006cf80 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fdae8009d90 tx=0x7fdae801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1052c91014d1a105 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:36.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.021+0000 7fdaf489a640 1 -- 172.21.15.5:0/3802292289 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae80a5900 con 0x7fdaf00cd980 2023-07-14T13:12:36.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.021+0000 7fdaf489a640 1 -- 172.21.15.5:0/3802292289 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae80a5a60 con 0x7fdaf00cd980 2023-07-14T13:12:36.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.021+0000 7fdaf489a640 1 -- 172.21.15.5:0/3802292289 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae80a5df0 con 0x7fdaf00cd980 2023-07-14T13:12:36.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.021+0000 7fdaf7b00640 1 -- 172.21.15.5:0/3802292289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaf00cd980 msgr2=0x7fdaf006cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:36.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.021+0000 7fdaf7b00640 1 --2- 172.21.15.5:0/3802292289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaf00cd980 0x7fdaf006cf80 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fdae8009d90 tx=0x7fdae801c950 comp rx=0 tx=0).stop 2023-07-14T13:12:36.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.021+0000 7fdaf7b00640 1 -- 172.21.15.5:0/3802292289 shutdown_connections 2023-07-14T13:12:36.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.021+0000 7fdaf7b00640 1 --2- 172.21.15.5:0/3802292289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaf00cd980 0x7fdaf006cf80 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:36.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.021+0000 7fdaf7b00640 1 -- 172.21.15.5:0/3802292289 >> 172.21.15.5:0/3802292289 conn(0x7fdaf00afac0 msgr2=0x7fdaf00afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:36.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.021+0000 7fdaf7b00640 1 -- 172.21.15.5:0/3802292289 shutdown_connections 2023-07-14T13:12:36.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.021+0000 7fdaf7b00640 1 -- 172.21.15.5:0/3802292289 wait complete. 2023-07-14T13:12:36.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.021+0000 7fdaf7b00640 1 Processor -- start 2023-07-14T13:12:36.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.021+0000 7fdaf7b00640 1 -- start start 2023-07-14T13:12:36.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.021+0000 7fdaf7b00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaf00cd980 0x7fdaf0157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:36.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.021+0000 7fdaf7b00640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf01600b0 0x7fdaf00b3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:36.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.021+0000 7fdaf7b00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaf0164340 0x7fdaf01543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:36.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.021+0000 7fdaf7b00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf00c63f0 con 0x7fdaf00cd980 2023-07-14T13:12:36.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.021+0000 7fdaf7b00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf00b3bd0 con 0x7fdaf0164340 2023-07-14T13:12:36.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.021+0000 7fdaf7b00640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf00c7c70 con 0x7fdaf01600b0 2023-07-14T13:12:36.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.021+0000 7fdaf589c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaf00cd980 0x7fdaf0157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:36.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.021+0000 7fdaf589c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaf00cd980 0x7fdaf0157190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55296/0 (socket says 172.21.15.5:55296) 2023-07-14T13:12:36.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.021+0000 7fdaf589c640 1 -- 172.21.15.5:0/3909060492 learned_addr learned my addr 172.21.15.5:0/3909060492 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:36.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.025+0000 7fdaf509b640 1 --2- 172.21.15.5:0/3909060492 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf01600b0 0x7fdaf00b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:36.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.025+0000 7fdaf609d640 1 --2- 172.21.15.5:0/3909060492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaf0164340 0x7fdaf01543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:36.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.025+0000 7fdaf589c640 1 -- 172.21.15.5:0/3909060492 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf01600b0 msgr2=0x7fdaf00b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:36.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.025+0000 7fdaf589c640 1 --2- 172.21.15.5:0/3909060492 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf01600b0 0x7fdaf00b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:36.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.025+0000 7fdaf589c640 1 -- 172.21.15.5:0/3909060492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaf0164340 msgr2=0x7fdaf01543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:36.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.025+0000 7fdaf589c640 1 --2- 172.21.15.5:0/3909060492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaf0164340 0x7fdaf01543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:36.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.025+0000 7fdaf589c640 1 -- 172.21.15.5:0/3909060492 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae8009a70 con 0x7fdaf00cd980 2023-07-14T13:12:36.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.025+0000 7fdaf609d640 1 --2- 172.21.15.5:0/3909060492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaf0164340 0x7fdaf01543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:36.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.025+0000 7fdaf589c640 1 --2- 172.21.15.5:0/3909060492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaf00cd980 0x7fdaf0157190 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fdaec00c500 tx=0x7fdaec00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:36.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.025+0000 7fdae67fc640 1 -- 172.21.15.5:0/3909060492 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec005220 con 0x7fdaf00cd980 2023-07-14T13:12:36.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.025+0000 7fdae67fc640 1 -- 172.21.15.5:0/3909060492 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec005380 con 0x7fdaf00cd980 2023-07-14T13:12:36.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.025+0000 7fdae67fc640 1 -- 172.21.15.5:0/3909060492 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec007270 con 0x7fdaf00cd980 2023-07-14T13:12:36.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.025+0000 7fdaf7b00640 1 -- 172.21.15.5:0/3909060492 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf00c76b0 con 0x7fdaf00cd980 2023-07-14T13:12:36.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.025+0000 7fdaf7b00640 1 -- 172.21.15.5:0/3909060492 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf00b1870 con 0x7fdaf00cd980 2023-07-14T13:12:36.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.025+0000 7fdaf7b00640 1 -- 172.21.15.5:0/3909060492 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf00678d0 con 0x7fdaf00cd980 2023-07-14T13:12:36.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.025+0000 7fdae67fc640 1 -- 172.21.15.5:0/3909060492 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 62) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdaec0073d0 con 0x7fdaf00cd980 2023-07-14T13:12:36.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.025+0000 7fdae67fc640 1 --2- 172.21.15.5:0/3909060492 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fdad40663a0 0x7fdad4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:36.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.025+0000 7fdae67fc640 1 -- 172.21.15.5:0/3909060492 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fdaec0837d0 con 0x7fdaf00cd980 2023-07-14T13:12:36.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.029+0000 7fdaf509b640 1 --2- 172.21.15.5:0/3909060492 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fdad40663a0 0x7fdad4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:36.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.029+0000 7fdaf509b640 1 --2- 172.21.15.5:0/3909060492 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fdad40663a0 0x7fdad4068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdaf00b28d0 tx=0x7fdae0009040 comp rx=0 tx=0).ready entity=mgr.7202 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:36.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.029+0000 7fdae67fc640 1 -- 172.21.15.5:0/3909060492 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fdaec050a90 con 0x7fdaf00cd980 2023-07-14T13:12:36.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.221+0000 7fdaf7b00640 1 -- 172.21.15.5:0/3909060492 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fdaf00cd760 con 0x7fdaf00cd980 2023-07-14T13:12:36.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.805+0000 7fdae67fc640 1 -- 172.21.15.5:0/3909060492 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 63) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fdaec050e60 con 0x7fdaf00cd980 2023-07-14T13:12:36.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.809+0000 7fdae67fc640 1 -- 172.21.15.5:0/3909060492 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v63) v1 ==== 92+0+0 (secure 0 0 0) 0x7fdaec07f400 con 0x7fdaf00cd980 2023-07-14T13:12:36.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.809+0000 7fdaf7b00640 1 -- 172.21.15.5:0/3909060492 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fdad40663a0 msgr2=0x7fdad4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:36.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.809+0000 7fdaf7b00640 1 --2- 172.21.15.5:0/3909060492 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fdad40663a0 0x7fdad4068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdaf00b28d0 tx=0x7fdae0009040 comp rx=0 tx=0).stop 2023-07-14T13:12:36.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.809+0000 7fdaf7b00640 1 -- 172.21.15.5:0/3909060492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaf00cd980 msgr2=0x7fdaf0157190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:36.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.809+0000 7fdaf7b00640 1 --2- 172.21.15.5:0/3909060492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaf00cd980 0x7fdaf0157190 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fdaec00c500 tx=0x7fdaec00c9c0 comp rx=0 tx=0).stop 2023-07-14T13:12:36.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.809+0000 7fdaf7b00640 1 -- 172.21.15.5:0/3909060492 shutdown_connections 2023-07-14T13:12:36.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.809+0000 7fdaf7b00640 1 --2- 172.21.15.5:0/3909060492 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7fdad40663a0 0x7fdad4068850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:36.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.809+0000 7fdaf7b00640 1 --2- 172.21.15.5:0/3909060492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaf0164340 0x7fdaf01543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:36.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.809+0000 7fdaf7b00640 1 --2- 172.21.15.5:0/3909060492 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf01600b0 0x7fdaf00b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:36.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.809+0000 7fdaf7b00640 1 --2- 172.21.15.5:0/3909060492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaf00cd980 0x7fdaf0157190 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:36.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.809+0000 7fdaf7b00640 1 -- 172.21.15.5:0/3909060492 >> 172.21.15.5:0/3909060492 conn(0x7fdaf00afac0 msgr2=0x7fdaf00cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:36.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.809+0000 7fdaf7b00640 1 -- 172.21.15.5:0/3909060492 shutdown_connections 2023-07-14T13:12:36.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.809+0000 7fdaf7b00640 1 -- 172.21.15.5:0/3909060492 wait complete. 2023-07-14T13:12:36.869 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-14T13:12:37.021 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:36.990+0000 7f3f9302d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:12:37.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.985+0000 7f979e996640 1 Processor -- start 2023-07-14T13:12:37.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.985+0000 7f979e996640 1 -- start start 2023-07-14T13:12:37.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.989+0000 7f979e996640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9798069430 0x7f9798069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:37.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.989+0000 7f979e996640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f97980af2b0 0x7f979815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:37.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.989+0000 7f979e996640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9798159d70 con 0x7f9798070f30 2023-07-14T13:12:37.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.989+0000 7f979e996640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9798069d40 con 0x7f97980af2b0 2023-07-14T13:12:37.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.989+0000 7f979e996640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97980c9c60 con 0x7f9798069430 2023-07-14T13:12:37.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.989+0000 7f97977fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9798070f30 0x7f97980ad6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49020/0 (socket says 172.21.15.5:49020) 2023-07-14T13:12:37.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.989+0000 7f97977fe640 1 -- 172.21.15.5:0/4167716884 learned_addr learned my addr 172.21.15.5:0/4167716884 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:37.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.989+0000 7f9797fff640 1 --2- 172.21.15.5:0/4167716884 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9798069430 0x7f9798069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:37.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.989+0000 7f979cf33640 1 --2- 172.21.15.5:0/4167716884 >> v2:172.21.15.154:3300/0 conn(0x7f97980af2b0 0x7f979815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:37.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.989+0000 7f9796ffd640 1 -- 172.21.15.5:0/4167716884 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1607372580 0 0) 0x7f978c001120 con 0x7f9798070f30 2023-07-14T13:12:37.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.989+0000 7f9796ffd640 1 -- 172.21.15.5:0/4167716884 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9780003530 con 0x7f9798070f30 2023-07-14T13:12:37.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.989+0000 7f9797fff640 1 -- 172.21.15.5:0/4167716884 >> v2:172.21.15.154:3300/0 conn(0x7f97980af2b0 msgr2=0x7f979815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:37.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.989+0000 7f9797fff640 1 --2- 172.21.15.5:0/4167716884 >> v2:172.21.15.154:3300/0 conn(0x7f97980af2b0 0x7f979815a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:37.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.989+0000 7f9797fff640 1 -- 172.21.15.5:0/4167716884 >> v1:172.21.15.5:6789/0 conn(0x7f9798070f30 legacy=0x7f97980ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:37.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.989+0000 7f9797fff640 1 -- 172.21.15.5:0/4167716884 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97980c9f40 con 0x7f9798069430 2023-07-14T13:12:37.026 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:36.989+0000 7faa27b28180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:12:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.989+0000 7f9797fff640 1 --2- 172.21.15.5:0/4167716884 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9798069430 0x7f9798069800 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f97880097c0 tx=0x7f978801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a711afe85836c6f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:37.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.993+0000 7f9796ffd640 1 -- 172.21.15.5:0/4167716884 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97880ad640 con 0x7f9798069430 2023-07-14T13:12:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.993+0000 7f9796ffd640 1 -- 172.21.15.5:0/4167716884 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97880ad7a0 con 0x7f9798069430 2023-07-14T13:12:37.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.993+0000 7f9796ffd640 1 -- 172.21.15.5:0/4167716884 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97880adb30 con 0x7f9798069430 2023-07-14T13:12:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.993+0000 7f979e996640 1 -- 172.21.15.5:0/4167716884 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9798069430 msgr2=0x7f9798069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.993+0000 7f979e996640 1 --2- 172.21.15.5:0/4167716884 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9798069430 0x7f9798069800 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f97880097c0 tx=0x7f978801c480 comp rx=0 tx=0).stop 2023-07-14T13:12:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.993+0000 7f979e996640 1 -- 172.21.15.5:0/4167716884 shutdown_connections 2023-07-14T13:12:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.993+0000 7f979e996640 1 --2- 172.21.15.5:0/4167716884 >> v2:172.21.15.154:3300/0 conn(0x7f97980af2b0 0x7f979815a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.993+0000 7f979e996640 1 --2- 172.21.15.5:0/4167716884 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9798069430 0x7f9798069800 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.993+0000 7f979e996640 1 -- 172.21.15.5:0/4167716884 >> 172.21.15.5:0/4167716884 conn(0x7f97980cde90 msgr2=0x7f97980ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:37.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.993+0000 7f979e996640 1 -- 172.21.15.5:0/4167716884 shutdown_connections 2023-07-14T13:12:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.993+0000 7f979e996640 1 -- 172.21.15.5:0/4167716884 wait complete. 2023-07-14T13:12:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.993+0000 7f979e996640 1 Processor -- start 2023-07-14T13:12:37.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.993+0000 7f979e996640 1 -- start start 2023-07-14T13:12:37.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.997+0000 7f979e996640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9798069430 0x7f9798153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.997+0000 7f979e996640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9798070f30 0x7f97981457d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.997+0000 7f979e996640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97980af2b0 0x7f97980b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.997+0000 7f979e996640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97980c61f0 con 0x7f9798069430 2023-07-14T13:12:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.997+0000 7f979e996640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97980c64d0 con 0x7f97980af2b0 2023-07-14T13:12:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.997+0000 7f979e996640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97980c67b0 con 0x7f9798070f30 2023-07-14T13:12:37.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.997+0000 7f9797fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9798069430 0x7f9798153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:37.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.997+0000 7f9797fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9798069430 0x7f9798153800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55316/0 (socket says 172.21.15.5:55316) 2023-07-14T13:12:37.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.997+0000 7f9797fff640 1 -- 172.21.15.5:0/4096662967 learned_addr learned my addr 172.21.15.5:0/4096662967 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:37.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.997+0000 7f97977fe640 1 --2- 172.21.15.5:0/4096662967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9798070f30 0x7f97981457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:37.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.997+0000 7f979cf33640 1 --2- 172.21.15.5:0/4096662967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97980af2b0 0x7f97980b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:37.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.997+0000 7f9797fff640 1 -- 172.21.15.5:0/4096662967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9798070f30 msgr2=0x7f97981457d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:37.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.997+0000 7f9797fff640 1 --2- 172.21.15.5:0/4096662967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9798070f30 0x7f97981457d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:37.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.997+0000 7f9797fff640 1 -- 172.21.15.5:0/4096662967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97980af2b0 msgr2=0x7f97980b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:37.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.997+0000 7f9797fff640 1 --2- 172.21.15.5:0/4096662967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97980af2b0 0x7f97980b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:37.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.997+0000 7f9797fff640 1 -- 172.21.15.5:0/4096662967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9788009420 con 0x7f9798069430 2023-07-14T13:12:37.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.997+0000 7f9797fff640 1 --2- 172.21.15.5:0/4096662967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9798069430 0x7f9798153800 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f97880b0040 tx=0x7f9788019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:37.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.997+0000 7f9794ff9640 1 -- 172.21.15.5:0/4096662967 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97880b6610 con 0x7f9798069430 2023-07-14T13:12:37.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.997+0000 7f9794ff9640 1 -- 172.21.15.5:0/4096662967 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97880a6040 con 0x7f9798069430 2023-07-14T13:12:37.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.997+0000 7f979e996640 1 -- 172.21.15.5:0/4096662967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97980c6a90 con 0x7f9798069430 2023-07-14T13:12:37.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.997+0000 7f9794ff9640 1 -- 172.21.15.5:0/4096662967 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97880b69b0 con 0x7f9798069430 2023-07-14T13:12:37.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.997+0000 7f979e996640 1 -- 172.21.15.5:0/4096662967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9798152f80 con 0x7f9798069430 2023-07-14T13:12:37.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.997+0000 7f979e996640 1 -- 172.21.15.5:0/4096662967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97980678d0 con 0x7f9798069430 2023-07-14T13:12:37.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:36.997+0000 7f9794ff9640 1 -- 172.21.15.5:0/4096662967 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 63) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f97880b4040 con 0x7f9798069430 2023-07-14T13:12:37.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.001+0000 7f9794ff9640 1 --2- 172.21.15.5:0/4096662967 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f97840663f0 0x7f97840688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:37.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.001+0000 7f9794ff9640 1 -- 172.21.15.5:0/4096662967 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f978811deb0 con 0x7f9798069430 2023-07-14T13:12:37.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.001+0000 7f97977fe640 1 -- 172.21.15.5:0/4096662967 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f97840663f0 msgr2=0x7f97840688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3769132865 2023-07-14T13:12:37.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.001+0000 7f97977fe640 1 --2- 172.21.15.5:0/4096662967 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f97840663f0 0x7f97840688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:12:37.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.005+0000 7f9794ff9640 1 -- 172.21.15.5:0/4096662967 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f97880eb180 con 0x7f9798069430 2023-07-14T13:12:37.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.161+0000 7f979e996640 1 -- 172.21.15.5:0/4096662967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f97980c6330 con 0x7f9798069430 2023-07-14T13:12:37.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.165+0000 7f9794ff9640 1 -- 172.21.15.5:0/4096662967 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v47)=0 v47) v1 ==== 138+0+0 (secure 0 0 0) 0x7f97980c6330 con 0x7f9798069430 2023-07-14T13:12:37.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.169+0000 7f979e996640 1 -- 172.21.15.5:0/4096662967 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f97840663f0 msgr2=0x7f97840688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:12:37.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.169+0000 7f979e996640 1 --2- 172.21.15.5:0/4096662967 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f97840663f0 0x7f97840688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:37.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.169+0000 7f979e996640 1 -- 172.21.15.5:0/4096662967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9798069430 msgr2=0x7f9798153800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:37.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.169+0000 7f979e996640 1 --2- 172.21.15.5:0/4096662967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9798069430 0x7f9798153800 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f97880b0040 tx=0x7f9788019220 comp rx=0 tx=0).stop 2023-07-14T13:12:37.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.169+0000 7f979e996640 1 -- 172.21.15.5:0/4096662967 shutdown_connections 2023-07-14T13:12:37.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.169+0000 7f979e996640 1 --2- 172.21.15.5:0/4096662967 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f97840663f0 0x7f97840688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:37.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.169+0000 7f979e996640 1 --2- 172.21.15.5:0/4096662967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97980af2b0 0x7f97980b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:37.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.169+0000 7f979e996640 1 --2- 172.21.15.5:0/4096662967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9798070f30 0x7f97981457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:37.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.169+0000 7f979e996640 1 --2- 172.21.15.5:0/4096662967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9798069430 0x7f9798153800 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:37.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.169+0000 7f979e996640 1 -- 172.21.15.5:0/4096662967 >> 172.21.15.5:0/4096662967 conn(0x7f97980cde90 msgr2=0x7f97980cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:37.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.169+0000 7f979e996640 1 -- 172.21.15.5:0/4096662967 shutdown_connections 2023-07-14T13:12:37.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.169+0000 7f979e996640 1 -- 172.21.15.5:0/4096662967 wait complete. 2023-07-14T13:12:37.224 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-14T13:12:37.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.337+0000 7f8bf99c5640 1 Processor -- start 2023-07-14T13:12:37.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.337+0000 7f8bf99c5640 1 -- start start 2023-07-14T13:12:37.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.337+0000 7f8bf99c5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8bf40d04d0 0x7f8bf40b1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:37.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.337+0000 7f8bf99c5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf40b07d0 0x7f8bf40b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:37.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.337+0000 7f8bf99c5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf40b19e0 con 0x7f8bf415bb30 2023-07-14T13:12:37.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.337+0000 7f8bf99c5640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf40b17d0 con 0x7f8bf40d04d0 2023-07-14T13:12:37.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.337+0000 7f8bf99c5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf40b1cc0 con 0x7f8bf40b07d0 2023-07-14T13:12:37.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.337+0000 7f8bf2ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8bf415bb30 0x7f8bf40cfdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49028/0 (socket says 172.21.15.5:49028) 2023-07-14T13:12:37.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.337+0000 7f8bf2ffd640 1 -- 172.21.15.5:0/202826571 learned_addr learned my addr 172.21.15.5:0/202826571 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:37.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.337+0000 7f8bf37fe640 1 --2- 172.21.15.5:0/202826571 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf40b07d0 0x7f8bf40b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:37.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.337+0000 7f8bebfff640 1 --2- 172.21.15.5:0/202826571 >> v2:172.21.15.154:3300/0 conn(0x7f8bf40d04d0 0x7f8bf40b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:37.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.337+0000 7f8bf27fc640 1 -- 172.21.15.5:0/202826571 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489754480 0 0) 0x7f8bf40b19e0 con 0x7f8bf415bb30 2023-07-14T13:12:37.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.337+0000 7f8bf27fc640 1 -- 172.21.15.5:0/202826571 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8be0003530 con 0x7f8bf415bb30 2023-07-14T13:12:37.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.337+0000 7f8bf37fe640 1 -- 172.21.15.5:0/202826571 >> v2:172.21.15.154:3300/0 conn(0x7f8bf40d04d0 msgr2=0x7f8bf40b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:37.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.337+0000 7f8bf37fe640 1 --2- 172.21.15.5:0/202826571 >> v2:172.21.15.154:3300/0 conn(0x7f8bf40d04d0 0x7f8bf40b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:37.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.337+0000 7f8bf37fe640 1 -- 172.21.15.5:0/202826571 >> v1:172.21.15.5:6789/0 conn(0x7f8bf415bb30 legacy=0x7f8bf40cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:37.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.337+0000 7f8bf37fe640 1 -- 172.21.15.5:0/202826571 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf40b1fa0 con 0x7f8bf40b07d0 2023-07-14T13:12:37.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.337+0000 7f8bebfff640 1 --2- 172.21.15.5:0/202826571 >> v2:172.21.15.154:3300/0 conn(0x7f8bf40d04d0 0x7f8bf40b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:37.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.341+0000 7f8bf37fe640 1 --2- 172.21.15.5:0/202826571 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf40b07d0 0x7f8bf40b27a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8bec009d90 tx=0x7f8bec01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ff233468c413e7b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:37.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.341+0000 7f8bf27fc640 1 -- 172.21.15.5:0/202826571 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec0a5a00 con 0x7f8bf40b07d0 2023-07-14T13:12:37.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.341+0000 7f8bf27fc640 1 -- 172.21.15.5:0/202826571 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bec0a5b60 con 0x7f8bf40b07d0 2023-07-14T13:12:37.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.341+0000 7f8bf27fc640 1 -- 172.21.15.5:0/202826571 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec0ad440 con 0x7f8bf40b07d0 2023-07-14T13:12:37.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.341+0000 7f8bf99c5640 1 -- 172.21.15.5:0/202826571 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf40b07d0 msgr2=0x7f8bf40b27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:37.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.341+0000 7f8bf99c5640 1 --2- 172.21.15.5:0/202826571 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf40b07d0 0x7f8bf40b27a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8bec009d90 tx=0x7f8bec01c920 comp rx=0 tx=0).stop 2023-07-14T13:12:37.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.341+0000 7f8bf99c5640 1 -- 172.21.15.5:0/202826571 shutdown_connections 2023-07-14T13:12:37.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.341+0000 7f8bf99c5640 1 --2- 172.21.15.5:0/202826571 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf40b07d0 0x7f8bf40b27a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:37.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.341+0000 7f8bf99c5640 1 --2- 172.21.15.5:0/202826571 >> v2:172.21.15.154:3300/0 conn(0x7f8bf40d04d0 0x7f8bf40b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:37.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.341+0000 7f8bf99c5640 1 -- 172.21.15.5:0/202826571 >> 172.21.15.5:0/202826571 conn(0x7f8bf409b4c0 msgr2=0x7f8bf40d21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:37.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.341+0000 7f8bf99c5640 1 -- 172.21.15.5:0/202826571 shutdown_connections 2023-07-14T13:12:37.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.341+0000 7f8bf99c5640 1 -- 172.21.15.5:0/202826571 wait complete. 2023-07-14T13:12:37.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.345+0000 7f8bf99c5640 1 Processor -- start 2023-07-14T13:12:37.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.345+0000 7f8bf99c5640 1 -- start start 2023-07-14T13:12:37.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.345+0000 7f8bf99c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf40b07d0 0x7f8bf4156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:37.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.345+0000 7f8bf99c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf40d04d0 0x7f8bf414e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:37.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.345+0000 7f8bf99c5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf415bb30 0x7f8bf41501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:37.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.345+0000 7f8bf99c5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf41562a0 con 0x7f8bf40d04d0 2023-07-14T13:12:37.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.345+0000 7f8bf99c5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf4150c90 con 0x7f8bf40b07d0 2023-07-14T13:12:37.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.345+0000 7f8bf99c5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf4150f70 con 0x7f8bf415bb30 2023-07-14T13:12:37.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.345+0000 7f8bebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf40d04d0 0x7f8bf414e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:37.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.345+0000 7f8bf2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf40b07d0 0x7f8bf4156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:37.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.345+0000 7f8bebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf40d04d0 0x7f8bf414e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55318/0 (socket says 172.21.15.5:55318) 2023-07-14T13:12:37.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.345+0000 7f8bebfff640 1 -- 172.21.15.5:0/1518914326 learned_addr learned my addr 172.21.15.5:0/1518914326 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:37.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.345+0000 7f8bf37fe640 1 --2- 172.21.15.5:0/1518914326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf415bb30 0x7f8bf41501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:37.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.345+0000 7f8bebfff640 1 -- 172.21.15.5:0/1518914326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf415bb30 msgr2=0x7f8bf41501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:37.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.345+0000 7f8bebfff640 1 --2- 172.21.15.5:0/1518914326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf415bb30 0x7f8bf41501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:37.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.345+0000 7f8bebfff640 1 -- 172.21.15.5:0/1518914326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf40b07d0 msgr2=0x7f8bf4156cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:37.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.345+0000 7f8bebfff640 1 --2- 172.21.15.5:0/1518914326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf40b07d0 0x7f8bf4156cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:37.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.345+0000 7f8bebfff640 1 -- 172.21.15.5:0/1518914326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bdc009420 con 0x7f8bf40d04d0 2023-07-14T13:12:37.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.345+0000 7f8bf2ffd640 1 --2- 172.21.15.5:0/1518914326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf40b07d0 0x7f8bf4156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:37.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.345+0000 7f8bebfff640 1 --2- 172.21.15.5:0/1518914326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf40d04d0 0x7f8bf414e510 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00e9d0 tx=0x7f8bdc00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:37.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.345+0000 7f8bf0ff9640 1 -- 172.21.15.5:0/1518914326 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc00ca60 con 0x7f8bf40d04d0 2023-07-14T13:12:37.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.345+0000 7f8bf0ff9640 1 -- 172.21.15.5:0/1518914326 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bdc00cbc0 con 0x7f8bf40d04d0 2023-07-14T13:12:37.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.345+0000 7f8bf0ff9640 1 -- 172.21.15.5:0/1518914326 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc013470 con 0x7f8bf40d04d0 2023-07-14T13:12:37.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.349+0000 7f8bf99c5640 1 -- 172.21.15.5:0/1518914326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bec009a70 con 0x7f8bf40d04d0 2023-07-14T13:12:37.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.349+0000 7f8bf99c5640 1 -- 172.21.15.5:0/1518914326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf41567d0 con 0x7f8bf40d04d0 2023-07-14T13:12:37.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.349+0000 7f8bf99c5640 1 -- 172.21.15.5:0/1518914326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf404e020 con 0x7f8bf40d04d0 2023-07-14T13:12:37.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.349+0000 7f8bf0ff9640 1 -- 172.21.15.5:0/1518914326 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 63) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f8bdc0135d0 con 0x7f8bf40d04d0 2023-07-14T13:12:37.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.349+0000 7f8bf0ff9640 1 --2- 172.21.15.5:0/1518914326 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f8bd40663f0 0x7f8bd40688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:37.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.349+0000 7f8bf0ff9640 1 -- 172.21.15.5:0/1518914326 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f8bdc083e40 con 0x7f8bf40d04d0 2023-07-14T13:12:37.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.349+0000 7f8bf2ffd640 1 -- 172.21.15.5:0/1518914326 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f8bd40663f0 msgr2=0x7f8bd40688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3769132865 2023-07-14T13:12:37.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.349+0000 7f8bf2ffd640 1 --2- 172.21.15.5:0/1518914326 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f8bd40663f0 0x7f8bd40688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:12:37.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.353+0000 7f8bf0ff9640 1 -- 172.21.15.5:0/1518914326 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f8bdc051230 con 0x7f8bf40d04d0 2023-07-14T13:12:37.439 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:37.410+0000 7f3f9302d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:12:37.472 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:37.437+0000 7faa27b28180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:12:37.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.513+0000 7f8bf99c5640 1 -- 172.21.15.5:0/1518914326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f8bf40d2cc0 con 0x7f8bf40d04d0 2023-07-14T13:12:37.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.517+0000 7f8bf0ff9640 1 -- 172.21.15.5:0/1518914326 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v48)=0 v48) v1 ==== 133+0+0 (secure 0 0 0) 0x7f8bdc054850 con 0x7f8bf40d04d0 2023-07-14T13:12:37.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.517+0000 7f8bf99c5640 1 -- 172.21.15.5:0/1518914326 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f8bd40663f0 msgr2=0x7f8bd40688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:12:37.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.517+0000 7f8bf99c5640 1 --2- 172.21.15.5:0/1518914326 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f8bd40663f0 0x7f8bd40688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:37.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.517+0000 7f8bf99c5640 1 -- 172.21.15.5:0/1518914326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf40d04d0 msgr2=0x7f8bf414e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:37.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.517+0000 7f8bf99c5640 1 --2- 172.21.15.5:0/1518914326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf40d04d0 0x7f8bf414e510 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00e9d0 tx=0x7f8bdc00ee90 comp rx=0 tx=0).stop 2023-07-14T13:12:37.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.517+0000 7f8bf99c5640 1 -- 172.21.15.5:0/1518914326 shutdown_connections 2023-07-14T13:12:37.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.517+0000 7f8bf99c5640 1 --2- 172.21.15.5:0/1518914326 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f8bd40663f0 0x7f8bd40688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:37.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.517+0000 7f8bf99c5640 1 --2- 172.21.15.5:0/1518914326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8bf415bb30 0x7f8bf41501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:37.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.517+0000 7f8bf99c5640 1 --2- 172.21.15.5:0/1518914326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf40d04d0 0x7f8bf414e510 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:37.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.517+0000 7f8bf99c5640 1 --2- 172.21.15.5:0/1518914326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf40b07d0 0x7f8bf4156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:37.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.517+0000 7f8bf99c5640 1 -- 172.21.15.5:0/1518914326 >> 172.21.15.5:0/1518914326 conn(0x7f8bf409b4c0 msgr2=0x7f8bf4155170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:37.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.517+0000 7f8bf99c5640 1 -- 172.21.15.5:0/1518914326 shutdown_connections 2023-07-14T13:12:37.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.517+0000 7f8bf99c5640 1 -- 172.21.15.5:0/1518914326 wait complete. 2023-07-14T13:12:37.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:12:37.574 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-14T13:12:37.590 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1h 2023-07-14T13:12:37.592 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:37.558+0000 7f3f9302d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:12:37.632 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:37.597+0000 7faa27b28180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:12:37.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.745+0000 7f97da0d5640 1 Processor -- start 2023-07-14T13:12:37.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.745+0000 7f97da0d5640 1 -- start start 2023-07-14T13:12:37.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.745+0000 7f97da0d5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f97d40d03f0 0x7f97d40ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:37.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.745+0000 7f97da0d5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97d40b11b0 0x7f97d40aece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:37.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.745+0000 7f97da0d5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d40ceaa0 con 0x7f97d415bb10 2023-07-14T13:12:37.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.745+0000 7f97da0d5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d40ce690 con 0x7f97d40d03f0 2023-07-14T13:12:37.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.745+0000 7f97da0d5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d40d1fb0 con 0x7f97d40b11b0 2023-07-14T13:12:37.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.745+0000 7f97d88d2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f97d40d03f0 0x7f97d40ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:37.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.745+0000 7f97d88d2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f97d40d03f0 0x7f97d40ce150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55334/0 (socket says 172.21.15.5:55334) 2023-07-14T13:12:37.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.745+0000 7f97d88d2640 1 -- 172.21.15.5:0/3508989749 learned_addr learned my addr 172.21.15.5:0/3508989749 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:37.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.745+0000 7f97d98d4640 1 --2- 172.21.15.5:0/3508989749 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97d40b11b0 0x7f97d40aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:37.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.745+0000 7f97d88d2640 1 -- 172.21.15.5:0/3508989749 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97d40b11b0 msgr2=0x7f97d40aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:37.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.745+0000 7f97d88d2640 1 --2- 172.21.15.5:0/3508989749 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97d40b11b0 0x7f97d40aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:37.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.745+0000 7f97d88d2640 1 -- 172.21.15.5:0/3508989749 >> v1:172.21.15.154:6789/0 conn(0x7f97d415bb10 legacy=0x7f97d40cfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:37.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.745+0000 7f97d88d2640 1 -- 172.21.15.5:0/3508989749 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d40ced80 con 0x7f97d40d03f0 2023-07-14T13:12:37.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.749+0000 7f97d88d2640 1 --2- 172.21.15.5:0/3508989749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97d40d03f0 0x7f97d40ce150 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f97c4009870 tx=0x7f97c401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3673a1e269446e20 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:37.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.749+0000 7f97cbfff640 1 -- 172.21.15.5:0/3508989749 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c40ab5f0 con 0x7f97d40d03f0 2023-07-14T13:12:37.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.749+0000 7f97cbfff640 1 -- 172.21.15.5:0/3508989749 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c40ab750 con 0x7f97d40d03f0 2023-07-14T13:12:37.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.749+0000 7f97cbfff640 1 -- 172.21.15.5:0/3508989749 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c40abae0 con 0x7f97d40d03f0 2023-07-14T13:12:37.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.749+0000 7f97da0d5640 1 -- 172.21.15.5:0/3508989749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97d40d03f0 msgr2=0x7f97d40ce150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:37.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.749+0000 7f97da0d5640 1 --2- 172.21.15.5:0/3508989749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97d40d03f0 0x7f97d40ce150 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f97c4009870 tx=0x7f97c401c3f0 comp rx=0 tx=0).stop 2023-07-14T13:12:37.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.749+0000 7f97da0d5640 1 -- 172.21.15.5:0/3508989749 shutdown_connections 2023-07-14T13:12:37.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.749+0000 7f97da0d5640 1 --2- 172.21.15.5:0/3508989749 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97d40b11b0 0x7f97d40aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:37.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.749+0000 7f97da0d5640 1 --2- 172.21.15.5:0/3508989749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97d40d03f0 0x7f97d40ce150 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:37.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.749+0000 7f97da0d5640 1 -- 172.21.15.5:0/3508989749 >> 172.21.15.5:0/3508989749 conn(0x7f97d409b480 msgr2=0x7f97d40d2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:37.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.749+0000 7f97da0d5640 1 -- 172.21.15.5:0/3508989749 shutdown_connections 2023-07-14T13:12:37.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.749+0000 7f97da0d5640 1 -- 172.21.15.5:0/3508989749 wait complete. 2023-07-14T13:12:37.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.753+0000 7f97da0d5640 1 Processor -- start 2023-07-14T13:12:37.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.753+0000 7f97da0d5640 1 -- start start 2023-07-14T13:12:37.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.753+0000 7f97da0d5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97d40b11b0 0x7f97d4153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:37.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.753+0000 7f97da0d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97d40d03f0 0x7f97d40b7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:37.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.753+0000 7f97da0d5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97d415bb10 0x7f97d40b77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:37.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.753+0000 7f97da0d5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d40b7e10 con 0x7f97d40d03f0 2023-07-14T13:12:37.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.753+0000 7f97da0d5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d415c200 con 0x7f97d40b11b0 2023-07-14T13:12:37.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.753+0000 7f97da0d5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d415c4e0 con 0x7f97d415bb10 2023-07-14T13:12:37.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.753+0000 7f97d88d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97d40d03f0 0x7f97d40b7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:37.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.753+0000 7f97d90d3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97d40b11b0 0x7f97d4153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:37.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.753+0000 7f97d88d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97d40d03f0 0x7f97d40b7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55336/0 (socket says 172.21.15.5:55336) 2023-07-14T13:12:37.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.753+0000 7f97d88d2640 1 -- 172.21.15.5:0/3399416201 learned_addr learned my addr 172.21.15.5:0/3399416201 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:37.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.753+0000 7f97d98d4640 1 --2- 172.21.15.5:0/3399416201 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97d415bb10 0x7f97d40b77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:37.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.753+0000 7f97d88d2640 1 -- 172.21.15.5:0/3399416201 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97d415bb10 msgr2=0x7f97d40b77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:37.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.753+0000 7f97d88d2640 1 --2- 172.21.15.5:0/3399416201 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97d415bb10 0x7f97d40b77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:37.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.753+0000 7f97d88d2640 1 -- 172.21.15.5:0/3399416201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97d40b11b0 msgr2=0x7f97d4153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:37.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.753+0000 7f97d88d2640 1 --2- 172.21.15.5:0/3399416201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97d40b11b0 0x7f97d4153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:37.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.753+0000 7f97d88d2640 1 -- 172.21.15.5:0/3399416201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c40094d0 con 0x7f97d40d03f0 2023-07-14T13:12:37.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.753+0000 7f97d88d2640 1 --2- 172.21.15.5:0/3399416201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97d40d03f0 0x7f97d40b7290 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f97c401a020 tx=0x7f97c401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:37.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.753+0000 7f97c9ffb640 1 -- 172.21.15.5:0/3399416201 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c40b4800 con 0x7f97d40d03f0 2023-07-14T13:12:37.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.753+0000 7f97c9ffb640 1 -- 172.21.15.5:0/3399416201 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c40b4960 con 0x7f97d40d03f0 2023-07-14T13:12:37.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.753+0000 7f97c9ffb640 1 -- 172.21.15.5:0/3399416201 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c40b4d10 con 0x7f97d40d03f0 2023-07-14T13:12:37.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.753+0000 7f97da0d5640 1 -- 172.21.15.5:0/3399416201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d415c7c0 con 0x7f97d40d03f0 2023-07-14T13:12:37.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.753+0000 7f97da0d5640 1 -- 172.21.15.5:0/3399416201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d4154380 con 0x7f97d40d03f0 2023-07-14T13:12:37.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.757+0000 7f97da0d5640 1 -- 172.21.15.5:0/3399416201 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d404e020 con 0x7f97d40d03f0 2023-07-14T13:12:37.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.757+0000 7f97c9ffb640 1 -- 172.21.15.5:0/3399416201 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 63) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f97c40c7440 con 0x7f97d40d03f0 2023-07-14T13:12:37.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.757+0000 7f97c9ffb640 1 --2- 172.21.15.5:0/3399416201 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f97b80663f0 0x7f97b80688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:37.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.757+0000 7f97c9ffb640 1 -- 172.21.15.5:0/3399416201 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f97c40a8050 con 0x7f97d40d03f0 2023-07-14T13:12:37.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.757+0000 7f97d90d3640 1 -- 172.21.15.5:0/3399416201 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f97b80663f0 msgr2=0x7f97b80688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3769132865 2023-07-14T13:12:37.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.757+0000 7f97d90d3640 1 --2- 172.21.15.5:0/3399416201 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f97b80663f0 0x7f97b80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:12:37.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.761+0000 7f97c9ffb640 1 -- 172.21.15.5:0/3399416201 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f97c40ebcb0 con 0x7f97d40d03f0 2023-07-14T13:12:37.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.937+0000 7f97da0d5640 1 -- 172.21.15.5:0/3399416201 --> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f97d40cf620 con 0x7f97b80663f0 2023-07-14T13:12:37.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.961+0000 7f97d90d3640 1 -- 172.21.15.5:0/3399416201 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f97b80663f0 msgr2=0x7f97b80688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3769132865 2023-07-14T13:12:37.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:37.961+0000 7f97d90d3640 1 --2- 172.21.15.5:0/3399416201 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f97b80663f0 0x7f97b80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-14T13:12:38.072 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:38.042+0000 7f3f9302d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:12:38.131 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:38.102+0000 7f3f9302d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:12:38.142 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:38.105+0000 7faa27b28180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:12:38.188 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:38.158+0000 7f3f9302d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:12:38.203 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:38.165+0000 7faa27b28180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:12:38.262 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:38.225+0000 7faa27b28180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:12:38.273 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:38.242+0000 7f3f9302d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:12:38.330 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:38.298+0000 7f3f9302d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:12:38.351 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:38.317+0000 7faa27b28180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:12:38.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:38.365+0000 7f97d90d3640 1 -- 172.21.15.5:0/3399416201 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f97b80663f0 msgr2=0x7f97b80688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3769132865 2023-07-14T13:12:38.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:38.365+0000 7f97d90d3640 1 --2- 172.21.15.5:0/3399416201 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f97b80663f0 0x7f97b80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-14T13:12:38.411 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:38.373+0000 7faa27b28180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:12:38.414 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:38.386+0000 7f3f9302d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:12:38.471 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:38.442+0000 7f3f9302d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:12:38.499 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:38.461+0000 7faa27b28180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:12:38.558 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:38.521+0000 7faa27b28180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:12:38.613 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:38.582+0000 7f3f9302d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:12:38.671 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:38.642+0000 7f3f9302d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:12:38.706 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:38.669+0000 7faa27b28180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:12:38.768 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:38.733+0000 7faa27b28180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:12:38.912 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:12:38.912 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:12:38.912 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:12:38.920 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:38.890+0000 7f3f9302d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:12:39.018 INFO:tasks.ceph.mgr.y.smithi005.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:12:39.019 INFO:tasks.ceph.mgr.y.smithi005.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:12:39.019 INFO:tasks.ceph.mgr.y.smithi005.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:12:39.027 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:38.993+0000 7faa27b28180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:12:39.055 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:39.026+0000 7f3f9302d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:12:39.167 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:39.129+0000 7faa27b28180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:12:39.181 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:39.150+0000 7f3f9302d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:12:39.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:39.169+0000 7f97d90d3640 1 -- 172.21.15.5:0/3399416201 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f97b80663f0 msgr2=0x7f97b80688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3769132865 2023-07-14T13:12:39.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:39.169+0000 7f97d90d3640 1 --2- 172.21.15.5:0/3399416201 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f97b80663f0 0x7f97b80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-14T13:12:39.251 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:39.222+0000 7f3f9302d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:12:39.298 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:39.261+0000 7faa27b28180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:12:39.372 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:39.337+0000 7faa27b28180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:12:39.384 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:39.354+0000 7f3f9302d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:12:39.512 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:39.477+0000 7faa27b28180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:12:39.922 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:39.890+0000 7f3f9302d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:12:40.010 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:39.978+0000 7f3f9302d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:12:40.080 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:40.045+0000 7faa27b28180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:12:40.159 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:40.130+0000 7f3f9302d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:12:40.169 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:40.133+0000 7faa27b28180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:12:40.243 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:40.214+0000 7f3f9302d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:12:40.323 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:40.285+0000 7faa27b28180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:12:40.410 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:40.373+0000 7faa27b28180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:12:40.513 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:40.482+0000 7f3f9302d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:12:40.572 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:40.542+0000 7f3f9302d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:12:40.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:40.549+0000 7f97c9ffb640 1 -- 172.21.15.5:0/3399416201 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 64) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f97c40ec080 con 0x7f97d40d03f0 2023-07-14T13:12:40.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:40.549+0000 7f97c9ffb640 1 -- 172.21.15.5:0/3399416201 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f97b80663f0 msgr2=0x7f97b80688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:12:40.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:40.549+0000 7f97c9ffb640 1 --2- 172.21.15.5:0/3399416201 >> [v2:172.21.15.154:6832/3769132865,v1:172.21.15.154:6833/3769132865] conn(0x7f97b80663f0 0x7f97b80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:40.705 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:40.669+0000 7faa27b28180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:12:40.707 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:40.678+0000 7f3f11112640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:40.707 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:40.678+0000 7f3f11112640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:40.707 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:40.678+0000 7f3f11112640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:40.707 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:40.678+0000 7f3f11112640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:40.708 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:40.678+0000 7f3f11112640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:40.708 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:40.678+0000 7f3f14118640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:40.708 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:40.678+0000 7f3f14118640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:40.708 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:40.678+0000 7f3f14118640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:40.708 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:40.678+0000 7f3f14118640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:40.709 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:40.678+0000 7f3f14118640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:40.769 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:40.733+0000 7faa27b28180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:12:41.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.553+0000 7f97c9ffb640 1 -- 172.21.15.5:0/3399416201 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mgrmap(e 65) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f97c40f0940 con 0x7f97d40d03f0 2023-07-14T13:12:41.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.553+0000 7f97c9ffb640 1 --2- 172.21.15.5:0/3399416201 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7f97b8033e90 0x7f97b8070920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:41.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.553+0000 7f97c9ffb640 1 -- 172.21.15.5:0/3399416201 --> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f97b8034260 con 0x7f97b8033e90 2023-07-14T13:12:41.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.553+0000 7f97d90d3640 1 --2- 172.21.15.5:0/3399416201 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7f97b8033e90 0x7f97b8070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:41.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.557+0000 7f97d90d3640 1 --2- 172.21.15.5:0/3399416201 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7f97b8033e90 0x7f97b8070920 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f97d0007fd0 tx=0x7f97d0007e40 comp rx=0 tx=0).ready entity=mgr.7520 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:41.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.621+0000 7f97c9ffb640 1 -- 172.21.15.5:0/3399416201 <== mgr.7520 v2:172.21.15.154:6832/4272779335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f97b8034260 con 0x7f97b8033e90 2023-07-14T13:12:41.658 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule set for path snap_test_dir1 2023-07-14T13:12:41.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.625+0000 7f97da0d5640 1 -- 172.21.15.5:0/3399416201 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7f97b8033e90 msgr2=0x7f97b8070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:41.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.625+0000 7f97da0d5640 1 --2- 172.21.15.5:0/3399416201 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7f97b8033e90 0x7f97b8070920 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f97d0007fd0 tx=0x7f97d0007e40 comp rx=0 tx=0).stop 2023-07-14T13:12:41.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.625+0000 7f97da0d5640 1 -- 172.21.15.5:0/3399416201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97d40d03f0 msgr2=0x7f97d40b7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:41.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.625+0000 7f97da0d5640 1 --2- 172.21.15.5:0/3399416201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97d40d03f0 0x7f97d40b7290 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f97c401a020 tx=0x7f97c401ac30 comp rx=0 tx=0).stop 2023-07-14T13:12:41.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.625+0000 7f97d98d4640 1 -- 172.21.15.5:0/3399416201 reap_dead start 2023-07-14T13:12:41.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.625+0000 7f97da0d5640 1 -- 172.21.15.5:0/3399416201 shutdown_connections 2023-07-14T13:12:41.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.625+0000 7f97da0d5640 1 -- 172.21.15.5:0/3399416201 >> 172.21.15.5:0/3399416201 conn(0x7f97d409b480 msgr2=0x7f97d40d2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:41.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.625+0000 7f97da0d5640 1 -- 172.21.15.5:0/3399416201 shutdown_connections 2023-07-14T13:12:41.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.625+0000 7f97da0d5640 1 -- 172.21.15.5:0/3399416201 wait complete. 2023-07-14T13:12:41.681 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-14T13:12:41.681 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-07-14T13:12:41.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.797+0000 7ff94f66a640 1 Processor -- start 2023-07-14T13:12:41.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.797+0000 7ff94f66a640 1 -- start start 2023-07-14T13:12:41.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.797+0000 7ff94f66a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff94815cef0 0x7ff948158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:41.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.797+0000 7ff94f66a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9481532b0 con 0x7ff948159270 2023-07-14T13:12:41.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.797+0000 7ff94f66a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9480ca6f0 con 0x7ff9480aeb40 2023-07-14T13:12:41.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.797+0000 7ff94f66a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff94815d360 con 0x7ff94815cef0 2023-07-14T13:12:41.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.797+0000 7ff94dc07640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff948159270 0x7ff9480c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49768/0 (socket says 172.21.15.5:49768) 2023-07-14T13:12:41.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.797+0000 7ff94dc07640 1 -- 172.21.15.5:0/823589230 learned_addr learned my addr 172.21.15.5:0/823589230 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:41.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.797+0000 7ff94cc05640 1 --2- 172.21.15.5:0/823589230 >> v2:172.21.15.154:3300/0 conn(0x7ff94815cef0 0x7ff948158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:41.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.797+0000 7ff93ffff640 1 -- 172.21.15.5:0/823589230 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3011231511 0 0) 0x7ff9481532b0 con 0x7ff948159270 2023-07-14T13:12:41.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.797+0000 7ff93ffff640 1 -- 172.21.15.5:0/823589230 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff934003530 con 0x7ff948159270 2023-07-14T13:12:41.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.797+0000 7ff94cc05640 1 -- 172.21.15.5:0/823589230 >> v1:172.21.15.154:6789/0 conn(0x7ff9480aeb40 legacy=0x7ff9480aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:41.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.797+0000 7ff93ffff640 1 -- 172.21.15.5:0/823589230 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2470322350 0 0) 0x7ff9480ca6f0 con 0x7ff9480aeb40 2023-07-14T13:12:41.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.797+0000 7ff94cc05640 1 -- 172.21.15.5:0/823589230 >> v1:172.21.15.5:6789/0 conn(0x7ff948159270 legacy=0x7ff9480c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:41.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.797+0000 7ff94cc05640 1 -- 172.21.15.5:0/823589230 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9481599d0 con 0x7ff94815cef0 2023-07-14T13:12:41.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.801+0000 7ff94cc05640 1 --2- 172.21.15.5:0/823589230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff94815cef0 0x7ff948158d30 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff9380097c0 tx=0x7ff93801c290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e543e9bc0650264 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:41.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.801+0000 7ff93ffff640 1 -- 172.21.15.5:0/823589230 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940001a00 con 0x7ff94815cef0 2023-07-14T13:12:41.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.801+0000 7ff93ffff640 1 -- 172.21.15.5:0/823589230 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9380a7050 con 0x7ff94815cef0 2023-07-14T13:12:41.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.801+0000 7ff93ffff640 1 -- 172.21.15.5:0/823589230 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9380ab620 con 0x7ff94815cef0 2023-07-14T13:12:41.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.801+0000 7ff94f66a640 1 -- 172.21.15.5:0/823589230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff94815cef0 msgr2=0x7ff948158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:41.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.801+0000 7ff94f66a640 1 --2- 172.21.15.5:0/823589230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff94815cef0 0x7ff948158d30 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff9380097c0 tx=0x7ff93801c290 comp rx=0 tx=0).stop 2023-07-14T13:12:41.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.801+0000 7ff94f66a640 1 -- 172.21.15.5:0/823589230 shutdown_connections 2023-07-14T13:12:41.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.801+0000 7ff94f66a640 1 --2- 172.21.15.5:0/823589230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff94815cef0 0x7ff948158d30 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:41.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.801+0000 7ff94f66a640 1 -- 172.21.15.5:0/823589230 >> 172.21.15.5:0/823589230 conn(0x7ff9480cde90 msgr2=0x7ff9480ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:41.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.801+0000 7ff94f66a640 1 -- 172.21.15.5:0/823589230 shutdown_connections 2023-07-14T13:12:41.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.801+0000 7ff94f66a640 1 -- 172.21.15.5:0/823589230 wait complete. 2023-07-14T13:12:41.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.805+0000 7ff94f66a640 1 Processor -- start 2023-07-14T13:12:41.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.805+0000 7ff94f66a640 1 -- start start 2023-07-14T13:12:41.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.805+0000 7ff94f66a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9480aeb40 0x7ff94814bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:41.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.805+0000 7ff94f66a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff948159270 0x7ff948155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:41.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.805+0000 7ff94f66a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff94815cef0 0x7ff9480b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:41.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.805+0000 7ff94f66a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff948153620 con 0x7ff9480aeb40 2023-07-14T13:12:41.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.805+0000 7ff94f66a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94806cd80 con 0x7ff948159270 2023-07-14T13:12:41.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.805+0000 7ff94f66a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94806d060 con 0x7ff94815cef0 2023-07-14T13:12:41.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.805+0000 7ff94d406640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9480aeb40 0x7ff94814bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:41.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.805+0000 7ff94d406640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9480aeb40 0x7ff94814bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59196/0 (socket says 172.21.15.5:59196) 2023-07-14T13:12:41.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.805+0000 7ff94cc05640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff948159270 0x7ff948155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:41.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.805+0000 7ff94d406640 1 -- 172.21.15.5:0/1578194340 learned_addr learned my addr 172.21.15.5:0/1578194340 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:41.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.805+0000 7ff94dc07640 1 --2- 172.21.15.5:0/1578194340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff94815cef0 0x7ff9480b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:41.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.805+0000 7ff94cc05640 1 -- 172.21.15.5:0/1578194340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff94815cef0 msgr2=0x7ff9480b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:41.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.805+0000 7ff94cc05640 1 --2- 172.21.15.5:0/1578194340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff94815cef0 0x7ff9480b16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:41.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.805+0000 7ff94cc05640 1 -- 172.21.15.5:0/1578194340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9480aeb40 msgr2=0x7ff94814bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:41.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.805+0000 7ff94cc05640 1 --2- 172.21.15.5:0/1578194340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9480aeb40 0x7ff94814bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:41.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.805+0000 7ff94cc05640 1 -- 172.21.15.5:0/1578194340 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff938009420 con 0x7ff948159270 2023-07-14T13:12:41.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.805+0000 7ff94d406640 1 --2- 172.21.15.5:0/1578194340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9480aeb40 0x7ff94814bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:41.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.805+0000 7ff94cc05640 1 --2- 172.21.15.5:0/1578194340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff948159270 0x7ff948155920 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff9380ab000 tx=0x7ff938019030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:41.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.805+0000 7ff93dffb640 1 -- 172.21.15.5:0/1578194340 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9380b4410 con 0x7ff948159270 2023-07-14T13:12:41.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.805+0000 7ff93dffb640 1 -- 172.21.15.5:0/1578194340 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9380b4570 con 0x7ff948159270 2023-07-14T13:12:41.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.805+0000 7ff93dffb640 1 -- 172.21.15.5:0/1578194340 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9380b4900 con 0x7ff948159270 2023-07-14T13:12:41.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.805+0000 7ff94f66a640 1 -- 172.21.15.5:0/1578194340 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff94806d340 con 0x7ff948159270 2023-07-14T13:12:41.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.809+0000 7ff94f66a640 1 -- 172.21.15.5:0/1578194340 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94814c890 con 0x7ff948159270 2023-07-14T13:12:41.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.809+0000 7ff94f66a640 1 -- 172.21.15.5:0/1578194340 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff94814ca80 con 0x7ff948159270 2023-07-14T13:12:41.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.809+0000 7ff93dffb640 1 -- 172.21.15.5:0/1578194340 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 65) v1 ==== 85513+0+0 (secure 0 0 0) 0x7ff9380b2040 con 0x7ff948159270 2023-07-14T13:12:41.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.809+0000 7ff93dffb640 1 --2- 172.21.15.5:0/1578194340 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7ff92c066120 0x7ff92c0685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.809+0000 7ff93dffb640 1 -- 172.21.15.5:0/1578194340 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6434+0+0 (secure 0 0 0) 0x7ff93811da70 con 0x7ff948159270 2023-07-14T13:12:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.809+0000 7ff94d406640 1 --2- 172.21.15.5:0/1578194340 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7ff92c066120 0x7ff92c0685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.813+0000 7ff94d406640 1 --2- 172.21.15.5:0/1578194340 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7ff92c066120 0x7ff92c0685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff944007fd0 tx=0x7ff944009040 comp rx=0 tx=0).ready entity=mgr.7520 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.813+0000 7ff93dffb640 1 -- 172.21.15.5:0/1578194340 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff9380eb110 con 0x7ff948159270 2023-07-14T13:12:42.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:41.989+0000 7ff94f66a640 1 -- 172.21.15.5:0/1578194340 --> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff94815c9d0 con 0x7ff92c066120 2023-07-14T13:12:42.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.041+0000 7ff93dffb640 1 -- 172.21.15.5:0/1578194340 <== mgr.7520 v2:172.21.15.154:6832/4272779335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff94400fcb0 con 0x7ff92c066120 2023-07-14T13:12:42.079 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule removed for path snap_test_dir1 2023-07-14T13:12:42.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.045+0000 7ff94f66a640 1 -- 172.21.15.5:0/1578194340 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7ff92c066120 msgr2=0x7ff92c0685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:42.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.045+0000 7ff94f66a640 1 --2- 172.21.15.5:0/1578194340 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7ff92c066120 0x7ff92c0685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff944007fd0 tx=0x7ff944009040 comp rx=0 tx=0).stop 2023-07-14T13:12:42.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.045+0000 7ff94f66a640 1 -- 172.21.15.5:0/1578194340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff948159270 msgr2=0x7ff948155920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.045+0000 7ff94f66a640 1 --2- 172.21.15.5:0/1578194340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff948159270 0x7ff948155920 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff9380ab000 tx=0x7ff938019030 comp rx=0 tx=0).stop 2023-07-14T13:12:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.045+0000 7ff94f66a640 1 -- 172.21.15.5:0/1578194340 shutdown_connections 2023-07-14T13:12:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.045+0000 7ff94f66a640 1 --2- 172.21.15.5:0/1578194340 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff94815cef0 0x7ff9480b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.045+0000 7ff94f66a640 1 --2- 172.21.15.5:0/1578194340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff948159270 0x7ff948155920 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.045+0000 7ff94f66a640 1 --2- 172.21.15.5:0/1578194340 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7ff92c066120 0x7ff92c0685d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.045+0000 7ff94f66a640 1 --2- 172.21.15.5:0/1578194340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9480aeb40 0x7ff94814bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:42.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.045+0000 7ff94f66a640 1 -- 172.21.15.5:0/1578194340 >> 172.21.15.5:0/1578194340 conn(0x7ff9480cde90 msgr2=0x7ff94814db40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.045+0000 7ff94f66a640 1 -- 172.21.15.5:0/1578194340 shutdown_connections 2023-07-14T13:12:42.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.045+0000 7ff94f66a640 1 -- 172.21.15.5:0/1578194340 wait complete. 2023-07-14T13:12:42.100 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-07-14T13:12:42.101 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-07-14T13:12:42.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.213+0000 7f71bb848640 1 Processor -- start 2023-07-14T13:12:42.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.213+0000 7f71bb848640 1 -- start start 2023-07-14T13:12:42.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.213+0000 7f71bb848640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f71b415bde0 0x7f71b40d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:42.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.213+0000 7f71bb848640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71b40d2fc0 0x7f71b40b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:42.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.217+0000 7f71bb848640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b40b04c0 con 0x7f71b40d2300 2023-07-14T13:12:42.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.217+0000 7f71bb848640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b415c1b0 con 0x7f71b415bde0 2023-07-14T13:12:42.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.217+0000 7f71bb848640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b40d0aa0 con 0x7f71b40d2fc0 2023-07-14T13:12:42.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.217+0000 7f71b95e4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f71b415bde0 0x7f71b40d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:42.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.217+0000 7f71b95e4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f71b415bde0 0x7f71b40d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59212/0 (socket says 172.21.15.5:59212) 2023-07-14T13:12:42.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.217+0000 7f71b95e4640 1 -- 172.21.15.5:0/356449434 learned_addr learned my addr 172.21.15.5:0/356449434 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:42.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.217+0000 7f71b8de3640 1 --2- 172.21.15.5:0/356449434 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71b40d2fc0 0x7f71b40b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:42.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.217+0000 7f71b95e4640 1 -- 172.21.15.5:0/356449434 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71b40d2fc0 msgr2=0x7f71b40b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:42.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.217+0000 7f71b95e4640 1 --2- 172.21.15.5:0/356449434 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71b40d2fc0 0x7f71b40b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:42.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.217+0000 7f71b95e4640 1 -- 172.21.15.5:0/356449434 >> v1:172.21.15.5:6789/0 conn(0x7f71b40d2300 legacy=0x7f71b40cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:42.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.217+0000 7f71b95e4640 1 -- 172.21.15.5:0/356449434 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b40afb90 con 0x7f71b415bde0 2023-07-14T13:12:42.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.217+0000 7f71b95e4640 1 --2- 172.21.15.5:0/356449434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b415bde0 0x7f71b40d0270 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f71b0006fd0 tx=0x7f71b001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=518682b1e5c437ad server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:42.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.217+0000 7f71abfff640 1 -- 172.21.15.5:0/356449434 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b00aa680 con 0x7f71b415bde0 2023-07-14T13:12:42.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.217+0000 7f71abfff640 1 -- 172.21.15.5:0/356449434 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b00aa7e0 con 0x7f71b415bde0 2023-07-14T13:12:42.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.217+0000 7f71abfff640 1 -- 172.21.15.5:0/356449434 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b00aab70 con 0x7f71b415bde0 2023-07-14T13:12:42.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.221+0000 7f71bb848640 1 -- 172.21.15.5:0/356449434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b415bde0 msgr2=0x7f71b40d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:42.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.221+0000 7f71bb848640 1 --2- 172.21.15.5:0/356449434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b415bde0 0x7f71b40d0270 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f71b0006fd0 tx=0x7f71b001c520 comp rx=0 tx=0).stop 2023-07-14T13:12:42.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.221+0000 7f71bb848640 1 -- 172.21.15.5:0/356449434 shutdown_connections 2023-07-14T13:12:42.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.221+0000 7f71bb848640 1 --2- 172.21.15.5:0/356449434 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71b40d2fc0 0x7f71b40b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:42.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.221+0000 7f71bb848640 1 --2- 172.21.15.5:0/356449434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b415bde0 0x7f71b40d0270 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:42.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.221+0000 7f71bb848640 1 -- 172.21.15.5:0/356449434 >> 172.21.15.5:0/356449434 conn(0x7f71b40659d0 msgr2=0x7f71b409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:42.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.221+0000 7f71bb848640 1 -- 172.21.15.5:0/356449434 shutdown_connections 2023-07-14T13:12:42.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.221+0000 7f71bb848640 1 -- 172.21.15.5:0/356449434 wait complete. 2023-07-14T13:12:42.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.221+0000 7f71bb848640 1 Processor -- start 2023-07-14T13:12:42.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.221+0000 7f71bb848640 1 -- start start 2023-07-14T13:12:42.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.221+0000 7f71bb848640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71b40d2300 0x7f71b414f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:42.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.221+0000 7f71bb848640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b40d2fc0 0x7f71b4150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:42.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.221+0000 7f71bb848640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71b415bde0 0x7f71b41506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:42.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.221+0000 7f71bb848640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b415cd00 con 0x7f71b40d2fc0 2023-07-14T13:12:42.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.221+0000 7f71bb848640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b415d5a0 con 0x7f71b415bde0 2023-07-14T13:12:42.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.221+0000 7f71bb848640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b40c8d60 con 0x7f71b40d2300 2023-07-14T13:12:42.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.221+0000 7f71b8de3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b40d2fc0 0x7f71b4150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:42.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.221+0000 7f71b8de3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b40d2fc0 0x7f71b4150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59222/0 (socket says 172.21.15.5:59222) 2023-07-14T13:12:42.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.221+0000 7f71b8de3640 1 -- 172.21.15.5:0/1959786250 learned_addr learned my addr 172.21.15.5:0/1959786250 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:42.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.221+0000 7f71b9de5640 1 --2- 172.21.15.5:0/1959786250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71b415bde0 0x7f71b41506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:42.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.221+0000 7f71b95e4640 1 --2- 172.21.15.5:0/1959786250 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71b40d2300 0x7f71b414f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:42.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.225+0000 7f71b8de3640 1 -- 172.21.15.5:0/1959786250 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71b40d2300 msgr2=0x7f71b414f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:42.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.225+0000 7f71b8de3640 1 --2- 172.21.15.5:0/1959786250 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71b40d2300 0x7f71b414f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:42.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.225+0000 7f71b8de3640 1 -- 172.21.15.5:0/1959786250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71b415bde0 msgr2=0x7f71b41506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:42.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.225+0000 7f71b8de3640 1 --2- 172.21.15.5:0/1959786250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71b415bde0 0x7f71b41506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:42.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.225+0000 7f71b8de3640 1 -- 172.21.15.5:0/1959786250 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b0009480 con 0x7f71b40d2fc0 2023-07-14T13:12:42.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.225+0000 7f71b8de3640 1 --2- 172.21.15.5:0/1959786250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b40d2fc0 0x7f71b4150180 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f71a400d800 tx=0x7f71a400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:42.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.225+0000 7f71a9ffb640 1 -- 172.21.15.5:0/1959786250 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a400b6c0 con 0x7f71b40d2fc0 2023-07-14T13:12:42.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.225+0000 7f71a9ffb640 1 -- 172.21.15.5:0/1959786250 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a400b820 con 0x7f71b40d2fc0 2023-07-14T13:12:42.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.225+0000 7f71a9ffb640 1 -- 172.21.15.5:0/1959786250 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a400bb90 con 0x7f71b40d2fc0 2023-07-14T13:12:42.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.225+0000 7f71bb848640 1 -- 172.21.15.5:0/1959786250 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b415cf50 con 0x7f71b40d2fc0 2023-07-14T13:12:42.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.225+0000 7f71bb848640 1 -- 172.21.15.5:0/1959786250 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b40c89c0 con 0x7f71b40d2fc0 2023-07-14T13:12:42.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.225+0000 7f71bb848640 1 -- 172.21.15.5:0/1959786250 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b40678d0 con 0x7f71b40d2fc0 2023-07-14T13:12:42.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.225+0000 7f71a9ffb640 1 -- 172.21.15.5:0/1959786250 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 65) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f71a400bcf0 con 0x7f71b40d2fc0 2023-07-14T13:12:42.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.225+0000 7f71a9ffb640 1 --2- 172.21.15.5:0/1959786250 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7f7198066120 0x7f71980685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.225+0000 7f71a9ffb640 1 -- 172.21.15.5:0/1959786250 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f71a4083f60 con 0x7f71b40d2fc0 2023-07-14T13:12:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.229+0000 7f71b95e4640 1 --2- 172.21.15.5:0/1959786250 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7f7198066120 0x7f71980685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.229+0000 7f71b95e4640 1 --2- 172.21.15.5:0/1959786250 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7f7198066120 0x7f71980685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f71b00ae000 tx=0x7f71b00a7000 comp rx=0 tx=0).ready entity=mgr.7520 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:42.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.233+0000 7f71a9ffb640 1 -- 172.21.15.5:0/1959786250 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f71a40b4720 con 0x7f71b40d2fc0 2023-07-14T13:12:42.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.401+0000 7f71bb848640 1 -- 172.21.15.5:0/1959786250 --> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f71b415d710 con 0x7f7198066120 2023-07-14T13:12:42.445 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:42.414+0000 7f3f1b126640 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-07-14T13:12:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.409+0000 7f71a9ffb640 1 -- 172.21.15.5:0/1959786250 <== mgr.7520 v2:172.21.15.154:6832/4272779335 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f71b415d710 con 0x7f7198066120 2023-07-14T13:12:42.446 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-07-14T13:12:42.454 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-07-14T13:12:42.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:12:42.455 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-14T13:12:42.467 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-14T13:12:42.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.625+0000 7ff152140640 1 Processor -- start 2023-07-14T13:12:42.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.625+0000 7ff152140640 1 -- start start 2023-07-14T13:12:42.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.629+0000 7ff152140640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff14c159a70 0x7ff14c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:42.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.629+0000 7ff152140640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff14c071030 0x7ff14c0c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:42.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.629+0000 7ff152140640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff14c0cbe50 con 0x7ff14c15e060 2023-07-14T13:12:42.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.629+0000 7ff152140640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14c0cd660 con 0x7ff14c071030 2023-07-14T13:12:42.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.629+0000 7ff152140640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14c0cc0a0 con 0x7ff14c159a70 2023-07-14T13:12:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.629+0000 7ff14bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff14c071030 0x7ff14c0c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.629+0000 7ff14bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff14c071030 0x7ff14c0c9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59238/0 (socket says 172.21.15.5:59238) 2023-07-14T13:12:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.629+0000 7ff14bfff640 1 -- 172.21.15.5:0/576377683 learned_addr learned my addr 172.21.15.5:0/576377683 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.629+0000 7ff14b7fe640 1 --2- 172.21.15.5:0/576377683 >> v2:172.21.15.154:3300/0 conn(0x7ff14c159a70 0x7ff14c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.629+0000 7ff14bfff640 1 -- 172.21.15.5:0/576377683 >> v2:172.21.15.154:3300/0 conn(0x7ff14c159a70 msgr2=0x7ff14c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.629+0000 7ff14bfff640 1 --2- 172.21.15.5:0/576377683 >> v2:172.21.15.154:3300/0 conn(0x7ff14c159a70 0x7ff14c0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:42.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.629+0000 7ff14bfff640 1 -- 172.21.15.5:0/576377683 >> v1:172.21.15.5:6789/0 conn(0x7ff14c15e060 legacy=0x7ff14c070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.629+0000 7ff14bfff640 1 -- 172.21.15.5:0/576377683 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c0cc380 con 0x7ff14c071030 2023-07-14T13:12:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.629+0000 7ff14a7fc640 1 -- 172.21.15.5:0/576377683 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2259754374 0 0) 0x7ff14c0cbe50 con 0x7ff14c15e060 2023-07-14T13:12:42.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.633+0000 7ff14bfff640 1 --2- 172.21.15.5:0/576377683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff14c071030 0x7ff14c0c9da0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7ff14c071b50 tx=0x7ff14401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b2ef3f6a290e01 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:42.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.633+0000 7ff14a7fc640 1 -- 172.21.15.5:0/576377683 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1440a56e0 con 0x7ff14c071030 2023-07-14T13:12:42.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.633+0000 7ff14a7fc640 1 -- 172.21.15.5:0/576377683 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1440a5840 con 0x7ff14c071030 2023-07-14T13:12:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.633+0000 7ff14a7fc640 1 -- 172.21.15.5:0/576377683 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1440a5bd0 con 0x7ff14c071030 2023-07-14T13:12:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.633+0000 7ff152140640 1 -- 172.21.15.5:0/576377683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff14c071030 msgr2=0x7ff14c0c9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:42.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.633+0000 7ff152140640 1 --2- 172.21.15.5:0/576377683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff14c071030 0x7ff14c0c9da0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7ff14c071b50 tx=0x7ff14401c880 comp rx=0 tx=0).stop 2023-07-14T13:12:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.633+0000 7ff152140640 1 -- 172.21.15.5:0/576377683 shutdown_connections 2023-07-14T13:12:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.633+0000 7ff152140640 1 --2- 172.21.15.5:0/576377683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff14c071030 0x7ff14c0c9da0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.633+0000 7ff152140640 1 --2- 172.21.15.5:0/576377683 >> v2:172.21.15.154:3300/0 conn(0x7ff14c159a70 0x7ff14c0ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.633+0000 7ff152140640 1 -- 172.21.15.5:0/576377683 >> 172.21.15.5:0/576377683 conn(0x7ff14c0afac0 msgr2=0x7ff14c0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.633+0000 7ff152140640 1 -- 172.21.15.5:0/576377683 shutdown_connections 2023-07-14T13:12:42.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.633+0000 7ff152140640 1 -- 172.21.15.5:0/576377683 wait complete. 2023-07-14T13:12:42.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.633+0000 7ff152140640 1 Processor -- start 2023-07-14T13:12:42.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.633+0000 7ff152140640 1 -- start start 2023-07-14T13:12:42.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.637+0000 7ff152140640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff14c071030 0x7ff14c0b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:42.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.637+0000 7ff152140640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff14c159a70 0x7ff14c15afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:42.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.637+0000 7ff152140640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff14c15e060 0x7ff14c15b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:42.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.637+0000 7ff152140640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c0b1890 con 0x7ff14c15e060 2023-07-14T13:12:42.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.637+0000 7ff152140640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c0b1560 con 0x7ff14c159a70 2023-07-14T13:12:42.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.637+0000 7ff152140640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c15a380 con 0x7ff14c071030 2023-07-14T13:12:42.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.637+0000 7ff14bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff14c15e060 0x7ff14c15b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:42.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.637+0000 7ff14b7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff14c071030 0x7ff14c0b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.637+0000 7ff14affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff14c159a70 0x7ff14c15afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.637+0000 7ff14bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff14c15e060 0x7ff14c15b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59244/0 (socket says 172.21.15.5:59244) 2023-07-14T13:12:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.637+0000 7ff14bfff640 1 -- 172.21.15.5:0/195882981 learned_addr learned my addr 172.21.15.5:0/195882981 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.637+0000 7ff14bfff640 1 -- 172.21.15.5:0/195882981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff14c071030 msgr2=0x7ff14c0b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.637+0000 7ff14bfff640 1 --2- 172.21.15.5:0/195882981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff14c071030 0x7ff14c0b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.637+0000 7ff14bfff640 1 -- 172.21.15.5:0/195882981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff14c159a70 msgr2=0x7ff14c15afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.637+0000 7ff14bfff640 1 --2- 172.21.15.5:0/195882981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff14c159a70 0x7ff14c15afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.637+0000 7ff14bfff640 1 -- 172.21.15.5:0/195882981 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff144009b30 con 0x7ff14c15e060 2023-07-14T13:12:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.637+0000 7ff14bfff640 1 --2- 172.21.15.5:0/195882981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff14c15e060 0x7ff14c15b500 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7ff144019490 tx=0x7ff144019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.637+0000 7ff133fff640 1 -- 172.21.15.5:0/195882981 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1440b8670 con 0x7ff14c15e060 2023-07-14T13:12:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.637+0000 7ff133fff640 1 -- 172.21.15.5:0/195882981 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1440b87d0 con 0x7ff14c15e060 2023-07-14T13:12:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.637+0000 7ff133fff640 1 -- 172.21.15.5:0/195882981 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1440b8b60 con 0x7ff14c15e060 2023-07-14T13:12:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.637+0000 7ff152140640 1 -- 172.21.15.5:0/195882981 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14c15bb60 con 0x7ff14c15e060 2023-07-14T13:12:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.637+0000 7ff152140640 1 -- 172.21.15.5:0/195882981 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14c15c120 con 0x7ff14c15e060 2023-07-14T13:12:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.637+0000 7ff152140640 1 -- 172.21.15.5:0/195882981 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff14c15e480 con 0x7ff14c15e060 2023-07-14T13:12:42.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.641+0000 7ff133fff640 1 -- 172.21.15.5:0/195882981 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 66) v1 ==== 85834+0+0 (secure 0 0 0) 0x7ff1440b8cc0 con 0x7ff14c15e060 2023-07-14T13:12:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.641+0000 7ff133fff640 1 --2- 172.21.15.5:0/195882981 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7ff138066480 0x7ff138068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.641+0000 7ff133fff640 1 -- 172.21.15.5:0/195882981 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6434+0+0 (secure 0 0 0) 0x7ff14411f610 con 0x7ff14c15e060 2023-07-14T13:12:42.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.641+0000 7ff14b7fe640 1 --2- 172.21.15.5:0/195882981 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7ff138066480 0x7ff138068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.641+0000 7ff14b7fe640 1 --2- 172.21.15.5:0/195882981 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7ff138066480 0x7ff138068930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff14c150650 tx=0x7ff13c009190 comp rx=0 tx=0).ready entity=mgr.7520 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:42.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.645+0000 7ff133fff640 1 -- 172.21.15.5:0/195882981 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff14c15e480 con 0x7ff14c15e060 2023-07-14T13:12:42.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:42.837+0000 7ff152140640 1 -- 172.21.15.5:0/195882981 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7ff14c15e480 con 0x7ff14c15e060 2023-07-14T13:12:43.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:43.617+0000 7ff133fff640 1 -- 172.21.15.5:0/195882981 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 67) v1 ==== 85817+0+0 (secure 0 0 0) 0x7ff1440eca70 con 0x7ff14c15e060 2023-07-14T13:12:43.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:43.617+0000 7ff133fff640 1 -- 172.21.15.5:0/195882981 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v67) v1 ==== 93+0+0 (secure 0 0 0) 0x7ff1440c1400 con 0x7ff14c15e060 2023-07-14T13:12:43.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:43.621+0000 7ff152140640 1 -- 172.21.15.5:0/195882981 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7ff138066480 msgr2=0x7ff138068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:43.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:43.621+0000 7ff152140640 1 --2- 172.21.15.5:0/195882981 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7ff138066480 0x7ff138068930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff14c150650 tx=0x7ff13c009190 comp rx=0 tx=0).stop 2023-07-14T13:12:43.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:43.621+0000 7ff152140640 1 -- 172.21.15.5:0/195882981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff14c15e060 msgr2=0x7ff14c15b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:43.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:43.621+0000 7ff152140640 1 --2- 172.21.15.5:0/195882981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff14c15e060 0x7ff14c15b500 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7ff144019490 tx=0x7ff144019620 comp rx=0 tx=0).stop 2023-07-14T13:12:43.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:43.621+0000 7ff152140640 1 -- 172.21.15.5:0/195882981 shutdown_connections 2023-07-14T13:12:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:43.621+0000 7ff152140640 1 --2- 172.21.15.5:0/195882981 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7ff138066480 0x7ff138068930 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:43.621+0000 7ff152140640 1 --2- 172.21.15.5:0/195882981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff14c15e060 0x7ff14c15b500 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:43.621+0000 7ff152140640 1 --2- 172.21.15.5:0/195882981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff14c159a70 0x7ff14c15afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:43.621+0000 7ff152140640 1 --2- 172.21.15.5:0/195882981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff14c071030 0x7ff14c0b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:43.621+0000 7ff152140640 1 -- 172.21.15.5:0/195882981 >> 172.21.15.5:0/195882981 conn(0x7ff14c0afac0 msgr2=0x7ff14c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:43.621+0000 7ff152140640 1 -- 172.21.15.5:0/195882981 shutdown_connections 2023-07-14T13:12:43.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:43.621+0000 7ff152140640 1 -- 172.21.15.5:0/195882981 wait complete. 2023-07-14T13:12:43.681 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T13:12:43.682 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:12:43.734 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:12:43.794 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T13:12:43.795 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:12:43.795 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:12:43.804 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:12:43.805 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:12:43.833 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:43.797+0000 7effdfcd2180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:12:43.837 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:43.805+0000 7f1861fa6180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:12:43.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:12:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:43.997+0000 7fc8ee382640 1 Processor -- start 2023-07-14T13:12:44.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:43.997+0000 7fc8ee382640 1 -- start start 2023-07-14T13:12:44.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.001+0000 7fc8ee382640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc8e815b7c0 0x7fc8e806b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.001+0000 7fc8ee382640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc8e80cb780 0x7fc8e806b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.001+0000 7fc8ee382640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e806f900 con 0x7fc8e806fd90 2023-07-14T13:12:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.001+0000 7fc8ee382640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e80cdce0 con 0x7fc8e815b7c0 2023-07-14T13:12:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.001+0000 7fc8ee382640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e80ca830 con 0x7fc8e80cb780 2023-07-14T13:12:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.001+0000 7fc8e7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc8e815b7c0 0x7fc8e806b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.001+0000 7fc8e7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc8e815b7c0 0x7fc8e806b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59256/0 (socket says 172.21.15.5:59256) 2023-07-14T13:12:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.001+0000 7fc8e7fff640 1 -- 172.21.15.5:0/3637962368 learned_addr learned my addr 172.21.15.5:0/3637962368 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.001+0000 7fc8e77fe640 1 --2- 172.21.15.5:0/3637962368 >> v2:172.21.15.154:3300/0 conn(0x7fc8e80cb780 0x7fc8e806b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.001+0000 7fc8e77fe640 1 -- 172.21.15.5:0/3637962368 >> v2:172.21.15.5:3300/0 conn(0x7fc8e815b7c0 msgr2=0x7fc8e806b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.001+0000 7fc8e77fe640 1 --2- 172.21.15.5:0/3637962368 >> v2:172.21.15.5:3300/0 conn(0x7fc8e815b7c0 0x7fc8e806b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.001+0000 7fc8e77fe640 1 -- 172.21.15.5:0/3637962368 >> v1:172.21.15.154:6789/0 conn(0x7fc8e806fd90 legacy=0x7fc8e8070210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.001+0000 7fc8e77fe640 1 -- 172.21.15.5:0/3637962368 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e815bb90 con 0x7fc8e80cb780 2023-07-14T13:12:44.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.001+0000 7fc8e6ffd640 1 -- 172.21.15.5:0/3637962368 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3253842037 0 0) 0x7fc8e806f900 con 0x7fc8e806fd90 2023-07-14T13:12:44.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.005+0000 7fc8e77fe640 1 --2- 172.21.15.5:0/3637962368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8e80cb780 0x7fc8e806b720 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fc8e806af40 tx=0x7fc8dc01d800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b66415bbf01565a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:44.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.005+0000 7fc8e6ffd640 1 -- 172.21.15.5:0/3637962368 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc0a6830 con 0x7fc8e80cb780 2023-07-14T13:12:44.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.005+0000 7fc8e6ffd640 1 -- 172.21.15.5:0/3637962368 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8dc0a6990 con 0x7fc8e80cb780 2023-07-14T13:12:44.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.005+0000 7fc8e6ffd640 1 -- 172.21.15.5:0/3637962368 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc0a6d20 con 0x7fc8e80cb780 2023-07-14T13:12:44.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.005+0000 7fc8ee382640 1 -- 172.21.15.5:0/3637962368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8e80cb780 msgr2=0x7fc8e806b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:44.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.005+0000 7fc8ee382640 1 --2- 172.21.15.5:0/3637962368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8e80cb780 0x7fc8e806b720 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fc8e806af40 tx=0x7fc8dc01d800 comp rx=0 tx=0).stop 2023-07-14T13:12:44.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.005+0000 7fc8ee382640 1 -- 172.21.15.5:0/3637962368 shutdown_connections 2023-07-14T13:12:44.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.005+0000 7fc8ee382640 1 --2- 172.21.15.5:0/3637962368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8e80cb780 0x7fc8e806b720 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.005+0000 7fc8ee382640 1 --2- 172.21.15.5:0/3637962368 >> v2:172.21.15.5:3300/0 conn(0x7fc8e815b7c0 0x7fc8e806b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.005+0000 7fc8ee382640 1 -- 172.21.15.5:0/3637962368 >> 172.21.15.5:0/3637962368 conn(0x7fc8e80afcf0 msgr2=0x7fc8e80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:44.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.005+0000 7fc8ee382640 1 -- 172.21.15.5:0/3637962368 shutdown_connections 2023-07-14T13:12:44.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.005+0000 7fc8ee382640 1 -- 172.21.15.5:0/3637962368 wait complete. 2023-07-14T13:12:44.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.009+0000 7fc8ee382640 1 Processor -- start 2023-07-14T13:12:44.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.009+0000 7fc8ee382640 1 -- start start 2023-07-14T13:12:44.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.009+0000 7fc8ee382640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8e806fd90 0x7fc8e8158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:44.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.009+0000 7fc8ee382640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8e815b7c0 0x7fc8e80cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:44.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.009+0000 7fc8ee382640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8e8151bf0 0x7fc8e80cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:44.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.009+0000 7fc8ee382640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e8153d10 con 0x7fc8e8151bf0 2023-07-14T13:12:44.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.009+0000 7fc8ee382640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e80b1bd0 con 0x7fc8e815b7c0 2023-07-14T13:12:44.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.009+0000 7fc8ee382640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e80c5230 con 0x7fc8e806fd90 2023-07-14T13:12:44.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.013+0000 7fc8ec91f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8e8151bf0 0x7fc8e80cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:44.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.013+0000 7fc8ec91f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8e8151bf0 0x7fc8e80cc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59272/0 (socket says 172.21.15.5:59272) 2023-07-14T13:12:44.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.013+0000 7fc8ec91f640 1 -- 172.21.15.5:0/1968831880 learned_addr learned my addr 172.21.15.5:0/1968831880 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:44.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.013+0000 7fc8e77fe640 1 --2- 172.21.15.5:0/1968831880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8e815b7c0 0x7fc8e80cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:44.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.013+0000 7fc8e7fff640 1 --2- 172.21.15.5:0/1968831880 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8e806fd90 0x7fc8e8158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:44.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.013+0000 7fc8ec91f640 1 -- 172.21.15.5:0/1968831880 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8e806fd90 msgr2=0x7fc8e8158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:44.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.013+0000 7fc8ec91f640 1 --2- 172.21.15.5:0/1968831880 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8e806fd90 0x7fc8e8158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.013+0000 7fc8ec91f640 1 -- 172.21.15.5:0/1968831880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8e815b7c0 msgr2=0x7fc8e80cbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:44.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.013+0000 7fc8ec91f640 1 --2- 172.21.15.5:0/1968831880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8e815b7c0 0x7fc8e80cbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.013+0000 7fc8ec91f640 1 -- 172.21.15.5:0/1968831880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8dc00a5c0 con 0x7fc8e8151bf0 2023-07-14T13:12:44.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.013+0000 7fc8ec91f640 1 --2- 172.21.15.5:0/1968831880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8e8151bf0 0x7fc8e80cc0a0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0001570 tx=0x7fc8e000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:44.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.013+0000 7fc8e4ff9640 1 -- 172.21.15.5:0/1968831880 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0003db0 con 0x7fc8e8151bf0 2023-07-14T13:12:44.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.013+0000 7fc8e4ff9640 1 -- 172.21.15.5:0/1968831880 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e0005070 con 0x7fc8e8151bf0 2023-07-14T13:12:44.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.013+0000 7fc8e4ff9640 1 -- 172.21.15.5:0/1968831880 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0005420 con 0x7fc8e8151bf0 2023-07-14T13:12:44.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.013+0000 7fc8ee382640 1 -- 172.21.15.5:0/1968831880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e8153750 con 0x7fc8e8151bf0 2023-07-14T13:12:44.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.013+0000 7fc8ee382640 1 -- 172.21.15.5:0/1968831880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e80b1860 con 0x7fc8e8151bf0 2023-07-14T13:12:44.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.013+0000 7fc8ee382640 1 -- 172.21.15.5:0/1968831880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8e80b16c0 con 0x7fc8e8151bf0 2023-07-14T13:12:44.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.013+0000 7fc8e4ff9640 1 -- 172.21.15.5:0/1968831880 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 67) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fc8e0005580 con 0x7fc8e8151bf0 2023-07-14T13:12:44.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.017+0000 7fc8e4ff9640 1 --2- 172.21.15.5:0/1968831880 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fc8d4066460 0x7fc8d4068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:44.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.017+0000 7fc8e4ff9640 1 -- 172.21.15.5:0/1968831880 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6434+0+0 (secure 0 0 0) 0x7fc8e0083980 con 0x7fc8e8151bf0 2023-07-14T13:12:44.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.017+0000 7fc8e7fff640 1 -- 172.21.15.5:0/1968831880 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fc8d4066460 msgr2=0x7fc8d4068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/4272779335 2023-07-14T13:12:44.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.017+0000 7fc8e7fff640 1 --2- 172.21.15.5:0/1968831880 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fc8d4066460 0x7fc8d4068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:12:44.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.021+0000 7fc8e4ff9640 1 -- 172.21.15.5:0/1968831880 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc8e80b16c0 con 0x7fc8e8151bf0 2023-07-14T13:12:44.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.181+0000 7fc8ee382640 1 -- 172.21.15.5:0/1968831880 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8e80b1d80 con 0x7fc8e8151bf0 2023-07-14T13:12:44.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.181+0000 7fc8e4ff9640 1 -- 172.21.15.5:0/1968831880 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+18866 (secure 0 0 0) 0x7fc8e80b1d80 con 0x7fc8e8151bf0 2023-07-14T13:12:44.219 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:44.219 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":143,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:12:40.543200+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:12:21.430786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-14T13:12:22.293915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/2411764460":"2023-07-15T13:12:40.543160+0000","172.21.15.154:0/2264156620":"2023-07-15T13:12:40.543160+0000","172.21.15.154:0/4093515681":"2023-07-15T13:12:40.543160+0000","172.21.15.154:0/1036989288":"2023-07-15T13:12:40.543160+0000","172.21.15.154:0/3525194571":"2023-07-15T13:12:40.543160+0000","172.21.15.154:6833/3769132865":"2023-07-15T13:12:40.543160+0000","172.21.15.154:6832/3769132865":"2023-07-15T13:12:40.543160+0000","172.21.15.154:0/1560509459":"2023-07-15T13:12:40.543160+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:12:44.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.185+0000 7fc8ee382640 1 -- 172.21.15.5:0/1968831880 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fc8d4066460 msgr2=0x7fc8d4068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:12:44.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.185+0000 7fc8ee382640 1 --2- 172.21.15.5:0/1968831880 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fc8d4066460 0x7fc8d4068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.185+0000 7fc8ee382640 1 -- 172.21.15.5:0/1968831880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8e8151bf0 msgr2=0x7fc8e80cc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:44.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.185+0000 7fc8ee382640 1 --2- 172.21.15.5:0/1968831880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8e8151bf0 0x7fc8e80cc0a0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0001570 tx=0x7fc8e000cd20 comp rx=0 tx=0).stop 2023-07-14T13:12:44.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.185+0000 7fc8ee382640 1 -- 172.21.15.5:0/1968831880 shutdown_connections 2023-07-14T13:12:44.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.185+0000 7fc8ee382640 1 --2- 172.21.15.5:0/1968831880 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fc8d4066460 0x7fc8d4068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.185+0000 7fc8ee382640 1 --2- 172.21.15.5:0/1968831880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8e8151bf0 0x7fc8e80cc0a0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.185+0000 7fc8ee382640 1 --2- 172.21.15.5:0/1968831880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8e815b7c0 0x7fc8e80cbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.185+0000 7fc8ee382640 1 --2- 172.21.15.5:0/1968831880 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8e806fd90 0x7fc8e8158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.185+0000 7fc8ee382640 1 -- 172.21.15.5:0/1968831880 >> 172.21.15.5:0/1968831880 conn(0x7fc8e80afcf0 msgr2=0x7fc8e80adcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:44.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.185+0000 7fc8ee382640 1 -- 172.21.15.5:0/1968831880 shutdown_connections 2023-07-14T13:12:44.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.185+0000 7fc8ee382640 1 -- 172.21.15.5:0/1968831880 wait complete. 2023-07-14T13:12:44.242 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T13:12:21.430786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T13:12:22.293915+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:12:44.243 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:12:44.254 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:44.221+0000 7f1861fa6180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:12:44.285 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:44.249+0000 7effdfcd2180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:12:44.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.357+0000 7f87dbbad640 1 Processor -- start 2023-07-14T13:12:44.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.357+0000 7f87dbbad640 1 -- start start 2023-07-14T13:12:44.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.357+0000 7f87dbbad640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f87d415bde0 0x7f87d40d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.357+0000 7f87dbbad640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f87d40d2fc0 0x7f87d40b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.357+0000 7f87dbbad640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d40b04c0 con 0x7f87d40d2300 2023-07-14T13:12:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.357+0000 7f87dbbad640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d415c1b0 con 0x7f87d415bde0 2023-07-14T13:12:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.357+0000 7f87dbbad640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d40d0aa0 con 0x7f87d40d2fc0 2023-07-14T13:12:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.357+0000 7f87d9949640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f87d415bde0 0x7f87d40d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:44.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.357+0000 7f87d9949640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f87d415bde0 0x7f87d40d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59282/0 (socket says 172.21.15.5:59282) 2023-07-14T13:12:44.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.357+0000 7f87d9949640 1 -- 172.21.15.5:0/2219267993 learned_addr learned my addr 172.21.15.5:0/2219267993 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:44.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.357+0000 7f87d9148640 1 --2- 172.21.15.5:0/2219267993 >> v2:172.21.15.154:3300/0 conn(0x7f87d40d2fc0 0x7f87d40b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:44.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.357+0000 7f87d9949640 1 -- 172.21.15.5:0/2219267993 >> v2:172.21.15.154:3300/0 conn(0x7f87d40d2fc0 msgr2=0x7f87d40b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:44.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.357+0000 7f87d9949640 1 --2- 172.21.15.5:0/2219267993 >> v2:172.21.15.154:3300/0 conn(0x7f87d40d2fc0 0x7f87d40b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.357+0000 7f87d9949640 1 -- 172.21.15.5:0/2219267993 >> v1:172.21.15.154:6789/0 conn(0x7f87d40d2300 legacy=0x7f87d40cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:44.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.357+0000 7f87d9949640 1 -- 172.21.15.5:0/2219267993 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d40afb90 con 0x7f87d415bde0 2023-07-14T13:12:44.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.361+0000 7f87d9949640 1 --2- 172.21.15.5:0/2219267993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87d415bde0 0x7f87d40d0270 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f87d408c600 tx=0x7f87d001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6af8b89032828c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:44.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.361+0000 7f87d8947640 1 -- 172.21.15.5:0/2219267993 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d00aa660 con 0x7f87d415bde0 2023-07-14T13:12:44.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.361+0000 7f87d8947640 1 -- 172.21.15.5:0/2219267993 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d00aa7c0 con 0x7f87d415bde0 2023-07-14T13:12:44.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.361+0000 7f87d8947640 1 -- 172.21.15.5:0/2219267993 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d00aab50 con 0x7f87d415bde0 2023-07-14T13:12:44.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.361+0000 7f87dbbad640 1 -- 172.21.15.5:0/2219267993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87d415bde0 msgr2=0x7f87d40d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:44.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.361+0000 7f87dbbad640 1 --2- 172.21.15.5:0/2219267993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87d415bde0 0x7f87d40d0270 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f87d408c600 tx=0x7f87d001c500 comp rx=0 tx=0).stop 2023-07-14T13:12:44.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.361+0000 7f87dbbad640 1 -- 172.21.15.5:0/2219267993 shutdown_connections 2023-07-14T13:12:44.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.361+0000 7f87dbbad640 1 --2- 172.21.15.5:0/2219267993 >> v2:172.21.15.154:3300/0 conn(0x7f87d40d2fc0 0x7f87d40b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.361+0000 7f87dbbad640 1 --2- 172.21.15.5:0/2219267993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87d415bde0 0x7f87d40d0270 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.361+0000 7f87dbbad640 1 -- 172.21.15.5:0/2219267993 >> 172.21.15.5:0/2219267993 conn(0x7f87d40659d0 msgr2=0x7f87d409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:44.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.365+0000 7f87dbbad640 1 -- 172.21.15.5:0/2219267993 shutdown_connections 2023-07-14T13:12:44.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.365+0000 7f87dbbad640 1 -- 172.21.15.5:0/2219267993 wait complete. 2023-07-14T13:12:44.403 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:44.373+0000 7f1861fa6180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:12:44.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.365+0000 7f87dbbad640 1 Processor -- start 2023-07-14T13:12:44.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.365+0000 7f87dbbad640 1 -- start start 2023-07-14T13:12:44.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.365+0000 7f87dbbad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87d40d2300 0x7f87d414b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:44.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.365+0000 7f87dbbad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87d40d2fc0 0x7f87d4149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:44.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.365+0000 7f87dbbad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87d415bde0 0x7f87d414c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:44.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.365+0000 7f87dbbad640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d40c60d0 con 0x7f87d415bde0 2023-07-14T13:12:44.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.365+0000 7f87dbbad640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d40cc3d0 con 0x7f87d40d2300 2023-07-14T13:12:44.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.365+0000 7f87dbbad640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d40cc0f0 con 0x7f87d40d2fc0 2023-07-14T13:12:44.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.365+0000 7f87da14a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87d415bde0 0x7f87d414c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:44.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.365+0000 7f87d9949640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87d40d2300 0x7f87d414b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:44.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.365+0000 7f87d9949640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87d40d2300 0x7f87d414b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:33300/0 (socket says 172.21.15.5:33300) 2023-07-14T13:12:44.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.365+0000 7f87da14a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87d415bde0 0x7f87d414c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59290/0 (socket says 172.21.15.5:59290) 2023-07-14T13:12:44.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.365+0000 7f87d9949640 1 -- 172.21.15.5:0/760762867 learned_addr learned my addr 172.21.15.5:0/760762867 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:44.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.365+0000 7f87d9148640 1 --2- 172.21.15.5:0/760762867 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87d40d2fc0 0x7f87d4149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:44.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.365+0000 7f87d9949640 1 -- 172.21.15.5:0/760762867 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87d40d2fc0 msgr2=0x7f87d4149990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:44.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.365+0000 7f87d9949640 1 --2- 172.21.15.5:0/760762867 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87d40d2fc0 0x7f87d4149990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.365+0000 7f87d9949640 1 -- 172.21.15.5:0/760762867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87d415bde0 msgr2=0x7f87d414c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:44.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.365+0000 7f87d9949640 1 --2- 172.21.15.5:0/760762867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87d415bde0 0x7f87d414c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.365+0000 7f87d9949640 1 -- 172.21.15.5:0/760762867 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d0009480 con 0x7f87d40d2300 2023-07-14T13:12:44.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.369+0000 7f87d9949640 1 --2- 172.21.15.5:0/760762867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87d40d2300 0x7f87d414b630 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f87d001a130 tx=0x7f87d00192a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:44.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.369+0000 7f87ca7fc640 1 -- 172.21.15.5:0/760762867 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d0005ba0 con 0x7f87d40d2300 2023-07-14T13:12:44.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.369+0000 7f87ca7fc640 1 -- 172.21.15.5:0/760762867 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d0005d00 con 0x7f87d40d2300 2023-07-14T13:12:44.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.369+0000 7f87ca7fc640 1 -- 172.21.15.5:0/760762867 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d00aab50 con 0x7f87d40d2300 2023-07-14T13:12:44.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.369+0000 7f87dbbad640 1 -- 172.21.15.5:0/760762867 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d414abe0 con 0x7f87d40d2300 2023-07-14T13:12:44.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.369+0000 7f87dbbad640 1 -- 172.21.15.5:0/760762867 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d414b1a0 con 0x7f87d40d2300 2023-07-14T13:12:44.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.369+0000 7f87dbbad640 1 -- 172.21.15.5:0/760762867 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87d40678d0 con 0x7f87d40d2300 2023-07-14T13:12:44.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.369+0000 7f87ca7fc640 1 -- 172.21.15.5:0/760762867 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 67) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f87d0003620 con 0x7f87d40d2300 2023-07-14T13:12:44.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.369+0000 7f87ca7fc640 1 --2- 172.21.15.5:0/760762867 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7f87b8066430 0x7f87b80688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:44.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.369+0000 7f87ca7fc640 1 -- 172.21.15.5:0/760762867 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f87d00a6040 con 0x7f87d40d2300 2023-07-14T13:12:44.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.369+0000 7f87d9148640 1 -- 172.21.15.5:0/760762867 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7f87b8066430 msgr2=0x7f87b80688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/4272779335 2023-07-14T13:12:44.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.369+0000 7f87d9148640 1 --2- 172.21.15.5:0/760762867 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7f87b8066430 0x7f87b80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:12:44.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.373+0000 7f87ca7fc640 1 -- 172.21.15.5:0/760762867 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f87d00ebde0 con 0x7f87d40d2300 2023-07-14T13:12:44.447 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:44.409+0000 7effdfcd2180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:12:44.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.533+0000 7f87dbbad640 1 -- 172.21.15.5:0/760762867 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f87d414b390 con 0x7f87d40d2300 2023-07-14T13:12:44.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.533+0000 7f87ca7fc640 1 -- 172.21.15.5:0/760762867 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v143) v1 ==== 93+0+10 (secure 0 0 0) 0x7f87d00c1020 con 0x7f87d40d2300 2023-07-14T13:12:44.568 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:12:44.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.533+0000 7f87dbbad640 1 -- 172.21.15.5:0/760762867 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7f87b8066430 msgr2=0x7f87b80688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:12:44.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.533+0000 7f87dbbad640 1 --2- 172.21.15.5:0/760762867 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7f87b8066430 0x7f87b80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.533+0000 7f87dbbad640 1 -- 172.21.15.5:0/760762867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87d40d2300 msgr2=0x7f87d414b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:44.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.533+0000 7f87dbbad640 1 --2- 172.21.15.5:0/760762867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87d40d2300 0x7f87d414b630 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f87d001a130 tx=0x7f87d00192a0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.533+0000 7f87dbbad640 1 -- 172.21.15.5:0/760762867 shutdown_connections 2023-07-14T13:12:44.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.533+0000 7f87dbbad640 1 --2- 172.21.15.5:0/760762867 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7f87b8066430 0x7f87b80688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.533+0000 7f87dbbad640 1 --2- 172.21.15.5:0/760762867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87d415bde0 0x7f87d414c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.533+0000 7f87dbbad640 1 --2- 172.21.15.5:0/760762867 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87d40d2fc0 0x7f87d4149990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.533+0000 7f87dbbad640 1 --2- 172.21.15.5:0/760762867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87d40d2300 0x7f87d414b630 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.533+0000 7f87dbbad640 1 -- 172.21.15.5:0/760762867 >> 172.21.15.5:0/760762867 conn(0x7f87d40659d0 msgr2=0x7f87d406afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:44.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.533+0000 7f87dbbad640 1 -- 172.21.15.5:0/760762867 shutdown_connections 2023-07-14T13:12:44.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.533+0000 7f87dbbad640 1 -- 172.21.15.5:0/760762867 wait complete. 2023-07-14T13:12:44.591 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:12:44.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.749+0000 7f0027b40640 1 Processor -- start 2023-07-14T13:12:44.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.749+0000 7f0027b40640 1 -- start start 2023-07-14T13:12:44.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.749+0000 7f0027b40640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00200d2fc0 0x7f00200b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:44.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.749+0000 7f0027b40640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f00200d2300 0x7f00200d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:44.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.749+0000 7f0027b40640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00200b04c0 con 0x7f002015bde0 2023-07-14T13:12:44.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.749+0000 7f0027b40640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00200d2ce0 con 0x7f00200d2300 2023-07-14T13:12:44.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.749+0000 7f0027b40640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002015c1b0 con 0x7f00200d2fc0 2023-07-14T13:12:44.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.749+0000 7f00258dc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f002015bde0 0x7f00200d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49798/0 (socket says 172.21.15.5:49798) 2023-07-14T13:12:44.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.749+0000 7f00258dc640 1 -- 172.21.15.5:0/673809109 learned_addr learned my addr 172.21.15.5:0/673809109 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:44.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.749+0000 7f00250db640 1 --2- 172.21.15.5:0/673809109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00200d2fc0 0x7f00200b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:44.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.749+0000 7f00260dd640 1 --2- 172.21.15.5:0/673809109 >> v2:172.21.15.154:3300/0 conn(0x7f00200d2300 0x7f00200d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:44.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.749+0000 7f00248da640 1 -- 172.21.15.5:0/673809109 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 481680190 0 0) 0x7f00200b04c0 con 0x7f002015bde0 2023-07-14T13:12:44.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.749+0000 7f00248da640 1 -- 172.21.15.5:0/673809109 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f000c003530 con 0x7f002015bde0 2023-07-14T13:12:44.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.749+0000 7f00250db640 1 -- 172.21.15.5:0/673809109 >> v2:172.21.15.154:3300/0 conn(0x7f00200d2300 msgr2=0x7f00200d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:44.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.749+0000 7f00250db640 1 --2- 172.21.15.5:0/673809109 >> v2:172.21.15.154:3300/0 conn(0x7f00200d2300 0x7f00200d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.749+0000 7f00250db640 1 -- 172.21.15.5:0/673809109 >> v1:172.21.15.5:6789/0 conn(0x7f002015bde0 legacy=0x7f00200d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:44.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.749+0000 7f00250db640 1 -- 172.21.15.5:0/673809109 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00200d0aa0 con 0x7f00200d2fc0 2023-07-14T13:12:44.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.749+0000 7f00260dd640 1 --2- 172.21.15.5:0/673809109 >> v2:172.21.15.154:3300/0 conn(0x7f00200d2300 0x7f00200d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:44.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.753+0000 7f00250db640 1 --2- 172.21.15.5:0/673809109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00200d2fc0 0x7f00200b0950 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f00100097c0 tx=0x7f001001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c46e8282d4bddb33 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:44.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.753+0000 7f00248da640 1 -- 172.21.15.5:0/673809109 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00100ab680 con 0x7f00200d2fc0 2023-07-14T13:12:44.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.753+0000 7f00248da640 1 -- 172.21.15.5:0/673809109 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00100ab7e0 con 0x7f00200d2fc0 2023-07-14T13:12:44.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.753+0000 7f00248da640 1 -- 172.21.15.5:0/673809109 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00100abb50 con 0x7f00200d2fc0 2023-07-14T13:12:44.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.753+0000 7f0027b40640 1 -- 172.21.15.5:0/673809109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00200d2fc0 msgr2=0x7f00200b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:44.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.753+0000 7f0027b40640 1 --2- 172.21.15.5:0/673809109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00200d2fc0 0x7f00200b0950 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f00100097c0 tx=0x7f001001c480 comp rx=0 tx=0).stop 2023-07-14T13:12:44.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.753+0000 7f0027b40640 1 -- 172.21.15.5:0/673809109 shutdown_connections 2023-07-14T13:12:44.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.753+0000 7f0027b40640 1 --2- 172.21.15.5:0/673809109 >> v2:172.21.15.154:3300/0 conn(0x7f00200d2300 0x7f00200d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.753+0000 7f0027b40640 1 --2- 172.21.15.5:0/673809109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00200d2fc0 0x7f00200b0950 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.753+0000 7f0027b40640 1 -- 172.21.15.5:0/673809109 >> 172.21.15.5:0/673809109 conn(0x7f00200659d0 msgr2=0x7f002009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:44.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.753+0000 7f0027b40640 1 -- 172.21.15.5:0/673809109 shutdown_connections 2023-07-14T13:12:44.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.753+0000 7f0027b40640 1 -- 172.21.15.5:0/673809109 wait complete. 2023-07-14T13:12:44.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.757+0000 7f0027b40640 1 Processor -- start 2023-07-14T13:12:44.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.757+0000 7f0027b40640 1 -- start start 2023-07-14T13:12:44.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.757+0000 7f0027b40640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00200d2300 0x7f00201542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:44.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.757+0000 7f0027b40640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00200d2fc0 0x7f00201594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:44.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.757+0000 7f0027b40640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f002015bde0 0x7f00200b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:44.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.757+0000 7f0027b40640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00200b1480 con 0x7f00200d2fc0 2023-07-14T13:12:44.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.757+0000 7f0027b40640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00200b7d20 con 0x7f00200d2300 2023-07-14T13:12:44.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.757+0000 7f0027b40640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00200b7fc0 con 0x7f002015bde0 2023-07-14T13:12:44.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.757+0000 7f00250db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00200d2fc0 0x7f00201594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:44.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.757+0000 7f00250db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00200d2fc0 0x7f00201594b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59292/0 (socket says 172.21.15.5:59292) 2023-07-14T13:12:44.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.757+0000 7f00250db640 1 -- 172.21.15.5:0/2369630887 learned_addr learned my addr 172.21.15.5:0/2369630887 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:44.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.757+0000 7f00258dc640 1 --2- 172.21.15.5:0/2369630887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00200d2300 0x7f00201542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:44.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.757+0000 7f00260dd640 1 --2- 172.21.15.5:0/2369630887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f002015bde0 0x7f00200b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:44.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.757+0000 7f00250db640 1 -- 172.21.15.5:0/2369630887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f002015bde0 msgr2=0x7f00200b61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:44.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.757+0000 7f00250db640 1 --2- 172.21.15.5:0/2369630887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f002015bde0 0x7f00200b61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.757+0000 7f00250db640 1 -- 172.21.15.5:0/2369630887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00200d2300 msgr2=0x7f00201542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:44.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.757+0000 7f00250db640 1 --2- 172.21.15.5:0/2369630887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00200d2300 0x7f00201542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.757+0000 7f00250db640 1 -- 172.21.15.5:0/2369630887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0018009a70 con 0x7f00200d2fc0 2023-07-14T13:12:44.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.757+0000 7f00258dc640 1 --2- 172.21.15.5:0/2369630887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00200d2300 0x7f00201542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:44.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.757+0000 7f00250db640 1 --2- 172.21.15.5:0/2369630887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00200d2fc0 0x7f00201594b0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f00100ad040 tx=0x7f001001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:44.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.757+0000 7f00167fc640 1 -- 172.21.15.5:0/2369630887 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00100bf610 con 0x7f00200d2fc0 2023-07-14T13:12:44.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.757+0000 7f00167fc640 1 -- 172.21.15.5:0/2369630887 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00100bf770 con 0x7f00200d2fc0 2023-07-14T13:12:44.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.757+0000 7f00167fc640 1 -- 172.21.15.5:0/2369630887 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00100bfae0 con 0x7f00200d2fc0 2023-07-14T13:12:44.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.757+0000 7f0027b40640 1 -- 172.21.15.5:0/2369630887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0010009420 con 0x7f00200d2fc0 2023-07-14T13:12:44.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.761+0000 7f0027b40640 1 -- 172.21.15.5:0/2369630887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00200b59d0 con 0x7f00200d2fc0 2023-07-14T13:12:44.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.761+0000 7f0027b40640 1 -- 172.21.15.5:0/2369630887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00200678d0 con 0x7f00200d2fc0 2023-07-14T13:12:44.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.761+0000 7f00167fc640 1 -- 172.21.15.5:0/2369630887 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 67) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f00100bfc40 con 0x7f00200d2fc0 2023-07-14T13:12:44.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.761+0000 7f00167fc640 1 --2- 172.21.15.5:0/2369630887 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7f0004066460 0x7f0004068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:44.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.761+0000 7f00167fc640 1 -- 172.21.15.5:0/2369630887 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f001011eb90 con 0x7f00200d2fc0 2023-07-14T13:12:44.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.761+0000 7f00258dc640 1 -- 172.21.15.5:0/2369630887 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7f0004066460 msgr2=0x7f0004068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/4272779335 2023-07-14T13:12:44.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.761+0000 7f00258dc640 1 --2- 172.21.15.5:0/2369630887 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7f0004066460 0x7f0004068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:12:44.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.769+0000 7f00167fc640 1 -- 172.21.15.5:0/2369630887 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f00100ebb10 con 0x7f00200d2fc0 2023-07-14T13:12:44.883 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:44.853+0000 7f1861fa6180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:12:44.941 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:44.909+0000 7f1861fa6180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:12:44.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.925+0000 7f0027b40640 1 -- 172.21.15.5:0/2369630887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f002015b3e0 con 0x7f00200d2fc0 2023-07-14T13:12:44.963 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:44.925+0000 7effdfcd2180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:12:44.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.925+0000 7f00167fc640 1 -- 172.21.15.5:0/2369630887 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v143) v1 ==== 92+0+10 (secure 0 0 0) 0x7f00100ef130 con 0x7f00200d2fc0 2023-07-14T13:12:44.964 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:12:44.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.929+0000 7f0027b40640 1 -- 172.21.15.5:0/2369630887 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7f0004066460 msgr2=0x7f0004068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:12:44.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.929+0000 7f0027b40640 1 --2- 172.21.15.5:0/2369630887 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7f0004066460 0x7f0004068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.929+0000 7f0027b40640 1 -- 172.21.15.5:0/2369630887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00200d2fc0 msgr2=0x7f00201594b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:44.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.929+0000 7f0027b40640 1 --2- 172.21.15.5:0/2369630887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00200d2fc0 0x7f00201594b0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f00100ad040 tx=0x7f001001acc0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.929+0000 7f0027b40640 1 -- 172.21.15.5:0/2369630887 shutdown_connections 2023-07-14T13:12:44.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.929+0000 7f0027b40640 1 --2- 172.21.15.5:0/2369630887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f002015bde0 0x7f00200b61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.929+0000 7f0027b40640 1 --2- 172.21.15.5:0/2369630887 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7f0004066460 0x7f0004068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.929+0000 7f0027b40640 1 --2- 172.21.15.5:0/2369630887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00200d2fc0 0x7f00201594b0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.929+0000 7f0027b40640 1 --2- 172.21.15.5:0/2369630887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00200d2300 0x7f00201542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:44.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.929+0000 7f0027b40640 1 -- 172.21.15.5:0/2369630887 >> 172.21.15.5:0/2369630887 conn(0x7f00200659d0 msgr2=0x7f00200ced20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:44.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.929+0000 7f0027b40640 1 -- 172.21.15.5:0/2369630887 shutdown_connections 2023-07-14T13:12:44.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:44.929+0000 7f0027b40640 1 -- 172.21.15.5:0/2369630887 wait complete. 2023-07-14T13:12:44.985 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T13:12:44.997 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:44.965+0000 7f1861fa6180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:12:45.027 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:44.989+0000 7effdfcd2180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:12:45.082 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:45.049+0000 7f1861fa6180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:12:45.087 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:45.049+0000 7effdfcd2180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:12:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.101+0000 7fe937a34640 1 Processor -- start 2023-07-14T13:12:45.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.101+0000 7fe937a34640 1 -- start start 2023-07-14T13:12:45.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.101+0000 7fe937a34640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe93015bde0 0x7fe9300d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.101+0000 7fe937a34640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe9300d2fc0 0x7fe9300b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.101+0000 7fe937a34640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9300b04c0 con 0x7fe9300d2300 2023-07-14T13:12:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.101+0000 7fe937a34640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe93015c1b0 con 0x7fe93015bde0 2023-07-14T13:12:45.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.101+0000 7fe937a34640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9300d0aa0 con 0x7fe9300d2fc0 2023-07-14T13:12:45.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.101+0000 7fe9357d0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe93015bde0 0x7fe9300d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:45.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.101+0000 7fe9357d0640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe93015bde0 0x7fe9300d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59294/0 (socket says 172.21.15.5:59294) 2023-07-14T13:12:45.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.101+0000 7fe9357d0640 1 -- 172.21.15.5:0/465905229 learned_addr learned my addr 172.21.15.5:0/465905229 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:45.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.101+0000 7fe934fcf640 1 --2- 172.21.15.5:0/465905229 >> v2:172.21.15.154:3300/0 conn(0x7fe9300d2fc0 0x7fe9300b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:45.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.101+0000 7fe9357d0640 1 -- 172.21.15.5:0/465905229 >> v2:172.21.15.154:3300/0 conn(0x7fe9300d2fc0 msgr2=0x7fe9300b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:45.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.101+0000 7fe9357d0640 1 --2- 172.21.15.5:0/465905229 >> v2:172.21.15.154:3300/0 conn(0x7fe9300d2fc0 0x7fe9300b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:45.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.101+0000 7fe9357d0640 1 -- 172.21.15.5:0/465905229 >> v1:172.21.15.154:6789/0 conn(0x7fe9300d2300 legacy=0x7fe9300cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:45.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.101+0000 7fe9357d0640 1 -- 172.21.15.5:0/465905229 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9300afb90 con 0x7fe93015bde0 2023-07-14T13:12:45.140 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:45.109+0000 7f1861fa6180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:12:45.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.105+0000 7fe9357d0640 1 --2- 172.21.15.5:0/465905229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe93015bde0 0x7fe9300d0270 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fe93008c600 tx=0x7fe92c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168b4a7bcb61549f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:45.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.105+0000 7fe927fff640 1 -- 172.21.15.5:0/465905229 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92c0aa660 con 0x7fe93015bde0 2023-07-14T13:12:45.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.105+0000 7fe927fff640 1 -- 172.21.15.5:0/465905229 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92c0aa7c0 con 0x7fe93015bde0 2023-07-14T13:12:45.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.105+0000 7fe927fff640 1 -- 172.21.15.5:0/465905229 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92c0aab50 con 0x7fe93015bde0 2023-07-14T13:12:45.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.105+0000 7fe937a34640 1 -- 172.21.15.5:0/465905229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe93015bde0 msgr2=0x7fe9300d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:45.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.105+0000 7fe937a34640 1 --2- 172.21.15.5:0/465905229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe93015bde0 0x7fe9300d0270 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fe93008c600 tx=0x7fe92c01c500 comp rx=0 tx=0).stop 2023-07-14T13:12:45.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.105+0000 7fe937a34640 1 -- 172.21.15.5:0/465905229 shutdown_connections 2023-07-14T13:12:45.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.105+0000 7fe937a34640 1 --2- 172.21.15.5:0/465905229 >> v2:172.21.15.154:3300/0 conn(0x7fe9300d2fc0 0x7fe9300b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:45.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.105+0000 7fe937a34640 1 --2- 172.21.15.5:0/465905229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe93015bde0 0x7fe9300d0270 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:45.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.105+0000 7fe937a34640 1 -- 172.21.15.5:0/465905229 >> 172.21.15.5:0/465905229 conn(0x7fe9300659d0 msgr2=0x7fe93009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:45.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.105+0000 7fe937a34640 1 -- 172.21.15.5:0/465905229 shutdown_connections 2023-07-14T13:12:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.105+0000 7fe937a34640 1 -- 172.21.15.5:0/465905229 wait complete. 2023-07-14T13:12:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.109+0000 7fe937a34640 1 Processor -- start 2023-07-14T13:12:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.109+0000 7fe937a34640 1 -- start start 2023-07-14T13:12:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.109+0000 7fe937a34640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9300d2300 0x7fe93014b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.109+0000 7fe937a34640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9300d2fc0 0x7fe930149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.109+0000 7fe937a34640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe93015bde0 0x7fe93014c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.109+0000 7fe937a34640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9300c60d0 con 0x7fe93015bde0 2023-07-14T13:12:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.109+0000 7fe937a34640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9300cc3d0 con 0x7fe9300d2fc0 2023-07-14T13:12:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.109+0000 7fe937a34640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9300cc0f0 con 0x7fe9300d2300 2023-07-14T13:12:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.109+0000 7fe935fd1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe93015bde0 0x7fe93014c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.109+0000 7fe9357d0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9300d2300 0x7fe93014b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.109+0000 7fe934fcf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9300d2fc0 0x7fe930149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.109+0000 7fe935fd1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe93015bde0 0x7fe93014c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59300/0 (socket says 172.21.15.5:59300) 2023-07-14T13:12:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.109+0000 7fe935fd1640 1 -- 172.21.15.5:0/2345956737 learned_addr learned my addr 172.21.15.5:0/2345956737 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:45.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.109+0000 7fe9357d0640 1 -- 172.21.15.5:0/2345956737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9300d2fc0 msgr2=0x7fe930149990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:45.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.109+0000 7fe9357d0640 1 --2- 172.21.15.5:0/2345956737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9300d2fc0 0x7fe930149990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:45.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.109+0000 7fe9357d0640 1 -- 172.21.15.5:0/2345956737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe93015bde0 msgr2=0x7fe93014c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:45.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.109+0000 7fe9357d0640 1 --2- 172.21.15.5:0/2345956737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe93015bde0 0x7fe93014c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:45.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.109+0000 7fe9357d0640 1 -- 172.21.15.5:0/2345956737 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c009480 con 0x7fe9300d2300 2023-07-14T13:12:45.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.109+0000 7fe9357d0640 1 --2- 172.21.15.5:0/2345956737 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9300d2300 0x7fe93014b630 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe92c0ab000 tx=0x7fe92c0192a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:45.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.109+0000 7fe925ffb640 1 -- 172.21.15.5:0/2345956737 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92c0aab30 con 0x7fe9300d2300 2023-07-14T13:12:45.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.109+0000 7fe925ffb640 1 -- 172.21.15.5:0/2345956737 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92c0aac90 con 0x7fe9300d2300 2023-07-14T13:12:45.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.109+0000 7fe925ffb640 1 -- 172.21.15.5:0/2345956737 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92c003620 con 0x7fe9300d2300 2023-07-14T13:12:45.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.109+0000 7fe937a34640 1 -- 172.21.15.5:0/2345956737 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe93014abe0 con 0x7fe9300d2300 2023-07-14T13:12:45.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.113+0000 7fe937a34640 1 -- 172.21.15.5:0/2345956737 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe93014b1a0 con 0x7fe9300d2300 2023-07-14T13:12:45.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.113+0000 7fe937a34640 1 -- 172.21.15.5:0/2345956737 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9300678d0 con 0x7fe9300d2300 2023-07-14T13:12:45.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.113+0000 7fe925ffb640 1 -- 172.21.15.5:0/2345956737 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 67) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fe92c003990 con 0x7fe9300d2300 2023-07-14T13:12:45.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.113+0000 7fe925ffb640 1 --2- 172.21.15.5:0/2345956737 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fe914066430 0x7fe9140688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:45.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.113+0000 7fe925ffb640 1 -- 172.21.15.5:0/2345956737 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6434+0+0 (secure 0 0 0) 0x7fe92c0a6040 con 0x7fe9300d2300 2023-07-14T13:12:45.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.113+0000 7fe934fcf640 1 -- 172.21.15.5:0/2345956737 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fe914066430 msgr2=0x7fe9140688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/4272779335 2023-07-14T13:12:45.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.113+0000 7fe934fcf640 1 --2- 172.21.15.5:0/2345956737 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fe914066430 0x7fe9140688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:12:45.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.117+0000 7fe925ffb640 1 -- 172.21.15.5:0/2345956737 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe92c0eb8e0 con 0x7fe9300d2300 2023-07-14T13:12:45.182 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:45.145+0000 7effdfcd2180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:12:45.225 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:45.193+0000 7f1861fa6180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:12:45.242 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:45.205+0000 7effdfcd2180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:12:45.281 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:45.249+0000 7f1861fa6180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:12:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.273+0000 7fe937a34640 1 -- 172.21.15.5:0/2345956737 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe93014b390 con 0x7fe9300d2300 2023-07-14T13:12:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.273+0000 7fe925ffb640 1 -- 172.21.15.5:0/2345956737 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v143) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe92c0eef00 con 0x7fe9300d2300 2023-07-14T13:12:45.312 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T13:12:45.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.277+0000 7fe937a34640 1 -- 172.21.15.5:0/2345956737 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fe914066430 msgr2=0x7fe9140688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:12:45.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.277+0000 7fe937a34640 1 --2- 172.21.15.5:0/2345956737 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fe914066430 0x7fe9140688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:45.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.277+0000 7fe937a34640 1 -- 172.21.15.5:0/2345956737 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9300d2300 msgr2=0x7fe93014b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:45.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.277+0000 7fe937a34640 1 --2- 172.21.15.5:0/2345956737 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9300d2300 0x7fe93014b630 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe92c0ab000 tx=0x7fe92c0192a0 comp rx=0 tx=0).stop 2023-07-14T13:12:45.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.277+0000 7fe937a34640 1 -- 172.21.15.5:0/2345956737 shutdown_connections 2023-07-14T13:12:45.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.277+0000 7fe937a34640 1 --2- 172.21.15.5:0/2345956737 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fe914066430 0x7fe9140688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:45.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.277+0000 7fe937a34640 1 --2- 172.21.15.5:0/2345956737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe93015bde0 0x7fe93014c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.277+0000 7fe937a34640 1 --2- 172.21.15.5:0/2345956737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9300d2fc0 0x7fe930149990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.277+0000 7fe937a34640 1 --2- 172.21.15.5:0/2345956737 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9300d2300 0x7fe93014b630 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.277+0000 7fe937a34640 1 -- 172.21.15.5:0/2345956737 >> 172.21.15.5:0/2345956737 conn(0x7fe9300659d0 msgr2=0x7fe93006afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.277+0000 7fe937a34640 1 -- 172.21.15.5:0/2345956737 shutdown_connections 2023-07-14T13:12:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.277+0000 7fe937a34640 1 -- 172.21.15.5:0/2345956737 wait complete. 2023-07-14T13:12:45.334 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T13:12:45.335 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:45.297+0000 7effdfcd2180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:12:45.393 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:45.357+0000 7effdfcd2180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:12:45.422 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:45.389+0000 7f1861fa6180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:12:45.480 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:45.449+0000 7f1861fa6180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:12:45.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.485+0000 7fe1837ad640 1 Processor -- start 2023-07-14T13:12:45.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.485+0000 7fe1837ad640 1 -- start start 2023-07-14T13:12:45.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.489+0000 7fe1837ad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe17c0d2fc0 0x7fe17c0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.489+0000 7fe1837ad640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe17c0d2300 0x7fe17c0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.489+0000 7fe1837ad640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17c0b04c0 con 0x7fe17c15bde0 2023-07-14T13:12:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.489+0000 7fe1837ad640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17c0d2ce0 con 0x7fe17c0d2300 2023-07-14T13:12:45.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.489+0000 7fe1837ad640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c15c1b0 con 0x7fe17c0d2fc0 2023-07-14T13:12:45.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.489+0000 7fe181d4a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe17c0d2300 0x7fe17c0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:45.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.489+0000 7fe181d4a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe17c0d2300 0x7fe17c0d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59312/0 (socket says 172.21.15.5:59312) 2023-07-14T13:12:45.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.489+0000 7fe181d4a640 1 -- 172.21.15.5:0/1061261430 learned_addr learned my addr 172.21.15.5:0/1061261430 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:45.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.489+0000 7fe180d48640 1 --2- 172.21.15.5:0/1061261430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe17c0d2fc0 0x7fe17c0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.489+0000 7fe181d4a640 1 -- 172.21.15.5:0/1061261430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe17c0d2fc0 msgr2=0x7fe17c0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.489+0000 7fe181d4a640 1 --2- 172.21.15.5:0/1061261430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe17c0d2fc0 0x7fe17c0b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:45.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.489+0000 7fe181d4a640 1 -- 172.21.15.5:0/1061261430 >> v1:172.21.15.154:6789/0 conn(0x7fe17c15bde0 legacy=0x7fe17c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.489+0000 7fe181d4a640 1 -- 172.21.15.5:0/1061261430 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c0d0aa0 con 0x7fe17c0d2300 2023-07-14T13:12:45.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.489+0000 7fe173fff640 1 -- 172.21.15.5:0/1061261430 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300380152 0 0) 0x7fe17c0b04c0 con 0x7fe17c15bde0 2023-07-14T13:12:45.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.493+0000 7fe181d4a640 1 --2- 172.21.15.5:0/1061261430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe17c0d2300 0x7fe17c0d27a0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fe174009e50 tx=0x7fe17401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaee5ba7e1d03316 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:45.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.493+0000 7fe173fff640 1 -- 172.21.15.5:0/1061261430 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1740a58e0 con 0x7fe17c0d2300 2023-07-14T13:12:45.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.493+0000 7fe173fff640 1 -- 172.21.15.5:0/1061261430 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1740a5a40 con 0x7fe17c0d2300 2023-07-14T13:12:45.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.493+0000 7fe173fff640 1 -- 172.21.15.5:0/1061261430 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1740a5dd0 con 0x7fe17c0d2300 2023-07-14T13:12:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.493+0000 7fe1837ad640 1 -- 172.21.15.5:0/1061261430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe17c0d2300 msgr2=0x7fe17c0d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.493+0000 7fe1837ad640 1 --2- 172.21.15.5:0/1061261430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe17c0d2300 0x7fe17c0d27a0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fe174009e50 tx=0x7fe17401ca10 comp rx=0 tx=0).stop 2023-07-14T13:12:45.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.493+0000 7fe1837ad640 1 -- 172.21.15.5:0/1061261430 shutdown_connections 2023-07-14T13:12:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.493+0000 7fe1837ad640 1 --2- 172.21.15.5:0/1061261430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe17c0d2300 0x7fe17c0d27a0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.493+0000 7fe1837ad640 1 --2- 172.21.15.5:0/1061261430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe17c0d2fc0 0x7fe17c0b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.493+0000 7fe1837ad640 1 -- 172.21.15.5:0/1061261430 >> 172.21.15.5:0/1061261430 conn(0x7fe17c0659d0 msgr2=0x7fe17c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:45.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.493+0000 7fe1837ad640 1 -- 172.21.15.5:0/1061261430 shutdown_connections 2023-07-14T13:12:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.493+0000 7fe1837ad640 1 -- 172.21.15.5:0/1061261430 wait complete. 2023-07-14T13:12:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.493+0000 7fe1837ad640 1 Processor -- start 2023-07-14T13:12:45.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.493+0000 7fe1837ad640 1 -- start start 2023-07-14T13:12:45.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.497+0000 7fe1837ad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe17c0d2300 0x7fe17c0b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:45.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.497+0000 7fe1837ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe17c0d2fc0 0x7fe17c153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:45.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.497+0000 7fe1837ad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe17c15bde0 0x7fe17c0c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:45.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.497+0000 7fe1837ad640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c153a60 con 0x7fe17c0d2300 2023-07-14T13:12:45.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.497+0000 7fe1837ad640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c0b5810 con 0x7fe17c0d2fc0 2023-07-14T13:12:45.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.497+0000 7fe1837ad640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c0b5af0 con 0x7fe17c15bde0 2023-07-14T13:12:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.497+0000 7fe181549640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe17c0d2300 0x7fe17c0b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.497+0000 7fe181549640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe17c0d2300 0x7fe17c0b51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59328/0 (socket says 172.21.15.5:59328) 2023-07-14T13:12:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.497+0000 7fe181549640 1 -- 172.21.15.5:0/1034004223 learned_addr learned my addr 172.21.15.5:0/1034004223 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:45.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.497+0000 7fe180d48640 1 --2- 172.21.15.5:0/1034004223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe17c0d2fc0 0x7fe17c153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.497+0000 7fe181d4a640 1 --2- 172.21.15.5:0/1034004223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe17c15bde0 0x7fe17c0c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.497+0000 7fe181549640 1 -- 172.21.15.5:0/1034004223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe17c15bde0 msgr2=0x7fe17c0c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:45.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.497+0000 7fe181549640 1 --2- 172.21.15.5:0/1034004223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe17c15bde0 0x7fe17c0c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:45.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.497+0000 7fe181549640 1 -- 172.21.15.5:0/1034004223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe17c0d2fc0 msgr2=0x7fe17c153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:45.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.497+0000 7fe181549640 1 --2- 172.21.15.5:0/1034004223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe17c0d2fc0 0x7fe17c153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:45.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.497+0000 7fe181549640 1 -- 172.21.15.5:0/1034004223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe174009b30 con 0x7fe17c0d2300 2023-07-14T13:12:45.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.497+0000 7fe181549640 1 --2- 172.21.15.5:0/1034004223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe17c0d2300 0x7fe17c0b51a0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fe17800c480 tx=0x7fe17800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:45.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.497+0000 7fe171ffb640 1 -- 172.21.15.5:0/1034004223 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe178005480 con 0x7fe17c0d2300 2023-07-14T13:12:45.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.497+0000 7fe171ffb640 1 -- 172.21.15.5:0/1034004223 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe178003650 con 0x7fe17c0d2300 2023-07-14T13:12:45.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.497+0000 7fe171ffb640 1 -- 172.21.15.5:0/1034004223 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe178003a00 con 0x7fe17c0d2300 2023-07-14T13:12:45.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.497+0000 7fe1837ad640 1 -- 172.21.15.5:0/1034004223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17c0b5dd0 con 0x7fe17c0d2300 2023-07-14T13:12:45.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.497+0000 7fe1837ad640 1 -- 172.21.15.5:0/1034004223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17c0b6390 con 0x7fe17c0d2300 2023-07-14T13:12:45.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.497+0000 7fe1837ad640 1 -- 172.21.15.5:0/1034004223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17c0b6580 con 0x7fe17c0d2300 2023-07-14T13:12:45.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.501+0000 7fe171ffb640 1 -- 172.21.15.5:0/1034004223 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 67) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fe178003b60 con 0x7fe17c0d2300 2023-07-14T13:12:45.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.501+0000 7fe171ffb640 1 --2- 172.21.15.5:0/1034004223 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fe160066430 0x7fe1600688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:45.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.501+0000 7fe171ffb640 1 -- 172.21.15.5:0/1034004223 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6434+0+0 (secure 0 0 0) 0x7fe178083be0 con 0x7fe17c0d2300 2023-07-14T13:12:45.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.501+0000 7fe180d48640 1 -- 172.21.15.5:0/1034004223 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fe160066430 msgr2=0x7fe1600688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/4272779335 2023-07-14T13:12:45.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.501+0000 7fe180d48640 1 --2- 172.21.15.5:0/1034004223 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fe160066430 0x7fe1600688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:12:45.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.505+0000 7fe171ffb640 1 -- 172.21.15.5:0/1034004223 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe178050da0 con 0x7fe17c0d2300 2023-07-14T13:12:45.547 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:45.509+0000 7effdfcd2180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:12:45.609 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:45.573+0000 7effdfcd2180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:12:45.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.661+0000 7fe1837ad640 1 -- 172.21.15.5:0/1034004223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe17c0678d0 con 0x7fe17c0d2300 2023-07-14T13:12:45.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.661+0000 7fe171ffb640 1 -- 172.21.15.5:0/1034004223 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v143) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe1780543c0 con 0x7fe17c0d2300 2023-07-14T13:12:45.699 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T13:12:45.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.665+0000 7fe1837ad640 1 -- 172.21.15.5:0/1034004223 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fe160066430 msgr2=0x7fe1600688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:12:45.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.665+0000 7fe1837ad640 1 --2- 172.21.15.5:0/1034004223 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fe160066430 0x7fe1600688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:45.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.665+0000 7fe1837ad640 1 -- 172.21.15.5:0/1034004223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe17c0d2300 msgr2=0x7fe17c0b51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:45.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.665+0000 7fe1837ad640 1 --2- 172.21.15.5:0/1034004223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe17c0d2300 0x7fe17c0b51a0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fe17800c480 tx=0x7fe17800c940 comp rx=0 tx=0).stop 2023-07-14T13:12:45.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.665+0000 7fe1837ad640 1 -- 172.21.15.5:0/1034004223 shutdown_connections 2023-07-14T13:12:45.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.665+0000 7fe1837ad640 1 --2- 172.21.15.5:0/1034004223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe17c15bde0 0x7fe17c0c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:45.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.665+0000 7fe1837ad640 1 --2- 172.21.15.5:0/1034004223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe17c0d2fc0 0x7fe17c153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:45.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.665+0000 7fe1837ad640 1 --2- 172.21.15.5:0/1034004223 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fe160066430 0x7fe1600688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:45.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.665+0000 7fe1837ad640 1 --2- 172.21.15.5:0/1034004223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe17c0d2300 0x7fe17c0b51a0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:45.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.665+0000 7fe1837ad640 1 -- 172.21.15.5:0/1034004223 >> 172.21.15.5:0/1034004223 conn(0x7fe17c0659d0 msgr2=0x7fe17c0aefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:45.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.665+0000 7fe1837ad640 1 -- 172.21.15.5:0/1034004223 shutdown_connections 2023-07-14T13:12:45.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.665+0000 7fe1837ad640 1 -- 172.21.15.5:0/1034004223 wait complete. 2023-07-14T13:12:45.720 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T13:12:45.722 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:12:45.722 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:12:45.722 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:12:45.730 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:45.697+0000 7f1861fa6180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:12:45.862 INFO:tasks.ceph.mgr.y.smithi005.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:12:45.863 INFO:tasks.ceph.mgr.y.smithi005.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:12:45.863 INFO:tasks.ceph.mgr.y.smithi005.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:12:45.867 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:45.833+0000 7f1861fa6180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:12:45.871 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:45.837+0000 7effdfcd2180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:12:45.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.921+0000 7fe88a9df640 1 Processor -- start 2023-07-14T13:12:45.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.921+0000 7fe88a9df640 1 -- start start 2023-07-14T13:12:45.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.925+0000 7fe88a9df640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe8840b7c70 0x7fe8840d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:45.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.925+0000 7fe88a9df640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe88415fd60 0x7fe8840d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:45.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.925+0000 7fe88a9df640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8840ccaf0 con 0x7fe8840d1850 2023-07-14T13:12:45.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.925+0000 7fe88a9df640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8840d1190 con 0x7fe8840b7c70 2023-07-14T13:12:45.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.925+0000 7fe88a9df640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe884160600 con 0x7fe88415fd60 2023-07-14T13:12:45.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.925+0000 7fe8837fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe8840d1850 0x7fe88415f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49808/0 (socket says 172.21.15.5:49808) 2023-07-14T13:12:45.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.925+0000 7fe8837fe640 1 -- 172.21.15.5:0/2439123659 learned_addr learned my addr 172.21.15.5:0/2439123659 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:45.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.925+0000 7fe883fff640 1 --2- 172.21.15.5:0/2439123659 >> v2:172.21.15.154:3300/0 conn(0x7fe8840b7c70 0x7fe8840d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:45.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.925+0000 7fe888f7c640 1 --2- 172.21.15.5:0/2439123659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe88415fd60 0x7fe8840d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:45.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.925+0000 7fe882ffd640 1 -- 172.21.15.5:0/2439123659 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511289079 0 0) 0x7fe8840ccaf0 con 0x7fe8840d1850 2023-07-14T13:12:45.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.925+0000 7fe882ffd640 1 -- 172.21.15.5:0/2439123659 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe86c003530 con 0x7fe8840d1850 2023-07-14T13:12:45.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.925+0000 7fe883fff640 1 -- 172.21.15.5:0/2439123659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe88415fd60 msgr2=0x7fe8840d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:45.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.925+0000 7fe883fff640 1 --2- 172.21.15.5:0/2439123659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe88415fd60 0x7fe8840d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:45.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.925+0000 7fe883fff640 1 -- 172.21.15.5:0/2439123659 >> v1:172.21.15.5:6789/0 conn(0x7fe8840d1850 legacy=0x7fe88415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:45.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.925+0000 7fe883fff640 1 -- 172.21.15.5:0/2439123659 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe884160320 con 0x7fe8840b7c70 2023-07-14T13:12:45.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.925+0000 7fe888f7c640 1 --2- 172.21.15.5:0/2439123659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe88415fd60 0x7fe8840d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:45.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.929+0000 7fe883fff640 1 --2- 172.21.15.5:0/2439123659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8840b7c70 0x7fe8840d0c50 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe8740097c0 tx=0x7fe87401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63b1eed0dea7f8d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:45.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.929+0000 7fe882ffd640 1 -- 172.21.15.5:0/2439123659 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8740ab670 con 0x7fe8840b7c70 2023-07-14T13:12:45.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.929+0000 7fe882ffd640 1 -- 172.21.15.5:0/2439123659 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8740ab7d0 con 0x7fe8840b7c70 2023-07-14T13:12:45.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.929+0000 7fe882ffd640 1 -- 172.21.15.5:0/2439123659 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8740abb60 con 0x7fe8840b7c70 2023-07-14T13:12:45.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.929+0000 7fe88a9df640 1 -- 172.21.15.5:0/2439123659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8840b7c70 msgr2=0x7fe8840d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:45.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.929+0000 7fe88a9df640 1 --2- 172.21.15.5:0/2439123659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8840b7c70 0x7fe8840d0c50 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe8740097c0 tx=0x7fe87401c450 comp rx=0 tx=0).stop 2023-07-14T13:12:45.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.929+0000 7fe88a9df640 1 -- 172.21.15.5:0/2439123659 shutdown_connections 2023-07-14T13:12:45.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.929+0000 7fe88a9df640 1 --2- 172.21.15.5:0/2439123659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe88415fd60 0x7fe8840d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:45.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.929+0000 7fe88a9df640 1 --2- 172.21.15.5:0/2439123659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8840b7c70 0x7fe8840d0c50 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:45.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.929+0000 7fe88a9df640 1 -- 172.21.15.5:0/2439123659 >> 172.21.15.5:0/2439123659 conn(0x7fe8840650b0 msgr2=0x7fe8840654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:45.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.929+0000 7fe88a9df640 1 -- 172.21.15.5:0/2439123659 shutdown_connections 2023-07-14T13:12:45.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.929+0000 7fe88a9df640 1 -- 172.21.15.5:0/2439123659 wait complete. 2023-07-14T13:12:45.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.929+0000 7fe88a9df640 1 Processor -- start 2023-07-14T13:12:45.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.929+0000 7fe88a9df640 1 -- start start 2023-07-14T13:12:45.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.933+0000 7fe88a9df640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8840b7c70 0x7fe88415e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:45.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.933+0000 7fe88a9df640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8840d1850 0x7fe88414d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:45.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.933+0000 7fe88a9df640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe88415fd60 0x7fe8840b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:45.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.933+0000 7fe88a9df640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8841512d0 con 0x7fe8840b7c70 2023-07-14T13:12:45.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.933+0000 7fe88a9df640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe884151850 con 0x7fe8840d1850 2023-07-14T13:12:45.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.933+0000 7fe88a9df640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88414f130 con 0x7fe88415fd60 2023-07-14T13:12:45.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.933+0000 7fe883fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8840b7c70 0x7fe88415e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:45.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.933+0000 7fe883fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8840b7c70 0x7fe88415e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59330/0 (socket says 172.21.15.5:59330) 2023-07-14T13:12:45.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.933+0000 7fe883fff640 1 -- 172.21.15.5:0/2073196594 learned_addr learned my addr 172.21.15.5:0/2073196594 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:45.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.933+0000 7fe8837fe640 1 --2- 172.21.15.5:0/2073196594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8840d1850 0x7fe88414d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:45.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.933+0000 7fe888f7c640 1 --2- 172.21.15.5:0/2073196594 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe88415fd60 0x7fe8840b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:45.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.933+0000 7fe883fff640 1 -- 172.21.15.5:0/2073196594 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe88415fd60 msgr2=0x7fe8840b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:45.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.933+0000 7fe883fff640 1 --2- 172.21.15.5:0/2073196594 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe88415fd60 0x7fe8840b51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:45.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.933+0000 7fe883fff640 1 -- 172.21.15.5:0/2073196594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8840d1850 msgr2=0x7fe88414d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:45.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.933+0000 7fe883fff640 1 --2- 172.21.15.5:0/2073196594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8840d1850 0x7fe88414d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:45.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.933+0000 7fe883fff640 1 -- 172.21.15.5:0/2073196594 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87c009a70 con 0x7fe8840b7c70 2023-07-14T13:12:45.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.933+0000 7fe883fff640 1 --2- 172.21.15.5:0/2073196594 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8840b7c70 0x7fe88415e990 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fe8740ad040 tx=0x7fe87401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:45.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.933+0000 7fe880ff9640 1 -- 172.21.15.5:0/2073196594 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8740bf610 con 0x7fe8840b7c70 2023-07-14T13:12:45.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.933+0000 7fe880ff9640 1 -- 172.21.15.5:0/2073196594 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8740bf7b0 con 0x7fe8840b7c70 2023-07-14T13:12:45.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.933+0000 7fe880ff9640 1 -- 172.21.15.5:0/2073196594 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8740bfb60 con 0x7fe8840b7c70 2023-07-14T13:12:45.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.933+0000 7fe88a9df640 1 -- 172.21.15.5:0/2073196594 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe874009420 con 0x7fe8840b7c70 2023-07-14T13:12:45.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.933+0000 7fe88a9df640 1 -- 172.21.15.5:0/2073196594 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe88414eb70 con 0x7fe8840b7c70 2023-07-14T13:12:45.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.933+0000 7fe88a9df640 1 -- 172.21.15.5:0/2073196594 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8840678d0 con 0x7fe8840b7c70 2023-07-14T13:12:45.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.937+0000 7fe880ff9640 1 -- 172.21.15.5:0/2073196594 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 67) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fe8740bfcc0 con 0x7fe8840b7c70 2023-07-14T13:12:45.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.937+0000 7fe880ff9640 1 --2- 172.21.15.5:0/2073196594 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fe870066430 0x7fe8700688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:45.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.937+0000 7fe880ff9640 1 -- 172.21.15.5:0/2073196594 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6434+0+0 (secure 0 0 0) 0x7fe87411e960 con 0x7fe8840b7c70 2023-07-14T13:12:45.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.937+0000 7fe8837fe640 1 -- 172.21.15.5:0/2073196594 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fe870066430 msgr2=0x7fe8700688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/4272779335 2023-07-14T13:12:45.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.937+0000 7fe8837fe640 1 --2- 172.21.15.5:0/2073196594 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fe870066430 0x7fe8700688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:12:45.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:45.941+0000 7fe880ff9640 1 -- 172.21.15.5:0/2073196594 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe8740eb8e0 con 0x7fe8840b7c70 2023-07-14T13:12:45.992 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:45.961+0000 7f1861fa6180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:12:46.018 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:45.981+0000 7effdfcd2180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:12:46.064 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:46.033+0000 7f1861fa6180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:12:46.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.109+0000 7fe88a9df640 1 -- 172.21.15.5:0/2073196594 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe8840c5bb0 con 0x7fe8840b7c70 2023-07-14T13:12:46.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.109+0000 7fe880ff9640 1 -- 172.21.15.5:0/2073196594 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v143) v1 ==== 80+0+478 (secure 0 0 0) 0x7fe8740eef00 con 0x7fe8840b7c70 2023-07-14T13:12:46.147 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/2411764460 2023-07-15T13:12:40.543160+0000 2023-07-14T13:12:46.147 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/2264156620 2023-07-15T13:12:40.543160+0000 2023-07-14T13:12:46.147 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/4093515681 2023-07-15T13:12:40.543160+0000 2023-07-14T13:12:46.147 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/1036989288 2023-07-15T13:12:40.543160+0000 2023-07-14T13:12:46.148 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/3525194571 2023-07-15T13:12:40.543160+0000 2023-07-14T13:12:46.148 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:6833/3769132865 2023-07-15T13:12:40.543160+0000 2023-07-14T13:12:46.148 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:6832/3769132865 2023-07-15T13:12:40.543160+0000 2023-07-14T13:12:46.148 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/1560509459 2023-07-15T13:12:40.543160+0000 2023-07-14T13:12:46.149 INFO:teuthology.orchestra.run.smithi005.stderr:listed 8 entries 2023-07-14T13:12:46.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.113+0000 7fe88a9df640 1 -- 172.21.15.5:0/2073196594 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fe870066430 msgr2=0x7fe8700688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:12:46.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.113+0000 7fe88a9df640 1 --2- 172.21.15.5:0/2073196594 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fe870066430 0x7fe8700688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:46.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.113+0000 7fe88a9df640 1 -- 172.21.15.5:0/2073196594 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8840b7c70 msgr2=0x7fe88415e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:46.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.113+0000 7fe88a9df640 1 --2- 172.21.15.5:0/2073196594 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8840b7c70 0x7fe88415e990 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fe8740ad040 tx=0x7fe87401ac90 comp rx=0 tx=0).stop 2023-07-14T13:12:46.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.113+0000 7fe88a9df640 1 -- 172.21.15.5:0/2073196594 shutdown_connections 2023-07-14T13:12:46.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.113+0000 7fe88a9df640 1 --2- 172.21.15.5:0/2073196594 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe88415fd60 0x7fe8840b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:46.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.113+0000 7fe88a9df640 1 --2- 172.21.15.5:0/2073196594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8840d1850 0x7fe88414d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:46.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.113+0000 7fe88a9df640 1 --2- 172.21.15.5:0/2073196594 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fe870066430 0x7fe8700688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:46.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.113+0000 7fe88a9df640 1 --2- 172.21.15.5:0/2073196594 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8840b7c70 0x7fe88415e990 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:46.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.113+0000 7fe88a9df640 1 -- 172.21.15.5:0/2073196594 >> 172.21.15.5:0/2073196594 conn(0x7fe8840650b0 msgr2=0x7fe88415f370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:46.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.113+0000 7fe88a9df640 1 -- 172.21.15.5:0/2073196594 shutdown_connections 2023-07-14T13:12:46.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.113+0000 7fe88a9df640 1 -- 172.21.15.5:0/2073196594 wait complete. 2023-07-14T13:12:46.152 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:46.117+0000 7effdfcd2180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:12:46.169 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-14T13:12:46.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:12:46.170 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-14T13:12:46.198 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:46.165+0000 7f1861fa6180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:12:46.228 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:46.193+0000 7effdfcd2180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:12:46.239 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-07-14T13:12:46.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:12:46.240 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-14T13:12:46.254 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:12:46.254 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:12:46.263 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:12:46.264 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:12:46.264 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:12:46.305 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:12:46.305 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:12:46.306 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:12:46.315 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:12:46.316 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:12:46.370 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:46.333+0000 7effdfcd2180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:12:46.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.457+0000 7f35fde93640 1 Processor -- start 2023-07-14T13:12:46.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.457+0000 7f35fde93640 1 -- start start 2023-07-14T13:12:46.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.457+0000 7f35fde93640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35f815fd60 0x7f35f80d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:46.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.457+0000 7f35fde93640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35f80d1850 0x7f35f80d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:46.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.457+0000 7f35fde93640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f80ccaf0 con 0x7f35f80b7c70 2023-07-14T13:12:46.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.457+0000 7f35fde93640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f80d1190 con 0x7f35f815fd60 2023-07-14T13:12:46.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.457+0000 7f35fde93640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f8160600 con 0x7f35f80d1850 2023-07-14T13:12:46.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.457+0000 7f35f6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35f815fd60 0x7f35f80d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:46.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.457+0000 7f35f6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35f815fd60 0x7f35f80d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59344/0 (socket says 172.21.15.5:59344) 2023-07-14T13:12:46.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.457+0000 7f35f6ffd640 1 -- 172.21.15.5:0/3121268857 learned_addr learned my addr 172.21.15.5:0/3121268857 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:46.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.457+0000 7f35f7fff640 1 --2- 172.21.15.5:0/3121268857 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35f80d1850 0x7f35f80d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:46.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.457+0000 7f35f6ffd640 1 -- 172.21.15.5:0/3121268857 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35f80d1850 msgr2=0x7f35f80d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:46.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.457+0000 7f35f6ffd640 1 --2- 172.21.15.5:0/3121268857 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35f80d1850 0x7f35f80d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:46.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.457+0000 7f35f6ffd640 1 -- 172.21.15.5:0/3121268857 >> v1:172.21.15.5:6789/0 conn(0x7f35f80b7c70 legacy=0x7f35f815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:46.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.457+0000 7f35f6ffd640 1 -- 172.21.15.5:0/3121268857 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f8160320 con 0x7f35f815fd60 2023-07-14T13:12:46.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.457+0000 7f35f7fff640 1 --2- 172.21.15.5:0/3121268857 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35f80d1850 0x7f35f80d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:46.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.457+0000 7f35f67fc640 1 -- 172.21.15.5:0/3121268857 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1070532916 0 0) 0x7f35f80ccaf0 con 0x7f35f80b7c70 2023-07-14T13:12:46.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.461+0000 7f35f6ffd640 1 --2- 172.21.15.5:0/3121268857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f815fd60 0x7f35f80d0c50 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f35ec009870 tx=0x7f35ec01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923577089f602379 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:46.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.461+0000 7f35f67fc640 1 -- 172.21.15.5:0/3121268857 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec0a95f0 con 0x7f35f815fd60 2023-07-14T13:12:46.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.461+0000 7f35f67fc640 1 -- 172.21.15.5:0/3121268857 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ec0a9750 con 0x7f35f815fd60 2023-07-14T13:12:46.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.461+0000 7f35f67fc640 1 -- 172.21.15.5:0/3121268857 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec0a9ae0 con 0x7f35f815fd60 2023-07-14T13:12:46.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.461+0000 7f35fde93640 1 -- 172.21.15.5:0/3121268857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f815fd60 msgr2=0x7f35f80d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:46.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.461+0000 7f35fde93640 1 --2- 172.21.15.5:0/3121268857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f815fd60 0x7f35f80d0c50 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f35ec009870 tx=0x7f35ec01c510 comp rx=0 tx=0).stop 2023-07-14T13:12:46.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.461+0000 7f35fde93640 1 -- 172.21.15.5:0/3121268857 shutdown_connections 2023-07-14T13:12:46.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.461+0000 7f35fde93640 1 --2- 172.21.15.5:0/3121268857 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35f80d1850 0x7f35f80d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:46.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.461+0000 7f35fde93640 1 --2- 172.21.15.5:0/3121268857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f815fd60 0x7f35f80d0c50 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:46.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.461+0000 7f35fde93640 1 -- 172.21.15.5:0/3121268857 >> 172.21.15.5:0/3121268857 conn(0x7f35f80650b0 msgr2=0x7f35f80654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:46.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.461+0000 7f35fde93640 1 -- 172.21.15.5:0/3121268857 shutdown_connections 2023-07-14T13:12:46.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.461+0000 7f35fde93640 1 -- 172.21.15.5:0/3121268857 wait complete. 2023-07-14T13:12:46.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.465+0000 7f35fde93640 1 Processor -- start 2023-07-14T13:12:46.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.465+0000 7f35fde93640 1 -- start start 2023-07-14T13:12:46.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.465+0000 7f35fde93640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f80b7c70 0x7f35f815a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:46.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.465+0000 7f35fde93640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35f80d1850 0x7f35f815e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:46.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.465+0000 7f35fde93640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35f815fd60 0x7f35f8159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:46.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.465+0000 7f35fde93640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f814e0f0 con 0x7f35f80b7c70 2023-07-14T13:12:46.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.465+0000 7f35fde93640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f815a260 con 0x7f35f80d1850 2023-07-14T13:12:46.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.465+0000 7f35fde93640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f814f7e0 con 0x7f35f815fd60 2023-07-14T13:12:46.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.465+0000 7f35f77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f80b7c70 0x7f35f815a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:46.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.465+0000 7f35f77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f80b7c70 0x7f35f815a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59354/0 (socket says 172.21.15.5:59354) 2023-07-14T13:12:46.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.465+0000 7f35f77fe640 1 -- 172.21.15.5:0/3950505440 learned_addr learned my addr 172.21.15.5:0/3950505440 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:46.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.465+0000 7f35f6ffd640 1 --2- 172.21.15.5:0/3950505440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35f80d1850 0x7f35f815e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:46.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.465+0000 7f35f7fff640 1 --2- 172.21.15.5:0/3950505440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35f815fd60 0x7f35f8159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:46.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.465+0000 7f35f77fe640 1 -- 172.21.15.5:0/3950505440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35f815fd60 msgr2=0x7f35f8159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:46.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.465+0000 7f35f77fe640 1 --2- 172.21.15.5:0/3950505440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35f815fd60 0x7f35f8159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:46.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.465+0000 7f35f77fe640 1 -- 172.21.15.5:0/3950505440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35f80d1850 msgr2=0x7f35f815e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:46.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.465+0000 7f35f77fe640 1 --2- 172.21.15.5:0/3950505440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35f80d1850 0x7f35f815e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:46.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.465+0000 7f35f77fe640 1 -- 172.21.15.5:0/3950505440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ec0094d0 con 0x7f35f80b7c70 2023-07-14T13:12:46.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.465+0000 7f35f77fe640 1 --2- 172.21.15.5:0/3950505440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f80b7c70 0x7f35f815a3e0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f35e800c450 tx=0x7f35e800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:46.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.465+0000 7f35dffff640 1 -- 172.21.15.5:0/3950505440 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8005480 con 0x7f35f80b7c70 2023-07-14T13:12:46.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.465+0000 7f35dffff640 1 -- 172.21.15.5:0/3950505440 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e8003600 con 0x7f35f80b7c70 2023-07-14T13:12:46.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.465+0000 7f35fde93640 1 -- 172.21.15.5:0/3950505440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f815ef70 con 0x7f35f80b7c70 2023-07-14T13:12:46.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.465+0000 7f35dffff640 1 -- 172.21.15.5:0/3950505440 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e80039b0 con 0x7f35f80b7c70 2023-07-14T13:12:46.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.469+0000 7f35fde93640 1 -- 172.21.15.5:0/3950505440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f80b5c70 con 0x7f35f80b7c70 2023-07-14T13:12:46.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.469+0000 7f35fde93640 1 -- 172.21.15.5:0/3950505440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f814e230 con 0x7f35f80b7c70 2023-07-14T13:12:46.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.469+0000 7f35dffff640 1 -- 172.21.15.5:0/3950505440 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 67) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f35e8003b10 con 0x7f35f80b7c70 2023-07-14T13:12:46.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.469+0000 7f35dffff640 1 --2- 172.21.15.5:0/3950505440 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7f35e4066430 0x7f35e40688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:46.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.469+0000 7f35dffff640 1 -- 172.21.15.5:0/3950505440 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f35e8083530 con 0x7f35f80b7c70 2023-07-14T13:12:46.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.469+0000 7f35f6ffd640 1 -- 172.21.15.5:0/3950505440 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7f35e4066430 msgr2=0x7f35e40688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/4272779335 2023-07-14T13:12:46.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.469+0000 7f35f6ffd640 1 --2- 172.21.15.5:0/3950505440 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7f35e4066430 0x7f35e40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:12:46.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.473+0000 7f35dffff640 1 -- 172.21.15.5:0/3950505440 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f35f814e230 con 0x7f35f80b7c70 2023-07-14T13:12:46.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.661+0000 7f35fde93640 1 -- 172.21.15.5:0/3950505440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35f814e230 con 0x7f35f80b7c70 2023-07-14T13:12:46.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.661+0000 7f35dffff640 1 -- 172.21.15.5:0/3950505440 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4711 (secure 0 0 0) 0x7f35f814e230 con 0x7f35f80b7c70 2023-07-14T13:12:46.700 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:46.701 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7373,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3424293950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3424293950},{"type":"v1","addr":"172.21.15.5:6834","nonce":3424293950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7379,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/1672977104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1672977104},{"type":"v1","addr":"172.21.15.154:6836","nonce":1672977104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":8401,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2517721716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2517721716},{"type":"v1","addr":"172.21.15.154:6837","nonce":2517721716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:12:23.316419+0000","modified":"2023-07-14T13:12:26.932428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8808},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8808":{"gid":8808,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/4283823156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":4283823156},{"type":"v1","addr":"172.21.15.5:6835","nonce":4283823156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-14T13:12:46.702 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 65 2023-07-14T13:12:46.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.665+0000 7f35fde93640 1 -- 172.21.15.5:0/3950505440 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7f35e4066430 msgr2=0x7f35e40688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:12:46.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.665+0000 7f35fde93640 1 --2- 172.21.15.5:0/3950505440 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7f35e4066430 0x7f35e40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:46.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.665+0000 7f35fde93640 1 -- 172.21.15.5:0/3950505440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f80b7c70 msgr2=0x7f35f815a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:46.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.665+0000 7f35fde93640 1 --2- 172.21.15.5:0/3950505440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f80b7c70 0x7f35f815a3e0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f35e800c450 tx=0x7f35e800c910 comp rx=0 tx=0).stop 2023-07-14T13:12:46.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.665+0000 7f35fde93640 1 -- 172.21.15.5:0/3950505440 shutdown_connections 2023-07-14T13:12:46.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.665+0000 7f35fde93640 1 --2- 172.21.15.5:0/3950505440 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f35f815fd60 0x7f35f8159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:46.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.665+0000 7f35fde93640 1 --2- 172.21.15.5:0/3950505440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35f80d1850 0x7f35f815e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:46.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.665+0000 7f35fde93640 1 --2- 172.21.15.5:0/3950505440 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7f35e4066430 0x7f35e40688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:46.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.665+0000 7f35fde93640 1 --2- 172.21.15.5:0/3950505440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f80b7c70 0x7f35f815a3e0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:46.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.665+0000 7f35fde93640 1 -- 172.21.15.5:0/3950505440 >> 172.21.15.5:0/3950505440 conn(0x7f35f80650b0 msgr2=0x7f35f80d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:46.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.665+0000 7f35fde93640 1 -- 172.21.15.5:0/3950505440 shutdown_connections 2023-07-14T13:12:46.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.665+0000 7f35fde93640 1 -- 172.21.15.5:0/3950505440 wait complete. 2023-07-14T13:12:46.722 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:12:46.741 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:46.709+0000 7f1861fa6180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:12:46.826 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:46.793+0000 7f1861fa6180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:12:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.877+0000 7fe206940640 1 Processor -- start 2023-07-14T13:12:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.877+0000 7fe206940640 1 -- start start 2023-07-14T13:12:46.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.877+0000 7fe206940640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe20015fd60 0x7fe2000d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:46.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.877+0000 7fe206940640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe2000d1850 0x7fe2000d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:46.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.877+0000 7fe206940640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2000ccaf0 con 0x7fe2000b7c70 2023-07-14T13:12:46.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.877+0000 7fe206940640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2000d1190 con 0x7fe2000d1850 2023-07-14T13:12:46.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.877+0000 7fe206940640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe200160600 con 0x7fe20015fd60 2023-07-14T13:12:46.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.877+0000 7fe204edd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe2000d1850 0x7fe2000d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.877+0000 7fe1ff7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe20015fd60 0x7fe2000d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.877+0000 7fe1fffff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe2000b7c70 0x7fe20015f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:53274/0 (socket says 172.21.15.5:53274) 2023-07-14T13:12:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.877+0000 7fe1fffff640 1 -- 172.21.15.5:0/3249428312 learned_addr learned my addr 172.21.15.5:0/3249428312 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.877+0000 7fe204edd640 1 -- 172.21.15.5:0/3249428312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe20015fd60 msgr2=0x7fe2000d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.877+0000 7fe204edd640 1 --2- 172.21.15.5:0/3249428312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe20015fd60 0x7fe2000d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.877+0000 7fe204edd640 1 -- 172.21.15.5:0/3249428312 >> v1:172.21.15.154:6789/0 conn(0x7fe2000b7c70 legacy=0x7fe20015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.877+0000 7fe204edd640 1 -- 172.21.15.5:0/3249428312 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe200160320 con 0x7fe2000d1850 2023-07-14T13:12:46.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.877+0000 7fe1feffd640 1 -- 172.21.15.5:0/3249428312 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303655033 0 0) 0x7fe2000ccaf0 con 0x7fe2000b7c70 2023-07-14T13:12:46.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.881+0000 7fe204edd640 1 --2- 172.21.15.5:0/3249428312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2000d1850 0x7fe2000d1da0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8009dc0 tx=0x7fe1f801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9feab99bd6d6eaac server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:46.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.881+0000 7fe1feffd640 1 -- 172.21.15.5:0/3249428312 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f80a59e0 con 0x7fe2000d1850 2023-07-14T13:12:46.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.881+0000 7fe1feffd640 1 -- 172.21.15.5:0/3249428312 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f80a5b40 con 0x7fe2000d1850 2023-07-14T13:12:46.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.881+0000 7fe1feffd640 1 -- 172.21.15.5:0/3249428312 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f80ad440 con 0x7fe2000d1850 2023-07-14T13:12:46.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.881+0000 7fe206940640 1 -- 172.21.15.5:0/3249428312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2000d1850 msgr2=0x7fe2000d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:46.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.881+0000 7fe206940640 1 --2- 172.21.15.5:0/3249428312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2000d1850 0x7fe2000d1da0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8009dc0 tx=0x7fe1f801c900 comp rx=0 tx=0).stop 2023-07-14T13:12:46.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.881+0000 7fe206940640 1 -- 172.21.15.5:0/3249428312 shutdown_connections 2023-07-14T13:12:46.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.881+0000 7fe206940640 1 --2- 172.21.15.5:0/3249428312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2000d1850 0x7fe2000d1da0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:46.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.881+0000 7fe206940640 1 --2- 172.21.15.5:0/3249428312 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe20015fd60 0x7fe2000d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:46.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.881+0000 7fe206940640 1 -- 172.21.15.5:0/3249428312 >> 172.21.15.5:0/3249428312 conn(0x7fe2000650b0 msgr2=0x7fe2000654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:46.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.881+0000 7fe206940640 1 -- 172.21.15.5:0/3249428312 shutdown_connections 2023-07-14T13:12:46.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.881+0000 7fe206940640 1 -- 172.21.15.5:0/3249428312 wait complete. 2023-07-14T13:12:46.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.885+0000 7fe206940640 1 Processor -- start 2023-07-14T13:12:46.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.885+0000 7fe206940640 1 -- start start 2023-07-14T13:12:46.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.885+0000 7fe206940640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2000b7c70 0x7fe20015eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:46.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.885+0000 7fe206940640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2000d1850 0x7fe20014a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:46.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.885+0000 7fe206940640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe20015fd60 0x7fe2001f7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:46.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.885+0000 7fe206940640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20015b2b0 con 0x7fe2000d1850 2023-07-14T13:12:46.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.885+0000 7fe206940640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2001f8390 con 0x7fe20015fd60 2023-07-14T13:12:46.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.885+0000 7fe206940640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20015b980 con 0x7fe2000b7c70 2023-07-14T13:12:46.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.885+0000 7fe1ff7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2000d1850 0x7fe20014a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:46.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.885+0000 7fe1ff7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2000d1850 0x7fe20014a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59366/0 (socket says 172.21.15.5:59366) 2023-07-14T13:12:46.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.885+0000 7fe1ff7fe640 1 -- 172.21.15.5:0/3325889104 learned_addr learned my addr 172.21.15.5:0/3325889104 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:46.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.885+0000 7fe1fffff640 1 --2- 172.21.15.5:0/3325889104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2000b7c70 0x7fe20015eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:46.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.885+0000 7fe204edd640 1 --2- 172.21.15.5:0/3325889104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe20015fd60 0x7fe2001f7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:46.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.885+0000 7fe1ff7fe640 1 -- 172.21.15.5:0/3325889104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2000b7c70 msgr2=0x7fe20015eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:46.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.885+0000 7fe1ff7fe640 1 --2- 172.21.15.5:0/3325889104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2000b7c70 0x7fe20015eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:46.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.885+0000 7fe1ff7fe640 1 -- 172.21.15.5:0/3325889104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe20015fd60 msgr2=0x7fe2001f7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:46.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.885+0000 7fe1ff7fe640 1 --2- 172.21.15.5:0/3325889104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe20015fd60 0x7fe2001f7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:46.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.885+0000 7fe1ff7fe640 1 -- 172.21.15.5:0/3325889104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f8009a70 con 0x7fe2000d1850 2023-07-14T13:12:46.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.885+0000 7fe1fffff640 1 --2- 172.21.15.5:0/3325889104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2000b7c70 0x7fe20015eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:46.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.885+0000 7fe1ff7fe640 1 --2- 172.21.15.5:0/3325889104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2000d1850 0x7fe20014a2c0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400e960 tx=0x7fe1f400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:46.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.885+0000 7fe1fcff9640 1 -- 172.21.15.5:0/3325889104 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4009690 con 0x7fe2000d1850 2023-07-14T13:12:46.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.885+0000 7fe1fcff9640 1 -- 172.21.15.5:0/3325889104 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f400c9a0 con 0x7fe2000d1850 2023-07-14T13:12:46.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.885+0000 7fe1fcff9640 1 -- 172.21.15.5:0/3325889104 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f400cd10 con 0x7fe2000d1850 2023-07-14T13:12:46.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.885+0000 7fe206940640 1 -- 172.21.15.5:0/3325889104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe20015dda0 con 0x7fe2000d1850 2023-07-14T13:12:46.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.885+0000 7fe206940640 1 -- 172.21.15.5:0/3325889104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20015c960 con 0x7fe2000d1850 2023-07-14T13:12:46.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.889+0000 7fe206940640 1 -- 172.21.15.5:0/3325889104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2000678d0 con 0x7fe2000d1850 2023-07-14T13:12:46.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.889+0000 7fe1fcff9640 1 -- 172.21.15.5:0/3325889104 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 67) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fe1f4013470 con 0x7fe2000d1850 2023-07-14T13:12:46.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.889+0000 7fe1fcff9640 1 --2- 172.21.15.5:0/3325889104 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fe1ec066430 0x7fe1ec0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:46.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.889+0000 7fe1fcff9640 1 -- 172.21.15.5:0/3325889104 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6434+0+0 (secure 0 0 0) 0x7fe1f40841e0 con 0x7fe2000d1850 2023-07-14T13:12:46.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.889+0000 7fe1fffff640 1 -- 172.21.15.5:0/3325889104 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fe1ec066430 msgr2=0x7fe1ec0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/4272779335 2023-07-14T13:12:46.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.889+0000 7fe1fffff640 1 --2- 172.21.15.5:0/3325889104 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fe1ec066430 0x7fe1ec0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:12:46.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:46.893+0000 7fe1fcff9640 1 -- 172.21.15.5:0/3325889104 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe1f4051450 con 0x7fe2000d1850 2023-07-14T13:12:46.953 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:46.917+0000 7effdfcd2180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:12:46.978 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:46.945+0000 7f1861fa6180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:12:47.047 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:47.009+0000 7effdfcd2180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:12:47.063 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:47.029+0000 7f1861fa6180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:12:47.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.053+0000 7fe206940640 1 -- 172.21.15.5:0/3325889104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2001665b0 con 0x7fe2000d1850 2023-07-14T13:12:47.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.057+0000 7fe1fcff9640 1 -- 172.21.15.5:0/3325889104 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+18866 (secure 0 0 0) 0x7fe1f4054a70 con 0x7fe2000d1850 2023-07-14T13:12:47.092 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:47.093 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":143,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:12:40.543200+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:12:21.430786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-14T13:12:22.293915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/2411764460":"2023-07-15T13:12:40.543160+0000","172.21.15.154:0/2264156620":"2023-07-15T13:12:40.543160+0000","172.21.15.154:0/4093515681":"2023-07-15T13:12:40.543160+0000","172.21.15.154:0/1036989288":"2023-07-15T13:12:40.543160+0000","172.21.15.154:0/3525194571":"2023-07-15T13:12:40.543160+0000","172.21.15.154:6833/3769132865":"2023-07-15T13:12:40.543160+0000","172.21.15.154:6832/3769132865":"2023-07-15T13:12:40.543160+0000","172.21.15.154:0/1560509459":"2023-07-15T13:12:40.543160+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:12:47.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.057+0000 7fe206940640 1 -- 172.21.15.5:0/3325889104 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fe1ec066430 msgr2=0x7fe1ec0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:12:47.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.057+0000 7fe206940640 1 --2- 172.21.15.5:0/3325889104 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fe1ec066430 0x7fe1ec0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.057+0000 7fe206940640 1 -- 172.21.15.5:0/3325889104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2000d1850 msgr2=0x7fe20014a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:47.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.057+0000 7fe206940640 1 --2- 172.21.15.5:0/3325889104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2000d1850 0x7fe20014a2c0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400e960 tx=0x7fe1f400ee20 comp rx=0 tx=0).stop 2023-07-14T13:12:47.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.057+0000 7fe206940640 1 -- 172.21.15.5:0/3325889104 shutdown_connections 2023-07-14T13:12:47.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.057+0000 7fe206940640 1 --2- 172.21.15.5:0/3325889104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe20015fd60 0x7fe2001f7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.057+0000 7fe206940640 1 --2- 172.21.15.5:0/3325889104 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fe1ec066430 0x7fe1ec0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.057+0000 7fe206940640 1 --2- 172.21.15.5:0/3325889104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2000d1850 0x7fe20014a2c0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.057+0000 7fe206940640 1 --2- 172.21.15.5:0/3325889104 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2000b7c70 0x7fe20015eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.057+0000 7fe206940640 1 -- 172.21.15.5:0/3325889104 >> 172.21.15.5:0/3325889104 conn(0x7fe2000650b0 msgr2=0x7fe200065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:47.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.057+0000 7fe206940640 1 -- 172.21.15.5:0/3325889104 shutdown_connections 2023-07-14T13:12:47.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.057+0000 7fe206940640 1 -- 172.21.15.5:0/3325889104 wait complete. 2023-07-14T13:12:47.115 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T13:12:21.430786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T13:12:22.293915+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:12:47.115 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:12:47.206 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:47.169+0000 7effdfcd2180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:12:47.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.229+0000 7fac54d96640 1 Processor -- start 2023-07-14T13:12:47.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.229+0000 7fac54d96640 1 -- start start 2023-07-14T13:12:47.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.229+0000 7fac54d96640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac5015bde0 0x7fac500d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:47.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.229+0000 7fac54d96640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fac500d2300 0x7fac500d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:47.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.229+0000 7fac54d96640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac500b04c0 con 0x7fac500d2fc0 2023-07-14T13:12:47.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.229+0000 7fac54d96640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5015c1b0 con 0x7fac5015bde0 2023-07-14T13:12:47.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.229+0000 7fac54d96640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac500b1060 con 0x7fac500d2300 2023-07-14T13:12:47.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.229+0000 7fac4e59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac5015bde0 0x7fac500d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:47.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.229+0000 7fac4e59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fac5015bde0 0x7fac500d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59382/0 (socket says 172.21.15.5:59382) 2023-07-14T13:12:47.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.229+0000 7fac4e59c640 1 -- 172.21.15.5:0/4093032755 learned_addr learned my addr 172.21.15.5:0/4093032755 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:47.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.229+0000 7fac4dd9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fac500d2fc0 0x7fac500b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49818/0 (socket says 172.21.15.5:49818) 2023-07-14T13:12:47.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.229+0000 7fac4ed9d640 1 --2- 172.21.15.5:0/4093032755 >> v2:172.21.15.154:3300/0 conn(0x7fac500d2300 0x7fac500d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:47.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.229+0000 7fac4e59c640 1 -- 172.21.15.5:0/4093032755 >> v2:172.21.15.154:3300/0 conn(0x7fac500d2300 msgr2=0x7fac500d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:47.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.229+0000 7fac4e59c640 1 --2- 172.21.15.5:0/4093032755 >> v2:172.21.15.154:3300/0 conn(0x7fac500d2300 0x7fac500d2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.229+0000 7fac4e59c640 1 -- 172.21.15.5:0/4093032755 >> v1:172.21.15.5:6789/0 conn(0x7fac500d2fc0 legacy=0x7fac500b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:47.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.229+0000 7fac4d59a640 1 -- 172.21.15.5:0/4093032755 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4103376566 0 0) 0x7fac500b04c0 con 0x7fac500d2fc0 2023-07-14T13:12:47.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.229+0000 7fac4e59c640 1 -- 172.21.15.5:0/4093032755 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac500d2c80 con 0x7fac5015bde0 2023-07-14T13:12:47.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.229+0000 7fac4ed9d640 1 --2- 172.21.15.5:0/4093032755 >> v2:172.21.15.154:3300/0 conn(0x7fac500d2300 0x7fac500d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:47.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.233+0000 7fac4e59c640 1 --2- 172.21.15.5:0/4093032755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac5015bde0 0x7fac500d0270 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fac5008c820 tx=0x7fac4001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f3e8954485bbab1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:47.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.233+0000 7fac4d59a640 1 -- 172.21.15.5:0/4093032755 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac400ab610 con 0x7fac5015bde0 2023-07-14T13:12:47.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.233+0000 7fac4d59a640 1 -- 172.21.15.5:0/4093032755 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac400ab770 con 0x7fac5015bde0 2023-07-14T13:12:47.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.233+0000 7fac4d59a640 1 -- 172.21.15.5:0/4093032755 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac400abb00 con 0x7fac5015bde0 2023-07-14T13:12:47.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.233+0000 7fac54d96640 1 -- 172.21.15.5:0/4093032755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac5015bde0 msgr2=0x7fac500d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:47.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.233+0000 7fac54d96640 1 --2- 172.21.15.5:0/4093032755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac5015bde0 0x7fac500d0270 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fac5008c820 tx=0x7fac4001c500 comp rx=0 tx=0).stop 2023-07-14T13:12:47.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.233+0000 7fac54d96640 1 -- 172.21.15.5:0/4093032755 shutdown_connections 2023-07-14T13:12:47.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.233+0000 7fac54d96640 1 --2- 172.21.15.5:0/4093032755 >> v2:172.21.15.154:3300/0 conn(0x7fac500d2300 0x7fac500d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.233+0000 7fac54d96640 1 --2- 172.21.15.5:0/4093032755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac5015bde0 0x7fac500d0270 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.233+0000 7fac54d96640 1 -- 172.21.15.5:0/4093032755 >> 172.21.15.5:0/4093032755 conn(0x7fac500659d0 msgr2=0x7fac5009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:47.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.233+0000 7fac54d96640 1 -- 172.21.15.5:0/4093032755 shutdown_connections 2023-07-14T13:12:47.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.233+0000 7fac54d96640 1 -- 172.21.15.5:0/4093032755 wait complete. 2023-07-14T13:12:47.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.237+0000 7fac54d96640 1 Processor -- start 2023-07-14T13:12:47.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.237+0000 7fac54d96640 1 -- start start 2023-07-14T13:12:47.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.237+0000 7fac54d96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac500d2300 0x7fac50157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:47.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.237+0000 7fac54d96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac500d2fc0 0x7fac500b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:47.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.237+0000 7fac54d96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac5015bde0 0x7fac5006afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:47.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.237+0000 7fac54d96640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac500b36b0 con 0x7fac500d2300 2023-07-14T13:12:47.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.237+0000 7fac54d96640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac500b3f90 con 0x7fac500d2fc0 2023-07-14T13:12:47.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.237+0000 7fac54d96640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac500c63a0 con 0x7fac5015bde0 2023-07-14T13:12:47.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.241+0000 7fac4e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac500d2300 0x7fac50157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:47.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.241+0000 7fac4e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac500d2300 0x7fac50157880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59392/0 (socket says 172.21.15.5:59392) 2023-07-14T13:12:47.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.241+0000 7fac4e59c640 1 -- 172.21.15.5:0/2759389699 learned_addr learned my addr 172.21.15.5:0/2759389699 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:47.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.241+0000 7fac4dd9b640 1 --2- 172.21.15.5:0/2759389699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac500d2fc0 0x7fac500b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:47.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.241+0000 7fac4ed9d640 1 --2- 172.21.15.5:0/2759389699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac5015bde0 0x7fac5006afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:47.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.241+0000 7fac4e59c640 1 -- 172.21.15.5:0/2759389699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac5015bde0 msgr2=0x7fac5006afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:47.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.241+0000 7fac4e59c640 1 --2- 172.21.15.5:0/2759389699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac5015bde0 0x7fac5006afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.241+0000 7fac4e59c640 1 -- 172.21.15.5:0/2759389699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac500d2fc0 msgr2=0x7fac500b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:47.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.241+0000 7fac4e59c640 1 --2- 172.21.15.5:0/2759389699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac500d2fc0 0x7fac500b3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.241+0000 7fac4e59c640 1 -- 172.21.15.5:0/2759389699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac40009470 con 0x7fac500d2300 2023-07-14T13:12:47.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.241+0000 7fac4e59c640 1 --2- 172.21.15.5:0/2759389699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac500d2300 0x7fac50157880 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fac400ad040 tx=0x7fac4001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:47.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.241+0000 7fac3effd640 1 -- 172.21.15.5:0/2759389699 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac400abdb0 con 0x7fac500d2300 2023-07-14T13:12:47.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.241+0000 7fac3effd640 1 -- 172.21.15.5:0/2759389699 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac400b8070 con 0x7fac500d2300 2023-07-14T13:12:47.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.241+0000 7fac54d96640 1 -- 172.21.15.5:0/2759389699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac500c6680 con 0x7fac500d2300 2023-07-14T13:12:47.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.241+0000 7fac3effd640 1 -- 172.21.15.5:0/2759389699 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40004220 con 0x7fac500d2300 2023-07-14T13:12:47.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.241+0000 7fac54d96640 1 -- 172.21.15.5:0/2759389699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac500c6c40 con 0x7fac500d2300 2023-07-14T13:12:47.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.241+0000 7fac54d96640 1 -- 172.21.15.5:0/2759389699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac500678d0 con 0x7fac500d2300 2023-07-14T13:12:47.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.241+0000 7fac3effd640 1 -- 172.21.15.5:0/2759389699 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 67) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fac40004380 con 0x7fac500d2300 2023-07-14T13:12:47.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.245+0000 7fac3effd640 1 --2- 172.21.15.5:0/2759389699 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fac30066430 0x7fac300688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:47.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.245+0000 7fac3effd640 1 -- 172.21.15.5:0/2759389699 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6434+0+0 (secure 0 0 0) 0x7fac4011e370 con 0x7fac500d2300 2023-07-14T13:12:47.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.245+0000 7fac4dd9b640 1 -- 172.21.15.5:0/2759389699 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fac30066430 msgr2=0x7fac300688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/4272779335 2023-07-14T13:12:47.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.245+0000 7fac4dd9b640 1 --2- 172.21.15.5:0/2759389699 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fac30066430 0x7fac300688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:12:47.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.249+0000 7fac3effd640 1 -- 172.21.15.5:0/2759389699 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fac400eb520 con 0x7fac500d2300 2023-07-14T13:12:47.300 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:47.265+0000 7effdfcd2180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:12:47.332 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:47.301+0000 7f1861fa6180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:12:47.392 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:47.361+0000 7f1861fa6180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:12:47.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.369+0000 7fac3effd640 1 -- 172.21.15.5:0/2759389699 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 68) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fac400eb8f0 con 0x7fac500d2300 2023-07-14T13:12:47.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.369+0000 7fac3effd640 1 -- 172.21.15.5:0/2759389699 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fac30066430 msgr2=0x7fac300688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:12:47.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.369+0000 7fac3effd640 1 --2- 172.21.15.5:0/2759389699 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fac30066430 0x7fac300688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.409+0000 7fac54d96640 1 -- 172.21.15.5:0/2759389699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac50073040 con 0x7fac500d2300 2023-07-14T13:12:47.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.409+0000 7fac3effd640 1 -- 172.21.15.5:0/2759389699 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v144) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac400bf440 con 0x7fac500d2300 2023-07-14T13:12:47.446 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:12:47.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.413+0000 7fac54d96640 1 -- 172.21.15.5:0/2759389699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac500d2300 msgr2=0x7fac50157880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:47.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.413+0000 7fac54d96640 1 --2- 172.21.15.5:0/2759389699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac500d2300 0x7fac50157880 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fac400ad040 tx=0x7fac4001ad40 comp rx=0 tx=0).stop 2023-07-14T13:12:47.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.413+0000 7fac54d96640 1 -- 172.21.15.5:0/2759389699 shutdown_connections 2023-07-14T13:12:47.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.413+0000 7fac54d96640 1 --2- 172.21.15.5:0/2759389699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac5015bde0 0x7fac5006afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.413+0000 7fac54d96640 1 --2- 172.21.15.5:0/2759389699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac500d2fc0 0x7fac500b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.413+0000 7fac54d96640 1 --2- 172.21.15.5:0/2759389699 >> [v2:172.21.15.154:6832/4272779335,v1:172.21.15.154:6833/4272779335] conn(0x7fac30066430 0x7fac300688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.413+0000 7fac54d96640 1 --2- 172.21.15.5:0/2759389699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fac500d2300 0x7fac50157880 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.413+0000 7fac54d96640 1 -- 172.21.15.5:0/2759389699 >> 172.21.15.5:0/2759389699 conn(0x7fac500659d0 msgr2=0x7fac5015ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:47.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.413+0000 7fac54d96640 1 -- 172.21.15.5:0/2759389699 shutdown_connections 2023-07-14T13:12:47.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.413+0000 7fac54d96640 1 -- 172.21.15.5:0/2759389699 wait complete. 2023-07-14T13:12:47.470 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:12:47.471 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:47.441+0000 7f17ea82b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:47.471 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:47.441+0000 7f17ea82b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:47.471 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:47.441+0000 7f17ea82b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:47.471 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:47.441+0000 7f17ea82b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:47.472 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:47.441+0000 7f17ea82b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:47.473 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:47.441+0000 7f17ee032640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:47.473 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:47.441+0000 7f17ee032640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:47.473 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:47.441+0000 7f17ee032640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:47.473 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:47.441+0000 7f17ee032640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:47.473 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:12:47.441+0000 7f17ee032640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:12:47.605 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:47.569+0000 7effdfcd2180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:12:47.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.585+0000 7f70a1940640 1 Processor -- start 2023-07-14T13:12:47.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.585+0000 7f70a1940640 1 -- start start 2023-07-14T13:12:47.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.585+0000 7f70a1940640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f709c0cba60 0x7f709c0c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:47.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.585+0000 7f70a1940640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f709c1590a0 0x7f709c159930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:47.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.585+0000 7f70a1940640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709c0c37e0 con 0x7f709c15b9c0 2023-07-14T13:12:47.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.585+0000 7f70a1940640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709c0c3ac0 con 0x7f709c1590a0 2023-07-14T13:12:47.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.585+0000 7f70a1940640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709c0c3da0 con 0x7f709c0cba60 2023-07-14T13:12:47.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.585+0000 7f7093fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f709c15b9c0 0x7f709c0cbe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49832/0 (socket says 172.21.15.5:49832) 2023-07-14T13:12:47.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.585+0000 7f7093fff640 1 -- 172.21.15.5:0/1712695460 learned_addr learned my addr 172.21.15.5:0/1712695460 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:47.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.585+0000 7f709b7fe640 1 --2- 172.21.15.5:0/1712695460 >> v2:172.21.15.5:3300/0 conn(0x7f709c1590a0 0x7f709c159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:47.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.585+0000 7f709affd640 1 --2- 172.21.15.5:0/1712695460 >> v2:172.21.15.154:3300/0 conn(0x7f709c0cba60 0x7f709c0c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:47.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.585+0000 7f709a7fc640 1 -- 172.21.15.5:0/1712695460 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2571381946 0 0) 0x7f709c0c37e0 con 0x7f709c15b9c0 2023-07-14T13:12:47.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.585+0000 7f709a7fc640 1 -- 172.21.15.5:0/1712695460 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7088003530 con 0x7f709c15b9c0 2023-07-14T13:12:47.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.585+0000 7f709b7fe640 1 -- 172.21.15.5:0/1712695460 >> v2:172.21.15.154:3300/0 conn(0x7f709c0cba60 msgr2=0x7f709c0c3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:47.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.585+0000 7f709b7fe640 1 --2- 172.21.15.5:0/1712695460 >> v2:172.21.15.154:3300/0 conn(0x7f709c0cba60 0x7f709c0c3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.585+0000 7f709b7fe640 1 -- 172.21.15.5:0/1712695460 >> v1:172.21.15.5:6789/0 conn(0x7f709c15b9c0 legacy=0x7f709c0cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:47.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.585+0000 7f709b7fe640 1 -- 172.21.15.5:0/1712695460 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709c0c4080 con 0x7f709c1590a0 2023-07-14T13:12:47.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.589+0000 7f709b7fe640 1 --2- 172.21.15.5:0/1712695460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f709c1590a0 0x7f709c159930 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f709c0cba10 tx=0x7f709401c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1d9fd6295c0a88 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:47.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.589+0000 7f709a7fc640 1 -- 172.21.15.5:0/1712695460 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70940a58d0 con 0x7f709c1590a0 2023-07-14T13:12:47.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.589+0000 7f709a7fc640 1 -- 172.21.15.5:0/1712695460 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70940a5a30 con 0x7f709c1590a0 2023-07-14T13:12:47.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.589+0000 7f709a7fc640 1 -- 172.21.15.5:0/1712695460 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70940a5dc0 con 0x7f709c1590a0 2023-07-14T13:12:47.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.593+0000 7f70a1940640 1 -- 172.21.15.5:0/1712695460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f709c1590a0 msgr2=0x7f709c159930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:47.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.593+0000 7f70a1940640 1 --2- 172.21.15.5:0/1712695460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f709c1590a0 0x7f709c159930 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f709c0cba10 tx=0x7f709401c7b0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.593+0000 7f70a1940640 1 -- 172.21.15.5:0/1712695460 shutdown_connections 2023-07-14T13:12:47.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.593+0000 7f70a1940640 1 --2- 172.21.15.5:0/1712695460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f709c1590a0 0x7f709c159930 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.593+0000 7f70a1940640 1 --2- 172.21.15.5:0/1712695460 >> v2:172.21.15.154:3300/0 conn(0x7f709c0cba60 0x7f709c0c3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.593+0000 7f70a1940640 1 -- 172.21.15.5:0/1712695460 >> 172.21.15.5:0/1712695460 conn(0x7f709c0cde90 msgr2=0x7f709c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:47.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.593+0000 7f70a1940640 1 -- 172.21.15.5:0/1712695460 shutdown_connections 2023-07-14T13:12:47.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.593+0000 7f70a1940640 1 -- 172.21.15.5:0/1712695460 wait complete. 2023-07-14T13:12:47.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.593+0000 7f70a1940640 1 Processor -- start 2023-07-14T13:12:47.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.593+0000 7f70a1940640 1 -- start start 2023-07-14T13:12:47.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.593+0000 7f70a1940640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f709c0cba60 0x7f709c149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:47.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.593+0000 7f70a1940640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f709c1590a0 0x7f709c148b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:47.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.593+0000 7f70a1940640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f709c15b9c0 0x7f709c06c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:47.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.593+0000 7f70a1940640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c14be70 con 0x7f709c0cba60 2023-07-14T13:12:47.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.593+0000 7f70a1940640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c14c6d0 con 0x7f709c15b9c0 2023-07-14T13:12:47.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.593+0000 7f70a1940640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709c149540 con 0x7f709c1590a0 2023-07-14T13:12:47.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.593+0000 7f709affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f709c0cba60 0x7f709c149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:47.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.593+0000 7f709affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f709c0cba60 0x7f709c149820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59406/0 (socket says 172.21.15.5:59406) 2023-07-14T13:12:47.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.593+0000 7f709affd640 1 -- 172.21.15.5:0/2832997845 learned_addr learned my addr 172.21.15.5:0/2832997845 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:47.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.593+0000 7f709b7fe640 1 --2- 172.21.15.5:0/2832997845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f709c15b9c0 0x7f709c06c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:47.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.597+0000 7f7093fff640 1 --2- 172.21.15.5:0/2832997845 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f709c1590a0 0x7f709c148b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:47.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.597+0000 7f709affd640 1 -- 172.21.15.5:0/2832997845 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f709c1590a0 msgr2=0x7f709c148b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:47.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.597+0000 7f709affd640 1 --2- 172.21.15.5:0/2832997845 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f709c1590a0 0x7f709c148b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.597+0000 7f709affd640 1 -- 172.21.15.5:0/2832997845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f709c15b9c0 msgr2=0x7f709c06c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:47.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.597+0000 7f709affd640 1 --2- 172.21.15.5:0/2832997845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f709c15b9c0 0x7f709c06c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.597+0000 7f709affd640 1 -- 172.21.15.5:0/2832997845 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7094009a70 con 0x7f709c0cba60 2023-07-14T13:12:47.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.597+0000 7f709affd640 1 --2- 172.21.15.5:0/2832997845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f709c0cba60 0x7f709c149820 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f708c00e930 tx=0x7f708c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:47.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.597+0000 7f7098ff9640 1 -- 172.21.15.5:0/2832997845 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c009690 con 0x7f709c0cba60 2023-07-14T13:12:47.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.597+0000 7f7098ff9640 1 -- 172.21.15.5:0/2832997845 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708c00ca00 con 0x7f709c0cba60 2023-07-14T13:12:47.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.597+0000 7f7098ff9640 1 -- 172.21.15.5:0/2832997845 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c00cd70 con 0x7f709c0cba60 2023-07-14T13:12:47.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.597+0000 7f70a1940640 1 -- 172.21.15.5:0/2832997845 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709c14c080 con 0x7f709c0cba60 2023-07-14T13:12:47.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.597+0000 7f70a1940640 1 -- 172.21.15.5:0/2832997845 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709c14d600 con 0x7f709c0cba60 2023-07-14T13:12:47.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.597+0000 7f70a1940640 1 -- 172.21.15.5:0/2832997845 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f709c0714b0 con 0x7f709c0cba60 2023-07-14T13:12:47.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.597+0000 7f7098ff9640 1 -- 172.21.15.5:0/2832997845 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 68) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f708c013470 con 0x7f709c0cba60 2023-07-14T13:12:47.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.597+0000 7f7098ff9640 1 -- 172.21.15.5:0/2832997845 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f708c084050 con 0x7f709c0cba60 2023-07-14T13:12:47.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.605+0000 7f7098ff9640 1 -- 172.21.15.5:0/2832997845 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f708c051790 con 0x7f709c0cba60 2023-07-14T13:12:47.677 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:12:47.641+0000 7effdfcd2180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:12:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.765+0000 7f70a1940640 1 -- 172.21.15.5:0/2832997845 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f709c0678d0 con 0x7f709c0cba60 2023-07-14T13:12:47.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.765+0000 7f7098ff9640 1 -- 172.21.15.5:0/2832997845 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v144) v1 ==== 92+0+10 (secure 0 0 0) 0x7f708c054db0 con 0x7f709c0cba60 2023-07-14T13:12:47.803 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:12:47.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.769+0000 7f70a1940640 1 -- 172.21.15.5:0/2832997845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f709c0cba60 msgr2=0x7f709c149820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:47.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.769+0000 7f70a1940640 1 --2- 172.21.15.5:0/2832997845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f709c0cba60 0x7f709c149820 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f708c00e930 tx=0x7f708c00edf0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.769+0000 7f70a1940640 1 -- 172.21.15.5:0/2832997845 shutdown_connections 2023-07-14T13:12:47.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.769+0000 7f70a1940640 1 --2- 172.21.15.5:0/2832997845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f709c15b9c0 0x7f709c06c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.769+0000 7f70a1940640 1 --2- 172.21.15.5:0/2832997845 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f709c1590a0 0x7f709c148b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.769+0000 7f70a1940640 1 --2- 172.21.15.5:0/2832997845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f709c0cba60 0x7f709c149820 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.769+0000 7f70a1940640 1 -- 172.21.15.5:0/2832997845 >> 172.21.15.5:0/2832997845 conn(0x7f709c0cde90 msgr2=0x7f709c0ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:47.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.769+0000 7f70a1940640 1 -- 172.21.15.5:0/2832997845 shutdown_connections 2023-07-14T13:12:47.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.769+0000 7f70a1940640 1 -- 172.21.15.5:0/2832997845 wait complete. 2023-07-14T13:12:47.823 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T13:12:47.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.937+0000 7fa77d66d640 1 Processor -- start 2023-07-14T13:12:47.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.937+0000 7fa77d66d640 1 -- start start 2023-07-14T13:12:47.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.937+0000 7fa77d66d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa7780d2fc0 0x7fa7780b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:47.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.937+0000 7fa77d66d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7780b04c0 con 0x7fa7780d2300 2023-07-14T13:12:47.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.937+0000 7fa77d66d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7780d0aa0 con 0x7fa77815bde0 2023-07-14T13:12:47.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.937+0000 7fa77d66d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa77815c1b0 con 0x7fa7780d2fc0 2023-07-14T13:12:47.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.937+0000 7fa7777fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa7780d2300 0x7fa7780cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49846/0 (socket says 172.21.15.5:49846) 2023-07-14T13:12:47.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.937+0000 7fa7777fe640 1 -- 172.21.15.5:0/2527374814 learned_addr learned my addr 172.21.15.5:0/2527374814 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:47.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.937+0000 7fa76ffff640 1 --2- 172.21.15.5:0/2527374814 >> v2:172.21.15.154:3300/0 conn(0x7fa7780d2fc0 0x7fa7780b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:47.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.937+0000 7fa7767fc640 1 -- 172.21.15.5:0/2527374814 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 873945994 0 0) 0x7fa7780b04c0 con 0x7fa7780d2300 2023-07-14T13:12:47.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.937+0000 7fa7767fc640 1 -- 172.21.15.5:0/2527374814 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa764003530 con 0x7fa7780d2300 2023-07-14T13:12:47.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.937+0000 7fa76ffff640 1 -- 172.21.15.5:0/2527374814 >> v1:172.21.15.154:6789/0 conn(0x7fa77815bde0 legacy=0x7fa7780d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:47.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.937+0000 7fa76ffff640 1 -- 172.21.15.5:0/2527374814 >> v1:172.21.15.5:6789/0 conn(0x7fa7780d2300 legacy=0x7fa7780cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:47.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.937+0000 7fa76ffff640 1 -- 172.21.15.5:0/2527374814 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7780afb90 con 0x7fa7780d2fc0 2023-07-14T13:12:47.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.941+0000 7fa76ffff640 1 --2- 172.21.15.5:0/2527374814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7780d2fc0 0x7fa7780b0950 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa7600097c0 tx=0x7fa76001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fbb63c4703ac347 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:47.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.941+0000 7fa7767fc640 1 -- 172.21.15.5:0/2527374814 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7600ab680 con 0x7fa7780d2fc0 2023-07-14T13:12:47.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.941+0000 7fa7767fc640 1 -- 172.21.15.5:0/2527374814 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7600ab7e0 con 0x7fa7780d2fc0 2023-07-14T13:12:47.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.941+0000 7fa7767fc640 1 -- 172.21.15.5:0/2527374814 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7600abb50 con 0x7fa7780d2fc0 2023-07-14T13:12:47.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.941+0000 7fa77d66d640 1 -- 172.21.15.5:0/2527374814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7780d2fc0 msgr2=0x7fa7780b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:47.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.941+0000 7fa77d66d640 1 --2- 172.21.15.5:0/2527374814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7780d2fc0 0x7fa7780b0950 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa7600097c0 tx=0x7fa76001c480 comp rx=0 tx=0).stop 2023-07-14T13:12:47.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.941+0000 7fa77d66d640 1 -- 172.21.15.5:0/2527374814 shutdown_connections 2023-07-14T13:12:47.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.941+0000 7fa77d66d640 1 --2- 172.21.15.5:0/2527374814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7780d2fc0 0x7fa7780b0950 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.941+0000 7fa77d66d640 1 -- 172.21.15.5:0/2527374814 >> 172.21.15.5:0/2527374814 conn(0x7fa7780659d0 msgr2=0x7fa77809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:47.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.941+0000 7fa77d66d640 1 -- 172.21.15.5:0/2527374814 shutdown_connections 2023-07-14T13:12:47.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.941+0000 7fa77d66d640 1 -- 172.21.15.5:0/2527374814 wait complete. 2023-07-14T13:12:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.945+0000 7fa77d66d640 1 Processor -- start 2023-07-14T13:12:47.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.945+0000 7fa77d66d640 1 -- start start 2023-07-14T13:12:47.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.945+0000 7fa77d66d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7780d2300 0x7fa77814fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:47.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.945+0000 7fa77d66d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7780d2fc0 0x7fa7781f8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:47.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.945+0000 7fa77d66d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa77815bde0 0x7fa7781f8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:47.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.945+0000 7fa77d66d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa778150590 con 0x7fa7780d2300 2023-07-14T13:12:47.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.945+0000 7fa77d66d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7780b31a0 con 0x7fa77815bde0 2023-07-14T13:12:47.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.945+0000 7fa77d66d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77814ec60 con 0x7fa7780d2fc0 2023-07-14T13:12:47.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.945+0000 7fa776ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7780d2300 0x7fa77814fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:47.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.945+0000 7fa776ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7780d2300 0x7fa77814fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59410/0 (socket says 172.21.15.5:59410) 2023-07-14T13:12:47.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.945+0000 7fa776ffd640 1 -- 172.21.15.5:0/2279785111 learned_addr learned my addr 172.21.15.5:0/2279785111 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:47.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.945+0000 7fa7777fe640 1 --2- 172.21.15.5:0/2279785111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa77815bde0 0x7fa7781f8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:47.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.945+0000 7fa76ffff640 1 --2- 172.21.15.5:0/2279785111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7780d2fc0 0x7fa7781f8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:47.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.945+0000 7fa776ffd640 1 -- 172.21.15.5:0/2279785111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7780d2fc0 msgr2=0x7fa7781f8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:47.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.945+0000 7fa776ffd640 1 --2- 172.21.15.5:0/2279785111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7780d2fc0 0x7fa7781f8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.945+0000 7fa776ffd640 1 -- 172.21.15.5:0/2279785111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa77815bde0 msgr2=0x7fa7781f8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:47.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.945+0000 7fa776ffd640 1 --2- 172.21.15.5:0/2279785111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa77815bde0 0x7fa7781f8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:47.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.945+0000 7fa776ffd640 1 -- 172.21.15.5:0/2279785111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa760009420 con 0x7fa7780d2300 2023-07-14T13:12:47.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.945+0000 7fa776ffd640 1 --2- 172.21.15.5:0/2279785111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7780d2300 0x7fa77814fce0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fa76800c400 tx=0x7fa76800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:47.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.945+0000 7fa76f7fe640 1 -- 172.21.15.5:0/2279785111 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7680052d0 con 0x7fa7780d2300 2023-07-14T13:12:47.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.945+0000 7fa76f7fe640 1 -- 172.21.15.5:0/2279785111 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa768005470 con 0x7fa7780d2300 2023-07-14T13:12:47.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.945+0000 7fa76f7fe640 1 -- 172.21.15.5:0/2279785111 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768006a70 con 0x7fa7780d2300 2023-07-14T13:12:47.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.945+0000 7fa77d66d640 1 -- 172.21.15.5:0/2279785111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa77814ef40 con 0x7fa7780d2300 2023-07-14T13:12:47.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.945+0000 7fa77d66d640 1 -- 172.21.15.5:0/2279785111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa77814f500 con 0x7fa7780d2300 2023-07-14T13:12:47.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.949+0000 7fa77d66d640 1 -- 172.21.15.5:0/2279785111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7780678d0 con 0x7fa7780d2300 2023-07-14T13:12:47.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.949+0000 7fa76f7fe640 1 -- 172.21.15.5:0/2279785111 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 68) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fa768006bd0 con 0x7fa7780d2300 2023-07-14T13:12:47.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.949+0000 7fa76f7fe640 1 -- 172.21.15.5:0/2279785111 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6821+0+0 (secure 0 0 0) 0x7fa768082e90 con 0x7fa7780d2300 2023-07-14T13:12:47.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:47.953+0000 7fa76f7fe640 1 -- 172.21.15.5:0/2279785111 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa768050510 con 0x7fa7780d2300 2023-07-14T13:12:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.109+0000 7fa77d66d640 1 -- 172.21.15.5:0/2279785111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa7780cf9b0 con 0x7fa7780d2300 2023-07-14T13:12:48.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.109+0000 7fa76f7fe640 1 -- 172.21.15.5:0/2279785111 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v144) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa768053b30 con 0x7fa7780d2300 2023-07-14T13:12:48.146 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T13:12:48.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.109+0000 7fa77d66d640 1 -- 172.21.15.5:0/2279785111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7780d2300 msgr2=0x7fa77814fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:48.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.109+0000 7fa77d66d640 1 --2- 172.21.15.5:0/2279785111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7780d2300 0x7fa77814fce0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fa76800c400 tx=0x7fa76800c8c0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.109+0000 7fa77d66d640 1 -- 172.21.15.5:0/2279785111 shutdown_connections 2023-07-14T13:12:48.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.109+0000 7fa77d66d640 1 --2- 172.21.15.5:0/2279785111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa77815bde0 0x7fa7781f8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.109+0000 7fa77d66d640 1 --2- 172.21.15.5:0/2279785111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7780d2fc0 0x7fa7781f8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.109+0000 7fa77d66d640 1 --2- 172.21.15.5:0/2279785111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7780d2300 0x7fa77814fce0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.109+0000 7fa77d66d640 1 -- 172.21.15.5:0/2279785111 >> 172.21.15.5:0/2279785111 conn(0x7fa7780659d0 msgr2=0x7fa7780cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:48.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.113+0000 7fa77d66d640 1 -- 172.21.15.5:0/2279785111 shutdown_connections 2023-07-14T13:12:48.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.113+0000 7fa77d66d640 1 -- 172.21.15.5:0/2279785111 wait complete. 2023-07-14T13:12:48.166 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T13:12:48.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.277+0000 7f663c700640 1 Processor -- start 2023-07-14T13:12:48.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.277+0000 7f663c700640 1 -- start start 2023-07-14T13:12:48.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.277+0000 7f663c700640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6634069430 0x7f66340cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.277+0000 7f663c700640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6634160030 0x7f6634069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.277+0000 7f663c700640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6634069d40 con 0x7f6634070330 2023-07-14T13:12:48.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.277+0000 7f663c700640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66340cb7d0 con 0x7f6634160030 2023-07-14T13:12:48.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.277+0000 7f663c700640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663406c510 con 0x7f6634069430 2023-07-14T13:12:48.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.277+0000 7f6639c9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6634160030 0x7f6634069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.277+0000 7f663a49c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6634069430 0x7f66340cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.277+0000 7f6639c9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6634160030 0x7f6634069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:33444/0 (socket says 172.21.15.5:33444) 2023-07-14T13:12:48.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.277+0000 7f663ac9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6634070330 0x7f66340707b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:53288/0 (socket says 172.21.15.5:53288) 2023-07-14T13:12:48.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.277+0000 7f6639c9b640 1 -- 172.21.15.5:0/1840819119 learned_addr learned my addr 172.21.15.5:0/1840819119 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:48.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.281+0000 7f6639c9b640 1 -- 172.21.15.5:0/1840819119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6634069430 msgr2=0x7f66340cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:48.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.281+0000 7f6639c9b640 1 --2- 172.21.15.5:0/1840819119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6634069430 0x7f66340cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.281+0000 7f6639c9b640 1 -- 172.21.15.5:0/1840819119 >> v1:172.21.15.154:6789/0 conn(0x7f6634070330 legacy=0x7f66340707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:48.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.281+0000 7f6639c9b640 1 -- 172.21.15.5:0/1840819119 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663406c7f0 con 0x7f6634160030 2023-07-14T13:12:48.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.281+0000 7f6639c9b640 1 --2- 172.21.15.5:0/1840819119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6634160030 0x7f6634069800 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f6624009870 tx=0x7f662401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4be3e4578dba1c3c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:48.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.281+0000 7f663949a640 1 -- 172.21.15.5:0/1840819119 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66240ab680 con 0x7f6634160030 2023-07-14T13:12:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.281+0000 7f663949a640 1 -- 172.21.15.5:0/1840819119 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66240ab7e0 con 0x7f6634160030 2023-07-14T13:12:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.281+0000 7f663949a640 1 -- 172.21.15.5:0/1840819119 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66240abb70 con 0x7f6634160030 2023-07-14T13:12:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.281+0000 7f663c700640 1 -- 172.21.15.5:0/1840819119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6634160030 msgr2=0x7f6634069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:48.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.281+0000 7f663c700640 1 --2- 172.21.15.5:0/1840819119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6634160030 0x7f6634069800 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f6624009870 tx=0x7f662401c480 comp rx=0 tx=0).stop 2023-07-14T13:12:48.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.285+0000 7f663c700640 1 -- 172.21.15.5:0/1840819119 shutdown_connections 2023-07-14T13:12:48.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.285+0000 7f663c700640 1 --2- 172.21.15.5:0/1840819119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6634160030 0x7f6634069800 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.285+0000 7f663c700640 1 --2- 172.21.15.5:0/1840819119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6634069430 0x7f66340cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.285+0000 7f663c700640 1 -- 172.21.15.5:0/1840819119 >> 172.21.15.5:0/1840819119 conn(0x7f66340b1840 msgr2=0x7f66340cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.285+0000 7f663c700640 1 -- 172.21.15.5:0/1840819119 shutdown_connections 2023-07-14T13:12:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.285+0000 7f663c700640 1 -- 172.21.15.5:0/1840819119 wait complete. 2023-07-14T13:12:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.285+0000 7f663c700640 1 Processor -- start 2023-07-14T13:12:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.285+0000 7f663c700640 1 -- start start 2023-07-14T13:12:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.285+0000 7f663c700640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6634069430 0x7f66340c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.285+0000 7f663c700640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6634070330 0x7f6634156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.285+0000 7f663c700640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6634160030 0x7f66341f7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.285+0000 7f663c700640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66340cd250 con 0x7f6634069430 2023-07-14T13:12:48.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.285+0000 7f663c700640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6634156fe0 con 0x7f6634160030 2023-07-14T13:12:48.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.285+0000 7f663c700640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66341572c0 con 0x7f6634070330 2023-07-14T13:12:48.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.285+0000 7f663a49c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6634069430 0x7f66340c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.285+0000 7f663a49c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6634069430 0x7f66340c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59412/0 (socket says 172.21.15.5:59412) 2023-07-14T13:12:48.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.285+0000 7f663a49c640 1 -- 172.21.15.5:0/436183285 learned_addr learned my addr 172.21.15.5:0/436183285 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:48.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.285+0000 7f6639c9b640 1 --2- 172.21.15.5:0/436183285 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6634070330 0x7f6634156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.285+0000 7f663ac9d640 1 --2- 172.21.15.5:0/436183285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6634160030 0x7f66341f7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.285+0000 7f663a49c640 1 -- 172.21.15.5:0/436183285 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6634070330 msgr2=0x7f6634156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:48.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.285+0000 7f663a49c640 1 --2- 172.21.15.5:0/436183285 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6634070330 0x7f6634156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.285+0000 7f663a49c640 1 -- 172.21.15.5:0/436183285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6634160030 msgr2=0x7f66341f7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:48.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.285+0000 7f663a49c640 1 --2- 172.21.15.5:0/436183285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6634160030 0x7f66341f7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.285+0000 7f663a49c640 1 -- 172.21.15.5:0/436183285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66240094d0 con 0x7f6634069430 2023-07-14T13:12:48.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.285+0000 7f663a49c640 1 --2- 172.21.15.5:0/436183285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6634069430 0x7f66340c6540 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f663000e870 tx=0x7f663000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:48.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.289+0000 7f662affd640 1 -- 172.21.15.5:0/436183285 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6630009510 con 0x7f6634069430 2023-07-14T13:12:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.289+0000 7f662affd640 1 -- 172.21.15.5:0/436183285 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663000eec0 con 0x7f6634069430 2023-07-14T13:12:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.289+0000 7f662affd640 1 -- 172.21.15.5:0/436183285 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663000cb40 con 0x7f6634069430 2023-07-14T13:12:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.289+0000 7f663c700640 1 -- 172.21.15.5:0/436183285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66341575a0 con 0x7f6634069430 2023-07-14T13:12:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.289+0000 7f663c700640 1 -- 172.21.15.5:0/436183285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6634156cd0 con 0x7f6634069430 2023-07-14T13:12:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.289+0000 7f663c700640 1 -- 172.21.15.5:0/436183285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66340678d0 con 0x7f6634069430 2023-07-14T13:12:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.289+0000 7f662affd640 1 -- 172.21.15.5:0/436183285 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 68) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f663000cca0 con 0x7f6634069430 2023-07-14T13:12:48.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.289+0000 7f662affd640 1 -- 172.21.15.5:0/436183285 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f6630083c20 con 0x7f6634069430 2023-07-14T13:12:48.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.293+0000 7f662affd640 1 -- 172.21.15.5:0/436183285 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f66300511b0 con 0x7f6634069430 2023-07-14T13:12:48.377 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:12:48.383 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:12:48.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.373+0000 7f662affd640 1 -- 172.21.15.5:0/436183285 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 69) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f6630050c60 con 0x7f6634069430 2023-07-14T13:12:48.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.373+0000 7f662affd640 1 --2- 172.21.15.5:0/436183285 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f661806c0f0 0x7f661806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.373+0000 7f6639c9b640 1 --2- 172.21.15.5:0/436183285 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f661806c0f0 0x7f661806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.377+0000 7f6639c9b640 1 --2- 172.21.15.5:0/436183285 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f661806c0f0 0x7f661806e4d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f66240af000 tx=0x7f66240a7000 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:48.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.453+0000 7f663c700640 1 -- 172.21.15.5:0/436183285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f66340cf820 con 0x7f6634069430 2023-07-14T13:12:48.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.453+0000 7f662affd640 1 -- 172.21.15.5:0/436183285 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v144) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6630080b30 con 0x7f6634069430 2023-07-14T13:12:48.491 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T13:12:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.457+0000 7f663c700640 1 -- 172.21.15.5:0/436183285 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f661806c0f0 msgr2=0x7f661806e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.457+0000 7f663c700640 1 --2- 172.21.15.5:0/436183285 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f661806c0f0 0x7f661806e4d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f66240af000 tx=0x7f66240a7000 comp rx=0 tx=0).stop 2023-07-14T13:12:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.457+0000 7f663c700640 1 -- 172.21.15.5:0/436183285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6634069430 msgr2=0x7f66340c6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:48.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.457+0000 7f663c700640 1 --2- 172.21.15.5:0/436183285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6634069430 0x7f66340c6540 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f663000e870 tx=0x7f663000ec70 comp rx=0 tx=0).stop 2023-07-14T13:12:48.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.457+0000 7f663c700640 1 -- 172.21.15.5:0/436183285 shutdown_connections 2023-07-14T13:12:48.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.457+0000 7f663c700640 1 --2- 172.21.15.5:0/436183285 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f661806c0f0 0x7f661806e4d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.457+0000 7f663c700640 1 --2- 172.21.15.5:0/436183285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6634160030 0x7f66341f7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.457+0000 7f663c700640 1 --2- 172.21.15.5:0/436183285 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6634070330 0x7f6634156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.457+0000 7f663c700640 1 --2- 172.21.15.5:0/436183285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6634069430 0x7f66340c6540 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.457+0000 7f663c700640 1 -- 172.21.15.5:0/436183285 >> 172.21.15.5:0/436183285 conn(0x7f66340b1840 msgr2=0x7f66340afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:48.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.457+0000 7f663c700640 1 -- 172.21.15.5:0/436183285 shutdown_connections 2023-07-14T13:12:48.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.457+0000 7f663c700640 1 -- 172.21.15.5:0/436183285 wait complete. 2023-07-14T13:12:48.511 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:12:48.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.617+0000 7fc2f8d37640 1 Processor -- start 2023-07-14T13:12:48.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.617+0000 7fc2f8d37640 1 -- start start 2023-07-14T13:12:48.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.621+0000 7fc2f8d37640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc2f40c8ad0 0x7fc2f40c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.621+0000 7fc2f8d37640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2f40c9560 0x7fc2f40ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.621+0000 7fc2f8d37640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f40cc700 con 0x7fc2f4158ce0 2023-07-14T13:12:48.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.621+0000 7fc2f8d37640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f40c99e0 con 0x7fc2f40c8ad0 2023-07-14T13:12:48.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.621+0000 7fc2f8d37640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f40b0ff0 con 0x7fc2f40c9560 2023-07-14T13:12:48.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.621+0000 7fc2f259c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc2f4158ce0 0x7fc2f4070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49848/0 (socket says 172.21.15.5:49848) 2023-07-14T13:12:48.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.621+0000 7fc2f259c640 1 -- 172.21.15.5:0/945815833 learned_addr learned my addr 172.21.15.5:0/945815833 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:48.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.621+0000 7fc2ebfff640 1 --2- 172.21.15.5:0/945815833 >> v2:172.21.15.154:3300/0 conn(0x7fc2f40c8ad0 0x7fc2f40c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.621+0000 7fc2f2d9d640 1 --2- 172.21.15.5:0/945815833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2f40c9560 0x7fc2f40ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.621+0000 7fc2f1d9b640 1 -- 172.21.15.5:0/945815833 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3156878231 0 0) 0x7fc2f40cc700 con 0x7fc2f4158ce0 2023-07-14T13:12:48.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.621+0000 7fc2f1d9b640 1 -- 172.21.15.5:0/945815833 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2e0003530 con 0x7fc2f4158ce0 2023-07-14T13:12:48.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.621+0000 7fc2f2d9d640 1 -- 172.21.15.5:0/945815833 >> v2:172.21.15.154:3300/0 conn(0x7fc2f40c8ad0 msgr2=0x7fc2f40c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:48.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.621+0000 7fc2f2d9d640 1 --2- 172.21.15.5:0/945815833 >> v2:172.21.15.154:3300/0 conn(0x7fc2f40c8ad0 0x7fc2f40c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.621+0000 7fc2f2d9d640 1 -- 172.21.15.5:0/945815833 >> v1:172.21.15.5:6789/0 conn(0x7fc2f4158ce0 legacy=0x7fc2f4070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:48.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.621+0000 7fc2f2d9d640 1 -- 172.21.15.5:0/945815833 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f4070c80 con 0x7fc2f40c9560 2023-07-14T13:12:48.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.621+0000 7fc2ebfff640 1 --2- 172.21.15.5:0/945815833 >> v2:172.21.15.154:3300/0 conn(0x7fc2f40c8ad0 0x7fc2f40c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:48.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.625+0000 7fc2f2d9d640 1 --2- 172.21.15.5:0/945815833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2f40c9560 0x7fc2f40ccb90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec009d90 tx=0x7fc2ec01ea10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=979759cf44b78b85 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:48.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.625+0000 7fc2f1d9b640 1 -- 172.21.15.5:0/945815833 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec0a79f0 con 0x7fc2f40c9560 2023-07-14T13:12:48.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.625+0000 7fc2f1d9b640 1 -- 172.21.15.5:0/945815833 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ec0a7b50 con 0x7fc2f40c9560 2023-07-14T13:12:48.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.625+0000 7fc2f1d9b640 1 -- 172.21.15.5:0/945815833 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec0af440 con 0x7fc2f40c9560 2023-07-14T13:12:48.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.625+0000 7fc2f8d37640 1 -- 172.21.15.5:0/945815833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2f40c9560 msgr2=0x7fc2f40ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:48.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.625+0000 7fc2f8d37640 1 --2- 172.21.15.5:0/945815833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2f40c9560 0x7fc2f40ccb90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec009d90 tx=0x7fc2ec01ea10 comp rx=0 tx=0).stop 2023-07-14T13:12:48.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.625+0000 7fc2f8d37640 1 -- 172.21.15.5:0/945815833 shutdown_connections 2023-07-14T13:12:48.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.625+0000 7fc2f8d37640 1 --2- 172.21.15.5:0/945815833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2f40c9560 0x7fc2f40ccb90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.625+0000 7fc2f8d37640 1 --2- 172.21.15.5:0/945815833 >> v2:172.21.15.154:3300/0 conn(0x7fc2f40c8ad0 0x7fc2f40c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.625+0000 7fc2f8d37640 1 -- 172.21.15.5:0/945815833 >> 172.21.15.5:0/945815833 conn(0x7fc2f40afcf0 msgr2=0x7fc2f40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:48.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.625+0000 7fc2f8d37640 1 -- 172.21.15.5:0/945815833 shutdown_connections 2023-07-14T13:12:48.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.625+0000 7fc2f8d37640 1 -- 172.21.15.5:0/945815833 wait complete. 2023-07-14T13:12:48.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.629+0000 7fc2f8d37640 1 Processor -- start 2023-07-14T13:12:48.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.629+0000 7fc2f8d37640 1 -- start start 2023-07-14T13:12:48.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.629+0000 7fc2f8d37640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2f40c8ad0 0x7fc2f41f7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.629+0000 7fc2f8d37640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2f40c9560 0x7fc2f4145590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.629+0000 7fc2f8d37640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f4158ce0 0x7fc2f4147200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.629+0000 7fc2f8d37640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f414bad0 con 0x7fc2f4158ce0 2023-07-14T13:12:48.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.629+0000 7fc2f8d37640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f41f8190 con 0x7fc2f40c9560 2023-07-14T13:12:48.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.629+0000 7fc2f8d37640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f4143ad0 con 0x7fc2f40c8ad0 2023-07-14T13:12:48.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.629+0000 7fc2f2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f4158ce0 0x7fc2f4147200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.629+0000 7fc2f2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f4158ce0 0x7fc2f4147200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59422/0 (socket says 172.21.15.5:59422) 2023-07-14T13:12:48.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.629+0000 7fc2f259c640 1 --2- 172.21.15.5:0/4170180223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2f40c8ad0 0x7fc2f41f7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.629+0000 7fc2f2d9d640 1 -- 172.21.15.5:0/4170180223 learned_addr learned my addr 172.21.15.5:0/4170180223 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:48.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.629+0000 7fc2ebfff640 1 --2- 172.21.15.5:0/4170180223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2f40c9560 0x7fc2f4145590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.629+0000 7fc2f2d9d640 1 -- 172.21.15.5:0/4170180223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2f40c8ad0 msgr2=0x7fc2f41f7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:48.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.629+0000 7fc2f2d9d640 1 --2- 172.21.15.5:0/4170180223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2f40c8ad0 0x7fc2f41f7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.629+0000 7fc2f2d9d640 1 -- 172.21.15.5:0/4170180223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2f40c9560 msgr2=0x7fc2f4145590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:48.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.629+0000 7fc2f2d9d640 1 --2- 172.21.15.5:0/4170180223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2f40c9560 0x7fc2f4145590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.629+0000 7fc2f2d9d640 1 -- 172.21.15.5:0/4170180223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc009420 con 0x7fc2f4158ce0 2023-07-14T13:12:48.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.629+0000 7fc2f2d9d640 1 --2- 172.21.15.5:0/4170180223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f4158ce0 0x7fc2f4147200 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0b2040 tx=0x7fc2ec01b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:48.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.629+0000 7fc2eaffd640 1 -- 172.21.15.5:0/4170180223 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec0a79f0 con 0x7fc2f4158ce0 2023-07-14T13:12:48.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.629+0000 7fc2eaffd640 1 -- 172.21.15.5:0/4170180223 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ec0afa60 con 0x7fc2f4158ce0 2023-07-14T13:12:48.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.629+0000 7fc2eaffd640 1 -- 172.21.15.5:0/4170180223 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec0afdf0 con 0x7fc2f4158ce0 2023-07-14T13:12:48.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.629+0000 7fc2f8d37640 1 -- 172.21.15.5:0/4170180223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ec009a70 con 0x7fc2f4158ce0 2023-07-14T13:12:48.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.629+0000 7fc2f8d37640 1 -- 172.21.15.5:0/4170180223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f4144090 con 0x7fc2f4158ce0 2023-07-14T13:12:48.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.633+0000 7fc2f8d37640 1 -- 172.21.15.5:0/4170180223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f40ca1a0 con 0x7fc2f4158ce0 2023-07-14T13:12:48.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.633+0000 7fc2eaffd640 1 -- 172.21.15.5:0/4170180223 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 69) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fc2ec0b6070 con 0x7fc2f4158ce0 2023-07-14T13:12:48.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.633+0000 7fc2eaffd640 1 --2- 172.21.15.5:0/4170180223 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fc2d40660d0 0x7fc2d4068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.633+0000 7fc2eaffd640 1 -- 172.21.15.5:0/4170180223 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6821+0+0 (secure 0 0 0) 0x7fc2ec11e8e0 con 0x7fc2f4158ce0 2023-07-14T13:12:48.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.633+0000 7fc2f259c640 1 --2- 172.21.15.5:0/4170180223 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fc2d40660d0 0x7fc2d4068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.633+0000 7fc2f259c640 1 --2- 172.21.15.5:0/4170180223 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fc2d40660d0 0x7fc2d4068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40011f0 tx=0x7fc2e4007d40 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:48.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.637+0000 7fc2eaffd640 1 -- 172.21.15.5:0/4170180223 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc2ec0ebd80 con 0x7fc2f4158ce0 2023-07-14T13:12:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.825+0000 7fc2f8d37640 1 -- 172.21.15.5:0/4170180223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2f40678d0 con 0x7fc2f4158ce0 2023-07-14T13:12:48.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.825+0000 7fc2eaffd640 1 -- 172.21.15.5:0/4170180223 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4711 (secure 0 0 0) 0x7fc2ec0ef3a0 con 0x7fc2f4158ce0 2023-07-14T13:12:48.862 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:48.862 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7373,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3424293950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3424293950},{"type":"v1","addr":"172.21.15.5:6834","nonce":3424293950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7379,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/1672977104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1672977104},{"type":"v1","addr":"172.21.15.154:6836","nonce":1672977104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":8401,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2517721716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2517721716},{"type":"v1","addr":"172.21.15.154:6837","nonce":2517721716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:12:23.316419+0000","modified":"2023-07-14T13:12:26.932428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8808},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8808":{"gid":8808,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/4283823156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":4283823156},{"type":"v1","addr":"172.21.15.5:6835","nonce":4283823156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-14T13:12:48.863 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 65 2023-07-14T13:12:48.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.825+0000 7fc2f8d37640 1 -- 172.21.15.5:0/4170180223 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fc2d40660d0 msgr2=0x7fc2d4068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:48.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.825+0000 7fc2f8d37640 1 --2- 172.21.15.5:0/4170180223 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fc2d40660d0 0x7fc2d4068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40011f0 tx=0x7fc2e4007d40 comp rx=0 tx=0).stop 2023-07-14T13:12:48.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.825+0000 7fc2f8d37640 1 -- 172.21.15.5:0/4170180223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f4158ce0 msgr2=0x7fc2f4147200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:48.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.825+0000 7fc2f8d37640 1 --2- 172.21.15.5:0/4170180223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f4158ce0 0x7fc2f4147200 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0b2040 tx=0x7fc2ec01b7b0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.825+0000 7fc2f8d37640 1 -- 172.21.15.5:0/4170180223 shutdown_connections 2023-07-14T13:12:48.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.825+0000 7fc2f8d37640 1 --2- 172.21.15.5:0/4170180223 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fc2d40660d0 0x7fc2d4068580 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.825+0000 7fc2f8d37640 1 --2- 172.21.15.5:0/4170180223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f4158ce0 0x7fc2f4147200 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.825+0000 7fc2f8d37640 1 --2- 172.21.15.5:0/4170180223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2f40c9560 0x7fc2f4145590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.825+0000 7fc2f8d37640 1 --2- 172.21.15.5:0/4170180223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc2f40c8ad0 0x7fc2f41f7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.829+0000 7fc2f8d37640 1 -- 172.21.15.5:0/4170180223 >> 172.21.15.5:0/4170180223 conn(0x7fc2f40afcf0 msgr2=0x7fc2f406b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.829+0000 7fc2f8d37640 1 -- 172.21.15.5:0/4170180223 shutdown_connections 2023-07-14T13:12:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.829+0000 7fc2f8d37640 1 -- 172.21.15.5:0/4170180223 wait complete. 2023-07-14T13:12:48.883 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:12:49.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.989+0000 7f68c8d82640 1 Processor -- start 2023-07-14T13:12:49.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.989+0000 7f68c8d82640 1 -- start start 2023-07-14T13:12:49.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.993+0000 7f68c8d82640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f68c4158ce0 0x7f68c4070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:49.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.993+0000 7f68c8d82640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c40cc700 con 0x7f68c40c9730 2023-07-14T13:12:49.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.993+0000 7f68c8d82640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c40b0ff0 con 0x7f68c40c8ad0 2023-07-14T13:12:49.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.993+0000 7f68c8d82640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c4070c80 con 0x7f68c4158ce0 2023-07-14T13:12:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.993+0000 7f68c2d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f68c40c9730 0x7f68c40ccb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49856/0 (socket says 172.21.15.5:49856) 2023-07-14T13:12:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.993+0000 7f68c2d9d640 1 -- 172.21.15.5:0/1302336184 learned_addr learned my addr 172.21.15.5:0/1302336184 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.993+0000 7f68c259c640 1 --2- 172.21.15.5:0/1302336184 >> v2:172.21.15.154:3300/0 conn(0x7f68c4158ce0 0x7f68c4070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.993+0000 7f68c1d9b640 1 -- 172.21.15.5:0/1302336184 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963465674 0 0) 0x7f68c40cc700 con 0x7f68c40c9730 2023-07-14T13:12:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.993+0000 7f68c1d9b640 1 -- 172.21.15.5:0/1302336184 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68b0003530 con 0x7f68c40c9730 2023-07-14T13:12:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.993+0000 7f68c259c640 1 -- 172.21.15.5:0/1302336184 >> v1:172.21.15.154:6789/0 conn(0x7f68c40c8ad0 legacy=0x7f68c40c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:49.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.993+0000 7f68c259c640 1 -- 172.21.15.5:0/1302336184 >> v1:172.21.15.5:6789/0 conn(0x7f68c40c9730 legacy=0x7f68c40ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:49.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.993+0000 7f68c259c640 1 -- 172.21.15.5:0/1302336184 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c40cbdd0 con 0x7f68c4158ce0 2023-07-14T13:12:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.997+0000 7f68c259c640 1 --2- 172.21.15.5:0/1302336184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68c4158ce0 0x7f68c4070450 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f68b40097c0 tx=0x7f68b401c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f757b6236192a09c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.997+0000 7f68c1d9b640 1 -- 172.21.15.5:0/1302336184 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b40ab600 con 0x7f68c4158ce0 2023-07-14T13:12:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.997+0000 7f68c1d9b640 1 -- 172.21.15.5:0/1302336184 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b40a7050 con 0x7f68c4158ce0 2023-07-14T13:12:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.997+0000 7f68c1d9b640 1 -- 172.21.15.5:0/1302336184 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b40ab960 con 0x7f68c4158ce0 2023-07-14T13:12:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.997+0000 7f68c8d82640 1 -- 172.21.15.5:0/1302336184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68c4158ce0 msgr2=0x7f68c4070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.997+0000 7f68c8d82640 1 --2- 172.21.15.5:0/1302336184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68c4158ce0 0x7f68c4070450 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f68b40097c0 tx=0x7f68b401c330 comp rx=0 tx=0).stop 2023-07-14T13:12:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.997+0000 7f68c8d82640 1 -- 172.21.15.5:0/1302336184 shutdown_connections 2023-07-14T13:12:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.997+0000 7f68c8d82640 1 --2- 172.21.15.5:0/1302336184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68c4158ce0 0x7f68c4070450 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.997+0000 7f68c8d82640 1 -- 172.21.15.5:0/1302336184 >> 172.21.15.5:0/1302336184 conn(0x7f68c40afcf0 msgr2=0x7f68c40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.997+0000 7f68c8d82640 1 -- 172.21.15.5:0/1302336184 shutdown_connections 2023-07-14T13:12:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.997+0000 7f68c8d82640 1 -- 172.21.15.5:0/1302336184 wait complete. 2023-07-14T13:12:49.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.997+0000 7f68c8d82640 1 Processor -- start 2023-07-14T13:12:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:48.997+0000 7f68c8d82640 1 -- start start 2023-07-14T13:12:49.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.001+0000 7f68c8d82640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68c40c8ad0 0x7f68c415bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:49.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.001+0000 7f68c8d82640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68c40c9730 0x7f68c40c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:49.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.001+0000 7f68c8d82640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68c4158ce0 0x7f68c414d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:49.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.001+0000 7f68c8d82640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c4157d70 con 0x7f68c40c8ad0 2023-07-14T13:12:49.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.001+0000 7f68c8d82640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c40c38a0 con 0x7f68c40c9730 2023-07-14T13:12:49.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.001+0000 7f68c8d82640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c414c590 con 0x7f68c4158ce0 2023-07-14T13:12:49.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.001+0000 7f68c259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68c40c8ad0 0x7f68c415bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:49.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.001+0000 7f68c259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68c40c8ad0 0x7f68c415bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59438/0 (socket says 172.21.15.5:59438) 2023-07-14T13:12:49.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.001+0000 7f68c259c640 1 -- 172.21.15.5:0/872650247 learned_addr learned my addr 172.21.15.5:0/872650247 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:49.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.001+0000 7f68bbfff640 1 --2- 172.21.15.5:0/872650247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68c40c9730 0x7f68c40c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:49.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.001+0000 7f68c2d9d640 1 --2- 172.21.15.5:0/872650247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68c4158ce0 0x7f68c414d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:49.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.001+0000 7f68c259c640 1 -- 172.21.15.5:0/872650247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68c4158ce0 msgr2=0x7f68c414d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.001+0000 7f68c259c640 1 --2- 172.21.15.5:0/872650247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68c4158ce0 0x7f68c414d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.001+0000 7f68c259c640 1 -- 172.21.15.5:0/872650247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68c40c9730 msgr2=0x7f68c40c3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.001+0000 7f68c259c640 1 --2- 172.21.15.5:0/872650247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68c40c9730 0x7f68c40c3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.001+0000 7f68c259c640 1 -- 172.21.15.5:0/872650247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b4009420 con 0x7f68c40c8ad0 2023-07-14T13:12:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.001+0000 7f68c2d9d640 1 --2- 172.21.15.5:0/872650247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68c4158ce0 0x7f68c414d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:12:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.001+0000 7f68c259c640 1 --2- 172.21.15.5:0/872650247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68c40c8ad0 0x7f68c415bdb0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f68b401c810 tx=0x7f68b40190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.001+0000 7f68baffd640 1 -- 172.21.15.5:0/872650247 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b4003af0 con 0x7f68c40c8ad0 2023-07-14T13:12:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.001+0000 7f68baffd640 1 -- 172.21.15.5:0/872650247 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b4003c50 con 0x7f68c40c8ad0 2023-07-14T13:12:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.001+0000 7f68baffd640 1 -- 172.21.15.5:0/872650247 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b40b5410 con 0x7f68c40c8ad0 2023-07-14T13:12:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.001+0000 7f68c8d82640 1 -- 172.21.15.5:0/872650247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c414c870 con 0x7f68c40c8ad0 2023-07-14T13:12:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.001+0000 7f68c8d82640 1 -- 172.21.15.5:0/872650247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c414ce30 con 0x7f68c40c8ad0 2023-07-14T13:12:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.001+0000 7f68c8d82640 1 -- 172.21.15.5:0/872650247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c40ca1a0 con 0x7f68c40c8ad0 2023-07-14T13:12:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.001+0000 7f68baffd640 1 -- 172.21.15.5:0/872650247 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 69) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f68b40b2050 con 0x7f68c40c8ad0 2023-07-14T13:12:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.005+0000 7f68baffd640 1 --2- 172.21.15.5:0/872650247 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f68a40660d0 0x7f68a4068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.005+0000 7f68baffd640 1 -- 172.21.15.5:0/872650247 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f68b411e240 con 0x7f68c40c8ad0 2023-07-14T13:12:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.005+0000 7f68bbfff640 1 --2- 172.21.15.5:0/872650247 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f68a40660d0 0x7f68a4068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.005+0000 7f68bbfff640 1 --2- 172.21.15.5:0/872650247 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f68a40660d0 0x7f68a4068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f68c41f7cb0 tx=0x7f68ac009040 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:49.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.009+0000 7f68baffd640 1 -- 172.21.15.5:0/872650247 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f68b40eb630 con 0x7f68c40c8ad0 2023-07-14T13:12:49.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.165+0000 7f68c8d82640 1 -- 172.21.15.5:0/872650247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68c40678d0 con 0x7f68c40c8ad0 2023-07-14T13:12:49.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.165+0000 7f68baffd640 1 -- 172.21.15.5:0/872650247 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+19436 (secure 0 0 0) 0x7f68b40eec50 con 0x7f68c40c8ad0 2023-07-14T13:12:49.204 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:49.204 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":144,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:12:47.362827+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:12:21.430786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-14T13:12:22.293915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/3874881932":"2023-07-15T13:12:47.362773+0000","172.21.15.154:6833/4272779335":"2023-07-15T13:12:47.362773+0000","172.21.15.154:6832/4272779335":"2023-07-15T13:12:47.362773+0000","172.21.15.154:0/1669723697":"2023-07-15T13:12:47.362773+0000","172.21.15.154:0/142605868":"2023-07-15T13:12:47.362773+0000","172.21.15.154:0/1963306512":"2023-07-15T13:12:47.362773+0000","172.21.15.154:0/2411764460":"2023-07-15T13:12:40.543160+0000","172.21.15.154:0/88866958":"2023-07-15T13:12:47.362773+0000","172.21.15.154:0/2631868727":"2023-07-15T13:12:47.362773+0000","172.21.15.154:0/2264156620":"2023-07-15T13:12:40.543160+0000","172.21.15.154:0/4093515681":"2023-07-15T13:12:40.543160+0000","172.21.15.154:0/1036989288":"2023-07-15T13:12:40.543160+0000","172.21.15.154:0/3525194571":"2023-07-15T13:12:40.543160+0000","172.21.15.154:6833/3769132865":"2023-07-15T13:12:40.543160+0000","172.21.15.154:6832/3769132865":"2023-07-15T13:12:40.543160+0000","172.21.15.154:0/4077908301":"2023-07-15T13:12:47.362773+0000","172.21.15.154:0/1560509459":"2023-07-15T13:12:40.543160+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:12:49.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.169+0000 7f68c8d82640 1 -- 172.21.15.5:0/872650247 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f68a40660d0 msgr2=0x7f68a4068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:49.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.169+0000 7f68c8d82640 1 --2- 172.21.15.5:0/872650247 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f68a40660d0 0x7f68a4068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f68c41f7cb0 tx=0x7f68ac009040 comp rx=0 tx=0).stop 2023-07-14T13:12:49.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.169+0000 7f68c8d82640 1 -- 172.21.15.5:0/872650247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68c40c8ad0 msgr2=0x7f68c415bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:49.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.169+0000 7f68c8d82640 1 --2- 172.21.15.5:0/872650247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68c40c8ad0 0x7f68c415bdb0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f68b401c810 tx=0x7f68b40190d0 comp rx=0 tx=0).stop 2023-07-14T13:12:49.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.169+0000 7f68c8d82640 1 -- 172.21.15.5:0/872650247 shutdown_connections 2023-07-14T13:12:49.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.169+0000 7f68c8d82640 1 --2- 172.21.15.5:0/872650247 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f68a40660d0 0x7f68a4068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:49.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.169+0000 7f68c8d82640 1 --2- 172.21.15.5:0/872650247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68c4158ce0 0x7f68c414d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:49.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.169+0000 7f68c8d82640 1 --2- 172.21.15.5:0/872650247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68c40c9730 0x7f68c40c3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:49.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.169+0000 7f68c8d82640 1 --2- 172.21.15.5:0/872650247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68c40c8ad0 0x7f68c415bdb0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:49.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.169+0000 7f68c8d82640 1 -- 172.21.15.5:0/872650247 >> 172.21.15.5:0/872650247 conn(0x7f68c40afcf0 msgr2=0x7f68c40b1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:49.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.169+0000 7f68c8d82640 1 -- 172.21.15.5:0/872650247 shutdown_connections 2023-07-14T13:12:49.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.169+0000 7f68c8d82640 1 -- 172.21.15.5:0/872650247 wait complete. 2023-07-14T13:12:49.225 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-14T13:12:49.226 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:12:49.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.333+0000 7f098affa640 1 Processor -- start 2023-07-14T13:12:49.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.333+0000 7f098affa640 1 -- start start 2023-07-14T13:12:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.337+0000 7f098affa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0984145430 0x7f09840b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.337+0000 7f098affa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09840b39f0 0x7f09840d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.337+0000 7f098affa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09840b2140 con 0x7f09840d06b0 2023-07-14T13:12:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.337+0000 7f098affa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09840b2410 con 0x7f09840b39f0 2023-07-14T13:12:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.337+0000 7f098affa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09840b26f0 con 0x7f0984145430 2023-07-14T13:12:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.337+0000 7f0988d96640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f09840d06b0 0x7f09840b1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37604/0 (socket says 172.21.15.5:37604) 2023-07-14T13:12:49.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.337+0000 7f0988d96640 1 -- 172.21.15.5:0/2284716571 learned_addr learned my addr 172.21.15.5:0/2284716571 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:49.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.337+0000 7f0989597640 1 --2- 172.21.15.5:0/2284716571 >> v2:172.21.15.5:3300/0 conn(0x7f09840b39f0 0x7f09840d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:49.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.337+0000 7f0983fff640 1 --2- 172.21.15.5:0/2284716571 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0984145430 0x7f09840b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:49.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.337+0000 7f0989597640 1 -- 172.21.15.5:0/2284716571 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0984145430 msgr2=0x7f09840b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.337+0000 7f0989597640 1 --2- 172.21.15.5:0/2284716571 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0984145430 0x7f09840b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.337+0000 7f0989597640 1 -- 172.21.15.5:0/2284716571 >> v1:172.21.15.5:6789/0 conn(0x7f09840d06b0 legacy=0x7f09840b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.337+0000 7f0989597640 1 -- 172.21.15.5:0/2284716571 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09840b29d0 con 0x7f09840b39f0 2023-07-14T13:12:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.337+0000 7f0983fff640 1 --2- 172.21.15.5:0/2284716571 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0984145430 0x7f09840b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.337+0000 7f09837fe640 1 -- 172.21.15.5:0/2284716571 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865546919 0 0) 0x7f09840b2140 con 0x7f09840d06b0 2023-07-14T13:12:49.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.337+0000 7f0989597640 1 --2- 172.21.15.5:0/2284716571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09840b39f0 0x7f09840d22e0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f097c009d90 tx=0x7f097c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1d26d8374ec2fe server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:49.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.337+0000 7f09837fe640 1 -- 172.21.15.5:0/2284716571 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c0a58f0 con 0x7f09840b39f0 2023-07-14T13:12:49.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.341+0000 7f09837fe640 1 -- 172.21.15.5:0/2284716571 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097c0a5a50 con 0x7f09840b39f0 2023-07-14T13:12:49.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.341+0000 7f09837fe640 1 -- 172.21.15.5:0/2284716571 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c0a5de0 con 0x7f09840b39f0 2023-07-14T13:12:49.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.341+0000 7f098affa640 1 -- 172.21.15.5:0/2284716571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09840b39f0 msgr2=0x7f09840d22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:49.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.341+0000 7f098affa640 1 --2- 172.21.15.5:0/2284716571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09840b39f0 0x7f09840d22e0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f097c009d90 tx=0x7f097c01c920 comp rx=0 tx=0).stop 2023-07-14T13:12:49.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.341+0000 7f098affa640 1 -- 172.21.15.5:0/2284716571 shutdown_connections 2023-07-14T13:12:49.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.341+0000 7f098affa640 1 --2- 172.21.15.5:0/2284716571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09840b39f0 0x7f09840d22e0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:49.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.341+0000 7f098affa640 1 --2- 172.21.15.5:0/2284716571 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0984145430 0x7f09840b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:49.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.341+0000 7f098affa640 1 -- 172.21.15.5:0/2284716571 >> 172.21.15.5:0/2284716571 conn(0x7f09840659d0 msgr2=0x7f098409b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:49.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.341+0000 7f098affa640 1 -- 172.21.15.5:0/2284716571 shutdown_connections 2023-07-14T13:12:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.341+0000 7f098affa640 1 -- 172.21.15.5:0/2284716571 wait complete. 2023-07-14T13:12:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.341+0000 7f098affa640 1 Processor -- start 2023-07-14T13:12:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.341+0000 7f098affa640 1 -- start start 2023-07-14T13:12:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.341+0000 7f098affa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09840b39f0 0x7f098415d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.341+0000 7f098affa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09840d06b0 0x7f098415ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.341+0000 7f098affa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09840b5180 0x7f0984156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.341+0000 7f098affa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09840c8b00 con 0x7f09840b39f0 2023-07-14T13:12:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.341+0000 7f098affa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09840c90c0 con 0x7f09840d06b0 2023-07-14T13:12:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.341+0000 7f098affa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09840b5bc0 con 0x7f09840b5180 2023-07-14T13:12:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.341+0000 7f0988d96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09840b39f0 0x7f098415d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.341+0000 7f0988d96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09840b39f0 0x7f098415d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51160/0 (socket says 172.21.15.5:51160) 2023-07-14T13:12:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.341+0000 7f0988d96640 1 -- 172.21.15.5:0/1017481622 learned_addr learned my addr 172.21.15.5:0/1017481622 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.345+0000 7f0989597640 1 --2- 172.21.15.5:0/1017481622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09840b5180 0x7f0984156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.345+0000 7f0983fff640 1 --2- 172.21.15.5:0/1017481622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09840d06b0 0x7f098415ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.345+0000 7f0988d96640 1 -- 172.21.15.5:0/1017481622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09840b5180 msgr2=0x7f0984156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.345+0000 7f0988d96640 1 --2- 172.21.15.5:0/1017481622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09840b5180 0x7f0984156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.345+0000 7f0988d96640 1 -- 172.21.15.5:0/1017481622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09840d06b0 msgr2=0x7f098415ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.345+0000 7f0988d96640 1 --2- 172.21.15.5:0/1017481622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09840d06b0 0x7f098415ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.345+0000 7f0988d96640 1 -- 172.21.15.5:0/1017481622 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c009a70 con 0x7f09840b39f0 2023-07-14T13:12:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.345+0000 7f0988d96640 1 --2- 172.21.15.5:0/1017481622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09840b39f0 0x7f098415d990 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f09780011f0 tx=0x7f097800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.345+0000 7f09817fa640 1 -- 172.21.15.5:0/1017481622 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09780074e0 con 0x7f09840b39f0 2023-07-14T13:12:49.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.345+0000 7f09817fa640 1 -- 172.21.15.5:0/1017481622 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0978007640 con 0x7f09840b39f0 2023-07-14T13:12:49.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.345+0000 7f09817fa640 1 -- 172.21.15.5:0/1017481622 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978004a10 con 0x7f09840b39f0 2023-07-14T13:12:49.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.345+0000 7f098affa640 1 -- 172.21.15.5:0/1017481622 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09840b5ea0 con 0x7f09840b39f0 2023-07-14T13:12:49.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.345+0000 7f098affa640 1 -- 172.21.15.5:0/1017481622 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098415e600 con 0x7f09840b39f0 2023-07-14T13:12:49.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.345+0000 7f098affa640 1 -- 172.21.15.5:0/1017481622 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0984072e70 con 0x7f09840b39f0 2023-07-14T13:12:49.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.345+0000 7f09817fa640 1 -- 172.21.15.5:0/1017481622 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 69) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f0978004b70 con 0x7f09840b39f0 2023-07-14T13:12:49.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.349+0000 7f09817fa640 1 --2- 172.21.15.5:0/1017481622 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f0968066100 0x7f09680685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:49.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.349+0000 7f09817fa640 1 -- 172.21.15.5:0/1017481622 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f0978082ed0 con 0x7f09840b39f0 2023-07-14T13:12:49.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.349+0000 7f0983fff640 1 --2- 172.21.15.5:0/1017481622 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f0968066100 0x7f09680685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:49.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.349+0000 7f0983fff640 1 --2- 172.21.15.5:0/1017481622 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f0968066100 0x7f09680685b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f098406ab80 tx=0x7f0970008040 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.349+0000 7f09817fa640 1 -- 172.21.15.5:0/1017481622 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f09780502c0 con 0x7f09840b39f0 2023-07-14T13:12:49.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.537+0000 7f098affa640 1 -- 172.21.15.5:0/1017481622 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09840678d0 con 0x7f09840b39f0 2023-07-14T13:12:49.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.537+0000 7f09817fa640 1 -- 172.21.15.5:0/1017481622 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4711 (secure 0 0 0) 0x7f0978018020 con 0x7f09840b39f0 2023-07-14T13:12:49.576 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:49.576 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7373,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3424293950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3424293950},{"type":"v1","addr":"172.21.15.5:6834","nonce":3424293950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7379,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/1672977104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1672977104},{"type":"v1","addr":"172.21.15.154:6836","nonce":1672977104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":8401,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2517721716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2517721716},{"type":"v1","addr":"172.21.15.154:6837","nonce":2517721716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:12:23.316419+0000","modified":"2023-07-14T13:12:26.932428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8808},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8808":{"gid":8808,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/4283823156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":4283823156},{"type":"v1","addr":"172.21.15.5:6835","nonce":4283823156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-14T13:12:49.576 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 65 2023-07-14T13:12:49.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.541+0000 7f098affa640 1 -- 172.21.15.5:0/1017481622 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f0968066100 msgr2=0x7f09680685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:49.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.541+0000 7f098affa640 1 --2- 172.21.15.5:0/1017481622 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f0968066100 0x7f09680685b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f098406ab80 tx=0x7f0970008040 comp rx=0 tx=0).stop 2023-07-14T13:12:49.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.541+0000 7f098affa640 1 -- 172.21.15.5:0/1017481622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09840b39f0 msgr2=0x7f098415d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:49.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.541+0000 7f098affa640 1 --2- 172.21.15.5:0/1017481622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09840b39f0 0x7f098415d990 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f09780011f0 tx=0x7f097800c9b0 comp rx=0 tx=0).stop 2023-07-14T13:12:49.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.541+0000 7f098affa640 1 -- 172.21.15.5:0/1017481622 shutdown_connections 2023-07-14T13:12:49.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.541+0000 7f098affa640 1 --2- 172.21.15.5:0/1017481622 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f0968066100 0x7f09680685b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:49.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.541+0000 7f098affa640 1 --2- 172.21.15.5:0/1017481622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09840b5180 0x7f0984156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:49.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.541+0000 7f098affa640 1 --2- 172.21.15.5:0/1017481622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09840d06b0 0x7f098415ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:49.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.541+0000 7f098affa640 1 --2- 172.21.15.5:0/1017481622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09840b39f0 0x7f098415d990 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:49.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.541+0000 7f098affa640 1 -- 172.21.15.5:0/1017481622 >> 172.21.15.5:0/1017481622 conn(0x7f09840659d0 msgr2=0x7f09841586d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:49.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.541+0000 7f098affa640 1 -- 172.21.15.5:0/1017481622 shutdown_connections 2023-07-14T13:12:49.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.541+0000 7f098affa640 1 -- 172.21.15.5:0/1017481622 wait complete. 2023-07-14T13:12:49.596 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:12:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.709+0000 7f27f53e9640 1 Processor -- start 2023-07-14T13:12:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.709+0000 7f27f53e9640 1 -- start start 2023-07-14T13:12:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.713+0000 7f27f53e9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27f00cc650 0x7f27f00c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.713+0000 7f27f53e9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27f006f7e0 0x7f27f006fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:49.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.713+0000 7f27f53e9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f00ccaa0 con 0x7f27f006c100 2023-07-14T13:12:49.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.713+0000 7f27f53e9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f00ccce0 con 0x7f27f006f7e0 2023-07-14T13:12:49.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.713+0000 7f27f53e9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00ccfc0 con 0x7f27f00cc650 2023-07-14T13:12:49.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.713+0000 7f27ef7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27f006f7e0 0x7f27f006fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:49.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.713+0000 7f27eeffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f27f006c100 0x7f27f006c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:45278/0 (socket says 172.21.15.5:45278) 2023-07-14T13:12:49.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.713+0000 7f27eeffd640 1 -- 172.21.15.5:0/39346840 learned_addr learned my addr 172.21.15.5:0/39346840 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:49.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.713+0000 7f27ee7fc640 1 --2- 172.21.15.5:0/39346840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27f00cc650 0x7f27f00c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:49.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.713+0000 7f27ef7fe640 1 -- 172.21.15.5:0/39346840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27f00cc650 msgr2=0x7f27f00c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:49.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.713+0000 7f27ef7fe640 1 --2- 172.21.15.5:0/39346840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27f00cc650 0x7f27f00c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.713+0000 7f27ef7fe640 1 -- 172.21.15.5:0/39346840 >> v1:172.21.15.154:6789/0 conn(0x7f27f006c100 legacy=0x7f27f006c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.713+0000 7f27ef7fe640 1 -- 172.21.15.5:0/39346840 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f00cd2a0 con 0x7f27f006f7e0 2023-07-14T13:12:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.713+0000 7f27edffb640 1 -- 172.21.15.5:0/39346840 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055442381 0 0) 0x7f27e0001120 con 0x7f27f006c100 2023-07-14T13:12:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.717+0000 7f27ef7fe640 1 --2- 172.21.15.5:0/39346840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f006f7e0 0x7f27f006fc50 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009d90 tx=0x7f27e801f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b30c4f7b0e3e32c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.717+0000 7f27edffb640 1 -- 172.21.15.5:0/39346840 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e80af600 con 0x7f27f006f7e0 2023-07-14T13:12:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.717+0000 7f27edffb640 1 -- 172.21.15.5:0/39346840 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e80ab050 con 0x7f27f006f7e0 2023-07-14T13:12:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.717+0000 7f27edffb640 1 -- 172.21.15.5:0/39346840 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e80af980 con 0x7f27f006f7e0 2023-07-14T13:12:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.717+0000 7f27f53e9640 1 -- 172.21.15.5:0/39346840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f006f7e0 msgr2=0x7f27f006fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.717+0000 7f27f53e9640 1 --2- 172.21.15.5:0/39346840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f006f7e0 0x7f27f006fc50 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009d90 tx=0x7f27e801f130 comp rx=0 tx=0).stop 2023-07-14T13:12:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.717+0000 7f27f53e9640 1 -- 172.21.15.5:0/39346840 shutdown_connections 2023-07-14T13:12:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.717+0000 7f27f53e9640 1 --2- 172.21.15.5:0/39346840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f006f7e0 0x7f27f006fc50 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.717+0000 7f27f53e9640 1 --2- 172.21.15.5:0/39346840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27f00cc650 0x7f27f00c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.717+0000 7f27f53e9640 1 -- 172.21.15.5:0/39346840 >> 172.21.15.5:0/39346840 conn(0x7f27f00ce9d0 msgr2=0x7f27f00ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.717+0000 7f27f53e9640 1 -- 172.21.15.5:0/39346840 shutdown_connections 2023-07-14T13:12:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.717+0000 7f27f53e9640 1 -- 172.21.15.5:0/39346840 wait complete. 2023-07-14T13:12:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.717+0000 7f27f53e9640 1 Processor -- start 2023-07-14T13:12:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.717+0000 7f27f53e9640 1 -- start start 2023-07-14T13:12:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.721+0000 7f27f53e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f006c100 0x7f27f00b3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.721+0000 7f27f53e9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27f006f7e0 0x7f27f00c7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.721+0000 7f27f53e9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27f00cc650 0x7f27f014fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.721+0000 7f27f53e9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00b3ba0 con 0x7f27f006c100 2023-07-14T13:12:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.721+0000 7f27f53e9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00c6290 con 0x7f27f00cc650 2023-07-14T13:12:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.721+0000 7f27f53e9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00c6570 con 0x7f27f006f7e0 2023-07-14T13:12:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.721+0000 7f27eeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f006c100 0x7f27f00b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.721+0000 7f27eeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f006c100 0x7f27f00b3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51190/0 (socket says 172.21.15.5:51190) 2023-07-14T13:12:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.721+0000 7f27eeffd640 1 -- 172.21.15.5:0/4064514897 learned_addr learned my addr 172.21.15.5:0/4064514897 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.721+0000 7f27ee7fc640 1 --2- 172.21.15.5:0/4064514897 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27f006f7e0 0x7f27f00c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:49.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.721+0000 7f27ef7fe640 1 --2- 172.21.15.5:0/4064514897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27f00cc650 0x7f27f014fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:49.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.721+0000 7f27eeffd640 1 -- 172.21.15.5:0/4064514897 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27f006f7e0 msgr2=0x7f27f00c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:49.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.721+0000 7f27eeffd640 1 --2- 172.21.15.5:0/4064514897 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27f006f7e0 0x7f27f00c7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:49.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.721+0000 7f27eeffd640 1 -- 172.21.15.5:0/4064514897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27f00cc650 msgr2=0x7f27f014fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:49.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.721+0000 7f27eeffd640 1 --2- 172.21.15.5:0/4064514897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27f00cc650 0x7f27f014fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:49.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.721+0000 7f27eeffd640 1 -- 172.21.15.5:0/4064514897 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e8009a70 con 0x7f27f006c100 2023-07-14T13:12:49.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.721+0000 7f27eeffd640 1 --2- 172.21.15.5:0/4064514897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f006c100 0x7f27f00b3660 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f27e000c780 tx=0x7f27e000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:49.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.721+0000 7f27d77fe640 1 -- 172.21.15.5:0/4064514897 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e00072d0 con 0x7f27f006c100 2023-07-14T13:12:49.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.721+0000 7f27d77fe640 1 -- 172.21.15.5:0/4064514897 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e0007450 con 0x7f27f006c100 2023-07-14T13:12:49.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.721+0000 7f27d77fe640 1 -- 172.21.15.5:0/4064514897 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e00047f0 con 0x7f27f006c100 2023-07-14T13:12:49.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.721+0000 7f27f53e9640 1 -- 172.21.15.5:0/4064514897 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f00c6850 con 0x7f27f006c100 2023-07-14T13:12:49.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.721+0000 7f27f53e9640 1 -- 172.21.15.5:0/4064514897 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f00c6e10 con 0x7f27f006c100 2023-07-14T13:12:49.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.721+0000 7f27f53e9640 1 -- 172.21.15.5:0/4064514897 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f00c7000 con 0x7f27f006c100 2023-07-14T13:12:49.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.721+0000 7f27d77fe640 1 -- 172.21.15.5:0/4064514897 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f27e0004950 con 0x7f27f006c100 2023-07-14T13:12:49.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.725+0000 7f27d77fe640 1 --2- 172.21.15.5:0/4064514897 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f27dc0663d0 0x7f27dc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:49.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.725+0000 7f27d77fe640 1 -- 172.21.15.5:0/4064514897 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f27e0083180 con 0x7f27f006c100 2023-07-14T13:12:49.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.725+0000 7f27ee7fc640 1 --2- 172.21.15.5:0/4064514897 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f27dc0663d0 0x7f27dc068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:49.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.725+0000 7f27ee7fc640 1 --2- 172.21.15.5:0/4064514897 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f27dc0663d0 0x7f27dc068880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f27f006bcf0 tx=0x7f27e4006f90 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:49.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.729+0000 7f27d77fe640 1 -- 172.21.15.5:0/4064514897 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f27e0050200 con 0x7f27f006c100 2023-07-14T13:12:49.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.913+0000 7f27f53e9640 1 -- 172.21.15.5:0/4064514897 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27f00ccaa0 con 0x7f27f006c100 2023-07-14T13:12:49.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.913+0000 7f27d77fe640 1 -- 172.21.15.5:0/4064514897 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4711 (secure 0 0 0) 0x7f27f00ccaa0 con 0x7f27f006c100 2023-07-14T13:12:49.951 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:49.951 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7373,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3424293950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3424293950},{"type":"v1","addr":"172.21.15.5:6834","nonce":3424293950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7379,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/1672977104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1672977104},{"type":"v1","addr":"172.21.15.154:6836","nonce":1672977104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":8401,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2517721716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2517721716},{"type":"v1","addr":"172.21.15.154:6837","nonce":2517721716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:12:23.316419+0000","modified":"2023-07-14T13:12:26.932428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8808},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8808":{"gid":8808,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/4283823156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":4283823156},{"type":"v1","addr":"172.21.15.5:6835","nonce":4283823156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-14T13:12:49.952 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 65 2023-07-14T13:12:49.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.917+0000 7f27f53e9640 1 -- 172.21.15.5:0/4064514897 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f27dc0663d0 msgr2=0x7f27dc068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:49.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.917+0000 7f27f53e9640 1 --2- 172.21.15.5:0/4064514897 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f27dc0663d0 0x7f27dc068880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f27f006bcf0 tx=0x7f27e4006f90 comp rx=0 tx=0).stop 2023-07-14T13:12:49.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.917+0000 7f27f53e9640 1 -- 172.21.15.5:0/4064514897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f006c100 msgr2=0x7f27f00b3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:49.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.917+0000 7f27f53e9640 1 --2- 172.21.15.5:0/4064514897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f006c100 0x7f27f00b3660 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f27e000c780 tx=0x7f27e000cc40 comp rx=0 tx=0).stop 2023-07-14T13:12:49.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.917+0000 7f27f53e9640 1 -- 172.21.15.5:0/4064514897 shutdown_connections 2023-07-14T13:12:49.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.917+0000 7f27f53e9640 1 --2- 172.21.15.5:0/4064514897 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f27dc0663d0 0x7f27dc068880 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:49.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.917+0000 7f27f53e9640 1 --2- 172.21.15.5:0/4064514897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27f00cc650 0x7f27f014fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:49.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.917+0000 7f27f53e9640 1 --2- 172.21.15.5:0/4064514897 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27f006f7e0 0x7f27f00c7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:49.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.917+0000 7f27f53e9640 1 --2- 172.21.15.5:0/4064514897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27f006c100 0x7f27f00b3660 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:49.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.917+0000 7f27f53e9640 1 -- 172.21.15.5:0/4064514897 >> 172.21.15.5:0/4064514897 conn(0x7f27f00ce9d0 msgr2=0x7f27f006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:49.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.917+0000 7f27f53e9640 1 -- 172.21.15.5:0/4064514897 shutdown_connections 2023-07-14T13:12:49.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:49.917+0000 7f27f53e9640 1 -- 172.21.15.5:0/4064514897 wait complete. 2023-07-14T13:12:49.973 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:12:50.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.081+0000 7f6a18e34640 1 Processor -- start 2023-07-14T13:12:50.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.081+0000 7f6a18e34640 1 -- start start 2023-07-14T13:12:50.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.081+0000 7f6a18e34640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a14158ce0 0x7f6a14070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:50.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.081+0000 7f6a18e34640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6a140c9730 0x7f6a140ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:50.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.081+0000 7f6a18e34640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a140cc700 con 0x7f6a140c8ad0 2023-07-14T13:12:50.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.081+0000 7f6a18e34640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a140b0ff0 con 0x7f6a140c9730 2023-07-14T13:12:50.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.081+0000 7f6a18e34640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a14070c80 con 0x7f6a14158ce0 2023-07-14T13:12:50.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.085+0000 7f6a1259c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a14158ce0 0x7f6a14070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:50.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.085+0000 7f6a12d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6a140c9730 0x7f6a140ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:50.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.085+0000 7f6a1259c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a14158ce0 0x7f6a14070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:49820/0 (socket says 172.21.15.5:49820) 2023-07-14T13:12:50.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.085+0000 7f6a1259c640 1 -- 172.21.15.5:0/4091138591 learned_addr learned my addr 172.21.15.5:0/4091138591 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:50.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.085+0000 7f6a12d9d640 1 -- 172.21.15.5:0/4091138591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a14158ce0 msgr2=0x7f6a14070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:50.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.085+0000 7f6a12d9d640 1 --2- 172.21.15.5:0/4091138591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a14158ce0 0x7f6a14070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:50.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.085+0000 7f6a12d9d640 1 -- 172.21.15.5:0/4091138591 >> v1:172.21.15.154:6789/0 conn(0x7f6a140c8ad0 legacy=0x7f6a140c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:50.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.085+0000 7f6a12d9d640 1 -- 172.21.15.5:0/4091138591 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a140cbdd0 con 0x7f6a140c9730 2023-07-14T13:12:50.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.085+0000 7f6a1259c640 1 --2- 172.21.15.5:0/4091138591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a14158ce0 0x7f6a14070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:50.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.085+0000 7f6a12d9d640 1 --2- 172.21.15.5:0/4091138591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a140c9730 0x7f6a140ccb90 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c009d90 tx=0x7f6a0c01c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=745da7798fc7553a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:50.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.085+0000 7f6a11d9b640 1 -- 172.21.15.5:0/4091138591 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c0a57d0 con 0x7f6a140c9730 2023-07-14T13:12:50.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.085+0000 7f6a11d9b640 1 -- 172.21.15.5:0/4091138591 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0c0a5930 con 0x7f6a140c9730 2023-07-14T13:12:50.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.085+0000 7f6a11d9b640 1 -- 172.21.15.5:0/4091138591 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c0a5cc0 con 0x7f6a140c9730 2023-07-14T13:12:50.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.089+0000 7f6a18e34640 1 -- 172.21.15.5:0/4091138591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a140c9730 msgr2=0x7f6a140ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:50.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.089+0000 7f6a18e34640 1 --2- 172.21.15.5:0/4091138591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a140c9730 0x7f6a140ccb90 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c009d90 tx=0x7f6a0c01c800 comp rx=0 tx=0).stop 2023-07-14T13:12:50.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.089+0000 7f6a18e34640 1 -- 172.21.15.5:0/4091138591 shutdown_connections 2023-07-14T13:12:50.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.089+0000 7f6a18e34640 1 --2- 172.21.15.5:0/4091138591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a140c9730 0x7f6a140ccb90 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:50.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.089+0000 7f6a18e34640 1 --2- 172.21.15.5:0/4091138591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a14158ce0 0x7f6a14070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:50.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.089+0000 7f6a18e34640 1 -- 172.21.15.5:0/4091138591 >> 172.21.15.5:0/4091138591 conn(0x7f6a140afcf0 msgr2=0x7f6a140b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:50.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.089+0000 7f6a18e34640 1 -- 172.21.15.5:0/4091138591 shutdown_connections 2023-07-14T13:12:50.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.089+0000 7f6a18e34640 1 -- 172.21.15.5:0/4091138591 wait complete. 2023-07-14T13:12:50.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.089+0000 7f6a18e34640 1 Processor -- start 2023-07-14T13:12:50.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.089+0000 7f6a18e34640 1 -- start start 2023-07-14T13:12:50.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.089+0000 7f6a18e34640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a140c8ad0 0x7f6a1413c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:50.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.089+0000 7f6a18e34640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a140c9730 0x7f6a140c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:50.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.089+0000 7f6a18e34640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a14158ce0 0x7f6a1414fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:50.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.089+0000 7f6a18e34640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a14139f00 con 0x7f6a14158ce0 2023-07-14T13:12:50.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.089+0000 7f6a18e34640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1413aa80 con 0x7f6a140c8ad0 2023-07-14T13:12:50.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.089+0000 7f6a18e34640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1413a150 con 0x7f6a140c9730 2023-07-14T13:12:50.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.089+0000 7f6a12d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a14158ce0 0x7f6a1414fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:50.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.089+0000 7f6a1259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a140c8ad0 0x7f6a1413c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:50.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.089+0000 7f6a1259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a140c8ad0 0x7f6a1413c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:54886/0 (socket says 172.21.15.5:54886) 2023-07-14T13:12:50.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.089+0000 7f6a1259c640 1 -- 172.21.15.5:0/2426281577 learned_addr learned my addr 172.21.15.5:0/2426281577 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:50.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.089+0000 7f6a12d9d640 1 --2- 172.21.15.5:0/2426281577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a14158ce0 0x7f6a1414fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51196/0 (socket says 172.21.15.5:51196) 2023-07-14T13:12:50.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.089+0000 7f6a09d9b640 1 --2- 172.21.15.5:0/2426281577 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a140c9730 0x7f6a140c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:50.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.093+0000 7f6a1259c640 1 -- 172.21.15.5:0/2426281577 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a140c9730 msgr2=0x7f6a140c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:50.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.093+0000 7f6a1259c640 1 --2- 172.21.15.5:0/2426281577 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a140c9730 0x7f6a140c1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:50.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.093+0000 7f6a1259c640 1 -- 172.21.15.5:0/2426281577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a14158ce0 msgr2=0x7f6a1414fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:50.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.093+0000 7f6a1259c640 1 --2- 172.21.15.5:0/2426281577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a14158ce0 0x7f6a1414fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:50.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.093+0000 7f6a1259c640 1 -- 172.21.15.5:0/2426281577 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a040094d0 con 0x7f6a140c8ad0 2023-07-14T13:12:50.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.093+0000 7f6a12d9d640 1 --2- 172.21.15.5:0/2426281577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a14158ce0 0x7f6a1414fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:50.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.093+0000 7f6a1259c640 1 --2- 172.21.15.5:0/2426281577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a140c8ad0 0x7f6a1413c870 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400e930 tx=0x7f6a0400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:50.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.093+0000 7f6a0b7fe640 1 -- 172.21.15.5:0/2426281577 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0400ca00 con 0x7f6a140c8ad0 2023-07-14T13:12:50.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.093+0000 7f6a0b7fe640 1 -- 172.21.15.5:0/2426281577 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0400cb60 con 0x7f6a140c8ad0 2023-07-14T13:12:50.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.093+0000 7f6a0b7fe640 1 -- 172.21.15.5:0/2426281577 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a04013470 con 0x7f6a140c8ad0 2023-07-14T13:12:50.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.093+0000 7f6a18e34640 1 -- 172.21.15.5:0/2426281577 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a0c009a70 con 0x7f6a140c8ad0 2023-07-14T13:12:50.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.093+0000 7f6a18e34640 1 -- 172.21.15.5:0/2426281577 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a1413a710 con 0x7f6a140c8ad0 2023-07-14T13:12:50.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.093+0000 7f6a18e34640 1 -- 172.21.15.5:0/2426281577 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a140ca1a0 con 0x7f6a140c8ad0 2023-07-14T13:12:50.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.093+0000 7f6a0b7fe640 1 -- 172.21.15.5:0/2426281577 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6a040135d0 con 0x7f6a140c8ad0 2023-07-14T13:12:50.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.093+0000 7f6a0b7fe640 1 --2- 172.21.15.5:0/2426281577 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f69f40663d0 0x7f69f4068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:50.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.093+0000 7f6a0b7fe640 1 -- 172.21.15.5:0/2426281577 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f6a04084340 con 0x7f6a140c8ad0 2023-07-14T13:12:50.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.097+0000 7f6a09d9b640 1 --2- 172.21.15.5:0/2426281577 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f69f40663d0 0x7f69f4068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:50.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.097+0000 7f6a09d9b640 1 --2- 172.21.15.5:0/2426281577 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f69f40663d0 0x7f69f4068880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6a14147e60 tx=0x7f69fc009040 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:50.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.101+0000 7f6a0b7fe640 1 -- 172.21.15.5:0/2426281577 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6a040513c0 con 0x7f6a140c8ad0 2023-07-14T13:12:50.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.257+0000 7f6a18e34640 1 -- 172.21.15.5:0/2426281577 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a140678d0 con 0x7f6a140c8ad0 2023-07-14T13:12:50.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.257+0000 7f6a0b7fe640 1 -- 172.21.15.5:0/2426281577 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+19436 (secure 0 0 0) 0x7f6a040549e0 con 0x7f6a140c8ad0 2023-07-14T13:12:50.294 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:50.295 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":144,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:12:47.362827+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:12:21.430786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-14T13:12:22.293915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/3874881932":"2023-07-15T13:12:47.362773+0000","172.21.15.154:6833/4272779335":"2023-07-15T13:12:47.362773+0000","172.21.15.154:6832/4272779335":"2023-07-15T13:12:47.362773+0000","172.21.15.154:0/1669723697":"2023-07-15T13:12:47.362773+0000","172.21.15.154:0/142605868":"2023-07-15T13:12:47.362773+0000","172.21.15.154:0/1963306512":"2023-07-15T13:12:47.362773+0000","172.21.15.154:0/2411764460":"2023-07-15T13:12:40.543160+0000","172.21.15.154:0/88866958":"2023-07-15T13:12:47.362773+0000","172.21.15.154:0/2631868727":"2023-07-15T13:12:47.362773+0000","172.21.15.154:0/2264156620":"2023-07-15T13:12:40.543160+0000","172.21.15.154:0/4093515681":"2023-07-15T13:12:40.543160+0000","172.21.15.154:0/1036989288":"2023-07-15T13:12:40.543160+0000","172.21.15.154:0/3525194571":"2023-07-15T13:12:40.543160+0000","172.21.15.154:6833/3769132865":"2023-07-15T13:12:40.543160+0000","172.21.15.154:6832/3769132865":"2023-07-15T13:12:40.543160+0000","172.21.15.154:0/4077908301":"2023-07-15T13:12:47.362773+0000","172.21.15.154:0/1560509459":"2023-07-15T13:12:40.543160+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:12:50.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.261+0000 7f6a18e34640 1 -- 172.21.15.5:0/2426281577 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f69f40663d0 msgr2=0x7f69f4068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:50.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.261+0000 7f6a18e34640 1 --2- 172.21.15.5:0/2426281577 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f69f40663d0 0x7f69f4068880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6a14147e60 tx=0x7f69fc009040 comp rx=0 tx=0).stop 2023-07-14T13:12:50.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.261+0000 7f6a18e34640 1 -- 172.21.15.5:0/2426281577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a140c8ad0 msgr2=0x7f6a1413c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:50.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.261+0000 7f6a18e34640 1 --2- 172.21.15.5:0/2426281577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a140c8ad0 0x7f6a1413c870 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400e930 tx=0x7f6a0400edf0 comp rx=0 tx=0).stop 2023-07-14T13:12:50.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.261+0000 7f6a18e34640 1 -- 172.21.15.5:0/2426281577 shutdown_connections 2023-07-14T13:12:50.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.261+0000 7f6a18e34640 1 --2- 172.21.15.5:0/2426281577 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f69f40663d0 0x7f69f4068880 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:50.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.261+0000 7f6a18e34640 1 --2- 172.21.15.5:0/2426281577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a14158ce0 0x7f6a1414fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:50.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.261+0000 7f6a18e34640 1 --2- 172.21.15.5:0/2426281577 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a140c9730 0x7f6a140c1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:50.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.261+0000 7f6a18e34640 1 --2- 172.21.15.5:0/2426281577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a140c8ad0 0x7f6a1413c870 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:50.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.261+0000 7f6a18e34640 1 -- 172.21.15.5:0/2426281577 >> 172.21.15.5:0/2426281577 conn(0x7f6a140afcf0 msgr2=0x7f6a140ae320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:50.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.261+0000 7f6a18e34640 1 -- 172.21.15.5:0/2426281577 shutdown_connections 2023-07-14T13:12:50.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.261+0000 7f6a18e34640 1 -- 172.21.15.5:0/2426281577 wait complete. 2023-07-14T13:12:50.317 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-14T13:12:50.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.425+0000 7faf0a4cb640 1 Processor -- start 2023-07-14T13:12:50.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.425+0000 7faf0a4cb640 1 -- start start 2023-07-14T13:12:50.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.429+0000 7faf0a4cb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faf040c8ad0 0x7faf040c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:50.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.429+0000 7faf0a4cb640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf040c99c0 con 0x7faf040c9560 2023-07-14T13:12:50.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.429+0000 7faf0a4cb640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf040cc700 con 0x7faf04158ce0 2023-07-14T13:12:50.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.429+0000 7faf0a4cb640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf040b0ff0 con 0x7faf040c8ad0 2023-07-14T13:12:50.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.429+0000 7faf08a68640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faf040c9560 0x7faf040ccb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37618/0 (socket says 172.21.15.5:37618) 2023-07-14T13:12:50.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.429+0000 7faf08a68640 1 -- 172.21.15.5:0/106840005 learned_addr learned my addr 172.21.15.5:0/106840005 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:50.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.429+0000 7faf037fe640 1 --2- 172.21.15.5:0/106840005 >> v2:172.21.15.154:3300/0 conn(0x7faf040c8ad0 0x7faf040c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:50.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.429+0000 7faf02ffd640 1 -- 172.21.15.5:0/106840005 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2351496136 0 0) 0x7faf040c99c0 con 0x7faf040c9560 2023-07-14T13:12:50.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.429+0000 7faf02ffd640 1 -- 172.21.15.5:0/106840005 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faeec003530 con 0x7faf040c9560 2023-07-14T13:12:50.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.429+0000 7faf02ffd640 1 -- 172.21.15.5:0/106840005 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1932247885 0 0) 0x7faf040cc700 con 0x7faf04158ce0 2023-07-14T13:12:50.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.429+0000 7faf02ffd640 1 -- 172.21.15.5:0/106840005 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf040c99c0 con 0x7faf04158ce0 2023-07-14T13:12:50.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.429+0000 7faf037fe640 1 -- 172.21.15.5:0/106840005 >> v1:172.21.15.154:6789/0 conn(0x7faf04158ce0 legacy=0x7faf04070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:50.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.429+0000 7faf037fe640 1 -- 172.21.15.5:0/106840005 >> v1:172.21.15.5:6789/0 conn(0x7faf040c9560 legacy=0x7faf040ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:50.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.429+0000 7faf037fe640 1 -- 172.21.15.5:0/106840005 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf04070c80 con 0x7faf040c8ad0 2023-07-14T13:12:50.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.433+0000 7faf037fe640 1 --2- 172.21.15.5:0/106840005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf040c8ad0 0x7faf040c9020 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7faef80097c0 tx=0x7faef801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ea38f146d8030b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:50.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.433+0000 7faf02ffd640 1 -- 172.21.15.5:0/106840005 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef80ab600 con 0x7faf040c8ad0 2023-07-14T13:12:50.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.433+0000 7faf02ffd640 1 -- 172.21.15.5:0/106840005 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef80a7050 con 0x7faf040c8ad0 2023-07-14T13:12:50.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.433+0000 7faf02ffd640 1 -- 172.21.15.5:0/106840005 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef80ab980 con 0x7faf040c8ad0 2023-07-14T13:12:50.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.433+0000 7faf0a4cb640 1 -- 172.21.15.5:0/106840005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf040c8ad0 msgr2=0x7faf040c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:50.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.433+0000 7faf0a4cb640 1 --2- 172.21.15.5:0/106840005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf040c8ad0 0x7faf040c9020 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7faef80097c0 tx=0x7faef801c330 comp rx=0 tx=0).stop 2023-07-14T13:12:50.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.433+0000 7faf0a4cb640 1 -- 172.21.15.5:0/106840005 shutdown_connections 2023-07-14T13:12:50.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.433+0000 7faf0a4cb640 1 --2- 172.21.15.5:0/106840005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf040c8ad0 0x7faf040c9020 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:50.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.433+0000 7faf0a4cb640 1 -- 172.21.15.5:0/106840005 >> 172.21.15.5:0/106840005 conn(0x7faf040afcf0 msgr2=0x7faf040b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:50.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.433+0000 7faf0a4cb640 1 -- 172.21.15.5:0/106840005 shutdown_connections 2023-07-14T13:12:50.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.433+0000 7faf0a4cb640 1 -- 172.21.15.5:0/106840005 wait complete. 2023-07-14T13:12:50.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.433+0000 7faf0a4cb640 1 Processor -- start 2023-07-14T13:12:50.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.433+0000 7faf0a4cb640 1 -- start start 2023-07-14T13:12:50.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.437+0000 7faf0a4cb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf040c8ad0 0x7faf041508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:50.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.437+0000 7faf0a4cb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf040c9560 0x7faf04156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:50.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.437+0000 7faf0a4cb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf04158ce0 0x7faf040ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.437+0000 7faf0a4cb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf041564f0 con 0x7faf04158ce0 2023-07-14T13:12:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.437+0000 7faf0a4cb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf04156e50 con 0x7faf040c8ad0 2023-07-14T13:12:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.437+0000 7faf0a4cb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf04155b50 con 0x7faf040c9560 2023-07-14T13:12:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.437+0000 7faf08a68640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf04158ce0 0x7faf040ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.437+0000 7faf08a68640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf04158ce0 0x7faf040ce2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51206/0 (socket says 172.21.15.5:51206) 2023-07-14T13:12:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.437+0000 7faf08a68640 1 -- 172.21.15.5:0/1103907986 learned_addr learned my addr 172.21.15.5:0/1103907986 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.437+0000 7faf03fff640 1 --2- 172.21.15.5:0/1103907986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf040c8ad0 0x7faf041508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:50.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.437+0000 7faf037fe640 1 --2- 172.21.15.5:0/1103907986 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf040c9560 0x7faf04156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:50.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.437+0000 7faf08a68640 1 -- 172.21.15.5:0/1103907986 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf040c9560 msgr2=0x7faf04156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:50.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.437+0000 7faf08a68640 1 --2- 172.21.15.5:0/1103907986 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf040c9560 0x7faf04156910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:50.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.437+0000 7faf08a68640 1 -- 172.21.15.5:0/1103907986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf040c8ad0 msgr2=0x7faf041508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:50.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.437+0000 7faf08a68640 1 --2- 172.21.15.5:0/1103907986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf040c8ad0 0x7faf041508d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:50.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.437+0000 7faf08a68640 1 -- 172.21.15.5:0/1103907986 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef8009420 con 0x7faf04158ce0 2023-07-14T13:12:50.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.437+0000 7faf08a68640 1 --2- 172.21.15.5:0/1103907986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf04158ce0 0x7faf040ce2e0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7faefc00cb40 tx=0x7faefc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:50.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.437+0000 7faf00ff9640 1 -- 172.21.15.5:0/1103907986 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc00aca0 con 0x7faf04158ce0 2023-07-14T13:12:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.437+0000 7faf00ff9640 1 -- 172.21.15.5:0/1103907986 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc00ae00 con 0x7faf04158ce0 2023-07-14T13:12:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.437+0000 7faf00ff9640 1 -- 172.21.15.5:0/1103907986 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc012600 con 0x7faf04158ce0 2023-07-14T13:12:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.437+0000 7faf0a4cb640 1 -- 172.21.15.5:0/1103907986 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf04155e30 con 0x7faf04158ce0 2023-07-14T13:12:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.437+0000 7faf0a4cb640 1 -- 172.21.15.5:0/1103907986 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0414e5f0 con 0x7faf04158ce0 2023-07-14T13:12:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.437+0000 7faf0a4cb640 1 -- 172.21.15.5:0/1103907986 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf040ca1a0 con 0x7faf04158ce0 2023-07-14T13:12:50.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.437+0000 7faf00ff9640 1 -- 172.21.15.5:0/1103907986 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7faefc007070 con 0x7faf04158ce0 2023-07-14T13:12:50.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.441+0000 7faf00ff9640 1 --2- 172.21.15.5:0/1103907986 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7faef00663a0 0x7faef0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:50.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.441+0000 7faf00ff9640 1 -- 172.21.15.5:0/1103907986 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6821+0+0 (secure 0 0 0) 0x7faefc0840d0 con 0x7faf04158ce0 2023-07-14T13:12:50.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.441+0000 7faf03fff640 1 --2- 172.21.15.5:0/1103907986 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7faef00663a0 0x7faef0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:50.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.441+0000 7faf03fff640 1 --2- 172.21.15.5:0/1103907986 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7faef00663a0 0x7faef0068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7faef40011f0 tx=0x7faef4009040 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:50.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.445+0000 7faf00ff9640 1 -- 172.21.15.5:0/1103907986 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7faefc0511e0 con 0x7faf04158ce0 2023-07-14T13:12:50.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.629+0000 7faf0a4cb640 1 -- 172.21.15.5:0/1103907986 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7faf040678d0 con 0x7faf04158ce0 2023-07-14T13:12:50.668 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-07-14T13:12:50.633+0000 7f17b1648640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-14T13:12:50.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.637+0000 7faf00ff9640 1 -- 172.21.15.5:0/1103907986 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v66) v1 ==== 161+0+0 (secure 0 0 0) 0x7faefc017090 con 0x7faf04158ce0 2023-07-14T13:12:50.673 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-14T13:12:50.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.637+0000 7faf0a4cb640 1 -- 172.21.15.5:0/1103907986 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7faef00663a0 msgr2=0x7faef0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:50.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.637+0000 7faf0a4cb640 1 --2- 172.21.15.5:0/1103907986 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7faef00663a0 0x7faef0068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7faef40011f0 tx=0x7faef4009040 comp rx=0 tx=0).stop 2023-07-14T13:12:50.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.637+0000 7faf0a4cb640 1 -- 172.21.15.5:0/1103907986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf04158ce0 msgr2=0x7faf040ce2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:50.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.637+0000 7faf0a4cb640 1 --2- 172.21.15.5:0/1103907986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf04158ce0 0x7faf040ce2e0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7faefc00cb40 tx=0x7faefc00a060 comp rx=0 tx=0).stop 2023-07-14T13:12:50.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.641+0000 7faf0a4cb640 1 -- 172.21.15.5:0/1103907986 shutdown_connections 2023-07-14T13:12:50.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.641+0000 7faf0a4cb640 1 --2- 172.21.15.5:0/1103907986 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7faef00663a0 0x7faef0068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:50.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.641+0000 7faf0a4cb640 1 --2- 172.21.15.5:0/1103907986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf04158ce0 0x7faf040ce2e0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:50.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.641+0000 7faf0a4cb640 1 --2- 172.21.15.5:0/1103907986 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf040c9560 0x7faf04156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:50.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.641+0000 7faf0a4cb640 1 --2- 172.21.15.5:0/1103907986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf040c8ad0 0x7faf041508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:50.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.641+0000 7faf0a4cb640 1 -- 172.21.15.5:0/1103907986 >> 172.21.15.5:0/1103907986 conn(0x7faf040afcf0 msgr2=0x7faf040ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:50.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.641+0000 7faf0a4cb640 1 -- 172.21.15.5:0/1103907986 shutdown_connections 2023-07-14T13:12:50.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.641+0000 7faf0a4cb640 1 -- 172.21.15.5:0/1103907986 wait complete. 2023-07-14T13:12:50.681 INFO:tasks.ceph.mds.c.smithi005.stderr: -4004> 2023-07-14T13:12:28.877+0000 7f04c59e9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T13:12:50.696 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-14T13:12:50.731 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-07-14T13:12:50.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.809+0000 7f7e38c34640 1 Processor -- start 2023-07-14T13:12:50.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.809+0000 7f7e38c34640 1 -- start start 2023-07-14T13:12:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.809+0000 7f7e38c34640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7e34159af0 0x7f7e340cba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.809+0000 7f7e38c34640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e3415d450 con 0x7f7e340cbf40 2023-07-14T13:12:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.809+0000 7f7e38c34640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e3415ac40 con 0x7f7e34159720 2023-07-14T13:12:50.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.809+0000 7f7e38c34640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e3415a3a0 con 0x7f7e34159af0 2023-07-14T13:12:50.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.813+0000 7f7e2bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7e34159af0 0x7f7e340cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:50.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.813+0000 7f7e2bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7e34159af0 0x7f7e340cba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51220/0 (socket says 172.21.15.5:51220) 2023-07-14T13:12:50.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.813+0000 7f7e2bfff640 1 -- 172.21.15.5:0/735987262 learned_addr learned my addr 172.21.15.5:0/735987262 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:50.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.813+0000 7f7e2bfff640 1 -- 172.21.15.5:0/735987262 >> v1:172.21.15.154:6789/0 conn(0x7f7e34159720 legacy=0x7f7e340cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:50.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.813+0000 7f7e2bfff640 1 -- 172.21.15.5:0/735987262 >> v1:172.21.15.5:6789/0 conn(0x7f7e340cbf40 legacy=0x7f7e3415d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:50.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.813+0000 7f7e2bfff640 1 -- 172.21.15.5:0/735987262 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3415a680 con 0x7f7e34159af0 2023-07-14T13:12:50.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.813+0000 7f7e32ffd640 1 -- 172.21.15.5:0/735987262 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3068098401 0 0) 0x7f7e3415d450 con 0x7f7e340cbf40 2023-07-14T13:12:50.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.813+0000 7f7e2bfff640 1 --2- 172.21.15.5:0/735987262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e34159af0 0x7f7e340cba00 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c009870 tx=0x7f7e1c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c5644f5566cb4a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:50.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.813+0000 7f7e32ffd640 1 -- 172.21.15.5:0/735987262 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c0a6040 con 0x7f7e34159af0 2023-07-14T13:12:50.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.813+0000 7f7e32ffd640 1 -- 172.21.15.5:0/735987262 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1c0aa600 con 0x7f7e34159af0 2023-07-14T13:12:50.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.813+0000 7f7e32ffd640 1 -- 172.21.15.5:0/735987262 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c0aa990 con 0x7f7e34159af0 2023-07-14T13:12:50.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.817+0000 7f7e38c34640 1 -- 172.21.15.5:0/735987262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e34159af0 msgr2=0x7f7e340cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:50.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.817+0000 7f7e38c34640 1 --2- 172.21.15.5:0/735987262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e34159af0 0x7f7e340cba00 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c009870 tx=0x7f7e1c01c480 comp rx=0 tx=0).stop 2023-07-14T13:12:50.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.817+0000 7f7e38c34640 1 -- 172.21.15.5:0/735987262 shutdown_connections 2023-07-14T13:12:50.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.817+0000 7f7e38c34640 1 --2- 172.21.15.5:0/735987262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e34159af0 0x7f7e340cba00 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:50.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.817+0000 7f7e38c34640 1 -- 172.21.15.5:0/735987262 >> 172.21.15.5:0/735987262 conn(0x7f7e340ca8b0 msgr2=0x7f7e340cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:50.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.817+0000 7f7e38c34640 1 -- 172.21.15.5:0/735987262 shutdown_connections 2023-07-14T13:12:50.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.817+0000 7f7e38c34640 1 -- 172.21.15.5:0/735987262 wait complete. 2023-07-14T13:12:50.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.817+0000 7f7e38c34640 1 Processor -- start 2023-07-14T13:12:50.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.817+0000 7f7e38c34640 1 -- start start 2023-07-14T13:12:50.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.817+0000 7f7e38c34640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e340cbf40 0x7f7e340c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:50.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.817+0000 7f7e38c34640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e34159720 0x7f7e34146e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:50.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.817+0000 7f7e38c34640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e34159af0 0x7f7e3414b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:50.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.817+0000 7f7e38c34640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e34147a40 con 0x7f7e34159af0 2023-07-14T13:12:50.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.817+0000 7f7e38c34640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e340c89e0 con 0x7f7e34159720 2023-07-14T13:12:50.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.817+0000 7f7e38c34640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e340c9840 con 0x7f7e340cbf40 2023-07-14T13:12:50.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.817+0000 7f7e33fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e34159af0 0x7f7e3414b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:50.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.817+0000 7f7e33fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e34159af0 0x7f7e3414b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51226/0 (socket says 172.21.15.5:51226) 2023-07-14T13:12:50.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.817+0000 7f7e33fff640 1 -- 172.21.15.5:0/2079052731 learned_addr learned my addr 172.21.15.5:0/2079052731 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:50.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.817+0000 7f7e2bfff640 1 --2- 172.21.15.5:0/2079052731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e34159720 0x7f7e34146e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:50.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.817+0000 7f7e337fe640 1 --2- 172.21.15.5:0/2079052731 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e340cbf40 0x7f7e340c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:50.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.817+0000 7f7e33fff640 1 -- 172.21.15.5:0/2079052731 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e340cbf40 msgr2=0x7f7e340c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:50.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.817+0000 7f7e33fff640 1 --2- 172.21.15.5:0/2079052731 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e340cbf40 0x7f7e340c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:50.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.817+0000 7f7e33fff640 1 -- 172.21.15.5:0/2079052731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e34159720 msgr2=0x7f7e34146e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:50.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.817+0000 7f7e33fff640 1 --2- 172.21.15.5:0/2079052731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e34159720 0x7f7e34146e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:50.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.817+0000 7f7e33fff640 1 -- 172.21.15.5:0/2079052731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1c0094d0 con 0x7f7e34159af0 2023-07-14T13:12:50.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.821+0000 7f7e33fff640 1 --2- 172.21.15.5:0/2079052731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e34159af0 0x7f7e3414b450 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00c890 tx=0x7f7e2c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:50.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.821+0000 7f7e30ff9640 1 -- 172.21.15.5:0/2079052731 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c003db0 con 0x7f7e34159af0 2023-07-14T13:12:50.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.821+0000 7f7e30ff9640 1 -- 172.21.15.5:0/2079052731 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2c005070 con 0x7f7e34159af0 2023-07-14T13:12:50.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.821+0000 7f7e30ff9640 1 -- 172.21.15.5:0/2079052731 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c005420 con 0x7f7e34159af0 2023-07-14T13:12:50.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.821+0000 7f7e38c34640 1 -- 172.21.15.5:0/2079052731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e340c8c30 con 0x7f7e34159af0 2023-07-14T13:12:50.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.821+0000 7f7e38c34640 1 -- 172.21.15.5:0/2079052731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e340c8fc0 con 0x7f7e34159af0 2023-07-14T13:12:50.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.821+0000 7f7e38c34640 1 -- 172.21.15.5:0/2079052731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e3404e020 con 0x7f7e34159af0 2023-07-14T13:12:50.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.821+0000 7f7e30ff9640 1 -- 172.21.15.5:0/2079052731 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7e2c005580 con 0x7f7e34159af0 2023-07-14T13:12:50.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.821+0000 7f7e30ff9640 1 --2- 172.21.15.5:0/2079052731 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f7e140663a0 0x7f7e14068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:50.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.821+0000 7f7e30ff9640 1 -- 172.21.15.5:0/2079052731 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6907+0+0 (secure 0 0 0) 0x7f7e2c083b90 con 0x7f7e34159af0 2023-07-14T13:12:50.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.821+0000 7f7e337fe640 1 --2- 172.21.15.5:0/2079052731 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f7e140663a0 0x7f7e14068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:50.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.825+0000 7f7e337fe640 1 --2- 172.21.15.5:0/2079052731 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f7e140663a0 0x7f7e14068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7e34158690 tx=0x7f7e24009040 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:50.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:50.825+0000 7f7e30ff9640 1 -- 172.21.15.5:0/2079052731 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7e2c050bd0 con 0x7f7e34159af0 2023-07-14T13:12:51.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.021+0000 7f7e38c34640 1 -- 172.21.15.5:0/2079052731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7e340c9980 con 0x7f7e34159af0 2023-07-14T13:12:51.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.649+0000 7f7e30ff9640 1 -- 172.21.15.5:0/2079052731 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v67) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7e2c0541f0 con 0x7f7e34159af0 2023-07-14T13:12:51.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.653+0000 7f7e38c34640 1 -- 172.21.15.5:0/2079052731 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f7e140663a0 msgr2=0x7f7e14068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:51.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.653+0000 7f7e38c34640 1 --2- 172.21.15.5:0/2079052731 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f7e140663a0 0x7f7e14068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7e34158690 tx=0x7f7e24009040 comp rx=0 tx=0).stop 2023-07-14T13:12:51.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.653+0000 7f7e38c34640 1 -- 172.21.15.5:0/2079052731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e34159af0 msgr2=0x7f7e3414b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:51.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.653+0000 7f7e38c34640 1 --2- 172.21.15.5:0/2079052731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e34159af0 0x7f7e3414b450 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00c890 tx=0x7f7e2c00cd50 comp rx=0 tx=0).stop 2023-07-14T13:12:51.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.653+0000 7f7e38c34640 1 -- 172.21.15.5:0/2079052731 shutdown_connections 2023-07-14T13:12:51.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.653+0000 7f7e38c34640 1 --2- 172.21.15.5:0/2079052731 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f7e140663a0 0x7f7e14068850 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:51.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.653+0000 7f7e38c34640 1 --2- 172.21.15.5:0/2079052731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e34159af0 0x7f7e3414b450 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:51.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.653+0000 7f7e38c34640 1 --2- 172.21.15.5:0/2079052731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e34159720 0x7f7e34146e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:51.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.653+0000 7f7e38c34640 1 --2- 172.21.15.5:0/2079052731 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e340cbf40 0x7f7e340c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:51.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.653+0000 7f7e38c34640 1 -- 172.21.15.5:0/2079052731 >> 172.21.15.5:0/2079052731 conn(0x7f7e340ca8b0 msgr2=0x7f7e3415d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:51.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.653+0000 7f7e38c34640 1 -- 172.21.15.5:0/2079052731 shutdown_connections 2023-07-14T13:12:51.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.653+0000 7f7e38c34640 1 -- 172.21.15.5:0/2079052731 wait complete. 2023-07-14T13:12:51.712 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-14T13:12:51.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.869+0000 7f9db73d2640 1 Processor -- start 2023-07-14T13:12:51.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.869+0000 7f9db73d2640 1 -- start start 2023-07-14T13:12:51.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.873+0000 7f9db73d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db00c3ac0 0x7f9db00c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:51.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.873+0000 7f9db73d2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9db00af2b0 0x7f9db00ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:51.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.873+0000 7f9db73d2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db00ca540 con 0x7f9db00cd120 2023-07-14T13:12:51.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.873+0000 7f9db73d2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db00695b0 con 0x7f9db00af2b0 2023-07-14T13:12:51.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.873+0000 7f9db73d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db0069890 con 0x7f9db00c3ac0 2023-07-14T13:12:51.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.873+0000 7f9db496d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9db00af2b0 0x7f9db00ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:51.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.873+0000 7f9db496d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9db00af2b0 0x7f9db00ca000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51234/0 (socket says 172.21.15.5:51234) 2023-07-14T13:12:51.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.873+0000 7f9db496d640 1 -- 172.21.15.5:0/4267880392 learned_addr learned my addr 172.21.15.5:0/4267880392 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:51.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.873+0000 7f9db516e640 1 --2- 172.21.15.5:0/4267880392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db00c3ac0 0x7f9db00c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:51.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.873+0000 7f9db496d640 1 -- 172.21.15.5:0/4267880392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db00c3ac0 msgr2=0x7f9db00c2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:51.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.873+0000 7f9db496d640 1 --2- 172.21.15.5:0/4267880392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db00c3ac0 0x7f9db00c2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:51.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.873+0000 7f9db496d640 1 -- 172.21.15.5:0/4267880392 >> v1:172.21.15.154:6789/0 conn(0x7f9db00cd120 legacy=0x7f9db00cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:51.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.873+0000 7f9db496d640 1 -- 172.21.15.5:0/4267880392 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db0069b70 con 0x7f9db00af2b0 2023-07-14T13:12:51.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.877+0000 7f9db496d640 1 --2- 172.21.15.5:0/4267880392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9db00af2b0 0x7f9db00ca000 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f9da0009870 tx=0x7f9da001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8be9b9d70bd5eb8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:51.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.877+0000 7f9da7fff640 1 -- 172.21.15.5:0/4267880392 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da00aa680 con 0x7f9db00af2b0 2023-07-14T13:12:51.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.877+0000 7f9da7fff640 1 -- 172.21.15.5:0/4267880392 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da00aa7e0 con 0x7f9db00af2b0 2023-07-14T13:12:51.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.877+0000 7f9da7fff640 1 -- 172.21.15.5:0/4267880392 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da00aab70 con 0x7f9db00af2b0 2023-07-14T13:12:51.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.877+0000 7f9db73d2640 1 -- 172.21.15.5:0/4267880392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9db00af2b0 msgr2=0x7f9db00ca000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:51.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.877+0000 7f9db73d2640 1 --2- 172.21.15.5:0/4267880392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9db00af2b0 0x7f9db00ca000 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f9da0009870 tx=0x7f9da001c540 comp rx=0 tx=0).stop 2023-07-14T13:12:51.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.877+0000 7f9db73d2640 1 -- 172.21.15.5:0/4267880392 shutdown_connections 2023-07-14T13:12:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.877+0000 7f9db73d2640 1 --2- 172.21.15.5:0/4267880392 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9db00af2b0 0x7f9db00ca000 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.877+0000 7f9db73d2640 1 --2- 172.21.15.5:0/4267880392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db00c3ac0 0x7f9db00c2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.877+0000 7f9db73d2640 1 -- 172.21.15.5:0/4267880392 >> 172.21.15.5:0/4267880392 conn(0x7f9db00cde90 msgr2=0x7f9db00ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.877+0000 7f9db73d2640 1 -- 172.21.15.5:0/4267880392 shutdown_connections 2023-07-14T13:12:51.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.877+0000 7f9db73d2640 1 -- 172.21.15.5:0/4267880392 wait complete. 2023-07-14T13:12:51.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.877+0000 7f9db73d2640 1 Processor -- start 2023-07-14T13:12:51.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.877+0000 7f9db73d2640 1 -- start start 2023-07-14T13:12:51.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.881+0000 7f9db73d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db00af2b0 0x7f9db00b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:51.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.881+0000 7f9db73d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9db00c3ac0 0x7f9db0155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:51.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.881+0000 7f9db73d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db00cd120 0x7f9db0159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:51.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.881+0000 7f9db73d2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db00b1d90 con 0x7f9db00c3ac0 2023-07-14T13:12:51.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.881+0000 7f9db73d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db00b3020 con 0x7f9db00af2b0 2023-07-14T13:12:51.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.881+0000 7f9db73d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db00b2220 con 0x7f9db00cd120 2023-07-14T13:12:51.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.881+0000 7f9db496d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9db00c3ac0 0x7f9db0155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:51.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.881+0000 7f9db496d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9db00c3ac0 0x7f9db0155820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51248/0 (socket says 172.21.15.5:51248) 2023-07-14T13:12:51.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.881+0000 7f9db496d640 1 -- 172.21.15.5:0/3574708637 learned_addr learned my addr 172.21.15.5:0/3574708637 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:51.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.881+0000 7f9db516e640 1 --2- 172.21.15.5:0/3574708637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db00af2b0 0x7f9db00b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:51.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.881+0000 7f9db596f640 1 --2- 172.21.15.5:0/3574708637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db00cd120 0x7f9db0159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:51.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.881+0000 7f9db496d640 1 -- 172.21.15.5:0/3574708637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db00cd120 msgr2=0x7f9db0159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:51.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.881+0000 7f9db496d640 1 --2- 172.21.15.5:0/3574708637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db00cd120 0x7f9db0159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:51.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.881+0000 7f9db496d640 1 -- 172.21.15.5:0/3574708637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db00af2b0 msgr2=0x7f9db00b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:51.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.881+0000 7f9db496d640 1 --2- 172.21.15.5:0/3574708637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db00af2b0 0x7f9db00b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:51.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.881+0000 7f9db496d640 1 -- 172.21.15.5:0/3574708637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da00094d0 con 0x7f9db00c3ac0 2023-07-14T13:12:51.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.881+0000 7f9db596f640 1 --2- 172.21.15.5:0/3574708637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db00cd120 0x7f9db0159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:51.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.881+0000 7f9db496d640 1 --2- 172.21.15.5:0/3574708637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9db00c3ac0 0x7f9db0155820 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f9da001abf0 tx=0x7f9da001ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:51.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.881+0000 7f9da5ffb640 1 -- 172.21.15.5:0/3574708637 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da00b38c0 con 0x7f9db00c3ac0 2023-07-14T13:12:51.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.881+0000 7f9da5ffb640 1 -- 172.21.15.5:0/3574708637 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da00b3a40 con 0x7f9db00c3ac0 2023-07-14T13:12:51.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.881+0000 7f9da5ffb640 1 -- 172.21.15.5:0/3574708637 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da00b3df0 con 0x7f9db00c3ac0 2023-07-14T13:12:51.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.881+0000 7f9db73d2640 1 -- 172.21.15.5:0/3574708637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db00b1180 con 0x7f9db00c3ac0 2023-07-14T13:12:51.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.881+0000 7f9db73d2640 1 -- 172.21.15.5:0/3574708637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db00b1740 con 0x7f9db00c3ac0 2023-07-14T13:12:51.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.881+0000 7f9db73d2640 1 -- 172.21.15.5:0/3574708637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db00b1f00 con 0x7f9db00c3ac0 2023-07-14T13:12:51.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.881+0000 7f9da5ffb640 1 -- 172.21.15.5:0/3574708637 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9da00a9460 con 0x7f9db00c3ac0 2023-07-14T13:12:51.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.885+0000 7f9da5ffb640 1 --2- 172.21.15.5:0/3574708637 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f9d940663a0 0x7f9d94068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:51.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.885+0000 7f9da5ffb640 1 -- 172.21.15.5:0/3574708637 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6907+0+0 (secure 0 0 0) 0x7f9da011f1e0 con 0x7f9db00c3ac0 2023-07-14T13:12:51.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.885+0000 7f9db516e640 1 --2- 172.21.15.5:0/3574708637 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f9d940663a0 0x7f9d94068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:51.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.885+0000 7f9db516e640 1 --2- 172.21.15.5:0/3574708637 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f9d940663a0 0x7f9d94068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0079c0 tx=0x7f9dac008040 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:51.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:51.889+0000 7f9da5ffb640 1 -- 172.21.15.5:0/3574708637 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9da00ec190 con 0x7f9db00c3ac0 2023-07-14T13:12:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.045+0000 7f9db73d2640 1 -- 172.21.15.5:0/3574708637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9db00678d0 con 0x7f9db00c3ac0 2023-07-14T13:12:52.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.801+0000 7f9da5ffb640 1 -- 172.21.15.5:0/3574708637 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v146) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9da00ef7b0 con 0x7f9db00c3ac0 2023-07-14T13:12:52.837 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-07-14T13:12:52.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.801+0000 7f9db73d2640 1 -- 172.21.15.5:0/3574708637 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f9d940663a0 msgr2=0x7f9d94068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:52.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.801+0000 7f9db73d2640 1 --2- 172.21.15.5:0/3574708637 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f9d940663a0 0x7f9d94068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0079c0 tx=0x7f9dac008040 comp rx=0 tx=0).stop 2023-07-14T13:12:52.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.801+0000 7f9db73d2640 1 -- 172.21.15.5:0/3574708637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9db00c3ac0 msgr2=0x7f9db0155820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:52.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.801+0000 7f9db73d2640 1 --2- 172.21.15.5:0/3574708637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9db00c3ac0 0x7f9db0155820 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f9da001abf0 tx=0x7f9da001ad80 comp rx=0 tx=0).stop 2023-07-14T13:12:52.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.801+0000 7f9db73d2640 1 -- 172.21.15.5:0/3574708637 shutdown_connections 2023-07-14T13:12:52.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.801+0000 7f9db73d2640 1 --2- 172.21.15.5:0/3574708637 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f9d940663a0 0x7f9d94068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:52.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.801+0000 7f9db73d2640 1 --2- 172.21.15.5:0/3574708637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9db00cd120 0x7f9db0159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:52.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.801+0000 7f9db73d2640 1 --2- 172.21.15.5:0/3574708637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9db00c3ac0 0x7f9db0155820 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:52.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.801+0000 7f9db73d2640 1 --2- 172.21.15.5:0/3574708637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9db00af2b0 0x7f9db00b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:52.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.801+0000 7f9db73d2640 1 -- 172.21.15.5:0/3574708637 >> 172.21.15.5:0/3574708637 conn(0x7f9db00cde90 msgr2=0x7f9db00ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:52.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.805+0000 7f9db73d2640 1 -- 172.21.15.5:0/3574708637 shutdown_connections 2023-07-14T13:12:52.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.805+0000 7f9db73d2640 1 -- 172.21.15.5:0/3574708637 wait complete. 2023-07-14T13:12:52.862 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-14T13:12:53.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f2549574640 1 Processor -- start 2023-07-14T13:12:53.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f2549574640 1 -- start start 2023-07-14T13:12:53.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f2549574640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25440cf2e0 0x7f25440cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:53.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f2549574640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25440d0920 con 0x7f25440ca790 2023-07-14T13:12:53.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f2549574640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f254415bfd0 con 0x7f254406a540 2023-07-14T13:12:53.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f2549574640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25440cfd10 con 0x7f25440cf2e0 2023-07-14T13:12:53.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f25437fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f25440ca790 0x7f25440cac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37650/0 (socket says 172.21.15.5:37650) 2023-07-14T13:12:53.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f25437fe640 1 -- 172.21.15.5:0/756849870 learned_addr learned my addr 172.21.15.5:0/756849870 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:53.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f253bfff640 1 --2- 172.21.15.5:0/756849870 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25440cf2e0 0x7f25440cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:53.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f25427fc640 1 -- 172.21.15.5:0/756849870 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875223068 0 0) 0x7f25440d0920 con 0x7f25440ca790 2023-07-14T13:12:53.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f25427fc640 1 -- 172.21.15.5:0/756849870 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2530003530 con 0x7f25440ca790 2023-07-14T13:12:53.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f25427fc640 1 -- 172.21.15.5:0/756849870 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 552924599 0 0) 0x7f2530003530 con 0x7f25440ca790 2023-07-14T13:12:53.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f25427fc640 1 -- 172.21.15.5:0/756849870 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25440cf2e0 msgr2=0x7f25440cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:53.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f25427fc640 1 --2- 172.21.15.5:0/756849870 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25440cf2e0 0x7f25440cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:53.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f25427fc640 1 -- 172.21.15.5:0/756849870 >> v1:172.21.15.154:6789/0 conn(0x7f254406a540 legacy=0x7f254406a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:53.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f25427fc640 1 -- 172.21.15.5:0/756849870 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25440cfff0 con 0x7f25440ca790 2023-07-14T13:12:53.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f25427fc640 1 -- 172.21.15.5:0/756849870 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f253c001a00 con 0x7f25440ca790 2023-07-14T13:12:53.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f25427fc640 1 -- 172.21.15.5:0/756849870 >> v1:172.21.15.5:6789/0 conn(0x7f25440ca790 legacy=0x7f25440cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:53.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f25427fc640 1 --2- 172.21.15.5:0/756849870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25300039b0 0x7f2530003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:53.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f25427fc640 1 --2- 172.21.15.5:0/756849870 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25440cf2e0 0x7f25300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:53.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f25427fc640 1 --2- 172.21.15.5:0/756849870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2530004d10 0x7f2530005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:53.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f25427fc640 1 -- 172.21.15.5:0/756849870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25440cfd10 con 0x7f2530004d10 2023-07-14T13:12:53.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f25427fc640 1 -- 172.21.15.5:0/756849870 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253000ba40 con 0x7f25300039b0 2023-07-14T13:12:53.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f25427fc640 1 -- 172.21.15.5:0/756849870 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253000bbd0 con 0x7f25440cf2e0 2023-07-14T13:12:53.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f253bfff640 1 --2- 172.21.15.5:0/756849870 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25440cf2e0 0x7f25300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:53.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f2542ffd640 1 --2- 172.21.15.5:0/756849870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25300039b0 0x7f2530003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:53.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f25437fe640 1 --2- 172.21.15.5:0/756849870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2530004d10 0x7f2530005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:53.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f25437fe640 1 -- 172.21.15.5:0/756849870 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25440cf2e0 msgr2=0x7f25300047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:53.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f25437fe640 1 --2- 172.21.15.5:0/756849870 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25440cf2e0 0x7f25300047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:53.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f25437fe640 1 -- 172.21.15.5:0/756849870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25300039b0 msgr2=0x7f2530003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:53.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f25437fe640 1 --2- 172.21.15.5:0/756849870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25300039b0 0x7f2530003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:53.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.977+0000 7f25437fe640 1 -- 172.21.15.5:0/756849870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2530003530 con 0x7f2530004d10 2023-07-14T13:12:53.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.981+0000 7f253bfff640 1 --2- 172.21.15.5:0/756849870 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f25440cf2e0 0x7f25300047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:53.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.981+0000 7f25437fe640 1 --2- 172.21.15.5:0/756849870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2530004d10 0x7f2530005180 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f253c00a800 tx=0x7f253c01d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dba92d0d1112ca0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:53.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.981+0000 7f25427fc640 1 -- 172.21.15.5:0/756849870 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253c0072d0 con 0x7f2530004d10 2023-07-14T13:12:53.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.981+0000 7f25427fc640 1 -- 172.21.15.5:0/756849870 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253c0a8070 con 0x7f2530004d10 2023-07-14T13:12:53.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.981+0000 7f25427fc640 1 -- 172.21.15.5:0/756849870 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253c0076b0 con 0x7f2530004d10 2023-07-14T13:12:53.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.981+0000 7f2549574640 1 -- 172.21.15.5:0/756849870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2530004d10 msgr2=0x7f2530005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:53.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.981+0000 7f2549574640 1 --2- 172.21.15.5:0/756849870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2530004d10 0x7f2530005180 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f253c00a800 tx=0x7f253c01d300 comp rx=0 tx=0).stop 2023-07-14T13:12:53.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.981+0000 7f25437fe640 1 -- 172.21.15.5:0/756849870 reap_dead start 2023-07-14T13:12:53.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.981+0000 7f2549574640 1 -- 172.21.15.5:0/756849870 shutdown_connections 2023-07-14T13:12:53.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.981+0000 7f2549574640 1 -- 172.21.15.5:0/756849870 >> 172.21.15.5:0/756849870 conn(0x7f2544099490 msgr2=0x7f2544089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:53.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.981+0000 7f2549574640 1 -- 172.21.15.5:0/756849870 shutdown_connections 2023-07-14T13:12:53.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.981+0000 7f2549574640 1 -- 172.21.15.5:0/756849870 wait complete. 2023-07-14T13:12:53.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.985+0000 7f2549574640 1 Processor -- start 2023-07-14T13:12:53.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.985+0000 7f2549574640 1 -- start start 2023-07-14T13:12:53.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.985+0000 7f2549574640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2530004d10 0x7f254415ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:53.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.985+0000 7f2549574640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f254415dd10 0x7f254415e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:53.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.985+0000 7f2549574640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25440cbe80 0x7f25440cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:53.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.985+0000 7f2549574640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254415e6c0 con 0x7f2530004d10 2023-07-14T13:12:53.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.985+0000 7f2549574640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25440cc830 con 0x7f25440cbe80 2023-07-14T13:12:53.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.985+0000 7f2549574640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25440c48e0 con 0x7f254415dd10 2023-07-14T13:12:53.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.985+0000 7f2542ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2530004d10 0x7f254415ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:53.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.985+0000 7f2542ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2530004d10 0x7f254415ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51260/0 (socket says 172.21.15.5:51260) 2023-07-14T13:12:53.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.985+0000 7f2542ffd640 1 -- 172.21.15.5:0/2813471878 learned_addr learned my addr 172.21.15.5:0/2813471878 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:53.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.985+0000 7f25437fe640 1 --2- 172.21.15.5:0/2813471878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25440cbe80 0x7f25440cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:53.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.985+0000 7f253bfff640 1 --2- 172.21.15.5:0/2813471878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f254415dd10 0x7f254415e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:53.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.985+0000 7f2542ffd640 1 -- 172.21.15.5:0/2813471878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f254415dd10 msgr2=0x7f254415e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:53.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.985+0000 7f2542ffd640 1 --2- 172.21.15.5:0/2813471878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f254415dd10 0x7f254415e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:53.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.985+0000 7f2542ffd640 1 -- 172.21.15.5:0/2813471878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25440cbe80 msgr2=0x7f25440cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:53.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.985+0000 7f2542ffd640 1 --2- 172.21.15.5:0/2813471878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25440cbe80 0x7f25440cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:53.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.985+0000 7f2542ffd640 1 -- 172.21.15.5:0/2813471878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25440c3d10 con 0x7f2530004d10 2023-07-14T13:12:53.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.985+0000 7f2542ffd640 1 --2- 172.21.15.5:0/2813471878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2530004d10 0x7f254415ca90 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f253400f610 tx=0x7f253400fad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:53.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.985+0000 7f253b7fe640 1 -- 172.21.15.5:0/2813471878 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25340052e0 con 0x7f2530004d10 2023-07-14T13:12:53.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.985+0000 7f253b7fe640 1 -- 172.21.15.5:0/2813471878 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2534005440 con 0x7f2530004d10 2023-07-14T13:12:53.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.985+0000 7f253b7fe640 1 -- 172.21.15.5:0/2813471878 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2534003820 con 0x7f2530004d10 2023-07-14T13:12:53.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.985+0000 7f2549574640 1 -- 172.21.15.5:0/2813471878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25440c3fb0 con 0x7f2530004d10 2023-07-14T13:12:53.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.985+0000 7f2549574640 1 -- 172.21.15.5:0/2813471878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25440c4570 con 0x7f2530004d10 2023-07-14T13:12:53.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.989+0000 7f2549574640 1 -- 172.21.15.5:0/2813471878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25440678d0 con 0x7f2530004d10 2023-07-14T13:12:53.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.989+0000 7f253b7fe640 1 -- 172.21.15.5:0/2813471878 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2534003980 con 0x7f2530004d10 2023-07-14T13:12:53.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.989+0000 7f253b7fe640 1 --2- 172.21.15.5:0/2813471878 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f25240663a0 0x7f2524068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:53.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.989+0000 7f253b7fe640 1 -- 172.21.15.5:0/2813471878 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6469+0+0 (secure 0 0 0) 0x7f2534083fe0 con 0x7f2530004d10 2023-07-14T13:12:53.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.989+0000 7f253bfff640 1 --2- 172.21.15.5:0/2813471878 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f25240663a0 0x7f2524068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:53.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.989+0000 7f253bfff640 1 --2- 172.21.15.5:0/2813471878 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f25240663a0 0x7f2524068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f254415dca0 tx=0x7f252c008040 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:53.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:52.993+0000 7f253b7fe640 1 -- 172.21.15.5:0/2813471878 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2534051110 con 0x7f2530004d10 2023-07-14T13:12:53.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.153+0000 7f2549574640 1 -- 172.21.15.5:0/2813471878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f25440ca570 con 0x7f2530004d10 2023-07-14T13:12:53.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.805+0000 7f253b7fe640 1 -- 172.21.15.5:0/2813471878 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v147) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2534054730 con 0x7f2530004d10 2023-07-14T13:12:53.844 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-07-14T13:12:53.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.809+0000 7f2549574640 1 -- 172.21.15.5:0/2813471878 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f25240663a0 msgr2=0x7f2524068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:53.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.809+0000 7f2549574640 1 --2- 172.21.15.5:0/2813471878 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f25240663a0 0x7f2524068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f254415dca0 tx=0x7f252c008040 comp rx=0 tx=0).stop 2023-07-14T13:12:53.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.809+0000 7f2549574640 1 -- 172.21.15.5:0/2813471878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2530004d10 msgr2=0x7f254415ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:53.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.809+0000 7f2549574640 1 --2- 172.21.15.5:0/2813471878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2530004d10 0x7f254415ca90 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f253400f610 tx=0x7f253400fad0 comp rx=0 tx=0).stop 2023-07-14T13:12:53.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.809+0000 7f2549574640 1 -- 172.21.15.5:0/2813471878 shutdown_connections 2023-07-14T13:12:53.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.809+0000 7f2549574640 1 --2- 172.21.15.5:0/2813471878 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f25240663a0 0x7f2524068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:53.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.809+0000 7f2549574640 1 --2- 172.21.15.5:0/2813471878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25440cbe80 0x7f25440cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:53.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.809+0000 7f2549574640 1 --2- 172.21.15.5:0/2813471878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f254415dd10 0x7f254415e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:53.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.809+0000 7f2549574640 1 --2- 172.21.15.5:0/2813471878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2530004d10 0x7f254415ca90 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:53.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.809+0000 7f2549574640 1 -- 172.21.15.5:0/2813471878 >> 172.21.15.5:0/2813471878 conn(0x7f2544099490 msgr2=0x7f254406ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:53.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.809+0000 7f2549574640 1 -- 172.21.15.5:0/2813471878 shutdown_connections 2023-07-14T13:12:53.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.809+0000 7f2549574640 1 -- 172.21.15.5:0/2813471878 wait complete. 2023-07-14T13:12:53.869 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-14T13:12:54.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.981+0000 7ff707f03640 1 Processor -- start 2023-07-14T13:12:54.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.981+0000 7ff707f03640 1 -- start start 2023-07-14T13:12:54.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.981+0000 7ff707f03640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff700164340 0x7ff7000cd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:54.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.981+0000 7ff707f03640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7000c89f0 con 0x7ff7001600b0 2023-07-14T13:12:54.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.981+0000 7ff707f03640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7000cbe50 con 0x7ff70006cf80 2023-07-14T13:12:54.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.981+0000 7ff707f03640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7000cc9d0 con 0x7ff700164340 2023-07-14T13:12:54.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.981+0000 7ff705c9f640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff7001600b0 0x7ff700163c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37666/0 (socket says 172.21.15.5:37666) 2023-07-14T13:12:54.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.981+0000 7ff705c9f640 1 -- 172.21.15.5:0/2354043140 learned_addr learned my addr 172.21.15.5:0/2354043140 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:54.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.981+0000 7ff704c9d640 1 -- 172.21.15.5:0/2354043140 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929379856 0 0) 0x7ff7000c89f0 con 0x7ff7001600b0 2023-07-14T13:12:54.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.981+0000 7ff70549e640 1 --2- 172.21.15.5:0/2354043140 >> v2:172.21.15.154:3300/0 conn(0x7ff700164340 0x7ff7000cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:54.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.981+0000 7ff704c9d640 1 -- 172.21.15.5:0/2354043140 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6ec003530 con 0x7ff7001600b0 2023-07-14T13:12:54.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.981+0000 7ff704c9d640 1 -- 172.21.15.5:0/2354043140 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 579138938 0 0) 0x7ff6ec003530 con 0x7ff7001600b0 2023-07-14T13:12:54.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.981+0000 7ff704c9d640 1 -- 172.21.15.5:0/2354043140 >> v2:172.21.15.154:3300/0 conn(0x7ff700164340 msgr2=0x7ff7000cd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:54.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.981+0000 7ff704c9d640 1 --2- 172.21.15.5:0/2354043140 >> v2:172.21.15.154:3300/0 conn(0x7ff700164340 0x7ff7000cd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.981+0000 7ff704c9d640 1 -- 172.21.15.5:0/2354043140 >> v1:172.21.15.154:6789/0 conn(0x7ff70006cf80 legacy=0x7ff7000c0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:54.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.981+0000 7ff704c9d640 1 -- 172.21.15.5:0/2354043140 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7000c9e20 con 0x7ff7001600b0 2023-07-14T13:12:54.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.981+0000 7ff704c9d640 1 -- 172.21.15.5:0/2354043140 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7ff6fc001680 con 0x7ff7001600b0 2023-07-14T13:12:54.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.985+0000 7ff704c9d640 1 -- 172.21.15.5:0/2354043140 >> v1:172.21.15.5:6789/0 conn(0x7ff7001600b0 legacy=0x7ff700163c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:54.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.985+0000 7ff704c9d640 1 --2- 172.21.15.5:0/2354043140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6ec003980 0x7ff6ec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:54.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.985+0000 7ff704c9d640 1 --2- 172.21.15.5:0/2354043140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6ec0047d0 0x7ff6ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:54.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.985+0000 7ff704c9d640 1 --2- 172.21.15.5:0/2354043140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6ec005180 0x7ff6ec00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:54.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.985+0000 7ff704c9d640 1 -- 172.21.15.5:0/2354043140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7000cc9d0 con 0x7ff6ec003980 2023-07-14T13:12:54.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.985+0000 7ff704c9d640 1 -- 172.21.15.5:0/2354043140 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec00c000 con 0x7ff6ec005180 2023-07-14T13:12:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.985+0000 7ff704c9d640 1 -- 172.21.15.5:0/2354043140 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec00c1c0 con 0x7ff6ec0047d0 2023-07-14T13:12:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.985+0000 7ff705c9f640 1 --2- 172.21.15.5:0/2354043140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6ec003980 0x7ff6ec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.985+0000 7ff70549e640 1 --2- 172.21.15.5:0/2354043140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6ec0047d0 0x7ff6ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.985+0000 7ff7064a0640 1 --2- 172.21.15.5:0/2354043140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6ec005180 0x7ff6ec00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.985+0000 7ff705c9f640 1 -- 172.21.15.5:0/2354043140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6ec0047d0 msgr2=0x7ff6ec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.985+0000 7ff705c9f640 1 --2- 172.21.15.5:0/2354043140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6ec0047d0 0x7ff6ec004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.985+0000 7ff705c9f640 1 -- 172.21.15.5:0/2354043140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6ec005180 msgr2=0x7ff6ec00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:54.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.985+0000 7ff705c9f640 1 --2- 172.21.15.5:0/2354043140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6ec005180 0x7ff6ec00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.985+0000 7ff705c9f640 1 -- 172.21.15.5:0/2354043140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ec003530 con 0x7ff6ec003980 2023-07-14T13:12:54.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.985+0000 7ff7064a0640 1 -- 172.21.15.5:0/2354043140 reap_dead start 2023-07-14T13:12:54.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.985+0000 7ff705c9f640 1 --2- 172.21.15.5:0/2354043140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6ec003980 0x7ff6ec003d90 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00c1c0 tx=0x7ff6fc01cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=128f8ec6538f2d92 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:54.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.989+0000 7ff704c9d640 1 -- 172.21.15.5:0/2354043140 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc005ae0 con 0x7ff6ec003980 2023-07-14T13:12:54.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.989+0000 7ff704c9d640 1 -- 172.21.15.5:0/2354043140 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6fc005c60 con 0x7ff6ec003980 2023-07-14T13:12:54.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.989+0000 7ff704c9d640 1 -- 172.21.15.5:0/2354043140 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc007070 con 0x7ff6ec003980 2023-07-14T13:12:54.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.989+0000 7ff707f03640 1 -- 172.21.15.5:0/2354043140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6ec003980 msgr2=0x7ff6ec003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:54.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.989+0000 7ff707f03640 1 --2- 172.21.15.5:0/2354043140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6ec003980 0x7ff6ec003d90 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00c1c0 tx=0x7ff6fc01cbf0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.989+0000 7ff707f03640 1 -- 172.21.15.5:0/2354043140 shutdown_connections 2023-07-14T13:12:54.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.989+0000 7ff707f03640 1 --2- 172.21.15.5:0/2354043140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6ec003980 0x7ff6ec003d90 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.989+0000 7ff707f03640 1 -- 172.21.15.5:0/2354043140 >> 172.21.15.5:0/2354043140 conn(0x7ff7000afac0 msgr2=0x7ff7000afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:54.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.989+0000 7ff707f03640 1 -- 172.21.15.5:0/2354043140 shutdown_connections 2023-07-14T13:12:54.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.989+0000 7ff707f03640 1 -- 172.21.15.5:0/2354043140 wait complete. 2023-07-14T13:12:54.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.989+0000 7ff707f03640 1 Processor -- start 2023-07-14T13:12:54.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.989+0000 7ff707f03640 1 -- start start 2023-07-14T13:12:54.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.989+0000 7ff707f03640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6ec003980 0x7ff700163200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:54.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.989+0000 7ff707f03640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7000b0dc0 0x7ff700153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:54.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.989+0000 7ff707f03640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7000c9fb0 0x7ff7000ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:54.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.989+0000 7ff707f03640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7000ca970 con 0x7ff6ec003980 2023-07-14T13:12:54.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.989+0000 7ff707f03640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7000b2640 con 0x7ff7000b0dc0 2023-07-14T13:12:54.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.989+0000 7ff707f03640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7001f8e00 con 0x7ff7000c9fb0 2023-07-14T13:12:54.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.989+0000 7ff705c9f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6ec003980 0x7ff700163200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:54.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.989+0000 7ff705c9f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6ec003980 0x7ff700163200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51270/0 (socket says 172.21.15.5:51270) 2023-07-14T13:12:54.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.989+0000 7ff705c9f640 1 -- 172.21.15.5:0/1609532696 learned_addr learned my addr 172.21.15.5:0/1609532696 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:54.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.989+0000 7ff70549e640 1 --2- 172.21.15.5:0/1609532696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7000b0dc0 0x7ff700153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:54.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.993+0000 7ff7064a0640 1 --2- 172.21.15.5:0/1609532696 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7000c9fb0 0x7ff7000ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:54.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.993+0000 7ff705c9f640 1 -- 172.21.15.5:0/1609532696 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7000c9fb0 msgr2=0x7ff7000ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:54.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.993+0000 7ff705c9f640 1 --2- 172.21.15.5:0/1609532696 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7000c9fb0 0x7ff7000ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.993+0000 7ff705c9f640 1 -- 172.21.15.5:0/1609532696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7000b0dc0 msgr2=0x7ff700153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:54.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.993+0000 7ff705c9f640 1 --2- 172.21.15.5:0/1609532696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7000b0dc0 0x7ff700153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.993+0000 7ff705c9f640 1 -- 172.21.15.5:0/1609532696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7000b1630 con 0x7ff6ec003980 2023-07-14T13:12:54.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.993+0000 7ff705c9f640 1 --2- 172.21.15.5:0/1609532696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6ec003980 0x7ff700163200 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc01ca20 tx=0x7ff6ec005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:54.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.993+0000 7ff6f67fc640 1 -- 172.21.15.5:0/1609532696 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc0b4070 con 0x7ff6ec003980 2023-07-14T13:12:54.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.993+0000 7ff6f67fc640 1 -- 172.21.15.5:0/1609532696 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6fc005dd0 con 0x7ff6ec003980 2023-07-14T13:12:54.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.993+0000 7ff707f03640 1 -- 172.21.15.5:0/1609532696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7000b1910 con 0x7ff6ec003980 2023-07-14T13:12:54.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.993+0000 7ff6f67fc640 1 -- 172.21.15.5:0/1609532696 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc001660 con 0x7ff6ec003980 2023-07-14T13:12:54.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.993+0000 7ff707f03640 1 -- 172.21.15.5:0/1609532696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7000b2890 con 0x7ff6ec003980 2023-07-14T13:12:54.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.993+0000 7ff707f03640 1 -- 172.21.15.5:0/1609532696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7000b2ab0 con 0x7ff6ec003980 2023-07-14T13:12:54.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.993+0000 7ff6f67fc640 1 -- 172.21.15.5:0/1609532696 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff6fc007040 con 0x7ff6ec003980 2023-07-14T13:12:54.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.993+0000 7ff6f67fc640 1 --2- 172.21.15.5:0/1609532696 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7ff6e40663a0 0x7ff6e4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:54.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.993+0000 7ff6f67fc640 1 -- 172.21.15.5:0/1609532696 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6055+0+0 (secure 0 0 0) 0x7ff6fc11d800 con 0x7ff6ec003980 2023-07-14T13:12:54.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.997+0000 7ff70549e640 1 --2- 172.21.15.5:0/1609532696 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7ff6e40663a0 0x7ff6e4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:54.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.997+0000 7ff70549e640 1 --2- 172.21.15.5:0/1609532696 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7ff6e40663a0 0x7ff6e4068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff70015de70 tx=0x7ff6f0009190 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:54.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:53.997+0000 7ff6f67fc640 1 -- 172.21.15.5:0/1609532696 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff6fc0eab60 con 0x7ff6ec003980 2023-07-14T13:12:54.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.165+0000 7ff707f03640 1 -- 172.21.15.5:0/1609532696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7ff7000678d0 con 0x7ff6ec003980 2023-07-14T13:12:54.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.169+0000 7ff6f67fc640 1 -- 172.21.15.5:0/1609532696 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v49) v1 ==== 120+0+0 (secure 0 0 0) 0x7ff6fc007cf0 con 0x7ff6ec003980 2023-07-14T13:12:54.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.173+0000 7ff707f03640 1 -- 172.21.15.5:0/1609532696 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7ff6e40663a0 msgr2=0x7ff6e4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:54.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.173+0000 7ff707f03640 1 --2- 172.21.15.5:0/1609532696 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7ff6e40663a0 0x7ff6e4068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff70015de70 tx=0x7ff6f0009190 comp rx=0 tx=0).stop 2023-07-14T13:12:54.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.173+0000 7ff707f03640 1 -- 172.21.15.5:0/1609532696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6ec003980 msgr2=0x7ff700163200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:54.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.173+0000 7ff707f03640 1 --2- 172.21.15.5:0/1609532696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6ec003980 0x7ff700163200 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc01ca20 tx=0x7ff6ec005800 comp rx=0 tx=0).stop 2023-07-14T13:12:54.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.173+0000 7ff707f03640 1 -- 172.21.15.5:0/1609532696 shutdown_connections 2023-07-14T13:12:54.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.173+0000 7ff707f03640 1 --2- 172.21.15.5:0/1609532696 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7ff6e40663a0 0x7ff6e4068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.173+0000 7ff707f03640 1 --2- 172.21.15.5:0/1609532696 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7000c9fb0 0x7ff7000ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.173+0000 7ff707f03640 1 --2- 172.21.15.5:0/1609532696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7000b0dc0 0x7ff700153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.173+0000 7ff707f03640 1 --2- 172.21.15.5:0/1609532696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6ec003980 0x7ff700163200 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.173+0000 7ff707f03640 1 -- 172.21.15.5:0/1609532696 >> 172.21.15.5:0/1609532696 conn(0x7ff7000afac0 msgr2=0x7ff70006b320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:54.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.173+0000 7ff707f03640 1 -- 172.21.15.5:0/1609532696 shutdown_connections 2023-07-14T13:12:54.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.173+0000 7ff707f03640 1 -- 172.21.15.5:0/1609532696 wait complete. 2023-07-14T13:12:54.227 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-14T13:12:54.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.349+0000 7f774e20b640 1 Processor -- start 2023-07-14T13:12:54.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.349+0000 7f774e20b640 1 -- start start 2023-07-14T13:12:54.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.349+0000 7f774e20b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f774815bc40 0x7f7748071630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:54.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.349+0000 7f774e20b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f774815c720 0x7f77480caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:54.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.349+0000 7f774e20b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77480abf90 con 0x7f77480aba90 2023-07-14T13:12:54.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.349+0000 7f774e20b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77480cf2f0 con 0x7f774815c720 2023-07-14T13:12:54.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.349+0000 7f774e20b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77480ac270 con 0x7f774815bc40 2023-07-14T13:12:54.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.349+0000 7f77477fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f774815bc40 0x7f7748071630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:54.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.349+0000 7f7747fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f774815c720 0x7f77480caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:54.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.349+0000 7f7746ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f77480aba90 0x7f774815c010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:45344/0 (socket says 172.21.15.5:45344) 2023-07-14T13:12:54.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.349+0000 7f7746ffd640 1 -- 172.21.15.5:0/2915567656 learned_addr learned my addr 172.21.15.5:0/2915567656 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:54.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.349+0000 7f77467fc640 1 -- 172.21.15.5:0/2915567656 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2573858842 0 0) 0x7f77480abf90 con 0x7f77480aba90 2023-07-14T13:12:54.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.349+0000 7f77467fc640 1 -- 172.21.15.5:0/2915567656 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7730003530 con 0x7f77480aba90 2023-07-14T13:12:54.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.349+0000 7f77477fe640 1 -- 172.21.15.5:0/2915567656 >> v2:172.21.15.154:3300/0 conn(0x7f774815c720 msgr2=0x7f77480caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:54.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.349+0000 7f77477fe640 1 --2- 172.21.15.5:0/2915567656 >> v2:172.21.15.154:3300/0 conn(0x7f774815c720 0x7f77480caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.349+0000 7f77477fe640 1 -- 172.21.15.5:0/2915567656 >> v1:172.21.15.154:6789/0 conn(0x7f77480aba90 legacy=0x7f774815c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:54.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.349+0000 7f77477fe640 1 -- 172.21.15.5:0/2915567656 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77480ac550 con 0x7f774815bc40 2023-07-14T13:12:54.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.349+0000 7f7747fff640 1 --2- 172.21.15.5:0/2915567656 >> v2:172.21.15.154:3300/0 conn(0x7f774815c720 0x7f77480caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:54.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.353+0000 7f77477fe640 1 --2- 172.21.15.5:0/2915567656 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f774815bc40 0x7f7748071630 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f77380097a0 tx=0x7f773801c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55f7bfa3a0af6e8a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:54.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.353+0000 7f77467fc640 1 -- 172.21.15.5:0/2915567656 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77380ab600 con 0x7f774815bc40 2023-07-14T13:12:54.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.353+0000 7f77467fc640 1 -- 172.21.15.5:0/2915567656 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77380a7050 con 0x7f774815bc40 2023-07-14T13:12:54.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.353+0000 7f77467fc640 1 -- 172.21.15.5:0/2915567656 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77380ab980 con 0x7f774815bc40 2023-07-14T13:12:54.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.353+0000 7f774e20b640 1 -- 172.21.15.5:0/2915567656 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f774815bc40 msgr2=0x7f7748071630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:54.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.353+0000 7f774e20b640 1 --2- 172.21.15.5:0/2915567656 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f774815bc40 0x7f7748071630 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f77380097a0 tx=0x7f773801c3a0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.353+0000 7f774e20b640 1 -- 172.21.15.5:0/2915567656 shutdown_connections 2023-07-14T13:12:54.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.353+0000 7f774e20b640 1 --2- 172.21.15.5:0/2915567656 >> v2:172.21.15.154:3300/0 conn(0x7f774815c720 0x7f77480caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.353+0000 7f774e20b640 1 --2- 172.21.15.5:0/2915567656 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f774815bc40 0x7f7748071630 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.353+0000 7f774e20b640 1 -- 172.21.15.5:0/2915567656 >> 172.21.15.5:0/2915567656 conn(0x7f7748070b20 msgr2=0x7f7748070f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:54.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.353+0000 7f774e20b640 1 -- 172.21.15.5:0/2915567656 shutdown_connections 2023-07-14T13:12:54.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.353+0000 7f774e20b640 1 -- 172.21.15.5:0/2915567656 wait complete. 2023-07-14T13:12:54.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.357+0000 7f774e20b640 1 Processor -- start 2023-07-14T13:12:54.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.357+0000 7f774e20b640 1 -- start start 2023-07-14T13:12:54.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.357+0000 7f774e20b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77480aba90 0x7f7748097960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:54.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.357+0000 7f774e20b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f774815bc40 0x7f7748155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:54.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.357+0000 7f774e20b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f774815c720 0x7f7748150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:54.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.357+0000 7f774e20b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77481525f0 con 0x7f774815bc40 2023-07-14T13:12:54.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.357+0000 7f774e20b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7748097ea0 con 0x7f774815c720 2023-07-14T13:12:54.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.357+0000 7f774e20b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7748152840 con 0x7f77480aba90 2023-07-14T13:12:54.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.357+0000 7f7746ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f774815bc40 0x7f7748155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:54.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.357+0000 7f77477fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77480aba90 0x7f7748097960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:54.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.357+0000 7f7747fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f774815c720 0x7f7748150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:54.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.357+0000 7f7746ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f774815bc40 0x7f7748155a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51284/0 (socket says 172.21.15.5:51284) 2023-07-14T13:12:54.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.357+0000 7f7746ffd640 1 -- 172.21.15.5:0/152206160 learned_addr learned my addr 172.21.15.5:0/152206160 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:54.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.357+0000 7f7746ffd640 1 -- 172.21.15.5:0/152206160 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77480aba90 msgr2=0x7f7748097960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:54.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.357+0000 7f7746ffd640 1 --2- 172.21.15.5:0/152206160 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77480aba90 0x7f7748097960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.357+0000 7f7746ffd640 1 -- 172.21.15.5:0/152206160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f774815c720 msgr2=0x7f7748150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:54.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.357+0000 7f7746ffd640 1 --2- 172.21.15.5:0/152206160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f774815c720 0x7f7748150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.357+0000 7f7746ffd640 1 -- 172.21.15.5:0/152206160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7740009a70 con 0x7f774815bc40 2023-07-14T13:12:54.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.357+0000 7f7747fff640 1 --2- 172.21.15.5:0/152206160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f774815c720 0x7f7748150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:54.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.357+0000 7f7746ffd640 1 --2- 172.21.15.5:0/152206160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f774815bc40 0x7f7748155a40 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f773c00c420 tx=0x7f773c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:54.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.357+0000 7f772ffff640 1 -- 172.21.15.5:0/152206160 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773c005cf0 con 0x7f774815bc40 2023-07-14T13:12:54.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.357+0000 7f772ffff640 1 -- 172.21.15.5:0/152206160 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773c005e70 con 0x7f774815bc40 2023-07-14T13:12:54.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.357+0000 7f774e20b640 1 -- 172.21.15.5:0/152206160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77380093b0 con 0x7f774815bc40 2023-07-14T13:12:54.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.357+0000 7f772ffff640 1 -- 172.21.15.5:0/152206160 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773c0072f0 con 0x7f774815bc40 2023-07-14T13:12:54.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.361+0000 7f774e20b640 1 -- 172.21.15.5:0/152206160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7748152e00 con 0x7f774815bc40 2023-07-14T13:12:54.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.361+0000 7f774e20b640 1 -- 172.21.15.5:0/152206160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77480678d0 con 0x7f774815bc40 2023-07-14T13:12:54.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.361+0000 7f772ffff640 1 -- 172.21.15.5:0/152206160 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f773c007450 con 0x7f774815bc40 2023-07-14T13:12:54.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.361+0000 7f772ffff640 1 --2- 172.21.15.5:0/152206160 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f77340663a0 0x7f7734068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:54.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.361+0000 7f772ffff640 1 -- 172.21.15.5:0/152206160 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6055+0+0 (secure 0 0 0) 0x7f773c083330 con 0x7f774815bc40 2023-07-14T13:12:54.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.365+0000 7f77477fe640 1 --2- 172.21.15.5:0/152206160 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f77340663a0 0x7f7734068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:54.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.365+0000 7f77477fe640 1 --2- 172.21.15.5:0/152206160 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f77340663a0 0x7f7734068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f77380ad000 tx=0x7f7738008040 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:54.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.365+0000 7f772ffff640 1 -- 172.21.15.5:0/152206160 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f773c0508a0 con 0x7f774815bc40 2023-07-14T13:12:54.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.521+0000 7f774e20b640 1 -- 172.21.15.5:0/152206160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f774814db90 con 0x7f774815bc40 2023-07-14T13:12:54.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.525+0000 7f772ffff640 1 -- 172.21.15.5:0/152206160 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v50) v1 ==== 104+0+0 (secure 0 0 0) 0x7f773c053ec0 con 0x7f774815bc40 2023-07-14T13:12:54.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.529+0000 7f774e20b640 1 -- 172.21.15.5:0/152206160 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f77340663a0 msgr2=0x7f7734068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:54.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.529+0000 7f774e20b640 1 --2- 172.21.15.5:0/152206160 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f77340663a0 0x7f7734068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f77380ad000 tx=0x7f7738008040 comp rx=0 tx=0).stop 2023-07-14T13:12:54.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.529+0000 7f774e20b640 1 -- 172.21.15.5:0/152206160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f774815bc40 msgr2=0x7f7748155a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:54.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.529+0000 7f774e20b640 1 --2- 172.21.15.5:0/152206160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f774815bc40 0x7f7748155a40 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f773c00c420 tx=0x7f773c00c820 comp rx=0 tx=0).stop 2023-07-14T13:12:54.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.529+0000 7f774e20b640 1 -- 172.21.15.5:0/152206160 shutdown_connections 2023-07-14T13:12:54.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.529+0000 7f774e20b640 1 --2- 172.21.15.5:0/152206160 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f77340663a0 0x7f7734068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.529+0000 7f774e20b640 1 --2- 172.21.15.5:0/152206160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f774815c720 0x7f7748150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.529+0000 7f774e20b640 1 --2- 172.21.15.5:0/152206160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f774815bc40 0x7f7748155a40 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.529+0000 7f774e20b640 1 --2- 172.21.15.5:0/152206160 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77480aba90 0x7f7748097960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.529+0000 7f774e20b640 1 -- 172.21.15.5:0/152206160 >> 172.21.15.5:0/152206160 conn(0x7f7748070b20 msgr2=0x7f77480cd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:54.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.529+0000 7f774e20b640 1 -- 172.21.15.5:0/152206160 shutdown_connections 2023-07-14T13:12:54.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.529+0000 7f774e20b640 1 -- 172.21.15.5:0/152206160 wait complete. 2023-07-14T13:12:54.585 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-14T13:12:54.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.693+0000 7f4b69540640 1 Processor -- start 2023-07-14T13:12:54.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.693+0000 7f4b69540640 1 -- start start 2023-07-14T13:12:54.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.697+0000 7f4b69540640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4b6406cf10 0x7f4b6415c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:54.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.697+0000 7f4b69540640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b640cc000 0x7f4b640cc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:54.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.697+0000 7f4b69540640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b641586e0 con 0x7f4b640c85a0 2023-07-14T13:12:54.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.697+0000 7f4b69540640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b641595a0 con 0x7f4b6406cf10 2023-07-14T13:12:54.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.697+0000 7f4b69540640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6415cc70 con 0x7f4b640cc000 2023-07-14T13:12:54.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.697+0000 7f4b627fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4b6406cf10 0x7f4b6415c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:54.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.697+0000 7f4b637fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b640cc000 0x7f4b640cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:54.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.697+0000 7f4b627fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4b6406cf10 0x7f4b6415c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:55018/0 (socket says 172.21.15.5:55018) 2023-07-14T13:12:54.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.697+0000 7f4b62ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4b640c85a0 0x7f4b640c8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:45346/0 (socket says 172.21.15.5:45346) 2023-07-14T13:12:54.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.697+0000 7f4b627fc640 1 -- 172.21.15.5:0/2973516099 learned_addr learned my addr 172.21.15.5:0/2973516099 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:54.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.697+0000 7f4b637fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b640cc000 0x7f4b640cc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:49908/0 (socket says 172.21.15.5:49908) 2023-07-14T13:12:54.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.697+0000 7f4b627fc640 1 -- 172.21.15.5:0/2973516099 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b640cc000 msgr2=0x7f4b640cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:54.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.697+0000 7f4b627fc640 1 --2- 172.21.15.5:0/2973516099 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b640cc000 0x7f4b640cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.697+0000 7f4b627fc640 1 -- 172.21.15.5:0/2973516099 >> v1:172.21.15.154:6789/0 conn(0x7f4b640c85a0 legacy=0x7f4b640c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:54.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.697+0000 7f4b627fc640 1 -- 172.21.15.5:0/2973516099 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b641560a0 con 0x7f4b6406cf10 2023-07-14T13:12:54.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.697+0000 7f4b61ffb640 1 -- 172.21.15.5:0/2973516099 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280146315 0 0) 0x7f4b54001120 con 0x7f4b640c85a0 2023-07-14T13:12:54.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.701+0000 7f4b627fc640 1 --2- 172.21.15.5:0/2973516099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b6406cf10 0x7f4b6415c730 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009870 tx=0x7f4b5801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3590afe485d57fcb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:54.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.701+0000 7f4b61ffb640 1 -- 172.21.15.5:0/2973516099 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b580ab5f0 con 0x7f4b6406cf10 2023-07-14T13:12:54.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.701+0000 7f4b61ffb640 1 -- 172.21.15.5:0/2973516099 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b580ab750 con 0x7f4b6406cf10 2023-07-14T13:12:54.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.701+0000 7f4b61ffb640 1 -- 172.21.15.5:0/2973516099 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b580abae0 con 0x7f4b6406cf10 2023-07-14T13:12:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.701+0000 7f4b69540640 1 -- 172.21.15.5:0/2973516099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b6406cf10 msgr2=0x7f4b6415c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.701+0000 7f4b69540640 1 --2- 172.21.15.5:0/2973516099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b6406cf10 0x7f4b6415c730 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009870 tx=0x7f4b5801c3f0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.701+0000 7f4b69540640 1 -- 172.21.15.5:0/2973516099 shutdown_connections 2023-07-14T13:12:54.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.701+0000 7f4b69540640 1 --2- 172.21.15.5:0/2973516099 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b640cc000 0x7f4b640cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.701+0000 7f4b69540640 1 --2- 172.21.15.5:0/2973516099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b6406cf10 0x7f4b6415c730 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.701+0000 7f4b69540640 1 -- 172.21.15.5:0/2973516099 >> 172.21.15.5:0/2973516099 conn(0x7f4b640afac0 msgr2=0x7f4b640afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:54.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.701+0000 7f4b69540640 1 -- 172.21.15.5:0/2973516099 shutdown_connections 2023-07-14T13:12:54.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.701+0000 7f4b69540640 1 -- 172.21.15.5:0/2973516099 wait complete. 2023-07-14T13:12:54.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.701+0000 7f4b69540640 1 Processor -- start 2023-07-14T13:12:54.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.701+0000 7f4b69540640 1 -- start start 2023-07-14T13:12:54.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.705+0000 7f4b69540640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6406cf10 0x7f4b640af190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:54.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.705+0000 7f4b69540640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b640c85a0 0x7f4b640c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:54.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.705+0000 7f4b69540640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b640cc000 0x7f4b64157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:54.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.705+0000 7f4b69540640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b641518b0 con 0x7f4b6406cf10 2023-07-14T13:12:54.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.705+0000 7f4b69540640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b640c5130 con 0x7f4b640c85a0 2023-07-14T13:12:54.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.705+0000 7f4b69540640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b640c5410 con 0x7f4b640cc000 2023-07-14T13:12:54.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.705+0000 7f4b62ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6406cf10 0x7f4b640af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:54.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.705+0000 7f4b62ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6406cf10 0x7f4b640af190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51298/0 (socket says 172.21.15.5:51298) 2023-07-14T13:12:54.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.705+0000 7f4b62ffd640 1 -- 172.21.15.5:0/1129152658 learned_addr learned my addr 172.21.15.5:0/1129152658 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:54.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.705+0000 7f4b637fe640 1 --2- 172.21.15.5:0/1129152658 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b640cc000 0x7f4b64157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:54.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.705+0000 7f4b627fc640 1 --2- 172.21.15.5:0/1129152658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b640c85a0 0x7f4b640c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:54.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.705+0000 7f4b62ffd640 1 -- 172.21.15.5:0/1129152658 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b640cc000 msgr2=0x7f4b64157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:54.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.705+0000 7f4b62ffd640 1 --2- 172.21.15.5:0/1129152658 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b640cc000 0x7f4b64157550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.705+0000 7f4b62ffd640 1 -- 172.21.15.5:0/1129152658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b640c85a0 msgr2=0x7f4b640c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:54.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.705+0000 7f4b62ffd640 1 --2- 172.21.15.5:0/1129152658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b640c85a0 0x7f4b640c6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.705+0000 7f4b62ffd640 1 -- 172.21.15.5:0/1129152658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b580094d0 con 0x7f4b6406cf10 2023-07-14T13:12:54.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.705+0000 7f4b62ffd640 1 --2- 172.21.15.5:0/1129152658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6406cf10 0x7f4b640af190 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400c780 tx=0x7f4b5400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:54.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.705+0000 7f4b4b7fe640 1 -- 172.21.15.5:0/1129152658 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b540072d0 con 0x7f4b6406cf10 2023-07-14T13:12:54.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.705+0000 7f4b4b7fe640 1 -- 172.21.15.5:0/1129152658 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b54007430 con 0x7f4b6406cf10 2023-07-14T13:12:54.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.705+0000 7f4b69540640 1 -- 172.21.15.5:0/1129152658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b640c56f0 con 0x7f4b6406cf10 2023-07-14T13:12:54.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.705+0000 7f4b4b7fe640 1 -- 172.21.15.5:0/1129152658 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b54001d20 con 0x7f4b6406cf10 2023-07-14T13:12:54.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.705+0000 7f4b69540640 1 -- 172.21.15.5:0/1129152658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b640b3b80 con 0x7f4b6406cf10 2023-07-14T13:12:54.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.705+0000 7f4b69540640 1 -- 172.21.15.5:0/1129152658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b640c9b40 con 0x7f4b6406cf10 2023-07-14T13:12:54.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.709+0000 7f4b4b7fe640 1 -- 172.21.15.5:0/1129152658 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4b5400a640 con 0x7f4b6406cf10 2023-07-14T13:12:54.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.709+0000 7f4b4b7fe640 1 --2- 172.21.15.5:0/1129152658 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f4b500663a0 0x7f4b50068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:54.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.709+0000 7f4b4b7fe640 1 -- 172.21.15.5:0/1129152658 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6055+0+0 (secure 0 0 0) 0x7f4b540835e0 con 0x7f4b6406cf10 2023-07-14T13:12:54.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.709+0000 7f4b627fc640 1 --2- 172.21.15.5:0/1129152658 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f4b500663a0 0x7f4b50068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:54.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.709+0000 7f4b627fc640 1 --2- 172.21.15.5:0/1129152658 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f4b500663a0 0x7f4b50068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4b580af000 tx=0x7f4b580b6040 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:54.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.709+0000 7f4b4b7fe640 1 -- 172.21.15.5:0/1129152658 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4b540509e0 con 0x7f4b6406cf10 2023-07-14T13:12:54.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.865+0000 7f4b69540640 1 -- 172.21.15.5:0/1129152658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f4b641586e0 con 0x7f4b6406cf10 2023-07-14T13:12:54.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.869+0000 7f4b4b7fe640 1 -- 172.21.15.5:0/1129152658 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v51) v1 ==== 115+0+0 (secure 0 0 0) 0x7f4b641586e0 con 0x7f4b6406cf10 2023-07-14T13:12:54.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.873+0000 7f4b69540640 1 -- 172.21.15.5:0/1129152658 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f4b500663a0 msgr2=0x7f4b50068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:54.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.873+0000 7f4b69540640 1 --2- 172.21.15.5:0/1129152658 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f4b500663a0 0x7f4b50068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4b580af000 tx=0x7f4b580b6040 comp rx=0 tx=0).stop 2023-07-14T13:12:54.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.873+0000 7f4b69540640 1 -- 172.21.15.5:0/1129152658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6406cf10 msgr2=0x7f4b640af190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:54.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.873+0000 7f4b69540640 1 --2- 172.21.15.5:0/1129152658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6406cf10 0x7f4b640af190 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400c780 tx=0x7f4b5400cc40 comp rx=0 tx=0).stop 2023-07-14T13:12:54.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.873+0000 7f4b69540640 1 -- 172.21.15.5:0/1129152658 shutdown_connections 2023-07-14T13:12:54.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.873+0000 7f4b69540640 1 --2- 172.21.15.5:0/1129152658 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f4b500663a0 0x7f4b50068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.873+0000 7f4b69540640 1 --2- 172.21.15.5:0/1129152658 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b640cc000 0x7f4b64157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.873+0000 7f4b69540640 1 --2- 172.21.15.5:0/1129152658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b640c85a0 0x7f4b640c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.873+0000 7f4b69540640 1 --2- 172.21.15.5:0/1129152658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6406cf10 0x7f4b640af190 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:54.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.873+0000 7f4b69540640 1 -- 172.21.15.5:0/1129152658 >> 172.21.15.5:0/1129152658 conn(0x7f4b640afac0 msgr2=0x7f4b6415a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:54.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.873+0000 7f4b69540640 1 -- 172.21.15.5:0/1129152658 shutdown_connections 2023-07-14T13:12:54.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:54.873+0000 7f4b69540640 1 -- 172.21.15.5:0/1129152658 wait complete. 2023-07-14T13:12:54.928 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-07-14T13:12:55.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.037+0000 7f5ed8d74640 1 Processor -- start 2023-07-14T13:12:55.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.037+0000 7f5ed8d74640 1 -- start start 2023-07-14T13:12:55.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.037+0000 7f5ed8d74640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5ed4070b70 0x7f5ed4070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:55.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.037+0000 7f5ed8d74640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ed406b1e0 0x7f5ed40c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:55.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.037+0000 7f5ed8d74640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed40cac70 con 0x7f5ed40c21f0 2023-07-14T13:12:55.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.037+0000 7f5ed8d74640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed4071480 con 0x7f5ed406b1e0 2023-07-14T13:12:55.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.037+0000 7f5ed8d74640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed40ca060 con 0x7f5ed4070b70 2023-07-14T13:12:55.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.037+0000 7f5ecbfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ed406b1e0 0x7f5ed40c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:55.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.037+0000 7f5ecbfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ed406b1e0 0x7f5ed40c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51314/0 (socket says 172.21.15.5:51314) 2023-07-14T13:12:55.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.037+0000 7f5ecbfff640 1 -- 172.21.15.5:0/413169021 learned_addr learned my addr 172.21.15.5:0/413169021 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:55.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.037+0000 7f5ed259c640 1 --2- 172.21.15.5:0/413169021 >> v2:172.21.15.154:3300/0 conn(0x7f5ed4070b70 0x7f5ed4070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:55.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.037+0000 7f5ecbfff640 1 -- 172.21.15.5:0/413169021 >> v2:172.21.15.154:3300/0 conn(0x7f5ed4070b70 msgr2=0x7f5ed4070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:55.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.037+0000 7f5ecbfff640 1 --2- 172.21.15.5:0/413169021 >> v2:172.21.15.154:3300/0 conn(0x7f5ed4070b70 0x7f5ed4070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:55.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.037+0000 7f5ecbfff640 1 -- 172.21.15.5:0/413169021 >> v1:172.21.15.154:6789/0 conn(0x7f5ed40c21f0 legacy=0x7f5ed40cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:55.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.037+0000 7f5ecbfff640 1 -- 172.21.15.5:0/413169021 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed40ca340 con 0x7f5ed406b1e0 2023-07-14T13:12:55.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.041+0000 7f5ecbfff640 1 --2- 172.21.15.5:0/413169021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed406b1e0 0x7f5ed40c1cb0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f5ed406f1f0 tx=0x7f5ebc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17db98fe45144f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:55.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.041+0000 7f5ed1d9b640 1 -- 172.21.15.5:0/413169021 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc0aa5f0 con 0x7f5ed406b1e0 2023-07-14T13:12:55.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.041+0000 7f5ed1d9b640 1 -- 172.21.15.5:0/413169021 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ebc0aa750 con 0x7f5ed406b1e0 2023-07-14T13:12:55.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.041+0000 7f5ed1d9b640 1 -- 172.21.15.5:0/413169021 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc0aaae0 con 0x7f5ed406b1e0 2023-07-14T13:12:55.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.041+0000 7f5ed8d74640 1 -- 172.21.15.5:0/413169021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed406b1e0 msgr2=0x7f5ed40c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:55.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.041+0000 7f5ed8d74640 1 --2- 172.21.15.5:0/413169021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed406b1e0 0x7f5ed40c1cb0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f5ed406f1f0 tx=0x7f5ebc01c490 comp rx=0 tx=0).stop 2023-07-14T13:12:55.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.041+0000 7f5ed8d74640 1 -- 172.21.15.5:0/413169021 shutdown_connections 2023-07-14T13:12:55.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.041+0000 7f5ed8d74640 1 --2- 172.21.15.5:0/413169021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed406b1e0 0x7f5ed40c1cb0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:55.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.041+0000 7f5ed8d74640 1 --2- 172.21.15.5:0/413169021 >> v2:172.21.15.154:3300/0 conn(0x7f5ed4070b70 0x7f5ed4070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:55.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.041+0000 7f5ed8d74640 1 -- 172.21.15.5:0/413169021 >> 172.21.15.5:0/413169021 conn(0x7f5ed40afcf0 msgr2=0x7f5ed40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:55.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.041+0000 7f5ed8d74640 1 -- 172.21.15.5:0/413169021 shutdown_connections 2023-07-14T13:12:55.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.041+0000 7f5ed8d74640 1 -- 172.21.15.5:0/413169021 wait complete. 2023-07-14T13:12:55.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.045+0000 7f5ed8d74640 1 Processor -- start 2023-07-14T13:12:55.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.045+0000 7f5ed8d74640 1 -- start start 2023-07-14T13:12:55.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.045+0000 7f5ed8d74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed406b1e0 0x7f5ed414ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:55.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.045+0000 7f5ed8d74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ed4070b70 0x7f5ed40b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:55.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.045+0000 7f5ed8d74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed40c21f0 0x7f5ed41549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:55.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.045+0000 7f5ed8d74640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed40b1aa0 con 0x7f5ed40c21f0 2023-07-14T13:12:55.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.045+0000 7f5ed8d74640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed40b1d80 con 0x7f5ed4070b70 2023-07-14T13:12:55.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.045+0000 7f5ed8d74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed40b2060 con 0x7f5ed406b1e0 2023-07-14T13:12:55.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.045+0000 7f5ed2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed40c21f0 0x7f5ed41549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:55.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.045+0000 7f5ed2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed40c21f0 0x7f5ed41549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51320/0 (socket says 172.21.15.5:51320) 2023-07-14T13:12:55.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.045+0000 7f5ed2d9d640 1 -- 172.21.15.5:0/930426401 learned_addr learned my addr 172.21.15.5:0/930426401 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:55.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.045+0000 7f5ed259c640 1 --2- 172.21.15.5:0/930426401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed406b1e0 0x7f5ed414ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:55.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.045+0000 7f5ecbfff640 1 --2- 172.21.15.5:0/930426401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ed4070b70 0x7f5ed40b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:55.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.045+0000 7f5ed2d9d640 1 -- 172.21.15.5:0/930426401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed406b1e0 msgr2=0x7f5ed414ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:55.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.045+0000 7f5ed2d9d640 1 --2- 172.21.15.5:0/930426401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed406b1e0 0x7f5ed414ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:55.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.045+0000 7f5ed2d9d640 1 -- 172.21.15.5:0/930426401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ed4070b70 msgr2=0x7f5ed40b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:55.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.045+0000 7f5ed2d9d640 1 --2- 172.21.15.5:0/930426401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ed4070b70 0x7f5ed40b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:55.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.045+0000 7f5ed2d9d640 1 -- 172.21.15.5:0/930426401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ebc0094d0 con 0x7f5ed40c21f0 2023-07-14T13:12:55.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.045+0000 7f5ed2d9d640 1 --2- 172.21.15.5:0/930426401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed40c21f0 0x7f5ed41549e0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00b9e0 tx=0x7f5ecc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:55.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.045+0000 7f5ecaffd640 1 -- 172.21.15.5:0/930426401 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc003b80 con 0x7f5ed40c21f0 2023-07-14T13:12:55.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.045+0000 7f5ecaffd640 1 -- 172.21.15.5:0/930426401 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc003ce0 con 0x7f5ed40c21f0 2023-07-14T13:12:55.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.045+0000 7f5ecaffd640 1 -- 172.21.15.5:0/930426401 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc00cb60 con 0x7f5ed40c21f0 2023-07-14T13:12:55.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.045+0000 7f5ed8d74640 1 -- 172.21.15.5:0/930426401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed40b2340 con 0x7f5ed40c21f0 2023-07-14T13:12:55.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.049+0000 7f5ed8d74640 1 -- 172.21.15.5:0/930426401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed40b3b20 con 0x7f5ed40c21f0 2023-07-14T13:12:55.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.049+0000 7f5ed8d74640 1 -- 172.21.15.5:0/930426401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed40b2860 con 0x7f5ed40c21f0 2023-07-14T13:12:55.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.049+0000 7f5ecaffd640 1 -- 172.21.15.5:0/930426401 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5ecc00ccc0 con 0x7f5ed40c21f0 2023-07-14T13:12:55.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.049+0000 7f5ecaffd640 1 --2- 172.21.15.5:0/930426401 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f5eb40663a0 0x7f5eb4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:55.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.049+0000 7f5ecaffd640 1 -- 172.21.15.5:0/930426401 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6055+0+0 (secure 0 0 0) 0x7f5ecc083b10 con 0x7f5ed40c21f0 2023-07-14T13:12:55.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.049+0000 7f5ed259c640 1 --2- 172.21.15.5:0/930426401 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f5eb40663a0 0x7f5eb4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:55.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.053+0000 7f5ed259c640 1 --2- 172.21.15.5:0/930426401 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f5eb40663a0 0x7f5eb4068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5ed40c8730 tx=0x7f5ec4008040 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:55.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.053+0000 7f5ecaffd640 1 -- 172.21.15.5:0/930426401 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f5ed40b2860 con 0x7f5ed40c21f0 2023-07-14T13:12:55.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.261+0000 7f5ed8d74640 1 -- 172.21.15.5:0/930426401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7f5ed40b2860 con 0x7f5ed40c21f0 2023-07-14T13:12:55.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.809+0000 7f5ecaffd640 1 -- 172.21.15.5:0/930426401 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v784) v1 ==== 174+0+0 (secure 0 0 0) 0x7f5ed40b2860 con 0x7f5ed40c21f0 2023-07-14T13:12:55.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.813+0000 7f5ed8d74640 1 -- 172.21.15.5:0/930426401 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f5eb40663a0 msgr2=0x7f5eb4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:55.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.813+0000 7f5ed8d74640 1 --2- 172.21.15.5:0/930426401 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f5eb40663a0 0x7f5eb4068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5ed40c8730 tx=0x7f5ec4008040 comp rx=0 tx=0).stop 2023-07-14T13:12:55.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.813+0000 7f5ed8d74640 1 -- 172.21.15.5:0/930426401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed40c21f0 msgr2=0x7f5ed41549e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:55.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.813+0000 7f5ed8d74640 1 --2- 172.21.15.5:0/930426401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed40c21f0 0x7f5ed41549e0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00b9e0 tx=0x7f5ecc00bea0 comp rx=0 tx=0).stop 2023-07-14T13:12:55.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.813+0000 7f5ed8d74640 1 -- 172.21.15.5:0/930426401 shutdown_connections 2023-07-14T13:12:55.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.813+0000 7f5ed8d74640 1 --2- 172.21.15.5:0/930426401 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f5eb40663a0 0x7f5eb4068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:55.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.813+0000 7f5ed8d74640 1 --2- 172.21.15.5:0/930426401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed40c21f0 0x7f5ed41549e0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:55.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.813+0000 7f5ed8d74640 1 --2- 172.21.15.5:0/930426401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ed4070b70 0x7f5ed40b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:55.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.813+0000 7f5ed8d74640 1 --2- 172.21.15.5:0/930426401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ed406b1e0 0x7f5ed414ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:55.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.813+0000 7f5ed8d74640 1 -- 172.21.15.5:0/930426401 >> 172.21.15.5:0/930426401 conn(0x7f5ed40afcf0 msgr2=0x7f5ed4163780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:55.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.813+0000 7f5ed8d74640 1 -- 172.21.15.5:0/930426401 shutdown_connections 2023-07-14T13:12:55.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.813+0000 7f5ed8d74640 1 -- 172.21.15.5:0/930426401 wait complete. 2023-07-14T13:12:55.868 INFO:tasks.cephfs_test_runner:Test listing snap schedules post removal of a schedule ... ok 2023-07-14T13:12:55.869 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that snap schedule is resumed after mgr restart 2023-07-14T13:12:55.869 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-14T13:12:55.870 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-07-14T13:12:56.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.981+0000 7fbc44d98640 1 Processor -- start 2023-07-14T13:12:56.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.981+0000 7fbc44d98640 1 -- start start 2023-07-14T13:12:56.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.981+0000 7fbc44d98640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc4015f3f0 0x7fbc400b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:56.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.981+0000 7fbc44d98640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbc400d13f0 0x7fbc400b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:56.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.981+0000 7fbc44d98640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc400d0f60 con 0x7fbc400cc9a0 2023-07-14T13:12:56.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.981+0000 7fbc44d98640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc400cd4e0 con 0x7fbc400d13f0 2023-07-14T13:12:56.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.981+0000 7fbc44d98640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc400d0390 con 0x7fbc4015f3f0 2023-07-14T13:12:56.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.981+0000 7fbc3effd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbc400d13f0 0x7fbc400b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:56.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.981+0000 7fbc3effd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbc400d13f0 0x7fbc400b7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:55058/0 (socket says 172.21.15.5:55058) 2023-07-14T13:12:56.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.981+0000 7fbc3ffff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbc400cc9a0 0x7fbc400ccdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:45368/0 (socket says 172.21.15.5:45368) 2023-07-14T13:12:56.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.981+0000 7fbc3effd640 1 -- 172.21.15.5:0/2143587868 learned_addr learned my addr 172.21.15.5:0/2143587868 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:56.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.981+0000 7fbc3f7fe640 1 --2- 172.21.15.5:0/2143587868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc4015f3f0 0x7fbc400b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:56.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.981+0000 7fbc3effd640 1 -- 172.21.15.5:0/2143587868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc4015f3f0 msgr2=0x7fbc400b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:56.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.981+0000 7fbc3effd640 1 --2- 172.21.15.5:0/2143587868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc4015f3f0 0x7fbc400b7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:56.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.981+0000 7fbc3effd640 1 -- 172.21.15.5:0/2143587868 >> v1:172.21.15.154:6789/0 conn(0x7fbc400cc9a0 legacy=0x7fbc400ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:56.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.981+0000 7fbc3effd640 1 -- 172.21.15.5:0/2143587868 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc400d0630 con 0x7fbc400d13f0 2023-07-14T13:12:56.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.985+0000 7fbc3effd640 1 --2- 172.21.15.5:0/2143587868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc400d13f0 0x7fbc400b7bc0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fbc34009870 tx=0x7fbc3401c340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a23a730acdc7192 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:56.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.985+0000 7fbc3e7fc640 1 -- 172.21.15.5:0/2143587868 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc340ab600 con 0x7fbc400d13f0 2023-07-14T13:12:56.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.985+0000 7fbc3e7fc640 1 -- 172.21.15.5:0/2143587868 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc340a7050 con 0x7fbc400d13f0 2023-07-14T13:12:56.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.985+0000 7fbc3e7fc640 1 -- 172.21.15.5:0/2143587868 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc340ab980 con 0x7fbc400d13f0 2023-07-14T13:12:56.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.985+0000 7fbc44d98640 1 -- 172.21.15.5:0/2143587868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc400d13f0 msgr2=0x7fbc400b7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:56.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.985+0000 7fbc44d98640 1 --2- 172.21.15.5:0/2143587868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc400d13f0 0x7fbc400b7bc0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fbc34009870 tx=0x7fbc3401c340 comp rx=0 tx=0).stop 2023-07-14T13:12:56.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.985+0000 7fbc44d98640 1 -- 172.21.15.5:0/2143587868 shutdown_connections 2023-07-14T13:12:56.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.985+0000 7fbc44d98640 1 --2- 172.21.15.5:0/2143587868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc400d13f0 0x7fbc400b7bc0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:56.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.985+0000 7fbc44d98640 1 --2- 172.21.15.5:0/2143587868 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc4015f3f0 0x7fbc400b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:56.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.985+0000 7fbc44d98640 1 -- 172.21.15.5:0/2143587868 >> 172.21.15.5:0/2143587868 conn(0x7fbc40069f50 msgr2=0x7fbc4006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:56.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.985+0000 7fbc44d98640 1 -- 172.21.15.5:0/2143587868 shutdown_connections 2023-07-14T13:12:56.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.985+0000 7fbc44d98640 1 -- 172.21.15.5:0/2143587868 wait complete. 2023-07-14T13:12:56.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.989+0000 7fbc44d98640 1 Processor -- start 2023-07-14T13:12:56.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.989+0000 7fbc44d98640 1 -- start start 2023-07-14T13:12:56.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.989+0000 7fbc44d98640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc400cc9a0 0x7fbc40154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:56.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.989+0000 7fbc44d98640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc400d13f0 0x7fbc40155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:56.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.989+0000 7fbc44d98640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc4015f3f0 0x7fbc400cb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:56.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.989+0000 7fbc44d98640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc400cc160 con 0x7fbc4015f3f0 2023-07-14T13:12:56.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.989+0000 7fbc44d98640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4015a1b0 con 0x7fbc400cc9a0 2023-07-14T13:12:56.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.989+0000 7fbc44d98640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4015a450 con 0x7fbc400d13f0 2023-07-14T13:12:56.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.989+0000 7fbc3ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc4015f3f0 0x7fbc400cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:56.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.989+0000 7fbc3ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc4015f3f0 0x7fbc400cb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51322/0 (socket says 172.21.15.5:51322) 2023-07-14T13:12:56.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.989+0000 7fbc3ffff640 1 -- 172.21.15.5:0/2833442601 learned_addr learned my addr 172.21.15.5:0/2833442601 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:56.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.989+0000 7fbc3effd640 1 --2- 172.21.15.5:0/2833442601 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc400d13f0 0x7fbc40155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:56.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.989+0000 7fbc3f7fe640 1 --2- 172.21.15.5:0/2833442601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc400cc9a0 0x7fbc40154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:56.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.989+0000 7fbc3ffff640 1 -- 172.21.15.5:0/2833442601 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc400d13f0 msgr2=0x7fbc40155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:56.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.989+0000 7fbc3ffff640 1 --2- 172.21.15.5:0/2833442601 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc400d13f0 0x7fbc40155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:56.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.989+0000 7fbc3ffff640 1 -- 172.21.15.5:0/2833442601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc400cc9a0 msgr2=0x7fbc40154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:56.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.989+0000 7fbc3ffff640 1 --2- 172.21.15.5:0/2833442601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc400cc9a0 0x7fbc40154a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:56.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.989+0000 7fbc3ffff640 1 -- 172.21.15.5:0/2833442601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc340094d0 con 0x7fbc4015f3f0 2023-07-14T13:12:56.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.989+0000 7fbc3ffff640 1 --2- 172.21.15.5:0/2833442601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc4015f3f0 0x7fbc400cb750 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fbc3800c3f0 tx=0x7fbc3800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:56.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.989+0000 7fbc27fff640 1 -- 172.21.15.5:0/2833442601 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc380090d0 con 0x7fbc4015f3f0 2023-07-14T13:12:56.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.989+0000 7fbc27fff640 1 -- 172.21.15.5:0/2833442601 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc38009230 con 0x7fbc4015f3f0 2023-07-14T13:12:56.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.989+0000 7fbc27fff640 1 -- 172.21.15.5:0/2833442601 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc380095e0 con 0x7fbc4015f3f0 2023-07-14T13:12:56.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.989+0000 7fbc44d98640 1 -- 172.21.15.5:0/2833442601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc4015a730 con 0x7fbc4015f3f0 2023-07-14T13:12:56.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.989+0000 7fbc44d98640 1 -- 172.21.15.5:0/2833442601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4015acf0 con 0x7fbc4015f3f0 2023-07-14T13:12:56.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.993+0000 7fbc44d98640 1 -- 172.21.15.5:0/2833442601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc4015aee0 con 0x7fbc4015f3f0 2023-07-14T13:12:56.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.993+0000 7fbc27fff640 1 -- 172.21.15.5:0/2833442601 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbc38009740 con 0x7fbc4015f3f0 2023-07-14T13:12:56.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.993+0000 7fbc27fff640 1 --2- 172.21.15.5:0/2833442601 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fbc2c0663a0 0x7fbc2c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:56.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.993+0000 7fbc27fff640 1 -- 172.21.15.5:0/2833442601 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6055+0+0 (secure 0 0 0) 0x7fbc38085e10 con 0x7fbc4015f3f0 2023-07-14T13:12:56.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.993+0000 7fbc3f7fe640 1 --2- 172.21.15.5:0/2833442601 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fbc2c0663a0 0x7fbc2c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:56.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.993+0000 7fbc3f7fe640 1 --2- 172.21.15.5:0/2833442601 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fbc2c0663a0 0x7fbc2c068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbc30009ac0 tx=0x7fbc30009190 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:56.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:55.997+0000 7fbc27fff640 1 -- 172.21.15.5:0/2833442601 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fbc38089030 con 0x7fbc4015f3f0 2023-07-14T13:12:56.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.209+0000 7fbc44d98640 1 -- 172.21.15.5:0/2833442601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7fbc400678d0 con 0x7fbc4015f3f0 2023-07-14T13:12:56.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.813+0000 7fbc27fff640 1 -- 172.21.15.5:0/2833442601 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v785) v1 ==== 168+0+0 (secure 0 0 0) 0x7fbc3801a0e0 con 0x7fbc4015f3f0 2023-07-14T13:12:56.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.813+0000 7fbc44d98640 1 -- 172.21.15.5:0/2833442601 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fbc2c0663a0 msgr2=0x7fbc2c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:56.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.813+0000 7fbc44d98640 1 --2- 172.21.15.5:0/2833442601 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fbc2c0663a0 0x7fbc2c068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbc30009ac0 tx=0x7fbc30009190 comp rx=0 tx=0).stop 2023-07-14T13:12:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.813+0000 7fbc44d98640 1 -- 172.21.15.5:0/2833442601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc4015f3f0 msgr2=0x7fbc400cb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.813+0000 7fbc44d98640 1 --2- 172.21.15.5:0/2833442601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc4015f3f0 0x7fbc400cb750 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fbc3800c3f0 tx=0x7fbc3800c8b0 comp rx=0 tx=0).stop 2023-07-14T13:12:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.813+0000 7fbc44d98640 1 -- 172.21.15.5:0/2833442601 shutdown_connections 2023-07-14T13:12:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.813+0000 7fbc44d98640 1 --2- 172.21.15.5:0/2833442601 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fbc2c0663a0 0x7fbc2c068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.813+0000 7fbc44d98640 1 --2- 172.21.15.5:0/2833442601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc4015f3f0 0x7fbc400cb750 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.813+0000 7fbc44d98640 1 --2- 172.21.15.5:0/2833442601 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc400d13f0 0x7fbc40155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.813+0000 7fbc44d98640 1 --2- 172.21.15.5:0/2833442601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc400cc9a0 0x7fbc40154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:56.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.813+0000 7fbc44d98640 1 -- 172.21.15.5:0/2833442601 >> 172.21.15.5:0/2833442601 conn(0x7fbc40069f50 msgr2=0x7fbc400b4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:56.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.817+0000 7fbc44d98640 1 -- 172.21.15.5:0/2833442601 shutdown_connections 2023-07-14T13:12:56.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.817+0000 7fbc44d98640 1 -- 172.21.15.5:0/2833442601 wait complete. 2023-07-14T13:12:56.873 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-14T13:12:57.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.985+0000 7fd366476640 1 Processor -- start 2023-07-14T13:12:57.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.985+0000 7fd366476640 1 -- start start 2023-07-14T13:12:57.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd366476640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd360159af0 0x7fd3600cba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:57.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd366476640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd3600cbf40 0x7fd36015d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:57.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd366476640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd36015d450 con 0x7fd360159720 2023-07-14T13:12:57.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd366476640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd36015ac40 con 0x7fd3600cbf40 2023-07-14T13:12:57.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd366476640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36015a3a0 con 0x7fd360159af0 2023-07-14T13:12:57.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd365474640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd360159720 0x7fd3600cd6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37668/0 (socket says 172.21.15.5:37668) 2023-07-14T13:12:57.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd365474640 1 -- 172.21.15.5:0/1474874281 learned_addr learned my addr 172.21.15.5:0/1474874281 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:57.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd365c75640 1 --2- 172.21.15.5:0/1474874281 >> v2:172.21.15.154:3300/0 conn(0x7fd3600cbf40 0x7fd36015d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:57.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd364c73640 1 --2- 172.21.15.5:0/1474874281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd360159af0 0x7fd3600cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:57.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd357fff640 1 -- 172.21.15.5:0/1474874281 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2370159079 0 0) 0x7fd36015d450 con 0x7fd360159720 2023-07-14T13:12:57.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd357fff640 1 -- 172.21.15.5:0/1474874281 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd34c003530 con 0x7fd360159720 2023-07-14T13:12:57.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd357fff640 1 -- 172.21.15.5:0/1474874281 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4036418914 0 0) 0x7fd34c003530 con 0x7fd360159720 2023-07-14T13:12:57.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd357fff640 1 -- 172.21.15.5:0/1474874281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd360159af0 msgr2=0x7fd3600cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:57.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd357fff640 1 --2- 172.21.15.5:0/1474874281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd360159af0 0x7fd3600cba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:57.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd357fff640 1 -- 172.21.15.5:0/1474874281 >> v2:172.21.15.154:3300/0 conn(0x7fd3600cbf40 msgr2=0x7fd36015d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:57.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd357fff640 1 --2- 172.21.15.5:0/1474874281 >> v2:172.21.15.154:3300/0 conn(0x7fd3600cbf40 0x7fd36015d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:57.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd357fff640 1 -- 172.21.15.5:0/1474874281 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36015a680 con 0x7fd360159720 2023-07-14T13:12:57.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd357fff640 1 -- 172.21.15.5:0/1474874281 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7fd35c001680 con 0x7fd360159720 2023-07-14T13:12:57.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd357fff640 1 -- 172.21.15.5:0/1474874281 >> v1:172.21.15.5:6789/0 conn(0x7fd360159720 legacy=0x7fd3600cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:57.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd357fff640 1 --2- 172.21.15.5:0/1474874281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd34c003980 0x7fd34c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:57.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd357fff640 1 --2- 172.21.15.5:0/1474874281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd34c0043b0 0x7fd34c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:57.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd357fff640 1 --2- 172.21.15.5:0/1474874281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd360159af0 0x7fd34c004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:57.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd357fff640 1 -- 172.21.15.5:0/1474874281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36015ac40 con 0x7fd34c003980 2023-07-14T13:12:57.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd357fff640 1 -- 172.21.15.5:0/1474874281 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36015a3a0 con 0x7fd34c0043b0 2023-07-14T13:12:57.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd357fff640 1 -- 172.21.15.5:0/1474874281 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c00b990 con 0x7fd360159af0 2023-07-14T13:12:57.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd365474640 1 --2- 172.21.15.5:0/1474874281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd34c003980 0x7fd34c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:57.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd364c73640 1 --2- 172.21.15.5:0/1474874281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd34c0043b0 0x7fd34c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:57.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd365c75640 1 --2- 172.21.15.5:0/1474874281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd360159af0 0x7fd34c004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:57.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd365474640 1 -- 172.21.15.5:0/1474874281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd360159af0 msgr2=0x7fd34c004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:57.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd365474640 1 --2- 172.21.15.5:0/1474874281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd360159af0 0x7fd34c004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:57.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd365474640 1 -- 172.21.15.5:0/1474874281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd34c0043b0 msgr2=0x7fd34c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:57.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd365474640 1 --2- 172.21.15.5:0/1474874281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd34c0043b0 0x7fd34c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:57.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd365474640 1 -- 172.21.15.5:0/1474874281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c003530 con 0x7fd34c003980 2023-07-14T13:12:57.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.989+0000 7fd365c75640 1 --2- 172.21.15.5:0/1474874281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd360159af0 0x7fd34c004fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:57.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.993+0000 7fd365474640 1 --2- 172.21.15.5:0/1474874281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd34c003980 0x7fd34c003d90 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00c270 tx=0x7fd35c01cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7855f422c8cd56 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:57.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.993+0000 7fd357fff640 1 -- 172.21.15.5:0/1474874281 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c0a5930 con 0x7fd34c003980 2023-07-14T13:12:57.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.993+0000 7fd357fff640 1 -- 172.21.15.5:0/1474874281 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35c0a5a90 con 0x7fd34c003980 2023-07-14T13:12:57.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.993+0000 7fd357fff640 1 -- 172.21.15.5:0/1474874281 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c0a5e60 con 0x7fd34c003980 2023-07-14T13:12:57.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.993+0000 7fd366476640 1 -- 172.21.15.5:0/1474874281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd34c003980 msgr2=0x7fd34c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:57.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.993+0000 7fd366476640 1 --2- 172.21.15.5:0/1474874281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd34c003980 0x7fd34c003d90 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00c270 tx=0x7fd35c01cc30 comp rx=0 tx=0).stop 2023-07-14T13:12:57.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.993+0000 7fd365c75640 1 -- 172.21.15.5:0/1474874281 reap_dead start 2023-07-14T13:12:57.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.993+0000 7fd366476640 1 -- 172.21.15.5:0/1474874281 shutdown_connections 2023-07-14T13:12:57.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.993+0000 7fd366476640 1 -- 172.21.15.5:0/1474874281 >> 172.21.15.5:0/1474874281 conn(0x7fd3600ca8b0 msgr2=0x7fd3600cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:57.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.993+0000 7fd366476640 1 -- 172.21.15.5:0/1474874281 shutdown_connections 2023-07-14T13:12:57.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.993+0000 7fd366476640 1 -- 172.21.15.5:0/1474874281 wait complete. 2023-07-14T13:12:57.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.993+0000 7fd366476640 1 Processor -- start 2023-07-14T13:12:57.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.993+0000 7fd366476640 1 -- start start 2023-07-14T13:12:57.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.997+0000 7fd366476640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd34c003980 0x7fd360158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:57.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.997+0000 7fd366476640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3600b0c60 0x7fd36014f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:57.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.997+0000 7fd366476640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3601561c0 0x7fd360156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:57.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.997+0000 7fd366476640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3601586d0 con 0x7fd34c003980 2023-07-14T13:12:57.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.997+0000 7fd366476640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd360156b80 con 0x7fd3601561c0 2023-07-14T13:12:57.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.997+0000 7fd366476640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3600b1d00 con 0x7fd3600b0c60 2023-07-14T13:12:57.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.997+0000 7fd365474640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd34c003980 0x7fd360158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:57.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.997+0000 7fd365474640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd34c003980 0x7fd360158190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51334/0 (socket says 172.21.15.5:51334) 2023-07-14T13:12:57.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.997+0000 7fd365474640 1 -- 172.21.15.5:0/1007822216 learned_addr learned my addr 172.21.15.5:0/1007822216 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:57.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.997+0000 7fd365474640 1 -- 172.21.15.5:0/1007822216 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3600b0c60 msgr2=0x7fd36014f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:57.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.997+0000 7fd365474640 1 --2- 172.21.15.5:0/1007822216 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3600b0c60 0x7fd36014f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:57.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.997+0000 7fd365474640 1 -- 172.21.15.5:0/1007822216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3601561c0 msgr2=0x7fd360156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:57.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.997+0000 7fd365c75640 1 --2- 172.21.15.5:0/1007822216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3601561c0 0x7fd360156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:57.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.997+0000 7fd365474640 1 --2- 172.21.15.5:0/1007822216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3601561c0 0x7fd360156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:57.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.997+0000 7fd365474640 1 -- 172.21.15.5:0/1007822216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36014fdf0 con 0x7fd34c003980 2023-07-14T13:12:57.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.997+0000 7fd365c75640 1 --2- 172.21.15.5:0/1007822216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3601561c0 0x7fd360156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:12:57.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.997+0000 7fd365474640 1 --2- 172.21.15.5:0/1007822216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd34c003980 0x7fd360158190 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fd35c0ab040 tx=0x7fd34c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:57.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.997+0000 7fd355ffb640 1 -- 172.21.15.5:0/1007822216 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c0049f0 con 0x7fd34c003980 2023-07-14T13:12:57.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.997+0000 7fd355ffb640 1 -- 172.21.15.5:0/1007822216 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35c0b3070 con 0x7fd34c003980 2023-07-14T13:12:57.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.997+0000 7fd355ffb640 1 -- 172.21.15.5:0/1007822216 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c004d50 con 0x7fd34c003980 2023-07-14T13:12:57.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.997+0000 7fd366476640 1 -- 172.21.15.5:0/1007822216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3600b10f0 con 0x7fd34c003980 2023-07-14T13:12:57.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.997+0000 7fd366476640 1 -- 172.21.15.5:0/1007822216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3600b16b0 con 0x7fd34c003980 2023-07-14T13:12:57.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:56.997+0000 7fd366476640 1 -- 172.21.15.5:0/1007822216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd36004e020 con 0x7fd34c003980 2023-07-14T13:12:57.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.001+0000 7fd355ffb640 1 -- 172.21.15.5:0/1007822216 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd35c0070d0 con 0x7fd34c003980 2023-07-14T13:12:57.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.001+0000 7fd355ffb640 1 --2- 172.21.15.5:0/1007822216 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fd3440663a0 0x7fd344068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:57.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.001+0000 7fd355ffb640 1 -- 172.21.15.5:0/1007822216 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6055+0+0 (secure 0 0 0) 0x7fd35c0b5070 con 0x7fd34c003980 2023-07-14T13:12:57.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.001+0000 7fd364c73640 1 --2- 172.21.15.5:0/1007822216 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fd3440663a0 0x7fd344068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:57.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.001+0000 7fd364c73640 1 --2- 172.21.15.5:0/1007822216 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fd3440663a0 0x7fd344068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd3600b05c0 tx=0x7fd350009340 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:57.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.005+0000 7fd355ffb640 1 -- 172.21.15.5:0/1007822216 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd35c0eb540 con 0x7fd34c003980 2023-07-14T13:12:57.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.161+0000 7fd366476640 1 -- 172.21.15.5:0/1007822216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd360154380 con 0x7fd34c003980 2023-07-14T13:12:57.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.165+0000 7fd355ffb640 1 -- 172.21.15.5:0/1007822216 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v52)=0 v52) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd35c0eeb60 con 0x7fd34c003980 2023-07-14T13:12:57.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.165+0000 7fd366476640 1 -- 172.21.15.5:0/1007822216 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fd3440663a0 msgr2=0x7fd344068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:57.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.165+0000 7fd366476640 1 --2- 172.21.15.5:0/1007822216 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fd3440663a0 0x7fd344068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd3600b05c0 tx=0x7fd350009340 comp rx=0 tx=0).stop 2023-07-14T13:12:57.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.165+0000 7fd366476640 1 -- 172.21.15.5:0/1007822216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd34c003980 msgr2=0x7fd360158190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:57.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.165+0000 7fd366476640 1 --2- 172.21.15.5:0/1007822216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd34c003980 0x7fd360158190 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fd35c0ab040 tx=0x7fd34c005800 comp rx=0 tx=0).stop 2023-07-14T13:12:57.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.165+0000 7fd366476640 1 -- 172.21.15.5:0/1007822216 shutdown_connections 2023-07-14T13:12:57.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.165+0000 7fd366476640 1 --2- 172.21.15.5:0/1007822216 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fd3440663a0 0x7fd344068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:57.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.165+0000 7fd366476640 1 --2- 172.21.15.5:0/1007822216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3601561c0 0x7fd360156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:57.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.165+0000 7fd366476640 1 --2- 172.21.15.5:0/1007822216 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3600b0c60 0x7fd36014f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:57.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.165+0000 7fd366476640 1 --2- 172.21.15.5:0/1007822216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd34c003980 0x7fd360158190 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:57.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.165+0000 7fd366476640 1 -- 172.21.15.5:0/1007822216 >> 172.21.15.5:0/1007822216 conn(0x7fd3600ca8b0 msgr2=0x7fd36015c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:57.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.165+0000 7fd366476640 1 -- 172.21.15.5:0/1007822216 shutdown_connections 2023-07-14T13:12:57.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.165+0000 7fd366476640 1 -- 172.21.15.5:0/1007822216 wait complete. 2023-07-14T13:12:57.222 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T13:12:57.222 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:12:57.286 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:12:57.346 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T13:12:57.347 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:12:57.347 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:12:57.356 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:12:57.357 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:12:57.357 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:12:57.366 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:12:57.367 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:12:57.367 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:12:57.411 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:12:57.411 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:12:57.412 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:12:57.421 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:12:57.421 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-14T13:12:57.421 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:12:57.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.561+0000 7f53f76cb640 1 Processor -- start 2023-07-14T13:12:57.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.561+0000 7f53f76cb640 1 -- start start 2023-07-14T13:12:57.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.561+0000 7f53f76cb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f53f00ae1f0 0x7f53f00b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:57.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.561+0000 7f53f76cb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53f006e160 0x7f53f006bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:57.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.561+0000 7f53f76cb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f53f006c260 0x7f53f015f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:57.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.561+0000 7f53f76cb640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f006c680 con 0x7f53f00ae1f0 2023-07-14T13:12:57.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.561+0000 7f53f76cb640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f00b24f0 con 0x7f53f006c260 2023-07-14T13:12:57.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.561+0000 7f53f76cb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f00b27d0 con 0x7f53f006e160 2023-07-14T13:12:57.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.561+0000 7f53f5467640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f53f00ae1f0 0x7f53f00b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:57.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.561+0000 7f53f5467640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f53f00ae1f0 0x7f53f00b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51344/0 (socket says 172.21.15.5:51344) 2023-07-14T13:12:57.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.561+0000 7f53f5467640 1 -- 172.21.15.5:0/869475245 learned_addr learned my addr 172.21.15.5:0/869475245 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:57.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.561+0000 7f53f5467640 1 -- 172.21.15.5:0/869475245 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53f006e160 msgr2=0x7f53f006bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:57.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.561+0000 7f53f5467640 1 --2- 172.21.15.5:0/869475245 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53f006e160 0x7f53f006bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:57.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.561+0000 7f53f5467640 1 -- 172.21.15.5:0/869475245 >> v2:172.21.15.154:3300/0 conn(0x7f53f006c260 msgr2=0x7f53f015f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:57.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.561+0000 7f53f5467640 1 --2- 172.21.15.5:0/869475245 >> v2:172.21.15.154:3300/0 conn(0x7f53f006c260 0x7f53f015f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:57.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.561+0000 7f53f5467640 1 -- 172.21.15.5:0/869475245 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f00b2ab0 con 0x7f53f00ae1f0 2023-07-14T13:12:57.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.565+0000 7f53f5467640 1 --2- 172.21.15.5:0/869475245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53f00ae1f0 0x7f53f00b1e60 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f53f006fc20 tx=0x7f53ec01c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a82a20a62af8990 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:57.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.565+0000 7f53e7fff640 1 -- 172.21.15.5:0/869475245 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec0ab600 con 0x7f53f00ae1f0 2023-07-14T13:12:57.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.565+0000 7f53e7fff640 1 -- 172.21.15.5:0/869475245 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ec0a7050 con 0x7f53f00ae1f0 2023-07-14T13:12:57.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.565+0000 7f53e7fff640 1 -- 172.21.15.5:0/869475245 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec0ab980 con 0x7f53f00ae1f0 2023-07-14T13:12:57.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.565+0000 7f53f76cb640 1 -- 172.21.15.5:0/869475245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53f00ae1f0 msgr2=0x7f53f00b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:57.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.565+0000 7f53f76cb640 1 --2- 172.21.15.5:0/869475245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53f00ae1f0 0x7f53f00b1e60 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f53f006fc20 tx=0x7f53ec01c210 comp rx=0 tx=0).stop 2023-07-14T13:12:57.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.565+0000 7f53f76cb640 1 -- 172.21.15.5:0/869475245 shutdown_connections 2023-07-14T13:12:57.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.565+0000 7f53f76cb640 1 --2- 172.21.15.5:0/869475245 >> v2:172.21.15.154:3300/0 conn(0x7f53f006c260 0x7f53f015f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:57.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.565+0000 7f53f76cb640 1 --2- 172.21.15.5:0/869475245 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53f006e160 0x7f53f006bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:57.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.565+0000 7f53f76cb640 1 --2- 172.21.15.5:0/869475245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53f00ae1f0 0x7f53f00b1e60 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:57.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.565+0000 7f53f76cb640 1 -- 172.21.15.5:0/869475245 >> 172.21.15.5:0/869475245 conn(0x7f53f00b1300 msgr2=0x7f53f00ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:57.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.565+0000 7f53f76cb640 1 -- 172.21.15.5:0/869475245 shutdown_connections 2023-07-14T13:12:57.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.565+0000 7f53f76cb640 1 -- 172.21.15.5:0/869475245 wait complete. 2023-07-14T13:12:57.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.569+0000 7f53f76cb640 1 Processor -- start 2023-07-14T13:12:57.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.569+0000 7f53f76cb640 1 -- start start 2023-07-14T13:12:57.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.569+0000 7f53f76cb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53f006c260 0x7f53f015af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:57.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.569+0000 7f53f76cb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53f006e160 0x7f53f01621f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:57.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.569+0000 7f53f76cb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53f00ae1f0 0x7f53f0162730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:57.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.569+0000 7f53f76cb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f0161a00 con 0x7f53f006c260 2023-07-14T13:12:57.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.569+0000 7f53f76cb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f0163470 con 0x7f53f00ae1f0 2023-07-14T13:12:57.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.569+0000 7f53f76cb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f01613b0 con 0x7f53f006e160 2023-07-14T13:12:57.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.569+0000 7f53f5467640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53f006c260 0x7f53f015af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:57.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.569+0000 7f53f5467640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53f006c260 0x7f53f015af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51350/0 (socket says 172.21.15.5:51350) 2023-07-14T13:12:57.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.569+0000 7f53f5467640 1 -- 172.21.15.5:0/3947896486 learned_addr learned my addr 172.21.15.5:0/3947896486 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:57.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.569+0000 7f53f5c68640 1 --2- 172.21.15.5:0/3947896486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53f00ae1f0 0x7f53f0162730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:57.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.569+0000 7f53f4c66640 1 --2- 172.21.15.5:0/3947896486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53f006e160 0x7f53f01621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:57.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.569+0000 7f53f5467640 1 -- 172.21.15.5:0/3947896486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53f006e160 msgr2=0x7f53f01621f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:57.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.569+0000 7f53f5467640 1 --2- 172.21.15.5:0/3947896486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53f006e160 0x7f53f01621f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:57.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.569+0000 7f53f5467640 1 -- 172.21.15.5:0/3947896486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53f00ae1f0 msgr2=0x7f53f0162730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:57.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.569+0000 7f53f5467640 1 --2- 172.21.15.5:0/3947896486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53f00ae1f0 0x7f53f0162730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:57.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.569+0000 7f53f5467640 1 -- 172.21.15.5:0/3947896486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ec0094d0 con 0x7f53f006c260 2023-07-14T13:12:57.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.569+0000 7f53f5467640 1 --2- 172.21.15.5:0/3947896486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53f006c260 0x7f53f015af90 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f53ec01cab0 tx=0x7f53ec01aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:57.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.569+0000 7f53e5ffb640 1 -- 172.21.15.5:0/3947896486 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec0b6620 con 0x7f53f006c260 2023-07-14T13:12:57.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.569+0000 7f53e5ffb640 1 -- 172.21.15.5:0/3947896486 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ec0b67a0 con 0x7f53f006c260 2023-07-14T13:12:57.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.569+0000 7f53f76cb640 1 -- 172.21.15.5:0/3947896486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f00b3710 con 0x7f53f006c260 2023-07-14T13:12:57.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.569+0000 7f53e5ffb640 1 -- 172.21.15.5:0/3947896486 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec0b6b50 con 0x7f53f006c260 2023-07-14T13:12:57.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.569+0000 7f53f76cb640 1 -- 172.21.15.5:0/3947896486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f0161620 con 0x7f53f006c260 2023-07-14T13:12:57.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.573+0000 7f53f76cb640 1 -- 172.21.15.5:0/3947896486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f006e550 con 0x7f53f006c260 2023-07-14T13:12:57.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.573+0000 7f53e5ffb640 1 -- 172.21.15.5:0/3947896486 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f53ec0b2040 con 0x7f53f006c260 2023-07-14T13:12:57.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.573+0000 7f53e5ffb640 1 --2- 172.21.15.5:0/3947896486 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f53d40663a0 0x7f53d4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:57.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.573+0000 7f53e5ffb640 1 -- 172.21.15.5:0/3947896486 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6055+0+0 (secure 0 0 0) 0x7f53ec11e390 con 0x7f53f006c260 2023-07-14T13:12:57.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.573+0000 7f53f4c66640 1 --2- 172.21.15.5:0/3947896486 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f53d40663a0 0x7f53d4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:57.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.573+0000 7f53f4c66640 1 --2- 172.21.15.5:0/3947896486 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f53d40663a0 0x7f53d4068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f53e0006fd0 tx=0x7f53e0008040 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:57.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.577+0000 7f53e5ffb640 1 -- 172.21.15.5:0/3947896486 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f53f006e550 con 0x7f53f006c260 2023-07-14T13:12:57.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.765+0000 7f53f76cb640 1 -- 172.21.15.5:0/3947896486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53f006e550 con 0x7f53f006c260 2023-07-14T13:12:57.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.765+0000 7f53e5ffb640 1 -- 172.21.15.5:0/3947896486 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f53ec0bade0 con 0x7f53f006c260 2023-07-14T13:12:57.801 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:57.801 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":67,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7373,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/3424293950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3424293950},{"type":"v1","addr":"172.21.15.5:6834","nonce":3424293950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7379,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/1672977104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1672977104},{"type":"v1","addr":"172.21.15.154:6836","nonce":1672977104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":8401,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2517721716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2517721716},{"type":"v1","addr":"172.21.15.154:6837","nonce":2517721716}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":9270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1424451487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":1424451487},{"type":"v1","addr":"172.21.15.5:6835","nonce":1424451487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67}],"filesystems":[]} 2023-07-14T13:12:57.802 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 67 2023-07-14T13:12:57.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.765+0000 7f53f76cb640 1 -- 172.21.15.5:0/3947896486 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f53d40663a0 msgr2=0x7f53d4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:57.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.765+0000 7f53f76cb640 1 --2- 172.21.15.5:0/3947896486 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f53d40663a0 0x7f53d4068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f53e0006fd0 tx=0x7f53e0008040 comp rx=0 tx=0).stop 2023-07-14T13:12:57.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.765+0000 7f53f76cb640 1 -- 172.21.15.5:0/3947896486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53f006c260 msgr2=0x7f53f015af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:57.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.765+0000 7f53f76cb640 1 --2- 172.21.15.5:0/3947896486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53f006c260 0x7f53f015af90 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f53ec01cab0 tx=0x7f53ec01aa50 comp rx=0 tx=0).stop 2023-07-14T13:12:57.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.765+0000 7f53f76cb640 1 -- 172.21.15.5:0/3947896486 shutdown_connections 2023-07-14T13:12:57.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.765+0000 7f53f76cb640 1 --2- 172.21.15.5:0/3947896486 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f53d40663a0 0x7f53d4068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:57.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.765+0000 7f53f76cb640 1 --2- 172.21.15.5:0/3947896486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53f00ae1f0 0x7f53f0162730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:57.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.765+0000 7f53f76cb640 1 --2- 172.21.15.5:0/3947896486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53f006e160 0x7f53f01621f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:57.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.765+0000 7f53f76cb640 1 --2- 172.21.15.5:0/3947896486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f53f006c260 0x7f53f015af90 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:57.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.765+0000 7f53f76cb640 1 -- 172.21.15.5:0/3947896486 >> 172.21.15.5:0/3947896486 conn(0x7f53f00b1300 msgr2=0x7f53f00ad2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:57.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.765+0000 7f53f76cb640 1 -- 172.21.15.5:0/3947896486 shutdown_connections 2023-07-14T13:12:57.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:57.765+0000 7f53f76cb640 1 -- 172.21.15.5:0/3947896486 wait complete. 2023-07-14T13:12:57.821 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-14T13:12:57.822 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-14T13:12:57.822 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-14T13:12:57.822 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:12:57.822 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-14T13:12:57.823 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-14T13:12:57.823 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-14T13:12:57.823 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:12:57.823 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-14T13:12:57.823 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-14T13:12:57.824 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-14T13:12:57.824 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:12:57.824 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-14T13:12:57.824 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-14T13:12:57.825 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-14T13:12:57.825 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:12:57.835 INFO:tasks.ceph.mds.a:Stopped 2023-07-14T13:12:57.836 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-14T13:12:57.837 INFO:tasks.ceph.mds.c:Stopped 2023-07-14T13:12:57.837 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-14T13:12:57.839 INFO:tasks.ceph.mds.d:Stopped 2023-07-14T13:12:57.840 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-14T13:12:57.840 INFO:tasks.ceph.mds.b:Stopped 2023-07-14T13:12:57.841 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-14T13:12:57.883 INFO:tasks.ceph.mds.a:Started 2023-07-14T13:12:57.884 DEBUG:teuthology.parallel:result is None 2023-07-14T13:12:57.885 INFO:tasks.ceph.mds.c:Started 2023-07-14T13:12:57.886 DEBUG:teuthology.parallel:result is None 2023-07-14T13:12:57.890 INFO:tasks.ceph.mds.d:Started 2023-07-14T13:12:57.890 DEBUG:teuthology.parallel:result is None 2023-07-14T13:12:57.892 INFO:tasks.ceph.mds.b:Started 2023-07-14T13:12:57.893 DEBUG:teuthology.parallel:result is None 2023-07-14T13:12:57.893 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-14T13:12:57.974 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-07-14T13:12:57.974 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-07-14T13:12:57.984 INFO:tasks.ceph.mds.b.smithi154.stdout:starting mds.b at 2023-07-14T13:12:57.984 INFO:tasks.ceph.mds.d.smithi154.stdout:starting mds.d at 2023-07-14T13:12:58.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.005+0000 7f155d293640 1 Processor -- start 2023-07-14T13:12:58.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.005+0000 7f155d293640 1 -- start start 2023-07-14T13:12:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.009+0000 7f155d293640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f155815f500 0x7f155806cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:58.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.009+0000 7f155d293640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f155806ac50 0x7f15580ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:58.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.009+0000 7f155d293640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15580cdc80 con 0x7f155806d430 2023-07-14T13:12:58.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.009+0000 7f155d293640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f155806e4c0 con 0x7f155815f500 2023-07-14T13:12:58.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.009+0000 7f155d293640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155806d940 con 0x7f155806ac50 2023-07-14T13:12:58.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.009+0000 7f154ffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f155806d430 0x7f155806a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37684/0 (socket says 172.21.15.5:37684) 2023-07-14T13:12:58.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.009+0000 7f154ffff640 1 -- 172.21.15.5:0/3514549390 learned_addr learned my addr 172.21.15.5:0/3514549390 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:58.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.009+0000 7f1556ffd640 1 --2- 172.21.15.5:0/3514549390 >> v2:172.21.15.154:3300/0 conn(0x7f155815f500 0x7f155806cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:58.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.009+0000 7f15577fe640 1 --2- 172.21.15.5:0/3514549390 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f155806ac50 0x7f15580ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:58.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.009+0000 7f15567fc640 1 -- 172.21.15.5:0/3514549390 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221676404 0 0) 0x7f15580cdc80 con 0x7f155806d430 2023-07-14T13:12:58.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.009+0000 7f15567fc640 1 -- 172.21.15.5:0/3514549390 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1544003530 con 0x7f155806d430 2023-07-14T13:12:58.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.009+0000 7f15567fc640 1 -- 172.21.15.5:0/3514549390 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1647584644 0 0) 0x7f1544003530 con 0x7f155806d430 2023-07-14T13:12:58.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.009+0000 7f15577fe640 1 -- 172.21.15.5:0/3514549390 >> v2:172.21.15.154:3300/0 conn(0x7f155815f500 msgr2=0x7f155806cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:58.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.009+0000 7f15577fe640 1 --2- 172.21.15.5:0/3514549390 >> v2:172.21.15.154:3300/0 conn(0x7f155815f500 0x7f155806cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:58.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.009+0000 7f15577fe640 1 -- 172.21.15.5:0/3514549390 >> v1:172.21.15.5:6789/0 conn(0x7f155806d430 legacy=0x7f155806a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:58.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.009+0000 7f15577fe640 1 -- 172.21.15.5:0/3514549390 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155806dc20 con 0x7f155806ac50 2023-07-14T13:12:58.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.013+0000 7f15577fe640 1 --2- 172.21.15.5:0/3514549390 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f155806ac50 0x7f15580ce0f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1550009d90 tx=0x7f155001c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9902433de312926a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:58.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.013+0000 7f15567fc640 1 -- 172.21.15.5:0/3514549390 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1540001680 con 0x7f155806ac50 2023-07-14T13:12:58.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.013+0000 7f15567fc640 1 -- 172.21.15.5:0/3514549390 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15500a5560 con 0x7f155806ac50 2023-07-14T13:12:58.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.013+0000 7f15567fc640 1 -- 172.21.15.5:0/3514549390 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15500a58f0 con 0x7f155806ac50 2023-07-14T13:12:58.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.013+0000 7f155d293640 1 -- 172.21.15.5:0/3514549390 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f155806ac50 msgr2=0x7f15580ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:58.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.013+0000 7f155d293640 1 --2- 172.21.15.5:0/3514549390 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f155806ac50 0x7f15580ce0f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1550009d90 tx=0x7f155001c870 comp rx=0 tx=0).stop 2023-07-14T13:12:58.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.013+0000 7f155d293640 1 -- 172.21.15.5:0/3514549390 shutdown_connections 2023-07-14T13:12:58.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.013+0000 7f155d293640 1 --2- 172.21.15.5:0/3514549390 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f155806ac50 0x7f15580ce0f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:58.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.013+0000 7f155d293640 1 --2- 172.21.15.5:0/3514549390 >> v2:172.21.15.154:3300/0 conn(0x7f155815f500 0x7f155806cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:58.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.013+0000 7f155d293640 1 -- 172.21.15.5:0/3514549390 >> 172.21.15.5:0/3514549390 conn(0x7f15580659d0 msgr2=0x7f1558099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:58.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.013+0000 7f155d293640 1 -- 172.21.15.5:0/3514549390 shutdown_connections 2023-07-14T13:12:58.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.013+0000 7f155d293640 1 -- 172.21.15.5:0/3514549390 wait complete. 2023-07-14T13:12:58.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.013+0000 7f155d293640 1 Processor -- start 2023-07-14T13:12:58.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.013+0000 7f155d293640 1 -- start start 2023-07-14T13:12:58.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.017+0000 7f155d293640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f155806ac50 0x7f1558155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:58.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.017+0000 7f155d293640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f155806d430 0x7f15580b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:58.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.017+0000 7f155d293640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f155815f500 0x7f15581516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:58.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.017+0000 7f155d293640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15580cb8d0 con 0x7f155815f500 2023-07-14T13:12:58.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.017+0000 7f155d293640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15581563c0 con 0x7f155806ac50 2023-07-14T13:12:58.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.017+0000 7f155d293640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15580cbb90 con 0x7f155806d430 2023-07-14T13:12:58.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.017+0000 7f15577fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f155815f500 0x7f15581516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:58.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.017+0000 7f15577fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f155815f500 0x7f15581516e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51386/0 (socket says 172.21.15.5:51386) 2023-07-14T13:12:58.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.017+0000 7f15577fe640 1 -- 172.21.15.5:0/3725129759 learned_addr learned my addr 172.21.15.5:0/3725129759 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:58.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.017+0000 7f1556ffd640 1 --2- 172.21.15.5:0/3725129759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f155806ac50 0x7f1558155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.017+0000 7f154ffff640 1 --2- 172.21.15.5:0/3725129759 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f155806d430 0x7f15580b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.017+0000 7f15577fe640 1 -- 172.21.15.5:0/3725129759 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f155806d430 msgr2=0x7f15580b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.017+0000 7f15577fe640 1 --2- 172.21.15.5:0/3725129759 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f155806d430 0x7f15580b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.017+0000 7f15577fe640 1 -- 172.21.15.5:0/3725129759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f155806ac50 msgr2=0x7f1558155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.017+0000 7f15577fe640 1 --2- 172.21.15.5:0/3725129759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f155806ac50 0x7f1558155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.017+0000 7f15577fe640 1 -- 172.21.15.5:0/3725129759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1550009a70 con 0x7f155815f500 2023-07-14T13:12:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.017+0000 7f1556ffd640 1 --2- 172.21.15.5:0/3725129759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f155806ac50 0x7f1558155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:58.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.017+0000 7f15577fe640 1 --2- 172.21.15.5:0/3725129759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f155815f500 0x7f15581516e0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f155001d110 tx=0x7f1550019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:58.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.017+0000 7f154f7fe640 1 -- 172.21.15.5:0/3725129759 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15500b9650 con 0x7f155815f500 2023-07-14T13:12:58.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.017+0000 7f154f7fe640 1 -- 172.21.15.5:0/3725129759 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15500b97b0 con 0x7f155815f500 2023-07-14T13:12:58.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.017+0000 7f154f7fe640 1 -- 172.21.15.5:0/3725129759 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15500b9b40 con 0x7f155815f500 2023-07-14T13:12:58.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.017+0000 7f155d293640 1 -- 172.21.15.5:0/3725129759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15580b5af0 con 0x7f155815f500 2023-07-14T13:12:58.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.017+0000 7f155d293640 1 -- 172.21.15.5:0/3725129759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1558155e00 con 0x7f155815f500 2023-07-14T13:12:58.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.017+0000 7f155d293640 1 -- 172.21.15.5:0/3725129759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15580664c0 con 0x7f155815f500 2023-07-14T13:12:58.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.017+0000 7f154f7fe640 1 -- 172.21.15.5:0/3725129759 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f15500b9ca0 con 0x7f155815f500 2023-07-14T13:12:58.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.021+0000 7f154f7fe640 1 --2- 172.21.15.5:0/3725129759 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f15380663d0 0x7f1538068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:58.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.021+0000 7f154f7fe640 1 -- 172.21.15.5:0/3725129759 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6055+0+0 (secure 0 0 0) 0x7f155011e930 con 0x7f155815f500 2023-07-14T13:12:58.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.021+0000 7f1556ffd640 1 --2- 172.21.15.5:0/3725129759 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f15380663d0 0x7f1538068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:58.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.021+0000 7f1556ffd640 1 --2- 172.21.15.5:0/3725129759 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f15380663d0 0x7f1538068880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1548009af0 tx=0x7f1548008040 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:58.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.025+0000 7f154f7fe640 1 -- 172.21.15.5:0/3725129759 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f15500ebc90 con 0x7f155815f500 2023-07-14T13:12:58.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:58.205+0000 7f155d293640 1 -- 172.21.15.5:0/3725129759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f15580678d0 con 0x7f155815f500 2023-07-14T13:12:59.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.185+0000 7f154f7fe640 1 -- 172.21.15.5:0/3725129759 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v152) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1550009450 con 0x7f155815f500 2023-07-14T13:12:59.223 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2023-07-14T13:12:59.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.189+0000 7f155d293640 1 -- 172.21.15.5:0/3725129759 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f15380663d0 msgr2=0x7f1538068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:59.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.189+0000 7f155d293640 1 --2- 172.21.15.5:0/3725129759 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f15380663d0 0x7f1538068880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1548009af0 tx=0x7f1548008040 comp rx=0 tx=0).stop 2023-07-14T13:12:59.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.189+0000 7f155d293640 1 -- 172.21.15.5:0/3725129759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f155815f500 msgr2=0x7f15581516e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:59.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.189+0000 7f155d293640 1 --2- 172.21.15.5:0/3725129759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f155815f500 0x7f15581516e0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f155001d110 tx=0x7f1550019610 comp rx=0 tx=0).stop 2023-07-14T13:12:59.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.189+0000 7f155d293640 1 -- 172.21.15.5:0/3725129759 shutdown_connections 2023-07-14T13:12:59.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.189+0000 7f155d293640 1 --2- 172.21.15.5:0/3725129759 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f15380663d0 0x7f1538068880 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:59.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.189+0000 7f155d293640 1 --2- 172.21.15.5:0/3725129759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f155815f500 0x7f15581516e0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:59.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.189+0000 7f155d293640 1 --2- 172.21.15.5:0/3725129759 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f155806d430 0x7f15580b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:59.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.189+0000 7f155d293640 1 --2- 172.21.15.5:0/3725129759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f155806ac50 0x7f1558155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:59.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.189+0000 7f155d293640 1 -- 172.21.15.5:0/3725129759 >> 172.21.15.5:0/3725129759 conn(0x7f15580659d0 msgr2=0x7f155815b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:59.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.189+0000 7f155d293640 1 -- 172.21.15.5:0/3725129759 shutdown_connections 2023-07-14T13:12:59.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.189+0000 7f155d293640 1 -- 172.21.15.5:0/3725129759 wait complete. 2023-07-14T13:12:59.248 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-14T13:12:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.361+0000 7f6901382640 1 Processor -- start 2023-07-14T13:12:59.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.361+0000 7f6901382640 1 -- start start 2023-07-14T13:12:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.361+0000 7f6901382640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f68fc0c8ad0 0x7f68fc0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.361+0000 7f6901382640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f68fc0c9560 0x7f68fc0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:59.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.361+0000 7f6901382640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68fc0c99c0 con 0x7f68fc158ce0 2023-07-14T13:12:59.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.361+0000 7f6901382640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68fc0cc700 con 0x7f68fc0c8ad0 2023-07-14T13:12:59.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.361+0000 7f6901382640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68fc0b0ff0 con 0x7f68fc0c9560 2023-07-14T13:12:59.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.361+0000 7f68faffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f68fc158ce0 0x7f68fc070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51470/0 (socket says 172.21.15.5:51470) 2023-07-14T13:12:59.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.361+0000 7f68faffd640 1 -- 172.21.15.5:0/3553355701 learned_addr learned my addr 172.21.15.5:0/3553355701 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:12:59.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.361+0000 7f68f3fff640 1 --2- 172.21.15.5:0/3553355701 >> v2:172.21.15.5:3300/0 conn(0x7f68fc0c8ad0 0x7f68fc0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:59.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.361+0000 7f68fb7fe640 1 --2- 172.21.15.5:0/3553355701 >> v2:172.21.15.154:3300/0 conn(0x7f68fc0c9560 0x7f68fc0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:59.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.361+0000 7f68fa7fc640 1 -- 172.21.15.5:0/3553355701 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 794706178 0 0) 0x7f68fc0c99c0 con 0x7f68fc158ce0 2023-07-14T13:12:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.361+0000 7f68fa7fc640 1 -- 172.21.15.5:0/3553355701 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68e8005740 con 0x7f68fc158ce0 2023-07-14T13:12:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.361+0000 7f68f3fff640 1 -- 172.21.15.5:0/3553355701 >> v2:172.21.15.154:3300/0 conn(0x7f68fc0c9560 msgr2=0x7f68fc0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.361+0000 7f68f3fff640 1 --2- 172.21.15.5:0/3553355701 >> v2:172.21.15.154:3300/0 conn(0x7f68fc0c9560 0x7f68fc0ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.361+0000 7f68f3fff640 1 -- 172.21.15.5:0/3553355701 >> v1:172.21.15.5:6789/0 conn(0x7f68fc158ce0 legacy=0x7f68fc070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.361+0000 7f68f3fff640 1 -- 172.21.15.5:0/3553355701 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68fc070c80 con 0x7f68fc0c8ad0 2023-07-14T13:12:59.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.361+0000 7f68fb7fe640 1 --2- 172.21.15.5:0/3553355701 >> v2:172.21.15.154:3300/0 conn(0x7f68fc0c9560 0x7f68fc0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:59.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.365+0000 7f68f3fff640 1 --2- 172.21.15.5:0/3553355701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68fc0c8ad0 0x7f68fc0c9020 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f68fc0b0d70 tx=0x7f68e401c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c82dcc5d4d3788 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:59.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.365+0000 7f68fa7fc640 1 -- 172.21.15.5:0/3553355701 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e40ac640 con 0x7f68fc0c8ad0 2023-07-14T13:12:59.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.365+0000 7f68fa7fc640 1 -- 172.21.15.5:0/3553355701 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e40ac7a0 con 0x7f68fc0c8ad0 2023-07-14T13:12:59.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.365+0000 7f68fa7fc640 1 -- 172.21.15.5:0/3553355701 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e40acb30 con 0x7f68fc0c8ad0 2023-07-14T13:12:59.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.365+0000 7f6901382640 1 -- 172.21.15.5:0/3553355701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68fc0c8ad0 msgr2=0x7f68fc0c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.365+0000 7f6901382640 1 --2- 172.21.15.5:0/3553355701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68fc0c8ad0 0x7f68fc0c9020 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f68fc0b0d70 tx=0x7f68e401c310 comp rx=0 tx=0).stop 2023-07-14T13:12:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.365+0000 7f6901382640 1 -- 172.21.15.5:0/3553355701 shutdown_connections 2023-07-14T13:12:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.365+0000 7f6901382640 1 --2- 172.21.15.5:0/3553355701 >> v2:172.21.15.154:3300/0 conn(0x7f68fc0c9560 0x7f68fc0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.365+0000 7f6901382640 1 --2- 172.21.15.5:0/3553355701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68fc0c8ad0 0x7f68fc0c9020 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.365+0000 7f6901382640 1 -- 172.21.15.5:0/3553355701 >> 172.21.15.5:0/3553355701 conn(0x7f68fc0afcf0 msgr2=0x7f68fc0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.365+0000 7f6901382640 1 -- 172.21.15.5:0/3553355701 shutdown_connections 2023-07-14T13:12:59.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.365+0000 7f6901382640 1 -- 172.21.15.5:0/3553355701 wait complete. 2023-07-14T13:12:59.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.369+0000 7f6901382640 1 Processor -- start 2023-07-14T13:12:59.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.369+0000 7f6901382640 1 -- start start 2023-07-14T13:12:59.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.369+0000 7f6901382640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68fc0c8ad0 0x7f68fc14d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:59.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.369+0000 7f6901382640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68fc0c9560 0x7f68fc15b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:59.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.369+0000 7f6901382640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68fc158ce0 0x7f68fc154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:59.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.369+0000 7f6901382640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc14e950 con 0x7f68fc0c9560 2023-07-14T13:12:59.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.369+0000 7f6901382640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc15ba80 con 0x7f68fc0c8ad0 2023-07-14T13:12:59.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.369+0000 7f6901382640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc14dd40 con 0x7f68fc158ce0 2023-07-14T13:12:59.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.369+0000 7f68f3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68fc0c9560 0x7f68fc15b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:59.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.369+0000 7f68f3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68fc0c9560 0x7f68fc15b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60154/0 (socket says 172.21.15.5:60154) 2023-07-14T13:12:59.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.369+0000 7f68f3fff640 1 -- 172.21.15.5:0/82518989 learned_addr learned my addr 172.21.15.5:0/82518989 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:59.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.369+0000 7f68f3fff640 1 -- 172.21.15.5:0/82518989 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68fc158ce0 msgr2=0x7f68fc154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:59.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.369+0000 7f68f3fff640 1 --2- 172.21.15.5:0/82518989 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68fc158ce0 0x7f68fc154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:59.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.369+0000 7f68faffd640 1 --2- 172.21.15.5:0/82518989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68fc0c8ad0 0x7f68fc14d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:59.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.369+0000 7f68f3fff640 1 -- 172.21.15.5:0/82518989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68fc0c8ad0 msgr2=0x7f68fc14d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:59.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.369+0000 7f68f3fff640 1 --2- 172.21.15.5:0/82518989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68fc0c8ad0 0x7f68fc14d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.369+0000 7f68f3fff640 1 -- 172.21.15.5:0/82518989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e4009420 con 0x7f68fc0c9560 2023-07-14T13:12:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.369+0000 7f68faffd640 1 --2- 172.21.15.5:0/82518989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68fc0c8ad0 0x7f68fc14d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:12:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.369+0000 7f68f3fff640 1 --2- 172.21.15.5:0/82518989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68fc0c9560 0x7f68fc15b540 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f68e40af040 tx=0x7f68e40190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.369+0000 7f68f37fe640 1 -- 172.21.15.5:0/82518989 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e40b5610 con 0x7f68fc0c9560 2023-07-14T13:12:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.369+0000 7f68f37fe640 1 -- 172.21.15.5:0/82518989 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e40b5790 con 0x7f68fc0c9560 2023-07-14T13:12:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.369+0000 7f68f37fe640 1 -- 172.21.15.5:0/82518989 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e40b5b40 con 0x7f68fc0c9560 2023-07-14T13:12:59.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.369+0000 7f6901382640 1 -- 172.21.15.5:0/82518989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68fc14e020 con 0x7f68fc0c9560 2023-07-14T13:12:59.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.369+0000 7f6901382640 1 -- 172.21.15.5:0/82518989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68fc14e5e0 con 0x7f68fc0c9560 2023-07-14T13:12:59.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.373+0000 7f6901382640 1 -- 172.21.15.5:0/82518989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68fc0ca1a0 con 0x7f68fc0c9560 2023-07-14T13:12:59.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.373+0000 7f68f37fe640 1 -- 172.21.15.5:0/82518989 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f68e40b3040 con 0x7f68fc0c9560 2023-07-14T13:12:59.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.373+0000 7f68f37fe640 1 --2- 172.21.15.5:0/82518989 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f68dc0663a0 0x7f68dc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:59.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.373+0000 7f68f37fe640 1 -- 172.21.15.5:0/82518989 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f68e411dec0 con 0x7f68fc0c9560 2023-07-14T13:12:59.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.373+0000 7f68faffd640 1 --2- 172.21.15.5:0/82518989 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f68dc0663a0 0x7f68dc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:59.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.373+0000 7f68faffd640 1 --2- 172.21.15.5:0/82518989 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f68dc0663a0 0x7f68dc068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0011f0 tx=0x7f68ec009040 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:59.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.377+0000 7f68f37fe640 1 -- 172.21.15.5:0/82518989 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f68e40eb4c0 con 0x7f68fc0c9560 2023-07-14T13:12:59.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.585+0000 7f6901382640 1 -- 172.21.15.5:0/82518989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f68fc0cc360 con 0x7f68fc0c9560 2023-07-14T13:12:59.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.585+0000 7f68f37fe640 1 -- 172.21.15.5:0/82518989 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f68e40eeae0 con 0x7f68fc0c9560 2023-07-14T13:12:59.624 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:59.624 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T13:12:59.625 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2023-07-14T13:12:59.625 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:59.625 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2023-07-14T13:12:59.626 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkGNTsMRAA5T/zjdynxEKmoNAAK0cChw==", 2023-07-14T13:12:59.626 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:59.626 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:12:59.626 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:12:59.627 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:12:59.627 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:59.627 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:59.628 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:59.628 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:59.628 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2023-07-14T13:12:59.629 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkqXNAAxAAb7bzXyE8cSS0A3Rz2de6TA==", 2023-07-14T13:12:59.629 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:59.629 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:12:59.630 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:12:59.630 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:12:59.630 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:59.630 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:59.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:59.631 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:59.631 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2023-07-14T13:12:59.632 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFk6NGUORAA+5odxrAlCCXYGc64nzFWwQ==", 2023-07-14T13:12:59.632 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:59.632 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:12:59.633 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:12:59.633 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:12:59.633 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:59.633 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:59.634 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:59.634 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:59.634 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2023-07-14T13:12:59.634 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkGh/BChAA5p9amLIC6ORC0JJov0bSVg==", 2023-07-14T13:12:59.635 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:59.635 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:12:59.635 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:12:59.635 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:12:59.635 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:59.636 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:59.636 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:59.636 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:59.636 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2023-07-14T13:12:59.636 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDlRLFkJ6MULhAAxExAqekc/gWudYBJ2sY4MQ==", 2023-07-14T13:12:59.637 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:59.637 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:12:59.637 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:12:59.637 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:59.637 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:59.637 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:59.638 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:59.638 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2023-07-14T13:12:59.638 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDoRLFksXGBNRAAFtHZt5OQw0aB6k3CkxOzZQ==", 2023-07-14T13:12:59.638 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:59.638 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:12:59.639 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:12:59.639 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:59.639 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:59.639 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:59.639 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:59.640 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2023-07-14T13:12:59.640 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDsRLFkaUH0ARAAkqgsKPX1dTSZQjn0cRxxRQ==", 2023-07-14T13:12:59.640 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:59.640 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:12:59.640 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:12:59.641 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:59.641 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:59.641 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:59.641 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:59.641 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2023-07-14T13:12:59.642 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDvRLFkvElJCRAAnox5LKwobP/1Qaf5d9UsjA==", 2023-07-14T13:12:59.642 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:59.642 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:12:59.642 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:12:59.642 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:59.643 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:59.643 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:59.643 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:59.643 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2023-07-14T13:12:59.644 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD1RLFkMNyyDxAA19dJkhhuSpcgVPQEyxb3lg==", 2023-07-14T13:12:59.644 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:59.644 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:12:59.644 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:12:59.645 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:59.645 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:59.645 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:59.646 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:59.646 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2023-07-14T13:12:59.646 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD4RLFkR8mTFhAAP5qUgUJI23XOvVAnNCSgRQ==", 2023-07-14T13:12:59.647 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:59.647 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:12:59.647 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:12:59.647 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:59.648 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:59.648 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:59.648 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:59.649 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2023-07-14T13:12:59.649 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD7RLFkpWL9HBAAo8MfszRnB4sHsDPPcRjCAg==", 2023-07-14T13:12:59.649 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:59.649 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:12:59.650 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:12:59.650 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:59.650 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:59.651 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:59.651 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:59.651 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2023-07-14T13:12:59.652 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD+RLFkL5cRIxAAF/4ndtYf0oiH3uhhDKnQQg==", 2023-07-14T13:12:59.652 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:59.652 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:12:59.652 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:12:59.653 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:59.653 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:59.653 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:59.654 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:59.654 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2023-07-14T13:12:59.654 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkCav/DhAA6SOiONAbTcWCnUZXcm7BcQ==", 2023-07-14T13:12:59.654 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:59.655 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:12:59.655 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2023-07-14T13:12:59.655 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-14T13:12:59.656 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:59.656 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:59.656 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:59.656 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2023-07-14T13:12:59.657 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkgS/hGBAAevMD2/lfNuaeV74w0Xj0Zw==", 2023-07-14T13:12:59.657 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:59.657 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:12:59.657 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T13:12:59.658 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T13:12:59.658 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T13:12:59.658 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:59.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:59.659 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:59.659 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2023-07-14T13:12:59.659 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkeBs4FRAAJ/UjIEKDajVyDb7PejPqAw==", 2023-07-14T13:12:59.660 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:59.660 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:12:59.660 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T13:12:59.661 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T13:12:59.661 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T13:12:59.661 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:59.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:59.662 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:59.662 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2023-07-14T13:12:59.662 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkSkDiHhAAV86wIrAVz3o/PI2CaBC44w==", 2023-07-14T13:12:59.662 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:59.662 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:12:59.663 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T13:12:59.663 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T13:12:59.663 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T13:12:59.663 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:59.663 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:59.664 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:59.664 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2023-07-14T13:12:59.664 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkk5IcFRAAThI0P1N8LsRetmwhHqSvdQ==", 2023-07-14T13:12:59.664 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:59.664 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T13:12:59.665 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:12:59.665 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:12:59.665 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:59.665 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:59.665 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:59.665 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:59.665 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2023-07-14T13:12:59.666 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkugeXLRAAEVAnLk/dldtqrpkdzQI3SA==", 2023-07-14T13:12:59.666 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:59.666 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T13:12:59.666 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-07-14T13:12:59.666 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:59.666 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:59.666 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:12:59.667 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:12:59.667 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2023-07-14T13:12:59.667 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkSvp/KRAAwvjYlrZYNeGbhCiDrTmnrA==", 2023-07-14T13:12:59.667 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:12:59.667 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T13:12:59.667 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-07-14T13:12:59.667 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:12:59.667 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:59.668 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:12:59.668 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-07-14T13:12:59.668 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T13:12:59.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.589+0000 7f6901382640 1 -- 172.21.15.5:0/82518989 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f68dc0663a0 msgr2=0x7f68dc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:59.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.589+0000 7f6901382640 1 --2- 172.21.15.5:0/82518989 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f68dc0663a0 0x7f68dc068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0011f0 tx=0x7f68ec009040 comp rx=0 tx=0).stop 2023-07-14T13:12:59.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.589+0000 7f6901382640 1 -- 172.21.15.5:0/82518989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68fc0c9560 msgr2=0x7f68fc15b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:59.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.589+0000 7f6901382640 1 --2- 172.21.15.5:0/82518989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68fc0c9560 0x7f68fc15b540 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f68e40af040 tx=0x7f68e40190b0 comp rx=0 tx=0).stop 2023-07-14T13:12:59.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.589+0000 7f6901382640 1 -- 172.21.15.5:0/82518989 shutdown_connections 2023-07-14T13:12:59.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.589+0000 7f6901382640 1 --2- 172.21.15.5:0/82518989 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f68dc0663a0 0x7f68dc068850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:59.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.589+0000 7f6901382640 1 --2- 172.21.15.5:0/82518989 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68fc158ce0 0x7f68fc154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:59.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.589+0000 7f6901382640 1 --2- 172.21.15.5:0/82518989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68fc0c9560 0x7f68fc15b540 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:59.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.589+0000 7f6901382640 1 --2- 172.21.15.5:0/82518989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68fc0c8ad0 0x7f68fc14d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:59.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.589+0000 7f6901382640 1 -- 172.21.15.5:0/82518989 >> 172.21.15.5:0/82518989 conn(0x7f68fc0afcf0 msgr2=0x7f68fc1517c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:59.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.589+0000 7f6901382640 1 -- 172.21.15.5:0/82518989 shutdown_connections 2023-07-14T13:12:59.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.589+0000 7f6901382640 1 -- 172.21.15.5:0/82518989 wait complete. 2023-07-14T13:12:59.672 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:12:59.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.781+0000 7f9cc134a640 1 Processor -- start 2023-07-14T13:12:59.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.781+0000 7f9cc134a640 1 -- start start 2023-07-14T13:12:59.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.781+0000 7f9cc134a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9cbc0d13f0 0x7f9cbc0cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:59.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.781+0000 7f9cc134a640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cbc0d0f60 con 0x7f9cbc0b7d90 2023-07-14T13:12:59.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.781+0000 7f9cc134a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cbc0d0390 con 0x7f9cbc15f3f0 2023-07-14T13:12:59.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.781+0000 7f9cc134a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cbc0d0630 con 0x7f9cbc0d13f0 2023-07-14T13:12:59.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.781+0000 7f9cc0b49640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9cbc0d13f0 0x7f9cbc0cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:59.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.781+0000 7f9cc0b49640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9cbc0d13f0 0x7f9cbc0cd0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60164/0 (socket says 172.21.15.5:60164) 2023-07-14T13:12:59.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.781+0000 7f9cc0b49640 1 -- 172.21.15.5:0/665920132 learned_addr learned my addr 172.21.15.5:0/665920132 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:59.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.781+0000 7f9cbb7fe640 1 --1- 172.21.15.5:0/665920132 >> v1:172.21.15.5:6789/0 conn(0x7f9cbc0b7d90 0x7f9cbc0cc9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51484/0 (socket says 172.21.15.5:51484) 2023-07-14T13:12:59.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.781+0000 7f9cc0b49640 1 -- 172.21.15.5:0/665920132 >> v1:172.21.15.154:6789/0 conn(0x7f9cbc15f3f0 legacy=0x7f9cbc0b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:59.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.781+0000 7f9cc0b49640 1 -- 172.21.15.5:0/665920132 >> v1:172.21.15.5:6789/0 conn(0x7f9cbc0b7d90 legacy=0x7f9cbc0cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:59.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.781+0000 7f9cc0b49640 1 -- 172.21.15.5:0/665920132 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cbc0d0910 con 0x7f9cbc0d13f0 2023-07-14T13:12:59.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.785+0000 7f9cc0b49640 1 --2- 172.21.15.5:0/665920132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cbc0d13f0 0x7f9cbc0cd0b0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009e50 tx=0x7f9cb401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360c158fce8b3d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:59.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.785+0000 7f9cbaffd640 1 -- 172.21.15.5:0/665920132 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb40a5680 con 0x7f9cbc0d13f0 2023-07-14T13:12:59.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.785+0000 7f9cbaffd640 1 -- 172.21.15.5:0/665920132 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb40a57e0 con 0x7f9cbc0d13f0 2023-07-14T13:12:59.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.785+0000 7f9cbaffd640 1 -- 172.21.15.5:0/665920132 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb40a5b70 con 0x7f9cbc0d13f0 2023-07-14T13:12:59.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.785+0000 7f9cc134a640 1 -- 172.21.15.5:0/665920132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cbc0d13f0 msgr2=0x7f9cbc0cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:59.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.785+0000 7f9cc134a640 1 --2- 172.21.15.5:0/665920132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cbc0d13f0 0x7f9cbc0cd0b0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009e50 tx=0x7f9cb401c940 comp rx=0 tx=0).stop 2023-07-14T13:12:59.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.785+0000 7f9cc134a640 1 -- 172.21.15.5:0/665920132 shutdown_connections 2023-07-14T13:12:59.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.785+0000 7f9cc134a640 1 --2- 172.21.15.5:0/665920132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cbc0d13f0 0x7f9cbc0cd0b0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:59.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.785+0000 7f9cc134a640 1 -- 172.21.15.5:0/665920132 >> 172.21.15.5:0/665920132 conn(0x7f9cbc069f50 msgr2=0x7f9cbc06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.785+0000 7f9cc134a640 1 -- 172.21.15.5:0/665920132 shutdown_connections 2023-07-14T13:12:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.785+0000 7f9cc134a640 1 -- 172.21.15.5:0/665920132 wait complete. 2023-07-14T13:12:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.785+0000 7f9cc134a640 1 Processor -- start 2023-07-14T13:12:59.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.785+0000 7f9cc134a640 1 -- start start 2023-07-14T13:12:59.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.789+0000 7f9cc134a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cbc0b7d90 0x7f9cbc153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:59.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.789+0000 7f9cc134a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cbc0d13f0 0x7f9cbc1583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:59.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.789+0000 7f9cc134a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cbc15f3f0 0x7f9cbc154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:59.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.789+0000 7f9cc134a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc158ef0 con 0x7f9cbc15f3f0 2023-07-14T13:12:59.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.789+0000 7f9cc134a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc1591d0 con 0x7f9cbc0d13f0 2023-07-14T13:12:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.789+0000 7f9cc134a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc1594b0 con 0x7f9cbc0b7d90 2023-07-14T13:12:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.789+0000 7f9cc0b49640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cbc15f3f0 0x7f9cbc154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.789+0000 7f9cc0b49640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cbc15f3f0 0x7f9cbc154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60178/0 (socket says 172.21.15.5:60178) 2023-07-14T13:12:59.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.789+0000 7f9cc0b49640 1 -- 172.21.15.5:0/253386861 learned_addr learned my addr 172.21.15.5:0/253386861 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:12:59.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.789+0000 7f9cc0b49640 1 -- 172.21.15.5:0/253386861 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cbc0b7d90 msgr2=0x7f9cbc153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:59.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.789+0000 7f9cc0b49640 1 --2- 172.21.15.5:0/253386861 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cbc0b7d90 0x7f9cbc153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:59.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.789+0000 7f9cbb7fe640 1 --2- 172.21.15.5:0/253386861 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cbc0d13f0 0x7f9cbc1583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:59.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.789+0000 7f9cc0b49640 1 -- 172.21.15.5:0/253386861 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cbc0d13f0 msgr2=0x7f9cbc1583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:59.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.789+0000 7f9cc0b49640 1 --2- 172.21.15.5:0/253386861 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cbc0d13f0 0x7f9cbc1583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:59.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.789+0000 7f9cc0b49640 1 -- 172.21.15.5:0/253386861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb4009b30 con 0x7f9cbc15f3f0 2023-07-14T13:12:59.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.789+0000 7f9cbb7fe640 1 --2- 172.21.15.5:0/253386861 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cbc0d13f0 0x7f9cbc1583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:12:59.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.789+0000 7f9cc0b49640 1 --2- 172.21.15.5:0/253386861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cbc15f3f0 0x7f9cbc154530 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4019550 tx=0x7f9cb40196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:59.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.789+0000 7f9cb8ff9640 1 -- 172.21.15.5:0/253386861 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb40b8670 con 0x7f9cbc15f3f0 2023-07-14T13:12:59.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.789+0000 7f9cb8ff9640 1 -- 172.21.15.5:0/253386861 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb40b87d0 con 0x7f9cbc15f3f0 2023-07-14T13:12:59.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.789+0000 7f9cb8ff9640 1 -- 172.21.15.5:0/253386861 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb40b8b40 con 0x7f9cbc15f3f0 2023-07-14T13:12:59.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.789+0000 7f9cc134a640 1 -- 172.21.15.5:0/253386861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cbc159790 con 0x7f9cbc15f3f0 2023-07-14T13:12:59.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.789+0000 7f9cc134a640 1 -- 172.21.15.5:0/253386861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cbc153ad0 con 0x7f9cbc15f3f0 2023-07-14T13:12:59.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.789+0000 7f9cc134a640 1 -- 172.21.15.5:0/253386861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cbc0678d0 con 0x7f9cbc15f3f0 2023-07-14T13:12:59.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.793+0000 7f9cb8ff9640 1 -- 172.21.15.5:0/253386861 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9cb40b8ca0 con 0x7f9cbc15f3f0 2023-07-14T13:12:59.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.793+0000 7f9cb8ff9640 1 --2- 172.21.15.5:0/253386861 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f9ca80663a0 0x7f9ca8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:59.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.793+0000 7f9cb8ff9640 1 -- 172.21.15.5:0/253386861 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f9cb411f150 con 0x7f9cbc15f3f0 2023-07-14T13:12:59.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.793+0000 7f9cbbfff640 1 --2- 172.21.15.5:0/253386861 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f9ca80663a0 0x7f9ca8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:59.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.793+0000 7f9cbbfff640 1 --2- 172.21.15.5:0/253386861 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f9ca80663a0 0x7f9ca8068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009670 tx=0x7f9cac006bd0 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:59.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.796+0000 7f9cb8ff9640 1 -- 172.21.15.5:0/253386861 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9cb40ec760 con 0x7f9cbc15f3f0 2023-07-14T13:12:59.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.952+0000 7f9cc134a640 1 -- 172.21.15.5:0/253386861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cbc159c40 con 0x7f9cbc15f3f0 2023-07-14T13:12:59.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.952+0000 7f9cb8ff9640 1 -- 172.21.15.5:0/253386861 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+14645 (secure 0 0 0) 0x7f9cb40efd80 con 0x7f9cbc15f3f0 2023-07-14T13:12:59.989 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:12:59.989 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":152,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:12:59.185085+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:12:59.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.952+0000 7f9cc134a640 1 -- 172.21.15.5:0/253386861 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f9ca80663a0 msgr2=0x7f9ca8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:59.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.952+0000 7f9cc134a640 1 --2- 172.21.15.5:0/253386861 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f9ca80663a0 0x7f9ca8068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009670 tx=0x7f9cac006bd0 comp rx=0 tx=0).stop 2023-07-14T13:12:59.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.952+0000 7f9cc134a640 1 -- 172.21.15.5:0/253386861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cbc15f3f0 msgr2=0x7f9cbc154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:59.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.952+0000 7f9cc134a640 1 --2- 172.21.15.5:0/253386861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cbc15f3f0 0x7f9cbc154530 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4019550 tx=0x7f9cb40196e0 comp rx=0 tx=0).stop 2023-07-14T13:12:59.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.952+0000 7f9cc134a640 1 -- 172.21.15.5:0/253386861 shutdown_connections 2023-07-14T13:12:59.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.952+0000 7f9cc134a640 1 --2- 172.21.15.5:0/253386861 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f9ca80663a0 0x7f9ca8068850 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:59.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.952+0000 7f9cc134a640 1 --2- 172.21.15.5:0/253386861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cbc15f3f0 0x7f9cbc154530 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:59.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.952+0000 7f9cc134a640 1 --2- 172.21.15.5:0/253386861 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cbc0d13f0 0x7f9cbc1583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:59.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.952+0000 7f9cc134a640 1 --2- 172.21.15.5:0/253386861 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cbc0b7d90 0x7f9cbc153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:59.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.952+0000 7f9cc134a640 1 -- 172.21.15.5:0/253386861 >> 172.21.15.5:0/253386861 conn(0x7f9cbc069f50 msgr2=0x7f9cbc0c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:59.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.952+0000 7f9cc134a640 1 -- 172.21.15.5:0/253386861 shutdown_connections 2023-07-14T13:12:59.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:12:59.952+0000 7f9cc134a640 1 -- 172.21.15.5:0/253386861 wait complete. 2023-07-14T13:13:00.010 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:13:00.011 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:13:00.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.120+0000 7f0aac2f9640 1 Processor -- start 2023-07-14T13:13:00.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.120+0000 7f0aac2f9640 1 -- start start 2023-07-14T13:13:00.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.124+0000 7f0aac2f9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0aa40aeb40 0x7f0aa415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:00.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.124+0000 7f0aac2f9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0aa40aef10 0x7f0aa4158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:00.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.124+0000 7f0aac2f9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa41532b0 con 0x7f0aa4159270 2023-07-14T13:13:00.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.124+0000 7f0aac2f9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa40ca6f0 con 0x7f0aa40aef10 2023-07-14T13:13:00.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.124+0000 7f0aac2f9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa41599d0 con 0x7f0aa40aeb40 2023-07-14T13:13:00.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.124+0000 7f0aa9894640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0aa40aef10 0x7f0aa4158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:00.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.124+0000 7f0aaa896640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0aa4159270 0x7f0aa40c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51488/0 (socket says 172.21.15.5:51488) 2023-07-14T13:13:00.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.124+0000 7f0aaa896640 1 -- 172.21.15.5:0/2590861365 learned_addr learned my addr 172.21.15.5:0/2590861365 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:13:00.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.124+0000 7f0aaa095640 1 --2- 172.21.15.5:0/2590861365 >> v2:172.21.15.154:3300/0 conn(0x7f0aa40aeb40 0x7f0aa415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:00.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.124+0000 7f0aa9894640 1 -- 172.21.15.5:0/2590861365 >> v2:172.21.15.154:3300/0 conn(0x7f0aa40aeb40 msgr2=0x7f0aa415cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:00.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.124+0000 7f0aa9894640 1 --2- 172.21.15.5:0/2590861365 >> v2:172.21.15.154:3300/0 conn(0x7f0aa40aeb40 0x7f0aa415cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:00.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.124+0000 7f0aa9894640 1 -- 172.21.15.5:0/2590861365 >> v1:172.21.15.5:6789/0 conn(0x7f0aa4159270 legacy=0x7f0aa40c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:00.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.124+0000 7f0aa9894640 1 -- 172.21.15.5:0/2590861365 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa4159cb0 con 0x7f0aa40aef10 2023-07-14T13:13:00.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.124+0000 7f0aaa095640 1 --2- 172.21.15.5:0/2590861365 >> v2:172.21.15.154:3300/0 conn(0x7f0aa40aeb40 0x7f0aa415cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:13:00.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.128+0000 7f0aa9894640 1 --2- 172.21.15.5:0/2590861365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aa40aef10 0x7f0aa4158d30 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4071ad0 tx=0x7f0a9401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b0651cd2bd777f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:00.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.128+0000 7f0aa9093640 1 -- 172.21.15.5:0/2590861365 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a940ac600 con 0x7f0aa40aef10 2023-07-14T13:13:00.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.128+0000 7f0aa9093640 1 -- 172.21.15.5:0/2590861365 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a940a8050 con 0x7f0aa40aef10 2023-07-14T13:13:00.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.128+0000 7f0aa9093640 1 -- 172.21.15.5:0/2590861365 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a940ac980 con 0x7f0aa40aef10 2023-07-14T13:13:00.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.128+0000 7f0aac2f9640 1 -- 172.21.15.5:0/2590861365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aa40aef10 msgr2=0x7f0aa4158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:00.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.128+0000 7f0aac2f9640 1 --2- 172.21.15.5:0/2590861365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aa40aef10 0x7f0aa4158d30 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4071ad0 tx=0x7f0a9401c3a0 comp rx=0 tx=0).stop 2023-07-14T13:13:00.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.128+0000 7f0aac2f9640 1 -- 172.21.15.5:0/2590861365 shutdown_connections 2023-07-14T13:13:00.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.128+0000 7f0aac2f9640 1 --2- 172.21.15.5:0/2590861365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aa40aef10 0x7f0aa4158d30 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:00.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.128+0000 7f0aac2f9640 1 --2- 172.21.15.5:0/2590861365 >> v2:172.21.15.154:3300/0 conn(0x7f0aa40aeb40 0x7f0aa415cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:00.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.128+0000 7f0aac2f9640 1 -- 172.21.15.5:0/2590861365 >> 172.21.15.5:0/2590861365 conn(0x7f0aa40cde90 msgr2=0x7f0aa40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:00.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.128+0000 7f0aac2f9640 1 -- 172.21.15.5:0/2590861365 shutdown_connections 2023-07-14T13:13:00.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.128+0000 7f0aac2f9640 1 -- 172.21.15.5:0/2590861365 wait complete. 2023-07-14T13:13:00.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.128+0000 7f0aac2f9640 1 Processor -- start 2023-07-14T13:13:00.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.128+0000 7f0aac2f9640 1 -- start start 2023-07-14T13:13:00.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.128+0000 7f0aac2f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0aa40aeb40 0x7f0aa414cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:00.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.128+0000 7f0aac2f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aa40aef10 0x7f0aa414f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:00.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.132+0000 7f0aac2f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0aa4159270 0x7f0aa4157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:00.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.132+0000 7f0aac2f9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa41f7b20 con 0x7f0aa40aef10 2023-07-14T13:13:00.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.132+0000 7f0aac2f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa415b770 con 0x7f0aa40aeb40 2023-07-14T13:13:00.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.132+0000 7f0aac2f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa414f6d0 con 0x7f0aa4159270 2023-07-14T13:13:00.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.132+0000 7f0aa9894640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aa40aef10 0x7f0aa414f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:00.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.132+0000 7f0aa9894640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aa40aef10 0x7f0aa414f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60198/0 (socket says 172.21.15.5:60198) 2023-07-14T13:13:00.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.132+0000 7f0aa9894640 1 -- 172.21.15.5:0/1948702613 learned_addr learned my addr 172.21.15.5:0/1948702613 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:00.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.132+0000 7f0aaa095640 1 --2- 172.21.15.5:0/1948702613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0aa40aeb40 0x7f0aa414cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:00.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.132+0000 7f0aaa896640 1 --2- 172.21.15.5:0/1948702613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0aa4159270 0x7f0aa4157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:00.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.132+0000 7f0aa9894640 1 -- 172.21.15.5:0/1948702613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0aa4159270 msgr2=0x7f0aa4157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:00.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.132+0000 7f0aa9894640 1 --2- 172.21.15.5:0/1948702613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0aa4159270 0x7f0aa4157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:00.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.132+0000 7f0aa9894640 1 -- 172.21.15.5:0/1948702613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0aa40aeb40 msgr2=0x7f0aa414cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:00.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.132+0000 7f0aa9894640 1 --2- 172.21.15.5:0/1948702613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0aa40aeb40 0x7f0aa414cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:00.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.132+0000 7f0aa9894640 1 -- 172.21.15.5:0/1948702613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a94009420 con 0x7f0aa40aef10 2023-07-14T13:13:00.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.132+0000 7f0aaa896640 1 --2- 172.21.15.5:0/1948702613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0aa4159270 0x7f0aa4157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:13:00.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.132+0000 7f0aa9894640 1 --2- 172.21.15.5:0/1948702613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aa40aef10 0x7f0aa414f190 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f0a94018fb0 tx=0x7f0a9401abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:00.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.132+0000 7f0a9affd640 1 -- 172.21.15.5:0/1948702613 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a940b7620 con 0x7f0aa40aef10 2023-07-14T13:13:00.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.132+0000 7f0a9affd640 1 -- 172.21.15.5:0/1948702613 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a940b7780 con 0x7f0aa40aef10 2023-07-14T13:13:00.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.132+0000 7f0a9affd640 1 -- 172.21.15.5:0/1948702613 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a940b7af0 con 0x7f0aa40aef10 2023-07-14T13:13:00.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.132+0000 7f0aac2f9640 1 -- 172.21.15.5:0/1948702613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa415b490 con 0x7f0aa40aef10 2023-07-14T13:13:00.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.132+0000 7f0aac2f9640 1 -- 172.21.15.5:0/1948702613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa41f77b0 con 0x7f0aa40aef10 2023-07-14T13:13:00.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.132+0000 7f0aac2f9640 1 -- 172.21.15.5:0/1948702613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa40678d0 con 0x7f0aa40aef10 2023-07-14T13:13:00.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.132+0000 7f0a9affd640 1 -- 172.21.15.5:0/1948702613 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0a940b3040 con 0x7f0aa40aef10 2023-07-14T13:13:00.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.136+0000 7f0a9affd640 1 --2- 172.21.15.5:0/1948702613 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f0a880663a0 0x7f0a88068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:00.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.136+0000 7f0a9affd640 1 -- 172.21.15.5:0/1948702613 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f0a9411e2d0 con 0x7f0aa40aef10 2023-07-14T13:13:00.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.136+0000 7f0aaa095640 1 --2- 172.21.15.5:0/1948702613 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f0a880663a0 0x7f0a88068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:00.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.136+0000 7f0aaa095640 1 --2- 172.21.15.5:0/1948702613 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f0a880663a0 0x7f0a88068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4157bd0 tx=0x7f0aa0008040 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:00.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.136+0000 7f0a9affd640 1 -- 172.21.15.5:0/1948702613 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f0a940eb7c0 con 0x7f0aa40aef10 2023-07-14T13:13:00.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.292+0000 7f0aac2f9640 1 -- 172.21.15.5:0/1948702613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0aa40c2ee0 con 0x7f0aa40aef10 2023-07-14T13:13:00.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.296+0000 7f0a9affd640 1 -- 172.21.15.5:0/1948702613 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v152) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0a940eede0 con 0x7f0aa40aef10 2023-07-14T13:13:00.332 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:13:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.296+0000 7f0aac2f9640 1 -- 172.21.15.5:0/1948702613 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f0a880663a0 msgr2=0x7f0a88068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.296+0000 7f0aac2f9640 1 --2- 172.21.15.5:0/1948702613 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f0a880663a0 0x7f0a88068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4157bd0 tx=0x7f0aa0008040 comp rx=0 tx=0).stop 2023-07-14T13:13:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.296+0000 7f0aac2f9640 1 -- 172.21.15.5:0/1948702613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aa40aef10 msgr2=0x7f0aa414f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.296+0000 7f0aac2f9640 1 --2- 172.21.15.5:0/1948702613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aa40aef10 0x7f0aa414f190 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f0a94018fb0 tx=0x7f0a9401abe0 comp rx=0 tx=0).stop 2023-07-14T13:13:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.296+0000 7f0aac2f9640 1 -- 172.21.15.5:0/1948702613 shutdown_connections 2023-07-14T13:13:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.296+0000 7f0aac2f9640 1 --2- 172.21.15.5:0/1948702613 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f0a880663a0 0x7f0a88068850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.296+0000 7f0aac2f9640 1 --2- 172.21.15.5:0/1948702613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0aa4159270 0x7f0aa4157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.296+0000 7f0aac2f9640 1 --2- 172.21.15.5:0/1948702613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0aa40aef10 0x7f0aa414f190 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.296+0000 7f0aac2f9640 1 --2- 172.21.15.5:0/1948702613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0aa40aeb40 0x7f0aa414cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.296+0000 7f0aac2f9640 1 -- 172.21.15.5:0/1948702613 >> 172.21.15.5:0/1948702613 conn(0x7f0aa40cde90 msgr2=0x7f0aa40ada10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.296+0000 7f0aac2f9640 1 -- 172.21.15.5:0/1948702613 shutdown_connections 2023-07-14T13:13:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.296+0000 7f0aac2f9640 1 -- 172.21.15.5:0/1948702613 wait complete. 2023-07-14T13:13:00.353 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:13:00.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.464+0000 7feb5b1fa640 1 Processor -- start 2023-07-14T13:13:00.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.464+0000 7feb5b1fa640 1 -- start start 2023-07-14T13:13:00.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.464+0000 7feb5b1fa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feb540aeb40 0x7feb5415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:00.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.464+0000 7feb5b1fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb54159440 0x7feb540c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:00.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.464+0000 7feb5b1fa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb541532b0 con 0x7feb540aef10 2023-07-14T13:13:00.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.464+0000 7feb5b1fa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb540ca6f0 con 0x7feb540aeb40 2023-07-14T13:13:00.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.464+0000 7feb5b1fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb541599d0 con 0x7feb54159440 2023-07-14T13:13:00.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.464+0000 7feb4bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7feb540aef10 0x7feb54158d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51492/0 (socket says 172.21.15.5:51492) 2023-07-14T13:13:00.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.464+0000 7feb4bfff640 1 -- 172.21.15.5:0/2818903401 learned_addr learned my addr 172.21.15.5:0/2818903401 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:13:00.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.464+0000 7feb59797640 1 --2- 172.21.15.5:0/2818903401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb54159440 0x7feb540c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:00.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.464+0000 7feb58f96640 1 --2- 172.21.15.5:0/2818903401 >> v2:172.21.15.154:3300/0 conn(0x7feb540aeb40 0x7feb5415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:00.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.464+0000 7feb4b7fe640 1 -- 172.21.15.5:0/2818903401 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 225607522 0 0) 0x7feb541532b0 con 0x7feb540aef10 2023-07-14T13:13:00.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.464+0000 7feb4b7fe640 1 -- 172.21.15.5:0/2818903401 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb3c003530 con 0x7feb540aef10 2023-07-14T13:13:00.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.464+0000 7feb4b7fe640 1 -- 172.21.15.5:0/2818903401 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1099370851 0 0) 0x7feb3c003530 con 0x7feb540aef10 2023-07-14T13:13:00.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.464+0000 7feb4b7fe640 1 -- 172.21.15.5:0/2818903401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb54159440 msgr2=0x7feb540c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:00.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.464+0000 7feb4b7fe640 1 --2- 172.21.15.5:0/2818903401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb54159440 0x7feb540c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:00.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.464+0000 7feb4b7fe640 1 -- 172.21.15.5:0/2818903401 >> v2:172.21.15.154:3300/0 conn(0x7feb540aeb40 msgr2=0x7feb5415cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:00.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.464+0000 7feb4b7fe640 1 --2- 172.21.15.5:0/2818903401 >> v2:172.21.15.154:3300/0 conn(0x7feb540aeb40 0x7feb5415cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:00.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.464+0000 7feb4b7fe640 1 -- 172.21.15.5:0/2818903401 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb54159cb0 con 0x7feb540aef10 2023-07-14T13:13:00.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.464+0000 7feb4b7fe640 1 -- 172.21.15.5:0/2818903401 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7feb44001680 con 0x7feb540aef10 2023-07-14T13:13:00.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.464+0000 7feb4b7fe640 1 -- 172.21.15.5:0/2818903401 >> v1:172.21.15.5:6789/0 conn(0x7feb540aef10 legacy=0x7feb54158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:00.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.464+0000 7feb4b7fe640 1 --2- 172.21.15.5:0/2818903401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb3c003980 0x7feb3c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:00.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.464+0000 7feb4b7fe640 1 --2- 172.21.15.5:0/2818903401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb3c0043b0 0x7feb3c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:00.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.468+0000 7feb4b7fe640 1 --2- 172.21.15.5:0/2818903401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb54159440 0x7feb3c004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:00.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.468+0000 7feb4b7fe640 1 -- 172.21.15.5:0/2818903401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb540ca6f0 con 0x7feb3c003980 2023-07-14T13:13:00.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.468+0000 7feb4b7fe640 1 -- 172.21.15.5:0/2818903401 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb541599d0 con 0x7feb3c0043b0 2023-07-14T13:13:00.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.468+0000 7feb4b7fe640 1 -- 172.21.15.5:0/2818903401 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c00b990 con 0x7feb54159440 2023-07-14T13:13:00.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.468+0000 7feb58f96640 1 --2- 172.21.15.5:0/2818903401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb3c003980 0x7feb3c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:00.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.468+0000 7feb59797640 1 --2- 172.21.15.5:0/2818903401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb54159440 0x7feb3c004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:00.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.468+0000 7feb4bfff640 1 --2- 172.21.15.5:0/2818903401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb3c0043b0 0x7feb3c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:00.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.468+0000 7feb58f96640 1 -- 172.21.15.5:0/2818903401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb54159440 msgr2=0x7feb3c004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:00.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.468+0000 7feb58f96640 1 --2- 172.21.15.5:0/2818903401 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb54159440 0x7feb3c004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:00.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.468+0000 7feb58f96640 1 -- 172.21.15.5:0/2818903401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb3c0043b0 msgr2=0x7feb3c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:00.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.468+0000 7feb58f96640 1 --2- 172.21.15.5:0/2818903401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb3c0043b0 0x7feb3c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:00.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.468+0000 7feb58f96640 1 -- 172.21.15.5:0/2818903401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3c003530 con 0x7feb3c003980 2023-07-14T13:13:00.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.468+0000 7feb58f96640 1 --2- 172.21.15.5:0/2818903401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb3c003980 0x7feb3c003d90 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7feb50009b10 tx=0x7feb5001ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d299611bdd0ace9b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:00.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.468+0000 7feb4b7fe640 1 -- 172.21.15.5:0/2818903401 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb500a5630 con 0x7feb3c003980 2023-07-14T13:13:00.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.468+0000 7feb4b7fe640 1 -- 172.21.15.5:0/2818903401 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb500a5790 con 0x7feb3c003980 2023-07-14T13:13:00.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.468+0000 7feb4b7fe640 1 -- 172.21.15.5:0/2818903401 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb500a5b40 con 0x7feb3c003980 2023-07-14T13:13:00.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.472+0000 7feb5b1fa640 1 -- 172.21.15.5:0/2818903401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb3c003980 msgr2=0x7feb3c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:00.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.472+0000 7feb5b1fa640 1 --2- 172.21.15.5:0/2818903401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb3c003980 0x7feb3c003d90 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7feb50009b10 tx=0x7feb5001ca60 comp rx=0 tx=0).stop 2023-07-14T13:13:00.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.472+0000 7feb59797640 1 -- 172.21.15.5:0/2818903401 reap_dead start 2023-07-14T13:13:00.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.472+0000 7feb5b1fa640 1 -- 172.21.15.5:0/2818903401 shutdown_connections 2023-07-14T13:13:00.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.472+0000 7feb5b1fa640 1 -- 172.21.15.5:0/2818903401 >> 172.21.15.5:0/2818903401 conn(0x7feb540cde90 msgr2=0x7feb540ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:00.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.472+0000 7feb5b1fa640 1 -- 172.21.15.5:0/2818903401 shutdown_connections 2023-07-14T13:13:00.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.472+0000 7feb5b1fa640 1 -- 172.21.15.5:0/2818903401 wait complete. 2023-07-14T13:13:00.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.472+0000 7feb5b1fa640 1 Processor -- start 2023-07-14T13:13:00.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.472+0000 7feb5b1fa640 1 -- start start 2023-07-14T13:13:00.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.472+0000 7feb5b1fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb3c003980 0x7feb5414f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:00.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.472+0000 7feb5b1fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb5406b610 0x7feb5406ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:00.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.472+0000 7feb5b1fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb54152310 0x7feb54152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:00.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.472+0000 7feb5b1fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5406ce00 con 0x7feb5406b610 2023-07-14T13:13:00.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.472+0000 7feb5b1fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5406d220 con 0x7feb3c003980 2023-07-14T13:13:00.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.472+0000 7feb5b1fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb54152c80 con 0x7feb54152310 2023-07-14T13:13:00.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.472+0000 7feb4bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb5406b610 0x7feb5406ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:00.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.472+0000 7feb4bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb5406b610 0x7feb5406ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60218/0 (socket says 172.21.15.5:60218) 2023-07-14T13:13:00.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.472+0000 7feb4bfff640 1 -- 172.21.15.5:0/462138733 learned_addr learned my addr 172.21.15.5:0/462138733 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:00.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.472+0000 7feb58f96640 1 --2- 172.21.15.5:0/462138733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb3c003980 0x7feb5414f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:00.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.472+0000 7feb59797640 1 --2- 172.21.15.5:0/462138733 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb54152310 0x7feb54152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:00.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.472+0000 7feb4bfff640 1 -- 172.21.15.5:0/462138733 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb54152310 msgr2=0x7feb54152740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:00.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.472+0000 7feb4bfff640 1 --2- 172.21.15.5:0/462138733 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb54152310 0x7feb54152740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:00.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.472+0000 7feb4bfff640 1 -- 172.21.15.5:0/462138733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb3c003980 msgr2=0x7feb5414f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:00.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.472+0000 7feb4bfff640 1 --2- 172.21.15.5:0/462138733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb3c003980 0x7feb5414f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:00.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.472+0000 7feb4bfff640 1 -- 172.21.15.5:0/462138733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5406f800 con 0x7feb5406b610 2023-07-14T13:13:00.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.472+0000 7feb58f96640 1 --2- 172.21.15.5:0/462138733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb3c003980 0x7feb5414f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:13:00.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.476+0000 7feb4bfff640 1 --2- 172.21.15.5:0/462138733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb5406b610 0x7feb5406ba80 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7feb4400e820 tx=0x7feb4400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:00.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.476+0000 7feb497fa640 1 -- 172.21.15.5:0/462138733 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4400c870 con 0x7feb5406b610 2023-07-14T13:13:00.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.476+0000 7feb497fa640 1 -- 172.21.15.5:0/462138733 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4400c9d0 con 0x7feb5406b610 2023-07-14T13:13:00.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.476+0000 7feb5b1fa640 1 -- 172.21.15.5:0/462138733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb5406c180 con 0x7feb5406b610 2023-07-14T13:13:00.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.476+0000 7feb497fa640 1 -- 172.21.15.5:0/462138733 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4400cd80 con 0x7feb5406b610 2023-07-14T13:13:00.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.476+0000 7feb5b1fa640 1 -- 172.21.15.5:0/462138733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb5406c740 con 0x7feb5406b610 2023-07-14T13:13:00.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.476+0000 7feb5b1fa640 1 -- 172.21.15.5:0/462138733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb5406cf40 con 0x7feb5406b610 2023-07-14T13:13:00.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.476+0000 7feb497fa640 1 -- 172.21.15.5:0/462138733 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7feb4401d460 con 0x7feb5406b610 2023-07-14T13:13:00.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.476+0000 7feb497fa640 1 --2- 172.21.15.5:0/462138733 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7feb400663d0 0x7feb40068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:00.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.476+0000 7feb497fa640 1 -- 172.21.15.5:0/462138733 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5238+0+0 (secure 0 0 0) 0x7feb44083bc0 con 0x7feb5406b610 2023-07-14T13:13:00.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.476+0000 7feb58f96640 1 --2- 172.21.15.5:0/462138733 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7feb400663d0 0x7feb40068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:00.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.480+0000 7feb58f96640 1 --2- 172.21.15.5:0/462138733 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7feb400663d0 0x7feb40068880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7feb500af000 tx=0x7feb500046d0 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:00.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.480+0000 7feb497fa640 1 -- 172.21.15.5:0/462138733 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7feb5406cf40 con 0x7feb5406b610 2023-07-14T13:13:00.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.636+0000 7feb5b1fa640 1 -- 172.21.15.5:0/462138733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7feb5406cf40 con 0x7feb5406b610 2023-07-14T13:13:00.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.636+0000 7feb497fa640 1 -- 172.21.15.5:0/462138733 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v152) v1 ==== 92+0+10 (secure 0 0 0) 0x7feb5406cf40 con 0x7feb5406b610 2023-07-14T13:13:00.674 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:13:00.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.636+0000 7feb5b1fa640 1 -- 172.21.15.5:0/462138733 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7feb400663d0 msgr2=0x7feb40068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:00.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.636+0000 7feb5b1fa640 1 --2- 172.21.15.5:0/462138733 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7feb400663d0 0x7feb40068880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7feb500af000 tx=0x7feb500046d0 comp rx=0 tx=0).stop 2023-07-14T13:13:00.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.636+0000 7feb5b1fa640 1 -- 172.21.15.5:0/462138733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb5406b610 msgr2=0x7feb5406ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:00.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.636+0000 7feb5b1fa640 1 --2- 172.21.15.5:0/462138733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb5406b610 0x7feb5406ba80 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7feb4400e820 tx=0x7feb4400ece0 comp rx=0 tx=0).stop 2023-07-14T13:13:00.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.636+0000 7feb5b1fa640 1 -- 172.21.15.5:0/462138733 shutdown_connections 2023-07-14T13:13:00.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.636+0000 7feb5b1fa640 1 --2- 172.21.15.5:0/462138733 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7feb400663d0 0x7feb40068880 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:00.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.636+0000 7feb5b1fa640 1 --2- 172.21.15.5:0/462138733 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb54152310 0x7feb54152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:00.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.636+0000 7feb5b1fa640 1 --2- 172.21.15.5:0/462138733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb5406b610 0x7feb5406ba80 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:00.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.636+0000 7feb5b1fa640 1 --2- 172.21.15.5:0/462138733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb3c003980 0x7feb5414f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:00.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.636+0000 7feb5b1fa640 1 -- 172.21.15.5:0/462138733 >> 172.21.15.5:0/462138733 conn(0x7feb540cde90 msgr2=0x7feb540c91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:00.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.636+0000 7feb5b1fa640 1 -- 172.21.15.5:0/462138733 shutdown_connections 2023-07-14T13:13:00.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.636+0000 7feb5b1fa640 1 -- 172.21.15.5:0/462138733 wait complete. 2023-07-14T13:13:00.694 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-14T13:13:00.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.800+0000 7feebf13b640 1 Processor -- start 2023-07-14T13:13:00.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.800+0000 7feebf13b640 1 -- start start 2023-07-14T13:13:00.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.804+0000 7feebf13b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feeb80b7d90 0x7feeb80cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:00.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.804+0000 7feebf13b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb80d0f60 con 0x7feeb815f3f0 2023-07-14T13:13:00.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.804+0000 7feebf13b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb80d0390 con 0x7feeb80d13f0 2023-07-14T13:13:00.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.804+0000 7feebf13b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb80d0630 con 0x7feeb80b7d90 2023-07-14T13:13:00.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.804+0000 7feebd938640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feeb80b7d90 0x7feeb80cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:00.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.804+0000 7feebe139640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7feeb815f3f0 0x7feeb80b7680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51504/0 (socket says 172.21.15.5:51504) 2023-07-14T13:13:00.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.804+0000 7feebe139640 1 -- 172.21.15.5:0/3026466952 learned_addr learned my addr 172.21.15.5:0/3026466952 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:13:00.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.804+0000 7feebd938640 1 -- 172.21.15.5:0/3026466952 >> v1:172.21.15.154:6789/0 conn(0x7feeb80d13f0 legacy=0x7feeb80ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:00.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.804+0000 7feebd938640 1 -- 172.21.15.5:0/3026466952 >> v1:172.21.15.5:6789/0 conn(0x7feeb815f3f0 legacy=0x7feeb80b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:00.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.804+0000 7feebd938640 1 -- 172.21.15.5:0/3026466952 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb80d0910 con 0x7feeb80b7d90 2023-07-14T13:13:00.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.808+0000 7feebd938640 1 --2- 172.21.15.5:0/3026466952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feeb80b7d90 0x7feeb80cc9a0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7feea80097c0 tx=0x7feea801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8232bd4f198c76ee server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:00.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.808+0000 7feebd137640 1 -- 172.21.15.5:0/3026466952 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea80ab600 con 0x7feeb80b7d90 2023-07-14T13:13:00.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.808+0000 7feebd137640 1 -- 172.21.15.5:0/3026466952 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea80a7050 con 0x7feeb80b7d90 2023-07-14T13:13:00.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.808+0000 7feebd137640 1 -- 172.21.15.5:0/3026466952 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea80ab980 con 0x7feeb80b7d90 2023-07-14T13:13:00.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.808+0000 7feebf13b640 1 -- 172.21.15.5:0/3026466952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feeb80b7d90 msgr2=0x7feeb80cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:00.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.808+0000 7feebf13b640 1 --2- 172.21.15.5:0/3026466952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feeb80b7d90 0x7feeb80cc9a0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7feea80097c0 tx=0x7feea801c3f0 comp rx=0 tx=0).stop 2023-07-14T13:13:00.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.808+0000 7feebf13b640 1 -- 172.21.15.5:0/3026466952 shutdown_connections 2023-07-14T13:13:00.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.808+0000 7feebf13b640 1 --2- 172.21.15.5:0/3026466952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feeb80b7d90 0x7feeb80cc9a0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:00.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.808+0000 7feebf13b640 1 -- 172.21.15.5:0/3026466952 >> 172.21.15.5:0/3026466952 conn(0x7feeb8069f50 msgr2=0x7feeb806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:00.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.808+0000 7feebf13b640 1 -- 172.21.15.5:0/3026466952 shutdown_connections 2023-07-14T13:13:00.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.808+0000 7feebf13b640 1 -- 172.21.15.5:0/3026466952 wait complete. 2023-07-14T13:13:00.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.808+0000 7feebf13b640 1 Processor -- start 2023-07-14T13:13:00.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.808+0000 7feebf13b640 1 -- start start 2023-07-14T13:13:00.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.812+0000 7feebf13b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feeb80b7d90 0x7feeb81577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:00.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.812+0000 7feebf13b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feeb80d13f0 0x7feeb8154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:00.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.812+0000 7feebf13b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feeb815f3f0 0x7feeb8154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:00.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.812+0000 7feebf13b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb8154cd0 con 0x7feeb80d13f0 2023-07-14T13:13:00.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.812+0000 7feebf13b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80cbd20 con 0x7feeb815f3f0 2023-07-14T13:13:00.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.812+0000 7feebf13b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80b2ab0 con 0x7feeb80b7d90 2023-07-14T13:13:00.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.812+0000 7feebd938640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feeb80d13f0 0x7feeb8154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:00.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.812+0000 7feebd938640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feeb80d13f0 0x7feeb8154250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60248/0 (socket says 172.21.15.5:60248) 2023-07-14T13:13:00.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.812+0000 7feebd938640 1 -- 172.21.15.5:0/668546665 learned_addr learned my addr 172.21.15.5:0/668546665 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:00.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.812+0000 7feebe139640 1 --2- 172.21.15.5:0/668546665 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feeb80b7d90 0x7feeb81577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:00.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.812+0000 7feebe93a640 1 --2- 172.21.15.5:0/668546665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feeb815f3f0 0x7feeb8154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:00.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.812+0000 7feebd938640 1 -- 172.21.15.5:0/668546665 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feeb80b7d90 msgr2=0x7feeb81577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:00.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.812+0000 7feebd938640 1 --2- 172.21.15.5:0/668546665 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feeb80b7d90 0x7feeb81577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:00.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.812+0000 7feebd938640 1 -- 172.21.15.5:0/668546665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feeb815f3f0 msgr2=0x7feeb8154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:00.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.812+0000 7feebd938640 1 --2- 172.21.15.5:0/668546665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feeb815f3f0 0x7feeb8154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:00.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.812+0000 7feebd938640 1 -- 172.21.15.5:0/668546665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea8009420 con 0x7feeb80d13f0 2023-07-14T13:13:00.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.812+0000 7feebd938640 1 --2- 172.21.15.5:0/668546665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feeb80d13f0 0x7feeb8154250 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7feea8019000 tx=0x7feea801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:00.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.812+0000 7feeaeffd640 1 -- 172.21.15.5:0/668546665 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea80b7650 con 0x7feeb80d13f0 2023-07-14T13:13:00.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.812+0000 7feeaeffd640 1 -- 172.21.15.5:0/668546665 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea80abe90 con 0x7feeb80d13f0 2023-07-14T13:13:00.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.812+0000 7feeaeffd640 1 -- 172.21.15.5:0/668546665 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea80b7a10 con 0x7feeb80d13f0 2023-07-14T13:13:00.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.812+0000 7feebf13b640 1 -- 172.21.15.5:0/668546665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb80cb3f0 con 0x7feeb80d13f0 2023-07-14T13:13:00.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.812+0000 7feebf13b640 1 -- 172.21.15.5:0/668546665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb80cb9b0 con 0x7feeb80d13f0 2023-07-14T13:13:00.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.812+0000 7feebf13b640 1 -- 172.21.15.5:0/668546665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb80678d0 con 0x7feeb80d13f0 2023-07-14T13:13:00.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.812+0000 7feeaeffd640 1 -- 172.21.15.5:0/668546665 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7feea80b7b70 con 0x7feeb80d13f0 2023-07-14T13:13:00.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.816+0000 7feeaeffd640 1 --2- 172.21.15.5:0/668546665 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fee9c0663a0 0x7fee9c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:00.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.816+0000 7feeaeffd640 1 -- 172.21.15.5:0/668546665 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5238+0+0 (secure 0 0 0) 0x7feea811e5c0 con 0x7feeb80d13f0 2023-07-14T13:13:00.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.816+0000 7feebe139640 1 --2- 172.21.15.5:0/668546665 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fee9c0663a0 0x7fee9c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:00.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.816+0000 7feebe139640 1 --2- 172.21.15.5:0/668546665 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fee9c0663a0 0x7fee9c068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7feeb4005890 tx=0x7feeb4009040 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:00.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.820+0000 7feeaeffd640 1 -- 172.21.15.5:0/668546665 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7feea80ebc80 con 0x7feeb80d13f0 2023-07-14T13:13:01.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.980+0000 7feebf13b640 1 -- 172.21.15.5:0/668546665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7feeb80cbeb0 con 0x7feeb80d13f0 2023-07-14T13:13:01.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.980+0000 7feeaeffd640 1 -- 172.21.15.5:0/668546665 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v152) v1 ==== 84+0+126 (secure 0 0 0) 0x7feea80bb090 con 0x7feeb80d13f0 2023-07-14T13:13:01.017 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:13:01.017 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-07-14T13:13:01.017 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:13:01.018 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-07-14T13:13:01.018 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-07-14T13:13:01.018 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:13:01.018 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:13:01.018 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 2, 2023-07-14T13:13:01.018 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": "rbd" 2023-07-14T13:13:01.018 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:13:01.018 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-07-14T13:13:01.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.980+0000 7feebf13b640 1 -- 172.21.15.5:0/668546665 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fee9c0663a0 msgr2=0x7fee9c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:01.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.980+0000 7feebf13b640 1 --2- 172.21.15.5:0/668546665 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fee9c0663a0 0x7fee9c068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7feeb4005890 tx=0x7feeb4009040 comp rx=0 tx=0).stop 2023-07-14T13:13:01.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.980+0000 7feebf13b640 1 -- 172.21.15.5:0/668546665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feeb80d13f0 msgr2=0x7feeb8154250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:01.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.980+0000 7feebf13b640 1 --2- 172.21.15.5:0/668546665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feeb80d13f0 0x7feeb8154250 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7feea8019000 tx=0x7feea801ac30 comp rx=0 tx=0).stop 2023-07-14T13:13:01.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.980+0000 7feebf13b640 1 -- 172.21.15.5:0/668546665 shutdown_connections 2023-07-14T13:13:01.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.980+0000 7feebf13b640 1 --2- 172.21.15.5:0/668546665 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fee9c0663a0 0x7fee9c068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.980+0000 7feebf13b640 1 --2- 172.21.15.5:0/668546665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feeb815f3f0 0x7feeb8154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.980+0000 7feebf13b640 1 --2- 172.21.15.5:0/668546665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feeb80d13f0 0x7feeb8154250 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.980+0000 7feebf13b640 1 --2- 172.21.15.5:0/668546665 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feeb80b7d90 0x7feeb81577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.980+0000 7feebf13b640 1 -- 172.21.15.5:0/668546665 >> 172.21.15.5:0/668546665 conn(0x7feeb8069f50 msgr2=0x7feeb80d1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.980+0000 7feebf13b640 1 -- 172.21.15.5:0/668546665 shutdown_connections 2023-07-14T13:13:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:00.980+0000 7feebf13b640 1 -- 172.21.15.5:0/668546665 wait complete. 2023-07-14T13:13:01.037 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-14T13:13:01.038 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-14T13:13:01.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.148+0000 7f4bf8740640 1 Processor -- start 2023-07-14T13:13:01.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.148+0000 7f4bf8740640 1 -- start start 2023-07-14T13:13:01.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.148+0000 7f4bf8740640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bf00cf710 0x7f4bf00caea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:01.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.148+0000 7f4bf8740640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf00d0920 con 0x7f4bf00cf2e0 2023-07-14T13:13:01.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.148+0000 7f4bf8740640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf015bfd0 con 0x7f4bf006a540 2023-07-14T13:13:01.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.148+0000 7f4bf8740640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf00cfd10 con 0x7f4bf00cf710 2023-07-14T13:13:01.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.148+0000 7f4bf5cdb640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4bf00cf2e0 0x7f4bf00ca790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51512/0 (socket says 172.21.15.5:51512) 2023-07-14T13:13:01.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.148+0000 7f4bf5cdb640 1 -- 172.21.15.5:0/414615488 learned_addr learned my addr 172.21.15.5:0/414615488 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:13:01.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.148+0000 7f4bf6cdd640 1 --2- 172.21.15.5:0/414615488 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bf00cf710 0x7f4bf00caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:01.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.152+0000 7f4bf54da640 1 -- 172.21.15.5:0/414615488 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2406145124 0 0) 0x7f4bf00d0920 con 0x7f4bf00cf2e0 2023-07-14T13:13:01.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.152+0000 7f4bf54da640 1 -- 172.21.15.5:0/414615488 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bdc003530 con 0x7f4bf00cf2e0 2023-07-14T13:13:01.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.152+0000 7f4bf54da640 1 -- 172.21.15.5:0/414615488 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834587974 0 0) 0x7f4bf015bfd0 con 0x7f4bf006a540 2023-07-14T13:13:01.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.152+0000 7f4bf54da640 1 -- 172.21.15.5:0/414615488 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf00d0920 con 0x7f4bf006a540 2023-07-14T13:13:01.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.152+0000 7f4bf6cdd640 1 -- 172.21.15.5:0/414615488 >> v1:172.21.15.154:6789/0 conn(0x7f4bf006a540 legacy=0x7f4bf006a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:01.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.152+0000 7f4bf6cdd640 1 -- 172.21.15.5:0/414615488 >> v1:172.21.15.5:6789/0 conn(0x7f4bf00cf2e0 legacy=0x7f4bf00ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:01.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.152+0000 7f4bf6cdd640 1 -- 172.21.15.5:0/414615488 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf00cfff0 con 0x7f4bf00cf710 2023-07-14T13:13:01.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.152+0000 7f4bf6cdd640 1 --2- 172.21.15.5:0/414615488 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bf00cf710 0x7f4bf00caea0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4be8009dc0 tx=0x7f4be801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f276e3aaece21b46 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:01.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.152+0000 7f4bf54da640 1 -- 172.21.15.5:0/414615488 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be80a5910 con 0x7f4bf00cf710 2023-07-14T13:13:01.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.152+0000 7f4bf54da640 1 -- 172.21.15.5:0/414615488 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be80a5a70 con 0x7f4bf00cf710 2023-07-14T13:13:01.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.152+0000 7f4bf54da640 1 -- 172.21.15.5:0/414615488 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be80a5e00 con 0x7f4bf00cf710 2023-07-14T13:13:01.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.156+0000 7f4bf8740640 1 -- 172.21.15.5:0/414615488 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bf00cf710 msgr2=0x7f4bf00caea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:01.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.156+0000 7f4bf8740640 1 --2- 172.21.15.5:0/414615488 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bf00cf710 0x7f4bf00caea0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4be8009dc0 tx=0x7f4be801c940 comp rx=0 tx=0).stop 2023-07-14T13:13:01.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.156+0000 7f4bf8740640 1 -- 172.21.15.5:0/414615488 shutdown_connections 2023-07-14T13:13:01.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.156+0000 7f4bf8740640 1 --2- 172.21.15.5:0/414615488 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bf00cf710 0x7f4bf00caea0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.156+0000 7f4bf8740640 1 -- 172.21.15.5:0/414615488 >> 172.21.15.5:0/414615488 conn(0x7f4bf0099490 msgr2=0x7f4bf0089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:01.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.156+0000 7f4bf8740640 1 -- 172.21.15.5:0/414615488 shutdown_connections 2023-07-14T13:13:01.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.156+0000 7f4bf8740640 1 -- 172.21.15.5:0/414615488 wait complete. 2023-07-14T13:13:01.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.156+0000 7f4bf8740640 1 Processor -- start 2023-07-14T13:13:01.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.156+0000 7f4bf8740640 1 -- start start 2023-07-14T13:13:01.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.156+0000 7f4bf8740640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bf006a540 0x7f4bf0153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:01.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.156+0000 7f4bf8740640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bf00cf2e0 0x7f4bf00c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:01.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.156+0000 7f4bf8740640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bf00cf710 0x7f4bf014cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:01.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.156+0000 7f4bf8740640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf014ec30 con 0x7f4bf006a540 2023-07-14T13:13:01.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.156+0000 7f4bf8740640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf00c41e0 con 0x7f4bf00cf710 2023-07-14T13:13:01.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.156+0000 7f4bf8740640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf00c44c0 con 0x7f4bf00cf2e0 2023-07-14T13:13:01.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.156+0000 7f4bf64dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bf006a540 0x7f4bf0153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:01.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.156+0000 7f4bf64dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bf006a540 0x7f4bf0153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60258/0 (socket says 172.21.15.5:60258) 2023-07-14T13:13:01.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.156+0000 7f4bf64dc640 1 -- 172.21.15.5:0/3429194311 learned_addr learned my addr 172.21.15.5:0/3429194311 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:01.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.156+0000 7f4bf6cdd640 1 --2- 172.21.15.5:0/3429194311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bf00cf710 0x7f4bf014cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:01.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.156+0000 7f4bf5cdb640 1 --2- 172.21.15.5:0/3429194311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bf00cf2e0 0x7f4bf00c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:01.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.156+0000 7f4bf64dc640 1 -- 172.21.15.5:0/3429194311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bf00cf2e0 msgr2=0x7f4bf00c63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:01.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.156+0000 7f4bf64dc640 1 --2- 172.21.15.5:0/3429194311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bf00cf2e0 0x7f4bf00c63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.156+0000 7f4bf64dc640 1 -- 172.21.15.5:0/3429194311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bf00cf710 msgr2=0x7f4bf014cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:01.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.156+0000 7f4bf64dc640 1 --2- 172.21.15.5:0/3429194311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bf00cf710 0x7f4bf014cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.156+0000 7f4bf64dc640 1 -- 172.21.15.5:0/3429194311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be8009a70 con 0x7f4bf006a540 2023-07-14T13:13:01.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.160+0000 7f4bf64dc640 1 --2- 172.21.15.5:0/3429194311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bf006a540 0x7f4bf0153340 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f4bec00c430 tx=0x7f4bec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:01.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.160+0000 7f4be6ffd640 1 -- 172.21.15.5:0/3429194311 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec0052d0 con 0x7f4bf006a540 2023-07-14T13:13:01.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.160+0000 7f4be6ffd640 1 -- 172.21.15.5:0/3429194311 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bec005450 con 0x7f4bf006a540 2023-07-14T13:13:01.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.160+0000 7f4bf8740640 1 -- 172.21.15.5:0/3429194311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf00c47a0 con 0x7f4bf006a540 2023-07-14T13:13:01.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.160+0000 7f4be6ffd640 1 -- 172.21.15.5:0/3429194311 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec003840 con 0x7f4bf006a540 2023-07-14T13:13:01.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.160+0000 7f4bf8740640 1 -- 172.21.15.5:0/3429194311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf00c3e40 con 0x7f4bf006a540 2023-07-14T13:13:01.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.160+0000 7f4bf8740640 1 -- 172.21.15.5:0/3429194311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf00678d0 con 0x7f4bf006a540 2023-07-14T13:13:01.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.160+0000 7f4be6ffd640 1 -- 172.21.15.5:0/3429194311 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4bec0039a0 con 0x7f4bf006a540 2023-07-14T13:13:01.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.160+0000 7f4be6ffd640 1 --2- 172.21.15.5:0/3429194311 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f4bd40663d0 0x7f4bd4068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:01.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.160+0000 7f4be6ffd640 1 -- 172.21.15.5:0/3429194311 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f4bec0830c0 con 0x7f4bf006a540 2023-07-14T13:13:01.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.160+0000 7f4bf5cdb640 1 --2- 172.21.15.5:0/3429194311 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f4bd40663d0 0x7f4bd4068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:01.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.164+0000 7f4bf5cdb640 1 --2- 172.21.15.5:0/3429194311 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f4bd40663d0 0x7f4bd4068880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4bf00b5ab0 tx=0x7f4be0009040 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:01.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.164+0000 7f4be6ffd640 1 -- 172.21.15.5:0/3429194311 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4bec050800 con 0x7f4bf006a540 2023-07-14T13:13:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.320+0000 7f4bf8740640 1 -- 172.21.15.5:0/3429194311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4bf00697a0 con 0x7f4bf006a540 2023-07-14T13:13:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.832+0000 7f4be6ffd640 1 -- 172.21.15.5:0/3429194311 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v153) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4bec053e20 con 0x7f4bf006a540 2023-07-14T13:13:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-07-14T13:13:01.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.836+0000 7f4bf8740640 1 -- 172.21.15.5:0/3429194311 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f4bd40663d0 msgr2=0x7f4bd4068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:01.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.836+0000 7f4bf8740640 1 --2- 172.21.15.5:0/3429194311 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f4bd40663d0 0x7f4bd4068880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4bf00b5ab0 tx=0x7f4be0009040 comp rx=0 tx=0).stop 2023-07-14T13:13:01.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.836+0000 7f4bf8740640 1 -- 172.21.15.5:0/3429194311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bf006a540 msgr2=0x7f4bf0153340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.836+0000 7f4bf8740640 1 --2- 172.21.15.5:0/3429194311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bf006a540 0x7f4bf0153340 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f4bec00c430 tx=0x7f4bec00c8f0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.836+0000 7f4bf8740640 1 -- 172.21.15.5:0/3429194311 shutdown_connections 2023-07-14T13:13:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.836+0000 7f4bf8740640 1 --2- 172.21.15.5:0/3429194311 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f4bd40663d0 0x7f4bd4068880 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.836+0000 7f4bf8740640 1 --2- 172.21.15.5:0/3429194311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bf00cf710 0x7f4bf014cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.836+0000 7f4bf8740640 1 --2- 172.21.15.5:0/3429194311 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bf00cf2e0 0x7f4bf00c63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.836+0000 7f4bf8740640 1 --2- 172.21.15.5:0/3429194311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bf006a540 0x7f4bf0153340 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.836+0000 7f4bf8740640 1 -- 172.21.15.5:0/3429194311 >> 172.21.15.5:0/3429194311 conn(0x7f4bf0099490 msgr2=0x7f4bf00b1100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:01.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.840+0000 7f4bf8740640 1 -- 172.21.15.5:0/3429194311 shutdown_connections 2023-07-14T13:13:01.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:01.840+0000 7f4bf8740640 1 -- 172.21.15.5:0/3429194311 wait complete. 2023-07-14T13:13:01.898 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-14T13:13:02.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.012+0000 7feab587b640 1 Processor -- start 2023-07-14T13:13:02.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.012+0000 7feab587b640 1 -- start start 2023-07-14T13:13:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.012+0000 7feab587b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feab00cb360 0x7feab015df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.012+0000 7feab587b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feab00b38d0 0x7feab0070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.012+0000 7feab587b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab00cc900 con 0x7feab00cd490 2023-07-14T13:13:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.012+0000 7feab587b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab00ccbe0 con 0x7feab00cb360 2023-07-14T13:13:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.012+0000 7feab587b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab015d780 con 0x7feab00b38d0 2023-07-14T13:13:02.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.016+0000 7feaaf7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7feab00cd490 0x7feab00c9d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51524/0 (socket says 172.21.15.5:51524) 2023-07-14T13:13:02.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.016+0000 7feaaf7fe640 1 -- 172.21.15.5:0/2320257020 learned_addr learned my addr 172.21.15.5:0/2320257020 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:13:02.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.016+0000 7feaaeffd640 1 --2- 172.21.15.5:0/2320257020 >> v2:172.21.15.154:3300/0 conn(0x7feab00cb360 0x7feab015df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:02.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.016+0000 7feaa7fff640 1 --2- 172.21.15.5:0/2320257020 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feab00b38d0 0x7feab0070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:02.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.016+0000 7feaae7fc640 1 -- 172.21.15.5:0/2320257020 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2112710890 0 0) 0x7feab00cc900 con 0x7feab00cd490 2023-07-14T13:13:02.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.016+0000 7feaae7fc640 1 -- 172.21.15.5:0/2320257020 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea9c003530 con 0x7feab00cd490 2023-07-14T13:13:02.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.016+0000 7feaa7fff640 1 -- 172.21.15.5:0/2320257020 >> v2:172.21.15.154:3300/0 conn(0x7feab00cb360 msgr2=0x7feab015df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:02.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.016+0000 7feaa7fff640 1 --2- 172.21.15.5:0/2320257020 >> v2:172.21.15.154:3300/0 conn(0x7feab00cb360 0x7feab015df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:02.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.016+0000 7feaa7fff640 1 -- 172.21.15.5:0/2320257020 >> v1:172.21.15.5:6789/0 conn(0x7feab00cd490 legacy=0x7feab00c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:02.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.016+0000 7feaa7fff640 1 -- 172.21.15.5:0/2320257020 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab015da60 con 0x7feab00b38d0 2023-07-14T13:13:02.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.016+0000 7feaaeffd640 1 --2- 172.21.15.5:0/2320257020 >> v2:172.21.15.154:3300/0 conn(0x7feab00cb360 0x7feab015df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:13:02.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.016+0000 7feaa7fff640 1 --2- 172.21.15.5:0/2320257020 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feab00b38d0 0x7feab0070920 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fea980097c0 tx=0x7fea9801ce10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a84f09a418ca6f3d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:02.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.020+0000 7feaae7fc640 1 -- 172.21.15.5:0/2320257020 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea980ab610 con 0x7feab00b38d0 2023-07-14T13:13:02.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.020+0000 7feaae7fc640 1 -- 172.21.15.5:0/2320257020 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea980ab770 con 0x7feab00b38d0 2023-07-14T13:13:02.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.020+0000 7feaae7fc640 1 -- 172.21.15.5:0/2320257020 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea980abb00 con 0x7feab00b38d0 2023-07-14T13:13:02.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.020+0000 7feab587b640 1 -- 172.21.15.5:0/2320257020 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feab00b38d0 msgr2=0x7feab0070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:02.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.020+0000 7feab587b640 1 --2- 172.21.15.5:0/2320257020 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feab00b38d0 0x7feab0070920 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fea980097c0 tx=0x7fea9801ce10 comp rx=0 tx=0).stop 2023-07-14T13:13:02.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.020+0000 7feab587b640 1 -- 172.21.15.5:0/2320257020 shutdown_connections 2023-07-14T13:13:02.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.020+0000 7feab587b640 1 --2- 172.21.15.5:0/2320257020 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feab00b38d0 0x7feab0070920 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:02.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.020+0000 7feab587b640 1 --2- 172.21.15.5:0/2320257020 >> v2:172.21.15.154:3300/0 conn(0x7feab00cb360 0x7feab015df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:02.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.020+0000 7feab587b640 1 -- 172.21.15.5:0/2320257020 >> 172.21.15.5:0/2320257020 conn(0x7feab00afac0 msgr2=0x7feab00afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:02.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.020+0000 7feab587b640 1 -- 172.21.15.5:0/2320257020 shutdown_connections 2023-07-14T13:13:02.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.020+0000 7feab587b640 1 -- 172.21.15.5:0/2320257020 wait complete. 2023-07-14T13:13:02.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.020+0000 7feab587b640 1 Processor -- start 2023-07-14T13:13:02.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.020+0000 7feab587b640 1 -- start start 2023-07-14T13:13:02.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.020+0000 7feab587b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feab00b38d0 0x7feab0149400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:02.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.020+0000 7feab587b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab00cb360 0x7feab015f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:02.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.020+0000 7feab587b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feab00cd490 0x7feab00b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:02.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.020+0000 7feab587b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab0161b70 con 0x7feab00cb360 2023-07-14T13:13:02.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.020+0000 7feab587b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab01606f0 con 0x7feab00cd490 2023-07-14T13:13:02.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.020+0000 7feab587b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab015fb70 con 0x7feab00b38d0 2023-07-14T13:13:02.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.020+0000 7feaa7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab00cb360 0x7feab015f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:02.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.020+0000 7feaa7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab00cb360 0x7feab015f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60266/0 (socket says 172.21.15.5:60266) 2023-07-14T13:13:02.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.020+0000 7feaa7fff640 1 -- 172.21.15.5:0/3422902425 learned_addr learned my addr 172.21.15.5:0/3422902425 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:02.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.024+0000 7feaaf7fe640 1 --2- 172.21.15.5:0/3422902425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feab00cd490 0x7feab00b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:02.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.020+0000 7feaaeffd640 1 --2- 172.21.15.5:0/3422902425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feab00b38d0 0x7feab0149400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:02.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.024+0000 7feaa7fff640 1 -- 172.21.15.5:0/3422902425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feab00b38d0 msgr2=0x7feab0149400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:02.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.024+0000 7feaa7fff640 1 --2- 172.21.15.5:0/3422902425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feab00b38d0 0x7feab0149400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:02.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.024+0000 7feaa7fff640 1 -- 172.21.15.5:0/3422902425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feab00cd490 msgr2=0x7feab00b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:02.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.024+0000 7feaa7fff640 1 --2- 172.21.15.5:0/3422902425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feab00cd490 0x7feab00b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:02.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.024+0000 7feaa7fff640 1 -- 172.21.15.5:0/3422902425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa0009420 con 0x7feab00cb360 2023-07-14T13:13:02.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.024+0000 7feaa7fff640 1 --2- 172.21.15.5:0/3422902425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab00cb360 0x7feab015f120 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fea980ad040 tx=0x7fea9801abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:02.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.024+0000 7feaacff9640 1 -- 172.21.15.5:0/3422902425 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea980bf610 con 0x7feab00cb360 2023-07-14T13:13:02.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.024+0000 7feaacff9640 1 -- 172.21.15.5:0/3422902425 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea980bf7b0 con 0x7feab00cb360 2023-07-14T13:13:02.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.024+0000 7feaacff9640 1 -- 172.21.15.5:0/3422902425 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea980bfb60 con 0x7feab00cb360 2023-07-14T13:13:02.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.024+0000 7feab587b640 1 -- 172.21.15.5:0/3422902425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea98009420 con 0x7feab00cb360 2023-07-14T13:13:02.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.024+0000 7feab587b640 1 -- 172.21.15.5:0/3422902425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab0160130 con 0x7feab00cb360 2023-07-14T13:13:02.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.024+0000 7feab587b640 1 -- 172.21.15.5:0/3422902425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab00678d0 con 0x7feab00cb360 2023-07-14T13:13:02.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.024+0000 7feaacff9640 1 -- 172.21.15.5:0/3422902425 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fea980b5400 con 0x7feab00cb360 2023-07-14T13:13:02.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.028+0000 7feaacff9640 1 --2- 172.21.15.5:0/3422902425 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fea900663a0 0x7fea90068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:02.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.028+0000 7feaacff9640 1 -- 172.21.15.5:0/3422902425 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5608+0+0 (secure 0 0 0) 0x7fea9811f290 con 0x7feab00cb360 2023-07-14T13:13:02.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.028+0000 7feaaeffd640 1 --2- 172.21.15.5:0/3422902425 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fea900663a0 0x7fea90068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:02.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.028+0000 7feaaeffd640 1 --2- 172.21.15.5:0/3422902425 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fea900663a0 0x7fea90068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feab01f7bd0 tx=0x7feaa0009190 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:02.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.028+0000 7feaacff9640 1 -- 172.21.15.5:0/3422902425 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fea980ec870 con 0x7feab00cb360 2023-07-14T13:13:02.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.184+0000 7feab587b640 1 -- 172.21.15.5:0/3422902425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7feab00cd270 con 0x7feab00cb360 2023-07-14T13:13:02.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.840+0000 7feaacff9640 1 -- 172.21.15.5:0/3422902425 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v154) v1 ==== 170+0+0 (secure 0 0 0) 0x7fea980efe90 con 0x7feab00cb360 2023-07-14T13:13:02.877 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-07-14T13:13:02.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.848+0000 7feab587b640 1 -- 172.21.15.5:0/3422902425 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fea900663a0 msgr2=0x7fea90068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:02.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.852+0000 7feab587b640 1 --2- 172.21.15.5:0/3422902425 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fea900663a0 0x7fea90068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feab01f7bd0 tx=0x7feaa0009190 comp rx=0 tx=0).stop 2023-07-14T13:13:02.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.852+0000 7feab587b640 1 -- 172.21.15.5:0/3422902425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab00cb360 msgr2=0x7feab015f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:02.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.852+0000 7feab587b640 1 --2- 172.21.15.5:0/3422902425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab00cb360 0x7feab015f120 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fea980ad040 tx=0x7fea9801abf0 comp rx=0 tx=0).stop 2023-07-14T13:13:02.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.852+0000 7feab587b640 1 -- 172.21.15.5:0/3422902425 shutdown_connections 2023-07-14T13:13:02.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.852+0000 7feab587b640 1 --2- 172.21.15.5:0/3422902425 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fea900663a0 0x7fea90068850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:02.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.852+0000 7feab587b640 1 --2- 172.21.15.5:0/3422902425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feab00cd490 0x7feab00b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:02.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.852+0000 7feab587b640 1 --2- 172.21.15.5:0/3422902425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feab00cb360 0x7feab015f120 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:02.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.856+0000 7feab587b640 1 --2- 172.21.15.5:0/3422902425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feab00b38d0 0x7feab0149400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:02.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.856+0000 7feab587b640 1 -- 172.21.15.5:0/3422902425 >> 172.21.15.5:0/3422902425 conn(0x7feab00afac0 msgr2=0x7feab00c9710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:02.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.856+0000 7feab587b640 1 -- 172.21.15.5:0/3422902425 shutdown_connections 2023-07-14T13:13:02.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:02.856+0000 7feab587b640 1 -- 172.21.15.5:0/3422902425 wait complete. 2023-07-14T13:13:02.919 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-14T13:13:03.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbbb759640 1 Processor -- start 2023-07-14T13:13:03.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbbb759640 1 -- start start 2023-07-14T13:13:03.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbbb759640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbbb40c3ac0 0x7fbbb40c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:03.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbbb759640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbbb40cd120 0x7fbbb40cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:03.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbbb759640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb40695b0 con 0x7fbbb40af2b0 2023-07-14T13:13:03.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbbb759640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb4069890 con 0x7fbbb40c3ac0 2023-07-14T13:13:03.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbbb759640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb4069b70 con 0x7fbbb40cd120 2023-07-14T13:13:03.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbb8cf4640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbbb40af2b0 0x7fbbb40ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51540/0 (socket says 172.21.15.5:51540) 2023-07-14T13:13:03.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbb8cf4640 1 -- 172.21.15.5:0/3109180830 learned_addr learned my addr 172.21.15.5:0/3109180830 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:13:03.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbb9cf6640 1 --2- 172.21.15.5:0/3109180830 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbbb40cd120 0x7fbbb40cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:03.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbb94f5640 1 --2- 172.21.15.5:0/3109180830 >> v2:172.21.15.154:3300/0 conn(0x7fbbb40c3ac0 0x7fbbb40c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:03.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbabfff640 1 -- 172.21.15.5:0/3109180830 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2535608292 0 0) 0x7fbbb40695b0 con 0x7fbbb40af2b0 2023-07-14T13:13:03.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbabfff640 1 -- 172.21.15.5:0/3109180830 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbba0003530 con 0x7fbbb40af2b0 2023-07-14T13:13:03.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbabfff640 1 -- 172.21.15.5:0/3109180830 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2235726339 0 0) 0x7fbba0003530 con 0x7fbbb40af2b0 2023-07-14T13:13:03.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbabfff640 1 -- 172.21.15.5:0/3109180830 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbbb40cd120 msgr2=0x7fbbb40cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:03.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbabfff640 1 --2- 172.21.15.5:0/3109180830 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbbb40cd120 0x7fbbb40cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:03.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbabfff640 1 -- 172.21.15.5:0/3109180830 >> v2:172.21.15.154:3300/0 conn(0x7fbbb40c3ac0 msgr2=0x7fbbb40c2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:03.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbabfff640 1 --2- 172.21.15.5:0/3109180830 >> v2:172.21.15.154:3300/0 conn(0x7fbbb40c3ac0 0x7fbbb40c2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:03.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbabfff640 1 -- 172.21.15.5:0/3109180830 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb4069e50 con 0x7fbbb40af2b0 2023-07-14T13:13:03.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbabfff640 1 -- 172.21.15.5:0/3109180830 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7fbba40016a0 con 0x7fbbb40af2b0 2023-07-14T13:13:03.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbabfff640 1 -- 172.21.15.5:0/3109180830 >> v1:172.21.15.5:6789/0 conn(0x7fbbb40af2b0 legacy=0x7fbbb40ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:03.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbabfff640 1 --2- 172.21.15.5:0/3109180830 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbbb40cd120 0x7fbba0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:03.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbabfff640 1 --2- 172.21.15.5:0/3109180830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbba0003f00 0x7fbba00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:03.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbabfff640 1 --2- 172.21.15.5:0/3109180830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbba0004d10 0x7fbba0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:03.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbabfff640 1 -- 172.21.15.5:0/3109180830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb4069890 con 0x7fbba0003f00 2023-07-14T13:13:03.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbabfff640 1 -- 172.21.15.5:0/3109180830 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb4069b70 con 0x7fbba0004d10 2023-07-14T13:13:03.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbabfff640 1 -- 172.21.15.5:0/3109180830 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba000b990 con 0x7fbbb40cd120 2023-07-14T13:13:03.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbb8cf4640 1 --2- 172.21.15.5:0/3109180830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbba0003f00 0x7fbba00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:03.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbb94f5640 1 --2- 172.21.15.5:0/3109180830 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbbb40cd120 0x7fbba0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:03.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbb9cf6640 1 --2- 172.21.15.5:0/3109180830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbba0004d10 0x7fbba0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:03.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbb8cf4640 1 -- 172.21.15.5:0/3109180830 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbbb40cd120 msgr2=0x7fbba0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:03.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbb8cf4640 1 --2- 172.21.15.5:0/3109180830 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbbb40cd120 0x7fbba0003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:03.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbb8cf4640 1 -- 172.21.15.5:0/3109180830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbba0004d10 msgr2=0x7fbba0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:03.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbb8cf4640 1 --2- 172.21.15.5:0/3109180830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbba0004d10 0x7fbba0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:03.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.032+0000 7fbbb8cf4640 1 -- 172.21.15.5:0/3109180830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba0003530 con 0x7fbba0003f00 2023-07-14T13:13:03.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.036+0000 7fbbb8cf4640 1 --2- 172.21.15.5:0/3109180830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbba0003f00 0x7fbba00047d0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fbba400c210 tx=0x7fbba401f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d13ede79a81e323 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:03.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.036+0000 7fbbabfff640 1 -- 172.21.15.5:0/3109180830 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba4005ae0 con 0x7fbba0003f00 2023-07-14T13:13:03.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.036+0000 7fbbabfff640 1 -- 172.21.15.5:0/3109180830 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba40ab070 con 0x7fbba0003f00 2023-07-14T13:13:03.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.036+0000 7fbbabfff640 1 -- 172.21.15.5:0/3109180830 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba4005e80 con 0x7fbba0003f00 2023-07-14T13:13:03.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.036+0000 7fbbbb759640 1 -- 172.21.15.5:0/3109180830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbba0003f00 msgr2=0x7fbba00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:03.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.036+0000 7fbbbb759640 1 --2- 172.21.15.5:0/3109180830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbba0003f00 0x7fbba00047d0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fbba400c210 tx=0x7fbba401f390 comp rx=0 tx=0).stop 2023-07-14T13:13:03.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.036+0000 7fbbb9cf6640 1 -- 172.21.15.5:0/3109180830 reap_dead start 2023-07-14T13:13:03.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.036+0000 7fbbbb759640 1 -- 172.21.15.5:0/3109180830 shutdown_connections 2023-07-14T13:13:03.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.036+0000 7fbbbb759640 1 -- 172.21.15.5:0/3109180830 >> 172.21.15.5:0/3109180830 conn(0x7fbbb40cde90 msgr2=0x7fbbb40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:03.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.036+0000 7fbbbb759640 1 -- 172.21.15.5:0/3109180830 shutdown_connections 2023-07-14T13:13:03.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.036+0000 7fbbbb759640 1 -- 172.21.15.5:0/3109180830 wait complete. 2023-07-14T13:13:03.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.040+0000 7fbbbb759640 1 Processor -- start 2023-07-14T13:13:03.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.040+0000 7fbbbb759640 1 -- start start 2023-07-14T13:13:03.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.040+0000 7fbbbb759640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbba0003f00 0x7fbbb414dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:03.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.040+0000 7fbbbb759640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbbb4151520 0x7fbbb41529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:03.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.040+0000 7fbbbb759640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbb414e250 0x7fbbb4152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:03.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.040+0000 7fbbbb759640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb4151ac0 con 0x7fbbb414e250 2023-07-14T13:13:03.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.040+0000 7fbbbb759640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb4151da0 con 0x7fbba0003f00 2023-07-14T13:13:03.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.040+0000 7fbbbb759640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb40b0e60 con 0x7fbbb4151520 2023-07-14T13:13:03.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.040+0000 7fbbb9cf6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbb414e250 0x7fbbb4152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:03.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.040+0000 7fbbb9cf6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbb414e250 0x7fbbb4152ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60280/0 (socket says 172.21.15.5:60280) 2023-07-14T13:13:03.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.040+0000 7fbbb9cf6640 1 -- 172.21.15.5:0/3324207770 learned_addr learned my addr 172.21.15.5:0/3324207770 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:03.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.040+0000 7fbbb94f5640 1 --2- 172.21.15.5:0/3324207770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbba0003f00 0x7fbbb414dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:03.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.040+0000 7fbbb8cf4640 1 --2- 172.21.15.5:0/3324207770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbbb4151520 0x7fbbb41529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:03.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.040+0000 7fbbb9cf6640 1 -- 172.21.15.5:0/3324207770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbbb4151520 msgr2=0x7fbbb41529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:03.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.040+0000 7fbbb9cf6640 1 --2- 172.21.15.5:0/3324207770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbbb4151520 0x7fbbb41529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:03.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.040+0000 7fbbb9cf6640 1 -- 172.21.15.5:0/3324207770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbba0003f00 msgr2=0x7fbbb414dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:03.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.040+0000 7fbbb9cf6640 1 --2- 172.21.15.5:0/3324207770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbba0003f00 0x7fbbb414dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:03.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.040+0000 7fbbb9cf6640 1 -- 172.21.15.5:0/3324207770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb40b1140 con 0x7fbbb414e250 2023-07-14T13:13:03.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.040+0000 7fbbb8cf4640 1 --2- 172.21.15.5:0/3324207770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbbb4151520 0x7fbbb41529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:13:03.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.040+0000 7fbbb9cf6640 1 --2- 172.21.15.5:0/3324207770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbb414e250 0x7fbbb4152ef0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fbbb40aeb50 tx=0x7fbbac011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:03.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.040+0000 7fbba9ffb640 1 -- 172.21.15.5:0/3324207770 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac00e040 con 0x7fbbb414e250 2023-07-14T13:13:03.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.040+0000 7fbba9ffb640 1 -- 172.21.15.5:0/3324207770 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac00f040 con 0x7fbbb414e250 2023-07-14T13:13:03.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.040+0000 7fbbbb759640 1 -- 172.21.15.5:0/3324207770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb40b1420 con 0x7fbbb414e250 2023-07-14T13:13:03.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.040+0000 7fbba9ffb640 1 -- 172.21.15.5:0/3324207770 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac015a80 con 0x7fbbb414e250 2023-07-14T13:13:03.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.044+0000 7fbbbb759640 1 -- 172.21.15.5:0/3324207770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb4153670 con 0x7fbbb414e250 2023-07-14T13:13:03.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.044+0000 7fbbbb759640 1 -- 172.21.15.5:0/3324207770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb40678d0 con 0x7fbbb414e250 2023-07-14T13:13:03.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.044+0000 7fbba9ffb640 1 -- 172.21.15.5:0/3324207770 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbbac015be0 con 0x7fbbb414e250 2023-07-14T13:13:03.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.044+0000 7fbba9ffb640 1 --2- 172.21.15.5:0/3324207770 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fbb980663d0 0x7fbb98068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:03.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.048+0000 7fbba9ffb640 1 -- 172.21.15.5:0/3324207770 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5990+0+0 (secure 0 0 0) 0x7fbbac0840e0 con 0x7fbbb414e250 2023-07-14T13:13:03.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.048+0000 7fbbb94f5640 1 --2- 172.21.15.5:0/3324207770 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fbb980663d0 0x7fbb98068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:03.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.048+0000 7fbbb94f5640 1 --2- 172.21.15.5:0/3324207770 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fbb980663d0 0x7fbb98068880 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0009be0 tx=0x7fbbb0009190 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:03.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.048+0000 7fbba9ffb640 1 -- 172.21.15.5:0/3324207770 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fbbac0513f0 con 0x7fbbb414e250 2023-07-14T13:13:03.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.236+0000 7fbbbb759640 1 -- 172.21.15.5:0/3324207770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbbb40aeb80 con 0x7fbbb414e250 2023-07-14T13:13:03.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.880+0000 7fbba9ffb640 1 -- 172.21.15.5:0/3324207770 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v69) v1 ==== 174+0+0 (secure 0 0 0) 0x7fbbac054a10 con 0x7fbbb414e250 2023-07-14T13:13:03.919 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 19 and data pool 20 2023-07-14T13:13:03.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.888+0000 7fbbbb759640 1 -- 172.21.15.5:0/3324207770 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fbb980663d0 msgr2=0x7fbb98068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:03.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.888+0000 7fbbbb759640 1 --2- 172.21.15.5:0/3324207770 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fbb980663d0 0x7fbb98068880 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0009be0 tx=0x7fbbb0009190 comp rx=0 tx=0).stop 2023-07-14T13:13:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.888+0000 7fbbbb759640 1 -- 172.21.15.5:0/3324207770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbb414e250 msgr2=0x7fbbb4152ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.888+0000 7fbbbb759640 1 --2- 172.21.15.5:0/3324207770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbb414e250 0x7fbbb4152ef0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fbbb40aeb50 tx=0x7fbbac011bf0 comp rx=0 tx=0).stop 2023-07-14T13:13:03.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.888+0000 7fbbbb759640 1 -- 172.21.15.5:0/3324207770 shutdown_connections 2023-07-14T13:13:03.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.888+0000 7fbbbb759640 1 --2- 172.21.15.5:0/3324207770 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fbb980663d0 0x7fbb98068880 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:03.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.888+0000 7fbbbb759640 1 --2- 172.21.15.5:0/3324207770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbb414e250 0x7fbbb4152ef0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:03.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.888+0000 7fbbbb759640 1 --2- 172.21.15.5:0/3324207770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbbb4151520 0x7fbbb41529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:03.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.888+0000 7fbbbb759640 1 --2- 172.21.15.5:0/3324207770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbba0003f00 0x7fbbb414dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:03.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.888+0000 7fbbbb759640 1 -- 172.21.15.5:0/3324207770 >> 172.21.15.5:0/3324207770 conn(0x7fbbb40cde90 msgr2=0x7fbbb40c2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:03.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.888+0000 7fbbbb759640 1 -- 172.21.15.5:0/3324207770 shutdown_connections 2023-07-14T13:13:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:03.888+0000 7fbbbb759640 1 -- 172.21.15.5:0/3324207770 wait complete. 2023-07-14T13:13:03.950 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:13:04.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.056+0000 7effbaff6640 1 Processor -- start 2023-07-14T13:13:04.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.056+0000 7effbaff6640 1 -- start start 2023-07-14T13:13:04.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.060+0000 7effbaff6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7effb4158ce0 0x7effb4070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.060+0000 7effbaff6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7effb40c9730 0x7effb40ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.060+0000 7effbaff6640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb40cc700 con 0x7effb40c8ad0 2023-07-14T13:13:04.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.060+0000 7effbaff6640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb40b0ff0 con 0x7effb40c9730 2023-07-14T13:13:04.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.060+0000 7effbaff6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb4070c80 con 0x7effb4158ce0 2023-07-14T13:13:04.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.060+0000 7effb9593640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7effb40c9730 0x7effb40ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.060+0000 7effb3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7effb40c8ad0 0x7effb40c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51554/0 (socket says 172.21.15.5:51554) 2023-07-14T13:13:04.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.060+0000 7effb3fff640 1 -- 172.21.15.5:0/1451951051 learned_addr learned my addr 172.21.15.5:0/1451951051 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:13:04.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.060+0000 7effb8d92640 1 --2- 172.21.15.5:0/1451951051 >> v2:172.21.15.154:3300/0 conn(0x7effb4158ce0 0x7effb4070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.060+0000 7effb9593640 1 -- 172.21.15.5:0/1451951051 >> v2:172.21.15.154:3300/0 conn(0x7effb4158ce0 msgr2=0x7effb4070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:04.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.060+0000 7effb9593640 1 --2- 172.21.15.5:0/1451951051 >> v2:172.21.15.154:3300/0 conn(0x7effb4158ce0 0x7effb4070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.060+0000 7effb9593640 1 -- 172.21.15.5:0/1451951051 >> v1:172.21.15.5:6789/0 conn(0x7effb40c8ad0 legacy=0x7effb40c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:04.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.060+0000 7effb9593640 1 -- 172.21.15.5:0/1451951051 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb40cbdd0 con 0x7effb40c9730 2023-07-14T13:13:04.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.060+0000 7effb37fe640 1 -- 172.21.15.5:0/1451951051 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1506713112 0 0) 0x7effb40cc700 con 0x7effb40c8ad0 2023-07-14T13:13:04.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.060+0000 7effb8d92640 1 --2- 172.21.15.5:0/1451951051 >> v2:172.21.15.154:3300/0 conn(0x7effb4158ce0 0x7effb4070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:13:04.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.060+0000 7effb9593640 1 --2- 172.21.15.5:0/1451951051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb40c9730 0x7effb40ccb90 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7effb4071be0 tx=0x7effac01c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c6af37411b7957 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:04.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.064+0000 7effb37fe640 1 -- 172.21.15.5:0/1451951051 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac0a58a0 con 0x7effb40c9730 2023-07-14T13:13:04.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.064+0000 7effb37fe640 1 -- 172.21.15.5:0/1451951051 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac0a5a00 con 0x7effb40c9730 2023-07-14T13:13:04.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.064+0000 7effb37fe640 1 -- 172.21.15.5:0/1451951051 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac0a5d90 con 0x7effb40c9730 2023-07-14T13:13:04.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.064+0000 7effbaff6640 1 -- 172.21.15.5:0/1451951051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb40c9730 msgr2=0x7effb40ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:04.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.064+0000 7effbaff6640 1 --2- 172.21.15.5:0/1451951051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb40c9730 0x7effb40ccb90 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7effb4071be0 tx=0x7effac01c7c0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.064+0000 7effbaff6640 1 -- 172.21.15.5:0/1451951051 shutdown_connections 2023-07-14T13:13:04.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.064+0000 7effbaff6640 1 --2- 172.21.15.5:0/1451951051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb40c9730 0x7effb40ccb90 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.064+0000 7effbaff6640 1 --2- 172.21.15.5:0/1451951051 >> v2:172.21.15.154:3300/0 conn(0x7effb4158ce0 0x7effb4070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.064+0000 7effbaff6640 1 -- 172.21.15.5:0/1451951051 >> 172.21.15.5:0/1451951051 conn(0x7effb40afcf0 msgr2=0x7effb40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:04.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.064+0000 7effbaff6640 1 -- 172.21.15.5:0/1451951051 shutdown_connections 2023-07-14T13:13:04.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.064+0000 7effbaff6640 1 -- 172.21.15.5:0/1451951051 wait complete. 2023-07-14T13:13:04.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.064+0000 7effbaff6640 1 Processor -- start 2023-07-14T13:13:04.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.064+0000 7effbaff6640 1 -- start start 2023-07-14T13:13:04.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.064+0000 7effbaff6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb40c8ad0 0x7effb414cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.064+0000 7effbaff6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effb40c9730 0x7effb40c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.064+0000 7effbaff6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effb4158ce0 0x7effb40c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.064+0000 7effbaff6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb40b1130 con 0x7effb40c8ad0 2023-07-14T13:13:04.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.064+0000 7effbaff6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb40b1380 con 0x7effb4158ce0 2023-07-14T13:13:04.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.064+0000 7effbaff6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb40b1660 con 0x7effb40c9730 2023-07-14T13:13:04.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.068+0000 7effb8d92640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb40c8ad0 0x7effb414cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.068+0000 7effb8d92640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb40c8ad0 0x7effb414cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60294/0 (socket says 172.21.15.5:60294) 2023-07-14T13:13:04.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.068+0000 7effb8d92640 1 -- 172.21.15.5:0/2032951473 learned_addr learned my addr 172.21.15.5:0/2032951473 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:04.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.068+0000 7effb3fff640 1 --2- 172.21.15.5:0/2032951473 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effb40c9730 0x7effb40c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.068+0000 7effb9593640 1 --2- 172.21.15.5:0/2032951473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effb4158ce0 0x7effb40c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.068+0000 7effb8d92640 1 -- 172.21.15.5:0/2032951473 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effb40c9730 msgr2=0x7effb40c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:04.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.068+0000 7effb8d92640 1 --2- 172.21.15.5:0/2032951473 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effb40c9730 0x7effb40c3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.068+0000 7effb8d92640 1 -- 172.21.15.5:0/2032951473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effb4158ce0 msgr2=0x7effb40c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:04.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.068+0000 7effb8d92640 1 --2- 172.21.15.5:0/2032951473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effb4158ce0 0x7effb40c4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.068+0000 7effb8d92640 1 -- 172.21.15.5:0/2032951473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac009a70 con 0x7effb40c8ad0 2023-07-14T13:13:04.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.068+0000 7effb8d92640 1 --2- 172.21.15.5:0/2032951473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb40c8ad0 0x7effb414cdc0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7effa800d800 tx=0x7effa800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:04.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.068+0000 7effb17fa640 1 -- 172.21.15.5:0/2032951473 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa800b6c0 con 0x7effb40c8ad0 2023-07-14T13:13:04.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.068+0000 7effb17fa640 1 -- 172.21.15.5:0/2032951473 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa800b820 con 0x7effb40c8ad0 2023-07-14T13:13:04.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.068+0000 7effb17fa640 1 -- 172.21.15.5:0/2032951473 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa800bbd0 con 0x7effb40c8ad0 2023-07-14T13:13:04.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.068+0000 7effbaff6640 1 -- 172.21.15.5:0/2032951473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb40b1940 con 0x7effb40c8ad0 2023-07-14T13:13:04.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.068+0000 7effbaff6640 1 -- 172.21.15.5:0/2032951473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb40b1f00 con 0x7effb40c8ad0 2023-07-14T13:13:04.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.068+0000 7effbaff6640 1 -- 172.21.15.5:0/2032951473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb40ca1a0 con 0x7effb40c8ad0 2023-07-14T13:13:04.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.068+0000 7effb17fa640 1 -- 172.21.15.5:0/2032951473 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7effa800bd30 con 0x7effb40c8ad0 2023-07-14T13:13:04.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.072+0000 7effb17fa640 1 --2- 172.21.15.5:0/2032951473 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7eff980663a0 0x7eff98068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.072+0000 7effb17fa640 1 -- 172.21.15.5:0/2032951473 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6090+0+0 (secure 0 0 0) 0x7effa80842e0 con 0x7effb40c8ad0 2023-07-14T13:13:04.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.072+0000 7effb3fff640 1 --2- 172.21.15.5:0/2032951473 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7eff980663a0 0x7eff98068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.072+0000 7effb3fff640 1 --2- 172.21.15.5:0/2032951473 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7eff980663a0 0x7eff98068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7effb4070600 tx=0x7effa0007d60 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:04.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.076+0000 7effb17fa640 1 -- 172.21.15.5:0/2032951473 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7effa80550d0 con 0x7effb40c8ad0 2023-07-14T13:13:04.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.232+0000 7effbaff6640 1 -- 172.21.15.5:0/2032951473 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effb40678d0 con 0x7effb40c8ad0 2023-07-14T13:13:04.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.232+0000 7effb17fa640 1 -- 172.21.15.5:0/2032951473 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+18318 (secure 0 0 0) 0x7effa8054c60 con 0x7effb40c8ad0 2023-07-14T13:13:04.270 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:13:04.270 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":155,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:13:03.243183+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:13:01.372511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-14T13:13:02.236215+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:13:04.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.236+0000 7effbaff6640 1 -- 172.21.15.5:0/2032951473 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7eff980663a0 msgr2=0x7eff98068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:04.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.236+0000 7effbaff6640 1 --2- 172.21.15.5:0/2032951473 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7eff980663a0 0x7eff98068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7effb4070600 tx=0x7effa0007d60 comp rx=0 tx=0).stop 2023-07-14T13:13:04.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.236+0000 7effbaff6640 1 -- 172.21.15.5:0/2032951473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb40c8ad0 msgr2=0x7effb414cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:04.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.236+0000 7effbaff6640 1 --2- 172.21.15.5:0/2032951473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb40c8ad0 0x7effb414cdc0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7effa800d800 tx=0x7effa800dcc0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.236+0000 7effbaff6640 1 -- 172.21.15.5:0/2032951473 shutdown_connections 2023-07-14T13:13:04.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.236+0000 7effbaff6640 1 --2- 172.21.15.5:0/2032951473 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7eff980663a0 0x7eff98068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.236+0000 7effbaff6640 1 --2- 172.21.15.5:0/2032951473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effb4158ce0 0x7effb40c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.236+0000 7effbaff6640 1 --2- 172.21.15.5:0/2032951473 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effb40c9730 0x7effb40c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.236+0000 7effbaff6640 1 --2- 172.21.15.5:0/2032951473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effb40c8ad0 0x7effb414cdc0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.236+0000 7effbaff6640 1 -- 172.21.15.5:0/2032951473 >> 172.21.15.5:0/2032951473 conn(0x7effb40afcf0 msgr2=0x7effb4070dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:04.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.236+0000 7effbaff6640 1 -- 172.21.15.5:0/2032951473 shutdown_connections 2023-07-14T13:13:04.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.236+0000 7effbaff6640 1 -- 172.21.15.5:0/2032951473 wait complete. 2023-07-14T13:13:04.292 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:13:04.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.400+0000 7f03262e6640 1 Processor -- start 2023-07-14T13:13:04.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.400+0000 7f03262e6640 1 -- start start 2023-07-14T13:13:04.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.400+0000 7f03262e6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f03200b7c70 0x7f03200d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.400+0000 7f03262e6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f032015fd60 0x7f03200d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.400+0000 7f03262e6640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03200ccaf0 con 0x7f03200d1850 2023-07-14T13:13:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.400+0000 7f03262e6640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03200d1190 con 0x7f032015fd60 2023-07-14T13:13:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.400+0000 7f03262e6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0320160600 con 0x7f03200b7c70 2023-07-14T13:13:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.400+0000 7f0324883640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f032015fd60 0x7f03200d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.400+0000 7f0324883640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f032015fd60 0x7f03200d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60302/0 (socket says 172.21.15.5:60302) 2023-07-14T13:13:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.400+0000 7f0324883640 1 -- 172.21.15.5:0/2034702920 learned_addr learned my addr 172.21.15.5:0/2034702920 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.400+0000 7f031f7fe640 1 --1- 172.21.15.5:0/2034702920 >> v1:172.21.15.5:6789/0 conn(0x7f03200d1850 0x7f032015f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51556/0 (socket says 172.21.15.5:51556) 2023-07-14T13:13:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.400+0000 7f031ffff640 1 --2- 172.21.15.5:0/2034702920 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f03200b7c70 0x7f03200d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.400+0000 7f031effd640 1 -- 172.21.15.5:0/2034702920 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3903637606 0 0) 0x7f03200ccaf0 con 0x7f03200d1850 2023-07-14T13:13:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.400+0000 7f031effd640 1 -- 172.21.15.5:0/2034702920 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0308003530 con 0x7f03200d1850 2023-07-14T13:13:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.400+0000 7f0324883640 1 -- 172.21.15.5:0/2034702920 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f03200b7c70 msgr2=0x7f03200d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.400+0000 7f0324883640 1 --2- 172.21.15.5:0/2034702920 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f03200b7c70 0x7f03200d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.400+0000 7f0324883640 1 -- 172.21.15.5:0/2034702920 >> v1:172.21.15.5:6789/0 conn(0x7f03200d1850 legacy=0x7f032015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.400+0000 7f0324883640 1 -- 172.21.15.5:0/2034702920 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0320160320 con 0x7f032015fd60 2023-07-14T13:13:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.404+0000 7f0324883640 1 --2- 172.21.15.5:0/2034702920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f032015fd60 0x7f03200d1da0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f0318009e80 tx=0x7f031801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc0964de6961f30 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:04.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.404+0000 7f031effd640 1 -- 172.21.15.5:0/2034702920 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03180a58a0 con 0x7f032015fd60 2023-07-14T13:13:04.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.404+0000 7f031effd640 1 -- 172.21.15.5:0/2034702920 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03180a5a00 con 0x7f032015fd60 2023-07-14T13:13:04.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.404+0000 7f031effd640 1 -- 172.21.15.5:0/2034702920 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03180a5d90 con 0x7f032015fd60 2023-07-14T13:13:04.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.404+0000 7f03262e6640 1 -- 172.21.15.5:0/2034702920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f032015fd60 msgr2=0x7f03200d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:04.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.404+0000 7f03262e6640 1 --2- 172.21.15.5:0/2034702920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f032015fd60 0x7f03200d1da0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f0318009e80 tx=0x7f031801c9c0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.404+0000 7f03262e6640 1 -- 172.21.15.5:0/2034702920 shutdown_connections 2023-07-14T13:13:04.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.404+0000 7f03262e6640 1 --2- 172.21.15.5:0/2034702920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f032015fd60 0x7f03200d1da0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.404+0000 7f03262e6640 1 --2- 172.21.15.5:0/2034702920 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f03200b7c70 0x7f03200d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.404+0000 7f03262e6640 1 -- 172.21.15.5:0/2034702920 >> 172.21.15.5:0/2034702920 conn(0x7f03200650b0 msgr2=0x7f03200654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:04.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.404+0000 7f03262e6640 1 -- 172.21.15.5:0/2034702920 shutdown_connections 2023-07-14T13:13:04.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.404+0000 7f03262e6640 1 -- 172.21.15.5:0/2034702920 wait complete. 2023-07-14T13:13:04.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.408+0000 7f03262e6640 1 Processor -- start 2023-07-14T13:13:04.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.408+0000 7f03262e6640 1 -- start start 2023-07-14T13:13:04.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.408+0000 7f03262e6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f03200b7c70 0x7f032015d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.408+0000 7f03262e6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03200d1850 0x7f032015b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.408+0000 7f03262e6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f032015fd60 0x7f032015e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.408+0000 7f03262e6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03201fcc00 con 0x7f032015fd60 2023-07-14T13:13:04.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.408+0000 7f03262e6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03201580a0 con 0x7f03200d1850 2023-07-14T13:13:04.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.408+0000 7f03262e6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0320158230 con 0x7f03200b7c70 2023-07-14T13:13:04.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.408+0000 7f0324883640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f032015fd60 0x7f032015e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.408+0000 7f0324883640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f032015fd60 0x7f032015e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60314/0 (socket says 172.21.15.5:60314) 2023-07-14T13:13:04.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.408+0000 7f0324883640 1 -- 172.21.15.5:0/222683499 learned_addr learned my addr 172.21.15.5:0/222683499 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:04.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.408+0000 7f031f7fe640 1 --2- 172.21.15.5:0/222683499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03200d1850 0x7f032015b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.408+0000 7f0324883640 1 -- 172.21.15.5:0/222683499 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f03200b7c70 msgr2=0x7f032015d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:04.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.408+0000 7f0324883640 1 --2- 172.21.15.5:0/222683499 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f03200b7c70 0x7f032015d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.408+0000 7f0324883640 1 -- 172.21.15.5:0/222683499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03200d1850 msgr2=0x7f032015b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:04.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.408+0000 7f0324883640 1 --2- 172.21.15.5:0/222683499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03200d1850 0x7f032015b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.408+0000 7f0324883640 1 -- 172.21.15.5:0/222683499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0318009b30 con 0x7f032015fd60 2023-07-14T13:13:04.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.408+0000 7f031f7fe640 1 --2- 172.21.15.5:0/222683499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03200d1850 0x7f032015b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:13:04.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.408+0000 7f0324883640 1 --2- 172.21.15.5:0/222683499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f032015fd60 0x7f032015e5e0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f03180af040 tx=0x7f0318019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:04.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.408+0000 7f031cff9640 1 -- 172.21.15.5:0/222683499 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03180b8640 con 0x7f032015fd60 2023-07-14T13:13:04.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.408+0000 7f031cff9640 1 -- 172.21.15.5:0/222683499 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03180b87a0 con 0x7f032015fd60 2023-07-14T13:13:04.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.408+0000 7f031cff9640 1 -- 172.21.15.5:0/222683499 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03180b8b30 con 0x7f032015fd60 2023-07-14T13:13:04.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.408+0000 7f03262e6640 1 -- 172.21.15.5:0/222683499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03201fbd30 con 0x7f032015fd60 2023-07-14T13:13:04.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.408+0000 7f03262e6640 1 -- 172.21.15.5:0/222683499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03201fc260 con 0x7f032015fd60 2023-07-14T13:13:04.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.412+0000 7f03262e6640 1 -- 172.21.15.5:0/222683499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03200678d0 con 0x7f032015fd60 2023-07-14T13:13:04.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.412+0000 7f031cff9640 1 -- 172.21.15.5:0/222683499 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f03180b8c90 con 0x7f032015fd60 2023-07-14T13:13:04.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.412+0000 7f031cff9640 1 --2- 172.21.15.5:0/222683499 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f030c0663a0 0x7f030c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.412+0000 7f031cff9640 1 -- 172.21.15.5:0/222683499 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f031811eee0 con 0x7f032015fd60 2023-07-14T13:13:04.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.412+0000 7f031ffff640 1 --2- 172.21.15.5:0/222683499 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f030c0663a0 0x7f030c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.412+0000 7f031ffff640 1 --2- 172.21.15.5:0/222683499 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f030c0663a0 0x7f030c068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0310006aa0 tx=0x7f0310006a30 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:04.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.416+0000 7f031cff9640 1 -- 172.21.15.5:0/222683499 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f03180ec190 con 0x7f032015fd60 2023-07-14T13:13:04.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.572+0000 7f03262e6640 1 -- 172.21.15.5:0/222683499 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f032015e3c0 con 0x7f032015fd60 2023-07-14T13:13:04.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.572+0000 7f031cff9640 1 -- 172.21.15.5:0/222683499 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+18318 (secure 0 0 0) 0x7f03180ef7b0 con 0x7f032015fd60 2023-07-14T13:13:04.610 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:13:04.610 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":155,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:13:03.243183+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:13:01.372511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-14T13:13:02.236215+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:13:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.572+0000 7f03262e6640 1 -- 172.21.15.5:0/222683499 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f030c0663a0 msgr2=0x7f030c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.572+0000 7f03262e6640 1 --2- 172.21.15.5:0/222683499 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f030c0663a0 0x7f030c068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0310006aa0 tx=0x7f0310006a30 comp rx=0 tx=0).stop 2023-07-14T13:13:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.572+0000 7f03262e6640 1 -- 172.21.15.5:0/222683499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f032015fd60 msgr2=0x7f032015e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.572+0000 7f03262e6640 1 --2- 172.21.15.5:0/222683499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f032015fd60 0x7f032015e5e0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f03180af040 tx=0x7f0318019760 comp rx=0 tx=0).stop 2023-07-14T13:13:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.576+0000 7f03262e6640 1 -- 172.21.15.5:0/222683499 shutdown_connections 2023-07-14T13:13:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.576+0000 7f03262e6640 1 --2- 172.21.15.5:0/222683499 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f030c0663a0 0x7f030c068850 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.576+0000 7f03262e6640 1 --2- 172.21.15.5:0/222683499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f032015fd60 0x7f032015e5e0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.576+0000 7f03262e6640 1 --2- 172.21.15.5:0/222683499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03200d1850 0x7f032015b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.576+0000 7f03262e6640 1 --2- 172.21.15.5:0/222683499 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f03200b7c70 0x7f032015d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.576+0000 7f03262e6640 1 -- 172.21.15.5:0/222683499 >> 172.21.15.5:0/222683499 conn(0x7f03200650b0 msgr2=0x7f0320165b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:04.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.576+0000 7f03262e6640 1 -- 172.21.15.5:0/222683499 shutdown_connections 2023-07-14T13:13:04.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.576+0000 7f03262e6640 1 -- 172.21.15.5:0/222683499 wait complete. 2023-07-14T13:13:04.632 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-14T13:13:04.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.744+0000 7f80bb9d2640 1 Processor -- start 2023-07-14T13:13:04.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.744+0000 7f80bb9d2640 1 -- start start 2023-07-14T13:13:04.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.744+0000 7f80bb9d2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f80b40c3ac0 0x7f80b40c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.744+0000 7f80bb9d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80b40cd120 0x7f80b40cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.744+0000 7f80bb9d2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b40695b0 con 0x7f80b40af2b0 2023-07-14T13:13:04.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.744+0000 7f80bb9d2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b4069890 con 0x7f80b40c3ac0 2023-07-14T13:13:04.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.744+0000 7f80bb9d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b4069b70 con 0x7f80b40cd120 2023-07-14T13:13:04.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.744+0000 7f80b976e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f80b40c3ac0 0x7f80b40c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.744+0000 7f80b8f6d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f80b40af2b0 0x7f80b40ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51568/0 (socket says 172.21.15.5:51568) 2023-07-14T13:13:04.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.744+0000 7f80b8f6d640 1 -- 172.21.15.5:0/3357883835 learned_addr learned my addr 172.21.15.5:0/3357883835 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:13:04.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.748+0000 7f80b9f6f640 1 --2- 172.21.15.5:0/3357883835 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80b40cd120 0x7f80b40cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.748+0000 7f80b976e640 1 -- 172.21.15.5:0/3357883835 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80b40cd120 msgr2=0x7f80b40cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:04.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.748+0000 7f80b976e640 1 --2- 172.21.15.5:0/3357883835 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80b40cd120 0x7f80b40cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.748+0000 7f80b976e640 1 -- 172.21.15.5:0/3357883835 >> v1:172.21.15.5:6789/0 conn(0x7f80b40af2b0 legacy=0x7f80b40ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:04.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.748+0000 7f80b976e640 1 -- 172.21.15.5:0/3357883835 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b4069e50 con 0x7f80b40c3ac0 2023-07-14T13:13:04.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.748+0000 7f80b9f6f640 1 --2- 172.21.15.5:0/3357883835 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80b40cd120 0x7f80b40cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:13:04.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.748+0000 7f80b976e640 1 --2- 172.21.15.5:0/3357883835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80b40c3ac0 0x7f80b40c2d30 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f80b00097c0 tx=0x7f80b001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=650072f96cf89878 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:04.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.748+0000 7f80abfff640 1 -- 172.21.15.5:0/3357883835 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b00ab610 con 0x7f80b40c3ac0 2023-07-14T13:13:04.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.748+0000 7f80abfff640 1 -- 172.21.15.5:0/3357883835 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b00ab770 con 0x7f80b40c3ac0 2023-07-14T13:13:04.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.748+0000 7f80abfff640 1 -- 172.21.15.5:0/3357883835 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b00abb00 con 0x7f80b40c3ac0 2023-07-14T13:13:04.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.748+0000 7f80bb9d2640 1 -- 172.21.15.5:0/3357883835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80b40c3ac0 msgr2=0x7f80b40c2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:04.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.748+0000 7f80bb9d2640 1 --2- 172.21.15.5:0/3357883835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80b40c3ac0 0x7f80b40c2d30 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f80b00097c0 tx=0x7f80b001c3f0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.752+0000 7f80bb9d2640 1 -- 172.21.15.5:0/3357883835 shutdown_connections 2023-07-14T13:13:04.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.752+0000 7f80bb9d2640 1 --2- 172.21.15.5:0/3357883835 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80b40cd120 0x7f80b40cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.752+0000 7f80bb9d2640 1 --2- 172.21.15.5:0/3357883835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80b40c3ac0 0x7f80b40c2d30 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.752+0000 7f80bb9d2640 1 -- 172.21.15.5:0/3357883835 >> 172.21.15.5:0/3357883835 conn(0x7f80b40cde90 msgr2=0x7f80b40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:04.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.752+0000 7f80bb9d2640 1 -- 172.21.15.5:0/3357883835 shutdown_connections 2023-07-14T13:13:04.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.752+0000 7f80bb9d2640 1 -- 172.21.15.5:0/3357883835 wait complete. 2023-07-14T13:13:04.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.752+0000 7f80bb9d2640 1 Processor -- start 2023-07-14T13:13:04.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.752+0000 7f80bb9d2640 1 -- start start 2023-07-14T13:13:04.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.752+0000 7f80bb9d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80b40af2b0 0x7f80b4145f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.752+0000 7f80bb9d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80b40c3ac0 0x7f80b4070890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.752+0000 7f80bb9d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80b40cd120 0x7f80b406c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.752+0000 7f80bb9d2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b40c7460 con 0x7f80b40c3ac0 2023-07-14T13:13:04.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.752+0000 7f80bb9d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b40c9a50 con 0x7f80b40af2b0 2023-07-14T13:13:04.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.752+0000 7f80bb9d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b40c8e40 con 0x7f80b40cd120 2023-07-14T13:13:04.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.752+0000 7f80b8f6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80b40c3ac0 0x7f80b4070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.752+0000 7f80b8f6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80b40c3ac0 0x7f80b4070890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60342/0 (socket says 172.21.15.5:60342) 2023-07-14T13:13:04.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.752+0000 7f80b8f6d640 1 -- 172.21.15.5:0/1036409048 learned_addr learned my addr 172.21.15.5:0/1036409048 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:04.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.752+0000 7f80b9f6f640 1 --2- 172.21.15.5:0/1036409048 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80b40cd120 0x7f80b406c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.752+0000 7f80b976e640 1 --2- 172.21.15.5:0/1036409048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80b40af2b0 0x7f80b4145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.752+0000 7f80b8f6d640 1 -- 172.21.15.5:0/1036409048 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80b40cd120 msgr2=0x7f80b406c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:04.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.752+0000 7f80b8f6d640 1 --2- 172.21.15.5:0/1036409048 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80b40cd120 0x7f80b406c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.752+0000 7f80b8f6d640 1 -- 172.21.15.5:0/1036409048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80b40af2b0 msgr2=0x7f80b4145f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:04.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.752+0000 7f80b8f6d640 1 --2- 172.21.15.5:0/1036409048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80b40af2b0 0x7f80b4145f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.752+0000 7f80b8f6d640 1 -- 172.21.15.5:0/1036409048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b0009420 con 0x7f80b40c3ac0 2023-07-14T13:13:04.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.752+0000 7f80b976e640 1 --2- 172.21.15.5:0/1036409048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80b40af2b0 0x7f80b4145f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:13:04.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.752+0000 7f80b8f6d640 1 --2- 172.21.15.5:0/1036409048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80b40c3ac0 0x7f80b4070890 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f80a400c420 tx=0x7f80a400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:04.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.752+0000 7f80a9ffb640 1 -- 172.21.15.5:0/1036409048 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a4005cf0 con 0x7f80b40c3ac0 2023-07-14T13:13:04.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.756+0000 7f80a9ffb640 1 -- 172.21.15.5:0/1036409048 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a4005e50 con 0x7f80b40c3ac0 2023-07-14T13:13:04.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.756+0000 7f80bb9d2640 1 -- 172.21.15.5:0/1036409048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b40c9120 con 0x7f80b40c3ac0 2023-07-14T13:13:04.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.756+0000 7f80a9ffb640 1 -- 172.21.15.5:0/1036409048 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a40072f0 con 0x7f80b40c3ac0 2023-07-14T13:13:04.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.756+0000 7f80bb9d2640 1 -- 172.21.15.5:0/1036409048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b40c96e0 con 0x7f80b40c3ac0 2023-07-14T13:13:04.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.756+0000 7f80bb9d2640 1 -- 172.21.15.5:0/1036409048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b40678d0 con 0x7f80b40c3ac0 2023-07-14T13:13:04.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.756+0000 7f80a9ffb640 1 -- 172.21.15.5:0/1036409048 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f80a4007450 con 0x7f80b40c3ac0 2023-07-14T13:13:04.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.756+0000 7f80a9ffb640 1 --2- 172.21.15.5:0/1036409048 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f80980663a0 0x7f8098068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.756+0000 7f80a9ffb640 1 -- 172.21.15.5:0/1036409048 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f80a40833c0 con 0x7f80b40c3ac0 2023-07-14T13:13:04.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.756+0000 7f80b976e640 1 --2- 172.21.15.5:0/1036409048 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f80980663a0 0x7f8098068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.760+0000 7f80b976e640 1 --2- 172.21.15.5:0/1036409048 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f80980663a0 0x7f8098068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f80b00af000 tx=0x7f80b00a7000 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:04.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.760+0000 7f80a9ffb640 1 -- 172.21.15.5:0/1036409048 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f80a40507b0 con 0x7f80b40c3ac0 2023-07-14T13:13:04.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:04.956+0000 7f80bb9d2640 1 -- 172.21.15.5:0/1036409048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f80b40cc4f0 con 0x7f80b40c3ac0 2023-07-14T13:13:05.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:05.884+0000 7f80a9ffb640 1 -- 172.21.15.5:0/1036409048 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v72) v1 ==== 118+0+0 (secure 0 0 0) 0x7f80a4053dd0 con 0x7f80b40c3ac0 2023-07-14T13:13:05.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:05.888+0000 7f80bb9d2640 1 -- 172.21.15.5:0/1036409048 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f80980663a0 msgr2=0x7f8098068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:05.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:05.888+0000 7f80bb9d2640 1 --2- 172.21.15.5:0/1036409048 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f80980663a0 0x7f8098068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f80b00af000 tx=0x7f80b00a7000 comp rx=0 tx=0).stop 2023-07-14T13:13:05.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:05.888+0000 7f80bb9d2640 1 -- 172.21.15.5:0/1036409048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80b40c3ac0 msgr2=0x7f80b4070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:05.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:05.888+0000 7f80bb9d2640 1 --2- 172.21.15.5:0/1036409048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80b40c3ac0 0x7f80b4070890 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f80a400c420 tx=0x7f80a400c8e0 comp rx=0 tx=0).stop 2023-07-14T13:13:05.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:05.888+0000 7f80bb9d2640 1 -- 172.21.15.5:0/1036409048 shutdown_connections 2023-07-14T13:13:05.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:05.888+0000 7f80bb9d2640 1 --2- 172.21.15.5:0/1036409048 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f80980663a0 0x7f8098068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:05.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:05.888+0000 7f80bb9d2640 1 --2- 172.21.15.5:0/1036409048 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80b40cd120 0x7f80b406c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:05.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:05.888+0000 7f80bb9d2640 1 --2- 172.21.15.5:0/1036409048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80b40c3ac0 0x7f80b4070890 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:05.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:05.888+0000 7f80bb9d2640 1 --2- 172.21.15.5:0/1036409048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80b40af2b0 0x7f80b4145f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:05.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:05.888+0000 7f80bb9d2640 1 -- 172.21.15.5:0/1036409048 >> 172.21.15.5:0/1036409048 conn(0x7f80b40cde90 msgr2=0x7f80b415a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:05.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:05.888+0000 7f80bb9d2640 1 -- 172.21.15.5:0/1036409048 shutdown_connections 2023-07-14T13:13:05.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:05.888+0000 7f80bb9d2640 1 -- 172.21.15.5:0/1036409048 wait complete. 2023-07-14T13:13:05.947 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-14T13:13:05.947 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-14T13:13:06.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.060+0000 7fe70ba9c640 1 Processor -- start 2023-07-14T13:13:06.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.060+0000 7fe70ba9c640 1 -- start start 2023-07-14T13:13:06.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe70ba9c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe704159440 0x7fe7040c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:06.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe70ba9c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7041532b0 con 0x7fe7040aeb40 2023-07-14T13:13:06.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe70ba9c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7040ca6f0 con 0x7fe70415cef0 2023-07-14T13:13:06.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe70ba9c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70415d360 con 0x7fe704159440 2023-07-14T13:13:06.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe709838640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe7040aeb40 0x7fe7040aef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51576/0 (socket says 172.21.15.5:51576) 2023-07-14T13:13:06.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe709838640 1 -- 172.21.15.5:0/845099673 learned_addr learned my addr 172.21.15.5:0/845099673 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:13:06.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe70a039640 1 --2- 172.21.15.5:0/845099673 >> v2:172.21.15.154:3300/0 conn(0x7fe704159440 0x7fe7040c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:06.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe708836640 1 -- 172.21.15.5:0/845099673 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 878893901 0 0) 0x7fe7041532b0 con 0x7fe7040aeb40 2023-07-14T13:13:06.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe708836640 1 -- 172.21.15.5:0/845099673 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6f0003530 con 0x7fe7040aeb40 2023-07-14T13:13:06.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe708836640 1 -- 172.21.15.5:0/845099673 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2145567200 0 0) 0x7fe7040ca6f0 con 0x7fe70415cef0 2023-07-14T13:13:06.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe708836640 1 -- 172.21.15.5:0/845099673 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7041532b0 con 0x7fe70415cef0 2023-07-14T13:13:06.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe708836640 1 -- 172.21.15.5:0/845099673 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1469905790 0 0) 0x7fe6f0003530 con 0x7fe7040aeb40 2023-07-14T13:13:06.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe708836640 1 -- 172.21.15.5:0/845099673 >> v2:172.21.15.154:3300/0 conn(0x7fe704159440 msgr2=0x7fe7040c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:06.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe708836640 1 --2- 172.21.15.5:0/845099673 >> v2:172.21.15.154:3300/0 conn(0x7fe704159440 0x7fe7040c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:06.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe708836640 1 -- 172.21.15.5:0/845099673 >> v1:172.21.15.154:6789/0 conn(0x7fe70415cef0 legacy=0x7fe704158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:06.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe708836640 1 -- 172.21.15.5:0/845099673 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7041599d0 con 0x7fe7040aeb40 2023-07-14T13:13:06.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe708836640 1 -- 172.21.15.5:0/845099673 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7fe700001600 con 0x7fe7040aeb40 2023-07-14T13:13:06.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe708836640 1 -- 172.21.15.5:0/845099673 >> v1:172.21.15.5:6789/0 conn(0x7fe7040aeb40 legacy=0x7fe7040aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:06.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe708836640 1 --2- 172.21.15.5:0/845099673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6f0003b60 0x7fe6f0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:06.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe708836640 1 --2- 172.21.15.5:0/845099673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6f00047d0 0x7fe6f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:06.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe708836640 1 --2- 172.21.15.5:0/845099673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6f0005180 0x7fe6f000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:06.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe708836640 1 -- 172.21.15.5:0/845099673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70415d360 con 0x7fe6f0003b60 2023-07-14T13:13:06.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe708836640 1 -- 172.21.15.5:0/845099673 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f000c060 con 0x7fe6f00047d0 2023-07-14T13:13:06.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe708836640 1 -- 172.21.15.5:0/845099673 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f000c1f0 con 0x7fe6f0005180 2023-07-14T13:13:06.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe709838640 1 --2- 172.21.15.5:0/845099673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6f0003b60 0x7fe6f0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:06.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe709037640 1 --2- 172.21.15.5:0/845099673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6f00047d0 0x7fe6f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:06.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe70a039640 1 --2- 172.21.15.5:0/845099673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6f0005180 0x7fe6f000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:06.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe709838640 1 -- 172.21.15.5:0/845099673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6f0005180 msgr2=0x7fe6f000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:06.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe709838640 1 --2- 172.21.15.5:0/845099673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6f0005180 0x7fe6f000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:06.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe709838640 1 -- 172.21.15.5:0/845099673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6f00047d0 msgr2=0x7fe6f0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:06.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe709838640 1 --2- 172.21.15.5:0/845099673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6f00047d0 0x7fe6f0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:06.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe709838640 1 -- 172.21.15.5:0/845099673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f0003530 con 0x7fe6f0003b60 2023-07-14T13:13:06.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.064+0000 7fe70a039640 1 -- 172.21.15.5:0/845099673 reap_dead start 2023-07-14T13:13:06.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.068+0000 7fe709838640 1 --2- 172.21.15.5:0/845099673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6f0003b60 0x7fe6f0003f50 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fe700007f20 tx=0x7fe70001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2989efd09797b1ad server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:06.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.068+0000 7fe708836640 1 -- 172.21.15.5:0/845099673 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700005ba0 con 0x7fe6f0003b60 2023-07-14T13:13:06.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.068+0000 7fe708836640 1 -- 172.21.15.5:0/845099673 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe700005d20 con 0x7fe6f0003b60 2023-07-14T13:13:06.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.068+0000 7fe708836640 1 -- 172.21.15.5:0/845099673 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7000072b0 con 0x7fe6f0003b60 2023-07-14T13:13:06.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.068+0000 7fe70ba9c640 1 -- 172.21.15.5:0/845099673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6f0003b60 msgr2=0x7fe6f0003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:06.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.068+0000 7fe70ba9c640 1 --2- 172.21.15.5:0/845099673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6f0003b60 0x7fe6f0003f50 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fe700007f20 tx=0x7fe70001ca30 comp rx=0 tx=0).stop 2023-07-14T13:13:06.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.068+0000 7fe70ba9c640 1 -- 172.21.15.5:0/845099673 shutdown_connections 2023-07-14T13:13:06.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.068+0000 7fe70ba9c640 1 --2- 172.21.15.5:0/845099673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6f0003b60 0x7fe6f0003f50 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:06.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.068+0000 7fe70ba9c640 1 -- 172.21.15.5:0/845099673 >> 172.21.15.5:0/845099673 conn(0x7fe7040cde90 msgr2=0x7fe7040ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:06.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.068+0000 7fe70ba9c640 1 -- 172.21.15.5:0/845099673 shutdown_connections 2023-07-14T13:13:06.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.068+0000 7fe70ba9c640 1 -- 172.21.15.5:0/845099673 wait complete. 2023-07-14T13:13:06.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.068+0000 7fe70ba9c640 1 Processor -- start 2023-07-14T13:13:06.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.068+0000 7fe70ba9c640 1 -- start start 2023-07-14T13:13:06.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.072+0000 7fe70ba9c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6f0003b60 0x7fe70414a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:06.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.072+0000 7fe70ba9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe704153440 0x7fe7041f39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:06.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.072+0000 7fe70ba9c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7041538b0 0x7fe70415af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:06.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.072+0000 7fe70ba9c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe704155140 con 0x7fe704153440 2023-07-14T13:13:06.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.072+0000 7fe70ba9c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe704155420 con 0x7fe7041538b0 2023-07-14T13:13:06.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.072+0000 7fe70ba9c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe704155700 con 0x7fe6f0003b60 2023-07-14T13:13:06.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.072+0000 7fe709037640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe704153440 0x7fe7041f39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:06.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.072+0000 7fe709037640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe704153440 0x7fe7041f39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60360/0 (socket says 172.21.15.5:60360) 2023-07-14T13:13:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.072+0000 7fe709037640 1 -- 172.21.15.5:0/2513522862 learned_addr learned my addr 172.21.15.5:0/2513522862 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.072+0000 7fe70a039640 1 --2- 172.21.15.5:0/2513522862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7041538b0 0x7fe70415af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.072+0000 7fe709838640 1 --2- 172.21.15.5:0/2513522862 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6f0003b60 0x7fe70414a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.072+0000 7fe709037640 1 -- 172.21.15.5:0/2513522862 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6f0003b60 msgr2=0x7fe70414a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.072+0000 7fe709037640 1 --2- 172.21.15.5:0/2513522862 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6f0003b60 0x7fe70414a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.072+0000 7fe709037640 1 -- 172.21.15.5:0/2513522862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7041538b0 msgr2=0x7fe70415af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:06.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.072+0000 7fe709037640 1 --2- 172.21.15.5:0/2513522862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7041538b0 0x7fe70415af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.072+0000 7fe709037640 1 -- 172.21.15.5:0/2513522862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7041559e0 con 0x7fe704153440 2023-07-14T13:13:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.072+0000 7fe70a039640 1 --2- 172.21.15.5:0/2513522862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7041538b0 0x7fe70415af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:13:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.072+0000 7fe709037640 1 --2- 172.21.15.5:0/2513522862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe704153440 0x7fe7041f39f0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fe6f400e500 tx=0x7fe6f400e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.072+0000 7fe6fa7fc640 1 -- 172.21.15.5:0/2513522862 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f400ee20 con 0x7fe704153440 2023-07-14T13:13:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.072+0000 7fe6fa7fc640 1 -- 172.21.15.5:0/2513522862 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f40052e0 con 0x7fe704153440 2023-07-14T13:13:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.072+0000 7fe6fa7fc640 1 -- 172.21.15.5:0/2513522862 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4006a20 con 0x7fe704153440 2023-07-14T13:13:06.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.072+0000 7fe70ba9c640 1 -- 172.21.15.5:0/2513522862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe704155cc0 con 0x7fe704153440 2023-07-14T13:13:06.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.072+0000 7fe70ba9c640 1 -- 172.21.15.5:0/2513522862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7041f3f30 con 0x7fe704153440 2023-07-14T13:13:06.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.072+0000 7fe70ba9c640 1 -- 172.21.15.5:0/2513522862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7041f4150 con 0x7fe704153440 2023-07-14T13:13:06.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.076+0000 7fe6fa7fc640 1 -- 172.21.15.5:0/2513522862 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe6f4006b80 con 0x7fe704153440 2023-07-14T13:13:06.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.076+0000 7fe6fa7fc640 1 --2- 172.21.15.5:0/2513522862 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fe6e80663a0 0x7fe6e8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:06.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.076+0000 7fe6fa7fc640 1 -- 172.21.15.5:0/2513522862 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fe6f4082ca0 con 0x7fe704153440 2023-07-14T13:13:06.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.076+0000 7fe709838640 1 --2- 172.21.15.5:0/2513522862 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fe6e80663a0 0x7fe6e8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:06.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.076+0000 7fe709838640 1 --2- 172.21.15.5:0/2513522862 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fe6e80663a0 0x7fe6e8068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe6f00057b0 tx=0x7fe7000a7070 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:06.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.080+0000 7fe6fa7fc640 1 -- 172.21.15.5:0/2513522862 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe6f404ff50 con 0x7fe704153440 2023-07-14T13:13:06.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.268+0000 7fe70ba9c640 1 -- 172.21.15.5:0/2513522862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe7040678d0 con 0x7fe704153440 2023-07-14T13:13:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.884+0000 7fe6fa7fc640 1 -- 172.21.15.5:0/2513522862 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v73) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe6f4053570 con 0x7fe704153440 2023-07-14T13:13:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.888+0000 7fe70ba9c640 1 -- 172.21.15.5:0/2513522862 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fe6e80663a0 msgr2=0x7fe6e8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.888+0000 7fe70ba9c640 1 --2- 172.21.15.5:0/2513522862 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fe6e80663a0 0x7fe6e8068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe6f00057b0 tx=0x7fe7000a7070 comp rx=0 tx=0).stop 2023-07-14T13:13:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.888+0000 7fe70ba9c640 1 -- 172.21.15.5:0/2513522862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe704153440 msgr2=0x7fe7041f39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.888+0000 7fe70ba9c640 1 --2- 172.21.15.5:0/2513522862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe704153440 0x7fe7041f39f0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fe6f400e500 tx=0x7fe6f400e5f0 comp rx=0 tx=0).stop 2023-07-14T13:13:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.888+0000 7fe70ba9c640 1 -- 172.21.15.5:0/2513522862 shutdown_connections 2023-07-14T13:13:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.888+0000 7fe70ba9c640 1 --2- 172.21.15.5:0/2513522862 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fe6e80663a0 0x7fe6e8068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.888+0000 7fe70ba9c640 1 --2- 172.21.15.5:0/2513522862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7041538b0 0x7fe70415af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.888+0000 7fe70ba9c640 1 --2- 172.21.15.5:0/2513522862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe704153440 0x7fe7041f39f0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.888+0000 7fe70ba9c640 1 --2- 172.21.15.5:0/2513522862 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6f0003b60 0x7fe70414a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.888+0000 7fe70ba9c640 1 -- 172.21.15.5:0/2513522862 >> 172.21.15.5:0/2513522862 conn(0x7fe7040cde90 msgr2=0x7fe704069430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.888+0000 7fe70ba9c640 1 -- 172.21.15.5:0/2513522862 shutdown_connections 2023-07-14T13:13:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:06.888+0000 7fe70ba9c640 1 -- 172.21.15.5:0/2513522862 wait complete. 2023-07-14T13:13:06.946 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-14T13:13:06.947 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:13:07.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.052+0000 7f1c9ff9d640 1 Processor -- start 2023-07-14T13:13:07.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.056+0000 7f1c9ff9d640 1 -- start start 2023-07-14T13:13:07.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.056+0000 7f1c9ff9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1c98070b70 0x7f1c98070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:07.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.056+0000 7f1c9ff9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1c9806b1e0 0x7f1c980c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:07.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.056+0000 7f1c9ff9d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c980cac70 con 0x7f1c980c21f0 2023-07-14T13:13:07.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.056+0000 7f1c9ff9d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c98071480 con 0x7f1c9806b1e0 2023-07-14T13:13:07.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.056+0000 7f1c9ff9d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c980ca060 con 0x7f1c98070b70 2023-07-14T13:13:07.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.056+0000 7f1c9d538640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1c9806b1e0 0x7f1c980c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:07.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.056+0000 7f1c9d538640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1c9806b1e0 0x7f1c980c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60362/0 (socket says 172.21.15.5:60362) 2023-07-14T13:13:07.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.056+0000 7f1c9e53a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1c980c21f0 0x7f1c980cb100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51590/0 (socket says 172.21.15.5:51590) 2023-07-14T13:13:07.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.056+0000 7f1c9d538640 1 -- 172.21.15.5:0/1426660445 learned_addr learned my addr 172.21.15.5:0/1426660445 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:07.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.056+0000 7f1c9dd39640 1 --2- 172.21.15.5:0/1426660445 >> v2:172.21.15.154:3300/0 conn(0x7f1c98070b70 0x7f1c98070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:07.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.056+0000 7f1c9d538640 1 -- 172.21.15.5:0/1426660445 >> v2:172.21.15.154:3300/0 conn(0x7f1c98070b70 msgr2=0x7f1c98070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:07.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.056+0000 7f1c9d538640 1 --2- 172.21.15.5:0/1426660445 >> v2:172.21.15.154:3300/0 conn(0x7f1c98070b70 0x7f1c98070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.056+0000 7f1c9d538640 1 -- 172.21.15.5:0/1426660445 >> v1:172.21.15.5:6789/0 conn(0x7f1c980c21f0 legacy=0x7f1c980cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:07.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.056+0000 7f1c9d538640 1 -- 172.21.15.5:0/1426660445 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c980ca340 con 0x7f1c9806b1e0 2023-07-14T13:13:07.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.060+0000 7f1c9d538640 1 --2- 172.21.15.5:0/1426660445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c9806b1e0 0x7f1c980c1cb0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f1c9806f1f0 tx=0x7f1c8801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef07bb868d35cfb3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:07.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.060+0000 7f1c9cd37640 1 -- 172.21.15.5:0/1426660445 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c880aa430 con 0x7f1c9806b1e0 2023-07-14T13:13:07.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.060+0000 7f1c9cd37640 1 -- 172.21.15.5:0/1426660445 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c880aa590 con 0x7f1c9806b1e0 2023-07-14T13:13:07.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.060+0000 7f1c9cd37640 1 -- 172.21.15.5:0/1426660445 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c880aa920 con 0x7f1c9806b1e0 2023-07-14T13:13:07.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.060+0000 7f1c9ff9d640 1 -- 172.21.15.5:0/1426660445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c9806b1e0 msgr2=0x7f1c980c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:07.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.060+0000 7f1c9ff9d640 1 --2- 172.21.15.5:0/1426660445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c9806b1e0 0x7f1c980c1cb0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f1c9806f1f0 tx=0x7f1c8801c4d0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.060+0000 7f1c9ff9d640 1 -- 172.21.15.5:0/1426660445 shutdown_connections 2023-07-14T13:13:07.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.060+0000 7f1c9ff9d640 1 --2- 172.21.15.5:0/1426660445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c9806b1e0 0x7f1c980c1cb0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.060+0000 7f1c9ff9d640 1 --2- 172.21.15.5:0/1426660445 >> v2:172.21.15.154:3300/0 conn(0x7f1c98070b70 0x7f1c98070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.060+0000 7f1c9ff9d640 1 -- 172.21.15.5:0/1426660445 >> 172.21.15.5:0/1426660445 conn(0x7f1c980afcf0 msgr2=0x7f1c980b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:07.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.060+0000 7f1c9ff9d640 1 -- 172.21.15.5:0/1426660445 shutdown_connections 2023-07-14T13:13:07.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.060+0000 7f1c9ff9d640 1 -- 172.21.15.5:0/1426660445 wait complete. 2023-07-14T13:13:07.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.060+0000 7f1c9ff9d640 1 Processor -- start 2023-07-14T13:13:07.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.060+0000 7f1c9ff9d640 1 -- start start 2023-07-14T13:13:07.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.064+0000 7f1c9ff9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c9806b1e0 0x7f1c980af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:07.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.064+0000 7f1c9ff9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c98070b70 0x7f1c980c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:07.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.064+0000 7f1c9ff9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c980c21f0 0x7f1c981524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:07.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.064+0000 7f1c9ff9d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c98153ac0 con 0x7f1c9806b1e0 2023-07-14T13:13:07.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.064+0000 7f1c9ff9d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c98153700 con 0x7f1c980c21f0 2023-07-14T13:13:07.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.064+0000 7f1c9ff9d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c980b3900 con 0x7f1c98070b70 2023-07-14T13:13:07.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.064+0000 7f1c9dd39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c9806b1e0 0x7f1c980af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:07.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.064+0000 7f1c9dd39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c9806b1e0 0x7f1c980af490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60374/0 (socket says 172.21.15.5:60374) 2023-07-14T13:13:07.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.064+0000 7f1c9dd39640 1 -- 172.21.15.5:0/3020836437 learned_addr learned my addr 172.21.15.5:0/3020836437 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:07.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.064+0000 7f1c9d538640 1 --2- 172.21.15.5:0/3020836437 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c98070b70 0x7f1c980c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:07.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.064+0000 7f1c9e53a640 1 --2- 172.21.15.5:0/3020836437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c980c21f0 0x7f1c981524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:07.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.064+0000 7f1c9dd39640 1 -- 172.21.15.5:0/3020836437 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c98070b70 msgr2=0x7f1c980c5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:07.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.064+0000 7f1c9dd39640 1 --2- 172.21.15.5:0/3020836437 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c98070b70 0x7f1c980c5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.064+0000 7f1c9dd39640 1 -- 172.21.15.5:0/3020836437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c980c21f0 msgr2=0x7f1c981524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:07.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.064+0000 7f1c9dd39640 1 --2- 172.21.15.5:0/3020836437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c980c21f0 0x7f1c981524d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.064+0000 7f1c9dd39640 1 -- 172.21.15.5:0/3020836437 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c880094d0 con 0x7f1c9806b1e0 2023-07-14T13:13:07.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.064+0000 7f1c9d538640 1 --2- 172.21.15.5:0/3020836437 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c98070b70 0x7f1c980c5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:13:07.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.064+0000 7f1c9dd39640 1 --2- 172.21.15.5:0/3020836437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c9806b1e0 0x7f1c980af490 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400d800 tx=0x7f1c9400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:07.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.064+0000 7f1c8e7fc640 1 -- 172.21.15.5:0/3020836437 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9400b6c0 con 0x7f1c9806b1e0 2023-07-14T13:13:07.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.064+0000 7f1c8e7fc640 1 -- 172.21.15.5:0/3020836437 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9400b820 con 0x7f1c9806b1e0 2023-07-14T13:13:07.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.064+0000 7f1c8e7fc640 1 -- 172.21.15.5:0/3020836437 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9400bb90 con 0x7f1c9806b1e0 2023-07-14T13:13:07.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.064+0000 7f1c9ff9d640 1 -- 172.21.15.5:0/3020836437 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c980b3be0 con 0x7f1c9806b1e0 2023-07-14T13:13:07.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.064+0000 7f1c9ff9d640 1 -- 172.21.15.5:0/3020836437 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c980af9d0 con 0x7f1c9806b1e0 2023-07-14T13:13:07.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.064+0000 7f1c9ff9d640 1 -- 172.21.15.5:0/3020836437 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c980b3dd0 con 0x7f1c9806b1e0 2023-07-14T13:13:07.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.068+0000 7f1c8e7fc640 1 -- 172.21.15.5:0/3020836437 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1c9400bcf0 con 0x7f1c9806b1e0 2023-07-14T13:13:07.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.068+0000 7f1c8e7fc640 1 --2- 172.21.15.5:0/3020836437 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f1c7c0663a0 0x7f1c7c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:07.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.068+0000 7f1c8e7fc640 1 -- 172.21.15.5:0/3020836437 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f1c94084440 con 0x7f1c9806b1e0 2023-07-14T13:13:07.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.068+0000 7f1c9d538640 1 --2- 172.21.15.5:0/3020836437 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f1c7c0663a0 0x7f1c7c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:07.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.068+0000 7f1c9d538640 1 --2- 172.21.15.5:0/3020836437 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f1c7c0663a0 0x7f1c7c068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1c880ae000 tx=0x7f1c880a7000 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:07.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.072+0000 7f1c8e7fc640 1 -- 172.21.15.5:0/3020836437 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f1c94055180 con 0x7f1c9806b1e0 2023-07-14T13:13:07.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.256+0000 7f1c9ff9d640 1 -- 172.21.15.5:0/3020836437 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c980678d0 con 0x7f1c9806b1e0 2023-07-14T13:13:07.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.256+0000 7f1c8e7fc640 1 -- 172.21.15.5:0/3020836437 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4708 (secure 0 0 0) 0x7f1c94054d10 con 0x7f1c9806b1e0 2023-07-14T13:13:07.296 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:13:07.296 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":73,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3146480803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3146480803},{"type":"v1","addr":"172.21.15.154:6837","nonce":3146480803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8908,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2567208960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2567208960},{"type":"v1","addr":"172.21.15.5:6835","nonce":2567208960}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8911,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3591700265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3591700265},{"type":"v1","addr":"172.21.15.154:6836","nonce":3591700265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:13:03.243523+0000","modified":"2023-07-14T13:13:06.886056+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9336":{"gid":9336,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/840216087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":840216087},{"type":"v1","addr":"172.21.15.5:6834","nonce":840216087}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-14T13:13:07.297 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 73 2023-07-14T13:13:07.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.260+0000 7f1c9ff9d640 1 -- 172.21.15.5:0/3020836437 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f1c7c0663a0 msgr2=0x7f1c7c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:07.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.260+0000 7f1c9ff9d640 1 --2- 172.21.15.5:0/3020836437 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f1c7c0663a0 0x7f1c7c068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1c880ae000 tx=0x7f1c880a7000 comp rx=0 tx=0).stop 2023-07-14T13:13:07.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.260+0000 7f1c9ff9d640 1 -- 172.21.15.5:0/3020836437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c9806b1e0 msgr2=0x7f1c980af490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:07.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.260+0000 7f1c9ff9d640 1 --2- 172.21.15.5:0/3020836437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c9806b1e0 0x7f1c980af490 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400d800 tx=0x7f1c9400dcc0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.260+0000 7f1c9ff9d640 1 -- 172.21.15.5:0/3020836437 shutdown_connections 2023-07-14T13:13:07.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.260+0000 7f1c9ff9d640 1 --2- 172.21.15.5:0/3020836437 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f1c7c0663a0 0x7f1c7c068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.260+0000 7f1c9ff9d640 1 --2- 172.21.15.5:0/3020836437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c980c21f0 0x7f1c981524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.260+0000 7f1c9ff9d640 1 --2- 172.21.15.5:0/3020836437 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c98070b70 0x7f1c980c5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.260+0000 7f1c9ff9d640 1 --2- 172.21.15.5:0/3020836437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c9806b1e0 0x7f1c980af490 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.260+0000 7f1c9ff9d640 1 -- 172.21.15.5:0/3020836437 >> 172.21.15.5:0/3020836437 conn(0x7f1c980afcf0 msgr2=0x7f1c980c2690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:07.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.260+0000 7f1c9ff9d640 1 -- 172.21.15.5:0/3020836437 shutdown_connections 2023-07-14T13:13:07.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.260+0000 7f1c9ff9d640 1 -- 172.21.15.5:0/3020836437 wait complete. 2023-07-14T13:13:07.316 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:13:07.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.424+0000 7f89875fa640 1 Processor -- start 2023-07-14T13:13:07.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.424+0000 7f89875fa640 1 -- start start 2023-07-14T13:13:07.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.424+0000 7f89875fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89800c8940 0x7f89800cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:07.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.424+0000 7f89875fa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89800c17d0 con 0x7f89800c0f80 2023-07-14T13:13:07.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.424+0000 7f89875fa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89800c14f0 con 0x7f8980160330 2023-07-14T13:13:07.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.424+0000 7f89875fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89800cdd70 con 0x7f89800c8940 2023-07-14T13:13:07.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.428+0000 7f8985b97640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f89800c0f80 0x7f89800cd660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51594/0 (socket says 172.21.15.5:51594) 2023-07-14T13:13:07.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.428+0000 7f8985b97640 1 -- 172.21.15.5:0/3150047228 learned_addr learned my addr 172.21.15.5:0/3150047228 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:13:07.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.428+0000 7f8984b95640 1 --2- 172.21.15.5:0/3150047228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89800c8940 0x7f89800cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:07.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.428+0000 7f8977fff640 1 -- 172.21.15.5:0/3150047228 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307977316 0 0) 0x7f89800c17d0 con 0x7f89800c0f80 2023-07-14T13:13:07.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.428+0000 7f8977fff640 1 -- 172.21.15.5:0/3150047228 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f896c003530 con 0x7f89800c0f80 2023-07-14T13:13:07.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.428+0000 7f8977fff640 1 -- 172.21.15.5:0/3150047228 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003175562 0 0) 0x7f89800c14f0 con 0x7f8980160330 2023-07-14T13:13:07.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.428+0000 7f8977fff640 1 -- 172.21.15.5:0/3150047228 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89800c17d0 con 0x7f8980160330 2023-07-14T13:13:07.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.428+0000 7f8977fff640 1 -- 172.21.15.5:0/3150047228 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3148692305 0 0) 0x7f896c003530 con 0x7f89800c0f80 2023-07-14T13:13:07.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.428+0000 7f8984b95640 1 -- 172.21.15.5:0/3150047228 >> v1:172.21.15.154:6789/0 conn(0x7f8980160330 legacy=0x7f89800ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:07.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.428+0000 7f8984b95640 1 -- 172.21.15.5:0/3150047228 >> v1:172.21.15.5:6789/0 conn(0x7f89800c0f80 legacy=0x7f89800cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:07.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.428+0000 7f8984b95640 1 -- 172.21.15.5:0/3150047228 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89800cac10 con 0x7f89800c8940 2023-07-14T13:13:07.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.428+0000 7f8984b95640 1 --2- 172.21.15.5:0/3150047228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89800c8940 0x7f89800cb6f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f89700097f0 tx=0x7f897001ebd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c306560c9df0424 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:07.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.432+0000 7f8977fff640 1 -- 172.21.15.5:0/3150047228 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8978001a00 con 0x7f89800c8940 2023-07-14T13:13:07.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.432+0000 7f8977fff640 1 -- 172.21.15.5:0/3150047228 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89700a8650 con 0x7f89800c8940 2023-07-14T13:13:07.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.432+0000 7f8977fff640 1 -- 172.21.15.5:0/3150047228 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89700a89e0 con 0x7f89800c8940 2023-07-14T13:13:07.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.432+0000 7f89875fa640 1 -- 172.21.15.5:0/3150047228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89800c8940 msgr2=0x7f89800cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:07.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.432+0000 7f89875fa640 1 --2- 172.21.15.5:0/3150047228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89800c8940 0x7f89800cb6f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f89700097f0 tx=0x7f897001ebd0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.432+0000 7f89875fa640 1 -- 172.21.15.5:0/3150047228 shutdown_connections 2023-07-14T13:13:07.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.432+0000 7f89875fa640 1 --2- 172.21.15.5:0/3150047228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89800c8940 0x7f89800cb6f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.432+0000 7f89875fa640 1 -- 172.21.15.5:0/3150047228 >> 172.21.15.5:0/3150047228 conn(0x7f89800afcf0 msgr2=0x7f89800b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.432+0000 7f89875fa640 1 -- 172.21.15.5:0/3150047228 shutdown_connections 2023-07-14T13:13:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.432+0000 7f89875fa640 1 -- 172.21.15.5:0/3150047228 wait complete. 2023-07-14T13:13:07.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.432+0000 7f89875fa640 1 Processor -- start 2023-07-14T13:13:07.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.432+0000 7f89875fa640 1 -- start start 2023-07-14T13:13:07.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.432+0000 7f89875fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89800c0f80 0x7f89800b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:07.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.432+0000 7f89875fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89800c8940 0x7f89800b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:07.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.432+0000 7f89875fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8980160330 0x7f89800b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:07.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.432+0000 7f89875fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89801f7b10 con 0x7f8980160330 2023-07-14T13:13:07.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.432+0000 7f89875fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89801f6c80 con 0x7f89800c8940 2023-07-14T13:13:07.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.432+0000 7f89875fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89801f6e90 con 0x7f89800c0f80 2023-07-14T13:13:07.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.436+0000 7f8985b97640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8980160330 0x7f89800b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:07.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.436+0000 7f8985b97640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8980160330 0x7f89800b3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60382/0 (socket says 172.21.15.5:60382) 2023-07-14T13:13:07.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.436+0000 7f8985b97640 1 -- 172.21.15.5:0/2857984525 learned_addr learned my addr 172.21.15.5:0/2857984525 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:07.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.436+0000 7f8985396640 1 --2- 172.21.15.5:0/2857984525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89800c0f80 0x7f89800b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:07.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.436+0000 7f8984b95640 1 --2- 172.21.15.5:0/2857984525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89800c8940 0x7f89800b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:07.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.436+0000 7f8985b97640 1 -- 172.21.15.5:0/2857984525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89800c0f80 msgr2=0x7f89800b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:07.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.436+0000 7f8985b97640 1 --2- 172.21.15.5:0/2857984525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89800c0f80 0x7f89800b0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.436+0000 7f8985b97640 1 -- 172.21.15.5:0/2857984525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89800c8940 msgr2=0x7f89800b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:07.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.436+0000 7f8985b97640 1 --2- 172.21.15.5:0/2857984525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89800c8940 0x7f89800b1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.436+0000 7f8985b97640 1 -- 172.21.15.5:0/2857984525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8970009420 con 0x7f8980160330 2023-07-14T13:13:07.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.436+0000 7f8984b95640 1 --2- 172.21.15.5:0/2857984525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89800c8940 0x7f89800b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:13:07.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.436+0000 7f8985b97640 1 --2- 172.21.15.5:0/2857984525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8980160330 0x7f89800b3080 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f8978002030 tx=0x7f897800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:07.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.436+0000 7f8975ffb640 1 -- 172.21.15.5:0/2857984525 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8978012400 con 0x7f8980160330 2023-07-14T13:13:07.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.436+0000 7f8975ffb640 1 -- 172.21.15.5:0/2857984525 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8978012580 con 0x7f8980160330 2023-07-14T13:13:07.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.436+0000 7f8975ffb640 1 -- 172.21.15.5:0/2857984525 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8978012930 con 0x7f8980160330 2023-07-14T13:13:07.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.436+0000 7f89875fa640 1 -- 172.21.15.5:0/2857984525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89801f7170 con 0x7f8980160330 2023-07-14T13:13:07.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.436+0000 7f89875fa640 1 -- 172.21.15.5:0/2857984525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89801f7730 con 0x7f8980160330 2023-07-14T13:13:07.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.436+0000 7f89875fa640 1 -- 172.21.15.5:0/2857984525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89800678d0 con 0x7f8980160330 2023-07-14T13:13:07.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.436+0000 7f8975ffb640 1 -- 172.21.15.5:0/2857984525 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8978012a90 con 0x7f8980160330 2023-07-14T13:13:07.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.440+0000 7f8975ffb640 1 --2- 172.21.15.5:0/2857984525 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f89640663a0 0x7f8964068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:07.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.440+0000 7f8975ffb640 1 -- 172.21.15.5:0/2857984525 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f8978084710 con 0x7f8980160330 2023-07-14T13:13:07.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.440+0000 7f8985396640 1 --2- 172.21.15.5:0/2857984525 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f89640663a0 0x7f8964068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:07.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.440+0000 7f8985396640 1 --2- 172.21.15.5:0/2857984525 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f89640663a0 0x7f8964068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f897c0011f0 tx=0x7f897c009040 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:07.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.440+0000 7f8975ffb640 1 -- 172.21.15.5:0/2857984525 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f8978051a50 con 0x7f8980160330 2023-07-14T13:13:07.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.600+0000 7f89875fa640 1 -- 172.21.15.5:0/2857984525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f898006c380 con 0x7f8980160330 2023-07-14T13:13:07.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.600+0000 7f8975ffb640 1 -- 172.21.15.5:0/2857984525 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+18305 (secure 0 0 0) 0x7f8978055070 con 0x7f8980160330 2023-07-14T13:13:07.640 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:13:07.640 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":156,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:13:04.872499+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:13:01.372511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-14T13:13:02.236215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:13:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.604+0000 7f89875fa640 1 -- 172.21.15.5:0/2857984525 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f89640663a0 msgr2=0x7f8964068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.604+0000 7f89875fa640 1 --2- 172.21.15.5:0/2857984525 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f89640663a0 0x7f8964068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f897c0011f0 tx=0x7f897c009040 comp rx=0 tx=0).stop 2023-07-14T13:13:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.604+0000 7f89875fa640 1 -- 172.21.15.5:0/2857984525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8980160330 msgr2=0x7f89800b3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.604+0000 7f89875fa640 1 --2- 172.21.15.5:0/2857984525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8980160330 0x7f89800b3080 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f8978002030 tx=0x7f897800a430 comp rx=0 tx=0).stop 2023-07-14T13:13:07.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.604+0000 7f89875fa640 1 -- 172.21.15.5:0/2857984525 shutdown_connections 2023-07-14T13:13:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.604+0000 7f89875fa640 1 --2- 172.21.15.5:0/2857984525 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f89640663a0 0x7f8964068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.604+0000 7f89875fa640 1 --2- 172.21.15.5:0/2857984525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8980160330 0x7f89800b3080 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.604+0000 7f89875fa640 1 --2- 172.21.15.5:0/2857984525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89800c8940 0x7f89800b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.604+0000 7f89875fa640 1 --2- 172.21.15.5:0/2857984525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89800c0f80 0x7f89800b0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.604+0000 7f89875fa640 1 -- 172.21.15.5:0/2857984525 >> 172.21.15.5:0/2857984525 conn(0x7f89800afcf0 msgr2=0x7f89800ae700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.604+0000 7f89875fa640 1 -- 172.21.15.5:0/2857984525 shutdown_connections 2023-07-14T13:13:07.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.604+0000 7f89875fa640 1 -- 172.21.15.5:0/2857984525 wait complete. 2023-07-14T13:13:07.661 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-14T13:13:07.661 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:13:07.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.768+0000 7f0f04574640 1 Processor -- start 2023-07-14T13:13:07.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.768+0000 7f0f04574640 1 -- start start 2023-07-14T13:13:07.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.768+0000 7f0f04574640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0efc158ce0 0x7f0efc070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.768+0000 7f0f04574640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0efc0c9730 0x7f0efc0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.772+0000 7f0f04574640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0efc0cc700 con 0x7f0efc0c8ad0 2023-07-14T13:13:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.772+0000 7f0f04574640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0efc0b0ff0 con 0x7f0efc158ce0 2023-07-14T13:13:07.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.772+0000 7f0f04574640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc070c80 con 0x7f0efc0c9730 2023-07-14T13:13:07.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.772+0000 7f0f02310640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0efc158ce0 0x7f0efc070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:07.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.772+0000 7f0f02310640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0efc158ce0 0x7f0efc070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60398/0 (socket says 172.21.15.5:60398) 2023-07-14T13:13:07.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.772+0000 7f0f02310640 1 -- 172.21.15.5:0/620118251 learned_addr learned my addr 172.21.15.5:0/620118251 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:07.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.772+0000 7f0f02b11640 1 --2- 172.21.15.5:0/620118251 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0efc0c9730 0x7f0efc0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:07.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.772+0000 7f0f02310640 1 -- 172.21.15.5:0/620118251 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0efc0c9730 msgr2=0x7f0efc0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:07.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.772+0000 7f0f02310640 1 --2- 172.21.15.5:0/620118251 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0efc0c9730 0x7f0efc0ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.772+0000 7f0f0130e640 1 -- 172.21.15.5:0/620118251 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349762802 0 0) 0x7f0efc0cc700 con 0x7f0efc0c8ad0 2023-07-14T13:13:07.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.772+0000 7f0f02310640 1 -- 172.21.15.5:0/620118251 >> v1:172.21.15.154:6789/0 conn(0x7f0efc0c8ad0 legacy=0x7f0efc0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:07.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.772+0000 7f0f02310640 1 -- 172.21.15.5:0/620118251 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0efc0cbdd0 con 0x7f0efc158ce0 2023-07-14T13:13:07.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.772+0000 7f0f02310640 1 --2- 172.21.15.5:0/620118251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0efc158ce0 0x7f0efc070450 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f0ef800bb10 tx=0x7f0ef801eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b272b114497afd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:07.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.776+0000 7f0f0130e640 1 -- 172.21.15.5:0/620118251 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef80a7bb0 con 0x7f0efc158ce0 2023-07-14T13:13:07.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.776+0000 7f0f0130e640 1 -- 172.21.15.5:0/620118251 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef80a7d10 con 0x7f0efc158ce0 2023-07-14T13:13:07.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.776+0000 7f0f0130e640 1 -- 172.21.15.5:0/620118251 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef80af660 con 0x7f0efc158ce0 2023-07-14T13:13:07.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.776+0000 7f0f04574640 1 -- 172.21.15.5:0/620118251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0efc158ce0 msgr2=0x7f0efc070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:07.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.776+0000 7f0f04574640 1 --2- 172.21.15.5:0/620118251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0efc158ce0 0x7f0efc070450 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f0ef800bb10 tx=0x7f0ef801eac0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.776+0000 7f0f04574640 1 -- 172.21.15.5:0/620118251 shutdown_connections 2023-07-14T13:13:07.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.776+0000 7f0f04574640 1 --2- 172.21.15.5:0/620118251 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0efc0c9730 0x7f0efc0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.776+0000 7f0f04574640 1 --2- 172.21.15.5:0/620118251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0efc158ce0 0x7f0efc070450 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.776+0000 7f0f04574640 1 -- 172.21.15.5:0/620118251 >> 172.21.15.5:0/620118251 conn(0x7f0efc0afcf0 msgr2=0x7f0efc0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:07.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.776+0000 7f0f04574640 1 -- 172.21.15.5:0/620118251 shutdown_connections 2023-07-14T13:13:07.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.776+0000 7f0f04574640 1 -- 172.21.15.5:0/620118251 wait complete. 2023-07-14T13:13:07.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.776+0000 7f0f04574640 1 Processor -- start 2023-07-14T13:13:07.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.776+0000 7f0f04574640 1 -- start start 2023-07-14T13:13:07.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.776+0000 7f0f04574640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0efc0c8ad0 0x7f0efc1512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:07.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.776+0000 7f0f04574640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0efc0c9730 0x7f0efc0c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:07.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.776+0000 7f0f04574640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0efc158ce0 0x7f0efc0b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:07.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.776+0000 7f0f04574640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc0b2320 con 0x7f0efc158ce0 2023-07-14T13:13:07.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.776+0000 7f0f04574640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc151830 con 0x7f0efc0c9730 2023-07-14T13:13:07.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.776+0000 7f0f04574640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc0c67c0 con 0x7f0efc0c8ad0 2023-07-14T13:13:07.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.776+0000 7f0f02b11640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0efc158ce0 0x7f0efc0b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:07.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.776+0000 7f0f02b11640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0efc158ce0 0x7f0efc0b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60400/0 (socket says 172.21.15.5:60400) 2023-07-14T13:13:07.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.780+0000 7f0f02b11640 1 -- 172.21.15.5:0/1697156242 learned_addr learned my addr 172.21.15.5:0/1697156242 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:07.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.780+0000 7f0f02310640 1 --2- 172.21.15.5:0/1697156242 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0efc0c8ad0 0x7f0efc1512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:07.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.780+0000 7f0f01b0f640 1 --2- 172.21.15.5:0/1697156242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0efc0c9730 0x7f0efc0c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:07.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.780+0000 7f0f02b11640 1 -- 172.21.15.5:0/1697156242 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0efc0c8ad0 msgr2=0x7f0efc1512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:07.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.780+0000 7f0f02b11640 1 --2- 172.21.15.5:0/1697156242 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0efc0c8ad0 0x7f0efc1512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.780+0000 7f0f02b11640 1 -- 172.21.15.5:0/1697156242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0efc0c9730 msgr2=0x7f0efc0c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:07.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.780+0000 7f0f02b11640 1 --2- 172.21.15.5:0/1697156242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0efc0c9730 0x7f0efc0c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.780+0000 7f0f02b11640 1 -- 172.21.15.5:0/1697156242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef800b770 con 0x7f0efc158ce0 2023-07-14T13:13:07.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.780+0000 7f0f02b11640 1 --2- 172.21.15.5:0/1697156242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0efc158ce0 0x7f0efc0b39e0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f0ef400efc0 tx=0x7f0ef400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:07.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.780+0000 7f0ef2ffd640 1 -- 172.21.15.5:0/1697156242 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4009ca0 con 0x7f0efc158ce0 2023-07-14T13:13:07.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.780+0000 7f0ef2ffd640 1 -- 172.21.15.5:0/1697156242 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef400f040 con 0x7f0efc158ce0 2023-07-14T13:13:07.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.780+0000 7f0ef2ffd640 1 -- 172.21.15.5:0/1697156242 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef40146c0 con 0x7f0efc158ce0 2023-07-14T13:13:07.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.780+0000 7f0f04574640 1 -- 172.21.15.5:0/1697156242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0efc0b2040 con 0x7f0efc158ce0 2023-07-14T13:13:07.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.780+0000 7f0f04574640 1 -- 172.21.15.5:0/1697156242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0efc0c2e10 con 0x7f0efc158ce0 2023-07-14T13:13:07.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.780+0000 7f0f04574640 1 -- 172.21.15.5:0/1697156242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0efc0ca1a0 con 0x7f0efc158ce0 2023-07-14T13:13:07.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.780+0000 7f0ef2ffd640 1 -- 172.21.15.5:0/1697156242 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0ef4014820 con 0x7f0efc158ce0 2023-07-14T13:13:07.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.784+0000 7f0ef2ffd640 1 --2- 172.21.15.5:0/1697156242 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f0ee00663a0 0x7f0ee0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:07.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.784+0000 7f0ef2ffd640 1 -- 172.21.15.5:0/1697156242 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f0ef4084d00 con 0x7f0efc158ce0 2023-07-14T13:13:07.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.784+0000 7f0f02310640 1 --2- 172.21.15.5:0/1697156242 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f0ee00663a0 0x7f0ee0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:07.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.784+0000 7f0f02310640 1 --2- 172.21.15.5:0/1697156242 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f0ee00663a0 0x7f0ee0068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80b1000 tx=0x7f0ef80a9070 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:07.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.784+0000 7f0ef2ffd640 1 -- 172.21.15.5:0/1697156242 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f0ef4051fe0 con 0x7f0efc158ce0 2023-07-14T13:13:07.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.940+0000 7f0f04574640 1 -- 172.21.15.5:0/1697156242 --> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0efc1590b0 con 0x7f0ee00663a0 2023-07-14T13:13:07.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.952+0000 7f0ef2ffd640 1 -- 172.21.15.5:0/1697156242 <== mgr.7604 v2:172.21.15.154:6832/1443161386 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306124 (secure 0 0 0) 0x7f0ef80a7b30 con 0x7f0ee00663a0 2023-07-14T13:13:07.991 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:13:07.992 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:13:07.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.956+0000 7f0f04574640 1 -- 172.21.15.5:0/1697156242 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f0ee00663a0 msgr2=0x7f0ee0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:07.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.956+0000 7f0f04574640 1 --2- 172.21.15.5:0/1697156242 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f0ee00663a0 0x7f0ee0068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80b1000 tx=0x7f0ef80a9070 comp rx=0 tx=0).stop 2023-07-14T13:13:07.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.956+0000 7f0f04574640 1 -- 172.21.15.5:0/1697156242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0efc158ce0 msgr2=0x7f0efc0b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:07.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.956+0000 7f0f04574640 1 --2- 172.21.15.5:0/1697156242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0efc158ce0 0x7f0efc0b39e0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f0ef400efc0 tx=0x7f0ef400c490 comp rx=0 tx=0).stop 2023-07-14T13:13:07.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.956+0000 7f0f04574640 1 -- 172.21.15.5:0/1697156242 shutdown_connections 2023-07-14T13:13:07.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.956+0000 7f0f04574640 1 --2- 172.21.15.5:0/1697156242 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f0ee00663a0 0x7f0ee0068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.956+0000 7f0f04574640 1 --2- 172.21.15.5:0/1697156242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0efc158ce0 0x7f0efc0b39e0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.956+0000 7f0f04574640 1 --2- 172.21.15.5:0/1697156242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0efc0c9730 0x7f0efc0c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.956+0000 7f0f04574640 1 --2- 172.21.15.5:0/1697156242 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0efc0c8ad0 0x7f0efc1512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:07.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.956+0000 7f0f04574640 1 -- 172.21.15.5:0/1697156242 >> 172.21.15.5:0/1697156242 conn(0x7f0efc0afcf0 msgr2=0x7f0efc162c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:07.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.956+0000 7f0f04574640 1 -- 172.21.15.5:0/1697156242 shutdown_connections 2023-07-14T13:13:07.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:07.956+0000 7f0f04574640 1 -- 172.21.15.5:0/1697156242 wait complete. 2023-07-14T13:13:08.011 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-14T13:13:07.392443+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":355484,"kb_used_data":16092,"kb_used_omap":0,"kb_used_meta":339328,"kb_avail":754619236,"statfs":{"total":773094113280,"available":772730097664,"internally_reserved":0,"allocated":16478208,"data_stored":8964746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":347471872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.552142"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.849702+0000","last_change":"2023-07-14T13:13:02.849702+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.849702+0000","last_undegraded":"2023-07-14T13:13:02.849702+0000","last_fullsized":"2023-07-14T13:13:02.849702+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.861742+0000","last_change":"2023-07-14T13:13:02.861742+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.861742+0000","last_undegraded":"2023-07-14T13:13:02.861742+0000","last_fullsized":"2023-07-14T13:13:02.861742+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.856128+0000","last_change":"2023-07-14T13:13:02.856128+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.856128+0000","last_undegraded":"2023-07-14T13:13:02.856128+0000","last_fullsized":"2023-07-14T13:13:02.856128+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.858190+0000","last_change":"2023-07-14T13:13:02.858190+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.858190+0000","last_undegraded":"2023-07-14T13:13:02.858190+0000","last_fullsized":"2023-07-14T13:13:02.858190+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.850808+0000","last_change":"2023-07-14T13:13:02.850808+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.850808+0000","last_undegraded":"2023-07-14T13:13:02.850808+0000","last_fullsized":"2023-07-14T13:13:02.850808+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.850055+0000","last_change":"2023-07-14T13:13:02.850055+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.850055+0000","last_undegraded":"2023-07-14T13:13:02.850055+0000","last_fullsized":"2023-07-14T13:13:02.850055+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.856317+0000","last_change":"2023-07-14T13:13:02.856317+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.856317+0000","last_undegraded":"2023-07-14T13:13:02.856317+0000","last_fullsized":"2023-07-14T13:13:02.856317+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.853552+0000","last_change":"2023-07-14T13:13:02.853552+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.853552+0000","last_undegraded":"2023-07-14T13:13:02.853552+0000","last_fullsized":"2023-07-14T13:13:02.853552+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.851575+0000","last_change":"2023-07-14T13:13:02.851575+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.851575+0000","last_undegraded":"2023-07-14T13:13:02.851575+0000","last_fullsized":"2023-07-14T13:13:02.851575+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.847249+0000","last_change":"2023-07-14T13:13:02.847249+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.847249+0000","last_undegraded":"2023-07-14T13:13:02.847249+0000","last_fullsized":"2023-07-14T13:13:02.847249+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.858717+0000","last_change":"2023-07-14T13:13:02.858717+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.858717+0000","last_undegraded":"2023-07-14T13:13:02.858717+0000","last_fullsized":"2023-07-14T13:13:02.858717+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.848547+0000","last_change":"2023-07-14T13:13:02.848547+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.848547+0000","last_undegraded":"2023-07-14T13:13:02.848547+0000","last_fullsized":"2023-07-14T13:13:02.848547+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.850700+0000","last_change":"2023-07-14T13:13:02.850700+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.850700+0000","last_undegraded":"2023-07-14T13:13:02.850700+0000","last_fullsized":"2023-07-14T13:13:02.850700+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.849830+0000","last_change":"2023-07-14T13:13:02.849830+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.849830+0000","last_undegraded":"2023-07-14T13:13:02.849830+0000","last_fullsized":"2023-07-14T13:13:02.849830+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.849124+0000","last_change":"2023-07-14T13:13:02.849124+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.849124+0000","last_undegraded":"2023-07-14T13:13:02.849124+0000","last_fullsized":"2023-07-14T13:13:02.849124+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.853108+0000","last_change":"2023-07-14T13:13:02.853108+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.853108+0000","last_undegraded":"2023-07-14T13:13:02.853108+0000","last_fullsized":"2023-07-14T13:13:02.853108+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.851143+0000","last_change":"2023-07-14T13:13:02.851143+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.851143+0000","last_undegraded":"2023-07-14T13:13:02.851143+0000","last_fullsized":"2023-07-14T13:13:02.851143+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.848625+0000","last_change":"2023-07-14T13:13:02.848625+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.848625+0000","last_undegraded":"2023-07-14T13:13:02.848625+0000","last_fullsized":"2023-07-14T13:13:02.848625+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.858202+0000","last_change":"2023-07-14T13:13:02.858202+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.858202+0000","last_undegraded":"2023-07-14T13:13:02.858202+0000","last_fullsized":"2023-07-14T13:13:02.858202+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.849602+0000","last_change":"2023-07-14T13:13:02.849602+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.849602+0000","last_undegraded":"2023-07-14T13:13:02.849602+0000","last_fullsized":"2023-07-14T13:13:02.849602+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.857664+0000","last_change":"2023-07-14T13:13:02.857664+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.857664+0000","last_undegraded":"2023-07-14T13:13:02.857664+0000","last_fullsized":"2023-07-14T13:13:02.857664+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.850309+0000","last_change":"2023-07-14T13:13:02.850309+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.850309+0000","last_undegraded":"2023-07-14T13:13:02.850309+0000","last_fullsized":"2023-07-14T13:13:02.850309+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.857728+0000","last_change":"2023-07-14T13:13:02.857728+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.857728+0000","last_undegraded":"2023-07-14T13:13:02.857728+0000","last_fullsized":"2023-07-14T13:13:02.857728+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.852651+0000","last_change":"2023-07-14T13:13:02.852651+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.852651+0000","last_undegraded":"2023-07-14T13:13:02.852651+0000","last_fullsized":"2023-07-14T13:13:02.852651+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.855048+0000","last_change":"2023-07-14T13:13:02.855048+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.855048+0000","last_undegraded":"2023-07-14T13:13:02.855048+0000","last_fullsized":"2023-07-14T13:13:02.855048+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.858641+0000","last_change":"2023-07-14T13:13:02.858641+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.858641+0000","last_undegraded":"2023-07-14T13:13:02.858641+0000","last_fullsized":"2023-07-14T13:13:02.858641+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.857754+0000","last_change":"2023-07-14T13:13:02.857754+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.857754+0000","last_undegraded":"2023-07-14T13:13:02.857754+0000","last_fullsized":"2023-07-14T13:13:02.857754+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.846958+0000","last_change":"2023-07-14T13:13:02.846958+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.846958+0000","last_undegraded":"2023-07-14T13:13:02.846958+0000","last_fullsized":"2023-07-14T13:13:02.846958+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.857735+0000","last_change":"2023-07-14T13:13:02.857735+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.857735+0000","last_undegraded":"2023-07-14T13:13:02.857735+0000","last_fullsized":"2023-07-14T13:13:02.857735+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.855125+0000","last_change":"2023-07-14T13:13:02.855125+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.855125+0000","last_undegraded":"2023-07-14T13:13:02.855125+0000","last_fullsized":"2023-07-14T13:13:02.855125+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.852437+0000","last_change":"2023-07-14T13:13:02.852437+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.852437+0000","last_undegraded":"2023-07-14T13:13:02.852437+0000","last_fullsized":"2023-07-14T13:13:02.852437+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.846335+0000","last_change":"2023-07-14T13:13:02.846335+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.846335+0000","last_undegraded":"2023-07-14T13:13:02.846335+0000","last_fullsized":"2023-07-14T13:13:02.846335+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.851446+0000","last_change":"2023-07-14T13:13:02.851446+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.851446+0000","last_undegraded":"2023-07-14T13:13:02.851446+0000","last_fullsized":"2023-07-14T13:13:02.851446+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.872286+0000","last_change":"2023-07-14T13:13:02.868993+0000","last_active":"2023-07-14T13:13:02.872286+0000","last_peered":"2023-07-14T13:13:02.872286+0000","last_clean":"2023-07-14T13:13:02.872286+0000","last_became_active":"2023-07-14T13:13:02.868694+0000","last_became_peered":"2023-07-14T13:13:02.868694+0000","last_unstale":"2023-07-14T13:13:02.872286+0000","last_undegraded":"2023-07-14T13:13:02.872286+0000","last_fullsized":"2023-07-14T13:13:02.872286+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:53:35.355464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.848613+0000","last_change":"2023-07-14T13:13:02.848613+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.848613+0000","last_undegraded":"2023-07-14T13:13:02.848613+0000","last_fullsized":"2023-07-14T13:13:02.848613+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.867448+0000","last_change":"2023-07-14T13:13:02.865527+0000","last_active":"2023-07-14T13:13:02.867448+0000","last_peered":"2023-07-14T13:13:02.867448+0000","last_clean":"2023-07-14T13:13:02.867448+0000","last_became_active":"2023-07-14T13:13:02.865167+0000","last_became_peered":"2023-07-14T13:13:02.865167+0000","last_unstale":"2023-07-14T13:13:02.867448+0000","last_undegraded":"2023-07-14T13:13:02.867448+0000","last_fullsized":"2023-07-14T13:13:02.867448+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:36:44.671952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.859386+0000","last_change":"2023-07-14T13:13:02.859386+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.859386+0000","last_undegraded":"2023-07-14T13:13:02.859386+0000","last_fullsized":"2023-07-14T13:13:02.859386+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.875295+0000","last_change":"2023-07-14T13:13:02.869637+0000","last_active":"2023-07-14T13:13:02.875295+0000","last_peered":"2023-07-14T13:13:02.875295+0000","last_clean":"2023-07-14T13:13:02.875295+0000","last_became_active":"2023-07-14T13:13:02.867864+0000","last_became_peered":"2023-07-14T13:13:02.867864+0000","last_unstale":"2023-07-14T13:13:02.875295+0000","last_undegraded":"2023-07-14T13:13:02.875295+0000","last_fullsized":"2023-07-14T13:13:02.875295+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:19:08.077344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.850910+0000","last_change":"2023-07-14T13:13:02.850910+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.850910+0000","last_undegraded":"2023-07-14T13:13:02.850910+0000","last_fullsized":"2023-07-14T13:13:02.850910+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.875422+0000","last_change":"2023-07-14T13:13:02.873106+0000","last_active":"2023-07-14T13:13:02.875422+0000","last_peered":"2023-07-14T13:13:02.875422+0000","last_clean":"2023-07-14T13:13:02.875422+0000","last_became_active":"2023-07-14T13:13:02.872783+0000","last_became_peered":"2023-07-14T13:13:02.872783+0000","last_unstale":"2023-07-14T13:13:02.875422+0000","last_undegraded":"2023-07-14T13:13:02.875422+0000","last_fullsized":"2023-07-14T13:13:02.875422+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:18:17.154686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.851433+0000","last_change":"2023-07-14T13:13:02.851433+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.851433+0000","last_undegraded":"2023-07-14T13:13:02.851433+0000","last_fullsized":"2023-07-14T13:13:02.851433+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.872343+0000","last_change":"2023-07-14T13:13:02.864266+0000","last_active":"2023-07-14T13:13:02.872343+0000","last_peered":"2023-07-14T13:13:02.872343+0000","last_clean":"2023-07-14T13:13:02.872343+0000","last_became_active":"2023-07-14T13:13:02.863987+0000","last_became_peered":"2023-07-14T13:13:02.863987+0000","last_unstale":"2023-07-14T13:13:02.872343+0000","last_undegraded":"2023-07-14T13:13:02.872343+0000","last_fullsized":"2023-07-14T13:13:02.872343+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:30:54.387176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.852729+0000","last_change":"2023-07-14T13:13:02.852729+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.852729+0000","last_undegraded":"2023-07-14T13:13:02.852729+0000","last_fullsized":"2023-07-14T13:13:02.852729+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.864947+0000","last_change":"2023-07-14T13:13:02.859614+0000","last_active":"2023-07-14T13:13:02.864947+0000","last_peered":"2023-07-14T13:13:02.864947+0000","last_clean":"2023-07-14T13:13:02.864947+0000","last_became_active":"2023-07-14T13:13:02.859348+0000","last_became_peered":"2023-07-14T13:13:02.859348+0000","last_unstale":"2023-07-14T13:13:02.864947+0000","last_undegraded":"2023-07-14T13:13:02.864947+0000","last_fullsized":"2023-07-14T13:13:02.864947+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:28:06.934465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.848145+0000","last_change":"2023-07-14T13:13:02.848145+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.848145+0000","last_undegraded":"2023-07-14T13:13:02.848145+0000","last_fullsized":"2023-07-14T13:13:02.848145+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.864200+0000","last_change":"2023-07-14T13:13:02.860411+0000","last_active":"2023-07-14T13:13:02.864200+0000","last_peered":"2023-07-14T13:13:02.864200+0000","last_clean":"2023-07-14T13:13:02.864200+0000","last_became_active":"2023-07-14T13:13:02.860127+0000","last_became_peered":"2023-07-14T13:13:02.860127+0000","last_unstale":"2023-07-14T13:13:02.864200+0000","last_undegraded":"2023-07-14T13:13:02.864200+0000","last_fullsized":"2023-07-14T13:13:02.864200+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:25:09.510581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.856377+0000","last_change":"2023-07-14T13:13:02.856377+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.856377+0000","last_undegraded":"2023-07-14T13:13:02.856377+0000","last_fullsized":"2023-07-14T13:13:02.856377+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.873554+0000","last_change":"2023-07-14T13:13:02.870024+0000","last_active":"2023-07-14T13:13:02.873554+0000","last_peered":"2023-07-14T13:13:02.873554+0000","last_clean":"2023-07-14T13:13:02.873554+0000","last_became_active":"2023-07-14T13:13:02.869711+0000","last_became_peered":"2023-07-14T13:13:02.869711+0000","last_unstale":"2023-07-14T13:13:02.873554+0000","last_undegraded":"2023-07-14T13:13:02.873554+0000","last_fullsized":"2023-07-14T13:13:02.873554+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:13:33.557920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.856673+0000","last_change":"2023-07-14T13:13:02.856673+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.856673+0000","last_undegraded":"2023-07-14T13:13:02.856673+0000","last_fullsized":"2023-07-14T13:13:02.856673+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.869317+0000","last_change":"2023-07-14T13:13:02.866258+0000","last_active":"2023-07-14T13:13:02.869317+0000","last_peered":"2023-07-14T13:13:02.869317+0000","last_clean":"2023-07-14T13:13:02.869317+0000","last_became_active":"2023-07-14T13:13:02.865982+0000","last_became_peered":"2023-07-14T13:13:02.865982+0000","last_unstale":"2023-07-14T13:13:02.869317+0000","last_undegraded":"2023-07-14T13:13:02.869317+0000","last_fullsized":"2023-07-14T13:13:02.869317+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:37.388068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.855785+0000","last_change":"2023-07-14T13:13:02.855785+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.855785+0000","last_undegraded":"2023-07-14T13:13:02.855785+0000","last_fullsized":"2023-07-14T13:13:02.855785+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.872246+0000","last_change":"2023-07-14T13:13:02.868862+0000","last_active":"2023-07-14T13:13:02.872246+0000","last_peered":"2023-07-14T13:13:02.872246+0000","last_clean":"2023-07-14T13:13:02.872246+0000","last_became_active":"2023-07-14T13:13:02.868554+0000","last_became_peered":"2023-07-14T13:13:02.868554+0000","last_unstale":"2023-07-14T13:13:02.872246+0000","last_undegraded":"2023-07-14T13:13:02.872246+0000","last_fullsized":"2023-07-14T13:13:02.872246+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:15:28.838577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.856936+0000","last_change":"2023-07-14T13:13:02.856936+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.856936+0000","last_undegraded":"2023-07-14T13:13:02.856936+0000","last_fullsized":"2023-07-14T13:13:02.856936+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.864245+0000","last_change":"2023-07-14T13:13:02.859151+0000","last_active":"2023-07-14T13:13:02.864245+0000","last_peered":"2023-07-14T13:13:02.864245+0000","last_clean":"2023-07-14T13:13:02.864245+0000","last_became_active":"2023-07-14T13:13:02.858878+0000","last_became_peered":"2023-07-14T13:13:02.858878+0000","last_unstale":"2023-07-14T13:13:02.864245+0000","last_undegraded":"2023-07-14T13:13:02.864245+0000","last_fullsized":"2023-07-14T13:13:02.864245+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:00.465195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.847342+0000","last_change":"2023-07-14T13:13:02.847342+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.847342+0000","last_undegraded":"2023-07-14T13:13:02.847342+0000","last_fullsized":"2023-07-14T13:13:02.847342+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.865960+0000","last_change":"2023-07-14T13:13:02.863173+0000","last_active":"2023-07-14T13:13:02.865960+0000","last_peered":"2023-07-14T13:13:02.865960+0000","last_clean":"2023-07-14T13:13:02.865960+0000","last_became_active":"2023-07-14T13:13:02.862902+0000","last_became_peered":"2023-07-14T13:13:02.862902+0000","last_unstale":"2023-07-14T13:13:02.865960+0000","last_undegraded":"2023-07-14T13:13:02.865960+0000","last_fullsized":"2023-07-14T13:13:02.865960+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:58:06.564871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.849137+0000","last_change":"2023-07-14T13:13:02.849137+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.849137+0000","last_undegraded":"2023-07-14T13:13:02.849137+0000","last_fullsized":"2023-07-14T13:13:02.849137+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.875022+0000","last_change":"2023-07-14T13:13:02.869185+0000","last_active":"2023-07-14T13:13:02.875022+0000","last_peered":"2023-07-14T13:13:02.875022+0000","last_clean":"2023-07-14T13:13:02.875022+0000","last_became_active":"2023-07-14T13:13:02.868925+0000","last_became_peered":"2023-07-14T13:13:02.868925+0000","last_unstale":"2023-07-14T13:13:02.875022+0000","last_undegraded":"2023-07-14T13:13:02.875022+0000","last_fullsized":"2023-07-14T13:13:02.875022+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:59:49.792863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.848430+0000","last_change":"2023-07-14T13:13:02.848430+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.848430+0000","last_undegraded":"2023-07-14T13:13:02.848430+0000","last_fullsized":"2023-07-14T13:13:02.848430+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.866556+0000","last_change":"2023-07-14T13:13:02.862781+0000","last_active":"2023-07-14T13:13:02.866556+0000","last_peered":"2023-07-14T13:13:02.866556+0000","last_clean":"2023-07-14T13:13:02.866556+0000","last_became_active":"2023-07-14T13:13:02.862518+0000","last_became_peered":"2023-07-14T13:13:02.862518+0000","last_unstale":"2023-07-14T13:13:02.866556+0000","last_undegraded":"2023-07-14T13:13:02.866556+0000","last_fullsized":"2023-07-14T13:13:02.866556+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:01:48.243729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.847246+0000","last_change":"2023-07-14T13:13:02.847246+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.847246+0000","last_undegraded":"2023-07-14T13:13:02.847246+0000","last_fullsized":"2023-07-14T13:13:02.847246+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.875379+0000","last_change":"2023-07-14T13:13:02.870693+0000","last_active":"2023-07-14T13:13:02.875379+0000","last_peered":"2023-07-14T13:13:02.875379+0000","last_clean":"2023-07-14T13:13:02.875379+0000","last_became_active":"2023-07-14T13:13:02.870369+0000","last_became_peered":"2023-07-14T13:13:02.870369+0000","last_unstale":"2023-07-14T13:13:02.875379+0000","last_undegraded":"2023-07-14T13:13:02.875379+0000","last_fullsized":"2023-07-14T13:13:02.875379+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:37:55.269264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.859982+0000","last_change":"2023-07-14T13:13:02.859982+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.859982+0000","last_undegraded":"2023-07-14T13:13:02.859982+0000","last_fullsized":"2023-07-14T13:13:02.859982+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.864210+0000","last_change":"2023-07-14T13:13:02.860174+0000","last_active":"2023-07-14T13:13:02.864210+0000","last_peered":"2023-07-14T13:13:02.864210+0000","last_clean":"2023-07-14T13:13:02.864210+0000","last_became_active":"2023-07-14T13:13:02.859857+0000","last_became_peered":"2023-07-14T13:13:02.859857+0000","last_unstale":"2023-07-14T13:13:02.864210+0000","last_undegraded":"2023-07-14T13:13:02.864210+0000","last_fullsized":"2023-07-14T13:13:02.864210+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:24.219405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.847343+0000","last_change":"2023-07-14T13:13:02.847343+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.847343+0000","last_undegraded":"2023-07-14T13:13:02.847343+0000","last_fullsized":"2023-07-14T13:13:02.847343+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.869509+0000","last_change":"2023-07-14T13:13:02.868617+0000","last_active":"2023-07-14T13:13:02.869509+0000","last_peered":"2023-07-14T13:13:02.869509+0000","last_clean":"2023-07-14T13:13:02.869509+0000","last_became_active":"2023-07-14T13:13:02.868316+0000","last_became_peered":"2023-07-14T13:13:02.868316+0000","last_unstale":"2023-07-14T13:13:02.869509+0000","last_undegraded":"2023-07-14T13:13:02.869509+0000","last_fullsized":"2023-07-14T13:13:02.869509+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:06:31.006923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.854870+0000","last_change":"2023-07-14T13:13:02.854870+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.854870+0000","last_undegraded":"2023-07-14T13:13:02.854870+0000","last_fullsized":"2023-07-14T13:13:02.854870+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.874975+0000","last_change":"2023-07-14T13:13:02.868072+0000","last_active":"2023-07-14T13:13:02.874975+0000","last_peered":"2023-07-14T13:13:02.874975+0000","last_clean":"2023-07-14T13:13:02.874975+0000","last_became_active":"2023-07-14T13:13:02.867703+0000","last_became_peered":"2023-07-14T13:13:02.867703+0000","last_unstale":"2023-07-14T13:13:02.874975+0000","last_undegraded":"2023-07-14T13:13:02.874975+0000","last_fullsized":"2023-07-14T13:13:02.874975+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:57:21.237766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.857490+0000","last_change":"2023-07-14T13:13:02.857490+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.857490+0000","last_undegraded":"2023-07-14T13:13:02.857490+0000","last_fullsized":"2023-07-14T13:13:02.857490+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.865455+0000","last_change":"2023-07-14T13:13:02.862857+0000","last_active":"2023-07-14T13:13:02.865455+0000","last_peered":"2023-07-14T13:13:02.865455+0000","last_clean":"2023-07-14T13:13:02.865455+0000","last_became_active":"2023-07-14T13:13:02.862567+0000","last_became_peered":"2023-07-14T13:13:02.862567+0000","last_unstale":"2023-07-14T13:13:02.865455+0000","last_undegraded":"2023-07-14T13:13:02.865455+0000","last_fullsized":"2023-07-14T13:13:02.865455+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:19:26.447864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.846833+0000","last_change":"2023-07-14T13:13:02.846833+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.846833+0000","last_undegraded":"2023-07-14T13:13:02.846833+0000","last_fullsized":"2023-07-14T13:13:02.846833+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.864271+0000","last_change":"2023-07-14T13:13:02.861021+0000","last_active":"2023-07-14T13:13:02.864271+0000","last_peered":"2023-07-14T13:13:02.864271+0000","last_clean":"2023-07-14T13:13:02.864271+0000","last_became_active":"2023-07-14T13:13:02.860774+0000","last_became_peered":"2023-07-14T13:13:02.860774+0000","last_unstale":"2023-07-14T13:13:02.864271+0000","last_undegraded":"2023-07-14T13:13:02.864271+0000","last_fullsized":"2023-07-14T13:13:02.864271+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:59:22.924331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.854073+0000","last_change":"2023-07-14T13:13:02.854073+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.854073+0000","last_undegraded":"2023-07-14T13:13:02.854073+0000","last_fullsized":"2023-07-14T13:13:02.854073+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.873830+0000","last_change":"2023-07-14T13:13:02.870130+0000","last_active":"2023-07-14T13:13:02.873830+0000","last_peered":"2023-07-14T13:13:02.873830+0000","last_clean":"2023-07-14T13:13:02.873830+0000","last_became_active":"2023-07-14T13:13:02.869853+0000","last_became_peered":"2023-07-14T13:13:02.869853+0000","last_unstale":"2023-07-14T13:13:02.873830+0000","last_undegraded":"2023-07-14T13:13:02.873830+0000","last_fullsized":"2023-07-14T13:13:02.873830+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:32:13.580494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.850458+0000","last_change":"2023-07-14T13:13:02.850458+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.850458+0000","last_undegraded":"2023-07-14T13:13:02.850458+0000","last_fullsized":"2023-07-14T13:13:02.850458+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.875846+0000","last_change":"2023-07-14T13:13:02.873722+0000","last_active":"2023-07-14T13:13:02.875846+0000","last_peered":"2023-07-14T13:13:02.875846+0000","last_clean":"2023-07-14T13:13:02.875846+0000","last_became_active":"2023-07-14T13:13:02.873392+0000","last_became_peered":"2023-07-14T13:13:02.873392+0000","last_unstale":"2023-07-14T13:13:02.875846+0000","last_undegraded":"2023-07-14T13:13:02.875846+0000","last_fullsized":"2023-07-14T13:13:02.875846+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:57:45.510833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.850928+0000","last_change":"2023-07-14T13:13:02.850928+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.850928+0000","last_undegraded":"2023-07-14T13:13:02.850928+0000","last_fullsized":"2023-07-14T13:13:02.850928+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.864221+0000","last_change":"2023-07-14T13:13:02.861693+0000","last_active":"2023-07-14T13:13:02.864221+0000","last_peered":"2023-07-14T13:13:02.864221+0000","last_clean":"2023-07-14T13:13:02.864221+0000","last_became_active":"2023-07-14T13:13:02.861433+0000","last_became_peered":"2023-07-14T13:13:02.861433+0000","last_unstale":"2023-07-14T13:13:02.864221+0000","last_undegraded":"2023-07-14T13:13:02.864221+0000","last_fullsized":"2023-07-14T13:13:02.864221+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:33:35.134309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.855767+0000","last_change":"2023-07-14T13:13:02.855767+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.855767+0000","last_undegraded":"2023-07-14T13:13:02.855767+0000","last_fullsized":"2023-07-14T13:13:02.855767+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.869285+0000","last_change":"2023-07-14T13:13:02.867349+0000","last_active":"2023-07-14T13:13:02.869285+0000","last_peered":"2023-07-14T13:13:02.869285+0000","last_clean":"2023-07-14T13:13:02.869285+0000","last_became_active":"2023-07-14T13:13:02.867008+0000","last_became_peered":"2023-07-14T13:13:02.867008+0000","last_unstale":"2023-07-14T13:13:02.869285+0000","last_undegraded":"2023-07-14T13:13:02.869285+0000","last_fullsized":"2023-07-14T13:13:02.869285+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:18:05.679927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.855630+0000","last_change":"2023-07-14T13:13:02.855630+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.855630+0000","last_undegraded":"2023-07-14T13:13:02.855630+0000","last_fullsized":"2023-07-14T13:13:02.855630+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.875446+0000","last_change":"2023-07-14T13:13:02.871042+0000","last_active":"2023-07-14T13:13:02.875446+0000","last_peered":"2023-07-14T13:13:02.875446+0000","last_clean":"2023-07-14T13:13:02.875446+0000","last_became_active":"2023-07-14T13:13:02.870763+0000","last_became_peered":"2023-07-14T13:13:02.870763+0000","last_unstale":"2023-07-14T13:13:02.875446+0000","last_undegraded":"2023-07-14T13:13:02.875446+0000","last_fullsized":"2023-07-14T13:13:02.875446+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:00:01.670302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"144'271","reported_seq":953,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.860041+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:13:02.860041+0000","last_peered":"2023-07-14T13:13:02.860041+0000","last_clean":"2023-07-14T13:13:02.860041+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:13:02.860041+0000","last_undegraded":"2023-07-14T13:13:02.860041+0000","last_fullsized":"2023-07-14T13:13:02.860041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:10:23.490968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":246,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.858518+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:13:02.858518+0000","last_peered":"2023-07-14T13:13:02.858518+0000","last_clean":"2023-07-14T13:13:02.858518+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:13:02.858518+0000","last_undegraded":"2023-07-14T13:13:02.858518+0000","last_fullsized":"2023-07-14T13:13:02.858518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:58:53.221426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.855688+0000","last_change":"2023-07-14T13:13:02.855688+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.855688+0000","last_undegraded":"2023-07-14T13:13:02.855688+0000","last_fullsized":"2023-07-14T13:13:02.855688+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.873210+0000","last_change":"2023-07-14T13:13:02.869188+0000","last_active":"2023-07-14T13:13:02.873210+0000","last_peered":"2023-07-14T13:13:02.873210+0000","last_clean":"2023-07-14T13:13:02.873210+0000","last_became_active":"2023-07-14T13:13:02.868868+0000","last_became_peered":"2023-07-14T13:13:02.868868+0000","last_unstale":"2023-07-14T13:13:02.873210+0000","last_undegraded":"2023-07-14T13:13:02.873210+0000","last_fullsized":"2023-07-14T13:13:02.873210+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:49:56.887514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":251,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.859913+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:13:02.859913+0000","last_peered":"2023-07-14T13:13:02.859913+0000","last_clean":"2023-07-14T13:13:02.859913+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:13:02.859913+0000","last_undegraded":"2023-07-14T13:13:02.859913+0000","last_fullsized":"2023-07-14T13:13:02.859913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:51:51.579230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.851606+0000","last_change":"2023-07-14T13:13:02.851606+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.851606+0000","last_undegraded":"2023-07-14T13:13:02.851606+0000","last_fullsized":"2023-07-14T13:13:02.851606+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.871277+0000","last_change":"2023-07-14T13:13:02.870439+0000","last_active":"2023-07-14T13:13:02.871277+0000","last_peered":"2023-07-14T13:13:02.871277+0000","last_clean":"2023-07-14T13:13:02.871277+0000","last_became_active":"2023-07-14T13:13:02.870195+0000","last_became_peered":"2023-07-14T13:13:02.870195+0000","last_unstale":"2023-07-14T13:13:02.871277+0000","last_undegraded":"2023-07-14T13:13:02.871277+0000","last_fullsized":"2023-07-14T13:13:02.871277+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:47:16.425255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":252,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.854743+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:13:02.854743+0000","last_peered":"2023-07-14T13:13:02.854743+0000","last_clean":"2023-07-14T13:13:02.854743+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:13:02.854743+0000","last_undegraded":"2023-07-14T13:13:02.854743+0000","last_fullsized":"2023-07-14T13:13:02.854743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:07:17.830966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.846459+0000","last_change":"2023-07-14T13:13:02.846459+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.846459+0000","last_undegraded":"2023-07-14T13:13:02.846459+0000","last_fullsized":"2023-07-14T13:13:02.846459+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.866527+0000","last_change":"2023-07-14T13:13:02.862863+0000","last_active":"2023-07-14T13:13:02.866527+0000","last_peered":"2023-07-14T13:13:02.866527+0000","last_clean":"2023-07-14T13:13:02.866527+0000","last_became_active":"2023-07-14T13:13:02.862584+0000","last_became_peered":"2023-07-14T13:13:02.862584+0000","last_unstale":"2023-07-14T13:13:02.866527+0000","last_undegraded":"2023-07-14T13:13:02.866527+0000","last_fullsized":"2023-07-14T13:13:02.866527+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:01:28.565089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":246,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.859753+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:13:02.859753+0000","last_peered":"2023-07-14T13:13:02.859753+0000","last_clean":"2023-07-14T13:13:02.859753+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:13:02.859753+0000","last_undegraded":"2023-07-14T13:13:02.859753+0000","last_fullsized":"2023-07-14T13:13:02.859753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:33:07.818603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.854448+0000","last_change":"2023-07-14T13:13:02.854448+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.854448+0000","last_undegraded":"2023-07-14T13:13:02.854448+0000","last_fullsized":"2023-07-14T13:13:02.854448+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.875385+0000","last_change":"2023-07-14T13:13:02.872225+0000","last_active":"2023-07-14T13:13:02.875385+0000","last_peered":"2023-07-14T13:13:02.875385+0000","last_clean":"2023-07-14T13:13:02.875385+0000","last_became_active":"2023-07-14T13:13:02.871842+0000","last_became_peered":"2023-07-14T13:13:02.871842+0000","last_unstale":"2023-07-14T13:13:02.875385+0000","last_undegraded":"2023-07-14T13:13:02.875385+0000","last_fullsized":"2023-07-14T13:13:02.875385+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:39:39.654808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":258,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.854434+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:13:02.854434+0000","last_peered":"2023-07-14T13:13:02.854434+0000","last_clean":"2023-07-14T13:13:02.854434+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:13:02.854434+0000","last_undegraded":"2023-07-14T13:13:02.854434+0000","last_fullsized":"2023-07-14T13:13:02.854434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:38:37.620856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.857262+0000","last_change":"2023-07-14T13:13:02.857262+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.857262+0000","last_undegraded":"2023-07-14T13:13:02.857262+0000","last_fullsized":"2023-07-14T13:13:02.857262+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.875404+0000","last_change":"2023-07-14T13:13:02.870013+0000","last_active":"2023-07-14T13:13:02.875404+0000","last_peered":"2023-07-14T13:13:02.875404+0000","last_clean":"2023-07-14T13:13:02.875404+0000","last_became_active":"2023-07-14T13:13:02.869705+0000","last_became_peered":"2023-07-14T13:13:02.869705+0000","last_unstale":"2023-07-14T13:13:02.875404+0000","last_undegraded":"2023-07-14T13:13:02.875404+0000","last_fullsized":"2023-07-14T13:13:02.875404+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:58:26.246984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":250,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.862100+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:13:02.862100+0000","last_peered":"2023-07-14T13:13:02.862100+0000","last_clean":"2023-07-14T13:13:02.862100+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:13:02.862100+0000","last_undegraded":"2023-07-14T13:13:02.862100+0000","last_fullsized":"2023-07-14T13:13:02.862100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:49:38.781467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.848962+0000","last_change":"2023-07-14T13:13:02.848962+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.848962+0000","last_undegraded":"2023-07-14T13:13:02.848962+0000","last_fullsized":"2023-07-14T13:13:02.848962+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.873756+0000","last_change":"2023-07-14T13:13:02.869873+0000","last_active":"2023-07-14T13:13:02.873756+0000","last_peered":"2023-07-14T13:13:02.873756+0000","last_clean":"2023-07-14T13:13:02.873756+0000","last_became_active":"2023-07-14T13:13:02.869590+0000","last_became_peered":"2023-07-14T13:13:02.869590+0000","last_unstale":"2023-07-14T13:13:02.873756+0000","last_undegraded":"2023-07-14T13:13:02.873756+0000","last_fullsized":"2023-07-14T13:13:02.873756+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:29:35.971780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":258,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.851182+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:13:02.851182+0000","last_peered":"2023-07-14T13:13:02.851182+0000","last_clean":"2023-07-14T13:13:02.851182+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:13:02.851182+0000","last_undegraded":"2023-07-14T13:13:02.851182+0000","last_fullsized":"2023-07-14T13:13:02.851182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:46:24.773536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.851849+0000","last_change":"2023-07-14T13:13:02.851849+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.851849+0000","last_undegraded":"2023-07-14T13:13:02.851849+0000","last_fullsized":"2023-07-14T13:13:02.851849+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.865847+0000","last_change":"2023-07-14T13:13:02.859953+0000","last_active":"2023-07-14T13:13:02.865847+0000","last_peered":"2023-07-14T13:13:02.865847+0000","last_clean":"2023-07-14T13:13:02.865847+0000","last_became_active":"2023-07-14T13:13:02.859642+0000","last_became_peered":"2023-07-14T13:13:02.859642+0000","last_unstale":"2023-07-14T13:13:02.865847+0000","last_undegraded":"2023-07-14T13:13:02.865847+0000","last_fullsized":"2023-07-14T13:13:02.865847+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:07:45.072422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":252,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.863796+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:13:02.863796+0000","last_peered":"2023-07-14T13:13:02.863796+0000","last_clean":"2023-07-14T13:13:02.863796+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:13:02.863796+0000","last_undegraded":"2023-07-14T13:13:02.863796+0000","last_fullsized":"2023-07-14T13:13:02.863796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:18:18.346357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575090,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59728,"kb_used_data":2440,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312112,"statfs":{"total":96636764160,"available":96575602688,"internally_reserved":0,"allocated":2498560,"data_stored":1559469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.68999999999999995,"15min":0.70699999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.84199999999999997,"5min":1.262,"15min":1.262},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71699999999999997,"15min":0.72899999999999998},"min":{"1min":0.54100000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.65800000000000003}]},{"osd":1,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.70599999999999996,"15min":0.72999999999999998},"min":{"1min":0.44,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83799999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72799999999999998,"15min":0.74299999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.71499999999999997}]},{"osd":2,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71199999999999997,"15min":0.72599999999999998},"min":{"1min":0.48999999999999999,"5min":0.46100000000000002,"15min":0.42699999999999999},"max":{"1min":0.91500000000000004,"5min":1.073,"15min":1.073},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.753},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84899999999999998,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.70199999999999996}]},{"osd":3,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.72699999999999998,"15min":0.73599999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.091,"5min":1.161,"15min":1.161},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73999999999999999,"15min":0.75600000000000001},"min":{"1min":0.51100000000000001,"5min":0.47899999999999998,"15min":0.41499999999999998},"max":{"1min":0.94899999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.60499999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56899999999999995,"15min":0.57899999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.318},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.022},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.40000000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.42699999999999999,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.91000000000000003,"5min":0.98099999999999998,"15min":0.98299999999999998},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63100000000000001,"15min":0.64900000000000002},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.34100000000000003},"max":{"1min":0.80500000000000005,"5min":1.028,"15min":1.028},"last":0.621}]},{"osd":6,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.42699999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.0489999999999999},"last":0.745},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.68100000000000005,"15min":0.67700000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.36299999999999999},"max":{"1min":1.151,"5min":4.1130000000000004,"15min":4.1130000000000004},"last":0.68500000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575091,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32920,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1916928,"data_stored":975749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70699999999999996,"15min":0.72699999999999998},"min":{"1min":0.496,"5min":0.47899999999999998,"15min":0.38},"max":{"1min":0.89300000000000002,"5min":0.90400000000000003,"15min":0.996},"last":0.498},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69999999999999996,"15min":0.72399999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88100000000000001,"5min":0.98199999999999998,"15min":1.0800000000000001},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70099999999999996,"15min":0.73299999999999998},"min":{"1min":0.48499999999999999,"5min":0.42299999999999999,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.0209999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69199999999999995,"15min":0.71899999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82999999999999996,"5min":0.88100000000000001,"15min":1.077},"last":0.625}]},{"osd":2,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.746},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.45900000000000002},"max":{"1min":0.872,"5min":0.95099999999999996,"15min":1.105},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71799999999999997,"15min":0.745},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.92100000000000004,"5min":0.99099999999999999,"15min":1.0900000000000001},"last":0.72599999999999998}]},{"osd":3,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72899999999999998,"15min":0.76600000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89300000000000002,"5min":1.054,"15min":1.1359999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71399999999999997,"15min":0.753},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93600000000000005,"5min":0.94799999999999995,"15min":1.1080000000000001},"last":0.64600000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.63900000000000001,"15min":0.63600000000000001},"min":{"1min":0.47499999999999998,"5min":0.439,"15min":0.38500000000000001},"max":{"1min":0.79800000000000004,"5min":0.95499999999999996,"15min":1.0780000000000001},"last":0.70599999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63,"15min":0.64000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":1.579},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48199999999999998,"5min":0.46300000000000002,"15min":0.42399999999999999},"max":{"1min":0.85599999999999998,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.55600000000000005}]},{"osd":7,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66000000000000003,"15min":0.65900000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91800000000000004,"5min":1.0940000000000001,"15min":1.1200000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.36199999999999999},"max":{"1min":0.90400000000000003,"5min":1.0209999999999999,"15min":1.657},"last":0.68899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575090,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50968,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320872,"statfs":{"total":96636764160,"available":96584572928,"internally_reserved":0,"allocated":1916928,"data_stored":975749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68799999999999994,"15min":0.72199999999999998},"min":{"1min":0.45400000000000001,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":2.6699999999999999},"last":1.081},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.46500000000000002,"5min":0.41699999999999998,"15min":0.32800000000000001},"max":{"1min":0.86799999999999999,"5min":1.083,"15min":1.083},"last":1.107}]},{"osd":1,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68899999999999995,"15min":0.71799999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44500000000000001},"max":{"1min":0.93600000000000005,"5min":1.05,"15min":1.079},"last":2.036},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.71499999999999997,"15min":0.73899999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.36799999999999999},"max":{"1min":0.873,"5min":0.94599999999999995,"15min":2.706},"last":0.59799999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70899999999999996,"15min":0.72799999999999998},"min":{"1min":0.41199999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90700000000000003,"5min":1.212,"15min":1.212},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70799999999999996,"15min":0.72699999999999998},"min":{"1min":0.497,"5min":0.44800000000000001,"15min":0.433},"max":{"1min":0.94599999999999995,"5min":1.181,"15min":1.181},"last":2.0790000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72499999999999998,"15min":0.74199999999999999},"min":{"1min":0.53900000000000003,"5min":0.41799999999999998,"15min":0.377},"max":{"1min":0.88600000000000001,"5min":0.95199999999999996,"15min":2.7389999999999999},"last":1.01},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73099999999999998,"15min":0.753},"min":{"1min":0.51600000000000001,"5min":0.47299999999999998,"15min":0.39700000000000002},"max":{"1min":0.94499999999999995,"5min":1.304,"15min":1.304},"last":0.98499999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.628,"15min":0.628},"min":{"1min":0.38500000000000001,"5min":0.38,"15min":0.28599999999999998},"max":{"1min":0.85599999999999998,"5min":1.129,"15min":1.129},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.69099999999999995,"15min":0.68400000000000005},"min":{"1min":0.53700000000000003,"5min":0.39900000000000002,"15min":0.36299999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":2.7719999999999998},"last":0.54800000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60199999999999998,"15min":0.60599999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.32700000000000001},"max":{"1min":0.89700000000000002,"5min":1.169,"15min":1.169},"last":1.2729999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42599999999999999,"5min":0.39400000000000002,"15min":0.34300000000000003},"max":{"1min":0.91000000000000003,"5min":1.238,"15min":1.238},"last":0.84399999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64600000000000002,"15min":0.64300000000000002},"min":{"1min":0.40899999999999997,"5min":0.36899999999999999,"15min":0.32900000000000001},"max":{"1min":0.90800000000000003,"5min":1.026,"15min":3.0230000000000001},"last":1.6000000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68300000000000005,"15min":0.67700000000000005},"min":{"1min":0.49399999999999999,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.98199999999999998,"5min":1.2589999999999999,"15min":1.407},"last":1.6819999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575090,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37004,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334836,"statfs":{"total":96636764160,"available":96598872064,"internally_reserved":0,"allocated":1904640,"data_stored":969101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.70599999999999996,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.411},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.45600000000000002,"5min":0.45100000000000001,"15min":0.435},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.1200000000000001},"last":0.67700000000000005}]},{"osd":1,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71199999999999997,"15min":0.74399999999999999},"min":{"1min":0.496,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84099999999999997,"5min":0.92500000000000004,"15min":1.077},"last":0.88},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70399999999999996,"15min":0.72999999999999998},"min":{"1min":0.52700000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.0469999999999999},"last":0.70299999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.71999999999999997,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.42199999999999999,"15min":0.35199999999999998},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72099999999999997,"15min":0.76400000000000001},"min":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.86699999999999999,"5min":0.98199999999999998,"15min":1.387},"last":1.004}]},{"osd":3,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.49399999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89700000000000002,"5min":0.95399999999999996,"15min":1.008},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.74099999999999999,"15min":0.76600000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46800000000000003},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":1.0289999999999999}]},{"osd":5,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.378},"max":{"1min":0.92200000000000004,"5min":0.92400000000000004,"15min":0.97099999999999997},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.40400000000000003,"15min":0.34599999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":1.1040000000000001}]},{"osd":6,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.014},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67900000000000005,"15min":0.67000000000000004},"min":{"1min":0.48599999999999999,"5min":0.443,"15min":0.374},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.0289999999999999},"last":1.133}]},{"osd":7,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.69899999999999995,"15min":0.67200000000000004},"min":{"1min":0.51300000000000001,"5min":0.502,"15min":0.39000000000000001},"max":{"1min":0.91700000000000004,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.69799999999999995},"min":{"1min":0.48199999999999998,"5min":0.42799999999999999,"15min":0.40300000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":1.1599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575090,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37004,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334836,"statfs":{"total":96636764160,"available":96598872064,"internally_reserved":0,"allocated":1904640,"data_stored":969101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.44400000000000001,"15min":0.44900000000000001},"min":{"1min":0.25600000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.63100000000000001,"5min":0.78600000000000003,"15min":0.84199999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.49299999999999999,"15min":0.51100000000000001},"min":{"1min":0.312,"5min":0.307,"15min":0.307},"max":{"1min":0.66700000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47399999999999998,"15min":0.47999999999999998},"min":{"1min":0.32300000000000001,"5min":0.32000000000000001,"15min":0.315},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.0029999999999999},"last":0.48699999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55800000000000005,"15min":0.57199999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.58299999999999996,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.36799999999999999},"max":{"1min":0.81599999999999995,"5min":0.88100000000000001,"15min":1.663},"last":0.59099999999999997}]},{"osd":4,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.72699999999999998,"15min":0.755},"min":{"1min":0.53000000000000003,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.284},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.52700000000000002,"5min":0.51900000000000002,"15min":0.47699999999999998},"max":{"1min":0.96899999999999997,"5min":1.175,"15min":1.175},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76600000000000001,"15min":0.78700000000000003},"min":{"1min":0.54900000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.05,"5min":1.0629999999999999,"15min":1.306},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.754,"15min":0.78200000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.372},"max":{"1min":1.121,"5min":1.121,"15min":1.2470000000000001},"last":0.85999999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.746,"15min":0.76900000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48099999999999998},"max":{"1min":1.0680000000000001,"5min":1.113,"15min":1.117},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.78700000000000003,"15min":0.81100000000000005},"min":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.54200000000000004},"max":{"1min":1.133,"5min":1.133,"15min":1.2589999999999999},"last":0.77600000000000002}]},{"osd":7,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.78300000000000003,"15min":0.82799999999999996},"min":{"1min":0.58399999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.159,"5min":1.159,"15min":2.4910000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.78100000000000003,"15min":0.81799999999999995},"min":{"1min":0.57599999999999996,"5min":0.53500000000000003,"15min":0.51600000000000001},"max":{"1min":1.0960000000000001,"5min":1.1359999999999999,"15min":1.595},"last":0.83999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575090,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59156,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312684,"statfs":{"total":96636764160,"available":96576188416,"internally_reserved":0,"allocated":1912832,"data_stored":974730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46200000000000002,"15min":0.46400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.80400000000000005,"5min":0.84699999999999998,"15min":1.3169999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.50800000000000001,"15min":0.53300000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67300000000000004,"5min":0.80800000000000005,"15min":2.5270000000000001},"last":0.47399999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.47699999999999998,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.29999999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":2.7200000000000002},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.55700000000000005},"min":{"1min":0.39900000000000002,"5min":0.36299999999999999,"15min":0.35999999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":2.6110000000000002},"last":0.52500000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55100000000000005,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.755,"5min":0.755,"15min":8.2530000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.77000000000000002,"5min":0.89600000000000002,"15min":1.2150000000000001},"last":0.49399999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.73999999999999999,"15min":0.76900000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.48399999999999999},"max":{"1min":0.91100000000000003,"5min":1.0840000000000001,"15min":1.1499999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73999999999999999,"15min":0.78100000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.47999999999999998},"max":{"1min":0.92900000000000005,"5min":1.0629999999999999,"15min":2.3170000000000002},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.79900000000000004,"15min":0.84699999999999998},"min":{"1min":0.58399999999999996,"5min":0.56399999999999995,"15min":0.49399999999999999},"max":{"1min":1.0029999999999999,"5min":1.1319999999999999,"15min":3.1139999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.78900000000000003,"15min":0.83299999999999996},"min":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.55600000000000005},"max":{"1min":1.03,"5min":1.153,"15min":2.6850000000000001},"last":0.81000000000000005}]},{"osd":6,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.73999999999999999,"15min":0.79100000000000004},"min":{"1min":0.52900000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98299999999999998,"5min":1.038,"15min":3.9849999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75900000000000001,"15min":0.80200000000000005},"min":{"1min":0.53900000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":3.391},"last":0.63600000000000001}]},{"osd":7,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.76000000000000001,"15min":0.80900000000000005},"min":{"1min":0.56200000000000006,"5min":0.52300000000000002,"15min":0.5},"max":{"1min":1.022,"5min":1.1759999999999999,"15min":2.5779999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.78200000000000003,"15min":0.81799999999999995},"min":{"1min":0.57099999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.736,"5min":1.736,"15min":2.5939999999999999},"last":0.77200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575091,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37016,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334824,"statfs":{"total":96636764160,"available":96598859776,"internally_reserved":0,"allocated":1916928,"data_stored":975749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42899999999999999,"15min":0.432},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26100000000000001},"max":{"1min":0.56000000000000005,"5min":0.65400000000000003,"15min":0.77200000000000002},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.34999999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.74399999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.39600000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.35899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.63700000000000001,"5min":0.69199999999999995,"15min":1.0409999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.51700000000000002},"min":{"1min":0.32100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73199999999999998,"5min":0.77900000000000003,"15min":1.014},"last":0.36099999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60799999999999998,"15min":0.628},"min":{"1min":0.502,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.746,"5min":0.80300000000000005,"15min":0.96299999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55300000000000005,"15min":0.57099999999999995},"min":{"1min":0.41299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69899999999999995,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.47199999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76400000000000001,"15min":0.78300000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48899999999999999},"max":{"1min":1.155,"5min":1.2110000000000001,"15min":1.236},"last":0.503},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79000000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0640000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.55800000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77700000000000002,"15min":0.78500000000000003},"min":{"1min":0.56000000000000005,"5min":0.52500000000000002,"15min":0.45200000000000001},"max":{"1min":1.1020000000000001,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.79600000000000004,"15min":0.80300000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.48599999999999999},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.54600000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.55900000000000005,"5min":0.53800000000000003,"15min":0.503},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.2170000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79900000000000004,"15min":0.81799999999999995},"min":{"1min":0.53700000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.60499999999999998}]},{"osd":7,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.58499999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82699999999999996,"15min":0.84199999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.65300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575092,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41688,"kb_used_data":2448,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330152,"statfs":{"total":96636764160,"available":96594075648,"internally_reserved":0,"allocated":2506752,"data_stored":1565098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.27300000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.59199999999999997,"5min":0.79600000000000004,"15min":2.2450000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.48299999999999998,"15min":0.50800000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27700000000000002},"max":{"1min":0.72999999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.33300000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.504,"15min":0.51400000000000001},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68200000000000005,"5min":0.84499999999999997,"15min":2.2989999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52800000000000002,"15min":0.54700000000000004},"min":{"1min":0.39100000000000001,"5min":0.34899999999999998,"15min":0.29899999999999999},"max":{"1min":0.71199999999999997,"5min":0.83599999999999997,"15min":0.90300000000000002},"last":0.379}]},{"osd":3,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.505,"15min":0.505},"min":{"1min":0.35199999999999998,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.84999999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57799999999999996,"15min":0.58999999999999997},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76600000000000001,"5min":0.92700000000000005,"15min":2.4100000000000001},"last":0.51100000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74399999999999999,"15min":0.77800000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1220000000000001,"5min":1.21,"15min":1.3640000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.75700000000000001,"15min":0.79300000000000004},"min":{"1min":0.57599999999999996,"5min":0.53500000000000003,"15min":0.44900000000000001},"max":{"1min":1.0289999999999999,"5min":1.0589999999999999,"15min":2.4460000000000002},"last":0.58099999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75600000000000001,"15min":0.79400000000000004},"min":{"1min":0.62,"5min":0.54200000000000004,"15min":0.47899999999999998},"max":{"1min":1.044,"5min":1.0669999999999999,"15min":1.3839999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.59399999999999997,"5min":0.5,"15min":0.48399999999999999},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.325},"last":0.74299999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77100000000000002,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.147,"5min":1.147,"15min":2.3380000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.755,"15min":0.79900000000000004},"min":{"1min":0.55600000000000005,"5min":0.51000000000000001,"15min":0.50600000000000001},"max":{"1min":0.97899999999999998,"5min":1.0900000000000001,"15min":1.3440000000000001},"last":0.61299999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76300000000000001,"15min":0.81599999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.503},"max":{"1min":1.016,"5min":1.1180000000000001,"15min":1.2749999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.77200000000000002,"15min":0.80500000000000005},"min":{"1min":0.56000000000000005,"5min":0.50600000000000001,"15min":0.502},"max":{"1min":1.077,"5min":1.0880000000000001,"15min":1.381},"last":0.76200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:13:08.018 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:13:08.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.156+0000 7f99adcf9640 1 Processor -- start 2023-07-14T13:13:08.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.156+0000 7f99adcf9640 1 -- start start 2023-07-14T13:13:08.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.156+0000 7f99adcf9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a8070b70 0x7f99a8070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:08.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.156+0000 7f99adcf9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99a806b1e0 0x7f99a80c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:08.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.156+0000 7f99adcf9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a80cac70 con 0x7f99a80c21f0 2023-07-14T13:13:08.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.156+0000 7f99adcf9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a8071480 con 0x7f99a806b1e0 2023-07-14T13:13:08.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.156+0000 7f99adcf9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a80ca060 con 0x7f99a8070b70 2023-07-14T13:13:08.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.160+0000 7f99a6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99a806b1e0 0x7f99a80c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:08.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.160+0000 7f99a6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99a806b1e0 0x7f99a80c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60402/0 (socket says 172.21.15.5:60402) 2023-07-14T13:13:08.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.160+0000 7f99a6ffd640 1 -- 172.21.15.5:0/1845391462 learned_addr learned my addr 172.21.15.5:0/1845391462 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:08.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.160+0000 7f99a77fe640 1 --2- 172.21.15.5:0/1845391462 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a8070b70 0x7f99a8070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:08.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.160+0000 7f99a6ffd640 1 -- 172.21.15.5:0/1845391462 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a8070b70 msgr2=0x7f99a8070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:08.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.160+0000 7f99a6ffd640 1 --2- 172.21.15.5:0/1845391462 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a8070b70 0x7f99a8070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:08.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.160+0000 7f99a6ffd640 1 -- 172.21.15.5:0/1845391462 >> v1:172.21.15.154:6789/0 conn(0x7f99a80c21f0 legacy=0x7f99a80cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:08.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.160+0000 7f99a6ffd640 1 -- 172.21.15.5:0/1845391462 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a80ca340 con 0x7f99a806b1e0 2023-07-14T13:13:08.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.160+0000 7f99a77fe640 1 --2- 172.21.15.5:0/1845391462 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a8070b70 0x7f99a8070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:13:08.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.160+0000 7f99a6ffd640 1 --2- 172.21.15.5:0/1845391462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a806b1e0 0x7f99a80c1cb0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f999c009870 tx=0x7f999c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9dd8155535e3ef server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:08.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.160+0000 7f99a67fc640 1 -- 172.21.15.5:0/1845391462 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c0ab680 con 0x7f99a806b1e0 2023-07-14T13:13:08.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.160+0000 7f99a67fc640 1 -- 172.21.15.5:0/1845391462 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999c0ab7e0 con 0x7f99a806b1e0 2023-07-14T13:13:08.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.160+0000 7f99a67fc640 1 -- 172.21.15.5:0/1845391462 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c0abb70 con 0x7f99a806b1e0 2023-07-14T13:13:08.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.164+0000 7f99adcf9640 1 -- 172.21.15.5:0/1845391462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a806b1e0 msgr2=0x7f99a80c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:08.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.164+0000 7f99adcf9640 1 --2- 172.21.15.5:0/1845391462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a806b1e0 0x7f99a80c1cb0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f999c009870 tx=0x7f999c01c480 comp rx=0 tx=0).stop 2023-07-14T13:13:08.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.164+0000 7f99adcf9640 1 -- 172.21.15.5:0/1845391462 shutdown_connections 2023-07-14T13:13:08.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.164+0000 7f99adcf9640 1 --2- 172.21.15.5:0/1845391462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a806b1e0 0x7f99a80c1cb0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:08.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.164+0000 7f99adcf9640 1 --2- 172.21.15.5:0/1845391462 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a8070b70 0x7f99a8070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:08.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.164+0000 7f99adcf9640 1 -- 172.21.15.5:0/1845391462 >> 172.21.15.5:0/1845391462 conn(0x7f99a80afcf0 msgr2=0x7f99a80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:08.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.164+0000 7f99adcf9640 1 -- 172.21.15.5:0/1845391462 shutdown_connections 2023-07-14T13:13:08.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.164+0000 7f99adcf9640 1 -- 172.21.15.5:0/1845391462 wait complete. 2023-07-14T13:13:08.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.164+0000 7f99adcf9640 1 Processor -- start 2023-07-14T13:13:08.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.164+0000 7f99adcf9640 1 -- start start 2023-07-14T13:13:08.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.164+0000 7f99adcf9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a806b1e0 0x7f99a8151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:08.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.164+0000 7f99adcf9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a8070b70 0x7f99a814f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:08.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.164+0000 7f99adcf9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80c21f0 0x7f99a814f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:08.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.164+0000 7f99adcf9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a80c1800 con 0x7f99a806b1e0 2023-07-14T13:13:08.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.164+0000 7f99adcf9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a814ee20 con 0x7f99a80c21f0 2023-07-14T13:13:08.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.164+0000 7f99adcf9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a80b1190 con 0x7f99a8070b70 2023-07-14T13:13:08.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.164+0000 7f99a77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a806b1e0 0x7f99a8151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:08.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.164+0000 7f99a77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a806b1e0 0x7f99a8151d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60414/0 (socket says 172.21.15.5:60414) 2023-07-14T13:13:08.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.164+0000 7f99a77fe640 1 -- 172.21.15.5:0/3574315161 learned_addr learned my addr 172.21.15.5:0/3574315161 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:08.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.164+0000 7f99a6ffd640 1 --2- 172.21.15.5:0/3574315161 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a8070b70 0x7f99a814f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:08.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.164+0000 7f99a7fff640 1 --2- 172.21.15.5:0/3574315161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80c21f0 0x7f99a814f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:08.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.168+0000 7f99a77fe640 1 -- 172.21.15.5:0/3574315161 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a8070b70 msgr2=0x7f99a814f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:08.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.168+0000 7f99a77fe640 1 --2- 172.21.15.5:0/3574315161 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a8070b70 0x7f99a814f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:08.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.168+0000 7f99a77fe640 1 -- 172.21.15.5:0/3574315161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80c21f0 msgr2=0x7f99a814f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:08.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.168+0000 7f99a77fe640 1 --2- 172.21.15.5:0/3574315161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80c21f0 0x7f99a814f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:08.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.168+0000 7f99a77fe640 1 -- 172.21.15.5:0/3574315161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999c0094d0 con 0x7f99a806b1e0 2023-07-14T13:13:08.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.168+0000 7f99a77fe640 1 --2- 172.21.15.5:0/3574315161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a806b1e0 0x7f99a8151d70 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f999800e810 tx=0x7f999800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:08.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.168+0000 7f998ffff640 1 -- 172.21.15.5:0/3574315161 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999800c8d0 con 0x7f99a806b1e0 2023-07-14T13:13:08.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.168+0000 7f998ffff640 1 -- 172.21.15.5:0/3574315161 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999800ca30 con 0x7f99a806b1e0 2023-07-14T13:13:08.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.168+0000 7f998ffff640 1 -- 172.21.15.5:0/3574315161 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999800cdc0 con 0x7f99a806b1e0 2023-07-14T13:13:08.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.168+0000 7f99adcf9640 1 -- 172.21.15.5:0/3574315161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a80b1470 con 0x7f99a806b1e0 2023-07-14T13:13:08.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.168+0000 7f99adcf9640 1 -- 172.21.15.5:0/3574315161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a80b1a30 con 0x7f99a806b1e0 2023-07-14T13:13:08.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.168+0000 7f99adcf9640 1 -- 172.21.15.5:0/3574315161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a80678d0 con 0x7f99a806b1e0 2023-07-14T13:13:08.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.168+0000 7f998ffff640 1 -- 172.21.15.5:0/3574315161 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9998013410 con 0x7f99a806b1e0 2023-07-14T13:13:08.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.168+0000 7f998ffff640 1 --2- 172.21.15.5:0/3574315161 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f99940663a0 0x7f9994068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:08.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.168+0000 7f998ffff640 1 -- 172.21.15.5:0/3574315161 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f9998083da0 con 0x7f99a806b1e0 2023-07-14T13:13:08.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.172+0000 7f99a6ffd640 1 --2- 172.21.15.5:0/3574315161 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f99940663a0 0x7f9994068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:08.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.172+0000 7f99a6ffd640 1 --2- 172.21.15.5:0/3574315161 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f99940663a0 0x7f9994068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f999c0af000 tx=0x7f999c0b6040 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:08.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.172+0000 7f998ffff640 1 -- 172.21.15.5:0/3574315161 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9998050ff0 con 0x7f99a806b1e0 2023-07-14T13:13:08.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.328+0000 7f99adcf9640 1 -- 172.21.15.5:0/3574315161 --> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f99a80c9cf0 con 0x7f99940663a0 2023-07-14T13:13:08.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.336+0000 7f998ffff640 1 -- 172.21.15.5:0/3574315161 <== mgr.7604 v2:172.21.15.154:6832/1443161386 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306124 (secure 0 0 0) 0x7f999c0ab950 con 0x7f99940663a0 2023-07-14T13:13:08.376 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:13:08.377 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:13:08.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.340+0000 7f99adcf9640 1 -- 172.21.15.5:0/3574315161 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f99940663a0 msgr2=0x7f9994068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:08.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.340+0000 7f99adcf9640 1 --2- 172.21.15.5:0/3574315161 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f99940663a0 0x7f9994068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f999c0af000 tx=0x7f999c0b6040 comp rx=0 tx=0).stop 2023-07-14T13:13:08.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.340+0000 7f99adcf9640 1 -- 172.21.15.5:0/3574315161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a806b1e0 msgr2=0x7f99a8151d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:08.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.340+0000 7f99adcf9640 1 --2- 172.21.15.5:0/3574315161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a806b1e0 0x7f99a8151d70 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f999800e810 tx=0x7f999800ecd0 comp rx=0 tx=0).stop 2023-07-14T13:13:08.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.340+0000 7f99adcf9640 1 -- 172.21.15.5:0/3574315161 shutdown_connections 2023-07-14T13:13:08.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.340+0000 7f99adcf9640 1 --2- 172.21.15.5:0/3574315161 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f99940663a0 0x7f9994068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:08.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.340+0000 7f99adcf9640 1 --2- 172.21.15.5:0/3574315161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80c21f0 0x7f99a814f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:08.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.340+0000 7f99adcf9640 1 --2- 172.21.15.5:0/3574315161 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a8070b70 0x7f99a814f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:08.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.340+0000 7f99adcf9640 1 --2- 172.21.15.5:0/3574315161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a806b1e0 0x7f99a8151d70 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:08.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.340+0000 7f99adcf9640 1 -- 172.21.15.5:0/3574315161 >> 172.21.15.5:0/3574315161 conn(0x7f99a80afcf0 msgr2=0x7f99a806b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:08.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.340+0000 7f99adcf9640 1 -- 172.21.15.5:0/3574315161 shutdown_connections 2023-07-14T13:13:08.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.340+0000 7f99adcf9640 1 -- 172.21.15.5:0/3574315161 wait complete. 2023-07-14T13:13:08.396 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-14T13:13:07.392443+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":355484,"kb_used_data":16092,"kb_used_omap":0,"kb_used_meta":339328,"kb_avail":754619236,"statfs":{"total":773094113280,"available":772730097664,"internally_reserved":0,"allocated":16478208,"data_stored":8964746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":347471872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.552142"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.849702+0000","last_change":"2023-07-14T13:13:02.849702+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.849702+0000","last_undegraded":"2023-07-14T13:13:02.849702+0000","last_fullsized":"2023-07-14T13:13:02.849702+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.861742+0000","last_change":"2023-07-14T13:13:02.861742+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.861742+0000","last_undegraded":"2023-07-14T13:13:02.861742+0000","last_fullsized":"2023-07-14T13:13:02.861742+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.856128+0000","last_change":"2023-07-14T13:13:02.856128+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.856128+0000","last_undegraded":"2023-07-14T13:13:02.856128+0000","last_fullsized":"2023-07-14T13:13:02.856128+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.858190+0000","last_change":"2023-07-14T13:13:02.858190+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.858190+0000","last_undegraded":"2023-07-14T13:13:02.858190+0000","last_fullsized":"2023-07-14T13:13:02.858190+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.850808+0000","last_change":"2023-07-14T13:13:02.850808+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.850808+0000","last_undegraded":"2023-07-14T13:13:02.850808+0000","last_fullsized":"2023-07-14T13:13:02.850808+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.850055+0000","last_change":"2023-07-14T13:13:02.850055+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.850055+0000","last_undegraded":"2023-07-14T13:13:02.850055+0000","last_fullsized":"2023-07-14T13:13:02.850055+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.856317+0000","last_change":"2023-07-14T13:13:02.856317+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.856317+0000","last_undegraded":"2023-07-14T13:13:02.856317+0000","last_fullsized":"2023-07-14T13:13:02.856317+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.853552+0000","last_change":"2023-07-14T13:13:02.853552+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.853552+0000","last_undegraded":"2023-07-14T13:13:02.853552+0000","last_fullsized":"2023-07-14T13:13:02.853552+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.851575+0000","last_change":"2023-07-14T13:13:02.851575+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.851575+0000","last_undegraded":"2023-07-14T13:13:02.851575+0000","last_fullsized":"2023-07-14T13:13:02.851575+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.847249+0000","last_change":"2023-07-14T13:13:02.847249+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.847249+0000","last_undegraded":"2023-07-14T13:13:02.847249+0000","last_fullsized":"2023-07-14T13:13:02.847249+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.858717+0000","last_change":"2023-07-14T13:13:02.858717+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.858717+0000","last_undegraded":"2023-07-14T13:13:02.858717+0000","last_fullsized":"2023-07-14T13:13:02.858717+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.848547+0000","last_change":"2023-07-14T13:13:02.848547+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.848547+0000","last_undegraded":"2023-07-14T13:13:02.848547+0000","last_fullsized":"2023-07-14T13:13:02.848547+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.850700+0000","last_change":"2023-07-14T13:13:02.850700+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.850700+0000","last_undegraded":"2023-07-14T13:13:02.850700+0000","last_fullsized":"2023-07-14T13:13:02.850700+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.849830+0000","last_change":"2023-07-14T13:13:02.849830+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.849830+0000","last_undegraded":"2023-07-14T13:13:02.849830+0000","last_fullsized":"2023-07-14T13:13:02.849830+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.849124+0000","last_change":"2023-07-14T13:13:02.849124+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.849124+0000","last_undegraded":"2023-07-14T13:13:02.849124+0000","last_fullsized":"2023-07-14T13:13:02.849124+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.853108+0000","last_change":"2023-07-14T13:13:02.853108+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.853108+0000","last_undegraded":"2023-07-14T13:13:02.853108+0000","last_fullsized":"2023-07-14T13:13:02.853108+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.851143+0000","last_change":"2023-07-14T13:13:02.851143+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.851143+0000","last_undegraded":"2023-07-14T13:13:02.851143+0000","last_fullsized":"2023-07-14T13:13:02.851143+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.848625+0000","last_change":"2023-07-14T13:13:02.848625+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.848625+0000","last_undegraded":"2023-07-14T13:13:02.848625+0000","last_fullsized":"2023-07-14T13:13:02.848625+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.858202+0000","last_change":"2023-07-14T13:13:02.858202+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.858202+0000","last_undegraded":"2023-07-14T13:13:02.858202+0000","last_fullsized":"2023-07-14T13:13:02.858202+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.849602+0000","last_change":"2023-07-14T13:13:02.849602+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.849602+0000","last_undegraded":"2023-07-14T13:13:02.849602+0000","last_fullsized":"2023-07-14T13:13:02.849602+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.857664+0000","last_change":"2023-07-14T13:13:02.857664+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.857664+0000","last_undegraded":"2023-07-14T13:13:02.857664+0000","last_fullsized":"2023-07-14T13:13:02.857664+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.850309+0000","last_change":"2023-07-14T13:13:02.850309+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.850309+0000","last_undegraded":"2023-07-14T13:13:02.850309+0000","last_fullsized":"2023-07-14T13:13:02.850309+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.857728+0000","last_change":"2023-07-14T13:13:02.857728+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.857728+0000","last_undegraded":"2023-07-14T13:13:02.857728+0000","last_fullsized":"2023-07-14T13:13:02.857728+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.852651+0000","last_change":"2023-07-14T13:13:02.852651+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.852651+0000","last_undegraded":"2023-07-14T13:13:02.852651+0000","last_fullsized":"2023-07-14T13:13:02.852651+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.855048+0000","last_change":"2023-07-14T13:13:02.855048+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.855048+0000","last_undegraded":"2023-07-14T13:13:02.855048+0000","last_fullsized":"2023-07-14T13:13:02.855048+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.858641+0000","last_change":"2023-07-14T13:13:02.858641+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.858641+0000","last_undegraded":"2023-07-14T13:13:02.858641+0000","last_fullsized":"2023-07-14T13:13:02.858641+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.857754+0000","last_change":"2023-07-14T13:13:02.857754+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.857754+0000","last_undegraded":"2023-07-14T13:13:02.857754+0000","last_fullsized":"2023-07-14T13:13:02.857754+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.846958+0000","last_change":"2023-07-14T13:13:02.846958+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.846958+0000","last_undegraded":"2023-07-14T13:13:02.846958+0000","last_fullsized":"2023-07-14T13:13:02.846958+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.857735+0000","last_change":"2023-07-14T13:13:02.857735+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.857735+0000","last_undegraded":"2023-07-14T13:13:02.857735+0000","last_fullsized":"2023-07-14T13:13:02.857735+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.855125+0000","last_change":"2023-07-14T13:13:02.855125+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.855125+0000","last_undegraded":"2023-07-14T13:13:02.855125+0000","last_fullsized":"2023-07-14T13:13:02.855125+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.852437+0000","last_change":"2023-07-14T13:13:02.852437+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.852437+0000","last_undegraded":"2023-07-14T13:13:02.852437+0000","last_fullsized":"2023-07-14T13:13:02.852437+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.846335+0000","last_change":"2023-07-14T13:13:02.846335+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.846335+0000","last_undegraded":"2023-07-14T13:13:02.846335+0000","last_fullsized":"2023-07-14T13:13:02.846335+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.851446+0000","last_change":"2023-07-14T13:13:02.851446+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.851446+0000","last_undegraded":"2023-07-14T13:13:02.851446+0000","last_fullsized":"2023-07-14T13:13:02.851446+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.872286+0000","last_change":"2023-07-14T13:13:02.868993+0000","last_active":"2023-07-14T13:13:02.872286+0000","last_peered":"2023-07-14T13:13:02.872286+0000","last_clean":"2023-07-14T13:13:02.872286+0000","last_became_active":"2023-07-14T13:13:02.868694+0000","last_became_peered":"2023-07-14T13:13:02.868694+0000","last_unstale":"2023-07-14T13:13:02.872286+0000","last_undegraded":"2023-07-14T13:13:02.872286+0000","last_fullsized":"2023-07-14T13:13:02.872286+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:53:35.355464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.848613+0000","last_change":"2023-07-14T13:13:02.848613+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.848613+0000","last_undegraded":"2023-07-14T13:13:02.848613+0000","last_fullsized":"2023-07-14T13:13:02.848613+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.867448+0000","last_change":"2023-07-14T13:13:02.865527+0000","last_active":"2023-07-14T13:13:02.867448+0000","last_peered":"2023-07-14T13:13:02.867448+0000","last_clean":"2023-07-14T13:13:02.867448+0000","last_became_active":"2023-07-14T13:13:02.865167+0000","last_became_peered":"2023-07-14T13:13:02.865167+0000","last_unstale":"2023-07-14T13:13:02.867448+0000","last_undegraded":"2023-07-14T13:13:02.867448+0000","last_fullsized":"2023-07-14T13:13:02.867448+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:36:44.671952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.859386+0000","last_change":"2023-07-14T13:13:02.859386+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.859386+0000","last_undegraded":"2023-07-14T13:13:02.859386+0000","last_fullsized":"2023-07-14T13:13:02.859386+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.875295+0000","last_change":"2023-07-14T13:13:02.869637+0000","last_active":"2023-07-14T13:13:02.875295+0000","last_peered":"2023-07-14T13:13:02.875295+0000","last_clean":"2023-07-14T13:13:02.875295+0000","last_became_active":"2023-07-14T13:13:02.867864+0000","last_became_peered":"2023-07-14T13:13:02.867864+0000","last_unstale":"2023-07-14T13:13:02.875295+0000","last_undegraded":"2023-07-14T13:13:02.875295+0000","last_fullsized":"2023-07-14T13:13:02.875295+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:19:08.077344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.850910+0000","last_change":"2023-07-14T13:13:02.850910+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.850910+0000","last_undegraded":"2023-07-14T13:13:02.850910+0000","last_fullsized":"2023-07-14T13:13:02.850910+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.875422+0000","last_change":"2023-07-14T13:13:02.873106+0000","last_active":"2023-07-14T13:13:02.875422+0000","last_peered":"2023-07-14T13:13:02.875422+0000","last_clean":"2023-07-14T13:13:02.875422+0000","last_became_active":"2023-07-14T13:13:02.872783+0000","last_became_peered":"2023-07-14T13:13:02.872783+0000","last_unstale":"2023-07-14T13:13:02.875422+0000","last_undegraded":"2023-07-14T13:13:02.875422+0000","last_fullsized":"2023-07-14T13:13:02.875422+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:18:17.154686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.851433+0000","last_change":"2023-07-14T13:13:02.851433+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.851433+0000","last_undegraded":"2023-07-14T13:13:02.851433+0000","last_fullsized":"2023-07-14T13:13:02.851433+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.872343+0000","last_change":"2023-07-14T13:13:02.864266+0000","last_active":"2023-07-14T13:13:02.872343+0000","last_peered":"2023-07-14T13:13:02.872343+0000","last_clean":"2023-07-14T13:13:02.872343+0000","last_became_active":"2023-07-14T13:13:02.863987+0000","last_became_peered":"2023-07-14T13:13:02.863987+0000","last_unstale":"2023-07-14T13:13:02.872343+0000","last_undegraded":"2023-07-14T13:13:02.872343+0000","last_fullsized":"2023-07-14T13:13:02.872343+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:30:54.387176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.852729+0000","last_change":"2023-07-14T13:13:02.852729+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.852729+0000","last_undegraded":"2023-07-14T13:13:02.852729+0000","last_fullsized":"2023-07-14T13:13:02.852729+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.864947+0000","last_change":"2023-07-14T13:13:02.859614+0000","last_active":"2023-07-14T13:13:02.864947+0000","last_peered":"2023-07-14T13:13:02.864947+0000","last_clean":"2023-07-14T13:13:02.864947+0000","last_became_active":"2023-07-14T13:13:02.859348+0000","last_became_peered":"2023-07-14T13:13:02.859348+0000","last_unstale":"2023-07-14T13:13:02.864947+0000","last_undegraded":"2023-07-14T13:13:02.864947+0000","last_fullsized":"2023-07-14T13:13:02.864947+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:28:06.934465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.848145+0000","last_change":"2023-07-14T13:13:02.848145+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.848145+0000","last_undegraded":"2023-07-14T13:13:02.848145+0000","last_fullsized":"2023-07-14T13:13:02.848145+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.864200+0000","last_change":"2023-07-14T13:13:02.860411+0000","last_active":"2023-07-14T13:13:02.864200+0000","last_peered":"2023-07-14T13:13:02.864200+0000","last_clean":"2023-07-14T13:13:02.864200+0000","last_became_active":"2023-07-14T13:13:02.860127+0000","last_became_peered":"2023-07-14T13:13:02.860127+0000","last_unstale":"2023-07-14T13:13:02.864200+0000","last_undegraded":"2023-07-14T13:13:02.864200+0000","last_fullsized":"2023-07-14T13:13:02.864200+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:25:09.510581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.856377+0000","last_change":"2023-07-14T13:13:02.856377+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.856377+0000","last_undegraded":"2023-07-14T13:13:02.856377+0000","last_fullsized":"2023-07-14T13:13:02.856377+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.873554+0000","last_change":"2023-07-14T13:13:02.870024+0000","last_active":"2023-07-14T13:13:02.873554+0000","last_peered":"2023-07-14T13:13:02.873554+0000","last_clean":"2023-07-14T13:13:02.873554+0000","last_became_active":"2023-07-14T13:13:02.869711+0000","last_became_peered":"2023-07-14T13:13:02.869711+0000","last_unstale":"2023-07-14T13:13:02.873554+0000","last_undegraded":"2023-07-14T13:13:02.873554+0000","last_fullsized":"2023-07-14T13:13:02.873554+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:13:33.557920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.856673+0000","last_change":"2023-07-14T13:13:02.856673+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.856673+0000","last_undegraded":"2023-07-14T13:13:02.856673+0000","last_fullsized":"2023-07-14T13:13:02.856673+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.869317+0000","last_change":"2023-07-14T13:13:02.866258+0000","last_active":"2023-07-14T13:13:02.869317+0000","last_peered":"2023-07-14T13:13:02.869317+0000","last_clean":"2023-07-14T13:13:02.869317+0000","last_became_active":"2023-07-14T13:13:02.865982+0000","last_became_peered":"2023-07-14T13:13:02.865982+0000","last_unstale":"2023-07-14T13:13:02.869317+0000","last_undegraded":"2023-07-14T13:13:02.869317+0000","last_fullsized":"2023-07-14T13:13:02.869317+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:37.388068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.855785+0000","last_change":"2023-07-14T13:13:02.855785+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.855785+0000","last_undegraded":"2023-07-14T13:13:02.855785+0000","last_fullsized":"2023-07-14T13:13:02.855785+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.872246+0000","last_change":"2023-07-14T13:13:02.868862+0000","last_active":"2023-07-14T13:13:02.872246+0000","last_peered":"2023-07-14T13:13:02.872246+0000","last_clean":"2023-07-14T13:13:02.872246+0000","last_became_active":"2023-07-14T13:13:02.868554+0000","last_became_peered":"2023-07-14T13:13:02.868554+0000","last_unstale":"2023-07-14T13:13:02.872246+0000","last_undegraded":"2023-07-14T13:13:02.872246+0000","last_fullsized":"2023-07-14T13:13:02.872246+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:15:28.838577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.856936+0000","last_change":"2023-07-14T13:13:02.856936+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.856936+0000","last_undegraded":"2023-07-14T13:13:02.856936+0000","last_fullsized":"2023-07-14T13:13:02.856936+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.864245+0000","last_change":"2023-07-14T13:13:02.859151+0000","last_active":"2023-07-14T13:13:02.864245+0000","last_peered":"2023-07-14T13:13:02.864245+0000","last_clean":"2023-07-14T13:13:02.864245+0000","last_became_active":"2023-07-14T13:13:02.858878+0000","last_became_peered":"2023-07-14T13:13:02.858878+0000","last_unstale":"2023-07-14T13:13:02.864245+0000","last_undegraded":"2023-07-14T13:13:02.864245+0000","last_fullsized":"2023-07-14T13:13:02.864245+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:00.465195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.847342+0000","last_change":"2023-07-14T13:13:02.847342+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.847342+0000","last_undegraded":"2023-07-14T13:13:02.847342+0000","last_fullsized":"2023-07-14T13:13:02.847342+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.865960+0000","last_change":"2023-07-14T13:13:02.863173+0000","last_active":"2023-07-14T13:13:02.865960+0000","last_peered":"2023-07-14T13:13:02.865960+0000","last_clean":"2023-07-14T13:13:02.865960+0000","last_became_active":"2023-07-14T13:13:02.862902+0000","last_became_peered":"2023-07-14T13:13:02.862902+0000","last_unstale":"2023-07-14T13:13:02.865960+0000","last_undegraded":"2023-07-14T13:13:02.865960+0000","last_fullsized":"2023-07-14T13:13:02.865960+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:58:06.564871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.849137+0000","last_change":"2023-07-14T13:13:02.849137+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.849137+0000","last_undegraded":"2023-07-14T13:13:02.849137+0000","last_fullsized":"2023-07-14T13:13:02.849137+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.875022+0000","last_change":"2023-07-14T13:13:02.869185+0000","last_active":"2023-07-14T13:13:02.875022+0000","last_peered":"2023-07-14T13:13:02.875022+0000","last_clean":"2023-07-14T13:13:02.875022+0000","last_became_active":"2023-07-14T13:13:02.868925+0000","last_became_peered":"2023-07-14T13:13:02.868925+0000","last_unstale":"2023-07-14T13:13:02.875022+0000","last_undegraded":"2023-07-14T13:13:02.875022+0000","last_fullsized":"2023-07-14T13:13:02.875022+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:59:49.792863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.848430+0000","last_change":"2023-07-14T13:13:02.848430+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.848430+0000","last_undegraded":"2023-07-14T13:13:02.848430+0000","last_fullsized":"2023-07-14T13:13:02.848430+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.866556+0000","last_change":"2023-07-14T13:13:02.862781+0000","last_active":"2023-07-14T13:13:02.866556+0000","last_peered":"2023-07-14T13:13:02.866556+0000","last_clean":"2023-07-14T13:13:02.866556+0000","last_became_active":"2023-07-14T13:13:02.862518+0000","last_became_peered":"2023-07-14T13:13:02.862518+0000","last_unstale":"2023-07-14T13:13:02.866556+0000","last_undegraded":"2023-07-14T13:13:02.866556+0000","last_fullsized":"2023-07-14T13:13:02.866556+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:01:48.243729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.847246+0000","last_change":"2023-07-14T13:13:02.847246+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.847246+0000","last_undegraded":"2023-07-14T13:13:02.847246+0000","last_fullsized":"2023-07-14T13:13:02.847246+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.875379+0000","last_change":"2023-07-14T13:13:02.870693+0000","last_active":"2023-07-14T13:13:02.875379+0000","last_peered":"2023-07-14T13:13:02.875379+0000","last_clean":"2023-07-14T13:13:02.875379+0000","last_became_active":"2023-07-14T13:13:02.870369+0000","last_became_peered":"2023-07-14T13:13:02.870369+0000","last_unstale":"2023-07-14T13:13:02.875379+0000","last_undegraded":"2023-07-14T13:13:02.875379+0000","last_fullsized":"2023-07-14T13:13:02.875379+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:37:55.269264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.859982+0000","last_change":"2023-07-14T13:13:02.859982+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.859982+0000","last_undegraded":"2023-07-14T13:13:02.859982+0000","last_fullsized":"2023-07-14T13:13:02.859982+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.864210+0000","last_change":"2023-07-14T13:13:02.860174+0000","last_active":"2023-07-14T13:13:02.864210+0000","last_peered":"2023-07-14T13:13:02.864210+0000","last_clean":"2023-07-14T13:13:02.864210+0000","last_became_active":"2023-07-14T13:13:02.859857+0000","last_became_peered":"2023-07-14T13:13:02.859857+0000","last_unstale":"2023-07-14T13:13:02.864210+0000","last_undegraded":"2023-07-14T13:13:02.864210+0000","last_fullsized":"2023-07-14T13:13:02.864210+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:24.219405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.847343+0000","last_change":"2023-07-14T13:13:02.847343+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.847343+0000","last_undegraded":"2023-07-14T13:13:02.847343+0000","last_fullsized":"2023-07-14T13:13:02.847343+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.869509+0000","last_change":"2023-07-14T13:13:02.868617+0000","last_active":"2023-07-14T13:13:02.869509+0000","last_peered":"2023-07-14T13:13:02.869509+0000","last_clean":"2023-07-14T13:13:02.869509+0000","last_became_active":"2023-07-14T13:13:02.868316+0000","last_became_peered":"2023-07-14T13:13:02.868316+0000","last_unstale":"2023-07-14T13:13:02.869509+0000","last_undegraded":"2023-07-14T13:13:02.869509+0000","last_fullsized":"2023-07-14T13:13:02.869509+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:06:31.006923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.854870+0000","last_change":"2023-07-14T13:13:02.854870+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.854870+0000","last_undegraded":"2023-07-14T13:13:02.854870+0000","last_fullsized":"2023-07-14T13:13:02.854870+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.874975+0000","last_change":"2023-07-14T13:13:02.868072+0000","last_active":"2023-07-14T13:13:02.874975+0000","last_peered":"2023-07-14T13:13:02.874975+0000","last_clean":"2023-07-14T13:13:02.874975+0000","last_became_active":"2023-07-14T13:13:02.867703+0000","last_became_peered":"2023-07-14T13:13:02.867703+0000","last_unstale":"2023-07-14T13:13:02.874975+0000","last_undegraded":"2023-07-14T13:13:02.874975+0000","last_fullsized":"2023-07-14T13:13:02.874975+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:57:21.237766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.857490+0000","last_change":"2023-07-14T13:13:02.857490+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.857490+0000","last_undegraded":"2023-07-14T13:13:02.857490+0000","last_fullsized":"2023-07-14T13:13:02.857490+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.865455+0000","last_change":"2023-07-14T13:13:02.862857+0000","last_active":"2023-07-14T13:13:02.865455+0000","last_peered":"2023-07-14T13:13:02.865455+0000","last_clean":"2023-07-14T13:13:02.865455+0000","last_became_active":"2023-07-14T13:13:02.862567+0000","last_became_peered":"2023-07-14T13:13:02.862567+0000","last_unstale":"2023-07-14T13:13:02.865455+0000","last_undegraded":"2023-07-14T13:13:02.865455+0000","last_fullsized":"2023-07-14T13:13:02.865455+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:19:26.447864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.846833+0000","last_change":"2023-07-14T13:13:02.846833+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.846833+0000","last_undegraded":"2023-07-14T13:13:02.846833+0000","last_fullsized":"2023-07-14T13:13:02.846833+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.864271+0000","last_change":"2023-07-14T13:13:02.861021+0000","last_active":"2023-07-14T13:13:02.864271+0000","last_peered":"2023-07-14T13:13:02.864271+0000","last_clean":"2023-07-14T13:13:02.864271+0000","last_became_active":"2023-07-14T13:13:02.860774+0000","last_became_peered":"2023-07-14T13:13:02.860774+0000","last_unstale":"2023-07-14T13:13:02.864271+0000","last_undegraded":"2023-07-14T13:13:02.864271+0000","last_fullsized":"2023-07-14T13:13:02.864271+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:59:22.924331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.854073+0000","last_change":"2023-07-14T13:13:02.854073+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.854073+0000","last_undegraded":"2023-07-14T13:13:02.854073+0000","last_fullsized":"2023-07-14T13:13:02.854073+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.873830+0000","last_change":"2023-07-14T13:13:02.870130+0000","last_active":"2023-07-14T13:13:02.873830+0000","last_peered":"2023-07-14T13:13:02.873830+0000","last_clean":"2023-07-14T13:13:02.873830+0000","last_became_active":"2023-07-14T13:13:02.869853+0000","last_became_peered":"2023-07-14T13:13:02.869853+0000","last_unstale":"2023-07-14T13:13:02.873830+0000","last_undegraded":"2023-07-14T13:13:02.873830+0000","last_fullsized":"2023-07-14T13:13:02.873830+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:32:13.580494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.850458+0000","last_change":"2023-07-14T13:13:02.850458+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.850458+0000","last_undegraded":"2023-07-14T13:13:02.850458+0000","last_fullsized":"2023-07-14T13:13:02.850458+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.875846+0000","last_change":"2023-07-14T13:13:02.873722+0000","last_active":"2023-07-14T13:13:02.875846+0000","last_peered":"2023-07-14T13:13:02.875846+0000","last_clean":"2023-07-14T13:13:02.875846+0000","last_became_active":"2023-07-14T13:13:02.873392+0000","last_became_peered":"2023-07-14T13:13:02.873392+0000","last_unstale":"2023-07-14T13:13:02.875846+0000","last_undegraded":"2023-07-14T13:13:02.875846+0000","last_fullsized":"2023-07-14T13:13:02.875846+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:57:45.510833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.850928+0000","last_change":"2023-07-14T13:13:02.850928+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.850928+0000","last_undegraded":"2023-07-14T13:13:02.850928+0000","last_fullsized":"2023-07-14T13:13:02.850928+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.864221+0000","last_change":"2023-07-14T13:13:02.861693+0000","last_active":"2023-07-14T13:13:02.864221+0000","last_peered":"2023-07-14T13:13:02.864221+0000","last_clean":"2023-07-14T13:13:02.864221+0000","last_became_active":"2023-07-14T13:13:02.861433+0000","last_became_peered":"2023-07-14T13:13:02.861433+0000","last_unstale":"2023-07-14T13:13:02.864221+0000","last_undegraded":"2023-07-14T13:13:02.864221+0000","last_fullsized":"2023-07-14T13:13:02.864221+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:33:35.134309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.855767+0000","last_change":"2023-07-14T13:13:02.855767+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.855767+0000","last_undegraded":"2023-07-14T13:13:02.855767+0000","last_fullsized":"2023-07-14T13:13:02.855767+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.869285+0000","last_change":"2023-07-14T13:13:02.867349+0000","last_active":"2023-07-14T13:13:02.869285+0000","last_peered":"2023-07-14T13:13:02.869285+0000","last_clean":"2023-07-14T13:13:02.869285+0000","last_became_active":"2023-07-14T13:13:02.867008+0000","last_became_peered":"2023-07-14T13:13:02.867008+0000","last_unstale":"2023-07-14T13:13:02.869285+0000","last_undegraded":"2023-07-14T13:13:02.869285+0000","last_fullsized":"2023-07-14T13:13:02.869285+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:18:05.679927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.855630+0000","last_change":"2023-07-14T13:13:02.855630+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.855630+0000","last_undegraded":"2023-07-14T13:13:02.855630+0000","last_fullsized":"2023-07-14T13:13:02.855630+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.875446+0000","last_change":"2023-07-14T13:13:02.871042+0000","last_active":"2023-07-14T13:13:02.875446+0000","last_peered":"2023-07-14T13:13:02.875446+0000","last_clean":"2023-07-14T13:13:02.875446+0000","last_became_active":"2023-07-14T13:13:02.870763+0000","last_became_peered":"2023-07-14T13:13:02.870763+0000","last_unstale":"2023-07-14T13:13:02.875446+0000","last_undegraded":"2023-07-14T13:13:02.875446+0000","last_fullsized":"2023-07-14T13:13:02.875446+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:00:01.670302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"144'271","reported_seq":953,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.860041+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:13:02.860041+0000","last_peered":"2023-07-14T13:13:02.860041+0000","last_clean":"2023-07-14T13:13:02.860041+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:13:02.860041+0000","last_undegraded":"2023-07-14T13:13:02.860041+0000","last_fullsized":"2023-07-14T13:13:02.860041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:10:23.490968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":246,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.858518+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:13:02.858518+0000","last_peered":"2023-07-14T13:13:02.858518+0000","last_clean":"2023-07-14T13:13:02.858518+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:13:02.858518+0000","last_undegraded":"2023-07-14T13:13:02.858518+0000","last_fullsized":"2023-07-14T13:13:02.858518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:58:53.221426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.855688+0000","last_change":"2023-07-14T13:13:02.855688+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.855688+0000","last_undegraded":"2023-07-14T13:13:02.855688+0000","last_fullsized":"2023-07-14T13:13:02.855688+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.873210+0000","last_change":"2023-07-14T13:13:02.869188+0000","last_active":"2023-07-14T13:13:02.873210+0000","last_peered":"2023-07-14T13:13:02.873210+0000","last_clean":"2023-07-14T13:13:02.873210+0000","last_became_active":"2023-07-14T13:13:02.868868+0000","last_became_peered":"2023-07-14T13:13:02.868868+0000","last_unstale":"2023-07-14T13:13:02.873210+0000","last_undegraded":"2023-07-14T13:13:02.873210+0000","last_fullsized":"2023-07-14T13:13:02.873210+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:49:56.887514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":251,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.859913+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:13:02.859913+0000","last_peered":"2023-07-14T13:13:02.859913+0000","last_clean":"2023-07-14T13:13:02.859913+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:13:02.859913+0000","last_undegraded":"2023-07-14T13:13:02.859913+0000","last_fullsized":"2023-07-14T13:13:02.859913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:51:51.579230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.851606+0000","last_change":"2023-07-14T13:13:02.851606+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.851606+0000","last_undegraded":"2023-07-14T13:13:02.851606+0000","last_fullsized":"2023-07-14T13:13:02.851606+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.871277+0000","last_change":"2023-07-14T13:13:02.870439+0000","last_active":"2023-07-14T13:13:02.871277+0000","last_peered":"2023-07-14T13:13:02.871277+0000","last_clean":"2023-07-14T13:13:02.871277+0000","last_became_active":"2023-07-14T13:13:02.870195+0000","last_became_peered":"2023-07-14T13:13:02.870195+0000","last_unstale":"2023-07-14T13:13:02.871277+0000","last_undegraded":"2023-07-14T13:13:02.871277+0000","last_fullsized":"2023-07-14T13:13:02.871277+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:47:16.425255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":252,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.854743+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:13:02.854743+0000","last_peered":"2023-07-14T13:13:02.854743+0000","last_clean":"2023-07-14T13:13:02.854743+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:13:02.854743+0000","last_undegraded":"2023-07-14T13:13:02.854743+0000","last_fullsized":"2023-07-14T13:13:02.854743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:07:17.830966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.846459+0000","last_change":"2023-07-14T13:13:02.846459+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.846459+0000","last_undegraded":"2023-07-14T13:13:02.846459+0000","last_fullsized":"2023-07-14T13:13:02.846459+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.866527+0000","last_change":"2023-07-14T13:13:02.862863+0000","last_active":"2023-07-14T13:13:02.866527+0000","last_peered":"2023-07-14T13:13:02.866527+0000","last_clean":"2023-07-14T13:13:02.866527+0000","last_became_active":"2023-07-14T13:13:02.862584+0000","last_became_peered":"2023-07-14T13:13:02.862584+0000","last_unstale":"2023-07-14T13:13:02.866527+0000","last_undegraded":"2023-07-14T13:13:02.866527+0000","last_fullsized":"2023-07-14T13:13:02.866527+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:01:28.565089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":246,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.859753+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:13:02.859753+0000","last_peered":"2023-07-14T13:13:02.859753+0000","last_clean":"2023-07-14T13:13:02.859753+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:13:02.859753+0000","last_undegraded":"2023-07-14T13:13:02.859753+0000","last_fullsized":"2023-07-14T13:13:02.859753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:33:07.818603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.854448+0000","last_change":"2023-07-14T13:13:02.854448+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.854448+0000","last_undegraded":"2023-07-14T13:13:02.854448+0000","last_fullsized":"2023-07-14T13:13:02.854448+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.875385+0000","last_change":"2023-07-14T13:13:02.872225+0000","last_active":"2023-07-14T13:13:02.875385+0000","last_peered":"2023-07-14T13:13:02.875385+0000","last_clean":"2023-07-14T13:13:02.875385+0000","last_became_active":"2023-07-14T13:13:02.871842+0000","last_became_peered":"2023-07-14T13:13:02.871842+0000","last_unstale":"2023-07-14T13:13:02.875385+0000","last_undegraded":"2023-07-14T13:13:02.875385+0000","last_fullsized":"2023-07-14T13:13:02.875385+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:39:39.654808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":258,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.854434+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:13:02.854434+0000","last_peered":"2023-07-14T13:13:02.854434+0000","last_clean":"2023-07-14T13:13:02.854434+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:13:02.854434+0000","last_undegraded":"2023-07-14T13:13:02.854434+0000","last_fullsized":"2023-07-14T13:13:02.854434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:38:37.620856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.857262+0000","last_change":"2023-07-14T13:13:02.857262+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.857262+0000","last_undegraded":"2023-07-14T13:13:02.857262+0000","last_fullsized":"2023-07-14T13:13:02.857262+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.875404+0000","last_change":"2023-07-14T13:13:02.870013+0000","last_active":"2023-07-14T13:13:02.875404+0000","last_peered":"2023-07-14T13:13:02.875404+0000","last_clean":"2023-07-14T13:13:02.875404+0000","last_became_active":"2023-07-14T13:13:02.869705+0000","last_became_peered":"2023-07-14T13:13:02.869705+0000","last_unstale":"2023-07-14T13:13:02.875404+0000","last_undegraded":"2023-07-14T13:13:02.875404+0000","last_fullsized":"2023-07-14T13:13:02.875404+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:58:26.246984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":250,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.862100+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:13:02.862100+0000","last_peered":"2023-07-14T13:13:02.862100+0000","last_clean":"2023-07-14T13:13:02.862100+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:13:02.862100+0000","last_undegraded":"2023-07-14T13:13:02.862100+0000","last_fullsized":"2023-07-14T13:13:02.862100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:49:38.781467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.848962+0000","last_change":"2023-07-14T13:13:02.848962+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.848962+0000","last_undegraded":"2023-07-14T13:13:02.848962+0000","last_fullsized":"2023-07-14T13:13:02.848962+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.873756+0000","last_change":"2023-07-14T13:13:02.869873+0000","last_active":"2023-07-14T13:13:02.873756+0000","last_peered":"2023-07-14T13:13:02.873756+0000","last_clean":"2023-07-14T13:13:02.873756+0000","last_became_active":"2023-07-14T13:13:02.869590+0000","last_became_peered":"2023-07-14T13:13:02.869590+0000","last_unstale":"2023-07-14T13:13:02.873756+0000","last_undegraded":"2023-07-14T13:13:02.873756+0000","last_fullsized":"2023-07-14T13:13:02.873756+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:29:35.971780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":258,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.851182+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:13:02.851182+0000","last_peered":"2023-07-14T13:13:02.851182+0000","last_clean":"2023-07-14T13:13:02.851182+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:13:02.851182+0000","last_undegraded":"2023-07-14T13:13:02.851182+0000","last_fullsized":"2023-07-14T13:13:02.851182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:46:24.773536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.851849+0000","last_change":"2023-07-14T13:13:02.851849+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.851849+0000","last_undegraded":"2023-07-14T13:13:02.851849+0000","last_fullsized":"2023-07-14T13:13:02.851849+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.865847+0000","last_change":"2023-07-14T13:13:02.859953+0000","last_active":"2023-07-14T13:13:02.865847+0000","last_peered":"2023-07-14T13:13:02.865847+0000","last_clean":"2023-07-14T13:13:02.865847+0000","last_became_active":"2023-07-14T13:13:02.859642+0000","last_became_peered":"2023-07-14T13:13:02.859642+0000","last_unstale":"2023-07-14T13:13:02.865847+0000","last_undegraded":"2023-07-14T13:13:02.865847+0000","last_fullsized":"2023-07-14T13:13:02.865847+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:07:45.072422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":252,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.863796+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:13:02.863796+0000","last_peered":"2023-07-14T13:13:02.863796+0000","last_clean":"2023-07-14T13:13:02.863796+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:13:02.863796+0000","last_undegraded":"2023-07-14T13:13:02.863796+0000","last_fullsized":"2023-07-14T13:13:02.863796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:18:18.346357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575090,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59728,"kb_used_data":2440,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312112,"statfs":{"total":96636764160,"available":96575602688,"internally_reserved":0,"allocated":2498560,"data_stored":1559469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.68999999999999995,"15min":0.70699999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.84199999999999997,"5min":1.262,"15min":1.262},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71699999999999997,"15min":0.72899999999999998},"min":{"1min":0.54100000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.65800000000000003}]},{"osd":1,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.70599999999999996,"15min":0.72999999999999998},"min":{"1min":0.44,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83799999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72799999999999998,"15min":0.74299999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.71499999999999997}]},{"osd":2,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71199999999999997,"15min":0.72599999999999998},"min":{"1min":0.48999999999999999,"5min":0.46100000000000002,"15min":0.42699999999999999},"max":{"1min":0.91500000000000004,"5min":1.073,"15min":1.073},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.753},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84899999999999998,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.70199999999999996}]},{"osd":3,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.72699999999999998,"15min":0.73599999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.091,"5min":1.161,"15min":1.161},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73999999999999999,"15min":0.75600000000000001},"min":{"1min":0.51100000000000001,"5min":0.47899999999999998,"15min":0.41499999999999998},"max":{"1min":0.94899999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.60499999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56899999999999995,"15min":0.57899999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.318},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.022},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.40000000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.42699999999999999,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.91000000000000003,"5min":0.98099999999999998,"15min":0.98299999999999998},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63100000000000001,"15min":0.64900000000000002},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.34100000000000003},"max":{"1min":0.80500000000000005,"5min":1.028,"15min":1.028},"last":0.621}]},{"osd":6,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.42699999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.0489999999999999},"last":0.745},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.68100000000000005,"15min":0.67700000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.36299999999999999},"max":{"1min":1.151,"5min":4.1130000000000004,"15min":4.1130000000000004},"last":0.68500000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575091,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32920,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1916928,"data_stored":975749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70699999999999996,"15min":0.72699999999999998},"min":{"1min":0.496,"5min":0.47899999999999998,"15min":0.38},"max":{"1min":0.89300000000000002,"5min":0.90400000000000003,"15min":0.996},"last":0.498},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69999999999999996,"15min":0.72399999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88100000000000001,"5min":0.98199999999999998,"15min":1.0800000000000001},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70099999999999996,"15min":0.73299999999999998},"min":{"1min":0.48499999999999999,"5min":0.42299999999999999,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.0209999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69199999999999995,"15min":0.71899999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82999999999999996,"5min":0.88100000000000001,"15min":1.077},"last":0.625}]},{"osd":2,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.746},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.45900000000000002},"max":{"1min":0.872,"5min":0.95099999999999996,"15min":1.105},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71799999999999997,"15min":0.745},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.92100000000000004,"5min":0.99099999999999999,"15min":1.0900000000000001},"last":0.72599999999999998}]},{"osd":3,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72899999999999998,"15min":0.76600000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89300000000000002,"5min":1.054,"15min":1.1359999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71399999999999997,"15min":0.753},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93600000000000005,"5min":0.94799999999999995,"15min":1.1080000000000001},"last":0.64600000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.63900000000000001,"15min":0.63600000000000001},"min":{"1min":0.47499999999999998,"5min":0.439,"15min":0.38500000000000001},"max":{"1min":0.79800000000000004,"5min":0.95499999999999996,"15min":1.0780000000000001},"last":0.70599999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63,"15min":0.64000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":1.579},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48199999999999998,"5min":0.46300000000000002,"15min":0.42399999999999999},"max":{"1min":0.85599999999999998,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.55600000000000005}]},{"osd":7,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66000000000000003,"15min":0.65900000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91800000000000004,"5min":1.0940000000000001,"15min":1.1200000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.36199999999999999},"max":{"1min":0.90400000000000003,"5min":1.0209999999999999,"15min":1.657},"last":0.68899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575090,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50968,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320872,"statfs":{"total":96636764160,"available":96584572928,"internally_reserved":0,"allocated":1916928,"data_stored":975749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68799999999999994,"15min":0.72199999999999998},"min":{"1min":0.45400000000000001,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":2.6699999999999999},"last":1.081},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.46500000000000002,"5min":0.41699999999999998,"15min":0.32800000000000001},"max":{"1min":0.86799999999999999,"5min":1.083,"15min":1.083},"last":1.107}]},{"osd":1,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68899999999999995,"15min":0.71799999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44500000000000001},"max":{"1min":0.93600000000000005,"5min":1.05,"15min":1.079},"last":2.036},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.71499999999999997,"15min":0.73899999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.36799999999999999},"max":{"1min":0.873,"5min":0.94599999999999995,"15min":2.706},"last":0.59799999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70899999999999996,"15min":0.72799999999999998},"min":{"1min":0.41199999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90700000000000003,"5min":1.212,"15min":1.212},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70799999999999996,"15min":0.72699999999999998},"min":{"1min":0.497,"5min":0.44800000000000001,"15min":0.433},"max":{"1min":0.94599999999999995,"5min":1.181,"15min":1.181},"last":2.0790000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72499999999999998,"15min":0.74199999999999999},"min":{"1min":0.53900000000000003,"5min":0.41799999999999998,"15min":0.377},"max":{"1min":0.88600000000000001,"5min":0.95199999999999996,"15min":2.7389999999999999},"last":1.01},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73099999999999998,"15min":0.753},"min":{"1min":0.51600000000000001,"5min":0.47299999999999998,"15min":0.39700000000000002},"max":{"1min":0.94499999999999995,"5min":1.304,"15min":1.304},"last":0.98499999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.628,"15min":0.628},"min":{"1min":0.38500000000000001,"5min":0.38,"15min":0.28599999999999998},"max":{"1min":0.85599999999999998,"5min":1.129,"15min":1.129},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.69099999999999995,"15min":0.68400000000000005},"min":{"1min":0.53700000000000003,"5min":0.39900000000000002,"15min":0.36299999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":2.7719999999999998},"last":0.54800000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60199999999999998,"15min":0.60599999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.32700000000000001},"max":{"1min":0.89700000000000002,"5min":1.169,"15min":1.169},"last":1.2729999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42599999999999999,"5min":0.39400000000000002,"15min":0.34300000000000003},"max":{"1min":0.91000000000000003,"5min":1.238,"15min":1.238},"last":0.84399999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64600000000000002,"15min":0.64300000000000002},"min":{"1min":0.40899999999999997,"5min":0.36899999999999999,"15min":0.32900000000000001},"max":{"1min":0.90800000000000003,"5min":1.026,"15min":3.0230000000000001},"last":1.6000000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68300000000000005,"15min":0.67700000000000005},"min":{"1min":0.49399999999999999,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.98199999999999998,"5min":1.2589999999999999,"15min":1.407},"last":1.6819999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575090,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37004,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334836,"statfs":{"total":96636764160,"available":96598872064,"internally_reserved":0,"allocated":1904640,"data_stored":969101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.70599999999999996,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.411},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.45600000000000002,"5min":0.45100000000000001,"15min":0.435},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.1200000000000001},"last":0.67700000000000005}]},{"osd":1,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71199999999999997,"15min":0.74399999999999999},"min":{"1min":0.496,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84099999999999997,"5min":0.92500000000000004,"15min":1.077},"last":0.88},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70399999999999996,"15min":0.72999999999999998},"min":{"1min":0.52700000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.0469999999999999},"last":0.70299999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.71999999999999997,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.42199999999999999,"15min":0.35199999999999998},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72099999999999997,"15min":0.76400000000000001},"min":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.86699999999999999,"5min":0.98199999999999998,"15min":1.387},"last":1.004}]},{"osd":3,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.49399999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89700000000000002,"5min":0.95399999999999996,"15min":1.008},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.74099999999999999,"15min":0.76600000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46800000000000003},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":1.0289999999999999}]},{"osd":5,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.378},"max":{"1min":0.92200000000000004,"5min":0.92400000000000004,"15min":0.97099999999999997},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.40400000000000003,"15min":0.34599999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":1.1040000000000001}]},{"osd":6,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.014},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67900000000000005,"15min":0.67000000000000004},"min":{"1min":0.48599999999999999,"5min":0.443,"15min":0.374},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.0289999999999999},"last":1.133}]},{"osd":7,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.69899999999999995,"15min":0.67200000000000004},"min":{"1min":0.51300000000000001,"5min":0.502,"15min":0.39000000000000001},"max":{"1min":0.91700000000000004,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.69799999999999995},"min":{"1min":0.48199999999999998,"5min":0.42799999999999999,"15min":0.40300000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":1.1599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575090,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37004,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334836,"statfs":{"total":96636764160,"available":96598872064,"internally_reserved":0,"allocated":1904640,"data_stored":969101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.44400000000000001,"15min":0.44900000000000001},"min":{"1min":0.25600000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.63100000000000001,"5min":0.78600000000000003,"15min":0.84199999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.49299999999999999,"15min":0.51100000000000001},"min":{"1min":0.312,"5min":0.307,"15min":0.307},"max":{"1min":0.66700000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47399999999999998,"15min":0.47999999999999998},"min":{"1min":0.32300000000000001,"5min":0.32000000000000001,"15min":0.315},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.0029999999999999},"last":0.48699999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55800000000000005,"15min":0.57199999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.58299999999999996,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.36799999999999999},"max":{"1min":0.81599999999999995,"5min":0.88100000000000001,"15min":1.663},"last":0.59099999999999997}]},{"osd":4,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.72699999999999998,"15min":0.755},"min":{"1min":0.53000000000000003,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.284},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.52700000000000002,"5min":0.51900000000000002,"15min":0.47699999999999998},"max":{"1min":0.96899999999999997,"5min":1.175,"15min":1.175},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76600000000000001,"15min":0.78700000000000003},"min":{"1min":0.54900000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.05,"5min":1.0629999999999999,"15min":1.306},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.754,"15min":0.78200000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.372},"max":{"1min":1.121,"5min":1.121,"15min":1.2470000000000001},"last":0.85999999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.746,"15min":0.76900000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48099999999999998},"max":{"1min":1.0680000000000001,"5min":1.113,"15min":1.117},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.78700000000000003,"15min":0.81100000000000005},"min":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.54200000000000004},"max":{"1min":1.133,"5min":1.133,"15min":1.2589999999999999},"last":0.77600000000000002}]},{"osd":7,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.78300000000000003,"15min":0.82799999999999996},"min":{"1min":0.58399999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.159,"5min":1.159,"15min":2.4910000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.78100000000000003,"15min":0.81799999999999995},"min":{"1min":0.57599999999999996,"5min":0.53500000000000003,"15min":0.51600000000000001},"max":{"1min":1.0960000000000001,"5min":1.1359999999999999,"15min":1.595},"last":0.83999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575090,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59156,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312684,"statfs":{"total":96636764160,"available":96576188416,"internally_reserved":0,"allocated":1912832,"data_stored":974730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46200000000000002,"15min":0.46400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.80400000000000005,"5min":0.84699999999999998,"15min":1.3169999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.50800000000000001,"15min":0.53300000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67300000000000004,"5min":0.80800000000000005,"15min":2.5270000000000001},"last":0.47399999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.47699999999999998,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.29999999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":2.7200000000000002},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.55700000000000005},"min":{"1min":0.39900000000000002,"5min":0.36299999999999999,"15min":0.35999999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":2.6110000000000002},"last":0.52500000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55100000000000005,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.755,"5min":0.755,"15min":8.2530000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.77000000000000002,"5min":0.89600000000000002,"15min":1.2150000000000001},"last":0.49399999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.73999999999999999,"15min":0.76900000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.48399999999999999},"max":{"1min":0.91100000000000003,"5min":1.0840000000000001,"15min":1.1499999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73999999999999999,"15min":0.78100000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.47999999999999998},"max":{"1min":0.92900000000000005,"5min":1.0629999999999999,"15min":2.3170000000000002},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.79900000000000004,"15min":0.84699999999999998},"min":{"1min":0.58399999999999996,"5min":0.56399999999999995,"15min":0.49399999999999999},"max":{"1min":1.0029999999999999,"5min":1.1319999999999999,"15min":3.1139999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.78900000000000003,"15min":0.83299999999999996},"min":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.55600000000000005},"max":{"1min":1.03,"5min":1.153,"15min":2.6850000000000001},"last":0.81000000000000005}]},{"osd":6,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.73999999999999999,"15min":0.79100000000000004},"min":{"1min":0.52900000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98299999999999998,"5min":1.038,"15min":3.9849999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75900000000000001,"15min":0.80200000000000005},"min":{"1min":0.53900000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":3.391},"last":0.63600000000000001}]},{"osd":7,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.76000000000000001,"15min":0.80900000000000005},"min":{"1min":0.56200000000000006,"5min":0.52300000000000002,"15min":0.5},"max":{"1min":1.022,"5min":1.1759999999999999,"15min":2.5779999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.78200000000000003,"15min":0.81799999999999995},"min":{"1min":0.57099999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.736,"5min":1.736,"15min":2.5939999999999999},"last":0.77200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575091,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37016,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334824,"statfs":{"total":96636764160,"available":96598859776,"internally_reserved":0,"allocated":1916928,"data_stored":975749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42899999999999999,"15min":0.432},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26100000000000001},"max":{"1min":0.56000000000000005,"5min":0.65400000000000003,"15min":0.77200000000000002},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.34999999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.74399999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.39600000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.35899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.63700000000000001,"5min":0.69199999999999995,"15min":1.0409999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.51700000000000002},"min":{"1min":0.32100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73199999999999998,"5min":0.77900000000000003,"15min":1.014},"last":0.36099999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60799999999999998,"15min":0.628},"min":{"1min":0.502,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.746,"5min":0.80300000000000005,"15min":0.96299999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55300000000000005,"15min":0.57099999999999995},"min":{"1min":0.41299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69899999999999995,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.47199999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76400000000000001,"15min":0.78300000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48899999999999999},"max":{"1min":1.155,"5min":1.2110000000000001,"15min":1.236},"last":0.503},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79000000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0640000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.55800000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77700000000000002,"15min":0.78500000000000003},"min":{"1min":0.56000000000000005,"5min":0.52500000000000002,"15min":0.45200000000000001},"max":{"1min":1.1020000000000001,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.79600000000000004,"15min":0.80300000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.48599999999999999},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.54600000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.55900000000000005,"5min":0.53800000000000003,"15min":0.503},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.2170000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79900000000000004,"15min":0.81799999999999995},"min":{"1min":0.53700000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.60499999999999998}]},{"osd":7,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.58499999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82699999999999996,"15min":0.84199999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.65300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575092,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41688,"kb_used_data":2448,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330152,"statfs":{"total":96636764160,"available":96594075648,"internally_reserved":0,"allocated":2506752,"data_stored":1565098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.27300000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.59199999999999997,"5min":0.79600000000000004,"15min":2.2450000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.48299999999999998,"15min":0.50800000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27700000000000002},"max":{"1min":0.72999999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.33300000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.504,"15min":0.51400000000000001},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68200000000000005,"5min":0.84499999999999997,"15min":2.2989999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52800000000000002,"15min":0.54700000000000004},"min":{"1min":0.39100000000000001,"5min":0.34899999999999998,"15min":0.29899999999999999},"max":{"1min":0.71199999999999997,"5min":0.83599999999999997,"15min":0.90300000000000002},"last":0.379}]},{"osd":3,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.505,"15min":0.505},"min":{"1min":0.35199999999999998,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.84999999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57799999999999996,"15min":0.58999999999999997},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76600000000000001,"5min":0.92700000000000005,"15min":2.4100000000000001},"last":0.51100000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74399999999999999,"15min":0.77800000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1220000000000001,"5min":1.21,"15min":1.3640000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.75700000000000001,"15min":0.79300000000000004},"min":{"1min":0.57599999999999996,"5min":0.53500000000000003,"15min":0.44900000000000001},"max":{"1min":1.0289999999999999,"5min":1.0589999999999999,"15min":2.4460000000000002},"last":0.58099999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75600000000000001,"15min":0.79400000000000004},"min":{"1min":0.62,"5min":0.54200000000000004,"15min":0.47899999999999998},"max":{"1min":1.044,"5min":1.0669999999999999,"15min":1.3839999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.59399999999999997,"5min":0.5,"15min":0.48399999999999999},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.325},"last":0.74299999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77100000000000002,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.147,"5min":1.147,"15min":2.3380000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.755,"15min":0.79900000000000004},"min":{"1min":0.55600000000000005,"5min":0.51000000000000001,"15min":0.50600000000000001},"max":{"1min":0.97899999999999998,"5min":1.0900000000000001,"15min":1.3440000000000001},"last":0.61299999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76300000000000001,"15min":0.81599999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.503},"max":{"1min":1.016,"5min":1.1180000000000001,"15min":1.2749999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.77200000000000002,"15min":0.80500000000000005},"min":{"1min":0.56000000000000005,"5min":0.50600000000000001,"15min":0.502},"max":{"1min":1.077,"5min":1.0880000000000001,"15min":1.381},"last":0.76200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:13:08.403 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:13:08.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.544+0000 7fe68d500640 1 Processor -- start 2023-07-14T13:13:08.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.544+0000 7fe68d500640 1 -- start start 2023-07-14T13:13:08.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.544+0000 7fe68d500640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe68806b1e0 0x7fe6880c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:08.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.544+0000 7fe68d500640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe6880c21f0 0x7fe6880cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:08.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.544+0000 7fe68d500640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6880cac70 con 0x7fe688070b70 2023-07-14T13:13:08.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.544+0000 7fe68d500640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6880ca060 con 0x7fe6880c21f0 2023-07-14T13:13:08.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.544+0000 7fe68d500640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6880ca340 con 0x7fe68806b1e0 2023-07-14T13:13:08.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.548+0000 7fe6877fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe6880c21f0 0x7fe6880cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:08.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.548+0000 7fe6877fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe6880c21f0 0x7fe6880cb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60426/0 (socket says 172.21.15.5:60426) 2023-07-14T13:13:08.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.548+0000 7fe6877fe640 1 -- 172.21.15.5:0/3666313438 learned_addr learned my addr 172.21.15.5:0/3666313438 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:08.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.548+0000 7fe67ffff640 1 --2- 172.21.15.5:0/3666313438 >> v2:172.21.15.154:3300/0 conn(0x7fe68806b1e0 0x7fe6880c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:08.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.548+0000 7fe6877fe640 1 -- 172.21.15.5:0/3666313438 >> v2:172.21.15.154:3300/0 conn(0x7fe68806b1e0 msgr2=0x7fe6880c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:08.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.548+0000 7fe6877fe640 1 --2- 172.21.15.5:0/3666313438 >> v2:172.21.15.154:3300/0 conn(0x7fe68806b1e0 0x7fe6880c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:08.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.548+0000 7fe6877fe640 1 -- 172.21.15.5:0/3666313438 >> v1:172.21.15.154:6789/0 conn(0x7fe688070b70 legacy=0x7fe688070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:08.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.548+0000 7fe6877fe640 1 -- 172.21.15.5:0/3666313438 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6880ca620 con 0x7fe6880c21f0 2023-07-14T13:13:08.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.548+0000 7fe6877fe640 1 --2- 172.21.15.5:0/3666313438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6880c21f0 0x7fe6880cb100 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fe68806f380 tx=0x7fe68001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57626d64a06f6cc8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:08.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.548+0000 7fe6867fc640 1 -- 172.21.15.5:0/3666313438 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6800a5880 con 0x7fe6880c21f0 2023-07-14T13:13:08.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.548+0000 7fe6867fc640 1 -- 172.21.15.5:0/3666313438 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6800a59e0 con 0x7fe6880c21f0 2023-07-14T13:13:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.548+0000 7fe6867fc640 1 -- 172.21.15.5:0/3666313438 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6800a5d70 con 0x7fe6880c21f0 2023-07-14T13:13:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.552+0000 7fe68d500640 1 -- 172.21.15.5:0/3666313438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6880c21f0 msgr2=0x7fe6880cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.552+0000 7fe68d500640 1 --2- 172.21.15.5:0/3666313438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6880c21f0 0x7fe6880cb100 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fe68806f380 tx=0x7fe68001c9a0 comp rx=0 tx=0).stop 2023-07-14T13:13:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.552+0000 7fe68d500640 1 -- 172.21.15.5:0/3666313438 shutdown_connections 2023-07-14T13:13:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.552+0000 7fe68d500640 1 --2- 172.21.15.5:0/3666313438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6880c21f0 0x7fe6880cb100 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.552+0000 7fe68d500640 1 --2- 172.21.15.5:0/3666313438 >> v2:172.21.15.154:3300/0 conn(0x7fe68806b1e0 0x7fe6880c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:08.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.552+0000 7fe68d500640 1 -- 172.21.15.5:0/3666313438 >> 172.21.15.5:0/3666313438 conn(0x7fe6880afcf0 msgr2=0x7fe6880b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:08.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.552+0000 7fe68d500640 1 -- 172.21.15.5:0/3666313438 shutdown_connections 2023-07-14T13:13:08.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.552+0000 7fe68d500640 1 -- 172.21.15.5:0/3666313438 wait complete. 2023-07-14T13:13:08.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.552+0000 7fe68d500640 1 Processor -- start 2023-07-14T13:13:08.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.552+0000 7fe68d500640 1 -- start start 2023-07-14T13:13:08.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.552+0000 7fe68d500640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe68806b1e0 0x7fe68814b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:08.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.552+0000 7fe68d500640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe688070b70 0x7fe68814b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:08.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.552+0000 7fe68d500640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6880c21f0 0x7fe68814df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:08.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.552+0000 7fe68d500640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe688155ce0 con 0x7fe68806b1e0 2023-07-14T13:13:08.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.552+0000 7fe68d500640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68814bdc0 con 0x7fe688070b70 2023-07-14T13:13:08.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.552+0000 7fe68d500640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68814c2e0 con 0x7fe6880c21f0 2023-07-14T13:13:08.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.552+0000 7fe686ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe68806b1e0 0x7fe68814b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:08.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.552+0000 7fe686ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe68806b1e0 0x7fe68814b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60428/0 (socket says 172.21.15.5:60428) 2023-07-14T13:13:08.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.552+0000 7fe686ffd640 1 -- 172.21.15.5:0/1214506574 learned_addr learned my addr 172.21.15.5:0/1214506574 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:08.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.552+0000 7fe6877fe640 1 --2- 172.21.15.5:0/1214506574 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6880c21f0 0x7fe68814df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:08.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.552+0000 7fe67ffff640 1 --2- 172.21.15.5:0/1214506574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe688070b70 0x7fe68814b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:08.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.552+0000 7fe686ffd640 1 -- 172.21.15.5:0/1214506574 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6880c21f0 msgr2=0x7fe68814df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:08.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.552+0000 7fe686ffd640 1 --2- 172.21.15.5:0/1214506574 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6880c21f0 0x7fe68814df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:08.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.552+0000 7fe686ffd640 1 -- 172.21.15.5:0/1214506574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe688070b70 msgr2=0x7fe68814b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:08.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.552+0000 7fe686ffd640 1 --2- 172.21.15.5:0/1214506574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe688070b70 0x7fe68814b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:08.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.552+0000 7fe686ffd640 1 -- 172.21.15.5:0/1214506574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe680009b30 con 0x7fe68806b1e0 2023-07-14T13:13:08.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.552+0000 7fe67ffff640 1 --2- 172.21.15.5:0/1214506574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe688070b70 0x7fe68814b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:13:08.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.556+0000 7fe686ffd640 1 --2- 172.21.15.5:0/1214506574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe68806b1e0 0x7fe68814b880 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fe67800c500 tx=0x7fe67800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:08.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.556+0000 7fe67f7fe640 1 -- 172.21.15.5:0/1214506574 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe678005220 con 0x7fe68806b1e0 2023-07-14T13:13:08.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.556+0000 7fe67f7fe640 1 -- 172.21.15.5:0/1214506574 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe678005380 con 0x7fe68806b1e0 2023-07-14T13:13:08.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.556+0000 7fe67f7fe640 1 -- 172.21.15.5:0/1214506574 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe678007270 con 0x7fe68806b1e0 2023-07-14T13:13:08.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.556+0000 7fe68d500640 1 -- 172.21.15.5:0/1214506574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe68814c5c0 con 0x7fe68806b1e0 2023-07-14T13:13:08.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.556+0000 7fe68d500640 1 -- 172.21.15.5:0/1214506574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe688155900 con 0x7fe68806b1e0 2023-07-14T13:13:08.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.556+0000 7fe68d500640 1 -- 172.21.15.5:0/1214506574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe688155e20 con 0x7fe68806b1e0 2023-07-14T13:13:08.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.556+0000 7fe67f7fe640 1 -- 172.21.15.5:0/1214506574 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe6780073d0 con 0x7fe68806b1e0 2023-07-14T13:13:08.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.556+0000 7fe67f7fe640 1 --2- 172.21.15.5:0/1214506574 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fe6680663a0 0x7fe668068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:08.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.556+0000 7fe67f7fe640 1 -- 172.21.15.5:0/1214506574 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fe678083790 con 0x7fe68806b1e0 2023-07-14T13:13:08.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.556+0000 7fe67ffff640 1 --2- 172.21.15.5:0/1214506574 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fe6680663a0 0x7fe668068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:08.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.560+0000 7fe67ffff640 1 --2- 172.21.15.5:0/1214506574 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fe6680663a0 0x7fe668068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe6880cb590 tx=0x7fe670008040 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:08.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.560+0000 7fe67f7fe640 1 -- 172.21.15.5:0/1214506574 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe688155e20 con 0x7fe68806b1e0 2023-07-14T13:13:08.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.716+0000 7fe68d500640 1 -- 172.21.15.5:0/1214506574 --> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe6880c9cf0 con 0x7fe6680663a0 2023-07-14T13:13:08.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.724+0000 7fe67f7fe640 1 -- 172.21.15.5:0/1214506574 <== mgr.7604 v2:172.21.15.154:6832/1443161386 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306124 (secure 0 0 0) 0x7fe670011a10 con 0x7fe6680663a0 2023-07-14T13:13:08.763 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:13:08.764 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:13:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.728+0000 7fe68d500640 1 -- 172.21.15.5:0/1214506574 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fe6680663a0 msgr2=0x7fe668068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.728+0000 7fe68d500640 1 --2- 172.21.15.5:0/1214506574 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fe6680663a0 0x7fe668068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe6880cb590 tx=0x7fe670008040 comp rx=0 tx=0).stop 2023-07-14T13:13:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.728+0000 7fe68d500640 1 -- 172.21.15.5:0/1214506574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe68806b1e0 msgr2=0x7fe68814b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.728+0000 7fe68d500640 1 --2- 172.21.15.5:0/1214506574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe68806b1e0 0x7fe68814b880 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fe67800c500 tx=0x7fe67800c9c0 comp rx=0 tx=0).stop 2023-07-14T13:13:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.728+0000 7fe68d500640 1 -- 172.21.15.5:0/1214506574 shutdown_connections 2023-07-14T13:13:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.728+0000 7fe68d500640 1 --2- 172.21.15.5:0/1214506574 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fe6680663a0 0x7fe668068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.728+0000 7fe68d500640 1 --2- 172.21.15.5:0/1214506574 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6880c21f0 0x7fe68814df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:08.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.728+0000 7fe68d500640 1 --2- 172.21.15.5:0/1214506574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe688070b70 0x7fe68814b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:08.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.728+0000 7fe68d500640 1 --2- 172.21.15.5:0/1214506574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe68806b1e0 0x7fe68814b880 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:08.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.728+0000 7fe68d500640 1 -- 172.21.15.5:0/1214506574 >> 172.21.15.5:0/1214506574 conn(0x7fe6880afcf0 msgr2=0x7fe6880cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:08.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.728+0000 7fe68d500640 1 -- 172.21.15.5:0/1214506574 shutdown_connections 2023-07-14T13:13:08.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.728+0000 7fe68d500640 1 -- 172.21.15.5:0/1214506574 wait complete. 2023-07-14T13:13:08.784 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-14T13:13:07.392443+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":355484,"kb_used_data":16092,"kb_used_omap":0,"kb_used_meta":339328,"kb_avail":754619236,"statfs":{"total":773094113280,"available":772730097664,"internally_reserved":0,"allocated":16478208,"data_stored":8964746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":347471872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.552142"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.849702+0000","last_change":"2023-07-14T13:13:02.849702+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.849702+0000","last_undegraded":"2023-07-14T13:13:02.849702+0000","last_fullsized":"2023-07-14T13:13:02.849702+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.861742+0000","last_change":"2023-07-14T13:13:02.861742+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.861742+0000","last_undegraded":"2023-07-14T13:13:02.861742+0000","last_fullsized":"2023-07-14T13:13:02.861742+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.856128+0000","last_change":"2023-07-14T13:13:02.856128+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.856128+0000","last_undegraded":"2023-07-14T13:13:02.856128+0000","last_fullsized":"2023-07-14T13:13:02.856128+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.858190+0000","last_change":"2023-07-14T13:13:02.858190+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.858190+0000","last_undegraded":"2023-07-14T13:13:02.858190+0000","last_fullsized":"2023-07-14T13:13:02.858190+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.850808+0000","last_change":"2023-07-14T13:13:02.850808+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.850808+0000","last_undegraded":"2023-07-14T13:13:02.850808+0000","last_fullsized":"2023-07-14T13:13:02.850808+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.850055+0000","last_change":"2023-07-14T13:13:02.850055+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.850055+0000","last_undegraded":"2023-07-14T13:13:02.850055+0000","last_fullsized":"2023-07-14T13:13:02.850055+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.856317+0000","last_change":"2023-07-14T13:13:02.856317+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.856317+0000","last_undegraded":"2023-07-14T13:13:02.856317+0000","last_fullsized":"2023-07-14T13:13:02.856317+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.853552+0000","last_change":"2023-07-14T13:13:02.853552+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.853552+0000","last_undegraded":"2023-07-14T13:13:02.853552+0000","last_fullsized":"2023-07-14T13:13:02.853552+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.851575+0000","last_change":"2023-07-14T13:13:02.851575+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.851575+0000","last_undegraded":"2023-07-14T13:13:02.851575+0000","last_fullsized":"2023-07-14T13:13:02.851575+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.847249+0000","last_change":"2023-07-14T13:13:02.847249+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.847249+0000","last_undegraded":"2023-07-14T13:13:02.847249+0000","last_fullsized":"2023-07-14T13:13:02.847249+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.858717+0000","last_change":"2023-07-14T13:13:02.858717+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.858717+0000","last_undegraded":"2023-07-14T13:13:02.858717+0000","last_fullsized":"2023-07-14T13:13:02.858717+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.848547+0000","last_change":"2023-07-14T13:13:02.848547+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.848547+0000","last_undegraded":"2023-07-14T13:13:02.848547+0000","last_fullsized":"2023-07-14T13:13:02.848547+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.850700+0000","last_change":"2023-07-14T13:13:02.850700+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.850700+0000","last_undegraded":"2023-07-14T13:13:02.850700+0000","last_fullsized":"2023-07-14T13:13:02.850700+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.849830+0000","last_change":"2023-07-14T13:13:02.849830+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.849830+0000","last_undegraded":"2023-07-14T13:13:02.849830+0000","last_fullsized":"2023-07-14T13:13:02.849830+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.849124+0000","last_change":"2023-07-14T13:13:02.849124+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.849124+0000","last_undegraded":"2023-07-14T13:13:02.849124+0000","last_fullsized":"2023-07-14T13:13:02.849124+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.853108+0000","last_change":"2023-07-14T13:13:02.853108+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.853108+0000","last_undegraded":"2023-07-14T13:13:02.853108+0000","last_fullsized":"2023-07-14T13:13:02.853108+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.851143+0000","last_change":"2023-07-14T13:13:02.851143+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.851143+0000","last_undegraded":"2023-07-14T13:13:02.851143+0000","last_fullsized":"2023-07-14T13:13:02.851143+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.848625+0000","last_change":"2023-07-14T13:13:02.848625+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.848625+0000","last_undegraded":"2023-07-14T13:13:02.848625+0000","last_fullsized":"2023-07-14T13:13:02.848625+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.858202+0000","last_change":"2023-07-14T13:13:02.858202+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.858202+0000","last_undegraded":"2023-07-14T13:13:02.858202+0000","last_fullsized":"2023-07-14T13:13:02.858202+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.849602+0000","last_change":"2023-07-14T13:13:02.849602+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.849602+0000","last_undegraded":"2023-07-14T13:13:02.849602+0000","last_fullsized":"2023-07-14T13:13:02.849602+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.857664+0000","last_change":"2023-07-14T13:13:02.857664+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.857664+0000","last_undegraded":"2023-07-14T13:13:02.857664+0000","last_fullsized":"2023-07-14T13:13:02.857664+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.850309+0000","last_change":"2023-07-14T13:13:02.850309+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.850309+0000","last_undegraded":"2023-07-14T13:13:02.850309+0000","last_fullsized":"2023-07-14T13:13:02.850309+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.857728+0000","last_change":"2023-07-14T13:13:02.857728+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.857728+0000","last_undegraded":"2023-07-14T13:13:02.857728+0000","last_fullsized":"2023-07-14T13:13:02.857728+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.852651+0000","last_change":"2023-07-14T13:13:02.852651+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.852651+0000","last_undegraded":"2023-07-14T13:13:02.852651+0000","last_fullsized":"2023-07-14T13:13:02.852651+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.855048+0000","last_change":"2023-07-14T13:13:02.855048+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.855048+0000","last_undegraded":"2023-07-14T13:13:02.855048+0000","last_fullsized":"2023-07-14T13:13:02.855048+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.858641+0000","last_change":"2023-07-14T13:13:02.858641+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.858641+0000","last_undegraded":"2023-07-14T13:13:02.858641+0000","last_fullsized":"2023-07-14T13:13:02.858641+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.857754+0000","last_change":"2023-07-14T13:13:02.857754+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.857754+0000","last_undegraded":"2023-07-14T13:13:02.857754+0000","last_fullsized":"2023-07-14T13:13:02.857754+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.846958+0000","last_change":"2023-07-14T13:13:02.846958+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.846958+0000","last_undegraded":"2023-07-14T13:13:02.846958+0000","last_fullsized":"2023-07-14T13:13:02.846958+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.857735+0000","last_change":"2023-07-14T13:13:02.857735+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.857735+0000","last_undegraded":"2023-07-14T13:13:02.857735+0000","last_fullsized":"2023-07-14T13:13:02.857735+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.855125+0000","last_change":"2023-07-14T13:13:02.855125+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.855125+0000","last_undegraded":"2023-07-14T13:13:02.855125+0000","last_fullsized":"2023-07-14T13:13:02.855125+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.852437+0000","last_change":"2023-07-14T13:13:02.852437+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.852437+0000","last_undegraded":"2023-07-14T13:13:02.852437+0000","last_fullsized":"2023-07-14T13:13:02.852437+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.846335+0000","last_change":"2023-07-14T13:13:02.846335+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.846335+0000","last_undegraded":"2023-07-14T13:13:02.846335+0000","last_fullsized":"2023-07-14T13:13:02.846335+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.851446+0000","last_change":"2023-07-14T13:13:02.851446+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.851446+0000","last_undegraded":"2023-07-14T13:13:02.851446+0000","last_fullsized":"2023-07-14T13:13:02.851446+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.872286+0000","last_change":"2023-07-14T13:13:02.868993+0000","last_active":"2023-07-14T13:13:02.872286+0000","last_peered":"2023-07-14T13:13:02.872286+0000","last_clean":"2023-07-14T13:13:02.872286+0000","last_became_active":"2023-07-14T13:13:02.868694+0000","last_became_peered":"2023-07-14T13:13:02.868694+0000","last_unstale":"2023-07-14T13:13:02.872286+0000","last_undegraded":"2023-07-14T13:13:02.872286+0000","last_fullsized":"2023-07-14T13:13:02.872286+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:53:35.355464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.848613+0000","last_change":"2023-07-14T13:13:02.848613+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.848613+0000","last_undegraded":"2023-07-14T13:13:02.848613+0000","last_fullsized":"2023-07-14T13:13:02.848613+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.867448+0000","last_change":"2023-07-14T13:13:02.865527+0000","last_active":"2023-07-14T13:13:02.867448+0000","last_peered":"2023-07-14T13:13:02.867448+0000","last_clean":"2023-07-14T13:13:02.867448+0000","last_became_active":"2023-07-14T13:13:02.865167+0000","last_became_peered":"2023-07-14T13:13:02.865167+0000","last_unstale":"2023-07-14T13:13:02.867448+0000","last_undegraded":"2023-07-14T13:13:02.867448+0000","last_fullsized":"2023-07-14T13:13:02.867448+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:36:44.671952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.859386+0000","last_change":"2023-07-14T13:13:02.859386+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.859386+0000","last_undegraded":"2023-07-14T13:13:02.859386+0000","last_fullsized":"2023-07-14T13:13:02.859386+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.875295+0000","last_change":"2023-07-14T13:13:02.869637+0000","last_active":"2023-07-14T13:13:02.875295+0000","last_peered":"2023-07-14T13:13:02.875295+0000","last_clean":"2023-07-14T13:13:02.875295+0000","last_became_active":"2023-07-14T13:13:02.867864+0000","last_became_peered":"2023-07-14T13:13:02.867864+0000","last_unstale":"2023-07-14T13:13:02.875295+0000","last_undegraded":"2023-07-14T13:13:02.875295+0000","last_fullsized":"2023-07-14T13:13:02.875295+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:19:08.077344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.850910+0000","last_change":"2023-07-14T13:13:02.850910+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.850910+0000","last_undegraded":"2023-07-14T13:13:02.850910+0000","last_fullsized":"2023-07-14T13:13:02.850910+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.875422+0000","last_change":"2023-07-14T13:13:02.873106+0000","last_active":"2023-07-14T13:13:02.875422+0000","last_peered":"2023-07-14T13:13:02.875422+0000","last_clean":"2023-07-14T13:13:02.875422+0000","last_became_active":"2023-07-14T13:13:02.872783+0000","last_became_peered":"2023-07-14T13:13:02.872783+0000","last_unstale":"2023-07-14T13:13:02.875422+0000","last_undegraded":"2023-07-14T13:13:02.875422+0000","last_fullsized":"2023-07-14T13:13:02.875422+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:18:17.154686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.851433+0000","last_change":"2023-07-14T13:13:02.851433+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.851433+0000","last_undegraded":"2023-07-14T13:13:02.851433+0000","last_fullsized":"2023-07-14T13:13:02.851433+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.872343+0000","last_change":"2023-07-14T13:13:02.864266+0000","last_active":"2023-07-14T13:13:02.872343+0000","last_peered":"2023-07-14T13:13:02.872343+0000","last_clean":"2023-07-14T13:13:02.872343+0000","last_became_active":"2023-07-14T13:13:02.863987+0000","last_became_peered":"2023-07-14T13:13:02.863987+0000","last_unstale":"2023-07-14T13:13:02.872343+0000","last_undegraded":"2023-07-14T13:13:02.872343+0000","last_fullsized":"2023-07-14T13:13:02.872343+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:30:54.387176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.852729+0000","last_change":"2023-07-14T13:13:02.852729+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.852729+0000","last_undegraded":"2023-07-14T13:13:02.852729+0000","last_fullsized":"2023-07-14T13:13:02.852729+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.864947+0000","last_change":"2023-07-14T13:13:02.859614+0000","last_active":"2023-07-14T13:13:02.864947+0000","last_peered":"2023-07-14T13:13:02.864947+0000","last_clean":"2023-07-14T13:13:02.864947+0000","last_became_active":"2023-07-14T13:13:02.859348+0000","last_became_peered":"2023-07-14T13:13:02.859348+0000","last_unstale":"2023-07-14T13:13:02.864947+0000","last_undegraded":"2023-07-14T13:13:02.864947+0000","last_fullsized":"2023-07-14T13:13:02.864947+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:28:06.934465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.848145+0000","last_change":"2023-07-14T13:13:02.848145+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.848145+0000","last_undegraded":"2023-07-14T13:13:02.848145+0000","last_fullsized":"2023-07-14T13:13:02.848145+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.864200+0000","last_change":"2023-07-14T13:13:02.860411+0000","last_active":"2023-07-14T13:13:02.864200+0000","last_peered":"2023-07-14T13:13:02.864200+0000","last_clean":"2023-07-14T13:13:02.864200+0000","last_became_active":"2023-07-14T13:13:02.860127+0000","last_became_peered":"2023-07-14T13:13:02.860127+0000","last_unstale":"2023-07-14T13:13:02.864200+0000","last_undegraded":"2023-07-14T13:13:02.864200+0000","last_fullsized":"2023-07-14T13:13:02.864200+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:25:09.510581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.856377+0000","last_change":"2023-07-14T13:13:02.856377+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.856377+0000","last_undegraded":"2023-07-14T13:13:02.856377+0000","last_fullsized":"2023-07-14T13:13:02.856377+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.873554+0000","last_change":"2023-07-14T13:13:02.870024+0000","last_active":"2023-07-14T13:13:02.873554+0000","last_peered":"2023-07-14T13:13:02.873554+0000","last_clean":"2023-07-14T13:13:02.873554+0000","last_became_active":"2023-07-14T13:13:02.869711+0000","last_became_peered":"2023-07-14T13:13:02.869711+0000","last_unstale":"2023-07-14T13:13:02.873554+0000","last_undegraded":"2023-07-14T13:13:02.873554+0000","last_fullsized":"2023-07-14T13:13:02.873554+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:13:33.557920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.856673+0000","last_change":"2023-07-14T13:13:02.856673+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.856673+0000","last_undegraded":"2023-07-14T13:13:02.856673+0000","last_fullsized":"2023-07-14T13:13:02.856673+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.869317+0000","last_change":"2023-07-14T13:13:02.866258+0000","last_active":"2023-07-14T13:13:02.869317+0000","last_peered":"2023-07-14T13:13:02.869317+0000","last_clean":"2023-07-14T13:13:02.869317+0000","last_became_active":"2023-07-14T13:13:02.865982+0000","last_became_peered":"2023-07-14T13:13:02.865982+0000","last_unstale":"2023-07-14T13:13:02.869317+0000","last_undegraded":"2023-07-14T13:13:02.869317+0000","last_fullsized":"2023-07-14T13:13:02.869317+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:37.388068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.855785+0000","last_change":"2023-07-14T13:13:02.855785+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.855785+0000","last_undegraded":"2023-07-14T13:13:02.855785+0000","last_fullsized":"2023-07-14T13:13:02.855785+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.872246+0000","last_change":"2023-07-14T13:13:02.868862+0000","last_active":"2023-07-14T13:13:02.872246+0000","last_peered":"2023-07-14T13:13:02.872246+0000","last_clean":"2023-07-14T13:13:02.872246+0000","last_became_active":"2023-07-14T13:13:02.868554+0000","last_became_peered":"2023-07-14T13:13:02.868554+0000","last_unstale":"2023-07-14T13:13:02.872246+0000","last_undegraded":"2023-07-14T13:13:02.872246+0000","last_fullsized":"2023-07-14T13:13:02.872246+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:15:28.838577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.856936+0000","last_change":"2023-07-14T13:13:02.856936+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.856936+0000","last_undegraded":"2023-07-14T13:13:02.856936+0000","last_fullsized":"2023-07-14T13:13:02.856936+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.864245+0000","last_change":"2023-07-14T13:13:02.859151+0000","last_active":"2023-07-14T13:13:02.864245+0000","last_peered":"2023-07-14T13:13:02.864245+0000","last_clean":"2023-07-14T13:13:02.864245+0000","last_became_active":"2023-07-14T13:13:02.858878+0000","last_became_peered":"2023-07-14T13:13:02.858878+0000","last_unstale":"2023-07-14T13:13:02.864245+0000","last_undegraded":"2023-07-14T13:13:02.864245+0000","last_fullsized":"2023-07-14T13:13:02.864245+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:00.465195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.847342+0000","last_change":"2023-07-14T13:13:02.847342+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.847342+0000","last_undegraded":"2023-07-14T13:13:02.847342+0000","last_fullsized":"2023-07-14T13:13:02.847342+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.865960+0000","last_change":"2023-07-14T13:13:02.863173+0000","last_active":"2023-07-14T13:13:02.865960+0000","last_peered":"2023-07-14T13:13:02.865960+0000","last_clean":"2023-07-14T13:13:02.865960+0000","last_became_active":"2023-07-14T13:13:02.862902+0000","last_became_peered":"2023-07-14T13:13:02.862902+0000","last_unstale":"2023-07-14T13:13:02.865960+0000","last_undegraded":"2023-07-14T13:13:02.865960+0000","last_fullsized":"2023-07-14T13:13:02.865960+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:58:06.564871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.849137+0000","last_change":"2023-07-14T13:13:02.849137+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.849137+0000","last_undegraded":"2023-07-14T13:13:02.849137+0000","last_fullsized":"2023-07-14T13:13:02.849137+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.875022+0000","last_change":"2023-07-14T13:13:02.869185+0000","last_active":"2023-07-14T13:13:02.875022+0000","last_peered":"2023-07-14T13:13:02.875022+0000","last_clean":"2023-07-14T13:13:02.875022+0000","last_became_active":"2023-07-14T13:13:02.868925+0000","last_became_peered":"2023-07-14T13:13:02.868925+0000","last_unstale":"2023-07-14T13:13:02.875022+0000","last_undegraded":"2023-07-14T13:13:02.875022+0000","last_fullsized":"2023-07-14T13:13:02.875022+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:59:49.792863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.848430+0000","last_change":"2023-07-14T13:13:02.848430+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.848430+0000","last_undegraded":"2023-07-14T13:13:02.848430+0000","last_fullsized":"2023-07-14T13:13:02.848430+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.866556+0000","last_change":"2023-07-14T13:13:02.862781+0000","last_active":"2023-07-14T13:13:02.866556+0000","last_peered":"2023-07-14T13:13:02.866556+0000","last_clean":"2023-07-14T13:13:02.866556+0000","last_became_active":"2023-07-14T13:13:02.862518+0000","last_became_peered":"2023-07-14T13:13:02.862518+0000","last_unstale":"2023-07-14T13:13:02.866556+0000","last_undegraded":"2023-07-14T13:13:02.866556+0000","last_fullsized":"2023-07-14T13:13:02.866556+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:01:48.243729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.847246+0000","last_change":"2023-07-14T13:13:02.847246+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.847246+0000","last_undegraded":"2023-07-14T13:13:02.847246+0000","last_fullsized":"2023-07-14T13:13:02.847246+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.875379+0000","last_change":"2023-07-14T13:13:02.870693+0000","last_active":"2023-07-14T13:13:02.875379+0000","last_peered":"2023-07-14T13:13:02.875379+0000","last_clean":"2023-07-14T13:13:02.875379+0000","last_became_active":"2023-07-14T13:13:02.870369+0000","last_became_peered":"2023-07-14T13:13:02.870369+0000","last_unstale":"2023-07-14T13:13:02.875379+0000","last_undegraded":"2023-07-14T13:13:02.875379+0000","last_fullsized":"2023-07-14T13:13:02.875379+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:37:55.269264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.859982+0000","last_change":"2023-07-14T13:13:02.859982+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.859982+0000","last_undegraded":"2023-07-14T13:13:02.859982+0000","last_fullsized":"2023-07-14T13:13:02.859982+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.864210+0000","last_change":"2023-07-14T13:13:02.860174+0000","last_active":"2023-07-14T13:13:02.864210+0000","last_peered":"2023-07-14T13:13:02.864210+0000","last_clean":"2023-07-14T13:13:02.864210+0000","last_became_active":"2023-07-14T13:13:02.859857+0000","last_became_peered":"2023-07-14T13:13:02.859857+0000","last_unstale":"2023-07-14T13:13:02.864210+0000","last_undegraded":"2023-07-14T13:13:02.864210+0000","last_fullsized":"2023-07-14T13:13:02.864210+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:24.219405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.847343+0000","last_change":"2023-07-14T13:13:02.847343+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.847343+0000","last_undegraded":"2023-07-14T13:13:02.847343+0000","last_fullsized":"2023-07-14T13:13:02.847343+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.869509+0000","last_change":"2023-07-14T13:13:02.868617+0000","last_active":"2023-07-14T13:13:02.869509+0000","last_peered":"2023-07-14T13:13:02.869509+0000","last_clean":"2023-07-14T13:13:02.869509+0000","last_became_active":"2023-07-14T13:13:02.868316+0000","last_became_peered":"2023-07-14T13:13:02.868316+0000","last_unstale":"2023-07-14T13:13:02.869509+0000","last_undegraded":"2023-07-14T13:13:02.869509+0000","last_fullsized":"2023-07-14T13:13:02.869509+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:06:31.006923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.854870+0000","last_change":"2023-07-14T13:13:02.854870+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.854870+0000","last_undegraded":"2023-07-14T13:13:02.854870+0000","last_fullsized":"2023-07-14T13:13:02.854870+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.874975+0000","last_change":"2023-07-14T13:13:02.868072+0000","last_active":"2023-07-14T13:13:02.874975+0000","last_peered":"2023-07-14T13:13:02.874975+0000","last_clean":"2023-07-14T13:13:02.874975+0000","last_became_active":"2023-07-14T13:13:02.867703+0000","last_became_peered":"2023-07-14T13:13:02.867703+0000","last_unstale":"2023-07-14T13:13:02.874975+0000","last_undegraded":"2023-07-14T13:13:02.874975+0000","last_fullsized":"2023-07-14T13:13:02.874975+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:57:21.237766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.857490+0000","last_change":"2023-07-14T13:13:02.857490+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.857490+0000","last_undegraded":"2023-07-14T13:13:02.857490+0000","last_fullsized":"2023-07-14T13:13:02.857490+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.865455+0000","last_change":"2023-07-14T13:13:02.862857+0000","last_active":"2023-07-14T13:13:02.865455+0000","last_peered":"2023-07-14T13:13:02.865455+0000","last_clean":"2023-07-14T13:13:02.865455+0000","last_became_active":"2023-07-14T13:13:02.862567+0000","last_became_peered":"2023-07-14T13:13:02.862567+0000","last_unstale":"2023-07-14T13:13:02.865455+0000","last_undegraded":"2023-07-14T13:13:02.865455+0000","last_fullsized":"2023-07-14T13:13:02.865455+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:19:26.447864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.846833+0000","last_change":"2023-07-14T13:13:02.846833+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.846833+0000","last_undegraded":"2023-07-14T13:13:02.846833+0000","last_fullsized":"2023-07-14T13:13:02.846833+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.864271+0000","last_change":"2023-07-14T13:13:02.861021+0000","last_active":"2023-07-14T13:13:02.864271+0000","last_peered":"2023-07-14T13:13:02.864271+0000","last_clean":"2023-07-14T13:13:02.864271+0000","last_became_active":"2023-07-14T13:13:02.860774+0000","last_became_peered":"2023-07-14T13:13:02.860774+0000","last_unstale":"2023-07-14T13:13:02.864271+0000","last_undegraded":"2023-07-14T13:13:02.864271+0000","last_fullsized":"2023-07-14T13:13:02.864271+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:59:22.924331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.854073+0000","last_change":"2023-07-14T13:13:02.854073+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.854073+0000","last_undegraded":"2023-07-14T13:13:02.854073+0000","last_fullsized":"2023-07-14T13:13:02.854073+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.873830+0000","last_change":"2023-07-14T13:13:02.870130+0000","last_active":"2023-07-14T13:13:02.873830+0000","last_peered":"2023-07-14T13:13:02.873830+0000","last_clean":"2023-07-14T13:13:02.873830+0000","last_became_active":"2023-07-14T13:13:02.869853+0000","last_became_peered":"2023-07-14T13:13:02.869853+0000","last_unstale":"2023-07-14T13:13:02.873830+0000","last_undegraded":"2023-07-14T13:13:02.873830+0000","last_fullsized":"2023-07-14T13:13:02.873830+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:32:13.580494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.850458+0000","last_change":"2023-07-14T13:13:02.850458+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.850458+0000","last_undegraded":"2023-07-14T13:13:02.850458+0000","last_fullsized":"2023-07-14T13:13:02.850458+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.875846+0000","last_change":"2023-07-14T13:13:02.873722+0000","last_active":"2023-07-14T13:13:02.875846+0000","last_peered":"2023-07-14T13:13:02.875846+0000","last_clean":"2023-07-14T13:13:02.875846+0000","last_became_active":"2023-07-14T13:13:02.873392+0000","last_became_peered":"2023-07-14T13:13:02.873392+0000","last_unstale":"2023-07-14T13:13:02.875846+0000","last_undegraded":"2023-07-14T13:13:02.875846+0000","last_fullsized":"2023-07-14T13:13:02.875846+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:57:45.510833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.850928+0000","last_change":"2023-07-14T13:13:02.850928+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.850928+0000","last_undegraded":"2023-07-14T13:13:02.850928+0000","last_fullsized":"2023-07-14T13:13:02.850928+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.864221+0000","last_change":"2023-07-14T13:13:02.861693+0000","last_active":"2023-07-14T13:13:02.864221+0000","last_peered":"2023-07-14T13:13:02.864221+0000","last_clean":"2023-07-14T13:13:02.864221+0000","last_became_active":"2023-07-14T13:13:02.861433+0000","last_became_peered":"2023-07-14T13:13:02.861433+0000","last_unstale":"2023-07-14T13:13:02.864221+0000","last_undegraded":"2023-07-14T13:13:02.864221+0000","last_fullsized":"2023-07-14T13:13:02.864221+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:33:35.134309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.855767+0000","last_change":"2023-07-14T13:13:02.855767+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.855767+0000","last_undegraded":"2023-07-14T13:13:02.855767+0000","last_fullsized":"2023-07-14T13:13:02.855767+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.869285+0000","last_change":"2023-07-14T13:13:02.867349+0000","last_active":"2023-07-14T13:13:02.869285+0000","last_peered":"2023-07-14T13:13:02.869285+0000","last_clean":"2023-07-14T13:13:02.869285+0000","last_became_active":"2023-07-14T13:13:02.867008+0000","last_became_peered":"2023-07-14T13:13:02.867008+0000","last_unstale":"2023-07-14T13:13:02.869285+0000","last_undegraded":"2023-07-14T13:13:02.869285+0000","last_fullsized":"2023-07-14T13:13:02.869285+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:18:05.679927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.855630+0000","last_change":"2023-07-14T13:13:02.855630+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.855630+0000","last_undegraded":"2023-07-14T13:13:02.855630+0000","last_fullsized":"2023-07-14T13:13:02.855630+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.875446+0000","last_change":"2023-07-14T13:13:02.871042+0000","last_active":"2023-07-14T13:13:02.875446+0000","last_peered":"2023-07-14T13:13:02.875446+0000","last_clean":"2023-07-14T13:13:02.875446+0000","last_became_active":"2023-07-14T13:13:02.870763+0000","last_became_peered":"2023-07-14T13:13:02.870763+0000","last_unstale":"2023-07-14T13:13:02.875446+0000","last_undegraded":"2023-07-14T13:13:02.875446+0000","last_fullsized":"2023-07-14T13:13:02.875446+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:00:01.670302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"144'271","reported_seq":953,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.860041+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:13:02.860041+0000","last_peered":"2023-07-14T13:13:02.860041+0000","last_clean":"2023-07-14T13:13:02.860041+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:13:02.860041+0000","last_undegraded":"2023-07-14T13:13:02.860041+0000","last_fullsized":"2023-07-14T13:13:02.860041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:10:23.490968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":246,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.858518+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:13:02.858518+0000","last_peered":"2023-07-14T13:13:02.858518+0000","last_clean":"2023-07-14T13:13:02.858518+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:13:02.858518+0000","last_undegraded":"2023-07-14T13:13:02.858518+0000","last_fullsized":"2023-07-14T13:13:02.858518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:58:53.221426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.855688+0000","last_change":"2023-07-14T13:13:02.855688+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.855688+0000","last_undegraded":"2023-07-14T13:13:02.855688+0000","last_fullsized":"2023-07-14T13:13:02.855688+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.873210+0000","last_change":"2023-07-14T13:13:02.869188+0000","last_active":"2023-07-14T13:13:02.873210+0000","last_peered":"2023-07-14T13:13:02.873210+0000","last_clean":"2023-07-14T13:13:02.873210+0000","last_became_active":"2023-07-14T13:13:02.868868+0000","last_became_peered":"2023-07-14T13:13:02.868868+0000","last_unstale":"2023-07-14T13:13:02.873210+0000","last_undegraded":"2023-07-14T13:13:02.873210+0000","last_fullsized":"2023-07-14T13:13:02.873210+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:49:56.887514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":251,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.859913+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:13:02.859913+0000","last_peered":"2023-07-14T13:13:02.859913+0000","last_clean":"2023-07-14T13:13:02.859913+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:13:02.859913+0000","last_undegraded":"2023-07-14T13:13:02.859913+0000","last_fullsized":"2023-07-14T13:13:02.859913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:51:51.579230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.851606+0000","last_change":"2023-07-14T13:13:02.851606+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.851606+0000","last_undegraded":"2023-07-14T13:13:02.851606+0000","last_fullsized":"2023-07-14T13:13:02.851606+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.871277+0000","last_change":"2023-07-14T13:13:02.870439+0000","last_active":"2023-07-14T13:13:02.871277+0000","last_peered":"2023-07-14T13:13:02.871277+0000","last_clean":"2023-07-14T13:13:02.871277+0000","last_became_active":"2023-07-14T13:13:02.870195+0000","last_became_peered":"2023-07-14T13:13:02.870195+0000","last_unstale":"2023-07-14T13:13:02.871277+0000","last_undegraded":"2023-07-14T13:13:02.871277+0000","last_fullsized":"2023-07-14T13:13:02.871277+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:47:16.425255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":252,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.854743+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:13:02.854743+0000","last_peered":"2023-07-14T13:13:02.854743+0000","last_clean":"2023-07-14T13:13:02.854743+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:13:02.854743+0000","last_undegraded":"2023-07-14T13:13:02.854743+0000","last_fullsized":"2023-07-14T13:13:02.854743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:07:17.830966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.846459+0000","last_change":"2023-07-14T13:13:02.846459+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.846459+0000","last_undegraded":"2023-07-14T13:13:02.846459+0000","last_fullsized":"2023-07-14T13:13:02.846459+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.866527+0000","last_change":"2023-07-14T13:13:02.862863+0000","last_active":"2023-07-14T13:13:02.866527+0000","last_peered":"2023-07-14T13:13:02.866527+0000","last_clean":"2023-07-14T13:13:02.866527+0000","last_became_active":"2023-07-14T13:13:02.862584+0000","last_became_peered":"2023-07-14T13:13:02.862584+0000","last_unstale":"2023-07-14T13:13:02.866527+0000","last_undegraded":"2023-07-14T13:13:02.866527+0000","last_fullsized":"2023-07-14T13:13:02.866527+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:01:28.565089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":246,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.859753+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:13:02.859753+0000","last_peered":"2023-07-14T13:13:02.859753+0000","last_clean":"2023-07-14T13:13:02.859753+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:13:02.859753+0000","last_undegraded":"2023-07-14T13:13:02.859753+0000","last_fullsized":"2023-07-14T13:13:02.859753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:33:07.818603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.854448+0000","last_change":"2023-07-14T13:13:02.854448+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.854448+0000","last_undegraded":"2023-07-14T13:13:02.854448+0000","last_fullsized":"2023-07-14T13:13:02.854448+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.875385+0000","last_change":"2023-07-14T13:13:02.872225+0000","last_active":"2023-07-14T13:13:02.875385+0000","last_peered":"2023-07-14T13:13:02.875385+0000","last_clean":"2023-07-14T13:13:02.875385+0000","last_became_active":"2023-07-14T13:13:02.871842+0000","last_became_peered":"2023-07-14T13:13:02.871842+0000","last_unstale":"2023-07-14T13:13:02.875385+0000","last_undegraded":"2023-07-14T13:13:02.875385+0000","last_fullsized":"2023-07-14T13:13:02.875385+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:39:39.654808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":258,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.854434+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:13:02.854434+0000","last_peered":"2023-07-14T13:13:02.854434+0000","last_clean":"2023-07-14T13:13:02.854434+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:13:02.854434+0000","last_undegraded":"2023-07-14T13:13:02.854434+0000","last_fullsized":"2023-07-14T13:13:02.854434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:38:37.620856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.857262+0000","last_change":"2023-07-14T13:13:02.857262+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.857262+0000","last_undegraded":"2023-07-14T13:13:02.857262+0000","last_fullsized":"2023-07-14T13:13:02.857262+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.875404+0000","last_change":"2023-07-14T13:13:02.870013+0000","last_active":"2023-07-14T13:13:02.875404+0000","last_peered":"2023-07-14T13:13:02.875404+0000","last_clean":"2023-07-14T13:13:02.875404+0000","last_became_active":"2023-07-14T13:13:02.869705+0000","last_became_peered":"2023-07-14T13:13:02.869705+0000","last_unstale":"2023-07-14T13:13:02.875404+0000","last_undegraded":"2023-07-14T13:13:02.875404+0000","last_fullsized":"2023-07-14T13:13:02.875404+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:58:26.246984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":250,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.862100+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:13:02.862100+0000","last_peered":"2023-07-14T13:13:02.862100+0000","last_clean":"2023-07-14T13:13:02.862100+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:13:02.862100+0000","last_undegraded":"2023-07-14T13:13:02.862100+0000","last_fullsized":"2023-07-14T13:13:02.862100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:49:38.781467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.848962+0000","last_change":"2023-07-14T13:13:02.848962+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.848962+0000","last_undegraded":"2023-07-14T13:13:02.848962+0000","last_fullsized":"2023-07-14T13:13:02.848962+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.873756+0000","last_change":"2023-07-14T13:13:02.869873+0000","last_active":"2023-07-14T13:13:02.873756+0000","last_peered":"2023-07-14T13:13:02.873756+0000","last_clean":"2023-07-14T13:13:02.873756+0000","last_became_active":"2023-07-14T13:13:02.869590+0000","last_became_peered":"2023-07-14T13:13:02.869590+0000","last_unstale":"2023-07-14T13:13:02.873756+0000","last_undegraded":"2023-07-14T13:13:02.873756+0000","last_fullsized":"2023-07-14T13:13:02.873756+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:29:35.971780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":258,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.851182+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:13:02.851182+0000","last_peered":"2023-07-14T13:13:02.851182+0000","last_clean":"2023-07-14T13:13:02.851182+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:13:02.851182+0000","last_undegraded":"2023-07-14T13:13:02.851182+0000","last_fullsized":"2023-07-14T13:13:02.851182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:46:24.773536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":154,"state":"creating+peering","last_fresh":"2023-07-14T13:13:02.851849+0000","last_change":"2023-07-14T13:13:02.851849+0000","last_active":"2023-07-14T13:13:02.835170+0000","last_peered":"2023-07-14T13:13:02.835170+0000","last_clean":"2023-07-14T13:13:02.835170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:13:02.851849+0000","last_undegraded":"2023-07-14T13:13:02.851849+0000","last_fullsized":"2023-07-14T13:13:02.851849+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.865847+0000","last_change":"2023-07-14T13:13:02.859953+0000","last_active":"2023-07-14T13:13:02.865847+0000","last_peered":"2023-07-14T13:13:02.865847+0000","last_clean":"2023-07-14T13:13:02.865847+0000","last_became_active":"2023-07-14T13:13:02.859642+0000","last_became_peered":"2023-07-14T13:13:02.859642+0000","last_unstale":"2023-07-14T13:13:02.865847+0000","last_undegraded":"2023-07-14T13:13:02.865847+0000","last_fullsized":"2023-07-14T13:13:02.865847+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:07:45.072422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":252,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-07-14T13:13:02.863796+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:13:02.863796+0000","last_peered":"2023-07-14T13:13:02.863796+0000","last_clean":"2023-07-14T13:13:02.863796+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:13:02.863796+0000","last_undegraded":"2023-07-14T13:13:02.863796+0000","last_fullsized":"2023-07-14T13:13:02.863796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:18:18.346357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575090,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59728,"kb_used_data":2440,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312112,"statfs":{"total":96636764160,"available":96575602688,"internally_reserved":0,"allocated":2498560,"data_stored":1559469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.68999999999999995,"15min":0.70699999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.84199999999999997,"5min":1.262,"15min":1.262},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71699999999999997,"15min":0.72899999999999998},"min":{"1min":0.54100000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.65800000000000003}]},{"osd":1,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.70599999999999996,"15min":0.72999999999999998},"min":{"1min":0.44,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83799999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72799999999999998,"15min":0.74299999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.71499999999999997}]},{"osd":2,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71199999999999997,"15min":0.72599999999999998},"min":{"1min":0.48999999999999999,"5min":0.46100000000000002,"15min":0.42699999999999999},"max":{"1min":0.91500000000000004,"5min":1.073,"15min":1.073},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.753},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84899999999999998,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.70199999999999996}]},{"osd":3,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.72699999999999998,"15min":0.73599999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.091,"5min":1.161,"15min":1.161},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73999999999999999,"15min":0.75600000000000001},"min":{"1min":0.51100000000000001,"5min":0.47899999999999998,"15min":0.41499999999999998},"max":{"1min":0.94899999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.60499999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56899999999999995,"15min":0.57899999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.318},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.022},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.40000000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.42699999999999999,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.91000000000000003,"5min":0.98099999999999998,"15min":0.98299999999999998},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63100000000000001,"15min":0.64900000000000002},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.34100000000000003},"max":{"1min":0.80500000000000005,"5min":1.028,"15min":1.028},"last":0.621}]},{"osd":6,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.42699999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.0489999999999999},"last":0.745},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.68100000000000005,"15min":0.67700000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.36299999999999999},"max":{"1min":1.151,"5min":4.1130000000000004,"15min":4.1130000000000004},"last":0.68500000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575091,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32920,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1916928,"data_stored":975749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70699999999999996,"15min":0.72699999999999998},"min":{"1min":0.496,"5min":0.47899999999999998,"15min":0.38},"max":{"1min":0.89300000000000002,"5min":0.90400000000000003,"15min":0.996},"last":0.498},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69999999999999996,"15min":0.72399999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88100000000000001,"5min":0.98199999999999998,"15min":1.0800000000000001},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70099999999999996,"15min":0.73299999999999998},"min":{"1min":0.48499999999999999,"5min":0.42299999999999999,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.0209999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69199999999999995,"15min":0.71899999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82999999999999996,"5min":0.88100000000000001,"15min":1.077},"last":0.625}]},{"osd":2,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.746},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.45900000000000002},"max":{"1min":0.872,"5min":0.95099999999999996,"15min":1.105},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71799999999999997,"15min":0.745},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.92100000000000004,"5min":0.99099999999999999,"15min":1.0900000000000001},"last":0.72599999999999998}]},{"osd":3,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72899999999999998,"15min":0.76600000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89300000000000002,"5min":1.054,"15min":1.1359999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71399999999999997,"15min":0.753},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93600000000000005,"5min":0.94799999999999995,"15min":1.1080000000000001},"last":0.64600000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.63900000000000001,"15min":0.63600000000000001},"min":{"1min":0.47499999999999998,"5min":0.439,"15min":0.38500000000000001},"max":{"1min":0.79800000000000004,"5min":0.95499999999999996,"15min":1.0780000000000001},"last":0.70599999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63,"15min":0.64000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":1.579},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48199999999999998,"5min":0.46300000000000002,"15min":0.42399999999999999},"max":{"1min":0.85599999999999998,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.55600000000000005}]},{"osd":7,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66000000000000003,"15min":0.65900000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91800000000000004,"5min":1.0940000000000001,"15min":1.1200000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.36199999999999999},"max":{"1min":0.90400000000000003,"5min":1.0209999999999999,"15min":1.657},"last":0.68899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575090,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50968,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320872,"statfs":{"total":96636764160,"available":96584572928,"internally_reserved":0,"allocated":1916928,"data_stored":975749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68799999999999994,"15min":0.72199999999999998},"min":{"1min":0.45400000000000001,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":2.6699999999999999},"last":1.081},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.46500000000000002,"5min":0.41699999999999998,"15min":0.32800000000000001},"max":{"1min":0.86799999999999999,"5min":1.083,"15min":1.083},"last":1.107}]},{"osd":1,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68899999999999995,"15min":0.71799999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44500000000000001},"max":{"1min":0.93600000000000005,"5min":1.05,"15min":1.079},"last":2.036},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.71499999999999997,"15min":0.73899999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.36799999999999999},"max":{"1min":0.873,"5min":0.94599999999999995,"15min":2.706},"last":0.59799999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70899999999999996,"15min":0.72799999999999998},"min":{"1min":0.41199999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90700000000000003,"5min":1.212,"15min":1.212},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70799999999999996,"15min":0.72699999999999998},"min":{"1min":0.497,"5min":0.44800000000000001,"15min":0.433},"max":{"1min":0.94599999999999995,"5min":1.181,"15min":1.181},"last":2.0790000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72499999999999998,"15min":0.74199999999999999},"min":{"1min":0.53900000000000003,"5min":0.41799999999999998,"15min":0.377},"max":{"1min":0.88600000000000001,"5min":0.95199999999999996,"15min":2.7389999999999999},"last":1.01},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73099999999999998,"15min":0.753},"min":{"1min":0.51600000000000001,"5min":0.47299999999999998,"15min":0.39700000000000002},"max":{"1min":0.94499999999999995,"5min":1.304,"15min":1.304},"last":0.98499999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.628,"15min":0.628},"min":{"1min":0.38500000000000001,"5min":0.38,"15min":0.28599999999999998},"max":{"1min":0.85599999999999998,"5min":1.129,"15min":1.129},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.69099999999999995,"15min":0.68400000000000005},"min":{"1min":0.53700000000000003,"5min":0.39900000000000002,"15min":0.36299999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":2.7719999999999998},"last":0.54800000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60199999999999998,"15min":0.60599999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.32700000000000001},"max":{"1min":0.89700000000000002,"5min":1.169,"15min":1.169},"last":1.2729999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42599999999999999,"5min":0.39400000000000002,"15min":0.34300000000000003},"max":{"1min":0.91000000000000003,"5min":1.238,"15min":1.238},"last":0.84399999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64600000000000002,"15min":0.64300000000000002},"min":{"1min":0.40899999999999997,"5min":0.36899999999999999,"15min":0.32900000000000001},"max":{"1min":0.90800000000000003,"5min":1.026,"15min":3.0230000000000001},"last":1.6000000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68300000000000005,"15min":0.67700000000000005},"min":{"1min":0.49399999999999999,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.98199999999999998,"5min":1.2589999999999999,"15min":1.407},"last":1.6819999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575090,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37004,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334836,"statfs":{"total":96636764160,"available":96598872064,"internally_reserved":0,"allocated":1904640,"data_stored":969101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.70599999999999996,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.411},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.45600000000000002,"5min":0.45100000000000001,"15min":0.435},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.1200000000000001},"last":0.67700000000000005}]},{"osd":1,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71199999999999997,"15min":0.74399999999999999},"min":{"1min":0.496,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84099999999999997,"5min":0.92500000000000004,"15min":1.077},"last":0.88},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70399999999999996,"15min":0.72999999999999998},"min":{"1min":0.52700000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.0469999999999999},"last":0.70299999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.71999999999999997,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.42199999999999999,"15min":0.35199999999999998},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72099999999999997,"15min":0.76400000000000001},"min":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.86699999999999999,"5min":0.98199999999999998,"15min":1.387},"last":1.004}]},{"osd":3,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.49399999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89700000000000002,"5min":0.95399999999999996,"15min":1.008},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.74099999999999999,"15min":0.76600000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46800000000000003},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":1.0289999999999999}]},{"osd":5,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.378},"max":{"1min":0.92200000000000004,"5min":0.92400000000000004,"15min":0.97099999999999997},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.40400000000000003,"15min":0.34599999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":1.1040000000000001}]},{"osd":6,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.014},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67900000000000005,"15min":0.67000000000000004},"min":{"1min":0.48599999999999999,"5min":0.443,"15min":0.374},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.0289999999999999},"last":1.133}]},{"osd":7,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.69899999999999995,"15min":0.67200000000000004},"min":{"1min":0.51300000000000001,"5min":0.502,"15min":0.39000000000000001},"max":{"1min":0.91700000000000004,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.69799999999999995},"min":{"1min":0.48199999999999998,"5min":0.42799999999999999,"15min":0.40300000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":1.1599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575090,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37004,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334836,"statfs":{"total":96636764160,"available":96598872064,"internally_reserved":0,"allocated":1904640,"data_stored":969101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.44400000000000001,"15min":0.44900000000000001},"min":{"1min":0.25600000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.63100000000000001,"5min":0.78600000000000003,"15min":0.84199999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.49299999999999999,"15min":0.51100000000000001},"min":{"1min":0.312,"5min":0.307,"15min":0.307},"max":{"1min":0.66700000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47399999999999998,"15min":0.47999999999999998},"min":{"1min":0.32300000000000001,"5min":0.32000000000000001,"15min":0.315},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.0029999999999999},"last":0.48699999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55800000000000005,"15min":0.57199999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.58299999999999996,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.36799999999999999},"max":{"1min":0.81599999999999995,"5min":0.88100000000000001,"15min":1.663},"last":0.59099999999999997}]},{"osd":4,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.72699999999999998,"15min":0.755},"min":{"1min":0.53000000000000003,"5min":0.48199999999999998,"15min":0.439},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.284},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.52700000000000002,"5min":0.51900000000000002,"15min":0.47699999999999998},"max":{"1min":0.96899999999999997,"5min":1.175,"15min":1.175},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76600000000000001,"15min":0.78700000000000003},"min":{"1min":0.54900000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.05,"5min":1.0629999999999999,"15min":1.306},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.754,"15min":0.78200000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.372},"max":{"1min":1.121,"5min":1.121,"15min":1.2470000000000001},"last":0.85999999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.746,"15min":0.76900000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48099999999999998},"max":{"1min":1.0680000000000001,"5min":1.113,"15min":1.117},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.78700000000000003,"15min":0.81100000000000005},"min":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.54200000000000004},"max":{"1min":1.133,"5min":1.133,"15min":1.2589999999999999},"last":0.77600000000000002}]},{"osd":7,"last update":"Fri Jul 14 13:12:05 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.78300000000000003,"15min":0.82799999999999996},"min":{"1min":0.58399999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.159,"5min":1.159,"15min":2.4910000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.78100000000000003,"15min":0.81799999999999995},"min":{"1min":0.57599999999999996,"5min":0.53500000000000003,"15min":0.51600000000000001},"max":{"1min":1.0960000000000001,"5min":1.1359999999999999,"15min":1.595},"last":0.83999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575090,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59156,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312684,"statfs":{"total":96636764160,"available":96576188416,"internally_reserved":0,"allocated":1912832,"data_stored":974730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46200000000000002,"15min":0.46400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.80400000000000005,"5min":0.84699999999999998,"15min":1.3169999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.50800000000000001,"15min":0.53300000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67300000000000004,"5min":0.80800000000000005,"15min":2.5270000000000001},"last":0.47399999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.47699999999999998,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.29999999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":2.7200000000000002},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.55700000000000005},"min":{"1min":0.39900000000000002,"5min":0.36299999999999999,"15min":0.35999999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":2.6110000000000002},"last":0.52500000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55100000000000005,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.755,"5min":0.755,"15min":8.2530000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.77000000000000002,"5min":0.89600000000000002,"15min":1.2150000000000001},"last":0.49399999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.73999999999999999,"15min":0.76900000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.48399999999999999},"max":{"1min":0.91100000000000003,"5min":1.0840000000000001,"15min":1.1499999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73999999999999999,"15min":0.78100000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.47999999999999998},"max":{"1min":0.92900000000000005,"5min":1.0629999999999999,"15min":2.3170000000000002},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.79900000000000004,"15min":0.84699999999999998},"min":{"1min":0.58399999999999996,"5min":0.56399999999999995,"15min":0.49399999999999999},"max":{"1min":1.0029999999999999,"5min":1.1319999999999999,"15min":3.1139999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.78900000000000003,"15min":0.83299999999999996},"min":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.55600000000000005},"max":{"1min":1.03,"5min":1.153,"15min":2.6850000000000001},"last":0.81000000000000005}]},{"osd":6,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.73999999999999999,"15min":0.79100000000000004},"min":{"1min":0.52900000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98299999999999998,"5min":1.038,"15min":3.9849999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75900000000000001,"15min":0.80200000000000005},"min":{"1min":0.53900000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":3.391},"last":0.63600000000000001}]},{"osd":7,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.76000000000000001,"15min":0.80900000000000005},"min":{"1min":0.56200000000000006,"5min":0.52300000000000002,"15min":0.5},"max":{"1min":1.022,"5min":1.1759999999999999,"15min":2.5779999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.78200000000000003,"15min":0.81799999999999995},"min":{"1min":0.57099999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.736,"5min":1.736,"15min":2.5939999999999999},"last":0.77200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575091,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37016,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334824,"statfs":{"total":96636764160,"available":96598859776,"internally_reserved":0,"allocated":1916928,"data_stored":975749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42899999999999999,"15min":0.432},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26100000000000001},"max":{"1min":0.56000000000000005,"5min":0.65400000000000003,"15min":0.77200000000000002},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.34999999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.74399999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.39600000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.35899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.63700000000000001,"5min":0.69199999999999995,"15min":1.0409999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.51700000000000002},"min":{"1min":0.32100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73199999999999998,"5min":0.77900000000000003,"15min":1.014},"last":0.36099999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60799999999999998,"15min":0.628},"min":{"1min":0.502,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.746,"5min":0.80300000000000005,"15min":0.96299999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55300000000000005,"15min":0.57099999999999995},"min":{"1min":0.41299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69899999999999995,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.47199999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76400000000000001,"15min":0.78300000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48899999999999999},"max":{"1min":1.155,"5min":1.2110000000000001,"15min":1.236},"last":0.503},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79000000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0640000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.55800000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77700000000000002,"15min":0.78500000000000003},"min":{"1min":0.56000000000000005,"5min":0.52500000000000002,"15min":0.45200000000000001},"max":{"1min":1.1020000000000001,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.79600000000000004,"15min":0.80300000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.48599999999999999},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.54600000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.55900000000000005,"5min":0.53800000000000003,"15min":0.503},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.2170000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79900000000000004,"15min":0.81799999999999995},"min":{"1min":0.53700000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.60499999999999998}]},{"osd":7,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.58499999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82699999999999996,"15min":0.84199999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.65300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575092,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41688,"kb_used_data":2448,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330152,"statfs":{"total":96636764160,"available":96594075648,"internally_reserved":0,"allocated":2506752,"data_stored":1565098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.27300000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.59199999999999997,"5min":0.79600000000000004,"15min":2.2450000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.48299999999999998,"15min":0.50800000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27700000000000002},"max":{"1min":0.72999999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.33300000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.504,"15min":0.51400000000000001},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68200000000000005,"5min":0.84499999999999997,"15min":2.2989999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52800000000000002,"15min":0.54700000000000004},"min":{"1min":0.39100000000000001,"5min":0.34899999999999998,"15min":0.29899999999999999},"max":{"1min":0.71199999999999997,"5min":0.83599999999999997,"15min":0.90300000000000002},"last":0.379}]},{"osd":3,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.505,"15min":0.505},"min":{"1min":0.35199999999999998,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.84999999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57799999999999996,"15min":0.58999999999999997},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76600000000000001,"5min":0.92700000000000005,"15min":2.4100000000000001},"last":0.51100000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74399999999999999,"15min":0.77800000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1220000000000001,"5min":1.21,"15min":1.3640000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.75700000000000001,"15min":0.79300000000000004},"min":{"1min":0.57599999999999996,"5min":0.53500000000000003,"15min":0.44900000000000001},"max":{"1min":1.0289999999999999,"5min":1.0589999999999999,"15min":2.4460000000000002},"last":0.58099999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75600000000000001,"15min":0.79400000000000004},"min":{"1min":0.62,"5min":0.54200000000000004,"15min":0.47899999999999998},"max":{"1min":1.044,"5min":1.0669999999999999,"15min":1.3839999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.59399999999999997,"5min":0.5,"15min":0.48399999999999999},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.325},"last":0.74299999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77100000000000002,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.147,"5min":1.147,"15min":2.3380000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.755,"15min":0.79900000000000004},"min":{"1min":0.55600000000000005,"5min":0.51000000000000001,"15min":0.50600000000000001},"max":{"1min":0.97899999999999998,"5min":1.0900000000000001,"15min":1.3440000000000001},"last":0.61299999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76300000000000001,"15min":0.81599999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.503},"max":{"1min":1.016,"5min":1.1180000000000001,"15min":1.2749999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.77200000000000002,"15min":0.80500000000000005},"min":{"1min":0.56000000000000005,"5min":0.50600000000000001,"15min":0.502},"max":{"1min":1.077,"5min":1.0880000000000001,"15min":1.381},"last":0.76200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:13:08.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3f is not active+clean 2023-07-14T13:13:08.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.849702+0000', 'last_change': '2023-07-14T13:13:02.849702+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.849702+0000', 'last_undegraded': '2023-07-14T13:13:02.849702+0000', 'last_fullsized': '2023-07-14T13:13:02.849702+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:13:08.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3e is not active+clean 2023-07-14T13:13:08.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.861742+0000', 'last_change': '2023-07-14T13:13:02.861742+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.861742+0000', 'last_undegraded': '2023-07-14T13:13:02.861742+0000', 'last_fullsized': '2023-07-14T13:13:02.861742+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:13:08.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3d is not active+clean 2023-07-14T13:13:08.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.856128+0000', 'last_change': '2023-07-14T13:13:02.856128+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.856128+0000', 'last_undegraded': '2023-07-14T13:13:02.856128+0000', 'last_fullsized': '2023-07-14T13:13:02.856128+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:13:08.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3c is not active+clean 2023-07-14T13:13:08.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.858190+0000', 'last_change': '2023-07-14T13:13:02.858190+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.858190+0000', 'last_undegraded': '2023-07-14T13:13:02.858190+0000', 'last_fullsized': '2023-07-14T13:13:02.858190+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:13:08.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3b is not active+clean 2023-07-14T13:13:08.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.850808+0000', 'last_change': '2023-07-14T13:13:02.850808+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.850808+0000', 'last_undegraded': '2023-07-14T13:13:02.850808+0000', 'last_fullsized': '2023-07-14T13:13:02.850808+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:13:08.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3a is not active+clean 2023-07-14T13:13:08.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.850055+0000', 'last_change': '2023-07-14T13:13:02.850055+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.850055+0000', 'last_undegraded': '2023-07-14T13:13:02.850055+0000', 'last_fullsized': '2023-07-14T13:13:02.850055+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:13:08.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.39 is not active+clean 2023-07-14T13:13:08.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.856317+0000', 'last_change': '2023-07-14T13:13:02.856317+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.856317+0000', 'last_undegraded': '2023-07-14T13:13:02.856317+0000', 'last_fullsized': '2023-07-14T13:13:02.856317+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:13:08.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.38 is not active+clean 2023-07-14T13:13:08.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.853552+0000', 'last_change': '2023-07-14T13:13:02.853552+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.853552+0000', 'last_undegraded': '2023-07-14T13:13:02.853552+0000', 'last_fullsized': '2023-07-14T13:13:02.853552+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:13:08.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.37 is not active+clean 2023-07-14T13:13:08.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.851575+0000', 'last_change': '2023-07-14T13:13:02.851575+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.851575+0000', 'last_undegraded': '2023-07-14T13:13:02.851575+0000', 'last_fullsized': '2023-07-14T13:13:02.851575+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:13:08.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.36 is not active+clean 2023-07-14T13:13:08.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.847249+0000', 'last_change': '2023-07-14T13:13:02.847249+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.847249+0000', 'last_undegraded': '2023-07-14T13:13:02.847249+0000', 'last_fullsized': '2023-07-14T13:13:02.847249+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:13:08.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.35 is not active+clean 2023-07-14T13:13:08.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.858717+0000', 'last_change': '2023-07-14T13:13:02.858717+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.858717+0000', 'last_undegraded': '2023-07-14T13:13:02.858717+0000', 'last_fullsized': '2023-07-14T13:13:02.858717+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:13:08.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.34 is not active+clean 2023-07-14T13:13:08.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.848547+0000', 'last_change': '2023-07-14T13:13:02.848547+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.848547+0000', 'last_undegraded': '2023-07-14T13:13:02.848547+0000', 'last_fullsized': '2023-07-14T13:13:02.848547+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:13:08.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.33 is not active+clean 2023-07-14T13:13:08.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.850700+0000', 'last_change': '2023-07-14T13:13:02.850700+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.850700+0000', 'last_undegraded': '2023-07-14T13:13:02.850700+0000', 'last_fullsized': '2023-07-14T13:13:02.850700+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:13:08.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.32 is not active+clean 2023-07-14T13:13:08.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.849830+0000', 'last_change': '2023-07-14T13:13:02.849830+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.849830+0000', 'last_undegraded': '2023-07-14T13:13:02.849830+0000', 'last_fullsized': '2023-07-14T13:13:02.849830+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:13:08.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.31 is not active+clean 2023-07-14T13:13:08.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.849124+0000', 'last_change': '2023-07-14T13:13:02.849124+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.849124+0000', 'last_undegraded': '2023-07-14T13:13:02.849124+0000', 'last_fullsized': '2023-07-14T13:13:02.849124+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:13:08.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.30 is not active+clean 2023-07-14T13:13:08.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.853108+0000', 'last_change': '2023-07-14T13:13:02.853108+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.853108+0000', 'last_undegraded': '2023-07-14T13:13:02.853108+0000', 'last_fullsized': '2023-07-14T13:13:02.853108+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:13:08.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2f is not active+clean 2023-07-14T13:13:08.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.851143+0000', 'last_change': '2023-07-14T13:13:02.851143+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.851143+0000', 'last_undegraded': '2023-07-14T13:13:02.851143+0000', 'last_fullsized': '2023-07-14T13:13:02.851143+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:13:08.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2e is not active+clean 2023-07-14T13:13:08.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.848625+0000', 'last_change': '2023-07-14T13:13:02.848625+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.848625+0000', 'last_undegraded': '2023-07-14T13:13:02.848625+0000', 'last_fullsized': '2023-07-14T13:13:02.848625+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:13:08.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2d is not active+clean 2023-07-14T13:13:08.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.858202+0000', 'last_change': '2023-07-14T13:13:02.858202+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.858202+0000', 'last_undegraded': '2023-07-14T13:13:02.858202+0000', 'last_fullsized': '2023-07-14T13:13:02.858202+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:13:08.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2c is not active+clean 2023-07-14T13:13:08.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.849602+0000', 'last_change': '2023-07-14T13:13:02.849602+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.849602+0000', 'last_undegraded': '2023-07-14T13:13:02.849602+0000', 'last_fullsized': '2023-07-14T13:13:02.849602+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:13:08.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2b is not active+clean 2023-07-14T13:13:08.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.857664+0000', 'last_change': '2023-07-14T13:13:02.857664+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.857664+0000', 'last_undegraded': '2023-07-14T13:13:02.857664+0000', 'last_fullsized': '2023-07-14T13:13:02.857664+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:13:08.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2a is not active+clean 2023-07-14T13:13:08.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.850309+0000', 'last_change': '2023-07-14T13:13:02.850309+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.850309+0000', 'last_undegraded': '2023-07-14T13:13:02.850309+0000', 'last_fullsized': '2023-07-14T13:13:02.850309+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:13:08.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.29 is not active+clean 2023-07-14T13:13:08.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.857728+0000', 'last_change': '2023-07-14T13:13:02.857728+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.857728+0000', 'last_undegraded': '2023-07-14T13:13:02.857728+0000', 'last_fullsized': '2023-07-14T13:13:02.857728+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:13:08.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.28 is not active+clean 2023-07-14T13:13:08.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.852651+0000', 'last_change': '2023-07-14T13:13:02.852651+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.852651+0000', 'last_undegraded': '2023-07-14T13:13:02.852651+0000', 'last_fullsized': '2023-07-14T13:13:02.852651+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:13:08.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.27 is not active+clean 2023-07-14T13:13:08.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.855048+0000', 'last_change': '2023-07-14T13:13:02.855048+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.855048+0000', 'last_undegraded': '2023-07-14T13:13:02.855048+0000', 'last_fullsized': '2023-07-14T13:13:02.855048+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:13:08.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.26 is not active+clean 2023-07-14T13:13:08.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.858641+0000', 'last_change': '2023-07-14T13:13:02.858641+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.858641+0000', 'last_undegraded': '2023-07-14T13:13:02.858641+0000', 'last_fullsized': '2023-07-14T13:13:02.858641+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:13:08.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.25 is not active+clean 2023-07-14T13:13:08.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.857754+0000', 'last_change': '2023-07-14T13:13:02.857754+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.857754+0000', 'last_undegraded': '2023-07-14T13:13:02.857754+0000', 'last_fullsized': '2023-07-14T13:13:02.857754+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:13:08.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.24 is not active+clean 2023-07-14T13:13:08.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.846958+0000', 'last_change': '2023-07-14T13:13:02.846958+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.846958+0000', 'last_undegraded': '2023-07-14T13:13:02.846958+0000', 'last_fullsized': '2023-07-14T13:13:02.846958+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:13:08.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.23 is not active+clean 2023-07-14T13:13:08.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.857735+0000', 'last_change': '2023-07-14T13:13:02.857735+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.857735+0000', 'last_undegraded': '2023-07-14T13:13:02.857735+0000', 'last_fullsized': '2023-07-14T13:13:02.857735+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:13:08.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.22 is not active+clean 2023-07-14T13:13:08.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.855125+0000', 'last_change': '2023-07-14T13:13:02.855125+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.855125+0000', 'last_undegraded': '2023-07-14T13:13:02.855125+0000', 'last_fullsized': '2023-07-14T13:13:02.855125+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:13:08.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.21 is not active+clean 2023-07-14T13:13:08.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.852437+0000', 'last_change': '2023-07-14T13:13:02.852437+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.852437+0000', 'last_undegraded': '2023-07-14T13:13:02.852437+0000', 'last_fullsized': '2023-07-14T13:13:02.852437+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:13:08.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.20 is not active+clean 2023-07-14T13:13:08.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.846335+0000', 'last_change': '2023-07-14T13:13:02.846335+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.846335+0000', 'last_undegraded': '2023-07-14T13:13:02.846335+0000', 'last_fullsized': '2023-07-14T13:13:02.846335+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:13:08.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.18 is not active+clean 2023-07-14T13:13:08.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.851446+0000', 'last_change': '2023-07-14T13:13:02.851446+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.851446+0000', 'last_undegraded': '2023-07-14T13:13:02.851446+0000', 'last_fullsized': '2023-07-14T13:13:02.851446+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:13:08.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.19 is not active+clean 2023-07-14T13:13:08.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.848613+0000', 'last_change': '2023-07-14T13:13:02.848613+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.848613+0000', 'last_undegraded': '2023-07-14T13:13:02.848613+0000', 'last_fullsized': '2023-07-14T13:13:02.848613+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:13:08.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1a is not active+clean 2023-07-14T13:13:08.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.859386+0000', 'last_change': '2023-07-14T13:13:02.859386+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.859386+0000', 'last_undegraded': '2023-07-14T13:13:02.859386+0000', 'last_fullsized': '2023-07-14T13:13:02.859386+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:13:08.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1b is not active+clean 2023-07-14T13:13:08.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.850910+0000', 'last_change': '2023-07-14T13:13:02.850910+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.850910+0000', 'last_undegraded': '2023-07-14T13:13:02.850910+0000', 'last_fullsized': '2023-07-14T13:13:02.850910+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:13:08.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1c is not active+clean 2023-07-14T13:13:08.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.851433+0000', 'last_change': '2023-07-14T13:13:02.851433+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.851433+0000', 'last_undegraded': '2023-07-14T13:13:02.851433+0000', 'last_fullsized': '2023-07-14T13:13:02.851433+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:13:08.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1d is not active+clean 2023-07-14T13:13:08.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.852729+0000', 'last_change': '2023-07-14T13:13:02.852729+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.852729+0000', 'last_undegraded': '2023-07-14T13:13:02.852729+0000', 'last_fullsized': '2023-07-14T13:13:02.852729+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-14T13:13:08.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1e is not active+clean 2023-07-14T13:13:08.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.848145+0000', 'last_change': '2023-07-14T13:13:02.848145+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.848145+0000', 'last_undegraded': '2023-07-14T13:13:02.848145+0000', 'last_fullsized': '2023-07-14T13:13:02.848145+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:13:08.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1f is not active+clean 2023-07-14T13:13:08.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.856377+0000', 'last_change': '2023-07-14T13:13:02.856377+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.856377+0000', 'last_undegraded': '2023-07-14T13:13:02.856377+0000', 'last_fullsized': '2023-07-14T13:13:02.856377+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:13:08.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.8 is not active+clean 2023-07-14T13:13:08.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.856673+0000', 'last_change': '2023-07-14T13:13:02.856673+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.856673+0000', 'last_undegraded': '2023-07-14T13:13:02.856673+0000', 'last_fullsized': '2023-07-14T13:13:02.856673+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:13:08.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.9 is not active+clean 2023-07-14T13:13:08.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.855785+0000', 'last_change': '2023-07-14T13:13:02.855785+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.855785+0000', 'last_undegraded': '2023-07-14T13:13:02.855785+0000', 'last_fullsized': '2023-07-14T13:13:02.855785+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:13:08.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.a is not active+clean 2023-07-14T13:13:08.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.856936+0000', 'last_change': '2023-07-14T13:13:02.856936+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.856936+0000', 'last_undegraded': '2023-07-14T13:13:02.856936+0000', 'last_fullsized': '2023-07-14T13:13:02.856936+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:13:08.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.b is not active+clean 2023-07-14T13:13:08.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.847342+0000', 'last_change': '2023-07-14T13:13:02.847342+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.847342+0000', 'last_undegraded': '2023-07-14T13:13:02.847342+0000', 'last_fullsized': '2023-07-14T13:13:02.847342+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:13:08.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.c is not active+clean 2023-07-14T13:13:08.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.849137+0000', 'last_change': '2023-07-14T13:13:02.849137+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.849137+0000', 'last_undegraded': '2023-07-14T13:13:02.849137+0000', 'last_fullsized': '2023-07-14T13:13:02.849137+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:13:08.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.d is not active+clean 2023-07-14T13:13:08.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.848430+0000', 'last_change': '2023-07-14T13:13:02.848430+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.848430+0000', 'last_undegraded': '2023-07-14T13:13:02.848430+0000', 'last_fullsized': '2023-07-14T13:13:02.848430+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:13:08.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.e is not active+clean 2023-07-14T13:13:08.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.847246+0000', 'last_change': '2023-07-14T13:13:02.847246+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.847246+0000', 'last_undegraded': '2023-07-14T13:13:02.847246+0000', 'last_fullsized': '2023-07-14T13:13:02.847246+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:13:08.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.f is not active+clean 2023-07-14T13:13:08.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.859982+0000', 'last_change': '2023-07-14T13:13:02.859982+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.859982+0000', 'last_undegraded': '2023-07-14T13:13:02.859982+0000', 'last_fullsized': '2023-07-14T13:13:02.859982+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:13:08.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.0 is not active+clean 2023-07-14T13:13:08.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.847343+0000', 'last_change': '2023-07-14T13:13:02.847343+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.847343+0000', 'last_undegraded': '2023-07-14T13:13:02.847343+0000', 'last_fullsized': '2023-07-14T13:13:02.847343+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:13:08.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1 is not active+clean 2023-07-14T13:13:08.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.854870+0000', 'last_change': '2023-07-14T13:13:02.854870+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.854870+0000', 'last_undegraded': '2023-07-14T13:13:02.854870+0000', 'last_fullsized': '2023-07-14T13:13:02.854870+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:13:08.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2 is not active+clean 2023-07-14T13:13:08.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.857490+0000', 'last_change': '2023-07-14T13:13:02.857490+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.857490+0000', 'last_undegraded': '2023-07-14T13:13:02.857490+0000', 'last_fullsized': '2023-07-14T13:13:02.857490+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:13:08.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3 is not active+clean 2023-07-14T13:13:08.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.846833+0000', 'last_change': '2023-07-14T13:13:02.846833+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.846833+0000', 'last_undegraded': '2023-07-14T13:13:02.846833+0000', 'last_fullsized': '2023-07-14T13:13:02.846833+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:13:08.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.4 is not active+clean 2023-07-14T13:13:08.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.854073+0000', 'last_change': '2023-07-14T13:13:02.854073+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.854073+0000', 'last_undegraded': '2023-07-14T13:13:02.854073+0000', 'last_fullsized': '2023-07-14T13:13:02.854073+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:13:08.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.5 is not active+clean 2023-07-14T13:13:08.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.850458+0000', 'last_change': '2023-07-14T13:13:02.850458+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.850458+0000', 'last_undegraded': '2023-07-14T13:13:02.850458+0000', 'last_fullsized': '2023-07-14T13:13:02.850458+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:13:08.829 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.6 is not active+clean 2023-07-14T13:13:08.829 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.850928+0000', 'last_change': '2023-07-14T13:13:02.850928+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.850928+0000', 'last_undegraded': '2023-07-14T13:13:02.850928+0000', 'last_fullsized': '2023-07-14T13:13:02.850928+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:13:08.829 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.7 is not active+clean 2023-07-14T13:13:08.830 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.855767+0000', 'last_change': '2023-07-14T13:13:02.855767+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.855767+0000', 'last_undegraded': '2023-07-14T13:13:02.855767+0000', 'last_fullsized': '2023-07-14T13:13:02.855767+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:13:08.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.15 is not active+clean 2023-07-14T13:13:08.830 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.855630+0000', 'last_change': '2023-07-14T13:13:02.855630+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.855630+0000', 'last_undegraded': '2023-07-14T13:13:02.855630+0000', 'last_fullsized': '2023-07-14T13:13:02.855630+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:13:08.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.16 is not active+clean 2023-07-14T13:13:08.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.855688+0000', 'last_change': '2023-07-14T13:13:02.855688+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.855688+0000', 'last_undegraded': '2023-07-14T13:13:02.855688+0000', 'last_fullsized': '2023-07-14T13:13:02.855688+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:13:08.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.17 is not active+clean 2023-07-14T13:13:08.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.851606+0000', 'last_change': '2023-07-14T13:13:02.851606+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.851606+0000', 'last_undegraded': '2023-07-14T13:13:02.851606+0000', 'last_fullsized': '2023-07-14T13:13:02.851606+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-14T13:13:08.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.14 is not active+clean 2023-07-14T13:13:08.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.846459+0000', 'last_change': '2023-07-14T13:13:02.846459+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.846459+0000', 'last_undegraded': '2023-07-14T13:13:02.846459+0000', 'last_fullsized': '2023-07-14T13:13:02.846459+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-14T13:13:08.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.12 is not active+clean 2023-07-14T13:13:08.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.854448+0000', 'last_change': '2023-07-14T13:13:02.854448+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.854448+0000', 'last_undegraded': '2023-07-14T13:13:02.854448+0000', 'last_fullsized': '2023-07-14T13:13:02.854448+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:13:08.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.13 is not active+clean 2023-07-14T13:13:08.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.857262+0000', 'last_change': '2023-07-14T13:13:02.857262+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.857262+0000', 'last_undegraded': '2023-07-14T13:13:02.857262+0000', 'last_fullsized': '2023-07-14T13:13:02.857262+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:13:08.834 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.10 is not active+clean 2023-07-14T13:13:08.834 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.848962+0000', 'last_change': '2023-07-14T13:13:02.848962+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.848962+0000', 'last_undegraded': '2023-07-14T13:13:02.848962+0000', 'last_fullsized': '2023-07-14T13:13:02.848962+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-14T13:13:08.834 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.11 is not active+clean 2023-07-14T13:13:08.835 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 154, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:13:02.851849+0000', 'last_change': '2023-07-14T13:13:02.851849+0000', 'last_active': '2023-07-14T13:13:02.835170+0000', 'last_peered': '2023-07-14T13:13:02.835170+0000', 'last_clean': '2023-07-14T13:13:02.835170+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:13:02.851849+0000', 'last_undegraded': '2023-07-14T13:13:02.851849+0000', 'last_fullsized': '2023-07-14T13:13:02.851849+0000', 'mapping_epoch': 154, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 154, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'last_clean_scrub_stamp': '2023-07-14T13:13:02.835170+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-14T13:13:08.836 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-14T13:13:08.863 INFO:tasks.ceph.mds.c.smithi005.stderr:2023-07-14T13:13:08.824+0000 7f771421d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T13:13:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.940+0000 7fce4189c640 1 Processor -- start 2023-07-14T13:13:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.940+0000 7fce4189c640 1 -- start start 2023-07-14T13:13:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce4189c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fce3c160330 0x7fce3c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce4189c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce3c0c17d0 con 0x7fce3c0c8940 2023-07-14T13:13:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce4189c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce3c0c14f0 con 0x7fce3c0c0f80 2023-07-14T13:13:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce4189c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce3c0cdd70 con 0x7fce3c160330 2023-07-14T13:13:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce33fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fce3c0c8940 0x7fce3c0ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:51602/0 (socket says 172.21.15.5:51602) 2023-07-14T13:13:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce33fff640 1 -- 172.21.15.5:0/4271128994 learned_addr learned my addr 172.21.15.5:0/4271128994 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:13:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce3a7fc640 1 -- 172.21.15.5:0/4271128994 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1813541277 0 0) 0x7fce3c0c17d0 con 0x7fce3c0c8940 2023-07-14T13:13:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce3affd640 1 --2- 172.21.15.5:0/4271128994 >> v2:172.21.15.154:3300/0 conn(0x7fce3c160330 0x7fce3c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce3a7fc640 1 -- 172.21.15.5:0/4271128994 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce28003530 con 0x7fce3c0c8940 2023-07-14T13:13:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce3a7fc640 1 -- 172.21.15.5:0/4271128994 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3283510694 0 0) 0x7fce28003530 con 0x7fce3c0c8940 2023-07-14T13:13:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce3a7fc640 1 -- 172.21.15.5:0/4271128994 >> v2:172.21.15.154:3300/0 conn(0x7fce3c160330 msgr2=0x7fce3c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce3a7fc640 1 --2- 172.21.15.5:0/4271128994 >> v2:172.21.15.154:3300/0 conn(0x7fce3c160330 0x7fce3c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce3a7fc640 1 -- 172.21.15.5:0/4271128994 >> v1:172.21.15.154:6789/0 conn(0x7fce3c0c0f80 legacy=0x7fce3c0cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce3a7fc640 1 -- 172.21.15.5:0/4271128994 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3c0cac10 con 0x7fce3c0c8940 2023-07-14T13:13:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce3a7fc640 1 -- 172.21.15.5:0/4271128994 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7fce24001680 con 0x7fce3c0c8940 2023-07-14T13:13:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce3a7fc640 1 -- 172.21.15.5:0/4271128994 >> v1:172.21.15.5:6789/0 conn(0x7fce3c0c8940 legacy=0x7fce3c0ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce3a7fc640 1 --2- 172.21.15.5:0/4271128994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce28003980 0x7fce28003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce3a7fc640 1 --2- 172.21.15.5:0/4271128994 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce280047d0 0x7fce28004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:08.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce3a7fc640 1 --2- 172.21.15.5:0/4271128994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce28005180 0x7fce2800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:08.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce3a7fc640 1 -- 172.21.15.5:0/4271128994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c0cdd70 con 0x7fce28005180 2023-07-14T13:13:08.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce3a7fc640 1 -- 172.21.15.5:0/4271128994 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2800bfe0 con 0x7fce28003980 2023-07-14T13:13:08.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce3a7fc640 1 -- 172.21.15.5:0/4271128994 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce2800c1a0 con 0x7fce280047d0 2023-07-14T13:13:08.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce3affd640 1 --2- 172.21.15.5:0/4271128994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce28003980 0x7fce28003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:08.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce33fff640 1 --2- 172.21.15.5:0/4271128994 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce280047d0 0x7fce28004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:08.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce3b7fe640 1 --2- 172.21.15.5:0/4271128994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce28005180 0x7fce2800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:08.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce3affd640 1 -- 172.21.15.5:0/4271128994 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce280047d0 msgr2=0x7fce28004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:08.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce3affd640 1 --2- 172.21.15.5:0/4271128994 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce280047d0 0x7fce28004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:08.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce3affd640 1 -- 172.21.15.5:0/4271128994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce28005180 msgr2=0x7fce2800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:08.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce3affd640 1 --2- 172.21.15.5:0/4271128994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce28005180 0x7fce2800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:08.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce3affd640 1 -- 172.21.15.5:0/4271128994 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce28003530 con 0x7fce28003980 2023-07-14T13:13:08.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.944+0000 7fce3b7fe640 1 -- 172.21.15.5:0/4271128994 reap_dead start 2023-07-14T13:13:08.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.948+0000 7fce3affd640 1 --2- 172.21.15.5:0/4271128994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce28003980 0x7fce28003d90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fce2c009ae0 tx=0x7fce2c01ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dedc8ac946c8afd6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:08.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.948+0000 7fce3a7fc640 1 -- 172.21.15.5:0/4271128994 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c0a5640 con 0x7fce28003980 2023-07-14T13:13:08.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.948+0000 7fce3a7fc640 1 -- 172.21.15.5:0/4271128994 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2c0a57a0 con 0x7fce28003980 2023-07-14T13:13:08.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.948+0000 7fce3a7fc640 1 -- 172.21.15.5:0/4271128994 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c0a5b50 con 0x7fce28003980 2023-07-14T13:13:08.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.948+0000 7fce4189c640 1 -- 172.21.15.5:0/4271128994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce28003980 msgr2=0x7fce28003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:08.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.948+0000 7fce4189c640 1 --2- 172.21.15.5:0/4271128994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce28003980 0x7fce28003d90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fce2c009ae0 tx=0x7fce2c01ca50 comp rx=0 tx=0).stop 2023-07-14T13:13:08.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.948+0000 7fce4189c640 1 -- 172.21.15.5:0/4271128994 shutdown_connections 2023-07-14T13:13:08.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.948+0000 7fce4189c640 1 --2- 172.21.15.5:0/4271128994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce28003980 0x7fce28003d90 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:08.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.948+0000 7fce4189c640 1 -- 172.21.15.5:0/4271128994 >> 172.21.15.5:0/4271128994 conn(0x7fce3c0afcf0 msgr2=0x7fce3c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:08.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.948+0000 7fce4189c640 1 -- 172.21.15.5:0/4271128994 shutdown_connections 2023-07-14T13:13:08.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.948+0000 7fce4189c640 1 -- 172.21.15.5:0/4271128994 wait complete. 2023-07-14T13:13:08.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.952+0000 7fce4189c640 1 Processor -- start 2023-07-14T13:13:08.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.952+0000 7fce4189c640 1 -- start start 2023-07-14T13:13:08.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.952+0000 7fce4189c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce28003980 0x7fce3c1f69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:08.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.952+0000 7fce4189c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce3c0b1f50 0x7fce3c0c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:08.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.952+0000 7fce4189c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce3c15c310 0x7fce3c0b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:08.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.952+0000 7fce4189c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c1f6fa0 con 0x7fce28003980 2023-07-14T13:13:08.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.952+0000 7fce4189c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c0b1b30 con 0x7fce3c0b1f50 2023-07-14T13:13:08.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.952+0000 7fce4189c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c0b23c0 con 0x7fce3c15c310 2023-07-14T13:13:08.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.952+0000 7fce3affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce28003980 0x7fce3c1f69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:08.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.952+0000 7fce3affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce28003980 0x7fce3c1f69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60450/0 (socket says 172.21.15.5:60450) 2023-07-14T13:13:08.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.952+0000 7fce3affd640 1 -- 172.21.15.5:0/3346279856 learned_addr learned my addr 172.21.15.5:0/3346279856 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:08.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.952+0000 7fce33fff640 1 --2- 172.21.15.5:0/3346279856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce3c0b1f50 0x7fce3c0c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:08.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.952+0000 7fce3b7fe640 1 --2- 172.21.15.5:0/3346279856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce3c15c310 0x7fce3c0b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:08.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.952+0000 7fce3affd640 1 -- 172.21.15.5:0/3346279856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce3c15c310 msgr2=0x7fce3c0b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:08.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.952+0000 7fce3affd640 1 --2- 172.21.15.5:0/3346279856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce3c15c310 0x7fce3c0b3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:08.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.952+0000 7fce3affd640 1 -- 172.21.15.5:0/3346279856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce3c0b1f50 msgr2=0x7fce3c0c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:08.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.952+0000 7fce3affd640 1 --2- 172.21.15.5:0/3346279856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce3c0b1f50 0x7fce3c0c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:08.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.952+0000 7fce3affd640 1 -- 172.21.15.5:0/3346279856 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3c0b1190 con 0x7fce28003980 2023-07-14T13:13:08.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.952+0000 7fce33fff640 1 --2- 172.21.15.5:0/3346279856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce3c0b1f50 0x7fce3c0c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:13:08.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.952+0000 7fce3b7fe640 1 --2- 172.21.15.5:0/3346279856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce3c15c310 0x7fce3c0b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:13:08.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.952+0000 7fce3affd640 1 --2- 172.21.15.5:0/3346279856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce28003980 0x7fce3c1f69c0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fce2c01c880 tx=0x7fce2c0197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:08.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.952+0000 7fce38ff9640 1 -- 172.21.15.5:0/3346279856 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c004020 con 0x7fce28003980 2023-07-14T13:13:08.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.952+0000 7fce38ff9640 1 -- 172.21.15.5:0/3346279856 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2c0041a0 con 0x7fce28003980 2023-07-14T13:13:08.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.952+0000 7fce4189c640 1 -- 172.21.15.5:0/3346279856 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce3c0b1470 con 0x7fce28003980 2023-07-14T13:13:08.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.952+0000 7fce38ff9640 1 -- 172.21.15.5:0/3346279856 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c003620 con 0x7fce28003980 2023-07-14T13:13:08.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.952+0000 7fce4189c640 1 -- 172.21.15.5:0/3346279856 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce3c15c7b0 con 0x7fce28003980 2023-07-14T13:13:08.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.952+0000 7fce4189c640 1 -- 172.21.15.5:0/3346279856 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce3c0678d0 con 0x7fce28003980 2023-07-14T13:13:08.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.956+0000 7fce38ff9640 1 -- 172.21.15.5:0/3346279856 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fce2c0b4070 con 0x7fce28003980 2023-07-14T13:13:08.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.956+0000 7fce38ff9640 1 --2- 172.21.15.5:0/3346279856 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fce1c0663a0 0x7fce1c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:08.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.956+0000 7fce38ff9640 1 -- 172.21.15.5:0/3346279856 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fce2c11e2a0 con 0x7fce28003980 2023-07-14T13:13:08.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.956+0000 7fce33fff640 1 --2- 172.21.15.5:0/3346279856 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fce1c0663a0 0x7fce1c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:08.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.956+0000 7fce33fff640 1 --2- 172.21.15.5:0/3346279856 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fce1c0663a0 0x7fce1c068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fce3c0cb970 tx=0x7fce24009040 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:08.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:08.960+0000 7fce38ff9640 1 -- 172.21.15.5:0/3346279856 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fce2c0eb550 con 0x7fce28003980 2023-07-14T13:13:09.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.168+0000 7fce4189c640 1 -- 172.21.15.5:0/3346279856 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fce3c0cb1d0 con 0x7fce28003980 2023-07-14T13:13:09.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.168+0000 7fce38ff9640 1 -- 172.21.15.5:0/3346279856 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3232 (secure 0 0 0) 0x7fce2c0eeb70 con 0x7fce28003980 2023-07-14T13:13:09.206 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:13:09.206 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1248,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":156,"num_osds":8,"num_up_osds":8,"osd_up_since":1689339152,"num_in_osds":8,"osd_in_since":1689339143,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":364015616,"bytes_avail":772730097664,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":73,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":9336}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2023-07-14T13:12:51.389015+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-14T13:13:09.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.168+0000 7fce4189c640 1 -- 172.21.15.5:0/3346279856 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fce1c0663a0 msgr2=0x7fce1c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:09.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.168+0000 7fce4189c640 1 --2- 172.21.15.5:0/3346279856 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fce1c0663a0 0x7fce1c068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fce3c0cb970 tx=0x7fce24009040 comp rx=0 tx=0).stop 2023-07-14T13:13:09.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.168+0000 7fce4189c640 1 -- 172.21.15.5:0/3346279856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce28003980 msgr2=0x7fce3c1f69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:09.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.168+0000 7fce4189c640 1 --2- 172.21.15.5:0/3346279856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce28003980 0x7fce3c1f69c0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fce2c01c880 tx=0x7fce2c0197f0 comp rx=0 tx=0).stop 2023-07-14T13:13:09.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.168+0000 7fce4189c640 1 -- 172.21.15.5:0/3346279856 shutdown_connections 2023-07-14T13:13:09.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.168+0000 7fce4189c640 1 --2- 172.21.15.5:0/3346279856 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fce1c0663a0 0x7fce1c068850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:09.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.168+0000 7fce4189c640 1 --2- 172.21.15.5:0/3346279856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce3c15c310 0x7fce3c0b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:09.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.168+0000 7fce4189c640 1 --2- 172.21.15.5:0/3346279856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce3c0b1f50 0x7fce3c0c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:09.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.168+0000 7fce4189c640 1 --2- 172.21.15.5:0/3346279856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce28003980 0x7fce3c1f69c0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:09.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.168+0000 7fce4189c640 1 -- 172.21.15.5:0/3346279856 >> 172.21.15.5:0/3346279856 conn(0x7fce3c0afcf0 msgr2=0x7fce3c0cd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:09.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.168+0000 7fce4189c640 1 -- 172.21.15.5:0/3346279856 shutdown_connections 2023-07-14T13:13:09.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.168+0000 7fce4189c640 1 -- 172.21.15.5:0/3346279856 wait complete. 2023-07-14T13:13:09.226 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-14T13:13:09.227 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:13:09.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7de1434640 1 Processor -- start 2023-07-14T13:13:09.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7de1434640 1 -- start start 2023-07-14T13:13:09.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7de1434640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7ddc15bcb0 0x7f7ddc0b4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:09.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7de1434640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ddc0b10c0 0x7f7ddc0cffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:09.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7de1434640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ddc0ce750 con 0x7f7ddc0b3c50 2023-07-14T13:13:09.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7de1434640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ddc0cea30 con 0x7f7ddc15bcb0 2023-07-14T13:13:09.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7de1434640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc0ced10 con 0x7f7ddc0b10c0 2023-07-14T13:13:09.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7ddaffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7ddc0b3c50 0x7f7ddc0b4020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39026/0 (socket says 172.21.15.5:39026) 2023-07-14T13:13:09.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7ddaffd640 1 -- 172.21.15.5:0/2410215223 learned_addr learned my addr 172.21.15.5:0/2410215223 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:13:09.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7ddb7fe640 1 --2- 172.21.15.5:0/2410215223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ddc0b10c0 0x7f7ddc0cffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7dda7fc640 1 --2- 172.21.15.5:0/2410215223 >> v2:172.21.15.154:3300/0 conn(0x7f7ddc15bcb0 0x7f7ddc0b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7dd9ffb640 1 -- 172.21.15.5:0/2410215223 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315561617 0 0) 0x7f7ddc0ce750 con 0x7f7ddc0b3c50 2023-07-14T13:13:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7dd9ffb640 1 -- 172.21.15.5:0/2410215223 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dc4003530 con 0x7f7ddc0b3c50 2023-07-14T13:13:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7dd9ffb640 1 -- 172.21.15.5:0/2410215223 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1493969953 0 0) 0x7f7dc4003530 con 0x7f7ddc0b3c50 2023-07-14T13:13:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7dd9ffb640 1 -- 172.21.15.5:0/2410215223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ddc0b10c0 msgr2=0x7f7ddc0cffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7dd9ffb640 1 --2- 172.21.15.5:0/2410215223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ddc0b10c0 0x7f7ddc0cffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7dd9ffb640 1 -- 172.21.15.5:0/2410215223 >> v2:172.21.15.154:3300/0 conn(0x7f7ddc15bcb0 msgr2=0x7f7ddc0b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7dd9ffb640 1 --2- 172.21.15.5:0/2410215223 >> v2:172.21.15.154:3300/0 conn(0x7f7ddc15bcb0 0x7f7ddc0b4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7dd9ffb640 1 -- 172.21.15.5:0/2410215223 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ddc0ceff0 con 0x7f7ddc0b3c50 2023-07-14T13:13:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7dd9ffb640 1 -- 172.21.15.5:0/2410215223 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f7dcc001680 con 0x7f7ddc0b3c50 2023-07-14T13:13:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7dd9ffb640 1 -- 172.21.15.5:0/2410215223 >> v1:172.21.15.5:6789/0 conn(0x7f7ddc0b3c50 legacy=0x7f7ddc0b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7dd9ffb640 1 --2- 172.21.15.5:0/2410215223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dc4003980 0x7f7dc4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7dd9ffb640 1 --2- 172.21.15.5:0/2410215223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ddc0b10c0 0x7f7dc40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7dd9ffb640 1 --2- 172.21.15.5:0/2410215223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dc4004d10 0x7f7dc4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:09.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7dd9ffb640 1 -- 172.21.15.5:0/2410215223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc0cea30 con 0x7f7dc4004d10 2023-07-14T13:13:09.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7dd9ffb640 1 -- 172.21.15.5:0/2410215223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc0ced10 con 0x7f7dc4003980 2023-07-14T13:13:09.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7dd9ffb640 1 -- 172.21.15.5:0/2410215223 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc400b990 con 0x7f7ddc0b10c0 2023-07-14T13:13:09.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7ddb7fe640 1 --2- 172.21.15.5:0/2410215223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dc4004d10 0x7f7dc4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:09.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7ddaffd640 1 --2- 172.21.15.5:0/2410215223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dc4003980 0x7f7dc4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:09.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7dda7fc640 1 --2- 172.21.15.5:0/2410215223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ddc0b10c0 0x7f7dc40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:09.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7ddb7fe640 1 -- 172.21.15.5:0/2410215223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ddc0b10c0 msgr2=0x7f7dc40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:09.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7ddb7fe640 1 --2- 172.21.15.5:0/2410215223 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ddc0b10c0 0x7f7dc40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7ddb7fe640 1 -- 172.21.15.5:0/2410215223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dc4003980 msgr2=0x7f7dc4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7ddb7fe640 1 --2- 172.21.15.5:0/2410215223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dc4003980 0x7f7dc4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7ddb7fe640 1 -- 172.21.15.5:0/2410215223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc4003530 con 0x7f7dc4004d10 2023-07-14T13:13:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.376+0000 7f7ddaffd640 1 --2- 172.21.15.5:0/2410215223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dc4003980 0x7f7dc4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:13:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.380+0000 7f7ddb7fe640 1 --2- 172.21.15.5:0/2410215223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dc4004d10 0x7f7dc4005180 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009fc0 tx=0x7f7dd401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731f6157d5e3e9c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.380+0000 7f7dd9ffb640 1 -- 172.21.15.5:0/2410215223 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd40a5b60 con 0x7f7dc4004d10 2023-07-14T13:13:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.380+0000 7f7dd9ffb640 1 -- 172.21.15.5:0/2410215223 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd400f040 con 0x7f7dc4004d10 2023-07-14T13:13:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.380+0000 7f7dd9ffb640 1 -- 172.21.15.5:0/2410215223 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd40ad440 con 0x7f7dc4004d10 2023-07-14T13:13:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.380+0000 7f7de1434640 1 -- 172.21.15.5:0/2410215223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dc4004d10 msgr2=0x7f7dc4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.380+0000 7f7de1434640 1 --2- 172.21.15.5:0/2410215223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dc4004d10 0x7f7dc4005180 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009fc0 tx=0x7f7dd401cc60 comp rx=0 tx=0).stop 2023-07-14T13:13:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.380+0000 7f7ddb7fe640 1 -- 172.21.15.5:0/2410215223 reap_dead start 2023-07-14T13:13:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.380+0000 7f7de1434640 1 -- 172.21.15.5:0/2410215223 shutdown_connections 2023-07-14T13:13:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.380+0000 7f7de1434640 1 -- 172.21.15.5:0/2410215223 >> 172.21.15.5:0/2410215223 conn(0x7f7ddc069e80 msgr2=0x7f7ddc06a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.380+0000 7f7de1434640 1 -- 172.21.15.5:0/2410215223 shutdown_connections 2023-07-14T13:13:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.380+0000 7f7de1434640 1 -- 172.21.15.5:0/2410215223 wait complete. 2023-07-14T13:13:09.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.384+0000 7f7de1434640 1 Processor -- start 2023-07-14T13:13:09.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.384+0000 7f7de1434640 1 -- start start 2023-07-14T13:13:09.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.384+0000 7f7de1434640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dc4004d10 0x7f7ddc14a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:09.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.384+0000 7f7de1434640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ddc15cab0 0x7f7ddc15e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:09.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.384+0000 7f7de1434640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ddc15eb50 0x7f7ddc0b4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:09.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.384+0000 7f7de1434640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc1541d0 con 0x7f7ddc15eb50 2023-07-14T13:13:09.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.384+0000 7f7de1434640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc1f1350 con 0x7f7dc4004d10 2023-07-14T13:13:09.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.384+0000 7f7de1434640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc1543e0 con 0x7f7ddc15cab0 2023-07-14T13:13:09.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.384+0000 7f7ddb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ddc15eb50 0x7f7ddc0b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:09.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.384+0000 7f7ddb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ddc15eb50 0x7f7ddc0b4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43662/0 (socket says 172.21.15.5:43662) 2023-07-14T13:13:09.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.384+0000 7f7ddb7fe640 1 -- 172.21.15.5:0/2339568084 learned_addr learned my addr 172.21.15.5:0/2339568084 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:09.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.384+0000 7f7ddaffd640 1 --2- 172.21.15.5:0/2339568084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dc4004d10 0x7f7ddc14a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:09.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.384+0000 7f7dda7fc640 1 --2- 172.21.15.5:0/2339568084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ddc15cab0 0x7f7ddc15e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:09.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.384+0000 7f7ddb7fe640 1 -- 172.21.15.5:0/2339568084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ddc15cab0 msgr2=0x7f7ddc15e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:09.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.384+0000 7f7ddb7fe640 1 --2- 172.21.15.5:0/2339568084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ddc15cab0 0x7f7ddc15e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:09.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.384+0000 7f7ddb7fe640 1 -- 172.21.15.5:0/2339568084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dc4004d10 msgr2=0x7f7ddc14a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:09.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.384+0000 7f7ddb7fe640 1 --2- 172.21.15.5:0/2339568084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dc4004d10 0x7f7ddc14a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:09.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.384+0000 7f7ddb7fe640 1 -- 172.21.15.5:0/2339568084 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ddc1546c0 con 0x7f7ddc15eb50 2023-07-14T13:13:09.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.384+0000 7f7ddb7fe640 1 --2- 172.21.15.5:0/2339568084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ddc15eb50 0x7f7ddc0b4020 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4002240 tx=0x7f7dd4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:09.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.384+0000 7f7dc37fe640 1 -- 172.21.15.5:0/2339568084 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd40039a0 con 0x7f7ddc15eb50 2023-07-14T13:13:09.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.384+0000 7f7dc37fe640 1 -- 172.21.15.5:0/2339568084 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd4003b00 con 0x7f7ddc15eb50 2023-07-14T13:13:09.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.384+0000 7f7de1434640 1 -- 172.21.15.5:0/2339568084 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ddc1549a0 con 0x7f7ddc15eb50 2023-07-14T13:13:09.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.384+0000 7f7dc37fe640 1 -- 172.21.15.5:0/2339568084 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4003e70 con 0x7f7ddc15eb50 2023-07-14T13:13:09.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.384+0000 7f7de1434640 1 -- 172.21.15.5:0/2339568084 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ddc1551a0 con 0x7f7ddc15eb50 2023-07-14T13:13:09.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.388+0000 7f7de1434640 1 -- 172.21.15.5:0/2339568084 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ddc0cd9a0 con 0x7f7ddc15eb50 2023-07-14T13:13:09.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.388+0000 7f7dc37fe640 1 -- 172.21.15.5:0/2339568084 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7dd40b4040 con 0x7f7ddc15eb50 2023-07-14T13:13:09.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.388+0000 7f7dc37fe640 1 --2- 172.21.15.5:0/2339568084 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f7dc80663d0 0x7f7dc8068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:09.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.388+0000 7f7dc37fe640 1 -- 172.21.15.5:0/2339568084 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f7dd40a5e40 con 0x7f7ddc15eb50 2023-07-14T13:13:09.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.388+0000 7f7ddaffd640 1 --2- 172.21.15.5:0/2339568084 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f7dc80663d0 0x7f7dc8068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:09.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.388+0000 7f7ddaffd640 1 --2- 172.21.15.5:0/2339568084 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f7dc80663d0 0x7f7dc8068880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc000c10 tx=0x7f7dcc007900 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:09.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.392+0000 7f7dc37fe640 1 -- 172.21.15.5:0/2339568084 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7dd40eaec0 con 0x7f7ddc15eb50 2023-07-14T13:13:09.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.548+0000 7f7de1434640 1 -- 172.21.15.5:0/2339568084 --> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7ddc15d220 con 0x7f7dc80663d0 2023-07-14T13:13:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.556+0000 7f7dc37fe640 1 -- 172.21.15.5:0/2339568084 <== mgr.7604 v2:172.21.15.154:6832/1443161386 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311577 (secure 0 0 0) 0x7f7ddc15d220 con 0x7f7dc80663d0 2023-07-14T13:13:09.596 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:13:09.597 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:13:09.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.560+0000 7f7de1434640 1 -- 172.21.15.5:0/2339568084 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f7dc80663d0 msgr2=0x7f7dc8068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:09.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.560+0000 7f7de1434640 1 --2- 172.21.15.5:0/2339568084 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f7dc80663d0 0x7f7dc8068880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc000c10 tx=0x7f7dcc007900 comp rx=0 tx=0).stop 2023-07-14T13:13:09.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.560+0000 7f7de1434640 1 -- 172.21.15.5:0/2339568084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ddc15eb50 msgr2=0x7f7ddc0b4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:09.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.560+0000 7f7de1434640 1 --2- 172.21.15.5:0/2339568084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ddc15eb50 0x7f7ddc0b4020 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4002240 tx=0x7f7dd4009750 comp rx=0 tx=0).stop 2023-07-14T13:13:09.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.560+0000 7f7de1434640 1 -- 172.21.15.5:0/2339568084 shutdown_connections 2023-07-14T13:13:09.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.560+0000 7f7de1434640 1 --2- 172.21.15.5:0/2339568084 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f7dc80663d0 0x7f7dc8068880 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:09.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.560+0000 7f7de1434640 1 --2- 172.21.15.5:0/2339568084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ddc15eb50 0x7f7ddc0b4020 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:09.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.560+0000 7f7de1434640 1 --2- 172.21.15.5:0/2339568084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ddc15cab0 0x7f7ddc15e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:09.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.560+0000 7f7de1434640 1 --2- 172.21.15.5:0/2339568084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dc4004d10 0x7f7ddc14a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:09.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.560+0000 7f7de1434640 1 -- 172.21.15.5:0/2339568084 >> 172.21.15.5:0/2339568084 conn(0x7f7ddc069e80 msgr2=0x7f7ddc0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:09.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.560+0000 7f7de1434640 1 -- 172.21.15.5:0/2339568084 shutdown_connections 2023-07-14T13:13:09.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:09.560+0000 7f7de1434640 1 -- 172.21.15.5:0/2339568084 wait complete. 2023-07-14T13:13:09.616 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-14T13:13:09.392848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":484,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":310,"ondisk_log_size":310,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":355776,"kb_used_data":16384,"kb_used_omap":0,"kb_used_meta":339328,"kb_avail":754618944,"statfs":{"total":773094113280,"available":772729798656,"internally_reserved":0,"allocated":16777216,"data_stored":9100110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":347471872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.543817"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.205214+0000","last_change":"2023-07-14T13:13:03.878936+0000","last_active":"2023-07-14T13:13:05.205214+0000","last_peered":"2023-07-14T13:13:05.205214+0000","last_clean":"2023-07-14T13:13:05.205214+0000","last_became_active":"2023-07-14T13:13:03.878639+0000","last_became_peered":"2023-07-14T13:13:03.878639+0000","last_unstale":"2023-07-14T13:13:05.205214+0000","last_undegraded":"2023-07-14T13:13:05.205214+0000","last_fullsized":"2023-07-14T13:13:05.205214+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:17:55.538629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852268+0000","last_change":"2023-07-14T13:13:03.896614+0000","last_active":"2023-07-14T13:13:05.852268+0000","last_peered":"2023-07-14T13:13:05.852268+0000","last_clean":"2023-07-14T13:13:05.852268+0000","last_became_active":"2023-07-14T13:13:03.896309+0000","last_became_peered":"2023-07-14T13:13:03.896309+0000","last_unstale":"2023-07-14T13:13:05.852268+0000","last_undegraded":"2023-07-14T13:13:05.852268+0000","last_fullsized":"2023-07-14T13:13:05.852268+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:31:43.170253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852286+0000","last_change":"2023-07-14T13:13:03.890286+0000","last_active":"2023-07-14T13:13:05.852286+0000","last_peered":"2023-07-14T13:13:05.852286+0000","last_clean":"2023-07-14T13:13:05.852286+0000","last_became_active":"2023-07-14T13:13:03.889791+0000","last_became_peered":"2023-07-14T13:13:03.889791+0000","last_unstale":"2023-07-14T13:13:05.852286+0000","last_undegraded":"2023-07-14T13:13:05.852286+0000","last_fullsized":"2023-07-14T13:13:05.852286+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:08:16.587693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.851742+0000","last_change":"2023-07-14T13:13:03.882302+0000","last_active":"2023-07-14T13:13:05.851742+0000","last_peered":"2023-07-14T13:13:05.851742+0000","last_clean":"2023-07-14T13:13:05.851742+0000","last_became_active":"2023-07-14T13:13:03.882003+0000","last_became_peered":"2023-07-14T13:13:03.882003+0000","last_unstale":"2023-07-14T13:13:05.851742+0000","last_undegraded":"2023-07-14T13:13:05.851742+0000","last_fullsized":"2023-07-14T13:13:05.851742+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:41:22.447400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.881300+0000","last_change":"2023-07-14T13:13:03.894265+0000","last_active":"2023-07-14T13:13:04.881300+0000","last_peered":"2023-07-14T13:13:04.881300+0000","last_clean":"2023-07-14T13:13:04.881300+0000","last_became_active":"2023-07-14T13:13:03.893962+0000","last_became_peered":"2023-07-14T13:13:03.893962+0000","last_unstale":"2023-07-14T13:13:04.881300+0000","last_undegraded":"2023-07-14T13:13:04.881300+0000","last_fullsized":"2023-07-14T13:13:04.881300+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:54:41.788647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.234765+0000","last_change":"2023-07-14T13:13:03.881220+0000","last_active":"2023-07-14T13:13:05.234765+0000","last_peered":"2023-07-14T13:13:05.234765+0000","last_clean":"2023-07-14T13:13:05.234765+0000","last_became_active":"2023-07-14T13:13:03.880938+0000","last_became_peered":"2023-07-14T13:13:03.880938+0000","last_unstale":"2023-07-14T13:13:05.234765+0000","last_undegraded":"2023-07-14T13:13:05.234765+0000","last_fullsized":"2023-07-14T13:13:05.234765+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:19:16.043064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.886336+0000","last_change":"2023-07-14T13:13:03.887096+0000","last_active":"2023-07-14T13:13:04.886336+0000","last_peered":"2023-07-14T13:13:04.886336+0000","last_clean":"2023-07-14T13:13:04.886336+0000","last_became_active":"2023-07-14T13:13:03.886470+0000","last_became_peered":"2023-07-14T13:13:03.886470+0000","last_unstale":"2023-07-14T13:13:04.886336+0000","last_undegraded":"2023-07-14T13:13:04.886336+0000","last_fullsized":"2023-07-14T13:13:04.886336+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:48:38.066346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.851614+0000","last_change":"2023-07-14T13:13:03.886737+0000","last_active":"2023-07-14T13:13:05.851614+0000","last_peered":"2023-07-14T13:13:05.851614+0000","last_clean":"2023-07-14T13:13:05.851614+0000","last_became_active":"2023-07-14T13:13:03.886406+0000","last_became_peered":"2023-07-14T13:13:03.886406+0000","last_unstale":"2023-07-14T13:13:05.851614+0000","last_undegraded":"2023-07-14T13:13:05.851614+0000","last_fullsized":"2023-07-14T13:13:05.851614+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:39:05.393236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.235354+0000","last_change":"2023-07-14T13:13:03.872143+0000","last_active":"2023-07-14T13:13:05.235354+0000","last_peered":"2023-07-14T13:13:05.235354+0000","last_clean":"2023-07-14T13:13:05.235354+0000","last_became_active":"2023-07-14T13:13:03.871873+0000","last_became_peered":"2023-07-14T13:13:03.871873+0000","last_unstale":"2023-07-14T13:13:05.235354+0000","last_undegraded":"2023-07-14T13:13:05.235354+0000","last_fullsized":"2023-07-14T13:13:05.235354+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:21:17.471299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.848282+0000","last_change":"2023-07-14T13:13:03.893736+0000","last_active":"2023-07-14T13:13:05.848282+0000","last_peered":"2023-07-14T13:13:05.848282+0000","last_clean":"2023-07-14T13:13:05.848282+0000","last_became_active":"2023-07-14T13:13:03.893490+0000","last_became_peered":"2023-07-14T13:13:03.893490+0000","last_unstale":"2023-07-14T13:13:05.848282+0000","last_undegraded":"2023-07-14T13:13:05.848282+0000","last_fullsized":"2023-07-14T13:13:05.848282+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:00:52.299290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852343+0000","last_change":"2023-07-14T13:13:03.891381+0000","last_active":"2023-07-14T13:13:05.852343+0000","last_peered":"2023-07-14T13:13:05.852343+0000","last_clean":"2023-07-14T13:13:05.852343+0000","last_became_active":"2023-07-14T13:13:03.891095+0000","last_became_peered":"2023-07-14T13:13:03.891095+0000","last_unstale":"2023-07-14T13:13:05.852343+0000","last_undegraded":"2023-07-14T13:13:05.852343+0000","last_fullsized":"2023-07-14T13:13:05.852343+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:33:08.086118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.205218+0000","last_change":"2023-07-14T13:13:03.879648+0000","last_active":"2023-07-14T13:13:05.205218+0000","last_peered":"2023-07-14T13:13:05.205218+0000","last_clean":"2023-07-14T13:13:05.205218+0000","last_became_active":"2023-07-14T13:13:03.878744+0000","last_became_peered":"2023-07-14T13:13:03.878744+0000","last_unstale":"2023-07-14T13:13:05.205218+0000","last_undegraded":"2023-07-14T13:13:05.205218+0000","last_fullsized":"2023-07-14T13:13:05.205218+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:59:01.136384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.234879+0000","last_change":"2023-07-14T13:13:03.881412+0000","last_active":"2023-07-14T13:13:05.234879+0000","last_peered":"2023-07-14T13:13:05.234879+0000","last_clean":"2023-07-14T13:13:05.234879+0000","last_became_active":"2023-07-14T13:13:03.881151+0000","last_became_peered":"2023-07-14T13:13:03.881151+0000","last_unstale":"2023-07-14T13:13:05.234879+0000","last_undegraded":"2023-07-14T13:13:05.234879+0000","last_fullsized":"2023-07-14T13:13:05.234879+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:06:46.077623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.204888+0000","last_change":"2023-07-14T13:13:03.879854+0000","last_active":"2023-07-14T13:13:05.204888+0000","last_peered":"2023-07-14T13:13:05.204888+0000","last_clean":"2023-07-14T13:13:05.204888+0000","last_became_active":"2023-07-14T13:13:03.879589+0000","last_became_peered":"2023-07-14T13:13:03.879589+0000","last_unstale":"2023-07-14T13:13:05.204888+0000","last_undegraded":"2023-07-14T13:13:05.204888+0000","last_fullsized":"2023-07-14T13:13:05.204888+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:59:50.217998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.204780+0000","last_change":"2023-07-14T13:13:03.880544+0000","last_active":"2023-07-14T13:13:05.204780+0000","last_peered":"2023-07-14T13:13:05.204780+0000","last_clean":"2023-07-14T13:13:05.204780+0000","last_became_active":"2023-07-14T13:13:03.880282+0000","last_became_peered":"2023-07-14T13:13:03.880282+0000","last_unstale":"2023-07-14T13:13:05.204780+0000","last_undegraded":"2023-07-14T13:13:05.204780+0000","last_fullsized":"2023-07-14T13:13:05.204780+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:55:59.053693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.234736+0000","last_change":"2023-07-14T13:13:03.877595+0000","last_active":"2023-07-14T13:13:05.234736+0000","last_peered":"2023-07-14T13:13:05.234736+0000","last_clean":"2023-07-14T13:13:05.234736+0000","last_became_active":"2023-07-14T13:13:03.877312+0000","last_became_peered":"2023-07-14T13:13:03.877312+0000","last_unstale":"2023-07-14T13:13:05.234736+0000","last_undegraded":"2023-07-14T13:13:05.234736+0000","last_fullsized":"2023-07-14T13:13:05.234736+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:32:14.587565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.235355+0000","last_change":"2023-07-14T13:13:03.882804+0000","last_active":"2023-07-14T13:13:05.235355+0000","last_peered":"2023-07-14T13:13:05.235355+0000","last_clean":"2023-07-14T13:13:05.235355+0000","last_became_active":"2023-07-14T13:13:03.882548+0000","last_became_peered":"2023-07-14T13:13:03.882548+0000","last_unstale":"2023-07-14T13:13:05.235355+0000","last_undegraded":"2023-07-14T13:13:05.235355+0000","last_fullsized":"2023-07-14T13:13:05.235355+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:41:06.584653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.881449+0000","last_change":"2023-07-14T13:13:03.894751+0000","last_active":"2023-07-14T13:13:04.881449+0000","last_peered":"2023-07-14T13:13:04.881449+0000","last_clean":"2023-07-14T13:13:04.881449+0000","last_became_active":"2023-07-14T13:13:03.894495+0000","last_became_peered":"2023-07-14T13:13:03.894495+0000","last_unstale":"2023-07-14T13:13:04.881449+0000","last_undegraded":"2023-07-14T13:13:04.881449+0000","last_fullsized":"2023-07-14T13:13:04.881449+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:27:49.661224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.887051+0000","last_change":"2023-07-14T13:13:03.897533+0000","last_active":"2023-07-14T13:13:04.887051+0000","last_peered":"2023-07-14T13:13:04.887051+0000","last_clean":"2023-07-14T13:13:04.887051+0000","last_became_active":"2023-07-14T13:13:03.897212+0000","last_became_peered":"2023-07-14T13:13:03.897212+0000","last_unstale":"2023-07-14T13:13:04.887051+0000","last_undegraded":"2023-07-14T13:13:04.887051+0000","last_fullsized":"2023-07-14T13:13:04.887051+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:11.278302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.881642+0000","last_change":"2023-07-14T13:13:03.880789+0000","last_active":"2023-07-14T13:13:04.881642+0000","last_peered":"2023-07-14T13:13:04.881642+0000","last_clean":"2023-07-14T13:13:04.881642+0000","last_became_active":"2023-07-14T13:13:03.880532+0000","last_became_peered":"2023-07-14T13:13:03.880532+0000","last_unstale":"2023-07-14T13:13:04.881642+0000","last_undegraded":"2023-07-14T13:13:04.881642+0000","last_fullsized":"2023-07-14T13:13:04.881642+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:18:48.204835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.851780+0000","last_change":"2023-07-14T13:13:03.875667+0000","last_active":"2023-07-14T13:13:05.851780+0000","last_peered":"2023-07-14T13:13:05.851780+0000","last_clean":"2023-07-14T13:13:05.851780+0000","last_became_active":"2023-07-14T13:13:03.875380+0000","last_became_peered":"2023-07-14T13:13:03.875380+0000","last_unstale":"2023-07-14T13:13:05.851780+0000","last_undegraded":"2023-07-14T13:13:05.851780+0000","last_fullsized":"2023-07-14T13:13:05.851780+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:49:19.362937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.204867+0000","last_change":"2023-07-14T13:13:03.874307+0000","last_active":"2023-07-14T13:13:05.204867+0000","last_peered":"2023-07-14T13:13:05.204867+0000","last_clean":"2023-07-14T13:13:05.204867+0000","last_became_active":"2023-07-14T13:13:03.874055+0000","last_became_peered":"2023-07-14T13:13:03.874055+0000","last_unstale":"2023-07-14T13:13:05.204867+0000","last_undegraded":"2023-07-14T13:13:05.204867+0000","last_fullsized":"2023-07-14T13:13:05.204867+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:30:19.975859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.851795+0000","last_change":"2023-07-14T13:13:03.883703+0000","last_active":"2023-07-14T13:13:05.851795+0000","last_peered":"2023-07-14T13:13:05.851795+0000","last_clean":"2023-07-14T13:13:05.851795+0000","last_became_active":"2023-07-14T13:13:03.883432+0000","last_became_peered":"2023-07-14T13:13:03.883432+0000","last_unstale":"2023-07-14T13:13:05.851795+0000","last_undegraded":"2023-07-14T13:13:05.851795+0000","last_fullsized":"2023-07-14T13:13:05.851795+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:44:35.493260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.234778+0000","last_change":"2023-07-14T13:13:03.870623+0000","last_active":"2023-07-14T13:13:05.234778+0000","last_peered":"2023-07-14T13:13:05.234778+0000","last_clean":"2023-07-14T13:13:05.234778+0000","last_became_active":"2023-07-14T13:13:03.870346+0000","last_became_peered":"2023-07-14T13:13:03.870346+0000","last_unstale":"2023-07-14T13:13:05.234778+0000","last_undegraded":"2023-07-14T13:13:05.234778+0000","last_fullsized":"2023-07-14T13:13:05.234778+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:38.395140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852345+0000","last_change":"2023-07-14T13:13:03.895742+0000","last_active":"2023-07-14T13:13:05.852345+0000","last_peered":"2023-07-14T13:13:05.852345+0000","last_clean":"2023-07-14T13:13:05.852345+0000","last_became_active":"2023-07-14T13:13:03.895282+0000","last_became_peered":"2023-07-14T13:13:03.895282+0000","last_unstale":"2023-07-14T13:13:05.852345+0000","last_undegraded":"2023-07-14T13:13:05.852345+0000","last_fullsized":"2023-07-14T13:13:05.852345+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:39:05.393236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.853139+0000","last_change":"2023-07-14T13:13:03.887184+0000","last_active":"2023-07-14T13:13:05.853139+0000","last_peered":"2023-07-14T13:13:05.853139+0000","last_clean":"2023-07-14T13:13:05.853139+0000","last_became_active":"2023-07-14T13:13:03.886898+0000","last_became_peered":"2023-07-14T13:13:03.886898+0000","last_unstale":"2023-07-14T13:13:05.853139+0000","last_undegraded":"2023-07-14T13:13:05.853139+0000","last_fullsized":"2023-07-14T13:13:05.853139+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:36:14.018856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.887311+0000","last_change":"2023-07-14T13:13:03.892941+0000","last_active":"2023-07-14T13:13:04.887311+0000","last_peered":"2023-07-14T13:13:04.887311+0000","last_clean":"2023-07-14T13:13:04.887311+0000","last_became_active":"2023-07-14T13:13:03.892670+0000","last_became_peered":"2023-07-14T13:13:03.892670+0000","last_unstale":"2023-07-14T13:13:04.887311+0000","last_undegraded":"2023-07-14T13:13:04.887311+0000","last_fullsized":"2023-07-14T13:13:04.887311+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:32:21.936733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.848100+0000","last_change":"2023-07-14T13:13:03.892495+0000","last_active":"2023-07-14T13:13:05.848100+0000","last_peered":"2023-07-14T13:13:05.848100+0000","last_clean":"2023-07-14T13:13:05.848100+0000","last_became_active":"2023-07-14T13:13:03.892114+0000","last_became_peered":"2023-07-14T13:13:03.892114+0000","last_unstale":"2023-07-14T13:13:05.848100+0000","last_undegraded":"2023-07-14T13:13:05.848100+0000","last_fullsized":"2023-07-14T13:13:05.848100+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:25:40.308861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852075+0000","last_change":"2023-07-14T13:13:03.890431+0000","last_active":"2023-07-14T13:13:05.852075+0000","last_peered":"2023-07-14T13:13:05.852075+0000","last_clean":"2023-07-14T13:13:05.852075+0000","last_became_active":"2023-07-14T13:13:03.890114+0000","last_became_peered":"2023-07-14T13:13:03.890114+0000","last_unstale":"2023-07-14T13:13:05.852075+0000","last_undegraded":"2023-07-14T13:13:05.852075+0000","last_fullsized":"2023-07-14T13:13:05.852075+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:21:58.972119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852587+0000","last_change":"2023-07-14T13:13:03.895550+0000","last_active":"2023-07-14T13:13:05.852587+0000","last_peered":"2023-07-14T13:13:05.852587+0000","last_clean":"2023-07-14T13:13:05.852587+0000","last_became_active":"2023-07-14T13:13:03.895177+0000","last_became_peered":"2023-07-14T13:13:03.895177+0000","last_unstale":"2023-07-14T13:13:05.852587+0000","last_undegraded":"2023-07-14T13:13:05.852587+0000","last_fullsized":"2023-07-14T13:13:05.852587+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:08:48.317515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852641+0000","last_change":"2023-07-14T13:13:03.891455+0000","last_active":"2023-07-14T13:13:05.852641+0000","last_peered":"2023-07-14T13:13:05.852641+0000","last_clean":"2023-07-14T13:13:05.852641+0000","last_became_active":"2023-07-14T13:13:03.891177+0000","last_became_peered":"2023-07-14T13:13:03.891177+0000","last_unstale":"2023-07-14T13:13:05.852641+0000","last_undegraded":"2023-07-14T13:13:05.852641+0000","last_fullsized":"2023-07-14T13:13:05.852641+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:27:31.751567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.847737+0000","last_change":"2023-07-14T13:13:03.878478+0000","last_active":"2023-07-14T13:13:05.847737+0000","last_peered":"2023-07-14T13:13:05.847737+0000","last_clean":"2023-07-14T13:13:05.847737+0000","last_became_active":"2023-07-14T13:13:03.878176+0000","last_became_peered":"2023-07-14T13:13:03.878176+0000","last_unstale":"2023-07-14T13:13:05.847737+0000","last_undegraded":"2023-07-14T13:13:05.847737+0000","last_fullsized":"2023-07-14T13:13:05.847737+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:44:16.008203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.851778+0000","last_change":"2023-07-14T13:13:03.886539+0000","last_active":"2023-07-14T13:13:05.851778+0000","last_peered":"2023-07-14T13:13:05.851778+0000","last_clean":"2023-07-14T13:13:05.851778+0000","last_became_active":"2023-07-14T13:13:03.886181+0000","last_became_peered":"2023-07-14T13:13:03.886181+0000","last_unstale":"2023-07-14T13:13:05.851778+0000","last_undegraded":"2023-07-14T13:13:05.851778+0000","last_fullsized":"2023-07-14T13:13:05.851778+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:08:33.929541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"155'4","reported_seq":17,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.853387+0000","last_change":"2023-07-14T13:13:02.868993+0000","last_active":"2023-07-14T13:13:05.853387+0000","last_peered":"2023-07-14T13:13:05.853387+0000","last_clean":"2023-07-14T13:13:05.853387+0000","last_became_active":"2023-07-14T13:13:02.868694+0000","last_became_peered":"2023-07-14T13:13:02.868694+0000","last_unstale":"2023-07-14T13:13:05.853387+0000","last_undegraded":"2023-07-14T13:13:05.853387+0000","last_fullsized":"2023-07-14T13:13:05.853387+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:08:32.922469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.205079+0000","last_change":"2023-07-14T13:13:03.873763+0000","last_active":"2023-07-14T13:13:05.205079+0000","last_peered":"2023-07-14T13:13:05.205079+0000","last_clean":"2023-07-14T13:13:05.205079+0000","last_became_active":"2023-07-14T13:13:03.873430+0000","last_became_peered":"2023-07-14T13:13:03.873430+0000","last_unstale":"2023-07-14T13:13:05.205079+0000","last_undegraded":"2023-07-14T13:13:05.205079+0000","last_fullsized":"2023-07-14T13:13:05.205079+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:03:17.721216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"155'1","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.881653+0000","last_change":"2023-07-14T13:13:02.865527+0000","last_active":"2023-07-14T13:13:04.881653+0000","last_peered":"2023-07-14T13:13:04.881653+0000","last_clean":"2023-07-14T13:13:04.881653+0000","last_became_active":"2023-07-14T13:13:02.865167+0000","last_became_peered":"2023-07-14T13:13:02.865167+0000","last_unstale":"2023-07-14T13:13:04.881653+0000","last_undegraded":"2023-07-14T13:13:04.881653+0000","last_fullsized":"2023-07-14T13:13:04.881653+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:24:39.592603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.851762+0000","last_change":"2023-07-14T13:13:03.882677+0000","last_active":"2023-07-14T13:13:05.851762+0000","last_peered":"2023-07-14T13:13:05.851762+0000","last_clean":"2023-07-14T13:13:05.851762+0000","last_became_active":"2023-07-14T13:13:03.882347+0000","last_became_peered":"2023-07-14T13:13:03.882347+0000","last_unstale":"2023-07-14T13:13:05.851762+0000","last_undegraded":"2023-07-14T13:13:05.851762+0000","last_fullsized":"2023-07-14T13:13:05.851762+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:42:39.963430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"155'2","reported_seq":15,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.887298+0000","last_change":"2023-07-14T13:13:02.869637+0000","last_active":"2023-07-14T13:13:04.887298+0000","last_peered":"2023-07-14T13:13:04.887298+0000","last_clean":"2023-07-14T13:13:04.887298+0000","last_became_active":"2023-07-14T13:13:02.867864+0000","last_became_peered":"2023-07-14T13:13:02.867864+0000","last_unstale":"2023-07-14T13:13:04.887298+0000","last_undegraded":"2023-07-14T13:13:04.887298+0000","last_fullsized":"2023-07-14T13:13:04.887298+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:05:12.516817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.204985+0000","last_change":"2023-07-14T13:13:03.879094+0000","last_active":"2023-07-14T13:13:05.204985+0000","last_peered":"2023-07-14T13:13:05.204985+0000","last_clean":"2023-07-14T13:13:05.204985+0000","last_became_active":"2023-07-14T13:13:03.878833+0000","last_became_peered":"2023-07-14T13:13:03.878833+0000","last_unstale":"2023-07-14T13:13:05.204985+0000","last_undegraded":"2023-07-14T13:13:05.204985+0000","last_fullsized":"2023-07-14T13:13:05.204985+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:09:48.542411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"155'2","reported_seq":15,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.886800+0000","last_change":"2023-07-14T13:13:02.873106+0000","last_active":"2023-07-14T13:13:04.886800+0000","last_peered":"2023-07-14T13:13:04.886800+0000","last_clean":"2023-07-14T13:13:04.886800+0000","last_became_active":"2023-07-14T13:13:02.872783+0000","last_became_peered":"2023-07-14T13:13:02.872783+0000","last_unstale":"2023-07-14T13:13:04.886800+0000","last_undegraded":"2023-07-14T13:13:04.886800+0000","last_fullsized":"2023-07-14T13:13:04.886800+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:02:31.465050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.853004+0000","last_change":"2023-07-14T13:13:03.888032+0000","last_active":"2023-07-14T13:13:05.853004+0000","last_peered":"2023-07-14T13:13:05.853004+0000","last_clean":"2023-07-14T13:13:05.853004+0000","last_became_active":"2023-07-14T13:13:03.887630+0000","last_became_peered":"2023-07-14T13:13:03.887630+0000","last_unstale":"2023-07-14T13:13:05.853004+0000","last_undegraded":"2023-07-14T13:13:05.853004+0000","last_fullsized":"2023-07-14T13:13:05.853004+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:07:46.313546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"155'1","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852030+0000","last_change":"2023-07-14T13:13:02.864266+0000","last_active":"2023-07-14T13:13:05.852030+0000","last_peered":"2023-07-14T13:13:05.852030+0000","last_clean":"2023-07-14T13:13:05.852030+0000","last_became_active":"2023-07-14T13:13:02.863987+0000","last_became_peered":"2023-07-14T13:13:02.863987+0000","last_unstale":"2023-07-14T13:13:05.852030+0000","last_undegraded":"2023-07-14T13:13:05.852030+0000","last_fullsized":"2023-07-14T13:13:05.852030+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:00:40.516631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852144+0000","last_change":"2023-07-14T13:13:03.887190+0000","last_active":"2023-07-14T13:13:05.852144+0000","last_peered":"2023-07-14T13:13:05.852144+0000","last_clean":"2023-07-14T13:13:05.852144+0000","last_became_active":"2023-07-14T13:13:03.886898+0000","last_became_peered":"2023-07-14T13:13:03.886898+0000","last_unstale":"2023-07-14T13:13:05.852144+0000","last_undegraded":"2023-07-14T13:13:05.852144+0000","last_fullsized":"2023-07-14T13:13:05.852144+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:44:06.470333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"155'1","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.881267+0000","last_change":"2023-07-14T13:13:02.859614+0000","last_active":"2023-07-14T13:13:04.881267+0000","last_peered":"2023-07-14T13:13:04.881267+0000","last_clean":"2023-07-14T13:13:04.881267+0000","last_became_active":"2023-07-14T13:13:02.859348+0000","last_became_peered":"2023-07-14T13:13:02.859348+0000","last_unstale":"2023-07-14T13:13:04.881267+0000","last_undegraded":"2023-07-14T13:13:04.881267+0000","last_fullsized":"2023-07-14T13:13:04.881267+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:15.245487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.881528+0000","last_change":"2023-07-14T13:13:03.878550+0000","last_active":"2023-07-14T13:13:04.881528+0000","last_peered":"2023-07-14T13:13:04.881528+0000","last_clean":"2023-07-14T13:13:04.881528+0000","last_became_active":"2023-07-14T13:13:03.878292+0000","last_became_peered":"2023-07-14T13:13:03.878292+0000","last_unstale":"2023-07-14T13:13:04.881528+0000","last_undegraded":"2023-07-14T13:13:04.881528+0000","last_fullsized":"2023-07-14T13:13:04.881528+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:50:16.589345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.235130+0000","last_change":"2023-07-14T13:13:02.860411+0000","last_active":"2023-07-14T13:13:05.235130+0000","last_peered":"2023-07-14T13:13:05.235130+0000","last_clean":"2023-07-14T13:13:05.235130+0000","last_became_active":"2023-07-14T13:13:02.860127+0000","last_became_peered":"2023-07-14T13:13:02.860127+0000","last_unstale":"2023-07-14T13:13:05.235130+0000","last_undegraded":"2023-07-14T13:13:05.235130+0000","last_fullsized":"2023-07-14T13:13:05.235130+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:56:40.608821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.886936+0000","last_change":"2023-07-14T13:13:03.892742+0000","last_active":"2023-07-14T13:13:04.886936+0000","last_peered":"2023-07-14T13:13:04.886936+0000","last_clean":"2023-07-14T13:13:04.886936+0000","last_became_active":"2023-07-14T13:13:03.892370+0000","last_became_peered":"2023-07-14T13:13:03.892370+0000","last_unstale":"2023-07-14T13:13:04.886936+0000","last_undegraded":"2023-07-14T13:13:04.886936+0000","last_fullsized":"2023-07-14T13:13:04.886936+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:45:05.103466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852352+0000","last_change":"2023-07-14T13:13:02.870024+0000","last_active":"2023-07-14T13:13:05.852352+0000","last_peered":"2023-07-14T13:13:05.852352+0000","last_clean":"2023-07-14T13:13:05.852352+0000","last_became_active":"2023-07-14T13:13:02.869711+0000","last_became_peered":"2023-07-14T13:13:02.869711+0000","last_unstale":"2023-07-14T13:13:05.852352+0000","last_undegraded":"2023-07-14T13:13:05.852352+0000","last_fullsized":"2023-07-14T13:13:05.852352+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:33:39.619565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852104+0000","last_change":"2023-07-14T13:13:03.889872+0000","last_active":"2023-07-14T13:13:05.852104+0000","last_peered":"2023-07-14T13:13:05.852104+0000","last_clean":"2023-07-14T13:13:05.852104+0000","last_became_active":"2023-07-14T13:13:03.889591+0000","last_became_peered":"2023-07-14T13:13:03.889591+0000","last_unstale":"2023-07-14T13:13:05.852104+0000","last_undegraded":"2023-07-14T13:13:05.852104+0000","last_fullsized":"2023-07-14T13:13:05.852104+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:24:21.255937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"155'1","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852962+0000","last_change":"2023-07-14T13:13:02.866258+0000","last_active":"2023-07-14T13:13:05.852962+0000","last_peered":"2023-07-14T13:13:05.852962+0000","last_clean":"2023-07-14T13:13:05.852962+0000","last_became_active":"2023-07-14T13:13:02.865982+0000","last_became_peered":"2023-07-14T13:13:02.865982+0000","last_unstale":"2023-07-14T13:13:05.852962+0000","last_undegraded":"2023-07-14T13:13:05.852962+0000","last_fullsized":"2023-07-14T13:13:05.852962+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:39:20.286940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.886474+0000","last_change":"2023-07-14T13:13:03.887304+0000","last_active":"2023-07-14T13:13:04.886474+0000","last_peered":"2023-07-14T13:13:04.886474+0000","last_clean":"2023-07-14T13:13:04.886474+0000","last_became_active":"2023-07-14T13:13:03.886840+0000","last_became_peered":"2023-07-14T13:13:03.886840+0000","last_unstale":"2023-07-14T13:13:04.886474+0000","last_undegraded":"2023-07-14T13:13:04.886474+0000","last_fullsized":"2023-07-14T13:13:04.886474+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:54:44.315592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"155'2","reported_seq":15,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.853172+0000","last_change":"2023-07-14T13:13:02.868862+0000","last_active":"2023-07-14T13:13:05.853172+0000","last_peered":"2023-07-14T13:13:05.853172+0000","last_clean":"2023-07-14T13:13:05.853172+0000","last_became_active":"2023-07-14T13:13:02.868554+0000","last_became_peered":"2023-07-14T13:13:02.868554+0000","last_unstale":"2023-07-14T13:13:05.853172+0000","last_undegraded":"2023-07-14T13:13:05.853172+0000","last_fullsized":"2023-07-14T13:13:05.853172+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:43:06.009440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.886761+0000","last_change":"2023-07-14T13:13:03.891127+0000","last_active":"2023-07-14T13:13:04.886761+0000","last_peered":"2023-07-14T13:13:04.886761+0000","last_clean":"2023-07-14T13:13:04.886761+0000","last_became_active":"2023-07-14T13:13:03.890865+0000","last_became_peered":"2023-07-14T13:13:03.890865+0000","last_unstale":"2023-07-14T13:13:04.886761+0000","last_undegraded":"2023-07-14T13:13:04.886761+0000","last_fullsized":"2023-07-14T13:13:04.886761+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:40:08.734457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"155'1","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.235146+0000","last_change":"2023-07-14T13:13:02.859151+0000","last_active":"2023-07-14T13:13:05.235146+0000","last_peered":"2023-07-14T13:13:05.235146+0000","last_clean":"2023-07-14T13:13:05.235146+0000","last_became_active":"2023-07-14T13:13:02.858878+0000","last_became_peered":"2023-07-14T13:13:02.858878+0000","last_unstale":"2023-07-14T13:13:05.235146+0000","last_undegraded":"2023-07-14T13:13:05.235146+0000","last_fullsized":"2023-07-14T13:13:05.235146+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:05:57.543450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.848153+0000","last_change":"2023-07-14T13:13:03.880230+0000","last_active":"2023-07-14T13:13:05.848153+0000","last_peered":"2023-07-14T13:13:05.848153+0000","last_clean":"2023-07-14T13:13:05.848153+0000","last_became_active":"2023-07-14T13:13:03.879738+0000","last_became_peered":"2023-07-14T13:13:03.879738+0000","last_unstale":"2023-07-14T13:13:05.848153+0000","last_undegraded":"2023-07-14T13:13:05.848153+0000","last_fullsized":"2023-07-14T13:13:05.848153+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:27:48.564618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.881785+0000","last_change":"2023-07-14T13:13:02.863173+0000","last_active":"2023-07-14T13:13:04.881785+0000","last_peered":"2023-07-14T13:13:04.881785+0000","last_clean":"2023-07-14T13:13:04.881785+0000","last_became_active":"2023-07-14T13:13:02.862902+0000","last_became_peered":"2023-07-14T13:13:02.862902+0000","last_unstale":"2023-07-14T13:13:04.881785+0000","last_undegraded":"2023-07-14T13:13:04.881785+0000","last_fullsized":"2023-07-14T13:13:04.881785+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:11:50.885355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.881773+0000","last_change":"2023-07-14T13:13:03.876179+0000","last_active":"2023-07-14T13:13:04.881773+0000","last_peered":"2023-07-14T13:13:04.881773+0000","last_clean":"2023-07-14T13:13:04.881773+0000","last_became_active":"2023-07-14T13:13:03.875761+0000","last_became_peered":"2023-07-14T13:13:03.875761+0000","last_unstale":"2023-07-14T13:13:04.881773+0000","last_undegraded":"2023-07-14T13:13:04.881773+0000","last_fullsized":"2023-07-14T13:13:04.881773+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:36:06.428923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"155'2","reported_seq":15,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852748+0000","last_change":"2023-07-14T13:13:02.869185+0000","last_active":"2023-07-14T13:13:05.852748+0000","last_peered":"2023-07-14T13:13:05.852748+0000","last_clean":"2023-07-14T13:13:05.852748+0000","last_became_active":"2023-07-14T13:13:02.868925+0000","last_became_peered":"2023-07-14T13:13:02.868925+0000","last_unstale":"2023-07-14T13:13:05.852748+0000","last_undegraded":"2023-07-14T13:13:05.852748+0000","last_fullsized":"2023-07-14T13:13:05.852748+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:08:36.628796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.205195+0000","last_change":"2023-07-14T13:13:03.883788+0000","last_active":"2023-07-14T13:13:05.205195+0000","last_peered":"2023-07-14T13:13:05.205195+0000","last_clean":"2023-07-14T13:13:05.205195+0000","last_became_active":"2023-07-14T13:13:03.883528+0000","last_became_peered":"2023-07-14T13:13:03.883528+0000","last_unstale":"2023-07-14T13:13:05.205195+0000","last_undegraded":"2023-07-14T13:13:05.205195+0000","last_fullsized":"2023-07-14T13:13:05.205195+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:43:00.199292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.205095+0000","last_change":"2023-07-14T13:13:02.862781+0000","last_active":"2023-07-14T13:13:05.205095+0000","last_peered":"2023-07-14T13:13:05.205095+0000","last_clean":"2023-07-14T13:13:05.205095+0000","last_became_active":"2023-07-14T13:13:02.862518+0000","last_became_peered":"2023-07-14T13:13:02.862518+0000","last_unstale":"2023-07-14T13:13:05.205095+0000","last_undegraded":"2023-07-14T13:13:05.205095+0000","last_fullsized":"2023-07-14T13:13:05.205095+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:44:09.031988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.881582+0000","last_change":"2023-07-14T13:13:03.886633+0000","last_active":"2023-07-14T13:13:04.881582+0000","last_peered":"2023-07-14T13:13:04.881582+0000","last_clean":"2023-07-14T13:13:04.881582+0000","last_became_active":"2023-07-14T13:13:03.886323+0000","last_became_peered":"2023-07-14T13:13:03.886323+0000","last_unstale":"2023-07-14T13:13:04.881582+0000","last_undegraded":"2023-07-14T13:13:04.881582+0000","last_fullsized":"2023-07-14T13:13:04.881582+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:38:32.778958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.886526+0000","last_change":"2023-07-14T13:13:02.870693+0000","last_active":"2023-07-14T13:13:04.886526+0000","last_peered":"2023-07-14T13:13:04.886526+0000","last_clean":"2023-07-14T13:13:04.886526+0000","last_became_active":"2023-07-14T13:13:02.870369+0000","last_became_peered":"2023-07-14T13:13:02.870369+0000","last_unstale":"2023-07-14T13:13:04.886526+0000","last_undegraded":"2023-07-14T13:13:04.886526+0000","last_fullsized":"2023-07-14T13:13:04.886526+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:05:32.697136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852919+0000","last_change":"2023-07-14T13:13:03.883319+0000","last_active":"2023-07-14T13:13:05.852919+0000","last_peered":"2023-07-14T13:13:05.852919+0000","last_clean":"2023-07-14T13:13:05.852919+0000","last_became_active":"2023-07-14T13:13:03.883002+0000","last_became_peered":"2023-07-14T13:13:03.883002+0000","last_unstale":"2023-07-14T13:13:05.852919+0000","last_undegraded":"2023-07-14T13:13:05.852919+0000","last_fullsized":"2023-07-14T13:13:05.852919+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:50:54.922648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.234921+0000","last_change":"2023-07-14T13:13:02.860174+0000","last_active":"2023-07-14T13:13:05.234921+0000","last_peered":"2023-07-14T13:13:05.234921+0000","last_clean":"2023-07-14T13:13:05.234921+0000","last_became_active":"2023-07-14T13:13:02.859857+0000","last_became_peered":"2023-07-14T13:13:02.859857+0000","last_unstale":"2023-07-14T13:13:05.234921+0000","last_undegraded":"2023-07-14T13:13:05.234921+0000","last_fullsized":"2023-07-14T13:13:05.234921+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:15:57.068012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.881292+0000","last_change":"2023-07-14T13:13:03.881391+0000","last_active":"2023-07-14T13:13:04.881292+0000","last_peered":"2023-07-14T13:13:04.881292+0000","last_clean":"2023-07-14T13:13:04.881292+0000","last_became_active":"2023-07-14T13:13:03.881124+0000","last_became_peered":"2023-07-14T13:13:03.881124+0000","last_unstale":"2023-07-14T13:13:04.881292+0000","last_undegraded":"2023-07-14T13:13:04.881292+0000","last_fullsized":"2023-07-14T13:13:04.881292+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:13:20.744848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"155'2","reported_seq":15,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.205263+0000","last_change":"2023-07-14T13:13:02.868617+0000","last_active":"2023-07-14T13:13:05.205263+0000","last_peered":"2023-07-14T13:13:05.205263+0000","last_clean":"2023-07-14T13:13:05.205263+0000","last_became_active":"2023-07-14T13:13:02.868316+0000","last_became_peered":"2023-07-14T13:13:02.868316+0000","last_unstale":"2023-07-14T13:13:05.205263+0000","last_undegraded":"2023-07-14T13:13:05.205263+0000","last_fullsized":"2023-07-14T13:13:05.205263+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:42:29.394315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852589+0000","last_change":"2023-07-14T13:13:03.885372+0000","last_active":"2023-07-14T13:13:05.852589+0000","last_peered":"2023-07-14T13:13:05.852589+0000","last_clean":"2023-07-14T13:13:05.852589+0000","last_became_active":"2023-07-14T13:13:03.885017+0000","last_became_peered":"2023-07-14T13:13:03.885017+0000","last_unstale":"2023-07-14T13:13:05.852589+0000","last_undegraded":"2023-07-14T13:13:05.852589+0000","last_fullsized":"2023-07-14T13:13:05.852589+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:10:35.686032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"156'1","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852551+0000","last_change":"2023-07-14T13:13:02.868072+0000","last_active":"2023-07-14T13:13:05.852551+0000","last_peered":"2023-07-14T13:13:05.852551+0000","last_clean":"2023-07-14T13:13:05.852551+0000","last_became_active":"2023-07-14T13:13:02.867703+0000","last_became_peered":"2023-07-14T13:13:02.867703+0000","last_unstale":"2023-07-14T13:13:05.852551+0000","last_undegraded":"2023-07-14T13:13:05.852551+0000","last_fullsized":"2023-07-14T13:13:05.852551+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:34:34.876121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.886361+0000","last_change":"2023-07-14T13:13:03.888425+0000","last_active":"2023-07-14T13:13:04.886361+0000","last_peered":"2023-07-14T13:13:04.886361+0000","last_clean":"2023-07-14T13:13:04.886361+0000","last_became_active":"2023-07-14T13:13:03.888140+0000","last_became_peered":"2023-07-14T13:13:03.888140+0000","last_unstale":"2023-07-14T13:13:04.886361+0000","last_undegraded":"2023-07-14T13:13:04.886361+0000","last_fullsized":"2023-07-14T13:13:04.886361+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:03:14.085716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852285+0000","last_change":"2023-07-14T13:13:02.862857+0000","last_active":"2023-07-14T13:13:05.852285+0000","last_peered":"2023-07-14T13:13:05.852285+0000","last_clean":"2023-07-14T13:13:05.852285+0000","last_became_active":"2023-07-14T13:13:02.862567+0000","last_became_peered":"2023-07-14T13:13:02.862567+0000","last_unstale":"2023-07-14T13:13:05.852285+0000","last_undegraded":"2023-07-14T13:13:05.852285+0000","last_fullsized":"2023-07-14T13:13:05.852285+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:21:24.703712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.848331+0000","last_change":"2023-07-14T13:13:03.883972+0000","last_active":"2023-07-14T13:13:05.848331+0000","last_peered":"2023-07-14T13:13:05.848331+0000","last_clean":"2023-07-14T13:13:05.848331+0000","last_became_active":"2023-07-14T13:13:03.883671+0000","last_became_peered":"2023-07-14T13:13:03.883671+0000","last_unstale":"2023-07-14T13:13:05.848331+0000","last_undegraded":"2023-07-14T13:13:05.848331+0000","last_fullsized":"2023-07-14T13:13:05.848331+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:45:42.429204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.234996+0000","last_change":"2023-07-14T13:13:02.861021+0000","last_active":"2023-07-14T13:13:05.234996+0000","last_peered":"2023-07-14T13:13:05.234996+0000","last_clean":"2023-07-14T13:13:05.234996+0000","last_became_active":"2023-07-14T13:13:02.860774+0000","last_became_peered":"2023-07-14T13:13:02.860774+0000","last_unstale":"2023-07-14T13:13:05.234996+0000","last_undegraded":"2023-07-14T13:13:05.234996+0000","last_fullsized":"2023-07-14T13:13:05.234996+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:39:27.240471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.235047+0000","last_change":"2023-07-14T13:13:03.874942+0000","last_active":"2023-07-14T13:13:05.235047+0000","last_peered":"2023-07-14T13:13:05.235047+0000","last_clean":"2023-07-14T13:13:05.235047+0000","last_became_active":"2023-07-14T13:13:03.874155+0000","last_became_peered":"2023-07-14T13:13:03.874155+0000","last_unstale":"2023-07-14T13:13:05.235047+0000","last_undegraded":"2023-07-14T13:13:05.235047+0000","last_fullsized":"2023-07-14T13:13:05.235047+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:46:28.694064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.851935+0000","last_change":"2023-07-14T13:13:02.870130+0000","last_active":"2023-07-14T13:13:05.851935+0000","last_peered":"2023-07-14T13:13:05.851935+0000","last_clean":"2023-07-14T13:13:05.851935+0000","last_became_active":"2023-07-14T13:13:02.869853+0000","last_became_peered":"2023-07-14T13:13:02.869853+0000","last_unstale":"2023-07-14T13:13:05.851935+0000","last_undegraded":"2023-07-14T13:13:05.851935+0000","last_fullsized":"2023-07-14T13:13:05.851935+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:20:38.631136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.235109+0000","last_change":"2023-07-14T13:13:03.873139+0000","last_active":"2023-07-14T13:13:05.235109+0000","last_peered":"2023-07-14T13:13:05.235109+0000","last_clean":"2023-07-14T13:13:05.235109+0000","last_became_active":"2023-07-14T13:13:03.872839+0000","last_became_peered":"2023-07-14T13:13:03.872839+0000","last_unstale":"2023-07-14T13:13:05.235109+0000","last_undegraded":"2023-07-14T13:13:05.235109+0000","last_fullsized":"2023-07-14T13:13:05.235109+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:33:48.429868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.886839+0000","last_change":"2023-07-14T13:13:02.873722+0000","last_active":"2023-07-14T13:13:04.886839+0000","last_peered":"2023-07-14T13:13:04.886839+0000","last_clean":"2023-07-14T13:13:04.886839+0000","last_became_active":"2023-07-14T13:13:02.873392+0000","last_became_peered":"2023-07-14T13:13:02.873392+0000","last_unstale":"2023-07-14T13:13:04.886839+0000","last_undegraded":"2023-07-14T13:13:04.886839+0000","last_fullsized":"2023-07-14T13:13:04.886839+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:14:34.588088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.235075+0000","last_change":"2023-07-14T13:13:03.874025+0000","last_active":"2023-07-14T13:13:05.235075+0000","last_peered":"2023-07-14T13:13:05.235075+0000","last_clean":"2023-07-14T13:13:05.235075+0000","last_became_active":"2023-07-14T13:13:03.873729+0000","last_became_peered":"2023-07-14T13:13:03.873729+0000","last_unstale":"2023-07-14T13:13:05.235075+0000","last_undegraded":"2023-07-14T13:13:05.235075+0000","last_fullsized":"2023-07-14T13:13:05.235075+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:51:54.594481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.235000+0000","last_change":"2023-07-14T13:13:02.861693+0000","last_active":"2023-07-14T13:13:05.235000+0000","last_peered":"2023-07-14T13:13:05.235000+0000","last_clean":"2023-07-14T13:13:05.235000+0000","last_became_active":"2023-07-14T13:13:02.861433+0000","last_became_peered":"2023-07-14T13:13:02.861433+0000","last_unstale":"2023-07-14T13:13:05.235000+0000","last_undegraded":"2023-07-14T13:13:05.235000+0000","last_fullsized":"2023-07-14T13:13:05.235000+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:23:04.603038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.887099+0000","last_change":"2023-07-14T13:13:03.888993+0000","last_active":"2023-07-14T13:13:04.887099+0000","last_peered":"2023-07-14T13:13:04.887099+0000","last_clean":"2023-07-14T13:13:04.887099+0000","last_became_active":"2023-07-14T13:13:03.888729+0000","last_became_peered":"2023-07-14T13:13:03.888729+0000","last_unstale":"2023-07-14T13:13:04.887099+0000","last_undegraded":"2023-07-14T13:13:04.887099+0000","last_fullsized":"2023-07-14T13:13:04.887099+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:52.133562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.881418+0000","last_change":"2023-07-14T13:13:02.867349+0000","last_active":"2023-07-14T13:13:04.881418+0000","last_peered":"2023-07-14T13:13:04.881418+0000","last_clean":"2023-07-14T13:13:04.881418+0000","last_became_active":"2023-07-14T13:13:02.867008+0000","last_became_peered":"2023-07-14T13:13:02.867008+0000","last_unstale":"2023-07-14T13:13:04.881418+0000","last_undegraded":"2023-07-14T13:13:04.881418+0000","last_fullsized":"2023-07-14T13:13:04.881418+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:43:48.293510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852441+0000","last_change":"2023-07-14T13:13:03.890110+0000","last_active":"2023-07-14T13:13:05.852441+0000","last_peered":"2023-07-14T13:13:05.852441+0000","last_clean":"2023-07-14T13:13:05.852441+0000","last_became_active":"2023-07-14T13:13:03.889441+0000","last_became_peered":"2023-07-14T13:13:03.889441+0000","last_unstale":"2023-07-14T13:13:05.852441+0000","last_undegraded":"2023-07-14T13:13:05.852441+0000","last_fullsized":"2023-07-14T13:13:05.852441+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:59:12.191868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.886679+0000","last_change":"2023-07-14T13:13:02.871042+0000","last_active":"2023-07-14T13:13:04.886679+0000","last_peered":"2023-07-14T13:13:04.886679+0000","last_clean":"2023-07-14T13:13:04.886679+0000","last_became_active":"2023-07-14T13:13:02.870763+0000","last_became_peered":"2023-07-14T13:13:02.870763+0000","last_unstale":"2023-07-14T13:13:04.886679+0000","last_undegraded":"2023-07-14T13:13:04.886679+0000","last_fullsized":"2023-07-14T13:13:04.886679+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:29:50.905334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"144'271","reported_seq":957,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.886326+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:13:04.886326+0000","last_peered":"2023-07-14T13:13:04.886326+0000","last_clean":"2023-07-14T13:13:04.886326+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:13:04.886326+0000","last_undegraded":"2023-07-14T13:13:04.886326+0000","last_fullsized":"2023-07-14T13:13:04.886326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:39:49.308096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":250,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852047+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:13:05.852047+0000","last_peered":"2023-07-14T13:13:05.852047+0000","last_clean":"2023-07-14T13:13:05.852047+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:13:05.852047+0000","last_undegraded":"2023-07-14T13:13:05.852047+0000","last_fullsized":"2023-07-14T13:13:05.852047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:52:04.074613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.887087+0000","last_change":"2023-07-14T13:13:03.889283+0000","last_active":"2023-07-14T13:13:04.887087+0000","last_peered":"2023-07-14T13:13:04.887087+0000","last_clean":"2023-07-14T13:13:04.887087+0000","last_became_active":"2023-07-14T13:13:03.889022+0000","last_became_peered":"2023-07-14T13:13:03.889022+0000","last_unstale":"2023-07-14T13:13:04.887087+0000","last_undegraded":"2023-07-14T13:13:04.887087+0000","last_fullsized":"2023-07-14T13:13:04.887087+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:48:12.575366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852733+0000","last_change":"2023-07-14T13:13:02.869188+0000","last_active":"2023-07-14T13:13:05.852733+0000","last_peered":"2023-07-14T13:13:05.852733+0000","last_clean":"2023-07-14T13:13:05.852733+0000","last_became_active":"2023-07-14T13:13:02.868868+0000","last_became_peered":"2023-07-14T13:13:02.868868+0000","last_unstale":"2023-07-14T13:13:05.852733+0000","last_undegraded":"2023-07-14T13:13:05.852733+0000","last_fullsized":"2023-07-14T13:13:05.852733+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:11:14.320901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":255,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.886245+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:13:04.886245+0000","last_peered":"2023-07-14T13:13:04.886245+0000","last_clean":"2023-07-14T13:13:04.886245+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:13:04.886245+0000","last_undegraded":"2023-07-14T13:13:04.886245+0000","last_fullsized":"2023-07-14T13:13:04.886245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:25:01.538797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.881724+0000","last_change":"2023-07-14T13:13:03.881579+0000","last_active":"2023-07-14T13:13:04.881724+0000","last_peered":"2023-07-14T13:13:04.881724+0000","last_clean":"2023-07-14T13:13:04.881724+0000","last_became_active":"2023-07-14T13:13:03.881267+0000","last_became_peered":"2023-07-14T13:13:03.881267+0000","last_unstale":"2023-07-14T13:13:04.881724+0000","last_undegraded":"2023-07-14T13:13:04.881724+0000","last_fullsized":"2023-07-14T13:13:04.881724+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:52:30.141277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"155'8","reported_seq":21,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.234897+0000","last_change":"2023-07-14T13:13:02.870439+0000","last_active":"2023-07-14T13:13:05.234897+0000","last_peered":"2023-07-14T13:13:05.234897+0000","last_clean":"2023-07-14T13:13:05.234897+0000","last_became_active":"2023-07-14T13:13:02.870195+0000","last_became_peered":"2023-07-14T13:13:02.870195+0000","last_unstale":"2023-07-14T13:13:05.234897+0000","last_undegraded":"2023-07-14T13:13:05.234897+0000","last_fullsized":"2023-07-14T13:13:05.234897+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:53:29.633168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":256,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.204687+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:13:05.204687+0000","last_peered":"2023-07-14T13:13:05.204687+0000","last_clean":"2023-07-14T13:13:05.204687+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:13:05.204687+0000","last_undegraded":"2023-07-14T13:13:05.204687+0000","last_fullsized":"2023-07-14T13:13:05.204687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:46:28.286836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.848142+0000","last_change":"2023-07-14T13:13:03.877528+0000","last_active":"2023-07-14T13:13:05.848142+0000","last_peered":"2023-07-14T13:13:05.848142+0000","last_clean":"2023-07-14T13:13:05.848142+0000","last_became_active":"2023-07-14T13:13:03.877261+0000","last_became_peered":"2023-07-14T13:13:03.877261+0000","last_unstale":"2023-07-14T13:13:05.848142+0000","last_undegraded":"2023-07-14T13:13:05.848142+0000","last_fullsized":"2023-07-14T13:13:05.848142+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:08:13.653033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"155'2","reported_seq":15,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.204982+0000","last_change":"2023-07-14T13:13:02.862863+0000","last_active":"2023-07-14T13:13:05.204982+0000","last_peered":"2023-07-14T13:13:05.204982+0000","last_clean":"2023-07-14T13:13:05.204982+0000","last_became_active":"2023-07-14T13:13:02.862584+0000","last_became_peered":"2023-07-14T13:13:02.862584+0000","last_unstale":"2023-07-14T13:13:05.204982+0000","last_undegraded":"2023-07-14T13:13:05.204982+0000","last_fullsized":"2023-07-14T13:13:05.204982+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:55:22.616337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":250,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.851907+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:13:05.851907+0000","last_peered":"2023-07-14T13:13:05.851907+0000","last_clean":"2023-07-14T13:13:05.851907+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:13:05.851907+0000","last_undegraded":"2023-07-14T13:13:05.851907+0000","last_fullsized":"2023-07-14T13:13:05.851907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:22:07.233317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852695+0000","last_change":"2023-07-14T13:13:03.884962+0000","last_active":"2023-07-14T13:13:05.852695+0000","last_peered":"2023-07-14T13:13:05.852695+0000","last_clean":"2023-07-14T13:13:05.852695+0000","last_became_active":"2023-07-14T13:13:03.884496+0000","last_became_peered":"2023-07-14T13:13:03.884496+0000","last_unstale":"2023-07-14T13:13:05.852695+0000","last_undegraded":"2023-07-14T13:13:05.852695+0000","last_fullsized":"2023-07-14T13:13:05.852695+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:39:45.719233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"155'3","reported_seq":16,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.887444+0000","last_change":"2023-07-14T13:13:02.872225+0000","last_active":"2023-07-14T13:13:04.887444+0000","last_peered":"2023-07-14T13:13:04.887444+0000","last_clean":"2023-07-14T13:13:04.887444+0000","last_became_active":"2023-07-14T13:13:02.871842+0000","last_became_peered":"2023-07-14T13:13:02.871842+0000","last_unstale":"2023-07-14T13:13:04.887444+0000","last_undegraded":"2023-07-14T13:13:04.887444+0000","last_fullsized":"2023-07-14T13:13:04.887444+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:16:06.209153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":262,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.235127+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:13:05.235127+0000","last_peered":"2023-07-14T13:13:05.235127+0000","last_clean":"2023-07-14T13:13:05.235127+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:13:05.235127+0000","last_undegraded":"2023-07-14T13:13:05.235127+0000","last_fullsized":"2023-07-14T13:13:05.235127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:34:02.515304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852245+0000","last_change":"2023-07-14T13:13:03.882555+0000","last_active":"2023-07-14T13:13:05.852245+0000","last_peered":"2023-07-14T13:13:05.852245+0000","last_clean":"2023-07-14T13:13:05.852245+0000","last_became_active":"2023-07-14T13:13:03.882155+0000","last_became_peered":"2023-07-14T13:13:03.882155+0000","last_unstale":"2023-07-14T13:13:05.852245+0000","last_undegraded":"2023-07-14T13:13:05.852245+0000","last_fullsized":"2023-07-14T13:13:05.852245+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:36:36.035577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"155'6","reported_seq":19,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.887159+0000","last_change":"2023-07-14T13:13:02.870013+0000","last_active":"2023-07-14T13:13:04.887159+0000","last_peered":"2023-07-14T13:13:04.887159+0000","last_clean":"2023-07-14T13:13:04.887159+0000","last_became_active":"2023-07-14T13:13:02.869705+0000","last_became_peered":"2023-07-14T13:13:02.869705+0000","last_unstale":"2023-07-14T13:13:04.887159+0000","last_undegraded":"2023-07-14T13:13:04.887159+0000","last_fullsized":"2023-07-14T13:13:04.887159+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:28:20.154792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":254,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.887464+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:13:04.887464+0000","last_peered":"2023-07-14T13:13:04.887464+0000","last_clean":"2023-07-14T13:13:04.887464+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:13:04.887464+0000","last_undegraded":"2023-07-14T13:13:04.887464+0000","last_fullsized":"2023-07-14T13:13:04.887464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:33:06.647695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.204770+0000","last_change":"2023-07-14T13:13:03.881535+0000","last_active":"2023-07-14T13:13:05.204770+0000","last_peered":"2023-07-14T13:13:05.204770+0000","last_clean":"2023-07-14T13:13:05.204770+0000","last_became_active":"2023-07-14T13:13:03.881273+0000","last_became_peered":"2023-07-14T13:13:03.881273+0000","last_unstale":"2023-07-14T13:13:05.204770+0000","last_undegraded":"2023-07-14T13:13:05.204770+0000","last_fullsized":"2023-07-14T13:13:05.204770+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:27:42.977096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852879+0000","last_change":"2023-07-14T13:13:02.869873+0000","last_active":"2023-07-14T13:13:05.852879+0000","last_peered":"2023-07-14T13:13:05.852879+0000","last_clean":"2023-07-14T13:13:05.852879+0000","last_became_active":"2023-07-14T13:13:02.869590+0000","last_became_peered":"2023-07-14T13:13:02.869590+0000","last_unstale":"2023-07-14T13:13:05.852879+0000","last_undegraded":"2023-07-14T13:13:05.852879+0000","last_fullsized":"2023-07-14T13:13:05.852879+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:33:28.142917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":262,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.235104+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:13:05.235104+0000","last_peered":"2023-07-14T13:13:05.235104+0000","last_clean":"2023-07-14T13:13:05.235104+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:13:05.235104+0000","last_undegraded":"2023-07-14T13:13:05.235104+0000","last_fullsized":"2023-07-14T13:13:05.235104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:03.635062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.234879+0000","last_change":"2023-07-14T13:13:03.877834+0000","last_active":"2023-07-14T13:13:05.234879+0000","last_peered":"2023-07-14T13:13:05.234879+0000","last_clean":"2023-07-14T13:13:05.234879+0000","last_became_active":"2023-07-14T13:13:03.877543+0000","last_became_peered":"2023-07-14T13:13:03.877543+0000","last_unstale":"2023-07-14T13:13:05.234879+0000","last_undegraded":"2023-07-14T13:13:05.234879+0000","last_fullsized":"2023-07-14T13:13:05.234879+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:29:36.978851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.205053+0000","last_change":"2023-07-14T13:13:02.859953+0000","last_active":"2023-07-14T13:13:05.205053+0000","last_peered":"2023-07-14T13:13:05.205053+0000","last_clean":"2023-07-14T13:13:05.205053+0000","last_became_active":"2023-07-14T13:13:02.859642+0000","last_became_peered":"2023-07-14T13:13:02.859642+0000","last_unstale":"2023-07-14T13:13:05.205053+0000","last_undegraded":"2023-07-14T13:13:05.205053+0000","last_fullsized":"2023-07-14T13:13:05.205053+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:54:32.455249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":256,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.851888+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:13:05.851888+0000","last_peered":"2023-07-14T13:13:05.851888+0000","last_clean":"2023-07-14T13:13:05.851888+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:13:05.851888+0000","last_undegraded":"2023-07-14T13:13:05.851888+0000","last_fullsized":"2023-07-14T13:13:05.851888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:44:02.276046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575091,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59780,"kb_used_data":2492,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312060,"statfs":{"total":96636764160,"available":96575549440,"internally_reserved":0,"allocated":2551808,"data_stored":1581608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.68999999999999995,"15min":0.70699999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.84199999999999997,"5min":1.262,"15min":1.262},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71699999999999997,"15min":0.72899999999999998},"min":{"1min":0.54100000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.70599999999999996,"15min":0.72999999999999998},"min":{"1min":0.44,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83799999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72799999999999998,"15min":0.74299999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.67300000000000004}]},{"osd":2,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71199999999999997,"15min":0.72599999999999998},"min":{"1min":0.48999999999999999,"5min":0.46100000000000002,"15min":0.42699999999999999},"max":{"1min":0.91500000000000004,"5min":1.073,"15min":1.073},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.753},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84899999999999998,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.69699999999999995}]},{"osd":3,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.72699999999999998,"15min":0.73599999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.091,"5min":1.161,"15min":1.161},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73999999999999999,"15min":0.75600000000000001},"min":{"1min":0.51100000000000001,"5min":0.47899999999999998,"15min":0.41499999999999998},"max":{"1min":0.94899999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.753}]},{"osd":4,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56899999999999995,"15min":0.57899999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.318},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.022},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.40000000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.64500000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.42699999999999999,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.91000000000000003,"5min":0.98099999999999998,"15min":0.98299999999999998},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63100000000000001,"15min":0.64900000000000002},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.34100000000000003},"max":{"1min":0.80500000000000005,"5min":1.028,"15min":1.028},"last":0.74399999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.42699999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.0489999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.68100000000000005,"15min":0.67700000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.36299999999999999},"max":{"1min":1.151,"5min":4.1130000000000004,"15min":4.1130000000000004},"last":0.82699999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575092,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32952,"kb_used_data":1904,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1949696,"data_stored":990258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70699999999999996,"15min":0.72699999999999998},"min":{"1min":0.496,"5min":0.47899999999999998,"15min":0.38},"max":{"1min":0.89300000000000002,"5min":0.90400000000000003,"15min":0.996},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69999999999999996,"15min":0.72399999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88100000000000001,"5min":0.98199999999999998,"15min":1.0800000000000001},"last":0.501}]},{"osd":1,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70099999999999996,"15min":0.73299999999999998},"min":{"1min":0.48499999999999999,"5min":0.42299999999999999,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.0209999999999999},"last":0.75},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69199999999999995,"15min":0.71899999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82999999999999996,"5min":0.88100000000000001,"15min":1.077},"last":0.628}]},{"osd":2,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.746},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.45900000000000002},"max":{"1min":0.872,"5min":0.95099999999999996,"15min":1.105},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71799999999999997,"15min":0.745},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.92100000000000004,"5min":0.99099999999999999,"15min":1.0900000000000001},"last":0.66200000000000003}]},{"osd":3,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72899999999999998,"15min":0.76600000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89300000000000002,"5min":1.054,"15min":1.1359999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71399999999999997,"15min":0.753},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93600000000000005,"5min":0.94799999999999995,"15min":1.1080000000000001},"last":0.64700000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.63900000000000001,"15min":0.63600000000000001},"min":{"1min":0.47499999999999998,"5min":0.439,"15min":0.38500000000000001},"max":{"1min":0.79800000000000004,"5min":0.95499999999999996,"15min":1.0780000000000001},"last":0.438}]},{"osd":5,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63,"15min":0.64000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":1.579},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48199999999999998,"5min":0.46300000000000002,"15min":0.42399999999999999},"max":{"1min":0.85599999999999998,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.69099999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66000000000000003,"15min":0.65900000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91800000000000004,"5min":1.0940000000000001,"15min":1.1200000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.36199999999999999},"max":{"1min":0.90400000000000003,"5min":1.0209999999999999,"15min":1.657},"last":0.72799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575091,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50996,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320844,"statfs":{"total":96636764160,"available":96584544256,"internally_reserved":0,"allocated":1945600,"data_stored":989608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68799999999999994,"15min":0.72199999999999998},"min":{"1min":0.45400000000000001,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":2.6699999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.46500000000000002,"5min":0.41699999999999998,"15min":0.32800000000000001},"max":{"1min":0.86799999999999999,"5min":1.083,"15min":1.083},"last":0.69899999999999995}]},{"osd":1,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68899999999999995,"15min":0.71799999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44500000000000001},"max":{"1min":0.93600000000000005,"5min":1.05,"15min":1.079},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.71499999999999997,"15min":0.73899999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.36799999999999999},"max":{"1min":0.873,"5min":0.94599999999999995,"15min":2.706},"last":0.65300000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70899999999999996,"15min":0.72799999999999998},"min":{"1min":0.41199999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90700000000000003,"5min":1.212,"15min":1.212},"last":0.755},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70799999999999996,"15min":0.72699999999999998},"min":{"1min":0.497,"5min":0.44800000000000001,"15min":0.433},"max":{"1min":0.94599999999999995,"5min":1.181,"15min":1.181},"last":0.47399999999999998}]},{"osd":3,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72499999999999998,"15min":0.74199999999999999},"min":{"1min":0.53900000000000003,"5min":0.41799999999999998,"15min":0.377},"max":{"1min":0.88600000000000001,"5min":0.95199999999999996,"15min":2.7389999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73099999999999998,"15min":0.753},"min":{"1min":0.51600000000000001,"5min":0.47299999999999998,"15min":0.39700000000000002},"max":{"1min":0.94499999999999995,"5min":1.304,"15min":1.304},"last":0.79400000000000004}]},{"osd":4,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.628,"15min":0.628},"min":{"1min":0.38500000000000001,"5min":0.38,"15min":0.28599999999999998},"max":{"1min":0.85599999999999998,"5min":1.129,"15min":1.129},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.69099999999999995,"15min":0.68400000000000005},"min":{"1min":0.53700000000000003,"5min":0.39900000000000002,"15min":0.36299999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":2.7719999999999998},"last":0.63200000000000001}]},{"osd":6,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60199999999999998,"15min":0.60599999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.32700000000000001},"max":{"1min":0.89700000000000002,"5min":1.169,"15min":1.169},"last":0.87},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42599999999999999,"5min":0.39400000000000002,"15min":0.34300000000000003},"max":{"1min":0.91000000000000003,"5min":1.238,"15min":1.238},"last":0.67000000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64600000000000002,"15min":0.64300000000000002},"min":{"1min":0.40899999999999997,"5min":0.36899999999999999,"15min":0.32900000000000001},"max":{"1min":0.90800000000000003,"5min":1.026,"15min":3.0230000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68300000000000005,"15min":0.67700000000000005},"min":{"1min":0.49399999999999999,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.98199999999999998,"5min":1.2589999999999999,"15min":1.407},"last":0.84699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575091,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37040,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334800,"statfs":{"total":96636764160,"available":96598835200,"internally_reserved":0,"allocated":1941504,"data_stored":989586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.70599999999999996,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.411},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.45600000000000002,"5min":0.45100000000000001,"15min":0.435},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.1200000000000001},"last":0.627}]},{"osd":1,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71199999999999997,"15min":0.74399999999999999},"min":{"1min":0.496,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84099999999999997,"5min":0.92500000000000004,"15min":1.077},"last":0.75},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70399999999999996,"15min":0.72999999999999998},"min":{"1min":0.52700000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.0469999999999999},"last":0.69599999999999995}]},{"osd":2,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.71999999999999997,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.42199999999999999,"15min":0.35199999999999998},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72099999999999997,"15min":0.76400000000000001},"min":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.86699999999999999,"5min":0.98199999999999998,"15min":1.387},"last":0.71099999999999997}]},{"osd":3,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.49399999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89700000000000002,"5min":0.95399999999999996,"15min":1.008},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.74099999999999999,"15min":0.76600000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46800000000000003},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.54300000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.378},"max":{"1min":0.92200000000000004,"5min":0.92400000000000004,"15min":0.97099999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.40400000000000003,"15min":0.34599999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.56599999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.014},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67900000000000005,"15min":0.67000000000000004},"min":{"1min":0.48599999999999999,"5min":0.443,"15min":0.374},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.0289999999999999},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.69899999999999995,"15min":0.67200000000000004},"min":{"1min":0.51300000000000001,"5min":0.502,"15min":0.39000000000000001},"max":{"1min":0.91700000000000004,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.69799999999999995},"min":{"1min":0.48199999999999998,"5min":0.42799999999999999,"15min":0.40300000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.60699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575091,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37056,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":1957888,"data_stored":991220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.439,"15min":0.44700000000000001},"min":{"1min":0.26400000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.65900000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.47699999999999998,"15min":0.504},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64900000000000002,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.46300000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46800000000000003,"15min":0.47799999999999998},"min":{"1min":0.33400000000000002,"5min":0.32000000000000001,"15min":0.315},"max":{"1min":0.58599999999999997,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.51200000000000001,"15min":0.53500000000000003},"min":{"1min":0.33200000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66600000000000004,"5min":0.78600000000000003,"15min":1.0029999999999999},"last":0.42699999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54700000000000004,"15min":0.56599999999999995},"min":{"1min":0.38300000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.69199999999999995,"5min":0.998,"15min":0.998},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57399999999999995,"15min":0.59999999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.71199999999999997,"5min":0.88100000000000001,"15min":1.663},"last":0.45600000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.751},"min":{"1min":0.495,"5min":0.48199999999999998,"15min":0.441},"max":{"1min":0.97199999999999998,"5min":1.0269999999999999,"15min":1.284},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73599999999999999,"15min":0.77400000000000002},"min":{"1min":0.54100000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0780000000000001,"5min":1.175,"15min":1.175},"last":0.54100000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.745,"15min":0.78200000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.306},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.77800000000000002},"min":{"1min":0.57299999999999995,"5min":0.48699999999999999,"15min":0.372},"max":{"1min":1.014,"5min":1.121,"15min":1.1870000000000001},"last":0.58399999999999996}]},{"osd":6,"last update":"Fri Jul 14 13:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.73599999999999999,"15min":0.76800000000000002},"min":{"1min":0.56899999999999995,"5min":0.49099999999999999,"15min":0.48099999999999998},"max":{"1min":1.0409999999999999,"5min":1.113,"15min":1.117},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76900000000000002,"15min":0.80900000000000005},"min":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.54200000000000004},"max":{"1min":1.018,"5min":1.133,"15min":1.2589999999999999},"last":0.67100000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.75900000000000001,"15min":0.82099999999999995},"min":{"1min":0.55600000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0600000000000001,"5min":1.159,"15min":2.4910000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77400000000000002,"15min":0.81699999999999995},"min":{"1min":0.58699999999999997,"5min":0.53500000000000003,"15min":0.51600000000000001},"max":{"1min":1.1040000000000001,"5min":1.1359999999999999,"15min":1.595},"last":0.73999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575091,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59188,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312652,"statfs":{"total":96636764160,"available":96576155648,"internally_reserved":0,"allocated":1945600,"data_stored":989183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46200000000000002,"15min":0.46400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.80400000000000005,"5min":0.84699999999999998,"15min":1.3169999999999999},"last":0.434},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.50800000000000001,"15min":0.53300000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67300000000000004,"5min":0.80800000000000005,"15min":2.5270000000000001},"last":0.57499999999999996}]},{"osd":1,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.47699999999999998,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.29999999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":2.7200000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.55700000000000005},"min":{"1min":0.39900000000000002,"5min":0.36299999999999999,"15min":0.35999999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":2.6110000000000002},"last":0.623}]},{"osd":3,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55100000000000005,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.755,"5min":0.755,"15min":8.2530000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.77000000000000002,"5min":0.89600000000000002,"15min":1.2150000000000001},"last":0.55500000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.73999999999999999,"15min":0.76900000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.48399999999999999},"max":{"1min":0.91100000000000003,"5min":1.0840000000000001,"15min":1.1499999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73999999999999999,"15min":0.78100000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.47999999999999998},"max":{"1min":0.92900000000000005,"5min":1.0629999999999999,"15min":2.3170000000000002},"last":0.71199999999999997}]},{"osd":5,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.79900000000000004,"15min":0.84699999999999998},"min":{"1min":0.58399999999999996,"5min":0.56399999999999995,"15min":0.49399999999999999},"max":{"1min":1.0029999999999999,"5min":1.1319999999999999,"15min":3.1139999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.78900000000000003,"15min":0.83299999999999996},"min":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.55600000000000005},"max":{"1min":1.03,"5min":1.153,"15min":2.6850000000000001},"last":1.04}]},{"osd":6,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.73999999999999999,"15min":0.79100000000000004},"min":{"1min":0.52900000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98299999999999998,"5min":1.038,"15min":3.9849999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75900000000000001,"15min":0.80200000000000005},"min":{"1min":0.53900000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":3.391},"last":0.879}]},{"osd":7,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.76000000000000001,"15min":0.80900000000000005},"min":{"1min":0.56200000000000006,"5min":0.52300000000000002,"15min":0.5},"max":{"1min":1.022,"5min":1.1759999999999999,"15min":2.5779999999999998},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.78200000000000003,"15min":0.81799999999999995},"min":{"1min":0.57099999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.736,"5min":1.736,"15min":2.5939999999999999},"last":0.747}]}]},{"osd":1,"up_from":13,"seq":55834575092,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37044,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334796,"statfs":{"total":96636764160,"available":96598831104,"internally_reserved":0,"allocated":1945600,"data_stored":989656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42899999999999999,"15min":0.432},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26100000000000001},"max":{"1min":0.56000000000000005,"5min":0.65400000000000003,"15min":0.77200000000000002},"last":0.37},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.34999999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.74399999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.49199999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.35899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.63700000000000001,"5min":0.69199999999999995,"15min":1.0409999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.51700000000000002},"min":{"1min":0.32100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73199999999999998,"5min":0.77900000000000003,"15min":1.014},"last":0.41699999999999998}]},{"osd":3,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60799999999999998,"15min":0.628},"min":{"1min":0.502,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.746,"5min":0.80300000000000005,"15min":0.96299999999999997},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55300000000000005,"15min":0.57099999999999995},"min":{"1min":0.41299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69899999999999995,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.442}]},{"osd":4,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76400000000000001,"15min":0.78300000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48899999999999999},"max":{"1min":1.155,"5min":1.2110000000000001,"15min":1.236},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79000000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0640000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.74399999999999999}]},{"osd":5,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77700000000000002,"15min":0.78500000000000003},"min":{"1min":0.56000000000000005,"5min":0.52500000000000002,"15min":0.45200000000000001},"max":{"1min":1.1020000000000001,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.79600000000000004,"15min":0.80300000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.48599999999999999},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.72799999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.55900000000000005,"5min":0.53800000000000003,"15min":0.503},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.2170000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79900000000000004,"15min":0.81799999999999995},"min":{"1min":0.53700000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.68700000000000006}]},{"osd":7,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.58499999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82699999999999996,"15min":0.84199999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.76400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575093,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41720,"kb_used_data":2480,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330120,"statfs":{"total":96636764160,"available":96594042880,"internally_reserved":0,"allocated":2539520,"data_stored":1578991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.27300000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.59199999999999997,"5min":0.79600000000000004,"15min":2.2450000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.48299999999999998,"15min":0.50800000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27700000000000002},"max":{"1min":0.72999999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.47499999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.504,"15min":0.51400000000000001},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68200000000000005,"5min":0.84499999999999997,"15min":2.2989999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52800000000000002,"15min":0.54700000000000004},"min":{"1min":0.39100000000000001,"5min":0.34899999999999998,"15min":0.29899999999999999},"max":{"1min":0.71199999999999997,"5min":0.83599999999999997,"15min":0.90300000000000002},"last":0.51700000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.505,"15min":0.505},"min":{"1min":0.35199999999999998,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.84999999999999998},"last":0.5},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57799999999999996,"15min":0.58999999999999997},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76600000000000001,"5min":0.92700000000000005,"15min":2.4100000000000001},"last":0.59399999999999997}]},{"osd":4,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74399999999999999,"15min":0.77800000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1220000000000001,"5min":1.21,"15min":1.3640000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.75700000000000001,"15min":0.79300000000000004},"min":{"1min":0.57599999999999996,"5min":0.53500000000000003,"15min":0.44900000000000001},"max":{"1min":1.0289999999999999,"5min":1.0589999999999999,"15min":2.4460000000000002},"last":0.77400000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75600000000000001,"15min":0.79400000000000004},"min":{"1min":0.62,"5min":0.54200000000000004,"15min":0.47899999999999998},"max":{"1min":1.044,"5min":1.0669999999999999,"15min":1.3839999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.59399999999999997,"5min":0.5,"15min":0.48399999999999999},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.325},"last":0.87}]},{"osd":6,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77100000000000002,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.147,"5min":1.147,"15min":2.3380000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.755,"15min":0.79900000000000004},"min":{"1min":0.55600000000000005,"5min":0.51000000000000001,"15min":0.50600000000000001},"max":{"1min":0.97899999999999998,"5min":1.0900000000000001,"15min":1.3440000000000001},"last":0.78900000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76300000000000001,"15min":0.81599999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.503},"max":{"1min":1.016,"5min":1.1180000000000001,"15min":1.2749999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.77200000000000002,"15min":0.80500000000000005},"min":{"1min":0.56000000000000005,"5min":0.50600000000000001,"15min":0.502},"max":{"1min":1.077,"5min":1.0880000000000001,"15min":1.381},"last":0.93600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:13:12.624 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:13:12.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.740+0000 7fe188737640 1 Processor -- start 2023-07-14T13:13:12.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.740+0000 7fe188737640 1 -- start start 2023-07-14T13:13:12.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.744+0000 7fe188737640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe180158ce0 0x7fe180070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:12.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.744+0000 7fe188737640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1800c9730 0x7fe1800ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:12.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.744+0000 7fe188737640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1800cc700 con 0x7fe1800c8ad0 2023-07-14T13:13:12.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.744+0000 7fe188737640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1800b0ff0 con 0x7fe180158ce0 2023-07-14T13:13:12.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.744+0000 7fe188737640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe180070c80 con 0x7fe1800c9730 2023-07-14T13:13:12.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.744+0000 7fe1864d3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe180158ce0 0x7fe180070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.744+0000 7fe1864d3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe180158ce0 0x7fe180070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43672/0 (socket says 172.21.15.5:43672) 2023-07-14T13:13:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.744+0000 7fe185cd2640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe1800c8ad0 0x7fe1800c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39028/0 (socket says 172.21.15.5:39028) 2023-07-14T13:13:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.744+0000 7fe1864d3640 1 -- 172.21.15.5:0/3478908813 learned_addr learned my addr 172.21.15.5:0/3478908813 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.744+0000 7fe186cd4640 1 --2- 172.21.15.5:0/3478908813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1800c9730 0x7fe1800ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.744+0000 7fe1864d3640 1 -- 172.21.15.5:0/3478908813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1800c9730 msgr2=0x7fe1800ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.744+0000 7fe1864d3640 1 --2- 172.21.15.5:0/3478908813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1800c9730 0x7fe1800ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.744+0000 7fe1864d3640 1 -- 172.21.15.5:0/3478908813 >> v1:172.21.15.5:6789/0 conn(0x7fe1800c8ad0 legacy=0x7fe1800c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.744+0000 7fe1864d3640 1 -- 172.21.15.5:0/3478908813 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1800cbdd0 con 0x7fe180158ce0 2023-07-14T13:13:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.744+0000 7fe1854d1640 1 -- 172.21.15.5:0/3478908813 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4046617348 0 0) 0x7fe1800cc700 con 0x7fe1800c8ad0 2023-07-14T13:13:12.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.748+0000 7fe1864d3640 1 --2- 172.21.15.5:0/3478908813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe180158ce0 0x7fe180070450 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fe17c009870 tx=0x7fe17c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d263b52fd6b4d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:12.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.748+0000 7fe1854d1640 1 -- 172.21.15.5:0/3478908813 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c0ab610 con 0x7fe180158ce0 2023-07-14T13:13:12.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.748+0000 7fe1854d1640 1 -- 172.21.15.5:0/3478908813 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17c0ab770 con 0x7fe180158ce0 2023-07-14T13:13:12.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.748+0000 7fe1854d1640 1 -- 172.21.15.5:0/3478908813 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c0abb00 con 0x7fe180158ce0 2023-07-14T13:13:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.748+0000 7fe188737640 1 -- 172.21.15.5:0/3478908813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe180158ce0 msgr2=0x7fe180070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.748+0000 7fe188737640 1 --2- 172.21.15.5:0/3478908813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe180158ce0 0x7fe180070450 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fe17c009870 tx=0x7fe17c01c3f0 comp rx=0 tx=0).stop 2023-07-14T13:13:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.748+0000 7fe188737640 1 -- 172.21.15.5:0/3478908813 shutdown_connections 2023-07-14T13:13:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.748+0000 7fe188737640 1 --2- 172.21.15.5:0/3478908813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1800c9730 0x7fe1800ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.748+0000 7fe188737640 1 --2- 172.21.15.5:0/3478908813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe180158ce0 0x7fe180070450 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.748+0000 7fe188737640 1 -- 172.21.15.5:0/3478908813 >> 172.21.15.5:0/3478908813 conn(0x7fe1800afcf0 msgr2=0x7fe1800b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.748+0000 7fe188737640 1 -- 172.21.15.5:0/3478908813 shutdown_connections 2023-07-14T13:13:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.748+0000 7fe188737640 1 -- 172.21.15.5:0/3478908813 wait complete. 2023-07-14T13:13:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.748+0000 7fe188737640 1 Processor -- start 2023-07-14T13:13:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.748+0000 7fe188737640 1 -- start start 2023-07-14T13:13:12.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.752+0000 7fe188737640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1800c8ad0 0x7fe180137ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:12.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.752+0000 7fe188737640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1800c9730 0x7fe180138420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:12.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.752+0000 7fe188737640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe180158ce0 0x7fe18014dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.752+0000 7fe188737640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1800c6340 con 0x7fe1800c8ad0 2023-07-14T13:13:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.752+0000 7fe188737640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18014d020 con 0x7fe1800c9730 2023-07-14T13:13:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.752+0000 7fe188737640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1800c59a0 con 0x7fe180158ce0 2023-07-14T13:13:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.752+0000 7fe1864d3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1800c8ad0 0x7fe180137ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.752+0000 7fe1864d3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1800c8ad0 0x7fe180137ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43684/0 (socket says 172.21.15.5:43684) 2023-07-14T13:13:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.752+0000 7fe1864d3640 1 -- 172.21.15.5:0/3197953247 learned_addr learned my addr 172.21.15.5:0/3197953247 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.752+0000 7fe185cd2640 1 --2- 172.21.15.5:0/3197953247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1800c9730 0x7fe180138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:12.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.752+0000 7fe186cd4640 1 --2- 172.21.15.5:0/3197953247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe180158ce0 0x7fe18014dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:12.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.752+0000 7fe1864d3640 1 -- 172.21.15.5:0/3197953247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe180158ce0 msgr2=0x7fe18014dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:12.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.752+0000 7fe1864d3640 1 --2- 172.21.15.5:0/3197953247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe180158ce0 0x7fe18014dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:12.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.752+0000 7fe1864d3640 1 -- 172.21.15.5:0/3197953247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1800c9730 msgr2=0x7fe180138420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:12.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.752+0000 7fe1864d3640 1 --2- 172.21.15.5:0/3197953247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1800c9730 0x7fe180138420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:12.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.752+0000 7fe1864d3640 1 -- 172.21.15.5:0/3197953247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c0094d0 con 0x7fe1800c8ad0 2023-07-14T13:13:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.752+0000 7fe1864d3640 1 --2- 172.21.15.5:0/3197953247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1800c8ad0 0x7fe180137ee0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fe17c0ad040 tx=0x7fe17c01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.752+0000 7fe176ffd640 1 -- 172.21.15.5:0/3197953247 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c0abcf0 con 0x7fe1800c8ad0 2023-07-14T13:13:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.752+0000 7fe176ffd640 1 -- 172.21.15.5:0/3197953247 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17c0b8070 con 0x7fe1800c8ad0 2023-07-14T13:13:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.752+0000 7fe176ffd640 1 -- 172.21.15.5:0/3197953247 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c004230 con 0x7fe1800c8ad0 2023-07-14T13:13:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.752+0000 7fe188737640 1 -- 172.21.15.5:0/3197953247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1800c5c80 con 0x7fe1800c8ad0 2023-07-14T13:13:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.752+0000 7fe188737640 1 -- 172.21.15.5:0/3197953247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe18014e280 con 0x7fe1800c8ad0 2023-07-14T13:13:12.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.752+0000 7fe188737640 1 -- 172.21.15.5:0/3197953247 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1800ca1a0 con 0x7fe1800c8ad0 2023-07-14T13:13:12.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.756+0000 7fe176ffd640 1 -- 172.21.15.5:0/3197953247 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe17c004390 con 0x7fe1800c8ad0 2023-07-14T13:13:12.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.756+0000 7fe176ffd640 1 --2- 172.21.15.5:0/3197953247 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fe1640663a0 0x7fe164068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:12.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.756+0000 7fe176ffd640 1 -- 172.21.15.5:0/3197953247 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fe17c11e1f0 con 0x7fe1800c8ad0 2023-07-14T13:13:12.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.756+0000 7fe185cd2640 1 --2- 172.21.15.5:0/3197953247 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fe1640663a0 0x7fe164068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:12.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.756+0000 7fe185cd2640 1 --2- 172.21.15.5:0/3197953247 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fe1640663a0 0x7fe164068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe180070fa0 tx=0x7fe170007d60 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:12.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.760+0000 7fe176ffd640 1 -- 172.21.15.5:0/3197953247 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe17c0eb710 con 0x7fe1800c8ad0 2023-07-14T13:13:12.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.908+0000 7fe188737640 1 -- 172.21.15.5:0/3197953247 --> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe1801590b0 con 0x7fe1640663a0 2023-07-14T13:13:12.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.920+0000 7fe176ffd640 1 -- 172.21.15.5:0/3197953247 <== mgr.7604 v2:172.21.15.154:6832/1443161386 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311577 (secure 0 0 0) 0x7fe170004c80 con 0x7fe1640663a0 2023-07-14T13:13:12.960 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:13:12.961 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:13:12.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.924+0000 7fe188737640 1 -- 172.21.15.5:0/3197953247 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fe1640663a0 msgr2=0x7fe164068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:12.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.924+0000 7fe188737640 1 --2- 172.21.15.5:0/3197953247 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fe1640663a0 0x7fe164068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe180070fa0 tx=0x7fe170007d60 comp rx=0 tx=0).stop 2023-07-14T13:13:12.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.924+0000 7fe188737640 1 -- 172.21.15.5:0/3197953247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1800c8ad0 msgr2=0x7fe180137ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:12.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.924+0000 7fe188737640 1 --2- 172.21.15.5:0/3197953247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1800c8ad0 0x7fe180137ee0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fe17c0ad040 tx=0x7fe17c01ac30 comp rx=0 tx=0).stop 2023-07-14T13:13:12.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.924+0000 7fe188737640 1 -- 172.21.15.5:0/3197953247 shutdown_connections 2023-07-14T13:13:12.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.924+0000 7fe188737640 1 --2- 172.21.15.5:0/3197953247 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fe1640663a0 0x7fe164068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:12.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.924+0000 7fe188737640 1 --2- 172.21.15.5:0/3197953247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe180158ce0 0x7fe18014dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:12.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.924+0000 7fe188737640 1 --2- 172.21.15.5:0/3197953247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1800c9730 0x7fe180138420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:12.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.924+0000 7fe188737640 1 --2- 172.21.15.5:0/3197953247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1800c8ad0 0x7fe180137ee0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:12.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.924+0000 7fe188737640 1 -- 172.21.15.5:0/3197953247 >> 172.21.15.5:0/3197953247 conn(0x7fe1800afcf0 msgr2=0x7fe1801511e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:12.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.924+0000 7fe188737640 1 -- 172.21.15.5:0/3197953247 shutdown_connections 2023-07-14T13:13:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:12.924+0000 7fe188737640 1 -- 172.21.15.5:0/3197953247 wait complete. 2023-07-14T13:13:12.980 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-14T13:13:11.393476+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":484,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":310,"ondisk_log_size":310,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":355776,"kb_used_data":16384,"kb_used_omap":0,"kb_used_meta":339328,"kb_avail":754618944,"statfs":{"total":773094113280,"available":772729798656,"internally_reserved":0,"allocated":16777216,"data_stored":9100110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":347471872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002123"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.205214+0000","last_change":"2023-07-14T13:13:03.878936+0000","last_active":"2023-07-14T13:13:05.205214+0000","last_peered":"2023-07-14T13:13:05.205214+0000","last_clean":"2023-07-14T13:13:05.205214+0000","last_became_active":"2023-07-14T13:13:03.878639+0000","last_became_peered":"2023-07-14T13:13:03.878639+0000","last_unstale":"2023-07-14T13:13:05.205214+0000","last_undegraded":"2023-07-14T13:13:05.205214+0000","last_fullsized":"2023-07-14T13:13:05.205214+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:17:55.538629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852268+0000","last_change":"2023-07-14T13:13:03.896614+0000","last_active":"2023-07-14T13:13:05.852268+0000","last_peered":"2023-07-14T13:13:05.852268+0000","last_clean":"2023-07-14T13:13:05.852268+0000","last_became_active":"2023-07-14T13:13:03.896309+0000","last_became_peered":"2023-07-14T13:13:03.896309+0000","last_unstale":"2023-07-14T13:13:05.852268+0000","last_undegraded":"2023-07-14T13:13:05.852268+0000","last_fullsized":"2023-07-14T13:13:05.852268+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:31:43.170253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852286+0000","last_change":"2023-07-14T13:13:03.890286+0000","last_active":"2023-07-14T13:13:05.852286+0000","last_peered":"2023-07-14T13:13:05.852286+0000","last_clean":"2023-07-14T13:13:05.852286+0000","last_became_active":"2023-07-14T13:13:03.889791+0000","last_became_peered":"2023-07-14T13:13:03.889791+0000","last_unstale":"2023-07-14T13:13:05.852286+0000","last_undegraded":"2023-07-14T13:13:05.852286+0000","last_fullsized":"2023-07-14T13:13:05.852286+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:08:16.587693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.851742+0000","last_change":"2023-07-14T13:13:03.882302+0000","last_active":"2023-07-14T13:13:05.851742+0000","last_peered":"2023-07-14T13:13:05.851742+0000","last_clean":"2023-07-14T13:13:05.851742+0000","last_became_active":"2023-07-14T13:13:03.882003+0000","last_became_peered":"2023-07-14T13:13:03.882003+0000","last_unstale":"2023-07-14T13:13:05.851742+0000","last_undegraded":"2023-07-14T13:13:05.851742+0000","last_fullsized":"2023-07-14T13:13:05.851742+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:41:22.447400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.881300+0000","last_change":"2023-07-14T13:13:03.894265+0000","last_active":"2023-07-14T13:13:04.881300+0000","last_peered":"2023-07-14T13:13:04.881300+0000","last_clean":"2023-07-14T13:13:04.881300+0000","last_became_active":"2023-07-14T13:13:03.893962+0000","last_became_peered":"2023-07-14T13:13:03.893962+0000","last_unstale":"2023-07-14T13:13:04.881300+0000","last_undegraded":"2023-07-14T13:13:04.881300+0000","last_fullsized":"2023-07-14T13:13:04.881300+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:54:41.788647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.234765+0000","last_change":"2023-07-14T13:13:03.881220+0000","last_active":"2023-07-14T13:13:05.234765+0000","last_peered":"2023-07-14T13:13:05.234765+0000","last_clean":"2023-07-14T13:13:05.234765+0000","last_became_active":"2023-07-14T13:13:03.880938+0000","last_became_peered":"2023-07-14T13:13:03.880938+0000","last_unstale":"2023-07-14T13:13:05.234765+0000","last_undegraded":"2023-07-14T13:13:05.234765+0000","last_fullsized":"2023-07-14T13:13:05.234765+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:19:16.043064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.886336+0000","last_change":"2023-07-14T13:13:03.887096+0000","last_active":"2023-07-14T13:13:04.886336+0000","last_peered":"2023-07-14T13:13:04.886336+0000","last_clean":"2023-07-14T13:13:04.886336+0000","last_became_active":"2023-07-14T13:13:03.886470+0000","last_became_peered":"2023-07-14T13:13:03.886470+0000","last_unstale":"2023-07-14T13:13:04.886336+0000","last_undegraded":"2023-07-14T13:13:04.886336+0000","last_fullsized":"2023-07-14T13:13:04.886336+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:48:38.066346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.851614+0000","last_change":"2023-07-14T13:13:03.886737+0000","last_active":"2023-07-14T13:13:05.851614+0000","last_peered":"2023-07-14T13:13:05.851614+0000","last_clean":"2023-07-14T13:13:05.851614+0000","last_became_active":"2023-07-14T13:13:03.886406+0000","last_became_peered":"2023-07-14T13:13:03.886406+0000","last_unstale":"2023-07-14T13:13:05.851614+0000","last_undegraded":"2023-07-14T13:13:05.851614+0000","last_fullsized":"2023-07-14T13:13:05.851614+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:39:05.393236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.235354+0000","last_change":"2023-07-14T13:13:03.872143+0000","last_active":"2023-07-14T13:13:05.235354+0000","last_peered":"2023-07-14T13:13:05.235354+0000","last_clean":"2023-07-14T13:13:05.235354+0000","last_became_active":"2023-07-14T13:13:03.871873+0000","last_became_peered":"2023-07-14T13:13:03.871873+0000","last_unstale":"2023-07-14T13:13:05.235354+0000","last_undegraded":"2023-07-14T13:13:05.235354+0000","last_fullsized":"2023-07-14T13:13:05.235354+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:21:17.471299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.848282+0000","last_change":"2023-07-14T13:13:03.893736+0000","last_active":"2023-07-14T13:13:05.848282+0000","last_peered":"2023-07-14T13:13:05.848282+0000","last_clean":"2023-07-14T13:13:05.848282+0000","last_became_active":"2023-07-14T13:13:03.893490+0000","last_became_peered":"2023-07-14T13:13:03.893490+0000","last_unstale":"2023-07-14T13:13:05.848282+0000","last_undegraded":"2023-07-14T13:13:05.848282+0000","last_fullsized":"2023-07-14T13:13:05.848282+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:00:52.299290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852343+0000","last_change":"2023-07-14T13:13:03.891381+0000","last_active":"2023-07-14T13:13:05.852343+0000","last_peered":"2023-07-14T13:13:05.852343+0000","last_clean":"2023-07-14T13:13:05.852343+0000","last_became_active":"2023-07-14T13:13:03.891095+0000","last_became_peered":"2023-07-14T13:13:03.891095+0000","last_unstale":"2023-07-14T13:13:05.852343+0000","last_undegraded":"2023-07-14T13:13:05.852343+0000","last_fullsized":"2023-07-14T13:13:05.852343+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:33:08.086118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.205218+0000","last_change":"2023-07-14T13:13:03.879648+0000","last_active":"2023-07-14T13:13:05.205218+0000","last_peered":"2023-07-14T13:13:05.205218+0000","last_clean":"2023-07-14T13:13:05.205218+0000","last_became_active":"2023-07-14T13:13:03.878744+0000","last_became_peered":"2023-07-14T13:13:03.878744+0000","last_unstale":"2023-07-14T13:13:05.205218+0000","last_undegraded":"2023-07-14T13:13:05.205218+0000","last_fullsized":"2023-07-14T13:13:05.205218+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:59:01.136384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.234879+0000","last_change":"2023-07-14T13:13:03.881412+0000","last_active":"2023-07-14T13:13:05.234879+0000","last_peered":"2023-07-14T13:13:05.234879+0000","last_clean":"2023-07-14T13:13:05.234879+0000","last_became_active":"2023-07-14T13:13:03.881151+0000","last_became_peered":"2023-07-14T13:13:03.881151+0000","last_unstale":"2023-07-14T13:13:05.234879+0000","last_undegraded":"2023-07-14T13:13:05.234879+0000","last_fullsized":"2023-07-14T13:13:05.234879+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:06:46.077623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.204888+0000","last_change":"2023-07-14T13:13:03.879854+0000","last_active":"2023-07-14T13:13:05.204888+0000","last_peered":"2023-07-14T13:13:05.204888+0000","last_clean":"2023-07-14T13:13:05.204888+0000","last_became_active":"2023-07-14T13:13:03.879589+0000","last_became_peered":"2023-07-14T13:13:03.879589+0000","last_unstale":"2023-07-14T13:13:05.204888+0000","last_undegraded":"2023-07-14T13:13:05.204888+0000","last_fullsized":"2023-07-14T13:13:05.204888+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:59:50.217998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.204780+0000","last_change":"2023-07-14T13:13:03.880544+0000","last_active":"2023-07-14T13:13:05.204780+0000","last_peered":"2023-07-14T13:13:05.204780+0000","last_clean":"2023-07-14T13:13:05.204780+0000","last_became_active":"2023-07-14T13:13:03.880282+0000","last_became_peered":"2023-07-14T13:13:03.880282+0000","last_unstale":"2023-07-14T13:13:05.204780+0000","last_undegraded":"2023-07-14T13:13:05.204780+0000","last_fullsized":"2023-07-14T13:13:05.204780+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:55:59.053693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.234736+0000","last_change":"2023-07-14T13:13:03.877595+0000","last_active":"2023-07-14T13:13:05.234736+0000","last_peered":"2023-07-14T13:13:05.234736+0000","last_clean":"2023-07-14T13:13:05.234736+0000","last_became_active":"2023-07-14T13:13:03.877312+0000","last_became_peered":"2023-07-14T13:13:03.877312+0000","last_unstale":"2023-07-14T13:13:05.234736+0000","last_undegraded":"2023-07-14T13:13:05.234736+0000","last_fullsized":"2023-07-14T13:13:05.234736+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:32:14.587565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.235355+0000","last_change":"2023-07-14T13:13:03.882804+0000","last_active":"2023-07-14T13:13:05.235355+0000","last_peered":"2023-07-14T13:13:05.235355+0000","last_clean":"2023-07-14T13:13:05.235355+0000","last_became_active":"2023-07-14T13:13:03.882548+0000","last_became_peered":"2023-07-14T13:13:03.882548+0000","last_unstale":"2023-07-14T13:13:05.235355+0000","last_undegraded":"2023-07-14T13:13:05.235355+0000","last_fullsized":"2023-07-14T13:13:05.235355+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:41:06.584653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.881449+0000","last_change":"2023-07-14T13:13:03.894751+0000","last_active":"2023-07-14T13:13:04.881449+0000","last_peered":"2023-07-14T13:13:04.881449+0000","last_clean":"2023-07-14T13:13:04.881449+0000","last_became_active":"2023-07-14T13:13:03.894495+0000","last_became_peered":"2023-07-14T13:13:03.894495+0000","last_unstale":"2023-07-14T13:13:04.881449+0000","last_undegraded":"2023-07-14T13:13:04.881449+0000","last_fullsized":"2023-07-14T13:13:04.881449+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:27:49.661224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.887051+0000","last_change":"2023-07-14T13:13:03.897533+0000","last_active":"2023-07-14T13:13:04.887051+0000","last_peered":"2023-07-14T13:13:04.887051+0000","last_clean":"2023-07-14T13:13:04.887051+0000","last_became_active":"2023-07-14T13:13:03.897212+0000","last_became_peered":"2023-07-14T13:13:03.897212+0000","last_unstale":"2023-07-14T13:13:04.887051+0000","last_undegraded":"2023-07-14T13:13:04.887051+0000","last_fullsized":"2023-07-14T13:13:04.887051+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:09:11.278302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.881642+0000","last_change":"2023-07-14T13:13:03.880789+0000","last_active":"2023-07-14T13:13:04.881642+0000","last_peered":"2023-07-14T13:13:04.881642+0000","last_clean":"2023-07-14T13:13:04.881642+0000","last_became_active":"2023-07-14T13:13:03.880532+0000","last_became_peered":"2023-07-14T13:13:03.880532+0000","last_unstale":"2023-07-14T13:13:04.881642+0000","last_undegraded":"2023-07-14T13:13:04.881642+0000","last_fullsized":"2023-07-14T13:13:04.881642+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:18:48.204835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.851780+0000","last_change":"2023-07-14T13:13:03.875667+0000","last_active":"2023-07-14T13:13:05.851780+0000","last_peered":"2023-07-14T13:13:05.851780+0000","last_clean":"2023-07-14T13:13:05.851780+0000","last_became_active":"2023-07-14T13:13:03.875380+0000","last_became_peered":"2023-07-14T13:13:03.875380+0000","last_unstale":"2023-07-14T13:13:05.851780+0000","last_undegraded":"2023-07-14T13:13:05.851780+0000","last_fullsized":"2023-07-14T13:13:05.851780+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:49:19.362937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.204867+0000","last_change":"2023-07-14T13:13:03.874307+0000","last_active":"2023-07-14T13:13:05.204867+0000","last_peered":"2023-07-14T13:13:05.204867+0000","last_clean":"2023-07-14T13:13:05.204867+0000","last_became_active":"2023-07-14T13:13:03.874055+0000","last_became_peered":"2023-07-14T13:13:03.874055+0000","last_unstale":"2023-07-14T13:13:05.204867+0000","last_undegraded":"2023-07-14T13:13:05.204867+0000","last_fullsized":"2023-07-14T13:13:05.204867+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:30:19.975859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.851795+0000","last_change":"2023-07-14T13:13:03.883703+0000","last_active":"2023-07-14T13:13:05.851795+0000","last_peered":"2023-07-14T13:13:05.851795+0000","last_clean":"2023-07-14T13:13:05.851795+0000","last_became_active":"2023-07-14T13:13:03.883432+0000","last_became_peered":"2023-07-14T13:13:03.883432+0000","last_unstale":"2023-07-14T13:13:05.851795+0000","last_undegraded":"2023-07-14T13:13:05.851795+0000","last_fullsized":"2023-07-14T13:13:05.851795+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:44:35.493260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.234778+0000","last_change":"2023-07-14T13:13:03.870623+0000","last_active":"2023-07-14T13:13:05.234778+0000","last_peered":"2023-07-14T13:13:05.234778+0000","last_clean":"2023-07-14T13:13:05.234778+0000","last_became_active":"2023-07-14T13:13:03.870346+0000","last_became_peered":"2023-07-14T13:13:03.870346+0000","last_unstale":"2023-07-14T13:13:05.234778+0000","last_undegraded":"2023-07-14T13:13:05.234778+0000","last_fullsized":"2023-07-14T13:13:05.234778+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:38.395140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852345+0000","last_change":"2023-07-14T13:13:03.895742+0000","last_active":"2023-07-14T13:13:05.852345+0000","last_peered":"2023-07-14T13:13:05.852345+0000","last_clean":"2023-07-14T13:13:05.852345+0000","last_became_active":"2023-07-14T13:13:03.895282+0000","last_became_peered":"2023-07-14T13:13:03.895282+0000","last_unstale":"2023-07-14T13:13:05.852345+0000","last_undegraded":"2023-07-14T13:13:05.852345+0000","last_fullsized":"2023-07-14T13:13:05.852345+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:39:05.393236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.853139+0000","last_change":"2023-07-14T13:13:03.887184+0000","last_active":"2023-07-14T13:13:05.853139+0000","last_peered":"2023-07-14T13:13:05.853139+0000","last_clean":"2023-07-14T13:13:05.853139+0000","last_became_active":"2023-07-14T13:13:03.886898+0000","last_became_peered":"2023-07-14T13:13:03.886898+0000","last_unstale":"2023-07-14T13:13:05.853139+0000","last_undegraded":"2023-07-14T13:13:05.853139+0000","last_fullsized":"2023-07-14T13:13:05.853139+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:36:14.018856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.887311+0000","last_change":"2023-07-14T13:13:03.892941+0000","last_active":"2023-07-14T13:13:04.887311+0000","last_peered":"2023-07-14T13:13:04.887311+0000","last_clean":"2023-07-14T13:13:04.887311+0000","last_became_active":"2023-07-14T13:13:03.892670+0000","last_became_peered":"2023-07-14T13:13:03.892670+0000","last_unstale":"2023-07-14T13:13:04.887311+0000","last_undegraded":"2023-07-14T13:13:04.887311+0000","last_fullsized":"2023-07-14T13:13:04.887311+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:32:21.936733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.848100+0000","last_change":"2023-07-14T13:13:03.892495+0000","last_active":"2023-07-14T13:13:05.848100+0000","last_peered":"2023-07-14T13:13:05.848100+0000","last_clean":"2023-07-14T13:13:05.848100+0000","last_became_active":"2023-07-14T13:13:03.892114+0000","last_became_peered":"2023-07-14T13:13:03.892114+0000","last_unstale":"2023-07-14T13:13:05.848100+0000","last_undegraded":"2023-07-14T13:13:05.848100+0000","last_fullsized":"2023-07-14T13:13:05.848100+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:25:40.308861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852075+0000","last_change":"2023-07-14T13:13:03.890431+0000","last_active":"2023-07-14T13:13:05.852075+0000","last_peered":"2023-07-14T13:13:05.852075+0000","last_clean":"2023-07-14T13:13:05.852075+0000","last_became_active":"2023-07-14T13:13:03.890114+0000","last_became_peered":"2023-07-14T13:13:03.890114+0000","last_unstale":"2023-07-14T13:13:05.852075+0000","last_undegraded":"2023-07-14T13:13:05.852075+0000","last_fullsized":"2023-07-14T13:13:05.852075+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:21:58.972119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852587+0000","last_change":"2023-07-14T13:13:03.895550+0000","last_active":"2023-07-14T13:13:05.852587+0000","last_peered":"2023-07-14T13:13:05.852587+0000","last_clean":"2023-07-14T13:13:05.852587+0000","last_became_active":"2023-07-14T13:13:03.895177+0000","last_became_peered":"2023-07-14T13:13:03.895177+0000","last_unstale":"2023-07-14T13:13:05.852587+0000","last_undegraded":"2023-07-14T13:13:05.852587+0000","last_fullsized":"2023-07-14T13:13:05.852587+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:08:48.317515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852641+0000","last_change":"2023-07-14T13:13:03.891455+0000","last_active":"2023-07-14T13:13:05.852641+0000","last_peered":"2023-07-14T13:13:05.852641+0000","last_clean":"2023-07-14T13:13:05.852641+0000","last_became_active":"2023-07-14T13:13:03.891177+0000","last_became_peered":"2023-07-14T13:13:03.891177+0000","last_unstale":"2023-07-14T13:13:05.852641+0000","last_undegraded":"2023-07-14T13:13:05.852641+0000","last_fullsized":"2023-07-14T13:13:05.852641+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:27:31.751567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.847737+0000","last_change":"2023-07-14T13:13:03.878478+0000","last_active":"2023-07-14T13:13:05.847737+0000","last_peered":"2023-07-14T13:13:05.847737+0000","last_clean":"2023-07-14T13:13:05.847737+0000","last_became_active":"2023-07-14T13:13:03.878176+0000","last_became_peered":"2023-07-14T13:13:03.878176+0000","last_unstale":"2023-07-14T13:13:05.847737+0000","last_undegraded":"2023-07-14T13:13:05.847737+0000","last_fullsized":"2023-07-14T13:13:05.847737+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:44:16.008203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.851778+0000","last_change":"2023-07-14T13:13:03.886539+0000","last_active":"2023-07-14T13:13:05.851778+0000","last_peered":"2023-07-14T13:13:05.851778+0000","last_clean":"2023-07-14T13:13:05.851778+0000","last_became_active":"2023-07-14T13:13:03.886181+0000","last_became_peered":"2023-07-14T13:13:03.886181+0000","last_unstale":"2023-07-14T13:13:05.851778+0000","last_undegraded":"2023-07-14T13:13:05.851778+0000","last_fullsized":"2023-07-14T13:13:05.851778+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:08:33.929541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"155'4","reported_seq":17,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.853387+0000","last_change":"2023-07-14T13:13:02.868993+0000","last_active":"2023-07-14T13:13:05.853387+0000","last_peered":"2023-07-14T13:13:05.853387+0000","last_clean":"2023-07-14T13:13:05.853387+0000","last_became_active":"2023-07-14T13:13:02.868694+0000","last_became_peered":"2023-07-14T13:13:02.868694+0000","last_unstale":"2023-07-14T13:13:05.853387+0000","last_undegraded":"2023-07-14T13:13:05.853387+0000","last_fullsized":"2023-07-14T13:13:05.853387+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:08:32.922469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.205079+0000","last_change":"2023-07-14T13:13:03.873763+0000","last_active":"2023-07-14T13:13:05.205079+0000","last_peered":"2023-07-14T13:13:05.205079+0000","last_clean":"2023-07-14T13:13:05.205079+0000","last_became_active":"2023-07-14T13:13:03.873430+0000","last_became_peered":"2023-07-14T13:13:03.873430+0000","last_unstale":"2023-07-14T13:13:05.205079+0000","last_undegraded":"2023-07-14T13:13:05.205079+0000","last_fullsized":"2023-07-14T13:13:05.205079+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:03:17.721216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"155'1","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.881653+0000","last_change":"2023-07-14T13:13:02.865527+0000","last_active":"2023-07-14T13:13:04.881653+0000","last_peered":"2023-07-14T13:13:04.881653+0000","last_clean":"2023-07-14T13:13:04.881653+0000","last_became_active":"2023-07-14T13:13:02.865167+0000","last_became_peered":"2023-07-14T13:13:02.865167+0000","last_unstale":"2023-07-14T13:13:04.881653+0000","last_undegraded":"2023-07-14T13:13:04.881653+0000","last_fullsized":"2023-07-14T13:13:04.881653+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:24:39.592603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.851762+0000","last_change":"2023-07-14T13:13:03.882677+0000","last_active":"2023-07-14T13:13:05.851762+0000","last_peered":"2023-07-14T13:13:05.851762+0000","last_clean":"2023-07-14T13:13:05.851762+0000","last_became_active":"2023-07-14T13:13:03.882347+0000","last_became_peered":"2023-07-14T13:13:03.882347+0000","last_unstale":"2023-07-14T13:13:05.851762+0000","last_undegraded":"2023-07-14T13:13:05.851762+0000","last_fullsized":"2023-07-14T13:13:05.851762+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:42:39.963430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"155'2","reported_seq":15,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.887298+0000","last_change":"2023-07-14T13:13:02.869637+0000","last_active":"2023-07-14T13:13:04.887298+0000","last_peered":"2023-07-14T13:13:04.887298+0000","last_clean":"2023-07-14T13:13:04.887298+0000","last_became_active":"2023-07-14T13:13:02.867864+0000","last_became_peered":"2023-07-14T13:13:02.867864+0000","last_unstale":"2023-07-14T13:13:04.887298+0000","last_undegraded":"2023-07-14T13:13:04.887298+0000","last_fullsized":"2023-07-14T13:13:04.887298+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:05:12.516817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.204985+0000","last_change":"2023-07-14T13:13:03.879094+0000","last_active":"2023-07-14T13:13:05.204985+0000","last_peered":"2023-07-14T13:13:05.204985+0000","last_clean":"2023-07-14T13:13:05.204985+0000","last_became_active":"2023-07-14T13:13:03.878833+0000","last_became_peered":"2023-07-14T13:13:03.878833+0000","last_unstale":"2023-07-14T13:13:05.204985+0000","last_undegraded":"2023-07-14T13:13:05.204985+0000","last_fullsized":"2023-07-14T13:13:05.204985+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:09:48.542411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"155'2","reported_seq":15,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.886800+0000","last_change":"2023-07-14T13:13:02.873106+0000","last_active":"2023-07-14T13:13:04.886800+0000","last_peered":"2023-07-14T13:13:04.886800+0000","last_clean":"2023-07-14T13:13:04.886800+0000","last_became_active":"2023-07-14T13:13:02.872783+0000","last_became_peered":"2023-07-14T13:13:02.872783+0000","last_unstale":"2023-07-14T13:13:04.886800+0000","last_undegraded":"2023-07-14T13:13:04.886800+0000","last_fullsized":"2023-07-14T13:13:04.886800+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:02:31.465050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.853004+0000","last_change":"2023-07-14T13:13:03.888032+0000","last_active":"2023-07-14T13:13:05.853004+0000","last_peered":"2023-07-14T13:13:05.853004+0000","last_clean":"2023-07-14T13:13:05.853004+0000","last_became_active":"2023-07-14T13:13:03.887630+0000","last_became_peered":"2023-07-14T13:13:03.887630+0000","last_unstale":"2023-07-14T13:13:05.853004+0000","last_undegraded":"2023-07-14T13:13:05.853004+0000","last_fullsized":"2023-07-14T13:13:05.853004+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:07:46.313546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"155'1","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852030+0000","last_change":"2023-07-14T13:13:02.864266+0000","last_active":"2023-07-14T13:13:05.852030+0000","last_peered":"2023-07-14T13:13:05.852030+0000","last_clean":"2023-07-14T13:13:05.852030+0000","last_became_active":"2023-07-14T13:13:02.863987+0000","last_became_peered":"2023-07-14T13:13:02.863987+0000","last_unstale":"2023-07-14T13:13:05.852030+0000","last_undegraded":"2023-07-14T13:13:05.852030+0000","last_fullsized":"2023-07-14T13:13:05.852030+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:00:40.516631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852144+0000","last_change":"2023-07-14T13:13:03.887190+0000","last_active":"2023-07-14T13:13:05.852144+0000","last_peered":"2023-07-14T13:13:05.852144+0000","last_clean":"2023-07-14T13:13:05.852144+0000","last_became_active":"2023-07-14T13:13:03.886898+0000","last_became_peered":"2023-07-14T13:13:03.886898+0000","last_unstale":"2023-07-14T13:13:05.852144+0000","last_undegraded":"2023-07-14T13:13:05.852144+0000","last_fullsized":"2023-07-14T13:13:05.852144+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:44:06.470333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"155'1","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.881267+0000","last_change":"2023-07-14T13:13:02.859614+0000","last_active":"2023-07-14T13:13:04.881267+0000","last_peered":"2023-07-14T13:13:04.881267+0000","last_clean":"2023-07-14T13:13:04.881267+0000","last_became_active":"2023-07-14T13:13:02.859348+0000","last_became_peered":"2023-07-14T13:13:02.859348+0000","last_unstale":"2023-07-14T13:13:04.881267+0000","last_undegraded":"2023-07-14T13:13:04.881267+0000","last_fullsized":"2023-07-14T13:13:04.881267+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:15.245487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.881528+0000","last_change":"2023-07-14T13:13:03.878550+0000","last_active":"2023-07-14T13:13:04.881528+0000","last_peered":"2023-07-14T13:13:04.881528+0000","last_clean":"2023-07-14T13:13:04.881528+0000","last_became_active":"2023-07-14T13:13:03.878292+0000","last_became_peered":"2023-07-14T13:13:03.878292+0000","last_unstale":"2023-07-14T13:13:04.881528+0000","last_undegraded":"2023-07-14T13:13:04.881528+0000","last_fullsized":"2023-07-14T13:13:04.881528+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:50:16.589345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.235130+0000","last_change":"2023-07-14T13:13:02.860411+0000","last_active":"2023-07-14T13:13:05.235130+0000","last_peered":"2023-07-14T13:13:05.235130+0000","last_clean":"2023-07-14T13:13:05.235130+0000","last_became_active":"2023-07-14T13:13:02.860127+0000","last_became_peered":"2023-07-14T13:13:02.860127+0000","last_unstale":"2023-07-14T13:13:05.235130+0000","last_undegraded":"2023-07-14T13:13:05.235130+0000","last_fullsized":"2023-07-14T13:13:05.235130+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:56:40.608821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.886936+0000","last_change":"2023-07-14T13:13:03.892742+0000","last_active":"2023-07-14T13:13:04.886936+0000","last_peered":"2023-07-14T13:13:04.886936+0000","last_clean":"2023-07-14T13:13:04.886936+0000","last_became_active":"2023-07-14T13:13:03.892370+0000","last_became_peered":"2023-07-14T13:13:03.892370+0000","last_unstale":"2023-07-14T13:13:04.886936+0000","last_undegraded":"2023-07-14T13:13:04.886936+0000","last_fullsized":"2023-07-14T13:13:04.886936+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:45:05.103466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852352+0000","last_change":"2023-07-14T13:13:02.870024+0000","last_active":"2023-07-14T13:13:05.852352+0000","last_peered":"2023-07-14T13:13:05.852352+0000","last_clean":"2023-07-14T13:13:05.852352+0000","last_became_active":"2023-07-14T13:13:02.869711+0000","last_became_peered":"2023-07-14T13:13:02.869711+0000","last_unstale":"2023-07-14T13:13:05.852352+0000","last_undegraded":"2023-07-14T13:13:05.852352+0000","last_fullsized":"2023-07-14T13:13:05.852352+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:33:39.619565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852104+0000","last_change":"2023-07-14T13:13:03.889872+0000","last_active":"2023-07-14T13:13:05.852104+0000","last_peered":"2023-07-14T13:13:05.852104+0000","last_clean":"2023-07-14T13:13:05.852104+0000","last_became_active":"2023-07-14T13:13:03.889591+0000","last_became_peered":"2023-07-14T13:13:03.889591+0000","last_unstale":"2023-07-14T13:13:05.852104+0000","last_undegraded":"2023-07-14T13:13:05.852104+0000","last_fullsized":"2023-07-14T13:13:05.852104+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:24:21.255937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"155'1","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852962+0000","last_change":"2023-07-14T13:13:02.866258+0000","last_active":"2023-07-14T13:13:05.852962+0000","last_peered":"2023-07-14T13:13:05.852962+0000","last_clean":"2023-07-14T13:13:05.852962+0000","last_became_active":"2023-07-14T13:13:02.865982+0000","last_became_peered":"2023-07-14T13:13:02.865982+0000","last_unstale":"2023-07-14T13:13:05.852962+0000","last_undegraded":"2023-07-14T13:13:05.852962+0000","last_fullsized":"2023-07-14T13:13:05.852962+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:39:20.286940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.886474+0000","last_change":"2023-07-14T13:13:03.887304+0000","last_active":"2023-07-14T13:13:04.886474+0000","last_peered":"2023-07-14T13:13:04.886474+0000","last_clean":"2023-07-14T13:13:04.886474+0000","last_became_active":"2023-07-14T13:13:03.886840+0000","last_became_peered":"2023-07-14T13:13:03.886840+0000","last_unstale":"2023-07-14T13:13:04.886474+0000","last_undegraded":"2023-07-14T13:13:04.886474+0000","last_fullsized":"2023-07-14T13:13:04.886474+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:54:44.315592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"155'2","reported_seq":15,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.853172+0000","last_change":"2023-07-14T13:13:02.868862+0000","last_active":"2023-07-14T13:13:05.853172+0000","last_peered":"2023-07-14T13:13:05.853172+0000","last_clean":"2023-07-14T13:13:05.853172+0000","last_became_active":"2023-07-14T13:13:02.868554+0000","last_became_peered":"2023-07-14T13:13:02.868554+0000","last_unstale":"2023-07-14T13:13:05.853172+0000","last_undegraded":"2023-07-14T13:13:05.853172+0000","last_fullsized":"2023-07-14T13:13:05.853172+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:43:06.009440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.886761+0000","last_change":"2023-07-14T13:13:03.891127+0000","last_active":"2023-07-14T13:13:04.886761+0000","last_peered":"2023-07-14T13:13:04.886761+0000","last_clean":"2023-07-14T13:13:04.886761+0000","last_became_active":"2023-07-14T13:13:03.890865+0000","last_became_peered":"2023-07-14T13:13:03.890865+0000","last_unstale":"2023-07-14T13:13:04.886761+0000","last_undegraded":"2023-07-14T13:13:04.886761+0000","last_fullsized":"2023-07-14T13:13:04.886761+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:40:08.734457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"155'1","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.235146+0000","last_change":"2023-07-14T13:13:02.859151+0000","last_active":"2023-07-14T13:13:05.235146+0000","last_peered":"2023-07-14T13:13:05.235146+0000","last_clean":"2023-07-14T13:13:05.235146+0000","last_became_active":"2023-07-14T13:13:02.858878+0000","last_became_peered":"2023-07-14T13:13:02.858878+0000","last_unstale":"2023-07-14T13:13:05.235146+0000","last_undegraded":"2023-07-14T13:13:05.235146+0000","last_fullsized":"2023-07-14T13:13:05.235146+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:05:57.543450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.848153+0000","last_change":"2023-07-14T13:13:03.880230+0000","last_active":"2023-07-14T13:13:05.848153+0000","last_peered":"2023-07-14T13:13:05.848153+0000","last_clean":"2023-07-14T13:13:05.848153+0000","last_became_active":"2023-07-14T13:13:03.879738+0000","last_became_peered":"2023-07-14T13:13:03.879738+0000","last_unstale":"2023-07-14T13:13:05.848153+0000","last_undegraded":"2023-07-14T13:13:05.848153+0000","last_fullsized":"2023-07-14T13:13:05.848153+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:27:48.564618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.881785+0000","last_change":"2023-07-14T13:13:02.863173+0000","last_active":"2023-07-14T13:13:04.881785+0000","last_peered":"2023-07-14T13:13:04.881785+0000","last_clean":"2023-07-14T13:13:04.881785+0000","last_became_active":"2023-07-14T13:13:02.862902+0000","last_became_peered":"2023-07-14T13:13:02.862902+0000","last_unstale":"2023-07-14T13:13:04.881785+0000","last_undegraded":"2023-07-14T13:13:04.881785+0000","last_fullsized":"2023-07-14T13:13:04.881785+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:11:50.885355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.881773+0000","last_change":"2023-07-14T13:13:03.876179+0000","last_active":"2023-07-14T13:13:04.881773+0000","last_peered":"2023-07-14T13:13:04.881773+0000","last_clean":"2023-07-14T13:13:04.881773+0000","last_became_active":"2023-07-14T13:13:03.875761+0000","last_became_peered":"2023-07-14T13:13:03.875761+0000","last_unstale":"2023-07-14T13:13:04.881773+0000","last_undegraded":"2023-07-14T13:13:04.881773+0000","last_fullsized":"2023-07-14T13:13:04.881773+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:36:06.428923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"155'2","reported_seq":15,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852748+0000","last_change":"2023-07-14T13:13:02.869185+0000","last_active":"2023-07-14T13:13:05.852748+0000","last_peered":"2023-07-14T13:13:05.852748+0000","last_clean":"2023-07-14T13:13:05.852748+0000","last_became_active":"2023-07-14T13:13:02.868925+0000","last_became_peered":"2023-07-14T13:13:02.868925+0000","last_unstale":"2023-07-14T13:13:05.852748+0000","last_undegraded":"2023-07-14T13:13:05.852748+0000","last_fullsized":"2023-07-14T13:13:05.852748+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:08:36.628796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.205195+0000","last_change":"2023-07-14T13:13:03.883788+0000","last_active":"2023-07-14T13:13:05.205195+0000","last_peered":"2023-07-14T13:13:05.205195+0000","last_clean":"2023-07-14T13:13:05.205195+0000","last_became_active":"2023-07-14T13:13:03.883528+0000","last_became_peered":"2023-07-14T13:13:03.883528+0000","last_unstale":"2023-07-14T13:13:05.205195+0000","last_undegraded":"2023-07-14T13:13:05.205195+0000","last_fullsized":"2023-07-14T13:13:05.205195+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:43:00.199292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.205095+0000","last_change":"2023-07-14T13:13:02.862781+0000","last_active":"2023-07-14T13:13:05.205095+0000","last_peered":"2023-07-14T13:13:05.205095+0000","last_clean":"2023-07-14T13:13:05.205095+0000","last_became_active":"2023-07-14T13:13:02.862518+0000","last_became_peered":"2023-07-14T13:13:02.862518+0000","last_unstale":"2023-07-14T13:13:05.205095+0000","last_undegraded":"2023-07-14T13:13:05.205095+0000","last_fullsized":"2023-07-14T13:13:05.205095+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:44:09.031988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.881582+0000","last_change":"2023-07-14T13:13:03.886633+0000","last_active":"2023-07-14T13:13:04.881582+0000","last_peered":"2023-07-14T13:13:04.881582+0000","last_clean":"2023-07-14T13:13:04.881582+0000","last_became_active":"2023-07-14T13:13:03.886323+0000","last_became_peered":"2023-07-14T13:13:03.886323+0000","last_unstale":"2023-07-14T13:13:04.881582+0000","last_undegraded":"2023-07-14T13:13:04.881582+0000","last_fullsized":"2023-07-14T13:13:04.881582+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:38:32.778958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.886526+0000","last_change":"2023-07-14T13:13:02.870693+0000","last_active":"2023-07-14T13:13:04.886526+0000","last_peered":"2023-07-14T13:13:04.886526+0000","last_clean":"2023-07-14T13:13:04.886526+0000","last_became_active":"2023-07-14T13:13:02.870369+0000","last_became_peered":"2023-07-14T13:13:02.870369+0000","last_unstale":"2023-07-14T13:13:04.886526+0000","last_undegraded":"2023-07-14T13:13:04.886526+0000","last_fullsized":"2023-07-14T13:13:04.886526+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:05:32.697136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852919+0000","last_change":"2023-07-14T13:13:03.883319+0000","last_active":"2023-07-14T13:13:05.852919+0000","last_peered":"2023-07-14T13:13:05.852919+0000","last_clean":"2023-07-14T13:13:05.852919+0000","last_became_active":"2023-07-14T13:13:03.883002+0000","last_became_peered":"2023-07-14T13:13:03.883002+0000","last_unstale":"2023-07-14T13:13:05.852919+0000","last_undegraded":"2023-07-14T13:13:05.852919+0000","last_fullsized":"2023-07-14T13:13:05.852919+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:50:54.922648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.234921+0000","last_change":"2023-07-14T13:13:02.860174+0000","last_active":"2023-07-14T13:13:05.234921+0000","last_peered":"2023-07-14T13:13:05.234921+0000","last_clean":"2023-07-14T13:13:05.234921+0000","last_became_active":"2023-07-14T13:13:02.859857+0000","last_became_peered":"2023-07-14T13:13:02.859857+0000","last_unstale":"2023-07-14T13:13:05.234921+0000","last_undegraded":"2023-07-14T13:13:05.234921+0000","last_fullsized":"2023-07-14T13:13:05.234921+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:15:57.068012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.881292+0000","last_change":"2023-07-14T13:13:03.881391+0000","last_active":"2023-07-14T13:13:04.881292+0000","last_peered":"2023-07-14T13:13:04.881292+0000","last_clean":"2023-07-14T13:13:04.881292+0000","last_became_active":"2023-07-14T13:13:03.881124+0000","last_became_peered":"2023-07-14T13:13:03.881124+0000","last_unstale":"2023-07-14T13:13:04.881292+0000","last_undegraded":"2023-07-14T13:13:04.881292+0000","last_fullsized":"2023-07-14T13:13:04.881292+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:13:20.744848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"155'2","reported_seq":15,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.205263+0000","last_change":"2023-07-14T13:13:02.868617+0000","last_active":"2023-07-14T13:13:05.205263+0000","last_peered":"2023-07-14T13:13:05.205263+0000","last_clean":"2023-07-14T13:13:05.205263+0000","last_became_active":"2023-07-14T13:13:02.868316+0000","last_became_peered":"2023-07-14T13:13:02.868316+0000","last_unstale":"2023-07-14T13:13:05.205263+0000","last_undegraded":"2023-07-14T13:13:05.205263+0000","last_fullsized":"2023-07-14T13:13:05.205263+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:42:29.394315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852589+0000","last_change":"2023-07-14T13:13:03.885372+0000","last_active":"2023-07-14T13:13:05.852589+0000","last_peered":"2023-07-14T13:13:05.852589+0000","last_clean":"2023-07-14T13:13:05.852589+0000","last_became_active":"2023-07-14T13:13:03.885017+0000","last_became_peered":"2023-07-14T13:13:03.885017+0000","last_unstale":"2023-07-14T13:13:05.852589+0000","last_undegraded":"2023-07-14T13:13:05.852589+0000","last_fullsized":"2023-07-14T13:13:05.852589+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:10:35.686032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"156'1","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852551+0000","last_change":"2023-07-14T13:13:02.868072+0000","last_active":"2023-07-14T13:13:05.852551+0000","last_peered":"2023-07-14T13:13:05.852551+0000","last_clean":"2023-07-14T13:13:05.852551+0000","last_became_active":"2023-07-14T13:13:02.867703+0000","last_became_peered":"2023-07-14T13:13:02.867703+0000","last_unstale":"2023-07-14T13:13:05.852551+0000","last_undegraded":"2023-07-14T13:13:05.852551+0000","last_fullsized":"2023-07-14T13:13:05.852551+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:34:34.876121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.886361+0000","last_change":"2023-07-14T13:13:03.888425+0000","last_active":"2023-07-14T13:13:04.886361+0000","last_peered":"2023-07-14T13:13:04.886361+0000","last_clean":"2023-07-14T13:13:04.886361+0000","last_became_active":"2023-07-14T13:13:03.888140+0000","last_became_peered":"2023-07-14T13:13:03.888140+0000","last_unstale":"2023-07-14T13:13:04.886361+0000","last_undegraded":"2023-07-14T13:13:04.886361+0000","last_fullsized":"2023-07-14T13:13:04.886361+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:03:14.085716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852285+0000","last_change":"2023-07-14T13:13:02.862857+0000","last_active":"2023-07-14T13:13:05.852285+0000","last_peered":"2023-07-14T13:13:05.852285+0000","last_clean":"2023-07-14T13:13:05.852285+0000","last_became_active":"2023-07-14T13:13:02.862567+0000","last_became_peered":"2023-07-14T13:13:02.862567+0000","last_unstale":"2023-07-14T13:13:05.852285+0000","last_undegraded":"2023-07-14T13:13:05.852285+0000","last_fullsized":"2023-07-14T13:13:05.852285+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:21:24.703712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.848331+0000","last_change":"2023-07-14T13:13:03.883972+0000","last_active":"2023-07-14T13:13:05.848331+0000","last_peered":"2023-07-14T13:13:05.848331+0000","last_clean":"2023-07-14T13:13:05.848331+0000","last_became_active":"2023-07-14T13:13:03.883671+0000","last_became_peered":"2023-07-14T13:13:03.883671+0000","last_unstale":"2023-07-14T13:13:05.848331+0000","last_undegraded":"2023-07-14T13:13:05.848331+0000","last_fullsized":"2023-07-14T13:13:05.848331+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:45:42.429204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.234996+0000","last_change":"2023-07-14T13:13:02.861021+0000","last_active":"2023-07-14T13:13:05.234996+0000","last_peered":"2023-07-14T13:13:05.234996+0000","last_clean":"2023-07-14T13:13:05.234996+0000","last_became_active":"2023-07-14T13:13:02.860774+0000","last_became_peered":"2023-07-14T13:13:02.860774+0000","last_unstale":"2023-07-14T13:13:05.234996+0000","last_undegraded":"2023-07-14T13:13:05.234996+0000","last_fullsized":"2023-07-14T13:13:05.234996+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:39:27.240471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.235047+0000","last_change":"2023-07-14T13:13:03.874942+0000","last_active":"2023-07-14T13:13:05.235047+0000","last_peered":"2023-07-14T13:13:05.235047+0000","last_clean":"2023-07-14T13:13:05.235047+0000","last_became_active":"2023-07-14T13:13:03.874155+0000","last_became_peered":"2023-07-14T13:13:03.874155+0000","last_unstale":"2023-07-14T13:13:05.235047+0000","last_undegraded":"2023-07-14T13:13:05.235047+0000","last_fullsized":"2023-07-14T13:13:05.235047+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:46:28.694064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.851935+0000","last_change":"2023-07-14T13:13:02.870130+0000","last_active":"2023-07-14T13:13:05.851935+0000","last_peered":"2023-07-14T13:13:05.851935+0000","last_clean":"2023-07-14T13:13:05.851935+0000","last_became_active":"2023-07-14T13:13:02.869853+0000","last_became_peered":"2023-07-14T13:13:02.869853+0000","last_unstale":"2023-07-14T13:13:05.851935+0000","last_undegraded":"2023-07-14T13:13:05.851935+0000","last_fullsized":"2023-07-14T13:13:05.851935+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:20:38.631136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.235109+0000","last_change":"2023-07-14T13:13:03.873139+0000","last_active":"2023-07-14T13:13:05.235109+0000","last_peered":"2023-07-14T13:13:05.235109+0000","last_clean":"2023-07-14T13:13:05.235109+0000","last_became_active":"2023-07-14T13:13:03.872839+0000","last_became_peered":"2023-07-14T13:13:03.872839+0000","last_unstale":"2023-07-14T13:13:05.235109+0000","last_undegraded":"2023-07-14T13:13:05.235109+0000","last_fullsized":"2023-07-14T13:13:05.235109+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:33:48.429868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.886839+0000","last_change":"2023-07-14T13:13:02.873722+0000","last_active":"2023-07-14T13:13:04.886839+0000","last_peered":"2023-07-14T13:13:04.886839+0000","last_clean":"2023-07-14T13:13:04.886839+0000","last_became_active":"2023-07-14T13:13:02.873392+0000","last_became_peered":"2023-07-14T13:13:02.873392+0000","last_unstale":"2023-07-14T13:13:04.886839+0000","last_undegraded":"2023-07-14T13:13:04.886839+0000","last_fullsized":"2023-07-14T13:13:04.886839+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:14:34.588088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.235075+0000","last_change":"2023-07-14T13:13:03.874025+0000","last_active":"2023-07-14T13:13:05.235075+0000","last_peered":"2023-07-14T13:13:05.235075+0000","last_clean":"2023-07-14T13:13:05.235075+0000","last_became_active":"2023-07-14T13:13:03.873729+0000","last_became_peered":"2023-07-14T13:13:03.873729+0000","last_unstale":"2023-07-14T13:13:05.235075+0000","last_undegraded":"2023-07-14T13:13:05.235075+0000","last_fullsized":"2023-07-14T13:13:05.235075+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:51:54.594481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.235000+0000","last_change":"2023-07-14T13:13:02.861693+0000","last_active":"2023-07-14T13:13:05.235000+0000","last_peered":"2023-07-14T13:13:05.235000+0000","last_clean":"2023-07-14T13:13:05.235000+0000","last_became_active":"2023-07-14T13:13:02.861433+0000","last_became_peered":"2023-07-14T13:13:02.861433+0000","last_unstale":"2023-07-14T13:13:05.235000+0000","last_undegraded":"2023-07-14T13:13:05.235000+0000","last_fullsized":"2023-07-14T13:13:05.235000+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:23:04.603038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.887099+0000","last_change":"2023-07-14T13:13:03.888993+0000","last_active":"2023-07-14T13:13:04.887099+0000","last_peered":"2023-07-14T13:13:04.887099+0000","last_clean":"2023-07-14T13:13:04.887099+0000","last_became_active":"2023-07-14T13:13:03.888729+0000","last_became_peered":"2023-07-14T13:13:03.888729+0000","last_unstale":"2023-07-14T13:13:04.887099+0000","last_undegraded":"2023-07-14T13:13:04.887099+0000","last_fullsized":"2023-07-14T13:13:04.887099+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:52.133562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.881418+0000","last_change":"2023-07-14T13:13:02.867349+0000","last_active":"2023-07-14T13:13:04.881418+0000","last_peered":"2023-07-14T13:13:04.881418+0000","last_clean":"2023-07-14T13:13:04.881418+0000","last_became_active":"2023-07-14T13:13:02.867008+0000","last_became_peered":"2023-07-14T13:13:02.867008+0000","last_unstale":"2023-07-14T13:13:04.881418+0000","last_undegraded":"2023-07-14T13:13:04.881418+0000","last_fullsized":"2023-07-14T13:13:04.881418+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:43:48.293510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852441+0000","last_change":"2023-07-14T13:13:03.890110+0000","last_active":"2023-07-14T13:13:05.852441+0000","last_peered":"2023-07-14T13:13:05.852441+0000","last_clean":"2023-07-14T13:13:05.852441+0000","last_became_active":"2023-07-14T13:13:03.889441+0000","last_became_peered":"2023-07-14T13:13:03.889441+0000","last_unstale":"2023-07-14T13:13:05.852441+0000","last_undegraded":"2023-07-14T13:13:05.852441+0000","last_fullsized":"2023-07-14T13:13:05.852441+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:59:12.191868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.886679+0000","last_change":"2023-07-14T13:13:02.871042+0000","last_active":"2023-07-14T13:13:04.886679+0000","last_peered":"2023-07-14T13:13:04.886679+0000","last_clean":"2023-07-14T13:13:04.886679+0000","last_became_active":"2023-07-14T13:13:02.870763+0000","last_became_peered":"2023-07-14T13:13:02.870763+0000","last_unstale":"2023-07-14T13:13:04.886679+0000","last_undegraded":"2023-07-14T13:13:04.886679+0000","last_fullsized":"2023-07-14T13:13:04.886679+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:29:50.905334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"144'271","reported_seq":957,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.886326+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:13:04.886326+0000","last_peered":"2023-07-14T13:13:04.886326+0000","last_clean":"2023-07-14T13:13:04.886326+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:13:04.886326+0000","last_undegraded":"2023-07-14T13:13:04.886326+0000","last_fullsized":"2023-07-14T13:13:04.886326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:39:49.308096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":250,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852047+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:13:05.852047+0000","last_peered":"2023-07-14T13:13:05.852047+0000","last_clean":"2023-07-14T13:13:05.852047+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:13:05.852047+0000","last_undegraded":"2023-07-14T13:13:05.852047+0000","last_fullsized":"2023-07-14T13:13:05.852047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:52:04.074613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.887087+0000","last_change":"2023-07-14T13:13:03.889283+0000","last_active":"2023-07-14T13:13:04.887087+0000","last_peered":"2023-07-14T13:13:04.887087+0000","last_clean":"2023-07-14T13:13:04.887087+0000","last_became_active":"2023-07-14T13:13:03.889022+0000","last_became_peered":"2023-07-14T13:13:03.889022+0000","last_unstale":"2023-07-14T13:13:04.887087+0000","last_undegraded":"2023-07-14T13:13:04.887087+0000","last_fullsized":"2023-07-14T13:13:04.887087+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:48:12.575366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852733+0000","last_change":"2023-07-14T13:13:02.869188+0000","last_active":"2023-07-14T13:13:05.852733+0000","last_peered":"2023-07-14T13:13:05.852733+0000","last_clean":"2023-07-14T13:13:05.852733+0000","last_became_active":"2023-07-14T13:13:02.868868+0000","last_became_peered":"2023-07-14T13:13:02.868868+0000","last_unstale":"2023-07-14T13:13:05.852733+0000","last_undegraded":"2023-07-14T13:13:05.852733+0000","last_fullsized":"2023-07-14T13:13:05.852733+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:11:14.320901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":255,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.886245+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:13:04.886245+0000","last_peered":"2023-07-14T13:13:04.886245+0000","last_clean":"2023-07-14T13:13:04.886245+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:13:04.886245+0000","last_undegraded":"2023-07-14T13:13:04.886245+0000","last_fullsized":"2023-07-14T13:13:04.886245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:25:01.538797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.881724+0000","last_change":"2023-07-14T13:13:03.881579+0000","last_active":"2023-07-14T13:13:04.881724+0000","last_peered":"2023-07-14T13:13:04.881724+0000","last_clean":"2023-07-14T13:13:04.881724+0000","last_became_active":"2023-07-14T13:13:03.881267+0000","last_became_peered":"2023-07-14T13:13:03.881267+0000","last_unstale":"2023-07-14T13:13:04.881724+0000","last_undegraded":"2023-07-14T13:13:04.881724+0000","last_fullsized":"2023-07-14T13:13:04.881724+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:52:30.141277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"155'8","reported_seq":21,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.234897+0000","last_change":"2023-07-14T13:13:02.870439+0000","last_active":"2023-07-14T13:13:05.234897+0000","last_peered":"2023-07-14T13:13:05.234897+0000","last_clean":"2023-07-14T13:13:05.234897+0000","last_became_active":"2023-07-14T13:13:02.870195+0000","last_became_peered":"2023-07-14T13:13:02.870195+0000","last_unstale":"2023-07-14T13:13:05.234897+0000","last_undegraded":"2023-07-14T13:13:05.234897+0000","last_fullsized":"2023-07-14T13:13:05.234897+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:53:29.633168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":256,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.204687+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:13:05.204687+0000","last_peered":"2023-07-14T13:13:05.204687+0000","last_clean":"2023-07-14T13:13:05.204687+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:13:05.204687+0000","last_undegraded":"2023-07-14T13:13:05.204687+0000","last_fullsized":"2023-07-14T13:13:05.204687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:46:28.286836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.848142+0000","last_change":"2023-07-14T13:13:03.877528+0000","last_active":"2023-07-14T13:13:05.848142+0000","last_peered":"2023-07-14T13:13:05.848142+0000","last_clean":"2023-07-14T13:13:05.848142+0000","last_became_active":"2023-07-14T13:13:03.877261+0000","last_became_peered":"2023-07-14T13:13:03.877261+0000","last_unstale":"2023-07-14T13:13:05.848142+0000","last_undegraded":"2023-07-14T13:13:05.848142+0000","last_fullsized":"2023-07-14T13:13:05.848142+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:08:13.653033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"155'2","reported_seq":15,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.204982+0000","last_change":"2023-07-14T13:13:02.862863+0000","last_active":"2023-07-14T13:13:05.204982+0000","last_peered":"2023-07-14T13:13:05.204982+0000","last_clean":"2023-07-14T13:13:05.204982+0000","last_became_active":"2023-07-14T13:13:02.862584+0000","last_became_peered":"2023-07-14T13:13:02.862584+0000","last_unstale":"2023-07-14T13:13:05.204982+0000","last_undegraded":"2023-07-14T13:13:05.204982+0000","last_fullsized":"2023-07-14T13:13:05.204982+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:55:22.616337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":250,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.851907+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:13:05.851907+0000","last_peered":"2023-07-14T13:13:05.851907+0000","last_clean":"2023-07-14T13:13:05.851907+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:13:05.851907+0000","last_undegraded":"2023-07-14T13:13:05.851907+0000","last_fullsized":"2023-07-14T13:13:05.851907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:22:07.233317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852695+0000","last_change":"2023-07-14T13:13:03.884962+0000","last_active":"2023-07-14T13:13:05.852695+0000","last_peered":"2023-07-14T13:13:05.852695+0000","last_clean":"2023-07-14T13:13:05.852695+0000","last_became_active":"2023-07-14T13:13:03.884496+0000","last_became_peered":"2023-07-14T13:13:03.884496+0000","last_unstale":"2023-07-14T13:13:05.852695+0000","last_undegraded":"2023-07-14T13:13:05.852695+0000","last_fullsized":"2023-07-14T13:13:05.852695+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:39:45.719233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"155'3","reported_seq":16,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.887444+0000","last_change":"2023-07-14T13:13:02.872225+0000","last_active":"2023-07-14T13:13:04.887444+0000","last_peered":"2023-07-14T13:13:04.887444+0000","last_clean":"2023-07-14T13:13:04.887444+0000","last_became_active":"2023-07-14T13:13:02.871842+0000","last_became_peered":"2023-07-14T13:13:02.871842+0000","last_unstale":"2023-07-14T13:13:04.887444+0000","last_undegraded":"2023-07-14T13:13:04.887444+0000","last_fullsized":"2023-07-14T13:13:04.887444+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:16:06.209153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":262,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.235127+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:13:05.235127+0000","last_peered":"2023-07-14T13:13:05.235127+0000","last_clean":"2023-07-14T13:13:05.235127+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:13:05.235127+0000","last_undegraded":"2023-07-14T13:13:05.235127+0000","last_fullsized":"2023-07-14T13:13:05.235127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:34:02.515304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852245+0000","last_change":"2023-07-14T13:13:03.882555+0000","last_active":"2023-07-14T13:13:05.852245+0000","last_peered":"2023-07-14T13:13:05.852245+0000","last_clean":"2023-07-14T13:13:05.852245+0000","last_became_active":"2023-07-14T13:13:03.882155+0000","last_became_peered":"2023-07-14T13:13:03.882155+0000","last_unstale":"2023-07-14T13:13:05.852245+0000","last_undegraded":"2023-07-14T13:13:05.852245+0000","last_fullsized":"2023-07-14T13:13:05.852245+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:36:36.035577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"155'6","reported_seq":19,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.887159+0000","last_change":"2023-07-14T13:13:02.870013+0000","last_active":"2023-07-14T13:13:04.887159+0000","last_peered":"2023-07-14T13:13:04.887159+0000","last_clean":"2023-07-14T13:13:04.887159+0000","last_became_active":"2023-07-14T13:13:02.869705+0000","last_became_peered":"2023-07-14T13:13:02.869705+0000","last_unstale":"2023-07-14T13:13:04.887159+0000","last_undegraded":"2023-07-14T13:13:04.887159+0000","last_fullsized":"2023-07-14T13:13:04.887159+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:28:20.154792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":254,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:04.887464+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:13:04.887464+0000","last_peered":"2023-07-14T13:13:04.887464+0000","last_clean":"2023-07-14T13:13:04.887464+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:13:04.887464+0000","last_undegraded":"2023-07-14T13:13:04.887464+0000","last_fullsized":"2023-07-14T13:13:04.887464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:33:06.647695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.204770+0000","last_change":"2023-07-14T13:13:03.881535+0000","last_active":"2023-07-14T13:13:05.204770+0000","last_peered":"2023-07-14T13:13:05.204770+0000","last_clean":"2023-07-14T13:13:05.204770+0000","last_became_active":"2023-07-14T13:13:03.881273+0000","last_became_peered":"2023-07-14T13:13:03.881273+0000","last_unstale":"2023-07-14T13:13:05.204770+0000","last_undegraded":"2023-07-14T13:13:05.204770+0000","last_fullsized":"2023-07-14T13:13:05.204770+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:27:42.977096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.852879+0000","last_change":"2023-07-14T13:13:02.869873+0000","last_active":"2023-07-14T13:13:05.852879+0000","last_peered":"2023-07-14T13:13:05.852879+0000","last_clean":"2023-07-14T13:13:05.852879+0000","last_became_active":"2023-07-14T13:13:02.869590+0000","last_became_peered":"2023-07-14T13:13:02.869590+0000","last_unstale":"2023-07-14T13:13:05.852879+0000","last_undegraded":"2023-07-14T13:13:05.852879+0000","last_fullsized":"2023-07-14T13:13:05.852879+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:33:28.142917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":262,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.235104+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:13:05.235104+0000","last_peered":"2023-07-14T13:13:05.235104+0000","last_clean":"2023-07-14T13:13:05.235104+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:13:05.235104+0000","last_undegraded":"2023-07-14T13:13:05.235104+0000","last_fullsized":"2023-07-14T13:13:05.235104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:11:03.635062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.234879+0000","last_change":"2023-07-14T13:13:03.877834+0000","last_active":"2023-07-14T13:13:05.234879+0000","last_peered":"2023-07-14T13:13:05.234879+0000","last_clean":"2023-07-14T13:13:05.234879+0000","last_became_active":"2023-07-14T13:13:03.877543+0000","last_became_peered":"2023-07-14T13:13:03.877543+0000","last_unstale":"2023-07-14T13:13:05.234879+0000","last_undegraded":"2023-07-14T13:13:05.234879+0000","last_fullsized":"2023-07-14T13:13:05.234879+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:02.835170+0000","last_clean_scrub_stamp":"2023-07-14T13:13:02.835170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:29:36.978851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.205053+0000","last_change":"2023-07-14T13:13:02.859953+0000","last_active":"2023-07-14T13:13:05.205053+0000","last_peered":"2023-07-14T13:13:05.205053+0000","last_clean":"2023-07-14T13:13:05.205053+0000","last_became_active":"2023-07-14T13:13:02.859642+0000","last_became_peered":"2023-07-14T13:13:02.859642+0000","last_unstale":"2023-07-14T13:13:05.205053+0000","last_undegraded":"2023-07-14T13:13:05.205053+0000","last_fullsized":"2023-07-14T13:13:05.205053+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:13:01.828098+0000","last_clean_scrub_stamp":"2023-07-14T13:13:01.828098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:54:32.455249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":256,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-14T13:13:05.851888+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:13:05.851888+0000","last_peered":"2023-07-14T13:13:05.851888+0000","last_clean":"2023-07-14T13:13:05.851888+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:13:05.851888+0000","last_undegraded":"2023-07-14T13:13:05.851888+0000","last_fullsized":"2023-07-14T13:13:05.851888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:44:02.276046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575091,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59780,"kb_used_data":2492,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312060,"statfs":{"total":96636764160,"available":96575549440,"internally_reserved":0,"allocated":2551808,"data_stored":1581608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.68999999999999995,"15min":0.70699999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.84199999999999997,"5min":1.262,"15min":1.262},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71699999999999997,"15min":0.72899999999999998},"min":{"1min":0.54100000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.71499999999999997}]},{"osd":1,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.70599999999999996,"15min":0.72999999999999998},"min":{"1min":0.44,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83799999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72799999999999998,"15min":0.74299999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.67300000000000004}]},{"osd":2,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71199999999999997,"15min":0.72599999999999998},"min":{"1min":0.48999999999999999,"5min":0.46100000000000002,"15min":0.42699999999999999},"max":{"1min":0.91500000000000004,"5min":1.073,"15min":1.073},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.753},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84899999999999998,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.69699999999999995}]},{"osd":3,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.72699999999999998,"15min":0.73599999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.091,"5min":1.161,"15min":1.161},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73999999999999999,"15min":0.75600000000000001},"min":{"1min":0.51100000000000001,"5min":0.47899999999999998,"15min":0.41499999999999998},"max":{"1min":0.94899999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.753}]},{"osd":4,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56899999999999995,"15min":0.57899999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.318},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.022},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.40000000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.64500000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.61199999999999999,"15min":0.61099999999999999},"min":{"1min":0.42699999999999999,"5min":0.39300000000000002,"15min":0.36599999999999999},"max":{"1min":0.91000000000000003,"5min":0.98099999999999998,"15min":0.98299999999999998},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63100000000000001,"15min":0.64900000000000002},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.34100000000000003},"max":{"1min":0.80500000000000005,"5min":1.028,"15min":1.028},"last":0.74399999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68600000000000005,"15min":0.69599999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.42699999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.0489999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.68100000000000005,"15min":0.67700000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.36299999999999999},"max":{"1min":1.151,"5min":4.1130000000000004,"15min":4.1130000000000004},"last":0.82699999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575092,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32952,"kb_used_data":1904,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1949696,"data_stored":990258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70699999999999996,"15min":0.72699999999999998},"min":{"1min":0.496,"5min":0.47899999999999998,"15min":0.38},"max":{"1min":0.89300000000000002,"5min":0.90400000000000003,"15min":0.996},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69999999999999996,"15min":0.72399999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88100000000000001,"5min":0.98199999999999998,"15min":1.0800000000000001},"last":0.501}]},{"osd":1,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70099999999999996,"15min":0.73299999999999998},"min":{"1min":0.48499999999999999,"5min":0.42299999999999999,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.0209999999999999},"last":0.75},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69199999999999995,"15min":0.71899999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82999999999999996,"5min":0.88100000000000001,"15min":1.077},"last":0.628}]},{"osd":2,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.746},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.45900000000000002},"max":{"1min":0.872,"5min":0.95099999999999996,"15min":1.105},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71799999999999997,"15min":0.745},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.92100000000000004,"5min":0.99099999999999999,"15min":1.0900000000000001},"last":0.66200000000000003}]},{"osd":3,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72899999999999998,"15min":0.76600000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89300000000000002,"5min":1.054,"15min":1.1359999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71399999999999997,"15min":0.753},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93600000000000005,"5min":0.94799999999999995,"15min":1.1080000000000001},"last":0.64700000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.63900000000000001,"15min":0.63600000000000001},"min":{"1min":0.47499999999999998,"5min":0.439,"15min":0.38500000000000001},"max":{"1min":0.79800000000000004,"5min":0.95499999999999996,"15min":1.0780000000000001},"last":0.438}]},{"osd":5,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63,"15min":0.64000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":1.579},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48199999999999998,"5min":0.46300000000000002,"15min":0.42399999999999999},"max":{"1min":0.85599999999999998,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.69099999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66000000000000003,"15min":0.65900000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91800000000000004,"5min":1.0940000000000001,"15min":1.1200000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.36199999999999999},"max":{"1min":0.90400000000000003,"5min":1.0209999999999999,"15min":1.657},"last":0.72799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575091,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50996,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320844,"statfs":{"total":96636764160,"available":96584544256,"internally_reserved":0,"allocated":1945600,"data_stored":989608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68799999999999994,"15min":0.72199999999999998},"min":{"1min":0.45400000000000001,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":2.6699999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71399999999999997,"15min":0.72699999999999998},"min":{"1min":0.46500000000000002,"5min":0.41699999999999998,"15min":0.32800000000000001},"max":{"1min":0.86799999999999999,"5min":1.083,"15min":1.083},"last":0.69899999999999995}]},{"osd":1,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68899999999999995,"15min":0.71799999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44500000000000001},"max":{"1min":0.93600000000000005,"5min":1.05,"15min":1.079},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.71499999999999997,"15min":0.73899999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.36799999999999999},"max":{"1min":0.873,"5min":0.94599999999999995,"15min":2.706},"last":0.65300000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70899999999999996,"15min":0.72799999999999998},"min":{"1min":0.41199999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90700000000000003,"5min":1.212,"15min":1.212},"last":0.755},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70799999999999996,"15min":0.72699999999999998},"min":{"1min":0.497,"5min":0.44800000000000001,"15min":0.433},"max":{"1min":0.94599999999999995,"5min":1.181,"15min":1.181},"last":0.47399999999999998}]},{"osd":3,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72499999999999998,"15min":0.74199999999999999},"min":{"1min":0.53900000000000003,"5min":0.41799999999999998,"15min":0.377},"max":{"1min":0.88600000000000001,"5min":0.95199999999999996,"15min":2.7389999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73099999999999998,"15min":0.753},"min":{"1min":0.51600000000000001,"5min":0.47299999999999998,"15min":0.39700000000000002},"max":{"1min":0.94499999999999995,"5min":1.304,"15min":1.304},"last":0.79400000000000004}]},{"osd":4,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.628,"15min":0.628},"min":{"1min":0.38500000000000001,"5min":0.38,"15min":0.28599999999999998},"max":{"1min":0.85599999999999998,"5min":1.129,"15min":1.129},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.69099999999999995,"15min":0.68400000000000005},"min":{"1min":0.53700000000000003,"5min":0.39900000000000002,"15min":0.36299999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":2.7719999999999998},"last":0.63200000000000001}]},{"osd":6,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60199999999999998,"15min":0.60599999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.32700000000000001},"max":{"1min":0.89700000000000002,"5min":1.169,"15min":1.169},"last":0.87},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42599999999999999,"5min":0.39400000000000002,"15min":0.34300000000000003},"max":{"1min":0.91000000000000003,"5min":1.238,"15min":1.238},"last":0.67000000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64600000000000002,"15min":0.64300000000000002},"min":{"1min":0.40899999999999997,"5min":0.36899999999999999,"15min":0.32900000000000001},"max":{"1min":0.90800000000000003,"5min":1.026,"15min":3.0230000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68300000000000005,"15min":0.67700000000000005},"min":{"1min":0.49399999999999999,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.98199999999999998,"5min":1.2589999999999999,"15min":1.407},"last":0.84699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575091,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37040,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334800,"statfs":{"total":96636764160,"available":96598835200,"internally_reserved":0,"allocated":1941504,"data_stored":989586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.70599999999999996,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.411},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.45600000000000002,"5min":0.45100000000000001,"15min":0.435},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.1200000000000001},"last":0.627}]},{"osd":1,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71199999999999997,"15min":0.74399999999999999},"min":{"1min":0.496,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84099999999999997,"5min":0.92500000000000004,"15min":1.077},"last":0.75},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70399999999999996,"15min":0.72999999999999998},"min":{"1min":0.52700000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.0469999999999999},"last":0.69599999999999995}]},{"osd":2,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.71999999999999997,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.42199999999999999,"15min":0.35199999999999998},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72099999999999997,"15min":0.76400000000000001},"min":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.43099999999999999},"max":{"1min":0.86699999999999999,"5min":0.98199999999999998,"15min":1.387},"last":0.71099999999999997}]},{"osd":3,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.49399999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89700000000000002,"5min":0.95399999999999996,"15min":1.008},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.74099999999999999,"15min":0.76600000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46800000000000003},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.54300000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.378},"max":{"1min":0.92200000000000004,"5min":0.92400000000000004,"15min":0.97099999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63900000000000001,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.40400000000000003,"15min":0.34599999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.56599999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.014},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.67900000000000005,"15min":0.67000000000000004},"min":{"1min":0.48599999999999999,"5min":0.443,"15min":0.374},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.0289999999999999},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.69899999999999995,"15min":0.67200000000000004},"min":{"1min":0.51300000000000001,"5min":0.502,"15min":0.39000000000000001},"max":{"1min":0.91700000000000004,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.69799999999999995},"min":{"1min":0.48199999999999998,"5min":0.42799999999999999,"15min":0.40300000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.60699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575091,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37056,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":1957888,"data_stored":991220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.439,"15min":0.44700000000000001},"min":{"1min":0.26400000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.65900000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.47699999999999998,"15min":0.504},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64900000000000002,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.46300000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46800000000000003,"15min":0.47799999999999998},"min":{"1min":0.33400000000000002,"5min":0.32000000000000001,"15min":0.315},"max":{"1min":0.58599999999999997,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.51200000000000001,"15min":0.53500000000000003},"min":{"1min":0.33200000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66600000000000004,"5min":0.78600000000000003,"15min":1.0029999999999999},"last":0.42699999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54700000000000004,"15min":0.56599999999999995},"min":{"1min":0.38300000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.69199999999999995,"5min":0.998,"15min":0.998},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57399999999999995,"15min":0.59999999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.71199999999999997,"5min":0.88100000000000001,"15min":1.663},"last":0.45600000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.751},"min":{"1min":0.495,"5min":0.48199999999999998,"15min":0.441},"max":{"1min":0.97199999999999998,"5min":1.0269999999999999,"15min":1.284},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73599999999999999,"15min":0.77400000000000002},"min":{"1min":0.54100000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0780000000000001,"5min":1.175,"15min":1.175},"last":0.54100000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.745,"15min":0.78200000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.306},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.77800000000000002},"min":{"1min":0.57299999999999995,"5min":0.48699999999999999,"15min":0.372},"max":{"1min":1.014,"5min":1.121,"15min":1.1870000000000001},"last":0.58399999999999996}]},{"osd":6,"last update":"Fri Jul 14 13:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.73599999999999999,"15min":0.76800000000000002},"min":{"1min":0.56899999999999995,"5min":0.49099999999999999,"15min":0.48099999999999998},"max":{"1min":1.0409999999999999,"5min":1.113,"15min":1.117},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76900000000000002,"15min":0.80900000000000005},"min":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.54200000000000004},"max":{"1min":1.018,"5min":1.133,"15min":1.2589999999999999},"last":0.67100000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.75900000000000001,"15min":0.82099999999999995},"min":{"1min":0.55600000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0600000000000001,"5min":1.159,"15min":2.4910000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77400000000000002,"15min":0.81699999999999995},"min":{"1min":0.58699999999999997,"5min":0.53500000000000003,"15min":0.51600000000000001},"max":{"1min":1.1040000000000001,"5min":1.1359999999999999,"15min":1.595},"last":0.73999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575091,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59188,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312652,"statfs":{"total":96636764160,"available":96576155648,"internally_reserved":0,"allocated":1945600,"data_stored":989183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46200000000000002,"15min":0.46400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.24199999999999999},"max":{"1min":0.80400000000000005,"5min":0.84699999999999998,"15min":1.3169999999999999},"last":0.434},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.50800000000000001,"15min":0.53300000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.67300000000000004,"5min":0.80800000000000005,"15min":2.5270000000000001},"last":0.57499999999999996}]},{"osd":1,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.47699999999999998,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.29999999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":2.7200000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.55700000000000005},"min":{"1min":0.39900000000000002,"5min":0.36299999999999999,"15min":0.35999999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":2.6110000000000002},"last":0.623}]},{"osd":3,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55100000000000005,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.755,"5min":0.755,"15min":8.2530000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.77000000000000002,"5min":0.89600000000000002,"15min":1.2150000000000001},"last":0.55500000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.73999999999999999,"15min":0.76900000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.48399999999999999},"max":{"1min":0.91100000000000003,"5min":1.0840000000000001,"15min":1.1499999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73999999999999999,"15min":0.78100000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.47999999999999998},"max":{"1min":0.92900000000000005,"5min":1.0629999999999999,"15min":2.3170000000000002},"last":0.71199999999999997}]},{"osd":5,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.79900000000000004,"15min":0.84699999999999998},"min":{"1min":0.58399999999999996,"5min":0.56399999999999995,"15min":0.49399999999999999},"max":{"1min":1.0029999999999999,"5min":1.1319999999999999,"15min":3.1139999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.78900000000000003,"15min":0.83299999999999996},"min":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.55600000000000005},"max":{"1min":1.03,"5min":1.153,"15min":2.6850000000000001},"last":1.04}]},{"osd":6,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.73999999999999999,"15min":0.79100000000000004},"min":{"1min":0.52900000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98299999999999998,"5min":1.038,"15min":3.9849999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75900000000000001,"15min":0.80200000000000005},"min":{"1min":0.53900000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":3.391},"last":0.879}]},{"osd":7,"last update":"Fri Jul 14 13:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.76000000000000001,"15min":0.80900000000000005},"min":{"1min":0.56200000000000006,"5min":0.52300000000000002,"15min":0.5},"max":{"1min":1.022,"5min":1.1759999999999999,"15min":2.5779999999999998},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.78200000000000003,"15min":0.81799999999999995},"min":{"1min":0.57099999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.736,"5min":1.736,"15min":2.5939999999999999},"last":0.747}]}]},{"osd":1,"up_from":13,"seq":55834575092,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37044,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334796,"statfs":{"total":96636764160,"available":96598831104,"internally_reserved":0,"allocated":1945600,"data_stored":989656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42899999999999999,"15min":0.432},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26100000000000001},"max":{"1min":0.56000000000000005,"5min":0.65400000000000003,"15min":0.77200000000000002},"last":0.37},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.34999999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.74399999999999999,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.49199999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.35899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.63700000000000001,"5min":0.69199999999999995,"15min":1.0409999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.51700000000000002},"min":{"1min":0.32100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73199999999999998,"5min":0.77900000000000003,"15min":1.014},"last":0.41699999999999998}]},{"osd":3,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60799999999999998,"15min":0.628},"min":{"1min":0.502,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.746,"5min":0.80300000000000005,"15min":0.96299999999999997},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55300000000000005,"15min":0.57099999999999995},"min":{"1min":0.41299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69899999999999995,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.442}]},{"osd":4,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76400000000000001,"15min":0.78300000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.48899999999999999},"max":{"1min":1.155,"5min":1.2110000000000001,"15min":1.236},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79000000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0640000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.74399999999999999}]},{"osd":5,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77700000000000002,"15min":0.78500000000000003},"min":{"1min":0.56000000000000005,"5min":0.52500000000000002,"15min":0.45200000000000001},"max":{"1min":1.1020000000000001,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.79600000000000004,"15min":0.80300000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.48599999999999999},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.72799999999999998}]},{"osd":6,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.55900000000000005,"5min":0.53800000000000003,"15min":0.503},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.2170000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79900000000000004,"15min":0.81799999999999995},"min":{"1min":0.53700000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.68700000000000006}]},{"osd":7,"last update":"Fri Jul 14 13:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.58499999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82699999999999996,"15min":0.84199999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.76400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575093,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41720,"kb_used_data":2480,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330120,"statfs":{"total":96636764160,"available":96594042880,"internally_reserved":0,"allocated":2539520,"data_stored":1578991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.27300000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.59199999999999997,"5min":0.79600000000000004,"15min":2.2450000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.48299999999999998,"15min":0.50800000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27700000000000002},"max":{"1min":0.72999999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.47499999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.504,"15min":0.51400000000000001},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68200000000000005,"5min":0.84499999999999997,"15min":2.2989999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52800000000000002,"15min":0.54700000000000004},"min":{"1min":0.39100000000000001,"5min":0.34899999999999998,"15min":0.29899999999999999},"max":{"1min":0.71199999999999997,"5min":0.83599999999999997,"15min":0.90300000000000002},"last":0.51700000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.505,"15min":0.505},"min":{"1min":0.35199999999999998,"5min":0.32700000000000001,"15min":0.318},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.84999999999999998},"last":0.5},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57799999999999996,"15min":0.58999999999999997},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76600000000000001,"5min":0.92700000000000005,"15min":2.4100000000000001},"last":0.59399999999999997}]},{"osd":4,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74399999999999999,"15min":0.77800000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1220000000000001,"5min":1.21,"15min":1.3640000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.75700000000000001,"15min":0.79300000000000004},"min":{"1min":0.57599999999999996,"5min":0.53500000000000003,"15min":0.44900000000000001},"max":{"1min":1.0289999999999999,"5min":1.0589999999999999,"15min":2.4460000000000002},"last":0.77400000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75600000000000001,"15min":0.79400000000000004},"min":{"1min":0.62,"5min":0.54200000000000004,"15min":0.47899999999999998},"max":{"1min":1.044,"5min":1.0669999999999999,"15min":1.3839999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.59399999999999997,"5min":0.5,"15min":0.48399999999999999},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.325},"last":0.87}]},{"osd":6,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77100000000000002,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.147,"5min":1.147,"15min":2.3380000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.755,"15min":0.79900000000000004},"min":{"1min":0.55600000000000005,"5min":0.51000000000000001,"15min":0.50600000000000001},"max":{"1min":0.97899999999999998,"5min":1.0900000000000001,"15min":1.3440000000000001},"last":0.78900000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:12:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76300000000000001,"15min":0.81599999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.503},"max":{"1min":1.016,"5min":1.1180000000000001,"15min":1.2749999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.77200000000000002,"15min":0.80500000000000005},"min":{"1min":0.56000000000000005,"5min":0.50600000000000001,"15min":0.502},"max":{"1min":1.077,"5min":1.0880000000000001,"15min":1.381},"last":0.93600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:13:12.988 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-14T13:13:12.988 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-14T13:13:13.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.136+0000 7f0f430ec640 1 Processor -- start 2023-07-14T13:13:13.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.136+0000 7f0f430ec640 1 -- start start 2023-07-14T13:13:13.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.140+0000 7f0f430ec640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0f3c0cb360 0x7f0f3c15df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:13.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.140+0000 7f0f430ec640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f3c0b38d0 0x7f0f3c070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:13.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.140+0000 7f0f430ec640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f3c0cc900 con 0x7f0f3c0cd490 2023-07-14T13:13:13.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.140+0000 7f0f430ec640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3c0ccbe0 con 0x7f0f3c0cb360 2023-07-14T13:13:13.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.140+0000 7f0f430ec640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c15d780 con 0x7f0f3c0b38d0 2023-07-14T13:13:13.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.140+0000 7f0f40e88640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0f3c0cb360 0x7f0f3c15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:13.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.140+0000 7f0f40e88640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0f3c0cb360 0x7f0f3c15df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43686/0 (socket says 172.21.15.5:43686) 2023-07-14T13:13:13.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.140+0000 7f0f40e88640 1 -- 172.21.15.5:0/751694578 learned_addr learned my addr 172.21.15.5:0/751694578 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:13.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.140+0000 7f0f3bfff640 1 --2- 172.21.15.5:0/751694578 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f3c0b38d0 0x7f0f3c070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:13.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.140+0000 7f0f40e88640 1 -- 172.21.15.5:0/751694578 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f3c0b38d0 msgr2=0x7f0f3c070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:13.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.140+0000 7f0f40e88640 1 --2- 172.21.15.5:0/751694578 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f3c0b38d0 0x7f0f3c070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:13.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.140+0000 7f0f40e88640 1 -- 172.21.15.5:0/751694578 >> v1:172.21.15.154:6789/0 conn(0x7f0f3c0cd490 legacy=0x7f0f3c0c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:13.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.140+0000 7f0f40e88640 1 -- 172.21.15.5:0/751694578 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c15da60 con 0x7f0f3c0cb360 2023-07-14T13:13:13.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.140+0000 7f0f3bfff640 1 --2- 172.21.15.5:0/751694578 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f3c0b38d0 0x7f0f3c070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:13:13.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.140+0000 7f0f40e88640 1 --2- 172.21.15.5:0/751694578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f3c0cb360 0x7f0f3c15df80 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f0f30009870 tx=0x7f0f3001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f427dc18f9301cc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:13.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.140+0000 7f0f3b7fe640 1 -- 172.21.15.5:0/751694578 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f300ab650 con 0x7f0f3c0cb360 2023-07-14T13:13:13.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.144+0000 7f0f3b7fe640 1 -- 172.21.15.5:0/751694578 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f300ab7b0 con 0x7f0f3c0cb360 2023-07-14T13:13:13.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.144+0000 7f0f3b7fe640 1 -- 172.21.15.5:0/751694578 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f300abb40 con 0x7f0f3c0cb360 2023-07-14T13:13:13.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.144+0000 7f0f430ec640 1 -- 172.21.15.5:0/751694578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f3c0cb360 msgr2=0x7f0f3c15df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:13.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.144+0000 7f0f430ec640 1 --2- 172.21.15.5:0/751694578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f3c0cb360 0x7f0f3c15df80 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f0f30009870 tx=0x7f0f3001ce90 comp rx=0 tx=0).stop 2023-07-14T13:13:13.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.144+0000 7f0f430ec640 1 -- 172.21.15.5:0/751694578 shutdown_connections 2023-07-14T13:13:13.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.144+0000 7f0f430ec640 1 --2- 172.21.15.5:0/751694578 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f3c0b38d0 0x7f0f3c070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:13.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.144+0000 7f0f430ec640 1 --2- 172.21.15.5:0/751694578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f3c0cb360 0x7f0f3c15df80 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:13.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.144+0000 7f0f430ec640 1 -- 172.21.15.5:0/751694578 >> 172.21.15.5:0/751694578 conn(0x7f0f3c0afac0 msgr2=0x7f0f3c0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:13.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.144+0000 7f0f430ec640 1 -- 172.21.15.5:0/751694578 shutdown_connections 2023-07-14T13:13:13.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.144+0000 7f0f430ec640 1 -- 172.21.15.5:0/751694578 wait complete. 2023-07-14T13:13:13.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.144+0000 7f0f430ec640 1 Processor -- start 2023-07-14T13:13:13.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.144+0000 7f0f430ec640 1 -- start start 2023-07-14T13:13:13.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.144+0000 7f0f430ec640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f3c0b38d0 0x7f0f3c14caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:13.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.144+0000 7f0f430ec640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f3c0cb360 0x7f0f3c1517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:13.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.144+0000 7f0f430ec640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f3c0cd490 0x7f0f3c151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:13.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.144+0000 7f0f430ec640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c1488b0 con 0x7f0f3c0cb360 2023-07-14T13:13:13.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.144+0000 7f0f430ec640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c148b90 con 0x7f0f3c0b38d0 2023-07-14T13:13:13.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.144+0000 7f0f430ec640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c148e70 con 0x7f0f3c0cd490 2023-07-14T13:13:13.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.144+0000 7f0f3bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f3c0cb360 0x7f0f3c1517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:13.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.144+0000 7f0f3bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f3c0cb360 0x7f0f3c1517c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43690/0 (socket says 172.21.15.5:43690) 2023-07-14T13:13:13.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.144+0000 7f0f3bfff640 1 -- 172.21.15.5:0/1093323796 learned_addr learned my addr 172.21.15.5:0/1093323796 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:13.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.148+0000 7f0f40e88640 1 --2- 172.21.15.5:0/1093323796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f3c0b38d0 0x7f0f3c14caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:13.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.148+0000 7f0f41689640 1 --2- 172.21.15.5:0/1093323796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f3c0cd490 0x7f0f3c151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:13.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.148+0000 7f0f3bfff640 1 -- 172.21.15.5:0/1093323796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f3c0cd490 msgr2=0x7f0f3c151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:13.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.148+0000 7f0f3bfff640 1 --2- 172.21.15.5:0/1093323796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f3c0cd490 0x7f0f3c151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:13.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.148+0000 7f0f3bfff640 1 -- 172.21.15.5:0/1093323796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f3c0b38d0 msgr2=0x7f0f3c14caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:13.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.148+0000 7f0f3bfff640 1 --2- 172.21.15.5:0/1093323796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f3c0b38d0 0x7f0f3c14caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:13.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.148+0000 7f0f3bfff640 1 -- 172.21.15.5:0/1093323796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f300094d0 con 0x7f0f3c0cb360 2023-07-14T13:13:13.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.148+0000 7f0f41689640 1 --2- 172.21.15.5:0/1093323796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f3c0cd490 0x7f0f3c151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:13:13.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.148+0000 7f0f3bfff640 1 --2- 172.21.15.5:0/1093323796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f3c0cb360 0x7f0f3c1517c0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f0f2800c7f0 tx=0x7f0f2800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:13.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.148+0000 7f0f397fa640 1 -- 172.21.15.5:0/1093323796 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f28007820 con 0x7f0f3c0cb360 2023-07-14T13:13:13.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.148+0000 7f0f397fa640 1 -- 172.21.15.5:0/1093323796 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f28007980 con 0x7f0f3c0cb360 2023-07-14T13:13:13.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.148+0000 7f0f397fa640 1 -- 172.21.15.5:0/1093323796 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f28007d30 con 0x7f0f3c0cb360 2023-07-14T13:13:13.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.148+0000 7f0f430ec640 1 -- 172.21.15.5:0/1093323796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f3c149150 con 0x7f0f3c0cb360 2023-07-14T13:13:13.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.148+0000 7f0f430ec640 1 -- 172.21.15.5:0/1093323796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f3c149950 con 0x7f0f3c0cb360 2023-07-14T13:13:13.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.148+0000 7f0f430ec640 1 -- 172.21.15.5:0/1093323796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3c0678d0 con 0x7f0f3c0cb360 2023-07-14T13:13:13.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.148+0000 7f0f397fa640 1 -- 172.21.15.5:0/1093323796 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0f280113f0 con 0x7f0f3c0cb360 2023-07-14T13:13:13.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.148+0000 7f0f397fa640 1 --2- 172.21.15.5:0/1093323796 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f0f200663a0 0x7f0f20068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:13.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.152+0000 7f0f397fa640 1 -- 172.21.15.5:0/1093323796 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f0f28084260 con 0x7f0f3c0cb360 2023-07-14T13:13:13.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.152+0000 7f0f40e88640 1 --2- 172.21.15.5:0/1093323796 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f0f200663a0 0x7f0f20068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:13.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.152+0000 7f0f40e88640 1 --2- 172.21.15.5:0/1093323796 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f0f200663a0 0x7f0f20068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0f300af000 tx=0x7f0f300b6040 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:13.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.152+0000 7f0f397fa640 1 -- 172.21.15.5:0/1093323796 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f0f28051540 con 0x7f0f3c0cb360 2023-07-14T13:13:13.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.360+0000 7f0f430ec640 1 -- 172.21.15.5:0/1093323796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0f3c149600 con 0x7f0f3c0cb360 2023-07-14T13:13:13.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.368+0000 7f0f397fa640 1 -- 172.21.15.5:0/1093323796 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+147 (secure 0 0 0) 0x7f0f28054b60 con 0x7f0f3c0cb360 2023-07-14T13:13:13.405 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-07-14T13:13:13.405 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDkRLFkCav/DhAA6SOiONAbTcWCnUZXcm7BcQ== 2023-07-14T13:13:13.405 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2023-07-14T13:13:13.405 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2023-07-14T13:13:13.405 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-14T13:13:13.406 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2023-07-14T13:13:13.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.368+0000 7f0f430ec640 1 -- 172.21.15.5:0/1093323796 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f0f200663a0 msgr2=0x7f0f20068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:13.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.368+0000 7f0f430ec640 1 --2- 172.21.15.5:0/1093323796 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f0f200663a0 0x7f0f20068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0f300af000 tx=0x7f0f300b6040 comp rx=0 tx=0).stop 2023-07-14T13:13:13.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.368+0000 7f0f430ec640 1 -- 172.21.15.5:0/1093323796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f3c0cb360 msgr2=0x7f0f3c1517c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:13.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.368+0000 7f0f430ec640 1 --2- 172.21.15.5:0/1093323796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f3c0cb360 0x7f0f3c1517c0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f0f2800c7f0 tx=0x7f0f2800ccb0 comp rx=0 tx=0).stop 2023-07-14T13:13:13.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.368+0000 7f0f430ec640 1 -- 172.21.15.5:0/1093323796 shutdown_connections 2023-07-14T13:13:13.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.368+0000 7f0f430ec640 1 --2- 172.21.15.5:0/1093323796 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f0f200663a0 0x7f0f20068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:13.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.368+0000 7f0f430ec640 1 --2- 172.21.15.5:0/1093323796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f3c0cd490 0x7f0f3c151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:13.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.368+0000 7f0f430ec640 1 --2- 172.21.15.5:0/1093323796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f3c0cb360 0x7f0f3c1517c0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:13.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.368+0000 7f0f430ec640 1 --2- 172.21.15.5:0/1093323796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f3c0b38d0 0x7f0f3c14caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:13.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.368+0000 7f0f430ec640 1 -- 172.21.15.5:0/1093323796 >> 172.21.15.5:0/1093323796 conn(0x7f0f3c0afac0 msgr2=0x7f0f3c0c2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:13.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.368+0000 7f0f430ec640 1 -- 172.21.15.5:0/1093323796 shutdown_connections 2023-07-14T13:13:13.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.368+0000 7f0f430ec640 1 -- 172.21.15.5:0/1093323796 wait complete. 2023-07-14T13:13:13.426 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:13:13.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.536+0000 7f7a5d0de640 1 Processor -- start 2023-07-14T13:13:13.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.536+0000 7f7a5d0de640 1 -- start start 2023-07-14T13:13:13.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.536+0000 7f7a5d0de640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a5806ae00 0x7f7a5806b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:13.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.536+0000 7f7a5d0de640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a5815fb90 con 0x7f7a58160020 2023-07-14T13:13:13.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.536+0000 7f7a5d0de640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a58156340 con 0x7f7a580af8b0 2023-07-14T13:13:13.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.536+0000 7f7a5d0de640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a580cbd70 con 0x7f7a5806ae00 2023-07-14T13:13:13.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.536+0000 7f7a5c8dd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a5806ae00 0x7f7a5806b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:13.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.536+0000 7f7a577fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7a58160020 0x7f7a580afc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39030/0 (socket says 172.21.15.5:39030) 2023-07-14T13:13:13.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.536+0000 7f7a5c8dd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7a5806ae00 0x7f7a5806b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43704/0 (socket says 172.21.15.5:43704) 2023-07-14T13:13:13.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.536+0000 7f7a577fe640 1 -- 172.21.15.5:0/1130393557 learned_addr learned my addr 172.21.15.5:0/1130393557 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:13:13.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.536+0000 7f7a5c8dd640 1 -- 172.21.15.5:0/1130393557 >> v1:172.21.15.154:6789/0 conn(0x7f7a580af8b0 legacy=0x7f7a5815c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:13.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.536+0000 7f7a5c8dd640 1 -- 172.21.15.5:0/1130393557 >> v1:172.21.15.5:6789/0 conn(0x7f7a58160020 legacy=0x7f7a580afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:13.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.536+0000 7f7a5c8dd640 1 -- 172.21.15.5:0/1130393557 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a580cc050 con 0x7f7a5806ae00 2023-07-14T13:13:13.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.536+0000 7f7a56ffd640 1 -- 172.21.15.5:0/1130393557 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935133072 0 0) 0x7f7a5815fb90 con 0x7f7a58160020 2023-07-14T13:13:13.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.540+0000 7f7a5c8dd640 1 --2- 172.21.15.5:0/1130393557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a5806ae00 0x7f7a5806b260 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f7a50009d90 tx=0x7f7a5001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a37ae3b3279e90 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:13.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.540+0000 7f7a56ffd640 1 -- 172.21.15.5:0/1130393557 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a500a5810 con 0x7f7a5806ae00 2023-07-14T13:13:13.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.540+0000 7f7a56ffd640 1 -- 172.21.15.5:0/1130393557 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a500a5970 con 0x7f7a5806ae00 2023-07-14T13:13:13.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.540+0000 7f7a56ffd640 1 -- 172.21.15.5:0/1130393557 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a500a5d00 con 0x7f7a5806ae00 2023-07-14T13:13:13.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.540+0000 7f7a5d0de640 1 -- 172.21.15.5:0/1130393557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a5806ae00 msgr2=0x7f7a5806b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:13.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.540+0000 7f7a5d0de640 1 --2- 172.21.15.5:0/1130393557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a5806ae00 0x7f7a5806b260 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f7a50009d90 tx=0x7f7a5001c950 comp rx=0 tx=0).stop 2023-07-14T13:13:13.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.540+0000 7f7a5d0de640 1 -- 172.21.15.5:0/1130393557 shutdown_connections 2023-07-14T13:13:13.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.540+0000 7f7a5d0de640 1 --2- 172.21.15.5:0/1130393557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a5806ae00 0x7f7a5806b260 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:13.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.540+0000 7f7a5d0de640 1 -- 172.21.15.5:0/1130393557 >> 172.21.15.5:0/1130393557 conn(0x7f7a580ca8b0 msgr2=0x7f7a580cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:13.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.540+0000 7f7a5d0de640 1 -- 172.21.15.5:0/1130393557 shutdown_connections 2023-07-14T13:13:13.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.540+0000 7f7a5d0de640 1 -- 172.21.15.5:0/1130393557 wait complete. 2023-07-14T13:13:13.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.540+0000 7f7a5d0de640 1 Processor -- start 2023-07-14T13:13:13.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.544+0000 7f7a5d0de640 1 -- start start 2023-07-14T13:13:13.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.544+0000 7f7a5d0de640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a5806ae00 0x7f7a5815ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:13.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.544+0000 7f7a5d0de640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a580af8b0 0x7f7a58153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:13.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.544+0000 7f7a5d0de640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a58160020 0x7f7a58150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:13.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.544+0000 7f7a5d0de640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5815f240 con 0x7f7a580af8b0 2023-07-14T13:13:13.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.544+0000 7f7a5d0de640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a58153e70 con 0x7f7a58160020 2023-07-14T13:13:13.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.544+0000 7f7a5d0de640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a58154150 con 0x7f7a5806ae00 2023-07-14T13:13:13.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.544+0000 7f7a577fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a580af8b0 0x7f7a58153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:13.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.544+0000 7f7a577fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a580af8b0 0x7f7a58153440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43720/0 (socket says 172.21.15.5:43720) 2023-07-14T13:13:13.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.544+0000 7f7a577fe640 1 -- 172.21.15.5:0/666885427 learned_addr learned my addr 172.21.15.5:0/666885427 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:13.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.544+0000 7f7a57fff640 1 --2- 172.21.15.5:0/666885427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a5806ae00 0x7f7a5815ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:13.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.544+0000 7f7a5c8dd640 1 --2- 172.21.15.5:0/666885427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a58160020 0x7f7a58150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:13.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.544+0000 7f7a577fe640 1 -- 172.21.15.5:0/666885427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a5806ae00 msgr2=0x7f7a5815ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:13.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.544+0000 7f7a577fe640 1 --2- 172.21.15.5:0/666885427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a5806ae00 0x7f7a5815ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:13.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.544+0000 7f7a577fe640 1 -- 172.21.15.5:0/666885427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a58160020 msgr2=0x7f7a58150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:13.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.544+0000 7f7a577fe640 1 --2- 172.21.15.5:0/666885427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a58160020 0x7f7a58150a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:13.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.544+0000 7f7a577fe640 1 -- 172.21.15.5:0/666885427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a50009a70 con 0x7f7a580af8b0 2023-07-14T13:13:13.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.544+0000 7f7a577fe640 1 --2- 172.21.15.5:0/666885427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a580af8b0 0x7f7a58153440 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00c4a0 tx=0x7f7a4c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:13.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.544+0000 7f7a54ff9640 1 -- 172.21.15.5:0/666885427 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c0074e0 con 0x7f7a580af8b0 2023-07-14T13:13:13.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.544+0000 7f7a54ff9640 1 -- 172.21.15.5:0/666885427 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4c007640 con 0x7f7a580af8b0 2023-07-14T13:13:13.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.544+0000 7f7a54ff9640 1 -- 172.21.15.5:0/666885427 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c004a30 con 0x7f7a580af8b0 2023-07-14T13:13:13.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.544+0000 7f7a5d0de640 1 -- 172.21.15.5:0/666885427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a58154430 con 0x7f7a580af8b0 2023-07-14T13:13:13.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.544+0000 7f7a5d0de640 1 -- 172.21.15.5:0/666885427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a581549f0 con 0x7f7a580af8b0 2023-07-14T13:13:13.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.544+0000 7f7a5d0de640 1 -- 172.21.15.5:0/666885427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a58154c10 con 0x7f7a580af8b0 2023-07-14T13:13:13.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.548+0000 7f7a54ff9640 1 -- 172.21.15.5:0/666885427 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7a4c004b90 con 0x7f7a580af8b0 2023-07-14T13:13:13.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.548+0000 7f7a54ff9640 1 --2- 172.21.15.5:0/666885427 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f7a440663d0 0x7f7a44068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:13.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.548+0000 7f7a54ff9640 1 -- 172.21.15.5:0/666885427 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f7a4c0831e0 con 0x7f7a580af8b0 2023-07-14T13:13:13.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.548+0000 7f7a57fff640 1 --2- 172.21.15.5:0/666885427 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f7a440663d0 0x7f7a44068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:13.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.548+0000 7f7a57fff640 1 --2- 172.21.15.5:0/666885427 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f7a440663d0 0x7f7a44068880 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7a48007fd0 tx=0x7f7a48009040 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.552+0000 7f7a54ff9640 1 -- 172.21.15.5:0/666885427 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7a4c0504b0 con 0x7f7a580af8b0 2023-07-14T13:13:13.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.740+0000 7f7a5d0de640 1 -- 172.21.15.5:0/666885427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a580cb9d0 con 0x7f7a580af8b0 2023-07-14T13:13:13.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.740+0000 7f7a54ff9640 1 -- 172.21.15.5:0/666885427 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4708 (secure 0 0 0) 0x7f7a4c018090 con 0x7f7a580af8b0 2023-07-14T13:13:13.778 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:13:13.778 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":73,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3146480803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3146480803},{"type":"v1","addr":"172.21.15.154:6837","nonce":3146480803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8908,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2567208960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2567208960},{"type":"v1","addr":"172.21.15.5:6835","nonce":2567208960}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8911,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3591700265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3591700265},{"type":"v1","addr":"172.21.15.154:6836","nonce":3591700265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:13:03.243523+0000","modified":"2023-07-14T13:13:06.886056+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9336":{"gid":9336,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/840216087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":840216087},{"type":"v1","addr":"172.21.15.5:6834","nonce":840216087}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-14T13:13:13.778 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 73 2023-07-14T13:13:13.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.740+0000 7f7a5d0de640 1 -- 172.21.15.5:0/666885427 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f7a440663d0 msgr2=0x7f7a44068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:13.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.740+0000 7f7a5d0de640 1 --2- 172.21.15.5:0/666885427 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f7a440663d0 0x7f7a44068880 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7a48007fd0 tx=0x7f7a48009040 comp rx=0 tx=0).stop 2023-07-14T13:13:13.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.740+0000 7f7a5d0de640 1 -- 172.21.15.5:0/666885427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a580af8b0 msgr2=0x7f7a58153440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:13.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.740+0000 7f7a5d0de640 1 --2- 172.21.15.5:0/666885427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a580af8b0 0x7f7a58153440 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00c4a0 tx=0x7f7a4c00c960 comp rx=0 tx=0).stop 2023-07-14T13:13:13.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.740+0000 7f7a5d0de640 1 -- 172.21.15.5:0/666885427 shutdown_connections 2023-07-14T13:13:13.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.740+0000 7f7a5d0de640 1 --2- 172.21.15.5:0/666885427 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f7a440663d0 0x7f7a44068880 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:13.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.740+0000 7f7a5d0de640 1 --2- 172.21.15.5:0/666885427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a58160020 0x7f7a58150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:13.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.740+0000 7f7a5d0de640 1 --2- 172.21.15.5:0/666885427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7a580af8b0 0x7f7a58153440 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:13.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.740+0000 7f7a5d0de640 1 --2- 172.21.15.5:0/666885427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a5806ae00 0x7f7a5815ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:13.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.740+0000 7f7a5d0de640 1 -- 172.21.15.5:0/666885427 >> 172.21.15.5:0/666885427 conn(0x7f7a580ca8b0 msgr2=0x7f7a580ae330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:13.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.740+0000 7f7a5d0de640 1 -- 172.21.15.5:0/666885427 shutdown_connections 2023-07-14T13:13:13.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:13.740+0000 7f7a5d0de640 1 -- 172.21.15.5:0/666885427 wait complete. 2023-07-14T13:13:14.202 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 73, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-14T13:13:03.243523+0000', 'modified': '2023-07-14T13:13:06.886056+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9336}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9336': {'gid': 9336, 'name': 'c', 'rank': 0, 'incarnation': 69, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6834/840216087', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6832', 'nonce': 840216087}, {'type': 'v1', 'addr': '172.21.15.5:6834', 'nonce': 840216087}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-14T13:13:14.203 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-14T13:13:14.203 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-14T13:13:14.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.312+0000 7ff70bf40640 1 Processor -- start 2023-07-14T13:13:14.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.312+0000 7ff70bf40640 1 -- start start 2023-07-14T13:13:14.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.312+0000 7ff70bf40640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff704070b70 0x7ff704070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.312+0000 7ff70bf40640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff70406b1e0 0x7ff7040c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.312+0000 7ff70bf40640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7040cac70 con 0x7ff7040c21f0 2023-07-14T13:13:14.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.312+0000 7ff70bf40640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff704071480 con 0x7ff70406b1e0 2023-07-14T13:13:14.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.312+0000 7ff70bf40640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7040ca060 con 0x7ff704070b70 2023-07-14T13:13:14.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.316+0000 7ff7094db640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff70406b1e0 0x7ff7040c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.316+0000 7ff7094db640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff70406b1e0 0x7ff7040c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43732/0 (socket says 172.21.15.5:43732) 2023-07-14T13:13:14.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.316+0000 7ff7094db640 1 -- 172.21.15.5:0/3373935996 learned_addr learned my addr 172.21.15.5:0/3373935996 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:14.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.316+0000 7ff70a4dd640 1 --1- 172.21.15.5:0/3373935996 >> v1:172.21.15.5:6789/0 conn(0x7ff7040c21f0 0x7ff7040cb100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39034/0 (socket says 172.21.15.5:39034) 2023-07-14T13:13:14.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.316+0000 7ff709cdc640 1 --2- 172.21.15.5:0/3373935996 >> v2:172.21.15.154:3300/0 conn(0x7ff704070b70 0x7ff704070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.316+0000 7ff7094db640 1 -- 172.21.15.5:0/3373935996 >> v2:172.21.15.154:3300/0 conn(0x7ff704070b70 msgr2=0x7ff704070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:14.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.316+0000 7ff7094db640 1 --2- 172.21.15.5:0/3373935996 >> v2:172.21.15.154:3300/0 conn(0x7ff704070b70 0x7ff704070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.316+0000 7ff7094db640 1 -- 172.21.15.5:0/3373935996 >> v1:172.21.15.5:6789/0 conn(0x7ff7040c21f0 legacy=0x7ff7040cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:14.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.316+0000 7ff7094db640 1 -- 172.21.15.5:0/3373935996 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7040ca340 con 0x7ff70406b1e0 2023-07-14T13:13:14.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.316+0000 7ff708cda640 1 -- 172.21.15.5:0/3373935996 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 157916518 0 0) 0x7ff7040cac70 con 0x7ff7040c21f0 2023-07-14T13:13:14.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.316+0000 7ff7094db640 1 --2- 172.21.15.5:0/3373935996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff70406b1e0 0x7ff7040c1cb0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7ff70406f1f0 tx=0x7ff6f401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a064ff600d5d25 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:14.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.316+0000 7ff708cda640 1 -- 172.21.15.5:0/3373935996 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f40aa430 con 0x7ff70406b1e0 2023-07-14T13:13:14.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.316+0000 7ff708cda640 1 -- 172.21.15.5:0/3373935996 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f40aa590 con 0x7ff70406b1e0 2023-07-14T13:13:14.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.316+0000 7ff708cda640 1 -- 172.21.15.5:0/3373935996 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f40aa920 con 0x7ff70406b1e0 2023-07-14T13:13:14.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.320+0000 7ff70bf40640 1 -- 172.21.15.5:0/3373935996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff70406b1e0 msgr2=0x7ff7040c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:14.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.320+0000 7ff70bf40640 1 --2- 172.21.15.5:0/3373935996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff70406b1e0 0x7ff7040c1cb0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7ff70406f1f0 tx=0x7ff6f401c4d0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.320+0000 7ff70bf40640 1 -- 172.21.15.5:0/3373935996 shutdown_connections 2023-07-14T13:13:14.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.320+0000 7ff70bf40640 1 --2- 172.21.15.5:0/3373935996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff70406b1e0 0x7ff7040c1cb0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.320+0000 7ff70bf40640 1 --2- 172.21.15.5:0/3373935996 >> v2:172.21.15.154:3300/0 conn(0x7ff704070b70 0x7ff704070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.320+0000 7ff70bf40640 1 -- 172.21.15.5:0/3373935996 >> 172.21.15.5:0/3373935996 conn(0x7ff7040afcf0 msgr2=0x7ff7040b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:14.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.320+0000 7ff70bf40640 1 -- 172.21.15.5:0/3373935996 shutdown_connections 2023-07-14T13:13:14.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.320+0000 7ff70bf40640 1 -- 172.21.15.5:0/3373935996 wait complete. 2023-07-14T13:13:14.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.320+0000 7ff70bf40640 1 Processor -- start 2023-07-14T13:13:14.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.320+0000 7ff70bf40640 1 -- start start 2023-07-14T13:13:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.320+0000 7ff70bf40640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff70406b1e0 0x7ff704152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.320+0000 7ff70bf40640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff704070b70 0x7ff7041f5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.320+0000 7ff70bf40640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7040c21f0 0x7ff7041f6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.320+0000 7ff70bf40640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70413ecf0 con 0x7ff704070b70 2023-07-14T13:13:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.320+0000 7ff70bf40640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70413e0e0 con 0x7ff70406b1e0 2023-07-14T13:13:14.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.320+0000 7ff70bf40640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff70413e3c0 con 0x7ff7040c21f0 2023-07-14T13:13:14.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.320+0000 7ff7094db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff704070b70 0x7ff7041f5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.320+0000 7ff7094db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff704070b70 0x7ff7041f5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43748/0 (socket says 172.21.15.5:43748) 2023-07-14T13:13:14.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.320+0000 7ff7094db640 1 -- 172.21.15.5:0/3746340696 learned_addr learned my addr 172.21.15.5:0/3746340696 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:14.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.320+0000 7ff709cdc640 1 --2- 172.21.15.5:0/3746340696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff70406b1e0 0x7ff704152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.324+0000 7ff70a4dd640 1 --2- 172.21.15.5:0/3746340696 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7040c21f0 0x7ff7041f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.324+0000 7ff7094db640 1 -- 172.21.15.5:0/3746340696 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7040c21f0 msgr2=0x7ff7041f6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:14.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.324+0000 7ff7094db640 1 --2- 172.21.15.5:0/3746340696 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7040c21f0 0x7ff7041f6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.324+0000 7ff7094db640 1 -- 172.21.15.5:0/3746340696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff70406b1e0 msgr2=0x7ff704152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:14.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.324+0000 7ff7094db640 1 --2- 172.21.15.5:0/3746340696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff70406b1e0 0x7ff704152240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.324+0000 7ff7094db640 1 -- 172.21.15.5:0/3746340696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f40094d0 con 0x7ff704070b70 2023-07-14T13:13:14.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.324+0000 7ff7094db640 1 --2- 172.21.15.5:0/3746340696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff704070b70 0x7ff7041f5c30 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7ff6f401ab80 tx=0x7ff6f401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:14.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.324+0000 7ff6fa7fc640 1 -- 172.21.15.5:0/3746340696 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f40aac90 con 0x7ff704070b70 2023-07-14T13:13:14.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.324+0000 7ff6fa7fc640 1 -- 172.21.15.5:0/3746340696 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f40b7070 con 0x7ff704070b70 2023-07-14T13:13:14.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.324+0000 7ff6fa7fc640 1 -- 172.21.15.5:0/3746340696 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4004020 con 0x7ff704070b70 2023-07-14T13:13:14.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.324+0000 7ff70bf40640 1 -- 172.21.15.5:0/3746340696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff70413e6a0 con 0x7ff704070b70 2023-07-14T13:13:14.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.324+0000 7ff70bf40640 1 -- 172.21.15.5:0/3746340696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff704152780 con 0x7ff704070b70 2023-07-14T13:13:14.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.324+0000 7ff6fa7fc640 1 -- 172.21.15.5:0/3746340696 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff6f4004180 con 0x7ff704070b70 2023-07-14T13:13:14.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff6fa7fc640 1 --2- 172.21.15.5:0/3746340696 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7ff6e80663a0 0x7ff6e8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff6fa7fc640 1 -- 172.21.15.5:0/3746340696 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6090+0+0 (secure 0 0 0) 0x7ff6f411dc40 con 0x7ff704070b70 2023-07-14T13:13:14.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff70f2a7000 1 Processor -- start 2023-07-14T13:13:14.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff709cdc640 1 --2- 172.21.15.5:0/3746340696 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7ff6e80663a0 0x7ff6e8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff70f2a7000 1 -- start start 2023-07-14T13:13:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff709cdc640 1 --2- 172.21.15.5:0/3746340696 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7ff6e80663a0 0x7ff6e8068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff700009b60 tx=0x7ff700009190 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff70f2a7000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e61ff34f80 0x55e61ff35350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff70f2a7000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e61ff35890 0x55e61feeb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff70f2a7000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61feeb930 0x55e61feebd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff70f2a7000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e61fdb2900 con 0x55e61feeb930 2023-07-14T13:13:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff70f2a7000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e61fcec8c0 con 0x55e61ff35890 2023-07-14T13:13:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff70f2a7000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e61fd40360 con 0x55e61ff34f80 2023-07-14T13:13:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff70a4dd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61feeb930 0x55e61feebd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff709cdc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e61ff34f80 0x55e61ff35350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff70a4dd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61feeb930 0x55e61feebd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43756/0 (socket says 172.21.15.5:43756) 2023-07-14T13:13:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff70a4dd640 1 -- 172.21.15.5:0/2624645058 learned_addr learned my addr 172.21.15.5:0/2624645058 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff7094db640 1 --2- 172.21.15.5:0/2624645058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e61ff35890 0x55e61feeb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff70a4dd640 1 -- 172.21.15.5:0/2624645058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e61ff34f80 msgr2=0x55e61ff35350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff70a4dd640 1 --2- 172.21.15.5:0/2624645058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e61ff34f80 0x55e61ff35350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff70a4dd640 1 -- 172.21.15.5:0/2624645058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e61ff35890 msgr2=0x55e61feeb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff70a4dd640 1 --2- 172.21.15.5:0/2624645058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e61ff35890 0x55e61feeb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff70a4dd640 1 -- 172.21.15.5:0/2624645058 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e61fa35890 con 0x55e61feeb930 2023-07-14T13:13:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff70a4dd640 1 --2- 172.21.15.5:0/2624645058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61feeb930 0x55e61feebd00 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc007420 tx=0x7ff6fc007820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b581518ba42a466 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff6e77fe640 1 -- 172.21.15.5:0/2624645058 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc007a70 con 0x55e61feeb930 2023-07-14T13:13:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff6e77fe640 1 -- 172.21.15.5:0/2624645058 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6fc001c60 con 0x55e61feeb930 2023-07-14T13:13:14.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff6e77fe640 1 -- 172.21.15.5:0/2624645058 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc001ff0 con 0x55e61feeb930 2023-07-14T13:13:14.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff70f2a7000 1 -- 172.21.15.5:0/2624645058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61feeb930 msgr2=0x55e61feebd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:14.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff70f2a7000 1 --2- 172.21.15.5:0/2624645058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61feeb930 0x55e61feebd00 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc007420 tx=0x7ff6fc007820 comp rx=0 tx=0).stop 2023-07-14T13:13:14.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff70f2a7000 1 -- 172.21.15.5:0/2624645058 shutdown_connections 2023-07-14T13:13:14.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff70f2a7000 1 --2- 172.21.15.5:0/2624645058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61feeb930 0x55e61feebd00 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff70f2a7000 1 --2- 172.21.15.5:0/2624645058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e61ff35890 0x55e61feeb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff70f2a7000 1 --2- 172.21.15.5:0/2624645058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e61ff34f80 0x55e61ff35350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff70f2a7000 1 -- 172.21.15.5:0/2624645058 >> 172.21.15.5:0/2624645058 conn(0x55e61fef1a90 msgr2=0x55e61fee9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:14.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff70f2a7000 1 -- 172.21.15.5:0/2624645058 shutdown_connections 2023-07-14T13:13:14.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.328+0000 7ff70f2a7000 1 -- 172.21.15.5:0/2624645058 wait complete. 2023-07-14T13:13:14.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff70f2a7000 1 -- start start 2023-07-14T13:13:14.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff70f2a7000 1 Processor -- start 2023-07-14T13:13:14.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff70f2a7000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e61feeb930 0x55e61ff40510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff70f2a7000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61ff34f80 0x55e61ff40a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff70f2a7000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e61ff35890 0x55e61fefa980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff70f2a7000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e61fd39400 con 0x55e61ff34f80 2023-07-14T13:13:14.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff70f2a7000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e61fcf5b60 con 0x55e61feeb930 2023-07-14T13:13:14.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff70f2a7000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e61fcf5800 con 0x55e61ff35890 2023-07-14T13:13:14.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff70f2a7000 10 client.0 _ll_register_callbacks cb 0x55e61fed72c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:13:14.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff7094db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61ff34f80 0x55e61ff40a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff7094db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61ff34f80 0x55e61ff40a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43760/0 (socket says 172.21.15.5:43760) 2023-07-14T13:13:14.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff7094db640 1 -- 172.21.15.5:0/1450132119 learned_addr learned my addr 172.21.15.5:0/1450132119 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:14.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff709cdc640 1 --2- 172.21.15.5:0/1450132119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e61feeb930 0x55e61ff40510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff70a4dd640 1 --2- 172.21.15.5:0/1450132119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e61ff35890 0x55e61fefa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff7094db640 1 -- 172.21.15.5:0/1450132119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e61ff35890 msgr2=0x55e61fefa980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:14.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff7094db640 1 --2- 172.21.15.5:0/1450132119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e61ff35890 0x55e61fefa980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff7094db640 1 -- 172.21.15.5:0/1450132119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e61feeb930 msgr2=0x55e61ff40510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:14.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff7094db640 1 --2- 172.21.15.5:0/1450132119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e61feeb930 0x55e61ff40510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff7094db640 1 -- 172.21.15.5:0/1450132119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6fc00f040 con 0x55e61ff34f80 2023-07-14T13:13:14.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff7094db640 1 --2- 172.21.15.5:0/1450132119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61ff34f80 0x55e61ff40a50 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7ff6f40eeaf0 tx=0x7ff6f40ecf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a884ad209d42fc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:14.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff6e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-07-14T13:13:14.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff6e4ff9640 1 -- 172.21.15.5:0/1450132119 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f40ea9a0 con 0x55e61ff34f80 2023-07-14T13:13:14.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff70f2a7000 1 -- 172.21.15.5:0/1450132119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e61fd00aa0 con 0x55e61ff34f80 2023-07-14T13:13:14.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff6e4ff9640 1 -- 172.21.15.5:0/1450132119 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(156..156 src has 1..156) v4 ==== 6090+0+0 (secure 0 0 0) 0x7ff6f40eab00 con 0x55e61ff34f80 2023-07-14T13:13:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff6e4ff9640 1 -- 172.21.15.5:0/1450132119 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6f40eacc0 con 0x55e61ff34f80 2023-07-14T13:13:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff70f2a7000 10 client.9528 fetch_fsmap learned FSMap version 73 2023-07-14T13:13:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff70f2a7000 1 -- 172.21.15.5:0/1450132119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x55e61fcfdd90 con 0x55e61ff34f80 2023-07-14T13:13:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff6e4ff9640 1 -- 172.21.15.5:0/1450132119 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e61fd00aa0 con 0x55e61ff34f80 2023-07-14T13:13:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff6e4ff9640 1 -- 172.21.15.5:0/1450132119 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 73) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff6f40c6020 con 0x55e61ff34f80 2023-07-14T13:13:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff70f2a7000 10 client.9528 fetch_fsmap finished waiting for FSMap version 73 2023-07-14T13:13:14.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff70f2a7000 10 client.9528 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T13:13:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff70f2a7000 20 client.9528 populate_metadata read hostname 'smithi005' 2023-07-14T13:13:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff70f2a7000 1 --2- 172.21.15.5:0/1450132119 >> [v2:172.21.15.5:6832/840216087,v1:172.21.15.5:6834/840216087] conn(0x55e61fefb720 0x55e61fefbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff70f2a7000 4 client.9528 mds_command: new command op to 9336 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:13:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.332+0000 7ff70f2a7000 1 -- 172.21.15.5:0/1450132119 --> [v2:172.21.15.5:6832/840216087,v1:172.21.15.5:6834/840216087] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e61fd67f40 con 0x55e61fefb720 2023-07-14T13:13:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.336+0000 7ff709cdc640 1 --2- 172.21.15.5:0/1450132119 >> [v2:172.21.15.5:6832/840216087,v1:172.21.15.5:6834/840216087] conn(0x55e61fefb720 0x55e61fefbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.336+0000 7ff709cdc640 1 --2- 172.21.15.5:0/1450132119 >> [v2:172.21.15.5:6832/840216087,v1:172.21.15.5:6834/840216087] conn(0x55e61fefb720 0x55e61fefbaf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6c78b09b1d7bbb1 server_cookie=7b17a8f9b0508cc6 in_seq=0 out_seq=0 2023-07-14T13:13:14.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.336+0000 7ff6e4ff9640 10 client.9528 ms_handle_connect on v2:172.21.15.5:6832/840216087 2023-07-14T13:13:14.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.336+0000 7ff6e4ff9640 1 -- 172.21.15.5:0/1450132119 <== mds.0 v2:172.21.15.5:6832/840216087 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e61fd67f40 con 0x55e61fefb720 2023-07-14T13:13:14.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.336+0000 7ff6e4ff9640 10 client.9528 handle_command_reply: tid=0 2023-07-14T13:13:14.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.336+0000 7ff70f2a7000 1 client.9528 shutdown 2023-07-14T13:13:14.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.336+0000 7ff70f2a7000 1 -- 172.21.15.5:0/1450132119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61ff34f80 msgr2=0x55e61ff40a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:14.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.336+0000 7ff70f2a7000 1 --2- 172.21.15.5:0/1450132119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61ff34f80 0x55e61ff40a50 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7ff6f40eeaf0 tx=0x7ff6f40ecf50 comp rx=0 tx=0).stop 2023-07-14T13:13:14.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.336+0000 7ff70f2a7000 1 -- 172.21.15.5:0/1450132119 shutdown_connections 2023-07-14T13:13:14.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.336+0000 7ff70f2a7000 1 --2- 172.21.15.5:0/1450132119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e61ff35890 0x55e61fefa980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.336+0000 7ff70f2a7000 1 --2- 172.21.15.5:0/1450132119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61ff34f80 0x55e61ff40a50 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.336+0000 7ff70f2a7000 1 --2- 172.21.15.5:0/1450132119 >> [v2:172.21.15.5:6832/840216087,v1:172.21.15.5:6834/840216087] conn(0x55e61fefb720 0x55e61fefbaf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.336+0000 7ff70f2a7000 1 --2- 172.21.15.5:0/1450132119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e61feeb930 0x55e61ff40510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.336+0000 7ff6e4ff9640 0 client.9528 ms_handle_reset on v2:172.21.15.5:6832/840216087 2023-07-14T13:13:14.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.336+0000 7ff70f2a7000 1 -- 172.21.15.5:0/1450132119 >> 172.21.15.5:0/1450132119 conn(0x55e61fef1a90 msgr2=0x55e61feea3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:14.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.336+0000 7ff70f2a7000 1 -- 172.21.15.5:0/1450132119 shutdown_connections 2023-07-14T13:13:14.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.336+0000 7ff70f2a7000 1 -- 172.21.15.5:0/1450132119 wait complete. 2023-07-14T13:13:14.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.336+0000 7ff70f2a7000 20 client.9528 trim_cache size 0 max 16384 2023-07-14T13:13:14.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.352+0000 7ff70f2a7000 1 Processor -- start 2023-07-14T13:13:14.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.352+0000 7ff70f2a7000 1 -- start start 2023-07-14T13:13:14.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.352+0000 7ff70f2a7000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61feeb930 0x55e61ff4a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.352+0000 7ff70f2a7000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e61ff34f80 0x55e61ff4abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.352+0000 7ff70f2a7000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e61ff35890 0x55e61ff4b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.352+0000 7ff70f2a7000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e61f9f6940 con 0x55e61feeb930 2023-07-14T13:13:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.352+0000 7ff70f2a7000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e61feeb450 con 0x55e61ff34f80 2023-07-14T13:13:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.352+0000 7ff70f2a7000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e61ff46c20 con 0x55e61ff35890 2023-07-14T13:13:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.352+0000 7ff709cdc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61feeb930 0x55e61ff4a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.352+0000 7ff709cdc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61feeb930 0x55e61ff4a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43766/0 (socket says 172.21.15.5:43766) 2023-07-14T13:13:14.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.352+0000 7ff709cdc640 1 -- 172.21.15.5:0/910289878 learned_addr learned my addr 172.21.15.5:0/910289878 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:14.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.352+0000 7ff709cdc640 1 -- 172.21.15.5:0/910289878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e61ff35890 msgr2=0x55e61ff4b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:14.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.352+0000 7ff709cdc640 1 --2- 172.21.15.5:0/910289878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e61ff35890 0x55e61ff4b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.352+0000 7ff709cdc640 1 -- 172.21.15.5:0/910289878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e61ff34f80 msgr2=0x55e61ff4abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:14.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.352+0000 7ff709cdc640 1 --2- 172.21.15.5:0/910289878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e61ff34f80 0x55e61ff4abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.352+0000 7ff709cdc640 1 -- 172.21.15.5:0/910289878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e61feee000 con 0x55e61feeb930 2023-07-14T13:13:14.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.352+0000 7ff709cdc640 1 --2- 172.21.15.5:0/910289878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61feeb930 0x55e61ff4a680 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x55e61fd39120 tx=0x7ff700018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db09098cf0866ec server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:14.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.352+0000 7ff6e7fff640 1 -- 172.21.15.5:0/910289878 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70001c040 con 0x55e61feeb930 2023-07-14T13:13:14.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.352+0000 7ff6e7fff640 1 -- 172.21.15.5:0/910289878 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70002c3e0 con 0x55e61feeb930 2023-07-14T13:13:14.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.352+0000 7ff6e7fff640 1 -- 172.21.15.5:0/910289878 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff700011d30 con 0x55e61feeb930 2023-07-14T13:13:14.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.352+0000 7ff70f2a7000 1 -- 172.21.15.5:0/910289878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61feeb930 msgr2=0x55e61ff4a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:14.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.352+0000 7ff70f2a7000 1 --2- 172.21.15.5:0/910289878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61feeb930 0x55e61ff4a680 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x55e61fd39120 tx=0x7ff700018000 comp rx=0 tx=0).stop 2023-07-14T13:13:14.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70f2a7000 1 -- 172.21.15.5:0/910289878 shutdown_connections 2023-07-14T13:13:14.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70f2a7000 1 --2- 172.21.15.5:0/910289878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e61ff35890 0x55e61ff4b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70f2a7000 1 --2- 172.21.15.5:0/910289878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e61ff34f80 0x55e61ff4abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70f2a7000 1 --2- 172.21.15.5:0/910289878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61feeb930 0x55e61ff4a680 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70f2a7000 1 -- 172.21.15.5:0/910289878 >> 172.21.15.5:0/910289878 conn(0x55e61fef1a90 msgr2=0x55e61fef0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:14.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70f2a7000 1 -- 172.21.15.5:0/910289878 shutdown_connections 2023-07-14T13:13:14.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70f2a7000 1 -- 172.21.15.5:0/910289878 wait complete. 2023-07-14T13:13:14.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70f2a7000 1 -- start start 2023-07-14T13:13:14.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70f2a7000 1 Processor -- start 2023-07-14T13:13:14.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70f2a7000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e61feeb930 0x55e61ff96da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70f2a7000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e61ff34f80 0x55e61ff4ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70f2a7000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61ff35890 0x55e61ff4e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70f2a7000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e61fd3bf60 con 0x55e61ff35890 2023-07-14T13:13:14.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70f2a7000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e61fd7c600 con 0x55e61feeb930 2023-07-14T13:13:14.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70f2a7000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e61fce14d0 con 0x55e61ff34f80 2023-07-14T13:13:14.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70f2a7000 10 client.0 _ll_register_callbacks cb 0x55e61feb74b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:13:14.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70a4dd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61ff35890 0x55e61ff4e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70a4dd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61ff35890 0x55e61ff4e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43772/0 (socket says 172.21.15.5:43772) 2023-07-14T13:13:14.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70a4dd640 1 -- 172.21.15.5:0/3820461195 learned_addr learned my addr 172.21.15.5:0/3820461195 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:14.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff709cdc640 1 --2- 172.21.15.5:0/3820461195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e61feeb930 0x55e61ff96da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff7094db640 1 --2- 172.21.15.5:0/3820461195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e61ff34f80 0x55e61ff4ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70a4dd640 1 -- 172.21.15.5:0/3820461195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e61ff34f80 msgr2=0x55e61ff4ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:14.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70a4dd640 1 --2- 172.21.15.5:0/3820461195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e61ff34f80 0x55e61ff4ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70a4dd640 1 -- 172.21.15.5:0/3820461195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e61feeb930 msgr2=0x55e61ff96da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:14.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70a4dd640 1 --2- 172.21.15.5:0/3820461195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e61feeb930 0x55e61ff96da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70a4dd640 1 -- 172.21.15.5:0/3820461195 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff700004140 con 0x55e61ff35890 2023-07-14T13:13:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70a4dd640 1 --2- 172.21.15.5:0/3820461195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61ff35890 0x55e61ff4e330 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc007fa0 tx=0x7ff6fc001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d22965a1ef9609 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff6e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-07-14T13:13:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff6e4ff9640 1 -- 172.21.15.5:0/3820461195 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc007a70 con 0x55e61ff35890 2023-07-14T13:13:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff6e4ff9640 1 -- 172.21.15.5:0/3820461195 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(156..156 src has 1..156) v4 ==== 6090+0+0 (secure 0 0 0) 0x7ff6fc014480 con 0x55e61ff35890 2023-07-14T13:13:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70f2a7000 1 -- 172.21.15.5:0/3820461195 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e61ff46650 con 0x55e61ff35890 2023-07-14T13:13:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff6e4ff9640 1 -- 172.21.15.5:0/3820461195 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6fc014640 con 0x55e61ff35890 2023-07-14T13:13:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70f2a7000 10 client.9534 fetch_fsmap learned FSMap version 73 2023-07-14T13:13:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70f2a7000 1 -- 172.21.15.5:0/3820461195 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x55e61fce4020 con 0x55e61ff35890 2023-07-14T13:13:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff6e4ff9640 1 -- 172.21.15.5:0/3820461195 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e61ff46650 con 0x55e61ff35890 2023-07-14T13:13:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff6e4ff9640 1 -- 172.21.15.5:0/3820461195 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 73) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff6fc0147a0 con 0x55e61ff35890 2023-07-14T13:13:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70f2a7000 10 client.9534 fetch_fsmap finished waiting for FSMap version 73 2023-07-14T13:13:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70f2a7000 10 client.9534 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T13:13:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70f2a7000 20 client.9534 populate_metadata read hostname 'smithi005' 2023-07-14T13:13:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70f2a7000 1 --2- 172.21.15.5:0/3820461195 >> [v2:172.21.15.5:6832/840216087,v1:172.21.15.5:6834/840216087] conn(0x55e61ff4e870 0x55e61ff4ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70f2a7000 4 client.9534 mds_command: new command op to 9336 tid=0[{"prefix": "status"}] 2023-07-14T13:13:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.356+0000 7ff70f2a7000 1 -- 172.21.15.5:0/3820461195 --> [v2:172.21.15.5:6832/840216087,v1:172.21.15.5:6834/840216087] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e61fd37d50 con 0x55e61ff4e870 2023-07-14T13:13:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff709cdc640 1 --2- 172.21.15.5:0/3820461195 >> [v2:172.21.15.5:6832/840216087,v1:172.21.15.5:6834/840216087] conn(0x55e61ff4e870 0x55e61ff4ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff709cdc640 1 --2- 172.21.15.5:0/3820461195 >> [v2:172.21.15.5:6832/840216087,v1:172.21.15.5:6834/840216087] conn(0x55e61ff4e870 0x55e61ff4ec40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdac0a34dcf6e211 server_cookie=5619c4d0132ab30a in_seq=0 out_seq=0 2023-07-14T13:13:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff6e4ff9640 10 client.9534 ms_handle_connect on v2:172.21.15.5:6832/840216087 2023-07-14T13:13:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff6e4ff9640 1 -- 172.21.15.5:0/3820461195 <== mds.0 v2:172.21.15.5:6832/840216087 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55e61fd37d50 con 0x55e61ff4e870 2023-07-14T13:13:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff6e4ff9640 10 client.9534 handle_command_reply: tid=0 2023-07-14T13:13:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff70f2a7000 1 client.9534 shutdown 2023-07-14T13:13:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff70f2a7000 1 -- 172.21.15.5:0/3820461195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61ff35890 msgr2=0x55e61ff4e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff70f2a7000 1 --2- 172.21.15.5:0/3820461195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61ff35890 0x55e61ff4e330 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc007fa0 tx=0x7ff6fc001260 comp rx=0 tx=0).stop 2023-07-14T13:13:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff70f2a7000 1 -- 172.21.15.5:0/3820461195 shutdown_connections 2023-07-14T13:13:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff70f2a7000 1 --2- 172.21.15.5:0/3820461195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e61ff35890 0x55e61ff4e330 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff70f2a7000 1 --2- 172.21.15.5:0/3820461195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55e61ff34f80 0x55e61ff4ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff70f2a7000 1 --2- 172.21.15.5:0/3820461195 >> [v2:172.21.15.5:6832/840216087,v1:172.21.15.5:6834/840216087] conn(0x55e61ff4e870 0x55e61ff4ec40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff70f2a7000 1 --2- 172.21.15.5:0/3820461195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e61feeb930 0x55e61ff96da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff6e4ff9640 0 client.9534 ms_handle_reset on v2:172.21.15.5:6832/840216087 2023-07-14T13:13:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff70f2a7000 1 -- 172.21.15.5:0/3820461195 >> 172.21.15.5:0/3820461195 conn(0x55e61fef1a90 msgr2=0x55e61fef1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff70f2a7000 1 -- 172.21.15.5:0/3820461195 shutdown_connections 2023-07-14T13:13:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff70f2a7000 1 -- 172.21.15.5:0/3820461195 wait complete. 2023-07-14T13:13:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff70f2a7000 20 client.9534 trim_cache size 0 max 16384 2023-07-14T13:13:14.406 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T13:13:14.406 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "22affb8d-e389-40f8-a764-dd40eb1759c8", 2023-07-14T13:13:14.406 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-07-14T13:13:14.406 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 9336, 2023-07-14T13:13:14.406 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-07-14T13:13:14.407 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-07-14T13:13:14.407 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-07-14T13:13:14.407 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 10.490741085, 2023-07-14T13:13:14.407 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 73, 2023-07-14T13:13:14.407 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 156, 2023-07-14T13:13:14.407 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 156, 2023-07-14T13:13:14.407 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 16.419118605000001 2023-07-14T13:13:14.408 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T13:13:14.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff70bf40640 1 -- 172.21.15.5:0/3746340696 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7ff6e80663a0 msgr2=0x7ff6e8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:14.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff70bf40640 1 --2- 172.21.15.5:0/3746340696 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7ff6e80663a0 0x7ff6e8068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff700009b60 tx=0x7ff700009190 comp rx=0 tx=0).stop 2023-07-14T13:13:14.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff70bf40640 1 -- 172.21.15.5:0/3746340696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff704070b70 msgr2=0x7ff7041f5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:14.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff70bf40640 1 --2- 172.21.15.5:0/3746340696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff704070b70 0x7ff7041f5c30 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7ff6f401ab80 tx=0x7ff6f401ad10 comp rx=0 tx=0).stop 2023-07-14T13:13:14.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff70bf40640 1 -- 172.21.15.5:0/3746340696 shutdown_connections 2023-07-14T13:13:14.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff70bf40640 1 --2- 172.21.15.5:0/3746340696 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7ff6e80663a0 0x7ff6e8068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff70bf40640 1 --2- 172.21.15.5:0/3746340696 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7040c21f0 0x7ff7041f6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff70bf40640 1 --2- 172.21.15.5:0/3746340696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff704070b70 0x7ff7041f5c30 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff70bf40640 1 --2- 172.21.15.5:0/3746340696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff70406b1e0 0x7ff704152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff70bf40640 1 -- 172.21.15.5:0/3746340696 >> 172.21.15.5:0/3746340696 conn(0x7ff7040afcf0 msgr2=0x7ff7040ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:14.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff70bf40640 1 -- 172.21.15.5:0/3746340696 shutdown_connections 2023-07-14T13:13:14.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.360+0000 7ff70bf40640 1 -- 172.21.15.5:0/3746340696 wait complete. 2023-07-14T13:13:14.417 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T13:13:14.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.524+0000 7f7098a34640 1 Processor -- start 2023-07-14T13:13:14.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.524+0000 7f7098a34640 1 -- start start 2023-07-14T13:13:14.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.524+0000 7f7098a34640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f709415bdf0 0x7f70940ca970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.524+0000 7f7098a34640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f709415f970 0x7f709415fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.524+0000 7f7098a34640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f709406b1e0 0x7f709406b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.524+0000 7f7098a34640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7094160330 con 0x7f709415f970 2023-07-14T13:13:14.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.524+0000 7f7098a34640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70940cb2e0 con 0x7f709415bdf0 2023-07-14T13:13:14.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.524+0000 7f7098a34640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70940cb5c0 con 0x7f709406b1e0 2023-07-14T13:13:14.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.524+0000 7f708bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f709415f970 0x7f709415fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.528+0000 7f708bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f709415f970 0x7f709415fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43774/0 (socket says 172.21.15.5:43774) 2023-07-14T13:13:14.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.528+0000 7f708bfff640 1 -- 172.21.15.5:0/1430975006 learned_addr learned my addr 172.21.15.5:0/1430975006 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:14.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.528+0000 7f7092d9d640 1 --2- 172.21.15.5:0/1430975006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f709406b1e0 0x7f709406b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.528+0000 7f709259c640 1 --2- 172.21.15.5:0/1430975006 >> v2:172.21.15.154:3300/0 conn(0x7f709415bdf0 0x7f70940ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.528+0000 7f708bfff640 1 -- 172.21.15.5:0/1430975006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f709406b1e0 msgr2=0x7f709406b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:14.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.528+0000 7f708bfff640 1 --2- 172.21.15.5:0/1430975006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f709406b1e0 0x7f709406b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.528+0000 7f708bfff640 1 -- 172.21.15.5:0/1430975006 >> v2:172.21.15.154:3300/0 conn(0x7f709415bdf0 msgr2=0x7f70940ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:14.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.528+0000 7f708bfff640 1 --2- 172.21.15.5:0/1430975006 >> v2:172.21.15.154:3300/0 conn(0x7f709415bdf0 0x7f70940ca970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.528+0000 7f708bfff640 1 -- 172.21.15.5:0/1430975006 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70940cb8a0 con 0x7f709415f970 2023-07-14T13:13:14.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.528+0000 7f708bfff640 1 --2- 172.21.15.5:0/1430975006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f709415f970 0x7f709415fdf0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f709406a7c0 tx=0x7f707c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=981c37fbe8d08a6a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:14.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.528+0000 7f7091d9b640 1 -- 172.21.15.5:0/1430975006 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c0ab620 con 0x7f709415f970 2023-07-14T13:13:14.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.528+0000 7f7091d9b640 1 -- 172.21.15.5:0/1430975006 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707c0ab780 con 0x7f709415f970 2023-07-14T13:13:14.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.528+0000 7f7091d9b640 1 -- 172.21.15.5:0/1430975006 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c0abb10 con 0x7f709415f970 2023-07-14T13:13:14.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.532+0000 7f7098a34640 1 -- 172.21.15.5:0/1430975006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f709415f970 msgr2=0x7f709415fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:14.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.532+0000 7f7098a34640 1 --2- 172.21.15.5:0/1430975006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f709415f970 0x7f709415fdf0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f709406a7c0 tx=0x7f707c01c440 comp rx=0 tx=0).stop 2023-07-14T13:13:14.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.532+0000 7f7098a34640 1 -- 172.21.15.5:0/1430975006 shutdown_connections 2023-07-14T13:13:14.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.532+0000 7f7098a34640 1 --2- 172.21.15.5:0/1430975006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f709406b1e0 0x7f709406b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.532+0000 7f7098a34640 1 --2- 172.21.15.5:0/1430975006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f709415f970 0x7f709415fdf0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.532+0000 7f7098a34640 1 --2- 172.21.15.5:0/1430975006 >> v2:172.21.15.154:3300/0 conn(0x7f709415bdf0 0x7f70940ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.532+0000 7f7098a34640 1 -- 172.21.15.5:0/1430975006 >> 172.21.15.5:0/1430975006 conn(0x7f70940afcf0 msgr2=0x7f70940b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:14.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.532+0000 7f7098a34640 1 -- 172.21.15.5:0/1430975006 shutdown_connections 2023-07-14T13:13:14.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.532+0000 7f7098a34640 1 -- 172.21.15.5:0/1430975006 wait complete. 2023-07-14T13:13:14.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.532+0000 7f7098a34640 1 Processor -- start 2023-07-14T13:13:14.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.532+0000 7f7098a34640 1 -- start start 2023-07-14T13:13:14.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.532+0000 7f7098a34640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f709406b1e0 0x7f70941508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.532+0000 7f7098a34640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f709415bdf0 0x7f70940ad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.532+0000 7f7098a34640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f709415f970 0x7f7094152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.532+0000 7f7098a34640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70940b14b0 con 0x7f709415bdf0 2023-07-14T13:13:14.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.532+0000 7f7098a34640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7094153f90 con 0x7f709406b1e0 2023-07-14T13:13:14.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.532+0000 7f7098a34640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7094154270 con 0x7f709415f970 2023-07-14T13:13:14.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.532+0000 7f708bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f709415bdf0 0x7f70940ad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.532+0000 7f708bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f709415bdf0 0x7f70940ad0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43788/0 (socket says 172.21.15.5:43788) 2023-07-14T13:13:14.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.532+0000 7f708bfff640 1 -- 172.21.15.5:0/3663745164 learned_addr learned my addr 172.21.15.5:0/3663745164 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:14.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.532+0000 7f709259c640 1 --2- 172.21.15.5:0/3663745164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f709406b1e0 0x7f70941508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.532+0000 7f7092d9d640 1 --2- 172.21.15.5:0/3663745164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f709415f970 0x7f7094152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.532+0000 7f708bfff640 1 -- 172.21.15.5:0/3663745164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f709415f970 msgr2=0x7f7094152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:14.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.532+0000 7f708bfff640 1 --2- 172.21.15.5:0/3663745164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f709415f970 0x7f7094152d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.532+0000 7f708bfff640 1 -- 172.21.15.5:0/3663745164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f709406b1e0 msgr2=0x7f70941508c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:14.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.532+0000 7f708bfff640 1 --2- 172.21.15.5:0/3663745164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f709406b1e0 0x7f70941508c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.532+0000 7f708bfff640 1 -- 172.21.15.5:0/3663745164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707c0094d0 con 0x7f709415bdf0 2023-07-14T13:13:14.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.536+0000 7f708bfff640 1 --2- 172.21.15.5:0/3663745164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f709415bdf0 0x7f70940ad0e0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f707c0ad040 tx=0x7f707c0191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:14.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.536+0000 7f708affd640 1 -- 172.21.15.5:0/3663745164 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c0bf410 con 0x7f709415bdf0 2023-07-14T13:13:14.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.536+0000 7f708affd640 1 -- 172.21.15.5:0/3663745164 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707c0bf5b0 con 0x7f709415bdf0 2023-07-14T13:13:14.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.536+0000 7f708affd640 1 -- 172.21.15.5:0/3663745164 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c0bf960 con 0x7f709415bdf0 2023-07-14T13:13:14.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.536+0000 7f7098a34640 1 -- 172.21.15.5:0/3663745164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7094154550 con 0x7f709415bdf0 2023-07-14T13:13:14.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.536+0000 7f7098a34640 1 -- 172.21.15.5:0/3663745164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7094154d50 con 0x7f709415bdf0 2023-07-14T13:13:14.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.536+0000 7f7098a34640 1 -- 172.21.15.5:0/3663745164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70940678d0 con 0x7f709415bdf0 2023-07-14T13:13:14.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.536+0000 7f708affd640 1 -- 172.21.15.5:0/3663745164 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f707c0b5400 con 0x7f709415bdf0 2023-07-14T13:13:14.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.536+0000 7f708affd640 1 --2- 172.21.15.5:0/3663745164 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f70740663d0 0x7f7074068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.540+0000 7f708affd640 1 -- 172.21.15.5:0/3663745164 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f707c11e940 con 0x7f709415bdf0 2023-07-14T13:13:14.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.540+0000 7f709259c640 1 --2- 172.21.15.5:0/3663745164 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f70740663d0 0x7f7074068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.540+0000 7f709259c640 1 --2- 172.21.15.5:0/3663745164 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f70740663d0 0x7f7074068880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f70840079c0 tx=0x7f7084008040 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:14.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.544+0000 7f708affd640 1 -- 172.21.15.5:0/3663745164 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f707c0ebcc0 con 0x7f709415bdf0 2023-07-14T13:13:14.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.728+0000 7f7098a34640 1 -- 172.21.15.5:0/3663745164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f70940b15f0 con 0x7f709415bdf0 2023-07-14T13:13:14.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.732+0000 7f708affd640 1 -- 172.21.15.5:0/3663745164 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v73) v1 ==== 53+0+73 (secure 0 0 0) 0x7f707c0c4070 con 0x7f709415bdf0 2023-07-14T13:13:14.768 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T13:13:14.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.732+0000 7f7098a34640 1 -- 172.21.15.5:0/3663745164 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f70740663d0 msgr2=0x7f7074068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:14.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.732+0000 7f7098a34640 1 --2- 172.21.15.5:0/3663745164 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f70740663d0 0x7f7074068880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f70840079c0 tx=0x7f7084008040 comp rx=0 tx=0).stop 2023-07-14T13:13:14.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.732+0000 7f7098a34640 1 -- 172.21.15.5:0/3663745164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f709415bdf0 msgr2=0x7f70940ad0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:14.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.732+0000 7f7098a34640 1 --2- 172.21.15.5:0/3663745164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f709415bdf0 0x7f70940ad0e0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f707c0ad040 tx=0x7f707c0191e0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.732+0000 7f7098a34640 1 -- 172.21.15.5:0/3663745164 shutdown_connections 2023-07-14T13:13:14.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.732+0000 7f7098a34640 1 --2- 172.21.15.5:0/3663745164 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f70740663d0 0x7f7074068880 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.732+0000 7f7098a34640 1 --2- 172.21.15.5:0/3663745164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f709415f970 0x7f7094152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.732+0000 7f7098a34640 1 --2- 172.21.15.5:0/3663745164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f709415bdf0 0x7f70940ad0e0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.732+0000 7f7098a34640 1 --2- 172.21.15.5:0/3663745164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f709406b1e0 0x7f70941508c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.732+0000 7f7098a34640 1 -- 172.21.15.5:0/3663745164 >> 172.21.15.5:0/3663745164 conn(0x7f70940afcf0 msgr2=0x7f70940c9680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:14.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.732+0000 7f7098a34640 1 -- 172.21.15.5:0/3663745164 shutdown_connections 2023-07-14T13:13:14.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:14.732+0000 7f7098a34640 1 -- 172.21.15.5:0/3663745164 wait complete. 2023-07-14T13:13:14.788 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-14T13:13:14.789 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T13:13:14.789 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-07-14T13:13:14.789 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-14T13:13:14.790 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-14T13:13:14.790 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-14T13:13:14.790 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-14T13:13:14.790 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T13:13:14.791 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T13:13:14.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:13:14.791 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-07-14T13:13:14.801 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T13:13:14.801 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T13:13:14.801 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T13:13:14.801 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:13:14.801 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-07-14T13:13:14.802 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:13:14.802 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T13:13:14.802 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-07-14T13:13:14.802 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2023-07-14T13:13:14.802 INFO:teuthology.orchestra.run.smithi005.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T13:13:14.802 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-07-14T13:13:14.802 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2023-07-14T13:13:14.802 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-14T13:13:14.803 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 41121sec preferred_lft 41121sec 2023-07-14T13:13:14.803 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-07-14T13:13:14.803 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:13:14.803 INFO:teuthology.orchestra.run.smithi005.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T13:13:14.803 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-07-14T13:13:14.803 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2023-07-14T13:13:14.803 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T13:13:14.804 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-07-14T13:13:14.804 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2023-07-14T13:13:14.804 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-14T13:13:14.804 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:96:b6:fb:c6 brd ff:ff:ff:ff:ff:ff 2023-07-14T13:13:14.804 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-14T13:13:14.804 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:13:14.804 INFO:teuthology.orchestra.run.smithi005.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T13:13:14.805 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-14T13:13:14.805 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T13:13:14.805 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:13:14.805 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-14T13:13:14.805 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:13:14.805 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T13:13:14.805 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T13:13:14.805 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-14T13:13:14.806 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:13:14.806 INFO:teuthology.orchestra.run.smithi005.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T13:13:14.806 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-14T13:13:14.806 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-14T13:13:14.806 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:13:14.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:13:14.807 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T13:13:14.871 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-07-14T13:13:14.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:13:14.874 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-07-14T13:13:14.924 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-07-14T13:13:14.925 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T13:13:14.925 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-14T13:13:14.925 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-14T13:13:14.925 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-14T13:13:14.925 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T13:13:14.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:13:14.926 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-07-14T13:13:14.926 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-07-14T13:13:14.927 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-14T13:13:14.927 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-14T13:13:14.928 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-14T13:13:14.928 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-07-14T13:13:15.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:13:15.022 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-07-14T13:13:15.031 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-14T13:13:15.031 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-14T13:13:15.032 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T13:13:15.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:13:15.033 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-07-14T13:13:15.101 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T13:13:15.101 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-14T13:13:15.151 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-14T13:13:15.152 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T13:13:15.152 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-14T13:13:15.207 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-14T13:13:15.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:13:15.208 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:13:15.303 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:13:15.304 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T13:13:15.304 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T13:13:15.319 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:13:15.319 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T13:13:15.319 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T13:13:15.319 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T13:13:15.319 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T13:13:15.327 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:13:15.328 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T13:13:15.328 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T13:13:15.328 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T13:13:15.328 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T13:13:15.328 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790" 2023-07-14T13:13:15.328 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790:/ 2023-07-14T13:13:15.329 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=22affb8d-e389-40f8-a764-dd40eb1759c8" will pass to kernel 2023-07-14T13:13:15.331 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T13:13:15.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:13:15.332 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-14T13:13:15.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:13:15.354 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T13:13:15.411 INFO:teuthology.orchestra.run.smithi005.stdout:client7898 2023-07-14T13:13:15.412 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:13:15.412 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:13:15.468 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-14T13:13:15.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.620+0000 7f3b1759e640 1 Processor -- start 2023-07-14T13:13:15.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.620+0000 7f3b1759e640 1 -- start start 2023-07-14T13:13:15.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.620+0000 7f3b1759e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3b1815f3f0 0x7f3b180b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:15.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.620+0000 7f3b1759e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3b180d13f0 0x7f3b180b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:15.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.620+0000 7f3b1759e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b180d0f60 con 0x7f3b180cc9a0 2023-07-14T13:13:15.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.620+0000 7f3b1759e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b180cd510 con 0x7f3b1815f3f0 2023-07-14T13:13:15.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.620+0000 7f3b1759e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b180d0390 con 0x7f3b180d13f0 2023-07-14T13:13:15.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.620+0000 7f3b1659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3b1815f3f0 0x7f3b180b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:15.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.620+0000 7f3b1659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3b1815f3f0 0x7f3b180b7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43802/0 (socket says 172.21.15.5:43802) 2023-07-14T13:13:15.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.620+0000 7f3b1659c640 1 -- 172.21.15.5:0/4012262840 learned_addr learned my addr 172.21.15.5:0/4012262840 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:15.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.620+0000 7f3b15d9b640 1 --2- 172.21.15.5:0/4012262840 >> v2:172.21.15.154:3300/0 conn(0x7f3b180d13f0 0x7f3b180b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:15.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.620+0000 7f3b1659c640 1 -- 172.21.15.5:0/4012262840 >> v2:172.21.15.154:3300/0 conn(0x7f3b180d13f0 msgr2=0x7f3b180b7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:15.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.620+0000 7f3b1659c640 1 --2- 172.21.15.5:0/4012262840 >> v2:172.21.15.154:3300/0 conn(0x7f3b180d13f0 0x7f3b180b7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:15.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.620+0000 7f3b1659c640 1 -- 172.21.15.5:0/4012262840 >> v1:172.21.15.5:6789/0 conn(0x7f3b180cc9a0 legacy=0x7f3b180cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:15.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.620+0000 7f3b1659c640 1 -- 172.21.15.5:0/4012262840 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b180d0630 con 0x7f3b1815f3f0 2023-07-14T13:13:15.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.620+0000 7f3b1559a640 1 -- 172.21.15.5:0/4012262840 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2159156699 0 0) 0x7f3b180d0f60 con 0x7f3b180cc9a0 2023-07-14T13:13:15.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.620+0000 7f3b15d9b640 1 --2- 172.21.15.5:0/4012262840 >> v2:172.21.15.154:3300/0 conn(0x7f3b180d13f0 0x7f3b180b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:13:15.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.624+0000 7f3b1659c640 1 --2- 172.21.15.5:0/4012262840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b1815f3f0 0x7f3b180b7680 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f3b180c5cc0 tx=0x7f3b0801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f044a0ec92335274 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:15.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.624+0000 7f3b1559a640 1 -- 172.21.15.5:0/4012262840 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b080ad660 con 0x7f3b1815f3f0 2023-07-14T13:13:15.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.624+0000 7f3b1559a640 1 -- 172.21.15.5:0/4012262840 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b080ad7c0 con 0x7f3b1815f3f0 2023-07-14T13:13:15.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.624+0000 7f3b1559a640 1 -- 172.21.15.5:0/4012262840 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b080adb50 con 0x7f3b1815f3f0 2023-07-14T13:13:15.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.624+0000 7f3b1759e640 1 -- 172.21.15.5:0/4012262840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b1815f3f0 msgr2=0x7f3b180b7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:15.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.624+0000 7f3b1759e640 1 --2- 172.21.15.5:0/4012262840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b1815f3f0 0x7f3b180b7680 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f3b180c5cc0 tx=0x7f3b0801c470 comp rx=0 tx=0).stop 2023-07-14T13:13:15.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.624+0000 7f3b1759e640 1 -- 172.21.15.5:0/4012262840 shutdown_connections 2023-07-14T13:13:15.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.624+0000 7f3b1759e640 1 --2- 172.21.15.5:0/4012262840 >> v2:172.21.15.154:3300/0 conn(0x7f3b180d13f0 0x7f3b180b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:15.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.624+0000 7f3b1759e640 1 --2- 172.21.15.5:0/4012262840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b1815f3f0 0x7f3b180b7680 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:15.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.624+0000 7f3b1759e640 1 -- 172.21.15.5:0/4012262840 >> 172.21.15.5:0/4012262840 conn(0x7f3b18069f50 msgr2=0x7f3b1806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:15.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.624+0000 7f3b1759e640 1 -- 172.21.15.5:0/4012262840 shutdown_connections 2023-07-14T13:13:15.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.624+0000 7f3b1759e640 1 -- 172.21.15.5:0/4012262840 wait complete. 2023-07-14T13:13:15.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.628+0000 7f3b1759e640 1 Processor -- start 2023-07-14T13:13:15.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.628+0000 7f3b1759e640 1 -- start start 2023-07-14T13:13:15.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.628+0000 7f3b1759e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b180cc9a0 0x7f3b18154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:15.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.628+0000 7f3b1759e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b180d13f0 0x7f3b181526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:15.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.628+0000 7f3b1759e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b1815f3f0 0x7f3b180b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:15.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.628+0000 7f3b1759e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b18155d10 con 0x7f3b1815f3f0 2023-07-14T13:13:15.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.628+0000 7f3b1759e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b180c9290 con 0x7f3b180d13f0 2023-07-14T13:13:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.628+0000 7f3b1759e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b18155f60 con 0x7f3b180cc9a0 2023-07-14T13:13:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.628+0000 7f3b16d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b1815f3f0 0x7f3b180b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.628+0000 7f3b16d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b1815f3f0 0x7f3b180b3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43812/0 (socket says 172.21.15.5:43812) 2023-07-14T13:13:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.628+0000 7f3b16d9d640 1 -- 172.21.15.5:0/3613233769 learned_addr learned my addr 172.21.15.5:0/3613233769 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.628+0000 7f3b15d9b640 1 --2- 172.21.15.5:0/3613233769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b180d13f0 0x7f3b181526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.628+0000 7f3b1659c640 1 --2- 172.21.15.5:0/3613233769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b180cc9a0 0x7f3b18154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:15.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.628+0000 7f3b16d9d640 1 -- 172.21.15.5:0/3613233769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b180cc9a0 msgr2=0x7f3b18154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:15.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.628+0000 7f3b16d9d640 1 --2- 172.21.15.5:0/3613233769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b180cc9a0 0x7f3b18154420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:15.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.628+0000 7f3b16d9d640 1 -- 172.21.15.5:0/3613233769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b180d13f0 msgr2=0x7f3b181526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:15.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.628+0000 7f3b16d9d640 1 --2- 172.21.15.5:0/3613233769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b180d13f0 0x7f3b181526a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:15.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.628+0000 7f3b16d9d640 1 -- 172.21.15.5:0/3613233769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b080094d0 con 0x7f3b1815f3f0 2023-07-14T13:13:15.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.628+0000 7f3b15d9b640 1 --2- 172.21.15.5:0/3613233769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b180d13f0 0x7f3b181526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:13:15.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.628+0000 7f3b16d9d640 1 --2- 172.21.15.5:0/3613233769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b1815f3f0 0x7f3b180b3db0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000c890 tx=0x7f3b1000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:15.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.628+0000 7f3b06ffd640 1 -- 172.21.15.5:0/3613233769 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b10003db0 con 0x7f3b1815f3f0 2023-07-14T13:13:15.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.628+0000 7f3b06ffd640 1 -- 172.21.15.5:0/3613233769 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b10005070 con 0x7f3b1815f3f0 2023-07-14T13:13:15.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.628+0000 7f3b06ffd640 1 -- 172.21.15.5:0/3613233769 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b10005420 con 0x7f3b1815f3f0 2023-07-14T13:13:15.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.628+0000 7f3b1759e640 1 -- 172.21.15.5:0/3613233769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b180cbd60 con 0x7f3b1815f3f0 2023-07-14T13:13:15.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.628+0000 7f3b1759e640 1 -- 172.21.15.5:0/3613233769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b180cba30 con 0x7f3b1815f3f0 2023-07-14T13:13:15.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.632+0000 7f3b1759e640 1 -- 172.21.15.5:0/3613233769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b180678d0 con 0x7f3b1815f3f0 2023-07-14T13:13:15.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.632+0000 7f3b06ffd640 1 -- 172.21.15.5:0/3613233769 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3b10005580 con 0x7f3b1815f3f0 2023-07-14T13:13:15.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.632+0000 7f3b06ffd640 1 --2- 172.21.15.5:0/3613233769 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f3af80663a0 0x7f3af8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:15.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.632+0000 7f3b06ffd640 1 -- 172.21.15.5:0/3613233769 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f3b10083860 con 0x7f3b1815f3f0 2023-07-14T13:13:15.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.632+0000 7f3b1659c640 1 --2- 172.21.15.5:0/3613233769 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f3af80663a0 0x7f3af8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:15.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.632+0000 7f3b1659c640 1 --2- 172.21.15.5:0/3613233769 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f3af80663a0 0x7f3af8068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3b080af000 tx=0x7f3b08008040 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:15.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.636+0000 7f3b06ffd640 1 -- 172.21.15.5:0/3613233769 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3b10050bd0 con 0x7f3b1815f3f0 2023-07-14T13:13:15.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.812+0000 7f3b1759e640 1 -- 172.21.15.5:0/3613233769 --> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b1815f7c0 con 0x7f3af80663a0 2023-07-14T13:13:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.812+0000 7f3b06ffd640 1 -- 172.21.15.5:0/3613233769 <== mgr.7604 v2:172.21.15.154:6832/1443161386 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f3b080ad930 con 0x7f3af80663a0 2023-07-14T13:13:15.851 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-07-14T13:13:15.852 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:13:15.852 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs" 2023-07-14T13:13:15.852 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:13:15.852 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-07-14T13:13:15.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.816+0000 7f3b1759e640 1 -- 172.21.15.5:0/3613233769 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f3af80663a0 msgr2=0x7f3af8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:15.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.816+0000 7f3b1759e640 1 --2- 172.21.15.5:0/3613233769 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f3af80663a0 0x7f3af8068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3b080af000 tx=0x7f3b08008040 comp rx=0 tx=0).stop 2023-07-14T13:13:15.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.816+0000 7f3b1759e640 1 -- 172.21.15.5:0/3613233769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b1815f3f0 msgr2=0x7f3b180b3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:15.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.816+0000 7f3b1759e640 1 --2- 172.21.15.5:0/3613233769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b1815f3f0 0x7f3b180b3db0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000c890 tx=0x7f3b1000cd50 comp rx=0 tx=0).stop 2023-07-14T13:13:15.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.816+0000 7f3b1759e640 1 -- 172.21.15.5:0/3613233769 shutdown_connections 2023-07-14T13:13:15.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.816+0000 7f3b1759e640 1 --2- 172.21.15.5:0/3613233769 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f3af80663a0 0x7f3af8068850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:15.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.816+0000 7f3b1759e640 1 --2- 172.21.15.5:0/3613233769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b1815f3f0 0x7f3b180b3db0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:15.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.816+0000 7f3b1759e640 1 --2- 172.21.15.5:0/3613233769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b180d13f0 0x7f3b181526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:15.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.816+0000 7f3b1759e640 1 --2- 172.21.15.5:0/3613233769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b180cc9a0 0x7f3b18154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.816+0000 7f3b1759e640 1 -- 172.21.15.5:0/3613233769 >> 172.21.15.5:0/3613233769 conn(0x7f3b18069f50 msgr2=0x7f3b180b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.816+0000 7f3b1759e640 1 -- 172.21.15.5:0/3613233769 shutdown_connections 2023-07-14T13:13:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.816+0000 7f3b1759e640 1 -- 172.21.15.5:0/3613233769 wait complete. 2023-07-14T13:13:15.872 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-14T13:13:16.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.980+0000 7faad8703640 1 Processor -- start 2023-07-14T13:13:16.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.980+0000 7faad8703640 1 -- start start 2023-07-14T13:13:16.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad8703640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faad0156560 0x7faad00cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:16.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad8703640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad00b08d0 con 0x7faad0159500 2023-07-14T13:13:16.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad8703640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad0159cb0 con 0x7faad00ccf60 2023-07-14T13:13:16.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad8703640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad01599d0 con 0x7faad0156560 2023-07-14T13:13:16.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad6ca0640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faad0159500 0x7faad006bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39050/0 (socket says 172.21.15.5:39050) 2023-07-14T13:13:16.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad6ca0640 1 -- 172.21.15.5:0/457411364 learned_addr learned my addr 172.21.15.5:0/457411364 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:13:16.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad649f640 1 --2- 172.21.15.5:0/457411364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faad0156560 0x7faad00cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:16.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad549d640 1 -- 172.21.15.5:0/457411364 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064329335 0 0) 0x7faad00b08d0 con 0x7faad0159500 2023-07-14T13:13:16.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad549d640 1 -- 172.21.15.5:0/457411364 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faabc005740 con 0x7faad0159500 2023-07-14T13:13:16.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad549d640 1 -- 172.21.15.5:0/457411364 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 118357162 0 0) 0x7faad0159cb0 con 0x7faad00ccf60 2023-07-14T13:13:16.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad549d640 1 -- 172.21.15.5:0/457411364 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faad00b08d0 con 0x7faad00ccf60 2023-07-14T13:13:16.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad549d640 1 -- 172.21.15.5:0/457411364 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1785136981 0 0) 0x7faabc005740 con 0x7faad0159500 2023-07-14T13:13:16.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad549d640 1 -- 172.21.15.5:0/457411364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faad0156560 msgr2=0x7faad00cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:16.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad549d640 1 --2- 172.21.15.5:0/457411364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faad0156560 0x7faad00cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:16.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad549d640 1 -- 172.21.15.5:0/457411364 >> v1:172.21.15.154:6789/0 conn(0x7faad00ccf60 legacy=0x7faad0158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:16.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad549d640 1 -- 172.21.15.5:0/457411364 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad00ca900 con 0x7faad0159500 2023-07-14T13:13:16.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad549d640 1 -- 172.21.15.5:0/457411364 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7faac8001a00 con 0x7faad0159500 2023-07-14T13:13:16.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad549d640 1 -- 172.21.15.5:0/457411364 >> v1:172.21.15.5:6789/0 conn(0x7faad0159500 legacy=0x7faad006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:16.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad549d640 1 --2- 172.21.15.5:0/457411364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faad0156560 0x7faabc005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:16.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad549d640 1 --2- 172.21.15.5:0/457411364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faabc0062b0 0x7faabc0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:16.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad549d640 1 --2- 172.21.15.5:0/457411364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faabc006f20 0x7faabc007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:16.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad549d640 1 -- 172.21.15.5:0/457411364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad01599d0 con 0x7faabc006f20 2023-07-14T13:13:16.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad549d640 1 -- 172.21.15.5:0/457411364 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc00dc50 con 0x7faabc0062b0 2023-07-14T13:13:16.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad549d640 1 -- 172.21.15.5:0/457411364 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faabc00de10 con 0x7faad0156560 2023-07-14T13:13:16.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad6ca0640 1 --2- 172.21.15.5:0/457411364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faabc006f20 0x7faabc007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:16.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad649f640 1 --2- 172.21.15.5:0/457411364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faad0156560 0x7faabc005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:16.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad5c9e640 1 --2- 172.21.15.5:0/457411364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faabc0062b0 0x7faabc0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:16.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad6ca0640 1 -- 172.21.15.5:0/457411364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faad0156560 msgr2=0x7faabc005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:16.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad6ca0640 1 --2- 172.21.15.5:0/457411364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faad0156560 0x7faabc005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:16.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad6ca0640 1 -- 172.21.15.5:0/457411364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faabc0062b0 msgr2=0x7faabc0069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:16.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad6ca0640 1 --2- 172.21.15.5:0/457411364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faabc0062b0 0x7faabc0069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:16.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad6ca0640 1 -- 172.21.15.5:0/457411364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc005740 con 0x7faabc006f20 2023-07-14T13:13:16.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.984+0000 7faad5c9e640 1 --2- 172.21.15.5:0/457411364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faabc0062b0 0x7faabc0069e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:13:16.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.988+0000 7faad6ca0640 1 --2- 172.21.15.5:0/457411364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faabc006f20 0x7faabc007390 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7faac8002240 tx=0x7faac801f9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f03f6d7fe8a863 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:16.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.988+0000 7faad549d640 1 -- 172.21.15.5:0/457411364 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac80ac670 con 0x7faabc006f20 2023-07-14T13:13:16.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.988+0000 7faad549d640 1 -- 172.21.15.5:0/457411364 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac80ac7f0 con 0x7faabc006f20 2023-07-14T13:13:16.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.988+0000 7faad549d640 1 -- 172.21.15.5:0/457411364 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac80acbe0 con 0x7faabc006f20 2023-07-14T13:13:16.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.988+0000 7faad8703640 1 -- 172.21.15.5:0/457411364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faabc006f20 msgr2=0x7faabc007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:16.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.988+0000 7faad8703640 1 --2- 172.21.15.5:0/457411364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faabc006f20 0x7faabc007390 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7faac8002240 tx=0x7faac801f9c0 comp rx=0 tx=0).stop 2023-07-14T13:13:16.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.988+0000 7faad6ca0640 1 -- 172.21.15.5:0/457411364 reap_dead start 2023-07-14T13:13:16.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.988+0000 7faad8703640 1 -- 172.21.15.5:0/457411364 shutdown_connections 2023-07-14T13:13:16.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.988+0000 7faad8703640 1 -- 172.21.15.5:0/457411364 >> 172.21.15.5:0/457411364 conn(0x7faad00afac0 msgr2=0x7faad00afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:16.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.988+0000 7faad8703640 1 -- 172.21.15.5:0/457411364 shutdown_connections 2023-07-14T13:13:16.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.988+0000 7faad8703640 1 -- 172.21.15.5:0/457411364 wait complete. 2023-07-14T13:13:16.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.988+0000 7faad8703640 1 Processor -- start 2023-07-14T13:13:16.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.988+0000 7faad8703640 1 -- start start 2023-07-14T13:13:16.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.992+0000 7faad8703640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faabc006f20 0x7faad0154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:16.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.992+0000 7faad8703640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faad00acd50 0x7faad01f0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:16.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.992+0000 7faad8703640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faad00b0dc0 0x7faad014fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:16.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.992+0000 7faad8703640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad0152e60 con 0x7faad00acd50 2023-07-14T13:13:16.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.992+0000 7faad8703640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad00ad250 con 0x7faad00b0dc0 2023-07-14T13:13:16.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.992+0000 7faad8703640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad0153070 con 0x7faabc006f20 2023-07-14T13:13:16.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.992+0000 7faad5c9e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faad00acd50 0x7faad01f0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:16.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.992+0000 7faad5c9e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faad00acd50 0x7faad01f0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43834/0 (socket says 172.21.15.5:43834) 2023-07-14T13:13:16.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.992+0000 7faad5c9e640 1 -- 172.21.15.5:0/64084116 learned_addr learned my addr 172.21.15.5:0/64084116 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:16.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.992+0000 7faad649f640 1 --2- 172.21.15.5:0/64084116 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faabc006f20 0x7faad0154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:16.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.992+0000 7faad6ca0640 1 --2- 172.21.15.5:0/64084116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faad00b0dc0 0x7faad014fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:16.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.992+0000 7faad5c9e640 1 -- 172.21.15.5:0/64084116 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faabc006f20 msgr2=0x7faad0154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:16.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.992+0000 7faad5c9e640 1 --2- 172.21.15.5:0/64084116 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faabc006f20 0x7faad0154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:16.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.992+0000 7faad5c9e640 1 -- 172.21.15.5:0/64084116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faad00b0dc0 msgr2=0x7faad014fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:16.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.992+0000 7faad5c9e640 1 --2- 172.21.15.5:0/64084116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faad00b0dc0 0x7faad014fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:16.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.992+0000 7faad5c9e640 1 -- 172.21.15.5:0/64084116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad0153350 con 0x7faad00acd50 2023-07-14T13:13:16.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.992+0000 7faad5c9e640 1 --2- 172.21.15.5:0/64084116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faad00acd50 0x7faad01f0aa0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7faac000d770 tx=0x7faac000db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:16.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.992+0000 7faac6ffd640 1 -- 172.21.15.5:0/64084116 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac0007220 con 0x7faad00acd50 2023-07-14T13:13:16.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.992+0000 7faac6ffd640 1 -- 172.21.15.5:0/64084116 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac0007380 con 0x7faad00acd50 2023-07-14T13:13:16.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.992+0000 7faac6ffd640 1 -- 172.21.15.5:0/64084116 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac00067e0 con 0x7faad00acd50 2023-07-14T13:13:16.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.992+0000 7faad8703640 1 -- 172.21.15.5:0/64084116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad014b5f0 con 0x7faad00acd50 2023-07-14T13:13:16.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.992+0000 7faad8703640 1 -- 172.21.15.5:0/64084116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad0153630 con 0x7faad00acd50 2023-07-14T13:13:16.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.992+0000 7faad8703640 1 -- 172.21.15.5:0/64084116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad00678d0 con 0x7faad00acd50 2023-07-14T13:13:16.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.996+0000 7faac6ffd640 1 -- 172.21.15.5:0/64084116 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 70) v1 ==== 85760+0+0 (secure 0 0 0) 0x7faac0006940 con 0x7faad00acd50 2023-07-14T13:13:16.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.996+0000 7faac6ffd640 1 --2- 172.21.15.5:0/64084116 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7faab40663a0 0x7faab4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:16.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.996+0000 7faac6ffd640 1 -- 172.21.15.5:0/64084116 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6090+0+0 (secure 0 0 0) 0x7faac00840f0 con 0x7faad00acd50 2023-07-14T13:13:16.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.996+0000 7faad649f640 1 --2- 172.21.15.5:0/64084116 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7faab40663a0 0x7faab4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:16.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:15.996+0000 7faad649f640 1 --2- 172.21.15.5:0/64084116 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7faab40663a0 0x7faab4068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faacc009be0 tx=0x7faacc009190 comp rx=0 tx=0).ready entity=mgr.7604 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:16.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.000+0000 7faac6ffd640 1 -- 172.21.15.5:0/64084116 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7faac00513d0 con 0x7faad00acd50 2023-07-14T13:13:16.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.188+0000 7faad8703640 1 -- 172.21.15.5:0/64084116 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7faad00cabb0 con 0x7faad00acd50 2023-07-14T13:13:16.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.808+0000 7faac6ffd640 1 -- 172.21.15.5:0/64084116 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 71) v1 ==== 85777+0+0 (secure 0 0 0) 0x7faac00517a0 con 0x7faad00acd50 2023-07-14T13:13:16.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.808+0000 7faac6ffd640 1 -- 172.21.15.5:0/64084116 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v71) v1 ==== 92+0+0 (secure 0 0 0) 0x7faac006dc60 con 0x7faad00acd50 2023-07-14T13:13:16.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.812+0000 7faad8703640 1 -- 172.21.15.5:0/64084116 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7faab40663a0 msgr2=0x7faab4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:16.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.812+0000 7faad8703640 1 --2- 172.21.15.5:0/64084116 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7faab40663a0 0x7faab4068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faacc009be0 tx=0x7faacc009190 comp rx=0 tx=0).stop 2023-07-14T13:13:16.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.812+0000 7faad8703640 1 -- 172.21.15.5:0/64084116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faad00acd50 msgr2=0x7faad01f0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:16.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.812+0000 7faad8703640 1 --2- 172.21.15.5:0/64084116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faad00acd50 0x7faad01f0aa0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7faac000d770 tx=0x7faac000db70 comp rx=0 tx=0).stop 2023-07-14T13:13:16.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.812+0000 7faad8703640 1 -- 172.21.15.5:0/64084116 shutdown_connections 2023-07-14T13:13:16.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.812+0000 7faad8703640 1 --2- 172.21.15.5:0/64084116 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7faab40663a0 0x7faab4068850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:16.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.812+0000 7faad8703640 1 --2- 172.21.15.5:0/64084116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faad00b0dc0 0x7faad014fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:16.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.812+0000 7faad8703640 1 --2- 172.21.15.5:0/64084116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faad00acd50 0x7faad01f0aa0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:16.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.812+0000 7faad8703640 1 --2- 172.21.15.5:0/64084116 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faabc006f20 0x7faad0154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:16.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.812+0000 7faad8703640 1 -- 172.21.15.5:0/64084116 >> 172.21.15.5:0/64084116 conn(0x7faad00afac0 msgr2=0x7faad00ae290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:16.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.812+0000 7faad8703640 1 -- 172.21.15.5:0/64084116 shutdown_connections 2023-07-14T13:13:16.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.812+0000 7faad8703640 1 -- 172.21.15.5:0/64084116 wait complete. 2023-07-14T13:13:16.870 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-14T13:13:17.024 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:16.992+0000 7f13e1846180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:13:17.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.988+0000 7f3aacb70640 1 Processor -- start 2023-07-14T13:13:17.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.988+0000 7f3aacb70640 1 -- start start 2023-07-14T13:13:17.026 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:13:16.988+0000 7fea71de8180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:13:17.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.988+0000 7f3aacb70640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3aa80b7980 0x7f3aa806a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:17.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.988+0000 7f3aacb70640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa80cff30 con 0x7f3aa80b42c0 2023-07-14T13:13:17.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.988+0000 7f3aacb70640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa80ccee0 con 0x7f3aa80cee50 2023-07-14T13:13:17.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.988+0000 7f3aacb70640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa80cf550 con 0x7f3aa80b7980 2023-07-14T13:13:17.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.988+0000 7f3aa7fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3aa80b42c0 0x7f3aa80d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39070/0 (socket says 172.21.15.5:39070) 2023-07-14T13:13:17.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.988+0000 7f3aa7fff640 1 -- 172.21.15.5:0/1996837052 learned_addr learned my addr 172.21.15.5:0/1996837052 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:13:17.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.988+0000 7f3aa77fe640 1 --2- 172.21.15.5:0/1996837052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3aa80b7980 0x7f3aa806a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:17.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.988+0000 7f3aa67fc640 1 -- 172.21.15.5:0/1996837052 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2227991233 0 0) 0x7f3aa80cff30 con 0x7f3aa80b42c0 2023-07-14T13:13:17.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.988+0000 7f3aa67fc640 1 -- 172.21.15.5:0/1996837052 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a90003530 con 0x7f3aa80b42c0 2023-07-14T13:13:17.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.988+0000 7f3aa67fc640 1 -- 172.21.15.5:0/1996837052 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 445669281 0 0) 0x7f3aa80ccee0 con 0x7f3aa80cee50 2023-07-14T13:13:17.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.988+0000 7f3aa77fe640 1 -- 172.21.15.5:0/1996837052 >> v1:172.21.15.154:6789/0 conn(0x7f3aa80cee50 legacy=0x7f3aa80b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:17.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.988+0000 7f3aa77fe640 1 -- 172.21.15.5:0/1996837052 >> v1:172.21.15.5:6789/0 conn(0x7f3aa80b42c0 legacy=0x7f3aa80d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:17.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.988+0000 7f3aa77fe640 1 -- 172.21.15.5:0/1996837052 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa80cf2a0 con 0x7f3aa80b7980 2023-07-14T13:13:17.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.992+0000 7f3aa77fe640 1 --2- 172.21.15.5:0/1996837052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3aa80b7980 0x7f3aa806a9b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3a980097f0 tx=0x7f3a9801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff1726191533e7ab server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:17.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.992+0000 7f3aa67fc640 1 -- 172.21.15.5:0/1996837052 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a980aa620 con 0x7f3aa80b7980 2023-07-14T13:13:17.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.992+0000 7f3aa67fc640 1 -- 172.21.15.5:0/1996837052 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a980aa780 con 0x7f3aa80b7980 2023-07-14T13:13:17.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.992+0000 7f3aa67fc640 1 -- 172.21.15.5:0/1996837052 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a980aaaf0 con 0x7f3aa80b7980 2023-07-14T13:13:17.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.992+0000 7f3aacb70640 1 -- 172.21.15.5:0/1996837052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3aa80b7980 msgr2=0x7f3aa806a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:17.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.992+0000 7f3aacb70640 1 --2- 172.21.15.5:0/1996837052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3aa80b7980 0x7f3aa806a9b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3a980097f0 tx=0x7f3a9801c4c0 comp rx=0 tx=0).stop 2023-07-14T13:13:17.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.992+0000 7f3aacb70640 1 -- 172.21.15.5:0/1996837052 shutdown_connections 2023-07-14T13:13:17.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.992+0000 7f3aacb70640 1 --2- 172.21.15.5:0/1996837052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3aa80b7980 0x7f3aa806a9b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:17.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.992+0000 7f3aacb70640 1 -- 172.21.15.5:0/1996837052 >> 172.21.15.5:0/1996837052 conn(0x7f3aa8069ea0 msgr2=0x7f3aa806a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:17.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.992+0000 7f3aacb70640 1 -- 172.21.15.5:0/1996837052 shutdown_connections 2023-07-14T13:13:17.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.992+0000 7f3aacb70640 1 -- 172.21.15.5:0/1996837052 wait complete. 2023-07-14T13:13:17.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.996+0000 7f3aacb70640 1 Processor -- start 2023-07-14T13:13:17.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.996+0000 7f3aacb70640 1 -- start start 2023-07-14T13:13:17.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.996+0000 7f3aacb70640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3aa80b42c0 0x7f3aa80cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:17.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.996+0000 7f3aacb70640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3aa80b7980 0x7f3aa80b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:17.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.996+0000 7f3aacb70640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aa80cee50 0x7f3aa80b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:17.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.996+0000 7f3aacb70640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa8150d60 con 0x7f3aa80cee50 2023-07-14T13:13:17.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.996+0000 7f3aacb70640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa8151a90 con 0x7f3aa80b7980 2023-07-14T13:13:17.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.996+0000 7f3aacb70640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa80cc020 con 0x7f3aa80b42c0 2023-07-14T13:13:17.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.996+0000 7f3aa77fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3aa80b42c0 0x7f3aa80cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:17.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.996+0000 7f3aa7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aa80cee50 0x7f3aa80b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:17.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.996+0000 7f3aa77fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3aa80b42c0 0x7f3aa80cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:49220/0 (socket says 172.21.15.5:49220) 2023-07-14T13:13:17.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.996+0000 7f3aa77fe640 1 -- 172.21.15.5:0/3823861692 learned_addr learned my addr 172.21.15.5:0/3823861692 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:17.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.996+0000 7f3aa6ffd640 1 --2- 172.21.15.5:0/3823861692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3aa80b7980 0x7f3aa80b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:17.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.996+0000 7f3aa77fe640 1 -- 172.21.15.5:0/3823861692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3aa80b7980 msgr2=0x7f3aa80b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:17.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.996+0000 7f3aa77fe640 1 --2- 172.21.15.5:0/3823861692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3aa80b7980 0x7f3aa80b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:17.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.996+0000 7f3aa77fe640 1 -- 172.21.15.5:0/3823861692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aa80cee50 msgr2=0x7f3aa80b20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:17.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.996+0000 7f3aa77fe640 1 --2- 172.21.15.5:0/3823861692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aa80cee50 0x7f3aa80b20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:17.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.996+0000 7f3aa77fe640 1 -- 172.21.15.5:0/3823861692 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a98009420 con 0x7f3aa80b42c0 2023-07-14T13:13:17.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.996+0000 7f3aa7fff640 1 --2- 172.21.15.5:0/3823861692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aa80cee50 0x7f3aa80b20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:13:17.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.996+0000 7f3aa77fe640 1 --2- 172.21.15.5:0/3823861692 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3aa80b42c0 0x7f3aa80cbae0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3a98000c10 tx=0x7f3a9801ad00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:17.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.996+0000 7f3a8ffff640 1 -- 172.21.15.5:0/3823861692 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a980aae40 con 0x7f3aa80b42c0 2023-07-14T13:13:17.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.996+0000 7f3a8ffff640 1 -- 172.21.15.5:0/3823861692 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a980be410 con 0x7f3aa80b42c0 2023-07-14T13:13:17.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.996+0000 7f3a8ffff640 1 -- 172.21.15.5:0/3823861692 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a980be780 con 0x7f3aa80b42c0 2023-07-14T13:13:17.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.996+0000 7f3aacb70640 1 -- 172.21.15.5:0/3823861692 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa81500e0 con 0x7f3aa80b42c0 2023-07-14T13:13:17.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:16.996+0000 7f3aacb70640 1 -- 172.21.15.5:0/3823861692 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa81506a0 con 0x7f3aa80b42c0 2023-07-14T13:13:17.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.000+0000 7f3aacb70640 1 -- 172.21.15.5:0/3823861692 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa804e020 con 0x7f3aa80b42c0 2023-07-14T13:13:17.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.000+0000 7f3a8ffff640 1 -- 172.21.15.5:0/3823861692 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 71) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f3a980be8e0 con 0x7f3aa80b42c0 2023-07-14T13:13:17.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.000+0000 7f3a8ffff640 1 --2- 172.21.15.5:0/3823861692 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f3a940663f0 0x7f3a940688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:17.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.000+0000 7f3a8ffff640 1 -- 172.21.15.5:0/3823861692 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f3a9811e900 con 0x7f3aa80b42c0 2023-07-14T13:13:17.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.000+0000 7f3aa6ffd640 1 -- 172.21.15.5:0/3823861692 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f3a940663f0 msgr2=0x7f3a940688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1443161386 2023-07-14T13:13:17.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.000+0000 7f3aa6ffd640 1 --2- 172.21.15.5:0/3823861692 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f3a940663f0 0x7f3a940688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:13:17.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.004+0000 7f3a8ffff640 1 -- 172.21.15.5:0/3823861692 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3a980ebbe0 con 0x7f3aa80b42c0 2023-07-14T13:13:17.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.176+0000 7f3aacb70640 1 -- 172.21.15.5:0/3823861692 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f3aa806a5f0 con 0x7f3aa80b42c0 2023-07-14T13:13:17.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.184+0000 7f3a8ffff640 1 -- 172.21.15.5:0/3823861692 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v53)=0 v53) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3a980c30d0 con 0x7f3aa80b42c0 2023-07-14T13:13:17.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.184+0000 7f3aacb70640 1 -- 172.21.15.5:0/3823861692 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f3a940663f0 msgr2=0x7f3a940688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:13:17.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.184+0000 7f3aacb70640 1 --2- 172.21.15.5:0/3823861692 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f3a940663f0 0x7f3a940688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:17.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.184+0000 7f3aacb70640 1 -- 172.21.15.5:0/3823861692 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3aa80b42c0 msgr2=0x7f3aa80cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:17.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.184+0000 7f3aacb70640 1 --2- 172.21.15.5:0/3823861692 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3aa80b42c0 0x7f3aa80cbae0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3a98000c10 tx=0x7f3a9801ad00 comp rx=0 tx=0).stop 2023-07-14T13:13:17.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.184+0000 7f3aacb70640 1 -- 172.21.15.5:0/3823861692 shutdown_connections 2023-07-14T13:13:17.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.184+0000 7f3aacb70640 1 --2- 172.21.15.5:0/3823861692 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f3a940663f0 0x7f3a940688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:17.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.184+0000 7f3aacb70640 1 --2- 172.21.15.5:0/3823861692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aa80cee50 0x7f3aa80b20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:17.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.184+0000 7f3aacb70640 1 --2- 172.21.15.5:0/3823861692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3aa80b7980 0x7f3aa80b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:17.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.184+0000 7f3aacb70640 1 --2- 172.21.15.5:0/3823861692 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3aa80b42c0 0x7f3aa80cbae0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:17.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.184+0000 7f3aacb70640 1 -- 172.21.15.5:0/3823861692 >> 172.21.15.5:0/3823861692 conn(0x7f3aa8069ea0 msgr2=0x7f3aa8156580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:17.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.184+0000 7f3aacb70640 1 -- 172.21.15.5:0/3823861692 shutdown_connections 2023-07-14T13:13:17.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.184+0000 7f3aacb70640 1 -- 172.21.15.5:0/3823861692 wait complete. 2023-07-14T13:13:17.244 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-14T13:13:17.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.356+0000 7fb520303640 1 Processor -- start 2023-07-14T13:13:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.356+0000 7fb520303640 1 -- start start 2023-07-14T13:13:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.356+0000 7fb520303640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb51815bde0 0x7fb5180d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.356+0000 7fb520303640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb5180d2300 0x7fb5180d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.356+0000 7fb520303640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5180b04c0 con 0x7fb5180d2fc0 2023-07-14T13:13:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.356+0000 7fb520303640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5180d2ce0 con 0x7fb5180d2300 2023-07-14T13:13:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.356+0000 7fb520303640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb51815c1b0 con 0x7fb51815bde0 2023-07-14T13:13:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.356+0000 7fb51d89e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb5180d2fc0 0x7fb5180b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39076/0 (socket says 172.21.15.5:39076) 2023-07-14T13:13:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.356+0000 7fb51d89e640 1 -- 172.21.15.5:0/988940234 learned_addr learned my addr 172.21.15.5:0/988940234 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:13:17.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.356+0000 7fb51e09f640 1 --2- 172.21.15.5:0/988940234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb51815bde0 0x7fb5180d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:17.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.356+0000 7fb51e8a0640 1 --2- 172.21.15.5:0/988940234 >> v2:172.21.15.154:3300/0 conn(0x7fb5180d2300 0x7fb5180d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:17.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.356+0000 7fb51d09d640 1 -- 172.21.15.5:0/988940234 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2348978178 0 0) 0x7fb5180b04c0 con 0x7fb5180d2fc0 2023-07-14T13:13:17.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.356+0000 7fb51d09d640 1 -- 172.21.15.5:0/988940234 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb504003530 con 0x7fb5180d2fc0 2023-07-14T13:13:17.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.356+0000 7fb51e09f640 1 -- 172.21.15.5:0/988940234 >> v2:172.21.15.154:3300/0 conn(0x7fb5180d2300 msgr2=0x7fb5180d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:17.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.356+0000 7fb51e09f640 1 --2- 172.21.15.5:0/988940234 >> v2:172.21.15.154:3300/0 conn(0x7fb5180d2300 0x7fb5180d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:17.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.356+0000 7fb51e09f640 1 -- 172.21.15.5:0/988940234 >> v1:172.21.15.5:6789/0 conn(0x7fb5180d2fc0 legacy=0x7fb5180b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:17.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.356+0000 7fb51e09f640 1 -- 172.21.15.5:0/988940234 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5180b1060 con 0x7fb51815bde0 2023-07-14T13:13:17.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.360+0000 7fb51e09f640 1 --2- 172.21.15.5:0/988940234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb51815bde0 0x7fb5180d0270 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb5140097a0 tx=0x7fb51401c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e225699c83df56d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:17.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.360+0000 7fb51d09d640 1 -- 172.21.15.5:0/988940234 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5140ab600 con 0x7fb51815bde0 2023-07-14T13:13:17.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.360+0000 7fb51d09d640 1 -- 172.21.15.5:0/988940234 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5140a7050 con 0x7fb51815bde0 2023-07-14T13:13:17.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.360+0000 7fb51d09d640 1 -- 172.21.15.5:0/988940234 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5140ab980 con 0x7fb51815bde0 2023-07-14T13:13:17.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.360+0000 7fb520303640 1 -- 172.21.15.5:0/988940234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb51815bde0 msgr2=0x7fb5180d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:17.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.360+0000 7fb520303640 1 --2- 172.21.15.5:0/988940234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb51815bde0 0x7fb5180d0270 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb5140097a0 tx=0x7fb51401c460 comp rx=0 tx=0).stop 2023-07-14T13:13:17.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.360+0000 7fb520303640 1 -- 172.21.15.5:0/988940234 shutdown_connections 2023-07-14T13:13:17.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.360+0000 7fb520303640 1 --2- 172.21.15.5:0/988940234 >> v2:172.21.15.154:3300/0 conn(0x7fb5180d2300 0x7fb5180d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:17.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.360+0000 7fb520303640 1 --2- 172.21.15.5:0/988940234 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb51815bde0 0x7fb5180d0270 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:17.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.360+0000 7fb520303640 1 -- 172.21.15.5:0/988940234 >> 172.21.15.5:0/988940234 conn(0x7fb5180659d0 msgr2=0x7fb51809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:17.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.360+0000 7fb520303640 1 -- 172.21.15.5:0/988940234 shutdown_connections 2023-07-14T13:13:17.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.360+0000 7fb520303640 1 -- 172.21.15.5:0/988940234 wait complete. 2023-07-14T13:13:17.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.364+0000 7fb520303640 1 Processor -- start 2023-07-14T13:13:17.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.364+0000 7fb520303640 1 -- start start 2023-07-14T13:13:17.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.364+0000 7fb520303640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5180d2300 0x7fb5181594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:17.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.364+0000 7fb520303640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5180d2fc0 0x7fb518159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:17.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.364+0000 7fb520303640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb51815bde0 0x7fb5181510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:17.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.364+0000 7fb520303640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5180ca0a0 con 0x7fb51815bde0 2023-07-14T13:13:17.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.364+0000 7fb520303640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5180cc400 con 0x7fb5180d2fc0 2023-07-14T13:13:17.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.364+0000 7fb520303640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5180cbbf0 con 0x7fb5180d2300 2023-07-14T13:13:17.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.364+0000 7fb51e8a0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb51815bde0 0x7fb5181510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:17.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.364+0000 7fb51e09f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5180d2300 0x7fb5181594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:17.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.364+0000 7fb51d89e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5180d2fc0 0x7fb518159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:17.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.364+0000 7fb51e09f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5180d2300 0x7fb5181594d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:49248/0 (socket says 172.21.15.5:49248) 2023-07-14T13:13:17.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.364+0000 7fb51e09f640 1 -- 172.21.15.5:0/1212742096 learned_addr learned my addr 172.21.15.5:0/1212742096 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:17.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.364+0000 7fb51e09f640 1 -- 172.21.15.5:0/1212742096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5180d2fc0 msgr2=0x7fb518159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:17.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.364+0000 7fb51e09f640 1 --2- 172.21.15.5:0/1212742096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5180d2fc0 0x7fb518159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:17.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.364+0000 7fb51e09f640 1 -- 172.21.15.5:0/1212742096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb51815bde0 msgr2=0x7fb5181510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:17.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.364+0000 7fb51e09f640 1 --2- 172.21.15.5:0/1212742096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb51815bde0 0x7fb5181510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:17.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.364+0000 7fb51e09f640 1 -- 172.21.15.5:0/1212742096 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5140093b0 con 0x7fb5180d2300 2023-07-14T13:13:17.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.364+0000 7fb51e8a0640 1 --2- 172.21.15.5:0/1212742096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb51815bde0 0x7fb5181510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:13:17.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.364+0000 7fb51e09f640 1 --2- 172.21.15.5:0/1212742096 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5180d2300 0x7fb5181594d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb5140ae040 tx=0x7fb514019200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:17.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.364+0000 7fb50effd640 1 -- 172.21.15.5:0/1212742096 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5140b4400 con 0x7fb5180d2300 2023-07-14T13:13:17.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.364+0000 7fb50effd640 1 -- 172.21.15.5:0/1212742096 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5140b4560 con 0x7fb5180d2300 2023-07-14T13:13:17.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.364+0000 7fb50effd640 1 -- 172.21.15.5:0/1212742096 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5140b4910 con 0x7fb5180d2300 2023-07-14T13:13:17.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.364+0000 7fb520303640 1 -- 172.21.15.5:0/1212742096 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5180cbe40 con 0x7fb5180d2300 2023-07-14T13:13:17.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.364+0000 7fb520303640 1 -- 172.21.15.5:0/1212742096 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5180ca290 con 0x7fb5180d2300 2023-07-14T13:13:17.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.368+0000 7fb520303640 1 -- 172.21.15.5:0/1212742096 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5180678d0 con 0x7fb5180d2300 2023-07-14T13:13:17.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.368+0000 7fb50effd640 1 -- 172.21.15.5:0/1212742096 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 71) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fb5140b2040 con 0x7fb5180d2300 2023-07-14T13:13:17.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.368+0000 7fb50effd640 1 --2- 172.21.15.5:0/1212742096 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fb4fc0663f0 0x7fb4fc0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:17.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.368+0000 7fb50effd640 1 -- 172.21.15.5:0/1212742096 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fb51411ea00 con 0x7fb5180d2300 2023-07-14T13:13:17.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.368+0000 7fb51d89e640 1 -- 172.21.15.5:0/1212742096 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fb4fc0663f0 msgr2=0x7fb4fc0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1443161386 2023-07-14T13:13:17.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.368+0000 7fb51d89e640 1 --2- 172.21.15.5:0/1212742096 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fb4fc0663f0 0x7fb4fc0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:13:17.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.372+0000 7fb50effd640 1 -- 172.21.15.5:0/1212742096 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb5140ebcd0 con 0x7fb5180d2300 2023-07-14T13:13:17.440 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:17.408+0000 7f13e1846180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:13:17.473 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:13:17.436+0000 7fea71de8180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:13:17.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.532+0000 7fb520303640 1 -- 172.21.15.5:0/1212742096 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fb5180d27a0 con 0x7fb5180d2300 2023-07-14T13:13:17.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.540+0000 7fb50effd640 1 -- 172.21.15.5:0/1212742096 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v54)=0 v54) v1 ==== 133+0+0 (secure 0 0 0) 0x7fb5140b00c0 con 0x7fb5180d2300 2023-07-14T13:13:17.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.544+0000 7fb520303640 1 -- 172.21.15.5:0/1212742096 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fb4fc0663f0 msgr2=0x7fb4fc0688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:13:17.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.544+0000 7fb520303640 1 --2- 172.21.15.5:0/1212742096 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fb4fc0663f0 0x7fb4fc0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:17.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.544+0000 7fb520303640 1 -- 172.21.15.5:0/1212742096 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5180d2300 msgr2=0x7fb5181594d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:17.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.544+0000 7fb520303640 1 --2- 172.21.15.5:0/1212742096 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5180d2300 0x7fb5181594d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb5140ae040 tx=0x7fb514019200 comp rx=0 tx=0).stop 2023-07-14T13:13:17.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.544+0000 7fb520303640 1 -- 172.21.15.5:0/1212742096 shutdown_connections 2023-07-14T13:13:17.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.544+0000 7fb520303640 1 --2- 172.21.15.5:0/1212742096 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7fb4fc0663f0 0x7fb4fc0688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:17.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.544+0000 7fb520303640 1 --2- 172.21.15.5:0/1212742096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb51815bde0 0x7fb5181510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:17.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.544+0000 7fb520303640 1 --2- 172.21.15.5:0/1212742096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5180d2fc0 0x7fb518159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:17.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.544+0000 7fb520303640 1 --2- 172.21.15.5:0/1212742096 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5180d2300 0x7fb5181594d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:17.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.544+0000 7fb520303640 1 -- 172.21.15.5:0/1212742096 >> 172.21.15.5:0/1212742096 conn(0x7fb5180659d0 msgr2=0x7fb5180ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:17.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.544+0000 7fb520303640 1 -- 172.21.15.5:0/1212742096 shutdown_connections 2023-07-14T13:13:17.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.544+0000 7fb520303640 1 -- 172.21.15.5:0/1212742096 wait complete. 2023-07-14T13:13:17.592 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:17.556+0000 7f13e1846180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:13:17.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:13:17.601 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-14T13:13:17.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:13:17.618 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/test_restart) 2023-07-14T13:13:17.635 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:13:17.596+0000 7fea71de8180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:13:17.646 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/test_restart 1M 2023-07-14T13:13:17.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.800+0000 7f89ad819640 1 Processor -- start 2023-07-14T13:13:17.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.800+0000 7f89ad819640 1 -- start start 2023-07-14T13:13:17.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.800+0000 7f89ad819640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f89a815bb10 0x7f89a80ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:17.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.800+0000 7f89ad819640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a80ceaa0 con 0x7f89a80d03f0 2023-07-14T13:13:17.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.800+0000 7f89ad819640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a80ced80 con 0x7f89a80b11b0 2023-07-14T13:13:17.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.800+0000 7f89ad819640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89a80ce690 con 0x7f89a815bb10 2023-07-14T13:13:17.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.800+0000 7f89ac817640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f89a815bb10 0x7f89a80ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:17.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.800+0000 7f89ac817640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f89a815bb10 0x7f89a80ce150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43866/0 (socket says 172.21.15.5:43866) 2023-07-14T13:13:17.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.800+0000 7f89ad018640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f89a80d03f0 0x7f89a80aece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:39078/0 (socket says 172.21.15.5:39078) 2023-07-14T13:13:17.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.800+0000 7f89ac817640 1 -- 172.21.15.5:0/1409410763 learned_addr learned my addr 172.21.15.5:0/1409410763 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:17.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.800+0000 7f89ac817640 1 -- 172.21.15.5:0/1409410763 >> v1:172.21.15.154:6789/0 conn(0x7f89a80b11b0 legacy=0x7f89a80cfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:17.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.800+0000 7f89ac817640 1 -- 172.21.15.5:0/1409410763 >> v1:172.21.15.5:6789/0 conn(0x7f89a80d03f0 legacy=0x7f89a80aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:17.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.800+0000 7f89a77fe640 1 -- 172.21.15.5:0/1409410763 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2106193062 0 0) 0x7f89a80ceaa0 con 0x7f89a80d03f0 2023-07-14T13:13:17.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.800+0000 7f89ac817640 1 -- 172.21.15.5:0/1409410763 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a80cf060 con 0x7f89a815bb10 2023-07-14T13:13:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.804+0000 7f89ac817640 1 --2- 172.21.15.5:0/1409410763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89a815bb10 0x7f89a80ce150 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f899c009870 tx=0x7f899c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1afdb5dba19fb29 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.804+0000 7f89a77fe640 1 -- 172.21.15.5:0/1409410763 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c0ab600 con 0x7f89a815bb10 2023-07-14T13:13:17.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.804+0000 7f89a77fe640 1 -- 172.21.15.5:0/1409410763 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899c0a7050 con 0x7f89a815bb10 2023-07-14T13:13:17.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.804+0000 7f89a77fe640 1 -- 172.21.15.5:0/1409410763 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c0ab980 con 0x7f89a815bb10 2023-07-14T13:13:17.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.804+0000 7f89ad819640 1 -- 172.21.15.5:0/1409410763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89a815bb10 msgr2=0x7f89a80ce150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:17.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.804+0000 7f89ad819640 1 --2- 172.21.15.5:0/1409410763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89a815bb10 0x7f89a80ce150 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f899c009870 tx=0x7f899c01c4b0 comp rx=0 tx=0).stop 2023-07-14T13:13:17.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.804+0000 7f89ad819640 1 -- 172.21.15.5:0/1409410763 shutdown_connections 2023-07-14T13:13:17.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.804+0000 7f89ad819640 1 --2- 172.21.15.5:0/1409410763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89a815bb10 0x7f89a80ce150 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:17.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.804+0000 7f89ad819640 1 -- 172.21.15.5:0/1409410763 >> 172.21.15.5:0/1409410763 conn(0x7f89a809b480 msgr2=0x7f89a80d2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:17.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.804+0000 7f89ad819640 1 -- 172.21.15.5:0/1409410763 shutdown_connections 2023-07-14T13:13:17.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.804+0000 7f89ad819640 1 -- 172.21.15.5:0/1409410763 wait complete. 2023-07-14T13:13:17.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.808+0000 7f89ad819640 1 Processor -- start 2023-07-14T13:13:17.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.808+0000 7f89ad819640 1 -- start start 2023-07-14T13:13:17.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.808+0000 7f89ad819640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89a80b11b0 0x7f89a8150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:17.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.808+0000 7f89ad819640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89a80d03f0 0x7f89a8157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:17.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.808+0000 7f89ad819640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89a815bb10 0x7f89a8156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:17.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.808+0000 7f89ad819640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a80b6e70 con 0x7f89a815bb10 2023-07-14T13:13:17.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.808+0000 7f89ad819640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a80b6540 con 0x7f89a80b11b0 2023-07-14T13:13:17.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.808+0000 7f89ad819640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a80b6820 con 0x7f89a80d03f0 2023-07-14T13:13:17.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.808+0000 7f89ad018640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89a815bb10 0x7f89a8156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:17.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.808+0000 7f89ad018640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89a815bb10 0x7f89a8156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43878/0 (socket says 172.21.15.5:43878) 2023-07-14T13:13:17.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.808+0000 7f89ad018640 1 -- 172.21.15.5:0/2465591879 learned_addr learned my addr 172.21.15.5:0/2465591879 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:17.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.808+0000 7f89ac817640 1 --2- 172.21.15.5:0/2465591879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89a80b11b0 0x7f89a8150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:17.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.808+0000 7f89a7fff640 1 --2- 172.21.15.5:0/2465591879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89a80d03f0 0x7f89a8157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:17.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.808+0000 7f89ad018640 1 -- 172.21.15.5:0/2465591879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89a80d03f0 msgr2=0x7f89a8157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:17.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.808+0000 7f89ad018640 1 --2- 172.21.15.5:0/2465591879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f89a80d03f0 0x7f89a8157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:17.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.808+0000 7f89ad018640 1 -- 172.21.15.5:0/2465591879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89a80b11b0 msgr2=0x7f89a8150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:17.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.808+0000 7f89ad018640 1 --2- 172.21.15.5:0/2465591879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89a80b11b0 0x7f89a8150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:17.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.808+0000 7f89ad018640 1 -- 172.21.15.5:0/2465591879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899c0094d0 con 0x7f89a815bb10 2023-07-14T13:13:17.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.808+0000 7f89ad018640 1 --2- 172.21.15.5:0/2465591879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89a815bb10 0x7f89a8156bf0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f89a000c750 tx=0x7f89a000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:17.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.808+0000 7f89a57fa640 1 -- 172.21.15.5:0/2465591879 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a000ce60 con 0x7f89a815bb10 2023-07-14T13:13:17.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.808+0000 7f89a57fa640 1 -- 172.21.15.5:0/2465591879 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a000a640 con 0x7f89a815bb10 2023-07-14T13:13:17.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.808+0000 7f89a57fa640 1 -- 172.21.15.5:0/2465591879 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a000aa10 con 0x7f89a815bb10 2023-07-14T13:13:17.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.808+0000 7f89ad819640 1 -- 172.21.15.5:0/2465591879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a80b6b00 con 0x7f89a815bb10 2023-07-14T13:13:17.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.808+0000 7f89ad819640 1 -- 172.21.15.5:0/2465591879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a8151090 con 0x7f89a815bb10 2023-07-14T13:13:17.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.812+0000 7f89ad819640 1 -- 172.21.15.5:0/2465591879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a804e020 con 0x7f89a815bb10 2023-07-14T13:13:17.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.812+0000 7f89a57fa640 1 -- 172.21.15.5:0/2465591879 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 71) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f89a000ab70 con 0x7f89a815bb10 2023-07-14T13:13:17.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.812+0000 7f89a57fa640 1 --2- 172.21.15.5:0/2465591879 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f898c0663f0 0x7f898c0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:17.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.812+0000 7f89a57fa640 1 -- 172.21.15.5:0/2465591879 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f89a0083420 con 0x7f89a815bb10 2023-07-14T13:13:17.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.812+0000 7f89ac817640 1 -- 172.21.15.5:0/2465591879 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f898c0663f0 msgr2=0x7f898c0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1443161386 2023-07-14T13:13:17.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.812+0000 7f89ac817640 1 --2- 172.21.15.5:0/2465591879 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f898c0663f0 0x7f898c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:13:17.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.816+0000 7f89a57fa640 1 -- 172.21.15.5:0/2465591879 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f89a0050780 con 0x7f89a815bb10 2023-07-14T13:13:18.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:17.992+0000 7f89ad819640 1 -- 172.21.15.5:0/2465591879 --> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f89a815bee0 con 0x7f898c0663f0 2023-07-14T13:13:18.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:18.016+0000 7f89ac817640 1 -- 172.21.15.5:0/2465591879 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f898c0663f0 msgr2=0x7f898c0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1443161386 2023-07-14T13:13:18.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:18.016+0000 7f89ac817640 1 --2- 172.21.15.5:0/2465591879 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f898c0663f0 0x7f898c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-14T13:13:18.071 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:18.036+0000 7f13e1846180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:13:18.129 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:18.096+0000 7f13e1846180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:13:18.148 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:13:18.112+0000 7fea71de8180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:13:18.185 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:18.152+0000 7f13e1846180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:13:18.209 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:13:18.172+0000 7fea71de8180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:13:18.268 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:13:18.232+0000 7fea71de8180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:13:18.270 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:18.236+0000 7f13e1846180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:13:18.327 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:18.292+0000 7f13e1846180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:13:18.359 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:13:18.320+0000 7fea71de8180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:13:18.410 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:18.376+0000 7f13e1846180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:13:18.419 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:13:18.380+0000 7fea71de8180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:13:18.444 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:13:18.448 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:13:18.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:18.420+0000 7f89ac817640 1 -- 172.21.15.5:0/2465591879 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f898c0663f0 msgr2=0x7f898c0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1443161386 2023-07-14T13:13:18.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:18.420+0000 7f89ac817640 1 --2- 172.21.15.5:0/2465591879 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f898c0663f0 0x7f898c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-14T13:13:18.467 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:18.432+0000 7f13e1846180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:13:18.508 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:13:18.472+0000 7fea71de8180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:13:18.568 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:13:18.528+0000 7fea71de8180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:13:18.611 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:18.576+0000 7f13e1846180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:13:18.669 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:18.636+0000 7f13e1846180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:13:18.717 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:13:18.680+0000 7fea71de8180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:13:18.778 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:13:18.740+0000 7fea71de8180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:13:18.910 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:13:18.911 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:13:18.911 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:13:18.918 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:18.884+0000 7f13e1846180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:13:19.029 INFO:tasks.ceph.mgr.y.smithi005.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:13:19.030 INFO:tasks.ceph.mgr.y.smithi005.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:13:19.030 INFO:tasks.ceph.mgr.y.smithi005.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:13:19.039 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:13:19.000+0000 7fea71de8180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:13:19.052 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:19.016+0000 7f13e1846180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:13:19.176 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:19.144+0000 7f13e1846180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:13:19.178 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:13:19.140+0000 7fea71de8180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:13:19.246 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:19.212+0000 7f13e1846180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:13:19.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:19.224+0000 7f89ac817640 1 -- 172.21.15.5:0/2465591879 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f898c0663f0 msgr2=0x7f898c0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1443161386 2023-07-14T13:13:19.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:19.224+0000 7f89ac817640 1 --2- 172.21.15.5:0/2465591879 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f898c0663f0 0x7f898c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-14T13:13:19.310 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:13:19.272+0000 7fea71de8180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:13:19.379 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:19.344+0000 7f13e1846180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:13:19.384 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:13:19.344+0000 7fea71de8180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:13:19.524 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:13:19.488+0000 7fea71de8180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:13:19.913 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:19.880+0000 7f13e1846180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:13:20.000 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:19.968+0000 7f13e1846180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:13:20.093 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:13:20.056+0000 7fea71de8180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:13:20.148 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:20.116+0000 7f13e1846180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:13:20.180 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:13:20.144+0000 7fea71de8180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:13:20.231 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:20.196+0000 7f13e1846180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:13:20.334 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:13:20.296+0000 7fea71de8180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:13:20.422 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:13:20.384+0000 7fea71de8180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:13:20.499 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:20.464+0000 7f13e1846180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:13:20.558 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:20.524+0000 7f13e1846180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:13:20.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:20.532+0000 7f89a57fa640 1 -- 172.21.15.5:0/2465591879 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 72) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f89a0050b50 con 0x7f89a815bb10 2023-07-14T13:13:20.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:20.532+0000 7f89a57fa640 1 -- 172.21.15.5:0/2465591879 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f898c0663f0 msgr2=0x7f898c0688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:13:20.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:20.532+0000 7f89a57fa640 1 --2- 172.21.15.5:0/2465591879 >> [v2:172.21.15.154:6832/1443161386,v1:172.21.15.154:6833/1443161386] conn(0x7f898c0663f0 0x7f898c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:20.696 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:20.660+0000 7f135ff05640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:13:20.696 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:20.660+0000 7f135ff05640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:13:20.696 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:20.660+0000 7f135ff05640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:13:20.696 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:20.660+0000 7f135ff05640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:13:20.697 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:20.664+0000 7f135ff05640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:13:20.697 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:20.664+0000 7f1362f0b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:13:20.697 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:20.664+0000 7f1362f0b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:13:20.698 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:20.664+0000 7f1362f0b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:13:20.698 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:20.664+0000 7f1362f0b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:13:20.698 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:13:20.664+0000 7f1362f0b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:13:20.721 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:13:20.684+0000 7fea71de8180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:13:20.784 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:13:20.748+0000 7fea71de8180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:13:21.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.540+0000 7f89a57fa640 1 -- 172.21.15.5:0/2465591879 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mgrmap(e 73) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f89a0081720 con 0x7f89a815bb10 2023-07-14T13:13:21.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.540+0000 7f89a57fa640 1 --2- 172.21.15.5:0/2465591879 >> [v2:172.21.15.154:6832/3414173858,v1:172.21.15.154:6833/3414173858] conn(0x7f898c033e70 0x7f898c070920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:21.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.540+0000 7f89a57fa640 1 -- 172.21.15.5:0/2465591879 --> [v2:172.21.15.154:6832/3414173858,v1:172.21.15.154:6833/3414173858] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f898c034240 con 0x7f898c033e70 2023-07-14T13:13:21.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.540+0000 7f89ac817640 1 --2- 172.21.15.5:0/2465591879 >> [v2:172.21.15.154:6832/3414173858,v1:172.21.15.154:6833/3414173858] conn(0x7f898c033e70 0x7f898c070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:21.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.544+0000 7f89ac817640 1 --2- 172.21.15.5:0/2465591879 >> [v2:172.21.15.154:6832/3414173858,v1:172.21.15.154:6833/3414173858] conn(0x7f898c033e70 0x7f898c070920 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f899c0ad000 tx=0x7f899c0a6000 comp rx=0 tx=0).ready entity=mgr.9073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:21.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.612+0000 7f89a57fa640 1 -- 172.21.15.5:0/2465591879 <== mgr.9073 v2:172.21.15.154:6832/3414173858 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f898c034240 con 0x7f898c033e70 2023-07-14T13:13:21.650 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule set for path /snap_test_dir1/test_restart 2023-07-14T13:13:21.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.616+0000 7f89ad819640 1 -- 172.21.15.5:0/2465591879 >> [v2:172.21.15.154:6832/3414173858,v1:172.21.15.154:6833/3414173858] conn(0x7f898c033e70 msgr2=0x7f898c070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.616+0000 7f89ad819640 1 --2- 172.21.15.5:0/2465591879 >> [v2:172.21.15.154:6832/3414173858,v1:172.21.15.154:6833/3414173858] conn(0x7f898c033e70 0x7f898c070920 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f899c0ad000 tx=0x7f899c0a6000 comp rx=0 tx=0).stop 2023-07-14T13:13:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.616+0000 7f89ad819640 1 -- 172.21.15.5:0/2465591879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89a815bb10 msgr2=0x7f89a8156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.616+0000 7f89ad819640 1 --2- 172.21.15.5:0/2465591879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89a815bb10 0x7f89a8156bf0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f89a000c750 tx=0x7f89a000cc10 comp rx=0 tx=0).stop 2023-07-14T13:13:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.616+0000 7f89ad018640 1 -- 172.21.15.5:0/2465591879 reap_dead start 2023-07-14T13:13:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.616+0000 7f89ad819640 1 -- 172.21.15.5:0/2465591879 shutdown_connections 2023-07-14T13:13:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.616+0000 7f89ad819640 1 -- 172.21.15.5:0/2465591879 >> 172.21.15.5:0/2465591879 conn(0x7f89a809b480 msgr2=0x7f89a8159840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.616+0000 7f89ad819640 1 -- 172.21.15.5:0/2465591879 shutdown_connections 2023-07-14T13:13:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.616+0000 7f89ad819640 1 -- 172.21.15.5:0/2465591879 wait complete. 2023-07-14T13:13:21.674 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/test_restart 2023-07-14T13:13:21.675 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/test_restart 1M 2023-07-14T13:13:21.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.832+0000 7f12d55d2640 1 Processor -- start 2023-07-14T13:13:21.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.832+0000 7f12d55d2640 1 -- start start 2023-07-14T13:13:21.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.836+0000 7f12d55d2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12d00cce30 0x7f12d00cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:21.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.836+0000 7f12d55d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12d0160250 0x7f12d006ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:21.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.836+0000 7f12d55d2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d006ec10 con 0x7f12d015f6d0 2023-07-14T13:13:21.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.836+0000 7f12d55d2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12d00af340 con 0x7f12d00cce30 2023-07-14T13:13:21.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.836+0000 7f12d55d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d006ee60 con 0x7f12d0160250 2023-07-14T13:13:21.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.836+0000 7f12cf7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f12d015f6d0 0x7f12d015fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:55826/0 (socket says 172.21.15.5:55826) 2023-07-14T13:13:21.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.836+0000 7f12cf7fe640 1 -- 172.21.15.5:0/851897456 learned_addr learned my addr 172.21.15.5:0/851897456 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:13:21.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.836+0000 7f12cffff640 1 --2- 172.21.15.5:0/851897456 >> v2:172.21.15.154:3300/0 conn(0x7f12d00cce30 0x7f12d00cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:21.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.836+0000 7f12d4dd1640 1 --2- 172.21.15.5:0/851897456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12d0160250 0x7f12d006ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:21.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.836+0000 7f12ceffd640 1 -- 172.21.15.5:0/851897456 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2718298506 0 0) 0x7f12d006ec10 con 0x7f12d015f6d0 2023-07-14T13:13:21.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.836+0000 7f12ceffd640 1 -- 172.21.15.5:0/851897456 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12b8003530 con 0x7f12d015f6d0 2023-07-14T13:13:21.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.836+0000 7f12cffff640 1 -- 172.21.15.5:0/851897456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12d0160250 msgr2=0x7f12d006ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:21.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.836+0000 7f12cffff640 1 --2- 172.21.15.5:0/851897456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12d0160250 0x7f12d006ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:21.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.836+0000 7f12cffff640 1 -- 172.21.15.5:0/851897456 >> v1:172.21.15.5:6789/0 conn(0x7f12d015f6d0 legacy=0x7f12d015fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:21.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.836+0000 7f12cffff640 1 -- 172.21.15.5:0/851897456 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d006f140 con 0x7f12d00cce30 2023-07-14T13:13:21.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.840+0000 7f12cffff640 1 --2- 172.21.15.5:0/851897456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12d00cce30 0x7f12d00cf7f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f12c00097c0 tx=0x7f12c001c170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dae059191274fd3a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:21.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.840+0000 7f12ceffd640 1 -- 172.21.15.5:0/851897456 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c4001680 con 0x7f12d00cce30 2023-07-14T13:13:21.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.840+0000 7f12ceffd640 1 -- 172.21.15.5:0/851897456 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c00a7050 con 0x7f12d00cce30 2023-07-14T13:13:21.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.840+0000 7f12ceffd640 1 -- 172.21.15.5:0/851897456 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c00ab620 con 0x7f12d00cce30 2023-07-14T13:13:21.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.840+0000 7f12d55d2640 1 -- 172.21.15.5:0/851897456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12d00cce30 msgr2=0x7f12d00cf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:21.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.840+0000 7f12d55d2640 1 --2- 172.21.15.5:0/851897456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12d00cce30 0x7f12d00cf7f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f12c00097c0 tx=0x7f12c001c170 comp rx=0 tx=0).stop 2023-07-14T13:13:21.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.840+0000 7f12d55d2640 1 -- 172.21.15.5:0/851897456 shutdown_connections 2023-07-14T13:13:21.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.840+0000 7f12d55d2640 1 --2- 172.21.15.5:0/851897456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12d0160250 0x7f12d006ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:21.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.840+0000 7f12d55d2640 1 --2- 172.21.15.5:0/851897456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12d00cce30 0x7f12d00cf7f0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:21.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.840+0000 7f12d55d2640 1 -- 172.21.15.5:0/851897456 >> 172.21.15.5:0/851897456 conn(0x7f12d006d1c0 msgr2=0x7f12d006d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:21.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.840+0000 7f12d55d2640 1 -- 172.21.15.5:0/851897456 shutdown_connections 2023-07-14T13:13:21.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.840+0000 7f12d55d2640 1 -- 172.21.15.5:0/851897456 wait complete. 2023-07-14T13:13:21.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.840+0000 7f12d55d2640 1 Processor -- start 2023-07-14T13:13:21.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.840+0000 7f12d55d2640 1 -- start start 2023-07-14T13:13:21.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.840+0000 7f12d55d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d00cce30 0x7f12d014a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:21.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.840+0000 7f12d55d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12d015f6d0 0x7f12d00b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:21.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.840+0000 7f12d55d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12d0160250 0x7f12d0153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:21.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.840+0000 7f12d55d2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d014a560 con 0x7f12d00cce30 2023-07-14T13:13:21.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.840+0000 7f12d55d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d00b27e0 con 0x7f12d015f6d0 2023-07-14T13:13:21.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.840+0000 7f12d55d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d01581e0 con 0x7f12d0160250 2023-07-14T13:13:21.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.844+0000 7f12cffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d00cce30 0x7f12d014a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:21.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.844+0000 7f12cffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d00cce30 0x7f12d014a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33594/0 (socket says 172.21.15.5:33594) 2023-07-14T13:13:21.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.844+0000 7f12cffff640 1 -- 172.21.15.5:0/444096403 learned_addr learned my addr 172.21.15.5:0/444096403 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:13:21.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.844+0000 7f12cf7fe640 1 --2- 172.21.15.5:0/444096403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12d015f6d0 0x7f12d00b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:21.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.844+0000 7f12cffff640 1 -- 172.21.15.5:0/444096403 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12d0160250 msgr2=0x7f12d0153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:21.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.844+0000 7f12cffff640 1 --2- 172.21.15.5:0/444096403 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12d0160250 0x7f12d0153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:21.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.844+0000 7f12cffff640 1 -- 172.21.15.5:0/444096403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12d015f6d0 msgr2=0x7f12d00b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:21.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.844+0000 7f12cffff640 1 --2- 172.21.15.5:0/444096403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12d015f6d0 0x7f12d00b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:21.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.844+0000 7f12cffff640 1 -- 172.21.15.5:0/444096403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c0009420 con 0x7f12d00cce30 2023-07-14T13:13:21.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.844+0000 7f12cf7fe640 1 --2- 172.21.15.5:0/444096403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12d015f6d0 0x7f12d00b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:13:21.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.844+0000 7f12cffff640 1 --2- 172.21.15.5:0/444096403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d00cce30 0x7f12d014a020 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f12c00ae040 tx=0x7f12c001a9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:21.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.844+0000 7f12ccff9640 1 -- 172.21.15.5:0/444096403 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c00b7450 con 0x7f12d00cce30 2023-07-14T13:13:21.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.844+0000 7f12ccff9640 1 -- 172.21.15.5:0/444096403 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c00b75b0 con 0x7f12d00cce30 2023-07-14T13:13:21.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.844+0000 7f12d55d2640 1 -- 172.21.15.5:0/444096403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d01578f0 con 0x7f12d00cce30 2023-07-14T13:13:21.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.844+0000 7f12ccff9640 1 -- 172.21.15.5:0/444096403 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c00b7960 con 0x7f12d00cce30 2023-07-14T13:13:21.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.844+0000 7f12d55d2640 1 -- 172.21.15.5:0/444096403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d0157e70 con 0x7f12d00cce30 2023-07-14T13:13:21.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.844+0000 7f12d55d2640 1 -- 172.21.15.5:0/444096403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d004e020 con 0x7f12d00cce30 2023-07-14T13:13:21.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.844+0000 7f12ccff9640 1 -- 172.21.15.5:0/444096403 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 73) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f12c00b7ac0 con 0x7f12d00cce30 2023-07-14T13:13:21.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.848+0000 7f12ccff9640 1 --2- 172.21.15.5:0/444096403 >> [v2:172.21.15.154:6832/3414173858,v1:172.21.15.154:6833/3414173858] conn(0x7f12bc066120 0x7f12bc0685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:21.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.848+0000 7f12ccff9640 1 -- 172.21.15.5:0/444096403 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f12c011e480 con 0x7f12d00cce30 2023-07-14T13:13:21.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.848+0000 7f12cf7fe640 1 --2- 172.21.15.5:0/444096403 >> [v2:172.21.15.154:6832/3414173858,v1:172.21.15.154:6833/3414173858] conn(0x7f12bc066120 0x7f12bc0685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:21.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.848+0000 7f12cf7fe640 1 --2- 172.21.15.5:0/444096403 >> [v2:172.21.15.154:6832/3414173858,v1:172.21.15.154:6833/3414173858] conn(0x7f12bc066120 0x7f12bc0685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f12c40017b0 tx=0x7f12c4009040 comp rx=0 tx=0).ready entity=mgr.9073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:21.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:21.852+0000 7f12ccff9640 1 -- 172.21.15.5:0/444096403 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f12c00ebb10 con 0x7f12d00cce30 2023-07-14T13:13:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:22.024+0000 7f12d55d2640 1 -- 172.21.15.5:0/444096403 --> [v2:172.21.15.154:6832/3414173858,v1:172.21.15.154:6833/3414173858] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f12d006bb30 con 0x7f12bc066120 2023-07-14T13:13:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:22.072+0000 7f12ccff9640 1 -- 172.21.15.5:0/444096403 <== mgr.9073 v2:172.21.15.154:6832/3414173858 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+57 (secure 0 0 0) 0x7f12c400d800 con 0x7f12bc066120 2023-07-14T13:13:22.110 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule activated for path /snap_test_dir1/test_restart 2023-07-14T13:13:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:22.072+0000 7f12d55d2640 1 -- 172.21.15.5:0/444096403 >> [v2:172.21.15.154:6832/3414173858,v1:172.21.15.154:6833/3414173858] conn(0x7f12bc066120 msgr2=0x7f12bc0685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:22.072+0000 7f12d55d2640 1 --2- 172.21.15.5:0/444096403 >> [v2:172.21.15.154:6832/3414173858,v1:172.21.15.154:6833/3414173858] conn(0x7f12bc066120 0x7f12bc0685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f12c40017b0 tx=0x7f12c4009040 comp rx=0 tx=0).stop 2023-07-14T13:13:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:22.072+0000 7f12d55d2640 1 -- 172.21.15.5:0/444096403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d00cce30 msgr2=0x7f12d014a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:22.072+0000 7f12d55d2640 1 --2- 172.21.15.5:0/444096403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d00cce30 0x7f12d014a020 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f12c00ae040 tx=0x7f12c001a9b0 comp rx=0 tx=0).stop 2023-07-14T13:13:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:22.072+0000 7f12d55d2640 1 -- 172.21.15.5:0/444096403 shutdown_connections 2023-07-14T13:13:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:22.072+0000 7f12d55d2640 1 --2- 172.21.15.5:0/444096403 >> [v2:172.21.15.154:6832/3414173858,v1:172.21.15.154:6833/3414173858] conn(0x7f12bc066120 0x7f12bc0685d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:22.072+0000 7f12d55d2640 1 --2- 172.21.15.5:0/444096403 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12d0160250 0x7f12d0153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:22.072+0000 7f12d55d2640 1 --2- 172.21.15.5:0/444096403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12d015f6d0 0x7f12d00b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:22.072+0000 7f12d55d2640 1 --2- 172.21.15.5:0/444096403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d00cce30 0x7f12d014a020 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:22.072+0000 7f12d55d2640 1 -- 172.21.15.5:0/444096403 >> 172.21.15.5:0/444096403 conn(0x7f12d006d1c0 msgr2=0x7f12d00cdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:22.076+0000 7f12d55d2640 1 -- 172.21.15.5:0/444096403 shutdown_connections 2023-07-14T13:13:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:13:22.076+0000 7f12d55d2640 1 -- 172.21.15.5:0/444096403 wait complete. 2023-07-14T13:13:22.131 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/test_restart 2023-07-14T13:13:48.499 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:13:48.504 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:14:00.122 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:14:00.090+0000 7f1351ee9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:14:00.123 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:14:00.090+0000 7f1351ee9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:14:00.123 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:14:00.090+0000 7f1351ee9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:14:00.123 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:14:00.090+0000 7f1351ee9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:14:00.123 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:14:00.090+0000 7f1351ee9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:14:18.580 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:14:18.584 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:14:48.677 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:14:48.680 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:15:18.798 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:15:18.802 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:15:48.863 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:15:48.868 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:16:18.919 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:16:18.923 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:16:48.984 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:16:48.988 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:17:19.053 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:17:19.057 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:17:49.132 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:17:49.137 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:18:19.220 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:18:19.225 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:18:49.289 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:18:49.293 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:19:19.366 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:19:19.370 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:19:49.461 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:19:49.466 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:20:19.522 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:20:19.526 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:20:49.600 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:20:49.605 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:21:19.678 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:21:19.682 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:21:49.757 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:21:49.761 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:22:19.814 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:22:19.818 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:22:49.887 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:22:49.891 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:23:19.956 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:23:19.960 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:23:50.019 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:23:50.023 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:24:16.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:24:16.134 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-07-14T13:24:16.147 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_14_00_UTC 2023-07-14T13:24:16.148 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_15_00_UTC 2023-07-14T13:24:16.148 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_16_00_UTC 2023-07-14T13:24:16.148 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_17_00_UTC 2023-07-14T13:24:16.149 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_18_00_UTC 2023-07-14T13:24:16.149 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_19_00_UTC 2023-07-14T13:24:16.149 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_20_00_UTC 2023-07-14T13:24:16.150 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_21_00_UTC 2023-07-14T13:24:16.150 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_22_00_UTC 2023-07-14T13:24:16.150 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_23_00_UTC 2023-07-14T13:24:16.151 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_24_00_UTC 2023-07-14T13:24:16.152 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-14-13_14_00_UTC', 'scheduled-2023-07-14-13_15_00_UTC', 'scheduled-2023-07-14-13_16_00_UTC', 'scheduled-2023-07-14-13_17_00_UTC', 'scheduled-2023-07-14-13_18_00_UTC', 'scheduled-2023-07-14-13_19_00_UTC', 'scheduled-2023-07-14-13_20_00_UTC', 'scheduled-2023-07-14-13_21_00_UTC', 'scheduled-2023-07-14-13_22_00_UTC', 'scheduled-2023-07-14-13_23_00_UTC', 'scheduled-2023-07-14-13_24_00_UTC'] 2023-07-14T13:24:16.153 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-07-14T13:24:16.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.340+0000 7efd88111640 1 Processor -- start 2023-07-14T13:24:16.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.340+0000 7efd88111640 1 -- start start 2023-07-14T13:24:16.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.340+0000 7efd88111640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd8015cef0 0x7efd80158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:16.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.340+0000 7efd88111640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efd80159270 0x7efd800c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:16.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.340+0000 7efd88111640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd801532b0 con 0x7efd800aeb40 2023-07-14T13:24:16.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.340+0000 7efd88111640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd8015d360 con 0x7efd80159270 2023-07-14T13:24:16.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.340+0000 7efd88111640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd800ca6f0 con 0x7efd8015cef0 2023-07-14T13:24:16.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.340+0000 7efd866ae640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efd80159270 0x7efd800c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:16.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.340+0000 7efd866ae640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efd80159270 0x7efd800c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60026/0 (socket says 172.21.15.5:60026) 2023-07-14T13:24:16.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.340+0000 7efd866ae640 1 -- 172.21.15.5:0/1097652147 learned_addr learned my addr 172.21.15.5:0/1097652147 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:24:16.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.340+0000 7efd856ac640 1 --2- 172.21.15.5:0/1097652147 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd8015cef0 0x7efd80158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:16.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.344+0000 7efd866ae640 1 -- 172.21.15.5:0/1097652147 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd8015cef0 msgr2=0x7efd80158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:16.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.344+0000 7efd866ae640 1 --2- 172.21.15.5:0/1097652147 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd8015cef0 0x7efd80158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:16.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.344+0000 7efd866ae640 1 -- 172.21.15.5:0/1097652147 >> v1:172.21.15.154:6789/0 conn(0x7efd800aeb40 legacy=0x7efd800aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:16.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.344+0000 7efd866ae640 1 -- 172.21.15.5:0/1097652147 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd801599d0 con 0x7efd80159270 2023-07-14T13:24:16.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.344+0000 7efd866ae640 1 --2- 172.21.15.5:0/1097652147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd80159270 0x7efd800c88c0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7efd78009e50 tx=0x7efd7801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937c699b4c037c47 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:16.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.344+0000 7efd84eab640 1 -- 172.21.15.5:0/1097652147 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd780a58a0 con 0x7efd80159270 2023-07-14T13:24:16.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.344+0000 7efd84eab640 1 -- 172.21.15.5:0/1097652147 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd780a5a00 con 0x7efd80159270 2023-07-14T13:24:16.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.344+0000 7efd84eab640 1 -- 172.21.15.5:0/1097652147 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd780a5d90 con 0x7efd80159270 2023-07-14T13:24:16.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.344+0000 7efd88111640 1 -- 172.21.15.5:0/1097652147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd80159270 msgr2=0x7efd800c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:16.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.344+0000 7efd88111640 1 --2- 172.21.15.5:0/1097652147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd80159270 0x7efd800c88c0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7efd78009e50 tx=0x7efd7801c9e0 comp rx=0 tx=0).stop 2023-07-14T13:24:16.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.344+0000 7efd88111640 1 -- 172.21.15.5:0/1097652147 shutdown_connections 2023-07-14T13:24:16.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.344+0000 7efd88111640 1 --2- 172.21.15.5:0/1097652147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd80159270 0x7efd800c88c0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:16.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.344+0000 7efd88111640 1 --2- 172.21.15.5:0/1097652147 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd8015cef0 0x7efd80158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:16.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.344+0000 7efd88111640 1 -- 172.21.15.5:0/1097652147 >> 172.21.15.5:0/1097652147 conn(0x7efd800cde90 msgr2=0x7efd800ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:16.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.348+0000 7efd88111640 1 -- 172.21.15.5:0/1097652147 shutdown_connections 2023-07-14T13:24:16.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.348+0000 7efd88111640 1 -- 172.21.15.5:0/1097652147 wait complete. 2023-07-14T13:24:16.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.348+0000 7efd88111640 1 Processor -- start 2023-07-14T13:24:16.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.348+0000 7efd88111640 1 -- start start 2023-07-14T13:24:16.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.348+0000 7efd88111640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd800aeb40 0x7efd8006bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:16.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.348+0000 7efd88111640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd80159270 0x7efd8014d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:16.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.348+0000 7efd88111640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd8015cef0 0x7efd80151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:16.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.348+0000 7efd88111640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd801f40d0 con 0x7efd8015cef0 2023-07-14T13:24:16.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.348+0000 7efd88111640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8014e050 con 0x7efd80159270 2023-07-14T13:24:16.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.348+0000 7efd88111640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8014e330 con 0x7efd800aeb40 2023-07-14T13:24:16.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.348+0000 7efd866ae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd8015cef0 0x7efd80151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:16.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.348+0000 7efd866ae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd8015cef0 0x7efd80151240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60032/0 (socket says 172.21.15.5:60032) 2023-07-14T13:24:16.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.348+0000 7efd866ae640 1 -- 172.21.15.5:0/3084644767 learned_addr learned my addr 172.21.15.5:0/3084644767 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:24:16.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.348+0000 7efd856ac640 1 --2- 172.21.15.5:0/3084644767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd80159270 0x7efd8014d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:16.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.348+0000 7efd85ead640 1 --2- 172.21.15.5:0/3084644767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd800aeb40 0x7efd8006bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:16.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.348+0000 7efd866ae640 1 -- 172.21.15.5:0/3084644767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd800aeb40 msgr2=0x7efd8006bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:16.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.348+0000 7efd866ae640 1 --2- 172.21.15.5:0/3084644767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd800aeb40 0x7efd8006bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:16.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.348+0000 7efd866ae640 1 -- 172.21.15.5:0/3084644767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd80159270 msgr2=0x7efd8014d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:16.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.348+0000 7efd866ae640 1 --2- 172.21.15.5:0/3084644767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd80159270 0x7efd8014d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:16.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.348+0000 7efd866ae640 1 -- 172.21.15.5:0/3084644767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd78009b30 con 0x7efd8015cef0 2023-07-14T13:24:16.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.348+0000 7efd866ae640 1 --2- 172.21.15.5:0/3084644767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd8015cef0 0x7efd80151240 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7efd7801a610 tx=0x7efd78019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:16.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.352+0000 7efd767fc640 1 -- 172.21.15.5:0/3084644767 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd780b8670 con 0x7efd8015cef0 2023-07-14T13:24:16.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.352+0000 7efd767fc640 1 -- 172.21.15.5:0/3084644767 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd780b87d0 con 0x7efd8015cef0 2023-07-14T13:24:16.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.352+0000 7efd88111640 1 -- 172.21.15.5:0/3084644767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd8014e610 con 0x7efd8015cef0 2023-07-14T13:24:16.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.352+0000 7efd767fc640 1 -- 172.21.15.5:0/3084644767 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd780b8b60 con 0x7efd8015cef0 2023-07-14T13:24:16.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.352+0000 7efd88111640 1 -- 172.21.15.5:0/3084644767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8014ebd0 con 0x7efd8015cef0 2023-07-14T13:24:16.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.352+0000 7efd88111640 1 -- 172.21.15.5:0/3084644767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd8014ed60 con 0x7efd8015cef0 2023-07-14T13:24:16.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.352+0000 7efd767fc640 1 -- 172.21.15.5:0/3084644767 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 76) v1 ==== 85789+0+0 (secure 0 0 0) 0x7efd800c9610 con 0x7efd8015cef0 2023-07-14T13:24:16.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.352+0000 7efd767fc640 1 --2- 172.21.15.5:0/3084644767 >> [v2:172.21.15.154:6832/3414173858,v1:172.21.15.154:6833/3414173858] conn(0x7efd640663f0 0x7efd640688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:16.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.352+0000 7efd767fc640 1 -- 172.21.15.5:0/3084644767 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6434+0+0 (secure 0 0 0) 0x7efd7811f470 con 0x7efd8015cef0 2023-07-14T13:24:16.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.352+0000 7efd85ead640 1 --2- 172.21.15.5:0/3084644767 >> [v2:172.21.15.154:6832/3414173858,v1:172.21.15.154:6833/3414173858] conn(0x7efd640663f0 0x7efd640688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:16.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.356+0000 7efd85ead640 1 --2- 172.21.15.5:0/3084644767 >> [v2:172.21.15.154:6832/3414173858,v1:172.21.15.154:6833/3414173858] conn(0x7efd640663f0 0x7efd640688a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efd7c000f70 tx=0x7efd7c009040 comp rx=0 tx=0).ready entity=mgr.9073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:16.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.356+0000 7efd767fc640 1 -- 172.21.15.5:0/3084644767 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7efd780ec830 con 0x7efd8015cef0 2023-07-14T13:24:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.532+0000 7efd88111640 1 -- 172.21.15.5:0/3084644767 --> [v2:172.21.15.154:6832/3414173858,v1:172.21.15.154:6833/3414173858] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efd8015c9d0 con 0x7efd640663f0 2023-07-14T13:24:16.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.540+0000 7efd767fc640 1 -- 172.21.15.5:0/3084644767 <== mgr.9073 v2:172.21.15.154:6832/3414173858 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7efd7c001ce0 con 0x7efd640663f0 2023-07-14T13:24:16.556 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:24:16.556 INFO:teuthology.orchestra.run.smithi005.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T13:13:21", "first": "2023-07-14T13:14:00", "last": "2023-07-14T13:24:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-07-14T13:24:16.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.540+0000 7efd88111640 1 -- 172.21.15.5:0/3084644767 >> [v2:172.21.15.154:6832/3414173858,v1:172.21.15.154:6833/3414173858] conn(0x7efd640663f0 msgr2=0x7efd640688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:16.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.540+0000 7efd88111640 1 --2- 172.21.15.5:0/3084644767 >> [v2:172.21.15.154:6832/3414173858,v1:172.21.15.154:6833/3414173858] conn(0x7efd640663f0 0x7efd640688a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efd7c000f70 tx=0x7efd7c009040 comp rx=0 tx=0).stop 2023-07-14T13:24:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.540+0000 7efd88111640 1 -- 172.21.15.5:0/3084644767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd8015cef0 msgr2=0x7efd80151240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.540+0000 7efd88111640 1 --2- 172.21.15.5:0/3084644767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd8015cef0 0x7efd80151240 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7efd7801a610 tx=0x7efd78019780 comp rx=0 tx=0).stop 2023-07-14T13:24:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.540+0000 7efd88111640 1 -- 172.21.15.5:0/3084644767 shutdown_connections 2023-07-14T13:24:16.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.540+0000 7efd88111640 1 --2- 172.21.15.5:0/3084644767 >> [v2:172.21.15.154:6832/3414173858,v1:172.21.15.154:6833/3414173858] conn(0x7efd640663f0 0x7efd640688a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:16.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.540+0000 7efd88111640 1 --2- 172.21.15.5:0/3084644767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd8015cef0 0x7efd80151240 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:16.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.540+0000 7efd88111640 1 --2- 172.21.15.5:0/3084644767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd80159270 0x7efd8014d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:16.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.540+0000 7efd88111640 1 --2- 172.21.15.5:0/3084644767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd800aeb40 0x7efd8006bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:16.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.540+0000 7efd88111640 1 -- 172.21.15.5:0/3084644767 >> 172.21.15.5:0/3084644767 conn(0x7efd800cde90 msgr2=0x7efd800ad8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:16.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.540+0000 7efd88111640 1 -- 172.21.15.5:0/3084644767 shutdown_connections 2023-07-14T13:24:16.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.540+0000 7efd88111640 1 -- 172.21.15.5:0/3084644767 wait complete. 2023-07-14T13:24:16.576 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T13:13:21", "first": "2023-07-14T13:14:00", "last": "2023-07-14T13:24:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-07-14T13:24:16.578 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-07-14T00:00:00', 'created': '2023-07-14T13:13:21', 'first': '2023-07-14T13:14:00', 'last': '2023-07-14T13:24:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': True} 2023-07-14T13:24:16.579 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-14T13:24:16.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.708+0000 7fab60c9c640 1 Processor -- start 2023-07-14T13:24:16.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.708+0000 7fab60c9c640 1 -- start start 2023-07-14T13:24:16.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.708+0000 7fab60c9c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab5c15fd60 0x7fab5c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:16.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.708+0000 7fab60c9c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fab5c0d1850 0x7fab5c0d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:16.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.708+0000 7fab60c9c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab5c0ccaf0 con 0x7fab5c0b7c70 2023-07-14T13:24:16.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.708+0000 7fab60c9c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab5c0d1190 con 0x7fab5c0d1850 2023-07-14T13:24:16.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.708+0000 7fab60c9c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c160600 con 0x7fab5c15fd60 2023-07-14T13:24:16.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.708+0000 7fab5ad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fab5c0d1850 0x7fab5c0d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:16.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.708+0000 7fab5ad9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fab5c0d1850 0x7fab5c0d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60048/0 (socket says 172.21.15.5:60048) 2023-07-14T13:24:16.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.708+0000 7fab5ad9d640 1 -- 172.21.15.5:0/2564103968 learned_addr learned my addr 172.21.15.5:0/2564103968 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:24:16.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.708+0000 7fab53fff640 1 --2- 172.21.15.5:0/2564103968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab5c15fd60 0x7fab5c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:16.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.708+0000 7fab5ad9d640 1 -- 172.21.15.5:0/2564103968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab5c15fd60 msgr2=0x7fab5c0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:16.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.708+0000 7fab5ad9d640 1 --2- 172.21.15.5:0/2564103968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab5c15fd60 0x7fab5c0d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:16.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.708+0000 7fab5ad9d640 1 -- 172.21.15.5:0/2564103968 >> v1:172.21.15.154:6789/0 conn(0x7fab5c0b7c70 legacy=0x7fab5c15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:16.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.708+0000 7fab5ad9d640 1 -- 172.21.15.5:0/2564103968 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5c160320 con 0x7fab5c0d1850 2023-07-14T13:24:16.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.712+0000 7fab5ad9d640 1 --2- 172.21.15.5:0/2564103968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab5c0d1850 0x7fab5c0d1da0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fab54009e80 tx=0x7fab5401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a2c7762f1f3e0c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:16.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.712+0000 7fab59d9b640 1 -- 172.21.15.5:0/2564103968 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab540a58a0 con 0x7fab5c0d1850 2023-07-14T13:24:16.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.712+0000 7fab59d9b640 1 -- 172.21.15.5:0/2564103968 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab540a5a00 con 0x7fab5c0d1850 2023-07-14T13:24:16.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.712+0000 7fab59d9b640 1 -- 172.21.15.5:0/2564103968 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab540a5d90 con 0x7fab5c0d1850 2023-07-14T13:24:16.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.712+0000 7fab60c9c640 1 -- 172.21.15.5:0/2564103968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab5c0d1850 msgr2=0x7fab5c0d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:16.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.712+0000 7fab60c9c640 1 --2- 172.21.15.5:0/2564103968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab5c0d1850 0x7fab5c0d1da0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fab54009e80 tx=0x7fab5401c9c0 comp rx=0 tx=0).stop 2023-07-14T13:24:16.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.712+0000 7fab60c9c640 1 -- 172.21.15.5:0/2564103968 shutdown_connections 2023-07-14T13:24:16.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.712+0000 7fab60c9c640 1 --2- 172.21.15.5:0/2564103968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab5c0d1850 0x7fab5c0d1da0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:16.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.712+0000 7fab60c9c640 1 --2- 172.21.15.5:0/2564103968 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab5c15fd60 0x7fab5c0d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:16.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.712+0000 7fab60c9c640 1 -- 172.21.15.5:0/2564103968 >> 172.21.15.5:0/2564103968 conn(0x7fab5c0650b0 msgr2=0x7fab5c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:16.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.712+0000 7fab60c9c640 1 -- 172.21.15.5:0/2564103968 shutdown_connections 2023-07-14T13:24:16.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.712+0000 7fab60c9c640 1 -- 172.21.15.5:0/2564103968 wait complete. 2023-07-14T13:24:16.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.716+0000 7fab60c9c640 1 Processor -- start 2023-07-14T13:24:16.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.716+0000 7fab60c9c640 1 -- start start 2023-07-14T13:24:16.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.716+0000 7fab60c9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab5c0b7c70 0x7fab5c0c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:16.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.716+0000 7fab60c9c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab5c0d1850 0x7fab5c159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:16.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.716+0000 7fab60c9c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab5c15fd60 0x7fab5c14a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:16.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.716+0000 7fab60c9c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c0cb8d0 con 0x7fab5c0b7c70 2023-07-14T13:24:16.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.716+0000 7fab60c9c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c0cbbb0 con 0x7fab5c0d1850 2023-07-14T13:24:16.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.716+0000 7fab60c9c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c0cbe90 con 0x7fab5c15fd60 2023-07-14T13:24:16.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.716+0000 7fab5a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab5c0b7c70 0x7fab5c0c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:16.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.716+0000 7fab5a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab5c0b7c70 0x7fab5c0c8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60050/0 (socket says 172.21.15.5:60050) 2023-07-14T13:24:16.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.716+0000 7fab5a59c640 1 -- 172.21.15.5:0/1321533958 learned_addr learned my addr 172.21.15.5:0/1321533958 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:24:16.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.716+0000 7fab53fff640 1 --2- 172.21.15.5:0/1321533958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab5c0d1850 0x7fab5c159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:16.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.716+0000 7fab5ad9d640 1 --2- 172.21.15.5:0/1321533958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab5c15fd60 0x7fab5c14a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:16.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.716+0000 7fab5a59c640 1 -- 172.21.15.5:0/1321533958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab5c15fd60 msgr2=0x7fab5c14a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:16.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.716+0000 7fab5a59c640 1 --2- 172.21.15.5:0/1321533958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab5c15fd60 0x7fab5c14a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:16.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.716+0000 7fab5a59c640 1 -- 172.21.15.5:0/1321533958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab5c0d1850 msgr2=0x7fab5c159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:16.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.716+0000 7fab5a59c640 1 --2- 172.21.15.5:0/1321533958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab5c0d1850 0x7fab5c159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:16.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.716+0000 7fab5a59c640 1 -- 172.21.15.5:0/1321533958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab54009b30 con 0x7fab5c0b7c70 2023-07-14T13:24:16.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.716+0000 7fab5a59c640 1 --2- 172.21.15.5:0/1321533958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab5c0b7c70 0x7fab5c0c8ca0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00c3c0 tx=0x7fab4c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:16.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.716+0000 7fab52ffd640 1 -- 172.21.15.5:0/1321533958 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c0052d0 con 0x7fab5c0b7c70 2023-07-14T13:24:16.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.716+0000 7fab52ffd640 1 -- 172.21.15.5:0/1321533958 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c005430 con 0x7fab5c0b7c70 2023-07-14T13:24:16.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.716+0000 7fab52ffd640 1 -- 172.21.15.5:0/1321533958 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c003840 con 0x7fab5c0b7c70 2023-07-14T13:24:16.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.716+0000 7fab60c9c640 1 -- 172.21.15.5:0/1321533958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab5c0cc170 con 0x7fab5c0b7c70 2023-07-14T13:24:16.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.716+0000 7fab60c9c640 1 -- 172.21.15.5:0/1321533958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab5c15a410 con 0x7fab5c0b7c70 2023-07-14T13:24:16.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.716+0000 7fab60c9c640 1 -- 172.21.15.5:0/1321533958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab5c0678d0 con 0x7fab5c0b7c70 2023-07-14T13:24:16.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.720+0000 7fab52ffd640 1 -- 172.21.15.5:0/1321533958 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 76) v1 ==== 85789+0+0 (secure 0 0 0) 0x7fab4c0039a0 con 0x7fab5c0b7c70 2023-07-14T13:24:16.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.720+0000 7fab52ffd640 1 --2- 172.21.15.5:0/1321533958 >> [v2:172.21.15.154:6832/3414173858,v1:172.21.15.154:6833/3414173858] conn(0x7fab3c0663f0 0x7fab3c0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:16.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.720+0000 7fab52ffd640 1 -- 172.21.15.5:0/1321533958 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6434+0+0 (secure 0 0 0) 0x7fab4c083560 con 0x7fab5c0b7c70 2023-07-14T13:24:16.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.720+0000 7fab53fff640 1 --2- 172.21.15.5:0/1321533958 >> [v2:172.21.15.154:6832/3414173858,v1:172.21.15.154:6833/3414173858] conn(0x7fab3c0663f0 0x7fab3c0688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:16.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.720+0000 7fab53fff640 1 --2- 172.21.15.5:0/1321533958 >> [v2:172.21.15.154:6832/3414173858,v1:172.21.15.154:6833/3414173858] conn(0x7fab3c0663f0 0x7fab3c0688a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fab5c0b39c0 tx=0x7fab44008040 comp rx=0 tx=0).ready entity=mgr.9073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:16.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.724+0000 7fab52ffd640 1 -- 172.21.15.5:0/1321533958 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fab4c0507c0 con 0x7fab5c0b7c70 2023-07-14T13:24:16.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.916+0000 7fab60c9c640 1 -- 172.21.15.5:0/1321533958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fab5c0cc360 con 0x7fab5c0b7c70 2023-07-14T13:24:16.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.920+0000 7fab52ffd640 1 -- 172.21.15.5:0/1321533958 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v76) v1 ==== 74+0+164458 (secure 0 0 0) 0x7fab5c0cc360 con 0x7fab5c0b7c70 2023-07-14T13:24:16.938 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:24:16.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.924+0000 7fab60c9c640 1 -- 172.21.15.5:0/1321533958 >> [v2:172.21.15.154:6832/3414173858,v1:172.21.15.154:6833/3414173858] conn(0x7fab3c0663f0 msgr2=0x7fab3c0688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:16.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.924+0000 7fab60c9c640 1 --2- 172.21.15.5:0/1321533958 >> [v2:172.21.15.154:6832/3414173858,v1:172.21.15.154:6833/3414173858] conn(0x7fab3c0663f0 0x7fab3c0688a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fab5c0b39c0 tx=0x7fab44008040 comp rx=0 tx=0).stop 2023-07-14T13:24:16.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.924+0000 7fab60c9c640 1 -- 172.21.15.5:0/1321533958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab5c0b7c70 msgr2=0x7fab5c0c8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:16.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.924+0000 7fab60c9c640 1 --2- 172.21.15.5:0/1321533958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab5c0b7c70 0x7fab5c0c8ca0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00c3c0 tx=0x7fab4c00c880 comp rx=0 tx=0).stop 2023-07-14T13:24:16.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.924+0000 7fab60c9c640 1 -- 172.21.15.5:0/1321533958 shutdown_connections 2023-07-14T13:24:16.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.924+0000 7fab60c9c640 1 --2- 172.21.15.5:0/1321533958 >> [v2:172.21.15.154:6832/3414173858,v1:172.21.15.154:6833/3414173858] conn(0x7fab3c0663f0 0x7fab3c0688a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:16.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.924+0000 7fab60c9c640 1 --2- 172.21.15.5:0/1321533958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab5c15fd60 0x7fab5c14a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:16.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.924+0000 7fab60c9c640 1 --2- 172.21.15.5:0/1321533958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab5c0d1850 0x7fab5c159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:16.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.924+0000 7fab60c9c640 1 --2- 172.21.15.5:0/1321533958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab5c0b7c70 0x7fab5c0c8ca0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:16.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.924+0000 7fab60c9c640 1 -- 172.21.15.5:0/1321533958 >> 172.21.15.5:0/1321533958 conn(0x7fab5c0650b0 msgr2=0x7fab5c065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:16.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.924+0000 7fab60c9c640 1 -- 172.21.15.5:0/1321533958 shutdown_connections 2023-07-14T13:24:16.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:24:16.924+0000 7fab60c9c640 1 -- 172.21.15.5:0/1321533958 wait complete. 2023-07-14T13:24:16.959 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":76,"active_gid":9073,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3414173858},{"type":"v1","addr":"172.21.15.154:6833","nonce":3414173858}]},"active_addr":"172.21.15.154:6833/3414173858","active_change":"2023-07-14T13:13:20.529097+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":9567,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":157,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":2602756791}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":1387122589}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":2448917971}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":2148864146}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":3205049834}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":3347209674}]}]} 2023-07-14T13:24:16.967 DEBUG:tasks.cephfs.test_snap_schedules:restarting active mgr: x 2023-07-14T13:24:16.968 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-14T13:24:16.969 INFO:tasks.ceph.mgr.x:Stopping old one... 2023-07-14T13:24:16.969 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-07-14T13:24:16.970 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:24:17.032 INFO:tasks.ceph.mgr.x:Stopped 2023-07-14T13:24:17.033 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-14T13:24:17.037 INFO:tasks.ceph.mgr.x:Started 2023-07-14T13:24:17.216 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:17.203+0000 7f50ee946180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:24:17.632 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:17.619+0000 7f50ee946180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:24:17.779 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:17.767+0000 7f50ee946180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:24:18.255 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:18.243+0000 7f50ee946180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:24:18.313 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:18.299+0000 7f50ee946180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:24:18.368 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:18.355+0000 7f50ee946180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:24:18.456 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:18.443+0000 7f50ee946180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:24:18.512 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:18.499+0000 7f50ee946180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:24:18.595 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:18.583+0000 7f50ee946180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:24:18.651 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:18.639+0000 7f50ee946180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:24:18.794 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:18.779+0000 7f50ee946180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:24:18.851 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:18.839+0000 7f50ee946180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:24:19.092 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:24:19.092 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:24:19.092 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:24:19.100 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:19.087+0000 7f50ee946180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:24:19.234 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:19.219+0000 7f50ee946180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:24:19.359 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:19.347+0000 7f50ee946180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:24:19.428 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:19.415+0000 7f50ee946180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:24:19.563 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:19.551+0000 7f50ee946180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:24:20.081 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:24:20.085 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:24:20.095 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:20.083+0000 7f50ee946180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:24:20.181 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:20.167+0000 7f50ee946180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:24:20.327 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:20.315+0000 7f50ee946180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:24:20.410 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:20.399+0000 7f50ee946180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:24:20.677 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:20.663+0000 7f50ee946180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:24:20.737 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:20.723+0000 7f50ee946180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:24:20.911 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:20.899+0000 7f506d2a8640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:24:20.911 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:20.899+0000 7f506d2a8640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:24:20.911 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:20.899+0000 7f506d2a8640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:24:20.911 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:20.899+0000 7f506d2a8640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:24:20.912 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:20.899+0000 7f506d2a8640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:24:20.912 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:20.899+0000 7f50702ae640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:24:20.912 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:20.899+0000 7f50702ae640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:24:20.912 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:20.899+0000 7f50702ae640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:24:20.913 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:20.899+0000 7f50702ae640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:24:20.913 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:24:20.899+0000 7f50702ae640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:24:50.162 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:24:50.166 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:25:00.906 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:25:00.898+0000 7f50782be640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:25:00.907 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:25:00.898+0000 7f50782be640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:25:00.907 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:25:00.898+0000 7f50782be640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:25:00.907 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:25:00.898+0000 7f50782be640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:25:00.907 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:25:00.898+0000 7f50782be640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:25:20.220 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:25:20.224 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:25:50.283 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:25:50.287 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:26:20.342 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:26:20.347 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:26:50.406 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:26:50.410 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:27:20.469 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:27:20.474 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:27:50.538 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:27:50.543 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:28:20.601 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:28:20.605 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:28:50.663 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:28:50.667 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:29:17.039 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/test_restart 1M 2023-07-14T13:29:17.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.196+0000 7fde82570640 1 Processor -- start 2023-07-14T13:29:17.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.196+0000 7fde82570640 1 -- start start 2023-07-14T13:29:17.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.196+0000 7fde82570640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde7c15fb90 0x7fde7c0c0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.196+0000 7fde82570640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fde7c0ca3b0 0x7fde7c0af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.196+0000 7fde82570640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde7c1639a0 con 0x7fde7c0c13f0 2023-07-14T13:29:17.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.196+0000 7fde82570640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde7c163c80 con 0x7fde7c0ca3b0 2023-07-14T13:29:17.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.196+0000 7fde82570640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c163f60 con 0x7fde7c15fb90 2023-07-14T13:29:17.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.196+0000 7fde8156e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde7c15fb90 0x7fde7c0c0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:17.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.196+0000 7fde80d6d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fde7c0ca3b0 0x7fde7c0af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:17.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.196+0000 7fde8156e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde7c15fb90 0x7fde7c0c0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:45958/0 (socket says 172.21.15.5:45958) 2023-07-14T13:29:17.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.196+0000 7fde8156e640 1 -- 172.21.15.5:0/17228589 learned_addr learned my addr 172.21.15.5:0/17228589 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:17.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.196+0000 7fde81d6f640 1 --1- 172.21.15.5:0/17228589 >> v1:172.21.15.154:6789/0 conn(0x7fde7c0c13f0 0x7fde7c15ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:46496/0 (socket says 172.21.15.5:46496) 2023-07-14T13:29:17.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.196+0000 7fde8156e640 1 -- 172.21.15.5:0/17228589 >> v2:172.21.15.154:3300/0 conn(0x7fde7c0ca3b0 msgr2=0x7fde7c0af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:17.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.196+0000 7fde8156e640 1 --2- 172.21.15.5:0/17228589 >> v2:172.21.15.154:3300/0 conn(0x7fde7c0ca3b0 0x7fde7c0af800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.196+0000 7fde8156e640 1 -- 172.21.15.5:0/17228589 >> v1:172.21.15.154:6789/0 conn(0x7fde7c0c13f0 legacy=0x7fde7c15ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:17.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.196+0000 7fde8156e640 1 -- 172.21.15.5:0/17228589 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7c164240 con 0x7fde7c15fb90 2023-07-14T13:29:17.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.196+0000 7fde73fff640 1 -- 172.21.15.5:0/17228589 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474254117 0 0) 0x7fde7c1639a0 con 0x7fde7c0c13f0 2023-07-14T13:29:17.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.200+0000 7fde8156e640 1 --2- 172.21.15.5:0/17228589 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde7c15fb90 0x7fde7c0c0eb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fde78009870 tx=0x7fde7801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9601a24b3287f1bd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:17.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.200+0000 7fde73fff640 1 -- 172.21.15.5:0/17228589 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde780aa430 con 0x7fde7c15fb90 2023-07-14T13:29:17.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.200+0000 7fde73fff640 1 -- 172.21.15.5:0/17228589 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde780aa590 con 0x7fde7c15fb90 2023-07-14T13:29:17.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.200+0000 7fde73fff640 1 -- 172.21.15.5:0/17228589 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde780aa920 con 0x7fde7c15fb90 2023-07-14T13:29:17.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.200+0000 7fde82570640 1 -- 172.21.15.5:0/17228589 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde7c15fb90 msgr2=0x7fde7c0c0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:17.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.200+0000 7fde82570640 1 --2- 172.21.15.5:0/17228589 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde7c15fb90 0x7fde7c0c0eb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fde78009870 tx=0x7fde7801c4b0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.200+0000 7fde82570640 1 -- 172.21.15.5:0/17228589 shutdown_connections 2023-07-14T13:29:17.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.200+0000 7fde82570640 1 --2- 172.21.15.5:0/17228589 >> v2:172.21.15.154:3300/0 conn(0x7fde7c0ca3b0 0x7fde7c0af800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.200+0000 7fde82570640 1 --2- 172.21.15.5:0/17228589 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde7c15fb90 0x7fde7c0c0eb0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.200+0000 7fde82570640 1 -- 172.21.15.5:0/17228589 >> 172.21.15.5:0/17228589 conn(0x7fde7c0ca800 msgr2=0x7fde7c0cac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:17.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.200+0000 7fde82570640 1 -- 172.21.15.5:0/17228589 shutdown_connections 2023-07-14T13:29:17.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.200+0000 7fde82570640 1 -- 172.21.15.5:0/17228589 wait complete. 2023-07-14T13:29:17.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.204+0000 7fde82570640 1 Processor -- start 2023-07-14T13:29:17.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.204+0000 7fde82570640 1 -- start start 2023-07-14T13:29:17.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.204+0000 7fde82570640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde7c0c13f0 0x7fde7c14e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.204+0000 7fde82570640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde7c15fb90 0x7fde7c154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.204+0000 7fde82570640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde7c1539d0 0x7fde7c1509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.204+0000 7fde82570640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c152ca0 con 0x7fde7c15fb90 2023-07-14T13:29:17.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.204+0000 7fde82570640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c153540 con 0x7fde7c0c13f0 2023-07-14T13:29:17.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.204+0000 7fde82570640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c157850 con 0x7fde7c1539d0 2023-07-14T13:29:17.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.204+0000 7fde80d6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde7c15fb90 0x7fde7c154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:17.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.204+0000 7fde80d6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde7c15fb90 0x7fde7c154ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47080/0 (socket says 172.21.15.5:47080) 2023-07-14T13:29:17.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.204+0000 7fde80d6d640 1 -- 172.21.15.5:0/3740622111 learned_addr learned my addr 172.21.15.5:0/3740622111 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:17.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.204+0000 7fde8156e640 1 --2- 172.21.15.5:0/3740622111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde7c0c13f0 0x7fde7c14e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:17.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.204+0000 7fde81d6f640 1 --2- 172.21.15.5:0/3740622111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde7c1539d0 0x7fde7c1509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:17.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.204+0000 7fde80d6d640 1 -- 172.21.15.5:0/3740622111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde7c1539d0 msgr2=0x7fde7c1509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:17.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.204+0000 7fde80d6d640 1 --2- 172.21.15.5:0/3740622111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde7c1539d0 0x7fde7c1509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.204+0000 7fde80d6d640 1 -- 172.21.15.5:0/3740622111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde7c0c13f0 msgr2=0x7fde7c14e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:17.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.204+0000 7fde80d6d640 1 --2- 172.21.15.5:0/3740622111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde7c0c13f0 0x7fde7c14e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.204+0000 7fde80d6d640 1 -- 172.21.15.5:0/3740622111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde780094d0 con 0x7fde7c15fb90 2023-07-14T13:29:17.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.204+0000 7fde80d6d640 1 --2- 172.21.15.5:0/3740622111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde7c15fb90 0x7fde7c154ad0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fde6c00e900 tx=0x7fde6c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:17.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.204+0000 7fde71ffb640 1 -- 172.21.15.5:0/3740622111 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c009690 con 0x7fde7c15fb90 2023-07-14T13:29:17.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.204+0000 7fde71ffb640 1 -- 172.21.15.5:0/3740622111 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6c00ca00 con 0x7fde7c15fb90 2023-07-14T13:29:17.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.204+0000 7fde71ffb640 1 -- 172.21.15.5:0/3740622111 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c00cd90 con 0x7fde7c15fb90 2023-07-14T13:29:17.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.204+0000 7fde82570640 1 -- 172.21.15.5:0/3740622111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde7c152ef0 con 0x7fde7c15fb90 2023-07-14T13:29:17.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.204+0000 7fde82570640 1 -- 172.21.15.5:0/3740622111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7c150080 con 0x7fde7c15fb90 2023-07-14T13:29:17.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.204+0000 7fde82570640 1 -- 172.21.15.5:0/3740622111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde7c04e020 con 0x7fde7c15fb90 2023-07-14T13:29:17.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.208+0000 7fde71ffb640 1 -- 172.21.15.5:0/3740622111 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 81) v1 ==== 85789+0+0 (secure 0 0 0) 0x7fde6c013470 con 0x7fde7c15fb90 2023-07-14T13:29:17.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.208+0000 7fde71ffb640 1 --2- 172.21.15.5:0/3740622111 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fde600663f0 0x7fde600688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.208+0000 7fde71ffb640 1 -- 172.21.15.5:0/3740622111 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6778+0+0 (secure 0 0 0) 0x7fde6c084440 con 0x7fde7c15fb90 2023-07-14T13:29:17.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.208+0000 7fde8156e640 1 --2- 172.21.15.5:0/3740622111 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fde600663f0 0x7fde600688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:17.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.208+0000 7fde8156e640 1 --2- 172.21.15.5:0/3740622111 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fde600663f0 0x7fde600688a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fde780ae000 tx=0x7fde780a7000 comp rx=0 tx=0).ready entity=mgr.8000 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:17.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.212+0000 7fde71ffb640 1 -- 172.21.15.5:0/3740622111 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fde6c0514f0 con 0x7fde7c15fb90 2023-07-14T13:29:17.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.388+0000 7fde82570640 1 -- 172.21.15.5:0/3740622111 --> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fde7c153680 con 0x7fde600663f0 2023-07-14T13:29:17.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.452+0000 7fde71ffb640 1 -- 172.21.15.5:0/3740622111 <== mgr.8000 v2:172.21.15.154:6832/1973779483 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+59 (secure 0 0 0) 0x7fde7c153680 con 0x7fde600663f0 2023-07-14T13:29:17.457 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule deactivated for path /snap_test_dir1/test_restart 2023-07-14T13:29:17.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.452+0000 7fde82570640 1 -- 172.21.15.5:0/3740622111 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fde600663f0 msgr2=0x7fde600688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:17.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.452+0000 7fde82570640 1 --2- 172.21.15.5:0/3740622111 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fde600663f0 0x7fde600688a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fde780ae000 tx=0x7fde780a7000 comp rx=0 tx=0).stop 2023-07-14T13:29:17.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.452+0000 7fde82570640 1 -- 172.21.15.5:0/3740622111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde7c15fb90 msgr2=0x7fde7c154ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:17.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.452+0000 7fde82570640 1 --2- 172.21.15.5:0/3740622111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde7c15fb90 0x7fde7c154ad0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fde6c00e900 tx=0x7fde6c00edc0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.452+0000 7fde82570640 1 -- 172.21.15.5:0/3740622111 shutdown_connections 2023-07-14T13:29:17.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.452+0000 7fde82570640 1 --2- 172.21.15.5:0/3740622111 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fde600663f0 0x7fde600688a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.452+0000 7fde82570640 1 --2- 172.21.15.5:0/3740622111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde7c1539d0 0x7fde7c1509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.452+0000 7fde82570640 1 --2- 172.21.15.5:0/3740622111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde7c15fb90 0x7fde7c154ad0 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.452+0000 7fde82570640 1 --2- 172.21.15.5:0/3740622111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde7c0c13f0 0x7fde7c14e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.452+0000 7fde82570640 1 -- 172.21.15.5:0/3740622111 >> 172.21.15.5:0/3740622111 conn(0x7fde7c0ca800 msgr2=0x7fde7c1558d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:17.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.452+0000 7fde82570640 1 -- 172.21.15.5:0/3740622111 shutdown_connections 2023-07-14T13:29:17.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.452+0000 7fde82570640 1 -- 172.21.15.5:0/3740622111 wait complete. 2023-07-14T13:29:17.478 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/test_restart 2023-07-14T13:29:17.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:17.479 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-07-14T13:29:17.489 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_14_00_UTC 2023-07-14T13:29:17.489 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_15_00_UTC 2023-07-14T13:29:17.489 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_16_00_UTC 2023-07-14T13:29:17.489 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_17_00_UTC 2023-07-14T13:29:17.489 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_18_00_UTC 2023-07-14T13:29:17.491 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_19_00_UTC 2023-07-14T13:29:17.491 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_20_00_UTC 2023-07-14T13:29:17.491 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_21_00_UTC 2023-07-14T13:29:17.492 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_22_00_UTC 2023-07-14T13:29:17.492 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_23_00_UTC 2023-07-14T13:29:17.492 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_24_00_UTC 2023-07-14T13:29:17.493 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_25_00_UTC 2023-07-14T13:29:17.493 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_26_00_UTC 2023-07-14T13:29:17.493 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_27_00_UTC 2023-07-14T13:29:17.493 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_28_00_UTC 2023-07-14T13:29:17.494 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_29_00_UTC 2023-07-14T13:29:17.495 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-14-13_14_00_UTC', 'scheduled-2023-07-14-13_15_00_UTC', 'scheduled-2023-07-14-13_16_00_UTC', 'scheduled-2023-07-14-13_17_00_UTC', 'scheduled-2023-07-14-13_18_00_UTC', 'scheduled-2023-07-14-13_19_00_UTC', 'scheduled-2023-07-14-13_20_00_UTC', 'scheduled-2023-07-14-13_21_00_UTC', 'scheduled-2023-07-14-13_22_00_UTC', 'scheduled-2023-07-14-13_23_00_UTC', 'scheduled-2023-07-14-13_24_00_UTC', 'scheduled-2023-07-14-13_25_00_UTC', 'scheduled-2023-07-14-13_26_00_UTC', 'scheduled-2023-07-14-13_27_00_UTC', 'scheduled-2023-07-14-13_28_00_UTC', 'scheduled-2023-07-14-13_29_00_UTC'] 2023-07-14T13:29:17.496 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-07-14T13:29:17.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.676+0000 7fdf015c5640 1 Processor -- start 2023-07-14T13:29:17.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.676+0000 7fdf015c5640 1 -- start start 2023-07-14T13:29:17.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.680+0000 7fdf015c5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdefc0cba60 0x7fdefc0c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.680+0000 7fdf015c5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdefc15b9c0 0x7fdefc0cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.680+0000 7fdf015c5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdefc158090 0x7fdefc158510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.680+0000 7fdf015c5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdefc0cc370 con 0x7fdefc15b9c0 2023-07-14T13:29:17.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.680+0000 7fdf015c5640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdefc0c37e0 con 0x7fdefc158090 2023-07-14T13:29:17.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.680+0000 7fdf015c5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc0c3ac0 con 0x7fdefc0cba60 2023-07-14T13:29:17.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.680+0000 7fdef3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdefc15b9c0 0x7fdefc0cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:17.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.680+0000 7fdef3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdefc15b9c0 0x7fdefc0cbe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47092/0 (socket says 172.21.15.5:47092) 2023-07-14T13:29:17.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.680+0000 7fdef3fff640 1 -- 172.21.15.5:0/259823302 learned_addr learned my addr 172.21.15.5:0/259823302 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:17.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.680+0000 7fdefaffd640 1 --2- 172.21.15.5:0/259823302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdefc0cba60 0x7fdefc0c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:17.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.680+0000 7fdef3fff640 1 -- 172.21.15.5:0/259823302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdefc0cba60 msgr2=0x7fdefc0c3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:17.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.680+0000 7fdef3fff640 1 --2- 172.21.15.5:0/259823302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdefc0cba60 0x7fdefc0c3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.680+0000 7fdef3fff640 1 -- 172.21.15.5:0/259823302 >> v2:172.21.15.154:3300/0 conn(0x7fdefc158090 msgr2=0x7fdefc158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:17.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.680+0000 7fdefb7fe640 1 --2- 172.21.15.5:0/259823302 >> v2:172.21.15.154:3300/0 conn(0x7fdefc158090 0x7fdefc158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:17.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.680+0000 7fdef3fff640 1 --2- 172.21.15.5:0/259823302 >> v2:172.21.15.154:3300/0 conn(0x7fdefc158090 0x7fdefc158510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.680+0000 7fdef3fff640 1 -- 172.21.15.5:0/259823302 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdefc0c3da0 con 0x7fdefc15b9c0 2023-07-14T13:29:17.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.680+0000 7fdefaffd640 1 --2- 172.21.15.5:0/259823302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdefc0cba60 0x7fdefc0c3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:29:17.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.684+0000 7fdef3fff640 1 --2- 172.21.15.5:0/259823302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdefc15b9c0 0x7fdefc0cbe30 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fdefc0c8470 tx=0x7fdee401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625b9391cafdc9b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:17.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.684+0000 7fdefa7fc640 1 -- 172.21.15.5:0/259823302 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee4004230 con 0x7fdefc15b9c0 2023-07-14T13:29:17.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.684+0000 7fdefa7fc640 1 -- 172.21.15.5:0/259823302 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee40a7050 con 0x7fdefc15b9c0 2023-07-14T13:29:17.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.684+0000 7fdefa7fc640 1 -- 172.21.15.5:0/259823302 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee4003620 con 0x7fdefc15b9c0 2023-07-14T13:29:17.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.684+0000 7fdf015c5640 1 -- 172.21.15.5:0/259823302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdefc15b9c0 msgr2=0x7fdefc0cbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:17.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.684+0000 7fdf015c5640 1 --2- 172.21.15.5:0/259823302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdefc15b9c0 0x7fdefc0cbe30 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fdefc0c8470 tx=0x7fdee401c3b0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.684+0000 7fdf015c5640 1 -- 172.21.15.5:0/259823302 shutdown_connections 2023-07-14T13:29:17.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.684+0000 7fdf015c5640 1 --2- 172.21.15.5:0/259823302 >> v2:172.21.15.154:3300/0 conn(0x7fdefc158090 0x7fdefc158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.684+0000 7fdf015c5640 1 --2- 172.21.15.5:0/259823302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdefc15b9c0 0x7fdefc0cbe30 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.684+0000 7fdf015c5640 1 --2- 172.21.15.5:0/259823302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdefc0cba60 0x7fdefc0c3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.684+0000 7fdf015c5640 1 -- 172.21.15.5:0/259823302 >> 172.21.15.5:0/259823302 conn(0x7fdefc0cde90 msgr2=0x7fdefc0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:17.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.684+0000 7fdf015c5640 1 -- 172.21.15.5:0/259823302 shutdown_connections 2023-07-14T13:29:17.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.684+0000 7fdf015c5640 1 -- 172.21.15.5:0/259823302 wait complete. 2023-07-14T13:29:17.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.684+0000 7fdf015c5640 1 Processor -- start 2023-07-14T13:29:17.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.684+0000 7fdf015c5640 1 -- start start 2023-07-14T13:29:17.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.688+0000 7fdf015c5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdefc0cba60 0x7fdefc0b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.688+0000 7fdf015c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdefc158090 0x7fdefc1526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.688+0000 7fdf015c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdefc15b9c0 0x7fdefc152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.688+0000 7fdf015c5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc0b2e00 con 0x7fdefc15b9c0 2023-07-14T13:29:17.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.688+0000 7fdf015c5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc0b2840 con 0x7fdefc158090 2023-07-14T13:29:17.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.688+0000 7fdf015c5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc0b2b20 con 0x7fdefc0cba60 2023-07-14T13:29:17.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.688+0000 7fdefb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdefc15b9c0 0x7fdefc152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:17.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.688+0000 7fdefb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdefc15b9c0 0x7fdefc152c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47098/0 (socket says 172.21.15.5:47098) 2023-07-14T13:29:17.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.688+0000 7fdefb7fe640 1 -- 172.21.15.5:0/45182037 learned_addr learned my addr 172.21.15.5:0/45182037 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:17.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.688+0000 7fdef3fff640 1 --2- 172.21.15.5:0/45182037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdefc158090 0x7fdefc1526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:17.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.688+0000 7fdefaffd640 1 --2- 172.21.15.5:0/45182037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdefc0cba60 0x7fdefc0b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:17.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.688+0000 7fdefb7fe640 1 -- 172.21.15.5:0/45182037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdefc0cba60 msgr2=0x7fdefc0b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:17.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.688+0000 7fdefb7fe640 1 --2- 172.21.15.5:0/45182037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdefc0cba60 0x7fdefc0b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.688+0000 7fdefb7fe640 1 -- 172.21.15.5:0/45182037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdefc158090 msgr2=0x7fdefc1526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:17.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.688+0000 7fdefb7fe640 1 --2- 172.21.15.5:0/45182037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdefc158090 0x7fdefc1526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.688+0000 7fdefb7fe640 1 -- 172.21.15.5:0/45182037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee40094d0 con 0x7fdefc15b9c0 2023-07-14T13:29:17.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.688+0000 7fdefaffd640 1 --2- 172.21.15.5:0/45182037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdefc0cba60 0x7fdefc0b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:29:17.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.688+0000 7fdefb7fe640 1 --2- 172.21.15.5:0/45182037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdefc15b9c0 0x7fdefc152c10 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fdef400cd70 tx=0x7fdef400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:17.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.688+0000 7fdef37fe640 1 -- 172.21.15.5:0/45182037 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef4003ba0 con 0x7fdefc15b9c0 2023-07-14T13:29:17.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.688+0000 7fdef37fe640 1 -- 172.21.15.5:0/45182037 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef4003d00 con 0x7fdefc15b9c0 2023-07-14T13:29:17.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.688+0000 7fdf015c5640 1 -- 172.21.15.5:0/45182037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdefc13eaa0 con 0x7fdefc15b9c0 2023-07-14T13:29:17.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.688+0000 7fdef37fe640 1 -- 172.21.15.5:0/45182037 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef4004240 con 0x7fdefc15b9c0 2023-07-14T13:29:17.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.688+0000 7fdf015c5640 1 -- 172.21.15.5:0/45182037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdefc0b3af0 con 0x7fdefc15b9c0 2023-07-14T13:29:17.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.688+0000 7fdf015c5640 1 -- 172.21.15.5:0/45182037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdefc0714b0 con 0x7fdefc15b9c0 2023-07-14T13:29:17.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.688+0000 7fdef37fe640 1 -- 172.21.15.5:0/45182037 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 81) v1 ==== 85789+0+0 (secure 0 0 0) 0x7fdef40043a0 con 0x7fdefc15b9c0 2023-07-14T13:29:17.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.692+0000 7fdef37fe640 1 --2- 172.21.15.5:0/45182037 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fdedc0663f0 0x7fdedc0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.692+0000 7fdef37fe640 1 -- 172.21.15.5:0/45182037 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6778+0+0 (secure 0 0 0) 0x7fdef4012070 con 0x7fdefc15b9c0 2023-07-14T13:29:17.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.692+0000 7fdefaffd640 1 --2- 172.21.15.5:0/45182037 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fdedc0663f0 0x7fdedc0688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:17.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.692+0000 7fdefaffd640 1 --2- 172.21.15.5:0/45182037 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fdedc0663f0 0x7fdedc0688a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdeec006fd0 tx=0x7fdeec008040 comp rx=0 tx=0).ready entity=mgr.8000 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:17.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.696+0000 7fdef37fe640 1 -- 172.21.15.5:0/45182037 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fdef4051bb0 con 0x7fdefc15b9c0 2023-07-14T13:29:17.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.868+0000 7fdf015c5640 1 -- 172.21.15.5:0/45182037 --> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdefc0b2c90 con 0x7fdedc0663f0 2023-07-14T13:29:17.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.876+0000 7fdef37fe640 1 -- 172.21.15.5:0/45182037 <== mgr.8000 v2:172.21.15.154:6832/1973779483 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+361 (secure 0 0 0) 0x7fdefc0b2c90 con 0x7fdedc0663f0 2023-07-14T13:29:17.884 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:29:17.884 INFO:teuthology.orchestra.run.smithi005.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T13:13:21", "first": "2023-07-14T13:14:00", "last": "2023-07-14T13:29:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-07-14T13:29:17.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.880+0000 7fdf015c5640 1 -- 172.21.15.5:0/45182037 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fdedc0663f0 msgr2=0x7fdedc0688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:17.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.880+0000 7fdf015c5640 1 --2- 172.21.15.5:0/45182037 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fdedc0663f0 0x7fdedc0688a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdeec006fd0 tx=0x7fdeec008040 comp rx=0 tx=0).stop 2023-07-14T13:29:17.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.880+0000 7fdf015c5640 1 -- 172.21.15.5:0/45182037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdefc15b9c0 msgr2=0x7fdefc152c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:17.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.880+0000 7fdf015c5640 1 --2- 172.21.15.5:0/45182037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdefc15b9c0 0x7fdefc152c10 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fdef400cd70 tx=0x7fdef400a660 comp rx=0 tx=0).stop 2023-07-14T13:29:17.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.880+0000 7fdf015c5640 1 -- 172.21.15.5:0/45182037 shutdown_connections 2023-07-14T13:29:17.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.880+0000 7fdf015c5640 1 --2- 172.21.15.5:0/45182037 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fdedc0663f0 0x7fdedc0688a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.880+0000 7fdf015c5640 1 --2- 172.21.15.5:0/45182037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdefc15b9c0 0x7fdefc152c10 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.880+0000 7fdf015c5640 1 --2- 172.21.15.5:0/45182037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdefc158090 0x7fdefc1526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.880+0000 7fdf015c5640 1 --2- 172.21.15.5:0/45182037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdefc0cba60 0x7fdefc0b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.880+0000 7fdf015c5640 1 -- 172.21.15.5:0/45182037 >> 172.21.15.5:0/45182037 conn(0x7fdefc0cde90 msgr2=0x7fdefc15af30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:17.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.880+0000 7fdf015c5640 1 -- 172.21.15.5:0/45182037 shutdown_connections 2023-07-14T13:29:17.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:17.880+0000 7fdf015c5640 1 -- 172.21.15.5:0/45182037 wait complete. 2023-07-14T13:29:17.905 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T13:13:21", "first": "2023-07-14T13:14:00", "last": "2023-07-14T13:29:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-07-14T13:29:17.905 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-07-14T00:00:00', 'created': '2023-07-14T13:13:21', 'first': '2023-07-14T13:14:00', 'last': '2023-07-14T13:29:00', 'last_pruned': None, 'created_count': 16, 'pruned_count': 0, 'active': False} 2023-07-14T13:29:17.905 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/test_restart 1M 2023-07-14T13:29:18.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.048+0000 7fbfba996640 1 Processor -- start 2023-07-14T13:29:18.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.048+0000 7fbfba996640 1 -- start start 2023-07-14T13:29:18.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.052+0000 7fbfba996640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfb406a440 0x7fbfb40b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:18.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.052+0000 7fbfba996640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb406c040 con 0x7fbfb41453a0 2023-07-14T13:29:18.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.052+0000 7fbfba996640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb4160600 con 0x7fbfb415f690 2023-07-14T13:29:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.052+0000 7fbfba996640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb4160170 con 0x7fbfb406a440 2023-07-14T13:29:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.052+0000 7fbfb8f33640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbfb41453a0 0x7fbfb406c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58488/0 (socket says 172.21.15.5:58488) 2023-07-14T13:29:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.052+0000 7fbfb37fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfb406a440 0x7fbfb40b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.052+0000 7fbfb8f33640 1 -- 172.21.15.5:0/2412254003 learned_addr learned my addr 172.21.15.5:0/2412254003 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.052+0000 7fbfb3fff640 1 --1- 172.21.15.5:0/2412254003 >> v1:172.21.15.154:6789/0 conn(0x7fbfb415f690 0x7fbfb415fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:46500/0 (socket says 172.21.15.5:46500) 2023-07-14T13:29:18.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.052+0000 7fbfb2ffd640 1 -- 172.21.15.5:0/2412254003 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3476252303 0 0) 0x7fbfb4160600 con 0x7fbfb415f690 2023-07-14T13:29:18.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.052+0000 7fbfb2ffd640 1 -- 172.21.15.5:0/2412254003 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf9c003530 con 0x7fbfb415f690 2023-07-14T13:29:18.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.052+0000 7fbfb2ffd640 1 -- 172.21.15.5:0/2412254003 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2745624706 0 0) 0x7fbfb406c040 con 0x7fbfb41453a0 2023-07-14T13:29:18.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.052+0000 7fbfb37fe640 1 -- 172.21.15.5:0/2412254003 >> v1:172.21.15.154:6789/0 conn(0x7fbfb415f690 legacy=0x7fbfb415fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:18.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.052+0000 7fbfb37fe640 1 -- 172.21.15.5:0/2412254003 >> v1:172.21.15.5:6789/0 conn(0x7fbfb41453a0 legacy=0x7fbfb406c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:18.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.052+0000 7fbfb37fe640 1 -- 172.21.15.5:0/2412254003 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb4160360 con 0x7fbfb406a440 2023-07-14T13:29:18.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.056+0000 7fbfb37fe640 1 --2- 172.21.15.5:0/2412254003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfb406a440 0x7fbfb40b1890 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbfa80097f0 tx=0x7fbfa801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d3a33a73b4411bd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:18.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.056+0000 7fbfb2ffd640 1 -- 172.21.15.5:0/2412254003 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa80ab600 con 0x7fbfb406a440 2023-07-14T13:29:18.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.056+0000 7fbfb2ffd640 1 -- 172.21.15.5:0/2412254003 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa80ab760 con 0x7fbfb406a440 2023-07-14T13:29:18.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.056+0000 7fbfb2ffd640 1 -- 172.21.15.5:0/2412254003 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa80abaf0 con 0x7fbfb406a440 2023-07-14T13:29:18.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.056+0000 7fbfba996640 1 -- 172.21.15.5:0/2412254003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfb406a440 msgr2=0x7fbfb40b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:18.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.056+0000 7fbfba996640 1 --2- 172.21.15.5:0/2412254003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfb406a440 0x7fbfb40b1890 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbfa80097f0 tx=0x7fbfa801c400 comp rx=0 tx=0).stop 2023-07-14T13:29:18.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.056+0000 7fbfba996640 1 -- 172.21.15.5:0/2412254003 shutdown_connections 2023-07-14T13:29:18.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.056+0000 7fbfba996640 1 --2- 172.21.15.5:0/2412254003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfb406a440 0x7fbfb40b1890 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:18.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.056+0000 7fbfba996640 1 -- 172.21.15.5:0/2412254003 >> 172.21.15.5:0/2412254003 conn(0x7fbfb40b1210 msgr2=0x7fbfb40ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:18.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.056+0000 7fbfba996640 1 -- 172.21.15.5:0/2412254003 shutdown_connections 2023-07-14T13:29:18.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.056+0000 7fbfba996640 1 -- 172.21.15.5:0/2412254003 wait complete. 2023-07-14T13:29:18.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.056+0000 7fbfba996640 1 Processor -- start 2023-07-14T13:29:18.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.056+0000 7fbfba996640 1 -- start start 2023-07-14T13:29:18.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.060+0000 7fbfba996640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfb406a440 0x7fbfb415c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:18.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.060+0000 7fbfba996640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfb41453a0 0x7fbfb41fb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:18.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.060+0000 7fbfba996640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfb415f690 0x7fbfb40cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:18.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.060+0000 7fbfba996640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb415ec70 con 0x7fbfb415f690 2023-07-14T13:29:18.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.060+0000 7fbfba996640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb415c740 con 0x7fbfb41453a0 2023-07-14T13:29:18.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.060+0000 7fbfba996640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb415e060 con 0x7fbfb406a440 2023-07-14T13:29:18.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.060+0000 7fbfb8f33640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfb415f690 0x7fbfb40cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:18.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.060+0000 7fbfb8f33640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfb415f690 0x7fbfb40cc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47114/0 (socket says 172.21.15.5:47114) 2023-07-14T13:29:18.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.060+0000 7fbfb8f33640 1 -- 172.21.15.5:0/3477724617 learned_addr learned my addr 172.21.15.5:0/3477724617 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:18.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.060+0000 7fbfb3fff640 1 --2- 172.21.15.5:0/3477724617 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfb406a440 0x7fbfb415c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:18.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.060+0000 7fbfb37fe640 1 --2- 172.21.15.5:0/3477724617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfb41453a0 0x7fbfb41fb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:18.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.060+0000 7fbfb8f33640 1 -- 172.21.15.5:0/3477724617 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfb406a440 msgr2=0x7fbfb415c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:18.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.060+0000 7fbfb8f33640 1 --2- 172.21.15.5:0/3477724617 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfb406a440 0x7fbfb415c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:18.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.060+0000 7fbfb8f33640 1 -- 172.21.15.5:0/3477724617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfb41453a0 msgr2=0x7fbfb41fb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:18.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.060+0000 7fbfb8f33640 1 --2- 172.21.15.5:0/3477724617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfb41453a0 0x7fbfb41fb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:18.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.060+0000 7fbfb8f33640 1 -- 172.21.15.5:0/3477724617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa8009420 con 0x7fbfb415f690 2023-07-14T13:29:18.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.060+0000 7fbfb8f33640 1 --2- 172.21.15.5:0/3477724617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfb415f690 0x7fbfb40cc010 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fbfac00c750 tx=0x7fbfac00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:18.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.060+0000 7fbfb0ff9640 1 -- 172.21.15.5:0/3477724617 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac00ce60 con 0x7fbfb415f690 2023-07-14T13:29:18.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.060+0000 7fbfb0ff9640 1 -- 172.21.15.5:0/3477724617 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfac00a640 con 0x7fbfb415f690 2023-07-14T13:29:18.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.060+0000 7fbfb0ff9640 1 -- 172.21.15.5:0/3477724617 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac00aa30 con 0x7fbfb415f690 2023-07-14T13:29:18.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.060+0000 7fbfba996640 1 -- 172.21.15.5:0/3477724617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb415e340 con 0x7fbfb415f690 2023-07-14T13:29:18.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.060+0000 7fbfba996640 1 -- 172.21.15.5:0/3477724617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb415e900 con 0x7fbfb415f690 2023-07-14T13:29:18.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.060+0000 7fbfba996640 1 -- 172.21.15.5:0/3477724617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb415ede0 con 0x7fbfb415f690 2023-07-14T13:29:18.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.060+0000 7fbfb0ff9640 1 -- 172.21.15.5:0/3477724617 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 81) v1 ==== 85789+0+0 (secure 0 0 0) 0x7fbfac00ab90 con 0x7fbfb415f690 2023-07-14T13:29:18.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.064+0000 7fbfb0ff9640 1 --2- 172.21.15.5:0/3477724617 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fbfa00663f0 0x7fbfa00688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:18.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.064+0000 7fbfb0ff9640 1 -- 172.21.15.5:0/3477724617 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6778+0+0 (secure 0 0 0) 0x7fbfac083640 con 0x7fbfb415f690 2023-07-14T13:29:18.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.064+0000 7fbfb3fff640 1 --2- 172.21.15.5:0/3477724617 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fbfa00663f0 0x7fbfa00688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:18.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.064+0000 7fbfb3fff640 1 --2- 172.21.15.5:0/3477724617 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fbfa00663f0 0x7fbfa00688a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbfa40011f0 tx=0x7fbfa4007d40 comp rx=0 tx=0).ready entity=mgr.8000 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:18.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.068+0000 7fbfb0ff9640 1 -- 172.21.15.5:0/3477724617 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fbfac050790 con 0x7fbfb415f690 2023-07-14T13:29:18.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.244+0000 7fbfba996640 1 -- 172.21.15.5:0/3477724617 --> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbfb406ad80 con 0x7fbfa00663f0 2023-07-14T13:29:18.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.316+0000 7fbfb0ff9640 1 -- 172.21.15.5:0/3477724617 <== mgr.8000 v2:172.21.15.154:6832/1973779483 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+55 (secure 0 0 0) 0x7fbfa4007300 con 0x7fbfa00663f0 2023-07-14T13:29:18.323 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule removed for path /snap_test_dir1/test_restart 2023-07-14T13:29:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.320+0000 7fbfba996640 1 -- 172.21.15.5:0/3477724617 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fbfa00663f0 msgr2=0x7fbfa00688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.320+0000 7fbfba996640 1 --2- 172.21.15.5:0/3477724617 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fbfa00663f0 0x7fbfa00688a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbfa40011f0 tx=0x7fbfa4007d40 comp rx=0 tx=0).stop 2023-07-14T13:29:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.320+0000 7fbfba996640 1 -- 172.21.15.5:0/3477724617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfb415f690 msgr2=0x7fbfb40cc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.320+0000 7fbfba996640 1 --2- 172.21.15.5:0/3477724617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfb415f690 0x7fbfb40cc010 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fbfac00c750 tx=0x7fbfac00cc10 comp rx=0 tx=0).stop 2023-07-14T13:29:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.320+0000 7fbfba996640 1 -- 172.21.15.5:0/3477724617 shutdown_connections 2023-07-14T13:29:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.320+0000 7fbfba996640 1 --2- 172.21.15.5:0/3477724617 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fbfa00663f0 0x7fbfa00688a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.320+0000 7fbfba996640 1 --2- 172.21.15.5:0/3477724617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfb415f690 0x7fbfb40cc010 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.320+0000 7fbfba996640 1 --2- 172.21.15.5:0/3477724617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfb41453a0 0x7fbfb41fb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.320+0000 7fbfba996640 1 --2- 172.21.15.5:0/3477724617 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfb406a440 0x7fbfb415c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.320+0000 7fbfba996640 1 -- 172.21.15.5:0/3477724617 >> 172.21.15.5:0/3477724617 conn(0x7fbfb40b1210 msgr2=0x7fbfb40b2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.320+0000 7fbfba996640 1 -- 172.21.15.5:0/3477724617 shutdown_connections 2023-07-14T13:29:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:18.320+0000 7fbfba996640 1 -- 172.21.15.5:0/3477724617 wait complete. 2023-07-14T13:29:18.344 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/test_restart 2023-07-14T13:29:18.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:18.345 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-07-14T13:29:18.355 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_14_00_UTC 2023-07-14T13:29:18.355 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_15_00_UTC 2023-07-14T13:29:18.355 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_16_00_UTC 2023-07-14T13:29:18.355 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_17_00_UTC 2023-07-14T13:29:18.356 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_18_00_UTC 2023-07-14T13:29:18.356 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_19_00_UTC 2023-07-14T13:29:18.356 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_20_00_UTC 2023-07-14T13:29:18.356 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_21_00_UTC 2023-07-14T13:29:18.356 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_22_00_UTC 2023-07-14T13:29:18.356 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_23_00_UTC 2023-07-14T13:29:18.357 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_24_00_UTC 2023-07-14T13:29:18.357 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_25_00_UTC 2023-07-14T13:29:18.357 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_26_00_UTC 2023-07-14T13:29:18.357 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_27_00_UTC 2023-07-14T13:29:18.357 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_28_00_UTC 2023-07-14T13:29:18.357 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_29_00_UTC 2023-07-14T13:29:18.358 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_14_00_UTC 2023-07-14T13:29:18.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:18.359 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_14_00_UTC) 2023-07-14T13:29:18.415 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_15_00_UTC 2023-07-14T13:29:18.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:18.416 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_15_00_UTC) 2023-07-14T13:29:18.470 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_16_00_UTC 2023-07-14T13:29:18.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:18.471 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_16_00_UTC) 2023-07-14T13:29:18.526 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_17_00_UTC 2023-07-14T13:29:18.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:18.527 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_17_00_UTC) 2023-07-14T13:29:18.582 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_18_00_UTC 2023-07-14T13:29:18.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:18.583 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_18_00_UTC) 2023-07-14T13:29:18.638 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_19_00_UTC 2023-07-14T13:29:18.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:18.639 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_19_00_UTC) 2023-07-14T13:29:18.698 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_20_00_UTC 2023-07-14T13:29:18.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:18.699 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_20_00_UTC) 2023-07-14T13:29:18.760 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_21_00_UTC 2023-07-14T13:29:18.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:18.761 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_21_00_UTC) 2023-07-14T13:29:18.814 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_22_00_UTC 2023-07-14T13:29:18.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:18.815 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_22_00_UTC) 2023-07-14T13:29:18.875 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_23_00_UTC 2023-07-14T13:29:18.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:18.875 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_23_00_UTC) 2023-07-14T13:29:18.935 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_24_00_UTC 2023-07-14T13:29:18.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:18.936 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_24_00_UTC) 2023-07-14T13:29:18.991 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_25_00_UTC 2023-07-14T13:29:18.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:18.992 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_25_00_UTC) 2023-07-14T13:29:19.046 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_26_00_UTC 2023-07-14T13:29:19.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:19.047 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_26_00_UTC) 2023-07-14T13:29:19.103 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_27_00_UTC 2023-07-14T13:29:19.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:19.104 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_27_00_UTC) 2023-07-14T13:29:19.159 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_28_00_UTC 2023-07-14T13:29:19.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:19.160 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_28_00_UTC) 2023-07-14T13:29:19.215 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_29_00_UTC 2023-07-14T13:29:19.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:19.216 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-14-13_29_00_UTC) 2023-07-14T13:29:19.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:19.271 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart) 2023-07-14T13:29:19.324 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-14T13:29:19.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.512+0000 7f0f90848640 1 Processor -- start 2023-07-14T13:29:19.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.512+0000 7f0f90848640 1 -- start start 2023-07-14T13:29:19.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.512+0000 7f0f90848640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f8c06d0f0 0x7f0f8c0ac1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:19.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.512+0000 7f0f90848640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0f8c0ca910 0x7f0f8c0cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:19.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.512+0000 7f0f90848640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f8c0cb2a0 con 0x7f0f8c15be20 2023-07-14T13:29:19.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.512+0000 7f0f90848640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f8c0abd20 con 0x7f0f8c0ca910 2023-07-14T13:29:19.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.512+0000 7f0f90848640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c06d540 con 0x7f0f8c06d0f0 2023-07-14T13:29:19.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.512+0000 7f0f83fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f8c06d0f0 0x7f0f8c0ac1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:19.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.512+0000 7f0f8ad9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0f8c0ca910 0x7f0f8c0cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:19.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.512+0000 7f0f8a59c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0f8c15be20 0x7f0f8c15cca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:59350/0 (socket says 172.21.15.5:59350) 2023-07-14T13:29:19.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.512+0000 7f0f8a59c640 1 -- 172.21.15.5:0/2565585889 learned_addr learned my addr 172.21.15.5:0/2565585889 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:19.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.512+0000 7f0f89d9b640 1 -- 172.21.15.5:0/2565585889 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684806923 0 0) 0x7f0f7c001120 con 0x7f0f8c15be20 2023-07-14T13:29:19.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.512+0000 7f0f89d9b640 1 -- 172.21.15.5:0/2565585889 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f78003530 con 0x7f0f8c15be20 2023-07-14T13:29:19.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.512+0000 7f0f83fff640 1 -- 172.21.15.5:0/2565585889 >> v2:172.21.15.154:3300/0 conn(0x7f0f8c0ca910 msgr2=0x7f0f8c0cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:19.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.512+0000 7f0f83fff640 1 --2- 172.21.15.5:0/2565585889 >> v2:172.21.15.154:3300/0 conn(0x7f0f8c0ca910 0x7f0f8c0cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:19.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.512+0000 7f0f83fff640 1 -- 172.21.15.5:0/2565585889 >> v1:172.21.15.154:6789/0 conn(0x7f0f8c15be20 legacy=0x7f0f8c15cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:19.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.512+0000 7f0f83fff640 1 -- 172.21.15.5:0/2565585889 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8c06ba80 con 0x7f0f8c06d0f0 2023-07-14T13:29:19.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.516+0000 7f0f83fff640 1 --2- 172.21.15.5:0/2565585889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f8c06d0f0 0x7f0f8c0ac1b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0f740097c0 tx=0x7f0f7401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52d147fb8855dcbf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:19.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.516+0000 7f0f89d9b640 1 -- 172.21.15.5:0/2565585889 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f740ac620 con 0x7f0f8c06d0f0 2023-07-14T13:29:19.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.516+0000 7f0f89d9b640 1 -- 172.21.15.5:0/2565585889 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f740ac780 con 0x7f0f8c06d0f0 2023-07-14T13:29:19.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.516+0000 7f0f89d9b640 1 -- 172.21.15.5:0/2565585889 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f740acb10 con 0x7f0f8c06d0f0 2023-07-14T13:29:19.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.516+0000 7f0f90848640 1 -- 172.21.15.5:0/2565585889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f8c06d0f0 msgr2=0x7f0f8c0ac1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:19.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.516+0000 7f0f90848640 1 --2- 172.21.15.5:0/2565585889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f8c06d0f0 0x7f0f8c0ac1b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0f740097c0 tx=0x7f0f7401c3c0 comp rx=0 tx=0).stop 2023-07-14T13:29:19.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.516+0000 7f0f90848640 1 -- 172.21.15.5:0/2565585889 shutdown_connections 2023-07-14T13:29:19.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.516+0000 7f0f90848640 1 --2- 172.21.15.5:0/2565585889 >> v2:172.21.15.154:3300/0 conn(0x7f0f8c0ca910 0x7f0f8c0cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:19.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.516+0000 7f0f90848640 1 --2- 172.21.15.5:0/2565585889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f8c06d0f0 0x7f0f8c0ac1b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:19.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.516+0000 7f0f90848640 1 -- 172.21.15.5:0/2565585889 >> 172.21.15.5:0/2565585889 conn(0x7f0f8c0afac0 msgr2=0x7f0f8c0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:19.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.516+0000 7f0f90848640 1 -- 172.21.15.5:0/2565585889 shutdown_connections 2023-07-14T13:29:19.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.516+0000 7f0f90848640 1 -- 172.21.15.5:0/2565585889 wait complete. 2023-07-14T13:29:19.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.520+0000 7f0f90848640 1 Processor -- start 2023-07-14T13:29:19.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.520+0000 7f0f90848640 1 -- start start 2023-07-14T13:29:19.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.520+0000 7f0f90848640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f8c06d0f0 0x7f0f8c1522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:19.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.520+0000 7f0f90848640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f8c0ca910 0x7f0f8c15e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:19.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.520+0000 7f0f90848640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f8c15be20 0x7f0f8c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:19.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.520+0000 7f0f90848640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c14c930 con 0x7f0f8c15be20 2023-07-14T13:29:19.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.520+0000 7f0f90848640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c14cc10 con 0x7f0f8c0ca910 2023-07-14T13:29:19.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.520+0000 7f0f90848640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c1527f0 con 0x7f0f8c06d0f0 2023-07-14T13:29:19.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.520+0000 7f0f8ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f8c15be20 0x7f0f8c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:19.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.520+0000 7f0f8ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f8c15be20 0x7f0f8c0b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48602/0 (socket says 172.21.15.5:48602) 2023-07-14T13:29:19.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.520+0000 7f0f8ad9d640 1 -- 172.21.15.5:0/1596103960 learned_addr learned my addr 172.21.15.5:0/1596103960 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:19.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.520+0000 7f0f8a59c640 1 --2- 172.21.15.5:0/1596103960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f8c06d0f0 0x7f0f8c1522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:19.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.520+0000 7f0f83fff640 1 --2- 172.21.15.5:0/1596103960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f8c0ca910 0x7f0f8c15e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:19.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.520+0000 7f0f8ad9d640 1 -- 172.21.15.5:0/1596103960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f8c06d0f0 msgr2=0x7f0f8c1522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:19.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.520+0000 7f0f8ad9d640 1 --2- 172.21.15.5:0/1596103960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f8c06d0f0 0x7f0f8c1522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:19.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.520+0000 7f0f8ad9d640 1 -- 172.21.15.5:0/1596103960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f8c0ca910 msgr2=0x7f0f8c15e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:19.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.520+0000 7f0f8ad9d640 1 --2- 172.21.15.5:0/1596103960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f8c0ca910 0x7f0f8c15e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:19.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.520+0000 7f0f8ad9d640 1 -- 172.21.15.5:0/1596103960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f74009420 con 0x7f0f8c15be20 2023-07-14T13:29:19.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.520+0000 7f0f8ad9d640 1 --2- 172.21.15.5:0/1596103960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f8c15be20 0x7f0f8c0b2270 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400efc0 tx=0x7f0f8400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:19.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.520+0000 7f0f82ffd640 1 -- 172.21.15.5:0/1596103960 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f84009ba0 con 0x7f0f8c15be20 2023-07-14T13:29:19.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.520+0000 7f0f82ffd640 1 -- 172.21.15.5:0/1596103960 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8400f040 con 0x7f0f8c15be20 2023-07-14T13:29:19.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.520+0000 7f0f82ffd640 1 -- 172.21.15.5:0/1596103960 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f840146c0 con 0x7f0f8c15be20 2023-07-14T13:29:19.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.520+0000 7f0f90848640 1 -- 172.21.15.5:0/1596103960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f8c0ac870 con 0x7f0f8c15be20 2023-07-14T13:29:19.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.520+0000 7f0f90848640 1 -- 172.21.15.5:0/1596103960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f8c0ce820 con 0x7f0f8c15be20 2023-07-14T13:29:19.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.524+0000 7f0f90848640 1 -- 172.21.15.5:0/1596103960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f8c14cd80 con 0x7f0f8c15be20 2023-07-14T13:29:19.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.524+0000 7f0f82ffd640 1 -- 172.21.15.5:0/1596103960 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 81) v1 ==== 85789+0+0 (secure 0 0 0) 0x7f0f84014820 con 0x7f0f8c15be20 2023-07-14T13:29:19.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.524+0000 7f0f82ffd640 1 --2- 172.21.15.5:0/1596103960 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f0f6c0663f0 0x7f0f6c0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:19.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.524+0000 7f0f82ffd640 1 -- 172.21.15.5:0/1596103960 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6778+0+0 (secure 0 0 0) 0x7f0f84084ce0 con 0x7f0f8c15be20 2023-07-14T13:29:19.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.524+0000 7f0f8a59c640 1 --2- 172.21.15.5:0/1596103960 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f0f6c0663f0 0x7f0f6c0688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:19.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.528+0000 7f0f8a59c640 1 --2- 172.21.15.5:0/1596103960 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f0f6c0663f0 0x7f0f6c0688a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c005890 tx=0x7f0f7c009040 comp rx=0 tx=0).ready entity=mgr.8000 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:19.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.528+0000 7f0f82ffd640 1 -- 172.21.15.5:0/1596103960 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f0f84051d20 con 0x7f0f8c15be20 2023-07-14T13:29:19.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:19.720+0000 7f0f90848640 1 -- 172.21.15.5:0/1596103960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f0f8c0678d0 con 0x7f0f8c15be20 2023-07-14T13:29:20.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.156+0000 7f0f82ffd640 1 -- 172.21.15.5:0/1596103960 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 82) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f0f84082dd0 con 0x7f0f8c15be20 2023-07-14T13:29:20.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.160+0000 7f0f82ffd640 1 -- 172.21.15.5:0/1596103960 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v82) v1 ==== 93+0+0 (secure 0 0 0) 0x7f0f84051d20 con 0x7f0f8c15be20 2023-07-14T13:29:20.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.160+0000 7f0f90848640 1 -- 172.21.15.5:0/1596103960 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f0f6c0663f0 msgr2=0x7f0f6c0688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:20.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.160+0000 7f0f90848640 1 --2- 172.21.15.5:0/1596103960 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f0f6c0663f0 0x7f0f6c0688a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c005890 tx=0x7f0f7c009040 comp rx=0 tx=0).stop 2023-07-14T13:29:20.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.160+0000 7f0f90848640 1 -- 172.21.15.5:0/1596103960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f8c15be20 msgr2=0x7f0f8c0b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:20.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.160+0000 7f0f90848640 1 --2- 172.21.15.5:0/1596103960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f8c15be20 0x7f0f8c0b2270 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400efc0 tx=0x7f0f8400c490 comp rx=0 tx=0).stop 2023-07-14T13:29:20.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.160+0000 7f0f90848640 1 -- 172.21.15.5:0/1596103960 shutdown_connections 2023-07-14T13:29:20.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.160+0000 7f0f90848640 1 --2- 172.21.15.5:0/1596103960 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f0f6c0663f0 0x7f0f6c0688a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:20.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.160+0000 7f0f90848640 1 --2- 172.21.15.5:0/1596103960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f8c15be20 0x7f0f8c0b2270 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:20.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.160+0000 7f0f90848640 1 --2- 172.21.15.5:0/1596103960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f8c0ca910 0x7f0f8c15e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:20.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.160+0000 7f0f90848640 1 --2- 172.21.15.5:0/1596103960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f8c06d0f0 0x7f0f8c1522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:20.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.160+0000 7f0f90848640 1 -- 172.21.15.5:0/1596103960 >> 172.21.15.5:0/1596103960 conn(0x7f0f8c0afac0 msgr2=0x7f0f8c15ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:20.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.160+0000 7f0f90848640 1 -- 172.21.15.5:0/1596103960 shutdown_connections 2023-07-14T13:29:20.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.160+0000 7f0f90848640 1 -- 172.21.15.5:0/1596103960 wait complete. 2023-07-14T13:29:20.190 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T13:29:20.191 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:29:20.251 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:29:20.307 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T13:29:20.308 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:29:20.309 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:29:20.319 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:29:20.319 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:29:20.348 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:29:20.340+0000 7fa84a82c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:29:20.351 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:20.349+0000 7fe9fbf48180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:29:20.356 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:29:20.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.540+0000 7f31f25fa640 1 Processor -- start 2023-07-14T13:29:20.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.540+0000 7f31f25fa640 1 -- start start 2023-07-14T13:29:20.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.540+0000 7f31f25fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31ec06b1e0 0x7f31ec0c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:20.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.540+0000 7f31f25fa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f31ec0c21f0 0x7f31ec0cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:20.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.540+0000 7f31f25fa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31ec0cac70 con 0x7f31ec070b70 2023-07-14T13:29:20.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.540+0000 7f31f25fa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ec0ca060 con 0x7f31ec0c21f0 2023-07-14T13:29:20.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.540+0000 7f31f25fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec0ca340 con 0x7f31ec06b1e0 2023-07-14T13:29:20.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.540+0000 7f31f0b97640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f31ec0c21f0 0x7f31ec0cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:20.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.540+0000 7f31ebfff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f31ec070b70 0x7f31ec070f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:59362/0 (socket says 172.21.15.5:59362) 2023-07-14T13:29:20.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.540+0000 7f31f0b97640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f31ec0c21f0 0x7f31ec0cb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:48974/0 (socket says 172.21.15.5:48974) 2023-07-14T13:29:20.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.540+0000 7f31f0b97640 1 -- 172.21.15.5:0/554882453 learned_addr learned my addr 172.21.15.5:0/554882453 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:20.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.540+0000 7f31eb7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31ec06b1e0 0x7f31ec0c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:20.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.540+0000 7f31eaffd640 1 -- 172.21.15.5:0/554882453 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586623224 0 0) 0x7f31ec0cac70 con 0x7f31ec070b70 2023-07-14T13:29:20.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.540+0000 7f31eaffd640 1 -- 172.21.15.5:0/554882453 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31d4003530 con 0x7f31ec070b70 2023-07-14T13:29:20.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.540+0000 7f31f0b97640 1 -- 172.21.15.5:0/554882453 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31ec06b1e0 msgr2=0x7f31ec0c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:20.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.540+0000 7f31f0b97640 1 --2- 172.21.15.5:0/554882453 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31ec06b1e0 0x7f31ec0c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:20.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.540+0000 7f31f0b97640 1 -- 172.21.15.5:0/554882453 >> v1:172.21.15.154:6789/0 conn(0x7f31ec070b70 legacy=0x7f31ec070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:20.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.540+0000 7f31f0b97640 1 -- 172.21.15.5:0/554882453 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ec0ca620 con 0x7f31ec0c21f0 2023-07-14T13:29:20.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.544+0000 7f31f0b97640 1 --2- 172.21.15.5:0/554882453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31ec0c21f0 0x7f31ec0cb100 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f31e4009e50 tx=0x7f31e401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa725673e74e2c90 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:20.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.544+0000 7f31eaffd640 1 -- 172.21.15.5:0/554882453 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e40a5830 con 0x7f31ec0c21f0 2023-07-14T13:29:20.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.544+0000 7f31eaffd640 1 -- 172.21.15.5:0/554882453 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e40a5990 con 0x7f31ec0c21f0 2023-07-14T13:29:20.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.544+0000 7f31eaffd640 1 -- 172.21.15.5:0/554882453 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e40a5d20 con 0x7f31ec0c21f0 2023-07-14T13:29:20.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.544+0000 7f31f25fa640 1 -- 172.21.15.5:0/554882453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31ec0c21f0 msgr2=0x7f31ec0cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:20.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.544+0000 7f31f25fa640 1 --2- 172.21.15.5:0/554882453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31ec0c21f0 0x7f31ec0cb100 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f31e4009e50 tx=0x7f31e401c950 comp rx=0 tx=0).stop 2023-07-14T13:29:20.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.544+0000 7f31f25fa640 1 -- 172.21.15.5:0/554882453 shutdown_connections 2023-07-14T13:29:20.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.544+0000 7f31f25fa640 1 --2- 172.21.15.5:0/554882453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31ec0c21f0 0x7f31ec0cb100 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:20.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.544+0000 7f31f25fa640 1 --2- 172.21.15.5:0/554882453 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31ec06b1e0 0x7f31ec0c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:20.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.544+0000 7f31f25fa640 1 -- 172.21.15.5:0/554882453 >> 172.21.15.5:0/554882453 conn(0x7f31ec0afcf0 msgr2=0x7f31ec0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:20.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.544+0000 7f31f25fa640 1 -- 172.21.15.5:0/554882453 shutdown_connections 2023-07-14T13:29:20.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.544+0000 7f31f25fa640 1 -- 172.21.15.5:0/554882453 wait complete. 2023-07-14T13:29:20.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.548+0000 7f31f25fa640 1 Processor -- start 2023-07-14T13:29:20.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.548+0000 7f31f25fa640 1 -- start start 2023-07-14T13:29:20.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.548+0000 7f31f25fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31ec06b1e0 0x7f31ec1f43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:20.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.548+0000 7f31f25fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31ec070b70 0x7f31ec158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:20.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.548+0000 7f31f25fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31ec0c21f0 0x7f31ec0cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:20.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.548+0000 7f31f25fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec158e50 con 0x7f31ec070b70 2023-07-14T13:29:20.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.548+0000 7f31f25fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec1f88a0 con 0x7f31ec0c21f0 2023-07-14T13:29:20.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.548+0000 7f31f25fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec1f79b0 con 0x7f31ec06b1e0 2023-07-14T13:29:20.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.548+0000 7f31ebfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31ec06b1e0 0x7f31ec1f43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:20.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.548+0000 7f31eb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31ec070b70 0x7f31ec158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:20.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.548+0000 7f31ebfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31ec06b1e0 0x7f31ec1f43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:36664/0 (socket says 172.21.15.5:36664) 2023-07-14T13:29:20.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.548+0000 7f31ebfff640 1 -- 172.21.15.5:0/2508743529 learned_addr learned my addr 172.21.15.5:0/2508743529 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:20.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.548+0000 7f31f0b97640 1 --2- 172.21.15.5:0/2508743529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31ec0c21f0 0x7f31ec0cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:20.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.548+0000 7f31ebfff640 1 -- 172.21.15.5:0/2508743529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31ec0c21f0 msgr2=0x7f31ec0cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:20.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.548+0000 7f31ebfff640 1 --2- 172.21.15.5:0/2508743529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31ec0c21f0 0x7f31ec0cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:20.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.548+0000 7f31ebfff640 1 -- 172.21.15.5:0/2508743529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31ec070b70 msgr2=0x7f31ec158910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:20.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.548+0000 7f31ebfff640 1 --2- 172.21.15.5:0/2508743529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31ec070b70 0x7f31ec158910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:20.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.548+0000 7f31ebfff640 1 -- 172.21.15.5:0/2508743529 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e4009b30 con 0x7f31ec06b1e0 2023-07-14T13:29:20.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.548+0000 7f31ebfff640 1 --2- 172.21.15.5:0/2508743529 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31ec06b1e0 0x7f31ec1f43f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f31dc00c500 tx=0x7f31dc00c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:20.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.552+0000 7f31e8ff9640 1 -- 172.21.15.5:0/2508743529 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31dc007500 con 0x7f31ec06b1e0 2023-07-14T13:29:20.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.552+0000 7f31e8ff9640 1 -- 172.21.15.5:0/2508743529 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31dc007660 con 0x7f31ec06b1e0 2023-07-14T13:29:20.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.552+0000 7f31e8ff9640 1 -- 172.21.15.5:0/2508743529 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31dc004a30 con 0x7f31ec06b1e0 2023-07-14T13:29:20.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.552+0000 7f31f25fa640 1 -- 172.21.15.5:0/2508743529 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31ec1f7c90 con 0x7f31ec06b1e0 2023-07-14T13:29:20.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.552+0000 7f31f25fa640 1 -- 172.21.15.5:0/2508743529 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31ec1f8250 con 0x7f31ec06b1e0 2023-07-14T13:29:20.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.552+0000 7f31f25fa640 1 -- 172.21.15.5:0/2508743529 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31ec0678d0 con 0x7f31ec06b1e0 2023-07-14T13:29:20.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.552+0000 7f31e8ff9640 1 -- 172.21.15.5:0/2508743529 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 82) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f31dc004b90 con 0x7f31ec06b1e0 2023-07-14T13:29:20.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.552+0000 7f31e8ff9640 1 --2- 172.21.15.5:0/2508743529 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f31d80663a0 0x7f31d8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:20.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.552+0000 7f31e8ff9640 1 -- 172.21.15.5:0/2508743529 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6778+0+0 (secure 0 0 0) 0x7f31dc083290 con 0x7f31ec06b1e0 2023-07-14T13:29:20.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.552+0000 7f31eb7fe640 1 -- 172.21.15.5:0/2508743529 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f31d80663a0 msgr2=0x7f31d8068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1973779483 2023-07-14T13:29:20.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.552+0000 7f31eb7fe640 1 --2- 172.21.15.5:0/2508743529 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f31d80663a0 0x7f31d8068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:29:20.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.556+0000 7f31e8ff9640 1 -- 172.21.15.5:0/2508743529 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f31dc050470 con 0x7f31ec06b1e0 2023-07-14T13:29:20.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.716+0000 7f31f25fa640 1 -- 172.21.15.5:0/2508743529 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31ec0cb170 con 0x7f31ec06b1e0 2023-07-14T13:29:20.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.716+0000 7f31e8ff9640 1 -- 172.21.15.5:0/2508743529 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+19320 (secure 0 0 0) 0x7f31dc053a90 con 0x7f31ec06b1e0 2023-07-14T13:29:20.724 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:29:20.724 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":158,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:24:20.729744+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:13:01.372511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-14T13:13:02.236215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/3205049834":"2023-07-15T13:24:20.729701+0000","172.21.15.154:0/2448917971":"2023-07-15T13:24:20.729701+0000","172.21.15.154:0/3347209674":"2023-07-15T13:24:20.729701+0000","172.21.15.154:0/2602756791":"2023-07-15T13:24:20.729701+0000","172.21.15.154:6833/3414173858":"2023-07-15T13:24:20.729701+0000","172.21.15.154:0/1387122589":"2023-07-15T13:24:20.729701+0000","172.21.15.154:0/2148864146":"2023-07-15T13:24:20.729701+0000","172.21.15.154:0/1540806126":"2023-07-15T13:13:20.528876+0000","172.21.15.154:0/77258959":"2023-07-15T13:13:20.528876+0000","172.21.15.154:0/1084316036":"2023-07-15T13:13:20.528876+0000","172.21.15.154:0/661817451":"2023-07-15T13:13:20.528876+0000","172.21.15.154:0/261234270":"2023-07-15T13:13:20.528876+0000","172.21.15.154:0/3779193680":"2023-07-15T13:13:20.528876+0000","172.21.15.154:6832/3414173858":"2023-07-15T13:24:20.729701+0000","172.21.15.154:6833/1443161386":"2023-07-15T13:13:20.528876+0000","172.21.15.154:6832/1443161386":"2023-07-15T13:13:20.528876+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:29:20.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.720+0000 7f31f25fa640 1 -- 172.21.15.5:0/2508743529 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f31d80663a0 msgr2=0x7f31d8068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:29:20.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.720+0000 7f31f25fa640 1 --2- 172.21.15.5:0/2508743529 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f31d80663a0 0x7f31d8068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:20.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.720+0000 7f31f25fa640 1 -- 172.21.15.5:0/2508743529 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31ec06b1e0 msgr2=0x7f31ec1f43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:20.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.720+0000 7f31f25fa640 1 --2- 172.21.15.5:0/2508743529 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31ec06b1e0 0x7f31ec1f43f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f31dc00c500 tx=0x7f31dc00c9c0 comp rx=0 tx=0).stop 2023-07-14T13:29:20.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.720+0000 7f31f25fa640 1 -- 172.21.15.5:0/2508743529 shutdown_connections 2023-07-14T13:29:20.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.720+0000 7f31f25fa640 1 --2- 172.21.15.5:0/2508743529 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f31d80663a0 0x7f31d8068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:20.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.720+0000 7f31f25fa640 1 --2- 172.21.15.5:0/2508743529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31ec0c21f0 0x7f31ec0cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:20.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.720+0000 7f31f25fa640 1 --2- 172.21.15.5:0/2508743529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f31ec070b70 0x7f31ec158910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:20.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.720+0000 7f31f25fa640 1 --2- 172.21.15.5:0/2508743529 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f31ec06b1e0 0x7f31ec1f43f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:20.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.720+0000 7f31f25fa640 1 -- 172.21.15.5:0/2508743529 >> 172.21.15.5:0/2508743529 conn(0x7f31ec0afcf0 msgr2=0x7f31ec0c25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:20.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.720+0000 7f31f25fa640 1 -- 172.21.15.5:0/2508743529 shutdown_connections 2023-07-14T13:29:20.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.720+0000 7f31f25fa640 1 -- 172.21.15.5:0/2508743529 wait complete. 2023-07-14T13:29:20.741 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:29:20.746 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:29:20.749 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T13:13:01.372511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '155', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T13:13:02.236215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '156', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:29:20.750 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:29:20.772 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:20.769+0000 7fe9fbf48180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:29:20.793 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:29:20.788+0000 7fa84a82c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:29:20.924 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:20.921+0000 7fe9fbf48180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:29:20.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.936+0000 7f86b926d640 1 Processor -- start 2023-07-14T13:29:20.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.936+0000 7f86b926d640 1 -- start start 2023-07-14T13:29:20.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.936+0000 7f86b926d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f86b415bde0 0x7f86b40d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:20.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.936+0000 7f86b926d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86b40d2fc0 0x7f86b40b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:20.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.936+0000 7f86b926d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86b40d2300 0x7f86b40d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:20.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.936+0000 7f86b926d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b415c1b0 con 0x7f86b40d2fc0 2023-07-14T13:29:20.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.936+0000 7f86b926d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b40d2cc0 con 0x7f86b415bde0 2023-07-14T13:29:20.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.936+0000 7f86b926d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b40b04c0 con 0x7f86b40d2300 2023-07-14T13:29:20.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.940+0000 7f86abfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86b40d2fc0 0x7f86b40b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:20.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.940+0000 7f86abfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86b40d2fc0 0x7f86b40b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48618/0 (socket says 172.21.15.5:48618) 2023-07-14T13:29:20.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.940+0000 7f86abfff640 1 -- 172.21.15.5:0/42615855 learned_addr learned my addr 172.21.15.5:0/42615855 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:20.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.940+0000 7f86b2ffd640 1 --2- 172.21.15.5:0/42615855 >> v2:172.21.15.154:3300/0 conn(0x7f86b415bde0 0x7f86b40d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:20.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.940+0000 7f86b37fe640 1 --2- 172.21.15.5:0/42615855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86b40d2300 0x7f86b40d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:20.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.940+0000 7f86abfff640 1 -- 172.21.15.5:0/42615855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86b40d2300 msgr2=0x7f86b40d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:20.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.940+0000 7f86abfff640 1 --2- 172.21.15.5:0/42615855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86b40d2300 0x7f86b40d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:20.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.940+0000 7f86abfff640 1 -- 172.21.15.5:0/42615855 >> v2:172.21.15.154:3300/0 conn(0x7f86b415bde0 msgr2=0x7f86b40d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:20.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.940+0000 7f86abfff640 1 --2- 172.21.15.5:0/42615855 >> v2:172.21.15.154:3300/0 conn(0x7f86b415bde0 0x7f86b40d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:20.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.940+0000 7f86abfff640 1 -- 172.21.15.5:0/42615855 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b40d0aa0 con 0x7f86b40d2fc0 2023-07-14T13:29:20.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.940+0000 7f86abfff640 1 --2- 172.21.15.5:0/42615855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b40d2fc0 0x7f86b40b0950 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f86b408b210 tx=0x7f869c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=406217bcce825fa server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:20.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.940+0000 7f86b27fc640 1 -- 172.21.15.5:0/42615855 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c0aa620 con 0x7f86b40d2fc0 2023-07-14T13:29:20.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.940+0000 7f86b27fc640 1 -- 172.21.15.5:0/42615855 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869c0aa780 con 0x7f86b40d2fc0 2023-07-14T13:29:20.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.940+0000 7f86b27fc640 1 -- 172.21.15.5:0/42615855 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c0aab10 con 0x7f86b40d2fc0 2023-07-14T13:29:20.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.944+0000 7f86b926d640 1 -- 172.21.15.5:0/42615855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b40d2fc0 msgr2=0x7f86b40b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:20.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.944+0000 7f86b926d640 1 --2- 172.21.15.5:0/42615855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b40d2fc0 0x7f86b40b0950 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f86b408b210 tx=0x7f869c01c500 comp rx=0 tx=0).stop 2023-07-14T13:29:20.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.944+0000 7f86b926d640 1 -- 172.21.15.5:0/42615855 shutdown_connections 2023-07-14T13:29:20.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.944+0000 7f86b926d640 1 --2- 172.21.15.5:0/42615855 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86b40d2300 0x7f86b40d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:20.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.944+0000 7f86b926d640 1 --2- 172.21.15.5:0/42615855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b40d2fc0 0x7f86b40b0950 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:20.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.944+0000 7f86b926d640 1 --2- 172.21.15.5:0/42615855 >> v2:172.21.15.154:3300/0 conn(0x7f86b415bde0 0x7f86b40d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:20.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.944+0000 7f86b926d640 1 -- 172.21.15.5:0/42615855 >> 172.21.15.5:0/42615855 conn(0x7f86b40659d0 msgr2=0x7f86b409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:20.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.944+0000 7f86b926d640 1 -- 172.21.15.5:0/42615855 shutdown_connections 2023-07-14T13:29:20.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.944+0000 7f86b926d640 1 -- 172.21.15.5:0/42615855 wait complete. 2023-07-14T13:29:20.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.944+0000 7f86b926d640 1 Processor -- start 2023-07-14T13:29:20.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.944+0000 7f86b926d640 1 -- start start 2023-07-14T13:29:20.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.944+0000 7f86b926d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86b40d2300 0x7f86b41541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:20.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.944+0000 7f86b926d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b40d2fc0 0x7f86b415e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:20.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.944+0000 7f86b926d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86b415bde0 0x7f86b4153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:20.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.944+0000 7f86b926d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b40b3350 con 0x7f86b40d2fc0 2023-07-14T13:29:20.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.944+0000 7f86b926d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b40b3630 con 0x7f86b415bde0 2023-07-14T13:29:20.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.944+0000 7f86b926d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b40b3910 con 0x7f86b40d2300 2023-07-14T13:29:20.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.944+0000 7f86abfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b40d2fc0 0x7f86b415e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:20.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.944+0000 7f86abfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b40d2fc0 0x7f86b415e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48628/0 (socket says 172.21.15.5:48628) 2023-07-14T13:29:20.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.944+0000 7f86abfff640 1 -- 172.21.15.5:0/2201219337 learned_addr learned my addr 172.21.15.5:0/2201219337 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:20.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.944+0000 7f86b2ffd640 1 --2- 172.21.15.5:0/2201219337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86b40d2300 0x7f86b41541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:20.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.944+0000 7f86b37fe640 1 --2- 172.21.15.5:0/2201219337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86b415bde0 0x7f86b4153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:20.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.948+0000 7f86abfff640 1 -- 172.21.15.5:0/2201219337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86b40d2300 msgr2=0x7f86b41541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:20.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.948+0000 7f86abfff640 1 --2- 172.21.15.5:0/2201219337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86b40d2300 0x7f86b41541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:20.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.948+0000 7f86abfff640 1 -- 172.21.15.5:0/2201219337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86b415bde0 msgr2=0x7f86b4153a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:20.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.948+0000 7f86abfff640 1 --2- 172.21.15.5:0/2201219337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86b415bde0 0x7f86b4153a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:20.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.948+0000 7f86abfff640 1 -- 172.21.15.5:0/2201219337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869c0094d0 con 0x7f86b40d2fc0 2023-07-14T13:29:20.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.948+0000 7f86abfff640 1 --2- 172.21.15.5:0/2201219337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b40d2fc0 0x7f86b415e980 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f869c01abb0 tx=0x7f869c01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:20.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.948+0000 7f86ab7fe640 1 -- 172.21.15.5:0/2201219337 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c0aadc0 con 0x7f86b40d2fc0 2023-07-14T13:29:20.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.948+0000 7f86ab7fe640 1 -- 172.21.15.5:0/2201219337 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869c0bd3f0 con 0x7f86b40d2fc0 2023-07-14T13:29:20.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.948+0000 7f86ab7fe640 1 -- 172.21.15.5:0/2201219337 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c0bd7a0 con 0x7f86b40d2fc0 2023-07-14T13:29:20.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.948+0000 7f86b926d640 1 -- 172.21.15.5:0/2201219337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b40b3bf0 con 0x7f86b40d2fc0 2023-07-14T13:29:20.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.948+0000 7f86b926d640 1 -- 172.21.15.5:0/2201219337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b4154890 con 0x7f86b40d2fc0 2023-07-14T13:29:20.964 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:29:20.948+0000 7fa84a82c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:29:20.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.948+0000 7f86b926d640 1 -- 172.21.15.5:0/2201219337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b40d0fb0 con 0x7f86b40d2fc0 2023-07-14T13:29:20.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.948+0000 7f86ab7fe640 1 -- 172.21.15.5:0/2201219337 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 82) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f869c0b33f0 con 0x7f86b40d2fc0 2023-07-14T13:29:20.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.952+0000 7f86ab7fe640 1 --2- 172.21.15.5:0/2201219337 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f86940663a0 0x7f8694068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:20.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.952+0000 7f86ab7fe640 1 -- 172.21.15.5:0/2201219337 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6778+0+0 (secure 0 0 0) 0x7f869c11e740 con 0x7f86b40d2fc0 2023-07-14T13:29:20.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.952+0000 7f86b2ffd640 1 -- 172.21.15.5:0/2201219337 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f86940663a0 msgr2=0x7f8694068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1973779483 2023-07-14T13:29:20.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.952+0000 7f86b2ffd640 1 --2- 172.21.15.5:0/2201219337 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f86940663a0 0x7f8694068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:29:20.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:20.952+0000 7f86ab7fe640 1 -- 172.21.15.5:0/2201219337 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f869c0eb910 con 0x7f86b40d2fc0 2023-07-14T13:29:21.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.108+0000 7f86b926d640 1 -- 172.21.15.5:0/2201219337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f86b40b3490 con 0x7f86b40d2fc0 2023-07-14T13:29:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.112+0000 7f86ab7fe640 1 -- 172.21.15.5:0/2201219337 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v158) v1 ==== 93+0+10 (secure 0 0 0) 0x7f86b40b3490 con 0x7f86b40d2fc0 2023-07-14T13:29:21.118 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:29:21.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.112+0000 7f86b926d640 1 -- 172.21.15.5:0/2201219337 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f86940663a0 msgr2=0x7f8694068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:29:21.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.112+0000 7f86b926d640 1 --2- 172.21.15.5:0/2201219337 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f86940663a0 0x7f8694068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.112+0000 7f86b926d640 1 -- 172.21.15.5:0/2201219337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b40d2fc0 msgr2=0x7f86b415e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.112+0000 7f86b926d640 1 --2- 172.21.15.5:0/2201219337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b40d2fc0 0x7f86b415e980 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f869c01abb0 tx=0x7f869c01ad40 comp rx=0 tx=0).stop 2023-07-14T13:29:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.112+0000 7f86b926d640 1 -- 172.21.15.5:0/2201219337 shutdown_connections 2023-07-14T13:29:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.112+0000 7f86b926d640 1 --2- 172.21.15.5:0/2201219337 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f86940663a0 0x7f8694068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.112+0000 7f86b926d640 1 --2- 172.21.15.5:0/2201219337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86b415bde0 0x7f86b4153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.112+0000 7f86b926d640 1 --2- 172.21.15.5:0/2201219337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86b40d2fc0 0x7f86b415e980 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.112+0000 7f86b926d640 1 --2- 172.21.15.5:0/2201219337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86b40d2300 0x7f86b41541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.112+0000 7f86b926d640 1 -- 172.21.15.5:0/2201219337 >> 172.21.15.5:0/2201219337 conn(0x7f86b40659d0 msgr2=0x7f86b40b46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:21.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.112+0000 7f86b926d640 1 -- 172.21.15.5:0/2201219337 shutdown_connections 2023-07-14T13:29:21.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.112+0000 7f86b926d640 1 -- 172.21.15.5:0/2201219337 wait complete. 2023-07-14T13:29:21.140 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:29:21.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.284+0000 7f005c8cb640 1 Processor -- start 2023-07-14T13:29:21.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.284+0000 7f005c8cb640 1 -- start start 2023-07-14T13:29:21.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.284+0000 7f005c8cb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f005815bde0 0x7f00580d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.284+0000 7f005c8cb640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00580b04c0 con 0x7f00580d2fc0 2023-07-14T13:29:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.284+0000 7f005c8cb640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00580b1060 con 0x7f00580d2300 2023-07-14T13:29:21.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.284+0000 7f005c8cb640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f005815c1b0 con 0x7f005815bde0 2023-07-14T13:29:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.284+0000 7f004ffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f00580d2fc0 0x7f00580b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41132/0 (socket says 172.21.15.5:41132) 2023-07-14T13:29:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.284+0000 7f004ffff640 1 -- 172.21.15.5:0/2478817498 learned_addr learned my addr 172.21.15.5:0/2478817498 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.284+0000 7f005659c640 1 --2- 172.21.15.5:0/2478817498 >> v2:172.21.15.154:3300/0 conn(0x7f005815bde0 0x7f00580d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.284+0000 7f0055d9b640 1 -- 172.21.15.5:0/2478817498 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3233568790 0 0) 0x7f00580b04c0 con 0x7f00580d2fc0 2023-07-14T13:29:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.284+0000 7f0055d9b640 1 -- 172.21.15.5:0/2478817498 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0044003530 con 0x7f00580d2fc0 2023-07-14T13:29:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.284+0000 7f0055d9b640 1 -- 172.21.15.5:0/2478817498 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718354773 0 0) 0x7f00580b1060 con 0x7f00580d2300 2023-07-14T13:29:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.284+0000 7f0055d9b640 1 -- 172.21.15.5:0/2478817498 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00580b04c0 con 0x7f00580d2300 2023-07-14T13:29:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.284+0000 7f005659c640 1 -- 172.21.15.5:0/2478817498 >> v1:172.21.15.154:6789/0 conn(0x7f00580d2300 legacy=0x7f00580cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.284+0000 7f005659c640 1 -- 172.21.15.5:0/2478817498 >> v1:172.21.15.5:6789/0 conn(0x7f00580d2fc0 legacy=0x7f00580b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:21.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.284+0000 7f005659c640 1 -- 172.21.15.5:0/2478817498 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00580d0aa0 con 0x7f005815bde0 2023-07-14T13:29:21.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.288+0000 7f005659c640 1 --2- 172.21.15.5:0/2478817498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f005815bde0 0x7f00580d0270 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f00480097a0 tx=0x7f004801c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1be922c15e2d6eb7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.288+0000 7f0055d9b640 1 -- 172.21.15.5:0/2478817498 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00480ab660 con 0x7f005815bde0 2023-07-14T13:29:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.288+0000 7f0055d9b640 1 -- 172.21.15.5:0/2478817498 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00480ab7c0 con 0x7f005815bde0 2023-07-14T13:29:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.288+0000 7f0055d9b640 1 -- 172.21.15.5:0/2478817498 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00480abb50 con 0x7f005815bde0 2023-07-14T13:29:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.288+0000 7f005c8cb640 1 -- 172.21.15.5:0/2478817498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f005815bde0 msgr2=0x7f00580d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.288+0000 7f005c8cb640 1 --2- 172.21.15.5:0/2478817498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f005815bde0 0x7f00580d0270 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f00480097a0 tx=0x7f004801c460 comp rx=0 tx=0).stop 2023-07-14T13:29:21.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.288+0000 7f005c8cb640 1 -- 172.21.15.5:0/2478817498 shutdown_connections 2023-07-14T13:29:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.288+0000 7f005c8cb640 1 --2- 172.21.15.5:0/2478817498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f005815bde0 0x7f00580d0270 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.288+0000 7f005c8cb640 1 -- 172.21.15.5:0/2478817498 >> 172.21.15.5:0/2478817498 conn(0x7f00580659d0 msgr2=0x7f005809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.288+0000 7f005c8cb640 1 -- 172.21.15.5:0/2478817498 shutdown_connections 2023-07-14T13:29:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.288+0000 7f005c8cb640 1 -- 172.21.15.5:0/2478817498 wait complete. 2023-07-14T13:29:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.292+0000 7f005c8cb640 1 Processor -- start 2023-07-14T13:29:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.292+0000 7f005c8cb640 1 -- start start 2023-07-14T13:29:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.292+0000 7f005c8cb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00580d2300 0x7f00580b6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.292+0000 7f005c8cb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00580d2fc0 0x7f005814a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:21.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.292+0000 7f005c8cb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f005815bde0 0x7f0058150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.292+0000 7f005c8cb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00580b7280 con 0x7f005815bde0 2023-07-14T13:29:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.292+0000 7f005c8cb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00580b5ce0 con 0x7f00580d2300 2023-07-14T13:29:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.292+0000 7f005c8cb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00580b5f80 con 0x7f00580d2fc0 2023-07-14T13:29:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.292+0000 7f0056d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f005815bde0 0x7f0058150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.292+0000 7f0056d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f005815bde0 0x7f0058150b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48636/0 (socket says 172.21.15.5:48636) 2023-07-14T13:29:21.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.292+0000 7f0056d9d640 1 -- 172.21.15.5:0/1991399371 learned_addr learned my addr 172.21.15.5:0/1991399371 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:21.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.292+0000 7f005659c640 1 --2- 172.21.15.5:0/1991399371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00580d2300 0x7f00580b6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:21.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.292+0000 7f004ffff640 1 --2- 172.21.15.5:0/1991399371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00580d2fc0 0x7f005814a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:21.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.292+0000 7f0056d9d640 1 -- 172.21.15.5:0/1991399371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00580d2fc0 msgr2=0x7f005814a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:21.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.292+0000 7f0056d9d640 1 --2- 172.21.15.5:0/1991399371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00580d2fc0 0x7f005814a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:21.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.292+0000 7f0056d9d640 1 -- 172.21.15.5:0/1991399371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00580d2300 msgr2=0x7f00580b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:21.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.292+0000 7f0056d9d640 1 --2- 172.21.15.5:0/1991399371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00580d2300 0x7f00580b6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:21.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.292+0000 7f0056d9d640 1 -- 172.21.15.5:0/1991399371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00480093b0 con 0x7f005815bde0 2023-07-14T13:29:21.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.292+0000 7f0056d9d640 1 --2- 172.21.15.5:0/1991399371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f005815bde0 0x7f0058150b50 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f005000c790 tx=0x7f005000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:21.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.296+0000 7f004effd640 1 -- 172.21.15.5:0/1991399371 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005000cea0 con 0x7f005815bde0 2023-07-14T13:29:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.296+0000 7f004effd640 1 -- 172.21.15.5:0/1991399371 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0050003b80 con 0x7f005815bde0 2023-07-14T13:29:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.296+0000 7f005c8cb640 1 -- 172.21.15.5:0/1991399371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00580b6260 con 0x7f005815bde0 2023-07-14T13:29:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.296+0000 7f004effd640 1 -- 172.21.15.5:0/1991399371 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005000a850 con 0x7f005815bde0 2023-07-14T13:29:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.296+0000 7f005c8cb640 1 -- 172.21.15.5:0/1991399371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00580b6820 con 0x7f005815bde0 2023-07-14T13:29:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.296+0000 7f005c8cb640 1 -- 172.21.15.5:0/1991399371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00580678d0 con 0x7f005815bde0 2023-07-14T13:29:21.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.296+0000 7f004effd640 1 -- 172.21.15.5:0/1991399371 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 82) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f005000a9b0 con 0x7f005815bde0 2023-07-14T13:29:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.296+0000 7f004effd640 1 --2- 172.21.15.5:0/1991399371 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f00380663d0 0x7f0038068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.296+0000 7f004effd640 1 -- 172.21.15.5:0/1991399371 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6778+0+0 (secure 0 0 0) 0x7f0050083f00 con 0x7f005815bde0 2023-07-14T13:29:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.296+0000 7f005659c640 1 -- 172.21.15.5:0/1991399371 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f00380663d0 msgr2=0x7f0038068880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1973779483 2023-07-14T13:29:21.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.296+0000 7f005659c640 1 --2- 172.21.15.5:0/1991399371 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f00380663d0 0x7f0038068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:29:21.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.300+0000 7f004effd640 1 -- 172.21.15.5:0/1991399371 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f0050051040 con 0x7f005815bde0 2023-07-14T13:29:21.411 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:21.409+0000 7fe9fbf48180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:29:21.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.460+0000 7f005c8cb640 1 -- 172.21.15.5:0/1991399371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f00580cd4e0 con 0x7f005815bde0 2023-07-14T13:29:21.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.460+0000 7f004effd640 1 -- 172.21.15.5:0/1991399371 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v158) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0050054660 con 0x7f005815bde0 2023-07-14T13:29:21.466 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:29:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.460+0000 7f005c8cb640 1 -- 172.21.15.5:0/1991399371 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f00380663d0 msgr2=0x7f0038068880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:29:21.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.460+0000 7f005c8cb640 1 --2- 172.21.15.5:0/1991399371 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f00380663d0 0x7f0038068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:21.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.460+0000 7f005c8cb640 1 -- 172.21.15.5:0/1991399371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f005815bde0 msgr2=0x7f0058150b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:21.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.460+0000 7f005c8cb640 1 --2- 172.21.15.5:0/1991399371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f005815bde0 0x7f0058150b50 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f005000c790 tx=0x7f005000cc50 comp rx=0 tx=0).stop 2023-07-14T13:29:21.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.460+0000 7f005c8cb640 1 -- 172.21.15.5:0/1991399371 shutdown_connections 2023-07-14T13:29:21.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.460+0000 7f005c8cb640 1 --2- 172.21.15.5:0/1991399371 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f00380663d0 0x7f0038068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:21.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.460+0000 7f005c8cb640 1 --2- 172.21.15.5:0/1991399371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f005815bde0 0x7f0058150b50 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:21.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.460+0000 7f005c8cb640 1 --2- 172.21.15.5:0/1991399371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00580d2fc0 0x7f005814a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:21.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.460+0000 7f005c8cb640 1 --2- 172.21.15.5:0/1991399371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00580d2300 0x7f00580b6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:21.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.460+0000 7f005c8cb640 1 -- 172.21.15.5:0/1991399371 >> 172.21.15.5:0/1991399371 conn(0x7f00580659d0 msgr2=0x7f00580cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:21.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.460+0000 7f005c8cb640 1 -- 172.21.15.5:0/1991399371 shutdown_connections 2023-07-14T13:29:21.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.460+0000 7f005c8cb640 1 -- 172.21.15.5:0/1991399371 wait complete. 2023-07-14T13:29:21.469 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:21.469+0000 7fe9fbf48180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:29:21.476 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:29:21.468+0000 7fa84a82c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:29:21.487 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T13:29:21.526 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:21.525+0000 7fe9fbf48180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:29:21.539 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:29:21.532+0000 7fa84a82c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:29:21.600 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:29:21.592+0000 7fa84a82c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:29:21.611 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:21.609+0000 7fe9fbf48180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:29:21.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.632+0000 7f28bb300640 1 Processor -- start 2023-07-14T13:29:21.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.632+0000 7f28bb300640 1 -- start start 2023-07-14T13:29:21.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.632+0000 7f28bb300640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28b4070f30 0x7f28b40ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:21.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.632+0000 7f28bb300640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28b40af2b0 0x7f28b415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:21.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.632+0000 7f28bb300640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b4159d70 con 0x7f28b4069430 2023-07-14T13:29:21.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.632+0000 7f28bb300640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b40c9c60 con 0x7f28b40af2b0 2023-07-14T13:29:21.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.632+0000 7f28bb300640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b40c9f40 con 0x7f28b4070f30 2023-07-14T13:29:21.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.632+0000 7f28b989d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28b40af2b0 0x7f28b415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:21.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.632+0000 7f28b889b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28b4070f30 0x7f28b40ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:21.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.632+0000 7f28b989d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28b40af2b0 0x7f28b415a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:49026/0 (socket says 172.21.15.5:49026) 2023-07-14T13:29:21.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.632+0000 7f28b989d640 1 -- 172.21.15.5:0/2404142594 learned_addr learned my addr 172.21.15.5:0/2404142594 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:21.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.632+0000 7f28abfff640 1 -- 172.21.15.5:0/2404142594 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189703635 0 0) 0x7f28b0001120 con 0x7f28b4069430 2023-07-14T13:29:21.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.636+0000 7f28abfff640 1 -- 172.21.15.5:0/2404142594 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28a0003530 con 0x7f28b4069430 2023-07-14T13:29:21.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.636+0000 7f28b989d640 1 -- 172.21.15.5:0/2404142594 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28b4070f30 msgr2=0x7f28b40ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:21.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.636+0000 7f28b989d640 1 --2- 172.21.15.5:0/2404142594 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28b4070f30 0x7f28b40ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:21.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.636+0000 7f28b989d640 1 -- 172.21.15.5:0/2404142594 >> v1:172.21.15.154:6789/0 conn(0x7f28b4069430 legacy=0x7f28b4069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:21.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.636+0000 7f28b989d640 1 -- 172.21.15.5:0/2404142594 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b40ca220 con 0x7f28b40af2b0 2023-07-14T13:29:21.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.636+0000 7f28b889b640 1 --2- 172.21.15.5:0/2404142594 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28b4070f30 0x7f28b40ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:29:21.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.636+0000 7f28b989d640 1 --2- 172.21.15.5:0/2404142594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28b40af2b0 0x7f28b415a1f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f28ac009e50 tx=0x7f28ac01ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e923894c9394d24 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:21.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.636+0000 7f28abfff640 1 -- 172.21.15.5:0/2404142594 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac0a57f0 con 0x7f28b40af2b0 2023-07-14T13:29:21.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.636+0000 7f28abfff640 1 -- 172.21.15.5:0/2404142594 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ac0a5950 con 0x7f28b40af2b0 2023-07-14T13:29:21.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.636+0000 7f28abfff640 1 -- 172.21.15.5:0/2404142594 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac0a5ce0 con 0x7f28b40af2b0 2023-07-14T13:29:21.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.640+0000 7f28bb300640 1 -- 172.21.15.5:0/2404142594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28b40af2b0 msgr2=0x7f28b415a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:21.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.640+0000 7f28bb300640 1 --2- 172.21.15.5:0/2404142594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28b40af2b0 0x7f28b415a1f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f28ac009e50 tx=0x7f28ac01ca10 comp rx=0 tx=0).stop 2023-07-14T13:29:21.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.640+0000 7f28bb300640 1 -- 172.21.15.5:0/2404142594 shutdown_connections 2023-07-14T13:29:21.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.640+0000 7f28bb300640 1 --2- 172.21.15.5:0/2404142594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28b40af2b0 0x7f28b415a1f0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:21.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.640+0000 7f28bb300640 1 --2- 172.21.15.5:0/2404142594 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28b4070f30 0x7f28b40ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:21.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.640+0000 7f28bb300640 1 -- 172.21.15.5:0/2404142594 >> 172.21.15.5:0/2404142594 conn(0x7f28b40cde90 msgr2=0x7f28b40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:21.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.640+0000 7f28bb300640 1 -- 172.21.15.5:0/2404142594 shutdown_connections 2023-07-14T13:29:21.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.640+0000 7f28bb300640 1 -- 172.21.15.5:0/2404142594 wait complete. 2023-07-14T13:29:21.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.640+0000 7f28bb300640 1 Processor -- start 2023-07-14T13:29:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.640+0000 7f28bb300640 1 -- start start 2023-07-14T13:29:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.644+0000 7f28bb300640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28b4069430 0x7f28b414faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.644+0000 7f28bb300640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28b4070f30 0x7f28b40c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.644+0000 7f28bb300640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28b40af2b0 0x7f28b40cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.644+0000 7f28bb300640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b4154b40 con 0x7f28b4069430 2023-07-14T13:29:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.644+0000 7f28bb300640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b40c5eb0 con 0x7f28b4070f30 2023-07-14T13:29:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.644+0000 7f28bb300640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b40c6150 con 0x7f28b40af2b0 2023-07-14T13:29:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.644+0000 7f28b909c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28b4069430 0x7f28b414faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.644+0000 7f28b909c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28b4069430 0x7f28b414faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48650/0 (socket says 172.21.15.5:48650) 2023-07-14T13:29:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.644+0000 7f28b909c640 1 -- 172.21.15.5:0/1784477988 learned_addr learned my addr 172.21.15.5:0/1784477988 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.644+0000 7f28b889b640 1 --2- 172.21.15.5:0/1784477988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28b4070f30 0x7f28b40c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.644+0000 7f28b989d640 1 --2- 172.21.15.5:0/1784477988 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28b40af2b0 0x7f28b40cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.644+0000 7f28b909c640 1 -- 172.21.15.5:0/1784477988 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28b40af2b0 msgr2=0x7f28b40cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.644+0000 7f28b909c640 1 --2- 172.21.15.5:0/1784477988 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28b40af2b0 0x7f28b40cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.644+0000 7f28b909c640 1 -- 172.21.15.5:0/1784477988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28b4070f30 msgr2=0x7f28b40c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.644+0000 7f28b909c640 1 --2- 172.21.15.5:0/1784477988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28b4070f30 0x7f28b40c5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.644+0000 7f28b909c640 1 -- 172.21.15.5:0/1784477988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a4009420 con 0x7f28b4069430 2023-07-14T13:29:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.644+0000 7f28b909c640 1 --2- 172.21.15.5:0/1784477988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28b4069430 0x7f28b414faf0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f28b0001280 tx=0x7f28b000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.644+0000 7f28a9ffb640 1 -- 172.21.15.5:0/1784477988 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b00052d0 con 0x7f28b4069430 2023-07-14T13:29:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.644+0000 7f28a9ffb640 1 -- 172.21.15.5:0/1784477988 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b0005450 con 0x7f28b4069430 2023-07-14T13:29:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.644+0000 7f28a9ffb640 1 -- 172.21.15.5:0/1784477988 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b0003840 con 0x7f28b4069430 2023-07-14T13:29:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.644+0000 7f28bb300640 1 -- 172.21.15.5:0/1784477988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ac009b30 con 0x7f28b4069430 2023-07-14T13:29:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.644+0000 7f28bb300640 1 -- 172.21.15.5:0/1784477988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b40c6710 con 0x7f28b4069430 2023-07-14T13:29:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.644+0000 7f28bb300640 1 -- 172.21.15.5:0/1784477988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b415a1f0 con 0x7f28b4069430 2023-07-14T13:29:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.648+0000 7f28a9ffb640 1 -- 172.21.15.5:0/1784477988 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 82) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f28b00039a0 con 0x7f28b4069430 2023-07-14T13:29:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.648+0000 7f28a9ffb640 1 --2- 172.21.15.5:0/1784477988 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f28980663a0 0x7f2898068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.648+0000 7f28a9ffb640 1 -- 172.21.15.5:0/1784477988 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6778+0+0 (secure 0 0 0) 0x7f28b00835c0 con 0x7f28b4069430 2023-07-14T13:29:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.648+0000 7f28b889b640 1 -- 172.21.15.5:0/1784477988 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f28980663a0 msgr2=0x7f2898068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1973779483 2023-07-14T13:29:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.648+0000 7f28b889b640 1 --2- 172.21.15.5:0/1784477988 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f28980663a0 0x7f2898068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:29:21.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.652+0000 7f28a9ffb640 1 -- 172.21.15.5:0/1784477988 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f28b0050680 con 0x7f28b4069430 2023-07-14T13:29:21.670 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:21.669+0000 7fe9fbf48180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:29:21.696 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:29:21.692+0000 7fa84a82c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:29:21.755 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:21.753+0000 7fe9fbf48180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:29:21.757 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:29:21.752+0000 7fa84a82c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:29:21.812 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:21.809+0000 7fe9fbf48180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:29:21.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.808+0000 7f28bb300640 1 -- 172.21.15.5:0/1784477988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f28b4159d70 con 0x7f28b4069430 2023-07-14T13:29:21.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.808+0000 7f28a9ffb640 1 -- 172.21.15.5:0/1784477988 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v158) v1 ==== 104+0+11 (secure 0 0 0) 0x7f28b4159d70 con 0x7f28b4069430 2023-07-14T13:29:21.814 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T13:29:21.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.808+0000 7f28bb300640 1 -- 172.21.15.5:0/1784477988 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f28980663a0 msgr2=0x7f2898068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:29:21.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.808+0000 7f28bb300640 1 --2- 172.21.15.5:0/1784477988 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f28980663a0 0x7f2898068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:21.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.808+0000 7f28bb300640 1 -- 172.21.15.5:0/1784477988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28b4069430 msgr2=0x7f28b414faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:21.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.808+0000 7f28bb300640 1 --2- 172.21.15.5:0/1784477988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28b4069430 0x7f28b414faf0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f28b0001280 tx=0x7f28b000c890 comp rx=0 tx=0).stop 2023-07-14T13:29:21.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.808+0000 7f28bb300640 1 -- 172.21.15.5:0/1784477988 shutdown_connections 2023-07-14T13:29:21.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.808+0000 7f28bb300640 1 --2- 172.21.15.5:0/1784477988 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f28980663a0 0x7f2898068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:21.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.808+0000 7f28bb300640 1 --2- 172.21.15.5:0/1784477988 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28b40af2b0 0x7f28b40cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:21.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.808+0000 7f28bb300640 1 --2- 172.21.15.5:0/1784477988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28b4070f30 0x7f28b40c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:21.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.808+0000 7f28bb300640 1 --2- 172.21.15.5:0/1784477988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28b4069430 0x7f28b414faf0 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:21.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.808+0000 7f28bb300640 1 -- 172.21.15.5:0/1784477988 >> 172.21.15.5:0/1784477988 conn(0x7f28b40cde90 msgr2=0x7f28b4150390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:21.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.812+0000 7f28bb300640 1 -- 172.21.15.5:0/1784477988 shutdown_connections 2023-07-14T13:29:21.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.812+0000 7f28bb300640 1 -- 172.21.15.5:0/1784477988 wait complete. 2023-07-14T13:29:21.838 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T13:29:21.848 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:29:21.840+0000 7fa84a82c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:29:21.909 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:29:21.904+0000 7fa84a82c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:29:21.953 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:21.953+0000 7fe9fbf48180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:29:21.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.980+0000 7f34c3a6d640 1 Processor -- start 2023-07-14T13:29:21.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.980+0000 7f34c3a6d640 1 -- start start 2023-07-14T13:29:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.980+0000 7f34c3a6d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34bc15bde0 0x7f34bc0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.980+0000 7f34c3a6d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f34bc0d2fc0 0x7f34bc0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:21.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.980+0000 7f34c3a6d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34bc0b04c0 con 0x7f34bc0d2300 2023-07-14T13:29:21.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.980+0000 7f34c3a6d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34bc15c1b0 con 0x7f34bc0d2fc0 2023-07-14T13:29:21.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.980+0000 7f34c3a6d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc0d0aa0 con 0x7f34bc15bde0 2023-07-14T13:29:21.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.984+0000 7f34c200a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f34bc0d2300 0x7f34bc0cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41138/0 (socket says 172.21.15.5:41138) 2023-07-14T13:29:21.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.984+0000 7f34c200a640 1 -- 172.21.15.5:0/2701726965 learned_addr learned my addr 172.21.15.5:0/2701726965 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:21.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.984+0000 7f34c1809640 1 --2- 172.21.15.5:0/2701726965 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34bc15bde0 0x7f34bc0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.984+0000 7f34c1008640 1 --2- 172.21.15.5:0/2701726965 >> v2:172.21.15.154:3300/0 conn(0x7f34bc0d2fc0 0x7f34bc0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.984+0000 7f34c0807640 1 -- 172.21.15.5:0/2701726965 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2433213759 0 0) 0x7f34bc0b04c0 con 0x7f34bc0d2300 2023-07-14T13:29:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.984+0000 7f34c1809640 1 -- 172.21.15.5:0/2701726965 >> v2:172.21.15.154:3300/0 conn(0x7f34bc0d2fc0 msgr2=0x7f34bc0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.984+0000 7f34c1809640 1 --2- 172.21.15.5:0/2701726965 >> v2:172.21.15.154:3300/0 conn(0x7f34bc0d2fc0 0x7f34bc0b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.984+0000 7f34c1809640 1 -- 172.21.15.5:0/2701726965 >> v1:172.21.15.5:6789/0 conn(0x7f34bc0d2300 legacy=0x7f34bc0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:21.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.984+0000 7f34c1809640 1 -- 172.21.15.5:0/2701726965 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34bc0afb90 con 0x7f34bc15bde0 2023-07-14T13:29:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.984+0000 7f34c1809640 1 --2- 172.21.15.5:0/2701726965 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34bc15bde0 0x7f34bc0d0270 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f34b80097a0 tx=0x7f34b801c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d410b8dbdb716d9c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.984+0000 7f34c0807640 1 -- 172.21.15.5:0/2701726965 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b80ab660 con 0x7f34bc15bde0 2023-07-14T13:29:21.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.984+0000 7f34c0807640 1 -- 172.21.15.5:0/2701726965 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b80ab7c0 con 0x7f34bc15bde0 2023-07-14T13:29:21.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.984+0000 7f34c0807640 1 -- 172.21.15.5:0/2701726965 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b80abb50 con 0x7f34bc15bde0 2023-07-14T13:29:21.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.988+0000 7f34c3a6d640 1 -- 172.21.15.5:0/2701726965 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34bc15bde0 msgr2=0x7f34bc0d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:21.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.988+0000 7f34c3a6d640 1 --2- 172.21.15.5:0/2701726965 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34bc15bde0 0x7f34bc0d0270 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f34b80097a0 tx=0x7f34b801c460 comp rx=0 tx=0).stop 2023-07-14T13:29:21.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.988+0000 7f34c3a6d640 1 -- 172.21.15.5:0/2701726965 shutdown_connections 2023-07-14T13:29:21.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.988+0000 7f34c3a6d640 1 --2- 172.21.15.5:0/2701726965 >> v2:172.21.15.154:3300/0 conn(0x7f34bc0d2fc0 0x7f34bc0b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:21.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.988+0000 7f34c3a6d640 1 --2- 172.21.15.5:0/2701726965 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34bc15bde0 0x7f34bc0d0270 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:21.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.988+0000 7f34c3a6d640 1 -- 172.21.15.5:0/2701726965 >> 172.21.15.5:0/2701726965 conn(0x7f34bc0659d0 msgr2=0x7f34bc09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:21.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.988+0000 7f34c3a6d640 1 -- 172.21.15.5:0/2701726965 shutdown_connections 2023-07-14T13:29:21.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.988+0000 7f34c3a6d640 1 -- 172.21.15.5:0/2701726965 wait complete. 2023-07-14T13:29:21.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.988+0000 7f34c3a6d640 1 Processor -- start 2023-07-14T13:29:21.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.988+0000 7f34c3a6d640 1 -- start start 2023-07-14T13:29:21.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.988+0000 7f34c3a6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34bc0d2300 0x7f34bc152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:21.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.988+0000 7f34c3a6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34bc0d2fc0 0x7f34bc158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:22.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.988+0000 7f34c3a6d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34bc15bde0 0x7f34bc14f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:22.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.988+0000 7f34c3a6d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc0b6930 con 0x7f34bc0d2300 2023-07-14T13:29:22.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.988+0000 7f34c3a6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc0b6c10 con 0x7f34bc0d2fc0 2023-07-14T13:29:22.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.988+0000 7f34c3a6d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc0b6ef0 con 0x7f34bc15bde0 2023-07-14T13:29:22.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.988+0000 7f34c1809640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34bc0d2300 0x7f34bc152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:22.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.992+0000 7f34c1809640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34bc0d2300 0x7f34bc152e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48652/0 (socket says 172.21.15.5:48652) 2023-07-14T13:29:22.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.992+0000 7f34c1809640 1 -- 172.21.15.5:0/1202968197 learned_addr learned my addr 172.21.15.5:0/1202968197 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:22.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.992+0000 7f34c1008640 1 --2- 172.21.15.5:0/1202968197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34bc0d2fc0 0x7f34bc158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:22.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.992+0000 7f34c200a640 1 --2- 172.21.15.5:0/1202968197 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34bc15bde0 0x7f34bc14f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:22.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.992+0000 7f34c1809640 1 -- 172.21.15.5:0/1202968197 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34bc15bde0 msgr2=0x7f34bc14f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:22.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.992+0000 7f34c1809640 1 --2- 172.21.15.5:0/1202968197 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34bc15bde0 0x7f34bc14f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:22.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.992+0000 7f34c1809640 1 -- 172.21.15.5:0/1202968197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34bc0d2fc0 msgr2=0x7f34bc158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:22.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.992+0000 7f34c1809640 1 --2- 172.21.15.5:0/1202968197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34bc0d2fc0 0x7f34bc158640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:22.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.992+0000 7f34c1809640 1 -- 172.21.15.5:0/1202968197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b80093b0 con 0x7f34bc0d2300 2023-07-14T13:29:22.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.992+0000 7f34c1809640 1 --2- 172.21.15.5:0/1202968197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34bc0d2300 0x7f34bc152e80 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f34b80ad040 tx=0x7f34b8019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:22.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.992+0000 7f34b27fc640 1 -- 172.21.15.5:0/1202968197 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b80abe80 con 0x7f34bc0d2300 2023-07-14T13:29:22.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.992+0000 7f34b27fc640 1 -- 172.21.15.5:0/1202968197 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b80059a0 con 0x7f34bc0d2300 2023-07-14T13:29:22.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.992+0000 7f34c3a6d640 1 -- 172.21.15.5:0/1202968197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34bc0b71d0 con 0x7f34bc0d2300 2023-07-14T13:29:22.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.992+0000 7f34b27fc640 1 -- 172.21.15.5:0/1202968197 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b8005d50 con 0x7f34bc0d2300 2023-07-14T13:29:22.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.992+0000 7f34c3a6d640 1 -- 172.21.15.5:0/1202968197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34bc153da0 con 0x7f34bc0d2300 2023-07-14T13:29:22.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.992+0000 7f34c3a6d640 1 -- 172.21.15.5:0/1202968197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34bc0678d0 con 0x7f34bc0d2300 2023-07-14T13:29:22.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.992+0000 7f34b27fc640 1 -- 172.21.15.5:0/1202968197 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 82) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f34b80a9070 con 0x7f34bc0d2300 2023-07-14T13:29:22.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.996+0000 7f34b27fc640 1 --2- 172.21.15.5:0/1202968197 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f34a00663d0 0x7f34a0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:22.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.996+0000 7f34b27fc640 1 -- 172.21.15.5:0/1202968197 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6778+0+0 (secure 0 0 0) 0x7f34b811e6c0 con 0x7f34bc0d2300 2023-07-14T13:29:22.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.996+0000 7f34c1008640 1 -- 172.21.15.5:0/1202968197 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f34a00663d0 msgr2=0x7f34a0068880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1973779483 2023-07-14T13:29:22.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:21.996+0000 7f34c1008640 1 --2- 172.21.15.5:0/1202968197 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f34a00663d0 0x7f34a0068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:29:22.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.000+0000 7f34b27fc640 1 -- 172.21.15.5:0/1202968197 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f34b80eb810 con 0x7f34bc0d2300 2023-07-14T13:29:22.013 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:22.013+0000 7fe9fbf48180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:29:22.063 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:29:22.056+0000 7fa84a82c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:29:22.125 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:29:22.120+0000 7fa84a82c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:29:22.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.156+0000 7f34c3a6d640 1 -- 172.21.15.5:0/1202968197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f34bc0cd680 con 0x7f34bc0d2300 2023-07-14T13:29:22.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.156+0000 7f34b27fc640 1 -- 172.21.15.5:0/1202968197 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v158) v1 ==== 100+0+11 (secure 0 0 0) 0x7f34b80eee30 con 0x7f34bc0d2300 2023-07-14T13:29:22.162 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T13:29:22.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.156+0000 7f34c3a6d640 1 -- 172.21.15.5:0/1202968197 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f34a00663d0 msgr2=0x7f34a0068880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:29:22.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.156+0000 7f34c3a6d640 1 --2- 172.21.15.5:0/1202968197 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f34a00663d0 0x7f34a0068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:22.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.156+0000 7f34c3a6d640 1 -- 172.21.15.5:0/1202968197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34bc0d2300 msgr2=0x7f34bc152e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:22.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.156+0000 7f34c3a6d640 1 --2- 172.21.15.5:0/1202968197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34bc0d2300 0x7f34bc152e80 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f34b80ad040 tx=0x7f34b8019200 comp rx=0 tx=0).stop 2023-07-14T13:29:22.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.156+0000 7f34c3a6d640 1 -- 172.21.15.5:0/1202968197 shutdown_connections 2023-07-14T13:29:22.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.156+0000 7f34c3a6d640 1 --2- 172.21.15.5:0/1202968197 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f34a00663d0 0x7f34a0068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.156+0000 7f34c3a6d640 1 --2- 172.21.15.5:0/1202968197 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34bc15bde0 0x7f34bc14f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.156+0000 7f34c3a6d640 1 --2- 172.21.15.5:0/1202968197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34bc0d2fc0 0x7f34bc158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.156+0000 7f34c3a6d640 1 --2- 172.21.15.5:0/1202968197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34bc0d2300 0x7f34bc152e80 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.156+0000 7f34c3a6d640 1 -- 172.21.15.5:0/1202968197 >> 172.21.15.5:0/1202968197 conn(0x7f34bc0659d0 msgr2=0x7f34bc0cd960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.156+0000 7f34c3a6d640 1 -- 172.21.15.5:0/1202968197 shutdown_connections 2023-07-14T13:29:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.156+0000 7f34c3a6d640 1 -- 172.21.15.5:0/1202968197 wait complete. 2023-07-14T13:29:22.184 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T13:29:22.255 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:29:22.256 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:29:22.257 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:29:22.264 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:22.261+0000 7fe9fbf48180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:29:22.384 INFO:tasks.ceph.mgr.y.smithi005.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:29:22.384 INFO:tasks.ceph.mgr.y.smithi005.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:29:22.384 INFO:tasks.ceph.mgr.y.smithi005.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:29:22.393 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:29:22.388+0000 7fa84a82c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:29:22.397 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:22.393+0000 7fe9fbf48180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:29:22.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.400+0000 7f927289c640 1 Processor -- start 2023-07-14T13:29:22.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.400+0000 7f927289c640 1 -- start start 2023-07-14T13:29:22.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.400+0000 7f927289c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f926c0b7c70 0x7f926c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:22.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.400+0000 7f927289c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f926c15fd60 0x7f926c0d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:22.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.400+0000 7f927289c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926c0ccaf0 con 0x7f926c0d1850 2023-07-14T13:29:22.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.400+0000 7f927289c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f926c0d1190 con 0x7f926c0b7c70 2023-07-14T13:29:22.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.400+0000 7f927289c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926c160600 con 0x7f926c15fd60 2023-07-14T13:29:22.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.400+0000 7f926b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f926c0d1850 0x7f926c15f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41146/0 (socket says 172.21.15.5:41146) 2023-07-14T13:29:22.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.400+0000 7f926b7fe640 1 -- 172.21.15.5:0/3923496498 learned_addr learned my addr 172.21.15.5:0/3923496498 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:22.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.400+0000 7f926bfff640 1 --2- 172.21.15.5:0/3923496498 >> v2:172.21.15.154:3300/0 conn(0x7f926c0b7c70 0x7f926c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:22.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.400+0000 7f9270e39640 1 --2- 172.21.15.5:0/3923496498 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f926c15fd60 0x7f926c0d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:22.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.400+0000 7f926affd640 1 -- 172.21.15.5:0/3923496498 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98240991 0 0) 0x7f926c0ccaf0 con 0x7f926c0d1850 2023-07-14T13:29:22.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.400+0000 7f926affd640 1 -- 172.21.15.5:0/3923496498 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9254003530 con 0x7f926c0d1850 2023-07-14T13:29:22.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.400+0000 7f926bfff640 1 -- 172.21.15.5:0/3923496498 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f926c15fd60 msgr2=0x7f926c0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:22.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.400+0000 7f926bfff640 1 --2- 172.21.15.5:0/3923496498 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f926c15fd60 0x7f926c0d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:22.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.400+0000 7f926bfff640 1 -- 172.21.15.5:0/3923496498 >> v1:172.21.15.5:6789/0 conn(0x7f926c0d1850 legacy=0x7f926c15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:22.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.400+0000 7f926bfff640 1 -- 172.21.15.5:0/3923496498 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926c160320 con 0x7f926c0b7c70 2023-07-14T13:29:22.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.400+0000 7f9270e39640 1 --2- 172.21.15.5:0/3923496498 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f926c15fd60 0x7f926c0d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:29:22.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.404+0000 7f926bfff640 1 --2- 172.21.15.5:0/3923496498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f926c0b7c70 0x7f926c0d0c50 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f925c0097c0 tx=0x7f925c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a881c40c9cd7cb26 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:22.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.404+0000 7f926affd640 1 -- 172.21.15.5:0/3923496498 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c0ab670 con 0x7f926c0b7c70 2023-07-14T13:29:22.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.404+0000 7f926affd640 1 -- 172.21.15.5:0/3923496498 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925c0ab7d0 con 0x7f926c0b7c70 2023-07-14T13:29:22.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.404+0000 7f926affd640 1 -- 172.21.15.5:0/3923496498 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c0abb60 con 0x7f926c0b7c70 2023-07-14T13:29:22.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.404+0000 7f927289c640 1 -- 172.21.15.5:0/3923496498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f926c0b7c70 msgr2=0x7f926c0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:22.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.404+0000 7f927289c640 1 --2- 172.21.15.5:0/3923496498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f926c0b7c70 0x7f926c0d0c50 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f925c0097c0 tx=0x7f925c01c450 comp rx=0 tx=0).stop 2023-07-14T13:29:22.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.404+0000 7f927289c640 1 -- 172.21.15.5:0/3923496498 shutdown_connections 2023-07-14T13:29:22.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.404+0000 7f927289c640 1 --2- 172.21.15.5:0/3923496498 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f926c15fd60 0x7f926c0d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:22.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.404+0000 7f927289c640 1 --2- 172.21.15.5:0/3923496498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f926c0b7c70 0x7f926c0d0c50 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:22.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.404+0000 7f927289c640 1 -- 172.21.15.5:0/3923496498 >> 172.21.15.5:0/3923496498 conn(0x7f926c0650b0 msgr2=0x7f926c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:22.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.408+0000 7f927289c640 1 -- 172.21.15.5:0/3923496498 shutdown_connections 2023-07-14T13:29:22.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.408+0000 7f927289c640 1 -- 172.21.15.5:0/3923496498 wait complete. 2023-07-14T13:29:22.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.408+0000 7f927289c640 1 Processor -- start 2023-07-14T13:29:22.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.408+0000 7f927289c640 1 -- start start 2023-07-14T13:29:22.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.408+0000 7f927289c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f926c0b7c70 0x7f926c151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:22.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.408+0000 7f927289c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f926c0d1850 0x7f926c152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:22.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.408+0000 7f927289c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f926c15fd60 0x7f926c152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:22.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.408+0000 7f927289c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926c157970 con 0x7f926c0d1850 2023-07-14T13:29:22.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.408+0000 7f927289c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926c1521a0 con 0x7f926c0b7c70 2023-07-14T13:29:22.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.408+0000 7f927289c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926c0b52d0 con 0x7f926c15fd60 2023-07-14T13:29:22.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.408+0000 7f926b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f926c0d1850 0x7f926c152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:22.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.408+0000 7f926b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f926c0d1850 0x7f926c152840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48660/0 (socket says 172.21.15.5:48660) 2023-07-14T13:29:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.408+0000 7f926b7fe640 1 -- 172.21.15.5:0/3178175419 learned_addr learned my addr 172.21.15.5:0/3178175419 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.408+0000 7f926bfff640 1 --2- 172.21.15.5:0/3178175419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f926c0b7c70 0x7f926c151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.408+0000 7f9270e39640 1 --2- 172.21.15.5:0/3178175419 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f926c15fd60 0x7f926c152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.408+0000 7f9270e39640 1 -- 172.21.15.5:0/3178175419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f926c0b7c70 msgr2=0x7f926c151c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.408+0000 7f9270e39640 1 --2- 172.21.15.5:0/3178175419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f926c0b7c70 0x7f926c151c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.408+0000 7f9270e39640 1 -- 172.21.15.5:0/3178175419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f926c0d1850 msgr2=0x7f926c152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.408+0000 7f9270e39640 1 --2- 172.21.15.5:0/3178175419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f926c0d1850 0x7f926c152840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.408+0000 7f9270e39640 1 -- 172.21.15.5:0/3178175419 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9264009a70 con 0x7f926c15fd60 2023-07-14T13:29:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.412+0000 7f9270e39640 1 --2- 172.21.15.5:0/3178175419 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f926c15fd60 0x7f926c152d80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9264009e50 tx=0x7f926400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.412+0000 7f9268ff9640 1 -- 172.21.15.5:0/3178175419 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926400cd90 con 0x7f926c15fd60 2023-07-14T13:29:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.412+0000 7f9268ff9640 1 -- 172.21.15.5:0/3178175419 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926400f040 con 0x7f926c15fd60 2023-07-14T13:29:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.412+0000 7f9268ff9640 1 -- 172.21.15.5:0/3178175419 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264003be0 con 0x7f926c15fd60 2023-07-14T13:29:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.412+0000 7f927289c640 1 -- 172.21.15.5:0/3178175419 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f925c009420 con 0x7f926c15fd60 2023-07-14T13:29:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.412+0000 7f927289c640 1 -- 172.21.15.5:0/3178175419 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f926c0b5890 con 0x7f926c15fd60 2023-07-14T13:29:22.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.412+0000 7f927289c640 1 -- 172.21.15.5:0/3178175419 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f926c0678d0 con 0x7f926c15fd60 2023-07-14T13:29:22.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.412+0000 7f9268ff9640 1 -- 172.21.15.5:0/3178175419 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 82) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f9264014480 con 0x7f926c15fd60 2023-07-14T13:29:22.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.416+0000 7f9268ff9640 1 --2- 172.21.15.5:0/3178175419 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f92580663d0 0x7f9258068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:22.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.416+0000 7f9268ff9640 1 -- 172.21.15.5:0/3178175419 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6778+0+0 (secure 0 0 0) 0x7f9264084d00 con 0x7f926c15fd60 2023-07-14T13:29:22.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.416+0000 7f926bfff640 1 -- 172.21.15.5:0/3178175419 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f92580663d0 msgr2=0x7f9258068880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1973779483 2023-07-14T13:29:22.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.416+0000 7f926bfff640 1 --2- 172.21.15.5:0/3178175419 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f92580663d0 0x7f9258068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:29:22.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.420+0000 7f9268ff9640 1 -- 172.21.15.5:0/3178175419 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9264051d30 con 0x7f926c15fd60 2023-07-14T13:29:22.524 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:22.521+0000 7fe9fbf48180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:29:22.538 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:29:22.532+0000 7fa84a82c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:29:22.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.588+0000 7f927289c640 1 -- 172.21.15.5:0/3178175419 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f926c0b1e00 con 0x7f926c15fd60 2023-07-14T13:29:22.595 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:22.593+0000 7fe9fbf48180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:29:22.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.588+0000 7f9268ff9640 1 -- 172.21.15.5:0/3178175419 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v158) v1 ==== 81+0+952 (secure 0 0 0) 0x7f9264055350 con 0x7f926c15fd60 2023-07-14T13:29:22.596 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/3205049834 2023-07-15T13:24:20.729701+0000 2023-07-14T13:29:22.596 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/2448917971 2023-07-15T13:24:20.729701+0000 2023-07-14T13:29:22.596 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/3347209674 2023-07-15T13:24:20.729701+0000 2023-07-14T13:29:22.596 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/2602756791 2023-07-15T13:24:20.729701+0000 2023-07-14T13:29:22.597 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:6833/3414173858 2023-07-15T13:24:20.729701+0000 2023-07-14T13:29:22.597 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/1387122589 2023-07-15T13:24:20.729701+0000 2023-07-14T13:29:22.597 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/2148864146 2023-07-15T13:24:20.729701+0000 2023-07-14T13:29:22.597 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/1540806126 2023-07-15T13:13:20.528876+0000 2023-07-14T13:29:22.597 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/77258959 2023-07-15T13:13:20.528876+0000 2023-07-14T13:29:22.598 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/1084316036 2023-07-15T13:13:20.528876+0000 2023-07-14T13:29:22.598 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/661817451 2023-07-15T13:13:20.528876+0000 2023-07-14T13:29:22.598 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/261234270 2023-07-15T13:13:20.528876+0000 2023-07-14T13:29:22.598 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/3779193680 2023-07-15T13:13:20.528876+0000 2023-07-14T13:29:22.598 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:6832/3414173858 2023-07-15T13:24:20.729701+0000 2023-07-14T13:29:22.598 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:6833/1443161386 2023-07-15T13:13:20.528876+0000 2023-07-14T13:29:22.598 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:6832/1443161386 2023-07-15T13:13:20.528876+0000 2023-07-14T13:29:22.599 INFO:teuthology.orchestra.run.smithi005.stderr:listed 16 entries 2023-07-14T13:29:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.592+0000 7f927289c640 1 -- 172.21.15.5:0/3178175419 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f92580663d0 msgr2=0x7f9258068880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:29:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.592+0000 7f927289c640 1 --2- 172.21.15.5:0/3178175419 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f92580663d0 0x7f9258068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.592+0000 7f927289c640 1 -- 172.21.15.5:0/3178175419 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f926c15fd60 msgr2=0x7f926c152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.592+0000 7f927289c640 1 --2- 172.21.15.5:0/3178175419 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f926c15fd60 0x7f926c152d80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9264009e50 tx=0x7f926400c490 comp rx=0 tx=0).stop 2023-07-14T13:29:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.592+0000 7f927289c640 1 -- 172.21.15.5:0/3178175419 shutdown_connections 2023-07-14T13:29:22.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.592+0000 7f927289c640 1 --2- 172.21.15.5:0/3178175419 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f92580663d0 0x7f9258068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.592+0000 7f927289c640 1 --2- 172.21.15.5:0/3178175419 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f926c15fd60 0x7f926c152d80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.592+0000 7f927289c640 1 --2- 172.21.15.5:0/3178175419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f926c0d1850 0x7f926c152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.592+0000 7f927289c640 1 --2- 172.21.15.5:0/3178175419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f926c0b7c70 0x7f926c151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.592+0000 7f927289c640 1 -- 172.21.15.5:0/3178175419 >> 172.21.15.5:0/3178175419 conn(0x7f926c0650b0 msgr2=0x7f926c15f370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.592+0000 7f927289c640 1 -- 172.21.15.5:0/3178175419 shutdown_connections 2023-07-14T13:29:22.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.592+0000 7f927289c640 1 -- 172.21.15.5:0/3178175419 wait complete. 2023-07-14T13:29:22.616 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-14T13:29:22.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:22.617 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-14T13:29:22.673 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:29:22.668+0000 7fa84a82c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:29:22.705 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-07-14T13:29:22.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:22.707 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-14T13:29:22.717 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:29:22.717 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:29:22.726 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:29:22.727 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:29:22.727 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:29:22.730 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:22.729+0000 7fe9fbf48180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:29:22.748 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:29:22.744+0000 7fa84a82c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:29:22.757 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:29:22.758 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:29:22.758 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:29:22.767 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:29:22.768 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:29:22.892 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:29:22.884+0000 7fa84a82c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:29:22.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.940+0000 7fcece648640 1 Processor -- start 2023-07-14T13:29:22.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.940+0000 7fcece648640 1 -- start start 2023-07-14T13:29:22.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.940+0000 7fcece648640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcec80cb780 0x7fcec815b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:22.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.940+0000 7fcece648640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcec806f900 con 0x7fcec80cb060 2023-07-14T13:29:22.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.940+0000 7fcece648640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcec80cd450 con 0x7fcec80cabe0 2023-07-14T13:29:22.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.940+0000 7fcece648640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcec80cdce0 con 0x7fcec80cb780 2023-07-14T13:29:22.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.940+0000 7fcec7fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcec80cb780 0x7fcec815b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:22.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.940+0000 7fceccbe5640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcec80cb060 0x7fcec80ccd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41158/0 (socket says 172.21.15.5:41158) 2023-07-14T13:29:22.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.940+0000 7fceccbe5640 1 -- 172.21.15.5:0/437441801 learned_addr learned my addr 172.21.15.5:0/437441801 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:22.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.940+0000 7fcec77fe640 1 --1- 172.21.15.5:0/437441801 >> v1:172.21.15.154:6789/0 conn(0x7fcec80cabe0 0x7fcec806b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:59392/0 (socket says 172.21.15.5:59392) 2023-07-14T13:29:22.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.940+0000 7fcec6ffd640 1 -- 172.21.15.5:0/437441801 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609132322 0 0) 0x7fcec80cd450 con 0x7fcec80cabe0 2023-07-14T13:29:22.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.940+0000 7fcec7fff640 1 -- 172.21.15.5:0/437441801 >> v1:172.21.15.154:6789/0 conn(0x7fcec80cabe0 legacy=0x7fcec806b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:22.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.940+0000 7fcec7fff640 1 -- 172.21.15.5:0/437441801 >> v1:172.21.15.5:6789/0 conn(0x7fcec80cb060 legacy=0x7fcec80ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:22.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.940+0000 7fcec7fff640 1 -- 172.21.15.5:0/437441801 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec80cd720 con 0x7fcec80cb780 2023-07-14T13:29:22.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.944+0000 7fcec7fff640 1 --2- 172.21.15.5:0/437441801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcec80cb780 0x7fcec815b7c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fceb80097c0 tx=0x7fceb801c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71490c58a0709787 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:22.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.944+0000 7fcec6ffd640 1 -- 172.21.15.5:0/437441801 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb80ab600 con 0x7fcec80cb780 2023-07-14T13:29:22.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.944+0000 7fcec6ffd640 1 -- 172.21.15.5:0/437441801 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb80a7050 con 0x7fcec80cb780 2023-07-14T13:29:22.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.944+0000 7fcec6ffd640 1 -- 172.21.15.5:0/437441801 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb80ab980 con 0x7fcec80cb780 2023-07-14T13:29:22.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.944+0000 7fcece648640 1 -- 172.21.15.5:0/437441801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcec80cb780 msgr2=0x7fcec815b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:22.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.944+0000 7fcece648640 1 --2- 172.21.15.5:0/437441801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcec80cb780 0x7fcec815b7c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fceb80097c0 tx=0x7fceb801c310 comp rx=0 tx=0).stop 2023-07-14T13:29:22.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.944+0000 7fcece648640 1 -- 172.21.15.5:0/437441801 shutdown_connections 2023-07-14T13:29:22.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.944+0000 7fcece648640 1 --2- 172.21.15.5:0/437441801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcec80cb780 0x7fcec815b7c0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:22.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.944+0000 7fcece648640 1 -- 172.21.15.5:0/437441801 >> 172.21.15.5:0/437441801 conn(0x7fcec80afcf0 msgr2=0x7fcec80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:22.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.944+0000 7fcece648640 1 -- 172.21.15.5:0/437441801 shutdown_connections 2023-07-14T13:29:22.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.944+0000 7fcece648640 1 -- 172.21.15.5:0/437441801 wait complete. 2023-07-14T13:29:22.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.948+0000 7fcece648640 1 Processor -- start 2023-07-14T13:29:22.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.948+0000 7fcece648640 1 -- start start 2023-07-14T13:29:22.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.948+0000 7fcece648640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcec80cabe0 0x7fcec81509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:22.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.948+0000 7fcece648640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcec80cb060 0x7fcec80b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:22.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.948+0000 7fcece648640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcec8158c50 0x7fcec81590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:22.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.948+0000 7fcece648640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec80c7400 con 0x7fcec80cabe0 2023-07-14T13:29:22.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.948+0000 7fcece648640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec8159610 con 0x7fcec80cb060 2023-07-14T13:29:22.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.948+0000 7fcece648640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec80c6780 con 0x7fcec8158c50 2023-07-14T13:29:22.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.948+0000 7fcec7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcec80cabe0 0x7fcec81509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:22.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.948+0000 7fcec7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcec80cabe0 0x7fcec81509a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48668/0 (socket says 172.21.15.5:48668) 2023-07-14T13:29:22.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.948+0000 7fcec77fe640 1 --2- 172.21.15.5:0/447007314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcec80cb060 0x7fcec80b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:22.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.948+0000 7fcec7fff640 1 -- 172.21.15.5:0/447007314 learned_addr learned my addr 172.21.15.5:0/447007314 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:22.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.948+0000 7fceccbe5640 1 --2- 172.21.15.5:0/447007314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcec8158c50 0x7fcec81590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:22.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.948+0000 7fcec7fff640 1 -- 172.21.15.5:0/447007314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcec8158c50 msgr2=0x7fcec81590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:22.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.948+0000 7fcec7fff640 1 --2- 172.21.15.5:0/447007314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcec8158c50 0x7fcec81590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:22.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.948+0000 7fcec7fff640 1 -- 172.21.15.5:0/447007314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcec80cb060 msgr2=0x7fcec80b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:22.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.948+0000 7fcec7fff640 1 --2- 172.21.15.5:0/447007314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcec80cb060 0x7fcec80b19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:22.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.948+0000 7fcec7fff640 1 -- 172.21.15.5:0/447007314 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb8009420 con 0x7fcec80cabe0 2023-07-14T13:29:22.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.948+0000 7fcec77fe640 1 --2- 172.21.15.5:0/447007314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcec80cb060 0x7fcec80b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:29:22.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.948+0000 7fcec7fff640 1 --2- 172.21.15.5:0/447007314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcec80cabe0 0x7fcec81509a0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fceb8018f20 tx=0x7fceb801ab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:22.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.948+0000 7fcec4ff9640 1 -- 172.21.15.5:0/447007314 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb80b7920 con 0x7fcec80cabe0 2023-07-14T13:29:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.948+0000 7fcec4ff9640 1 -- 172.21.15.5:0/447007314 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb80b7a80 con 0x7fcec80cabe0 2023-07-14T13:29:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.948+0000 7fcec4ff9640 1 -- 172.21.15.5:0/447007314 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb80b7e10 con 0x7fcec80cabe0 2023-07-14T13:29:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.948+0000 7fcece648640 1 -- 172.21.15.5:0/447007314 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec80c6a60 con 0x7fcec80cabe0 2023-07-14T13:29:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.948+0000 7fcece648640 1 -- 172.21.15.5:0/447007314 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec80c7020 con 0x7fcec80cabe0 2023-07-14T13:29:22.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.952+0000 7fcece648640 1 -- 172.21.15.5:0/447007314 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec80678d0 con 0x7fcec80cabe0 2023-07-14T13:29:22.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.952+0000 7fcec4ff9640 1 -- 172.21.15.5:0/447007314 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 82) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fceb80aa420 con 0x7fcec80cabe0 2023-07-14T13:29:22.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.952+0000 7fcec4ff9640 1 --2- 172.21.15.5:0/447007314 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fceb40663a0 0x7fceb4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:22.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.952+0000 7fcec4ff9640 1 -- 172.21.15.5:0/447007314 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6778+0+0 (secure 0 0 0) 0x7fceb811efc0 con 0x7fcec80cabe0 2023-07-14T13:29:22.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.952+0000 7fcec77fe640 1 -- 172.21.15.5:0/447007314 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fceb40663a0 msgr2=0x7fceb4068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1973779483 2023-07-14T13:29:22.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.952+0000 7fcec77fe640 1 --2- 172.21.15.5:0/447007314 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fceb40663a0 0x7fceb4068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:29:22.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:22.956+0000 7fcec4ff9640 1 -- 172.21.15.5:0/447007314 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fceb80ec090 con 0x7fcec80cabe0 2023-07-14T13:29:23.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.144+0000 7fcece648640 1 -- 172.21.15.5:0/447007314 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcec806c380 con 0x7fcec80cabe0 2023-07-14T13:29:23.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.148+0000 7fcec4ff9640 1 -- 172.21.15.5:0/447007314 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4708 (secure 0 0 0) 0x7fceb80bb070 con 0x7fcec80cabe0 2023-07-14T13:29:23.153 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:29:23.153 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":73,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3146480803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3146480803},{"type":"v1","addr":"172.21.15.154:6837","nonce":3146480803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8908,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2567208960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2567208960},{"type":"v1","addr":"172.21.15.5:6835","nonce":2567208960}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8911,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3591700265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3591700265},{"type":"v1","addr":"172.21.15.154:6836","nonce":3591700265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:13:03.243523+0000","modified":"2023-07-14T13:13:06.886056+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9336":{"gid":9336,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/840216087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":840216087},{"type":"v1","addr":"172.21.15.5:6834","nonce":840216087}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-14T13:29:23.154 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 73 2023-07-14T13:29:23.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.148+0000 7fcece648640 1 -- 172.21.15.5:0/447007314 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fceb40663a0 msgr2=0x7fceb4068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:29:23.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.148+0000 7fcece648640 1 --2- 172.21.15.5:0/447007314 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fceb40663a0 0x7fceb4068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.148+0000 7fcece648640 1 -- 172.21.15.5:0/447007314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcec80cabe0 msgr2=0x7fcec81509a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:23.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.148+0000 7fcece648640 1 --2- 172.21.15.5:0/447007314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcec80cabe0 0x7fcec81509a0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fceb8018f20 tx=0x7fceb801ab50 comp rx=0 tx=0).stop 2023-07-14T13:29:23.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.148+0000 7fcece648640 1 -- 172.21.15.5:0/447007314 shutdown_connections 2023-07-14T13:29:23.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.148+0000 7fcece648640 1 --2- 172.21.15.5:0/447007314 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fceb40663a0 0x7fceb4068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.148+0000 7fcece648640 1 --2- 172.21.15.5:0/447007314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcec8158c50 0x7fcec81590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.148+0000 7fcece648640 1 --2- 172.21.15.5:0/447007314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcec80cb060 0x7fcec80b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.148+0000 7fcece648640 1 --2- 172.21.15.5:0/447007314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcec80cabe0 0x7fcec81509a0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.148+0000 7fcece648640 1 -- 172.21.15.5:0/447007314 >> 172.21.15.5:0/447007314 conn(0x7fcec80afcf0 msgr2=0x7fcec80b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:23.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.148+0000 7fcece648640 1 -- 172.21.15.5:0/447007314 shutdown_connections 2023-07-14T13:29:23.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.148+0000 7fcece648640 1 -- 172.21.15.5:0/447007314 wait complete. 2023-07-14T13:29:23.175 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:29:23.289 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:23.289+0000 7fe9fbf48180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:29:23.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.376+0000 7fd2aa32c640 1 Processor -- start 2023-07-14T13:29:23.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.376+0000 7fd2aa32c640 1 -- start start 2023-07-14T13:29:23.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.380+0000 7fd2aa32c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd2a406b8f0 0x7fd2a4163db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:23.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.380+0000 7fd2aa32c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd2a4160430 0x7fd2a41642f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:23.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.380+0000 7fd2aa32c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a406fb70 con 0x7fd2a4160060 2023-07-14T13:29:23.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.380+0000 7fd2aa32c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a4071010 con 0x7fd2a4160430 2023-07-14T13:29:23.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.380+0000 7fd2aa32c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a40cf0f0 con 0x7fd2a406b8f0 2023-07-14T13:29:23.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.380+0000 7fd2a3fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd2a4160060 0x7fd2a406b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:59406/0 (socket says 172.21.15.5:59406) 2023-07-14T13:29:23.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.380+0000 7fd2a3fff640 1 -- 172.21.15.5:0/4067939366 learned_addr learned my addr 172.21.15.5:0/4067939366 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:23.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.380+0000 7fd2a88c9640 1 --2- 172.21.15.5:0/4067939366 >> v2:172.21.15.5:3300/0 conn(0x7fd2a4160430 0x7fd2a41642f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:23.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.380+0000 7fd2a37fe640 1 --2- 172.21.15.5:0/4067939366 >> v2:172.21.15.154:3300/0 conn(0x7fd2a406b8f0 0x7fd2a4163db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:23.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.380+0000 7fd2a88c9640 1 -- 172.21.15.5:0/4067939366 >> v2:172.21.15.154:3300/0 conn(0x7fd2a406b8f0 msgr2=0x7fd2a4163db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:23.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.380+0000 7fd2a88c9640 1 --2- 172.21.15.5:0/4067939366 >> v2:172.21.15.154:3300/0 conn(0x7fd2a406b8f0 0x7fd2a4163db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.380+0000 7fd2a88c9640 1 -- 172.21.15.5:0/4067939366 >> v1:172.21.15.154:6789/0 conn(0x7fd2a4160060 legacy=0x7fd2a406b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:23.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.380+0000 7fd2a88c9640 1 -- 172.21.15.5:0/4067939366 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a4164ca0 con 0x7fd2a4160430 2023-07-14T13:29:23.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.384+0000 7fd2a88c9640 1 --2- 172.21.15.5:0/4067939366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a4160430 0x7fd2a41642f0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fd2a406afa0 tx=0x7fd29c01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869672c6643ad4d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:23.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.384+0000 7fd2a2ffd640 1 -- 172.21.15.5:0/4067939366 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c0a5960 con 0x7fd2a4160430 2023-07-14T13:29:23.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.384+0000 7fd2a2ffd640 1 -- 172.21.15.5:0/4067939366 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29c0a5ac0 con 0x7fd2a4160430 2023-07-14T13:29:23.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.384+0000 7fd2a2ffd640 1 -- 172.21.15.5:0/4067939366 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c0a5e50 con 0x7fd2a4160430 2023-07-14T13:29:23.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.388+0000 7fd2aa32c640 1 -- 172.21.15.5:0/4067939366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a4160430 msgr2=0x7fd2a41642f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:23.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.388+0000 7fd2aa32c640 1 --2- 172.21.15.5:0/4067939366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a4160430 0x7fd2a41642f0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fd2a406afa0 tx=0x7fd29c01c8a0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.388+0000 7fd2aa32c640 1 -- 172.21.15.5:0/4067939366 shutdown_connections 2023-07-14T13:29:23.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.388+0000 7fd2aa32c640 1 --2- 172.21.15.5:0/4067939366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a4160430 0x7fd2a41642f0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.388+0000 7fd2aa32c640 1 --2- 172.21.15.5:0/4067939366 >> v2:172.21.15.154:3300/0 conn(0x7fd2a406b8f0 0x7fd2a4163db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.388+0000 7fd2aa32c640 1 -- 172.21.15.5:0/4067939366 >> 172.21.15.5:0/4067939366 conn(0x7fd2a40b0980 msgr2=0x7fd2a40ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:23.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.388+0000 7fd2aa32c640 1 -- 172.21.15.5:0/4067939366 shutdown_connections 2023-07-14T13:29:23.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.388+0000 7fd2aa32c640 1 -- 172.21.15.5:0/4067939366 wait complete. 2023-07-14T13:29:23.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.388+0000 7fd2aa32c640 1 Processor -- start 2023-07-14T13:29:23.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.388+0000 7fd2aa32c640 1 -- start start 2023-07-14T13:29:23.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.392+0000 7fd2aa32c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2a406b8f0 0x7fd2a40ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:23.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.392+0000 7fd2aa32c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2a4160060 0x7fd2a415d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:23.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.392+0000 7fd2aa32c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a4160430 0x7fd2a415eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:23.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.392+0000 7fd2aa32c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a415e970 con 0x7fd2a4160430 2023-07-14T13:29:23.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.392+0000 7fd2aa32c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a415e690 con 0x7fd2a406b8f0 2023-07-14T13:29:23.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.392+0000 7fd2aa32c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a415dd60 con 0x7fd2a4160060 2023-07-14T13:29:23.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.392+0000 7fd2a37fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2a4160060 0x7fd2a415d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:23.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.392+0000 7fd2a37fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2a4160060 0x7fd2a415d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:36746/0 (socket says 172.21.15.5:36746) 2023-07-14T13:29:23.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.392+0000 7fd2a37fe640 1 -- 172.21.15.5:0/534777834 learned_addr learned my addr 172.21.15.5:0/534777834 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:23.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.392+0000 7fd2a88c9640 1 --2- 172.21.15.5:0/534777834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a4160430 0x7fd2a415eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:23.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.392+0000 7fd2a3fff640 1 --2- 172.21.15.5:0/534777834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2a406b8f0 0x7fd2a40ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:23.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.392+0000 7fd2a37fe640 1 -- 172.21.15.5:0/534777834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2a406b8f0 msgr2=0x7fd2a40ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:23.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.392+0000 7fd2a37fe640 1 --2- 172.21.15.5:0/534777834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2a406b8f0 0x7fd2a40ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.392+0000 7fd2a37fe640 1 -- 172.21.15.5:0/534777834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a4160430 msgr2=0x7fd2a415eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:23.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.392+0000 7fd2a37fe640 1 --2- 172.21.15.5:0/534777834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a4160430 0x7fd2a415eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.392+0000 7fd2a37fe640 1 -- 172.21.15.5:0/534777834 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29c009a70 con 0x7fd2a4160060 2023-07-14T13:29:23.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.392+0000 7fd2a3fff640 1 --2- 172.21.15.5:0/534777834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2a406b8f0 0x7fd2a40ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:29:23.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.392+0000 7fd2a88c9640 1 --2- 172.21.15.5:0/534777834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a4160430 0x7fd2a415eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:29:23.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.396+0000 7fd2a37fe640 1 --2- 172.21.15.5:0/534777834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2a4160060 0x7fd2a415d2c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd29800c610 tx=0x7fd29800cad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:23.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.396+0000 7fd2a0ff9640 1 -- 172.21.15.5:0/534777834 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd298004220 con 0x7fd2a4160060 2023-07-14T13:29:23.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.396+0000 7fd2a0ff9640 1 -- 172.21.15.5:0/534777834 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd298004380 con 0x7fd2a4160060 2023-07-14T13:29:23.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.396+0000 7fd2a0ff9640 1 -- 172.21.15.5:0/534777834 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd298003860 con 0x7fd2a4160060 2023-07-14T13:29:23.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.396+0000 7fd2aa32c640 1 -- 172.21.15.5:0/534777834 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a415e040 con 0x7fd2a4160060 2023-07-14T13:29:23.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.396+0000 7fd2aa32c640 1 -- 172.21.15.5:0/534777834 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a40c27f0 con 0x7fd2a4160060 2023-07-14T13:29:23.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.396+0000 7fd2aa32c640 1 -- 172.21.15.5:0/534777834 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a40678d0 con 0x7fd2a4160060 2023-07-14T13:29:23.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.400+0000 7fd2a0ff9640 1 -- 172.21.15.5:0/534777834 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 82) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fd2980039c0 con 0x7fd2a4160060 2023-07-14T13:29:23.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.400+0000 7fd2a0ff9640 1 --2- 172.21.15.5:0/534777834 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fd2900663f0 0x7fd2900688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:23.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.400+0000 7fd2a0ff9640 1 -- 172.21.15.5:0/534777834 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6834+0+0 (secure 0 0 0) 0x7fd298083f40 con 0x7fd2a4160060 2023-07-14T13:29:23.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.400+0000 7fd2a3fff640 1 -- 172.21.15.5:0/534777834 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fd2900663f0 msgr2=0x7fd2900688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1973779483 2023-07-14T13:29:23.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.400+0000 7fd2a3fff640 1 --2- 172.21.15.5:0/534777834 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fd2900663f0 0x7fd2900688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:29:23.408 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:23.405+0000 7fe9fbf48180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:29:23.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.404+0000 7fd2a0ff9640 1 -- 172.21.15.5:0/534777834 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd2980b4720 con 0x7fd2a4160060 2023-07-14T13:29:23.543 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:29:23.536+0000 7fa84a82c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:29:23.558 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:23.557+0000 7fe9fbf48180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:29:23.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.568+0000 7fd2aa32c640 1 -- 172.21.15.5:0/534777834 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2a406b6d0 con 0x7fd2a4160060 2023-07-14T13:29:23.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.568+0000 7fd2a0ff9640 1 -- 172.21.15.5:0/534777834 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+19435 (secure 0 0 0) 0x7fd29801e020 con 0x7fd2a4160060 2023-07-14T13:29:23.575 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:29:23.576 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":159,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:29:23.175339+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:13:01.372511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-14T13:13:02.236215+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":159,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/3205049834":"2023-07-15T13:24:20.729701+0000","172.21.15.154:0/2448917971":"2023-07-15T13:24:20.729701+0000","172.21.15.154:0/3347209674":"2023-07-15T13:24:20.729701+0000","172.21.15.154:0/2602756791":"2023-07-15T13:24:20.729701+0000","172.21.15.154:6833/3414173858":"2023-07-15T13:24:20.729701+0000","172.21.15.154:0/1387122589":"2023-07-15T13:24:20.729701+0000","172.21.15.154:0/2148864146":"2023-07-15T13:24:20.729701+0000","172.21.15.154:0/1540806126":"2023-07-15T13:13:20.528876+0000","172.21.15.154:0/77258959":"2023-07-15T13:13:20.528876+0000","172.21.15.154:0/1084316036":"2023-07-15T13:13:20.528876+0000","172.21.15.154:0/661817451":"2023-07-15T13:13:20.528876+0000","172.21.15.154:0/261234270":"2023-07-15T13:13:20.528876+0000","172.21.15.154:0/3779193680":"2023-07-15T13:13:20.528876+0000","172.21.15.154:6832/3414173858":"2023-07-15T13:24:20.729701+0000","172.21.15.154:6833/1443161386":"2023-07-15T13:13:20.528876+0000","172.21.15.154:6832/1443161386":"2023-07-15T13:13:20.528876+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:29:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.572+0000 7fd2aa32c640 1 -- 172.21.15.5:0/534777834 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fd2900663f0 msgr2=0x7fd2900688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:29:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.572+0000 7fd2aa32c640 1 --2- 172.21.15.5:0/534777834 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fd2900663f0 0x7fd2900688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.572+0000 7fd2aa32c640 1 -- 172.21.15.5:0/534777834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2a4160060 msgr2=0x7fd2a415d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.572+0000 7fd2aa32c640 1 --2- 172.21.15.5:0/534777834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2a4160060 0x7fd2a415d2c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd29800c610 tx=0x7fd29800cad0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.572+0000 7fd2aa32c640 1 -- 172.21.15.5:0/534777834 shutdown_connections 2023-07-14T13:29:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.572+0000 7fd2aa32c640 1 --2- 172.21.15.5:0/534777834 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7fd2900663f0 0x7fd2900688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.572+0000 7fd2aa32c640 1 --2- 172.21.15.5:0/534777834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a4160430 0x7fd2a415eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.572+0000 7fd2aa32c640 1 --2- 172.21.15.5:0/534777834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2a4160060 0x7fd2a415d2c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.572+0000 7fd2aa32c640 1 --2- 172.21.15.5:0/534777834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2a406b8f0 0x7fd2a40ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.572+0000 7fd2aa32c640 1 -- 172.21.15.5:0/534777834 >> 172.21.15.5:0/534777834 conn(0x7fd2a40b0980 msgr2=0x7fd2a40af4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.572+0000 7fd2aa32c640 1 -- 172.21.15.5:0/534777834 shutdown_connections 2023-07-14T13:29:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.572+0000 7fd2aa32c640 1 -- 172.21.15.5:0/534777834 wait complete. 2023-07-14T13:29:23.597 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T13:13:01.372511+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '155', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T13:13:02.236215+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '159', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 33, 'snap_epoch': 159, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:29:23.598 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:29:23.637 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:29:23.628+0000 7fa84a82c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:29:23.641 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:23.641+0000 7fe9fbf48180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:29:23.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.768+0000 7f05b4cf9640 1 Processor -- start 2023-07-14T13:29:23.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.768+0000 7f05b4cf9640 1 -- start start 2023-07-14T13:29:23.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.772+0000 7f05b4cf9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05b00cdd10 0x7f05b00ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:23.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.772+0000 7f05b4cf9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f05b00b1770 0x7f05b00d0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:23.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.772+0000 7f05b4cf9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f05b00d0650 0x7f05b00ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:23.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.772+0000 7f05b4cf9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b00d0ad0 con 0x7f05b00d0650 2023-07-14T13:29:23.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.772+0000 7f05b4cf9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b00b0450 con 0x7f05b00b1770 2023-07-14T13:29:23.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.772+0000 7f05b4cf9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b00ce620 con 0x7f05b00cdd10 2023-07-14T13:29:23.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.772+0000 7f05add9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f05b00b1770 0x7f05b00d0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:23.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.772+0000 7f05add9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f05b00b1770 0x7f05b00d0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:49100/0 (socket says 172.21.15.5:49100) 2023-07-14T13:29:23.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.772+0000 7f05add9b640 1 -- 172.21.15.5:0/1635337704 learned_addr learned my addr 172.21.15.5:0/1635337704 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:23.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.772+0000 7f05ae59c640 1 --2- 172.21.15.5:0/1635337704 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05b00cdd10 0x7f05b00ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:23.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.772+0000 7f05aed9d640 1 --2- 172.21.15.5:0/1635337704 >> v2:172.21.15.5:3300/0 conn(0x7f05b00d0650 0x7f05b00ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:23.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.772+0000 7f05add9b640 1 -- 172.21.15.5:0/1635337704 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05b00cdd10 msgr2=0x7f05b00ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:23.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.772+0000 7f05add9b640 1 --2- 172.21.15.5:0/1635337704 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05b00cdd10 0x7f05b00ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.772+0000 7f05add9b640 1 -- 172.21.15.5:0/1635337704 >> v2:172.21.15.5:3300/0 conn(0x7f05b00d0650 msgr2=0x7f05b00ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:23.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.772+0000 7f05add9b640 1 --2- 172.21.15.5:0/1635337704 >> v2:172.21.15.5:3300/0 conn(0x7f05b00d0650 0x7f05b00ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.772+0000 7f05add9b640 1 -- 172.21.15.5:0/1635337704 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b00b06d0 con 0x7f05b00b1770 2023-07-14T13:29:23.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.780+0000 7f05add9b640 1 --2- 172.21.15.5:0/1635337704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05b00b1770 0x7f05b00d0110 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f05b0070ba0 tx=0x7f05a0020620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a52653c759f5c31d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:23.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.780+0000 7f05ad59a640 1 -- 172.21.15.5:0/1635337704 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a00ae660 con 0x7f05b00b1770 2023-07-14T13:29:23.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.780+0000 7f05ad59a640 1 -- 172.21.15.5:0/1635337704 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a00ae7c0 con 0x7f05b00b1770 2023-07-14T13:29:23.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.780+0000 7f05ad59a640 1 -- 172.21.15.5:0/1635337704 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a00aeb50 con 0x7f05b00b1770 2023-07-14T13:29:23.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.780+0000 7f05b4cf9640 1 -- 172.21.15.5:0/1635337704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05b00b1770 msgr2=0x7f05b00d0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:23.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.780+0000 7f05b4cf9640 1 --2- 172.21.15.5:0/1635337704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05b00b1770 0x7f05b00d0110 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f05b0070ba0 tx=0x7f05a0020620 comp rx=0 tx=0).stop 2023-07-14T13:29:23.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.780+0000 7f05b4cf9640 1 -- 172.21.15.5:0/1635337704 shutdown_connections 2023-07-14T13:29:23.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.780+0000 7f05b4cf9640 1 --2- 172.21.15.5:0/1635337704 >> v2:172.21.15.5:3300/0 conn(0x7f05b00d0650 0x7f05b00ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.780+0000 7f05b4cf9640 1 --2- 172.21.15.5:0/1635337704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05b00b1770 0x7f05b00d0110 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.780+0000 7f05b4cf9640 1 --2- 172.21.15.5:0/1635337704 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05b00cdd10 0x7f05b00ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.780+0000 7f05b4cf9640 1 -- 172.21.15.5:0/1635337704 >> 172.21.15.5:0/1635337704 conn(0x7f05b0099490 msgr2=0x7f05b0089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:23.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.780+0000 7f05b4cf9640 1 -- 172.21.15.5:0/1635337704 shutdown_connections 2023-07-14T13:29:23.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.780+0000 7f05b4cf9640 1 -- 172.21.15.5:0/1635337704 wait complete. 2023-07-14T13:29:23.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.784+0000 7f05b4cf9640 1 Processor -- start 2023-07-14T13:29:23.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.784+0000 7f05b4cf9640 1 -- start start 2023-07-14T13:29:23.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.784+0000 7f05b4cf9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05b00b1770 0x7f05b01fb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:23.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.784+0000 7f05b4cf9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05b00cdd10 0x7f05b01f93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:23.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.784+0000 7f05b4cf9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05b00d0650 0x7f05b00b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:23.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.784+0000 7f05b4cf9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b01fb700 con 0x7f05b00d0650 2023-07-14T13:29:23.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.784+0000 7f05b4cf9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b0155b40 con 0x7f05b00cdd10 2023-07-14T13:29:23.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.784+0000 7f05b4cf9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b014de60 con 0x7f05b00b1770 2023-07-14T13:29:23.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.784+0000 7f05aed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05b00d0650 0x7f05b00b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:23.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.784+0000 7f05aed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05b00d0650 0x7f05b00b2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48706/0 (socket says 172.21.15.5:48706) 2023-07-14T13:29:23.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.784+0000 7f05aed9d640 1 -- 172.21.15.5:0/143170707 learned_addr learned my addr 172.21.15.5:0/143170707 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:23.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.784+0000 7f05ae59c640 1 --2- 172.21.15.5:0/143170707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05b00b1770 0x7f05b01fb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:23.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.784+0000 7f05add9b640 1 --2- 172.21.15.5:0/143170707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05b00cdd10 0x7f05b01f93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:23.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.784+0000 7f05aed9d640 1 -- 172.21.15.5:0/143170707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05b00b1770 msgr2=0x7f05b01fb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:23.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.784+0000 7f05aed9d640 1 --2- 172.21.15.5:0/143170707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05b00b1770 0x7f05b01fb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.784+0000 7f05aed9d640 1 -- 172.21.15.5:0/143170707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05b00cdd10 msgr2=0x7f05b01f93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:23.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.784+0000 7f05aed9d640 1 --2- 172.21.15.5:0/143170707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05b00cdd10 0x7f05b01f93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.784+0000 7f05aed9d640 1 -- 172.21.15.5:0/143170707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a00094d0 con 0x7f05b00d0650 2023-07-14T13:29:23.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.784+0000 7f05add9b640 1 --2- 172.21.15.5:0/143170707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05b00cdd10 0x7f05b01f93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:29:23.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.784+0000 7f05aed9d640 1 --2- 172.21.15.5:0/143170707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05b00d0650 0x7f05b00b2f70 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f05a8007e40 tx=0x7f05a800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:23.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.788+0000 7f059effd640 1 -- 172.21.15.5:0/143170707 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a8014620 con 0x7f05b00d0650 2023-07-14T13:29:23.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.788+0000 7f059effd640 1 -- 172.21.15.5:0/143170707 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a800ee90 con 0x7f05b00d0650 2023-07-14T13:29:23.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.788+0000 7f059effd640 1 -- 172.21.15.5:0/143170707 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a80149e0 con 0x7f05b00d0650 2023-07-14T13:29:23.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.788+0000 7f05b4cf9640 1 -- 172.21.15.5:0/143170707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b00b6050 con 0x7f05b00d0650 2023-07-14T13:29:23.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.788+0000 7f05b4cf9640 1 -- 172.21.15.5:0/143170707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b01554f0 con 0x7f05b00d0650 2023-07-14T13:29:23.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.788+0000 7f05b4cf9640 1 -- 172.21.15.5:0/143170707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b008a5b0 con 0x7f05b00d0650 2023-07-14T13:29:23.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.788+0000 7f059effd640 1 -- 172.21.15.5:0/143170707 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 82) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f05a8014b40 con 0x7f05b00d0650 2023-07-14T13:29:23.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.792+0000 7f059effd640 1 --2- 172.21.15.5:0/143170707 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f05900663f0 0x7f05900688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:23.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.792+0000 7f059effd640 1 -- 172.21.15.5:0/143170707 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6834+0+0 (secure 0 0 0) 0x7f05a8084a30 con 0x7f05b00d0650 2023-07-14T13:29:23.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.792+0000 7f05ae59c640 1 -- 172.21.15.5:0/143170707 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f05900663f0 msgr2=0x7f05900688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1973779483 2023-07-14T13:29:23.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.792+0000 7f05ae59c640 1 --2- 172.21.15.5:0/143170707 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f05900663f0 0x7f05900688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:29:23.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.796+0000 7f059effd640 1 -- 172.21.15.5:0/143170707 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f05a8051b20 con 0x7f05b00d0650 2023-07-14T13:29:23.836 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:29:23.828+0000 7fa84a82c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:29:23.924 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:29:23.916+0000 7fa84a82c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:29:23.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.956+0000 7f05b4cf9640 1 -- 172.21.15.5:0/143170707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f05b00678d0 con 0x7f05b00d0650 2023-07-14T13:29:23.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.956+0000 7f059effd640 1 -- 172.21.15.5:0/143170707 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v159) v1 ==== 93+0+10 (secure 0 0 0) 0x7f05a8055140 con 0x7f05b00d0650 2023-07-14T13:29:23.962 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:29:23.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.956+0000 7f05b4cf9640 1 -- 172.21.15.5:0/143170707 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f05900663f0 msgr2=0x7f05900688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:29:23.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.956+0000 7f05b4cf9640 1 --2- 172.21.15.5:0/143170707 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f05900663f0 0x7f05900688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.956+0000 7f05b4cf9640 1 -- 172.21.15.5:0/143170707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05b00d0650 msgr2=0x7f05b00b2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:23.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.956+0000 7f05b4cf9640 1 --2- 172.21.15.5:0/143170707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05b00d0650 0x7f05b00b2f70 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f05a8007e40 tx=0x7f05a800e4b0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.956+0000 7f05b4cf9640 1 -- 172.21.15.5:0/143170707 shutdown_connections 2023-07-14T13:29:23.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.956+0000 7f05b4cf9640 1 --2- 172.21.15.5:0/143170707 >> [v2:172.21.15.154:6832/1973779483,v1:172.21.15.154:6833/1973779483] conn(0x7f05900663f0 0x7f05900688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.956+0000 7f05b4cf9640 1 --2- 172.21.15.5:0/143170707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05b00d0650 0x7f05b00b2f70 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.956+0000 7f05b4cf9640 1 --2- 172.21.15.5:0/143170707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05b00cdd10 0x7f05b01f93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.956+0000 7f05b4cf9640 1 --2- 172.21.15.5:0/143170707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f05b00b1770 0x7f05b01fb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:23.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.956+0000 7f05b4cf9640 1 -- 172.21.15.5:0/143170707 >> 172.21.15.5:0/143170707 conn(0x7f05b0099490 msgr2=0x7f05b00afa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:23.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.956+0000 7f05b4cf9640 1 -- 172.21.15.5:0/143170707 shutdown_connections 2023-07-14T13:29:23.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:23.956+0000 7f05b4cf9640 1 -- 172.21.15.5:0/143170707 wait complete. 2023-07-14T13:29:23.967 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:23.965+0000 7fe9fbf48180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:29:23.983 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:29:24.027 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:24.025+0000 7fe9fbf48180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:29:24.107 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:24.105+0000 7fe9881c3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:29:24.108 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:24.105+0000 7fe9881c3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:29:24.108 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:24.105+0000 7fe9881c3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:29:24.108 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:24.105+0000 7fe9881c3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:29:24.108 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:24.105+0000 7fe9881c3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:29:24.109 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:24.105+0000 7fe9851bd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:29:24.109 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:24.105+0000 7fe9851bd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:29:24.110 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:24.105+0000 7fe9851bd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:29:24.110 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:24.105+0000 7fe9851bd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:29:24.110 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:24.105+0000 7fe9851bd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:29:24.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.180+0000 7f6db7f11640 1 Processor -- start 2023-07-14T13:29:24.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.180+0000 7f6db7f11640 1 -- start start 2023-07-14T13:29:24.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.180+0000 7f6db7f11640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6db00d2fc0 0x7f6db00b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:24.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.180+0000 7f6db7f11640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6db00d2300 0x7f6db00d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:24.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.180+0000 7f6db7f11640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db00b04c0 con 0x7f6db015bde0 2023-07-14T13:29:24.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.180+0000 7f6db7f11640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db015c1b0 con 0x7f6db00d2fc0 2023-07-14T13:29:24.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.180+0000 7f6db7f11640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db00d2c80 con 0x7f6db00d2300 2023-07-14T13:29:24.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.180+0000 7f6db5cad640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6db015bde0 0x7f6db00d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:59416/0 (socket says 172.21.15.5:59416) 2023-07-14T13:29:24.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.180+0000 7f6db5cad640 1 -- 172.21.15.5:0/1409315350 learned_addr learned my addr 172.21.15.5:0/1409315350 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:24.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.180+0000 7f6db54ac640 1 --2- 172.21.15.5:0/1409315350 >> v2:172.21.15.5:3300/0 conn(0x7f6db00d2fc0 0x7f6db00b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:24.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.180+0000 7f6db64ae640 1 --2- 172.21.15.5:0/1409315350 >> v2:172.21.15.154:3300/0 conn(0x7f6db00d2300 0x7f6db00d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:24.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.184+0000 7f6db54ac640 1 -- 172.21.15.5:0/1409315350 >> v2:172.21.15.154:3300/0 conn(0x7f6db00d2300 msgr2=0x7f6db00d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:24.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.184+0000 7f6db54ac640 1 --2- 172.21.15.5:0/1409315350 >> v2:172.21.15.154:3300/0 conn(0x7f6db00d2300 0x7f6db00d2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:24.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.184+0000 7f6db54ac640 1 -- 172.21.15.5:0/1409315350 >> v1:172.21.15.154:6789/0 conn(0x7f6db015bde0 legacy=0x7f6db00d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:24.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.184+0000 7f6db54ac640 1 -- 172.21.15.5:0/1409315350 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db00d0aa0 con 0x7f6db00d2fc0 2023-07-14T13:29:24.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.184+0000 7f6db64ae640 1 --2- 172.21.15.5:0/1409315350 >> v2:172.21.15.154:3300/0 conn(0x7f6db00d2300 0x7f6db00d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:29:24.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.184+0000 7f6db54ac640 1 --2- 172.21.15.5:0/1409315350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6db00d2fc0 0x7f6db00b0950 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f6db008c820 tx=0x7f6da001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665db0fa08a6c783 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:24.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.188+0000 7f6db4cab640 1 -- 172.21.15.5:0/1409315350 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da00ab660 con 0x7f6db00d2fc0 2023-07-14T13:29:24.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.188+0000 7f6db4cab640 1 -- 172.21.15.5:0/1409315350 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da00ab7c0 con 0x7f6db00d2fc0 2023-07-14T13:29:24.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.188+0000 7f6db4cab640 1 -- 172.21.15.5:0/1409315350 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da00abb50 con 0x7f6db00d2fc0 2023-07-14T13:29:24.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.188+0000 7f6db7f11640 1 -- 172.21.15.5:0/1409315350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6db00d2fc0 msgr2=0x7f6db00b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:24.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.188+0000 7f6db7f11640 1 --2- 172.21.15.5:0/1409315350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6db00d2fc0 0x7f6db00b0950 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f6db008c820 tx=0x7f6da001c460 comp rx=0 tx=0).stop 2023-07-14T13:29:24.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.188+0000 7f6db7f11640 1 -- 172.21.15.5:0/1409315350 shutdown_connections 2023-07-14T13:29:24.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.188+0000 7f6db7f11640 1 --2- 172.21.15.5:0/1409315350 >> v2:172.21.15.154:3300/0 conn(0x7f6db00d2300 0x7f6db00d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:24.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.188+0000 7f6db7f11640 1 --2- 172.21.15.5:0/1409315350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6db00d2fc0 0x7f6db00b0950 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:24.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.188+0000 7f6db7f11640 1 -- 172.21.15.5:0/1409315350 >> 172.21.15.5:0/1409315350 conn(0x7f6db00659d0 msgr2=0x7f6db009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:24.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.188+0000 7f6db7f11640 1 -- 172.21.15.5:0/1409315350 shutdown_connections 2023-07-14T13:29:24.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.188+0000 7f6db7f11640 1 -- 172.21.15.5:0/1409315350 wait complete. 2023-07-14T13:29:24.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.188+0000 7f6db7f11640 1 Processor -- start 2023-07-14T13:29:24.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.188+0000 7f6db7f11640 1 -- start start 2023-07-14T13:29:24.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.192+0000 7f6db7f11640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6db00d2300 0x7f6db01585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:24.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.192+0000 7f6db7f11640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6db00d2fc0 0x7f6db00c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:24.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.192+0000 7f6db7f11640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6db015bde0 0x7f6db00c6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:24.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.192+0000 7f6db7f11640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db015c490 con 0x7f6db00d2fc0 2023-07-14T13:29:24.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.192+0000 7f6db7f11640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db015c770 con 0x7f6db015bde0 2023-07-14T13:29:24.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.192+0000 7f6db7f11640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db015ca50 con 0x7f6db00d2300 2023-07-14T13:29:24.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.192+0000 7f6db54ac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6db00d2fc0 0x7f6db00c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:24.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.192+0000 7f6db54ac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6db00d2fc0 0x7f6db00c6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48722/0 (socket says 172.21.15.5:48722) 2023-07-14T13:29:24.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.192+0000 7f6db54ac640 1 -- 172.21.15.5:0/3291408481 learned_addr learned my addr 172.21.15.5:0/3291408481 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:24.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.192+0000 7f6db5cad640 1 --2- 172.21.15.5:0/3291408481 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6db00d2300 0x7f6db01585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:24.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.192+0000 7f6db64ae640 1 --2- 172.21.15.5:0/3291408481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6db015bde0 0x7f6db00c6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:24.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.192+0000 7f6db54ac640 1 -- 172.21.15.5:0/3291408481 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6db00d2300 msgr2=0x7f6db01585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:24.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.192+0000 7f6db54ac640 1 --2- 172.21.15.5:0/3291408481 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6db00d2300 0x7f6db01585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:24.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.192+0000 7f6db54ac640 1 -- 172.21.15.5:0/3291408481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6db015bde0 msgr2=0x7f6db00c6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:24.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.192+0000 7f6db54ac640 1 --2- 172.21.15.5:0/3291408481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6db015bde0 0x7f6db00c6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:24.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.192+0000 7f6db54ac640 1 -- 172.21.15.5:0/3291408481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da8009a70 con 0x7f6db00d2fc0 2023-07-14T13:29:24.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.192+0000 7f6db5cad640 1 --2- 172.21.15.5:0/3291408481 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6db00d2300 0x7f6db01585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:29:24.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.192+0000 7f6db64ae640 1 --2- 172.21.15.5:0/3291408481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6db015bde0 0x7f6db00c6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:29:24.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.192+0000 7f6db54ac640 1 --2- 172.21.15.5:0/3291408481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6db00d2fc0 0x7f6db00c6250 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f6da0019070 tx=0x7f6da001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:24.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.192+0000 7f6da67fc640 1 -- 172.21.15.5:0/3291408481 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da00b5810 con 0x7f6db00d2fc0 2023-07-14T13:29:24.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.192+0000 7f6da67fc640 1 -- 172.21.15.5:0/3291408481 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da00b5990 con 0x7f6db00d2fc0 2023-07-14T13:29:24.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.192+0000 7f6da67fc640 1 -- 172.21.15.5:0/3291408481 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da00b5d40 con 0x7f6db00d2fc0 2023-07-14T13:29:24.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.192+0000 7f6db7f11640 1 -- 172.21.15.5:0/3291408481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da0009420 con 0x7f6db00d2fc0 2023-07-14T13:29:24.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.192+0000 7f6db7f11640 1 -- 172.21.15.5:0/3291408481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db015d010 con 0x7f6db00d2fc0 2023-07-14T13:29:24.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.192+0000 7f6db7f11640 1 -- 172.21.15.5:0/3291408481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db015d200 con 0x7f6db00d2fc0 2023-07-14T13:29:24.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.192+0000 7f6da67fc640 1 -- 172.21.15.5:0/3291408481 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 83) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f6da00a9070 con 0x7f6db00d2fc0 2023-07-14T13:29:24.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.196+0000 7f6da67fc640 1 -- 172.21.15.5:0/3291408481 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 7150+0+0 (secure 0 0 0) 0x7f6da011e2f0 con 0x7f6db00d2fc0 2023-07-14T13:29:24.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.200+0000 7f6da67fc640 1 -- 172.21.15.5:0/3291408481 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6da00eb7b0 con 0x7f6db00d2fc0 2023-07-14T13:29:24.230 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:29:24.224+0000 7fa84a82c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:29:24.294 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:29:24.288+0000 7fa84a82c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:29:24.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.356+0000 7f6db7f11640 1 -- 172.21.15.5:0/3291408481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6db00678d0 con 0x7f6db00d2fc0 2023-07-14T13:29:24.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.356+0000 7f6da67fc640 1 -- 172.21.15.5:0/3291408481 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v160) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6da00ab620 con 0x7f6db00d2fc0 2023-07-14T13:29:24.364 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:29:24.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.360+0000 7f6db7f11640 1 -- 172.21.15.5:0/3291408481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6db00d2fc0 msgr2=0x7f6db00c6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:24.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.360+0000 7f6db7f11640 1 --2- 172.21.15.5:0/3291408481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6db00d2fc0 0x7f6db00c6250 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f6da0019070 tx=0x7f6da001aca0 comp rx=0 tx=0).stop 2023-07-14T13:29:24.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.360+0000 7f6db7f11640 1 -- 172.21.15.5:0/3291408481 shutdown_connections 2023-07-14T13:29:24.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.360+0000 7f6db7f11640 1 --2- 172.21.15.5:0/3291408481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6db015bde0 0x7f6db00c6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:24.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.360+0000 7f6db7f11640 1 --2- 172.21.15.5:0/3291408481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6db00d2fc0 0x7f6db00c6250 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:24.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.360+0000 7f6db7f11640 1 --2- 172.21.15.5:0/3291408481 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6db00d2300 0x7f6db01585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:24.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.360+0000 7f6db7f11640 1 -- 172.21.15.5:0/3291408481 >> 172.21.15.5:0/3291408481 conn(0x7f6db00659d0 msgr2=0x7f6db015a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:24.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.360+0000 7f6db7f11640 1 -- 172.21.15.5:0/3291408481 shutdown_connections 2023-07-14T13:29:24.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.360+0000 7f6db7f11640 1 -- 172.21.15.5:0/3291408481 wait complete. 2023-07-14T13:29:24.385 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T13:29:24.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.524+0000 7f123f737640 1 Processor -- start 2023-07-14T13:29:24.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.524+0000 7f123f737640 1 -- start start 2023-07-14T13:29:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.528+0000 7f123f737640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f123806a540 0x7f123806a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.528+0000 7f123f737640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f12380cf2e0 0x7f12380cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.528+0000 7f123f737640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12380cb7a0 con 0x7f12380cc9c0 2023-07-14T13:29:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.528+0000 7f123f737640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12380d0920 con 0x7f12380cf2e0 2023-07-14T13:29:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.528+0000 7f123f737640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123815bfd0 con 0x7f123806a540 2023-07-14T13:29:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.528+0000 7f123ccd2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f12380cf2e0 0x7f12380cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.528+0000 7f123ccd2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f12380cf2e0 0x7f12380cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48734/0 (socket says 172.21.15.5:48734) 2023-07-14T13:29:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.528+0000 7f123ccd2640 1 -- 172.21.15.5:0/3289682653 learned_addr learned my addr 172.21.15.5:0/3289682653 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:24.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.528+0000 7f123d4d3640 1 --2- 172.21.15.5:0/3289682653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f123806a540 0x7f123806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:24.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.528+0000 7f123ccd2640 1 -- 172.21.15.5:0/3289682653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f123806a540 msgr2=0x7f123806a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:24.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.528+0000 7f123ccd2640 1 --2- 172.21.15.5:0/3289682653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f123806a540 0x7f123806a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:24.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.528+0000 7f123ccd2640 1 -- 172.21.15.5:0/3289682653 >> v1:172.21.15.5:6789/0 conn(0x7f12380cc9c0 legacy=0x7f12380cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:24.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.528+0000 7f123ccd2640 1 -- 172.21.15.5:0/3289682653 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123806ae50 con 0x7f12380cf2e0 2023-07-14T13:29:24.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.532+0000 7f123ccd2640 1 --2- 172.21.15.5:0/3289682653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12380cf2e0 0x7f12380cf710 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f1228009870 tx=0x7f122801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e8e96db8c72e63 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:24.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.532+0000 7f122ffff640 1 -- 172.21.15.5:0/3289682653 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12280aa670 con 0x7f12380cf2e0 2023-07-14T13:29:24.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.532+0000 7f122ffff640 1 -- 172.21.15.5:0/3289682653 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12280aa7d0 con 0x7f12380cf2e0 2023-07-14T13:29:24.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.532+0000 7f122ffff640 1 -- 172.21.15.5:0/3289682653 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12280aab60 con 0x7f12380cf2e0 2023-07-14T13:29:24.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.532+0000 7f123f737640 1 -- 172.21.15.5:0/3289682653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12380cf2e0 msgr2=0x7f12380cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:24.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.532+0000 7f123f737640 1 --2- 172.21.15.5:0/3289682653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12380cf2e0 0x7f12380cf710 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f1228009870 tx=0x7f122801c510 comp rx=0 tx=0).stop 2023-07-14T13:29:24.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.532+0000 7f123f737640 1 -- 172.21.15.5:0/3289682653 shutdown_connections 2023-07-14T13:29:24.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.532+0000 7f123f737640 1 --2- 172.21.15.5:0/3289682653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12380cf2e0 0x7f12380cf710 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:24.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.532+0000 7f123f737640 1 --2- 172.21.15.5:0/3289682653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f123806a540 0x7f123806a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:24.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.532+0000 7f123f737640 1 -- 172.21.15.5:0/3289682653 >> 172.21.15.5:0/3289682653 conn(0x7f1238099490 msgr2=0x7f1238089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:24.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.532+0000 7f123f737640 1 -- 172.21.15.5:0/3289682653 shutdown_connections 2023-07-14T13:29:24.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.532+0000 7f123f737640 1 -- 172.21.15.5:0/3289682653 wait complete. 2023-07-14T13:29:24.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.532+0000 7f123f737640 1 Processor -- start 2023-07-14T13:29:24.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.532+0000 7f123f737640 1 -- start start 2023-07-14T13:29:24.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.532+0000 7f123f737640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f123806a540 0x7f123814e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:24.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.532+0000 7f123f737640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12380cc9c0 0x7f1238152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:24.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.532+0000 7f123f737640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12380cf2e0 0x7f1238154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:24.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.532+0000 7f123f737640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123814ed80 con 0x7f12380cc9c0 2023-07-14T13:29:24.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.532+0000 7f123f737640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1238152fe0 con 0x7f123806a540 2023-07-14T13:29:24.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.532+0000 7f123f737640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12381532c0 con 0x7f12380cf2e0 2023-07-14T13:29:24.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.536+0000 7f123ccd2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12380cc9c0 0x7f1238152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:24.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.536+0000 7f123ccd2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12380cc9c0 0x7f1238152720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48742/0 (socket says 172.21.15.5:48742) 2023-07-14T13:29:24.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.536+0000 7f123ccd2640 1 -- 172.21.15.5:0/1348229204 learned_addr learned my addr 172.21.15.5:0/1348229204 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:24.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.536+0000 7f123d4d3640 1 --2- 172.21.15.5:0/1348229204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f123806a540 0x7f123814e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:24.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.536+0000 7f123dcd4640 1 --2- 172.21.15.5:0/1348229204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12380cf2e0 0x7f1238154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:24.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.536+0000 7f123ccd2640 1 -- 172.21.15.5:0/1348229204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12380cf2e0 msgr2=0x7f1238154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:24.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.536+0000 7f123ccd2640 1 --2- 172.21.15.5:0/1348229204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12380cf2e0 0x7f1238154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:24.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.536+0000 7f123ccd2640 1 -- 172.21.15.5:0/1348229204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f123806a540 msgr2=0x7f123814e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:24.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.536+0000 7f123ccd2640 1 --2- 172.21.15.5:0/1348229204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f123806a540 0x7f123814e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:24.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.536+0000 7f123ccd2640 1 -- 172.21.15.5:0/1348229204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12280094d0 con 0x7f12380cc9c0 2023-07-14T13:29:24.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.536+0000 7f123ccd2640 1 --2- 172.21.15.5:0/1348229204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12380cc9c0 0x7f1238152720 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f122801a140 tx=0x7f122801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:24.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.536+0000 7f122dffb640 1 -- 172.21.15.5:0/1348229204 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12280b3800 con 0x7f12380cc9c0 2023-07-14T13:29:24.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.536+0000 7f122dffb640 1 -- 172.21.15.5:0/1348229204 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12280b3980 con 0x7f12380cc9c0 2023-07-14T13:29:24.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.536+0000 7f122dffb640 1 -- 172.21.15.5:0/1348229204 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12280b3d30 con 0x7f12380cc9c0 2023-07-14T13:29:24.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.536+0000 7f123f737640 1 -- 172.21.15.5:0/1348229204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12381535a0 con 0x7f12380cc9c0 2023-07-14T13:29:24.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.536+0000 7f123f737640 1 -- 172.21.15.5:0/1348229204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1238153b60 con 0x7f12380cc9c0 2023-07-14T13:29:24.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.536+0000 7f123f737640 1 -- 172.21.15.5:0/1348229204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1238153d50 con 0x7f12380cc9c0 2023-07-14T13:29:24.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.536+0000 7f122dffb640 1 -- 172.21.15.5:0/1348229204 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 83) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f12280b2380 con 0x7f12380cc9c0 2023-07-14T13:29:24.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.540+0000 7f122dffb640 1 -- 172.21.15.5:0/1348229204 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 7150+0+0 (secure 0 0 0) 0x7f122811e5e0 con 0x7f12380cc9c0 2023-07-14T13:29:24.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.544+0000 7f122dffb640 1 -- 172.21.15.5:0/1348229204 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f12280eba30 con 0x7f12380cc9c0 2023-07-14T13:29:24.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.700+0000 7f123f737640 1 -- 172.21.15.5:0/1348229204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1238153400 con 0x7f12380cc9c0 2023-07-14T13:29:24.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.700+0000 7f122dffb640 1 -- 172.21.15.5:0/1348229204 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v160) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1238153400 con 0x7f12380cc9c0 2023-07-14T13:29:24.706 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T13:29:24.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.700+0000 7f123f737640 1 -- 172.21.15.5:0/1348229204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12380cc9c0 msgr2=0x7f1238152720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:24.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.700+0000 7f123f737640 1 --2- 172.21.15.5:0/1348229204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12380cc9c0 0x7f1238152720 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f122801a140 tx=0x7f122801ad50 comp rx=0 tx=0).stop 2023-07-14T13:29:24.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.700+0000 7f123f737640 1 -- 172.21.15.5:0/1348229204 shutdown_connections 2023-07-14T13:29:24.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.700+0000 7f123f737640 1 --2- 172.21.15.5:0/1348229204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12380cf2e0 0x7f1238154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:24.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.700+0000 7f123f737640 1 --2- 172.21.15.5:0/1348229204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12380cc9c0 0x7f1238152720 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:24.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.700+0000 7f123f737640 1 --2- 172.21.15.5:0/1348229204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f123806a540 0x7f123814e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:24.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.700+0000 7f123f737640 1 -- 172.21.15.5:0/1348229204 >> 172.21.15.5:0/1348229204 conn(0x7f1238099490 msgr2=0x7f12380accf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:24.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.700+0000 7f123f737640 1 -- 172.21.15.5:0/1348229204 shutdown_connections 2023-07-14T13:29:24.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.700+0000 7f123f737640 1 -- 172.21.15.5:0/1348229204 wait complete. 2023-07-14T13:29:24.727 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T13:29:24.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.868+0000 7f99a8e0b640 1 Processor -- start 2023-07-14T13:29:24.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.868+0000 7f99a8e0b640 1 -- start start 2023-07-14T13:29:24.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.868+0000 7f99a8e0b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f99a40d2fc0 0x7f99a40b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:24.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.868+0000 7f99a8e0b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a40b04c0 con 0x7f99a415bde0 2023-07-14T13:29:24.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.868+0000 7f99a8e0b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a40d0aa0 con 0x7f99a40d2300 2023-07-14T13:29:24.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.868+0000 7f99a8e0b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a415c1b0 con 0x7f99a40d2fc0 2023-07-14T13:29:24.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.868+0000 7f99a259c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f99a415bde0 0x7f99a40d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41180/0 (socket says 172.21.15.5:41180) 2023-07-14T13:29:24.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.868+0000 7f99a259c640 1 -- 172.21.15.5:0/395049793 learned_addr learned my addr 172.21.15.5:0/395049793 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:24.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.868+0000 7f999bfff640 1 --2- 172.21.15.5:0/395049793 >> v2:172.21.15.154:3300/0 conn(0x7f99a40d2fc0 0x7f99a40b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:24.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.868+0000 7f99a1d9b640 1 -- 172.21.15.5:0/395049793 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 985208531 0 0) 0x7f99a40b04c0 con 0x7f99a415bde0 2023-07-14T13:29:24.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.868+0000 7f99a1d9b640 1 -- 172.21.15.5:0/395049793 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9990003530 con 0x7f99a415bde0 2023-07-14T13:29:24.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.868+0000 7f99a1d9b640 1 -- 172.21.15.5:0/395049793 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3709301289 0 0) 0x7f9990003530 con 0x7f99a415bde0 2023-07-14T13:29:24.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.868+0000 7f99a1d9b640 1 -- 172.21.15.5:0/395049793 >> v2:172.21.15.154:3300/0 conn(0x7f99a40d2fc0 msgr2=0x7f99a40b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:24.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.868+0000 7f99a1d9b640 1 --2- 172.21.15.5:0/395049793 >> v2:172.21.15.154:3300/0 conn(0x7f99a40d2fc0 0x7f99a40b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:24.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.872+0000 7f99a1d9b640 1 -- 172.21.15.5:0/395049793 >> v1:172.21.15.154:6789/0 conn(0x7f99a40d2300 legacy=0x7f99a40cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:24.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.872+0000 7f99a1d9b640 1 -- 172.21.15.5:0/395049793 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a40afb90 con 0x7f99a415bde0 2023-07-14T13:29:24.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.872+0000 7f99a1d9b640 1 -- 172.21.15.5:0/395049793 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f9994001800 con 0x7f99a415bde0 2023-07-14T13:29:24.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.872+0000 7f99a1d9b640 1 -- 172.21.15.5:0/395049793 >> v1:172.21.15.5:6789/0 conn(0x7f99a415bde0 legacy=0x7f99a40d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:24.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.872+0000 7f99a1d9b640 1 --2- 172.21.15.5:0/395049793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9990003980 0x7f9990003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:24.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.872+0000 7f99a1d9b640 1 --2- 172.21.15.5:0/395049793 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9990004370 0x7f9990004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:24.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.872+0000 7f99a1d9b640 1 --2- 172.21.15.5:0/395049793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9990005030 0x7f999000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:24.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.872+0000 7f99a1d9b640 1 -- 172.21.15.5:0/395049793 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a415c1b0 con 0x7f9990003980 2023-07-14T13:29:24.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.872+0000 7f99a1d9b640 1 -- 172.21.15.5:0/395049793 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999000bf80 con 0x7f9990005030 2023-07-14T13:29:24.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.872+0000 7f99a1d9b640 1 -- 172.21.15.5:0/395049793 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f999000c140 con 0x7f9990004370 2023-07-14T13:29:24.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.872+0000 7f99a259c640 1 --2- 172.21.15.5:0/395049793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9990003980 0x7f9990003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:24.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.872+0000 7f99a2d9d640 1 --2- 172.21.15.5:0/395049793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9990005030 0x7f999000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:24.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.872+0000 7f999bfff640 1 --2- 172.21.15.5:0/395049793 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9990004370 0x7f9990004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:24.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.872+0000 7f99a259c640 1 -- 172.21.15.5:0/395049793 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9990004370 msgr2=0x7f9990004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:24.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.872+0000 7f99a259c640 1 --2- 172.21.15.5:0/395049793 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9990004370 0x7f9990004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:24.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.872+0000 7f99a259c640 1 -- 172.21.15.5:0/395049793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9990005030 msgr2=0x7f999000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:24.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.872+0000 7f99a259c640 1 --2- 172.21.15.5:0/395049793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9990005030 0x7f999000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:24.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.872+0000 7f99a259c640 1 -- 172.21.15.5:0/395049793 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9990003530 con 0x7f9990003980 2023-07-14T13:29:24.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.872+0000 7f99a2d9d640 1 -- 172.21.15.5:0/395049793 reap_dead start 2023-07-14T13:29:24.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.872+0000 7f99a259c640 1 --2- 172.21.15.5:0/395049793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9990003980 0x7f9990003d50 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f999400c1c0 tx=0x7f999401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e8386253fbc1a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:24.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.872+0000 7f99a1d9b640 1 -- 172.21.15.5:0/395049793 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9994007270 con 0x7f9990003980 2023-07-14T13:29:24.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.872+0000 7f99a1d9b640 1 -- 172.21.15.5:0/395049793 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99940073d0 con 0x7f9990003980 2023-07-14T13:29:24.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.872+0000 7f99a1d9b640 1 -- 172.21.15.5:0/395049793 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99940a5800 con 0x7f9990003980 2023-07-14T13:29:24.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.876+0000 7f99a8e0b640 1 -- 172.21.15.5:0/395049793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9990003980 msgr2=0x7f9990003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:24.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.876+0000 7f99a8e0b640 1 --2- 172.21.15.5:0/395049793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9990003980 0x7f9990003d50 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f999400c1c0 tx=0x7f999401cc40 comp rx=0 tx=0).stop 2023-07-14T13:29:24.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.876+0000 7f99a8e0b640 1 -- 172.21.15.5:0/395049793 shutdown_connections 2023-07-14T13:29:24.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.876+0000 7f99a8e0b640 1 --2- 172.21.15.5:0/395049793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9990003980 0x7f9990003d50 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:24.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.876+0000 7f99a8e0b640 1 -- 172.21.15.5:0/395049793 >> 172.21.15.5:0/395049793 conn(0x7f99a40659d0 msgr2=0x7f99a409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:24.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.876+0000 7f99a8e0b640 1 -- 172.21.15.5:0/395049793 shutdown_connections 2023-07-14T13:29:24.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.876+0000 7f99a8e0b640 1 -- 172.21.15.5:0/395049793 wait complete. 2023-07-14T13:29:24.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.876+0000 7f99a8e0b640 1 Processor -- start 2023-07-14T13:29:24.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.876+0000 7f99a8e0b640 1 -- start start 2023-07-14T13:29:24.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.876+0000 7f99a8e0b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9990003980 0x7f99a40c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:24.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.876+0000 7f99a8e0b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a40b51a0 0x7f99a41504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:24.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.876+0000 7f99a8e0b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a41591c0 0x7f99a4159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:24.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.876+0000 7f99a8e0b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a40c8d40 con 0x7f99a40b51a0 2023-07-14T13:29:24.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.876+0000 7f99a8e0b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a40b62d0 con 0x7f9990003980 2023-07-14T13:29:24.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.876+0000 7f99a8e0b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a4159ba0 con 0x7f99a41591c0 2023-07-14T13:29:24.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.876+0000 7f999bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a40b51a0 0x7f99a41504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:24.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.876+0000 7f999bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a40b51a0 0x7f99a41504b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48768/0 (socket says 172.21.15.5:48768) 2023-07-14T13:29:24.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.876+0000 7f999bfff640 1 -- 172.21.15.5:0/2702731863 learned_addr learned my addr 172.21.15.5:0/2702731863 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:24.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.876+0000 7f99a259c640 1 --2- 172.21.15.5:0/2702731863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9990003980 0x7f99a40c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:24.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.876+0000 7f99a2d9d640 1 --2- 172.21.15.5:0/2702731863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a41591c0 0x7f99a4159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:24.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.880+0000 7f999bfff640 1 -- 172.21.15.5:0/2702731863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a41591c0 msgr2=0x7f99a4159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:24.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.880+0000 7f999bfff640 1 --2- 172.21.15.5:0/2702731863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a41591c0 0x7f99a4159660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:24.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.880+0000 7f999bfff640 1 -- 172.21.15.5:0/2702731863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9990003980 msgr2=0x7f99a40c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:24.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.880+0000 7f999bfff640 1 --2- 172.21.15.5:0/2702731863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9990003980 0x7f99a40c60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:24.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.880+0000 7f999bfff640 1 -- 172.21.15.5:0/2702731863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a40b5660 con 0x7f99a40b51a0 2023-07-14T13:29:24.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.880+0000 7f999bfff640 1 --2- 172.21.15.5:0/2702731863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a40b51a0 0x7f99a41504b0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f998c011870 tx=0x7f998c011960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:24.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.880+0000 7f999affd640 1 -- 172.21.15.5:0/2702731863 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c004240 con 0x7f99a40b51a0 2023-07-14T13:29:24.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.880+0000 7f999affd640 1 -- 172.21.15.5:0/2702731863 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998c0043a0 con 0x7f99a40b51a0 2023-07-14T13:29:24.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.880+0000 7f999affd640 1 -- 172.21.15.5:0/2702731863 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c003860 con 0x7f99a40b51a0 2023-07-14T13:29:24.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.880+0000 7f99a8e0b640 1 -- 172.21.15.5:0/2702731863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a40b5940 con 0x7f99a40b51a0 2023-07-14T13:29:24.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.880+0000 7f99a8e0b640 1 -- 172.21.15.5:0/2702731863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a40b5f00 con 0x7f99a40b51a0 2023-07-14T13:29:24.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.880+0000 7f99a8e0b640 1 -- 172.21.15.5:0/2702731863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a40b6440 con 0x7f99a40b51a0 2023-07-14T13:29:24.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.880+0000 7f999affd640 1 -- 172.21.15.5:0/2702731863 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 83) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f998c0039c0 con 0x7f99a40b51a0 2023-07-14T13:29:24.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.880+0000 7f999affd640 1 -- 172.21.15.5:0/2702731863 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 7150+0+0 (secure 0 0 0) 0x7f998c083dc0 con 0x7f99a40b51a0 2023-07-14T13:29:24.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:24.884+0000 7f999affd640 1 -- 172.21.15.5:0/2702731863 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f99a40b6440 con 0x7f99a40b51a0 2023-07-14T13:29:25.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.036+0000 7f999affd640 1 -- 172.21.15.5:0/2702731863 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 84) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f998c050cc0 con 0x7f99a40b51a0 2023-07-14T13:29:25.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.036+0000 7f999affd640 1 --2- 172.21.15.5:0/2702731863 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f998406c380 0x7f998406e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:25.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.040+0000 7f99a259c640 1 --2- 172.21.15.5:0/2702731863 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f998406c380 0x7f998406e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:25.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.040+0000 7f99a259c640 1 --2- 172.21.15.5:0/2702731863 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f998406c380 0x7f998406e760 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f99940ab000 tx=0x7f99940a7070 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:25.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.044+0000 7f99a8e0b640 1 -- 172.21.15.5:0/2702731863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f99a40b6440 con 0x7f99a40b51a0 2023-07-14T13:29:25.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.044+0000 7f999affd640 1 -- 172.21.15.5:0/2702731863 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v160) v1 ==== 100+0+11 (secure 0 0 0) 0x7f99a40b6440 con 0x7f99a40b51a0 2023-07-14T13:29:25.051 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T13:29:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.048+0000 7f99a8e0b640 1 -- 172.21.15.5:0/2702731863 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f998406c380 msgr2=0x7f998406e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.048+0000 7f99a8e0b640 1 --2- 172.21.15.5:0/2702731863 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f998406c380 0x7f998406e760 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f99940ab000 tx=0x7f99940a7070 comp rx=0 tx=0).stop 2023-07-14T13:29:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.048+0000 7f99a8e0b640 1 -- 172.21.15.5:0/2702731863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a40b51a0 msgr2=0x7f99a41504b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.048+0000 7f99a8e0b640 1 --2- 172.21.15.5:0/2702731863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a40b51a0 0x7f99a41504b0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f998c011870 tx=0x7f998c011960 comp rx=0 tx=0).stop 2023-07-14T13:29:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.048+0000 7f99a8e0b640 1 -- 172.21.15.5:0/2702731863 shutdown_connections 2023-07-14T13:29:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.048+0000 7f99a8e0b640 1 --2- 172.21.15.5:0/2702731863 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f998406c380 0x7f998406e760 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.048+0000 7f99a8e0b640 1 --2- 172.21.15.5:0/2702731863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a41591c0 0x7f99a4159660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.048+0000 7f99a8e0b640 1 --2- 172.21.15.5:0/2702731863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a40b51a0 0x7f99a41504b0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.048+0000 7f99a8e0b640 1 --2- 172.21.15.5:0/2702731863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9990003980 0x7f99a40c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.048+0000 7f99a8e0b640 1 -- 172.21.15.5:0/2702731863 >> 172.21.15.5:0/2702731863 conn(0x7f99a40659d0 msgr2=0x7f99a415b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.048+0000 7f99a8e0b640 1 -- 172.21.15.5:0/2702731863 shutdown_connections 2023-07-14T13:29:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.048+0000 7f99a8e0b640 1 -- 172.21.15.5:0/2702731863 wait complete. 2023-07-14T13:29:25.073 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:29:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.212+0000 7ff5f7c0b640 1 Processor -- start 2023-07-14T13:29:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.212+0000 7ff5f7c0b640 1 -- start start 2023-07-14T13:29:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.212+0000 7ff5f7c0b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5f0070b70 0x7ff5f0070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.212+0000 7ff5f7c0b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff5f00cb100 0x7ff5f00cb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:25.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.212+0000 7ff5f7c0b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f00cbac0 con 0x7ff5f006b1e0 2023-07-14T13:29:25.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.212+0000 7ff5f7c0b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f00cac70 con 0x7ff5f00cb100 2023-07-14T13:29:25.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.212+0000 7ff5f7c0b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f0071480 con 0x7ff5f0070b70 2023-07-14T13:29:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.212+0000 7ff5f51a6640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff5f006b1e0 0x7ff5f00c1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41188/0 (socket says 172.21.15.5:41188) 2023-07-14T13:29:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.212+0000 7ff5f51a6640 1 -- 172.21.15.5:0/3504672078 learned_addr learned my addr 172.21.15.5:0/3504672078 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.212+0000 7ff5f61a8640 1 --2- 172.21.15.5:0/3504672078 >> v2:172.21.15.154:3300/0 conn(0x7ff5f00cb100 0x7ff5f00cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.212+0000 7ff5f59a7640 1 --2- 172.21.15.5:0/3504672078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5f0070b70 0x7ff5f0070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.212+0000 7ff5f49a5640 1 -- 172.21.15.5:0/3504672078 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539607079 0 0) 0x7ff5e0001120 con 0x7ff5f006b1e0 2023-07-14T13:29:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.216+0000 7ff5f49a5640 1 -- 172.21.15.5:0/3504672078 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5dc003530 con 0x7ff5f006b1e0 2023-07-14T13:29:25.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.216+0000 7ff5f59a7640 1 -- 172.21.15.5:0/3504672078 >> v2:172.21.15.154:3300/0 conn(0x7ff5f00cb100 msgr2=0x7ff5f00cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:25.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.216+0000 7ff5f59a7640 1 --2- 172.21.15.5:0/3504672078 >> v2:172.21.15.154:3300/0 conn(0x7ff5f00cb100 0x7ff5f00cb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.216+0000 7ff5f59a7640 1 -- 172.21.15.5:0/3504672078 >> v1:172.21.15.5:6789/0 conn(0x7ff5f006b1e0 legacy=0x7ff5f00c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:25.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.216+0000 7ff5f59a7640 1 -- 172.21.15.5:0/3504672078 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f00ca060 con 0x7ff5f0070b70 2023-07-14T13:29:25.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.216+0000 7ff5f59a7640 1 --2- 172.21.15.5:0/3504672078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5f0070b70 0x7ff5f0070f40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0097c0 tx=0x7ff5ec01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f5145af6427b77a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:25.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.220+0000 7ff5f49a5640 1 -- 172.21.15.5:0/3504672078 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec0ac620 con 0x7ff5f0070b70 2023-07-14T13:29:25.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.220+0000 7ff5f49a5640 1 -- 172.21.15.5:0/3504672078 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ec0ac780 con 0x7ff5f0070b70 2023-07-14T13:29:25.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.220+0000 7ff5f49a5640 1 -- 172.21.15.5:0/3504672078 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec0acb10 con 0x7ff5f0070b70 2023-07-14T13:29:25.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.220+0000 7ff5f7c0b640 1 -- 172.21.15.5:0/3504672078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5f0070b70 msgr2=0x7ff5f0070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:25.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.220+0000 7ff5f7c0b640 1 --2- 172.21.15.5:0/3504672078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5f0070b70 0x7ff5f0070f40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0097c0 tx=0x7ff5ec01c3c0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.220+0000 7ff5f7c0b640 1 -- 172.21.15.5:0/3504672078 shutdown_connections 2023-07-14T13:29:25.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.220+0000 7ff5f7c0b640 1 --2- 172.21.15.5:0/3504672078 >> v2:172.21.15.154:3300/0 conn(0x7ff5f00cb100 0x7ff5f00cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.220+0000 7ff5f7c0b640 1 --2- 172.21.15.5:0/3504672078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5f0070b70 0x7ff5f0070f40 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.220+0000 7ff5f7c0b640 1 -- 172.21.15.5:0/3504672078 >> 172.21.15.5:0/3504672078 conn(0x7ff5f00afcf0 msgr2=0x7ff5f00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:25.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.220+0000 7ff5f7c0b640 1 -- 172.21.15.5:0/3504672078 shutdown_connections 2023-07-14T13:29:25.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.220+0000 7ff5f7c0b640 1 -- 172.21.15.5:0/3504672078 wait complete. 2023-07-14T13:29:25.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.220+0000 7ff5f7c0b640 1 Processor -- start 2023-07-14T13:29:25.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.220+0000 7ff5f7c0b640 1 -- start start 2023-07-14T13:29:25.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.220+0000 7ff5f7c0b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5f006b1e0 0x7ff5f01436d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.220+0000 7ff5f7c0b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5f0070b70 0x7ff5f0141de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.220+0000 7ff5f7c0b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5f00cb100 0x7ff5f01452d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.220+0000 7ff5f7c0b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f0143c10 con 0x7ff5f0070b70 2023-07-14T13:29:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.220+0000 7ff5f7c0b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f0142630 con 0x7ff5f006b1e0 2023-07-14T13:29:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.220+0000 7ff5f7c0b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f0142910 con 0x7ff5f00cb100 2023-07-14T13:29:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.220+0000 7ff5f51a6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5f0070b70 0x7ff5f0141de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.220+0000 7ff5f51a6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5f0070b70 0x7ff5f0141de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48778/0 (socket says 172.21.15.5:48778) 2023-07-14T13:29:25.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.220+0000 7ff5f51a6640 1 -- 172.21.15.5:0/2472816021 learned_addr learned my addr 172.21.15.5:0/2472816021 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:25.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.224+0000 7ff5f61a8640 1 --2- 172.21.15.5:0/2472816021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5f00cb100 0x7ff5f01452d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:25.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.224+0000 7ff5f59a7640 1 --2- 172.21.15.5:0/2472816021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5f006b1e0 0x7ff5f01436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:25.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.224+0000 7ff5f51a6640 1 -- 172.21.15.5:0/2472816021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5f00cb100 msgr2=0x7ff5f01452d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:25.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.224+0000 7ff5f51a6640 1 --2- 172.21.15.5:0/2472816021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5f00cb100 0x7ff5f01452d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.224+0000 7ff5f51a6640 1 -- 172.21.15.5:0/2472816021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5f006b1e0 msgr2=0x7ff5f01436d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:25.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.224+0000 7ff5f51a6640 1 --2- 172.21.15.5:0/2472816021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5f006b1e0 0x7ff5f01436d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.224+0000 7ff5f51a6640 1 -- 172.21.15.5:0/2472816021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ec009420 con 0x7ff5f0070b70 2023-07-14T13:29:25.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.224+0000 7ff5f61a8640 1 --2- 172.21.15.5:0/2472816021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5f00cb100 0x7ff5f01452d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:29:25.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.224+0000 7ff5f59a7640 1 --2- 172.21.15.5:0/2472816021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5f006b1e0 0x7ff5f01436d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:29:25.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.224+0000 7ff5f51a6640 1 --2- 172.21.15.5:0/2472816021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5f0070b70 0x7ff5f0141de0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000c400 tx=0x7ff5e000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:25.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.224+0000 7ff5e67fc640 1 -- 172.21.15.5:0/2472816021 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0005cf0 con 0x7ff5f0070b70 2023-07-14T13:29:25.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.224+0000 7ff5e67fc640 1 -- 172.21.15.5:0/2472816021 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e0005e70 con 0x7ff5f0070b70 2023-07-14T13:29:25.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.224+0000 7ff5f7c0b640 1 -- 172.21.15.5:0/2472816021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f0142bf0 con 0x7ff5f0070b70 2023-07-14T13:29:25.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.224+0000 7ff5e67fc640 1 -- 172.21.15.5:0/2472816021 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e00072f0 con 0x7ff5f0070b70 2023-07-14T13:29:25.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.224+0000 7ff5f7c0b640 1 -- 172.21.15.5:0/2472816021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f01431b0 con 0x7ff5f0070b70 2023-07-14T13:29:25.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.224+0000 7ff5f7c0b640 1 -- 172.21.15.5:0/2472816021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f00c1ea0 con 0x7ff5f0070b70 2023-07-14T13:29:25.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.224+0000 7ff5e67fc640 1 -- 172.21.15.5:0/2472816021 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 84) v1 ==== 85496+0+0 (secure 0 0 0) 0x7ff5e0007450 con 0x7ff5f0070b70 2023-07-14T13:29:25.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.224+0000 7ff5e67fc640 1 --2- 172.21.15.5:0/2472816021 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff5d40660d0 0x7ff5d4068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:25.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.224+0000 7ff5e67fc640 1 -- 172.21.15.5:0/2472816021 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 7150+0+0 (secure 0 0 0) 0x7ff5e00832e0 con 0x7ff5f0070b70 2023-07-14T13:29:25.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.228+0000 7ff5f59a7640 1 --2- 172.21.15.5:0/2472816021 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff5d40660d0 0x7ff5d4068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:25.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.228+0000 7ff5f59a7640 1 --2- 172.21.15.5:0/2472816021 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff5d40660d0 0x7ff5d4068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0ae000 tx=0x7ff5ec008040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:25.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.232+0000 7ff5e67fc640 1 -- 172.21.15.5:0/2472816021 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff5e0054020 con 0x7ff5f0070b70 2023-07-14T13:29:25.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.420+0000 7ff5f7c0b640 1 -- 172.21.15.5:0/2472816021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5f00cbac0 con 0x7ff5f0070b70 2023-07-14T13:29:25.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.420+0000 7ff5e67fc640 1 -- 172.21.15.5:0/2472816021 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4708 (secure 0 0 0) 0x7ff5f00cbac0 con 0x7ff5f0070b70 2023-07-14T13:29:25.425 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:29:25.426 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":73,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3146480803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3146480803},{"type":"v1","addr":"172.21.15.154:6837","nonce":3146480803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8908,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2567208960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2567208960},{"type":"v1","addr":"172.21.15.5:6835","nonce":2567208960}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8911,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3591700265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3591700265},{"type":"v1","addr":"172.21.15.154:6836","nonce":3591700265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:13:03.243523+0000","modified":"2023-07-14T13:13:06.886056+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9336":{"gid":9336,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/840216087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":840216087},{"type":"v1","addr":"172.21.15.5:6834","nonce":840216087}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-14T13:29:25.426 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 73 2023-07-14T13:29:25.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.420+0000 7ff5f7c0b640 1 -- 172.21.15.5:0/2472816021 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff5d40660d0 msgr2=0x7ff5d4068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:25.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.420+0000 7ff5f7c0b640 1 --2- 172.21.15.5:0/2472816021 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff5d40660d0 0x7ff5d4068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0ae000 tx=0x7ff5ec008040 comp rx=0 tx=0).stop 2023-07-14T13:29:25.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.420+0000 7ff5f7c0b640 1 -- 172.21.15.5:0/2472816021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5f0070b70 msgr2=0x7ff5f0141de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:25.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.420+0000 7ff5f7c0b640 1 --2- 172.21.15.5:0/2472816021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5f0070b70 0x7ff5f0141de0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000c400 tx=0x7ff5e000c8c0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.420+0000 7ff5f7c0b640 1 -- 172.21.15.5:0/2472816021 shutdown_connections 2023-07-14T13:29:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.420+0000 7ff5f7c0b640 1 --2- 172.21.15.5:0/2472816021 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff5d40660d0 0x7ff5d4068580 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.420+0000 7ff5f7c0b640 1 --2- 172.21.15.5:0/2472816021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5f00cb100 0x7ff5f01452d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.420+0000 7ff5f7c0b640 1 --2- 172.21.15.5:0/2472816021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5f0070b70 0x7ff5f0141de0 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.420+0000 7ff5f7c0b640 1 --2- 172.21.15.5:0/2472816021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5f006b1e0 0x7ff5f01436d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.420+0000 7ff5f7c0b640 1 -- 172.21.15.5:0/2472816021 >> 172.21.15.5:0/2472816021 conn(0x7ff5f00afcf0 msgr2=0x7ff5f0163470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:25.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.420+0000 7ff5f7c0b640 1 -- 172.21.15.5:0/2472816021 shutdown_connections 2023-07-14T13:29:25.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.420+0000 7ff5f7c0b640 1 -- 172.21.15.5:0/2472816021 wait complete. 2023-07-14T13:29:25.446 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:29:25.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.584+0000 7f197269c640 1 Processor -- start 2023-07-14T13:29:25.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.584+0000 7f197269c640 1 -- start start 2023-07-14T13:29:25.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.584+0000 7f197269c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f196c0c9730 0x7f196c1638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:25.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.584+0000 7f197269c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f196c0cc700 con 0x7f196c0c8ad0 2023-07-14T13:29:25.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.584+0000 7f197269c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f196c0b0ff0 con 0x7f196c158ce0 2023-07-14T13:29:25.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.584+0000 7f197269c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f196c070c80 con 0x7f196c0c9730 2023-07-14T13:29:25.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.584+0000 7f1970c39640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f196c0c9730 0x7f196c1638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:25.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.584+0000 7f1970c39640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f196c0c9730 0x7f196c1638b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48780/0 (socket says 172.21.15.5:48780) 2023-07-14T13:29:25.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.584+0000 7f196b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f196c0c8ad0 0x7f196c0c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41200/0 (socket says 172.21.15.5:41200) 2023-07-14T13:29:25.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.584+0000 7f1970c39640 1 -- 172.21.15.5:0/683865672 learned_addr learned my addr 172.21.15.5:0/683865672 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:25.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.584+0000 7f1970c39640 1 -- 172.21.15.5:0/683865672 >> v1:172.21.15.154:6789/0 conn(0x7f196c158ce0 legacy=0x7f196c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:25.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.584+0000 7f1970c39640 1 -- 172.21.15.5:0/683865672 >> v1:172.21.15.5:6789/0 conn(0x7f196c0c8ad0 legacy=0x7f196c0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:25.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.584+0000 7f1970c39640 1 -- 172.21.15.5:0/683865672 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c0cbdd0 con 0x7f196c0c9730 2023-07-14T13:29:25.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.588+0000 7f1970c39640 1 --2- 172.21.15.5:0/683865672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f196c0c9730 0x7f196c1638b0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f1964009e50 tx=0x7f196401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58754e94992015c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:25.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.588+0000 7f196affd640 1 -- 172.21.15.5:0/683865672 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19640a5650 con 0x7f196c0c9730 2023-07-14T13:29:25.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.588+0000 7f196affd640 1 -- 172.21.15.5:0/683865672 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19640a57b0 con 0x7f196c0c9730 2023-07-14T13:29:25.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.588+0000 7f196affd640 1 -- 172.21.15.5:0/683865672 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19640a5b40 con 0x7f196c0c9730 2023-07-14T13:29:25.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.588+0000 7f197269c640 1 -- 172.21.15.5:0/683865672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f196c0c9730 msgr2=0x7f196c1638b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:25.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.588+0000 7f197269c640 1 --2- 172.21.15.5:0/683865672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f196c0c9730 0x7f196c1638b0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f1964009e50 tx=0x7f196401c880 comp rx=0 tx=0).stop 2023-07-14T13:29:25.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.588+0000 7f197269c640 1 -- 172.21.15.5:0/683865672 shutdown_connections 2023-07-14T13:29:25.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.588+0000 7f197269c640 1 --2- 172.21.15.5:0/683865672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f196c0c9730 0x7f196c1638b0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.588+0000 7f197269c640 1 -- 172.21.15.5:0/683865672 >> 172.21.15.5:0/683865672 conn(0x7f196c0afcf0 msgr2=0x7f196c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:25.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.588+0000 7f197269c640 1 -- 172.21.15.5:0/683865672 shutdown_connections 2023-07-14T13:29:25.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.588+0000 7f197269c640 1 -- 172.21.15.5:0/683865672 wait complete. 2023-07-14T13:29:25.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.592+0000 7f197269c640 1 Processor -- start 2023-07-14T13:29:25.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.592+0000 7f197269c640 1 -- start start 2023-07-14T13:29:25.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.592+0000 7f197269c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f196c0c8ad0 0x7f196c0ac2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:25.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.592+0000 7f197269c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f196c0c9730 0x7f196c152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:25.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.592+0000 7f197269c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f196c158ce0 0x7f196c0c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:25.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.592+0000 7f197269c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c0acae0 con 0x7f196c0c9730 2023-07-14T13:29:25.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.592+0000 7f197269c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c156360 con 0x7f196c0c8ad0 2023-07-14T13:29:25.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.592+0000 7f197269c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c156640 con 0x7f196c158ce0 2023-07-14T13:29:25.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.592+0000 7f196b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f196c0c9730 0x7f196c152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:25.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.592+0000 7f196b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f196c0c9730 0x7f196c152b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48790/0 (socket says 172.21.15.5:48790) 2023-07-14T13:29:25.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.592+0000 7f196b7fe640 1 -- 172.21.15.5:0/2400939052 learned_addr learned my addr 172.21.15.5:0/2400939052 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:25.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.592+0000 7f196bfff640 1 --2- 172.21.15.5:0/2400939052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f196c0c8ad0 0x7f196c0ac2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:25.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.592+0000 7f1970c39640 1 --2- 172.21.15.5:0/2400939052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f196c158ce0 0x7f196c0c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:25.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.592+0000 7f196b7fe640 1 -- 172.21.15.5:0/2400939052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f196c158ce0 msgr2=0x7f196c0c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:25.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.592+0000 7f196b7fe640 1 --2- 172.21.15.5:0/2400939052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f196c158ce0 0x7f196c0c1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.592+0000 7f196b7fe640 1 -- 172.21.15.5:0/2400939052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f196c0c8ad0 msgr2=0x7f196c0ac2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:25.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.592+0000 7f196b7fe640 1 --2- 172.21.15.5:0/2400939052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f196c0c8ad0 0x7f196c0ac2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.592+0000 7f196b7fe640 1 -- 172.21.15.5:0/2400939052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1964009b30 con 0x7f196c0c9730 2023-07-14T13:29:25.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.592+0000 7f1970c39640 1 --2- 172.21.15.5:0/2400939052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f196c158ce0 0x7f196c0c1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:29:25.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.592+0000 7f196b7fe640 1 --2- 172.21.15.5:0/2400939052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f196c0c9730 0x7f196c152b80 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f196000c430 tx=0x7f196000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:25.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.592+0000 7f1968ff9640 1 -- 172.21.15.5:0/2400939052 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19600074e0 con 0x7f196c0c9730 2023-07-14T13:29:25.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.592+0000 7f1968ff9640 1 -- 172.21.15.5:0/2400939052 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1960007640 con 0x7f196c0c9730 2023-07-14T13:29:25.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.592+0000 7f1968ff9640 1 -- 172.21.15.5:0/2400939052 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1960004a10 con 0x7f196c0c9730 2023-07-14T13:29:25.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.592+0000 7f197269c640 1 -- 172.21.15.5:0/2400939052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f196c156920 con 0x7f196c0c9730 2023-07-14T13:29:25.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.592+0000 7f197269c640 1 -- 172.21.15.5:0/2400939052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196c0ac7f0 con 0x7f196c0c9730 2023-07-14T13:29:25.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.596+0000 7f197269c640 1 -- 172.21.15.5:0/2400939052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f196c0ca1a0 con 0x7f196c0c9730 2023-07-14T13:29:25.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.596+0000 7f1968ff9640 1 -- 172.21.15.5:0/2400939052 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 84) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f1960004b70 con 0x7f196c0c9730 2023-07-14T13:29:25.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.596+0000 7f1968ff9640 1 --2- 172.21.15.5:0/2400939052 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f19580660d0 0x7f1958068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:25.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.596+0000 7f1968ff9640 1 -- 172.21.15.5:0/2400939052 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 7150+0+0 (secure 0 0 0) 0x7f1960083880 con 0x7f196c0c9730 2023-07-14T13:29:25.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.596+0000 7f196bfff640 1 --2- 172.21.15.5:0/2400939052 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f19580660d0 0x7f1958068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:25.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.596+0000 7f196bfff640 1 --2- 172.21.15.5:0/2400939052 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f19580660d0 0x7f1958068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f196c0c4e40 tx=0x7f195c008040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:25.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.600+0000 7f1968ff9640 1 -- 172.21.15.5:0/2400939052 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f1960050b30 con 0x7f196c0c9730 2023-07-14T13:29:25.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.756+0000 7f197269c640 1 -- 172.21.15.5:0/2400939052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f196c0678d0 con 0x7f196c0c9730 2023-07-14T13:29:25.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.756+0000 7f1968ff9640 1 -- 172.21.15.5:0/2400939052 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+19900 (secure 0 0 0) 0x7f1960054150 con 0x7f196c0c9730 2023-07-14T13:29:25.765 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:29:25.765 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":160,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:29:24.028589+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:13:01.372511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-14T13:13:02.236215+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":159,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/2262646220":"2023-07-15T13:29:24.028549+0000","172.21.15.154:6833/1973779483":"2023-07-15T13:29:24.028549+0000","172.21.15.154:6832/1973779483":"2023-07-15T13:29:24.028549+0000","172.21.15.154:0/2471411083":"2023-07-15T13:29:24.028549+0000","172.21.15.154:0/2755630099":"2023-07-15T13:29:24.028549+0000","172.21.15.154:0/3403666064":"2023-07-15T13:29:24.028549+0000","172.21.15.154:0/3205049834":"2023-07-15T13:24:20.729701+0000","172.21.15.154:0/2448917971":"2023-07-15T13:24:20.729701+0000","172.21.15.154:0/3347209674":"2023-07-15T13:24:20.729701+0000","172.21.15.154:0/2602756791":"2023-07-15T13:24:20.729701+0000","172.21.15.154:6833/3414173858":"2023-07-15T13:24:20.729701+0000","172.21.15.154:0/1387122589":"2023-07-15T13:24:20.729701+0000","172.21.15.154:0/2148864146":"2023-07-15T13:24:20.729701+0000","172.21.15.154:0/1540806126":"2023-07-15T13:13:20.528876+0000","172.21.15.154:0/77258959":"2023-07-15T13:13:20.528876+0000","172.21.15.154:0/4204288379":"2023-07-15T13:29:24.028549+0000","172.21.15.154:0/1084316036":"2023-07-15T13:13:20.528876+0000","172.21.15.154:0/661817451":"2023-07-15T13:13:20.528876+0000","172.21.15.154:0/261234270":"2023-07-15T13:13:20.528876+0000","172.21.15.154:0/1648971414":"2023-07-15T13:29:24.028549+0000","172.21.15.154:0/3779193680":"2023-07-15T13:13:20.528876+0000","172.21.15.154:6832/3414173858":"2023-07-15T13:24:20.729701+0000","172.21.15.154:6833/1443161386":"2023-07-15T13:13:20.528876+0000","172.21.15.154:6832/1443161386":"2023-07-15T13:13:20.528876+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:29:25.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.760+0000 7f197269c640 1 -- 172.21.15.5:0/2400939052 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f19580660d0 msgr2=0x7f1958068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:25.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.760+0000 7f197269c640 1 --2- 172.21.15.5:0/2400939052 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f19580660d0 0x7f1958068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f196c0c4e40 tx=0x7f195c008040 comp rx=0 tx=0).stop 2023-07-14T13:29:25.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.760+0000 7f197269c640 1 -- 172.21.15.5:0/2400939052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f196c0c9730 msgr2=0x7f196c152b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:25.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.760+0000 7f197269c640 1 --2- 172.21.15.5:0/2400939052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f196c0c9730 0x7f196c152b80 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f196000c430 tx=0x7f196000c8f0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.760+0000 7f197269c640 1 -- 172.21.15.5:0/2400939052 shutdown_connections 2023-07-14T13:29:25.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.760+0000 7f197269c640 1 --2- 172.21.15.5:0/2400939052 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f19580660d0 0x7f1958068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.760+0000 7f197269c640 1 --2- 172.21.15.5:0/2400939052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f196c158ce0 0x7f196c0c1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.760+0000 7f197269c640 1 --2- 172.21.15.5:0/2400939052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f196c0c9730 0x7f196c152b80 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.760+0000 7f197269c640 1 --2- 172.21.15.5:0/2400939052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f196c0c8ad0 0x7f196c0ac2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.760+0000 7f197269c640 1 -- 172.21.15.5:0/2400939052 >> 172.21.15.5:0/2400939052 conn(0x7f196c0afcf0 msgr2=0x7f196c06b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:25.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.760+0000 7f197269c640 1 -- 172.21.15.5:0/2400939052 shutdown_connections 2023-07-14T13:29:25.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.760+0000 7f197269c640 1 -- 172.21.15.5:0/2400939052 wait complete. 2023-07-14T13:29:25.786 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-14T13:29:25.787 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:29:25.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.924+0000 7fd3c4174640 1 Processor -- start 2023-07-14T13:29:25.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.924+0000 7fd3c4174640 1 -- start start 2023-07-14T13:29:25.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.924+0000 7fd3c4174640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd3bc070b70 0x7fd3bc070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:25.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.924+0000 7fd3c4174640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3bc0cb100 0x7fd3bc0cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:25.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.924+0000 7fd3c4174640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3bc0cac70 con 0x7fd3bc06b1e0 2023-07-14T13:29:25.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.924+0000 7fd3c4174640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3bc0cbaa0 con 0x7fd3bc070b70 2023-07-14T13:29:25.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.924+0000 7fd3c4174640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc071480 con 0x7fd3bc0cb100 2023-07-14T13:29:25.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.924+0000 7fd3c170f640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd3bc06b1e0 0x7fd3bc0c1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41206/0 (socket says 172.21.15.5:41206) 2023-07-14T13:29:25.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.924+0000 7fd3c170f640 1 -- 172.21.15.5:0/229024021 learned_addr learned my addr 172.21.15.5:0/229024021 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:25.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.928+0000 7fd3c2711640 1 --2- 172.21.15.5:0/229024021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3bc0cb100 0x7fd3bc0cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:25.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.928+0000 7fd3c1f10640 1 --2- 172.21.15.5:0/229024021 >> v2:172.21.15.154:3300/0 conn(0x7fd3bc070b70 0x7fd3bc070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:25.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.928+0000 7fd3c0f0e640 1 -- 172.21.15.5:0/229024021 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399520736 0 0) 0x7fd3bc0cac70 con 0x7fd3bc06b1e0 2023-07-14T13:29:25.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.928+0000 7fd3c0f0e640 1 -- 172.21.15.5:0/229024021 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3a8003530 con 0x7fd3bc06b1e0 2023-07-14T13:29:25.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.928+0000 7fd3c1f10640 1 -- 172.21.15.5:0/229024021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3bc0cb100 msgr2=0x7fd3bc0cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:25.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.928+0000 7fd3c1f10640 1 --2- 172.21.15.5:0/229024021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3bc0cb100 0x7fd3bc0cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.928+0000 7fd3c1f10640 1 -- 172.21.15.5:0/229024021 >> v1:172.21.15.5:6789/0 conn(0x7fd3bc06b1e0 legacy=0x7fd3bc0c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:25.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.928+0000 7fd3c0f0e640 1 -- 172.21.15.5:0/229024021 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2391174422 0 0) 0x7fd3a8003530 con 0x7fd3bc06b1e0 2023-07-14T13:29:25.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.928+0000 7fd3c1f10640 1 -- 172.21.15.5:0/229024021 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3bc0ca060 con 0x7fd3bc070b70 2023-07-14T13:29:25.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.928+0000 7fd3c2711640 1 --2- 172.21.15.5:0/229024021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3bc0cb100 0x7fd3bc0cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:29:25.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.928+0000 7fd3c1f10640 1 --2- 172.21.15.5:0/229024021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3bc070b70 0x7fd3bc070f40 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fd3b80097c0 tx=0x7fd3b801c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26e0144de72a73b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:25.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.932+0000 7fd3c0f0e640 1 -- 172.21.15.5:0/229024021 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac001680 con 0x7fd3bc070b70 2023-07-14T13:29:25.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.932+0000 7fd3c0f0e640 1 -- 172.21.15.5:0/229024021 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b80a7050 con 0x7fd3bc070b70 2023-07-14T13:29:25.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.932+0000 7fd3c0f0e640 1 -- 172.21.15.5:0/229024021 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b80ab620 con 0x7fd3bc070b70 2023-07-14T13:29:25.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.932+0000 7fd3c4174640 1 -- 172.21.15.5:0/229024021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3bc070b70 msgr2=0x7fd3bc070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:25.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.932+0000 7fd3c4174640 1 --2- 172.21.15.5:0/229024021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3bc070b70 0x7fd3bc070f40 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fd3b80097c0 tx=0x7fd3b801c370 comp rx=0 tx=0).stop 2023-07-14T13:29:25.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.932+0000 7fd3c4174640 1 -- 172.21.15.5:0/229024021 shutdown_connections 2023-07-14T13:29:25.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.932+0000 7fd3c4174640 1 --2- 172.21.15.5:0/229024021 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3bc0cb100 0x7fd3bc0cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.932+0000 7fd3c4174640 1 --2- 172.21.15.5:0/229024021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3bc070b70 0x7fd3bc070f40 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.932+0000 7fd3c4174640 1 -- 172.21.15.5:0/229024021 >> 172.21.15.5:0/229024021 conn(0x7fd3bc0afcf0 msgr2=0x7fd3bc0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:25.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.932+0000 7fd3c4174640 1 -- 172.21.15.5:0/229024021 shutdown_connections 2023-07-14T13:29:25.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.932+0000 7fd3c4174640 1 -- 172.21.15.5:0/229024021 wait complete. 2023-07-14T13:29:25.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.932+0000 7fd3c4174640 1 Processor -- start 2023-07-14T13:29:25.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.932+0000 7fd3c4174640 1 -- start start 2023-07-14T13:29:25.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.932+0000 7fd3c4174640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3bc06b1e0 0x7fd3bc14b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:25.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.932+0000 7fd3c4174640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3bc070b70 0x7fd3bc1590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:25.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.932+0000 7fd3c4174640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3bc0cb100 0x7fd3bc0b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:25.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.932+0000 7fd3c4174640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc151a30 con 0x7fd3bc070b70 2023-07-14T13:29:25.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.932+0000 7fd3c4174640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc151700 con 0x7fd3bc06b1e0 2023-07-14T13:29:25.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.932+0000 7fd3c4174640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc150cb0 con 0x7fd3bc0cb100 2023-07-14T13:29:25.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.932+0000 7fd3c170f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3bc070b70 0x7fd3bc1590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:25.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.932+0000 7fd3c170f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3bc070b70 0x7fd3bc1590c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48798/0 (socket says 172.21.15.5:48798) 2023-07-14T13:29:25.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.932+0000 7fd3c170f640 1 -- 172.21.15.5:0/1096194432 learned_addr learned my addr 172.21.15.5:0/1096194432 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:25.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.936+0000 7fd3c2711640 1 --2- 172.21.15.5:0/1096194432 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3bc0cb100 0x7fd3bc0b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:25.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.936+0000 7fd3c170f640 1 -- 172.21.15.5:0/1096194432 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3bc0cb100 msgr2=0x7fd3bc0b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:25.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.936+0000 7fd3c1f10640 1 --2- 172.21.15.5:0/1096194432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3bc06b1e0 0x7fd3bc14b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:25.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.936+0000 7fd3c170f640 1 --2- 172.21.15.5:0/1096194432 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3bc0cb100 0x7fd3bc0b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.936+0000 7fd3c170f640 1 -- 172.21.15.5:0/1096194432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3bc06b1e0 msgr2=0x7fd3bc14b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:25.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.936+0000 7fd3c170f640 1 --2- 172.21.15.5:0/1096194432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3bc06b1e0 0x7fd3bc14b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:25.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.936+0000 7fd3c170f640 1 -- 172.21.15.5:0/1096194432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b4009a70 con 0x7fd3bc070b70 2023-07-14T13:29:25.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.936+0000 7fd3c2711640 1 --2- 172.21.15.5:0/1096194432 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3bc0cb100 0x7fd3bc0b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:29:25.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.936+0000 7fd3c170f640 1 --2- 172.21.15.5:0/1096194432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3bc070b70 0x7fd3bc1590c0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00c780 tx=0x7fd3ac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:25.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.936+0000 7fd3b27fc640 1 -- 172.21.15.5:0/1096194432 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac005ae0 con 0x7fd3bc070b70 2023-07-14T13:29:25.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.936+0000 7fd3b27fc640 1 -- 172.21.15.5:0/1096194432 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ac005c40 con 0x7fd3bc070b70 2023-07-14T13:29:25.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.936+0000 7fd3b27fc640 1 -- 172.21.15.5:0/1096194432 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac007070 con 0x7fd3bc070b70 2023-07-14T13:29:25.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.936+0000 7fd3c4174640 1 -- 172.21.15.5:0/1096194432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b8009420 con 0x7fd3bc070b70 2023-07-14T13:29:25.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.936+0000 7fd3c4174640 1 -- 172.21.15.5:0/1096194432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3bc151270 con 0x7fd3bc070b70 2023-07-14T13:29:25.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.936+0000 7fd3c4174640 1 -- 172.21.15.5:0/1096194432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3bc0678d0 con 0x7fd3bc070b70 2023-07-14T13:29:25.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.936+0000 7fd3b27fc640 1 -- 172.21.15.5:0/1096194432 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 84) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fd3ac0071d0 con 0x7fd3bc070b70 2023-07-14T13:29:25.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.936+0000 7fd3b27fc640 1 --2- 172.21.15.5:0/1096194432 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd3a00660d0 0x7fd3a0068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:25.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.936+0000 7fd3b27fc640 1 -- 172.21.15.5:0/1096194432 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 7150+0+0 (secure 0 0 0) 0x7fd3ac083b50 con 0x7fd3bc070b70 2023-07-14T13:29:25.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.940+0000 7fd3c1f10640 1 --2- 172.21.15.5:0/1096194432 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd3a00660d0 0x7fd3a0068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:25.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.940+0000 7fd3c1f10640 1 --2- 172.21.15.5:0/1096194432 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd3a00660d0 0x7fd3a0068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd3b80ad000 tx=0x7fd3b8008040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:25.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:25.940+0000 7fd3b27fc640 1 -- 172.21.15.5:0/1096194432 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd3ac050ec0 con 0x7fd3bc070b70 2023-07-14T13:29:26.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.132+0000 7fd3c4174640 1 -- 172.21.15.5:0/1096194432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3bc0c98c0 con 0x7fd3bc070b70 2023-07-14T13:29:26.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.136+0000 7fd3b27fc640 1 -- 172.21.15.5:0/1096194432 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4708 (secure 0 0 0) 0x7fd3ac0544e0 con 0x7fd3bc070b70 2023-07-14T13:29:26.141 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:29:26.141 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":73,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3146480803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3146480803},{"type":"v1","addr":"172.21.15.154:6837","nonce":3146480803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8908,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2567208960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2567208960},{"type":"v1","addr":"172.21.15.5:6835","nonce":2567208960}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8911,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3591700265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3591700265},{"type":"v1","addr":"172.21.15.154:6836","nonce":3591700265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:13:03.243523+0000","modified":"2023-07-14T13:13:06.886056+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9336":{"gid":9336,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/840216087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":840216087},{"type":"v1","addr":"172.21.15.5:6834","nonce":840216087}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-14T13:29:26.142 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 73 2023-07-14T13:29:26.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.136+0000 7fd3c4174640 1 -- 172.21.15.5:0/1096194432 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd3a00660d0 msgr2=0x7fd3a0068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:26.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.136+0000 7fd3c4174640 1 --2- 172.21.15.5:0/1096194432 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd3a00660d0 0x7fd3a0068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd3b80ad000 tx=0x7fd3b8008040 comp rx=0 tx=0).stop 2023-07-14T13:29:26.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.136+0000 7fd3c4174640 1 -- 172.21.15.5:0/1096194432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3bc070b70 msgr2=0x7fd3bc1590c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:26.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.136+0000 7fd3c4174640 1 --2- 172.21.15.5:0/1096194432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3bc070b70 0x7fd3bc1590c0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00c780 tx=0x7fd3ac00cc40 comp rx=0 tx=0).stop 2023-07-14T13:29:26.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.136+0000 7fd3c4174640 1 -- 172.21.15.5:0/1096194432 shutdown_connections 2023-07-14T13:29:26.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.136+0000 7fd3c4174640 1 --2- 172.21.15.5:0/1096194432 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd3a00660d0 0x7fd3a0068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:26.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.136+0000 7fd3c4174640 1 --2- 172.21.15.5:0/1096194432 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd3bc0cb100 0x7fd3bc0b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:26.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.136+0000 7fd3c4174640 1 --2- 172.21.15.5:0/1096194432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3bc070b70 0x7fd3bc1590c0 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:26.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.136+0000 7fd3c4174640 1 --2- 172.21.15.5:0/1096194432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3bc06b1e0 0x7fd3bc14b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:26.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.136+0000 7fd3c4174640 1 -- 172.21.15.5:0/1096194432 >> 172.21.15.5:0/1096194432 conn(0x7fd3bc0afcf0 msgr2=0x7fd3bc0c1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:26.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.136+0000 7fd3c4174640 1 -- 172.21.15.5:0/1096194432 shutdown_connections 2023-07-14T13:29:26.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.136+0000 7fd3c4174640 1 -- 172.21.15.5:0/1096194432 wait complete. 2023-07-14T13:29:26.162 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:29:26.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.308+0000 7f13448a1640 1 Processor -- start 2023-07-14T13:29:26.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.308+0000 7f13448a1640 1 -- start start 2023-07-14T13:29:26.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.308+0000 7f13448a1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f13400b7d90 0x7f13400cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:26.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.308+0000 7f13448a1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13400d13f0 0x7f13400ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:26.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.308+0000 7f13448a1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13400d0f60 con 0x7f134015f3f0 2023-07-14T13:29:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.308+0000 7f13448a1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13400d0390 con 0x7f13400d13f0 2023-07-14T13:29:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.308+0000 7f13448a1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13400d0630 con 0x7f13400b7d90 2023-07-14T13:29:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.308+0000 7f133f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f134015f3f0 0x7f13400b7680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41214/0 (socket says 172.21.15.5:41214) 2023-07-14T13:29:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.308+0000 7f133f7fe640 1 -- 172.21.15.5:0/2794917665 learned_addr learned my addr 172.21.15.5:0/2794917665 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.308+0000 7f133ffff640 1 --2- 172.21.15.5:0/2794917665 >> v2:172.21.15.5:3300/0 conn(0x7f13400d13f0 0x7f13400ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.308+0000 7f133effd640 1 --2- 172.21.15.5:0/2794917665 >> v2:172.21.15.154:3300/0 conn(0x7f13400b7d90 0x7f13400cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.308+0000 7f133ffff640 1 -- 172.21.15.5:0/2794917665 >> v2:172.21.15.154:3300/0 conn(0x7f13400b7d90 msgr2=0x7f13400cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.308+0000 7f133ffff640 1 --2- 172.21.15.5:0/2794917665 >> v2:172.21.15.154:3300/0 conn(0x7f13400b7d90 0x7f13400cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.308+0000 7f133ffff640 1 -- 172.21.15.5:0/2794917665 >> v1:172.21.15.5:6789/0 conn(0x7f134015f3f0 legacy=0x7f13400b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.308+0000 7f133ffff640 1 -- 172.21.15.5:0/2794917665 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13400d0910 con 0x7f13400d13f0 2023-07-14T13:29:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.308+0000 7f133e7fc640 1 -- 172.21.15.5:0/2794917665 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933297336 0 0) 0x7f13400d0f60 con 0x7f134015f3f0 2023-07-14T13:29:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.312+0000 7f133ffff640 1 --2- 172.21.15.5:0/2794917665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13400d13f0 0x7f13400ccee0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f13400c5cc0 tx=0x7f133801c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53214f5e1376cb2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.312+0000 7f133e7fc640 1 -- 172.21.15.5:0/2794917665 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13380a5730 con 0x7f13400d13f0 2023-07-14T13:29:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.312+0000 7f133e7fc640 1 -- 172.21.15.5:0/2794917665 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13380a5890 con 0x7f13400d13f0 2023-07-14T13:29:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.312+0000 7f133e7fc640 1 -- 172.21.15.5:0/2794917665 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13380a5c20 con 0x7f13400d13f0 2023-07-14T13:29:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.312+0000 7f13448a1640 1 -- 172.21.15.5:0/2794917665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13400d13f0 msgr2=0x7f13400ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.312+0000 7f13448a1640 1 --2- 172.21.15.5:0/2794917665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13400d13f0 0x7f13400ccee0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f13400c5cc0 tx=0x7f133801c7f0 comp rx=0 tx=0).stop 2023-07-14T13:29:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.312+0000 7f13448a1640 1 -- 172.21.15.5:0/2794917665 shutdown_connections 2023-07-14T13:29:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.312+0000 7f13448a1640 1 --2- 172.21.15.5:0/2794917665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13400d13f0 0x7f13400ccee0 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.312+0000 7f13448a1640 1 --2- 172.21.15.5:0/2794917665 >> v2:172.21.15.154:3300/0 conn(0x7f13400b7d90 0x7f13400cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.312+0000 7f13448a1640 1 -- 172.21.15.5:0/2794917665 >> 172.21.15.5:0/2794917665 conn(0x7f1340069f50 msgr2=0x7f134006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.312+0000 7f13448a1640 1 -- 172.21.15.5:0/2794917665 shutdown_connections 2023-07-14T13:29:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.312+0000 7f13448a1640 1 -- 172.21.15.5:0/2794917665 wait complete. 2023-07-14T13:29:26.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.312+0000 7f13448a1640 1 Processor -- start 2023-07-14T13:29:26.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.316+0000 7f13448a1640 1 -- start start 2023-07-14T13:29:26.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.316+0000 7f13448a1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13400b7d90 0x7f13400c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:26.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.316+0000 7f13448a1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13400d13f0 0x7f1340155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:26.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.316+0000 7f13448a1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f134015f3f0 0x7f134015b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:26.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.316+0000 7f13448a1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13400c8330 con 0x7f13400d13f0 2023-07-14T13:29:26.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.316+0000 7f13448a1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13401f4480 con 0x7f13400b7d90 2023-07-14T13:29:26.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.316+0000 7f13448a1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13401f4760 con 0x7f134015f3f0 2023-07-14T13:29:26.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.316+0000 7f133effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13400d13f0 0x7f1340155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:26.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.316+0000 7f133effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13400d13f0 0x7f1340155460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48804/0 (socket says 172.21.15.5:48804) 2023-07-14T13:29:26.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.316+0000 7f133effd640 1 -- 172.21.15.5:0/509561384 learned_addr learned my addr 172.21.15.5:0/509561384 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:26.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.316+0000 7f133ffff640 1 --2- 172.21.15.5:0/509561384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f134015f3f0 0x7f134015b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:26.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.316+0000 7f133f7fe640 1 --2- 172.21.15.5:0/509561384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13400b7d90 0x7f13400c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:26.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.316+0000 7f133effd640 1 -- 172.21.15.5:0/509561384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f134015f3f0 msgr2=0x7f134015b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:26.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.316+0000 7f133effd640 1 --2- 172.21.15.5:0/509561384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f134015f3f0 0x7f134015b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:26.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.316+0000 7f133effd640 1 -- 172.21.15.5:0/509561384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13400b7d90 msgr2=0x7f13400c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:26.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.316+0000 7f133effd640 1 --2- 172.21.15.5:0/509561384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13400b7d90 0x7f13400c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:26.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.316+0000 7f133effd640 1 -- 172.21.15.5:0/509561384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1338009a70 con 0x7f13400d13f0 2023-07-14T13:29:26.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.316+0000 7f133ffff640 1 --2- 172.21.15.5:0/509561384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f134015f3f0 0x7f134015b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:29:26.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.316+0000 7f133f7fe640 1 --2- 172.21.15.5:0/509561384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13400b7d90 0x7f13400c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:29:26.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.316+0000 7f133effd640 1 --2- 172.21.15.5:0/509561384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13400d13f0 0x7f1340155460 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f133400d800 tx=0x7f133400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:26.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.316+0000 7f1327fff640 1 -- 172.21.15.5:0/509561384 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133400b6c0 con 0x7f13400d13f0 2023-07-14T13:29:26.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.316+0000 7f1327fff640 1 -- 172.21.15.5:0/509561384 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133400b840 con 0x7f13400d13f0 2023-07-14T13:29:26.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.316+0000 7f1327fff640 1 -- 172.21.15.5:0/509561384 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133400bbf0 con 0x7f13400d13f0 2023-07-14T13:29:26.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.316+0000 7f13448a1640 1 -- 172.21.15.5:0/509561384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13401f4a40 con 0x7f13400d13f0 2023-07-14T13:29:26.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.316+0000 7f13448a1640 1 -- 172.21.15.5:0/509561384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13401f4190 con 0x7f13400d13f0 2023-07-14T13:29:26.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.316+0000 7f13448a1640 1 -- 172.21.15.5:0/509561384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13401f4ef0 con 0x7f13400d13f0 2023-07-14T13:29:26.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.320+0000 7f1327fff640 1 -- 172.21.15.5:0/509561384 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f133400bd50 con 0x7f13400d13f0 2023-07-14T13:29:26.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.320+0000 7f1327fff640 1 --2- 172.21.15.5:0/509561384 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f132c0663d0 0x7f132c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:26.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.320+0000 7f1327fff640 1 -- 172.21.15.5:0/509561384 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 7150+0+0 (secure 0 0 0) 0x7f1334084860 con 0x7f13400d13f0 2023-07-14T13:29:26.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.320+0000 7f133f7fe640 1 --2- 172.21.15.5:0/509561384 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f132c0663d0 0x7f132c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:26.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.320+0000 7f133f7fe640 1 --2- 172.21.15.5:0/509561384 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f132c0663d0 0x7f132c068880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1330007fd0 tx=0x7f1330009040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:26.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.324+0000 7f1327fff640 1 -- 172.21.15.5:0/509561384 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f13401f4ef0 con 0x7f13400d13f0 2023-07-14T13:29:26.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.512+0000 7f13448a1640 1 -- 172.21.15.5:0/509561384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13401f4ef0 con 0x7f13400d13f0 2023-07-14T13:29:26.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.512+0000 7f1327fff640 1 -- 172.21.15.5:0/509561384 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4708 (secure 0 0 0) 0x7f13401f4ef0 con 0x7f13400d13f0 2023-07-14T13:29:26.518 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:29:26.519 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":73,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3146480803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3146480803},{"type":"v1","addr":"172.21.15.154:6837","nonce":3146480803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8908,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2567208960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2567208960},{"type":"v1","addr":"172.21.15.5:6835","nonce":2567208960}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8911,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3591700265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3591700265},{"type":"v1","addr":"172.21.15.154:6836","nonce":3591700265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:13:03.243523+0000","modified":"2023-07-14T13:13:06.886056+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9336},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9336":{"gid":9336,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6834/840216087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":840216087},{"type":"v1","addr":"172.21.15.5:6834","nonce":840216087}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-14T13:29:26.520 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 73 2023-07-14T13:29:26.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.512+0000 7f13448a1640 1 -- 172.21.15.5:0/509561384 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f132c0663d0 msgr2=0x7f132c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:26.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.512+0000 7f13448a1640 1 --2- 172.21.15.5:0/509561384 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f132c0663d0 0x7f132c068880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1330007fd0 tx=0x7f1330009040 comp rx=0 tx=0).stop 2023-07-14T13:29:26.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.512+0000 7f13448a1640 1 -- 172.21.15.5:0/509561384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13400d13f0 msgr2=0x7f1340155460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:26.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.512+0000 7f13448a1640 1 --2- 172.21.15.5:0/509561384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13400d13f0 0x7f1340155460 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f133400d800 tx=0x7f133400dcc0 comp rx=0 tx=0).stop 2023-07-14T13:29:26.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.512+0000 7f13448a1640 1 -- 172.21.15.5:0/509561384 shutdown_connections 2023-07-14T13:29:26.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.512+0000 7f13448a1640 1 --2- 172.21.15.5:0/509561384 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f132c0663d0 0x7f132c068880 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:26.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.512+0000 7f13448a1640 1 --2- 172.21.15.5:0/509561384 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f134015f3f0 0x7f134015b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:26.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.512+0000 7f13448a1640 1 --2- 172.21.15.5:0/509561384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13400d13f0 0x7f1340155460 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:26.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.512+0000 7f13448a1640 1 --2- 172.21.15.5:0/509561384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13400b7d90 0x7f13400c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:26.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.512+0000 7f13448a1640 1 -- 172.21.15.5:0/509561384 >> 172.21.15.5:0/509561384 conn(0x7f1340069f50 msgr2=0x7f13400d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:26.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.512+0000 7f13448a1640 1 -- 172.21.15.5:0/509561384 shutdown_connections 2023-07-14T13:29:26.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.512+0000 7f13448a1640 1 -- 172.21.15.5:0/509561384 wait complete. 2023-07-14T13:29:26.539 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:29:26.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.680+0000 7f9e6ed67640 1 Processor -- start 2023-07-14T13:29:26.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.680+0000 7f9e6ed67640 1 -- start start 2023-07-14T13:29:26.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.680+0000 7f9e6ed67640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e680c8ad0 0x7f9e680c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:26.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.680+0000 7f9e6ed67640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e680cc700 con 0x7f9e680c9560 2023-07-14T13:29:26.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.680+0000 7f9e6ed67640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e680b0ff0 con 0x7f9e68158ce0 2023-07-14T13:29:26.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.680+0000 7f9e6ed67640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e680c99e0 con 0x7f9e680c8ad0 2023-07-14T13:29:26.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.680+0000 7f9e6d304640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9e680c9560 0x7f9e680ccb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41224/0 (socket says 172.21.15.5:41224) 2023-07-14T13:29:26.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.680+0000 7f9e6d304640 1 -- 172.21.15.5:0/1832470762 learned_addr learned my addr 172.21.15.5:0/1832470762 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:26.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.680+0000 7f9e67fff640 1 --2- 172.21.15.5:0/1832470762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e680c8ad0 0x7f9e680c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:26.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.680+0000 7f9e677fe640 1 -- 172.21.15.5:0/1832470762 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 272929447 0 0) 0x7f9e680cc700 con 0x7f9e680c9560 2023-07-14T13:29:26.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.680+0000 7f9e677fe640 1 -- 172.21.15.5:0/1832470762 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e58005740 con 0x7f9e680c9560 2023-07-14T13:29:26.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.680+0000 7f9e677fe640 1 -- 172.21.15.5:0/1832470762 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407945667 0 0) 0x7f9e680b0ff0 con 0x7f9e68158ce0 2023-07-14T13:29:26.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.680+0000 7f9e677fe640 1 -- 172.21.15.5:0/1832470762 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e680cc700 con 0x7f9e68158ce0 2023-07-14T13:29:26.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.680+0000 7f9e677fe640 1 -- 172.21.15.5:0/1832470762 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2667673277 0 0) 0x7f9e58005740 con 0x7f9e680c9560 2023-07-14T13:29:26.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.680+0000 7f9e67fff640 1 -- 172.21.15.5:0/1832470762 >> v1:172.21.15.154:6789/0 conn(0x7f9e68158ce0 legacy=0x7f9e68070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:26.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.680+0000 7f9e67fff640 1 -- 172.21.15.5:0/1832470762 >> v1:172.21.15.5:6789/0 conn(0x7f9e680c9560 legacy=0x7f9e680ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:26.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.680+0000 7f9e67fff640 1 -- 172.21.15.5:0/1832470762 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e68070c80 con 0x7f9e680c8ad0 2023-07-14T13:29:26.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.684+0000 7f9e67fff640 1 --2- 172.21.15.5:0/1832470762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e680c8ad0 0x7f9e680c9020 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9e540097f0 tx=0x7f9e5401c290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23c95dd5e33a0838 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:26.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.684+0000 7f9e677fe640 1 -- 172.21.15.5:0/1832470762 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e540a4ea0 con 0x7f9e680c8ad0 2023-07-14T13:29:26.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.684+0000 7f9e677fe640 1 -- 172.21.15.5:0/1832470762 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e540a7050 con 0x7f9e680c8ad0 2023-07-14T13:29:26.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.684+0000 7f9e677fe640 1 -- 172.21.15.5:0/1832470762 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e60001a00 con 0x7f9e680c8ad0 2023-07-14T13:29:26.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.684+0000 7f9e6ed67640 1 -- 172.21.15.5:0/1832470762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e680c8ad0 msgr2=0x7f9e680c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:26.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.684+0000 7f9e6ed67640 1 --2- 172.21.15.5:0/1832470762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e680c8ad0 0x7f9e680c9020 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9e540097f0 tx=0x7f9e5401c290 comp rx=0 tx=0).stop 2023-07-14T13:29:26.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.684+0000 7f9e6ed67640 1 -- 172.21.15.5:0/1832470762 shutdown_connections 2023-07-14T13:29:26.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.684+0000 7f9e6ed67640 1 --2- 172.21.15.5:0/1832470762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e680c8ad0 0x7f9e680c9020 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:26.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.684+0000 7f9e6ed67640 1 -- 172.21.15.5:0/1832470762 >> 172.21.15.5:0/1832470762 conn(0x7f9e680afcf0 msgr2=0x7f9e680b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:26.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.684+0000 7f9e6ed67640 1 -- 172.21.15.5:0/1832470762 shutdown_connections 2023-07-14T13:29:26.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.684+0000 7f9e6ed67640 1 -- 172.21.15.5:0/1832470762 wait complete. 2023-07-14T13:29:26.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.688+0000 7f9e6ed67640 1 Processor -- start 2023-07-14T13:29:26.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.688+0000 7f9e6ed67640 1 -- start start 2023-07-14T13:29:26.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.688+0000 7f9e6ed67640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e680c8ad0 0x7f9e6814bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:26.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.688+0000 7f9e6ed67640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e680c9560 0x7f9e681f37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:26.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.688+0000 7f9e6ed67640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e68158ce0 0x7f9e681f3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.688+0000 7f9e6ed67640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e68158460 con 0x7f9e68158ce0 2023-07-14T13:29:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.688+0000 7f9e6ed67640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6814cc70 con 0x7f9e680c8ad0 2023-07-14T13:29:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.688+0000 7f9e6ed67640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e680afa90 con 0x7f9e680c9560 2023-07-14T13:29:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.688+0000 7f9e6d304640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e68158ce0 0x7f9e681f3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.688+0000 7f9e6d304640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e68158ce0 0x7f9e681f3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48816/0 (socket says 172.21.15.5:48816) 2023-07-14T13:29:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.688+0000 7f9e6d304640 1 -- 172.21.15.5:0/3674599785 learned_addr learned my addr 172.21.15.5:0/3674599785 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:26.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.688+0000 7f9e6cb03640 1 --2- 172.21.15.5:0/3674599785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e680c8ad0 0x7f9e6814bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:26.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.688+0000 7f9e67fff640 1 --2- 172.21.15.5:0/3674599785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e680c9560 0x7f9e681f37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:26.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.688+0000 7f9e6d304640 1 -- 172.21.15.5:0/3674599785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e680c9560 msgr2=0x7f9e681f37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:26.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.688+0000 7f9e6d304640 1 --2- 172.21.15.5:0/3674599785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e680c9560 0x7f9e681f37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:26.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.688+0000 7f9e6d304640 1 -- 172.21.15.5:0/3674599785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e680c8ad0 msgr2=0x7f9e6814bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:26.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.688+0000 7f9e6d304640 1 --2- 172.21.15.5:0/3674599785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e680c8ad0 0x7f9e6814bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:26.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.688+0000 7f9e6d304640 1 -- 172.21.15.5:0/3674599785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e54009420 con 0x7f9e68158ce0 2023-07-14T13:29:26.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.688+0000 7f9e6cb03640 1 --2- 172.21.15.5:0/3674599785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e680c8ad0 0x7f9e6814bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:29:26.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.688+0000 7f9e6d304640 1 --2- 172.21.15.5:0/3674599785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e68158ce0 0x7f9e681f3cf0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f9e60002040 tx=0x7f9e6000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:26.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.692+0000 7f9e657fa640 1 -- 172.21.15.5:0/3674599785 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e60012400 con 0x7f9e68158ce0 2023-07-14T13:29:26.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.692+0000 7f9e657fa640 1 -- 172.21.15.5:0/3674599785 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e60012560 con 0x7f9e68158ce0 2023-07-14T13:29:26.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.692+0000 7f9e657fa640 1 -- 172.21.15.5:0/3674599785 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e60012910 con 0x7f9e68158ce0 2023-07-14T13:29:26.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.692+0000 7f9e6ed67640 1 -- 172.21.15.5:0/3674599785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e681435b0 con 0x7f9e68158ce0 2023-07-14T13:29:26.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.692+0000 7f9e6ed67640 1 -- 172.21.15.5:0/3674599785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e680af570 con 0x7f9e68158ce0 2023-07-14T13:29:26.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.692+0000 7f9e6ed67640 1 -- 172.21.15.5:0/3674599785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e680ca1a0 con 0x7f9e68158ce0 2023-07-14T13:29:26.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.692+0000 7f9e657fa640 1 -- 172.21.15.5:0/3674599785 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9e60012a70 con 0x7f9e68158ce0 2023-07-14T13:29:26.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.692+0000 7f9e657fa640 1 --2- 172.21.15.5:0/3674599785 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f9e4c0663f0 0x7f9e4c0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:26.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.692+0000 7f9e657fa640 1 -- 172.21.15.5:0/3674599785 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 7150+0+0 (secure 0 0 0) 0x7f9e60084940 con 0x7f9e68158ce0 2023-07-14T13:29:26.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.692+0000 7f9e6cb03640 1 --2- 172.21.15.5:0/3674599785 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f9e4c0663f0 0x7f9e4c0688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:26.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.696+0000 7f9e6cb03640 1 --2- 172.21.15.5:0/3674599785 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f9e4c0663f0 0x7f9e4c0688a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c0011f0 tx=0x7f9e5c009040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:26.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.696+0000 7f9e657fa640 1 -- 172.21.15.5:0/3674599785 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9e60051990 con 0x7f9e68158ce0 2023-07-14T13:29:26.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.856+0000 7f9e6ed67640 1 -- 172.21.15.5:0/3674599785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e6814c7d0 con 0x7f9e68158ce0 2023-07-14T13:29:26.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.860+0000 7f9e657fa640 1 -- 172.21.15.5:0/3674599785 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+19899 (secure 0 0 0) 0x7f9e60054fb0 con 0x7f9e68158ce0 2023-07-14T13:29:26.865 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:29:26.865 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":161,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:29:26.126420+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:13:01.372511+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-14T13:13:02.236215+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":159,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/2262646220":"2023-07-15T13:29:24.028549+0000","172.21.15.154:6833/1973779483":"2023-07-15T13:29:24.028549+0000","172.21.15.154:6832/1973779483":"2023-07-15T13:29:24.028549+0000","172.21.15.154:0/2471411083":"2023-07-15T13:29:24.028549+0000","172.21.15.154:0/2755630099":"2023-07-15T13:29:24.028549+0000","172.21.15.154:0/3403666064":"2023-07-15T13:29:24.028549+0000","172.21.15.154:0/3205049834":"2023-07-15T13:24:20.729701+0000","172.21.15.154:0/2448917971":"2023-07-15T13:24:20.729701+0000","172.21.15.154:0/3347209674":"2023-07-15T13:24:20.729701+0000","172.21.15.154:0/2602756791":"2023-07-15T13:24:20.729701+0000","172.21.15.154:6833/3414173858":"2023-07-15T13:24:20.729701+0000","172.21.15.154:0/1387122589":"2023-07-15T13:24:20.729701+0000","172.21.15.154:0/2148864146":"2023-07-15T13:24:20.729701+0000","172.21.15.154:0/1540806126":"2023-07-15T13:13:20.528876+0000","172.21.15.154:0/77258959":"2023-07-15T13:13:20.528876+0000","172.21.15.154:0/4204288379":"2023-07-15T13:29:24.028549+0000","172.21.15.154:0/1084316036":"2023-07-15T13:13:20.528876+0000","172.21.15.154:0/661817451":"2023-07-15T13:13:20.528876+0000","172.21.15.154:0/261234270":"2023-07-15T13:13:20.528876+0000","172.21.15.154:0/1648971414":"2023-07-15T13:29:24.028549+0000","172.21.15.154:0/3779193680":"2023-07-15T13:13:20.528876+0000","172.21.15.154:6832/3414173858":"2023-07-15T13:24:20.729701+0000","172.21.15.154:6833/1443161386":"2023-07-15T13:13:20.528876+0000","172.21.15.154:6832/1443161386":"2023-07-15T13:13:20.528876+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":20,"snaps":[{"begin":2,"length":32}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:29:26.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.860+0000 7f9e6ed67640 1 -- 172.21.15.5:0/3674599785 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f9e4c0663f0 msgr2=0x7f9e4c0688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:26.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.860+0000 7f9e6ed67640 1 --2- 172.21.15.5:0/3674599785 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f9e4c0663f0 0x7f9e4c0688a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c0011f0 tx=0x7f9e5c009040 comp rx=0 tx=0).stop 2023-07-14T13:29:26.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.860+0000 7f9e6ed67640 1 -- 172.21.15.5:0/3674599785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e68158ce0 msgr2=0x7f9e681f3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:26.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.860+0000 7f9e6ed67640 1 --2- 172.21.15.5:0/3674599785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e68158ce0 0x7f9e681f3cf0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f9e60002040 tx=0x7f9e6000a430 comp rx=0 tx=0).stop 2023-07-14T13:29:26.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.860+0000 7f9e6ed67640 1 -- 172.21.15.5:0/3674599785 shutdown_connections 2023-07-14T13:29:26.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.860+0000 7f9e6ed67640 1 --2- 172.21.15.5:0/3674599785 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f9e4c0663f0 0x7f9e4c0688a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:26.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.860+0000 7f9e6ed67640 1 --2- 172.21.15.5:0/3674599785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e68158ce0 0x7f9e681f3cf0 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:26.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.860+0000 7f9e6ed67640 1 --2- 172.21.15.5:0/3674599785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e680c9560 0x7f9e681f37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:26.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.860+0000 7f9e6ed67640 1 --2- 172.21.15.5:0/3674599785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e680c8ad0 0x7f9e6814bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:26.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.860+0000 7f9e6ed67640 1 -- 172.21.15.5:0/3674599785 >> 172.21.15.5:0/3674599785 conn(0x7f9e680afcf0 msgr2=0x7f9e68157560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:26.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.860+0000 7f9e6ed67640 1 -- 172.21.15.5:0/3674599785 shutdown_connections 2023-07-14T13:29:26.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:26.860+0000 7f9e6ed67640 1 -- 172.21.15.5:0/3674599785 wait complete. 2023-07-14T13:29:26.886 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-14T13:29:27.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.028+0000 7fd1eb4d8640 1 Processor -- start 2023-07-14T13:29:27.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.028+0000 7fd1eb4d8640 1 -- start start 2023-07-14T13:29:27.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.028+0000 7fd1eb4d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1e4070b70 0x7fd1e4070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:27.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.028+0000 7fd1eb4d8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd1e406b1e0 0x7fd1e40c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:27.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.028+0000 7fd1eb4d8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e40cac70 con 0x7fd1e40c21f0 2023-07-14T13:29:27.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.028+0000 7fd1eb4d8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e4071480 con 0x7fd1e406b1e0 2023-07-14T13:29:27.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.028+0000 7fd1eb4d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e40ca060 con 0x7fd1e4070b70 2023-07-14T13:29:27.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.028+0000 7fd1e8a73640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd1e406b1e0 0x7fd1e40c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:27.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.028+0000 7fd1e9274640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1e4070b70 0x7fd1e4070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:27.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.028+0000 7fd1e9a75640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd1e40c21f0 0x7fd1e40cb100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:59458/0 (socket says 172.21.15.5:59458) 2023-07-14T13:29:27.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.028+0000 7fd1e9a75640 1 -- 172.21.15.5:0/3169904218 learned_addr learned my addr 172.21.15.5:0/3169904218 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:27.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.028+0000 7fd1e9274640 1 -- 172.21.15.5:0/3169904218 >> v2:172.21.15.154:3300/0 conn(0x7fd1e406b1e0 msgr2=0x7fd1e40c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:27.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.028+0000 7fd1e9274640 1 --2- 172.21.15.5:0/3169904218 >> v2:172.21.15.154:3300/0 conn(0x7fd1e406b1e0 0x7fd1e40c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:27.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.028+0000 7fd1e9274640 1 -- 172.21.15.5:0/3169904218 >> v1:172.21.15.154:6789/0 conn(0x7fd1e40c21f0 legacy=0x7fd1e40cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:27.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.028+0000 7fd1e9274640 1 -- 172.21.15.5:0/3169904218 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e40ca340 con 0x7fd1e4070b70 2023-07-14T13:29:27.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.028+0000 7fd1e8a73640 1 --2- 172.21.15.5:0/3169904218 >> v2:172.21.15.154:3300/0 conn(0x7fd1e406b1e0 0x7fd1e40c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:29:27.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.032+0000 7fd1e9274640 1 --2- 172.21.15.5:0/3169904218 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1e4070b70 0x7fd1e4070f40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd1e00097c0 tx=0x7fd1e001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f664d95cd4745d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:27.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.032+0000 7fd1dbfff640 1 -- 172.21.15.5:0/3169904218 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e00ac620 con 0x7fd1e4070b70 2023-07-14T13:29:27.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.032+0000 7fd1dbfff640 1 -- 172.21.15.5:0/3169904218 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e00ac780 con 0x7fd1e4070b70 2023-07-14T13:29:27.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.032+0000 7fd1dbfff640 1 -- 172.21.15.5:0/3169904218 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e00acb10 con 0x7fd1e4070b70 2023-07-14T13:29:27.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.032+0000 7fd1eb4d8640 1 -- 172.21.15.5:0/3169904218 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1e4070b70 msgr2=0x7fd1e4070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:27.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.032+0000 7fd1eb4d8640 1 --2- 172.21.15.5:0/3169904218 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1e4070b70 0x7fd1e4070f40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd1e00097c0 tx=0x7fd1e001c3c0 comp rx=0 tx=0).stop 2023-07-14T13:29:27.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.032+0000 7fd1eb4d8640 1 -- 172.21.15.5:0/3169904218 shutdown_connections 2023-07-14T13:29:27.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.032+0000 7fd1eb4d8640 1 --2- 172.21.15.5:0/3169904218 >> v2:172.21.15.154:3300/0 conn(0x7fd1e406b1e0 0x7fd1e40c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:27.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.032+0000 7fd1eb4d8640 1 --2- 172.21.15.5:0/3169904218 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1e4070b70 0x7fd1e4070f40 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.032+0000 7fd1eb4d8640 1 -- 172.21.15.5:0/3169904218 >> 172.21.15.5:0/3169904218 conn(0x7fd1e40afcf0 msgr2=0x7fd1e40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.032+0000 7fd1eb4d8640 1 -- 172.21.15.5:0/3169904218 shutdown_connections 2023-07-14T13:29:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.032+0000 7fd1eb4d8640 1 -- 172.21.15.5:0/3169904218 wait complete. 2023-07-14T13:29:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.036+0000 7fd1eb4d8640 1 Processor -- start 2023-07-14T13:29:27.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.036+0000 7fd1eb4d8640 1 -- start start 2023-07-14T13:29:27.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.036+0000 7fd1eb4d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1e406b1e0 0x7fd1e4153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:27.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.036+0000 7fd1eb4d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1e4070b70 0x7fd1e41551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:27.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.036+0000 7fd1eb4d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1e40c21f0 0x7fd1e414cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:27.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.036+0000 7fd1eb4d8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e4154120 con 0x7fd1e4070b70 2023-07-14T13:29:27.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.036+0000 7fd1eb4d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e4154400 con 0x7fd1e406b1e0 2023-07-14T13:29:27.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.036+0000 7fd1eb4d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e41546e0 con 0x7fd1e40c21f0 2023-07-14T13:29:27.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.036+0000 7fd1e8a73640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1e4070b70 0x7fd1e41551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:27.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.036+0000 7fd1e8a73640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1e4070b70 0x7fd1e41551c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48818/0 (socket says 172.21.15.5:48818) 2023-07-14T13:29:27.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.036+0000 7fd1e8a73640 1 -- 172.21.15.5:0/2986742456 learned_addr learned my addr 172.21.15.5:0/2986742456 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:27.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.036+0000 7fd1e9274640 1 --2- 172.21.15.5:0/2986742456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1e406b1e0 0x7fd1e4153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:27.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.036+0000 7fd1e9a75640 1 --2- 172.21.15.5:0/2986742456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1e40c21f0 0x7fd1e414cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:27.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.036+0000 7fd1e8a73640 1 -- 172.21.15.5:0/2986742456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1e40c21f0 msgr2=0x7fd1e414cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:27.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.036+0000 7fd1e8a73640 1 --2- 172.21.15.5:0/2986742456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1e40c21f0 0x7fd1e414cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:27.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.036+0000 7fd1e8a73640 1 -- 172.21.15.5:0/2986742456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1e406b1e0 msgr2=0x7fd1e4153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:27.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.036+0000 7fd1e8a73640 1 --2- 172.21.15.5:0/2986742456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1e406b1e0 0x7fd1e4153a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:27.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.036+0000 7fd1e8a73640 1 -- 172.21.15.5:0/2986742456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d4009420 con 0x7fd1e4070b70 2023-07-14T13:29:27.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.036+0000 7fd1e8a73640 1 --2- 172.21.15.5:0/2986742456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1e4070b70 0x7fd1e41551c0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fd1d400ebe0 tx=0x7fd1d400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:27.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.040+0000 7fd1d9ffb640 1 -- 172.21.15.5:0/2986742456 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d400eee0 con 0x7fd1e4070b70 2023-07-14T13:29:27.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.040+0000 7fd1d9ffb640 1 -- 172.21.15.5:0/2986742456 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d400cc30 con 0x7fd1e4070b70 2023-07-14T13:29:27.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.040+0000 7fd1d9ffb640 1 -- 172.21.15.5:0/2986742456 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4013470 con 0x7fd1e4070b70 2023-07-14T13:29:27.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.040+0000 7fd1eb4d8640 1 -- 172.21.15.5:0/2986742456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e0009420 con 0x7fd1e4070b70 2023-07-14T13:29:27.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.040+0000 7fd1eb4d8640 1 -- 172.21.15.5:0/2986742456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e4154ca0 con 0x7fd1e4070b70 2023-07-14T13:29:27.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.040+0000 7fd1eb4d8640 1 -- 172.21.15.5:0/2986742456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e40678d0 con 0x7fd1e4070b70 2023-07-14T13:29:27.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.040+0000 7fd1d9ffb640 1 -- 172.21.15.5:0/2986742456 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd1d40135d0 con 0x7fd1e4070b70 2023-07-14T13:29:27.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.040+0000 7fd1d9ffb640 1 --2- 172.21.15.5:0/2986742456 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd1c80663a0 0x7fd1c8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:27.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.044+0000 7fd1d9ffb640 1 -- 172.21.15.5:0/2986742456 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 7150+0+0 (secure 0 0 0) 0x7fd1d4084520 con 0x7fd1e4070b70 2023-07-14T13:29:27.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.044+0000 7fd1e9274640 1 --2- 172.21.15.5:0/2986742456 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd1c80663a0 0x7fd1c8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:27.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.044+0000 7fd1e9274640 1 --2- 172.21.15.5:0/2986742456 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd1c80663a0 0x7fd1c8068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd1e00ae000 tx=0x7fd1e00a7000 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:27.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.048+0000 7fd1d9ffb640 1 -- 172.21.15.5:0/2986742456 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd1d4054f80 con 0x7fd1e4070b70 2023-07-14T13:29:27.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.236+0000 7fd1eb4d8640 1 -- 172.21.15.5:0/2986742456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd1e40c98c0 con 0x7fd1e4070b70 2023-07-14T13:29:27.243 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-07-14T13:29:27.236+0000 7f17b1648640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-14T13:29:27.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.240+0000 7fd1d9ffb640 1 -- 172.21.15.5:0/2986742456 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v74) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd1d4054b10 con 0x7fd1e4070b70 2023-07-14T13:29:27.248 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-14T13:29:27.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.244+0000 7fd1eb4d8640 1 -- 172.21.15.5:0/2986742456 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd1c80663a0 msgr2=0x7fd1c8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:27.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.244+0000 7fd1eb4d8640 1 --2- 172.21.15.5:0/2986742456 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd1c80663a0 0x7fd1c8068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd1e00ae000 tx=0x7fd1e00a7000 comp rx=0 tx=0).stop 2023-07-14T13:29:27.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.244+0000 7fd1eb4d8640 1 -- 172.21.15.5:0/2986742456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1e4070b70 msgr2=0x7fd1e41551c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:27.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.244+0000 7fd1eb4d8640 1 --2- 172.21.15.5:0/2986742456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1e4070b70 0x7fd1e41551c0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fd1d400ebe0 tx=0x7fd1d400c520 comp rx=0 tx=0).stop 2023-07-14T13:29:27.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.244+0000 7fd1eb4d8640 1 -- 172.21.15.5:0/2986742456 shutdown_connections 2023-07-14T13:29:27.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.244+0000 7fd1eb4d8640 1 --2- 172.21.15.5:0/2986742456 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd1c80663a0 0x7fd1c8068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:27.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.244+0000 7fd1eb4d8640 1 --2- 172.21.15.5:0/2986742456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1e40c21f0 0x7fd1e414cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:27.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.244+0000 7fd1eb4d8640 1 --2- 172.21.15.5:0/2986742456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1e4070b70 0x7fd1e41551c0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:27.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.244+0000 7fd1eb4d8640 1 --2- 172.21.15.5:0/2986742456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1e406b1e0 0x7fd1e4153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:27.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.244+0000 7fd1eb4d8640 1 -- 172.21.15.5:0/2986742456 >> 172.21.15.5:0/2986742456 conn(0x7fd1e40afcf0 msgr2=0x7fd1e40b2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:27.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.244+0000 7fd1eb4d8640 1 -- 172.21.15.5:0/2986742456 shutdown_connections 2023-07-14T13:29:27.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.244+0000 7fd1eb4d8640 1 -- 172.21.15.5:0/2986742456 wait complete. 2023-07-14T13:29:27.270 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-14T13:29:27.313 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-07-14T13:29:27.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.416+0000 7fd039093640 1 Processor -- start 2023-07-14T13:29:27.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.416+0000 7fd039093640 1 -- start start 2023-07-14T13:29:27.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.416+0000 7fd039093640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd034156560 0x7fd0340cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:27.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.416+0000 7fd039093640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd0340ccf60 0x7fd0340cd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:27.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.416+0000 7fd039093640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd034158df0 0x7fd034159270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:27.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.416+0000 7fd039093640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0341597b0 con 0x7fd0340ccf60 2023-07-14T13:29:27.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.416+0000 7fd039093640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0340b08d0 con 0x7fd034158df0 2023-07-14T13:29:27.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.416+0000 7fd039093640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0340cd8d0 con 0x7fd034156560 2023-07-14T13:29:27.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.416+0000 7fd02bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd0340ccf60 0x7fd0340cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:27.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.416+0000 7fd02bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd0340ccf60 0x7fd0340cd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48840/0 (socket says 172.21.15.5:48840) 2023-07-14T13:29:27.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.416+0000 7fd02bfff640 1 -- 172.21.15.5:0/1054643659 learned_addr learned my addr 172.21.15.5:0/1054643659 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:27.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.416+0000 7fd03359e640 1 --2- 172.21.15.5:0/1054643659 >> v2:172.21.15.154:3300/0 conn(0x7fd034158df0 0x7fd034159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:27.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.416+0000 7fd02bfff640 1 -- 172.21.15.5:0/1054643659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd034156560 msgr2=0x7fd0340cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:27.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.416+0000 7fd02bfff640 1 --2- 172.21.15.5:0/1054643659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd034156560 0x7fd0340cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:27.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.416+0000 7fd02bfff640 1 -- 172.21.15.5:0/1054643659 >> v2:172.21.15.154:3300/0 conn(0x7fd034158df0 msgr2=0x7fd034159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:27.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.416+0000 7fd02bfff640 1 --2- 172.21.15.5:0/1054643659 >> v2:172.21.15.154:3300/0 conn(0x7fd034158df0 0x7fd034159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:27.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.416+0000 7fd02bfff640 1 -- 172.21.15.5:0/1054643659 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd034159cb0 con 0x7fd0340ccf60 2023-07-14T13:29:27.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.416+0000 7fd03359e640 1 --2- 172.21.15.5:0/1054643659 >> v2:172.21.15.154:3300/0 conn(0x7fd034158df0 0x7fd034159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:29:27.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.420+0000 7fd02bfff640 1 --2- 172.21.15.5:0/1054643659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0340ccf60 0x7fd0340cd390 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fd01c00bb40 tx=0x7fd01c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b12453d6ccd8ba server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:27.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.420+0000 7fd03259c640 1 -- 172.21.15.5:0/1054643659 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c0a5a00 con 0x7fd0340ccf60 2023-07-14T13:29:27.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.420+0000 7fd03259c640 1 -- 172.21.15.5:0/1054643659 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01c0a5b60 con 0x7fd0340ccf60 2023-07-14T13:29:27.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.420+0000 7fd03259c640 1 -- 172.21.15.5:0/1054643659 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c0ad440 con 0x7fd0340ccf60 2023-07-14T13:29:27.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.420+0000 7fd039093640 1 -- 172.21.15.5:0/1054643659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0340ccf60 msgr2=0x7fd0340cd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:27.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.420+0000 7fd039093640 1 --2- 172.21.15.5:0/1054643659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0340ccf60 0x7fd0340cd390 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fd01c00bb40 tx=0x7fd01c01c980 comp rx=0 tx=0).stop 2023-07-14T13:29:27.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.420+0000 7fd039093640 1 -- 172.21.15.5:0/1054643659 shutdown_connections 2023-07-14T13:29:27.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.420+0000 7fd039093640 1 --2- 172.21.15.5:0/1054643659 >> v2:172.21.15.154:3300/0 conn(0x7fd034158df0 0x7fd034159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:27.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.420+0000 7fd039093640 1 --2- 172.21.15.5:0/1054643659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0340ccf60 0x7fd0340cd390 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:27.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.420+0000 7fd039093640 1 --2- 172.21.15.5:0/1054643659 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd034156560 0x7fd0340cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:27.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.420+0000 7fd039093640 1 -- 172.21.15.5:0/1054643659 >> 172.21.15.5:0/1054643659 conn(0x7fd0340afac0 msgr2=0x7fd0340afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:27.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.420+0000 7fd039093640 1 -- 172.21.15.5:0/1054643659 shutdown_connections 2023-07-14T13:29:27.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.420+0000 7fd039093640 1 -- 172.21.15.5:0/1054643659 wait complete. 2023-07-14T13:29:27.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.424+0000 7fd039093640 1 Processor -- start 2023-07-14T13:29:27.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.424+0000 7fd039093640 1 -- start start 2023-07-14T13:29:27.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.424+0000 7fd039093640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0340ccf60 0x7fd0340b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:27.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.424+0000 7fd039093640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd034156560 0x7fd034150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:27.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.424+0000 7fd039093640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd034158df0 0x7fd034150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:27.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.424+0000 7fd039093640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0340c7a90 con 0x7fd034156560 2023-07-14T13:29:27.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.424+0000 7fd039093640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0340b36b0 con 0x7fd0340ccf60 2023-07-14T13:29:27.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.424+0000 7fd039093640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0340b2d60 con 0x7fd034158df0 2023-07-14T13:29:27.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.424+0000 7fd02bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd034156560 0x7fd034150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:27.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.424+0000 7fd02bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd034156560 0x7fd034150430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48846/0 (socket says 172.21.15.5:48846) 2023-07-14T13:29:27.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.424+0000 7fd02bfff640 1 -- 172.21.15.5:0/437207352 learned_addr learned my addr 172.21.15.5:0/437207352 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:27.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.424+0000 7fd032d9d640 1 --2- 172.21.15.5:0/437207352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0340ccf60 0x7fd0340b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:27.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.424+0000 7fd03359e640 1 --2- 172.21.15.5:0/437207352 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd034158df0 0x7fd034150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:27.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.424+0000 7fd02bfff640 1 -- 172.21.15.5:0/437207352 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd034158df0 msgr2=0x7fd034150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:27.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.424+0000 7fd02bfff640 1 --2- 172.21.15.5:0/437207352 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd034158df0 0x7fd034150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:27.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.424+0000 7fd02bfff640 1 -- 172.21.15.5:0/437207352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0340ccf60 msgr2=0x7fd0340b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:27.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.424+0000 7fd02bfff640 1 --2- 172.21.15.5:0/437207352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0340ccf60 0x7fd0340b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:27.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.424+0000 7fd02bfff640 1 -- 172.21.15.5:0/437207352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01c00b770 con 0x7fd034156560 2023-07-14T13:29:27.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.424+0000 7fd02bfff640 1 --2- 172.21.15.5:0/437207352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd034156560 0x7fd034150430 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fd01c00b2c0 tx=0x7fd01c019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:27.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.424+0000 7fd02b7fe640 1 -- 172.21.15.5:0/437207352 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c0a5a00 con 0x7fd034156560 2023-07-14T13:29:27.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.424+0000 7fd02b7fe640 1 -- 172.21.15.5:0/437207352 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01c0b6400 con 0x7fd034156560 2023-07-14T13:29:27.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.424+0000 7fd02b7fe640 1 -- 172.21.15.5:0/437207352 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c0b6790 con 0x7fd034156560 2023-07-14T13:29:27.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.424+0000 7fd039093640 1 -- 172.21.15.5:0/437207352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0340c69f0 con 0x7fd034156560 2023-07-14T13:29:27.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.424+0000 7fd039093640 1 -- 172.21.15.5:0/437207352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0340c6fb0 con 0x7fd034156560 2023-07-14T13:29:27.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.424+0000 7fd039093640 1 -- 172.21.15.5:0/437207352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0340678d0 con 0x7fd034156560 2023-07-14T13:29:27.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.428+0000 7fd02b7fe640 1 -- 172.21.15.5:0/437207352 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd01c0b4040 con 0x7fd034156560 2023-07-14T13:29:27.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.428+0000 7fd02b7fe640 1 --2- 172.21.15.5:0/437207352 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd0140663a0 0x7fd014068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:27.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.428+0000 7fd02b7fe640 1 -- 172.21.15.5:0/437207352 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 7208+0+0 (secure 0 0 0) 0x7fd01c11f330 con 0x7fd034156560 2023-07-14T13:29:27.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.428+0000 7fd032d9d640 1 --2- 172.21.15.5:0/437207352 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd0140663a0 0x7fd014068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:27.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.428+0000 7fd032d9d640 1 --2- 172.21.15.5:0/437207352 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd0140663a0 0x7fd014068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd024009990 tx=0x7fd024009110 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:27.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.432+0000 7fd02b7fe640 1 -- 172.21.15.5:0/437207352 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd01c0ec180 con 0x7fd034156560 2023-07-14T13:29:27.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:27.620+0000 7fd039093640 1 -- 172.21.15.5:0/437207352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd03406b920 con 0x7fd034156560 2023-07-14T13:29:28.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.252+0000 7fd02b7fe640 1 -- 172.21.15.5:0/437207352 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v75) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd01c0ef7a0 con 0x7fd034156560 2023-07-14T13:29:28.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.252+0000 7fd039093640 1 -- 172.21.15.5:0/437207352 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd0140663a0 msgr2=0x7fd014068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:28.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.252+0000 7fd039093640 1 --2- 172.21.15.5:0/437207352 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd0140663a0 0x7fd014068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd024009990 tx=0x7fd024009110 comp rx=0 tx=0).stop 2023-07-14T13:29:28.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.252+0000 7fd039093640 1 -- 172.21.15.5:0/437207352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd034156560 msgr2=0x7fd034150430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.252+0000 7fd039093640 1 --2- 172.21.15.5:0/437207352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd034156560 0x7fd034150430 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fd01c00b2c0 tx=0x7fd01c019720 comp rx=0 tx=0).stop 2023-07-14T13:29:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.252+0000 7fd039093640 1 -- 172.21.15.5:0/437207352 shutdown_connections 2023-07-14T13:29:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.252+0000 7fd039093640 1 --2- 172.21.15.5:0/437207352 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd0140663a0 0x7fd014068850 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.252+0000 7fd039093640 1 --2- 172.21.15.5:0/437207352 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd034158df0 0x7fd034150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.252+0000 7fd039093640 1 --2- 172.21.15.5:0/437207352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd034156560 0x7fd034150430 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.252+0000 7fd039093640 1 --2- 172.21.15.5:0/437207352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0340ccf60 0x7fd0340b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:28.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.252+0000 7fd039093640 1 -- 172.21.15.5:0/437207352 >> 172.21.15.5:0/437207352 conn(0x7fd0340afac0 msgr2=0x7fd0340ada30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:28.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.252+0000 7fd039093640 1 -- 172.21.15.5:0/437207352 shutdown_connections 2023-07-14T13:29:28.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.252+0000 7fd039093640 1 -- 172.21.15.5:0/437207352 wait complete. 2023-07-14T13:29:28.281 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-14T13:29:28.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.468+0000 7fe61bf2c640 1 Processor -- start 2023-07-14T13:29:28.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.468+0000 7fe61bf2c640 1 -- start start 2023-07-14T13:29:28.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.468+0000 7fe61bf2c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe61415bde0 0x7fe6140d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:28.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.468+0000 7fe61bf2c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6140d2fc0 0x7fe6140b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:28.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.468+0000 7fe61bf2c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe6140d2300 0x7fe6140d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:28.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.468+0000 7fe61bf2c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6140d2ce0 con 0x7fe6140d2300 2023-07-14T13:29:28.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.468+0000 7fe61bf2c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe61415c1b0 con 0x7fe61415bde0 2023-07-14T13:29:28.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.468+0000 7fe61bf2c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6140b04c0 con 0x7fe6140d2fc0 2023-07-14T13:29:28.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.468+0000 7fe61a4c9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe6140d2300 0x7fe6140d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:28.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.468+0000 7fe61a4c9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe6140d2300 0x7fe6140d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48854/0 (socket says 172.21.15.5:48854) 2023-07-14T13:29:28.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.468+0000 7fe61a4c9640 1 -- 172.21.15.5:0/170182886 learned_addr learned my addr 172.21.15.5:0/170182886 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:28.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.468+0000 7fe619cc8640 1 --2- 172.21.15.5:0/170182886 >> v2:172.21.15.154:3300/0 conn(0x7fe61415bde0 0x7fe6140d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:28.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.468+0000 7fe6194c7640 1 --2- 172.21.15.5:0/170182886 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6140d2fc0 0x7fe6140b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:28.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.468+0000 7fe61a4c9640 1 -- 172.21.15.5:0/170182886 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6140d2fc0 msgr2=0x7fe6140b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:28.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.468+0000 7fe61a4c9640 1 --2- 172.21.15.5:0/170182886 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6140d2fc0 0x7fe6140b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:28.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.468+0000 7fe61a4c9640 1 -- 172.21.15.5:0/170182886 >> v2:172.21.15.154:3300/0 conn(0x7fe61415bde0 msgr2=0x7fe6140d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:28.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.468+0000 7fe61a4c9640 1 --2- 172.21.15.5:0/170182886 >> v2:172.21.15.154:3300/0 conn(0x7fe61415bde0 0x7fe6140d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:28.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.468+0000 7fe61a4c9640 1 -- 172.21.15.5:0/170182886 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6140d0aa0 con 0x7fe6140d2300 2023-07-14T13:29:28.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.472+0000 7fe61a4c9640 1 --2- 172.21.15.5:0/170182886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6140d2300 0x7fe6140d27a0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fe61408b210 tx=0x7fe60c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b60c9ad714bae5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:28.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.472+0000 7fe618cc6640 1 -- 172.21.15.5:0/170182886 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c0a5850 con 0x7fe6140d2300 2023-07-14T13:29:28.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.472+0000 7fe618cc6640 1 -- 172.21.15.5:0/170182886 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60c0a59b0 con 0x7fe6140d2300 2023-07-14T13:29:28.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.472+0000 7fe618cc6640 1 -- 172.21.15.5:0/170182886 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c0a5d40 con 0x7fe6140d2300 2023-07-14T13:29:28.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.472+0000 7fe61bf2c640 1 -- 172.21.15.5:0/170182886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6140d2300 msgr2=0x7fe6140d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:28.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.472+0000 7fe61bf2c640 1 --2- 172.21.15.5:0/170182886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6140d2300 0x7fe6140d27a0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fe61408b210 tx=0x7fe60c01c9d0 comp rx=0 tx=0).stop 2023-07-14T13:29:28.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.472+0000 7fe61bf2c640 1 -- 172.21.15.5:0/170182886 shutdown_connections 2023-07-14T13:29:28.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.472+0000 7fe61bf2c640 1 --2- 172.21.15.5:0/170182886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6140d2300 0x7fe6140d27a0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:28.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.472+0000 7fe61bf2c640 1 --2- 172.21.15.5:0/170182886 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6140d2fc0 0x7fe6140b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:28.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.472+0000 7fe61bf2c640 1 --2- 172.21.15.5:0/170182886 >> v2:172.21.15.154:3300/0 conn(0x7fe61415bde0 0x7fe6140d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:28.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.472+0000 7fe61bf2c640 1 -- 172.21.15.5:0/170182886 >> 172.21.15.5:0/170182886 conn(0x7fe6140659d0 msgr2=0x7fe61409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:28.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.472+0000 7fe61bf2c640 1 -- 172.21.15.5:0/170182886 shutdown_connections 2023-07-14T13:29:28.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.472+0000 7fe61bf2c640 1 -- 172.21.15.5:0/170182886 wait complete. 2023-07-14T13:29:28.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.476+0000 7fe61bf2c640 1 Processor -- start 2023-07-14T13:29:28.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.476+0000 7fe61bf2c640 1 -- start start 2023-07-14T13:29:28.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.476+0000 7fe61bf2c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6140d2300 0x7fe6141f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:28.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.476+0000 7fe61bf2c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6140d2fc0 0x7fe6141f7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:28.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.476+0000 7fe61bf2c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe61415bde0 0x7fe6140cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.476+0000 7fe61bf2c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe614152790 con 0x7fe6140d2fc0 2023-07-14T13:29:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.476+0000 7fe61bf2c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe614152a70 con 0x7fe61415bde0 2023-07-14T13:29:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.476+0000 7fe61bf2c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6141f4390 con 0x7fe6140d2300 2023-07-14T13:29:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.476+0000 7fe6194c7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6140d2fc0 0x7fe6141f7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.476+0000 7fe6194c7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6140d2fc0 0x7fe6141f7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48862/0 (socket says 172.21.15.5:48862) 2023-07-14T13:29:28.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.476+0000 7fe6194c7640 1 -- 172.21.15.5:0/1829779320 learned_addr learned my addr 172.21.15.5:0/1829779320 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:28.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.476+0000 7fe619cc8640 1 --2- 172.21.15.5:0/1829779320 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6140d2300 0x7fe6141f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:28.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.476+0000 7fe6194c7640 1 -- 172.21.15.5:0/1829779320 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6140d2300 msgr2=0x7fe6141f3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:28.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.476+0000 7fe6194c7640 1 --2- 172.21.15.5:0/1829779320 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6140d2300 0x7fe6141f3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:28.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.476+0000 7fe61a4c9640 1 --2- 172.21.15.5:0/1829779320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe61415bde0 0x7fe6140cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:28.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.476+0000 7fe6194c7640 1 -- 172.21.15.5:0/1829779320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe61415bde0 msgr2=0x7fe6140cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:28.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.476+0000 7fe6194c7640 1 --2- 172.21.15.5:0/1829779320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe61415bde0 0x7fe6140cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:28.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.476+0000 7fe6194c7640 1 -- 172.21.15.5:0/1829779320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60c009b30 con 0x7fe6140d2fc0 2023-07-14T13:29:28.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.476+0000 7fe61a4c9640 1 --2- 172.21.15.5:0/1829779320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe61415bde0 0x7fe6140cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:29:28.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.476+0000 7fe6194c7640 1 --2- 172.21.15.5:0/1829779320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6140d2fc0 0x7fe6141f7dd0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fe60400e870 tx=0x7fe60400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:28.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.476+0000 7fe60a7fc640 1 -- 172.21.15.5:0/1829779320 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60400ee60 con 0x7fe6140d2fc0 2023-07-14T13:29:28.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.476+0000 7fe60a7fc640 1 -- 172.21.15.5:0/1829779320 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60400c940 con 0x7fe6140d2fc0 2023-07-14T13:29:28.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.476+0000 7fe60a7fc640 1 -- 172.21.15.5:0/1829779320 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60400ccf0 con 0x7fe6140d2fc0 2023-07-14T13:29:28.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.476+0000 7fe61bf2c640 1 -- 172.21.15.5:0/1829779320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6141f4650 con 0x7fe6140d2fc0 2023-07-14T13:29:28.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.476+0000 7fe61bf2c640 1 -- 172.21.15.5:0/1829779320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6141f4c10 con 0x7fe6140d2fc0 2023-07-14T13:29:28.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.480+0000 7fe61bf2c640 1 -- 172.21.15.5:0/1829779320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6141f4e30 con 0x7fe6140d2fc0 2023-07-14T13:29:28.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.480+0000 7fe60a7fc640 1 -- 172.21.15.5:0/1829779320 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe604013470 con 0x7fe6140d2fc0 2023-07-14T13:29:28.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.480+0000 7fe60a7fc640 1 --2- 172.21.15.5:0/1829779320 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fe5f80663a0 0x7fe5f8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:28.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.480+0000 7fe60a7fc640 1 -- 172.21.15.5:0/1829779320 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 7208+0+0 (secure 0 0 0) 0x7fe604084440 con 0x7fe6140d2fc0 2023-07-14T13:29:28.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.480+0000 7fe619cc8640 1 --2- 172.21.15.5:0/1829779320 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fe5f80663a0 0x7fe5f8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:28.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.480+0000 7fe619cc8640 1 --2- 172.21.15.5:0/1829779320 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fe5f80663a0 0x7fe5f8068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe6140ce710 tx=0x7fe610008040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:28.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.484+0000 7fe60a7fc640 1 -- 172.21.15.5:0/1829779320 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe604051290 con 0x7fe6140d2fc0 2023-07-14T13:29:28.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:28.640+0000 7fe61bf2c640 1 -- 172.21.15.5:0/1829779320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe614152be0 con 0x7fe6140d2fc0 2023-07-14T13:29:29.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.256+0000 7fe60a7fc640 1 -- 172.21.15.5:0/1829779320 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v163) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe6040548b0 con 0x7fe6140d2fc0 2023-07-14T13:29:29.261 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-07-14T13:29:29.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.256+0000 7fe61bf2c640 1 -- 172.21.15.5:0/1829779320 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fe5f80663a0 msgr2=0x7fe5f8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:29.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.256+0000 7fe61bf2c640 1 --2- 172.21.15.5:0/1829779320 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fe5f80663a0 0x7fe5f8068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe6140ce710 tx=0x7fe610008040 comp rx=0 tx=0).stop 2023-07-14T13:29:29.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.256+0000 7fe61bf2c640 1 -- 172.21.15.5:0/1829779320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6140d2fc0 msgr2=0x7fe6141f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:29.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.256+0000 7fe61bf2c640 1 --2- 172.21.15.5:0/1829779320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6140d2fc0 0x7fe6141f7dd0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fe60400e870 tx=0x7fe60400ed30 comp rx=0 tx=0).stop 2023-07-14T13:29:29.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.256+0000 7fe61bf2c640 1 -- 172.21.15.5:0/1829779320 shutdown_connections 2023-07-14T13:29:29.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.256+0000 7fe61bf2c640 1 --2- 172.21.15.5:0/1829779320 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fe5f80663a0 0x7fe5f8068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:29.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.256+0000 7fe61bf2c640 1 --2- 172.21.15.5:0/1829779320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe61415bde0 0x7fe6140cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:29.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.256+0000 7fe61bf2c640 1 --2- 172.21.15.5:0/1829779320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6140d2fc0 0x7fe6141f7dd0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:29.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.256+0000 7fe61bf2c640 1 --2- 172.21.15.5:0/1829779320 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe6140d2300 0x7fe6141f3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:29.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.256+0000 7fe61bf2c640 1 -- 172.21.15.5:0/1829779320 >> 172.21.15.5:0/1829779320 conn(0x7fe6140659d0 msgr2=0x7fe61415ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:29.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.260+0000 7fe61bf2c640 1 -- 172.21.15.5:0/1829779320 shutdown_connections 2023-07-14T13:29:29.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.260+0000 7fe61bf2c640 1 -- 172.21.15.5:0/1829779320 wait complete. 2023-07-14T13:29:29.288 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-14T13:29:29.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.432+0000 7fd589e6d640 1 Processor -- start 2023-07-14T13:29:29.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.432+0000 7fd589e6d640 1 -- start start 2023-07-14T13:29:29.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.436+0000 7fd589e6d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5840aeb40 0x7fd58415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:29.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.436+0000 7fd589e6d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5840aef10 0x7fd584158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:29.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.436+0000 7fd589e6d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5841532b0 con 0x7fd584159270 2023-07-14T13:29:29.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.436+0000 7fd589e6d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5840ca6f0 con 0x7fd5840aef10 2023-07-14T13:29:29.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.436+0000 7fd589e6d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5841599d0 con 0x7fd5840aeb40 2023-07-14T13:29:29.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.436+0000 7fd582ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5840aef10 0x7fd584158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:29.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.436+0000 7fd582ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5840aef10 0x7fd584158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50838/0 (socket says 172.21.15.5:50838) 2023-07-14T13:29:29.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.436+0000 7fd582ffd640 1 -- 172.21.15.5:0/3263917352 learned_addr learned my addr 172.21.15.5:0/3263917352 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:29.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.436+0000 7fd5837fe640 1 --2- 172.21.15.5:0/3263917352 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5840aeb40 0x7fd58415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:29.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.436+0000 7fd582ffd640 1 -- 172.21.15.5:0/3263917352 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5840aeb40 msgr2=0x7fd58415cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:29.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.436+0000 7fd582ffd640 1 --2- 172.21.15.5:0/3263917352 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5840aeb40 0x7fd58415cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:29.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.436+0000 7fd582ffd640 1 -- 172.21.15.5:0/3263917352 >> v1:172.21.15.154:6789/0 conn(0x7fd584159270 legacy=0x7fd5840c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:29.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.436+0000 7fd582ffd640 1 -- 172.21.15.5:0/3263917352 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd584159cb0 con 0x7fd5840aef10 2023-07-14T13:29:29.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.440+0000 7fd582ffd640 1 --2- 172.21.15.5:0/3263917352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5840aef10 0x7fd584158d30 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fd578009870 tx=0x7fd57801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ecfbb68d4f39aab server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:29.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.440+0000 7fd5827fc640 1 -- 172.21.15.5:0/3263917352 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5780ab680 con 0x7fd5840aef10 2023-07-14T13:29:29.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.440+0000 7fd5827fc640 1 -- 172.21.15.5:0/3263917352 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5780ab7e0 con 0x7fd5840aef10 2023-07-14T13:29:29.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.440+0000 7fd5827fc640 1 -- 172.21.15.5:0/3263917352 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5780abb70 con 0x7fd5840aef10 2023-07-14T13:29:29.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.440+0000 7fd589e6d640 1 -- 172.21.15.5:0/3263917352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5840aef10 msgr2=0x7fd584158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:29.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.440+0000 7fd589e6d640 1 --2- 172.21.15.5:0/3263917352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5840aef10 0x7fd584158d30 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fd578009870 tx=0x7fd57801c480 comp rx=0 tx=0).stop 2023-07-14T13:29:29.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.440+0000 7fd589e6d640 1 -- 172.21.15.5:0/3263917352 shutdown_connections 2023-07-14T13:29:29.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.440+0000 7fd589e6d640 1 --2- 172.21.15.5:0/3263917352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5840aef10 0x7fd584158d30 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:29.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.440+0000 7fd589e6d640 1 --2- 172.21.15.5:0/3263917352 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5840aeb40 0x7fd58415cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:29.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.440+0000 7fd589e6d640 1 -- 172.21.15.5:0/3263917352 >> 172.21.15.5:0/3263917352 conn(0x7fd5840cde90 msgr2=0x7fd5840ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:29.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.440+0000 7fd589e6d640 1 -- 172.21.15.5:0/3263917352 shutdown_connections 2023-07-14T13:29:29.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.440+0000 7fd589e6d640 1 -- 172.21.15.5:0/3263917352 wait complete. 2023-07-14T13:29:29.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.440+0000 7fd589e6d640 1 Processor -- start 2023-07-14T13:29:29.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.440+0000 7fd589e6d640 1 -- start start 2023-07-14T13:29:29.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.444+0000 7fd589e6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5840aeb40 0x7fd584157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:29.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.444+0000 7fd589e6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5840aef10 0x7fd584165710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:29.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.444+0000 7fd589e6d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd584159270 0x7fd58406b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:29.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.444+0000 7fd589e6d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58406b5b0 con 0x7fd5840aeb40 2023-07-14T13:29:29.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.444+0000 7fd589e6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5841661d0 con 0x7fd5840aef10 2023-07-14T13:29:29.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.444+0000 7fd589e6d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5841664b0 con 0x7fd584159270 2023-07-14T13:29:29.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.444+0000 7fd5837fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5840aeb40 0x7fd584157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:29.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.444+0000 7fd5837fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5840aeb40 0x7fd584157c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50850/0 (socket says 172.21.15.5:50850) 2023-07-14T13:29:29.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.444+0000 7fd5837fe640 1 -- 172.21.15.5:0/137999740 learned_addr learned my addr 172.21.15.5:0/137999740 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:29.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.444+0000 7fd582ffd640 1 --2- 172.21.15.5:0/137999740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5840aef10 0x7fd584165710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:29.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.444+0000 7fd583fff640 1 --2- 172.21.15.5:0/137999740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd584159270 0x7fd58406b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:29.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.444+0000 7fd5837fe640 1 -- 172.21.15.5:0/137999740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd584159270 msgr2=0x7fd58406b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:29.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.444+0000 7fd5837fe640 1 --2- 172.21.15.5:0/137999740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd584159270 0x7fd58406b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:29.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.444+0000 7fd5837fe640 1 -- 172.21.15.5:0/137999740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5840aef10 msgr2=0x7fd584165710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:29.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.444+0000 7fd5837fe640 1 --2- 172.21.15.5:0/137999740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5840aef10 0x7fd584165710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:29.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.444+0000 7fd5837fe640 1 -- 172.21.15.5:0/137999740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5780094d0 con 0x7fd5840aeb40 2023-07-14T13:29:29.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.444+0000 7fd583fff640 1 --2- 172.21.15.5:0/137999740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd584159270 0x7fd58406b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:29:29.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.444+0000 7fd5837fe640 1 --2- 172.21.15.5:0/137999740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5840aeb40 0x7fd584157c50 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fd57400d800 tx=0x7fd57400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:29.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.444+0000 7fd56bfff640 1 -- 172.21.15.5:0/137999740 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57400b6c0 con 0x7fd5840aeb40 2023-07-14T13:29:29.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.444+0000 7fd56bfff640 1 -- 172.21.15.5:0/137999740 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57400b820 con 0x7fd5840aeb40 2023-07-14T13:29:29.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.444+0000 7fd56bfff640 1 -- 172.21.15.5:0/137999740 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57400bb90 con 0x7fd5840aeb40 2023-07-14T13:29:29.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.444+0000 7fd589e6d640 1 -- 172.21.15.5:0/137999740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd584166790 con 0x7fd5840aeb40 2023-07-14T13:29:29.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.444+0000 7fd589e6d640 1 -- 172.21.15.5:0/137999740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5840aba60 con 0x7fd5840aeb40 2023-07-14T13:29:29.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.444+0000 7fd589e6d640 1 -- 172.21.15.5:0/137999740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd58406b820 con 0x7fd5840aeb40 2023-07-14T13:29:29.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.444+0000 7fd56bfff640 1 -- 172.21.15.5:0/137999740 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd57400bcf0 con 0x7fd5840aeb40 2023-07-14T13:29:29.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.448+0000 7fd56bfff640 1 --2- 172.21.15.5:0/137999740 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd5700663a0 0x7fd570068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:29.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.448+0000 7fd56bfff640 1 -- 172.21.15.5:0/137999740 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6770+0+0 (secure 0 0 0) 0x7fd574084660 con 0x7fd5840aeb40 2023-07-14T13:29:29.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.448+0000 7fd582ffd640 1 --2- 172.21.15.5:0/137999740 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd5700663a0 0x7fd570068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:29.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.448+0000 7fd582ffd640 1 --2- 172.21.15.5:0/137999740 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd5700663a0 0x7fd570068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd5780af000 tx=0x7fd5780b6040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:29.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.452+0000 7fd56bfff640 1 -- 172.21.15.5:0/137999740 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd574055180 con 0x7fd5840aeb40 2023-07-14T13:29:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:29.608+0000 7fd589e6d640 1 -- 172.21.15.5:0/137999740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd5840af880 con 0x7fd5840aeb40 2023-07-14T13:29:30.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.264+0000 7fd56bfff640 1 -- 172.21.15.5:0/137999740 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v164) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd574054d10 con 0x7fd5840aeb40 2023-07-14T13:29:30.269 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-07-14T13:29:30.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.264+0000 7fd589e6d640 1 -- 172.21.15.5:0/137999740 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd5700663a0 msgr2=0x7fd570068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:30.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.264+0000 7fd589e6d640 1 --2- 172.21.15.5:0/137999740 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd5700663a0 0x7fd570068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd5780af000 tx=0x7fd5780b6040 comp rx=0 tx=0).stop 2023-07-14T13:29:30.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.264+0000 7fd589e6d640 1 -- 172.21.15.5:0/137999740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5840aeb40 msgr2=0x7fd584157c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:30.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.264+0000 7fd589e6d640 1 --2- 172.21.15.5:0/137999740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5840aeb40 0x7fd584157c50 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fd57400d800 tx=0x7fd57400dcc0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.264+0000 7fd589e6d640 1 -- 172.21.15.5:0/137999740 shutdown_connections 2023-07-14T13:29:30.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.264+0000 7fd589e6d640 1 --2- 172.21.15.5:0/137999740 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd5700663a0 0x7fd570068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.264+0000 7fd589e6d640 1 --2- 172.21.15.5:0/137999740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd584159270 0x7fd58406b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.264+0000 7fd589e6d640 1 --2- 172.21.15.5:0/137999740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5840aef10 0x7fd584165710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.264+0000 7fd589e6d640 1 --2- 172.21.15.5:0/137999740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5840aeb40 0x7fd584157c50 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.264+0000 7fd589e6d640 1 -- 172.21.15.5:0/137999740 >> 172.21.15.5:0/137999740 conn(0x7fd5840cde90 msgr2=0x7fd5840c3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:30.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.264+0000 7fd589e6d640 1 -- 172.21.15.5:0/137999740 shutdown_connections 2023-07-14T13:29:30.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.268+0000 7fd589e6d640 1 -- 172.21.15.5:0/137999740 wait complete. 2023-07-14T13:29:30.298 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-14T13:29:30.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.444+0000 7f7cfbe7b640 1 Processor -- start 2023-07-14T13:29:30.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.444+0000 7f7cfbe7b640 1 -- start start 2023-07-14T13:29:30.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.448+0000 7f7cfbe7b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7cf4159a70 0x7f7cf40ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.448+0000 7f7cfbe7b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cf415e060 0x7f7cf4070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.448+0000 7f7cfbe7b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf40cbe50 con 0x7f7cf4070e60 2023-07-14T13:29:30.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.448+0000 7f7cfbe7b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf40cd660 con 0x7f7cf4159a70 2023-07-14T13:29:30.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.448+0000 7f7cfbe7b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40cc0a0 con 0x7f7cf415e060 2023-07-14T13:29:30.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.448+0000 7f7cf9c17640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7cf4159a70 0x7f7cf40ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:30.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.448+0000 7f7cf9c17640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7cf4159a70 0x7f7cf40ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50854/0 (socket says 172.21.15.5:50854) 2023-07-14T13:29:30.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.448+0000 7f7cf9c17640 1 -- 172.21.15.5:0/4153995416 learned_addr learned my addr 172.21.15.5:0/4153995416 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:30.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.448+0000 7f7cf9416640 1 --2- 172.21.15.5:0/4153995416 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cf415e060 0x7f7cf4070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:30.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.448+0000 7f7cf9c17640 1 -- 172.21.15.5:0/4153995416 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cf415e060 msgr2=0x7f7cf4070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:30.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.448+0000 7f7cf9c17640 1 --2- 172.21.15.5:0/4153995416 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cf415e060 0x7f7cf4070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.448+0000 7f7cf9c17640 1 -- 172.21.15.5:0/4153995416 >> v1:172.21.15.154:6789/0 conn(0x7f7cf4070e60 legacy=0x7f7cf40c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:30.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.448+0000 7f7cf9c17640 1 -- 172.21.15.5:0/4153995416 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf40cc380 con 0x7f7cf4159a70 2023-07-14T13:29:30.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.452+0000 7f7cf9c17640 1 --2- 172.21.15.5:0/4153995416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cf4159a70 0x7f7cf40ccff0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009870 tx=0x7f7cf001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289102e7ee683bf9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:30.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.452+0000 7f7cf8c15640 1 -- 172.21.15.5:0/4153995416 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf00ab600 con 0x7f7cf4159a70 2023-07-14T13:29:30.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.452+0000 7f7cf8c15640 1 -- 172.21.15.5:0/4153995416 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf00a7050 con 0x7f7cf4159a70 2023-07-14T13:29:30.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.452+0000 7f7cf8c15640 1 -- 172.21.15.5:0/4153995416 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf00ab980 con 0x7f7cf4159a70 2023-07-14T13:29:30.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.452+0000 7f7cfbe7b640 1 -- 172.21.15.5:0/4153995416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cf4159a70 msgr2=0x7f7cf40ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:30.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.452+0000 7f7cfbe7b640 1 --2- 172.21.15.5:0/4153995416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cf4159a70 0x7f7cf40ccff0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009870 tx=0x7f7cf001c3f0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.452+0000 7f7cfbe7b640 1 -- 172.21.15.5:0/4153995416 shutdown_connections 2023-07-14T13:29:30.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.452+0000 7f7cfbe7b640 1 --2- 172.21.15.5:0/4153995416 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cf415e060 0x7f7cf4070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.452+0000 7f7cfbe7b640 1 --2- 172.21.15.5:0/4153995416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cf4159a70 0x7f7cf40ccff0 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.452+0000 7f7cfbe7b640 1 -- 172.21.15.5:0/4153995416 >> 172.21.15.5:0/4153995416 conn(0x7f7cf40afac0 msgr2=0x7f7cf40afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:30.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.452+0000 7f7cfbe7b640 1 -- 172.21.15.5:0/4153995416 shutdown_connections 2023-07-14T13:29:30.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.452+0000 7f7cfbe7b640 1 -- 172.21.15.5:0/4153995416 wait complete. 2023-07-14T13:29:30.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.456+0000 7f7cfbe7b640 1 Processor -- start 2023-07-14T13:29:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.456+0000 7f7cfbe7b640 1 -- start start 2023-07-14T13:29:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.456+0000 7f7cfbe7b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cf4070e60 0x7f7cf4150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.456+0000 7f7cfbe7b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cf4159a70 0x7f7cf40c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.456+0000 7f7cfbe7b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cf415e060 0x7f7cf40b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.456+0000 7f7cfbe7b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf4157070 con 0x7f7cf4159a70 2023-07-14T13:29:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.456+0000 7f7cfbe7b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf4150560 con 0x7f7cf4070e60 2023-07-14T13:29:30.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.456+0000 7f7cfbe7b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40c8a80 con 0x7f7cf415e060 2023-07-14T13:29:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.456+0000 7f7cf9416640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cf4159a70 0x7f7cf40c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.456+0000 7f7cf9416640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cf4159a70 0x7f7cf40c8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50864/0 (socket says 172.21.15.5:50864) 2023-07-14T13:29:30.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.456+0000 7f7cf9416640 1 -- 172.21.15.5:0/3465364147 learned_addr learned my addr 172.21.15.5:0/3465364147 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:30.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.456+0000 7f7cfa418640 1 --2- 172.21.15.5:0/3465364147 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cf415e060 0x7f7cf40b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:30.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.456+0000 7f7cf9c17640 1 --2- 172.21.15.5:0/3465364147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cf4070e60 0x7f7cf4150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:30.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.456+0000 7f7cf9416640 1 -- 172.21.15.5:0/3465364147 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cf415e060 msgr2=0x7f7cf40b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:30.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.456+0000 7f7cf9416640 1 --2- 172.21.15.5:0/3465364147 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cf415e060 0x7f7cf40b2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.456+0000 7f7cf9416640 1 -- 172.21.15.5:0/3465364147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cf4070e60 msgr2=0x7f7cf4150020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:30.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.456+0000 7f7cf9416640 1 --2- 172.21.15.5:0/3465364147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cf4070e60 0x7f7cf4150020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.456+0000 7f7cf9416640 1 -- 172.21.15.5:0/3465364147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf00094d0 con 0x7f7cf4159a70 2023-07-14T13:29:30.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.456+0000 7f7cf9416640 1 --2- 172.21.15.5:0/3465364147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cf4159a70 0x7f7cf40c8540 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f7ce400e8a0 tx=0x7f7ce400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:30.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.460+0000 7f7cea7fc640 1 -- 172.21.15.5:0/3465364147 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4009510 con 0x7f7cf4159a70 2023-07-14T13:29:30.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.460+0000 7f7cea7fc640 1 -- 172.21.15.5:0/3465364147 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce400c940 con 0x7f7cf4159a70 2023-07-14T13:29:30.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.460+0000 7f7cfbe7b640 1 -- 172.21.15.5:0/3465364147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf4153450 con 0x7f7cf4159a70 2023-07-14T13:29:30.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.460+0000 7f7cea7fc640 1 -- 172.21.15.5:0/3465364147 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce400ccb0 con 0x7f7cf4159a70 2023-07-14T13:29:30.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.460+0000 7f7cfbe7b640 1 -- 172.21.15.5:0/3465364147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf4153a10 con 0x7f7cf4159a70 2023-07-14T13:29:30.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.460+0000 7f7cfbe7b640 1 -- 172.21.15.5:0/3465364147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf4153c30 con 0x7f7cf4159a70 2023-07-14T13:29:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.460+0000 7f7cea7fc640 1 -- 172.21.15.5:0/3465364147 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7ce4013470 con 0x7f7cf4159a70 2023-07-14T13:29:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.460+0000 7f7cea7fc640 1 --2- 172.21.15.5:0/3465364147 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f7cd80663a0 0x7f7cd8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.460+0000 7f7cea7fc640 1 -- 172.21.15.5:0/3465364147 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6356+0+0 (secure 0 0 0) 0x7f7ce4083fe0 con 0x7f7cf4159a70 2023-07-14T13:29:30.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.460+0000 7f7cf9c17640 1 --2- 172.21.15.5:0/3465364147 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f7cd80663a0 0x7f7cd8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:30.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.464+0000 7f7cf9c17640 1 --2- 172.21.15.5:0/3465364147 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f7cd80663a0 0x7f7cd8068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00ad000 tx=0x7f7cf0008040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:30.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.464+0000 7f7cea7fc640 1 -- 172.21.15.5:0/3465364147 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7ce40512b0 con 0x7f7cf4159a70 2023-07-14T13:29:30.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.620+0000 7f7cfbe7b640 1 -- 172.21.15.5:0/3465364147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f7cf40678d0 con 0x7f7cf4159a70 2023-07-14T13:29:30.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.624+0000 7f7cea7fc640 1 -- 172.21.15.5:0/3465364147 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v55) v1 ==== 120+0+0 (secure 0 0 0) 0x7f7ce40548d0 con 0x7f7cf4159a70 2023-07-14T13:29:30.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.628+0000 7f7cfbe7b640 1 -- 172.21.15.5:0/3465364147 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f7cd80663a0 msgr2=0x7f7cd8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:30.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.628+0000 7f7cfbe7b640 1 --2- 172.21.15.5:0/3465364147 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f7cd80663a0 0x7f7cd8068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00ad000 tx=0x7f7cf0008040 comp rx=0 tx=0).stop 2023-07-14T13:29:30.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.628+0000 7f7cfbe7b640 1 -- 172.21.15.5:0/3465364147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cf4159a70 msgr2=0x7f7cf40c8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:30.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.628+0000 7f7cfbe7b640 1 --2- 172.21.15.5:0/3465364147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cf4159a70 0x7f7cf40c8540 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f7ce400e8a0 tx=0x7f7ce400eca0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.628+0000 7f7cfbe7b640 1 -- 172.21.15.5:0/3465364147 shutdown_connections 2023-07-14T13:29:30.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.628+0000 7f7cfbe7b640 1 --2- 172.21.15.5:0/3465364147 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f7cd80663a0 0x7f7cd8068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.628+0000 7f7cfbe7b640 1 --2- 172.21.15.5:0/3465364147 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cf415e060 0x7f7cf40b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.628+0000 7f7cfbe7b640 1 --2- 172.21.15.5:0/3465364147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7cf4159a70 0x7f7cf40c8540 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.628+0000 7f7cfbe7b640 1 --2- 172.21.15.5:0/3465364147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cf4070e60 0x7f7cf4150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.628+0000 7f7cfbe7b640 1 -- 172.21.15.5:0/3465364147 >> 172.21.15.5:0/3465364147 conn(0x7f7cf40afac0 msgr2=0x7f7cf40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:30.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.628+0000 7f7cfbe7b640 1 -- 172.21.15.5:0/3465364147 shutdown_connections 2023-07-14T13:29:30.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.628+0000 7f7cfbe7b640 1 -- 172.21.15.5:0/3465364147 wait complete. 2023-07-14T13:29:30.652 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-14T13:29:30.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.792+0000 7fd5ed737640 1 Processor -- start 2023-07-14T13:29:30.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.792+0000 7fd5ed737640 1 -- start start 2023-07-14T13:29:30.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.792+0000 7fd5ed737640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5e8159340 0x7fd5e8158980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.792+0000 7fd5ed737640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd5e80c8760 0x7fd5e8069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.792+0000 7fd5ed737640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5e806be90 con 0x7fd5e80c8bc0 2023-07-14T13:29:30.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.792+0000 7fd5ed737640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e806b280 con 0x7fd5e8159340 2023-07-14T13:29:30.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.792+0000 7fd5ed737640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e806b560 con 0x7fd5e80c8760 2023-07-14T13:29:30.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.792+0000 7fd5e6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5e8159340 0x7fd5e8158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:30.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.796+0000 7fd5e6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5e8159340 0x7fd5e8158980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50866/0 (socket says 172.21.15.5:50866) 2023-07-14T13:29:30.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.796+0000 7fd5e6ffd640 1 -- 172.21.15.5:0/4109631414 learned_addr learned my addr 172.21.15.5:0/4109631414 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:30.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.796+0000 7fd5e6ffd640 1 -- 172.21.15.5:0/4109631414 >> v2:172.21.15.154:3300/0 conn(0x7fd5e80c8760 msgr2=0x7fd5e8069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:30.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.796+0000 7fd5dffff640 1 --2- 172.21.15.5:0/4109631414 >> v2:172.21.15.154:3300/0 conn(0x7fd5e80c8760 0x7fd5e8069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:30.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.796+0000 7fd5e6ffd640 1 --2- 172.21.15.5:0/4109631414 >> v2:172.21.15.154:3300/0 conn(0x7fd5e80c8760 0x7fd5e8069430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.796+0000 7fd5e6ffd640 1 -- 172.21.15.5:0/4109631414 >> v1:172.21.15.154:6789/0 conn(0x7fd5e80c8bc0 legacy=0x7fd5e815c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:30.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.796+0000 7fd5e6ffd640 1 -- 172.21.15.5:0/4109631414 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e806b840 con 0x7fd5e8159340 2023-07-14T13:29:30.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.796+0000 7fd5dffff640 1 --2- 172.21.15.5:0/4109631414 >> v2:172.21.15.154:3300/0 conn(0x7fd5e80c8760 0x7fd5e8069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:29:30.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.796+0000 7fd5e6ffd640 1 --2- 172.21.15.5:0/4109631414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e8159340 0x7fd5e8158980 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fd5e806d4e0 tx=0x7fd5d801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc11d8f3ff81ac server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:30.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.796+0000 7fd5e67fc640 1 -- 172.21.15.5:0/4109631414 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d80ab600 con 0x7fd5e8159340 2023-07-14T13:29:30.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.796+0000 7fd5e67fc640 1 -- 172.21.15.5:0/4109631414 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d80a7050 con 0x7fd5e8159340 2023-07-14T13:29:30.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.796+0000 7fd5e67fc640 1 -- 172.21.15.5:0/4109631414 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d80ab980 con 0x7fd5e8159340 2023-07-14T13:29:30.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.800+0000 7fd5ed737640 1 -- 172.21.15.5:0/4109631414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e8159340 msgr2=0x7fd5e8158980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:30.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.800+0000 7fd5ed737640 1 --2- 172.21.15.5:0/4109631414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e8159340 0x7fd5e8158980 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fd5e806d4e0 tx=0x7fd5d801c430 comp rx=0 tx=0).stop 2023-07-14T13:29:30.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.800+0000 7fd5ed737640 1 -- 172.21.15.5:0/4109631414 shutdown_connections 2023-07-14T13:29:30.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.800+0000 7fd5ed737640 1 --2- 172.21.15.5:0/4109631414 >> v2:172.21.15.154:3300/0 conn(0x7fd5e80c8760 0x7fd5e8069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.800+0000 7fd5ed737640 1 --2- 172.21.15.5:0/4109631414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e8159340 0x7fd5e8158980 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.800+0000 7fd5ed737640 1 -- 172.21.15.5:0/4109631414 >> 172.21.15.5:0/4109631414 conn(0x7fd5e80cb4f0 msgr2=0x7fd5e80cdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:30.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.800+0000 7fd5ed737640 1 -- 172.21.15.5:0/4109631414 shutdown_connections 2023-07-14T13:29:30.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.800+0000 7fd5ed737640 1 -- 172.21.15.5:0/4109631414 wait complete. 2023-07-14T13:29:30.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.800+0000 7fd5ed737640 1 Processor -- start 2023-07-14T13:29:30.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.800+0000 7fd5ed737640 1 -- start start 2023-07-14T13:29:30.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.800+0000 7fd5ed737640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5e80c8760 0x7fd5e814c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.800+0000 7fd5ed737640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e80c8bc0 0x7fd5e81573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.800+0000 7fd5ed737640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5e8159340 0x7fd5e8157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.800+0000 7fd5ed737640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e80c7740 con 0x7fd5e80c8bc0 2023-07-14T13:29:30.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.800+0000 7fd5ed737640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e814c880 con 0x7fd5e80c8760 2023-07-14T13:29:30.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.800+0000 7fd5ed737640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e80c6e00 con 0x7fd5e8159340 2023-07-14T13:29:30.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.800+0000 7fd5dffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e80c8bc0 0x7fd5e81573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:30.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.800+0000 7fd5dffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e80c8bc0 0x7fd5e81573c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50874/0 (socket says 172.21.15.5:50874) 2023-07-14T13:29:30.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.800+0000 7fd5dffff640 1 -- 172.21.15.5:0/1492009152 learned_addr learned my addr 172.21.15.5:0/1492009152 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:30.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.800+0000 7fd5e6ffd640 1 --2- 172.21.15.5:0/1492009152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5e80c8760 0x7fd5e814c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:30.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.800+0000 7fd5e77fe640 1 --2- 172.21.15.5:0/1492009152 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5e8159340 0x7fd5e8157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:30.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.800+0000 7fd5dffff640 1 -- 172.21.15.5:0/1492009152 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5e8159340 msgr2=0x7fd5e8157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:30.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.800+0000 7fd5dffff640 1 --2- 172.21.15.5:0/1492009152 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5e8159340 0x7fd5e8157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.800+0000 7fd5dffff640 1 -- 172.21.15.5:0/1492009152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5e80c8760 msgr2=0x7fd5e814c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:30.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.800+0000 7fd5dffff640 1 --2- 172.21.15.5:0/1492009152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5e80c8760 0x7fd5e814c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.800+0000 7fd5dffff640 1 -- 172.21.15.5:0/1492009152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d80094d0 con 0x7fd5e80c8bc0 2023-07-14T13:29:30.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.804+0000 7fd5dffff640 1 --2- 172.21.15.5:0/1492009152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e80c8bc0 0x7fd5e81573c0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fd5d000c820 tx=0x7fd5d000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:30.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.804+0000 7fd5df7fe640 1 -- 172.21.15.5:0/1492009152 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d0007a30 con 0x7fd5e80c8bc0 2023-07-14T13:29:30.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.804+0000 7fd5df7fe640 1 -- 172.21.15.5:0/1492009152 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d0007b90 con 0x7fd5e80c8bc0 2023-07-14T13:29:30.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.804+0000 7fd5df7fe640 1 -- 172.21.15.5:0/1492009152 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d000ce10 con 0x7fd5e80c8bc0 2023-07-14T13:29:30.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.804+0000 7fd5ed737640 1 -- 172.21.15.5:0/1492009152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e80c4720 con 0x7fd5e80c8bc0 2023-07-14T13:29:30.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.804+0000 7fd5ed737640 1 -- 172.21.15.5:0/1492009152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e80c7360 con 0x7fd5e80c8bc0 2023-07-14T13:29:30.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.804+0000 7fd5ed737640 1 -- 172.21.15.5:0/1492009152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e80c7880 con 0x7fd5e80c8bc0 2023-07-14T13:29:30.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.804+0000 7fd5df7fe640 1 -- 172.21.15.5:0/1492009152 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd5d00113f0 con 0x7fd5e80c8bc0 2023-07-14T13:29:30.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.804+0000 7fd5df7fe640 1 --2- 172.21.15.5:0/1492009152 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd5c80663a0 0x7fd5c8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.804+0000 7fd5df7fe640 1 -- 172.21.15.5:0/1492009152 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6356+0+0 (secure 0 0 0) 0x7fd5d00841b0 con 0x7fd5e80c8bc0 2023-07-14T13:29:30.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.804+0000 7fd5e6ffd640 1 --2- 172.21.15.5:0/1492009152 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd5c80663a0 0x7fd5c8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:30.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.808+0000 7fd5e6ffd640 1 --2- 172.21.15.5:0/1492009152 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd5c80663a0 0x7fd5c8068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd5e80c83c0 tx=0x7fd5d8009040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:30.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.808+0000 7fd5df7fe640 1 -- 172.21.15.5:0/1492009152 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd5d0051380 con 0x7fd5e80c8bc0 2023-07-14T13:29:30.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.964+0000 7fd5ed737640 1 -- 172.21.15.5:0/1492009152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd5e804e020 con 0x7fd5e80c8bc0 2023-07-14T13:29:30.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.968+0000 7fd5df7fe640 1 -- 172.21.15.5:0/1492009152 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v56) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd5d00549a0 con 0x7fd5e80c8bc0 2023-07-14T13:29:30.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.972+0000 7fd5ed737640 1 -- 172.21.15.5:0/1492009152 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd5c80663a0 msgr2=0x7fd5c8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:30.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.972+0000 7fd5ed737640 1 --2- 172.21.15.5:0/1492009152 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd5c80663a0 0x7fd5c8068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd5e80c83c0 tx=0x7fd5d8009040 comp rx=0 tx=0).stop 2023-07-14T13:29:30.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.972+0000 7fd5ed737640 1 -- 172.21.15.5:0/1492009152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e80c8bc0 msgr2=0x7fd5e81573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:30.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.972+0000 7fd5ed737640 1 --2- 172.21.15.5:0/1492009152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e80c8bc0 0x7fd5e81573c0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fd5d000c820 tx=0x7fd5d000cce0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.972+0000 7fd5ed737640 1 -- 172.21.15.5:0/1492009152 shutdown_connections 2023-07-14T13:29:30.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.972+0000 7fd5ed737640 1 --2- 172.21.15.5:0/1492009152 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd5c80663a0 0x7fd5c8068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.972+0000 7fd5ed737640 1 --2- 172.21.15.5:0/1492009152 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5e8159340 0x7fd5e8157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.972+0000 7fd5ed737640 1 --2- 172.21.15.5:0/1492009152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5e80c8bc0 0x7fd5e81573c0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.972+0000 7fd5ed737640 1 --2- 172.21.15.5:0/1492009152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5e80c8760 0x7fd5e814c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.972+0000 7fd5ed737640 1 -- 172.21.15.5:0/1492009152 >> 172.21.15.5:0/1492009152 conn(0x7fd5e80cb4f0 msgr2=0x7fd5e806f560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:30.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.972+0000 7fd5ed737640 1 -- 172.21.15.5:0/1492009152 shutdown_connections 2023-07-14T13:29:30.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:30.972+0000 7fd5ed737640 1 -- 172.21.15.5:0/1492009152 wait complete. 2023-07-14T13:29:30.997 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-14T13:29:31.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.136+0000 7f6bb927b640 1 Processor -- start 2023-07-14T13:29:31.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.136+0000 7f6bb927b640 1 -- start start 2023-07-14T13:29:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.136+0000 7f6bb927b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bb4156560 0x7f6bb40cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.140+0000 7f6bb927b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb40b08d0 con 0x7f6bb40ccf60 2023-07-14T13:29:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.140+0000 7f6bb927b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb4159cb0 con 0x7f6bb4159500 2023-07-14T13:29:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.140+0000 7f6bb927b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb41599d0 con 0x7f6bb4156560 2023-07-14T13:29:31.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.140+0000 7f6babfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6bb40ccf60 0x7f6bb4158df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45938/0 (socket says 172.21.15.5:45938) 2023-07-14T13:29:31.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.140+0000 7f6babfff640 1 -- 172.21.15.5:0/98824660 learned_addr learned my addr 172.21.15.5:0/98824660 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:31.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.140+0000 7f6bb2ffd640 1 --2- 172.21.15.5:0/98824660 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bb4156560 0x7f6bb40cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:31.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.140+0000 7f6bb27fc640 1 -- 172.21.15.5:0/98824660 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3477467802 0 0) 0x7f6bb40b08d0 con 0x7f6bb40ccf60 2023-07-14T13:29:31.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.140+0000 7f6bb27fc640 1 -- 172.21.15.5:0/98824660 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ba0005740 con 0x7f6bb40ccf60 2023-07-14T13:29:31.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.140+0000 7f6bb27fc640 1 -- 172.21.15.5:0/98824660 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2368598072 0 0) 0x7f6bb4159cb0 con 0x7f6bb4159500 2023-07-14T13:29:31.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.140+0000 7f6bb2ffd640 1 -- 172.21.15.5:0/98824660 >> v1:172.21.15.154:6789/0 conn(0x7f6bb4159500 legacy=0x7f6bb406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:31.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.140+0000 7f6bb2ffd640 1 -- 172.21.15.5:0/98824660 >> v1:172.21.15.5:6789/0 conn(0x7f6bb40ccf60 legacy=0x7f6bb4158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:31.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.140+0000 7f6bb2ffd640 1 -- 172.21.15.5:0/98824660 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb40ca900 con 0x7f6bb4156560 2023-07-14T13:29:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.144+0000 7f6bb2ffd640 1 --2- 172.21.15.5:0/98824660 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bb4156560 0x7f6bb40cb3e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4009820 tx=0x7f6ba401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31408de24544a0cb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:31.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.144+0000 7f6bb27fc640 1 -- 172.21.15.5:0/98824660 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba40ab670 con 0x7f6bb4156560 2023-07-14T13:29:31.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.144+0000 7f6bb27fc640 1 -- 172.21.15.5:0/98824660 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba40ab7d0 con 0x7f6bb4156560 2023-07-14T13:29:31.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.144+0000 7f6bb27fc640 1 -- 172.21.15.5:0/98824660 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba40abb60 con 0x7f6bb4156560 2023-07-14T13:29:31.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.144+0000 7f6bb927b640 1 -- 172.21.15.5:0/98824660 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bb4156560 msgr2=0x7f6bb40cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:31.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.144+0000 7f6bb927b640 1 --2- 172.21.15.5:0/98824660 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bb4156560 0x7f6bb40cb3e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4009820 tx=0x7f6ba401c470 comp rx=0 tx=0).stop 2023-07-14T13:29:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.144+0000 7f6bb927b640 1 -- 172.21.15.5:0/98824660 shutdown_connections 2023-07-14T13:29:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.144+0000 7f6bb927b640 1 --2- 172.21.15.5:0/98824660 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bb4156560 0x7f6bb40cb3e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.144+0000 7f6bb927b640 1 -- 172.21.15.5:0/98824660 >> 172.21.15.5:0/98824660 conn(0x7f6bb40afac0 msgr2=0x7f6bb40afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.144+0000 7f6bb927b640 1 -- 172.21.15.5:0/98824660 shutdown_connections 2023-07-14T13:29:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.144+0000 7f6bb927b640 1 -- 172.21.15.5:0/98824660 wait complete. 2023-07-14T13:29:31.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.144+0000 7f6bb927b640 1 Processor -- start 2023-07-14T13:29:31.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.144+0000 7f6bb927b640 1 -- start start 2023-07-14T13:29:31.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.148+0000 7f6bb927b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bb40ccf60 0x7f6bb40b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:31.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.148+0000 7f6bb927b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bb4156560 0x7f6bb41f46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:31.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.148+0000 7f6bb927b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bb4159500 0x7f6bb40c0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:31.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.148+0000 7f6bb927b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb41f4c30 con 0x7f6bb40ccf60 2023-07-14T13:29:31.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.148+0000 7f6bb927b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb40b23a0 con 0x7f6bb4156560 2023-07-14T13:29:31.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.148+0000 7f6bb927b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb40b1790 con 0x7f6bb4159500 2023-07-14T13:29:31.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.148+0000 7f6bb2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bb40ccf60 0x7f6bb40b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:31.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.148+0000 7f6bb2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bb40ccf60 0x7f6bb40b10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50888/0 (socket says 172.21.15.5:50888) 2023-07-14T13:29:31.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.148+0000 7f6bb2ffd640 1 -- 172.21.15.5:0/557630020 learned_addr learned my addr 172.21.15.5:0/557630020 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:31.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.148+0000 7f6babfff640 1 --2- 172.21.15.5:0/557630020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bb4156560 0x7f6bb41f46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:31.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.148+0000 7f6bb37fe640 1 --2- 172.21.15.5:0/557630020 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bb4159500 0x7f6bb40c0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:31.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.148+0000 7f6bb2ffd640 1 -- 172.21.15.5:0/557630020 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bb4159500 msgr2=0x7f6bb40c0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:31.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.148+0000 7f6bb2ffd640 1 --2- 172.21.15.5:0/557630020 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bb4159500 0x7f6bb40c0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:31.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.148+0000 7f6bb2ffd640 1 -- 172.21.15.5:0/557630020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bb4156560 msgr2=0x7f6bb41f46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:31.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.148+0000 7f6bb2ffd640 1 --2- 172.21.15.5:0/557630020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bb4156560 0x7f6bb41f46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:31.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.148+0000 7f6bb2ffd640 1 -- 172.21.15.5:0/557630020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba4009420 con 0x7f6bb40ccf60 2023-07-14T13:29:31.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.148+0000 7f6bb37fe640 1 --2- 172.21.15.5:0/557630020 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bb4159500 0x7f6bb40c0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:29:31.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.148+0000 7f6bb2ffd640 1 --2- 172.21.15.5:0/557630020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bb40ccf60 0x7f6bb40b10d0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f6ba401c950 tx=0x7f6ba401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:31.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.148+0000 7f6bab7fe640 1 -- 172.21.15.5:0/557630020 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4004220 con 0x7f6bb40ccf60 2023-07-14T13:29:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.148+0000 7f6bab7fe640 1 -- 172.21.15.5:0/557630020 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba4004380 con 0x7f6bb40ccf60 2023-07-14T13:29:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.148+0000 7f6bb927b640 1 -- 172.21.15.5:0/557630020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb40b1a70 con 0x7f6bb40ccf60 2023-07-14T13:29:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.148+0000 7f6bab7fe640 1 -- 172.21.15.5:0/557630020 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4003860 con 0x7f6bb40ccf60 2023-07-14T13:29:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.148+0000 7f6bb927b640 1 -- 172.21.15.5:0/557630020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb40b2030 con 0x7f6bb40ccf60 2023-07-14T13:29:31.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.148+0000 7f6bb927b640 1 -- 172.21.15.5:0/557630020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb40678d0 con 0x7f6bb40ccf60 2023-07-14T13:29:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.148+0000 7f6bab7fe640 1 -- 172.21.15.5:0/557630020 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6ba40039c0 con 0x7f6bb40ccf60 2023-07-14T13:29:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.152+0000 7f6bab7fe640 1 --2- 172.21.15.5:0/557630020 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f6b940663d0 0x7f6b94068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.152+0000 7f6bab7fe640 1 -- 172.21.15.5:0/557630020 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6356+0+0 (secure 0 0 0) 0x7f6ba411ee40 con 0x7f6bb40ccf60 2023-07-14T13:29:31.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.152+0000 7f6babfff640 1 --2- 172.21.15.5:0/557630020 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f6b940663d0 0x7f6b94068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:31.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.152+0000 7f6babfff640 1 --2- 172.21.15.5:0/557630020 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f6b940663d0 0x7f6b94068880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6bb40708d0 tx=0x7f6b9c009040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.156+0000 7f6bab7fe640 1 -- 172.21.15.5:0/557630020 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6ba40ec0a0 con 0x7f6bb40ccf60 2023-07-14T13:29:31.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.312+0000 7f6bb927b640 1 -- 172.21.15.5:0/557630020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f6bb4164560 con 0x7f6bb40ccf60 2023-07-14T13:29:31.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.320+0000 7f6bab7fe640 1 -- 172.21.15.5:0/557630020 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v57) v1 ==== 115+0+0 (secure 0 0 0) 0x7f6ba40044f0 con 0x7f6bb40ccf60 2023-07-14T13:29:31.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.320+0000 7f6bb927b640 1 -- 172.21.15.5:0/557630020 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f6b940663d0 msgr2=0x7f6b94068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:31.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.320+0000 7f6bb927b640 1 --2- 172.21.15.5:0/557630020 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f6b940663d0 0x7f6b94068880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6bb40708d0 tx=0x7f6b9c009040 comp rx=0 tx=0).stop 2023-07-14T13:29:31.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.320+0000 7f6bb927b640 1 -- 172.21.15.5:0/557630020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bb40ccf60 msgr2=0x7f6bb40b10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:31.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.320+0000 7f6bb927b640 1 --2- 172.21.15.5:0/557630020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bb40ccf60 0x7f6bb40b10d0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f6ba401c950 tx=0x7f6ba401acb0 comp rx=0 tx=0).stop 2023-07-14T13:29:31.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.320+0000 7f6bb927b640 1 -- 172.21.15.5:0/557630020 shutdown_connections 2023-07-14T13:29:31.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.320+0000 7f6bb927b640 1 --2- 172.21.15.5:0/557630020 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f6b940663d0 0x7f6b94068880 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:31.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.320+0000 7f6bb927b640 1 --2- 172.21.15.5:0/557630020 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bb4159500 0x7f6bb40c0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:31.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.320+0000 7f6bb927b640 1 --2- 172.21.15.5:0/557630020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bb4156560 0x7f6bb41f46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:31.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.320+0000 7f6bb927b640 1 --2- 172.21.15.5:0/557630020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bb40ccf60 0x7f6bb40b10d0 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:31.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.320+0000 7f6bb927b640 1 -- 172.21.15.5:0/557630020 >> 172.21.15.5:0/557630020 conn(0x7f6bb40afac0 msgr2=0x7f6bb406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:31.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.320+0000 7f6bb927b640 1 -- 172.21.15.5:0/557630020 shutdown_connections 2023-07-14T13:29:31.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.320+0000 7f6bb927b640 1 -- 172.21.15.5:0/557630020 wait complete. 2023-07-14T13:29:31.346 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-07-14T13:29:31.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.484+0000 7f96749fa640 1 Processor -- start 2023-07-14T13:29:31.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.484+0000 7f96749fa640 1 -- start start 2023-07-14T13:29:31.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.484+0000 7f96749fa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f967015fd60 0x7f96700d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:31.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.484+0000 7f96749fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96700d1850 0x7f96700d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:31.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.484+0000 7f96749fa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96700ccaf0 con 0x7f96700b7c70 2023-07-14T13:29:31.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.484+0000 7f96749fa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96700d1190 con 0x7f967015fd60 2023-07-14T13:29:31.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.484+0000 7f96749fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9670160600 con 0x7f96700d1850 2023-07-14T13:29:31.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.484+0000 7f966e59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f96700b7c70 0x7f967015f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45944/0 (socket says 172.21.15.5:45944) 2023-07-14T13:29:31.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.484+0000 7f966e59c640 1 -- 172.21.15.5:0/3722337233 learned_addr learned my addr 172.21.15.5:0/3722337233 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:31.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.484+0000 7f9667fff640 1 --2- 172.21.15.5:0/3722337233 >> v2:172.21.15.5:3300/0 conn(0x7f967015fd60 0x7f96700d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:31.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.484+0000 7f966ed9d640 1 --2- 172.21.15.5:0/3722337233 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96700d1850 0x7f96700d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:31.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.484+0000 7f966dd9b640 1 -- 172.21.15.5:0/3722337233 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796443057 0 0) 0x7f96700ccaf0 con 0x7f96700b7c70 2023-07-14T13:29:31.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.484+0000 7f9667fff640 1 -- 172.21.15.5:0/3722337233 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96700d1850 msgr2=0x7f96700d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:31.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.484+0000 7f9667fff640 1 --2- 172.21.15.5:0/3722337233 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96700d1850 0x7f96700d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:31.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.484+0000 7f9667fff640 1 -- 172.21.15.5:0/3722337233 >> v1:172.21.15.5:6789/0 conn(0x7f96700b7c70 legacy=0x7f967015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:31.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.484+0000 7f9667fff640 1 -- 172.21.15.5:0/3722337233 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9670160320 con 0x7f967015fd60 2023-07-14T13:29:31.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.488+0000 7f9667fff640 1 --2- 172.21.15.5:0/3722337233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f967015fd60 0x7f96700d0c50 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f96580097c0 tx=0x7f965801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7120ffbd9669a190 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:31.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.488+0000 7f966dd9b640 1 -- 172.21.15.5:0/3722337233 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96580ab670 con 0x7f967015fd60 2023-07-14T13:29:31.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.488+0000 7f966dd9b640 1 -- 172.21.15.5:0/3722337233 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96580ab7d0 con 0x7f967015fd60 2023-07-14T13:29:31.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.488+0000 7f966dd9b640 1 -- 172.21.15.5:0/3722337233 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96580abb60 con 0x7f967015fd60 2023-07-14T13:29:31.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.488+0000 7f96749fa640 1 -- 172.21.15.5:0/3722337233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f967015fd60 msgr2=0x7f96700d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:31.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.488+0000 7f96749fa640 1 --2- 172.21.15.5:0/3722337233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f967015fd60 0x7f96700d0c50 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f96580097c0 tx=0x7f965801c450 comp rx=0 tx=0).stop 2023-07-14T13:29:31.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.488+0000 7f96749fa640 1 -- 172.21.15.5:0/3722337233 shutdown_connections 2023-07-14T13:29:31.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.488+0000 7f96749fa640 1 --2- 172.21.15.5:0/3722337233 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96700d1850 0x7f96700d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:31.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.488+0000 7f96749fa640 1 --2- 172.21.15.5:0/3722337233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f967015fd60 0x7f96700d0c50 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:31.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.488+0000 7f96749fa640 1 -- 172.21.15.5:0/3722337233 >> 172.21.15.5:0/3722337233 conn(0x7f96700650b0 msgr2=0x7f96700654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:31.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.488+0000 7f96749fa640 1 -- 172.21.15.5:0/3722337233 shutdown_connections 2023-07-14T13:29:31.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.488+0000 7f96749fa640 1 -- 172.21.15.5:0/3722337233 wait complete. 2023-07-14T13:29:31.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.492+0000 7f96749fa640 1 Processor -- start 2023-07-14T13:29:31.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.492+0000 7f96749fa640 1 -- start start 2023-07-14T13:29:31.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.492+0000 7f96749fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96700b7c70 0x7f96700b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:31.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.492+0000 7f96749fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96700d1850 0x7f9670152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:31.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.492+0000 7f96749fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f967015fd60 0x7f9670152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:31.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.492+0000 7f96749fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967014dda0 con 0x7f96700b7c70 2023-07-14T13:29:31.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.492+0000 7f96749fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96701545a0 con 0x7f967015fd60 2023-07-14T13:29:31.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.492+0000 7f96749fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96700b5ea0 con 0x7f96700d1850 2023-07-14T13:29:31.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.492+0000 7f966e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96700b7c70 0x7f96700b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:31.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.492+0000 7f966e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96700b7c70 0x7f96700b5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50896/0 (socket says 172.21.15.5:50896) 2023-07-14T13:29:31.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.492+0000 7f966e59c640 1 -- 172.21.15.5:0/461045188 learned_addr learned my addr 172.21.15.5:0/461045188 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:31.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.492+0000 7f9667fff640 1 --2- 172.21.15.5:0/461045188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96700d1850 0x7f9670152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:31.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.492+0000 7f966e59c640 1 -- 172.21.15.5:0/461045188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96700d1850 msgr2=0x7f9670152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:31.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.492+0000 7f966e59c640 1 --2- 172.21.15.5:0/461045188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96700d1850 0x7f9670152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:31.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.492+0000 7f966e59c640 1 -- 172.21.15.5:0/461045188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f967015fd60 msgr2=0x7f9670152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:31.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.492+0000 7f966e59c640 1 --2- 172.21.15.5:0/461045188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f967015fd60 0x7f9670152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:31.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.492+0000 7f966e59c640 1 -- 172.21.15.5:0/461045188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9658009420 con 0x7f96700b7c70 2023-07-14T13:29:31.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.492+0000 7f966e59c640 1 --2- 172.21.15.5:0/461045188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96700b7c70 0x7f96700b5960 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f966000c480 tx=0x7f966000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:31.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.492+0000 7f9666ffd640 1 -- 172.21.15.5:0/461045188 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96600074e0 con 0x7f96700b7c70 2023-07-14T13:29:31.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.492+0000 7f9666ffd640 1 -- 172.21.15.5:0/461045188 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9660007660 con 0x7f96700b7c70 2023-07-14T13:29:31.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.492+0000 7f9666ffd640 1 -- 172.21.15.5:0/461045188 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9660004a30 con 0x7f96700b7c70 2023-07-14T13:29:31.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.492+0000 7f96749fa640 1 -- 172.21.15.5:0/461045188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9670153990 con 0x7f96700b7c70 2023-07-14T13:29:31.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.492+0000 7f96749fa640 1 -- 172.21.15.5:0/461045188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9670153f50 con 0x7f96700b7c70 2023-07-14T13:29:31.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.496+0000 7f96749fa640 1 -- 172.21.15.5:0/461045188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96700678d0 con 0x7f96700b7c70 2023-07-14T13:29:31.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.496+0000 7f9666ffd640 1 -- 172.21.15.5:0/461045188 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9660004b90 con 0x7f96700b7c70 2023-07-14T13:29:31.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.496+0000 7f9666ffd640 1 --2- 172.21.15.5:0/461045188 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f96500663a0 0x7f9650068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:31.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.496+0000 7f9666ffd640 1 -- 172.21.15.5:0/461045188 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6356+0+0 (secure 0 0 0) 0x7f96600831f0 con 0x7f96700b7c70 2023-07-14T13:29:31.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.496+0000 7f9667fff640 1 --2- 172.21.15.5:0/461045188 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f96500663a0 0x7f9650068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:31.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.496+0000 7f9667fff640 1 --2- 172.21.15.5:0/461045188 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f96500663a0 0x7f9650068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f96580af000 tx=0x7f96580a7000 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:31.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.500+0000 7f9666ffd640 1 -- 172.21.15.5:0/461045188 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9660053eb0 con 0x7f96700b7c70 2023-07-14T13:29:31.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:31.712+0000 7f96749fa640 1 -- 172.21.15.5:0/461045188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7f96700b1060 con 0x7f96700b7c70 2023-07-14T13:29:32.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.264+0000 7f9666ffd640 1 -- 172.21.15.5:0/461045188 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v1302) v1 ==== 165+0+0 (secure 0 0 0) 0x7f9660053a40 con 0x7f96700b7c70 2023-07-14T13:29:32.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.268+0000 7f96749fa640 1 -- 172.21.15.5:0/461045188 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f96500663a0 msgr2=0x7f9650068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:32.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.268+0000 7f96749fa640 1 --2- 172.21.15.5:0/461045188 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f96500663a0 0x7f9650068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f96580af000 tx=0x7f96580a7000 comp rx=0 tx=0).stop 2023-07-14T13:29:32.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.268+0000 7f96749fa640 1 -- 172.21.15.5:0/461045188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96700b7c70 msgr2=0x7f96700b5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:32.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.268+0000 7f96749fa640 1 --2- 172.21.15.5:0/461045188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96700b7c70 0x7f96700b5960 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f966000c480 tx=0x7f966000c940 comp rx=0 tx=0).stop 2023-07-14T13:29:32.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.268+0000 7f96749fa640 1 -- 172.21.15.5:0/461045188 shutdown_connections 2023-07-14T13:29:32.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.268+0000 7f96749fa640 1 --2- 172.21.15.5:0/461045188 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f96500663a0 0x7f9650068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:32.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.268+0000 7f96749fa640 1 --2- 172.21.15.5:0/461045188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f967015fd60 0x7f9670152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:32.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.268+0000 7f96749fa640 1 --2- 172.21.15.5:0/461045188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96700d1850 0x7f9670152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:32.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.268+0000 7f96749fa640 1 --2- 172.21.15.5:0/461045188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96700b7c70 0x7f96700b5960 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:32.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.268+0000 7f96749fa640 1 -- 172.21.15.5:0/461045188 >> 172.21.15.5:0/461045188 conn(0x7f96700650b0 msgr2=0x7f9670065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:32.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.268+0000 7f96749fa640 1 -- 172.21.15.5:0/461045188 shutdown_connections 2023-07-14T13:29:32.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.268+0000 7f96749fa640 1 -- 172.21.15.5:0/461045188 wait complete. 2023-07-14T13:29:32.297 INFO:tasks.cephfs_test_runner:Test that snap schedule is resumed after mgr restart ... ok 2023-07-14T13:29:32.298 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test scheduled snapshots along with rentention policy 2023-07-14T13:29:32.298 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-14T13:29:32.298 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-07-14T13:29:32.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.440+0000 7f0b39648640 1 Processor -- start 2023-07-14T13:29:32.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.440+0000 7f0b39648640 1 -- start start 2023-07-14T13:29:32.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.444+0000 7f0b39648640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b340ae1f0 0x7f0b340b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:32.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.444+0000 7f0b39648640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0b3406c430 0x7f0b34069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:32.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.444+0000 7f0b39648640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b340b24f0 con 0x7f0b3406e160 2023-07-14T13:29:32.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.444+0000 7f0b39648640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b340b27d0 con 0x7f0b3406c430 2023-07-14T13:29:32.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.444+0000 7f0b39648640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b340b2ab0 con 0x7f0b340ae1f0 2023-07-14T13:29:32.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.444+0000 7f0b32ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b340ae1f0 0x7f0b340b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:32.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.444+0000 7f0b32ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b340ae1f0 0x7f0b340b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:60446/0 (socket says 172.21.15.5:60446) 2023-07-14T13:29:32.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.444+0000 7f0b32ffd640 1 -- 172.21.15.5:0/3743472138 learned_addr learned my addr 172.21.15.5:0/3743472138 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:32.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.444+0000 7f0b337fe640 1 --2- 172.21.15.5:0/3743472138 >> v2:172.21.15.154:3300/0 conn(0x7f0b3406c430 0x7f0b34069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:32.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.444+0000 7f0b31ffb640 1 -- 172.21.15.5:0/3743472138 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1604611227 0 0) 0x7f0b340b24f0 con 0x7f0b3406e160 2023-07-14T13:29:32.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.444+0000 7f0b32ffd640 1 -- 172.21.15.5:0/3743472138 >> v2:172.21.15.154:3300/0 conn(0x7f0b3406c430 msgr2=0x7f0b34069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:32.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.444+0000 7f0b32ffd640 1 --2- 172.21.15.5:0/3743472138 >> v2:172.21.15.154:3300/0 conn(0x7f0b3406c430 0x7f0b34069430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:32.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.444+0000 7f0b32ffd640 1 -- 172.21.15.5:0/3743472138 >> v1:172.21.15.154:6789/0 conn(0x7f0b3406e160 legacy=0x7f0b3406bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:32.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.444+0000 7f0b32ffd640 1 -- 172.21.15.5:0/3743472138 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b340b2d90 con 0x7f0b340ae1f0 2023-07-14T13:29:32.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.448+0000 7f0b32ffd640 1 --2- 172.21.15.5:0/3743472138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b340ae1f0 0x7f0b340b1e60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0b24009870 tx=0x7f0b2401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f9a365f6c68f4f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:32.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.448+0000 7f0b31ffb640 1 -- 172.21.15.5:0/3743472138 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b240a95f0 con 0x7f0b340ae1f0 2023-07-14T13:29:32.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.448+0000 7f0b31ffb640 1 -- 172.21.15.5:0/3743472138 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b240a9750 con 0x7f0b340ae1f0 2023-07-14T13:29:32.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.448+0000 7f0b31ffb640 1 -- 172.21.15.5:0/3743472138 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b240a9ae0 con 0x7f0b340ae1f0 2023-07-14T13:29:32.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.448+0000 7f0b39648640 1 -- 172.21.15.5:0/3743472138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b340ae1f0 msgr2=0x7f0b340b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:32.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.448+0000 7f0b39648640 1 --2- 172.21.15.5:0/3743472138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b340ae1f0 0x7f0b340b1e60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0b24009870 tx=0x7f0b2401c510 comp rx=0 tx=0).stop 2023-07-14T13:29:32.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.448+0000 7f0b39648640 1 -- 172.21.15.5:0/3743472138 shutdown_connections 2023-07-14T13:29:32.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.448+0000 7f0b39648640 1 --2- 172.21.15.5:0/3743472138 >> v2:172.21.15.154:3300/0 conn(0x7f0b3406c430 0x7f0b34069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:32.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.448+0000 7f0b39648640 1 --2- 172.21.15.5:0/3743472138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b340ae1f0 0x7f0b340b1e60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:32.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.448+0000 7f0b39648640 1 -- 172.21.15.5:0/3743472138 >> 172.21.15.5:0/3743472138 conn(0x7f0b340b1300 msgr2=0x7f0b340ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:32.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.448+0000 7f0b39648640 1 -- 172.21.15.5:0/3743472138 shutdown_connections 2023-07-14T13:29:32.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.448+0000 7f0b39648640 1 -- 172.21.15.5:0/3743472138 wait complete. 2023-07-14T13:29:32.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.448+0000 7f0b39648640 1 Processor -- start 2023-07-14T13:29:32.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.448+0000 7f0b39648640 1 -- start start 2023-07-14T13:29:32.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.452+0000 7f0b39648640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b3406c430 0x7f0b341651e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:32.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.452+0000 7f0b39648640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b3406e160 0x7f0b34140770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:32.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.452+0000 7f0b39648640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b340ae1f0 0x7f0b340af630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:32.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.452+0000 7f0b39648640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b34141e40 con 0x7f0b340ae1f0 2023-07-14T13:29:32.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.452+0000 7f0b39648640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b34165720 con 0x7f0b3406c430 2023-07-14T13:29:32.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.452+0000 7f0b39648640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b34141230 con 0x7f0b3406e160 2023-07-14T13:29:32.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.452+0000 7f0b337fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b340ae1f0 0x7f0b340af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:32.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.452+0000 7f0b337fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b340ae1f0 0x7f0b340af630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50902/0 (socket says 172.21.15.5:50902) 2023-07-14T13:29:32.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.452+0000 7f0b337fe640 1 -- 172.21.15.5:0/822798446 learned_addr learned my addr 172.21.15.5:0/822798446 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:32.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.452+0000 7f0b327fc640 1 --2- 172.21.15.5:0/822798446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b3406e160 0x7f0b34140770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:32.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.452+0000 7f0b337fe640 1 -- 172.21.15.5:0/822798446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b3406e160 msgr2=0x7f0b34140770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:32.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.452+0000 7f0b337fe640 1 --2- 172.21.15.5:0/822798446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b3406e160 0x7f0b34140770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:32.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.452+0000 7f0b337fe640 1 -- 172.21.15.5:0/822798446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b3406c430 msgr2=0x7f0b341651e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:32.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.452+0000 7f0b337fe640 1 --2- 172.21.15.5:0/822798446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b3406c430 0x7f0b341651e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:32.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.452+0000 7f0b337fe640 1 -- 172.21.15.5:0/822798446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b240094d0 con 0x7f0b340ae1f0 2023-07-14T13:29:32.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.452+0000 7f0b337fe640 1 --2- 172.21.15.5:0/822798446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b340ae1f0 0x7f0b340af630 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c00efc0 tx=0x7f0b2c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:32.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.452+0000 7f0b1b7fe640 1 -- 172.21.15.5:0/822798446 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c009ba0 con 0x7f0b340ae1f0 2023-07-14T13:29:32.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.452+0000 7f0b1b7fe640 1 -- 172.21.15.5:0/822798446 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b2c00f040 con 0x7f0b340ae1f0 2023-07-14T13:29:32.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.452+0000 7f0b39648640 1 -- 172.21.15.5:0/822798446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b340b3710 con 0x7f0b340ae1f0 2023-07-14T13:29:32.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.452+0000 7f0b1b7fe640 1 -- 172.21.15.5:0/822798446 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c0146c0 con 0x7f0b340ae1f0 2023-07-14T13:29:32.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.452+0000 7f0b39648640 1 -- 172.21.15.5:0/822798446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b341417f0 con 0x7f0b340ae1f0 2023-07-14T13:29:32.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.452+0000 7f0b39648640 1 -- 172.21.15.5:0/822798446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b34141ff0 con 0x7f0b340ae1f0 2023-07-14T13:29:32.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.456+0000 7f0b1b7fe640 1 -- 172.21.15.5:0/822798446 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0b2c014820 con 0x7f0b340ae1f0 2023-07-14T13:29:32.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.456+0000 7f0b1b7fe640 1 --2- 172.21.15.5:0/822798446 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f0b200663a0 0x7f0b20068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:32.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.456+0000 7f0b1b7fe640 1 -- 172.21.15.5:0/822798446 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6356+0+0 (secure 0 0 0) 0x7f0b2c084e40 con 0x7f0b340ae1f0 2023-07-14T13:29:32.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.456+0000 7f0b32ffd640 1 --2- 172.21.15.5:0/822798446 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f0b200663a0 0x7f0b20068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:32.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.456+0000 7f0b32ffd640 1 --2- 172.21.15.5:0/822798446 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f0b200663a0 0x7f0b20068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0b240ae000 tx=0x7f0b24008040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:32.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.460+0000 7f0b1b7fe640 1 -- 172.21.15.5:0/822798446 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f0b2c051f60 con 0x7f0b340ae1f0 2023-07-14T13:29:32.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:32.668+0000 7f0b39648640 1 -- 172.21.15.5:0/822798446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7f0b340678d0 con 0x7f0b340ae1f0 2023-07-14T13:29:33.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.268+0000 7f0b1b7fe640 1 -- 172.21.15.5:0/822798446 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v1303) v1 ==== 166+0+0 (secure 0 0 0) 0x7f0b2c055580 con 0x7f0b340ae1f0 2023-07-14T13:29:33.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.268+0000 7f0b39648640 1 -- 172.21.15.5:0/822798446 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f0b200663a0 msgr2=0x7f0b20068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:33.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.268+0000 7f0b39648640 1 --2- 172.21.15.5:0/822798446 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f0b200663a0 0x7f0b20068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0b240ae000 tx=0x7f0b24008040 comp rx=0 tx=0).stop 2023-07-14T13:29:33.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.268+0000 7f0b39648640 1 -- 172.21.15.5:0/822798446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b340ae1f0 msgr2=0x7f0b340af630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:33.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.268+0000 7f0b39648640 1 --2- 172.21.15.5:0/822798446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b340ae1f0 0x7f0b340af630 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c00efc0 tx=0x7f0b2c00c490 comp rx=0 tx=0).stop 2023-07-14T13:29:33.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.272+0000 7f0b39648640 1 -- 172.21.15.5:0/822798446 shutdown_connections 2023-07-14T13:29:33.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.272+0000 7f0b39648640 1 --2- 172.21.15.5:0/822798446 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f0b200663a0 0x7f0b20068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:33.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.272+0000 7f0b39648640 1 --2- 172.21.15.5:0/822798446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b340ae1f0 0x7f0b340af630 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:33.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.272+0000 7f0b39648640 1 --2- 172.21.15.5:0/822798446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0b3406e160 0x7f0b34140770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:33.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.272+0000 7f0b39648640 1 --2- 172.21.15.5:0/822798446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b3406c430 0x7f0b341651e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:33.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.272+0000 7f0b39648640 1 -- 172.21.15.5:0/822798446 >> 172.21.15.5:0/822798446 conn(0x7f0b340b1300 msgr2=0x7f0b340ad470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:33.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.272+0000 7f0b39648640 1 -- 172.21.15.5:0/822798446 shutdown_connections 2023-07-14T13:29:33.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.272+0000 7f0b39648640 1 -- 172.21.15.5:0/822798446 wait complete. 2023-07-14T13:29:33.299 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-14T13:29:33.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6cb7574640 1 Processor -- start 2023-07-14T13:29:33.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6cb7574640 1 -- start start 2023-07-14T13:29:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6cb7574640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6cb00aeb40 0x7f6cb015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6cb7574640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb01532b0 con 0x7f6cb0159440 2023-07-14T13:29:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6cb7574640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb00ca6f0 con 0x7f6cb00aef10 2023-07-14T13:29:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6cb7574640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb01599d0 con 0x7f6cb00aeb40 2023-07-14T13:29:33.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6cb5b11640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6cb0159440 0x7f6cb00c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45956/0 (socket says 172.21.15.5:45956) 2023-07-14T13:29:33.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6cb5b11640 1 -- 172.21.15.5:0/606455871 learned_addr learned my addr 172.21.15.5:0/606455871 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6ca7fff640 1 -- 172.21.15.5:0/606455871 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2582179347 0 0) 0x7f6cb01532b0 con 0x7f6cb0159440 2023-07-14T13:29:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6ca7fff640 1 -- 172.21.15.5:0/606455871 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c9c003530 con 0x7f6cb0159440 2023-07-14T13:29:33.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6cb5310640 1 --2- 172.21.15.5:0/606455871 >> v2:172.21.15.154:3300/0 conn(0x7f6cb00aeb40 0x7f6cb015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6ca7fff640 1 -- 172.21.15.5:0/606455871 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1506166447 0 0) 0x7f6c9c003530 con 0x7f6cb0159440 2023-07-14T13:29:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6ca7fff640 1 -- 172.21.15.5:0/606455871 >> v2:172.21.15.154:3300/0 conn(0x7f6cb00aeb40 msgr2=0x7f6cb015cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6ca7fff640 1 --2- 172.21.15.5:0/606455871 >> v2:172.21.15.154:3300/0 conn(0x7f6cb00aeb40 0x7f6cb015cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6ca7fff640 1 -- 172.21.15.5:0/606455871 >> v1:172.21.15.154:6789/0 conn(0x7f6cb00aef10 legacy=0x7f6cb0158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6ca7fff640 1 -- 172.21.15.5:0/606455871 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb0159cb0 con 0x7f6cb0159440 2023-07-14T13:29:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6ca7fff640 1 -- 172.21.15.5:0/606455871 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f6ca8001a00 con 0x7f6cb0159440 2023-07-14T13:29:33.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6ca7fff640 1 -- 172.21.15.5:0/606455871 >> v1:172.21.15.5:6789/0 conn(0x7f6cb0159440 legacy=0x7f6cb00c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6ca7fff640 1 --2- 172.21.15.5:0/606455871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c9c003980 0x7f6c9c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6ca7fff640 1 --2- 172.21.15.5:0/606455871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c9c0047d0 0x7f6c9c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6ca7fff640 1 --2- 172.21.15.5:0/606455871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c9c005180 0x7f6c9c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6ca7fff640 1 -- 172.21.15.5:0/606455871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb01599d0 con 0x7f6c9c003980 2023-07-14T13:29:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6ca7fff640 1 -- 172.21.15.5:0/606455871 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c00c090 con 0x7f6c9c005180 2023-07-14T13:29:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6ca7fff640 1 -- 172.21.15.5:0/606455871 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c00e460 con 0x7f6c9c0047d0 2023-07-14T13:29:33.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6cb5310640 1 --2- 172.21.15.5:0/606455871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c9c003980 0x7f6c9c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6cb5b11640 1 --2- 172.21.15.5:0/606455871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c9c005180 0x7f6c9c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6cb4b0f640 1 --2- 172.21.15.5:0/606455871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c9c0047d0 0x7f6c9c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6cb5310640 1 -- 172.21.15.5:0/606455871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c9c0047d0 msgr2=0x7f6c9c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.444+0000 7f6cb5310640 1 --2- 172.21.15.5:0/606455871 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c9c0047d0 0x7f6c9c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.448+0000 7f6cb5310640 1 -- 172.21.15.5:0/606455871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c9c005180 msgr2=0x7f6c9c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.448+0000 7f6cb5310640 1 --2- 172.21.15.5:0/606455871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c9c005180 0x7f6c9c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.448+0000 7f6cb5310640 1 -- 172.21.15.5:0/606455871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9c003530 con 0x7f6c9c003980 2023-07-14T13:29:33.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.448+0000 7f6cb5b11640 1 -- 172.21.15.5:0/606455871 reap_dead start 2023-07-14T13:29:33.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.448+0000 7f6cb5310640 1 --2- 172.21.15.5:0/606455871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c9c003980 0x7f6c9c003d90 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f6cac009ae0 tx=0x7f6cac01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fcae63f247a8620 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.448+0000 7f6ca7fff640 1 -- 172.21.15.5:0/606455871 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac0a6510 con 0x7f6c9c003980 2023-07-14T13:29:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.448+0000 7f6ca7fff640 1 -- 172.21.15.5:0/606455871 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cac0a6670 con 0x7f6c9c003980 2023-07-14T13:29:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.448+0000 7f6ca7fff640 1 -- 172.21.15.5:0/606455871 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac0a6a20 con 0x7f6c9c003980 2023-07-14T13:29:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.448+0000 7f6cb7574640 1 -- 172.21.15.5:0/606455871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c9c003980 msgr2=0x7f6c9c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.448+0000 7f6cb7574640 1 --2- 172.21.15.5:0/606455871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c9c003980 0x7f6c9c003d90 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f6cac009ae0 tx=0x7f6cac01ca20 comp rx=0 tx=0).stop 2023-07-14T13:29:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.448+0000 7f6cb7574640 1 -- 172.21.15.5:0/606455871 shutdown_connections 2023-07-14T13:29:33.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.448+0000 7f6cb7574640 1 --2- 172.21.15.5:0/606455871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c9c003980 0x7f6c9c003d90 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.448+0000 7f6cb7574640 1 -- 172.21.15.5:0/606455871 >> 172.21.15.5:0/606455871 conn(0x7f6cb00cde90 msgr2=0x7f6cb00ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.448+0000 7f6cb7574640 1 -- 172.21.15.5:0/606455871 shutdown_connections 2023-07-14T13:29:33.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.448+0000 7f6cb7574640 1 -- 172.21.15.5:0/606455871 wait complete. 2023-07-14T13:29:33.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.452+0000 7f6cb7574640 1 Processor -- start 2023-07-14T13:29:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.452+0000 7f6cb7574640 1 -- start start 2023-07-14T13:29:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.452+0000 7f6cb7574640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c9c003980 0x7f6cb014ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.452+0000 7f6cb7574640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cb014ea40 0x7f6cb014ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:33.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.452+0000 7f6cb7574640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cb00b0dc0 0x7f6cb00b1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.452+0000 7f6cb7574640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb014b0b0 con 0x7f6cb014ea40 2023-07-14T13:29:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.452+0000 7f6cb7574640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb014f770 con 0x7f6cb00b0dc0 2023-07-14T13:29:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.452+0000 7f6cb7574640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb014fa50 con 0x7f6c9c003980 2023-07-14T13:29:33.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.452+0000 7f6cb4b0f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cb014ea40 0x7f6cb014ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.452+0000 7f6cb4b0f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cb014ea40 0x7f6cb014ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50924/0 (socket says 172.21.15.5:50924) 2023-07-14T13:29:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.452+0000 7f6cb4b0f640 1 -- 172.21.15.5:0/2631848587 learned_addr learned my addr 172.21.15.5:0/2631848587 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.452+0000 7f6cb5b11640 1 --2- 172.21.15.5:0/2631848587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cb00b0dc0 0x7f6cb00b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:33.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.452+0000 7f6cb5310640 1 --2- 172.21.15.5:0/2631848587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c9c003980 0x7f6cb014ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.452+0000 7f6cb4b0f640 1 -- 172.21.15.5:0/2631848587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c9c003980 msgr2=0x7f6cb014ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.452+0000 7f6cb4b0f640 1 --2- 172.21.15.5:0/2631848587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c9c003980 0x7f6cb014ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:33.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.452+0000 7f6cb4b0f640 1 -- 172.21.15.5:0/2631848587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cb00b0dc0 msgr2=0x7f6cb00b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.452+0000 7f6cb4b0f640 1 --2- 172.21.15.5:0/2631848587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cb00b0dc0 0x7f6cb00b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.452+0000 7f6cb4b0f640 1 -- 172.21.15.5:0/2631848587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb014fd30 con 0x7f6cb014ea40 2023-07-14T13:29:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.452+0000 7f6cb5310640 1 --2- 172.21.15.5:0/2631848587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c9c003980 0x7f6cb014ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:29:33.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.452+0000 7f6cb4b0f640 1 --2- 172.21.15.5:0/2631848587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cb014ea40 0x7f6cb014ee90 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000f5f0 tx=0x7f6ca000f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:33.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.452+0000 7f6ca5ffb640 1 -- 172.21.15.5:0/2631848587 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca00052e0 con 0x7f6cb014ea40 2023-07-14T13:29:33.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.452+0000 7f6ca5ffb640 1 -- 172.21.15.5:0/2631848587 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca0005440 con 0x7f6cb014ea40 2023-07-14T13:29:33.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.452+0000 7f6cb7574640 1 -- 172.21.15.5:0/2631848587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb0150010 con 0x7f6cb014ea40 2023-07-14T13:29:33.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.452+0000 7f6ca5ffb640 1 -- 172.21.15.5:0/2631848587 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca0003820 con 0x7f6cb014ea40 2023-07-14T13:29:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.452+0000 7f6cb7574640 1 -- 172.21.15.5:0/2631848587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb0150810 con 0x7f6cb014ea40 2023-07-14T13:29:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.456+0000 7f6cb7574640 1 -- 172.21.15.5:0/2631848587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb00678d0 con 0x7f6cb014ea40 2023-07-14T13:29:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.456+0000 7f6ca5ffb640 1 -- 172.21.15.5:0/2631848587 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6ca0003980 con 0x7f6cb014ea40 2023-07-14T13:29:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.456+0000 7f6ca5ffb640 1 --2- 172.21.15.5:0/2631848587 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f6c940663a0 0x7f6c94068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.456+0000 7f6ca5ffb640 1 -- 172.21.15.5:0/2631848587 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6356+0+0 (secure 0 0 0) 0x7f6ca0083d80 con 0x7f6cb014ea40 2023-07-14T13:29:33.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.456+0000 7f6cb5310640 1 --2- 172.21.15.5:0/2631848587 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f6c940663a0 0x7f6c94068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.456+0000 7f6cb5310640 1 --2- 172.21.15.5:0/2631848587 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f6c940663a0 0x7f6c94068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0af000 tx=0x7f6cac008040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:33.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.460+0000 7f6ca5ffb640 1 -- 172.21.15.5:0/2631848587 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6ca0050fc0 con 0x7f6cb014ea40 2023-07-14T13:29:33.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.616+0000 7f6cb7574640 1 -- 172.21.15.5:0/2631848587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6cb00af780 con 0x7f6cb014ea40 2023-07-14T13:29:33.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.620+0000 7f6ca5ffb640 1 -- 172.21.15.5:0/2631848587 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v58)=0 v58) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6ca00545e0 con 0x7f6cb014ea40 2023-07-14T13:29:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.624+0000 7f6cb7574640 1 -- 172.21.15.5:0/2631848587 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f6c940663a0 msgr2=0x7f6c94068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:33.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.624+0000 7f6cb7574640 1 --2- 172.21.15.5:0/2631848587 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f6c940663a0 0x7f6c94068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0af000 tx=0x7f6cac008040 comp rx=0 tx=0).stop 2023-07-14T13:29:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.624+0000 7f6cb7574640 1 -- 172.21.15.5:0/2631848587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cb014ea40 msgr2=0x7f6cb014ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.624+0000 7f6cb7574640 1 --2- 172.21.15.5:0/2631848587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cb014ea40 0x7f6cb014ee90 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000f5f0 tx=0x7f6ca000f9f0 comp rx=0 tx=0).stop 2023-07-14T13:29:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.624+0000 7f6cb7574640 1 -- 172.21.15.5:0/2631848587 shutdown_connections 2023-07-14T13:29:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.624+0000 7f6cb7574640 1 --2- 172.21.15.5:0/2631848587 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f6c940663a0 0x7f6c94068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.624+0000 7f6cb7574640 1 --2- 172.21.15.5:0/2631848587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cb00b0dc0 0x7f6cb00b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.624+0000 7f6cb7574640 1 --2- 172.21.15.5:0/2631848587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cb014ea40 0x7f6cb014ee90 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.624+0000 7f6cb7574640 1 --2- 172.21.15.5:0/2631848587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c9c003980 0x7f6cb014ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:33.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.624+0000 7f6cb7574640 1 -- 172.21.15.5:0/2631848587 >> 172.21.15.5:0/2631848587 conn(0x7f6cb00cde90 msgr2=0x7f6cb00ada10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:33.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.624+0000 7f6cb7574640 1 -- 172.21.15.5:0/2631848587 shutdown_connections 2023-07-14T13:29:33.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:33.624+0000 7f6cb7574640 1 -- 172.21.15.5:0/2631848587 wait complete. 2023-07-14T13:29:33.647 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T13:29:33.648 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:29:33.695 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:29:33.763 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T13:29:33.764 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:29:33.764 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:29:33.774 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:29:33.774 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:29:33.774 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:29:33.784 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:29:33.785 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:29:33.785 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:29:33.828 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:29:33.829 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:29:33.829 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:29:33.840 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:29:33.841 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-14T13:29:33.841 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:29:34.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.008+0000 7fae3eacb640 1 Processor -- start 2023-07-14T13:29:34.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.008+0000 7fae3eacb640 1 -- start start 2023-07-14T13:29:34.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.008+0000 7fae3eacb640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae380b7c70 0x7fae380d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:34.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.008+0000 7fae3eacb640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae380ccaf0 con 0x7fae380d1850 2023-07-14T13:29:34.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.008+0000 7fae3eacb640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae38160320 con 0x7fae3815fd60 2023-07-14T13:29:34.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.008+0000 7fae3eacb640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae380d1190 con 0x7fae380b7c70 2023-07-14T13:29:34.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.008+0000 7fae3c867640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae380b7c70 0x7fae380d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:34.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.008+0000 7fae3c867640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fae380b7c70 0x7fae380d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50930/0 (socket says 172.21.15.5:50930) 2023-07-14T13:29:34.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.008+0000 7fae3c867640 1 -- 172.21.15.5:0/2966768814 learned_addr learned my addr 172.21.15.5:0/2966768814 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:34.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.008+0000 7fae3c867640 1 -- 172.21.15.5:0/2966768814 >> v1:172.21.15.154:6789/0 conn(0x7fae3815fd60 legacy=0x7fae380d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:34.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.008+0000 7fae3c867640 1 -- 172.21.15.5:0/2966768814 >> v1:172.21.15.5:6789/0 conn(0x7fae380d1850 legacy=0x7fae3815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:34.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.008+0000 7fae3c867640 1 -- 172.21.15.5:0/2966768814 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae380ccd90 con 0x7fae380b7c70 2023-07-14T13:29:34.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.008+0000 7fae377fe640 1 -- 172.21.15.5:0/2966768814 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1339709913 0 0) 0x7fae380ccaf0 con 0x7fae380d1850 2023-07-14T13:29:34.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.012+0000 7fae3c867640 1 --2- 172.21.15.5:0/2966768814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae380b7c70 0x7fae380d0c50 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fae2c009870 tx=0x7fae2c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16dcd8e49ed3f8a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:34.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.012+0000 7fae377fe640 1 -- 172.21.15.5:0/2966768814 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c0ab650 con 0x7fae380b7c70 2023-07-14T13:29:34.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.012+0000 7fae377fe640 1 -- 172.21.15.5:0/2966768814 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c0ab7b0 con 0x7fae380b7c70 2023-07-14T13:29:34.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.012+0000 7fae377fe640 1 -- 172.21.15.5:0/2966768814 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c0abb40 con 0x7fae380b7c70 2023-07-14T13:29:34.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.012+0000 7fae3eacb640 1 -- 172.21.15.5:0/2966768814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae380b7c70 msgr2=0x7fae380d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:34.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.012+0000 7fae3eacb640 1 --2- 172.21.15.5:0/2966768814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae380b7c70 0x7fae380d0c50 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fae2c009870 tx=0x7fae2c01c540 comp rx=0 tx=0).stop 2023-07-14T13:29:34.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.012+0000 7fae3eacb640 1 -- 172.21.15.5:0/2966768814 shutdown_connections 2023-07-14T13:29:34.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.012+0000 7fae3eacb640 1 --2- 172.21.15.5:0/2966768814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae380b7c70 0x7fae380d0c50 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:34.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.012+0000 7fae3eacb640 1 -- 172.21.15.5:0/2966768814 >> 172.21.15.5:0/2966768814 conn(0x7fae380650b0 msgr2=0x7fae380654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:34.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.012+0000 7fae3eacb640 1 -- 172.21.15.5:0/2966768814 shutdown_connections 2023-07-14T13:29:34.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.012+0000 7fae3eacb640 1 -- 172.21.15.5:0/2966768814 wait complete. 2023-07-14T13:29:34.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.016+0000 7fae3eacb640 1 Processor -- start 2023-07-14T13:29:34.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.016+0000 7fae3eacb640 1 -- start start 2023-07-14T13:29:34.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.016+0000 7fae3eacb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae380b7c70 0x7fae3814c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:34.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.016+0000 7fae3eacb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae380d1850 0x7fae380b2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:34.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.016+0000 7fae3eacb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae3815fd60 0x7fae380b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:34.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.016+0000 7fae3eacb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae380c7b50 con 0x7fae3815fd60 2023-07-14T13:29:34.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.016+0000 7fae3eacb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae380c76c0 con 0x7fae380b7c70 2023-07-14T13:29:34.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.016+0000 7fae3eacb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae380c6ab0 con 0x7fae380d1850 2023-07-14T13:29:34.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.016+0000 7fae3d068640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae3815fd60 0x7fae380b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:34.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.016+0000 7fae3d068640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae3815fd60 0x7fae380b2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50938/0 (socket says 172.21.15.5:50938) 2023-07-14T13:29:34.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.016+0000 7fae3d068640 1 -- 172.21.15.5:0/1150630400 learned_addr learned my addr 172.21.15.5:0/1150630400 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:34.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.016+0000 7fae3c867640 1 --2- 172.21.15.5:0/1150630400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae380b7c70 0x7fae3814c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:34.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.016+0000 7fae37fff640 1 --2- 172.21.15.5:0/1150630400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae380d1850 0x7fae380b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:34.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.016+0000 7fae3d068640 1 -- 172.21.15.5:0/1150630400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae380d1850 msgr2=0x7fae380b2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:34.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.016+0000 7fae3d068640 1 --2- 172.21.15.5:0/1150630400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae380d1850 0x7fae380b2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:34.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.016+0000 7fae3d068640 1 -- 172.21.15.5:0/1150630400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae380b7c70 msgr2=0x7fae3814c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:34.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.016+0000 7fae3d068640 1 --2- 172.21.15.5:0/1150630400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae380b7c70 0x7fae3814c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:34.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.016+0000 7fae3d068640 1 -- 172.21.15.5:0/1150630400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2c0094d0 con 0x7fae3815fd60 2023-07-14T13:29:34.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.016+0000 7fae3d068640 1 --2- 172.21.15.5:0/1150630400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae3815fd60 0x7fae380b2980 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fae3000c770 tx=0x7fae3000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:34.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.016+0000 7fae357fa640 1 -- 172.21.15.5:0/1150630400 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae30003b80 con 0x7fae3815fd60 2023-07-14T13:29:34.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.016+0000 7fae357fa640 1 -- 172.21.15.5:0/1150630400 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae30003ce0 con 0x7fae3815fd60 2023-07-14T13:29:34.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.016+0000 7fae357fa640 1 -- 172.21.15.5:0/1150630400 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3000aa90 con 0x7fae3815fd60 2023-07-14T13:29:34.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.016+0000 7fae3eacb640 1 -- 172.21.15.5:0/1150630400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae380c6d90 con 0x7fae3815fd60 2023-07-14T13:29:34.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.016+0000 7fae3eacb640 1 -- 172.21.15.5:0/1150630400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae380c7350 con 0x7fae3815fd60 2023-07-14T13:29:34.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.020+0000 7fae3eacb640 1 -- 172.21.15.5:0/1150630400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae380c7850 con 0x7fae3815fd60 2023-07-14T13:29:34.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.020+0000 7fae357fa640 1 -- 172.21.15.5:0/1150630400 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fae3000abf0 con 0x7fae3815fd60 2023-07-14T13:29:34.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.020+0000 7fae357fa640 1 --2- 172.21.15.5:0/1150630400 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fae1c0663a0 0x7fae1c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:34.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.020+0000 7fae357fa640 1 -- 172.21.15.5:0/1150630400 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6356+0+0 (secure 0 0 0) 0x7fae30083ea0 con 0x7fae3815fd60 2023-07-14T13:29:34.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.020+0000 7fae3c867640 1 --2- 172.21.15.5:0/1150630400 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fae1c0663a0 0x7fae1c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:34.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.020+0000 7fae3c867640 1 --2- 172.21.15.5:0/1150630400 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fae1c0663a0 0x7fae1c068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fae2c0af000 tx=0x7fae2c0a7000 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:34.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.024+0000 7fae357fa640 1 -- 172.21.15.5:0/1150630400 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fae30051040 con 0x7fae3815fd60 2023-07-14T13:29:34.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.208+0000 7fae3eacb640 1 -- 172.21.15.5:0/1150630400 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae380678d0 con 0x7fae3815fd60 2023-07-14T13:29:34.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.212+0000 7fae357fa640 1 -- 172.21.15.5:0/1150630400 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fae30054660 con 0x7fae3815fd60 2023-07-14T13:29:34.217 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:29:34.217 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":75,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3146480803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3146480803},{"type":"v1","addr":"172.21.15.154:6837","nonce":3146480803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8908,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2567208960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6833","nonce":2567208960},{"type":"v1","addr":"172.21.15.5:6835","nonce":2567208960}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8911,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3591700265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3591700265},{"type":"v1","addr":"172.21.15.154:6836","nonce":3591700265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":9879,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6834/1445304956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1445304956},{"type":"v1","addr":"172.21.15.5:6834","nonce":1445304956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[]} 2023-07-14T13:29:34.217 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 75 2023-07-14T13:29:34.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.212+0000 7fae3eacb640 1 -- 172.21.15.5:0/1150630400 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fae1c0663a0 msgr2=0x7fae1c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:34.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.212+0000 7fae3eacb640 1 --2- 172.21.15.5:0/1150630400 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fae1c0663a0 0x7fae1c068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fae2c0af000 tx=0x7fae2c0a7000 comp rx=0 tx=0).stop 2023-07-14T13:29:34.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.212+0000 7fae3eacb640 1 -- 172.21.15.5:0/1150630400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae3815fd60 msgr2=0x7fae380b2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:34.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.212+0000 7fae3eacb640 1 --2- 172.21.15.5:0/1150630400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae3815fd60 0x7fae380b2980 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fae3000c770 tx=0x7fae3000cc30 comp rx=0 tx=0).stop 2023-07-14T13:29:34.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.212+0000 7fae3eacb640 1 -- 172.21.15.5:0/1150630400 shutdown_connections 2023-07-14T13:29:34.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.212+0000 7fae3eacb640 1 --2- 172.21.15.5:0/1150630400 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fae1c0663a0 0x7fae1c068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:34.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.212+0000 7fae3eacb640 1 --2- 172.21.15.5:0/1150630400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae3815fd60 0x7fae380b2980 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:34.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.212+0000 7fae3eacb640 1 --2- 172.21.15.5:0/1150630400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae380d1850 0x7fae380b2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:34.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.212+0000 7fae3eacb640 1 --2- 172.21.15.5:0/1150630400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae380b7c70 0x7fae3814c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:34.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.212+0000 7fae3eacb640 1 -- 172.21.15.5:0/1150630400 >> 172.21.15.5:0/1150630400 conn(0x7fae380650b0 msgr2=0x7fae38065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:34.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.212+0000 7fae3eacb640 1 -- 172.21.15.5:0/1150630400 shutdown_connections 2023-07-14T13:29:34.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:34.212+0000 7fae3eacb640 1 -- 172.21.15.5:0/1150630400 wait complete. 2023-07-14T13:29:34.238 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-14T13:29:34.238 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-14T13:29:34.238 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-14T13:29:34.239 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:29:34.239 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-14T13:29:34.239 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-14T13:29:34.239 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-14T13:29:34.240 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:29:34.240 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-14T13:29:34.240 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-14T13:29:34.240 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-14T13:29:34.241 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:29:34.241 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-14T13:29:34.241 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-14T13:29:34.241 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-14T13:29:34.242 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:29:34.251 INFO:tasks.ceph.mds.c:Stopped 2023-07-14T13:29:34.251 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-14T13:29:34.256 INFO:tasks.ceph.mds.b:Stopped 2023-07-14T13:29:34.257 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-14T13:29:34.299 INFO:tasks.ceph.mds.c:Started 2023-07-14T13:29:34.299 DEBUG:teuthology.parallel:result is None 2023-07-14T13:29:34.303 INFO:tasks.ceph.mds.b:Started 2023-07-14T13:29:34.304 DEBUG:teuthology.parallel:result is None 2023-07-14T13:29:34.386 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-07-14T13:29:34.393 INFO:tasks.ceph.mds.b.smithi154.stdout:starting mds.b at 2023-07-14T13:29:34.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-07-14T13:29:34.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-07-14T13:29:40.251 INFO:tasks.ceph.mds.a:Stopped 2023-07-14T13:29:40.252 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-14T13:29:40.256 INFO:tasks.ceph.mds.d:Stopped 2023-07-14T13:29:40.257 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-14T13:29:40.258 INFO:tasks.ceph.mds.a:Started 2023-07-14T13:29:40.259 DEBUG:teuthology.parallel:result is None 2023-07-14T13:29:40.262 INFO:tasks.ceph.mds.d:Started 2023-07-14T13:29:40.263 DEBUG:teuthology.parallel:result is None 2023-07-14T13:29:40.263 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-14T13:29:40.355 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-07-14T13:29:40.355 INFO:tasks.ceph.mds.d.smithi154.stdout:starting mds.d at 2023-07-14T13:29:40.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.411+0000 7f118367b640 1 Processor -- start 2023-07-14T13:29:40.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.415+0000 7f118367b640 1 -- start start 2023-07-14T13:29:40.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.415+0000 7f118367b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f117c070b70 0x7f117c070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:40.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.415+0000 7f118367b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f117c0cb100 0x7f117c0cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:40.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.415+0000 7f118367b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f117c0cac70 con 0x7f117c06b1e0 2023-07-14T13:29:40.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.415+0000 7f118367b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f117c0cba60 con 0x7f117c070b70 2023-07-14T13:29:40.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.415+0000 7f118367b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f117c071480 con 0x7f117c0cb100 2023-07-14T13:29:40.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.415+0000 7f1180c16640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f117c06b1e0 0x7f117c0c1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43070/0 (socket says 172.21.15.5:43070) 2023-07-14T13:29:40.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.415+0000 7f1180c16640 1 -- 172.21.15.5:0/1651319265 learned_addr learned my addr 172.21.15.5:0/1651319265 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:40.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.415+0000 7f1181417640 1 --2- 172.21.15.5:0/1651319265 >> v2:172.21.15.5:3300/0 conn(0x7f117c070b70 0x7f117c070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:40.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.415+0000 7f1181c18640 1 --2- 172.21.15.5:0/1651319265 >> v2:172.21.15.154:3300/0 conn(0x7f117c0cb100 0x7f117c0cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:40.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.415+0000 7f1181417640 1 -- 172.21.15.5:0/1651319265 >> v2:172.21.15.154:3300/0 conn(0x7f117c0cb100 msgr2=0x7f117c0cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:40.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.415+0000 7f1181417640 1 --2- 172.21.15.5:0/1651319265 >> v2:172.21.15.154:3300/0 conn(0x7f117c0cb100 0x7f117c0cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:40.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.415+0000 7f1181417640 1 -- 172.21.15.5:0/1651319265 >> v1:172.21.15.5:6789/0 conn(0x7f117c06b1e0 legacy=0x7f117c0c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:40.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.415+0000 7f1181417640 1 -- 172.21.15.5:0/1651319265 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117c0ca060 con 0x7f117c070b70 2023-07-14T13:29:40.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.415+0000 7f1173fff640 1 -- 172.21.15.5:0/1651319265 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 951358257 0 0) 0x7f117c0cac70 con 0x7f117c06b1e0 2023-07-14T13:29:40.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.419+0000 7f1181417640 1 --2- 172.21.15.5:0/1651319265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f117c070b70 0x7f117c070f40 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f117c0c19c0 tx=0x7f117801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1c54577f5a7c76 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.419+0000 7f1173fff640 1 -- 172.21.15.5:0/1651319265 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11780a7070 con 0x7f117c070b70 2023-07-14T13:29:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.419+0000 7f1173fff640 1 -- 172.21.15.5:0/1651319265 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11780ab430 con 0x7f117c070b70 2023-07-14T13:29:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.419+0000 7f1173fff640 1 -- 172.21.15.5:0/1651319265 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11780ab7c0 con 0x7f117c070b70 2023-07-14T13:29:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.419+0000 7f118367b640 1 -- 172.21.15.5:0/1651319265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f117c070b70 msgr2=0x7f117c070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.419+0000 7f118367b640 1 --2- 172.21.15.5:0/1651319265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f117c070b70 0x7f117c070f40 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f117c0c19c0 tx=0x7f117801c430 comp rx=0 tx=0).stop 2023-07-14T13:29:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.419+0000 7f118367b640 1 -- 172.21.15.5:0/1651319265 shutdown_connections 2023-07-14T13:29:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.419+0000 7f118367b640 1 --2- 172.21.15.5:0/1651319265 >> v2:172.21.15.154:3300/0 conn(0x7f117c0cb100 0x7f117c0cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.419+0000 7f118367b640 1 --2- 172.21.15.5:0/1651319265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f117c070b70 0x7f117c070f40 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.419+0000 7f118367b640 1 -- 172.21.15.5:0/1651319265 >> 172.21.15.5:0/1651319265 conn(0x7f117c0afcf0 msgr2=0x7f117c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.419+0000 7f118367b640 1 -- 172.21.15.5:0/1651319265 shutdown_connections 2023-07-14T13:29:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.419+0000 7f118367b640 1 -- 172.21.15.5:0/1651319265 wait complete. 2023-07-14T13:29:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.419+0000 7f118367b640 1 Processor -- start 2023-07-14T13:29:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.423+0000 7f118367b640 1 -- start start 2023-07-14T13:29:40.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.423+0000 7f118367b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f117c06b1e0 0x7f117c0c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:40.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.423+0000 7f118367b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f117c070b70 0x7f117c153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:40.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.423+0000 7f118367b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f117c0cb100 0x7f117c0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:40.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.423+0000 7f118367b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117c0c9130 con 0x7f117c0cb100 2023-07-14T13:29:40.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.423+0000 7f118367b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117c0c8890 con 0x7f117c070b70 2023-07-14T13:29:40.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.423+0000 7f118367b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117c0c8b70 con 0x7f117c06b1e0 2023-07-14T13:29:40.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.423+0000 7f1181c18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f117c0cb100 0x7f117c0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:40.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.423+0000 7f1181c18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f117c0cb100 0x7f117c0c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48834/0 (socket says 172.21.15.5:48834) 2023-07-14T13:29:40.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.423+0000 7f1181c18640 1 -- 172.21.15.5:0/4172798298 learned_addr learned my addr 172.21.15.5:0/4172798298 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:40.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.423+0000 7f1180c16640 1 --2- 172.21.15.5:0/4172798298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f117c070b70 0x7f117c153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:40.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.423+0000 7f1181417640 1 --2- 172.21.15.5:0/4172798298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f117c06b1e0 0x7f117c0c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:40.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.423+0000 7f1181c18640 1 -- 172.21.15.5:0/4172798298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f117c06b1e0 msgr2=0x7f117c0c82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:40.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.423+0000 7f1181c18640 1 --2- 172.21.15.5:0/4172798298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f117c06b1e0 0x7f117c0c82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:40.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.423+0000 7f1181c18640 1 -- 172.21.15.5:0/4172798298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f117c070b70 msgr2=0x7f117c153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:40.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.423+0000 7f1181c18640 1 --2- 172.21.15.5:0/4172798298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f117c070b70 0x7f117c153060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:40.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.423+0000 7f1181c18640 1 -- 172.21.15.5:0/4172798298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1178009420 con 0x7f117c0cb100 2023-07-14T13:29:40.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.423+0000 7f1181c18640 1 --2- 172.21.15.5:0/4172798298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f117c0cb100 0x7f117c0c5c60 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f1174007e60 tx=0x7f117400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:40.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.423+0000 7f1171ffb640 1 -- 172.21.15.5:0/4172798298 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1174014420 con 0x7f117c0cb100 2023-07-14T13:29:40.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.423+0000 7f1171ffb640 1 -- 172.21.15.5:0/4172798298 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11740145a0 con 0x7f117c0cb100 2023-07-14T13:29:40.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.423+0000 7f1171ffb640 1 -- 172.21.15.5:0/4172798298 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1174014950 con 0x7f117c0cb100 2023-07-14T13:29:40.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.423+0000 7f118367b640 1 -- 172.21.15.5:0/4172798298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f117c0c8e50 con 0x7f117c0cb100 2023-07-14T13:29:40.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.423+0000 7f118367b640 1 -- 172.21.15.5:0/4172798298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f117c1535a0 con 0x7f117c0cb100 2023-07-14T13:29:40.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.423+0000 7f118367b640 1 -- 172.21.15.5:0/4172798298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f117c0cbd30 con 0x7f117c0cb100 2023-07-14T13:29:40.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.427+0000 7f1171ffb640 1 -- 172.21.15.5:0/4172798298 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1174014ab0 con 0x7f117c0cb100 2023-07-14T13:29:40.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.427+0000 7f1171ffb640 1 --2- 172.21.15.5:0/4172798298 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f11600663a0 0x7f1160068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:40.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.427+0000 7f1171ffb640 1 -- 172.21.15.5:0/4172798298 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6356+0+0 (secure 0 0 0) 0x7f11740847a0 con 0x7f117c0cb100 2023-07-14T13:29:40.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.427+0000 7f1181417640 1 --2- 172.21.15.5:0/4172798298 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f11600663a0 0x7f1160068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:40.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.427+0000 7f1181417640 1 --2- 172.21.15.5:0/4172798298 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f11600663a0 0x7f1160068850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f11780af000 tx=0x7f11780a7000 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:40.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.431+0000 7f1171ffb640 1 -- 172.21.15.5:0/4172798298 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f117c0cbd30 con 0x7f117c0cb100 2023-07-14T13:29:40.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:40.595+0000 7f118367b640 1 -- 172.21.15.5:0/4172798298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f117c0cbd30 con 0x7f117c0cb100 2023-07-14T13:29:41.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.123+0000 7f1171ffb640 1 -- 172.21.15.5:0/4172798298 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v168) v1 ==== 97+0+0 (secure 0 0 0) 0x7f117c0cbd30 con 0x7f117c0cb100 2023-07-14T13:29:41.132 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2023-07-14T13:29:41.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.127+0000 7f118367b640 1 -- 172.21.15.5:0/4172798298 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f11600663a0 msgr2=0x7f1160068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:41.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.127+0000 7f118367b640 1 --2- 172.21.15.5:0/4172798298 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f11600663a0 0x7f1160068850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f11780af000 tx=0x7f11780a7000 comp rx=0 tx=0).stop 2023-07-14T13:29:41.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.127+0000 7f118367b640 1 -- 172.21.15.5:0/4172798298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f117c0cb100 msgr2=0x7f117c0c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:41.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.127+0000 7f118367b640 1 --2- 172.21.15.5:0/4172798298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f117c0cb100 0x7f117c0c5c60 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f1174007e60 tx=0x7f117400e4b0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.127+0000 7f118367b640 1 -- 172.21.15.5:0/4172798298 shutdown_connections 2023-07-14T13:29:41.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.127+0000 7f118367b640 1 --2- 172.21.15.5:0/4172798298 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f11600663a0 0x7f1160068850 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.127+0000 7f118367b640 1 --2- 172.21.15.5:0/4172798298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f117c0cb100 0x7f117c0c5c60 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.127+0000 7f118367b640 1 --2- 172.21.15.5:0/4172798298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f117c070b70 0x7f117c153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.127+0000 7f118367b640 1 --2- 172.21.15.5:0/4172798298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f117c06b1e0 0x7f117c0c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.127+0000 7f118367b640 1 -- 172.21.15.5:0/4172798298 >> 172.21.15.5:0/4172798298 conn(0x7f117c0afcf0 msgr2=0x7f117c0c1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:41.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.127+0000 7f118367b640 1 -- 172.21.15.5:0/4172798298 shutdown_connections 2023-07-14T13:29:41.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.127+0000 7f118367b640 1 -- 172.21.15.5:0/4172798298 wait complete. 2023-07-14T13:29:41.157 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-14T13:29:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.299+0000 7fb8a6f00640 1 Processor -- start 2023-07-14T13:29:41.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.299+0000 7fb8a6f00640 1 -- start start 2023-07-14T13:29:41.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.299+0000 7fb8a6f00640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb8a015f500 0x7fb8a006cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:41.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.299+0000 7fb8a6f00640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8a006d430 0x7fb8a006a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:41.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.299+0000 7fb8a6f00640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb8a006aa80 0x7fb8a00b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:41.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.299+0000 7fb8a6f00640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a006af20 con 0x7fb8a006aa80 2023-07-14T13:29:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.299+0000 7fb8a6f00640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a00cdc80 con 0x7fb8a015f500 2023-07-14T13:29:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.299+0000 7fb8a6f00640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a006e4c0 con 0x7fb8a006d430 2023-07-14T13:29:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.299+0000 7fb8a549d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb8a006aa80 0x7fb8a00b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.299+0000 7fb8a549d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb8a006aa80 0x7fb8a00b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48842/0 (socket says 172.21.15.5:48842) 2023-07-14T13:29:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.299+0000 7fb8a549d640 1 -- 172.21.15.5:0/526408302 learned_addr learned my addr 172.21.15.5:0/526408302 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.299+0000 7fb89ffff640 1 --2- 172.21.15.5:0/526408302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8a006d430 0x7fb8a006a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.299+0000 7fb8a4c9c640 1 --2- 172.21.15.5:0/526408302 >> v2:172.21.15.154:3300/0 conn(0x7fb8a015f500 0x7fb8a006cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.299+0000 7fb8a549d640 1 -- 172.21.15.5:0/526408302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8a006d430 msgr2=0x7fb8a006a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.299+0000 7fb8a549d640 1 --2- 172.21.15.5:0/526408302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8a006d430 0x7fb8a006a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.299+0000 7fb8a549d640 1 -- 172.21.15.5:0/526408302 >> v2:172.21.15.154:3300/0 conn(0x7fb8a015f500 msgr2=0x7fb8a006cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.299+0000 7fb8a549d640 1 --2- 172.21.15.5:0/526408302 >> v2:172.21.15.154:3300/0 conn(0x7fb8a015f500 0x7fb8a006cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.299+0000 7fb8a549d640 1 -- 172.21.15.5:0/526408302 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a006d940 con 0x7fb8a006aa80 2023-07-14T13:29:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.303+0000 7fb8a549d640 1 --2- 172.21.15.5:0/526408302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a006aa80 0x7fb8a00b1bc0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00b2c40 tx=0x7fb89801c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac1ca2fa67dcea2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:41.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.303+0000 7fb89f7fe640 1 -- 172.21.15.5:0/526408302 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8980a6490 con 0x7fb8a006aa80 2023-07-14T13:29:41.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.303+0000 7fb89f7fe640 1 -- 172.21.15.5:0/526408302 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8980a65f0 con 0x7fb8a006aa80 2023-07-14T13:29:41.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.303+0000 7fb89f7fe640 1 -- 172.21.15.5:0/526408302 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8980a6980 con 0x7fb8a006aa80 2023-07-14T13:29:41.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.303+0000 7fb8a6f00640 1 -- 172.21.15.5:0/526408302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a006aa80 msgr2=0x7fb8a00b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:41.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.303+0000 7fb8a6f00640 1 --2- 172.21.15.5:0/526408302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a006aa80 0x7fb8a00b1bc0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00b2c40 tx=0x7fb89801c710 comp rx=0 tx=0).stop 2023-07-14T13:29:41.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.303+0000 7fb8a6f00640 1 -- 172.21.15.5:0/526408302 shutdown_connections 2023-07-14T13:29:41.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.303+0000 7fb8a6f00640 1 --2- 172.21.15.5:0/526408302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a006aa80 0x7fb8a00b1bc0 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.303+0000 7fb8a6f00640 1 --2- 172.21.15.5:0/526408302 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8a006d430 0x7fb8a006a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.303+0000 7fb8a6f00640 1 --2- 172.21.15.5:0/526408302 >> v2:172.21.15.154:3300/0 conn(0x7fb8a015f500 0x7fb8a006cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.303+0000 7fb8a6f00640 1 -- 172.21.15.5:0/526408302 >> 172.21.15.5:0/526408302 conn(0x7fb8a00659d0 msgr2=0x7fb8a0099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:41.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.303+0000 7fb8a6f00640 1 -- 172.21.15.5:0/526408302 shutdown_connections 2023-07-14T13:29:41.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.303+0000 7fb8a6f00640 1 -- 172.21.15.5:0/526408302 wait complete. 2023-07-14T13:29:41.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.307+0000 7fb8a6f00640 1 Processor -- start 2023-07-14T13:29:41.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.307+0000 7fb8a6f00640 1 -- start start 2023-07-14T13:29:41.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.307+0000 7fb8a6f00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8a006aa80 0x7fb8a01665e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:41.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.307+0000 7fb8a6f00640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8a006d430 0x7fb8a00b4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:41.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.307+0000 7fb8a6f00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a015f500 0x7fb8a014cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:41.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.307+0000 7fb8a6f00640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a00b4fa0 con 0x7fb8a015f500 2023-07-14T13:29:41.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.307+0000 7fb8a6f00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a0166b20 con 0x7fb8a006aa80 2023-07-14T13:29:41.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.307+0000 7fb8a6f00640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a00cb730 con 0x7fb8a006d430 2023-07-14T13:29:41.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.307+0000 7fb8a549d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a015f500 0x7fb8a014cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:41.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.307+0000 7fb8a549d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a015f500 0x7fb8a014cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48844/0 (socket says 172.21.15.5:48844) 2023-07-14T13:29:41.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.307+0000 7fb8a549d640 1 -- 172.21.15.5:0/2325289142 learned_addr learned my addr 172.21.15.5:0/2325289142 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:41.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.307+0000 7fb89ffff640 1 --2- 172.21.15.5:0/2325289142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8a006d430 0x7fb8a00b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:41.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.307+0000 7fb8a4c9c640 1 --2- 172.21.15.5:0/2325289142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8a006aa80 0x7fb8a01665e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:41.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.307+0000 7fb8a549d640 1 -- 172.21.15.5:0/2325289142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8a006d430 msgr2=0x7fb8a00b4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:41.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.307+0000 7fb8a549d640 1 --2- 172.21.15.5:0/2325289142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8a006d430 0x7fb8a00b4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.307+0000 7fb8a549d640 1 -- 172.21.15.5:0/2325289142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8a006aa80 msgr2=0x7fb8a01665e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:41.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.307+0000 7fb8a549d640 1 --2- 172.21.15.5:0/2325289142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8a006aa80 0x7fb8a01665e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.307+0000 7fb8a549d640 1 -- 172.21.15.5:0/2325289142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb898009b30 con 0x7fb8a015f500 2023-07-14T13:29:41.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.307+0000 7fb8a549d640 1 --2- 172.21.15.5:0/2325289142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a015f500 0x7fb8a014cee0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fb89801cfb0 tx=0x7fb8980194b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:41.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.307+0000 7fb89d7fa640 1 -- 172.21.15.5:0/2325289142 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8980a6490 con 0x7fb8a015f500 2023-07-14T13:29:41.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.307+0000 7fb89d7fa640 1 -- 172.21.15.5:0/2325289142 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8980a7670 con 0x7fb8a015f500 2023-07-14T13:29:41.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.307+0000 7fb8a6f00640 1 -- 172.21.15.5:0/2325289142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a00cba10 con 0x7fb8a015f500 2023-07-14T13:29:41.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.307+0000 7fb89d7fa640 1 -- 172.21.15.5:0/2325289142 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8980a7a00 con 0x7fb8a015f500 2023-07-14T13:29:41.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.307+0000 7fb8a6f00640 1 -- 172.21.15.5:0/2325289142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a00b4c30 con 0x7fb8a015f500 2023-07-14T13:29:41.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.311+0000 7fb8a6f00640 1 -- 172.21.15.5:0/2325289142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a00b5110 con 0x7fb8a015f500 2023-07-14T13:29:41.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.311+0000 7fb89d7fa640 1 -- 172.21.15.5:0/2325289142 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb8980a7b60 con 0x7fb8a015f500 2023-07-14T13:29:41.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.311+0000 7fb89d7fa640 1 --2- 172.21.15.5:0/2325289142 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fb8840663a0 0x7fb884068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:41.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.311+0000 7fb89d7fa640 1 -- 172.21.15.5:0/2325289142 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5238+0+0 (secure 0 0 0) 0x7fb89811e5f0 con 0x7fb8a015f500 2023-07-14T13:29:41.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.311+0000 7fb8a4c9c640 1 --2- 172.21.15.5:0/2325289142 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fb8840663a0 0x7fb884068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:41.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.315+0000 7fb8a4c9c640 1 --2- 172.21.15.5:0/2325289142 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fb8840663a0 0x7fb884068850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb894009a30 tx=0x7fb894008040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:41.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.315+0000 7fb89d7fa640 1 -- 172.21.15.5:0/2325289142 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb8980ebb80 con 0x7fb8a015f500 2023-07-14T13:29:41.419 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-07-14T13:29:41.420 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-07-14T13:29:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.523+0000 7fb8a6f00640 1 -- 172.21.15.5:0/2325289142 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb8a00678d0 con 0x7fb8a015f500 2023-07-14T13:29:41.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.523+0000 7fb89d7fa640 1 -- 172.21.15.5:0/2325289142 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v28) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb898009510 con 0x7fb8a015f500 2023-07-14T13:29:41.531 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:29:41.531 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T13:29:41.531 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2023-07-14T13:29:41.531 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:29:41.531 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2023-07-14T13:29:41.531 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkGNTsMRAA5T/zjdynxEKmoNAAK0cChw==", 2023-07-14T13:29:41.531 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:29:41.532 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:29:41.532 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:29:41.532 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:29:41.532 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:29:41.532 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:29:41.532 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:29:41.533 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:29:41.533 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2023-07-14T13:29:41.533 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkqXNAAxAAb7bzXyE8cSS0A3Rz2de6TA==", 2023-07-14T13:29:41.533 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:29:41.533 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:29:41.534 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:29:41.534 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:29:41.534 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:29:41.534 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:29:41.534 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:29:41.534 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:29:41.534 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2023-07-14T13:29:41.535 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFk6NGUORAA+5odxrAlCCXYGc64nzFWwQ==", 2023-07-14T13:29:41.535 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:29:41.535 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:29:41.535 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:29:41.535 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:29:41.535 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:29:41.535 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:29:41.536 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:29:41.536 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:29:41.536 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2023-07-14T13:29:41.537 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkGh/BChAA5p9amLIC6ORC0JJov0bSVg==", 2023-07-14T13:29:41.537 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:29:41.537 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:29:41.537 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:29:41.537 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:29:41.537 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:29:41.537 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:29:41.538 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:29:41.538 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:29:41.538 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2023-07-14T13:29:41.538 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDlRLFkJ6MULhAAxExAqekc/gWudYBJ2sY4MQ==", 2023-07-14T13:29:41.538 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:29:41.538 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:29:41.538 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:29:41.539 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:29:41.539 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:29:41.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:29:41.539 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:29:41.539 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2023-07-14T13:29:41.540 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDoRLFksXGBNRAAFtHZt5OQw0aB6k3CkxOzZQ==", 2023-07-14T13:29:41.540 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:29:41.540 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:29:41.540 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:29:41.540 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:29:41.540 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:29:41.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:29:41.541 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:29:41.541 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2023-07-14T13:29:41.541 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDsRLFkaUH0ARAAkqgsKPX1dTSZQjn0cRxxRQ==", 2023-07-14T13:29:41.541 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:29:41.541 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:29:41.541 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:29:41.542 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:29:41.542 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:29:41.542 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:29:41.542 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:29:41.542 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2023-07-14T13:29:41.542 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDvRLFkvElJCRAAnox5LKwobP/1Qaf5d9UsjA==", 2023-07-14T13:29:41.542 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:29:41.543 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:29:41.543 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:29:41.543 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:29:41.543 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:29:41.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:29:41.543 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:29:41.543 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2023-07-14T13:29:41.544 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD1RLFkMNyyDxAA19dJkhhuSpcgVPQEyxb3lg==", 2023-07-14T13:29:41.544 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:29:41.544 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:29:41.544 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:29:41.544 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:29:41.544 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:29:41.544 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:29:41.545 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:29:41.545 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2023-07-14T13:29:41.545 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD4RLFkR8mTFhAAP5qUgUJI23XOvVAnNCSgRQ==", 2023-07-14T13:29:41.545 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:29:41.545 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:29:41.545 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:29:41.545 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:29:41.546 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:29:41.546 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:29:41.546 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:29:41.546 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2023-07-14T13:29:41.547 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD7RLFkpWL9HBAAo8MfszRnB4sHsDPPcRjCAg==", 2023-07-14T13:29:41.547 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:29:41.547 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:29:41.547 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:29:41.547 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:29:41.548 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:29:41.548 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:29:41.548 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:29:41.548 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2023-07-14T13:29:41.548 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD+RLFkL5cRIxAAF/4ndtYf0oiH3uhhDKnQQg==", 2023-07-14T13:29:41.548 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:29:41.548 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:29:41.549 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:29:41.549 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:29:41.549 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:29:41.549 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:29:41.549 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:29:41.549 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2023-07-14T13:29:41.549 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkCav/DhAA6SOiONAbTcWCnUZXcm7BcQ==", 2023-07-14T13:29:41.550 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:29:41.550 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:29:41.550 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2023-07-14T13:29:41.550 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-14T13:29:41.550 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:29:41.550 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:29:41.550 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:29:41.551 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2023-07-14T13:29:41.551 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkgS/hGBAAevMD2/lfNuaeV74w0Xj0Zw==", 2023-07-14T13:29:41.551 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:29:41.551 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:29:41.551 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T13:29:41.551 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T13:29:41.551 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T13:29:41.552 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:29:41.552 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:29:41.552 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:29:41.552 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2023-07-14T13:29:41.552 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkeBs4FRAAJ/UjIEKDajVyDb7PejPqAw==", 2023-07-14T13:29:41.552 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:29:41.552 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:29:41.553 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T13:29:41.553 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T13:29:41.553 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T13:29:41.553 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:29:41.553 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:29:41.553 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:29:41.553 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2023-07-14T13:29:41.554 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkSkDiHhAAV86wIrAVz3o/PI2CaBC44w==", 2023-07-14T13:29:41.554 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:29:41.554 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:29:41.554 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T13:29:41.554 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T13:29:41.555 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T13:29:41.555 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:29:41.555 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:29:41.555 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:29:41.555 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2023-07-14T13:29:41.555 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkk5IcFRAAThI0P1N8LsRetmwhHqSvdQ==", 2023-07-14T13:29:41.555 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:29:41.556 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T13:29:41.556 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:29:41.556 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:29:41.556 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:29:41.556 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:29:41.556 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:29:41.556 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:29:41.557 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2023-07-14T13:29:41.557 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkugeXLRAAEVAnLk/dldtqrpkdzQI3SA==", 2023-07-14T13:29:41.557 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:29:41.557 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T13:29:41.557 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-07-14T13:29:41.557 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:29:41.557 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:29:41.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:29:41.558 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:29:41.558 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2023-07-14T13:29:41.558 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkSvp/KRAAwvjYlrZYNeGbhCiDrTmnrA==", 2023-07-14T13:29:41.558 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:29:41.558 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T13:29:41.558 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-07-14T13:29:41.559 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:29:41.559 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:29:41.559 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:29:41.559 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-07-14T13:29:41.559 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T13:29:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.527+0000 7fb8a6f00640 1 -- 172.21.15.5:0/2325289142 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fb8840663a0 msgr2=0x7fb884068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.527+0000 7fb8a6f00640 1 --2- 172.21.15.5:0/2325289142 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fb8840663a0 0x7fb884068850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb894009a30 tx=0x7fb894008040 comp rx=0 tx=0).stop 2023-07-14T13:29:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.527+0000 7fb8a6f00640 1 -- 172.21.15.5:0/2325289142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a015f500 msgr2=0x7fb8a014cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.527+0000 7fb8a6f00640 1 --2- 172.21.15.5:0/2325289142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a015f500 0x7fb8a014cee0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fb89801cfb0 tx=0x7fb8980194b0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.527+0000 7fb8a6f00640 1 -- 172.21.15.5:0/2325289142 shutdown_connections 2023-07-14T13:29:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.527+0000 7fb8a6f00640 1 --2- 172.21.15.5:0/2325289142 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fb8840663a0 0x7fb884068850 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.527+0000 7fb8a6f00640 1 --2- 172.21.15.5:0/2325289142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a015f500 0x7fb8a014cee0 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.527+0000 7fb8a6f00640 1 --2- 172.21.15.5:0/2325289142 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8a006d430 0x7fb8a00b4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.527+0000 7fb8a6f00640 1 --2- 172.21.15.5:0/2325289142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8a006aa80 0x7fb8a01665e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.527+0000 7fb8a6f00640 1 -- 172.21.15.5:0/2325289142 >> 172.21.15.5:0/2325289142 conn(0x7fb8a00659d0 msgr2=0x7fb8a015bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.527+0000 7fb8a6f00640 1 -- 172.21.15.5:0/2325289142 shutdown_connections 2023-07-14T13:29:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.527+0000 7fb8a6f00640 1 -- 172.21.15.5:0/2325289142 wait complete. 2023-07-14T13:29:41.563 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:29:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.699+0000 7f2cbaa96640 1 Processor -- start 2023-07-14T13:29:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.699+0000 7f2cbaa96640 1 -- start start 2023-07-14T13:29:41.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cbaa96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cb40c9730 0x7f2cb41638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:41.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cbaa96640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb40cc700 con 0x7f2cb40c8ad0 2023-07-14T13:29:41.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cbaa96640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb40b0ff0 con 0x7f2cb4158ce0 2023-07-14T13:29:41.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cbaa96640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb4070c80 con 0x7f2cb40c9730 2023-07-14T13:29:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cb3fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2cb40c8ad0 0x7f2cb40c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43072/0 (socket says 172.21.15.5:43072) 2023-07-14T13:29:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cb3fff640 1 -- 172.21.15.5:0/3526967089 learned_addr learned my addr 172.21.15.5:0/3526967089 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cb9033640 1 --2- 172.21.15.5:0/3526967089 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cb40c9730 0x7f2cb41638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cb37fe640 1 -- 172.21.15.5:0/3526967089 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 685614578 0 0) 0x7f2cb40cc700 con 0x7f2cb40c8ad0 2023-07-14T13:29:41.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cb37fe640 1 -- 172.21.15.5:0/3526967089 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ca4003530 con 0x7f2cb40c8ad0 2023-07-14T13:29:41.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cb37fe640 1 -- 172.21.15.5:0/3526967089 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 348012305 0 0) 0x7f2ca4003530 con 0x7f2cb40c8ad0 2023-07-14T13:29:41.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cb37fe640 1 -- 172.21.15.5:0/3526967089 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cb40c9730 msgr2=0x7f2cb41638b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:41.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cb37fe640 1 --2- 172.21.15.5:0/3526967089 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cb40c9730 0x7f2cb41638b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cb37fe640 1 -- 172.21.15.5:0/3526967089 >> v1:172.21.15.154:6789/0 conn(0x7f2cb4158ce0 legacy=0x7f2cb4070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:41.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cb37fe640 1 -- 172.21.15.5:0/3526967089 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb40cbdd0 con 0x7f2cb40c8ad0 2023-07-14T13:29:41.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cb37fe640 1 -- 172.21.15.5:0/3526967089 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f2ca0001680 con 0x7f2cb40c8ad0 2023-07-14T13:29:41.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cb37fe640 1 -- 172.21.15.5:0/3526967089 >> v1:172.21.15.5:6789/0 conn(0x7f2cb40c8ad0 legacy=0x7f2cb40c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:41.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cb37fe640 1 --2- 172.21.15.5:0/3526967089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ca40039b0 0x7f2ca4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:41.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cb37fe640 1 --2- 172.21.15.5:0/3526967089 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cb40c9730 0x7f2ca40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:41.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cb37fe640 1 --2- 172.21.15.5:0/3526967089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ca4004d10 0x7f2ca4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:41.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cb37fe640 1 -- 172.21.15.5:0/3526967089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb4070c80 con 0x7f2ca40039b0 2023-07-14T13:29:41.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cb37fe640 1 -- 172.21.15.5:0/3526967089 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca400bad0 con 0x7f2ca4004d10 2023-07-14T13:29:41.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cb37fe640 1 -- 172.21.15.5:0/3526967089 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca400dea0 con 0x7f2cb40c9730 2023-07-14T13:29:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cb8832640 1 --2- 172.21.15.5:0/3526967089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ca40039b0 0x7f2ca4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cb3fff640 1 --2- 172.21.15.5:0/3526967089 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cb40c9730 0x7f2ca40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cb9033640 1 --2- 172.21.15.5:0/3526967089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ca4004d10 0x7f2ca4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cb8832640 1 -- 172.21.15.5:0/3526967089 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cb40c9730 msgr2=0x7f2ca40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cb8832640 1 --2- 172.21.15.5:0/3526967089 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cb40c9730 0x7f2ca40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cb8832640 1 -- 172.21.15.5:0/3526967089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ca4004d10 msgr2=0x7f2ca4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cb8832640 1 --2- 172.21.15.5:0/3526967089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ca4004d10 0x7f2ca4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.703+0000 7f2cb8832640 1 -- 172.21.15.5:0/3526967089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca4003530 con 0x7f2ca40039b0 2023-07-14T13:29:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.707+0000 7f2cb8832640 1 --2- 172.21.15.5:0/3526967089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ca40039b0 0x7f2ca4003d80 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8001860 tx=0x7f2ca801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446e8e23dab28d8d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:41.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.707+0000 7f2cb37fe640 1 -- 172.21.15.5:0/3526967089 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca80ab600 con 0x7f2ca40039b0 2023-07-14T13:29:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.707+0000 7f2cb37fe640 1 -- 172.21.15.5:0/3526967089 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca80a7050 con 0x7f2ca40039b0 2023-07-14T13:29:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.707+0000 7f2cb37fe640 1 -- 172.21.15.5:0/3526967089 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca80ab9a0 con 0x7f2ca40039b0 2023-07-14T13:29:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.707+0000 7f2cbaa96640 1 -- 172.21.15.5:0/3526967089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ca40039b0 msgr2=0x7f2ca4003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.707+0000 7f2cbaa96640 1 --2- 172.21.15.5:0/3526967089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ca40039b0 0x7f2ca4003d80 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8001860 tx=0x7f2ca801c4d0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.707+0000 7f2cb9033640 1 -- 172.21.15.5:0/3526967089 reap_dead start 2023-07-14T13:29:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.707+0000 7f2cbaa96640 1 -- 172.21.15.5:0/3526967089 shutdown_connections 2023-07-14T13:29:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.707+0000 7f2cbaa96640 1 -- 172.21.15.5:0/3526967089 >> 172.21.15.5:0/3526967089 conn(0x7f2cb40afcf0 msgr2=0x7f2cb40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.707+0000 7f2cbaa96640 1 -- 172.21.15.5:0/3526967089 shutdown_connections 2023-07-14T13:29:41.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.707+0000 7f2cbaa96640 1 -- 172.21.15.5:0/3526967089 wait complete. 2023-07-14T13:29:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.707+0000 7f2cbaa96640 1 Processor -- start 2023-07-14T13:29:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.707+0000 7f2cbaa96640 1 -- start start 2023-07-14T13:29:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.711+0000 7f2cbaa96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ca40039b0 0x7f2cb414d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.711+0000 7f2cbaa96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cb40b24c0 0x7f2cb40c35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:41.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.711+0000 7f2cbaa96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cb40ce700 0x7f2cb40ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.711+0000 7f2cbaa96640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb40cf0c0 con 0x7f2cb40ce700 2023-07-14T13:29:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.711+0000 7f2cbaa96640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb40b2950 con 0x7f2cb40b24c0 2023-07-14T13:29:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.711+0000 7f2cbaa96640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb40b2c30 con 0x7f2ca40039b0 2023-07-14T13:29:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.711+0000 7f2cb9033640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cb40ce700 0x7f2cb40ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.711+0000 7f2cb9033640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cb40ce700 0x7f2cb40ceb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48868/0 (socket says 172.21.15.5:48868) 2023-07-14T13:29:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.711+0000 7f2cb9033640 1 -- 172.21.15.5:0/689435891 learned_addr learned my addr 172.21.15.5:0/689435891 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.711+0000 7f2cb8832640 1 --2- 172.21.15.5:0/689435891 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ca40039b0 0x7f2cb414d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.711+0000 7f2cb3fff640 1 --2- 172.21.15.5:0/689435891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cb40b24c0 0x7f2cb40c35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.711+0000 7f2cb9033640 1 -- 172.21.15.5:0/689435891 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ca40039b0 msgr2=0x7f2cb414d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.711+0000 7f2cb9033640 1 --2- 172.21.15.5:0/689435891 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ca40039b0 0x7f2cb414d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.711+0000 7f2cb9033640 1 -- 172.21.15.5:0/689435891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cb40b24c0 msgr2=0x7f2cb40c35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.711+0000 7f2cb9033640 1 --2- 172.21.15.5:0/689435891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cb40b24c0 0x7f2cb40c35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.711+0000 7f2cb9033640 1 -- 172.21.15.5:0/689435891 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb40b2f10 con 0x7f2cb40ce700 2023-07-14T13:29:41.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.711+0000 7f2cb9033640 1 --2- 172.21.15.5:0/689435891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cb40ce700 0x7f2cb40ceb80 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f2cb406a410 tx=0x7f2cac011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.711+0000 7f2cb17fa640 1 -- 172.21.15.5:0/689435891 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac00e040 con 0x7f2cb40ce700 2023-07-14T13:29:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.711+0000 7f2cb17fa640 1 -- 172.21.15.5:0/689435891 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cac00f040 con 0x7f2cb40ce700 2023-07-14T13:29:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.711+0000 7f2cb17fa640 1 -- 172.21.15.5:0/689435891 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac015a80 con 0x7f2cb40ce700 2023-07-14T13:29:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.711+0000 7f2cbaa96640 1 -- 172.21.15.5:0/689435891 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb40b31f0 con 0x7f2cb40ce700 2023-07-14T13:29:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.711+0000 7f2cbaa96640 1 -- 172.21.15.5:0/689435891 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb414dc80 con 0x7f2cb40ce700 2023-07-14T13:29:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.711+0000 7f2cbaa96640 1 -- 172.21.15.5:0/689435891 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb40ca1a0 con 0x7f2cb40ce700 2023-07-14T13:29:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.715+0000 7f2cb17fa640 1 -- 172.21.15.5:0/689435891 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2cac015be0 con 0x7f2cb40ce700 2023-07-14T13:29:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.715+0000 7f2cb17fa640 1 --2- 172.21.15.5:0/689435891 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f2c980663a0 0x7f2c98068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.715+0000 7f2cb17fa640 1 -- 172.21.15.5:0/689435891 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f2cac083b00 con 0x7f2cb40ce700 2023-07-14T13:29:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.715+0000 7f2cb8832640 1 --2- 172.21.15.5:0/689435891 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f2c980663a0 0x7f2c98068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.715+0000 7f2cb8832640 1 --2- 172.21.15.5:0/689435891 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f2c980663a0 0x7f2c98068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80ad000 tx=0x7f2ca80a6000 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:41.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.719+0000 7f2cb17fa640 1 -- 172.21.15.5:0/689435891 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2cac085e60 con 0x7f2cb40ce700 2023-07-14T13:29:41.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.875+0000 7f2cbaa96640 1 -- 172.21.15.5:0/689435891 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cb40678d0 con 0x7f2cb40ce700 2023-07-14T13:29:41.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.875+0000 7f2cb17fa640 1 -- 172.21.15.5:0/689435891 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+14645 (secure 0 0 0) 0x7f2cac054b30 con 0x7f2cb40ce700 2023-07-14T13:29:41.882 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:29:41.882 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":168,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:29:41.125221+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:29:41.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.875+0000 7f2cbaa96640 1 -- 172.21.15.5:0/689435891 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f2c980663a0 msgr2=0x7f2c98068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:41.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.875+0000 7f2cbaa96640 1 --2- 172.21.15.5:0/689435891 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f2c980663a0 0x7f2c98068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80ad000 tx=0x7f2ca80a6000 comp rx=0 tx=0).stop 2023-07-14T13:29:41.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.875+0000 7f2cbaa96640 1 -- 172.21.15.5:0/689435891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cb40ce700 msgr2=0x7f2cb40ceb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:41.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.875+0000 7f2cbaa96640 1 --2- 172.21.15.5:0/689435891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cb40ce700 0x7f2cb40ceb80 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f2cb406a410 tx=0x7f2cac011cb0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.879+0000 7f2cbaa96640 1 -- 172.21.15.5:0/689435891 shutdown_connections 2023-07-14T13:29:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.879+0000 7f2cbaa96640 1 --2- 172.21.15.5:0/689435891 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f2c980663a0 0x7f2c98068850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.879+0000 7f2cbaa96640 1 --2- 172.21.15.5:0/689435891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cb40ce700 0x7f2cb40ceb80 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.879+0000 7f2cbaa96640 1 --2- 172.21.15.5:0/689435891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cb40b24c0 0x7f2cb40c35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.879+0000 7f2cbaa96640 1 --2- 172.21.15.5:0/689435891 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ca40039b0 0x7f2cb414d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:41.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.879+0000 7f2cbaa96640 1 -- 172.21.15.5:0/689435891 >> 172.21.15.5:0/689435891 conn(0x7f2cb40afcf0 msgr2=0x7f2cb4153ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:41.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.879+0000 7f2cbaa96640 1 -- 172.21.15.5:0/689435891 shutdown_connections 2023-07-14T13:29:41.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:41.879+0000 7f2cbaa96640 1 -- 172.21.15.5:0/689435891 wait complete. 2023-07-14T13:29:41.904 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:29:41.904 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:29:42.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.047+0000 7f222d034640 1 Processor -- start 2023-07-14T13:29:42.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.047+0000 7f222d034640 1 -- start start 2023-07-14T13:29:42.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.047+0000 7f222d034640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2228069b40 0x7f2228070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:42.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.047+0000 7f222d034640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222806e810 con 0x7f2228070870 2023-07-14T13:29:42.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.047+0000 7f222d034640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2228071060 con 0x7f2228159be0 2023-07-14T13:29:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.047+0000 7f222d034640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222806e1c0 con 0x7f2228069b40 2023-07-14T13:29:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.047+0000 7f222759e640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2228070870 0x7f22280b1eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43086/0 (socket says 172.21.15.5:43086) 2023-07-14T13:29:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.047+0000 7f222759e640 1 -- 172.21.15.5:0/832585484 learned_addr learned my addr 172.21.15.5:0/832585484 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.047+0000 7f221ffff640 1 --2- 172.21.15.5:0/832585484 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2228069b40 0x7f2228070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.047+0000 7f222659c640 1 -- 172.21.15.5:0/832585484 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 193742495 0 0) 0x7f222806e810 con 0x7f2228070870 2023-07-14T13:29:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.047+0000 7f222659c640 1 -- 172.21.15.5:0/832585484 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2214003530 con 0x7f2228070870 2023-07-14T13:29:42.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.047+0000 7f221ffff640 1 -- 172.21.15.5:0/832585484 >> v1:172.21.15.154:6789/0 conn(0x7f2228159be0 legacy=0x7f2228069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.047+0000 7f222659c640 1 -- 172.21.15.5:0/832585484 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3647849936 0 0) 0x7f2228071060 con 0x7f2228159be0 2023-07-14T13:29:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.047+0000 7f221ffff640 1 -- 172.21.15.5:0/832585484 >> v1:172.21.15.5:6789/0 conn(0x7f2228070870 legacy=0x7f22280b1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:42.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.047+0000 7f221ffff640 1 -- 172.21.15.5:0/832585484 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222806e4a0 con 0x7f2228069b40 2023-07-14T13:29:42.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.051+0000 7f221ffff640 1 --2- 172.21.15.5:0/832585484 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2228069b40 0x7f2228070330 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f22100097f0 tx=0x7f221001c210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7f5a62fe111710 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:42.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.051+0000 7f222659c640 1 -- 172.21.15.5:0/832585484 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2220001a00 con 0x7f2228069b40 2023-07-14T13:29:42.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.051+0000 7f222659c640 1 -- 172.21.15.5:0/832585484 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22100a7050 con 0x7f2228069b40 2023-07-14T13:29:42.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.051+0000 7f222659c640 1 -- 172.21.15.5:0/832585484 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22100ab620 con 0x7f2228069b40 2023-07-14T13:29:42.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.051+0000 7f222d034640 1 -- 172.21.15.5:0/832585484 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2228069b40 msgr2=0x7f2228070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:42.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.051+0000 7f222d034640 1 --2- 172.21.15.5:0/832585484 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2228069b40 0x7f2228070330 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f22100097f0 tx=0x7f221001c210 comp rx=0 tx=0).stop 2023-07-14T13:29:42.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.051+0000 7f222d034640 1 -- 172.21.15.5:0/832585484 shutdown_connections 2023-07-14T13:29:42.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.051+0000 7f222d034640 1 --2- 172.21.15.5:0/832585484 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2228069b40 0x7f2228070330 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:42.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.051+0000 7f222d034640 1 -- 172.21.15.5:0/832585484 >> 172.21.15.5:0/832585484 conn(0x7f22280b1840 msgr2=0x7f22280cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:42.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.051+0000 7f222d034640 1 -- 172.21.15.5:0/832585484 shutdown_connections 2023-07-14T13:29:42.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.051+0000 7f222d034640 1 -- 172.21.15.5:0/832585484 wait complete. 2023-07-14T13:29:42.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.051+0000 7f222d034640 1 Processor -- start 2023-07-14T13:29:42.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.055+0000 7f222d034640 1 -- start start 2023-07-14T13:29:42.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.055+0000 7f222d034640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2228069b40 0x7f22280c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:42.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.055+0000 7f222d034640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2228070870 0x7f222815be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:42.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.055+0000 7f222d034640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2228159be0 0x7f2228151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:42.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.055+0000 7f222d034640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2228150d70 con 0x7f2228070870 2023-07-14T13:29:42.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.055+0000 7f222d034640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2228150160 con 0x7f2228159be0 2023-07-14T13:29:42.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.055+0000 7f222d034640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2228150440 con 0x7f2228069b40 2023-07-14T13:29:42.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.055+0000 7f221ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2228070870 0x7f222815be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:42.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.055+0000 7f221ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2228070870 0x7f222815be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48880/0 (socket says 172.21.15.5:48880) 2023-07-14T13:29:42.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.055+0000 7f221ffff640 1 -- 172.21.15.5:0/150019981 learned_addr learned my addr 172.21.15.5:0/150019981 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:42.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.055+0000 7f2226d9d640 1 --2- 172.21.15.5:0/150019981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2228069b40 0x7f22280c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:42.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.055+0000 7f222759e640 1 --2- 172.21.15.5:0/150019981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2228159be0 0x7f2228151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:42.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.055+0000 7f221ffff640 1 -- 172.21.15.5:0/150019981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2228069b40 msgr2=0x7f22280c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:42.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.055+0000 7f221ffff640 1 --2- 172.21.15.5:0/150019981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2228069b40 0x7f22280c6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.055+0000 7f221ffff640 1 -- 172.21.15.5:0/150019981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2228159be0 msgr2=0x7f2228151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.055+0000 7f221ffff640 1 --2- 172.21.15.5:0/150019981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2228159be0 0x7f2228151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.055+0000 7f221ffff640 1 -- 172.21.15.5:0/150019981 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2210009420 con 0x7f2228070870 2023-07-14T13:29:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.055+0000 7f222759e640 1 --2- 172.21.15.5:0/150019981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2228159be0 0x7f2228151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:29:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.055+0000 7f221ffff640 1 --2- 172.21.15.5:0/150019981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2228070870 0x7f222815be90 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f22100097f0 tx=0x7f2210019010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.055+0000 7f221f7fe640 1 -- 172.21.15.5:0/150019981 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2210004020 con 0x7f2228070870 2023-07-14T13:29:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.055+0000 7f221f7fe640 1 -- 172.21.15.5:0/150019981 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2210004180 con 0x7f2228070870 2023-07-14T13:29:42.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.055+0000 7f221f7fe640 1 -- 172.21.15.5:0/150019981 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22100044f0 con 0x7f2228070870 2023-07-14T13:29:42.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.055+0000 7f222d034640 1 -- 172.21.15.5:0/150019981 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2228150720 con 0x7f2228070870 2023-07-14T13:29:42.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.055+0000 7f222d034640 1 -- 172.21.15.5:0/150019981 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f222814ec30 con 0x7f2228070870 2023-07-14T13:29:42.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.055+0000 7f222d034640 1 -- 172.21.15.5:0/150019981 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22280678d0 con 0x7f2228070870 2023-07-14T13:29:42.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.059+0000 7f221f7fe640 1 -- 172.21.15.5:0/150019981 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f22100b2040 con 0x7f2228070870 2023-07-14T13:29:42.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.059+0000 7f221f7fe640 1 --2- 172.21.15.5:0/150019981 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f22080663a0 0x7f2208068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:42.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.059+0000 7f221f7fe640 1 -- 172.21.15.5:0/150019981 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f221011da60 con 0x7f2228070870 2023-07-14T13:29:42.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.059+0000 7f2226d9d640 1 --2- 172.21.15.5:0/150019981 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f22080663a0 0x7f2208068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:42.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.059+0000 7f2226d9d640 1 --2- 172.21.15.5:0/150019981 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f22080663a0 0x7f2208068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2218007fd0 tx=0x7f2218009040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:42.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.063+0000 7f221f7fe640 1 -- 172.21.15.5:0/150019981 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f22100eb130 con 0x7f2228070870 2023-07-14T13:29:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.219+0000 7f222d034640 1 -- 172.21.15.5:0/150019981 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f22280b21f0 con 0x7f2228070870 2023-07-14T13:29:42.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.219+0000 7f221f7fe640 1 -- 172.21.15.5:0/150019981 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v168) v1 ==== 93+0+10 (secure 0 0 0) 0x7f22100ee750 con 0x7f2228070870 2023-07-14T13:29:42.228 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:29:42.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.223+0000 7f222d034640 1 -- 172.21.15.5:0/150019981 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f22080663a0 msgr2=0x7f2208068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:42.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.223+0000 7f222d034640 1 --2- 172.21.15.5:0/150019981 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f22080663a0 0x7f2208068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2218007fd0 tx=0x7f2218009040 comp rx=0 tx=0).stop 2023-07-14T13:29:42.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.223+0000 7f222d034640 1 -- 172.21.15.5:0/150019981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2228070870 msgr2=0x7f222815be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:42.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.223+0000 7f222d034640 1 --2- 172.21.15.5:0/150019981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2228070870 0x7f222815be90 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f22100097f0 tx=0x7f2210019010 comp rx=0 tx=0).stop 2023-07-14T13:29:42.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.223+0000 7f222d034640 1 -- 172.21.15.5:0/150019981 shutdown_connections 2023-07-14T13:29:42.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.223+0000 7f222d034640 1 --2- 172.21.15.5:0/150019981 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f22080663a0 0x7f2208068850 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:42.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.223+0000 7f222d034640 1 --2- 172.21.15.5:0/150019981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2228159be0 0x7f2228151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:42.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.223+0000 7f222d034640 1 --2- 172.21.15.5:0/150019981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2228070870 0x7f222815be90 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:42.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.223+0000 7f222d034640 1 --2- 172.21.15.5:0/150019981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2228069b40 0x7f22280c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:42.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.223+0000 7f222d034640 1 -- 172.21.15.5:0/150019981 >> 172.21.15.5:0/150019981 conn(0x7f22280b1840 msgr2=0x7f2228152510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:42.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.223+0000 7f222d034640 1 -- 172.21.15.5:0/150019981 shutdown_connections 2023-07-14T13:29:42.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.223+0000 7f222d034640 1 -- 172.21.15.5:0/150019981 wait complete. 2023-07-14T13:29:42.249 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:29:42.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.391+0000 7f3277634640 1 Processor -- start 2023-07-14T13:29:42.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.391+0000 7f3277634640 1 -- start start 2023-07-14T13:29:42.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.391+0000 7f3277634640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f32700af2b0 0x7f32700c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:42.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.391+0000 7f3277634640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32700695b0 con 0x7f32700c3ac0 2023-07-14T13:29:42.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.391+0000 7f3277634640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3270069890 con 0x7f32700cd120 2023-07-14T13:29:42.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.391+0000 7f3277634640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3270069b70 con 0x7f32700af2b0 2023-07-14T13:29:42.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.391+0000 7f32753d0640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f32700c3ac0 0x7f32700ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43088/0 (socket says 172.21.15.5:43088) 2023-07-14T13:29:42.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.391+0000 7f32753d0640 1 -- 172.21.15.5:0/1231717079 learned_addr learned my addr 172.21.15.5:0/1231717079 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:42.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.391+0000 7f3274bcf640 1 --2- 172.21.15.5:0/1231717079 >> v2:172.21.15.5:3300/0 conn(0x7f32700af2b0 0x7f32700c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:42.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.391+0000 7f3267fff640 1 -- 172.21.15.5:0/1231717079 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2620263464 0 0) 0x7f32700695b0 con 0x7f32700c3ac0 2023-07-14T13:29:42.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.391+0000 7f3267fff640 1 -- 172.21.15.5:0/1231717079 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f325c003530 con 0x7f32700c3ac0 2023-07-14T13:29:42.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.391+0000 7f3274bcf640 1 -- 172.21.15.5:0/1231717079 >> v1:172.21.15.154:6789/0 conn(0x7f32700cd120 legacy=0x7f32700cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:42.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.391+0000 7f3274bcf640 1 -- 172.21.15.5:0/1231717079 >> v1:172.21.15.5:6789/0 conn(0x7f32700c3ac0 legacy=0x7f32700ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:42.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.391+0000 7f3274bcf640 1 -- 172.21.15.5:0/1231717079 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3270069e50 con 0x7f32700af2b0 2023-07-14T13:29:42.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.395+0000 7f3274bcf640 1 --2- 172.21.15.5:0/1231717079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32700af2b0 0x7f32700c2d30 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f32600097c0 tx=0x7f326001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=266e7b65251504ea server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:42.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.395+0000 7f3267fff640 1 -- 172.21.15.5:0/1231717079 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32600ab660 con 0x7f32700af2b0 2023-07-14T13:29:42.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.395+0000 7f3267fff640 1 -- 172.21.15.5:0/1231717079 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32600ab7c0 con 0x7f32700af2b0 2023-07-14T13:29:42.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.395+0000 7f3267fff640 1 -- 172.21.15.5:0/1231717079 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32600abb50 con 0x7f32700af2b0 2023-07-14T13:29:42.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.395+0000 7f3277634640 1 -- 172.21.15.5:0/1231717079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32700af2b0 msgr2=0x7f32700c2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:42.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.395+0000 7f3277634640 1 --2- 172.21.15.5:0/1231717079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32700af2b0 0x7f32700c2d30 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f32600097c0 tx=0x7f326001c440 comp rx=0 tx=0).stop 2023-07-14T13:29:42.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.395+0000 7f3277634640 1 -- 172.21.15.5:0/1231717079 shutdown_connections 2023-07-14T13:29:42.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.395+0000 7f3277634640 1 --2- 172.21.15.5:0/1231717079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32700af2b0 0x7f32700c2d30 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:42.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.395+0000 7f3277634640 1 -- 172.21.15.5:0/1231717079 >> 172.21.15.5:0/1231717079 conn(0x7f32700cde90 msgr2=0x7f32700ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:42.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.395+0000 7f3277634640 1 -- 172.21.15.5:0/1231717079 shutdown_connections 2023-07-14T13:29:42.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.395+0000 7f3277634640 1 -- 172.21.15.5:0/1231717079 wait complete. 2023-07-14T13:29:42.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.399+0000 7f3277634640 1 Processor -- start 2023-07-14T13:29:42.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.399+0000 7f3277634640 1 -- start start 2023-07-14T13:29:42.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.399+0000 7f3277634640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32700af2b0 0x7f3270149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:42.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.399+0000 7f3277634640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32700c3ac0 0x7f3270151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:42.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.399+0000 7f3277634640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32700cd120 0x7f32701558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:42.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.399+0000 7f3277634640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3270153270 con 0x7f32700af2b0 2023-07-14T13:29:42.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.399+0000 7f3277634640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32701526f0 con 0x7f32700c3ac0 2023-07-14T13:29:42.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.399+0000 7f3277634640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32701529d0 con 0x7f32700cd120 2023-07-14T13:29:42.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.399+0000 7f32753d0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32700af2b0 0x7f3270149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:42.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.399+0000 7f32753d0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32700af2b0 0x7f3270149ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48906/0 (socket says 172.21.15.5:48906) 2023-07-14T13:29:42.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.399+0000 7f32753d0640 1 -- 172.21.15.5:0/1712163519 learned_addr learned my addr 172.21.15.5:0/1712163519 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:42.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.399+0000 7f3275bd1640 1 --2- 172.21.15.5:0/1712163519 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32700cd120 0x7f32701558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:42.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.399+0000 7f3274bcf640 1 --2- 172.21.15.5:0/1712163519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32700c3ac0 0x7f3270151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:42.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.399+0000 7f32753d0640 1 -- 172.21.15.5:0/1712163519 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32700cd120 msgr2=0x7f32701558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:42.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.399+0000 7f32753d0640 1 --2- 172.21.15.5:0/1712163519 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32700cd120 0x7f32701558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:42.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.399+0000 7f32753d0640 1 -- 172.21.15.5:0/1712163519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32700c3ac0 msgr2=0x7f3270151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:42.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.399+0000 7f32753d0640 1 --2- 172.21.15.5:0/1712163519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32700c3ac0 0x7f3270151fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:42.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.399+0000 7f32753d0640 1 -- 172.21.15.5:0/1712163519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3260009420 con 0x7f32700af2b0 2023-07-14T13:29:42.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.399+0000 7f32753d0640 1 --2- 172.21.15.5:0/1712163519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32700af2b0 0x7f3270149ca0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f326c00c4d0 tx=0x7f326c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:42.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.399+0000 7f3265ffb640 1 -- 172.21.15.5:0/1712163519 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c005cf0 con 0x7f32700af2b0 2023-07-14T13:29:42.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.399+0000 7f3265ffb640 1 -- 172.21.15.5:0/1712163519 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326c005e50 con 0x7f32700af2b0 2023-07-14T13:29:42.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.399+0000 7f3277634640 1 -- 172.21.15.5:0/1712163519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3270152cb0 con 0x7f32700af2b0 2023-07-14T13:29:42.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.399+0000 7f3265ffb640 1 -- 172.21.15.5:0/1712163519 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c007270 con 0x7f32700af2b0 2023-07-14T13:29:42.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.399+0000 7f3277634640 1 -- 172.21.15.5:0/1712163519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3270155de0 con 0x7f32700af2b0 2023-07-14T13:29:42.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.403+0000 7f3277634640 1 -- 172.21.15.5:0/1712163519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32700678d0 con 0x7f32700af2b0 2023-07-14T13:29:42.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.403+0000 7f3265ffb640 1 -- 172.21.15.5:0/1712163519 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f326c0073d0 con 0x7f32700af2b0 2023-07-14T13:29:42.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.403+0000 7f3265ffb640 1 --2- 172.21.15.5:0/1712163519 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f32540663a0 0x7f3254068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:42.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.403+0000 7f3265ffb640 1 -- 172.21.15.5:0/1712163519 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f326c083100 con 0x7f32700af2b0 2023-07-14T13:29:42.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.403+0000 7f3274bcf640 1 --2- 172.21.15.5:0/1712163519 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f32540663a0 0x7f3254068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:42.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.403+0000 7f3274bcf640 1 --2- 172.21.15.5:0/1712163519 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f32540663a0 0x7f3254068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f32600af000 tx=0x7f32600a7000 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:42.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.407+0000 7f3265ffb640 1 -- 172.21.15.5:0/1712163519 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f326c0507b0 con 0x7f32700af2b0 2023-07-14T13:29:42.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.563+0000 7f3277634640 1 -- 172.21.15.5:0/1712163519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f32700aeb80 con 0x7f32700af2b0 2023-07-14T13:29:42.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.563+0000 7f3265ffb640 1 -- 172.21.15.5:0/1712163519 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v168) v1 ==== 92+0+10 (secure 0 0 0) 0x7f326c053dd0 con 0x7f32700af2b0 2023-07-14T13:29:42.571 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:29:42.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.567+0000 7f3277634640 1 -- 172.21.15.5:0/1712163519 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f32540663a0 msgr2=0x7f3254068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:42.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.567+0000 7f3277634640 1 --2- 172.21.15.5:0/1712163519 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f32540663a0 0x7f3254068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f32600af000 tx=0x7f32600a7000 comp rx=0 tx=0).stop 2023-07-14T13:29:42.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.567+0000 7f3277634640 1 -- 172.21.15.5:0/1712163519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32700af2b0 msgr2=0x7f3270149ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:42.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.567+0000 7f3277634640 1 --2- 172.21.15.5:0/1712163519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32700af2b0 0x7f3270149ca0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f326c00c4d0 tx=0x7f326c00c990 comp rx=0 tx=0).stop 2023-07-14T13:29:42.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.567+0000 7f3277634640 1 -- 172.21.15.5:0/1712163519 shutdown_connections 2023-07-14T13:29:42.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.567+0000 7f3277634640 1 --2- 172.21.15.5:0/1712163519 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f32540663a0 0x7f3254068850 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:42.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.567+0000 7f3277634640 1 --2- 172.21.15.5:0/1712163519 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32700cd120 0x7f32701558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:42.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.567+0000 7f3277634640 1 --2- 172.21.15.5:0/1712163519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32700c3ac0 0x7f3270151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:42.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.567+0000 7f3277634640 1 --2- 172.21.15.5:0/1712163519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32700af2b0 0x7f3270149ca0 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:42.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.567+0000 7f3277634640 1 -- 172.21.15.5:0/1712163519 >> 172.21.15.5:0/1712163519 conn(0x7f32700cde90 msgr2=0x7f32700c3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:42.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.567+0000 7f3277634640 1 -- 172.21.15.5:0/1712163519 shutdown_connections 2023-07-14T13:29:42.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.567+0000 7f3277634640 1 -- 172.21.15.5:0/1712163519 wait complete. 2023-07-14T13:29:42.592 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-14T13:29:42.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fac017fa640 1 Processor -- start 2023-07-14T13:29:42.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fac017fa640 1 -- start start 2023-07-14T13:29:42.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fac017fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabfc0d06b0 0x7fabfc0b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:42.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fac017fa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabfc0b2410 con 0x7fabfc0b1f70 2023-07-14T13:29:42.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fac017fa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabfc0b26f0 con 0x7fabfc145430 2023-07-14T13:29:42.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fac017fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc0b29d0 con 0x7fabfc0d06b0 2023-07-14T13:29:42.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fabfb7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fabfc0b1f70 0x7fabfc0d22e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43104/0 (socket says 172.21.15.5:43104) 2023-07-14T13:29:42.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fabfb7fe640 1 -- 172.21.15.5:0/3958263678 learned_addr learned my addr 172.21.15.5:0/3958263678 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:42.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fabfaffd640 1 --2- 172.21.15.5:0/3958263678 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabfc0d06b0 0x7fabfc0b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:42.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fabf9ffb640 1 -- 172.21.15.5:0/3958263678 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947029990 0 0) 0x7fabfc0b2410 con 0x7fabfc0b1f70 2023-07-14T13:29:42.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fabf9ffb640 1 -- 172.21.15.5:0/3958263678 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabe4003530 con 0x7fabfc0b1f70 2023-07-14T13:29:42.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fabf9ffb640 1 -- 172.21.15.5:0/3958263678 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4152468107 0 0) 0x7fabfc0b26f0 con 0x7fabfc145430 2023-07-14T13:29:42.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fabf9ffb640 1 -- 172.21.15.5:0/3958263678 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabfc0b2410 con 0x7fabfc145430 2023-07-14T13:29:42.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fabf9ffb640 1 -- 172.21.15.5:0/3958263678 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4236066103 0 0) 0x7fabe4003530 con 0x7fabfc0b1f70 2023-07-14T13:29:42.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fabf9ffb640 1 -- 172.21.15.5:0/3958263678 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabfc0d06b0 msgr2=0x7fabfc0b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:42.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fabf9ffb640 1 --2- 172.21.15.5:0/3958263678 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabfc0d06b0 0x7fabfc0b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:42.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fabf9ffb640 1 -- 172.21.15.5:0/3958263678 >> v1:172.21.15.154:6789/0 conn(0x7fabfc145430 legacy=0x7fabfc0b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:42.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fabf9ffb640 1 -- 172.21.15.5:0/3958263678 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabfc0b2cb0 con 0x7fabfc0b1f70 2023-07-14T13:29:42.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fabf9ffb640 1 -- 172.21.15.5:0/3958263678 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7fabf4001a00 con 0x7fabfc0b1f70 2023-07-14T13:29:42.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fabf9ffb640 1 -- 172.21.15.5:0/3958263678 >> v1:172.21.15.5:6789/0 conn(0x7fabfc0b1f70 legacy=0x7fabfc0d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:42.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fabf9ffb640 1 --2- 172.21.15.5:0/3958263678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabe4003b40 0x7fabe4003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:42.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fabf9ffb640 1 --2- 172.21.15.5:0/3958263678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabe40047d0 0x7fabe4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:42.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fabf9ffb640 1 --2- 172.21.15.5:0/3958263678 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabe4005180 0x7fabe400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:42.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fabf9ffb640 1 -- 172.21.15.5:0/3958263678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc0b29d0 con 0x7fabe40047d0 2023-07-14T13:29:42.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fabf9ffb640 1 -- 172.21.15.5:0/3958263678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe400bf50 con 0x7fabe4003b40 2023-07-14T13:29:42.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fabf9ffb640 1 -- 172.21.15.5:0/3958263678 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe400c110 con 0x7fabe4005180 2023-07-14T13:29:42.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fabfaffd640 1 --2- 172.21.15.5:0/3958263678 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabfc0d06b0 0x7fabfc0b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:29:42.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fabfa7fc640 1 --2- 172.21.15.5:0/3958263678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabe40047d0 0x7fabe4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:42.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fabfb7fe640 1 --2- 172.21.15.5:0/3958263678 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabe4005180 0x7fabe400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:42.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.731+0000 7fabfaffd640 1 --2- 172.21.15.5:0/3958263678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabe4003b40 0x7fabe4003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:42.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.735+0000 7fabfa7fc640 1 -- 172.21.15.5:0/3958263678 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabe4005180 msgr2=0x7fabe400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:42.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.735+0000 7fabfa7fc640 1 --2- 172.21.15.5:0/3958263678 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabe4005180 0x7fabe400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:42.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.735+0000 7fabfa7fc640 1 -- 172.21.15.5:0/3958263678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabe4003b40 msgr2=0x7fabe4003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:42.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.735+0000 7fabfa7fc640 1 --2- 172.21.15.5:0/3958263678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabe4003b40 0x7fabe4003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:42.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.735+0000 7fabfa7fc640 1 -- 172.21.15.5:0/3958263678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe4003530 con 0x7fabe40047d0 2023-07-14T13:29:42.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.735+0000 7fabfa7fc640 1 --2- 172.21.15.5:0/3958263678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabe40047d0 0x7fabe4004c40 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fabf00018d0 tx=0x7fabf001ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af731fcfa09121a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:42.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.735+0000 7fabf9ffb640 1 -- 172.21.15.5:0/3958263678 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf00052d0 con 0x7fabe40047d0 2023-07-14T13:29:42.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.735+0000 7fabf9ffb640 1 -- 172.21.15.5:0/3958263678 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf0005450 con 0x7fabe40047d0 2023-07-14T13:29:42.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.735+0000 7fabf9ffb640 1 -- 172.21.15.5:0/3958263678 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf00a8870 con 0x7fabe40047d0 2023-07-14T13:29:42.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.735+0000 7fac017fa640 1 -- 172.21.15.5:0/3958263678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabe40047d0 msgr2=0x7fabe4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:42.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.735+0000 7fac017fa640 1 --2- 172.21.15.5:0/3958263678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabe40047d0 0x7fabe4004c40 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fabf00018d0 tx=0x7fabf001ec10 comp rx=0 tx=0).stop 2023-07-14T13:29:42.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.735+0000 7fabfb7fe640 1 -- 172.21.15.5:0/3958263678 reap_dead start 2023-07-14T13:29:42.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.735+0000 7fac017fa640 1 -- 172.21.15.5:0/3958263678 shutdown_connections 2023-07-14T13:29:42.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.735+0000 7fac017fa640 1 -- 172.21.15.5:0/3958263678 >> 172.21.15.5:0/3958263678 conn(0x7fabfc0659d0 msgr2=0x7fabfc09b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:42.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.735+0000 7fac017fa640 1 -- 172.21.15.5:0/3958263678 shutdown_connections 2023-07-14T13:29:42.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.735+0000 7fac017fa640 1 -- 172.21.15.5:0/3958263678 wait complete. 2023-07-14T13:29:42.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.739+0000 7fac017fa640 1 Processor -- start 2023-07-14T13:29:42.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.739+0000 7fac017fa640 1 -- start start 2023-07-14T13:29:42.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.739+0000 7fac017fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabe40047d0 0x7fabfc15a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:42.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.739+0000 7fac017fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabfc0cece0 0x7fabfc159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:42.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.739+0000 7fac017fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabfc15a4c0 0x7fabfc0cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:42.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.739+0000 7fac017fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc0cf480 con 0x7fabfc0cece0 2023-07-14T13:29:42.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.739+0000 7fac017fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc0cf760 con 0x7fabe40047d0 2023-07-14T13:29:42.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.739+0000 7fac017fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc0cfa40 con 0x7fabfc15a4c0 2023-07-14T13:29:42.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.739+0000 7fabfa7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabfc0cece0 0x7fabfc159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:42.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.739+0000 7fabfa7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabfc0cece0 0x7fabfc159f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48922/0 (socket says 172.21.15.5:48922) 2023-07-14T13:29:42.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.739+0000 7fabfa7fc640 1 -- 172.21.15.5:0/3132856528 learned_addr learned my addr 172.21.15.5:0/3132856528 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:42.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.739+0000 7fabfaffd640 1 --2- 172.21.15.5:0/3132856528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabe40047d0 0x7fabfc15a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:42.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.739+0000 7fabfb7fe640 1 --2- 172.21.15.5:0/3132856528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabfc15a4c0 0x7fabfc0cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:42.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.739+0000 7fabfa7fc640 1 -- 172.21.15.5:0/3132856528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabfc15a4c0 msgr2=0x7fabfc0cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:42.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.739+0000 7fabfa7fc640 1 --2- 172.21.15.5:0/3132856528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabfc15a4c0 0x7fabfc0cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:42.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.739+0000 7fabfa7fc640 1 -- 172.21.15.5:0/3132856528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabe40047d0 msgr2=0x7fabfc15a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:42.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.739+0000 7fabfa7fc640 1 --2- 172.21.15.5:0/3132856528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabe40047d0 0x7fabfc15a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:42.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.739+0000 7fabfa7fc640 1 -- 172.21.15.5:0/3132856528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabfc0c94c0 con 0x7fabfc0cece0 2023-07-14T13:29:42.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.739+0000 7fabfb7fe640 1 --2- 172.21.15.5:0/3132856528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabfc15a4c0 0x7fabfc0cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:29:42.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.739+0000 7fabfa7fc640 1 --2- 172.21.15.5:0/3132856528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabfc0cece0 0x7fabfc159f80 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fabf00018d0 tx=0x7fabe4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:42.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.739+0000 7fabe37fe640 1 -- 172.21.15.5:0/3132856528 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf00be070 con 0x7fabfc0cece0 2023-07-14T13:29:42.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.739+0000 7fabe37fe640 1 -- 172.21.15.5:0/3132856528 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf00a8d80 con 0x7fabfc0cece0 2023-07-14T13:29:42.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.739+0000 7fabe37fe640 1 -- 172.21.15.5:0/3132856528 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf00050d0 con 0x7fabfc0cece0 2023-07-14T13:29:42.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.739+0000 7fac017fa640 1 -- 172.21.15.5:0/3132856528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabfc0c97a0 con 0x7fabfc0cece0 2023-07-14T13:29:42.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.743+0000 7fac017fa640 1 -- 172.21.15.5:0/3132856528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabfc0b61d0 con 0x7fabfc0cece0 2023-07-14T13:29:42.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.743+0000 7fac017fa640 1 -- 172.21.15.5:0/3132856528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabfc0678d0 con 0x7fabfc0cece0 2023-07-14T13:29:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.743+0000 7fabe37fe640 1 -- 172.21.15.5:0/3132856528 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fabf0003600 con 0x7fabfc0cece0 2023-07-14T13:29:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.743+0000 7fabe37fe640 1 --2- 172.21.15.5:0/3132856528 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fabe80663d0 0x7fabe8068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.743+0000 7fabe37fe640 1 -- 172.21.15.5:0/3132856528 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5238+0+0 (secure 0 0 0) 0x7fabf0120380 con 0x7fabfc0cece0 2023-07-14T13:29:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.743+0000 7fabfaffd640 1 --2- 172.21.15.5:0/3132856528 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fabe80663d0 0x7fabe8068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.743+0000 7fabfaffd640 1 --2- 172.21.15.5:0/3132856528 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fabe80663d0 0x7fabe8068880 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fabfc08b420 tx=0x7fabec009190 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:42.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.747+0000 7fabe37fe640 1 -- 172.21.15.5:0/3132856528 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fabf00ed980 con 0x7fabfc0cece0 2023-07-14T13:29:42.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.903+0000 7fac017fa640 1 -- 172.21.15.5:0/3132856528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fabfc0678d0 con 0x7fabfc0cece0 2023-07-14T13:29:42.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.903+0000 7fabe37fe640 1 -- 172.21.15.5:0/3132856528 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v168) v1 ==== 84+0+126 (secure 0 0 0) 0x7fabf00f0fa0 con 0x7fabfc0cece0 2023-07-14T13:29:42.910 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:29:42.910 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-07-14T13:29:42.910 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:29:42.910 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-07-14T13:29:42.911 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-07-14T13:29:42.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:29:42.911 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:29:42.911 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 2, 2023-07-14T13:29:42.911 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": "rbd" 2023-07-14T13:29:42.911 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:29:42.911 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-07-14T13:29:42.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.903+0000 7fac017fa640 1 -- 172.21.15.5:0/3132856528 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fabe80663d0 msgr2=0x7fabe8068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:42.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.903+0000 7fac017fa640 1 --2- 172.21.15.5:0/3132856528 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fabe80663d0 0x7fabe8068880 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fabfc08b420 tx=0x7fabec009190 comp rx=0 tx=0).stop 2023-07-14T13:29:42.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.903+0000 7fac017fa640 1 -- 172.21.15.5:0/3132856528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabfc0cece0 msgr2=0x7fabfc159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:42.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.903+0000 7fac017fa640 1 --2- 172.21.15.5:0/3132856528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabfc0cece0 0x7fabfc159f80 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fabf00018d0 tx=0x7fabe4005800 comp rx=0 tx=0).stop 2023-07-14T13:29:42.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.903+0000 7fac017fa640 1 -- 172.21.15.5:0/3132856528 shutdown_connections 2023-07-14T13:29:42.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.903+0000 7fac017fa640 1 --2- 172.21.15.5:0/3132856528 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fabe80663d0 0x7fabe8068880 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:42.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.903+0000 7fac017fa640 1 --2- 172.21.15.5:0/3132856528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabfc15a4c0 0x7fabfc0cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:42.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.903+0000 7fac017fa640 1 --2- 172.21.15.5:0/3132856528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabfc0cece0 0x7fabfc159f80 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:42.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.903+0000 7fac017fa640 1 --2- 172.21.15.5:0/3132856528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabe40047d0 0x7fabfc15a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:42.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.903+0000 7fac017fa640 1 -- 172.21.15.5:0/3132856528 >> 172.21.15.5:0/3132856528 conn(0x7fabfc0659d0 msgr2=0x7fabfc06b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:42.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.907+0000 7fac017fa640 1 -- 172.21.15.5:0/3132856528 shutdown_connections 2023-07-14T13:29:42.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:42.907+0000 7fac017fa640 1 -- 172.21.15.5:0/3132856528 wait complete. 2023-07-14T13:29:42.932 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-14T13:29:42.933 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-14T13:29:43.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.075+0000 7fef18f82640 1 Processor -- start 2023-07-14T13:29:43.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.075+0000 7fef18f82640 1 -- start start 2023-07-14T13:29:43.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.075+0000 7fef18f82640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef1415bde0 0x7fef140d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:43.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.075+0000 7fef18f82640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fef140d2fc0 0x7fef140b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:43.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.075+0000 7fef18f82640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef140b04c0 con 0x7fef140d2300 2023-07-14T13:29:43.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.075+0000 7fef18f82640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef1415c1b0 con 0x7fef140d2fc0 2023-07-14T13:29:43.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.075+0000 7fef18f82640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef140d0aa0 con 0x7fef1415bde0 2023-07-14T13:29:43.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.075+0000 7fef12d9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fef140d2300 0x7fef140cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43108/0 (socket says 172.21.15.5:43108) 2023-07-14T13:29:43.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.075+0000 7fef12d9d640 1 -- 172.21.15.5:0/1336142127 learned_addr learned my addr 172.21.15.5:0/1336142127 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:43.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.075+0000 7fef0bfff640 1 --2- 172.21.15.5:0/1336142127 >> v2:172.21.15.5:3300/0 conn(0x7fef140d2fc0 0x7fef140b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:43.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.075+0000 7fef1259c640 1 --2- 172.21.15.5:0/1336142127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef1415bde0 0x7fef140d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:43.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.075+0000 7fef0bfff640 1 -- 172.21.15.5:0/1336142127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef1415bde0 msgr2=0x7fef140d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:43.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.075+0000 7fef0bfff640 1 --2- 172.21.15.5:0/1336142127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef1415bde0 0x7fef140d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:43.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.075+0000 7fef0bfff640 1 -- 172.21.15.5:0/1336142127 >> v1:172.21.15.5:6789/0 conn(0x7fef140d2300 legacy=0x7fef140cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:43.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.075+0000 7fef0bfff640 1 -- 172.21.15.5:0/1336142127 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef140afb90 con 0x7fef140d2fc0 2023-07-14T13:29:43.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.075+0000 7fef1259c640 1 --2- 172.21.15.5:0/1336142127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef1415bde0 0x7fef140d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:29:43.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.079+0000 7fef0bfff640 1 --2- 172.21.15.5:0/1336142127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef140d2fc0 0x7fef140b0950 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7feefc0097c0 tx=0x7feefc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744b3f3f1f1f44be server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:43.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.079+0000 7fef11d9b640 1 -- 172.21.15.5:0/1336142127 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc0ab680 con 0x7fef140d2fc0 2023-07-14T13:29:43.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.079+0000 7fef11d9b640 1 -- 172.21.15.5:0/1336142127 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feefc0ab7e0 con 0x7fef140d2fc0 2023-07-14T13:29:43.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.079+0000 7fef11d9b640 1 -- 172.21.15.5:0/1336142127 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc0abb70 con 0x7fef140d2fc0 2023-07-14T13:29:43.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.079+0000 7fef18f82640 1 -- 172.21.15.5:0/1336142127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef140d2fc0 msgr2=0x7fef140b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:43.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.079+0000 7fef18f82640 1 --2- 172.21.15.5:0/1336142127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef140d2fc0 0x7fef140b0950 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7feefc0097c0 tx=0x7feefc01c480 comp rx=0 tx=0).stop 2023-07-14T13:29:43.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.079+0000 7fef18f82640 1 -- 172.21.15.5:0/1336142127 shutdown_connections 2023-07-14T13:29:43.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.079+0000 7fef18f82640 1 --2- 172.21.15.5:0/1336142127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef140d2fc0 0x7fef140b0950 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:43.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.079+0000 7fef18f82640 1 --2- 172.21.15.5:0/1336142127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef1415bde0 0x7fef140d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:43.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.079+0000 7fef18f82640 1 -- 172.21.15.5:0/1336142127 >> 172.21.15.5:0/1336142127 conn(0x7fef140659d0 msgr2=0x7fef1409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:43.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.079+0000 7fef18f82640 1 -- 172.21.15.5:0/1336142127 shutdown_connections 2023-07-14T13:29:43.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.079+0000 7fef18f82640 1 -- 172.21.15.5:0/1336142127 wait complete. 2023-07-14T13:29:43.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.083+0000 7fef18f82640 1 Processor -- start 2023-07-14T13:29:43.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.083+0000 7fef18f82640 1 -- start start 2023-07-14T13:29:43.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.083+0000 7fef18f82640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef140d2300 0x7fef140c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:43.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.083+0000 7fef18f82640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef140d2fc0 0x7fef1415ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:43.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.083+0000 7fef18f82640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef1415bde0 0x7fef14150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:43.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.083+0000 7fef18f82640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef140c5ea0 con 0x7fef140d2300 2023-07-14T13:29:43.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.083+0000 7fef18f82640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1415f190 con 0x7fef140d2fc0 2023-07-14T13:29:43.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.083+0000 7fef18f82640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef140c87e0 con 0x7fef1415bde0 2023-07-14T13:29:43.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.083+0000 7fef1259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef140d2300 0x7fef140c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:43.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.083+0000 7fef1259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef140d2300 0x7fef140c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48930/0 (socket says 172.21.15.5:48930) 2023-07-14T13:29:43.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.083+0000 7fef1259c640 1 -- 172.21.15.5:0/3847684022 learned_addr learned my addr 172.21.15.5:0/3847684022 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:43.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.083+0000 7fef1259c640 1 -- 172.21.15.5:0/3847684022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef1415bde0 msgr2=0x7fef14150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:43.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.083+0000 7fef1259c640 1 --2- 172.21.15.5:0/3847684022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef1415bde0 0x7fef14150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:43.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.083+0000 7fef0bfff640 1 --2- 172.21.15.5:0/3847684022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef140d2fc0 0x7fef1415ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:43.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.083+0000 7fef1259c640 1 -- 172.21.15.5:0/3847684022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef140d2fc0 msgr2=0x7fef1415ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:43.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.083+0000 7fef1259c640 1 --2- 172.21.15.5:0/3847684022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef140d2fc0 0x7fef1415ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:43.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.083+0000 7fef1259c640 1 -- 172.21.15.5:0/3847684022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feefc009420 con 0x7fef140d2300 2023-07-14T13:29:43.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.083+0000 7fef1259c640 1 --2- 172.21.15.5:0/3847684022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef140d2300 0x7fef140c8200 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fef0400e7e0 tx=0x7fef0400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:43.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.083+0000 7fef0affd640 1 -- 172.21.15.5:0/3847684022 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef040059a0 con 0x7fef140d2300 2023-07-14T13:29:43.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.083+0000 7fef0affd640 1 -- 172.21.15.5:0/3847684022 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef04005b00 con 0x7fef140d2300 2023-07-14T13:29:43.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.083+0000 7fef0affd640 1 -- 172.21.15.5:0/3847684022 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef04005e90 con 0x7fef140d2300 2023-07-14T13:29:43.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.083+0000 7fef18f82640 1 -- 172.21.15.5:0/3847684022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef140c8ac0 con 0x7fef140d2300 2023-07-14T13:29:43.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.083+0000 7fef18f82640 1 -- 172.21.15.5:0/3847684022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef140c63d0 con 0x7fef140d2300 2023-07-14T13:29:43.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.087+0000 7fef18f82640 1 -- 172.21.15.5:0/3847684022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef140c8d00 con 0x7fef140d2300 2023-07-14T13:29:43.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.087+0000 7fef0affd640 1 -- 172.21.15.5:0/3847684022 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fef04004030 con 0x7fef140d2300 2023-07-14T13:29:43.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.087+0000 7fef0affd640 1 --2- 172.21.15.5:0/3847684022 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7feef40663d0 0x7feef4068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:43.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.087+0000 7fef0affd640 1 -- 172.21.15.5:0/3847684022 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5238+0+0 (secure 0 0 0) 0x7fef04083a30 con 0x7fef140d2300 2023-07-14T13:29:43.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.087+0000 7fef0bfff640 1 --2- 172.21.15.5:0/3847684022 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7feef40663d0 0x7feef4068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:43.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.091+0000 7fef0bfff640 1 --2- 172.21.15.5:0/3847684022 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7feef40663d0 0x7feef4068880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feefc0af000 tx=0x7feefc008040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:43.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.091+0000 7fef0affd640 1 -- 172.21.15.5:0/3847684022 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fef04054a40 con 0x7fef140d2300 2023-07-14T13:29:43.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:43.247+0000 7fef18f82640 1 -- 172.21.15.5:0/3847684022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fef140678d0 con 0x7fef140d2300 2023-07-14T13:29:44.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.139+0000 7fef0affd640 1 -- 172.21.15.5:0/3847684022 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v169) v1 ==== 138+0+0 (secure 0 0 0) 0x7fef040545d0 con 0x7fef140d2300 2023-07-14T13:29:44.144 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-07-14T13:29:44.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.143+0000 7fef18f82640 1 -- 172.21.15.5:0/3847684022 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7feef40663d0 msgr2=0x7feef4068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:44.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.143+0000 7fef18f82640 1 --2- 172.21.15.5:0/3847684022 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7feef40663d0 0x7feef4068880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feefc0af000 tx=0x7feefc008040 comp rx=0 tx=0).stop 2023-07-14T13:29:44.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.143+0000 7fef18f82640 1 -- 172.21.15.5:0/3847684022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef140d2300 msgr2=0x7fef140c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:44.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.143+0000 7fef18f82640 1 --2- 172.21.15.5:0/3847684022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef140d2300 0x7fef140c8200 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fef0400e7e0 tx=0x7fef0400eca0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.143+0000 7fef18f82640 1 -- 172.21.15.5:0/3847684022 shutdown_connections 2023-07-14T13:29:44.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.143+0000 7fef18f82640 1 --2- 172.21.15.5:0/3847684022 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7feef40663d0 0x7feef4068880 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.143+0000 7fef18f82640 1 --2- 172.21.15.5:0/3847684022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fef1415bde0 0x7fef14150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.143+0000 7fef18f82640 1 --2- 172.21.15.5:0/3847684022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef140d2fc0 0x7fef1415ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.143+0000 7fef18f82640 1 --2- 172.21.15.5:0/3847684022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fef140d2300 0x7fef140c8200 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.143+0000 7fef18f82640 1 -- 172.21.15.5:0/3847684022 >> 172.21.15.5:0/3847684022 conn(0x7fef140659d0 msgr2=0x7fef140b71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:44.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.143+0000 7fef18f82640 1 -- 172.21.15.5:0/3847684022 shutdown_connections 2023-07-14T13:29:44.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.143+0000 7fef18f82640 1 -- 172.21.15.5:0/3847684022 wait complete. 2023-07-14T13:29:44.177 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-14T13:29:44.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.331+0000 7f13ed537640 1 Processor -- start 2023-07-14T13:29:44.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.331+0000 7f13ed537640 1 -- start start 2023-07-14T13:29:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.331+0000 7f13ed537640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13e806cff0 0x7f13e815c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13ed537640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13e80c8cb0 0x7f13e81630d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13ed537640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e815cc90 con 0x7f13e80ca9d0 2023-07-14T13:29:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13ed537640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e8156130 con 0x7f13e80c8cb0 2023-07-14T13:29:44.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13ed537640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e8158a10 con 0x7f13e806cff0 2023-07-14T13:29:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13e77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13e80c8cb0 0x7f13e81630d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13e77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13e80c8cb0 0x7f13e81630d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48936/0 (socket says 172.21.15.5:48936) 2023-07-14T13:29:44.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13e77fe640 1 -- 172.21.15.5:0/1318746321 learned_addr learned my addr 172.21.15.5:0/1318746321 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13e6ffd640 1 --2- 172.21.15.5:0/1318746321 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13e806cff0 0x7f13e815c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13e77fe640 1 -- 172.21.15.5:0/1318746321 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13e806cff0 msgr2=0x7f13e815c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13e77fe640 1 --2- 172.21.15.5:0/1318746321 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13e806cff0 0x7f13e815c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13e77fe640 1 -- 172.21.15.5:0/1318746321 >> v1:172.21.15.154:6789/0 conn(0x7f13e80ca9d0 legacy=0x7f13e80c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:44.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13e77fe640 1 -- 172.21.15.5:0/1318746321 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e8158cf0 con 0x7f13e80c8cb0 2023-07-14T13:29:44.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13e77fe640 1 --2- 172.21.15.5:0/1318746321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e80c8cb0 0x7f13e81630d0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f13e000d150 tx=0x7f13e001eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a9cc5bc8a814cff server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:44.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13e67fc640 1 -- 172.21.15.5:0/1318746321 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e000b2d0 con 0x7f13e80c8cb0 2023-07-14T13:29:44.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13e67fc640 1 -- 172.21.15.5:0/1318746321 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e000b430 con 0x7f13e80c8cb0 2023-07-14T13:29:44.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13e67fc640 1 -- 172.21.15.5:0/1318746321 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e00a7c70 con 0x7f13e80c8cb0 2023-07-14T13:29:44.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13ed537640 1 -- 172.21.15.5:0/1318746321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e80c8cb0 msgr2=0x7f13e81630d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13ed537640 1 --2- 172.21.15.5:0/1318746321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e80c8cb0 0x7f13e81630d0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f13e000d150 tx=0x7f13e001eb80 comp rx=0 tx=0).stop 2023-07-14T13:29:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13ed537640 1 -- 172.21.15.5:0/1318746321 shutdown_connections 2023-07-14T13:29:44.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13ed537640 1 --2- 172.21.15.5:0/1318746321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e80c8cb0 0x7f13e81630d0 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13ed537640 1 --2- 172.21.15.5:0/1318746321 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13e806cff0 0x7f13e815c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13ed537640 1 -- 172.21.15.5:0/1318746321 >> 172.21.15.5:0/1318746321 conn(0x7f13e80afac0 msgr2=0x7f13e80afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:44.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13ed537640 1 -- 172.21.15.5:0/1318746321 shutdown_connections 2023-07-14T13:29:44.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13ed537640 1 -- 172.21.15.5:0/1318746321 wait complete. 2023-07-14T13:29:44.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13ed537640 1 Processor -- start 2023-07-14T13:29:44.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13ed537640 1 -- start start 2023-07-14T13:29:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13ed537640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13e806cff0 0x7f13e81f4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:44.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13ed537640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13e80c8cb0 0x7f13e815b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:44.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13ed537640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e80ca9d0 0x7f13e815b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:44.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13ed537640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e80b1160 con 0x7f13e80ca9d0 2023-07-14T13:29:44.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13ed537640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e80b0dc0 con 0x7f13e806cff0 2023-07-14T13:29:44.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13ed537640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e81f4b10 con 0x7f13e80c8cb0 2023-07-14T13:29:44.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13e77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e80ca9d0 0x7f13e815b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:44.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13e77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e80ca9d0 0x7f13e815b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48950/0 (socket says 172.21.15.5:48950) 2023-07-14T13:29:44.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13e77fe640 1 -- 172.21.15.5:0/2709070102 learned_addr learned my addr 172.21.15.5:0/2709070102 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:44.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13e6ffd640 1 --2- 172.21.15.5:0/2709070102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13e806cff0 0x7f13e81f4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:44.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.335+0000 7f13dffff640 1 --2- 172.21.15.5:0/2709070102 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13e80c8cb0 0x7f13e815b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:44.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.339+0000 7f13e77fe640 1 -- 172.21.15.5:0/2709070102 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13e80c8cb0 msgr2=0x7f13e815b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:44.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.339+0000 7f13e77fe640 1 --2- 172.21.15.5:0/2709070102 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13e80c8cb0 0x7f13e815b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.339+0000 7f13e77fe640 1 -- 172.21.15.5:0/2709070102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13e806cff0 msgr2=0x7f13e81f4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:44.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.339+0000 7f13e77fe640 1 --2- 172.21.15.5:0/2709070102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13e806cff0 0x7f13e81f4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.339+0000 7f13e77fe640 1 -- 172.21.15.5:0/2709070102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e000bd40 con 0x7f13e80ca9d0 2023-07-14T13:29:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.339+0000 7f13dffff640 1 --2- 172.21.15.5:0/2709070102 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13e80c8cb0 0x7f13e815b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:29:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.339+0000 7f13e77fe640 1 --2- 172.21.15.5:0/2709070102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e80ca9d0 0x7f13e815b930 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f13e00b1040 tx=0x7f13e001b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.339+0000 7f13df7fe640 1 -- 172.21.15.5:0/2709070102 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e0009800 con 0x7f13e80ca9d0 2023-07-14T13:29:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.339+0000 7f13df7fe640 1 -- 172.21.15.5:0/2709070102 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e0009980 con 0x7f13e80ca9d0 2023-07-14T13:29:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.339+0000 7f13df7fe640 1 -- 172.21.15.5:0/2709070102 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e0009d30 con 0x7f13e80ca9d0 2023-07-14T13:29:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.339+0000 7f13ed537640 1 -- 172.21.15.5:0/2709070102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e81f4df0 con 0x7f13e80ca9d0 2023-07-14T13:29:44.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.339+0000 7f13ed537640 1 -- 172.21.15.5:0/2709070102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e81f4760 con 0x7f13e80ca9d0 2023-07-14T13:29:44.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.339+0000 7f13ed537640 1 -- 172.21.15.5:0/2709070102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e80b12a0 con 0x7f13e80ca9d0 2023-07-14T13:29:44.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.339+0000 7f13df7fe640 1 -- 172.21.15.5:0/2709070102 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f13e00c3460 con 0x7f13e80ca9d0 2023-07-14T13:29:44.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.339+0000 7f13df7fe640 1 --2- 172.21.15.5:0/2709070102 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f13c80663a0 0x7f13c8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:44.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.339+0000 7f13df7fe640 1 -- 172.21.15.5:0/2709070102 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5608+0+0 (secure 0 0 0) 0x7f13e011f280 con 0x7f13e80ca9d0 2023-07-14T13:29:44.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.343+0000 7f13e6ffd640 1 --2- 172.21.15.5:0/2709070102 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f13c80663a0 0x7f13c8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:44.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.343+0000 7f13e6ffd640 1 --2- 172.21.15.5:0/2709070102 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f13c80663a0 0x7f13c8068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f13d8009b60 tx=0x7f13d8009190 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:44.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.351+0000 7f13df7fe640 1 -- 172.21.15.5:0/2709070102 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f13e80b12a0 con 0x7f13e80ca9d0 2023-07-14T13:29:44.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:44.507+0000 7f13ed537640 1 -- 172.21.15.5:0/2709070102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f13e80b12a0 con 0x7f13e80ca9d0 2023-07-14T13:29:45.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.151+0000 7f13df7fe640 1 -- 172.21.15.5:0/2709070102 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v170) v1 ==== 170+0+0 (secure 0 0 0) 0x7f13e80b12a0 con 0x7f13e80ca9d0 2023-07-14T13:29:45.157 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-07-14T13:29:45.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.163+0000 7f13ed537640 1 -- 172.21.15.5:0/2709070102 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f13c80663a0 msgr2=0x7f13c8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:45.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.163+0000 7f13ed537640 1 --2- 172.21.15.5:0/2709070102 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f13c80663a0 0x7f13c8068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f13d8009b60 tx=0x7f13d8009190 comp rx=0 tx=0).stop 2023-07-14T13:29:45.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.163+0000 7f13ed537640 1 -- 172.21.15.5:0/2709070102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e80ca9d0 msgr2=0x7f13e815b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:45.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.163+0000 7f13ed537640 1 --2- 172.21.15.5:0/2709070102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e80ca9d0 0x7f13e815b930 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f13e00b1040 tx=0x7f13e001b920 comp rx=0 tx=0).stop 2023-07-14T13:29:45.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.163+0000 7f13ed537640 1 -- 172.21.15.5:0/2709070102 shutdown_connections 2023-07-14T13:29:45.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.163+0000 7f13ed537640 1 --2- 172.21.15.5:0/2709070102 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f13c80663a0 0x7f13c8068850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:45.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.163+0000 7f13ed537640 1 --2- 172.21.15.5:0/2709070102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13e80ca9d0 0x7f13e815b930 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:45.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.163+0000 7f13ed537640 1 --2- 172.21.15.5:0/2709070102 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13e80c8cb0 0x7f13e815b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:45.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.163+0000 7f13ed537640 1 --2- 172.21.15.5:0/2709070102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13e806cff0 0x7f13e81f4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:45.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.163+0000 7f13ed537640 1 -- 172.21.15.5:0/2709070102 >> 172.21.15.5:0/2709070102 conn(0x7f13e80afac0 msgr2=0x7f13e8162e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:45.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.163+0000 7f13ed537640 1 -- 172.21.15.5:0/2709070102 shutdown_connections 2023-07-14T13:29:45.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.167+0000 7f13ed537640 1 -- 172.21.15.5:0/2709070102 wait complete. 2023-07-14T13:29:45.196 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-14T13:29:45.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.343+0000 7fd2b3b2c640 1 Processor -- start 2023-07-14T13:29:45.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.343+0000 7fd2b3b2c640 1 -- start start 2023-07-14T13:29:45.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.343+0000 7fd2b3b2c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd2ac0d2fc0 0x7fd2ac0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:45.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.343+0000 7fd2b3b2c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd2ac0d2300 0x7fd2ac0d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:45.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.343+0000 7fd2b3b2c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2ac0b04c0 con 0x7fd2ac15bde0 2023-07-14T13:29:45.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.343+0000 7fd2b3b2c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2ac15c1b0 con 0x7fd2ac0d2300 2023-07-14T13:29:45.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.343+0000 7fd2b3b2c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2ac0d2c80 con 0x7fd2ac0d2fc0 2023-07-14T13:29:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.343+0000 7fd2b20c9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd2ac0d2300 0x7fd2ac0d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.343+0000 7fd2b20c9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd2ac0d2300 0x7fd2ac0d2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48964/0 (socket says 172.21.15.5:48964) 2023-07-14T13:29:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.343+0000 7fd2b20c9640 1 -- 172.21.15.5:0/792617696 learned_addr learned my addr 172.21.15.5:0/792617696 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.343+0000 7fd2b10c7640 1 --2- 172.21.15.5:0/792617696 >> v2:172.21.15.154:3300/0 conn(0x7fd2ac0d2fc0 0x7fd2ac0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.343+0000 7fd2b20c9640 1 -- 172.21.15.5:0/792617696 >> v2:172.21.15.154:3300/0 conn(0x7fd2ac0d2fc0 msgr2=0x7fd2ac0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.343+0000 7fd2b20c9640 1 --2- 172.21.15.5:0/792617696 >> v2:172.21.15.154:3300/0 conn(0x7fd2ac0d2fc0 0x7fd2ac0b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:45.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.343+0000 7fd2b20c9640 1 -- 172.21.15.5:0/792617696 >> v1:172.21.15.154:6789/0 conn(0x7fd2ac15bde0 legacy=0x7fd2ac0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:45.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.343+0000 7fd2b20c9640 1 -- 172.21.15.5:0/792617696 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ac0d0aa0 con 0x7fd2ac0d2300 2023-07-14T13:29:45.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.347+0000 7fd2b20c9640 1 --2- 172.21.15.5:0/792617696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2ac0d2300 0x7fd2ac0d2740 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac08c600 tx=0x7fd2a401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5ba539f60ad295 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:45.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.347+0000 7fd2b08c6640 1 -- 172.21.15.5:0/792617696 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a40a5890 con 0x7fd2ac0d2300 2023-07-14T13:29:45.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.347+0000 7fd2b08c6640 1 -- 172.21.15.5:0/792617696 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a40a59f0 con 0x7fd2ac0d2300 2023-07-14T13:29:45.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.347+0000 7fd2b08c6640 1 -- 172.21.15.5:0/792617696 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a40a5d80 con 0x7fd2ac0d2300 2023-07-14T13:29:45.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.347+0000 7fd2b3b2c640 1 -- 172.21.15.5:0/792617696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2ac0d2300 msgr2=0x7fd2ac0d2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:45.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.347+0000 7fd2b3b2c640 1 --2- 172.21.15.5:0/792617696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2ac0d2300 0x7fd2ac0d2740 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac08c600 tx=0x7fd2a401c9d0 comp rx=0 tx=0).stop 2023-07-14T13:29:45.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.347+0000 7fd2b3b2c640 1 -- 172.21.15.5:0/792617696 shutdown_connections 2023-07-14T13:29:45.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.347+0000 7fd2b3b2c640 1 --2- 172.21.15.5:0/792617696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2ac0d2300 0x7fd2ac0d2740 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:45.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.347+0000 7fd2b3b2c640 1 --2- 172.21.15.5:0/792617696 >> v2:172.21.15.154:3300/0 conn(0x7fd2ac0d2fc0 0x7fd2ac0b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:45.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.347+0000 7fd2b3b2c640 1 -- 172.21.15.5:0/792617696 >> 172.21.15.5:0/792617696 conn(0x7fd2ac0659d0 msgr2=0x7fd2ac09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:45.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.347+0000 7fd2b3b2c640 1 -- 172.21.15.5:0/792617696 shutdown_connections 2023-07-14T13:29:45.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.347+0000 7fd2b3b2c640 1 -- 172.21.15.5:0/792617696 wait complete. 2023-07-14T13:29:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.351+0000 7fd2b3b2c640 1 Processor -- start 2023-07-14T13:29:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.351+0000 7fd2b3b2c640 1 -- start start 2023-07-14T13:29:45.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.351+0000 7fd2b3b2c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2ac0d2300 0x7fd2ac154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:45.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.351+0000 7fd2b3b2c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2ac0d2fc0 0x7fd2ac0cee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:45.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.351+0000 7fd2b3b2c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2ac15bde0 0x7fd2ac0cf380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:45.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.351+0000 7fd2b3b2c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac15dc10 con 0x7fd2ac0d2300 2023-07-14T13:29:45.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.351+0000 7fd2b3b2c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac15def0 con 0x7fd2ac15bde0 2023-07-14T13:29:45.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.351+0000 7fd2b3b2c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac15e1d0 con 0x7fd2ac0d2fc0 2023-07-14T13:29:45.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.351+0000 7fd2b18c8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2ac0d2300 0x7fd2ac154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:45.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.351+0000 7fd2b18c8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2ac0d2300 0x7fd2ac154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48972/0 (socket says 172.21.15.5:48972) 2023-07-14T13:29:45.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.351+0000 7fd2b18c8640 1 -- 172.21.15.5:0/3064488023 learned_addr learned my addr 172.21.15.5:0/3064488023 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:45.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.351+0000 7fd2b10c7640 1 --2- 172.21.15.5:0/3064488023 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2ac0d2fc0 0x7fd2ac0cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:45.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.351+0000 7fd2b20c9640 1 --2- 172.21.15.5:0/3064488023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2ac15bde0 0x7fd2ac0cf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:45.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.351+0000 7fd2b18c8640 1 -- 172.21.15.5:0/3064488023 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2ac0d2fc0 msgr2=0x7fd2ac0cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:45.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.351+0000 7fd2b18c8640 1 --2- 172.21.15.5:0/3064488023 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2ac0d2fc0 0x7fd2ac0cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:45.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.351+0000 7fd2b18c8640 1 -- 172.21.15.5:0/3064488023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2ac15bde0 msgr2=0x7fd2ac0cf380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:45.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.351+0000 7fd2b18c8640 1 --2- 172.21.15.5:0/3064488023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2ac15bde0 0x7fd2ac0cf380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:45.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.351+0000 7fd2b18c8640 1 -- 172.21.15.5:0/3064488023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a4009b30 con 0x7fd2ac0d2300 2023-07-14T13:29:45.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.351+0000 7fd2b18c8640 1 --2- 172.21.15.5:0/3064488023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2ac0d2300 0x7fd2ac154080 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fd2a800c450 tx=0x7fd2a800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:45.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.351+0000 7fd2a27fc640 1 -- 172.21.15.5:0/3064488023 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a80052d0 con 0x7fd2ac0d2300 2023-07-14T13:29:45.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.351+0000 7fd2a27fc640 1 -- 172.21.15.5:0/3064488023 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a8005430 con 0x7fd2ac0d2300 2023-07-14T13:29:45.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.351+0000 7fd2a27fc640 1 -- 172.21.15.5:0/3064488023 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8003890 con 0x7fd2ac0d2300 2023-07-14T13:29:45.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.351+0000 7fd2b3b2c640 1 -- 172.21.15.5:0/3064488023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2ac0b1a60 con 0x7fd2ac0d2300 2023-07-14T13:29:45.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.351+0000 7fd2b3b2c640 1 -- 172.21.15.5:0/3064488023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2ac1545c0 con 0x7fd2ac0d2300 2023-07-14T13:29:45.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.355+0000 7fd2b3b2c640 1 -- 172.21.15.5:0/3064488023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2ac0b1c80 con 0x7fd2ac0d2300 2023-07-14T13:29:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.355+0000 7fd2a27fc640 1 -- 172.21.15.5:0/3064488023 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd2a80039f0 con 0x7fd2ac0d2300 2023-07-14T13:29:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.355+0000 7fd2a27fc640 1 --2- 172.21.15.5:0/3064488023 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd2900663a0 0x7fd290068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.355+0000 7fd2a27fc640 1 -- 172.21.15.5:0/3064488023 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5990+0+0 (secure 0 0 0) 0x7fd2a8084330 con 0x7fd2ac0d2300 2023-07-14T13:29:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.355+0000 7fd2b10c7640 1 --2- 172.21.15.5:0/3064488023 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd2900663a0 0x7fd290068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.355+0000 7fd2b10c7640 1 --2- 172.21.15.5:0/3064488023 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd2900663a0 0x7fd290068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac0b6860 tx=0x7fd29c008040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:45.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.359+0000 7fd2a27fc640 1 -- 172.21.15.5:0/3064488023 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd2a8051800 con 0x7fd2ac0d2300 2023-07-14T13:29:45.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:45.551+0000 7fd2b3b2c640 1 -- 172.21.15.5:0/3064488023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd2ac0678d0 con 0x7fd2ac0d2300 2023-07-14T13:29:46.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.171+0000 7fd2a27fc640 1 -- 172.21.15.5:0/3064488023 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v79) v1 ==== 174+0+0 (secure 0 0 0) 0x7fd2a8054e20 con 0x7fd2ac0d2300 2023-07-14T13:29:46.174 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 21 and data pool 22 2023-07-14T13:29:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.175+0000 7fd2b3b2c640 1 -- 172.21.15.5:0/3064488023 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd2900663a0 msgr2=0x7fd290068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.175+0000 7fd2b3b2c640 1 --2- 172.21.15.5:0/3064488023 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd2900663a0 0x7fd290068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac0b6860 tx=0x7fd29c008040 comp rx=0 tx=0).stop 2023-07-14T13:29:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.175+0000 7fd2b3b2c640 1 -- 172.21.15.5:0/3064488023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2ac0d2300 msgr2=0x7fd2ac154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.175+0000 7fd2b3b2c640 1 --2- 172.21.15.5:0/3064488023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2ac0d2300 0x7fd2ac154080 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fd2a800c450 tx=0x7fd2a800c910 comp rx=0 tx=0).stop 2023-07-14T13:29:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.179+0000 7fd2b3b2c640 1 -- 172.21.15.5:0/3064488023 shutdown_connections 2023-07-14T13:29:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.179+0000 7fd2b3b2c640 1 --2- 172.21.15.5:0/3064488023 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd2900663a0 0x7fd290068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.179+0000 7fd2b3b2c640 1 --2- 172.21.15.5:0/3064488023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2ac15bde0 0x7fd2ac0cf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.179+0000 7fd2b3b2c640 1 --2- 172.21.15.5:0/3064488023 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2ac0d2fc0 0x7fd2ac0cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.179+0000 7fd2b3b2c640 1 --2- 172.21.15.5:0/3064488023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2ac0d2300 0x7fd2ac154080 secure :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fd2a800c450 tx=0x7fd2a800c910 comp rx=0 tx=0).stop 2023-07-14T13:29:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.179+0000 7fd2b3b2c640 1 -- 172.21.15.5:0/3064488023 >> 172.21.15.5:0/3064488023 conn(0x7fd2ac0659d0 msgr2=0x7fd2ac0cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.179+0000 7fd2b3b2c640 1 -- 172.21.15.5:0/3064488023 shutdown_connections 2023-07-14T13:29:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.179+0000 7fd2b3b2c640 1 -- 172.21.15.5:0/3064488023 wait complete. 2023-07-14T13:29:46.203 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:29:46.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.343+0000 7ff75d340640 1 Processor -- start 2023-07-14T13:29:46.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.343+0000 7ff75d340640 1 -- start start 2023-07-14T13:29:46.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.347+0000 7ff75d340640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff758070b70 0x7ff758070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:46.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.347+0000 7ff75d340640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff7580cb100 0x7ff7580cb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:46.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.347+0000 7ff75d340640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7580cbac0 con 0x7ff75806b1e0 2023-07-14T13:29:46.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.347+0000 7ff75d340640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7580cac70 con 0x7ff7580cb100 2023-07-14T13:29:46.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.347+0000 7ff75d340640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff758071480 con 0x7ff758070b70 2023-07-14T13:29:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.347+0000 7ff74ffff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff75806b1e0 0x7ff7580c1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:47804/0 (socket says 172.21.15.5:47804) 2023-07-14T13:29:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.347+0000 7ff74ffff640 1 -- 172.21.15.5:0/1198173718 learned_addr learned my addr 172.21.15.5:0/1198173718 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.347+0000 7ff756ffd640 1 --2- 172.21.15.5:0/1198173718 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff758070b70 0x7ff758070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.347+0000 7ff7577fe640 1 --2- 172.21.15.5:0/1198173718 >> v2:172.21.15.154:3300/0 conn(0x7ff7580cb100 0x7ff7580cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:46.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.347+0000 7ff7567fc640 1 -- 172.21.15.5:0/1198173718 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 748583777 0 0) 0x7ff740001120 con 0x7ff75806b1e0 2023-07-14T13:29:46.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.347+0000 7ff7567fc640 1 -- 172.21.15.5:0/1198173718 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff744003530 con 0x7ff75806b1e0 2023-07-14T13:29:46.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.347+0000 7ff756ffd640 1 -- 172.21.15.5:0/1198173718 >> v2:172.21.15.154:3300/0 conn(0x7ff7580cb100 msgr2=0x7ff7580cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:46.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.347+0000 7ff756ffd640 1 --2- 172.21.15.5:0/1198173718 >> v2:172.21.15.154:3300/0 conn(0x7ff7580cb100 0x7ff7580cb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:46.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.347+0000 7ff756ffd640 1 -- 172.21.15.5:0/1198173718 >> v1:172.21.15.154:6789/0 conn(0x7ff75806b1e0 legacy=0x7ff7580c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:46.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.347+0000 7ff756ffd640 1 -- 172.21.15.5:0/1198173718 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7580ca060 con 0x7ff758070b70 2023-07-14T13:29:46.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.347+0000 7ff7577fe640 1 --2- 172.21.15.5:0/1198173718 >> v2:172.21.15.154:3300/0 conn(0x7ff7580cb100 0x7ff7580cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:29:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.351+0000 7ff756ffd640 1 --2- 172.21.15.5:0/1198173718 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff758070b70 0x7ff758070f40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff7480097c0 tx=0x7ff74801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=234435bf99392f54 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:46.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.351+0000 7ff7567fc640 1 -- 172.21.15.5:0/1198173718 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7480ac620 con 0x7ff758070b70 2023-07-14T13:29:46.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.351+0000 7ff7567fc640 1 -- 172.21.15.5:0/1198173718 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7480ac780 con 0x7ff758070b70 2023-07-14T13:29:46.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.351+0000 7ff7567fc640 1 -- 172.21.15.5:0/1198173718 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7480acaf0 con 0x7ff758070b70 2023-07-14T13:29:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.351+0000 7ff75d340640 1 -- 172.21.15.5:0/1198173718 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff758070b70 msgr2=0x7ff758070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:46.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.351+0000 7ff75d340640 1 --2- 172.21.15.5:0/1198173718 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff758070b70 0x7ff758070f40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff7480097c0 tx=0x7ff74801c3c0 comp rx=0 tx=0).stop 2023-07-14T13:29:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.351+0000 7ff75d340640 1 -- 172.21.15.5:0/1198173718 shutdown_connections 2023-07-14T13:29:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.351+0000 7ff75d340640 1 --2- 172.21.15.5:0/1198173718 >> v2:172.21.15.154:3300/0 conn(0x7ff7580cb100 0x7ff7580cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:46.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.351+0000 7ff75d340640 1 --2- 172.21.15.5:0/1198173718 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff758070b70 0x7ff758070f40 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:46.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.351+0000 7ff75d340640 1 -- 172.21.15.5:0/1198173718 >> 172.21.15.5:0/1198173718 conn(0x7ff7580afcf0 msgr2=0x7ff7580b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:46.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.351+0000 7ff75d340640 1 -- 172.21.15.5:0/1198173718 shutdown_connections 2023-07-14T13:29:46.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.351+0000 7ff75d340640 1 -- 172.21.15.5:0/1198173718 wait complete. 2023-07-14T13:29:46.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.351+0000 7ff75d340640 1 Processor -- start 2023-07-14T13:29:46.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.351+0000 7ff75d340640 1 -- start start 2023-07-14T13:29:46.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.355+0000 7ff75d340640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff75806b1e0 0x7ff75814b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:46.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.355+0000 7ff75d340640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff758070b70 0x7ff758155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:46.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.355+0000 7ff75d340640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7580cb100 0x7ff7580b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:46.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.355+0000 7ff75d340640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75814bc00 con 0x7ff758070b70 2023-07-14T13:29:46.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.355+0000 7ff75d340640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff758156790 con 0x7ff7580cb100 2023-07-14T13:29:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.355+0000 7ff75d340640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff758156a70 con 0x7ff75806b1e0 2023-07-14T13:29:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.355+0000 7ff756ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff75806b1e0 0x7ff75814b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.355+0000 7ff756ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff75806b1e0 0x7ff75814b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:48470/0 (socket says 172.21.15.5:48470) 2023-07-14T13:29:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.355+0000 7ff756ffd640 1 -- 172.21.15.5:0/933216915 learned_addr learned my addr 172.21.15.5:0/933216915 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:46.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.355+0000 7ff74ffff640 1 --2- 172.21.15.5:0/933216915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff758070b70 0x7ff758155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.355+0000 7ff7577fe640 1 --2- 172.21.15.5:0/933216915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7580cb100 0x7ff7580b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.355+0000 7ff756ffd640 1 -- 172.21.15.5:0/933216915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7580cb100 msgr2=0x7ff7580b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.355+0000 7ff756ffd640 1 --2- 172.21.15.5:0/933216915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7580cb100 0x7ff7580b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.355+0000 7ff756ffd640 1 -- 172.21.15.5:0/933216915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff758070b70 msgr2=0x7ff758155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:46.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.355+0000 7ff756ffd640 1 --2- 172.21.15.5:0/933216915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff758070b70 0x7ff758155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:46.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.355+0000 7ff756ffd640 1 -- 172.21.15.5:0/933216915 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff750009a70 con 0x7ff75806b1e0 2023-07-14T13:29:46.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.355+0000 7ff756ffd640 1 --2- 172.21.15.5:0/933216915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff75806b1e0 0x7ff75814b6c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff74801aa70 tx=0x7ff748019160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:46.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.355+0000 7ff74f7fe640 1 -- 172.21.15.5:0/933216915 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7480ac620 con 0x7ff75806b1e0 2023-07-14T13:29:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.355+0000 7ff74f7fe640 1 -- 172.21.15.5:0/933216915 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7480b5400 con 0x7ff75806b1e0 2023-07-14T13:29:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.355+0000 7ff74f7fe640 1 -- 172.21.15.5:0/933216915 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7480b5790 con 0x7ff75806b1e0 2023-07-14T13:29:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.355+0000 7ff75d340640 1 -- 172.21.15.5:0/933216915 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff748009420 con 0x7ff75806b1e0 2023-07-14T13:29:46.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.355+0000 7ff75d340640 1 -- 172.21.15.5:0/933216915 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff758157030 con 0x7ff75806b1e0 2023-07-14T13:29:46.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.355+0000 7ff75d340640 1 -- 172.21.15.5:0/933216915 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7580678d0 con 0x7ff75806b1e0 2023-07-14T13:29:46.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.359+0000 7ff74f7fe640 1 -- 172.21.15.5:0/933216915 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff7480b3040 con 0x7ff75806b1e0 2023-07-14T13:29:46.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.359+0000 7ff74f7fe640 1 --2- 172.21.15.5:0/933216915 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff7380663a0 0x7ff738068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:46.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.359+0000 7ff74f7fe640 1 -- 172.21.15.5:0/933216915 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6090+0+0 (secure 0 0 0) 0x7ff74811ea90 con 0x7ff75806b1e0 2023-07-14T13:29:46.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.359+0000 7ff74ffff640 1 --2- 172.21.15.5:0/933216915 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff7380663a0 0x7ff738068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:46.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.359+0000 7ff74ffff640 1 --2- 172.21.15.5:0/933216915 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff7380663a0 0x7ff738068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff740007fd0 tx=0x7ff740009040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:46.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.363+0000 7ff74f7fe640 1 -- 172.21.15.5:0/933216915 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff7480ebdf0 con 0x7ff75806b1e0 2023-07-14T13:29:46.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.519+0000 7ff75d340640 1 -- 172.21.15.5:0/933216915 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7581634a0 con 0x7ff75806b1e0 2023-07-14T13:29:46.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.519+0000 7ff74f7fe640 1 -- 172.21.15.5:0/933216915 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) v1 ==== 74+0+18310 (secure 0 0 0) 0x7ff7480ef410 con 0x7ff75806b1e0 2023-07-14T13:29:46.522 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:29:46.522 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":171,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:29:45.554951+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:29:43.300974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-14T13:29:44.554824+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:29:46.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.519+0000 7ff75d340640 1 -- 172.21.15.5:0/933216915 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff7380663a0 msgr2=0x7ff738068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:46.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.519+0000 7ff75d340640 1 --2- 172.21.15.5:0/933216915 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff7380663a0 0x7ff738068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff740007fd0 tx=0x7ff740009040 comp rx=0 tx=0).stop 2023-07-14T13:29:46.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.519+0000 7ff75d340640 1 -- 172.21.15.5:0/933216915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff75806b1e0 msgr2=0x7ff75814b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:46.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.519+0000 7ff75d340640 1 --2- 172.21.15.5:0/933216915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff75806b1e0 0x7ff75814b6c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff74801aa70 tx=0x7ff748019160 comp rx=0 tx=0).stop 2023-07-14T13:29:46.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.519+0000 7ff75d340640 1 -- 172.21.15.5:0/933216915 shutdown_connections 2023-07-14T13:29:46.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.519+0000 7ff75d340640 1 --2- 172.21.15.5:0/933216915 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff7380663a0 0x7ff738068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:46.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.519+0000 7ff75d340640 1 --2- 172.21.15.5:0/933216915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7580cb100 0x7ff7580b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:46.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.519+0000 7ff75d340640 1 --2- 172.21.15.5:0/933216915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff758070b70 0x7ff758155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:46.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.519+0000 7ff75d340640 1 --2- 172.21.15.5:0/933216915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff75806b1e0 0x7ff75814b6c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:46.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.519+0000 7ff75d340640 1 -- 172.21.15.5:0/933216915 >> 172.21.15.5:0/933216915 conn(0x7ff7580afcf0 msgr2=0x7ff7580c25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:46.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.519+0000 7ff75d340640 1 -- 172.21.15.5:0/933216915 shutdown_connections 2023-07-14T13:29:46.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.523+0000 7ff75d340640 1 -- 172.21.15.5:0/933216915 wait complete. 2023-07-14T13:29:46.543 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:29:46.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.683+0000 7f03ae26d640 1 Processor -- start 2023-07-14T13:29:46.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.683+0000 7f03ae26d640 1 -- start start 2023-07-14T13:29:46.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.687+0000 7f03ae26d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f03a815bc00 0x7f03a80ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:46.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.687+0000 7f03ae26d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f03a8160450 0x7f03a806e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:46.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.687+0000 7f03ae26d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a80c9c30 con 0x7f03a8069430 2023-07-14T13:29:46.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.687+0000 7f03ae26d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a80c96b0 con 0x7f03a8160450 2023-07-14T13:29:46.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.687+0000 7f03ae26d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a815bfd0 con 0x7f03a815bc00 2023-07-14T13:29:46.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.687+0000 7f03a77fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f03a8160450 0x7f03a806e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:46.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.687+0000 7f03ac80a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f03a8069430 0x7f03a80702c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43116/0 (socket says 172.21.15.5:43116) 2023-07-14T13:29:46.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.687+0000 7f03ac80a640 1 -- 172.21.15.5:0/81407699 learned_addr learned my addr 172.21.15.5:0/81407699 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:46.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.687+0000 7f03a7fff640 1 --2- 172.21.15.5:0/81407699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f03a815bc00 0x7f03a80ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:46.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.687+0000 7f03a77fe640 1 -- 172.21.15.5:0/81407699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f03a815bc00 msgr2=0x7f03a80ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:46.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.687+0000 7f03a77fe640 1 --2- 172.21.15.5:0/81407699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f03a815bc00 0x7f03a80ce8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:46.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.687+0000 7f03a77fe640 1 -- 172.21.15.5:0/81407699 >> v1:172.21.15.5:6789/0 conn(0x7f03a8069430 legacy=0x7f03a80702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:46.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.687+0000 7f03a77fe640 1 -- 172.21.15.5:0/81407699 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a80cee30 con 0x7f03a8160450 2023-07-14T13:29:46.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.687+0000 7f03a6ffd640 1 -- 172.21.15.5:0/81407699 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126719182 0 0) 0x7f03a80c9c30 con 0x7f03a8069430 2023-07-14T13:29:46.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.691+0000 7f03a77fe640 1 --2- 172.21.15.5:0/81407699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a8160450 0x7f03a806e690 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f039c0097c0 tx=0x7f039c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f838e57fdde6a7c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:46.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.691+0000 7f03a6ffd640 1 -- 172.21.15.5:0/81407699 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039c0ab650 con 0x7f03a8160450 2023-07-14T13:29:46.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.691+0000 7f03a6ffd640 1 -- 172.21.15.5:0/81407699 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039c0ab7b0 con 0x7f03a8160450 2023-07-14T13:29:46.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.691+0000 7f03a6ffd640 1 -- 172.21.15.5:0/81407699 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039c0abb40 con 0x7f03a8160450 2023-07-14T13:29:46.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.691+0000 7f03ae26d640 1 -- 172.21.15.5:0/81407699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a8160450 msgr2=0x7f03a806e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:46.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.691+0000 7f03ae26d640 1 --2- 172.21.15.5:0/81407699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a8160450 0x7f03a806e690 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f039c0097c0 tx=0x7f039c01c450 comp rx=0 tx=0).stop 2023-07-14T13:29:46.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.691+0000 7f03ae26d640 1 -- 172.21.15.5:0/81407699 shutdown_connections 2023-07-14T13:29:46.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.691+0000 7f03ae26d640 1 --2- 172.21.15.5:0/81407699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a8160450 0x7f03a806e690 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:46.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.691+0000 7f03ae26d640 1 --2- 172.21.15.5:0/81407699 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f03a815bc00 0x7f03a80ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:46.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.691+0000 7f03ae26d640 1 -- 172.21.15.5:0/81407699 >> 172.21.15.5:0/81407699 conn(0x7f03a80b1840 msgr2=0x7f03a80cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:46.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.691+0000 7f03ae26d640 1 -- 172.21.15.5:0/81407699 shutdown_connections 2023-07-14T13:29:46.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.691+0000 7f03ae26d640 1 -- 172.21.15.5:0/81407699 wait complete. 2023-07-14T13:29:46.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.691+0000 7f03ae26d640 1 Processor -- start 2023-07-14T13:29:46.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.691+0000 7f03ae26d640 1 -- start start 2023-07-14T13:29:46.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.695+0000 7f03ae26d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f03a8069430 0x7f03a8158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:46.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.695+0000 7f03ae26d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03a815bc00 0x7f03a81f87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:46.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.695+0000 7f03ae26d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a8160450 0x7f03a814ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:46.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.695+0000 7f03ae26d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80b4120 con 0x7f03a8160450 2023-07-14T13:29:46.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.695+0000 7f03ae26d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a81f8d00 con 0x7f03a815bc00 2023-07-14T13:29:46.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.695+0000 7f03ae26d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a815ecb0 con 0x7f03a8069430 2023-07-14T13:29:46.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.695+0000 7f03ac80a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a8160450 0x7f03a814ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:46.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.695+0000 7f03ac80a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a8160450 0x7f03a814ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48998/0 (socket says 172.21.15.5:48998) 2023-07-14T13:29:46.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.695+0000 7f03ac80a640 1 -- 172.21.15.5:0/1785854679 learned_addr learned my addr 172.21.15.5:0/1785854679 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:46.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.695+0000 7f03a77fe640 1 --2- 172.21.15.5:0/1785854679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03a815bc00 0x7f03a81f87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:46.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.695+0000 7f03a7fff640 1 --2- 172.21.15.5:0/1785854679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f03a8069430 0x7f03a8158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:46.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.695+0000 7f03ac80a640 1 -- 172.21.15.5:0/1785854679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f03a8069430 msgr2=0x7f03a8158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:46.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.695+0000 7f03ac80a640 1 --2- 172.21.15.5:0/1785854679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f03a8069430 0x7f03a8158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:46.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.695+0000 7f03ac80a640 1 -- 172.21.15.5:0/1785854679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03a815bc00 msgr2=0x7f03a81f87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:46.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.695+0000 7f03ac80a640 1 --2- 172.21.15.5:0/1785854679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03a815bc00 0x7f03a81f87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:46.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.695+0000 7f03ac80a640 1 -- 172.21.15.5:0/1785854679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039c009420 con 0x7f03a8160450 2023-07-14T13:29:46.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.695+0000 7f03a77fe640 1 --2- 172.21.15.5:0/1785854679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03a815bc00 0x7f03a81f87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:29:46.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.695+0000 7f03ac80a640 1 --2- 172.21.15.5:0/1785854679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a8160450 0x7f03a814ee70 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f03a000c700 tx=0x7f03a000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:46.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.695+0000 7f03a4ff9640 1 -- 172.21.15.5:0/1785854679 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a000ce10 con 0x7f03a8160450 2023-07-14T13:29:46.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.695+0000 7f03a4ff9640 1 -- 172.21.15.5:0/1785854679 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a000a640 con 0x7f03a8160450 2023-07-14T13:29:46.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.695+0000 7f03a4ff9640 1 -- 172.21.15.5:0/1785854679 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a000aa70 con 0x7f03a8160450 2023-07-14T13:29:46.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.695+0000 7f03ae26d640 1 -- 172.21.15.5:0/1785854679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a80b4390 con 0x7f03a8160450 2023-07-14T13:29:46.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.695+0000 7f03ae26d640 1 -- 172.21.15.5:0/1785854679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a815ef90 con 0x7f03a8160450 2023-07-14T13:29:46.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.695+0000 7f03ae26d640 1 -- 172.21.15.5:0/1785854679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a80cdda0 con 0x7f03a8160450 2023-07-14T13:29:46.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.699+0000 7f03a4ff9640 1 -- 172.21.15.5:0/1785854679 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f03a000abd0 con 0x7f03a8160450 2023-07-14T13:29:46.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.699+0000 7f03a4ff9640 1 --2- 172.21.15.5:0/1785854679 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f03940663a0 0x7f0394068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:46.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.699+0000 7f03a4ff9640 1 -- 172.21.15.5:0/1785854679 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f03a0083320 con 0x7f03a8160450 2023-07-14T13:29:46.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.699+0000 7f03a7fff640 1 --2- 172.21.15.5:0/1785854679 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f03940663a0 0x7f0394068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:46.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.699+0000 7f03a7fff640 1 --2- 172.21.15.5:0/1785854679 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f03940663a0 0x7f0394068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f03a80cdd00 tx=0x7f0398009190 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:46.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.703+0000 7f03a4ff9640 1 -- 172.21.15.5:0/1785854679 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f03a0050710 con 0x7f03a8160450 2023-07-14T13:29:46.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.863+0000 7f03ae26d640 1 -- 172.21.15.5:0/1785854679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03a80678d0 con 0x7f03a8160450 2023-07-14T13:29:46.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.863+0000 7f03a4ff9640 1 -- 172.21.15.5:0/1785854679 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f03a0053d30 con 0x7f03a8160450 2023-07-14T13:29:46.866 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:29:46.867 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":171,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:29:45.554951+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:29:43.300974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-14T13:29:44.554824+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:29:46.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.863+0000 7f03ae26d640 1 -- 172.21.15.5:0/1785854679 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f03940663a0 msgr2=0x7f0394068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:46.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.863+0000 7f03ae26d640 1 --2- 172.21.15.5:0/1785854679 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f03940663a0 0x7f0394068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f03a80cdd00 tx=0x7f0398009190 comp rx=0 tx=0).stop 2023-07-14T13:29:46.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.863+0000 7f03ae26d640 1 -- 172.21.15.5:0/1785854679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a8160450 msgr2=0x7f03a814ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:46.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.863+0000 7f03ae26d640 1 --2- 172.21.15.5:0/1785854679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a8160450 0x7f03a814ee70 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f03a000c700 tx=0x7f03a000cbc0 comp rx=0 tx=0).stop 2023-07-14T13:29:46.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.863+0000 7f03ae26d640 1 -- 172.21.15.5:0/1785854679 shutdown_connections 2023-07-14T13:29:46.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.863+0000 7f03ae26d640 1 --2- 172.21.15.5:0/1785854679 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f03940663a0 0x7f0394068850 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:46.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.863+0000 7f03ae26d640 1 --2- 172.21.15.5:0/1785854679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03a8160450 0x7f03a814ee70 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:46.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.863+0000 7f03ae26d640 1 --2- 172.21.15.5:0/1785854679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03a815bc00 0x7f03a81f87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:46.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.863+0000 7f03ae26d640 1 --2- 172.21.15.5:0/1785854679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f03a8069430 0x7f03a8158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:46.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.863+0000 7f03ae26d640 1 -- 172.21.15.5:0/1785854679 >> 172.21.15.5:0/1785854679 conn(0x7f03a80b1840 msgr2=0x7f03a815ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:46.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.863+0000 7f03ae26d640 1 -- 172.21.15.5:0/1785854679 shutdown_connections 2023-07-14T13:29:46.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:46.863+0000 7f03ae26d640 1 -- 172.21.15.5:0/1785854679 wait complete. 2023-07-14T13:29:46.887 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-14T13:29:47.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.031+0000 7f04fe140640 1 Processor -- start 2023-07-14T13:29:47.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.031+0000 7f04fe140640 1 -- start start 2023-07-14T13:29:47.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.035+0000 7f04fe140640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f04f8070f30 0x7f04f80ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:47.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.035+0000 7f04fe140640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04f80af2b0 0x7f04f815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:47.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.035+0000 7f04fe140640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f8159d70 con 0x7f04f8069430 2023-07-14T13:29:47.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.035+0000 7f04fe140640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f80c9c60 con 0x7f04f8070f30 2023-07-14T13:29:47.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.035+0000 7f04fe140640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f80c9f40 con 0x7f04f80af2b0 2023-07-14T13:29:47.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.035+0000 7f04f77fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f04f8069430 0x7f04f8069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43132/0 (socket says 172.21.15.5:43132) 2023-07-14T13:29:47.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.035+0000 7f04f77fe640 1 -- 172.21.15.5:0/3628812864 learned_addr learned my addr 172.21.15.5:0/3628812864 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:47.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.035+0000 7f04f7fff640 1 --2- 172.21.15.5:0/3628812864 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04f80af2b0 0x7f04f815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:47.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.035+0000 7f04f6ffd640 1 --2- 172.21.15.5:0/3628812864 >> v2:172.21.15.154:3300/0 conn(0x7f04f8070f30 0x7f04f80ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:47.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.035+0000 7f04f67fc640 1 -- 172.21.15.5:0/3628812864 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718181221 0 0) 0x7f04e8001120 con 0x7f04f8069430 2023-07-14T13:29:47.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.035+0000 7f04f67fc640 1 -- 172.21.15.5:0/3628812864 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04e0003530 con 0x7f04f8069430 2023-07-14T13:29:47.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.035+0000 7f04f7fff640 1 -- 172.21.15.5:0/3628812864 >> v2:172.21.15.154:3300/0 conn(0x7f04f8070f30 msgr2=0x7f04f80ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:47.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.035+0000 7f04f7fff640 1 --2- 172.21.15.5:0/3628812864 >> v2:172.21.15.154:3300/0 conn(0x7f04f8070f30 0x7f04f80ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:47.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.035+0000 7f04f7fff640 1 -- 172.21.15.5:0/3628812864 >> v1:172.21.15.5:6789/0 conn(0x7f04f8069430 legacy=0x7f04f8069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:47.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.035+0000 7f04f7fff640 1 -- 172.21.15.5:0/3628812864 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f80ca220 con 0x7f04f80af2b0 2023-07-14T13:29:47.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.039+0000 7f04f7fff640 1 --2- 172.21.15.5:0/3628812864 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04f80af2b0 0x7f04f815a1f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f04f0009d90 tx=0x7f04f001c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a11c648b99ab2546 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:47.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.039+0000 7f04f67fc640 1 -- 172.21.15.5:0/3628812864 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f00a5920 con 0x7f04f80af2b0 2023-07-14T13:29:47.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.039+0000 7f04f67fc640 1 -- 172.21.15.5:0/3628812864 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f00a5a80 con 0x7f04f80af2b0 2023-07-14T13:29:47.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.039+0000 7f04f67fc640 1 -- 172.21.15.5:0/3628812864 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f00a5e10 con 0x7f04f80af2b0 2023-07-14T13:29:47.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.039+0000 7f04fe140640 1 -- 172.21.15.5:0/3628812864 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04f80af2b0 msgr2=0x7f04f815a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:47.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.039+0000 7f04fe140640 1 --2- 172.21.15.5:0/3628812864 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04f80af2b0 0x7f04f815a1f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f04f0009d90 tx=0x7f04f001c950 comp rx=0 tx=0).stop 2023-07-14T13:29:47.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.039+0000 7f04fe140640 1 -- 172.21.15.5:0/3628812864 shutdown_connections 2023-07-14T13:29:47.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.039+0000 7f04fe140640 1 --2- 172.21.15.5:0/3628812864 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04f80af2b0 0x7f04f815a1f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:47.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.039+0000 7f04fe140640 1 --2- 172.21.15.5:0/3628812864 >> v2:172.21.15.154:3300/0 conn(0x7f04f8070f30 0x7f04f80ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:47.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.039+0000 7f04fe140640 1 -- 172.21.15.5:0/3628812864 >> 172.21.15.5:0/3628812864 conn(0x7f04f80cde90 msgr2=0x7f04f80ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:47.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.039+0000 7f04fe140640 1 -- 172.21.15.5:0/3628812864 shutdown_connections 2023-07-14T13:29:47.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.039+0000 7f04fe140640 1 -- 172.21.15.5:0/3628812864 wait complete. 2023-07-14T13:29:47.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.039+0000 7f04fe140640 1 Processor -- start 2023-07-14T13:29:47.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.039+0000 7f04fe140640 1 -- start start 2023-07-14T13:29:47.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.043+0000 7f04fe140640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04f8069430 0x7f04f81f44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:47.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.043+0000 7f04fe140640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04f8070f30 0x7f04f80cb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:47.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.043+0000 7f04fe140640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f80af2b0 0x7f04f80b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:47.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.043+0000 7f04fe140640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f8149440 con 0x7f04f80af2b0 2023-07-14T13:29:47.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.043+0000 7f04fe140640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f8154b50 con 0x7f04f8069430 2023-07-14T13:29:47.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.043+0000 7f04fe140640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f8154da0 con 0x7f04f8070f30 2023-07-14T13:29:47.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.043+0000 7f04f7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f80af2b0 0x7f04f80b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.043+0000 7f04f7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f80af2b0 0x7f04f80b35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49008/0 (socket says 172.21.15.5:49008) 2023-07-14T13:29:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.043+0000 7f04f7fff640 1 -- 172.21.15.5:0/4292742591 learned_addr learned my addr 172.21.15.5:0/4292742591 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.043+0000 7f04f6ffd640 1 --2- 172.21.15.5:0/4292742591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04f8070f30 0x7f04f80cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.043+0000 7f04f77fe640 1 --2- 172.21.15.5:0/4292742591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04f8069430 0x7f04f81f44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.043+0000 7f04f7fff640 1 -- 172.21.15.5:0/4292742591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04f8070f30 msgr2=0x7f04f80cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:47.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.043+0000 7f04f7fff640 1 --2- 172.21.15.5:0/4292742591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04f8070f30 0x7f04f80cb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:47.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.043+0000 7f04f7fff640 1 -- 172.21.15.5:0/4292742591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04f8069430 msgr2=0x7f04f81f44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:47.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.043+0000 7f04f7fff640 1 --2- 172.21.15.5:0/4292742591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04f8069430 0x7f04f81f44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:47.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.043+0000 7f04f7fff640 1 -- 172.21.15.5:0/4292742591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f0009a70 con 0x7f04f80af2b0 2023-07-14T13:29:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.043+0000 7f04f77fe640 1 --2- 172.21.15.5:0/4292742591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04f8069430 0x7f04f81f44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:29:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.043+0000 7f04f7fff640 1 --2- 172.21.15.5:0/4292742591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f80af2b0 0x7f04f80b35d0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f04f0009d90 tx=0x7f04f00196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.043+0000 7f04dffff640 1 -- 172.21.15.5:0/4292742591 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f00aecd0 con 0x7f04f80af2b0 2023-07-14T13:29:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.043+0000 7f04dffff640 1 -- 172.21.15.5:0/4292742591 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f00aee30 con 0x7f04f80af2b0 2023-07-14T13:29:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.043+0000 7f04fe140640 1 -- 172.21.15.5:0/4292742591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f8155080 con 0x7f04f80af2b0 2023-07-14T13:29:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.043+0000 7f04dffff640 1 -- 172.21.15.5:0/4292742591 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f00b7630 con 0x7f04f80af2b0 2023-07-14T13:29:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.043+0000 7f04fe140640 1 -- 172.21.15.5:0/4292742591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f8155640 con 0x7f04f80af2b0 2023-07-14T13:29:47.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.043+0000 7f04fe140640 1 -- 172.21.15.5:0/4292742591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f8155830 con 0x7f04f80af2b0 2023-07-14T13:29:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.047+0000 7f04dffff640 1 -- 172.21.15.5:0/4292742591 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f04f00b4050 con 0x7f04f80af2b0 2023-07-14T13:29:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.047+0000 7f04dffff640 1 --2- 172.21.15.5:0/4292742591 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f04e40663a0 0x7f04e4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.047+0000 7f04dffff640 1 -- 172.21.15.5:0/4292742591 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f04f011ef30 con 0x7f04f80af2b0 2023-07-14T13:29:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.047+0000 7f04f77fe640 1 --2- 172.21.15.5:0/4292742591 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f04e40663a0 0x7f04e4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:47.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.047+0000 7f04f77fe640 1 --2- 172.21.15.5:0/4292742591 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f04e40663a0 0x7f04e4068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f04e8005890 tx=0x7f04e8009040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:47.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.051+0000 7f04dffff640 1 -- 172.21.15.5:0/4292742591 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f04f00ec3c0 con 0x7f04f80af2b0 2023-07-14T13:29:47.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:47.243+0000 7f04fe140640 1 -- 172.21.15.5:0/4292742591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f04f80678d0 con 0x7f04f80af2b0 2023-07-14T13:29:48.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.187+0000 7f04dffff640 1 -- 172.21.15.5:0/4292742591 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v82) v1 ==== 118+0+0 (secure 0 0 0) 0x7f04f00c70b0 con 0x7f04f80af2b0 2023-07-14T13:29:48.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.187+0000 7f04fe140640 1 -- 172.21.15.5:0/4292742591 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f04e40663a0 msgr2=0x7f04e4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:48.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.187+0000 7f04fe140640 1 --2- 172.21.15.5:0/4292742591 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f04e40663a0 0x7f04e4068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f04e8005890 tx=0x7f04e8009040 comp rx=0 tx=0).stop 2023-07-14T13:29:48.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.187+0000 7f04fe140640 1 -- 172.21.15.5:0/4292742591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f80af2b0 msgr2=0x7f04f80b35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:48.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.187+0000 7f04fe140640 1 --2- 172.21.15.5:0/4292742591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f80af2b0 0x7f04f80b35d0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f04f0009d90 tx=0x7f04f00196f0 comp rx=0 tx=0).stop 2023-07-14T13:29:48.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.187+0000 7f04fe140640 1 -- 172.21.15.5:0/4292742591 shutdown_connections 2023-07-14T13:29:48.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.187+0000 7f04fe140640 1 --2- 172.21.15.5:0/4292742591 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f04e40663a0 0x7f04e4068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:48.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.187+0000 7f04fe140640 1 --2- 172.21.15.5:0/4292742591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f80af2b0 0x7f04f80b35d0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:48.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.187+0000 7f04fe140640 1 --2- 172.21.15.5:0/4292742591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04f8070f30 0x7f04f80cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:48.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.187+0000 7f04fe140640 1 --2- 172.21.15.5:0/4292742591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04f8069430 0x7f04f81f44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:48.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.187+0000 7f04fe140640 1 -- 172.21.15.5:0/4292742591 >> 172.21.15.5:0/4292742591 conn(0x7f04f80cde90 msgr2=0x7f04f80aceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:48.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.187+0000 7f04fe140640 1 -- 172.21.15.5:0/4292742591 shutdown_connections 2023-07-14T13:29:48.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.187+0000 7f04fe140640 1 -- 172.21.15.5:0/4292742591 wait complete. 2023-07-14T13:29:48.213 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-14T13:29:48.213 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-14T13:29:48.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.363+0000 7fb26bc34640 1 Processor -- start 2023-07-14T13:29:48.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.363+0000 7fb26bc34640 1 -- start start 2023-07-14T13:29:48.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.363+0000 7fb26bc34640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb2640d2300 0x7fb2640d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:48.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.363+0000 7fb26bc34640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2640b04c0 con 0x7fb26415bde0 2023-07-14T13:29:48.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.363+0000 7fb26bc34640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2640b1060 con 0x7fb2640d2fc0 2023-07-14T13:29:48.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.363+0000 7fb26bc34640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb26415c1b0 con 0x7fb2640d2300 2023-07-14T13:29:48.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.363+0000 7fb2699d0640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb26415bde0 0x7fb2640d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43138/0 (socket says 172.21.15.5:43138) 2023-07-14T13:29:48.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.363+0000 7fb2699d0640 1 -- 172.21.15.5:0/2477659452 learned_addr learned my addr 172.21.15.5:0/2477659452 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:48.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.363+0000 7fb26a1d1640 1 --2- 172.21.15.5:0/2477659452 >> v2:172.21.15.5:3300/0 conn(0x7fb2640d2300 0x7fb2640d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:48.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.363+0000 7fb2689ce640 1 -- 172.21.15.5:0/2477659452 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 102532611 0 0) 0x7fb2640b04c0 con 0x7fb26415bde0 2023-07-14T13:29:48.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.363+0000 7fb2689ce640 1 -- 172.21.15.5:0/2477659452 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb250003530 con 0x7fb26415bde0 2023-07-14T13:29:48.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.363+0000 7fb26a1d1640 1 -- 172.21.15.5:0/2477659452 >> v1:172.21.15.154:6789/0 conn(0x7fb2640d2fc0 legacy=0x7fb2640b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:48.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.363+0000 7fb26a1d1640 1 -- 172.21.15.5:0/2477659452 >> v1:172.21.15.5:6789/0 conn(0x7fb26415bde0 legacy=0x7fb2640d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:48.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.363+0000 7fb26a1d1640 1 -- 172.21.15.5:0/2477659452 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2640d2c80 con 0x7fb2640d2300 2023-07-14T13:29:48.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.367+0000 7fb26a1d1640 1 --2- 172.21.15.5:0/2477659452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2640d2300 0x7fb2640d2740 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fb25c009d90 tx=0x7fb25c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a6f3668ecffcee5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:48.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.367+0000 7fb2689ce640 1 -- 172.21.15.5:0/2477659452 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c0a5920 con 0x7fb2640d2300 2023-07-14T13:29:48.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.367+0000 7fb2689ce640 1 -- 172.21.15.5:0/2477659452 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25c0a5a80 con 0x7fb2640d2300 2023-07-14T13:29:48.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.367+0000 7fb2689ce640 1 -- 172.21.15.5:0/2477659452 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c0a5df0 con 0x7fb2640d2300 2023-07-14T13:29:48.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.367+0000 7fb26bc34640 1 -- 172.21.15.5:0/2477659452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2640d2300 msgr2=0x7fb2640d2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:48.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.367+0000 7fb26bc34640 1 --2- 172.21.15.5:0/2477659452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2640d2300 0x7fb2640d2740 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fb25c009d90 tx=0x7fb25c01c950 comp rx=0 tx=0).stop 2023-07-14T13:29:48.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.367+0000 7fb26bc34640 1 -- 172.21.15.5:0/2477659452 shutdown_connections 2023-07-14T13:29:48.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.367+0000 7fb26bc34640 1 --2- 172.21.15.5:0/2477659452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2640d2300 0x7fb2640d2740 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:48.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.367+0000 7fb26bc34640 1 -- 172.21.15.5:0/2477659452 >> 172.21.15.5:0/2477659452 conn(0x7fb2640659d0 msgr2=0x7fb26409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:48.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.367+0000 7fb26bc34640 1 -- 172.21.15.5:0/2477659452 shutdown_connections 2023-07-14T13:29:48.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.367+0000 7fb26bc34640 1 -- 172.21.15.5:0/2477659452 wait complete. 2023-07-14T13:29:48.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.371+0000 7fb26bc34640 1 Processor -- start 2023-07-14T13:29:48.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.371+0000 7fb26bc34640 1 -- start start 2023-07-14T13:29:48.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.371+0000 7fb26bc34640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2640d2300 0x7fb2640b6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:48.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.371+0000 7fb26bc34640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2640d2fc0 0x7fb2640b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:48.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.371+0000 7fb26bc34640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb26415bde0 0x7fb264152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:48.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.371+0000 7fb26bc34640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2640b23b0 con 0x7fb2640d2fc0 2023-07-14T13:29:48.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.371+0000 7fb26bc34640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2640b25c0 con 0x7fb26415bde0 2023-07-14T13:29:48.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.371+0000 7fb26bc34640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2640b2b00 con 0x7fb2640d2300 2023-07-14T13:29:48.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.371+0000 7fb2691cf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2640d2fc0 0x7fb2640b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:48.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.371+0000 7fb2691cf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2640d2fc0 0x7fb2640b1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49016/0 (socket says 172.21.15.5:49016) 2023-07-14T13:29:48.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.371+0000 7fb2691cf640 1 -- 172.21.15.5:0/2590661826 learned_addr learned my addr 172.21.15.5:0/2590661826 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:48.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.371+0000 7fb2699d0640 1 --2- 172.21.15.5:0/2590661826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2640d2300 0x7fb2640b6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:48.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.371+0000 7fb2691cf640 1 -- 172.21.15.5:0/2590661826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2640d2300 msgr2=0x7fb2640b6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:48.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.371+0000 7fb26a1d1640 1 --2- 172.21.15.5:0/2590661826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb26415bde0 0x7fb264152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:48.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.371+0000 7fb2691cf640 1 --2- 172.21.15.5:0/2590661826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2640d2300 0x7fb2640b6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:48.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.371+0000 7fb2691cf640 1 -- 172.21.15.5:0/2590661826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb26415bde0 msgr2=0x7fb264152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:48.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.371+0000 7fb2691cf640 1 --2- 172.21.15.5:0/2590661826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb26415bde0 0x7fb264152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:48.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.371+0000 7fb2691cf640 1 -- 172.21.15.5:0/2590661826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb25c009a70 con 0x7fb2640d2fc0 2023-07-14T13:29:48.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.371+0000 7fb2699d0640 1 --2- 172.21.15.5:0/2590661826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2640d2300 0x7fb2640b6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:29:48.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.371+0000 7fb26a1d1640 1 --2- 172.21.15.5:0/2590661826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb26415bde0 0x7fb264152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:29:48.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.371+0000 7fb2691cf640 1 --2- 172.21.15.5:0/2590661826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2640d2fc0 0x7fb2640b1e70 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fb25400c430 tx=0x7fb25400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:48.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.371+0000 7fb25a7fc640 1 -- 172.21.15.5:0/2590661826 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2540052d0 con 0x7fb2640d2fc0 2023-07-14T13:29:48.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.371+0000 7fb25a7fc640 1 -- 172.21.15.5:0/2590661826 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb254005430 con 0x7fb2640d2fc0 2023-07-14T13:29:48.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.371+0000 7fb26bc34640 1 -- 172.21.15.5:0/2590661826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2640b2de0 con 0x7fb2640d2fc0 2023-07-14T13:29:48.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.371+0000 7fb25a7fc640 1 -- 172.21.15.5:0/2590661826 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb254007260 con 0x7fb2640d2fc0 2023-07-14T13:29:48.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.371+0000 7fb26bc34640 1 -- 172.21.15.5:0/2590661826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2640b33a0 con 0x7fb2640d2fc0 2023-07-14T13:29:48.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.375+0000 7fb26bc34640 1 -- 172.21.15.5:0/2590661826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2640678d0 con 0x7fb2640d2fc0 2023-07-14T13:29:48.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.375+0000 7fb25a7fc640 1 -- 172.21.15.5:0/2590661826 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb2540073c0 con 0x7fb2640d2fc0 2023-07-14T13:29:48.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.375+0000 7fb25a7fc640 1 --2- 172.21.15.5:0/2590661826 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fb2480663a0 0x7fb248068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:48.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.375+0000 7fb25a7fc640 1 -- 172.21.15.5:0/2590661826 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fb2540832d0 con 0x7fb2640d2fc0 2023-07-14T13:29:48.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.375+0000 7fb2699d0640 1 --2- 172.21.15.5:0/2590661826 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fb2480663a0 0x7fb248068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:48.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.375+0000 7fb2699d0640 1 --2- 172.21.15.5:0/2590661826 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fb2480663a0 0x7fb248068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb260007fd0 tx=0x7fb260009040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:48.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.379+0000 7fb25a7fc640 1 -- 172.21.15.5:0/2590661826 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb254050620 con 0x7fb2640d2fc0 2023-07-14T13:29:48.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:48.567+0000 7fb26bc34640 1 -- 172.21.15.5:0/2590661826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb26415f570 con 0x7fb2640d2fc0 2023-07-14T13:29:49.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.195+0000 7fb25a7fc640 1 -- 172.21.15.5:0/2590661826 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v83) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb254053c40 con 0x7fb2640d2fc0 2023-07-14T13:29:49.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.199+0000 7fb26bc34640 1 -- 172.21.15.5:0/2590661826 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fb2480663a0 msgr2=0x7fb248068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:49.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.199+0000 7fb26bc34640 1 --2- 172.21.15.5:0/2590661826 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fb2480663a0 0x7fb248068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb260007fd0 tx=0x7fb260009040 comp rx=0 tx=0).stop 2023-07-14T13:29:49.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.199+0000 7fb26bc34640 1 -- 172.21.15.5:0/2590661826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2640d2fc0 msgr2=0x7fb2640b1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:49.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.199+0000 7fb26bc34640 1 --2- 172.21.15.5:0/2590661826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2640d2fc0 0x7fb2640b1e70 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fb25400c430 tx=0x7fb25400c8f0 comp rx=0 tx=0).stop 2023-07-14T13:29:49.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.199+0000 7fb26bc34640 1 -- 172.21.15.5:0/2590661826 shutdown_connections 2023-07-14T13:29:49.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.199+0000 7fb26bc34640 1 --2- 172.21.15.5:0/2590661826 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fb2480663a0 0x7fb248068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:49.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.199+0000 7fb26bc34640 1 --2- 172.21.15.5:0/2590661826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb26415bde0 0x7fb264152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:49.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.199+0000 7fb26bc34640 1 --2- 172.21.15.5:0/2590661826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2640d2fc0 0x7fb2640b1e70 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:49.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.199+0000 7fb26bc34640 1 --2- 172.21.15.5:0/2590661826 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2640d2300 0x7fb2640b6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:49.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.199+0000 7fb26bc34640 1 -- 172.21.15.5:0/2590661826 >> 172.21.15.5:0/2590661826 conn(0x7fb2640659d0 msgr2=0x7fb2640cdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:49.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.199+0000 7fb26bc34640 1 -- 172.21.15.5:0/2590661826 shutdown_connections 2023-07-14T13:29:49.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.199+0000 7fb26bc34640 1 -- 172.21.15.5:0/2590661826 wait complete. 2023-07-14T13:29:49.221 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-14T13:29:49.221 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:29:49.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.363+0000 7f196287b640 1 Processor -- start 2023-07-14T13:29:49.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.363+0000 7f196287b640 1 -- start start 2023-07-14T13:29:49.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.367+0000 7f196287b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f195c15fdf0 0x7f195c0c9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:49.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.367+0000 7f196287b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195c0cb080 con 0x7f195c15f970 2023-07-14T13:29:49.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.367+0000 7f196287b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195c0cb2e0 con 0x7f195c15bdf0 2023-07-14T13:29:49.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.367+0000 7f196287b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f195c0cb5c0 con 0x7f195c15fdf0 2023-07-14T13:29:49.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.367+0000 7f1953fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f195c15f970 0x7f195c0c8e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45974/0 (socket says 172.21.15.5:45974) 2023-07-14T13:29:49.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.367+0000 7f1953fff640 1 -- 172.21.15.5:0/1290294085 learned_addr learned my addr 172.21.15.5:0/1290294085 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:49.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.367+0000 7f1960e18640 1 --2- 172.21.15.5:0/1290294085 >> v2:172.21.15.5:3300/0 conn(0x7f195c15fdf0 0x7f195c0c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:49.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.367+0000 7f195b7fe640 1 -- 172.21.15.5:0/1290294085 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357266810 0 0) 0x7f195c0cb080 con 0x7f195c15f970 2023-07-14T13:29:49.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.367+0000 7f195b7fe640 1 -- 172.21.15.5:0/1290294085 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1948003530 con 0x7f195c15f970 2023-07-14T13:29:49.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.367+0000 7f1960e18640 1 -- 172.21.15.5:0/1290294085 >> v1:172.21.15.154:6789/0 conn(0x7f195c15bdf0 legacy=0x7f195c0ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:49.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.367+0000 7f1960e18640 1 -- 172.21.15.5:0/1290294085 >> v1:172.21.15.5:6789/0 conn(0x7f195c15f970 legacy=0x7f195c0c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:49.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.367+0000 7f1960e18640 1 -- 172.21.15.5:0/1290294085 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c0cb8a0 con 0x7f195c15fdf0 2023-07-14T13:29:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.371+0000 7f1960e18640 1 --2- 172.21.15.5:0/1290294085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f195c15fdf0 0x7f195c0c9580 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f1954009d90 tx=0x7f195401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7dc77a376f6098c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.371+0000 7f195b7fe640 1 -- 172.21.15.5:0/1290294085 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19540a5970 con 0x7f195c15fdf0 2023-07-14T13:29:49.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.371+0000 7f195b7fe640 1 -- 172.21.15.5:0/1290294085 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19540a5ad0 con 0x7f195c15fdf0 2023-07-14T13:29:49.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.371+0000 7f195b7fe640 1 -- 172.21.15.5:0/1290294085 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19540a5e40 con 0x7f195c15fdf0 2023-07-14T13:29:49.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.371+0000 7f196287b640 1 -- 172.21.15.5:0/1290294085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f195c15fdf0 msgr2=0x7f195c0c9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:49.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.371+0000 7f196287b640 1 --2- 172.21.15.5:0/1290294085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f195c15fdf0 0x7f195c0c9580 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f1954009d90 tx=0x7f195401c890 comp rx=0 tx=0).stop 2023-07-14T13:29:49.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.371+0000 7f196287b640 1 -- 172.21.15.5:0/1290294085 shutdown_connections 2023-07-14T13:29:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.371+0000 7f196287b640 1 --2- 172.21.15.5:0/1290294085 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f195c15fdf0 0x7f195c0c9580 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.371+0000 7f196287b640 1 -- 172.21.15.5:0/1290294085 >> 172.21.15.5:0/1290294085 conn(0x7f195c0afcf0 msgr2=0x7f195c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.371+0000 7f196287b640 1 -- 172.21.15.5:0/1290294085 shutdown_connections 2023-07-14T13:29:49.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.371+0000 7f196287b640 1 -- 172.21.15.5:0/1290294085 wait complete. 2023-07-14T13:29:49.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.371+0000 7f196287b640 1 Processor -- start 2023-07-14T13:29:49.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.371+0000 7f196287b640 1 -- start start 2023-07-14T13:29:49.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.371+0000 7f196287b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f195c15bdf0 0x7f195c1459b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:49.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.371+0000 7f196287b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f195c15f970 0x7f195c14b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:49.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.371+0000 7f196287b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f195c15fdf0 0x7f195c151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:49.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.371+0000 7f196287b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c145ef0 con 0x7f195c15fdf0 2023-07-14T13:29:49.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.371+0000 7f196287b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c155c60 con 0x7f195c15bdf0 2023-07-14T13:29:49.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.371+0000 7f196287b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c155100 con 0x7f195c15f970 2023-07-14T13:29:49.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.375+0000 7f1960e18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f195c15fdf0 0x7f195c151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:49.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.375+0000 7f1960e18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f195c15fdf0 0x7f195c151800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52514/0 (socket says 172.21.15.5:52514) 2023-07-14T13:29:49.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.375+0000 7f1960e18640 1 -- 172.21.15.5:0/144236323 learned_addr learned my addr 172.21.15.5:0/144236323 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:49.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.375+0000 7f1953fff640 1 --2- 172.21.15.5:0/144236323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f195c15f970 0x7f195c14b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:49.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.375+0000 7f195bfff640 1 --2- 172.21.15.5:0/144236323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f195c15bdf0 0x7f195c1459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.375+0000 7f1960e18640 1 -- 172.21.15.5:0/144236323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f195c15f970 msgr2=0x7f195c14b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.375+0000 7f1960e18640 1 --2- 172.21.15.5:0/144236323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f195c15f970 0x7f195c14b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.375+0000 7f1960e18640 1 -- 172.21.15.5:0/144236323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f195c15bdf0 msgr2=0x7f195c1459b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:49.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.375+0000 7f1960e18640 1 --2- 172.21.15.5:0/144236323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f195c15bdf0 0x7f195c1459b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.375+0000 7f1960e18640 1 -- 172.21.15.5:0/144236323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1954009a70 con 0x7f195c15fdf0 2023-07-14T13:29:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.375+0000 7f195bfff640 1 --2- 172.21.15.5:0/144236323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f195c15bdf0 0x7f195c1459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:29:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.375+0000 7f1960e18640 1 --2- 172.21.15.5:0/144236323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f195c15fdf0 0x7f195c151800 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f19540194a0 tx=0x7f1954019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.375+0000 7f19597fa640 1 -- 172.21.15.5:0/144236323 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1954003db0 con 0x7f195c15fdf0 2023-07-14T13:29:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.375+0000 7f19597fa640 1 -- 172.21.15.5:0/144236323 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19540a58f0 con 0x7f195c15fdf0 2023-07-14T13:29:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.375+0000 7f196287b640 1 -- 172.21.15.5:0/144236323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195c1553c0 con 0x7f195c15fdf0 2023-07-14T13:29:49.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.375+0000 7f19597fa640 1 -- 172.21.15.5:0/144236323 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1954004240 con 0x7f195c15fdf0 2023-07-14T13:29:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.375+0000 7f196287b640 1 -- 172.21.15.5:0/144236323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195c155980 con 0x7f195c15fdf0 2023-07-14T13:29:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.375+0000 7f196287b640 1 -- 172.21.15.5:0/144236323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f195c0678d0 con 0x7f195c15fdf0 2023-07-14T13:29:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.375+0000 7f19597fa640 1 -- 172.21.15.5:0/144236323 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f19540043a0 con 0x7f195c15fdf0 2023-07-14T13:29:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.379+0000 7f19597fa640 1 --2- 172.21.15.5:0/144236323 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f193c0663a0 0x7f193c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.379+0000 7f19597fa640 1 -- 172.21.15.5:0/144236323 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f195411f070 con 0x7f195c15fdf0 2023-07-14T13:29:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.379+0000 7f195bfff640 1 --2- 172.21.15.5:0/144236323 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f193c0663a0 0x7f193c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:49.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.379+0000 7f195bfff640 1 --2- 172.21.15.5:0/144236323 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f193c0663a0 0x7f193c068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f194c000f70 tx=0x7f194c009040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:49.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.383+0000 7f19597fa640 1 -- 172.21.15.5:0/144236323 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f19540ec450 con 0x7f195c15fdf0 2023-07-14T13:29:49.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.571+0000 7f196287b640 1 -- 172.21.15.5:0/144236323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f195c06c380 con 0x7f195c15fdf0 2023-07-14T13:29:49.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.571+0000 7f19597fa640 1 -- 172.21.15.5:0/144236323 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4710 (secure 0 0 0) 0x7f19540efa70 con 0x7f195c15fdf0 2023-07-14T13:29:49.573 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:29:49.573 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2329374117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2329374117},{"type":"v1","addr":"172.21.15.154:6835","nonce":2329374117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":9457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/811714286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":811714286},{"type":"v1","addr":"172.21.15.154:6837","nonce":811714286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":9954,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3020438262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3020438262},{"type":"v1","addr":"172.21.15.5:6833","nonce":3020438262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:29:45.555298+0000","modified":"2023-07-14T13:29:49.191310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9966":{"gid":9966,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/3098088945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3098088945},{"type":"v1","addr":"172.21.15.5:6835","nonce":3098088945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-14T13:29:49.574 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 83 2023-07-14T13:29:49.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.571+0000 7f196287b640 1 -- 172.21.15.5:0/144236323 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f193c0663a0 msgr2=0x7f193c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:49.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.571+0000 7f196287b640 1 --2- 172.21.15.5:0/144236323 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f193c0663a0 0x7f193c068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f194c000f70 tx=0x7f194c009040 comp rx=0 tx=0).stop 2023-07-14T13:29:49.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.571+0000 7f196287b640 1 -- 172.21.15.5:0/144236323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f195c15fdf0 msgr2=0x7f195c151800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:49.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.571+0000 7f196287b640 1 --2- 172.21.15.5:0/144236323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f195c15fdf0 0x7f195c151800 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f19540194a0 tx=0x7f1954019630 comp rx=0 tx=0).stop 2023-07-14T13:29:49.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.571+0000 7f196287b640 1 -- 172.21.15.5:0/144236323 shutdown_connections 2023-07-14T13:29:49.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.571+0000 7f196287b640 1 --2- 172.21.15.5:0/144236323 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f193c0663a0 0x7f193c068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:49.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.571+0000 7f196287b640 1 --2- 172.21.15.5:0/144236323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f195c15fdf0 0x7f195c151800 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:49.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.571+0000 7f196287b640 1 --2- 172.21.15.5:0/144236323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f195c15f970 0x7f195c14b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:49.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.571+0000 7f196287b640 1 --2- 172.21.15.5:0/144236323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f195c15bdf0 0x7f195c1459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:49.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.571+0000 7f196287b640 1 -- 172.21.15.5:0/144236323 >> 172.21.15.5:0/144236323 conn(0x7f195c0afcf0 msgr2=0x7f195c0ab8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:49.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.571+0000 7f196287b640 1 -- 172.21.15.5:0/144236323 shutdown_connections 2023-07-14T13:29:49.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.571+0000 7f196287b640 1 -- 172.21.15.5:0/144236323 wait complete. 2023-07-14T13:29:49.594 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:29:49.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.735+0000 7fb5e4eca640 1 Processor -- start 2023-07-14T13:29:49.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.735+0000 7fb5e4eca640 1 -- start start 2023-07-14T13:29:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5e4eca640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb5e00cf4d0 0x7fb5e0071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5e4eca640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e01592c0 con 0x7fb5e0158950 2023-07-14T13:29:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5e4eca640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e01595a0 con 0x7fb5e006d020 2023-07-14T13:29:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5e4eca640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5e0159880 con 0x7fb5e00cf4d0 2023-07-14T13:29:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5de59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb5e0158950 0x7fb5e0159e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45978/0 (socket says 172.21.15.5:45978) 2023-07-14T13:29:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5de59c640 1 -- 172.21.15.5:0/3019171859 learned_addr learned my addr 172.21.15.5:0/3019171859 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:49.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5ded9d640 1 --2- 172.21.15.5:0/3019171859 >> v2:172.21.15.154:3300/0 conn(0x7fb5e00cf4d0 0x7fb5e0071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:49.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5dd59a640 1 -- 172.21.15.5:0/3019171859 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 805346714 0 0) 0x7fb5e01592c0 con 0x7fb5e0158950 2023-07-14T13:29:49.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5dd59a640 1 -- 172.21.15.5:0/3019171859 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5c8003530 con 0x7fb5e0158950 2023-07-14T13:29:49.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5dd59a640 1 -- 172.21.15.5:0/3019171859 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2535126971 0 0) 0x7fb5c8003530 con 0x7fb5e0158950 2023-07-14T13:29:49.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5dd59a640 1 -- 172.21.15.5:0/3019171859 >> v2:172.21.15.154:3300/0 conn(0x7fb5e00cf4d0 msgr2=0x7fb5e0071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:49.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5dd59a640 1 --2- 172.21.15.5:0/3019171859 >> v2:172.21.15.154:3300/0 conn(0x7fb5e00cf4d0 0x7fb5e0071530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:49.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5dd59a640 1 -- 172.21.15.5:0/3019171859 >> v1:172.21.15.154:6789/0 conn(0x7fb5e006d020 legacy=0x7fb5e00cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:49.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5dd59a640 1 -- 172.21.15.5:0/3019171859 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e0159b60 con 0x7fb5e0158950 2023-07-14T13:29:49.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5dd59a640 1 -- 172.21.15.5:0/3019171859 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7fb5d0001680 con 0x7fb5e0158950 2023-07-14T13:29:49.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5dd59a640 1 -- 172.21.15.5:0/3019171859 >> v1:172.21.15.5:6789/0 conn(0x7fb5e0158950 legacy=0x7fb5e0159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:49.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5dd59a640 1 --2- 172.21.15.5:0/3019171859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5c8003980 0x7fb5c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:49.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5dd59a640 1 --2- 172.21.15.5:0/3019171859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c80047d0 0x7fb5c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:49.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5dd59a640 1 --2- 172.21.15.5:0/3019171859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5c8005180 0x7fb5c800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:49.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5dd59a640 1 -- 172.21.15.5:0/3019171859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e0159880 con 0x7fb5c80047d0 2023-07-14T13:29:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5dd59a640 1 -- 172.21.15.5:0/3019171859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c800e210 con 0x7fb5c8003980 2023-07-14T13:29:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5dd59a640 1 -- 172.21.15.5:0/3019171859 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c800e3d0 con 0x7fb5c8005180 2023-07-14T13:29:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5ddd9b640 1 --2- 172.21.15.5:0/3019171859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c80047d0 0x7fb5c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5de59c640 1 --2- 172.21.15.5:0/3019171859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5c8003980 0x7fb5c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5ded9d640 1 --2- 172.21.15.5:0/3019171859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5c8005180 0x7fb5c800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5ddd9b640 1 -- 172.21.15.5:0/3019171859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5c8005180 msgr2=0x7fb5c800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5ddd9b640 1 --2- 172.21.15.5:0/3019171859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5c8005180 0x7fb5c800dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:49.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5ddd9b640 1 -- 172.21.15.5:0/3019171859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5c8003980 msgr2=0x7fb5c8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5ddd9b640 1 --2- 172.21.15.5:0/3019171859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5c8003980 0x7fb5c8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5ddd9b640 1 -- 172.21.15.5:0/3019171859 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c8003530 con 0x7fb5c80047d0 2023-07-14T13:29:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5ded9d640 1 --2- 172.21.15.5:0/3019171859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5c8005180 0x7fb5c800dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:29:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5de59c640 1 --2- 172.21.15.5:0/3019171859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5c8003980 0x7fb5c8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:29:49.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.739+0000 7fb5ded9d640 1 -- 172.21.15.5:0/3019171859 reap_dead start 2023-07-14T13:29:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.743+0000 7fb5ddd9b640 1 --2- 172.21.15.5:0/3019171859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c80047d0 0x7fb5c8004c40 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4001780 tx=0x7fb5d401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f246151de85a8d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.743+0000 7fb5dd59a640 1 -- 172.21.15.5:0/3019171859 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d40052d0 con 0x7fb5c80047d0 2023-07-14T13:29:49.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.743+0000 7fb5dd59a640 1 -- 172.21.15.5:0/3019171859 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d40a7050 con 0x7fb5c80047d0 2023-07-14T13:29:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.743+0000 7fb5dd59a640 1 -- 172.21.15.5:0/3019171859 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4003600 con 0x7fb5c80047d0 2023-07-14T13:29:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.743+0000 7fb5e4eca640 1 -- 172.21.15.5:0/3019171859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c80047d0 msgr2=0x7fb5c8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.743+0000 7fb5e4eca640 1 --2- 172.21.15.5:0/3019171859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c80047d0 0x7fb5c8004c40 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4001780 tx=0x7fb5d401c3e0 comp rx=0 tx=0).stop 2023-07-14T13:29:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.743+0000 7fb5e4eca640 1 -- 172.21.15.5:0/3019171859 shutdown_connections 2023-07-14T13:29:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.743+0000 7fb5e4eca640 1 --2- 172.21.15.5:0/3019171859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c80047d0 0x7fb5c8004c40 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.743+0000 7fb5e4eca640 1 -- 172.21.15.5:0/3019171859 >> 172.21.15.5:0/3019171859 conn(0x7fb5e006a540 msgr2=0x7fb5e006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:49.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.743+0000 7fb5e4eca640 1 -- 172.21.15.5:0/3019171859 shutdown_connections 2023-07-14T13:29:49.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.743+0000 7fb5e4eca640 1 -- 172.21.15.5:0/3019171859 wait complete. 2023-07-14T13:29:49.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.743+0000 7fb5e4eca640 1 Processor -- start 2023-07-14T13:29:49.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.743+0000 7fb5e4eca640 1 -- start start 2023-07-14T13:29:49.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.747+0000 7fb5e4eca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c80047d0 0x7fb5e0150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:49.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.747+0000 7fb5e4eca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5e00ade90 0x7fb5e00c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:49.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.747+0000 7fb5e4eca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5e00cd4b0 0x7fb5e0144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:49.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.747+0000 7fb5e4eca640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e01517a0 con 0x7fb5c80047d0 2023-07-14T13:29:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.747+0000 7fb5e4eca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e014c8c0 con 0x7fb5e00ade90 2023-07-14T13:29:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.747+0000 7fb5e4eca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e00ae300 con 0x7fb5e00cd4b0 2023-07-14T13:29:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.747+0000 7fb5de59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c80047d0 0x7fb5e0150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.747+0000 7fb5de59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c80047d0 0x7fb5e0150440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52522/0 (socket says 172.21.15.5:52522) 2023-07-14T13:29:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.747+0000 7fb5de59c640 1 -- 172.21.15.5:0/2704650739 learned_addr learned my addr 172.21.15.5:0/2704650739 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.747+0000 7fb5de59c640 1 -- 172.21.15.5:0/2704650739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5e00cd4b0 msgr2=0x7fb5e0144ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:49.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.747+0000 7fb5de59c640 1 --2- 172.21.15.5:0/2704650739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5e00cd4b0 0x7fb5e0144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.747+0000 7fb5de59c640 1 -- 172.21.15.5:0/2704650739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5e00ade90 msgr2=0x7fb5e00c60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.747+0000 7fb5de59c640 1 --2- 172.21.15.5:0/2704650739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5e00ade90 0x7fb5e00c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.747+0000 7fb5de59c640 1 -- 172.21.15.5:0/2704650739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e0150b20 con 0x7fb5c80047d0 2023-07-14T13:29:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.747+0000 7fb5de59c640 1 --2- 172.21.15.5:0/2704650739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c80047d0 0x7fb5e0150440 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0012490 tx=0x7fb5d0012580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.747+0000 7fb5ceffd640 1 -- 172.21.15.5:0/2704650739 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d00153e0 con 0x7fb5c80047d0 2023-07-14T13:29:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.747+0000 7fb5ceffd640 1 -- 172.21.15.5:0/2704650739 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d0015540 con 0x7fb5c80047d0 2023-07-14T13:29:49.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.747+0000 7fb5ceffd640 1 -- 172.21.15.5:0/2704650739 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d00158f0 con 0x7fb5c80047d0 2023-07-14T13:29:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.747+0000 7fb5e4eca640 1 -- 172.21.15.5:0/2704650739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e0150e00 con 0x7fb5c80047d0 2023-07-14T13:29:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.747+0000 7fb5e4eca640 1 -- 172.21.15.5:0/2704650739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e01513c0 con 0x7fb5c80047d0 2023-07-14T13:29:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.747+0000 7fb5e4eca640 1 -- 172.21.15.5:0/2704650739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5e00c28c0 con 0x7fb5c80047d0 2023-07-14T13:29:49.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.751+0000 7fb5ceffd640 1 -- 172.21.15.5:0/2704650739 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb5d0015a50 con 0x7fb5c80047d0 2023-07-14T13:29:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.751+0000 7fb5ceffd640 1 --2- 172.21.15.5:0/2704650739 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fb5c00663d0 0x7fb5c0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.751+0000 7fb5ceffd640 1 -- 172.21.15.5:0/2704650739 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fb5d0086190 con 0x7fb5c80047d0 2023-07-14T13:29:49.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.751+0000 7fb5ddd9b640 1 --2- 172.21.15.5:0/2704650739 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fb5c00663d0 0x7fb5c0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:49.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.751+0000 7fb5ddd9b640 1 --2- 172.21.15.5:0/2704650739 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fb5c00663d0 0x7fb5c0068880 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4001750 tx=0x7fb5d4001130 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:49.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.755+0000 7fb5ceffd640 1 -- 172.21.15.5:0/2704650739 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb5d00534e0 con 0x7fb5c80047d0 2023-07-14T13:29:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.907+0000 7fb5e4eca640 1 -- 172.21.15.5:0/2704650739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5e00678d0 con 0x7fb5c80047d0 2023-07-14T13:29:49.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.911+0000 7fb5ceffd640 1 -- 172.21.15.5:0/2704650739 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v172) v1 ==== 74+0+18297 (secure 0 0 0) 0x7fb5d0007cf0 con 0x7fb5c80047d0 2023-07-14T13:29:49.915 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:29:49.915 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":172,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:29:47.136826+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:29:43.300974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-14T13:29:44.554824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:29:49.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.911+0000 7fb5e4eca640 1 -- 172.21.15.5:0/2704650739 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fb5c00663d0 msgr2=0x7fb5c0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:49.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.911+0000 7fb5e4eca640 1 --2- 172.21.15.5:0/2704650739 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fb5c00663d0 0x7fb5c0068880 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4001750 tx=0x7fb5d4001130 comp rx=0 tx=0).stop 2023-07-14T13:29:49.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.911+0000 7fb5e4eca640 1 -- 172.21.15.5:0/2704650739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c80047d0 msgr2=0x7fb5e0150440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:49.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.911+0000 7fb5e4eca640 1 --2- 172.21.15.5:0/2704650739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c80047d0 0x7fb5e0150440 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0012490 tx=0x7fb5d0012580 comp rx=0 tx=0).stop 2023-07-14T13:29:49.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.911+0000 7fb5e4eca640 1 -- 172.21.15.5:0/2704650739 shutdown_connections 2023-07-14T13:29:49.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.911+0000 7fb5e4eca640 1 --2- 172.21.15.5:0/2704650739 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fb5c00663d0 0x7fb5c0068880 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:49.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.911+0000 7fb5e4eca640 1 --2- 172.21.15.5:0/2704650739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5e00cd4b0 0x7fb5e0144ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.911+0000 7fb5e4eca640 1 --2- 172.21.15.5:0/2704650739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5e00ade90 0x7fb5e00c60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.911+0000 7fb5e4eca640 1 --2- 172.21.15.5:0/2704650739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5c80047d0 0x7fb5e0150440 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.911+0000 7fb5e4eca640 1 -- 172.21.15.5:0/2704650739 >> 172.21.15.5:0/2704650739 conn(0x7fb5e006a540 msgr2=0x7fb5e0070bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:49.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.911+0000 7fb5e4eca640 1 -- 172.21.15.5:0/2704650739 shutdown_connections 2023-07-14T13:29:49.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:49.911+0000 7fb5e4eca640 1 -- 172.21.15.5:0/2704650739 wait complete. 2023-07-14T13:29:49.934 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-14T13:29:49.935 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:29:50.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.079+0000 7f85ad720640 1 Processor -- start 2023-07-14T13:29:50.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.079+0000 7f85ad720640 1 -- start start 2023-07-14T13:29:50.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.079+0000 7f85ad720640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85a80b7d90 0x7f85a80cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:50.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.079+0000 7f85ad720640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f85a80d13f0 0x7f85a80ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:50.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.079+0000 7f85ad720640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a80d0f60 con 0x7f85a815f3f0 2023-07-14T13:29:50.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.079+0000 7f85ad720640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a80d0390 con 0x7f85a80d13f0 2023-07-14T13:29:50.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.079+0000 7f85ad720640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a80d0630 con 0x7f85a80b7d90 2023-07-14T13:29:50.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.079+0000 7f85a7fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f85a815f3f0 0x7f85a80b7680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45994/0 (socket says 172.21.15.5:45994) 2023-07-14T13:29:50.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.079+0000 7f85a7fff640 1 -- 172.21.15.5:0/2449046813 learned_addr learned my addr 172.21.15.5:0/2449046813 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:50.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.079+0000 7f85acf1f640 1 --2- 172.21.15.5:0/2449046813 >> v2:172.21.15.5:3300/0 conn(0x7f85a80d13f0 0x7f85a80ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:50.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.079+0000 7f85a77fe640 1 --2- 172.21.15.5:0/2449046813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85a80b7d90 0x7f85a80cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:50.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.079+0000 7f85a6ffd640 1 -- 172.21.15.5:0/2449046813 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1048711027 0 0) 0x7f85a80d0f60 con 0x7f85a815f3f0 2023-07-14T13:29:50.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.079+0000 7f85a6ffd640 1 -- 172.21.15.5:0/2449046813 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8590003530 con 0x7f85a815f3f0 2023-07-14T13:29:50.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.079+0000 7f85acf1f640 1 -- 172.21.15.5:0/2449046813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85a80b7d90 msgr2=0x7f85a80cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:50.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.079+0000 7f85acf1f640 1 --2- 172.21.15.5:0/2449046813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85a80b7d90 0x7f85a80cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:50.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.079+0000 7f85acf1f640 1 -- 172.21.15.5:0/2449046813 >> v1:172.21.15.5:6789/0 conn(0x7f85a815f3f0 legacy=0x7f85a80b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:50.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.079+0000 7f85acf1f640 1 -- 172.21.15.5:0/2449046813 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a80d0910 con 0x7f85a80d13f0 2023-07-14T13:29:50.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.083+0000 7f85acf1f640 1 --2- 172.21.15.5:0/2449046813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85a80d13f0 0x7f85a80ccee0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f85a0009d90 tx=0x7f85a001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd0260855a312e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:50.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.083+0000 7f85a6ffd640 1 -- 172.21.15.5:0/2449046813 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a00a5800 con 0x7f85a80d13f0 2023-07-14T13:29:50.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.083+0000 7f85a6ffd640 1 -- 172.21.15.5:0/2449046813 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a00a5960 con 0x7f85a80d13f0 2023-07-14T13:29:50.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.083+0000 7f85a6ffd640 1 -- 172.21.15.5:0/2449046813 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a00a5cf0 con 0x7f85a80d13f0 2023-07-14T13:29:50.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.083+0000 7f85ad720640 1 -- 172.21.15.5:0/2449046813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85a80d13f0 msgr2=0x7f85a80ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:50.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.083+0000 7f85ad720640 1 --2- 172.21.15.5:0/2449046813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85a80d13f0 0x7f85a80ccee0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f85a0009d90 tx=0x7f85a001c8c0 comp rx=0 tx=0).stop 2023-07-14T13:29:50.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.083+0000 7f85ad720640 1 -- 172.21.15.5:0/2449046813 shutdown_connections 2023-07-14T13:29:50.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.083+0000 7f85ad720640 1 --2- 172.21.15.5:0/2449046813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85a80d13f0 0x7f85a80ccee0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:50.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.083+0000 7f85ad720640 1 --2- 172.21.15.5:0/2449046813 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85a80b7d90 0x7f85a80cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:50.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.083+0000 7f85ad720640 1 -- 172.21.15.5:0/2449046813 >> 172.21.15.5:0/2449046813 conn(0x7f85a8069f50 msgr2=0x7f85a806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:50.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.083+0000 7f85ad720640 1 -- 172.21.15.5:0/2449046813 shutdown_connections 2023-07-14T13:29:50.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.083+0000 7f85ad720640 1 -- 172.21.15.5:0/2449046813 wait complete. 2023-07-14T13:29:50.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.083+0000 7f85ad720640 1 Processor -- start 2023-07-14T13:29:50.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.087+0000 7f85ad720640 1 -- start start 2023-07-14T13:29:50.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.087+0000 7f85ad720640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85a80b7d90 0x7f85a8158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:50.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.087+0000 7f85ad720640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85a80d13f0 0x7f85a806a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:50.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.087+0000 7f85ad720640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85a815f3f0 0x7f85a806a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:50.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.087+0000 7f85ad720640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a8161640 con 0x7f85a815f3f0 2023-07-14T13:29:50.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.087+0000 7f85ad720640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a8158aa0 con 0x7f85a80b7d90 2023-07-14T13:29:50.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.087+0000 7f85ad720640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a81609c0 con 0x7f85a80d13f0 2023-07-14T13:29:50.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.087+0000 7f85acf1f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85a815f3f0 0x7f85a806a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:50.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.087+0000 7f85acf1f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85a815f3f0 0x7f85a806a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52538/0 (socket says 172.21.15.5:52538) 2023-07-14T13:29:50.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.087+0000 7f85acf1f640 1 -- 172.21.15.5:0/1695552000 learned_addr learned my addr 172.21.15.5:0/1695552000 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:50.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.087+0000 7f85acf1f640 1 -- 172.21.15.5:0/1695552000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85a80d13f0 msgr2=0x7f85a806a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:50.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.087+0000 7f85acf1f640 1 --2- 172.21.15.5:0/1695552000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85a80d13f0 0x7f85a806a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:50.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.087+0000 7f85acf1f640 1 -- 172.21.15.5:0/1695552000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85a80b7d90 msgr2=0x7f85a8158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:50.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.087+0000 7f85acf1f640 1 --2- 172.21.15.5:0/1695552000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85a80b7d90 0x7f85a8158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.087+0000 7f85acf1f640 1 -- 172.21.15.5:0/1695552000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a0009a70 con 0x7f85a815f3f0 2023-07-14T13:29:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.087+0000 7f85acf1f640 1 --2- 172.21.15.5:0/1695552000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85a815f3f0 0x7f85a806a860 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f85a00b0040 tx=0x7f85a0019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.087+0000 7f85a4ff9640 1 -- 172.21.15.5:0/1695552000 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a00b9650 con 0x7f85a815f3f0 2023-07-14T13:29:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.087+0000 7f85a4ff9640 1 -- 172.21.15.5:0/1695552000 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a00b97b0 con 0x7f85a815f3f0 2023-07-14T13:29:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.087+0000 7f85a4ff9640 1 -- 172.21.15.5:0/1695552000 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a00b9b40 con 0x7f85a815f3f0 2023-07-14T13:29:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.087+0000 7f85ad720640 1 -- 172.21.15.5:0/1695552000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a8160ca0 con 0x7f85a815f3f0 2023-07-14T13:29:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.087+0000 7f85ad720640 1 -- 172.21.15.5:0/1695552000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a8161260 con 0x7f85a815f3f0 2023-07-14T13:29:50.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.087+0000 7f85ad720640 1 -- 172.21.15.5:0/1695552000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a80678d0 con 0x7f85a815f3f0 2023-07-14T13:29:50.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.091+0000 7f85a4ff9640 1 -- 172.21.15.5:0/1695552000 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f85a00b9ca0 con 0x7f85a815f3f0 2023-07-14T13:29:50.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.091+0000 7f85a4ff9640 1 --2- 172.21.15.5:0/1695552000 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f85940663a0 0x7f8594068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:50.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.091+0000 7f85a4ff9640 1 -- 172.21.15.5:0/1695552000 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f85a011f070 con 0x7f85a815f3f0 2023-07-14T13:29:50.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.091+0000 7f85a7fff640 1 --2- 172.21.15.5:0/1695552000 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f85940663a0 0x7f8594068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:50.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.091+0000 7f85a7fff640 1 --2- 172.21.15.5:0/1695552000 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f85940663a0 0x7f8594068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8598007fd0 tx=0x7f8598007940 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:50.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.095+0000 7f85a4ff9640 1 -- 172.21.15.5:0/1695552000 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f85a00ec450 con 0x7f85a815f3f0 2023-07-14T13:29:50.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.247+0000 7f85ad720640 1 -- 172.21.15.5:0/1695552000 --> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f85a80cd420 con 0x7f85940663a0 2023-07-14T13:29:50.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.259+0000 7f85a4ff9640 1 -- 172.21.15.5:0/1695552000 <== mgr.9247 v2:172.21.15.154:6832/1905284593 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+307174 (secure 0 0 0) 0x7f85980058c0 con 0x7f85940663a0 2023-07-14T13:29:50.263 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:29:50.265 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:29:50.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.263+0000 7f85ad720640 1 -- 172.21.15.5:0/1695552000 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f85940663a0 msgr2=0x7f8594068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:50.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.263+0000 7f85ad720640 1 --2- 172.21.15.5:0/1695552000 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f85940663a0 0x7f8594068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8598007fd0 tx=0x7f8598007940 comp rx=0 tx=0).stop 2023-07-14T13:29:50.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.263+0000 7f85ad720640 1 -- 172.21.15.5:0/1695552000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85a815f3f0 msgr2=0x7f85a806a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:50.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.263+0000 7f85ad720640 1 --2- 172.21.15.5:0/1695552000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85a815f3f0 0x7f85a806a860 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f85a00b0040 tx=0x7f85a0019660 comp rx=0 tx=0).stop 2023-07-14T13:29:50.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.263+0000 7f85ad720640 1 -- 172.21.15.5:0/1695552000 shutdown_connections 2023-07-14T13:29:50.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.263+0000 7f85ad720640 1 --2- 172.21.15.5:0/1695552000 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f85940663a0 0x7f8594068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:50.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.263+0000 7f85ad720640 1 --2- 172.21.15.5:0/1695552000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85a815f3f0 0x7f85a806a860 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:50.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.263+0000 7f85ad720640 1 --2- 172.21.15.5:0/1695552000 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85a80d13f0 0x7f85a806a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:50.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.263+0000 7f85ad720640 1 --2- 172.21.15.5:0/1695552000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85a80b7d90 0x7f85a8158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:50.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.263+0000 7f85ad720640 1 -- 172.21.15.5:0/1695552000 >> 172.21.15.5:0/1695552000 conn(0x7f85a8069f50 msgr2=0x7f85a815e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:50.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.263+0000 7f85ad720640 1 -- 172.21.15.5:0/1695552000 shutdown_connections 2023-07-14T13:29:50.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.263+0000 7f85ad720640 1 -- 172.21.15.5:0/1695552000 wait complete. 2023-07-14T13:29:50.284 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-14T13:29:50.058487+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":522,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":327,"ondisk_log_size":327,"up":166,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":365452,"kb_used_data":17868,"kb_used_omap":0,"kb_used_meta":347520,"kb_avail":754609268,"statfs":{"total":773094113280,"available":772719890432,"internally_reserved":0,"allocated":18296832,"data_stored":9929899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":355860480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.912780"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479686+0000","last_change":"2023-07-14T13:29:46.159865+0000","last_active":"2023-07-14T13:29:48.479686+0000","last_peered":"2023-07-14T13:29:48.479686+0000","last_clean":"2023-07-14T13:29:48.479686+0000","last_became_active":"2023-07-14T13:29:46.159410+0000","last_became_peered":"2023-07-14T13:29:46.159410+0000","last_unstale":"2023-07-14T13:29:48.479686+0000","last_undegraded":"2023-07-14T13:29:48.479686+0000","last_fullsized":"2023-07-14T13:29:48.479686+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:01.004278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479590+0000","last_change":"2023-07-14T13:29:46.162495+0000","last_active":"2023-07-14T13:29:48.479590+0000","last_peered":"2023-07-14T13:29:48.479590+0000","last_clean":"2023-07-14T13:29:48.479590+0000","last_became_active":"2023-07-14T13:29:46.162075+0000","last_became_peered":"2023-07-14T13:29:46.162075+0000","last_unstale":"2023-07-14T13:29:48.479590+0000","last_undegraded":"2023-07-14T13:29:48.479590+0000","last_fullsized":"2023-07-14T13:29:48.479590+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:33:26.310832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141616+0000","last_change":"2023-07-14T13:29:46.165214+0000","last_active":"2023-07-14T13:29:47.141616+0000","last_peered":"2023-07-14T13:29:47.141616+0000","last_clean":"2023-07-14T13:29:47.141616+0000","last_became_active":"2023-07-14T13:29:46.164908+0000","last_became_peered":"2023-07-14T13:29:46.164908+0000","last_unstale":"2023-07-14T13:29:47.141616+0000","last_undegraded":"2023-07-14T13:29:47.141616+0000","last_fullsized":"2023-07-14T13:29:47.141616+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:23:47.997179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141388+0000","last_change":"2023-07-14T13:29:46.163840+0000","last_active":"2023-07-14T13:29:47.141388+0000","last_peered":"2023-07-14T13:29:47.141388+0000","last_clean":"2023-07-14T13:29:47.141388+0000","last_became_active":"2023-07-14T13:29:46.163561+0000","last_became_peered":"2023-07-14T13:29:46.163561+0000","last_unstale":"2023-07-14T13:29:47.141388+0000","last_undegraded":"2023-07-14T13:29:47.141388+0000","last_fullsized":"2023-07-14T13:29:47.141388+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:31:33.867324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146119+0000","last_change":"2023-07-14T13:29:46.157415+0000","last_active":"2023-07-14T13:29:47.146119+0000","last_peered":"2023-07-14T13:29:47.146119+0000","last_clean":"2023-07-14T13:29:47.146119+0000","last_became_active":"2023-07-14T13:29:46.156908+0000","last_became_peered":"2023-07-14T13:29:46.156908+0000","last_unstale":"2023-07-14T13:29:47.146119+0000","last_undegraded":"2023-07-14T13:29:47.146119+0000","last_fullsized":"2023-07-14T13:29:47.146119+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:24:50.135616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141617+0000","last_change":"2023-07-14T13:29:46.152971+0000","last_active":"2023-07-14T13:29:47.141617+0000","last_peered":"2023-07-14T13:29:47.141617+0000","last_clean":"2023-07-14T13:29:47.141617+0000","last_became_active":"2023-07-14T13:29:46.152641+0000","last_became_peered":"2023-07-14T13:29:46.152641+0000","last_unstale":"2023-07-14T13:29:47.141617+0000","last_undegraded":"2023-07-14T13:29:47.141617+0000","last_fullsized":"2023-07-14T13:29:47.141617+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:06:17.863530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141851+0000","last_change":"2023-07-14T13:29:46.151471+0000","last_active":"2023-07-14T13:29:47.141851+0000","last_peered":"2023-07-14T13:29:47.141851+0000","last_clean":"2023-07-14T13:29:47.141851+0000","last_became_active":"2023-07-14T13:29:46.150996+0000","last_became_peered":"2023-07-14T13:29:46.150996+0000","last_unstale":"2023-07-14T13:29:47.141851+0000","last_undegraded":"2023-07-14T13:29:47.141851+0000","last_fullsized":"2023-07-14T13:29:47.141851+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:36:46.294425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797696+0000","last_change":"2023-07-14T13:29:46.161038+0000","last_active":"2023-07-14T13:29:48.797696+0000","last_peered":"2023-07-14T13:29:48.797696+0000","last_clean":"2023-07-14T13:29:48.797696+0000","last_became_active":"2023-07-14T13:29:46.160750+0000","last_became_peered":"2023-07-14T13:29:46.160750+0000","last_unstale":"2023-07-14T13:29:48.797696+0000","last_undegraded":"2023-07-14T13:29:48.797696+0000","last_fullsized":"2023-07-14T13:29:48.797696+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:42:08.863141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141480+0000","last_change":"2023-07-14T13:29:46.149699+0000","last_active":"2023-07-14T13:29:47.141480+0000","last_peered":"2023-07-14T13:29:47.141480+0000","last_clean":"2023-07-14T13:29:47.141480+0000","last_became_active":"2023-07-14T13:29:46.149429+0000","last_became_peered":"2023-07-14T13:29:46.149429+0000","last_unstale":"2023-07-14T13:29:47.141480+0000","last_undegraded":"2023-07-14T13:29:47.141480+0000","last_fullsized":"2023-07-14T13:29:47.141480+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:55:39.460034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479340+0000","last_change":"2023-07-14T13:29:46.160166+0000","last_active":"2023-07-14T13:29:48.479340+0000","last_peered":"2023-07-14T13:29:48.479340+0000","last_clean":"2023-07-14T13:29:48.479340+0000","last_became_active":"2023-07-14T13:29:46.159843+0000","last_became_peered":"2023-07-14T13:29:46.159843+0000","last_unstale":"2023-07-14T13:29:48.479340+0000","last_undegraded":"2023-07-14T13:29:48.479340+0000","last_fullsized":"2023-07-14T13:29:48.479340+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:12:09.149124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141216+0000","last_change":"2023-07-14T13:29:46.155517+0000","last_active":"2023-07-14T13:29:47.141216+0000","last_peered":"2023-07-14T13:29:47.141216+0000","last_clean":"2023-07-14T13:29:47.141216+0000","last_became_active":"2023-07-14T13:29:46.155241+0000","last_became_peered":"2023-07-14T13:29:46.155241+0000","last_unstale":"2023-07-14T13:29:47.141216+0000","last_undegraded":"2023-07-14T13:29:47.141216+0000","last_fullsized":"2023-07-14T13:29:47.141216+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:23:00.388761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797786+0000","last_change":"2023-07-14T13:29:46.165903+0000","last_active":"2023-07-14T13:29:48.797786+0000","last_peered":"2023-07-14T13:29:48.797786+0000","last_clean":"2023-07-14T13:29:48.797786+0000","last_became_active":"2023-07-14T13:29:46.165382+0000","last_became_peered":"2023-07-14T13:29:46.165382+0000","last_unstale":"2023-07-14T13:29:48.797786+0000","last_undegraded":"2023-07-14T13:29:48.797786+0000","last_fullsized":"2023-07-14T13:29:48.797786+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:40:22.854519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:49.060361+0000","last_change":"2023-07-14T13:29:46.151003+0000","last_active":"2023-07-14T13:29:49.060361+0000","last_peered":"2023-07-14T13:29:49.060361+0000","last_clean":"2023-07-14T13:29:49.060361+0000","last_became_active":"2023-07-14T13:29:46.150704+0000","last_became_peered":"2023-07-14T13:29:46.150704+0000","last_unstale":"2023-07-14T13:29:49.060361+0000","last_undegraded":"2023-07-14T13:29:49.060361+0000","last_fullsized":"2023-07-14T13:29:49.060361+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:24.768994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141544+0000","last_change":"2023-07-14T13:29:46.153305+0000","last_active":"2023-07-14T13:29:47.141544+0000","last_peered":"2023-07-14T13:29:47.141544+0000","last_clean":"2023-07-14T13:29:47.141544+0000","last_became_active":"2023-07-14T13:29:46.153008+0000","last_became_peered":"2023-07-14T13:29:46.153008+0000","last_unstale":"2023-07-14T13:29:47.141544+0000","last_undegraded":"2023-07-14T13:29:47.141544+0000","last_fullsized":"2023-07-14T13:29:47.141544+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:16:23.727196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146015+0000","last_change":"2023-07-14T13:29:46.168865+0000","last_active":"2023-07-14T13:29:47.146015+0000","last_peered":"2023-07-14T13:29:47.146015+0000","last_clean":"2023-07-14T13:29:47.146015+0000","last_became_active":"2023-07-14T13:29:46.168603+0000","last_became_peered":"2023-07-14T13:29:46.168603+0000","last_unstale":"2023-07-14T13:29:47.146015+0000","last_undegraded":"2023-07-14T13:29:47.146015+0000","last_fullsized":"2023-07-14T13:29:47.146015+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:35:20.966733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797806+0000","last_change":"2023-07-14T13:29:46.155602+0000","last_active":"2023-07-14T13:29:48.797806+0000","last_peered":"2023-07-14T13:29:48.797806+0000","last_clean":"2023-07-14T13:29:48.797806+0000","last_became_active":"2023-07-14T13:29:46.155108+0000","last_became_peered":"2023-07-14T13:29:46.155108+0000","last_unstale":"2023-07-14T13:29:48.797806+0000","last_undegraded":"2023-07-14T13:29:48.797806+0000","last_fullsized":"2023-07-14T13:29:48.797806+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:13.416506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141791+0000","last_change":"2023-07-14T13:29:46.152988+0000","last_active":"2023-07-14T13:29:47.141791+0000","last_peered":"2023-07-14T13:29:47.141791+0000","last_clean":"2023-07-14T13:29:47.141791+0000","last_became_active":"2023-07-14T13:29:46.152697+0000","last_became_peered":"2023-07-14T13:29:46.152697+0000","last_unstale":"2023-07-14T13:29:47.141791+0000","last_undegraded":"2023-07-14T13:29:47.141791+0000","last_fullsized":"2023-07-14T13:29:47.141791+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:46:18.882359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797626+0000","last_change":"2023-07-14T13:29:46.156427+0000","last_active":"2023-07-14T13:29:48.797626+0000","last_peered":"2023-07-14T13:29:48.797626+0000","last_clean":"2023-07-14T13:29:48.797626+0000","last_became_active":"2023-07-14T13:29:46.156073+0000","last_became_peered":"2023-07-14T13:29:46.156073+0000","last_unstale":"2023-07-14T13:29:48.797626+0000","last_undegraded":"2023-07-14T13:29:48.797626+0000","last_fullsized":"2023-07-14T13:29:48.797626+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:22:17.681971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146211+0000","last_change":"2023-07-14T13:29:46.150139+0000","last_active":"2023-07-14T13:29:47.146211+0000","last_peered":"2023-07-14T13:29:47.146211+0000","last_clean":"2023-07-14T13:29:47.146211+0000","last_became_active":"2023-07-14T13:29:46.149853+0000","last_became_peered":"2023-07-14T13:29:46.149853+0000","last_unstale":"2023-07-14T13:29:47.146211+0000","last_undegraded":"2023-07-14T13:29:47.146211+0000","last_fullsized":"2023-07-14T13:29:47.146211+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:58.328252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797616+0000","last_change":"2023-07-14T13:29:46.159106+0000","last_active":"2023-07-14T13:29:48.797616+0000","last_peered":"2023-07-14T13:29:48.797616+0000","last_clean":"2023-07-14T13:29:48.797616+0000","last_became_active":"2023-07-14T13:29:46.158801+0000","last_became_peered":"2023-07-14T13:29:46.158801+0000","last_unstale":"2023-07-14T13:29:48.797616+0000","last_undegraded":"2023-07-14T13:29:48.797616+0000","last_fullsized":"2023-07-14T13:29:48.797616+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:20:40.273751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141222+0000","last_change":"2023-07-14T13:29:46.155534+0000","last_active":"2023-07-14T13:29:47.141222+0000","last_peered":"2023-07-14T13:29:47.141222+0000","last_clean":"2023-07-14T13:29:47.141222+0000","last_became_active":"2023-07-14T13:29:46.155265+0000","last_became_peered":"2023-07-14T13:29:46.155265+0000","last_unstale":"2023-07-14T13:29:47.141222+0000","last_undegraded":"2023-07-14T13:29:47.141222+0000","last_fullsized":"2023-07-14T13:29:47.141222+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:58:07.820454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.145962+0000","last_change":"2023-07-14T13:29:46.159148+0000","last_active":"2023-07-14T13:29:47.145962+0000","last_peered":"2023-07-14T13:29:47.145962+0000","last_clean":"2023-07-14T13:29:47.145962+0000","last_became_active":"2023-07-14T13:29:46.157198+0000","last_became_peered":"2023-07-14T13:29:46.157198+0000","last_unstale":"2023-07-14T13:29:47.145962+0000","last_undegraded":"2023-07-14T13:29:47.145962+0000","last_fullsized":"2023-07-14T13:29:47.145962+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:06:21.860997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479648+0000","last_change":"2023-07-14T13:29:46.162714+0000","last_active":"2023-07-14T13:29:48.479648+0000","last_peered":"2023-07-14T13:29:48.479648+0000","last_clean":"2023-07-14T13:29:48.479648+0000","last_became_active":"2023-07-14T13:29:46.162123+0000","last_became_peered":"2023-07-14T13:29:46.162123+0000","last_unstale":"2023-07-14T13:29:48.479648+0000","last_undegraded":"2023-07-14T13:29:48.479648+0000","last_fullsized":"2023-07-14T13:29:48.479648+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:36.907010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"171'4","reported_seq":17,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141806+0000","last_change":"2023-07-14T13:29:45.169422+0000","last_active":"2023-07-14T13:29:47.141806+0000","last_peered":"2023-07-14T13:29:47.141806+0000","last_clean":"2023-07-14T13:29:47.141806+0000","last_became_active":"2023-07-14T13:29:45.169138+0000","last_became_peered":"2023-07-14T13:29:45.169138+0000","last_unstale":"2023-07-14T13:29:47.141806+0000","last_undegraded":"2023-07-14T13:29:47.141806+0000","last_fullsized":"2023-07-14T13:29:47.141806+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:58:31.107549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479614+0000","last_change":"2023-07-14T13:29:46.160327+0000","last_active":"2023-07-14T13:29:48.479614+0000","last_peered":"2023-07-14T13:29:48.479614+0000","last_clean":"2023-07-14T13:29:48.479614+0000","last_became_active":"2023-07-14T13:29:46.159195+0000","last_became_peered":"2023-07-14T13:29:46.159195+0000","last_unstale":"2023-07-14T13:29:48.479614+0000","last_undegraded":"2023-07-14T13:29:48.479614+0000","last_fullsized":"2023-07-14T13:29:48.479614+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:15:41.664289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.155482+0000","last_change":"2023-07-14T13:29:44.155482+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.155482+0000","last_undegraded":"2023-07-14T13:29:44.155482+0000","last_fullsized":"2023-07-14T13:29:44.155482+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146443+0000","last_change":"2023-07-14T13:29:46.161735+0000","last_active":"2023-07-14T13:29:47.146443+0000","last_peered":"2023-07-14T13:29:47.146443+0000","last_clean":"2023-07-14T13:29:47.146443+0000","last_became_active":"2023-07-14T13:29:46.161340+0000","last_became_peered":"2023-07-14T13:29:46.161340+0000","last_unstale":"2023-07-14T13:29:47.146443+0000","last_undegraded":"2023-07-14T13:29:47.146443+0000","last_fullsized":"2023-07-14T13:29:47.146443+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:45:00.745964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.153856+0000","last_change":"2023-07-14T13:29:44.153856+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.153856+0000","last_undegraded":"2023-07-14T13:29:44.153856+0000","last_fullsized":"2023-07-14T13:29:44.153856+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479548+0000","last_change":"2023-07-14T13:29:45.163603+0000","last_active":"2023-07-14T13:29:48.479548+0000","last_peered":"2023-07-14T13:29:48.479548+0000","last_clean":"2023-07-14T13:29:48.479548+0000","last_became_active":"2023-07-14T13:29:45.163310+0000","last_became_peered":"2023-07-14T13:29:45.163310+0000","last_unstale":"2023-07-14T13:29:48.479548+0000","last_undegraded":"2023-07-14T13:29:48.479548+0000","last_fullsized":"2023-07-14T13:29:48.479548+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:53:27.366678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:49.060181+0000","last_change":"2023-07-14T13:29:46.154089+0000","last_active":"2023-07-14T13:29:49.060181+0000","last_peered":"2023-07-14T13:29:49.060181+0000","last_clean":"2023-07-14T13:29:49.060181+0000","last_became_active":"2023-07-14T13:29:46.153663+0000","last_became_peered":"2023-07-14T13:29:46.153663+0000","last_unstale":"2023-07-14T13:29:49.060181+0000","last_undegraded":"2023-07-14T13:29:49.060181+0000","last_fullsized":"2023-07-14T13:29:49.060181+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:30.137865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146336+0000","last_change":"2023-07-14T13:29:45.177250+0000","last_active":"2023-07-14T13:29:47.146336+0000","last_peered":"2023-07-14T13:29:47.146336+0000","last_clean":"2023-07-14T13:29:47.146336+0000","last_became_active":"2023-07-14T13:29:45.176926+0000","last_became_peered":"2023-07-14T13:29:45.176926+0000","last_unstale":"2023-07-14T13:29:47.146336+0000","last_undegraded":"2023-07-14T13:29:47.146336+0000","last_fullsized":"2023-07-14T13:29:47.146336+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:21:29.147948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141484+0000","last_change":"2023-07-14T13:29:45.173114+0000","last_active":"2023-07-14T13:29:47.141484+0000","last_peered":"2023-07-14T13:29:47.141484+0000","last_clean":"2023-07-14T13:29:47.141484+0000","last_became_active":"2023-07-14T13:29:45.172835+0000","last_became_peered":"2023-07-14T13:29:45.172835+0000","last_unstale":"2023-07-14T13:29:47.141484+0000","last_undegraded":"2023-07-14T13:29:47.141484+0000","last_fullsized":"2023-07-14T13:29:47.141484+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:27:21.083351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479370+0000","last_change":"2023-07-14T13:29:46.154070+0000","last_active":"2023-07-14T13:29:48.479370+0000","last_peered":"2023-07-14T13:29:48.479370+0000","last_clean":"2023-07-14T13:29:48.479370+0000","last_became_active":"2023-07-14T13:29:46.153808+0000","last_became_peered":"2023-07-14T13:29:46.153808+0000","last_unstale":"2023-07-14T13:29:48.479370+0000","last_undegraded":"2023-07-14T13:29:48.479370+0000","last_fullsized":"2023-07-14T13:29:48.479370+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:29:11.403775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.151443+0000","last_change":"2023-07-14T13:29:44.151443+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.151443+0000","last_undegraded":"2023-07-14T13:29:44.151443+0000","last_fullsized":"2023-07-14T13:29:44.151443+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141245+0000","last_change":"2023-07-14T13:29:45.171928+0000","last_active":"2023-07-14T13:29:47.141245+0000","last_peered":"2023-07-14T13:29:47.141245+0000","last_clean":"2023-07-14T13:29:47.141245+0000","last_became_active":"2023-07-14T13:29:45.171477+0000","last_became_peered":"2023-07-14T13:29:45.171477+0000","last_unstale":"2023-07-14T13:29:47.141245+0000","last_undegraded":"2023-07-14T13:29:47.141245+0000","last_fullsized":"2023-07-14T13:29:47.141245+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:34:09.091228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797671+0000","last_change":"2023-07-14T13:29:45.170109+0000","last_active":"2023-07-14T13:29:48.797671+0000","last_peered":"2023-07-14T13:29:48.797671+0000","last_clean":"2023-07-14T13:29:48.797671+0000","last_became_active":"2023-07-14T13:29:45.169830+0000","last_became_peered":"2023-07-14T13:29:45.169830+0000","last_unstale":"2023-07-14T13:29:48.797671+0000","last_undegraded":"2023-07-14T13:29:48.797671+0000","last_fullsized":"2023-07-14T13:29:48.797671+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:46:28.314128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.153918+0000","last_change":"2023-07-14T13:29:44.153918+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.153918+0000","last_undegraded":"2023-07-14T13:29:44.153918+0000","last_fullsized":"2023-07-14T13:29:44.153918+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479710+0000","last_change":"2023-07-14T13:29:45.175075+0000","last_active":"2023-07-14T13:29:48.479710+0000","last_peered":"2023-07-14T13:29:48.479710+0000","last_clean":"2023-07-14T13:29:48.479710+0000","last_became_active":"2023-07-14T13:29:45.174845+0000","last_became_peered":"2023-07-14T13:29:45.174845+0000","last_unstale":"2023-07-14T13:29:48.479710+0000","last_undegraded":"2023-07-14T13:29:48.479710+0000","last_fullsized":"2023-07-14T13:29:48.479710+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:42.991173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150865+0000","last_change":"2023-07-14T13:29:44.150865+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150865+0000","last_undegraded":"2023-07-14T13:29:44.150865+0000","last_fullsized":"2023-07-14T13:29:44.150865+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:49.060345+0000","last_change":"2023-07-14T13:29:45.175827+0000","last_active":"2023-07-14T13:29:49.060345+0000","last_peered":"2023-07-14T13:29:49.060345+0000","last_clean":"2023-07-14T13:29:49.060345+0000","last_became_active":"2023-07-14T13:29:45.175532+0000","last_became_peered":"2023-07-14T13:29:45.175532+0000","last_unstale":"2023-07-14T13:29:49.060345+0000","last_undegraded":"2023-07-14T13:29:49.060345+0000","last_fullsized":"2023-07-14T13:29:49.060345+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:46:17.873832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479490+0000","last_change":"2023-07-14T13:29:46.165792+0000","last_active":"2023-07-14T13:29:48.479490+0000","last_peered":"2023-07-14T13:29:48.479490+0000","last_clean":"2023-07-14T13:29:48.479490+0000","last_became_active":"2023-07-14T13:29:46.165479+0000","last_became_peered":"2023-07-14T13:29:46.165479+0000","last_unstale":"2023-07-14T13:29:48.479490+0000","last_undegraded":"2023-07-14T13:29:48.479490+0000","last_fullsized":"2023-07-14T13:29:48.479490+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:09:56.183958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146005+0000","last_change":"2023-07-14T13:29:45.173121+0000","last_active":"2023-07-14T13:29:47.146005+0000","last_peered":"2023-07-14T13:29:47.146005+0000","last_clean":"2023-07-14T13:29:47.146005+0000","last_became_active":"2023-07-14T13:29:45.172588+0000","last_became_peered":"2023-07-14T13:29:45.172588+0000","last_unstale":"2023-07-14T13:29:47.146005+0000","last_undegraded":"2023-07-14T13:29:47.146005+0000","last_fullsized":"2023-07-14T13:29:47.146005+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:51:26.781033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:49.060129+0000","last_change":"2023-07-14T13:29:45.172122+0000","last_active":"2023-07-14T13:29:49.060129+0000","last_peered":"2023-07-14T13:29:49.060129+0000","last_clean":"2023-07-14T13:29:49.060129+0000","last_became_active":"2023-07-14T13:29:45.171842+0000","last_became_peered":"2023-07-14T13:29:45.171842+0000","last_unstale":"2023-07-14T13:29:49.060129+0000","last_undegraded":"2023-07-14T13:29:49.060129+0000","last_fullsized":"2023-07-14T13:29:49.060129+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:06:16.855003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479597+0000","last_change":"2023-07-14T13:29:46.159571+0000","last_active":"2023-07-14T13:29:48.479597+0000","last_peered":"2023-07-14T13:29:48.479597+0000","last_clean":"2023-07-14T13:29:48.479597+0000","last_became_active":"2023-07-14T13:29:46.159131+0000","last_became_peered":"2023-07-14T13:29:46.159131+0000","last_unstale":"2023-07-14T13:29:48.479597+0000","last_undegraded":"2023-07-14T13:29:48.479597+0000","last_fullsized":"2023-07-14T13:29:48.479597+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:29:41.684686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146568+0000","last_change":"2023-07-14T13:29:45.172255+0000","last_active":"2023-07-14T13:29:47.146568+0000","last_peered":"2023-07-14T13:29:47.146568+0000","last_clean":"2023-07-14T13:29:47.146568+0000","last_became_active":"2023-07-14T13:29:45.171958+0000","last_became_peered":"2023-07-14T13:29:45.171958+0000","last_unstale":"2023-07-14T13:29:47.146568+0000","last_undegraded":"2023-07-14T13:29:47.146568+0000","last_fullsized":"2023-07-14T13:29:47.146568+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:03:09.694947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141579+0000","last_change":"2023-07-14T13:29:46.163846+0000","last_active":"2023-07-14T13:29:47.141579+0000","last_peered":"2023-07-14T13:29:47.141579+0000","last_clean":"2023-07-14T13:29:47.141579+0000","last_became_active":"2023-07-14T13:29:46.163582+0000","last_became_peered":"2023-07-14T13:29:46.163582+0000","last_unstale":"2023-07-14T13:29:47.141579+0000","last_undegraded":"2023-07-14T13:29:47.141579+0000","last_fullsized":"2023-07-14T13:29:47.141579+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:30:43.385089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150656+0000","last_change":"2023-07-14T13:29:44.150656+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150656+0000","last_undegraded":"2023-07-14T13:29:44.150656+0000","last_fullsized":"2023-07-14T13:29:44.150656+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150513+0000","last_change":"2023-07-14T13:29:44.150513+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150513+0000","last_undegraded":"2023-07-14T13:29:44.150513+0000","last_fullsized":"2023-07-14T13:29:44.150513+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479790+0000","last_change":"2023-07-14T13:29:45.170294+0000","last_active":"2023-07-14T13:29:48.479790+0000","last_peered":"2023-07-14T13:29:48.479790+0000","last_clean":"2023-07-14T13:29:48.479790+0000","last_became_active":"2023-07-14T13:29:45.170018+0000","last_became_peered":"2023-07-14T13:29:45.170018+0000","last_unstale":"2023-07-14T13:29:48.479790+0000","last_undegraded":"2023-07-14T13:29:48.479790+0000","last_fullsized":"2023-07-14T13:29:48.479790+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:07:58.741534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141753+0000","last_change":"2023-07-14T13:29:46.159322+0000","last_active":"2023-07-14T13:29:47.141753+0000","last_peered":"2023-07-14T13:29:47.141753+0000","last_clean":"2023-07-14T13:29:47.141753+0000","last_became_active":"2023-07-14T13:29:46.159056+0000","last_became_peered":"2023-07-14T13:29:46.159056+0000","last_unstale":"2023-07-14T13:29:47.141753+0000","last_undegraded":"2023-07-14T13:29:47.141753+0000","last_fullsized":"2023-07-14T13:29:47.141753+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:24.768994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141634+0000","last_change":"2023-07-14T13:29:45.175896+0000","last_active":"2023-07-14T13:29:47.141634+0000","last_peered":"2023-07-14T13:29:47.141634+0000","last_clean":"2023-07-14T13:29:47.141634+0000","last_became_active":"2023-07-14T13:29:45.175541+0000","last_became_peered":"2023-07-14T13:29:45.175541+0000","last_unstale":"2023-07-14T13:29:47.141634+0000","last_undegraded":"2023-07-14T13:29:47.141634+0000","last_fullsized":"2023-07-14T13:29:47.141634+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:29.129338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146365+0000","last_change":"2023-07-14T13:29:46.154310+0000","last_active":"2023-07-14T13:29:47.146365+0000","last_peered":"2023-07-14T13:29:47.146365+0000","last_clean":"2023-07-14T13:29:47.146365+0000","last_became_active":"2023-07-14T13:29:46.153864+0000","last_became_peered":"2023-07-14T13:29:46.153864+0000","last_unstale":"2023-07-14T13:29:47.146365+0000","last_undegraded":"2023-07-14T13:29:47.146365+0000","last_fullsized":"2023-07-14T13:29:47.146365+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:14:22.808642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150533+0000","last_change":"2023-07-14T13:29:44.150533+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150533+0000","last_undegraded":"2023-07-14T13:29:44.150533+0000","last_fullsized":"2023-07-14T13:29:44.150533+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797562+0000","last_change":"2023-07-14T13:29:45.171477+0000","last_active":"2023-07-14T13:29:48.797562+0000","last_peered":"2023-07-14T13:29:48.797562+0000","last_clean":"2023-07-14T13:29:48.797562+0000","last_became_active":"2023-07-14T13:29:45.171199+0000","last_became_peered":"2023-07-14T13:29:45.171199+0000","last_unstale":"2023-07-14T13:29:48.797562+0000","last_undegraded":"2023-07-14T13:29:48.797562+0000","last_fullsized":"2023-07-14T13:29:48.797562+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:45.698963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479447+0000","last_change":"2023-07-14T13:29:46.156947+0000","last_active":"2023-07-14T13:29:48.479447+0000","last_peered":"2023-07-14T13:29:48.479447+0000","last_clean":"2023-07-14T13:29:48.479447+0000","last_became_active":"2023-07-14T13:29:46.156662+0000","last_became_peered":"2023-07-14T13:29:46.156662+0000","last_unstale":"2023-07-14T13:29:48.479447+0000","last_undegraded":"2023-07-14T13:29:48.479447+0000","last_fullsized":"2023-07-14T13:29:48.479447+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:40:20.487679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150538+0000","last_change":"2023-07-14T13:29:44.150538+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150538+0000","last_undegraded":"2023-07-14T13:29:44.150538+0000","last_fullsized":"2023-07-14T13:29:44.150538+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146203+0000","last_change":"2023-07-14T13:29:46.158420+0000","last_active":"2023-07-14T13:29:47.146203+0000","last_peered":"2023-07-14T13:29:47.146203+0000","last_clean":"2023-07-14T13:29:47.146203+0000","last_became_active":"2023-07-14T13:29:46.158157+0000","last_became_peered":"2023-07-14T13:29:46.158157+0000","last_unstale":"2023-07-14T13:29:47.146203+0000","last_undegraded":"2023-07-14T13:29:47.146203+0000","last_fullsized":"2023-07-14T13:29:47.146203+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:39:57.006292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.153884+0000","last_change":"2023-07-14T13:29:44.153884+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.153884+0000","last_undegraded":"2023-07-14T13:29:44.153884+0000","last_fullsized":"2023-07-14T13:29:44.153884+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146622+0000","last_change":"2023-07-14T13:29:46.155886+0000","last_active":"2023-07-14T13:29:47.146622+0000","last_peered":"2023-07-14T13:29:47.146622+0000","last_clean":"2023-07-14T13:29:47.146622+0000","last_became_active":"2023-07-14T13:29:46.155575+0000","last_became_peered":"2023-07-14T13:29:46.155575+0000","last_unstale":"2023-07-14T13:29:47.146622+0000","last_undegraded":"2023-07-14T13:29:47.146622+0000","last_fullsized":"2023-07-14T13:29:47.146622+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:38:53.097885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"171'6","reported_seq":19,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:49.060214+0000","last_change":"2023-07-14T13:29:45.175838+0000","last_active":"2023-07-14T13:29:49.060214+0000","last_peered":"2023-07-14T13:29:49.060214+0000","last_clean":"2023-07-14T13:29:49.060214+0000","last_became_active":"2023-07-14T13:29:45.175543+0000","last_became_peered":"2023-07-14T13:29:45.175543+0000","last_unstale":"2023-07-14T13:29:49.060214+0000","last_undegraded":"2023-07-14T13:29:49.060214+0000","last_fullsized":"2023-07-14T13:29:49.060214+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:17:20.283333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"160'304","reported_seq":1106,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-14T13:29:44.154708+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:29:44.154708+0000","last_peered":"2023-07-14T13:29:44.154708+0000","last_clean":"2023-07-14T13:29:44.154708+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:29:44.154708+0000","last_undegraded":"2023-07-14T13:29:44.154708+0000","last_fullsized":"2023-07-14T13:29:44.154708+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:39:53.671602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":282,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-14T13:29:44.153127+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:29:44.153127+0000","last_peered":"2023-07-14T13:29:44.153127+0000","last_clean":"2023-07-14T13:29:44.153127+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:29:44.153127+0000","last_undegraded":"2023-07-14T13:29:44.153127+0000","last_fullsized":"2023-07-14T13:29:44.153127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:23:28.688209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146431+0000","last_change":"2023-07-14T13:29:46.159514+0000","last_active":"2023-07-14T13:29:47.146431+0000","last_peered":"2023-07-14T13:29:47.146431+0000","last_clean":"2023-07-14T13:29:47.146431+0000","last_became_active":"2023-07-14T13:29:46.158086+0000","last_became_peered":"2023-07-14T13:29:46.158086+0000","last_unstale":"2023-07-14T13:29:47.146431+0000","last_undegraded":"2023-07-14T13:29:47.146431+0000","last_fullsized":"2023-07-14T13:29:47.146431+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:16:18.528808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.154151+0000","last_change":"2023-07-14T13:29:44.154151+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.154151+0000","last_undegraded":"2023-07-14T13:29:44.154151+0000","last_fullsized":"2023-07-14T13:29:44.154151+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":287,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-14T13:29:44.154584+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:29:44.154584+0000","last_peered":"2023-07-14T13:29:44.154584+0000","last_clean":"2023-07-14T13:29:44.154584+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:29:44.154584+0000","last_undegraded":"2023-07-14T13:29:44.154584+0000","last_fullsized":"2023-07-14T13:29:44.154584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:23:31.882598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797720+0000","last_change":"2023-07-14T13:29:46.161055+0000","last_active":"2023-07-14T13:29:48.797720+0000","last_peered":"2023-07-14T13:29:48.797720+0000","last_clean":"2023-07-14T13:29:48.797720+0000","last_became_active":"2023-07-14T13:29:46.160756+0000","last_became_peered":"2023-07-14T13:29:46.160756+0000","last_unstale":"2023-07-14T13:29:48.797720+0000","last_undegraded":"2023-07-14T13:29:48.797720+0000","last_fullsized":"2023-07-14T13:29:48.797720+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:28:44.675715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.151080+0000","last_change":"2023-07-14T13:29:44.151080+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.151080+0000","last_undegraded":"2023-07-14T13:29:44.151080+0000","last_fullsized":"2023-07-14T13:29:44.151080+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":292,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797462+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:29:48.797462+0000","last_peered":"2023-07-14T13:29:48.797462+0000","last_clean":"2023-07-14T13:29:48.797462+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:29:48.797462+0000","last_undegraded":"2023-07-14T13:29:48.797462+0000","last_fullsized":"2023-07-14T13:29:48.797462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:14:45.493017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797812+0000","last_change":"2023-07-14T13:29:46.165798+0000","last_active":"2023-07-14T13:29:48.797812+0000","last_peered":"2023-07-14T13:29:48.797812+0000","last_clean":"2023-07-14T13:29:48.797812+0000","last_became_active":"2023-07-14T13:29:46.165366+0000","last_became_peered":"2023-07-14T13:29:46.165366+0000","last_unstale":"2023-07-14T13:29:48.797812+0000","last_undegraded":"2023-07-14T13:29:48.797812+0000","last_fullsized":"2023-07-14T13:29:48.797812+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:34:21.181467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"171'3","reported_seq":16,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797772+0000","last_change":"2023-07-14T13:29:45.167394+0000","last_active":"2023-07-14T13:29:48.797772+0000","last_peered":"2023-07-14T13:29:48.797772+0000","last_clean":"2023-07-14T13:29:48.797772+0000","last_became_active":"2023-07-14T13:29:45.167109+0000","last_became_peered":"2023-07-14T13:29:45.167109+0000","last_unstale":"2023-07-14T13:29:48.797772+0000","last_undegraded":"2023-07-14T13:29:48.797772+0000","last_fullsized":"2023-07-14T13:29:48.797772+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:07:03.377007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":282,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-14T13:29:44.153084+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:29:44.153084+0000","last_peered":"2023-07-14T13:29:44.153084+0000","last_clean":"2023-07-14T13:29:44.153084+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:29:44.153084+0000","last_undegraded":"2023-07-14T13:29:44.153084+0000","last_fullsized":"2023-07-14T13:29:44.153084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:39:28.264692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146524+0000","last_change":"2023-07-14T13:29:46.158284+0000","last_active":"2023-07-14T13:29:47.146524+0000","last_peered":"2023-07-14T13:29:47.146524+0000","last_clean":"2023-07-14T13:29:47.146524+0000","last_became_active":"2023-07-14T13:29:46.157955+0000","last_became_peered":"2023-07-14T13:29:46.157955+0000","last_unstale":"2023-07-14T13:29:47.146524+0000","last_undegraded":"2023-07-14T13:29:47.146524+0000","last_fullsized":"2023-07-14T13:29:47.146524+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:42:58.793494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141644+0000","last_change":"2023-07-14T13:29:45.167565+0000","last_active":"2023-07-14T13:29:47.141644+0000","last_peered":"2023-07-14T13:29:47.141644+0000","last_clean":"2023-07-14T13:29:47.141644+0000","last_became_active":"2023-07-14T13:29:45.167122+0000","last_became_peered":"2023-07-14T13:29:45.167122+0000","last_unstale":"2023-07-14T13:29:47.141644+0000","last_undegraded":"2023-07-14T13:29:47.141644+0000","last_fullsized":"2023-07-14T13:29:47.141644+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:17:20.283333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":300,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479725+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:29:48.479725+0000","last_peered":"2023-07-14T13:29:48.479725+0000","last_clean":"2023-07-14T13:29:48.479725+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:29:48.479725+0000","last_undegraded":"2023-07-14T13:29:48.479725+0000","last_fullsized":"2023-07-14T13:29:48.479725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:04:01.119223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479382+0000","last_change":"2023-07-14T13:29:46.159750+0000","last_active":"2023-07-14T13:29:48.479382+0000","last_peered":"2023-07-14T13:29:48.479382+0000","last_clean":"2023-07-14T13:29:48.479382+0000","last_became_active":"2023-07-14T13:29:46.159434+0000","last_became_peered":"2023-07-14T13:29:46.159434+0000","last_unstale":"2023-07-14T13:29:48.479382+0000","last_undegraded":"2023-07-14T13:29:48.479382+0000","last_fullsized":"2023-07-14T13:29:48.479382+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:25:26.203512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150838+0000","last_change":"2023-07-14T13:29:44.150838+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150838+0000","last_undegraded":"2023-07-14T13:29:44.150838+0000","last_fullsized":"2023-07-14T13:29:44.150838+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":284,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-14T13:29:44.154855+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:29:44.154855+0000","last_peered":"2023-07-14T13:29:44.154855+0000","last_clean":"2023-07-14T13:29:44.154855+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:29:44.154855+0000","last_undegraded":"2023-07-14T13:29:44.154855+0000","last_fullsized":"2023-07-14T13:29:44.154855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:47:20.376659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141463+0000","last_change":"2023-07-14T13:29:46.150567+0000","last_active":"2023-07-14T13:29:47.141463+0000","last_peered":"2023-07-14T13:29:47.141463+0000","last_clean":"2023-07-14T13:29:47.141463+0000","last_became_active":"2023-07-14T13:29:46.150251+0000","last_became_peered":"2023-07-14T13:29:46.150251+0000","last_unstale":"2023-07-14T13:29:47.141463+0000","last_undegraded":"2023-07-14T13:29:47.141463+0000","last_fullsized":"2023-07-14T13:29:47.141463+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:35:51.313440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150512+0000","last_change":"2023-07-14T13:29:44.150512+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150512+0000","last_undegraded":"2023-07-14T13:29:44.150512+0000","last_fullsized":"2023-07-14T13:29:44.150512+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":300,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479710+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:29:48.479710+0000","last_peered":"2023-07-14T13:29:48.479710+0000","last_clean":"2023-07-14T13:29:48.479710+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:29:48.479710+0000","last_undegraded":"2023-07-14T13:29:48.479710+0000","last_fullsized":"2023-07-14T13:29:48.479710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:05:23.988230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479427+0000","last_change":"2023-07-14T13:29:46.152496+0000","last_active":"2023-07-14T13:29:48.479427+0000","last_peered":"2023-07-14T13:29:48.479427+0000","last_clean":"2023-07-14T13:29:48.479427+0000","last_became_active":"2023-07-14T13:29:46.152230+0000","last_became_peered":"2023-07-14T13:29:46.152230+0000","last_unstale":"2023-07-14T13:29:48.479427+0000","last_undegraded":"2023-07-14T13:29:48.479427+0000","last_fullsized":"2023-07-14T13:29:48.479427+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:26:38.395035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.151752+0000","last_change":"2023-07-14T13:29:44.151752+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.151752+0000","last_undegraded":"2023-07-14T13:29:44.151752+0000","last_fullsized":"2023-07-14T13:29:44.151752+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":286,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-14T13:29:44.151631+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:29:44.151631+0000","last_peered":"2023-07-14T13:29:44.151631+0000","last_clean":"2023-07-14T13:29:44.151631+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:29:44.151631+0000","last_undegraded":"2023-07-14T13:29:44.151631+0000","last_fullsized":"2023-07-14T13:29:44.151631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:05:53.665139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":84,"acting":84,"num_store_stats":5},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23,"ondisk_log_size":23,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575289,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59928,"kb_used_data":2640,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94311912,"statfs":{"total":96636764160,"available":96575397888,"internally_reserved":0,"allocated":2703360,"data_stored":1670881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.57099999999999995,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96899999999999997,"5min":1.054,"15min":1.054},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.752,"15min":0.746},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.443},"max":{"1min":1.016,"5min":1.016,"15min":1.032},"last":0.42899999999999999}]},{"osd":1,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.752,"15min":0.755},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.90400000000000003,"5min":1.339,"15min":1.339},"last":1.1659999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.76600000000000001,"15min":0.76100000000000001},"min":{"1min":0.53300000000000003,"5min":0.501,"15min":0.496},"max":{"1min":0.98399999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.60399999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.72899999999999998,"15min":0.74099999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88400000000000001,"5min":1.032,"15min":1.1379999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.879,"5min":1.429,"15min":1.429},"last":0.91400000000000003}]},{"osd":3,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.746,"15min":0.75600000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.499},"max":{"1min":0.95599999999999996,"5min":1.361,"15min":1.361},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.44700000000000001},"max":{"1min":0.94299999999999995,"5min":1.395,"15min":1.395},"last":1.097}]},{"osd":4,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.60599999999999998,"15min":0.58299999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.35799999999999998},"max":{"1min":0.89700000000000002,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.879},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61399999999999999,"15min":0.62},"min":{"1min":0.44700000000000001,"5min":0.439,"15min":0.40400000000000003},"max":{"1min":0.93700000000000006,"5min":0.95799999999999996,"15min":0.99399999999999999},"last":0.80400000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60399999999999998,"15min":0.61099999999999999},"min":{"1min":0.48599999999999999,"5min":0.42399999999999999,"15min":0.40200000000000002},"max":{"1min":0.90300000000000002,"5min":1,"15min":1},"last":1.056},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47999999999999998,"5min":0.45300000000000001,"15min":0.41699999999999998},"max":{"1min":0.873,"5min":0.93600000000000005,"15min":1.0620000000000001},"last":0.96099999999999997}]},{"osd":6,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.56899999999999995,"5min":0.52600000000000002,"15min":0.47099999999999997},"max":{"1min":0.93799999999999994,"5min":1.0940000000000001,"15min":1.115},"last":1.032},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67800000000000005,"15min":0.68100000000000005},"min":{"1min":0.503,"5min":0.495,"15min":0.41999999999999998},"max":{"1min":0.879,"5min":0.95299999999999996,"15min":1.147},"last":0.84699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575290,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33108,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338732,"statfs":{"total":96636764160,"available":96602861568,"internally_reserved":0,"allocated":2109440,"data_stored":1080513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.998,"5min":1.026,"15min":1.026},"last":0.629},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.499,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89400000000000002,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.76300000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73999999999999999,"15min":0.76400000000000001},"min":{"1min":0.54000000000000004,"5min":0.51600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91500000000000004,"5min":1.0049999999999999,"15min":1.3300000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73799999999999999,"15min":0.747},"min":{"1min":0.58299999999999996,"5min":0.51700000000000002,"15min":0.47499999999999998},"max":{"1min":0.93999999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.69199999999999995}]},{"osd":2,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77500000000000002,"15min":0.79200000000000004},"min":{"1min":0.59799999999999998,"5min":0.53300000000000003,"15min":0.52000000000000002},"max":{"1min":0.92500000000000004,"5min":1.04,"15min":1.0660000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75700000000000001,"15min":0.76700000000000002},"min":{"1min":0.53500000000000003,"5min":0.52600000000000002,"15min":0.51300000000000001},"max":{"1min":0.94799999999999995,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.66900000000000004}]},{"osd":3,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77700000000000002,"15min":0.78100000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.95799999999999996,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.70699999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.2569999999999999},"last":0.71399999999999997}]},{"osd":4,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.41499999999999998,"5min":0.36299999999999999,"15min":0.36099999999999999},"max":{"1min":0.82199999999999995,"5min":0.92600000000000005,"15min":1.175},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60899999999999999,"15min":0.61199999999999999},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.36799999999999999},"max":{"1min":0.80800000000000005,"5min":0.94599999999999995,"15min":1.0580000000000001},"last":0.46100000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.42699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84999999999999998,"5min":0.873,"15min":1.0860000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.68000000000000005,"15min":0.67400000000000004},"min":{"1min":0.51000000000000001,"5min":0.45900000000000002,"15min":0.41699999999999998},"max":{"1min":0.92100000000000004,"5min":0.93200000000000005,"15min":1.3180000000000001},"last":0.59399999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.46500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88800000000000001,"5min":0.99199999999999999,"15min":1.042},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.53700000000000003,"5min":0.50900000000000001,"15min":0.46200000000000002},"max":{"1min":0.89900000000000002,"5min":0.92300000000000004,"15min":1.0369999999999999},"last":0.49299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575289,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51156,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320684,"statfs":{"total":96636764160,"available":96584380416,"internally_reserved":0,"allocated":2109440,"data_stored":1080513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.76000000000000001,"15min":0.745},"min":{"1min":0.59499999999999997,"5min":0.41799999999999998,"15min":0.40500000000000003},"max":{"1min":0.94099999999999995,"5min":1.8,"15min":1.8},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77400000000000002,"15min":0.76100000000000001},"min":{"1min":0.58599999999999997,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":0.91500000000000004,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.71999999999999997}]},{"osd":1,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77000000000000002,"15min":0.746},"min":{"1min":0.58699999999999997,"5min":0.50600000000000001,"15min":0.378},"max":{"1min":0.89600000000000002,"5min":1.835,"15min":1.835},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.77500000000000002,"15min":0.77200000000000002},"min":{"1min":0.56200000000000006,"5min":0.503,"15min":0.499},"max":{"1min":0.99299999999999999,"5min":1.0429999999999999,"15min":1.05},"last":1.0629999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.91800000000000004,"15min":0.80300000000000005},"min":{"1min":0.67100000000000004,"5min":0.434,"15min":0.434},"max":{"1min":0.95199999999999996,"5min":16.774000000000001,"15min":16.774000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.90800000000000003,"15min":0.80600000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.496},"max":{"1min":0.88,"5min":16.751999999999999,"15min":16.751999999999999},"last":0.67100000000000004}]},{"osd":3,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.77700000000000002,"15min":0.77100000000000002},"min":{"1min":0.65400000000000003,"5min":0.52700000000000002,"15min":0.51100000000000001},"max":{"1min":0.95899999999999996,"5min":0.999,"15min":1.115},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.93600000000000005,"15min":0.82999999999999996},"min":{"1min":0.60699999999999998,"5min":0.54100000000000004,"15min":0.50600000000000001},"max":{"1min":0.93999999999999995,"5min":16.731000000000002,"15min":16.731000000000002},"last":0.96799999999999997}]},{"osd":4,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.624,"15min":0.63100000000000001},"min":{"1min":0.442,"5min":0.39500000000000002,"15min":0.38},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":1.0089999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.70999999999999996},"min":{"1min":0.45200000000000001,"5min":0.375,"15min":0.36699999999999999},"max":{"1min":1.02,"5min":1.159,"15min":1.159},"last":1.248}]},{"osd":6,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.61899999999999999},"min":{"1min":0.49099999999999999,"5min":0.41799999999999998,"15min":0.34999999999999998},"max":{"1min":0.88800000000000001,"5min":0.94699999999999995,"15min":1.3100000000000001},"last":1.157},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64700000000000002,"15min":0.64400000000000002},"min":{"1min":0.501,"5min":0.45400000000000001,"15min":0.40999999999999998},"max":{"1min":0.80400000000000005,"5min":0.91800000000000004,"15min":0.97299999999999998},"last":0.99199999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65400000000000003,"15min":0.64900000000000002},"min":{"1min":0.51100000000000001,"5min":0.432,"15min":0.42399999999999999},"max":{"1min":0.93000000000000005,"5min":1.123,"15min":1.123},"last":1.1759999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.69499999999999995,"15min":0.68899999999999995},"min":{"1min":0.55700000000000005,"5min":0.49299999999999999,"15min":0.40000000000000002},"max":{"1min":0.96899999999999997,"5min":1.012,"15min":1.012},"last":1.091}]}]},{"osd":4,"up_from":13,"seq":55834575290,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37252,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334588,"statfs":{"total":96636764160,"available":96598618112,"internally_reserved":0,"allocated":2158592,"data_stored":1102570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.76400000000000001,"15min":0.76700000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.38100000000000001},"max":{"1min":0.96899999999999997,"5min":1.0069999999999999,"15min":1.0249999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77100000000000002,"15min":0.76300000000000001},"min":{"1min":0.60799999999999998,"5min":0.45800000000000002,"15min":0.442},"max":{"1min":0.94499999999999995,"5min":1.278,"15min":1.278},"last":0.50800000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.76300000000000001,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0349999999999999,"5min":1.306,"15min":1.306},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.53800000000000003,"5min":0.51000000000000001,"15min":0.47599999999999998},"max":{"1min":1.024,"5min":1.177,"15min":1.177},"last":0.748}]},{"osd":2,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78000000000000003,"15min":0.77300000000000002},"min":{"1min":0.56899999999999995,"5min":0.54000000000000004,"15min":0.49299999999999999},"max":{"1min":0.90400000000000003,"5min":1.137,"15min":1.137},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77300000000000002,"15min":0.77900000000000003},"min":{"1min":0.53700000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1,"5min":1,"15min":1.0149999999999999},"last":0.82299999999999995}]},{"osd":3,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.50800000000000001},"max":{"1min":0.93200000000000005,"5min":1.222,"15min":1.222},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78400000000000003,"15min":0.77900000000000003},"min":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.496},"max":{"1min":1.018,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60599999999999998,"15min":0.60699999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.40000000000000002},"max":{"1min":0.94099999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61799999999999999,"15min":0.60799999999999998},"min":{"1min":0.45000000000000001,"5min":0.42399999999999999,"15min":0.378},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96799999999999997},"last":0.61799999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.624,"15min":0.61599999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.42699999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.88600000000000001}]},{"osd":7,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67300000000000004,"15min":0.67100000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.435},"max":{"1min":0.91800000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70099999999999996,"15min":0.69799999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.83999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575290,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41344,"kb_used_data":2104,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330496,"statfs":{"total":96636764160,"available":96594427904,"internally_reserved":0,"allocated":2154496,"data_stored":1101622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47399999999999998,"15min":0.46000000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.28799999999999998},"max":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.92900000000000005},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.621,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.51900000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.48899999999999999,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.33900000000000002,"15min":0.32300000000000001},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.495},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55800000000000005,"15min":0.56100000000000005},"min":{"1min":0.39700000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.82199999999999995,"5min":0.82399999999999995,"15min":0.95799999999999996},"last":0.70099999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57799999999999996,"15min":0.58299999999999996},"min":{"1min":0.41499999999999998,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.623,"15min":0.61499999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82399999999999995,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.74299999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.77000000000000002,"15min":0.78500000000000003},"min":{"1min":0.45200000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.048,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.79500000000000004,"15min":0.80600000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98999999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.84599999999999997}]},{"osd":5,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81000000000000005,"15min":0.82899999999999996},"min":{"1min":0.56499999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.069,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80800000000000005,"15min":0.81299999999999994},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1220000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":1.0089999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.81399999999999995,"15min":0.80800000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1910000000000001,"5min":1.383,"15min":1.383},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.82299999999999995,"15min":0.83999999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1439999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.76200000000000001}]},{"osd":7,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.86399999999999999,"15min":0.85999999999999999},"min":{"1min":0.58899999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.171,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.56599999999999995,"5min":0.56000000000000005,"15min":0.54800000000000004},"max":{"1min":1.1579999999999999,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.91200000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575290,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59388,"kb_used_data":2100,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312452,"statfs":{"total":96636764160,"available":96575950848,"internally_reserved":0,"allocated":2150400,"data_stored":1100099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46899999999999997,"15min":0.46500000000000002},"min":{"1min":0.32200000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.68400000000000005,"5min":0.70799999999999996,"15min":0.80500000000000005},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.53100000000000003},"min":{"1min":0.38300000000000001,"5min":0.318,"15min":0.30599999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.34899999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47099999999999997,"15min":0.46800000000000003},"min":{"1min":0.34100000000000003,"5min":0.32900000000000001,"15min":0.32600000000000001},"max":{"1min":0.58599999999999997,"5min":0.80600000000000005,"15min":0.84799999999999998},"last":0.307},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.56100000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38200000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.93799999999999994},"last":0.41699999999999998}]},{"osd":3,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.39700000000000002,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.74399999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.433},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56699999999999995,"15min":0.55800000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35699999999999998},"max":{"1min":0.73599999999999999,"5min":0.77300000000000002,"15min":0.84599999999999997},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.80100000000000005},"min":{"1min":0.58099999999999996,"5min":0.49399999999999999,"15min":0.48799999999999999},"max":{"1min":1.004,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.84099999999999997,"15min":0.81999999999999995},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.48899999999999999},"max":{"1min":1.0169999999999999,"5min":1.179,"15min":1.3029999999999999},"last":0.627}]},{"osd":5,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.86899999999999999,"15min":0.86399999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.02,"5min":1.2430000000000001,"15min":1.302},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.85999999999999999,"15min":0.85099999999999998},"min":{"1min":0.65700000000000003,"5min":0.60699999999999998,"15min":0.54000000000000004},"max":{"1min":1.1120000000000001,"5min":1.2410000000000001,"15min":1.248},"last":0.67400000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85999999999999999,"15min":0.82899999999999996},"min":{"1min":0.59799999999999998,"5min":0.56699999999999995,"15min":0.54800000000000004},"max":{"1min":1.042,"5min":1.2749999999999999,"15min":1.446},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.83599999999999997,"15min":0.82399999999999995},"min":{"1min":0.64500000000000002,"5min":0.55100000000000005,"15min":0.51700000000000002},"max":{"1min":1.119,"5min":1.1830000000000001,"15min":1.266},"last":0.65200000000000002}]},{"osd":7,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.873,"15min":0.84499999999999997},"min":{"1min":0.64800000000000002,"5min":0.56799999999999995,"15min":0.55900000000000005},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.871,"15min":0.84999999999999998},"min":{"1min":0.69099999999999995,"5min":0.61599999999999999,"15min":0.56000000000000005},"max":{"1min":1.2709999999999999,"5min":1.351,"15min":1.371},"last":0.61199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575291,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41340,"kb_used_data":2100,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330500,"statfs":{"total":96636764160,"available":96594432000,"internally_reserved":0,"allocated":2150400,"data_stored":1101076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46000000000000002,"15min":0.45500000000000002},"min":{"1min":0.33100000000000002,"5min":0.316,"15min":0.28100000000000003},"max":{"1min":0.70899999999999996,"5min":0.753,"15min":0.81599999999999995},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.52500000000000002},"min":{"1min":0.41799999999999998,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":0.68500000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.45000000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.46899999999999997,"15min":0.47199999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.30499999999999999},"max":{"1min":0.59999999999999998,"5min":0.63600000000000001,"15min":0.70799999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.39700000000000002,"5min":0.378,"15min":0.32800000000000001},"max":{"1min":0.747,"5min":0.79900000000000004,"15min":0.89200000000000002},"last":0.51100000000000001}]},{"osd":3,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66500000000000004,"15min":0.65900000000000003},"min":{"1min":0.51100000000000001,"5min":0.47099999999999997,"15min":0.42299999999999999},"max":{"1min":0.90200000000000002,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.36399999999999999,"5min":0.34300000000000003,"15min":0.32300000000000001},"max":{"1min":0.86899999999999999,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.53300000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.79500000000000004,"15min":0.80800000000000005},"min":{"1min":0.61599999999999999,"5min":0.56699999999999995,"15min":0.52200000000000002},"max":{"1min":1.091,"5min":1.155,"15min":1.2470000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.81899999999999995,"15min":0.82799999999999996},"min":{"1min":0.63600000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.0309999999999999,"5min":1.151,"15min":1.171},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.64000000000000001,"5min":0.56299999999999994,"15min":0.54500000000000004},"max":{"1min":1.0469999999999999,"5min":1.224,"15min":1.224},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.81399999999999995,"15min":0.83099999999999996},"min":{"1min":0.66100000000000003,"5min":0.57299999999999995,"15min":0.56100000000000005},"max":{"1min":1.1240000000000001,"5min":1.1259999999999999,"15min":1.375},"last":0.84399999999999997}]},{"osd":6,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.66900000000000004,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.036,"5min":1.1759999999999999,"15min":1.2},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.84299999999999997,"15min":0.85399999999999998},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.56399999999999995},"max":{"1min":1.0589999999999999,"5min":1.169,"15min":1.329},"last":0.745}]},{"osd":7,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.79500000000000004,"15min":0.81899999999999995},"min":{"1min":0.59699999999999998,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.0609999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.86899999999999999,"15min":0.875},"min":{"1min":0.71799999999999997,"5min":0.59999999999999998,"15min":0.58899999999999997},"max":{"1min":1.0389999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.89800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575292,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41936,"kb_used_data":2696,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329904,"statfs":{"total":96636764160,"available":96593821696,"internally_reserved":0,"allocated":2760704,"data_stored":1692625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.33500000000000002,"5min":0.30499999999999999,"15min":0.29899999999999999},"max":{"1min":0.69399999999999995,"5min":0.77100000000000002,"15min":0.85299999999999998},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39900000000000002,"5min":0.36799999999999999,"15min":0.308},"max":{"1min":0.73099999999999998,"5min":0.76800000000000002,"15min":0.80700000000000005},"last":0.39700000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53200000000000003,"15min":0.53600000000000003},"min":{"1min":0.42599999999999999,"5min":0.35699999999999998,"15min":0.33700000000000002},"max":{"1min":0.63500000000000001,"5min":0.72499999999999998,"15min":1.002},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77700000000000002,"5min":0.84099999999999997,"15min":0.91200000000000003},"last":0.37}]},{"osd":3,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52900000000000003,"15min":0.53200000000000003},"min":{"1min":0.38400000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75700000000000001,"5min":0.77000000000000002,"15min":0.83299999999999996},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.47499999999999998,"5min":0.44400000000000001,"15min":0.38800000000000001},"max":{"1min":0.75900000000000001,"5min":0.77200000000000002,"15min":0.871},"last":0.40999999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.83599999999999997,"15min":0.83099999999999996},"min":{"1min":0.60699999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.157,"5min":1.274,"15min":1.284},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.85299999999999998,"15min":0.83699999999999997},"min":{"1min":0.63,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.034,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.82599999999999996,"15min":0.83999999999999997},"min":{"1min":0.59799999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0800000000000001,"5min":1.28,"15min":1.294},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.86699999999999999,"15min":0.85799999999999998},"min":{"1min":0.66200000000000003,"5min":0.58399999999999996,"15min":0.52400000000000002},"max":{"1min":1.0189999999999999,"5min":1.472,"15min":1.472},"last":0.61299999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.84099999999999997,"15min":0.84299999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.96999999999999997,"5min":1.639,"15min":1.639},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.88100000000000001,"15min":0.86399999999999999},"min":{"1min":0.65900000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.044,"5min":1.544,"15min":1.544},"last":0.53300000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.85299999999999998,"15min":0.86199999999999999},"min":{"1min":0.67300000000000004,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1259999999999999,"5min":1.236,"15min":1.3280000000000001},"last":0.63},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.877,"15min":0.86299999999999999},"min":{"1min":0.63100000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.103,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.65300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:29:50.293 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:29:50.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.467+0000 7f4e8349c640 1 Processor -- start 2023-07-14T13:29:50.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.467+0000 7f4e8349c640 1 -- start start 2023-07-14T13:29:50.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.471+0000 7f4e8349c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4e7c15bc00 0x7f4e7c0ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.471+0000 7f4e8349c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4e7c160450 0x7f4e7c06e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.471+0000 7f4e8349c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e7c0c9c30 con 0x7f4e7c069430 2023-07-14T13:29:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.471+0000 7f4e8349c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e7c0c96b0 con 0x7f4e7c15bc00 2023-07-14T13:29:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.471+0000 7f4e8349c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e7c15bfd0 con 0x7f4e7c160450 2023-07-14T13:29:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.471+0000 7f4e81a39640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4e7c069430 0x7f4e7c069830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46004/0 (socket says 172.21.15.5:46004) 2023-07-14T13:29:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.471+0000 7f4e81a39640 1 -- 172.21.15.5:0/2961415358 learned_addr learned my addr 172.21.15.5:0/2961415358 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:50.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.471+0000 7f4e81238640 1 --2- 172.21.15.5:0/2961415358 >> v2:172.21.15.5:3300/0 conn(0x7f4e7c15bc00 0x7f4e7c0ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:50.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.471+0000 7f4e80a37640 1 --2- 172.21.15.5:0/2961415358 >> v2:172.21.15.154:3300/0 conn(0x7f4e7c160450 0x7f4e7c06e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:50.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.471+0000 7f4e81238640 1 -- 172.21.15.5:0/2961415358 >> v2:172.21.15.154:3300/0 conn(0x7f4e7c160450 msgr2=0x7f4e7c06e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:50.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.471+0000 7f4e81238640 1 --2- 172.21.15.5:0/2961415358 >> v2:172.21.15.154:3300/0 conn(0x7f4e7c160450 0x7f4e7c06e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:50.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.471+0000 7f4e81238640 1 -- 172.21.15.5:0/2961415358 >> v1:172.21.15.5:6789/0 conn(0x7f4e7c069430 legacy=0x7f4e7c069830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:50.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.471+0000 7f4e81238640 1 -- 172.21.15.5:0/2961415358 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7c0cee30 con 0x7f4e7c15bc00 2023-07-14T13:29:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.475+0000 7f4e81238640 1 --2- 172.21.15.5:0/2961415358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e7c15bc00 0x7f4e7c0ce8f0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c06a160 tx=0x7f4e7801c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1f0eb863841300 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.475+0000 7f4e73fff640 1 -- 172.21.15.5:0/2961415358 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e780ab600 con 0x7f4e7c15bc00 2023-07-14T13:29:50.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.475+0000 7f4e73fff640 1 -- 172.21.15.5:0/2961415358 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e780a7050 con 0x7f4e7c15bc00 2023-07-14T13:29:50.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.475+0000 7f4e73fff640 1 -- 172.21.15.5:0/2961415358 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e780ab980 con 0x7f4e7c15bc00 2023-07-14T13:29:50.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.475+0000 7f4e8349c640 1 -- 172.21.15.5:0/2961415358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e7c15bc00 msgr2=0x7f4e7c0ce8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:50.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.475+0000 7f4e8349c640 1 --2- 172.21.15.5:0/2961415358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e7c15bc00 0x7f4e7c0ce8f0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c06a160 tx=0x7f4e7801c2f0 comp rx=0 tx=0).stop 2023-07-14T13:29:50.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.475+0000 7f4e8349c640 1 -- 172.21.15.5:0/2961415358 shutdown_connections 2023-07-14T13:29:50.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.475+0000 7f4e8349c640 1 --2- 172.21.15.5:0/2961415358 >> v2:172.21.15.154:3300/0 conn(0x7f4e7c160450 0x7f4e7c06e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:50.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.475+0000 7f4e8349c640 1 --2- 172.21.15.5:0/2961415358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e7c15bc00 0x7f4e7c0ce8f0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:50.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.475+0000 7f4e8349c640 1 -- 172.21.15.5:0/2961415358 >> 172.21.15.5:0/2961415358 conn(0x7f4e7c0b1840 msgr2=0x7f4e7c0cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:50.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.475+0000 7f4e8349c640 1 -- 172.21.15.5:0/2961415358 shutdown_connections 2023-07-14T13:29:50.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.475+0000 7f4e8349c640 1 -- 172.21.15.5:0/2961415358 wait complete. 2023-07-14T13:29:50.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.475+0000 7f4e8349c640 1 Processor -- start 2023-07-14T13:29:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.475+0000 7f4e8349c640 1 -- start start 2023-07-14T13:29:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.479+0000 7f4e8349c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e7c069430 0x7f4e7c15c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.479+0000 7f4e8349c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e7c15bc00 0x7f4e7c1463f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.479+0000 7f4e8349c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e7c160450 0x7f4e7c15e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.479+0000 7f4e8349c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c1e7fc0 con 0x7f4e7c069430 2023-07-14T13:29:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.479+0000 7f4e8349c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c1e5550 con 0x7f4e7c160450 2023-07-14T13:29:50.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.479+0000 7f4e8349c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c15c6e0 con 0x7f4e7c15bc00 2023-07-14T13:29:50.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.479+0000 7f4e81238640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e7c069430 0x7f4e7c15c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:50.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.479+0000 7f4e81238640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e7c069430 0x7f4e7c15c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52554/0 (socket says 172.21.15.5:52554) 2023-07-14T13:29:50.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.479+0000 7f4e81238640 1 -- 172.21.15.5:0/1005223585 learned_addr learned my addr 172.21.15.5:0/1005223585 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:50.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.479+0000 7f4e81a39640 1 --2- 172.21.15.5:0/1005223585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e7c160450 0x7f4e7c15e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:50.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.479+0000 7f4e80a37640 1 --2- 172.21.15.5:0/1005223585 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e7c15bc00 0x7f4e7c1463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:50.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.479+0000 7f4e81238640 1 -- 172.21.15.5:0/1005223585 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e7c15bc00 msgr2=0x7f4e7c1463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:50.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.479+0000 7f4e81238640 1 --2- 172.21.15.5:0/1005223585 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e7c15bc00 0x7f4e7c1463f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:50.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.479+0000 7f4e81238640 1 -- 172.21.15.5:0/1005223585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e7c160450 msgr2=0x7f4e7c15e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:50.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.479+0000 7f4e81238640 1 --2- 172.21.15.5:0/1005223585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e7c160450 0x7f4e7c15e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:50.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.479+0000 7f4e81238640 1 -- 172.21.15.5:0/1005223585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e78009420 con 0x7f4e7c069430 2023-07-14T13:29:50.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.479+0000 7f4e81a39640 1 --2- 172.21.15.5:0/1005223585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e7c160450 0x7f4e7c15e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:29:50.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.479+0000 7f4e80a37640 1 --2- 172.21.15.5:0/1005223585 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e7c15bc00 0x7f4e7c1463f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:29:50.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.479+0000 7f4e81238640 1 --2- 172.21.15.5:0/1005223585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e7c069430 0x7f4e7c15c1a0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f4e780ae040 tx=0x7f4e78019090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:50.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.479+0000 7f4e71ffb640 1 -- 172.21.15.5:0/1005223585 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e780b4820 con 0x7f4e7c069430 2023-07-14T13:29:50.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.479+0000 7f4e71ffb640 1 -- 172.21.15.5:0/1005223585 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e780b49a0 con 0x7f4e7c069430 2023-07-14T13:29:50.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.479+0000 7f4e71ffb640 1 -- 172.21.15.5:0/1005223585 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e780b4d50 con 0x7f4e7c069430 2023-07-14T13:29:50.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.479+0000 7f4e8349c640 1 -- 172.21.15.5:0/1005223585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e7c1e57a0 con 0x7f4e7c069430 2023-07-14T13:29:50.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.479+0000 7f4e8349c640 1 -- 172.21.15.5:0/1005223585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e7c1e5d60 con 0x7f4e7c069430 2023-07-14T13:29:50.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.479+0000 7f4e8349c640 1 -- 172.21.15.5:0/1005223585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e7c0c2a80 con 0x7f4e7c069430 2023-07-14T13:29:50.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.483+0000 7f4e71ffb640 1 -- 172.21.15.5:0/1005223585 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4e780b2040 con 0x7f4e7c069430 2023-07-14T13:29:50.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.483+0000 7f4e71ffb640 1 --2- 172.21.15.5:0/1005223585 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f4e600663a0 0x7f4e60068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:50.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.483+0000 7f4e71ffb640 1 -- 172.21.15.5:0/1005223585 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f4e7811e3c0 con 0x7f4e7c069430 2023-07-14T13:29:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.483+0000 7f4e80a37640 1 --2- 172.21.15.5:0/1005223585 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f4e600663a0 0x7f4e60068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.483+0000 7f4e80a37640 1 --2- 172.21.15.5:0/1005223585 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f4e600663a0 0x7f4e60068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c069c50 tx=0x7f4e6c008040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:50.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.487+0000 7f4e71ffb640 1 -- 172.21.15.5:0/1005223585 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4e780eb600 con 0x7f4e7c069430 2023-07-14T13:29:50.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.639+0000 7f4e8349c640 1 -- 172.21.15.5:0/1005223585 --> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4e7c0cfbf0 con 0x7f4e600663a0 2023-07-14T13:29:50.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.647+0000 7f4e71ffb640 1 -- 172.21.15.5:0/1005223585 <== mgr.9247 v2:172.21.15.154:6832/1905284593 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+307174 (secure 0 0 0) 0x7f4e6c009df0 con 0x7f4e600663a0 2023-07-14T13:29:50.651 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:29:50.653 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:29:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.651+0000 7f4e8349c640 1 -- 172.21.15.5:0/1005223585 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f4e600663a0 msgr2=0x7f4e60068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.651+0000 7f4e8349c640 1 --2- 172.21.15.5:0/1005223585 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f4e600663a0 0x7f4e60068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c069c50 tx=0x7f4e6c008040 comp rx=0 tx=0).stop 2023-07-14T13:29:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.651+0000 7f4e8349c640 1 -- 172.21.15.5:0/1005223585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e7c069430 msgr2=0x7f4e7c15c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.651+0000 7f4e8349c640 1 --2- 172.21.15.5:0/1005223585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e7c069430 0x7f4e7c15c1a0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f4e780ae040 tx=0x7f4e78019090 comp rx=0 tx=0).stop 2023-07-14T13:29:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.651+0000 7f4e8349c640 1 -- 172.21.15.5:0/1005223585 shutdown_connections 2023-07-14T13:29:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.651+0000 7f4e8349c640 1 --2- 172.21.15.5:0/1005223585 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f4e600663a0 0x7f4e60068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.651+0000 7f4e8349c640 1 --2- 172.21.15.5:0/1005223585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e7c160450 0x7f4e7c15e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.651+0000 7f4e8349c640 1 --2- 172.21.15.5:0/1005223585 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e7c15bc00 0x7f4e7c1463f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.651+0000 7f4e8349c640 1 --2- 172.21.15.5:0/1005223585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e7c069430 0x7f4e7c15c1a0 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.651+0000 7f4e8349c640 1 -- 172.21.15.5:0/1005223585 >> 172.21.15.5:0/1005223585 conn(0x7f4e7c0b1840 msgr2=0x7f4e7c0afde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.651+0000 7f4e8349c640 1 -- 172.21.15.5:0/1005223585 shutdown_connections 2023-07-14T13:29:50.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.651+0000 7f4e8349c640 1 -- 172.21.15.5:0/1005223585 wait complete. 2023-07-14T13:29:50.672 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-14T13:29:50.058487+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":522,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":327,"ondisk_log_size":327,"up":166,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":365452,"kb_used_data":17868,"kb_used_omap":0,"kb_used_meta":347520,"kb_avail":754609268,"statfs":{"total":773094113280,"available":772719890432,"internally_reserved":0,"allocated":18296832,"data_stored":9929899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":355860480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.912780"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479686+0000","last_change":"2023-07-14T13:29:46.159865+0000","last_active":"2023-07-14T13:29:48.479686+0000","last_peered":"2023-07-14T13:29:48.479686+0000","last_clean":"2023-07-14T13:29:48.479686+0000","last_became_active":"2023-07-14T13:29:46.159410+0000","last_became_peered":"2023-07-14T13:29:46.159410+0000","last_unstale":"2023-07-14T13:29:48.479686+0000","last_undegraded":"2023-07-14T13:29:48.479686+0000","last_fullsized":"2023-07-14T13:29:48.479686+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:01.004278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479590+0000","last_change":"2023-07-14T13:29:46.162495+0000","last_active":"2023-07-14T13:29:48.479590+0000","last_peered":"2023-07-14T13:29:48.479590+0000","last_clean":"2023-07-14T13:29:48.479590+0000","last_became_active":"2023-07-14T13:29:46.162075+0000","last_became_peered":"2023-07-14T13:29:46.162075+0000","last_unstale":"2023-07-14T13:29:48.479590+0000","last_undegraded":"2023-07-14T13:29:48.479590+0000","last_fullsized":"2023-07-14T13:29:48.479590+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:33:26.310832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141616+0000","last_change":"2023-07-14T13:29:46.165214+0000","last_active":"2023-07-14T13:29:47.141616+0000","last_peered":"2023-07-14T13:29:47.141616+0000","last_clean":"2023-07-14T13:29:47.141616+0000","last_became_active":"2023-07-14T13:29:46.164908+0000","last_became_peered":"2023-07-14T13:29:46.164908+0000","last_unstale":"2023-07-14T13:29:47.141616+0000","last_undegraded":"2023-07-14T13:29:47.141616+0000","last_fullsized":"2023-07-14T13:29:47.141616+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:23:47.997179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141388+0000","last_change":"2023-07-14T13:29:46.163840+0000","last_active":"2023-07-14T13:29:47.141388+0000","last_peered":"2023-07-14T13:29:47.141388+0000","last_clean":"2023-07-14T13:29:47.141388+0000","last_became_active":"2023-07-14T13:29:46.163561+0000","last_became_peered":"2023-07-14T13:29:46.163561+0000","last_unstale":"2023-07-14T13:29:47.141388+0000","last_undegraded":"2023-07-14T13:29:47.141388+0000","last_fullsized":"2023-07-14T13:29:47.141388+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:31:33.867324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146119+0000","last_change":"2023-07-14T13:29:46.157415+0000","last_active":"2023-07-14T13:29:47.146119+0000","last_peered":"2023-07-14T13:29:47.146119+0000","last_clean":"2023-07-14T13:29:47.146119+0000","last_became_active":"2023-07-14T13:29:46.156908+0000","last_became_peered":"2023-07-14T13:29:46.156908+0000","last_unstale":"2023-07-14T13:29:47.146119+0000","last_undegraded":"2023-07-14T13:29:47.146119+0000","last_fullsized":"2023-07-14T13:29:47.146119+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:24:50.135616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141617+0000","last_change":"2023-07-14T13:29:46.152971+0000","last_active":"2023-07-14T13:29:47.141617+0000","last_peered":"2023-07-14T13:29:47.141617+0000","last_clean":"2023-07-14T13:29:47.141617+0000","last_became_active":"2023-07-14T13:29:46.152641+0000","last_became_peered":"2023-07-14T13:29:46.152641+0000","last_unstale":"2023-07-14T13:29:47.141617+0000","last_undegraded":"2023-07-14T13:29:47.141617+0000","last_fullsized":"2023-07-14T13:29:47.141617+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:06:17.863530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141851+0000","last_change":"2023-07-14T13:29:46.151471+0000","last_active":"2023-07-14T13:29:47.141851+0000","last_peered":"2023-07-14T13:29:47.141851+0000","last_clean":"2023-07-14T13:29:47.141851+0000","last_became_active":"2023-07-14T13:29:46.150996+0000","last_became_peered":"2023-07-14T13:29:46.150996+0000","last_unstale":"2023-07-14T13:29:47.141851+0000","last_undegraded":"2023-07-14T13:29:47.141851+0000","last_fullsized":"2023-07-14T13:29:47.141851+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:36:46.294425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797696+0000","last_change":"2023-07-14T13:29:46.161038+0000","last_active":"2023-07-14T13:29:48.797696+0000","last_peered":"2023-07-14T13:29:48.797696+0000","last_clean":"2023-07-14T13:29:48.797696+0000","last_became_active":"2023-07-14T13:29:46.160750+0000","last_became_peered":"2023-07-14T13:29:46.160750+0000","last_unstale":"2023-07-14T13:29:48.797696+0000","last_undegraded":"2023-07-14T13:29:48.797696+0000","last_fullsized":"2023-07-14T13:29:48.797696+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:42:08.863141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141480+0000","last_change":"2023-07-14T13:29:46.149699+0000","last_active":"2023-07-14T13:29:47.141480+0000","last_peered":"2023-07-14T13:29:47.141480+0000","last_clean":"2023-07-14T13:29:47.141480+0000","last_became_active":"2023-07-14T13:29:46.149429+0000","last_became_peered":"2023-07-14T13:29:46.149429+0000","last_unstale":"2023-07-14T13:29:47.141480+0000","last_undegraded":"2023-07-14T13:29:47.141480+0000","last_fullsized":"2023-07-14T13:29:47.141480+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:55:39.460034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479340+0000","last_change":"2023-07-14T13:29:46.160166+0000","last_active":"2023-07-14T13:29:48.479340+0000","last_peered":"2023-07-14T13:29:48.479340+0000","last_clean":"2023-07-14T13:29:48.479340+0000","last_became_active":"2023-07-14T13:29:46.159843+0000","last_became_peered":"2023-07-14T13:29:46.159843+0000","last_unstale":"2023-07-14T13:29:48.479340+0000","last_undegraded":"2023-07-14T13:29:48.479340+0000","last_fullsized":"2023-07-14T13:29:48.479340+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:12:09.149124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141216+0000","last_change":"2023-07-14T13:29:46.155517+0000","last_active":"2023-07-14T13:29:47.141216+0000","last_peered":"2023-07-14T13:29:47.141216+0000","last_clean":"2023-07-14T13:29:47.141216+0000","last_became_active":"2023-07-14T13:29:46.155241+0000","last_became_peered":"2023-07-14T13:29:46.155241+0000","last_unstale":"2023-07-14T13:29:47.141216+0000","last_undegraded":"2023-07-14T13:29:47.141216+0000","last_fullsized":"2023-07-14T13:29:47.141216+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:23:00.388761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797786+0000","last_change":"2023-07-14T13:29:46.165903+0000","last_active":"2023-07-14T13:29:48.797786+0000","last_peered":"2023-07-14T13:29:48.797786+0000","last_clean":"2023-07-14T13:29:48.797786+0000","last_became_active":"2023-07-14T13:29:46.165382+0000","last_became_peered":"2023-07-14T13:29:46.165382+0000","last_unstale":"2023-07-14T13:29:48.797786+0000","last_undegraded":"2023-07-14T13:29:48.797786+0000","last_fullsized":"2023-07-14T13:29:48.797786+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:40:22.854519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:49.060361+0000","last_change":"2023-07-14T13:29:46.151003+0000","last_active":"2023-07-14T13:29:49.060361+0000","last_peered":"2023-07-14T13:29:49.060361+0000","last_clean":"2023-07-14T13:29:49.060361+0000","last_became_active":"2023-07-14T13:29:46.150704+0000","last_became_peered":"2023-07-14T13:29:46.150704+0000","last_unstale":"2023-07-14T13:29:49.060361+0000","last_undegraded":"2023-07-14T13:29:49.060361+0000","last_fullsized":"2023-07-14T13:29:49.060361+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:24.768994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141544+0000","last_change":"2023-07-14T13:29:46.153305+0000","last_active":"2023-07-14T13:29:47.141544+0000","last_peered":"2023-07-14T13:29:47.141544+0000","last_clean":"2023-07-14T13:29:47.141544+0000","last_became_active":"2023-07-14T13:29:46.153008+0000","last_became_peered":"2023-07-14T13:29:46.153008+0000","last_unstale":"2023-07-14T13:29:47.141544+0000","last_undegraded":"2023-07-14T13:29:47.141544+0000","last_fullsized":"2023-07-14T13:29:47.141544+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:16:23.727196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146015+0000","last_change":"2023-07-14T13:29:46.168865+0000","last_active":"2023-07-14T13:29:47.146015+0000","last_peered":"2023-07-14T13:29:47.146015+0000","last_clean":"2023-07-14T13:29:47.146015+0000","last_became_active":"2023-07-14T13:29:46.168603+0000","last_became_peered":"2023-07-14T13:29:46.168603+0000","last_unstale":"2023-07-14T13:29:47.146015+0000","last_undegraded":"2023-07-14T13:29:47.146015+0000","last_fullsized":"2023-07-14T13:29:47.146015+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:35:20.966733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797806+0000","last_change":"2023-07-14T13:29:46.155602+0000","last_active":"2023-07-14T13:29:48.797806+0000","last_peered":"2023-07-14T13:29:48.797806+0000","last_clean":"2023-07-14T13:29:48.797806+0000","last_became_active":"2023-07-14T13:29:46.155108+0000","last_became_peered":"2023-07-14T13:29:46.155108+0000","last_unstale":"2023-07-14T13:29:48.797806+0000","last_undegraded":"2023-07-14T13:29:48.797806+0000","last_fullsized":"2023-07-14T13:29:48.797806+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:13.416506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141791+0000","last_change":"2023-07-14T13:29:46.152988+0000","last_active":"2023-07-14T13:29:47.141791+0000","last_peered":"2023-07-14T13:29:47.141791+0000","last_clean":"2023-07-14T13:29:47.141791+0000","last_became_active":"2023-07-14T13:29:46.152697+0000","last_became_peered":"2023-07-14T13:29:46.152697+0000","last_unstale":"2023-07-14T13:29:47.141791+0000","last_undegraded":"2023-07-14T13:29:47.141791+0000","last_fullsized":"2023-07-14T13:29:47.141791+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:46:18.882359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797626+0000","last_change":"2023-07-14T13:29:46.156427+0000","last_active":"2023-07-14T13:29:48.797626+0000","last_peered":"2023-07-14T13:29:48.797626+0000","last_clean":"2023-07-14T13:29:48.797626+0000","last_became_active":"2023-07-14T13:29:46.156073+0000","last_became_peered":"2023-07-14T13:29:46.156073+0000","last_unstale":"2023-07-14T13:29:48.797626+0000","last_undegraded":"2023-07-14T13:29:48.797626+0000","last_fullsized":"2023-07-14T13:29:48.797626+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:22:17.681971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146211+0000","last_change":"2023-07-14T13:29:46.150139+0000","last_active":"2023-07-14T13:29:47.146211+0000","last_peered":"2023-07-14T13:29:47.146211+0000","last_clean":"2023-07-14T13:29:47.146211+0000","last_became_active":"2023-07-14T13:29:46.149853+0000","last_became_peered":"2023-07-14T13:29:46.149853+0000","last_unstale":"2023-07-14T13:29:47.146211+0000","last_undegraded":"2023-07-14T13:29:47.146211+0000","last_fullsized":"2023-07-14T13:29:47.146211+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:58.328252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797616+0000","last_change":"2023-07-14T13:29:46.159106+0000","last_active":"2023-07-14T13:29:48.797616+0000","last_peered":"2023-07-14T13:29:48.797616+0000","last_clean":"2023-07-14T13:29:48.797616+0000","last_became_active":"2023-07-14T13:29:46.158801+0000","last_became_peered":"2023-07-14T13:29:46.158801+0000","last_unstale":"2023-07-14T13:29:48.797616+0000","last_undegraded":"2023-07-14T13:29:48.797616+0000","last_fullsized":"2023-07-14T13:29:48.797616+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:20:40.273751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141222+0000","last_change":"2023-07-14T13:29:46.155534+0000","last_active":"2023-07-14T13:29:47.141222+0000","last_peered":"2023-07-14T13:29:47.141222+0000","last_clean":"2023-07-14T13:29:47.141222+0000","last_became_active":"2023-07-14T13:29:46.155265+0000","last_became_peered":"2023-07-14T13:29:46.155265+0000","last_unstale":"2023-07-14T13:29:47.141222+0000","last_undegraded":"2023-07-14T13:29:47.141222+0000","last_fullsized":"2023-07-14T13:29:47.141222+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:58:07.820454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.145962+0000","last_change":"2023-07-14T13:29:46.159148+0000","last_active":"2023-07-14T13:29:47.145962+0000","last_peered":"2023-07-14T13:29:47.145962+0000","last_clean":"2023-07-14T13:29:47.145962+0000","last_became_active":"2023-07-14T13:29:46.157198+0000","last_became_peered":"2023-07-14T13:29:46.157198+0000","last_unstale":"2023-07-14T13:29:47.145962+0000","last_undegraded":"2023-07-14T13:29:47.145962+0000","last_fullsized":"2023-07-14T13:29:47.145962+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:06:21.860997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479648+0000","last_change":"2023-07-14T13:29:46.162714+0000","last_active":"2023-07-14T13:29:48.479648+0000","last_peered":"2023-07-14T13:29:48.479648+0000","last_clean":"2023-07-14T13:29:48.479648+0000","last_became_active":"2023-07-14T13:29:46.162123+0000","last_became_peered":"2023-07-14T13:29:46.162123+0000","last_unstale":"2023-07-14T13:29:48.479648+0000","last_undegraded":"2023-07-14T13:29:48.479648+0000","last_fullsized":"2023-07-14T13:29:48.479648+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:36.907010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"171'4","reported_seq":17,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141806+0000","last_change":"2023-07-14T13:29:45.169422+0000","last_active":"2023-07-14T13:29:47.141806+0000","last_peered":"2023-07-14T13:29:47.141806+0000","last_clean":"2023-07-14T13:29:47.141806+0000","last_became_active":"2023-07-14T13:29:45.169138+0000","last_became_peered":"2023-07-14T13:29:45.169138+0000","last_unstale":"2023-07-14T13:29:47.141806+0000","last_undegraded":"2023-07-14T13:29:47.141806+0000","last_fullsized":"2023-07-14T13:29:47.141806+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:58:31.107549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479614+0000","last_change":"2023-07-14T13:29:46.160327+0000","last_active":"2023-07-14T13:29:48.479614+0000","last_peered":"2023-07-14T13:29:48.479614+0000","last_clean":"2023-07-14T13:29:48.479614+0000","last_became_active":"2023-07-14T13:29:46.159195+0000","last_became_peered":"2023-07-14T13:29:46.159195+0000","last_unstale":"2023-07-14T13:29:48.479614+0000","last_undegraded":"2023-07-14T13:29:48.479614+0000","last_fullsized":"2023-07-14T13:29:48.479614+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:15:41.664289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.155482+0000","last_change":"2023-07-14T13:29:44.155482+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.155482+0000","last_undegraded":"2023-07-14T13:29:44.155482+0000","last_fullsized":"2023-07-14T13:29:44.155482+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146443+0000","last_change":"2023-07-14T13:29:46.161735+0000","last_active":"2023-07-14T13:29:47.146443+0000","last_peered":"2023-07-14T13:29:47.146443+0000","last_clean":"2023-07-14T13:29:47.146443+0000","last_became_active":"2023-07-14T13:29:46.161340+0000","last_became_peered":"2023-07-14T13:29:46.161340+0000","last_unstale":"2023-07-14T13:29:47.146443+0000","last_undegraded":"2023-07-14T13:29:47.146443+0000","last_fullsized":"2023-07-14T13:29:47.146443+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:45:00.745964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.153856+0000","last_change":"2023-07-14T13:29:44.153856+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.153856+0000","last_undegraded":"2023-07-14T13:29:44.153856+0000","last_fullsized":"2023-07-14T13:29:44.153856+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479548+0000","last_change":"2023-07-14T13:29:45.163603+0000","last_active":"2023-07-14T13:29:48.479548+0000","last_peered":"2023-07-14T13:29:48.479548+0000","last_clean":"2023-07-14T13:29:48.479548+0000","last_became_active":"2023-07-14T13:29:45.163310+0000","last_became_peered":"2023-07-14T13:29:45.163310+0000","last_unstale":"2023-07-14T13:29:48.479548+0000","last_undegraded":"2023-07-14T13:29:48.479548+0000","last_fullsized":"2023-07-14T13:29:48.479548+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:53:27.366678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:49.060181+0000","last_change":"2023-07-14T13:29:46.154089+0000","last_active":"2023-07-14T13:29:49.060181+0000","last_peered":"2023-07-14T13:29:49.060181+0000","last_clean":"2023-07-14T13:29:49.060181+0000","last_became_active":"2023-07-14T13:29:46.153663+0000","last_became_peered":"2023-07-14T13:29:46.153663+0000","last_unstale":"2023-07-14T13:29:49.060181+0000","last_undegraded":"2023-07-14T13:29:49.060181+0000","last_fullsized":"2023-07-14T13:29:49.060181+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:30.137865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146336+0000","last_change":"2023-07-14T13:29:45.177250+0000","last_active":"2023-07-14T13:29:47.146336+0000","last_peered":"2023-07-14T13:29:47.146336+0000","last_clean":"2023-07-14T13:29:47.146336+0000","last_became_active":"2023-07-14T13:29:45.176926+0000","last_became_peered":"2023-07-14T13:29:45.176926+0000","last_unstale":"2023-07-14T13:29:47.146336+0000","last_undegraded":"2023-07-14T13:29:47.146336+0000","last_fullsized":"2023-07-14T13:29:47.146336+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:21:29.147948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141484+0000","last_change":"2023-07-14T13:29:45.173114+0000","last_active":"2023-07-14T13:29:47.141484+0000","last_peered":"2023-07-14T13:29:47.141484+0000","last_clean":"2023-07-14T13:29:47.141484+0000","last_became_active":"2023-07-14T13:29:45.172835+0000","last_became_peered":"2023-07-14T13:29:45.172835+0000","last_unstale":"2023-07-14T13:29:47.141484+0000","last_undegraded":"2023-07-14T13:29:47.141484+0000","last_fullsized":"2023-07-14T13:29:47.141484+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:27:21.083351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479370+0000","last_change":"2023-07-14T13:29:46.154070+0000","last_active":"2023-07-14T13:29:48.479370+0000","last_peered":"2023-07-14T13:29:48.479370+0000","last_clean":"2023-07-14T13:29:48.479370+0000","last_became_active":"2023-07-14T13:29:46.153808+0000","last_became_peered":"2023-07-14T13:29:46.153808+0000","last_unstale":"2023-07-14T13:29:48.479370+0000","last_undegraded":"2023-07-14T13:29:48.479370+0000","last_fullsized":"2023-07-14T13:29:48.479370+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:29:11.403775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.151443+0000","last_change":"2023-07-14T13:29:44.151443+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.151443+0000","last_undegraded":"2023-07-14T13:29:44.151443+0000","last_fullsized":"2023-07-14T13:29:44.151443+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141245+0000","last_change":"2023-07-14T13:29:45.171928+0000","last_active":"2023-07-14T13:29:47.141245+0000","last_peered":"2023-07-14T13:29:47.141245+0000","last_clean":"2023-07-14T13:29:47.141245+0000","last_became_active":"2023-07-14T13:29:45.171477+0000","last_became_peered":"2023-07-14T13:29:45.171477+0000","last_unstale":"2023-07-14T13:29:47.141245+0000","last_undegraded":"2023-07-14T13:29:47.141245+0000","last_fullsized":"2023-07-14T13:29:47.141245+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:34:09.091228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797671+0000","last_change":"2023-07-14T13:29:45.170109+0000","last_active":"2023-07-14T13:29:48.797671+0000","last_peered":"2023-07-14T13:29:48.797671+0000","last_clean":"2023-07-14T13:29:48.797671+0000","last_became_active":"2023-07-14T13:29:45.169830+0000","last_became_peered":"2023-07-14T13:29:45.169830+0000","last_unstale":"2023-07-14T13:29:48.797671+0000","last_undegraded":"2023-07-14T13:29:48.797671+0000","last_fullsized":"2023-07-14T13:29:48.797671+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:46:28.314128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.153918+0000","last_change":"2023-07-14T13:29:44.153918+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.153918+0000","last_undegraded":"2023-07-14T13:29:44.153918+0000","last_fullsized":"2023-07-14T13:29:44.153918+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479710+0000","last_change":"2023-07-14T13:29:45.175075+0000","last_active":"2023-07-14T13:29:48.479710+0000","last_peered":"2023-07-14T13:29:48.479710+0000","last_clean":"2023-07-14T13:29:48.479710+0000","last_became_active":"2023-07-14T13:29:45.174845+0000","last_became_peered":"2023-07-14T13:29:45.174845+0000","last_unstale":"2023-07-14T13:29:48.479710+0000","last_undegraded":"2023-07-14T13:29:48.479710+0000","last_fullsized":"2023-07-14T13:29:48.479710+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:42.991173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150865+0000","last_change":"2023-07-14T13:29:44.150865+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150865+0000","last_undegraded":"2023-07-14T13:29:44.150865+0000","last_fullsized":"2023-07-14T13:29:44.150865+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:49.060345+0000","last_change":"2023-07-14T13:29:45.175827+0000","last_active":"2023-07-14T13:29:49.060345+0000","last_peered":"2023-07-14T13:29:49.060345+0000","last_clean":"2023-07-14T13:29:49.060345+0000","last_became_active":"2023-07-14T13:29:45.175532+0000","last_became_peered":"2023-07-14T13:29:45.175532+0000","last_unstale":"2023-07-14T13:29:49.060345+0000","last_undegraded":"2023-07-14T13:29:49.060345+0000","last_fullsized":"2023-07-14T13:29:49.060345+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:46:17.873832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479490+0000","last_change":"2023-07-14T13:29:46.165792+0000","last_active":"2023-07-14T13:29:48.479490+0000","last_peered":"2023-07-14T13:29:48.479490+0000","last_clean":"2023-07-14T13:29:48.479490+0000","last_became_active":"2023-07-14T13:29:46.165479+0000","last_became_peered":"2023-07-14T13:29:46.165479+0000","last_unstale":"2023-07-14T13:29:48.479490+0000","last_undegraded":"2023-07-14T13:29:48.479490+0000","last_fullsized":"2023-07-14T13:29:48.479490+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:09:56.183958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146005+0000","last_change":"2023-07-14T13:29:45.173121+0000","last_active":"2023-07-14T13:29:47.146005+0000","last_peered":"2023-07-14T13:29:47.146005+0000","last_clean":"2023-07-14T13:29:47.146005+0000","last_became_active":"2023-07-14T13:29:45.172588+0000","last_became_peered":"2023-07-14T13:29:45.172588+0000","last_unstale":"2023-07-14T13:29:47.146005+0000","last_undegraded":"2023-07-14T13:29:47.146005+0000","last_fullsized":"2023-07-14T13:29:47.146005+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:51:26.781033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:49.060129+0000","last_change":"2023-07-14T13:29:45.172122+0000","last_active":"2023-07-14T13:29:49.060129+0000","last_peered":"2023-07-14T13:29:49.060129+0000","last_clean":"2023-07-14T13:29:49.060129+0000","last_became_active":"2023-07-14T13:29:45.171842+0000","last_became_peered":"2023-07-14T13:29:45.171842+0000","last_unstale":"2023-07-14T13:29:49.060129+0000","last_undegraded":"2023-07-14T13:29:49.060129+0000","last_fullsized":"2023-07-14T13:29:49.060129+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:06:16.855003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479597+0000","last_change":"2023-07-14T13:29:46.159571+0000","last_active":"2023-07-14T13:29:48.479597+0000","last_peered":"2023-07-14T13:29:48.479597+0000","last_clean":"2023-07-14T13:29:48.479597+0000","last_became_active":"2023-07-14T13:29:46.159131+0000","last_became_peered":"2023-07-14T13:29:46.159131+0000","last_unstale":"2023-07-14T13:29:48.479597+0000","last_undegraded":"2023-07-14T13:29:48.479597+0000","last_fullsized":"2023-07-14T13:29:48.479597+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:29:41.684686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146568+0000","last_change":"2023-07-14T13:29:45.172255+0000","last_active":"2023-07-14T13:29:47.146568+0000","last_peered":"2023-07-14T13:29:47.146568+0000","last_clean":"2023-07-14T13:29:47.146568+0000","last_became_active":"2023-07-14T13:29:45.171958+0000","last_became_peered":"2023-07-14T13:29:45.171958+0000","last_unstale":"2023-07-14T13:29:47.146568+0000","last_undegraded":"2023-07-14T13:29:47.146568+0000","last_fullsized":"2023-07-14T13:29:47.146568+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:03:09.694947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141579+0000","last_change":"2023-07-14T13:29:46.163846+0000","last_active":"2023-07-14T13:29:47.141579+0000","last_peered":"2023-07-14T13:29:47.141579+0000","last_clean":"2023-07-14T13:29:47.141579+0000","last_became_active":"2023-07-14T13:29:46.163582+0000","last_became_peered":"2023-07-14T13:29:46.163582+0000","last_unstale":"2023-07-14T13:29:47.141579+0000","last_undegraded":"2023-07-14T13:29:47.141579+0000","last_fullsized":"2023-07-14T13:29:47.141579+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:30:43.385089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150656+0000","last_change":"2023-07-14T13:29:44.150656+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150656+0000","last_undegraded":"2023-07-14T13:29:44.150656+0000","last_fullsized":"2023-07-14T13:29:44.150656+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150513+0000","last_change":"2023-07-14T13:29:44.150513+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150513+0000","last_undegraded":"2023-07-14T13:29:44.150513+0000","last_fullsized":"2023-07-14T13:29:44.150513+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479790+0000","last_change":"2023-07-14T13:29:45.170294+0000","last_active":"2023-07-14T13:29:48.479790+0000","last_peered":"2023-07-14T13:29:48.479790+0000","last_clean":"2023-07-14T13:29:48.479790+0000","last_became_active":"2023-07-14T13:29:45.170018+0000","last_became_peered":"2023-07-14T13:29:45.170018+0000","last_unstale":"2023-07-14T13:29:48.479790+0000","last_undegraded":"2023-07-14T13:29:48.479790+0000","last_fullsized":"2023-07-14T13:29:48.479790+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:07:58.741534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141753+0000","last_change":"2023-07-14T13:29:46.159322+0000","last_active":"2023-07-14T13:29:47.141753+0000","last_peered":"2023-07-14T13:29:47.141753+0000","last_clean":"2023-07-14T13:29:47.141753+0000","last_became_active":"2023-07-14T13:29:46.159056+0000","last_became_peered":"2023-07-14T13:29:46.159056+0000","last_unstale":"2023-07-14T13:29:47.141753+0000","last_undegraded":"2023-07-14T13:29:47.141753+0000","last_fullsized":"2023-07-14T13:29:47.141753+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:24.768994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141634+0000","last_change":"2023-07-14T13:29:45.175896+0000","last_active":"2023-07-14T13:29:47.141634+0000","last_peered":"2023-07-14T13:29:47.141634+0000","last_clean":"2023-07-14T13:29:47.141634+0000","last_became_active":"2023-07-14T13:29:45.175541+0000","last_became_peered":"2023-07-14T13:29:45.175541+0000","last_unstale":"2023-07-14T13:29:47.141634+0000","last_undegraded":"2023-07-14T13:29:47.141634+0000","last_fullsized":"2023-07-14T13:29:47.141634+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:29.129338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146365+0000","last_change":"2023-07-14T13:29:46.154310+0000","last_active":"2023-07-14T13:29:47.146365+0000","last_peered":"2023-07-14T13:29:47.146365+0000","last_clean":"2023-07-14T13:29:47.146365+0000","last_became_active":"2023-07-14T13:29:46.153864+0000","last_became_peered":"2023-07-14T13:29:46.153864+0000","last_unstale":"2023-07-14T13:29:47.146365+0000","last_undegraded":"2023-07-14T13:29:47.146365+0000","last_fullsized":"2023-07-14T13:29:47.146365+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:14:22.808642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150533+0000","last_change":"2023-07-14T13:29:44.150533+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150533+0000","last_undegraded":"2023-07-14T13:29:44.150533+0000","last_fullsized":"2023-07-14T13:29:44.150533+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797562+0000","last_change":"2023-07-14T13:29:45.171477+0000","last_active":"2023-07-14T13:29:48.797562+0000","last_peered":"2023-07-14T13:29:48.797562+0000","last_clean":"2023-07-14T13:29:48.797562+0000","last_became_active":"2023-07-14T13:29:45.171199+0000","last_became_peered":"2023-07-14T13:29:45.171199+0000","last_unstale":"2023-07-14T13:29:48.797562+0000","last_undegraded":"2023-07-14T13:29:48.797562+0000","last_fullsized":"2023-07-14T13:29:48.797562+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:45.698963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479447+0000","last_change":"2023-07-14T13:29:46.156947+0000","last_active":"2023-07-14T13:29:48.479447+0000","last_peered":"2023-07-14T13:29:48.479447+0000","last_clean":"2023-07-14T13:29:48.479447+0000","last_became_active":"2023-07-14T13:29:46.156662+0000","last_became_peered":"2023-07-14T13:29:46.156662+0000","last_unstale":"2023-07-14T13:29:48.479447+0000","last_undegraded":"2023-07-14T13:29:48.479447+0000","last_fullsized":"2023-07-14T13:29:48.479447+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:40:20.487679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150538+0000","last_change":"2023-07-14T13:29:44.150538+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150538+0000","last_undegraded":"2023-07-14T13:29:44.150538+0000","last_fullsized":"2023-07-14T13:29:44.150538+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146203+0000","last_change":"2023-07-14T13:29:46.158420+0000","last_active":"2023-07-14T13:29:47.146203+0000","last_peered":"2023-07-14T13:29:47.146203+0000","last_clean":"2023-07-14T13:29:47.146203+0000","last_became_active":"2023-07-14T13:29:46.158157+0000","last_became_peered":"2023-07-14T13:29:46.158157+0000","last_unstale":"2023-07-14T13:29:47.146203+0000","last_undegraded":"2023-07-14T13:29:47.146203+0000","last_fullsized":"2023-07-14T13:29:47.146203+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:39:57.006292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.153884+0000","last_change":"2023-07-14T13:29:44.153884+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.153884+0000","last_undegraded":"2023-07-14T13:29:44.153884+0000","last_fullsized":"2023-07-14T13:29:44.153884+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146622+0000","last_change":"2023-07-14T13:29:46.155886+0000","last_active":"2023-07-14T13:29:47.146622+0000","last_peered":"2023-07-14T13:29:47.146622+0000","last_clean":"2023-07-14T13:29:47.146622+0000","last_became_active":"2023-07-14T13:29:46.155575+0000","last_became_peered":"2023-07-14T13:29:46.155575+0000","last_unstale":"2023-07-14T13:29:47.146622+0000","last_undegraded":"2023-07-14T13:29:47.146622+0000","last_fullsized":"2023-07-14T13:29:47.146622+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:38:53.097885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"171'6","reported_seq":19,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:49.060214+0000","last_change":"2023-07-14T13:29:45.175838+0000","last_active":"2023-07-14T13:29:49.060214+0000","last_peered":"2023-07-14T13:29:49.060214+0000","last_clean":"2023-07-14T13:29:49.060214+0000","last_became_active":"2023-07-14T13:29:45.175543+0000","last_became_peered":"2023-07-14T13:29:45.175543+0000","last_unstale":"2023-07-14T13:29:49.060214+0000","last_undegraded":"2023-07-14T13:29:49.060214+0000","last_fullsized":"2023-07-14T13:29:49.060214+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:17:20.283333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"160'304","reported_seq":1106,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-14T13:29:44.154708+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:29:44.154708+0000","last_peered":"2023-07-14T13:29:44.154708+0000","last_clean":"2023-07-14T13:29:44.154708+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:29:44.154708+0000","last_undegraded":"2023-07-14T13:29:44.154708+0000","last_fullsized":"2023-07-14T13:29:44.154708+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:39:53.671602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":282,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-14T13:29:44.153127+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:29:44.153127+0000","last_peered":"2023-07-14T13:29:44.153127+0000","last_clean":"2023-07-14T13:29:44.153127+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:29:44.153127+0000","last_undegraded":"2023-07-14T13:29:44.153127+0000","last_fullsized":"2023-07-14T13:29:44.153127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:23:28.688209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146431+0000","last_change":"2023-07-14T13:29:46.159514+0000","last_active":"2023-07-14T13:29:47.146431+0000","last_peered":"2023-07-14T13:29:47.146431+0000","last_clean":"2023-07-14T13:29:47.146431+0000","last_became_active":"2023-07-14T13:29:46.158086+0000","last_became_peered":"2023-07-14T13:29:46.158086+0000","last_unstale":"2023-07-14T13:29:47.146431+0000","last_undegraded":"2023-07-14T13:29:47.146431+0000","last_fullsized":"2023-07-14T13:29:47.146431+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:16:18.528808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.154151+0000","last_change":"2023-07-14T13:29:44.154151+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.154151+0000","last_undegraded":"2023-07-14T13:29:44.154151+0000","last_fullsized":"2023-07-14T13:29:44.154151+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":287,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-14T13:29:44.154584+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:29:44.154584+0000","last_peered":"2023-07-14T13:29:44.154584+0000","last_clean":"2023-07-14T13:29:44.154584+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:29:44.154584+0000","last_undegraded":"2023-07-14T13:29:44.154584+0000","last_fullsized":"2023-07-14T13:29:44.154584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:23:31.882598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797720+0000","last_change":"2023-07-14T13:29:46.161055+0000","last_active":"2023-07-14T13:29:48.797720+0000","last_peered":"2023-07-14T13:29:48.797720+0000","last_clean":"2023-07-14T13:29:48.797720+0000","last_became_active":"2023-07-14T13:29:46.160756+0000","last_became_peered":"2023-07-14T13:29:46.160756+0000","last_unstale":"2023-07-14T13:29:48.797720+0000","last_undegraded":"2023-07-14T13:29:48.797720+0000","last_fullsized":"2023-07-14T13:29:48.797720+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:28:44.675715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.151080+0000","last_change":"2023-07-14T13:29:44.151080+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.151080+0000","last_undegraded":"2023-07-14T13:29:44.151080+0000","last_fullsized":"2023-07-14T13:29:44.151080+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":292,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797462+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:29:48.797462+0000","last_peered":"2023-07-14T13:29:48.797462+0000","last_clean":"2023-07-14T13:29:48.797462+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:29:48.797462+0000","last_undegraded":"2023-07-14T13:29:48.797462+0000","last_fullsized":"2023-07-14T13:29:48.797462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:14:45.493017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797812+0000","last_change":"2023-07-14T13:29:46.165798+0000","last_active":"2023-07-14T13:29:48.797812+0000","last_peered":"2023-07-14T13:29:48.797812+0000","last_clean":"2023-07-14T13:29:48.797812+0000","last_became_active":"2023-07-14T13:29:46.165366+0000","last_became_peered":"2023-07-14T13:29:46.165366+0000","last_unstale":"2023-07-14T13:29:48.797812+0000","last_undegraded":"2023-07-14T13:29:48.797812+0000","last_fullsized":"2023-07-14T13:29:48.797812+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:34:21.181467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"171'3","reported_seq":16,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797772+0000","last_change":"2023-07-14T13:29:45.167394+0000","last_active":"2023-07-14T13:29:48.797772+0000","last_peered":"2023-07-14T13:29:48.797772+0000","last_clean":"2023-07-14T13:29:48.797772+0000","last_became_active":"2023-07-14T13:29:45.167109+0000","last_became_peered":"2023-07-14T13:29:45.167109+0000","last_unstale":"2023-07-14T13:29:48.797772+0000","last_undegraded":"2023-07-14T13:29:48.797772+0000","last_fullsized":"2023-07-14T13:29:48.797772+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:07:03.377007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":282,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-14T13:29:44.153084+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:29:44.153084+0000","last_peered":"2023-07-14T13:29:44.153084+0000","last_clean":"2023-07-14T13:29:44.153084+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:29:44.153084+0000","last_undegraded":"2023-07-14T13:29:44.153084+0000","last_fullsized":"2023-07-14T13:29:44.153084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:39:28.264692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146524+0000","last_change":"2023-07-14T13:29:46.158284+0000","last_active":"2023-07-14T13:29:47.146524+0000","last_peered":"2023-07-14T13:29:47.146524+0000","last_clean":"2023-07-14T13:29:47.146524+0000","last_became_active":"2023-07-14T13:29:46.157955+0000","last_became_peered":"2023-07-14T13:29:46.157955+0000","last_unstale":"2023-07-14T13:29:47.146524+0000","last_undegraded":"2023-07-14T13:29:47.146524+0000","last_fullsized":"2023-07-14T13:29:47.146524+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:42:58.793494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141644+0000","last_change":"2023-07-14T13:29:45.167565+0000","last_active":"2023-07-14T13:29:47.141644+0000","last_peered":"2023-07-14T13:29:47.141644+0000","last_clean":"2023-07-14T13:29:47.141644+0000","last_became_active":"2023-07-14T13:29:45.167122+0000","last_became_peered":"2023-07-14T13:29:45.167122+0000","last_unstale":"2023-07-14T13:29:47.141644+0000","last_undegraded":"2023-07-14T13:29:47.141644+0000","last_fullsized":"2023-07-14T13:29:47.141644+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:17:20.283333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":300,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479725+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:29:48.479725+0000","last_peered":"2023-07-14T13:29:48.479725+0000","last_clean":"2023-07-14T13:29:48.479725+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:29:48.479725+0000","last_undegraded":"2023-07-14T13:29:48.479725+0000","last_fullsized":"2023-07-14T13:29:48.479725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:04:01.119223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479382+0000","last_change":"2023-07-14T13:29:46.159750+0000","last_active":"2023-07-14T13:29:48.479382+0000","last_peered":"2023-07-14T13:29:48.479382+0000","last_clean":"2023-07-14T13:29:48.479382+0000","last_became_active":"2023-07-14T13:29:46.159434+0000","last_became_peered":"2023-07-14T13:29:46.159434+0000","last_unstale":"2023-07-14T13:29:48.479382+0000","last_undegraded":"2023-07-14T13:29:48.479382+0000","last_fullsized":"2023-07-14T13:29:48.479382+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:25:26.203512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150838+0000","last_change":"2023-07-14T13:29:44.150838+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150838+0000","last_undegraded":"2023-07-14T13:29:44.150838+0000","last_fullsized":"2023-07-14T13:29:44.150838+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":284,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-14T13:29:44.154855+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:29:44.154855+0000","last_peered":"2023-07-14T13:29:44.154855+0000","last_clean":"2023-07-14T13:29:44.154855+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:29:44.154855+0000","last_undegraded":"2023-07-14T13:29:44.154855+0000","last_fullsized":"2023-07-14T13:29:44.154855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:47:20.376659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141463+0000","last_change":"2023-07-14T13:29:46.150567+0000","last_active":"2023-07-14T13:29:47.141463+0000","last_peered":"2023-07-14T13:29:47.141463+0000","last_clean":"2023-07-14T13:29:47.141463+0000","last_became_active":"2023-07-14T13:29:46.150251+0000","last_became_peered":"2023-07-14T13:29:46.150251+0000","last_unstale":"2023-07-14T13:29:47.141463+0000","last_undegraded":"2023-07-14T13:29:47.141463+0000","last_fullsized":"2023-07-14T13:29:47.141463+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:35:51.313440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150512+0000","last_change":"2023-07-14T13:29:44.150512+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150512+0000","last_undegraded":"2023-07-14T13:29:44.150512+0000","last_fullsized":"2023-07-14T13:29:44.150512+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":300,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479710+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:29:48.479710+0000","last_peered":"2023-07-14T13:29:48.479710+0000","last_clean":"2023-07-14T13:29:48.479710+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:29:48.479710+0000","last_undegraded":"2023-07-14T13:29:48.479710+0000","last_fullsized":"2023-07-14T13:29:48.479710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:05:23.988230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479427+0000","last_change":"2023-07-14T13:29:46.152496+0000","last_active":"2023-07-14T13:29:48.479427+0000","last_peered":"2023-07-14T13:29:48.479427+0000","last_clean":"2023-07-14T13:29:48.479427+0000","last_became_active":"2023-07-14T13:29:46.152230+0000","last_became_peered":"2023-07-14T13:29:46.152230+0000","last_unstale":"2023-07-14T13:29:48.479427+0000","last_undegraded":"2023-07-14T13:29:48.479427+0000","last_fullsized":"2023-07-14T13:29:48.479427+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:26:38.395035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.151752+0000","last_change":"2023-07-14T13:29:44.151752+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.151752+0000","last_undegraded":"2023-07-14T13:29:44.151752+0000","last_fullsized":"2023-07-14T13:29:44.151752+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":286,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-14T13:29:44.151631+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:29:44.151631+0000","last_peered":"2023-07-14T13:29:44.151631+0000","last_clean":"2023-07-14T13:29:44.151631+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:29:44.151631+0000","last_undegraded":"2023-07-14T13:29:44.151631+0000","last_fullsized":"2023-07-14T13:29:44.151631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:05:53.665139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":84,"acting":84,"num_store_stats":5},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23,"ondisk_log_size":23,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575289,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59928,"kb_used_data":2640,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94311912,"statfs":{"total":96636764160,"available":96575397888,"internally_reserved":0,"allocated":2703360,"data_stored":1670881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.57099999999999995,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96899999999999997,"5min":1.054,"15min":1.054},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.752,"15min":0.746},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.443},"max":{"1min":1.016,"5min":1.016,"15min":1.032},"last":0.42899999999999999}]},{"osd":1,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.752,"15min":0.755},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.90400000000000003,"5min":1.339,"15min":1.339},"last":1.1659999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.76600000000000001,"15min":0.76100000000000001},"min":{"1min":0.53300000000000003,"5min":0.501,"15min":0.496},"max":{"1min":0.98399999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.60399999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.72899999999999998,"15min":0.74099999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88400000000000001,"5min":1.032,"15min":1.1379999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.879,"5min":1.429,"15min":1.429},"last":0.91400000000000003}]},{"osd":3,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.746,"15min":0.75600000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.499},"max":{"1min":0.95599999999999996,"5min":1.361,"15min":1.361},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.44700000000000001},"max":{"1min":0.94299999999999995,"5min":1.395,"15min":1.395},"last":1.097}]},{"osd":4,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.60599999999999998,"15min":0.58299999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.35799999999999998},"max":{"1min":0.89700000000000002,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.879},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61399999999999999,"15min":0.62},"min":{"1min":0.44700000000000001,"5min":0.439,"15min":0.40400000000000003},"max":{"1min":0.93700000000000006,"5min":0.95799999999999996,"15min":0.99399999999999999},"last":0.80400000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60399999999999998,"15min":0.61099999999999999},"min":{"1min":0.48599999999999999,"5min":0.42399999999999999,"15min":0.40200000000000002},"max":{"1min":0.90300000000000002,"5min":1,"15min":1},"last":1.056},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47999999999999998,"5min":0.45300000000000001,"15min":0.41699999999999998},"max":{"1min":0.873,"5min":0.93600000000000005,"15min":1.0620000000000001},"last":0.96099999999999997}]},{"osd":6,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.56899999999999995,"5min":0.52600000000000002,"15min":0.47099999999999997},"max":{"1min":0.93799999999999994,"5min":1.0940000000000001,"15min":1.115},"last":1.032},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67800000000000005,"15min":0.68100000000000005},"min":{"1min":0.503,"5min":0.495,"15min":0.41999999999999998},"max":{"1min":0.879,"5min":0.95299999999999996,"15min":1.147},"last":0.84699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575290,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33108,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338732,"statfs":{"total":96636764160,"available":96602861568,"internally_reserved":0,"allocated":2109440,"data_stored":1080513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.998,"5min":1.026,"15min":1.026},"last":0.629},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.499,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89400000000000002,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.76300000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73999999999999999,"15min":0.76400000000000001},"min":{"1min":0.54000000000000004,"5min":0.51600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91500000000000004,"5min":1.0049999999999999,"15min":1.3300000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73799999999999999,"15min":0.747},"min":{"1min":0.58299999999999996,"5min":0.51700000000000002,"15min":0.47499999999999998},"max":{"1min":0.93999999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.69199999999999995}]},{"osd":2,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77500000000000002,"15min":0.79200000000000004},"min":{"1min":0.59799999999999998,"5min":0.53300000000000003,"15min":0.52000000000000002},"max":{"1min":0.92500000000000004,"5min":1.04,"15min":1.0660000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75700000000000001,"15min":0.76700000000000002},"min":{"1min":0.53500000000000003,"5min":0.52600000000000002,"15min":0.51300000000000001},"max":{"1min":0.94799999999999995,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.66900000000000004}]},{"osd":3,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77700000000000002,"15min":0.78100000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.95799999999999996,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.70699999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.2569999999999999},"last":0.71399999999999997}]},{"osd":4,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.41499999999999998,"5min":0.36299999999999999,"15min":0.36099999999999999},"max":{"1min":0.82199999999999995,"5min":0.92600000000000005,"15min":1.175},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60899999999999999,"15min":0.61199999999999999},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.36799999999999999},"max":{"1min":0.80800000000000005,"5min":0.94599999999999995,"15min":1.0580000000000001},"last":0.46100000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.42699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84999999999999998,"5min":0.873,"15min":1.0860000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.68000000000000005,"15min":0.67400000000000004},"min":{"1min":0.51000000000000001,"5min":0.45900000000000002,"15min":0.41699999999999998},"max":{"1min":0.92100000000000004,"5min":0.93200000000000005,"15min":1.3180000000000001},"last":0.59399999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.46500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88800000000000001,"5min":0.99199999999999999,"15min":1.042},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.53700000000000003,"5min":0.50900000000000001,"15min":0.46200000000000002},"max":{"1min":0.89900000000000002,"5min":0.92300000000000004,"15min":1.0369999999999999},"last":0.49299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575289,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51156,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320684,"statfs":{"total":96636764160,"available":96584380416,"internally_reserved":0,"allocated":2109440,"data_stored":1080513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.76000000000000001,"15min":0.745},"min":{"1min":0.59499999999999997,"5min":0.41799999999999998,"15min":0.40500000000000003},"max":{"1min":0.94099999999999995,"5min":1.8,"15min":1.8},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77400000000000002,"15min":0.76100000000000001},"min":{"1min":0.58599999999999997,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":0.91500000000000004,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.71999999999999997}]},{"osd":1,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77000000000000002,"15min":0.746},"min":{"1min":0.58699999999999997,"5min":0.50600000000000001,"15min":0.378},"max":{"1min":0.89600000000000002,"5min":1.835,"15min":1.835},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.77500000000000002,"15min":0.77200000000000002},"min":{"1min":0.56200000000000006,"5min":0.503,"15min":0.499},"max":{"1min":0.99299999999999999,"5min":1.0429999999999999,"15min":1.05},"last":1.0629999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.91800000000000004,"15min":0.80300000000000005},"min":{"1min":0.67100000000000004,"5min":0.434,"15min":0.434},"max":{"1min":0.95199999999999996,"5min":16.774000000000001,"15min":16.774000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.90800000000000003,"15min":0.80600000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.496},"max":{"1min":0.88,"5min":16.751999999999999,"15min":16.751999999999999},"last":0.67100000000000004}]},{"osd":3,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.77700000000000002,"15min":0.77100000000000002},"min":{"1min":0.65400000000000003,"5min":0.52700000000000002,"15min":0.51100000000000001},"max":{"1min":0.95899999999999996,"5min":0.999,"15min":1.115},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.93600000000000005,"15min":0.82999999999999996},"min":{"1min":0.60699999999999998,"5min":0.54100000000000004,"15min":0.50600000000000001},"max":{"1min":0.93999999999999995,"5min":16.731000000000002,"15min":16.731000000000002},"last":0.96799999999999997}]},{"osd":4,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.624,"15min":0.63100000000000001},"min":{"1min":0.442,"5min":0.39500000000000002,"15min":0.38},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":1.0089999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.70999999999999996},"min":{"1min":0.45200000000000001,"5min":0.375,"15min":0.36699999999999999},"max":{"1min":1.02,"5min":1.159,"15min":1.159},"last":1.248}]},{"osd":6,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.61899999999999999},"min":{"1min":0.49099999999999999,"5min":0.41799999999999998,"15min":0.34999999999999998},"max":{"1min":0.88800000000000001,"5min":0.94699999999999995,"15min":1.3100000000000001},"last":1.157},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64700000000000002,"15min":0.64400000000000002},"min":{"1min":0.501,"5min":0.45400000000000001,"15min":0.40999999999999998},"max":{"1min":0.80400000000000005,"5min":0.91800000000000004,"15min":0.97299999999999998},"last":0.99199999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65400000000000003,"15min":0.64900000000000002},"min":{"1min":0.51100000000000001,"5min":0.432,"15min":0.42399999999999999},"max":{"1min":0.93000000000000005,"5min":1.123,"15min":1.123},"last":1.1759999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.69499999999999995,"15min":0.68899999999999995},"min":{"1min":0.55700000000000005,"5min":0.49299999999999999,"15min":0.40000000000000002},"max":{"1min":0.96899999999999997,"5min":1.012,"15min":1.012},"last":1.091}]}]},{"osd":4,"up_from":13,"seq":55834575290,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37252,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334588,"statfs":{"total":96636764160,"available":96598618112,"internally_reserved":0,"allocated":2158592,"data_stored":1102570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.76400000000000001,"15min":0.76700000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.38100000000000001},"max":{"1min":0.96899999999999997,"5min":1.0069999999999999,"15min":1.0249999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77100000000000002,"15min":0.76300000000000001},"min":{"1min":0.60799999999999998,"5min":0.45800000000000002,"15min":0.442},"max":{"1min":0.94499999999999995,"5min":1.278,"15min":1.278},"last":0.50800000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.76300000000000001,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0349999999999999,"5min":1.306,"15min":1.306},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.53800000000000003,"5min":0.51000000000000001,"15min":0.47599999999999998},"max":{"1min":1.024,"5min":1.177,"15min":1.177},"last":0.748}]},{"osd":2,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78000000000000003,"15min":0.77300000000000002},"min":{"1min":0.56899999999999995,"5min":0.54000000000000004,"15min":0.49299999999999999},"max":{"1min":0.90400000000000003,"5min":1.137,"15min":1.137},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77300000000000002,"15min":0.77900000000000003},"min":{"1min":0.53700000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1,"5min":1,"15min":1.0149999999999999},"last":0.82299999999999995}]},{"osd":3,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.50800000000000001},"max":{"1min":0.93200000000000005,"5min":1.222,"15min":1.222},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78400000000000003,"15min":0.77900000000000003},"min":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.496},"max":{"1min":1.018,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60599999999999998,"15min":0.60699999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.40000000000000002},"max":{"1min":0.94099999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61799999999999999,"15min":0.60799999999999998},"min":{"1min":0.45000000000000001,"5min":0.42399999999999999,"15min":0.378},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96799999999999997},"last":0.61799999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.624,"15min":0.61599999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.42699999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.88600000000000001}]},{"osd":7,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67300000000000004,"15min":0.67100000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.435},"max":{"1min":0.91800000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70099999999999996,"15min":0.69799999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.83999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575290,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41344,"kb_used_data":2104,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330496,"statfs":{"total":96636764160,"available":96594427904,"internally_reserved":0,"allocated":2154496,"data_stored":1101622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47399999999999998,"15min":0.46000000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.28799999999999998},"max":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.92900000000000005},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.621,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.51900000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.48899999999999999,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.33900000000000002,"15min":0.32300000000000001},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.495},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55800000000000005,"15min":0.56100000000000005},"min":{"1min":0.39700000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.82199999999999995,"5min":0.82399999999999995,"15min":0.95799999999999996},"last":0.70099999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57799999999999996,"15min":0.58299999999999996},"min":{"1min":0.41499999999999998,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.623,"15min":0.61499999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82399999999999995,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.74299999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.77000000000000002,"15min":0.78500000000000003},"min":{"1min":0.45200000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.048,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.79500000000000004,"15min":0.80600000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98999999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.84599999999999997}]},{"osd":5,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81000000000000005,"15min":0.82899999999999996},"min":{"1min":0.56499999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.069,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80800000000000005,"15min":0.81299999999999994},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1220000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":1.0089999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.81399999999999995,"15min":0.80800000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1910000000000001,"5min":1.383,"15min":1.383},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.82299999999999995,"15min":0.83999999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1439999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.76200000000000001}]},{"osd":7,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.86399999999999999,"15min":0.85999999999999999},"min":{"1min":0.58899999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.171,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.56599999999999995,"5min":0.56000000000000005,"15min":0.54800000000000004},"max":{"1min":1.1579999999999999,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.91200000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575290,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59388,"kb_used_data":2100,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312452,"statfs":{"total":96636764160,"available":96575950848,"internally_reserved":0,"allocated":2150400,"data_stored":1100099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46899999999999997,"15min":0.46500000000000002},"min":{"1min":0.32200000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.68400000000000005,"5min":0.70799999999999996,"15min":0.80500000000000005},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.53100000000000003},"min":{"1min":0.38300000000000001,"5min":0.318,"15min":0.30599999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.34899999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47099999999999997,"15min":0.46800000000000003},"min":{"1min":0.34100000000000003,"5min":0.32900000000000001,"15min":0.32600000000000001},"max":{"1min":0.58599999999999997,"5min":0.80600000000000005,"15min":0.84799999999999998},"last":0.307},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.56100000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38200000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.93799999999999994},"last":0.41699999999999998}]},{"osd":3,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.39700000000000002,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.74399999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.433},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56699999999999995,"15min":0.55800000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35699999999999998},"max":{"1min":0.73599999999999999,"5min":0.77300000000000002,"15min":0.84599999999999997},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.80100000000000005},"min":{"1min":0.58099999999999996,"5min":0.49399999999999999,"15min":0.48799999999999999},"max":{"1min":1.004,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.84099999999999997,"15min":0.81999999999999995},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.48899999999999999},"max":{"1min":1.0169999999999999,"5min":1.179,"15min":1.3029999999999999},"last":0.627}]},{"osd":5,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.86899999999999999,"15min":0.86399999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.02,"5min":1.2430000000000001,"15min":1.302},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.85999999999999999,"15min":0.85099999999999998},"min":{"1min":0.65700000000000003,"5min":0.60699999999999998,"15min":0.54000000000000004},"max":{"1min":1.1120000000000001,"5min":1.2410000000000001,"15min":1.248},"last":0.67400000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85999999999999999,"15min":0.82899999999999996},"min":{"1min":0.59799999999999998,"5min":0.56699999999999995,"15min":0.54800000000000004},"max":{"1min":1.042,"5min":1.2749999999999999,"15min":1.446},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.83599999999999997,"15min":0.82399999999999995},"min":{"1min":0.64500000000000002,"5min":0.55100000000000005,"15min":0.51700000000000002},"max":{"1min":1.119,"5min":1.1830000000000001,"15min":1.266},"last":0.65200000000000002}]},{"osd":7,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.873,"15min":0.84499999999999997},"min":{"1min":0.64800000000000002,"5min":0.56799999999999995,"15min":0.55900000000000005},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.871,"15min":0.84999999999999998},"min":{"1min":0.69099999999999995,"5min":0.61599999999999999,"15min":0.56000000000000005},"max":{"1min":1.2709999999999999,"5min":1.351,"15min":1.371},"last":0.61199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575291,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41340,"kb_used_data":2100,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330500,"statfs":{"total":96636764160,"available":96594432000,"internally_reserved":0,"allocated":2150400,"data_stored":1101076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46000000000000002,"15min":0.45500000000000002},"min":{"1min":0.33100000000000002,"5min":0.316,"15min":0.28100000000000003},"max":{"1min":0.70899999999999996,"5min":0.753,"15min":0.81599999999999995},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.52500000000000002},"min":{"1min":0.41799999999999998,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":0.68500000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.45000000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.46899999999999997,"15min":0.47199999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.30499999999999999},"max":{"1min":0.59999999999999998,"5min":0.63600000000000001,"15min":0.70799999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.39700000000000002,"5min":0.378,"15min":0.32800000000000001},"max":{"1min":0.747,"5min":0.79900000000000004,"15min":0.89200000000000002},"last":0.51100000000000001}]},{"osd":3,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66500000000000004,"15min":0.65900000000000003},"min":{"1min":0.51100000000000001,"5min":0.47099999999999997,"15min":0.42299999999999999},"max":{"1min":0.90200000000000002,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.36399999999999999,"5min":0.34300000000000003,"15min":0.32300000000000001},"max":{"1min":0.86899999999999999,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.53300000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.79500000000000004,"15min":0.80800000000000005},"min":{"1min":0.61599999999999999,"5min":0.56699999999999995,"15min":0.52200000000000002},"max":{"1min":1.091,"5min":1.155,"15min":1.2470000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.81899999999999995,"15min":0.82799999999999996},"min":{"1min":0.63600000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.0309999999999999,"5min":1.151,"15min":1.171},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.64000000000000001,"5min":0.56299999999999994,"15min":0.54500000000000004},"max":{"1min":1.0469999999999999,"5min":1.224,"15min":1.224},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.81399999999999995,"15min":0.83099999999999996},"min":{"1min":0.66100000000000003,"5min":0.57299999999999995,"15min":0.56100000000000005},"max":{"1min":1.1240000000000001,"5min":1.1259999999999999,"15min":1.375},"last":0.84399999999999997}]},{"osd":6,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.66900000000000004,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.036,"5min":1.1759999999999999,"15min":1.2},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.84299999999999997,"15min":0.85399999999999998},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.56399999999999995},"max":{"1min":1.0589999999999999,"5min":1.169,"15min":1.329},"last":0.745}]},{"osd":7,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.79500000000000004,"15min":0.81899999999999995},"min":{"1min":0.59699999999999998,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.0609999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.86899999999999999,"15min":0.875},"min":{"1min":0.71799999999999997,"5min":0.59999999999999998,"15min":0.58899999999999997},"max":{"1min":1.0389999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.89800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575292,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41936,"kb_used_data":2696,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329904,"statfs":{"total":96636764160,"available":96593821696,"internally_reserved":0,"allocated":2760704,"data_stored":1692625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.33500000000000002,"5min":0.30499999999999999,"15min":0.29899999999999999},"max":{"1min":0.69399999999999995,"5min":0.77100000000000002,"15min":0.85299999999999998},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39900000000000002,"5min":0.36799999999999999,"15min":0.308},"max":{"1min":0.73099999999999998,"5min":0.76800000000000002,"15min":0.80700000000000005},"last":0.39700000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53200000000000003,"15min":0.53600000000000003},"min":{"1min":0.42599999999999999,"5min":0.35699999999999998,"15min":0.33700000000000002},"max":{"1min":0.63500000000000001,"5min":0.72499999999999998,"15min":1.002},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77700000000000002,"5min":0.84099999999999997,"15min":0.91200000000000003},"last":0.37}]},{"osd":3,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52900000000000003,"15min":0.53200000000000003},"min":{"1min":0.38400000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75700000000000001,"5min":0.77000000000000002,"15min":0.83299999999999996},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.47499999999999998,"5min":0.44400000000000001,"15min":0.38800000000000001},"max":{"1min":0.75900000000000001,"5min":0.77200000000000002,"15min":0.871},"last":0.40999999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.83599999999999997,"15min":0.83099999999999996},"min":{"1min":0.60699999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.157,"5min":1.274,"15min":1.284},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.85299999999999998,"15min":0.83699999999999997},"min":{"1min":0.63,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.034,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.82599999999999996,"15min":0.83999999999999997},"min":{"1min":0.59799999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0800000000000001,"5min":1.28,"15min":1.294},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.86699999999999999,"15min":0.85799999999999998},"min":{"1min":0.66200000000000003,"5min":0.58399999999999996,"15min":0.52400000000000002},"max":{"1min":1.0189999999999999,"5min":1.472,"15min":1.472},"last":0.61299999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.84099999999999997,"15min":0.84299999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.96999999999999997,"5min":1.639,"15min":1.639},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.88100000000000001,"15min":0.86399999999999999},"min":{"1min":0.65900000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.044,"5min":1.544,"15min":1.544},"last":0.53300000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.85299999999999998,"15min":0.86199999999999999},"min":{"1min":0.67300000000000004,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1259999999999999,"5min":1.236,"15min":1.3280000000000001},"last":0.63},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.877,"15min":0.86299999999999999},"min":{"1min":0.63100000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.103,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.65300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:29:50.679 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:29:50.805 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:29:50.810 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:29:50.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.859+0000 7f41638d8640 1 Processor -- start 2023-07-14T13:29:50.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.859+0000 7f41638d8640 1 -- start start 2023-07-14T13:29:50.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.859+0000 7f41638d8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f415c06b1e0 0x7f415c0c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:50.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.859+0000 7f41638d8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f415c0cac70 con 0x7f415c0c21f0 2023-07-14T13:29:50.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.859+0000 7f41638d8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f415c0ca060 con 0x7f415c070b70 2023-07-14T13:29:50.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.859+0000 7f41638d8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f415c0ca340 con 0x7f415c06b1e0 2023-07-14T13:29:50.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.859+0000 7f4161e75640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f415c0c21f0 0x7f415c0cb100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46010/0 (socket says 172.21.15.5:46010) 2023-07-14T13:29:50.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.859+0000 7f4161e75640 1 -- 172.21.15.5:0/2041525100 learned_addr learned my addr 172.21.15.5:0/2041525100 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:50.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.859+0000 7f4160e73640 1 --2- 172.21.15.5:0/2041525100 >> v2:172.21.15.154:3300/0 conn(0x7f415c06b1e0 0x7f415c0c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:50.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.859+0000 7f4153fff640 1 -- 172.21.15.5:0/2041525100 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3156239919 0 0) 0x7f415c0cac70 con 0x7f415c0c21f0 2023-07-14T13:29:50.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.859+0000 7f4153fff640 1 -- 172.21.15.5:0/2041525100 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4148003530 con 0x7f415c0c21f0 2023-07-14T13:29:50.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.859+0000 7f4153fff640 1 -- 172.21.15.5:0/2041525100 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3859691802 0 0) 0x7f4148003530 con 0x7f415c0c21f0 2023-07-14T13:29:50.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.859+0000 7f4153fff640 1 -- 172.21.15.5:0/2041525100 >> v2:172.21.15.154:3300/0 conn(0x7f415c06b1e0 msgr2=0x7f415c0c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:50.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.859+0000 7f4153fff640 1 --2- 172.21.15.5:0/2041525100 >> v2:172.21.15.154:3300/0 conn(0x7f415c06b1e0 0x7f415c0c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:50.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.859+0000 7f4153fff640 1 -- 172.21.15.5:0/2041525100 >> v1:172.21.15.154:6789/0 conn(0x7f415c070b70 legacy=0x7f415c070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:50.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.859+0000 7f4153fff640 1 -- 172.21.15.5:0/2041525100 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415c0ca620 con 0x7f415c0c21f0 2023-07-14T13:29:50.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.859+0000 7f4153fff640 1 -- 172.21.15.5:0/2041525100 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f4154001a00 con 0x7f415c0c21f0 2023-07-14T13:29:50.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.859+0000 7f4153fff640 1 -- 172.21.15.5:0/2041525100 >> v1:172.21.15.5:6789/0 conn(0x7f415c0c21f0 legacy=0x7f415c0cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:50.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.859+0000 7f4153fff640 1 --2- 172.21.15.5:0/2041525100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4148003980 0x7f4148003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:50.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.859+0000 7f4153fff640 1 --2- 172.21.15.5:0/2041525100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4148004370 0x7f4148004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:50.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.859+0000 7f4153fff640 1 --2- 172.21.15.5:0/2041525100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4148005030 0x7f414800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:50.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.859+0000 7f4153fff640 1 -- 172.21.15.5:0/2041525100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415c0ca340 con 0x7f4148005030 2023-07-14T13:29:50.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.859+0000 7f4153fff640 1 -- 172.21.15.5:0/2041525100 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414800bf80 con 0x7f4148004370 2023-07-14T13:29:50.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.859+0000 7f4153fff640 1 -- 172.21.15.5:0/2041525100 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414800c140 con 0x7f4148003980 2023-07-14T13:29:50.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.863+0000 7f4161e75640 1 --2- 172.21.15.5:0/2041525100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4148005030 0x7f414800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:50.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.863+0000 7f4161674640 1 --2- 172.21.15.5:0/2041525100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4148003980 0x7f4148003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:50.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.863+0000 7f4160e73640 1 --2- 172.21.15.5:0/2041525100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4148004370 0x7f4148004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:50.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.863+0000 7f4161e75640 1 -- 172.21.15.5:0/2041525100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4148003980 msgr2=0x7f4148003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:50.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.863+0000 7f4161e75640 1 --2- 172.21.15.5:0/2041525100 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4148003980 0x7f4148003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:50.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.863+0000 7f4161e75640 1 -- 172.21.15.5:0/2041525100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4148004370 msgr2=0x7f4148004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:50.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.863+0000 7f4161e75640 1 --2- 172.21.15.5:0/2041525100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4148004370 0x7f4148004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:50.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.863+0000 7f4161e75640 1 -- 172.21.15.5:0/2041525100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4148003530 con 0x7f4148005030 2023-07-14T13:29:50.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.863+0000 7f4160e73640 1 --2- 172.21.15.5:0/2041525100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4148004370 0x7f4148004830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:29:50.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.867+0000 7f4161e75640 1 -- 172.21.15.5:0/2041525100 reap_dead start 2023-07-14T13:29:50.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.867+0000 7f4161e75640 1 --2- 172.21.15.5:0/2041525100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4148005030 0x7f414800b990 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f415400a7a0 tx=0x7f415401f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=413246ad92b48020 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:50.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.867+0000 7f4153fff640 1 -- 172.21.15.5:0/2041525100 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41540af070 con 0x7f4148005030 2023-07-14T13:29:50.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.867+0000 7f4153fff640 1 -- 172.21.15.5:0/2041525100 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41540aa410 con 0x7f4148005030 2023-07-14T13:29:50.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.867+0000 7f4153fff640 1 -- 172.21.15.5:0/2041525100 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41540aa7a0 con 0x7f4148005030 2023-07-14T13:29:50.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.867+0000 7f41638d8640 1 -- 172.21.15.5:0/2041525100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4148005030 msgr2=0x7f414800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:50.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.867+0000 7f41638d8640 1 --2- 172.21.15.5:0/2041525100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4148005030 0x7f414800b990 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f415400a7a0 tx=0x7f415401f9e0 comp rx=0 tx=0).stop 2023-07-14T13:29:50.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.867+0000 7f41638d8640 1 -- 172.21.15.5:0/2041525100 shutdown_connections 2023-07-14T13:29:50.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.867+0000 7f41638d8640 1 --2- 172.21.15.5:0/2041525100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4148005030 0x7f414800b990 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:50.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.867+0000 7f41638d8640 1 -- 172.21.15.5:0/2041525100 >> 172.21.15.5:0/2041525100 conn(0x7f415c0afcf0 msgr2=0x7f415c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:50.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.867+0000 7f41638d8640 1 -- 172.21.15.5:0/2041525100 shutdown_connections 2023-07-14T13:29:50.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.867+0000 7f41638d8640 1 -- 172.21.15.5:0/2041525100 wait complete. 2023-07-14T13:29:50.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.867+0000 7f41638d8640 1 Processor -- start 2023-07-14T13:29:50.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.867+0000 7f41638d8640 1 -- start start 2023-07-14T13:29:50.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.871+0000 7f41638d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4148005030 0x7f415c156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:50.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.871+0000 7f41638d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f415c1537b0 0x7f415c156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:50.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.871+0000 7f41638d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f415c1f4790 0x7f415c1f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:50.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.871+0000 7f41638d8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415c0c5e50 con 0x7f415c1537b0 2023-07-14T13:29:50.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.871+0000 7f41638d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415c0c52d0 con 0x7f4148005030 2023-07-14T13:29:50.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.871+0000 7f41638d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415c0c55b0 con 0x7f415c1f4790 2023-07-14T13:29:50.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.871+0000 7f4160e73640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f415c1537b0 0x7f415c156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:50.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.871+0000 7f4160e73640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f415c1537b0 0x7f415c156150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52566/0 (socket says 172.21.15.5:52566) 2023-07-14T13:29:50.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.871+0000 7f4160e73640 1 -- 172.21.15.5:0/3204964938 learned_addr learned my addr 172.21.15.5:0/3204964938 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:50.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.871+0000 7f4161e75640 1 --2- 172.21.15.5:0/3204964938 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f415c1f4790 0x7f415c1f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:50.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.871+0000 7f4161674640 1 --2- 172.21.15.5:0/3204964938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4148005030 0x7f415c156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:50.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.871+0000 7f4160e73640 1 -- 172.21.15.5:0/3204964938 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f415c1f4790 msgr2=0x7f415c1f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:50.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.871+0000 7f4160e73640 1 --2- 172.21.15.5:0/3204964938 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f415c1f4790 0x7f415c1f4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:50.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.871+0000 7f4160e73640 1 -- 172.21.15.5:0/3204964938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4148005030 msgr2=0x7f415c156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:50.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.871+0000 7f4160e73640 1 --2- 172.21.15.5:0/3204964938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4148005030 0x7f415c156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:50.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.871+0000 7f4160e73640 1 -- 172.21.15.5:0/3204964938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415c0c5890 con 0x7f415c1537b0 2023-07-14T13:29:50.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.871+0000 7f4160e73640 1 --2- 172.21.15.5:0/3204964938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f415c1537b0 0x7f415c156150 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f414c011560 tx=0x7f414c011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:50.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.871+0000 7f4151ffb640 1 -- 172.21.15.5:0/3204964938 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414c004220 con 0x7f415c1537b0 2023-07-14T13:29:50.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.871+0000 7f4151ffb640 1 -- 172.21.15.5:0/3204964938 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414c004380 con 0x7f415c1537b0 2023-07-14T13:29:50.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.871+0000 7f4151ffb640 1 -- 172.21.15.5:0/3204964938 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414c015870 con 0x7f415c1537b0 2023-07-14T13:29:50.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.871+0000 7f41638d8640 1 -- 172.21.15.5:0/3204964938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f415c0c5b70 con 0x7f415c1537b0 2023-07-14T13:29:50.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.871+0000 7f41638d8640 1 -- 172.21.15.5:0/3204964938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f415c1572c0 con 0x7f415c1537b0 2023-07-14T13:29:50.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.871+0000 7f41638d8640 1 -- 172.21.15.5:0/3204964938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f415c0ca8e0 con 0x7f415c1537b0 2023-07-14T13:29:50.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.871+0000 7f4151ffb640 1 -- 172.21.15.5:0/3204964938 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f414c0159d0 con 0x7f415c1537b0 2023-07-14T13:29:50.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.875+0000 7f4151ffb640 1 --2- 172.21.15.5:0/3204964938 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f41400663d0 0x7f4140068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.875+0000 7f4151ffb640 1 -- 172.21.15.5:0/3204964938 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f414c0842e0 con 0x7f415c1537b0 2023-07-14T13:29:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.875+0000 7f4161674640 1 --2- 172.21.15.5:0/3204964938 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f41400663d0 0x7f4140068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.875+0000 7f4161674640 1 --2- 172.21.15.5:0/3204964938 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f41400663d0 0x7f4140068880 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4158007fd0 tx=0x7f4158009040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:50.879+0000 7f4151ffb640 1 -- 172.21.15.5:0/3204964938 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f415c0ca8e0 con 0x7f415c1537b0 2023-07-14T13:29:51.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.031+0000 7f41638d8640 1 -- 172.21.15.5:0/3204964938 --> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f415c06f5b0 con 0x7f41400663d0 2023-07-14T13:29:51.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.043+0000 7f4151ffb640 1 -- 172.21.15.5:0/3204964938 <== mgr.9247 v2:172.21.15.154:6832/1905284593 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+307174 (secure 0 0 0) 0x7f41580015f0 con 0x7f41400663d0 2023-07-14T13:29:51.046 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:29:51.047 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:29:51.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.043+0000 7f41638d8640 1 -- 172.21.15.5:0/3204964938 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f41400663d0 msgr2=0x7f4140068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:51.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.043+0000 7f41638d8640 1 --2- 172.21.15.5:0/3204964938 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f41400663d0 0x7f4140068880 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4158007fd0 tx=0x7f4158009040 comp rx=0 tx=0).stop 2023-07-14T13:29:51.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.043+0000 7f41638d8640 1 -- 172.21.15.5:0/3204964938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f415c1537b0 msgr2=0x7f415c156150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:51.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.043+0000 7f41638d8640 1 --2- 172.21.15.5:0/3204964938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f415c1537b0 0x7f415c156150 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f414c011560 tx=0x7f414c011a20 comp rx=0 tx=0).stop 2023-07-14T13:29:51.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.043+0000 7f41638d8640 1 -- 172.21.15.5:0/3204964938 shutdown_connections 2023-07-14T13:29:51.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.043+0000 7f41638d8640 1 --2- 172.21.15.5:0/3204964938 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f41400663d0 0x7f4140068880 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:51.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.043+0000 7f41638d8640 1 --2- 172.21.15.5:0/3204964938 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f415c1f4790 0x7f415c1f4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:51.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.043+0000 7f41638d8640 1 --2- 172.21.15.5:0/3204964938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f415c1537b0 0x7f415c156150 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:51.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.043+0000 7f41638d8640 1 --2- 172.21.15.5:0/3204964938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4148005030 0x7f415c156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:51.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.043+0000 7f41638d8640 1 -- 172.21.15.5:0/3204964938 >> 172.21.15.5:0/3204964938 conn(0x7f415c0afcf0 msgr2=0x7f415c0cc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:51.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.043+0000 7f41638d8640 1 -- 172.21.15.5:0/3204964938 shutdown_connections 2023-07-14T13:29:51.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.043+0000 7f41638d8640 1 -- 172.21.15.5:0/3204964938 wait complete. 2023-07-14T13:29:51.067 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-14T13:29:50.058487+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":522,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":327,"ondisk_log_size":327,"up":166,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":365452,"kb_used_data":17868,"kb_used_omap":0,"kb_used_meta":347520,"kb_avail":754609268,"statfs":{"total":773094113280,"available":772719890432,"internally_reserved":0,"allocated":18296832,"data_stored":9929899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":355860480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.912780"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479686+0000","last_change":"2023-07-14T13:29:46.159865+0000","last_active":"2023-07-14T13:29:48.479686+0000","last_peered":"2023-07-14T13:29:48.479686+0000","last_clean":"2023-07-14T13:29:48.479686+0000","last_became_active":"2023-07-14T13:29:46.159410+0000","last_became_peered":"2023-07-14T13:29:46.159410+0000","last_unstale":"2023-07-14T13:29:48.479686+0000","last_undegraded":"2023-07-14T13:29:48.479686+0000","last_fullsized":"2023-07-14T13:29:48.479686+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:01.004278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479590+0000","last_change":"2023-07-14T13:29:46.162495+0000","last_active":"2023-07-14T13:29:48.479590+0000","last_peered":"2023-07-14T13:29:48.479590+0000","last_clean":"2023-07-14T13:29:48.479590+0000","last_became_active":"2023-07-14T13:29:46.162075+0000","last_became_peered":"2023-07-14T13:29:46.162075+0000","last_unstale":"2023-07-14T13:29:48.479590+0000","last_undegraded":"2023-07-14T13:29:48.479590+0000","last_fullsized":"2023-07-14T13:29:48.479590+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:33:26.310832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141616+0000","last_change":"2023-07-14T13:29:46.165214+0000","last_active":"2023-07-14T13:29:47.141616+0000","last_peered":"2023-07-14T13:29:47.141616+0000","last_clean":"2023-07-14T13:29:47.141616+0000","last_became_active":"2023-07-14T13:29:46.164908+0000","last_became_peered":"2023-07-14T13:29:46.164908+0000","last_unstale":"2023-07-14T13:29:47.141616+0000","last_undegraded":"2023-07-14T13:29:47.141616+0000","last_fullsized":"2023-07-14T13:29:47.141616+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:23:47.997179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141388+0000","last_change":"2023-07-14T13:29:46.163840+0000","last_active":"2023-07-14T13:29:47.141388+0000","last_peered":"2023-07-14T13:29:47.141388+0000","last_clean":"2023-07-14T13:29:47.141388+0000","last_became_active":"2023-07-14T13:29:46.163561+0000","last_became_peered":"2023-07-14T13:29:46.163561+0000","last_unstale":"2023-07-14T13:29:47.141388+0000","last_undegraded":"2023-07-14T13:29:47.141388+0000","last_fullsized":"2023-07-14T13:29:47.141388+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:31:33.867324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146119+0000","last_change":"2023-07-14T13:29:46.157415+0000","last_active":"2023-07-14T13:29:47.146119+0000","last_peered":"2023-07-14T13:29:47.146119+0000","last_clean":"2023-07-14T13:29:47.146119+0000","last_became_active":"2023-07-14T13:29:46.156908+0000","last_became_peered":"2023-07-14T13:29:46.156908+0000","last_unstale":"2023-07-14T13:29:47.146119+0000","last_undegraded":"2023-07-14T13:29:47.146119+0000","last_fullsized":"2023-07-14T13:29:47.146119+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:24:50.135616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141617+0000","last_change":"2023-07-14T13:29:46.152971+0000","last_active":"2023-07-14T13:29:47.141617+0000","last_peered":"2023-07-14T13:29:47.141617+0000","last_clean":"2023-07-14T13:29:47.141617+0000","last_became_active":"2023-07-14T13:29:46.152641+0000","last_became_peered":"2023-07-14T13:29:46.152641+0000","last_unstale":"2023-07-14T13:29:47.141617+0000","last_undegraded":"2023-07-14T13:29:47.141617+0000","last_fullsized":"2023-07-14T13:29:47.141617+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:06:17.863530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141851+0000","last_change":"2023-07-14T13:29:46.151471+0000","last_active":"2023-07-14T13:29:47.141851+0000","last_peered":"2023-07-14T13:29:47.141851+0000","last_clean":"2023-07-14T13:29:47.141851+0000","last_became_active":"2023-07-14T13:29:46.150996+0000","last_became_peered":"2023-07-14T13:29:46.150996+0000","last_unstale":"2023-07-14T13:29:47.141851+0000","last_undegraded":"2023-07-14T13:29:47.141851+0000","last_fullsized":"2023-07-14T13:29:47.141851+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:36:46.294425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797696+0000","last_change":"2023-07-14T13:29:46.161038+0000","last_active":"2023-07-14T13:29:48.797696+0000","last_peered":"2023-07-14T13:29:48.797696+0000","last_clean":"2023-07-14T13:29:48.797696+0000","last_became_active":"2023-07-14T13:29:46.160750+0000","last_became_peered":"2023-07-14T13:29:46.160750+0000","last_unstale":"2023-07-14T13:29:48.797696+0000","last_undegraded":"2023-07-14T13:29:48.797696+0000","last_fullsized":"2023-07-14T13:29:48.797696+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:42:08.863141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141480+0000","last_change":"2023-07-14T13:29:46.149699+0000","last_active":"2023-07-14T13:29:47.141480+0000","last_peered":"2023-07-14T13:29:47.141480+0000","last_clean":"2023-07-14T13:29:47.141480+0000","last_became_active":"2023-07-14T13:29:46.149429+0000","last_became_peered":"2023-07-14T13:29:46.149429+0000","last_unstale":"2023-07-14T13:29:47.141480+0000","last_undegraded":"2023-07-14T13:29:47.141480+0000","last_fullsized":"2023-07-14T13:29:47.141480+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:55:39.460034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479340+0000","last_change":"2023-07-14T13:29:46.160166+0000","last_active":"2023-07-14T13:29:48.479340+0000","last_peered":"2023-07-14T13:29:48.479340+0000","last_clean":"2023-07-14T13:29:48.479340+0000","last_became_active":"2023-07-14T13:29:46.159843+0000","last_became_peered":"2023-07-14T13:29:46.159843+0000","last_unstale":"2023-07-14T13:29:48.479340+0000","last_undegraded":"2023-07-14T13:29:48.479340+0000","last_fullsized":"2023-07-14T13:29:48.479340+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:12:09.149124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141216+0000","last_change":"2023-07-14T13:29:46.155517+0000","last_active":"2023-07-14T13:29:47.141216+0000","last_peered":"2023-07-14T13:29:47.141216+0000","last_clean":"2023-07-14T13:29:47.141216+0000","last_became_active":"2023-07-14T13:29:46.155241+0000","last_became_peered":"2023-07-14T13:29:46.155241+0000","last_unstale":"2023-07-14T13:29:47.141216+0000","last_undegraded":"2023-07-14T13:29:47.141216+0000","last_fullsized":"2023-07-14T13:29:47.141216+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:23:00.388761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797786+0000","last_change":"2023-07-14T13:29:46.165903+0000","last_active":"2023-07-14T13:29:48.797786+0000","last_peered":"2023-07-14T13:29:48.797786+0000","last_clean":"2023-07-14T13:29:48.797786+0000","last_became_active":"2023-07-14T13:29:46.165382+0000","last_became_peered":"2023-07-14T13:29:46.165382+0000","last_unstale":"2023-07-14T13:29:48.797786+0000","last_undegraded":"2023-07-14T13:29:48.797786+0000","last_fullsized":"2023-07-14T13:29:48.797786+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:40:22.854519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:49.060361+0000","last_change":"2023-07-14T13:29:46.151003+0000","last_active":"2023-07-14T13:29:49.060361+0000","last_peered":"2023-07-14T13:29:49.060361+0000","last_clean":"2023-07-14T13:29:49.060361+0000","last_became_active":"2023-07-14T13:29:46.150704+0000","last_became_peered":"2023-07-14T13:29:46.150704+0000","last_unstale":"2023-07-14T13:29:49.060361+0000","last_undegraded":"2023-07-14T13:29:49.060361+0000","last_fullsized":"2023-07-14T13:29:49.060361+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:24.768994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141544+0000","last_change":"2023-07-14T13:29:46.153305+0000","last_active":"2023-07-14T13:29:47.141544+0000","last_peered":"2023-07-14T13:29:47.141544+0000","last_clean":"2023-07-14T13:29:47.141544+0000","last_became_active":"2023-07-14T13:29:46.153008+0000","last_became_peered":"2023-07-14T13:29:46.153008+0000","last_unstale":"2023-07-14T13:29:47.141544+0000","last_undegraded":"2023-07-14T13:29:47.141544+0000","last_fullsized":"2023-07-14T13:29:47.141544+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:16:23.727196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146015+0000","last_change":"2023-07-14T13:29:46.168865+0000","last_active":"2023-07-14T13:29:47.146015+0000","last_peered":"2023-07-14T13:29:47.146015+0000","last_clean":"2023-07-14T13:29:47.146015+0000","last_became_active":"2023-07-14T13:29:46.168603+0000","last_became_peered":"2023-07-14T13:29:46.168603+0000","last_unstale":"2023-07-14T13:29:47.146015+0000","last_undegraded":"2023-07-14T13:29:47.146015+0000","last_fullsized":"2023-07-14T13:29:47.146015+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:35:20.966733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797806+0000","last_change":"2023-07-14T13:29:46.155602+0000","last_active":"2023-07-14T13:29:48.797806+0000","last_peered":"2023-07-14T13:29:48.797806+0000","last_clean":"2023-07-14T13:29:48.797806+0000","last_became_active":"2023-07-14T13:29:46.155108+0000","last_became_peered":"2023-07-14T13:29:46.155108+0000","last_unstale":"2023-07-14T13:29:48.797806+0000","last_undegraded":"2023-07-14T13:29:48.797806+0000","last_fullsized":"2023-07-14T13:29:48.797806+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:13.416506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141791+0000","last_change":"2023-07-14T13:29:46.152988+0000","last_active":"2023-07-14T13:29:47.141791+0000","last_peered":"2023-07-14T13:29:47.141791+0000","last_clean":"2023-07-14T13:29:47.141791+0000","last_became_active":"2023-07-14T13:29:46.152697+0000","last_became_peered":"2023-07-14T13:29:46.152697+0000","last_unstale":"2023-07-14T13:29:47.141791+0000","last_undegraded":"2023-07-14T13:29:47.141791+0000","last_fullsized":"2023-07-14T13:29:47.141791+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:46:18.882359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797626+0000","last_change":"2023-07-14T13:29:46.156427+0000","last_active":"2023-07-14T13:29:48.797626+0000","last_peered":"2023-07-14T13:29:48.797626+0000","last_clean":"2023-07-14T13:29:48.797626+0000","last_became_active":"2023-07-14T13:29:46.156073+0000","last_became_peered":"2023-07-14T13:29:46.156073+0000","last_unstale":"2023-07-14T13:29:48.797626+0000","last_undegraded":"2023-07-14T13:29:48.797626+0000","last_fullsized":"2023-07-14T13:29:48.797626+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:22:17.681971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146211+0000","last_change":"2023-07-14T13:29:46.150139+0000","last_active":"2023-07-14T13:29:47.146211+0000","last_peered":"2023-07-14T13:29:47.146211+0000","last_clean":"2023-07-14T13:29:47.146211+0000","last_became_active":"2023-07-14T13:29:46.149853+0000","last_became_peered":"2023-07-14T13:29:46.149853+0000","last_unstale":"2023-07-14T13:29:47.146211+0000","last_undegraded":"2023-07-14T13:29:47.146211+0000","last_fullsized":"2023-07-14T13:29:47.146211+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:58.328252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797616+0000","last_change":"2023-07-14T13:29:46.159106+0000","last_active":"2023-07-14T13:29:48.797616+0000","last_peered":"2023-07-14T13:29:48.797616+0000","last_clean":"2023-07-14T13:29:48.797616+0000","last_became_active":"2023-07-14T13:29:46.158801+0000","last_became_peered":"2023-07-14T13:29:46.158801+0000","last_unstale":"2023-07-14T13:29:48.797616+0000","last_undegraded":"2023-07-14T13:29:48.797616+0000","last_fullsized":"2023-07-14T13:29:48.797616+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:20:40.273751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141222+0000","last_change":"2023-07-14T13:29:46.155534+0000","last_active":"2023-07-14T13:29:47.141222+0000","last_peered":"2023-07-14T13:29:47.141222+0000","last_clean":"2023-07-14T13:29:47.141222+0000","last_became_active":"2023-07-14T13:29:46.155265+0000","last_became_peered":"2023-07-14T13:29:46.155265+0000","last_unstale":"2023-07-14T13:29:47.141222+0000","last_undegraded":"2023-07-14T13:29:47.141222+0000","last_fullsized":"2023-07-14T13:29:47.141222+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:58:07.820454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.145962+0000","last_change":"2023-07-14T13:29:46.159148+0000","last_active":"2023-07-14T13:29:47.145962+0000","last_peered":"2023-07-14T13:29:47.145962+0000","last_clean":"2023-07-14T13:29:47.145962+0000","last_became_active":"2023-07-14T13:29:46.157198+0000","last_became_peered":"2023-07-14T13:29:46.157198+0000","last_unstale":"2023-07-14T13:29:47.145962+0000","last_undegraded":"2023-07-14T13:29:47.145962+0000","last_fullsized":"2023-07-14T13:29:47.145962+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:06:21.860997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479648+0000","last_change":"2023-07-14T13:29:46.162714+0000","last_active":"2023-07-14T13:29:48.479648+0000","last_peered":"2023-07-14T13:29:48.479648+0000","last_clean":"2023-07-14T13:29:48.479648+0000","last_became_active":"2023-07-14T13:29:46.162123+0000","last_became_peered":"2023-07-14T13:29:46.162123+0000","last_unstale":"2023-07-14T13:29:48.479648+0000","last_undegraded":"2023-07-14T13:29:48.479648+0000","last_fullsized":"2023-07-14T13:29:48.479648+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:36.907010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"171'4","reported_seq":17,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141806+0000","last_change":"2023-07-14T13:29:45.169422+0000","last_active":"2023-07-14T13:29:47.141806+0000","last_peered":"2023-07-14T13:29:47.141806+0000","last_clean":"2023-07-14T13:29:47.141806+0000","last_became_active":"2023-07-14T13:29:45.169138+0000","last_became_peered":"2023-07-14T13:29:45.169138+0000","last_unstale":"2023-07-14T13:29:47.141806+0000","last_undegraded":"2023-07-14T13:29:47.141806+0000","last_fullsized":"2023-07-14T13:29:47.141806+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:58:31.107549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479614+0000","last_change":"2023-07-14T13:29:46.160327+0000","last_active":"2023-07-14T13:29:48.479614+0000","last_peered":"2023-07-14T13:29:48.479614+0000","last_clean":"2023-07-14T13:29:48.479614+0000","last_became_active":"2023-07-14T13:29:46.159195+0000","last_became_peered":"2023-07-14T13:29:46.159195+0000","last_unstale":"2023-07-14T13:29:48.479614+0000","last_undegraded":"2023-07-14T13:29:48.479614+0000","last_fullsized":"2023-07-14T13:29:48.479614+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:15:41.664289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.155482+0000","last_change":"2023-07-14T13:29:44.155482+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.155482+0000","last_undegraded":"2023-07-14T13:29:44.155482+0000","last_fullsized":"2023-07-14T13:29:44.155482+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146443+0000","last_change":"2023-07-14T13:29:46.161735+0000","last_active":"2023-07-14T13:29:47.146443+0000","last_peered":"2023-07-14T13:29:47.146443+0000","last_clean":"2023-07-14T13:29:47.146443+0000","last_became_active":"2023-07-14T13:29:46.161340+0000","last_became_peered":"2023-07-14T13:29:46.161340+0000","last_unstale":"2023-07-14T13:29:47.146443+0000","last_undegraded":"2023-07-14T13:29:47.146443+0000","last_fullsized":"2023-07-14T13:29:47.146443+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:45:00.745964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.153856+0000","last_change":"2023-07-14T13:29:44.153856+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.153856+0000","last_undegraded":"2023-07-14T13:29:44.153856+0000","last_fullsized":"2023-07-14T13:29:44.153856+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479548+0000","last_change":"2023-07-14T13:29:45.163603+0000","last_active":"2023-07-14T13:29:48.479548+0000","last_peered":"2023-07-14T13:29:48.479548+0000","last_clean":"2023-07-14T13:29:48.479548+0000","last_became_active":"2023-07-14T13:29:45.163310+0000","last_became_peered":"2023-07-14T13:29:45.163310+0000","last_unstale":"2023-07-14T13:29:48.479548+0000","last_undegraded":"2023-07-14T13:29:48.479548+0000","last_fullsized":"2023-07-14T13:29:48.479548+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:53:27.366678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:49.060181+0000","last_change":"2023-07-14T13:29:46.154089+0000","last_active":"2023-07-14T13:29:49.060181+0000","last_peered":"2023-07-14T13:29:49.060181+0000","last_clean":"2023-07-14T13:29:49.060181+0000","last_became_active":"2023-07-14T13:29:46.153663+0000","last_became_peered":"2023-07-14T13:29:46.153663+0000","last_unstale":"2023-07-14T13:29:49.060181+0000","last_undegraded":"2023-07-14T13:29:49.060181+0000","last_fullsized":"2023-07-14T13:29:49.060181+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:30.137865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146336+0000","last_change":"2023-07-14T13:29:45.177250+0000","last_active":"2023-07-14T13:29:47.146336+0000","last_peered":"2023-07-14T13:29:47.146336+0000","last_clean":"2023-07-14T13:29:47.146336+0000","last_became_active":"2023-07-14T13:29:45.176926+0000","last_became_peered":"2023-07-14T13:29:45.176926+0000","last_unstale":"2023-07-14T13:29:47.146336+0000","last_undegraded":"2023-07-14T13:29:47.146336+0000","last_fullsized":"2023-07-14T13:29:47.146336+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:21:29.147948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141484+0000","last_change":"2023-07-14T13:29:45.173114+0000","last_active":"2023-07-14T13:29:47.141484+0000","last_peered":"2023-07-14T13:29:47.141484+0000","last_clean":"2023-07-14T13:29:47.141484+0000","last_became_active":"2023-07-14T13:29:45.172835+0000","last_became_peered":"2023-07-14T13:29:45.172835+0000","last_unstale":"2023-07-14T13:29:47.141484+0000","last_undegraded":"2023-07-14T13:29:47.141484+0000","last_fullsized":"2023-07-14T13:29:47.141484+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:27:21.083351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479370+0000","last_change":"2023-07-14T13:29:46.154070+0000","last_active":"2023-07-14T13:29:48.479370+0000","last_peered":"2023-07-14T13:29:48.479370+0000","last_clean":"2023-07-14T13:29:48.479370+0000","last_became_active":"2023-07-14T13:29:46.153808+0000","last_became_peered":"2023-07-14T13:29:46.153808+0000","last_unstale":"2023-07-14T13:29:48.479370+0000","last_undegraded":"2023-07-14T13:29:48.479370+0000","last_fullsized":"2023-07-14T13:29:48.479370+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:29:11.403775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.151443+0000","last_change":"2023-07-14T13:29:44.151443+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.151443+0000","last_undegraded":"2023-07-14T13:29:44.151443+0000","last_fullsized":"2023-07-14T13:29:44.151443+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141245+0000","last_change":"2023-07-14T13:29:45.171928+0000","last_active":"2023-07-14T13:29:47.141245+0000","last_peered":"2023-07-14T13:29:47.141245+0000","last_clean":"2023-07-14T13:29:47.141245+0000","last_became_active":"2023-07-14T13:29:45.171477+0000","last_became_peered":"2023-07-14T13:29:45.171477+0000","last_unstale":"2023-07-14T13:29:47.141245+0000","last_undegraded":"2023-07-14T13:29:47.141245+0000","last_fullsized":"2023-07-14T13:29:47.141245+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:34:09.091228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797671+0000","last_change":"2023-07-14T13:29:45.170109+0000","last_active":"2023-07-14T13:29:48.797671+0000","last_peered":"2023-07-14T13:29:48.797671+0000","last_clean":"2023-07-14T13:29:48.797671+0000","last_became_active":"2023-07-14T13:29:45.169830+0000","last_became_peered":"2023-07-14T13:29:45.169830+0000","last_unstale":"2023-07-14T13:29:48.797671+0000","last_undegraded":"2023-07-14T13:29:48.797671+0000","last_fullsized":"2023-07-14T13:29:48.797671+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:46:28.314128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.153918+0000","last_change":"2023-07-14T13:29:44.153918+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.153918+0000","last_undegraded":"2023-07-14T13:29:44.153918+0000","last_fullsized":"2023-07-14T13:29:44.153918+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479710+0000","last_change":"2023-07-14T13:29:45.175075+0000","last_active":"2023-07-14T13:29:48.479710+0000","last_peered":"2023-07-14T13:29:48.479710+0000","last_clean":"2023-07-14T13:29:48.479710+0000","last_became_active":"2023-07-14T13:29:45.174845+0000","last_became_peered":"2023-07-14T13:29:45.174845+0000","last_unstale":"2023-07-14T13:29:48.479710+0000","last_undegraded":"2023-07-14T13:29:48.479710+0000","last_fullsized":"2023-07-14T13:29:48.479710+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:42.991173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150865+0000","last_change":"2023-07-14T13:29:44.150865+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150865+0000","last_undegraded":"2023-07-14T13:29:44.150865+0000","last_fullsized":"2023-07-14T13:29:44.150865+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:49.060345+0000","last_change":"2023-07-14T13:29:45.175827+0000","last_active":"2023-07-14T13:29:49.060345+0000","last_peered":"2023-07-14T13:29:49.060345+0000","last_clean":"2023-07-14T13:29:49.060345+0000","last_became_active":"2023-07-14T13:29:45.175532+0000","last_became_peered":"2023-07-14T13:29:45.175532+0000","last_unstale":"2023-07-14T13:29:49.060345+0000","last_undegraded":"2023-07-14T13:29:49.060345+0000","last_fullsized":"2023-07-14T13:29:49.060345+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:46:17.873832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479490+0000","last_change":"2023-07-14T13:29:46.165792+0000","last_active":"2023-07-14T13:29:48.479490+0000","last_peered":"2023-07-14T13:29:48.479490+0000","last_clean":"2023-07-14T13:29:48.479490+0000","last_became_active":"2023-07-14T13:29:46.165479+0000","last_became_peered":"2023-07-14T13:29:46.165479+0000","last_unstale":"2023-07-14T13:29:48.479490+0000","last_undegraded":"2023-07-14T13:29:48.479490+0000","last_fullsized":"2023-07-14T13:29:48.479490+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:09:56.183958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146005+0000","last_change":"2023-07-14T13:29:45.173121+0000","last_active":"2023-07-14T13:29:47.146005+0000","last_peered":"2023-07-14T13:29:47.146005+0000","last_clean":"2023-07-14T13:29:47.146005+0000","last_became_active":"2023-07-14T13:29:45.172588+0000","last_became_peered":"2023-07-14T13:29:45.172588+0000","last_unstale":"2023-07-14T13:29:47.146005+0000","last_undegraded":"2023-07-14T13:29:47.146005+0000","last_fullsized":"2023-07-14T13:29:47.146005+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:51:26.781033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:49.060129+0000","last_change":"2023-07-14T13:29:45.172122+0000","last_active":"2023-07-14T13:29:49.060129+0000","last_peered":"2023-07-14T13:29:49.060129+0000","last_clean":"2023-07-14T13:29:49.060129+0000","last_became_active":"2023-07-14T13:29:45.171842+0000","last_became_peered":"2023-07-14T13:29:45.171842+0000","last_unstale":"2023-07-14T13:29:49.060129+0000","last_undegraded":"2023-07-14T13:29:49.060129+0000","last_fullsized":"2023-07-14T13:29:49.060129+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:06:16.855003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479597+0000","last_change":"2023-07-14T13:29:46.159571+0000","last_active":"2023-07-14T13:29:48.479597+0000","last_peered":"2023-07-14T13:29:48.479597+0000","last_clean":"2023-07-14T13:29:48.479597+0000","last_became_active":"2023-07-14T13:29:46.159131+0000","last_became_peered":"2023-07-14T13:29:46.159131+0000","last_unstale":"2023-07-14T13:29:48.479597+0000","last_undegraded":"2023-07-14T13:29:48.479597+0000","last_fullsized":"2023-07-14T13:29:48.479597+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:29:41.684686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146568+0000","last_change":"2023-07-14T13:29:45.172255+0000","last_active":"2023-07-14T13:29:47.146568+0000","last_peered":"2023-07-14T13:29:47.146568+0000","last_clean":"2023-07-14T13:29:47.146568+0000","last_became_active":"2023-07-14T13:29:45.171958+0000","last_became_peered":"2023-07-14T13:29:45.171958+0000","last_unstale":"2023-07-14T13:29:47.146568+0000","last_undegraded":"2023-07-14T13:29:47.146568+0000","last_fullsized":"2023-07-14T13:29:47.146568+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:03:09.694947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141579+0000","last_change":"2023-07-14T13:29:46.163846+0000","last_active":"2023-07-14T13:29:47.141579+0000","last_peered":"2023-07-14T13:29:47.141579+0000","last_clean":"2023-07-14T13:29:47.141579+0000","last_became_active":"2023-07-14T13:29:46.163582+0000","last_became_peered":"2023-07-14T13:29:46.163582+0000","last_unstale":"2023-07-14T13:29:47.141579+0000","last_undegraded":"2023-07-14T13:29:47.141579+0000","last_fullsized":"2023-07-14T13:29:47.141579+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:30:43.385089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150656+0000","last_change":"2023-07-14T13:29:44.150656+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150656+0000","last_undegraded":"2023-07-14T13:29:44.150656+0000","last_fullsized":"2023-07-14T13:29:44.150656+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150513+0000","last_change":"2023-07-14T13:29:44.150513+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150513+0000","last_undegraded":"2023-07-14T13:29:44.150513+0000","last_fullsized":"2023-07-14T13:29:44.150513+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479790+0000","last_change":"2023-07-14T13:29:45.170294+0000","last_active":"2023-07-14T13:29:48.479790+0000","last_peered":"2023-07-14T13:29:48.479790+0000","last_clean":"2023-07-14T13:29:48.479790+0000","last_became_active":"2023-07-14T13:29:45.170018+0000","last_became_peered":"2023-07-14T13:29:45.170018+0000","last_unstale":"2023-07-14T13:29:48.479790+0000","last_undegraded":"2023-07-14T13:29:48.479790+0000","last_fullsized":"2023-07-14T13:29:48.479790+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:07:58.741534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141753+0000","last_change":"2023-07-14T13:29:46.159322+0000","last_active":"2023-07-14T13:29:47.141753+0000","last_peered":"2023-07-14T13:29:47.141753+0000","last_clean":"2023-07-14T13:29:47.141753+0000","last_became_active":"2023-07-14T13:29:46.159056+0000","last_became_peered":"2023-07-14T13:29:46.159056+0000","last_unstale":"2023-07-14T13:29:47.141753+0000","last_undegraded":"2023-07-14T13:29:47.141753+0000","last_fullsized":"2023-07-14T13:29:47.141753+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:24.768994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141634+0000","last_change":"2023-07-14T13:29:45.175896+0000","last_active":"2023-07-14T13:29:47.141634+0000","last_peered":"2023-07-14T13:29:47.141634+0000","last_clean":"2023-07-14T13:29:47.141634+0000","last_became_active":"2023-07-14T13:29:45.175541+0000","last_became_peered":"2023-07-14T13:29:45.175541+0000","last_unstale":"2023-07-14T13:29:47.141634+0000","last_undegraded":"2023-07-14T13:29:47.141634+0000","last_fullsized":"2023-07-14T13:29:47.141634+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:29.129338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146365+0000","last_change":"2023-07-14T13:29:46.154310+0000","last_active":"2023-07-14T13:29:47.146365+0000","last_peered":"2023-07-14T13:29:47.146365+0000","last_clean":"2023-07-14T13:29:47.146365+0000","last_became_active":"2023-07-14T13:29:46.153864+0000","last_became_peered":"2023-07-14T13:29:46.153864+0000","last_unstale":"2023-07-14T13:29:47.146365+0000","last_undegraded":"2023-07-14T13:29:47.146365+0000","last_fullsized":"2023-07-14T13:29:47.146365+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:14:22.808642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150533+0000","last_change":"2023-07-14T13:29:44.150533+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150533+0000","last_undegraded":"2023-07-14T13:29:44.150533+0000","last_fullsized":"2023-07-14T13:29:44.150533+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797562+0000","last_change":"2023-07-14T13:29:45.171477+0000","last_active":"2023-07-14T13:29:48.797562+0000","last_peered":"2023-07-14T13:29:48.797562+0000","last_clean":"2023-07-14T13:29:48.797562+0000","last_became_active":"2023-07-14T13:29:45.171199+0000","last_became_peered":"2023-07-14T13:29:45.171199+0000","last_unstale":"2023-07-14T13:29:48.797562+0000","last_undegraded":"2023-07-14T13:29:48.797562+0000","last_fullsized":"2023-07-14T13:29:48.797562+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:45.698963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479447+0000","last_change":"2023-07-14T13:29:46.156947+0000","last_active":"2023-07-14T13:29:48.479447+0000","last_peered":"2023-07-14T13:29:48.479447+0000","last_clean":"2023-07-14T13:29:48.479447+0000","last_became_active":"2023-07-14T13:29:46.156662+0000","last_became_peered":"2023-07-14T13:29:46.156662+0000","last_unstale":"2023-07-14T13:29:48.479447+0000","last_undegraded":"2023-07-14T13:29:48.479447+0000","last_fullsized":"2023-07-14T13:29:48.479447+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:40:20.487679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150538+0000","last_change":"2023-07-14T13:29:44.150538+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150538+0000","last_undegraded":"2023-07-14T13:29:44.150538+0000","last_fullsized":"2023-07-14T13:29:44.150538+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146203+0000","last_change":"2023-07-14T13:29:46.158420+0000","last_active":"2023-07-14T13:29:47.146203+0000","last_peered":"2023-07-14T13:29:47.146203+0000","last_clean":"2023-07-14T13:29:47.146203+0000","last_became_active":"2023-07-14T13:29:46.158157+0000","last_became_peered":"2023-07-14T13:29:46.158157+0000","last_unstale":"2023-07-14T13:29:47.146203+0000","last_undegraded":"2023-07-14T13:29:47.146203+0000","last_fullsized":"2023-07-14T13:29:47.146203+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:39:57.006292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.153884+0000","last_change":"2023-07-14T13:29:44.153884+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.153884+0000","last_undegraded":"2023-07-14T13:29:44.153884+0000","last_fullsized":"2023-07-14T13:29:44.153884+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146622+0000","last_change":"2023-07-14T13:29:46.155886+0000","last_active":"2023-07-14T13:29:47.146622+0000","last_peered":"2023-07-14T13:29:47.146622+0000","last_clean":"2023-07-14T13:29:47.146622+0000","last_became_active":"2023-07-14T13:29:46.155575+0000","last_became_peered":"2023-07-14T13:29:46.155575+0000","last_unstale":"2023-07-14T13:29:47.146622+0000","last_undegraded":"2023-07-14T13:29:47.146622+0000","last_fullsized":"2023-07-14T13:29:47.146622+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:38:53.097885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"171'6","reported_seq":19,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:49.060214+0000","last_change":"2023-07-14T13:29:45.175838+0000","last_active":"2023-07-14T13:29:49.060214+0000","last_peered":"2023-07-14T13:29:49.060214+0000","last_clean":"2023-07-14T13:29:49.060214+0000","last_became_active":"2023-07-14T13:29:45.175543+0000","last_became_peered":"2023-07-14T13:29:45.175543+0000","last_unstale":"2023-07-14T13:29:49.060214+0000","last_undegraded":"2023-07-14T13:29:49.060214+0000","last_fullsized":"2023-07-14T13:29:49.060214+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:17:20.283333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"160'304","reported_seq":1106,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-14T13:29:44.154708+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:29:44.154708+0000","last_peered":"2023-07-14T13:29:44.154708+0000","last_clean":"2023-07-14T13:29:44.154708+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:29:44.154708+0000","last_undegraded":"2023-07-14T13:29:44.154708+0000","last_fullsized":"2023-07-14T13:29:44.154708+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:39:53.671602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":282,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-14T13:29:44.153127+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:29:44.153127+0000","last_peered":"2023-07-14T13:29:44.153127+0000","last_clean":"2023-07-14T13:29:44.153127+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:29:44.153127+0000","last_undegraded":"2023-07-14T13:29:44.153127+0000","last_fullsized":"2023-07-14T13:29:44.153127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:23:28.688209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146431+0000","last_change":"2023-07-14T13:29:46.159514+0000","last_active":"2023-07-14T13:29:47.146431+0000","last_peered":"2023-07-14T13:29:47.146431+0000","last_clean":"2023-07-14T13:29:47.146431+0000","last_became_active":"2023-07-14T13:29:46.158086+0000","last_became_peered":"2023-07-14T13:29:46.158086+0000","last_unstale":"2023-07-14T13:29:47.146431+0000","last_undegraded":"2023-07-14T13:29:47.146431+0000","last_fullsized":"2023-07-14T13:29:47.146431+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:16:18.528808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.154151+0000","last_change":"2023-07-14T13:29:44.154151+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.154151+0000","last_undegraded":"2023-07-14T13:29:44.154151+0000","last_fullsized":"2023-07-14T13:29:44.154151+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":287,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-14T13:29:44.154584+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:29:44.154584+0000","last_peered":"2023-07-14T13:29:44.154584+0000","last_clean":"2023-07-14T13:29:44.154584+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:29:44.154584+0000","last_undegraded":"2023-07-14T13:29:44.154584+0000","last_fullsized":"2023-07-14T13:29:44.154584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:23:31.882598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797720+0000","last_change":"2023-07-14T13:29:46.161055+0000","last_active":"2023-07-14T13:29:48.797720+0000","last_peered":"2023-07-14T13:29:48.797720+0000","last_clean":"2023-07-14T13:29:48.797720+0000","last_became_active":"2023-07-14T13:29:46.160756+0000","last_became_peered":"2023-07-14T13:29:46.160756+0000","last_unstale":"2023-07-14T13:29:48.797720+0000","last_undegraded":"2023-07-14T13:29:48.797720+0000","last_fullsized":"2023-07-14T13:29:48.797720+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:28:44.675715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.151080+0000","last_change":"2023-07-14T13:29:44.151080+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.151080+0000","last_undegraded":"2023-07-14T13:29:44.151080+0000","last_fullsized":"2023-07-14T13:29:44.151080+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":292,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797462+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:29:48.797462+0000","last_peered":"2023-07-14T13:29:48.797462+0000","last_clean":"2023-07-14T13:29:48.797462+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:29:48.797462+0000","last_undegraded":"2023-07-14T13:29:48.797462+0000","last_fullsized":"2023-07-14T13:29:48.797462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:14:45.493017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797812+0000","last_change":"2023-07-14T13:29:46.165798+0000","last_active":"2023-07-14T13:29:48.797812+0000","last_peered":"2023-07-14T13:29:48.797812+0000","last_clean":"2023-07-14T13:29:48.797812+0000","last_became_active":"2023-07-14T13:29:46.165366+0000","last_became_peered":"2023-07-14T13:29:46.165366+0000","last_unstale":"2023-07-14T13:29:48.797812+0000","last_undegraded":"2023-07-14T13:29:48.797812+0000","last_fullsized":"2023-07-14T13:29:48.797812+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:34:21.181467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"171'3","reported_seq":16,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797772+0000","last_change":"2023-07-14T13:29:45.167394+0000","last_active":"2023-07-14T13:29:48.797772+0000","last_peered":"2023-07-14T13:29:48.797772+0000","last_clean":"2023-07-14T13:29:48.797772+0000","last_became_active":"2023-07-14T13:29:45.167109+0000","last_became_peered":"2023-07-14T13:29:45.167109+0000","last_unstale":"2023-07-14T13:29:48.797772+0000","last_undegraded":"2023-07-14T13:29:48.797772+0000","last_fullsized":"2023-07-14T13:29:48.797772+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:07:03.377007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":282,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-14T13:29:44.153084+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:29:44.153084+0000","last_peered":"2023-07-14T13:29:44.153084+0000","last_clean":"2023-07-14T13:29:44.153084+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:29:44.153084+0000","last_undegraded":"2023-07-14T13:29:44.153084+0000","last_fullsized":"2023-07-14T13:29:44.153084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:39:28.264692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146524+0000","last_change":"2023-07-14T13:29:46.158284+0000","last_active":"2023-07-14T13:29:47.146524+0000","last_peered":"2023-07-14T13:29:47.146524+0000","last_clean":"2023-07-14T13:29:47.146524+0000","last_became_active":"2023-07-14T13:29:46.157955+0000","last_became_peered":"2023-07-14T13:29:46.157955+0000","last_unstale":"2023-07-14T13:29:47.146524+0000","last_undegraded":"2023-07-14T13:29:47.146524+0000","last_fullsized":"2023-07-14T13:29:47.146524+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:42:58.793494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141644+0000","last_change":"2023-07-14T13:29:45.167565+0000","last_active":"2023-07-14T13:29:47.141644+0000","last_peered":"2023-07-14T13:29:47.141644+0000","last_clean":"2023-07-14T13:29:47.141644+0000","last_became_active":"2023-07-14T13:29:45.167122+0000","last_became_peered":"2023-07-14T13:29:45.167122+0000","last_unstale":"2023-07-14T13:29:47.141644+0000","last_undegraded":"2023-07-14T13:29:47.141644+0000","last_fullsized":"2023-07-14T13:29:47.141644+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:17:20.283333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":300,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479725+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:29:48.479725+0000","last_peered":"2023-07-14T13:29:48.479725+0000","last_clean":"2023-07-14T13:29:48.479725+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:29:48.479725+0000","last_undegraded":"2023-07-14T13:29:48.479725+0000","last_fullsized":"2023-07-14T13:29:48.479725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:04:01.119223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479382+0000","last_change":"2023-07-14T13:29:46.159750+0000","last_active":"2023-07-14T13:29:48.479382+0000","last_peered":"2023-07-14T13:29:48.479382+0000","last_clean":"2023-07-14T13:29:48.479382+0000","last_became_active":"2023-07-14T13:29:46.159434+0000","last_became_peered":"2023-07-14T13:29:46.159434+0000","last_unstale":"2023-07-14T13:29:48.479382+0000","last_undegraded":"2023-07-14T13:29:48.479382+0000","last_fullsized":"2023-07-14T13:29:48.479382+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:25:26.203512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150838+0000","last_change":"2023-07-14T13:29:44.150838+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150838+0000","last_undegraded":"2023-07-14T13:29:44.150838+0000","last_fullsized":"2023-07-14T13:29:44.150838+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":284,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-14T13:29:44.154855+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:29:44.154855+0000","last_peered":"2023-07-14T13:29:44.154855+0000","last_clean":"2023-07-14T13:29:44.154855+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:29:44.154855+0000","last_undegraded":"2023-07-14T13:29:44.154855+0000","last_fullsized":"2023-07-14T13:29:44.154855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:47:20.376659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141463+0000","last_change":"2023-07-14T13:29:46.150567+0000","last_active":"2023-07-14T13:29:47.141463+0000","last_peered":"2023-07-14T13:29:47.141463+0000","last_clean":"2023-07-14T13:29:47.141463+0000","last_became_active":"2023-07-14T13:29:46.150251+0000","last_became_peered":"2023-07-14T13:29:46.150251+0000","last_unstale":"2023-07-14T13:29:47.141463+0000","last_undegraded":"2023-07-14T13:29:47.141463+0000","last_fullsized":"2023-07-14T13:29:47.141463+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:35:51.313440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150512+0000","last_change":"2023-07-14T13:29:44.150512+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150512+0000","last_undegraded":"2023-07-14T13:29:44.150512+0000","last_fullsized":"2023-07-14T13:29:44.150512+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":300,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479710+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:29:48.479710+0000","last_peered":"2023-07-14T13:29:48.479710+0000","last_clean":"2023-07-14T13:29:48.479710+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:29:48.479710+0000","last_undegraded":"2023-07-14T13:29:48.479710+0000","last_fullsized":"2023-07-14T13:29:48.479710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:05:23.988230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479427+0000","last_change":"2023-07-14T13:29:46.152496+0000","last_active":"2023-07-14T13:29:48.479427+0000","last_peered":"2023-07-14T13:29:48.479427+0000","last_clean":"2023-07-14T13:29:48.479427+0000","last_became_active":"2023-07-14T13:29:46.152230+0000","last_became_peered":"2023-07-14T13:29:46.152230+0000","last_unstale":"2023-07-14T13:29:48.479427+0000","last_undegraded":"2023-07-14T13:29:48.479427+0000","last_fullsized":"2023-07-14T13:29:48.479427+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:26:38.395035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.151752+0000","last_change":"2023-07-14T13:29:44.151752+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.151752+0000","last_undegraded":"2023-07-14T13:29:44.151752+0000","last_fullsized":"2023-07-14T13:29:44.151752+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":286,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-14T13:29:44.151631+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:29:44.151631+0000","last_peered":"2023-07-14T13:29:44.151631+0000","last_clean":"2023-07-14T13:29:44.151631+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:29:44.151631+0000","last_undegraded":"2023-07-14T13:29:44.151631+0000","last_fullsized":"2023-07-14T13:29:44.151631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:05:53.665139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":84,"acting":84,"num_store_stats":5},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23,"ondisk_log_size":23,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575289,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59928,"kb_used_data":2640,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94311912,"statfs":{"total":96636764160,"available":96575397888,"internally_reserved":0,"allocated":2703360,"data_stored":1670881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.57099999999999995,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96899999999999997,"5min":1.054,"15min":1.054},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.752,"15min":0.746},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.443},"max":{"1min":1.016,"5min":1.016,"15min":1.032},"last":0.42899999999999999}]},{"osd":1,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.752,"15min":0.755},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.90400000000000003,"5min":1.339,"15min":1.339},"last":1.1659999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.76600000000000001,"15min":0.76100000000000001},"min":{"1min":0.53300000000000003,"5min":0.501,"15min":0.496},"max":{"1min":0.98399999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.60399999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.72899999999999998,"15min":0.74099999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88400000000000001,"5min":1.032,"15min":1.1379999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.879,"5min":1.429,"15min":1.429},"last":0.91400000000000003}]},{"osd":3,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.746,"15min":0.75600000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.499},"max":{"1min":0.95599999999999996,"5min":1.361,"15min":1.361},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.44700000000000001},"max":{"1min":0.94299999999999995,"5min":1.395,"15min":1.395},"last":1.097}]},{"osd":4,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.60599999999999998,"15min":0.58299999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.35799999999999998},"max":{"1min":0.89700000000000002,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.879},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61399999999999999,"15min":0.62},"min":{"1min":0.44700000000000001,"5min":0.439,"15min":0.40400000000000003},"max":{"1min":0.93700000000000006,"5min":0.95799999999999996,"15min":0.99399999999999999},"last":0.80400000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60399999999999998,"15min":0.61099999999999999},"min":{"1min":0.48599999999999999,"5min":0.42399999999999999,"15min":0.40200000000000002},"max":{"1min":0.90300000000000002,"5min":1,"15min":1},"last":1.056},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47999999999999998,"5min":0.45300000000000001,"15min":0.41699999999999998},"max":{"1min":0.873,"5min":0.93600000000000005,"15min":1.0620000000000001},"last":0.96099999999999997}]},{"osd":6,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.56899999999999995,"5min":0.52600000000000002,"15min":0.47099999999999997},"max":{"1min":0.93799999999999994,"5min":1.0940000000000001,"15min":1.115},"last":1.032},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67800000000000005,"15min":0.68100000000000005},"min":{"1min":0.503,"5min":0.495,"15min":0.41999999999999998},"max":{"1min":0.879,"5min":0.95299999999999996,"15min":1.147},"last":0.84699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575290,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33108,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338732,"statfs":{"total":96636764160,"available":96602861568,"internally_reserved":0,"allocated":2109440,"data_stored":1080513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.998,"5min":1.026,"15min":1.026},"last":0.629},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.499,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89400000000000002,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.76300000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73999999999999999,"15min":0.76400000000000001},"min":{"1min":0.54000000000000004,"5min":0.51600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91500000000000004,"5min":1.0049999999999999,"15min":1.3300000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73799999999999999,"15min":0.747},"min":{"1min":0.58299999999999996,"5min":0.51700000000000002,"15min":0.47499999999999998},"max":{"1min":0.93999999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.69199999999999995}]},{"osd":2,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77500000000000002,"15min":0.79200000000000004},"min":{"1min":0.59799999999999998,"5min":0.53300000000000003,"15min":0.52000000000000002},"max":{"1min":0.92500000000000004,"5min":1.04,"15min":1.0660000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75700000000000001,"15min":0.76700000000000002},"min":{"1min":0.53500000000000003,"5min":0.52600000000000002,"15min":0.51300000000000001},"max":{"1min":0.94799999999999995,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.66900000000000004}]},{"osd":3,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77700000000000002,"15min":0.78100000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.95799999999999996,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.70699999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.2569999999999999},"last":0.71399999999999997}]},{"osd":4,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.41499999999999998,"5min":0.36299999999999999,"15min":0.36099999999999999},"max":{"1min":0.82199999999999995,"5min":0.92600000000000005,"15min":1.175},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60899999999999999,"15min":0.61199999999999999},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.36799999999999999},"max":{"1min":0.80800000000000005,"5min":0.94599999999999995,"15min":1.0580000000000001},"last":0.46100000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.42699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84999999999999998,"5min":0.873,"15min":1.0860000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.68000000000000005,"15min":0.67400000000000004},"min":{"1min":0.51000000000000001,"5min":0.45900000000000002,"15min":0.41699999999999998},"max":{"1min":0.92100000000000004,"5min":0.93200000000000005,"15min":1.3180000000000001},"last":0.59399999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.46500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88800000000000001,"5min":0.99199999999999999,"15min":1.042},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.53700000000000003,"5min":0.50900000000000001,"15min":0.46200000000000002},"max":{"1min":0.89900000000000002,"5min":0.92300000000000004,"15min":1.0369999999999999},"last":0.49299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575289,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51156,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320684,"statfs":{"total":96636764160,"available":96584380416,"internally_reserved":0,"allocated":2109440,"data_stored":1080513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.76000000000000001,"15min":0.745},"min":{"1min":0.59499999999999997,"5min":0.41799999999999998,"15min":0.40500000000000003},"max":{"1min":0.94099999999999995,"5min":1.8,"15min":1.8},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77400000000000002,"15min":0.76100000000000001},"min":{"1min":0.58599999999999997,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":0.91500000000000004,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.71999999999999997}]},{"osd":1,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77000000000000002,"15min":0.746},"min":{"1min":0.58699999999999997,"5min":0.50600000000000001,"15min":0.378},"max":{"1min":0.89600000000000002,"5min":1.835,"15min":1.835},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.77500000000000002,"15min":0.77200000000000002},"min":{"1min":0.56200000000000006,"5min":0.503,"15min":0.499},"max":{"1min":0.99299999999999999,"5min":1.0429999999999999,"15min":1.05},"last":1.0629999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.91800000000000004,"15min":0.80300000000000005},"min":{"1min":0.67100000000000004,"5min":0.434,"15min":0.434},"max":{"1min":0.95199999999999996,"5min":16.774000000000001,"15min":16.774000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.90800000000000003,"15min":0.80600000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.496},"max":{"1min":0.88,"5min":16.751999999999999,"15min":16.751999999999999},"last":0.67100000000000004}]},{"osd":3,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.77700000000000002,"15min":0.77100000000000002},"min":{"1min":0.65400000000000003,"5min":0.52700000000000002,"15min":0.51100000000000001},"max":{"1min":0.95899999999999996,"5min":0.999,"15min":1.115},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.93600000000000005,"15min":0.82999999999999996},"min":{"1min":0.60699999999999998,"5min":0.54100000000000004,"15min":0.50600000000000001},"max":{"1min":0.93999999999999995,"5min":16.731000000000002,"15min":16.731000000000002},"last":0.96799999999999997}]},{"osd":4,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.624,"15min":0.63100000000000001},"min":{"1min":0.442,"5min":0.39500000000000002,"15min":0.38},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":1.0089999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.70999999999999996},"min":{"1min":0.45200000000000001,"5min":0.375,"15min":0.36699999999999999},"max":{"1min":1.02,"5min":1.159,"15min":1.159},"last":1.248}]},{"osd":6,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.61899999999999999},"min":{"1min":0.49099999999999999,"5min":0.41799999999999998,"15min":0.34999999999999998},"max":{"1min":0.88800000000000001,"5min":0.94699999999999995,"15min":1.3100000000000001},"last":1.157},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64700000000000002,"15min":0.64400000000000002},"min":{"1min":0.501,"5min":0.45400000000000001,"15min":0.40999999999999998},"max":{"1min":0.80400000000000005,"5min":0.91800000000000004,"15min":0.97299999999999998},"last":0.99199999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65400000000000003,"15min":0.64900000000000002},"min":{"1min":0.51100000000000001,"5min":0.432,"15min":0.42399999999999999},"max":{"1min":0.93000000000000005,"5min":1.123,"15min":1.123},"last":1.1759999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.69499999999999995,"15min":0.68899999999999995},"min":{"1min":0.55700000000000005,"5min":0.49299999999999999,"15min":0.40000000000000002},"max":{"1min":0.96899999999999997,"5min":1.012,"15min":1.012},"last":1.091}]}]},{"osd":4,"up_from":13,"seq":55834575290,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37252,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334588,"statfs":{"total":96636764160,"available":96598618112,"internally_reserved":0,"allocated":2158592,"data_stored":1102570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.76400000000000001,"15min":0.76700000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.38100000000000001},"max":{"1min":0.96899999999999997,"5min":1.0069999999999999,"15min":1.0249999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77100000000000002,"15min":0.76300000000000001},"min":{"1min":0.60799999999999998,"5min":0.45800000000000002,"15min":0.442},"max":{"1min":0.94499999999999995,"5min":1.278,"15min":1.278},"last":0.50800000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.76300000000000001,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0349999999999999,"5min":1.306,"15min":1.306},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.53800000000000003,"5min":0.51000000000000001,"15min":0.47599999999999998},"max":{"1min":1.024,"5min":1.177,"15min":1.177},"last":0.748}]},{"osd":2,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78000000000000003,"15min":0.77300000000000002},"min":{"1min":0.56899999999999995,"5min":0.54000000000000004,"15min":0.49299999999999999},"max":{"1min":0.90400000000000003,"5min":1.137,"15min":1.137},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77300000000000002,"15min":0.77900000000000003},"min":{"1min":0.53700000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1,"5min":1,"15min":1.0149999999999999},"last":0.82299999999999995}]},{"osd":3,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.50800000000000001},"max":{"1min":0.93200000000000005,"5min":1.222,"15min":1.222},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78400000000000003,"15min":0.77900000000000003},"min":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.496},"max":{"1min":1.018,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60599999999999998,"15min":0.60699999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.40000000000000002},"max":{"1min":0.94099999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61799999999999999,"15min":0.60799999999999998},"min":{"1min":0.45000000000000001,"5min":0.42399999999999999,"15min":0.378},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96799999999999997},"last":0.61799999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.624,"15min":0.61599999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.42699999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.88600000000000001}]},{"osd":7,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67300000000000004,"15min":0.67100000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.435},"max":{"1min":0.91800000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70099999999999996,"15min":0.69799999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.83999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575290,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41344,"kb_used_data":2104,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330496,"statfs":{"total":96636764160,"available":96594427904,"internally_reserved":0,"allocated":2154496,"data_stored":1101622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47399999999999998,"15min":0.46000000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.28799999999999998},"max":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.92900000000000005},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.621,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.51900000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.48899999999999999,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.33900000000000002,"15min":0.32300000000000001},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.495},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55800000000000005,"15min":0.56100000000000005},"min":{"1min":0.39700000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.82199999999999995,"5min":0.82399999999999995,"15min":0.95799999999999996},"last":0.70099999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57799999999999996,"15min":0.58299999999999996},"min":{"1min":0.41499999999999998,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.623,"15min":0.61499999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82399999999999995,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.74299999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.77000000000000002,"15min":0.78500000000000003},"min":{"1min":0.45200000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.048,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.79500000000000004,"15min":0.80600000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98999999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.84599999999999997}]},{"osd":5,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81000000000000005,"15min":0.82899999999999996},"min":{"1min":0.56499999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.069,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80800000000000005,"15min":0.81299999999999994},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1220000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":1.0089999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.81399999999999995,"15min":0.80800000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1910000000000001,"5min":1.383,"15min":1.383},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.82299999999999995,"15min":0.83999999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1439999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.76200000000000001}]},{"osd":7,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.86399999999999999,"15min":0.85999999999999999},"min":{"1min":0.58899999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.171,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.56599999999999995,"5min":0.56000000000000005,"15min":0.54800000000000004},"max":{"1min":1.1579999999999999,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.91200000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575290,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59388,"kb_used_data":2100,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312452,"statfs":{"total":96636764160,"available":96575950848,"internally_reserved":0,"allocated":2150400,"data_stored":1100099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46899999999999997,"15min":0.46500000000000002},"min":{"1min":0.32200000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.68400000000000005,"5min":0.70799999999999996,"15min":0.80500000000000005},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.53100000000000003},"min":{"1min":0.38300000000000001,"5min":0.318,"15min":0.30599999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.34899999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47099999999999997,"15min":0.46800000000000003},"min":{"1min":0.34100000000000003,"5min":0.32900000000000001,"15min":0.32600000000000001},"max":{"1min":0.58599999999999997,"5min":0.80600000000000005,"15min":0.84799999999999998},"last":0.307},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.56100000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38200000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.93799999999999994},"last":0.41699999999999998}]},{"osd":3,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.39700000000000002,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.74399999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.433},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56699999999999995,"15min":0.55800000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35699999999999998},"max":{"1min":0.73599999999999999,"5min":0.77300000000000002,"15min":0.84599999999999997},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.80100000000000005},"min":{"1min":0.58099999999999996,"5min":0.49399999999999999,"15min":0.48799999999999999},"max":{"1min":1.004,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.84099999999999997,"15min":0.81999999999999995},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.48899999999999999},"max":{"1min":1.0169999999999999,"5min":1.179,"15min":1.3029999999999999},"last":0.627}]},{"osd":5,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.86899999999999999,"15min":0.86399999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.02,"5min":1.2430000000000001,"15min":1.302},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.85999999999999999,"15min":0.85099999999999998},"min":{"1min":0.65700000000000003,"5min":0.60699999999999998,"15min":0.54000000000000004},"max":{"1min":1.1120000000000001,"5min":1.2410000000000001,"15min":1.248},"last":0.67400000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85999999999999999,"15min":0.82899999999999996},"min":{"1min":0.59799999999999998,"5min":0.56699999999999995,"15min":0.54800000000000004},"max":{"1min":1.042,"5min":1.2749999999999999,"15min":1.446},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.83599999999999997,"15min":0.82399999999999995},"min":{"1min":0.64500000000000002,"5min":0.55100000000000005,"15min":0.51700000000000002},"max":{"1min":1.119,"5min":1.1830000000000001,"15min":1.266},"last":0.65200000000000002}]},{"osd":7,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.873,"15min":0.84499999999999997},"min":{"1min":0.64800000000000002,"5min":0.56799999999999995,"15min":0.55900000000000005},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.871,"15min":0.84999999999999998},"min":{"1min":0.69099999999999995,"5min":0.61599999999999999,"15min":0.56000000000000005},"max":{"1min":1.2709999999999999,"5min":1.351,"15min":1.371},"last":0.61199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575291,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41340,"kb_used_data":2100,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330500,"statfs":{"total":96636764160,"available":96594432000,"internally_reserved":0,"allocated":2150400,"data_stored":1101076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46000000000000002,"15min":0.45500000000000002},"min":{"1min":0.33100000000000002,"5min":0.316,"15min":0.28100000000000003},"max":{"1min":0.70899999999999996,"5min":0.753,"15min":0.81599999999999995},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.52500000000000002},"min":{"1min":0.41799999999999998,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":0.68500000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.45000000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.46899999999999997,"15min":0.47199999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.30499999999999999},"max":{"1min":0.59999999999999998,"5min":0.63600000000000001,"15min":0.70799999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.39700000000000002,"5min":0.378,"15min":0.32800000000000001},"max":{"1min":0.747,"5min":0.79900000000000004,"15min":0.89200000000000002},"last":0.51100000000000001}]},{"osd":3,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66500000000000004,"15min":0.65900000000000003},"min":{"1min":0.51100000000000001,"5min":0.47099999999999997,"15min":0.42299999999999999},"max":{"1min":0.90200000000000002,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.36399999999999999,"5min":0.34300000000000003,"15min":0.32300000000000001},"max":{"1min":0.86899999999999999,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.53300000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.79500000000000004,"15min":0.80800000000000005},"min":{"1min":0.61599999999999999,"5min":0.56699999999999995,"15min":0.52200000000000002},"max":{"1min":1.091,"5min":1.155,"15min":1.2470000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.81899999999999995,"15min":0.82799999999999996},"min":{"1min":0.63600000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.0309999999999999,"5min":1.151,"15min":1.171},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.64000000000000001,"5min":0.56299999999999994,"15min":0.54500000000000004},"max":{"1min":1.0469999999999999,"5min":1.224,"15min":1.224},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.81399999999999995,"15min":0.83099999999999996},"min":{"1min":0.66100000000000003,"5min":0.57299999999999995,"15min":0.56100000000000005},"max":{"1min":1.1240000000000001,"5min":1.1259999999999999,"15min":1.375},"last":0.84399999999999997}]},{"osd":6,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.66900000000000004,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.036,"5min":1.1759999999999999,"15min":1.2},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.84299999999999997,"15min":0.85399999999999998},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.56399999999999995},"max":{"1min":1.0589999999999999,"5min":1.169,"15min":1.329},"last":0.745}]},{"osd":7,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.79500000000000004,"15min":0.81899999999999995},"min":{"1min":0.59699999999999998,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.0609999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.86899999999999999,"15min":0.875},"min":{"1min":0.71799999999999997,"5min":0.59999999999999998,"15min":0.58899999999999997},"max":{"1min":1.0389999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.89800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575292,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41936,"kb_used_data":2696,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329904,"statfs":{"total":96636764160,"available":96593821696,"internally_reserved":0,"allocated":2760704,"data_stored":1692625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.33500000000000002,"5min":0.30499999999999999,"15min":0.29899999999999999},"max":{"1min":0.69399999999999995,"5min":0.77100000000000002,"15min":0.85299999999999998},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39900000000000002,"5min":0.36799999999999999,"15min":0.308},"max":{"1min":0.73099999999999998,"5min":0.76800000000000002,"15min":0.80700000000000005},"last":0.39700000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53200000000000003,"15min":0.53600000000000003},"min":{"1min":0.42599999999999999,"5min":0.35699999999999998,"15min":0.33700000000000002},"max":{"1min":0.63500000000000001,"5min":0.72499999999999998,"15min":1.002},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77700000000000002,"5min":0.84099999999999997,"15min":0.91200000000000003},"last":0.37}]},{"osd":3,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52900000000000003,"15min":0.53200000000000003},"min":{"1min":0.38400000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75700000000000001,"5min":0.77000000000000002,"15min":0.83299999999999996},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.47499999999999998,"5min":0.44400000000000001,"15min":0.38800000000000001},"max":{"1min":0.75900000000000001,"5min":0.77200000000000002,"15min":0.871},"last":0.40999999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.83599999999999997,"15min":0.83099999999999996},"min":{"1min":0.60699999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.157,"5min":1.274,"15min":1.284},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.85299999999999998,"15min":0.83699999999999997},"min":{"1min":0.63,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.034,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.82599999999999996,"15min":0.83999999999999997},"min":{"1min":0.59799999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0800000000000001,"5min":1.28,"15min":1.294},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.86699999999999999,"15min":0.85799999999999998},"min":{"1min":0.66200000000000003,"5min":0.58399999999999996,"15min":0.52400000000000002},"max":{"1min":1.0189999999999999,"5min":1.472,"15min":1.472},"last":0.61299999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.84099999999999997,"15min":0.84299999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.96999999999999997,"5min":1.639,"15min":1.639},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.88100000000000001,"15min":0.86399999999999999},"min":{"1min":0.65900000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.044,"5min":1.544,"15min":1.544},"last":0.53300000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.85299999999999998,"15min":0.86199999999999999},"min":{"1min":0.67300000000000004,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1259999999999999,"5min":1.236,"15min":1.3280000000000001},"last":0.63},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.877,"15min":0.86299999999999999},"min":{"1min":0.63100000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.103,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.65300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:29:51.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3f is not active+clean 2023-07-14T13:29:51.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:29:45.141888+0000', 'last_change': '2023-07-14T13:29:45.141888+0000', 'last_active': '2023-07-14T13:29:45.141888+0000', 'last_peered': '2023-07-14T13:29:45.141888+0000', 'last_clean': '2023-07-14T13:29:45.141888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:45.141888+0000', 'last_undegraded': '2023-07-14T13:29:45.141888+0000', 'last_fullsized': '2023-07-14T13:29:45.141888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:29:51.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3c is not active+clean 2023-07-14T13:29:51.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:29:45.141888+0000', 'last_change': '2023-07-14T13:29:45.141888+0000', 'last_active': '2023-07-14T13:29:45.141888+0000', 'last_peered': '2023-07-14T13:29:45.141888+0000', 'last_clean': '2023-07-14T13:29:45.141888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:45.141888+0000', 'last_undegraded': '2023-07-14T13:29:45.141888+0000', 'last_fullsized': '2023-07-14T13:29:45.141888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:29:51.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.39 is not active+clean 2023-07-14T13:29:51.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:29:45.141888+0000', 'last_change': '2023-07-14T13:29:45.141888+0000', 'last_active': '2023-07-14T13:29:45.141888+0000', 'last_peered': '2023-07-14T13:29:45.141888+0000', 'last_clean': '2023-07-14T13:29:45.141888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:45.141888+0000', 'last_undegraded': '2023-07-14T13:29:45.141888+0000', 'last_fullsized': '2023-07-14T13:29:45.141888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:29:51.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.34 is not active+clean 2023-07-14T13:29:51.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:29:45.141888+0000', 'last_change': '2023-07-14T13:29:45.141888+0000', 'last_active': '2023-07-14T13:29:45.141888+0000', 'last_peered': '2023-07-14T13:29:45.141888+0000', 'last_clean': '2023-07-14T13:29:45.141888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:45.141888+0000', 'last_undegraded': '2023-07-14T13:29:45.141888+0000', 'last_fullsized': '2023-07-14T13:29:45.141888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:29:51.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.32 is not active+clean 2023-07-14T13:29:51.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:29:45.141888+0000', 'last_change': '2023-07-14T13:29:45.141888+0000', 'last_active': '2023-07-14T13:29:45.141888+0000', 'last_peered': '2023-07-14T13:29:45.141888+0000', 'last_clean': '2023-07-14T13:29:45.141888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:45.141888+0000', 'last_undegraded': '2023-07-14T13:29:45.141888+0000', 'last_fullsized': '2023-07-14T13:29:45.141888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:29:51.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2f is not active+clean 2023-07-14T13:29:51.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:29:45.141888+0000', 'last_change': '2023-07-14T13:29:45.141888+0000', 'last_active': '2023-07-14T13:29:45.141888+0000', 'last_peered': '2023-07-14T13:29:45.141888+0000', 'last_clean': '2023-07-14T13:29:45.141888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:45.141888+0000', 'last_undegraded': '2023-07-14T13:29:45.141888+0000', 'last_fullsized': '2023-07-14T13:29:45.141888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:29:51.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2d is not active+clean 2023-07-14T13:29:51.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:29:45.141888+0000', 'last_change': '2023-07-14T13:29:45.141888+0000', 'last_active': '2023-07-14T13:29:45.141888+0000', 'last_peered': '2023-07-14T13:29:45.141888+0000', 'last_clean': '2023-07-14T13:29:45.141888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:45.141888+0000', 'last_undegraded': '2023-07-14T13:29:45.141888+0000', 'last_fullsized': '2023-07-14T13:29:45.141888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:29:51.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2a is not active+clean 2023-07-14T13:29:51.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:29:45.141888+0000', 'last_change': '2023-07-14T13:29:45.141888+0000', 'last_active': '2023-07-14T13:29:45.141888+0000', 'last_peered': '2023-07-14T13:29:45.141888+0000', 'last_clean': '2023-07-14T13:29:45.141888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:45.141888+0000', 'last_undegraded': '2023-07-14T13:29:45.141888+0000', 'last_fullsized': '2023-07-14T13:29:45.141888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:29:51.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.27 is not active+clean 2023-07-14T13:29:51.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:29:45.141888+0000', 'last_change': '2023-07-14T13:29:45.141888+0000', 'last_active': '2023-07-14T13:29:45.141888+0000', 'last_peered': '2023-07-14T13:29:45.141888+0000', 'last_clean': '2023-07-14T13:29:45.141888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:45.141888+0000', 'last_undegraded': '2023-07-14T13:29:45.141888+0000', 'last_fullsized': '2023-07-14T13:29:45.141888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:29:51.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.26 is not active+clean 2023-07-14T13:29:51.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:29:45.141888+0000', 'last_change': '2023-07-14T13:29:45.141888+0000', 'last_active': '2023-07-14T13:29:45.141888+0000', 'last_peered': '2023-07-14T13:29:45.141888+0000', 'last_clean': '2023-07-14T13:29:45.141888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:45.141888+0000', 'last_undegraded': '2023-07-14T13:29:45.141888+0000', 'last_fullsized': '2023-07-14T13:29:45.141888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:29:51.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1e is not active+clean 2023-07-14T13:29:51.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:29:44.155482+0000', 'last_change': '2023-07-14T13:29:44.155482+0000', 'last_active': '2023-07-14T13:29:44.133361+0000', 'last_peered': '2023-07-14T13:29:44.133361+0000', 'last_clean': '2023-07-14T13:29:44.133361+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:44.155482+0000', 'last_undegraded': '2023-07-14T13:29:44.155482+0000', 'last_fullsized': '2023-07-14T13:29:44.155482+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:29:51.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1d is not active+clean 2023-07-14T13:29:51.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:29:44.153856+0000', 'last_change': '2023-07-14T13:29:44.153856+0000', 'last_active': '2023-07-14T13:29:44.133361+0000', 'last_peered': '2023-07-14T13:29:44.133361+0000', 'last_clean': '2023-07-14T13:29:44.133361+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:44.153856+0000', 'last_undegraded': '2023-07-14T13:29:44.153856+0000', 'last_fullsized': '2023-07-14T13:29:44.153856+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:29:51.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1f is not active+clean 2023-07-14T13:29:51.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:29:45.141888+0000', 'last_change': '2023-07-14T13:29:45.141888+0000', 'last_active': '2023-07-14T13:29:45.141888+0000', 'last_peered': '2023-07-14T13:29:45.141888+0000', 'last_clean': '2023-07-14T13:29:45.141888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:45.141888+0000', 'last_undegraded': '2023-07-14T13:29:45.141888+0000', 'last_fullsized': '2023-07-14T13:29:45.141888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:29:51.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.19 is not active+clean 2023-07-14T13:29:51.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:29:45.141888+0000', 'last_change': '2023-07-14T13:29:45.141888+0000', 'last_active': '2023-07-14T13:29:45.141888+0000', 'last_peered': '2023-07-14T13:29:45.141888+0000', 'last_clean': '2023-07-14T13:29:45.141888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:45.141888+0000', 'last_undegraded': '2023-07-14T13:29:45.141888+0000', 'last_fullsized': '2023-07-14T13:29:45.141888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:29:51.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.19 is not active+clean 2023-07-14T13:29:51.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:29:44.151443+0000', 'last_change': '2023-07-14T13:29:44.151443+0000', 'last_active': '2023-07-14T13:29:44.133361+0000', 'last_peered': '2023-07-14T13:29:44.133361+0000', 'last_clean': '2023-07-14T13:29:44.133361+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:44.151443+0000', 'last_undegraded': '2023-07-14T13:29:44.151443+0000', 'last_fullsized': '2023-07-14T13:29:44.151443+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:29:51.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1b is not active+clean 2023-07-14T13:29:51.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:29:45.141888+0000', 'last_change': '2023-07-14T13:29:45.141888+0000', 'last_active': '2023-07-14T13:29:45.141888+0000', 'last_peered': '2023-07-14T13:29:45.141888+0000', 'last_clean': '2023-07-14T13:29:45.141888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:45.141888+0000', 'last_undegraded': '2023-07-14T13:29:45.141888+0000', 'last_fullsized': '2023-07-14T13:29:45.141888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:29:51.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.c is not active+clean 2023-07-14T13:29:51.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:29:45.141888+0000', 'last_change': '2023-07-14T13:29:45.141888+0000', 'last_active': '2023-07-14T13:29:45.141888+0000', 'last_peered': '2023-07-14T13:29:45.141888+0000', 'last_clean': '2023-07-14T13:29:45.141888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:45.141888+0000', 'last_undegraded': '2023-07-14T13:29:45.141888+0000', 'last_fullsized': '2023-07-14T13:29:45.141888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:29:51.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.d is not active+clean 2023-07-14T13:29:51.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:29:45.141888+0000', 'last_change': '2023-07-14T13:29:45.141888+0000', 'last_active': '2023-07-14T13:29:45.141888+0000', 'last_peered': '2023-07-14T13:29:45.141888+0000', 'last_clean': '2023-07-14T13:29:45.141888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:45.141888+0000', 'last_undegraded': '2023-07-14T13:29:45.141888+0000', 'last_fullsized': '2023-07-14T13:29:45.141888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:29:51.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.e is not active+clean 2023-07-14T13:29:51.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:29:44.153918+0000', 'last_change': '2023-07-14T13:29:44.153918+0000', 'last_active': '2023-07-14T13:29:44.133361+0000', 'last_peered': '2023-07-14T13:29:44.133361+0000', 'last_clean': '2023-07-14T13:29:44.133361+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:44.153918+0000', 'last_undegraded': '2023-07-14T13:29:44.153918+0000', 'last_fullsized': '2023-07-14T13:29:44.153918+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:29:51.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.e is not active+clean 2023-07-14T13:29:51.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:29:45.141888+0000', 'last_change': '2023-07-14T13:29:45.141888+0000', 'last_active': '2023-07-14T13:29:45.141888+0000', 'last_peered': '2023-07-14T13:29:45.141888+0000', 'last_clean': '2023-07-14T13:29:45.141888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:45.141888+0000', 'last_undegraded': '2023-07-14T13:29:45.141888+0000', 'last_fullsized': '2023-07-14T13:29:45.141888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:29:51.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.f is not active+clean 2023-07-14T13:29:51.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:29:45.141888+0000', 'last_change': '2023-07-14T13:29:45.141888+0000', 'last_active': '2023-07-14T13:29:45.141888+0000', 'last_peered': '2023-07-14T13:29:45.141888+0000', 'last_clean': '2023-07-14T13:29:45.141888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:45.141888+0000', 'last_undegraded': '2023-07-14T13:29:45.141888+0000', 'last_fullsized': '2023-07-14T13:29:45.141888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:29:51.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.c is not active+clean 2023-07-14T13:29:51.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:29:44.150865+0000', 'last_change': '2023-07-14T13:29:44.150865+0000', 'last_active': '2023-07-14T13:29:44.133361+0000', 'last_peered': '2023-07-14T13:29:44.133361+0000', 'last_clean': '2023-07-14T13:29:44.133361+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:44.150865+0000', 'last_undegraded': '2023-07-14T13:29:44.150865+0000', 'last_fullsized': '2023-07-14T13:29:44.150865+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:29:51.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.8 is not active+clean 2023-07-14T13:29:51.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:29:45.141888+0000', 'last_change': '2023-07-14T13:29:45.141888+0000', 'last_active': '2023-07-14T13:29:45.141888+0000', 'last_peered': '2023-07-14T13:29:45.141888+0000', 'last_clean': '2023-07-14T13:29:45.141888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:45.141888+0000', 'last_undegraded': '2023-07-14T13:29:45.141888+0000', 'last_fullsized': '2023-07-14T13:29:45.141888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:29:51.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.a is not active+clean 2023-07-14T13:29:51.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:29:45.141888+0000', 'last_change': '2023-07-14T13:29:45.141888+0000', 'last_active': '2023-07-14T13:29:45.141888+0000', 'last_peered': '2023-07-14T13:29:45.141888+0000', 'last_clean': '2023-07-14T13:29:45.141888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:45.141888+0000', 'last_undegraded': '2023-07-14T13:29:45.141888+0000', 'last_fullsized': '2023-07-14T13:29:45.141888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:29:51.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.7 is not active+clean 2023-07-14T13:29:51.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:29:44.150656+0000', 'last_change': '2023-07-14T13:29:44.150656+0000', 'last_active': '2023-07-14T13:29:44.133361+0000', 'last_peered': '2023-07-14T13:29:44.133361+0000', 'last_clean': '2023-07-14T13:29:44.133361+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:44.150656+0000', 'last_undegraded': '2023-07-14T13:29:44.150656+0000', 'last_fullsized': '2023-07-14T13:29:44.150656+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:29:51.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.5 is not active+clean 2023-07-14T13:29:51.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:29:45.141888+0000', 'last_change': '2023-07-14T13:29:45.141888+0000', 'last_active': '2023-07-14T13:29:45.141888+0000', 'last_peered': '2023-07-14T13:29:45.141888+0000', 'last_clean': '2023-07-14T13:29:45.141888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:45.141888+0000', 'last_undegraded': '2023-07-14T13:29:45.141888+0000', 'last_fullsized': '2023-07-14T13:29:45.141888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:29:51.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.6 is not active+clean 2023-07-14T13:29:51.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:29:44.150513+0000', 'last_change': '2023-07-14T13:29:44.150513+0000', 'last_active': '2023-07-14T13:29:44.133361+0000', 'last_peered': '2023-07-14T13:29:44.133361+0000', 'last_clean': '2023-07-14T13:29:44.133361+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:44.150513+0000', 'last_undegraded': '2023-07-14T13:29:44.150513+0000', 'last_fullsized': '2023-07-14T13:29:44.150513+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:29:51.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.6 is not active+clean 2023-07-14T13:29:51.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:29:45.141888+0000', 'last_change': '2023-07-14T13:29:45.141888+0000', 'last_active': '2023-07-14T13:29:45.141888+0000', 'last_peered': '2023-07-14T13:29:45.141888+0000', 'last_clean': '2023-07-14T13:29:45.141888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:45.141888+0000', 'last_undegraded': '2023-07-14T13:29:45.141888+0000', 'last_fullsized': '2023-07-14T13:29:45.141888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:29:51.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3 is not active+clean 2023-07-14T13:29:51.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:29:44.150533+0000', 'last_change': '2023-07-14T13:29:44.150533+0000', 'last_active': '2023-07-14T13:29:44.133361+0000', 'last_peered': '2023-07-14T13:29:44.133361+0000', 'last_clean': '2023-07-14T13:29:44.133361+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:44.150533+0000', 'last_undegraded': '2023-07-14T13:29:44.150533+0000', 'last_fullsized': '2023-07-14T13:29:44.150533+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:29:51.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1 is not active+clean 2023-07-14T13:29:51.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-14T13:29:45.141888+0000', 'last_change': '2023-07-14T13:29:45.141888+0000', 'last_active': '2023-07-14T13:29:45.141888+0000', 'last_peered': '2023-07-14T13:29:45.141888+0000', 'last_clean': '2023-07-14T13:29:45.141888+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:45.141888+0000', 'last_undegraded': '2023-07-14T13:29:45.141888+0000', 'last_fullsized': '2023-07-14T13:29:45.141888+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:45.141888+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-14T13:29:51.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1 is not active+clean 2023-07-14T13:29:51.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:29:44.150538+0000', 'last_change': '2023-07-14T13:29:44.150538+0000', 'last_active': '2023-07-14T13:29:44.133361+0000', 'last_peered': '2023-07-14T13:29:44.133361+0000', 'last_clean': '2023-07-14T13:29:44.133361+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:44.150538+0000', 'last_undegraded': '2023-07-14T13:29:44.150538+0000', 'last_fullsized': '2023-07-14T13:29:44.150538+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:29:51.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.0 is not active+clean 2023-07-14T13:29:51.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:29:44.153884+0000', 'last_change': '2023-07-14T13:29:44.153884+0000', 'last_active': '2023-07-14T13:29:44.133361+0000', 'last_peered': '2023-07-14T13:29:44.133361+0000', 'last_clean': '2023-07-14T13:29:44.133361+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:44.153884+0000', 'last_undegraded': '2023-07-14T13:29:44.153884+0000', 'last_fullsized': '2023-07-14T13:29:44.153884+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:29:51.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.17 is not active+clean 2023-07-14T13:29:51.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:29:44.154151+0000', 'last_change': '2023-07-14T13:29:44.154151+0000', 'last_active': '2023-07-14T13:29:44.133361+0000', 'last_peered': '2023-07-14T13:29:44.133361+0000', 'last_clean': '2023-07-14T13:29:44.133361+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:44.154151+0000', 'last_undegraded': '2023-07-14T13:29:44.154151+0000', 'last_fullsized': '2023-07-14T13:29:44.154151+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-14T13:29:51.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.16 is not active+clean 2023-07-14T13:29:51.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:29:44.151080+0000', 'last_change': '2023-07-14T13:29:44.151080+0000', 'last_active': '2023-07-14T13:29:44.133361+0000', 'last_peered': '2023-07-14T13:29:44.133361+0000', 'last_clean': '2023-07-14T13:29:44.133361+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:44.151080+0000', 'last_undegraded': '2023-07-14T13:29:44.151080+0000', 'last_fullsized': '2023-07-14T13:29:44.151080+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:29:51.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.12 is not active+clean 2023-07-14T13:29:51.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:29:44.150838+0000', 'last_change': '2023-07-14T13:29:44.150838+0000', 'last_active': '2023-07-14T13:29:44.133361+0000', 'last_peered': '2023-07-14T13:29:44.133361+0000', 'last_clean': '2023-07-14T13:29:44.133361+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:44.150838+0000', 'last_undegraded': '2023-07-14T13:29:44.150838+0000', 'last_fullsized': '2023-07-14T13:29:44.150838+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:29:51.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.11 is not active+clean 2023-07-14T13:29:51.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:29:44.150512+0000', 'last_change': '2023-07-14T13:29:44.150512+0000', 'last_active': '2023-07-14T13:29:44.133361+0000', 'last_peered': '2023-07-14T13:29:44.133361+0000', 'last_clean': '2023-07-14T13:29:44.133361+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:44.150512+0000', 'last_undegraded': '2023-07-14T13:29:44.150512+0000', 'last_fullsized': '2023-07-14T13:29:44.150512+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-14T13:29:51.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.10 is not active+clean 2023-07-14T13:29:51.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-14T13:29:44.151752+0000', 'last_change': '2023-07-14T13:29:44.151752+0000', 'last_active': '2023-07-14T13:29:44.133361+0000', 'last_peered': '2023-07-14T13:29:44.133361+0000', 'last_clean': '2023-07-14T13:29:44.133361+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-14T13:29:44.151752+0000', 'last_undegraded': '2023-07-14T13:29:44.151752+0000', 'last_fullsized': '2023-07-14T13:29:44.151752+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'last_clean_scrub_stamp': '2023-07-14T13:29:44.133361+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-14T13:29:51.101 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-14T13:29:51.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.247+0000 7f6af84d8640 1 Processor -- start 2023-07-14T13:29:51.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.247+0000 7f6af84d8640 1 -- start start 2023-07-14T13:29:51.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.251+0000 7f6af84d8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6af006c430 0x7f6af00b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:51.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.251+0000 7f6af84d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6af006e160 0x7f6af0069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:51.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.251+0000 7f6af84d8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af00b24f0 con 0x7f6af00ae1f0 2023-07-14T13:29:51.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.251+0000 7f6af84d8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6af00b27d0 con 0x7f6af006c430 2023-07-14T13:29:51.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.251+0000 7f6af84d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af00b2ab0 con 0x7f6af006e160 2023-07-14T13:29:51.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.251+0000 7f6af5a73640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6af006c430 0x7f6af00b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:51.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.251+0000 7f6af5a73640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6af006c430 0x7f6af00b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52578/0 (socket says 172.21.15.5:52578) 2023-07-14T13:29:51.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.251+0000 7f6af5a73640 1 -- 172.21.15.5:0/1782793601 learned_addr learned my addr 172.21.15.5:0/1782793601 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:51.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.251+0000 7f6af6a75640 1 --2- 172.21.15.5:0/1782793601 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6af006e160 0x7f6af0069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:51.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.251+0000 7f6af5a73640 1 -- 172.21.15.5:0/1782793601 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6af006e160 msgr2=0x7f6af0069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:51.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.251+0000 7f6af5a73640 1 --2- 172.21.15.5:0/1782793601 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6af006e160 0x7f6af0069430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:51.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.251+0000 7f6af5a73640 1 -- 172.21.15.5:0/1782793601 >> v1:172.21.15.154:6789/0 conn(0x7f6af00ae1f0 legacy=0x7f6af006bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:51.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.251+0000 7f6af5a73640 1 -- 172.21.15.5:0/1782793601 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af00b2d90 con 0x7f6af006c430 2023-07-14T13:29:51.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.251+0000 7f6af5a73640 1 --2- 172.21.15.5:0/1782793601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6af006c430 0x7f6af00b1e60 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0009870 tx=0x7f6ae001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c423f4e018b6c26e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.251+0000 7f6af5272640 1 -- 172.21.15.5:0/1782793601 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae00a95f0 con 0x7f6af006c430 2023-07-14T13:29:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.255+0000 7f6af5272640 1 -- 172.21.15.5:0/1782793601 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae00a9750 con 0x7f6af006c430 2023-07-14T13:29:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.255+0000 7f6af5272640 1 -- 172.21.15.5:0/1782793601 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae00a9ae0 con 0x7f6af006c430 2023-07-14T13:29:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.255+0000 7f6af84d8640 1 -- 172.21.15.5:0/1782793601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6af006c430 msgr2=0x7f6af00b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:51.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.255+0000 7f6af84d8640 1 --2- 172.21.15.5:0/1782793601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6af006c430 0x7f6af00b1e60 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0009870 tx=0x7f6ae001c510 comp rx=0 tx=0).stop 2023-07-14T13:29:51.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.255+0000 7f6af84d8640 1 -- 172.21.15.5:0/1782793601 shutdown_connections 2023-07-14T13:29:51.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.255+0000 7f6af84d8640 1 --2- 172.21.15.5:0/1782793601 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6af006e160 0x7f6af0069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:51.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.255+0000 7f6af84d8640 1 --2- 172.21.15.5:0/1782793601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6af006c430 0x7f6af00b1e60 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:51.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.255+0000 7f6af84d8640 1 -- 172.21.15.5:0/1782793601 >> 172.21.15.5:0/1782793601 conn(0x7f6af00b1300 msgr2=0x7f6af00ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:51.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.255+0000 7f6af84d8640 1 -- 172.21.15.5:0/1782793601 shutdown_connections 2023-07-14T13:29:51.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.255+0000 7f6af84d8640 1 -- 172.21.15.5:0/1782793601 wait complete. 2023-07-14T13:29:51.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.255+0000 7f6af84d8640 1 Processor -- start 2023-07-14T13:29:51.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.255+0000 7f6af84d8640 1 -- start start 2023-07-14T13:29:51.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.255+0000 7f6af84d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6af006c430 0x7f6af00cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:51.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.255+0000 7f6af84d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6af006e160 0x7f6af013e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:51.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.255+0000 7f6af84d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6af00ae1f0 0x7f6af00cd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:51.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.255+0000 7f6af84d8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af00cc630 con 0x7f6af00ae1f0 2023-07-14T13:29:51.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.255+0000 7f6af84d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af00cba20 con 0x7f6af006c430 2023-07-14T13:29:51.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.255+0000 7f6af84d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af00cbd00 con 0x7f6af006e160 2023-07-14T13:29:51.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.255+0000 7f6af6a75640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6af00ae1f0 0x7f6af00cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:51.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.255+0000 7f6af6a75640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6af00ae1f0 0x7f6af00cd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52594/0 (socket says 172.21.15.5:52594) 2023-07-14T13:29:51.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.255+0000 7f6af6a75640 1 -- 172.21.15.5:0/1321408144 learned_addr learned my addr 172.21.15.5:0/1321408144 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:51.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.255+0000 7f6af6274640 1 --2- 172.21.15.5:0/1321408144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6af006c430 0x7f6af00cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:51.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.255+0000 7f6af5a73640 1 --2- 172.21.15.5:0/1321408144 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6af006e160 0x7f6af013e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:51.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.259+0000 7f6af6a75640 1 -- 172.21.15.5:0/1321408144 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6af006e160 msgr2=0x7f6af013e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:51.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.259+0000 7f6af6a75640 1 --2- 172.21.15.5:0/1321408144 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6af006e160 0x7f6af013e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:51.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.259+0000 7f6af6a75640 1 -- 172.21.15.5:0/1321408144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6af006c430 msgr2=0x7f6af00cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:51.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.259+0000 7f6af6a75640 1 --2- 172.21.15.5:0/1321408144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6af006c430 0x7f6af00cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:51.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.259+0000 7f6af6a75640 1 -- 172.21.15.5:0/1321408144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae00094d0 con 0x7f6af00ae1f0 2023-07-14T13:29:51.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.259+0000 7f6af6a75640 1 --2- 172.21.15.5:0/1321408144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6af00ae1f0 0x7f6af00cd900 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8007e40 tx=0x7f6ae800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:51.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.259+0000 7f6ae6ffd640 1 -- 172.21.15.5:0/1321408144 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8014620 con 0x7f6af00ae1f0 2023-07-14T13:29:51.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.259+0000 7f6ae6ffd640 1 -- 172.21.15.5:0/1321408144 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae800ee90 con 0x7f6af00ae1f0 2023-07-14T13:29:51.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.259+0000 7f6ae6ffd640 1 -- 172.21.15.5:0/1321408144 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae80149e0 con 0x7f6af00ae1f0 2023-07-14T13:29:51.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.259+0000 7f6af84d8640 1 -- 172.21.15.5:0/1321408144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af00b3710 con 0x7f6af00ae1f0 2023-07-14T13:29:51.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.259+0000 7f6af84d8640 1 -- 172.21.15.5:0/1321408144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af00cc2c0 con 0x7f6af00ae1f0 2023-07-14T13:29:51.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.259+0000 7f6af84d8640 1 -- 172.21.15.5:0/1321408144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6af00cc7a0 con 0x7f6af00ae1f0 2023-07-14T13:29:51.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.259+0000 7f6ae6ffd640 1 -- 172.21.15.5:0/1321408144 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6ae8014b40 con 0x7f6af00ae1f0 2023-07-14T13:29:51.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.263+0000 7f6ae6ffd640 1 --2- 172.21.15.5:0/1321408144 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f6ad40663a0 0x7f6ad4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:51.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.263+0000 7f6ae6ffd640 1 -- 172.21.15.5:0/1321408144 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f6ae80847a0 con 0x7f6af00ae1f0 2023-07-14T13:29:51.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.263+0000 7f6af6274640 1 --2- 172.21.15.5:0/1321408144 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f6ad40663a0 0x7f6ad4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:51.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.263+0000 7f6af6274640 1 --2- 172.21.15.5:0/1321408144 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f6ad40663a0 0x7f6ad4068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6aec007fd0 tx=0x7f6aec009040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:51.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.267+0000 7f6ae6ffd640 1 -- 172.21.15.5:0/1321408144 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6ae8051b00 con 0x7f6af00ae1f0 2023-07-14T13:29:51.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.475+0000 7f6af84d8640 1 -- 172.21.15.5:0/1321408144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f6af00678d0 con 0x7f6af00ae1f0 2023-07-14T13:29:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.475+0000 7f6ae6ffd640 1 -- 172.21.15.5:0/1321408144 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3374 (secure 0 0 0) 0x7f6ae8055120 con 0x7f6af00ae1f0 2023-07-14T13:29:51.478 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:29:51.478 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":2250,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":172,"num_osds":8,"num_up_osds":8,"osd_up_since":1689339152,"num_in_osds":8,"osd_in_since":1689339143,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":68},{"state_name":"unknown","count":22},{"state_name":"creating+peering","count":15}],"num_pgs":105,"num_pools":4,"num_objects":16,"data_bytes":592730,"bytes_used":374222848,"bytes_avail":772719890432,"bytes_total":773094113280,"unknown_pgs_ratio":0.20952381193637848,"inactive_pgs_ratio":0.1428571492433548,"write_bytes_sec":2424,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":83,"id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9966}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2023-07-14T13:29:28.053978+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-14T13:29:51.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.475+0000 7f6af84d8640 1 -- 172.21.15.5:0/1321408144 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f6ad40663a0 msgr2=0x7f6ad4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.475+0000 7f6af84d8640 1 --2- 172.21.15.5:0/1321408144 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f6ad40663a0 0x7f6ad4068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6aec007fd0 tx=0x7f6aec009040 comp rx=0 tx=0).stop 2023-07-14T13:29:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.475+0000 7f6af84d8640 1 -- 172.21.15.5:0/1321408144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6af00ae1f0 msgr2=0x7f6af00cd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.475+0000 7f6af84d8640 1 --2- 172.21.15.5:0/1321408144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6af00ae1f0 0x7f6af00cd900 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8007e40 tx=0x7f6ae800e4b0 comp rx=0 tx=0).stop 2023-07-14T13:29:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.475+0000 7f6af84d8640 1 -- 172.21.15.5:0/1321408144 shutdown_connections 2023-07-14T13:29:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.475+0000 7f6af84d8640 1 --2- 172.21.15.5:0/1321408144 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f6ad40663a0 0x7f6ad4068850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.475+0000 7f6af84d8640 1 --2- 172.21.15.5:0/1321408144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6af00ae1f0 0x7f6af00cd900 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.475+0000 7f6af84d8640 1 --2- 172.21.15.5:0/1321408144 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6af006e160 0x7f6af013e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.475+0000 7f6af84d8640 1 --2- 172.21.15.5:0/1321408144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6af006c430 0x7f6af00cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.475+0000 7f6af84d8640 1 -- 172.21.15.5:0/1321408144 >> 172.21.15.5:0/1321408144 conn(0x7f6af00b1300 msgr2=0x7f6af00ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.479+0000 7f6af84d8640 1 -- 172.21.15.5:0/1321408144 shutdown_connections 2023-07-14T13:29:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.479+0000 7f6af84d8640 1 -- 172.21.15.5:0/1321408144 wait complete. 2023-07-14T13:29:51.499 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-14T13:29:51.500 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:29:51.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.639+0000 7fa839340640 1 Processor -- start 2023-07-14T13:29:51.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.643+0000 7fa839340640 1 -- start start 2023-07-14T13:29:51.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.643+0000 7fa839340640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8340c8ad0 0x7fa8340c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:51.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.643+0000 7fa839340640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8340cc700 con 0x7fa834158ce0 2023-07-14T13:29:51.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.643+0000 7fa839340640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8340b0ff0 con 0x7fa8340c9560 2023-07-14T13:29:51.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.643+0000 7fa839340640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8340c99e0 con 0x7fa8340c8ad0 2023-07-14T13:29:51.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.643+0000 7fa832ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa834158ce0 0x7fa834070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46020/0 (socket says 172.21.15.5:46020) 2023-07-14T13:29:51.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.643+0000 7fa832ffd640 1 -- 172.21.15.5:0/3561600437 learned_addr learned my addr 172.21.15.5:0/3561600437 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:51.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.643+0000 7fa82bfff640 1 --2- 172.21.15.5:0/3561600437 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8340c8ad0 0x7fa8340c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:51.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.643+0000 7fa8327fc640 1 -- 172.21.15.5:0/3561600437 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417309579 0 0) 0x7fa8340cc700 con 0x7fa834158ce0 2023-07-14T13:29:51.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.643+0000 7fa8327fc640 1 -- 172.21.15.5:0/3561600437 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa820003530 con 0x7fa834158ce0 2023-07-14T13:29:51.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.643+0000 7fa8327fc640 1 -- 172.21.15.5:0/3561600437 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2071250095 0 0) 0x7fa8340b0ff0 con 0x7fa8340c9560 2023-07-14T13:29:51.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.643+0000 7fa82bfff640 1 -- 172.21.15.5:0/3561600437 >> v1:172.21.15.154:6789/0 conn(0x7fa8340c9560 legacy=0x7fa8340ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:51.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.643+0000 7fa82bfff640 1 -- 172.21.15.5:0/3561600437 >> v1:172.21.15.5:6789/0 conn(0x7fa834158ce0 legacy=0x7fa834070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:51.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.643+0000 7fa82bfff640 1 -- 172.21.15.5:0/3561600437 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa834070c80 con 0x7fa8340c8ad0 2023-07-14T13:29:51.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.647+0000 7fa82bfff640 1 --2- 172.21.15.5:0/3561600437 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8340c8ad0 0x7fa8340c9020 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0097f0 tx=0x7fa81c01c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52001156bce5e2dc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:51.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.647+0000 7fa8327fc640 1 -- 172.21.15.5:0/3561600437 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c0ab600 con 0x7fa8340c8ad0 2023-07-14T13:29:51.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.647+0000 7fa8327fc640 1 -- 172.21.15.5:0/3561600437 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81c0a7050 con 0x7fa8340c8ad0 2023-07-14T13:29:51.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.647+0000 7fa8327fc640 1 -- 172.21.15.5:0/3561600437 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c0ab980 con 0x7fa8340c8ad0 2023-07-14T13:29:51.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.647+0000 7fa839340640 1 -- 172.21.15.5:0/3561600437 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8340c8ad0 msgr2=0x7fa8340c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:51.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.647+0000 7fa839340640 1 --2- 172.21.15.5:0/3561600437 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8340c8ad0 0x7fa8340c9020 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0097f0 tx=0x7fa81c01c370 comp rx=0 tx=0).stop 2023-07-14T13:29:51.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.647+0000 7fa839340640 1 -- 172.21.15.5:0/3561600437 shutdown_connections 2023-07-14T13:29:51.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.647+0000 7fa839340640 1 --2- 172.21.15.5:0/3561600437 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8340c8ad0 0x7fa8340c9020 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:51.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.647+0000 7fa839340640 1 -- 172.21.15.5:0/3561600437 >> 172.21.15.5:0/3561600437 conn(0x7fa8340afcf0 msgr2=0x7fa8340b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:51.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.647+0000 7fa839340640 1 -- 172.21.15.5:0/3561600437 shutdown_connections 2023-07-14T13:29:51.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.647+0000 7fa839340640 1 -- 172.21.15.5:0/3561600437 wait complete. 2023-07-14T13:29:51.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.647+0000 7fa839340640 1 Processor -- start 2023-07-14T13:29:51.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.651+0000 7fa839340640 1 -- start start 2023-07-14T13:29:51.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.651+0000 7fa839340640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8340c8ad0 0x7fa834147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:51.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.651+0000 7fa839340640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8340c9560 0x7fa8340ac990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:51.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.651+0000 7fa839340640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa834158ce0 0x7fa8341676c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:51.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.651+0000 7fa839340640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83414b310 con 0x7fa8340c9560 2023-07-14T13:29:51.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.651+0000 7fa839340640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8340cb9c0 con 0x7fa8340c8ad0 2023-07-14T13:29:51.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.651+0000 7fa839340640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8341476a0 con 0x7fa834158ce0 2023-07-14T13:29:51.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.651+0000 7fa82bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8340c9560 0x7fa8340ac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:51.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.651+0000 7fa82bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8340c9560 0x7fa8340ac990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52600/0 (socket says 172.21.15.5:52600) 2023-07-14T13:29:51.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.651+0000 7fa82bfff640 1 -- 172.21.15.5:0/945148115 learned_addr learned my addr 172.21.15.5:0/945148115 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:51.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.651+0000 7fa832ffd640 1 --2- 172.21.15.5:0/945148115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8340c8ad0 0x7fa834147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:51.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.651+0000 7fa8337fe640 1 --2- 172.21.15.5:0/945148115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa834158ce0 0x7fa8341676c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:51.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.651+0000 7fa82bfff640 1 -- 172.21.15.5:0/945148115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa834158ce0 msgr2=0x7fa8341676c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:51.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.651+0000 7fa82bfff640 1 --2- 172.21.15.5:0/945148115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa834158ce0 0x7fa8341676c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:51.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.651+0000 7fa82bfff640 1 -- 172.21.15.5:0/945148115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8340c8ad0 msgr2=0x7fa834147160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:51.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.651+0000 7fa82bfff640 1 --2- 172.21.15.5:0/945148115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8340c8ad0 0x7fa834147160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:51.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.651+0000 7fa82bfff640 1 -- 172.21.15.5:0/945148115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c009420 con 0x7fa8340c9560 2023-07-14T13:29:51.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.651+0000 7fa82bfff640 1 --2- 172.21.15.5:0/945148115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8340c9560 0x7fa8340ac990 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0097f0 tx=0x7fa81c019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:51.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.651+0000 7fa82b7fe640 1 -- 172.21.15.5:0/945148115 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c004030 con 0x7fa8340c9560 2023-07-14T13:29:51.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.651+0000 7fa82b7fe640 1 -- 172.21.15.5:0/945148115 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81c004190 con 0x7fa8340c9560 2023-07-14T13:29:51.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.651+0000 7fa82b7fe640 1 -- 172.21.15.5:0/945148115 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c004500 con 0x7fa8340c9560 2023-07-14T13:29:51.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.651+0000 7fa839340640 1 -- 172.21.15.5:0/945148115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8340aced0 con 0x7fa8340c9560 2023-07-14T13:29:51.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.651+0000 7fa839340640 1 -- 172.21.15.5:0/945148115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8340cb6e0 con 0x7fa8340c9560 2023-07-14T13:29:51.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.651+0000 7fa839340640 1 -- 172.21.15.5:0/945148115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8340ca1a0 con 0x7fa8340c9560 2023-07-14T13:29:51.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.655+0000 7fa82b7fe640 1 -- 172.21.15.5:0/945148115 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa81c0b2040 con 0x7fa8340c9560 2023-07-14T13:29:51.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.655+0000 7fa82b7fe640 1 --2- 172.21.15.5:0/945148115 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fa8140663a0 0x7fa814068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:51.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.655+0000 7fa82b7fe640 1 -- 172.21.15.5:0/945148115 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fa81c11dee0 con 0x7fa8340c9560 2023-07-14T13:29:51.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.655+0000 7fa832ffd640 1 --2- 172.21.15.5:0/945148115 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fa8140663a0 0x7fa814068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:51.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.655+0000 7fa832ffd640 1 --2- 172.21.15.5:0/945148115 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fa8140663a0 0x7fa814068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa824007fd0 tx=0x7fa824009040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:51.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.659+0000 7fa82b7fe640 1 -- 172.21.15.5:0/945148115 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa81c0eb130 con 0x7fa8340c9560 2023-07-14T13:29:51.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.811+0000 7fa839340640 1 -- 172.21.15.5:0/945148115 --> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa8341590b0 con 0x7fa8140663a0 2023-07-14T13:29:51.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.819+0000 7fa82b7fe640 1 -- 172.21.15.5:0/945148115 <== mgr.9247 v2:172.21.15.154:6832/1905284593 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+307174 (secure 0 0 0) 0x7fa8240011c0 con 0x7fa8140663a0 2023-07-14T13:29:51.825 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:29:51.827 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:29:51.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.823+0000 7fa839340640 1 -- 172.21.15.5:0/945148115 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fa8140663a0 msgr2=0x7fa814068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:51.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.823+0000 7fa839340640 1 --2- 172.21.15.5:0/945148115 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fa8140663a0 0x7fa814068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa824007fd0 tx=0x7fa824009040 comp rx=0 tx=0).stop 2023-07-14T13:29:51.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.823+0000 7fa839340640 1 -- 172.21.15.5:0/945148115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8340c9560 msgr2=0x7fa8340ac990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:51.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.823+0000 7fa839340640 1 --2- 172.21.15.5:0/945148115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8340c9560 0x7fa8340ac990 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0097f0 tx=0x7fa81c019110 comp rx=0 tx=0).stop 2023-07-14T13:29:51.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.823+0000 7fa839340640 1 -- 172.21.15.5:0/945148115 shutdown_connections 2023-07-14T13:29:51.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.823+0000 7fa839340640 1 --2- 172.21.15.5:0/945148115 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fa8140663a0 0x7fa814068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:51.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.823+0000 7fa839340640 1 --2- 172.21.15.5:0/945148115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa834158ce0 0x7fa8341676c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:51.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.823+0000 7fa839340640 1 --2- 172.21.15.5:0/945148115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8340c9560 0x7fa8340ac990 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:51.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.823+0000 7fa839340640 1 --2- 172.21.15.5:0/945148115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8340c8ad0 0x7fa834147160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:51.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.823+0000 7fa839340640 1 -- 172.21.15.5:0/945148115 >> 172.21.15.5:0/945148115 conn(0x7fa8340afcf0 msgr2=0x7fa8340ab9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:51.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.823+0000 7fa839340640 1 -- 172.21.15.5:0/945148115 shutdown_connections 2023-07-14T13:29:51.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:51.823+0000 7fa839340640 1 -- 172.21.15.5:0/945148115 wait complete. 2023-07-14T13:29:51.844 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-14T13:29:50.058487+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":522,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":327,"ondisk_log_size":327,"up":166,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":365452,"kb_used_data":17868,"kb_used_omap":0,"kb_used_meta":347520,"kb_avail":754609268,"statfs":{"total":773094113280,"available":772719890432,"internally_reserved":0,"allocated":18296832,"data_stored":9929899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":355860480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.912780"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479686+0000","last_change":"2023-07-14T13:29:46.159865+0000","last_active":"2023-07-14T13:29:48.479686+0000","last_peered":"2023-07-14T13:29:48.479686+0000","last_clean":"2023-07-14T13:29:48.479686+0000","last_became_active":"2023-07-14T13:29:46.159410+0000","last_became_peered":"2023-07-14T13:29:46.159410+0000","last_unstale":"2023-07-14T13:29:48.479686+0000","last_undegraded":"2023-07-14T13:29:48.479686+0000","last_fullsized":"2023-07-14T13:29:48.479686+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:01.004278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479590+0000","last_change":"2023-07-14T13:29:46.162495+0000","last_active":"2023-07-14T13:29:48.479590+0000","last_peered":"2023-07-14T13:29:48.479590+0000","last_clean":"2023-07-14T13:29:48.479590+0000","last_became_active":"2023-07-14T13:29:46.162075+0000","last_became_peered":"2023-07-14T13:29:46.162075+0000","last_unstale":"2023-07-14T13:29:48.479590+0000","last_undegraded":"2023-07-14T13:29:48.479590+0000","last_fullsized":"2023-07-14T13:29:48.479590+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:33:26.310832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141616+0000","last_change":"2023-07-14T13:29:46.165214+0000","last_active":"2023-07-14T13:29:47.141616+0000","last_peered":"2023-07-14T13:29:47.141616+0000","last_clean":"2023-07-14T13:29:47.141616+0000","last_became_active":"2023-07-14T13:29:46.164908+0000","last_became_peered":"2023-07-14T13:29:46.164908+0000","last_unstale":"2023-07-14T13:29:47.141616+0000","last_undegraded":"2023-07-14T13:29:47.141616+0000","last_fullsized":"2023-07-14T13:29:47.141616+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:23:47.997179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141388+0000","last_change":"2023-07-14T13:29:46.163840+0000","last_active":"2023-07-14T13:29:47.141388+0000","last_peered":"2023-07-14T13:29:47.141388+0000","last_clean":"2023-07-14T13:29:47.141388+0000","last_became_active":"2023-07-14T13:29:46.163561+0000","last_became_peered":"2023-07-14T13:29:46.163561+0000","last_unstale":"2023-07-14T13:29:47.141388+0000","last_undegraded":"2023-07-14T13:29:47.141388+0000","last_fullsized":"2023-07-14T13:29:47.141388+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:31:33.867324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146119+0000","last_change":"2023-07-14T13:29:46.157415+0000","last_active":"2023-07-14T13:29:47.146119+0000","last_peered":"2023-07-14T13:29:47.146119+0000","last_clean":"2023-07-14T13:29:47.146119+0000","last_became_active":"2023-07-14T13:29:46.156908+0000","last_became_peered":"2023-07-14T13:29:46.156908+0000","last_unstale":"2023-07-14T13:29:47.146119+0000","last_undegraded":"2023-07-14T13:29:47.146119+0000","last_fullsized":"2023-07-14T13:29:47.146119+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:24:50.135616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141617+0000","last_change":"2023-07-14T13:29:46.152971+0000","last_active":"2023-07-14T13:29:47.141617+0000","last_peered":"2023-07-14T13:29:47.141617+0000","last_clean":"2023-07-14T13:29:47.141617+0000","last_became_active":"2023-07-14T13:29:46.152641+0000","last_became_peered":"2023-07-14T13:29:46.152641+0000","last_unstale":"2023-07-14T13:29:47.141617+0000","last_undegraded":"2023-07-14T13:29:47.141617+0000","last_fullsized":"2023-07-14T13:29:47.141617+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:06:17.863530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141851+0000","last_change":"2023-07-14T13:29:46.151471+0000","last_active":"2023-07-14T13:29:47.141851+0000","last_peered":"2023-07-14T13:29:47.141851+0000","last_clean":"2023-07-14T13:29:47.141851+0000","last_became_active":"2023-07-14T13:29:46.150996+0000","last_became_peered":"2023-07-14T13:29:46.150996+0000","last_unstale":"2023-07-14T13:29:47.141851+0000","last_undegraded":"2023-07-14T13:29:47.141851+0000","last_fullsized":"2023-07-14T13:29:47.141851+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:36:46.294425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797696+0000","last_change":"2023-07-14T13:29:46.161038+0000","last_active":"2023-07-14T13:29:48.797696+0000","last_peered":"2023-07-14T13:29:48.797696+0000","last_clean":"2023-07-14T13:29:48.797696+0000","last_became_active":"2023-07-14T13:29:46.160750+0000","last_became_peered":"2023-07-14T13:29:46.160750+0000","last_unstale":"2023-07-14T13:29:48.797696+0000","last_undegraded":"2023-07-14T13:29:48.797696+0000","last_fullsized":"2023-07-14T13:29:48.797696+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:42:08.863141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141480+0000","last_change":"2023-07-14T13:29:46.149699+0000","last_active":"2023-07-14T13:29:47.141480+0000","last_peered":"2023-07-14T13:29:47.141480+0000","last_clean":"2023-07-14T13:29:47.141480+0000","last_became_active":"2023-07-14T13:29:46.149429+0000","last_became_peered":"2023-07-14T13:29:46.149429+0000","last_unstale":"2023-07-14T13:29:47.141480+0000","last_undegraded":"2023-07-14T13:29:47.141480+0000","last_fullsized":"2023-07-14T13:29:47.141480+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:55:39.460034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479340+0000","last_change":"2023-07-14T13:29:46.160166+0000","last_active":"2023-07-14T13:29:48.479340+0000","last_peered":"2023-07-14T13:29:48.479340+0000","last_clean":"2023-07-14T13:29:48.479340+0000","last_became_active":"2023-07-14T13:29:46.159843+0000","last_became_peered":"2023-07-14T13:29:46.159843+0000","last_unstale":"2023-07-14T13:29:48.479340+0000","last_undegraded":"2023-07-14T13:29:48.479340+0000","last_fullsized":"2023-07-14T13:29:48.479340+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:12:09.149124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141216+0000","last_change":"2023-07-14T13:29:46.155517+0000","last_active":"2023-07-14T13:29:47.141216+0000","last_peered":"2023-07-14T13:29:47.141216+0000","last_clean":"2023-07-14T13:29:47.141216+0000","last_became_active":"2023-07-14T13:29:46.155241+0000","last_became_peered":"2023-07-14T13:29:46.155241+0000","last_unstale":"2023-07-14T13:29:47.141216+0000","last_undegraded":"2023-07-14T13:29:47.141216+0000","last_fullsized":"2023-07-14T13:29:47.141216+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:23:00.388761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797786+0000","last_change":"2023-07-14T13:29:46.165903+0000","last_active":"2023-07-14T13:29:48.797786+0000","last_peered":"2023-07-14T13:29:48.797786+0000","last_clean":"2023-07-14T13:29:48.797786+0000","last_became_active":"2023-07-14T13:29:46.165382+0000","last_became_peered":"2023-07-14T13:29:46.165382+0000","last_unstale":"2023-07-14T13:29:48.797786+0000","last_undegraded":"2023-07-14T13:29:48.797786+0000","last_fullsized":"2023-07-14T13:29:48.797786+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:40:22.854519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:49.060361+0000","last_change":"2023-07-14T13:29:46.151003+0000","last_active":"2023-07-14T13:29:49.060361+0000","last_peered":"2023-07-14T13:29:49.060361+0000","last_clean":"2023-07-14T13:29:49.060361+0000","last_became_active":"2023-07-14T13:29:46.150704+0000","last_became_peered":"2023-07-14T13:29:46.150704+0000","last_unstale":"2023-07-14T13:29:49.060361+0000","last_undegraded":"2023-07-14T13:29:49.060361+0000","last_fullsized":"2023-07-14T13:29:49.060361+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:24.768994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141544+0000","last_change":"2023-07-14T13:29:46.153305+0000","last_active":"2023-07-14T13:29:47.141544+0000","last_peered":"2023-07-14T13:29:47.141544+0000","last_clean":"2023-07-14T13:29:47.141544+0000","last_became_active":"2023-07-14T13:29:46.153008+0000","last_became_peered":"2023-07-14T13:29:46.153008+0000","last_unstale":"2023-07-14T13:29:47.141544+0000","last_undegraded":"2023-07-14T13:29:47.141544+0000","last_fullsized":"2023-07-14T13:29:47.141544+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:16:23.727196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146015+0000","last_change":"2023-07-14T13:29:46.168865+0000","last_active":"2023-07-14T13:29:47.146015+0000","last_peered":"2023-07-14T13:29:47.146015+0000","last_clean":"2023-07-14T13:29:47.146015+0000","last_became_active":"2023-07-14T13:29:46.168603+0000","last_became_peered":"2023-07-14T13:29:46.168603+0000","last_unstale":"2023-07-14T13:29:47.146015+0000","last_undegraded":"2023-07-14T13:29:47.146015+0000","last_fullsized":"2023-07-14T13:29:47.146015+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:35:20.966733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797806+0000","last_change":"2023-07-14T13:29:46.155602+0000","last_active":"2023-07-14T13:29:48.797806+0000","last_peered":"2023-07-14T13:29:48.797806+0000","last_clean":"2023-07-14T13:29:48.797806+0000","last_became_active":"2023-07-14T13:29:46.155108+0000","last_became_peered":"2023-07-14T13:29:46.155108+0000","last_unstale":"2023-07-14T13:29:48.797806+0000","last_undegraded":"2023-07-14T13:29:48.797806+0000","last_fullsized":"2023-07-14T13:29:48.797806+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:13.416506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141791+0000","last_change":"2023-07-14T13:29:46.152988+0000","last_active":"2023-07-14T13:29:47.141791+0000","last_peered":"2023-07-14T13:29:47.141791+0000","last_clean":"2023-07-14T13:29:47.141791+0000","last_became_active":"2023-07-14T13:29:46.152697+0000","last_became_peered":"2023-07-14T13:29:46.152697+0000","last_unstale":"2023-07-14T13:29:47.141791+0000","last_undegraded":"2023-07-14T13:29:47.141791+0000","last_fullsized":"2023-07-14T13:29:47.141791+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:46:18.882359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797626+0000","last_change":"2023-07-14T13:29:46.156427+0000","last_active":"2023-07-14T13:29:48.797626+0000","last_peered":"2023-07-14T13:29:48.797626+0000","last_clean":"2023-07-14T13:29:48.797626+0000","last_became_active":"2023-07-14T13:29:46.156073+0000","last_became_peered":"2023-07-14T13:29:46.156073+0000","last_unstale":"2023-07-14T13:29:48.797626+0000","last_undegraded":"2023-07-14T13:29:48.797626+0000","last_fullsized":"2023-07-14T13:29:48.797626+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:22:17.681971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146211+0000","last_change":"2023-07-14T13:29:46.150139+0000","last_active":"2023-07-14T13:29:47.146211+0000","last_peered":"2023-07-14T13:29:47.146211+0000","last_clean":"2023-07-14T13:29:47.146211+0000","last_became_active":"2023-07-14T13:29:46.149853+0000","last_became_peered":"2023-07-14T13:29:46.149853+0000","last_unstale":"2023-07-14T13:29:47.146211+0000","last_undegraded":"2023-07-14T13:29:47.146211+0000","last_fullsized":"2023-07-14T13:29:47.146211+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:58.328252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797616+0000","last_change":"2023-07-14T13:29:46.159106+0000","last_active":"2023-07-14T13:29:48.797616+0000","last_peered":"2023-07-14T13:29:48.797616+0000","last_clean":"2023-07-14T13:29:48.797616+0000","last_became_active":"2023-07-14T13:29:46.158801+0000","last_became_peered":"2023-07-14T13:29:46.158801+0000","last_unstale":"2023-07-14T13:29:48.797616+0000","last_undegraded":"2023-07-14T13:29:48.797616+0000","last_fullsized":"2023-07-14T13:29:48.797616+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:20:40.273751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141222+0000","last_change":"2023-07-14T13:29:46.155534+0000","last_active":"2023-07-14T13:29:47.141222+0000","last_peered":"2023-07-14T13:29:47.141222+0000","last_clean":"2023-07-14T13:29:47.141222+0000","last_became_active":"2023-07-14T13:29:46.155265+0000","last_became_peered":"2023-07-14T13:29:46.155265+0000","last_unstale":"2023-07-14T13:29:47.141222+0000","last_undegraded":"2023-07-14T13:29:47.141222+0000","last_fullsized":"2023-07-14T13:29:47.141222+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:58:07.820454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.145962+0000","last_change":"2023-07-14T13:29:46.159148+0000","last_active":"2023-07-14T13:29:47.145962+0000","last_peered":"2023-07-14T13:29:47.145962+0000","last_clean":"2023-07-14T13:29:47.145962+0000","last_became_active":"2023-07-14T13:29:46.157198+0000","last_became_peered":"2023-07-14T13:29:46.157198+0000","last_unstale":"2023-07-14T13:29:47.145962+0000","last_undegraded":"2023-07-14T13:29:47.145962+0000","last_fullsized":"2023-07-14T13:29:47.145962+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:06:21.860997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479648+0000","last_change":"2023-07-14T13:29:46.162714+0000","last_active":"2023-07-14T13:29:48.479648+0000","last_peered":"2023-07-14T13:29:48.479648+0000","last_clean":"2023-07-14T13:29:48.479648+0000","last_became_active":"2023-07-14T13:29:46.162123+0000","last_became_peered":"2023-07-14T13:29:46.162123+0000","last_unstale":"2023-07-14T13:29:48.479648+0000","last_undegraded":"2023-07-14T13:29:48.479648+0000","last_fullsized":"2023-07-14T13:29:48.479648+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:36.907010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"171'4","reported_seq":17,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141806+0000","last_change":"2023-07-14T13:29:45.169422+0000","last_active":"2023-07-14T13:29:47.141806+0000","last_peered":"2023-07-14T13:29:47.141806+0000","last_clean":"2023-07-14T13:29:47.141806+0000","last_became_active":"2023-07-14T13:29:45.169138+0000","last_became_peered":"2023-07-14T13:29:45.169138+0000","last_unstale":"2023-07-14T13:29:47.141806+0000","last_undegraded":"2023-07-14T13:29:47.141806+0000","last_fullsized":"2023-07-14T13:29:47.141806+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:58:31.107549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479614+0000","last_change":"2023-07-14T13:29:46.160327+0000","last_active":"2023-07-14T13:29:48.479614+0000","last_peered":"2023-07-14T13:29:48.479614+0000","last_clean":"2023-07-14T13:29:48.479614+0000","last_became_active":"2023-07-14T13:29:46.159195+0000","last_became_peered":"2023-07-14T13:29:46.159195+0000","last_unstale":"2023-07-14T13:29:48.479614+0000","last_undegraded":"2023-07-14T13:29:48.479614+0000","last_fullsized":"2023-07-14T13:29:48.479614+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:15:41.664289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.155482+0000","last_change":"2023-07-14T13:29:44.155482+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.155482+0000","last_undegraded":"2023-07-14T13:29:44.155482+0000","last_fullsized":"2023-07-14T13:29:44.155482+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146443+0000","last_change":"2023-07-14T13:29:46.161735+0000","last_active":"2023-07-14T13:29:47.146443+0000","last_peered":"2023-07-14T13:29:47.146443+0000","last_clean":"2023-07-14T13:29:47.146443+0000","last_became_active":"2023-07-14T13:29:46.161340+0000","last_became_peered":"2023-07-14T13:29:46.161340+0000","last_unstale":"2023-07-14T13:29:47.146443+0000","last_undegraded":"2023-07-14T13:29:47.146443+0000","last_fullsized":"2023-07-14T13:29:47.146443+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:45:00.745964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.153856+0000","last_change":"2023-07-14T13:29:44.153856+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.153856+0000","last_undegraded":"2023-07-14T13:29:44.153856+0000","last_fullsized":"2023-07-14T13:29:44.153856+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479548+0000","last_change":"2023-07-14T13:29:45.163603+0000","last_active":"2023-07-14T13:29:48.479548+0000","last_peered":"2023-07-14T13:29:48.479548+0000","last_clean":"2023-07-14T13:29:48.479548+0000","last_became_active":"2023-07-14T13:29:45.163310+0000","last_became_peered":"2023-07-14T13:29:45.163310+0000","last_unstale":"2023-07-14T13:29:48.479548+0000","last_undegraded":"2023-07-14T13:29:48.479548+0000","last_fullsized":"2023-07-14T13:29:48.479548+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:53:27.366678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:49.060181+0000","last_change":"2023-07-14T13:29:46.154089+0000","last_active":"2023-07-14T13:29:49.060181+0000","last_peered":"2023-07-14T13:29:49.060181+0000","last_clean":"2023-07-14T13:29:49.060181+0000","last_became_active":"2023-07-14T13:29:46.153663+0000","last_became_peered":"2023-07-14T13:29:46.153663+0000","last_unstale":"2023-07-14T13:29:49.060181+0000","last_undegraded":"2023-07-14T13:29:49.060181+0000","last_fullsized":"2023-07-14T13:29:49.060181+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:30.137865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146336+0000","last_change":"2023-07-14T13:29:45.177250+0000","last_active":"2023-07-14T13:29:47.146336+0000","last_peered":"2023-07-14T13:29:47.146336+0000","last_clean":"2023-07-14T13:29:47.146336+0000","last_became_active":"2023-07-14T13:29:45.176926+0000","last_became_peered":"2023-07-14T13:29:45.176926+0000","last_unstale":"2023-07-14T13:29:47.146336+0000","last_undegraded":"2023-07-14T13:29:47.146336+0000","last_fullsized":"2023-07-14T13:29:47.146336+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:21:29.147948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141484+0000","last_change":"2023-07-14T13:29:45.173114+0000","last_active":"2023-07-14T13:29:47.141484+0000","last_peered":"2023-07-14T13:29:47.141484+0000","last_clean":"2023-07-14T13:29:47.141484+0000","last_became_active":"2023-07-14T13:29:45.172835+0000","last_became_peered":"2023-07-14T13:29:45.172835+0000","last_unstale":"2023-07-14T13:29:47.141484+0000","last_undegraded":"2023-07-14T13:29:47.141484+0000","last_fullsized":"2023-07-14T13:29:47.141484+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:27:21.083351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479370+0000","last_change":"2023-07-14T13:29:46.154070+0000","last_active":"2023-07-14T13:29:48.479370+0000","last_peered":"2023-07-14T13:29:48.479370+0000","last_clean":"2023-07-14T13:29:48.479370+0000","last_became_active":"2023-07-14T13:29:46.153808+0000","last_became_peered":"2023-07-14T13:29:46.153808+0000","last_unstale":"2023-07-14T13:29:48.479370+0000","last_undegraded":"2023-07-14T13:29:48.479370+0000","last_fullsized":"2023-07-14T13:29:48.479370+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:29:11.403775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.151443+0000","last_change":"2023-07-14T13:29:44.151443+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.151443+0000","last_undegraded":"2023-07-14T13:29:44.151443+0000","last_fullsized":"2023-07-14T13:29:44.151443+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141245+0000","last_change":"2023-07-14T13:29:45.171928+0000","last_active":"2023-07-14T13:29:47.141245+0000","last_peered":"2023-07-14T13:29:47.141245+0000","last_clean":"2023-07-14T13:29:47.141245+0000","last_became_active":"2023-07-14T13:29:45.171477+0000","last_became_peered":"2023-07-14T13:29:45.171477+0000","last_unstale":"2023-07-14T13:29:47.141245+0000","last_undegraded":"2023-07-14T13:29:47.141245+0000","last_fullsized":"2023-07-14T13:29:47.141245+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:34:09.091228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797671+0000","last_change":"2023-07-14T13:29:45.170109+0000","last_active":"2023-07-14T13:29:48.797671+0000","last_peered":"2023-07-14T13:29:48.797671+0000","last_clean":"2023-07-14T13:29:48.797671+0000","last_became_active":"2023-07-14T13:29:45.169830+0000","last_became_peered":"2023-07-14T13:29:45.169830+0000","last_unstale":"2023-07-14T13:29:48.797671+0000","last_undegraded":"2023-07-14T13:29:48.797671+0000","last_fullsized":"2023-07-14T13:29:48.797671+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:46:28.314128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.153918+0000","last_change":"2023-07-14T13:29:44.153918+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.153918+0000","last_undegraded":"2023-07-14T13:29:44.153918+0000","last_fullsized":"2023-07-14T13:29:44.153918+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479710+0000","last_change":"2023-07-14T13:29:45.175075+0000","last_active":"2023-07-14T13:29:48.479710+0000","last_peered":"2023-07-14T13:29:48.479710+0000","last_clean":"2023-07-14T13:29:48.479710+0000","last_became_active":"2023-07-14T13:29:45.174845+0000","last_became_peered":"2023-07-14T13:29:45.174845+0000","last_unstale":"2023-07-14T13:29:48.479710+0000","last_undegraded":"2023-07-14T13:29:48.479710+0000","last_fullsized":"2023-07-14T13:29:48.479710+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:42.991173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150865+0000","last_change":"2023-07-14T13:29:44.150865+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150865+0000","last_undegraded":"2023-07-14T13:29:44.150865+0000","last_fullsized":"2023-07-14T13:29:44.150865+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:49.060345+0000","last_change":"2023-07-14T13:29:45.175827+0000","last_active":"2023-07-14T13:29:49.060345+0000","last_peered":"2023-07-14T13:29:49.060345+0000","last_clean":"2023-07-14T13:29:49.060345+0000","last_became_active":"2023-07-14T13:29:45.175532+0000","last_became_peered":"2023-07-14T13:29:45.175532+0000","last_unstale":"2023-07-14T13:29:49.060345+0000","last_undegraded":"2023-07-14T13:29:49.060345+0000","last_fullsized":"2023-07-14T13:29:49.060345+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:46:17.873832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479490+0000","last_change":"2023-07-14T13:29:46.165792+0000","last_active":"2023-07-14T13:29:48.479490+0000","last_peered":"2023-07-14T13:29:48.479490+0000","last_clean":"2023-07-14T13:29:48.479490+0000","last_became_active":"2023-07-14T13:29:46.165479+0000","last_became_peered":"2023-07-14T13:29:46.165479+0000","last_unstale":"2023-07-14T13:29:48.479490+0000","last_undegraded":"2023-07-14T13:29:48.479490+0000","last_fullsized":"2023-07-14T13:29:48.479490+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:09:56.183958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146005+0000","last_change":"2023-07-14T13:29:45.173121+0000","last_active":"2023-07-14T13:29:47.146005+0000","last_peered":"2023-07-14T13:29:47.146005+0000","last_clean":"2023-07-14T13:29:47.146005+0000","last_became_active":"2023-07-14T13:29:45.172588+0000","last_became_peered":"2023-07-14T13:29:45.172588+0000","last_unstale":"2023-07-14T13:29:47.146005+0000","last_undegraded":"2023-07-14T13:29:47.146005+0000","last_fullsized":"2023-07-14T13:29:47.146005+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:51:26.781033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:49.060129+0000","last_change":"2023-07-14T13:29:45.172122+0000","last_active":"2023-07-14T13:29:49.060129+0000","last_peered":"2023-07-14T13:29:49.060129+0000","last_clean":"2023-07-14T13:29:49.060129+0000","last_became_active":"2023-07-14T13:29:45.171842+0000","last_became_peered":"2023-07-14T13:29:45.171842+0000","last_unstale":"2023-07-14T13:29:49.060129+0000","last_undegraded":"2023-07-14T13:29:49.060129+0000","last_fullsized":"2023-07-14T13:29:49.060129+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:06:16.855003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479597+0000","last_change":"2023-07-14T13:29:46.159571+0000","last_active":"2023-07-14T13:29:48.479597+0000","last_peered":"2023-07-14T13:29:48.479597+0000","last_clean":"2023-07-14T13:29:48.479597+0000","last_became_active":"2023-07-14T13:29:46.159131+0000","last_became_peered":"2023-07-14T13:29:46.159131+0000","last_unstale":"2023-07-14T13:29:48.479597+0000","last_undegraded":"2023-07-14T13:29:48.479597+0000","last_fullsized":"2023-07-14T13:29:48.479597+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:29:41.684686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146568+0000","last_change":"2023-07-14T13:29:45.172255+0000","last_active":"2023-07-14T13:29:47.146568+0000","last_peered":"2023-07-14T13:29:47.146568+0000","last_clean":"2023-07-14T13:29:47.146568+0000","last_became_active":"2023-07-14T13:29:45.171958+0000","last_became_peered":"2023-07-14T13:29:45.171958+0000","last_unstale":"2023-07-14T13:29:47.146568+0000","last_undegraded":"2023-07-14T13:29:47.146568+0000","last_fullsized":"2023-07-14T13:29:47.146568+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:03:09.694947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141579+0000","last_change":"2023-07-14T13:29:46.163846+0000","last_active":"2023-07-14T13:29:47.141579+0000","last_peered":"2023-07-14T13:29:47.141579+0000","last_clean":"2023-07-14T13:29:47.141579+0000","last_became_active":"2023-07-14T13:29:46.163582+0000","last_became_peered":"2023-07-14T13:29:46.163582+0000","last_unstale":"2023-07-14T13:29:47.141579+0000","last_undegraded":"2023-07-14T13:29:47.141579+0000","last_fullsized":"2023-07-14T13:29:47.141579+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:30:43.385089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150656+0000","last_change":"2023-07-14T13:29:44.150656+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150656+0000","last_undegraded":"2023-07-14T13:29:44.150656+0000","last_fullsized":"2023-07-14T13:29:44.150656+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150513+0000","last_change":"2023-07-14T13:29:44.150513+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150513+0000","last_undegraded":"2023-07-14T13:29:44.150513+0000","last_fullsized":"2023-07-14T13:29:44.150513+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479790+0000","last_change":"2023-07-14T13:29:45.170294+0000","last_active":"2023-07-14T13:29:48.479790+0000","last_peered":"2023-07-14T13:29:48.479790+0000","last_clean":"2023-07-14T13:29:48.479790+0000","last_became_active":"2023-07-14T13:29:45.170018+0000","last_became_peered":"2023-07-14T13:29:45.170018+0000","last_unstale":"2023-07-14T13:29:48.479790+0000","last_undegraded":"2023-07-14T13:29:48.479790+0000","last_fullsized":"2023-07-14T13:29:48.479790+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:07:58.741534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141753+0000","last_change":"2023-07-14T13:29:46.159322+0000","last_active":"2023-07-14T13:29:47.141753+0000","last_peered":"2023-07-14T13:29:47.141753+0000","last_clean":"2023-07-14T13:29:47.141753+0000","last_became_active":"2023-07-14T13:29:46.159056+0000","last_became_peered":"2023-07-14T13:29:46.159056+0000","last_unstale":"2023-07-14T13:29:47.141753+0000","last_undegraded":"2023-07-14T13:29:47.141753+0000","last_fullsized":"2023-07-14T13:29:47.141753+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:24.768994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141634+0000","last_change":"2023-07-14T13:29:45.175896+0000","last_active":"2023-07-14T13:29:47.141634+0000","last_peered":"2023-07-14T13:29:47.141634+0000","last_clean":"2023-07-14T13:29:47.141634+0000","last_became_active":"2023-07-14T13:29:45.175541+0000","last_became_peered":"2023-07-14T13:29:45.175541+0000","last_unstale":"2023-07-14T13:29:47.141634+0000","last_undegraded":"2023-07-14T13:29:47.141634+0000","last_fullsized":"2023-07-14T13:29:47.141634+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:29.129338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146365+0000","last_change":"2023-07-14T13:29:46.154310+0000","last_active":"2023-07-14T13:29:47.146365+0000","last_peered":"2023-07-14T13:29:47.146365+0000","last_clean":"2023-07-14T13:29:47.146365+0000","last_became_active":"2023-07-14T13:29:46.153864+0000","last_became_peered":"2023-07-14T13:29:46.153864+0000","last_unstale":"2023-07-14T13:29:47.146365+0000","last_undegraded":"2023-07-14T13:29:47.146365+0000","last_fullsized":"2023-07-14T13:29:47.146365+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:14:22.808642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150533+0000","last_change":"2023-07-14T13:29:44.150533+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150533+0000","last_undegraded":"2023-07-14T13:29:44.150533+0000","last_fullsized":"2023-07-14T13:29:44.150533+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-14T13:29:45.141888+0000","last_change":"2023-07-14T13:29:45.141888+0000","last_active":"2023-07-14T13:29:45.141888+0000","last_peered":"2023-07-14T13:29:45.141888+0000","last_clean":"2023-07-14T13:29:45.141888+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:45.141888+0000","last_undegraded":"2023-07-14T13:29:45.141888+0000","last_fullsized":"2023-07-14T13:29:45.141888+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797562+0000","last_change":"2023-07-14T13:29:45.171477+0000","last_active":"2023-07-14T13:29:48.797562+0000","last_peered":"2023-07-14T13:29:48.797562+0000","last_clean":"2023-07-14T13:29:48.797562+0000","last_became_active":"2023-07-14T13:29:45.171199+0000","last_became_peered":"2023-07-14T13:29:45.171199+0000","last_unstale":"2023-07-14T13:29:48.797562+0000","last_undegraded":"2023-07-14T13:29:48.797562+0000","last_fullsized":"2023-07-14T13:29:48.797562+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:45.698963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479447+0000","last_change":"2023-07-14T13:29:46.156947+0000","last_active":"2023-07-14T13:29:48.479447+0000","last_peered":"2023-07-14T13:29:48.479447+0000","last_clean":"2023-07-14T13:29:48.479447+0000","last_became_active":"2023-07-14T13:29:46.156662+0000","last_became_peered":"2023-07-14T13:29:46.156662+0000","last_unstale":"2023-07-14T13:29:48.479447+0000","last_undegraded":"2023-07-14T13:29:48.479447+0000","last_fullsized":"2023-07-14T13:29:48.479447+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:40:20.487679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150538+0000","last_change":"2023-07-14T13:29:44.150538+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150538+0000","last_undegraded":"2023-07-14T13:29:44.150538+0000","last_fullsized":"2023-07-14T13:29:44.150538+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146203+0000","last_change":"2023-07-14T13:29:46.158420+0000","last_active":"2023-07-14T13:29:47.146203+0000","last_peered":"2023-07-14T13:29:47.146203+0000","last_clean":"2023-07-14T13:29:47.146203+0000","last_became_active":"2023-07-14T13:29:46.158157+0000","last_became_peered":"2023-07-14T13:29:46.158157+0000","last_unstale":"2023-07-14T13:29:47.146203+0000","last_undegraded":"2023-07-14T13:29:47.146203+0000","last_fullsized":"2023-07-14T13:29:47.146203+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:39:57.006292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.153884+0000","last_change":"2023-07-14T13:29:44.153884+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.153884+0000","last_undegraded":"2023-07-14T13:29:44.153884+0000","last_fullsized":"2023-07-14T13:29:44.153884+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146622+0000","last_change":"2023-07-14T13:29:46.155886+0000","last_active":"2023-07-14T13:29:47.146622+0000","last_peered":"2023-07-14T13:29:47.146622+0000","last_clean":"2023-07-14T13:29:47.146622+0000","last_became_active":"2023-07-14T13:29:46.155575+0000","last_became_peered":"2023-07-14T13:29:46.155575+0000","last_unstale":"2023-07-14T13:29:47.146622+0000","last_undegraded":"2023-07-14T13:29:47.146622+0000","last_fullsized":"2023-07-14T13:29:47.146622+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:38:53.097885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"171'6","reported_seq":19,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:49.060214+0000","last_change":"2023-07-14T13:29:45.175838+0000","last_active":"2023-07-14T13:29:49.060214+0000","last_peered":"2023-07-14T13:29:49.060214+0000","last_clean":"2023-07-14T13:29:49.060214+0000","last_became_active":"2023-07-14T13:29:45.175543+0000","last_became_peered":"2023-07-14T13:29:45.175543+0000","last_unstale":"2023-07-14T13:29:49.060214+0000","last_undegraded":"2023-07-14T13:29:49.060214+0000","last_fullsized":"2023-07-14T13:29:49.060214+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:17:20.283333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"160'304","reported_seq":1106,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-14T13:29:44.154708+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:29:44.154708+0000","last_peered":"2023-07-14T13:29:44.154708+0000","last_clean":"2023-07-14T13:29:44.154708+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:29:44.154708+0000","last_undegraded":"2023-07-14T13:29:44.154708+0000","last_fullsized":"2023-07-14T13:29:44.154708+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:39:53.671602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":282,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-14T13:29:44.153127+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:29:44.153127+0000","last_peered":"2023-07-14T13:29:44.153127+0000","last_clean":"2023-07-14T13:29:44.153127+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:29:44.153127+0000","last_undegraded":"2023-07-14T13:29:44.153127+0000","last_fullsized":"2023-07-14T13:29:44.153127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:23:28.688209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146431+0000","last_change":"2023-07-14T13:29:46.159514+0000","last_active":"2023-07-14T13:29:47.146431+0000","last_peered":"2023-07-14T13:29:47.146431+0000","last_clean":"2023-07-14T13:29:47.146431+0000","last_became_active":"2023-07-14T13:29:46.158086+0000","last_became_peered":"2023-07-14T13:29:46.158086+0000","last_unstale":"2023-07-14T13:29:47.146431+0000","last_undegraded":"2023-07-14T13:29:47.146431+0000","last_fullsized":"2023-07-14T13:29:47.146431+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:16:18.528808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.154151+0000","last_change":"2023-07-14T13:29:44.154151+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.154151+0000","last_undegraded":"2023-07-14T13:29:44.154151+0000","last_fullsized":"2023-07-14T13:29:44.154151+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":287,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-14T13:29:44.154584+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:29:44.154584+0000","last_peered":"2023-07-14T13:29:44.154584+0000","last_clean":"2023-07-14T13:29:44.154584+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:29:44.154584+0000","last_undegraded":"2023-07-14T13:29:44.154584+0000","last_fullsized":"2023-07-14T13:29:44.154584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:23:31.882598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797720+0000","last_change":"2023-07-14T13:29:46.161055+0000","last_active":"2023-07-14T13:29:48.797720+0000","last_peered":"2023-07-14T13:29:48.797720+0000","last_clean":"2023-07-14T13:29:48.797720+0000","last_became_active":"2023-07-14T13:29:46.160756+0000","last_became_peered":"2023-07-14T13:29:46.160756+0000","last_unstale":"2023-07-14T13:29:48.797720+0000","last_undegraded":"2023-07-14T13:29:48.797720+0000","last_fullsized":"2023-07-14T13:29:48.797720+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:28:44.675715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.151080+0000","last_change":"2023-07-14T13:29:44.151080+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.151080+0000","last_undegraded":"2023-07-14T13:29:44.151080+0000","last_fullsized":"2023-07-14T13:29:44.151080+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":292,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797462+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:29:48.797462+0000","last_peered":"2023-07-14T13:29:48.797462+0000","last_clean":"2023-07-14T13:29:48.797462+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:29:48.797462+0000","last_undegraded":"2023-07-14T13:29:48.797462+0000","last_fullsized":"2023-07-14T13:29:48.797462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:14:45.493017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797812+0000","last_change":"2023-07-14T13:29:46.165798+0000","last_active":"2023-07-14T13:29:48.797812+0000","last_peered":"2023-07-14T13:29:48.797812+0000","last_clean":"2023-07-14T13:29:48.797812+0000","last_became_active":"2023-07-14T13:29:46.165366+0000","last_became_peered":"2023-07-14T13:29:46.165366+0000","last_unstale":"2023-07-14T13:29:48.797812+0000","last_undegraded":"2023-07-14T13:29:48.797812+0000","last_fullsized":"2023-07-14T13:29:48.797812+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:34:21.181467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"171'3","reported_seq":16,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797772+0000","last_change":"2023-07-14T13:29:45.167394+0000","last_active":"2023-07-14T13:29:48.797772+0000","last_peered":"2023-07-14T13:29:48.797772+0000","last_clean":"2023-07-14T13:29:48.797772+0000","last_became_active":"2023-07-14T13:29:45.167109+0000","last_became_peered":"2023-07-14T13:29:45.167109+0000","last_unstale":"2023-07-14T13:29:48.797772+0000","last_undegraded":"2023-07-14T13:29:48.797772+0000","last_fullsized":"2023-07-14T13:29:48.797772+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:07:03.377007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":282,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-14T13:29:44.153084+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:29:44.153084+0000","last_peered":"2023-07-14T13:29:44.153084+0000","last_clean":"2023-07-14T13:29:44.153084+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:29:44.153084+0000","last_undegraded":"2023-07-14T13:29:44.153084+0000","last_fullsized":"2023-07-14T13:29:44.153084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:39:28.264692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146524+0000","last_change":"2023-07-14T13:29:46.158284+0000","last_active":"2023-07-14T13:29:47.146524+0000","last_peered":"2023-07-14T13:29:47.146524+0000","last_clean":"2023-07-14T13:29:47.146524+0000","last_became_active":"2023-07-14T13:29:46.157955+0000","last_became_peered":"2023-07-14T13:29:46.157955+0000","last_unstale":"2023-07-14T13:29:47.146524+0000","last_undegraded":"2023-07-14T13:29:47.146524+0000","last_fullsized":"2023-07-14T13:29:47.146524+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:42:58.793494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141644+0000","last_change":"2023-07-14T13:29:45.167565+0000","last_active":"2023-07-14T13:29:47.141644+0000","last_peered":"2023-07-14T13:29:47.141644+0000","last_clean":"2023-07-14T13:29:47.141644+0000","last_became_active":"2023-07-14T13:29:45.167122+0000","last_became_peered":"2023-07-14T13:29:45.167122+0000","last_unstale":"2023-07-14T13:29:47.141644+0000","last_undegraded":"2023-07-14T13:29:47.141644+0000","last_fullsized":"2023-07-14T13:29:47.141644+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:17:20.283333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":300,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479725+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:29:48.479725+0000","last_peered":"2023-07-14T13:29:48.479725+0000","last_clean":"2023-07-14T13:29:48.479725+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:29:48.479725+0000","last_undegraded":"2023-07-14T13:29:48.479725+0000","last_fullsized":"2023-07-14T13:29:48.479725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:04:01.119223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479382+0000","last_change":"2023-07-14T13:29:46.159750+0000","last_active":"2023-07-14T13:29:48.479382+0000","last_peered":"2023-07-14T13:29:48.479382+0000","last_clean":"2023-07-14T13:29:48.479382+0000","last_became_active":"2023-07-14T13:29:46.159434+0000","last_became_peered":"2023-07-14T13:29:46.159434+0000","last_unstale":"2023-07-14T13:29:48.479382+0000","last_undegraded":"2023-07-14T13:29:48.479382+0000","last_fullsized":"2023-07-14T13:29:48.479382+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:25:26.203512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150838+0000","last_change":"2023-07-14T13:29:44.150838+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150838+0000","last_undegraded":"2023-07-14T13:29:44.150838+0000","last_fullsized":"2023-07-14T13:29:44.150838+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":284,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-14T13:29:44.154855+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:29:44.154855+0000","last_peered":"2023-07-14T13:29:44.154855+0000","last_clean":"2023-07-14T13:29:44.154855+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:29:44.154855+0000","last_undegraded":"2023-07-14T13:29:44.154855+0000","last_fullsized":"2023-07-14T13:29:44.154855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:47:20.376659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141463+0000","last_change":"2023-07-14T13:29:46.150567+0000","last_active":"2023-07-14T13:29:47.141463+0000","last_peered":"2023-07-14T13:29:47.141463+0000","last_clean":"2023-07-14T13:29:47.141463+0000","last_became_active":"2023-07-14T13:29:46.150251+0000","last_became_peered":"2023-07-14T13:29:46.150251+0000","last_unstale":"2023-07-14T13:29:47.141463+0000","last_undegraded":"2023-07-14T13:29:47.141463+0000","last_fullsized":"2023-07-14T13:29:47.141463+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:35:51.313440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.150512+0000","last_change":"2023-07-14T13:29:44.150512+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.150512+0000","last_undegraded":"2023-07-14T13:29:44.150512+0000","last_fullsized":"2023-07-14T13:29:44.150512+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":300,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479710+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:29:48.479710+0000","last_peered":"2023-07-14T13:29:48.479710+0000","last_clean":"2023-07-14T13:29:48.479710+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:29:48.479710+0000","last_undegraded":"2023-07-14T13:29:48.479710+0000","last_fullsized":"2023-07-14T13:29:48.479710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:05:23.988230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479427+0000","last_change":"2023-07-14T13:29:46.152496+0000","last_active":"2023-07-14T13:29:48.479427+0000","last_peered":"2023-07-14T13:29:48.479427+0000","last_clean":"2023-07-14T13:29:48.479427+0000","last_became_active":"2023-07-14T13:29:46.152230+0000","last_became_peered":"2023-07-14T13:29:46.152230+0000","last_unstale":"2023-07-14T13:29:48.479427+0000","last_undegraded":"2023-07-14T13:29:48.479427+0000","last_fullsized":"2023-07-14T13:29:48.479427+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:26:38.395035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-14T13:29:44.151752+0000","last_change":"2023-07-14T13:29:44.151752+0000","last_active":"2023-07-14T13:29:44.133361+0000","last_peered":"2023-07-14T13:29:44.133361+0000","last_clean":"2023-07-14T13:29:44.133361+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-14T13:29:44.151752+0000","last_undegraded":"2023-07-14T13:29:44.151752+0000","last_fullsized":"2023-07-14T13:29:44.151752+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":286,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-14T13:29:44.151631+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:29:44.151631+0000","last_peered":"2023-07-14T13:29:44.151631+0000","last_clean":"2023-07-14T13:29:44.151631+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:29:44.151631+0000","last_undegraded":"2023-07-14T13:29:44.151631+0000","last_fullsized":"2023-07-14T13:29:44.151631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:05:53.665139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":84,"acting":84,"num_store_stats":5},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23,"ondisk_log_size":23,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575289,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59928,"kb_used_data":2640,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94311912,"statfs":{"total":96636764160,"available":96575397888,"internally_reserved":0,"allocated":2703360,"data_stored":1670881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.57099999999999995,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96899999999999997,"5min":1.054,"15min":1.054},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.752,"15min":0.746},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.443},"max":{"1min":1.016,"5min":1.016,"15min":1.032},"last":0.42899999999999999}]},{"osd":1,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.752,"15min":0.755},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.90400000000000003,"5min":1.339,"15min":1.339},"last":1.1659999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.76600000000000001,"15min":0.76100000000000001},"min":{"1min":0.53300000000000003,"5min":0.501,"15min":0.496},"max":{"1min":0.98399999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.60399999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.72899999999999998,"15min":0.74099999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88400000000000001,"5min":1.032,"15min":1.1379999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.879,"5min":1.429,"15min":1.429},"last":0.91400000000000003}]},{"osd":3,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.746,"15min":0.75600000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.499},"max":{"1min":0.95599999999999996,"5min":1.361,"15min":1.361},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.44700000000000001},"max":{"1min":0.94299999999999995,"5min":1.395,"15min":1.395},"last":1.097}]},{"osd":4,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.60599999999999998,"15min":0.58299999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.35799999999999998},"max":{"1min":0.89700000000000002,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.879},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61399999999999999,"15min":0.62},"min":{"1min":0.44700000000000001,"5min":0.439,"15min":0.40400000000000003},"max":{"1min":0.93700000000000006,"5min":0.95799999999999996,"15min":0.99399999999999999},"last":0.80400000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60399999999999998,"15min":0.61099999999999999},"min":{"1min":0.48599999999999999,"5min":0.42399999999999999,"15min":0.40200000000000002},"max":{"1min":0.90300000000000002,"5min":1,"15min":1},"last":1.056},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47999999999999998,"5min":0.45300000000000001,"15min":0.41699999999999998},"max":{"1min":0.873,"5min":0.93600000000000005,"15min":1.0620000000000001},"last":0.96099999999999997}]},{"osd":6,"last update":"Fri Jul 14 13:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.56899999999999995,"5min":0.52600000000000002,"15min":0.47099999999999997},"max":{"1min":0.93799999999999994,"5min":1.0940000000000001,"15min":1.115},"last":1.032},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67800000000000005,"15min":0.68100000000000005},"min":{"1min":0.503,"5min":0.495,"15min":0.41999999999999998},"max":{"1min":0.879,"5min":0.95299999999999996,"15min":1.147},"last":0.84699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575290,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33108,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338732,"statfs":{"total":96636764160,"available":96602861568,"internally_reserved":0,"allocated":2109440,"data_stored":1080513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.998,"5min":1.026,"15min":1.026},"last":0.629},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.499,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89400000000000002,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.76300000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73999999999999999,"15min":0.76400000000000001},"min":{"1min":0.54000000000000004,"5min":0.51600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91500000000000004,"5min":1.0049999999999999,"15min":1.3300000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73799999999999999,"15min":0.747},"min":{"1min":0.58299999999999996,"5min":0.51700000000000002,"15min":0.47499999999999998},"max":{"1min":0.93999999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.69199999999999995}]},{"osd":2,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77500000000000002,"15min":0.79200000000000004},"min":{"1min":0.59799999999999998,"5min":0.53300000000000003,"15min":0.52000000000000002},"max":{"1min":0.92500000000000004,"5min":1.04,"15min":1.0660000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75700000000000001,"15min":0.76700000000000002},"min":{"1min":0.53500000000000003,"5min":0.52600000000000002,"15min":0.51300000000000001},"max":{"1min":0.94799999999999995,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.66900000000000004}]},{"osd":3,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77700000000000002,"15min":0.78100000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.95799999999999996,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.70699999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.2569999999999999},"last":0.71399999999999997}]},{"osd":4,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.41499999999999998,"5min":0.36299999999999999,"15min":0.36099999999999999},"max":{"1min":0.82199999999999995,"5min":0.92600000000000005,"15min":1.175},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60899999999999999,"15min":0.61199999999999999},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.36799999999999999},"max":{"1min":0.80800000000000005,"5min":0.94599999999999995,"15min":1.0580000000000001},"last":0.46100000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.42699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84999999999999998,"5min":0.873,"15min":1.0860000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.68000000000000005,"15min":0.67400000000000004},"min":{"1min":0.51000000000000001,"5min":0.45900000000000002,"15min":0.41699999999999998},"max":{"1min":0.92100000000000004,"5min":0.93200000000000005,"15min":1.3180000000000001},"last":0.59399999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.46500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88800000000000001,"5min":0.99199999999999999,"15min":1.042},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.53700000000000003,"5min":0.50900000000000001,"15min":0.46200000000000002},"max":{"1min":0.89900000000000002,"5min":0.92300000000000004,"15min":1.0369999999999999},"last":0.49299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575289,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51156,"kb_used_data":2060,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320684,"statfs":{"total":96636764160,"available":96584380416,"internally_reserved":0,"allocated":2109440,"data_stored":1080513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.76000000000000001,"15min":0.745},"min":{"1min":0.59499999999999997,"5min":0.41799999999999998,"15min":0.40500000000000003},"max":{"1min":0.94099999999999995,"5min":1.8,"15min":1.8},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77400000000000002,"15min":0.76100000000000001},"min":{"1min":0.58599999999999997,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":0.91500000000000004,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.71999999999999997}]},{"osd":1,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77000000000000002,"15min":0.746},"min":{"1min":0.58699999999999997,"5min":0.50600000000000001,"15min":0.378},"max":{"1min":0.89600000000000002,"5min":1.835,"15min":1.835},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.77500000000000002,"15min":0.77200000000000002},"min":{"1min":0.56200000000000006,"5min":0.503,"15min":0.499},"max":{"1min":0.99299999999999999,"5min":1.0429999999999999,"15min":1.05},"last":1.0629999999999999}]},{"osd":2,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.91800000000000004,"15min":0.80300000000000005},"min":{"1min":0.67100000000000004,"5min":0.434,"15min":0.434},"max":{"1min":0.95199999999999996,"5min":16.774000000000001,"15min":16.774000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.90800000000000003,"15min":0.80600000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.496},"max":{"1min":0.88,"5min":16.751999999999999,"15min":16.751999999999999},"last":0.67100000000000004}]},{"osd":3,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.77700000000000002,"15min":0.77100000000000002},"min":{"1min":0.65400000000000003,"5min":0.52700000000000002,"15min":0.51100000000000001},"max":{"1min":0.95899999999999996,"5min":0.999,"15min":1.115},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.93600000000000005,"15min":0.82999999999999996},"min":{"1min":0.60699999999999998,"5min":0.54100000000000004,"15min":0.50600000000000001},"max":{"1min":0.93999999999999995,"5min":16.731000000000002,"15min":16.731000000000002},"last":0.96799999999999997}]},{"osd":4,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.624,"15min":0.63100000000000001},"min":{"1min":0.442,"5min":0.39500000000000002,"15min":0.38},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":1.0089999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.70999999999999996},"min":{"1min":0.45200000000000001,"5min":0.375,"15min":0.36699999999999999},"max":{"1min":1.02,"5min":1.159,"15min":1.159},"last":1.248}]},{"osd":6,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.61899999999999999},"min":{"1min":0.49099999999999999,"5min":0.41799999999999998,"15min":0.34999999999999998},"max":{"1min":0.88800000000000001,"5min":0.94699999999999995,"15min":1.3100000000000001},"last":1.157},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64700000000000002,"15min":0.64400000000000002},"min":{"1min":0.501,"5min":0.45400000000000001,"15min":0.40999999999999998},"max":{"1min":0.80400000000000005,"5min":0.91800000000000004,"15min":0.97299999999999998},"last":0.99199999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65400000000000003,"15min":0.64900000000000002},"min":{"1min":0.51100000000000001,"5min":0.432,"15min":0.42399999999999999},"max":{"1min":0.93000000000000005,"5min":1.123,"15min":1.123},"last":1.1759999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.69499999999999995,"15min":0.68899999999999995},"min":{"1min":0.55700000000000005,"5min":0.49299999999999999,"15min":0.40000000000000002},"max":{"1min":0.96899999999999997,"5min":1.012,"15min":1.012},"last":1.091}]}]},{"osd":4,"up_from":13,"seq":55834575290,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37252,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334588,"statfs":{"total":96636764160,"available":96598618112,"internally_reserved":0,"allocated":2158592,"data_stored":1102570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.76400000000000001,"15min":0.76700000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.38100000000000001},"max":{"1min":0.96899999999999997,"5min":1.0069999999999999,"15min":1.0249999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77100000000000002,"15min":0.76300000000000001},"min":{"1min":0.60799999999999998,"5min":0.45800000000000002,"15min":0.442},"max":{"1min":0.94499999999999995,"5min":1.278,"15min":1.278},"last":0.50800000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.76300000000000001,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0349999999999999,"5min":1.306,"15min":1.306},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.53800000000000003,"5min":0.51000000000000001,"15min":0.47599999999999998},"max":{"1min":1.024,"5min":1.177,"15min":1.177},"last":0.748}]},{"osd":2,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78000000000000003,"15min":0.77300000000000002},"min":{"1min":0.56899999999999995,"5min":0.54000000000000004,"15min":0.49299999999999999},"max":{"1min":0.90400000000000003,"5min":1.137,"15min":1.137},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77300000000000002,"15min":0.77900000000000003},"min":{"1min":0.53700000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1,"5min":1,"15min":1.0149999999999999},"last":0.82299999999999995}]},{"osd":3,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.50800000000000001},"max":{"1min":0.93200000000000005,"5min":1.222,"15min":1.222},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78400000000000003,"15min":0.77900000000000003},"min":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.496},"max":{"1min":1.018,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60599999999999998,"15min":0.60699999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.40000000000000002},"max":{"1min":0.94099999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61799999999999999,"15min":0.60799999999999998},"min":{"1min":0.45000000000000001,"5min":0.42399999999999999,"15min":0.378},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96799999999999997},"last":0.61799999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.624,"15min":0.61599999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.42699999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.88600000000000001}]},{"osd":7,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67300000000000004,"15min":0.67100000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.435},"max":{"1min":0.91800000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70099999999999996,"15min":0.69799999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.83999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575290,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41344,"kb_used_data":2104,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330496,"statfs":{"total":96636764160,"available":96594427904,"internally_reserved":0,"allocated":2154496,"data_stored":1101622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47399999999999998,"15min":0.46000000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.28799999999999998},"max":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.92900000000000005},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.621,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.51900000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.48899999999999999,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.33900000000000002,"15min":0.32300000000000001},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.495},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55800000000000005,"15min":0.56100000000000005},"min":{"1min":0.39700000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.82199999999999995,"5min":0.82399999999999995,"15min":0.95799999999999996},"last":0.70099999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57799999999999996,"15min":0.58299999999999996},"min":{"1min":0.41499999999999998,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.623,"15min":0.61499999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82399999999999995,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.74299999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.77000000000000002,"15min":0.78500000000000003},"min":{"1min":0.45200000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.048,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.79500000000000004,"15min":0.80600000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98999999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.84599999999999997}]},{"osd":5,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81000000000000005,"15min":0.82899999999999996},"min":{"1min":0.56499999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.069,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80800000000000005,"15min":0.81299999999999994},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1220000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":1.0089999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.81399999999999995,"15min":0.80800000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1910000000000001,"5min":1.383,"15min":1.383},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.82299999999999995,"15min":0.83999999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1439999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.76200000000000001}]},{"osd":7,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.86399999999999999,"15min":0.85999999999999999},"min":{"1min":0.58899999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.171,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.56599999999999995,"5min":0.56000000000000005,"15min":0.54800000000000004},"max":{"1min":1.1579999999999999,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.91200000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575290,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59388,"kb_used_data":2100,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312452,"statfs":{"total":96636764160,"available":96575950848,"internally_reserved":0,"allocated":2150400,"data_stored":1100099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46899999999999997,"15min":0.46500000000000002},"min":{"1min":0.32200000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.68400000000000005,"5min":0.70799999999999996,"15min":0.80500000000000005},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.53100000000000003},"min":{"1min":0.38300000000000001,"5min":0.318,"15min":0.30599999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.34899999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47099999999999997,"15min":0.46800000000000003},"min":{"1min":0.34100000000000003,"5min":0.32900000000000001,"15min":0.32600000000000001},"max":{"1min":0.58599999999999997,"5min":0.80600000000000005,"15min":0.84799999999999998},"last":0.307},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.56100000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38200000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.93799999999999994},"last":0.41699999999999998}]},{"osd":3,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.39700000000000002,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.74399999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.433},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56699999999999995,"15min":0.55800000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35699999999999998},"max":{"1min":0.73599999999999999,"5min":0.77300000000000002,"15min":0.84599999999999997},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.80100000000000005},"min":{"1min":0.58099999999999996,"5min":0.49399999999999999,"15min":0.48799999999999999},"max":{"1min":1.004,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.84099999999999997,"15min":0.81999999999999995},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.48899999999999999},"max":{"1min":1.0169999999999999,"5min":1.179,"15min":1.3029999999999999},"last":0.627}]},{"osd":5,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.86899999999999999,"15min":0.86399999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.02,"5min":1.2430000000000001,"15min":1.302},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.85999999999999999,"15min":0.85099999999999998},"min":{"1min":0.65700000000000003,"5min":0.60699999999999998,"15min":0.54000000000000004},"max":{"1min":1.1120000000000001,"5min":1.2410000000000001,"15min":1.248},"last":0.67400000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85999999999999999,"15min":0.82899999999999996},"min":{"1min":0.59799999999999998,"5min":0.56699999999999995,"15min":0.54800000000000004},"max":{"1min":1.042,"5min":1.2749999999999999,"15min":1.446},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.83599999999999997,"15min":0.82399999999999995},"min":{"1min":0.64500000000000002,"5min":0.55100000000000005,"15min":0.51700000000000002},"max":{"1min":1.119,"5min":1.1830000000000001,"15min":1.266},"last":0.65200000000000002}]},{"osd":7,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.873,"15min":0.84499999999999997},"min":{"1min":0.64800000000000002,"5min":0.56799999999999995,"15min":0.55900000000000005},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.871,"15min":0.84999999999999998},"min":{"1min":0.69099999999999995,"5min":0.61599999999999999,"15min":0.56000000000000005},"max":{"1min":1.2709999999999999,"5min":1.351,"15min":1.371},"last":0.61199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575291,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41340,"kb_used_data":2100,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330500,"statfs":{"total":96636764160,"available":96594432000,"internally_reserved":0,"allocated":2150400,"data_stored":1101076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46000000000000002,"15min":0.45500000000000002},"min":{"1min":0.33100000000000002,"5min":0.316,"15min":0.28100000000000003},"max":{"1min":0.70899999999999996,"5min":0.753,"15min":0.81599999999999995},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.52500000000000002},"min":{"1min":0.41799999999999998,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":0.68500000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.45000000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.46899999999999997,"15min":0.47199999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.30499999999999999},"max":{"1min":0.59999999999999998,"5min":0.63600000000000001,"15min":0.70799999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.39700000000000002,"5min":0.378,"15min":0.32800000000000001},"max":{"1min":0.747,"5min":0.79900000000000004,"15min":0.89200000000000002},"last":0.51100000000000001}]},{"osd":3,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66500000000000004,"15min":0.65900000000000003},"min":{"1min":0.51100000000000001,"5min":0.47099999999999997,"15min":0.42299999999999999},"max":{"1min":0.90200000000000002,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.36399999999999999,"5min":0.34300000000000003,"15min":0.32300000000000001},"max":{"1min":0.86899999999999999,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.53300000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.79500000000000004,"15min":0.80800000000000005},"min":{"1min":0.61599999999999999,"5min":0.56699999999999995,"15min":0.52200000000000002},"max":{"1min":1.091,"5min":1.155,"15min":1.2470000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.81899999999999995,"15min":0.82799999999999996},"min":{"1min":0.63600000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.0309999999999999,"5min":1.151,"15min":1.171},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.64000000000000001,"5min":0.56299999999999994,"15min":0.54500000000000004},"max":{"1min":1.0469999999999999,"5min":1.224,"15min":1.224},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.81399999999999995,"15min":0.83099999999999996},"min":{"1min":0.66100000000000003,"5min":0.57299999999999995,"15min":0.56100000000000005},"max":{"1min":1.1240000000000001,"5min":1.1259999999999999,"15min":1.375},"last":0.84399999999999997}]},{"osd":6,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.66900000000000004,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.036,"5min":1.1759999999999999,"15min":1.2},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.84299999999999997,"15min":0.85399999999999998},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.56399999999999995},"max":{"1min":1.0589999999999999,"5min":1.169,"15min":1.329},"last":0.745}]},{"osd":7,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.79500000000000004,"15min":0.81899999999999995},"min":{"1min":0.59699999999999998,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.0609999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.86899999999999999,"15min":0.875},"min":{"1min":0.71799999999999997,"5min":0.59999999999999998,"15min":0.58899999999999997},"max":{"1min":1.0389999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.89800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575292,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41936,"kb_used_data":2696,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329904,"statfs":{"total":96636764160,"available":96593821696,"internally_reserved":0,"allocated":2760704,"data_stored":1692625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.33500000000000002,"5min":0.30499999999999999,"15min":0.29899999999999999},"max":{"1min":0.69399999999999995,"5min":0.77100000000000002,"15min":0.85299999999999998},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39900000000000002,"5min":0.36799999999999999,"15min":0.308},"max":{"1min":0.73099999999999998,"5min":0.76800000000000002,"15min":0.80700000000000005},"last":0.39700000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53200000000000003,"15min":0.53600000000000003},"min":{"1min":0.42599999999999999,"5min":0.35699999999999998,"15min":0.33700000000000002},"max":{"1min":0.63500000000000001,"5min":0.72499999999999998,"15min":1.002},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77700000000000002,"5min":0.84099999999999997,"15min":0.91200000000000003},"last":0.37}]},{"osd":3,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52900000000000003,"15min":0.53200000000000003},"min":{"1min":0.38400000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75700000000000001,"5min":0.77000000000000002,"15min":0.83299999999999996},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.47499999999999998,"5min":0.44400000000000001,"15min":0.38800000000000001},"max":{"1min":0.75900000000000001,"5min":0.77200000000000002,"15min":0.871},"last":0.40999999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.83599999999999997,"15min":0.83099999999999996},"min":{"1min":0.60699999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.157,"5min":1.274,"15min":1.284},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.85299999999999998,"15min":0.83699999999999997},"min":{"1min":0.63,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.034,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.82599999999999996,"15min":0.83999999999999997},"min":{"1min":0.59799999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0800000000000001,"5min":1.28,"15min":1.294},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.86699999999999999,"15min":0.85799999999999998},"min":{"1min":0.66200000000000003,"5min":0.58399999999999996,"15min":0.52400000000000002},"max":{"1min":1.0189999999999999,"5min":1.472,"15min":1.472},"last":0.61299999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.84099999999999997,"15min":0.84299999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.96999999999999997,"5min":1.639,"15min":1.639},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.88100000000000001,"15min":0.86399999999999999},"min":{"1min":0.65900000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.044,"5min":1.544,"15min":1.544},"last":0.53300000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.85299999999999998,"15min":0.86199999999999999},"min":{"1min":0.67300000000000004,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1259999999999999,"5min":1.236,"15min":1.3280000000000001},"last":0.63},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.877,"15min":0.86299999999999999},"min":{"1min":0.63100000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.103,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.65300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:29:52.138 INFO:tasks.ceph.mds.a.smithi005.stderr:2023-07-14T13:29:52.135+0000 7f79d6a64640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T13:29:54.852 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:29:55.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.007+0000 7fbd0879f640 1 Processor -- start 2023-07-14T13:29:55.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.007+0000 7fbd0879f640 1 -- start start 2023-07-14T13:29:55.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.007+0000 7fbd0879f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbd000c8ad0 0x7fbd000c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:55.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.007+0000 7fbd0879f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd000c9560 0x7fbd000ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:55.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.007+0000 7fbd0879f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd000cc700 con 0x7fbd00158ce0 2023-07-14T13:29:55.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.007+0000 7fbd0879f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd000c99e0 con 0x7fbd000c8ad0 2023-07-14T13:29:55.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.007+0000 7fbd0879f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd000b0ff0 con 0x7fbd000c9560 2023-07-14T13:29:55.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.007+0000 7fbd0653b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbd00158ce0 0x7fbd00070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46030/0 (socket says 172.21.15.5:46030) 2023-07-14T13:29:55.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.007+0000 7fbd0653b640 1 -- 172.21.15.5:0/1645679786 learned_addr learned my addr 172.21.15.5:0/1645679786 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:55.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.007+0000 7fbd05d3a640 1 --2- 172.21.15.5:0/1645679786 >> v2:172.21.15.5:3300/0 conn(0x7fbd000c8ad0 0x7fbd000c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:55.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.007+0000 7fbd06d3c640 1 --2- 172.21.15.5:0/1645679786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd000c9560 0x7fbd000ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:55.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.007+0000 7fbd05539640 1 -- 172.21.15.5:0/1645679786 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950082625 0 0) 0x7fbd000cc700 con 0x7fbd00158ce0 2023-07-14T13:29:55.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.007+0000 7fbd05d3a640 1 -- 172.21.15.5:0/1645679786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd000c9560 msgr2=0x7fbd000ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:55.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.007+0000 7fbd05d3a640 1 --2- 172.21.15.5:0/1645679786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd000c9560 0x7fbd000ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:55.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.007+0000 7fbd05d3a640 1 -- 172.21.15.5:0/1645679786 >> v1:172.21.15.5:6789/0 conn(0x7fbd00158ce0 legacy=0x7fbd00070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:55.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.007+0000 7fbd05d3a640 1 -- 172.21.15.5:0/1645679786 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd00070c80 con 0x7fbd000c8ad0 2023-07-14T13:29:55.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.007+0000 7fbd06d3c640 1 --2- 172.21.15.5:0/1645679786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd000c9560 0x7fbd000ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:29:55.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.011+0000 7fbd05d3a640 1 --2- 172.21.15.5:0/1645679786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd000c8ad0 0x7fbd000c9020 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00097c0 tx=0x7fbcf001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6117e6394c4a47 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:55.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.011+0000 7fbd05539640 1 -- 172.21.15.5:0/1645679786 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf00ab600 con 0x7fbd000c8ad0 2023-07-14T13:29:55.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.011+0000 7fbd05539640 1 -- 172.21.15.5:0/1645679786 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf00a7050 con 0x7fbd000c8ad0 2023-07-14T13:29:55.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.011+0000 7fbd05539640 1 -- 172.21.15.5:0/1645679786 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf00ab980 con 0x7fbd000c8ad0 2023-07-14T13:29:55.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.011+0000 7fbd0879f640 1 -- 172.21.15.5:0/1645679786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd000c8ad0 msgr2=0x7fbd000c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:55.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.011+0000 7fbd0879f640 1 --2- 172.21.15.5:0/1645679786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd000c8ad0 0x7fbd000c9020 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00097c0 tx=0x7fbcf001c330 comp rx=0 tx=0).stop 2023-07-14T13:29:55.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.011+0000 7fbd0879f640 1 -- 172.21.15.5:0/1645679786 shutdown_connections 2023-07-14T13:29:55.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.011+0000 7fbd0879f640 1 --2- 172.21.15.5:0/1645679786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd000c9560 0x7fbd000ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:55.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.011+0000 7fbd0879f640 1 --2- 172.21.15.5:0/1645679786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd000c8ad0 0x7fbd000c9020 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:55.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.011+0000 7fbd0879f640 1 -- 172.21.15.5:0/1645679786 >> 172.21.15.5:0/1645679786 conn(0x7fbd000afcf0 msgr2=0x7fbd000b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:55.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.011+0000 7fbd0879f640 1 -- 172.21.15.5:0/1645679786 shutdown_connections 2023-07-14T13:29:55.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.011+0000 7fbd0879f640 1 -- 172.21.15.5:0/1645679786 wait complete. 2023-07-14T13:29:55.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.015+0000 7fbd0879f640 1 Processor -- start 2023-07-14T13:29:55.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.015+0000 7fbd0879f640 1 -- start start 2023-07-14T13:29:55.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.015+0000 7fbd0879f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd000c8ad0 0x7fbd000c0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:55.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.015+0000 7fbd0879f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd000c9560 0x7fbd000b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:55.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.015+0000 7fbd0879f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd00158ce0 0x7fbd000b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:55.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.015+0000 7fbd0879f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd000c1480 con 0x7fbd00158ce0 2023-07-14T13:29:55.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.015+0000 7fbd0879f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd000c5230 con 0x7fbd000c9560 2023-07-14T13:29:55.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.015+0000 7fbd0879f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd000c54d0 con 0x7fbd000c8ad0 2023-07-14T13:29:55.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.015+0000 7fbd06d3c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd00158ce0 0x7fbd000b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:55.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.015+0000 7fbd06d3c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd00158ce0 0x7fbd000b3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52608/0 (socket says 172.21.15.5:52608) 2023-07-14T13:29:55.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.015+0000 7fbd06d3c640 1 -- 172.21.15.5:0/3572483724 learned_addr learned my addr 172.21.15.5:0/3572483724 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:55.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.015+0000 7fbd0653b640 1 --2- 172.21.15.5:0/3572483724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd000c8ad0 0x7fbd000c0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:55.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.015+0000 7fbd05d3a640 1 --2- 172.21.15.5:0/3572483724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd000c9560 0x7fbd000b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:55.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.015+0000 7fbd06d3c640 1 -- 172.21.15.5:0/3572483724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd000c8ad0 msgr2=0x7fbd000c0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:55.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.015+0000 7fbd06d3c640 1 --2- 172.21.15.5:0/3572483724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd000c8ad0 0x7fbd000c0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:55.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.015+0000 7fbd06d3c640 1 -- 172.21.15.5:0/3572483724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd000c9560 msgr2=0x7fbd000b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:55.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.015+0000 7fbd06d3c640 1 --2- 172.21.15.5:0/3572483724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd000c9560 0x7fbd000b35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:55.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.015+0000 7fbd06d3c640 1 -- 172.21.15.5:0/3572483724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf0009420 con 0x7fbd00158ce0 2023-07-14T13:29:55.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.015+0000 7fbd05d3a640 1 --2- 172.21.15.5:0/3572483724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd000c9560 0x7fbd000b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:29:55.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.015+0000 7fbd06d3c640 1 --2- 172.21.15.5:0/3572483724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd00158ce0 0x7fbd000b3b30 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8009fa0 tx=0x7fbcf800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:55.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.015+0000 7fbcf6ffd640 1 -- 172.21.15.5:0/3572483724 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8003ba0 con 0x7fbd00158ce0 2023-07-14T13:29:55.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.015+0000 7fbcf6ffd640 1 -- 172.21.15.5:0/3572483724 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf800f040 con 0x7fbd00158ce0 2023-07-14T13:29:55.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.015+0000 7fbcf6ffd640 1 -- 172.21.15.5:0/3572483724 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8004030 con 0x7fbd00158ce0 2023-07-14T13:29:55.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.015+0000 7fbd0879f640 1 -- 172.21.15.5:0/3572483724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd000c57b0 con 0x7fbd00158ce0 2023-07-14T13:29:55.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.015+0000 7fbd0879f640 1 -- 172.21.15.5:0/3572483724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd000c5d70 con 0x7fbd00158ce0 2023-07-14T13:29:55.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.015+0000 7fbd0879f640 1 -- 172.21.15.5:0/3572483724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd000ca1a0 con 0x7fbd00158ce0 2023-07-14T13:29:55.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.019+0000 7fbcf6ffd640 1 -- 172.21.15.5:0/3572483724 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbcf8004190 con 0x7fbd00158ce0 2023-07-14T13:29:55.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.019+0000 7fbcf6ffd640 1 --2- 172.21.15.5:0/3572483724 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fbce40663d0 0x7fbce4068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:55.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.019+0000 7fbcf6ffd640 1 -- 172.21.15.5:0/3572483724 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fbcf80842b0 con 0x7fbd00158ce0 2023-07-14T13:29:55.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.019+0000 7fbd0653b640 1 --2- 172.21.15.5:0/3572483724 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fbce40663d0 0x7fbce4068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:55.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.019+0000 7fbd0653b640 1 --2- 172.21.15.5:0/3572483724 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fbce40663d0 0x7fbce4068880 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc000f70 tx=0x7fbcfc007df0 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:55.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.023+0000 7fbcf6ffd640 1 -- 172.21.15.5:0/3572483724 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fbcf80515a0 con 0x7fbd00158ce0 2023-07-14T13:29:55.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.175+0000 7fbd0879f640 1 -- 172.21.15.5:0/3572483724 --> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbd001590b0 con 0x7fbce40663d0 2023-07-14T13:29:55.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.187+0000 7fbcf6ffd640 1 -- 172.21.15.5:0/3572483724 <== mgr.9247 v2:172.21.15.154:6832/1905284593 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311906 (secure 0 0 0) 0x7fbcfc0072a0 con 0x7fbce40663d0 2023-07-14T13:29:55.191 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:29:55.193 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:29:55.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.191+0000 7fbd0879f640 1 -- 172.21.15.5:0/3572483724 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fbce40663d0 msgr2=0x7fbce4068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:55.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.191+0000 7fbd0879f640 1 --2- 172.21.15.5:0/3572483724 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fbce40663d0 0x7fbce4068880 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc000f70 tx=0x7fbcfc007df0 comp rx=0 tx=0).stop 2023-07-14T13:29:55.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.191+0000 7fbd0879f640 1 -- 172.21.15.5:0/3572483724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd00158ce0 msgr2=0x7fbd000b3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:55.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.191+0000 7fbd0879f640 1 --2- 172.21.15.5:0/3572483724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd00158ce0 0x7fbd000b3b30 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8009fa0 tx=0x7fbcf800d560 comp rx=0 tx=0).stop 2023-07-14T13:29:55.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.191+0000 7fbd0879f640 1 -- 172.21.15.5:0/3572483724 shutdown_connections 2023-07-14T13:29:55.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.191+0000 7fbd0879f640 1 --2- 172.21.15.5:0/3572483724 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fbce40663d0 0x7fbce4068880 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:55.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.191+0000 7fbd0879f640 1 --2- 172.21.15.5:0/3572483724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd00158ce0 0x7fbd000b3b30 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:55.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.191+0000 7fbd0879f640 1 --2- 172.21.15.5:0/3572483724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd000c9560 0x7fbd000b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:55.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.191+0000 7fbd0879f640 1 --2- 172.21.15.5:0/3572483724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd000c8ad0 0x7fbd000c0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:55.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.191+0000 7fbd0879f640 1 -- 172.21.15.5:0/3572483724 >> 172.21.15.5:0/3572483724 conn(0x7fbd000afcf0 msgr2=0x7fbd000af260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:55.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.191+0000 7fbd0879f640 1 -- 172.21.15.5:0/3572483724 shutdown_connections 2023-07-14T13:29:55.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.191+0000 7fbd0879f640 1 -- 172.21.15.5:0/3572483724 wait complete. 2023-07-14T13:29:55.212 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2023-07-14T13:29:54.059551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":543,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":342,"ondisk_log_size":342,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":203,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":365568,"kb_used_data":17984,"kb_used_omap":0,"kb_used_meta":347520,"kb_avail":754609152,"statfs":{"total":773094113280,"available":772719771648,"internally_reserved":0,"allocated":18415616,"data_stored":9991470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":355860480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002055"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.231401+0000","last_change":"2023-07-14T13:29:46.167481+0000","last_active":"2023-07-14T13:29:48.231401+0000","last_peered":"2023-07-14T13:29:48.231401+0000","last_clean":"2023-07-14T13:29:48.231401+0000","last_became_active":"2023-07-14T13:29:46.166765+0000","last_became_peered":"2023-07-14T13:29:46.166765+0000","last_unstale":"2023-07-14T13:29:48.231401+0000","last_undegraded":"2023-07-14T13:29:48.231401+0000","last_fullsized":"2023-07-14T13:29:48.231401+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:36.907010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479686+0000","last_change":"2023-07-14T13:29:46.159865+0000","last_active":"2023-07-14T13:29:48.479686+0000","last_peered":"2023-07-14T13:29:48.479686+0000","last_clean":"2023-07-14T13:29:48.479686+0000","last_became_active":"2023-07-14T13:29:46.159410+0000","last_became_peered":"2023-07-14T13:29:46.159410+0000","last_unstale":"2023-07-14T13:29:48.479686+0000","last_undegraded":"2023-07-14T13:29:48.479686+0000","last_fullsized":"2023-07-14T13:29:48.479686+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:01.004278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479590+0000","last_change":"2023-07-14T13:29:46.162495+0000","last_active":"2023-07-14T13:29:48.479590+0000","last_peered":"2023-07-14T13:29:48.479590+0000","last_clean":"2023-07-14T13:29:48.479590+0000","last_became_active":"2023-07-14T13:29:46.162075+0000","last_became_peered":"2023-07-14T13:29:46.162075+0000","last_unstale":"2023-07-14T13:29:48.479590+0000","last_undegraded":"2023-07-14T13:29:48.479590+0000","last_fullsized":"2023-07-14T13:29:48.479590+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:33:26.310832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.661773+0000","last_change":"2023-07-14T13:29:46.160628+0000","last_active":"2023-07-14T13:29:48.661773+0000","last_peered":"2023-07-14T13:29:48.661773+0000","last_clean":"2023-07-14T13:29:48.661773+0000","last_became_active":"2023-07-14T13:29:46.159958+0000","last_became_peered":"2023-07-14T13:29:46.159958+0000","last_unstale":"2023-07-14T13:29:48.661773+0000","last_undegraded":"2023-07-14T13:29:48.661773+0000","last_fullsized":"2023-07-14T13:29:48.661773+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:25:04.968865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141616+0000","last_change":"2023-07-14T13:29:46.165214+0000","last_active":"2023-07-14T13:29:47.141616+0000","last_peered":"2023-07-14T13:29:47.141616+0000","last_clean":"2023-07-14T13:29:47.141616+0000","last_became_active":"2023-07-14T13:29:46.164908+0000","last_became_peered":"2023-07-14T13:29:46.164908+0000","last_unstale":"2023-07-14T13:29:47.141616+0000","last_undegraded":"2023-07-14T13:29:47.141616+0000","last_fullsized":"2023-07-14T13:29:47.141616+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:23:47.997179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141388+0000","last_change":"2023-07-14T13:29:46.163840+0000","last_active":"2023-07-14T13:29:47.141388+0000","last_peered":"2023-07-14T13:29:47.141388+0000","last_clean":"2023-07-14T13:29:47.141388+0000","last_became_active":"2023-07-14T13:29:46.163561+0000","last_became_peered":"2023-07-14T13:29:46.163561+0000","last_unstale":"2023-07-14T13:29:47.141388+0000","last_undegraded":"2023-07-14T13:29:47.141388+0000","last_fullsized":"2023-07-14T13:29:47.141388+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:31:33.867324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.231034+0000","last_change":"2023-07-14T13:29:46.164182+0000","last_active":"2023-07-14T13:29:48.231034+0000","last_peered":"2023-07-14T13:29:48.231034+0000","last_clean":"2023-07-14T13:29:48.231034+0000","last_became_active":"2023-07-14T13:29:46.163898+0000","last_became_peered":"2023-07-14T13:29:46.163898+0000","last_unstale":"2023-07-14T13:29:48.231034+0000","last_undegraded":"2023-07-14T13:29:48.231034+0000","last_fullsized":"2023-07-14T13:29:48.231034+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:26:38.395035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146119+0000","last_change":"2023-07-14T13:29:46.157415+0000","last_active":"2023-07-14T13:29:47.146119+0000","last_peered":"2023-07-14T13:29:47.146119+0000","last_clean":"2023-07-14T13:29:47.146119+0000","last_became_active":"2023-07-14T13:29:46.156908+0000","last_became_peered":"2023-07-14T13:29:46.156908+0000","last_unstale":"2023-07-14T13:29:47.146119+0000","last_undegraded":"2023-07-14T13:29:47.146119+0000","last_fullsized":"2023-07-14T13:29:47.146119+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:24:50.135616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141617+0000","last_change":"2023-07-14T13:29:46.152971+0000","last_active":"2023-07-14T13:29:47.141617+0000","last_peered":"2023-07-14T13:29:47.141617+0000","last_clean":"2023-07-14T13:29:47.141617+0000","last_became_active":"2023-07-14T13:29:46.152641+0000","last_became_peered":"2023-07-14T13:29:46.152641+0000","last_unstale":"2023-07-14T13:29:47.141617+0000","last_undegraded":"2023-07-14T13:29:47.141617+0000","last_fullsized":"2023-07-14T13:29:47.141617+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:06:17.863530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141851+0000","last_change":"2023-07-14T13:29:46.151471+0000","last_active":"2023-07-14T13:29:47.141851+0000","last_peered":"2023-07-14T13:29:47.141851+0000","last_clean":"2023-07-14T13:29:47.141851+0000","last_became_active":"2023-07-14T13:29:46.150996+0000","last_became_peered":"2023-07-14T13:29:46.150996+0000","last_unstale":"2023-07-14T13:29:47.141851+0000","last_undegraded":"2023-07-14T13:29:47.141851+0000","last_fullsized":"2023-07-14T13:29:47.141851+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:36:46.294425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797696+0000","last_change":"2023-07-14T13:29:46.161038+0000","last_active":"2023-07-14T13:29:48.797696+0000","last_peered":"2023-07-14T13:29:48.797696+0000","last_clean":"2023-07-14T13:29:48.797696+0000","last_became_active":"2023-07-14T13:29:46.160750+0000","last_became_peered":"2023-07-14T13:29:46.160750+0000","last_unstale":"2023-07-14T13:29:48.797696+0000","last_undegraded":"2023-07-14T13:29:48.797696+0000","last_fullsized":"2023-07-14T13:29:48.797696+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:42:08.863141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.661748+0000","last_change":"2023-07-14T13:29:46.161772+0000","last_active":"2023-07-14T13:29:48.661748+0000","last_peered":"2023-07-14T13:29:48.661748+0000","last_clean":"2023-07-14T13:29:48.661748+0000","last_became_active":"2023-07-14T13:29:46.161487+0000","last_became_peered":"2023-07-14T13:29:46.161487+0000","last_unstale":"2023-07-14T13:29:48.661748+0000","last_undegraded":"2023-07-14T13:29:48.661748+0000","last_fullsized":"2023-07-14T13:29:48.661748+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:47:29.686387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141480+0000","last_change":"2023-07-14T13:29:46.149699+0000","last_active":"2023-07-14T13:29:47.141480+0000","last_peered":"2023-07-14T13:29:47.141480+0000","last_clean":"2023-07-14T13:29:47.141480+0000","last_became_active":"2023-07-14T13:29:46.149429+0000","last_became_peered":"2023-07-14T13:29:46.149429+0000","last_unstale":"2023-07-14T13:29:47.141480+0000","last_undegraded":"2023-07-14T13:29:47.141480+0000","last_fullsized":"2023-07-14T13:29:47.141480+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:55:39.460034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.661868+0000","last_change":"2023-07-14T13:29:46.159676+0000","last_active":"2023-07-14T13:29:48.661868+0000","last_peered":"2023-07-14T13:29:48.661868+0000","last_clean":"2023-07-14T13:29:48.661868+0000","last_became_active":"2023-07-14T13:29:46.159394+0000","last_became_peered":"2023-07-14T13:29:46.159394+0000","last_unstale":"2023-07-14T13:29:48.661868+0000","last_undegraded":"2023-07-14T13:29:48.661868+0000","last_fullsized":"2023-07-14T13:29:48.661868+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:34:03.073288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479340+0000","last_change":"2023-07-14T13:29:46.160166+0000","last_active":"2023-07-14T13:29:48.479340+0000","last_peered":"2023-07-14T13:29:48.479340+0000","last_clean":"2023-07-14T13:29:48.479340+0000","last_became_active":"2023-07-14T13:29:46.159843+0000","last_became_peered":"2023-07-14T13:29:46.159843+0000","last_unstale":"2023-07-14T13:29:48.479340+0000","last_undegraded":"2023-07-14T13:29:48.479340+0000","last_fullsized":"2023-07-14T13:29:48.479340+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:12:09.149124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141216+0000","last_change":"2023-07-14T13:29:46.155517+0000","last_active":"2023-07-14T13:29:47.141216+0000","last_peered":"2023-07-14T13:29:47.141216+0000","last_clean":"2023-07-14T13:29:47.141216+0000","last_became_active":"2023-07-14T13:29:46.155241+0000","last_became_peered":"2023-07-14T13:29:46.155241+0000","last_unstale":"2023-07-14T13:29:47.141216+0000","last_undegraded":"2023-07-14T13:29:47.141216+0000","last_fullsized":"2023-07-14T13:29:47.141216+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:23:00.388761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.662117+0000","last_change":"2023-07-14T13:29:46.156850+0000","last_active":"2023-07-14T13:29:48.662117+0000","last_peered":"2023-07-14T13:29:48.662117+0000","last_clean":"2023-07-14T13:29:48.662117+0000","last_became_active":"2023-07-14T13:29:46.156543+0000","last_became_peered":"2023-07-14T13:29:46.156543+0000","last_unstale":"2023-07-14T13:29:48.662117+0000","last_undegraded":"2023-07-14T13:29:48.662117+0000","last_fullsized":"2023-07-14T13:29:48.662117+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:10:17.555664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797786+0000","last_change":"2023-07-14T13:29:46.165903+0000","last_active":"2023-07-14T13:29:48.797786+0000","last_peered":"2023-07-14T13:29:48.797786+0000","last_clean":"2023-07-14T13:29:48.797786+0000","last_became_active":"2023-07-14T13:29:46.165382+0000","last_became_peered":"2023-07-14T13:29:46.165382+0000","last_unstale":"2023-07-14T13:29:48.797786+0000","last_undegraded":"2023-07-14T13:29:48.797786+0000","last_fullsized":"2023-07-14T13:29:48.797786+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:40:22.854519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.042519+0000","last_change":"2023-07-14T13:29:46.165184+0000","last_active":"2023-07-14T13:29:48.042519+0000","last_peered":"2023-07-14T13:29:48.042519+0000","last_clean":"2023-07-14T13:29:48.042519+0000","last_became_active":"2023-07-14T13:29:46.164773+0000","last_became_peered":"2023-07-14T13:29:46.164773+0000","last_unstale":"2023-07-14T13:29:48.042519+0000","last_undegraded":"2023-07-14T13:29:48.042519+0000","last_fullsized":"2023-07-14T13:29:48.042519+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:51:27.014087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:49.060361+0000","last_change":"2023-07-14T13:29:46.151003+0000","last_active":"2023-07-14T13:29:49.060361+0000","last_peered":"2023-07-14T13:29:49.060361+0000","last_clean":"2023-07-14T13:29:49.060361+0000","last_became_active":"2023-07-14T13:29:46.150704+0000","last_became_peered":"2023-07-14T13:29:46.150704+0000","last_unstale":"2023-07-14T13:29:49.060361+0000","last_undegraded":"2023-07-14T13:29:49.060361+0000","last_fullsized":"2023-07-14T13:29:49.060361+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:24.768994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141544+0000","last_change":"2023-07-14T13:29:46.153305+0000","last_active":"2023-07-14T13:29:47.141544+0000","last_peered":"2023-07-14T13:29:47.141544+0000","last_clean":"2023-07-14T13:29:47.141544+0000","last_became_active":"2023-07-14T13:29:46.153008+0000","last_became_peered":"2023-07-14T13:29:46.153008+0000","last_unstale":"2023-07-14T13:29:47.141544+0000","last_undegraded":"2023-07-14T13:29:47.141544+0000","last_fullsized":"2023-07-14T13:29:47.141544+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:16:23.727196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.230934+0000","last_change":"2023-07-14T13:29:46.166831+0000","last_active":"2023-07-14T13:29:48.230934+0000","last_peered":"2023-07-14T13:29:48.230934+0000","last_clean":"2023-07-14T13:29:48.230934+0000","last_became_active":"2023-07-14T13:29:46.166475+0000","last_became_peered":"2023-07-14T13:29:46.166475+0000","last_unstale":"2023-07-14T13:29:48.230934+0000","last_undegraded":"2023-07-14T13:29:48.230934+0000","last_fullsized":"2023-07-14T13:29:48.230934+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:29:11.403775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146015+0000","last_change":"2023-07-14T13:29:46.168865+0000","last_active":"2023-07-14T13:29:47.146015+0000","last_peered":"2023-07-14T13:29:47.146015+0000","last_clean":"2023-07-14T13:29:47.146015+0000","last_became_active":"2023-07-14T13:29:46.168603+0000","last_became_peered":"2023-07-14T13:29:46.168603+0000","last_unstale":"2023-07-14T13:29:47.146015+0000","last_undegraded":"2023-07-14T13:29:47.146015+0000","last_fullsized":"2023-07-14T13:29:47.146015+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:35:20.966733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797806+0000","last_change":"2023-07-14T13:29:46.155602+0000","last_active":"2023-07-14T13:29:48.797806+0000","last_peered":"2023-07-14T13:29:48.797806+0000","last_clean":"2023-07-14T13:29:48.797806+0000","last_became_active":"2023-07-14T13:29:46.155108+0000","last_became_peered":"2023-07-14T13:29:46.155108+0000","last_unstale":"2023-07-14T13:29:48.797806+0000","last_undegraded":"2023-07-14T13:29:48.797806+0000","last_fullsized":"2023-07-14T13:29:48.797806+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:13.416506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.231449+0000","last_change":"2023-07-14T13:29:46.167723+0000","last_active":"2023-07-14T13:29:48.231449+0000","last_peered":"2023-07-14T13:29:48.231449+0000","last_clean":"2023-07-14T13:29:48.231449+0000","last_became_active":"2023-07-14T13:29:46.167125+0000","last_became_peered":"2023-07-14T13:29:46.167125+0000","last_unstale":"2023-07-14T13:29:48.231449+0000","last_undegraded":"2023-07-14T13:29:48.231449+0000","last_fullsized":"2023-07-14T13:29:48.231449+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:43.999700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.231193+0000","last_change":"2023-07-14T13:29:46.167419+0000","last_active":"2023-07-14T13:29:48.231193+0000","last_peered":"2023-07-14T13:29:48.231193+0000","last_clean":"2023-07-14T13:29:48.231193+0000","last_became_active":"2023-07-14T13:29:46.166999+0000","last_became_peered":"2023-07-14T13:29:46.166999+0000","last_unstale":"2023-07-14T13:29:48.231193+0000","last_undegraded":"2023-07-14T13:29:48.231193+0000","last_fullsized":"2023-07-14T13:29:48.231193+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:29:41.684686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141791+0000","last_change":"2023-07-14T13:29:46.152988+0000","last_active":"2023-07-14T13:29:47.141791+0000","last_peered":"2023-07-14T13:29:47.141791+0000","last_clean":"2023-07-14T13:29:47.141791+0000","last_became_active":"2023-07-14T13:29:46.152697+0000","last_became_peered":"2023-07-14T13:29:46.152697+0000","last_unstale":"2023-07-14T13:29:47.141791+0000","last_undegraded":"2023-07-14T13:29:47.141791+0000","last_fullsized":"2023-07-14T13:29:47.141791+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:46:18.882359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797626+0000","last_change":"2023-07-14T13:29:46.156427+0000","last_active":"2023-07-14T13:29:48.797626+0000","last_peered":"2023-07-14T13:29:48.797626+0000","last_clean":"2023-07-14T13:29:48.797626+0000","last_became_active":"2023-07-14T13:29:46.156073+0000","last_became_peered":"2023-07-14T13:29:46.156073+0000","last_unstale":"2023-07-14T13:29:48.797626+0000","last_undegraded":"2023-07-14T13:29:48.797626+0000","last_fullsized":"2023-07-14T13:29:48.797626+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:22:17.681971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146211+0000","last_change":"2023-07-14T13:29:46.150139+0000","last_active":"2023-07-14T13:29:47.146211+0000","last_peered":"2023-07-14T13:29:47.146211+0000","last_clean":"2023-07-14T13:29:47.146211+0000","last_became_active":"2023-07-14T13:29:46.149853+0000","last_became_peered":"2023-07-14T13:29:46.149853+0000","last_unstale":"2023-07-14T13:29:47.146211+0000","last_undegraded":"2023-07-14T13:29:47.146211+0000","last_fullsized":"2023-07-14T13:29:47.146211+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:52:58.328252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797616+0000","last_change":"2023-07-14T13:29:46.159106+0000","last_active":"2023-07-14T13:29:48.797616+0000","last_peered":"2023-07-14T13:29:48.797616+0000","last_clean":"2023-07-14T13:29:48.797616+0000","last_became_active":"2023-07-14T13:29:46.158801+0000","last_became_peered":"2023-07-14T13:29:46.158801+0000","last_unstale":"2023-07-14T13:29:48.797616+0000","last_undegraded":"2023-07-14T13:29:48.797616+0000","last_fullsized":"2023-07-14T13:29:48.797616+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:20:40.273751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141222+0000","last_change":"2023-07-14T13:29:46.155534+0000","last_active":"2023-07-14T13:29:47.141222+0000","last_peered":"2023-07-14T13:29:47.141222+0000","last_clean":"2023-07-14T13:29:47.141222+0000","last_became_active":"2023-07-14T13:29:46.155265+0000","last_became_peered":"2023-07-14T13:29:46.155265+0000","last_unstale":"2023-07-14T13:29:47.141222+0000","last_undegraded":"2023-07-14T13:29:47.141222+0000","last_fullsized":"2023-07-14T13:29:47.141222+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:58:07.820454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.145962+0000","last_change":"2023-07-14T13:29:46.159148+0000","last_active":"2023-07-14T13:29:47.145962+0000","last_peered":"2023-07-14T13:29:47.145962+0000","last_clean":"2023-07-14T13:29:47.145962+0000","last_became_active":"2023-07-14T13:29:46.157198+0000","last_became_peered":"2023-07-14T13:29:46.157198+0000","last_unstale":"2023-07-14T13:29:47.145962+0000","last_undegraded":"2023-07-14T13:29:47.145962+0000","last_fullsized":"2023-07-14T13:29:47.145962+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:06:21.860997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479648+0000","last_change":"2023-07-14T13:29:46.162714+0000","last_active":"2023-07-14T13:29:48.479648+0000","last_peered":"2023-07-14T13:29:48.479648+0000","last_clean":"2023-07-14T13:29:48.479648+0000","last_became_active":"2023-07-14T13:29:46.162123+0000","last_became_peered":"2023-07-14T13:29:46.162123+0000","last_unstale":"2023-07-14T13:29:48.479648+0000","last_undegraded":"2023-07-14T13:29:48.479648+0000","last_fullsized":"2023-07-14T13:29:48.479648+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:36.907010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"171'4","reported_seq":17,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141806+0000","last_change":"2023-07-14T13:29:45.169422+0000","last_active":"2023-07-14T13:29:47.141806+0000","last_peered":"2023-07-14T13:29:47.141806+0000","last_clean":"2023-07-14T13:29:47.141806+0000","last_became_active":"2023-07-14T13:29:45.169138+0000","last_became_peered":"2023-07-14T13:29:45.169138+0000","last_unstale":"2023-07-14T13:29:47.141806+0000","last_undegraded":"2023-07-14T13:29:47.141806+0000","last_fullsized":"2023-07-14T13:29:47.141806+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:58:31.107549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479614+0000","last_change":"2023-07-14T13:29:46.160327+0000","last_active":"2023-07-14T13:29:48.479614+0000","last_peered":"2023-07-14T13:29:48.479614+0000","last_clean":"2023-07-14T13:29:48.479614+0000","last_became_active":"2023-07-14T13:29:46.159195+0000","last_became_peered":"2023-07-14T13:29:46.159195+0000","last_unstale":"2023-07-14T13:29:48.479614+0000","last_undegraded":"2023-07-14T13:29:48.479614+0000","last_fullsized":"2023-07-14T13:29:48.479614+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:15:41.664289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.042160+0000","last_change":"2023-07-14T13:29:45.179013+0000","last_active":"2023-07-14T13:29:48.042160+0000","last_peered":"2023-07-14T13:29:48.042160+0000","last_clean":"2023-07-14T13:29:48.042160+0000","last_became_active":"2023-07-14T13:29:45.178697+0000","last_became_peered":"2023-07-14T13:29:45.178697+0000","last_unstale":"2023-07-14T13:29:48.042160+0000","last_undegraded":"2023-07-14T13:29:48.042160+0000","last_fullsized":"2023-07-14T13:29:48.042160+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:48:50.280298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146443+0000","last_change":"2023-07-14T13:29:46.161735+0000","last_active":"2023-07-14T13:29:47.146443+0000","last_peered":"2023-07-14T13:29:47.146443+0000","last_clean":"2023-07-14T13:29:47.146443+0000","last_became_active":"2023-07-14T13:29:46.161340+0000","last_became_peered":"2023-07-14T13:29:46.161340+0000","last_unstale":"2023-07-14T13:29:47.146443+0000","last_undegraded":"2023-07-14T13:29:47.146443+0000","last_fullsized":"2023-07-14T13:29:47.146443+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:45:00.745964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.042324+0000","last_change":"2023-07-14T13:29:45.179398+0000","last_active":"2023-07-14T13:29:48.042324+0000","last_peered":"2023-07-14T13:29:48.042324+0000","last_clean":"2023-07-14T13:29:48.042324+0000","last_became_active":"2023-07-14T13:29:45.179056+0000","last_became_peered":"2023-07-14T13:29:45.179056+0000","last_unstale":"2023-07-14T13:29:48.042324+0000","last_undegraded":"2023-07-14T13:29:48.042324+0000","last_fullsized":"2023-07-14T13:29:48.042324+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:58:37.681416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.042435+0000","last_change":"2023-07-14T13:29:46.169159+0000","last_active":"2023-07-14T13:29:48.042435+0000","last_peered":"2023-07-14T13:29:48.042435+0000","last_clean":"2023-07-14T13:29:48.042435+0000","last_became_active":"2023-07-14T13:29:46.168883+0000","last_became_peered":"2023-07-14T13:29:46.168883+0000","last_unstale":"2023-07-14T13:29:48.042435+0000","last_undegraded":"2023-07-14T13:29:48.042435+0000","last_fullsized":"2023-07-14T13:29:48.042435+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:40:10.432275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479548+0000","last_change":"2023-07-14T13:29:45.163603+0000","last_active":"2023-07-14T13:29:48.479548+0000","last_peered":"2023-07-14T13:29:48.479548+0000","last_clean":"2023-07-14T13:29:48.479548+0000","last_became_active":"2023-07-14T13:29:45.163310+0000","last_became_peered":"2023-07-14T13:29:45.163310+0000","last_unstale":"2023-07-14T13:29:48.479548+0000","last_undegraded":"2023-07-14T13:29:48.479548+0000","last_fullsized":"2023-07-14T13:29:48.479548+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:53:27.366678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:49.060181+0000","last_change":"2023-07-14T13:29:46.154089+0000","last_active":"2023-07-14T13:29:49.060181+0000","last_peered":"2023-07-14T13:29:49.060181+0000","last_clean":"2023-07-14T13:29:49.060181+0000","last_became_active":"2023-07-14T13:29:46.153663+0000","last_became_peered":"2023-07-14T13:29:46.153663+0000","last_unstale":"2023-07-14T13:29:49.060181+0000","last_undegraded":"2023-07-14T13:29:49.060181+0000","last_fullsized":"2023-07-14T13:29:49.060181+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:30.137865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146336+0000","last_change":"2023-07-14T13:29:45.177250+0000","last_active":"2023-07-14T13:29:47.146336+0000","last_peered":"2023-07-14T13:29:47.146336+0000","last_clean":"2023-07-14T13:29:47.146336+0000","last_became_active":"2023-07-14T13:29:45.176926+0000","last_became_peered":"2023-07-14T13:29:45.176926+0000","last_unstale":"2023-07-14T13:29:47.146336+0000","last_undegraded":"2023-07-14T13:29:47.146336+0000","last_fullsized":"2023-07-14T13:29:47.146336+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:21:29.147948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.661774+0000","last_change":"2023-07-14T13:29:46.160299+0000","last_active":"2023-07-14T13:29:48.661774+0000","last_peered":"2023-07-14T13:29:48.661774+0000","last_clean":"2023-07-14T13:29:48.661774+0000","last_became_active":"2023-07-14T13:29:46.159941+0000","last_became_peered":"2023-07-14T13:29:46.159941+0000","last_unstale":"2023-07-14T13:29:48.661774+0000","last_undegraded":"2023-07-14T13:29:48.661774+0000","last_fullsized":"2023-07-14T13:29:48.661774+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:33:19.954278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141484+0000","last_change":"2023-07-14T13:29:45.173114+0000","last_active":"2023-07-14T13:29:47.141484+0000","last_peered":"2023-07-14T13:29:47.141484+0000","last_clean":"2023-07-14T13:29:47.141484+0000","last_became_active":"2023-07-14T13:29:45.172835+0000","last_became_peered":"2023-07-14T13:29:45.172835+0000","last_unstale":"2023-07-14T13:29:47.141484+0000","last_undegraded":"2023-07-14T13:29:47.141484+0000","last_fullsized":"2023-07-14T13:29:47.141484+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:27:21.083351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479370+0000","last_change":"2023-07-14T13:29:46.154070+0000","last_active":"2023-07-14T13:29:48.479370+0000","last_peered":"2023-07-14T13:29:48.479370+0000","last_clean":"2023-07-14T13:29:48.479370+0000","last_became_active":"2023-07-14T13:29:46.153808+0000","last_became_peered":"2023-07-14T13:29:46.153808+0000","last_unstale":"2023-07-14T13:29:48.479370+0000","last_undegraded":"2023-07-14T13:29:48.479370+0000","last_fullsized":"2023-07-14T13:29:48.479370+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:29:11.403775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.231071+0000","last_change":"2023-07-14T13:29:45.178797+0000","last_active":"2023-07-14T13:29:48.231071+0000","last_peered":"2023-07-14T13:29:48.231071+0000","last_clean":"2023-07-14T13:29:48.231071+0000","last_became_active":"2023-07-14T13:29:45.178277+0000","last_became_peered":"2023-07-14T13:29:45.178277+0000","last_unstale":"2023-07-14T13:29:48.231071+0000","last_undegraded":"2023-07-14T13:29:48.231071+0000","last_fullsized":"2023-07-14T13:29:48.231071+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:09:55.175431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.231130+0000","last_change":"2023-07-14T13:29:46.166694+0000","last_active":"2023-07-14T13:29:48.231130+0000","last_peered":"2023-07-14T13:29:48.231130+0000","last_clean":"2023-07-14T13:29:48.231130+0000","last_became_active":"2023-07-14T13:29:46.166404+0000","last_became_peered":"2023-07-14T13:29:46.166404+0000","last_unstale":"2023-07-14T13:29:48.231130+0000","last_undegraded":"2023-07-14T13:29:48.231130+0000","last_fullsized":"2023-07-14T13:29:48.231130+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:40:20.487679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141245+0000","last_change":"2023-07-14T13:29:45.171928+0000","last_active":"2023-07-14T13:29:47.141245+0000","last_peered":"2023-07-14T13:29:47.141245+0000","last_clean":"2023-07-14T13:29:47.141245+0000","last_became_active":"2023-07-14T13:29:45.171477+0000","last_became_peered":"2023-07-14T13:29:45.171477+0000","last_unstale":"2023-07-14T13:29:47.141245+0000","last_undegraded":"2023-07-14T13:29:47.141245+0000","last_fullsized":"2023-07-14T13:29:47.141245+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:34:09.091228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.042084+0000","last_change":"2023-07-14T13:29:46.163804+0000","last_active":"2023-07-14T13:29:48.042084+0000","last_peered":"2023-07-14T13:29:48.042084+0000","last_clean":"2023-07-14T13:29:48.042084+0000","last_became_active":"2023-07-14T13:29:46.163452+0000","last_became_peered":"2023-07-14T13:29:46.163452+0000","last_unstale":"2023-07-14T13:29:48.042084+0000","last_undegraded":"2023-07-14T13:29:48.042084+0000","last_fullsized":"2023-07-14T13:29:48.042084+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:25:03.359595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797671+0000","last_change":"2023-07-14T13:29:45.170109+0000","last_active":"2023-07-14T13:29:48.797671+0000","last_peered":"2023-07-14T13:29:48.797671+0000","last_clean":"2023-07-14T13:29:48.797671+0000","last_became_active":"2023-07-14T13:29:45.169830+0000","last_became_peered":"2023-07-14T13:29:45.169830+0000","last_unstale":"2023-07-14T13:29:48.797671+0000","last_undegraded":"2023-07-14T13:29:48.797671+0000","last_fullsized":"2023-07-14T13:29:48.797671+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:46:28.314128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.042358+0000","last_change":"2023-07-14T13:29:46.165239+0000","last_active":"2023-07-14T13:29:48.042358+0000","last_peered":"2023-07-14T13:29:48.042358+0000","last_clean":"2023-07-14T13:29:48.042358+0000","last_became_active":"2023-07-14T13:29:46.164745+0000","last_became_peered":"2023-07-14T13:29:46.164745+0000","last_unstale":"2023-07-14T13:29:48.042358+0000","last_undegraded":"2023-07-14T13:29:48.042358+0000","last_fullsized":"2023-07-14T13:29:48.042358+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:22:41.106120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.042200+0000","last_change":"2023-07-14T13:29:45.179180+0000","last_active":"2023-07-14T13:29:48.042200+0000","last_peered":"2023-07-14T13:29:48.042200+0000","last_clean":"2023-07-14T13:29:48.042200+0000","last_became_active":"2023-07-14T13:29:45.178865+0000","last_became_peered":"2023-07-14T13:29:45.178865+0000","last_unstale":"2023-07-14T13:29:48.042200+0000","last_undegraded":"2023-07-14T13:29:48.042200+0000","last_fullsized":"2023-07-14T13:29:48.042200+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:21:15.733946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.231451+0000","last_change":"2023-07-14T13:29:46.166760+0000","last_active":"2023-07-14T13:29:48.231451+0000","last_peered":"2023-07-14T13:29:48.231451+0000","last_clean":"2023-07-14T13:29:48.231451+0000","last_became_active":"2023-07-14T13:29:46.166396+0000","last_became_peered":"2023-07-14T13:29:46.166396+0000","last_unstale":"2023-07-14T13:29:48.231451+0000","last_undegraded":"2023-07-14T13:29:48.231451+0000","last_fullsized":"2023-07-14T13:29:48.231451+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:42:29.116585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479710+0000","last_change":"2023-07-14T13:29:45.175075+0000","last_active":"2023-07-14T13:29:48.479710+0000","last_peered":"2023-07-14T13:29:48.479710+0000","last_clean":"2023-07-14T13:29:48.479710+0000","last_became_active":"2023-07-14T13:29:45.174845+0000","last_became_peered":"2023-07-14T13:29:45.174845+0000","last_unstale":"2023-07-14T13:29:48.479710+0000","last_undegraded":"2023-07-14T13:29:48.479710+0000","last_fullsized":"2023-07-14T13:29:48.479710+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:42.991173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.231517+0000","last_change":"2023-07-14T13:29:46.166502+0000","last_active":"2023-07-14T13:29:48.231517+0000","last_peered":"2023-07-14T13:29:48.231517+0000","last_clean":"2023-07-14T13:29:48.231517+0000","last_became_active":"2023-07-14T13:29:46.166164+0000","last_became_peered":"2023-07-14T13:29:46.166164+0000","last_unstale":"2023-07-14T13:29:48.231517+0000","last_undegraded":"2023-07-14T13:29:48.231517+0000","last_fullsized":"2023-07-14T13:29:48.231517+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:07:59.750061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.661891+0000","last_change":"2023-07-14T13:29:45.176241+0000","last_active":"2023-07-14T13:29:48.661891+0000","last_peered":"2023-07-14T13:29:48.661891+0000","last_clean":"2023-07-14T13:29:48.661891+0000","last_became_active":"2023-07-14T13:29:45.175938+0000","last_became_peered":"2023-07-14T13:29:45.175938+0000","last_unstale":"2023-07-14T13:29:48.661891+0000","last_undegraded":"2023-07-14T13:29:48.661891+0000","last_fullsized":"2023-07-14T13:29:48.661891+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:38:17.611925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.041980+0000","last_change":"2023-07-14T13:29:46.168119+0000","last_active":"2023-07-14T13:29:48.041980+0000","last_peered":"2023-07-14T13:29:48.041980+0000","last_clean":"2023-07-14T13:29:48.041980+0000","last_became_active":"2023-07-14T13:29:46.167815+0000","last_became_peered":"2023-07-14T13:29:46.167815+0000","last_unstale":"2023-07-14T13:29:48.041980+0000","last_undegraded":"2023-07-14T13:29:48.041980+0000","last_fullsized":"2023-07-14T13:29:48.041980+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:21:27.666069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:49.060345+0000","last_change":"2023-07-14T13:29:45.175827+0000","last_active":"2023-07-14T13:29:49.060345+0000","last_peered":"2023-07-14T13:29:49.060345+0000","last_clean":"2023-07-14T13:29:49.060345+0000","last_became_active":"2023-07-14T13:29:45.175532+0000","last_became_peered":"2023-07-14T13:29:45.175532+0000","last_unstale":"2023-07-14T13:29:49.060345+0000","last_undegraded":"2023-07-14T13:29:49.060345+0000","last_fullsized":"2023-07-14T13:29:49.060345+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:46:17.873832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479490+0000","last_change":"2023-07-14T13:29:46.165792+0000","last_active":"2023-07-14T13:29:48.479490+0000","last_peered":"2023-07-14T13:29:48.479490+0000","last_clean":"2023-07-14T13:29:48.479490+0000","last_became_active":"2023-07-14T13:29:46.165479+0000","last_became_peered":"2023-07-14T13:29:46.165479+0000","last_unstale":"2023-07-14T13:29:48.479490+0000","last_undegraded":"2023-07-14T13:29:48.479490+0000","last_fullsized":"2023-07-14T13:29:48.479490+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:09:56.183958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146005+0000","last_change":"2023-07-14T13:29:45.173121+0000","last_active":"2023-07-14T13:29:47.146005+0000","last_peered":"2023-07-14T13:29:47.146005+0000","last_clean":"2023-07-14T13:29:47.146005+0000","last_became_active":"2023-07-14T13:29:45.172588+0000","last_became_peered":"2023-07-14T13:29:45.172588+0000","last_unstale":"2023-07-14T13:29:47.146005+0000","last_undegraded":"2023-07-14T13:29:47.146005+0000","last_fullsized":"2023-07-14T13:29:47.146005+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:51:26.781033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.041913+0000","last_change":"2023-07-14T13:29:46.163829+0000","last_active":"2023-07-14T13:29:48.041913+0000","last_peered":"2023-07-14T13:29:48.041913+0000","last_clean":"2023-07-14T13:29:48.041913+0000","last_became_active":"2023-07-14T13:29:46.163380+0000","last_became_peered":"2023-07-14T13:29:46.163380+0000","last_unstale":"2023-07-14T13:29:48.041913+0000","last_undegraded":"2023-07-14T13:29:48.041913+0000","last_fullsized":"2023-07-14T13:29:48.041913+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:30:22.996469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:49.060129+0000","last_change":"2023-07-14T13:29:45.172122+0000","last_active":"2023-07-14T13:29:49.060129+0000","last_peered":"2023-07-14T13:29:49.060129+0000","last_clean":"2023-07-14T13:29:49.060129+0000","last_became_active":"2023-07-14T13:29:45.171842+0000","last_became_peered":"2023-07-14T13:29:45.171842+0000","last_unstale":"2023-07-14T13:29:49.060129+0000","last_undegraded":"2023-07-14T13:29:49.060129+0000","last_fullsized":"2023-07-14T13:29:49.060129+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:06:16.855003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479597+0000","last_change":"2023-07-14T13:29:46.159571+0000","last_active":"2023-07-14T13:29:48.479597+0000","last_peered":"2023-07-14T13:29:48.479597+0000","last_clean":"2023-07-14T13:29:48.479597+0000","last_became_active":"2023-07-14T13:29:46.159131+0000","last_became_peered":"2023-07-14T13:29:46.159131+0000","last_unstale":"2023-07-14T13:29:48.479597+0000","last_undegraded":"2023-07-14T13:29:48.479597+0000","last_fullsized":"2023-07-14T13:29:48.479597+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:29:41.684686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146568+0000","last_change":"2023-07-14T13:29:45.172255+0000","last_active":"2023-07-14T13:29:47.146568+0000","last_peered":"2023-07-14T13:29:47.146568+0000","last_clean":"2023-07-14T13:29:47.146568+0000","last_became_active":"2023-07-14T13:29:45.171958+0000","last_became_peered":"2023-07-14T13:29:45.171958+0000","last_unstale":"2023-07-14T13:29:47.146568+0000","last_undegraded":"2023-07-14T13:29:47.146568+0000","last_fullsized":"2023-07-14T13:29:47.146568+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:03:09.694947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141579+0000","last_change":"2023-07-14T13:29:46.163846+0000","last_active":"2023-07-14T13:29:47.141579+0000","last_peered":"2023-07-14T13:29:47.141579+0000","last_clean":"2023-07-14T13:29:47.141579+0000","last_became_active":"2023-07-14T13:29:46.163582+0000","last_became_peered":"2023-07-14T13:29:46.163582+0000","last_unstale":"2023-07-14T13:29:47.141579+0000","last_undegraded":"2023-07-14T13:29:47.141579+0000","last_fullsized":"2023-07-14T13:29:47.141579+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:30:43.385089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.662079+0000","last_change":"2023-07-14T13:29:45.179021+0000","last_active":"2023-07-14T13:29:48.662079+0000","last_peered":"2023-07-14T13:29:48.662079+0000","last_clean":"2023-07-14T13:29:48.662079+0000","last_became_active":"2023-07-14T13:29:45.178769+0000","last_became_peered":"2023-07-14T13:29:45.178769+0000","last_unstale":"2023-07-14T13:29:48.662079+0000","last_undegraded":"2023-07-14T13:29:48.662079+0000","last_fullsized":"2023-07-14T13:29:48.662079+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:25:32.357914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.662002+0000","last_change":"2023-07-14T13:29:46.162113+0000","last_active":"2023-07-14T13:29:48.662002+0000","last_peered":"2023-07-14T13:29:48.662002+0000","last_clean":"2023-07-14T13:29:48.662002+0000","last_became_active":"2023-07-14T13:29:46.161832+0000","last_became_peered":"2023-07-14T13:29:46.161832+0000","last_unstale":"2023-07-14T13:29:48.662002+0000","last_undegraded":"2023-07-14T13:29:48.662002+0000","last_fullsized":"2023-07-14T13:29:48.662002+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:07:28.634874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.231549+0000","last_change":"2023-07-14T13:29:45.181966+0000","last_active":"2023-07-14T13:29:48.231549+0000","last_peered":"2023-07-14T13:29:48.231549+0000","last_clean":"2023-07-14T13:29:48.231549+0000","last_became_active":"2023-07-14T13:29:45.181519+0000","last_became_peered":"2023-07-14T13:29:45.181519+0000","last_unstale":"2023-07-14T13:29:48.231549+0000","last_undegraded":"2023-07-14T13:29:48.231549+0000","last_fullsized":"2023-07-14T13:29:48.231549+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:38:49.783919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.231427+0000","last_change":"2023-07-14T13:29:46.166149+0000","last_active":"2023-07-14T13:29:48.231427+0000","last_peered":"2023-07-14T13:29:48.231427+0000","last_clean":"2023-07-14T13:29:48.231427+0000","last_became_active":"2023-07-14T13:29:46.165832+0000","last_became_peered":"2023-07-14T13:29:46.165832+0000","last_unstale":"2023-07-14T13:29:48.231427+0000","last_undegraded":"2023-07-14T13:29:48.231427+0000","last_fullsized":"2023-07-14T13:29:48.231427+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:01.004278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479790+0000","last_change":"2023-07-14T13:29:45.170294+0000","last_active":"2023-07-14T13:29:48.479790+0000","last_peered":"2023-07-14T13:29:48.479790+0000","last_clean":"2023-07-14T13:29:48.479790+0000","last_became_active":"2023-07-14T13:29:45.170018+0000","last_became_peered":"2023-07-14T13:29:45.170018+0000","last_unstale":"2023-07-14T13:29:48.479790+0000","last_undegraded":"2023-07-14T13:29:48.479790+0000","last_fullsized":"2023-07-14T13:29:48.479790+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:07:58.741534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141753+0000","last_change":"2023-07-14T13:29:46.159322+0000","last_active":"2023-07-14T13:29:47.141753+0000","last_peered":"2023-07-14T13:29:47.141753+0000","last_clean":"2023-07-14T13:29:47.141753+0000","last_became_active":"2023-07-14T13:29:46.159056+0000","last_became_peered":"2023-07-14T13:29:46.159056+0000","last_unstale":"2023-07-14T13:29:47.141753+0000","last_undegraded":"2023-07-14T13:29:47.141753+0000","last_fullsized":"2023-07-14T13:29:47.141753+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:24.768994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141634+0000","last_change":"2023-07-14T13:29:45.175896+0000","last_active":"2023-07-14T13:29:47.141634+0000","last_peered":"2023-07-14T13:29:47.141634+0000","last_clean":"2023-07-14T13:29:47.141634+0000","last_became_active":"2023-07-14T13:29:45.175541+0000","last_became_peered":"2023-07-14T13:29:45.175541+0000","last_unstale":"2023-07-14T13:29:47.141634+0000","last_undegraded":"2023-07-14T13:29:47.141634+0000","last_fullsized":"2023-07-14T13:29:47.141634+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:16:29.129338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146365+0000","last_change":"2023-07-14T13:29:46.154310+0000","last_active":"2023-07-14T13:29:47.146365+0000","last_peered":"2023-07-14T13:29:47.146365+0000","last_clean":"2023-07-14T13:29:47.146365+0000","last_became_active":"2023-07-14T13:29:46.153864+0000","last_became_peered":"2023-07-14T13:29:46.153864+0000","last_unstale":"2023-07-14T13:29:47.146365+0000","last_undegraded":"2023-07-14T13:29:47.146365+0000","last_fullsized":"2023-07-14T13:29:47.146365+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:14:22.808642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.231110+0000","last_change":"2023-07-14T13:29:45.178052+0000","last_active":"2023-07-14T13:29:48.231110+0000","last_peered":"2023-07-14T13:29:48.231110+0000","last_clean":"2023-07-14T13:29:48.231110+0000","last_became_active":"2023-07-14T13:29:45.177773+0000","last_became_peered":"2023-07-14T13:29:45.177773+0000","last_unstale":"2023-07-14T13:29:48.231110+0000","last_undegraded":"2023-07-14T13:29:48.231110+0000","last_fullsized":"2023-07-14T13:29:48.231110+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:33:25.302305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.661771+0000","last_change":"2023-07-14T13:29:46.161056+0000","last_active":"2023-07-14T13:29:48.661771+0000","last_peered":"2023-07-14T13:29:48.661771+0000","last_clean":"2023-07-14T13:29:48.661771+0000","last_became_active":"2023-07-14T13:29:46.160648+0000","last_became_peered":"2023-07-14T13:29:46.160648+0000","last_unstale":"2023-07-14T13:29:48.661771+0000","last_undegraded":"2023-07-14T13:29:48.661771+0000","last_fullsized":"2023-07-14T13:29:48.661771+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:26:50.942093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797562+0000","last_change":"2023-07-14T13:29:45.171477+0000","last_active":"2023-07-14T13:29:48.797562+0000","last_peered":"2023-07-14T13:29:48.797562+0000","last_clean":"2023-07-14T13:29:48.797562+0000","last_became_active":"2023-07-14T13:29:45.171199+0000","last_became_peered":"2023-07-14T13:29:45.171199+0000","last_unstale":"2023-07-14T13:29:48.797562+0000","last_undegraded":"2023-07-14T13:29:48.797562+0000","last_fullsized":"2023-07-14T13:29:48.797562+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:54:45.698963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479447+0000","last_change":"2023-07-14T13:29:46.156947+0000","last_active":"2023-07-14T13:29:48.479447+0000","last_peered":"2023-07-14T13:29:48.479447+0000","last_clean":"2023-07-14T13:29:48.479447+0000","last_became_active":"2023-07-14T13:29:46.156662+0000","last_became_peered":"2023-07-14T13:29:46.156662+0000","last_unstale":"2023-07-14T13:29:48.479447+0000","last_undegraded":"2023-07-14T13:29:48.479447+0000","last_fullsized":"2023-07-14T13:29:48.479447+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:40:20.487679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.231142+0000","last_change":"2023-07-14T13:29:45.178591+0000","last_active":"2023-07-14T13:29:48.231142+0000","last_peered":"2023-07-14T13:29:48.231142+0000","last_clean":"2023-07-14T13:29:48.231142+0000","last_became_active":"2023-07-14T13:29:45.177951+0000","last_became_peered":"2023-07-14T13:29:45.177951+0000","last_unstale":"2023-07-14T13:29:48.231142+0000","last_undegraded":"2023-07-14T13:29:48.231142+0000","last_fullsized":"2023-07-14T13:29:48.231142+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:53:27.366678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146203+0000","last_change":"2023-07-14T13:29:46.158420+0000","last_active":"2023-07-14T13:29:47.146203+0000","last_peered":"2023-07-14T13:29:47.146203+0000","last_clean":"2023-07-14T13:29:47.146203+0000","last_became_active":"2023-07-14T13:29:46.158157+0000","last_became_peered":"2023-07-14T13:29:46.158157+0000","last_unstale":"2023-07-14T13:29:47.146203+0000","last_undegraded":"2023-07-14T13:29:47.146203+0000","last_fullsized":"2023-07-14T13:29:47.146203+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:39:57.006292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.041936+0000","last_change":"2023-07-14T13:29:45.175667+0000","last_active":"2023-07-14T13:29:48.041936+0000","last_peered":"2023-07-14T13:29:48.041936+0000","last_clean":"2023-07-14T13:29:48.041936+0000","last_became_active":"2023-07-14T13:29:45.174977+0000","last_became_peered":"2023-07-14T13:29:45.174977+0000","last_unstale":"2023-07-14T13:29:48.041936+0000","last_undegraded":"2023-07-14T13:29:48.041936+0000","last_fullsized":"2023-07-14T13:29:48.041936+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:18:52.659695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146622+0000","last_change":"2023-07-14T13:29:46.155886+0000","last_active":"2023-07-14T13:29:47.146622+0000","last_peered":"2023-07-14T13:29:47.146622+0000","last_clean":"2023-07-14T13:29:47.146622+0000","last_became_active":"2023-07-14T13:29:46.155575+0000","last_became_peered":"2023-07-14T13:29:46.155575+0000","last_unstale":"2023-07-14T13:29:47.146622+0000","last_undegraded":"2023-07-14T13:29:47.146622+0000","last_fullsized":"2023-07-14T13:29:47.146622+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:38:53.097885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"171'6","reported_seq":19,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:49.060214+0000","last_change":"2023-07-14T13:29:45.175838+0000","last_active":"2023-07-14T13:29:49.060214+0000","last_peered":"2023-07-14T13:29:49.060214+0000","last_clean":"2023-07-14T13:29:49.060214+0000","last_became_active":"2023-07-14T13:29:45.175543+0000","last_became_peered":"2023-07-14T13:29:45.175543+0000","last_unstale":"2023-07-14T13:29:49.060214+0000","last_undegraded":"2023-07-14T13:29:49.060214+0000","last_fullsized":"2023-07-14T13:29:49.060214+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:17:20.283333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"160'304","reported_seq":1112,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.042276+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:29:48.042276+0000","last_peered":"2023-07-14T13:29:48.042276+0000","last_clean":"2023-07-14T13:29:48.042276+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:29:48.042276+0000","last_undegraded":"2023-07-14T13:29:48.042276+0000","last_fullsized":"2023-07-14T13:29:48.042276+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:21:28.490486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":288,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.231221+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:29:48.231221+0000","last_peered":"2023-07-14T13:29:48.231221+0000","last_clean":"2023-07-14T13:29:48.231221+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:29:48.231221+0000","last_undegraded":"2023-07-14T13:29:48.231221+0000","last_fullsized":"2023-07-14T13:29:48.231221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:38:36.535934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146431+0000","last_change":"2023-07-14T13:29:46.159514+0000","last_active":"2023-07-14T13:29:47.146431+0000","last_peered":"2023-07-14T13:29:47.146431+0000","last_clean":"2023-07-14T13:29:47.146431+0000","last_became_active":"2023-07-14T13:29:46.158086+0000","last_became_peered":"2023-07-14T13:29:46.158086+0000","last_unstale":"2023-07-14T13:29:47.146431+0000","last_undegraded":"2023-07-14T13:29:47.146431+0000","last_fullsized":"2023-07-14T13:29:47.146431+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:16:18.528808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.042448+0000","last_change":"2023-07-14T13:29:45.176199+0000","last_active":"2023-07-14T13:29:48.042448+0000","last_peered":"2023-07-14T13:29:48.042448+0000","last_clean":"2023-07-14T13:29:48.042448+0000","last_became_active":"2023-07-14T13:29:45.174210+0000","last_became_peered":"2023-07-14T13:29:45.174210+0000","last_unstale":"2023-07-14T13:29:48.042448+0000","last_undegraded":"2023-07-14T13:29:48.042448+0000","last_fullsized":"2023-07-14T13:29:48.042448+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:44:21.390031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":293,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.042142+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:29:48.042142+0000","last_peered":"2023-07-14T13:29:48.042142+0000","last_clean":"2023-07-14T13:29:48.042142+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:29:48.042142+0000","last_undegraded":"2023-07-14T13:29:48.042142+0000","last_fullsized":"2023-07-14T13:29:48.042142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:37:08.677412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797720+0000","last_change":"2023-07-14T13:29:46.161055+0000","last_active":"2023-07-14T13:29:48.797720+0000","last_peered":"2023-07-14T13:29:48.797720+0000","last_clean":"2023-07-14T13:29:48.797720+0000","last_became_active":"2023-07-14T13:29:46.160756+0000","last_became_peered":"2023-07-14T13:29:46.160756+0000","last_unstale":"2023-07-14T13:29:48.797720+0000","last_undegraded":"2023-07-14T13:29:48.797720+0000","last_fullsized":"2023-07-14T13:29:48.797720+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:28:44.675715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.231486+0000","last_change":"2023-07-14T13:29:45.177678+0000","last_active":"2023-07-14T13:29:48.231486+0000","last_peered":"2023-07-14T13:29:48.231486+0000","last_clean":"2023-07-14T13:29:48.231486+0000","last_became_active":"2023-07-14T13:29:45.177424+0000","last_became_peered":"2023-07-14T13:29:45.177424+0000","last_unstale":"2023-07-14T13:29:48.231486+0000","last_undegraded":"2023-07-14T13:29:48.231486+0000","last_fullsized":"2023-07-14T13:29:48.231486+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:41:05.239051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":292,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797462+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:29:48.797462+0000","last_peered":"2023-07-14T13:29:48.797462+0000","last_clean":"2023-07-14T13:29:48.797462+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:29:48.797462+0000","last_undegraded":"2023-07-14T13:29:48.797462+0000","last_fullsized":"2023-07-14T13:29:48.797462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:14:45.493017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797812+0000","last_change":"2023-07-14T13:29:46.165798+0000","last_active":"2023-07-14T13:29:48.797812+0000","last_peered":"2023-07-14T13:29:48.797812+0000","last_clean":"2023-07-14T13:29:48.797812+0000","last_became_active":"2023-07-14T13:29:46.165366+0000","last_became_peered":"2023-07-14T13:29:46.165366+0000","last_unstale":"2023-07-14T13:29:48.797812+0000","last_undegraded":"2023-07-14T13:29:48.797812+0000","last_fullsized":"2023-07-14T13:29:48.797812+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:34:21.181467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"171'3","reported_seq":16,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.797772+0000","last_change":"2023-07-14T13:29:45.167394+0000","last_active":"2023-07-14T13:29:48.797772+0000","last_peered":"2023-07-14T13:29:48.797772+0000","last_clean":"2023-07-14T13:29:48.797772+0000","last_became_active":"2023-07-14T13:29:45.167109+0000","last_became_peered":"2023-07-14T13:29:45.167109+0000","last_unstale":"2023-07-14T13:29:48.797772+0000","last_undegraded":"2023-07-14T13:29:48.797772+0000","last_fullsized":"2023-07-14T13:29:48.797772+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:07:03.377007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":288,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.230959+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:29:48.230959+0000","last_peered":"2023-07-14T13:29:48.230959+0000","last_clean":"2023-07-14T13:29:48.230959+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:29:48.230959+0000","last_undegraded":"2023-07-14T13:29:48.230959+0000","last_fullsized":"2023-07-14T13:29:48.230959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:21.075157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.146524+0000","last_change":"2023-07-14T13:29:46.158284+0000","last_active":"2023-07-14T13:29:47.146524+0000","last_peered":"2023-07-14T13:29:47.146524+0000","last_clean":"2023-07-14T13:29:47.146524+0000","last_became_active":"2023-07-14T13:29:46.157955+0000","last_became_peered":"2023-07-14T13:29:46.157955+0000","last_unstale":"2023-07-14T13:29:47.146524+0000","last_undegraded":"2023-07-14T13:29:47.146524+0000","last_fullsized":"2023-07-14T13:29:47.146524+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:42:58.793494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141644+0000","last_change":"2023-07-14T13:29:45.167565+0000","last_active":"2023-07-14T13:29:47.141644+0000","last_peered":"2023-07-14T13:29:47.141644+0000","last_clean":"2023-07-14T13:29:47.141644+0000","last_became_active":"2023-07-14T13:29:45.167122+0000","last_became_peered":"2023-07-14T13:29:45.167122+0000","last_unstale":"2023-07-14T13:29:47.141644+0000","last_undegraded":"2023-07-14T13:29:47.141644+0000","last_fullsized":"2023-07-14T13:29:47.141644+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:17:20.283333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":300,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479725+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:29:48.479725+0000","last_peered":"2023-07-14T13:29:48.479725+0000","last_clean":"2023-07-14T13:29:48.479725+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:29:48.479725+0000","last_undegraded":"2023-07-14T13:29:48.479725+0000","last_fullsized":"2023-07-14T13:29:48.479725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:04:01.119223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479382+0000","last_change":"2023-07-14T13:29:46.159750+0000","last_active":"2023-07-14T13:29:48.479382+0000","last_peered":"2023-07-14T13:29:48.479382+0000","last_clean":"2023-07-14T13:29:48.479382+0000","last_became_active":"2023-07-14T13:29:46.159434+0000","last_became_peered":"2023-07-14T13:29:46.159434+0000","last_unstale":"2023-07-14T13:29:48.479382+0000","last_undegraded":"2023-07-14T13:29:48.479382+0000","last_fullsized":"2023-07-14T13:29:48.479382+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:25:26.203512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.661968+0000","last_change":"2023-07-14T13:29:45.176456+0000","last_active":"2023-07-14T13:29:48.661968+0000","last_peered":"2023-07-14T13:29:48.661968+0000","last_clean":"2023-07-14T13:29:48.661968+0000","last_became_active":"2023-07-14T13:29:45.175916+0000","last_became_peered":"2023-07-14T13:29:45.175916+0000","last_unstale":"2023-07-14T13:29:48.661968+0000","last_undegraded":"2023-07-14T13:29:48.661968+0000","last_fullsized":"2023-07-14T13:29:48.661968+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:51:13.493640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":290,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.042451+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:29:48.042451+0000","last_peered":"2023-07-14T13:29:48.042451+0000","last_clean":"2023-07-14T13:29:48.042451+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:29:48.042451+0000","last_undegraded":"2023-07-14T13:29:48.042451+0000","last_fullsized":"2023-07-14T13:29:48.042451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:16:55.408139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:47.141463+0000","last_change":"2023-07-14T13:29:46.150567+0000","last_active":"2023-07-14T13:29:47.141463+0000","last_peered":"2023-07-14T13:29:47.141463+0000","last_clean":"2023-07-14T13:29:47.141463+0000","last_became_active":"2023-07-14T13:29:46.150251+0000","last_became_peered":"2023-07-14T13:29:46.150251+0000","last_unstale":"2023-07-14T13:29:47.141463+0000","last_undegraded":"2023-07-14T13:29:47.141463+0000","last_fullsized":"2023-07-14T13:29:47.141463+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:35:51.313440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.661889+0000","last_change":"2023-07-14T13:29:45.178483+0000","last_active":"2023-07-14T13:29:48.661889+0000","last_peered":"2023-07-14T13:29:48.661889+0000","last_clean":"2023-07-14T13:29:48.661889+0000","last_became_active":"2023-07-14T13:29:45.178200+0000","last_became_peered":"2023-07-14T13:29:45.178200+0000","last_unstale":"2023-07-14T13:29:48.661889+0000","last_undegraded":"2023-07-14T13:29:48.661889+0000","last_fullsized":"2023-07-14T13:29:48.661889+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:42:05.537643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":300,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479710+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:29:48.479710+0000","last_peered":"2023-07-14T13:29:48.479710+0000","last_clean":"2023-07-14T13:29:48.479710+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:29:48.479710+0000","last_undegraded":"2023-07-14T13:29:48.479710+0000","last_fullsized":"2023-07-14T13:29:48.479710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:05:23.988230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.479427+0000","last_change":"2023-07-14T13:29:46.152496+0000","last_active":"2023-07-14T13:29:48.479427+0000","last_peered":"2023-07-14T13:29:48.479427+0000","last_clean":"2023-07-14T13:29:48.479427+0000","last_became_active":"2023-07-14T13:29:46.152230+0000","last_became_peered":"2023-07-14T13:29:46.152230+0000","last_unstale":"2023-07-14T13:29:48.479427+0000","last_undegraded":"2023-07-14T13:29:48.479427+0000","last_fullsized":"2023-07-14T13:29:48.479427+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:45.141888+0000","last_clean_scrub_stamp":"2023-07-14T13:29:45.141888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:26:38.395035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"171'8","reported_seq":21,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.230818+0000","last_change":"2023-07-14T13:29:45.180157+0000","last_active":"2023-07-14T13:29:48.230818+0000","last_peered":"2023-07-14T13:29:48.230818+0000","last_clean":"2023-07-14T13:29:48.230818+0000","last_became_active":"2023-07-14T13:29:45.179721+0000","last_became_peered":"2023-07-14T13:29:45.179721+0000","last_unstale":"2023-07-14T13:29:48.230818+0000","last_undegraded":"2023-07-14T13:29:48.230818+0000","last_fullsized":"2023-07-14T13:29:48.230818+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:29:44.133361+0000","last_clean_scrub_stamp":"2023-07-14T13:29:44.133361+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:12:08.140597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":292,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-14T13:29:48.662156+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:29:48.662156+0000","last_peered":"2023-07-14T13:29:48.662156+0000","last_clean":"2023-07-14T13:29:48.662156+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:29:48.662156+0000","last_undegraded":"2023-07-14T13:29:48.662156+0000","last_fullsized":"2023-07-14T13:29:48.662156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:27:43.938609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575290,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59968,"kb_used_data":2680,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94311872,"statfs":{"total":96636764160,"available":96575356928,"internally_reserved":0,"allocated":2744320,"data_stored":1691396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.72999999999999998,"15min":0.73599999999999999},"min":{"1min":0.49399999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73099999999999998,"15min":0.74399999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94799999999999995,"5min":1.016,"15min":1.032},"last":0.75600000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.47099999999999997,"5min":0.433,"15min":0.433},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76700000000000002,"15min":0.76400000000000001},"min":{"1min":0.55300000000000005,"5min":0.501,"15min":0.496},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.69199999999999995}]},{"osd":2,"last update":"Fri Jul 14 13:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.72499999999999998,"15min":0.74099999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1379999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.76500000000000001,"15min":0.76800000000000002},"min":{"1min":0.51700000000000002,"5min":0.495,"15min":0.495},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.875}]},{"osd":3,"last update":"Fri Jul 14 13:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.746,"15min":0.75700000000000001},"min":{"1min":0.59799999999999998,"5min":0.51600000000000001,"15min":0.499},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.78800000000000003,"15min":0.78000000000000003},"min":{"1min":0.623,"5min":0.48699999999999999,"15min":0.44700000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.78100000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59599999999999997,"15min":0.58599999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.35799999999999998},"max":{"1min":0.99099999999999999,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60799999999999998,"15min":0.623},"min":{"1min":0.45400000000000001,"5min":0.439,"15min":0.40400000000000003},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.99399999999999999},"last":0.72799999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60399999999999998,"15min":0.61199999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40200000000000002},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.64800000000000002,"15min":0.65400000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.41699999999999998},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.81000000000000005}]},{"osd":6,"last update":"Fri Jul 14 13:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.71599999999999997,"15min":0.71699999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47099999999999997},"max":{"1min":1.0700000000000001,"5min":1.0940000000000001,"15min":1.115},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.68100000000000005,"15min":0.68600000000000005},"min":{"1min":0.504,"5min":0.495,"15min":0.41999999999999998},"max":{"1min":1.089,"5min":1.089,"15min":1.147},"last":0.84599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575291,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33148,"kb_used_data":2100,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338692,"statfs":{"total":96636764160,"available":96602820608,"internally_reserved":0,"allocated":2150400,"data_stored":1101076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.998,"5min":1.026,"15min":1.026},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.499,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89400000000000002,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.85999999999999999}]},{"osd":1,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73999999999999999,"15min":0.76400000000000001},"min":{"1min":0.54000000000000004,"5min":0.51600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91500000000000004,"5min":1.0049999999999999,"15min":1.3300000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73799999999999999,"15min":0.747},"min":{"1min":0.58299999999999996,"5min":0.51700000000000002,"15min":0.47499999999999998},"max":{"1min":0.93999999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.77000000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77500000000000002,"15min":0.79200000000000004},"min":{"1min":0.59799999999999998,"5min":0.53300000000000003,"15min":0.52000000000000002},"max":{"1min":0.92500000000000004,"5min":1.04,"15min":1.0660000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75700000000000001,"15min":0.76700000000000002},"min":{"1min":0.53500000000000003,"5min":0.52600000000000002,"15min":0.51300000000000001},"max":{"1min":0.94799999999999995,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.748}]},{"osd":3,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77700000000000002,"15min":0.78100000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.95799999999999996,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.70699999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.2569999999999999},"last":0.68799999999999994}]},{"osd":4,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.41499999999999998,"5min":0.36299999999999999,"15min":0.36099999999999999},"max":{"1min":0.82199999999999995,"5min":0.92600000000000005,"15min":1.175},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60899999999999999,"15min":0.61199999999999999},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.36799999999999999},"max":{"1min":0.80800000000000005,"5min":0.94599999999999995,"15min":1.0580000000000001},"last":0.80600000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.42699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84999999999999998,"5min":0.873,"15min":1.0860000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.68000000000000005,"15min":0.67400000000000004},"min":{"1min":0.51000000000000001,"5min":0.45900000000000002,"15min":0.41699999999999998},"max":{"1min":0.92100000000000004,"5min":0.93200000000000005,"15min":1.3180000000000001},"last":0.91900000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.46500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88800000000000001,"5min":0.99199999999999999,"15min":1.042},"last":0.629},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.53700000000000003,"5min":0.50900000000000001,"15min":0.46200000000000002},"max":{"1min":0.89900000000000002,"5min":0.92300000000000004,"15min":1.0369999999999999},"last":0.65300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575290,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51192,"kb_used_data":2096,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320648,"statfs":{"total":96636764160,"available":96584343552,"internally_reserved":0,"allocated":2146304,"data_stored":1101006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:29:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.76100000000000001,"15min":0.74099999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.97599999999999998,"5min":1.8,"15min":1.8},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.77500000000000002,"15min":0.75600000000000001},"min":{"1min":0.51100000000000001,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":1.0269999999999999,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.51100000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:29:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.76900000000000002,"15min":0.74299999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.378},"max":{"1min":1.008,"5min":1.835,"15min":1.835},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77700000000000002,"15min":0.76800000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.499},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.71499999999999997}]},{"osd":2,"last update":"Fri Jul 14 13:29:48 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.92700000000000005,"15min":0.80200000000000005},"min":{"1min":0.45700000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.2130000000000001,"5min":16.774000000000001,"15min":16.774000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.91500000000000004,"15min":0.80200000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0449999999999999,"5min":16.751999999999999,"15min":16.751999999999999},"last":0.60499999999999998}]},{"osd":3,"last update":"Fri Jul 14 13:29:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77600000000000002,"15min":0.76700000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.115},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.94999999999999996,"15min":0.83099999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.50600000000000001},"max":{"1min":1.1140000000000001,"5min":16.731000000000002,"15min":16.731000000000002},"last":0.77700000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:29:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63100000000000001,"15min":0.63},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.38},"max":{"1min":0.88400000000000001,"5min":0.92600000000000005,"15min":1.0089999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72099999999999997,"15min":0.71099999999999997},"min":{"1min":0.52600000000000002,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.75800000000000001}]},{"osd":6,"last update":"Fri Jul 14 13:29:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.628,"15min":0.622},"min":{"1min":0.47899999999999998,"5min":0.44,"15min":0.34999999999999998},"max":{"1min":1.157,"5min":1.157,"15min":1.3100000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.42799999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.54800000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:29:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66500000000000004,"15min":0.65200000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.42399999999999999},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.70999999999999996,"15min":0.69099999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.40000000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.81599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575290,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37252,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334588,"statfs":{"total":96636764160,"available":96598618112,"internally_reserved":0,"allocated":2158592,"data_stored":1102570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.76400000000000001,"15min":0.76700000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.38100000000000001},"max":{"1min":0.96899999999999997,"5min":1.0069999999999999,"15min":1.0249999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77100000000000002,"15min":0.76300000000000001},"min":{"1min":0.60799999999999998,"5min":0.45800000000000002,"15min":0.442},"max":{"1min":0.94499999999999995,"5min":1.278,"15min":1.278},"last":0.50800000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.76300000000000001,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0349999999999999,"5min":1.306,"15min":1.306},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.74099999999999999,"15min":0.74399999999999999},"min":{"1min":0.53800000000000003,"5min":0.51000000000000001,"15min":0.47599999999999998},"max":{"1min":1.024,"5min":1.177,"15min":1.177},"last":0.748}]},{"osd":2,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78000000000000003,"15min":0.77300000000000002},"min":{"1min":0.56899999999999995,"5min":0.54000000000000004,"15min":0.49299999999999999},"max":{"1min":0.90400000000000003,"5min":1.137,"15min":1.137},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77300000000000002,"15min":0.77900000000000003},"min":{"1min":0.53700000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1,"5min":1,"15min":1.0149999999999999},"last":0.82299999999999995}]},{"osd":3,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.50800000000000001},"max":{"1min":0.93200000000000005,"5min":1.222,"15min":1.222},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78400000000000003,"15min":0.77900000000000003},"min":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.496},"max":{"1min":1.018,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60599999999999998,"15min":0.60699999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.40000000000000002},"max":{"1min":0.94099999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61799999999999999,"15min":0.60799999999999998},"min":{"1min":0.45000000000000001,"5min":0.42399999999999999,"15min":0.378},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96799999999999997},"last":0.61799999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.624,"15min":0.61599999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.42699999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.88600000000000001}]},{"osd":7,"last update":"Fri Jul 14 13:29:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67300000000000004,"15min":0.67100000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.435},"max":{"1min":0.91800000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70099999999999996,"15min":0.69799999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.83999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575290,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41344,"kb_used_data":2104,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330496,"statfs":{"total":96636764160,"available":96594427904,"internally_reserved":0,"allocated":2154496,"data_stored":1101622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47399999999999998,"15min":0.46000000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.28799999999999998},"max":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.92900000000000005},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.621,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.51900000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.48899999999999999,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.33900000000000002,"15min":0.32300000000000001},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.495},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55800000000000005,"15min":0.56100000000000005},"min":{"1min":0.39700000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.82199999999999995,"5min":0.82399999999999995,"15min":0.95799999999999996},"last":0.70099999999999996}]},{"osd":2,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57799999999999996,"15min":0.58299999999999996},"min":{"1min":0.41499999999999998,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.623,"15min":0.61499999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82399999999999995,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.74299999999999999}]},{"osd":4,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.77000000000000002,"15min":0.78500000000000003},"min":{"1min":0.45200000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.048,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.79500000000000004,"15min":0.80600000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98999999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.84599999999999997}]},{"osd":5,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81000000000000005,"15min":0.82899999999999996},"min":{"1min":0.56499999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.069,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80800000000000005,"15min":0.81299999999999994},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1220000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":1.0089999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.81399999999999995,"15min":0.80800000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1910000000000001,"5min":1.383,"15min":1.383},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.82299999999999995,"15min":0.83999999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1439999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.76200000000000001}]},{"osd":7,"last update":"Fri Jul 14 13:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.86399999999999999,"15min":0.85999999999999999},"min":{"1min":0.58899999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.171,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.56599999999999995,"5min":0.56000000000000005,"15min":0.54800000000000004},"max":{"1min":1.1579999999999999,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.91200000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575290,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59388,"kb_used_data":2100,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312452,"statfs":{"total":96636764160,"available":96575950848,"internally_reserved":0,"allocated":2150400,"data_stored":1100099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46899999999999997,"15min":0.46500000000000002},"min":{"1min":0.32200000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.68400000000000005,"5min":0.70799999999999996,"15min":0.80500000000000005},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.53100000000000003},"min":{"1min":0.38300000000000001,"5min":0.318,"15min":0.30599999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.34899999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47099999999999997,"15min":0.46800000000000003},"min":{"1min":0.34100000000000003,"5min":0.32900000000000001,"15min":0.32600000000000001},"max":{"1min":0.58599999999999997,"5min":0.80600000000000005,"15min":0.84799999999999998},"last":0.307},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.56100000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38200000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.93799999999999994},"last":0.41699999999999998}]},{"osd":3,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.39700000000000002,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.74399999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.433},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56699999999999995,"15min":0.55800000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.35699999999999998},"max":{"1min":0.73599999999999999,"5min":0.77300000000000002,"15min":0.84599999999999997},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81899999999999995,"15min":0.80100000000000005},"min":{"1min":0.58099999999999996,"5min":0.49399999999999999,"15min":0.48799999999999999},"max":{"1min":1.004,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.84099999999999997,"15min":0.81999999999999995},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.48899999999999999},"max":{"1min":1.0169999999999999,"5min":1.179,"15min":1.3029999999999999},"last":0.627}]},{"osd":5,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.86899999999999999,"15min":0.86399999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.02,"5min":1.2430000000000001,"15min":1.302},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.85999999999999999,"15min":0.85099999999999998},"min":{"1min":0.65700000000000003,"5min":0.60699999999999998,"15min":0.54000000000000004},"max":{"1min":1.1120000000000001,"5min":1.2410000000000001,"15min":1.248},"last":0.67400000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85999999999999999,"15min":0.82899999999999996},"min":{"1min":0.59799999999999998,"5min":0.56699999999999995,"15min":0.54800000000000004},"max":{"1min":1.042,"5min":1.2749999999999999,"15min":1.446},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.83599999999999997,"15min":0.82399999999999995},"min":{"1min":0.64500000000000002,"5min":0.55100000000000005,"15min":0.51700000000000002},"max":{"1min":1.119,"5min":1.1830000000000001,"15min":1.266},"last":0.65200000000000002}]},{"osd":7,"last update":"Fri Jul 14 13:29:43 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.873,"15min":0.84499999999999997},"min":{"1min":0.64800000000000002,"5min":0.56799999999999995,"15min":0.55900000000000005},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.871,"15min":0.84999999999999998},"min":{"1min":0.69099999999999995,"5min":0.61599999999999999,"15min":0.56000000000000005},"max":{"1min":1.2709999999999999,"5min":1.351,"15min":1.371},"last":0.61199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575291,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41340,"kb_used_data":2100,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330500,"statfs":{"total":96636764160,"available":96594432000,"internally_reserved":0,"allocated":2150400,"data_stored":1101076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46000000000000002,"15min":0.45500000000000002},"min":{"1min":0.33100000000000002,"5min":0.316,"15min":0.28100000000000003},"max":{"1min":0.70899999999999996,"5min":0.753,"15min":0.81599999999999995},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.52500000000000002},"min":{"1min":0.41799999999999998,"5min":0.33200000000000002,"15min":0.30199999999999999},"max":{"1min":0.68500000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.45000000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.46899999999999997,"15min":0.47199999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.30499999999999999},"max":{"1min":0.59999999999999998,"5min":0.63600000000000001,"15min":0.70799999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.39700000000000002,"5min":0.378,"15min":0.32800000000000001},"max":{"1min":0.747,"5min":0.79900000000000004,"15min":0.89200000000000002},"last":0.51100000000000001}]},{"osd":3,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66500000000000004,"15min":0.65900000000000003},"min":{"1min":0.51100000000000001,"5min":0.47099999999999997,"15min":0.42299999999999999},"max":{"1min":0.90200000000000002,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.36399999999999999,"5min":0.34300000000000003,"15min":0.32300000000000001},"max":{"1min":0.86899999999999999,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.53300000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.79500000000000004,"15min":0.80800000000000005},"min":{"1min":0.61599999999999999,"5min":0.56699999999999995,"15min":0.52200000000000002},"max":{"1min":1.091,"5min":1.155,"15min":1.2470000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.81899999999999995,"15min":0.82799999999999996},"min":{"1min":0.63600000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.0309999999999999,"5min":1.151,"15min":1.171},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.64000000000000001,"5min":0.56299999999999994,"15min":0.54500000000000004},"max":{"1min":1.0469999999999999,"5min":1.224,"15min":1.224},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.81399999999999995,"15min":0.83099999999999996},"min":{"1min":0.66100000000000003,"5min":0.57299999999999995,"15min":0.56100000000000005},"max":{"1min":1.1240000000000001,"5min":1.1259999999999999,"15min":1.375},"last":0.84399999999999997}]},{"osd":6,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.66900000000000004,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.036,"5min":1.1759999999999999,"15min":1.2},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.84299999999999997,"15min":0.85399999999999998},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.56399999999999995},"max":{"1min":1.0589999999999999,"5min":1.169,"15min":1.329},"last":0.745}]},{"osd":7,"last update":"Fri Jul 14 13:28:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.79500000000000004,"15min":0.81899999999999995},"min":{"1min":0.59699999999999998,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.0609999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.86899999999999999,"15min":0.875},"min":{"1min":0.71799999999999997,"5min":0.59999999999999998,"15min":0.58899999999999997},"max":{"1min":1.0389999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.89800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575292,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41936,"kb_used_data":2696,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329904,"statfs":{"total":96636764160,"available":96593821696,"internally_reserved":0,"allocated":2760704,"data_stored":1692625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.33500000000000002,"5min":0.30499999999999999,"15min":0.29899999999999999},"max":{"1min":0.69399999999999995,"5min":0.77100000000000002,"15min":0.85299999999999998},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39900000000000002,"5min":0.36799999999999999,"15min":0.308},"max":{"1min":0.73099999999999998,"5min":0.76800000000000002,"15min":0.80700000000000005},"last":0.39700000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53200000000000003,"15min":0.53600000000000003},"min":{"1min":0.42599999999999999,"5min":0.35699999999999998,"15min":0.33700000000000002},"max":{"1min":0.63500000000000001,"5min":0.72499999999999998,"15min":1.002},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77700000000000002,"5min":0.84099999999999997,"15min":0.91200000000000003},"last":0.37}]},{"osd":3,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52900000000000003,"15min":0.53200000000000003},"min":{"1min":0.38400000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75700000000000001,"5min":0.77000000000000002,"15min":0.83299999999999996},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.47499999999999998,"5min":0.44400000000000001,"15min":0.38800000000000001},"max":{"1min":0.75900000000000001,"5min":0.77200000000000002,"15min":0.871},"last":0.40999999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.83599999999999997,"15min":0.83099999999999996},"min":{"1min":0.60699999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.157,"5min":1.274,"15min":1.284},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.85299999999999998,"15min":0.83699999999999997},"min":{"1min":0.63,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.034,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.82599999999999996,"15min":0.83999999999999997},"min":{"1min":0.59799999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0800000000000001,"5min":1.28,"15min":1.294},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.86699999999999999,"15min":0.85799999999999998},"min":{"1min":0.66200000000000003,"5min":0.58399999999999996,"15min":0.52400000000000002},"max":{"1min":1.0189999999999999,"5min":1.472,"15min":1.472},"last":0.61299999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.84099999999999997,"15min":0.84299999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.96999999999999997,"5min":1.639,"15min":1.639},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.88100000000000001,"15min":0.86399999999999999},"min":{"1min":0.65900000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.044,"5min":1.544,"15min":1.544},"last":0.53300000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.85299999999999998,"15min":0.86199999999999999},"min":{"1min":0.67300000000000004,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.1259999999999999,"5min":1.236,"15min":1.3280000000000001},"last":0.63},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.877,"15min":0.86299999999999999},"min":{"1min":0.63100000000000001,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.103,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.65300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:29:55.221 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-14T13:29:55.222 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-14T13:29:55.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.403+0000 7fa8f70d5640 1 Processor -- start 2023-07-14T13:29:55.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.403+0000 7fa8f70d5640 1 -- start start 2023-07-14T13:29:55.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.403+0000 7fa8f70d5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa8f015f940 0x7fa8f006f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:55.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.407+0000 7fa8f70d5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8f006fe50 0x7fa8f006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:55.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.407+0000 7fa8f70d5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f015ff20 con 0x7fa8f015bd00 2023-07-14T13:29:55.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.407+0000 7fa8f70d5640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f00702d0 con 0x7fa8f015f940 2023-07-14T13:29:55.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.407+0000 7fa8f70d5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f0160200 con 0x7fa8f006fe50 2023-07-14T13:29:55.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.407+0000 7fa8f68d4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8f006fe50 0x7fa8f006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:55.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.407+0000 7fa8f60d3640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa8f015bd00 0x7fa8f0070640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:32774/0 (socket says 172.21.15.5:32774) 2023-07-14T13:29:55.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.407+0000 7fa8f60d3640 1 -- 172.21.15.5:0/455639476 learned_addr learned my addr 172.21.15.5:0/455639476 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:55.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.407+0000 7fa8f58d2640 1 --2- 172.21.15.5:0/455639476 >> v2:172.21.15.154:3300/0 conn(0x7fa8f015f940 0x7fa8f006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:55.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.407+0000 7fa8f50d1640 1 -- 172.21.15.5:0/455639476 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3806645781 0 0) 0x7fa8f015ff20 con 0x7fa8f015bd00 2023-07-14T13:29:55.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.407+0000 7fa8f50d1640 1 -- 172.21.15.5:0/455639476 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8dc003530 con 0x7fa8f015bd00 2023-07-14T13:29:55.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.407+0000 7fa8f68d4640 1 -- 172.21.15.5:0/455639476 >> v2:172.21.15.154:3300/0 conn(0x7fa8f015f940 msgr2=0x7fa8f006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:55.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.407+0000 7fa8f68d4640 1 --2- 172.21.15.5:0/455639476 >> v2:172.21.15.154:3300/0 conn(0x7fa8f015f940 0x7fa8f006f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:55.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.407+0000 7fa8f68d4640 1 -- 172.21.15.5:0/455639476 >> v1:172.21.15.154:6789/0 conn(0x7fa8f015bd00 legacy=0x7fa8f0070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.407+0000 7fa8f68d4640 1 -- 172.21.15.5:0/455639476 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f01604e0 con 0x7fa8f006fe50 2023-07-14T13:29:55.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.411+0000 7fa8f68d4640 1 --2- 172.21.15.5:0/455639476 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8f006fe50 0x7fa8f006bed0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8009d90 tx=0x7fa8e801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0fc6c6c34765422 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:55.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.411+0000 7fa8f50d1640 1 -- 172.21.15.5:0/455639476 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e80a58f0 con 0x7fa8f006fe50 2023-07-14T13:29:55.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.411+0000 7fa8f50d1640 1 -- 172.21.15.5:0/455639476 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e80a5a50 con 0x7fa8f006fe50 2023-07-14T13:29:55.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.411+0000 7fa8f50d1640 1 -- 172.21.15.5:0/455639476 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e80a5dc0 con 0x7fa8f006fe50 2023-07-14T13:29:55.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.411+0000 7fa8f70d5640 1 -- 172.21.15.5:0/455639476 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8f006fe50 msgr2=0x7fa8f006bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:55.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.411+0000 7fa8f70d5640 1 --2- 172.21.15.5:0/455639476 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8f006fe50 0x7fa8f006bed0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8009d90 tx=0x7fa8e801c920 comp rx=0 tx=0).stop 2023-07-14T13:29:55.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.411+0000 7fa8f70d5640 1 -- 172.21.15.5:0/455639476 shutdown_connections 2023-07-14T13:29:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.411+0000 7fa8f70d5640 1 --2- 172.21.15.5:0/455639476 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8f006fe50 0x7fa8f006bed0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.411+0000 7fa8f70d5640 1 --2- 172.21.15.5:0/455639476 >> v2:172.21.15.154:3300/0 conn(0x7fa8f015f940 0x7fa8f006f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.411+0000 7fa8f70d5640 1 -- 172.21.15.5:0/455639476 >> 172.21.15.5:0/455639476 conn(0x7fa8f00ce610 msgr2=0x7fa8f00cea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.411+0000 7fa8f70d5640 1 -- 172.21.15.5:0/455639476 shutdown_connections 2023-07-14T13:29:55.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.411+0000 7fa8f70d5640 1 -- 172.21.15.5:0/455639476 wait complete. 2023-07-14T13:29:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.411+0000 7fa8f70d5640 1 Processor -- start 2023-07-14T13:29:55.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.411+0000 7fa8f70d5640 1 -- start start 2023-07-14T13:29:55.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.415+0000 7fa8f70d5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8f006fe50 0x7fa8f0152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:55.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.415+0000 7fa8f70d5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8f015bd00 0x7fa8f00acbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:55.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.415+0000 7fa8f70d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8f015f940 0x7fa8f00ad120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:55.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.415+0000 7fa8f70d5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f013f300 con 0x7fa8f015f940 2023-07-14T13:29:55.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.415+0000 7fa8f70d5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f0152b70 con 0x7fa8f006fe50 2023-07-14T13:29:55.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.415+0000 7fa8f70d5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f00c5060 con 0x7fa8f015bd00 2023-07-14T13:29:55.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.415+0000 7fa8f68d4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8f015f940 0x7fa8f00ad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:55.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.415+0000 7fa8f68d4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8f015f940 0x7fa8f00ad120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52624/0 (socket says 172.21.15.5:52624) 2023-07-14T13:29:55.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.415+0000 7fa8f68d4640 1 -- 172.21.15.5:0/3061682591 learned_addr learned my addr 172.21.15.5:0/3061682591 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.415+0000 7fa8f60d3640 1 --2- 172.21.15.5:0/3061682591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8f006fe50 0x7fa8f0152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.415+0000 7fa8f58d2640 1 --2- 172.21.15.5:0/3061682591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8f015bd00 0x7fa8f00acbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.415+0000 7fa8f68d4640 1 -- 172.21.15.5:0/3061682591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8f015bd00 msgr2=0x7fa8f00acbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.415+0000 7fa8f68d4640 1 --2- 172.21.15.5:0/3061682591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8f015bd00 0x7fa8f00acbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.415+0000 7fa8f68d4640 1 -- 172.21.15.5:0/3061682591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8f006fe50 msgr2=0x7fa8f0152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.415+0000 7fa8f68d4640 1 --2- 172.21.15.5:0/3061682591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8f006fe50 0x7fa8f0152630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:55.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.415+0000 7fa8f68d4640 1 -- 172.21.15.5:0/3061682591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e8009a70 con 0x7fa8f015f940 2023-07-14T13:29:55.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.415+0000 7fa8f68d4640 1 --2- 172.21.15.5:0/3061682591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8f015f940 0x7fa8f00ad120 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8009d90 tx=0x7fa8e80196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:55.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.415+0000 7fa8e6ffd640 1 -- 172.21.15.5:0/3061682591 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e80a58f0 con 0x7fa8f015f940 2023-07-14T13:29:55.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.415+0000 7fa8e6ffd640 1 -- 172.21.15.5:0/3061682591 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e80ad850 con 0x7fa8f015f940 2023-07-14T13:29:55.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.415+0000 7fa8f70d5640 1 -- 172.21.15.5:0/3061682591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f00c4d80 con 0x7fa8f015f940 2023-07-14T13:29:55.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.415+0000 7fa8e6ffd640 1 -- 172.21.15.5:0/3061682591 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e80adbe0 con 0x7fa8f015f940 2023-07-14T13:29:55.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.415+0000 7fa8f70d5640 1 -- 172.21.15.5:0/3061682591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f013ef90 con 0x7fa8f015f940 2023-07-14T13:29:55.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.415+0000 7fa8f70d5640 1 -- 172.21.15.5:0/3061682591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f013f470 con 0x7fa8f015f940 2023-07-14T13:29:55.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.415+0000 7fa8e6ffd640 1 -- 172.21.15.5:0/3061682591 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa8e80b4070 con 0x7fa8f015f940 2023-07-14T13:29:55.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.419+0000 7fa8e6ffd640 1 --2- 172.21.15.5:0/3061682591 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fa8d40663a0 0x7fa8d4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:55.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.419+0000 7fa8e6ffd640 1 -- 172.21.15.5:0/3061682591 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fa8e811eb70 con 0x7fa8f015f940 2023-07-14T13:29:55.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.419+0000 7fa8f60d3640 1 --2- 172.21.15.5:0/3061682591 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fa8d40663a0 0x7fa8d4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:55.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.419+0000 7fa8f60d3640 1 --2- 172.21.15.5:0/3061682591 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fa8d40663a0 0x7fa8d4068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec0011f0 tx=0x7fa8ec007d40 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:55.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.423+0000 7fa8e6ffd640 1 -- 172.21.15.5:0/3061682591 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa8e80ebff0 con 0x7fa8f015f940 2023-07-14T13:29:55.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.631+0000 7fa8f70d5640 1 -- 172.21.15.5:0/3061682591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa8f004e020 con 0x7fa8f015f940 2023-07-14T13:29:55.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.635+0000 7fa8e6ffd640 1 -- 172.21.15.5:0/3061682591 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v29) v1 ==== 190+0+147 (secure 0 0 0) 0x7fa8e80b20e0 con 0x7fa8f015f940 2023-07-14T13:29:55.638 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-07-14T13:29:55.638 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDkRLFkCav/DhAA6SOiONAbTcWCnUZXcm7BcQ== 2023-07-14T13:29:55.639 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2023-07-14T13:29:55.639 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2023-07-14T13:29:55.639 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-14T13:29:55.640 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2023-07-14T13:29:55.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.635+0000 7fa8f70d5640 1 -- 172.21.15.5:0/3061682591 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fa8d40663a0 msgr2=0x7fa8d4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:55.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.635+0000 7fa8f70d5640 1 --2- 172.21.15.5:0/3061682591 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fa8d40663a0 0x7fa8d4068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec0011f0 tx=0x7fa8ec007d40 comp rx=0 tx=0).stop 2023-07-14T13:29:55.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.635+0000 7fa8f70d5640 1 -- 172.21.15.5:0/3061682591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8f015f940 msgr2=0x7fa8f00ad120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:55.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.635+0000 7fa8f70d5640 1 --2- 172.21.15.5:0/3061682591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8f015f940 0x7fa8f00ad120 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8009d90 tx=0x7fa8e80196c0 comp rx=0 tx=0).stop 2023-07-14T13:29:55.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.635+0000 7fa8f70d5640 1 -- 172.21.15.5:0/3061682591 shutdown_connections 2023-07-14T13:29:55.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.635+0000 7fa8f70d5640 1 --2- 172.21.15.5:0/3061682591 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fa8d40663a0 0x7fa8d4068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:55.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.635+0000 7fa8f70d5640 1 --2- 172.21.15.5:0/3061682591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8f015f940 0x7fa8f00ad120 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:55.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.635+0000 7fa8f70d5640 1 --2- 172.21.15.5:0/3061682591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8f015bd00 0x7fa8f00acbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:55.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.635+0000 7fa8f70d5640 1 --2- 172.21.15.5:0/3061682591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8f006fe50 0x7fa8f0152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:55.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.635+0000 7fa8f70d5640 1 -- 172.21.15.5:0/3061682591 >> 172.21.15.5:0/3061682591 conn(0x7fa8f00ce610 msgr2=0x7fa8f006d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:55.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.635+0000 7fa8f70d5640 1 -- 172.21.15.5:0/3061682591 shutdown_connections 2023-07-14T13:29:55.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.639+0000 7fa8f70d5640 1 -- 172.21.15.5:0/3061682591 wait complete. 2023-07-14T13:29:55.659 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:29:55.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.799+0000 7ff317f40640 1 Processor -- start 2023-07-14T13:29:55.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.799+0000 7ff317f40640 1 -- start start 2023-07-14T13:29:55.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.803+0000 7ff317f40640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff310160330 0x7ff3100cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:55.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.803+0000 7ff317f40640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff3100c8940 0x7ff3100ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:55.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.803+0000 7ff317f40640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3100c17d0 con 0x7ff3100c0f80 2023-07-14T13:29:55.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.803+0000 7ff317f40640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3100c14f0 con 0x7ff3100c8940 2023-07-14T13:29:55.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.803+0000 7ff317f40640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3100cac10 con 0x7ff310160330 2023-07-14T13:29:55.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.803+0000 7ff3154db640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff3100c8940 0x7ff3100ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:55.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.803+0000 7ff3154db640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff3100c8940 0x7ff3100ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52634/0 (socket says 172.21.15.5:52634) 2023-07-14T13:29:55.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.803+0000 7ff3154db640 1 -- 172.21.15.5:0/3058617390 learned_addr learned my addr 172.21.15.5:0/3058617390 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:55.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.803+0000 7ff315cdc640 1 --2- 172.21.15.5:0/3058617390 >> v2:172.21.15.154:3300/0 conn(0x7ff310160330 0x7ff3100cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.803+0000 7ff3154db640 1 -- 172.21.15.5:0/3058617390 >> v2:172.21.15.154:3300/0 conn(0x7ff310160330 msgr2=0x7ff3100cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.803+0000 7ff3154db640 1 --2- 172.21.15.5:0/3058617390 >> v2:172.21.15.154:3300/0 conn(0x7ff310160330 0x7ff3100cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.803+0000 7ff3154db640 1 -- 172.21.15.5:0/3058617390 >> v1:172.21.15.154:6789/0 conn(0x7ff3100c0f80 legacy=0x7ff3100cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:55.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.803+0000 7ff3154db640 1 -- 172.21.15.5:0/3058617390 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3100caef0 con 0x7ff3100c8940 2023-07-14T13:29:55.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.803+0000 7ff315cdc640 1 --2- 172.21.15.5:0/3058617390 >> v2:172.21.15.154:3300/0 conn(0x7ff310160330 0x7ff3100cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:29:55.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.807+0000 7ff3154db640 1 --2- 172.21.15.5:0/3058617390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3100c8940 0x7ff3100ccf50 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7ff310066260 tx=0x7ff30001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc069ca7bc39f57 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:55.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.807+0000 7ff314cda640 1 -- 172.21.15.5:0/3058617390 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3000a89f0 con 0x7ff3100c8940 2023-07-14T13:29:55.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.807+0000 7ff314cda640 1 -- 172.21.15.5:0/3058617390 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3000a8b50 con 0x7ff3100c8940 2023-07-14T13:29:55.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.807+0000 7ff314cda640 1 -- 172.21.15.5:0/3058617390 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3000b0440 con 0x7ff3100c8940 2023-07-14T13:29:55.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.807+0000 7ff317f40640 1 -- 172.21.15.5:0/3058617390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3100c8940 msgr2=0x7ff3100ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:55.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.807+0000 7ff317f40640 1 --2- 172.21.15.5:0/3058617390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3100c8940 0x7ff3100ccf50 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7ff310066260 tx=0x7ff30001ecf0 comp rx=0 tx=0).stop 2023-07-14T13:29:55.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.807+0000 7ff317f40640 1 -- 172.21.15.5:0/3058617390 shutdown_connections 2023-07-14T13:29:55.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.807+0000 7ff317f40640 1 --2- 172.21.15.5:0/3058617390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3100c8940 0x7ff3100ccf50 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:55.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.807+0000 7ff317f40640 1 --2- 172.21.15.5:0/3058617390 >> v2:172.21.15.154:3300/0 conn(0x7ff310160330 0x7ff3100cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:55.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.807+0000 7ff317f40640 1 -- 172.21.15.5:0/3058617390 >> 172.21.15.5:0/3058617390 conn(0x7ff3100afcf0 msgr2=0x7ff3100b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:55.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.807+0000 7ff317f40640 1 -- 172.21.15.5:0/3058617390 shutdown_connections 2023-07-14T13:29:55.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.807+0000 7ff317f40640 1 -- 172.21.15.5:0/3058617390 wait complete. 2023-07-14T13:29:55.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.807+0000 7ff317f40640 1 Processor -- start 2023-07-14T13:29:55.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.807+0000 7ff317f40640 1 -- start start 2023-07-14T13:29:55.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.811+0000 7ff317f40640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3100c0f80 0x7ff31015b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:55.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.811+0000 7ff317f40640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3100c8940 0x7ff31015bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:55.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.811+0000 7ff317f40640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff310160330 0x7ff3100b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:55.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.811+0000 7ff317f40640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3100c5c40 con 0x7ff310160330 2023-07-14T13:29:55.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.811+0000 7ff317f40640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff310163b90 con 0x7ff3100c8940 2023-07-14T13:29:55.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.811+0000 7ff317f40640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31015bd70 con 0x7ff3100c0f80 2023-07-14T13:29:55.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.811+0000 7ff3164dd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff310160330 0x7ff3100b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:55.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.811+0000 7ff3164dd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff310160330 0x7ff3100b2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52650/0 (socket says 172.21.15.5:52650) 2023-07-14T13:29:55.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.811+0000 7ff3164dd640 1 -- 172.21.15.5:0/280510890 learned_addr learned my addr 172.21.15.5:0/280510890 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:55.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.811+0000 7ff3154db640 1 --2- 172.21.15.5:0/280510890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3100c8940 0x7ff31015bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:55.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.811+0000 7ff315cdc640 1 --2- 172.21.15.5:0/280510890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3100c0f80 0x7ff31015b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:55.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.811+0000 7ff3164dd640 1 -- 172.21.15.5:0/280510890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3100c0f80 msgr2=0x7ff31015b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:55.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.811+0000 7ff3164dd640 1 --2- 172.21.15.5:0/280510890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3100c0f80 0x7ff31015b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:55.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.811+0000 7ff3164dd640 1 -- 172.21.15.5:0/280510890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3100c8940 msgr2=0x7ff31015bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:55.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.811+0000 7ff3164dd640 1 --2- 172.21.15.5:0/280510890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3100c8940 0x7ff31015bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:55.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.811+0000 7ff3164dd640 1 -- 172.21.15.5:0/280510890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3000094d0 con 0x7ff310160330 2023-07-14T13:29:55.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.811+0000 7ff3164dd640 1 --2- 172.21.15.5:0/280510890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff310160330 0x7ff3100b2040 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7ff30800c730 tx=0x7ff30800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:55.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.811+0000 7ff3067fc640 1 -- 172.21.15.5:0/280510890 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff308003b80 con 0x7ff310160330 2023-07-14T13:29:55.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.811+0000 7ff3067fc640 1 -- 172.21.15.5:0/280510890 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff308003ce0 con 0x7ff310160330 2023-07-14T13:29:55.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.811+0000 7ff3067fc640 1 -- 172.21.15.5:0/280510890 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30800aa30 con 0x7ff310160330 2023-07-14T13:29:55.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.811+0000 7ff317f40640 1 -- 172.21.15.5:0/280510890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3100c53d0 con 0x7ff310160330 2023-07-14T13:29:55.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.811+0000 7ff317f40640 1 -- 172.21.15.5:0/280510890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3100c6170 con 0x7ff310160330 2023-07-14T13:29:55.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.811+0000 7ff317f40640 1 -- 172.21.15.5:0/280510890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3100678d0 con 0x7ff310160330 2023-07-14T13:29:55.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.811+0000 7ff3067fc640 1 -- 172.21.15.5:0/280510890 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff30800ab90 con 0x7ff310160330 2023-07-14T13:29:55.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.815+0000 7ff3067fc640 1 --2- 172.21.15.5:0/280510890 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff2f40663a0 0x7ff2f4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:55.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.815+0000 7ff3067fc640 1 -- 172.21.15.5:0/280510890 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6090+0+0 (secure 0 0 0) 0x7ff308083b40 con 0x7ff310160330 2023-07-14T13:29:55.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.815+0000 7ff315cdc640 1 --2- 172.21.15.5:0/280510890 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff2f40663a0 0x7ff2f4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:55.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.815+0000 7ff315cdc640 1 --2- 172.21.15.5:0/280510890 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff2f40663a0 0x7ff2f4068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff3100af3c0 tx=0x7ff30c008040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:55.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:55.819+0000 7ff3067fc640 1 -- 172.21.15.5:0/280510890 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff308050f30 con 0x7ff310160330 2023-07-14T13:29:56.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.003+0000 7ff317f40640 1 -- 172.21.15.5:0/280510890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff31006c380 con 0x7ff310160330 2023-07-14T13:29:56.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.003+0000 7ff3067fc640 1 -- 172.21.15.5:0/280510890 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4710 (secure 0 0 0) 0x7ff308054550 con 0x7ff310160330 2023-07-14T13:29:56.006 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:29:56.006 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2329374117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2329374117},{"type":"v1","addr":"172.21.15.154:6835","nonce":2329374117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":9457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/811714286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":811714286},{"type":"v1","addr":"172.21.15.154:6837","nonce":811714286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":9954,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3020438262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3020438262},{"type":"v1","addr":"172.21.15.5:6833","nonce":3020438262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:29:45.555298+0000","modified":"2023-07-14T13:29:49.191310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9966":{"gid":9966,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/3098088945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3098088945},{"type":"v1","addr":"172.21.15.5:6835","nonce":3098088945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-14T13:29:56.008 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 83 2023-07-14T13:29:56.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.003+0000 7ff317f40640 1 -- 172.21.15.5:0/280510890 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff2f40663a0 msgr2=0x7ff2f4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:56.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.003+0000 7ff317f40640 1 --2- 172.21.15.5:0/280510890 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff2f40663a0 0x7ff2f4068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff3100af3c0 tx=0x7ff30c008040 comp rx=0 tx=0).stop 2023-07-14T13:29:56.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.003+0000 7ff317f40640 1 -- 172.21.15.5:0/280510890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff310160330 msgr2=0x7ff3100b2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:56.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.003+0000 7ff317f40640 1 --2- 172.21.15.5:0/280510890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff310160330 0x7ff3100b2040 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7ff30800c730 tx=0x7ff30800cbf0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.003+0000 7ff317f40640 1 -- 172.21.15.5:0/280510890 shutdown_connections 2023-07-14T13:29:56.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.003+0000 7ff317f40640 1 --2- 172.21.15.5:0/280510890 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff2f40663a0 0x7ff2f4068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.003+0000 7ff317f40640 1 --2- 172.21.15.5:0/280510890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff310160330 0x7ff3100b2040 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.003+0000 7ff317f40640 1 --2- 172.21.15.5:0/280510890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3100c8940 0x7ff31015bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.003+0000 7ff317f40640 1 --2- 172.21.15.5:0/280510890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3100c0f80 0x7ff31015b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.003+0000 7ff317f40640 1 -- 172.21.15.5:0/280510890 >> 172.21.15.5:0/280510890 conn(0x7ff3100afcf0 msgr2=0x7ff3100adc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:56.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.003+0000 7ff317f40640 1 -- 172.21.15.5:0/280510890 shutdown_connections 2023-07-14T13:29:56.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.003+0000 7ff317f40640 1 -- 172.21.15.5:0/280510890 wait complete. 2023-07-14T13:29:56.428 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 83, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-14T13:29:45.555298+0000', 'modified': '2023-07-14T13:29:49.191310+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9966}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9966': {'gid': 9966, 'name': 'a', 'rank': 0, 'incarnation': 79, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6835/3098088945', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6834', 'nonce': 3098088945}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 3098088945}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-14T13:29:56.429 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-14T13:29:56.430 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-14T13:29:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.575+0000 7f071a8d8640 1 Processor -- start 2023-07-14T13:29:56.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.575+0000 7f071a8d8640 1 -- start start 2023-07-14T13:29:56.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.575+0000 7f071a8d8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0714158ce0 0x7f0714070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:56.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.575+0000 7f071a8d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07140c9730 0x7f07140ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.575+0000 7f071a8d8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07140cc700 con 0x7f07140c8ad0 2023-07-14T13:29:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.575+0000 7f071a8d8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07140b0ff0 con 0x7f0714158ce0 2023-07-14T13:29:56.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.575+0000 7f071a8d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0714070c80 con 0x7f07140c9730 2023-07-14T13:29:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.575+0000 7f0713fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0714158ce0 0x7f0714070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.575+0000 7f0718e75640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07140c9730 0x7f07140ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.575+0000 7f0713fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0714158ce0 0x7f0714070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:56998/0 (socket says 172.21.15.5:56998) 2023-07-14T13:29:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.575+0000 7f0713fff640 1 -- 172.21.15.5:0/429375515 learned_addr learned my addr 172.21.15.5:0/429375515 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.579+0000 7f0718e75640 1 -- 172.21.15.5:0/429375515 >> v2:172.21.15.154:3300/0 conn(0x7f0714158ce0 msgr2=0x7f0714070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:56.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.579+0000 7f0718e75640 1 --2- 172.21.15.5:0/429375515 >> v2:172.21.15.154:3300/0 conn(0x7f0714158ce0 0x7f0714070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.579+0000 7f0718e75640 1 -- 172.21.15.5:0/429375515 >> v1:172.21.15.154:6789/0 conn(0x7f07140c8ad0 legacy=0x7f07140c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.579+0000 7f0718e75640 1 -- 172.21.15.5:0/429375515 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07140cbdd0 con 0x7f07140c9730 2023-07-14T13:29:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.579+0000 7f0713fff640 1 --2- 172.21.15.5:0/429375515 >> v2:172.21.15.154:3300/0 conn(0x7f0714158ce0 0x7f0714070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:29:56.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.579+0000 7f0712ffd640 1 -- 172.21.15.5:0/429375515 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737586495 0 0) 0x7f07140cc700 con 0x7f07140c8ad0 2023-07-14T13:29:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.579+0000 7f0718e75640 1 --2- 172.21.15.5:0/429375515 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07140c9730 0x7f07140ccb90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f070c009d90 tx=0x7f070c01c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45a4d4317a3bf8d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.579+0000 7f0712ffd640 1 -- 172.21.15.5:0/429375515 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c0a58e0 con 0x7f07140c9730 2023-07-14T13:29:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.579+0000 7f0712ffd640 1 -- 172.21.15.5:0/429375515 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070c0a5a40 con 0x7f07140c9730 2023-07-14T13:29:56.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.579+0000 7f0712ffd640 1 -- 172.21.15.5:0/429375515 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c0a5dd0 con 0x7f07140c9730 2023-07-14T13:29:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.583+0000 7f071a8d8640 1 -- 172.21.15.5:0/429375515 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07140c9730 msgr2=0x7f07140ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.583+0000 7f071a8d8640 1 --2- 172.21.15.5:0/429375515 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07140c9730 0x7f07140ccb90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f070c009d90 tx=0x7f070c01c800 comp rx=0 tx=0).stop 2023-07-14T13:29:56.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.583+0000 7f071a8d8640 1 -- 172.21.15.5:0/429375515 shutdown_connections 2023-07-14T13:29:56.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.583+0000 7f071a8d8640 1 --2- 172.21.15.5:0/429375515 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07140c9730 0x7f07140ccb90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.583+0000 7f071a8d8640 1 --2- 172.21.15.5:0/429375515 >> v2:172.21.15.154:3300/0 conn(0x7f0714158ce0 0x7f0714070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.583+0000 7f071a8d8640 1 -- 172.21.15.5:0/429375515 >> 172.21.15.5:0/429375515 conn(0x7f07140afcf0 msgr2=0x7f07140b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:56.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.583+0000 7f071a8d8640 1 -- 172.21.15.5:0/429375515 shutdown_connections 2023-07-14T13:29:56.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.583+0000 7f071a8d8640 1 -- 172.21.15.5:0/429375515 wait complete. 2023-07-14T13:29:56.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.583+0000 7f071a8d8640 1 Processor -- start 2023-07-14T13:29:56.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.583+0000 7f071a8d8640 1 -- start start 2023-07-14T13:29:56.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.583+0000 7f071a8d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07140c8ad0 0x7f071415bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:56.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.583+0000 7f071a8d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07140c9730 0x7f07141487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:56.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.583+0000 7f071a8d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0714158ce0 0x7f07140c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:56.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.583+0000 7f071a8d8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071415c0c0 con 0x7f0714158ce0 2023-07-14T13:29:56.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.583+0000 7f071a8d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071415a890 con 0x7f07140c8ad0 2023-07-14T13:29:56.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.583+0000 7f071a8d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07140c5750 con 0x7f07140c9730 2023-07-14T13:29:56.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.583+0000 7f0718e75640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0714158ce0 0x7f07140c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:56.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.583+0000 7f0718e75640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0714158ce0 0x7f07140c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52658/0 (socket says 172.21.15.5:52658) 2023-07-14T13:29:56.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.583+0000 7f0718e75640 1 -- 172.21.15.5:0/474557591 learned_addr learned my addr 172.21.15.5:0/474557591 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:56.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.583+0000 7f0713fff640 1 --2- 172.21.15.5:0/474557591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07140c8ad0 0x7f071415bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:56.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.583+0000 7f07137fe640 1 --2- 172.21.15.5:0/474557591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07140c9730 0x7f07141487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:56.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.587+0000 7f0718e75640 1 -- 172.21.15.5:0/474557591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07140c9730 msgr2=0x7f07141487b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:56.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.587+0000 7f0718e75640 1 --2- 172.21.15.5:0/474557591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07140c9730 0x7f07141487b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.587+0000 7f0718e75640 1 -- 172.21.15.5:0/474557591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07140c8ad0 msgr2=0x7f071415bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:56.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.587+0000 7f0718e75640 1 --2- 172.21.15.5:0/474557591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07140c8ad0 0x7f071415bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.587+0000 7f0718e75640 1 -- 172.21.15.5:0/474557591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07040094d0 con 0x7f0714158ce0 2023-07-14T13:29:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.587+0000 7f0713fff640 1 --2- 172.21.15.5:0/474557591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07140c8ad0 0x7f071415bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:29:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.587+0000 7f0718e75640 1 --2- 172.21.15.5:0/474557591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0714158ce0 0x7f07140c6300 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f070c01aeb0 tx=0x7f070c0195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.587+0000 7f0710ff9640 1 -- 172.21.15.5:0/474557591 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c0b9860 con 0x7f0714158ce0 2023-07-14T13:29:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.587+0000 7f0710ff9640 1 -- 172.21.15.5:0/474557591 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070c0b99c0 con 0x7f0714158ce0 2023-07-14T13:29:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.587+0000 7f0710ff9640 1 -- 172.21.15.5:0/474557591 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c0b9d30 con 0x7f0714158ce0 2023-07-14T13:29:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.587+0000 7f071a8d8640 1 -- 172.21.15.5:0/474557591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f070c009a70 con 0x7f0714158ce0 2023-07-14T13:29:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.587+0000 7f071a8d8640 1 -- 172.21.15.5:0/474557591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f071415adc0 con 0x7f0714158ce0 2023-07-14T13:29:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.587+0000 7f0710ff9640 1 -- 172.21.15.5:0/474557591 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f070c0ad440 con 0x7f0714158ce0 2023-07-14T13:29:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.587+0000 7f0710ff9640 1 --2- 172.21.15.5:0/474557591 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f07000663a0 0x7f0700068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.587+0000 7f0710ff9640 1 -- 172.21.15.5:0/474557591 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f070c11f2b0 con 0x7f0714158ce0 2023-07-14T13:29:56.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f071dc34000 1 Processor -- start 2023-07-14T13:29:56.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f0713fff640 1 --2- 172.21.15.5:0/474557591 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f07000663a0 0x7f0700068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:56.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f071dc34000 1 -- start start 2023-07-14T13:29:56.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f0713fff640 1 --2- 172.21.15.5:0/474557591 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f07000663a0 0x7f0700068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0714158360 tx=0x7f0704008040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:56.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f071dc34000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b14bc16f80 0x55b14bc17350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:56.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f071dc34000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc17890 0x55b14bbcd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:56.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f071dc34000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55b14bbcd930 0x55b14bbcdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:56.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f071dc34000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b14ba94900 con 0x55b14bc17890 2023-07-14T13:29:56.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f071dc34000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b14b9ce8c0 con 0x55b14bc16f80 2023-07-14T13:29:56.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f071dc34000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b14ba22360 con 0x55b14bbcd930 2023-07-14T13:29:56.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f07137fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc17890 0x55b14bbcd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:56.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f07137fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc17890 0x55b14bbcd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52674/0 (socket says 172.21.15.5:52674) 2023-07-14T13:29:56.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f07137fe640 1 -- 172.21.15.5:0/1933883878 learned_addr learned my addr 172.21.15.5:0/1933883878 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:56.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f0713fff640 1 --2- 172.21.15.5:0/1933883878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b14bc16f80 0x55b14bc17350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:56.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f0718e75640 1 --2- 172.21.15.5:0/1933883878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55b14bbcd930 0x55b14bbcdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:56.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f07137fe640 1 -- 172.21.15.5:0/1933883878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55b14bbcd930 msgr2=0x55b14bbcdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:56.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f07137fe640 1 --2- 172.21.15.5:0/1933883878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55b14bbcd930 0x55b14bbcdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f07137fe640 1 -- 172.21.15.5:0/1933883878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b14bc16f80 msgr2=0x55b14bc17350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:56.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f07137fe640 1 --2- 172.21.15.5:0/1933883878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b14bc16f80 0x55b14bc17350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f07137fe640 1 -- 172.21.15.5:0/1933883878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b14b717890 con 0x55b14bc17890 2023-07-14T13:29:56.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f07137fe640 1 --2- 172.21.15.5:0/1933883878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc17890 0x55b14bbcd3f0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f0708001640 tx=0x7f0708001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c74066df8d68169 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:56.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f06f9ffb640 1 -- 172.21.15.5:0/1933883878 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0708001d50 con 0x55b14bc17890 2023-07-14T13:29:56.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f06f9ffb640 1 -- 172.21.15.5:0/1933883878 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07080052e0 con 0x55b14bc17890 2023-07-14T13:29:56.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f06f9ffb640 1 -- 172.21.15.5:0/1933883878 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070800e960 con 0x55b14bc17890 2023-07-14T13:29:56.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f071dc34000 1 -- 172.21.15.5:0/1933883878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc17890 msgr2=0x55b14bbcd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:56.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f071dc34000 1 --2- 172.21.15.5:0/1933883878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc17890 0x55b14bbcd3f0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f0708001640 tx=0x7f0708001b00 comp rx=0 tx=0).stop 2023-07-14T13:29:56.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f071dc34000 1 -- 172.21.15.5:0/1933883878 shutdown_connections 2023-07-14T13:29:56.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f071dc34000 1 --2- 172.21.15.5:0/1933883878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55b14bbcd930 0x55b14bbcdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f071dc34000 1 --2- 172.21.15.5:0/1933883878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc17890 0x55b14bbcd3f0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f071dc34000 1 --2- 172.21.15.5:0/1933883878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b14bc16f80 0x55b14bc17350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f071dc34000 1 -- 172.21.15.5:0/1933883878 >> 172.21.15.5:0/1933883878 conn(0x55b14bbd3a90 msgr2=0x55b14bbcbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:56.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f071dc34000 1 -- 172.21.15.5:0/1933883878 shutdown_connections 2023-07-14T13:29:56.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f071dc34000 1 -- 172.21.15.5:0/1933883878 wait complete. 2023-07-14T13:29:56.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.591+0000 7f071dc34000 1 -- start start 2023-07-14T13:29:56.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f071dc34000 1 Processor -- start 2023-07-14T13:29:56.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f071dc34000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b14bbcd930 0x55b14bc094e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:56.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f071dc34000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55b14bc16f80 0x55b14bc09a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:56.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f071dc34000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc17890 0x55b14bc09f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:56.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f071dc34000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b14ba1b400 con 0x55b14bc17890 2023-07-14T13:29:56.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f071dc34000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b14b9d7b60 con 0x55b14bbcd930 2023-07-14T13:29:56.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f071dc34000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b14b9d7800 con 0x55b14bc16f80 2023-07-14T13:29:56.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f071dc34000 10 client.0 _ll_register_callbacks cb 0x55b14bbb92c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:29:56.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f0718e75640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc17890 0x55b14bc09f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:56.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f0718e75640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc17890 0x55b14bc09f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52682/0 (socket says 172.21.15.5:52682) 2023-07-14T13:29:56.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f0718e75640 1 -- 172.21.15.5:0/2556232248 learned_addr learned my addr 172.21.15.5:0/2556232248 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:56.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f0713fff640 1 --2- 172.21.15.5:0/2556232248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b14bbcd930 0x55b14bc094e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:56.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f07137fe640 1 --2- 172.21.15.5:0/2556232248 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55b14bc16f80 0x55b14bc09a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:56.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f0718e75640 1 -- 172.21.15.5:0/2556232248 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55b14bc16f80 msgr2=0x55b14bc09a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:56.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f0718e75640 1 --2- 172.21.15.5:0/2556232248 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55b14bc16f80 0x55b14bc09a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f0718e75640 1 -- 172.21.15.5:0/2556232248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b14bbcd930 msgr2=0x55b14bc094e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:56.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f0718e75640 1 --2- 172.21.15.5:0/2556232248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b14bbcd930 0x55b14bc094e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f0718e75640 1 -- 172.21.15.5:0/2556232248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f070800f040 con 0x55b14bc17890 2023-07-14T13:29:56.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f0718e75640 1 --2- 172.21.15.5:0/2556232248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc17890 0x55b14bc09f60 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f070c009d90 tx=0x7f070c11f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7ef723c12e5d6e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:56.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f06f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-07-14T13:29:56.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f06f2ffd640 1 -- 172.21.15.5:0/2556232248 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c0ef910 con 0x55b14bc17890 2023-07-14T13:29:56.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f071dc34000 1 -- 172.21.15.5:0/2556232248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b14b9e2aa0 con 0x55b14bc17890 2023-07-14T13:29:56.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f06f2ffd640 1 -- 172.21.15.5:0/2556232248 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(172..172 src has 1..172) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f070c0f80e0 con 0x55b14bc17890 2023-07-14T13:29:56.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f06f2ffd640 1 -- 172.21.15.5:0/2556232248 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f070c0f82a0 con 0x55b14bc17890 2023-07-14T13:29:56.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f071dc34000 10 client.10134 fetch_fsmap learned FSMap version 83 2023-07-14T13:29:56.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f071dc34000 1 -- 172.21.15.5:0/2556232248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) v3 -- 0x55b14b9dfd90 con 0x55b14bc17890 2023-07-14T13:29:56.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f06f2ffd640 1 -- 172.21.15.5:0/2556232248 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b14b9e2aa0 con 0x55b14bc17890 2023-07-14T13:29:56.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f06f2ffd640 1 -- 172.21.15.5:0/2556232248 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 83) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f070c0c9020 con 0x55b14bc17890 2023-07-14T13:29:56.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f071dc34000 10 client.10134 fetch_fsmap finished waiting for FSMap version 83 2023-07-14T13:29:56.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f071dc34000 10 client.10134 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-14T13:29:56.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f071dc34000 20 client.10134 populate_metadata read hostname 'smithi005' 2023-07-14T13:29:56.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f071dc34000 1 --2- 172.21.15.5:0/2556232248 >> [v2:172.21.15.5:6834/3098088945,v1:172.21.15.5:6835/3098088945] conn(0x55b14bc0a970 0x55b14bc2d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:56.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f071dc34000 4 client.10134 mds_command: new command op to 9966 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:29:56.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f071dc34000 1 -- 172.21.15.5:0/2556232248 --> [v2:172.21.15.5:6834/3098088945,v1:172.21.15.5:6835/3098088945] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b14ba49f40 con 0x55b14bc0a970 2023-07-14T13:29:56.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f0713fff640 1 --2- 172.21.15.5:0/2556232248 >> [v2:172.21.15.5:6834/3098088945,v1:172.21.15.5:6835/3098088945] conn(0x55b14bc0a970 0x55b14bc2d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:56.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f0713fff640 1 --2- 172.21.15.5:0/2556232248 >> [v2:172.21.15.5:6834/3098088945,v1:172.21.15.5:6835/3098088945] conn(0x55b14bc0a970 0x55b14bc2d050 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7aa822d17e6d0b1e server_cookie=2e47bb8095afa76a in_seq=0 out_seq=0 2023-07-14T13:29:56.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.595+0000 7f06f2ffd640 10 client.10134 ms_handle_connect on v2:172.21.15.5:6834/3098088945 2023-07-14T13:29:56.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.599+0000 7f06f2ffd640 1 -- 172.21.15.5:0/2556232248 <== mds.0 v2:172.21.15.5:6834/3098088945 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b14ba49f40 con 0x55b14bc0a970 2023-07-14T13:29:56.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.599+0000 7f06f2ffd640 10 client.10134 handle_command_reply: tid=0 2023-07-14T13:29:56.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.599+0000 7f071dc34000 1 client.10134 shutdown 2023-07-14T13:29:56.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.599+0000 7f071dc34000 1 -- 172.21.15.5:0/2556232248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc17890 msgr2=0x55b14bc09f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:56.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.599+0000 7f071dc34000 1 --2- 172.21.15.5:0/2556232248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc17890 0x55b14bc09f60 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f070c009d90 tx=0x7f070c11f1a0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.599+0000 7f071dc34000 1 -- 172.21.15.5:0/2556232248 shutdown_connections 2023-07-14T13:29:56.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.599+0000 7f071dc34000 1 --2- 172.21.15.5:0/2556232248 >> [v2:172.21.15.5:6834/3098088945,v1:172.21.15.5:6835/3098088945] conn(0x55b14bc0a970 0x55b14bc2d050 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.599+0000 7f071dc34000 1 --2- 172.21.15.5:0/2556232248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc17890 0x55b14bc09f60 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.599+0000 7f071dc34000 1 --2- 172.21.15.5:0/2556232248 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55b14bc16f80 0x55b14bc09a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.599+0000 7f071dc34000 1 --2- 172.21.15.5:0/2556232248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b14bbcd930 0x55b14bc094e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.599+0000 7f06f2ffd640 0 client.10134 ms_handle_reset on v2:172.21.15.5:6834/3098088945 2023-07-14T13:29:56.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.599+0000 7f071dc34000 1 -- 172.21.15.5:0/2556232248 >> 172.21.15.5:0/2556232248 conn(0x55b14bbd3a90 msgr2=0x55b14bbd2320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:56.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.599+0000 7f071dc34000 1 -- 172.21.15.5:0/2556232248 shutdown_connections 2023-07-14T13:29:56.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.599+0000 7f071dc34000 1 -- 172.21.15.5:0/2556232248 wait complete. 2023-07-14T13:29:56.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.599+0000 7f071dc34000 20 client.10134 trim_cache size 0 max 16384 2023-07-14T13:29:56.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f071dc34000 1 Processor -- start 2023-07-14T13:29:56.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f071dc34000 1 -- start start 2023-07-14T13:29:56.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f071dc34000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55b14bbcd930 0x55b14bc07200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:56.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f071dc34000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc16f80 0x55b14bc07740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:56.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f071dc34000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b14bc17890 0x55b14bc07f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:56.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f071dc34000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b14b6d8940 con 0x55b14bc16f80 2023-07-14T13:29:56.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f071dc34000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b14bbc6750 con 0x55b14bc17890 2023-07-14T13:29:56.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f071dc34000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b14ba1df60 con 0x55b14bbcd930 2023-07-14T13:29:56.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f07137fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc16f80 0x55b14bc07740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:56.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f07137fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc16f80 0x55b14bc07740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52686/0 (socket says 172.21.15.5:52686) 2023-07-14T13:29:56.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f07137fe640 1 -- 172.21.15.5:0/142027760 learned_addr learned my addr 172.21.15.5:0/142027760 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:56.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f0718e75640 1 --2- 172.21.15.5:0/142027760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b14bc17890 0x55b14bc07f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:56.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f0713fff640 1 --2- 172.21.15.5:0/142027760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55b14bbcd930 0x55b14bc07200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:56.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f07137fe640 1 -- 172.21.15.5:0/142027760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55b14bbcd930 msgr2=0x55b14bc07200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:56.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f07137fe640 1 --2- 172.21.15.5:0/142027760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55b14bbcd930 0x55b14bc07200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f07137fe640 1 -- 172.21.15.5:0/142027760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b14bc17890 msgr2=0x55b14bc07f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f07137fe640 1 --2- 172.21.15.5:0/142027760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b14bc17890 0x55b14bc07f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f07137fe640 1 -- 172.21.15.5:0/142027760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b14b9c6020 con 0x55b14bc16f80 2023-07-14T13:29:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f07137fe640 1 --2- 172.21.15.5:0/142027760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc16f80 0x55b14bc07740 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f0708007e20 tx=0x7f070800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=244b43f001861be7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f06fa7fc640 1 -- 172.21.15.5:0/142027760 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0708001d50 con 0x55b14bc16f80 2023-07-14T13:29:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f06fa7fc640 1 -- 172.21.15.5:0/142027760 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07080052e0 con 0x55b14bc16f80 2023-07-14T13:29:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f06fa7fc640 1 -- 172.21.15.5:0/142027760 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0708007250 con 0x55b14bc16f80 2023-07-14T13:29:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f071dc34000 1 -- 172.21.15.5:0/142027760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc16f80 msgr2=0x55b14bc07740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:56.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f071dc34000 1 --2- 172.21.15.5:0/142027760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc16f80 0x55b14bc07740 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f0708007e20 tx=0x7f070800a000 comp rx=0 tx=0).stop 2023-07-14T13:29:56.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f071dc34000 1 -- 172.21.15.5:0/142027760 shutdown_connections 2023-07-14T13:29:56.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f071dc34000 1 --2- 172.21.15.5:0/142027760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b14bc17890 0x55b14bc07f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f071dc34000 1 --2- 172.21.15.5:0/142027760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc16f80 0x55b14bc07740 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f071dc34000 1 --2- 172.21.15.5:0/142027760 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55b14bbcd930 0x55b14bc07200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f071dc34000 1 -- 172.21.15.5:0/142027760 >> 172.21.15.5:0/142027760 conn(0x55b14bbd3a90 msgr2=0x55b14bc09b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:56.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f071dc34000 1 -- 172.21.15.5:0/142027760 shutdown_connections 2023-07-14T13:29:56.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f071dc34000 1 -- 172.21.15.5:0/142027760 wait complete. 2023-07-14T13:29:56.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.615+0000 7f071dc34000 1 -- start start 2023-07-14T13:29:56.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f071dc34000 1 Processor -- start 2023-07-14T13:29:56.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f071dc34000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b14bbcd930 0x55b14bc78cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:56.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f071dc34000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc16f80 0x55b14bc79200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:56.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f071dc34000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55b14bc17890 0x55b14bc2d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:56.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f071dc34000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b14ba18800 con 0x55b14bc16f80 2023-07-14T13:29:56.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f071dc34000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b14ba1f400 con 0x55b14bbcd930 2023-07-14T13:29:56.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f071dc34000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b14b9b8b00 con 0x55b14bc17890 2023-07-14T13:29:56.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f071dc34000 10 client.0 _ll_register_callbacks cb 0x55b14bb994b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:29:56.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f07137fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc16f80 0x55b14bc79200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:56.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f07137fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc16f80 0x55b14bc79200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52688/0 (socket says 172.21.15.5:52688) 2023-07-14T13:29:56.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f07137fe640 1 -- 172.21.15.5:0/1191834002 learned_addr learned my addr 172.21.15.5:0/1191834002 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:56.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f0713fff640 1 --2- 172.21.15.5:0/1191834002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b14bbcd930 0x55b14bc78cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:56.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f0718e75640 1 --2- 172.21.15.5:0/1191834002 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55b14bc17890 0x55b14bc2d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:56.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f07137fe640 1 -- 172.21.15.5:0/1191834002 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55b14bc17890 msgr2=0x55b14bc2d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:56.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f07137fe640 1 --2- 172.21.15.5:0/1191834002 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55b14bc17890 0x55b14bc2d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f07137fe640 1 -- 172.21.15.5:0/1191834002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b14bbcd930 msgr2=0x55b14bc78cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:56.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f07137fe640 1 --2- 172.21.15.5:0/1191834002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b14bbcd930 0x55b14bc78cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f07137fe640 1 -- 172.21.15.5:0/1191834002 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b14b717890 con 0x55b14bc16f80 2023-07-14T13:29:56.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f07137fe640 1 --2- 172.21.15.5:0/1191834002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc16f80 0x55b14bc79200 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f0708013000 tx=0x7f0708000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e40b6b17c335d25 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:56.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f06f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-07-14T13:29:56.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f06f2ffd640 1 -- 172.21.15.5:0/1191834002 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0708005450 con 0x55b14bc16f80 2023-07-14T13:29:56.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f071dc34000 1 -- 172.21.15.5:0/1191834002 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b14bbcd7c0 con 0x55b14bc16f80 2023-07-14T13:29:56.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f06f2ffd640 1 -- 172.21.15.5:0/1191834002 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(172..172 src has 1..172) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f070800ec80 con 0x55b14bc16f80 2023-07-14T13:29:56.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f06f2ffd640 1 -- 172.21.15.5:0/1191834002 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f070800ee40 con 0x55b14bc16f80 2023-07-14T13:29:56.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f071dc34000 10 client.10140 fetch_fsmap learned FSMap version 83 2023-07-14T13:29:56.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f071dc34000 1 -- 172.21.15.5:0/1191834002 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) v3 -- 0x55b14b717cc0 con 0x55b14bc16f80 2023-07-14T13:29:56.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f06f2ffd640 1 -- 172.21.15.5:0/1191834002 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b14bbcd7c0 con 0x55b14bc16f80 2023-07-14T13:29:56.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f06f2ffd640 1 -- 172.21.15.5:0/1191834002 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 83) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f0708026070 con 0x55b14bc16f80 2023-07-14T13:29:56.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f071dc34000 10 client.10140 fetch_fsmap finished waiting for FSMap version 83 2023-07-14T13:29:56.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f071dc34000 10 client.10140 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-14T13:29:56.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f071dc34000 20 client.10140 populate_metadata read hostname 'smithi005' 2023-07-14T13:29:56.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f071dc34000 1 --2- 172.21.15.5:0/1191834002 >> [v2:172.21.15.5:6834/3098088945,v1:172.21.15.5:6835/3098088945] conn(0x55b14bc2e0f0 0x55b14bc2e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:56.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f071dc34000 4 client.10140 mds_command: new command op to 9966 tid=0[{"prefix": "status"}] 2023-07-14T13:29:56.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f071dc34000 1 -- 172.21.15.5:0/1191834002 --> [v2:172.21.15.5:6834/3098088945,v1:172.21.15.5:6835/3098088945] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b14ba19d50 con 0x55b14bc2e0f0 2023-07-14T13:29:56.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f0713fff640 1 --2- 172.21.15.5:0/1191834002 >> [v2:172.21.15.5:6834/3098088945,v1:172.21.15.5:6835/3098088945] conn(0x55b14bc2e0f0 0x55b14bc2e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:56.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f0713fff640 1 --2- 172.21.15.5:0/1191834002 >> [v2:172.21.15.5:6834/3098088945,v1:172.21.15.5:6835/3098088945] conn(0x55b14bc2e0f0 0x55b14bc2e4c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cef47419ea16424a server_cookie=e953a86cc161f655 in_seq=0 out_seq=0 2023-07-14T13:29:56.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f06f2ffd640 10 client.10140 ms_handle_connect on v2:172.21.15.5:6834/3098088945 2023-07-14T13:29:56.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f06f2ffd640 1 -- 172.21.15.5:0/1191834002 <== mds.0 v2:172.21.15.5:6834/3098088945 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55b14ba19d50 con 0x55b14bc2e0f0 2023-07-14T13:29:56.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f06f2ffd640 10 client.10140 handle_command_reply: tid=0 2023-07-14T13:29:56.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.619+0000 7f071dc34000 1 client.10140 shutdown 2023-07-14T13:29:56.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.623+0000 7f071dc34000 1 -- 172.21.15.5:0/1191834002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc16f80 msgr2=0x55b14bc79200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:56.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.623+0000 7f071dc34000 1 --2- 172.21.15.5:0/1191834002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc16f80 0x55b14bc79200 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f0708013000 tx=0x7f0708000ee0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.623+0000 7f071dc34000 1 -- 172.21.15.5:0/1191834002 shutdown_connections 2023-07-14T13:29:56.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.623+0000 7f071dc34000 1 --2- 172.21.15.5:0/1191834002 >> [v2:172.21.15.5:6834/3098088945,v1:172.21.15.5:6835/3098088945] conn(0x55b14bc2e0f0 0x55b14bc2e4c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.623+0000 7f071dc34000 1 --2- 172.21.15.5:0/1191834002 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55b14bc17890 0x55b14bc2d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.623+0000 7f071dc34000 1 --2- 172.21.15.5:0/1191834002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b14bc16f80 0x55b14bc79200 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.623+0000 7f06f2ffd640 0 client.10140 ms_handle_reset on v2:172.21.15.5:6834/3098088945 2023-07-14T13:29:56.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.623+0000 7f071dc34000 1 --2- 172.21.15.5:0/1191834002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b14bbcd930 0x55b14bc78cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.623+0000 7f071dc34000 1 -- 172.21.15.5:0/1191834002 >> 172.21.15.5:0/1191834002 conn(0x55b14bbd3a90 msgr2=0x55b14bbd8570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:56.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.623+0000 7f071dc34000 1 -- 172.21.15.5:0/1191834002 shutdown_connections 2023-07-14T13:29:56.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.623+0000 7f071dc34000 1 -- 172.21.15.5:0/1191834002 wait complete. 2023-07-14T13:29:56.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.623+0000 7f071dc34000 20 client.10140 trim_cache size 0 max 16384 2023-07-14T13:29:56.631 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T13:29:56.631 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "22affb8d-e389-40f8-a764-dd40eb1759c8", 2023-07-14T13:29:56.632 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-07-14T13:29:56.632 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 9966, 2023-07-14T13:29:56.632 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-07-14T13:29:56.632 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-07-14T13:29:56.632 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-07-14T13:29:56.632 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 10.452372713999999, 2023-07-14T13:29:56.632 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 83, 2023-07-14T13:29:56.633 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 172, 2023-07-14T13:29:56.633 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 172, 2023-07-14T13:29:56.633 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 16.264648761 2023-07-14T13:29:56.633 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T13:29:56.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.623+0000 7f071a8d8640 1 -- 172.21.15.5:0/474557591 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f07000663a0 msgr2=0x7f0700068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:56.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.623+0000 7f071a8d8640 1 --2- 172.21.15.5:0/474557591 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f07000663a0 0x7f0700068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0714158360 tx=0x7f0704008040 comp rx=0 tx=0).stop 2023-07-14T13:29:56.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.623+0000 7f071a8d8640 1 -- 172.21.15.5:0/474557591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0714158ce0 msgr2=0x7f07140c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:56.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.623+0000 7f071a8d8640 1 --2- 172.21.15.5:0/474557591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0714158ce0 0x7f07140c6300 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f070c01aeb0 tx=0x7f070c0195a0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.623+0000 7f071a8d8640 1 -- 172.21.15.5:0/474557591 shutdown_connections 2023-07-14T13:29:56.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.623+0000 7f071a8d8640 1 --2- 172.21.15.5:0/474557591 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f07000663a0 0x7f0700068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.623+0000 7f071a8d8640 1 --2- 172.21.15.5:0/474557591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0714158ce0 0x7f07140c6300 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.623+0000 7f071a8d8640 1 --2- 172.21.15.5:0/474557591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07140c9730 0x7f07141487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.623+0000 7f071a8d8640 1 --2- 172.21.15.5:0/474557591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07140c8ad0 0x7f071415bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.623+0000 7f071a8d8640 1 -- 172.21.15.5:0/474557591 >> 172.21.15.5:0/474557591 conn(0x7f07140afcf0 msgr2=0x7f07140c9000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:56.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.623+0000 7f071a8d8640 1 -- 172.21.15.5:0/474557591 shutdown_connections 2023-07-14T13:29:56.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.623+0000 7f071a8d8640 1 -- 172.21.15.5:0/474557591 wait complete. 2023-07-14T13:29:56.643 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T13:29:56.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.787+0000 7fcdc91fa640 1 Processor -- start 2023-07-14T13:29:56.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.787+0000 7fcdc91fa640 1 -- start start 2023-07-14T13:29:56.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.787+0000 7fcdc91fa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcdc4158490 0x7fcdc40af920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:56.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.787+0000 7fcdc91fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdc40c8480 0x7fcdc406f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.787+0000 7fcdc91fa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc40ccb10 con 0x7fcdc40c9dd0 2023-07-14T13:29:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.787+0000 7fcdc91fa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc40708d0 con 0x7fcdc4158490 2023-07-14T13:29:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.787+0000 7fcdc91fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc40c8990 con 0x7fcdc40c8480 2023-07-14T13:29:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.787+0000 7fcdc89f9640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcdc40c9dd0 0x7fcdc415ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:46046/0 (socket says 172.21.15.5:46046) 2023-07-14T13:29:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.787+0000 7fcdc89f9640 1 -- 172.21.15.5:0/3223929956 learned_addr learned my addr 172.21.15.5:0/3223929956 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.787+0000 7fcdc3fff640 1 --2- 172.21.15.5:0/3223929956 >> v2:172.21.15.5:3300/0 conn(0x7fcdc4158490 0x7fcdc40af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:56.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.787+0000 7fcdbbfff640 1 --2- 172.21.15.5:0/3223929956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdc40c8480 0x7fcdc406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:56.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.787+0000 7fcdc37fe640 1 -- 172.21.15.5:0/3223929956 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1599044096 0 0) 0x7fcdc40ccb10 con 0x7fcdc40c9dd0 2023-07-14T13:29:56.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.787+0000 7fcdc3fff640 1 -- 172.21.15.5:0/3223929956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdc40c8480 msgr2=0x7fcdc406f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:56.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.787+0000 7fcdc3fff640 1 --2- 172.21.15.5:0/3223929956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdc40c8480 0x7fcdc406f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.787+0000 7fcdc3fff640 1 -- 172.21.15.5:0/3223929956 >> v1:172.21.15.5:6789/0 conn(0x7fcdc40c9dd0 legacy=0x7fcdc415ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:56.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.787+0000 7fcdc3fff640 1 -- 172.21.15.5:0/3223929956 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc40c99a0 con 0x7fcdc4158490 2023-07-14T13:29:56.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.791+0000 7fcdc3fff640 1 --2- 172.21.15.5:0/3223929956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdc4158490 0x7fcdc40af920 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fcdb40097c0 tx=0x7fcdb401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cfcadb94df0d591 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:56.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.791+0000 7fcdc37fe640 1 -- 172.21.15.5:0/3223929956 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb40ab600 con 0x7fcdc4158490 2023-07-14T13:29:56.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.791+0000 7fcdc37fe640 1 -- 172.21.15.5:0/3223929956 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb40a7050 con 0x7fcdc4158490 2023-07-14T13:29:56.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.791+0000 7fcdc37fe640 1 -- 172.21.15.5:0/3223929956 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb40ab980 con 0x7fcdc4158490 2023-07-14T13:29:56.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.791+0000 7fcdc91fa640 1 -- 172.21.15.5:0/3223929956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdc4158490 msgr2=0x7fcdc40af920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:56.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.791+0000 7fcdc91fa640 1 --2- 172.21.15.5:0/3223929956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdc4158490 0x7fcdc40af920 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fcdb40097c0 tx=0x7fcdb401c480 comp rx=0 tx=0).stop 2023-07-14T13:29:56.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.791+0000 7fcdc91fa640 1 -- 172.21.15.5:0/3223929956 shutdown_connections 2023-07-14T13:29:56.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.791+0000 7fcdc91fa640 1 --2- 172.21.15.5:0/3223929956 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdc40c8480 0x7fcdc406f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.791+0000 7fcdc91fa640 1 --2- 172.21.15.5:0/3223929956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdc4158490 0x7fcdc40af920 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.791+0000 7fcdc91fa640 1 -- 172.21.15.5:0/3223929956 >> 172.21.15.5:0/3223929956 conn(0x7fcdc40ca8b0 msgr2=0x7fcdc40cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:56.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.791+0000 7fcdc91fa640 1 -- 172.21.15.5:0/3223929956 shutdown_connections 2023-07-14T13:29:56.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.791+0000 7fcdc91fa640 1 -- 172.21.15.5:0/3223929956 wait complete. 2023-07-14T13:29:56.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.795+0000 7fcdc91fa640 1 Processor -- start 2023-07-14T13:29:56.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.795+0000 7fcdc91fa640 1 -- start start 2023-07-14T13:29:56.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.795+0000 7fcdc91fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdc40c8480 0x7fcdc40c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:56.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.795+0000 7fcdc91fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdc40c9dd0 0x7fcdc414e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:56.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.795+0000 7fcdc91fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdc4158490 0x7fcdc41f6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:56.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.795+0000 7fcdc91fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc40c2520 con 0x7fcdc40c8480 2023-07-14T13:29:56.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.795+0000 7fcdc91fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc40c27c0 con 0x7fcdc40c9dd0 2023-07-14T13:29:56.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.795+0000 7fcdc91fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc40c2aa0 con 0x7fcdc4158490 2023-07-14T13:29:56.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.795+0000 7fcdc3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdc40c8480 0x7fcdc40c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:56.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.795+0000 7fcdc3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdc40c8480 0x7fcdc40c57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52696/0 (socket says 172.21.15.5:52696) 2023-07-14T13:29:56.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.795+0000 7fcdc3fff640 1 -- 172.21.15.5:0/3348194985 learned_addr learned my addr 172.21.15.5:0/3348194985 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:56.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.795+0000 7fcdbbfff640 1 --2- 172.21.15.5:0/3348194985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdc40c9dd0 0x7fcdc414e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:56.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.795+0000 7fcdc89f9640 1 --2- 172.21.15.5:0/3348194985 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdc4158490 0x7fcdc41f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:56.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.795+0000 7fcdc3fff640 1 -- 172.21.15.5:0/3348194985 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdc4158490 msgr2=0x7fcdc41f6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:56.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.795+0000 7fcdc3fff640 1 --2- 172.21.15.5:0/3348194985 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdc4158490 0x7fcdc41f6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.795+0000 7fcdc3fff640 1 -- 172.21.15.5:0/3348194985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdc40c9dd0 msgr2=0x7fcdc414e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:56.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.795+0000 7fcdc3fff640 1 --2- 172.21.15.5:0/3348194985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdc40c9dd0 0x7fcdc414e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.795+0000 7fcdc3fff640 1 -- 172.21.15.5:0/3348194985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb4009420 con 0x7fcdc40c8480 2023-07-14T13:29:56.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.795+0000 7fcdc3fff640 1 --2- 172.21.15.5:0/3348194985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdc40c8480 0x7fcdc40c57f0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fcdb40ae040 tx=0x7fcdb401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:56.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.795+0000 7fcdc17fa640 1 -- 172.21.15.5:0/3348194985 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb40b7450 con 0x7fcdc40c8480 2023-07-14T13:29:56.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.795+0000 7fcdc17fa640 1 -- 172.21.15.5:0/3348194985 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb40b75b0 con 0x7fcdc40c8480 2023-07-14T13:29:56.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.795+0000 7fcdc17fa640 1 -- 172.21.15.5:0/3348194985 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb40b7960 con 0x7fcdc40c8480 2023-07-14T13:29:56.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.795+0000 7fcdc91fa640 1 -- 172.21.15.5:0/3348194985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc40c2d80 con 0x7fcdc40c8480 2023-07-14T13:29:56.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.795+0000 7fcdc91fa640 1 -- 172.21.15.5:0/3348194985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc40c5df0 con 0x7fcdc40c8480 2023-07-14T13:29:56.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.795+0000 7fcdc91fa640 1 -- 172.21.15.5:0/3348194985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc4065fd0 con 0x7fcdc40c8480 2023-07-14T13:29:56.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.799+0000 7fcdc17fa640 1 -- 172.21.15.5:0/3348194985 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcdb40b7ac0 con 0x7fcdc40c8480 2023-07-14T13:29:56.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.799+0000 7fcdc17fa640 1 --2- 172.21.15.5:0/3348194985 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fcda40663a0 0x7fcda4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:56.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.799+0000 7fcdc17fa640 1 -- 172.21.15.5:0/3348194985 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fcdb411e8f0 con 0x7fcdc40c8480 2023-07-14T13:29:56.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.799+0000 7fcdbbfff640 1 --2- 172.21.15.5:0/3348194985 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fcda40663a0 0x7fcda4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:56.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.799+0000 7fcdbbfff640 1 --2- 172.21.15.5:0/3348194985 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fcda40663a0 0x7fcda4068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40c5020 tx=0x7fcdac008040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:56.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.803+0000 7fcdc17fa640 1 -- 172.21.15.5:0/3348194985 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fcdb40eba90 con 0x7fcdc40c8480 2023-07-14T13:29:56.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.991+0000 7fcdc91fa640 1 -- 172.21.15.5:0/3348194985 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcdc40678d0 con 0x7fcdc40c8480 2023-07-14T13:29:56.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.991+0000 7fcdc17fa640 1 -- 172.21.15.5:0/3348194985 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v83) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcdb40b0070 con 0x7fcdc40c8480 2023-07-14T13:29:56.992 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T13:29:56.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.991+0000 7fcdc91fa640 1 -- 172.21.15.5:0/3348194985 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fcda40663a0 msgr2=0x7fcda4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:56.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.991+0000 7fcdc91fa640 1 --2- 172.21.15.5:0/3348194985 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fcda40663a0 0x7fcda4068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40c5020 tx=0x7fcdac008040 comp rx=0 tx=0).stop 2023-07-14T13:29:56.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.991+0000 7fcdc91fa640 1 -- 172.21.15.5:0/3348194985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdc40c8480 msgr2=0x7fcdc40c57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:56.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.991+0000 7fcdc91fa640 1 --2- 172.21.15.5:0/3348194985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdc40c8480 0x7fcdc40c57f0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fcdb40ae040 tx=0x7fcdb401acc0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.991+0000 7fcdc91fa640 1 -- 172.21.15.5:0/3348194985 shutdown_connections 2023-07-14T13:29:56.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.991+0000 7fcdc91fa640 1 --2- 172.21.15.5:0/3348194985 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fcda40663a0 0x7fcda4068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.991+0000 7fcdc91fa640 1 --2- 172.21.15.5:0/3348194985 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcdc4158490 0x7fcdc41f6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.991+0000 7fcdc91fa640 1 --2- 172.21.15.5:0/3348194985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdc40c9dd0 0x7fcdc414e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.991+0000 7fcdc91fa640 1 --2- 172.21.15.5:0/3348194985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdc40c8480 0x7fcdc40c57f0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:56.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.991+0000 7fcdc91fa640 1 -- 172.21.15.5:0/3348194985 >> 172.21.15.5:0/3348194985 conn(0x7fcdc40ca8b0 msgr2=0x7fcdc414fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:56.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.991+0000 7fcdc91fa640 1 -- 172.21.15.5:0/3348194985 shutdown_connections 2023-07-14T13:29:56.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:56.991+0000 7fcdc91fa640 1 -- 172.21.15.5:0/3348194985 wait complete. 2023-07-14T13:29:57.013 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-14T13:29:57.014 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T13:29:57.014 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-07-14T13:29:57.015 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-14T13:29:57.015 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-14T13:29:57.016 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-14T13:29:57.016 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-14T13:29:57.017 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T13:29:57.017 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T13:29:57.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:57.019 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-07-14T13:29:57.030 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T13:29:57.030 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T13:29:57.030 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T13:29:57.030 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:29:57.030 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-07-14T13:29:57.031 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:29:57.031 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T13:29:57.031 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-07-14T13:29:57.031 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2023-07-14T13:29:57.031 INFO:teuthology.orchestra.run.smithi005.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T13:29:57.031 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-07-14T13:29:57.031 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2023-07-14T13:29:57.031 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-14T13:29:57.032 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 40119sec preferred_lft 40119sec 2023-07-14T13:29:57.032 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-07-14T13:29:57.032 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:29:57.032 INFO:teuthology.orchestra.run.smithi005.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T13:29:57.032 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-07-14T13:29:57.032 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2023-07-14T13:29:57.033 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T13:29:57.033 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-07-14T13:29:57.033 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2023-07-14T13:29:57.033 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-14T13:29:57.033 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:96:b6:fb:c6 brd ff:ff:ff:ff:ff:ff 2023-07-14T13:29:57.034 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-14T13:29:57.034 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:29:57.034 INFO:teuthology.orchestra.run.smithi005.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T13:29:57.034 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-14T13:29:57.034 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T13:29:57.034 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:29:57.034 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-14T13:29:57.034 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:29:57.035 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T13:29:57.035 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T13:29:57.035 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-14T13:29:57.035 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:29:57.036 INFO:teuthology.orchestra.run.smithi005.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T13:29:57.036 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-14T13:29:57.036 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-14T13:29:57.036 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:29:57.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:57.037 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T13:29:57.095 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-07-14T13:29:57.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:57.097 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-07-14T13:29:57.153 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-07-14T13:29:57.154 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T13:29:57.154 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-14T13:29:57.154 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-14T13:29:57.154 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-14T13:29:57.154 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T13:29:57.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:57.155 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-07-14T13:29:57.156 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-07-14T13:29:57.156 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-14T13:29:57.156 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-14T13:29:57.156 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-14T13:29:57.157 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-07-14T13:29:57.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:57.255 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-07-14T13:29:57.266 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-14T13:29:57.267 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-14T13:29:57.267 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T13:29:57.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:57.270 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-07-14T13:29:57.333 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T13:29:57.334 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-14T13:29:57.384 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-14T13:29:57.385 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T13:29:57.385 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-14T13:29:57.439 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-14T13:29:57.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:57.440 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:29:57.539 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:29:57.540 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T13:29:57.541 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T13:29:57.555 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:29:57.555 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T13:29:57.555 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T13:29:57.555 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T13:29:57.555 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T13:29:57.564 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:29:57.564 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T13:29:57.564 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T13:29:57.564 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T13:29:57.565 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T13:29:57.565 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790" 2023-07-14T13:29:57.565 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790:/ 2023-07-14T13:29:57.565 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=22affb8d-e389-40f8-a764-dd40eb1759c8" will pass to kernel 2023-07-14T13:29:57.568 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T13:29:57.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:57.569 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-14T13:29:57.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:57.592 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T13:29:57.653 INFO:teuthology.orchestra.run.smithi005.stdout:client10152 2023-07-14T13:29:57.654 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:29:57.654 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:29:57.704 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-14T13:29:57.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.887+0000 7f5cbb293640 1 Processor -- start 2023-07-14T13:29:57.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.887+0000 7f5cbb293640 1 -- start start 2023-07-14T13:29:57.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.891+0000 7f5cbb293640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cb413ed20 0x7f5cb406a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:57.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.891+0000 7f5cbb293640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5cb406de30 0x7f5cb406e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:57.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.891+0000 7f5cbb293640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5cb406bd20 0x7f5cb406c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:57.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.891+0000 7f5cbb293640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb406a470 con 0x7f5cb406bd20 2023-07-14T13:29:57.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.891+0000 7f5cbb293640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb406add0 con 0x7f5cb406de30 2023-07-14T13:29:57.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.891+0000 7f5cbb293640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb406c6a0 con 0x7f5cb413ed20 2023-07-14T13:29:57.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.891+0000 7f5cb9830640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5cb406bd20 0x7f5cb406c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:57.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.891+0000 7f5cb9830640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5cb406bd20 0x7f5cb406c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52706/0 (socket says 172.21.15.5:52706) 2023-07-14T13:29:57.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.891+0000 7f5cb9830640 1 -- 172.21.15.5:0/1151136593 learned_addr learned my addr 172.21.15.5:0/1151136593 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:57.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.891+0000 7f5cb902f640 1 --2- 172.21.15.5:0/1151136593 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cb413ed20 0x7f5cb406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:57.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.891+0000 7f5cb9830640 1 -- 172.21.15.5:0/1151136593 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cb413ed20 msgr2=0x7f5cb406a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:57.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.891+0000 7f5cb882e640 1 --2- 172.21.15.5:0/1151136593 >> v2:172.21.15.154:3300/0 conn(0x7f5cb406de30 0x7f5cb406e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:57.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.891+0000 7f5cb9830640 1 --2- 172.21.15.5:0/1151136593 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cb413ed20 0x7f5cb406a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.891+0000 7f5cb9830640 1 -- 172.21.15.5:0/1151136593 >> v2:172.21.15.154:3300/0 conn(0x7f5cb406de30 msgr2=0x7f5cb406e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:57.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.891+0000 7f5cb9830640 1 --2- 172.21.15.5:0/1151136593 >> v2:172.21.15.154:3300/0 conn(0x7f5cb406de30 0x7f5cb406e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.891+0000 7f5cb9830640 1 -- 172.21.15.5:0/1151136593 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb40697f0 con 0x7f5cb406bd20 2023-07-14T13:29:57.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.891+0000 7f5cb902f640 1 --2- 172.21.15.5:0/1151136593 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cb413ed20 0x7f5cb406a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:29:57.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.891+0000 7f5cb882e640 1 --2- 172.21.15.5:0/1151136593 >> v2:172.21.15.154:3300/0 conn(0x7f5cb406de30 0x7f5cb406e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:29:57.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.895+0000 7f5cb9830640 1 --2- 172.21.15.5:0/1151136593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb406bd20 0x7f5cb406c160 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4070f40 tx=0x7f5cac01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b82ae54d2fc4171 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:57.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.895+0000 7f5cabfff640 1 -- 172.21.15.5:0/1151136593 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac0a57c0 con 0x7f5cb406bd20 2023-07-14T13:29:57.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.895+0000 7f5cabfff640 1 -- 172.21.15.5:0/1151136593 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cac0a5920 con 0x7f5cb406bd20 2023-07-14T13:29:57.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.895+0000 7f5cabfff640 1 -- 172.21.15.5:0/1151136593 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac0a5cb0 con 0x7f5cb406bd20 2023-07-14T13:29:57.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.895+0000 7f5cbb293640 1 -- 172.21.15.5:0/1151136593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb406bd20 msgr2=0x7f5cb406c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:57.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.895+0000 7f5cbb293640 1 --2- 172.21.15.5:0/1151136593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb406bd20 0x7f5cb406c160 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4070f40 tx=0x7f5cac01c940 comp rx=0 tx=0).stop 2023-07-14T13:29:57.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.895+0000 7f5cbb293640 1 -- 172.21.15.5:0/1151136593 shutdown_connections 2023-07-14T13:29:57.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.895+0000 7f5cbb293640 1 --2- 172.21.15.5:0/1151136593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb406bd20 0x7f5cb406c160 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.895+0000 7f5cbb293640 1 --2- 172.21.15.5:0/1151136593 >> v2:172.21.15.154:3300/0 conn(0x7f5cb406de30 0x7f5cb406e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.895+0000 7f5cbb293640 1 --2- 172.21.15.5:0/1151136593 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cb413ed20 0x7f5cb406a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.895+0000 7f5cbb293640 1 -- 172.21.15.5:0/1151136593 >> 172.21.15.5:0/1151136593 conn(0x7f5cb40b1300 msgr2=0x7f5cb40ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:57.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.895+0000 7f5cbb293640 1 -- 172.21.15.5:0/1151136593 shutdown_connections 2023-07-14T13:29:57.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.895+0000 7f5cbb293640 1 -- 172.21.15.5:0/1151136593 wait complete. 2023-07-14T13:29:57.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.895+0000 7f5cbb293640 1 Processor -- start 2023-07-14T13:29:57.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.895+0000 7f5cbb293640 1 -- start start 2023-07-14T13:29:57.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.895+0000 7f5cbb293640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb406bd20 0x7f5cb41f6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:57.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.895+0000 7f5cbb293640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cb406de30 0x7f5cb40b3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:57.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.895+0000 7f5cbb293640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cb413ed20 0x7f5cb413c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:57.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.895+0000 7f5cbb293640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb40adb90 con 0x7f5cb406bd20 2023-07-14T13:29:57.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.895+0000 7f5cbb293640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb40ad2f0 con 0x7f5cb413ed20 2023-07-14T13:29:57.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.895+0000 7f5cbb293640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb40ad5d0 con 0x7f5cb406de30 2023-07-14T13:29:57.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.899+0000 7f5cb902f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb406bd20 0x7f5cb41f6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:57.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.899+0000 7f5cb902f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb406bd20 0x7f5cb41f6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52716/0 (socket says 172.21.15.5:52716) 2023-07-14T13:29:57.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.899+0000 7f5cb902f640 1 -- 172.21.15.5:0/3577242450 learned_addr learned my addr 172.21.15.5:0/3577242450 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:57.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.899+0000 7f5cb882e640 1 --2- 172.21.15.5:0/3577242450 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cb406de30 0x7f5cb40b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:57.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.899+0000 7f5cb902f640 1 -- 172.21.15.5:0/3577242450 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cb406de30 msgr2=0x7f5cb40b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:57.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.899+0000 7f5cb902f640 1 --2- 172.21.15.5:0/3577242450 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cb406de30 0x7f5cb40b3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.899+0000 7f5cb902f640 1 -- 172.21.15.5:0/3577242450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cb413ed20 msgr2=0x7f5cb413c7e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-14T13:29:57.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.899+0000 7f5cb902f640 1 --2- 172.21.15.5:0/3577242450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cb413ed20 0x7f5cb413c7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.899+0000 7f5cb902f640 1 -- 172.21.15.5:0/3577242450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cac009b30 con 0x7f5cb406bd20 2023-07-14T13:29:57.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.899+0000 7f5cb902f640 1 --2- 172.21.15.5:0/3577242450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb406bd20 0x7f5cb41f6cc0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f5cb000c7f0 tx=0x7f5cb000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.899+0000 7f5ca9ffb640 1 -- 172.21.15.5:0/3577242450 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0007820 con 0x7f5cb406bd20 2023-07-14T13:29:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.899+0000 7f5ca9ffb640 1 -- 172.21.15.5:0/3577242450 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb0007980 con 0x7f5cb406bd20 2023-07-14T13:29:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.899+0000 7f5ca9ffb640 1 -- 172.21.15.5:0/3577242450 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0007d30 con 0x7f5cb406bd20 2023-07-14T13:29:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.899+0000 7f5cbb293640 1 -- 172.21.15.5:0/3577242450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb40ad8b0 con 0x7f5cb406bd20 2023-07-14T13:29:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.899+0000 7f5cbb293640 1 -- 172.21.15.5:0/3577242450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb41f7200 con 0x7f5cb406bd20 2023-07-14T13:29:57.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.899+0000 7f5cbb293640 1 -- 172.21.15.5:0/3577242450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb40678d0 con 0x7f5cb406bd20 2023-07-14T13:29:57.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.899+0000 7f5ca9ffb640 1 -- 172.21.15.5:0/3577242450 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5cb00113f0 con 0x7f5cb406bd20 2023-07-14T13:29:57.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.903+0000 7f5ca9ffb640 1 --2- 172.21.15.5:0/3577242450 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f5c980663a0 0x7f5c98068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:57.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.903+0000 7f5ca9ffb640 1 -- 172.21.15.5:0/3577242450 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f5cb0084350 con 0x7f5cb406bd20 2023-07-14T13:29:57.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.903+0000 7f5cb882e640 1 --2- 172.21.15.5:0/3577242450 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f5c980663a0 0x7f5c98068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:57.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.903+0000 7f5cb882e640 1 --2- 172.21.15.5:0/3577242450 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f5c980663a0 0x7f5c98068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5cb413d5e0 tx=0x7f5ca4008040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:57.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:57.907+0000 7f5ca9ffb640 1 -- 172.21.15.5:0/3577242450 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f5cb0051580 con 0x7f5cb406bd20 2023-07-14T13:29:58.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.079+0000 7f5cbb293640 1 -- 172.21.15.5:0/3577242450 --> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f5cb406a060 con 0x7f5c980663a0 2023-07-14T13:29:58.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.083+0000 7f5ca9ffb640 1 -- 172.21.15.5:0/3577242450 <== mgr.9247 v2:172.21.15.154:6832/1905284593 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f5cb406a060 con 0x7f5c980663a0 2023-07-14T13:29:58.084 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-07-14T13:29:58.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:29:58.085 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs" 2023-07-14T13:29:58.085 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:29:58.085 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-07-14T13:29:58.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.083+0000 7f5cbb293640 1 -- 172.21.15.5:0/3577242450 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f5c980663a0 msgr2=0x7f5c98068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:58.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.083+0000 7f5cbb293640 1 --2- 172.21.15.5:0/3577242450 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f5c980663a0 0x7f5c98068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5cb413d5e0 tx=0x7f5ca4008040 comp rx=0 tx=0).stop 2023-07-14T13:29:58.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.083+0000 7f5cbb293640 1 -- 172.21.15.5:0/3577242450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb406bd20 msgr2=0x7f5cb41f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:58.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.083+0000 7f5cbb293640 1 --2- 172.21.15.5:0/3577242450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb406bd20 0x7f5cb41f6cc0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f5cb000c7f0 tx=0x7f5cb000ccb0 comp rx=0 tx=0).stop 2023-07-14T13:29:58.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.083+0000 7f5cbb293640 1 -- 172.21.15.5:0/3577242450 shutdown_connections 2023-07-14T13:29:58.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.083+0000 7f5cbb293640 1 --2- 172.21.15.5:0/3577242450 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f5c980663a0 0x7f5c98068850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:58.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.083+0000 7f5cbb293640 1 --2- 172.21.15.5:0/3577242450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cb413ed20 0x7f5cb413c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:58.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.083+0000 7f5cbb293640 1 --2- 172.21.15.5:0/3577242450 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5cb406de30 0x7f5cb40b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:58.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.083+0000 7f5cbb293640 1 --2- 172.21.15.5:0/3577242450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5cb406bd20 0x7f5cb41f6cc0 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.083+0000 7f5cbb293640 1 -- 172.21.15.5:0/3577242450 >> 172.21.15.5:0/3577242450 conn(0x7f5cb40b1300 msgr2=0x7f5cb415a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.083+0000 7f5cbb293640 1 -- 172.21.15.5:0/3577242450 shutdown_connections 2023-07-14T13:29:58.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.083+0000 7f5cbb293640 1 -- 172.21.15.5:0/3577242450 wait complete. 2023-07-14T13:29:58.105 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-14T13:29:58.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.251+0000 7fd1dc434640 1 Processor -- start 2023-07-14T13:29:58.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.251+0000 7fd1dc434640 1 -- start start 2023-07-14T13:29:58.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.251+0000 7fd1dc434640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1d40d06b0 0x7fd1d40b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:58.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.251+0000 7fd1dc434640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd1d4145430 0x7fd1d40b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:58.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.251+0000 7fd1dc434640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd1d40b1f70 0x7fd1d40d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:58.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.251+0000 7fd1dc434640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d40b2410 con 0x7fd1d40b1f70 2023-07-14T13:29:58.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.251+0000 7fd1dc434640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d40b26f0 con 0x7fd1d4145430 2023-07-14T13:29:58.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.251+0000 7fd1dc434640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d40b29d0 con 0x7fd1d40d06b0 2023-07-14T13:29:58.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.251+0000 7fd1da9d1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd1d40b1f70 0x7fd1d40d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:58.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.251+0000 7fd1da9d1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd1d40b1f70 0x7fd1d40d22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52730/0 (socket says 172.21.15.5:52730) 2023-07-14T13:29:58.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.251+0000 7fd1da9d1640 1 -- 172.21.15.5:0/3340836210 learned_addr learned my addr 172.21.15.5:0/3340836210 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:58.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.251+0000 7fd1d99cf640 1 --2- 172.21.15.5:0/3340836210 >> v2:172.21.15.154:3300/0 conn(0x7fd1d4145430 0x7fd1d40b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:58.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.251+0000 7fd1da1d0640 1 --2- 172.21.15.5:0/3340836210 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1d40d06b0 0x7fd1d40b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:58.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.251+0000 7fd1da9d1640 1 -- 172.21.15.5:0/3340836210 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1d40d06b0 msgr2=0x7fd1d40b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:58.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.251+0000 7fd1da9d1640 1 --2- 172.21.15.5:0/3340836210 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1d40d06b0 0x7fd1d40b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:58.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.251+0000 7fd1da9d1640 1 -- 172.21.15.5:0/3340836210 >> v2:172.21.15.154:3300/0 conn(0x7fd1d4145430 msgr2=0x7fd1d40b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:58.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.251+0000 7fd1da9d1640 1 --2- 172.21.15.5:0/3340836210 >> v2:172.21.15.154:3300/0 conn(0x7fd1d4145430 0x7fd1d40b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:58.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.251+0000 7fd1da9d1640 1 -- 172.21.15.5:0/3340836210 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d40b2cb0 con 0x7fd1d40b1f70 2023-07-14T13:29:58.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.251+0000 7fd1d99cf640 1 --2- 172.21.15.5:0/3340836210 >> v2:172.21.15.154:3300/0 conn(0x7fd1d4145430 0x7fd1d40b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:29:58.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.251+0000 7fd1da1d0640 1 --2- 172.21.15.5:0/3340836210 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1d40d06b0 0x7fd1d40b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:29:58.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.255+0000 7fd1da9d1640 1 --2- 172.21.15.5:0/3340836210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1d40b1f70 0x7fd1d40d22e0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fd1d408af50 tx=0x7fd1cc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d545c8d25c0d17 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:58.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.255+0000 7fd1d91ce640 1 -- 172.21.15.5:0/3340836210 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc0a5840 con 0x7fd1d40b1f70 2023-07-14T13:29:58.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.255+0000 7fd1d91ce640 1 -- 172.21.15.5:0/3340836210 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1cc0a59a0 con 0x7fd1d40b1f70 2023-07-14T13:29:58.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.255+0000 7fd1d91ce640 1 -- 172.21.15.5:0/3340836210 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc0a5d30 con 0x7fd1d40b1f70 2023-07-14T13:29:58.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.255+0000 7fd1dc434640 1 -- 172.21.15.5:0/3340836210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1d40b1f70 msgr2=0x7fd1d40d22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:58.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.255+0000 7fd1dc434640 1 --2- 172.21.15.5:0/3340836210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1d40b1f70 0x7fd1d40d22e0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fd1d408af50 tx=0x7fd1cc01c9a0 comp rx=0 tx=0).stop 2023-07-14T13:29:58.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.255+0000 7fd1dc434640 1 -- 172.21.15.5:0/3340836210 shutdown_connections 2023-07-14T13:29:58.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.255+0000 7fd1dc434640 1 --2- 172.21.15.5:0/3340836210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1d40b1f70 0x7fd1d40d22e0 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:58.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.255+0000 7fd1dc434640 1 --2- 172.21.15.5:0/3340836210 >> v2:172.21.15.154:3300/0 conn(0x7fd1d4145430 0x7fd1d40b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:58.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.255+0000 7fd1dc434640 1 --2- 172.21.15.5:0/3340836210 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1d40d06b0 0x7fd1d40b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:58.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.255+0000 7fd1dc434640 1 -- 172.21.15.5:0/3340836210 >> 172.21.15.5:0/3340836210 conn(0x7fd1d40659d0 msgr2=0x7fd1d409b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:58.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.255+0000 7fd1dc434640 1 -- 172.21.15.5:0/3340836210 shutdown_connections 2023-07-14T13:29:58.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.255+0000 7fd1dc434640 1 -- 172.21.15.5:0/3340836210 wait complete. 2023-07-14T13:29:58.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.259+0000 7fd1dc434640 1 Processor -- start 2023-07-14T13:29:58.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.259+0000 7fd1dc434640 1 -- start start 2023-07-14T13:29:58.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.259+0000 7fd1dc434640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1d40b1f70 0x7fd1d4154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:58.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.259+0000 7fd1dc434640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1d40d06b0 0x7fd1d4153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:58.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.259+0000 7fd1dc434640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1d4155a00 0x7fd1d40b7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:58.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.259+0000 7fd1dc434640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d40b60c0 con 0x7fd1d40d06b0 2023-07-14T13:29:58.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.259+0000 7fd1dc434640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d4155720 con 0x7fd1d40b1f70 2023-07-14T13:29:58.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.259+0000 7fd1dc434640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d40b69a0 con 0x7fd1d4155a00 2023-07-14T13:29:58.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.259+0000 7fd1d99cf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1d40d06b0 0x7fd1d4153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:58.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.259+0000 7fd1d99cf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1d40d06b0 0x7fd1d4153bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52736/0 (socket says 172.21.15.5:52736) 2023-07-14T13:29:58.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.259+0000 7fd1d99cf640 1 -- 172.21.15.5:0/2980282149 learned_addr learned my addr 172.21.15.5:0/2980282149 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:58.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.259+0000 7fd1da9d1640 1 --2- 172.21.15.5:0/2980282149 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1d4155a00 0x7fd1d40b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:58.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.259+0000 7fd1da1d0640 1 --2- 172.21.15.5:0/2980282149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1d40b1f70 0x7fd1d4154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:58.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.259+0000 7fd1d99cf640 1 -- 172.21.15.5:0/2980282149 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1d4155a00 msgr2=0x7fd1d40b7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:58.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.259+0000 7fd1d99cf640 1 --2- 172.21.15.5:0/2980282149 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1d4155a00 0x7fd1d40b7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:58.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.259+0000 7fd1d99cf640 1 -- 172.21.15.5:0/2980282149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1d40b1f70 msgr2=0x7fd1d4154ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:58.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.259+0000 7fd1d99cf640 1 --2- 172.21.15.5:0/2980282149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1d40b1f70 0x7fd1d4154ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:58.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.259+0000 7fd1d99cf640 1 -- 172.21.15.5:0/2980282149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc009b30 con 0x7fd1d40d06b0 2023-07-14T13:29:58.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.259+0000 7fd1da9d1640 1 --2- 172.21.15.5:0/2980282149 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1d4155a00 0x7fd1d40b7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:29:58.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.259+0000 7fd1da1d0640 1 --2- 172.21.15.5:0/2980282149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1d40b1f70 0x7fd1d4154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:29:58.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.259+0000 7fd1d99cf640 1 --2- 172.21.15.5:0/2980282149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1d40d06b0 0x7fd1d4153bf0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400c7c0 tx=0x7fd1c400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:58.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.259+0000 7fd1caffd640 1 -- 172.21.15.5:0/2980282149 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4007a30 con 0x7fd1d40d06b0 2023-07-14T13:29:58.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.259+0000 7fd1caffd640 1 -- 172.21.15.5:0/2980282149 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c4007b90 con 0x7fd1d40d06b0 2023-07-14T13:29:58.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.259+0000 7fd1caffd640 1 -- 172.21.15.5:0/2980282149 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c400ce70 con 0x7fd1d40d06b0 2023-07-14T13:29:58.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.259+0000 7fd1dc434640 1 -- 172.21.15.5:0/2980282149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d40b6c80 con 0x7fd1d40d06b0 2023-07-14T13:29:58.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.259+0000 7fd1dc434640 1 -- 172.21.15.5:0/2980282149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d4155410 con 0x7fd1d40d06b0 2023-07-14T13:29:58.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.263+0000 7fd1dc434640 1 -- 172.21.15.5:0/2980282149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d4072e70 con 0x7fd1d40d06b0 2023-07-14T13:29:58.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.263+0000 7fd1caffd640 1 -- 172.21.15.5:0/2980282149 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 85) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd1c40113f0 con 0x7fd1d40d06b0 2023-07-14T13:29:58.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.263+0000 7fd1caffd640 1 --2- 172.21.15.5:0/2980282149 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd1b80663a0 0x7fd1b8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:58.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.263+0000 7fd1caffd640 1 -- 172.21.15.5:0/2980282149 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fd1c4084510 con 0x7fd1d40d06b0 2023-07-14T13:29:58.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.263+0000 7fd1da1d0640 1 --2- 172.21.15.5:0/2980282149 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd1b80663a0 0x7fd1b8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:58.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.263+0000 7fd1da1d0640 1 --2- 172.21.15.5:0/2980282149 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd1b80663a0 0x7fd1b8068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0006fd0 tx=0x7fd1d0008040 comp rx=0 tx=0).ready entity=mgr.9247 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:58.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.267+0000 7fd1caffd640 1 -- 172.21.15.5:0/2980282149 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd1c40516b0 con 0x7fd1d40d06b0 2023-07-14T13:29:58.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:58.459+0000 7fd1dc434640 1 -- 172.21.15.5:0/2980282149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fd1d40b71a0 con 0x7fd1d40d06b0 2023-07-14T13:29:59.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.239+0000 7fd1caffd640 1 -- 172.21.15.5:0/2980282149 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 86) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fd1c4051a80 con 0x7fd1d40d06b0 2023-07-14T13:29:59.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.239+0000 7fd1caffd640 1 -- 172.21.15.5:0/2980282149 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v86) v1 ==== 92+0+0 (secure 0 0 0) 0x7fd1c406f020 con 0x7fd1d40d06b0 2023-07-14T13:29:59.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.243+0000 7fd1dc434640 1 -- 172.21.15.5:0/2980282149 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd1b80663a0 msgr2=0x7fd1b8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.243+0000 7fd1dc434640 1 --2- 172.21.15.5:0/2980282149 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd1b80663a0 0x7fd1b8068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0006fd0 tx=0x7fd1d0008040 comp rx=0 tx=0).stop 2023-07-14T13:29:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.243+0000 7fd1dc434640 1 -- 172.21.15.5:0/2980282149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1d40d06b0 msgr2=0x7fd1d4153bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.243+0000 7fd1dc434640 1 --2- 172.21.15.5:0/2980282149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1d40d06b0 0x7fd1d4153bf0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400c7c0 tx=0x7fd1c400cc80 comp rx=0 tx=0).stop 2023-07-14T13:29:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.243+0000 7fd1dc434640 1 -- 172.21.15.5:0/2980282149 shutdown_connections 2023-07-14T13:29:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.243+0000 7fd1dc434640 1 --2- 172.21.15.5:0/2980282149 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fd1b80663a0 0x7fd1b8068850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:59.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.243+0000 7fd1dc434640 1 --2- 172.21.15.5:0/2980282149 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd1d4155a00 0x7fd1d40b7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:59.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.243+0000 7fd1dc434640 1 --2- 172.21.15.5:0/2980282149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1d40d06b0 0x7fd1d4153bf0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:59.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.243+0000 7fd1dc434640 1 --2- 172.21.15.5:0/2980282149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1d40b1f70 0x7fd1d4154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:59.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.243+0000 7fd1dc434640 1 -- 172.21.15.5:0/2980282149 >> 172.21.15.5:0/2980282149 conn(0x7fd1d40659d0 msgr2=0x7fd1d406b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:59.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.243+0000 7fd1dc434640 1 -- 172.21.15.5:0/2980282149 shutdown_connections 2023-07-14T13:29:59.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.243+0000 7fd1dc434640 1 -- 172.21.15.5:0/2980282149 wait complete. 2023-07-14T13:29:59.269 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-14T13:29:59.419 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:59.416+0000 7f9818d8a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:29:59.423 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:29:59.423+0000 7fb91d833180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:29:59.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.423+0000 7f6575303640 1 Processor -- start 2023-07-14T13:29:59.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.423+0000 7f6575303640 1 -- start start 2023-07-14T13:29:59.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.423+0000 7f6575303640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f657015f320 0x7f65700d22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:59.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.423+0000 7f6575303640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f65700d0230 0x7f65700d2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:59.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.423+0000 7f6575303640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65700b0230 con 0x7f65700b3690 2023-07-14T13:29:59.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.423+0000 7f6575303640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65700d0a60 con 0x7f65700d0230 2023-07-14T13:29:59.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.423+0000 7f6575303640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65700af9d0 con 0x7f657015f320 2023-07-14T13:29:59.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.423+0000 7f6567fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f65700d0230 0x7f65700d2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:59.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.423+0000 7f6567fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f65700d0230 0x7f65700d2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60866/0 (socket says 172.21.15.5:60866) 2023-07-14T13:29:59.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.423+0000 7f6567fff640 1 -- 172.21.15.5:0/810996572 learned_addr learned my addr 172.21.15.5:0/810996572 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:59.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.423+0000 7f656effd640 1 --2- 172.21.15.5:0/810996572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f657015f320 0x7f65700d22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:59.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.423+0000 7f6567fff640 1 -- 172.21.15.5:0/810996572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f657015f320 msgr2=0x7f65700d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:59.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.423+0000 7f6567fff640 1 --2- 172.21.15.5:0/810996572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f657015f320 0x7f65700d22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:59.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.423+0000 7f6567fff640 1 -- 172.21.15.5:0/810996572 >> v1:172.21.15.154:6789/0 conn(0x7f65700b3690 legacy=0x7f65700b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:59.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.423+0000 7f6567fff640 1 -- 172.21.15.5:0/810996572 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65700d0780 con 0x7f65700d0230 2023-07-14T13:29:59.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.427+0000 7f6567fff640 1 --2- 172.21.15.5:0/810996572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65700d0230 0x7f65700d2800 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f6558009870 tx=0x7f655801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=278dfbaf96d63b1a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:59.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.427+0000 7f656e7fc640 1 -- 172.21.15.5:0/810996572 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65580a7070 con 0x7f65700d0230 2023-07-14T13:29:59.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.427+0000 7f656e7fc640 1 -- 172.21.15.5:0/810996572 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65580ab430 con 0x7f65700d0230 2023-07-14T13:29:59.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.427+0000 7f656e7fc640 1 -- 172.21.15.5:0/810996572 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65580ab7c0 con 0x7f65700d0230 2023-07-14T13:29:59.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.427+0000 7f6575303640 1 -- 172.21.15.5:0/810996572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65700d0230 msgr2=0x7f65700d2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:59.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.427+0000 7f6575303640 1 --2- 172.21.15.5:0/810996572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65700d0230 0x7f65700d2800 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f6558009870 tx=0x7f655801c540 comp rx=0 tx=0).stop 2023-07-14T13:29:59.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.427+0000 7f6575303640 1 -- 172.21.15.5:0/810996572 shutdown_connections 2023-07-14T13:29:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.427+0000 7f6575303640 1 --2- 172.21.15.5:0/810996572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65700d0230 0x7f65700d2800 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.427+0000 7f6575303640 1 --2- 172.21.15.5:0/810996572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f657015f320 0x7f65700d22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.427+0000 7f6575303640 1 -- 172.21.15.5:0/810996572 >> 172.21.15.5:0/810996572 conn(0x7f65700659d0 msgr2=0x7f657009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.427+0000 7f6575303640 1 -- 172.21.15.5:0/810996572 shutdown_connections 2023-07-14T13:29:59.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.427+0000 7f6575303640 1 -- 172.21.15.5:0/810996572 wait complete. 2023-07-14T13:29:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.431+0000 7f6575303640 1 Processor -- start 2023-07-14T13:29:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.431+0000 7f6575303640 1 -- start start 2023-07-14T13:29:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.431+0000 7f6575303640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65700b3690 0x7f657014da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.431+0000 7f6575303640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65700d0230 0x7f6570156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.431+0000 7f6575303640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f657015f320 0x7f65700b6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.431+0000 7f6575303640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657014e6d0 con 0x7f65700b3690 2023-07-14T13:29:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.431+0000 7f6575303640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657015be60 con 0x7f65700d0230 2023-07-14T13:29:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.431+0000 7f6575303640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657015c6a0 con 0x7f657015f320 2023-07-14T13:29:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.431+0000 7f656effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65700b3690 0x7f657014da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.431+0000 7f656effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65700b3690 0x7f657014da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60882/0 (socket says 172.21.15.5:60882) 2023-07-14T13:29:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.431+0000 7f656effd640 1 -- 172.21.15.5:0/1184327646 learned_addr learned my addr 172.21.15.5:0/1184327646 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.431+0000 7f6567fff640 1 --2- 172.21.15.5:0/1184327646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65700d0230 0x7f6570156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.431+0000 7f656f7fe640 1 --2- 172.21.15.5:0/1184327646 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f657015f320 0x7f65700b6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.431+0000 7f656effd640 1 -- 172.21.15.5:0/1184327646 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f657015f320 msgr2=0x7f65700b6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.431+0000 7f656effd640 1 --2- 172.21.15.5:0/1184327646 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f657015f320 0x7f65700b6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.431+0000 7f656effd640 1 -- 172.21.15.5:0/1184327646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65700d0230 msgr2=0x7f6570156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.431+0000 7f656effd640 1 --2- 172.21.15.5:0/1184327646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65700d0230 0x7f6570156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.431+0000 7f656effd640 1 -- 172.21.15.5:0/1184327646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65580094d0 con 0x7f65700b3690 2023-07-14T13:29:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.431+0000 7f656f7fe640 1 --2- 172.21.15.5:0/1184327646 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f657015f320 0x7f65700b6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:29:59.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.431+0000 7f656effd640 1 --2- 172.21.15.5:0/1184327646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65700b3690 0x7f657014da90 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f656000e930 tx=0x7f656000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:59.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.431+0000 7f65677fe640 1 -- 172.21.15.5:0/1184327646 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6560009690 con 0x7f65700b3690 2023-07-14T13:29:59.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.431+0000 7f65677fe640 1 -- 172.21.15.5:0/1184327646 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656000ca00 con 0x7f65700b3690 2023-07-14T13:29:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.431+0000 7f65677fe640 1 -- 172.21.15.5:0/1184327646 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656000cd70 con 0x7f65700b3690 2023-07-14T13:29:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.431+0000 7f6575303640 1 -- 172.21.15.5:0/1184327646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f657015c0e0 con 0x7f65700b3690 2023-07-14T13:29:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.431+0000 7f6575303640 1 -- 172.21.15.5:0/1184327646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f657014e360 con 0x7f65700b3690 2023-07-14T13:29:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.435+0000 7f6575303640 1 -- 172.21.15.5:0/1184327646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65700678d0 con 0x7f65700b3690 2023-07-14T13:29:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.435+0000 7f65677fe640 1 -- 172.21.15.5:0/1184327646 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 86) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f6560013470 con 0x7f65700b3690 2023-07-14T13:29:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.435+0000 7f65677fe640 1 --2- 172.21.15.5:0/1184327646 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f65500663f0 0x7f65500688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.435+0000 7f65677fe640 1 -- 172.21.15.5:0/1184327646 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f65600840e0 con 0x7f65700b3690 2023-07-14T13:29:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.435+0000 7f6567fff640 1 -- 172.21.15.5:0/1184327646 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f65500663f0 msgr2=0x7f65500688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1905284593 2023-07-14T13:29:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.435+0000 7f6567fff640 1 --2- 172.21.15.5:0/1184327646 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f65500663f0 0x7f65500688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:29:59.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.439+0000 7f65677fe640 1 -- 172.21.15.5:0/1184327646 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6560051590 con 0x7f65700b3690 2023-07-14T13:29:59.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.599+0000 7f6575303640 1 -- 172.21.15.5:0/1184327646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f657014dfd0 con 0x7f65700b3690 2023-07-14T13:29:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.603+0000 7f65677fe640 1 -- 172.21.15.5:0/1184327646 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v59)=0 v59) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6560054bb0 con 0x7f65700b3690 2023-07-14T13:29:59.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.603+0000 7f6575303640 1 -- 172.21.15.5:0/1184327646 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f65500663f0 msgr2=0x7f65500688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:29:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.603+0000 7f6575303640 1 --2- 172.21.15.5:0/1184327646 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f65500663f0 0x7f65500688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.603+0000 7f6575303640 1 -- 172.21.15.5:0/1184327646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65700b3690 msgr2=0x7f657014da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.603+0000 7f6575303640 1 --2- 172.21.15.5:0/1184327646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65700b3690 0x7f657014da90 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f656000e930 tx=0x7f656000edf0 comp rx=0 tx=0).stop 2023-07-14T13:29:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.603+0000 7f6575303640 1 -- 172.21.15.5:0/1184327646 shutdown_connections 2023-07-14T13:29:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.603+0000 7f6575303640 1 --2- 172.21.15.5:0/1184327646 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7f65500663f0 0x7f65500688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.603+0000 7f6575303640 1 --2- 172.21.15.5:0/1184327646 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f657015f320 0x7f65700b6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.603+0000 7f6575303640 1 --2- 172.21.15.5:0/1184327646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65700d0230 0x7f6570156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.603+0000 7f6575303640 1 --2- 172.21.15.5:0/1184327646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65700b3690 0x7f657014da90 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.603+0000 7f6575303640 1 -- 172.21.15.5:0/1184327646 >> 172.21.15.5:0/1184327646 conn(0x7f65700659d0 msgr2=0x7f65700b3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.603+0000 7f6575303640 1 -- 172.21.15.5:0/1184327646 shutdown_connections 2023-07-14T13:29:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.603+0000 7f6575303640 1 -- 172.21.15.5:0/1184327646 wait complete. 2023-07-14T13:29:59.627 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-14T13:29:59.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.775+0000 7fdcb0093640 1 Processor -- start 2023-07-14T13:29:59.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.775+0000 7fdcb0093640 1 -- start start 2023-07-14T13:29:59.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.775+0000 7fdcb0093640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdca815bde0 0x7fdca80d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:59.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.775+0000 7fdcb0093640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdca80d2fc0 0x7fdca80b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:59.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.775+0000 7fdcb0093640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca80b04c0 con 0x7fdca80d2300 2023-07-14T13:29:59.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.775+0000 7fdcb0093640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca815c1b0 con 0x7fdca815bde0 2023-07-14T13:29:59.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.775+0000 7fdcb0093640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca80d0aa0 con 0x7fdca80d2fc0 2023-07-14T13:29:59.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.775+0000 7fdcae630640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdca80d2300 0x7fdca80cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41432/0 (socket says 172.21.15.5:41432) 2023-07-14T13:29:59.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.775+0000 7fdcae630640 1 -- 172.21.15.5:0/1964135289 learned_addr learned my addr 172.21.15.5:0/1964135289 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:29:59.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.775+0000 7fdcade2f640 1 --2- 172.21.15.5:0/1964135289 >> v2:172.21.15.154:3300/0 conn(0x7fdca815bde0 0x7fdca80d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:59.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.775+0000 7fdcad62e640 1 --2- 172.21.15.5:0/1964135289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdca80d2fc0 0x7fdca80b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:59.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.775+0000 7fdcace2d640 1 -- 172.21.15.5:0/1964135289 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1567858844 0 0) 0x7fdca80b04c0 con 0x7fdca80d2300 2023-07-14T13:29:59.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.775+0000 7fdcace2d640 1 -- 172.21.15.5:0/1964135289 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc94003530 con 0x7fdca80d2300 2023-07-14T13:29:59.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.779+0000 7fdcad62e640 1 -- 172.21.15.5:0/1964135289 >> v2:172.21.15.154:3300/0 conn(0x7fdca815bde0 msgr2=0x7fdca80d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:59.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.779+0000 7fdcad62e640 1 --2- 172.21.15.5:0/1964135289 >> v2:172.21.15.154:3300/0 conn(0x7fdca815bde0 0x7fdca80d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:59.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.779+0000 7fdcad62e640 1 -- 172.21.15.5:0/1964135289 >> v1:172.21.15.5:6789/0 conn(0x7fdca80d2300 legacy=0x7fdca80cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:59.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.779+0000 7fdcad62e640 1 -- 172.21.15.5:0/1964135289 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca80afb90 con 0x7fdca80d2fc0 2023-07-14T13:29:59.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.779+0000 7fdcade2f640 1 --2- 172.21.15.5:0/1964135289 >> v2:172.21.15.154:3300/0 conn(0x7fdca815bde0 0x7fdca80d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:29:59.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.779+0000 7fdcad62e640 1 --2- 172.21.15.5:0/1964135289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdca80d2fc0 0x7fdca80b0950 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdc980097c0 tx=0x7fdc9801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d124471784e0fa4f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:59.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.779+0000 7fdcace2d640 1 -- 172.21.15.5:0/1964135289 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc980ab680 con 0x7fdca80d2fc0 2023-07-14T13:29:59.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.779+0000 7fdcace2d640 1 -- 172.21.15.5:0/1964135289 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc980ab7e0 con 0x7fdca80d2fc0 2023-07-14T13:29:59.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.779+0000 7fdcace2d640 1 -- 172.21.15.5:0/1964135289 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc980abb70 con 0x7fdca80d2fc0 2023-07-14T13:29:59.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.779+0000 7fdcb0093640 1 -- 172.21.15.5:0/1964135289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdca80d2fc0 msgr2=0x7fdca80b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:59.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.779+0000 7fdcb0093640 1 --2- 172.21.15.5:0/1964135289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdca80d2fc0 0x7fdca80b0950 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdc980097c0 tx=0x7fdc9801c480 comp rx=0 tx=0).stop 2023-07-14T13:29:59.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.779+0000 7fdcb0093640 1 -- 172.21.15.5:0/1964135289 shutdown_connections 2023-07-14T13:29:59.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.779+0000 7fdcb0093640 1 --2- 172.21.15.5:0/1964135289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdca80d2fc0 0x7fdca80b0950 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:59.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.779+0000 7fdcb0093640 1 --2- 172.21.15.5:0/1964135289 >> v2:172.21.15.154:3300/0 conn(0x7fdca815bde0 0x7fdca80d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:59.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.779+0000 7fdcb0093640 1 -- 172.21.15.5:0/1964135289 >> 172.21.15.5:0/1964135289 conn(0x7fdca80659d0 msgr2=0x7fdca809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:59.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.783+0000 7fdcb0093640 1 -- 172.21.15.5:0/1964135289 shutdown_connections 2023-07-14T13:29:59.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.783+0000 7fdcb0093640 1 -- 172.21.15.5:0/1964135289 wait complete. 2023-07-14T13:29:59.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.783+0000 7fdcb0093640 1 Processor -- start 2023-07-14T13:29:59.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.783+0000 7fdcb0093640 1 -- start start 2023-07-14T13:29:59.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.783+0000 7fdcb0093640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca80d2300 0x7fdca814f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:59.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.783+0000 7fdcb0093640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdca80d2fc0 0x7fdca8153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:59.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.783+0000 7fdcb0093640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdca815bde0 0x7fdca815c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:59.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.783+0000 7fdcb0093640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca8153440 con 0x7fdca80d2fc0 2023-07-14T13:29:59.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.783+0000 7fdcb0093640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca8152e10 con 0x7fdca80d2300 2023-07-14T13:29:59.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.783+0000 7fdcb0093640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca815eac0 con 0x7fdca815bde0 2023-07-14T13:29:59.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.783+0000 7fdcad62e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdca80d2fc0 0x7fdca8153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:59.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.783+0000 7fdcad62e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdca80d2fc0 0x7fdca8153860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60896/0 (socket says 172.21.15.5:60896) 2023-07-14T13:29:59.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.783+0000 7fdcad62e640 1 -- 172.21.15.5:0/2793887377 learned_addr learned my addr 172.21.15.5:0/2793887377 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:29:59.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.783+0000 7fdcade2f640 1 --2- 172.21.15.5:0/2793887377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca80d2300 0x7fdca814f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:59.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.783+0000 7fdcae630640 1 --2- 172.21.15.5:0/2793887377 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdca815bde0 0x7fdca815c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:59.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.783+0000 7fdcad62e640 1 -- 172.21.15.5:0/2793887377 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdca815bde0 msgr2=0x7fdca815c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:59.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.783+0000 7fdcad62e640 1 --2- 172.21.15.5:0/2793887377 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdca815bde0 0x7fdca815c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:59.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.783+0000 7fdcad62e640 1 -- 172.21.15.5:0/2793887377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca80d2300 msgr2=0x7fdca814f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.783+0000 7fdcad62e640 1 --2- 172.21.15.5:0/2793887377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca80d2300 0x7fdca814f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.783+0000 7fdcad62e640 1 -- 172.21.15.5:0/2793887377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca40093b0 con 0x7fdca80d2fc0 2023-07-14T13:29:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.783+0000 7fdcad62e640 1 --2- 172.21.15.5:0/2793887377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdca80d2fc0 0x7fdca8153860 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fdc980ad040 tx=0x7fdc9801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.787+0000 7fdc9e7fc640 1 -- 172.21.15.5:0/2793887377 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc980bf610 con 0x7fdca80d2fc0 2023-07-14T13:29:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.787+0000 7fdc9e7fc640 1 -- 172.21.15.5:0/2793887377 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc980bf790 con 0x7fdca80d2fc0 2023-07-14T13:29:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.787+0000 7fdc9e7fc640 1 -- 172.21.15.5:0/2793887377 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc980bfb40 con 0x7fdca80d2fc0 2023-07-14T13:29:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.787+0000 7fdcb0093640 1 -- 172.21.15.5:0/2793887377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc98009420 con 0x7fdca80d2fc0 2023-07-14T13:29:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.787+0000 7fdcb0093640 1 -- 172.21.15.5:0/2793887377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca815d640 con 0x7fdca80d2fc0 2023-07-14T13:29:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.787+0000 7fdcb0093640 1 -- 172.21.15.5:0/2793887377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca8153580 con 0x7fdca80d2fc0 2023-07-14T13:29:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.787+0000 7fdc9e7fc640 1 -- 172.21.15.5:0/2793887377 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 86) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fdc980bfca0 con 0x7fdca80d2fc0 2023-07-14T13:29:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.787+0000 7fdc9e7fc640 1 --2- 172.21.15.5:0/2793887377 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fdc8c0663f0 0x7fdc8c0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.787+0000 7fdc9e7fc640 1 -- 172.21.15.5:0/2793887377 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fdc9811ead0 con 0x7fdca80d2fc0 2023-07-14T13:29:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.787+0000 7fdcade2f640 1 -- 172.21.15.5:0/2793887377 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fdc8c0663f0 msgr2=0x7fdc8c0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1905284593 2023-07-14T13:29:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.787+0000 7fdcade2f640 1 --2- 172.21.15.5:0/2793887377 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fdc8c0663f0 0x7fdc8c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:29:59.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.791+0000 7fdc9e7fc640 1 -- 172.21.15.5:0/2793887377 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fdc980ebdb0 con 0x7fdca80d2fc0 2023-07-14T13:29:59.836 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:59.836+0000 7f9818d8a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:29:59.874 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:29:59.871+0000 7fb91d833180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:29:59.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.951+0000 7fdcb0093640 1 -- 172.21.15.5:0/2793887377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fdca80678d0 con 0x7fdca80d2fc0 2023-07-14T13:29:59.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.955+0000 7fdc9e7fc640 1 -- 172.21.15.5:0/2793887377 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v60)=0 v60) v1 ==== 133+0+0 (secure 0 0 0) 0x7fdc980ef3d0 con 0x7fdca80d2fc0 2023-07-14T13:29:59.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.959+0000 7fdcb0093640 1 -- 172.21.15.5:0/2793887377 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fdc8c0663f0 msgr2=0x7fdc8c0688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:29:59.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.959+0000 7fdcb0093640 1 --2- 172.21.15.5:0/2793887377 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fdc8c0663f0 0x7fdc8c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:59.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.959+0000 7fdcb0093640 1 -- 172.21.15.5:0/2793887377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdca80d2fc0 msgr2=0x7fdca8153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:59.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.959+0000 7fdcb0093640 1 --2- 172.21.15.5:0/2793887377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdca80d2fc0 0x7fdca8153860 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fdc980ad040 tx=0x7fdc9801acc0 comp rx=0 tx=0).stop 2023-07-14T13:29:59.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.959+0000 7fdcb0093640 1 -- 172.21.15.5:0/2793887377 shutdown_connections 2023-07-14T13:29:59.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.959+0000 7fdcb0093640 1 --2- 172.21.15.5:0/2793887377 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7fdc8c0663f0 0x7fdc8c0688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:59.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.959+0000 7fdcb0093640 1 --2- 172.21.15.5:0/2793887377 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdca815bde0 0x7fdca815c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:59.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.959+0000 7fdcb0093640 1 --2- 172.21.15.5:0/2793887377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdca80d2fc0 0x7fdca8153860 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:59.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.959+0000 7fdcb0093640 1 --2- 172.21.15.5:0/2793887377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca80d2300 0x7fdca814f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:59.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.959+0000 7fdcb0093640 1 -- 172.21.15.5:0/2793887377 >> 172.21.15.5:0/2793887377 conn(0x7fdca80659d0 msgr2=0x7fdca806afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:59.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.959+0000 7fdcb0093640 1 -- 172.21.15.5:0/2793887377 shutdown_connections 2023-07-14T13:29:59.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:29:59.959+0000 7fdcb0093640 1 -- 172.21.15.5:0/2793887377 wait complete. 2023-07-14T13:29:59.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:29:59.982 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-14T13:29:59.987 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:29:59.984+0000 7f9818d8a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:30:00.000 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-07-14T13:30:00.037 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:30:00.035+0000 7fb91d833180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:30:00.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.187+0000 7ff69b834640 1 Processor -- start 2023-07-14T13:30:00.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.187+0000 7ff69b834640 1 -- start start 2023-07-14T13:30:00.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.191+0000 7ff69b834640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69415bde0 0x7ff6940d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:00.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.191+0000 7ff69b834640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff6940d2300 0x7ff6940d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:00.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.191+0000 7ff69b834640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6940b04c0 con 0x7ff6940d2fc0 2023-07-14T13:30:00.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.191+0000 7ff69b834640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6940d2ce0 con 0x7ff6940d2300 2023-07-14T13:30:00.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.191+0000 7ff69b834640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69415c1b0 con 0x7ff69415bde0 2023-07-14T13:30:00.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.191+0000 7ff698dcf640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff6940d2fc0 0x7ff6940b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41442/0 (socket says 172.21.15.5:41442) 2023-07-14T13:30:00.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.191+0000 7ff698dcf640 1 -- 172.21.15.5:0/319025314 learned_addr learned my addr 172.21.15.5:0/319025314 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:30:00.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.191+0000 7ff6995d0640 1 --2- 172.21.15.5:0/319025314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69415bde0 0x7ff6940d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:00.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.191+0000 7ff699dd1640 1 --2- 172.21.15.5:0/319025314 >> v2:172.21.15.154:3300/0 conn(0x7ff6940d2300 0x7ff6940d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:00.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.191+0000 7ff68bfff640 1 -- 172.21.15.5:0/319025314 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 15435363 0 0) 0x7ff6940b04c0 con 0x7ff6940d2fc0 2023-07-14T13:30:00.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.191+0000 7ff68bfff640 1 -- 172.21.15.5:0/319025314 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff680003530 con 0x7ff6940d2fc0 2023-07-14T13:30:00.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.191+0000 7ff699dd1640 1 -- 172.21.15.5:0/319025314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69415bde0 msgr2=0x7ff6940d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:00.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.191+0000 7ff699dd1640 1 --2- 172.21.15.5:0/319025314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69415bde0 0x7ff6940d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:00.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.191+0000 7ff699dd1640 1 -- 172.21.15.5:0/319025314 >> v1:172.21.15.5:6789/0 conn(0x7ff6940d2fc0 legacy=0x7ff6940b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:00.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.191+0000 7ff699dd1640 1 -- 172.21.15.5:0/319025314 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6940b1060 con 0x7ff6940d2300 2023-07-14T13:30:00.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.191+0000 7ff6995d0640 1 --2- 172.21.15.5:0/319025314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69415bde0 0x7ff6940d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:30:00.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.195+0000 7ff699dd1640 1 --2- 172.21.15.5:0/319025314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6940d2300 0x7ff6940d27a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009d90 tx=0x7ff68c01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55784bb5c38562e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:00.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.195+0000 7ff68bfff640 1 -- 172.21.15.5:0/319025314 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c0a5920 con 0x7ff6940d2300 2023-07-14T13:30:00.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.195+0000 7ff68bfff640 1 -- 172.21.15.5:0/319025314 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68c0a5a80 con 0x7ff6940d2300 2023-07-14T13:30:00.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.195+0000 7ff68bfff640 1 -- 172.21.15.5:0/319025314 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c0a5e10 con 0x7ff6940d2300 2023-07-14T13:30:00.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.195+0000 7ff69b834640 1 -- 172.21.15.5:0/319025314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6940d2300 msgr2=0x7ff6940d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:00.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.195+0000 7ff69b834640 1 --2- 172.21.15.5:0/319025314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6940d2300 0x7ff6940d27a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009d90 tx=0x7ff68c01c950 comp rx=0 tx=0).stop 2023-07-14T13:30:00.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.195+0000 7ff69b834640 1 -- 172.21.15.5:0/319025314 shutdown_connections 2023-07-14T13:30:00.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.195+0000 7ff69b834640 1 --2- 172.21.15.5:0/319025314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6940d2300 0x7ff6940d27a0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:00.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.195+0000 7ff69b834640 1 --2- 172.21.15.5:0/319025314 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69415bde0 0x7ff6940d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:00.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.195+0000 7ff69b834640 1 -- 172.21.15.5:0/319025314 >> 172.21.15.5:0/319025314 conn(0x7ff6940659d0 msgr2=0x7ff69409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:00.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.195+0000 7ff69b834640 1 -- 172.21.15.5:0/319025314 shutdown_connections 2023-07-14T13:30:00.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.195+0000 7ff69b834640 1 -- 172.21.15.5:0/319025314 wait complete. 2023-07-14T13:30:00.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.195+0000 7ff69b834640 1 Processor -- start 2023-07-14T13:30:00.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.195+0000 7ff69b834640 1 -- start start 2023-07-14T13:30:00.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.199+0000 7ff69b834640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6940d2300 0x7ff69415e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:00.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.199+0000 7ff69b834640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6940d2fc0 0x7ff6940b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:00.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.199+0000 7ff69b834640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69415bde0 0x7ff6941551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:00.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.199+0000 7ff69b834640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69414b950 con 0x7ff6940d2fc0 2023-07-14T13:30:00.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.199+0000 7ff69b834640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69415c3c0 con 0x7ff6940d2300 2023-07-14T13:30:00.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.199+0000 7ff69b834640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69415c660 con 0x7ff69415bde0 2023-07-14T13:30:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.199+0000 7ff698dcf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6940d2fc0 0x7ff6940b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.199+0000 7ff698dcf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6940d2fc0 0x7ff6940b3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60904/0 (socket says 172.21.15.5:60904) 2023-07-14T13:30:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.199+0000 7ff698dcf640 1 -- 172.21.15.5:0/848932575 learned_addr learned my addr 172.21.15.5:0/848932575 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:30:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.199+0000 7ff6995d0640 1 --2- 172.21.15.5:0/848932575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6940d2300 0x7ff69415e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:00.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.199+0000 7ff699dd1640 1 --2- 172.21.15.5:0/848932575 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69415bde0 0x7ff6941551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:00.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.199+0000 7ff698dcf640 1 -- 172.21.15.5:0/848932575 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69415bde0 msgr2=0x7ff6941551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:00.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.199+0000 7ff698dcf640 1 --2- 172.21.15.5:0/848932575 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69415bde0 0x7ff6941551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:00.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.199+0000 7ff698dcf640 1 -- 172.21.15.5:0/848932575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6940d2300 msgr2=0x7ff69415e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:00.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.199+0000 7ff698dcf640 1 --2- 172.21.15.5:0/848932575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6940d2300 0x7ff69415e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:00.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.199+0000 7ff698dcf640 1 -- 172.21.15.5:0/848932575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6900093b0 con 0x7ff6940d2fc0 2023-07-14T13:30:00.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.199+0000 7ff699dd1640 1 --2- 172.21.15.5:0/848932575 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff69415bde0 0x7ff6941551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:30:00.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.199+0000 7ff698dcf640 1 --2- 172.21.15.5:0/848932575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6940d2fc0 0x7ff6940b3d20 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7ff68400c450 tx=0x7ff68400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:00.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.199+0000 7ff689ffb640 1 -- 172.21.15.5:0/848932575 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff684005cf0 con 0x7ff6940d2fc0 2023-07-14T13:30:00.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.199+0000 7ff689ffb640 1 -- 172.21.15.5:0/848932575 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff684005e50 con 0x7ff6940d2fc0 2023-07-14T13:30:00.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.199+0000 7ff689ffb640 1 -- 172.21.15.5:0/848932575 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff684007290 con 0x7ff6940d2fc0 2023-07-14T13:30:00.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.199+0000 7ff69b834640 1 -- 172.21.15.5:0/848932575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff68c009a70 con 0x7ff6940d2fc0 2023-07-14T13:30:00.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.199+0000 7ff69b834640 1 -- 172.21.15.5:0/848932575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6940b1210 con 0x7ff6940d2fc0 2023-07-14T13:30:00.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.199+0000 7ff69b834640 1 -- 172.21.15.5:0/848932575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6940b1400 con 0x7ff6940d2fc0 2023-07-14T13:30:00.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.203+0000 7ff689ffb640 1 -- 172.21.15.5:0/848932575 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 86) v1 ==== 85777+0+0 (secure 0 0 0) 0x7ff6840073f0 con 0x7ff6940d2fc0 2023-07-14T13:30:00.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.203+0000 7ff689ffb640 1 --2- 172.21.15.5:0/848932575 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff6780663f0 0x7ff6780688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:00.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.203+0000 7ff689ffb640 1 -- 172.21.15.5:0/848932575 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6090+0+0 (secure 0 0 0) 0x7ff6840833e0 con 0x7ff6940d2fc0 2023-07-14T13:30:00.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.203+0000 7ff6995d0640 1 -- 172.21.15.5:0/848932575 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff6780663f0 msgr2=0x7ff6780688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1905284593 2023-07-14T13:30:00.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.203+0000 7ff6995d0640 1 --2- 172.21.15.5:0/848932575 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff6780663f0 0x7ff6780688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:30:00.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.207+0000 7ff689ffb640 1 -- 172.21.15.5:0/848932575 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff684050870 con 0x7ff6940d2fc0 2023-07-14T13:30:00.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.383+0000 7ff69b834640 1 -- 172.21.15.5:0/848932575 --> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff69415df90 con 0x7ff6780663f0 2023-07-14T13:30:00.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.407+0000 7ff6995d0640 1 -- 172.21.15.5:0/848932575 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff6780663f0 msgr2=0x7ff6780688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1905284593 2023-07-14T13:30:00.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.407+0000 7ff6995d0640 1 --2- 172.21.15.5:0/848932575 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff6780663f0 0x7ff6780688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-14T13:30:00.470 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:00.468+0000 7f9818d8a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:30:00.528 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:00.524+0000 7f9818d8a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:30:00.554 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:30:00.551+0000 7fb91d833180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:30:00.583 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:00.580+0000 7f9818d8a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:30:00.615 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:30:00.615+0000 7fb91d833180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:30:00.668 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:00.664+0000 7f9818d8a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:30:00.674 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:30:00.671+0000 7fb91d833180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:30:00.725 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:00.724+0000 7f9818d8a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:30:00.765 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:30:00.763+0000 7fb91d833180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:30:00.809 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:00.808+0000 7f9818d8a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:30:00.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.811+0000 7ff6995d0640 1 -- 172.21.15.5:0/848932575 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff6780663f0 msgr2=0x7ff6780688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1905284593 2023-07-14T13:30:00.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:00.811+0000 7ff6995d0640 1 --2- 172.21.15.5:0/848932575 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff6780663f0 0x7ff6780688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-14T13:30:00.824 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:30:00.823+0000 7fb91d833180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:30:00.865 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:00.864+0000 7f9818d8a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:30:00.913 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:30:00.911+0000 7fb91d833180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:30:00.972 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:30:00.971+0000 7fb91d833180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:30:01.006 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:01.004+0000 7f9818d8a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:30:01.064 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:01.064+0000 7f9818d8a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:30:01.122 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:30:01.119+0000 7fb91d833180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:30:01.185 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:30:01.183+0000 7fb91d833180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:30:01.308 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:30:01.308 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:30:01.308 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:30:01.316 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:01.316+0000 7f9818d8a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:30:01.437 INFO:tasks.ceph.mgr.y.smithi005.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:30:01.438 INFO:tasks.ceph.mgr.y.smithi005.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:30:01.438 INFO:tasks.ceph.mgr.y.smithi005.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:30:01.446 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:30:01.443+0000 7fb91d833180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:30:01.450 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:01.448+0000 7f9818d8a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:30:01.574 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:01.572+0000 7f9818d8a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:30:01.587 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:30:01.583+0000 7fb91d833180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:30:01.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:01.615+0000 7ff6995d0640 1 -- 172.21.15.5:0/848932575 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff6780663f0 msgr2=0x7ff6780688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/1905284593 2023-07-14T13:30:01.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:01.615+0000 7ff6995d0640 1 --2- 172.21.15.5:0/848932575 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff6780663f0 0x7ff6780688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-14T13:30:01.644 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:01.644+0000 7f9818d8a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:30:01.718 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:30:01.715+0000 7fb91d833180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:30:01.777 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:01.776+0000 7f9818d8a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:30:01.792 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:30:01.791+0000 7fb91d833180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:30:01.933 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:30:01.931+0000 7fb91d833180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:30:02.315 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:02.312+0000 7f9818d8a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:30:02.399 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:02.396+0000 7f9818d8a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:30:02.503 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:30:02.503+0000 7fb91d833180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:30:02.546 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:02.544+0000 7f9818d8a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:30:02.592 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:30:02.591+0000 7fb91d833180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:30:02.629 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:02.628+0000 7f9818d8a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:30:02.747 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:30:02.743+0000 7fb91d833180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:30:02.834 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:30:02.831+0000 7fb91d833180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:30:02.898 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:02.896+0000 7f9818d8a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:30:02.958 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:02.956+0000 7f9818d8a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:30:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:02.967+0000 7ff689ffb640 1 -- 172.21.15.5:0/848932575 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 87) v1 ==== 85386+0+0 (secure 0 0 0) 0x7ff684050c40 con 0x7ff6940d2fc0 2023-07-14T13:30:02.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:02.967+0000 7ff689ffb640 1 -- 172.21.15.5:0/848932575 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff6780663f0 msgr2=0x7ff6780688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:30:02.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:02.967+0000 7ff689ffb640 1 --2- 172.21.15.5:0/848932575 >> [v2:172.21.15.154:6832/1905284593,v1:172.21.15.154:6833/1905284593] conn(0x7ff6780663f0 0x7ff6780688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:03.105 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:03.104+0000 7f9797def640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:30:03.105 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:03.104+0000 7f9797def640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:30:03.106 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:03.104+0000 7f9797def640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:30:03.106 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:03.104+0000 7f9797def640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:30:03.106 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:03.104+0000 7f9797def640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:30:03.106 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:03.104+0000 7f979a5f4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:30:03.107 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:03.104+0000 7f979a5f4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:30:03.107 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:03.104+0000 7f979a5f4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:30:03.107 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:03.104+0000 7f979a5f4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:30:03.107 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:30:03.104+0000 7f979a5f4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:30:03.134 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:30:03.131+0000 7fb91d833180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:30:03.198 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:30:03.195+0000 7fb91d833180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:30:03.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:03.975+0000 7ff689ffb640 1 -- 172.21.15.5:0/848932575 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mgrmap(e 88) v1 ==== 85513+0+0 (secure 0 0 0) 0x7ff684081750 con 0x7ff6940d2fc0 2023-07-14T13:30:03.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:03.975+0000 7ff689ffb640 1 --2- 172.21.15.5:0/848932575 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7ff678033c80 0x7ff678070920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:03.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:03.975+0000 7ff689ffb640 1 -- 172.21.15.5:0/848932575 --> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff69415df90 con 0x7ff678033c80 2023-07-14T13:30:03.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:03.979+0000 7ff6995d0640 1 --2- 172.21.15.5:0/848932575 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7ff678033c80 0x7ff678070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:03.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:03.987+0000 7ff6995d0640 1 --2- 172.21.15.5:0/848932575 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7ff678033c80 0x7ff678070920 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff6900097c0 tx=0x7ff690006f90 comp rx=0 tx=0).ready entity=mgr.8399 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:04.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.051+0000 7ff689ffb640 1 -- 172.21.15.5:0/848932575 <== mgr.8399 v2:172.21.15.154:6832/3169896898 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff69415df90 con 0x7ff678033c80 2023-07-14T13:30:04.053 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule set for path snap_test_dir1 2023-07-14T13:30:04.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.051+0000 7ff69b834640 1 -- 172.21.15.5:0/848932575 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7ff678033c80 msgr2=0x7ff678070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:04.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.051+0000 7ff69b834640 1 --2- 172.21.15.5:0/848932575 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7ff678033c80 0x7ff678070920 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff6900097c0 tx=0x7ff690006f90 comp rx=0 tx=0).stop 2023-07-14T13:30:04.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.051+0000 7ff69b834640 1 -- 172.21.15.5:0/848932575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6940d2fc0 msgr2=0x7ff6940b3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:04.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.051+0000 7ff69b834640 1 --2- 172.21.15.5:0/848932575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6940d2fc0 0x7ff6940b3d20 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7ff68400c450 tx=0x7ff68400c910 comp rx=0 tx=0).stop 2023-07-14T13:30:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.051+0000 7ff699dd1640 1 -- 172.21.15.5:0/848932575 reap_dead start 2023-07-14T13:30:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.051+0000 7ff69b834640 1 -- 172.21.15.5:0/848932575 shutdown_connections 2023-07-14T13:30:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.051+0000 7ff69b834640 1 -- 172.21.15.5:0/848932575 >> 172.21.15.5:0/848932575 conn(0x7ff6940659d0 msgr2=0x7ff69415ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.051+0000 7ff69b834640 1 -- 172.21.15.5:0/848932575 shutdown_connections 2023-07-14T13:30:04.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.055+0000 7ff69b834640 1 -- 172.21.15.5:0/848932575 wait complete. 2023-07-14T13:30:04.078 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-14T13:30:04.078 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-07-14T13:30:04.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.227+0000 7f7f6f940640 1 Processor -- start 2023-07-14T13:30:04.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.231+0000 7f7f6f940640 1 -- start start 2023-07-14T13:30:04.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.231+0000 7f7f6f940640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7f680aeb40 0x7f7f6815cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:04.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.231+0000 7f7f6f940640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7f68159440 0x7f7f680c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:04.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.231+0000 7f7f6f940640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f681532b0 con 0x7f7f680aef10 2023-07-14T13:30:04.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.231+0000 7f7f6f940640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f680ca6f0 con 0x7f7f68159440 2023-07-14T13:30:04.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.231+0000 7f7f6f940640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f681599d0 con 0x7f7f680aeb40 2023-07-14T13:30:04.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.231+0000 7f7f6dedd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7f68159440 0x7f7f680c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:04.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.231+0000 7f7f6dedd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7f68159440 0x7f7f680c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60920/0 (socket says 172.21.15.5:60920) 2023-07-14T13:30:04.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.231+0000 7f7f6dedd640 1 -- 172.21.15.5:0/3340444809 learned_addr learned my addr 172.21.15.5:0/3340444809 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:30:04.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.231+0000 7f7f6d6dc640 1 --2- 172.21.15.5:0/3340444809 >> v2:172.21.15.154:3300/0 conn(0x7f7f680aeb40 0x7f7f6815cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:04.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.231+0000 7f7f6dedd640 1 -- 172.21.15.5:0/3340444809 >> v2:172.21.15.154:3300/0 conn(0x7f7f680aeb40 msgr2=0x7f7f6815cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:04.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.231+0000 7f7f6dedd640 1 --2- 172.21.15.5:0/3340444809 >> v2:172.21.15.154:3300/0 conn(0x7f7f680aeb40 0x7f7f6815cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:04.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.231+0000 7f7f6dedd640 1 -- 172.21.15.5:0/3340444809 >> v1:172.21.15.5:6789/0 conn(0x7f7f680aef10 legacy=0x7f7f68158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:04.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.231+0000 7f7f6dedd640 1 -- 172.21.15.5:0/3340444809 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f68159cb0 con 0x7f7f68159440 2023-07-14T13:30:04.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.235+0000 7f7f6dedd640 1 --2- 172.21.15.5:0/3340444809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f68159440 0x7f7f680c88c0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f7f68071ad0 tx=0x7f7f6001eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76c7245a3d5f5a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:04.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.235+0000 7f7f5ffff640 1 -- 172.21.15.5:0/3340444809 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6000b2d0 con 0x7f7f68159440 2023-07-14T13:30:04.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.235+0000 7f7f5ffff640 1 -- 172.21.15.5:0/3340444809 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6000b430 con 0x7f7f68159440 2023-07-14T13:30:04.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.235+0000 7f7f5ffff640 1 -- 172.21.15.5:0/3340444809 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f600a7c00 con 0x7f7f68159440 2023-07-14T13:30:04.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.235+0000 7f7f6f940640 1 -- 172.21.15.5:0/3340444809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f68159440 msgr2=0x7f7f680c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:04.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.235+0000 7f7f6f940640 1 --2- 172.21.15.5:0/3340444809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f68159440 0x7f7f680c88c0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f7f68071ad0 tx=0x7f7f6001eb10 comp rx=0 tx=0).stop 2023-07-14T13:30:04.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.235+0000 7f7f6f940640 1 -- 172.21.15.5:0/3340444809 shutdown_connections 2023-07-14T13:30:04.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.235+0000 7f7f6f940640 1 --2- 172.21.15.5:0/3340444809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f68159440 0x7f7f680c88c0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:04.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.235+0000 7f7f6f940640 1 --2- 172.21.15.5:0/3340444809 >> v2:172.21.15.154:3300/0 conn(0x7f7f680aeb40 0x7f7f6815cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:04.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.235+0000 7f7f6f940640 1 -- 172.21.15.5:0/3340444809 >> 172.21.15.5:0/3340444809 conn(0x7f7f680cde90 msgr2=0x7f7f680ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:04.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.235+0000 7f7f6f940640 1 -- 172.21.15.5:0/3340444809 shutdown_connections 2023-07-14T13:30:04.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.235+0000 7f7f6f940640 1 -- 172.21.15.5:0/3340444809 wait complete. 2023-07-14T13:30:04.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.235+0000 7f7f6f940640 1 Processor -- start 2023-07-14T13:30:04.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.239+0000 7f7f6f940640 1 -- start start 2023-07-14T13:30:04.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.239+0000 7f7f6f940640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f680aeb40 0x7f7f68070940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:04.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.239+0000 7f7f6f940640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f680aef10 0x7f7f680b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:04.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.239+0000 7f7f6f940640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f68159440 0x7f7f68161e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:04.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.239+0000 7f7f6f940640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f68071240 con 0x7f7f680aeb40 2023-07-14T13:30:04.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.239+0000 7f7f6f940640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f681f7ef0 con 0x7f7f680aef10 2023-07-14T13:30:04.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.239+0000 7f7f6f940640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f681f75c0 con 0x7f7f68159440 2023-07-14T13:30:04.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.239+0000 7f7f6d6dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f680aeb40 0x7f7f68070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:04.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.239+0000 7f7f6d6dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f680aeb40 0x7f7f68070940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60930/0 (socket says 172.21.15.5:60930) 2023-07-14T13:30:04.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.239+0000 7f7f6d6dc640 1 -- 172.21.15.5:0/192169887 learned_addr learned my addr 172.21.15.5:0/192169887 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:30:04.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.239+0000 7f7f6cedb640 1 --2- 172.21.15.5:0/192169887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f680aef10 0x7f7f680b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:04.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.239+0000 7f7f6dedd640 1 --2- 172.21.15.5:0/192169887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f68159440 0x7f7f68161e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:04.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.239+0000 7f7f6d6dc640 1 -- 172.21.15.5:0/192169887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f68159440 msgr2=0x7f7f68161e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:04.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.239+0000 7f7f6d6dc640 1 --2- 172.21.15.5:0/192169887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f68159440 0x7f7f68161e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:04.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.239+0000 7f7f6d6dc640 1 -- 172.21.15.5:0/192169887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f680aef10 msgr2=0x7f7f680b3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:04.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.239+0000 7f7f6d6dc640 1 --2- 172.21.15.5:0/192169887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f680aef10 0x7f7f680b3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:04.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.239+0000 7f7f6d6dc640 1 -- 172.21.15.5:0/192169887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6000bd40 con 0x7f7f680aeb40 2023-07-14T13:30:04.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.239+0000 7f7f6d6dc640 1 --2- 172.21.15.5:0/192169887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f680aeb40 0x7f7f68070940 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f7f6400d800 tx=0x7f7f6400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:04.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.239+0000 7f7f5dffb640 1 -- 172.21.15.5:0/192169887 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6400b6c0 con 0x7f7f680aeb40 2023-07-14T13:30:04.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.239+0000 7f7f5dffb640 1 -- 172.21.15.5:0/192169887 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6400b820 con 0x7f7f680aeb40 2023-07-14T13:30:04.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.239+0000 7f7f5dffb640 1 -- 172.21.15.5:0/192169887 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6400bb90 con 0x7f7f680aeb40 2023-07-14T13:30:04.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.239+0000 7f7f6f940640 1 -- 172.21.15.5:0/192169887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f681f78a0 con 0x7f7f680aeb40 2023-07-14T13:30:04.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.239+0000 7f7f6f940640 1 -- 172.21.15.5:0/192169887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f680c6b60 con 0x7f7f680aeb40 2023-07-14T13:30:04.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.239+0000 7f7f6f940640 1 -- 172.21.15.5:0/192169887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f680678d0 con 0x7f7f680aeb40 2023-07-14T13:30:04.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.243+0000 7f7f5dffb640 1 -- 172.21.15.5:0/192169887 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 88) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f7f6400bcf0 con 0x7f7f680aeb40 2023-07-14T13:30:04.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.243+0000 7f7f5dffb640 1 --2- 172.21.15.5:0/192169887 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f7f4c066150 0x7f7f4c068600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:04.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.243+0000 7f7f5dffb640 1 -- 172.21.15.5:0/192169887 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f7f64083ff0 con 0x7f7f680aeb40 2023-07-14T13:30:04.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.243+0000 7f7f6cedb640 1 --2- 172.21.15.5:0/192169887 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f7f4c066150 0x7f7f4c068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:04.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.243+0000 7f7f6cedb640 1 --2- 172.21.15.5:0/192169887 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f7f4c066150 0x7f7f4c068600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7f680cbc90 tx=0x7f7f58009040 comp rx=0 tx=0).ready entity=mgr.8399 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:04.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.247+0000 7f7f5dffb640 1 -- 172.21.15.5:0/192169887 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7f640b4720 con 0x7f7f680aeb40 2023-07-14T13:30:04.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.419+0000 7f7f6f940640 1 -- 172.21.15.5:0/192169887 --> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f6815c9d0 con 0x7f7f4c066150 2023-07-14T13:30:04.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.475+0000 7f7f5dffb640 1 -- 172.21.15.5:0/192169887 <== mgr.8399 v2:172.21.15.154:6832/3169896898 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7f7f580014f0 con 0x7f7f4c066150 2023-07-14T13:30:04.480 INFO:teuthology.orchestra.run.smithi005.stdout:Retention added to path snap_test_dir1 2023-07-14T13:30:04.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.479+0000 7f7f6f940640 1 -- 172.21.15.5:0/192169887 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f7f4c066150 msgr2=0x7f7f4c068600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:04.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.479+0000 7f7f6f940640 1 --2- 172.21.15.5:0/192169887 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f7f4c066150 0x7f7f4c068600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7f680cbc90 tx=0x7f7f58009040 comp rx=0 tx=0).stop 2023-07-14T13:30:04.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.479+0000 7f7f6f940640 1 -- 172.21.15.5:0/192169887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f680aeb40 msgr2=0x7f7f68070940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:04.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.479+0000 7f7f6f940640 1 --2- 172.21.15.5:0/192169887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f680aeb40 0x7f7f68070940 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f7f6400d800 tx=0x7f7f6400dcc0 comp rx=0 tx=0).stop 2023-07-14T13:30:04.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.479+0000 7f7f6f940640 1 -- 172.21.15.5:0/192169887 shutdown_connections 2023-07-14T13:30:04.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.479+0000 7f7f6f940640 1 --2- 172.21.15.5:0/192169887 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f7f4c066150 0x7f7f4c068600 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:04.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.479+0000 7f7f6f940640 1 --2- 172.21.15.5:0/192169887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f68159440 0x7f7f68161e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:04.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.479+0000 7f7f6f940640 1 --2- 172.21.15.5:0/192169887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f680aef10 0x7f7f680b3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:04.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.479+0000 7f7f6f940640 1 --2- 172.21.15.5:0/192169887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f680aeb40 0x7f7f68070940 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:04.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.479+0000 7f7f6f940640 1 -- 172.21.15.5:0/192169887 >> 172.21.15.5:0/192169887 conn(0x7f7f680cde90 msgr2=0x7f7f680c3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:04.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.479+0000 7f7f6f940640 1 -- 172.21.15.5:0/192169887 shutdown_connections 2023-07-14T13:30:04.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.479+0000 7f7f6f940640 1 -- 172.21.15.5:0/192169887 wait complete. 2023-07-14T13:30:04.500 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-07-14T13:30:04.501 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-07-14-13_31_00 in ~56s... 2023-07-14T13:30:04.501 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-07-14T13:30:04.501 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-07-14T13:30:04.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.647+0000 7f26e45f6640 1 Processor -- start 2023-07-14T13:30:04.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.647+0000 7f26e45f6640 1 -- start start 2023-07-14T13:30:04.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.647+0000 7f26e45f6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f26dc06a440 0x7f26dc0b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:04.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.647+0000 7f26e45f6640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26dc06c040 con 0x7f26dc15f690 2023-07-14T13:30:04.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.647+0000 7f26e45f6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26dc160600 con 0x7f26dc1453a0 2023-07-14T13:30:04.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.647+0000 7f26e45f6640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26dc160170 con 0x7f26dc06a440 2023-07-14T13:30:04.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.647+0000 7f26e1b91640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f26dc06a440 0x7f26dc0b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:04.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.647+0000 7f26e2392640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f26dc15f690 0x7f26dc15fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41458/0 (socket says 172.21.15.5:41458) 2023-07-14T13:30:04.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.647+0000 7f26e2392640 1 -- 172.21.15.5:0/3931271447 learned_addr learned my addr 172.21.15.5:0/3931271447 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:30:04.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.647+0000 7f26e1b91640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f26dc06a440 0x7f26dc0b1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60938/0 (socket says 172.21.15.5:60938) 2023-07-14T13:30:04.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.651+0000 7f26e1b91640 1 -- 172.21.15.5:0/3931271447 >> v1:172.21.15.154:6789/0 conn(0x7f26dc1453a0 legacy=0x7f26dc06c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:04.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.651+0000 7f26e1b91640 1 -- 172.21.15.5:0/3931271447 >> v1:172.21.15.5:6789/0 conn(0x7f26dc15f690 legacy=0x7f26dc15fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:04.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.651+0000 7f26e1b91640 1 -- 172.21.15.5:0/3931271447 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc160360 con 0x7f26dc06a440 2023-07-14T13:30:04.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.651+0000 7f26e1b91640 1 --2- 172.21.15.5:0/3931271447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26dc06a440 0x7f26dc0b1890 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f26cc0097c0 tx=0x7f26cc01c250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf8d50854f10fc7a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:04.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.651+0000 7f26e1390640 1 -- 172.21.15.5:0/3931271447 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc0ab600 con 0x7f26dc06a440 2023-07-14T13:30:04.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.651+0000 7f26e1390640 1 -- 172.21.15.5:0/3931271447 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26cc0a7050 con 0x7f26dc06a440 2023-07-14T13:30:04.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.651+0000 7f26e1390640 1 -- 172.21.15.5:0/3931271447 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc0ab980 con 0x7f26dc06a440 2023-07-14T13:30:04.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.651+0000 7f26e45f6640 1 -- 172.21.15.5:0/3931271447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26dc06a440 msgr2=0x7f26dc0b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:04.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.655+0000 7f26e45f6640 1 --2- 172.21.15.5:0/3931271447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26dc06a440 0x7f26dc0b1890 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f26cc0097c0 tx=0x7f26cc01c250 comp rx=0 tx=0).stop 2023-07-14T13:30:04.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.655+0000 7f26e45f6640 1 -- 172.21.15.5:0/3931271447 shutdown_connections 2023-07-14T13:30:04.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.655+0000 7f26e45f6640 1 --2- 172.21.15.5:0/3931271447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26dc06a440 0x7f26dc0b1890 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:04.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.655+0000 7f26e45f6640 1 -- 172.21.15.5:0/3931271447 >> 172.21.15.5:0/3931271447 conn(0x7f26dc0b1210 msgr2=0x7f26dc0ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:04.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.655+0000 7f26e45f6640 1 -- 172.21.15.5:0/3931271447 shutdown_connections 2023-07-14T13:30:04.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.655+0000 7f26e45f6640 1 -- 172.21.15.5:0/3931271447 wait complete. 2023-07-14T13:30:04.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.655+0000 7f26e45f6640 1 Processor -- start 2023-07-14T13:30:04.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.655+0000 7f26e45f6640 1 -- start start 2023-07-14T13:30:04.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.655+0000 7f26e45f6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26dc06a440 0x7f26dc1431a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:04.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.655+0000 7f26e45f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26dc1453a0 0x7f26dc15b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:04.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.655+0000 7f26e45f6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26dc15f690 0x7f26dc15ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:04.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.655+0000 7f26e45f6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc15cff0 con 0x7f26dc1453a0 2023-07-14T13:30:04.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.655+0000 7f26e45f6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc15c650 con 0x7f26dc06a440 2023-07-14T13:30:04.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.655+0000 7f26e45f6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc15c930 con 0x7f26dc15f690 2023-07-14T13:30:04.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.655+0000 7f26e1b91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26dc1453a0 0x7f26dc15b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:04.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.655+0000 7f26e1b91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26dc1453a0 0x7f26dc15b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60940/0 (socket says 172.21.15.5:60940) 2023-07-14T13:30:04.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.655+0000 7f26e1b91640 1 -- 172.21.15.5:0/2795437271 learned_addr learned my addr 172.21.15.5:0/2795437271 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:30:04.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.655+0000 7f26e2392640 1 --2- 172.21.15.5:0/2795437271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26dc06a440 0x7f26dc1431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:04.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.655+0000 7f26e2b93640 1 --2- 172.21.15.5:0/2795437271 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26dc15f690 0x7f26dc15ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:04.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.655+0000 7f26e1b91640 1 -- 172.21.15.5:0/2795437271 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26dc15f690 msgr2=0x7f26dc15ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:04.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.655+0000 7f26e1b91640 1 --2- 172.21.15.5:0/2795437271 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26dc15f690 0x7f26dc15ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:04.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.655+0000 7f26e1b91640 1 -- 172.21.15.5:0/2795437271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26dc06a440 msgr2=0x7f26dc1431a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:04.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.655+0000 7f26e1b91640 1 --2- 172.21.15.5:0/2795437271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26dc06a440 0x7f26dc1431a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:04.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.655+0000 7f26e1b91640 1 -- 172.21.15.5:0/2795437271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc009420 con 0x7f26dc1453a0 2023-07-14T13:30:04.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.655+0000 7f26e2392640 1 --2- 172.21.15.5:0/2795437271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26dc06a440 0x7f26dc1431a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:30:04.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.659+0000 7f26e1b91640 1 --2- 172.21.15.5:0/2795437271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26dc1453a0 0x7f26dc15b4f0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f26cc018e60 tx=0x7f26cc018ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:04.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.659+0000 7f26d2ffd640 1 -- 172.21.15.5:0/2795437271 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc0b4610 con 0x7f26dc1453a0 2023-07-14T13:30:04.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.659+0000 7f26d2ffd640 1 -- 172.21.15.5:0/2795437271 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26cc0abe90 con 0x7f26dc1453a0 2023-07-14T13:30:04.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.659+0000 7f26d2ffd640 1 -- 172.21.15.5:0/2795437271 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc0b49d0 con 0x7f26dc1453a0 2023-07-14T13:30:04.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.659+0000 7f26e45f6640 1 -- 172.21.15.5:0/2795437271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26dc15cc10 con 0x7f26dc1453a0 2023-07-14T13:30:04.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.659+0000 7f26e45f6640 1 -- 172.21.15.5:0/2795437271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26dc1436e0 con 0x7f26dc1453a0 2023-07-14T13:30:04.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.659+0000 7f26e45f6640 1 -- 172.21.15.5:0/2795437271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26dc1438d0 con 0x7f26dc1453a0 2023-07-14T13:30:04.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.659+0000 7f26d2ffd640 1 -- 172.21.15.5:0/2795437271 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 88) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f26cc0b2040 con 0x7f26dc1453a0 2023-07-14T13:30:04.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.659+0000 7f26d2ffd640 1 --2- 172.21.15.5:0/2795437271 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f26c0066120 0x7f26c00685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:04.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.659+0000 7f26d2ffd640 1 -- 172.21.15.5:0/2795437271 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f26cc11dd50 con 0x7f26dc1453a0 2023-07-14T13:30:04.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.663+0000 7f26e2392640 1 --2- 172.21.15.5:0/2795437271 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f26c0066120 0x7f26c00685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:04.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.663+0000 7f26e2392640 1 --2- 172.21.15.5:0/2795437271 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f26c0066120 0x7f26c00685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f26d8000f70 tx=0x7f26d8007e10 comp rx=0 tx=0).ready entity=mgr.8399 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:04.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.663+0000 7f26d2ffd640 1 -- 172.21.15.5:0/2795437271 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f26dc1438d0 con 0x7f26dc1453a0 2023-07-14T13:30:04.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.839+0000 7f26e45f6640 1 -- 172.21.15.5:0/2795437271 --> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f26dc15c7c0 con 0x7f26c0066120 2023-07-14T13:30:04.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.843+0000 7f26d2ffd640 1 -- 172.21.15.5:0/2795437271 <== mgr.8399 v2:172.21.15.154:6832/3169896898 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7f26dc15c7c0 con 0x7f26c0066120 2023-07-14T13:30:04.847 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:30:04.848 INFO:teuthology.orchestra.run.smithi005.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-07-14T13:30:04.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.847+0000 7f26e45f6640 1 -- 172.21.15.5:0/2795437271 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f26c0066120 msgr2=0x7f26c00685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:04.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.847+0000 7f26e45f6640 1 --2- 172.21.15.5:0/2795437271 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f26c0066120 0x7f26c00685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f26d8000f70 tx=0x7f26d8007e10 comp rx=0 tx=0).stop 2023-07-14T13:30:04.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.847+0000 7f26e45f6640 1 -- 172.21.15.5:0/2795437271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26dc1453a0 msgr2=0x7f26dc15b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:04.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.847+0000 7f26e45f6640 1 --2- 172.21.15.5:0/2795437271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26dc1453a0 0x7f26dc15b4f0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f26cc018e60 tx=0x7f26cc018ff0 comp rx=0 tx=0).stop 2023-07-14T13:30:04.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.847+0000 7f26e45f6640 1 -- 172.21.15.5:0/2795437271 shutdown_connections 2023-07-14T13:30:04.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.847+0000 7f26e45f6640 1 --2- 172.21.15.5:0/2795437271 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f26c0066120 0x7f26c00685d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:04.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.847+0000 7f26e45f6640 1 --2- 172.21.15.5:0/2795437271 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26dc15f690 0x7f26dc15ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:04.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.847+0000 7f26e45f6640 1 --2- 172.21.15.5:0/2795437271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26dc1453a0 0x7f26dc15b4f0 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:04.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.847+0000 7f26e45f6640 1 --2- 172.21.15.5:0/2795437271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26dc06a440 0x7f26dc1431a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:04.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.847+0000 7f26e45f6640 1 -- 172.21.15.5:0/2795437271 >> 172.21.15.5:0/2795437271 conn(0x7f26dc0b1210 msgr2=0x7f26dc0b1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:04.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.847+0000 7f26e45f6640 1 -- 172.21.15.5:0/2795437271 shutdown_connections 2023-07-14T13:30:04.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:30:04.847+0000 7f26e45f6640 1 -- 172.21.15.5:0/2795437271 wait complete. 2023-07-14T13:30:04.868 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-07-14T13:30:04.869 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-07-14T13:30:04.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:04.870 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:04.881 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:04.882 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:04.882 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:05.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:05.884 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:05.896 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:05.897 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:05.897 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:06.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:06.899 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:06.912 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:06.912 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:06.912 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:07.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:07.914 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:07.926 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:07.926 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:07.927 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:08.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:08.929 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:08.941 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:08.941 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:08.942 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:09.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:09.943 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:09.956 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:09.956 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:09.956 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:10.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:10.958 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:10.970 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:10.971 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:10.971 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:11.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:11.973 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:11.985 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:11.986 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:11.986 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:12.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:12.988 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:13.000 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:13.001 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:13.001 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:14.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:14.003 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:14.015 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:14.015 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:14.015 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:15.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:15.017 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:15.030 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:15.031 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:15.031 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:16.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:16.033 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:16.046 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:16.046 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:16.047 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:17.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:17.048 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:17.060 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:17.061 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:17.062 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:18.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:18.064 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:18.077 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:18.078 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:18.078 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:19.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:19.080 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:19.093 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:19.093 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:19.093 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:20.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:20.094 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:20.107 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:20.107 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:20.108 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:20.871 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:30:20.875 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:30:21.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:21.110 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:21.122 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:21.123 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:21.123 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:22.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:22.125 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:22.137 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:22.138 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:22.138 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:23.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:23.140 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:23.152 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:23.152 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:23.152 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:24.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:24.154 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:24.166 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:24.166 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:24.167 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:25.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:25.168 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:25.181 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:25.181 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:25.181 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:26.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:26.183 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:26.198 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:26.198 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:26.198 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:27.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:27.200 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:27.212 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:27.213 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:27.213 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:28.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:28.215 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:28.228 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:28.229 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:28.229 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:29.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:29.231 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:29.243 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:29.243 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:29.243 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:30.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:30.245 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:30.257 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:30.257 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:30.257 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:31.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:31.259 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:31.271 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:31.272 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:31.272 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:32.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:32.274 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:32.285 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:32.286 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:32.286 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:33.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:33.288 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:33.300 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:33.300 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:33.301 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:34.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:34.303 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:34.315 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:34.316 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:34.316 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:35.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:35.318 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:35.330 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:35.330 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:35.331 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:36.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:36.332 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:36.345 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:36.345 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:36.345 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:37.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:37.347 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:37.359 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:37.359 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:37.360 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:38.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:38.362 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:38.373 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:38.373 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:38.373 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:39.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:39.375 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:39.387 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:39.388 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:39.388 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:40.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:40.390 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:40.402 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:40.403 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:40.403 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:41.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:41.404 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:41.416 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:41.417 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:41.417 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:42.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:42.419 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:42.431 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:42.431 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:42.431 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:43.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:43.433 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:43.447 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:43.447 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:43.448 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:44.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:44.451 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:44.463 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:44.463 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:44.464 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:45.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:45.465 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:45.477 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:45.478 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:45.478 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:46.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:46.480 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:46.495 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:46.496 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:46.496 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:47.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:47.498 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:47.511 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:47.512 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:47.512 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:48.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:48.514 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:48.528 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:48.529 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:48.529 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:49.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:49.531 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:49.544 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:49.544 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:49.544 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:50.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:50.546 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:50.558 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:50.559 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:50.559 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:50.937 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:30:50.941 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:30:51.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:51.561 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:51.574 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:51.574 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:51.574 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:52.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:52.576 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:52.588 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:52.588 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:52.588 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:53.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:53.590 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:53.602 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:53.602 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:53.602 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:54.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:54.604 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:54.616 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:54.616 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:54.617 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:55.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:55.619 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:55.631 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:55.632 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:55.632 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:56.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:56.634 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:56.647 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:56.647 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:56.648 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:57.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:57.649 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:57.663 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:57.663 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:57.663 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:58.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:58.665 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:58.676 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:58.677 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:58.677 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:30:59.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:30:59.679 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:30:59.691 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-14T13:30:59.691 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:30:59.691 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:00.490 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:31:00.490+0000 7f9789dd3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:31:00.490 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:31:00.490+0000 7f9789dd3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:31:00.490 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:31:00.490+0000 7f9789dd3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:31:00.490 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:31:00.490+0000 7f9789dd3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:31:00.490 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:31:00.490+0000 7f9789dd3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:31:00.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:00.693 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:00.704 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:00.706 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:00.707 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:00.707 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:00.708 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-07-14-13_31_00_UTC'] 2023-07-14T13:31:00.708 DEBUG:tasks.cephfs.test_snap_schedules:exec=1689341404.5013025, now = 1689341460.7089162, timo = 56 2023-07-14T13:31:01.709 DEBUG:tasks.cephfs.test_snap_schedules:expecting removal of snap snap_test_dir1/.snap/scheduled-2023-07-14-13_31_00 in ~116s... 2023-07-14T13:31:01.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:01.710 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:01.721 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:01.722 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:01.723 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:01.723 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:02.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:02.724 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:02.736 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:02.739 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:02.741 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:02.741 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:03.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:03.743 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:03.753 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:03.754 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:03.755 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:03.755 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:04.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:04.757 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:04.769 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:04.770 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:04.771 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:04.771 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:05.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:05.773 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:05.784 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:05.785 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:05.785 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:05.786 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:06.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:06.787 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:06.798 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:06.799 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:06.799 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:06.799 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:07.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:07.801 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:07.813 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:07.814 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:07.814 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:07.814 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:08.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:08.816 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:08.828 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:08.829 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:08.829 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:08.830 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:09.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:09.831 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:09.842 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:09.843 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:09.843 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:09.843 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:10.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:10.846 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:10.858 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:10.860 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:10.861 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:10.861 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:11.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:11.863 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:11.874 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:11.875 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:11.875 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:11.875 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:12.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:12.877 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:12.889 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:12.890 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:12.890 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:12.890 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:13.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:13.892 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:13.904 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:13.905 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:13.905 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:13.906 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:14.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:14.907 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:14.918 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:14.919 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:14.919 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:14.920 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:15.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:15.922 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:15.933 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:15.934 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:15.934 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:15.934 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:16.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:16.936 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:16.948 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:16.949 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:16.949 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:16.949 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:17.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:17.952 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:17.964 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:17.965 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:17.966 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:17.966 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:18.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:18.968 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:18.979 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:18.980 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:18.980 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:18.980 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:19.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:19.982 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:19.993 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:19.995 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:19.995 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:19.996 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:20.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:20.998 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:20.999 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:31:21.005 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:31:21.010 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:21.011 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:21.011 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:21.012 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:22.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:22.014 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:22.025 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:22.026 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:22.026 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:22.026 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:23.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:23.028 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:23.039 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:23.040 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:23.040 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:23.041 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:24.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:24.043 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:24.054 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:24.055 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:24.055 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:24.056 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:25.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:25.058 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:25.069 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:25.070 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:25.071 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:25.071 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:26.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:26.073 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:26.083 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:26.084 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:26.085 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:26.085 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:27.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:27.087 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:27.098 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:27.099 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:27.100 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:27.100 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:28.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:28.102 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:28.113 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:28.114 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:28.114 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:28.114 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:29.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:29.116 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:29.128 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:29.129 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:29.129 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:29.129 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:30.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:30.131 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:30.142 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:30.143 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:30.143 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:30.143 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:31.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:31.145 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:31.156 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:31.157 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:31.157 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:31.157 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:32.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:32.159 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:32.171 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:32.173 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:32.174 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:32.175 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:33.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:33.176 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:33.187 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:33.188 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:33.189 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:33.189 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:34.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:34.191 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:34.202 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:34.203 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:34.203 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:34.203 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:35.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:35.205 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:35.220 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:35.221 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:35.221 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:35.222 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:36.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:36.223 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:36.234 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:36.235 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:36.236 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:36.236 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:37.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:37.238 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:37.248 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:37.249 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:37.250 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:37.250 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:38.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:38.252 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:38.263 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:38.264 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:38.264 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:38.265 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:39.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:39.266 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:39.278 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:39.279 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:39.280 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:39.280 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:40.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:40.281 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:40.292 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:40.293 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:40.294 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:40.294 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:41.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:41.296 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:41.309 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:41.310 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:41.310 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:41.311 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:42.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:42.313 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:42.324 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:42.325 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:42.325 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:42.326 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:43.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:43.327 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:43.338 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:43.339 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:43.340 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:43.340 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:44.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:44.341 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:44.353 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:44.354 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:44.354 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:44.355 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:45.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:45.356 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:45.368 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:45.369 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:45.370 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:45.370 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:46.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:46.371 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:46.382 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:46.383 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:46.384 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:46.384 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:47.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:47.386 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:47.397 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:47.398 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:47.398 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:47.398 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:48.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:48.400 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:48.411 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:48.412 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:48.412 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:48.412 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:49.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:49.413 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:49.425 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:49.426 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:49.426 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:49.426 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:50.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:50.428 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:50.440 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:50.441 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:50.441 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:50.441 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:51.070 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:31:51.075 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:31:51.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:51.443 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:51.454 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:51.455 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:51.455 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:51.455 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:52.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:52.457 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:52.468 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:52.469 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:52.469 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:52.470 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:53.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:53.472 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:53.483 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:53.484 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:53.485 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:53.485 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:54.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:54.486 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:54.497 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:54.498 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:54.498 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:54.499 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:55.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:55.500 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:55.512 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:55.513 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:55.514 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:55.514 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:56.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:56.515 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:56.526 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:56.527 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:56.528 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:56.528 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:57.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:57.530 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:57.541 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:57.542 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:57.542 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:57.542 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:58.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:58.544 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:58.555 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:58.556 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:58.556 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:58.556 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:31:59.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:31:59.558 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:31:59.569 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:31:59.570 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:31:59.571 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:31:59.571 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:32:00.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:00.573 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:32:00.588 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_31_00_UTC 2023-07-14T13:32:00.589 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_32_00_UTC 2023-07-14T13:32:00.590 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_31_00_UTC', 'scheduled-2023-07-14-13_32_00_UTC'} 2023-07-14T13:32:00.590 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-07-14-13_32_00_UTC'} 2023-07-14T13:32:00.590 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-14T13:32:01.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:01.592 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:32:01.603 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_32_00_UTC 2023-07-14T13:32:01.604 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-14-13_32_00_UTC'} 2023-07-14T13:32:01.604 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-14T13:32:01.605 INFO:tasks.cephfs.test_snap_schedules:removed: {'scheduled-2023-07-14-13_31_00_UTC'} 2023-07-14T13:32:01.605 DEBUG:tasks.cephfs.test_snap_schedules:snapshots removed=['scheduled-2023-07-14-13_31_00_UTC'] 2023-07-14T13:32:01.605 DEBUG:tasks.cephfs.test_snap_schedules:exec=1689341404.5013025, now = 1689341521.6056552, timo = 116 2023-07-14T13:32:02.607 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-07-14T13:32:02.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.764+0000 7f456f493640 1 Processor -- start 2023-07-14T13:32:02.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.764+0000 7f456f493640 1 -- start start 2023-07-14T13:32:02.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.764+0000 7f456f493640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f45680aeb40 0x7f456815cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:02.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.764+0000 7f456f493640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4568159440 0x7f45680c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:02.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.764+0000 7f456f493640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45681532b0 con 0x7f45680aef10 2023-07-14T13:32:02.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.764+0000 7f456f493640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45680ca6f0 con 0x7f4568159440 2023-07-14T13:32:02.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.764+0000 7f456f493640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45681599d0 con 0x7f45680aeb40 2023-07-14T13:32:02.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.764+0000 7f456da30640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4568159440 0x7f45680c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:02.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.764+0000 7f456da30640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4568159440 0x7f45680c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44380/0 (socket says 172.21.15.5:44380) 2023-07-14T13:32:02.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.764+0000 7f456da30640 1 -- 172.21.15.5:0/1155275282 learned_addr learned my addr 172.21.15.5:0/1155275282 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:02.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.764+0000 7f456d22f640 1 --2- 172.21.15.5:0/1155275282 >> v2:172.21.15.154:3300/0 conn(0x7f45680aeb40 0x7f456815cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:02.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.764+0000 7f456da30640 1 -- 172.21.15.5:0/1155275282 >> v2:172.21.15.154:3300/0 conn(0x7f45680aeb40 msgr2=0x7f456815cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:02.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.764+0000 7f456da30640 1 --2- 172.21.15.5:0/1155275282 >> v2:172.21.15.154:3300/0 conn(0x7f45680aeb40 0x7f456815cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:02.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.764+0000 7f456da30640 1 -- 172.21.15.5:0/1155275282 >> v1:172.21.15.154:6789/0 conn(0x7f45680aef10 legacy=0x7f4568158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:02.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.764+0000 7f456da30640 1 -- 172.21.15.5:0/1155275282 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4568159cb0 con 0x7f4568159440 2023-07-14T13:32:02.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.768+0000 7f456da30640 1 --2- 172.21.15.5:0/1155275282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4568159440 0x7f45680c88c0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f4568071ad0 tx=0x7f456001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed60b10d18d0f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:02.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.768+0000 7f455ffff640 1 -- 172.21.15.5:0/1155275282 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45600a57d0 con 0x7f4568159440 2023-07-14T13:32:02.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.768+0000 7f455ffff640 1 -- 172.21.15.5:0/1155275282 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45600a5930 con 0x7f4568159440 2023-07-14T13:32:02.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.768+0000 7f455ffff640 1 -- 172.21.15.5:0/1155275282 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45600a5cc0 con 0x7f4568159440 2023-07-14T13:32:02.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.768+0000 7f456f493640 1 -- 172.21.15.5:0/1155275282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4568159440 msgr2=0x7f45680c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:02.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.768+0000 7f456f493640 1 --2- 172.21.15.5:0/1155275282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4568159440 0x7f45680c88c0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f4568071ad0 tx=0x7f456001c910 comp rx=0 tx=0).stop 2023-07-14T13:32:02.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.768+0000 7f456f493640 1 -- 172.21.15.5:0/1155275282 shutdown_connections 2023-07-14T13:32:02.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.768+0000 7f456f493640 1 --2- 172.21.15.5:0/1155275282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4568159440 0x7f45680c88c0 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:02.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.768+0000 7f456f493640 1 --2- 172.21.15.5:0/1155275282 >> v2:172.21.15.154:3300/0 conn(0x7f45680aeb40 0x7f456815cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:02.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.768+0000 7f456f493640 1 -- 172.21.15.5:0/1155275282 >> 172.21.15.5:0/1155275282 conn(0x7f45680cde90 msgr2=0x7f45680ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:02.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.768+0000 7f456f493640 1 -- 172.21.15.5:0/1155275282 shutdown_connections 2023-07-14T13:32:02.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.768+0000 7f456f493640 1 -- 172.21.15.5:0/1155275282 wait complete. 2023-07-14T13:32:02.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.772+0000 7f456f493640 1 Processor -- start 2023-07-14T13:32:02.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.772+0000 7f456f493640 1 -- start start 2023-07-14T13:32:02.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.772+0000 7f456f493640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45680aeb40 0x7f456814c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:02.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.772+0000 7f456f493640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45680aef10 0x7f456815b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:02.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.772+0000 7f456f493640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4568159440 0x7f45680c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:02.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.772+0000 7f456f493640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456814cb10 con 0x7f4568159440 2023-07-14T13:32:02.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.772+0000 7f456f493640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456815a2c0 con 0x7f45680aef10 2023-07-14T13:32:02.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.772+0000 7f456f493640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456815a5a0 con 0x7f45680aeb40 2023-07-14T13:32:02.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.772+0000 7f456da30640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4568159440 0x7f45680c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:02.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.772+0000 7f456da30640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4568159440 0x7f45680c54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44390/0 (socket says 172.21.15.5:44390) 2023-07-14T13:32:02.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.772+0000 7f456da30640 1 -- 172.21.15.5:0/2937562923 learned_addr learned my addr 172.21.15.5:0/2937562923 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:02.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.772+0000 7f456d22f640 1 --2- 172.21.15.5:0/2937562923 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45680aeb40 0x7f456814c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:02.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.772+0000 7f456ca2e640 1 --2- 172.21.15.5:0/2937562923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45680aef10 0x7f456815b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:02.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.772+0000 7f456da30640 1 -- 172.21.15.5:0/2937562923 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45680aeb40 msgr2=0x7f456814c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:02.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.772+0000 7f456da30640 1 --2- 172.21.15.5:0/2937562923 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45680aeb40 0x7f456814c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:02.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.772+0000 7f456da30640 1 -- 172.21.15.5:0/2937562923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45680aef10 msgr2=0x7f456815b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:02.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.772+0000 7f456da30640 1 --2- 172.21.15.5:0/2937562923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45680aef10 0x7f456815b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:02.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.772+0000 7f456da30640 1 -- 172.21.15.5:0/2937562923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4560009b30 con 0x7f4568159440 2023-07-14T13:32:02.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.772+0000 7f456da30640 1 --2- 172.21.15.5:0/2937562923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4568159440 0x7f45680c54c0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f4560019520 tx=0x7f45600196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:02.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.772+0000 7f455dffb640 1 -- 172.21.15.5:0/2937562923 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45600b8670 con 0x7f4568159440 2023-07-14T13:32:02.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.772+0000 7f455dffb640 1 -- 172.21.15.5:0/2937562923 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45600b87f0 con 0x7f4568159440 2023-07-14T13:32:02.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.772+0000 7f456f493640 1 -- 172.21.15.5:0/2937562923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f456815a880 con 0x7f4568159440 2023-07-14T13:32:02.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.772+0000 7f455dffb640 1 -- 172.21.15.5:0/2937562923 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45600b8ba0 con 0x7f4568159440 2023-07-14T13:32:02.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.772+0000 7f456f493640 1 -- 172.21.15.5:0/2937562923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f456815ae40 con 0x7f4568159440 2023-07-14T13:32:02.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.776+0000 7f456f493640 1 -- 172.21.15.5:0/2937562923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f456815b030 con 0x7f4568159440 2023-07-14T13:32:02.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.776+0000 7f455dffb640 1 -- 172.21.15.5:0/2937562923 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 91) v1 ==== 85789+0+0 (secure 0 0 0) 0x7f45680c9610 con 0x7f4568159440 2023-07-14T13:32:02.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.776+0000 7f455dffb640 1 --2- 172.21.15.5:0/2937562923 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f454c066420 0x7f454c0688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:02.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.776+0000 7f455dffb640 1 -- 172.21.15.5:0/2937562923 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6492+0+0 (secure 0 0 0) 0x7f456011efc0 con 0x7f4568159440 2023-07-14T13:32:02.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.776+0000 7f456d22f640 1 --2- 172.21.15.5:0/2937562923 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f454c066420 0x7f454c0688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:02.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.776+0000 7f456d22f640 1 --2- 172.21.15.5:0/2937562923 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f454c066420 0x7f454c0688d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f45680c4de0 tx=0x7f4564009190 comp rx=0 tx=0).ready entity=mgr.8399 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:02.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.780+0000 7f455dffb640 1 -- 172.21.15.5:0/2937562923 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f45600ec3e0 con 0x7f4568159440 2023-07-14T13:32:02.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:02.952+0000 7f456f493640 1 -- 172.21.15.5:0/2937562923 --> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f456815c9d0 con 0x7f454c066420 2023-07-14T13:32:03.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.024+0000 7f455dffb640 1 -- 172.21.15.5:0/2937562923 <== mgr.8399 v2:172.21.15.154:6832/3169896898 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f4564011a60 con 0x7f454c066420 2023-07-14T13:32:03.025 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule removed for path snap_test_dir1 2023-07-14T13:32:03.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.024+0000 7f456f493640 1 -- 172.21.15.5:0/2937562923 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f454c066420 msgr2=0x7f454c0688d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:03.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.024+0000 7f456f493640 1 --2- 172.21.15.5:0/2937562923 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f454c066420 0x7f454c0688d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f45680c4de0 tx=0x7f4564009190 comp rx=0 tx=0).stop 2023-07-14T13:32:03.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.024+0000 7f456f493640 1 -- 172.21.15.5:0/2937562923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4568159440 msgr2=0x7f45680c54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:03.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.024+0000 7f456f493640 1 --2- 172.21.15.5:0/2937562923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4568159440 0x7f45680c54c0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f4560019520 tx=0x7f45600196b0 comp rx=0 tx=0).stop 2023-07-14T13:32:03.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.024+0000 7f456f493640 1 -- 172.21.15.5:0/2937562923 shutdown_connections 2023-07-14T13:32:03.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.024+0000 7f456f493640 1 --2- 172.21.15.5:0/2937562923 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f454c066420 0x7f454c0688d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:03.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.024+0000 7f456f493640 1 --2- 172.21.15.5:0/2937562923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4568159440 0x7f45680c54c0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:03.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.024+0000 7f456f493640 1 --2- 172.21.15.5:0/2937562923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45680aef10 0x7f456815b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:03.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.024+0000 7f456f493640 1 --2- 172.21.15.5:0/2937562923 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45680aeb40 0x7f456814c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:03.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.024+0000 7f456f493640 1 -- 172.21.15.5:0/2937562923 >> 172.21.15.5:0/2937562923 conn(0x7f45680cde90 msgr2=0x7f45680ada10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:03.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.024+0000 7f456f493640 1 -- 172.21.15.5:0/2937562923 shutdown_connections 2023-07-14T13:32:03.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.024+0000 7f456f493640 1 -- 172.21.15.5:0/2937562923 wait complete. 2023-07-14T13:32:03.046 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-07-14T13:32:03.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:03.047 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:32:03.057 INFO:teuthology.orchestra.run.smithi005.stdout:scheduled-2023-07-14-13_32_00_UTC 2023-07-14T13:32:03.058 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-14-13_32_00_UTC 2023-07-14T13:32:03.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:03.059 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-14-13_32_00_UTC) 2023-07-14T13:32:03.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:03.119 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-14T13:32:03.172 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-14T13:32:03.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.364+0000 7fcfc5dfa640 1 Processor -- start 2023-07-14T13:32:03.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.364+0000 7fcfc5dfa640 1 -- start start 2023-07-14T13:32:03.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.364+0000 7fcfc5dfa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcfc00ccff0 0x7fcfc015e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:03.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.364+0000 7fcfc5dfa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc00cbe50 con 0x7fcfc0159a70 2023-07-14T13:32:03.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.364+0000 7fcfc5dfa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc00cd410 con 0x7fcfc0071030 2023-07-14T13:32:03.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.364+0000 7fcfc5dfa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc015e5a0 con 0x7fcfc00ccff0 2023-07-14T13:32:03.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.364+0000 7fcfbf7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcfc0159a70 0x7fcfc0070920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50898/0 (socket says 172.21.15.5:50898) 2023-07-14T13:32:03.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.364+0000 7fcfbf7fe640 1 -- 172.21.15.5:0/1953625719 learned_addr learned my addr 172.21.15.5:0/1953625719 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:03.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.364+0000 7fcfbffff640 1 --2- 172.21.15.5:0/1953625719 >> v2:172.21.15.5:3300/0 conn(0x7fcfc00ccff0 0x7fcfc015e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:03.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.364+0000 7fcfbffff640 1 -- 172.21.15.5:0/1953625719 >> v1:172.21.15.154:6789/0 conn(0x7fcfc0071030 legacy=0x7fcfc00c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:03.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.364+0000 7fcfbffff640 1 -- 172.21.15.5:0/1953625719 >> v1:172.21.15.5:6789/0 conn(0x7fcfc0159a70 legacy=0x7fcfc0070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:03.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.364+0000 7fcfbffff640 1 -- 172.21.15.5:0/1953625719 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc00cd660 con 0x7fcfc00ccff0 2023-07-14T13:32:03.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.364+0000 7fcfbe7fc640 1 -- 172.21.15.5:0/1953625719 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934796784 0 0) 0x7fcfc00cbe50 con 0x7fcfc0159a70 2023-07-14T13:32:03.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.368+0000 7fcfbffff640 1 --2- 172.21.15.5:0/1953625719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfc00ccff0 0x7fcfc015e060 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009d90 tx=0x7fcfb801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745f24f2d36ac6db server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:03.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.368+0000 7fcfbe7fc640 1 -- 172.21.15.5:0/1953625719 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb80a5970 con 0x7fcfc00ccff0 2023-07-14T13:32:03.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.368+0000 7fcfbe7fc640 1 -- 172.21.15.5:0/1953625719 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb80a5ad0 con 0x7fcfc00ccff0 2023-07-14T13:32:03.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.368+0000 7fcfbe7fc640 1 -- 172.21.15.5:0/1953625719 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb80a5e60 con 0x7fcfc00ccff0 2023-07-14T13:32:03.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.368+0000 7fcfc5dfa640 1 -- 172.21.15.5:0/1953625719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfc00ccff0 msgr2=0x7fcfc015e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:03.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.368+0000 7fcfc5dfa640 1 --2- 172.21.15.5:0/1953625719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfc00ccff0 0x7fcfc015e060 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009d90 tx=0x7fcfb801c890 comp rx=0 tx=0).stop 2023-07-14T13:32:03.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.368+0000 7fcfc5dfa640 1 -- 172.21.15.5:0/1953625719 shutdown_connections 2023-07-14T13:32:03.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.368+0000 7fcfc5dfa640 1 --2- 172.21.15.5:0/1953625719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfc00ccff0 0x7fcfc015e060 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:03.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.368+0000 7fcfc5dfa640 1 -- 172.21.15.5:0/1953625719 >> 172.21.15.5:0/1953625719 conn(0x7fcfc00afac0 msgr2=0x7fcfc00afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:03.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.368+0000 7fcfc5dfa640 1 -- 172.21.15.5:0/1953625719 shutdown_connections 2023-07-14T13:32:03.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.368+0000 7fcfc5dfa640 1 -- 172.21.15.5:0/1953625719 wait complete. 2023-07-14T13:32:03.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.368+0000 7fcfc5dfa640 1 Processor -- start 2023-07-14T13:32:03.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.372+0000 7fcfc5dfa640 1 -- start start 2023-07-14T13:32:03.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.372+0000 7fcfc5dfa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfc0071030 0x7fcfc00b2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:03.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.372+0000 7fcfc5dfa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfc00ccff0 0x7fcfc014ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:03.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.372+0000 7fcfc5dfa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcfc0159a70 0x7fcfc00b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:03.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.372+0000 7fcfc5dfa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc014d940 con 0x7fcfc0071030 2023-07-14T13:32:03.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.372+0000 7fcfc5dfa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc014d660 con 0x7fcfc00ccff0 2023-07-14T13:32:03.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.372+0000 7fcfc5dfa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc00b1970 con 0x7fcfc0159a70 2023-07-14T13:32:03.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.372+0000 7fcfbf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfc0071030 0x7fcfc00b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:03.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.372+0000 7fcfbf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfc0071030 0x7fcfc00b2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44400/0 (socket says 172.21.15.5:44400) 2023-07-14T13:32:03.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.372+0000 7fcfbf7fe640 1 -- 172.21.15.5:0/686908109 learned_addr learned my addr 172.21.15.5:0/686908109 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:03.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.372+0000 7fcfbeffd640 1 --2- 172.21.15.5:0/686908109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfc00ccff0 0x7fcfc014ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:03.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.372+0000 7fcfbffff640 1 --2- 172.21.15.5:0/686908109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcfc0159a70 0x7fcfc00b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:03.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.372+0000 7fcfbf7fe640 1 -- 172.21.15.5:0/686908109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcfc0159a70 msgr2=0x7fcfc00b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:03.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.372+0000 7fcfbf7fe640 1 --2- 172.21.15.5:0/686908109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcfc0159a70 0x7fcfc00b30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:03.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.372+0000 7fcfbf7fe640 1 -- 172.21.15.5:0/686908109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfc00ccff0 msgr2=0x7fcfc014ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:03.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.372+0000 7fcfbf7fe640 1 --2- 172.21.15.5:0/686908109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfc00ccff0 0x7fcfc014ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:03.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.372+0000 7fcfbf7fe640 1 -- 172.21.15.5:0/686908109 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb8009a70 con 0x7fcfc0071030 2023-07-14T13:32:03.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.372+0000 7fcfbf7fe640 1 --2- 172.21.15.5:0/686908109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfc0071030 0x7fcfc00b2450 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000c410 tx=0x7fcfb000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:03.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.372+0000 7fcfa7fff640 1 -- 172.21.15.5:0/686908109 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb00074e0 con 0x7fcfc0071030 2023-07-14T13:32:03.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.372+0000 7fcfa7fff640 1 -- 172.21.15.5:0/686908109 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb0007640 con 0x7fcfc0071030 2023-07-14T13:32:03.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.372+0000 7fcfc5dfa640 1 -- 172.21.15.5:0/686908109 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc00b1c50 con 0x7fcfc0071030 2023-07-14T13:32:03.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.372+0000 7fcfa7fff640 1 -- 172.21.15.5:0/686908109 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0004a30 con 0x7fcfc0071030 2023-07-14T13:32:03.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.372+0000 7fcfc5dfa640 1 -- 172.21.15.5:0/686908109 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc014cf50 con 0x7fcfc0071030 2023-07-14T13:32:03.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.372+0000 7fcfc5dfa640 1 -- 172.21.15.5:0/686908109 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc00ad780 con 0x7fcfc0071030 2023-07-14T13:32:03.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.376+0000 7fcfa7fff640 1 -- 172.21.15.5:0/686908109 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 91) v1 ==== 85789+0+0 (secure 0 0 0) 0x7fcfb0004b90 con 0x7fcfc0071030 2023-07-14T13:32:03.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.376+0000 7fcfa7fff640 1 --2- 172.21.15.5:0/686908109 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7fcfac0663f0 0x7fcfac0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:03.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.376+0000 7fcfa7fff640 1 -- 172.21.15.5:0/686908109 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6492+0+0 (secure 0 0 0) 0x7fcfb0083da0 con 0x7fcfc0071030 2023-07-14T13:32:03.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.376+0000 7fcfbeffd640 1 --2- 172.21.15.5:0/686908109 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7fcfac0663f0 0x7fcfac0688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:03.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.376+0000 7fcfbeffd640 1 --2- 172.21.15.5:0/686908109 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7fcfac0663f0 0x7fcfac0688a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcfc00b0860 tx=0x7fcfb4009040 comp rx=0 tx=0).ready entity=mgr.8399 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:03.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.380+0000 7fcfa7fff640 1 -- 172.21.15.5:0/686908109 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fcfb0051000 con 0x7fcfc0071030 2023-07-14T13:32:03.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:03.576+0000 7fcfc5dfa640 1 -- 172.21.15.5:0/686908109 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fcfc00b17d0 con 0x7fcfc0071030 2023-07-14T13:32:04.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.284+0000 7fcfa7fff640 1 -- 172.21.15.5:0/686908109 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 92) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fcfb00513d0 con 0x7fcfc0071030 2023-07-14T13:32:04.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.284+0000 7fcfa7fff640 1 -- 172.21.15.5:0/686908109 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v92) v1 ==== 93+0+0 (secure 0 0 0) 0x7fcfb00711a0 con 0x7fcfc0071030 2023-07-14T13:32:04.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.288+0000 7fcfc5dfa640 1 -- 172.21.15.5:0/686908109 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7fcfac0663f0 msgr2=0x7fcfac0688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:04.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.288+0000 7fcfc5dfa640 1 --2- 172.21.15.5:0/686908109 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7fcfac0663f0 0x7fcfac0688a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcfc00b0860 tx=0x7fcfb4009040 comp rx=0 tx=0).stop 2023-07-14T13:32:04.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.288+0000 7fcfc5dfa640 1 -- 172.21.15.5:0/686908109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfc0071030 msgr2=0x7fcfc00b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:04.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.288+0000 7fcfc5dfa640 1 --2- 172.21.15.5:0/686908109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfc0071030 0x7fcfc00b2450 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000c410 tx=0x7fcfb000c8d0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.288+0000 7fcfc5dfa640 1 -- 172.21.15.5:0/686908109 shutdown_connections 2023-07-14T13:32:04.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.288+0000 7fcfc5dfa640 1 --2- 172.21.15.5:0/686908109 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7fcfac0663f0 0x7fcfac0688a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.288+0000 7fcfc5dfa640 1 --2- 172.21.15.5:0/686908109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcfc0159a70 0x7fcfc00b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.288+0000 7fcfc5dfa640 1 --2- 172.21.15.5:0/686908109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfc00ccff0 0x7fcfc014ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.288+0000 7fcfc5dfa640 1 --2- 172.21.15.5:0/686908109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfc0071030 0x7fcfc00b2450 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.288+0000 7fcfc5dfa640 1 -- 172.21.15.5:0/686908109 >> 172.21.15.5:0/686908109 conn(0x7fcfc00afac0 msgr2=0x7fcfc0158c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:04.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.288+0000 7fcfc5dfa640 1 -- 172.21.15.5:0/686908109 shutdown_connections 2023-07-14T13:32:04.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.288+0000 7fcfc5dfa640 1 -- 172.21.15.5:0/686908109 wait complete. 2023-07-14T13:32:04.324 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T13:32:04.325 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:32:04.403 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:32:04.454 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T13:32:04.455 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:32:04.456 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:32:04.467 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:32:04.467 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:32:04.468 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:04.468+0000 7fd2e6445180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:32:04.480 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:04.480+0000 7f2614592180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:32:04.491 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:32:04.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.676+0000 7f8f57426640 1 Processor -- start 2023-07-14T13:32:04.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.676+0000 7f8f57426640 1 -- start start 2023-07-14T13:32:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.676+0000 7f8f57426640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8f500b7c70 0x7f8f500d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:04.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.676+0000 7f8f57426640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8f5015fd60 0x7f8f500d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:04.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.676+0000 7f8f57426640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f500ccaf0 con 0x7f8f500d1850 2023-07-14T13:32:04.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.676+0000 7f8f57426640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f500d1190 con 0x7f8f500b7c70 2023-07-14T13:32:04.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.676+0000 7f8f57426640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f50160600 con 0x7f8f5015fd60 2023-07-14T13:32:04.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.676+0000 7f8f551c2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8f500b7c70 0x7f8f500d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.676+0000 7f8f551c2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8f500b7c70 0x7f8f500d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44438/0 (socket says 172.21.15.5:44438) 2023-07-14T13:32:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.676+0000 7f8f551c2640 1 -- 172.21.15.5:0/395819608 learned_addr learned my addr 172.21.15.5:0/395819608 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:04.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.676+0000 7f8f559c3640 1 --2- 172.21.15.5:0/395819608 >> v2:172.21.15.154:3300/0 conn(0x7f8f5015fd60 0x7f8f500d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.680+0000 7f8f551c2640 1 -- 172.21.15.5:0/395819608 >> v2:172.21.15.154:3300/0 conn(0x7f8f5015fd60 msgr2=0x7f8f500d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:04.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.680+0000 7f8f551c2640 1 --2- 172.21.15.5:0/395819608 >> v2:172.21.15.154:3300/0 conn(0x7f8f5015fd60 0x7f8f500d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.680+0000 7f8f551c2640 1 -- 172.21.15.5:0/395819608 >> v1:172.21.15.154:6789/0 conn(0x7f8f500d1850 legacy=0x7f8f5015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:04.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.680+0000 7f8f551c2640 1 -- 172.21.15.5:0/395819608 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f50160320 con 0x7f8f500b7c70 2023-07-14T13:32:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.680+0000 7f8f551c2640 1 --2- 172.21.15.5:0/395819608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f500b7c70 0x7f8f500d0c50 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f8f500b4040 tx=0x7f8f4c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9244ca3dfb629180 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.680+0000 7f8f47fff640 1 -- 172.21.15.5:0/395819608 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c0aa650 con 0x7f8f500b7c70 2023-07-14T13:32:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.680+0000 7f8f47fff640 1 -- 172.21.15.5:0/395819608 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4c0aa7b0 con 0x7f8f500b7c70 2023-07-14T13:32:04.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.680+0000 7f8f47fff640 1 -- 172.21.15.5:0/395819608 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c0aab40 con 0x7f8f500b7c70 2023-07-14T13:32:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.684+0000 7f8f57426640 1 -- 172.21.15.5:0/395819608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f500b7c70 msgr2=0x7f8f500d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.684+0000 7f8f57426640 1 --2- 172.21.15.5:0/395819608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f500b7c70 0x7f8f500d0c50 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f8f500b4040 tx=0x7f8f4c01c4d0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.684+0000 7f8f57426640 1 -- 172.21.15.5:0/395819608 shutdown_connections 2023-07-14T13:32:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.684+0000 7f8f57426640 1 --2- 172.21.15.5:0/395819608 >> v2:172.21.15.154:3300/0 conn(0x7f8f5015fd60 0x7f8f500d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.684+0000 7f8f57426640 1 --2- 172.21.15.5:0/395819608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f500b7c70 0x7f8f500d0c50 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.684+0000 7f8f57426640 1 -- 172.21.15.5:0/395819608 >> 172.21.15.5:0/395819608 conn(0x7f8f500650b0 msgr2=0x7f8f500654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.684+0000 7f8f57426640 1 -- 172.21.15.5:0/395819608 shutdown_connections 2023-07-14T13:32:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.684+0000 7f8f57426640 1 -- 172.21.15.5:0/395819608 wait complete. 2023-07-14T13:32:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.684+0000 7f8f57426640 1 Processor -- start 2023-07-14T13:32:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.684+0000 7f8f57426640 1 -- start start 2023-07-14T13:32:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.684+0000 7f8f57426640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f500b7c70 0x7f8f5015e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.684+0000 7f8f57426640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f500d1850 0x7f8f50159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:04.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.684+0000 7f8f57426640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f5015fd60 0x7f8f5015a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.684+0000 7f8f57426640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5015e860 con 0x7f8f500d1850 2023-07-14T13:32:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.684+0000 7f8f57426640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f500b6f40 con 0x7f8f5015fd60 2023-07-14T13:32:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.684+0000 7f8f57426640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5015ea90 con 0x7f8f500b7c70 2023-07-14T13:32:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.684+0000 7f8f549c1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f500d1850 0x7f8f50159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.684+0000 7f8f549c1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f500d1850 0x7f8f50159fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44446/0 (socket says 172.21.15.5:44446) 2023-07-14T13:32:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.684+0000 7f8f549c1640 1 -- 172.21.15.5:0/4032756391 learned_addr learned my addr 172.21.15.5:0/4032756391 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:04.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.684+0000 7f8f559c3640 1 --2- 172.21.15.5:0/4032756391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f5015fd60 0x7f8f5015a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.684+0000 7f8f551c2640 1 --2- 172.21.15.5:0/4032756391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f500b7c70 0x7f8f5015e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.684+0000 7f8f549c1640 1 -- 172.21.15.5:0/4032756391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f500b7c70 msgr2=0x7f8f5015e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.684+0000 7f8f549c1640 1 --2- 172.21.15.5:0/4032756391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f500b7c70 0x7f8f5015e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.684+0000 7f8f549c1640 1 -- 172.21.15.5:0/4032756391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f5015fd60 msgr2=0x7f8f5015a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.684+0000 7f8f549c1640 1 --2- 172.21.15.5:0/4032756391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f5015fd60 0x7f8f5015a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.684+0000 7f8f549c1640 1 -- 172.21.15.5:0/4032756391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4c0094d0 con 0x7f8f500d1850 2023-07-14T13:32:04.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.684+0000 7f8f559c3640 1 --2- 172.21.15.5:0/4032756391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f5015fd60 0x7f8f5015a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:32:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.688+0000 7f8f549c1640 1 --2- 172.21.15.5:0/4032756391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f500d1850 0x7f8f50159fd0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000c3c0 tx=0x7f8f4000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.688+0000 7f8f45ffb640 1 -- 172.21.15.5:0/4032756391 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f400052d0 con 0x7f8f500d1850 2023-07-14T13:32:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.688+0000 7f8f45ffb640 1 -- 172.21.15.5:0/4032756391 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f40005430 con 0x7f8f500d1850 2023-07-14T13:32:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.688+0000 7f8f45ffb640 1 -- 172.21.15.5:0/4032756391 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f40003840 con 0x7f8f500d1850 2023-07-14T13:32:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.688+0000 7f8f57426640 1 -- 172.21.15.5:0/4032756391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f5015ed70 con 0x7f8f500d1850 2023-07-14T13:32:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.688+0000 7f8f57426640 1 -- 172.21.15.5:0/4032756391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f50154570 con 0x7f8f500d1850 2023-07-14T13:32:04.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.688+0000 7f8f57426640 1 -- 172.21.15.5:0/4032756391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f501540f0 con 0x7f8f500d1850 2023-07-14T13:32:04.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.688+0000 7f8f45ffb640 1 -- 172.21.15.5:0/4032756391 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 92) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f8f400039a0 con 0x7f8f500d1850 2023-07-14T13:32:04.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.688+0000 7f8f45ffb640 1 --2- 172.21.15.5:0/4032756391 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f8f340663a0 0x7f8f34068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:04.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.688+0000 7f8f45ffb640 1 -- 172.21.15.5:0/4032756391 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6492+0+0 (secure 0 0 0) 0x7f8f400834f0 con 0x7f8f500d1850 2023-07-14T13:32:04.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.688+0000 7f8f551c2640 1 -- 172.21.15.5:0/4032756391 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f8f340663a0 msgr2=0x7f8f34068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3169896898 2023-07-14T13:32:04.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.692+0000 7f8f551c2640 1 --2- 172.21.15.5:0/4032756391 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f8f340663a0 0x7f8f34068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:32:04.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.696+0000 7f8f45ffb640 1 -- 172.21.15.5:0/4032756391 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f8f501540f0 con 0x7f8f500d1850 2023-07-14T13:32:04.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.856+0000 7f8f57426640 1 -- 172.21.15.5:0/4032756391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f501540f0 con 0x7f8f500d1850 2023-07-14T13:32:04.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.856+0000 7f8f45ffb640 1 -- 172.21.15.5:0/4032756391 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) v1 ==== 74+0+18963 (secure 0 0 0) 0x7f8f501540f0 con 0x7f8f500d1850 2023-07-14T13:32:04.858 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:04.859 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":175,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:31:04.285076+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:29:43.300974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-14T13:29:44.554824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.7","mappings":[{"from":3,"to":0}]},{"pgid":"22.2b","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6833/1905284593":"2023-07-15T13:30:02.960482+0000","172.21.15.154:6832/1905284593":"2023-07-15T13:30:02.960482+0000","172.21.15.154:0/3194204879":"2023-07-15T13:30:02.960482+0000","172.21.15.154:0/3861552987":"2023-07-15T13:30:02.960482+0000","172.21.15.154:0/2010542927":"2023-07-15T13:30:02.960482+0000","172.21.15.154:0/1225132039":"2023-07-15T13:30:02.960482+0000","172.21.15.154:0/2876445445":"2023-07-15T13:30:02.960482+0000","172.21.15.154:0/1648465409":"2023-07-15T13:30:02.960482+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:32:04.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.856+0000 7f8f57426640 1 -- 172.21.15.5:0/4032756391 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f8f340663a0 msgr2=0x7f8f34068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:32:04.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.856+0000 7f8f57426640 1 --2- 172.21.15.5:0/4032756391 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f8f340663a0 0x7f8f34068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.856+0000 7f8f57426640 1 -- 172.21.15.5:0/4032756391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f500d1850 msgr2=0x7f8f50159fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:04.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.856+0000 7f8f57426640 1 --2- 172.21.15.5:0/4032756391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f500d1850 0x7f8f50159fd0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000c3c0 tx=0x7f8f4000c880 comp rx=0 tx=0).stop 2023-07-14T13:32:04.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.860+0000 7f8f57426640 1 -- 172.21.15.5:0/4032756391 shutdown_connections 2023-07-14T13:32:04.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.860+0000 7f8f57426640 1 --2- 172.21.15.5:0/4032756391 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f8f340663a0 0x7f8f34068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.860+0000 7f8f57426640 1 --2- 172.21.15.5:0/4032756391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f5015fd60 0x7f8f5015a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.860+0000 7f8f57426640 1 --2- 172.21.15.5:0/4032756391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f500d1850 0x7f8f50159fd0 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.860+0000 7f8f57426640 1 --2- 172.21.15.5:0/4032756391 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f500b7c70 0x7f8f5015e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.860+0000 7f8f57426640 1 -- 172.21.15.5:0/4032756391 >> 172.21.15.5:0/4032756391 conn(0x7f8f500650b0 msgr2=0x7f8f500cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:04.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.860+0000 7f8f57426640 1 -- 172.21.15.5:0/4032756391 shutdown_connections 2023-07-14T13:32:04.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:04.860+0000 7f8f57426640 1 -- 172.21.15.5:0/4032756391 wait complete. 2023-07-14T13:32:04.881 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T13:29:43.300974+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '171', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T13:29:44.554824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '172', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:32:04.882 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:32:04.883 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:04.884+0000 7fd2e6445180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:32:04.929 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:04.928+0000 7f2614592180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:32:05.034 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:05.036+0000 7fd2e6445180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:32:05.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.032+0000 7f0fa4293640 1 Processor -- start 2023-07-14T13:32:05.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.032+0000 7f0fa4293640 1 -- start start 2023-07-14T13:32:05.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.036+0000 7f0fa4293640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f9c0aeb40 0x7f0f9c15cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:05.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.036+0000 7f0fa4293640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0f9c0aef10 0x7f0f9c158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:05.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.036+0000 7f0fa4293640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f9c1532b0 con 0x7f0f9c159270 2023-07-14T13:32:05.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.036+0000 7f0fa4293640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f9c0ca6f0 con 0x7f0f9c0aef10 2023-07-14T13:32:05.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.036+0000 7f0fa4293640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c1599d0 con 0x7f0f9c0aeb40 2023-07-14T13:32:05.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.036+0000 7f0fa182e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0f9c0aef10 0x7f0f9c158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:05.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.036+0000 7f0fa182e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0f9c0aef10 0x7f0f9c158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44448/0 (socket says 172.21.15.5:44448) 2023-07-14T13:32:05.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.036+0000 7f0fa2830640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0f9c159270 0x7f0f9c0c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50906/0 (socket says 172.21.15.5:50906) 2023-07-14T13:32:05.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.036+0000 7f0fa182e640 1 -- 172.21.15.5:0/2835113214 learned_addr learned my addr 172.21.15.5:0/2835113214 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:05.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.036+0000 7f0fa202f640 1 --2- 172.21.15.5:0/2835113214 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f9c0aeb40 0x7f0f9c15cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:05.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.036+0000 7f0fa182e640 1 -- 172.21.15.5:0/2835113214 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f9c0aeb40 msgr2=0x7f0f9c15cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:05.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.036+0000 7f0fa182e640 1 --2- 172.21.15.5:0/2835113214 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f9c0aeb40 0x7f0f9c15cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.036+0000 7f0fa182e640 1 -- 172.21.15.5:0/2835113214 >> v1:172.21.15.5:6789/0 conn(0x7f0f9c159270 legacy=0x7f0f9c0c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:05.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.036+0000 7f0fa182e640 1 -- 172.21.15.5:0/2835113214 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c159cb0 con 0x7f0f9c0aef10 2023-07-14T13:32:05.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.036+0000 7f0fa102d640 1 -- 172.21.15.5:0/2835113214 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 799511525 0 0) 0x7f0f9c1532b0 con 0x7f0f9c159270 2023-07-14T13:32:05.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.040+0000 7f0fa182e640 1 --2- 172.21.15.5:0/2835113214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f9c0aef10 0x7f0f9c158d30 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c00bb10 tx=0x7f0f8c01eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=417d53308fcd274b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:05.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.040+0000 7f0fa102d640 1 -- 172.21.15.5:0/2835113214 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c0a7c20 con 0x7f0f9c0aef10 2023-07-14T13:32:05.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.040+0000 7f0fa102d640 1 -- 172.21.15.5:0/2835113214 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8c0a7d80 con 0x7f0f9c0aef10 2023-07-14T13:32:05.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.040+0000 7f0fa102d640 1 -- 172.21.15.5:0/2835113214 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c0af660 con 0x7f0f9c0aef10 2023-07-14T13:32:05.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.040+0000 7f0fa4293640 1 -- 172.21.15.5:0/2835113214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f9c0aef10 msgr2=0x7f0f9c158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:05.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.040+0000 7f0fa4293640 1 --2- 172.21.15.5:0/2835113214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f9c0aef10 0x7f0f9c158d30 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c00bb10 tx=0x7f0f8c01eb50 comp rx=0 tx=0).stop 2023-07-14T13:32:05.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.040+0000 7f0fa4293640 1 -- 172.21.15.5:0/2835113214 shutdown_connections 2023-07-14T13:32:05.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.040+0000 7f0fa4293640 1 --2- 172.21.15.5:0/2835113214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f9c0aef10 0x7f0f9c158d30 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.040+0000 7f0fa4293640 1 --2- 172.21.15.5:0/2835113214 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f9c0aeb40 0x7f0f9c15cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.040+0000 7f0fa4293640 1 -- 172.21.15.5:0/2835113214 >> 172.21.15.5:0/2835113214 conn(0x7f0f9c0cde90 msgr2=0x7f0f9c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:05.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.040+0000 7f0fa4293640 1 -- 172.21.15.5:0/2835113214 shutdown_connections 2023-07-14T13:32:05.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.040+0000 7f0fa4293640 1 -- 172.21.15.5:0/2835113214 wait complete. 2023-07-14T13:32:05.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.044+0000 7f0fa4293640 1 Processor -- start 2023-07-14T13:32:05.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.044+0000 7f0fa4293640 1 -- start start 2023-07-14T13:32:05.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.044+0000 7f0fa4293640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f9c0aeb40 0x7f0f9c1f39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.044+0000 7f0fa4293640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f9c0aef10 0x7f0f9c06c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.044+0000 7f0fa4293640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f9c159270 0x7f0f9c06c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.044+0000 7f0fa4293640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c1618d0 con 0x7f0f9c0aeb40 2023-07-14T13:32:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.044+0000 7f0fa4293640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c0b3220 con 0x7f0f9c159270 2023-07-14T13:32:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.044+0000 7f0fa4293640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c0b3500 con 0x7f0f9c0aef10 2023-07-14T13:32:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.044+0000 7f0fa202f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f9c0aeb40 0x7f0f9c1f39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:05.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.044+0000 7f0fa202f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f9c0aeb40 0x7f0f9c1f39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44450/0 (socket says 172.21.15.5:44450) 2023-07-14T13:32:05.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.044+0000 7f0fa202f640 1 -- 172.21.15.5:0/3128029680 learned_addr learned my addr 172.21.15.5:0/3128029680 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:05.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.044+0000 7f0fa2830640 1 --2- 172.21.15.5:0/3128029680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f9c159270 0x7f0f9c06c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:05.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.044+0000 7f0fa182e640 1 --2- 172.21.15.5:0/3128029680 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f9c0aef10 0x7f0f9c06c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.044+0000 7f0fa202f640 1 -- 172.21.15.5:0/3128029680 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f9c0aef10 msgr2=0x7f0f9c06c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.044+0000 7f0fa202f640 1 --2- 172.21.15.5:0/3128029680 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f9c0aef10 0x7f0f9c06c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.044+0000 7f0fa202f640 1 -- 172.21.15.5:0/3128029680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f9c159270 msgr2=0x7f0f9c06c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:05.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.044+0000 7f0fa202f640 1 --2- 172.21.15.5:0/3128029680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f9c159270 0x7f0f9c06c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.044+0000 7f0fa202f640 1 -- 172.21.15.5:0/3128029680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8c00b770 con 0x7f0f9c0aeb40 2023-07-14T13:32:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.044+0000 7f0fa2830640 1 --2- 172.21.15.5:0/3128029680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f9c159270 0x7f0f9c06c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.044+0000 7f0fa202f640 1 --2- 172.21.15.5:0/3128029680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f9c0aeb40 0x7f0f9c1f39d0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800e930 tx=0x7f0f9800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.044+0000 7f0f92ffd640 1 -- 172.21.15.5:0/3128029680 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98009690 con 0x7f0f9c0aeb40 2023-07-14T13:32:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.044+0000 7f0f92ffd640 1 -- 172.21.15.5:0/3128029680 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9800ca00 con 0x7f0f9c0aeb40 2023-07-14T13:32:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.044+0000 7f0f92ffd640 1 -- 172.21.15.5:0/3128029680 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9800cd70 con 0x7f0f9c0aeb40 2023-07-14T13:32:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.044+0000 7f0fa4293640 1 -- 172.21.15.5:0/3128029680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9c0b37e0 con 0x7f0f9c0aeb40 2023-07-14T13:32:05.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.044+0000 7f0fa4293640 1 -- 172.21.15.5:0/3128029680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9c1f3f10 con 0x7f0f9c0aeb40 2023-07-14T13:32:05.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.048+0000 7f0fa4293640 1 -- 172.21.15.5:0/3128029680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f9c0678d0 con 0x7f0f9c0aeb40 2023-07-14T13:32:05.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.048+0000 7f0f92ffd640 1 -- 172.21.15.5:0/3128029680 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 92) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f0f98013470 con 0x7f0f9c0aeb40 2023-07-14T13:32:05.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.048+0000 7f0f92ffd640 1 --2- 172.21.15.5:0/3128029680 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f0f800663a0 0x7f0f80068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:05.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.048+0000 7f0f92ffd640 1 -- 172.21.15.5:0/3128029680 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6492+0+0 (secure 0 0 0) 0x7f0f980842a0 con 0x7f0f9c0aeb40 2023-07-14T13:32:05.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.048+0000 7f0fa182e640 1 -- 172.21.15.5:0/3128029680 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f0f800663a0 msgr2=0x7f0f80068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3169896898 2023-07-14T13:32:05.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.048+0000 7f0fa182e640 1 --2- 172.21.15.5:0/3128029680 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f0f800663a0 0x7f0f80068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:32:05.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.052+0000 7f0f92ffd640 1 -- 172.21.15.5:0/3128029680 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f0f98051530 con 0x7f0f9c0aeb40 2023-07-14T13:32:05.093 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:05.092+0000 7f2614592180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:32:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.208+0000 7f0fa4293640 1 -- 172.21.15.5:0/3128029680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0f9c0c2ee0 con 0x7f0f9c0aeb40 2023-07-14T13:32:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.208+0000 7f0f92ffd640 1 -- 172.21.15.5:0/3128029680 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v175) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0f98054b50 con 0x7f0f9c0aeb40 2023-07-14T13:32:05.211 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:32:05.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.212+0000 7f0fa4293640 1 -- 172.21.15.5:0/3128029680 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f0f800663a0 msgr2=0x7f0f80068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:32:05.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.212+0000 7f0fa4293640 1 --2- 172.21.15.5:0/3128029680 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f0f800663a0 0x7f0f80068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.212+0000 7f0fa4293640 1 -- 172.21.15.5:0/3128029680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f9c0aeb40 msgr2=0x7f0f9c1f39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:05.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.212+0000 7f0fa4293640 1 --2- 172.21.15.5:0/3128029680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f9c0aeb40 0x7f0f9c1f39d0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800e930 tx=0x7f0f9800edf0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.212+0000 7f0fa4293640 1 -- 172.21.15.5:0/3128029680 shutdown_connections 2023-07-14T13:32:05.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.212+0000 7f0fa4293640 1 --2- 172.21.15.5:0/3128029680 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f0f800663a0 0x7f0f80068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.212+0000 7f0fa4293640 1 --2- 172.21.15.5:0/3128029680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f9c159270 0x7f0f9c06c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.212+0000 7f0fa4293640 1 --2- 172.21.15.5:0/3128029680 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f9c0aef10 0x7f0f9c06c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.212+0000 7f0fa4293640 1 --2- 172.21.15.5:0/3128029680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f9c0aeb40 0x7f0f9c1f39d0 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.212+0000 7f0fa4293640 1 -- 172.21.15.5:0/3128029680 >> 172.21.15.5:0/3128029680 conn(0x7f0f9c0cde90 msgr2=0x7f0f9c152a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:05.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.212+0000 7f0fa4293640 1 -- 172.21.15.5:0/3128029680 shutdown_connections 2023-07-14T13:32:05.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.212+0000 7f0fa4293640 1 -- 172.21.15.5:0/3128029680 wait complete. 2023-07-14T13:32:05.233 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:32:05.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.380+0000 7fb5b6c93640 1 Processor -- start 2023-07-14T13:32:05.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.380+0000 7fb5b6c93640 1 -- start start 2023-07-14T13:32:05.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.380+0000 7fb5b6c93640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb5b015bde0 0x7fb5b00d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:05.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.380+0000 7fb5b6c93640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5b00d2fc0 0x7fb5b00b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:05.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.380+0000 7fb5b6c93640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b00b04c0 con 0x7fb5b00d2300 2023-07-14T13:32:05.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.380+0000 7fb5b6c93640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b015c1b0 con 0x7fb5b015bde0 2023-07-14T13:32:05.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.380+0000 7fb5b6c93640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b00d0aa0 con 0x7fb5b00d2fc0 2023-07-14T13:32:05.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.380+0000 7fb5b4a2f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb5b015bde0 0x7fb5b00d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:05.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.380+0000 7fb5b4a2f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb5b015bde0 0x7fb5b00d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44464/0 (socket says 172.21.15.5:44464) 2023-07-14T13:32:05.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.380+0000 7fb5b4a2f640 1 -- 172.21.15.5:0/289000337 learned_addr learned my addr 172.21.15.5:0/289000337 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:05.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.380+0000 7fb5b5230640 1 --1- 172.21.15.5:0/289000337 >> v1:172.21.15.5:6789/0 conn(0x7fb5b00d2300 0x7fb5b00cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50916/0 (socket says 172.21.15.5:50916) 2023-07-14T13:32:05.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.380+0000 7fb5affff640 1 --2- 172.21.15.5:0/289000337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5b00d2fc0 0x7fb5b00b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:05.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.384+0000 7fb5b4a2f640 1 -- 172.21.15.5:0/289000337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5b00d2fc0 msgr2=0x7fb5b00b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:05.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.384+0000 7fb5b4a2f640 1 --2- 172.21.15.5:0/289000337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5b00d2fc0 0x7fb5b00b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.384+0000 7fb5b4a2f640 1 -- 172.21.15.5:0/289000337 >> v1:172.21.15.5:6789/0 conn(0x7fb5b00d2300 legacy=0x7fb5b00cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:05.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.384+0000 7fb5b4a2f640 1 -- 172.21.15.5:0/289000337 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b00afb90 con 0x7fb5b015bde0 2023-07-14T13:32:05.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.384+0000 7fb5af7fe640 1 -- 172.21.15.5:0/289000337 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743975664 0 0) 0x7fb5b00b04c0 con 0x7fb5b00d2300 2023-07-14T13:32:05.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.384+0000 7fb5b4a2f640 1 --2- 172.21.15.5:0/289000337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b015bde0 0x7fb5b00d0270 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4006fd0 tx=0x7fb5a401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a8ebdbbf872e6b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:05.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.384+0000 7fb5af7fe640 1 -- 172.21.15.5:0/289000337 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a40aa680 con 0x7fb5b015bde0 2023-07-14T13:32:05.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.384+0000 7fb5af7fe640 1 -- 172.21.15.5:0/289000337 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a40aa7e0 con 0x7fb5b015bde0 2023-07-14T13:32:05.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.384+0000 7fb5af7fe640 1 -- 172.21.15.5:0/289000337 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a40aab70 con 0x7fb5b015bde0 2023-07-14T13:32:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.388+0000 7fb5b6c93640 1 -- 172.21.15.5:0/289000337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b015bde0 msgr2=0x7fb5b00d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.388+0000 7fb5b6c93640 1 --2- 172.21.15.5:0/289000337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b015bde0 0x7fb5b00d0270 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4006fd0 tx=0x7fb5a401c520 comp rx=0 tx=0).stop 2023-07-14T13:32:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.388+0000 7fb5b6c93640 1 -- 172.21.15.5:0/289000337 shutdown_connections 2023-07-14T13:32:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.388+0000 7fb5b6c93640 1 --2- 172.21.15.5:0/289000337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5b00d2fc0 0x7fb5b00b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.388+0000 7fb5b6c93640 1 --2- 172.21.15.5:0/289000337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b015bde0 0x7fb5b00d0270 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.388+0000 7fb5b6c93640 1 -- 172.21.15.5:0/289000337 >> 172.21.15.5:0/289000337 conn(0x7fb5b00659d0 msgr2=0x7fb5b009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:05.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.388+0000 7fb5b6c93640 1 -- 172.21.15.5:0/289000337 shutdown_connections 2023-07-14T13:32:05.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.388+0000 7fb5b6c93640 1 -- 172.21.15.5:0/289000337 wait complete. 2023-07-14T13:32:05.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.388+0000 7fb5b6c93640 1 Processor -- start 2023-07-14T13:32:05.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.388+0000 7fb5b6c93640 1 -- start start 2023-07-14T13:32:05.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.388+0000 7fb5b6c93640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b00d2300 0x7fb5b015cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:05.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.388+0000 7fb5b6c93640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5b00d2fc0 0x7fb5b01f7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:05.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.388+0000 7fb5b6c93640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5b015bde0 0x7fb5b00b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:05.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.388+0000 7fb5b6c93640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b015d600 con 0x7fb5b00d2300 2023-07-14T13:32:05.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.388+0000 7fb5b6c93640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b015d8e0 con 0x7fb5b015bde0 2023-07-14T13:32:05.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.388+0000 7fb5b6c93640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b015dbc0 con 0x7fb5b00d2fc0 2023-07-14T13:32:05.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.388+0000 7fb5b4a2f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b00d2300 0x7fb5b015cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:05.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.388+0000 7fb5b4a2f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b00d2300 0x7fb5b015cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44472/0 (socket says 172.21.15.5:44472) 2023-07-14T13:32:05.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.388+0000 7fb5b4a2f640 1 -- 172.21.15.5:0/4145693561 learned_addr learned my addr 172.21.15.5:0/4145693561 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:05.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.392+0000 7fb5affff640 1 --2- 172.21.15.5:0/4145693561 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5b00d2fc0 0x7fb5b01f7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:05.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.392+0000 7fb5b5230640 1 --2- 172.21.15.5:0/4145693561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5b015bde0 0x7fb5b00b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:05.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.392+0000 7fb5b4a2f640 1 -- 172.21.15.5:0/4145693561 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5b00d2fc0 msgr2=0x7fb5b01f7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:05.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.392+0000 7fb5b4a2f640 1 --2- 172.21.15.5:0/4145693561 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5b00d2fc0 0x7fb5b01f7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.392+0000 7fb5b4a2f640 1 -- 172.21.15.5:0/4145693561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5b015bde0 msgr2=0x7fb5b00b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:05.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.392+0000 7fb5b4a2f640 1 --2- 172.21.15.5:0/4145693561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5b015bde0 0x7fb5b00b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.392+0000 7fb5b4a2f640 1 -- 172.21.15.5:0/4145693561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a4009480 con 0x7fb5b00d2300 2023-07-14T13:32:05.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.392+0000 7fb5b4a2f640 1 --2- 172.21.15.5:0/4145693561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b00d2300 0x7fb5b015cd00 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fb5a401abd0 tx=0x7fb5a40192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:05.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.392+0000 7fb5ad7fa640 1 -- 172.21.15.5:0/4145693561 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a40aab50 con 0x7fb5b00d2300 2023-07-14T13:32:05.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.392+0000 7fb5ad7fa640 1 -- 172.21.15.5:0/4145693561 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a40aacb0 con 0x7fb5b00d2300 2023-07-14T13:32:05.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.392+0000 7fb5ad7fa640 1 -- 172.21.15.5:0/4145693561 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4003860 con 0x7fb5b00d2300 2023-07-14T13:32:05.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.392+0000 7fb5b6c93640 1 -- 172.21.15.5:0/4145693561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b015dea0 con 0x7fb5b00d2300 2023-07-14T13:32:05.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.392+0000 7fb5b6c93640 1 -- 172.21.15.5:0/4145693561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b015d240 con 0x7fb5b00d2300 2023-07-14T13:32:05.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.392+0000 7fb5b6c93640 1 -- 172.21.15.5:0/4145693561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b00678d0 con 0x7fb5b00d2300 2023-07-14T13:32:05.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.392+0000 7fb5ad7fa640 1 -- 172.21.15.5:0/4145693561 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 92) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fb5a4003bd0 con 0x7fb5b00d2300 2023-07-14T13:32:05.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.396+0000 7fb5ad7fa640 1 --2- 172.21.15.5:0/4145693561 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7fb5940663d0 0x7fb594068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:05.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.396+0000 7fb5ad7fa640 1 -- 172.21.15.5:0/4145693561 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6492+0+0 (secure 0 0 0) 0x7fb5a411eee0 con 0x7fb5b00d2300 2023-07-14T13:32:05.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.396+0000 7fb5affff640 1 -- 172.21.15.5:0/4145693561 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7fb5940663d0 msgr2=0x7fb594068880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3169896898 2023-07-14T13:32:05.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.396+0000 7fb5affff640 1 --2- 172.21.15.5:0/4145693561 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7fb5940663d0 0x7fb594068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:32:05.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.400+0000 7fb5ad7fa640 1 -- 172.21.15.5:0/4145693561 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb5a40ec1b0 con 0x7fb5b00d2300 2023-07-14T13:32:05.515 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:05.516+0000 7fd2e6445180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:32:05.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.556+0000 7fb5b6c93640 1 -- 172.21.15.5:0/4145693561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb5b00b7ad0 con 0x7fb5b00d2300 2023-07-14T13:32:05.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.556+0000 7fb5ad7fa640 1 -- 172.21.15.5:0/4145693561 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v175) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb5a40c3020 con 0x7fb5b00d2300 2023-07-14T13:32:05.558 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:32:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.556+0000 7fb5b6c93640 1 -- 172.21.15.5:0/4145693561 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7fb5940663d0 msgr2=0x7fb594068880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:32:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.556+0000 7fb5b6c93640 1 --2- 172.21.15.5:0/4145693561 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7fb5940663d0 0x7fb594068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.556+0000 7fb5b6c93640 1 -- 172.21.15.5:0/4145693561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b00d2300 msgr2=0x7fb5b015cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.556+0000 7fb5b6c93640 1 --2- 172.21.15.5:0/4145693561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b00d2300 0x7fb5b015cd00 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fb5a401abd0 tx=0x7fb5a40192c0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.556+0000 7fb5b6c93640 1 -- 172.21.15.5:0/4145693561 shutdown_connections 2023-07-14T13:32:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.556+0000 7fb5b6c93640 1 --2- 172.21.15.5:0/4145693561 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7fb5940663d0 0x7fb594068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.556+0000 7fb5b6c93640 1 --2- 172.21.15.5:0/4145693561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5b015bde0 0x7fb5b00b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.556+0000 7fb5b6c93640 1 --2- 172.21.15.5:0/4145693561 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5b00d2fc0 0x7fb5b01f7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.556+0000 7fb5b6c93640 1 --2- 172.21.15.5:0/4145693561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b00d2300 0x7fb5b015cd00 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.556+0000 7fb5b6c93640 1 -- 172.21.15.5:0/4145693561 >> 172.21.15.5:0/4145693561 conn(0x7fb5b00659d0 msgr2=0x7fb5b00ceff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.560+0000 7fb5b6c93640 1 -- 172.21.15.5:0/4145693561 shutdown_connections 2023-07-14T13:32:05.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.560+0000 7fb5b6c93640 1 -- 172.21.15.5:0/4145693561 wait complete. 2023-07-14T13:32:05.573 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:05.572+0000 7fd2e6445180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:32:05.580 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T13:32:05.611 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:05.608+0000 7f2614592180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:32:05.630 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:05.632+0000 7fd2e6445180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:32:05.674 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:05.672+0000 7f2614592180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:32:05.715 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:05.716+0000 7fd2e6445180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:32:05.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.728+0000 7f19055db640 1 Processor -- start 2023-07-14T13:32:05.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.728+0000 7f19055db640 1 -- start start 2023-07-14T13:32:05.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.728+0000 7f19055db640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f19000d2fc0 0x7f19000b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:05.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.728+0000 7f19055db640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19000b04c0 con 0x7f190015bde0 2023-07-14T13:32:05.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.728+0000 7f19055db640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19000d0aa0 con 0x7f19000d2300 2023-07-14T13:32:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.728+0000 7f19055db640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f190015c1b0 con 0x7f19000d2fc0 2023-07-14T13:32:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.728+0000 7f18fe7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f19000d2fc0 0x7f19000b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:05.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.728+0000 7f18feffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f190015bde0 0x7f19000d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50922/0 (socket says 172.21.15.5:50922) 2023-07-14T13:32:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.728+0000 7f18feffd640 1 -- 172.21.15.5:0/913088688 learned_addr learned my addr 172.21.15.5:0/913088688 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.728+0000 7f18fe7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f19000d2fc0 0x7f19000b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44486/0 (socket says 172.21.15.5:44486) 2023-07-14T13:32:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.728+0000 7f18fe7fc640 1 -- 172.21.15.5:0/913088688 >> v1:172.21.15.154:6789/0 conn(0x7f19000d2300 legacy=0x7f19000cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.728+0000 7f18fe7fc640 1 -- 172.21.15.5:0/913088688 >> v1:172.21.15.5:6789/0 conn(0x7f190015bde0 legacy=0x7f19000d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:05.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.728+0000 7f18fe7fc640 1 -- 172.21.15.5:0/913088688 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19000afb90 con 0x7f19000d2fc0 2023-07-14T13:32:05.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.728+0000 7f18fdffb640 1 -- 172.21.15.5:0/913088688 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3309045667 0 0) 0x7f19000b04c0 con 0x7f190015bde0 2023-07-14T13:32:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.732+0000 7f18fe7fc640 1 --2- 172.21.15.5:0/913088688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19000d2fc0 0x7f19000b0950 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f18f40097c0 tx=0x7f18f401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709869878a109368 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.732+0000 7f18fdffb640 1 -- 172.21.15.5:0/913088688 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f40ab680 con 0x7f19000d2fc0 2023-07-14T13:32:05.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.732+0000 7f18fdffb640 1 -- 172.21.15.5:0/913088688 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f40ab7e0 con 0x7f19000d2fc0 2023-07-14T13:32:05.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.732+0000 7f18fdffb640 1 -- 172.21.15.5:0/913088688 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f40abb70 con 0x7f19000d2fc0 2023-07-14T13:32:05.735 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:05.732+0000 7f2614592180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:32:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.732+0000 7f19055db640 1 -- 172.21.15.5:0/913088688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19000d2fc0 msgr2=0x7f19000b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.732+0000 7f19055db640 1 --2- 172.21.15.5:0/913088688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19000d2fc0 0x7f19000b0950 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f18f40097c0 tx=0x7f18f401c480 comp rx=0 tx=0).stop 2023-07-14T13:32:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.732+0000 7f19055db640 1 -- 172.21.15.5:0/913088688 shutdown_connections 2023-07-14T13:32:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.732+0000 7f19055db640 1 --2- 172.21.15.5:0/913088688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19000d2fc0 0x7f19000b0950 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.732+0000 7f19055db640 1 -- 172.21.15.5:0/913088688 >> 172.21.15.5:0/913088688 conn(0x7f19000659d0 msgr2=0x7f190009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:05.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.732+0000 7f19055db640 1 -- 172.21.15.5:0/913088688 shutdown_connections 2023-07-14T13:32:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.732+0000 7f19055db640 1 -- 172.21.15.5:0/913088688 wait complete. 2023-07-14T13:32:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.736+0000 7f19055db640 1 Processor -- start 2023-07-14T13:32:05.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.736+0000 7f19055db640 1 -- start start 2023-07-14T13:32:05.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.736+0000 7f19055db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19000d2300 0x7f19000cd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:05.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.736+0000 7f19055db640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19000d2fc0 0x7f190015e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:05.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.736+0000 7f19055db640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f190015bde0 0x7f190015d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:05.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.736+0000 7f19055db640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19000c7d50 con 0x7f19000d2300 2023-07-14T13:32:05.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.736+0000 7f19055db640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19000c8030 con 0x7f190015bde0 2023-07-14T13:32:05.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.736+0000 7f19055db640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19000c8310 con 0x7f19000d2fc0 2023-07-14T13:32:05.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.736+0000 7f18feffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19000d2300 0x7f19000cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:05.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.736+0000 7f18feffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19000d2300 0x7f19000cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44502/0 (socket says 172.21.15.5:44502) 2023-07-14T13:32:05.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.736+0000 7f18feffd640 1 -- 172.21.15.5:0/1621883243 learned_addr learned my addr 172.21.15.5:0/1621883243 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:05.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.736+0000 7f18fe7fc640 1 --2- 172.21.15.5:0/1621883243 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19000d2fc0 0x7f190015e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:05.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.736+0000 7f18ff7fe640 1 --2- 172.21.15.5:0/1621883243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f190015bde0 0x7f190015d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:05.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.736+0000 7f18feffd640 1 -- 172.21.15.5:0/1621883243 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19000d2fc0 msgr2=0x7f190015e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:05.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.736+0000 7f18feffd640 1 --2- 172.21.15.5:0/1621883243 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19000d2fc0 0x7f190015e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.736+0000 7f18feffd640 1 -- 172.21.15.5:0/1621883243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f190015bde0 msgr2=0x7f190015d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:05.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.736+0000 7f18feffd640 1 --2- 172.21.15.5:0/1621883243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f190015bde0 0x7f190015d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.736+0000 7f18feffd640 1 -- 172.21.15.5:0/1621883243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f4009420 con 0x7f19000d2300 2023-07-14T13:32:05.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.736+0000 7f18feffd640 1 --2- 172.21.15.5:0/1621883243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19000d2300 0x7f19000cd740 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f18f000c730 tx=0x7f18f000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:05.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.736+0000 7f18e77fe640 1 -- 172.21.15.5:0/1621883243 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f0007270 con 0x7f19000d2300 2023-07-14T13:32:05.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.736+0000 7f18e77fe640 1 -- 172.21.15.5:0/1621883243 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f00073f0 con 0x7f19000d2300 2023-07-14T13:32:05.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.736+0000 7f19055db640 1 -- 172.21.15.5:0/1621883243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19000c85f0 con 0x7f19000d2300 2023-07-14T13:32:05.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.736+0000 7f18e77fe640 1 -- 172.21.15.5:0/1621883243 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f0001d10 con 0x7f19000d2300 2023-07-14T13:32:05.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.736+0000 7f19055db640 1 -- 172.21.15.5:0/1621883243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19000c7950 con 0x7f19000d2300 2023-07-14T13:32:05.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.740+0000 7f19055db640 1 -- 172.21.15.5:0/1621883243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19000678d0 con 0x7f19000d2300 2023-07-14T13:32:05.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.740+0000 7f18e77fe640 1 -- 172.21.15.5:0/1621883243 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 92) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f18f00057b0 con 0x7f19000d2300 2023-07-14T13:32:05.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.740+0000 7f18e77fe640 1 --2- 172.21.15.5:0/1621883243 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f18ec0663a0 0x7f18ec068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:05.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.740+0000 7f18e77fe640 1 -- 172.21.15.5:0/1621883243 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6492+0+0 (secure 0 0 0) 0x7f18f0083a20 con 0x7f19000d2300 2023-07-14T13:32:05.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.740+0000 7f18fe7fc640 1 -- 172.21.15.5:0/1621883243 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f18ec0663a0 msgr2=0x7f18ec068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3169896898 2023-07-14T13:32:05.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.740+0000 7f18fe7fc640 1 --2- 172.21.15.5:0/1621883243 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f18ec0663a0 0x7f18ec068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:32:05.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.744+0000 7f18e77fe640 1 -- 172.21.15.5:0/1621883243 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f18f0050c90 con 0x7f19000d2300 2023-07-14T13:32:05.773 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:05.772+0000 7fd2e6445180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:32:05.828 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:05.828+0000 7f2614592180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:32:05.857 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:05.856+0000 7fd2e6445180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:32:05.888 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:05.888+0000 7f2614592180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:32:05.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.904+0000 7f19055db640 1 -- 172.21.15.5:0/1621883243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f19001525a0 con 0x7f19000d2300 2023-07-14T13:32:05.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.904+0000 7f18e77fe640 1 -- 172.21.15.5:0/1621883243 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v175) v1 ==== 104+0+11 (secure 0 0 0) 0x7f18f00542b0 con 0x7f19000d2300 2023-07-14T13:32:05.906 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T13:32:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.904+0000 7f19055db640 1 -- 172.21.15.5:0/1621883243 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f18ec0663a0 msgr2=0x7f18ec068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:32:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.904+0000 7f19055db640 1 --2- 172.21.15.5:0/1621883243 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f18ec0663a0 0x7f18ec068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.904+0000 7f19055db640 1 -- 172.21.15.5:0/1621883243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19000d2300 msgr2=0x7f19000cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.904+0000 7f19055db640 1 --2- 172.21.15.5:0/1621883243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19000d2300 0x7f19000cd740 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f18f000c730 tx=0x7f18f000cbf0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.904+0000 7f19055db640 1 -- 172.21.15.5:0/1621883243 shutdown_connections 2023-07-14T13:32:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.904+0000 7f19055db640 1 --2- 172.21.15.5:0/1621883243 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f18ec0663a0 0x7f18ec068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.904+0000 7f19055db640 1 --2- 172.21.15.5:0/1621883243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f190015bde0 0x7f190015d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.904+0000 7f19055db640 1 --2- 172.21.15.5:0/1621883243 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19000d2fc0 0x7f190015e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.904+0000 7f19055db640 1 --2- 172.21.15.5:0/1621883243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19000d2300 0x7f19000cd740 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.904+0000 7f19055db640 1 -- 172.21.15.5:0/1621883243 >> 172.21.15.5:0/1621883243 conn(0x7f19000659d0 msgr2=0x7f19000aefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.904+0000 7f19055db640 1 -- 172.21.15.5:0/1621883243 shutdown_connections 2023-07-14T13:32:05.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:05.904+0000 7f19055db640 1 -- 172.21.15.5:0/1621883243 wait complete. 2023-07-14T13:32:05.913 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:05.912+0000 7fd2e6445180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:32:05.928 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T13:32:05.978 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:05.976+0000 7f2614592180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:32:06.039 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:06.036+0000 7f2614592180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:32:06.054 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:06.056+0000 7fd2e6445180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:32:06.111 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:06.112+0000 7fd2e6445180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:32:06.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.116+0000 7f5eb18f9640 1 Processor -- start 2023-07-14T13:32:06.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.116+0000 7f5eb18f9640 1 -- start start 2023-07-14T13:32:06.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.120+0000 7f5eb18f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eac15cef0 0x7f5eac158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:06.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.120+0000 7f5eb18f9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5eac159270 0x7f5eac0c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:06.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.120+0000 7f5eb18f9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eac1532b0 con 0x7f5eac0aeb40 2023-07-14T13:32:06.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.120+0000 7f5eb18f9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eac15d360 con 0x7f5eac159270 2023-07-14T13:32:06.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.120+0000 7f5eb18f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac0ca6f0 con 0x7f5eac15cef0 2023-07-14T13:32:06.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.120+0000 7f5eab7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5eac159270 0x7f5eac0c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:06.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.120+0000 7f5eab7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5eac159270 0x7f5eac0c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44512/0 (socket says 172.21.15.5:44512) 2023-07-14T13:32:06.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.120+0000 7f5eab7fe640 1 -- 172.21.15.5:0/107841922 learned_addr learned my addr 172.21.15.5:0/107841922 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:06.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.120+0000 7f5eaaffd640 1 --1- 172.21.15.5:0/107841922 >> v1:172.21.15.5:6789/0 conn(0x7f5eac0aeb40 0x7f5eac0aef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50928/0 (socket says 172.21.15.5:50928) 2023-07-14T13:32:06.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.120+0000 7f5ea3fff640 1 --2- 172.21.15.5:0/107841922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eac15cef0 0x7f5eac158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:06.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.120+0000 7f5eab7fe640 1 -- 172.21.15.5:0/107841922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eac15cef0 msgr2=0x7f5eac158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:06.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.120+0000 7f5eab7fe640 1 --2- 172.21.15.5:0/107841922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eac15cef0 0x7f5eac158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:06.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.120+0000 7f5eab7fe640 1 -- 172.21.15.5:0/107841922 >> v1:172.21.15.5:6789/0 conn(0x7f5eac0aeb40 legacy=0x7f5eac0aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:06.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.120+0000 7f5eab7fe640 1 -- 172.21.15.5:0/107841922 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eac1599d0 con 0x7f5eac159270 2023-07-14T13:32:06.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.124+0000 7f5eab7fe640 1 --2- 172.21.15.5:0/107841922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5eac159270 0x7f5eac0c88c0 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4009e50 tx=0x7f5ea401ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3186f42a63f2f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:06.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.124+0000 7f5eaa7fc640 1 -- 172.21.15.5:0/107841922 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea40a7ac0 con 0x7f5eac159270 2023-07-14T13:32:06.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.124+0000 7f5eaa7fc640 1 -- 172.21.15.5:0/107841922 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea40a7c20 con 0x7f5eac159270 2023-07-14T13:32:06.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.124+0000 7f5eaa7fc640 1 -- 172.21.15.5:0/107841922 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea40af3f0 con 0x7f5eac159270 2023-07-14T13:32:06.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.124+0000 7f5eb18f9640 1 -- 172.21.15.5:0/107841922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5eac159270 msgr2=0x7f5eac0c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:06.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.124+0000 7f5eb18f9640 1 --2- 172.21.15.5:0/107841922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5eac159270 0x7f5eac0c88c0 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4009e50 tx=0x7f5ea401ebf0 comp rx=0 tx=0).stop 2023-07-14T13:32:06.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.124+0000 7f5eb18f9640 1 -- 172.21.15.5:0/107841922 shutdown_connections 2023-07-14T13:32:06.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.124+0000 7f5eb18f9640 1 --2- 172.21.15.5:0/107841922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5eac159270 0x7f5eac0c88c0 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:06.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.124+0000 7f5eb18f9640 1 --2- 172.21.15.5:0/107841922 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eac15cef0 0x7f5eac158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:06.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.124+0000 7f5eb18f9640 1 -- 172.21.15.5:0/107841922 >> 172.21.15.5:0/107841922 conn(0x7f5eac0cde90 msgr2=0x7f5eac0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:06.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.124+0000 7f5eb18f9640 1 -- 172.21.15.5:0/107841922 shutdown_connections 2023-07-14T13:32:06.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.124+0000 7f5eb18f9640 1 -- 172.21.15.5:0/107841922 wait complete. 2023-07-14T13:32:06.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.124+0000 7f5eb18f9640 1 Processor -- start 2023-07-14T13:32:06.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.124+0000 7f5eb18f9640 1 -- start start 2023-07-14T13:32:06.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.128+0000 7f5eb18f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5eac0aeb40 0x7f5eac14d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:06.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.128+0000 7f5eb18f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eac159270 0x7f5eac155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:06.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.128+0000 7f5eb18f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eac15cef0 0x7f5eac1579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:06.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.128+0000 7f5eb18f9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac0b35a0 con 0x7f5eac0aeb40 2023-07-14T13:32:06.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.128+0000 7f5eb18f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac0b3880 con 0x7f5eac159270 2023-07-14T13:32:06.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.128+0000 7f5eb18f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac0b3b60 con 0x7f5eac15cef0 2023-07-14T13:32:06.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.128+0000 7f5eaaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5eac0aeb40 0x7f5eac14d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:06.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.128+0000 7f5eaaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5eac0aeb40 0x7f5eac14d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44526/0 (socket says 172.21.15.5:44526) 2023-07-14T13:32:06.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.128+0000 7f5eaaffd640 1 -- 172.21.15.5:0/3856073527 learned_addr learned my addr 172.21.15.5:0/3856073527 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:06.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.128+0000 7f5eab7fe640 1 --2- 172.21.15.5:0/3856073527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eac15cef0 0x7f5eac1579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:06.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.128+0000 7f5ea3fff640 1 --2- 172.21.15.5:0/3856073527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eac159270 0x7f5eac155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:06.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.128+0000 7f5eaaffd640 1 -- 172.21.15.5:0/3856073527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eac15cef0 msgr2=0x7f5eac1579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:06.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.128+0000 7f5eaaffd640 1 --2- 172.21.15.5:0/3856073527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eac15cef0 0x7f5eac1579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.128+0000 7f5eaaffd640 1 -- 172.21.15.5:0/3856073527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eac159270 msgr2=0x7f5eac155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.128+0000 7f5eaaffd640 1 --2- 172.21.15.5:0/3856073527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eac159270 0x7f5eac155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.128+0000 7f5eaaffd640 1 -- 172.21.15.5:0/3856073527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea4009b30 con 0x7f5eac0aeb40 2023-07-14T13:32:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.128+0000 7f5ea3fff640 1 --2- 172.21.15.5:0/3856073527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eac159270 0x7f5eac155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.128+0000 7f5eaaffd640 1 --2- 172.21.15.5:0/3856073527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5eac0aeb40 0x7f5eac14d800 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c00c490 tx=0x7f5e9c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.128+0000 7f5ea8ff9640 1 -- 172.21.15.5:0/3856073527 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c007480 con 0x7f5eac0aeb40 2023-07-14T13:32:06.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.128+0000 7f5ea8ff9640 1 -- 172.21.15.5:0/3856073527 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9c0075e0 con 0x7f5eac0aeb40 2023-07-14T13:32:06.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.128+0000 7f5ea8ff9640 1 -- 172.21.15.5:0/3856073527 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c004a10 con 0x7f5eac0aeb40 2023-07-14T13:32:06.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.128+0000 7f5eb18f9640 1 -- 172.21.15.5:0/3856073527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eac153440 con 0x7f5eac0aeb40 2023-07-14T13:32:06.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.128+0000 7f5eb18f9640 1 -- 172.21.15.5:0/3856073527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eac153c40 con 0x7f5eac0aeb40 2023-07-14T13:32:06.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.128+0000 7f5eb18f9640 1 -- 172.21.15.5:0/3856073527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eac0678d0 con 0x7f5eac0aeb40 2023-07-14T13:32:06.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.132+0000 7f5ea8ff9640 1 -- 172.21.15.5:0/3856073527 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 92) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f5e9c004b70 con 0x7f5eac0aeb40 2023-07-14T13:32:06.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.132+0000 7f5ea8ff9640 1 --2- 172.21.15.5:0/3856073527 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f5e8c0663a0 0x7f5e8c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:06.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.132+0000 7f5ea8ff9640 1 -- 172.21.15.5:0/3856073527 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6492+0+0 (secure 0 0 0) 0x7f5e9c083100 con 0x7f5eac0aeb40 2023-07-14T13:32:06.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.132+0000 7f5ea3fff640 1 -- 172.21.15.5:0/3856073527 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f5e8c0663a0 msgr2=0x7f5e8c068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3169896898 2023-07-14T13:32:06.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.132+0000 7f5ea3fff640 1 --2- 172.21.15.5:0/3856073527 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f5e8c0663a0 0x7f5e8c068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:32:06.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.136+0000 7f5ea8ff9640 1 -- 172.21.15.5:0/3856073527 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f5e9c050400 con 0x7f5eac0aeb40 2023-07-14T13:32:06.193 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:06.192+0000 7f2614592180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:32:06.255 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:06.252+0000 7f2614592180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:32:06.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.292+0000 7f5eb18f9640 1 -- 172.21.15.5:0/3856073527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5eac0c36a0 con 0x7f5eac0aeb40 2023-07-14T13:32:06.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.292+0000 7f5ea8ff9640 1 -- 172.21.15.5:0/3856073527 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v175) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5e9c053a20 con 0x7f5eac0aeb40 2023-07-14T13:32:06.294 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T13:32:06.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.292+0000 7f5eb18f9640 1 -- 172.21.15.5:0/3856073527 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f5e8c0663a0 msgr2=0x7f5e8c068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:32:06.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.292+0000 7f5eb18f9640 1 --2- 172.21.15.5:0/3856073527 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f5e8c0663a0 0x7f5e8c068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:06.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.292+0000 7f5eb18f9640 1 -- 172.21.15.5:0/3856073527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5eac0aeb40 msgr2=0x7f5eac14d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:06.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.292+0000 7f5eb18f9640 1 --2- 172.21.15.5:0/3856073527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5eac0aeb40 0x7f5eac14d800 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c00c490 tx=0x7f5e9c00c950 comp rx=0 tx=0).stop 2023-07-14T13:32:06.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.292+0000 7f5eb18f9640 1 -- 172.21.15.5:0/3856073527 shutdown_connections 2023-07-14T13:32:06.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.292+0000 7f5eb18f9640 1 --2- 172.21.15.5:0/3856073527 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f5e8c0663a0 0x7f5e8c068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:06.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.292+0000 7f5eb18f9640 1 --2- 172.21.15.5:0/3856073527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5eac15cef0 0x7f5eac1579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:06.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.292+0000 7f5eb18f9640 1 --2- 172.21.15.5:0/3856073527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eac159270 0x7f5eac155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:06.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.292+0000 7f5eb18f9640 1 --2- 172.21.15.5:0/3856073527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5eac0aeb40 0x7f5eac14d800 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:06.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.292+0000 7f5eb18f9640 1 -- 172.21.15.5:0/3856073527 >> 172.21.15.5:0/3856073527 conn(0x7f5eac0cde90 msgr2=0x7f5eac0ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:06.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.292+0000 7f5eb18f9640 1 -- 172.21.15.5:0/3856073527 shutdown_connections 2023-07-14T13:32:06.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.296+0000 7f5eb18f9640 1 -- 172.21.15.5:0/3856073527 wait complete. 2023-07-14T13:32:06.319 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T13:32:06.359 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:32:06.359 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:32:06.360 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:32:06.369 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:06.372+0000 7fd2e6445180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:32:06.503 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:06.504+0000 7fd2e6445180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:32:06.517 INFO:tasks.ceph.mgr.y.smithi005.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:32:06.518 INFO:tasks.ceph.mgr.y.smithi005.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:32:06.518 INFO:tasks.ceph.mgr.y.smithi005.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:32:06.526 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:06.524+0000 7f2614592180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:32:06.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.540+0000 7f86157e6640 1 Processor -- start 2023-07-14T13:32:06.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.540+0000 7f86157e6640 1 -- start start 2023-07-14T13:32:06.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.540+0000 7f86157e6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f861015f3f0 0x7f86100b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:06.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.540+0000 7f86157e6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86100b7bc0 0x7f86100cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:06.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.540+0000 7f86157e6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86100b8020 con 0x7f86100d13f0 2023-07-14T13:32:06.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.540+0000 7f86157e6640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86100d0f60 con 0x7f861015f3f0 2023-07-14T13:32:06.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.540+0000 7f86157e6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86100d0390 con 0x7f86100b7bc0 2023-07-14T13:32:06.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.540+0000 7f860ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f861015f3f0 0x7f86100b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.540+0000 7f860ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f861015f3f0 0x7f86100b7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44528/0 (socket says 172.21.15.5:44528) 2023-07-14T13:32:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.540+0000 7f860ffff640 1 -- 172.21.15.5:0/1158430229 learned_addr learned my addr 172.21.15.5:0/1158430229 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.540+0000 7f8614fe5640 1 --2- 172.21.15.5:0/1158430229 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86100b7bc0 0x7f86100cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.540+0000 7f860ffff640 1 -- 172.21.15.5:0/1158430229 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86100b7bc0 msgr2=0x7f86100cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:06.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.540+0000 7f860ffff640 1 --2- 172.21.15.5:0/1158430229 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86100b7bc0 0x7f86100cd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:06.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.540+0000 7f860ffff640 1 -- 172.21.15.5:0/1158430229 >> v1:172.21.15.154:6789/0 conn(0x7f86100d13f0 legacy=0x7f86100cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:06.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.540+0000 7f860ffff640 1 -- 172.21.15.5:0/1158430229 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86100d0630 con 0x7f861015f3f0 2023-07-14T13:32:06.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.540+0000 7f8614fe5640 1 --2- 172.21.15.5:0/1158430229 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86100b7bc0 0x7f86100cd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:06.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.544+0000 7f860ffff640 1 --2- 172.21.15.5:0/1158430229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f861015f3f0 0x7f86100b7680 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f8600009870 tx=0x7f860001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc878d9cdca914f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:06.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.544+0000 7f860effd640 1 -- 172.21.15.5:0/1158430229 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000ac600 con 0x7f861015f3f0 2023-07-14T13:32:06.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.544+0000 7f860effd640 1 -- 172.21.15.5:0/1158430229 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86000a8050 con 0x7f861015f3f0 2023-07-14T13:32:06.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.544+0000 7f860effd640 1 -- 172.21.15.5:0/1158430229 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000ac980 con 0x7f861015f3f0 2023-07-14T13:32:06.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.544+0000 7f86157e6640 1 -- 172.21.15.5:0/1158430229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f861015f3f0 msgr2=0x7f86100b7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:06.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.544+0000 7f86157e6640 1 --2- 172.21.15.5:0/1158430229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f861015f3f0 0x7f86100b7680 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f8600009870 tx=0x7f860001c4b0 comp rx=0 tx=0).stop 2023-07-14T13:32:06.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.544+0000 7f86157e6640 1 -- 172.21.15.5:0/1158430229 shutdown_connections 2023-07-14T13:32:06.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.544+0000 7f86157e6640 1 --2- 172.21.15.5:0/1158430229 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86100b7bc0 0x7f86100cd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:06.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.544+0000 7f86157e6640 1 --2- 172.21.15.5:0/1158430229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f861015f3f0 0x7f86100b7680 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:06.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.544+0000 7f86157e6640 1 -- 172.21.15.5:0/1158430229 >> 172.21.15.5:0/1158430229 conn(0x7f8610069f50 msgr2=0x7f861006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:06.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.544+0000 7f86157e6640 1 -- 172.21.15.5:0/1158430229 shutdown_connections 2023-07-14T13:32:06.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.544+0000 7f86157e6640 1 -- 172.21.15.5:0/1158430229 wait complete. 2023-07-14T13:32:06.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.548+0000 7f86157e6640 1 Processor -- start 2023-07-14T13:32:06.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.548+0000 7f86157e6640 1 -- start start 2023-07-14T13:32:06.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.548+0000 7f86157e6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86100b7bc0 0x7f861015e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:06.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.548+0000 7f86157e6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86100d13f0 0x7f86101f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:06.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.548+0000 7f86157e6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f861015f3f0 0x7f86100c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:06.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.548+0000 7f86157e6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86100b2280 con 0x7f86100d13f0 2023-07-14T13:32:06.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.548+0000 7f86157e6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861015eba0 con 0x7f86100b7bc0 2023-07-14T13:32:06.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.548+0000 7f86157e6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86101f85a0 con 0x7f861015f3f0 2023-07-14T13:32:06.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.548+0000 7f860f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86100d13f0 0x7f86101f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:06.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.548+0000 7f860ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86100b7bc0 0x7f861015e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:06.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.548+0000 7f860ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86100b7bc0 0x7f861015e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:45982/0 (socket says 172.21.15.5:45982) 2023-07-14T13:32:06.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.548+0000 7f860ffff640 1 -- 172.21.15.5:0/4107707757 learned_addr learned my addr 172.21.15.5:0/4107707757 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:06.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.548+0000 7f8614fe5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f861015f3f0 0x7f86100c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:06.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.548+0000 7f860ffff640 1 -- 172.21.15.5:0/4107707757 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f861015f3f0 msgr2=0x7f86100c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:06.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.548+0000 7f860ffff640 1 --2- 172.21.15.5:0/4107707757 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f861015f3f0 0x7f86100c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:06.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.548+0000 7f860ffff640 1 -- 172.21.15.5:0/4107707757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86100d13f0 msgr2=0x7f86101f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:06.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.548+0000 7f860ffff640 1 --2- 172.21.15.5:0/4107707757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86100d13f0 0x7f86101f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:06.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.548+0000 7f860ffff640 1 -- 172.21.15.5:0/4107707757 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86000094d0 con 0x7f86100b7bc0 2023-07-14T13:32:06.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.548+0000 7f860f7fe640 1 --2- 172.21.15.5:0/4107707757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86100d13f0 0x7f86101f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:32:06.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.548+0000 7f860ffff640 1 --2- 172.21.15.5:0/4107707757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86100b7bc0 0x7f861015e660 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f860001ab60 tx=0x7f860001acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:06.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.548+0000 7f860cff9640 1 -- 172.21.15.5:0/4107707757 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000b7620 con 0x7f86100b7bc0 2023-07-14T13:32:06.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.548+0000 7f860cff9640 1 -- 172.21.15.5:0/4107707757 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86000ace90 con 0x7f86100b7bc0 2023-07-14T13:32:06.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.548+0000 7f860cff9640 1 -- 172.21.15.5:0/4107707757 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000b79c0 con 0x7f86100b7bc0 2023-07-14T13:32:06.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.548+0000 7f86157e6640 1 -- 172.21.15.5:0/4107707757 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86100b1a20 con 0x7f86100b7bc0 2023-07-14T13:32:06.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.552+0000 7f86157e6640 1 -- 172.21.15.5:0/4107707757 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86100b1cc0 con 0x7f86100b7bc0 2023-07-14T13:32:06.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.552+0000 7f86157e6640 1 -- 172.21.15.5:0/4107707757 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86100678d0 con 0x7f86100b7bc0 2023-07-14T13:32:06.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.552+0000 7f860cff9640 1 -- 172.21.15.5:0/4107707757 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 92) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f86000b3040 con 0x7f86100b7bc0 2023-07-14T13:32:06.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.552+0000 7f860cff9640 1 --2- 172.21.15.5:0/4107707757 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f85fc0663a0 0x7f85fc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:06.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.552+0000 7f860cff9640 1 -- 172.21.15.5:0/4107707757 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6580+0+0 (secure 0 0 0) 0x7f860011e860 con 0x7f86100b7bc0 2023-07-14T13:32:06.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.552+0000 7f860f7fe640 1 -- 172.21.15.5:0/4107707757 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f85fc0663a0 msgr2=0x7f85fc068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3169896898 2023-07-14T13:32:06.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.552+0000 7f860f7fe640 1 --2- 172.21.15.5:0/4107707757 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f85fc0663a0 0x7f85fc068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:32:06.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.556+0000 7f860cff9640 1 -- 172.21.15.5:0/4107707757 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f86000eb940 con 0x7f86100b7bc0 2023-07-14T13:32:06.637 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:06.636+0000 7fd2e6445180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:32:06.678 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:06.676+0000 7f2614592180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:32:06.707 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:06.708+0000 7fd2e6445180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:32:06.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.732+0000 7f86157e6640 1 -- 172.21.15.5:0/4107707757 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8610158480 con 0x7f86100b7bc0 2023-07-14T13:32:06.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.732+0000 7f860cff9640 1 -- 172.21.15.5:0/4107707757 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v176) v1 ==== 80+0+478 (secure 0 0 0) 0x7f86000eef60 con 0x7f86100b7bc0 2023-07-14T13:32:06.734 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:6833/1905284593 2023-07-15T13:30:02.960482+0000 2023-07-14T13:32:06.735 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:6832/1905284593 2023-07-15T13:30:02.960482+0000 2023-07-14T13:32:06.735 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/3194204879 2023-07-15T13:30:02.960482+0000 2023-07-14T13:32:06.735 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/3861552987 2023-07-15T13:30:02.960482+0000 2023-07-14T13:32:06.735 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/2010542927 2023-07-15T13:30:02.960482+0000 2023-07-14T13:32:06.736 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/1225132039 2023-07-15T13:30:02.960482+0000 2023-07-14T13:32:06.736 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/2876445445 2023-07-15T13:30:02.960482+0000 2023-07-14T13:32:06.736 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/1648465409 2023-07-15T13:30:02.960482+0000 2023-07-14T13:32:06.738 INFO:teuthology.orchestra.run.smithi005.stderr:listed 8 entries 2023-07-14T13:32:06.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.736+0000 7f86157e6640 1 -- 172.21.15.5:0/4107707757 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f85fc0663a0 msgr2=0x7f85fc068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:32:06.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.736+0000 7f86157e6640 1 --2- 172.21.15.5:0/4107707757 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f85fc0663a0 0x7f85fc068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:06.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.736+0000 7f86157e6640 1 -- 172.21.15.5:0/4107707757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86100b7bc0 msgr2=0x7f861015e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:06.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.736+0000 7f86157e6640 1 --2- 172.21.15.5:0/4107707757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86100b7bc0 0x7f861015e660 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f860001ab60 tx=0x7f860001acf0 comp rx=0 tx=0).stop 2023-07-14T13:32:06.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.736+0000 7f86157e6640 1 -- 172.21.15.5:0/4107707757 shutdown_connections 2023-07-14T13:32:06.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.736+0000 7f86157e6640 1 --2- 172.21.15.5:0/4107707757 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f85fc0663a0 0x7f85fc068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:06.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.736+0000 7f86157e6640 1 --2- 172.21.15.5:0/4107707757 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f861015f3f0 0x7f86100c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:06.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.736+0000 7f86157e6640 1 --2- 172.21.15.5:0/4107707757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86100d13f0 0x7f86101f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:06.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.736+0000 7f86157e6640 1 --2- 172.21.15.5:0/4107707757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86100b7bc0 0x7f861015e660 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:06.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.736+0000 7f86157e6640 1 -- 172.21.15.5:0/4107707757 >> 172.21.15.5:0/4107707757 conn(0x7f8610069f50 msgr2=0x7f86100b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:06.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.736+0000 7f86157e6640 1 -- 172.21.15.5:0/4107707757 shutdown_connections 2023-07-14T13:32:06.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:06.736+0000 7f86157e6640 1 -- 172.21.15.5:0/4107707757 wait complete. 2023-07-14T13:32:06.766 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-14T13:32:06.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:06.768 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-14T13:32:06.823 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:06.820+0000 7f2614592180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:32:06.828 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-07-14T13:32:06.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:06.829 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-14T13:32:06.839 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:32:06.839 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:32:06.843 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:06.844+0000 7fd2e6445180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:32:06.848 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:32:06.848 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:32:06.849 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:32:06.888 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:32:06.889 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:32:06.889 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:32:06.898 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:32:06.898 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:32:06.899 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:06.896+0000 7f2614592180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:32:07.042 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:07.040+0000 7f2614592180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:32:07.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.040+0000 7fd5dc9c5640 1 Processor -- start 2023-07-14T13:32:07.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.044+0000 7fd5dc9c5640 1 -- start start 2023-07-14T13:32:07.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.044+0000 7fd5dc9c5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5d80b7c70 0x7fd5d80d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:07.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.044+0000 7fd5dc9c5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd5d80d1850 0x7fd5d815f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:07.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.044+0000 7fd5dc9c5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d80d1300 0x7fd5d815fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:07.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.044+0000 7fd5dc9c5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d80d1190 con 0x7fd5d80b7c70 2023-07-14T13:32:07.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.044+0000 7fd5dc9c5640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d8160600 con 0x7fd5d80d1850 2023-07-14T13:32:07.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.044+0000 7fd5dc9c5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d81600d0 con 0x7fd5d80d1300 2023-07-14T13:32:07.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.044+0000 7fd5d659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5d80b7c70 0x7fd5d80d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:07.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.044+0000 7fd5d659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5d80b7c70 0x7fd5d80d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44552/0 (socket says 172.21.15.5:44552) 2023-07-14T13:32:07.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.044+0000 7fd5d659c640 1 -- 172.21.15.5:0/3228982343 learned_addr learned my addr 172.21.15.5:0/3228982343 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:07.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.044+0000 7fd5d6d9d640 1 --2- 172.21.15.5:0/3228982343 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d80d1300 0x7fd5d815fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:07.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.044+0000 7fd5d5d9b640 1 --2- 172.21.15.5:0/3228982343 >> v2:172.21.15.154:3300/0 conn(0x7fd5d80d1850 0x7fd5d815f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:07.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.044+0000 7fd5d659c640 1 -- 172.21.15.5:0/3228982343 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d80d1300 msgr2=0x7fd5d815fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.044+0000 7fd5d659c640 1 --2- 172.21.15.5:0/3228982343 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d80d1300 0x7fd5d815fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.044+0000 7fd5d659c640 1 -- 172.21.15.5:0/3228982343 >> v2:172.21.15.154:3300/0 conn(0x7fd5d80d1850 msgr2=0x7fd5d815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.044+0000 7fd5d659c640 1 --2- 172.21.15.5:0/3228982343 >> v2:172.21.15.154:3300/0 conn(0x7fd5d80d1850 0x7fd5d815f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.044+0000 7fd5d659c640 1 -- 172.21.15.5:0/3228982343 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d80ccaf0 con 0x7fd5d80b7c70 2023-07-14T13:32:07.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.044+0000 7fd5d6d9d640 1 --2- 172.21.15.5:0/3228982343 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d80d1300 0x7fd5d815fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:07.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.048+0000 7fd5d659c640 1 --2- 172.21.15.5:0/3228982343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5d80b7c70 0x7fd5d80d0c50 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7fd5d80b1180 tx=0x7fd5c801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f1911e9318529e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:07.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.048+0000 7fd5d559a640 1 -- 172.21.15.5:0/3228982343 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c80ac600 con 0x7fd5d80b7c70 2023-07-14T13:32:07.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.048+0000 7fd5d559a640 1 -- 172.21.15.5:0/3228982343 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c80a8050 con 0x7fd5d80b7c70 2023-07-14T13:32:07.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.048+0000 7fd5d559a640 1 -- 172.21.15.5:0/3228982343 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c80ac980 con 0x7fd5d80b7c70 2023-07-14T13:32:07.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.048+0000 7fd5dc9c5640 1 -- 172.21.15.5:0/3228982343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5d80b7c70 msgr2=0x7fd5d80d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:07.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.048+0000 7fd5dc9c5640 1 --2- 172.21.15.5:0/3228982343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5d80b7c70 0x7fd5d80d0c50 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7fd5d80b1180 tx=0x7fd5c801c4d0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.048+0000 7fd5dc9c5640 1 -- 172.21.15.5:0/3228982343 shutdown_connections 2023-07-14T13:32:07.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.048+0000 7fd5dc9c5640 1 --2- 172.21.15.5:0/3228982343 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d80d1300 0x7fd5d815fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.048+0000 7fd5dc9c5640 1 --2- 172.21.15.5:0/3228982343 >> v2:172.21.15.154:3300/0 conn(0x7fd5d80d1850 0x7fd5d815f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.048+0000 7fd5dc9c5640 1 --2- 172.21.15.5:0/3228982343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5d80b7c70 0x7fd5d80d0c50 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.048+0000 7fd5dc9c5640 1 -- 172.21.15.5:0/3228982343 >> 172.21.15.5:0/3228982343 conn(0x7fd5d80650b0 msgr2=0x7fd5d80654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:07.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.048+0000 7fd5dc9c5640 1 -- 172.21.15.5:0/3228982343 shutdown_connections 2023-07-14T13:32:07.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.048+0000 7fd5dc9c5640 1 -- 172.21.15.5:0/3228982343 wait complete. 2023-07-14T13:32:07.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.052+0000 7fd5dc9c5640 1 Processor -- start 2023-07-14T13:32:07.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.052+0000 7fd5dc9c5640 1 -- start start 2023-07-14T13:32:07.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.052+0000 7fd5dc9c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5d80b7c70 0x7fd5d80b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:07.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.052+0000 7fd5dc9c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d80d1300 0x7fd5d815d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:07.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.052+0000 7fd5dc9c5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d80d1850 0x7fd5d80b2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:07.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.052+0000 7fd5dc9c5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d815c190 con 0x7fd5d80b7c70 2023-07-14T13:32:07.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.052+0000 7fd5dc9c5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d815c470 con 0x7fd5d80d1300 2023-07-14T13:32:07.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.052+0000 7fd5dc9c5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d815c750 con 0x7fd5d80d1850 2023-07-14T13:32:07.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.052+0000 7fd5d659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5d80b7c70 0x7fd5d80b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:07.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.052+0000 7fd5d659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5d80b7c70 0x7fd5d80b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44558/0 (socket says 172.21.15.5:44558) 2023-07-14T13:32:07.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.052+0000 7fd5d659c640 1 -- 172.21.15.5:0/2958743547 learned_addr learned my addr 172.21.15.5:0/2958743547 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:07.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.052+0000 7fd5d5d9b640 1 --2- 172.21.15.5:0/2958743547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d80d1300 0x7fd5d815d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:07.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.052+0000 7fd5d6d9d640 1 --2- 172.21.15.5:0/2958743547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d80d1850 0x7fd5d80b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:07.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.052+0000 7fd5d659c640 1 -- 172.21.15.5:0/2958743547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d80d1850 msgr2=0x7fd5d80b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:07.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.052+0000 7fd5d659c640 1 --2- 172.21.15.5:0/2958743547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d80d1850 0x7fd5d80b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.052+0000 7fd5d659c640 1 -- 172.21.15.5:0/2958743547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d80d1300 msgr2=0x7fd5d815d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:07.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.052+0000 7fd5d659c640 1 --2- 172.21.15.5:0/2958743547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d80d1300 0x7fd5d815d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.052+0000 7fd5d659c640 1 -- 172.21.15.5:0/2958743547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c80094d0 con 0x7fd5d80b7c70 2023-07-14T13:32:07.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.052+0000 7fd5d5d9b640 1 --2- 172.21.15.5:0/2958743547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d80d1300 0x7fd5d815d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:32:07.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.052+0000 7fd5d659c640 1 --2- 172.21.15.5:0/2958743547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5d80b7c70 0x7fd5d80b31c0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7fd5c801ab80 tx=0x7fd5c801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:07.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.052+0000 7fd5c6ffd640 1 -- 172.21.15.5:0/2958743547 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c80bd070 con 0x7fd5d80b7c70 2023-07-14T13:32:07.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.052+0000 7fd5c6ffd640 1 -- 172.21.15.5:0/2958743547 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c80ace70 con 0x7fd5d80b7c70 2023-07-14T13:32:07.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.052+0000 7fd5c6ffd640 1 -- 172.21.15.5:0/2958743547 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c80b7620 con 0x7fd5d80b7c70 2023-07-14T13:32:07.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.052+0000 7fd5dc9c5640 1 -- 172.21.15.5:0/2958743547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d815ca30 con 0x7fd5d80b7c70 2023-07-14T13:32:07.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.052+0000 7fd5dc9c5640 1 -- 172.21.15.5:0/2958743547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d8158a80 con 0x7fd5d80b7c70 2023-07-14T13:32:07.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.056+0000 7fd5dc9c5640 1 -- 172.21.15.5:0/2958743547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d80678d0 con 0x7fd5d80b7c70 2023-07-14T13:32:07.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.056+0000 7fd5c6ffd640 1 -- 172.21.15.5:0/2958743547 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 92) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fd5c80b3040 con 0x7fd5d80b7c70 2023-07-14T13:32:07.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.056+0000 7fd5c6ffd640 1 --2- 172.21.15.5:0/2958743547 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7fd5b80663a0 0x7fd5b8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:07.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.056+0000 7fd5c6ffd640 1 -- 172.21.15.5:0/2958743547 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6580+0+0 (secure 0 0 0) 0x7fd5c811dc30 con 0x7fd5d80b7c70 2023-07-14T13:32:07.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.056+0000 7fd5d5d9b640 1 -- 172.21.15.5:0/2958743547 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7fd5b80663a0 msgr2=0x7fd5b8068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3169896898 2023-07-14T13:32:07.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.056+0000 7fd5d5d9b640 1 --2- 172.21.15.5:0/2958743547 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7fd5b80663a0 0x7fd5b8068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:32:07.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.060+0000 7fd5c6ffd640 1 -- 172.21.15.5:0/2958743547 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd5c80ead20 con 0x7fd5d80b7c70 2023-07-14T13:32:07.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.248+0000 7fd5dc9c5640 1 -- 172.21.15.5:0/2958743547 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5d8065480 con 0x7fd5d80b7c70 2023-07-14T13:32:07.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.252+0000 7fd5c6ffd640 1 -- 172.21.15.5:0/2958743547 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4710 (secure 0 0 0) 0x7fd5c811d020 con 0x7fd5d80b7c70 2023-07-14T13:32:07.253 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:07.253 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2329374117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2329374117},{"type":"v1","addr":"172.21.15.154:6835","nonce":2329374117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":9457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/811714286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":811714286},{"type":"v1","addr":"172.21.15.154:6837","nonce":811714286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":9954,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3020438262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3020438262},{"type":"v1","addr":"172.21.15.5:6833","nonce":3020438262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:29:45.555298+0000","modified":"2023-07-14T13:29:49.191310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9966":{"gid":9966,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/3098088945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3098088945},{"type":"v1","addr":"172.21.15.5:6835","nonce":3098088945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-14T13:32:07.253 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 83 2023-07-14T13:32:07.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.252+0000 7fd5dc9c5640 1 -- 172.21.15.5:0/2958743547 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7fd5b80663a0 msgr2=0x7fd5b8068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:32:07.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.252+0000 7fd5dc9c5640 1 --2- 172.21.15.5:0/2958743547 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7fd5b80663a0 0x7fd5b8068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.252+0000 7fd5dc9c5640 1 -- 172.21.15.5:0/2958743547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5d80b7c70 msgr2=0x7fd5d80b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:07.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.252+0000 7fd5dc9c5640 1 --2- 172.21.15.5:0/2958743547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5d80b7c70 0x7fd5d80b31c0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7fd5c801ab80 tx=0x7fd5c801ad10 comp rx=0 tx=0).stop 2023-07-14T13:32:07.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.252+0000 7fd5dc9c5640 1 -- 172.21.15.5:0/2958743547 shutdown_connections 2023-07-14T13:32:07.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.252+0000 7fd5dc9c5640 1 --2- 172.21.15.5:0/2958743547 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7fd5b80663a0 0x7fd5b8068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.252+0000 7fd5dc9c5640 1 --2- 172.21.15.5:0/2958743547 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd5d80d1850 0x7fd5d80b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.252+0000 7fd5dc9c5640 1 --2- 172.21.15.5:0/2958743547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5d80d1300 0x7fd5d815d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.252+0000 7fd5dc9c5640 1 --2- 172.21.15.5:0/2958743547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5d80b7c70 0x7fd5d80b31c0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.252+0000 7fd5dc9c5640 1 -- 172.21.15.5:0/2958743547 >> 172.21.15.5:0/2958743547 conn(0x7fd5d80650b0 msgr2=0x7fd5d8165d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:07.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.252+0000 7fd5dc9c5640 1 -- 172.21.15.5:0/2958743547 shutdown_connections 2023-07-14T13:32:07.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.252+0000 7fd5dc9c5640 1 -- 172.21.15.5:0/2958743547 wait complete. 2023-07-14T13:32:07.274 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:32:07.387 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:07.388+0000 7fd2e6445180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:32:07.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.424+0000 7f095e1d2640 1 Processor -- start 2023-07-14T13:32:07.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.424+0000 7f095e1d2640 1 -- start start 2023-07-14T13:32:07.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.424+0000 7f095e1d2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09580b7c70 0x7f09580d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:07.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.424+0000 7f095e1d2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f095815fd60 0x7f09580d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:07.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.424+0000 7f095e1d2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09580ccaf0 con 0x7f09580d1850 2023-07-14T13:32:07.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.424+0000 7f095e1d2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09580d1190 con 0x7f09580b7c70 2023-07-14T13:32:07.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.424+0000 7f095e1d2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0958160600 con 0x7f095815fd60 2023-07-14T13:32:07.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.424+0000 7f0956ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f09580d1850 0x7f095815f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50932/0 (socket says 172.21.15.5:50932) 2023-07-14T13:32:07.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.424+0000 7f0956ffd640 1 -- 172.21.15.5:0/532541434 learned_addr learned my addr 172.21.15.5:0/532541434 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:07.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.424+0000 7f09577fe640 1 --2- 172.21.15.5:0/532541434 >> v2:172.21.15.5:3300/0 conn(0x7f09580b7c70 0x7f09580d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:07.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.424+0000 7f0957fff640 1 --2- 172.21.15.5:0/532541434 >> v2:172.21.15.154:3300/0 conn(0x7f095815fd60 0x7f09580d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:07.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.424+0000 7f09567fc640 1 -- 172.21.15.5:0/532541434 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4137353148 0 0) 0x7f09580ccaf0 con 0x7f09580d1850 2023-07-14T13:32:07.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.424+0000 7f09567fc640 1 -- 172.21.15.5:0/532541434 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0940003530 con 0x7f09580d1850 2023-07-14T13:32:07.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.424+0000 7f09577fe640 1 -- 172.21.15.5:0/532541434 >> v2:172.21.15.154:3300/0 conn(0x7f095815fd60 msgr2=0x7f09580d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:07.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.424+0000 7f09577fe640 1 --2- 172.21.15.5:0/532541434 >> v2:172.21.15.154:3300/0 conn(0x7f095815fd60 0x7f09580d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.424+0000 7f09577fe640 1 -- 172.21.15.5:0/532541434 >> v1:172.21.15.5:6789/0 conn(0x7f09580d1850 legacy=0x7f095815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:07.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.424+0000 7f09577fe640 1 -- 172.21.15.5:0/532541434 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0958160320 con 0x7f09580b7c70 2023-07-14T13:32:07.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.424+0000 7f0957fff640 1 --2- 172.21.15.5:0/532541434 >> v2:172.21.15.154:3300/0 conn(0x7f095815fd60 0x7f09580d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:32:07.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.428+0000 7f09577fe640 1 --2- 172.21.15.5:0/532541434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09580b7c70 0x7f09580d0c50 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f09580b4040 tx=0x7f094801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f3c3674377e9a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:07.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.428+0000 7f09567fc640 1 -- 172.21.15.5:0/532541434 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09480a7070 con 0x7f09580b7c70 2023-07-14T13:32:07.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.428+0000 7f09567fc640 1 -- 172.21.15.5:0/532541434 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09480ab430 con 0x7f09580b7c70 2023-07-14T13:32:07.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.428+0000 7f09567fc640 1 -- 172.21.15.5:0/532541434 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09480ab7a0 con 0x7f09580b7c70 2023-07-14T13:32:07.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.428+0000 7f095e1d2640 1 -- 172.21.15.5:0/532541434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09580b7c70 msgr2=0x7f09580d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:07.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.428+0000 7f095e1d2640 1 --2- 172.21.15.5:0/532541434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09580b7c70 0x7f09580d0c50 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f09580b4040 tx=0x7f094801c410 comp rx=0 tx=0).stop 2023-07-14T13:32:07.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.428+0000 7f095e1d2640 1 -- 172.21.15.5:0/532541434 shutdown_connections 2023-07-14T13:32:07.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.428+0000 7f095e1d2640 1 --2- 172.21.15.5:0/532541434 >> v2:172.21.15.154:3300/0 conn(0x7f095815fd60 0x7f09580d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.428+0000 7f095e1d2640 1 --2- 172.21.15.5:0/532541434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09580b7c70 0x7f09580d0c50 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.428+0000 7f095e1d2640 1 -- 172.21.15.5:0/532541434 >> 172.21.15.5:0/532541434 conn(0x7f09580650b0 msgr2=0x7f09580654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:07.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.428+0000 7f095e1d2640 1 -- 172.21.15.5:0/532541434 shutdown_connections 2023-07-14T13:32:07.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.428+0000 7f095e1d2640 1 -- 172.21.15.5:0/532541434 wait complete. 2023-07-14T13:32:07.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.432+0000 7f095e1d2640 1 Processor -- start 2023-07-14T13:32:07.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.432+0000 7f095e1d2640 1 -- start start 2023-07-14T13:32:07.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.432+0000 7f095e1d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09580b7c70 0x7f095814c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:07.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.432+0000 7f095e1d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09580d1850 0x7f095815e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:07.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.432+0000 7f095e1d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f095815fd60 0x7f09580b2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:07.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.432+0000 7f095e1d2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095814ce00 con 0x7f09580d1850 2023-07-14T13:32:07.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.432+0000 7f095e1d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0958153bb0 con 0x7f095815fd60 2023-07-14T13:32:07.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.432+0000 7f095e1d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f095815ec00 con 0x7f09580b7c70 2023-07-14T13:32:07.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.432+0000 7f0956ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09580d1850 0x7f095815e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:07.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.432+0000 7f0956ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09580d1850 0x7f095815e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44568/0 (socket says 172.21.15.5:44568) 2023-07-14T13:32:07.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.432+0000 7f0956ffd640 1 -- 172.21.15.5:0/41504689 learned_addr learned my addr 172.21.15.5:0/41504689 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:07.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.432+0000 7f09577fe640 1 --2- 172.21.15.5:0/41504689 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09580b7c70 0x7f095814c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:07.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.432+0000 7f0957fff640 1 --2- 172.21.15.5:0/41504689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f095815fd60 0x7f09580b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:07.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.432+0000 7f0956ffd640 1 -- 172.21.15.5:0/41504689 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09580b7c70 msgr2=0x7f095814c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:07.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.432+0000 7f0956ffd640 1 --2- 172.21.15.5:0/41504689 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09580b7c70 0x7f095814c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.432+0000 7f0956ffd640 1 -- 172.21.15.5:0/41504689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f095815fd60 msgr2=0x7f09580b2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:07.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.432+0000 7f0956ffd640 1 --2- 172.21.15.5:0/41504689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f095815fd60 0x7f09580b2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.432+0000 7f0956ffd640 1 -- 172.21.15.5:0/41504689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0950009a70 con 0x7f09580d1850 2023-07-14T13:32:07.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.432+0000 7f0956ffd640 1 --2- 172.21.15.5:0/41504689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09580d1850 0x7f095815e290 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f094c00c3c0 tx=0x7f094c00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:07.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.432+0000 7f093ffff640 1 -- 172.21.15.5:0/41504689 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c005db0 con 0x7f09580d1850 2023-07-14T13:32:07.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.432+0000 7f093ffff640 1 -- 172.21.15.5:0/41504689 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094c0070d0 con 0x7f09580d1850 2023-07-14T13:32:07.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.432+0000 7f093ffff640 1 -- 172.21.15.5:0/41504689 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c0074a0 con 0x7f09580d1850 2023-07-14T13:32:07.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.432+0000 7f095e1d2640 1 -- 172.21.15.5:0/41504689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0948009420 con 0x7f09580d1850 2023-07-14T13:32:07.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.432+0000 7f095e1d2640 1 -- 172.21.15.5:0/41504689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0958154130 con 0x7f09580d1850 2023-07-14T13:32:07.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.436+0000 7f095e1d2640 1 -- 172.21.15.5:0/41504689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09580678d0 con 0x7f09580d1850 2023-07-14T13:32:07.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.436+0000 7f093ffff640 1 -- 172.21.15.5:0/41504689 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 92) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f094c007600 con 0x7f09580d1850 2023-07-14T13:32:07.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.436+0000 7f093ffff640 1 --2- 172.21.15.5:0/41504689 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f09440663a0 0x7f0944068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:07.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.436+0000 7f093ffff640 1 -- 172.21.15.5:0/41504689 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6564+0+0 (secure 0 0 0) 0x7f094c0836c0 con 0x7f09580d1850 2023-07-14T13:32:07.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.436+0000 7f09577fe640 1 -- 172.21.15.5:0/41504689 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f09440663a0 msgr2=0x7f0944068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3169896898 2023-07-14T13:32:07.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.436+0000 7f09577fe640 1 --2- 172.21.15.5:0/41504689 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f09440663a0 0x7f0944068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:32:07.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.440+0000 7f093ffff640 1 -- 172.21.15.5:0/41504689 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f094c050840 con 0x7f09580d1850 2023-07-14T13:32:07.473 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:07.472+0000 7fd2e6445180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:32:07.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.600+0000 7f095e1d2640 1 -- 172.21.15.5:0/41504689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09580d1cc0 con 0x7f09580d1850 2023-07-14T13:32:07.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.600+0000 7f093ffff640 1 -- 172.21.15.5:0/41504689 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) v1 ==== 74+0+19098 (secure 0 0 0) 0x7f094c053e60 con 0x7f09580d1850 2023-07-14T13:32:07.602 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:07.603 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":177,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:32:07.309876+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:29:43.300974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-14T13:29:44.554824+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":177,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.7","mappings":[{"from":3,"to":0}]},{"pgid":"22.2b","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6833/1905284593":"2023-07-15T13:30:02.960482+0000","172.21.15.154:6832/1905284593":"2023-07-15T13:30:02.960482+0000","172.21.15.154:0/3194204879":"2023-07-15T13:30:02.960482+0000","172.21.15.154:0/3861552987":"2023-07-15T13:30:02.960482+0000","172.21.15.154:0/2010542927":"2023-07-15T13:30:02.960482+0000","172.21.15.154:0/1225132039":"2023-07-15T13:30:02.960482+0000","172.21.15.154:0/2876445445":"2023-07-15T13:30:02.960482+0000","172.21.15.154:0/1648465409":"2023-07-15T13:30:02.960482+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":22,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:32:07.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.604+0000 7f095e1d2640 1 -- 172.21.15.5:0/41504689 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f09440663a0 msgr2=0x7f0944068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:32:07.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.604+0000 7f095e1d2640 1 --2- 172.21.15.5:0/41504689 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f09440663a0 0x7f0944068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.604+0000 7f095e1d2640 1 -- 172.21.15.5:0/41504689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09580d1850 msgr2=0x7f095815e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:07.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.604+0000 7f095e1d2640 1 --2- 172.21.15.5:0/41504689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09580d1850 0x7f095815e290 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f094c00c3c0 tx=0x7f094c00c7c0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.604+0000 7f095e1d2640 1 -- 172.21.15.5:0/41504689 shutdown_connections 2023-07-14T13:32:07.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.604+0000 7f095e1d2640 1 --2- 172.21.15.5:0/41504689 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7f09440663a0 0x7f0944068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.604+0000 7f095e1d2640 1 --2- 172.21.15.5:0/41504689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f095815fd60 0x7f09580b2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.604+0000 7f095e1d2640 1 --2- 172.21.15.5:0/41504689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09580d1850 0x7f095815e290 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.604+0000 7f095e1d2640 1 --2- 172.21.15.5:0/41504689 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f09580b7c70 0x7f095814c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.604+0000 7f095e1d2640 1 -- 172.21.15.5:0/41504689 >> 172.21.15.5:0/41504689 conn(0x7f09580650b0 msgr2=0x7f0958065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:07.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.604+0000 7f095e1d2640 1 -- 172.21.15.5:0/41504689 shutdown_connections 2023-07-14T13:32:07.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.604+0000 7f095e1d2640 1 -- 172.21.15.5:0/41504689 wait complete. 2023-07-14T13:32:07.621 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:07.620+0000 7fd2e6445180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:32:07.631 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T13:29:43.300974+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '171', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T13:29:44.554824+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '177', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 5, 'snap_epoch': 177, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:32:07.632 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:32:07.633 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:07.632+0000 7f2614592180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:32:07.707 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:07.708+0000 7fd2e6445180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:32:07.724 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:07.724+0000 7f2614592180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:32:07.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.780+0000 7fb75d3df640 1 Processor -- start 2023-07-14T13:32:07.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.780+0000 7fb75d3df640 1 -- start start 2023-07-14T13:32:07.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.780+0000 7fb75d3df640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb758069430 0x7fb7580cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:07.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.780+0000 7fb75d3df640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb75806d2d0 0x7fb75806d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:07.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.780+0000 7fb75d3df640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7580cb7d0 con 0x7fb758160030 2023-07-14T13:32:07.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.780+0000 7fb75d3df640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb75806c510 con 0x7fb75806d2d0 2023-07-14T13:32:07.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.780+0000 7fb75d3df640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75806c7f0 con 0x7fb758069430 2023-07-14T13:32:07.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.780+0000 7fb7577fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb75806d2d0 0x7fb75806d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:07.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.780+0000 7fb7567fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb758160030 0x7fb758069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:50938/0 (socket says 172.21.15.5:50938) 2023-07-14T13:32:07.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.780+0000 7fb7567fc640 1 -- 172.21.15.5:0/3027595213 learned_addr learned my addr 172.21.15.5:0/3027595213 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:07.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.780+0000 7fb756ffd640 1 --2- 172.21.15.5:0/3027595213 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb758069430 0x7fb7580cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:07.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.780+0000 7fb7577fe640 1 -- 172.21.15.5:0/3027595213 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb758069430 msgr2=0x7fb7580cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:07.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.780+0000 7fb7577fe640 1 --2- 172.21.15.5:0/3027595213 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb758069430 0x7fb7580cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.780+0000 7fb7577fe640 1 -- 172.21.15.5:0/3027595213 >> v1:172.21.15.5:6789/0 conn(0x7fb758160030 legacy=0x7fb758069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:07.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.780+0000 7fb7577fe640 1 -- 172.21.15.5:0/3027595213 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75806cad0 con 0x7fb75806d2d0 2023-07-14T13:32:07.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.780+0000 7fb755ffb640 1 -- 172.21.15.5:0/3027595213 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4082492177 0 0) 0x7fb7580cb7d0 con 0x7fb758160030 2023-07-14T13:32:07.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.784+0000 7fb7577fe640 1 --2- 172.21.15.5:0/3027595213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb75806d2d0 0x7fb75806d750 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fb750009d90 tx=0x7fb75001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ff1e43703da31b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:07.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.784+0000 7fb755ffb640 1 -- 172.21.15.5:0/3027595213 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7500a5880 con 0x7fb75806d2d0 2023-07-14T13:32:07.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.784+0000 7fb755ffb640 1 -- 172.21.15.5:0/3027595213 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7500a59e0 con 0x7fb75806d2d0 2023-07-14T13:32:07.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.784+0000 7fb755ffb640 1 -- 172.21.15.5:0/3027595213 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7500a5d70 con 0x7fb75806d2d0 2023-07-14T13:32:07.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.784+0000 7fb75d3df640 1 -- 172.21.15.5:0/3027595213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb75806d2d0 msgr2=0x7fb75806d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:07.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.784+0000 7fb75d3df640 1 --2- 172.21.15.5:0/3027595213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb75806d2d0 0x7fb75806d750 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fb750009d90 tx=0x7fb75001c890 comp rx=0 tx=0).stop 2023-07-14T13:32:07.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.784+0000 7fb75d3df640 1 -- 172.21.15.5:0/3027595213 shutdown_connections 2023-07-14T13:32:07.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.784+0000 7fb75d3df640 1 --2- 172.21.15.5:0/3027595213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb75806d2d0 0x7fb75806d750 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.784+0000 7fb75d3df640 1 --2- 172.21.15.5:0/3027595213 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb758069430 0x7fb7580cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.784+0000 7fb75d3df640 1 -- 172.21.15.5:0/3027595213 >> 172.21.15.5:0/3027595213 conn(0x7fb7580b1840 msgr2=0x7fb7580cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:07.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.784+0000 7fb75d3df640 1 -- 172.21.15.5:0/3027595213 shutdown_connections 2023-07-14T13:32:07.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.788+0000 7fb75d3df640 1 -- 172.21.15.5:0/3027595213 wait complete. 2023-07-14T13:32:07.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.788+0000 7fb75d3df640 1 Processor -- start 2023-07-14T13:32:07.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.788+0000 7fb75d3df640 1 -- start start 2023-07-14T13:32:07.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.792+0000 7fb75d3df640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb758069430 0x7fb758152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:07.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.792+0000 7fb75d3df640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb75806d2d0 0x7fb7580cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:07.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.792+0000 7fb75d3df640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb758160030 0x7fb7580cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:07.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.792+0000 7fb75d3df640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb758149f80 con 0x7fb75806d2d0 2023-07-14T13:32:07.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.792+0000 7fb75d3df640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb758154fe0 con 0x7fb758069430 2023-07-14T13:32:07.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.792+0000 7fb75d3df640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7581552c0 con 0x7fb758160030 2023-07-14T13:32:07.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.792+0000 7fb7567fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb75806d2d0 0x7fb7580cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:07.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.792+0000 7fb7567fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb75806d2d0 0x7fb7580cbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44588/0 (socket says 172.21.15.5:44588) 2023-07-14T13:32:07.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.792+0000 7fb7567fc640 1 -- 172.21.15.5:0/227135043 learned_addr learned my addr 172.21.15.5:0/227135043 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:07.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.792+0000 7fb756ffd640 1 --2- 172.21.15.5:0/227135043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb758069430 0x7fb758152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:07.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.792+0000 7fb7577fe640 1 --2- 172.21.15.5:0/227135043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb758160030 0x7fb7580cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:07.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.792+0000 7fb7567fc640 1 -- 172.21.15.5:0/227135043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb758160030 msgr2=0x7fb7580cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:07.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.792+0000 7fb7567fc640 1 --2- 172.21.15.5:0/227135043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb758160030 0x7fb7580cc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.792+0000 7fb7567fc640 1 -- 172.21.15.5:0/227135043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb758069430 msgr2=0x7fb758152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:07.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.792+0000 7fb7567fc640 1 --2- 172.21.15.5:0/227135043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb758069430 0x7fb758152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.792+0000 7fb7567fc640 1 -- 172.21.15.5:0/227135043 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb750009a70 con 0x7fb75806d2d0 2023-07-14T13:32:07.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.792+0000 7fb7567fc640 1 --2- 172.21.15.5:0/227135043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb75806d2d0 0x7fb7580cbac0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fb74c0011f0 tx=0x7fb74c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:07.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.792+0000 7fb73f7fe640 1 -- 172.21.15.5:0/227135043 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c0074e0 con 0x7fb75806d2d0 2023-07-14T13:32:07.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.792+0000 7fb73f7fe640 1 -- 172.21.15.5:0/227135043 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74c007640 con 0x7fb75806d2d0 2023-07-14T13:32:07.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.792+0000 7fb73f7fe640 1 -- 172.21.15.5:0/227135043 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c004a10 con 0x7fb75806d2d0 2023-07-14T13:32:07.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.792+0000 7fb75d3df640 1 -- 172.21.15.5:0/227135043 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7581555a0 con 0x7fb75806d2d0 2023-07-14T13:32:07.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.792+0000 7fb75d3df640 1 -- 172.21.15.5:0/227135043 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7580c7c00 con 0x7fb75806d2d0 2023-07-14T13:32:07.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.792+0000 7fb75d3df640 1 -- 172.21.15.5:0/227135043 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7580678d0 con 0x7fb75806d2d0 2023-07-14T13:32:07.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.796+0000 7fb73f7fe640 1 -- 172.21.15.5:0/227135043 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 92) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fb74c004b70 con 0x7fb75806d2d0 2023-07-14T13:32:07.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.796+0000 7fb73f7fe640 1 --2- 172.21.15.5:0/227135043 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7fb7440663a0 0x7fb744068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:07.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.796+0000 7fb73f7fe640 1 -- 172.21.15.5:0/227135043 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6564+0+0 (secure 0 0 0) 0x7fb74c0832f0 con 0x7fb75806d2d0 2023-07-14T13:32:07.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.796+0000 7fb756ffd640 1 -- 172.21.15.5:0/227135043 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7fb7440663a0 msgr2=0x7fb744068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/3169896898 2023-07-14T13:32:07.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.796+0000 7fb756ffd640 1 --2- 172.21.15.5:0/227135043 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7fb7440663a0 0x7fb744068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:32:07.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.800+0000 7fb73f7fe640 1 -- 172.21.15.5:0/227135043 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fb74c050500 con 0x7fb75806d2d0 2023-07-14T13:32:07.888 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:07.884+0000 7f2614592180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:32:07.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.956+0000 7fb75d3df640 1 -- 172.21.15.5:0/227135043 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb75806e920 con 0x7fb75806d2d0 2023-07-14T13:32:07.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.956+0000 7fb73f7fe640 1 -- 172.21.15.5:0/227135043 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v177) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb74c0180a0 con 0x7fb75806d2d0 2023-07-14T13:32:07.958 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:32:07.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.956+0000 7fb75d3df640 1 -- 172.21.15.5:0/227135043 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7fb7440663a0 msgr2=0x7fb744068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:32:07.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.956+0000 7fb75d3df640 1 --2- 172.21.15.5:0/227135043 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7fb7440663a0 0x7fb744068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.956+0000 7fb75d3df640 1 -- 172.21.15.5:0/227135043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb75806d2d0 msgr2=0x7fb7580cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:07.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.956+0000 7fb75d3df640 1 --2- 172.21.15.5:0/227135043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb75806d2d0 0x7fb7580cbac0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fb74c0011f0 tx=0x7fb74c00c9b0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.956+0000 7fb75d3df640 1 -- 172.21.15.5:0/227135043 shutdown_connections 2023-07-14T13:32:07.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.956+0000 7fb75d3df640 1 --2- 172.21.15.5:0/227135043 >> [v2:172.21.15.154:6832/3169896898,v1:172.21.15.154:6833/3169896898] conn(0x7fb7440663a0 0x7fb744068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.956+0000 7fb75d3df640 1 --2- 172.21.15.5:0/227135043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb758160030 0x7fb7580cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.956+0000 7fb75d3df640 1 --2- 172.21.15.5:0/227135043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb75806d2d0 0x7fb7580cbac0 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.956+0000 7fb75d3df640 1 --2- 172.21.15.5:0/227135043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb758069430 0x7fb758152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:07.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.956+0000 7fb75d3df640 1 -- 172.21.15.5:0/227135043 >> 172.21.15.5:0/227135043 conn(0x7fb7580b1840 msgr2=0x7fb758069800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:07.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.956+0000 7fb75d3df640 1 -- 172.21.15.5:0/227135043 shutdown_connections 2023-07-14T13:32:07.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:07.956+0000 7fb75d3df640 1 -- 172.21.15.5:0/227135043 wait complete. 2023-07-14T13:32:07.976 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:07.976+0000 7fd2e6445180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:32:07.977 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:07.976+0000 7f2614592180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:32:07.979 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:32:08.035 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:08.036+0000 7fd2e6445180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:32:08.118 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:08.120+0000 7fd270cc2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:08.119 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:08.120+0000 7fd270cc2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:08.119 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:08.120+0000 7fd270cc2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:08.119 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:08.120+0000 7fd270cc2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:08.119 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:08.120+0000 7fd270cc2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:08.119 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:08.120+0000 7fd26f4bf640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:08.119 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:08.120+0000 7fd26f4bf640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:08.120 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:08.120+0000 7fd26f4bf640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:08.120 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:08.120+0000 7fd26f4bf640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:08.120 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:08.120+0000 7fd26f4bf640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:08.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.136+0000 7f60a36d8640 1 Processor -- start 2023-07-14T13:32:08.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.136+0000 7f60a36d8640 1 -- start start 2023-07-14T13:32:08.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.140+0000 7f60a36d8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f609c15bde0 0x7f609c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:08.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.140+0000 7f60a36d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f609c0d2300 0x7f609c0d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:08.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.140+0000 7f60a36d8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f609c0b04c0 con 0x7f609c0d2fc0 2023-07-14T13:32:08.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.140+0000 7f60a36d8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f609c15c1b0 con 0x7f609c15bde0 2023-07-14T13:32:08.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.140+0000 7f60a36d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609c0d2cc0 con 0x7f609c0d2300 2023-07-14T13:32:08.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.140+0000 7f60a1474640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f609c15bde0 0x7f609c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:08.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.140+0000 7f60a1c75640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f609c0d2300 0x7f609c0d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:08.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.140+0000 7f60a1c75640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f609c0d2300 0x7f609c0d2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:42498/0 (socket says 172.21.15.5:42498) 2023-07-14T13:32:08.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.140+0000 7f60a1c75640 1 -- 172.21.15.5:0/3686123947 learned_addr learned my addr 172.21.15.5:0/3686123947 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:08.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.140+0000 7f60a1474640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f609c15bde0 0x7f609c0d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:46026/0 (socket says 172.21.15.5:46026) 2023-07-14T13:32:08.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.140+0000 7f60a0c73640 1 --1- 172.21.15.5:0/3686123947 >> v1:172.21.15.154:6789/0 conn(0x7f609c0d2fc0 0x7f609c0b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:42352/0 (socket says 172.21.15.5:42352) 2023-07-14T13:32:08.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.140+0000 7f60a1c75640 1 -- 172.21.15.5:0/3686123947 >> v2:172.21.15.154:3300/0 conn(0x7f609c15bde0 msgr2=0x7f609c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:08.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.140+0000 7f60a1c75640 1 --2- 172.21.15.5:0/3686123947 >> v2:172.21.15.154:3300/0 conn(0x7f609c15bde0 0x7f609c0d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:08.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.140+0000 7f60a1c75640 1 -- 172.21.15.5:0/3686123947 >> v1:172.21.15.154:6789/0 conn(0x7f609c0d2fc0 legacy=0x7f609c0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:08.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.140+0000 7f60a1c75640 1 -- 172.21.15.5:0/3686123947 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c0b1060 con 0x7f609c0d2300 2023-07-14T13:32:08.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.140+0000 7f60a1474640 1 --2- 172.21.15.5:0/3686123947 >> v2:172.21.15.154:3300/0 conn(0x7f609c15bde0 0x7f609c0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:32:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.144+0000 7f60a1c75640 1 --2- 172.21.15.5:0/3686123947 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f609c0d2300 0x7f609c0d2780 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6094009e50 tx=0x7f609401ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4aaa6b344a1fec37 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.144+0000 7f6093fff640 1 -- 172.21.15.5:0/3686123947 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60940a57f0 con 0x7f609c0d2300 2023-07-14T13:32:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.144+0000 7f6093fff640 1 -- 172.21.15.5:0/3686123947 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60940a5950 con 0x7f609c0d2300 2023-07-14T13:32:08.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.144+0000 7f6093fff640 1 -- 172.21.15.5:0/3686123947 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60940a5ce0 con 0x7f609c0d2300 2023-07-14T13:32:08.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.144+0000 7f60a36d8640 1 -- 172.21.15.5:0/3686123947 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f609c0d2300 msgr2=0x7f609c0d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:08.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.144+0000 7f60a36d8640 1 --2- 172.21.15.5:0/3686123947 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f609c0d2300 0x7f609c0d2780 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6094009e50 tx=0x7f609401ca10 comp rx=0 tx=0).stop 2023-07-14T13:32:08.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.144+0000 7f60a36d8640 1 -- 172.21.15.5:0/3686123947 shutdown_connections 2023-07-14T13:32:08.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.144+0000 7f60a36d8640 1 --2- 172.21.15.5:0/3686123947 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f609c0d2300 0x7f609c0d2780 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:08.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.144+0000 7f60a36d8640 1 --2- 172.21.15.5:0/3686123947 >> v2:172.21.15.154:3300/0 conn(0x7f609c15bde0 0x7f609c0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:08.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.144+0000 7f60a36d8640 1 -- 172.21.15.5:0/3686123947 >> 172.21.15.5:0/3686123947 conn(0x7f609c0659d0 msgr2=0x7f609c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:08.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.144+0000 7f60a36d8640 1 -- 172.21.15.5:0/3686123947 shutdown_connections 2023-07-14T13:32:08.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.144+0000 7f60a36d8640 1 -- 172.21.15.5:0/3686123947 wait complete. 2023-07-14T13:32:08.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.144+0000 7f60a36d8640 1 Processor -- start 2023-07-14T13:32:08.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.144+0000 7f60a36d8640 1 -- start start 2023-07-14T13:32:08.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.148+0000 7f60a36d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f609c0d2300 0x7f609c14c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:08.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.148+0000 7f60a36d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f609c0d2fc0 0x7f609c0b3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:08.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.148+0000 7f60a36d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f609c15bde0 0x7f609c0b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.148+0000 7f60a36d8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c14cb20 con 0x7f609c0d2300 2023-07-14T13:32:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.148+0000 7f60a36d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c0b7bd0 con 0x7f609c0d2fc0 2023-07-14T13:32:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.148+0000 7f60a36d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609c0b4020 con 0x7f609c15bde0 2023-07-14T13:32:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.148+0000 7f60a1474640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f609c0d2300 0x7f609c14c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.148+0000 7f60a1474640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f609c0d2300 0x7f609c14c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44590/0 (socket says 172.21.15.5:44590) 2023-07-14T13:32:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.148+0000 7f60a1474640 1 -- 172.21.15.5:0/718387677 learned_addr learned my addr 172.21.15.5:0/718387677 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.148+0000 7f60a0c73640 1 --2- 172.21.15.5:0/718387677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f609c0d2fc0 0x7f609c0b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:08.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.148+0000 7f60a1c75640 1 --2- 172.21.15.5:0/718387677 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f609c15bde0 0x7f609c0b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:08.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.148+0000 7f60a1474640 1 -- 172.21.15.5:0/718387677 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f609c15bde0 msgr2=0x7f609c0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:08.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.148+0000 7f60a1474640 1 --2- 172.21.15.5:0/718387677 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f609c15bde0 0x7f609c0b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:08.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.148+0000 7f60a1474640 1 -- 172.21.15.5:0/718387677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f609c0d2fc0 msgr2=0x7f609c0b3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:08.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.148+0000 7f60a1474640 1 --2- 172.21.15.5:0/718387677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f609c0d2fc0 0x7f609c0b3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:08.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.148+0000 7f60a1474640 1 -- 172.21.15.5:0/718387677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60980093b0 con 0x7f609c0d2300 2023-07-14T13:32:08.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.148+0000 7f60a0c73640 1 --2- 172.21.15.5:0/718387677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f609c0d2fc0 0x7f609c0b3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:32:08.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.148+0000 7f60a1474640 1 --2- 172.21.15.5:0/718387677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f609c0d2300 0x7f609c14c5e0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f609800ebe0 tx=0x7f609800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.148+0000 7f6091ffb640 1 -- 172.21.15.5:0/718387677 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6098009760 con 0x7f609c0d2300 2023-07-14T13:32:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.148+0000 7f6091ffb640 1 -- 172.21.15.5:0/718387677 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609800cc30 con 0x7f609c0d2300 2023-07-14T13:32:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.148+0000 7f6091ffb640 1 -- 172.21.15.5:0/718387677 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609800eee0 con 0x7f609c0d2300 2023-07-14T13:32:08.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.148+0000 7f60a36d8640 1 -- 172.21.15.5:0/718387677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6094009b30 con 0x7f609c0d2300 2023-07-14T13:32:08.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.148+0000 7f60a36d8640 1 -- 172.21.15.5:0/718387677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609c0b7860 con 0x7f609c0d2300 2023-07-14T13:32:08.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.148+0000 7f60a36d8640 1 -- 172.21.15.5:0/718387677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f609c0678d0 con 0x7f609c0d2300 2023-07-14T13:32:08.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.152+0000 7f6091ffb640 1 -- 172.21.15.5:0/718387677 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 93) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f60980059a0 con 0x7f609c0d2300 2023-07-14T13:32:08.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.152+0000 7f6091ffb640 1 -- 172.21.15.5:0/718387677 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6864+0+0 (secure 0 0 0) 0x7f6098083ff0 con 0x7f609c0d2300 2023-07-14T13:32:08.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.160+0000 7f6091ffb640 1 -- 172.21.15.5:0/718387677 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f60980b4720 con 0x7f609c0d2300 2023-07-14T13:32:08.288 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:08.288+0000 7f2614592180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:32:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.316+0000 7f60a36d8640 1 -- 172.21.15.5:0/718387677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f609c15b3e0 con 0x7f609c0d2300 2023-07-14T13:32:08.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.316+0000 7f6091ffb640 1 -- 172.21.15.5:0/718387677 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v178) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6098020020 con 0x7f609c0d2300 2023-07-14T13:32:08.319 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:32:08.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.320+0000 7f60a36d8640 1 -- 172.21.15.5:0/718387677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f609c0d2300 msgr2=0x7f609c14c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:08.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.320+0000 7f60a36d8640 1 --2- 172.21.15.5:0/718387677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f609c0d2300 0x7f609c14c5e0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f609800ebe0 tx=0x7f609800c520 comp rx=0 tx=0).stop 2023-07-14T13:32:08.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.320+0000 7f60a36d8640 1 -- 172.21.15.5:0/718387677 shutdown_connections 2023-07-14T13:32:08.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.320+0000 7f60a36d8640 1 --2- 172.21.15.5:0/718387677 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f609c15bde0 0x7f609c0b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:08.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.320+0000 7f60a36d8640 1 --2- 172.21.15.5:0/718387677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f609c0d2fc0 0x7f609c0b3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:08.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.320+0000 7f60a36d8640 1 --2- 172.21.15.5:0/718387677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f609c0d2300 0x7f609c14c5e0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:08.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.320+0000 7f60a36d8640 1 -- 172.21.15.5:0/718387677 >> 172.21.15.5:0/718387677 conn(0x7f609c0659d0 msgr2=0x7f609c0aefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:08.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.320+0000 7f60a36d8640 1 -- 172.21.15.5:0/718387677 shutdown_connections 2023-07-14T13:32:08.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.320+0000 7f60a36d8640 1 -- 172.21.15.5:0/718387677 wait complete. 2023-07-14T13:32:08.341 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T13:32:08.355 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:08.352+0000 7f2614592180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:32:08.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.488+0000 7f8485937640 1 Processor -- start 2023-07-14T13:32:08.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.488+0000 7f8485937640 1 -- start start 2023-07-14T13:32:08.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.488+0000 7f8485937640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8480069430 0x7f84800cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:08.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.488+0000 7f8485937640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8480160030 0x7f8480069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:08.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.488+0000 7f8485937640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8480070330 0x7f8480070790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:08.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.488+0000 7f8485937640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8480069d40 con 0x7f8480069430 2023-07-14T13:32:08.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.488+0000 7f8485937640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84800cb7d0 con 0x7f8480160030 2023-07-14T13:32:08.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.488+0000 7f8485937640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848006c510 con 0x7f8480070330 2023-07-14T13:32:08.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.488+0000 7f847effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8480069430 0x7f84800cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:08.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.488+0000 7f847effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8480069430 0x7f84800cb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44598/0 (socket says 172.21.15.5:44598) 2023-07-14T13:32:08.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.488+0000 7f847effd640 1 -- 172.21.15.5:0/543642541 learned_addr learned my addr 172.21.15.5:0/543642541 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:08.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.488+0000 7f847f7fe640 1 --2- 172.21.15.5:0/543642541 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8480070330 0x7f8480070790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:08.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.488+0000 7f8477fff640 1 --2- 172.21.15.5:0/543642541 >> v2:172.21.15.154:3300/0 conn(0x7f8480160030 0x7f8480069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:08.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.488+0000 7f847effd640 1 -- 172.21.15.5:0/543642541 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8480070330 msgr2=0x7f8480070790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:08.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.488+0000 7f847effd640 1 --2- 172.21.15.5:0/543642541 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8480070330 0x7f8480070790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:08.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.488+0000 7f847effd640 1 -- 172.21.15.5:0/543642541 >> v2:172.21.15.154:3300/0 conn(0x7f8480160030 msgr2=0x7f8480069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:08.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.488+0000 7f847effd640 1 --2- 172.21.15.5:0/543642541 >> v2:172.21.15.154:3300/0 conn(0x7f8480160030 0x7f8480069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:08.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.488+0000 7f847effd640 1 -- 172.21.15.5:0/543642541 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848006c7f0 con 0x7f8480069430 2023-07-14T13:32:08.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.492+0000 7f847effd640 1 --2- 172.21.15.5:0/543642541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8480069430 0x7f84800cb0f0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f8480065f00 tx=0x7f847001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed26ba4b5e8a41b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:08.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.492+0000 7f847e7fc640 1 -- 172.21.15.5:0/543642541 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84700ab600 con 0x7f8480069430 2023-07-14T13:32:08.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.492+0000 7f847e7fc640 1 -- 172.21.15.5:0/543642541 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84700a7050 con 0x7f8480069430 2023-07-14T13:32:08.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.492+0000 7f847e7fc640 1 -- 172.21.15.5:0/543642541 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84700ab980 con 0x7f8480069430 2023-07-14T13:32:08.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.492+0000 7f8485937640 1 -- 172.21.15.5:0/543642541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8480069430 msgr2=0x7f84800cb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:08.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.492+0000 7f8485937640 1 --2- 172.21.15.5:0/543642541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8480069430 0x7f84800cb0f0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f8480065f00 tx=0x7f847001c440 comp rx=0 tx=0).stop 2023-07-14T13:32:08.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.492+0000 7f8485937640 1 -- 172.21.15.5:0/543642541 shutdown_connections 2023-07-14T13:32:08.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.492+0000 7f8485937640 1 --2- 172.21.15.5:0/543642541 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8480070330 0x7f8480070790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:08.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.492+0000 7f8485937640 1 --2- 172.21.15.5:0/543642541 >> v2:172.21.15.154:3300/0 conn(0x7f8480160030 0x7f8480069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:08.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.492+0000 7f8485937640 1 --2- 172.21.15.5:0/543642541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8480069430 0x7f84800cb0f0 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:08.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.492+0000 7f8485937640 1 -- 172.21.15.5:0/543642541 >> 172.21.15.5:0/543642541 conn(0x7f84800b1840 msgr2=0x7f84800cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:08.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.492+0000 7f8485937640 1 -- 172.21.15.5:0/543642541 shutdown_connections 2023-07-14T13:32:08.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.492+0000 7f8485937640 1 -- 172.21.15.5:0/543642541 wait complete. 2023-07-14T13:32:08.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.496+0000 7f8485937640 1 Processor -- start 2023-07-14T13:32:08.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.496+0000 7f8485937640 1 -- start start 2023-07-14T13:32:08.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.496+0000 7f8485937640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8480069430 0x7f84801f78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:08.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.496+0000 7f8485937640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8480070330 0x7f84800ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:08.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.496+0000 7f8485937640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8480160030 0x7f84800cd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:08.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.496+0000 7f8485937640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84800ce3e0 con 0x7f8480160030 2023-07-14T13:32:08.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.496+0000 7f8485937640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84801f84c0 con 0x7f8480070330 2023-07-14T13:32:08.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.496+0000 7f8485937640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84800cd760 con 0x7f8480069430 2023-07-14T13:32:08.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.496+0000 7f847f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8480160030 0x7f84800cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:08.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.496+0000 7f847f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8480160030 0x7f84800cd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44602/0 (socket says 172.21.15.5:44602) 2023-07-14T13:32:08.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.496+0000 7f847f7fe640 1 -- 172.21.15.5:0/2524441563 learned_addr learned my addr 172.21.15.5:0/2524441563 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:08.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.496+0000 7f8477fff640 1 --2- 172.21.15.5:0/2524441563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8480070330 0x7f84800ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:08.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.496+0000 7f847effd640 1 --2- 172.21.15.5:0/2524441563 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8480069430 0x7f84801f78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:08.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.496+0000 7f847f7fe640 1 -- 172.21.15.5:0/2524441563 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8480069430 msgr2=0x7f84801f78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:08.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.496+0000 7f847f7fe640 1 --2- 172.21.15.5:0/2524441563 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8480069430 0x7f84801f78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:08.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.496+0000 7f847f7fe640 1 -- 172.21.15.5:0/2524441563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8480070330 msgr2=0x7f84800ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:08.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.496+0000 7f847f7fe640 1 --2- 172.21.15.5:0/2524441563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8480070330 0x7f84800ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:08.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.496+0000 7f847f7fe640 1 -- 172.21.15.5:0/2524441563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84700094d0 con 0x7f8480160030 2023-07-14T13:32:08.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.496+0000 7f847f7fe640 1 --2- 172.21.15.5:0/2524441563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8480160030 0x7f84800cd150 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f847800eed0 tx=0x7f847800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:08.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.496+0000 7f847cff9640 1 -- 172.21.15.5:0/2524441563 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8478010040 con 0x7f8480160030 2023-07-14T13:32:08.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.496+0000 7f847cff9640 1 -- 172.21.15.5:0/2524441563 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8478014400 con 0x7f8480160030 2023-07-14T13:32:08.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.496+0000 7f8485937640 1 -- 172.21.15.5:0/2524441563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84801605b0 con 0x7f8480160030 2023-07-14T13:32:08.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.496+0000 7f847cff9640 1 -- 172.21.15.5:0/2524441563 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8478009ea0 con 0x7f8480160030 2023-07-14T13:32:08.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.496+0000 7f8485937640 1 -- 172.21.15.5:0/2524441563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84800cdd20 con 0x7f8480160030 2023-07-14T13:32:08.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.496+0000 7f8485937640 1 -- 172.21.15.5:0/2524441563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84800ce520 con 0x7f8480160030 2023-07-14T13:32:08.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.500+0000 7f847cff9640 1 -- 172.21.15.5:0/2524441563 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 93) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f84780147b0 con 0x7f8480160030 2023-07-14T13:32:08.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.500+0000 7f847cff9640 1 -- 172.21.15.5:0/2524441563 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6864+0+0 (secure 0 0 0) 0x7f84780843f0 con 0x7f8480160030 2023-07-14T13:32:08.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.504+0000 7f847cff9640 1 -- 172.21.15.5:0/2524441563 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f8478051980 con 0x7f8480160030 2023-07-14T13:32:08.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.656+0000 7f8485937640 1 -- 172.21.15.5:0/2524441563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f84800678d0 con 0x7f8480160030 2023-07-14T13:32:08.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.656+0000 7f847cff9640 1 -- 172.21.15.5:0/2524441563 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v178) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8478054fa0 con 0x7f8480160030 2023-07-14T13:32:08.659 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T13:32:08.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.660+0000 7f8485937640 1 -- 172.21.15.5:0/2524441563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8480160030 msgr2=0x7f84800cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:08.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.660+0000 7f8485937640 1 --2- 172.21.15.5:0/2524441563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8480160030 0x7f84800cd150 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f847800eed0 tx=0x7f847800b480 comp rx=0 tx=0).stop 2023-07-14T13:32:08.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.660+0000 7f8485937640 1 -- 172.21.15.5:0/2524441563 shutdown_connections 2023-07-14T13:32:08.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.660+0000 7f8485937640 1 --2- 172.21.15.5:0/2524441563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8480160030 0x7f84800cd150 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:08.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.660+0000 7f8485937640 1 --2- 172.21.15.5:0/2524441563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8480070330 0x7f84800ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:08.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.660+0000 7f8485937640 1 --2- 172.21.15.5:0/2524441563 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8480069430 0x7f84801f78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:08.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.660+0000 7f8485937640 1 -- 172.21.15.5:0/2524441563 >> 172.21.15.5:0/2524441563 conn(0x7f84800b1840 msgr2=0x7f848015a740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:08.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.660+0000 7f8485937640 1 -- 172.21.15.5:0/2524441563 shutdown_connections 2023-07-14T13:32:08.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.660+0000 7f8485937640 1 -- 172.21.15.5:0/2524441563 wait complete. 2023-07-14T13:32:08.680 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T13:32:08.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.868+0000 7f5ad5d74640 1 Processor -- start 2023-07-14T13:32:08.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.868+0000 7f5ad5d74640 1 -- start start 2023-07-14T13:32:08.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.868+0000 7f5ad5d74640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ad00aeb40 0x7f5ad015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:08.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.868+0000 7f5ad5d74640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5ad0159440 0x7f5ad00c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:08.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.868+0000 7f5ad5d74640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad01532b0 con 0x7f5ad00aef10 2023-07-14T13:32:08.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.868+0000 7f5ad5d74640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad00ca6f0 con 0x7f5ad00aeb40 2023-07-14T13:32:08.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.868+0000 7f5ad5d74640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad01599d0 con 0x7f5ad0159440 2023-07-14T13:32:08.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.868+0000 7f5acf7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ad00aeb40 0x7f5ad015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:08.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.868+0000 7f5acf7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ad00aeb40 0x7f5ad015cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44612/0 (socket says 172.21.15.5:44612) 2023-07-14T13:32:08.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.868+0000 7f5acf7fe640 1 -- 172.21.15.5:0/2240042571 learned_addr learned my addr 172.21.15.5:0/2240042571 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:08.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.868+0000 7f5acffff640 1 --2- 172.21.15.5:0/2240042571 >> v2:172.21.15.154:3300/0 conn(0x7f5ad0159440 0x7f5ad00c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:08.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.868+0000 7f5acf7fe640 1 -- 172.21.15.5:0/2240042571 >> v2:172.21.15.154:3300/0 conn(0x7f5ad0159440 msgr2=0x7f5ad00c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:08.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.868+0000 7f5acf7fe640 1 --2- 172.21.15.5:0/2240042571 >> v2:172.21.15.154:3300/0 conn(0x7f5ad0159440 0x7f5ad00c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:08.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.868+0000 7f5acf7fe640 1 -- 172.21.15.5:0/2240042571 >> v1:172.21.15.154:6789/0 conn(0x7f5ad00aef10 legacy=0x7f5ad0158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:08.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.868+0000 7f5acf7fe640 1 -- 172.21.15.5:0/2240042571 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad0159cb0 con 0x7f5ad00aeb40 2023-07-14T13:32:08.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.868+0000 7f5acffff640 1 --2- 172.21.15.5:0/2240042571 >> v2:172.21.15.154:3300/0 conn(0x7f5ad0159440 0x7f5ad00c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:08.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.872+0000 7f5acf7fe640 1 --2- 172.21.15.5:0/2240042571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ad00aeb40 0x7f5ad015cef0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f5ad00c8690 tx=0x7f5ac001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873380cfefd0025a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:08.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.872+0000 7f5ace7fc640 1 -- 172.21.15.5:0/2240042571 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac00ab640 con 0x7f5ad00aeb40 2023-07-14T13:32:08.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.872+0000 7f5ace7fc640 1 -- 172.21.15.5:0/2240042571 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac00a7070 con 0x7f5ad00aeb40 2023-07-14T13:32:08.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.872+0000 7f5ace7fc640 1 -- 172.21.15.5:0/2240042571 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac00ab9c0 con 0x7f5ad00aeb40 2023-07-14T13:32:08.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.872+0000 7f5ad5d74640 1 -- 172.21.15.5:0/2240042571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ad00aeb40 msgr2=0x7f5ad015cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:08.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.872+0000 7f5ad5d74640 1 --2- 172.21.15.5:0/2240042571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ad00aeb40 0x7f5ad015cef0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f5ad00c8690 tx=0x7f5ac001c440 comp rx=0 tx=0).stop 2023-07-14T13:32:08.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.872+0000 7f5ad5d74640 1 -- 172.21.15.5:0/2240042571 shutdown_connections 2023-07-14T13:32:08.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.872+0000 7f5ad5d74640 1 --2- 172.21.15.5:0/2240042571 >> v2:172.21.15.154:3300/0 conn(0x7f5ad0159440 0x7f5ad00c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:08.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.872+0000 7f5ad5d74640 1 --2- 172.21.15.5:0/2240042571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ad00aeb40 0x7f5ad015cef0 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:08.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.872+0000 7f5ad5d74640 1 -- 172.21.15.5:0/2240042571 >> 172.21.15.5:0/2240042571 conn(0x7f5ad00cde90 msgr2=0x7f5ad00ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:08.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.872+0000 7f5ad5d74640 1 -- 172.21.15.5:0/2240042571 shutdown_connections 2023-07-14T13:32:08.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.872+0000 7f5ad5d74640 1 -- 172.21.15.5:0/2240042571 wait complete. 2023-07-14T13:32:08.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.876+0000 7f5ad5d74640 1 Processor -- start 2023-07-14T13:32:08.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.876+0000 7f5ad5d74640 1 -- start start 2023-07-14T13:32:08.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.876+0000 7f5ad5d74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ad00aeb40 0x7f5ad014f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:08.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.876+0000 7f5ad5d74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ad00aef10 0x7f5ad0070a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:08.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.876+0000 7f5ad5d74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ad0159440 0x7f5ad00ada10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:08.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.876+0000 7f5ad5d74640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad014f920 con 0x7f5ad00aeb40 2023-07-14T13:32:08.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.876+0000 7f5ad5d74640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad00705f0 con 0x7f5ad0159440 2023-07-14T13:32:08.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.876+0000 7f5ad5d74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad006f9e0 con 0x7f5ad00aef10 2023-07-14T13:32:08.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.876+0000 7f5acf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ad00aeb40 0x7f5ad014f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:08.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.876+0000 7f5acf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ad00aeb40 0x7f5ad014f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44616/0 (socket says 172.21.15.5:44616) 2023-07-14T13:32:08.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.876+0000 7f5acf7fe640 1 -- 172.21.15.5:0/551829776 learned_addr learned my addr 172.21.15.5:0/551829776 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:08.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.876+0000 7f5acffff640 1 --2- 172.21.15.5:0/551829776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ad0159440 0x7f5ad00ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:08.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.876+0000 7f5aceffd640 1 --2- 172.21.15.5:0/551829776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ad00aef10 0x7f5ad0070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:08.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.876+0000 7f5acf7fe640 1 -- 172.21.15.5:0/551829776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ad00aef10 msgr2=0x7f5ad0070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:08.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.876+0000 7f5acf7fe640 1 --2- 172.21.15.5:0/551829776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ad00aef10 0x7f5ad0070a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:08.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.876+0000 7f5acf7fe640 1 -- 172.21.15.5:0/551829776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ad0159440 msgr2=0x7f5ad00ada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:08.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.876+0000 7f5acf7fe640 1 --2- 172.21.15.5:0/551829776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ad0159440 0x7f5ad00ada10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:08.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.876+0000 7f5acf7fe640 1 -- 172.21.15.5:0/551829776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac00094d0 con 0x7f5ad00aeb40 2023-07-14T13:32:08.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.876+0000 7f5acffff640 1 --2- 172.21.15.5:0/551829776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ad0159440 0x7f5ad00ada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:08.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.876+0000 7f5acf7fe640 1 --2- 172.21.15.5:0/551829776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ad00aeb40 0x7f5ad014f3e0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0019050 tx=0x7f5ac001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:08.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.876+0000 7f5ab7fff640 1 -- 172.21.15.5:0/551829776 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac00be3f0 con 0x7f5ad00aeb40 2023-07-14T13:32:08.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.876+0000 7f5ab7fff640 1 -- 172.21.15.5:0/551829776 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac00be550 con 0x7f5ad00aeb40 2023-07-14T13:32:08.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.876+0000 7f5ab7fff640 1 -- 172.21.15.5:0/551829776 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac00be900 con 0x7f5ad00aeb40 2023-07-14T13:32:08.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.876+0000 7f5ad5d74640 1 -- 172.21.15.5:0/551829776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad006fcc0 con 0x7f5ad00aeb40 2023-07-14T13:32:08.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.880+0000 7f5ad5d74640 1 -- 172.21.15.5:0/551829776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad0070280 con 0x7f5ad00aeb40 2023-07-14T13:32:08.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.880+0000 7f5ad5d74640 1 -- 172.21.15.5:0/551829776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad00678d0 con 0x7f5ad00aeb40 2023-07-14T13:32:08.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.880+0000 7f5ab7fff640 1 -- 172.21.15.5:0/551829776 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 93) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f5ad00c9610 con 0x7f5ad00aeb40 2023-07-14T13:32:08.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.880+0000 7f5ab7fff640 1 -- 172.21.15.5:0/551829776 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6864+0+0 (secure 0 0 0) 0x7f5ac011e320 con 0x7f5ad00aeb40 2023-07-14T13:32:08.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:08.884+0000 7f5ab7fff640 1 -- 172.21.15.5:0/551829776 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f5ac00eb800 con 0x7f5ad00aeb40 2023-07-14T13:32:09.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.036+0000 7f5ad5d74640 1 -- 172.21.15.5:0/551829776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5ad00c33e0 con 0x7f5ad00aeb40 2023-07-14T13:32:09.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.036+0000 7f5ab7fff640 1 -- 172.21.15.5:0/551829776 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v178) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5ac00eee20 con 0x7f5ad00aeb40 2023-07-14T13:32:09.040 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T13:32:09.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.040+0000 7f5ad5d74640 1 -- 172.21.15.5:0/551829776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ad00aeb40 msgr2=0x7f5ad014f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:09.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.040+0000 7f5ad5d74640 1 --2- 172.21.15.5:0/551829776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ad00aeb40 0x7f5ad014f3e0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0019050 tx=0x7f5ac001ac80 comp rx=0 tx=0).stop 2023-07-14T13:32:09.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.040+0000 7f5ad5d74640 1 -- 172.21.15.5:0/551829776 shutdown_connections 2023-07-14T13:32:09.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.040+0000 7f5ad5d74640 1 --2- 172.21.15.5:0/551829776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ad0159440 0x7f5ad00ada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.040+0000 7f5ad5d74640 1 --2- 172.21.15.5:0/551829776 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ad00aef10 0x7f5ad0070a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.040+0000 7f5ad5d74640 1 --2- 172.21.15.5:0/551829776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ad00aeb40 0x7f5ad014f3e0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.040+0000 7f5ad5d74640 1 -- 172.21.15.5:0/551829776 >> 172.21.15.5:0/551829776 conn(0x7f5ad00cde90 msgr2=0x7f5ad015b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:09.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.040+0000 7f5ad5d74640 1 -- 172.21.15.5:0/551829776 shutdown_connections 2023-07-14T13:32:09.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.040+0000 7f5ad5d74640 1 -- 172.21.15.5:0/551829776 wait complete. 2023-07-14T13:32:09.065 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:32:09.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.208+0000 7fa09a340640 1 Processor -- start 2023-07-14T13:32:09.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.208+0000 7fa09a340640 1 -- start start 2023-07-14T13:32:09.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.208+0000 7fa09a340640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa0940afee0 0x7fa09415d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:09.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.208+0000 7fa09a340640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0940b02b0 0x7fa0940b3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:09.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.208+0000 7fa09a340640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa09415a730 0x7fa0940b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:09.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.208+0000 7fa09a340640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa09415e500 con 0x7fa0940b02b0 2023-07-14T13:32:09.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.208+0000 7fa09a340640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa09415a000 con 0x7fa0940afee0 2023-07-14T13:32:09.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.208+0000 7fa09a340640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0940b3540 con 0x7fa09415a730 2023-07-14T13:32:09.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.208+0000 7fa0937fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0940b02b0 0x7fa0940b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:09.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.208+0000 7fa0937fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa0940b02b0 0x7fa0940b3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50958/0 (socket says 172.21.15.5:50958) 2023-07-14T13:32:09.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.208+0000 7fa0937fe640 1 -- 172.21.15.5:0/739199051 learned_addr learned my addr 172.21.15.5:0/739199051 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:09.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.208+0000 7fa0988dd640 1 --2- 172.21.15.5:0/739199051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa09415a730 0x7fa0940b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:09.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.208+0000 7fa093fff640 1 --2- 172.21.15.5:0/739199051 >> v2:172.21.15.154:3300/0 conn(0x7fa0940afee0 0x7fa09415d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:09.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.212+0000 7fa0937fe640 1 -- 172.21.15.5:0/739199051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa09415a730 msgr2=0x7fa0940b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:09.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.212+0000 7fa0937fe640 1 --2- 172.21.15.5:0/739199051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa09415a730 0x7fa0940b0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.212+0000 7fa0937fe640 1 -- 172.21.15.5:0/739199051 >> v2:172.21.15.154:3300/0 conn(0x7fa0940afee0 msgr2=0x7fa09415d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:09.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.212+0000 7fa0937fe640 1 --2- 172.21.15.5:0/739199051 >> v2:172.21.15.154:3300/0 conn(0x7fa0940afee0 0x7fa09415d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.212+0000 7fa0937fe640 1 -- 172.21.15.5:0/739199051 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09415dc60 con 0x7fa0940b02b0 2023-07-14T13:32:09.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.212+0000 7fa0937fe640 1 --2- 172.21.15.5:0/739199051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0940b02b0 0x7fa0940b3000 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fa0940cf130 tx=0x7fa08801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e63ebcfeaa343d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:09.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.212+0000 7fa092ffd640 1 -- 172.21.15.5:0/739199051 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0880ab620 con 0x7fa0940b02b0 2023-07-14T13:32:09.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.212+0000 7fa092ffd640 1 -- 172.21.15.5:0/739199051 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0880ab780 con 0x7fa0940b02b0 2023-07-14T13:32:09.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.212+0000 7fa092ffd640 1 -- 172.21.15.5:0/739199051 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0880abb10 con 0x7fa0940b02b0 2023-07-14T13:32:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.212+0000 7fa09a340640 1 -- 172.21.15.5:0/739199051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0940b02b0 msgr2=0x7fa0940b3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.212+0000 7fa09a340640 1 --2- 172.21.15.5:0/739199051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0940b02b0 0x7fa0940b3000 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fa0940cf130 tx=0x7fa08801c440 comp rx=0 tx=0).stop 2023-07-14T13:32:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.216+0000 7fa09a340640 1 -- 172.21.15.5:0/739199051 shutdown_connections 2023-07-14T13:32:09.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.216+0000 7fa09a340640 1 --2- 172.21.15.5:0/739199051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa09415a730 0x7fa0940b0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.216+0000 7fa09a340640 1 --2- 172.21.15.5:0/739199051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0940b02b0 0x7fa0940b3000 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.216+0000 7fa09a340640 1 --2- 172.21.15.5:0/739199051 >> v2:172.21.15.154:3300/0 conn(0x7fa0940afee0 0x7fa09415d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.216+0000 7fa09a340640 1 -- 172.21.15.5:0/739199051 >> 172.21.15.5:0/739199051 conn(0x7fa09406c7b0 msgr2=0x7fa09406cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:09.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.216+0000 7fa09a340640 1 -- 172.21.15.5:0/739199051 shutdown_connections 2023-07-14T13:32:09.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.216+0000 7fa09a340640 1 -- 172.21.15.5:0/739199051 wait complete. 2023-07-14T13:32:09.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.216+0000 7fa09a340640 1 Processor -- start 2023-07-14T13:32:09.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.216+0000 7fa09a340640 1 -- start start 2023-07-14T13:32:09.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.216+0000 7fa09a340640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0940afee0 0x7fa09414d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:09.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.216+0000 7fa09a340640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0940b02b0 0x7fa0940706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:09.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.216+0000 7fa09a340640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09415a730 0x7fa094144d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:09.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.216+0000 7fa09a340640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa094070c30 con 0x7fa09415a730 2023-07-14T13:32:09.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.216+0000 7fa09a340640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa094145df0 con 0x7fa0940b02b0 2023-07-14T13:32:09.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.216+0000 7fa09a340640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09414dab0 con 0x7fa0940afee0 2023-07-14T13:32:09.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.216+0000 7fa0988dd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09415a730 0x7fa094144d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:09.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.216+0000 7fa0988dd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09415a730 0x7fa094144d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50960/0 (socket says 172.21.15.5:50960) 2023-07-14T13:32:09.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.216+0000 7fa0988dd640 1 -- 172.21.15.5:0/3930543265 learned_addr learned my addr 172.21.15.5:0/3930543265 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.216+0000 7fa093fff640 1 --2- 172.21.15.5:0/3930543265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0940afee0 0x7fa09414d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:09.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.216+0000 7fa0937fe640 1 --2- 172.21.15.5:0/3930543265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0940b02b0 0x7fa0940706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:09.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.216+0000 7fa0988dd640 1 -- 172.21.15.5:0/3930543265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0940afee0 msgr2=0x7fa09414d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:09.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.216+0000 7fa0988dd640 1 --2- 172.21.15.5:0/3930543265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0940afee0 0x7fa09414d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.216+0000 7fa0988dd640 1 -- 172.21.15.5:0/3930543265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0940b02b0 msgr2=0x7fa0940706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:09.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.216+0000 7fa0988dd640 1 --2- 172.21.15.5:0/3930543265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0940b02b0 0x7fa0940706f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.216+0000 7fa0988dd640 1 -- 172.21.15.5:0/3930543265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0880094d0 con 0x7fa09415a730 2023-07-14T13:32:09.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.220+0000 7fa0988dd640 1 --2- 172.21.15.5:0/3930543265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09415a730 0x7fa094144d40 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fa08c007e40 tx=0x7fa08c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:09.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.220+0000 7fa090ff9640 1 -- 172.21.15.5:0/3930543265 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c014620 con 0x7fa09415a730 2023-07-14T13:32:09.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.220+0000 7fa090ff9640 1 -- 172.21.15.5:0/3930543265 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08c00ee90 con 0x7fa09415a730 2023-07-14T13:32:09.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.220+0000 7fa090ff9640 1 -- 172.21.15.5:0/3930543265 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c0149e0 con 0x7fa09415a730 2023-07-14T13:32:09.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.220+0000 7fa09a340640 1 -- 172.21.15.5:0/3930543265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa09414dd90 con 0x7fa09415a730 2023-07-14T13:32:09.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.220+0000 7fa09a340640 1 -- 172.21.15.5:0/3930543265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa09414e350 con 0x7fa09415a730 2023-07-14T13:32:09.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.220+0000 7fa09a340640 1 -- 172.21.15.5:0/3930543265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0940678d0 con 0x7fa09415a730 2023-07-14T13:32:09.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.220+0000 7fa090ff9640 1 -- 172.21.15.5:0/3930543265 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 94) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fa08c014b40 con 0x7fa09415a730 2023-07-14T13:32:09.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.220+0000 7fa090ff9640 1 --2- 172.21.15.5:0/3930543265 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fa0800660d0 0x7fa080068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:09.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.220+0000 7fa090ff9640 1 -- 172.21.15.5:0/3930543265 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6864+0+0 (secure 0 0 0) 0x7fa08c0853e0 con 0x7fa09415a730 2023-07-14T13:32:09.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.224+0000 7fa093fff640 1 --2- 172.21.15.5:0/3930543265 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fa0800660d0 0x7fa080068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:09.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.224+0000 7fa093fff640 1 --2- 172.21.15.5:0/3930543265 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fa0800660d0 0x7fa080068580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa0840079c0 tx=0x7fa084008040 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:09.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.224+0000 7fa090ff9640 1 -- 172.21.15.5:0/3930543265 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa08c052900 con 0x7fa09415a730 2023-07-14T13:32:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.416+0000 7fa09a340640 1 -- 172.21.15.5:0/3930543265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa09406c380 con 0x7fa09415a730 2023-07-14T13:32:09.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.416+0000 7fa090ff9640 1 -- 172.21.15.5:0/3930543265 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4710 (secure 0 0 0) 0x7fa08c055f20 con 0x7fa09415a730 2023-07-14T13:32:09.418 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:09.418 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2329374117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2329374117},{"type":"v1","addr":"172.21.15.154:6835","nonce":2329374117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":9457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/811714286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":811714286},{"type":"v1","addr":"172.21.15.154:6837","nonce":811714286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":9954,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3020438262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3020438262},{"type":"v1","addr":"172.21.15.5:6833","nonce":3020438262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:29:45.555298+0000","modified":"2023-07-14T13:29:49.191310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9966":{"gid":9966,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/3098088945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3098088945},{"type":"v1","addr":"172.21.15.5:6835","nonce":3098088945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-14T13:32:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 83 2023-07-14T13:32:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.416+0000 7fa09a340640 1 -- 172.21.15.5:0/3930543265 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fa0800660d0 msgr2=0x7fa080068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.416+0000 7fa09a340640 1 --2- 172.21.15.5:0/3930543265 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fa0800660d0 0x7fa080068580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa0840079c0 tx=0x7fa084008040 comp rx=0 tx=0).stop 2023-07-14T13:32:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.416+0000 7fa09a340640 1 -- 172.21.15.5:0/3930543265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09415a730 msgr2=0x7fa094144d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.416+0000 7fa09a340640 1 --2- 172.21.15.5:0/3930543265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09415a730 0x7fa094144d40 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fa08c007e40 tx=0x7fa08c00e4b0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.416+0000 7fa09a340640 1 -- 172.21.15.5:0/3930543265 shutdown_connections 2023-07-14T13:32:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.416+0000 7fa09a340640 1 --2- 172.21.15.5:0/3930543265 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fa0800660d0 0x7fa080068580 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.416+0000 7fa09a340640 1 --2- 172.21.15.5:0/3930543265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09415a730 0x7fa094144d40 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.416+0000 7fa09a340640 1 --2- 172.21.15.5:0/3930543265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0940b02b0 0x7fa0940706f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.416+0000 7fa09a340640 1 --2- 172.21.15.5:0/3930543265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa0940afee0 0x7fa09414d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.420+0000 7fa09a340640 1 -- 172.21.15.5:0/3930543265 >> 172.21.15.5:0/3930543265 conn(0x7fa09406c7b0 msgr2=0x7fa09415d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.420+0000 7fa09a340640 1 -- 172.21.15.5:0/3930543265 shutdown_connections 2023-07-14T13:32:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.420+0000 7fa09a340640 1 -- 172.21.15.5:0/3930543265 wait complete. 2023-07-14T13:32:09.439 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:32:09.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.580+0000 7f2c55669640 1 Processor -- start 2023-07-14T13:32:09.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.580+0000 7f2c55669640 1 -- start start 2023-07-14T13:32:09.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.584+0000 7f2c55669640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2c5006e770 0x7f2c500abd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:09.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.584+0000 7f2c55669640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2c500ce650 0x7f2c50069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:09.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.584+0000 7f2c55669640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c500cead0 0x7f2c50069970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:09.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.584+0000 7f2c55669640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c500c9950 con 0x7f2c5006e770 2023-07-14T13:32:09.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.584+0000 7f2c55669640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c5006eb40 con 0x7f2c500ce650 2023-07-14T13:32:09.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.584+0000 7f2c55669640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5015f900 con 0x7f2c500cead0 2023-07-14T13:32:09.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.584+0000 7f2c4ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2c5006e770 0x7f2c500abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:09.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.584+0000 7f2c4ffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2c5006e770 0x7f2c500abd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50966/0 (socket says 172.21.15.5:50966) 2023-07-14T13:32:09.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.584+0000 7f2c4ffff640 1 -- 172.21.15.5:0/2913591658 learned_addr learned my addr 172.21.15.5:0/2913591658 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:09.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.584+0000 7f2c4f7fe640 1 --2- 172.21.15.5:0/2913591658 >> v2:172.21.15.154:3300/0 conn(0x7f2c500ce650 0x7f2c50069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:09.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.584+0000 7f2c54e68640 1 --2- 172.21.15.5:0/2913591658 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c500cead0 0x7f2c50069970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:09.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.584+0000 7f2c4ffff640 1 -- 172.21.15.5:0/2913591658 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c500cead0 msgr2=0x7f2c50069970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:09.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.584+0000 7f2c4ffff640 1 --2- 172.21.15.5:0/2913591658 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c500cead0 0x7f2c50069970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.584+0000 7f2c4ffff640 1 -- 172.21.15.5:0/2913591658 >> v2:172.21.15.154:3300/0 conn(0x7f2c500ce650 msgr2=0x7f2c50069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:09.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.584+0000 7f2c4ffff640 1 --2- 172.21.15.5:0/2913591658 >> v2:172.21.15.154:3300/0 conn(0x7f2c500ce650 0x7f2c50069430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.584+0000 7f2c4ffff640 1 -- 172.21.15.5:0/2913591658 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5015fbe0 con 0x7f2c5006e770 2023-07-14T13:32:09.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.584+0000 7f2c4f7fe640 1 --2- 172.21.15.5:0/2913591658 >> v2:172.21.15.154:3300/0 conn(0x7f2c500ce650 0x7f2c50069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:09.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.584+0000 7f2c4ffff640 1 --2- 172.21.15.5:0/2913591658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c5006e770 0x7f2c500abd60 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f2c5006b600 tx=0x7f2c4001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=812d1466687a6787 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:09.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.588+0000 7f2c4effd640 1 -- 172.21.15.5:0/2913591658 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c400aa5f0 con 0x7f2c5006e770 2023-07-14T13:32:09.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.588+0000 7f2c4effd640 1 -- 172.21.15.5:0/2913591658 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c400aa750 con 0x7f2c5006e770 2023-07-14T13:32:09.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.588+0000 7f2c4effd640 1 -- 172.21.15.5:0/2913591658 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c400aaae0 con 0x7f2c5006e770 2023-07-14T13:32:09.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.588+0000 7f2c55669640 1 -- 172.21.15.5:0/2913591658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c5006e770 msgr2=0x7f2c500abd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:09.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.588+0000 7f2c55669640 1 --2- 172.21.15.5:0/2913591658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c5006e770 0x7f2c500abd60 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f2c5006b600 tx=0x7f2c4001c4d0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.588+0000 7f2c55669640 1 -- 172.21.15.5:0/2913591658 shutdown_connections 2023-07-14T13:32:09.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.588+0000 7f2c55669640 1 --2- 172.21.15.5:0/2913591658 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c500cead0 0x7f2c50069970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.588+0000 7f2c55669640 1 --2- 172.21.15.5:0/2913591658 >> v2:172.21.15.154:3300/0 conn(0x7f2c500ce650 0x7f2c50069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.588+0000 7f2c55669640 1 --2- 172.21.15.5:0/2913591658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c5006e770 0x7f2c500abd60 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.588+0000 7f2c55669640 1 -- 172.21.15.5:0/2913591658 >> 172.21.15.5:0/2913591658 conn(0x7f2c5006a540 msgr2=0x7f2c5006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:09.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.588+0000 7f2c55669640 1 -- 172.21.15.5:0/2913591658 shutdown_connections 2023-07-14T13:32:09.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.588+0000 7f2c55669640 1 -- 172.21.15.5:0/2913591658 wait complete. 2023-07-14T13:32:09.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.588+0000 7f2c55669640 1 Processor -- start 2023-07-14T13:32:09.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.588+0000 7f2c55669640 1 -- start start 2023-07-14T13:32:09.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.588+0000 7f2c55669640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c5006e770 0x7f2c50146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:09.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.588+0000 7f2c55669640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c500ce650 0x7f2c500ac2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.588+0000 7f2c55669640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c500cead0 0x7f2c500ac7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.588+0000 7f2c55669640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5006da60 con 0x7f2c500ce650 2023-07-14T13:32:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.588+0000 7f2c55669640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c50149900 con 0x7f2c5006e770 2023-07-14T13:32:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.588+0000 7f2c55669640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5006cee0 con 0x7f2c500cead0 2023-07-14T13:32:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.588+0000 7f2c4f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c500ce650 0x7f2c500ac2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.588+0000 7f2c4f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c500ce650 0x7f2c500ac2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50980/0 (socket says 172.21.15.5:50980) 2023-07-14T13:32:09.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.588+0000 7f2c4f7fe640 1 -- 172.21.15.5:0/3098837121 learned_addr learned my addr 172.21.15.5:0/3098837121 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:09.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.592+0000 7f2c4ffff640 1 --2- 172.21.15.5:0/3098837121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c5006e770 0x7f2c50146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:09.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.592+0000 7f2c54e68640 1 --2- 172.21.15.5:0/3098837121 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c500cead0 0x7f2c500ac7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:09.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.592+0000 7f2c4f7fe640 1 -- 172.21.15.5:0/3098837121 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c500cead0 msgr2=0x7f2c500ac7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:09.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.592+0000 7f2c4f7fe640 1 --2- 172.21.15.5:0/3098837121 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c500cead0 0x7f2c500ac7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.592+0000 7f2c4f7fe640 1 -- 172.21.15.5:0/3098837121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c5006e770 msgr2=0x7f2c50146f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:09.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.592+0000 7f2c4f7fe640 1 --2- 172.21.15.5:0/3098837121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c5006e770 0x7f2c50146f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.592+0000 7f2c4f7fe640 1 -- 172.21.15.5:0/3098837121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c400094d0 con 0x7f2c500ce650 2023-07-14T13:32:09.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.592+0000 7f2c4f7fe640 1 --2- 172.21.15.5:0/3098837121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c500ce650 0x7f2c500ac2b0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f2c4400e810 tx=0x7f2c4400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:09.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.592+0000 7f2c4cff9640 1 -- 172.21.15.5:0/3098837121 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c44004030 con 0x7f2c500ce650 2023-07-14T13:32:09.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.592+0000 7f2c4cff9640 1 -- 172.21.15.5:0/3098837121 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c44004190 con 0x7f2c500ce650 2023-07-14T13:32:09.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.592+0000 7f2c4cff9640 1 -- 172.21.15.5:0/3098837121 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c44004520 con 0x7f2c500ce650 2023-07-14T13:32:09.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.592+0000 7f2c55669640 1 -- 172.21.15.5:0/3098837121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c5006d1c0 con 0x7f2c500ce650 2023-07-14T13:32:09.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.592+0000 7f2c55669640 1 -- 172.21.15.5:0/3098837121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c5006d780 con 0x7f2c500ce650 2023-07-14T13:32:09.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.592+0000 7f2c55669640 1 -- 172.21.15.5:0/3098837121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c500c25e0 con 0x7f2c500ce650 2023-07-14T13:32:09.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.592+0000 7f2c4cff9640 1 -- 172.21.15.5:0/3098837121 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 94) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f2c4400c6d0 con 0x7f2c500ce650 2023-07-14T13:32:09.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.596+0000 7f2c4cff9640 1 --2- 172.21.15.5:0/3098837121 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f2c3c0660d0 0x7f2c3c068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:09.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.596+0000 7f2c4cff9640 1 -- 172.21.15.5:0/3098837121 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6864+0+0 (secure 0 0 0) 0x7f2c440837f0 con 0x7f2c500ce650 2023-07-14T13:32:09.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.596+0000 7f2c4ffff640 1 --2- 172.21.15.5:0/3098837121 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f2c3c0660d0 0x7f2c3c068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:09.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.596+0000 7f2c4ffff640 1 --2- 172.21.15.5:0/3098837121 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f2c3c0660d0 0x7f2c3c068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2c400ae000 tx=0x7f2c400b5040 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:09.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.600+0000 7f2c4cff9640 1 -- 172.21.15.5:0/3098837121 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2c44050c90 con 0x7f2c500ce650 2023-07-14T13:32:09.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.756+0000 7f2c55669640 1 -- 172.21.15.5:0/3098837121 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c500678d0 con 0x7f2c500ce650 2023-07-14T13:32:09.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.756+0000 7f2c4cff9640 1 -- 172.21.15.5:0/3098837121 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) v1 ==== 74+0+19540 (secure 0 0 0) 0x7f2c440542b0 con 0x7f2c500ce650 2023-07-14T13:32:09.758 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:09.759 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":178,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:32:08.041645+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:29:43.300974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-14T13:29:44.554824+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":177,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.7","mappings":[{"from":3,"to":0}]},{"pgid":"22.2b","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6832/3169896898":"2023-07-15T13:32:08.041591+0000","172.21.15.154:0/847094899":"2023-07-15T13:32:08.041591+0000","172.21.15.154:0/3251205969":"2023-07-15T13:32:08.041591+0000","172.21.15.154:0/2723104041":"2023-07-15T13:32:08.041591+0000","172.21.15.154:6833/1905284593":"2023-07-15T13:30:02.960482+0000","172.21.15.154:0/2675379455":"2023-07-15T13:32:08.041591+0000","172.21.15.154:6832/1905284593":"2023-07-15T13:30:02.960482+0000","172.21.15.154:0/4112878363":"2023-07-15T13:32:08.041591+0000","172.21.15.154:0/3194204879":"2023-07-15T13:30:02.960482+0000","172.21.15.154:0/3861552987":"2023-07-15T13:30:02.960482+0000","172.21.15.154:0/2010542927":"2023-07-15T13:30:02.960482+0000","172.21.15.154:0/1225132039":"2023-07-15T13:30:02.960482+0000","172.21.15.154:0/2878542364":"2023-07-15T13:32:08.041591+0000","172.21.15.154:0/2876445445":"2023-07-15T13:30:02.960482+0000","172.21.15.154:6833/3169896898":"2023-07-15T13:32:08.041591+0000","172.21.15.154:0/1648465409":"2023-07-15T13:30:02.960482+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:32:09.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.760+0000 7f2c55669640 1 -- 172.21.15.5:0/3098837121 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f2c3c0660d0 msgr2=0x7f2c3c068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:09.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.760+0000 7f2c55669640 1 --2- 172.21.15.5:0/3098837121 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f2c3c0660d0 0x7f2c3c068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2c400ae000 tx=0x7f2c400b5040 comp rx=0 tx=0).stop 2023-07-14T13:32:09.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.760+0000 7f2c55669640 1 -- 172.21.15.5:0/3098837121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c500ce650 msgr2=0x7f2c500ac2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:09.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.760+0000 7f2c55669640 1 --2- 172.21.15.5:0/3098837121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c500ce650 0x7f2c500ac2b0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f2c4400e810 tx=0x7f2c4400ecd0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.760+0000 7f2c55669640 1 -- 172.21.15.5:0/3098837121 shutdown_connections 2023-07-14T13:32:09.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.760+0000 7f2c55669640 1 --2- 172.21.15.5:0/3098837121 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f2c3c0660d0 0x7f2c3c068580 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.760+0000 7f2c55669640 1 --2- 172.21.15.5:0/3098837121 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2c500cead0 0x7f2c500ac7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.760+0000 7f2c55669640 1 --2- 172.21.15.5:0/3098837121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c500ce650 0x7f2c500ac2b0 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.760+0000 7f2c55669640 1 --2- 172.21.15.5:0/3098837121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c5006e770 0x7f2c50146f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.760+0000 7f2c55669640 1 -- 172.21.15.5:0/3098837121 >> 172.21.15.5:0/3098837121 conn(0x7f2c5006a540 msgr2=0x7f2c501546d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:09.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.760+0000 7f2c55669640 1 -- 172.21.15.5:0/3098837121 shutdown_connections 2023-07-14T13:32:09.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.760+0000 7f2c55669640 1 -- 172.21.15.5:0/3098837121 wait complete. 2023-07-14T13:32:09.780 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-14T13:32:09.780 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:32:09.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.920+0000 7f3cdf7c5640 1 Processor -- start 2023-07-14T13:32:09.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.924+0000 7f3cdf7c5640 1 -- start start 2023-07-14T13:32:09.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.924+0000 7f3cdf7c5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3cd8070b70 0x7f3cd8070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:09.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.924+0000 7f3cdf7c5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cd80cb100 0x7f3cd80cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:09.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.924+0000 7f3cdf7c5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd80cac70 con 0x7f3cd806b1e0 2023-07-14T13:32:09.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.924+0000 7f3cdf7c5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd80cbaa0 con 0x7f3cd8070b70 2023-07-14T13:32:09.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.924+0000 7f3cdf7c5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd8071480 con 0x7f3cd80cb100 2023-07-14T13:32:09.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.924+0000 7f3cdd561640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3cd8070b70 0x7f3cd8070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:09.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.924+0000 7f3cdcd60640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3cd806b1e0 0x7f3cd80c1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45452/0 (socket says 172.21.15.5:45452) 2023-07-14T13:32:09.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.924+0000 7f3cdd561640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3cd8070b70 0x7f3cd8070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50982/0 (socket says 172.21.15.5:50982) 2023-07-14T13:32:09.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.924+0000 7f3cdcd60640 1 -- 172.21.15.5:0/2515374650 learned_addr learned my addr 172.21.15.5:0/2515374650 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:09.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.924+0000 7f3cddd62640 1 --2- 172.21.15.5:0/2515374650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cd80cb100 0x7f3cd80cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:09.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.924+0000 7f3cdd561640 1 -- 172.21.15.5:0/2515374650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cd80cb100 msgr2=0x7f3cd80cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:09.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.924+0000 7f3cdd561640 1 --2- 172.21.15.5:0/2515374650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cd80cb100 0x7f3cd80cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.924+0000 7f3cdd561640 1 -- 172.21.15.5:0/2515374650 >> v1:172.21.15.5:6789/0 conn(0x7f3cd806b1e0 legacy=0x7f3cd80c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:09.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.924+0000 7f3ccffff640 1 -- 172.21.15.5:0/2515374650 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1863193534 0 0) 0x7f3cd80cac70 con 0x7f3cd806b1e0 2023-07-14T13:32:09.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.924+0000 7f3cdd561640 1 -- 172.21.15.5:0/2515374650 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd80ca060 con 0x7f3cd8070b70 2023-07-14T13:32:09.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.924+0000 7f3cddd62640 1 --2- 172.21.15.5:0/2515374650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cd80cb100 0x7f3cd80cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:32:09.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.928+0000 7f3cdd561640 1 --2- 172.21.15.5:0/2515374650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd8070b70 0x7f3cd8070f40 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f3cd40097c0 tx=0x7f3cd401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50034cd0d14710a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:09.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.928+0000 7f3ccffff640 1 -- 172.21.15.5:0/2515374650 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd40ab650 con 0x7f3cd8070b70 2023-07-14T13:32:09.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.928+0000 7f3ccffff640 1 -- 172.21.15.5:0/2515374650 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd40ab7b0 con 0x7f3cd8070b70 2023-07-14T13:32:09.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.928+0000 7f3ccffff640 1 -- 172.21.15.5:0/2515374650 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd40abb40 con 0x7f3cd8070b70 2023-07-14T13:32:09.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.928+0000 7f3cdf7c5640 1 -- 172.21.15.5:0/2515374650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd8070b70 msgr2=0x7f3cd8070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:09.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.928+0000 7f3cdf7c5640 1 --2- 172.21.15.5:0/2515374650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd8070b70 0x7f3cd8070f40 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f3cd40097c0 tx=0x7f3cd401c450 comp rx=0 tx=0).stop 2023-07-14T13:32:09.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.928+0000 7f3cdf7c5640 1 -- 172.21.15.5:0/2515374650 shutdown_connections 2023-07-14T13:32:09.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.928+0000 7f3cdf7c5640 1 --2- 172.21.15.5:0/2515374650 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cd80cb100 0x7f3cd80cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.928+0000 7f3cdf7c5640 1 --2- 172.21.15.5:0/2515374650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd8070b70 0x7f3cd8070f40 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.928+0000 7f3cdf7c5640 1 -- 172.21.15.5:0/2515374650 >> 172.21.15.5:0/2515374650 conn(0x7f3cd80afcf0 msgr2=0x7f3cd80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:09.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.928+0000 7f3cdf7c5640 1 -- 172.21.15.5:0/2515374650 shutdown_connections 2023-07-14T13:32:09.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.928+0000 7f3cdf7c5640 1 -- 172.21.15.5:0/2515374650 wait complete. 2023-07-14T13:32:09.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.928+0000 7f3cdf7c5640 1 Processor -- start 2023-07-14T13:32:09.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.928+0000 7f3cdf7c5640 1 -- start start 2023-07-14T13:32:09.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.932+0000 7f3cdf7c5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cd806b1e0 0x7f3cd814a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:09.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.932+0000 7f3cdf7c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cd8070b70 0x7f3cd814c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:09.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.932+0000 7f3cdf7c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd80cb100 0x7f3cd814c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:09.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.932+0000 7f3cdf7c5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd814e680 con 0x7f3cd80cb100 2023-07-14T13:32:09.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.932+0000 7f3cdf7c5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd814fbd0 con 0x7f3cd8070b70 2023-07-14T13:32:09.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.932+0000 7f3cdf7c5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd814abd0 con 0x7f3cd806b1e0 2023-07-14T13:32:09.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.932+0000 7f3cddd62640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd80cb100 0x7f3cd814c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:09.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.932+0000 7f3cddd62640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd80cb100 0x7f3cd814c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50984/0 (socket says 172.21.15.5:50984) 2023-07-14T13:32:09.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.932+0000 7f3cddd62640 1 -- 172.21.15.5:0/3265010749 learned_addr learned my addr 172.21.15.5:0/3265010749 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:09.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.932+0000 7f3cdcd60640 1 --2- 172.21.15.5:0/3265010749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cd8070b70 0x7f3cd814c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:09.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.932+0000 7f3cdd561640 1 --2- 172.21.15.5:0/3265010749 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cd806b1e0 0x7f3cd814a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:09.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.932+0000 7f3cddd62640 1 -- 172.21.15.5:0/3265010749 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cd806b1e0 msgr2=0x7f3cd814a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:09.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.932+0000 7f3cddd62640 1 --2- 172.21.15.5:0/3265010749 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cd806b1e0 0x7f3cd814a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.932+0000 7f3cddd62640 1 -- 172.21.15.5:0/3265010749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cd8070b70 msgr2=0x7f3cd814c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:09.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.932+0000 7f3cddd62640 1 --2- 172.21.15.5:0/3265010749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cd8070b70 0x7f3cd814c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:09.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.932+0000 7f3cddd62640 1 -- 172.21.15.5:0/3265010749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd4009420 con 0x7f3cd80cb100 2023-07-14T13:32:09.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.932+0000 7f3cdcd60640 1 --2- 172.21.15.5:0/3265010749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cd8070b70 0x7f3cd814c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:09.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.932+0000 7f3cddd62640 1 --2- 172.21.15.5:0/3265010749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd80cb100 0x7f3cd814c780 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000cef0 tx=0x7f3cd000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:09.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.932+0000 7f3ccdffb640 1 -- 172.21.15.5:0/3265010749 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd000d840 con 0x7f3cd80cb100 2023-07-14T13:32:09.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.932+0000 7f3ccdffb640 1 -- 172.21.15.5:0/3265010749 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd000d9c0 con 0x7f3cd80cb100 2023-07-14T13:32:09.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.932+0000 7f3ccdffb640 1 -- 172.21.15.5:0/3265010749 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd000dd70 con 0x7f3cd80cb100 2023-07-14T13:32:09.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.932+0000 7f3cdf7c5640 1 -- 172.21.15.5:0/3265010749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd814b990 con 0x7f3cd80cb100 2023-07-14T13:32:09.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.932+0000 7f3cdf7c5640 1 -- 172.21.15.5:0/3265010749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd814bf50 con 0x7f3cd80cb100 2023-07-14T13:32:09.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.932+0000 7f3cdf7c5640 1 -- 172.21.15.5:0/3265010749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd80678d0 con 0x7f3cd80cb100 2023-07-14T13:32:09.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.936+0000 7f3ccdffb640 1 -- 172.21.15.5:0/3265010749 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 94) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f3cd001e3b0 con 0x7f3cd80cb100 2023-07-14T13:32:09.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.936+0000 7f3ccdffb640 1 --2- 172.21.15.5:0/3265010749 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f3cbc0660d0 0x7f3cbc068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:09.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.936+0000 7f3ccdffb640 1 -- 172.21.15.5:0/3265010749 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6864+0+0 (secure 0 0 0) 0x7f3cd0084710 con 0x7f3cd80cb100 2023-07-14T13:32:09.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.936+0000 7f3cdd561640 1 --2- 172.21.15.5:0/3265010749 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f3cbc0660d0 0x7f3cbc068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:09.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.936+0000 7f3cdd561640 1 --2- 172.21.15.5:0/3265010749 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f3cbc0660d0 0x7f3cbc068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3cd40af000 tx=0x7f3cd40a7000 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:09.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:09.940+0000 7f3ccdffb640 1 -- 172.21.15.5:0/3265010749 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3cd0051c70 con 0x7f3cd80cb100 2023-07-14T13:32:10.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.128+0000 7f3cdf7c5640 1 -- 172.21.15.5:0/3265010749 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3cd814fd10 con 0x7f3cd80cb100 2023-07-14T13:32:10.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.128+0000 7f3ccdffb640 1 -- 172.21.15.5:0/3265010749 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4710 (secure 0 0 0) 0x7f3cd0055290 con 0x7f3cd80cb100 2023-07-14T13:32:10.131 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:10.131 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2329374117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2329374117},{"type":"v1","addr":"172.21.15.154:6835","nonce":2329374117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":9457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/811714286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":811714286},{"type":"v1","addr":"172.21.15.154:6837","nonce":811714286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":9954,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3020438262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3020438262},{"type":"v1","addr":"172.21.15.5:6833","nonce":3020438262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:29:45.555298+0000","modified":"2023-07-14T13:29:49.191310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9966":{"gid":9966,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/3098088945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3098088945},{"type":"v1","addr":"172.21.15.5:6835","nonce":3098088945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-14T13:32:10.132 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 83 2023-07-14T13:32:10.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.128+0000 7f3cdf7c5640 1 -- 172.21.15.5:0/3265010749 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f3cbc0660d0 msgr2=0x7f3cbc068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:10.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.128+0000 7f3cdf7c5640 1 --2- 172.21.15.5:0/3265010749 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f3cbc0660d0 0x7f3cbc068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3cd40af000 tx=0x7f3cd40a7000 comp rx=0 tx=0).stop 2023-07-14T13:32:10.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.128+0000 7f3cdf7c5640 1 -- 172.21.15.5:0/3265010749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd80cb100 msgr2=0x7f3cd814c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:10.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.128+0000 7f3cdf7c5640 1 --2- 172.21.15.5:0/3265010749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd80cb100 0x7f3cd814c780 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000cef0 tx=0x7f3cd000a710 comp rx=0 tx=0).stop 2023-07-14T13:32:10.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.128+0000 7f3cdf7c5640 1 -- 172.21.15.5:0/3265010749 shutdown_connections 2023-07-14T13:32:10.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.128+0000 7f3cdf7c5640 1 --2- 172.21.15.5:0/3265010749 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f3cbc0660d0 0x7f3cbc068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.128+0000 7f3cdf7c5640 1 --2- 172.21.15.5:0/3265010749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd80cb100 0x7f3cd814c780 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.128+0000 7f3cdf7c5640 1 --2- 172.21.15.5:0/3265010749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cd8070b70 0x7f3cd814c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.128+0000 7f3cdf7c5640 1 --2- 172.21.15.5:0/3265010749 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cd806b1e0 0x7f3cd814a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.128+0000 7f3cdf7c5640 1 -- 172.21.15.5:0/3265010749 >> 172.21.15.5:0/3265010749 conn(0x7f3cd80afcf0 msgr2=0x7f3cd80ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:10.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.128+0000 7f3cdf7c5640 1 -- 172.21.15.5:0/3265010749 shutdown_connections 2023-07-14T13:32:10.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.128+0000 7f3cdf7c5640 1 -- 172.21.15.5:0/3265010749 wait complete. 2023-07-14T13:32:10.152 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:32:10.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.296+0000 7faadea6d640 1 Processor -- start 2023-07-14T13:32:10.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.296+0000 7faadea6d640 1 -- start start 2023-07-14T13:32:10.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.296+0000 7faadea6d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faad806a540 0x7faad806a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:10.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.296+0000 7faadea6d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad80cdc80 con 0x7faad815f500 2023-07-14T13:32:10.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.296+0000 7faadea6d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad806e4c0 con 0x7faad80ce0f0 2023-07-14T13:32:10.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.296+0000 7faadea6d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad806af00 con 0x7faad806a540 2023-07-14T13:32:10.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.296+0000 7faadc809640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faad815f500 0x7faad806cef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45456/0 (socket says 172.21.15.5:45456) 2023-07-14T13:32:10.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.296+0000 7faadc809640 1 -- 172.21.15.5:0/1558674342 learned_addr learned my addr 172.21.15.5:0/1558674342 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:10.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.296+0000 7faad77fe640 1 -- 172.21.15.5:0/1558674342 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181468282 0 0) 0x7faad80cdc80 con 0x7faad815f500 2023-07-14T13:32:10.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.296+0000 7faad7fff640 1 --2- 172.21.15.5:0/1558674342 >> v2:172.21.15.154:3300/0 conn(0x7faad806a540 0x7faad806a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:10.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.296+0000 7faad77fe640 1 -- 172.21.15.5:0/1558674342 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faac8003530 con 0x7faad815f500 2023-07-14T13:32:10.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.296+0000 7faad77fe640 1 -- 172.21.15.5:0/1558674342 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2321426088 0 0) 0x7faac8003530 con 0x7faad815f500 2023-07-14T13:32:10.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.296+0000 7faad77fe640 1 -- 172.21.15.5:0/1558674342 >> v2:172.21.15.154:3300/0 conn(0x7faad806a540 msgr2=0x7faad806a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:10.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.296+0000 7faad77fe640 1 --2- 172.21.15.5:0/1558674342 >> v2:172.21.15.154:3300/0 conn(0x7faad806a540 0x7faad806a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.296+0000 7faad77fe640 1 -- 172.21.15.5:0/1558674342 >> v1:172.21.15.154:6789/0 conn(0x7faad80ce0f0 legacy=0x7faad80ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:10.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.296+0000 7faad77fe640 1 -- 172.21.15.5:0/1558674342 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad806d940 con 0x7faad815f500 2023-07-14T13:32:10.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.296+0000 7faad77fe640 1 -- 172.21.15.5:0/1558674342 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7faacc001800 con 0x7faad815f500 2023-07-14T13:32:10.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.296+0000 7faad77fe640 1 -- 172.21.15.5:0/1558674342 >> v1:172.21.15.5:6789/0 conn(0x7faad815f500 legacy=0x7faad806cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:10.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.296+0000 7faad77fe640 1 --2- 172.21.15.5:0/1558674342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faac8003980 0x7faac8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:10.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.296+0000 7faad77fe640 1 --2- 172.21.15.5:0/1558674342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac80047d0 0x7faac8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:10.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.296+0000 7faad77fe640 1 --2- 172.21.15.5:0/1558674342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faac8005180 0x7faac800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:10.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.296+0000 7faad77fe640 1 -- 172.21.15.5:0/1558674342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad806af00 con 0x7faac80047d0 2023-07-14T13:32:10.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.296+0000 7faad77fe640 1 -- 172.21.15.5:0/1558674342 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac800c000 con 0x7faac8003980 2023-07-14T13:32:10.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.296+0000 7faad77fe640 1 -- 172.21.15.5:0/1558674342 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac800c1c0 con 0x7faac8005180 2023-07-14T13:32:10.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.300+0000 7faad7fff640 1 --2- 172.21.15.5:0/1558674342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac80047d0 0x7faac8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:10.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.300+0000 7faadc809640 1 --2- 172.21.15.5:0/1558674342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faac8003980 0x7faac8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:10.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.300+0000 7faadd00a640 1 --2- 172.21.15.5:0/1558674342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faac8005180 0x7faac800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:10.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.300+0000 7faad7fff640 1 -- 172.21.15.5:0/1558674342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faac8005180 msgr2=0x7faac800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:10.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.300+0000 7faad7fff640 1 --2- 172.21.15.5:0/1558674342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faac8005180 0x7faac800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.300+0000 7faad7fff640 1 -- 172.21.15.5:0/1558674342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faac8003980 msgr2=0x7faac8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:10.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.300+0000 7faad7fff640 1 --2- 172.21.15.5:0/1558674342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faac8003980 0x7faac8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.300+0000 7faad7fff640 1 -- 172.21.15.5:0/1558674342 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac8003530 con 0x7faac80047d0 2023-07-14T13:32:10.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.300+0000 7faadc809640 1 --2- 172.21.15.5:0/1558674342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faac8003980 0x7faac8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:10.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.300+0000 7faadd00a640 1 -- 172.21.15.5:0/1558674342 reap_dead start 2023-07-14T13:32:10.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.300+0000 7faad7fff640 1 --2- 172.21.15.5:0/1558674342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac80047d0 0x7faac8004c40 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7faac4009ae0 tx=0x7faac401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8ea2173c2f60ea server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:10.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.300+0000 7faad77fe640 1 -- 172.21.15.5:0/1558674342 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac40a5560 con 0x7faac80047d0 2023-07-14T13:32:10.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.300+0000 7faad77fe640 1 -- 172.21.15.5:0/1558674342 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac40a56c0 con 0x7faac80047d0 2023-07-14T13:32:10.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.300+0000 7faad77fe640 1 -- 172.21.15.5:0/1558674342 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac40a5a70 con 0x7faac80047d0 2023-07-14T13:32:10.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.304+0000 7faadea6d640 1 -- 172.21.15.5:0/1558674342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac80047d0 msgr2=0x7faac8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:10.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.304+0000 7faadea6d640 1 --2- 172.21.15.5:0/1558674342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac80047d0 0x7faac8004c40 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7faac4009ae0 tx=0x7faac401ca50 comp rx=0 tx=0).stop 2023-07-14T13:32:10.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.304+0000 7faadea6d640 1 -- 172.21.15.5:0/1558674342 shutdown_connections 2023-07-14T13:32:10.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.304+0000 7faadea6d640 1 --2- 172.21.15.5:0/1558674342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faac80047d0 0x7faac8004c40 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.304+0000 7faadea6d640 1 -- 172.21.15.5:0/1558674342 >> 172.21.15.5:0/1558674342 conn(0x7faad80659d0 msgr2=0x7faad8099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:10.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.304+0000 7faadea6d640 1 -- 172.21.15.5:0/1558674342 shutdown_connections 2023-07-14T13:32:10.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.304+0000 7faadea6d640 1 -- 172.21.15.5:0/1558674342 wait complete. 2023-07-14T13:32:10.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.304+0000 7faadea6d640 1 Processor -- start 2023-07-14T13:32:10.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.304+0000 7faadea6d640 1 -- start start 2023-07-14T13:32:10.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.304+0000 7faadea6d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faac80047d0 0x7faad80cd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:10.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.304+0000 7faadea6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faad8154260 0x7faad8153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:10.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.304+0000 7faadea6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faad80b3fc0 0x7faad80b4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:10.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.304+0000 7faadea6d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad81558a0 con 0x7faad80b3fc0 2023-07-14T13:32:10.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.304+0000 7faadea6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad80b4970 con 0x7faad8154260 2023-07-14T13:32:10.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.304+0000 7faadea6d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad8153e40 con 0x7faac80047d0 2023-07-14T13:32:10.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.304+0000 7faadd00a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faad80b3fc0 0x7faad80b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:10.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.304+0000 7faadd00a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faad80b3fc0 0x7faad80b4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51002/0 (socket says 172.21.15.5:51002) 2023-07-14T13:32:10.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.304+0000 7faadd00a640 1 -- 172.21.15.5:0/1874389812 learned_addr learned my addr 172.21.15.5:0/1874389812 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:10.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.304+0000 7faad7fff640 1 --2- 172.21.15.5:0/1874389812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faad8154260 0x7faad8153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:10.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.304+0000 7faadc809640 1 --2- 172.21.15.5:0/1874389812 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faac80047d0 0x7faad80cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:10.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.304+0000 7faadd00a640 1 -- 172.21.15.5:0/1874389812 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faac80047d0 msgr2=0x7faad80cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:10.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.308+0000 7faadd00a640 1 --2- 172.21.15.5:0/1874389812 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faac80047d0 0x7faad80cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.308+0000 7faadd00a640 1 -- 172.21.15.5:0/1874389812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faad8154260 msgr2=0x7faad8153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:10.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.308+0000 7faadd00a640 1 --2- 172.21.15.5:0/1874389812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faad8154260 0x7faad8153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.308+0000 7faadd00a640 1 -- 172.21.15.5:0/1874389812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad8156e10 con 0x7faad80b3fc0 2023-07-14T13:32:10.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.308+0000 7faad7fff640 1 --2- 172.21.15.5:0/1874389812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faad8154260 0x7faad8153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:32:10.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.308+0000 7faadc809640 1 --2- 172.21.15.5:0/1874389812 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faac80047d0 0x7faad80cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:32:10.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.308+0000 7faadd00a640 1 --2- 172.21.15.5:0/1874389812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faad80b3fc0 0x7faad80b4430 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7faad8066010 tx=0x7faad000e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:10.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.308+0000 7faad57fa640 1 -- 172.21.15.5:0/1874389812 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad000ec30 con 0x7faad80b3fc0 2023-07-14T13:32:10.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.308+0000 7faad57fa640 1 -- 172.21.15.5:0/1874389812 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad000edb0 con 0x7faad80b3fc0 2023-07-14T13:32:10.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.308+0000 7faad57fa640 1 -- 172.21.15.5:0/1874389812 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad0003bc0 con 0x7faad80b3fc0 2023-07-14T13:32:10.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.308+0000 7faadea6d640 1 -- 172.21.15.5:0/1874389812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad8154800 con 0x7faad80b3fc0 2023-07-14T13:32:10.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.308+0000 7faadea6d640 1 -- 172.21.15.5:0/1874389812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad8154dc0 con 0x7faad80b3fc0 2023-07-14T13:32:10.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.308+0000 7faadea6d640 1 -- 172.21.15.5:0/1874389812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad80678d0 con 0x7faad80b3fc0 2023-07-14T13:32:10.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.308+0000 7faad57fa640 1 -- 172.21.15.5:0/1874389812 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 94) v1 ==== 85496+0+0 (secure 0 0 0) 0x7faad0003d20 con 0x7faad80b3fc0 2023-07-14T13:32:10.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.308+0000 7faad57fa640 1 --2- 172.21.15.5:0/1874389812 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7faabc0660d0 0x7faabc068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:10.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.308+0000 7faad57fa640 1 -- 172.21.15.5:0/1874389812 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6864+0+0 (secure 0 0 0) 0x7faad0082d10 con 0x7faad80b3fc0 2023-07-14T13:32:10.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.308+0000 7faadc809640 1 --2- 172.21.15.5:0/1874389812 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7faabc0660d0 0x7faabc068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:10.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.312+0000 7faadc809640 1 --2- 172.21.15.5:0/1874389812 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7faabc0660d0 0x7faabc068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faacc001390 tx=0x7faacc0012a0 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:10.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.312+0000 7faad57fa640 1 -- 172.21.15.5:0/1874389812 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7faad00501b0 con 0x7faad80b3fc0 2023-07-14T13:32:10.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.320+0000 7faad57fa640 1 -- 172.21.15.5:0/1874389812 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7faad0050580 con 0x7faad80b3fc0 2023-07-14T13:32:10.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.504+0000 7faadea6d640 1 -- 172.21.15.5:0/1874389812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faad80ca2b0 con 0x7faad80b3fc0 2023-07-14T13:32:10.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.504+0000 7faad57fa640 1 -- 172.21.15.5:0/1874389812 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4710 (secure 0 0 0) 0x7faad006db00 con 0x7faad80b3fc0 2023-07-14T13:32:10.506 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:10.506 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2329374117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2329374117},{"type":"v1","addr":"172.21.15.154:6835","nonce":2329374117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":9457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/811714286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":811714286},{"type":"v1","addr":"172.21.15.154:6837","nonce":811714286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":9954,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3020438262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3020438262},{"type":"v1","addr":"172.21.15.5:6833","nonce":3020438262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:29:45.555298+0000","modified":"2023-07-14T13:29:49.191310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9966},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9966":{"gid":9966,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6835/3098088945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":3098088945},{"type":"v1","addr":"172.21.15.5:6835","nonce":3098088945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-14T13:32:10.507 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 83 2023-07-14T13:32:10.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.504+0000 7faadea6d640 1 -- 172.21.15.5:0/1874389812 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7faabc0660d0 msgr2=0x7faabc068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:10.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.504+0000 7faadea6d640 1 --2- 172.21.15.5:0/1874389812 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7faabc0660d0 0x7faabc068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faacc001390 tx=0x7faacc0012a0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.504+0000 7faadea6d640 1 -- 172.21.15.5:0/1874389812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faad80b3fc0 msgr2=0x7faad80b4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:10.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.504+0000 7faadea6d640 1 --2- 172.21.15.5:0/1874389812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faad80b3fc0 0x7faad80b4430 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7faad8066010 tx=0x7faad000e7c0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.504+0000 7faadea6d640 1 -- 172.21.15.5:0/1874389812 shutdown_connections 2023-07-14T13:32:10.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.504+0000 7faadea6d640 1 --2- 172.21.15.5:0/1874389812 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7faabc0660d0 0x7faabc068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.504+0000 7faadea6d640 1 --2- 172.21.15.5:0/1874389812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faad80b3fc0 0x7faad80b4430 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.504+0000 7faadea6d640 1 --2- 172.21.15.5:0/1874389812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faad8154260 0x7faad8153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.504+0000 7faadea6d640 1 --2- 172.21.15.5:0/1874389812 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faac80047d0 0x7faad80cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.504+0000 7faadea6d640 1 -- 172.21.15.5:0/1874389812 >> 172.21.15.5:0/1874389812 conn(0x7faad80659d0 msgr2=0x7faad80ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:10.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.504+0000 7faadea6d640 1 -- 172.21.15.5:0/1874389812 shutdown_connections 2023-07-14T13:32:10.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.504+0000 7faadea6d640 1 -- 172.21.15.5:0/1874389812 wait complete. 2023-07-14T13:32:10.526 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:32:10.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.668+0000 7fbcecaca640 1 Processor -- start 2023-07-14T13:32:10.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.668+0000 7fbcecaca640 1 -- start start 2023-07-14T13:32:10.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.668+0000 7fbcecaca640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbce80b7c70 0x7fbce80d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.668+0000 7fbcecaca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbce80d1850 0x7fbce815f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.668+0000 7fbcecaca640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbce80d1300 0x7fbce815fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.668+0000 7fbcecaca640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce80d1190 con 0x7fbce80d1300 2023-07-14T13:32:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.668+0000 7fbcecaca640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce8160600 con 0x7fbce80b7c70 2023-07-14T13:32:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.668+0000 7fbcecaca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce81600d0 con 0x7fbce80d1850 2023-07-14T13:32:10.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.668+0000 7fbce6d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbce80d1300 0x7fbce815fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.668+0000 7fbce6d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbce80d1300 0x7fbce815fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51006/0 (socket says 172.21.15.5:51006) 2023-07-14T13:32:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.668+0000 7fbce6d9d640 1 -- 172.21.15.5:0/499851899 learned_addr learned my addr 172.21.15.5:0/499851899 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.668+0000 7fbce659c640 1 --2- 172.21.15.5:0/499851899 >> v2:172.21.15.154:3300/0 conn(0x7fbce80b7c70 0x7fbce80d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:10.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.668+0000 7fbcdffff640 1 --2- 172.21.15.5:0/499851899 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbce80d1850 0x7fbce815f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.668+0000 7fbce6d9d640 1 -- 172.21.15.5:0/499851899 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbce80d1850 msgr2=0x7fbce815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.668+0000 7fbce6d9d640 1 --2- 172.21.15.5:0/499851899 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbce80d1850 0x7fbce815f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.668+0000 7fbce6d9d640 1 -- 172.21.15.5:0/499851899 >> v2:172.21.15.154:3300/0 conn(0x7fbce80b7c70 msgr2=0x7fbce80d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.668+0000 7fbce6d9d640 1 --2- 172.21.15.5:0/499851899 >> v2:172.21.15.154:3300/0 conn(0x7fbce80b7c70 0x7fbce80d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.668+0000 7fbce6d9d640 1 -- 172.21.15.5:0/499851899 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce80ccaf0 con 0x7fbce80d1300 2023-07-14T13:32:10.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.668+0000 7fbcdffff640 1 --2- 172.21.15.5:0/499851899 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbce80d1850 0x7fbce815f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:10.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.672+0000 7fbce6d9d640 1 --2- 172.21.15.5:0/499851899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbce80d1300 0x7fbce815fb90 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fbce80b40a0 tx=0x7fbce001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79eaadcad4c6e2fb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:10.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.672+0000 7fbce5d9b640 1 -- 172.21.15.5:0/499851899 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce00a5730 con 0x7fbce80d1300 2023-07-14T13:32:10.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.672+0000 7fbce5d9b640 1 -- 172.21.15.5:0/499851899 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce00a5890 con 0x7fbce80d1300 2023-07-14T13:32:10.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.672+0000 7fbce5d9b640 1 -- 172.21.15.5:0/499851899 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce00a5c20 con 0x7fbce80d1300 2023-07-14T13:32:10.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.672+0000 7fbcecaca640 1 -- 172.21.15.5:0/499851899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbce80d1300 msgr2=0x7fbce815fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:10.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.672+0000 7fbcecaca640 1 --2- 172.21.15.5:0/499851899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbce80d1300 0x7fbce815fb90 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fbce80b40a0 tx=0x7fbce001c9a0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.672+0000 7fbcecaca640 1 -- 172.21.15.5:0/499851899 shutdown_connections 2023-07-14T13:32:10.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.672+0000 7fbcecaca640 1 --2- 172.21.15.5:0/499851899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbce80d1300 0x7fbce815fb90 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.672+0000 7fbcecaca640 1 --2- 172.21.15.5:0/499851899 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbce80d1850 0x7fbce815f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.672+0000 7fbcecaca640 1 --2- 172.21.15.5:0/499851899 >> v2:172.21.15.154:3300/0 conn(0x7fbce80b7c70 0x7fbce80d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.672+0000 7fbcecaca640 1 -- 172.21.15.5:0/499851899 >> 172.21.15.5:0/499851899 conn(0x7fbce80650b0 msgr2=0x7fbce80654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:10.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.672+0000 7fbcecaca640 1 -- 172.21.15.5:0/499851899 shutdown_connections 2023-07-14T13:32:10.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.672+0000 7fbcecaca640 1 -- 172.21.15.5:0/499851899 wait complete. 2023-07-14T13:32:10.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.676+0000 7fbcecaca640 1 Processor -- start 2023-07-14T13:32:10.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.676+0000 7fbcecaca640 1 -- start start 2023-07-14T13:32:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.676+0000 7fbcecaca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbce80b7c70 0x7fbce81f8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.676+0000 7fbcecaca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbce80d1300 0x7fbce815dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.676+0000 7fbcecaca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbce80d1850 0x7fbce81f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.676+0000 7fbcecaca640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce81f4ad0 con 0x7fbce80d1850 2023-07-14T13:32:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.676+0000 7fbcecaca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce81f4db0 con 0x7fbce80b7c70 2023-07-14T13:32:10.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.676+0000 7fbcecaca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce81f7540 con 0x7fbce80d1300 2023-07-14T13:32:10.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.676+0000 7fbce6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbce80d1850 0x7fbce81f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:10.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.676+0000 7fbce6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbce80d1850 0x7fbce81f3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51018/0 (socket says 172.21.15.5:51018) 2023-07-14T13:32:10.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.676+0000 7fbce6d9d640 1 -- 172.21.15.5:0/3040123023 learned_addr learned my addr 172.21.15.5:0/3040123023 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:10.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.676+0000 7fbce659c640 1 --2- 172.21.15.5:0/3040123023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbce80b7c70 0x7fbce81f8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:10.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.676+0000 7fbcdffff640 1 --2- 172.21.15.5:0/3040123023 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbce80d1300 0x7fbce815dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:10.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.676+0000 7fbce6d9d640 1 -- 172.21.15.5:0/3040123023 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbce80d1300 msgr2=0x7fbce815dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:10.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.676+0000 7fbce6d9d640 1 --2- 172.21.15.5:0/3040123023 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbce80d1300 0x7fbce815dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.676+0000 7fbce6d9d640 1 -- 172.21.15.5:0/3040123023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbce80b7c70 msgr2=0x7fbce81f8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:10.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.676+0000 7fbce6d9d640 1 --2- 172.21.15.5:0/3040123023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbce80b7c70 0x7fbce81f8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.676+0000 7fbce6d9d640 1 -- 172.21.15.5:0/3040123023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce0009b30 con 0x7fbce80d1850 2023-07-14T13:32:10.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.676+0000 7fbcdffff640 1 --2- 172.21.15.5:0/3040123023 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbce80d1300 0x7fbce815dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:10.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.676+0000 7fbce6d9d640 1 --2- 172.21.15.5:0/3040123023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbce80d1850 0x7fbce81f3f60 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fbce001b050 tx=0x7fbce0019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:10.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.680+0000 7fbcdeffd640 1 -- 172.21.15.5:0/3040123023 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce00b8670 con 0x7fbce80d1850 2023-07-14T13:32:10.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.680+0000 7fbcdeffd640 1 -- 172.21.15.5:0/3040123023 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce00b8810 con 0x7fbce80d1850 2023-07-14T13:32:10.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.680+0000 7fbcecaca640 1 -- 172.21.15.5:0/3040123023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce81f7820 con 0x7fbce80d1850 2023-07-14T13:32:10.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.680+0000 7fbcdeffd640 1 -- 172.21.15.5:0/3040123023 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce00b8bc0 con 0x7fbce80d1850 2023-07-14T13:32:10.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.680+0000 7fbcecaca640 1 -- 172.21.15.5:0/3040123023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce80c7fe0 con 0x7fbce80d1850 2023-07-14T13:32:10.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.680+0000 7fbcecaca640 1 -- 172.21.15.5:0/3040123023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce80678d0 con 0x7fbce80d1850 2023-07-14T13:32:10.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.680+0000 7fbcdeffd640 1 -- 172.21.15.5:0/3040123023 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbce00b8d20 con 0x7fbce80d1850 2023-07-14T13:32:10.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.680+0000 7fbcdeffd640 1 --2- 172.21.15.5:0/3040123023 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fbcc80663a0 0x7fbcc8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:10.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.680+0000 7fbcdeffd640 1 -- 172.21.15.5:0/3040123023 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6864+0+0 (secure 0 0 0) 0x7fbce011f6c0 con 0x7fbce80d1850 2023-07-14T13:32:10.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.680+0000 7fbce659c640 1 --2- 172.21.15.5:0/3040123023 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fbcc80663a0 0x7fbcc8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:10.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.684+0000 7fbce659c640 1 --2- 172.21.15.5:0/3040123023 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fbcc80663a0 0x7fbcc8068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8009b60 tx=0x7fbcd8009190 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:10.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.684+0000 7fbcdeffd640 1 -- 172.21.15.5:0/3040123023 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fbce00ec8f0 con 0x7fbce80d1850 2023-07-14T13:32:10.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.840+0000 7fbcecaca640 1 -- 172.21.15.5:0/3040123023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbce80c5bb0 con 0x7fbce80d1850 2023-07-14T13:32:10.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.840+0000 7fbcdeffd640 1 -- 172.21.15.5:0/3040123023 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) v1 ==== 74+0+19540 (secure 0 0 0) 0x7fbce00eff10 con 0x7fbce80d1850 2023-07-14T13:32:10.844 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:10.844 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":178,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:32:08.041645+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:29:43.300974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-14T13:29:44.554824+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":177,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.7","mappings":[{"from":3,"to":0}]},{"pgid":"22.2b","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6832/3169896898":"2023-07-15T13:32:08.041591+0000","172.21.15.154:0/847094899":"2023-07-15T13:32:08.041591+0000","172.21.15.154:0/3251205969":"2023-07-15T13:32:08.041591+0000","172.21.15.154:0/2723104041":"2023-07-15T13:32:08.041591+0000","172.21.15.154:6833/1905284593":"2023-07-15T13:30:02.960482+0000","172.21.15.154:0/2675379455":"2023-07-15T13:32:08.041591+0000","172.21.15.154:6832/1905284593":"2023-07-15T13:30:02.960482+0000","172.21.15.154:0/4112878363":"2023-07-15T13:32:08.041591+0000","172.21.15.154:0/3194204879":"2023-07-15T13:30:02.960482+0000","172.21.15.154:0/3861552987":"2023-07-15T13:30:02.960482+0000","172.21.15.154:0/2010542927":"2023-07-15T13:30:02.960482+0000","172.21.15.154:0/1225132039":"2023-07-15T13:30:02.960482+0000","172.21.15.154:0/2878542364":"2023-07-15T13:32:08.041591+0000","172.21.15.154:0/2876445445":"2023-07-15T13:30:02.960482+0000","172.21.15.154:6833/3169896898":"2023-07-15T13:32:08.041591+0000","172.21.15.154:0/1648465409":"2023-07-15T13:30:02.960482+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:32:10.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.844+0000 7fbcecaca640 1 -- 172.21.15.5:0/3040123023 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fbcc80663a0 msgr2=0x7fbcc8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:10.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.844+0000 7fbcecaca640 1 --2- 172.21.15.5:0/3040123023 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fbcc80663a0 0x7fbcc8068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8009b60 tx=0x7fbcd8009190 comp rx=0 tx=0).stop 2023-07-14T13:32:10.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.844+0000 7fbcecaca640 1 -- 172.21.15.5:0/3040123023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbce80d1850 msgr2=0x7fbce81f3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:10.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.844+0000 7fbcecaca640 1 --2- 172.21.15.5:0/3040123023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbce80d1850 0x7fbce81f3f60 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fbce001b050 tx=0x7fbce0019740 comp rx=0 tx=0).stop 2023-07-14T13:32:10.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.844+0000 7fbcecaca640 1 -- 172.21.15.5:0/3040123023 shutdown_connections 2023-07-14T13:32:10.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.844+0000 7fbcecaca640 1 --2- 172.21.15.5:0/3040123023 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fbcc80663a0 0x7fbcc8068850 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.844+0000 7fbcecaca640 1 --2- 172.21.15.5:0/3040123023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbce80d1850 0x7fbce81f3f60 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.844+0000 7fbcecaca640 1 --2- 172.21.15.5:0/3040123023 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbce80d1300 0x7fbce815dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.844+0000 7fbcecaca640 1 --2- 172.21.15.5:0/3040123023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbce80b7c70 0x7fbce81f8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:10.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.844+0000 7fbcecaca640 1 -- 172.21.15.5:0/3040123023 >> 172.21.15.5:0/3040123023 conn(0x7fbce80650b0 msgr2=0x7fbce80cfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:10.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.844+0000 7fbcecaca640 1 -- 172.21.15.5:0/3040123023 shutdown_connections 2023-07-14T13:32:10.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:10.844+0000 7fbcecaca640 1 -- 172.21.15.5:0/3040123023 wait complete. 2023-07-14T13:32:10.865 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-14T13:32:11.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.008+0000 7f2661a6d640 1 Processor -- start 2023-07-14T13:32:11.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.008+0000 7f2661a6d640 1 -- start start 2023-07-14T13:32:11.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f2661a6d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f265c0c8ad0 0x7f265c0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:11.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f2661a6d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f265c0c9560 0x7f265c0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:11.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f2661a6d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f265c0cc700 con 0x7f265c158ce0 2023-07-14T13:32:11.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f2661a6d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f265c0c99e0 con 0x7f265c0c9560 2023-07-14T13:32:11.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f2661a6d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265c0b0ff0 con 0x7f265c0c8ad0 2023-07-14T13:32:11.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265b7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f265c158ce0 0x7f265c070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45462/0 (socket says 172.21.15.5:45462) 2023-07-14T13:32:11.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265b7fe640 1 -- 172.21.15.5:0/2343094948 learned_addr learned my addr 172.21.15.5:0/2343094948 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:11.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265bfff640 1 --2- 172.21.15.5:0/2343094948 >> v2:172.21.15.154:3300/0 conn(0x7f265c0c9560 0x7f265c0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:11.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265affd640 1 --2- 172.21.15.5:0/2343094948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f265c0c8ad0 0x7f265c0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:11.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265a7fc640 1 -- 172.21.15.5:0/2343094948 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2612890240 0 0) 0x7f265c0cc700 con 0x7f265c158ce0 2023-07-14T13:32:11.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265a7fc640 1 -- 172.21.15.5:0/2343094948 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2644003530 con 0x7f265c158ce0 2023-07-14T13:32:11.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265a7fc640 1 -- 172.21.15.5:0/2343094948 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 122468491 0 0) 0x7f2644003530 con 0x7f265c158ce0 2023-07-14T13:32:11.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265a7fc640 1 -- 172.21.15.5:0/2343094948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f265c0c8ad0 msgr2=0x7f265c0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:11.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265a7fc640 1 --2- 172.21.15.5:0/2343094948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f265c0c8ad0 0x7f265c0c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:11.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265a7fc640 1 -- 172.21.15.5:0/2343094948 >> v2:172.21.15.154:3300/0 conn(0x7f265c0c9560 msgr2=0x7f265c0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:11.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265a7fc640 1 --2- 172.21.15.5:0/2343094948 >> v2:172.21.15.154:3300/0 conn(0x7f265c0c9560 0x7f265c0ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:11.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265a7fc640 1 -- 172.21.15.5:0/2343094948 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f265c070c80 con 0x7f265c158ce0 2023-07-14T13:32:11.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265a7fc640 1 -- 172.21.15.5:0/2343094948 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f264c001680 con 0x7f265c158ce0 2023-07-14T13:32:11.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265a7fc640 1 -- 172.21.15.5:0/2343094948 >> v1:172.21.15.5:6789/0 conn(0x7f265c158ce0 legacy=0x7f265c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:11.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265a7fc640 1 --2- 172.21.15.5:0/2343094948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2644003980 0x7f2644003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:11.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265a7fc640 1 --2- 172.21.15.5:0/2343094948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26440047d0 0x7f2644004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:11.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265a7fc640 1 --2- 172.21.15.5:0/2343094948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f265c0c8ad0 0x7f2644005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:11.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265a7fc640 1 -- 172.21.15.5:0/2343094948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c0c99e0 con 0x7f26440047d0 2023-07-14T13:32:11.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265a7fc640 1 -- 172.21.15.5:0/2343094948 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c0b0ff0 con 0x7f2644003980 2023-07-14T13:32:11.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265a7fc640 1 -- 172.21.15.5:0/2343094948 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264400ba10 con 0x7f265c0c8ad0 2023-07-14T13:32:11.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265affd640 1 --2- 172.21.15.5:0/2343094948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26440047d0 0x7f2644004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:11.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265b7fe640 1 --2- 172.21.15.5:0/2343094948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2644003980 0x7f2644003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:11.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265bfff640 1 --2- 172.21.15.5:0/2343094948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f265c0c8ad0 0x7f2644005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:11.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265affd640 1 -- 172.21.15.5:0/2343094948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f265c0c8ad0 msgr2=0x7f2644005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:11.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265affd640 1 --2- 172.21.15.5:0/2343094948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f265c0c8ad0 0x7f2644005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:11.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265affd640 1 -- 172.21.15.5:0/2343094948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2644003980 msgr2=0x7f2644003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:11.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265affd640 1 --2- 172.21.15.5:0/2343094948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2644003980 0x7f2644003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:11.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.012+0000 7f265affd640 1 -- 172.21.15.5:0/2343094948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2644003530 con 0x7f26440047d0 2023-07-14T13:32:11.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.016+0000 7f265affd640 1 --2- 172.21.15.5:0/2343094948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26440047d0 0x7f2644004c40 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f2650009ae0 tx=0x7f265001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3372b0c88fc9c22 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:11.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.016+0000 7f265a7fc640 1 -- 172.21.15.5:0/2343094948 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26500a6510 con 0x7f26440047d0 2023-07-14T13:32:11.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.016+0000 7f265a7fc640 1 -- 172.21.15.5:0/2343094948 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26500a6670 con 0x7f26440047d0 2023-07-14T13:32:11.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.016+0000 7f265a7fc640 1 -- 172.21.15.5:0/2343094948 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26500a6a20 con 0x7f26440047d0 2023-07-14T13:32:11.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.016+0000 7f2661a6d640 1 -- 172.21.15.5:0/2343094948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26440047d0 msgr2=0x7f2644004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:11.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.016+0000 7f2661a6d640 1 --2- 172.21.15.5:0/2343094948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26440047d0 0x7f2644004c40 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f2650009ae0 tx=0x7f265001ca20 comp rx=0 tx=0).stop 2023-07-14T13:32:11.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.016+0000 7f265bfff640 1 -- 172.21.15.5:0/2343094948 reap_dead start 2023-07-14T13:32:11.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.016+0000 7f2661a6d640 1 -- 172.21.15.5:0/2343094948 shutdown_connections 2023-07-14T13:32:11.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.016+0000 7f2661a6d640 1 -- 172.21.15.5:0/2343094948 >> 172.21.15.5:0/2343094948 conn(0x7f265c0afcf0 msgr2=0x7f265c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:11.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.016+0000 7f2661a6d640 1 -- 172.21.15.5:0/2343094948 shutdown_connections 2023-07-14T13:32:11.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.016+0000 7f2661a6d640 1 -- 172.21.15.5:0/2343094948 wait complete. 2023-07-14T13:32:11.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.016+0000 7f2661a6d640 1 Processor -- start 2023-07-14T13:32:11.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.016+0000 7f2661a6d640 1 -- start start 2023-07-14T13:32:11.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.020+0000 7f2661a6d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26440047d0 0x7f265c14b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:11.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.020+0000 7f2661a6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f265c14c970 0x7f265c14e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:11.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.020+0000 7f2661a6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f265c14e570 0x7f265c0adbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:11.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.020+0000 7f2661a6d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c1533c0 con 0x7f265c14c970 2023-07-14T13:32:11.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.020+0000 7f2661a6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c1536a0 con 0x7f265c14e570 2023-07-14T13:32:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.020+0000 7f2661a6d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265c14be90 con 0x7f26440047d0 2023-07-14T13:32:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.020+0000 7f265affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f265c14c970 0x7f265c14e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.020+0000 7f265affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f265c14c970 0x7f265c14e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51040/0 (socket says 172.21.15.5:51040) 2023-07-14T13:32:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.020+0000 7f265affd640 1 -- 172.21.15.5:0/1808328516 learned_addr learned my addr 172.21.15.5:0/1808328516 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.020+0000 7f265bfff640 1 --2- 172.21.15.5:0/1808328516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f265c14e570 0x7f265c0adbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.020+0000 7f265b7fe640 1 --2- 172.21.15.5:0/1808328516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26440047d0 0x7f265c14b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:11.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.020+0000 7f265affd640 1 -- 172.21.15.5:0/1808328516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26440047d0 msgr2=0x7f265c14b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:11.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.020+0000 7f265affd640 1 --2- 172.21.15.5:0/1808328516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26440047d0 0x7f265c14b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:11.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.020+0000 7f265affd640 1 -- 172.21.15.5:0/1808328516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f265c14e570 msgr2=0x7f265c0adbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:11.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.020+0000 7f265affd640 1 --2- 172.21.15.5:0/1808328516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f265c14e570 0x7f265c0adbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:11.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.020+0000 7f265affd640 1 -- 172.21.15.5:0/1808328516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f265c14c170 con 0x7f265c14c970 2023-07-14T13:32:11.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.020+0000 7f265bfff640 1 --2- 172.21.15.5:0/1808328516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f265c14e570 0x7f265c0adbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:32:11.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.020+0000 7f265b7fe640 1 --2- 172.21.15.5:0/1808328516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26440047d0 0x7f265c14b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:32:11.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.020+0000 7f265affd640 1 --2- 172.21.15.5:0/1808328516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f265c14c970 0x7f265c14e030 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f26500b0040 tx=0x7f2644005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:11.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.020+0000 7f2643fff640 1 -- 172.21.15.5:0/1808328516 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265000f000 con 0x7f265c14c970 2023-07-14T13:32:11.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.020+0000 7f2643fff640 1 -- 172.21.15.5:0/1808328516 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2650004020 con 0x7f265c14c970 2023-07-14T13:32:11.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.020+0000 7f2643fff640 1 -- 172.21.15.5:0/1808328516 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26500043b0 con 0x7f265c14c970 2023-07-14T13:32:11.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.020+0000 7f2661a6d640 1 -- 172.21.15.5:0/1808328516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f265c14c450 con 0x7f265c14c970 2023-07-14T13:32:11.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.020+0000 7f2661a6d640 1 -- 172.21.15.5:0/1808328516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f265c153180 con 0x7f265c14c970 2023-07-14T13:32:11.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.020+0000 7f2661a6d640 1 -- 172.21.15.5:0/1808328516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f265c0ca1a0 con 0x7f265c14c970 2023-07-14T13:32:11.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.020+0000 7f2643fff640 1 -- 172.21.15.5:0/1808328516 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f26500a67e0 con 0x7f265c14c970 2023-07-14T13:32:11.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.024+0000 7f2643fff640 1 --2- 172.21.15.5:0/1808328516 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f26480663a0 0x7f2648068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:11.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.024+0000 7f2643fff640 1 -- 172.21.15.5:0/1808328516 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6864+0+0 (secure 0 0 0) 0x7f26500aa070 con 0x7f265c14c970 2023-07-14T13:32:11.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.024+0000 7f265b7fe640 1 --2- 172.21.15.5:0/1808328516 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f26480663a0 0x7f2648068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:11.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.024+0000 7f265b7fe640 1 --2- 172.21.15.5:0/1808328516 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f26480663a0 0x7f2648068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f264c001130 tx=0x7f264c009040 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:11.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.028+0000 7f2643fff640 1 -- 172.21.15.5:0/1808328516 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f26500eb2a0 con 0x7f265c14c970 2023-07-14T13:32:11.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.224+0000 7f2661a6d640 1 -- 172.21.15.5:0/1808328516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f265c153180 con 0x7f265c14c970 2023-07-14T13:32:11.226 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-07-14T13:32:11.224+0000 7f17b1648640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-14T13:32:11.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.232+0000 7f2643fff640 1 -- 172.21.15.5:0/1808328516 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v84) v1 ==== 161+0+0 (secure 0 0 0) 0x7f265c153180 con 0x7f265c14c970 2023-07-14T13:32:11.232 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-14T13:32:11.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.232+0000 7f2661a6d640 1 -- 172.21.15.5:0/1808328516 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f26480663a0 msgr2=0x7f2648068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:11.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.232+0000 7f2661a6d640 1 --2- 172.21.15.5:0/1808328516 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f26480663a0 0x7f2648068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f264c001130 tx=0x7f264c009040 comp rx=0 tx=0).stop 2023-07-14T13:32:11.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.232+0000 7f2661a6d640 1 -- 172.21.15.5:0/1808328516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f265c14c970 msgr2=0x7f265c14e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:11.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.232+0000 7f2661a6d640 1 --2- 172.21.15.5:0/1808328516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f265c14c970 0x7f265c14e030 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f26500b0040 tx=0x7f2644005800 comp rx=0 tx=0).stop 2023-07-14T13:32:11.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.232+0000 7f2661a6d640 1 -- 172.21.15.5:0/1808328516 shutdown_connections 2023-07-14T13:32:11.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.232+0000 7f2661a6d640 1 --2- 172.21.15.5:0/1808328516 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f26480663a0 0x7f2648068850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:11.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.232+0000 7f2661a6d640 1 --2- 172.21.15.5:0/1808328516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f265c14e570 0x7f265c0adbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:11.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.232+0000 7f2661a6d640 1 --2- 172.21.15.5:0/1808328516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f265c14c970 0x7f265c14e030 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:11.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.232+0000 7f2661a6d640 1 --2- 172.21.15.5:0/1808328516 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f26440047d0 0x7f265c14b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:11.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.232+0000 7f2661a6d640 1 -- 172.21.15.5:0/1808328516 >> 172.21.15.5:0/1808328516 conn(0x7f265c0afcf0 msgr2=0x7f265c156c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:11.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.232+0000 7f2661a6d640 1 -- 172.21.15.5:0/1808328516 shutdown_connections 2023-07-14T13:32:11.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.232+0000 7f2661a6d640 1 -- 172.21.15.5:0/1808328516 wait complete. 2023-07-14T13:32:11.255 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-14T13:32:11.297 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-07-14T13:32:11.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.400+0000 7f7ee8dad640 1 Processor -- start 2023-07-14T13:32:11.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.400+0000 7f7ee8dad640 1 -- start start 2023-07-14T13:32:11.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.404+0000 7f7ee8dad640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7ee415bd50 0x7f7ee4069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:11.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.404+0000 7f7ee8dad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ee406fcf0 0x7f7ee4070150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:11.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.404+0000 7f7ee8dad640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee4069970 con 0x7f7ee406cc80 2023-07-14T13:32:11.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.404+0000 7f7ee8dad640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee415fa90 con 0x7f7ee415bd50 2023-07-14T13:32:11.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.404+0000 7f7ee8dad640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee415fd70 con 0x7f7ee406fcf0 2023-07-14T13:32:11.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.404+0000 7f7ee1d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7ee415bd50 0x7f7ee4069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:11.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.404+0000 7f7ee1d9b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7ee415bd50 0x7f7ee4069430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51058/0 (socket says 172.21.15.5:51058) 2023-07-14T13:32:11.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.404+0000 7f7ee1d9b640 1 -- 172.21.15.5:0/3323722770 learned_addr learned my addr 172.21.15.5:0/3323722770 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:11.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.404+0000 7f7ee2d9d640 1 --2- 172.21.15.5:0/3323722770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ee406fcf0 0x7f7ee4070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:11.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.404+0000 7f7ee1d9b640 1 -- 172.21.15.5:0/3323722770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ee406fcf0 msgr2=0x7f7ee4070150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:11.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.404+0000 7f7ee1d9b640 1 --2- 172.21.15.5:0/3323722770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ee406fcf0 0x7f7ee4070150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:11.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.404+0000 7f7ee1d9b640 1 -- 172.21.15.5:0/3323722770 >> v1:172.21.15.154:6789/0 conn(0x7f7ee406cc80 legacy=0x7f7ee406d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:11.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.404+0000 7f7ee1d9b640 1 -- 172.21.15.5:0/3323722770 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee4160050 con 0x7f7ee415bd50 2023-07-14T13:32:11.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.408+0000 7f7ee1d9b640 1 --2- 172.21.15.5:0/3323722770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee415bd50 0x7f7ee4069430 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009870 tx=0x7f7ed801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d1360bc5248f43 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:11.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.408+0000 7f7ee159a640 1 -- 172.21.15.5:0/3323722770 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed80a95f0 con 0x7f7ee415bd50 2023-07-14T13:32:11.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.408+0000 7f7ee159a640 1 -- 172.21.15.5:0/3323722770 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed80a9750 con 0x7f7ee415bd50 2023-07-14T13:32:11.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.408+0000 7f7ee159a640 1 -- 172.21.15.5:0/3323722770 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed80a9ae0 con 0x7f7ee415bd50 2023-07-14T13:32:11.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.408+0000 7f7ee8dad640 1 -- 172.21.15.5:0/3323722770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee415bd50 msgr2=0x7f7ee4069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:11.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.408+0000 7f7ee8dad640 1 --2- 172.21.15.5:0/3323722770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee415bd50 0x7f7ee4069430 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009870 tx=0x7f7ed801c510 comp rx=0 tx=0).stop 2023-07-14T13:32:11.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.408+0000 7f7ee8dad640 1 -- 172.21.15.5:0/3323722770 shutdown_connections 2023-07-14T13:32:11.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.408+0000 7f7ee8dad640 1 --2- 172.21.15.5:0/3323722770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ee406fcf0 0x7f7ee4070150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:11.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.408+0000 7f7ee8dad640 1 --2- 172.21.15.5:0/3323722770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee415bd50 0x7f7ee4069430 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:11.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.408+0000 7f7ee8dad640 1 -- 172.21.15.5:0/3323722770 >> 172.21.15.5:0/3323722770 conn(0x7f7ee40b0490 msgr2=0x7f7ee40b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:11.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.408+0000 7f7ee8dad640 1 -- 172.21.15.5:0/3323722770 shutdown_connections 2023-07-14T13:32:11.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.408+0000 7f7ee8dad640 1 -- 172.21.15.5:0/3323722770 wait complete. 2023-07-14T13:32:11.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.408+0000 7f7ee8dad640 1 Processor -- start 2023-07-14T13:32:11.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.408+0000 7f7ee8dad640 1 -- start start 2023-07-14T13:32:11.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.412+0000 7f7ee8dad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ee406cc80 0x7f7ee415b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:11.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.412+0000 7f7ee8dad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee406fcf0 0x7f7ee414e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:11.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.412+0000 7f7ee8dad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ee415bd50 0x7f7ee4159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:11.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.412+0000 7f7ee8dad640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee40b1ae0 con 0x7f7ee406fcf0 2023-07-14T13:32:11.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.412+0000 7f7ee8dad640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee40b1dc0 con 0x7f7ee415bd50 2023-07-14T13:32:11.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.412+0000 7f7ee8dad640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee41597f0 con 0x7f7ee406cc80 2023-07-14T13:32:11.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.412+0000 7f7ee1d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee406fcf0 0x7f7ee414e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:11.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.412+0000 7f7ee1d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee406fcf0 0x7f7ee414e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51072/0 (socket says 172.21.15.5:51072) 2023-07-14T13:32:11.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.412+0000 7f7ee1d9b640 1 -- 172.21.15.5:0/383837976 learned_addr learned my addr 172.21.15.5:0/383837976 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:11.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.412+0000 7f7ee259c640 1 --2- 172.21.15.5:0/383837976 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ee406cc80 0x7f7ee415b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:11.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.412+0000 7f7ee2d9d640 1 --2- 172.21.15.5:0/383837976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ee415bd50 0x7f7ee4159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:11.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.412+0000 7f7ee1d9b640 1 -- 172.21.15.5:0/383837976 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ee406cc80 msgr2=0x7f7ee415b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:11.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.412+0000 7f7ee1d9b640 1 --2- 172.21.15.5:0/383837976 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ee406cc80 0x7f7ee415b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:11.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.412+0000 7f7ee1d9b640 1 -- 172.21.15.5:0/383837976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ee415bd50 msgr2=0x7f7ee4159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:11.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.412+0000 7f7ee1d9b640 1 --2- 172.21.15.5:0/383837976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ee415bd50 0x7f7ee4159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:11.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.412+0000 7f7ee1d9b640 1 -- 172.21.15.5:0/383837976 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed80094d0 con 0x7f7ee406fcf0 2023-07-14T13:32:11.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.412+0000 7f7ee2d9d640 1 --2- 172.21.15.5:0/383837976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ee415bd50 0x7f7ee4159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:11.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.412+0000 7f7ee1d9b640 1 --2- 172.21.15.5:0/383837976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee406fcf0 0x7f7ee414e820 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80ab040 tx=0x7f7ed80192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:11.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.412+0000 7f7ed2ffd640 1 -- 172.21.15.5:0/383837976 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed80a95f0 con 0x7f7ee406fcf0 2023-07-14T13:32:11.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.412+0000 7f7ed2ffd640 1 -- 172.21.15.5:0/383837976 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed80b1600 con 0x7f7ee406fcf0 2023-07-14T13:32:11.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.412+0000 7f7ed2ffd640 1 -- 172.21.15.5:0/383837976 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed80b19b0 con 0x7f7ee406fcf0 2023-07-14T13:32:11.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.412+0000 7f7ee8dad640 1 -- 172.21.15.5:0/383837976 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee4159ad0 con 0x7f7ee406fcf0 2023-07-14T13:32:11.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.412+0000 7f7ee8dad640 1 -- 172.21.15.5:0/383837976 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee414ed60 con 0x7f7ee406fcf0 2023-07-14T13:32:11.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.412+0000 7f7ee8dad640 1 -- 172.21.15.5:0/383837976 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee40678d0 con 0x7f7ee406fcf0 2023-07-14T13:32:11.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.412+0000 7f7ed2ffd640 1 -- 172.21.15.5:0/383837976 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7ed80b1b10 con 0x7f7ee406fcf0 2023-07-14T13:32:11.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.416+0000 7f7ed2ffd640 1 --2- 172.21.15.5:0/383837976 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f7ec40663a0 0x7f7ec4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:11.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.416+0000 7f7ed2ffd640 1 -- 172.21.15.5:0/383837976 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6922+0+0 (secure 0 0 0) 0x7f7ed811e690 con 0x7f7ee406fcf0 2023-07-14T13:32:11.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.416+0000 7f7ee259c640 1 --2- 172.21.15.5:0/383837976 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f7ec40663a0 0x7f7ec4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:11.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.416+0000 7f7ee259c640 1 --2- 172.21.15.5:0/383837976 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f7ec40663a0 0x7f7ec4068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4007fd0 tx=0x7f7ed4009040 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:11.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.420+0000 7f7ed2ffd640 1 -- 172.21.15.5:0/383837976 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7ed80eb5a0 con 0x7f7ee406fcf0 2023-07-14T13:32:11.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:11.608+0000 7f7ee8dad640 1 -- 172.21.15.5:0/383837976 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7ee40b1f30 con 0x7f7ee406fcf0 2023-07-14T13:32:12.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.232+0000 7f7ed2ffd640 1 -- 172.21.15.5:0/383837976 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v85) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7ed80eebc0 con 0x7f7ee406fcf0 2023-07-14T13:32:12.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.232+0000 7f7ee8dad640 1 -- 172.21.15.5:0/383837976 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f7ec40663a0 msgr2=0x7f7ec4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:12.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.232+0000 7f7ee8dad640 1 --2- 172.21.15.5:0/383837976 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f7ec40663a0 0x7f7ec4068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4007fd0 tx=0x7f7ed4009040 comp rx=0 tx=0).stop 2023-07-14T13:32:12.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.232+0000 7f7ee8dad640 1 -- 172.21.15.5:0/383837976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee406fcf0 msgr2=0x7f7ee414e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:12.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.232+0000 7f7ee8dad640 1 --2- 172.21.15.5:0/383837976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee406fcf0 0x7f7ee414e820 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80ab040 tx=0x7f7ed80192b0 comp rx=0 tx=0).stop 2023-07-14T13:32:12.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.232+0000 7f7ee8dad640 1 -- 172.21.15.5:0/383837976 shutdown_connections 2023-07-14T13:32:12.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.232+0000 7f7ee8dad640 1 --2- 172.21.15.5:0/383837976 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f7ec40663a0 0x7f7ec4068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:12.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.232+0000 7f7ee8dad640 1 --2- 172.21.15.5:0/383837976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ee415bd50 0x7f7ee4159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:12.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.232+0000 7f7ee8dad640 1 --2- 172.21.15.5:0/383837976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee406fcf0 0x7f7ee414e820 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:12.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.232+0000 7f7ee8dad640 1 --2- 172.21.15.5:0/383837976 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7ee406cc80 0x7f7ee415b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:12.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.232+0000 7f7ee8dad640 1 -- 172.21.15.5:0/383837976 >> 172.21.15.5:0/383837976 conn(0x7f7ee40b0490 msgr2=0x7f7ee406a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:12.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.232+0000 7f7ee8dad640 1 -- 172.21.15.5:0/383837976 shutdown_connections 2023-07-14T13:32:12.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.232+0000 7f7ee8dad640 1 -- 172.21.15.5:0/383837976 wait complete. 2023-07-14T13:32:12.258 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-14T13:32:12.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.452+0000 7fcb8e434640 1 Processor -- start 2023-07-14T13:32:12.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.452+0000 7fcb8e434640 1 -- start start 2023-07-14T13:32:12.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.452+0000 7fcb8e434640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcb88159440 0x7fcb880c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:12.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.452+0000 7fcb8e434640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb881532b0 con 0x7fcb8815cef0 2023-07-14T13:32:12.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.452+0000 7fcb8e434640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb880ca6f0 con 0x7fcb880aeb40 2023-07-14T13:32:12.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.452+0000 7fcb8e434640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8815d360 con 0x7fcb88159440 2023-07-14T13:32:12.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.452+0000 7fcb8c9d1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcb88159440 0x7fcb880c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:12.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.452+0000 7fcb877fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcb8815cef0 0x7fcb88158d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45490/0 (socket says 172.21.15.5:45490) 2023-07-14T13:32:12.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.452+0000 7fcb877fe640 1 -- 172.21.15.5:0/2438999264 learned_addr learned my addr 172.21.15.5:0/2438999264 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:12.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.456+0000 7fcb8c9d1640 1 -- 172.21.15.5:0/2438999264 >> v1:172.21.15.154:6789/0 conn(0x7fcb880aeb40 legacy=0x7fcb880aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:12.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.456+0000 7fcb8c9d1640 1 -- 172.21.15.5:0/2438999264 >> v1:172.21.15.5:6789/0 conn(0x7fcb8815cef0 legacy=0x7fcb88158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:12.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.456+0000 7fcb8c9d1640 1 -- 172.21.15.5:0/2438999264 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb881599d0 con 0x7fcb88159440 2023-07-14T13:32:12.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.456+0000 7fcb8c9d1640 1 --2- 172.21.15.5:0/2438999264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb88159440 0x7fcb880c88c0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fcb80009d90 tx=0x7fcb8001eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54fb6c93397c083 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:12.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.456+0000 7fcb86ffd640 1 -- 172.21.15.5:0/2438999264 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb800a7c00 con 0x7fcb88159440 2023-07-14T13:32:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.456+0000 7fcb86ffd640 1 -- 172.21.15.5:0/2438999264 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb800a7d60 con 0x7fcb88159440 2023-07-14T13:32:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.456+0000 7fcb86ffd640 1 -- 172.21.15.5:0/2438999264 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb800af660 con 0x7fcb88159440 2023-07-14T13:32:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.456+0000 7fcb8e434640 1 -- 172.21.15.5:0/2438999264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb88159440 msgr2=0x7fcb880c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.456+0000 7fcb8e434640 1 --2- 172.21.15.5:0/2438999264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb88159440 0x7fcb880c88c0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fcb80009d90 tx=0x7fcb8001eb30 comp rx=0 tx=0).stop 2023-07-14T13:32:12.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.456+0000 7fcb8e434640 1 -- 172.21.15.5:0/2438999264 shutdown_connections 2023-07-14T13:32:12.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.456+0000 7fcb8e434640 1 --2- 172.21.15.5:0/2438999264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb88159440 0x7fcb880c88c0 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:12.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.456+0000 7fcb8e434640 1 -- 172.21.15.5:0/2438999264 >> 172.21.15.5:0/2438999264 conn(0x7fcb880cde90 msgr2=0x7fcb880ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:12.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.456+0000 7fcb8e434640 1 -- 172.21.15.5:0/2438999264 shutdown_connections 2023-07-14T13:32:12.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.456+0000 7fcb8e434640 1 -- 172.21.15.5:0/2438999264 wait complete. 2023-07-14T13:32:12.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.460+0000 7fcb8e434640 1 Processor -- start 2023-07-14T13:32:12.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.460+0000 7fcb8e434640 1 -- start start 2023-07-14T13:32:12.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.460+0000 7fcb8e434640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb880aeb40 0x7fcb88143ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:12.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.460+0000 7fcb8e434640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb88159440 0x7fcb880acce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:12.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.460+0000 7fcb8e434640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb8815cef0 0x7fcb881579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:12.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.460+0000 7fcb8e434640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb88144400 con 0x7fcb88159440 2023-07-14T13:32:12.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.460+0000 7fcb8e434640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb880ab890 con 0x7fcb880aeb40 2023-07-14T13:32:12.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.460+0000 7fcb8e434640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb88070ef0 con 0x7fcb8815cef0 2023-07-14T13:32:12.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.460+0000 7fcb877fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb88159440 0x7fcb880acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:12.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.460+0000 7fcb877fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb88159440 0x7fcb880acce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51084/0 (socket says 172.21.15.5:51084) 2023-07-14T13:32:12.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.460+0000 7fcb877fe640 1 -- 172.21.15.5:0/2950833816 learned_addr learned my addr 172.21.15.5:0/2950833816 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:12.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.460+0000 7fcb87fff640 1 --2- 172.21.15.5:0/2950833816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb880aeb40 0x7fcb88143ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:12.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.460+0000 7fcb8c9d1640 1 --2- 172.21.15.5:0/2950833816 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb8815cef0 0x7fcb881579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:12.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.460+0000 7fcb877fe640 1 -- 172.21.15.5:0/2950833816 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb8815cef0 msgr2=0x7fcb881579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:12.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.460+0000 7fcb877fe640 1 --2- 172.21.15.5:0/2950833816 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb8815cef0 0x7fcb881579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:12.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.460+0000 7fcb877fe640 1 -- 172.21.15.5:0/2950833816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb880aeb40 msgr2=0x7fcb88143ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:12.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.460+0000 7fcb877fe640 1 --2- 172.21.15.5:0/2950833816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb880aeb40 0x7fcb88143ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:12.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.460+0000 7fcb877fe640 1 -- 172.21.15.5:0/2950833816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb80009a70 con 0x7fcb88159440 2023-07-14T13:32:12.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.460+0000 7fcb877fe640 1 --2- 172.21.15.5:0/2950833816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb88159440 0x7fcb880acce0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c00c400 tx=0x7fcb7c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:12.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.460+0000 7fcb84ff9640 1 -- 172.21.15.5:0/2950833816 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c005cf0 con 0x7fcb88159440 2023-07-14T13:32:12.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.460+0000 7fcb84ff9640 1 -- 172.21.15.5:0/2950833816 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7c005e50 con 0x7fcb88159440 2023-07-14T13:32:12.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.464+0000 7fcb84ff9640 1 -- 172.21.15.5:0/2950833816 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c0072d0 con 0x7fcb88159440 2023-07-14T13:32:12.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.464+0000 7fcb8e434640 1 -- 172.21.15.5:0/2950833816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb880abb50 con 0x7fcb88159440 2023-07-14T13:32:12.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.464+0000 7fcb8e434640 1 -- 172.21.15.5:0/2950833816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb880ac110 con 0x7fcb88159440 2023-07-14T13:32:12.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.464+0000 7fcb8e434640 1 -- 172.21.15.5:0/2950833816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb880678d0 con 0x7fcb88159440 2023-07-14T13:32:12.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.464+0000 7fcb84ff9640 1 -- 172.21.15.5:0/2950833816 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcb7c007430 con 0x7fcb88159440 2023-07-14T13:32:12.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.464+0000 7fcb84ff9640 1 --2- 172.21.15.5:0/2950833816 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fcb740663a0 0x7fcb74068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:12.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.464+0000 7fcb84ff9640 1 -- 172.21.15.5:0/2950833816 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6922+0+0 (secure 0 0 0) 0x7fcb7c083730 con 0x7fcb88159440 2023-07-14T13:32:12.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.464+0000 7fcb87fff640 1 --2- 172.21.15.5:0/2950833816 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fcb740663a0 0x7fcb74068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:12.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.468+0000 7fcb87fff640 1 --2- 172.21.15.5:0/2950833816 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fcb740663a0 0x7fcb74068850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcb78007fd0 tx=0x7fcb78009040 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:12.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.468+0000 7fcb84ff9640 1 -- 172.21.15.5:0/2950833816 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fcb7c050750 con 0x7fcb88159440 2023-07-14T13:32:12.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:12.624+0000 7fcb8e434640 1 -- 172.21.15.5:0/2950833816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcb880c4ab0 con 0x7fcb88159440 2023-07-14T13:32:13.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.344+0000 7fcb84ff9640 1 -- 172.21.15.5:0/2950833816 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v181) v1 ==== 181+0+0 (secure 0 0 0) 0x7fcb7c053d70 con 0x7fcb88159440 2023-07-14T13:32:13.345 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-07-14T13:32:13.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.344+0000 7fcb8e434640 1 -- 172.21.15.5:0/2950833816 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fcb740663a0 msgr2=0x7fcb74068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:13.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.348+0000 7fcb8e434640 1 --2- 172.21.15.5:0/2950833816 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fcb740663a0 0x7fcb74068850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcb78007fd0 tx=0x7fcb78009040 comp rx=0 tx=0).stop 2023-07-14T13:32:13.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.348+0000 7fcb8e434640 1 -- 172.21.15.5:0/2950833816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb88159440 msgr2=0x7fcb880acce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:13.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.348+0000 7fcb8e434640 1 --2- 172.21.15.5:0/2950833816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb88159440 0x7fcb880acce0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c00c400 tx=0x7fcb7c00c8c0 comp rx=0 tx=0).stop 2023-07-14T13:32:13.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.348+0000 7fcb8e434640 1 -- 172.21.15.5:0/2950833816 shutdown_connections 2023-07-14T13:32:13.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.348+0000 7fcb8e434640 1 --2- 172.21.15.5:0/2950833816 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fcb740663a0 0x7fcb74068850 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:13.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.348+0000 7fcb8e434640 1 --2- 172.21.15.5:0/2950833816 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb8815cef0 0x7fcb881579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:13.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.348+0000 7fcb8e434640 1 --2- 172.21.15.5:0/2950833816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb88159440 0x7fcb880acce0 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:13.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.348+0000 7fcb8e434640 1 --2- 172.21.15.5:0/2950833816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb880aeb40 0x7fcb88143ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:13.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.348+0000 7fcb8e434640 1 -- 172.21.15.5:0/2950833816 >> 172.21.15.5:0/2950833816 conn(0x7fcb880cde90 msgr2=0x7fcb880aef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:13.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.348+0000 7fcb8e434640 1 -- 172.21.15.5:0/2950833816 shutdown_connections 2023-07-14T13:32:13.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.348+0000 7fcb8e434640 1 -- 172.21.15.5:0/2950833816 wait complete. 2023-07-14T13:32:13.373 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-14T13:32:13.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.524+0000 7f3ec75f6640 1 Processor -- start 2023-07-14T13:32:13.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.524+0000 7f3ec75f6640 1 -- start start 2023-07-14T13:32:13.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.524+0000 7f3ec75f6640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3ec015bde0 0x7f3ec00d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:13.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.524+0000 7f3ec75f6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3ec00d2300 0x7f3ec00d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:13.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.524+0000 7f3ec75f6640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec00b04c0 con 0x7f3ec00d2fc0 2023-07-14T13:32:13.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.524+0000 7f3ec75f6640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec015c1b0 con 0x7f3ec015bde0 2023-07-14T13:32:13.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.524+0000 7f3ec75f6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec00b1060 con 0x7f3ec00d2300 2023-07-14T13:32:13.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.524+0000 7f3ec5392640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3ec015bde0 0x7f3ec00d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:13.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.524+0000 7f3ec4b91640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3ec00d2fc0 0x7f3ec00b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45502/0 (socket says 172.21.15.5:45502) 2023-07-14T13:32:13.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.524+0000 7f3ec4b91640 1 -- 172.21.15.5:0/598793346 learned_addr learned my addr 172.21.15.5:0/598793346 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:13.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.524+0000 7f3ec5b93640 1 --2- 172.21.15.5:0/598793346 >> v2:172.21.15.154:3300/0 conn(0x7f3ec00d2300 0x7f3ec00d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:13.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.524+0000 7f3ec5392640 1 -- 172.21.15.5:0/598793346 >> v2:172.21.15.154:3300/0 conn(0x7f3ec00d2300 msgr2=0x7f3ec00d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.524+0000 7f3ec5392640 1 --2- 172.21.15.5:0/598793346 >> v2:172.21.15.154:3300/0 conn(0x7f3ec00d2300 0x7f3ec00d2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.524+0000 7f3ec5392640 1 -- 172.21.15.5:0/598793346 >> v1:172.21.15.5:6789/0 conn(0x7f3ec00d2fc0 legacy=0x7f3ec00b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.524+0000 7f3ec5392640 1 -- 172.21.15.5:0/598793346 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec00d2c80 con 0x7f3ec015bde0 2023-07-14T13:32:13.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.524+0000 7f3ec5b93640 1 --2- 172.21.15.5:0/598793346 >> v2:172.21.15.154:3300/0 conn(0x7f3ec00d2300 0x7f3ec00d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:32:13.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.528+0000 7f3ec5392640 1 --2- 172.21.15.5:0/598793346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ec015bde0 0x7f3ec00d0270 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f3ec008c820 tx=0x7f3ebc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c35cd9fafc8bc07 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:13.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.528+0000 7f3eb7fff640 1 -- 172.21.15.5:0/598793346 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc004230 con 0x7f3ec015bde0 2023-07-14T13:32:13.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.528+0000 7f3eb7fff640 1 -- 172.21.15.5:0/598793346 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ebc0a7050 con 0x7f3ec015bde0 2023-07-14T13:32:13.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.528+0000 7f3eb7fff640 1 -- 172.21.15.5:0/598793346 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc003620 con 0x7f3ec015bde0 2023-07-14T13:32:13.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.528+0000 7f3ec75f6640 1 -- 172.21.15.5:0/598793346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ec015bde0 msgr2=0x7f3ec00d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:13.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.528+0000 7f3ec75f6640 1 --2- 172.21.15.5:0/598793346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ec015bde0 0x7f3ec00d0270 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f3ec008c820 tx=0x7f3ebc01c440 comp rx=0 tx=0).stop 2023-07-14T13:32:13.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.528+0000 7f3ec75f6640 1 -- 172.21.15.5:0/598793346 shutdown_connections 2023-07-14T13:32:13.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.528+0000 7f3ec75f6640 1 --2- 172.21.15.5:0/598793346 >> v2:172.21.15.154:3300/0 conn(0x7f3ec00d2300 0x7f3ec00d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:13.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.528+0000 7f3ec75f6640 1 --2- 172.21.15.5:0/598793346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ec015bde0 0x7f3ec00d0270 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:13.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.528+0000 7f3ec75f6640 1 -- 172.21.15.5:0/598793346 >> 172.21.15.5:0/598793346 conn(0x7f3ec00659d0 msgr2=0x7f3ec009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:13.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.528+0000 7f3ec75f6640 1 -- 172.21.15.5:0/598793346 shutdown_connections 2023-07-14T13:32:13.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.528+0000 7f3ec75f6640 1 -- 172.21.15.5:0/598793346 wait complete. 2023-07-14T13:32:13.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.532+0000 7f3ec75f6640 1 Processor -- start 2023-07-14T13:32:13.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.532+0000 7f3ec75f6640 1 -- start start 2023-07-14T13:32:13.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.532+0000 7f3ec75f6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ec00d2300 0x7f3ec015ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:13.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.532+0000 7f3ec75f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ec00d2fc0 0x7f3ec00c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:13.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.532+0000 7f3ec75f6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ec015bde0 0x7f3ec0151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:13.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.532+0000 7f3ec75f6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec0154040 con 0x7f3ec00d2fc0 2023-07-14T13:32:13.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.532+0000 7f3ec75f6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec0152fc0 con 0x7f3ec015bde0 2023-07-14T13:32:13.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.532+0000 7f3ec75f6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec01532a0 con 0x7f3ec00d2300 2023-07-14T13:32:13.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.532+0000 7f3ec4b91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ec00d2fc0 0x7f3ec00c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:13.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.532+0000 7f3ec4b91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ec00d2fc0 0x7f3ec00c6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51106/0 (socket says 172.21.15.5:51106) 2023-07-14T13:32:13.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.532+0000 7f3ec4b91640 1 -- 172.21.15.5:0/3958531254 learned_addr learned my addr 172.21.15.5:0/3958531254 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:13.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.532+0000 7f3ec5392640 1 --2- 172.21.15.5:0/3958531254 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ec00d2300 0x7f3ec015ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:13.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.532+0000 7f3ec5b93640 1 --2- 172.21.15.5:0/3958531254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ec015bde0 0x7f3ec0151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:13.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.532+0000 7f3ec4b91640 1 -- 172.21.15.5:0/3958531254 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ec00d2300 msgr2=0x7f3ec015ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:13.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.532+0000 7f3ec4b91640 1 --2- 172.21.15.5:0/3958531254 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ec00d2300 0x7f3ec015ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.532+0000 7f3ec4b91640 1 -- 172.21.15.5:0/3958531254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ec015bde0 msgr2=0x7f3ec0151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.532+0000 7f3ec4b91640 1 --2- 172.21.15.5:0/3958531254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ec015bde0 0x7f3ec0151f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.532+0000 7f3ec4b91640 1 -- 172.21.15.5:0/3958531254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ebc0093b0 con 0x7f3ec00d2fc0 2023-07-14T13:32:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.532+0000 7f3ec4b91640 1 --2- 172.21.15.5:0/3958531254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ec00d2fc0 0x7f3ec00c6930 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f3eb000c4d0 tx=0x7f3eb000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.532+0000 7f3eb5ffb640 1 -- 172.21.15.5:0/3958531254 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0005cf0 con 0x7f3ec00d2fc0 2023-07-14T13:32:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.532+0000 7f3eb5ffb640 1 -- 172.21.15.5:0/3958531254 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb0005e50 con 0x7f3ec00d2fc0 2023-07-14T13:32:13.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.532+0000 7f3ec75f6640 1 -- 172.21.15.5:0/3958531254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec0153580 con 0x7f3ec00d2fc0 2023-07-14T13:32:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.532+0000 7f3eb5ffb640 1 -- 172.21.15.5:0/3958531254 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0007270 con 0x7f3ec00d2fc0 2023-07-14T13:32:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.532+0000 7f3ec75f6640 1 -- 172.21.15.5:0/3958531254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec0153b40 con 0x7f3ec00d2fc0 2023-07-14T13:32:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.536+0000 7f3ec75f6640 1 -- 172.21.15.5:0/3958531254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec00678d0 con 0x7f3ec00d2fc0 2023-07-14T13:32:13.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.536+0000 7f3eb5ffb640 1 -- 172.21.15.5:0/3958531254 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3eb00073d0 con 0x7f3ec00d2fc0 2023-07-14T13:32:13.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.536+0000 7f3eb5ffb640 1 --2- 172.21.15.5:0/3958531254 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f3ea40663a0 0x7f3ea4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:13.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.536+0000 7f3eb5ffb640 1 -- 172.21.15.5:0/3958531254 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6484+0+0 (secure 0 0 0) 0x7f3eb0083550 con 0x7f3ec00d2fc0 2023-07-14T13:32:13.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.536+0000 7f3ec5392640 1 --2- 172.21.15.5:0/3958531254 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f3ea40663a0 0x7f3ea4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:13.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.540+0000 7f3ec5392640 1 --2- 172.21.15.5:0/3958531254 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f3ea40663a0 0x7f3ea4068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0ad000 tx=0x7f3ebc0a6000 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:13.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.540+0000 7f3eb5ffb640 1 -- 172.21.15.5:0/3958531254 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3eb0050720 con 0x7f3ec00d2fc0 2023-07-14T13:32:13.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:13.696+0000 7f3ec75f6640 1 -- 172.21.15.5:0/3958531254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3ec00b4730 con 0x7f3ec00d2fc0 2023-07-14T13:32:14.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.356+0000 7f3eb5ffb640 1 -- 172.21.15.5:0/3958531254 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v182) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3eb0053d40 con 0x7f3ec00d2fc0 2023-07-14T13:32:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-07-14T13:32:14.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.360+0000 7f3ec75f6640 1 -- 172.21.15.5:0/3958531254 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f3ea40663a0 msgr2=0x7f3ea4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:14.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.360+0000 7f3ec75f6640 1 --2- 172.21.15.5:0/3958531254 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f3ea40663a0 0x7f3ea4068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0ad000 tx=0x7f3ebc0a6000 comp rx=0 tx=0).stop 2023-07-14T13:32:14.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.360+0000 7f3ec75f6640 1 -- 172.21.15.5:0/3958531254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ec00d2fc0 msgr2=0x7f3ec00c6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:14.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.360+0000 7f3ec75f6640 1 --2- 172.21.15.5:0/3958531254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ec00d2fc0 0x7f3ec00c6930 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f3eb000c4d0 tx=0x7f3eb000c990 comp rx=0 tx=0).stop 2023-07-14T13:32:14.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.360+0000 7f3ec75f6640 1 -- 172.21.15.5:0/3958531254 shutdown_connections 2023-07-14T13:32:14.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.360+0000 7f3ec75f6640 1 --2- 172.21.15.5:0/3958531254 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f3ea40663a0 0x7f3ea4068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:14.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.360+0000 7f3ec75f6640 1 --2- 172.21.15.5:0/3958531254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ec015bde0 0x7f3ec0151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:14.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.360+0000 7f3ec75f6640 1 --2- 172.21.15.5:0/3958531254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ec00d2fc0 0x7f3ec00c6930 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:14.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.360+0000 7f3ec75f6640 1 --2- 172.21.15.5:0/3958531254 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ec00d2300 0x7f3ec015ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:14.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.360+0000 7f3ec75f6640 1 -- 172.21.15.5:0/3958531254 >> 172.21.15.5:0/3958531254 conn(0x7f3ec00659d0 msgr2=0x7f3ec00cf430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:14.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.360+0000 7f3ec75f6640 1 -- 172.21.15.5:0/3958531254 shutdown_connections 2023-07-14T13:32:14.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.360+0000 7f3ec75f6640 1 -- 172.21.15.5:0/3958531254 wait complete. 2023-07-14T13:32:14.386 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-14T13:32:14.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.532+0000 7f51ba0f9640 1 Processor -- start 2023-07-14T13:32:14.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.532+0000 7f51ba0f9640 1 -- start start 2023-07-14T13:32:14.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51ba0f9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f51b415bd50 0x7f51b4069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:14.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51ba0f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51b406fcf0 0x7f51b4070150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:14.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51ba0f9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b4069970 con 0x7f51b406cc80 2023-07-14T13:32:14.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51ba0f9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51b415fa90 con 0x7f51b415bd50 2023-07-14T13:32:14.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51ba0f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b415fd70 con 0x7f51b406fcf0 2023-07-14T13:32:14.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b37fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f51b406cc80 0x7f51b406d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45508/0 (socket says 172.21.15.5:45508) 2023-07-14T13:32:14.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b37fe640 1 -- 172.21.15.5:0/3226676763 learned_addr learned my addr 172.21.15.5:0/3226676763 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:14.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b2ffd640 1 --2- 172.21.15.5:0/3226676763 >> v2:172.21.15.154:3300/0 conn(0x7f51b415bd50 0x7f51b4069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:14.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b3fff640 1 --2- 172.21.15.5:0/3226676763 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51b406fcf0 0x7f51b4070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:14.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b27fc640 1 -- 172.21.15.5:0/3226676763 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3459978531 0 0) 0x7f51b4069970 con 0x7f51b406cc80 2023-07-14T13:32:14.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b27fc640 1 -- 172.21.15.5:0/3226676763 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f519c003530 con 0x7f51b406cc80 2023-07-14T13:32:14.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b27fc640 1 -- 172.21.15.5:0/3226676763 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3653376806 0 0) 0x7f519c003530 con 0x7f51b406cc80 2023-07-14T13:32:14.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b27fc640 1 -- 172.21.15.5:0/3226676763 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51b406fcf0 msgr2=0x7f51b4070150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:14.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b27fc640 1 --2- 172.21.15.5:0/3226676763 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51b406fcf0 0x7f51b4070150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:14.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b27fc640 1 -- 172.21.15.5:0/3226676763 >> v2:172.21.15.154:3300/0 conn(0x7f51b415bd50 msgr2=0x7f51b4069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:14.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b27fc640 1 --2- 172.21.15.5:0/3226676763 >> v2:172.21.15.154:3300/0 conn(0x7f51b415bd50 0x7f51b4069430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:14.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b27fc640 1 -- 172.21.15.5:0/3226676763 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b4160050 con 0x7f51b406cc80 2023-07-14T13:32:14.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b27fc640 1 -- 172.21.15.5:0/3226676763 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f51a4001680 con 0x7f51b406cc80 2023-07-14T13:32:14.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b27fc640 1 -- 172.21.15.5:0/3226676763 >> v1:172.21.15.5:6789/0 conn(0x7f51b406cc80 legacy=0x7f51b406d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:14.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b27fc640 1 --2- 172.21.15.5:0/3226676763 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51b406fcf0 0x7f519c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:14.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b27fc640 1 --2- 172.21.15.5:0/3226676763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c003f00 0x7f519c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:14.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b27fc640 1 --2- 172.21.15.5:0/3226676763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f519c004d10 0x7f519c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:14.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b27fc640 1 -- 172.21.15.5:0/3226676763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b415fa90 con 0x7f519c003f00 2023-07-14T13:32:14.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b27fc640 1 -- 172.21.15.5:0/3226676763 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b415fd70 con 0x7f519c004d10 2023-07-14T13:32:14.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b27fc640 1 -- 172.21.15.5:0/3226676763 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519c00b990 con 0x7f51b406fcf0 2023-07-14T13:32:14.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b2ffd640 1 --2- 172.21.15.5:0/3226676763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c003f00 0x7f519c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:14.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b37fe640 1 --2- 172.21.15.5:0/3226676763 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51b406fcf0 0x7f519c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:14.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b3fff640 1 --2- 172.21.15.5:0/3226676763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f519c004d10 0x7f519c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:14.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b2ffd640 1 -- 172.21.15.5:0/3226676763 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51b406fcf0 msgr2=0x7f519c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:14.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b2ffd640 1 --2- 172.21.15.5:0/3226676763 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51b406fcf0 0x7f519c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:14.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b2ffd640 1 -- 172.21.15.5:0/3226676763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f519c004d10 msgr2=0x7f519c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:14.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b2ffd640 1 --2- 172.21.15.5:0/3226676763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f519c004d10 0x7f519c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:14.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.536+0000 7f51b2ffd640 1 -- 172.21.15.5:0/3226676763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519c003530 con 0x7f519c003f00 2023-07-14T13:32:14.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.540+0000 7f51b2ffd640 1 --2- 172.21.15.5:0/3226676763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c003f00 0x7f519c0047d0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009ab0 tx=0x7f51a801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef02070fa036c047 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:14.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.540+0000 7f51b27fc640 1 -- 172.21.15.5:0/3226676763 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a80a5660 con 0x7f519c003f00 2023-07-14T13:32:14.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.540+0000 7f51b27fc640 1 -- 172.21.15.5:0/3226676763 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a80a57c0 con 0x7f519c003f00 2023-07-14T13:32:14.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.540+0000 7f51b27fc640 1 -- 172.21.15.5:0/3226676763 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a80a5b70 con 0x7f519c003f00 2023-07-14T13:32:14.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.540+0000 7f51ba0f9640 1 -- 172.21.15.5:0/3226676763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c003f00 msgr2=0x7f519c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:14.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.540+0000 7f51ba0f9640 1 --2- 172.21.15.5:0/3226676763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f519c003f00 0x7f519c0047d0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009ab0 tx=0x7f51a801ca70 comp rx=0 tx=0).stop 2023-07-14T13:32:14.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.540+0000 7f51b3fff640 1 -- 172.21.15.5:0/3226676763 reap_dead start 2023-07-14T13:32:14.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.540+0000 7f51ba0f9640 1 -- 172.21.15.5:0/3226676763 shutdown_connections 2023-07-14T13:32:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.540+0000 7f51ba0f9640 1 -- 172.21.15.5:0/3226676763 >> 172.21.15.5:0/3226676763 conn(0x7f51b40b0490 msgr2=0x7f51b40b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.540+0000 7f51ba0f9640 1 -- 172.21.15.5:0/3226676763 shutdown_connections 2023-07-14T13:32:14.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.540+0000 7f51ba0f9640 1 -- 172.21.15.5:0/3226676763 wait complete. 2023-07-14T13:32:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.540+0000 7f51ba0f9640 1 Processor -- start 2023-07-14T13:32:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.540+0000 7f51ba0f9640 1 -- start start 2023-07-14T13:32:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.544+0000 7f51ba0f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f519c003f00 0x7f51b40ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.544+0000 7f51ba0f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51b40b1c60 0x7f51b41f0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:14.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.544+0000 7f51ba0f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51b415e6f0 0x7f51b4158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:14.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.544+0000 7f51ba0f9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b40b2700 con 0x7f51b40b1c60 2023-07-14T13:32:14.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.544+0000 7f51ba0f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b40b2140 con 0x7f51b415e6f0 2023-07-14T13:32:14.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.544+0000 7f51ba0f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b40b2420 con 0x7f519c003f00 2023-07-14T13:32:14.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.544+0000 7f51b2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51b40b1c60 0x7f51b41f0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:14.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.544+0000 7f51b2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51b40b1c60 0x7f51b41f0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51124/0 (socket says 172.21.15.5:51124) 2023-07-14T13:32:14.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.544+0000 7f51b2ffd640 1 -- 172.21.15.5:0/116054567 learned_addr learned my addr 172.21.15.5:0/116054567 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:14.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.544+0000 7f51b3fff640 1 --2- 172.21.15.5:0/116054567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51b415e6f0 0x7f51b4158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:14.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.544+0000 7f51b37fe640 1 --2- 172.21.15.5:0/116054567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f519c003f00 0x7f51b40ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:14.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.544+0000 7f51b2ffd640 1 -- 172.21.15.5:0/116054567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f519c003f00 msgr2=0x7f51b40ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:14.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.544+0000 7f51b2ffd640 1 --2- 172.21.15.5:0/116054567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f519c003f00 0x7f51b40ca3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:14.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.544+0000 7f51b2ffd640 1 -- 172.21.15.5:0/116054567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51b415e6f0 msgr2=0x7f51b4158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:14.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.544+0000 7f51b2ffd640 1 --2- 172.21.15.5:0/116054567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51b415e6f0 0x7f51b4158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:14.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.544+0000 7f51b2ffd640 1 -- 172.21.15.5:0/116054567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b40a7590 con 0x7f51b40b1c60 2023-07-14T13:32:14.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.544+0000 7f51b2ffd640 1 --2- 172.21.15.5:0/116054567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51b40b1c60 0x7f51b41f0ff0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009ab0 tx=0x7f519c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:14.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.544+0000 7f519bfff640 1 -- 172.21.15.5:0/116054567 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a80a5660 con 0x7f51b40b1c60 2023-07-14T13:32:14.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.544+0000 7f519bfff640 1 -- 172.21.15.5:0/116054567 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a8004220 con 0x7f51b40b1c60 2023-07-14T13:32:14.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.544+0000 7f51ba0f9640 1 -- 172.21.15.5:0/116054567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b40a7870 con 0x7f51b40b1c60 2023-07-14T13:32:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.544+0000 7f519bfff640 1 -- 172.21.15.5:0/116054567 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8003620 con 0x7f51b40b1c60 2023-07-14T13:32:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.544+0000 7f51ba0f9640 1 -- 172.21.15.5:0/116054567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b41f1530 con 0x7f51b40b1c60 2023-07-14T13:32:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.544+0000 7f51ba0f9640 1 -- 172.21.15.5:0/116054567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b40678d0 con 0x7f51b40b1c60 2023-07-14T13:32:14.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.548+0000 7f519bfff640 1 -- 172.21.15.5:0/116054567 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f51a80b4040 con 0x7f51b40b1c60 2023-07-14T13:32:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.548+0000 7f519bfff640 1 --2- 172.21.15.5:0/116054567 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f51a00663a0 0x7f51a0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.548+0000 7f519bfff640 1 -- 172.21.15.5:0/116054567 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6012+0+0 (secure 0 0 0) 0x7f51a811e430 con 0x7f51b40b1c60 2023-07-14T13:32:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.548+0000 7f51b37fe640 1 --2- 172.21.15.5:0/116054567 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f51a00663a0 0x7f51a0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:14.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.548+0000 7f51b37fe640 1 --2- 172.21.15.5:0/116054567 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f51a00663a0 0x7f51a0068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f51a4001060 tx=0x7f51a4009040 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:14.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.552+0000 7f519bfff640 1 -- 172.21.15.5:0/116054567 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f51a80eb760 con 0x7f51b40b1c60 2023-07-14T13:32:14.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.704+0000 7f51ba0f9640 1 -- 172.21.15.5:0/116054567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f51b40cd470 con 0x7f51b40b1c60 2023-07-14T13:32:14.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.712+0000 7f519bfff640 1 -- 172.21.15.5:0/116054567 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v61) v1 ==== 120+0+0 (secure 0 0 0) 0x7f51a80eed80 con 0x7f51b40b1c60 2023-07-14T13:32:14.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.712+0000 7f51ba0f9640 1 -- 172.21.15.5:0/116054567 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f51a00663a0 msgr2=0x7f51a0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:14.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.712+0000 7f51ba0f9640 1 --2- 172.21.15.5:0/116054567 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f51a00663a0 0x7f51a0068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f51a4001060 tx=0x7f51a4009040 comp rx=0 tx=0).stop 2023-07-14T13:32:14.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.712+0000 7f51ba0f9640 1 -- 172.21.15.5:0/116054567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51b40b1c60 msgr2=0x7f51b41f0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:14.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.712+0000 7f51ba0f9640 1 --2- 172.21.15.5:0/116054567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51b40b1c60 0x7f51b41f0ff0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009ab0 tx=0x7f519c005800 comp rx=0 tx=0).stop 2023-07-14T13:32:14.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.712+0000 7f51ba0f9640 1 -- 172.21.15.5:0/116054567 shutdown_connections 2023-07-14T13:32:14.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.712+0000 7f51ba0f9640 1 --2- 172.21.15.5:0/116054567 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f51a00663a0 0x7f51a0068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:14.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.712+0000 7f51ba0f9640 1 --2- 172.21.15.5:0/116054567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51b415e6f0 0x7f51b4158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:14.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.712+0000 7f51ba0f9640 1 --2- 172.21.15.5:0/116054567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51b40b1c60 0x7f51b41f0ff0 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:14.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.712+0000 7f51ba0f9640 1 --2- 172.21.15.5:0/116054567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f519c003f00 0x7f51b40ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:14.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.712+0000 7f51ba0f9640 1 -- 172.21.15.5:0/116054567 >> 172.21.15.5:0/116054567 conn(0x7f51b40b0490 msgr2=0x7f51b406a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:14.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.712+0000 7f51ba0f9640 1 -- 172.21.15.5:0/116054567 shutdown_connections 2023-07-14T13:32:14.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.712+0000 7f51ba0f9640 1 -- 172.21.15.5:0/116054567 wait complete. 2023-07-14T13:32:14.734 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-14T13:32:14.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.880+0000 7f8191796640 1 Processor -- start 2023-07-14T13:32:14.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.880+0000 7f8191796640 1 -- start start 2023-07-14T13:32:14.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.884+0000 7f8191796640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f818c06a540 0x7f818c0cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:14.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.884+0000 7f8191796640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818c0cd1f0 con 0x7f818c1601f0 2023-07-14T13:32:14.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.884+0000 7f8191796640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818c0cd4d0 con 0x7f818c06a910 2023-07-14T13:32:14.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.884+0000 7f8191796640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818c0cd7b0 con 0x7f818c06a540 2023-07-14T13:32:14.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.884+0000 7f818affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f818c06a540 0x7f818c0cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:14.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.884+0000 7f8183fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f818c1601f0 0x7f818c0cca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45522/0 (socket says 172.21.15.5:45522) 2023-07-14T13:32:14.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.884+0000 7f8183fff640 1 -- 172.21.15.5:0/1037499374 learned_addr learned my addr 172.21.15.5:0/1037499374 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:14.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.884+0000 7f818affd640 1 -- 172.21.15.5:0/1037499374 >> v1:172.21.15.154:6789/0 conn(0x7f818c06a910 legacy=0x7f818c0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:14.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.884+0000 7f818affd640 1 -- 172.21.15.5:0/1037499374 >> v1:172.21.15.5:6789/0 conn(0x7f818c1601f0 legacy=0x7f818c0cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:14.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.884+0000 7f818affd640 1 -- 172.21.15.5:0/1037499374 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c0cfe40 con 0x7f818c06a540 2023-07-14T13:32:14.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.884+0000 7f818affd640 1 --2- 172.21.15.5:0/1037499374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c06a540 0x7f818c0cdcd0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f817c0097d0 tx=0x7f817c01bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50d69b25af6e62db server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:14.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.888+0000 7f818a7fc640 1 -- 172.21.15.5:0/1037499374 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c0a7630 con 0x7f818c06a540 2023-07-14T13:32:14.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.888+0000 7f818a7fc640 1 -- 172.21.15.5:0/1037499374 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817c0a7790 con 0x7f818c06a540 2023-07-14T13:32:14.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.888+0000 7f818a7fc640 1 -- 172.21.15.5:0/1037499374 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c0a7b20 con 0x7f818c06a540 2023-07-14T13:32:14.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.888+0000 7f8191796640 1 -- 172.21.15.5:0/1037499374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c06a540 msgr2=0x7f818c0cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:14.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.888+0000 7f8191796640 1 --2- 172.21.15.5:0/1037499374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c06a540 0x7f818c0cdcd0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f817c0097d0 tx=0x7f817c01bf00 comp rx=0 tx=0).stop 2023-07-14T13:32:14.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.888+0000 7f8191796640 1 -- 172.21.15.5:0/1037499374 shutdown_connections 2023-07-14T13:32:14.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.888+0000 7f8191796640 1 --2- 172.21.15.5:0/1037499374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c06a540 0x7f818c0cdcd0 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:14.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.888+0000 7f8191796640 1 -- 172.21.15.5:0/1037499374 >> 172.21.15.5:0/1037499374 conn(0x7f818c099490 msgr2=0x7f818c089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:14.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.888+0000 7f8191796640 1 -- 172.21.15.5:0/1037499374 shutdown_connections 2023-07-14T13:32:14.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.888+0000 7f8191796640 1 -- 172.21.15.5:0/1037499374 wait complete. 2023-07-14T13:32:14.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.888+0000 7f8191796640 1 Processor -- start 2023-07-14T13:32:14.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.888+0000 7f8191796640 1 -- start start 2023-07-14T13:32:14.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.888+0000 7f8191796640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f818c06a540 0x7f818c154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:14.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.888+0000 7f8191796640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f818c06a910 0x7f818c15b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:14.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.888+0000 7f8191796640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c1601f0 0x7f818c154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:14.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.888+0000 7f8191796640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c15a1f0 con 0x7f818c1601f0 2023-07-14T13:32:14.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.888+0000 7f8191796640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c15a4d0 con 0x7f818c06a910 2023-07-14T13:32:14.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.888+0000 7f8191796640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818c0b39e0 con 0x7f818c06a540 2023-07-14T13:32:14.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.892+0000 7f818b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c1601f0 0x7f818c154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:14.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.892+0000 7f818b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c1601f0 0x7f818c154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51150/0 (socket says 172.21.15.5:51150) 2023-07-14T13:32:14.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.892+0000 7f818b7fe640 1 -- 172.21.15.5:0/1077176331 learned_addr learned my addr 172.21.15.5:0/1077176331 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:14.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.892+0000 7f8183fff640 1 --2- 172.21.15.5:0/1077176331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f818c06a910 0x7f818c15b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:14.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.892+0000 7f818affd640 1 --2- 172.21.15.5:0/1077176331 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f818c06a540 0x7f818c154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:14.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.892+0000 7f818b7fe640 1 -- 172.21.15.5:0/1077176331 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f818c06a540 msgr2=0x7f818c154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:14.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.892+0000 7f818b7fe640 1 --2- 172.21.15.5:0/1077176331 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f818c06a540 0x7f818c154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:14.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.892+0000 7f818b7fe640 1 -- 172.21.15.5:0/1077176331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f818c06a910 msgr2=0x7f818c15b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:14.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.892+0000 7f818b7fe640 1 --2- 172.21.15.5:0/1077176331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f818c06a910 0x7f818c15b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:14.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.892+0000 7f818b7fe640 1 -- 172.21.15.5:0/1077176331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817c0093b0 con 0x7f818c1601f0 2023-07-14T13:32:14.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.892+0000 7f818b7fe640 1 --2- 172.21.15.5:0/1077176331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c1601f0 0x7f818c154b50 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f818400b970 tx=0x7f818400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:14.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.892+0000 7f81837fe640 1 -- 172.21.15.5:0/1077176331 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818400cb40 con 0x7f818c1601f0 2023-07-14T13:32:14.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.892+0000 7f81837fe640 1 -- 172.21.15.5:0/1077176331 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818400cca0 con 0x7f818c1601f0 2023-07-14T13:32:14.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.892+0000 7f8191796640 1 -- 172.21.15.5:0/1077176331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f818c0b3cc0 con 0x7f818c1601f0 2023-07-14T13:32:14.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.892+0000 7f81837fe640 1 -- 172.21.15.5:0/1077176331 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8184014680 con 0x7f818c1601f0 2023-07-14T13:32:14.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.892+0000 7f8191796640 1 -- 172.21.15.5:0/1077176331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f818c154850 con 0x7f818c1601f0 2023-07-14T13:32:14.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.892+0000 7f8191796640 1 -- 172.21.15.5:0/1077176331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f818c0b3ee0 con 0x7f818c1601f0 2023-07-14T13:32:14.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.892+0000 7f81837fe640 1 -- 172.21.15.5:0/1077176331 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f818401d3b0 con 0x7f818c1601f0 2023-07-14T13:32:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.896+0000 7f81837fe640 1 --2- 172.21.15.5:0/1077176331 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f816c0663d0 0x7f816c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.896+0000 7f81837fe640 1 -- 172.21.15.5:0/1077176331 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6012+0+0 (secure 0 0 0) 0x7f8184083c60 con 0x7f818c1601f0 2023-07-14T13:32:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.896+0000 7f818affd640 1 --2- 172.21.15.5:0/1077176331 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f816c0663d0 0x7f816c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:14.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.896+0000 7f818affd640 1 --2- 172.21.15.5:0/1077176331 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f816c0663d0 0x7f816c068880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f817c0ae000 tx=0x7f817c0a6000 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:14.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:14.900+0000 7f81837fe640 1 -- 172.21.15.5:0/1077176331 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f81840510a0 con 0x7f818c1601f0 2023-07-14T13:32:15.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.052+0000 7f8191796640 1 -- 172.21.15.5:0/1077176331 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f818c0678d0 con 0x7f818c1601f0 2023-07-14T13:32:15.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.056+0000 7f81837fe640 1 -- 172.21.15.5:0/1077176331 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v62) v1 ==== 104+0+0 (secure 0 0 0) 0x7f81840546c0 con 0x7f818c1601f0 2023-07-14T13:32:15.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.060+0000 7f8191796640 1 -- 172.21.15.5:0/1077176331 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f816c0663d0 msgr2=0x7f816c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:15.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.060+0000 7f8191796640 1 --2- 172.21.15.5:0/1077176331 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f816c0663d0 0x7f816c068880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f817c0ae000 tx=0x7f817c0a6000 comp rx=0 tx=0).stop 2023-07-14T13:32:15.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.060+0000 7f8191796640 1 -- 172.21.15.5:0/1077176331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c1601f0 msgr2=0x7f818c154b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:15.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.060+0000 7f8191796640 1 --2- 172.21.15.5:0/1077176331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c1601f0 0x7f818c154b50 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f818400b970 tx=0x7f818400be30 comp rx=0 tx=0).stop 2023-07-14T13:32:15.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.060+0000 7f8191796640 1 -- 172.21.15.5:0/1077176331 shutdown_connections 2023-07-14T13:32:15.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.060+0000 7f8191796640 1 --2- 172.21.15.5:0/1077176331 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f816c0663d0 0x7f816c068880 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:15.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.060+0000 7f8191796640 1 --2- 172.21.15.5:0/1077176331 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f818c1601f0 0x7f818c154b50 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:15.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.060+0000 7f8191796640 1 --2- 172.21.15.5:0/1077176331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f818c06a910 0x7f818c15b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:15.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.060+0000 7f8191796640 1 --2- 172.21.15.5:0/1077176331 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f818c06a540 0x7f818c154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:15.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.060+0000 7f8191796640 1 -- 172.21.15.5:0/1077176331 >> 172.21.15.5:0/1077176331 conn(0x7f818c099490 msgr2=0x7f818c0b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:15.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.060+0000 7f8191796640 1 -- 172.21.15.5:0/1077176331 shutdown_connections 2023-07-14T13:32:15.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.060+0000 7f8191796640 1 -- 172.21.15.5:0/1077176331 wait complete. 2023-07-14T13:32:15.081 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-14T13:32:15.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.232+0000 7f4b540bd640 1 Processor -- start 2023-07-14T13:32:15.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.232+0000 7f4b540bd640 1 -- start start 2023-07-14T13:32:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.232+0000 7f4b540bd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b4c159500 0x7f4b4c0cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.232+0000 7f4b540bd640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b4c0b08d0 con 0x7f4b4c156560 2023-07-14T13:32:15.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.232+0000 7f4b540bd640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b4c159cb0 con 0x7f4b4c0cd670 2023-07-14T13:32:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.232+0000 7f4b540bd640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b4c1599d0 con 0x7f4b4c159500 2023-07-14T13:32:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.232+0000 7f4b5265a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b4c159500 0x7f4b4c0cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.232+0000 7f4b51e59640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4b4c156560 0x7f4b4c0ccf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45526/0 (socket says 172.21.15.5:45526) 2023-07-14T13:32:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.232+0000 7f4b5265a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b4c159500 0x7f4b4c0cb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51166/0 (socket says 172.21.15.5:51166) 2023-07-14T13:32:15.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.232+0000 7f4b51e59640 1 -- 172.21.15.5:0/1313949918 learned_addr learned my addr 172.21.15.5:0/1313949918 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.236+0000 7f4b5265a640 1 -- 172.21.15.5:0/1313949918 >> v1:172.21.15.154:6789/0 conn(0x7f4b4c0cd670 legacy=0x7f4b4c158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.236+0000 7f4b5265a640 1 -- 172.21.15.5:0/1313949918 >> v1:172.21.15.5:6789/0 conn(0x7f4b4c156560 legacy=0x7f4b4c0ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.236+0000 7f4b50e57640 1 -- 172.21.15.5:0/1313949918 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960318084 0 0) 0x7f4b4c0b08d0 con 0x7f4b4c156560 2023-07-14T13:32:15.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.236+0000 7f4b5265a640 1 -- 172.21.15.5:0/1313949918 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c0ca900 con 0x7f4b4c159500 2023-07-14T13:32:15.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.236+0000 7f4b5265a640 1 --2- 172.21.15.5:0/1313949918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b4c159500 0x7f4b4c0cb3e0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f4b44009d90 tx=0x7f4b4401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ec799bc6984af server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:15.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.236+0000 7f4b50e57640 1 -- 172.21.15.5:0/1313949918 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b440a59e0 con 0x7f4b4c159500 2023-07-14T13:32:15.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.236+0000 7f4b50e57640 1 -- 172.21.15.5:0/1313949918 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b440a5b40 con 0x7f4b4c159500 2023-07-14T13:32:15.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.236+0000 7f4b50e57640 1 -- 172.21.15.5:0/1313949918 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b440ad440 con 0x7f4b4c159500 2023-07-14T13:32:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.236+0000 7f4b540bd640 1 -- 172.21.15.5:0/1313949918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b4c159500 msgr2=0x7f4b4c0cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.236+0000 7f4b540bd640 1 --2- 172.21.15.5:0/1313949918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b4c159500 0x7f4b4c0cb3e0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f4b44009d90 tx=0x7f4b4401c920 comp rx=0 tx=0).stop 2023-07-14T13:32:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.236+0000 7f4b540bd640 1 -- 172.21.15.5:0/1313949918 shutdown_connections 2023-07-14T13:32:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.236+0000 7f4b540bd640 1 --2- 172.21.15.5:0/1313949918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b4c159500 0x7f4b4c0cb3e0 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:15.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.236+0000 7f4b540bd640 1 -- 172.21.15.5:0/1313949918 >> 172.21.15.5:0/1313949918 conn(0x7f4b4c0afac0 msgr2=0x7f4b4c0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.240+0000 7f4b540bd640 1 -- 172.21.15.5:0/1313949918 shutdown_connections 2023-07-14T13:32:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.240+0000 7f4b540bd640 1 -- 172.21.15.5:0/1313949918 wait complete. 2023-07-14T13:32:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.240+0000 7f4b540bd640 1 Processor -- start 2023-07-14T13:32:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.240+0000 7f4b540bd640 1 -- start start 2023-07-14T13:32:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.240+0000 7f4b540bd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b4c0cd670 0x7f4b4c15ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.240+0000 7f4b540bd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b4c156560 0x7f4b4c0c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.240+0000 7f4b540bd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b4c159500 0x7f4b4c0ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.240+0000 7f4b540bd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0c43a0 con 0x7f4b4c159500 2023-07-14T13:32:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.240+0000 7f4b540bd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c15a050 con 0x7f4b4c156560 2023-07-14T13:32:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.240+0000 7f4b540bd640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0cd3e0 con 0x7f4b4c0cd670 2023-07-14T13:32:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.240+0000 7f4b5265a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b4c159500 0x7f4b4c0ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.240+0000 7f4b5265a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b4c159500 0x7f4b4c0ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51172/0 (socket says 172.21.15.5:51172) 2023-07-14T13:32:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.240+0000 7f4b5265a640 1 -- 172.21.15.5:0/1974176832 learned_addr learned my addr 172.21.15.5:0/1974176832 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.240+0000 7f4b51e59640 1 --2- 172.21.15.5:0/1974176832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b4c0cd670 0x7f4b4c15ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.240+0000 7f4b51658640 1 --2- 172.21.15.5:0/1974176832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b4c156560 0x7f4b4c0c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.240+0000 7f4b5265a640 1 -- 172.21.15.5:0/1974176832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b4c0cd670 msgr2=0x7f4b4c15ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.240+0000 7f4b5265a640 1 --2- 172.21.15.5:0/1974176832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b4c0cd670 0x7f4b4c15ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.240+0000 7f4b5265a640 1 -- 172.21.15.5:0/1974176832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b4c156560 msgr2=0x7f4b4c0c3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.240+0000 7f4b5265a640 1 --2- 172.21.15.5:0/1974176832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b4c156560 0x7f4b4c0c3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.240+0000 7f4b5265a640 1 -- 172.21.15.5:0/1974176832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b44009a70 con 0x7f4b4c159500 2023-07-14T13:32:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.240+0000 7f4b51e59640 1 --2- 172.21.15.5:0/1974176832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b4c0cd670 0x7f4b4c15ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.240+0000 7f4b5265a640 1 --2- 172.21.15.5:0/1974176832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b4c159500 0x7f4b4c0ccea0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f4b44019530 tx=0x7f4b440196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.244+0000 7f4b427fc640 1 -- 172.21.15.5:0/1974176832 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b440a59e0 con 0x7f4b4c159500 2023-07-14T13:32:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.244+0000 7f4b427fc640 1 -- 172.21.15.5:0/1974176832 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b440039a0 con 0x7f4b4c159500 2023-07-14T13:32:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.244+0000 7f4b540bd640 1 -- 172.21.15.5:0/1974176832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b4c155450 con 0x7f4b4c159500 2023-07-14T13:32:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.244+0000 7f4b427fc640 1 -- 172.21.15.5:0/1974176832 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b44003d10 con 0x7f4b4c159500 2023-07-14T13:32:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.244+0000 7f4b540bd640 1 -- 172.21.15.5:0/1974176832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4c155a10 con 0x7f4b4c159500 2023-07-14T13:32:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.244+0000 7f4b540bd640 1 -- 172.21.15.5:0/1974176832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b4c0678d0 con 0x7f4b4c159500 2023-07-14T13:32:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.244+0000 7f4b427fc640 1 -- 172.21.15.5:0/1974176832 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4b440b4050 con 0x7f4b4c159500 2023-07-14T13:32:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.244+0000 7f4b427fc640 1 --2- 172.21.15.5:0/1974176832 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f4b300663a0 0x7f4b30068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.244+0000 7f4b427fc640 1 -- 172.21.15.5:0/1974176832 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6012+0+0 (secure 0 0 0) 0x7f4b4411f110 con 0x7f4b4c159500 2023-07-14T13:32:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.244+0000 7f4b51e59640 1 --2- 172.21.15.5:0/1974176832 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f4b300663a0 0x7f4b30068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.248+0000 7f4b51e59640 1 --2- 172.21.15.5:0/1974176832 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f4b300663a0 0x7f4b30068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4b48000f70 tx=0x7f4b48007c60 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:15.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.248+0000 7f4b427fc640 1 -- 172.21.15.5:0/1974176832 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4b440ec680 con 0x7f4b4c159500 2023-07-14T13:32:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.404+0000 7f4b540bd640 1 -- 172.21.15.5:0/1974176832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f4b4c15a190 con 0x7f4b4c159500 2023-07-14T13:32:15.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.412+0000 7f4b427fc640 1 -- 172.21.15.5:0/1974176832 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v63) v1 ==== 115+0+0 (secure 0 0 0) 0x7f4b440efca0 con 0x7f4b4c159500 2023-07-14T13:32:15.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.412+0000 7f4b540bd640 1 -- 172.21.15.5:0/1974176832 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f4b300663a0 msgr2=0x7f4b30068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.412+0000 7f4b540bd640 1 --2- 172.21.15.5:0/1974176832 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f4b300663a0 0x7f4b30068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4b48000f70 tx=0x7f4b48007c60 comp rx=0 tx=0).stop 2023-07-14T13:32:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.412+0000 7f4b540bd640 1 -- 172.21.15.5:0/1974176832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b4c159500 msgr2=0x7f4b4c0ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.412+0000 7f4b540bd640 1 --2- 172.21.15.5:0/1974176832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b4c159500 0x7f4b4c0ccea0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f4b44019530 tx=0x7f4b440196c0 comp rx=0 tx=0).stop 2023-07-14T13:32:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.412+0000 7f4b540bd640 1 -- 172.21.15.5:0/1974176832 shutdown_connections 2023-07-14T13:32:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.412+0000 7f4b540bd640 1 --2- 172.21.15.5:0/1974176832 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f4b300663a0 0x7f4b30068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:15.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.412+0000 7f4b540bd640 1 --2- 172.21.15.5:0/1974176832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b4c159500 0x7f4b4c0ccea0 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.412+0000 7f4b540bd640 1 --2- 172.21.15.5:0/1974176832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b4c156560 0x7f4b4c0c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.412+0000 7f4b540bd640 1 --2- 172.21.15.5:0/1974176832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4b4c0cd670 0x7f4b4c15ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.412+0000 7f4b540bd640 1 -- 172.21.15.5:0/1974176832 >> 172.21.15.5:0/1974176832 conn(0x7f4b4c0afac0 msgr2=0x7f4b4c0ad930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.412+0000 7f4b540bd640 1 -- 172.21.15.5:0/1974176832 shutdown_connections 2023-07-14T13:32:15.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.412+0000 7f4b540bd640 1 -- 172.21.15.5:0/1974176832 wait complete. 2023-07-14T13:32:15.433 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-07-14T13:32:15.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.576+0000 7f5720a0b640 1 Processor -- start 2023-07-14T13:32:15.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.576+0000 7f5720a0b640 1 -- start start 2023-07-14T13:32:15.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.576+0000 7f5720a0b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f571c15fdf0 0x7f571c0c9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:15.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.576+0000 7f5720a0b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f571c0cb080 con 0x7f571c15bdf0 2023-07-14T13:32:15.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.576+0000 7f5720a0b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f571c0cb2e0 con 0x7f571c15f970 2023-07-14T13:32:15.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.576+0000 7f5720a0b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f571c0cb5c0 con 0x7f571c15fdf0 2023-07-14T13:32:15.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.576+0000 7f571a59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f571c15bdf0 0x7f571c0ca970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45534/0 (socket says 172.21.15.5:45534) 2023-07-14T13:32:15.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.576+0000 7f571a59c640 1 -- 172.21.15.5:0/219252323 learned_addr learned my addr 172.21.15.5:0/219252323 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:15.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.580+0000 7f571ad9d640 1 --2- 172.21.15.5:0/219252323 >> v2:172.21.15.154:3300/0 conn(0x7f571c15fdf0 0x7f571c0c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:15.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.580+0000 7f5719d9b640 1 -- 172.21.15.5:0/219252323 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2457724643 0 0) 0x7f571c0cb080 con 0x7f571c15bdf0 2023-07-14T13:32:15.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.580+0000 7f5719d9b640 1 -- 172.21.15.5:0/219252323 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5708003530 con 0x7f571c15bdf0 2023-07-14T13:32:15.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.580+0000 7f5719d9b640 1 -- 172.21.15.5:0/219252323 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4191878080 0 0) 0x7f5708003530 con 0x7f571c15bdf0 2023-07-14T13:32:15.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.580+0000 7f5719d9b640 1 -- 172.21.15.5:0/219252323 >> v2:172.21.15.154:3300/0 conn(0x7f571c15fdf0 msgr2=0x7f571c0c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:15.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.580+0000 7f5719d9b640 1 --2- 172.21.15.5:0/219252323 >> v2:172.21.15.154:3300/0 conn(0x7f571c15fdf0 0x7f571c0c9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:15.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.580+0000 7f5719d9b640 1 -- 172.21.15.5:0/219252323 >> v1:172.21.15.154:6789/0 conn(0x7f571c15f970 legacy=0x7f571c0c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:15.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.580+0000 7f5719d9b640 1 -- 172.21.15.5:0/219252323 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571c0cb8a0 con 0x7f571c15bdf0 2023-07-14T13:32:15.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.580+0000 7f5719d9b640 1 -- 172.21.15.5:0/219252323 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f570c001680 con 0x7f571c15bdf0 2023-07-14T13:32:15.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.580+0000 7f5719d9b640 1 -- 172.21.15.5:0/219252323 >> v1:172.21.15.5:6789/0 conn(0x7f571c15bdf0 legacy=0x7f571c0ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:15.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.580+0000 7f5719d9b640 1 --2- 172.21.15.5:0/219252323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5708003980 0x7f5708003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:15.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.580+0000 7f5719d9b640 1 --2- 172.21.15.5:0/219252323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57080047d0 0x7f5708004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:15.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.580+0000 7f5719d9b640 1 --2- 172.21.15.5:0/219252323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5708005180 0x7f570800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:15.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.580+0000 7f5719d9b640 1 -- 172.21.15.5:0/219252323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c0cb5c0 con 0x7f5708003980 2023-07-14T13:32:15.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.580+0000 7f5719d9b640 1 -- 172.21.15.5:0/219252323 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570800c090 con 0x7f57080047d0 2023-07-14T13:32:15.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.580+0000 7f5719d9b640 1 -- 172.21.15.5:0/219252323 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f570800c250 con 0x7f5708005180 2023-07-14T13:32:15.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.580+0000 7f571a59c640 1 --2- 172.21.15.5:0/219252323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5708003980 0x7f5708003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:15.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.580+0000 7f5713fff640 1 --2- 172.21.15.5:0/219252323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57080047d0 0x7f5708004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:15.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.580+0000 7f571ad9d640 1 --2- 172.21.15.5:0/219252323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5708005180 0x7f570800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:15.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.580+0000 7f571a59c640 1 -- 172.21.15.5:0/219252323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5708005180 msgr2=0x7f570800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:15.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.580+0000 7f571a59c640 1 --2- 172.21.15.5:0/219252323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5708005180 0x7f570800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:15.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.580+0000 7f571a59c640 1 -- 172.21.15.5:0/219252323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57080047d0 msgr2=0x7f5708004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:15.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.580+0000 7f571a59c640 1 --2- 172.21.15.5:0/219252323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57080047d0 0x7f5708004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:15.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.580+0000 7f571a59c640 1 -- 172.21.15.5:0/219252323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5708003530 con 0x7f5708003980 2023-07-14T13:32:15.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.580+0000 7f571ad9d640 1 -- 172.21.15.5:0/219252323 reap_dead start 2023-07-14T13:32:15.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.584+0000 7f571a59c640 1 --2- 172.21.15.5:0/219252323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5708003980 0x7f5708003d90 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f570c00c240 tx=0x7f570c01cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7a2a01dcd1fc2d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:15.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.584+0000 7f5719d9b640 1 -- 172.21.15.5:0/219252323 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c005ae0 con 0x7f5708003980 2023-07-14T13:32:15.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.584+0000 7f5719d9b640 1 -- 172.21.15.5:0/219252323 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570c005c40 con 0x7f5708003980 2023-07-14T13:32:15.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.584+0000 7f5719d9b640 1 -- 172.21.15.5:0/219252323 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c0a5ad0 con 0x7f5708003980 2023-07-14T13:32:15.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.584+0000 7f5720a0b640 1 -- 172.21.15.5:0/219252323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5708003980 msgr2=0x7f5708003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:15.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.584+0000 7f5720a0b640 1 --2- 172.21.15.5:0/219252323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5708003980 0x7f5708003d90 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f570c00c240 tx=0x7f570c01cb90 comp rx=0 tx=0).stop 2023-07-14T13:32:15.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.584+0000 7f5720a0b640 1 -- 172.21.15.5:0/219252323 shutdown_connections 2023-07-14T13:32:15.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.584+0000 7f5720a0b640 1 --2- 172.21.15.5:0/219252323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5708003980 0x7f5708003d90 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:15.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.584+0000 7f5720a0b640 1 -- 172.21.15.5:0/219252323 >> 172.21.15.5:0/219252323 conn(0x7f571c0afcf0 msgr2=0x7f571c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:15.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.584+0000 7f5720a0b640 1 -- 172.21.15.5:0/219252323 shutdown_connections 2023-07-14T13:32:15.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.584+0000 7f5720a0b640 1 -- 172.21.15.5:0/219252323 wait complete. 2023-07-14T13:32:15.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.584+0000 7f5720a0b640 1 Processor -- start 2023-07-14T13:32:15.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.584+0000 7f5720a0b640 1 -- start start 2023-07-14T13:32:15.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.584+0000 7f5720a0b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5708003980 0x7f571c1f4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:15.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.588+0000 7f5720a0b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f571c0adb60 0x7f571c0b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:15.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.588+0000 7f5720a0b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f571c158920 0x7f571c0c9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:15.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.588+0000 7f5720a0b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c0aeba0 con 0x7f5708003980 2023-07-14T13:32:15.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.588+0000 7f5720a0b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c0ae300 con 0x7f571c0adb60 2023-07-14T13:32:15.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.588+0000 7f5720a0b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571c0ae5e0 con 0x7f571c158920 2023-07-14T13:32:15.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.588+0000 7f571a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5708003980 0x7f571c1f4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:15.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.588+0000 7f571a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5708003980 0x7f571c1f4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51204/0 (socket says 172.21.15.5:51204) 2023-07-14T13:32:15.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.588+0000 7f571a59c640 1 -- 172.21.15.5:0/3021121172 learned_addr learned my addr 172.21.15.5:0/3021121172 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:15.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.588+0000 7f571ad9d640 1 --2- 172.21.15.5:0/3021121172 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f571c158920 0x7f571c0c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:15.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.588+0000 7f5713fff640 1 --2- 172.21.15.5:0/3021121172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f571c0adb60 0x7f571c0b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:15.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.588+0000 7f571a59c640 1 -- 172.21.15.5:0/3021121172 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f571c158920 msgr2=0x7f571c0c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:15.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.588+0000 7f571a59c640 1 --2- 172.21.15.5:0/3021121172 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f571c158920 0x7f571c0c9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:15.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.588+0000 7f571a59c640 1 -- 172.21.15.5:0/3021121172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f571c0adb60 msgr2=0x7f571c0b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:15.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.588+0000 7f571a59c640 1 --2- 172.21.15.5:0/3021121172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f571c0adb60 0x7f571c0b1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:15.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.588+0000 7f571a59c640 1 -- 172.21.15.5:0/3021121172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571c0ae8c0 con 0x7f5708003980 2023-07-14T13:32:15.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.588+0000 7f5713fff640 1 --2- 172.21.15.5:0/3021121172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f571c0adb60 0x7f571c0b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:15.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.588+0000 7f571ad9d640 1 --2- 172.21.15.5:0/3021121172 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f571c158920 0x7f571c0c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:15.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.588+0000 7f571a59c640 1 --2- 172.21.15.5:0/3021121172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5708003980 0x7f571c1f4fc0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f570c00c240 tx=0x7f5708005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:15.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.588+0000 7f5712ffd640 1 -- 172.21.15.5:0/3021121172 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c0b4070 con 0x7f5708003980 2023-07-14T13:32:15.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.588+0000 7f5712ffd640 1 -- 172.21.15.5:0/3021121172 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570c001480 con 0x7f5708003980 2023-07-14T13:32:15.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.588+0000 7f5712ffd640 1 -- 172.21.15.5:0/3021121172 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c0a5ad0 con 0x7f5708003980 2023-07-14T13:32:15.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.588+0000 7f5720a0b640 1 -- 172.21.15.5:0/3021121172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f571c15de40 con 0x7f5708003980 2023-07-14T13:32:15.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.588+0000 7f5720a0b640 1 -- 172.21.15.5:0/3021121172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f571c0b2440 con 0x7f5708003980 2023-07-14T13:32:15.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.588+0000 7f5720a0b640 1 -- 172.21.15.5:0/3021121172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f571c0678d0 con 0x7f5708003980 2023-07-14T13:32:15.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.588+0000 7f5712ffd640 1 -- 172.21.15.5:0/3021121172 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f570c0a5c30 con 0x7f5708003980 2023-07-14T13:32:15.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.592+0000 7f5712ffd640 1 --2- 172.21.15.5:0/3021121172 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f56fc0663a0 0x7f56fc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:15.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.592+0000 7f5712ffd640 1 -- 172.21.15.5:0/3021121172 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6012+0+0 (secure 0 0 0) 0x7f570c11ddd0 con 0x7f5708003980 2023-07-14T13:32:15.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.592+0000 7f5713fff640 1 --2- 172.21.15.5:0/3021121172 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f56fc0663a0 0x7f56fc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:15.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.592+0000 7f5713fff640 1 --2- 172.21.15.5:0/3021121172 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f56fc0663a0 0x7f56fc068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5704000c10 tx=0x7f5704009040 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:15.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.596+0000 7f5712ffd640 1 -- 172.21.15.5:0/3021121172 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f570c0eb160 con 0x7f5708003980 2023-07-14T13:32:15.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:15.804+0000 7f5720a0b640 1 -- 172.21.15.5:0/3021121172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7f571c06c380 con 0x7f5708003980 2023-07-14T13:32:16.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.364+0000 7f5712ffd640 1 -- 172.21.15.5:0/3021121172 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v1402) v1 ==== 163+0+0 (secure 0 0 0) 0x7f570c0ee780 con 0x7f5708003980 2023-07-14T13:32:16.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.364+0000 7f5720a0b640 1 -- 172.21.15.5:0/3021121172 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f56fc0663a0 msgr2=0x7f56fc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:16.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.364+0000 7f5720a0b640 1 --2- 172.21.15.5:0/3021121172 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f56fc0663a0 0x7f56fc068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5704000c10 tx=0x7f5704009040 comp rx=0 tx=0).stop 2023-07-14T13:32:16.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.364+0000 7f5720a0b640 1 -- 172.21.15.5:0/3021121172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5708003980 msgr2=0x7f571c1f4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:16.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.364+0000 7f5720a0b640 1 --2- 172.21.15.5:0/3021121172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5708003980 0x7f571c1f4fc0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f570c00c240 tx=0x7f5708005800 comp rx=0 tx=0).stop 2023-07-14T13:32:16.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.364+0000 7f5720a0b640 1 -- 172.21.15.5:0/3021121172 shutdown_connections 2023-07-14T13:32:16.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.364+0000 7f5720a0b640 1 --2- 172.21.15.5:0/3021121172 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f56fc0663a0 0x7f56fc068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:16.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.364+0000 7f5720a0b640 1 --2- 172.21.15.5:0/3021121172 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f571c158920 0x7f571c0c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:16.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.364+0000 7f5720a0b640 1 --2- 172.21.15.5:0/3021121172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f571c0adb60 0x7f571c0b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:16.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.364+0000 7f5720a0b640 1 --2- 172.21.15.5:0/3021121172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5708003980 0x7f571c1f4fc0 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:16.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.364+0000 7f5720a0b640 1 -- 172.21.15.5:0/3021121172 >> 172.21.15.5:0/3021121172 conn(0x7f571c0afcf0 msgr2=0x7f571c0ab8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:16.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.364+0000 7f5720a0b640 1 -- 172.21.15.5:0/3021121172 shutdown_connections 2023-07-14T13:32:16.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.364+0000 7f5720a0b640 1 -- 172.21.15.5:0/3021121172 wait complete. 2023-07-14T13:32:16.390 INFO:tasks.cephfs_test_runner:Test scheduled snapshots along with rentention policy ... ok 2023-07-14T13:32:16.390 INFO:tasks.cephfs_test_runner:Starting test: test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) Test the correctness of snap directory name 2023-07-14T13:32:16.391 INFO:tasks.cephfs_test_runner:test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) 2023-07-14T13:32:16.391 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-07-14T13:32:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.536+0000 7f6561f82640 1 Processor -- start 2023-07-14T13:32:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.536+0000 7f6561f82640 1 -- start start 2023-07-14T13:32:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.540+0000 7f6561f82640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f655c158ce0 0x7f655c070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.540+0000 7f6561f82640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f655c0c9730 0x7f655c0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:16.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.540+0000 7f6561f82640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f655c0cc700 con 0x7f655c0c8ad0 2023-07-14T13:32:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.540+0000 7f6561f82640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f655c0b0ff0 con 0x7f655c158ce0 2023-07-14T13:32:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.540+0000 7f6561f82640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655c070c80 con 0x7f655c0c9730 2023-07-14T13:32:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.540+0000 7f655b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f655c158ce0 0x7f655c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.540+0000 7f655b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f655c158ce0 0x7f655c070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51208/0 (socket says 172.21.15.5:51208) 2023-07-14T13:32:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.540+0000 7f655b7fe640 1 -- 172.21.15.5:0/2488064109 learned_addr learned my addr 172.21.15.5:0/2488064109 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:16.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.540+0000 7f655bfff640 1 --2- 172.21.15.5:0/2488064109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f655c0c9730 0x7f655c0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.540+0000 7f655b7fe640 1 -- 172.21.15.5:0/2488064109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f655c0c9730 msgr2=0x7f655c0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.540+0000 7f655b7fe640 1 --2- 172.21.15.5:0/2488064109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f655c0c9730 0x7f655c0ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.540+0000 7f655b7fe640 1 -- 172.21.15.5:0/2488064109 >> v1:172.21.15.5:6789/0 conn(0x7f655c0c8ad0 legacy=0x7f655c0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:16.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.540+0000 7f655b7fe640 1 -- 172.21.15.5:0/2488064109 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655c0cbdd0 con 0x7f655c158ce0 2023-07-14T13:32:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.544+0000 7f655b7fe640 1 --2- 172.21.15.5:0/2488064109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f655c158ce0 0x7f655c070450 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f654c009870 tx=0x7f654c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b01e36945eac8645 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:16.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.544+0000 7f655a7fc640 1 -- 172.21.15.5:0/2488064109 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c0ab600 con 0x7f655c158ce0 2023-07-14T13:32:16.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.544+0000 7f655a7fc640 1 -- 172.21.15.5:0/2488064109 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654c0a7050 con 0x7f655c158ce0 2023-07-14T13:32:16.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.544+0000 7f655a7fc640 1 -- 172.21.15.5:0/2488064109 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c0ab980 con 0x7f655c158ce0 2023-07-14T13:32:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.544+0000 7f6561f82640 1 -- 172.21.15.5:0/2488064109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f655c158ce0 msgr2=0x7f655c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.544+0000 7f6561f82640 1 --2- 172.21.15.5:0/2488064109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f655c158ce0 0x7f655c070450 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f654c009870 tx=0x7f654c01c3f0 comp rx=0 tx=0).stop 2023-07-14T13:32:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.544+0000 7f6561f82640 1 -- 172.21.15.5:0/2488064109 shutdown_connections 2023-07-14T13:32:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.544+0000 7f6561f82640 1 --2- 172.21.15.5:0/2488064109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f655c0c9730 0x7f655c0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.544+0000 7f6561f82640 1 --2- 172.21.15.5:0/2488064109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f655c158ce0 0x7f655c070450 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:16.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.544+0000 7f6561f82640 1 -- 172.21.15.5:0/2488064109 >> 172.21.15.5:0/2488064109 conn(0x7f655c0afcf0 msgr2=0x7f655c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.544+0000 7f6561f82640 1 -- 172.21.15.5:0/2488064109 shutdown_connections 2023-07-14T13:32:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.544+0000 7f6561f82640 1 -- 172.21.15.5:0/2488064109 wait complete. 2023-07-14T13:32:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.544+0000 7f6561f82640 1 Processor -- start 2023-07-14T13:32:16.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.544+0000 7f6561f82640 1 -- start start 2023-07-14T13:32:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.548+0000 7f6561f82640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f655c0c8ad0 0x7f655c14c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.548+0000 7f6561f82640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f655c0c9730 0x7f655c159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.548+0000 7f6561f82640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f655c158ce0 0x7f655c148be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.548+0000 7f6561f82640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655c15a150 con 0x7f655c0c9730 2023-07-14T13:32:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.548+0000 7f6561f82640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655c0c1c90 con 0x7f655c158ce0 2023-07-14T13:32:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.548+0000 7f6561f82640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655c165010 con 0x7f655c0c8ad0 2023-07-14T13:32:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.548+0000 7f655affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f655c0c9730 0x7f655c159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.548+0000 7f655affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f655c0c9730 0x7f655c159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51218/0 (socket says 172.21.15.5:51218) 2023-07-14T13:32:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.548+0000 7f655affd640 1 -- 172.21.15.5:0/3282703435 learned_addr learned my addr 172.21.15.5:0/3282703435 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.548+0000 7f655bfff640 1 --2- 172.21.15.5:0/3282703435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f655c158ce0 0x7f655c148be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.548+0000 7f655b7fe640 1 --2- 172.21.15.5:0/3282703435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f655c0c8ad0 0x7f655c14c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.548+0000 7f655affd640 1 -- 172.21.15.5:0/3282703435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f655c0c8ad0 msgr2=0x7f655c14c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.548+0000 7f655affd640 1 --2- 172.21.15.5:0/3282703435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f655c0c8ad0 0x7f655c14c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.548+0000 7f655affd640 1 -- 172.21.15.5:0/3282703435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f655c158ce0 msgr2=0x7f655c148be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.548+0000 7f655affd640 1 --2- 172.21.15.5:0/3282703435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f655c158ce0 0x7f655c148be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:16.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.548+0000 7f655affd640 1 -- 172.21.15.5:0/3282703435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654c0094d0 con 0x7f655c0c9730 2023-07-14T13:32:16.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.548+0000 7f655b7fe640 1 --2- 172.21.15.5:0/3282703435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f655c0c8ad0 0x7f655c14c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:16.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.548+0000 7f655bfff640 1 --2- 172.21.15.5:0/3282703435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f655c158ce0 0x7f655c148be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:16.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.548+0000 7f655affd640 1 --2- 172.21.15.5:0/3282703435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f655c0c9730 0x7f655c159c10 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f655000c500 tx=0x7f655000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:16.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.548+0000 7f6543fff640 1 -- 172.21.15.5:0/3282703435 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6550005220 con 0x7f655c0c9730 2023-07-14T13:32:16.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.548+0000 7f6543fff640 1 -- 172.21.15.5:0/3282703435 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6550005380 con 0x7f655c0c9730 2023-07-14T13:32:16.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.548+0000 7f6561f82640 1 -- 172.21.15.5:0/3282703435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655c15a370 con 0x7f655c0c9730 2023-07-14T13:32:16.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.548+0000 7f6543fff640 1 -- 172.21.15.5:0/3282703435 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6550007270 con 0x7f655c0c9730 2023-07-14T13:32:16.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.548+0000 7f6561f82640 1 -- 172.21.15.5:0/3282703435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655c15a930 con 0x7f655c0c9730 2023-07-14T13:32:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.548+0000 7f6561f82640 1 -- 172.21.15.5:0/3282703435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f655c0ca1a0 con 0x7f655c0c9730 2023-07-14T13:32:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.548+0000 7f6543fff640 1 -- 172.21.15.5:0/3282703435 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f65500073d0 con 0x7f655c0c9730 2023-07-14T13:32:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.552+0000 7f6543fff640 1 --2- 172.21.15.5:0/3282703435 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f65480663d0 0x7f6548068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.552+0000 7f6543fff640 1 -- 172.21.15.5:0/3282703435 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6012+0+0 (secure 0 0 0) 0x7f6550083780 con 0x7f655c0c9730 2023-07-14T13:32:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.552+0000 7f655b7fe640 1 --2- 172.21.15.5:0/3282703435 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f65480663d0 0x7f6548068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.552+0000 7f655b7fe640 1 --2- 172.21.15.5:0/3282703435 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f65480663d0 0x7f6548068880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f654c0ad000 tx=0x7f654c0a4f90 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:16.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.556+0000 7f6543fff640 1 -- 172.21.15.5:0/3282703435 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6550050a90 con 0x7f655c0c9730 2023-07-14T13:32:16.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:16.764+0000 7f6561f82640 1 -- 172.21.15.5:0/3282703435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7f655c166900 con 0x7f655c0c9730 2023-07-14T13:32:17.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.364+0000 7f6543fff640 1 -- 172.21.15.5:0/3282703435 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v1403) v1 ==== 158+0+0 (secure 0 0 0) 0x7f655c166900 con 0x7f655c0c9730 2023-07-14T13:32:17.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.368+0000 7f6561f82640 1 -- 172.21.15.5:0/3282703435 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f65480663d0 msgr2=0x7f6548068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:17.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.368+0000 7f6561f82640 1 --2- 172.21.15.5:0/3282703435 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f65480663d0 0x7f6548068880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f654c0ad000 tx=0x7f654c0a4f90 comp rx=0 tx=0).stop 2023-07-14T13:32:17.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.368+0000 7f6561f82640 1 -- 172.21.15.5:0/3282703435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f655c0c9730 msgr2=0x7f655c159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:17.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.368+0000 7f6561f82640 1 --2- 172.21.15.5:0/3282703435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f655c0c9730 0x7f655c159c10 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f655000c500 tx=0x7f655000c9c0 comp rx=0 tx=0).stop 2023-07-14T13:32:17.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.368+0000 7f6561f82640 1 -- 172.21.15.5:0/3282703435 shutdown_connections 2023-07-14T13:32:17.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.368+0000 7f6561f82640 1 --2- 172.21.15.5:0/3282703435 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f65480663d0 0x7f6548068880 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:17.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.368+0000 7f6561f82640 1 --2- 172.21.15.5:0/3282703435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f655c158ce0 0x7f655c148be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:17.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.368+0000 7f6561f82640 1 --2- 172.21.15.5:0/3282703435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f655c0c9730 0x7f655c159c10 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:17.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.368+0000 7f6561f82640 1 --2- 172.21.15.5:0/3282703435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f655c0c8ad0 0x7f655c14c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:17.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.368+0000 7f6561f82640 1 -- 172.21.15.5:0/3282703435 >> 172.21.15.5:0/3282703435 conn(0x7f655c0afcf0 msgr2=0x7f655c0b1130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:17.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.368+0000 7f6561f82640 1 -- 172.21.15.5:0/3282703435 shutdown_connections 2023-07-14T13:32:17.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.368+0000 7f6561f82640 1 -- 172.21.15.5:0/3282703435 wait complete. 2023-07-14T13:32:17.393 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-14T13:32:17.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.544+0000 7f852006a640 1 Processor -- start 2023-07-14T13:32:17.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.544+0000 7f852006a640 1 -- start start 2023-07-14T13:32:17.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.544+0000 7f852006a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85180c3ac0 0x7f85180c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:17.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.544+0000 7f852006a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f85180af2b0 0x7f85180ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:17.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.544+0000 7f852006a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f85180cd120 0x7f85180cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:17.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.544+0000 7f852006a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85180ca540 con 0x7f85180af2b0 2023-07-14T13:32:17.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.544+0000 7f852006a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85180695b0 con 0x7f85180cd120 2023-07-14T13:32:17.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.544+0000 7f852006a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8518069890 con 0x7f85180c3ac0 2023-07-14T13:32:17.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.544+0000 7f851d605640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f85180af2b0 0x7f85180ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:17.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.544+0000 7f851d605640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f85180af2b0 0x7f85180ca000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51232/0 (socket says 172.21.15.5:51232) 2023-07-14T13:32:17.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.544+0000 7f851d605640 1 -- 172.21.15.5:0/2268322324 learned_addr learned my addr 172.21.15.5:0/2268322324 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:17.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.544+0000 7f851e607640 1 --2- 172.21.15.5:0/2268322324 >> v2:172.21.15.154:3300/0 conn(0x7f85180cd120 0x7f85180cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:17.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.544+0000 7f851de06640 1 --2- 172.21.15.5:0/2268322324 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85180c3ac0 0x7f85180c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:17.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.544+0000 7f851d605640 1 -- 172.21.15.5:0/2268322324 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85180c3ac0 msgr2=0x7f85180c2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:17.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.544+0000 7f851d605640 1 --2- 172.21.15.5:0/2268322324 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85180c3ac0 0x7f85180c2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:17.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.544+0000 7f851d605640 1 -- 172.21.15.5:0/2268322324 >> v2:172.21.15.154:3300/0 conn(0x7f85180cd120 msgr2=0x7f85180cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:17.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.544+0000 7f851d605640 1 --2- 172.21.15.5:0/2268322324 >> v2:172.21.15.154:3300/0 conn(0x7f85180cd120 0x7f85180cd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:17.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.544+0000 7f851d605640 1 -- 172.21.15.5:0/2268322324 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8518069b70 con 0x7f85180af2b0 2023-07-14T13:32:17.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.544+0000 7f851e607640 1 --2- 172.21.15.5:0/2268322324 >> v2:172.21.15.154:3300/0 conn(0x7f85180cd120 0x7f85180cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:17.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.548+0000 7f851d605640 1 --2- 172.21.15.5:0/2268322324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85180af2b0 0x7f85180ca000 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f851815aab0 tx=0x7f850801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66ff457a668c3d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:17.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.548+0000 7f851ce04640 1 -- 172.21.15.5:0/2268322324 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85080ab640 con 0x7f85180af2b0 2023-07-14T13:32:17.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.548+0000 7f851ce04640 1 -- 172.21.15.5:0/2268322324 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85080a7070 con 0x7f85180af2b0 2023-07-14T13:32:17.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.548+0000 7f851ce04640 1 -- 172.21.15.5:0/2268322324 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85080ab9c0 con 0x7f85180af2b0 2023-07-14T13:32:17.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.548+0000 7f852006a640 1 -- 172.21.15.5:0/2268322324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85180af2b0 msgr2=0x7f85180ca000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:17.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.548+0000 7f852006a640 1 --2- 172.21.15.5:0/2268322324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85180af2b0 0x7f85180ca000 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f851815aab0 tx=0x7f850801c500 comp rx=0 tx=0).stop 2023-07-14T13:32:17.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.548+0000 7f852006a640 1 -- 172.21.15.5:0/2268322324 shutdown_connections 2023-07-14T13:32:17.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.548+0000 7f852006a640 1 --2- 172.21.15.5:0/2268322324 >> v2:172.21.15.154:3300/0 conn(0x7f85180cd120 0x7f85180cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:17.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.548+0000 7f852006a640 1 --2- 172.21.15.5:0/2268322324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85180af2b0 0x7f85180ca000 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:17.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.548+0000 7f852006a640 1 --2- 172.21.15.5:0/2268322324 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85180c3ac0 0x7f85180c2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:17.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.548+0000 7f852006a640 1 -- 172.21.15.5:0/2268322324 >> 172.21.15.5:0/2268322324 conn(0x7f85180cde90 msgr2=0x7f85180ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:17.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.548+0000 7f852006a640 1 -- 172.21.15.5:0/2268322324 shutdown_connections 2023-07-14T13:32:17.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.548+0000 7f852006a640 1 -- 172.21.15.5:0/2268322324 wait complete. 2023-07-14T13:32:17.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.552+0000 7f852006a640 1 Processor -- start 2023-07-14T13:32:17.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.552+0000 7f852006a640 1 -- start start 2023-07-14T13:32:17.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.552+0000 7f852006a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85180af2b0 0x7f85181400e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:17.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.552+0000 7f852006a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85180c3ac0 0x7f8518151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:17.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.552+0000 7f852006a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85180cd120 0x7f85180c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:17.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.552+0000 7f852006a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8518140620 con 0x7f85180c3ac0 2023-07-14T13:32:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.552+0000 7f852006a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85181fc570 con 0x7f85180af2b0 2023-07-14T13:32:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.552+0000 7f852006a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85181fb8f0 con 0x7f85180cd120 2023-07-14T13:32:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.552+0000 7f851d605640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85180c3ac0 0x7f8518151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.552+0000 7f851d605640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85180c3ac0 0x7f8518151a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51242/0 (socket says 172.21.15.5:51242) 2023-07-14T13:32:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.552+0000 7f851d605640 1 -- 172.21.15.5:0/4202616710 learned_addr learned my addr 172.21.15.5:0/4202616710 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.552+0000 7f851e607640 1 --2- 172.21.15.5:0/4202616710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85180cd120 0x7f85180c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:17.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.552+0000 7f851de06640 1 --2- 172.21.15.5:0/4202616710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85180af2b0 0x7f85181400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:17.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.552+0000 7f851d605640 1 -- 172.21.15.5:0/4202616710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85180cd120 msgr2=0x7f85180c2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:17.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.552+0000 7f851d605640 1 --2- 172.21.15.5:0/4202616710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85180cd120 0x7f85180c2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:17.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.552+0000 7f851d605640 1 -- 172.21.15.5:0/4202616710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85180af2b0 msgr2=0x7f85181400e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:17.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.552+0000 7f851d605640 1 --2- 172.21.15.5:0/4202616710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85180af2b0 0x7f85181400e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:17.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.552+0000 7f851d605640 1 -- 172.21.15.5:0/4202616710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85080094d0 con 0x7f85180c3ac0 2023-07-14T13:32:17.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.552+0000 7f851d605640 1 --2- 172.21.15.5:0/4202616710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85180c3ac0 0x7f8518151a20 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f850801c9e0 tx=0x7f850801ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:17.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.552+0000 7f850e7fc640 1 -- 172.21.15.5:0/4202616710 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85080be3f0 con 0x7f85180c3ac0 2023-07-14T13:32:17.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.552+0000 7f850e7fc640 1 -- 172.21.15.5:0/4202616710 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85080be570 con 0x7f85180c3ac0 2023-07-14T13:32:17.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.552+0000 7f850e7fc640 1 -- 172.21.15.5:0/4202616710 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85080be920 con 0x7f85180c3ac0 2023-07-14T13:32:17.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.552+0000 7f852006a640 1 -- 172.21.15.5:0/4202616710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85181fbbd0 con 0x7f85180c3ac0 2023-07-14T13:32:17.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.552+0000 7f852006a640 1 -- 172.21.15.5:0/4202616710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85181fc190 con 0x7f85180c3ac0 2023-07-14T13:32:17.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.552+0000 7f852006a640 1 -- 172.21.15.5:0/4202616710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8518162a90 con 0x7f85180c3ac0 2023-07-14T13:32:17.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.556+0000 7f850e7fc640 1 -- 172.21.15.5:0/4202616710 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f85080b43f0 con 0x7f85180c3ac0 2023-07-14T13:32:17.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.556+0000 7f850e7fc640 1 --2- 172.21.15.5:0/4202616710 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f84fc0663a0 0x7f84fc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:17.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.556+0000 7f850e7fc640 1 -- 172.21.15.5:0/4202616710 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6012+0+0 (secure 0 0 0) 0x7f850811e370 con 0x7f85180c3ac0 2023-07-14T13:32:17.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.556+0000 7f851de06640 1 --2- 172.21.15.5:0/4202616710 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f84fc0663a0 0x7f84fc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:17.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.556+0000 7f851de06640 1 --2- 172.21.15.5:0/4202616710 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f84fc0663a0 0x7f84fc068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f85140045f0 tx=0x7f8514008040 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:17.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.560+0000 7f850e7fc640 1 -- 172.21.15.5:0/4202616710 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f85080eb690 con 0x7f85180c3ac0 2023-07-14T13:32:17.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.712+0000 7f852006a640 1 -- 172.21.15.5:0/4202616710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f85180678d0 con 0x7f85180c3ac0 2023-07-14T13:32:17.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.720+0000 7f850e7fc640 1 -- 172.21.15.5:0/4202616710 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v64)=0 v64) v1 ==== 122+0+0 (secure 0 0 0) 0x7f85080eecb0 con 0x7f85180c3ac0 2023-07-14T13:32:17.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.720+0000 7f852006a640 1 -- 172.21.15.5:0/4202616710 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f84fc0663a0 msgr2=0x7f84fc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:17.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.720+0000 7f852006a640 1 --2- 172.21.15.5:0/4202616710 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f84fc0663a0 0x7f84fc068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f85140045f0 tx=0x7f8514008040 comp rx=0 tx=0).stop 2023-07-14T13:32:17.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.720+0000 7f852006a640 1 -- 172.21.15.5:0/4202616710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85180c3ac0 msgr2=0x7f8518151a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:17.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.720+0000 7f852006a640 1 --2- 172.21.15.5:0/4202616710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85180c3ac0 0x7f8518151a20 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f850801c9e0 tx=0x7f850801ad40 comp rx=0 tx=0).stop 2023-07-14T13:32:17.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.720+0000 7f852006a640 1 -- 172.21.15.5:0/4202616710 shutdown_connections 2023-07-14T13:32:17.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.720+0000 7f852006a640 1 --2- 172.21.15.5:0/4202616710 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f84fc0663a0 0x7f84fc068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:17.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.720+0000 7f852006a640 1 --2- 172.21.15.5:0/4202616710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85180cd120 0x7f85180c2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:17.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.720+0000 7f852006a640 1 --2- 172.21.15.5:0/4202616710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85180c3ac0 0x7f8518151a20 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:17.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.720+0000 7f852006a640 1 --2- 172.21.15.5:0/4202616710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85180af2b0 0x7f85181400e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:17.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.720+0000 7f852006a640 1 -- 172.21.15.5:0/4202616710 >> 172.21.15.5:0/4202616710 conn(0x7f85180cde90 msgr2=0x7f851806b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:17.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.720+0000 7f852006a640 1 -- 172.21.15.5:0/4202616710 shutdown_connections 2023-07-14T13:32:17.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:17.720+0000 7f852006a640 1 -- 172.21.15.5:0/4202616710 wait complete. 2023-07-14T13:32:17.742 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T13:32:17.742 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:32:17.806 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:32:17.864 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T13:32:17.865 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:32:17.865 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:32:17.874 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:32:17.875 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:32:17.875 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:32:17.885 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:32:17.886 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:32:17.887 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:32:17.924 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:32:17.924 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:32:17.925 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:32:17.941 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:32:17.942 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-14T13:32:17.942 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:32:18.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.108+0000 7f13270ca640 1 Processor -- start 2023-07-14T13:32:18.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.108+0000 7f13270ca640 1 -- start start 2023-07-14T13:32:18.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.112+0000 7f13270ca640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13200ae1f0 0x7f13200b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:18.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.112+0000 7f13270ca640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13200b24f0 con 0x7f132006c430 2023-07-14T13:32:18.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.112+0000 7f13270ca640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13200b27d0 con 0x7f132006e160 2023-07-14T13:32:18.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.112+0000 7f13270ca640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13200b2ab0 con 0x7f13200ae1f0 2023-07-14T13:32:18.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.112+0000 7f1324e66640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13200ae1f0 0x7f13200b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:18.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.112+0000 7f1324e66640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13200ae1f0 0x7f13200b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51258/0 (socket says 172.21.15.5:51258) 2023-07-14T13:32:18.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.112+0000 7f1324e66640 1 -- 172.21.15.5:0/25597615 learned_addr learned my addr 172.21.15.5:0/25597615 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:18.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.112+0000 7f1325667640 1 --1- 172.21.15.5:0/25597615 >> v1:172.21.15.5:6789/0 conn(0x7f132006c430 0x7f1320069430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45556/0 (socket says 172.21.15.5:45556) 2023-07-14T13:32:18.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.112+0000 7f1324e66640 1 -- 172.21.15.5:0/25597615 >> v1:172.21.15.154:6789/0 conn(0x7f132006e160 legacy=0x7f132006bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:18.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.112+0000 7f1324e66640 1 -- 172.21.15.5:0/25597615 >> v1:172.21.15.5:6789/0 conn(0x7f132006c430 legacy=0x7f1320069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:18.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.112+0000 7f1324e66640 1 -- 172.21.15.5:0/25597615 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13200b2d90 con 0x7f13200ae1f0 2023-07-14T13:32:18.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.112+0000 7f131f7fe640 1 -- 172.21.15.5:0/25597615 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105929665 0 0) 0x7f13200b24f0 con 0x7f132006c430 2023-07-14T13:32:18.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.116+0000 7f1324e66640 1 --2- 172.21.15.5:0/25597615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13200ae1f0 0x7f13200b1e60 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f1314009870 tx=0x7f131401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f3d4ef32748324 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:18.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.116+0000 7f131f7fe640 1 -- 172.21.15.5:0/25597615 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13140a95f0 con 0x7f13200ae1f0 2023-07-14T13:32:18.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.116+0000 7f131f7fe640 1 -- 172.21.15.5:0/25597615 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13140a9750 con 0x7f13200ae1f0 2023-07-14T13:32:18.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.116+0000 7f131f7fe640 1 -- 172.21.15.5:0/25597615 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13140a9ae0 con 0x7f13200ae1f0 2023-07-14T13:32:18.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.116+0000 7f13270ca640 1 -- 172.21.15.5:0/25597615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13200ae1f0 msgr2=0x7f13200b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:18.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.116+0000 7f13270ca640 1 --2- 172.21.15.5:0/25597615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13200ae1f0 0x7f13200b1e60 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f1314009870 tx=0x7f131401c510 comp rx=0 tx=0).stop 2023-07-14T13:32:18.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.116+0000 7f13270ca640 1 -- 172.21.15.5:0/25597615 shutdown_connections 2023-07-14T13:32:18.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.116+0000 7f13270ca640 1 --2- 172.21.15.5:0/25597615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13200ae1f0 0x7f13200b1e60 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.116+0000 7f13270ca640 1 -- 172.21.15.5:0/25597615 >> 172.21.15.5:0/25597615 conn(0x7f13200b1300 msgr2=0x7f13200ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:18.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.116+0000 7f13270ca640 1 -- 172.21.15.5:0/25597615 shutdown_connections 2023-07-14T13:32:18.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.116+0000 7f13270ca640 1 -- 172.21.15.5:0/25597615 wait complete. 2023-07-14T13:32:18.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.116+0000 7f13270ca640 1 Processor -- start 2023-07-14T13:32:18.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.116+0000 7f13270ca640 1 -- start start 2023-07-14T13:32:18.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.116+0000 7f13270ca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132006c430 0x7f13200cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:18.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.120+0000 7f13270ca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f132006e160 0x7f132013b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:18.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.120+0000 7f13270ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13200ae1f0 0x7f13200ac380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:18.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.120+0000 7f13270ca640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13200cc1e0 con 0x7f132006c430 2023-07-14T13:32:18.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.120+0000 7f13270ca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13201448d0 con 0x7f132006e160 2023-07-14T13:32:18.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.120+0000 7f13270ca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13201f8620 con 0x7f13200ae1f0 2023-07-14T13:32:18.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.120+0000 7f1324e66640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132006c430 0x7f13200cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:18.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.120+0000 7f1324e66640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132006c430 0x7f13200cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51262/0 (socket says 172.21.15.5:51262) 2023-07-14T13:32:18.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.120+0000 7f1324e66640 1 -- 172.21.15.5:0/2805967047 learned_addr learned my addr 172.21.15.5:0/2805967047 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:18.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.120+0000 7f1325667640 1 --2- 172.21.15.5:0/2805967047 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13200ae1f0 0x7f13200ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:18.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.120+0000 7f131ffff640 1 --2- 172.21.15.5:0/2805967047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f132006e160 0x7f132013b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:18.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.120+0000 7f1324e66640 1 -- 172.21.15.5:0/2805967047 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13200ae1f0 msgr2=0x7f13200ac380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:18.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.120+0000 7f1324e66640 1 --2- 172.21.15.5:0/2805967047 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13200ae1f0 0x7f13200ac380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.120+0000 7f1324e66640 1 -- 172.21.15.5:0/2805967047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f132006e160 msgr2=0x7f132013b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:18.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.120+0000 7f1324e66640 1 --2- 172.21.15.5:0/2805967047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f132006e160 0x7f132013b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.120+0000 7f1324e66640 1 -- 172.21.15.5:0/2805967047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13140094d0 con 0x7f132006c430 2023-07-14T13:32:18.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.120+0000 7f1324e66640 1 --2- 172.21.15.5:0/2805967047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132006c430 0x7f13200cd8c0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f1314019120 tx=0x7f13140192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:18.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.120+0000 7f131d7fa640 1 -- 172.21.15.5:0/2805967047 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1314004220 con 0x7f132006c430 2023-07-14T13:32:18.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.120+0000 7f131d7fa640 1 -- 172.21.15.5:0/2805967047 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1314004380 con 0x7f132006c430 2023-07-14T13:32:18.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.120+0000 7f131d7fa640 1 -- 172.21.15.5:0/2805967047 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1314003820 con 0x7f132006c430 2023-07-14T13:32:18.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.120+0000 7f13270ca640 1 -- 172.21.15.5:0/2805967047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13200b3710 con 0x7f132006c430 2023-07-14T13:32:18.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.120+0000 7f13270ca640 1 -- 172.21.15.5:0/2805967047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13201f8060 con 0x7f132006c430 2023-07-14T13:32:18.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.120+0000 7f13270ca640 1 -- 172.21.15.5:0/2805967047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13200678d0 con 0x7f132006c430 2023-07-14T13:32:18.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.120+0000 7f131d7fa640 1 -- 172.21.15.5:0/2805967047 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1314003b90 con 0x7f132006c430 2023-07-14T13:32:18.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.124+0000 7f131d7fa640 1 --2- 172.21.15.5:0/2805967047 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f13040663a0 0x7f1304068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.124+0000 7f131d7fa640 1 -- 172.21.15.5:0/2805967047 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6012+0+0 (secure 0 0 0) 0x7f131411e6d0 con 0x7f132006c430 2023-07-14T13:32:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.124+0000 7f131ffff640 1 --2- 172.21.15.5:0/2805967047 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f13040663a0 0x7f1304068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:18.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.124+0000 7f131ffff640 1 --2- 172.21.15.5:0/2805967047 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f13040663a0 0x7f1304068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f13200cd3a0 tx=0x7f130c009040 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:18.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.128+0000 7f131d7fa640 1 -- 172.21.15.5:0/2805967047 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f13140eb9f0 con 0x7f132006c430 2023-07-14T13:32:18.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.316+0000 7f13270ca640 1 -- 172.21.15.5:0/2805967047 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1320066810 con 0x7f132006c430 2023-07-14T13:32:18.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.316+0000 7f131d7fa640 1 -- 172.21.15.5:0/2805967047 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+3527 (secure 0 0 0) 0x7f13140044f0 con 0x7f132006c430 2023-07-14T13:32:18.318 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:18.318 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":85,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2329374117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2329374117},{"type":"v1","addr":"172.21.15.154:6835","nonce":2329374117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":9457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/811714286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":811714286},{"type":"v1","addr":"172.21.15.154:6837","nonce":811714286}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":9954,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/3020438262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":3020438262},{"type":"v1","addr":"172.21.15.5:6833","nonce":3020438262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":10452,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2748549295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2748549295},{"type":"v1","addr":"172.21.15.5:6835","nonce":2748549295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[]} 2023-07-14T13:32:18.318 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 85 2023-07-14T13:32:18.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.316+0000 7f13270ca640 1 -- 172.21.15.5:0/2805967047 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f13040663a0 msgr2=0x7f1304068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:18.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.316+0000 7f13270ca640 1 --2- 172.21.15.5:0/2805967047 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f13040663a0 0x7f1304068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f13200cd3a0 tx=0x7f130c009040 comp rx=0 tx=0).stop 2023-07-14T13:32:18.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.316+0000 7f13270ca640 1 -- 172.21.15.5:0/2805967047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132006c430 msgr2=0x7f13200cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:18.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.316+0000 7f13270ca640 1 --2- 172.21.15.5:0/2805967047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132006c430 0x7f13200cd8c0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f1314019120 tx=0x7f13140192b0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.316+0000 7f13270ca640 1 -- 172.21.15.5:0/2805967047 shutdown_connections 2023-07-14T13:32:18.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.316+0000 7f13270ca640 1 --2- 172.21.15.5:0/2805967047 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f13040663a0 0x7f1304068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.316+0000 7f13270ca640 1 --2- 172.21.15.5:0/2805967047 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13200ae1f0 0x7f13200ac380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.316+0000 7f13270ca640 1 --2- 172.21.15.5:0/2805967047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f132006e160 0x7f132013b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.316+0000 7f13270ca640 1 --2- 172.21.15.5:0/2805967047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132006c430 0x7f13200cd8c0 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.316+0000 7f13270ca640 1 -- 172.21.15.5:0/2805967047 >> 172.21.15.5:0/2805967047 conn(0x7f13200b1300 msgr2=0x7f132006bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:18.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.316+0000 7f13270ca640 1 -- 172.21.15.5:0/2805967047 shutdown_connections 2023-07-14T13:32:18.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:18.316+0000 7f13270ca640 1 -- 172.21.15.5:0/2805967047 wait complete. 2023-07-14T13:32:18.339 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-14T13:32:18.339 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-14T13:32:18.339 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-14T13:32:18.340 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:32:18.340 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-14T13:32:18.340 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-14T13:32:18.340 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-14T13:32:18.341 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:32:18.341 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-14T13:32:18.341 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-14T13:32:18.341 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-14T13:32:18.341 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:32:18.342 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-14T13:32:18.342 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-14T13:32:18.342 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-14T13:32:18.342 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:32:18.351 INFO:tasks.ceph.mds.a:Stopped 2023-07-14T13:32:18.351 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-14T13:32:18.352 INFO:tasks.ceph.mds.c:Stopped 2023-07-14T13:32:18.353 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-14T13:32:18.358 INFO:tasks.ceph.mds.d:Stopped 2023-07-14T13:32:18.358 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-14T13:32:18.402 INFO:tasks.ceph.mds.a:Started 2023-07-14T13:32:18.403 DEBUG:teuthology.parallel:result is None 2023-07-14T13:32:18.405 INFO:tasks.ceph.mds.c:Started 2023-07-14T13:32:18.405 DEBUG:teuthology.parallel:result is None 2023-07-14T13:32:18.408 INFO:tasks.ceph.mds.d:Started 2023-07-14T13:32:18.408 DEBUG:teuthology.parallel:result is None 2023-07-14T13:32:18.489 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-07-14T13:32:18.492 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-07-14T13:32:18.501 INFO:tasks.ceph.mds.d.smithi154.stdout:starting mds.d at 2023-07-14T13:32:21.131 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:32:21.135 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:32:22.415 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-07-14T13:32:24.359 INFO:tasks.ceph.mds.b:Stopped 2023-07-14T13:32:24.359 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-14T13:32:24.363 INFO:tasks.ceph.mds.b:Started 2023-07-14T13:32:24.363 DEBUG:teuthology.parallel:result is None 2023-07-14T13:32:24.364 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-14T13:32:24.457 INFO:tasks.ceph.mds.b.smithi154.stdout:starting mds.b at 2023-07-14T13:32:24.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.520+0000 7fee3d174640 1 Processor -- start 2023-07-14T13:32:24.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.520+0000 7fee3d174640 1 -- start start 2023-07-14T13:32:24.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.520+0000 7fee3d174640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee38070b70 0x7fee38070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:24.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.520+0000 7fee3d174640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fee380cb100 0x7fee380cb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:24.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.520+0000 7fee3d174640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee380cbac0 con 0x7fee3806b1e0 2023-07-14T13:32:24.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.520+0000 7fee3d174640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee380cac70 con 0x7fee380cb100 2023-07-14T13:32:24.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.520+0000 7fee3d174640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee38071480 con 0x7fee38070b70 2023-07-14T13:32:24.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.520+0000 7fee36d9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee38070b70 0x7fee38070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:24.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.520+0000 7fee2ffff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fee3806b1e0 0x7fee380c1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:37616/0 (socket says 172.21.15.5:37616) 2023-07-14T13:32:24.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.520+0000 7fee2ffff640 1 -- 172.21.15.5:0/1956726735 learned_addr learned my addr 172.21.15.5:0/1956726735 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:24.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.520+0000 7fee3759e640 1 --2- 172.21.15.5:0/1956726735 >> v2:172.21.15.154:3300/0 conn(0x7fee380cb100 0x7fee380cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:24.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.524+0000 7fee36d9d640 1 -- 172.21.15.5:0/1956726735 >> v2:172.21.15.154:3300/0 conn(0x7fee380cb100 msgr2=0x7fee380cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:24.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.524+0000 7fee3659c640 1 -- 172.21.15.5:0/1956726735 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1728039661 0 0) 0x7fee20001120 con 0x7fee3806b1e0 2023-07-14T13:32:24.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.524+0000 7fee36d9d640 1 --2- 172.21.15.5:0/1956726735 >> v2:172.21.15.154:3300/0 conn(0x7fee380cb100 0x7fee380cb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:24.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.524+0000 7fee36d9d640 1 -- 172.21.15.5:0/1956726735 >> v1:172.21.15.154:6789/0 conn(0x7fee3806b1e0 legacy=0x7fee380c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:24.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.524+0000 7fee36d9d640 1 -- 172.21.15.5:0/1956726735 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee380ca060 con 0x7fee38070b70 2023-07-14T13:32:24.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.524+0000 7fee3759e640 1 --2- 172.21.15.5:0/1956726735 >> v2:172.21.15.154:3300/0 conn(0x7fee380cb100 0x7fee380cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:32:24.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.524+0000 7fee36d9d640 1 --2- 172.21.15.5:0/1956726735 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee38070b70 0x7fee38070f40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fee280097c0 tx=0x7fee2801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20617b60be50afe8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:24.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.524+0000 7fee3659c640 1 -- 172.21.15.5:0/1956726735 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee280ac620 con 0x7fee38070b70 2023-07-14T13:32:24.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.524+0000 7fee3659c640 1 -- 172.21.15.5:0/1956726735 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee280ac780 con 0x7fee38070b70 2023-07-14T13:32:24.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.524+0000 7fee3659c640 1 -- 172.21.15.5:0/1956726735 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee280acb10 con 0x7fee38070b70 2023-07-14T13:32:24.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.528+0000 7fee3d174640 1 -- 172.21.15.5:0/1956726735 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee38070b70 msgr2=0x7fee38070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:24.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.528+0000 7fee3d174640 1 --2- 172.21.15.5:0/1956726735 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee38070b70 0x7fee38070f40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fee280097c0 tx=0x7fee2801c3c0 comp rx=0 tx=0).stop 2023-07-14T13:32:24.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.528+0000 7fee3d174640 1 -- 172.21.15.5:0/1956726735 shutdown_connections 2023-07-14T13:32:24.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.528+0000 7fee3d174640 1 --2- 172.21.15.5:0/1956726735 >> v2:172.21.15.154:3300/0 conn(0x7fee380cb100 0x7fee380cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:24.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.528+0000 7fee3d174640 1 --2- 172.21.15.5:0/1956726735 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee38070b70 0x7fee38070f40 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:24.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.528+0000 7fee3d174640 1 -- 172.21.15.5:0/1956726735 >> 172.21.15.5:0/1956726735 conn(0x7fee380afcf0 msgr2=0x7fee380b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:24.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.528+0000 7fee3d174640 1 -- 172.21.15.5:0/1956726735 shutdown_connections 2023-07-14T13:32:24.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.528+0000 7fee3d174640 1 -- 172.21.15.5:0/1956726735 wait complete. 2023-07-14T13:32:24.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.528+0000 7fee3d174640 1 Processor -- start 2023-07-14T13:32:24.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.528+0000 7fee3d174640 1 -- start start 2023-07-14T13:32:24.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.528+0000 7fee3d174640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee3806b1e0 0x7fee38144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:24.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.528+0000 7fee3d174640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee38070b70 0x7fee380b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:24.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.528+0000 7fee3d174640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee380cb100 0x7fee380b2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:24.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.528+0000 7fee3d174640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee380a9990 con 0x7fee3806b1e0 2023-07-14T13:32:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.528+0000 7fee3d174640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee380a8d80 con 0x7fee38070b70 2023-07-14T13:32:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.528+0000 7fee3d174640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee380a9060 con 0x7fee380cb100 2023-07-14T13:32:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.528+0000 7fee36d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee3806b1e0 0x7fee38144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.528+0000 7fee36d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee3806b1e0 0x7fee38144670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57848/0 (socket says 172.21.15.5:57848) 2023-07-14T13:32:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.528+0000 7fee36d9d640 1 -- 172.21.15.5:0/3822263857 learned_addr learned my addr 172.21.15.5:0/3822263857 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.528+0000 7fee2ffff640 1 --2- 172.21.15.5:0/3822263857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee38070b70 0x7fee380b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.528+0000 7fee3759e640 1 --2- 172.21.15.5:0/3822263857 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee380cb100 0x7fee380b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.528+0000 7fee36d9d640 1 -- 172.21.15.5:0/3822263857 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee380cb100 msgr2=0x7fee380b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.528+0000 7fee36d9d640 1 --2- 172.21.15.5:0/3822263857 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee380cb100 0x7fee380b2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.528+0000 7fee36d9d640 1 -- 172.21.15.5:0/3822263857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee38070b70 msgr2=0x7fee380b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.528+0000 7fee36d9d640 1 --2- 172.21.15.5:0/3822263857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee38070b70 0x7fee380b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.528+0000 7fee36d9d640 1 -- 172.21.15.5:0/3822263857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee30009a70 con 0x7fee3806b1e0 2023-07-14T13:32:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.532+0000 7fee36d9d640 1 --2- 172.21.15.5:0/3822263857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee3806b1e0 0x7fee38144670 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7fee280af040 tx=0x7fee2801ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:24.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.532+0000 7fee2f7fe640 1 -- 172.21.15.5:0/3822263857 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee280ac620 con 0x7fee3806b1e0 2023-07-14T13:32:24.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.532+0000 7fee2f7fe640 1 -- 172.21.15.5:0/3822263857 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee280b8450 con 0x7fee3806b1e0 2023-07-14T13:32:24.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.532+0000 7fee2f7fe640 1 -- 172.21.15.5:0/3822263857 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee280b8820 con 0x7fee3806b1e0 2023-07-14T13:32:24.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.532+0000 7fee3d174640 1 -- 172.21.15.5:0/3822263857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee28009420 con 0x7fee3806b1e0 2023-07-14T13:32:24.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.532+0000 7fee3d174640 1 -- 172.21.15.5:0/3822263857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee380a9620 con 0x7fee3806b1e0 2023-07-14T13:32:24.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.532+0000 7fee3d174640 1 -- 172.21.15.5:0/3822263857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee38070fe0 con 0x7fee3806b1e0 2023-07-14T13:32:24.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.532+0000 7fee2f7fe640 1 -- 172.21.15.5:0/3822263857 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fee280aa070 con 0x7fee3806b1e0 2023-07-14T13:32:24.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.536+0000 7fee2f7fe640 1 --2- 172.21.15.5:0/3822263857 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fee180663a0 0x7fee18068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:24.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.536+0000 7fee2f7fe640 1 -- 172.21.15.5:0/3822263857 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6012+0+0 (secure 0 0 0) 0x7fee2811e4e0 con 0x7fee3806b1e0 2023-07-14T13:32:24.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.536+0000 7fee2ffff640 1 --2- 172.21.15.5:0/3822263857 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fee180663a0 0x7fee18068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:24.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.536+0000 7fee2ffff640 1 --2- 172.21.15.5:0/3822263857 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fee180663a0 0x7fee18068850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fee38155a10 tx=0x7fee20007ba0 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:24.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.540+0000 7fee2f7fe640 1 -- 172.21.15.5:0/3822263857 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fee280eb7f0 con 0x7fee3806b1e0 2023-07-14T13:32:24.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:24.708+0000 7fee3d174640 1 -- 172.21.15.5:0/3822263857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fee380678d0 con 0x7fee3806b1e0 2023-07-14T13:32:26.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.124+0000 7fee2f7fe640 1 -- 172.21.15.5:0/3822263857 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v187) v1 ==== 97+0+0 (secure 0 0 0) 0x7fee280eee10 con 0x7fee3806b1e0 2023-07-14T13:32:26.127 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2023-07-14T13:32:26.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.128+0000 7fee3d174640 1 -- 172.21.15.5:0/3822263857 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fee180663a0 msgr2=0x7fee18068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:26.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.128+0000 7fee3d174640 1 --2- 172.21.15.5:0/3822263857 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fee180663a0 0x7fee18068850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fee38155a10 tx=0x7fee20007ba0 comp rx=0 tx=0).stop 2023-07-14T13:32:26.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.128+0000 7fee3d174640 1 -- 172.21.15.5:0/3822263857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee3806b1e0 msgr2=0x7fee38144670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:26.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.128+0000 7fee3d174640 1 --2- 172.21.15.5:0/3822263857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee3806b1e0 0x7fee38144670 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7fee280af040 tx=0x7fee2801ac00 comp rx=0 tx=0).stop 2023-07-14T13:32:26.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.128+0000 7fee3d174640 1 -- 172.21.15.5:0/3822263857 shutdown_connections 2023-07-14T13:32:26.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.128+0000 7fee3d174640 1 --2- 172.21.15.5:0/3822263857 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fee180663a0 0x7fee18068850 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:26.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.128+0000 7fee3d174640 1 --2- 172.21.15.5:0/3822263857 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee380cb100 0x7fee380b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:26.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.128+0000 7fee3d174640 1 --2- 172.21.15.5:0/3822263857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee38070b70 0x7fee380b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:26.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.128+0000 7fee3d174640 1 --2- 172.21.15.5:0/3822263857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee3806b1e0 0x7fee38144670 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:26.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.128+0000 7fee3d174640 1 -- 172.21.15.5:0/3822263857 >> 172.21.15.5:0/3822263857 conn(0x7fee380afcf0 msgr2=0x7fee380ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:26.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.128+0000 7fee3d174640 1 -- 172.21.15.5:0/3822263857 shutdown_connections 2023-07-14T13:32:26.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.128+0000 7fee3d174640 1 -- 172.21.15.5:0/3822263857 wait complete. 2023-07-14T13:32:26.154 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-14T13:32:26.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.304+0000 7f37f826d640 1 Processor -- start 2023-07-14T13:32:26.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.304+0000 7f37f826d640 1 -- start start 2023-07-14T13:32:26.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.308+0000 7f37f826d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f37f00c8ad0 0x7f37f00c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:26.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.308+0000 7f37f826d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f00c99c0 con 0x7f37f00c9560 2023-07-14T13:32:26.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.308+0000 7f37f826d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f00cc700 con 0x7f37f0158ce0 2023-07-14T13:32:26.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.308+0000 7f37f826d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f00b0ff0 con 0x7f37f00c8ad0 2023-07-14T13:32:26.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.308+0000 7f37f680a640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f37f00c9560 0x7f37f00ccb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34298/0 (socket says 172.21.15.5:34298) 2023-07-14T13:32:26.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.308+0000 7f37f680a640 1 -- 172.21.15.5:0/539640984 learned_addr learned my addr 172.21.15.5:0/539640984 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:26.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.308+0000 7f37f5808640 1 --2- 172.21.15.5:0/539640984 >> v2:172.21.15.5:3300/0 conn(0x7f37f00c8ad0 0x7f37f00c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:26.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.308+0000 7f37f5007640 1 -- 172.21.15.5:0/539640984 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2581244956 0 0) 0x7f37f00c99c0 con 0x7f37f00c9560 2023-07-14T13:32:26.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.308+0000 7f37f5007640 1 -- 172.21.15.5:0/539640984 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37dc003530 con 0x7f37f00c9560 2023-07-14T13:32:26.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.308+0000 7f37f5808640 1 -- 172.21.15.5:0/539640984 >> v1:172.21.15.154:6789/0 conn(0x7f37f0158ce0 legacy=0x7f37f0070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:26.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.308+0000 7f37f5808640 1 -- 172.21.15.5:0/539640984 >> v1:172.21.15.5:6789/0 conn(0x7f37f00c9560 legacy=0x7f37f00ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:26.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.308+0000 7f37f5808640 1 -- 172.21.15.5:0/539640984 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f0070c80 con 0x7f37f00c8ad0 2023-07-14T13:32:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.312+0000 7f37f5808640 1 --2- 172.21.15.5:0/539640984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37f00c8ad0 0x7f37f00c9020 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f37e00097c0 tx=0x7f37e001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eee3ad958fbb758 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.312+0000 7f37f5007640 1 -- 172.21.15.5:0/539640984 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e00ab600 con 0x7f37f00c8ad0 2023-07-14T13:32:26.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.312+0000 7f37f5007640 1 -- 172.21.15.5:0/539640984 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e00a7050 con 0x7f37f00c8ad0 2023-07-14T13:32:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.312+0000 7f37f5007640 1 -- 172.21.15.5:0/539640984 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e00ab960 con 0x7f37f00c8ad0 2023-07-14T13:32:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.312+0000 7f37f826d640 1 -- 172.21.15.5:0/539640984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37f00c8ad0 msgr2=0x7f37f00c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.312+0000 7f37f826d640 1 --2- 172.21.15.5:0/539640984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37f00c8ad0 0x7f37f00c9020 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f37e00097c0 tx=0x7f37e001c330 comp rx=0 tx=0).stop 2023-07-14T13:32:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.312+0000 7f37f826d640 1 -- 172.21.15.5:0/539640984 shutdown_connections 2023-07-14T13:32:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.312+0000 7f37f826d640 1 --2- 172.21.15.5:0/539640984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37f00c8ad0 0x7f37f00c9020 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.312+0000 7f37f826d640 1 -- 172.21.15.5:0/539640984 >> 172.21.15.5:0/539640984 conn(0x7f37f00afcf0 msgr2=0x7f37f00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.312+0000 7f37f826d640 1 -- 172.21.15.5:0/539640984 shutdown_connections 2023-07-14T13:32:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.312+0000 7f37f826d640 1 -- 172.21.15.5:0/539640984 wait complete. 2023-07-14T13:32:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.312+0000 7f37f826d640 1 Processor -- start 2023-07-14T13:32:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.312+0000 7f37f826d640 1 -- start start 2023-07-14T13:32:26.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.316+0000 7f37f826d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37f00c8ad0 0x7f37f014e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:26.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.316+0000 7f37f826d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37f00c9560 0x7f37f0152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.316+0000 7f37f826d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37f0158ce0 0x7f37f006b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.316+0000 7f37f826d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f0154030 con 0x7f37f0158ce0 2023-07-14T13:32:26.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.316+0000 7f37f826d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f00ad8d0 con 0x7f37f00c9560 2023-07-14T13:32:26.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.316+0000 7f37f826d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f0153790 con 0x7f37f00c8ad0 2023-07-14T13:32:26.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.316+0000 7f37f680a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37f0158ce0 0x7f37f006b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:26.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.316+0000 7f37f680a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37f0158ce0 0x7f37f006b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57864/0 (socket says 172.21.15.5:57864) 2023-07-14T13:32:26.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.316+0000 7f37f680a640 1 -- 172.21.15.5:0/955972695 learned_addr learned my addr 172.21.15.5:0/955972695 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:26.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.316+0000 7f37f5808640 1 --2- 172.21.15.5:0/955972695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37f00c9560 0x7f37f0152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:26.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.316+0000 7f37f6009640 1 --2- 172.21.15.5:0/955972695 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37f00c8ad0 0x7f37f014e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:26.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.316+0000 7f37f680a640 1 -- 172.21.15.5:0/955972695 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37f00c8ad0 msgr2=0x7f37f014e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:26.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.316+0000 7f37f680a640 1 --2- 172.21.15.5:0/955972695 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37f00c8ad0 0x7f37f014e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:26.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.316+0000 7f37f680a640 1 -- 172.21.15.5:0/955972695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37f00c9560 msgr2=0x7f37f0152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:26.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.316+0000 7f37f680a640 1 --2- 172.21.15.5:0/955972695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37f00c9560 0x7f37f0152d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:26.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.316+0000 7f37f680a640 1 -- 172.21.15.5:0/955972695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e0009420 con 0x7f37f0158ce0 2023-07-14T13:32:26.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.316+0000 7f37f680a640 1 --2- 172.21.15.5:0/955972695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37f0158ce0 0x7f37f006b1e0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f37e800caa0 tx=0x7f37e800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:26.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.316+0000 7f37e6ffd640 1 -- 172.21.15.5:0/955972695 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e800ac00 con 0x7f37f0158ce0 2023-07-14T13:32:26.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.316+0000 7f37e6ffd640 1 -- 172.21.15.5:0/955972695 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e800ad60 con 0x7f37f0158ce0 2023-07-14T13:32:26.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.316+0000 7f37f826d640 1 -- 172.21.15.5:0/955972695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f0153a70 con 0x7f37f0158ce0 2023-07-14T13:32:26.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.316+0000 7f37e6ffd640 1 -- 172.21.15.5:0/955972695 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e8012620 con 0x7f37f0158ce0 2023-07-14T13:32:26.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.316+0000 7f37f826d640 1 -- 172.21.15.5:0/955972695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f014ea00 con 0x7f37f0158ce0 2023-07-14T13:32:26.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.316+0000 7f37f826d640 1 -- 172.21.15.5:0/955972695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f00ca1a0 con 0x7f37f0158ce0 2023-07-14T13:32:26.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.320+0000 7f37e6ffd640 1 -- 172.21.15.5:0/955972695 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f37e8007070 con 0x7f37f0158ce0 2023-07-14T13:32:26.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.320+0000 7f37e6ffd640 1 --2- 172.21.15.5:0/955972695 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f37d40663a0 0x7f37d4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:26.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.320+0000 7f37e6ffd640 1 -- 172.21.15.5:0/955972695 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f37e8083c00 con 0x7f37f0158ce0 2023-07-14T13:32:26.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.320+0000 7f37f6009640 1 --2- 172.21.15.5:0/955972695 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f37d40663a0 0x7f37d4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:26.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.320+0000 7f37f6009640 1 --2- 172.21.15.5:0/955972695 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f37d40663a0 0x7f37d4068850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f37ec000f70 tx=0x7f37ec009040 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:26.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.324+0000 7f37e6ffd640 1 -- 172.21.15.5:0/955972695 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f37e8051200 con 0x7f37f0158ce0 2023-07-14T13:32:26.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.528+0000 7f37f826d640 1 -- 172.21.15.5:0/955972695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f37f00ad6a0 con 0x7f37f0158ce0 2023-07-14T13:32:26.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.532+0000 7f37e6ffd640 1 -- 172.21.15.5:0/955972695 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v30) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f37f00ad6a0 con 0x7f37f0158ce0 2023-07-14T13:32:26.533 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:26.533 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T13:32:26.533 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2023-07-14T13:32:26.533 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:32:26.533 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2023-07-14T13:32:26.533 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkGNTsMRAA5T/zjdynxEKmoNAAK0cChw==", 2023-07-14T13:32:26.534 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:32:26.534 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:32:26.534 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:32:26.534 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:32:26.535 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:32:26.535 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:32:26.535 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:32:26.535 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:32:26.535 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2023-07-14T13:32:26.535 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkqXNAAxAAb7bzXyE8cSS0A3Rz2de6TA==", 2023-07-14T13:32:26.535 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:32:26.536 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:32:26.536 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:32:26.536 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:32:26.536 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:32:26.537 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:32:26.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:32:26.537 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:32:26.537 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2023-07-14T13:32:26.537 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFk6NGUORAA+5odxrAlCCXYGc64nzFWwQ==", 2023-07-14T13:32:26.537 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:32:26.537 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:32:26.538 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:32:26.538 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:32:26.538 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:32:26.538 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:32:26.538 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:32:26.538 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:32:26.538 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2023-07-14T13:32:26.539 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkGh/BChAA5p9amLIC6ORC0JJov0bSVg==", 2023-07-14T13:32:26.539 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:32:26.539 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:32:26.539 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:32:26.539 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:32:26.539 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:32:26.539 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:32:26.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:32:26.540 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:32:26.540 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2023-07-14T13:32:26.540 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDlRLFkJ6MULhAAxExAqekc/gWudYBJ2sY4MQ==", 2023-07-14T13:32:26.540 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:32:26.540 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:32:26.540 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:32:26.541 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:32:26.541 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:32:26.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:32:26.541 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:32:26.541 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2023-07-14T13:32:26.541 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDoRLFksXGBNRAAFtHZt5OQw0aB6k3CkxOzZQ==", 2023-07-14T13:32:26.541 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:32:26.542 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:32:26.542 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:32:26.542 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:32:26.542 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:32:26.542 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:32:26.542 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:32:26.542 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2023-07-14T13:32:26.543 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDsRLFkaUH0ARAAkqgsKPX1dTSZQjn0cRxxRQ==", 2023-07-14T13:32:26.543 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:32:26.543 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:32:26.543 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:32:26.543 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:32:26.543 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:32:26.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:32:26.544 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:32:26.544 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2023-07-14T13:32:26.544 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDvRLFkvElJCRAAnox5LKwobP/1Qaf5d9UsjA==", 2023-07-14T13:32:26.544 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:32:26.544 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:32:26.544 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:32:26.545 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:32:26.545 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:32:26.545 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:32:26.545 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:32:26.545 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2023-07-14T13:32:26.545 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD1RLFkMNyyDxAA19dJkhhuSpcgVPQEyxb3lg==", 2023-07-14T13:32:26.545 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:32:26.546 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:32:26.546 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:32:26.546 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:32:26.546 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:32:26.546 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:32:26.546 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:32:26.546 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2023-07-14T13:32:26.547 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD4RLFkR8mTFhAAP5qUgUJI23XOvVAnNCSgRQ==", 2023-07-14T13:32:26.547 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:32:26.547 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:32:26.548 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:32:26.548 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:32:26.548 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:32:26.548 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:32:26.548 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:32:26.548 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2023-07-14T13:32:26.548 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD7RLFkpWL9HBAAo8MfszRnB4sHsDPPcRjCAg==", 2023-07-14T13:32:26.549 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:32:26.549 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:32:26.549 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:32:26.549 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:32:26.549 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:32:26.549 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:32:26.549 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:32:26.550 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2023-07-14T13:32:26.550 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQD+RLFkL5cRIxAAF/4ndtYf0oiH3uhhDKnQQg==", 2023-07-14T13:32:26.550 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:32:26.550 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-07-14T13:32:26.550 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-07-14T13:32:26.550 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:32:26.550 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:32:26.551 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:32:26.551 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:32:26.551 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2023-07-14T13:32:26.551 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkCav/DhAA6SOiONAbTcWCnUZXcm7BcQ==", 2023-07-14T13:32:26.551 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:32:26.551 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:32:26.551 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2023-07-14T13:32:26.552 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-14T13:32:26.552 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:32:26.552 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:32:26.552 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:32:26.552 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2023-07-14T13:32:26.552 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkgS/hGBAAevMD2/lfNuaeV74w0Xj0Zw==", 2023-07-14T13:32:26.553 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:32:26.553 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:32:26.553 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T13:32:26.553 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T13:32:26.553 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T13:32:26.553 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:32:26.553 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:32:26.553 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:32:26.554 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2023-07-14T13:32:26.554 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkeBs4FRAAJ/UjIEKDajVyDb7PejPqAw==", 2023-07-14T13:32:26.554 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:32:26.554 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:32:26.554 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T13:32:26.554 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T13:32:26.554 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T13:32:26.554 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:32:26.555 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:32:26.555 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:32:26.555 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2023-07-14T13:32:26.555 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDkRLFkSkDiHhAAV86wIrAVz3o/PI2CaBC44w==", 2023-07-14T13:32:26.555 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:32:26.555 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-07-14T13:32:26.555 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-07-14T13:32:26.556 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-07-14T13:32:26.556 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-07-14T13:32:26.556 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:32:26.556 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:32:26.556 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:32:26.556 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2023-07-14T13:32:26.556 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkk5IcFRAAThI0P1N8LsRetmwhHqSvdQ==", 2023-07-14T13:32:26.557 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:32:26.557 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T13:32:26.557 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-07-14T13:32:26.557 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-07-14T13:32:26.557 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:32:26.557 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:32:26.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:32:26.558 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:32:26.558 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2023-07-14T13:32:26.558 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkugeXLRAAEVAnLk/dldtqrpkdzQI3SA==", 2023-07-14T13:32:26.558 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:32:26.558 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T13:32:26.558 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-07-14T13:32:26.559 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:32:26.559 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:32:26.559 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:32:26.559 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:32:26.559 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2023-07-14T13:32:26.559 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQDjRLFkSvp/KRAAwvjYlrZYNeGbhCiDrTmnrA==", 2023-07-14T13:32:26.559 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-07-14T13:32:26.560 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-07-14T13:32:26.560 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-07-14T13:32:26.560 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-07-14T13:32:26.560 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:32:26.560 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:32:26.560 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-07-14T13:32:26.560 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T13:32:26.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.532+0000 7f37f826d640 1 -- 172.21.15.5:0/955972695 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f37d40663a0 msgr2=0x7f37d4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:26.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.532+0000 7f37f826d640 1 --2- 172.21.15.5:0/955972695 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f37d40663a0 0x7f37d4068850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f37ec000f70 tx=0x7f37ec009040 comp rx=0 tx=0).stop 2023-07-14T13:32:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.532+0000 7f37f826d640 1 -- 172.21.15.5:0/955972695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37f0158ce0 msgr2=0x7f37f006b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.532+0000 7f37f826d640 1 --2- 172.21.15.5:0/955972695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37f0158ce0 0x7f37f006b1e0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f37e800caa0 tx=0x7f37e800cf60 comp rx=0 tx=0).stop 2023-07-14T13:32:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.532+0000 7f37f826d640 1 -- 172.21.15.5:0/955972695 shutdown_connections 2023-07-14T13:32:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.532+0000 7f37f826d640 1 --2- 172.21.15.5:0/955972695 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f37d40663a0 0x7f37d4068850 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.532+0000 7f37f826d640 1 --2- 172.21.15.5:0/955972695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37f0158ce0 0x7f37f006b1e0 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:26.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.532+0000 7f37f826d640 1 --2- 172.21.15.5:0/955972695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37f00c9560 0x7f37f0152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:26.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.532+0000 7f37f826d640 1 --2- 172.21.15.5:0/955972695 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37f00c8ad0 0x7f37f014e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:26.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.532+0000 7f37f826d640 1 -- 172.21.15.5:0/955972695 >> 172.21.15.5:0/955972695 conn(0x7f37f00afcf0 msgr2=0x7f37f0151200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:26.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.532+0000 7f37f826d640 1 -- 172.21.15.5:0/955972695 shutdown_connections 2023-07-14T13:32:26.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.532+0000 7f37f826d640 1 -- 172.21.15.5:0/955972695 wait complete. 2023-07-14T13:32:26.565 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:32:26.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.708+0000 7fa67a99d640 1 Processor -- start 2023-07-14T13:32:26.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.708+0000 7fa67a99d640 1 -- start start 2023-07-14T13:32:26.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.712+0000 7fa67a99d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa674070b70 0x7fa674070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:26.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.712+0000 7fa67a99d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa67406b1e0 0x7fa6740c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:26.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.712+0000 7fa67a99d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa6740c21f0 0x7fa6740cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:26.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.712+0000 7fa67a99d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6740cac70 con 0x7fa6740c21f0 2023-07-14T13:32:26.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.712+0000 7fa67a99d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa674071480 con 0x7fa674070b70 2023-07-14T13:32:26.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.712+0000 7fa67a99d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6740ca060 con 0x7fa67406b1e0 2023-07-14T13:32:26.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.712+0000 7fa678f3a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa6740c21f0 0x7fa6740cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:26.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.712+0000 7fa678f3a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa6740c21f0 0x7fa6740cb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57880/0 (socket says 172.21.15.5:57880) 2023-07-14T13:32:26.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.712+0000 7fa678f3a640 1 -- 172.21.15.5:0/957997853 learned_addr learned my addr 172.21.15.5:0/957997853 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:26.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.712+0000 7fa673fff640 1 --2- 172.21.15.5:0/957997853 >> v2:172.21.15.154:3300/0 conn(0x7fa674070b70 0x7fa674070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:26.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.712+0000 7fa6737fe640 1 --2- 172.21.15.5:0/957997853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa67406b1e0 0x7fa6740c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:26.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.712+0000 7fa678f3a640 1 -- 172.21.15.5:0/957997853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa67406b1e0 msgr2=0x7fa6740c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:26.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.712+0000 7fa678f3a640 1 --2- 172.21.15.5:0/957997853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa67406b1e0 0x7fa6740c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:26.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.712+0000 7fa678f3a640 1 -- 172.21.15.5:0/957997853 >> v2:172.21.15.154:3300/0 conn(0x7fa674070b70 msgr2=0x7fa674070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:26.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.712+0000 7fa678f3a640 1 --2- 172.21.15.5:0/957997853 >> v2:172.21.15.154:3300/0 conn(0x7fa674070b70 0x7fa674070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:26.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.712+0000 7fa678f3a640 1 -- 172.21.15.5:0/957997853 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6740ca340 con 0x7fa6740c21f0 2023-07-14T13:32:26.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.712+0000 7fa6737fe640 1 --2- 172.21.15.5:0/957997853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa67406b1e0 0x7fa6740c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:26.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.712+0000 7fa678f3a640 1 --2- 172.21.15.5:0/957997853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6740c21f0 0x7fa6740cb100 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fa67406f1f0 tx=0x7fa66c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a250661e0fa5793 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:26.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.716+0000 7fa672ffd640 1 -- 172.21.15.5:0/957997853 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c0a57b0 con 0x7fa6740c21f0 2023-07-14T13:32:26.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.716+0000 7fa672ffd640 1 -- 172.21.15.5:0/957997853 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66c0a5910 con 0x7fa6740c21f0 2023-07-14T13:32:26.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.716+0000 7fa672ffd640 1 -- 172.21.15.5:0/957997853 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c0a5ca0 con 0x7fa6740c21f0 2023-07-14T13:32:26.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.716+0000 7fa67a99d640 1 -- 172.21.15.5:0/957997853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6740c21f0 msgr2=0x7fa6740cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:26.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.716+0000 7fa67a99d640 1 --2- 172.21.15.5:0/957997853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6740c21f0 0x7fa6740cb100 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fa67406f1f0 tx=0x7fa66c01c910 comp rx=0 tx=0).stop 2023-07-14T13:32:26.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.716+0000 7fa67a99d640 1 -- 172.21.15.5:0/957997853 shutdown_connections 2023-07-14T13:32:26.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.716+0000 7fa67a99d640 1 --2- 172.21.15.5:0/957997853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6740c21f0 0x7fa6740cb100 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:26.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.716+0000 7fa67a99d640 1 --2- 172.21.15.5:0/957997853 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa67406b1e0 0x7fa6740c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:26.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.716+0000 7fa67a99d640 1 --2- 172.21.15.5:0/957997853 >> v2:172.21.15.154:3300/0 conn(0x7fa674070b70 0x7fa674070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:26.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.716+0000 7fa67a99d640 1 -- 172.21.15.5:0/957997853 >> 172.21.15.5:0/957997853 conn(0x7fa6740afcf0 msgr2=0x7fa6740b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:26.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.716+0000 7fa67a99d640 1 -- 172.21.15.5:0/957997853 shutdown_connections 2023-07-14T13:32:26.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.716+0000 7fa67a99d640 1 -- 172.21.15.5:0/957997853 wait complete. 2023-07-14T13:32:26.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.716+0000 7fa67a99d640 1 Processor -- start 2023-07-14T13:32:26.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.716+0000 7fa67a99d640 1 -- start start 2023-07-14T13:32:26.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.716+0000 7fa67a99d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa67406b1e0 0x7fa674154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:26.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.716+0000 7fa67a99d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa674070b70 0x7fa6740cd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:26.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.716+0000 7fa67a99d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6740c21f0 0x7fa6741f4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:26.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.716+0000 7fa67a99d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6740cddd0 con 0x7fa6740c21f0 2023-07-14T13:32:26.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.716+0000 7fa67a99d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6740c25f0 con 0x7fa674070b70 2023-07-14T13:32:26.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.716+0000 7fa67a99d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6741f4e00 con 0x7fa67406b1e0 2023-07-14T13:32:26.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.720+0000 7fa678f3a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6740c21f0 0x7fa6741f4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:26.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.720+0000 7fa678f3a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6740c21f0 0x7fa6741f4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57888/0 (socket says 172.21.15.5:57888) 2023-07-14T13:32:26.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.720+0000 7fa678f3a640 1 -- 172.21.15.5:0/3340079872 learned_addr learned my addr 172.21.15.5:0/3340079872 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:26.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.720+0000 7fa6737fe640 1 --2- 172.21.15.5:0/3340079872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa674070b70 0x7fa6740cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:26.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.720+0000 7fa673fff640 1 --2- 172.21.15.5:0/3340079872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa67406b1e0 0x7fa674154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:26.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.720+0000 7fa678f3a640 1 -- 172.21.15.5:0/3340079872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa67406b1e0 msgr2=0x7fa674154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:26.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.720+0000 7fa678f3a640 1 --2- 172.21.15.5:0/3340079872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa67406b1e0 0x7fa674154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:26.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.720+0000 7fa678f3a640 1 -- 172.21.15.5:0/3340079872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa674070b70 msgr2=0x7fa6740cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:26.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.720+0000 7fa678f3a640 1 --2- 172.21.15.5:0/3340079872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa674070b70 0x7fa6740cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:26.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.720+0000 7fa678f3a640 1 -- 172.21.15.5:0/3340079872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c009b30 con 0x7fa6740c21f0 2023-07-14T13:32:26.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.720+0000 7fa673fff640 1 --2- 172.21.15.5:0/3340079872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa67406b1e0 0x7fa674154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:26.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.720+0000 7fa678f3a640 1 --2- 172.21.15.5:0/3340079872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6740c21f0 0x7fa6741f4550 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0af040 tx=0x7fa66c0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.720+0000 7fa670ff9640 1 -- 172.21.15.5:0/3340079872 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c0b8670 con 0x7fa6740c21f0 2023-07-14T13:32:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.720+0000 7fa670ff9640 1 -- 172.21.15.5:0/3340079872 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66c0b87f0 con 0x7fa6740c21f0 2023-07-14T13:32:26.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.720+0000 7fa670ff9640 1 -- 172.21.15.5:0/3340079872 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c0b8ba0 con 0x7fa6740c21f0 2023-07-14T13:32:26.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.720+0000 7fa67a99d640 1 -- 172.21.15.5:0/3340079872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6741f50e0 con 0x7fa6740c21f0 2023-07-14T13:32:26.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.720+0000 7fa67a99d640 1 -- 172.21.15.5:0/3340079872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6740c2840 con 0x7fa6740c21f0 2023-07-14T13:32:26.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.720+0000 7fa67a99d640 1 -- 172.21.15.5:0/3340079872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6740678d0 con 0x7fa6740c21f0 2023-07-14T13:32:26.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.720+0000 7fa670ff9640 1 -- 172.21.15.5:0/3340079872 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa66c0b8d00 con 0x7fa6740c21f0 2023-07-14T13:32:26.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.724+0000 7fa670ff9640 1 --2- 172.21.15.5:0/3340079872 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fa6600663a0 0x7fa660068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:26.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.724+0000 7fa670ff9640 1 -- 172.21.15.5:0/3340079872 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5238+0+0 (secure 0 0 0) 0x7fa66c11ef80 con 0x7fa6740c21f0 2023-07-14T13:32:26.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.724+0000 7fa673fff640 1 --2- 172.21.15.5:0/3340079872 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fa6600663a0 0x7fa660068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:26.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.724+0000 7fa673fff640 1 --2- 172.21.15.5:0/3340079872 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fa6600663a0 0x7fa660068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa664009bb0 tx=0x7fa664008040 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:26.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.728+0000 7fa670ff9640 1 -- 172.21.15.5:0/3340079872 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa66c14f720 con 0x7fa6740c21f0 2023-07-14T13:32:26.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.880+0000 7fa67a99d640 1 -- 172.21.15.5:0/3340079872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6740b0a30 con 0x7fa6740c21f0 2023-07-14T13:32:26.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.884+0000 7fa670ff9640 1 -- 172.21.15.5:0/3340079872 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v187) v1 ==== 74+0+14645 (secure 0 0 0) 0x7fa66c0ec6b0 con 0x7fa6740c21f0 2023-07-14T13:32:26.884 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:26.885 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":187,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:32:26.124039+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:32:26.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.884+0000 7fa67a99d640 1 -- 172.21.15.5:0/3340079872 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fa6600663a0 msgr2=0x7fa660068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:26.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.884+0000 7fa67a99d640 1 --2- 172.21.15.5:0/3340079872 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fa6600663a0 0x7fa660068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa664009bb0 tx=0x7fa664008040 comp rx=0 tx=0).stop 2023-07-14T13:32:26.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.884+0000 7fa67a99d640 1 -- 172.21.15.5:0/3340079872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6740c21f0 msgr2=0x7fa6741f4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:26.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.884+0000 7fa67a99d640 1 --2- 172.21.15.5:0/3340079872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6740c21f0 0x7fa6741f4550 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0af040 tx=0x7fa66c0196b0 comp rx=0 tx=0).stop 2023-07-14T13:32:26.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.884+0000 7fa67a99d640 1 -- 172.21.15.5:0/3340079872 shutdown_connections 2023-07-14T13:32:26.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.884+0000 7fa67a99d640 1 --2- 172.21.15.5:0/3340079872 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fa6600663a0 0x7fa660068850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:26.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.884+0000 7fa67a99d640 1 --2- 172.21.15.5:0/3340079872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6740c21f0 0x7fa6741f4550 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:26.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.884+0000 7fa67a99d640 1 --2- 172.21.15.5:0/3340079872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa674070b70 0x7fa6740cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:26.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.884+0000 7fa67a99d640 1 --2- 172.21.15.5:0/3340079872 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa67406b1e0 0x7fa674154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:26.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.884+0000 7fa67a99d640 1 -- 172.21.15.5:0/3340079872 >> 172.21.15.5:0/3340079872 conn(0x7fa6740afcf0 msgr2=0x7fa6740b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:26.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.884+0000 7fa67a99d640 1 -- 172.21.15.5:0/3340079872 shutdown_connections 2023-07-14T13:32:26.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:26.884+0000 7fa67a99d640 1 -- 172.21.15.5:0/3340079872 wait complete. 2023-07-14T13:32:26.906 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:32:26.906 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:32:27.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.052+0000 7f4be4493640 1 Processor -- start 2023-07-14T13:32:27.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.052+0000 7f4be4493640 1 -- start start 2023-07-14T13:32:27.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.052+0000 7f4be4493640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4bdc15f690 0x7f4bdc0b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:27.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.052+0000 7f4be4493640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bdc1453a0 0x7f4bdc15fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:27.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.052+0000 7f4be4493640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bdc06c040 con 0x7f4bdc06c4d0 2023-07-14T13:32:27.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.052+0000 7f4be4493640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bdc160600 con 0x7f4bdc15f690 2023-07-14T13:32:27.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.052+0000 7f4be4493640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc160360 con 0x7f4bdc1453a0 2023-07-14T13:32:27.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.052+0000 7f4be222f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4bdc15f690 0x7f4bdc0b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:27.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.052+0000 7f4be222f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4bdc15f690 0x7f4bdc0b1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57892/0 (socket says 172.21.15.5:57892) 2023-07-14T13:32:27.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.052+0000 7f4be2a30640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4bdc06c4d0 0x7f4bdc06c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34302/0 (socket says 172.21.15.5:34302) 2023-07-14T13:32:27.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.052+0000 7f4be222f640 1 -- 172.21.15.5:0/1457427766 learned_addr learned my addr 172.21.15.5:0/1457427766 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:27.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.056+0000 7f4be1a2e640 1 --2- 172.21.15.5:0/1457427766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bdc1453a0 0x7f4bdc15fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:27.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.056+0000 7f4be222f640 1 -- 172.21.15.5:0/1457427766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bdc1453a0 msgr2=0x7f4bdc15fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:27.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.056+0000 7f4be222f640 1 --2- 172.21.15.5:0/1457427766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bdc1453a0 0x7f4bdc15fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:27.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.056+0000 7f4be222f640 1 -- 172.21.15.5:0/1457427766 >> v1:172.21.15.5:6789/0 conn(0x7f4bdc06c4d0 legacy=0x7f4bdc06c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:27.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.056+0000 7f4be222f640 1 -- 172.21.15.5:0/1457427766 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bdc06b9f0 con 0x7f4bdc15f690 2023-07-14T13:32:27.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.056+0000 7f4be122d640 1 -- 172.21.15.5:0/1457427766 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813143708 0 0) 0x7f4bdc06c040 con 0x7f4bdc06c4d0 2023-07-14T13:32:27.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.056+0000 7f4be1a2e640 1 --2- 172.21.15.5:0/1457427766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bdc1453a0 0x7f4bdc15fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:32:27.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.056+0000 7f4be222f640 1 --2- 172.21.15.5:0/1457427766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bdc15f690 0x7f4bdc0b1890 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8009870 tx=0x7f4bd801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=981f80b997fc89b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:27.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.056+0000 7f4be122d640 1 -- 172.21.15.5:0/1457427766 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd80ad640 con 0x7f4bdc15f690 2023-07-14T13:32:27.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.056+0000 7f4be122d640 1 -- 172.21.15.5:0/1457427766 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd80ad7a0 con 0x7f4bdc15f690 2023-07-14T13:32:27.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.056+0000 7f4be122d640 1 -- 172.21.15.5:0/1457427766 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd80adb30 con 0x7f4bdc15f690 2023-07-14T13:32:27.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.060+0000 7f4be4493640 1 -- 172.21.15.5:0/1457427766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bdc15f690 msgr2=0x7f4bdc0b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:27.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.060+0000 7f4be4493640 1 --2- 172.21.15.5:0/1457427766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bdc15f690 0x7f4bdc0b1890 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8009870 tx=0x7f4bd801c480 comp rx=0 tx=0).stop 2023-07-14T13:32:27.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.060+0000 7f4be4493640 1 -- 172.21.15.5:0/1457427766 shutdown_connections 2023-07-14T13:32:27.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.060+0000 7f4be4493640 1 --2- 172.21.15.5:0/1457427766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bdc1453a0 0x7f4bdc15fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:27.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.060+0000 7f4be4493640 1 --2- 172.21.15.5:0/1457427766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bdc15f690 0x7f4bdc0b1890 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:27.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.060+0000 7f4be4493640 1 -- 172.21.15.5:0/1457427766 >> 172.21.15.5:0/1457427766 conn(0x7f4bdc0b1210 msgr2=0x7f4bdc0ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:27.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.060+0000 7f4be4493640 1 -- 172.21.15.5:0/1457427766 shutdown_connections 2023-07-14T13:32:27.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.060+0000 7f4be4493640 1 -- 172.21.15.5:0/1457427766 wait complete. 2023-07-14T13:32:27.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.060+0000 7f4be4493640 1 Processor -- start 2023-07-14T13:32:27.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.060+0000 7f4be4493640 1 -- start start 2023-07-14T13:32:27.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.060+0000 7f4be4493640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bdc06c4d0 0x7f4bdc14e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:27.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.060+0000 7f4be4493640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bdc1453a0 0x7f4bdc162bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:27.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.060+0000 7f4be4493640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bdc15f690 0x7f4bdc163130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:27.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.060+0000 7f4be4493640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc1668c0 con 0x7f4bdc1453a0 2023-07-14T13:32:27.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.060+0000 7f4be4493640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc14e620 con 0x7f4bdc15f690 2023-07-14T13:32:27.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.060+0000 7f4be4493640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc1659f0 con 0x7f4bdc06c4d0 2023-07-14T13:32:27.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.060+0000 7f4be1a2e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bdc1453a0 0x7f4bdc162bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:27.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.060+0000 7f4be1a2e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bdc1453a0 0x7f4bdc162bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57908/0 (socket says 172.21.15.5:57908) 2023-07-14T13:32:27.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.060+0000 7f4be1a2e640 1 -- 172.21.15.5:0/3039076424 learned_addr learned my addr 172.21.15.5:0/3039076424 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:27.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.060+0000 7f4be2a30640 1 --2- 172.21.15.5:0/3039076424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bdc15f690 0x7f4bdc163130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:27.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.060+0000 7f4be222f640 1 --2- 172.21.15.5:0/3039076424 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bdc06c4d0 0x7f4bdc14e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:27.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.060+0000 7f4be1a2e640 1 -- 172.21.15.5:0/3039076424 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bdc06c4d0 msgr2=0x7f4bdc14e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:27.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.060+0000 7f4be1a2e640 1 --2- 172.21.15.5:0/3039076424 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bdc06c4d0 0x7f4bdc14e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:27.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.060+0000 7f4be1a2e640 1 -- 172.21.15.5:0/3039076424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bdc15f690 msgr2=0x7f4bdc163130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:27.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.060+0000 7f4be1a2e640 1 --2- 172.21.15.5:0/3039076424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bdc15f690 0x7f4bdc163130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:27.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.060+0000 7f4be1a2e640 1 -- 172.21.15.5:0/3039076424 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd80094d0 con 0x7f4bdc1453a0 2023-07-14T13:32:27.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.064+0000 7f4be1a2e640 1 --2- 172.21.15.5:0/3039076424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bdc1453a0 0x7f4bdc162bf0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc00c820 tx=0x7f4bcc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:27.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.064+0000 7f4bd2ffd640 1 -- 172.21.15.5:0/3039076424 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc007a30 con 0x7f4bdc1453a0 2023-07-14T13:32:27.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.064+0000 7f4bd2ffd640 1 -- 172.21.15.5:0/3039076424 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bcc007b90 con 0x7f4bdc1453a0 2023-07-14T13:32:27.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.064+0000 7f4be4493640 1 -- 172.21.15.5:0/3039076424 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bdc165c40 con 0x7f4bdc1453a0 2023-07-14T13:32:27.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.064+0000 7f4bd2ffd640 1 -- 172.21.15.5:0/3039076424 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc00ce10 con 0x7f4bdc1453a0 2023-07-14T13:32:27.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.064+0000 7f4be4493640 1 -- 172.21.15.5:0/3039076424 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bdc166200 con 0x7f4bdc1453a0 2023-07-14T13:32:27.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.064+0000 7f4be4493640 1 -- 172.21.15.5:0/3039076424 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bdc0678d0 con 0x7f4bdc1453a0 2023-07-14T13:32:27.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.064+0000 7f4bd2ffd640 1 -- 172.21.15.5:0/3039076424 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4bcc0113f0 con 0x7f4bdc1453a0 2023-07-14T13:32:27.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.064+0000 7f4bd2ffd640 1 --2- 172.21.15.5:0/3039076424 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f4bc00663a0 0x7f4bc0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:27.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.064+0000 7f4bd2ffd640 1 -- 172.21.15.5:0/3039076424 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f4bcc083d50 con 0x7f4bdc1453a0 2023-07-14T13:32:27.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.064+0000 7f4be222f640 1 --2- 172.21.15.5:0/3039076424 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f4bc00663a0 0x7f4bc0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:27.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.068+0000 7f4be222f640 1 --2- 172.21.15.5:0/3039076424 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f4bc00663a0 0x7f4bc0068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80af000 tx=0x7f4bd80a7070 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:27.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.068+0000 7f4bd2ffd640 1 -- 172.21.15.5:0/3039076424 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4bcc087030 con 0x7f4bdc1453a0 2023-07-14T13:32:27.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.224+0000 7f4be4493640 1 -- 172.21.15.5:0/3039076424 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4bdc15ea10 con 0x7f4bdc1453a0 2023-07-14T13:32:27.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.224+0000 7f4bd2ffd640 1 -- 172.21.15.5:0/3039076424 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v187) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4bcc01f0a0 con 0x7f4bdc1453a0 2023-07-14T13:32:27.228 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:32:27.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.228+0000 7f4be4493640 1 -- 172.21.15.5:0/3039076424 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f4bc00663a0 msgr2=0x7f4bc0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:27.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.228+0000 7f4be4493640 1 --2- 172.21.15.5:0/3039076424 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f4bc00663a0 0x7f4bc0068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80af000 tx=0x7f4bd80a7070 comp rx=0 tx=0).stop 2023-07-14T13:32:27.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.228+0000 7f4be4493640 1 -- 172.21.15.5:0/3039076424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bdc1453a0 msgr2=0x7f4bdc162bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:27.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.228+0000 7f4be4493640 1 --2- 172.21.15.5:0/3039076424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bdc1453a0 0x7f4bdc162bf0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc00c820 tx=0x7f4bcc00cce0 comp rx=0 tx=0).stop 2023-07-14T13:32:27.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.228+0000 7f4be4493640 1 -- 172.21.15.5:0/3039076424 shutdown_connections 2023-07-14T13:32:27.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.228+0000 7f4be4493640 1 --2- 172.21.15.5:0/3039076424 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f4bc00663a0 0x7f4bc0068850 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:27.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.228+0000 7f4be4493640 1 --2- 172.21.15.5:0/3039076424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bdc15f690 0x7f4bdc163130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:27.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.228+0000 7f4be4493640 1 --2- 172.21.15.5:0/3039076424 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bdc1453a0 0x7f4bdc162bf0 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:27.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.228+0000 7f4be4493640 1 --2- 172.21.15.5:0/3039076424 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bdc06c4d0 0x7f4bdc14e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:27.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.228+0000 7f4be4493640 1 -- 172.21.15.5:0/3039076424 >> 172.21.15.5:0/3039076424 conn(0x7f4bdc0b1210 msgr2=0x7f4bdc0afd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:27.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.228+0000 7f4be4493640 1 -- 172.21.15.5:0/3039076424 shutdown_connections 2023-07-14T13:32:27.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.228+0000 7f4be4493640 1 -- 172.21.15.5:0/3039076424 wait complete. 2023-07-14T13:32:27.247 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:32:27.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.392+0000 7f1b151fa640 1 Processor -- start 2023-07-14T13:32:27.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.392+0000 7f1b151fa640 1 -- start start 2023-07-14T13:32:27.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.392+0000 7f1b151fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b1015f320 0x7f1b100d22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:27.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.392+0000 7f1b151fa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1b100b16d0 0x7f1b100d2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:27.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.392+0000 7f1b151fa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b100b0230 con 0x7f1b100d0230 2023-07-14T13:32:27.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.392+0000 7f1b151fa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b100d0a60 con 0x7f1b100b16d0 2023-07-14T13:32:27.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.392+0000 7f1b151fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b100af9d0 con 0x7f1b1015f320 2023-07-14T13:32:27.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.392+0000 7f1b0e59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1b100d0230 0x7f1b100b1c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34306/0 (socket says 172.21.15.5:34306) 2023-07-14T13:32:27.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.396+0000 7f1b0e59c640 1 -- 172.21.15.5:0/830702617 learned_addr learned my addr 172.21.15.5:0/830702617 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:27.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.396+0000 7f1b0f59e640 1 --2- 172.21.15.5:0/830702617 >> v2:172.21.15.5:3300/0 conn(0x7f1b100b16d0 0x7f1b100d2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:27.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.396+0000 7f1b0ed9d640 1 --2- 172.21.15.5:0/830702617 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b1015f320 0x7f1b100d22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:27.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.396+0000 7f1b0dd9b640 1 -- 172.21.15.5:0/830702617 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2621986881 0 0) 0x7f1b100b0230 con 0x7f1b100d0230 2023-07-14T13:32:27.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.396+0000 7f1b0dd9b640 1 -- 172.21.15.5:0/830702617 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1af8003530 con 0x7f1b100d0230 2023-07-14T13:32:27.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.396+0000 7f1b0f59e640 1 -- 172.21.15.5:0/830702617 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b1015f320 msgr2=0x7f1b100d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:27.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.396+0000 7f1b0f59e640 1 --2- 172.21.15.5:0/830702617 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b1015f320 0x7f1b100d22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:27.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.396+0000 7f1b0f59e640 1 -- 172.21.15.5:0/830702617 >> v1:172.21.15.5:6789/0 conn(0x7f1b100d0230 legacy=0x7f1b100b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:27.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.396+0000 7f1b0f59e640 1 -- 172.21.15.5:0/830702617 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b100d0780 con 0x7f1b100b16d0 2023-07-14T13:32:27.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.396+0000 7f1b0f59e640 1 --2- 172.21.15.5:0/830702617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b100b16d0 0x7f1b100d2800 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f1b08009d90 tx=0x7f1b0801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=280308941e44e31f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:27.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.396+0000 7f1b0dd9b640 1 -- 172.21.15.5:0/830702617 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b080a5900 con 0x7f1b100b16d0 2023-07-14T13:32:27.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.396+0000 7f1b0dd9b640 1 -- 172.21.15.5:0/830702617 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b080a5a60 con 0x7f1b100b16d0 2023-07-14T13:32:27.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.396+0000 7f1b0dd9b640 1 -- 172.21.15.5:0/830702617 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b080a5df0 con 0x7f1b100b16d0 2023-07-14T13:32:27.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.400+0000 7f1b151fa640 1 -- 172.21.15.5:0/830702617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b100b16d0 msgr2=0x7f1b100d2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:27.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.400+0000 7f1b151fa640 1 --2- 172.21.15.5:0/830702617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b100b16d0 0x7f1b100d2800 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f1b08009d90 tx=0x7f1b0801c950 comp rx=0 tx=0).stop 2023-07-14T13:32:27.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.400+0000 7f1b151fa640 1 -- 172.21.15.5:0/830702617 shutdown_connections 2023-07-14T13:32:27.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.400+0000 7f1b151fa640 1 --2- 172.21.15.5:0/830702617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b100b16d0 0x7f1b100d2800 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:27.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.400+0000 7f1b151fa640 1 --2- 172.21.15.5:0/830702617 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b1015f320 0x7f1b100d22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:27.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.400+0000 7f1b151fa640 1 -- 172.21.15.5:0/830702617 >> 172.21.15.5:0/830702617 conn(0x7f1b100659d0 msgr2=0x7f1b1009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:27.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.400+0000 7f1b151fa640 1 -- 172.21.15.5:0/830702617 shutdown_connections 2023-07-14T13:32:27.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.400+0000 7f1b151fa640 1 -- 172.21.15.5:0/830702617 wait complete. 2023-07-14T13:32:27.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.400+0000 7f1b151fa640 1 Processor -- start 2023-07-14T13:32:27.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.400+0000 7f1b151fa640 1 -- start start 2023-07-14T13:32:27.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.400+0000 7f1b151fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b100b16d0 0x7f1b10150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:27.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.400+0000 7f1b151fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b100d0230 0x7f1b100c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:27.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.400+0000 7f1b151fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b1015f320 0x7f1b100c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:27.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.400+0000 7f1b151fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b10152150 con 0x7f1b100b16d0 2023-07-14T13:32:27.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.400+0000 7f1b151fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b101523f0 con 0x7f1b1015f320 2023-07-14T13:32:27.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.400+0000 7f1b151fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b101526d0 con 0x7f1b100d0230 2023-07-14T13:32:27.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.400+0000 7f1b0ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b100b16d0 0x7f1b10150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:27.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.400+0000 7f1b0ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b100b16d0 0x7f1b10150e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57918/0 (socket says 172.21.15.5:57918) 2023-07-14T13:32:27.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.400+0000 7f1b0ed9d640 1 -- 172.21.15.5:0/70674446 learned_addr learned my addr 172.21.15.5:0/70674446 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:27.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.404+0000 7f1b0f59e640 1 --2- 172.21.15.5:0/70674446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b1015f320 0x7f1b100c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:27.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.404+0000 7f1b0e59c640 1 --2- 172.21.15.5:0/70674446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b100d0230 0x7f1b100c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:27.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.404+0000 7f1b0ed9d640 1 -- 172.21.15.5:0/70674446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b100d0230 msgr2=0x7f1b100c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:27.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.404+0000 7f1b0ed9d640 1 --2- 172.21.15.5:0/70674446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b100d0230 0x7f1b100c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:27.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.404+0000 7f1b0ed9d640 1 -- 172.21.15.5:0/70674446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b1015f320 msgr2=0x7f1b100c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:27.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.404+0000 7f1b0ed9d640 1 --2- 172.21.15.5:0/70674446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b1015f320 0x7f1b100c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:27.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.404+0000 7f1b0ed9d640 1 -- 172.21.15.5:0/70674446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b08009a70 con 0x7f1b100b16d0 2023-07-14T13:32:27.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.404+0000 7f1b0e59c640 1 --2- 172.21.15.5:0/70674446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b100d0230 0x7f1b100c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:32:27.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.404+0000 7f1b0ed9d640 1 --2- 172.21.15.5:0/70674446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b100b16d0 0x7f1b10150e70 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f1b0000e870 tx=0x7f1b0000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:27.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.404+0000 7f1af77fe640 1 -- 172.21.15.5:0/70674446 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b00009510 con 0x7f1b100b16d0 2023-07-14T13:32:27.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.404+0000 7f1af77fe640 1 -- 172.21.15.5:0/70674446 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0000eec0 con 0x7f1b100b16d0 2023-07-14T13:32:27.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.404+0000 7f1af77fe640 1 -- 172.21.15.5:0/70674446 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0000cb40 con 0x7f1b100b16d0 2023-07-14T13:32:27.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.404+0000 7f1b151fa640 1 -- 172.21.15.5:0/70674446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b101533e0 con 0x7f1b100b16d0 2023-07-14T13:32:27.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.404+0000 7f1b151fa640 1 -- 172.21.15.5:0/70674446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b101513b0 con 0x7f1b100b16d0 2023-07-14T13:32:27.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.404+0000 7f1b151fa640 1 -- 172.21.15.5:0/70674446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b100678d0 con 0x7f1b100b16d0 2023-07-14T13:32:27.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.404+0000 7f1af77fe640 1 -- 172.21.15.5:0/70674446 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1b0000cca0 con 0x7f1b100b16d0 2023-07-14T13:32:27.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.404+0000 7f1af77fe640 1 --2- 172.21.15.5:0/70674446 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f1afc0663a0 0x7f1afc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:27.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.404+0000 7f1af77fe640 1 -- 172.21.15.5:0/70674446 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f1b00083bb0 con 0x7f1b100b16d0 2023-07-14T13:32:27.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.408+0000 7f1b0e59c640 1 --2- 172.21.15.5:0/70674446 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f1afc0663a0 0x7f1afc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:27.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.408+0000 7f1b0e59c640 1 --2- 172.21.15.5:0/70674446 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f1afc0663a0 0x7f1afc068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1b1015a6c0 tx=0x7f1b04009040 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:27.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.412+0000 7f1af77fe640 1 -- 172.21.15.5:0/70674446 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f1b000512e0 con 0x7f1b100b16d0 2023-07-14T13:32:27.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.564+0000 7f1b151fa640 1 -- 172.21.15.5:0/70674446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1b101563b0 con 0x7f1b100b16d0 2023-07-14T13:32:27.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.564+0000 7f1af77fe640 1 -- 172.21.15.5:0/70674446 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v187) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1b000170a0 con 0x7f1b100b16d0 2023-07-14T13:32:27.565 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:32:27.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.564+0000 7f1b151fa640 1 -- 172.21.15.5:0/70674446 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f1afc0663a0 msgr2=0x7f1afc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:27.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.564+0000 7f1b151fa640 1 --2- 172.21.15.5:0/70674446 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f1afc0663a0 0x7f1afc068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1b1015a6c0 tx=0x7f1b04009040 comp rx=0 tx=0).stop 2023-07-14T13:32:27.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.564+0000 7f1b151fa640 1 -- 172.21.15.5:0/70674446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b100b16d0 msgr2=0x7f1b10150e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:27.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.564+0000 7f1b151fa640 1 --2- 172.21.15.5:0/70674446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b100b16d0 0x7f1b10150e70 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f1b0000e870 tx=0x7f1b0000ec70 comp rx=0 tx=0).stop 2023-07-14T13:32:27.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.564+0000 7f1b151fa640 1 -- 172.21.15.5:0/70674446 shutdown_connections 2023-07-14T13:32:27.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.564+0000 7f1b151fa640 1 --2- 172.21.15.5:0/70674446 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f1afc0663a0 0x7f1afc068850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:27.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.564+0000 7f1b151fa640 1 --2- 172.21.15.5:0/70674446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b1015f320 0x7f1b100c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:27.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.564+0000 7f1b151fa640 1 --2- 172.21.15.5:0/70674446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b100d0230 0x7f1b100c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:27.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.564+0000 7f1b151fa640 1 --2- 172.21.15.5:0/70674446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b100b16d0 0x7f1b10150e70 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:27.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.564+0000 7f1b151fa640 1 -- 172.21.15.5:0/70674446 >> 172.21.15.5:0/70674446 conn(0x7f1b100659d0 msgr2=0x7f1b100b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:27.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.564+0000 7f1b151fa640 1 -- 172.21.15.5:0/70674446 shutdown_connections 2023-07-14T13:32:27.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.564+0000 7f1b151fa640 1 -- 172.21.15.5:0/70674446 wait complete. 2023-07-14T13:32:27.586 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-14T13:32:27.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.728+0000 7f15c2bc5640 1 Processor -- start 2023-07-14T13:32:27.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.728+0000 7f15c2bc5640 1 -- start start 2023-07-14T13:32:27.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.728+0000 7f15c2bc5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15bc06a540 0x7f15bc06a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:27.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.728+0000 7f15c2bc5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15bc0cdc80 con 0x7f15bc0ce0f0 2023-07-14T13:32:27.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.728+0000 7f15c2bc5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15bc06aed0 con 0x7f15bc15f500 2023-07-14T13:32:27.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.728+0000 7f15c2bc5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc06e4c0 con 0x7f15bc06a540 2023-07-14T13:32:27.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.728+0000 7f15c1162640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f15bc0ce0f0 0x7f15bc0ce570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34312/0 (socket says 172.21.15.5:34312) 2023-07-14T13:32:27.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.728+0000 7f15c1162640 1 -- 172.21.15.5:0/3945095372 learned_addr learned my addr 172.21.15.5:0/3945095372 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:27.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.728+0000 7f15bbfff640 1 --2- 172.21.15.5:0/3945095372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15bc06a540 0x7f15bc06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:27.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.732+0000 7f15bb7fe640 1 -- 172.21.15.5:0/3945095372 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939787440 0 0) 0x7f15bc0cdc80 con 0x7f15bc0ce0f0 2023-07-14T13:32:27.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.732+0000 7f15bb7fe640 1 -- 172.21.15.5:0/3945095372 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15ac003530 con 0x7f15bc0ce0f0 2023-07-14T13:32:27.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.732+0000 7f15bb7fe640 1 -- 172.21.15.5:0/3945095372 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98250277 0 0) 0x7f15b0001170 con 0x7f15bc15f500 2023-07-14T13:32:27.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.732+0000 7f15bb7fe640 1 -- 172.21.15.5:0/3945095372 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15bc0cdc80 con 0x7f15bc15f500 2023-07-14T13:32:27.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.732+0000 7f15bbfff640 1 -- 172.21.15.5:0/3945095372 >> v1:172.21.15.154:6789/0 conn(0x7f15bc15f500 legacy=0x7f15bc06cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:27.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.732+0000 7f15bbfff640 1 -- 172.21.15.5:0/3945095372 >> v1:172.21.15.5:6789/0 conn(0x7f15bc0ce0f0 legacy=0x7f15bc0ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:27.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.732+0000 7f15bbfff640 1 -- 172.21.15.5:0/3945095372 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15bc06d940 con 0x7f15bc06a540 2023-07-14T13:32:27.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.732+0000 7f15bbfff640 1 --2- 172.21.15.5:0/3945095372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15bc06a540 0x7f15bc06a990 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f15a80097f0 tx=0x7f15a801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c67d38a37451f74 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:27.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.732+0000 7f15bb7fe640 1 -- 172.21.15.5:0/3945095372 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a80ac410 con 0x7f15bc06a540 2023-07-14T13:32:27.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.732+0000 7f15bb7fe640 1 -- 172.21.15.5:0/3945095372 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a80ac570 con 0x7f15bc06a540 2023-07-14T13:32:27.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.732+0000 7f15bb7fe640 1 -- 172.21.15.5:0/3945095372 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a80ac900 con 0x7f15bc06a540 2023-07-14T13:32:27.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.736+0000 7f15c2bc5640 1 -- 172.21.15.5:0/3945095372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15bc06a540 msgr2=0x7f15bc06a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:27.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.736+0000 7f15c2bc5640 1 --2- 172.21.15.5:0/3945095372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15bc06a540 0x7f15bc06a990 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f15a80097f0 tx=0x7f15a801c4c0 comp rx=0 tx=0).stop 2023-07-14T13:32:27.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.736+0000 7f15c2bc5640 1 -- 172.21.15.5:0/3945095372 shutdown_connections 2023-07-14T13:32:27.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.736+0000 7f15c2bc5640 1 --2- 172.21.15.5:0/3945095372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15bc06a540 0x7f15bc06a990 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:27.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.736+0000 7f15c2bc5640 1 -- 172.21.15.5:0/3945095372 >> 172.21.15.5:0/3945095372 conn(0x7f15bc0659d0 msgr2=0x7f15bc099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:27.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.736+0000 7f15c2bc5640 1 -- 172.21.15.5:0/3945095372 shutdown_connections 2023-07-14T13:32:27.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.736+0000 7f15c2bc5640 1 -- 172.21.15.5:0/3945095372 wait complete. 2023-07-14T13:32:27.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.736+0000 7f15c2bc5640 1 Processor -- start 2023-07-14T13:32:27.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.736+0000 7f15c2bc5640 1 -- start start 2023-07-14T13:32:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.736+0000 7f15c2bc5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15bc06a540 0x7f15bc0ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.736+0000 7f15c2bc5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15bc0ce0f0 0x7f15bc153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.736+0000 7f15c2bc5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15bc15f500 0x7f15bc0b1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.736+0000 7f15c2bc5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc0b10c0 con 0x7f15bc0ce0f0 2023-07-14T13:32:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.736+0000 7f15c2bc5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc0b04b0 con 0x7f15bc15f500 2023-07-14T13:32:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.736+0000 7f15c2bc5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc0b0790 con 0x7f15bc06a540 2023-07-14T13:32:27.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.736+0000 7f15bbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15bc0ce0f0 0x7f15bc153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:27.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.736+0000 7f15bbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15bc0ce0f0 0x7f15bc153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57924/0 (socket says 172.21.15.5:57924) 2023-07-14T13:32:27.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.736+0000 7f15bbfff640 1 -- 172.21.15.5:0/2874484007 learned_addr learned my addr 172.21.15.5:0/2874484007 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:27.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.736+0000 7f15c1162640 1 --2- 172.21.15.5:0/2874484007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15bc15f500 0x7f15bc0b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:27.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.736+0000 7f15c0961640 1 --2- 172.21.15.5:0/2874484007 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15bc06a540 0x7f15bc0ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:27.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.736+0000 7f15bbfff640 1 -- 172.21.15.5:0/2874484007 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15bc06a540 msgr2=0x7f15bc0ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:27.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.736+0000 7f15bbfff640 1 --2- 172.21.15.5:0/2874484007 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15bc06a540 0x7f15bc0ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:27.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.736+0000 7f15bbfff640 1 -- 172.21.15.5:0/2874484007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15bc15f500 msgr2=0x7f15bc0b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:27.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.736+0000 7f15bbfff640 1 --2- 172.21.15.5:0/2874484007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15bc15f500 0x7f15bc0b1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.736+0000 7f15bbfff640 1 -- 172.21.15.5:0/2874484007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a8009420 con 0x7f15bc0ce0f0 2023-07-14T13:32:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.740+0000 7f15bbfff640 1 --2- 172.21.15.5:0/2874484007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15bc0ce0f0 0x7f15bc153340 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f15a80190d0 tx=0x7f15a8019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.740+0000 7f15b97fa640 1 -- 172.21.15.5:0/2874484007 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a8006e20 con 0x7f15bc0ce0f0 2023-07-14T13:32:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.740+0000 7f15b97fa640 1 -- 172.21.15.5:0/2874484007 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a80ace20 con 0x7f15bc0ce0f0 2023-07-14T13:32:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.740+0000 7f15b97fa640 1 -- 172.21.15.5:0/2874484007 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a80b5880 con 0x7f15bc0ce0f0 2023-07-14T13:32:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.740+0000 7f15c2bc5640 1 -- 172.21.15.5:0/2874484007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15bc0b0a70 con 0x7f15bc0ce0f0 2023-07-14T13:32:27.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.740+0000 7f15c2bc5640 1 -- 172.21.15.5:0/2874484007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15bc0cd4b0 con 0x7f15bc0ce0f0 2023-07-14T13:32:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.740+0000 7f15c2bc5640 1 -- 172.21.15.5:0/2874484007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15bc0b1230 con 0x7f15bc0ce0f0 2023-07-14T13:32:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.740+0000 7f15b97fa640 1 -- 172.21.15.5:0/2874484007 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f15a80b3040 con 0x7f15bc0ce0f0 2023-07-14T13:32:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.740+0000 7f15b97fa640 1 --2- 172.21.15.5:0/2874484007 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f15a00663d0 0x7f15a0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:27.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.740+0000 7f15b97fa640 1 -- 172.21.15.5:0/2874484007 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f15a811d310 con 0x7f15bc0ce0f0 2023-07-14T13:32:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.740+0000 7f15c0961640 1 --2- 172.21.15.5:0/2874484007 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f15a00663d0 0x7f15a0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:27.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.744+0000 7f15c0961640 1 --2- 172.21.15.5:0/2874484007 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f15a00663d0 0x7f15a0068880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f15b00013d0 tx=0x7f15b0009040 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:27.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.744+0000 7f15b97fa640 1 -- 172.21.15.5:0/2874484007 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f15a80ea950 con 0x7f15bc0ce0f0 2023-07-14T13:32:27.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.904+0000 7f15c2bc5640 1 -- 172.21.15.5:0/2874484007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f15bc0678d0 con 0x7f15bc0ce0f0 2023-07-14T13:32:27.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.904+0000 7f15b97fa640 1 -- 172.21.15.5:0/2874484007 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v187) v1 ==== 84+0+126 (secure 0 0 0) 0x7f15a80edf70 con 0x7f15bc0ce0f0 2023-07-14T13:32:27.904 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:27.905 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-07-14T13:32:27.905 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:32:27.905 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-07-14T13:32:27.905 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-07-14T13:32:27.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-07-14T13:32:27.905 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:32:27.906 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 2, 2023-07-14T13:32:27.906 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": "rbd" 2023-07-14T13:32:27.906 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:32:27.906 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-07-14T13:32:27.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.904+0000 7f15c2bc5640 1 -- 172.21.15.5:0/2874484007 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f15a00663d0 msgr2=0x7f15a0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:27.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.904+0000 7f15c2bc5640 1 --2- 172.21.15.5:0/2874484007 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f15a00663d0 0x7f15a0068880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f15b00013d0 tx=0x7f15b0009040 comp rx=0 tx=0).stop 2023-07-14T13:32:27.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.904+0000 7f15c2bc5640 1 -- 172.21.15.5:0/2874484007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15bc0ce0f0 msgr2=0x7f15bc153340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:27.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.904+0000 7f15c2bc5640 1 --2- 172.21.15.5:0/2874484007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15bc0ce0f0 0x7f15bc153340 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f15a80190d0 tx=0x7f15a8019260 comp rx=0 tx=0).stop 2023-07-14T13:32:27.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.904+0000 7f15c2bc5640 1 -- 172.21.15.5:0/2874484007 shutdown_connections 2023-07-14T13:32:27.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.904+0000 7f15c2bc5640 1 --2- 172.21.15.5:0/2874484007 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f15a00663d0 0x7f15a0068880 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:27.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.904+0000 7f15c2bc5640 1 --2- 172.21.15.5:0/2874484007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15bc15f500 0x7f15bc0b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:27.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.904+0000 7f15c2bc5640 1 --2- 172.21.15.5:0/2874484007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15bc0ce0f0 0x7f15bc153340 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:27.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.904+0000 7f15c2bc5640 1 --2- 172.21.15.5:0/2874484007 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f15bc06a540 0x7f15bc0ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:27.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.904+0000 7f15c2bc5640 1 -- 172.21.15.5:0/2874484007 >> 172.21.15.5:0/2874484007 conn(0x7f15bc0659d0 msgr2=0x7f15bc15fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:27.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.904+0000 7f15c2bc5640 1 -- 172.21.15.5:0/2874484007 shutdown_connections 2023-07-14T13:32:27.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:27.904+0000 7f15c2bc5640 1 -- 172.21.15.5:0/2874484007 wait complete. 2023-07-14T13:32:27.925 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-14T13:32:27.926 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-14T13:32:28.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.072+0000 7fe31d39d640 1 Processor -- start 2023-07-14T13:32:28.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.072+0000 7fe31d39d640 1 -- start start 2023-07-14T13:32:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.072+0000 7fe31d39d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe3180aeb40 0x7fe31815cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.072+0000 7fe31d39d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe318159440 0x7fe3180c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.072+0000 7fe31d39d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3181532b0 con 0x7fe3180aef10 2023-07-14T13:32:28.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.072+0000 7fe31d39d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3180ca6f0 con 0x7fe3180aeb40 2023-07-14T13:32:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.072+0000 7fe31d39d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3181599d0 con 0x7fe318159440 2023-07-14T13:32:28.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.076+0000 7fe3177fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe318159440 0x7fe3180c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:28.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.076+0000 7fe30ffff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe3180aef10 0x7fe318158d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:37648/0 (socket says 172.21.15.5:37648) 2023-07-14T13:32:28.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.076+0000 7fe30ffff640 1 -- 172.21.15.5:0/2088297821 learned_addr learned my addr 172.21.15.5:0/2088297821 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:28.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.076+0000 7fe316ffd640 1 --2- 172.21.15.5:0/2088297821 >> v2:172.21.15.154:3300/0 conn(0x7fe3180aeb40 0x7fe31815cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:28.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.076+0000 7fe3177fe640 1 -- 172.21.15.5:0/2088297821 >> v2:172.21.15.154:3300/0 conn(0x7fe3180aeb40 msgr2=0x7fe31815cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:28.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.076+0000 7fe3177fe640 1 --2- 172.21.15.5:0/2088297821 >> v2:172.21.15.154:3300/0 conn(0x7fe3180aeb40 0x7fe31815cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:28.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.076+0000 7fe3177fe640 1 -- 172.21.15.5:0/2088297821 >> v1:172.21.15.154:6789/0 conn(0x7fe3180aef10 legacy=0x7fe318158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.076+0000 7fe3177fe640 1 -- 172.21.15.5:0/2088297821 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe318159cb0 con 0x7fe318159440 2023-07-14T13:32:28.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.076+0000 7fe3167fc640 1 -- 172.21.15.5:0/2088297821 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3097814802 0 0) 0x7fe3181532b0 con 0x7fe3180aef10 2023-07-14T13:32:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.076+0000 7fe3177fe640 1 --2- 172.21.15.5:0/2088297821 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe318159440 0x7fe3180c88c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe310009d90 tx=0x7fe31001eaa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2c550c625627664 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:28.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.080+0000 7fe3167fc640 1 -- 172.21.15.5:0/2088297821 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3100a7b70 con 0x7fe318159440 2023-07-14T13:32:28.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.080+0000 7fe3167fc640 1 -- 172.21.15.5:0/2088297821 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3100a7cd0 con 0x7fe318159440 2023-07-14T13:32:28.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.080+0000 7fe3167fc640 1 -- 172.21.15.5:0/2088297821 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3100af660 con 0x7fe318159440 2023-07-14T13:32:28.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.080+0000 7fe31d39d640 1 -- 172.21.15.5:0/2088297821 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe318159440 msgr2=0x7fe3180c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:28.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.080+0000 7fe31d39d640 1 --2- 172.21.15.5:0/2088297821 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe318159440 0x7fe3180c88c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe310009d90 tx=0x7fe31001eaa0 comp rx=0 tx=0).stop 2023-07-14T13:32:28.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.080+0000 7fe31d39d640 1 -- 172.21.15.5:0/2088297821 shutdown_connections 2023-07-14T13:32:28.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.080+0000 7fe31d39d640 1 --2- 172.21.15.5:0/2088297821 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe318159440 0x7fe3180c88c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:28.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.080+0000 7fe31d39d640 1 --2- 172.21.15.5:0/2088297821 >> v2:172.21.15.154:3300/0 conn(0x7fe3180aeb40 0x7fe31815cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:28.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.080+0000 7fe31d39d640 1 -- 172.21.15.5:0/2088297821 >> 172.21.15.5:0/2088297821 conn(0x7fe3180cde90 msgr2=0x7fe3180ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:28.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.080+0000 7fe31d39d640 1 -- 172.21.15.5:0/2088297821 shutdown_connections 2023-07-14T13:32:28.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.080+0000 7fe31d39d640 1 -- 172.21.15.5:0/2088297821 wait complete. 2023-07-14T13:32:28.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.080+0000 7fe31d39d640 1 Processor -- start 2023-07-14T13:32:28.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.080+0000 7fe31d39d640 1 -- start start 2023-07-14T13:32:28.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.080+0000 7fe31d39d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3180aeb40 0x7fe31815b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:28.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.080+0000 7fe31d39d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe3180aef10 0x7fe318149e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:28.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.080+0000 7fe31d39d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe318159440 0x7fe31806b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:28.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.080+0000 7fe31d39d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31806f7e0 con 0x7fe3180aeb40 2023-07-14T13:32:28.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.080+0000 7fe31d39d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31815bd70 con 0x7fe318159440 2023-07-14T13:32:28.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.080+0000 7fe31d39d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31815b7f0 con 0x7fe3180aef10 2023-07-14T13:32:28.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.080+0000 7fe316ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3180aeb40 0x7fe31815b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:28.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.080+0000 7fe316ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3180aeb40 0x7fe31815b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57938/0 (socket says 172.21.15.5:57938) 2023-07-14T13:32:28.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.080+0000 7fe316ffd640 1 -- 172.21.15.5:0/3311013904 learned_addr learned my addr 172.21.15.5:0/3311013904 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:28.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.080+0000 7fe3177fe640 1 --2- 172.21.15.5:0/3311013904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe318159440 0x7fe31806b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:28.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.080+0000 7fe30ffff640 1 --2- 172.21.15.5:0/3311013904 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe3180aef10 0x7fe318149e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:28.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.084+0000 7fe316ffd640 1 -- 172.21.15.5:0/3311013904 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe3180aef10 msgr2=0x7fe318149e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:28.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.084+0000 7fe316ffd640 1 --2- 172.21.15.5:0/3311013904 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe3180aef10 0x7fe318149e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:28.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.084+0000 7fe316ffd640 1 -- 172.21.15.5:0/3311013904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe318159440 msgr2=0x7fe31806b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:28.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.084+0000 7fe316ffd640 1 --2- 172.21.15.5:0/3311013904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe318159440 0x7fe31806b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:28.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.084+0000 7fe316ffd640 1 -- 172.21.15.5:0/3311013904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe310009a70 con 0x7fe3180aeb40 2023-07-14T13:32:28.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.084+0000 7fe30ffff640 1 --2- 172.21.15.5:0/3311013904 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe3180aef10 0x7fe318149e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:28.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.084+0000 7fe316ffd640 1 --2- 172.21.15.5:0/3311013904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3180aeb40 0x7fe31815b2b0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7fe30800e930 tx=0x7fe30800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:28.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.084+0000 7fe30f7fe640 1 -- 172.21.15.5:0/3311013904 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe308009690 con 0x7fe3180aeb40 2023-07-14T13:32:28.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.084+0000 7fe30f7fe640 1 -- 172.21.15.5:0/3311013904 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30800ca00 con 0x7fe3180aeb40 2023-07-14T13:32:28.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.084+0000 7fe31d39d640 1 -- 172.21.15.5:0/3311013904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe31815ba90 con 0x7fe3180aeb40 2023-07-14T13:32:28.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.084+0000 7fe30f7fe640 1 -- 172.21.15.5:0/3311013904 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30800cd70 con 0x7fe3180aeb40 2023-07-14T13:32:28.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.084+0000 7fe31d39d640 1 -- 172.21.15.5:0/3311013904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe31806f470 con 0x7fe3180aeb40 2023-07-14T13:32:28.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.084+0000 7fe31d39d640 1 -- 172.21.15.5:0/3311013904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3180678d0 con 0x7fe3180aeb40 2023-07-14T13:32:28.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.084+0000 7fe30f7fe640 1 -- 172.21.15.5:0/3311013904 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe308013470 con 0x7fe3180aeb40 2023-07-14T13:32:28.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.084+0000 7fe30f7fe640 1 --2- 172.21.15.5:0/3311013904 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fe2f80663a0 0x7fe2f8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:28.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.084+0000 7fe30f7fe640 1 -- 172.21.15.5:0/3311013904 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5238+0+0 (secure 0 0 0) 0x7fe308084150 con 0x7fe3180aeb40 2023-07-14T13:32:28.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.088+0000 7fe30ffff640 1 --2- 172.21.15.5:0/3311013904 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fe2f80663a0 0x7fe2f8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:28.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.088+0000 7fe30ffff640 1 --2- 172.21.15.5:0/3311013904 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fe2f80663a0 0x7fe2f8068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe3180c3600 tx=0x7fe300007c40 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:28.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.088+0000 7fe30f7fe640 1 -- 172.21.15.5:0/3311013904 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fe3080518e0 con 0x7fe3180aeb40 2023-07-14T13:32:28.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:28.248+0000 7fe31d39d640 1 -- 172.21.15.5:0/3311013904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe318156730 con 0x7fe3180aeb40 2023-07-14T13:32:29.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-07-14T13:32:29.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.208+0000 7fe30f7fe640 1 -- 172.21.15.5:0/3311013904 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v188) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe308054f00 con 0x7fe3180aeb40 2023-07-14T13:32:29.210 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-07-14T13:32:29.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.216+0000 7fe31d39d640 1 -- 172.21.15.5:0/3311013904 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fe2f80663a0 msgr2=0x7fe2f8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:29.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.216+0000 7fe31d39d640 1 --2- 172.21.15.5:0/3311013904 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fe2f80663a0 0x7fe2f8068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe3180c3600 tx=0x7fe300007c40 comp rx=0 tx=0).stop 2023-07-14T13:32:29.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.216+0000 7fe31d39d640 1 -- 172.21.15.5:0/3311013904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3180aeb40 msgr2=0x7fe31815b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:29.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.216+0000 7fe31d39d640 1 --2- 172.21.15.5:0/3311013904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3180aeb40 0x7fe31815b2b0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7fe30800e930 tx=0x7fe30800edf0 comp rx=0 tx=0).stop 2023-07-14T13:32:29.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.216+0000 7fe31d39d640 1 -- 172.21.15.5:0/3311013904 shutdown_connections 2023-07-14T13:32:29.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.216+0000 7fe31d39d640 1 --2- 172.21.15.5:0/3311013904 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fe2f80663a0 0x7fe2f8068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:29.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.216+0000 7fe31d39d640 1 --2- 172.21.15.5:0/3311013904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe318159440 0x7fe31806b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:29.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.216+0000 7fe31d39d640 1 --2- 172.21.15.5:0/3311013904 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe3180aef10 0x7fe318149e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:29.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.216+0000 7fe31d39d640 1 --2- 172.21.15.5:0/3311013904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3180aeb40 0x7fe31815b2b0 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:29.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.216+0000 7fe31d39d640 1 -- 172.21.15.5:0/3311013904 >> 172.21.15.5:0/3311013904 conn(0x7fe3180cde90 msgr2=0x7fe3180c3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:29.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.216+0000 7fe31d39d640 1 -- 172.21.15.5:0/3311013904 shutdown_connections 2023-07-14T13:32:29.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.216+0000 7fe31d39d640 1 -- 172.21.15.5:0/3311013904 wait complete. 2023-07-14T13:32:29.242 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-14T13:32:29.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.396+0000 7f99af5c5640 1 Processor -- start 2023-07-14T13:32:29.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.396+0000 7f99af5c5640 1 -- start start 2023-07-14T13:32:29.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.396+0000 7f99af5c5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f99a80cb360 0x7f99a815df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:29.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.396+0000 7f99af5c5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a80b38d0 0x7f99a8070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:29.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.396+0000 7f99af5c5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a80cc900 con 0x7f99a80cd490 2023-07-14T13:32:29.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.396+0000 7f99af5c5640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a80ccbe0 con 0x7f99a80cb360 2023-07-14T13:32:29.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.396+0000 7f99af5c5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a815d780 con 0x7f99a80b38d0 2023-07-14T13:32:29.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.396+0000 7f99acb60640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a80b38d0 0x7f99a8070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:29.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.396+0000 7f99acb60640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a80b38d0 0x7f99a8070920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:48470/0 (socket says 172.21.15.5:48470) 2023-07-14T13:32:29.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.396+0000 7f99acb60640 1 -- 172.21.15.5:0/3498279240 learned_addr learned my addr 172.21.15.5:0/3498279240 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:29.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.396+0000 7f99ad361640 1 --2- 172.21.15.5:0/3498279240 >> v2:172.21.15.154:3300/0 conn(0x7f99a80cb360 0x7f99a815df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:29.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.400+0000 7f99ad361640 1 -- 172.21.15.5:0/3498279240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a80b38d0 msgr2=0x7f99a8070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.400+0000 7f99ad361640 1 --2- 172.21.15.5:0/3498279240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a80b38d0 0x7f99a8070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.400+0000 7f99ad361640 1 -- 172.21.15.5:0/3498279240 >> v1:172.21.15.154:6789/0 conn(0x7f99a80cd490 legacy=0x7f99a80c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.400+0000 7f99ad361640 1 -- 172.21.15.5:0/3498279240 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a815da60 con 0x7f99a80cb360 2023-07-14T13:32:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.400+0000 7f99acb60640 1 --2- 172.21.15.5:0/3498279240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a80b38d0 0x7f99a8070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:32:29.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.400+0000 7f99ad361640 1 --2- 172.21.15.5:0/3498279240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80cb360 0x7f99a815df80 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f99a40097c0 tx=0x7f99a401ce10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f3bd5c365b09fc4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.400+0000 7f999ffff640 1 -- 172.21.15.5:0/3498279240 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a40ab610 con 0x7f99a80cb360 2023-07-14T13:32:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.400+0000 7f999ffff640 1 -- 172.21.15.5:0/3498279240 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a40ab770 con 0x7f99a80cb360 2023-07-14T13:32:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.400+0000 7f999ffff640 1 -- 172.21.15.5:0/3498279240 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a40abb00 con 0x7f99a80cb360 2023-07-14T13:32:29.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.404+0000 7f99af5c5640 1 -- 172.21.15.5:0/3498279240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80cb360 msgr2=0x7f99a815df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:29.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.404+0000 7f99af5c5640 1 --2- 172.21.15.5:0/3498279240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80cb360 0x7f99a815df80 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f99a40097c0 tx=0x7f99a401ce10 comp rx=0 tx=0).stop 2023-07-14T13:32:29.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.404+0000 7f99af5c5640 1 -- 172.21.15.5:0/3498279240 shutdown_connections 2023-07-14T13:32:29.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.404+0000 7f99af5c5640 1 --2- 172.21.15.5:0/3498279240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a80b38d0 0x7f99a8070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:29.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.404+0000 7f99af5c5640 1 --2- 172.21.15.5:0/3498279240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80cb360 0x7f99a815df80 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:29.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.404+0000 7f99af5c5640 1 -- 172.21.15.5:0/3498279240 >> 172.21.15.5:0/3498279240 conn(0x7f99a80afac0 msgr2=0x7f99a80afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:29.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.404+0000 7f99af5c5640 1 -- 172.21.15.5:0/3498279240 shutdown_connections 2023-07-14T13:32:29.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.404+0000 7f99af5c5640 1 -- 172.21.15.5:0/3498279240 wait complete. 2023-07-14T13:32:29.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.404+0000 7f99af5c5640 1 Processor -- start 2023-07-14T13:32:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.404+0000 7f99af5c5640 1 -- start start 2023-07-14T13:32:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.404+0000 7f99af5c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80b38d0 0x7f99a814c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.404+0000 7f99af5c5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a80cb360 0x7f99a813b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.404+0000 7f99af5c5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a80cd490 0x7f99a80c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.404+0000 7f99af5c5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a814cd10 con 0x7f99a80cb360 2023-07-14T13:32:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.404+0000 7f99af5c5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a806c1c0 con 0x7f99a80b38d0 2023-07-14T13:32:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.404+0000 7f99af5c5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a806c4a0 con 0x7f99a80cd490 2023-07-14T13:32:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.404+0000 7f99acb60640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a80cb360 0x7f99a813b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.404+0000 7f99acb60640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a80cb360 0x7f99a813b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39824/0 (socket says 172.21.15.5:39824) 2023-07-14T13:32:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.404+0000 7f99acb60640 1 -- 172.21.15.5:0/2424519803 learned_addr learned my addr 172.21.15.5:0/2424519803 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.404+0000 7f99adb62640 1 --2- 172.21.15.5:0/2424519803 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a80cd490 0x7f99a80c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.404+0000 7f99ad361640 1 --2- 172.21.15.5:0/2424519803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80b38d0 0x7f99a814c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.404+0000 7f99acb60640 1 -- 172.21.15.5:0/2424519803 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a80cd490 msgr2=0x7f99a80c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.404+0000 7f99acb60640 1 --2- 172.21.15.5:0/2424519803 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a80cd490 0x7f99a80c9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.404+0000 7f99acb60640 1 -- 172.21.15.5:0/2424519803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80b38d0 msgr2=0x7f99a814c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.404+0000 7f99acb60640 1 --2- 172.21.15.5:0/2424519803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80b38d0 0x7f99a814c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.404+0000 7f99acb60640 1 -- 172.21.15.5:0/2424519803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99980094d0 con 0x7f99a80cb360 2023-07-14T13:32:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.408+0000 7f99acb60640 1 --2- 172.21.15.5:0/2424519803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a80cb360 0x7f99a813b510 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f999800e930 tx=0x7f999800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:29.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.408+0000 7f999dffb640 1 -- 172.21.15.5:0/2424519803 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999800ca00 con 0x7f99a80cb360 2023-07-14T13:32:29.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.408+0000 7f999dffb640 1 -- 172.21.15.5:0/2424519803 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999800cb60 con 0x7f99a80cb360 2023-07-14T13:32:29.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.408+0000 7f999dffb640 1 -- 172.21.15.5:0/2424519803 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9998013470 con 0x7f99a80cb360 2023-07-14T13:32:29.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.408+0000 7f99af5c5640 1 -- 172.21.15.5:0/2424519803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a4009420 con 0x7f99a80cb360 2023-07-14T13:32:29.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.408+0000 7f99af5c5640 1 -- 172.21.15.5:0/2424519803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a806ca60 con 0x7f99a80cb360 2023-07-14T13:32:29.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.408+0000 7f99af5c5640 1 -- 172.21.15.5:0/2424519803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a80678d0 con 0x7f99a80cb360 2023-07-14T13:32:29.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.412+0000 7f999dffb640 1 -- 172.21.15.5:0/2424519803 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f99980135d0 con 0x7f99a80cb360 2023-07-14T13:32:29.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.412+0000 7f999dffb640 1 --2- 172.21.15.5:0/2424519803 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f998c0663a0 0x7f998c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:29.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.412+0000 7f999dffb640 1 -- 172.21.15.5:0/2424519803 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5608+0+0 (secure 0 0 0) 0x7f9998084590 con 0x7f99a80cb360 2023-07-14T13:32:29.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.412+0000 7f99ad361640 1 --2- 172.21.15.5:0/2424519803 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f998c0663a0 0x7f998c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:29.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.412+0000 7f99ad361640 1 --2- 172.21.15.5:0/2424519803 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f998c0663a0 0x7f998c068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f99a40af000 tx=0x7f99a4004740 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:29.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.416+0000 7f999dffb640 1 -- 172.21.15.5:0/2424519803 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f9998051ce0 con 0x7f99a80cb360 2023-07-14T13:32:29.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:29.568+0000 7f99af5c5640 1 -- 172.21.15.5:0/2424519803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f99a80cd270 con 0x7f99a80cb360 2023-07-14T13:32:30.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.220+0000 7f999dffb640 1 -- 172.21.15.5:0/2424519803 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v189) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9998055300 con 0x7f99a80cb360 2023-07-14T13:32:30.221 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-07-14T13:32:30.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.224+0000 7f99af5c5640 1 -- 172.21.15.5:0/2424519803 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f998c0663a0 msgr2=0x7f998c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:30.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.224+0000 7f99af5c5640 1 --2- 172.21.15.5:0/2424519803 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f998c0663a0 0x7f998c068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f99a40af000 tx=0x7f99a4004740 comp rx=0 tx=0).stop 2023-07-14T13:32:30.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.224+0000 7f99af5c5640 1 -- 172.21.15.5:0/2424519803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a80cb360 msgr2=0x7f99a813b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:30.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.224+0000 7f99af5c5640 1 --2- 172.21.15.5:0/2424519803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a80cb360 0x7f99a813b510 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f999800e930 tx=0x7f999800edf0 comp rx=0 tx=0).stop 2023-07-14T13:32:30.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.236+0000 7f99af5c5640 1 -- 172.21.15.5:0/2424519803 shutdown_connections 2023-07-14T13:32:30.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.236+0000 7f99af5c5640 1 --2- 172.21.15.5:0/2424519803 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f998c0663a0 0x7f998c068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:30.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.236+0000 7f99af5c5640 1 --2- 172.21.15.5:0/2424519803 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a80cd490 0x7f99a80c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:30.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.236+0000 7f99af5c5640 1 --2- 172.21.15.5:0/2424519803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a80cb360 0x7f99a813b510 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:30.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.236+0000 7f99af5c5640 1 --2- 172.21.15.5:0/2424519803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80b38d0 0x7f99a814c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:30.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.236+0000 7f99af5c5640 1 -- 172.21.15.5:0/2424519803 >> 172.21.15.5:0/2424519803 conn(0x7f99a80afac0 msgr2=0x7f99a80c3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:30.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.236+0000 7f99af5c5640 1 -- 172.21.15.5:0/2424519803 shutdown_connections 2023-07-14T13:32:30.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.236+0000 7f99af5c5640 1 -- 172.21.15.5:0/2424519803 wait complete. 2023-07-14T13:32:30.266 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-14T13:32:30.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.416+0000 7fc482b67640 1 Processor -- start 2023-07-14T13:32:30.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.416+0000 7fc482b67640 1 -- start start 2023-07-14T13:32:30.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.416+0000 7fc482b67640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc47c15bba0 0x7fc47c0c4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:30.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.416+0000 7fc482b67640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc47c0c2d30 0x7fc47c0acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:30.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.416+0000 7fc482b67640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc47c0ad280 0x7fc47c0ab890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:30.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.416+0000 7fc482b67640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47c0ad700 con 0x7fc47c0ad280 2023-07-14T13:32:30.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.416+0000 7fc482b67640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47c15bf70 con 0x7fc47c0c2d30 2023-07-14T13:32:30.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.416+0000 7fc482b67640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c1600e0 con 0x7fc47c15bba0 2023-07-14T13:32:30.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.416+0000 7fc481104640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc47c0ad280 0x7fc47c0ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:30.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.416+0000 7fc481104640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc47c0ad280 0x7fc47c0ab890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39826/0 (socket says 172.21.15.5:39826) 2023-07-14T13:32:30.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.416+0000 7fc481104640 1 -- 172.21.15.5:0/2518953197 learned_addr learned my addr 172.21.15.5:0/2518953197 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:30.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.416+0000 7fc480903640 1 --2- 172.21.15.5:0/2518953197 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc47c15bba0 0x7fc47c0c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:30.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.416+0000 7fc47bfff640 1 --2- 172.21.15.5:0/2518953197 >> v2:172.21.15.154:3300/0 conn(0x7fc47c0c2d30 0x7fc47c0acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:30.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.416+0000 7fc481104640 1 -- 172.21.15.5:0/2518953197 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc47c15bba0 msgr2=0x7fc47c0c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:30.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.416+0000 7fc481104640 1 --2- 172.21.15.5:0/2518953197 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc47c15bba0 0x7fc47c0c4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:30.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.416+0000 7fc481104640 1 -- 172.21.15.5:0/2518953197 >> v2:172.21.15.154:3300/0 conn(0x7fc47c0c2d30 msgr2=0x7fc47c0acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:30.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.416+0000 7fc481104640 1 --2- 172.21.15.5:0/2518953197 >> v2:172.21.15.154:3300/0 conn(0x7fc47c0c2d30 0x7fc47c0acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:30.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.416+0000 7fc481104640 1 -- 172.21.15.5:0/2518953197 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c0c4d00 con 0x7fc47c0ad280 2023-07-14T13:32:30.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.420+0000 7fc481104640 1 --2- 172.21.15.5:0/2518953197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc47c0ad280 0x7fc47c0ab890 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7fc47c06ed50 tx=0x7fc47401c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216c799bab965f08 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:30.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.420+0000 7fc47b7fe640 1 -- 172.21.15.5:0/2518953197 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4740a6450 con 0x7fc47c0ad280 2023-07-14T13:32:30.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.420+0000 7fc47b7fe640 1 -- 172.21.15.5:0/2518953197 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4740a65b0 con 0x7fc47c0ad280 2023-07-14T13:32:30.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.420+0000 7fc47b7fe640 1 -- 172.21.15.5:0/2518953197 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4740a6940 con 0x7fc47c0ad280 2023-07-14T13:32:30.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.420+0000 7fc482b67640 1 -- 172.21.15.5:0/2518953197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc47c0ad280 msgr2=0x7fc47c0ab890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:30.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.420+0000 7fc482b67640 1 --2- 172.21.15.5:0/2518953197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc47c0ad280 0x7fc47c0ab890 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7fc47c06ed50 tx=0x7fc47401c5c0 comp rx=0 tx=0).stop 2023-07-14T13:32:30.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.420+0000 7fc482b67640 1 -- 172.21.15.5:0/2518953197 shutdown_connections 2023-07-14T13:32:30.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.420+0000 7fc482b67640 1 --2- 172.21.15.5:0/2518953197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc47c0ad280 0x7fc47c0ab890 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:30.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.420+0000 7fc482b67640 1 --2- 172.21.15.5:0/2518953197 >> v2:172.21.15.154:3300/0 conn(0x7fc47c0c2d30 0x7fc47c0acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:30.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.420+0000 7fc482b67640 1 --2- 172.21.15.5:0/2518953197 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc47c15bba0 0x7fc47c0c4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:30.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.420+0000 7fc482b67640 1 -- 172.21.15.5:0/2518953197 >> 172.21.15.5:0/2518953197 conn(0x7fc47c0cde90 msgr2=0x7fc47c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:30.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.420+0000 7fc482b67640 1 -- 172.21.15.5:0/2518953197 shutdown_connections 2023-07-14T13:32:30.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.420+0000 7fc482b67640 1 -- 172.21.15.5:0/2518953197 wait complete. 2023-07-14T13:32:30.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.424+0000 7fc482b67640 1 Processor -- start 2023-07-14T13:32:30.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.424+0000 7fc482b67640 1 -- start start 2023-07-14T13:32:30.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.424+0000 7fc482b67640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc47c0ad280 0x7fc47c13b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:30.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.424+0000 7fc482b67640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc47c0c2d30 0x7fc47c1547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:30.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.424+0000 7fc482b67640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc47c15bba0 0x7fc47c154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:30.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.424+0000 7fc482b67640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c13ebd0 con 0x7fc47c15bba0 2023-07-14T13:32:30.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.424+0000 7fc482b67640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c13e8f0 con 0x7fc47c0c2d30 2023-07-14T13:32:30.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.424+0000 7fc482b67640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c13bd40 con 0x7fc47c0ad280 2023-07-14T13:32:30.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.424+0000 7fc481104640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc47c15bba0 0x7fc47c154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:30.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.424+0000 7fc481104640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc47c15bba0 0x7fc47c154ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39840/0 (socket says 172.21.15.5:39840) 2023-07-14T13:32:30.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.424+0000 7fc481104640 1 -- 172.21.15.5:0/3606299738 learned_addr learned my addr 172.21.15.5:0/3606299738 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:30.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.424+0000 7fc47bfff640 1 --2- 172.21.15.5:0/3606299738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc47c0c2d30 0x7fc47c1547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:30.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.424+0000 7fc481104640 1 -- 172.21.15.5:0/3606299738 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc47c0ad280 msgr2=0x7fc47c13b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:30.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.424+0000 7fc480903640 1 --2- 172.21.15.5:0/3606299738 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc47c0ad280 0x7fc47c13b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:30.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.424+0000 7fc481104640 1 --2- 172.21.15.5:0/3606299738 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc47c0ad280 0x7fc47c13b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:30.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.424+0000 7fc481104640 1 -- 172.21.15.5:0/3606299738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc47c0c2d30 msgr2=0x7fc47c1547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:30.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.424+0000 7fc481104640 1 --2- 172.21.15.5:0/3606299738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc47c0c2d30 0x7fc47c1547a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:30.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.424+0000 7fc481104640 1 -- 172.21.15.5:0/3606299738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc474009b30 con 0x7fc47c15bba0 2023-07-14T13:32:30.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.424+0000 7fc47bfff640 1 --2- 172.21.15.5:0/3606299738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc47c0c2d30 0x7fc47c1547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:32:30.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.424+0000 7fc480903640 1 --2- 172.21.15.5:0/3606299738 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc47c0ad280 0x7fc47c13b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:32:30.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.424+0000 7fc481104640 1 --2- 172.21.15.5:0/3606299738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc47c15bba0 0x7fc47c154ce0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7fc4740ab040 tx=0x7fc474019360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:30.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.424+0000 7fc4797fa640 1 -- 172.21.15.5:0/3606299738 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4740a6450 con 0x7fc47c15bba0 2023-07-14T13:32:30.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.424+0000 7fc4797fa640 1 -- 172.21.15.5:0/3606299738 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4740b5070 con 0x7fc47c15bba0 2023-07-14T13:32:30.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.424+0000 7fc4797fa640 1 -- 172.21.15.5:0/3606299738 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4740a7890 con 0x7fc47c15bba0 2023-07-14T13:32:30.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.424+0000 7fc482b67640 1 -- 172.21.15.5:0/3606299738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc47c13c020 con 0x7fc47c15bba0 2023-07-14T13:32:30.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.424+0000 7fc482b67640 1 -- 172.21.15.5:0/3606299738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc47c13dc30 con 0x7fc47c15bba0 2023-07-14T13:32:30.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.424+0000 7fc482b67640 1 -- 172.21.15.5:0/3606299738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc47c0678d0 con 0x7fc47c15bba0 2023-07-14T13:32:30.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.428+0000 7fc4797fa640 1 -- 172.21.15.5:0/3606299738 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc4740a79f0 con 0x7fc47c15bba0 2023-07-14T13:32:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.428+0000 7fc4797fa640 1 --2- 172.21.15.5:0/3606299738 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fc4600663a0 0x7fc460068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.428+0000 7fc4797fa640 1 -- 172.21.15.5:0/3606299738 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5990+0+0 (secure 0 0 0) 0x7fc47411e080 con 0x7fc47c15bba0 2023-07-14T13:32:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.428+0000 7fc480903640 1 --2- 172.21.15.5:0/3606299738 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fc4600663a0 0x7fc460068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.428+0000 7fc480903640 1 --2- 172.21.15.5:0/3606299738 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fc4600663a0 0x7fc460068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc470009a40 tx=0x7fc470008040 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.432+0000 7fc4797fa640 1 -- 172.21.15.5:0/3606299738 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc4740eb4a0 con 0x7fc47c15bba0 2023-07-14T13:32:30.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:30.616+0000 7fc482b67640 1 -- 172.21.15.5:0/3606299738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc47c13c4d0 con 0x7fc47c15bba0 2023-07-14T13:32:31.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.220+0000 7fc4797fa640 1 -- 172.21.15.5:0/3606299738 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v88) v1 ==== 174+0+0 (secure 0 0 0) 0x7fc4740b70c0 con 0x7fc47c15bba0 2023-07-14T13:32:31.221 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 23 and data pool 24 2023-07-14T13:32:31.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.224+0000 7fc482b67640 1 -- 172.21.15.5:0/3606299738 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fc4600663a0 msgr2=0x7fc460068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:31.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.224+0000 7fc482b67640 1 --2- 172.21.15.5:0/3606299738 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fc4600663a0 0x7fc460068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc470009a40 tx=0x7fc470008040 comp rx=0 tx=0).stop 2023-07-14T13:32:31.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.224+0000 7fc482b67640 1 -- 172.21.15.5:0/3606299738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc47c15bba0 msgr2=0x7fc47c154ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:31.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.224+0000 7fc482b67640 1 --2- 172.21.15.5:0/3606299738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc47c15bba0 0x7fc47c154ce0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7fc4740ab040 tx=0x7fc474019360 comp rx=0 tx=0).stop 2023-07-14T13:32:31.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.228+0000 7fc482b67640 1 -- 172.21.15.5:0/3606299738 shutdown_connections 2023-07-14T13:32:31.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.228+0000 7fc482b67640 1 --2- 172.21.15.5:0/3606299738 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fc4600663a0 0x7fc460068850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.228+0000 7fc482b67640 1 --2- 172.21.15.5:0/3606299738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc47c15bba0 0x7fc47c154ce0 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.228+0000 7fc482b67640 1 --2- 172.21.15.5:0/3606299738 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc47c0c2d30 0x7fc47c1547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.228+0000 7fc482b67640 1 --2- 172.21.15.5:0/3606299738 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc47c0ad280 0x7fc47c13b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.228+0000 7fc482b67640 1 -- 172.21.15.5:0/3606299738 >> 172.21.15.5:0/3606299738 conn(0x7fc47c0cde90 msgr2=0x7fc47c06ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.232+0000 7fc482b67640 1 -- 172.21.15.5:0/3606299738 shutdown_connections 2023-07-14T13:32:31.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.232+0000 7fc482b67640 1 -- 172.21.15.5:0/3606299738 wait complete. 2023-07-14T13:32:31.256 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:32:31.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.400+0000 7f23b5b9d640 1 Processor -- start 2023-07-14T13:32:31.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.400+0000 7f23b5b9d640 1 -- start start 2023-07-14T13:32:31.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23b5b9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b006b1e0 0x7f23b00c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23b5b9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f23b00c21f0 0x7f23b00cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23b5b9d640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b00cac70 con 0x7f23b0070b70 2023-07-14T13:32:31.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23b5b9d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b00ca060 con 0x7f23b00c21f0 2023-07-14T13:32:31.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23b5b9d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b00ca340 con 0x7f23b006b1e0 2023-07-14T13:32:31.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23af7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f23b0070b70 0x7f23b0070f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57572/0 (socket says 172.21.15.5:57572) 2023-07-14T13:32:31.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23af7fe640 1 -- 172.21.15.5:0/2601791242 learned_addr learned my addr 172.21.15.5:0/2601791242 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:31.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23affff640 1 --2- 172.21.15.5:0/2601791242 >> v2:172.21.15.154:3300/0 conn(0x7f23b00c21f0 0x7f23b00cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23aeffd640 1 --2- 172.21.15.5:0/2601791242 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b006b1e0 0x7f23b00c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23ae7fc640 1 -- 172.21.15.5:0/2601791242 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2986108045 0 0) 0x7f23b00cac70 con 0x7f23b0070b70 2023-07-14T13:32:31.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23ae7fc640 1 -- 172.21.15.5:0/2601791242 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2398003530 con 0x7f23b0070b70 2023-07-14T13:32:31.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23ae7fc640 1 -- 172.21.15.5:0/2601791242 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 99396330 0 0) 0x7f2398003530 con 0x7f23b0070b70 2023-07-14T13:32:31.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23ae7fc640 1 -- 172.21.15.5:0/2601791242 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b006b1e0 msgr2=0x7f23b00c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:31.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23ae7fc640 1 --2- 172.21.15.5:0/2601791242 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b006b1e0 0x7f23b00c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23ae7fc640 1 -- 172.21.15.5:0/2601791242 >> v2:172.21.15.154:3300/0 conn(0x7f23b00c21f0 msgr2=0x7f23b00cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:31.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23ae7fc640 1 --2- 172.21.15.5:0/2601791242 >> v2:172.21.15.154:3300/0 conn(0x7f23b00c21f0 0x7f23b00cb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23ae7fc640 1 -- 172.21.15.5:0/2601791242 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b00ca620 con 0x7f23b0070b70 2023-07-14T13:32:31.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23ae7fc640 1 -- 172.21.15.5:0/2601791242 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f23a0001680 con 0x7f23b0070b70 2023-07-14T13:32:31.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23ae7fc640 1 -- 172.21.15.5:0/2601791242 >> v1:172.21.15.5:6789/0 conn(0x7f23b0070b70 legacy=0x7f23b0070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:31.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23ae7fc640 1 --2- 172.21.15.5:0/2601791242 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2398003980 0x7f2398003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23ae7fc640 1 --2- 172.21.15.5:0/2601791242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2398004360 0x7f2398004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23ae7fc640 1 --2- 172.21.15.5:0/2601791242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2398004f40 0x7f239800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23ae7fc640 1 -- 172.21.15.5:0/2601791242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b00ca060 con 0x7f2398004f40 2023-07-14T13:32:31.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23ae7fc640 1 -- 172.21.15.5:0/2601791242 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b00ca340 con 0x7f2398004360 2023-07-14T13:32:31.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23ae7fc640 1 -- 172.21.15.5:0/2601791242 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239800bed0 con 0x7f2398003980 2023-07-14T13:32:31.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23affff640 1 --2- 172.21.15.5:0/2601791242 >> v2:172.21.15.154:3300/0 conn(0x7f23b00c21f0 0x7f23b00cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:32:31.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23aeffd640 1 --2- 172.21.15.5:0/2601791242 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b006b1e0 0x7f23b00c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:32:31.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23af7fe640 1 --2- 172.21.15.5:0/2601791242 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2398003980 0x7f2398003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23affff640 1 --2- 172.21.15.5:0/2601791242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2398004f40 0x7f239800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23aeffd640 1 --2- 172.21.15.5:0/2601791242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2398004360 0x7f2398004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23affff640 1 -- 172.21.15.5:0/2601791242 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2398003980 msgr2=0x7f2398003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:31.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23affff640 1 --2- 172.21.15.5:0/2601791242 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2398003980 0x7f2398003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23affff640 1 -- 172.21.15.5:0/2601791242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2398004360 msgr2=0x7f2398004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:31.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23affff640 1 --2- 172.21.15.5:0/2601791242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2398004360 0x7f2398004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.404+0000 7f23affff640 1 -- 172.21.15.5:0/2601791242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2398003530 con 0x7f2398004f40 2023-07-14T13:32:31.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.408+0000 7f23affff640 1 --2- 172.21.15.5:0/2601791242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2398004f40 0x7f239800b990 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f23b00c4cb0 tx=0x7f23a801cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56dc6205e1dec76e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:31.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.408+0000 7f23ae7fc640 1 -- 172.21.15.5:0/2601791242 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a80a5dd0 con 0x7f2398004f40 2023-07-14T13:32:31.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.408+0000 7f23ae7fc640 1 -- 172.21.15.5:0/2601791242 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a800f040 con 0x7f2398004f40 2023-07-14T13:32:31.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.408+0000 7f23ae7fc640 1 -- 172.21.15.5:0/2601791242 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a80ad680 con 0x7f2398004f40 2023-07-14T13:32:31.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.408+0000 7f23b5b9d640 1 -- 172.21.15.5:0/2601791242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2398004f40 msgr2=0x7f239800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:31.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.408+0000 7f23b5b9d640 1 --2- 172.21.15.5:0/2601791242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2398004f40 0x7f239800b990 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f23b00c4cb0 tx=0x7f23a801cdc0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.408+0000 7f23affff640 1 -- 172.21.15.5:0/2601791242 reap_dead start 2023-07-14T13:32:31.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.408+0000 7f23b5b9d640 1 -- 172.21.15.5:0/2601791242 shutdown_connections 2023-07-14T13:32:31.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.408+0000 7f23b5b9d640 1 -- 172.21.15.5:0/2601791242 >> 172.21.15.5:0/2601791242 conn(0x7f23b00afcf0 msgr2=0x7f23b00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:31.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.408+0000 7f23b5b9d640 1 -- 172.21.15.5:0/2601791242 shutdown_connections 2023-07-14T13:32:31.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.408+0000 7f23b5b9d640 1 -- 172.21.15.5:0/2601791242 wait complete. 2023-07-14T13:32:31.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.408+0000 7f23b5b9d640 1 Processor -- start 2023-07-14T13:32:31.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.412+0000 7f23b5b9d640 1 -- start start 2023-07-14T13:32:31.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.412+0000 7f23b5b9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2398004f40 0x7f23b00c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.412+0000 7f23b5b9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b01ed470 0x7f23b01579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.412+0000 7f23b5b9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23b01581b0 0x7f23b01e0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.412+0000 7f23b5b9d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b00c7e60 con 0x7f2398004f40 2023-07-14T13:32:31.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.412+0000 7f23b5b9d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b00c8070 con 0x7f23b01581b0 2023-07-14T13:32:31.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.412+0000 7f23b5b9d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b01df070 con 0x7f23b01ed470 2023-07-14T13:32:31.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.412+0000 7f23af7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2398004f40 0x7f23b00c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.412+0000 7f23af7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2398004f40 0x7f23b00c7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39860/0 (socket says 172.21.15.5:39860) 2023-07-14T13:32:31.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.412+0000 7f23af7fe640 1 -- 172.21.15.5:0/3593179053 learned_addr learned my addr 172.21.15.5:0/3593179053 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:31.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.412+0000 7f23aeffd640 1 --2- 172.21.15.5:0/3593179053 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b01ed470 0x7f23b01579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.412+0000 7f23affff640 1 --2- 172.21.15.5:0/3593179053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23b01581b0 0x7f23b01e0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.412+0000 7f23af7fe640 1 -- 172.21.15.5:0/3593179053 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b01ed470 msgr2=0x7f23b01579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:31.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.412+0000 7f23af7fe640 1 --2- 172.21.15.5:0/3593179053 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b01ed470 0x7f23b01579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.412+0000 7f23af7fe640 1 -- 172.21.15.5:0/3593179053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23b01581b0 msgr2=0x7f23b01e0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:31.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.412+0000 7f23af7fe640 1 --2- 172.21.15.5:0/3593179053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23b01581b0 0x7f23b01e0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.412+0000 7f23af7fe640 1 -- 172.21.15.5:0/3593179053 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b01df310 con 0x7f2398004f40 2023-07-14T13:32:31.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.412+0000 7f23aeffd640 1 --2- 172.21.15.5:0/3593179053 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b01ed470 0x7f23b01579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:31.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.412+0000 7f23af7fe640 1 --2- 172.21.15.5:0/3593179053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2398004f40 0x7f23b00c7920 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f23a00124f0 tx=0x7f23a00129b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:31.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.412+0000 7f2397fff640 1 -- 172.21.15.5:0/3593179053 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a0014810 con 0x7f2398004f40 2023-07-14T13:32:31.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.412+0000 7f2397fff640 1 -- 172.21.15.5:0/3593179053 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a00149b0 con 0x7f2398004f40 2023-07-14T13:32:31.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.412+0000 7f2397fff640 1 -- 172.21.15.5:0/3593179053 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a0014d60 con 0x7f2398004f40 2023-07-14T13:32:31.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.412+0000 7f23b5b9d640 1 -- 172.21.15.5:0/3593179053 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b01df5f0 con 0x7f2398004f40 2023-07-14T13:32:31.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.412+0000 7f23b5b9d640 1 -- 172.21.15.5:0/3593179053 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b0157f30 con 0x7f2398004f40 2023-07-14T13:32:31.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.412+0000 7f23b5b9d640 1 -- 172.21.15.5:0/3593179053 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b00678d0 con 0x7f2398004f40 2023-07-14T13:32:31.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.416+0000 7f2397fff640 1 -- 172.21.15.5:0/3593179053 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f23a0016480 con 0x7f2398004f40 2023-07-14T13:32:31.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.416+0000 7f2397fff640 1 --2- 172.21.15.5:0/3593179053 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f239c0663d0 0x7f239c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.416+0000 7f2397fff640 1 -- 172.21.15.5:0/3593179053 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f23a0087320 con 0x7f2398004f40 2023-07-14T13:32:31.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.416+0000 7f23aeffd640 1 --2- 172.21.15.5:0/3593179053 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f239c0663d0 0x7f239c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.416+0000 7f23aeffd640 1 --2- 172.21.15.5:0/3593179053 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f239c0663d0 0x7f239c068880 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f23b0158d70 tx=0x7f23a4008040 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:31.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.420+0000 7f2397fff640 1 -- 172.21.15.5:0/3593179053 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f23a0058100 con 0x7f2398004f40 2023-07-14T13:32:31.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.576+0000 7f23b5b9d640 1 -- 172.21.15.5:0/3593179053 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23b006f580 con 0x7f2398004f40 2023-07-14T13:32:31.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.580+0000 7f2397fff640 1 -- 172.21.15.5:0/3593179053 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+18302 (secure 0 0 0) 0x7f23a0057c90 con 0x7f2398004f40 2023-07-14T13:32:31.580 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:31.581 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":190,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:32:30.624282+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:32:28.300155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-14T13:32:29.622154+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:32:31.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.580+0000 7f23b5b9d640 1 -- 172.21.15.5:0/3593179053 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f239c0663d0 msgr2=0x7f239c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:31.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.580+0000 7f23b5b9d640 1 --2- 172.21.15.5:0/3593179053 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f239c0663d0 0x7f239c068880 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f23b0158d70 tx=0x7f23a4008040 comp rx=0 tx=0).stop 2023-07-14T13:32:31.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.580+0000 7f23b5b9d640 1 -- 172.21.15.5:0/3593179053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2398004f40 msgr2=0x7f23b00c7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:31.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.580+0000 7f23b5b9d640 1 --2- 172.21.15.5:0/3593179053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2398004f40 0x7f23b00c7920 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f23a00124f0 tx=0x7f23a00129b0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.580+0000 7f23b5b9d640 1 -- 172.21.15.5:0/3593179053 shutdown_connections 2023-07-14T13:32:31.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.580+0000 7f23b5b9d640 1 --2- 172.21.15.5:0/3593179053 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f239c0663d0 0x7f239c068880 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.580+0000 7f23b5b9d640 1 --2- 172.21.15.5:0/3593179053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23b01581b0 0x7f23b01e0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.580+0000 7f23b5b9d640 1 --2- 172.21.15.5:0/3593179053 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23b01ed470 0x7f23b01579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.580+0000 7f23b5b9d640 1 --2- 172.21.15.5:0/3593179053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2398004f40 0x7f23b00c7920 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.580+0000 7f23b5b9d640 1 -- 172.21.15.5:0/3593179053 >> 172.21.15.5:0/3593179053 conn(0x7f23b00afcf0 msgr2=0x7f23b00cea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:31.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.580+0000 7f23b5b9d640 1 -- 172.21.15.5:0/3593179053 shutdown_connections 2023-07-14T13:32:31.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.580+0000 7f23b5b9d640 1 -- 172.21.15.5:0/3593179053 wait complete. 2023-07-14T13:32:31.601 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:32:31.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.744+0000 7f2e75dad640 1 Processor -- start 2023-07-14T13:32:31.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.744+0000 7f2e75dad640 1 -- start start 2023-07-14T13:32:31.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.744+0000 7f2e75dad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e700d1800 0x7f2e700cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.744+0000 7f2e75dad640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2e700cf130 0x7f2e700cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.744+0000 7f2e75dad640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e700ccc10 con 0x7f2e7015bb40 2023-07-14T13:32:31.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.744+0000 7f2e75dad640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e700ccef0 con 0x7f2e700cf130 2023-07-14T13:32:31.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.744+0000 7f2e75dad640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e700d2880 con 0x7f2e700d1800 2023-07-14T13:32:31.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.744+0000 7f2e6ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2e700cf130 0x7f2e700cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.744+0000 7f2e6effd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e700d1800 0x7f2e700cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.744+0000 7f2e6ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2e700cf130 0x7f2e700cfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:33878/0 (socket says 172.21.15.5:33878) 2023-07-14T13:32:31.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.744+0000 7f2e6ffff640 1 -- 172.21.15.5:0/1288199045 learned_addr learned my addr 172.21.15.5:0/1288199045 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:31.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.744+0000 7f2e6f7fe640 1 --1- 172.21.15.5:0/1288199045 >> v1:172.21.15.154:6789/0 conn(0x7f2e7015bb40 0x7f2e700ce4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:59912/0 (socket says 172.21.15.5:59912) 2023-07-14T13:32:31.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.744+0000 7f2e6ffff640 1 -- 172.21.15.5:0/1288199045 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e700d1800 msgr2=0x7f2e700cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:31.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.744+0000 7f2e6ffff640 1 --2- 172.21.15.5:0/1288199045 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e700d1800 0x7f2e700cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.744+0000 7f2e6ffff640 1 -- 172.21.15.5:0/1288199045 >> v1:172.21.15.154:6789/0 conn(0x7f2e7015bb40 legacy=0x7f2e700ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:31.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.744+0000 7f2e6ffff640 1 -- 172.21.15.5:0/1288199045 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e700d2b60 con 0x7f2e700cf130 2023-07-14T13:32:31.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.744+0000 7f2e6effd640 1 --2- 172.21.15.5:0/1288199045 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e700d1800 0x7f2e700cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:32:31.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.748+0000 7f2e6ffff640 1 --2- 172.21.15.5:0/1288199045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e700cf130 0x7f2e700cfed0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f2e68009e50 tx=0x7f2e6801ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc3ca6c3f2e25586 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:31.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.748+0000 7f2e6e7fc640 1 -- 172.21.15.5:0/1288199045 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e680a5900 con 0x7f2e700cf130 2023-07-14T13:32:31.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.748+0000 7f2e6e7fc640 1 -- 172.21.15.5:0/1288199045 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e680a5a60 con 0x7f2e700cf130 2023-07-14T13:32:31.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.748+0000 7f2e6e7fc640 1 -- 172.21.15.5:0/1288199045 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e680a5df0 con 0x7f2e700cf130 2023-07-14T13:32:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.748+0000 7f2e75dad640 1 -- 172.21.15.5:0/1288199045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e700cf130 msgr2=0x7f2e700cfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.748+0000 7f2e75dad640 1 --2- 172.21.15.5:0/1288199045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e700cf130 0x7f2e700cfed0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f2e68009e50 tx=0x7f2e6801ca10 comp rx=0 tx=0).stop 2023-07-14T13:32:31.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.748+0000 7f2e75dad640 1 -- 172.21.15.5:0/1288199045 shutdown_connections 2023-07-14T13:32:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.748+0000 7f2e75dad640 1 --2- 172.21.15.5:0/1288199045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e700cf130 0x7f2e700cfed0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.748+0000 7f2e75dad640 1 --2- 172.21.15.5:0/1288199045 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e700d1800 0x7f2e700cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.748+0000 7f2e75dad640 1 -- 172.21.15.5:0/1288199045 >> 172.21.15.5:0/1288199045 conn(0x7f2e700650b0 msgr2=0x7f2e700654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.748+0000 7f2e75dad640 1 -- 172.21.15.5:0/1288199045 shutdown_connections 2023-07-14T13:32:31.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.748+0000 7f2e75dad640 1 -- 172.21.15.5:0/1288199045 wait complete. 2023-07-14T13:32:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.752+0000 7f2e75dad640 1 Processor -- start 2023-07-14T13:32:31.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.752+0000 7f2e75dad640 1 -- start start 2023-07-14T13:32:31.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.752+0000 7f2e75dad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e700cf130 0x7f2e70158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.752+0000 7f2e75dad640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e700d1800 0x7f2e70146ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.752+0000 7f2e75dad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e7015bb40 0x7f2e70151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.752+0000 7f2e75dad640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e700b7560 con 0x7f2e700cf130 2023-07-14T13:32:31.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.752+0000 7f2e75dad640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e700b7840 con 0x7f2e7015bb40 2023-07-14T13:32:31.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.752+0000 7f2e75dad640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e700c9400 con 0x7f2e700d1800 2023-07-14T13:32:31.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.752+0000 7f2e6f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e700cf130 0x7f2e70158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.752+0000 7f2e6f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e700cf130 0x7f2e70158ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39872/0 (socket says 172.21.15.5:39872) 2023-07-14T13:32:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.752+0000 7f2e6f7fe640 1 -- 172.21.15.5:0/2537774080 learned_addr learned my addr 172.21.15.5:0/2537774080 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.752+0000 7f2e6ffff640 1 --2- 172.21.15.5:0/2537774080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e7015bb40 0x7f2e70151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.752+0000 7f2e6effd640 1 --2- 172.21.15.5:0/2537774080 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e700d1800 0x7f2e70146ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.752+0000 7f2e6f7fe640 1 -- 172.21.15.5:0/2537774080 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e700d1800 msgr2=0x7f2e70146ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.752+0000 7f2e6f7fe640 1 --2- 172.21.15.5:0/2537774080 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e700d1800 0x7f2e70146ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.752+0000 7f2e6f7fe640 1 -- 172.21.15.5:0/2537774080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e7015bb40 msgr2=0x7f2e70151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:31.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.752+0000 7f2e6f7fe640 1 --2- 172.21.15.5:0/2537774080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e7015bb40 0x7f2e70151490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.752+0000 7f2e6f7fe640 1 -- 172.21.15.5:0/2537774080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e64009420 con 0x7f2e700cf130 2023-07-14T13:32:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.752+0000 7f2e6f7fe640 1 --2- 172.21.15.5:0/2537774080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e700cf130 0x7f2e70158ad0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f2e6000c430 tx=0x7f2e6000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:31.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.752+0000 7f2e57fff640 1 -- 172.21.15.5:0/2537774080 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e600074e0 con 0x7f2e700cf130 2023-07-14T13:32:31.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.752+0000 7f2e57fff640 1 -- 172.21.15.5:0/2537774080 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e60007640 con 0x7f2e700cf130 2023-07-14T13:32:31.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.752+0000 7f2e75dad640 1 -- 172.21.15.5:0/2537774080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e68009b30 con 0x7f2e700cf130 2023-07-14T13:32:31.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.752+0000 7f2e57fff640 1 -- 172.21.15.5:0/2537774080 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e60004a10 con 0x7f2e700cf130 2023-07-14T13:32:31.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.752+0000 7f2e75dad640 1 -- 172.21.15.5:0/2537774080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e700c99c0 con 0x7f2e700cf130 2023-07-14T13:32:31.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.756+0000 7f2e75dad640 1 -- 172.21.15.5:0/2537774080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e700678d0 con 0x7f2e700cf130 2023-07-14T13:32:31.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.756+0000 7f2e57fff640 1 -- 172.21.15.5:0/2537774080 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2e60004b70 con 0x7f2e700cf130 2023-07-14T13:32:31.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.756+0000 7f2e57fff640 1 --2- 172.21.15.5:0/2537774080 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f2e5c0663a0 0x7f2e5c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.756+0000 7f2e57fff640 1 -- 172.21.15.5:0/2537774080 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f2e60083920 con 0x7f2e700cf130 2023-07-14T13:32:31.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.756+0000 7f2e6effd640 1 --2- 172.21.15.5:0/2537774080 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f2e5c0663a0 0x7f2e5c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.756+0000 7f2e6effd640 1 --2- 172.21.15.5:0/2537774080 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f2e5c0663a0 0x7f2e5c068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2e70150ee0 tx=0x7f2e64009190 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:31.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.760+0000 7f2e57fff640 1 -- 172.21.15.5:0/2537774080 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2e60050b70 con 0x7f2e700cf130 2023-07-14T13:32:31.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.916+0000 7f2e75dad640 1 -- 172.21.15.5:0/2537774080 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e70159d60 con 0x7f2e700cf130 2023-07-14T13:32:31.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.916+0000 7f2e57fff640 1 -- 172.21.15.5:0/2537774080 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+18302 (secure 0 0 0) 0x7f2e60054190 con 0x7f2e700cf130 2023-07-14T13:32:31.919 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:31.919 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":190,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:32:30.624282+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:32:28.300155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-14T13:32:29.622154+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:32:31.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.920+0000 7f2e75dad640 1 -- 172.21.15.5:0/2537774080 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f2e5c0663a0 msgr2=0x7f2e5c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:31.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.920+0000 7f2e75dad640 1 --2- 172.21.15.5:0/2537774080 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f2e5c0663a0 0x7f2e5c068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2e70150ee0 tx=0x7f2e64009190 comp rx=0 tx=0).stop 2023-07-14T13:32:31.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.920+0000 7f2e75dad640 1 -- 172.21.15.5:0/2537774080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e700cf130 msgr2=0x7f2e70158ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:31.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.920+0000 7f2e75dad640 1 --2- 172.21.15.5:0/2537774080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e700cf130 0x7f2e70158ad0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f2e6000c430 tx=0x7f2e6000c8f0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.920+0000 7f2e75dad640 1 -- 172.21.15.5:0/2537774080 shutdown_connections 2023-07-14T13:32:31.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.920+0000 7f2e75dad640 1 --2- 172.21.15.5:0/2537774080 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f2e5c0663a0 0x7f2e5c068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.920+0000 7f2e75dad640 1 --2- 172.21.15.5:0/2537774080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e7015bb40 0x7f2e70151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.920+0000 7f2e75dad640 1 --2- 172.21.15.5:0/2537774080 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e700d1800 0x7f2e70146ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.920+0000 7f2e75dad640 1 --2- 172.21.15.5:0/2537774080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e700cf130 0x7f2e70158ad0 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.920+0000 7f2e75dad640 1 -- 172.21.15.5:0/2537774080 >> 172.21.15.5:0/2537774080 conn(0x7f2e700650b0 msgr2=0x7f2e70065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:31.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.920+0000 7f2e75dad640 1 -- 172.21.15.5:0/2537774080 shutdown_connections 2023-07-14T13:32:31.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:31.920+0000 7f2e75dad640 1 -- 172.21.15.5:0/2537774080 wait complete. 2023-07-14T13:32:31.940 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-14T13:32:32.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.088+0000 7fdf38e19640 1 Processor -- start 2023-07-14T13:32:32.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.088+0000 7fdf38e19640 1 -- start start 2023-07-14T13:32:32.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.088+0000 7fdf38e19640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdf341649a0 0x7fdf34166d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:32.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.088+0000 7fdf38e19640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf340cb570 con 0x7fdf34069430 2023-07-14T13:32:32.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.088+0000 7fdf38e19640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf340cb7d0 con 0x7fdf340cb0f0 2023-07-14T13:32:32.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.088+0000 7fdf38e19640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf3406c510 con 0x7fdf341649a0 2023-07-14T13:32:32.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.088+0000 7fdf3259c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdf34069430 0x7fdf34160030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57584/0 (socket says 172.21.15.5:57584) 2023-07-14T13:32:32.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.088+0000 7fdf3259c640 1 -- 172.21.15.5:0/897197733 learned_addr learned my addr 172.21.15.5:0/897197733 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:32.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.088+0000 7fdf31d9b640 1 -- 172.21.15.5:0/897197733 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777653199 0 0) 0x7fdf340cb570 con 0x7fdf34069430 2023-07-14T13:32:32.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.088+0000 7fdf31d9b640 1 -- 172.21.15.5:0/897197733 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf20003530 con 0x7fdf34069430 2023-07-14T13:32:32.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.088+0000 7fdf32d9d640 1 --2- 172.21.15.5:0/897197733 >> v2:172.21.15.154:3300/0 conn(0x7fdf341649a0 0x7fdf34166d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:32.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.088+0000 7fdf31d9b640 1 -- 172.21.15.5:0/897197733 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1665854386 0 0) 0x7fdf20003530 con 0x7fdf34069430 2023-07-14T13:32:32.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.088+0000 7fdf31d9b640 1 -- 172.21.15.5:0/897197733 >> v2:172.21.15.154:3300/0 conn(0x7fdf341649a0 msgr2=0x7fdf34166d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:32.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.088+0000 7fdf31d9b640 1 --2- 172.21.15.5:0/897197733 >> v2:172.21.15.154:3300/0 conn(0x7fdf341649a0 0x7fdf34166d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:32.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.088+0000 7fdf31d9b640 1 -- 172.21.15.5:0/897197733 >> v1:172.21.15.154:6789/0 conn(0x7fdf340cb0f0 legacy=0x7fdf34069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:32.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.088+0000 7fdf31d9b640 1 -- 172.21.15.5:0/897197733 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3406c7f0 con 0x7fdf34069430 2023-07-14T13:32:32.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.088+0000 7fdf31d9b640 1 -- 172.21.15.5:0/897197733 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7fdf24001680 con 0x7fdf34069430 2023-07-14T13:32:32.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.088+0000 7fdf31d9b640 1 -- 172.21.15.5:0/897197733 >> v1:172.21.15.5:6789/0 conn(0x7fdf34069430 legacy=0x7fdf34160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:32.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.088+0000 7fdf31d9b640 1 --2- 172.21.15.5:0/897197733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf20003980 0x7fdf20003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:32.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.088+0000 7fdf31d9b640 1 --2- 172.21.15.5:0/897197733 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf200047d0 0x7fdf20004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:32.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.088+0000 7fdf31d9b640 1 --2- 172.21.15.5:0/897197733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf20005180 0x7fdf2000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:32.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.088+0000 7fdf31d9b640 1 -- 172.21.15.5:0/897197733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3406c510 con 0x7fdf20005180 2023-07-14T13:32:32.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.088+0000 7fdf31d9b640 1 -- 172.21.15.5:0/897197733 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2000c090 con 0x7fdf20003980 2023-07-14T13:32:32.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.088+0000 7fdf31d9b640 1 -- 172.21.15.5:0/897197733 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2000c250 con 0x7fdf200047d0 2023-07-14T13:32:32.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.088+0000 7fdf32d9d640 1 --2- 172.21.15.5:0/897197733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf20005180 0x7fdf2000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:32.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.088+0000 7fdf3259c640 1 --2- 172.21.15.5:0/897197733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf20003980 0x7fdf20003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:32.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.088+0000 7fdf2bfff640 1 --2- 172.21.15.5:0/897197733 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf200047d0 0x7fdf20004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:32.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.092+0000 7fdf32d9d640 1 -- 172.21.15.5:0/897197733 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf200047d0 msgr2=0x7fdf20004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:32.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.092+0000 7fdf32d9d640 1 --2- 172.21.15.5:0/897197733 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf200047d0 0x7fdf20004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.092+0000 7fdf32d9d640 1 -- 172.21.15.5:0/897197733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf20003980 msgr2=0x7fdf20003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.092+0000 7fdf32d9d640 1 --2- 172.21.15.5:0/897197733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf20003980 0x7fdf20003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.092+0000 7fdf32d9d640 1 -- 172.21.15.5:0/897197733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf20003530 con 0x7fdf20005180 2023-07-14T13:32:32.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.092+0000 7fdf2bfff640 1 --2- 172.21.15.5:0/897197733 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf200047d0 0x7fdf20004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:32.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.092+0000 7fdf32d9d640 1 -- 172.21.15.5:0/897197733 reap_dead start 2023-07-14T13:32:32.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.092+0000 7fdf32d9d640 1 --2- 172.21.15.5:0/897197733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf20005180 0x7fdf2000b990 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c009fc0 tx=0x7fdf2c01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e2a5e02c65bcaff server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:32.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.092+0000 7fdf31d9b640 1 -- 172.21.15.5:0/897197733 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c0a5bb0 con 0x7fdf20005180 2023-07-14T13:32:32.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.092+0000 7fdf31d9b640 1 -- 172.21.15.5:0/897197733 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2c00f040 con 0x7fdf20005180 2023-07-14T13:32:32.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.092+0000 7fdf31d9b640 1 -- 172.21.15.5:0/897197733 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c0039a0 con 0x7fdf20005180 2023-07-14T13:32:32.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.092+0000 7fdf38e19640 1 -- 172.21.15.5:0/897197733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf20005180 msgr2=0x7fdf2000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:32.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.092+0000 7fdf38e19640 1 --2- 172.21.15.5:0/897197733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf20005180 0x7fdf2000b990 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c009fc0 tx=0x7fdf2c01cca0 comp rx=0 tx=0).stop 2023-07-14T13:32:32.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.092+0000 7fdf38e19640 1 -- 172.21.15.5:0/897197733 shutdown_connections 2023-07-14T13:32:32.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.092+0000 7fdf38e19640 1 --2- 172.21.15.5:0/897197733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf20005180 0x7fdf2000b990 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:32.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.092+0000 7fdf38e19640 1 -- 172.21.15.5:0/897197733 >> 172.21.15.5:0/897197733 conn(0x7fdf340b1840 msgr2=0x7fdf340cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:32.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.092+0000 7fdf38e19640 1 -- 172.21.15.5:0/897197733 shutdown_connections 2023-07-14T13:32:32.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.092+0000 7fdf38e19640 1 -- 172.21.15.5:0/897197733 wait complete. 2023-07-14T13:32:32.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.096+0000 7fdf38e19640 1 Processor -- start 2023-07-14T13:32:32.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.096+0000 7fdf38e19640 1 -- start start 2023-07-14T13:32:32.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.096+0000 7fdf38e19640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf20005180 0x7fdf340ad670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:32.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.096+0000 7fdf38e19640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf34157850 0x7fdf340adef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:32.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.096+0000 7fdf38e19640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf340ae430 0x7fdf340c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:32.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.096+0000 7fdf38e19640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf340ae8a0 con 0x7fdf34157850 2023-07-14T13:32:32.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.096+0000 7fdf38e19640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf340b3ed0 con 0x7fdf20005180 2023-07-14T13:32:32.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.096+0000 7fdf38e19640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf340ac8b0 con 0x7fdf340ae430 2023-07-14T13:32:32.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.096+0000 7fdf2bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf34157850 0x7fdf340adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:32.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.096+0000 7fdf2bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf34157850 0x7fdf340adef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39896/0 (socket says 172.21.15.5:39896) 2023-07-14T13:32:32.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.096+0000 7fdf2bfff640 1 -- 172.21.15.5:0/2873530236 learned_addr learned my addr 172.21.15.5:0/2873530236 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:32.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.096+0000 7fdf3259c640 1 --2- 172.21.15.5:0/2873530236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf20005180 0x7fdf340ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:32.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.096+0000 7fdf32d9d640 1 --2- 172.21.15.5:0/2873530236 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf340ae430 0x7fdf340c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:32.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.096+0000 7fdf2bfff640 1 -- 172.21.15.5:0/2873530236 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf340ae430 msgr2=0x7fdf340c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:32.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.096+0000 7fdf2bfff640 1 --2- 172.21.15.5:0/2873530236 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf340ae430 0x7fdf340c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:32.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.096+0000 7fdf2bfff640 1 -- 172.21.15.5:0/2873530236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf20005180 msgr2=0x7fdf340ad670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:32.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.096+0000 7fdf2bfff640 1 --2- 172.21.15.5:0/2873530236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf20005180 0x7fdf340ad670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:32.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.096+0000 7fdf2bfff640 1 -- 172.21.15.5:0/2873530236 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf340acb90 con 0x7fdf34157850 2023-07-14T13:32:32.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.096+0000 7fdf2bfff640 1 --2- 172.21.15.5:0/2873530236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf34157850 0x7fdf340adef0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00e4d0 tx=0x7fdf1c00e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:32.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.096+0000 7fdf2affd640 1 -- 172.21.15.5:0/2873530236 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c0052e0 con 0x7fdf34157850 2023-07-14T13:32:32.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.100+0000 7fdf2affd640 1 -- 172.21.15.5:0/2873530236 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1c005440 con 0x7fdf34157850 2023-07-14T13:32:32.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.100+0000 7fdf38e19640 1 -- 172.21.15.5:0/2873530236 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf340ace70 con 0x7fdf34157850 2023-07-14T13:32:32.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.100+0000 7fdf2affd640 1 -- 172.21.15.5:0/2873530236 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c003820 con 0x7fdf34157850 2023-07-14T13:32:32.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.100+0000 7fdf38e19640 1 -- 172.21.15.5:0/2873530236 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf340ac560 con 0x7fdf34157850 2023-07-14T13:32:32.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.100+0000 7fdf38e19640 1 -- 172.21.15.5:0/2873530236 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf340678d0 con 0x7fdf34157850 2023-07-14T13:32:32.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.100+0000 7fdf2affd640 1 -- 172.21.15.5:0/2873530236 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdf1c003980 con 0x7fdf34157850 2023-07-14T13:32:32.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.100+0000 7fdf2affd640 1 --2- 172.21.15.5:0/2873530236 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fdf140663d0 0x7fdf14068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:32.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.100+0000 7fdf2affd640 1 -- 172.21.15.5:0/2873530236 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fdf1c0838d0 con 0x7fdf34157850 2023-07-14T13:32:32.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.100+0000 7fdf3259c640 1 --2- 172.21.15.5:0/2873530236 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fdf140663d0 0x7fdf14068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:32.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.104+0000 7fdf3259c640 1 --2- 172.21.15.5:0/2873530236 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fdf140663d0 0x7fdf14068880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdf24001060 tx=0x7fdf24009040 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:32.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.104+0000 7fdf2affd640 1 -- 172.21.15.5:0/2873530236 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fdf1c050c10 con 0x7fdf34157850 2023-07-14T13:32:32.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:32.300+0000 7fdf38e19640 1 -- 172.21.15.5:0/2873530236 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdf3406e920 con 0x7fdf34157850 2023-07-14T13:32:33.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.240+0000 7fdf2affd640 1 -- 172.21.15.5:0/2873530236 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v91) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdf1c054230 con 0x7fdf34157850 2023-07-14T13:32:33.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.244+0000 7fdf38e19640 1 -- 172.21.15.5:0/2873530236 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fdf140663d0 msgr2=0x7fdf14068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:33.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.244+0000 7fdf38e19640 1 --2- 172.21.15.5:0/2873530236 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fdf140663d0 0x7fdf14068880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdf24001060 tx=0x7fdf24009040 comp rx=0 tx=0).stop 2023-07-14T13:32:33.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.244+0000 7fdf38e19640 1 -- 172.21.15.5:0/2873530236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf34157850 msgr2=0x7fdf340adef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:33.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.244+0000 7fdf38e19640 1 --2- 172.21.15.5:0/2873530236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf34157850 0x7fdf340adef0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00e4d0 tx=0x7fdf1c00e990 comp rx=0 tx=0).stop 2023-07-14T13:32:33.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.244+0000 7fdf38e19640 1 -- 172.21.15.5:0/2873530236 shutdown_connections 2023-07-14T13:32:33.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.244+0000 7fdf38e19640 1 --2- 172.21.15.5:0/2873530236 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fdf140663d0 0x7fdf14068880 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:33.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.244+0000 7fdf38e19640 1 --2- 172.21.15.5:0/2873530236 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf340ae430 0x7fdf340c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:33.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.244+0000 7fdf38e19640 1 --2- 172.21.15.5:0/2873530236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf34157850 0x7fdf340adef0 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:33.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.244+0000 7fdf38e19640 1 --2- 172.21.15.5:0/2873530236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf20005180 0x7fdf340ad670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:33.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.244+0000 7fdf38e19640 1 -- 172.21.15.5:0/2873530236 >> 172.21.15.5:0/2873530236 conn(0x7fdf340b1840 msgr2=0x7fdf3406d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:33.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.244+0000 7fdf38e19640 1 -- 172.21.15.5:0/2873530236 shutdown_connections 2023-07-14T13:32:33.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.244+0000 7fdf38e19640 1 -- 172.21.15.5:0/2873530236 wait complete. 2023-07-14T13:32:33.268 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-14T13:32:33.268 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-14T13:32:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.420+0000 7fcf5551e640 1 Processor -- start 2023-07-14T13:32:33.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.420+0000 7fcf5551e640 1 -- start start 2023-07-14T13:32:33.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.420+0000 7fcf5551e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf5015cef0 0x7fcf50158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:33.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.420+0000 7fcf5551e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf501532b0 con 0x7fcf50159270 2023-07-14T13:32:33.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.420+0000 7fcf5551e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf500ca6f0 con 0x7fcf500aeb40 2023-07-14T13:32:33.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.420+0000 7fcf5551e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5015d360 con 0x7fcf5015cef0 2023-07-14T13:32:33.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.420+0000 7fcf4f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcf50159270 0x7fcf500c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57596/0 (socket says 172.21.15.5:57596) 2023-07-14T13:32:33.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.420+0000 7fcf4f7fe640 1 -- 172.21.15.5:0/1852417578 learned_addr learned my addr 172.21.15.5:0/1852417578 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:33.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.420+0000 7fcf47fff640 1 --2- 172.21.15.5:0/1852417578 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf5015cef0 0x7fcf50158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:33.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.420+0000 7fcf4e7fc640 1 -- 172.21.15.5:0/1852417578 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1350758969 0 0) 0x7fcf501532b0 con 0x7fcf50159270 2023-07-14T13:32:33.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.420+0000 7fcf4e7fc640 1 -- 172.21.15.5:0/1852417578 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf3c003530 con 0x7fcf50159270 2023-07-14T13:32:33.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.424+0000 7fcf4e7fc640 1 -- 172.21.15.5:0/1852417578 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1918445433 0 0) 0x7fcf500ca6f0 con 0x7fcf500aeb40 2023-07-14T13:32:33.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.424+0000 7fcf4e7fc640 1 -- 172.21.15.5:0/1852417578 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf501532b0 con 0x7fcf500aeb40 2023-07-14T13:32:33.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.424+0000 7fcf4e7fc640 1 -- 172.21.15.5:0/1852417578 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1349459359 0 0) 0x7fcf3c003530 con 0x7fcf50159270 2023-07-14T13:32:33.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.424+0000 7fcf4e7fc640 1 -- 172.21.15.5:0/1852417578 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf5015cef0 msgr2=0x7fcf50158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:33.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.424+0000 7fcf4e7fc640 1 --2- 172.21.15.5:0/1852417578 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf5015cef0 0x7fcf50158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.424+0000 7fcf4e7fc640 1 -- 172.21.15.5:0/1852417578 >> v1:172.21.15.154:6789/0 conn(0x7fcf500aeb40 legacy=0x7fcf500aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.424+0000 7fcf4e7fc640 1 -- 172.21.15.5:0/1852417578 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf501599d0 con 0x7fcf50159270 2023-07-14T13:32:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.424+0000 7fcf4e7fc640 1 -- 172.21.15.5:0/1852417578 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7fcf48001a00 con 0x7fcf50159270 2023-07-14T13:32:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.424+0000 7fcf4e7fc640 1 -- 172.21.15.5:0/1852417578 >> v1:172.21.15.5:6789/0 conn(0x7fcf50159270 legacy=0x7fcf500c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.424+0000 7fcf4e7fc640 1 --2- 172.21.15.5:0/1852417578 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf5015cef0 0x7fcf3c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.424+0000 7fcf4e7fc640 1 --2- 172.21.15.5:0/1852417578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf3c0040f0 0x7fcf3c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.424+0000 7fcf4e7fc640 1 --2- 172.21.15.5:0/1852417578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf3c004d10 0x7fcf3c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.424+0000 7fcf4e7fc640 1 -- 172.21.15.5:0/1852417578 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5015d360 con 0x7fcf3c004d10 2023-07-14T13:32:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.424+0000 7fcf4e7fc640 1 -- 172.21.15.5:0/1852417578 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c00dcb0 con 0x7fcf3c0040f0 2023-07-14T13:32:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.424+0000 7fcf4e7fc640 1 -- 172.21.15.5:0/1852417578 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c00de70 con 0x7fcf5015cef0 2023-07-14T13:32:33.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.424+0000 7fcf4f7fe640 1 --2- 172.21.15.5:0/1852417578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf3c004d10 0x7fcf3c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:33.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.424+0000 7fcf4effd640 1 --2- 172.21.15.5:0/1852417578 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf5015cef0 0x7fcf3c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:33.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.424+0000 7fcf47fff640 1 --2- 172.21.15.5:0/1852417578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf3c0040f0 0x7fcf3c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:33.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.424+0000 7fcf4f7fe640 1 -- 172.21.15.5:0/1852417578 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf5015cef0 msgr2=0x7fcf3c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:33.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.424+0000 7fcf4f7fe640 1 --2- 172.21.15.5:0/1852417578 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf5015cef0 0x7fcf3c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:33.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.424+0000 7fcf4f7fe640 1 -- 172.21.15.5:0/1852417578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf3c0040f0 msgr2=0x7fcf3c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:33.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.424+0000 7fcf4f7fe640 1 --2- 172.21.15.5:0/1852417578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf3c0040f0 0x7fcf3c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:33.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.424+0000 7fcf4f7fe640 1 -- 172.21.15.5:0/1852417578 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c003530 con 0x7fcf3c004d10 2023-07-14T13:32:33.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.424+0000 7fcf4f7fe640 1 --2- 172.21.15.5:0/1852417578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf3c004d10 0x7fcf3c005180 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800a710 tx=0x7fcf4801f960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bead1d52b40ec3c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:33.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.428+0000 7fcf4e7fc640 1 -- 172.21.15.5:0/1852417578 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf480ac610 con 0x7fcf3c004d10 2023-07-14T13:32:33.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.428+0000 7fcf4e7fc640 1 -- 172.21.15.5:0/1852417578 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf480ac770 con 0x7fcf3c004d10 2023-07-14T13:32:33.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.428+0000 7fcf4e7fc640 1 -- 172.21.15.5:0/1852417578 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf480acba0 con 0x7fcf3c004d10 2023-07-14T13:32:33.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.428+0000 7fcf5551e640 1 -- 172.21.15.5:0/1852417578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf3c004d10 msgr2=0x7fcf3c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:33.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.428+0000 7fcf5551e640 1 --2- 172.21.15.5:0/1852417578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf3c004d10 0x7fcf3c005180 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800a710 tx=0x7fcf4801f960 comp rx=0 tx=0).stop 2023-07-14T13:32:33.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.428+0000 7fcf4f7fe640 1 -- 172.21.15.5:0/1852417578 reap_dead start 2023-07-14T13:32:33.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.428+0000 7fcf5551e640 1 -- 172.21.15.5:0/1852417578 shutdown_connections 2023-07-14T13:32:33.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.428+0000 7fcf5551e640 1 -- 172.21.15.5:0/1852417578 >> 172.21.15.5:0/1852417578 conn(0x7fcf500cde90 msgr2=0x7fcf500ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:33.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.428+0000 7fcf5551e640 1 -- 172.21.15.5:0/1852417578 shutdown_connections 2023-07-14T13:32:33.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.428+0000 7fcf5551e640 1 -- 172.21.15.5:0/1852417578 wait complete. 2023-07-14T13:32:33.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.428+0000 7fcf5551e640 1 Processor -- start 2023-07-14T13:32:33.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.428+0000 7fcf5551e640 1 -- start start 2023-07-14T13:32:33.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.428+0000 7fcf5551e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf50145a20 0x7fcf50070180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:33.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.428+0000 7fcf5551e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf5006b1f0 0x7fcf5006c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:33.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.428+0000 7fcf5551e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf5006cd50 0x7fcf500ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:33.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.428+0000 7fcf5551e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5006c380 con 0x7fcf50145a20 2023-07-14T13:32:33.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.428+0000 7fcf5551e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5006b770 con 0x7fcf5006b1f0 2023-07-14T13:32:33.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.428+0000 7fcf5551e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5006ba50 con 0x7fcf5006cd50 2023-07-14T13:32:33.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.428+0000 7fcf4effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf50145a20 0x7fcf50070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:33.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.428+0000 7fcf4effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf50145a20 0x7fcf50070180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39908/0 (socket says 172.21.15.5:39908) 2023-07-14T13:32:33.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.428+0000 7fcf4effd640 1 -- 172.21.15.5:0/614091383 learned_addr learned my addr 172.21.15.5:0/614091383 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:33.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.428+0000 7fcf47fff640 1 --2- 172.21.15.5:0/614091383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf5006b1f0 0x7fcf5006c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:33.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.432+0000 7fcf4f7fe640 1 --2- 172.21.15.5:0/614091383 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf5006cd50 0x7fcf500ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:33.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.432+0000 7fcf4effd640 1 -- 172.21.15.5:0/614091383 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf5006cd50 msgr2=0x7fcf500ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:33.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.432+0000 7fcf4effd640 1 --2- 172.21.15.5:0/614091383 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf5006cd50 0x7fcf500ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:33.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.432+0000 7fcf4effd640 1 -- 172.21.15.5:0/614091383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf5006b1f0 msgr2=0x7fcf5006c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:33.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.432+0000 7fcf4effd640 1 --2- 172.21.15.5:0/614091383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf5006b1f0 0x7fcf5006c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:33.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.432+0000 7fcf4effd640 1 -- 172.21.15.5:0/614091383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5006bd30 con 0x7fcf50145a20 2023-07-14T13:32:33.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.432+0000 7fcf4f7fe640 1 --2- 172.21.15.5:0/614091383 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf5006cd50 0x7fcf500ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:32:33.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.432+0000 7fcf4effd640 1 --2- 172.21.15.5:0/614091383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf50145a20 0x7fcf50070180 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fcf4000f7f0 tx=0x7fcf4000fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:33.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.432+0000 7fcf477fe640 1 -- 172.21.15.5:0/614091383 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40001510 con 0x7fcf50145a20 2023-07-14T13:32:33.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.432+0000 7fcf477fe640 1 -- 172.21.15.5:0/614091383 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf400052e0 con 0x7fcf50145a20 2023-07-14T13:32:33.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.432+0000 7fcf477fe640 1 -- 172.21.15.5:0/614091383 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4000d970 con 0x7fcf50145a20 2023-07-14T13:32:33.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.432+0000 7fcf5551e640 1 -- 172.21.15.5:0/614091383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5006c010 con 0x7fcf50145a20 2023-07-14T13:32:33.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.432+0000 7fcf5551e640 1 -- 172.21.15.5:0/614091383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf50145df0 con 0x7fcf50145a20 2023-07-14T13:32:33.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.432+0000 7fcf5551e640 1 -- 172.21.15.5:0/614091383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf5015b770 con 0x7fcf50145a20 2023-07-14T13:32:33.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.432+0000 7fcf477fe640 1 -- 172.21.15.5:0/614091383 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcf4000dad0 con 0x7fcf50145a20 2023-07-14T13:32:33.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.432+0000 7fcf477fe640 1 --2- 172.21.15.5:0/614091383 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fcf300663a0 0x7fcf30068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:33.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.432+0000 7fcf477fe640 1 -- 172.21.15.5:0/614091383 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fcf40083f70 con 0x7fcf50145a20 2023-07-14T13:32:33.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.436+0000 7fcf47fff640 1 --2- 172.21.15.5:0/614091383 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fcf300663a0 0x7fcf30068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:33.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.436+0000 7fcf47fff640 1 --2- 172.21.15.5:0/614091383 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fcf300663a0 0x7fcf30068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcf50070e50 tx=0x7fcf38008040 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:33.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.436+0000 7fcf477fe640 1 -- 172.21.15.5:0/614091383 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fcf400b4720 con 0x7fcf50145a20 2023-07-14T13:32:33.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:33.628+0000 7fcf5551e640 1 -- 172.21.15.5:0/614091383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcf5006d120 con 0x7fcf50145a20 2023-07-14T13:32:34.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.248+0000 7fcf477fe640 1 -- 172.21.15.5:0/614091383 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v92) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcf40051350 con 0x7fcf50145a20 2023-07-14T13:32:34.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.252+0000 7fcf5551e640 1 -- 172.21.15.5:0/614091383 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fcf300663a0 msgr2=0x7fcf30068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:34.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.252+0000 7fcf5551e640 1 --2- 172.21.15.5:0/614091383 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fcf300663a0 0x7fcf30068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcf50070e50 tx=0x7fcf38008040 comp rx=0 tx=0).stop 2023-07-14T13:32:34.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.252+0000 7fcf5551e640 1 -- 172.21.15.5:0/614091383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf50145a20 msgr2=0x7fcf50070180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:34.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.252+0000 7fcf5551e640 1 --2- 172.21.15.5:0/614091383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf50145a20 0x7fcf50070180 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fcf4000f7f0 tx=0x7fcf4000fcb0 comp rx=0 tx=0).stop 2023-07-14T13:32:34.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.252+0000 7fcf5551e640 1 -- 172.21.15.5:0/614091383 shutdown_connections 2023-07-14T13:32:34.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.252+0000 7fcf5551e640 1 --2- 172.21.15.5:0/614091383 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fcf300663a0 0x7fcf30068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:34.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.252+0000 7fcf5551e640 1 --2- 172.21.15.5:0/614091383 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf5006cd50 0x7fcf500ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:34.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.252+0000 7fcf5551e640 1 --2- 172.21.15.5:0/614091383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf5006b1f0 0x7fcf5006c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:34.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.252+0000 7fcf5551e640 1 --2- 172.21.15.5:0/614091383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf50145a20 0x7fcf50070180 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:34.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.252+0000 7fcf5551e640 1 -- 172.21.15.5:0/614091383 >> 172.21.15.5:0/614091383 conn(0x7fcf500cde90 msgr2=0x7fcf5015b060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:34.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.252+0000 7fcf5551e640 1 -- 172.21.15.5:0/614091383 shutdown_connections 2023-07-14T13:32:34.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.252+0000 7fcf5551e640 1 -- 172.21.15.5:0/614091383 wait complete. 2023-07-14T13:32:34.275 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-14T13:32:34.276 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:32:34.382 INFO:tasks.ceph.mds.c.smithi005.stderr:2023-07-14T13:32:34.380+0000 7f77afba4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T13:32:34.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2eb4bfa640 1 Processor -- start 2023-07-14T13:32:34.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2eb4bfa640 1 -- start start 2023-07-14T13:32:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2eb4bfa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2eb00b7c70 0x7f2eb00d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2eb4bfa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2eb015fd60 0x7f2eb00d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2eb4bfa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb00ccaf0 con 0x7f2eb00d1850 2023-07-14T13:32:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2eb4bfa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb00d1190 con 0x7f2eb00b7c70 2023-07-14T13:32:34.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2eb4bfa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb0160600 con 0x7f2eb015fd60 2023-07-14T13:32:34.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2eadd9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2eb00d1850 0x7f2eb015f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57612/0 (socket says 172.21.15.5:57612) 2023-07-14T13:32:34.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2eadd9b640 1 -- 172.21.15.5:0/1517940612 learned_addr learned my addr 172.21.15.5:0/1517940612 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:34.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2eaed9d640 1 --2- 172.21.15.5:0/1517940612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2eb015fd60 0x7f2eb00d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:34.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2eae59c640 1 --2- 172.21.15.5:0/1517940612 >> v2:172.21.15.154:3300/0 conn(0x7f2eb00b7c70 0x7f2eb00d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2ead59a640 1 -- 172.21.15.5:0/1517940612 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288265260 0 0) 0x7f2eb00ccaf0 con 0x7f2eb00d1850 2023-07-14T13:32:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2ead59a640 1 -- 172.21.15.5:0/1517940612 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e98003530 con 0x7f2eb00d1850 2023-07-14T13:32:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2ead59a640 1 -- 172.21.15.5:0/1517940612 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 247188514 0 0) 0x7f2e98003530 con 0x7f2eb00d1850 2023-07-14T13:32:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2ead59a640 1 -- 172.21.15.5:0/1517940612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2eb015fd60 msgr2=0x7f2eb00d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2ead59a640 1 --2- 172.21.15.5:0/1517940612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2eb015fd60 0x7f2eb00d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2ead59a640 1 -- 172.21.15.5:0/1517940612 >> v2:172.21.15.154:3300/0 conn(0x7f2eb00b7c70 msgr2=0x7f2eb00d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2ead59a640 1 --2- 172.21.15.5:0/1517940612 >> v2:172.21.15.154:3300/0 conn(0x7f2eb00b7c70 0x7f2eb00d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:34.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2ead59a640 1 -- 172.21.15.5:0/1517940612 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb0160320 con 0x7f2eb00d1850 2023-07-14T13:32:34.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2ead59a640 1 -- 172.21.15.5:0/1517940612 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f2ea4001680 con 0x7f2eb00d1850 2023-07-14T13:32:34.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2eaed9d640 1 --2- 172.21.15.5:0/1517940612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2eb015fd60 0x7f2eb00d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:32:34.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2ead59a640 1 -- 172.21.15.5:0/1517940612 >> v1:172.21.15.5:6789/0 conn(0x7f2eb00d1850 legacy=0x7f2eb015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:34.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2ead59a640 1 --2- 172.21.15.5:0/1517940612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2eb015fd60 0x7f2e98003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:34.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2ead59a640 1 --2- 172.21.15.5:0/1517940612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e98003ec0 0x7f2e980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:34.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2ead59a640 1 --2- 172.21.15.5:0/1517940612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e98004d10 0x7f2e98005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:34.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2ead59a640 1 -- 172.21.15.5:0/1517940612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb0160600 con 0x7f2e98004d10 2023-07-14T13:32:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2ead59a640 1 -- 172.21.15.5:0/1517940612 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e98004640 con 0x7f2e98003ec0 2023-07-14T13:32:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.424+0000 7f2ead59a640 1 -- 172.21.15.5:0/1517940612 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9800ba10 con 0x7f2eb015fd60 2023-07-14T13:32:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.428+0000 7f2eaed9d640 1 --2- 172.21.15.5:0/1517940612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e98004d10 0x7f2e98005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.428+0000 7f2eae59c640 1 --2- 172.21.15.5:0/1517940612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2eb015fd60 0x7f2e98003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.428+0000 7f2eadd9b640 1 --2- 172.21.15.5:0/1517940612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e98003ec0 0x7f2e980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.428+0000 7f2eaed9d640 1 -- 172.21.15.5:0/1517940612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2eb015fd60 msgr2=0x7f2e98003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.428+0000 7f2eaed9d640 1 --2- 172.21.15.5:0/1517940612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2eb015fd60 0x7f2e98003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:34.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.428+0000 7f2eaed9d640 1 -- 172.21.15.5:0/1517940612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e98003ec0 msgr2=0x7f2e980047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:34.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.428+0000 7f2eaed9d640 1 --2- 172.21.15.5:0/1517940612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e98003ec0 0x7f2e980047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:34.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.428+0000 7f2eaed9d640 1 -- 172.21.15.5:0/1517940612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea8009a70 con 0x7f2e98004d10 2023-07-14T13:32:34.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.428+0000 7f2eaed9d640 1 --2- 172.21.15.5:0/1517940612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e98004d10 0x7f2e98005180 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f2ea800e350 tx=0x7f2ea801cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ceb7841ba9b9cee server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:34.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.428+0000 7f2ead59a640 1 -- 172.21.15.5:0/1517940612 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea80a5df0 con 0x7f2e98004d10 2023-07-14T13:32:34.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.428+0000 7f2ead59a640 1 -- 172.21.15.5:0/1517940612 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea800f040 con 0x7f2e98004d10 2023-07-14T13:32:34.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.428+0000 7f2ead59a640 1 -- 172.21.15.5:0/1517940612 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea80ad640 con 0x7f2e98004d10 2023-07-14T13:32:34.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.432+0000 7f2eb4bfa640 1 -- 172.21.15.5:0/1517940612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e98004d10 msgr2=0x7f2e98005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:34.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.432+0000 7f2eb4bfa640 1 --2- 172.21.15.5:0/1517940612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e98004d10 0x7f2e98005180 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f2ea800e350 tx=0x7f2ea801cde0 comp rx=0 tx=0).stop 2023-07-14T13:32:34.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.432+0000 7f2eaed9d640 1 -- 172.21.15.5:0/1517940612 reap_dead start 2023-07-14T13:32:34.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.432+0000 7f2eb4bfa640 1 -- 172.21.15.5:0/1517940612 shutdown_connections 2023-07-14T13:32:34.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.432+0000 7f2eb4bfa640 1 -- 172.21.15.5:0/1517940612 >> 172.21.15.5:0/1517940612 conn(0x7f2eb00650b0 msgr2=0x7f2eb00654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:34.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.432+0000 7f2eb4bfa640 1 -- 172.21.15.5:0/1517940612 shutdown_connections 2023-07-14T13:32:34.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.432+0000 7f2eb4bfa640 1 -- 172.21.15.5:0/1517940612 wait complete. 2023-07-14T13:32:34.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.432+0000 7f2eb4bfa640 1 Processor -- start 2023-07-14T13:32:34.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.432+0000 7f2eb4bfa640 1 -- start start 2023-07-14T13:32:34.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.432+0000 7f2eb4bfa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e98004d10 0x7f2eb0148b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:34.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.432+0000 7f2eb4bfa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2eb014f630 0x7f2eb015e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:34.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.432+0000 7f2eb4bfa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2eb015ed10 0x7f2eb00b5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:34.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.432+0000 7f2eb4bfa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb00ca4a0 con 0x7f2e98004d10 2023-07-14T13:32:34.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.432+0000 7f2eb4bfa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb00c9470 con 0x7f2eb014f630 2023-07-14T13:32:34.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.432+0000 7f2eb4bfa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb00c96e0 con 0x7f2eb015ed10 2023-07-14T13:32:34.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.432+0000 7f2eae59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e98004d10 0x7f2eb0148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:34.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.432+0000 7f2eae59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e98004d10 0x7f2eb0148b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39912/0 (socket says 172.21.15.5:39912) 2023-07-14T13:32:34.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.432+0000 7f2eae59c640 1 -- 172.21.15.5:0/2010839170 learned_addr learned my addr 172.21.15.5:0/2010839170 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:34.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.436+0000 7f2eae59c640 1 -- 172.21.15.5:0/2010839170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2eb015ed10 msgr2=0x7f2eb00b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:34.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.436+0000 7f2eae59c640 1 --2- 172.21.15.5:0/2010839170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2eb015ed10 0x7f2eb00b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:34.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.436+0000 7f2eae59c640 1 -- 172.21.15.5:0/2010839170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2eb014f630 msgr2=0x7f2eb015e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.436+0000 7f2eae59c640 1 --2- 172.21.15.5:0/2010839170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2eb014f630 0x7f2eb015e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.436+0000 7f2eae59c640 1 -- 172.21.15.5:0/2010839170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb00c99c0 con 0x7f2e98004d10 2023-07-14T13:32:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.436+0000 7f2eae59c640 1 --2- 172.21.15.5:0/2010839170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e98004d10 0x7f2eb0148b10 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0011ad0 tx=0x7f2ea0011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.436+0000 7f2e9effd640 1 -- 172.21.15.5:0/2010839170 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea000fb30 con 0x7f2e98004d10 2023-07-14T13:32:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.436+0000 7f2e9effd640 1 -- 172.21.15.5:0/2010839170 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea000fc90 con 0x7f2e98004d10 2023-07-14T13:32:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.436+0000 7f2e9effd640 1 -- 172.21.15.5:0/2010839170 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0014440 con 0x7f2e98004d10 2023-07-14T13:32:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.436+0000 7f2eb4bfa640 1 -- 172.21.15.5:0/2010839170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb00c9ca0 con 0x7f2e98004d10 2023-07-14T13:32:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.436+0000 7f2eb4bfa640 1 -- 172.21.15.5:0/2010839170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb0149050 con 0x7f2e98004d10 2023-07-14T13:32:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.436+0000 7f2eb4bfa640 1 -- 172.21.15.5:0/2010839170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb00c9220 con 0x7f2e98004d10 2023-07-14T13:32:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.436+0000 7f2e9effd640 1 -- 172.21.15.5:0/2010839170 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2ea00145c0 con 0x7f2e98004d10 2023-07-14T13:32:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.440+0000 7f2e9effd640 1 --2- 172.21.15.5:0/2010839170 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f2e900663a0 0x7f2e90068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.440+0000 7f2e9effd640 1 -- 172.21.15.5:0/2010839170 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f2ea0084770 con 0x7f2e98004d10 2023-07-14T13:32:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.440+0000 7f2eadd9b640 1 --2- 172.21.15.5:0/2010839170 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f2e900663a0 0x7f2e90068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.440+0000 7f2eadd9b640 1 --2- 172.21.15.5:0/2010839170 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f2e900663a0 0x7f2e90068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4001060 tx=0x7f2ea4000ff0 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:34.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.444+0000 7f2e9effd640 1 -- 172.21.15.5:0/2010839170 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2ea0051ac0 con 0x7f2e98004d10 2023-07-14T13:32:34.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.636+0000 7f2eb4bfa640 1 -- 172.21.15.5:0/2010839170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2eb00678d0 con 0x7f2e98004d10 2023-07-14T13:32:34.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.636+0000 7f2e9effd640 1 -- 172.21.15.5:0/2010839170 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4714 (secure 0 0 0) 0x7f2ea00550e0 con 0x7f2e98004d10 2023-07-14T13:32:34.637 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:34.637 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8669,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3337947661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3337947661},{"type":"v1","addr":"172.21.15.154:6835","nonce":3337947661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8675,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/695363750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":695363750},{"type":"v1","addr":"172.21.15.154:6837","nonce":695363750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":10542,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1412864639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1412864639},{"type":"v1","addr":"172.21.15.5:6833","nonce":1412864639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:32:30.624611+0000","modified":"2023-07-14T13:32:34.244769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10545":{"gid":10545,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6835/1752765831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1752765831},{"type":"v1","addr":"172.21.15.5:6835","nonce":1752765831}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-14T13:32:34.637 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 92 2023-07-14T13:32:34.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.636+0000 7f2eb4bfa640 1 -- 172.21.15.5:0/2010839170 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f2e900663a0 msgr2=0x7f2e90068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:34.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.636+0000 7f2eb4bfa640 1 --2- 172.21.15.5:0/2010839170 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f2e900663a0 0x7f2e90068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4001060 tx=0x7f2ea4000ff0 comp rx=0 tx=0).stop 2023-07-14T13:32:34.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.636+0000 7f2eb4bfa640 1 -- 172.21.15.5:0/2010839170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e98004d10 msgr2=0x7f2eb0148b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:34.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.636+0000 7f2eb4bfa640 1 --2- 172.21.15.5:0/2010839170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e98004d10 0x7f2eb0148b10 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0011ad0 tx=0x7f2ea0011f90 comp rx=0 tx=0).stop 2023-07-14T13:32:34.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.636+0000 7f2eb4bfa640 1 -- 172.21.15.5:0/2010839170 shutdown_connections 2023-07-14T13:32:34.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.636+0000 7f2eb4bfa640 1 --2- 172.21.15.5:0/2010839170 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f2e900663a0 0x7f2e90068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:34.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.636+0000 7f2eb4bfa640 1 --2- 172.21.15.5:0/2010839170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2eb015ed10 0x7f2eb00b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:34.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.636+0000 7f2eb4bfa640 1 --2- 172.21.15.5:0/2010839170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2eb014f630 0x7f2eb015e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:34.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.636+0000 7f2eb4bfa640 1 --2- 172.21.15.5:0/2010839170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e98004d10 0x7f2eb0148b10 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:34.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.636+0000 7f2eb4bfa640 1 -- 172.21.15.5:0/2010839170 >> 172.21.15.5:0/2010839170 conn(0x7f2eb00650b0 msgr2=0x7f2eb00cfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:34.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.636+0000 7f2eb4bfa640 1 -- 172.21.15.5:0/2010839170 shutdown_connections 2023-07-14T13:32:34.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.636+0000 7f2eb4bfa640 1 -- 172.21.15.5:0/2010839170 wait complete. 2023-07-14T13:32:34.658 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:32:34.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.800+0000 7f7df5f11640 1 Processor -- start 2023-07-14T13:32:34.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.800+0000 7f7df5f11640 1 -- start start 2023-07-14T13:32:34.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.804+0000 7f7df5f11640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7df00b1e60 0x7f7df006e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:34.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.804+0000 7f7df5f11640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df006e6a0 con 0x7f7df00ae1f0 2023-07-14T13:32:34.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.804+0000 7f7df5f11640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df00b2260 con 0x7f7df006c430 2023-07-14T13:32:34.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.804+0000 7f7df5f11640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df00b24f0 con 0x7f7df00b1e60 2023-07-14T13:32:34.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.804+0000 7f7deffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7df00b1e60 0x7f7df006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:34.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.804+0000 7f7deffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7df00b1e60 0x7f7df006e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39926/0 (socket says 172.21.15.5:39926) 2023-07-14T13:32:34.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.804+0000 7f7deffff640 1 -- 172.21.15.5:0/3355249452 learned_addr learned my addr 172.21.15.5:0/3355249452 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:34.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.804+0000 7f7def7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7df00ae1f0 0x7f7df006bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57618/0 (socket says 172.21.15.5:57618) 2023-07-14T13:32:34.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.804+0000 7f7deffff640 1 -- 172.21.15.5:0/3355249452 >> v1:172.21.15.154:6789/0 conn(0x7f7df006c430 legacy=0x7f7df0069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:34.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.804+0000 7f7deffff640 1 -- 172.21.15.5:0/3355249452 >> v1:172.21.15.5:6789/0 conn(0x7f7df00ae1f0 legacy=0x7f7df006bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:34.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.804+0000 7f7dee7fc640 1 -- 172.21.15.5:0/3355249452 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774645565 0 0) 0x7f7de0001120 con 0x7f7df00ae1f0 2023-07-14T13:32:34.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.804+0000 7f7deffff640 1 -- 172.21.15.5:0/3355249452 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df00b27d0 con 0x7f7df00b1e60 2023-07-14T13:32:34.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.804+0000 7f7deffff640 1 --2- 172.21.15.5:0/3355249452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7df00b1e60 0x7f7df006e160 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f7de8009e50 tx=0x7f7de801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431111649ed6bff1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:34.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.804+0000 7f7dee7fc640 1 -- 172.21.15.5:0/3355249452 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de80a58a0 con 0x7f7df00b1e60 2023-07-14T13:32:34.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.804+0000 7f7dee7fc640 1 -- 172.21.15.5:0/3355249452 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de80a5a00 con 0x7f7df00b1e60 2023-07-14T13:32:34.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.804+0000 7f7dee7fc640 1 -- 172.21.15.5:0/3355249452 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de80a5d90 con 0x7f7df00b1e60 2023-07-14T13:32:34.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.808+0000 7f7df5f11640 1 -- 172.21.15.5:0/3355249452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7df00b1e60 msgr2=0x7f7df006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:34.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.808+0000 7f7df5f11640 1 --2- 172.21.15.5:0/3355249452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7df00b1e60 0x7f7df006e160 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f7de8009e50 tx=0x7f7de801c9e0 comp rx=0 tx=0).stop 2023-07-14T13:32:34.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.808+0000 7f7df5f11640 1 -- 172.21.15.5:0/3355249452 shutdown_connections 2023-07-14T13:32:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.808+0000 7f7df5f11640 1 --2- 172.21.15.5:0/3355249452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7df00b1e60 0x7f7df006e160 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.808+0000 7f7df5f11640 1 -- 172.21.15.5:0/3355249452 >> 172.21.15.5:0/3355249452 conn(0x7f7df00b1300 msgr2=0x7f7df00ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.808+0000 7f7df5f11640 1 -- 172.21.15.5:0/3355249452 shutdown_connections 2023-07-14T13:32:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.808+0000 7f7df5f11640 1 -- 172.21.15.5:0/3355249452 wait complete. 2023-07-14T13:32:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.808+0000 7f7df5f11640 1 Processor -- start 2023-07-14T13:32:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.808+0000 7f7df5f11640 1 -- start start 2023-07-14T13:32:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.808+0000 7f7df5f11640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7df006c430 0x7f7df015ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.808+0000 7f7df5f11640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7df00ae1f0 0x7f7df00cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:34.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.808+0000 7f7df5f11640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7df00b1e60 0x7f7df00cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:34.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.808+0000 7f7df5f11640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df0140ed0 con 0x7f7df00ae1f0 2023-07-14T13:32:34.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.808+0000 7f7df5f11640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df0140630 con 0x7f7df00b1e60 2023-07-14T13:32:34.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.808+0000 7f7df5f11640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df0140910 con 0x7f7df006c430 2023-07-14T13:32:34.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.808+0000 7f7deeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7df00ae1f0 0x7f7df00cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:34.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.808+0000 7f7deeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7df00ae1f0 0x7f7df00cdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39940/0 (socket says 172.21.15.5:39940) 2023-07-14T13:32:34.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.808+0000 7f7deeffd640 1 -- 172.21.15.5:0/2005602452 learned_addr learned my addr 172.21.15.5:0/2005602452 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:34.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.808+0000 7f7deffff640 1 --2- 172.21.15.5:0/2005602452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7df00b1e60 0x7f7df00cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:34.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.808+0000 7f7def7fe640 1 --2- 172.21.15.5:0/2005602452 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7df006c430 0x7f7df015ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:34.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.808+0000 7f7deeffd640 1 -- 172.21.15.5:0/2005602452 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7df006c430 msgr2=0x7f7df015ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:34.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.812+0000 7f7deeffd640 1 --2- 172.21.15.5:0/2005602452 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7df006c430 0x7f7df015ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:34.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.812+0000 7f7deeffd640 1 -- 172.21.15.5:0/2005602452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7df00b1e60 msgr2=0x7f7df00cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:34.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.812+0000 7f7deeffd640 1 --2- 172.21.15.5:0/2005602452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7df00b1e60 0x7f7df00cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:34.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.812+0000 7f7deeffd640 1 -- 172.21.15.5:0/2005602452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de8009b30 con 0x7f7df00ae1f0 2023-07-14T13:32:34.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.812+0000 7f7deffff640 1 --2- 172.21.15.5:0/2005602452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7df00b1e60 0x7f7df00cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:32:34.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.812+0000 7f7def7fe640 1 --2- 172.21.15.5:0/2005602452 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7df006c430 0x7f7df015ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:32:34.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.812+0000 7f7deeffd640 1 --2- 172.21.15.5:0/2005602452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7df00ae1f0 0x7f7df00cdce0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f7de400c400 tx=0x7f7de400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.812+0000 7f7dd7fff640 1 -- 172.21.15.5:0/2005602452 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de40052d0 con 0x7f7df00ae1f0 2023-07-14T13:32:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.812+0000 7f7df5f11640 1 -- 172.21.15.5:0/2005602452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df00b3710 con 0x7f7df00ae1f0 2023-07-14T13:32:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.812+0000 7f7dd7fff640 1 -- 172.21.15.5:0/2005602452 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de4005430 con 0x7f7df00ae1f0 2023-07-14T13:32:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.812+0000 7f7dd7fff640 1 -- 172.21.15.5:0/2005602452 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de4003840 con 0x7f7df00ae1f0 2023-07-14T13:32:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.812+0000 7f7df5f11640 1 -- 172.21.15.5:0/2005602452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df013c1c0 con 0x7f7df00ae1f0 2023-07-14T13:32:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.812+0000 7f7df5f11640 1 -- 172.21.15.5:0/2005602452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7df00678d0 con 0x7f7df00ae1f0 2023-07-14T13:32:34.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.812+0000 7f7dd7fff640 1 -- 172.21.15.5:0/2005602452 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7de40039a0 con 0x7f7df00ae1f0 2023-07-14T13:32:34.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.812+0000 7f7dd7fff640 1 --2- 172.21.15.5:0/2005602452 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f7ddc0663a0 0x7f7ddc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:34.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.812+0000 7f7dd7fff640 1 -- 172.21.15.5:0/2005602452 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f7de40835c0 con 0x7f7df00ae1f0 2023-07-14T13:32:34.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.812+0000 7f7def7fe640 1 --2- 172.21.15.5:0/2005602452 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f7ddc0663a0 0x7f7ddc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:34.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.816+0000 7f7def7fe640 1 --2- 172.21.15.5:0/2005602452 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f7ddc0663a0 0x7f7ddc068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7de0007fd0 tx=0x7f7de0009040 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:34.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.816+0000 7f7dd7fff640 1 -- 172.21.15.5:0/2005602452 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f7de40507f0 con 0x7f7df00ae1f0 2023-07-14T13:32:34.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.976+0000 7f7df5f11640 1 -- 172.21.15.5:0/2005602452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7df0066810 con 0x7f7df00ae1f0 2023-07-14T13:32:34.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.976+0000 7f7dd7fff640 1 -- 172.21.15.5:0/2005602452 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) v1 ==== 74+0+18289 (secure 0 0 0) 0x7f7de4053e10 con 0x7f7df00ae1f0 2023-07-14T13:32:34.978 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:34.978 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":191,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:32:32.184985+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:32:28.300155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-14T13:32:29.622154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:32:34.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.980+0000 7f7df5f11640 1 -- 172.21.15.5:0/2005602452 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f7ddc0663a0 msgr2=0x7f7ddc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:34.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.980+0000 7f7df5f11640 1 --2- 172.21.15.5:0/2005602452 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f7ddc0663a0 0x7f7ddc068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7de0007fd0 tx=0x7f7de0009040 comp rx=0 tx=0).stop 2023-07-14T13:32:34.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.980+0000 7f7df5f11640 1 -- 172.21.15.5:0/2005602452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7df00ae1f0 msgr2=0x7f7df00cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.980+0000 7f7df5f11640 1 --2- 172.21.15.5:0/2005602452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7df00ae1f0 0x7f7df00cdce0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f7de400c400 tx=0x7f7de400c8c0 comp rx=0 tx=0).stop 2023-07-14T13:32:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.980+0000 7f7df5f11640 1 -- 172.21.15.5:0/2005602452 shutdown_connections 2023-07-14T13:32:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.980+0000 7f7df5f11640 1 --2- 172.21.15.5:0/2005602452 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f7ddc0663a0 0x7f7ddc068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.980+0000 7f7df5f11640 1 --2- 172.21.15.5:0/2005602452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7df00b1e60 0x7f7df00cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.980+0000 7f7df5f11640 1 --2- 172.21.15.5:0/2005602452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7df00ae1f0 0x7f7df00cdce0 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.980+0000 7f7df5f11640 1 --2- 172.21.15.5:0/2005602452 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7df006c430 0x7f7df015ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.980+0000 7f7df5f11640 1 -- 172.21.15.5:0/2005602452 >> 172.21.15.5:0/2005602452 conn(0x7f7df00b1300 msgr2=0x7f7df00ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.980+0000 7f7df5f11640 1 -- 172.21.15.5:0/2005602452 shutdown_connections 2023-07-14T13:32:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:34.980+0000 7f7df5f11640 1 -- 172.21.15.5:0/2005602452 wait complete. 2023-07-14T13:32:35.000 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-14T13:32:35.001 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:32:35.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.144+0000 7f4bbefc5640 1 Processor -- start 2023-07-14T13:32:35.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.144+0000 7f4bbefc5640 1 -- start start 2023-07-14T13:32:35.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.144+0000 7f4bbefc5640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4bb815fd60 0x7f4bb80d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:35.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.144+0000 7f4bbefc5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4bb80d1850 0x7f4bb80d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:35.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.144+0000 7f4bbefc5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb80ccaf0 con 0x7f4bb80b7c70 2023-07-14T13:32:35.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.144+0000 7f4bbefc5640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bb80d1190 con 0x7f4bb815fd60 2023-07-14T13:32:35.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.144+0000 7f4bbefc5640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bb8160600 con 0x7f4bb80d1850 2023-07-14T13:32:35.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.144+0000 7f4bb7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4bb815fd60 0x7f4bb80d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:35.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.144+0000 7f4bbcd61640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4bb80b7c70 0x7f4bb815f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57632/0 (socket says 172.21.15.5:57632) 2023-07-14T13:32:35.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.144+0000 7f4bbcd61640 1 -- 172.21.15.5:0/1533745309 learned_addr learned my addr 172.21.15.5:0/1533745309 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:35.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.144+0000 7f4bbd562640 1 --2- 172.21.15.5:0/1533745309 >> v2:172.21.15.154:3300/0 conn(0x7f4bb80d1850 0x7f4bb80d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:35.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.144+0000 7f4bb7fff640 1 -- 172.21.15.5:0/1533745309 >> v2:172.21.15.154:3300/0 conn(0x7f4bb80d1850 msgr2=0x7f4bb80d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:35.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.144+0000 7f4bb7fff640 1 --2- 172.21.15.5:0/1533745309 >> v2:172.21.15.154:3300/0 conn(0x7f4bb80d1850 0x7f4bb80d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:35.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.144+0000 7f4bb7fff640 1 -- 172.21.15.5:0/1533745309 >> v1:172.21.15.5:6789/0 conn(0x7f4bb80b7c70 legacy=0x7f4bb815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:35.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.144+0000 7f4bb7fff640 1 -- 172.21.15.5:0/1533745309 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb8160320 con 0x7f4bb815fd60 2023-07-14T13:32:35.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.148+0000 7f4bb7fff640 1 --2- 172.21.15.5:0/1533745309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bb815fd60 0x7f4bb80d0c50 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f4bb80b4040 tx=0x7f4ba401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31f731f3f03df11 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:35.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.148+0000 7f4bb77fe640 1 -- 172.21.15.5:0/1533745309 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba40a7070 con 0x7f4bb815fd60 2023-07-14T13:32:35.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.148+0000 7f4bb77fe640 1 -- 172.21.15.5:0/1533745309 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba40ab430 con 0x7f4bb815fd60 2023-07-14T13:32:35.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.148+0000 7f4bb77fe640 1 -- 172.21.15.5:0/1533745309 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba40ab7c0 con 0x7f4bb815fd60 2023-07-14T13:32:35.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.148+0000 7f4bbefc5640 1 -- 172.21.15.5:0/1533745309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bb815fd60 msgr2=0x7f4bb80d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:35.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.148+0000 7f4bbefc5640 1 --2- 172.21.15.5:0/1533745309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bb815fd60 0x7f4bb80d0c50 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f4bb80b4040 tx=0x7f4ba401c410 comp rx=0 tx=0).stop 2023-07-14T13:32:35.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.148+0000 7f4bbefc5640 1 -- 172.21.15.5:0/1533745309 shutdown_connections 2023-07-14T13:32:35.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.148+0000 7f4bbefc5640 1 --2- 172.21.15.5:0/1533745309 >> v2:172.21.15.154:3300/0 conn(0x7f4bb80d1850 0x7f4bb80d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:35.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.148+0000 7f4bbefc5640 1 --2- 172.21.15.5:0/1533745309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bb815fd60 0x7f4bb80d0c50 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:35.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.148+0000 7f4bbefc5640 1 -- 172.21.15.5:0/1533745309 >> 172.21.15.5:0/1533745309 conn(0x7f4bb80650b0 msgr2=0x7f4bb80654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:35.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.148+0000 7f4bbefc5640 1 -- 172.21.15.5:0/1533745309 shutdown_connections 2023-07-14T13:32:35.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.148+0000 7f4bbefc5640 1 -- 172.21.15.5:0/1533745309 wait complete. 2023-07-14T13:32:35.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.152+0000 7f4bbefc5640 1 Processor -- start 2023-07-14T13:32:35.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.152+0000 7f4bbefc5640 1 -- start start 2023-07-14T13:32:35.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.152+0000 7f4bbefc5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bb80b7c70 0x7f4bb814a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:35.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.152+0000 7f4bbefc5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bb80d1850 0x7f4bb815a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:35.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.152+0000 7f4bbefc5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bb815fd60 0x7f4bb815aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:35.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.152+0000 7f4bbefc5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb814c410 con 0x7f4bb80d1850 2023-07-14T13:32:35.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.152+0000 7f4bbefc5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb814bf80 con 0x7f4bb80b7c70 2023-07-14T13:32:35.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.152+0000 7f4bbefc5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb814ae70 con 0x7f4bb815fd60 2023-07-14T13:32:35.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.152+0000 7f4bb7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bb80d1850 0x7f4bb815a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:35.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.152+0000 7f4bb7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bb80d1850 0x7f4bb815a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39954/0 (socket says 172.21.15.5:39954) 2023-07-14T13:32:35.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.152+0000 7f4bb7fff640 1 -- 172.21.15.5:0/3996156014 learned_addr learned my addr 172.21.15.5:0/3996156014 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:35.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.152+0000 7f4bbcd61640 1 --2- 172.21.15.5:0/3996156014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bb80b7c70 0x7f4bb814a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:35.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.152+0000 7f4bbd562640 1 --2- 172.21.15.5:0/3996156014 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bb815fd60 0x7f4bb815aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:35.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.152+0000 7f4bb7fff640 1 -- 172.21.15.5:0/3996156014 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bb815fd60 msgr2=0x7f4bb815aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:35.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.152+0000 7f4bb7fff640 1 --2- 172.21.15.5:0/3996156014 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bb815fd60 0x7f4bb815aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:35.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.152+0000 7f4bb7fff640 1 -- 172.21.15.5:0/3996156014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bb80b7c70 msgr2=0x7f4bb814a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:35.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.152+0000 7f4bb7fff640 1 --2- 172.21.15.5:0/3996156014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bb80b7c70 0x7f4bb814a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:35.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.152+0000 7f4bb7fff640 1 -- 172.21.15.5:0/3996156014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba4009420 con 0x7f4bb80d1850 2023-07-14T13:32:35.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.152+0000 7f4bbd562640 1 --2- 172.21.15.5:0/3996156014 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bb815fd60 0x7f4bb815aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:35.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.152+0000 7f4bb7fff640 1 --2- 172.21.15.5:0/3996156014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bb80d1850 0x7f4bb815a9b0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f4ba401a040 tx=0x7f4ba40191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:35.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.152+0000 7f4bb57fa640 1 -- 172.21.15.5:0/3996156014 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba40abe90 con 0x7f4bb80d1850 2023-07-14T13:32:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.152+0000 7f4bb57fa640 1 -- 172.21.15.5:0/3996156014 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba40bf450 con 0x7f4bb80d1850 2023-07-14T13:32:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.152+0000 7f4bb57fa640 1 -- 172.21.15.5:0/3996156014 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba40bf7e0 con 0x7f4bb80d1850 2023-07-14T13:32:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.152+0000 7f4bbefc5640 1 -- 172.21.15.5:0/3996156014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb80cee20 con 0x7f4bb80d1850 2023-07-14T13:32:35.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.156+0000 7f4bbefc5640 1 -- 172.21.15.5:0/3996156014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb80cc110 con 0x7f4bb80d1850 2023-07-14T13:32:35.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.156+0000 7f4bbefc5640 1 -- 172.21.15.5:0/3996156014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb80cc300 con 0x7f4bb80d1850 2023-07-14T13:32:35.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.156+0000 7f4bb57fa640 1 -- 172.21.15.5:0/3996156014 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4ba40b43f0 con 0x7f4bb80d1850 2023-07-14T13:32:35.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.156+0000 7f4bb57fa640 1 --2- 172.21.15.5:0/3996156014 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f4b9c0663a0 0x7f4b9c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:35.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.156+0000 7f4bb57fa640 1 -- 172.21.15.5:0/3996156014 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f4ba411e4b0 con 0x7f4bb80d1850 2023-07-14T13:32:35.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.156+0000 7f4bbcd61640 1 --2- 172.21.15.5:0/3996156014 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f4b9c0663a0 0x7f4b9c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:35.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.160+0000 7f4bbcd61640 1 --2- 172.21.15.5:0/3996156014 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f4b9c0663a0 0x7f4b9c068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4bac005890 tx=0x7f4bac009040 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:35.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.160+0000 7f4bb57fa640 1 -- 172.21.15.5:0/3996156014 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4ba40eb790 con 0x7f4bb80d1850 2023-07-14T13:32:35.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.316+0000 7f4bbefc5640 1 -- 172.21.15.5:0/3996156014 --> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4bb80678d0 con 0x7f4b9c0663a0 2023-07-14T13:32:35.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.328+0000 7f4bb57fa640 1 -- 172.21.15.5:0/3996156014 <== mgr.8477 v2:172.21.15.154:6832/2194391064 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311654 (secure 0 0 0) 0x7f4bb80678d0 con 0x7f4b9c0663a0 2023-07-14T13:32:35.331 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:35.333 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:32:35.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.332+0000 7f4bbefc5640 1 -- 172.21.15.5:0/3996156014 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f4b9c0663a0 msgr2=0x7f4b9c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:35.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.332+0000 7f4bbefc5640 1 --2- 172.21.15.5:0/3996156014 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f4b9c0663a0 0x7f4b9c068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4bac005890 tx=0x7f4bac009040 comp rx=0 tx=0).stop 2023-07-14T13:32:35.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.332+0000 7f4bbefc5640 1 -- 172.21.15.5:0/3996156014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bb80d1850 msgr2=0x7f4bb815a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:35.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.332+0000 7f4bbefc5640 1 --2- 172.21.15.5:0/3996156014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bb80d1850 0x7f4bb815a9b0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f4ba401a040 tx=0x7f4ba40191b0 comp rx=0 tx=0).stop 2023-07-14T13:32:35.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.332+0000 7f4bbefc5640 1 -- 172.21.15.5:0/3996156014 shutdown_connections 2023-07-14T13:32:35.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.332+0000 7f4bbefc5640 1 --2- 172.21.15.5:0/3996156014 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f4b9c0663a0 0x7f4b9c068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:35.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.332+0000 7f4bbefc5640 1 --2- 172.21.15.5:0/3996156014 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4bb815fd60 0x7f4bb815aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:35.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.332+0000 7f4bbefc5640 1 --2- 172.21.15.5:0/3996156014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bb80d1850 0x7f4bb815a9b0 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:35.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.332+0000 7f4bbefc5640 1 --2- 172.21.15.5:0/3996156014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bb80b7c70 0x7f4bb814a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:35.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.332+0000 7f4bbefc5640 1 -- 172.21.15.5:0/3996156014 >> 172.21.15.5:0/3996156014 conn(0x7f4bb80650b0 msgr2=0x7f4bb80cfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:35.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.332+0000 7f4bbefc5640 1 -- 172.21.15.5:0/3996156014 shutdown_connections 2023-07-14T13:32:35.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.332+0000 7f4bbefc5640 1 -- 172.21.15.5:0/3996156014 wait complete. 2023-07-14T13:32:35.351 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-07-14T13:32:34.071912+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":584,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":365,"ondisk_log_size":365,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":375648,"kb_used_data":19872,"kb_used_omap":0,"kb_used_meta":355712,"kb_avail":754599072,"statfs":{"total":773094113280,"available":772709449728,"internally_reserved":0,"allocated":20348928,"data_stored":11018294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":364249088},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.854258"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.193889+0000","last_change":"2023-07-14T13:32:31.203938+0000","last_active":"2023-07-14T13:32:32.193889+0000","last_peered":"2023-07-14T13:32:32.193889+0000","last_clean":"2023-07-14T13:32:32.193889+0000","last_became_active":"2023-07-14T13:32:31.203601+0000","last_became_peered":"2023-07-14T13:32:31.203601+0000","last_unstale":"2023-07-14T13:32:32.193889+0000","last_undegraded":"2023-07-14T13:32:32.193889+0000","last_fullsized":"2023-07-14T13:32:32.193889+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:46:08.167816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205409+0000","last_change":"2023-07-14T13:32:31.214732+0000","last_active":"2023-07-14T13:32:32.205409+0000","last_peered":"2023-07-14T13:32:32.205409+0000","last_clean":"2023-07-14T13:32:32.205409+0000","last_became_active":"2023-07-14T13:32:31.214438+0000","last_became_peered":"2023-07-14T13:32:31.214438+0000","last_unstale":"2023-07-14T13:32:32.205409+0000","last_undegraded":"2023-07-14T13:32:32.205409+0000","last_fullsized":"2023-07-14T13:32:32.205409+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:25:21.468757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.193402+0000","last_change":"2023-07-14T13:32:31.204880+0000","last_active":"2023-07-14T13:32:32.193402+0000","last_peered":"2023-07-14T13:32:32.193402+0000","last_clean":"2023-07-14T13:32:32.193402+0000","last_became_active":"2023-07-14T13:32:31.204592+0000","last_became_peered":"2023-07-14T13:32:31.204592+0000","last_unstale":"2023-07-14T13:32:32.193402+0000","last_undegraded":"2023-07-14T13:32:32.193402+0000","last_fullsized":"2023-07-14T13:32:32.193402+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:37:54.795028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.193552+0000","last_change":"2023-07-14T13:32:31.200422+0000","last_active":"2023-07-14T13:32:32.193552+0000","last_peered":"2023-07-14T13:32:32.193552+0000","last_clean":"2023-07-14T13:32:32.193552+0000","last_became_active":"2023-07-14T13:32:31.200137+0000","last_became_peered":"2023-07-14T13:32:31.200137+0000","last_unstale":"2023-07-14T13:32:32.193552+0000","last_undegraded":"2023-07-14T13:32:32.193552+0000","last_fullsized":"2023-07-14T13:32:32.193552+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:26:07.628051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190915+0000","last_change":"2023-07-14T13:32:31.205389+0000","last_active":"2023-07-14T13:32:32.190915+0000","last_peered":"2023-07-14T13:32:32.190915+0000","last_clean":"2023-07-14T13:32:32.190915+0000","last_became_active":"2023-07-14T13:32:31.205070+0000","last_became_peered":"2023-07-14T13:32:31.205070+0000","last_unstale":"2023-07-14T13:32:32.190915+0000","last_undegraded":"2023-07-14T13:32:32.190915+0000","last_fullsized":"2023-07-14T13:32:32.190915+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:16:09.294013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205102+0000","last_change":"2023-07-14T13:32:31.208121+0000","last_active":"2023-07-14T13:32:32.205102+0000","last_peered":"2023-07-14T13:32:32.205102+0000","last_clean":"2023-07-14T13:32:32.205102+0000","last_became_active":"2023-07-14T13:32:31.207798+0000","last_became_peered":"2023-07-14T13:32:31.207798+0000","last_unstale":"2023-07-14T13:32:32.205102+0000","last_undegraded":"2023-07-14T13:32:32.205102+0000","last_fullsized":"2023-07-14T13:32:32.205102+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:47:49.243329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.189638+0000","last_change":"2023-07-14T13:32:31.206567+0000","last_active":"2023-07-14T13:32:32.189638+0000","last_peered":"2023-07-14T13:32:32.189638+0000","last_clean":"2023-07-14T13:32:32.189638+0000","last_became_active":"2023-07-14T13:32:31.206300+0000","last_became_peered":"2023-07-14T13:32:31.206300+0000","last_unstale":"2023-07-14T13:32:32.189638+0000","last_undegraded":"2023-07-14T13:32:32.189638+0000","last_fullsized":"2023-07-14T13:32:32.189638+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:09:38.610886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.189926+0000","last_change":"2023-07-14T13:32:31.212134+0000","last_active":"2023-07-14T13:32:32.189926+0000","last_peered":"2023-07-14T13:32:32.189926+0000","last_clean":"2023-07-14T13:32:32.189926+0000","last_became_active":"2023-07-14T13:32:31.211792+0000","last_became_peered":"2023-07-14T13:32:31.211792+0000","last_unstale":"2023-07-14T13:32:32.189926+0000","last_undegraded":"2023-07-14T13:32:32.189926+0000","last_fullsized":"2023-07-14T13:32:32.189926+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:57:31.559095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190005+0000","last_change":"2023-07-14T13:32:31.206271+0000","last_active":"2023-07-14T13:32:32.190005+0000","last_peered":"2023-07-14T13:32:32.190005+0000","last_clean":"2023-07-14T13:32:32.190005+0000","last_became_active":"2023-07-14T13:32:31.205994+0000","last_became_peered":"2023-07-14T13:32:31.205994+0000","last_unstale":"2023-07-14T13:32:32.190005+0000","last_undegraded":"2023-07-14T13:32:32.190005+0000","last_fullsized":"2023-07-14T13:32:32.190005+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:19:48.546864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190002+0000","last_change":"2023-07-14T13:32:31.209730+0000","last_active":"2023-07-14T13:32:32.190002+0000","last_peered":"2023-07-14T13:32:32.190002+0000","last_clean":"2023-07-14T13:32:32.190002+0000","last_became_active":"2023-07-14T13:32:31.209453+0000","last_became_peered":"2023-07-14T13:32:31.209453+0000","last_unstale":"2023-07-14T13:32:32.190002+0000","last_undegraded":"2023-07-14T13:32:32.190002+0000","last_fullsized":"2023-07-14T13:32:32.190002+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:05:11.283813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.206439+0000","last_change":"2023-07-14T13:32:31.205033+0000","last_active":"2023-07-14T13:32:32.206439+0000","last_peered":"2023-07-14T13:32:32.206439+0000","last_clean":"2023-07-14T13:32:32.206439+0000","last_became_active":"2023-07-14T13:32:31.204764+0000","last_became_peered":"2023-07-14T13:32:31.204764+0000","last_unstale":"2023-07-14T13:32:32.206439+0000","last_undegraded":"2023-07-14T13:32:32.206439+0000","last_fullsized":"2023-07-14T13:32:32.206439+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:23:51.025043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205706+0000","last_change":"2023-07-14T13:32:31.207079+0000","last_active":"2023-07-14T13:32:32.205706+0000","last_peered":"2023-07-14T13:32:32.205706+0000","last_clean":"2023-07-14T13:32:32.205706+0000","last_became_active":"2023-07-14T13:32:31.206776+0000","last_became_peered":"2023-07-14T13:32:31.206776+0000","last_unstale":"2023-07-14T13:32:32.205706+0000","last_undegraded":"2023-07-14T13:32:32.205706+0000","last_fullsized":"2023-07-14T13:32:32.205706+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:15:59.984528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203425+0000","last_change":"2023-07-14T13:32:31.201883+0000","last_active":"2023-07-14T13:32:32.203425+0000","last_peered":"2023-07-14T13:32:32.203425+0000","last_clean":"2023-07-14T13:32:32.203425+0000","last_became_active":"2023-07-14T13:32:31.201605+0000","last_became_peered":"2023-07-14T13:32:31.201605+0000","last_unstale":"2023-07-14T13:32:32.203425+0000","last_undegraded":"2023-07-14T13:32:32.203425+0000","last_fullsized":"2023-07-14T13:32:32.203425+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:24:01.812269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.191085+0000","last_change":"2023-07-14T13:32:31.204506+0000","last_active":"2023-07-14T13:32:32.191085+0000","last_peered":"2023-07-14T13:32:32.191085+0000","last_clean":"2023-07-14T13:32:32.191085+0000","last_became_active":"2023-07-14T13:32:31.203749+0000","last_became_peered":"2023-07-14T13:32:31.203749+0000","last_unstale":"2023-07-14T13:32:32.191085+0000","last_undegraded":"2023-07-14T13:32:32.191085+0000","last_fullsized":"2023-07-14T13:32:32.191085+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:15:07.926351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205189+0000","last_change":"2023-07-14T13:32:31.210961+0000","last_active":"2023-07-14T13:32:32.205189+0000","last_peered":"2023-07-14T13:32:32.205189+0000","last_clean":"2023-07-14T13:32:32.205189+0000","last_became_active":"2023-07-14T13:32:31.210596+0000","last_became_peered":"2023-07-14T13:32:31.210596+0000","last_unstale":"2023-07-14T13:32:32.205189+0000","last_undegraded":"2023-07-14T13:32:32.205189+0000","last_fullsized":"2023-07-14T13:32:32.205189+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:56:14.173024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.192951+0000","last_change":"2023-07-14T13:32:31.211784+0000","last_active":"2023-07-14T13:32:32.192951+0000","last_peered":"2023-07-14T13:32:32.192951+0000","last_clean":"2023-07-14T13:32:32.192951+0000","last_became_active":"2023-07-14T13:32:31.211048+0000","last_became_peered":"2023-07-14T13:32:31.211048+0000","last_unstale":"2023-07-14T13:32:32.192951+0000","last_undegraded":"2023-07-14T13:32:32.192951+0000","last_fullsized":"2023-07-14T13:32:32.192951+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:02:15.862335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190079+0000","last_change":"2023-07-14T13:32:31.208509+0000","last_active":"2023-07-14T13:32:32.190079+0000","last_peered":"2023-07-14T13:32:32.190079+0000","last_clean":"2023-07-14T13:32:32.190079+0000","last_became_active":"2023-07-14T13:32:31.208208+0000","last_became_peered":"2023-07-14T13:32:31.208208+0000","last_unstale":"2023-07-14T13:32:32.190079+0000","last_undegraded":"2023-07-14T13:32:32.190079+0000","last_fullsized":"2023-07-14T13:32:32.190079+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:20:47.051343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.206378+0000","last_change":"2023-07-14T13:32:31.212072+0000","last_active":"2023-07-14T13:32:32.206378+0000","last_peered":"2023-07-14T13:32:32.206378+0000","last_clean":"2023-07-14T13:32:32.206378+0000","last_became_active":"2023-07-14T13:32:31.211797+0000","last_became_peered":"2023-07-14T13:32:31.211797+0000","last_unstale":"2023-07-14T13:32:32.206378+0000","last_undegraded":"2023-07-14T13:32:32.206378+0000","last_fullsized":"2023-07-14T13:32:32.206378+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:06:40.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.206165+0000","last_change":"2023-07-14T13:32:31.211445+0000","last_active":"2023-07-14T13:32:32.206165+0000","last_peered":"2023-07-14T13:32:32.206165+0000","last_clean":"2023-07-14T13:32:32.206165+0000","last_became_active":"2023-07-14T13:32:31.211147+0000","last_became_peered":"2023-07-14T13:32:31.211147+0000","last_unstale":"2023-07-14T13:32:32.206165+0000","last_undegraded":"2023-07-14T13:32:32.206165+0000","last_fullsized":"2023-07-14T13:32:32.206165+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:07:53.334708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203663+0000","last_change":"2023-07-14T13:32:31.213891+0000","last_active":"2023-07-14T13:32:32.203663+0000","last_peered":"2023-07-14T13:32:32.203663+0000","last_clean":"2023-07-14T13:32:32.203663+0000","last_became_active":"2023-07-14T13:32:31.213592+0000","last_became_peered":"2023-07-14T13:32:31.213592+0000","last_unstale":"2023-07-14T13:32:32.203663+0000","last_undegraded":"2023-07-14T13:32:32.203663+0000","last_fullsized":"2023-07-14T13:32:32.203663+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:42:37.296338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203542+0000","last_change":"2023-07-14T13:32:31.202187+0000","last_active":"2023-07-14T13:32:32.203542+0000","last_peered":"2023-07-14T13:32:32.203542+0000","last_clean":"2023-07-14T13:32:32.203542+0000","last_became_active":"2023-07-14T13:32:31.198471+0000","last_became_peered":"2023-07-14T13:32:31.198471+0000","last_unstale":"2023-07-14T13:32:32.203542+0000","last_undegraded":"2023-07-14T13:32:32.203542+0000","last_fullsized":"2023-07-14T13:32:32.203542+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:01:24.936504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205217+0000","last_change":"2023-07-14T13:32:31.202532+0000","last_active":"2023-07-14T13:32:32.205217+0000","last_peered":"2023-07-14T13:32:32.205217+0000","last_clean":"2023-07-14T13:32:32.205217+0000","last_became_active":"2023-07-14T13:32:31.202246+0000","last_became_peered":"2023-07-14T13:32:31.202246+0000","last_unstale":"2023-07-14T13:32:32.205217+0000","last_undegraded":"2023-07-14T13:32:32.205217+0000","last_fullsized":"2023-07-14T13:32:32.205217+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:38:29.105240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190486+0000","last_change":"2023-07-14T13:32:31.206853+0000","last_active":"2023-07-14T13:32:32.190486+0000","last_peered":"2023-07-14T13:32:32.190486+0000","last_clean":"2023-07-14T13:32:32.190486+0000","last_became_active":"2023-07-14T13:32:31.205309+0000","last_became_peered":"2023-07-14T13:32:31.205309+0000","last_unstale":"2023-07-14T13:32:32.190486+0000","last_undegraded":"2023-07-14T13:32:32.190486+0000","last_fullsized":"2023-07-14T13:32:32.190486+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:43:43.768931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.193049+0000","last_change":"2023-07-14T13:32:31.212040+0000","last_active":"2023-07-14T13:32:32.193049+0000","last_peered":"2023-07-14T13:32:32.193049+0000","last_clean":"2023-07-14T13:32:32.193049+0000","last_became_active":"2023-07-14T13:32:31.211481+0000","last_became_peered":"2023-07-14T13:32:31.211481+0000","last_unstale":"2023-07-14T13:32:32.193049+0000","last_undegraded":"2023-07-14T13:32:32.193049+0000","last_fullsized":"2023-07-14T13:32:32.193049+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:53:44.693730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203261+0000","last_change":"2023-07-14T13:32:31.211682+0000","last_active":"2023-07-14T13:32:32.203261+0000","last_peered":"2023-07-14T13:32:32.203261+0000","last_clean":"2023-07-14T13:32:32.203261+0000","last_became_active":"2023-07-14T13:32:31.211311+0000","last_became_peered":"2023-07-14T13:32:31.211311+0000","last_unstale":"2023-07-14T13:32:32.203261+0000","last_undegraded":"2023-07-14T13:32:32.203261+0000","last_fullsized":"2023-07-14T13:32:32.203261+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:21:38.738018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203722+0000","last_change":"2023-07-14T13:32:31.208668+0000","last_active":"2023-07-14T13:32:32.203722+0000","last_peered":"2023-07-14T13:32:32.203722+0000","last_clean":"2023-07-14T13:32:32.203722+0000","last_became_active":"2023-07-14T13:32:31.206439+0000","last_became_peered":"2023-07-14T13:32:31.206439+0000","last_unstale":"2023-07-14T13:32:32.203722+0000","last_undegraded":"2023-07-14T13:32:32.203722+0000","last_fullsized":"2023-07-14T13:32:32.203722+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:20:07.817109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205490+0000","last_change":"2023-07-14T13:32:31.206788+0000","last_active":"2023-07-14T13:32:32.205490+0000","last_peered":"2023-07-14T13:32:32.205490+0000","last_clean":"2023-07-14T13:32:32.205490+0000","last_became_active":"2023-07-14T13:32:31.205845+0000","last_became_peered":"2023-07-14T13:32:31.205845+0000","last_unstale":"2023-07-14T13:32:32.205490+0000","last_undegraded":"2023-07-14T13:32:32.205490+0000","last_fullsized":"2023-07-14T13:32:32.205490+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:31:20.919658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203750+0000","last_change":"2023-07-14T13:32:31.197264+0000","last_active":"2023-07-14T13:32:32.203750+0000","last_peered":"2023-07-14T13:32:32.203750+0000","last_clean":"2023-07-14T13:32:32.203750+0000","last_became_active":"2023-07-14T13:32:31.196879+0000","last_became_peered":"2023-07-14T13:32:31.196879+0000","last_unstale":"2023-07-14T13:32:32.203750+0000","last_undegraded":"2023-07-14T13:32:32.203750+0000","last_fullsized":"2023-07-14T13:32:32.203750+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:25:26.175917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205358+0000","last_change":"2023-07-14T13:32:31.212985+0000","last_active":"2023-07-14T13:32:32.205358+0000","last_peered":"2023-07-14T13:32:32.205358+0000","last_clean":"2023-07-14T13:32:32.205358+0000","last_became_active":"2023-07-14T13:32:31.212711+0000","last_became_peered":"2023-07-14T13:32:31.212711+0000","last_unstale":"2023-07-14T13:32:32.205358+0000","last_undegraded":"2023-07-14T13:32:32.205358+0000","last_fullsized":"2023-07-14T13:32:32.205358+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:59:24.190899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.206365+0000","last_change":"2023-07-14T13:32:31.215337+0000","last_active":"2023-07-14T13:32:32.206365+0000","last_peered":"2023-07-14T13:32:32.206365+0000","last_clean":"2023-07-14T13:32:32.206365+0000","last_became_active":"2023-07-14T13:32:31.215003+0000","last_became_peered":"2023-07-14T13:32:31.215003+0000","last_unstale":"2023-07-14T13:32:32.206365+0000","last_undegraded":"2023-07-14T13:32:32.206365+0000","last_fullsized":"2023-07-14T13:32:32.206365+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:28:23.466070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205801+0000","last_change":"2023-07-14T13:32:31.213697+0000","last_active":"2023-07-14T13:32:32.205801+0000","last_peered":"2023-07-14T13:32:32.205801+0000","last_clean":"2023-07-14T13:32:32.205801+0000","last_became_active":"2023-07-14T13:32:31.213395+0000","last_became_peered":"2023-07-14T13:32:31.213395+0000","last_unstale":"2023-07-14T13:32:32.205801+0000","last_undegraded":"2023-07-14T13:32:32.205801+0000","last_fullsized":"2023-07-14T13:32:32.205801+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:27:16.655571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205790+0000","last_change":"2023-07-14T13:32:31.217700+0000","last_active":"2023-07-14T13:32:32.205790+0000","last_peered":"2023-07-14T13:32:32.205790+0000","last_clean":"2023-07-14T13:32:32.205790+0000","last_became_active":"2023-07-14T13:32:31.217251+0000","last_became_peered":"2023-07-14T13:32:31.217251+0000","last_unstale":"2023-07-14T13:32:32.205790+0000","last_undegraded":"2023-07-14T13:32:32.205790+0000","last_fullsized":"2023-07-14T13:32:32.205790+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:02:45.080454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205041+0000","last_change":"2023-07-14T13:32:31.211084+0000","last_active":"2023-07-14T13:32:32.205041+0000","last_peered":"2023-07-14T13:32:32.205041+0000","last_clean":"2023-07-14T13:32:32.205041+0000","last_became_active":"2023-07-14T13:32:31.210752+0000","last_became_peered":"2023-07-14T13:32:31.210752+0000","last_unstale":"2023-07-14T13:32:32.205041+0000","last_undegraded":"2023-07-14T13:32:32.205041+0000","last_fullsized":"2023-07-14T13:32:32.205041+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:14:32.558210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"190'4","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.193976+0000","last_change":"2023-07-14T13:32:30.250085+0000","last_active":"2023-07-14T13:32:32.193976+0000","last_peered":"2023-07-14T13:32:32.193976+0000","last_clean":"2023-07-14T13:32:32.193976+0000","last_became_active":"2023-07-14T13:32:30.249862+0000","last_became_peered":"2023-07-14T13:32:30.249862+0000","last_unstale":"2023-07-14T13:32:32.193976+0000","last_undegraded":"2023-07-14T13:32:32.193976+0000","last_fullsized":"2023-07-14T13:32:32.193976+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:33:47.979553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.202921+0000","last_change":"2023-07-14T13:32:31.206791+0000","last_active":"2023-07-14T13:32:32.202921+0000","last_peered":"2023-07-14T13:32:32.202921+0000","last_clean":"2023-07-14T13:32:32.202921+0000","last_became_active":"2023-07-14T13:32:31.206446+0000","last_became_peered":"2023-07-14T13:32:31.206446+0000","last_unstale":"2023-07-14T13:32:32.202921+0000","last_undegraded":"2023-07-14T13:32:32.202921+0000","last_fullsized":"2023-07-14T13:32:32.202921+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:32:47.818992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"190'1","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190657+0000","last_change":"2023-07-14T13:32:30.249698+0000","last_active":"2023-07-14T13:32:32.190657+0000","last_peered":"2023-07-14T13:32:32.190657+0000","last_clean":"2023-07-14T13:32:32.190657+0000","last_became_active":"2023-07-14T13:32:30.249401+0000","last_became_peered":"2023-07-14T13:32:30.249401+0000","last_unstale":"2023-07-14T13:32:32.190657+0000","last_undegraded":"2023-07-14T13:32:32.190657+0000","last_fullsized":"2023-07-14T13:32:32.190657+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:11:08.167906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190698+0000","last_change":"2023-07-14T13:32:31.204725+0000","last_active":"2023-07-14T13:32:32.190698+0000","last_peered":"2023-07-14T13:32:32.190698+0000","last_clean":"2023-07-14T13:32:32.190698+0000","last_became_active":"2023-07-14T13:32:31.204215+0000","last_became_peered":"2023-07-14T13:32:31.204215+0000","last_unstale":"2023-07-14T13:32:32.190698+0000","last_undegraded":"2023-07-14T13:32:32.190698+0000","last_fullsized":"2023-07-14T13:32:32.190698+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:30:20.860803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.206304+0000","last_change":"2023-07-14T13:32:30.241437+0000","last_active":"2023-07-14T13:32:32.206304+0000","last_peered":"2023-07-14T13:32:32.206304+0000","last_clean":"2023-07-14T13:32:32.206304+0000","last_became_active":"2023-07-14T13:32:30.241090+0000","last_became_peered":"2023-07-14T13:32:30.241090+0000","last_unstale":"2023-07-14T13:32:32.206304+0000","last_undegraded":"2023-07-14T13:32:32.206304+0000","last_fullsized":"2023-07-14T13:32:32.206304+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:17:13.038984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205515+0000","last_change":"2023-07-14T13:32:31.210427+0000","last_active":"2023-07-14T13:32:32.205515+0000","last_peered":"2023-07-14T13:32:32.205515+0000","last_clean":"2023-07-14T13:32:32.205515+0000","last_became_active":"2023-07-14T13:32:31.210134+0000","last_became_peered":"2023-07-14T13:32:31.210134+0000","last_unstale":"2023-07-14T13:32:32.205515+0000","last_undegraded":"2023-07-14T13:32:32.205515+0000","last_fullsized":"2023-07-14T13:32:32.205515+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:19:14.781770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203719+0000","last_change":"2023-07-14T13:32:30.242094+0000","last_active":"2023-07-14T13:32:32.203719+0000","last_peered":"2023-07-14T13:32:32.203719+0000","last_clean":"2023-07-14T13:32:32.203719+0000","last_became_active":"2023-07-14T13:32:30.241826+0000","last_became_peered":"2023-07-14T13:32:30.241826+0000","last_unstale":"2023-07-14T13:32:32.203719+0000","last_undegraded":"2023-07-14T13:32:32.203719+0000","last_fullsized":"2023-07-14T13:32:32.203719+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:24:07.198567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.189955+0000","last_change":"2023-07-14T13:32:31.213427+0000","last_active":"2023-07-14T13:32:32.189955+0000","last_peered":"2023-07-14T13:32:32.189955+0000","last_clean":"2023-07-14T13:32:32.189955+0000","last_became_active":"2023-07-14T13:32:31.213140+0000","last_became_peered":"2023-07-14T13:32:31.213140+0000","last_unstale":"2023-07-14T13:32:32.189955+0000","last_undegraded":"2023-07-14T13:32:32.189955+0000","last_fullsized":"2023-07-14T13:32:32.189955+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:34:36.112916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"190'1","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.189835+0000","last_change":"2023-07-14T13:32:30.242038+0000","last_active":"2023-07-14T13:32:32.189835+0000","last_peered":"2023-07-14T13:32:32.189835+0000","last_clean":"2023-07-14T13:32:32.189835+0000","last_became_active":"2023-07-14T13:32:30.241766+0000","last_became_peered":"2023-07-14T13:32:30.241766+0000","last_unstale":"2023-07-14T13:32:32.189835+0000","last_undegraded":"2023-07-14T13:32:32.189835+0000","last_fullsized":"2023-07-14T13:32:32.189835+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:56:13.164224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203666+0000","last_change":"2023-07-14T13:32:31.210912+0000","last_active":"2023-07-14T13:32:32.203666+0000","last_peered":"2023-07-14T13:32:32.203666+0000","last_clean":"2023-07-14T13:32:32.203666+0000","last_became_active":"2023-07-14T13:32:31.210595+0000","last_became_peered":"2023-07-14T13:32:31.210595+0000","last_unstale":"2023-07-14T13:32:32.203666+0000","last_undegraded":"2023-07-14T13:32:32.203666+0000","last_fullsized":"2023-07-14T13:32:32.203666+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:49:30.384355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"190'1","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190832+0000","last_change":"2023-07-14T13:32:30.248549+0000","last_active":"2023-07-14T13:32:32.190832+0000","last_peered":"2023-07-14T13:32:32.190832+0000","last_clean":"2023-07-14T13:32:32.190832+0000","last_became_active":"2023-07-14T13:32:30.248272+0000","last_became_peered":"2023-07-14T13:32:30.248272+0000","last_unstale":"2023-07-14T13:32:32.190832+0000","last_undegraded":"2023-07-14T13:32:32.190832+0000","last_fullsized":"2023-07-14T13:32:32.190832+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:42:48.024162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203816+0000","last_change":"2023-07-14T13:32:31.204767+0000","last_active":"2023-07-14T13:32:32.203816+0000","last_peered":"2023-07-14T13:32:32.203816+0000","last_clean":"2023-07-14T13:32:32.203816+0000","last_became_active":"2023-07-14T13:32:31.204384+0000","last_became_peered":"2023-07-14T13:32:31.204384+0000","last_unstale":"2023-07-14T13:32:32.203816+0000","last_undegraded":"2023-07-14T13:32:32.203816+0000","last_fullsized":"2023-07-14T13:32:32.203816+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:33:50.548320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.202789+0000","last_change":"2023-07-14T13:32:30.239582+0000","last_active":"2023-07-14T13:32:32.202789+0000","last_peered":"2023-07-14T13:32:32.202789+0000","last_clean":"2023-07-14T13:32:32.202789+0000","last_became_active":"2023-07-14T13:32:30.239200+0000","last_became_peered":"2023-07-14T13:32:30.239200+0000","last_unstale":"2023-07-14T13:32:32.202789+0000","last_undegraded":"2023-07-14T13:32:32.202789+0000","last_fullsized":"2023-07-14T13:32:32.202789+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:43:50.308575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.193959+0000","last_change":"2023-07-14T13:32:31.211251+0000","last_active":"2023-07-14T13:32:32.193959+0000","last_peered":"2023-07-14T13:32:32.193959+0000","last_clean":"2023-07-14T13:32:32.193959+0000","last_became_active":"2023-07-14T13:32:31.210945+0000","last_became_peered":"2023-07-14T13:32:31.210945+0000","last_unstale":"2023-07-14T13:32:32.193959+0000","last_undegraded":"2023-07-14T13:32:32.193959+0000","last_fullsized":"2023-07-14T13:32:32.193959+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:56:59.464366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.189801+0000","last_change":"2023-07-14T13:32:30.241295+0000","last_active":"2023-07-14T13:32:32.189801+0000","last_peered":"2023-07-14T13:32:32.189801+0000","last_clean":"2023-07-14T13:32:32.189801+0000","last_became_active":"2023-07-14T13:32:30.239463+0000","last_became_peered":"2023-07-14T13:32:30.239463+0000","last_unstale":"2023-07-14T13:32:32.189801+0000","last_undegraded":"2023-07-14T13:32:32.189801+0000","last_fullsized":"2023-07-14T13:32:32.189801+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:27:31.022684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.189545+0000","last_change":"2023-07-14T13:32:31.202557+0000","last_active":"2023-07-14T13:32:32.189545+0000","last_peered":"2023-07-14T13:32:32.189545+0000","last_clean":"2023-07-14T13:32:32.189545+0000","last_became_active":"2023-07-14T13:32:31.202279+0000","last_became_peered":"2023-07-14T13:32:31.202279+0000","last_unstale":"2023-07-14T13:32:32.189545+0000","last_undegraded":"2023-07-14T13:32:32.189545+0000","last_fullsized":"2023-07-14T13:32:32.189545+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:56:05.505108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"190'1","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203379+0000","last_change":"2023-07-14T13:32:30.242629+0000","last_active":"2023-07-14T13:32:32.203379+0000","last_peered":"2023-07-14T13:32:32.203379+0000","last_clean":"2023-07-14T13:32:32.203379+0000","last_became_active":"2023-07-14T13:32:30.242363+0000","last_became_peered":"2023-07-14T13:32:30.242363+0000","last_unstale":"2023-07-14T13:32:32.203379+0000","last_undegraded":"2023-07-14T13:32:32.203379+0000","last_fullsized":"2023-07-14T13:32:32.203379+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:51:35.349822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.206048+0000","last_change":"2023-07-14T13:32:31.216185+0000","last_active":"2023-07-14T13:32:32.206048+0000","last_peered":"2023-07-14T13:32:32.206048+0000","last_clean":"2023-07-14T13:32:32.206048+0000","last_became_active":"2023-07-14T13:32:31.215885+0000","last_became_peered":"2023-07-14T13:32:31.215885+0000","last_unstale":"2023-07-14T13:32:32.206048+0000","last_undegraded":"2023-07-14T13:32:32.206048+0000","last_fullsized":"2023-07-14T13:32:32.206048+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:43:27.797146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190121+0000","last_change":"2023-07-14T13:32:30.243084+0000","last_active":"2023-07-14T13:32:32.190121+0000","last_peered":"2023-07-14T13:32:32.190121+0000","last_clean":"2023-07-14T13:32:32.190121+0000","last_became_active":"2023-07-14T13:32:30.242780+0000","last_became_peered":"2023-07-14T13:32:30.242780+0000","last_unstale":"2023-07-14T13:32:32.190121+0000","last_undegraded":"2023-07-14T13:32:32.190121+0000","last_fullsized":"2023-07-14T13:32:32.190121+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:24:32.879660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205543+0000","last_change":"2023-07-14T13:32:31.209834+0000","last_active":"2023-07-14T13:32:32.205543+0000","last_peered":"2023-07-14T13:32:32.205543+0000","last_clean":"2023-07-14T13:32:32.205543+0000","last_became_active":"2023-07-14T13:32:31.209513+0000","last_became_peered":"2023-07-14T13:32:31.209513+0000","last_unstale":"2023-07-14T13:32:32.205543+0000","last_undegraded":"2023-07-14T13:32:32.205543+0000","last_fullsized":"2023-07-14T13:32:32.205543+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:05:11.283813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"190'1","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190804+0000","last_change":"2023-07-14T13:32:30.242983+0000","last_active":"2023-07-14T13:32:32.190804+0000","last_peered":"2023-07-14T13:32:32.190804+0000","last_clean":"2023-07-14T13:32:32.190804+0000","last_became_active":"2023-07-14T13:32:30.242716+0000","last_became_peered":"2023-07-14T13:32:30.242716+0000","last_unstale":"2023-07-14T13:32:32.190804+0000","last_undegraded":"2023-07-14T13:32:32.190804+0000","last_fullsized":"2023-07-14T13:32:32.190804+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:59:01.370430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205519+0000","last_change":"2023-07-14T13:32:31.208101+0000","last_active":"2023-07-14T13:32:32.205519+0000","last_peered":"2023-07-14T13:32:32.205519+0000","last_clean":"2023-07-14T13:32:32.205519+0000","last_became_active":"2023-07-14T13:32:31.207799+0000","last_became_peered":"2023-07-14T13:32:31.207799+0000","last_unstale":"2023-07-14T13:32:32.205519+0000","last_undegraded":"2023-07-14T13:32:32.205519+0000","last_fullsized":"2023-07-14T13:32:32.205519+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:34:36.112916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190066+0000","last_change":"2023-07-14T13:32:30.244326+0000","last_active":"2023-07-14T13:32:32.190066+0000","last_peered":"2023-07-14T13:32:32.190066+0000","last_clean":"2023-07-14T13:32:32.190066+0000","last_became_active":"2023-07-14T13:32:30.241302+0000","last_became_peered":"2023-07-14T13:32:30.241302+0000","last_unstale":"2023-07-14T13:32:32.190066+0000","last_undegraded":"2023-07-14T13:32:32.190066+0000","last_fullsized":"2023-07-14T13:32:32.190066+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:27:15.646772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203864+0000","last_change":"2023-07-14T13:32:31.197067+0000","last_active":"2023-07-14T13:32:32.203864+0000","last_peered":"2023-07-14T13:32:32.203864+0000","last_clean":"2023-07-14T13:32:32.203864+0000","last_became_active":"2023-07-14T13:32:31.196749+0000","last_became_peered":"2023-07-14T13:32:31.196749+0000","last_unstale":"2023-07-14T13:32:32.203864+0000","last_undegraded":"2023-07-14T13:32:32.203864+0000","last_fullsized":"2023-07-14T13:32:32.203864+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:01:23.759739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.191148+0000","last_change":"2023-07-14T13:32:30.240867+0000","last_active":"2023-07-14T13:32:32.191148+0000","last_peered":"2023-07-14T13:32:32.191148+0000","last_clean":"2023-07-14T13:32:32.191148+0000","last_became_active":"2023-07-14T13:32:30.240602+0000","last_became_peered":"2023-07-14T13:32:30.240602+0000","last_unstale":"2023-07-14T13:32:32.191148+0000","last_undegraded":"2023-07-14T13:32:32.191148+0000","last_fullsized":"2023-07-14T13:32:32.191148+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:34:02.222616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190650+0000","last_change":"2023-07-14T13:32:31.210252+0000","last_active":"2023-07-14T13:32:32.190650+0000","last_peered":"2023-07-14T13:32:32.190650+0000","last_clean":"2023-07-14T13:32:32.190650+0000","last_became_active":"2023-07-14T13:32:31.209716+0000","last_became_peered":"2023-07-14T13:32:31.209716+0000","last_unstale":"2023-07-14T13:32:32.190650+0000","last_undegraded":"2023-07-14T13:32:32.190650+0000","last_fullsized":"2023-07-14T13:32:32.190650+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:04:33.766884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205405+0000","last_change":"2023-07-14T13:32:30.241454+0000","last_active":"2023-07-14T13:32:32.205405+0000","last_peered":"2023-07-14T13:32:32.205405+0000","last_clean":"2023-07-14T13:32:32.205405+0000","last_became_active":"2023-07-14T13:32:30.241096+0000","last_became_peered":"2023-07-14T13:32:30.241096+0000","last_unstale":"2023-07-14T13:32:32.205405+0000","last_undegraded":"2023-07-14T13:32:32.205405+0000","last_fullsized":"2023-07-14T13:32:32.205405+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:57:30.550296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190479+0000","last_change":"2023-07-14T13:32:31.209143+0000","last_active":"2023-07-14T13:32:32.190479+0000","last_peered":"2023-07-14T13:32:32.190479+0000","last_clean":"2023-07-14T13:32:32.190479+0000","last_became_active":"2023-07-14T13:32:31.208863+0000","last_became_peered":"2023-07-14T13:32:31.208863+0000","last_unstale":"2023-07-14T13:32:32.190479+0000","last_undegraded":"2023-07-14T13:32:32.190479+0000","last_fullsized":"2023-07-14T13:32:32.190479+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:06:40.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203211+0000","last_change":"2023-07-14T13:32:30.241042+0000","last_active":"2023-07-14T13:32:32.203211+0000","last_peered":"2023-07-14T13:32:32.203211+0000","last_clean":"2023-07-14T13:32:32.203211+0000","last_became_active":"2023-07-14T13:32:30.240771+0000","last_became_peered":"2023-07-14T13:32:30.240771+0000","last_unstale":"2023-07-14T13:32:32.203211+0000","last_undegraded":"2023-07-14T13:32:32.203211+0000","last_fullsized":"2023-07-14T13:32:32.203211+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:41:34.853443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205937+0000","last_change":"2023-07-14T13:32:31.214571+0000","last_active":"2023-07-14T13:32:32.205937+0000","last_peered":"2023-07-14T13:32:32.205937+0000","last_clean":"2023-07-14T13:32:32.205937+0000","last_became_active":"2023-07-14T13:32:31.214263+0000","last_became_peered":"2023-07-14T13:32:31.214263+0000","last_unstale":"2023-07-14T13:32:32.205937+0000","last_undegraded":"2023-07-14T13:32:32.205937+0000","last_fullsized":"2023-07-14T13:32:32.205937+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:40:58.378949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205361+0000","last_change":"2023-07-14T13:32:30.246075+0000","last_active":"2023-07-14T13:32:32.205361+0000","last_peered":"2023-07-14T13:32:32.205361+0000","last_clean":"2023-07-14T13:32:32.205361+0000","last_became_active":"2023-07-14T13:32:30.245775+0000","last_became_peered":"2023-07-14T13:32:30.245775+0000","last_unstale":"2023-07-14T13:32:32.205361+0000","last_undegraded":"2023-07-14T13:32:32.205361+0000","last_fullsized":"2023-07-14T13:32:32.205361+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:02:24.666528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205039+0000","last_change":"2023-07-14T13:32:31.211743+0000","last_active":"2023-07-14T13:32:32.205039+0000","last_peered":"2023-07-14T13:32:32.205039+0000","last_clean":"2023-07-14T13:32:32.205039+0000","last_became_active":"2023-07-14T13:32:31.211457+0000","last_became_peered":"2023-07-14T13:32:31.211457+0000","last_unstale":"2023-07-14T13:32:32.205039+0000","last_undegraded":"2023-07-14T13:32:32.205039+0000","last_fullsized":"2023-07-14T13:32:32.205039+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:27:32.031484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.191024+0000","last_change":"2023-07-14T13:32:30.242261+0000","last_active":"2023-07-14T13:32:32.191024+0000","last_peered":"2023-07-14T13:32:32.191024+0000","last_clean":"2023-07-14T13:32:32.191024+0000","last_became_active":"2023-07-14T13:32:30.241989+0000","last_became_peered":"2023-07-14T13:32:30.241989+0000","last_unstale":"2023-07-14T13:32:32.191024+0000","last_undegraded":"2023-07-14T13:32:32.191024+0000","last_fullsized":"2023-07-14T13:32:32.191024+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:25:04.156717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.189717+0000","last_change":"2023-07-14T13:32:31.206471+0000","last_active":"2023-07-14T13:32:32.189717+0000","last_peered":"2023-07-14T13:32:32.189717+0000","last_clean":"2023-07-14T13:32:32.189717+0000","last_became_active":"2023-07-14T13:32:31.205885+0000","last_became_peered":"2023-07-14T13:32:31.205885+0000","last_unstale":"2023-07-14T13:32:32.189717+0000","last_undegraded":"2023-07-14T13:32:32.189717+0000","last_fullsized":"2023-07-14T13:32:32.189717+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:45:16.493561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"191'1","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:33.504262+0000","last_change":"2023-07-14T13:32:30.245092+0000","last_active":"2023-07-14T13:32:33.504262+0000","last_peered":"2023-07-14T13:32:33.504262+0000","last_clean":"2023-07-14T13:32:33.504262+0000","last_became_active":"2023-07-14T13:32:30.244339+0000","last_became_peered":"2023-07-14T13:32:30.244339+0000","last_unstale":"2023-07-14T13:32:33.504262+0000","last_undegraded":"2023-07-14T13:32:33.504262+0000","last_fullsized":"2023-07-14T13:32:33.504262+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:16:57.866764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203555+0000","last_change":"2023-07-14T13:32:31.204646+0000","last_active":"2023-07-14T13:32:32.203555+0000","last_peered":"2023-07-14T13:32:32.203555+0000","last_clean":"2023-07-14T13:32:32.203555+0000","last_became_active":"2023-07-14T13:32:31.204331+0000","last_became_peered":"2023-07-14T13:32:31.204331+0000","last_unstale":"2023-07-14T13:32:32.203555+0000","last_undegraded":"2023-07-14T13:32:32.203555+0000","last_fullsized":"2023-07-14T13:32:32.203555+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:49:58.943103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203093+0000","last_change":"2023-07-14T13:32:30.242222+0000","last_active":"2023-07-14T13:32:32.203093+0000","last_peered":"2023-07-14T13:32:32.203093+0000","last_clean":"2023-07-14T13:32:32.203093+0000","last_became_active":"2023-07-14T13:32:30.241950+0000","last_became_peered":"2023-07-14T13:32:30.241950+0000","last_unstale":"2023-07-14T13:32:32.203093+0000","last_undegraded":"2023-07-14T13:32:32.203093+0000","last_fullsized":"2023-07-14T13:32:32.203093+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:31:01.648192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.189686+0000","last_change":"2023-07-14T13:32:31.203457+0000","last_active":"2023-07-14T13:32:32.189686+0000","last_peered":"2023-07-14T13:32:32.189686+0000","last_clean":"2023-07-14T13:32:32.189686+0000","last_became_active":"2023-07-14T13:32:31.203165+0000","last_became_peered":"2023-07-14T13:32:31.203165+0000","last_unstale":"2023-07-14T13:32:32.189686+0000","last_undegraded":"2023-07-14T13:32:32.189686+0000","last_fullsized":"2023-07-14T13:32:32.189686+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:39:27.399834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203778+0000","last_change":"2023-07-14T13:32:30.244565+0000","last_active":"2023-07-14T13:32:32.203778+0000","last_peered":"2023-07-14T13:32:32.203778+0000","last_clean":"2023-07-14T13:32:32.203778+0000","last_became_active":"2023-07-14T13:32:30.244306+0000","last_became_peered":"2023-07-14T13:32:30.244306+0000","last_unstale":"2023-07-14T13:32:32.203778+0000","last_undegraded":"2023-07-14T13:32:32.203778+0000","last_fullsized":"2023-07-14T13:32:32.203778+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:42:07.607381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.193583+0000","last_change":"2023-07-14T13:32:31.201412+0000","last_active":"2023-07-14T13:32:32.193583+0000","last_peered":"2023-07-14T13:32:32.193583+0000","last_clean":"2023-07-14T13:32:32.193583+0000","last_became_active":"2023-07-14T13:32:31.201144+0000","last_became_peered":"2023-07-14T13:32:31.201144+0000","last_unstale":"2023-07-14T13:32:32.193583+0000","last_undegraded":"2023-07-14T13:32:32.193583+0000","last_fullsized":"2023-07-14T13:32:32.193583+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:59:43.408218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.193364+0000","last_change":"2023-07-14T13:32:30.239572+0000","last_active":"2023-07-14T13:32:32.193364+0000","last_peered":"2023-07-14T13:32:32.193364+0000","last_clean":"2023-07-14T13:32:32.193364+0000","last_became_active":"2023-07-14T13:32:30.239299+0000","last_became_peered":"2023-07-14T13:32:30.239299+0000","last_unstale":"2023-07-14T13:32:32.193364+0000","last_undegraded":"2023-07-14T13:32:32.193364+0000","last_fullsized":"2023-07-14T13:32:32.193364+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:12:04.747786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205760+0000","last_change":"2023-07-14T13:32:31.211161+0000","last_active":"2023-07-14T13:32:32.205760+0000","last_peered":"2023-07-14T13:32:32.205760+0000","last_clean":"2023-07-14T13:32:32.205760+0000","last_became_active":"2023-07-14T13:32:31.210296+0000","last_became_peered":"2023-07-14T13:32:31.210296+0000","last_unstale":"2023-07-14T13:32:32.205760+0000","last_undegraded":"2023-07-14T13:32:32.205760+0000","last_fullsized":"2023-07-14T13:32:32.205760+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:45:18.896852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203320+0000","last_change":"2023-07-14T13:32:30.247260+0000","last_active":"2023-07-14T13:32:32.203320+0000","last_peered":"2023-07-14T13:32:32.203320+0000","last_clean":"2023-07-14T13:32:32.203320+0000","last_became_active":"2023-07-14T13:32:30.246874+0000","last_became_peered":"2023-07-14T13:32:30.246874+0000","last_unstale":"2023-07-14T13:32:32.203320+0000","last_undegraded":"2023-07-14T13:32:32.203320+0000","last_fullsized":"2023-07-14T13:32:32.203320+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:27:47.420592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203137+0000","last_change":"2023-07-14T13:32:31.196912+0000","last_active":"2023-07-14T13:32:32.203137+0000","last_peered":"2023-07-14T13:32:32.203137+0000","last_clean":"2023-07-14T13:32:32.203137+0000","last_became_active":"2023-07-14T13:32:31.196563+0000","last_became_peered":"2023-07-14T13:32:31.196563+0000","last_unstale":"2023-07-14T13:32:32.203137+0000","last_undegraded":"2023-07-14T13:32:32.203137+0000","last_fullsized":"2023-07-14T13:32:32.203137+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:34:18.832102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205921+0000","last_change":"2023-07-14T13:32:30.242655+0000","last_active":"2023-07-14T13:32:32.205921+0000","last_peered":"2023-07-14T13:32:32.205921+0000","last_clean":"2023-07-14T13:32:32.205921+0000","last_became_active":"2023-07-14T13:32:30.242239+0000","last_became_peered":"2023-07-14T13:32:30.242239+0000","last_unstale":"2023-07-14T13:32:32.205921+0000","last_undegraded":"2023-07-14T13:32:32.205921+0000","last_fullsized":"2023-07-14T13:32:32.205921+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:20:46.042543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203968+0000","last_change":"2023-07-14T13:32:31.206218+0000","last_active":"2023-07-14T13:32:32.203968+0000","last_peered":"2023-07-14T13:32:32.203968+0000","last_clean":"2023-07-14T13:32:32.203968+0000","last_became_active":"2023-07-14T13:32:31.205868+0000","last_became_peered":"2023-07-14T13:32:31.205868+0000","last_unstale":"2023-07-14T13:32:32.203968+0000","last_undegraded":"2023-07-14T13:32:32.203968+0000","last_fullsized":"2023-07-14T13:32:32.203968+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:12:19.595971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190233+0000","last_change":"2023-07-14T13:32:30.245599+0000","last_active":"2023-07-14T13:32:32.190233+0000","last_peered":"2023-07-14T13:32:32.190233+0000","last_clean":"2023-07-14T13:32:32.190233+0000","last_became_active":"2023-07-14T13:32:30.245326+0000","last_became_peered":"2023-07-14T13:32:30.245326+0000","last_unstale":"2023-07-14T13:32:32.190233+0000","last_undegraded":"2023-07-14T13:32:32.190233+0000","last_fullsized":"2023-07-14T13:32:32.190233+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:28:22.457271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205270+0000","last_change":"2023-07-14T13:32:31.209183+0000","last_active":"2023-07-14T13:32:32.205270+0000","last_peered":"2023-07-14T13:32:32.205270+0000","last_clean":"2023-07-14T13:32:32.205270+0000","last_became_active":"2023-07-14T13:32:31.208913+0000","last_became_peered":"2023-07-14T13:32:31.208913+0000","last_unstale":"2023-07-14T13:32:32.205270+0000","last_undegraded":"2023-07-14T13:32:32.205270+0000","last_fullsized":"2023-07-14T13:32:32.205270+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:04:29.283317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203248+0000","last_change":"2023-07-14T13:32:30.245307+0000","last_active":"2023-07-14T13:32:32.203248+0000","last_peered":"2023-07-14T13:32:32.203248+0000","last_clean":"2023-07-14T13:32:32.203248+0000","last_became_active":"2023-07-14T13:32:30.244760+0000","last_became_peered":"2023-07-14T13:32:30.244760+0000","last_unstale":"2023-07-14T13:32:32.203248+0000","last_undegraded":"2023-07-14T13:32:32.203248+0000","last_fullsized":"2023-07-14T13:32:32.203248+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:24:11.727066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"178'326","reported_seq":1223,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205457+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:32:32.205457+0000","last_peered":"2023-07-14T13:32:32.205457+0000","last_clean":"2023-07-14T13:32:32.205457+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:32:32.205457+0000","last_undegraded":"2023-07-14T13:32:32.205457+0000","last_fullsized":"2023-07-14T13:32:32.205457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:16:48.744501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":322,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.206010+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:32:32.206010+0000","last_peered":"2023-07-14T13:32:32.206010+0000","last_clean":"2023-07-14T13:32:32.206010+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:32:32.206010+0000","last_undegraded":"2023-07-14T13:32:32.206010+0000","last_fullsized":"2023-07-14T13:32:32.206010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:44:43.690308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203041+0000","last_change":"2023-07-14T13:32:31.201043+0000","last_active":"2023-07-14T13:32:32.203041+0000","last_peered":"2023-07-14T13:32:32.203041+0000","last_clean":"2023-07-14T13:32:32.203041+0000","last_became_active":"2023-07-14T13:32:31.200709+0000","last_became_peered":"2023-07-14T13:32:31.200709+0000","last_unstale":"2023-07-14T13:32:32.203041+0000","last_undegraded":"2023-07-14T13:32:32.203041+0000","last_fullsized":"2023-07-14T13:32:32.203041+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:30:38.008514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"190'3","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.193646+0000","last_change":"2023-07-14T13:32:30.242440+0000","last_active":"2023-07-14T13:32:32.193646+0000","last_peered":"2023-07-14T13:32:32.193646+0000","last_clean":"2023-07-14T13:32:32.193646+0000","last_became_active":"2023-07-14T13:32:30.242160+0000","last_became_peered":"2023-07-14T13:32:30.242160+0000","last_unstale":"2023-07-14T13:32:32.193646+0000","last_undegraded":"2023-07-14T13:32:32.193646+0000","last_fullsized":"2023-07-14T13:32:32.193646+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:05:10.714583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":326,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205609+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:32:32.205609+0000","last_peered":"2023-07-14T13:32:32.205609+0000","last_clean":"2023-07-14T13:32:32.205609+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:32:32.205609+0000","last_undegraded":"2023-07-14T13:32:32.205609+0000","last_fullsized":"2023-07-14T13:32:32.205609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:14:35.978723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203534+0000","last_change":"2023-07-14T13:32:31.214524+0000","last_active":"2023-07-14T13:32:32.203534+0000","last_peered":"2023-07-14T13:32:32.203534+0000","last_clean":"2023-07-14T13:32:32.203534+0000","last_became_active":"2023-07-14T13:32:31.214217+0000","last_became_peered":"2023-07-14T13:32:31.214217+0000","last_unstale":"2023-07-14T13:32:32.203534+0000","last_undegraded":"2023-07-14T13:32:32.203534+0000","last_fullsized":"2023-07-14T13:32:32.203534+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:20:12.411054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"190'6","reported_seq":19,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203957+0000","last_change":"2023-07-14T13:32:30.241035+0000","last_active":"2023-07-14T13:32:32.203957+0000","last_peered":"2023-07-14T13:32:32.203957+0000","last_clean":"2023-07-14T13:32:32.203957+0000","last_became_active":"2023-07-14T13:32:30.240769+0000","last_became_peered":"2023-07-14T13:32:30.240769+0000","last_unstale":"2023-07-14T13:32:32.203957+0000","last_undegraded":"2023-07-14T13:32:32.203957+0000","last_fullsized":"2023-07-14T13:32:32.203957+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:42:54.493273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":328,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.202875+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:32:32.202875+0000","last_peered":"2023-07-14T13:32:32.202875+0000","last_clean":"2023-07-14T13:32:32.202875+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:32:32.202875+0000","last_undegraded":"2023-07-14T13:32:32.202875+0000","last_fullsized":"2023-07-14T13:32:32.202875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:30:54.621706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205054+0000","last_change":"2023-07-14T13:32:31.212190+0000","last_active":"2023-07-14T13:32:32.205054+0000","last_peered":"2023-07-14T13:32:32.205054+0000","last_clean":"2023-07-14T13:32:32.205054+0000","last_became_active":"2023-07-14T13:32:31.210287+0000","last_became_peered":"2023-07-14T13:32:31.210287+0000","last_unstale":"2023-07-14T13:32:32.205054+0000","last_undegraded":"2023-07-14T13:32:32.205054+0000","last_fullsized":"2023-07-14T13:32:32.205054+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:29:58.513910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203129+0000","last_change":"2023-07-14T13:32:30.244430+0000","last_active":"2023-07-14T13:32:32.203129+0000","last_peered":"2023-07-14T13:32:32.203129+0000","last_clean":"2023-07-14T13:32:32.203129+0000","last_became_active":"2023-07-14T13:32:30.244154+0000","last_became_peered":"2023-07-14T13:32:30.244154+0000","last_unstale":"2023-07-14T13:32:32.203129+0000","last_undegraded":"2023-07-14T13:32:32.203129+0000","last_fullsized":"2023-07-14T13:32:32.203129+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:53:19.858001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":322,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205619+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:32:32.205619+0000","last_peered":"2023-07-14T13:32:32.205619+0000","last_clean":"2023-07-14T13:32:32.205619+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:32:32.205619+0000","last_undegraded":"2023-07-14T13:32:32.205619+0000","last_fullsized":"2023-07-14T13:32:32.205619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:39:58.348712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.206391+0000","last_change":"2023-07-14T13:32:31.206840+0000","last_active":"2023-07-14T13:32:32.206391+0000","last_peered":"2023-07-14T13:32:32.206391+0000","last_clean":"2023-07-14T13:32:32.206391+0000","last_became_active":"2023-07-14T13:32:31.206552+0000","last_became_peered":"2023-07-14T13:32:31.206552+0000","last_unstale":"2023-07-14T13:32:32.206391+0000","last_undegraded":"2023-07-14T13:32:32.206391+0000","last_fullsized":"2023-07-14T13:32:32.206391+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:08:53.852889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.206156+0000","last_change":"2023-07-14T13:32:30.241324+0000","last_active":"2023-07-14T13:32:32.206156+0000","last_peered":"2023-07-14T13:32:32.206156+0000","last_clean":"2023-07-14T13:32:32.206156+0000","last_became_active":"2023-07-14T13:32:30.240927+0000","last_became_peered":"2023-07-14T13:32:30.240927+0000","last_unstale":"2023-07-14T13:32:32.206156+0000","last_undegraded":"2023-07-14T13:32:32.206156+0000","last_fullsized":"2023-07-14T13:32:32.206156+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:05:44.673186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":334,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190234+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:32:32.190234+0000","last_peered":"2023-07-14T13:32:32.190234+0000","last_clean":"2023-07-14T13:32:32.190234+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:32:32.190234+0000","last_undegraded":"2023-07-14T13:32:32.190234+0000","last_fullsized":"2023-07-14T13:32:32.190234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:28:03.136557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203926+0000","last_change":"2023-07-14T13:32:31.209121+0000","last_active":"2023-07-14T13:32:32.203926+0000","last_peered":"2023-07-14T13:32:32.203926+0000","last_clean":"2023-07-14T13:32:32.203926+0000","last_became_active":"2023-07-14T13:32:31.206507+0000","last_became_peered":"2023-07-14T13:32:31.206507+0000","last_unstale":"2023-07-14T13:32:32.203926+0000","last_undegraded":"2023-07-14T13:32:32.203926+0000","last_fullsized":"2023-07-14T13:32:32.203926+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:19:11.545881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"190'8","reported_seq":21,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.189676+0000","last_change":"2023-07-14T13:32:30.236226+0000","last_active":"2023-07-14T13:32:32.189676+0000","last_peered":"2023-07-14T13:32:32.189676+0000","last_clean":"2023-07-14T13:32:32.189676+0000","last_became_active":"2023-07-14T13:32:30.235945+0000","last_became_peered":"2023-07-14T13:32:30.235945+0000","last_unstale":"2023-07-14T13:32:32.189676+0000","last_undegraded":"2023-07-14T13:32:32.189676+0000","last_fullsized":"2023-07-14T13:32:32.189676+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:31:00.930151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":324,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205684+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:32:32.205684+0000","last_peered":"2023-07-14T13:32:32.205684+0000","last_clean":"2023-07-14T13:32:32.205684+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:32:32.205684+0000","last_undegraded":"2023-07-14T13:32:32.205684+0000","last_fullsized":"2023-07-14T13:32:32.205684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:28:09.921387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205960+0000","last_change":"2023-07-14T13:32:31.215815+0000","last_active":"2023-07-14T13:32:32.205960+0000","last_peered":"2023-07-14T13:32:32.205960+0000","last_clean":"2023-07-14T13:32:32.205960+0000","last_became_active":"2023-07-14T13:32:31.215352+0000","last_became_peered":"2023-07-14T13:32:31.215352+0000","last_unstale":"2023-07-14T13:32:32.205960+0000","last_undegraded":"2023-07-14T13:32:32.205960+0000","last_fullsized":"2023-07-14T13:32:32.205960+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:10:34.934009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.191048+0000","last_change":"2023-07-14T13:32:30.244445+0000","last_active":"2023-07-14T13:32:32.191048+0000","last_peered":"2023-07-14T13:32:32.191048+0000","last_clean":"2023-07-14T13:32:32.191048+0000","last_became_active":"2023-07-14T13:32:30.243969+0000","last_became_peered":"2023-07-14T13:32:30.243969+0000","last_unstale":"2023-07-14T13:32:32.191048+0000","last_undegraded":"2023-07-14T13:32:32.191048+0000","last_fullsized":"2023-07-14T13:32:32.191048+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:54:23.473518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":333,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190308+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:32:32.190308+0000","last_peered":"2023-07-14T13:32:32.190308+0000","last_clean":"2023-07-14T13:32:32.190308+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:32:32.190308+0000","last_undegraded":"2023-07-14T13:32:32.190308+0000","last_fullsized":"2023-07-14T13:32:32.190308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:37:23.849632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190173+0000","last_change":"2023-07-14T13:32:31.208666+0000","last_active":"2023-07-14T13:32:32.190173+0000","last_peered":"2023-07-14T13:32:32.190173+0000","last_clean":"2023-07-14T13:32:32.190173+0000","last_became_active":"2023-07-14T13:32:31.208381+0000","last_became_peered":"2023-07-14T13:32:31.208381+0000","last_unstale":"2023-07-14T13:32:32.190173+0000","last_undegraded":"2023-07-14T13:32:32.190173+0000","last_fullsized":"2023-07-14T13:32:32.190173+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:05:45.681986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203195+0000","last_change":"2023-07-14T13:32:30.239834+0000","last_active":"2023-07-14T13:32:32.203195+0000","last_peered":"2023-07-14T13:32:32.203195+0000","last_clean":"2023-07-14T13:32:32.203195+0000","last_became_active":"2023-07-14T13:32:30.239519+0000","last_became_peered":"2023-07-14T13:32:30.239519+0000","last_unstale":"2023-07-14T13:32:32.203195+0000","last_undegraded":"2023-07-14T13:32:32.203195+0000","last_fullsized":"2023-07-14T13:32:32.203195+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:33:07.057466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":325,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.206108+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:32:32.206108+0000","last_peered":"2023-07-14T13:32:32.206108+0000","last_clean":"2023-07-14T13:32:32.206108+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:32:32.206108+0000","last_undegraded":"2023-07-14T13:32:32.206108+0000","last_fullsized":"2023-07-14T13:32:32.206108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:42:36.055102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575322,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60200,"kb_used_data":2912,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94311640,"statfs":{"total":96636764160,"available":96575119360,"internally_reserved":0,"allocated":2981888,"data_stored":1819727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.75600000000000001,"15min":0.74299999999999999},"min":{"1min":0.58599999999999997,"5min":0.48799999999999999,"15min":0.48699999999999999},"max":{"1min":0.96999999999999997,"5min":1.208,"15min":1.208},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.746,"15min":0.747},"min":{"1min":0.59999999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96699999999999997,"5min":1.042,"15min":1.042},"last":0.85699999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.76300000000000001,"15min":0.76000000000000001},"min":{"1min":0.629,"5min":0.433,"15min":0.433},"max":{"1min":0.96799999999999997,"5min":1.444,"15min":1.444},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78900000000000003,"15min":0.77000000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0029999999999999,"5min":1.534,"15min":1.534},"last":0.80400000000000005}]},{"osd":2,"last update":"Fri Jul 14 13:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.745,"15min":0.745},"min":{"1min":0.64100000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96499999999999997,"5min":1.1120000000000001,"15min":1.1379999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.79600000000000004,"15min":0.77400000000000002},"min":{"1min":0.64100000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.0089999999999999,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.82099999999999995}]},{"osd":3,"last update":"Fri Jul 14 13:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77000000000000002,"15min":0.75900000000000001},"min":{"1min":0.51700000000000002,"5min":0.51600000000000001,"15min":0.499},"max":{"1min":0.94599999999999995,"5min":1.498,"15min":1.498},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.80500000000000005,"15min":0.78600000000000003},"min":{"1min":0.69399999999999995,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.97899999999999998,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.92700000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.376,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81599999999999995,"5min":1.0129999999999999,"15min":1.0620000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.62,"15min":0.625},"min":{"1min":0.45800000000000002,"5min":0.44700000000000001,"15min":0.439},"max":{"1min":0.91000000000000003,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.76800000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.63200000000000001,"15min":0.61699999999999999},"min":{"1min":0.54600000000000004,"5min":0.41799999999999998,"15min":0.41499999999999998},"max":{"1min":0.88800000000000001,"5min":1.145,"15min":1.145},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66200000000000003,"15min":0.65700000000000003},"min":{"1min":0.48099999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88200000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.66300000000000003}]},{"osd":6,"last update":"Fri Jul 14 13:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72399999999999998,"15min":0.71699999999999997},"min":{"1min":0.52400000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90500000000000003,"5min":1.0700000000000001,"15min":1.0940000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.41999999999999998},"max":{"1min":0.97399999999999998,"5min":1.089,"15min":1.089},"last":0.94399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575323,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37476,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334364,"statfs":{"total":96636764160,"available":96598388736,"internally_reserved":0,"allocated":2387968,"data_stored":1229359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.53500000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.98299999999999998,"5min":1.026,"15min":1.026},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.755,"15min":0.753},"min":{"1min":0.55600000000000005,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.012,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.57199999999999995}]},{"osd":1,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.59799999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.044,"5min":1.044,"15min":1.3300000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.746,"15min":0.746},"min":{"1min":0.57299999999999995,"5min":0.51900000000000002,"15min":0.47499999999999998},"max":{"1min":0.996,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.82199999999999995}]},{"osd":2,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78000000000000003,"15min":0.78900000000000003},"min":{"1min":0.58599999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0740000000000001,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77200000000000002,"15min":0.76400000000000001},"min":{"1min":0.61799999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96799999999999997,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.80400000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.77600000000000002,"15min":0.78100000000000003},"min":{"1min":0.59399999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.073,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76100000000000001,"15min":0.76700000000000002},"min":{"1min":0.56100000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.999,"5min":1.0249999999999999,"15min":1.2569999999999999},"last":0.68999999999999995}]},{"osd":4,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57699999999999996,"15min":0.56799999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.36099999999999999},"max":{"1min":0.78200000000000003,"5min":1.02,"15min":1.175},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.626,"15min":0.61099999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.36799999999999999},"max":{"1min":0.755,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.91700000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64700000000000002,"15min":0.63300000000000001},"min":{"1min":0.41899999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94499999999999995,"5min":1.0049999999999999,"15min":1.0860000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68500000000000005,"15min":0.67300000000000004},"min":{"1min":0.50900000000000001,"5min":0.46400000000000002,"15min":0.41699999999999998},"max":{"1min":0.878,"5min":1.0640000000000001,"15min":1.3180000000000001},"last":0.86199999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.64700000000000002,"15min":0.64300000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.42899999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":1.0269999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71599999999999997,"15min":0.70499999999999996},"min":{"1min":0.52600000000000002,"5min":0.49299999999999999,"15min":0.46200000000000002},"max":{"1min":0.92900000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.88700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575322,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55532,"kb_used_data":2340,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316308,"statfs":{"total":96636764160,"available":96579899392,"internally_reserved":0,"allocated":2396160,"data_stored":1229483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.753,"15min":0.74299999999999999},"min":{"1min":0.48199999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.0389999999999999,"5min":1.615,"15min":1.8},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76100000000000001,"15min":0.76000000000000001},"min":{"1min":0.623,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.97499999999999998,"5min":1.6899999999999999,"15min":1.8700000000000001},"last":0.64800000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.76100000000000001,"15min":0.752},"min":{"1min":0.53400000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.995,"5min":1.633,"15min":1.835},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77100000000000002,"15min":0.76700000000000002},"min":{"1min":0.60899999999999999,"5min":0.52300000000000002,"15min":0.499},"max":{"1min":0.94599999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.47999999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78200000000000003,"15min":0.80500000000000005},"min":{"1min":0.51400000000000001,"5min":0.45700000000000002,"15min":0.434},"max":{"1min":1.02,"5min":1.5960000000000001,"15min":16.774000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77500000000000002,"15min":0.80700000000000005},"min":{"1min":0.50800000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.98799999999999999,"5min":1.6779999999999999,"15min":16.751999999999999},"last":0.63500000000000001}]},{"osd":3,"last update":"Fri Jul 14 13:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.75700000000000001,"15min":0.76800000000000002},"min":{"1min":0.54000000000000004,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95499999999999996,"5min":1.0209999999999999,"15min":1.115},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.80500000000000005,"15min":0.83399999999999996},"min":{"1min":0.55400000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.006,"5min":1.6559999999999999,"15min":16.731000000000002},"last":0.58799999999999997}]},{"osd":4,"last update":"Fri Jul 14 13:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64300000000000002,"15min":0.63100000000000001},"min":{"1min":0.46000000000000002,"5min":0.40400000000000003,"15min":0.38},"max":{"1min":0.92500000000000004,"5min":0.94199999999999995,"15min":1.0089999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72699999999999998,"15min":0.71399999999999997},"min":{"1min":0.38300000000000001,"5min":0.378,"15min":0.375},"max":{"1min":0.92300000000000004,"5min":1.248,"15min":1.248},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Jul 14 13:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63800000000000001,"15min":0.625},"min":{"1min":0.438,"5min":0.42799999999999999,"15min":0.34999999999999998},"max":{"1min":0.85499999999999998,"5min":1.157,"15min":1.3100000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.66500000000000004,"15min":0.65100000000000002},"min":{"1min":0.49199999999999999,"5min":0.45400000000000001,"15min":0.42799999999999999},"max":{"1min":0.96899999999999997,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.69099999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67100000000000004,"15min":0.65600000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.42399999999999999},"max":{"1min":0.79600000000000004,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.71899999999999997,"15min":0.69799999999999995},"min":{"1min":0.51200000000000001,"5min":0.433,"15min":0.40000000000000002},"max":{"1min":0.85499999999999998,"5min":1.091,"15min":1.091},"last":0.72599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575322,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37492,"kb_used_data":2348,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334348,"statfs":{"total":96636764160,"available":96598372352,"internally_reserved":0,"allocated":2404352,"data_stored":1230123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:31:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76700000000000002,"15min":0.76500000000000001},"min":{"1min":0.54600000000000004,"5min":0.50700000000000001,"15min":0.38100000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.877},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.755,"15min":0.75900000000000001},"min":{"1min":0.51300000000000001,"5min":0.45800000000000002,"15min":0.442},"max":{"1min":0.94699999999999995,"5min":0.98599999999999999,"15min":1.278},"last":0.76400000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:31:44 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.76400000000000001,"15min":0.77500000000000002},"min":{"1min":0.58599999999999997,"5min":0.51500000000000001,"15min":0.47199999999999998},"max":{"1min":0.97999999999999998,"5min":1.0369999999999999,"15min":1.306},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.75,"15min":0.745},"min":{"1min":0.623,"5min":0.51400000000000001,"15min":0.47599999999999998},"max":{"1min":0.995,"5min":1.024,"15min":1.177},"last":0.84399999999999997}]},{"osd":2,"last update":"Fri Jul 14 13:31:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76900000000000002,"15min":0.77200000000000002},"min":{"1min":0.60599999999999998,"5min":0.55100000000000005,"15min":0.49299999999999999},"max":{"1min":0.92600000000000005,"5min":0.95899999999999996,"15min":1.137},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.77000000000000002,"15min":0.77700000000000002},"min":{"1min":0.59399999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.89300000000000002,"5min":1,"15min":1},"last":0.86299999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:31:44 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.749,"15min":0.76500000000000001},"min":{"1min":0.58899999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.96899999999999997,"5min":1.0229999999999999,"15min":1.222},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78000000000000003,"15min":0.77900000000000003},"min":{"1min":0.56299999999999994,"5min":0.54400000000000004,"15min":0.496},"max":{"1min":0.98999999999999999,"5min":1.018,"15min":1.1970000000000001},"last":0.79100000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:31:44 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60599999999999998,"15min":0.60299999999999998},"min":{"1min":0.42899999999999999,"5min":0.42199999999999999,"15min":0.40000000000000002},"max":{"1min":0.86699999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.378},"max":{"1min":0.80400000000000005,"5min":0.96099999999999997,"15min":0.96799999999999997},"last":0.60999999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:31:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.45200000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.875,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66500000000000004,"15min":0.66700000000000004},"min":{"1min":0.52000000000000002,"5min":0.47199999999999998,"15min":0.42699999999999999},"max":{"1min":1.04,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.69399999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:31:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67000000000000004,"15min":0.67200000000000004},"min":{"1min":0.44400000000000001,"5min":0.436,"15min":0.435},"max":{"1min":0.84699999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68899999999999995,"15min":0.69699999999999995},"min":{"1min":0.501,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0569999999999999,"5min":1.127,"15min":1.127},"last":0.59499999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575322,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41592,"kb_used_data":2352,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330248,"statfs":{"total":96636764160,"available":96594173952,"internally_reserved":0,"allocated":2408448,"data_stored":1231527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:31:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.46700000000000003,"15min":0.46100000000000002},"min":{"1min":0.32100000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.67600000000000005,"5min":0.73799999999999999,"15min":0.92900000000000005},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.504,"15min":0.52100000000000002},"min":{"1min":0.36899999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.748,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.52800000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:31:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.496,"15min":0.48499999999999999},"min":{"1min":0.35499999999999998,"5min":0.34000000000000002,"15min":0.32300000000000001},"max":{"1min":0.69499999999999995,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55000000000000004,"15min":0.55800000000000005},"min":{"1min":0.45300000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72199999999999998,"5min":0.82199999999999995,"15min":0.85099999999999998},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:31:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56999999999999995,"15min":0.57799999999999996},"min":{"1min":0.44800000000000001,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.66200000000000003,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.61699999999999999},"min":{"1min":0.40100000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.81100000000000005,"5min":0.86099999999999999,"15min":0.88100000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:31:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.73799999999999999,"15min":0.77800000000000002},"min":{"1min":0.52700000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1.0680000000000001,"5min":1.0880000000000001,"15min":1.2529999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78400000000000003,"15min":0.79800000000000004},"min":{"1min":0.629,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.92000000000000004,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.70199999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:31:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.78500000000000003,"15min":0.82099999999999995},"min":{"1min":0.58099999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0349999999999999,"5min":1.069,"15min":1.3959999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80300000000000005,"15min":0.81000000000000005},"min":{"1min":0.623,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.89900000000000002,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.66600000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:31:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.79500000000000004,"15min":0.80300000000000005},"min":{"1min":0.58699999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.93200000000000005,"5min":1.383,"15min":1.383},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.81000000000000005,"15min":0.83399999999999996},"min":{"1min":0.63600000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.98099999999999998,"5min":1.1439999999999999,"15min":1.3520000000000001},"last":0.74099999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:31:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.85299999999999998,"15min":0.85899999999999999},"min":{"1min":0.66100000000000003,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.95699999999999996,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81799999999999995,"15min":0.83699999999999997},"min":{"1min":0.56399999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.01,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.79800000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575322,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59616,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312224,"statfs":{"total":96636764160,"available":96575717376,"internally_reserved":0,"allocated":2383872,"data_stored":1228340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:31:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46500000000000002,"15min":0.46600000000000003},"min":{"1min":0.30399999999999999,"5min":0.29799999999999999,"15min":0.28599999999999998},"max":{"1min":0.624,"5min":0.75900000000000001,"15min":0.79800000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51300000000000001,"15min":0.52700000000000002},"min":{"1min":0.33700000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.79600000000000004,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.57199999999999995}]},{"osd":1,"last update":"Fri Jul 14 13:31:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.35599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.64400000000000002,"5min":0.80600000000000005,"15min":0.84799999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.55900000000000005},"min":{"1min":0.45400000000000001,"5min":0.38900000000000001,"15min":0.38200000000000001},"max":{"1min":0.75700000000000001,"5min":0.82199999999999995,"15min":0.93799999999999994},"last":0.629}]},{"osd":3,"last update":"Fri Jul 14 13:31:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58499999999999996,"15min":0.58399999999999996},"min":{"1min":0.434,"5min":0.39700000000000002,"15min":0.38800000000000001},"max":{"1min":0.81999999999999995,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56000000000000005,"15min":0.55700000000000005},"min":{"1min":0.45200000000000001,"5min":0.38600000000000001,"15min":0.35999999999999999},"max":{"1min":0.72399999999999998,"5min":0.77300000000000002,"15min":0.81999999999999995},"last":0.59999999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:31:48 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.82099999999999995,"15min":0.80400000000000005},"min":{"1min":0.67500000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.68300000000000005,"5min":0.53600000000000003,"15min":0.48899999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.3029999999999999},"last":0.90500000000000003}]},{"osd":5,"last update":"Fri Jul 14 13:31:48 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.88700000000000001,"15min":0.86699999999999999},"min":{"1min":0.70099999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.85899999999999999,"15min":0.85499999999999998},"min":{"1min":0.73899999999999999,"5min":0.60699999999999998,"15min":0.54000000000000004},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.88700000000000001}]},{"osd":6,"last update":"Fri Jul 14 13:31:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.85599999999999998,"15min":0.83199999999999996},"min":{"1min":0.64800000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1859999999999999,"5min":1.2749999999999999,"15min":1.446},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82599999999999996,"15min":0.82399999999999995},"min":{"1min":0.68700000000000006,"5min":0.55100000000000005,"15min":0.53700000000000003},"max":{"1min":1.111,"5min":1.119,"15min":1.266},"last":0.77800000000000002}]},{"osd":7,"last update":"Fri Jul 14 13:31:48 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.875,"15min":0.84699999999999998},"min":{"1min":0.72199999999999998,"5min":0.56799999999999995,"15min":0.55900000000000005},"max":{"1min":1.145,"5min":2.306,"15min":2.306},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.873,"15min":0.85099999999999998},"min":{"1min":0.72599999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2649999999999999,"5min":1.351,"15min":1.371},"last":0.81699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575323,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41584,"kb_used_data":2344,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330256,"statfs":{"total":96636764160,"available":96594182144,"internally_reserved":0,"allocated":2400256,"data_stored":1230923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.46300000000000002},"min":{"1min":0.33200000000000002,"5min":0.316,"15min":0.28499999999999998},"max":{"1min":0.64400000000000002,"5min":0.76600000000000001,"15min":0.81599999999999995},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51300000000000001,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.32500000000000001,"15min":0.30199999999999999},"max":{"1min":0.80200000000000005,"5min":0.80300000000000005,"15min":0.81299999999999994},"last":0.47299999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.34699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69599999999999995,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.376},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54100000000000004,"15min":0.53600000000000003},"min":{"1min":0.42899999999999999,"5min":0.373,"15min":0.32800000000000001},"max":{"1min":0.71799999999999997,"5min":0.83399999999999996,"15min":0.89200000000000002},"last":0.44700000000000001}]},{"osd":3,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.52100000000000002,"5min":0.501,"15min":0.42299999999999999},"max":{"1min":0.747,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57299999999999995,"15min":0.58699999999999997},"min":{"1min":0.41199999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80800000000000005,"5min":0.86899999999999999,"15min":0.90300000000000002},"last":0.51500000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79800000000000004,"15min":0.80900000000000005},"min":{"1min":0.56699999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1519999999999999,"5min":1.155,"15min":1.2470000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81699999999999995,"15min":0.82499999999999996},"min":{"1min":0.61599999999999999,"5min":0.56100000000000005,"15min":0.497},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.71199999999999997}]},{"osd":5,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.81699999999999995,"15min":0.82199999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1850000000000001,"5min":1.224,"15min":1.224},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.82399999999999995,"15min":0.83199999999999996},"min":{"1min":0.62,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0920000000000001,"5min":1.2010000000000001,"15min":1.202},"last":0.92800000000000005}]},{"osd":6,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.82199999999999995,"15min":0.82899999999999996},"min":{"1min":0.623,"5min":0.60399999999999998,"15min":0.57799999999999996},"max":{"1min":1.0529999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.83499999999999996,"15min":0.85299999999999998},"min":{"1min":0.64800000000000002,"5min":0.60599999999999998,"15min":0.56399999999999995},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.73299999999999998}]},{"osd":7,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.81799999999999995},"min":{"1min":0.63500000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.129,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.875,"5min":0.877,"15min":0.877},"min":{"1min":0.65600000000000003,"5min":0.60499999999999998,"15min":0.58899999999999997},"max":{"1min":1.2569999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.89000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575324,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42156,"kb_used_data":2916,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329684,"statfs":{"total":96636764160,"available":96593596416,"internally_reserved":0,"allocated":2985984,"data_stored":1818812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.45900000000000002,"15min":0.47899999999999998},"min":{"1min":0.307,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70999999999999996,"5min":0.81499999999999995,"15min":0.85299999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52600000000000002,"15min":0.53000000000000003},"min":{"1min":0.38300000000000001,"5min":0.34100000000000003,"15min":0.308},"max":{"1min":0.71299999999999997,"5min":0.73999999999999999,"15min":0.80700000000000005},"last":0.33200000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52100000000000002,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.82099999999999995},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57099999999999995,"15min":0.57399999999999995},"min":{"1min":0.44800000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.79800000000000004,"5min":0.81200000000000006,"15min":0.91200000000000003},"last":0.39400000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.53200000000000003},"min":{"1min":0.35899999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.745,"5min":0.77000000000000002,"15min":0.80100000000000005},"last":0.435},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.435,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.374}]},{"osd":4,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.64900000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0329999999999999,"5min":1.157,"15min":1.284},"last":0.995},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.84199999999999997,"15min":0.83799999999999997},"min":{"1min":0.63500000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0820000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.93000000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.81299999999999994,"15min":0.83299999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.56699999999999995},"max":{"1min":1.1160000000000001,"5min":1.28,"15min":1.294},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85199999999999998,"15min":0.85299999999999998},"min":{"1min":0.69899999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0249999999999999,"5min":1.472,"15min":1.472},"last":1.0580000000000001}]},{"osd":6,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83499999999999996,"15min":0.84299999999999997},"min":{"1min":0.65700000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.236,"5min":1.639,"15min":1.639},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.85999999999999999,"15min":0.86299999999999999},"min":{"1min":0.64200000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.002,"5min":1.544,"15min":1.544},"last":0.95699999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86899999999999999,"15min":0.85799999999999998},"min":{"1min":0.621,"5min":0.621,"15min":0.55500000000000005},"max":{"1min":1.0640000000000001,"5min":1.236,"15min":1.3200000000000001},"last":1.026},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84899999999999998,"15min":0.85999999999999999},"min":{"1min":0.63100000000000001,"5min":0.57599999999999996,"15min":0.57499999999999996},"max":{"1min":1.202,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.88900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:32:35.359 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:32:35.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.536+0000 7fa1adb40640 1 Processor -- start 2023-07-14T13:32:35.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.536+0000 7fa1adb40640 1 -- start start 2023-07-14T13:32:35.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.540+0000 7fa1adb40640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa1a8158ce0 0x7fa1a8070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:35.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.540+0000 7fa1adb40640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa1a80c9730 0x7fa1a80ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:35.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.540+0000 7fa1adb40640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1a80cc700 con 0x7fa1a80c8ad0 2023-07-14T13:32:35.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.540+0000 7fa1adb40640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a80b0ff0 con 0x7fa1a80c9730 2023-07-14T13:32:35.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.540+0000 7fa1adb40640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a8070c80 con 0x7fa1a8158ce0 2023-07-14T13:32:35.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.540+0000 7fa1a7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa1a80c9730 0x7fa1a80ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:35.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.540+0000 7fa1a7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa1a80c9730 0x7fa1a80ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39964/0 (socket says 172.21.15.5:39964) 2023-07-14T13:32:35.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.540+0000 7fa1a7fff640 1 -- 172.21.15.5:0/3709316637 learned_addr learned my addr 172.21.15.5:0/3709316637 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:35.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.540+0000 7fa1a7fff640 1 -- 172.21.15.5:0/3709316637 >> v2:172.21.15.154:3300/0 conn(0x7fa1a8158ce0 msgr2=0x7fa1a8070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:35.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.540+0000 7fa1a77fe640 1 --2- 172.21.15.5:0/3709316637 >> v2:172.21.15.154:3300/0 conn(0x7fa1a8158ce0 0x7fa1a8070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:35.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.540+0000 7fa1a7fff640 1 --2- 172.21.15.5:0/3709316637 >> v2:172.21.15.154:3300/0 conn(0x7fa1a8158ce0 0x7fa1a8070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:35.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.540+0000 7fa1a7fff640 1 -- 172.21.15.5:0/3709316637 >> v1:172.21.15.154:6789/0 conn(0x7fa1a80c8ad0 legacy=0x7fa1a80c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:35.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.540+0000 7fa1a7fff640 1 -- 172.21.15.5:0/3709316637 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a80cbdd0 con 0x7fa1a80c9730 2023-07-14T13:32:35.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.540+0000 7fa1a77fe640 1 --2- 172.21.15.5:0/3709316637 >> v2:172.21.15.154:3300/0 conn(0x7fa1a8158ce0 0x7fa1a8070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:32:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.544+0000 7fa1a7fff640 1 --2- 172.21.15.5:0/3709316637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1a80c9730 0x7fa1a80ccb90 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8071be0 tx=0x7fa1a001c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b250ba3adb1c4b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.544+0000 7fa1a67fc640 1 -- 172.21.15.5:0/3709316637 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a00a5700 con 0x7fa1a80c9730 2023-07-14T13:32:35.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.544+0000 7fa1a67fc640 1 -- 172.21.15.5:0/3709316637 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a00a5860 con 0x7fa1a80c9730 2023-07-14T13:32:35.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.544+0000 7fa1a67fc640 1 -- 172.21.15.5:0/3709316637 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a00a5bf0 con 0x7fa1a80c9730 2023-07-14T13:32:35.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.544+0000 7fa1adb40640 1 -- 172.21.15.5:0/3709316637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1a80c9730 msgr2=0x7fa1a80ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:35.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.544+0000 7fa1adb40640 1 --2- 172.21.15.5:0/3709316637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1a80c9730 0x7fa1a80ccb90 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8071be0 tx=0x7fa1a001c840 comp rx=0 tx=0).stop 2023-07-14T13:32:35.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.544+0000 7fa1adb40640 1 -- 172.21.15.5:0/3709316637 shutdown_connections 2023-07-14T13:32:35.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.544+0000 7fa1adb40640 1 --2- 172.21.15.5:0/3709316637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1a80c9730 0x7fa1a80ccb90 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:35.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.544+0000 7fa1adb40640 1 --2- 172.21.15.5:0/3709316637 >> v2:172.21.15.154:3300/0 conn(0x7fa1a8158ce0 0x7fa1a8070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:35.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.544+0000 7fa1adb40640 1 -- 172.21.15.5:0/3709316637 >> 172.21.15.5:0/3709316637 conn(0x7fa1a80afcf0 msgr2=0x7fa1a80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:35.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.544+0000 7fa1adb40640 1 -- 172.21.15.5:0/3709316637 shutdown_connections 2023-07-14T13:32:35.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.544+0000 7fa1adb40640 1 -- 172.21.15.5:0/3709316637 wait complete. 2023-07-14T13:32:35.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.544+0000 7fa1adb40640 1 Processor -- start 2023-07-14T13:32:35.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.544+0000 7fa1adb40640 1 -- start start 2023-07-14T13:32:35.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.548+0000 7fa1adb40640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1a80c8ad0 0x7fa1a8152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:35.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.548+0000 7fa1adb40640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa1a80c9730 0x7fa1a80c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.548+0000 7fa1adb40640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1a8158ce0 0x7fa1a80c3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.548+0000 7fa1adb40640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a80c3ac0 con 0x7fa1a8158ce0 2023-07-14T13:32:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.548+0000 7fa1adb40640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a80c2e80 con 0x7fa1a80c8ad0 2023-07-14T13:32:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.548+0000 7fa1adb40640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a80c3120 con 0x7fa1a80c9730 2023-07-14T13:32:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.548+0000 7fa1a7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1a8158ce0 0x7fa1a80c3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.548+0000 7fa1a7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1a8158ce0 0x7fa1a80c3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39972/0 (socket says 172.21.15.5:39972) 2023-07-14T13:32:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.548+0000 7fa1a7fff640 1 -- 172.21.15.5:0/718429612 learned_addr learned my addr 172.21.15.5:0/718429612 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:35.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.548+0000 7fa1a77fe640 1 --2- 172.21.15.5:0/718429612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1a80c8ad0 0x7fa1a8152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:35.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.548+0000 7fa1a6ffd640 1 --2- 172.21.15.5:0/718429612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa1a80c9730 0x7fa1a80c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:35.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.548+0000 7fa1a7fff640 1 -- 172.21.15.5:0/718429612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa1a80c9730 msgr2=0x7fa1a80c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:35.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.548+0000 7fa1a7fff640 1 --2- 172.21.15.5:0/718429612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa1a80c9730 0x7fa1a80c7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:35.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.548+0000 7fa1a7fff640 1 -- 172.21.15.5:0/718429612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1a80c8ad0 msgr2=0x7fa1a8152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:35.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.548+0000 7fa1a7fff640 1 --2- 172.21.15.5:0/718429612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1a80c8ad0 0x7fa1a8152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:35.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.548+0000 7fa1a7fff640 1 -- 172.21.15.5:0/718429612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a0009b30 con 0x7fa1a8158ce0 2023-07-14T13:32:35.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.548+0000 7fa1a7fff640 1 --2- 172.21.15.5:0/718429612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1a8158ce0 0x7fa1a80c3ee0 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fa1a00af040 tx=0x7fa1a00195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:35.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.548+0000 7fa18ffff640 1 -- 172.21.15.5:0/718429612 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a00b8670 con 0x7fa1a8158ce0 2023-07-14T13:32:35.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.548+0000 7fa18ffff640 1 -- 172.21.15.5:0/718429612 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a00b87d0 con 0x7fa1a8158ce0 2023-07-14T13:32:35.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.548+0000 7fa1adb40640 1 -- 172.21.15.5:0/718429612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a80c3400 con 0x7fa1a8158ce0 2023-07-14T13:32:35.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.548+0000 7fa18ffff640 1 -- 172.21.15.5:0/718429612 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a00b8b60 con 0x7fa1a8158ce0 2023-07-14T13:32:35.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.548+0000 7fa1adb40640 1 -- 172.21.15.5:0/718429612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a8152e70 con 0x7fa1a8158ce0 2023-07-14T13:32:35.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.548+0000 7fa1adb40640 1 -- 172.21.15.5:0/718429612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a80ca1a0 con 0x7fa1a8158ce0 2023-07-14T13:32:35.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.552+0000 7fa18ffff640 1 -- 172.21.15.5:0/718429612 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa1a00b8cc0 con 0x7fa1a8158ce0 2023-07-14T13:32:35.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.552+0000 7fa18ffff640 1 --2- 172.21.15.5:0/718429612 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fa1940663a0 0x7fa194068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:35.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.552+0000 7fa18ffff640 1 -- 172.21.15.5:0/718429612 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fa1a011f580 con 0x7fa1a8158ce0 2023-07-14T13:32:35.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.552+0000 7fa1a77fe640 1 --2- 172.21.15.5:0/718429612 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fa1940663a0 0x7fa194068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:35.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.552+0000 7fa1a77fe640 1 --2- 172.21.15.5:0/718429612 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fa1940663a0 0x7fa194068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa198006fd0 tx=0x7fa198008040 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:35.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.556+0000 7fa18ffff640 1 -- 172.21.15.5:0/718429612 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa1a00eca40 con 0x7fa1a8158ce0 2023-07-14T13:32:35.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.708+0000 7fa1adb40640 1 -- 172.21.15.5:0/718429612 --> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1a8070990 con 0x7fa1940663a0 2023-07-14T13:32:35.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.716+0000 7fa18ffff640 1 -- 172.21.15.5:0/718429612 <== mgr.8477 v2:172.21.15.154:6832/2194391064 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311654 (secure 0 0 0) 0x7fa19800c050 con 0x7fa1940663a0 2023-07-14T13:32:35.720 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:35.721 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:32:35.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.720+0000 7fa1adb40640 1 -- 172.21.15.5:0/718429612 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fa1940663a0 msgr2=0x7fa194068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:35.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.720+0000 7fa1adb40640 1 --2- 172.21.15.5:0/718429612 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fa1940663a0 0x7fa194068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa198006fd0 tx=0x7fa198008040 comp rx=0 tx=0).stop 2023-07-14T13:32:35.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.720+0000 7fa1adb40640 1 -- 172.21.15.5:0/718429612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1a8158ce0 msgr2=0x7fa1a80c3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:35.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.720+0000 7fa1adb40640 1 --2- 172.21.15.5:0/718429612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1a8158ce0 0x7fa1a80c3ee0 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fa1a00af040 tx=0x7fa1a00195e0 comp rx=0 tx=0).stop 2023-07-14T13:32:35.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.720+0000 7fa1adb40640 1 -- 172.21.15.5:0/718429612 shutdown_connections 2023-07-14T13:32:35.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.720+0000 7fa1adb40640 1 --2- 172.21.15.5:0/718429612 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fa1940663a0 0x7fa194068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:35.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.720+0000 7fa1adb40640 1 --2- 172.21.15.5:0/718429612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1a8158ce0 0x7fa1a80c3ee0 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:35.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.720+0000 7fa1adb40640 1 --2- 172.21.15.5:0/718429612 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa1a80c9730 0x7fa1a80c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:35.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.720+0000 7fa1adb40640 1 --2- 172.21.15.5:0/718429612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1a80c8ad0 0x7fa1a8152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:35.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.720+0000 7fa1adb40640 1 -- 172.21.15.5:0/718429612 >> 172.21.15.5:0/718429612 conn(0x7fa1a80afcf0 msgr2=0x7fa1a80af300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:35.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.720+0000 7fa1adb40640 1 -- 172.21.15.5:0/718429612 shutdown_connections 2023-07-14T13:32:35.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.720+0000 7fa1adb40640 1 -- 172.21.15.5:0/718429612 wait complete. 2023-07-14T13:32:35.740 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-07-14T13:32:34.071912+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":584,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":365,"ondisk_log_size":365,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":375648,"kb_used_data":19872,"kb_used_omap":0,"kb_used_meta":355712,"kb_avail":754599072,"statfs":{"total":773094113280,"available":772709449728,"internally_reserved":0,"allocated":20348928,"data_stored":11018294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":364249088},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.854258"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.193889+0000","last_change":"2023-07-14T13:32:31.203938+0000","last_active":"2023-07-14T13:32:32.193889+0000","last_peered":"2023-07-14T13:32:32.193889+0000","last_clean":"2023-07-14T13:32:32.193889+0000","last_became_active":"2023-07-14T13:32:31.203601+0000","last_became_peered":"2023-07-14T13:32:31.203601+0000","last_unstale":"2023-07-14T13:32:32.193889+0000","last_undegraded":"2023-07-14T13:32:32.193889+0000","last_fullsized":"2023-07-14T13:32:32.193889+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:46:08.167816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205409+0000","last_change":"2023-07-14T13:32:31.214732+0000","last_active":"2023-07-14T13:32:32.205409+0000","last_peered":"2023-07-14T13:32:32.205409+0000","last_clean":"2023-07-14T13:32:32.205409+0000","last_became_active":"2023-07-14T13:32:31.214438+0000","last_became_peered":"2023-07-14T13:32:31.214438+0000","last_unstale":"2023-07-14T13:32:32.205409+0000","last_undegraded":"2023-07-14T13:32:32.205409+0000","last_fullsized":"2023-07-14T13:32:32.205409+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:25:21.468757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.193402+0000","last_change":"2023-07-14T13:32:31.204880+0000","last_active":"2023-07-14T13:32:32.193402+0000","last_peered":"2023-07-14T13:32:32.193402+0000","last_clean":"2023-07-14T13:32:32.193402+0000","last_became_active":"2023-07-14T13:32:31.204592+0000","last_became_peered":"2023-07-14T13:32:31.204592+0000","last_unstale":"2023-07-14T13:32:32.193402+0000","last_undegraded":"2023-07-14T13:32:32.193402+0000","last_fullsized":"2023-07-14T13:32:32.193402+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:37:54.795028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.193552+0000","last_change":"2023-07-14T13:32:31.200422+0000","last_active":"2023-07-14T13:32:32.193552+0000","last_peered":"2023-07-14T13:32:32.193552+0000","last_clean":"2023-07-14T13:32:32.193552+0000","last_became_active":"2023-07-14T13:32:31.200137+0000","last_became_peered":"2023-07-14T13:32:31.200137+0000","last_unstale":"2023-07-14T13:32:32.193552+0000","last_undegraded":"2023-07-14T13:32:32.193552+0000","last_fullsized":"2023-07-14T13:32:32.193552+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:26:07.628051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190915+0000","last_change":"2023-07-14T13:32:31.205389+0000","last_active":"2023-07-14T13:32:32.190915+0000","last_peered":"2023-07-14T13:32:32.190915+0000","last_clean":"2023-07-14T13:32:32.190915+0000","last_became_active":"2023-07-14T13:32:31.205070+0000","last_became_peered":"2023-07-14T13:32:31.205070+0000","last_unstale":"2023-07-14T13:32:32.190915+0000","last_undegraded":"2023-07-14T13:32:32.190915+0000","last_fullsized":"2023-07-14T13:32:32.190915+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:16:09.294013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205102+0000","last_change":"2023-07-14T13:32:31.208121+0000","last_active":"2023-07-14T13:32:32.205102+0000","last_peered":"2023-07-14T13:32:32.205102+0000","last_clean":"2023-07-14T13:32:32.205102+0000","last_became_active":"2023-07-14T13:32:31.207798+0000","last_became_peered":"2023-07-14T13:32:31.207798+0000","last_unstale":"2023-07-14T13:32:32.205102+0000","last_undegraded":"2023-07-14T13:32:32.205102+0000","last_fullsized":"2023-07-14T13:32:32.205102+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:47:49.243329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.189638+0000","last_change":"2023-07-14T13:32:31.206567+0000","last_active":"2023-07-14T13:32:32.189638+0000","last_peered":"2023-07-14T13:32:32.189638+0000","last_clean":"2023-07-14T13:32:32.189638+0000","last_became_active":"2023-07-14T13:32:31.206300+0000","last_became_peered":"2023-07-14T13:32:31.206300+0000","last_unstale":"2023-07-14T13:32:32.189638+0000","last_undegraded":"2023-07-14T13:32:32.189638+0000","last_fullsized":"2023-07-14T13:32:32.189638+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:09:38.610886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.189926+0000","last_change":"2023-07-14T13:32:31.212134+0000","last_active":"2023-07-14T13:32:32.189926+0000","last_peered":"2023-07-14T13:32:32.189926+0000","last_clean":"2023-07-14T13:32:32.189926+0000","last_became_active":"2023-07-14T13:32:31.211792+0000","last_became_peered":"2023-07-14T13:32:31.211792+0000","last_unstale":"2023-07-14T13:32:32.189926+0000","last_undegraded":"2023-07-14T13:32:32.189926+0000","last_fullsized":"2023-07-14T13:32:32.189926+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:57:31.559095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190005+0000","last_change":"2023-07-14T13:32:31.206271+0000","last_active":"2023-07-14T13:32:32.190005+0000","last_peered":"2023-07-14T13:32:32.190005+0000","last_clean":"2023-07-14T13:32:32.190005+0000","last_became_active":"2023-07-14T13:32:31.205994+0000","last_became_peered":"2023-07-14T13:32:31.205994+0000","last_unstale":"2023-07-14T13:32:32.190005+0000","last_undegraded":"2023-07-14T13:32:32.190005+0000","last_fullsized":"2023-07-14T13:32:32.190005+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:19:48.546864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190002+0000","last_change":"2023-07-14T13:32:31.209730+0000","last_active":"2023-07-14T13:32:32.190002+0000","last_peered":"2023-07-14T13:32:32.190002+0000","last_clean":"2023-07-14T13:32:32.190002+0000","last_became_active":"2023-07-14T13:32:31.209453+0000","last_became_peered":"2023-07-14T13:32:31.209453+0000","last_unstale":"2023-07-14T13:32:32.190002+0000","last_undegraded":"2023-07-14T13:32:32.190002+0000","last_fullsized":"2023-07-14T13:32:32.190002+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:05:11.283813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.206439+0000","last_change":"2023-07-14T13:32:31.205033+0000","last_active":"2023-07-14T13:32:32.206439+0000","last_peered":"2023-07-14T13:32:32.206439+0000","last_clean":"2023-07-14T13:32:32.206439+0000","last_became_active":"2023-07-14T13:32:31.204764+0000","last_became_peered":"2023-07-14T13:32:31.204764+0000","last_unstale":"2023-07-14T13:32:32.206439+0000","last_undegraded":"2023-07-14T13:32:32.206439+0000","last_fullsized":"2023-07-14T13:32:32.206439+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:23:51.025043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205706+0000","last_change":"2023-07-14T13:32:31.207079+0000","last_active":"2023-07-14T13:32:32.205706+0000","last_peered":"2023-07-14T13:32:32.205706+0000","last_clean":"2023-07-14T13:32:32.205706+0000","last_became_active":"2023-07-14T13:32:31.206776+0000","last_became_peered":"2023-07-14T13:32:31.206776+0000","last_unstale":"2023-07-14T13:32:32.205706+0000","last_undegraded":"2023-07-14T13:32:32.205706+0000","last_fullsized":"2023-07-14T13:32:32.205706+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:15:59.984528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203425+0000","last_change":"2023-07-14T13:32:31.201883+0000","last_active":"2023-07-14T13:32:32.203425+0000","last_peered":"2023-07-14T13:32:32.203425+0000","last_clean":"2023-07-14T13:32:32.203425+0000","last_became_active":"2023-07-14T13:32:31.201605+0000","last_became_peered":"2023-07-14T13:32:31.201605+0000","last_unstale":"2023-07-14T13:32:32.203425+0000","last_undegraded":"2023-07-14T13:32:32.203425+0000","last_fullsized":"2023-07-14T13:32:32.203425+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:24:01.812269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.191085+0000","last_change":"2023-07-14T13:32:31.204506+0000","last_active":"2023-07-14T13:32:32.191085+0000","last_peered":"2023-07-14T13:32:32.191085+0000","last_clean":"2023-07-14T13:32:32.191085+0000","last_became_active":"2023-07-14T13:32:31.203749+0000","last_became_peered":"2023-07-14T13:32:31.203749+0000","last_unstale":"2023-07-14T13:32:32.191085+0000","last_undegraded":"2023-07-14T13:32:32.191085+0000","last_fullsized":"2023-07-14T13:32:32.191085+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:15:07.926351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205189+0000","last_change":"2023-07-14T13:32:31.210961+0000","last_active":"2023-07-14T13:32:32.205189+0000","last_peered":"2023-07-14T13:32:32.205189+0000","last_clean":"2023-07-14T13:32:32.205189+0000","last_became_active":"2023-07-14T13:32:31.210596+0000","last_became_peered":"2023-07-14T13:32:31.210596+0000","last_unstale":"2023-07-14T13:32:32.205189+0000","last_undegraded":"2023-07-14T13:32:32.205189+0000","last_fullsized":"2023-07-14T13:32:32.205189+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:56:14.173024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.192951+0000","last_change":"2023-07-14T13:32:31.211784+0000","last_active":"2023-07-14T13:32:32.192951+0000","last_peered":"2023-07-14T13:32:32.192951+0000","last_clean":"2023-07-14T13:32:32.192951+0000","last_became_active":"2023-07-14T13:32:31.211048+0000","last_became_peered":"2023-07-14T13:32:31.211048+0000","last_unstale":"2023-07-14T13:32:32.192951+0000","last_undegraded":"2023-07-14T13:32:32.192951+0000","last_fullsized":"2023-07-14T13:32:32.192951+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:02:15.862335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190079+0000","last_change":"2023-07-14T13:32:31.208509+0000","last_active":"2023-07-14T13:32:32.190079+0000","last_peered":"2023-07-14T13:32:32.190079+0000","last_clean":"2023-07-14T13:32:32.190079+0000","last_became_active":"2023-07-14T13:32:31.208208+0000","last_became_peered":"2023-07-14T13:32:31.208208+0000","last_unstale":"2023-07-14T13:32:32.190079+0000","last_undegraded":"2023-07-14T13:32:32.190079+0000","last_fullsized":"2023-07-14T13:32:32.190079+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:20:47.051343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.206378+0000","last_change":"2023-07-14T13:32:31.212072+0000","last_active":"2023-07-14T13:32:32.206378+0000","last_peered":"2023-07-14T13:32:32.206378+0000","last_clean":"2023-07-14T13:32:32.206378+0000","last_became_active":"2023-07-14T13:32:31.211797+0000","last_became_peered":"2023-07-14T13:32:31.211797+0000","last_unstale":"2023-07-14T13:32:32.206378+0000","last_undegraded":"2023-07-14T13:32:32.206378+0000","last_fullsized":"2023-07-14T13:32:32.206378+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:06:40.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.206165+0000","last_change":"2023-07-14T13:32:31.211445+0000","last_active":"2023-07-14T13:32:32.206165+0000","last_peered":"2023-07-14T13:32:32.206165+0000","last_clean":"2023-07-14T13:32:32.206165+0000","last_became_active":"2023-07-14T13:32:31.211147+0000","last_became_peered":"2023-07-14T13:32:31.211147+0000","last_unstale":"2023-07-14T13:32:32.206165+0000","last_undegraded":"2023-07-14T13:32:32.206165+0000","last_fullsized":"2023-07-14T13:32:32.206165+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:07:53.334708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203663+0000","last_change":"2023-07-14T13:32:31.213891+0000","last_active":"2023-07-14T13:32:32.203663+0000","last_peered":"2023-07-14T13:32:32.203663+0000","last_clean":"2023-07-14T13:32:32.203663+0000","last_became_active":"2023-07-14T13:32:31.213592+0000","last_became_peered":"2023-07-14T13:32:31.213592+0000","last_unstale":"2023-07-14T13:32:32.203663+0000","last_undegraded":"2023-07-14T13:32:32.203663+0000","last_fullsized":"2023-07-14T13:32:32.203663+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:42:37.296338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203542+0000","last_change":"2023-07-14T13:32:31.202187+0000","last_active":"2023-07-14T13:32:32.203542+0000","last_peered":"2023-07-14T13:32:32.203542+0000","last_clean":"2023-07-14T13:32:32.203542+0000","last_became_active":"2023-07-14T13:32:31.198471+0000","last_became_peered":"2023-07-14T13:32:31.198471+0000","last_unstale":"2023-07-14T13:32:32.203542+0000","last_undegraded":"2023-07-14T13:32:32.203542+0000","last_fullsized":"2023-07-14T13:32:32.203542+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:01:24.936504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205217+0000","last_change":"2023-07-14T13:32:31.202532+0000","last_active":"2023-07-14T13:32:32.205217+0000","last_peered":"2023-07-14T13:32:32.205217+0000","last_clean":"2023-07-14T13:32:32.205217+0000","last_became_active":"2023-07-14T13:32:31.202246+0000","last_became_peered":"2023-07-14T13:32:31.202246+0000","last_unstale":"2023-07-14T13:32:32.205217+0000","last_undegraded":"2023-07-14T13:32:32.205217+0000","last_fullsized":"2023-07-14T13:32:32.205217+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:38:29.105240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190486+0000","last_change":"2023-07-14T13:32:31.206853+0000","last_active":"2023-07-14T13:32:32.190486+0000","last_peered":"2023-07-14T13:32:32.190486+0000","last_clean":"2023-07-14T13:32:32.190486+0000","last_became_active":"2023-07-14T13:32:31.205309+0000","last_became_peered":"2023-07-14T13:32:31.205309+0000","last_unstale":"2023-07-14T13:32:32.190486+0000","last_undegraded":"2023-07-14T13:32:32.190486+0000","last_fullsized":"2023-07-14T13:32:32.190486+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:43:43.768931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.193049+0000","last_change":"2023-07-14T13:32:31.212040+0000","last_active":"2023-07-14T13:32:32.193049+0000","last_peered":"2023-07-14T13:32:32.193049+0000","last_clean":"2023-07-14T13:32:32.193049+0000","last_became_active":"2023-07-14T13:32:31.211481+0000","last_became_peered":"2023-07-14T13:32:31.211481+0000","last_unstale":"2023-07-14T13:32:32.193049+0000","last_undegraded":"2023-07-14T13:32:32.193049+0000","last_fullsized":"2023-07-14T13:32:32.193049+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:53:44.693730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203261+0000","last_change":"2023-07-14T13:32:31.211682+0000","last_active":"2023-07-14T13:32:32.203261+0000","last_peered":"2023-07-14T13:32:32.203261+0000","last_clean":"2023-07-14T13:32:32.203261+0000","last_became_active":"2023-07-14T13:32:31.211311+0000","last_became_peered":"2023-07-14T13:32:31.211311+0000","last_unstale":"2023-07-14T13:32:32.203261+0000","last_undegraded":"2023-07-14T13:32:32.203261+0000","last_fullsized":"2023-07-14T13:32:32.203261+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:21:38.738018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203722+0000","last_change":"2023-07-14T13:32:31.208668+0000","last_active":"2023-07-14T13:32:32.203722+0000","last_peered":"2023-07-14T13:32:32.203722+0000","last_clean":"2023-07-14T13:32:32.203722+0000","last_became_active":"2023-07-14T13:32:31.206439+0000","last_became_peered":"2023-07-14T13:32:31.206439+0000","last_unstale":"2023-07-14T13:32:32.203722+0000","last_undegraded":"2023-07-14T13:32:32.203722+0000","last_fullsized":"2023-07-14T13:32:32.203722+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:20:07.817109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205490+0000","last_change":"2023-07-14T13:32:31.206788+0000","last_active":"2023-07-14T13:32:32.205490+0000","last_peered":"2023-07-14T13:32:32.205490+0000","last_clean":"2023-07-14T13:32:32.205490+0000","last_became_active":"2023-07-14T13:32:31.205845+0000","last_became_peered":"2023-07-14T13:32:31.205845+0000","last_unstale":"2023-07-14T13:32:32.205490+0000","last_undegraded":"2023-07-14T13:32:32.205490+0000","last_fullsized":"2023-07-14T13:32:32.205490+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:31:20.919658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203750+0000","last_change":"2023-07-14T13:32:31.197264+0000","last_active":"2023-07-14T13:32:32.203750+0000","last_peered":"2023-07-14T13:32:32.203750+0000","last_clean":"2023-07-14T13:32:32.203750+0000","last_became_active":"2023-07-14T13:32:31.196879+0000","last_became_peered":"2023-07-14T13:32:31.196879+0000","last_unstale":"2023-07-14T13:32:32.203750+0000","last_undegraded":"2023-07-14T13:32:32.203750+0000","last_fullsized":"2023-07-14T13:32:32.203750+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:25:26.175917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205358+0000","last_change":"2023-07-14T13:32:31.212985+0000","last_active":"2023-07-14T13:32:32.205358+0000","last_peered":"2023-07-14T13:32:32.205358+0000","last_clean":"2023-07-14T13:32:32.205358+0000","last_became_active":"2023-07-14T13:32:31.212711+0000","last_became_peered":"2023-07-14T13:32:31.212711+0000","last_unstale":"2023-07-14T13:32:32.205358+0000","last_undegraded":"2023-07-14T13:32:32.205358+0000","last_fullsized":"2023-07-14T13:32:32.205358+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:59:24.190899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.206365+0000","last_change":"2023-07-14T13:32:31.215337+0000","last_active":"2023-07-14T13:32:32.206365+0000","last_peered":"2023-07-14T13:32:32.206365+0000","last_clean":"2023-07-14T13:32:32.206365+0000","last_became_active":"2023-07-14T13:32:31.215003+0000","last_became_peered":"2023-07-14T13:32:31.215003+0000","last_unstale":"2023-07-14T13:32:32.206365+0000","last_undegraded":"2023-07-14T13:32:32.206365+0000","last_fullsized":"2023-07-14T13:32:32.206365+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:28:23.466070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205801+0000","last_change":"2023-07-14T13:32:31.213697+0000","last_active":"2023-07-14T13:32:32.205801+0000","last_peered":"2023-07-14T13:32:32.205801+0000","last_clean":"2023-07-14T13:32:32.205801+0000","last_became_active":"2023-07-14T13:32:31.213395+0000","last_became_peered":"2023-07-14T13:32:31.213395+0000","last_unstale":"2023-07-14T13:32:32.205801+0000","last_undegraded":"2023-07-14T13:32:32.205801+0000","last_fullsized":"2023-07-14T13:32:32.205801+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:27:16.655571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205790+0000","last_change":"2023-07-14T13:32:31.217700+0000","last_active":"2023-07-14T13:32:32.205790+0000","last_peered":"2023-07-14T13:32:32.205790+0000","last_clean":"2023-07-14T13:32:32.205790+0000","last_became_active":"2023-07-14T13:32:31.217251+0000","last_became_peered":"2023-07-14T13:32:31.217251+0000","last_unstale":"2023-07-14T13:32:32.205790+0000","last_undegraded":"2023-07-14T13:32:32.205790+0000","last_fullsized":"2023-07-14T13:32:32.205790+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:02:45.080454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205041+0000","last_change":"2023-07-14T13:32:31.211084+0000","last_active":"2023-07-14T13:32:32.205041+0000","last_peered":"2023-07-14T13:32:32.205041+0000","last_clean":"2023-07-14T13:32:32.205041+0000","last_became_active":"2023-07-14T13:32:31.210752+0000","last_became_peered":"2023-07-14T13:32:31.210752+0000","last_unstale":"2023-07-14T13:32:32.205041+0000","last_undegraded":"2023-07-14T13:32:32.205041+0000","last_fullsized":"2023-07-14T13:32:32.205041+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:14:32.558210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"190'4","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.193976+0000","last_change":"2023-07-14T13:32:30.250085+0000","last_active":"2023-07-14T13:32:32.193976+0000","last_peered":"2023-07-14T13:32:32.193976+0000","last_clean":"2023-07-14T13:32:32.193976+0000","last_became_active":"2023-07-14T13:32:30.249862+0000","last_became_peered":"2023-07-14T13:32:30.249862+0000","last_unstale":"2023-07-14T13:32:32.193976+0000","last_undegraded":"2023-07-14T13:32:32.193976+0000","last_fullsized":"2023-07-14T13:32:32.193976+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:33:47.979553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.202921+0000","last_change":"2023-07-14T13:32:31.206791+0000","last_active":"2023-07-14T13:32:32.202921+0000","last_peered":"2023-07-14T13:32:32.202921+0000","last_clean":"2023-07-14T13:32:32.202921+0000","last_became_active":"2023-07-14T13:32:31.206446+0000","last_became_peered":"2023-07-14T13:32:31.206446+0000","last_unstale":"2023-07-14T13:32:32.202921+0000","last_undegraded":"2023-07-14T13:32:32.202921+0000","last_fullsized":"2023-07-14T13:32:32.202921+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:32:47.818992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"190'1","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190657+0000","last_change":"2023-07-14T13:32:30.249698+0000","last_active":"2023-07-14T13:32:32.190657+0000","last_peered":"2023-07-14T13:32:32.190657+0000","last_clean":"2023-07-14T13:32:32.190657+0000","last_became_active":"2023-07-14T13:32:30.249401+0000","last_became_peered":"2023-07-14T13:32:30.249401+0000","last_unstale":"2023-07-14T13:32:32.190657+0000","last_undegraded":"2023-07-14T13:32:32.190657+0000","last_fullsized":"2023-07-14T13:32:32.190657+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:11:08.167906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190698+0000","last_change":"2023-07-14T13:32:31.204725+0000","last_active":"2023-07-14T13:32:32.190698+0000","last_peered":"2023-07-14T13:32:32.190698+0000","last_clean":"2023-07-14T13:32:32.190698+0000","last_became_active":"2023-07-14T13:32:31.204215+0000","last_became_peered":"2023-07-14T13:32:31.204215+0000","last_unstale":"2023-07-14T13:32:32.190698+0000","last_undegraded":"2023-07-14T13:32:32.190698+0000","last_fullsized":"2023-07-14T13:32:32.190698+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:30:20.860803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.206304+0000","last_change":"2023-07-14T13:32:30.241437+0000","last_active":"2023-07-14T13:32:32.206304+0000","last_peered":"2023-07-14T13:32:32.206304+0000","last_clean":"2023-07-14T13:32:32.206304+0000","last_became_active":"2023-07-14T13:32:30.241090+0000","last_became_peered":"2023-07-14T13:32:30.241090+0000","last_unstale":"2023-07-14T13:32:32.206304+0000","last_undegraded":"2023-07-14T13:32:32.206304+0000","last_fullsized":"2023-07-14T13:32:32.206304+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:17:13.038984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205515+0000","last_change":"2023-07-14T13:32:31.210427+0000","last_active":"2023-07-14T13:32:32.205515+0000","last_peered":"2023-07-14T13:32:32.205515+0000","last_clean":"2023-07-14T13:32:32.205515+0000","last_became_active":"2023-07-14T13:32:31.210134+0000","last_became_peered":"2023-07-14T13:32:31.210134+0000","last_unstale":"2023-07-14T13:32:32.205515+0000","last_undegraded":"2023-07-14T13:32:32.205515+0000","last_fullsized":"2023-07-14T13:32:32.205515+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:19:14.781770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203719+0000","last_change":"2023-07-14T13:32:30.242094+0000","last_active":"2023-07-14T13:32:32.203719+0000","last_peered":"2023-07-14T13:32:32.203719+0000","last_clean":"2023-07-14T13:32:32.203719+0000","last_became_active":"2023-07-14T13:32:30.241826+0000","last_became_peered":"2023-07-14T13:32:30.241826+0000","last_unstale":"2023-07-14T13:32:32.203719+0000","last_undegraded":"2023-07-14T13:32:32.203719+0000","last_fullsized":"2023-07-14T13:32:32.203719+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:24:07.198567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.189955+0000","last_change":"2023-07-14T13:32:31.213427+0000","last_active":"2023-07-14T13:32:32.189955+0000","last_peered":"2023-07-14T13:32:32.189955+0000","last_clean":"2023-07-14T13:32:32.189955+0000","last_became_active":"2023-07-14T13:32:31.213140+0000","last_became_peered":"2023-07-14T13:32:31.213140+0000","last_unstale":"2023-07-14T13:32:32.189955+0000","last_undegraded":"2023-07-14T13:32:32.189955+0000","last_fullsized":"2023-07-14T13:32:32.189955+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:34:36.112916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"190'1","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.189835+0000","last_change":"2023-07-14T13:32:30.242038+0000","last_active":"2023-07-14T13:32:32.189835+0000","last_peered":"2023-07-14T13:32:32.189835+0000","last_clean":"2023-07-14T13:32:32.189835+0000","last_became_active":"2023-07-14T13:32:30.241766+0000","last_became_peered":"2023-07-14T13:32:30.241766+0000","last_unstale":"2023-07-14T13:32:32.189835+0000","last_undegraded":"2023-07-14T13:32:32.189835+0000","last_fullsized":"2023-07-14T13:32:32.189835+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:56:13.164224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203666+0000","last_change":"2023-07-14T13:32:31.210912+0000","last_active":"2023-07-14T13:32:32.203666+0000","last_peered":"2023-07-14T13:32:32.203666+0000","last_clean":"2023-07-14T13:32:32.203666+0000","last_became_active":"2023-07-14T13:32:31.210595+0000","last_became_peered":"2023-07-14T13:32:31.210595+0000","last_unstale":"2023-07-14T13:32:32.203666+0000","last_undegraded":"2023-07-14T13:32:32.203666+0000","last_fullsized":"2023-07-14T13:32:32.203666+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:49:30.384355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"190'1","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190832+0000","last_change":"2023-07-14T13:32:30.248549+0000","last_active":"2023-07-14T13:32:32.190832+0000","last_peered":"2023-07-14T13:32:32.190832+0000","last_clean":"2023-07-14T13:32:32.190832+0000","last_became_active":"2023-07-14T13:32:30.248272+0000","last_became_peered":"2023-07-14T13:32:30.248272+0000","last_unstale":"2023-07-14T13:32:32.190832+0000","last_undegraded":"2023-07-14T13:32:32.190832+0000","last_fullsized":"2023-07-14T13:32:32.190832+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:42:48.024162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203816+0000","last_change":"2023-07-14T13:32:31.204767+0000","last_active":"2023-07-14T13:32:32.203816+0000","last_peered":"2023-07-14T13:32:32.203816+0000","last_clean":"2023-07-14T13:32:32.203816+0000","last_became_active":"2023-07-14T13:32:31.204384+0000","last_became_peered":"2023-07-14T13:32:31.204384+0000","last_unstale":"2023-07-14T13:32:32.203816+0000","last_undegraded":"2023-07-14T13:32:32.203816+0000","last_fullsized":"2023-07-14T13:32:32.203816+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:33:50.548320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.202789+0000","last_change":"2023-07-14T13:32:30.239582+0000","last_active":"2023-07-14T13:32:32.202789+0000","last_peered":"2023-07-14T13:32:32.202789+0000","last_clean":"2023-07-14T13:32:32.202789+0000","last_became_active":"2023-07-14T13:32:30.239200+0000","last_became_peered":"2023-07-14T13:32:30.239200+0000","last_unstale":"2023-07-14T13:32:32.202789+0000","last_undegraded":"2023-07-14T13:32:32.202789+0000","last_fullsized":"2023-07-14T13:32:32.202789+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:43:50.308575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.193959+0000","last_change":"2023-07-14T13:32:31.211251+0000","last_active":"2023-07-14T13:32:32.193959+0000","last_peered":"2023-07-14T13:32:32.193959+0000","last_clean":"2023-07-14T13:32:32.193959+0000","last_became_active":"2023-07-14T13:32:31.210945+0000","last_became_peered":"2023-07-14T13:32:31.210945+0000","last_unstale":"2023-07-14T13:32:32.193959+0000","last_undegraded":"2023-07-14T13:32:32.193959+0000","last_fullsized":"2023-07-14T13:32:32.193959+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:56:59.464366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.189801+0000","last_change":"2023-07-14T13:32:30.241295+0000","last_active":"2023-07-14T13:32:32.189801+0000","last_peered":"2023-07-14T13:32:32.189801+0000","last_clean":"2023-07-14T13:32:32.189801+0000","last_became_active":"2023-07-14T13:32:30.239463+0000","last_became_peered":"2023-07-14T13:32:30.239463+0000","last_unstale":"2023-07-14T13:32:32.189801+0000","last_undegraded":"2023-07-14T13:32:32.189801+0000","last_fullsized":"2023-07-14T13:32:32.189801+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:27:31.022684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.189545+0000","last_change":"2023-07-14T13:32:31.202557+0000","last_active":"2023-07-14T13:32:32.189545+0000","last_peered":"2023-07-14T13:32:32.189545+0000","last_clean":"2023-07-14T13:32:32.189545+0000","last_became_active":"2023-07-14T13:32:31.202279+0000","last_became_peered":"2023-07-14T13:32:31.202279+0000","last_unstale":"2023-07-14T13:32:32.189545+0000","last_undegraded":"2023-07-14T13:32:32.189545+0000","last_fullsized":"2023-07-14T13:32:32.189545+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:56:05.505108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"190'1","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203379+0000","last_change":"2023-07-14T13:32:30.242629+0000","last_active":"2023-07-14T13:32:32.203379+0000","last_peered":"2023-07-14T13:32:32.203379+0000","last_clean":"2023-07-14T13:32:32.203379+0000","last_became_active":"2023-07-14T13:32:30.242363+0000","last_became_peered":"2023-07-14T13:32:30.242363+0000","last_unstale":"2023-07-14T13:32:32.203379+0000","last_undegraded":"2023-07-14T13:32:32.203379+0000","last_fullsized":"2023-07-14T13:32:32.203379+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:51:35.349822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.206048+0000","last_change":"2023-07-14T13:32:31.216185+0000","last_active":"2023-07-14T13:32:32.206048+0000","last_peered":"2023-07-14T13:32:32.206048+0000","last_clean":"2023-07-14T13:32:32.206048+0000","last_became_active":"2023-07-14T13:32:31.215885+0000","last_became_peered":"2023-07-14T13:32:31.215885+0000","last_unstale":"2023-07-14T13:32:32.206048+0000","last_undegraded":"2023-07-14T13:32:32.206048+0000","last_fullsized":"2023-07-14T13:32:32.206048+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:43:27.797146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190121+0000","last_change":"2023-07-14T13:32:30.243084+0000","last_active":"2023-07-14T13:32:32.190121+0000","last_peered":"2023-07-14T13:32:32.190121+0000","last_clean":"2023-07-14T13:32:32.190121+0000","last_became_active":"2023-07-14T13:32:30.242780+0000","last_became_peered":"2023-07-14T13:32:30.242780+0000","last_unstale":"2023-07-14T13:32:32.190121+0000","last_undegraded":"2023-07-14T13:32:32.190121+0000","last_fullsized":"2023-07-14T13:32:32.190121+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:24:32.879660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205543+0000","last_change":"2023-07-14T13:32:31.209834+0000","last_active":"2023-07-14T13:32:32.205543+0000","last_peered":"2023-07-14T13:32:32.205543+0000","last_clean":"2023-07-14T13:32:32.205543+0000","last_became_active":"2023-07-14T13:32:31.209513+0000","last_became_peered":"2023-07-14T13:32:31.209513+0000","last_unstale":"2023-07-14T13:32:32.205543+0000","last_undegraded":"2023-07-14T13:32:32.205543+0000","last_fullsized":"2023-07-14T13:32:32.205543+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:05:11.283813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"190'1","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190804+0000","last_change":"2023-07-14T13:32:30.242983+0000","last_active":"2023-07-14T13:32:32.190804+0000","last_peered":"2023-07-14T13:32:32.190804+0000","last_clean":"2023-07-14T13:32:32.190804+0000","last_became_active":"2023-07-14T13:32:30.242716+0000","last_became_peered":"2023-07-14T13:32:30.242716+0000","last_unstale":"2023-07-14T13:32:32.190804+0000","last_undegraded":"2023-07-14T13:32:32.190804+0000","last_fullsized":"2023-07-14T13:32:32.190804+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:59:01.370430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205519+0000","last_change":"2023-07-14T13:32:31.208101+0000","last_active":"2023-07-14T13:32:32.205519+0000","last_peered":"2023-07-14T13:32:32.205519+0000","last_clean":"2023-07-14T13:32:32.205519+0000","last_became_active":"2023-07-14T13:32:31.207799+0000","last_became_peered":"2023-07-14T13:32:31.207799+0000","last_unstale":"2023-07-14T13:32:32.205519+0000","last_undegraded":"2023-07-14T13:32:32.205519+0000","last_fullsized":"2023-07-14T13:32:32.205519+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:34:36.112916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190066+0000","last_change":"2023-07-14T13:32:30.244326+0000","last_active":"2023-07-14T13:32:32.190066+0000","last_peered":"2023-07-14T13:32:32.190066+0000","last_clean":"2023-07-14T13:32:32.190066+0000","last_became_active":"2023-07-14T13:32:30.241302+0000","last_became_peered":"2023-07-14T13:32:30.241302+0000","last_unstale":"2023-07-14T13:32:32.190066+0000","last_undegraded":"2023-07-14T13:32:32.190066+0000","last_fullsized":"2023-07-14T13:32:32.190066+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:27:15.646772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203864+0000","last_change":"2023-07-14T13:32:31.197067+0000","last_active":"2023-07-14T13:32:32.203864+0000","last_peered":"2023-07-14T13:32:32.203864+0000","last_clean":"2023-07-14T13:32:32.203864+0000","last_became_active":"2023-07-14T13:32:31.196749+0000","last_became_peered":"2023-07-14T13:32:31.196749+0000","last_unstale":"2023-07-14T13:32:32.203864+0000","last_undegraded":"2023-07-14T13:32:32.203864+0000","last_fullsized":"2023-07-14T13:32:32.203864+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:01:23.759739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.191148+0000","last_change":"2023-07-14T13:32:30.240867+0000","last_active":"2023-07-14T13:32:32.191148+0000","last_peered":"2023-07-14T13:32:32.191148+0000","last_clean":"2023-07-14T13:32:32.191148+0000","last_became_active":"2023-07-14T13:32:30.240602+0000","last_became_peered":"2023-07-14T13:32:30.240602+0000","last_unstale":"2023-07-14T13:32:32.191148+0000","last_undegraded":"2023-07-14T13:32:32.191148+0000","last_fullsized":"2023-07-14T13:32:32.191148+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:34:02.222616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190650+0000","last_change":"2023-07-14T13:32:31.210252+0000","last_active":"2023-07-14T13:32:32.190650+0000","last_peered":"2023-07-14T13:32:32.190650+0000","last_clean":"2023-07-14T13:32:32.190650+0000","last_became_active":"2023-07-14T13:32:31.209716+0000","last_became_peered":"2023-07-14T13:32:31.209716+0000","last_unstale":"2023-07-14T13:32:32.190650+0000","last_undegraded":"2023-07-14T13:32:32.190650+0000","last_fullsized":"2023-07-14T13:32:32.190650+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:04:33.766884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205405+0000","last_change":"2023-07-14T13:32:30.241454+0000","last_active":"2023-07-14T13:32:32.205405+0000","last_peered":"2023-07-14T13:32:32.205405+0000","last_clean":"2023-07-14T13:32:32.205405+0000","last_became_active":"2023-07-14T13:32:30.241096+0000","last_became_peered":"2023-07-14T13:32:30.241096+0000","last_unstale":"2023-07-14T13:32:32.205405+0000","last_undegraded":"2023-07-14T13:32:32.205405+0000","last_fullsized":"2023-07-14T13:32:32.205405+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:57:30.550296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190479+0000","last_change":"2023-07-14T13:32:31.209143+0000","last_active":"2023-07-14T13:32:32.190479+0000","last_peered":"2023-07-14T13:32:32.190479+0000","last_clean":"2023-07-14T13:32:32.190479+0000","last_became_active":"2023-07-14T13:32:31.208863+0000","last_became_peered":"2023-07-14T13:32:31.208863+0000","last_unstale":"2023-07-14T13:32:32.190479+0000","last_undegraded":"2023-07-14T13:32:32.190479+0000","last_fullsized":"2023-07-14T13:32:32.190479+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:06:40.938914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203211+0000","last_change":"2023-07-14T13:32:30.241042+0000","last_active":"2023-07-14T13:32:32.203211+0000","last_peered":"2023-07-14T13:32:32.203211+0000","last_clean":"2023-07-14T13:32:32.203211+0000","last_became_active":"2023-07-14T13:32:30.240771+0000","last_became_peered":"2023-07-14T13:32:30.240771+0000","last_unstale":"2023-07-14T13:32:32.203211+0000","last_undegraded":"2023-07-14T13:32:32.203211+0000","last_fullsized":"2023-07-14T13:32:32.203211+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:41:34.853443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205937+0000","last_change":"2023-07-14T13:32:31.214571+0000","last_active":"2023-07-14T13:32:32.205937+0000","last_peered":"2023-07-14T13:32:32.205937+0000","last_clean":"2023-07-14T13:32:32.205937+0000","last_became_active":"2023-07-14T13:32:31.214263+0000","last_became_peered":"2023-07-14T13:32:31.214263+0000","last_unstale":"2023-07-14T13:32:32.205937+0000","last_undegraded":"2023-07-14T13:32:32.205937+0000","last_fullsized":"2023-07-14T13:32:32.205937+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:40:58.378949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205361+0000","last_change":"2023-07-14T13:32:30.246075+0000","last_active":"2023-07-14T13:32:32.205361+0000","last_peered":"2023-07-14T13:32:32.205361+0000","last_clean":"2023-07-14T13:32:32.205361+0000","last_became_active":"2023-07-14T13:32:30.245775+0000","last_became_peered":"2023-07-14T13:32:30.245775+0000","last_unstale":"2023-07-14T13:32:32.205361+0000","last_undegraded":"2023-07-14T13:32:32.205361+0000","last_fullsized":"2023-07-14T13:32:32.205361+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:02:24.666528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205039+0000","last_change":"2023-07-14T13:32:31.211743+0000","last_active":"2023-07-14T13:32:32.205039+0000","last_peered":"2023-07-14T13:32:32.205039+0000","last_clean":"2023-07-14T13:32:32.205039+0000","last_became_active":"2023-07-14T13:32:31.211457+0000","last_became_peered":"2023-07-14T13:32:31.211457+0000","last_unstale":"2023-07-14T13:32:32.205039+0000","last_undegraded":"2023-07-14T13:32:32.205039+0000","last_fullsized":"2023-07-14T13:32:32.205039+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:27:32.031484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.191024+0000","last_change":"2023-07-14T13:32:30.242261+0000","last_active":"2023-07-14T13:32:32.191024+0000","last_peered":"2023-07-14T13:32:32.191024+0000","last_clean":"2023-07-14T13:32:32.191024+0000","last_became_active":"2023-07-14T13:32:30.241989+0000","last_became_peered":"2023-07-14T13:32:30.241989+0000","last_unstale":"2023-07-14T13:32:32.191024+0000","last_undegraded":"2023-07-14T13:32:32.191024+0000","last_fullsized":"2023-07-14T13:32:32.191024+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:25:04.156717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.189717+0000","last_change":"2023-07-14T13:32:31.206471+0000","last_active":"2023-07-14T13:32:32.189717+0000","last_peered":"2023-07-14T13:32:32.189717+0000","last_clean":"2023-07-14T13:32:32.189717+0000","last_became_active":"2023-07-14T13:32:31.205885+0000","last_became_peered":"2023-07-14T13:32:31.205885+0000","last_unstale":"2023-07-14T13:32:32.189717+0000","last_undegraded":"2023-07-14T13:32:32.189717+0000","last_fullsized":"2023-07-14T13:32:32.189717+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:45:16.493561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"191'1","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:33.504262+0000","last_change":"2023-07-14T13:32:30.245092+0000","last_active":"2023-07-14T13:32:33.504262+0000","last_peered":"2023-07-14T13:32:33.504262+0000","last_clean":"2023-07-14T13:32:33.504262+0000","last_became_active":"2023-07-14T13:32:30.244339+0000","last_became_peered":"2023-07-14T13:32:30.244339+0000","last_unstale":"2023-07-14T13:32:33.504262+0000","last_undegraded":"2023-07-14T13:32:33.504262+0000","last_fullsized":"2023-07-14T13:32:33.504262+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:16:57.866764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203555+0000","last_change":"2023-07-14T13:32:31.204646+0000","last_active":"2023-07-14T13:32:32.203555+0000","last_peered":"2023-07-14T13:32:32.203555+0000","last_clean":"2023-07-14T13:32:32.203555+0000","last_became_active":"2023-07-14T13:32:31.204331+0000","last_became_peered":"2023-07-14T13:32:31.204331+0000","last_unstale":"2023-07-14T13:32:32.203555+0000","last_undegraded":"2023-07-14T13:32:32.203555+0000","last_fullsized":"2023-07-14T13:32:32.203555+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:49:58.943103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203093+0000","last_change":"2023-07-14T13:32:30.242222+0000","last_active":"2023-07-14T13:32:32.203093+0000","last_peered":"2023-07-14T13:32:32.203093+0000","last_clean":"2023-07-14T13:32:32.203093+0000","last_became_active":"2023-07-14T13:32:30.241950+0000","last_became_peered":"2023-07-14T13:32:30.241950+0000","last_unstale":"2023-07-14T13:32:32.203093+0000","last_undegraded":"2023-07-14T13:32:32.203093+0000","last_fullsized":"2023-07-14T13:32:32.203093+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:31:01.648192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.189686+0000","last_change":"2023-07-14T13:32:31.203457+0000","last_active":"2023-07-14T13:32:32.189686+0000","last_peered":"2023-07-14T13:32:32.189686+0000","last_clean":"2023-07-14T13:32:32.189686+0000","last_became_active":"2023-07-14T13:32:31.203165+0000","last_became_peered":"2023-07-14T13:32:31.203165+0000","last_unstale":"2023-07-14T13:32:32.189686+0000","last_undegraded":"2023-07-14T13:32:32.189686+0000","last_fullsized":"2023-07-14T13:32:32.189686+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:39:27.399834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203778+0000","last_change":"2023-07-14T13:32:30.244565+0000","last_active":"2023-07-14T13:32:32.203778+0000","last_peered":"2023-07-14T13:32:32.203778+0000","last_clean":"2023-07-14T13:32:32.203778+0000","last_became_active":"2023-07-14T13:32:30.244306+0000","last_became_peered":"2023-07-14T13:32:30.244306+0000","last_unstale":"2023-07-14T13:32:32.203778+0000","last_undegraded":"2023-07-14T13:32:32.203778+0000","last_fullsized":"2023-07-14T13:32:32.203778+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:42:07.607381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.193583+0000","last_change":"2023-07-14T13:32:31.201412+0000","last_active":"2023-07-14T13:32:32.193583+0000","last_peered":"2023-07-14T13:32:32.193583+0000","last_clean":"2023-07-14T13:32:32.193583+0000","last_became_active":"2023-07-14T13:32:31.201144+0000","last_became_peered":"2023-07-14T13:32:31.201144+0000","last_unstale":"2023-07-14T13:32:32.193583+0000","last_undegraded":"2023-07-14T13:32:32.193583+0000","last_fullsized":"2023-07-14T13:32:32.193583+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:59:43.408218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.193364+0000","last_change":"2023-07-14T13:32:30.239572+0000","last_active":"2023-07-14T13:32:32.193364+0000","last_peered":"2023-07-14T13:32:32.193364+0000","last_clean":"2023-07-14T13:32:32.193364+0000","last_became_active":"2023-07-14T13:32:30.239299+0000","last_became_peered":"2023-07-14T13:32:30.239299+0000","last_unstale":"2023-07-14T13:32:32.193364+0000","last_undegraded":"2023-07-14T13:32:32.193364+0000","last_fullsized":"2023-07-14T13:32:32.193364+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:12:04.747786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205760+0000","last_change":"2023-07-14T13:32:31.211161+0000","last_active":"2023-07-14T13:32:32.205760+0000","last_peered":"2023-07-14T13:32:32.205760+0000","last_clean":"2023-07-14T13:32:32.205760+0000","last_became_active":"2023-07-14T13:32:31.210296+0000","last_became_peered":"2023-07-14T13:32:31.210296+0000","last_unstale":"2023-07-14T13:32:32.205760+0000","last_undegraded":"2023-07-14T13:32:32.205760+0000","last_fullsized":"2023-07-14T13:32:32.205760+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:45:18.896852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203320+0000","last_change":"2023-07-14T13:32:30.247260+0000","last_active":"2023-07-14T13:32:32.203320+0000","last_peered":"2023-07-14T13:32:32.203320+0000","last_clean":"2023-07-14T13:32:32.203320+0000","last_became_active":"2023-07-14T13:32:30.246874+0000","last_became_peered":"2023-07-14T13:32:30.246874+0000","last_unstale":"2023-07-14T13:32:32.203320+0000","last_undegraded":"2023-07-14T13:32:32.203320+0000","last_fullsized":"2023-07-14T13:32:32.203320+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:27:47.420592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203137+0000","last_change":"2023-07-14T13:32:31.196912+0000","last_active":"2023-07-14T13:32:32.203137+0000","last_peered":"2023-07-14T13:32:32.203137+0000","last_clean":"2023-07-14T13:32:32.203137+0000","last_became_active":"2023-07-14T13:32:31.196563+0000","last_became_peered":"2023-07-14T13:32:31.196563+0000","last_unstale":"2023-07-14T13:32:32.203137+0000","last_undegraded":"2023-07-14T13:32:32.203137+0000","last_fullsized":"2023-07-14T13:32:32.203137+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:34:18.832102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205921+0000","last_change":"2023-07-14T13:32:30.242655+0000","last_active":"2023-07-14T13:32:32.205921+0000","last_peered":"2023-07-14T13:32:32.205921+0000","last_clean":"2023-07-14T13:32:32.205921+0000","last_became_active":"2023-07-14T13:32:30.242239+0000","last_became_peered":"2023-07-14T13:32:30.242239+0000","last_unstale":"2023-07-14T13:32:32.205921+0000","last_undegraded":"2023-07-14T13:32:32.205921+0000","last_fullsized":"2023-07-14T13:32:32.205921+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:20:46.042543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203968+0000","last_change":"2023-07-14T13:32:31.206218+0000","last_active":"2023-07-14T13:32:32.203968+0000","last_peered":"2023-07-14T13:32:32.203968+0000","last_clean":"2023-07-14T13:32:32.203968+0000","last_became_active":"2023-07-14T13:32:31.205868+0000","last_became_peered":"2023-07-14T13:32:31.205868+0000","last_unstale":"2023-07-14T13:32:32.203968+0000","last_undegraded":"2023-07-14T13:32:32.203968+0000","last_fullsized":"2023-07-14T13:32:32.203968+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:12:19.595971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190233+0000","last_change":"2023-07-14T13:32:30.245599+0000","last_active":"2023-07-14T13:32:32.190233+0000","last_peered":"2023-07-14T13:32:32.190233+0000","last_clean":"2023-07-14T13:32:32.190233+0000","last_became_active":"2023-07-14T13:32:30.245326+0000","last_became_peered":"2023-07-14T13:32:30.245326+0000","last_unstale":"2023-07-14T13:32:32.190233+0000","last_undegraded":"2023-07-14T13:32:32.190233+0000","last_fullsized":"2023-07-14T13:32:32.190233+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:28:22.457271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205270+0000","last_change":"2023-07-14T13:32:31.209183+0000","last_active":"2023-07-14T13:32:32.205270+0000","last_peered":"2023-07-14T13:32:32.205270+0000","last_clean":"2023-07-14T13:32:32.205270+0000","last_became_active":"2023-07-14T13:32:31.208913+0000","last_became_peered":"2023-07-14T13:32:31.208913+0000","last_unstale":"2023-07-14T13:32:32.205270+0000","last_undegraded":"2023-07-14T13:32:32.205270+0000","last_fullsized":"2023-07-14T13:32:32.205270+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:04:29.283317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203248+0000","last_change":"2023-07-14T13:32:30.245307+0000","last_active":"2023-07-14T13:32:32.203248+0000","last_peered":"2023-07-14T13:32:32.203248+0000","last_clean":"2023-07-14T13:32:32.203248+0000","last_became_active":"2023-07-14T13:32:30.244760+0000","last_became_peered":"2023-07-14T13:32:30.244760+0000","last_unstale":"2023-07-14T13:32:32.203248+0000","last_undegraded":"2023-07-14T13:32:32.203248+0000","last_fullsized":"2023-07-14T13:32:32.203248+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:24:11.727066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"178'326","reported_seq":1223,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205457+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:32:32.205457+0000","last_peered":"2023-07-14T13:32:32.205457+0000","last_clean":"2023-07-14T13:32:32.205457+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:32:32.205457+0000","last_undegraded":"2023-07-14T13:32:32.205457+0000","last_fullsized":"2023-07-14T13:32:32.205457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:16:48.744501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":322,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.206010+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:32:32.206010+0000","last_peered":"2023-07-14T13:32:32.206010+0000","last_clean":"2023-07-14T13:32:32.206010+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:32:32.206010+0000","last_undegraded":"2023-07-14T13:32:32.206010+0000","last_fullsized":"2023-07-14T13:32:32.206010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:44:43.690308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203041+0000","last_change":"2023-07-14T13:32:31.201043+0000","last_active":"2023-07-14T13:32:32.203041+0000","last_peered":"2023-07-14T13:32:32.203041+0000","last_clean":"2023-07-14T13:32:32.203041+0000","last_became_active":"2023-07-14T13:32:31.200709+0000","last_became_peered":"2023-07-14T13:32:31.200709+0000","last_unstale":"2023-07-14T13:32:32.203041+0000","last_undegraded":"2023-07-14T13:32:32.203041+0000","last_fullsized":"2023-07-14T13:32:32.203041+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:30:38.008514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"190'3","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.193646+0000","last_change":"2023-07-14T13:32:30.242440+0000","last_active":"2023-07-14T13:32:32.193646+0000","last_peered":"2023-07-14T13:32:32.193646+0000","last_clean":"2023-07-14T13:32:32.193646+0000","last_became_active":"2023-07-14T13:32:30.242160+0000","last_became_peered":"2023-07-14T13:32:30.242160+0000","last_unstale":"2023-07-14T13:32:32.193646+0000","last_undegraded":"2023-07-14T13:32:32.193646+0000","last_fullsized":"2023-07-14T13:32:32.193646+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:05:10.714583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":326,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205609+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:32:32.205609+0000","last_peered":"2023-07-14T13:32:32.205609+0000","last_clean":"2023-07-14T13:32:32.205609+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:32:32.205609+0000","last_undegraded":"2023-07-14T13:32:32.205609+0000","last_fullsized":"2023-07-14T13:32:32.205609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:14:35.978723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203534+0000","last_change":"2023-07-14T13:32:31.214524+0000","last_active":"2023-07-14T13:32:32.203534+0000","last_peered":"2023-07-14T13:32:32.203534+0000","last_clean":"2023-07-14T13:32:32.203534+0000","last_became_active":"2023-07-14T13:32:31.214217+0000","last_became_peered":"2023-07-14T13:32:31.214217+0000","last_unstale":"2023-07-14T13:32:32.203534+0000","last_undegraded":"2023-07-14T13:32:32.203534+0000","last_fullsized":"2023-07-14T13:32:32.203534+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:20:12.411054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"190'6","reported_seq":19,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203957+0000","last_change":"2023-07-14T13:32:30.241035+0000","last_active":"2023-07-14T13:32:32.203957+0000","last_peered":"2023-07-14T13:32:32.203957+0000","last_clean":"2023-07-14T13:32:32.203957+0000","last_became_active":"2023-07-14T13:32:30.240769+0000","last_became_peered":"2023-07-14T13:32:30.240769+0000","last_unstale":"2023-07-14T13:32:32.203957+0000","last_undegraded":"2023-07-14T13:32:32.203957+0000","last_fullsized":"2023-07-14T13:32:32.203957+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:42:54.493273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":328,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.202875+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:32:32.202875+0000","last_peered":"2023-07-14T13:32:32.202875+0000","last_clean":"2023-07-14T13:32:32.202875+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:32:32.202875+0000","last_undegraded":"2023-07-14T13:32:32.202875+0000","last_fullsized":"2023-07-14T13:32:32.202875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:30:54.621706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205054+0000","last_change":"2023-07-14T13:32:31.212190+0000","last_active":"2023-07-14T13:32:32.205054+0000","last_peered":"2023-07-14T13:32:32.205054+0000","last_clean":"2023-07-14T13:32:32.205054+0000","last_became_active":"2023-07-14T13:32:31.210287+0000","last_became_peered":"2023-07-14T13:32:31.210287+0000","last_unstale":"2023-07-14T13:32:32.205054+0000","last_undegraded":"2023-07-14T13:32:32.205054+0000","last_fullsized":"2023-07-14T13:32:32.205054+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:29:58.513910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203129+0000","last_change":"2023-07-14T13:32:30.244430+0000","last_active":"2023-07-14T13:32:32.203129+0000","last_peered":"2023-07-14T13:32:32.203129+0000","last_clean":"2023-07-14T13:32:32.203129+0000","last_became_active":"2023-07-14T13:32:30.244154+0000","last_became_peered":"2023-07-14T13:32:30.244154+0000","last_unstale":"2023-07-14T13:32:32.203129+0000","last_undegraded":"2023-07-14T13:32:32.203129+0000","last_fullsized":"2023-07-14T13:32:32.203129+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:53:19.858001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":322,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205619+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:32:32.205619+0000","last_peered":"2023-07-14T13:32:32.205619+0000","last_clean":"2023-07-14T13:32:32.205619+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:32:32.205619+0000","last_undegraded":"2023-07-14T13:32:32.205619+0000","last_fullsized":"2023-07-14T13:32:32.205619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:39:58.348712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.206391+0000","last_change":"2023-07-14T13:32:31.206840+0000","last_active":"2023-07-14T13:32:32.206391+0000","last_peered":"2023-07-14T13:32:32.206391+0000","last_clean":"2023-07-14T13:32:32.206391+0000","last_became_active":"2023-07-14T13:32:31.206552+0000","last_became_peered":"2023-07-14T13:32:31.206552+0000","last_unstale":"2023-07-14T13:32:32.206391+0000","last_undegraded":"2023-07-14T13:32:32.206391+0000","last_fullsized":"2023-07-14T13:32:32.206391+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:08:53.852889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.206156+0000","last_change":"2023-07-14T13:32:30.241324+0000","last_active":"2023-07-14T13:32:32.206156+0000","last_peered":"2023-07-14T13:32:32.206156+0000","last_clean":"2023-07-14T13:32:32.206156+0000","last_became_active":"2023-07-14T13:32:30.240927+0000","last_became_peered":"2023-07-14T13:32:30.240927+0000","last_unstale":"2023-07-14T13:32:32.206156+0000","last_undegraded":"2023-07-14T13:32:32.206156+0000","last_fullsized":"2023-07-14T13:32:32.206156+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:05:44.673186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":334,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190234+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:32:32.190234+0000","last_peered":"2023-07-14T13:32:32.190234+0000","last_clean":"2023-07-14T13:32:32.190234+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:32:32.190234+0000","last_undegraded":"2023-07-14T13:32:32.190234+0000","last_fullsized":"2023-07-14T13:32:32.190234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:28:03.136557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203926+0000","last_change":"2023-07-14T13:32:31.209121+0000","last_active":"2023-07-14T13:32:32.203926+0000","last_peered":"2023-07-14T13:32:32.203926+0000","last_clean":"2023-07-14T13:32:32.203926+0000","last_became_active":"2023-07-14T13:32:31.206507+0000","last_became_peered":"2023-07-14T13:32:31.206507+0000","last_unstale":"2023-07-14T13:32:32.203926+0000","last_undegraded":"2023-07-14T13:32:32.203926+0000","last_fullsized":"2023-07-14T13:32:32.203926+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:19:11.545881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"190'8","reported_seq":21,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.189676+0000","last_change":"2023-07-14T13:32:30.236226+0000","last_active":"2023-07-14T13:32:32.189676+0000","last_peered":"2023-07-14T13:32:32.189676+0000","last_clean":"2023-07-14T13:32:32.189676+0000","last_became_active":"2023-07-14T13:32:30.235945+0000","last_became_peered":"2023-07-14T13:32:30.235945+0000","last_unstale":"2023-07-14T13:32:32.189676+0000","last_undegraded":"2023-07-14T13:32:32.189676+0000","last_fullsized":"2023-07-14T13:32:32.189676+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:31:00.930151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":324,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205684+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:32:32.205684+0000","last_peered":"2023-07-14T13:32:32.205684+0000","last_clean":"2023-07-14T13:32:32.205684+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:32:32.205684+0000","last_undegraded":"2023-07-14T13:32:32.205684+0000","last_fullsized":"2023-07-14T13:32:32.205684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:28:09.921387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.205960+0000","last_change":"2023-07-14T13:32:31.215815+0000","last_active":"2023-07-14T13:32:32.205960+0000","last_peered":"2023-07-14T13:32:32.205960+0000","last_clean":"2023-07-14T13:32:32.205960+0000","last_became_active":"2023-07-14T13:32:31.215352+0000","last_became_peered":"2023-07-14T13:32:31.215352+0000","last_unstale":"2023-07-14T13:32:32.205960+0000","last_undegraded":"2023-07-14T13:32:32.205960+0000","last_fullsized":"2023-07-14T13:32:32.205960+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:10:34.934009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.191048+0000","last_change":"2023-07-14T13:32:30.244445+0000","last_active":"2023-07-14T13:32:32.191048+0000","last_peered":"2023-07-14T13:32:32.191048+0000","last_clean":"2023-07-14T13:32:32.191048+0000","last_became_active":"2023-07-14T13:32:30.243969+0000","last_became_peered":"2023-07-14T13:32:30.243969+0000","last_unstale":"2023-07-14T13:32:32.191048+0000","last_undegraded":"2023-07-14T13:32:32.191048+0000","last_fullsized":"2023-07-14T13:32:32.191048+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:54:23.473518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":333,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190308+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:32:32.190308+0000","last_peered":"2023-07-14T13:32:32.190308+0000","last_clean":"2023-07-14T13:32:32.190308+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:32:32.190308+0000","last_undegraded":"2023-07-14T13:32:32.190308+0000","last_fullsized":"2023-07-14T13:32:32.190308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:37:23.849632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.190173+0000","last_change":"2023-07-14T13:32:31.208666+0000","last_active":"2023-07-14T13:32:32.190173+0000","last_peered":"2023-07-14T13:32:32.190173+0000","last_clean":"2023-07-14T13:32:32.190173+0000","last_became_active":"2023-07-14T13:32:31.208381+0000","last_became_peered":"2023-07-14T13:32:31.208381+0000","last_unstale":"2023-07-14T13:32:32.190173+0000","last_undegraded":"2023-07-14T13:32:32.190173+0000","last_fullsized":"2023-07-14T13:32:32.190173+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:30.211684+0000","last_clean_scrub_stamp":"2023-07-14T13:32:30.211684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:05:45.681986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.203195+0000","last_change":"2023-07-14T13:32:30.239834+0000","last_active":"2023-07-14T13:32:32.203195+0000","last_peered":"2023-07-14T13:32:32.203195+0000","last_clean":"2023-07-14T13:32:32.203195+0000","last_became_active":"2023-07-14T13:32:30.239519+0000","last_became_peered":"2023-07-14T13:32:30.239519+0000","last_unstale":"2023-07-14T13:32:32.203195+0000","last_undegraded":"2023-07-14T13:32:32.203195+0000","last_fullsized":"2023-07-14T13:32:32.203195+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:32:29.202885+0000","last_clean_scrub_stamp":"2023-07-14T13:32:29.202885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:33:07.057466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":325,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-14T13:32:32.206108+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:32:32.206108+0000","last_peered":"2023-07-14T13:32:32.206108+0000","last_clean":"2023-07-14T13:32:32.206108+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:32:32.206108+0000","last_undegraded":"2023-07-14T13:32:32.206108+0000","last_fullsized":"2023-07-14T13:32:32.206108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:42:36.055102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575322,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60200,"kb_used_data":2912,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94311640,"statfs":{"total":96636764160,"available":96575119360,"internally_reserved":0,"allocated":2981888,"data_stored":1819727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.75600000000000001,"15min":0.74299999999999999},"min":{"1min":0.58599999999999997,"5min":0.48799999999999999,"15min":0.48699999999999999},"max":{"1min":0.96999999999999997,"5min":1.208,"15min":1.208},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.746,"15min":0.747},"min":{"1min":0.59999999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96699999999999997,"5min":1.042,"15min":1.042},"last":0.85699999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.76300000000000001,"15min":0.76000000000000001},"min":{"1min":0.629,"5min":0.433,"15min":0.433},"max":{"1min":0.96799999999999997,"5min":1.444,"15min":1.444},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78900000000000003,"15min":0.77000000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0029999999999999,"5min":1.534,"15min":1.534},"last":0.80400000000000005}]},{"osd":2,"last update":"Fri Jul 14 13:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.745,"15min":0.745},"min":{"1min":0.64100000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96499999999999997,"5min":1.1120000000000001,"15min":1.1379999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.79600000000000004,"15min":0.77400000000000002},"min":{"1min":0.64100000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.0089999999999999,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.82099999999999995}]},{"osd":3,"last update":"Fri Jul 14 13:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77000000000000002,"15min":0.75900000000000001},"min":{"1min":0.51700000000000002,"5min":0.51600000000000001,"15min":0.499},"max":{"1min":0.94599999999999995,"5min":1.498,"15min":1.498},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.80500000000000005,"15min":0.78600000000000003},"min":{"1min":0.69399999999999995,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.97899999999999998,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.92700000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.376,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81599999999999995,"5min":1.0129999999999999,"15min":1.0620000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.62,"15min":0.625},"min":{"1min":0.45800000000000002,"5min":0.44700000000000001,"15min":0.439},"max":{"1min":0.91000000000000003,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.76800000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.63200000000000001,"15min":0.61699999999999999},"min":{"1min":0.54600000000000004,"5min":0.41799999999999998,"15min":0.41499999999999998},"max":{"1min":0.88800000000000001,"5min":1.145,"15min":1.145},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66200000000000003,"15min":0.65700000000000003},"min":{"1min":0.48099999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88200000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.66300000000000003}]},{"osd":6,"last update":"Fri Jul 14 13:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72399999999999998,"15min":0.71699999999999997},"min":{"1min":0.52400000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90500000000000003,"5min":1.0700000000000001,"15min":1.0940000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.41999999999999998},"max":{"1min":0.97399999999999998,"5min":1.089,"15min":1.089},"last":0.94399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575323,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37476,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334364,"statfs":{"total":96636764160,"available":96598388736,"internally_reserved":0,"allocated":2387968,"data_stored":1229359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.53500000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.98299999999999998,"5min":1.026,"15min":1.026},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.755,"15min":0.753},"min":{"1min":0.55600000000000005,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.012,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.57199999999999995}]},{"osd":1,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.59799999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.044,"5min":1.044,"15min":1.3300000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.746,"15min":0.746},"min":{"1min":0.57299999999999995,"5min":0.51900000000000002,"15min":0.47499999999999998},"max":{"1min":0.996,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.82199999999999995}]},{"osd":2,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78000000000000003,"15min":0.78900000000000003},"min":{"1min":0.58599999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0740000000000001,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77200000000000002,"15min":0.76400000000000001},"min":{"1min":0.61799999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96799999999999997,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.80400000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.77600000000000002,"15min":0.78100000000000003},"min":{"1min":0.59399999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.073,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76100000000000001,"15min":0.76700000000000002},"min":{"1min":0.56100000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.999,"5min":1.0249999999999999,"15min":1.2569999999999999},"last":0.68999999999999995}]},{"osd":4,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57699999999999996,"15min":0.56799999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.36099999999999999},"max":{"1min":0.78200000000000003,"5min":1.02,"15min":1.175},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.626,"15min":0.61099999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.36799999999999999},"max":{"1min":0.755,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.91700000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64700000000000002,"15min":0.63300000000000001},"min":{"1min":0.41899999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94499999999999995,"5min":1.0049999999999999,"15min":1.0860000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68500000000000005,"15min":0.67300000000000004},"min":{"1min":0.50900000000000001,"5min":0.46400000000000002,"15min":0.41699999999999998},"max":{"1min":0.878,"5min":1.0640000000000001,"15min":1.3180000000000001},"last":0.86199999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.64700000000000002,"15min":0.64300000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.42899999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":1.0269999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71599999999999997,"15min":0.70499999999999996},"min":{"1min":0.52600000000000002,"5min":0.49299999999999999,"15min":0.46200000000000002},"max":{"1min":0.92900000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.88700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575322,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55532,"kb_used_data":2340,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316308,"statfs":{"total":96636764160,"available":96579899392,"internally_reserved":0,"allocated":2396160,"data_stored":1229483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.753,"15min":0.74299999999999999},"min":{"1min":0.48199999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.0389999999999999,"5min":1.615,"15min":1.8},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76100000000000001,"15min":0.76000000000000001},"min":{"1min":0.623,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.97499999999999998,"5min":1.6899999999999999,"15min":1.8700000000000001},"last":0.64800000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.76100000000000001,"15min":0.752},"min":{"1min":0.53400000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.995,"5min":1.633,"15min":1.835},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77100000000000002,"15min":0.76700000000000002},"min":{"1min":0.60899999999999999,"5min":0.52300000000000002,"15min":0.499},"max":{"1min":0.94599999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.47999999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78200000000000003,"15min":0.80500000000000005},"min":{"1min":0.51400000000000001,"5min":0.45700000000000002,"15min":0.434},"max":{"1min":1.02,"5min":1.5960000000000001,"15min":16.774000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77500000000000002,"15min":0.80700000000000005},"min":{"1min":0.50800000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.98799999999999999,"5min":1.6779999999999999,"15min":16.751999999999999},"last":0.63500000000000001}]},{"osd":3,"last update":"Fri Jul 14 13:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.75700000000000001,"15min":0.76800000000000002},"min":{"1min":0.54000000000000004,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95499999999999996,"5min":1.0209999999999999,"15min":1.115},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.80500000000000005,"15min":0.83399999999999996},"min":{"1min":0.55400000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.006,"5min":1.6559999999999999,"15min":16.731000000000002},"last":0.58799999999999997}]},{"osd":4,"last update":"Fri Jul 14 13:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64300000000000002,"15min":0.63100000000000001},"min":{"1min":0.46000000000000002,"5min":0.40400000000000003,"15min":0.38},"max":{"1min":0.92500000000000004,"5min":0.94199999999999995,"15min":1.0089999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72699999999999998,"15min":0.71399999999999997},"min":{"1min":0.38300000000000001,"5min":0.378,"15min":0.375},"max":{"1min":0.92300000000000004,"5min":1.248,"15min":1.248},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Jul 14 13:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63800000000000001,"15min":0.625},"min":{"1min":0.438,"5min":0.42799999999999999,"15min":0.34999999999999998},"max":{"1min":0.85499999999999998,"5min":1.157,"15min":1.3100000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.66500000000000004,"15min":0.65100000000000002},"min":{"1min":0.49199999999999999,"5min":0.45400000000000001,"15min":0.42799999999999999},"max":{"1min":0.96899999999999997,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.69099999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.67100000000000004,"15min":0.65600000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.42399999999999999},"max":{"1min":0.79600000000000004,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.71899999999999997,"15min":0.69799999999999995},"min":{"1min":0.51200000000000001,"5min":0.433,"15min":0.40000000000000002},"max":{"1min":0.85499999999999998,"5min":1.091,"15min":1.091},"last":0.72599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575322,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37492,"kb_used_data":2348,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334348,"statfs":{"total":96636764160,"available":96598372352,"internally_reserved":0,"allocated":2404352,"data_stored":1230123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:31:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76700000000000002,"15min":0.76500000000000001},"min":{"1min":0.54600000000000004,"5min":0.50700000000000001,"15min":0.38100000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.877},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.755,"15min":0.75900000000000001},"min":{"1min":0.51300000000000001,"5min":0.45800000000000002,"15min":0.442},"max":{"1min":0.94699999999999995,"5min":0.98599999999999999,"15min":1.278},"last":0.76400000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:31:44 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.76400000000000001,"15min":0.77500000000000002},"min":{"1min":0.58599999999999997,"5min":0.51500000000000001,"15min":0.47199999999999998},"max":{"1min":0.97999999999999998,"5min":1.0369999999999999,"15min":1.306},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.75,"15min":0.745},"min":{"1min":0.623,"5min":0.51400000000000001,"15min":0.47599999999999998},"max":{"1min":0.995,"5min":1.024,"15min":1.177},"last":0.84399999999999997}]},{"osd":2,"last update":"Fri Jul 14 13:31:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76900000000000002,"15min":0.77200000000000002},"min":{"1min":0.60599999999999998,"5min":0.55100000000000005,"15min":0.49299999999999999},"max":{"1min":0.92600000000000005,"5min":0.95899999999999996,"15min":1.137},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.77000000000000002,"15min":0.77700000000000002},"min":{"1min":0.59399999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.89300000000000002,"5min":1,"15min":1},"last":0.86299999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:31:44 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.749,"15min":0.76500000000000001},"min":{"1min":0.58899999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.96899999999999997,"5min":1.0229999999999999,"15min":1.222},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78000000000000003,"15min":0.77900000000000003},"min":{"1min":0.56299999999999994,"5min":0.54400000000000004,"15min":0.496},"max":{"1min":0.98999999999999999,"5min":1.018,"15min":1.1970000000000001},"last":0.79100000000000004}]},{"osd":5,"last update":"Fri Jul 14 13:31:44 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60599999999999998,"15min":0.60299999999999998},"min":{"1min":0.42899999999999999,"5min":0.42199999999999999,"15min":0.40000000000000002},"max":{"1min":0.86699999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.378},"max":{"1min":0.80400000000000005,"5min":0.96099999999999997,"15min":0.96799999999999997},"last":0.60999999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:31:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.45200000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.875,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66500000000000004,"15min":0.66700000000000004},"min":{"1min":0.52000000000000002,"5min":0.47199999999999998,"15min":0.42699999999999999},"max":{"1min":1.04,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.69399999999999995}]},{"osd":7,"last update":"Fri Jul 14 13:31:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67000000000000004,"15min":0.67200000000000004},"min":{"1min":0.44400000000000001,"5min":0.436,"15min":0.435},"max":{"1min":0.84699999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68899999999999995,"15min":0.69699999999999995},"min":{"1min":0.501,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0569999999999999,"5min":1.127,"15min":1.127},"last":0.59499999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575322,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41592,"kb_used_data":2352,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330248,"statfs":{"total":96636764160,"available":96594173952,"internally_reserved":0,"allocated":2408448,"data_stored":1231527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:31:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.46700000000000003,"15min":0.46100000000000002},"min":{"1min":0.32100000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.67600000000000005,"5min":0.73799999999999999,"15min":0.92900000000000005},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.504,"15min":0.52100000000000002},"min":{"1min":0.36899999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.748,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.52800000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:31:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.496,"15min":0.48499999999999999},"min":{"1min":0.35499999999999998,"5min":0.34000000000000002,"15min":0.32300000000000001},"max":{"1min":0.69499999999999995,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55000000000000004,"15min":0.55800000000000005},"min":{"1min":0.45300000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72199999999999998,"5min":0.82199999999999995,"15min":0.85099999999999998},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:31:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56999999999999995,"15min":0.57799999999999996},"min":{"1min":0.44800000000000001,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.66200000000000003,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.61699999999999999},"min":{"1min":0.40100000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.81100000000000005,"5min":0.86099999999999999,"15min":0.88100000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:31:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.73799999999999999,"15min":0.77800000000000002},"min":{"1min":0.52700000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1.0680000000000001,"5min":1.0880000000000001,"15min":1.2529999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78400000000000003,"15min":0.79800000000000004},"min":{"1min":0.629,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.92000000000000004,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.70199999999999996}]},{"osd":5,"last update":"Fri Jul 14 13:31:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.78500000000000003,"15min":0.82099999999999995},"min":{"1min":0.58099999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0349999999999999,"5min":1.069,"15min":1.3959999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80300000000000005,"15min":0.81000000000000005},"min":{"1min":0.623,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.89900000000000002,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.66600000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:31:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.79500000000000004,"15min":0.80300000000000005},"min":{"1min":0.58699999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.93200000000000005,"5min":1.383,"15min":1.383},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.81000000000000005,"15min":0.83399999999999996},"min":{"1min":0.63600000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.98099999999999998,"5min":1.1439999999999999,"15min":1.3520000000000001},"last":0.74099999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:31:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.85299999999999998,"15min":0.85899999999999999},"min":{"1min":0.66100000000000003,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.95699999999999996,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81799999999999995,"15min":0.83699999999999997},"min":{"1min":0.56399999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.01,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.79800000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575322,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59616,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312224,"statfs":{"total":96636764160,"available":96575717376,"internally_reserved":0,"allocated":2383872,"data_stored":1228340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:31:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46500000000000002,"15min":0.46600000000000003},"min":{"1min":0.30399999999999999,"5min":0.29799999999999999,"15min":0.28599999999999998},"max":{"1min":0.624,"5min":0.75900000000000001,"15min":0.79800000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51300000000000001,"15min":0.52700000000000002},"min":{"1min":0.33700000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.79600000000000004,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.57199999999999995}]},{"osd":1,"last update":"Fri Jul 14 13:31:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47099999999999997,"15min":0.46899999999999997},"min":{"1min":0.35599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.64400000000000002,"5min":0.80600000000000005,"15min":0.84799999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.55900000000000005},"min":{"1min":0.45400000000000001,"5min":0.38900000000000001,"15min":0.38200000000000001},"max":{"1min":0.75700000000000001,"5min":0.82199999999999995,"15min":0.93799999999999994},"last":0.629}]},{"osd":3,"last update":"Fri Jul 14 13:31:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58499999999999996,"15min":0.58399999999999996},"min":{"1min":0.434,"5min":0.39700000000000002,"15min":0.38800000000000001},"max":{"1min":0.81999999999999995,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56000000000000005,"15min":0.55700000000000005},"min":{"1min":0.45200000000000001,"5min":0.38600000000000001,"15min":0.35999999999999999},"max":{"1min":0.72399999999999998,"5min":0.77300000000000002,"15min":0.81999999999999995},"last":0.59999999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:31:48 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.82099999999999995,"15min":0.80400000000000005},"min":{"1min":0.67500000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.68300000000000005,"5min":0.53600000000000003,"15min":0.48899999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.3029999999999999},"last":0.90500000000000003}]},{"osd":5,"last update":"Fri Jul 14 13:31:48 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.88700000000000001,"15min":0.86699999999999999},"min":{"1min":0.70099999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.85899999999999999,"15min":0.85499999999999998},"min":{"1min":0.73899999999999999,"5min":0.60699999999999998,"15min":0.54000000000000004},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.88700000000000001}]},{"osd":6,"last update":"Fri Jul 14 13:31:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.85599999999999998,"15min":0.83199999999999996},"min":{"1min":0.64800000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1859999999999999,"5min":1.2749999999999999,"15min":1.446},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82599999999999996,"15min":0.82399999999999995},"min":{"1min":0.68700000000000006,"5min":0.55100000000000005,"15min":0.53700000000000003},"max":{"1min":1.111,"5min":1.119,"15min":1.266},"last":0.77800000000000002}]},{"osd":7,"last update":"Fri Jul 14 13:31:48 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.875,"15min":0.84699999999999998},"min":{"1min":0.72199999999999998,"5min":0.56799999999999995,"15min":0.55900000000000005},"max":{"1min":1.145,"5min":2.306,"15min":2.306},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.873,"15min":0.85099999999999998},"min":{"1min":0.72599999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2649999999999999,"5min":1.351,"15min":1.371},"last":0.81699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575323,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41584,"kb_used_data":2344,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330256,"statfs":{"total":96636764160,"available":96594182144,"internally_reserved":0,"allocated":2400256,"data_stored":1230923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.46300000000000002},"min":{"1min":0.33200000000000002,"5min":0.316,"15min":0.28499999999999998},"max":{"1min":0.64400000000000002,"5min":0.76600000000000001,"15min":0.81599999999999995},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51300000000000001,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.32500000000000001,"15min":0.30199999999999999},"max":{"1min":0.80200000000000005,"5min":0.80300000000000005,"15min":0.81299999999999994},"last":0.47299999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.34699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69599999999999995,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.376},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54100000000000004,"15min":0.53600000000000003},"min":{"1min":0.42899999999999999,"5min":0.373,"15min":0.32800000000000001},"max":{"1min":0.71799999999999997,"5min":0.83399999999999996,"15min":0.89200000000000002},"last":0.44700000000000001}]},{"osd":3,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.52100000000000002,"5min":0.501,"15min":0.42299999999999999},"max":{"1min":0.747,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57299999999999995,"15min":0.58699999999999997},"min":{"1min":0.41199999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80800000000000005,"5min":0.86899999999999999,"15min":0.90300000000000002},"last":0.51500000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79800000000000004,"15min":0.80900000000000005},"min":{"1min":0.56699999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1519999999999999,"5min":1.155,"15min":1.2470000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81699999999999995,"15min":0.82499999999999996},"min":{"1min":0.61599999999999999,"5min":0.56100000000000005,"15min":0.497},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.71199999999999997}]},{"osd":5,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.81699999999999995,"15min":0.82199999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1850000000000001,"5min":1.224,"15min":1.224},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.82399999999999995,"15min":0.83199999999999996},"min":{"1min":0.62,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0920000000000001,"5min":1.2010000000000001,"15min":1.202},"last":0.92800000000000005}]},{"osd":6,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.82199999999999995,"15min":0.82899999999999996},"min":{"1min":0.623,"5min":0.60399999999999998,"15min":0.57799999999999996},"max":{"1min":1.0529999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.83499999999999996,"15min":0.85299999999999998},"min":{"1min":0.64800000000000002,"5min":0.60599999999999998,"15min":0.56399999999999995},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.73299999999999998}]},{"osd":7,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.81799999999999995},"min":{"1min":0.63500000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.129,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.875,"5min":0.877,"15min":0.877},"min":{"1min":0.65600000000000003,"5min":0.60499999999999998,"15min":0.58899999999999997},"max":{"1min":1.2569999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.89000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575324,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42156,"kb_used_data":2916,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329684,"statfs":{"total":96636764160,"available":96593596416,"internally_reserved":0,"allocated":2985984,"data_stored":1818812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.45900000000000002,"15min":0.47899999999999998},"min":{"1min":0.307,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70999999999999996,"5min":0.81499999999999995,"15min":0.85299999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52600000000000002,"15min":0.53000000000000003},"min":{"1min":0.38300000000000001,"5min":0.34100000000000003,"15min":0.308},"max":{"1min":0.71299999999999997,"5min":0.73999999999999999,"15min":0.80700000000000005},"last":0.33200000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52100000000000002,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.82099999999999995},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57099999999999995,"15min":0.57399999999999995},"min":{"1min":0.44800000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.79800000000000004,"5min":0.81200000000000006,"15min":0.91200000000000003},"last":0.39400000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.53200000000000003},"min":{"1min":0.35899999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.745,"5min":0.77000000000000002,"15min":0.80100000000000005},"last":0.435},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.435,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.374}]},{"osd":4,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.64900000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0329999999999999,"5min":1.157,"15min":1.284},"last":0.995},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.84199999999999997,"15min":0.83799999999999997},"min":{"1min":0.63500000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0820000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.93000000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.81299999999999994,"15min":0.83299999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.56699999999999995},"max":{"1min":1.1160000000000001,"5min":1.28,"15min":1.294},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85199999999999998,"15min":0.85299999999999998},"min":{"1min":0.69899999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0249999999999999,"5min":1.472,"15min":1.472},"last":1.0580000000000001}]},{"osd":6,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83499999999999996,"15min":0.84299999999999997},"min":{"1min":0.65700000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.236,"5min":1.639,"15min":1.639},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.85999999999999999,"15min":0.86299999999999999},"min":{"1min":0.64200000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.002,"5min":1.544,"15min":1.544},"last":0.95699999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86899999999999999,"15min":0.85799999999999998},"min":{"1min":0.621,"5min":0.621,"15min":0.55500000000000005},"max":{"1min":1.0640000000000001,"5min":1.236,"15min":1.3200000000000001},"last":1.026},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84899999999999998,"15min":0.85999999999999999},"min":{"1min":0.63100000000000001,"5min":0.57599999999999996,"15min":0.57499999999999996},"max":{"1min":1.202,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.88900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:32:35.748 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-14T13:32:35.749 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-14T13:32:35.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.932+0000 7f6aa98ca640 1 Processor -- start 2023-07-14T13:32:35.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.932+0000 7f6aa98ca640 1 -- start start 2023-07-14T13:32:35.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.932+0000 7f6aa98ca640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6aa40cb360 0x7f6aa415df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:35.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.932+0000 7f6aa98ca640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6aa40b38d0 0x7f6aa4070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:35.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.932+0000 7f6aa98ca640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aa40cc900 con 0x7f6aa40cd490 2023-07-14T13:32:35.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.932+0000 7f6aa98ca640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa40ccbe0 con 0x7f6aa40b38d0 2023-07-14T13:32:35.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.932+0000 7f6aa98ca640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa415d780 con 0x7f6aa40cb360 2023-07-14T13:32:35.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.932+0000 7f6a9bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6aa40b38d0 0x7f6aa4070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:35.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.932+0000 7f6a9bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6aa40b38d0 0x7f6aa4070920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39988/0 (socket says 172.21.15.5:39988) 2023-07-14T13:32:35.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.932+0000 7f6a9bfff640 1 -- 172.21.15.5:0/2591417407 learned_addr learned my addr 172.21.15.5:0/2591417407 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:35.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.936+0000 7f6a9bfff640 1 -- 172.21.15.5:0/2591417407 >> v2:172.21.15.154:3300/0 conn(0x7f6aa40cb360 msgr2=0x7f6aa415df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:35.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.936+0000 7f6a9bfff640 1 --2- 172.21.15.5:0/2591417407 >> v2:172.21.15.154:3300/0 conn(0x7f6aa40cb360 0x7f6aa415df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:35.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.936+0000 7f6a9bfff640 1 -- 172.21.15.5:0/2591417407 >> v1:172.21.15.154:6789/0 conn(0x7f6aa40cd490 legacy=0x7f6aa40c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:35.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.936+0000 7f6a9bfff640 1 -- 172.21.15.5:0/2591417407 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa415da60 con 0x7f6aa40b38d0 2023-07-14T13:32:35.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.936+0000 7f6a9bfff640 1 --2- 172.21.15.5:0/2591417407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aa40b38d0 0x7f6aa4070920 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f6aa406d690 tx=0x7f6a8c01cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22409a0ef5829a1f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:35.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.936+0000 7f6aa27fc640 1 -- 172.21.15.5:0/2591417407 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c0ac620 con 0x7f6aa40b38d0 2023-07-14T13:32:35.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.936+0000 7f6aa27fc640 1 -- 172.21.15.5:0/2591417407 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8c0ac780 con 0x7f6aa40b38d0 2023-07-14T13:32:35.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.936+0000 7f6aa27fc640 1 -- 172.21.15.5:0/2591417407 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c0acb10 con 0x7f6aa40b38d0 2023-07-14T13:32:35.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.936+0000 7f6aa98ca640 1 -- 172.21.15.5:0/2591417407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aa40b38d0 msgr2=0x7f6aa4070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:35.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.936+0000 7f6aa98ca640 1 --2- 172.21.15.5:0/2591417407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aa40b38d0 0x7f6aa4070920 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f6aa406d690 tx=0x7f6a8c01cdc0 comp rx=0 tx=0).stop 2023-07-14T13:32:35.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.940+0000 7f6aa98ca640 1 -- 172.21.15.5:0/2591417407 shutdown_connections 2023-07-14T13:32:35.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.940+0000 7f6aa98ca640 1 --2- 172.21.15.5:0/2591417407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aa40b38d0 0x7f6aa4070920 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:35.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.940+0000 7f6aa98ca640 1 --2- 172.21.15.5:0/2591417407 >> v2:172.21.15.154:3300/0 conn(0x7f6aa40cb360 0x7f6aa415df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:35.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.940+0000 7f6aa98ca640 1 -- 172.21.15.5:0/2591417407 >> 172.21.15.5:0/2591417407 conn(0x7f6aa40afac0 msgr2=0x7f6aa40afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:35.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.940+0000 7f6aa98ca640 1 -- 172.21.15.5:0/2591417407 shutdown_connections 2023-07-14T13:32:35.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.940+0000 7f6aa98ca640 1 -- 172.21.15.5:0/2591417407 wait complete. 2023-07-14T13:32:35.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.940+0000 7f6aa98ca640 1 Processor -- start 2023-07-14T13:32:35.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.940+0000 7f6aa98ca640 1 -- start start 2023-07-14T13:32:35.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.940+0000 7f6aa98ca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6aa40b38d0 0x7f6aa414b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:35.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.940+0000 7f6aa98ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6aa40cb360 0x7f6aa41543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:35.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.940+0000 7f6aa98ca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aa40cd490 0x7f6aa4154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:35.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.940+0000 7f6aa98ca640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa4152940 con 0x7f6aa40cd490 2023-07-14T13:32:35.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.940+0000 7f6aa98ca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa4152c20 con 0x7f6aa40b38d0 2023-07-14T13:32:35.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.940+0000 7f6aa98ca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa4152f00 con 0x7f6aa40cb360 2023-07-14T13:32:35.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.940+0000 7f6aa37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aa40cd490 0x7f6aa4154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:35.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.940+0000 7f6aa37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aa40cd490 0x7f6aa4154910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40004/0 (socket says 172.21.15.5:40004) 2023-07-14T13:32:35.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.940+0000 7f6aa37fe640 1 -- 172.21.15.5:0/667642445 learned_addr learned my addr 172.21.15.5:0/667642445 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:35.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.940+0000 7f6aa2ffd640 1 --2- 172.21.15.5:0/667642445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6aa40b38d0 0x7f6aa414b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:35.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.940+0000 7f6a9bfff640 1 --2- 172.21.15.5:0/667642445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6aa40cb360 0x7f6aa41543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:35.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.940+0000 7f6aa37fe640 1 -- 172.21.15.5:0/667642445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6aa40cb360 msgr2=0x7f6aa41543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:35.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.940+0000 7f6aa37fe640 1 --2- 172.21.15.5:0/667642445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6aa40cb360 0x7f6aa41543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:35.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.940+0000 7f6aa37fe640 1 -- 172.21.15.5:0/667642445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6aa40b38d0 msgr2=0x7f6aa414b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:35.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.940+0000 7f6aa37fe640 1 --2- 172.21.15.5:0/667642445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6aa40b38d0 0x7f6aa414b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:35.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.940+0000 7f6aa37fe640 1 -- 172.21.15.5:0/667642445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c0094d0 con 0x7f6aa40cd490 2023-07-14T13:32:35.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.944+0000 7f6aa37fe640 1 --2- 172.21.15.5:0/667642445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aa40cd490 0x7f6aa4154910 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c00c780 tx=0x7f6a9c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:35.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.944+0000 7f6aa0ff9640 1 -- 172.21.15.5:0/667642445 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c003d90 con 0x7f6aa40cd490 2023-07-14T13:32:35.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.944+0000 7f6aa0ff9640 1 -- 172.21.15.5:0/667642445 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9c00ce90 con 0x7f6aa40cd490 2023-07-14T13:32:35.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.944+0000 7f6aa98ca640 1 -- 172.21.15.5:0/667642445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa41531e0 con 0x7f6aa40cd490 2023-07-14T13:32:35.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.944+0000 7f6aa0ff9640 1 -- 172.21.15.5:0/667642445 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c0052b0 con 0x7f6aa40cd490 2023-07-14T13:32:35.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.944+0000 7f6aa98ca640 1 -- 172.21.15.5:0/667642445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa414bd10 con 0x7f6aa40cd490 2023-07-14T13:32:35.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.944+0000 7f6aa98ca640 1 -- 172.21.15.5:0/667642445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aa415d360 con 0x7f6aa40cd490 2023-07-14T13:32:35.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.944+0000 7f6aa0ff9640 1 -- 172.21.15.5:0/667642445 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6a9c005410 con 0x7f6aa40cd490 2023-07-14T13:32:35.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.944+0000 7f6aa0ff9640 1 --2- 172.21.15.5:0/667642445 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f6a840663a0 0x7f6a84068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:35.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.944+0000 7f6aa0ff9640 1 -- 172.21.15.5:0/667642445 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f6a9c083660 con 0x7f6aa40cd490 2023-07-14T13:32:35.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.944+0000 7f6aa2ffd640 1 --2- 172.21.15.5:0/667642445 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f6a840663a0 0x7f6a84068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:35.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.948+0000 7f6aa2ffd640 1 --2- 172.21.15.5:0/667642445 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f6a840663a0 0x7f6a84068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6a940098f0 tx=0x7f6a94006f90 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:35.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:35.948+0000 7f6aa0ff9640 1 -- 172.21.15.5:0/667642445 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6a9c050a50 con 0x7f6aa40cd490 2023-07-14T13:32:36.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.160+0000 7f6aa98ca640 1 -- 172.21.15.5:0/667642445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6aa4152a80 con 0x7f6aa40cd490 2023-07-14T13:32:36.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.168+0000 7f6aa0ff9640 1 -- 172.21.15.5:0/667642445 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v31) v1 ==== 190+0+147 (secure 0 0 0) 0x7f6aa4152a80 con 0x7f6aa40cd490 2023-07-14T13:32:36.168 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-07-14T13:32:36.168 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDkRLFkCav/DhAA6SOiONAbTcWCnUZXcm7BcQ== 2023-07-14T13:32:36.168 INFO:teuthology.orchestra.run.smithi005.stdout: caps mds = "allow" 2023-07-14T13:32:36.168 INFO:teuthology.orchestra.run.smithi005.stdout: caps mon = "allow r" 2023-07-14T13:32:36.168 INFO:teuthology.orchestra.run.smithi005.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-14T13:32:36.168 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2023-07-14T13:32:36.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.168+0000 7f6aa98ca640 1 -- 172.21.15.5:0/667642445 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f6a840663a0 msgr2=0x7f6a84068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:36.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.168+0000 7f6aa98ca640 1 --2- 172.21.15.5:0/667642445 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f6a840663a0 0x7f6a84068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6a940098f0 tx=0x7f6a94006f90 comp rx=0 tx=0).stop 2023-07-14T13:32:36.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.168+0000 7f6aa98ca640 1 -- 172.21.15.5:0/667642445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aa40cd490 msgr2=0x7f6aa4154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:36.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.168+0000 7f6aa98ca640 1 --2- 172.21.15.5:0/667642445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aa40cd490 0x7f6aa4154910 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c00c780 tx=0x7f6a9c00cc40 comp rx=0 tx=0).stop 2023-07-14T13:32:36.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.168+0000 7f6aa98ca640 1 -- 172.21.15.5:0/667642445 shutdown_connections 2023-07-14T13:32:36.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.168+0000 7f6aa98ca640 1 --2- 172.21.15.5:0/667642445 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f6a840663a0 0x7f6a84068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:36.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.168+0000 7f6aa98ca640 1 --2- 172.21.15.5:0/667642445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aa40cd490 0x7f6aa4154910 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:36.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.168+0000 7f6aa98ca640 1 --2- 172.21.15.5:0/667642445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6aa40cb360 0x7f6aa41543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:36.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.168+0000 7f6aa98ca640 1 --2- 172.21.15.5:0/667642445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6aa40b38d0 0x7f6aa414b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:36.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.168+0000 7f6aa98ca640 1 -- 172.21.15.5:0/667642445 >> 172.21.15.5:0/667642445 conn(0x7f6aa40afac0 msgr2=0x7f6aa4155e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:36.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.168+0000 7f6aa98ca640 1 -- 172.21.15.5:0/667642445 shutdown_connections 2023-07-14T13:32:36.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.168+0000 7f6aa98ca640 1 -- 172.21.15.5:0/667642445 wait complete. 2023-07-14T13:32:36.189 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:32:36.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.332+0000 7f3d1e4ca640 1 Processor -- start 2023-07-14T13:32:36.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.332+0000 7f3d1e4ca640 1 -- start start 2023-07-14T13:32:36.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.336+0000 7f3d1e4ca640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3d18160330 0x7f3d180cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:36.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.336+0000 7f3d1e4ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d180c0f80 0x7f3d180cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:36.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.336+0000 7f3d1e4ca640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d180c17d0 con 0x7f3d180c8940 2023-07-14T13:32:36.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.336+0000 7f3d1e4ca640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d180c14f0 con 0x7f3d18160330 2023-07-14T13:32:36.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.336+0000 7f3d1e4ca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d180cac10 con 0x7f3d180c0f80 2023-07-14T13:32:36.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.336+0000 7f3d1ca67640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d180c0f80 0x7f3d180cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:36.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.336+0000 7f3d177fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3d180c8940 0x7f3d180ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:59970/0 (socket says 172.21.15.5:59970) 2023-07-14T13:32:36.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.336+0000 7f3d177fe640 1 -- 172.21.15.5:0/167887626 learned_addr learned my addr 172.21.15.5:0/167887626 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:36.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.336+0000 7f3d1ca67640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d180c0f80 0x7f3d180cd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:48656/0 (socket says 172.21.15.5:48656) 2023-07-14T13:32:36.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.336+0000 7f3d17fff640 1 --2- 172.21.15.5:0/167887626 >> v2:172.21.15.154:3300/0 conn(0x7f3d18160330 0x7f3d180cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:36.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.336+0000 7f3d16ffd640 1 -- 172.21.15.5:0/167887626 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156514391 0 0) 0x7f3d180c17d0 con 0x7f3d180c8940 2023-07-14T13:32:36.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.336+0000 7f3d1ca67640 1 -- 172.21.15.5:0/167887626 >> v2:172.21.15.154:3300/0 conn(0x7f3d18160330 msgr2=0x7f3d180cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:36.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.336+0000 7f3d1ca67640 1 --2- 172.21.15.5:0/167887626 >> v2:172.21.15.154:3300/0 conn(0x7f3d18160330 0x7f3d180cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:36.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.336+0000 7f3d1ca67640 1 -- 172.21.15.5:0/167887626 >> v1:172.21.15.154:6789/0 conn(0x7f3d180c8940 legacy=0x7f3d180ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:36.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.336+0000 7f3d1ca67640 1 -- 172.21.15.5:0/167887626 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d180caef0 con 0x7f3d180c0f80 2023-07-14T13:32:36.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.340+0000 7f3d1ca67640 1 --2- 172.21.15.5:0/167887626 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d180c0f80 0x7f3d180cd660 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009d90 tx=0x7f3d1001f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa571291cbae8e79 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:36.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.340+0000 7f3d16ffd640 1 -- 172.21.15.5:0/167887626 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d100af600 con 0x7f3d180c0f80 2023-07-14T13:32:36.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.340+0000 7f3d16ffd640 1 -- 172.21.15.5:0/167887626 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d100ab050 con 0x7f3d180c0f80 2023-07-14T13:32:36.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.340+0000 7f3d16ffd640 1 -- 172.21.15.5:0/167887626 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d100af980 con 0x7f3d180c0f80 2023-07-14T13:32:36.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.340+0000 7f3d1e4ca640 1 -- 172.21.15.5:0/167887626 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d180c0f80 msgr2=0x7f3d180cd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:36.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.340+0000 7f3d1e4ca640 1 --2- 172.21.15.5:0/167887626 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d180c0f80 0x7f3d180cd660 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009d90 tx=0x7f3d1001f130 comp rx=0 tx=0).stop 2023-07-14T13:32:36.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.340+0000 7f3d1e4ca640 1 -- 172.21.15.5:0/167887626 shutdown_connections 2023-07-14T13:32:36.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.340+0000 7f3d1e4ca640 1 --2- 172.21.15.5:0/167887626 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d180c0f80 0x7f3d180cd660 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:36.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.340+0000 7f3d1e4ca640 1 --2- 172.21.15.5:0/167887626 >> v2:172.21.15.154:3300/0 conn(0x7f3d18160330 0x7f3d180cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:36.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.340+0000 7f3d1e4ca640 1 -- 172.21.15.5:0/167887626 >> 172.21.15.5:0/167887626 conn(0x7f3d180afcf0 msgr2=0x7f3d180b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:36.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.340+0000 7f3d1e4ca640 1 -- 172.21.15.5:0/167887626 shutdown_connections 2023-07-14T13:32:36.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.340+0000 7f3d1e4ca640 1 -- 172.21.15.5:0/167887626 wait complete. 2023-07-14T13:32:36.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.340+0000 7f3d1e4ca640 1 Processor -- start 2023-07-14T13:32:36.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.340+0000 7f3d1e4ca640 1 -- start start 2023-07-14T13:32:36.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.344+0000 7f3d1e4ca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d180c0f80 0x7f3d180c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:36.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.344+0000 7f3d1e4ca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d180c8940 0x7f3d180aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:36.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.344+0000 7f3d1e4ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d18160330 0x7f3d180b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:36.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.344+0000 7f3d1e4ca640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d180b2840 con 0x7f3d180c0f80 2023-07-14T13:32:36.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.344+0000 7f3d1e4ca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d180c38b0 con 0x7f3d180c8940 2023-07-14T13:32:36.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.344+0000 7f3d1e4ca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d180b2560 con 0x7f3d18160330 2023-07-14T13:32:36.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.344+0000 7f3d17fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d180c0f80 0x7f3d180c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:36.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.344+0000 7f3d17fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d180c0f80 0x7f3d180c5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40014/0 (socket says 172.21.15.5:40014) 2023-07-14T13:32:36.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.344+0000 7f3d17fff640 1 -- 172.21.15.5:0/4205336970 learned_addr learned my addr 172.21.15.5:0/4205336970 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:36.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.344+0000 7f3d1ca67640 1 --2- 172.21.15.5:0/4205336970 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d18160330 0x7f3d180b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:36.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.344+0000 7f3d177fe640 1 --2- 172.21.15.5:0/4205336970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d180c8940 0x7f3d180aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:36.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.344+0000 7f3d17fff640 1 -- 172.21.15.5:0/4205336970 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d18160330 msgr2=0x7f3d180b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:36.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.344+0000 7f3d17fff640 1 --2- 172.21.15.5:0/4205336970 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d18160330 0x7f3d180b1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:36.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.344+0000 7f3d17fff640 1 -- 172.21.15.5:0/4205336970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d180c8940 msgr2=0x7f3d180aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:36.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.344+0000 7f3d17fff640 1 --2- 172.21.15.5:0/4205336970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d180c8940 0x7f3d180aefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:36.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.344+0000 7f3d17fff640 1 -- 172.21.15.5:0/4205336970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d10009a70 con 0x7f3d180c0f80 2023-07-14T13:32:36.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.344+0000 7f3d17fff640 1 --2- 172.21.15.5:0/4205336970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d180c0f80 0x7f3d180c5230 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f3d0800e870 tx=0x7f3d0800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:36.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.344+0000 7f3d14ff9640 1 -- 172.21.15.5:0/4205336970 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d08009510 con 0x7f3d180c0f80 2023-07-14T13:32:36.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.344+0000 7f3d14ff9640 1 -- 172.21.15.5:0/4205336970 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0800eec0 con 0x7f3d180c0f80 2023-07-14T13:32:36.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.344+0000 7f3d1e4ca640 1 -- 172.21.15.5:0/4205336970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d180c31f0 con 0x7f3d180c0f80 2023-07-14T13:32:36.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.344+0000 7f3d14ff9640 1 -- 172.21.15.5:0/4205336970 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0800cb40 con 0x7f3d180c0f80 2023-07-14T13:32:36.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.344+0000 7f3d1e4ca640 1 -- 172.21.15.5:0/4205336970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d180c2a80 con 0x7f3d180c0f80 2023-07-14T13:32:36.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.344+0000 7f3d1e4ca640 1 -- 172.21.15.5:0/4205336970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d18072d90 con 0x7f3d180c0f80 2023-07-14T13:32:36.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.348+0000 7f3d14ff9640 1 -- 172.21.15.5:0/4205336970 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3d0800cca0 con 0x7f3d180c0f80 2023-07-14T13:32:36.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.348+0000 7f3d14ff9640 1 --2- 172.21.15.5:0/4205336970 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f3d040663a0 0x7f3d04068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:36.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.348+0000 7f3d14ff9640 1 -- 172.21.15.5:0/4205336970 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f3d08083eb0 con 0x7f3d180c0f80 2023-07-14T13:32:36.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.348+0000 7f3d177fe640 1 --2- 172.21.15.5:0/4205336970 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f3d040663a0 0x7f3d04068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:36.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.348+0000 7f3d177fe640 1 --2- 172.21.15.5:0/4205336970 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f3d040663a0 0x7f3d04068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3d18070a20 tx=0x7f3d0c009040 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:36.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.352+0000 7f3d14ff9640 1 -- 172.21.15.5:0/4205336970 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3d08051340 con 0x7f3d180c0f80 2023-07-14T13:32:36.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.536+0000 7f3d1e4ca640 1 -- 172.21.15.5:0/4205336970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d180c3050 con 0x7f3d180c0f80 2023-07-14T13:32:36.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.540+0000 7f3d14ff9640 1 -- 172.21.15.5:0/4205336970 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4714 (secure 0 0 0) 0x7f3d180c3050 con 0x7f3d180c0f80 2023-07-14T13:32:36.540 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:36.541 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8669,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3337947661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3337947661},{"type":"v1","addr":"172.21.15.154:6835","nonce":3337947661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8675,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/695363750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":695363750},{"type":"v1","addr":"172.21.15.154:6837","nonce":695363750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":10542,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1412864639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1412864639},{"type":"v1","addr":"172.21.15.5:6833","nonce":1412864639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:32:30.624611+0000","modified":"2023-07-14T13:32:34.244769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10545":{"gid":10545,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6835/1752765831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1752765831},{"type":"v1","addr":"172.21.15.5:6835","nonce":1752765831}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-14T13:32:36.542 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 92 2023-07-14T13:32:36.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.540+0000 7f3d1e4ca640 1 -- 172.21.15.5:0/4205336970 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f3d040663a0 msgr2=0x7f3d04068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:36.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.540+0000 7f3d1e4ca640 1 --2- 172.21.15.5:0/4205336970 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f3d040663a0 0x7f3d04068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3d18070a20 tx=0x7f3d0c009040 comp rx=0 tx=0).stop 2023-07-14T13:32:36.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.540+0000 7f3d1e4ca640 1 -- 172.21.15.5:0/4205336970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d180c0f80 msgr2=0x7f3d180c5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:36.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.540+0000 7f3d1e4ca640 1 --2- 172.21.15.5:0/4205336970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d180c0f80 0x7f3d180c5230 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f3d0800e870 tx=0x7f3d0800ec70 comp rx=0 tx=0).stop 2023-07-14T13:32:36.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.540+0000 7f3d1e4ca640 1 -- 172.21.15.5:0/4205336970 shutdown_connections 2023-07-14T13:32:36.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.540+0000 7f3d1e4ca640 1 --2- 172.21.15.5:0/4205336970 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f3d040663a0 0x7f3d04068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:36.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.540+0000 7f3d1e4ca640 1 --2- 172.21.15.5:0/4205336970 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d18160330 0x7f3d180b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:36.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.540+0000 7f3d1e4ca640 1 --2- 172.21.15.5:0/4205336970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d180c8940 0x7f3d180aefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:36.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.540+0000 7f3d1e4ca640 1 --2- 172.21.15.5:0/4205336970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d180c0f80 0x7f3d180c5230 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:36.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.540+0000 7f3d1e4ca640 1 -- 172.21.15.5:0/4205336970 >> 172.21.15.5:0/4205336970 conn(0x7f3d180afcf0 msgr2=0x7f3d180cbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:36.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.540+0000 7f3d1e4ca640 1 -- 172.21.15.5:0/4205336970 shutdown_connections 2023-07-14T13:32:36.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:36.540+0000 7f3d1e4ca640 1 -- 172.21.15.5:0/4205336970 wait complete. 2023-07-14T13:32:36.963 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 92, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-14T13:32:30.624611+0000', 'modified': '2023-07-14T13:32:34.244769+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10545}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10545': {'gid': 10545, 'name': 'c', 'rank': 0, 'incarnation': 88, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.5:6835/1752765831', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6834', 'nonce': 1752765831}, {'type': 'v1', 'addr': '172.21.15.5:6835', 'nonce': 1752765831}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-14T13:32:36.963 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-14T13:32:36.964 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-14T13:32:37.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.108+0000 7ff4f867b640 1 Processor -- start 2023-07-14T13:32:37.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.108+0000 7ff4f867b640 1 -- start start 2023-07-14T13:32:37.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.112+0000 7ff4f867b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff4f00cb780 0x7ff4f00cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:37.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.112+0000 7ff4f867b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f006f900 con 0x7ff4f006b8f0 2023-07-14T13:32:37.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.112+0000 7ff4f867b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f015bb90 con 0x7ff4f015b7c0 2023-07-14T13:32:37.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.112+0000 7ff4f867b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f00cdce0 con 0x7ff4f00cb780 2023-07-14T13:32:37.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.112+0000 7ff4f6c18640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff4f006b8f0 0x7ff4f00cc270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57636/0 (socket says 172.21.15.5:57636) 2023-07-14T13:32:37.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.112+0000 7ff4f6c18640 1 -- 172.21.15.5:0/2244976338 learned_addr learned my addr 172.21.15.5:0/2244976338 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:37.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.112+0000 7ff4f5c16640 1 --2- 172.21.15.5:0/2244976338 >> v2:172.21.15.154:3300/0 conn(0x7ff4f00cb780 0x7ff4f00cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:37.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.112+0000 7ff4f5415640 1 -- 172.21.15.5:0/2244976338 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4181522380 0 0) 0x7ff4f006f900 con 0x7ff4f006b8f0 2023-07-14T13:32:37.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.112+0000 7ff4f5415640 1 -- 172.21.15.5:0/2244976338 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4dc003530 con 0x7ff4f006b8f0 2023-07-14T13:32:37.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.112+0000 7ff4f5415640 1 -- 172.21.15.5:0/2244976338 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3752820608 0 0) 0x7ff4f015bb90 con 0x7ff4f015b7c0 2023-07-14T13:32:37.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.112+0000 7ff4f5415640 1 -- 172.21.15.5:0/2244976338 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4f006f900 con 0x7ff4f015b7c0 2023-07-14T13:32:37.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.112+0000 7ff4f5c16640 1 -- 172.21.15.5:0/2244976338 >> v1:172.21.15.154:6789/0 conn(0x7ff4f015b7c0 legacy=0x7ff4f006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:37.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.112+0000 7ff4f5c16640 1 -- 172.21.15.5:0/2244976338 >> v1:172.21.15.5:6789/0 conn(0x7ff4f006b8f0 legacy=0x7ff4f00cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:37.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.112+0000 7ff4f5c16640 1 -- 172.21.15.5:0/2244976338 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f00cd720 con 0x7ff4f00cb780 2023-07-14T13:32:37.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.116+0000 7ff4f5c16640 1 --2- 172.21.15.5:0/2244976338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4f00cb780 0x7ff4f00cbd30 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00097c0 tx=0x7ff4e001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7d51d34718fbc8e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:37.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.116+0000 7ff4f5415640 1 -- 172.21.15.5:0/2244976338 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e00ab600 con 0x7ff4f00cb780 2023-07-14T13:32:37.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.116+0000 7ff4f5415640 1 -- 172.21.15.5:0/2244976338 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e00a7050 con 0x7ff4f00cb780 2023-07-14T13:32:37.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.116+0000 7ff4f5415640 1 -- 172.21.15.5:0/2244976338 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e00ab980 con 0x7ff4f00cb780 2023-07-14T13:32:37.117 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.116+0000 7ff4f867b640 1 -- 172.21.15.5:0/2244976338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4f00cb780 msgr2=0x7ff4f00cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:37.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.116+0000 7ff4f867b640 1 --2- 172.21.15.5:0/2244976338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4f00cb780 0x7ff4f00cbd30 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00097c0 tx=0x7ff4e001c480 comp rx=0 tx=0).stop 2023-07-14T13:32:37.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.116+0000 7ff4f867b640 1 -- 172.21.15.5:0/2244976338 shutdown_connections 2023-07-14T13:32:37.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.116+0000 7ff4f867b640 1 --2- 172.21.15.5:0/2244976338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4f00cb780 0x7ff4f00cbd30 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.116+0000 7ff4f867b640 1 -- 172.21.15.5:0/2244976338 >> 172.21.15.5:0/2244976338 conn(0x7ff4f00afcf0 msgr2=0x7ff4f00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:37.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.116+0000 7ff4f867b640 1 -- 172.21.15.5:0/2244976338 shutdown_connections 2023-07-14T13:32:37.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.116+0000 7ff4f867b640 1 -- 172.21.15.5:0/2244976338 wait complete. 2023-07-14T13:32:37.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.116+0000 7ff4f867b640 1 Processor -- start 2023-07-14T13:32:37.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.116+0000 7ff4f867b640 1 -- start start 2023-07-14T13:32:37.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.120+0000 7ff4f867b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4f006b8f0 0x7ff4f0143310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:37.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.120+0000 7ff4f867b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4f015b7c0 0x7ff4f00c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:37.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.120+0000 7ff4f867b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4f0157200 0x7ff4f00adc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:37.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.120+0000 7ff4f867b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00c22c0 con 0x7ff4f0157200 2023-07-14T13:32:37.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.120+0000 7ff4f867b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00c1c90 con 0x7ff4f006b8f0 2023-07-14T13:32:37.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.120+0000 7ff4f867b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00c6e70 con 0x7ff4f015b7c0 2023-07-14T13:32:37.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.120+0000 7ff4f6c18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4f0157200 0x7ff4f00adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:37.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.120+0000 7ff4f6c18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4f0157200 0x7ff4f00adc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40030/0 (socket says 172.21.15.5:40030) 2023-07-14T13:32:37.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.120+0000 7ff4f6c18640 1 -- 172.21.15.5:0/3125329228 learned_addr learned my addr 172.21.15.5:0/3125329228 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:37.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.120+0000 7ff4f6417640 1 --2- 172.21.15.5:0/3125329228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4f006b8f0 0x7ff4f0143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:37.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.120+0000 7ff4f5c16640 1 --2- 172.21.15.5:0/3125329228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4f015b7c0 0x7ff4f00c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:37.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.120+0000 7ff4f6c18640 1 -- 172.21.15.5:0/3125329228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4f015b7c0 msgr2=0x7ff4f00c63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:37.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.120+0000 7ff4f6c18640 1 --2- 172.21.15.5:0/3125329228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4f015b7c0 0x7ff4f00c63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.120+0000 7ff4f6c18640 1 -- 172.21.15.5:0/3125329228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4f006b8f0 msgr2=0x7ff4f0143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:37.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.120+0000 7ff4f6c18640 1 --2- 172.21.15.5:0/3125329228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4f006b8f0 0x7ff4f0143310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.120+0000 7ff4f6c18640 1 -- 172.21.15.5:0/3125329228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e0009420 con 0x7ff4f0157200 2023-07-14T13:32:37.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.120+0000 7ff4f6c18640 1 --2- 172.21.15.5:0/3125329228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4f0157200 0x7ff4f00adc60 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800cba0 tx=0x7ff4e800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:37.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.120+0000 7ff4e6ffd640 1 -- 172.21.15.5:0/3125329228 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e800ace0 con 0x7ff4f0157200 2023-07-14T13:32:37.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.120+0000 7ff4e6ffd640 1 -- 172.21.15.5:0/3125329228 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e800ae40 con 0x7ff4f0157200 2023-07-14T13:32:37.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.120+0000 7ff4e6ffd640 1 -- 172.21.15.5:0/3125329228 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8012620 con 0x7ff4f0157200 2023-07-14T13:32:37.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.120+0000 7ff4f867b640 1 -- 172.21.15.5:0/3125329228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f00c7150 con 0x7ff4f0157200 2023-07-14T13:32:37.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.120+0000 7ff4f867b640 1 -- 172.21.15.5:0/3125329228 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f00c7e90 con 0x7ff4f0157200 2023-07-14T13:32:37.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.124+0000 7ff4e6ffd640 1 -- 172.21.15.5:0/3125329228 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff4e8007070 con 0x7ff4f0157200 2023-07-14T13:32:37.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.124+0000 7ff4e6ffd640 1 --2- 172.21.15.5:0/3125329228 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7ff4d40663a0 0x7ff4d4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:37.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.124+0000 7ff4e6ffd640 1 -- 172.21.15.5:0/3125329228 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6090+0+0 (secure 0 0 0) 0x7ff4e8083e70 con 0x7ff4f0157200 2023-07-14T13:32:37.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.124+0000 7ff4f6417640 1 --2- 172.21.15.5:0/3125329228 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7ff4d40663a0 0x7ff4d4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:37.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.124+0000 7ff4fb9c7000 1 Processor -- start 2023-07-14T13:32:37.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.124+0000 7ff4fb9c7000 1 -- start start 2023-07-14T13:32:37.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.124+0000 7ff4f6417640 1 --2- 172.21.15.5:0/3125329228 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7ff4d40663a0 0x7ff4d4068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec001720 tx=0x7ff4ec009040 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:37.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.124+0000 7ff4fb9c7000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebbad1c3e0 0x55ebbad1c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:37.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.124+0000 7ff4fb9c7000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbad1ccf0 0x55ebbacd2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:37.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.124+0000 7ff4fb9c7000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ebbacd2d40 0x55ebbacd3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:37.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.124+0000 7ff4fb9c7000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebbab95900 con 0x55ebbad1ccf0 2023-07-14T13:32:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.124+0000 7ff4fb9c7000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebbaacf8c0 con 0x55ebbad1c3e0 2023-07-14T13:32:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.124+0000 7ff4fb9c7000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ebbab23360 con 0x55ebbacd2d40 2023-07-14T13:32:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.124+0000 7ff4f5c16640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbad1ccf0 0x55ebbacd2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.124+0000 7ff4f5c16640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbad1ccf0 0x55ebbacd2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40040/0 (socket says 172.21.15.5:40040) 2023-07-14T13:32:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.124+0000 7ff4f5c16640 1 -- 172.21.15.5:0/2103753767 learned_addr learned my addr 172.21.15.5:0/2103753767 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.124+0000 7ff4f6417640 1 --2- 172.21.15.5:0/2103753767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebbad1c3e0 0x55ebbad1c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.124+0000 7ff4f6c18640 1 --2- 172.21.15.5:0/2103753767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ebbacd2d40 0x55ebbacd3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:37.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.124+0000 7ff4f5c16640 1 -- 172.21.15.5:0/2103753767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ebbacd2d40 msgr2=0x55ebbacd3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.124+0000 7ff4f5c16640 1 --2- 172.21.15.5:0/2103753767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ebbacd2d40 0x55ebbacd3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.124+0000 7ff4f5c16640 1 -- 172.21.15.5:0/2103753767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebbad1c3e0 msgr2=0x55ebbad1c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.124+0000 7ff4f5c16640 1 --2- 172.21.15.5:0/2103753767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebbad1c3e0 0x55ebbad1c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.124+0000 7ff4f5c16640 1 -- 172.21.15.5:0/2103753767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ebba818890 con 0x55ebbad1ccf0 2023-07-14T13:32:37.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.128+0000 7ff4f5c16640 1 --2- 172.21.15.5:0/2103753767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbad1ccf0 0x55ebbacd2800 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7ff4e001a0b0 tx=0x7ff4e0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fcf93606a6ef4d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:37.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.128+0000 7ff4d3fff640 1 -- 172.21.15.5:0/2103753767 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e00ab7c0 con 0x55ebbad1ccf0 2023-07-14T13:32:37.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.128+0000 7ff4d3fff640 1 -- 172.21.15.5:0/2103753767 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e00ab940 con 0x55ebbad1ccf0 2023-07-14T13:32:37.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.128+0000 7ff4d3fff640 1 -- 172.21.15.5:0/2103753767 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e00abcb0 con 0x55ebbad1ccf0 2023-07-14T13:32:37.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.128+0000 7ff4fb9c7000 1 -- 172.21.15.5:0/2103753767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbad1ccf0 msgr2=0x55ebbacd2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:37.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.128+0000 7ff4fb9c7000 1 --2- 172.21.15.5:0/2103753767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbad1ccf0 0x55ebbacd2800 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7ff4e001a0b0 tx=0x7ff4e0004740 comp rx=0 tx=0).stop 2023-07-14T13:32:37.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.128+0000 7ff4fb9c7000 1 -- 172.21.15.5:0/2103753767 shutdown_connections 2023-07-14T13:32:37.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.128+0000 7ff4fb9c7000 1 --2- 172.21.15.5:0/2103753767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ebbacd2d40 0x55ebbacd3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.128+0000 7ff4fb9c7000 1 --2- 172.21.15.5:0/2103753767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbad1ccf0 0x55ebbacd2800 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.128+0000 7ff4fb9c7000 1 --2- 172.21.15.5:0/2103753767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebbad1c3e0 0x55ebbad1c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.128+0000 7ff4fb9c7000 1 -- 172.21.15.5:0/2103753767 >> 172.21.15.5:0/2103753767 conn(0x55ebbacd4e60 msgr2=0x55ebbacd10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:37.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.128+0000 7ff4fb9c7000 1 -- 172.21.15.5:0/2103753767 shutdown_connections 2023-07-14T13:32:37.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.128+0000 7ff4fb9c7000 1 -- 172.21.15.5:0/2103753767 wait complete. 2023-07-14T13:32:37.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.128+0000 7ff4fb9c7000 1 -- start start 2023-07-14T13:32:37.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.128+0000 7ff4fb9c7000 1 Processor -- start 2023-07-14T13:32:37.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.128+0000 7ff4fb9c7000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ebbacd2d40 0x55ebbad09bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:37.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.128+0000 7ff4fb9c7000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebbad1c3e0 0x55ebbad0a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:37.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.128+0000 7ff4fb9c7000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbad1ccf0 0x55ebbad0a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:37.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.128+0000 7ff4fb9c7000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebbab1c400 con 0x55ebbad1ccf0 2023-07-14T13:32:37.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.128+0000 7ff4fb9c7000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebbaad8b60 con 0x55ebbad1c3e0 2023-07-14T13:32:37.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.128+0000 7ff4fb9c7000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ebbaad8800 con 0x55ebbacd2d40 2023-07-14T13:32:37.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.128+0000 7ff4fb9c7000 10 client.0 _ll_register_callbacks cb 0x55ebbacba2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:32:37.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.128+0000 7ff4f6c18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbad1ccf0 0x55ebbad0a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:37.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.128+0000 7ff4f6c18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbad1ccf0 0x55ebbad0a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40046/0 (socket says 172.21.15.5:40046) 2023-07-14T13:32:37.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.128+0000 7ff4f6c18640 1 -- 172.21.15.5:0/3578210049 learned_addr learned my addr 172.21.15.5:0/3578210049 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:37.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.128+0000 7ff4f6417640 1 --2- 172.21.15.5:0/3578210049 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ebbacd2d40 0x55ebbad09bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:37.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.128+0000 7ff4f5c16640 1 --2- 172.21.15.5:0/3578210049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebbad1c3e0 0x55ebbad0a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4f6c18640 1 -- 172.21.15.5:0/3578210049 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ebbacd2d40 msgr2=0x55ebbad09bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:37.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4f6c18640 1 --2- 172.21.15.5:0/3578210049 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ebbacd2d40 0x55ebbad09bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4f6c18640 1 -- 172.21.15.5:0/3578210049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebbad1c3e0 msgr2=0x55ebbad0a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4f6c18640 1 --2- 172.21.15.5:0/3578210049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebbad1c3e0 0x55ebbad0a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4f6c18640 1 -- 172.21.15.5:0/3578210049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f00cd720 con 0x55ebbad1ccf0 2023-07-14T13:32:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4f6c18640 1 --2- 172.21.15.5:0/3578210049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbad1ccf0 0x55ebbad0a630 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8054c20 tx=0x7ff4e80516f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7370c04410fc1e50 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-07-14T13:32:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4d17fa640 1 -- 172.21.15.5:0/3578210049 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e805d000 con 0x55ebbad1ccf0 2023-07-14T13:32:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4fb9c7000 1 -- 172.21.15.5:0/3578210049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ebbaae3aa0 con 0x55ebbad1ccf0 2023-07-14T13:32:37.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4d17fa640 1 -- 172.21.15.5:0/3578210049 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(191..191 src has 1..191) v4 ==== 6090+0+0 (secure 0 0 0) 0x7ff4e8004d70 con 0x55ebbad1ccf0 2023-07-14T13:32:37.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4d17fa640 1 -- 172.21.15.5:0/3578210049 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4e8050d10 con 0x55ebbad1ccf0 2023-07-14T13:32:37.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4fb9c7000 10 client.10683 fetch_fsmap learned FSMap version 92 2023-07-14T13:32:37.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4fb9c7000 1 -- 172.21.15.5:0/3578210049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x55ebbaae0d90 con 0x55ebbad1ccf0 2023-07-14T13:32:37.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4d17fa640 1 -- 172.21.15.5:0/3578210049 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ebbaae3aa0 con 0x55ebbad1ccf0 2023-07-14T13:32:37.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4d17fa640 1 -- 172.21.15.5:0/3578210049 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 92) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff4e8050e70 con 0x55ebbad1ccf0 2023-07-14T13:32:37.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4fb9c7000 10 client.10683 fetch_fsmap finished waiting for FSMap version 92 2023-07-14T13:32:37.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4fb9c7000 10 client.10683 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T13:32:37.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4fb9c7000 20 client.10683 populate_metadata read hostname 'smithi005' 2023-07-14T13:32:37.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4fb9c7000 1 --2- 172.21.15.5:0/3578210049 >> [v2:172.21.15.5:6834/1752765831,v1:172.21.15.5:6835/1752765831] conn(0x55ebbad2b660 0x55ebbad2da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:37.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4fb9c7000 4 client.10683 mds_command: new command op to 10545 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:32:37.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4fb9c7000 1 -- 172.21.15.5:0/3578210049 --> [v2:172.21.15.5:6834/1752765831,v1:172.21.15.5:6835/1752765831] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ebbab4af40 con 0x55ebbad2b660 2023-07-14T13:32:37.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4f6417640 1 --2- 172.21.15.5:0/3578210049 >> [v2:172.21.15.5:6834/1752765831,v1:172.21.15.5:6835/1752765831] conn(0x55ebbad2b660 0x55ebbad2da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:37.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4f6417640 1 --2- 172.21.15.5:0/3578210049 >> [v2:172.21.15.5:6834/1752765831,v1:172.21.15.5:6835/1752765831] conn(0x55ebbad2b660 0x55ebbad2da40 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53d080b96c257eb1 server_cookie=d058ec16ba872834 in_seq=0 out_seq=0 2023-07-14T13:32:37.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4d17fa640 10 client.10683 ms_handle_connect on v2:172.21.15.5:6834/1752765831 2023-07-14T13:32:37.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4d17fa640 1 -- 172.21.15.5:0/3578210049 <== mds.0 v2:172.21.15.5:6834/1752765831 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ebbab4af40 con 0x55ebbad2b660 2023-07-14T13:32:37.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4d17fa640 10 client.10683 handle_command_reply: tid=0 2023-07-14T13:32:37.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4fb9c7000 1 client.10683 shutdown 2023-07-14T13:32:37.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4fb9c7000 1 -- 172.21.15.5:0/3578210049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbad1ccf0 msgr2=0x55ebbad0a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:37.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4fb9c7000 1 --2- 172.21.15.5:0/3578210049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbad1ccf0 0x55ebbad0a630 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8054c20 tx=0x7ff4e80516f0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4fb9c7000 1 -- 172.21.15.5:0/3578210049 shutdown_connections 2023-07-14T13:32:37.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4fb9c7000 1 --2- 172.21.15.5:0/3578210049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbad1ccf0 0x55ebbad0a630 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4fb9c7000 1 --2- 172.21.15.5:0/3578210049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebbad1c3e0 0x55ebbad0a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4fb9c7000 1 --2- 172.21.15.5:0/3578210049 >> [v2:172.21.15.5:6834/1752765831,v1:172.21.15.5:6835/1752765831] conn(0x55ebbad2b660 0x55ebbad2da40 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4fb9c7000 1 --2- 172.21.15.5:0/3578210049 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ebbacd2d40 0x55ebbad09bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4fb9c7000 1 -- 172.21.15.5:0/3578210049 >> 172.21.15.5:0/3578210049 conn(0x55ebbacd4e60 msgr2=0x55ebbacd39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:37.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4d17fa640 0 client.10683 ms_handle_reset on v2:172.21.15.5:6834/1752765831 2023-07-14T13:32:37.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4fb9c7000 1 -- 172.21.15.5:0/3578210049 shutdown_connections 2023-07-14T13:32:37.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4fb9c7000 1 -- 172.21.15.5:0/3578210049 wait complete. 2023-07-14T13:32:37.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.132+0000 7ff4fb9c7000 20 client.10683 trim_cache size 0 max 16384 2023-07-14T13:32:37.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.148+0000 7ff4fb9c7000 1 Processor -- start 2023-07-14T13:32:37.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.148+0000 7ff4fb9c7000 1 -- start start 2023-07-14T13:32:37.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.148+0000 7ff4fb9c7000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebbacd2d40 0x55ebbacd3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:37.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.148+0000 7ff4fb9c7000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbad1c3e0 0x55ebbacd3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:37.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.148+0000 7ff4fb9c7000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ebbad1ccf0 0x55ebbacd3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:37.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.148+0000 7ff4fb9c7000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebba7d9940 con 0x55ebbad1c3e0 2023-07-14T13:32:37.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.148+0000 7ff4fb9c7000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebbacca660 con 0x55ebbacd2d40 2023-07-14T13:32:37.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.148+0000 7ff4fb9c7000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ebbaaeb3a0 con 0x55ebbad1ccf0 2023-07-14T13:32:37.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.148+0000 7ff4f5c16640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbad1c3e0 0x55ebbacd3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:37.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4f5c16640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbad1c3e0 0x55ebbacd3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40062/0 (socket says 172.21.15.5:40062) 2023-07-14T13:32:37.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4f5c16640 1 -- 172.21.15.5:0/769916456 learned_addr learned my addr 172.21.15.5:0/769916456 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:37.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4f6417640 1 --2- 172.21.15.5:0/769916456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebbacd2d40 0x55ebbacd3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:37.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4f6c18640 1 --2- 172.21.15.5:0/769916456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ebbad1ccf0 0x55ebbacd3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4f5c16640 1 -- 172.21.15.5:0/769916456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ebbad1ccf0 msgr2=0x55ebbacd3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4f5c16640 1 --2- 172.21.15.5:0/769916456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ebbad1ccf0 0x55ebbacd3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4f5c16640 1 -- 172.21.15.5:0/769916456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebbacd2d40 msgr2=0x55ebbacd3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4f5c16640 1 --2- 172.21.15.5:0/769916456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebbacd2d40 0x55ebbacd3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4f5c16640 1 -- 172.21.15.5:0/769916456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ebbaac7020 con 0x55ebbad1c3e0 2023-07-14T13:32:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4f6c18640 1 --2- 172.21.15.5:0/769916456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ebbad1ccf0 0x55ebbacd3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4f5c16640 1 --2- 172.21.15.5:0/769916456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbad1c3e0 0x55ebbacd3650 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0004780 tx=0x7ff4e0009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960b792c3e5531d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4e4ff9640 1 -- 172.21.15.5:0/769916456 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e00ab7c0 con 0x55ebbad1c3e0 2023-07-14T13:32:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4e4ff9640 1 -- 172.21.15.5:0/769916456 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e00ab920 con 0x55ebbad1c3e0 2023-07-14T13:32:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4e4ff9640 1 -- 172.21.15.5:0/769916456 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e00abcd0 con 0x55ebbad1c3e0 2023-07-14T13:32:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4fb9c7000 1 -- 172.21.15.5:0/769916456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbad1c3e0 msgr2=0x55ebbacd3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4fb9c7000 1 --2- 172.21.15.5:0/769916456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbad1c3e0 0x55ebbacd3650 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0004780 tx=0x7ff4e0009190 comp rx=0 tx=0).stop 2023-07-14T13:32:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4fb9c7000 1 -- 172.21.15.5:0/769916456 shutdown_connections 2023-07-14T13:32:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4fb9c7000 1 --2- 172.21.15.5:0/769916456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ebbad1ccf0 0x55ebbacd3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4fb9c7000 1 --2- 172.21.15.5:0/769916456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbad1c3e0 0x55ebbacd3650 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4fb9c7000 1 --2- 172.21.15.5:0/769916456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebbacd2d40 0x55ebbacd3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4fb9c7000 1 -- 172.21.15.5:0/769916456 >> 172.21.15.5:0/769916456 conn(0x55ebbacd4e60 msgr2=0x55ebbacd1970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4fb9c7000 1 -- 172.21.15.5:0/769916456 shutdown_connections 2023-07-14T13:32:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4fb9c7000 1 -- 172.21.15.5:0/769916456 wait complete. 2023-07-14T13:32:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4fb9c7000 1 -- start start 2023-07-14T13:32:37.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4fb9c7000 1 Processor -- start 2023-07-14T13:32:37.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4fb9c7000 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbacd2d40 0x55ebbad2ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:37.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4fb9c7000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebbad1c3e0 0x55ebbad2efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:37.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4fb9c7000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ebbad1ccf0 0x55ebbad36ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:37.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4fb9c7000 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebbabbaca0 con 0x55ebbacd2d40 2023-07-14T13:32:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4fb9c7000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebbaae4370 con 0x55ebbad1c3e0 2023-07-14T13:32:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4fb9c7000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ebbab19010 con 0x55ebbad1ccf0 2023-07-14T13:32:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4fb9c7000 10 client.0 _ll_register_callbacks cb 0x55ebbac9a4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:32:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.152+0000 7ff4f6417640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbacd2d40 0x55ebbad2ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4f6417640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbacd2d40 0x55ebbad2ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40074/0 (socket says 172.21.15.5:40074) 2023-07-14T13:32:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4f6417640 1 -- 172.21.15.5:0/2192820289 learned_addr learned my addr 172.21.15.5:0/2192820289 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4f6c18640 1 --2- 172.21.15.5:0/2192820289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ebbad1ccf0 0x55ebbad36ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4f5c16640 1 --2- 172.21.15.5:0/2192820289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebbad1c3e0 0x55ebbad2efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4f6417640 1 -- 172.21.15.5:0/2192820289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ebbad1ccf0 msgr2=0x55ebbad36ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4f6417640 1 --2- 172.21.15.5:0/2192820289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ebbad1ccf0 0x55ebbad36ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4f6417640 1 -- 172.21.15.5:0/2192820289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebbad1c3e0 msgr2=0x55ebbad2efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4f6417640 1 --2- 172.21.15.5:0/2192820289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebbad1c3e0 0x55ebbad2efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4f6417640 1 -- 172.21.15.5:0/2192820289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ebba818890 con 0x55ebbacd2d40 2023-07-14T13:32:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4f6417640 1 --2- 172.21.15.5:0/2192820289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbacd2d40 0x55ebbad2ea90 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec001550 tx=0x7ff4ec000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3fd60560f8d96db server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-07-14T13:32:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4d17fa640 1 -- 172.21.15.5:0/2192820289 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec029e80 con 0x55ebbacd2d40 2023-07-14T13:32:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4d17fa640 1 -- 172.21.15.5:0/2192820289 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(191..191 src has 1..191) v4 ==== 6090+0+0 (secure 0 0 0) 0x7ff4ec01c040 con 0x55ebbacd2d40 2023-07-14T13:32:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4fb9c7000 1 -- 172.21.15.5:0/2192820289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ebbacdadd0 con 0x55ebbacd2d40 2023-07-14T13:32:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4d17fa640 1 -- 172.21.15.5:0/2192820289 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4ec0293c0 con 0x55ebbacd2d40 2023-07-14T13:32:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4fb9c7000 10 client.10689 fetch_fsmap learned FSMap version 92 2023-07-14T13:32:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4fb9c7000 1 -- 172.21.15.5:0/2192820289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x55ebba818cc0 con 0x55ebbacd2d40 2023-07-14T13:32:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4d17fa640 1 -- 172.21.15.5:0/2192820289 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ebbacdadd0 con 0x55ebbacd2d40 2023-07-14T13:32:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4d17fa640 1 -- 172.21.15.5:0/2192820289 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 92) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff4ec012070 con 0x55ebbacd2d40 2023-07-14T13:32:37.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4fb9c7000 10 client.10689 fetch_fsmap finished waiting for FSMap version 92 2023-07-14T13:32:37.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4fb9c7000 10 client.10689 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T13:32:37.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4fb9c7000 20 client.10689 populate_metadata read hostname 'smithi005' 2023-07-14T13:32:37.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4fb9c7000 1 --2- 172.21.15.5:0/2192820289 >> [v2:172.21.15.5:6834/1752765831,v1:172.21.15.5:6835/1752765831] conn(0x55ebbad373e0 0x55ebbad377b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:37.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4fb9c7000 4 client.10689 mds_command: new command op to 10545 tid=0[{"prefix": "status"}] 2023-07-14T13:32:37.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4fb9c7000 1 -- 172.21.15.5:0/2192820289 --> [v2:172.21.15.5:6834/1752765831,v1:172.21.15.5:6835/1752765831] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ebbab1ad50 con 0x55ebbad373e0 2023-07-14T13:32:37.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4f5c16640 1 --2- 172.21.15.5:0/2192820289 >> [v2:172.21.15.5:6834/1752765831,v1:172.21.15.5:6835/1752765831] conn(0x55ebbad373e0 0x55ebbad377b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:37.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4f5c16640 1 --2- 172.21.15.5:0/2192820289 >> [v2:172.21.15.5:6834/1752765831,v1:172.21.15.5:6835/1752765831] conn(0x55ebbad373e0 0x55ebbad377b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf227ce665e4df60 server_cookie=8c33389f3cca1650 in_seq=0 out_seq=0 2023-07-14T13:32:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4d17fa640 10 client.10689 ms_handle_connect on v2:172.21.15.5:6834/1752765831 2023-07-14T13:32:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4d17fa640 1 -- 172.21.15.5:0/2192820289 <== mds.0 v2:172.21.15.5:6834/1752765831 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55ebbab1ad50 con 0x55ebbad373e0 2023-07-14T13:32:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4d17fa640 10 client.10689 handle_command_reply: tid=0 2023-07-14T13:32:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4fb9c7000 1 client.10689 shutdown 2023-07-14T13:32:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4fb9c7000 1 -- 172.21.15.5:0/2192820289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbacd2d40 msgr2=0x55ebbad2ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4fb9c7000 1 --2- 172.21.15.5:0/2192820289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbacd2d40 0x55ebbad2ea90 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec001550 tx=0x7ff4ec000ee0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4fb9c7000 1 -- 172.21.15.5:0/2192820289 shutdown_connections 2023-07-14T13:32:37.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4fb9c7000 1 --2- 172.21.15.5:0/2192820289 >> [v2:172.21.15.5:6834/1752765831,v1:172.21.15.5:6835/1752765831] conn(0x55ebbad373e0 0x55ebbad377b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4fb9c7000 1 --2- 172.21.15.5:0/2192820289 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55ebbad1ccf0 0x55ebbad36ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4fb9c7000 1 --2- 172.21.15.5:0/2192820289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebbad1c3e0 0x55ebbad2efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4fb9c7000 1 --2- 172.21.15.5:0/2192820289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ebbacd2d40 0x55ebbad2ea90 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4d17fa640 0 client.10689 ms_handle_reset on v2:172.21.15.5:6834/1752765831 2023-07-14T13:32:37.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4fb9c7000 1 -- 172.21.15.5:0/2192820289 >> 172.21.15.5:0/2192820289 conn(0x55ebbacd4e60 msgr2=0x55ebbacd9570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:37.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4fb9c7000 1 -- 172.21.15.5:0/2192820289 shutdown_connections 2023-07-14T13:32:37.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4fb9c7000 1 -- 172.21.15.5:0/2192820289 wait complete. 2023-07-14T13:32:37.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.156+0000 7ff4fb9c7000 20 client.10689 trim_cache size 0 max 16384 2023-07-14T13:32:37.166 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T13:32:37.166 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "22affb8d-e389-40f8-a764-dd40eb1759c8", 2023-07-14T13:32:37.166 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-07-14T13:32:37.166 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 10545, 2023-07-14T13:32:37.167 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-07-14T13:32:37.167 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-07-14T13:32:37.167 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-07-14T13:32:37.167 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 5.9405752170000001, 2023-07-14T13:32:37.167 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 92, 2023-07-14T13:32:37.167 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 191, 2023-07-14T13:32:37.167 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 191, 2023-07-14T13:32:37.167 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 18.66267723 2023-07-14T13:32:37.168 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T13:32:37.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.160+0000 7ff4f867b640 1 -- 172.21.15.5:0/3125329228 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7ff4d40663a0 msgr2=0x7ff4d4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:37.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.160+0000 7ff4f867b640 1 --2- 172.21.15.5:0/3125329228 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7ff4d40663a0 0x7ff4d4068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec001720 tx=0x7ff4ec009040 comp rx=0 tx=0).stop 2023-07-14T13:32:37.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.160+0000 7ff4f867b640 1 -- 172.21.15.5:0/3125329228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4f0157200 msgr2=0x7ff4f00adc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:37.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.160+0000 7ff4f867b640 1 --2- 172.21.15.5:0/3125329228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4f0157200 0x7ff4f00adc60 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800cba0 tx=0x7ff4e800a430 comp rx=0 tx=0).stop 2023-07-14T13:32:37.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.160+0000 7ff4f867b640 1 -- 172.21.15.5:0/3125329228 shutdown_connections 2023-07-14T13:32:37.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.160+0000 7ff4f867b640 1 --2- 172.21.15.5:0/3125329228 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7ff4d40663a0 0x7ff4d4068850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.160+0000 7ff4f867b640 1 --2- 172.21.15.5:0/3125329228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4f0157200 0x7ff4f00adc60 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.160+0000 7ff4f867b640 1 --2- 172.21.15.5:0/3125329228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4f015b7c0 0x7ff4f00c63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.160+0000 7ff4f867b640 1 --2- 172.21.15.5:0/3125329228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4f006b8f0 0x7ff4f0143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.160+0000 7ff4f867b640 1 -- 172.21.15.5:0/3125329228 >> 172.21.15.5:0/3125329228 conn(0x7ff4f00afcf0 msgr2=0x7ff4f00c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:37.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.160+0000 7ff4f867b640 1 -- 172.21.15.5:0/3125329228 shutdown_connections 2023-07-14T13:32:37.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.160+0000 7ff4f867b640 1 -- 172.21.15.5:0/3125329228 wait complete. 2023-07-14T13:32:37.178 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-14T13:32:37.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.320+0000 7f4f51bc5640 1 Processor -- start 2023-07-14T13:32:37.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.320+0000 7f4f51bc5640 1 -- start start 2023-07-14T13:32:37.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.324+0000 7f4f51bc5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4f4c0ae1f0 0x7f4f4c0b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:37.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.324+0000 7f4f51bc5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f4c06c430 0x7f4f4c069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:37.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.324+0000 7f4f51bc5640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f4c0b24f0 con 0x7f4f4c06e160 2023-07-14T13:32:37.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.324+0000 7f4f51bc5640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f4c0b27d0 con 0x7f4f4c0ae1f0 2023-07-14T13:32:37.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.324+0000 7f4f51bc5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c0b2ab0 con 0x7f4f4c06c430 2023-07-14T13:32:37.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.324+0000 7f4f4affd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4f4c06e160 0x7f4f4c06bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57646/0 (socket says 172.21.15.5:57646) 2023-07-14T13:32:37.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.324+0000 7f4f4affd640 1 -- 172.21.15.5:0/3885676343 learned_addr learned my addr 172.21.15.5:0/3885676343 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:37.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.324+0000 7f4f4b7fe640 1 --2- 172.21.15.5:0/3885676343 >> v2:172.21.15.154:3300/0 conn(0x7f4f4c0ae1f0 0x7f4f4c0b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:37.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.324+0000 7f4f4bfff640 1 --2- 172.21.15.5:0/3885676343 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f4c06c430 0x7f4f4c069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:37.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.324+0000 7f4f4a7fc640 1 -- 172.21.15.5:0/3885676343 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3052083658 0 0) 0x7f4f4c0b24f0 con 0x7f4f4c06e160 2023-07-14T13:32:37.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.324+0000 7f4f4a7fc640 1 -- 172.21.15.5:0/3885676343 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f34003530 con 0x7f4f4c06e160 2023-07-14T13:32:37.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.324+0000 7f4f4b7fe640 1 -- 172.21.15.5:0/3885676343 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f4c06c430 msgr2=0x7f4f4c069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:37.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.324+0000 7f4f4b7fe640 1 --2- 172.21.15.5:0/3885676343 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f4c06c430 0x7f4f4c069430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.324+0000 7f4f4b7fe640 1 -- 172.21.15.5:0/3885676343 >> v1:172.21.15.5:6789/0 conn(0x7f4f4c06e160 legacy=0x7f4f4c06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:37.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.324+0000 7f4f4b7fe640 1 -- 172.21.15.5:0/3885676343 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4c0b2d90 con 0x7f4f4c0ae1f0 2023-07-14T13:32:37.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.328+0000 7f4f4b7fe640 1 --2- 172.21.15.5:0/3885676343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f4c0ae1f0 0x7f4f4c0b1e60 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0097c0 tx=0x7f4f3c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e9db47f4cf42ee2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:37.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.328+0000 7f4f4a7fc640 1 -- 172.21.15.5:0/3885676343 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c0ab670 con 0x7f4f4c0ae1f0 2023-07-14T13:32:37.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.328+0000 7f4f4a7fc640 1 -- 172.21.15.5:0/3885676343 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3c0ab7d0 con 0x7f4f4c0ae1f0 2023-07-14T13:32:37.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.328+0000 7f4f4a7fc640 1 -- 172.21.15.5:0/3885676343 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c0abb60 con 0x7f4f4c0ae1f0 2023-07-14T13:32:37.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.328+0000 7f4f51bc5640 1 -- 172.21.15.5:0/3885676343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f4c0ae1f0 msgr2=0x7f4f4c0b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:37.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.328+0000 7f4f51bc5640 1 --2- 172.21.15.5:0/3885676343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f4c0ae1f0 0x7f4f4c0b1e60 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0097c0 tx=0x7f4f3c01c450 comp rx=0 tx=0).stop 2023-07-14T13:32:37.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.328+0000 7f4f51bc5640 1 -- 172.21.15.5:0/3885676343 shutdown_connections 2023-07-14T13:32:37.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.328+0000 7f4f51bc5640 1 --2- 172.21.15.5:0/3885676343 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f4c06c430 0x7f4f4c069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.328+0000 7f4f51bc5640 1 --2- 172.21.15.5:0/3885676343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f4c0ae1f0 0x7f4f4c0b1e60 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.328+0000 7f4f51bc5640 1 -- 172.21.15.5:0/3885676343 >> 172.21.15.5:0/3885676343 conn(0x7f4f4c0b1300 msgr2=0x7f4f4c0ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:37.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.328+0000 7f4f51bc5640 1 -- 172.21.15.5:0/3885676343 shutdown_connections 2023-07-14T13:32:37.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.328+0000 7f4f51bc5640 1 -- 172.21.15.5:0/3885676343 wait complete. 2023-07-14T13:32:37.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.328+0000 7f4f51bc5640 1 Processor -- start 2023-07-14T13:32:37.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.328+0000 7f4f51bc5640 1 -- start start 2023-07-14T13:32:37.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.332+0000 7f4f51bc5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f4c06c430 0x7f4f4c0af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:37.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.332+0000 7f4f51bc5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f4c06e160 0x7f4f4c15ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:37.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.332+0000 7f4f51bc5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f4c0ae1f0 0x7f4f4c13f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:37.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.332+0000 7f4f51bc5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c15b360 con 0x7f4f4c06e160 2023-07-14T13:32:37.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.332+0000 7f4f51bc5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c13ede0 con 0x7f4f4c06c430 2023-07-14T13:32:37.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.332+0000 7f4f51bc5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c0cbae0 con 0x7f4f4c0ae1f0 2023-07-14T13:32:37.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.332+0000 7f4f4affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f4c06e160 0x7f4f4c15ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:37.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.332+0000 7f4f4affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f4c06e160 0x7f4f4c15ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40076/0 (socket says 172.21.15.5:40076) 2023-07-14T13:32:37.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.332+0000 7f4f4affd640 1 -- 172.21.15.5:0/66291916 learned_addr learned my addr 172.21.15.5:0/66291916 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:37.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.332+0000 7f4f4affd640 1 -- 172.21.15.5:0/66291916 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f4c0ae1f0 msgr2=0x7f4f4c13f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:37.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.332+0000 7f4f4affd640 1 --2- 172.21.15.5:0/66291916 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f4c0ae1f0 0x7f4f4c13f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.332+0000 7f4f4affd640 1 -- 172.21.15.5:0/66291916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f4c06c430 msgr2=0x7f4f4c0af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:37.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.332+0000 7f4f4b7fe640 1 --2- 172.21.15.5:0/66291916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f4c06c430 0x7f4f4c0af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:37.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.332+0000 7f4f4affd640 1 --2- 172.21.15.5:0/66291916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f4c06c430 0x7f4f4c0af9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.332+0000 7f4f4affd640 1 -- 172.21.15.5:0/66291916 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c009420 con 0x7f4f4c06e160 2023-07-14T13:32:37.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.332+0000 7f4f4affd640 1 --2- 172.21.15.5:0/66291916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f4c06e160 0x7f4f4c15ae20 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f4f4000c3d0 tx=0x7f4f4000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:37.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.332+0000 7f4f33fff640 1 -- 172.21.15.5:0/66291916 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f40005cf0 con 0x7f4f4c06e160 2023-07-14T13:32:37.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.332+0000 7f4f33fff640 1 -- 172.21.15.5:0/66291916 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f40005e50 con 0x7f4f4c06e160 2023-07-14T13:32:37.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.332+0000 7f4f33fff640 1 -- 172.21.15.5:0/66291916 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f400072f0 con 0x7f4f4c06e160 2023-07-14T13:32:37.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.332+0000 7f4f51bc5640 1 -- 172.21.15.5:0/66291916 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f4c0b3710 con 0x7f4f4c06e160 2023-07-14T13:32:37.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.332+0000 7f4f51bc5640 1 -- 172.21.15.5:0/66291916 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4c13e300 con 0x7f4f4c06e160 2023-07-14T13:32:37.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.332+0000 7f4f51bc5640 1 -- 172.21.15.5:0/66291916 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f4c0678d0 con 0x7f4f4c06e160 2023-07-14T13:32:37.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.332+0000 7f4f33fff640 1 -- 172.21.15.5:0/66291916 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4f40007450 con 0x7f4f4c06e160 2023-07-14T13:32:37.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.336+0000 7f4f33fff640 1 --2- 172.21.15.5:0/66291916 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f4f380663d0 0x7f4f38068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:37.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.336+0000 7f4f33fff640 1 -- 172.21.15.5:0/66291916 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f4f400833d0 con 0x7f4f4c06e160 2023-07-14T13:32:37.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.336+0000 7f4f4b7fe640 1 --2- 172.21.15.5:0/66291916 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f4f380663d0 0x7f4f38068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:37.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.336+0000 7f4f4b7fe640 1 --2- 172.21.15.5:0/66291916 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f4f380663d0 0x7f4f38068880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0af000 tx=0x7f4f3c008040 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:37.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.340+0000 7f4f33fff640 1 -- 172.21.15.5:0/66291916 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f4f400507b0 con 0x7f4f4c06e160 2023-07-14T13:32:37.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.524+0000 7f4f51bc5640 1 -- 172.21.15.5:0/66291916 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4f4c066810 con 0x7f4f4c06e160 2023-07-14T13:32:37.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.524+0000 7f4f33fff640 1 -- 172.21.15.5:0/66291916 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v92) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4f40053dd0 con 0x7f4f4c06e160 2023-07-14T13:32:37.527 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T13:32:37.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.528+0000 7f4f51bc5640 1 -- 172.21.15.5:0/66291916 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f4f380663d0 msgr2=0x7f4f38068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:37.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.528+0000 7f4f51bc5640 1 --2- 172.21.15.5:0/66291916 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f4f380663d0 0x7f4f38068880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0af000 tx=0x7f4f3c008040 comp rx=0 tx=0).stop 2023-07-14T13:32:37.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.528+0000 7f4f51bc5640 1 -- 172.21.15.5:0/66291916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f4c06e160 msgr2=0x7f4f4c15ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:37.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.528+0000 7f4f51bc5640 1 --2- 172.21.15.5:0/66291916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f4c06e160 0x7f4f4c15ae20 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f4f4000c3d0 tx=0x7f4f4000c890 comp rx=0 tx=0).stop 2023-07-14T13:32:37.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.528+0000 7f4f51bc5640 1 -- 172.21.15.5:0/66291916 shutdown_connections 2023-07-14T13:32:37.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.528+0000 7f4f51bc5640 1 --2- 172.21.15.5:0/66291916 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f4f380663d0 0x7f4f38068880 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.528+0000 7f4f51bc5640 1 --2- 172.21.15.5:0/66291916 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f4c0ae1f0 0x7f4f4c13f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.528+0000 7f4f51bc5640 1 --2- 172.21.15.5:0/66291916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f4c06e160 0x7f4f4c15ae20 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.528+0000 7f4f51bc5640 1 --2- 172.21.15.5:0/66291916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f4c06c430 0x7f4f4c0af9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:37.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.528+0000 7f4f51bc5640 1 -- 172.21.15.5:0/66291916 >> 172.21.15.5:0/66291916 conn(0x7f4f4c0b1300 msgr2=0x7f4f4c165d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:37.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.528+0000 7f4f51bc5640 1 -- 172.21.15.5:0/66291916 shutdown_connections 2023-07-14T13:32:37.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:37.528+0000 7f4f51bc5640 1 -- 172.21.15.5:0/66291916 wait complete. 2023-07-14T13:32:37.548 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-14T13:32:37.548 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T13:32:37.549 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-07-14T13:32:37.549 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-14T13:32:37.549 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-14T13:32:37.549 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-14T13:32:37.550 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-14T13:32:37.550 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T13:32:37.550 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T13:32:37.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:37.551 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-07-14T13:32:37.561 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T13:32:37.561 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T13:32:37.561 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T13:32:37.562 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:32:37.562 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-07-14T13:32:37.562 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:32:37.562 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T13:32:37.562 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-07-14T13:32:37.562 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2023-07-14T13:32:37.562 INFO:teuthology.orchestra.run.smithi005.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T13:32:37.563 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-07-14T13:32:37.563 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2023-07-14T13:32:37.563 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-14T13:32:37.563 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 39959sec preferred_lft 39959sec 2023-07-14T13:32:37.563 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-07-14T13:32:37.563 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:32:37.563 INFO:teuthology.orchestra.run.smithi005.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T13:32:37.564 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-07-14T13:32:37.564 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2023-07-14T13:32:37.564 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-14T13:32:37.564 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-07-14T13:32:37.564 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2023-07-14T13:32:37.564 INFO:teuthology.orchestra.run.smithi005.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-14T13:32:37.565 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 02:42:96:b6:fb:c6 brd ff:ff:ff:ff:ff:ff 2023-07-14T13:32:37.565 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-14T13:32:37.565 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:32:37.565 INFO:teuthology.orchestra.run.smithi005.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-14T13:32:37.565 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-14T13:32:37.565 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-14T13:32:37.565 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:32:37.566 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-14T13:32:37.566 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:32:37.566 INFO:teuthology.orchestra.run.smithi005.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T13:32:37.566 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T13:32:37.566 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-14T13:32:37.566 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:32:37.566 INFO:teuthology.orchestra.run.smithi005.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-14T13:32:37.567 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-14T13:32:37.567 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-14T13:32:37.567 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-07-14T13:32:37.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:37.569 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T13:32:37.630 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-07-14T13:32:37.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:37.633 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-07-14T13:32:37.685 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-07-14T13:32:37.686 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T13:32:37.686 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-14T13:32:37.686 INFO:teuthology.orchestra.run.smithi005.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-14T13:32:37.687 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-14T13:32:37.687 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T13:32:37.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:37.688 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-07-14T13:32:37.688 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-07-14T13:32:37.689 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-14T13:32:37.689 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-14T13:32:37.689 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-14T13:32:37.690 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-07-14T13:32:37.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:37.781 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-07-14T13:32:37.790 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-14T13:32:37.790 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-14T13:32:37.791 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T13:32:37.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:37.791 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-07-14T13:32:37.856 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T13:32:37.856 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-14T13:32:37.907 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-14T13:32:37.908 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T13:32:37.908 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-14T13:32:37.959 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-14T13:32:37.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:37.959 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:32:38.052 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:32:38.052 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T13:32:38.052 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T13:32:38.067 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:32:38.067 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T13:32:38.068 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T13:32:38.068 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T13:32:38.068 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T13:32:38.076 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-14T13:32:38.077 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-14T13:32:38.077 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2023-07-14T13:32:38.077 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.154:3300,172.21.15.154:3301" 2023-07-14T13:32:38.077 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-14T13:32:38.078 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790" 2023-07-14T13:32:38.078 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.154:6789,172.21.15.154:6790:/ 2023-07-14T13:32:38.078 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=22affb8d-e389-40f8-a764-dd40eb1759c8" will pass to kernel 2023-07-14T13:32:38.081 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-14T13:32:38.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:38.082 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-14T13:32:38.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:38.104 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-14T13:32:38.167 INFO:teuthology.orchestra.run.smithi005.stdout:client8774 2023-07-14T13:32:38.168 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:32:38.168 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:32:38.224 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-14T13:32:38.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.412+0000 7f33e4dd2640 1 Processor -- start 2023-07-14T13:32:38.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.412+0000 7f33e4dd2640 1 -- start start 2023-07-14T13:32:38.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.412+0000 7f33e4dd2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f33e015f970 0x7f33e015fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:38.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.412+0000 7f33e4dd2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e0160330 con 0x7f33e015bdf0 2023-07-14T13:32:38.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.412+0000 7f33e4dd2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e00cb080 con 0x7f33e00c8e70 2023-07-14T13:32:38.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.412+0000 7f33e4dd2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e00cb2e0 con 0x7f33e015f970 2023-07-14T13:32:38.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.412+0000 7f33d7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f33e015f970 0x7f33e015fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:38.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.412+0000 7f33d7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f33e015f970 0x7f33e015fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40086/0 (socket says 172.21.15.5:40086) 2023-07-14T13:32:38.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.412+0000 7f33d7fff640 1 -- 172.21.15.5:0/3701314199 learned_addr learned my addr 172.21.15.5:0/3701314199 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:38.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.412+0000 7f33d7fff640 1 -- 172.21.15.5:0/3701314199 >> v1:172.21.15.154:6789/0 conn(0x7f33e00c8e70 legacy=0x7f33e00c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:38.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.412+0000 7f33d7fff640 1 -- 172.21.15.5:0/3701314199 >> v1:172.21.15.5:6789/0 conn(0x7f33e015bdf0 legacy=0x7f33e00ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:38.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.412+0000 7f33d7fff640 1 -- 172.21.15.5:0/3701314199 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e00cb5c0 con 0x7f33e015f970 2023-07-14T13:32:38.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.416+0000 7f33d7fff640 1 --2- 172.21.15.5:0/3701314199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33e015f970 0x7f33e015fdf0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f33c8009870 tx=0x7f33c801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42115c9ffb6bf09e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:38.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.416+0000 7f33ddd9b640 1 -- 172.21.15.5:0/3701314199 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c80ab680 con 0x7f33e015f970 2023-07-14T13:32:38.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.416+0000 7f33ddd9b640 1 -- 172.21.15.5:0/3701314199 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c80ab7e0 con 0x7f33e015f970 2023-07-14T13:32:38.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.416+0000 7f33ddd9b640 1 -- 172.21.15.5:0/3701314199 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c80abb70 con 0x7f33e015f970 2023-07-14T13:32:38.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.416+0000 7f33e4dd2640 1 -- 172.21.15.5:0/3701314199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33e015f970 msgr2=0x7f33e015fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:38.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.416+0000 7f33e4dd2640 1 --2- 172.21.15.5:0/3701314199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33e015f970 0x7f33e015fdf0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f33c8009870 tx=0x7f33c801c480 comp rx=0 tx=0).stop 2023-07-14T13:32:38.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.416+0000 7f33e4dd2640 1 -- 172.21.15.5:0/3701314199 shutdown_connections 2023-07-14T13:32:38.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.416+0000 7f33e4dd2640 1 --2- 172.21.15.5:0/3701314199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33e015f970 0x7f33e015fdf0 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:38.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.416+0000 7f33e4dd2640 1 -- 172.21.15.5:0/3701314199 >> 172.21.15.5:0/3701314199 conn(0x7f33e00afcf0 msgr2=0x7f33e00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:38.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.416+0000 7f33e4dd2640 1 -- 172.21.15.5:0/3701314199 shutdown_connections 2023-07-14T13:32:38.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.416+0000 7f33e4dd2640 1 -- 172.21.15.5:0/3701314199 wait complete. 2023-07-14T13:32:38.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.420+0000 7f33e4dd2640 1 Processor -- start 2023-07-14T13:32:38.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.420+0000 7f33e4dd2640 1 -- start start 2023-07-14T13:32:38.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.420+0000 7f33e4dd2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33e00c8e70 0x7f33e00ac6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:38.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.420+0000 7f33e4dd2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33e015bdf0 0x7f33e00c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:38.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.420+0000 7f33e4dd2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33e015f970 0x7f33e01f7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:38.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.420+0000 7f33e4dd2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e0156440 con 0x7f33e015bdf0 2023-07-14T13:32:38.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.420+0000 7f33e4dd2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e00c4a20 con 0x7f33e00c8e70 2023-07-14T13:32:38.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.420+0000 7f33e4dd2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e00c4460 con 0x7f33e015f970 2023-07-14T13:32:38.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.420+0000 7f33d7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33e015bdf0 0x7f33e00c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:38.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.420+0000 7f33d7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33e015bdf0 0x7f33e00c7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40094/0 (socket says 172.21.15.5:40094) 2023-07-14T13:32:38.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.420+0000 7f33d7fff640 1 -- 172.21.15.5:0/648479555 learned_addr learned my addr 172.21.15.5:0/648479555 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:38.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.420+0000 7f33de59c640 1 --2- 172.21.15.5:0/648479555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33e00c8e70 0x7f33e00ac6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:38.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.420+0000 7f33ded9d640 1 --2- 172.21.15.5:0/648479555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33e015f970 0x7f33e01f7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:38.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.420+0000 7f33d7fff640 1 -- 172.21.15.5:0/648479555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33e015f970 msgr2=0x7f33e01f7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:38.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.420+0000 7f33d7fff640 1 --2- 172.21.15.5:0/648479555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33e015f970 0x7f33e01f7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:38.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.420+0000 7f33d7fff640 1 -- 172.21.15.5:0/648479555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33e00c8e70 msgr2=0x7f33e00ac6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:38.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.420+0000 7f33d7fff640 1 --2- 172.21.15.5:0/648479555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33e00c8e70 0x7f33e00ac6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:38.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.420+0000 7f33d7fff640 1 -- 172.21.15.5:0/648479555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c80094d0 con 0x7f33e015bdf0 2023-07-14T13:32:38.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.420+0000 7f33ded9d640 1 --2- 172.21.15.5:0/648479555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33e015f970 0x7f33e01f7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:38.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.420+0000 7f33d7fff640 1 --2- 172.21.15.5:0/648479555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33e015bdf0 0x7f33e00c7a40 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f33c80ad040 tx=0x7f33c8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:38.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.420+0000 7f33d6ffd640 1 -- 172.21.15.5:0/648479555 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c80b5810 con 0x7f33e015bdf0 2023-07-14T13:32:38.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.420+0000 7f33d6ffd640 1 -- 172.21.15.5:0/648479555 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c80b59b0 con 0x7f33e015bdf0 2023-07-14T13:32:38.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.420+0000 7f33d6ffd640 1 -- 172.21.15.5:0/648479555 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c80b5d60 con 0x7f33e015bdf0 2023-07-14T13:32:38.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.420+0000 7f33e4dd2640 1 -- 172.21.15.5:0/648479555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e015c3e0 con 0x7f33e015bdf0 2023-07-14T13:32:38.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.420+0000 7f33e4dd2640 1 -- 172.21.15.5:0/648479555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e00c46b0 con 0x7f33e015bdf0 2023-07-14T13:32:38.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.424+0000 7f33e4dd2640 1 -- 172.21.15.5:0/648479555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e00678d0 con 0x7f33e015bdf0 2023-07-14T13:32:38.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.424+0000 7f33d6ffd640 1 -- 172.21.15.5:0/648479555 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f33c80c83a0 con 0x7f33e015bdf0 2023-07-14T13:32:38.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.424+0000 7f33d6ffd640 1 --2- 172.21.15.5:0/648479555 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f33c00663a0 0x7f33c0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:38.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.424+0000 7f33d6ffd640 1 -- 172.21.15.5:0/648479555 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f33c811ef80 con 0x7f33e015bdf0 2023-07-14T13:32:38.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.424+0000 7f33de59c640 1 --2- 172.21.15.5:0/648479555 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f33c00663a0 0x7f33c0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:38.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.424+0000 7f33de59c640 1 --2- 172.21.15.5:0/648479555 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f33c00663a0 0x7f33c0068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f33d0007fd0 tx=0x7f33d0009040 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:38.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.428+0000 7f33d6ffd640 1 -- 172.21.15.5:0/648479555 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f33c814f720 con 0x7f33e015bdf0 2023-07-14T13:32:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.604+0000 7f33e4dd2640 1 -- 172.21.15.5:0/648479555 --> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f33e015c1c0 con 0x7f33c00663a0 2023-07-14T13:32:38.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.604+0000 7f33d6ffd640 1 -- 172.21.15.5:0/648479555 <== mgr.8477 v2:172.21.15.154:6832/2194391064 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f33d00014f0 con 0x7f33c00663a0 2023-07-14T13:32:38.607 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-07-14T13:32:38.607 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-07-14T13:32:38.607 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephfs" 2023-07-14T13:32:38.607 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-07-14T13:32:38.608 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-07-14T13:32:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.608+0000 7f33e4dd2640 1 -- 172.21.15.5:0/648479555 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f33c00663a0 msgr2=0x7f33c0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.608+0000 7f33e4dd2640 1 --2- 172.21.15.5:0/648479555 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f33c00663a0 0x7f33c0068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f33d0007fd0 tx=0x7f33d0009040 comp rx=0 tx=0).stop 2023-07-14T13:32:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.608+0000 7f33e4dd2640 1 -- 172.21.15.5:0/648479555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33e015bdf0 msgr2=0x7f33e00c7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.608+0000 7f33e4dd2640 1 --2- 172.21.15.5:0/648479555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33e015bdf0 0x7f33e00c7a40 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f33c80ad040 tx=0x7f33c8019220 comp rx=0 tx=0).stop 2023-07-14T13:32:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.608+0000 7f33e4dd2640 1 -- 172.21.15.5:0/648479555 shutdown_connections 2023-07-14T13:32:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.608+0000 7f33e4dd2640 1 --2- 172.21.15.5:0/648479555 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f33c00663a0 0x7f33c0068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.608+0000 7f33e4dd2640 1 --2- 172.21.15.5:0/648479555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33e015f970 0x7f33e01f7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.608+0000 7f33e4dd2640 1 --2- 172.21.15.5:0/648479555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33e015bdf0 0x7f33e00c7a40 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.608+0000 7f33e4dd2640 1 --2- 172.21.15.5:0/648479555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33e00c8e70 0x7f33e00ac6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.608+0000 7f33e4dd2640 1 -- 172.21.15.5:0/648479555 >> 172.21.15.5:0/648479555 conn(0x7f33e00afcf0 msgr2=0x7f33e00adc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.608+0000 7f33e4dd2640 1 -- 172.21.15.5:0/648479555 shutdown_connections 2023-07-14T13:32:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.608+0000 7f33e4dd2640 1 -- 172.21.15.5:0/648479555 wait complete. 2023-07-14T13:32:38.628 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-14T13:32:38.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.772+0000 7f0c7f6ca640 1 Processor -- start 2023-07-14T13:32:38.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.772+0000 7f0c7f6ca640 1 -- start start 2023-07-14T13:32:38.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.776+0000 7f0c7f6ca640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0c7815bd50 0x7f0c78069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:38.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.776+0000 7f0c7f6ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c7806fcf0 0x7f0c78070150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:38.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.776+0000 7f0c7f6ca640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c78069970 con 0x7f0c7806cc80 2023-07-14T13:32:38.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.776+0000 7f0c7f6ca640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c7815fa90 con 0x7f0c7815bd50 2023-07-14T13:32:38.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.776+0000 7f0c7f6ca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7815fd70 con 0x7f0c7806fcf0 2023-07-14T13:32:38.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.776+0000 7f0c7cc65640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0c7815bd50 0x7f0c78069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:38.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.776+0000 7f0c7cc65640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0c7815bd50 0x7f0c78069430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:34076/0 (socket says 172.21.15.5:34076) 2023-07-14T13:32:38.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.776+0000 7f0c7d466640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0c7806cc80 0x7f0c7806d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:60012/0 (socket says 172.21.15.5:60012) 2023-07-14T13:32:38.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.776+0000 7f0c7cc65640 1 -- 172.21.15.5:0/2480729496 learned_addr learned my addr 172.21.15.5:0/2480729496 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:38.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.776+0000 7f0c7dc67640 1 --2- 172.21.15.5:0/2480729496 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c7806fcf0 0x7f0c78070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:38.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.776+0000 7f0c7cc65640 1 -- 172.21.15.5:0/2480729496 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c7806fcf0 msgr2=0x7f0c78070150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:38.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.776+0000 7f0c7cc65640 1 --2- 172.21.15.5:0/2480729496 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c7806fcf0 0x7f0c78070150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:38.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.776+0000 7f0c7cc65640 1 -- 172.21.15.5:0/2480729496 >> v1:172.21.15.154:6789/0 conn(0x7f0c7806cc80 legacy=0x7f0c7806d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:38.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.776+0000 7f0c7cc65640 1 -- 172.21.15.5:0/2480729496 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c78160050 con 0x7f0c7815bd50 2023-07-14T13:32:38.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.780+0000 7f0c7cc65640 1 --2- 172.21.15.5:0/2480729496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c7815bd50 0x7f0c78069430 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009870 tx=0x7f0c6801c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfed9c8511ca6127 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:38.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.780+0000 7f0c6ffff640 1 -- 172.21.15.5:0/2480729496 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c680a95f0 con 0x7f0c7815bd50 2023-07-14T13:32:38.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.780+0000 7f0c6ffff640 1 -- 172.21.15.5:0/2480729496 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c680a9750 con 0x7f0c7815bd50 2023-07-14T13:32:38.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.780+0000 7f0c6ffff640 1 -- 172.21.15.5:0/2480729496 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c680a9ae0 con 0x7f0c7815bd50 2023-07-14T13:32:38.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.780+0000 7f0c7f6ca640 1 -- 172.21.15.5:0/2480729496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c7815bd50 msgr2=0x7f0c78069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:38.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.780+0000 7f0c7f6ca640 1 --2- 172.21.15.5:0/2480729496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c7815bd50 0x7f0c78069430 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009870 tx=0x7f0c6801c510 comp rx=0 tx=0).stop 2023-07-14T13:32:38.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.780+0000 7f0c7f6ca640 1 -- 172.21.15.5:0/2480729496 shutdown_connections 2023-07-14T13:32:38.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.780+0000 7f0c7f6ca640 1 --2- 172.21.15.5:0/2480729496 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c7806fcf0 0x7f0c78070150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:38.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.780+0000 7f0c7f6ca640 1 --2- 172.21.15.5:0/2480729496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c7815bd50 0x7f0c78069430 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:38.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.780+0000 7f0c7f6ca640 1 -- 172.21.15.5:0/2480729496 >> 172.21.15.5:0/2480729496 conn(0x7f0c780b0490 msgr2=0x7f0c780b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:38.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.780+0000 7f0c7f6ca640 1 -- 172.21.15.5:0/2480729496 shutdown_connections 2023-07-14T13:32:38.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.780+0000 7f0c7f6ca640 1 -- 172.21.15.5:0/2480729496 wait complete. 2023-07-14T13:32:38.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.780+0000 7f0c7f6ca640 1 Processor -- start 2023-07-14T13:32:38.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.780+0000 7f0c7f6ca640 1 -- start start 2023-07-14T13:32:38.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.784+0000 7f0c7f6ca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c7806cc80 0x7f0c7815b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:38.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.784+0000 7f0c7f6ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c7806fcf0 0x7f0c7814e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:38.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.784+0000 7f0c7f6ca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c7815bd50 0x7f0c78159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:38.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.784+0000 7f0c7f6ca640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c780b1ae0 con 0x7f0c7806cc80 2023-07-14T13:32:38.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.784+0000 7f0c7f6ca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c780b1dc0 con 0x7f0c7815bd50 2023-07-14T13:32:38.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.784+0000 7f0c7f6ca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c781597f0 con 0x7f0c7806fcf0 2023-07-14T13:32:38.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.784+0000 7f0c7d466640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c7806cc80 0x7f0c7815b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:38.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.784+0000 7f0c7d466640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c7806cc80 0x7f0c7815b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40098/0 (socket says 172.21.15.5:40098) 2023-07-14T13:32:38.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.784+0000 7f0c7d466640 1 -- 172.21.15.5:0/3200530785 learned_addr learned my addr 172.21.15.5:0/3200530785 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:38.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.784+0000 7f0c7cc65640 1 --2- 172.21.15.5:0/3200530785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c7806fcf0 0x7f0c7814e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:38.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.784+0000 7f0c7dc67640 1 --2- 172.21.15.5:0/3200530785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c7815bd50 0x7f0c78159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:38.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.784+0000 7f0c7d466640 1 -- 172.21.15.5:0/3200530785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c7806fcf0 msgr2=0x7f0c7814e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:38.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.784+0000 7f0c7d466640 1 --2- 172.21.15.5:0/3200530785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c7806fcf0 0x7f0c7814e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:38.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.784+0000 7f0c7d466640 1 -- 172.21.15.5:0/3200530785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c7815bd50 msgr2=0x7f0c78159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:38.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.784+0000 7f0c7d466640 1 --2- 172.21.15.5:0/3200530785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c7815bd50 0x7f0c78159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:38.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.784+0000 7f0c7d466640 1 -- 172.21.15.5:0/3200530785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c680094d0 con 0x7f0c7806cc80 2023-07-14T13:32:38.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.784+0000 7f0c7dc67640 1 --2- 172.21.15.5:0/3200530785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c7815bd50 0x7f0c78159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:38.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.784+0000 7f0c7d466640 1 --2- 172.21.15.5:0/3200530785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c7806cc80 0x7f0c7815b2f0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f0c7400c430 tx=0x7f0c7400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:38.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.784+0000 7f0c6dffb640 1 -- 172.21.15.5:0/3200530785 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c740074e0 con 0x7f0c7806cc80 2023-07-14T13:32:38.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.784+0000 7f0c6dffb640 1 -- 172.21.15.5:0/3200530785 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c74007640 con 0x7f0c7806cc80 2023-07-14T13:32:38.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.784+0000 7f0c6dffb640 1 -- 172.21.15.5:0/3200530785 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c74004a10 con 0x7f0c7806cc80 2023-07-14T13:32:38.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.784+0000 7f0c7f6ca640 1 -- 172.21.15.5:0/3200530785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c78159ad0 con 0x7f0c7806cc80 2023-07-14T13:32:38.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.784+0000 7f0c7f6ca640 1 -- 172.21.15.5:0/3200530785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c7814ed60 con 0x7f0c7806cc80 2023-07-14T13:32:38.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.784+0000 7f0c7f6ca640 1 -- 172.21.15.5:0/3200530785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c780678d0 con 0x7f0c7806cc80 2023-07-14T13:32:38.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.784+0000 7f0c6dffb640 1 -- 172.21.15.5:0/3200530785 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 95) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0c74004b70 con 0x7f0c7806cc80 2023-07-14T13:32:38.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.788+0000 7f0c6dffb640 1 --2- 172.21.15.5:0/3200530785 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f0c5c0663a0 0x7f0c5c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:38.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.788+0000 7f0c6dffb640 1 -- 172.21.15.5:0/3200530785 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f0c74083940 con 0x7f0c7806cc80 2023-07-14T13:32:38.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.788+0000 7f0c7cc65640 1 --2- 172.21.15.5:0/3200530785 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f0c5c0663a0 0x7f0c5c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:38.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.788+0000 7f0c7cc65640 1 --2- 172.21.15.5:0/3200530785 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f0c5c0663a0 0x7f0c5c068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0c680ae000 tx=0x7f0c680b3040 comp rx=0 tx=0).ready entity=mgr.8477 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:38.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.792+0000 7f0c6dffb640 1 -- 172.21.15.5:0/3200530785 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f0c74050b70 con 0x7f0c7806cc80 2023-07-14T13:32:38.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:38.980+0000 7f0c7f6ca640 1 -- 172.21.15.5:0/3200530785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f0c78070cb0 con 0x7f0c7806cc80 2023-07-14T13:32:39.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.276+0000 7f0c6dffb640 1 -- 172.21.15.5:0/3200530785 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 96) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f0c74050f40 con 0x7f0c7806cc80 2023-07-14T13:32:39.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.276+0000 7f0c6dffb640 1 -- 172.21.15.5:0/3200530785 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v96) v1 ==== 92+0+0 (secure 0 0 0) 0x7f0c74050b70 con 0x7f0c7806cc80 2023-07-14T13:32:39.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.280+0000 7f0c7f6ca640 1 -- 172.21.15.5:0/3200530785 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f0c5c0663a0 msgr2=0x7f0c5c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:39.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.280+0000 7f0c7f6ca640 1 --2- 172.21.15.5:0/3200530785 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f0c5c0663a0 0x7f0c5c068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0c680ae000 tx=0x7f0c680b3040 comp rx=0 tx=0).stop 2023-07-14T13:32:39.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.280+0000 7f0c7f6ca640 1 -- 172.21.15.5:0/3200530785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c7806cc80 msgr2=0x7f0c7815b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:39.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.280+0000 7f0c7f6ca640 1 --2- 172.21.15.5:0/3200530785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c7806cc80 0x7f0c7815b2f0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f0c7400c430 tx=0x7f0c7400c8f0 comp rx=0 tx=0).stop 2023-07-14T13:32:39.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.280+0000 7f0c7f6ca640 1 -- 172.21.15.5:0/3200530785 shutdown_connections 2023-07-14T13:32:39.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.280+0000 7f0c7f6ca640 1 --2- 172.21.15.5:0/3200530785 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f0c5c0663a0 0x7f0c5c068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:39.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.280+0000 7f0c7f6ca640 1 --2- 172.21.15.5:0/3200530785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c7815bd50 0x7f0c78159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:39.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.280+0000 7f0c7f6ca640 1 --2- 172.21.15.5:0/3200530785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0c7806fcf0 0x7f0c7814e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:39.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.280+0000 7f0c7f6ca640 1 --2- 172.21.15.5:0/3200530785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c7806cc80 0x7f0c7815b2f0 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:39.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.280+0000 7f0c7f6ca640 1 -- 172.21.15.5:0/3200530785 >> 172.21.15.5:0/3200530785 conn(0x7f0c780b0490 msgr2=0x7f0c7806a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:39.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.280+0000 7f0c7f6ca640 1 -- 172.21.15.5:0/3200530785 shutdown_connections 2023-07-14T13:32:39.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.280+0000 7f0c7f6ca640 1 -- 172.21.15.5:0/3200530785 wait complete. 2023-07-14T13:32:39.303 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-14T13:32:39.455 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:39.455+0000 7ff7c31d4180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:32:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.456+0000 7f3eeaaec640 1 Processor -- start 2023-07-14T13:32:39.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.456+0000 7f3eeaaec640 1 -- start start 2023-07-14T13:32:39.457 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:39.456+0000 7efd0ce46180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:32:39.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.456+0000 7f3eeaaec640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3ee4070f30 0x7f3ee40ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:39.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.456+0000 7f3eeaaec640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee4159d70 con 0x7f3ee4069430 2023-07-14T13:32:39.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.456+0000 7f3eeaaec640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee40c9c60 con 0x7f3ee40af2b0 2023-07-14T13:32:39.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.456+0000 7f3eeaaec640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee40c9f40 con 0x7f3ee4070f30 2023-07-14T13:32:39.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.456+0000 7f3ee3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3ee4070f30 0x7f3ee40ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:39.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.456+0000 7f3ee8888640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3ee4069430 0x7f3ee4069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47846/0 (socket says 172.21.15.5:47846) 2023-07-14T13:32:39.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.456+0000 7f3ee8888640 1 -- 172.21.15.5:0/2168980551 learned_addr learned my addr 172.21.15.5:0/2168980551 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:39.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.456+0000 7f3ee3fff640 1 -- 172.21.15.5:0/2168980551 >> v1:172.21.15.154:6789/0 conn(0x7f3ee40af2b0 legacy=0x7f3ee415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:39.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.456+0000 7f3ee3fff640 1 -- 172.21.15.5:0/2168980551 >> v1:172.21.15.5:6789/0 conn(0x7f3ee4069430 legacy=0x7f3ee4069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:39.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.456+0000 7f3ee3fff640 1 -- 172.21.15.5:0/2168980551 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee40ca220 con 0x7f3ee4070f30 2023-07-14T13:32:39.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.456+0000 7f3ee37fe640 1 -- 172.21.15.5:0/2168980551 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2868762325 0 0) 0x7f3ed8001120 con 0x7f3ee4069430 2023-07-14T13:32:39.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.460+0000 7f3ee3fff640 1 --2- 172.21.15.5:0/2168980551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ee4070f30 0x7f3ee40ad6f0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00097c0 tx=0x7f3ed001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecffcc8ee7a21393 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:39.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.460+0000 7f3ee37fe640 1 -- 172.21.15.5:0/2168980551 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed00ab680 con 0x7f3ee4070f30 2023-07-14T13:32:39.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.460+0000 7f3ee37fe640 1 -- 172.21.15.5:0/2168980551 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed00ab7e0 con 0x7f3ee4070f30 2023-07-14T13:32:39.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.460+0000 7f3ee37fe640 1 -- 172.21.15.5:0/2168980551 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed00abb70 con 0x7f3ee4070f30 2023-07-14T13:32:39.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.460+0000 7f3eeaaec640 1 -- 172.21.15.5:0/2168980551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ee4070f30 msgr2=0x7f3ee40ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:39.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.460+0000 7f3eeaaec640 1 --2- 172.21.15.5:0/2168980551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ee4070f30 0x7f3ee40ad6f0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00097c0 tx=0x7f3ed001c480 comp rx=0 tx=0).stop 2023-07-14T13:32:39.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.460+0000 7f3eeaaec640 1 -- 172.21.15.5:0/2168980551 shutdown_connections 2023-07-14T13:32:39.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.460+0000 7f3eeaaec640 1 --2- 172.21.15.5:0/2168980551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ee4070f30 0x7f3ee40ad6f0 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:39.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.460+0000 7f3eeaaec640 1 -- 172.21.15.5:0/2168980551 >> 172.21.15.5:0/2168980551 conn(0x7f3ee40cde90 msgr2=0x7f3ee40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:39.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.460+0000 7f3eeaaec640 1 -- 172.21.15.5:0/2168980551 shutdown_connections 2023-07-14T13:32:39.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.460+0000 7f3eeaaec640 1 -- 172.21.15.5:0/2168980551 wait complete. 2023-07-14T13:32:39.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.464+0000 7f3eeaaec640 1 Processor -- start 2023-07-14T13:32:39.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.464+0000 7f3eeaaec640 1 -- start start 2023-07-14T13:32:39.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.464+0000 7f3eeaaec640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ee4069430 0x7f3ee40cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:39.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.464+0000 7f3eeaaec640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ee4070f30 0x7f3ee406c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:39.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.464+0000 7f3eeaaec640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ee40af2b0 0x7f3ee40c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:39.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.464+0000 7f3eeaaec640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee4149210 con 0x7f3ee40af2b0 2023-07-14T13:32:39.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.464+0000 7f3eeaaec640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40ca870 con 0x7f3ee4069430 2023-07-14T13:32:39.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.464+0000 7f3eeaaec640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40cb6d0 con 0x7f3ee4070f30 2023-07-14T13:32:39.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.464+0000 7f3ee8888640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ee4069430 0x7f3ee40cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:39.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.464+0000 7f3ee9089640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ee40af2b0 0x7f3ee40c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:39.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.464+0000 7f3ee3fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ee4070f30 0x7f3ee406c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:39.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.464+0000 7f3ee8888640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ee4069430 0x7f3ee40cbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:58628/0 (socket says 172.21.15.5:58628) 2023-07-14T13:32:39.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.464+0000 7f3ee8888640 1 -- 172.21.15.5:0/3878999148 learned_addr learned my addr 172.21.15.5:0/3878999148 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:39.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.464+0000 7f3ee8888640 1 -- 172.21.15.5:0/3878999148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ee4070f30 msgr2=0x7f3ee406c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:39.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.464+0000 7f3ee8888640 1 --2- 172.21.15.5:0/3878999148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ee4070f30 0x7f3ee406c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:39.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.464+0000 7f3ee8888640 1 -- 172.21.15.5:0/3878999148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ee40af2b0 msgr2=0x7f3ee40c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:39.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.464+0000 7f3ee8888640 1 --2- 172.21.15.5:0/3878999148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ee40af2b0 0x7f3ee40c74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:39.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.464+0000 7f3ee8888640 1 -- 172.21.15.5:0/3878999148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed0009420 con 0x7f3ee4069430 2023-07-14T13:32:39.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.464+0000 7f3ee8888640 1 --2- 172.21.15.5:0/3878999148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ee4069430 0x7f3ee40cbb60 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800c410 tx=0x7f3ed800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:39.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.464+0000 7f3ee17fa640 1 -- 172.21.15.5:0/3878999148 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed80074e0 con 0x7f3ee4069430 2023-07-14T13:32:39.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.464+0000 7f3ee17fa640 1 -- 172.21.15.5:0/3878999148 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed8007640 con 0x7f3ee4069430 2023-07-14T13:32:39.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.464+0000 7f3ee17fa640 1 -- 172.21.15.5:0/3878999148 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8004a30 con 0x7f3ee4069430 2023-07-14T13:32:39.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.464+0000 7f3eeaaec640 1 -- 172.21.15.5:0/3878999148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee40caac0 con 0x7f3ee4069430 2023-07-14T13:32:39.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.464+0000 7f3eeaaec640 1 -- 172.21.15.5:0/3878999148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee40cb080 con 0x7f3ee4069430 2023-07-14T13:32:39.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.468+0000 7f3eeaaec640 1 -- 172.21.15.5:0/3878999148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee40678d0 con 0x7f3ee4069430 2023-07-14T13:32:39.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.468+0000 7f3ee17fa640 1 -- 172.21.15.5:0/3878999148 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 96) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f3ed8004b90 con 0x7f3ee4069430 2023-07-14T13:32:39.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.468+0000 7f3ee17fa640 1 --2- 172.21.15.5:0/3878999148 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f3ec80663f0 0x7f3ec80688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:39.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.468+0000 7f3ee17fa640 1 -- 172.21.15.5:0/3878999148 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f3ed8083ab0 con 0x7f3ee4069430 2023-07-14T13:32:39.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.468+0000 7f3ee3fff640 1 -- 172.21.15.5:0/3878999148 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f3ec80663f0 msgr2=0x7f3ec80688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/2194391064 2023-07-14T13:32:39.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.468+0000 7f3ee3fff640 1 --2- 172.21.15.5:0/3878999148 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f3ec80663f0 0x7f3ec80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:32:39.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.476+0000 7f3ee17fa640 1 -- 172.21.15.5:0/3878999148 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3ed8050ea0 con 0x7f3ee4069430 2023-07-14T13:32:39.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.636+0000 7f3eeaaec640 1 -- 172.21.15.5:0/3878999148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f3ee4159d70 con 0x7f3ee4069430 2023-07-14T13:32:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.644+0000 7f3ee17fa640 1 -- 172.21.15.5:0/3878999148 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v65)=0 v65) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3ee4159d70 con 0x7f3ee4069430 2023-07-14T13:32:39.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.644+0000 7f3eeaaec640 1 -- 172.21.15.5:0/3878999148 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f3ec80663f0 msgr2=0x7f3ec80688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:32:39.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.644+0000 7f3eeaaec640 1 --2- 172.21.15.5:0/3878999148 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f3ec80663f0 0x7f3ec80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:39.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.644+0000 7f3eeaaec640 1 -- 172.21.15.5:0/3878999148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ee4069430 msgr2=0x7f3ee40cbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:39.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.644+0000 7f3eeaaec640 1 --2- 172.21.15.5:0/3878999148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ee4069430 0x7f3ee40cbb60 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800c410 tx=0x7f3ed800c8d0 comp rx=0 tx=0).stop 2023-07-14T13:32:39.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.644+0000 7f3eeaaec640 1 -- 172.21.15.5:0/3878999148 shutdown_connections 2023-07-14T13:32:39.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.644+0000 7f3eeaaec640 1 --2- 172.21.15.5:0/3878999148 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f3ec80663f0 0x7f3ec80688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.644+0000 7f3eeaaec640 1 --2- 172.21.15.5:0/3878999148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ee40af2b0 0x7f3ee40c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.644+0000 7f3eeaaec640 1 --2- 172.21.15.5:0/3878999148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ee4070f30 0x7f3ee406c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.644+0000 7f3eeaaec640 1 --2- 172.21.15.5:0/3878999148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ee4069430 0x7f3ee40cbb60 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.644+0000 7f3eeaaec640 1 -- 172.21.15.5:0/3878999148 >> 172.21.15.5:0/3878999148 conn(0x7f3ee40cde90 msgr2=0x7f3ee414f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.644+0000 7f3eeaaec640 1 -- 172.21.15.5:0/3878999148 shutdown_connections 2023-07-14T13:32:39.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.644+0000 7f3eeaaec640 1 -- 172.21.15.5:0/3878999148 wait complete. 2023-07-14T13:32:39.666 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-14T13:32:39.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.812+0000 7f7321ef9640 1 Processor -- start 2023-07-14T13:32:39.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.812+0000 7f7321ef9640 1 -- start start 2023-07-14T13:32:39.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.816+0000 7f7321ef9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f731c15bde0 0x7f731c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:39.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.816+0000 7f7321ef9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f731c0d2fc0 0x7f731c0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:39.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.816+0000 7f7321ef9640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f731c0d2300 0x7f731c0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:39.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.816+0000 7f7321ef9640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f731c0d2ce0 con 0x7f731c0d2300 2023-07-14T13:32:39.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.816+0000 7f7321ef9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f731c15c1b0 con 0x7f731c15bde0 2023-07-14T13:32:39.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.816+0000 7f7321ef9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731c0b04c0 con 0x7f731c0d2fc0 2023-07-14T13:32:39.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.816+0000 7f731bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f731c0d2300 0x7f731c0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:39.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.816+0000 7f731bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f731c0d2300 0x7f731c0d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36556/0 (socket says 172.21.15.5:36556) 2023-07-14T13:32:39.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.816+0000 7f731bfff640 1 -- 172.21.15.5:0/581971072 learned_addr learned my addr 172.21.15.5:0/581971072 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:39.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.816+0000 7f7313fff640 1 --2- 172.21.15.5:0/581971072 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f731c0d2fc0 0x7f731c0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:39.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.816+0000 7f731b7fe640 1 --2- 172.21.15.5:0/581971072 >> v2:172.21.15.154:3300/0 conn(0x7f731c15bde0 0x7f731c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:39.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.816+0000 7f731bfff640 1 -- 172.21.15.5:0/581971072 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f731c0d2fc0 msgr2=0x7f731c0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:39.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.816+0000 7f731bfff640 1 --2- 172.21.15.5:0/581971072 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f731c0d2fc0 0x7f731c0b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:39.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.816+0000 7f731bfff640 1 -- 172.21.15.5:0/581971072 >> v2:172.21.15.154:3300/0 conn(0x7f731c15bde0 msgr2=0x7f731c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:39.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.816+0000 7f731bfff640 1 --2- 172.21.15.5:0/581971072 >> v2:172.21.15.154:3300/0 conn(0x7f731c15bde0 0x7f731c0d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:39.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.816+0000 7f731bfff640 1 -- 172.21.15.5:0/581971072 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731c0d0aa0 con 0x7f731c0d2300 2023-07-14T13:32:39.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.816+0000 7f731bfff640 1 --2- 172.21.15.5:0/581971072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f731c0d2300 0x7f731c0d27a0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f731c08b210 tx=0x7f731401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6f4621c71183fa server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:39.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.820+0000 7f731affd640 1 -- 172.21.15.5:0/581971072 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73140a5850 con 0x7f731c0d2300 2023-07-14T13:32:39.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.820+0000 7f731affd640 1 -- 172.21.15.5:0/581971072 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73140a59b0 con 0x7f731c0d2300 2023-07-14T13:32:39.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.820+0000 7f731affd640 1 -- 172.21.15.5:0/581971072 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73140a5d40 con 0x7f731c0d2300 2023-07-14T13:32:39.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.820+0000 7f7321ef9640 1 -- 172.21.15.5:0/581971072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f731c0d2300 msgr2=0x7f731c0d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:39.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.820+0000 7f7321ef9640 1 --2- 172.21.15.5:0/581971072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f731c0d2300 0x7f731c0d27a0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f731c08b210 tx=0x7f731401c9d0 comp rx=0 tx=0).stop 2023-07-14T13:32:39.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.820+0000 7f7321ef9640 1 -- 172.21.15.5:0/581971072 shutdown_connections 2023-07-14T13:32:39.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.820+0000 7f7321ef9640 1 --2- 172.21.15.5:0/581971072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f731c0d2300 0x7f731c0d27a0 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:39.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.820+0000 7f7321ef9640 1 --2- 172.21.15.5:0/581971072 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f731c0d2fc0 0x7f731c0b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:39.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.820+0000 7f7321ef9640 1 --2- 172.21.15.5:0/581971072 >> v2:172.21.15.154:3300/0 conn(0x7f731c15bde0 0x7f731c0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:39.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.820+0000 7f7321ef9640 1 -- 172.21.15.5:0/581971072 >> 172.21.15.5:0/581971072 conn(0x7f731c0659d0 msgr2=0x7f731c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:39.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.820+0000 7f7321ef9640 1 -- 172.21.15.5:0/581971072 shutdown_connections 2023-07-14T13:32:39.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.820+0000 7f7321ef9640 1 -- 172.21.15.5:0/581971072 wait complete. 2023-07-14T13:32:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.820+0000 7f7321ef9640 1 Processor -- start 2023-07-14T13:32:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.820+0000 7f7321ef9640 1 -- start start 2023-07-14T13:32:39.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.820+0000 7f7321ef9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f731c0d2300 0x7f731c150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:39.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.820+0000 7f7321ef9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f731c0d2fc0 0x7f731c0b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:39.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.820+0000 7f7321ef9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f731c15bde0 0x7f731c0c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:39.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.820+0000 7f7321ef9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731c0b36f0 con 0x7f731c15bde0 2023-07-14T13:32:39.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.820+0000 7f7321ef9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731c0b1750 con 0x7f731c0d2300 2023-07-14T13:32:39.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.820+0000 7f7321ef9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731c0c64e0 con 0x7f731c0d2fc0 2023-07-14T13:32:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.824+0000 7f731bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f731c15bde0 0x7f731c0c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.824+0000 7f731b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f731c0d2300 0x7f731c150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.824+0000 7f731b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f731c0d2300 0x7f731c150fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:58636/0 (socket says 172.21.15.5:58636) 2023-07-14T13:32:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.824+0000 7f731b7fe640 1 -- 172.21.15.5:0/3984738034 learned_addr learned my addr 172.21.15.5:0/3984738034 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.824+0000 7f7313fff640 1 --2- 172.21.15.5:0/3984738034 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f731c0d2fc0 0x7f731c0b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.824+0000 7f731bfff640 1 -- 172.21.15.5:0/3984738034 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f731c0d2fc0 msgr2=0x7f731c0b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.824+0000 7f731bfff640 1 --2- 172.21.15.5:0/3984738034 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f731c0d2fc0 0x7f731c0b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:39.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.824+0000 7f731bfff640 1 -- 172.21.15.5:0/3984738034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f731c0d2300 msgr2=0x7f731c150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:39.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.824+0000 7f731bfff640 1 --2- 172.21.15.5:0/3984738034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f731c0d2300 0x7f731c150fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:39.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.824+0000 7f731bfff640 1 -- 172.21.15.5:0/3984738034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7314009b30 con 0x7f731c15bde0 2023-07-14T13:32:39.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.824+0000 7f7313fff640 1 --2- 172.21.15.5:0/3984738034 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f731c0d2fc0 0x7f731c0b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:32:39.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.824+0000 7f731b7fe640 1 --2- 172.21.15.5:0/3984738034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f731c0d2300 0x7f731c150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:32:39.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.824+0000 7f731bfff640 1 --2- 172.21.15.5:0/3984738034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f731c15bde0 0x7f731c0c8520 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f73140ab000 tx=0x7f7314019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:39.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.824+0000 7f7318ff9640 1 -- 172.21.15.5:0/3984738034 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73140bd070 con 0x7f731c15bde0 2023-07-14T13:32:39.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.824+0000 7f7318ff9640 1 -- 172.21.15.5:0/3984738034 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7314009510 con 0x7f731c15bde0 2023-07-14T13:32:39.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.824+0000 7f7318ff9640 1 -- 172.21.15.5:0/3984738034 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73140b8690 con 0x7f731c15bde0 2023-07-14T13:32:39.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.824+0000 7f7321ef9640 1 -- 172.21.15.5:0/3984738034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f731c0b3900 con 0x7f731c15bde0 2023-07-14T13:32:39.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.824+0000 7f7321ef9640 1 -- 172.21.15.5:0/3984738034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731c0b3ec0 con 0x7f731c15bde0 2023-07-14T13:32:39.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.824+0000 7f7321ef9640 1 -- 172.21.15.5:0/3984738034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731c0b40b0 con 0x7f731c15bde0 2023-07-14T13:32:39.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.824+0000 7f7318ff9640 1 -- 172.21.15.5:0/3984738034 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 96) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f73140b87f0 con 0x7f731c15bde0 2023-07-14T13:32:39.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.828+0000 7f7318ff9640 1 --2- 172.21.15.5:0/3984738034 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f72fc0663f0 0x7f72fc0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:39.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.828+0000 7f7318ff9640 1 -- 172.21.15.5:0/3984738034 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f731411e8e0 con 0x7f731c15bde0 2023-07-14T13:32:39.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.828+0000 7f731b7fe640 1 -- 172.21.15.5:0/3984738034 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f72fc0663f0 msgr2=0x7f72fc0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/2194391064 2023-07-14T13:32:39.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.828+0000 7f731b7fe640 1 --2- 172.21.15.5:0/3984738034 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f72fc0663f0 0x7f72fc0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:32:39.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.832+0000 7f7318ff9640 1 -- 172.21.15.5:0/3984738034 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f73140ebc40 con 0x7f731c15bde0 2023-07-14T13:32:39.871 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:39.871+0000 7ff7c31d4180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:32:39.910 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:39.908+0000 7efd0ce46180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:32:39.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.992+0000 7f7321ef9640 1 -- 172.21.15.5:0/3984738034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f731c0678d0 con 0x7f731c15bde0 2023-07-14T13:32:39.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.996+0000 7f7318ff9640 1 -- 172.21.15.5:0/3984738034 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v66)=0 v66) v1 ==== 133+0+0 (secure 0 0 0) 0x7f73140ef260 con 0x7f731c15bde0 2023-07-14T13:32:39.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.996+0000 7f7321ef9640 1 -- 172.21.15.5:0/3984738034 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f72fc0663f0 msgr2=0x7f72fc0688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:32:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.996+0000 7f7321ef9640 1 --2- 172.21.15.5:0/3984738034 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f72fc0663f0 0x7f72fc0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.996+0000 7f7321ef9640 1 -- 172.21.15.5:0/3984738034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f731c15bde0 msgr2=0x7f731c0c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.996+0000 7f7321ef9640 1 --2- 172.21.15.5:0/3984738034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f731c15bde0 0x7f731c0c8520 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f73140ab000 tx=0x7f7314019770 comp rx=0 tx=0).stop 2023-07-14T13:32:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.996+0000 7f7321ef9640 1 -- 172.21.15.5:0/3984738034 shutdown_connections 2023-07-14T13:32:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.996+0000 7f7321ef9640 1 --2- 172.21.15.5:0/3984738034 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7f72fc0663f0 0x7f72fc0688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:39.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.996+0000 7f7321ef9640 1 --2- 172.21.15.5:0/3984738034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f731c15bde0 0x7f731c0c8520 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.996+0000 7f7321ef9640 1 --2- 172.21.15.5:0/3984738034 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f731c0d2fc0 0x7f731c0b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.996+0000 7f7321ef9640 1 --2- 172.21.15.5:0/3984738034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f731c0d2300 0x7f731c150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.996+0000 7f7321ef9640 1 -- 172.21.15.5:0/3984738034 >> 172.21.15.5:0/3984738034 conn(0x7f731c0659d0 msgr2=0x7f731c15a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.996+0000 7f7321ef9640 1 -- 172.21.15.5:0/3984738034 shutdown_connections 2023-07-14T13:32:40.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:39.996+0000 7f7321ef9640 1 -- 172.21.15.5:0/3984738034 wait complete. 2023-07-14T13:32:40.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:40.019 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-14T13:32:40.024 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:40.023+0000 7ff7c31d4180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:32:40.033 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-07-14T13:32:40.073 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:40.072+0000 7efd0ce46180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:32:40.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.220+0000 7fdafa648640 1 Processor -- start 2023-07-14T13:32:40.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.220+0000 7fdafa648640 1 -- start start 2023-07-14T13:32:40.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.224+0000 7fdafa648640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf415bde0 0x7fdaf40d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:40.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.224+0000 7fdafa648640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdaf40d2fc0 0x7fdaf40b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:40.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.224+0000 7fdafa648640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf40b04c0 con 0x7fdaf40d2300 2023-07-14T13:32:40.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.224+0000 7fdafa648640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf415c1b0 con 0x7fdaf40d2fc0 2023-07-14T13:32:40.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.224+0000 7fdafa648640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf40d0aa0 con 0x7fdaf415bde0 2023-07-14T13:32:40.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.224+0000 7fdaf8be5640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdaf40d2300 0x7fdaf40cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47862/0 (socket says 172.21.15.5:47862) 2023-07-14T13:32:40.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.224+0000 7fdaf8be5640 1 -- 172.21.15.5:0/862365858 learned_addr learned my addr 172.21.15.5:0/862365858 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:40.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.224+0000 7fdaf3fff640 1 --2- 172.21.15.5:0/862365858 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf415bde0 0x7fdaf40d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:40.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.224+0000 7fdaf37fe640 1 --2- 172.21.15.5:0/862365858 >> v2:172.21.15.154:3300/0 conn(0x7fdaf40d2fc0 0x7fdaf40b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:40.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.224+0000 7fdaf2ffd640 1 -- 172.21.15.5:0/862365858 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2762670843 0 0) 0x7fdaf40b04c0 con 0x7fdaf40d2300 2023-07-14T13:32:40.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.224+0000 7fdaf3fff640 1 -- 172.21.15.5:0/862365858 >> v2:172.21.15.154:3300/0 conn(0x7fdaf40d2fc0 msgr2=0x7fdaf40b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:40.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.224+0000 7fdaf3fff640 1 --2- 172.21.15.5:0/862365858 >> v2:172.21.15.154:3300/0 conn(0x7fdaf40d2fc0 0x7fdaf40b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:40.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.224+0000 7fdaf3fff640 1 -- 172.21.15.5:0/862365858 >> v1:172.21.15.5:6789/0 conn(0x7fdaf40d2300 legacy=0x7fdaf40cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:40.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.224+0000 7fdaf3fff640 1 -- 172.21.15.5:0/862365858 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf40afb90 con 0x7fdaf415bde0 2023-07-14T13:32:40.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.228+0000 7fdaf3fff640 1 --2- 172.21.15.5:0/862365858 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf415bde0 0x7fdaf40d0270 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdae40097a0 tx=0x7fdae401c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c686f538728227f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:40.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.228+0000 7fdaf2ffd640 1 -- 172.21.15.5:0/862365858 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae40ab660 con 0x7fdaf415bde0 2023-07-14T13:32:40.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.228+0000 7fdaf2ffd640 1 -- 172.21.15.5:0/862365858 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae40ab7c0 con 0x7fdaf415bde0 2023-07-14T13:32:40.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.228+0000 7fdaf2ffd640 1 -- 172.21.15.5:0/862365858 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae40abb50 con 0x7fdaf415bde0 2023-07-14T13:32:40.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.228+0000 7fdafa648640 1 -- 172.21.15.5:0/862365858 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf415bde0 msgr2=0x7fdaf40d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:40.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.228+0000 7fdafa648640 1 --2- 172.21.15.5:0/862365858 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf415bde0 0x7fdaf40d0270 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdae40097a0 tx=0x7fdae401c460 comp rx=0 tx=0).stop 2023-07-14T13:32:40.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.228+0000 7fdafa648640 1 -- 172.21.15.5:0/862365858 shutdown_connections 2023-07-14T13:32:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.228+0000 7fdafa648640 1 --2- 172.21.15.5:0/862365858 >> v2:172.21.15.154:3300/0 conn(0x7fdaf40d2fc0 0x7fdaf40b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.228+0000 7fdafa648640 1 --2- 172.21.15.5:0/862365858 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf415bde0 0x7fdaf40d0270 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.228+0000 7fdafa648640 1 -- 172.21.15.5:0/862365858 >> 172.21.15.5:0/862365858 conn(0x7fdaf40659d0 msgr2=0x7fdaf409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:40.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.228+0000 7fdafa648640 1 -- 172.21.15.5:0/862365858 shutdown_connections 2023-07-14T13:32:40.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.228+0000 7fdafa648640 1 -- 172.21.15.5:0/862365858 wait complete. 2023-07-14T13:32:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.228+0000 7fdafa648640 1 Processor -- start 2023-07-14T13:32:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.232+0000 7fdafa648640 1 -- start start 2023-07-14T13:32:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.232+0000 7fdafa648640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaf40d2300 0x7fdaf4152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.232+0000 7fdafa648640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf40d2fc0 0x7fdaf4158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.232+0000 7fdafa648640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaf415bde0 0x7fdaf414f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.232+0000 7fdafa648640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf40b6930 con 0x7fdaf40d2300 2023-07-14T13:32:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.232+0000 7fdafa648640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf40b6c10 con 0x7fdaf415bde0 2023-07-14T13:32:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.232+0000 7fdafa648640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf40b6ef0 con 0x7fdaf40d2fc0 2023-07-14T13:32:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.232+0000 7fdaf3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaf40d2300 0x7fdaf4152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.232+0000 7fdaf3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaf40d2300 0x7fdaf4152e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36568/0 (socket says 172.21.15.5:36568) 2023-07-14T13:32:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.232+0000 7fdaf3fff640 1 -- 172.21.15.5:0/2028932673 learned_addr learned my addr 172.21.15.5:0/2028932673 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:40.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.232+0000 7fdaf37fe640 1 --2- 172.21.15.5:0/2028932673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf40d2fc0 0x7fdaf4158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:40.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.232+0000 7fdaf8be5640 1 --2- 172.21.15.5:0/2028932673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaf415bde0 0x7fdaf414f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:40.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.232+0000 7fdaf3fff640 1 -- 172.21.15.5:0/2028932673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf40d2fc0 msgr2=0x7fdaf4158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:40.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.232+0000 7fdaf3fff640 1 --2- 172.21.15.5:0/2028932673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdaf40d2fc0 0x7fdaf4158640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:40.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.232+0000 7fdaf3fff640 1 -- 172.21.15.5:0/2028932673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaf415bde0 msgr2=0x7fdaf414f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:40.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.232+0000 7fdaf3fff640 1 --2- 172.21.15.5:0/2028932673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdaf415bde0 0x7fdaf414f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:40.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.232+0000 7fdaf3fff640 1 -- 172.21.15.5:0/2028932673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae40093b0 con 0x7fdaf40d2300 2023-07-14T13:32:40.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.232+0000 7fdaf3fff640 1 --2- 172.21.15.5:0/2028932673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaf40d2300 0x7fdaf4152e80 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fdae40ad040 tx=0x7fdae4019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:40.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.232+0000 7fdaf0ff9640 1 -- 172.21.15.5:0/2028932673 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae40abe80 con 0x7fdaf40d2300 2023-07-14T13:32:40.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.232+0000 7fdaf0ff9640 1 -- 172.21.15.5:0/2028932673 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae40059a0 con 0x7fdaf40d2300 2023-07-14T13:32:40.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.232+0000 7fdafa648640 1 -- 172.21.15.5:0/2028932673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf40b71d0 con 0x7fdaf40d2300 2023-07-14T13:32:40.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.232+0000 7fdaf0ff9640 1 -- 172.21.15.5:0/2028932673 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae4005d50 con 0x7fdaf40d2300 2023-07-14T13:32:40.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.232+0000 7fdafa648640 1 -- 172.21.15.5:0/2028932673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf4153da0 con 0x7fdaf40d2300 2023-07-14T13:32:40.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.232+0000 7fdafa648640 1 -- 172.21.15.5:0/2028932673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf40678d0 con 0x7fdaf40d2300 2023-07-14T13:32:40.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.236+0000 7fdaf0ff9640 1 -- 172.21.15.5:0/2028932673 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 96) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fdae40a9070 con 0x7fdaf40d2300 2023-07-14T13:32:40.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.236+0000 7fdaf0ff9640 1 --2- 172.21.15.5:0/2028932673 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fdae0066420 0x7fdae00688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:40.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.236+0000 7fdaf0ff9640 1 -- 172.21.15.5:0/2028932673 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fdae411e530 con 0x7fdaf40d2300 2023-07-14T13:32:40.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.236+0000 7fdaf37fe640 1 -- 172.21.15.5:0/2028932673 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fdae0066420 msgr2=0x7fdae00688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/2194391064 2023-07-14T13:32:40.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.236+0000 7fdaf37fe640 1 --2- 172.21.15.5:0/2028932673 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fdae0066420 0x7fdae00688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:32:40.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.240+0000 7fdaf0ff9640 1 -- 172.21.15.5:0/2028932673 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fdae40eb880 con 0x7fdaf40d2300 2023-07-14T13:32:40.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.416+0000 7fdafa648640 1 -- 172.21.15.5:0/2028932673 --> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fdaf40b6d80 con 0x7fdae0066420 2023-07-14T13:32:40.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.440+0000 7fdaf37fe640 1 -- 172.21.15.5:0/2028932673 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fdae0066420 msgr2=0x7fdae00688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/2194391064 2023-07-14T13:32:40.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.440+0000 7fdaf37fe640 1 --2- 172.21.15.5:0/2028932673 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fdae0066420 0x7fdae00688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-14T13:32:40.507 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:40.507+0000 7ff7c31d4180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:32:40.566 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:40.567+0000 7ff7c31d4180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:32:40.591 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:40.592+0000 7efd0ce46180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:32:40.621 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:40.623+0000 7ff7c31d4180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:32:40.654 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:40.652+0000 7efd0ce46180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:32:40.707 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:40.707+0000 7ff7c31d4180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:32:40.713 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:40.712+0000 7efd0ce46180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:32:40.765 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:40.767+0000 7ff7c31d4180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:32:40.806 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:40.804+0000 7efd0ce46180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:32:40.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.844+0000 7fdaf37fe640 1 -- 172.21.15.5:0/2028932673 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fdae0066420 msgr2=0x7fdae00688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/2194391064 2023-07-14T13:32:40.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:40.844+0000 7fdaf37fe640 1 --2- 172.21.15.5:0/2028932673 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fdae0066420 0x7fdae00688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-14T13:32:40.850 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:40.851+0000 7ff7c31d4180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:32:40.865 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:40.864+0000 7efd0ce46180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:32:40.907 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:40.907+0000 7ff7c31d4180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:32:40.955 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:40.952+0000 7efd0ce46180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:32:41.014 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:41.012+0000 7efd0ce46180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:32:41.048 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:41.047+0000 7ff7c31d4180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:32:41.105 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:41.107+0000 7ff7c31d4180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:32:41.165 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:41.164+0000 7efd0ce46180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:32:41.228 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:41.228+0000 7efd0ce46180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:32:41.349 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:32:41.349 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:32:41.349 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:32:41.357 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:41.359+0000 7ff7c31d4180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:32:41.481 INFO:tasks.ceph.mgr.y.smithi005.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:32:41.481 INFO:tasks.ceph.mgr.y.smithi005.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:32:41.482 INFO:tasks.ceph.mgr.y.smithi005.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:32:41.489 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:41.488+0000 7efd0ce46180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:32:41.490 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:41.491+0000 7ff7c31d4180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:32:41.618 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:41.619+0000 7ff7c31d4180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:32:41.630 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:41.628+0000 7efd0ce46180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:32:41.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:41.648+0000 7fdaf37fe640 1 -- 172.21.15.5:0/2028932673 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fdae0066420 msgr2=0x7fdae00688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/2194391064 2023-07-14T13:32:41.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:41.648+0000 7fdaf37fe640 1 --2- 172.21.15.5:0/2028932673 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fdae0066420 0x7fdae00688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-14T13:32:41.690 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:41.691+0000 7ff7c31d4180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:32:41.763 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:41.760+0000 7efd0ce46180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:32:41.823 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:41.823+0000 7ff7c31d4180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:32:41.838 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:41.836+0000 7efd0ce46180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:32:41.979 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:41.980+0000 7efd0ce46180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:32:42.360 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:42.359+0000 7ff7c31d4180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:32:42.444 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:42.443+0000 7ff7c31d4180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:32:42.553 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:42.552+0000 7efd0ce46180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:32:42.593 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:42.595+0000 7ff7c31d4180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:32:42.642 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:42.640+0000 7efd0ce46180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:32:42.676 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:42.675+0000 7ff7c31d4180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:32:42.797 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:42.796+0000 7efd0ce46180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:32:42.886 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:42.884+0000 7efd0ce46180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:32:42.946 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:42.947+0000 7ff7c31d4180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:32:43.006 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:43.007+0000 7ff7c31d4180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:32:43.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:43.016+0000 7fdaf0ff9640 1 -- 172.21.15.5:0/2028932673 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 97) v1 ==== 85386+0+0 (secure 0 0 0) 0x7fdae40ebc50 con 0x7fdaf40d2300 2023-07-14T13:32:43.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:43.016+0000 7fdaf0ff9640 1 -- 172.21.15.5:0/2028932673 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fdae0066420 msgr2=0x7fdae00688d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:32:43.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:43.016+0000 7fdaf0ff9640 1 --2- 172.21.15.5:0/2028932673 >> [v2:172.21.15.154:6832/2194391064,v1:172.21.15.154:6833/2194391064] conn(0x7fdae0066420 0x7fdae00688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:43.143 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:43.143+0000 7ff74533f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:43.143 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:43.143+0000 7ff74533f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:43.144 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:43.143+0000 7ff74533f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:43.144 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:43.143+0000 7ff74533f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:43.144 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:43.143+0000 7ff74533f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:43.145 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:43.143+0000 7ff742339640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:43.145 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:43.143+0000 7ff742339640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:43.145 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:43.143+0000 7ff742339640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:43.145 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:43.143+0000 7ff742339640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:43.145 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:43.143+0000 7ff742339640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:43.198 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:43.196+0000 7efd0ce46180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:32:43.262 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:43.260+0000 7efd0ce46180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:32:44.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.024+0000 7fdaf0ff9640 1 -- 172.21.15.5:0/2028932673 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mgrmap(e 98) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fdae40c0cd0 con 0x7fdaf40d2300 2023-07-14T13:32:44.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.024+0000 7fdaf0ff9640 1 --2- 172.21.15.5:0/2028932673 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fdae0033ce0 0x7fdae0070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:44.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.024+0000 7fdaf0ff9640 1 -- 172.21.15.5:0/2028932673 --> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fdaf40b6d80 con 0x7fdae0033ce0 2023-07-14T13:32:44.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.024+0000 7fdaf37fe640 1 --2- 172.21.15.5:0/2028932673 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fdae0033ce0 0x7fdae0070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.032+0000 7fdaf37fe640 1 --2- 172.21.15.5:0/2028932673 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fdae0033ce0 0x7fdae0070950 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdaf40b4380 tx=0x7fdae8009190 comp rx=0 tx=0).ready entity=mgr.8792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:44.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.096+0000 7fdaf0ff9640 1 -- 172.21.15.5:0/2028932673 <== mgr.8792 v2:172.21.15.154:6832/4121325793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fdaf40b6d80 con 0x7fdae0033ce0 2023-07-14T13:32:44.098 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule set for path snap_test_dir1 2023-07-14T13:32:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.100+0000 7fdafa648640 1 -- 172.21.15.5:0/2028932673 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fdae0033ce0 msgr2=0x7fdae0070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.100+0000 7fdafa648640 1 --2- 172.21.15.5:0/2028932673 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fdae0033ce0 0x7fdae0070950 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdaf40b4380 tx=0x7fdae8009190 comp rx=0 tx=0).stop 2023-07-14T13:32:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.100+0000 7fdafa648640 1 -- 172.21.15.5:0/2028932673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaf40d2300 msgr2=0x7fdaf4152e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.100+0000 7fdafa648640 1 --2- 172.21.15.5:0/2028932673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaf40d2300 0x7fdaf4152e80 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fdae40ad040 tx=0x7fdae4019200 comp rx=0 tx=0).stop 2023-07-14T13:32:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.100+0000 7fdaf8be5640 1 -- 172.21.15.5:0/2028932673 reap_dead start 2023-07-14T13:32:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.100+0000 7fdafa648640 1 -- 172.21.15.5:0/2028932673 shutdown_connections 2023-07-14T13:32:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.100+0000 7fdafa648640 1 -- 172.21.15.5:0/2028932673 >> 172.21.15.5:0/2028932673 conn(0x7fdaf40659d0 msgr2=0x7fdaf40cd960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.100+0000 7fdafa648640 1 -- 172.21.15.5:0/2028932673 shutdown_connections 2023-07-14T13:32:44.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.100+0000 7fdafa648640 1 -- 172.21.15.5:0/2028932673 wait complete. 2023-07-14T13:32:44.120 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-14T13:32:44.121 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-07-14T13:32:44.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.272+0000 7fed508d8640 1 Processor -- start 2023-07-14T13:32:44.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.272+0000 7fed508d8640 1 -- start start 2023-07-14T13:32:44.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.272+0000 7fed508d8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fed4c06a440 0x7fed4c0b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:44.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.272+0000 7fed508d8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed4c06c040 con 0x7fed4c15f690 2023-07-14T13:32:44.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.272+0000 7fed508d8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed4c160600 con 0x7fed4c1453a0 2023-07-14T13:32:44.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.272+0000 7fed508d8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed4c160170 con 0x7fed4c06a440 2023-07-14T13:32:44.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.272+0000 7fed4a59c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fed4c15f690 0x7fed4c15fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47872/0 (socket says 172.21.15.5:47872) 2023-07-14T13:32:44.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.272+0000 7fed4a59c640 1 -- 172.21.15.5:0/2548449535 learned_addr learned my addr 172.21.15.5:0/2548449535 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:44.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.272+0000 7fed43fff640 1 --2- 172.21.15.5:0/2548449535 >> v2:172.21.15.154:3300/0 conn(0x7fed4c06a440 0x7fed4c0b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:44.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.272+0000 7fed49d9b640 1 -- 172.21.15.5:0/2548449535 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932135415 0 0) 0x7fed4c06c040 con 0x7fed4c15f690 2023-07-14T13:32:44.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.272+0000 7fed49d9b640 1 -- 172.21.15.5:0/2548449535 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed38003530 con 0x7fed4c15f690 2023-07-14T13:32:44.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.276+0000 7fed49d9b640 1 -- 172.21.15.5:0/2548449535 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2233597998 0 0) 0x7fed38003530 con 0x7fed4c15f690 2023-07-14T13:32:44.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.276+0000 7fed49d9b640 1 -- 172.21.15.5:0/2548449535 >> v2:172.21.15.154:3300/0 conn(0x7fed4c06a440 msgr2=0x7fed4c0b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:44.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.276+0000 7fed49d9b640 1 --2- 172.21.15.5:0/2548449535 >> v2:172.21.15.154:3300/0 conn(0x7fed4c06a440 0x7fed4c0b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.276+0000 7fed49d9b640 1 -- 172.21.15.5:0/2548449535 >> v1:172.21.15.154:6789/0 conn(0x7fed4c1453a0 legacy=0x7fed4c06c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:44.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.276+0000 7fed49d9b640 1 -- 172.21.15.5:0/2548449535 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c160360 con 0x7fed4c15f690 2023-07-14T13:32:44.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.276+0000 7fed49d9b640 1 -- 172.21.15.5:0/2548449535 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7fed3c001680 con 0x7fed4c15f690 2023-07-14T13:32:44.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.276+0000 7fed49d9b640 1 -- 172.21.15.5:0/2548449535 >> v1:172.21.15.5:6789/0 conn(0x7fed4c15f690 legacy=0x7fed4c15fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:44.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.276+0000 7fed49d9b640 1 --2- 172.21.15.5:0/2548449535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed38003980 0x7fed38003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:44.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.276+0000 7fed49d9b640 1 --2- 172.21.15.5:0/2548449535 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed380047d0 0x7fed38004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:44.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.276+0000 7fed49d9b640 1 --2- 172.21.15.5:0/2548449535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed38005180 0x7fed3800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:44.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.276+0000 7fed49d9b640 1 -- 172.21.15.5:0/2548449535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3800c060 con 0x7fed38005180 2023-07-14T13:32:44.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.276+0000 7fed49d9b640 1 -- 172.21.15.5:0/2548449535 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3800c1d0 con 0x7fed38003980 2023-07-14T13:32:44.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.276+0000 7fed49d9b640 1 -- 172.21.15.5:0/2548449535 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3800c390 con 0x7fed380047d0 2023-07-14T13:32:44.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.276+0000 7fed43fff640 1 --2- 172.21.15.5:0/2548449535 >> v2:172.21.15.154:3300/0 conn(0x7fed4c06a440 0x7fed4c0b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:32:44.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.276+0000 7fed4ad9d640 1 --2- 172.21.15.5:0/2548449535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed38005180 0x7fed3800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:44.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.276+0000 7fed4a59c640 1 --2- 172.21.15.5:0/2548449535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed38003980 0x7fed38003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:44.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.276+0000 7fed43fff640 1 --2- 172.21.15.5:0/2548449535 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed380047d0 0x7fed38004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:44.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.276+0000 7fed4ad9d640 1 -- 172.21.15.5:0/2548449535 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed380047d0 msgr2=0x7fed38004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:44.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.276+0000 7fed4ad9d640 1 --2- 172.21.15.5:0/2548449535 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed380047d0 0x7fed38004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.276+0000 7fed4ad9d640 1 -- 172.21.15.5:0/2548449535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed38003980 msgr2=0x7fed38003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:44.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.276+0000 7fed4ad9d640 1 --2- 172.21.15.5:0/2548449535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed38003980 0x7fed38003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.276+0000 7fed4ad9d640 1 -- 172.21.15.5:0/2548449535 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed38003530 con 0x7fed38005180 2023-07-14T13:32:44.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.276+0000 7fed43fff640 1 --2- 172.21.15.5:0/2548449535 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed380047d0 0x7fed38004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:44.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.276+0000 7fed4a59c640 1 --2- 172.21.15.5:0/2548449535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed38003980 0x7fed38003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:32:44.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.276+0000 7fed4ad9d640 1 -- 172.21.15.5:0/2548449535 reap_dead start 2023-07-14T13:32:44.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.280+0000 7fed4ad9d640 1 --2- 172.21.15.5:0/2548449535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed38005180 0x7fed3800b990 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7fed44001e70 tx=0x7fed4401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515aa24f6542f387 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:44.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.280+0000 7fed49d9b640 1 -- 172.21.15.5:0/2548449535 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed44003b80 con 0x7fed38005180 2023-07-14T13:32:44.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.280+0000 7fed49d9b640 1 -- 172.21.15.5:0/2548449535 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed44003d20 con 0x7fed38005180 2023-07-14T13:32:44.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.280+0000 7fed49d9b640 1 -- 172.21.15.5:0/2548449535 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed44005310 con 0x7fed38005180 2023-07-14T13:32:44.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.280+0000 7fed508d8640 1 -- 172.21.15.5:0/2548449535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed38005180 msgr2=0x7fed3800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:44.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.280+0000 7fed508d8640 1 --2- 172.21.15.5:0/2548449535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed38005180 0x7fed3800b990 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7fed44001e70 tx=0x7fed4401c760 comp rx=0 tx=0).stop 2023-07-14T13:32:44.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.280+0000 7fed508d8640 1 -- 172.21.15.5:0/2548449535 shutdown_connections 2023-07-14T13:32:44.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.280+0000 7fed508d8640 1 --2- 172.21.15.5:0/2548449535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed38005180 0x7fed3800b990 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.280+0000 7fed508d8640 1 -- 172.21.15.5:0/2548449535 >> 172.21.15.5:0/2548449535 conn(0x7fed4c0b1210 msgr2=0x7fed4c0ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:44.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.280+0000 7fed508d8640 1 -- 172.21.15.5:0/2548449535 shutdown_connections 2023-07-14T13:32:44.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.280+0000 7fed508d8640 1 -- 172.21.15.5:0/2548449535 wait complete. 2023-07-14T13:32:44.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.280+0000 7fed508d8640 1 Processor -- start 2023-07-14T13:32:44.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.280+0000 7fed508d8640 1 -- start start 2023-07-14T13:32:44.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.280+0000 7fed508d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed38005180 0x7fed4c13c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:44.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.280+0000 7fed508d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed4c139a10 0x7fed4c0b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:44.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.280+0000 7fed508d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed4c15ed00 0x7fed4c0b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:44.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.280+0000 7fed508d8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c13ce10 con 0x7fed4c139a10 2023-07-14T13:32:44.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.280+0000 7fed508d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c13ac30 con 0x7fed38005180 2023-07-14T13:32:44.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.280+0000 7fed508d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c13a390 con 0x7fed4c15ed00 2023-07-14T13:32:44.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.284+0000 7fed43fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed4c139a10 0x7fed4c0b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:44.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.284+0000 7fed43fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed4c139a10 0x7fed4c0b28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36590/0 (socket says 172.21.15.5:36590) 2023-07-14T13:32:44.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.284+0000 7fed43fff640 1 -- 172.21.15.5:0/1936541600 learned_addr learned my addr 172.21.15.5:0/1936541600 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:44.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.284+0000 7fed4a59c640 1 --2- 172.21.15.5:0/1936541600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed38005180 0x7fed4c13c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:44.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.284+0000 7fed4ad9d640 1 --2- 172.21.15.5:0/1936541600 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed4c15ed00 0x7fed4c0b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.284+0000 7fed43fff640 1 -- 172.21.15.5:0/1936541600 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed4c15ed00 msgr2=0x7fed4c0b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.284+0000 7fed43fff640 1 --2- 172.21.15.5:0/1936541600 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed4c15ed00 0x7fed4c0b2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.284+0000 7fed43fff640 1 -- 172.21.15.5:0/1936541600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed38005180 msgr2=0x7fed4c13c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.284+0000 7fed43fff640 1 --2- 172.21.15.5:0/1936541600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed38005180 0x7fed4c13c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.284+0000 7fed43fff640 1 -- 172.21.15.5:0/1936541600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c139ea0 con 0x7fed4c139a10 2023-07-14T13:32:44.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.284+0000 7fed43fff640 1 --2- 172.21.15.5:0/1936541600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed4c139a10 0x7fed4c0b28e0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7fed340116a0 tx=0x7fed34011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.284+0000 7fed42ffd640 1 -- 172.21.15.5:0/1936541600 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed34015870 con 0x7fed4c139a10 2023-07-14T13:32:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.284+0000 7fed42ffd640 1 -- 172.21.15.5:0/1936541600 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed340159d0 con 0x7fed4c139a10 2023-07-14T13:32:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.284+0000 7fed42ffd640 1 -- 172.21.15.5:0/1936541600 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed34015d40 con 0x7fed4c139a10 2023-07-14T13:32:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.284+0000 7fed508d8640 1 -- 172.21.15.5:0/1936541600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4c13a5e0 con 0x7fed4c139a10 2023-07-14T13:32:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.284+0000 7fed508d8640 1 -- 172.21.15.5:0/1936541600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4c13fdc0 con 0x7fed4c139a10 2023-07-14T13:32:44.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.284+0000 7fed508d8640 1 -- 172.21.15.5:0/1936541600 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed4c0678d0 con 0x7fed4c139a10 2023-07-14T13:32:44.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.284+0000 7fed42ffd640 1 -- 172.21.15.5:0/1936541600 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 98) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fed3400f480 con 0x7fed4c139a10 2023-07-14T13:32:44.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.284+0000 7fed42ffd640 1 --2- 172.21.15.5:0/1936541600 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fed2c066120 0x7fed2c0685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:44.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.288+0000 7fed42ffd640 1 -- 172.21.15.5:0/1936541600 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6434+0+0 (secure 0 0 0) 0x7fed34084390 con 0x7fed4c139a10 2023-07-14T13:32:44.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.288+0000 7fed4a59c640 1 --2- 172.21.15.5:0/1936541600 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fed2c066120 0x7fed2c0685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.288+0000 7fed4a59c640 1 --2- 172.21.15.5:0/1936541600 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fed2c066120 0x7fed2c0685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fed3c001ca0 tx=0x7fed3c001b90 comp rx=0 tx=0).ready entity=mgr.8792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:44.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.292+0000 7fed42ffd640 1 -- 172.21.15.5:0/1936541600 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fed34051900 con 0x7fed4c139a10 2023-07-14T13:32:44.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.464+0000 7fed508d8640 1 -- 172.21.15.5:0/1936541600 --> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fed4c06bcd0 con 0x7fed2c066120 2023-07-14T13:32:44.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.528+0000 7fed42ffd640 1 -- 172.21.15.5:0/1936541600 <== mgr.8792 v2:172.21.15.154:6832/4121325793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7fed3c015920 con 0x7fed2c066120 2023-07-14T13:32:44.529 INFO:teuthology.orchestra.run.smithi005.stdout:Retention added to path snap_test_dir1 2023-07-14T13:32:44.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.528+0000 7fed508d8640 1 -- 172.21.15.5:0/1936541600 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fed2c066120 msgr2=0x7fed2c0685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.528+0000 7fed508d8640 1 --2- 172.21.15.5:0/1936541600 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fed2c066120 0x7fed2c0685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fed3c001ca0 tx=0x7fed3c001b90 comp rx=0 tx=0).stop 2023-07-14T13:32:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.528+0000 7fed508d8640 1 -- 172.21.15.5:0/1936541600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed4c139a10 msgr2=0x7fed4c0b28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.528+0000 7fed508d8640 1 --2- 172.21.15.5:0/1936541600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed4c139a10 0x7fed4c0b28e0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7fed340116a0 tx=0x7fed34011aa0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.528+0000 7fed508d8640 1 -- 172.21.15.5:0/1936541600 shutdown_connections 2023-07-14T13:32:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.528+0000 7fed508d8640 1 --2- 172.21.15.5:0/1936541600 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fed2c066120 0x7fed2c0685d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.528+0000 7fed508d8640 1 --2- 172.21.15.5:0/1936541600 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed4c15ed00 0x7fed4c0b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.528+0000 7fed508d8640 1 --2- 172.21.15.5:0/1936541600 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed4c139a10 0x7fed4c0b28e0 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.528+0000 7fed508d8640 1 --2- 172.21.15.5:0/1936541600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed38005180 0x7fed4c13c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.528+0000 7fed508d8640 1 -- 172.21.15.5:0/1936541600 >> 172.21.15.5:0/1936541600 conn(0x7fed4c0b1210 msgr2=0x7fed4c143090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:44.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.528+0000 7fed508d8640 1 -- 172.21.15.5:0/1936541600 shutdown_connections 2023-07-14T13:32:44.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.528+0000 7fed508d8640 1 -- 172.21.15.5:0/1936541600 wait complete. 2023-07-14T13:32:44.550 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-07-14T13:32:44.555 INFO:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-07-14-13_33_00 in ~16s... 2023-07-14T13:32:44.555 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-07-14T13:32:44.555 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-07-14T13:32:44.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.700+0000 7f34f369c640 1 Processor -- start 2023-07-14T13:32:44.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.700+0000 7f34f369c640 1 -- start start 2023-07-14T13:32:44.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34f369c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ec15cef0 0x7f34ec158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:44.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34f369c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34ec1532b0 con 0x7f34ec159270 2023-07-14T13:32:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34f369c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34ec0ca6f0 con 0x7f34ec0aeb40 2023-07-14T13:32:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34f369c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec15d360 con 0x7f34ec15cef0 2023-07-14T13:32:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34f1c39640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f34ec159270 0x7f34ec0c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47884/0 (socket says 172.21.15.5:47884) 2023-07-14T13:32:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34f1c39640 1 -- 172.21.15.5:0/1545442466 learned_addr learned my addr 172.21.15.5:0/1545442466 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:44.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34e3fff640 1 -- 172.21.15.5:0/1545442466 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723825581 0 0) 0x7f34ec1532b0 con 0x7f34ec159270 2023-07-14T13:32:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34e3fff640 1 -- 172.21.15.5:0/1545442466 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34d8005740 con 0x7f34ec159270 2023-07-14T13:32:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34f0c37640 1 --2- 172.21.15.5:0/1545442466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ec15cef0 0x7f34ec158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34e3fff640 1 -- 172.21.15.5:0/1545442466 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4012595350 0 0) 0x7f34d8005740 con 0x7f34ec159270 2023-07-14T13:32:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34e3fff640 1 -- 172.21.15.5:0/1545442466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ec15cef0 msgr2=0x7f34ec158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34e3fff640 1 --2- 172.21.15.5:0/1545442466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ec15cef0 0x7f34ec158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34e3fff640 1 -- 172.21.15.5:0/1545442466 >> v1:172.21.15.154:6789/0 conn(0x7f34ec0aeb40 legacy=0x7f34ec0aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34e3fff640 1 -- 172.21.15.5:0/1545442466 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ec1599d0 con 0x7f34ec159270 2023-07-14T13:32:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34e3fff640 1 -- 172.21.15.5:0/1545442466 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f34e4001a00 con 0x7f34ec159270 2023-07-14T13:32:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34e3fff640 1 -- 172.21.15.5:0/1545442466 >> v1:172.21.15.5:6789/0 conn(0x7f34ec159270 legacy=0x7f34ec0c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34e3fff640 1 --2- 172.21.15.5:0/1545442466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ec15cef0 0x7f34d8005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34e3fff640 1 --2- 172.21.15.5:0/1545442466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34d8006140 0x7f34d80069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34e3fff640 1 --2- 172.21.15.5:0/1545442466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34d8006f20 0x7f34d8007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:44.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34e3fff640 1 -- 172.21.15.5:0/1545442466 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec15d360 con 0x7f34d8006f20 2023-07-14T13:32:44.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34e3fff640 1 -- 172.21.15.5:0/1545442466 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d800dc80 con 0x7f34d8006140 2023-07-14T13:32:44.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34e3fff640 1 -- 172.21.15.5:0/1545442466 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d800de40 con 0x7f34ec15cef0 2023-07-14T13:32:44.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34f1c39640 1 --2- 172.21.15.5:0/1545442466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34d8006f20 0x7f34d8007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:44.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34f0c37640 1 --2- 172.21.15.5:0/1545442466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34d8006140 0x7f34d80069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:44.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34f1438640 1 --2- 172.21.15.5:0/1545442466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ec15cef0 0x7f34d8005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:44.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34f1c39640 1 -- 172.21.15.5:0/1545442466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ec15cef0 msgr2=0x7f34d8005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:44.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34f1c39640 1 --2- 172.21.15.5:0/1545442466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ec15cef0 0x7f34d8005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34f1c39640 1 -- 172.21.15.5:0/1545442466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34d8006140 msgr2=0x7f34d80069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:44.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34f1c39640 1 --2- 172.21.15.5:0/1545442466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34d8006140 0x7f34d80069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.704+0000 7f34f1c39640 1 -- 172.21.15.5:0/1545442466 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d8005740 con 0x7f34d8006f20 2023-07-14T13:32:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.708+0000 7f34f1c39640 1 --2- 172.21.15.5:0/1545442466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34d8006f20 0x7f34d8007390 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f34e400a800 tx=0x7f34e401d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c656d56c44535127 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.708+0000 7f34e3fff640 1 -- 172.21.15.5:0/1545442466 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e40072d0 con 0x7f34d8006f20 2023-07-14T13:32:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.708+0000 7f34e3fff640 1 -- 172.21.15.5:0/1545442466 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e40a8070 con 0x7f34d8006f20 2023-07-14T13:32:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.708+0000 7f34e3fff640 1 -- 172.21.15.5:0/1545442466 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e4007690 con 0x7f34d8006f20 2023-07-14T13:32:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.708+0000 7f34f369c640 1 -- 172.21.15.5:0/1545442466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34d8006f20 msgr2=0x7f34d8007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:44.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.708+0000 7f34f369c640 1 --2- 172.21.15.5:0/1545442466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34d8006f20 0x7f34d8007390 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f34e400a800 tx=0x7f34e401d300 comp rx=0 tx=0).stop 2023-07-14T13:32:44.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.708+0000 7f34f1c39640 1 -- 172.21.15.5:0/1545442466 reap_dead start 2023-07-14T13:32:44.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.708+0000 7f34f369c640 1 -- 172.21.15.5:0/1545442466 shutdown_connections 2023-07-14T13:32:44.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.708+0000 7f34f369c640 1 -- 172.21.15.5:0/1545442466 >> 172.21.15.5:0/1545442466 conn(0x7f34ec0cde90 msgr2=0x7f34ec0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:44.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.708+0000 7f34f369c640 1 -- 172.21.15.5:0/1545442466 shutdown_connections 2023-07-14T13:32:44.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.708+0000 7f34f369c640 1 -- 172.21.15.5:0/1545442466 wait complete. 2023-07-14T13:32:44.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.712+0000 7f34f369c640 1 Processor -- start 2023-07-14T13:32:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.712+0000 7f34f369c640 1 -- start start 2023-07-14T13:32:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.712+0000 7f34f369c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34d8006f20 0x7f34ec147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.712+0000 7f34f369c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34ec06cc00 0x7f34ec13a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.712+0000 7f34f369c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ec070c80 0x7f34ec0adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.712+0000 7f34f369c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec070860 con 0x7f34ec06cc00 2023-07-14T13:32:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.712+0000 7f34f369c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec13aeb0 con 0x7f34d8006f20 2023-07-14T13:32:44.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.712+0000 7f34f369c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec06d070 con 0x7f34ec070c80 2023-07-14T13:32:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.712+0000 7f34f0c37640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34ec06cc00 0x7f34ec13a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.712+0000 7f34f0c37640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34ec06cc00 0x7f34ec13a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36606/0 (socket says 172.21.15.5:36606) 2023-07-14T13:32:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.712+0000 7f34f0c37640 1 -- 172.21.15.5:0/405875958 learned_addr learned my addr 172.21.15.5:0/405875958 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.712+0000 7f34f1438640 1 --2- 172.21.15.5:0/405875958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34d8006f20 0x7f34ec147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.712+0000 7f34f1c39640 1 --2- 172.21.15.5:0/405875958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ec070c80 0x7f34ec0adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.712+0000 7f34f0c37640 1 -- 172.21.15.5:0/405875958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ec070c80 msgr2=0x7f34ec0adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.712+0000 7f34f0c37640 1 --2- 172.21.15.5:0/405875958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ec070c80 0x7f34ec0adcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.712+0000 7f34f0c37640 1 -- 172.21.15.5:0/405875958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34d8006f20 msgr2=0x7f34ec147eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.712+0000 7f34f0c37640 1 --2- 172.21.15.5:0/405875958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34d8006f20 0x7f34ec147eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.712+0000 7f34f0c37640 1 -- 172.21.15.5:0/405875958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ec148530 con 0x7f34ec06cc00 2023-07-14T13:32:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.712+0000 7f34f1c39640 1 --2- 172.21.15.5:0/405875958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ec070c80 0x7f34ec0adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:32:44.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.712+0000 7f34f0c37640 1 --2- 172.21.15.5:0/405875958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34ec06cc00 0x7f34ec13a970 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f34dc011a00 tx=0x7f34dc011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.712+0000 7f34e1ffb640 1 -- 172.21.15.5:0/405875958 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc00faf0 con 0x7f34ec06cc00 2023-07-14T13:32:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.712+0000 7f34e1ffb640 1 -- 172.21.15.5:0/405875958 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34dc00fc50 con 0x7f34ec06cc00 2023-07-14T13:32:44.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.712+0000 7f34e1ffb640 1 -- 172.21.15.5:0/405875958 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc014440 con 0x7f34ec06cc00 2023-07-14T13:32:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.712+0000 7f34f369c640 1 -- 172.21.15.5:0/405875958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34ec148a60 con 0x7f34ec06cc00 2023-07-14T13:32:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.712+0000 7f34f369c640 1 -- 172.21.15.5:0/405875958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ec0701a0 con 0x7f34ec06cc00 2023-07-14T13:32:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.716+0000 7f34f369c640 1 -- 172.21.15.5:0/405875958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ec0678d0 con 0x7f34ec06cc00 2023-07-14T13:32:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.716+0000 7f34e1ffb640 1 -- 172.21.15.5:0/405875958 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 98) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f34dc0145a0 con 0x7f34ec06cc00 2023-07-14T13:32:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.716+0000 7f34e1ffb640 1 --2- 172.21.15.5:0/405875958 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f34d0066120 0x7f34d00685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.716+0000 7f34e1ffb640 1 -- 172.21.15.5:0/405875958 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f34dc084420 con 0x7f34ec06cc00 2023-07-14T13:32:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.716+0000 7f34f1438640 1 --2- 172.21.15.5:0/405875958 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f34d0066120 0x7f34d00685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.716+0000 7f34f1438640 1 --2- 172.21.15.5:0/405875958 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f34d0066120 0x7f34d00685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f34ec06cae0 tx=0x7f34e8009040 comp rx=0 tx=0).ready entity=mgr.8792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.720+0000 7f34e1ffb640 1 -- 172.21.15.5:0/405875958 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f34dc051b00 con 0x7f34ec06cc00 2023-07-14T13:32:44.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.896+0000 7f34f369c640 1 -- 172.21.15.5:0/405875958 --> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34ec15c410 con 0x7f34d0066120 2023-07-14T13:32:44.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.904+0000 7f34e1ffb640 1 -- 172.21.15.5:0/405875958 <== mgr.8792 v2:172.21.15.154:6832/4121325793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7f34e8005270 con 0x7f34d0066120 2023-07-14T13:32:44.906 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:44.906 INFO:teuthology.orchestra.run.smithi005.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-07-14T13:32:44.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.908+0000 7f34f369c640 1 -- 172.21.15.5:0/405875958 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f34d0066120 msgr2=0x7f34d00685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:44.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.908+0000 7f34f369c640 1 --2- 172.21.15.5:0/405875958 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f34d0066120 0x7f34d00685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f34ec06cae0 tx=0x7f34e8009040 comp rx=0 tx=0).stop 2023-07-14T13:32:44.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.908+0000 7f34f369c640 1 -- 172.21.15.5:0/405875958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34ec06cc00 msgr2=0x7f34ec13a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:44.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.908+0000 7f34f369c640 1 --2- 172.21.15.5:0/405875958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34ec06cc00 0x7f34ec13a970 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f34dc011a00 tx=0x7f34dc011ec0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.908+0000 7f34f369c640 1 -- 172.21.15.5:0/405875958 shutdown_connections 2023-07-14T13:32:44.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.908+0000 7f34f369c640 1 --2- 172.21.15.5:0/405875958 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f34d0066120 0x7f34d00685d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.908+0000 7f34f369c640 1 --2- 172.21.15.5:0/405875958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f34ec070c80 0x7f34ec0adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.908+0000 7f34f369c640 1 --2- 172.21.15.5:0/405875958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34ec06cc00 0x7f34ec13a970 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.908+0000 7f34f369c640 1 --2- 172.21.15.5:0/405875958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34d8006f20 0x7f34ec147eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.908+0000 7f34f369c640 1 -- 172.21.15.5:0/405875958 >> 172.21.15.5:0/405875958 conn(0x7f34ec0cde90 msgr2=0x7f34ec158290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:44.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.908+0000 7f34f369c640 1 -- 172.21.15.5:0/405875958 shutdown_connections 2023-07-14T13:32:44.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:44.908+0000 7f34f369c640 1 -- 172.21.15.5:0/405875958 wait complete. 2023-07-14T13:32:44.928 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-07-14T13:32:44.928 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-07-14T13:32:44.929 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-07-14T13:32:45.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.080+0000 7f2f82740640 1 Processor -- start 2023-07-14T13:32:45.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.080+0000 7f2f82740640 1 -- start start 2023-07-14T13:32:45.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.080+0000 7f2f82740640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2f7c0d2fc0 0x7f2f7c0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:45.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.080+0000 7f2f82740640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f7c0b04c0 con 0x7f2f7c15bde0 2023-07-14T13:32:45.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.080+0000 7f2f82740640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f7c0d0aa0 con 0x7f2f7c0d2300 2023-07-14T13:32:45.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.080+0000 7f2f82740640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f7c15c1b0 con 0x7f2f7c0d2fc0 2023-07-14T13:32:45.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.080+0000 7f2f7b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2f7c0d2fc0 0x7f2f7c0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:45.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.080+0000 7f2f7bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2f7c15bde0 0x7f2f7c0d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47896/0 (socket says 172.21.15.5:47896) 2023-07-14T13:32:45.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.080+0000 7f2f7bfff640 1 -- 172.21.15.5:0/3863380257 learned_addr learned my addr 172.21.15.5:0/3863380257 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:45.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.080+0000 7f2f7b7fe640 1 -- 172.21.15.5:0/3863380257 >> v1:172.21.15.154:6789/0 conn(0x7f2f7c0d2300 legacy=0x7f2f7c0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:45.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.080+0000 7f2f7b7fe640 1 -- 172.21.15.5:0/3863380257 >> v1:172.21.15.5:6789/0 conn(0x7f2f7c15bde0 legacy=0x7f2f7c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:45.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.080+0000 7f2f7b7fe640 1 -- 172.21.15.5:0/3863380257 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7c0afb90 con 0x7f2f7c0d2fc0 2023-07-14T13:32:45.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.080+0000 7f2f7affd640 1 -- 172.21.15.5:0/3863380257 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581716016 0 0) 0x7f2f7c0b04c0 con 0x7f2f7c15bde0 2023-07-14T13:32:45.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.084+0000 7f2f7b7fe640 1 --2- 172.21.15.5:0/3863380257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f7c0d2fc0 0x7f2f7c0b0950 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7f2f700097c0 tx=0x7f2f7001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89dd6448248be0b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:45.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.084+0000 7f2f7affd640 1 -- 172.21.15.5:0/3863380257 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f700ab680 con 0x7f2f7c0d2fc0 2023-07-14T13:32:45.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.084+0000 7f2f7affd640 1 -- 172.21.15.5:0/3863380257 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f700ab7e0 con 0x7f2f7c0d2fc0 2023-07-14T13:32:45.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.084+0000 7f2f7affd640 1 -- 172.21.15.5:0/3863380257 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f700abb70 con 0x7f2f7c0d2fc0 2023-07-14T13:32:45.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.084+0000 7f2f82740640 1 -- 172.21.15.5:0/3863380257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f7c0d2fc0 msgr2=0x7f2f7c0b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:45.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.084+0000 7f2f82740640 1 --2- 172.21.15.5:0/3863380257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f7c0d2fc0 0x7f2f7c0b0950 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7f2f700097c0 tx=0x7f2f7001c480 comp rx=0 tx=0).stop 2023-07-14T13:32:45.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.084+0000 7f2f82740640 1 -- 172.21.15.5:0/3863380257 shutdown_connections 2023-07-14T13:32:45.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.084+0000 7f2f82740640 1 --2- 172.21.15.5:0/3863380257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f7c0d2fc0 0x7f2f7c0b0950 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.084+0000 7f2f82740640 1 -- 172.21.15.5:0/3863380257 >> 172.21.15.5:0/3863380257 conn(0x7f2f7c0659d0 msgr2=0x7f2f7c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.084+0000 7f2f82740640 1 -- 172.21.15.5:0/3863380257 shutdown_connections 2023-07-14T13:32:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.084+0000 7f2f82740640 1 -- 172.21.15.5:0/3863380257 wait complete. 2023-07-14T13:32:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.088+0000 7f2f82740640 1 Processor -- start 2023-07-14T13:32:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.088+0000 7f2f82740640 1 -- start start 2023-07-14T13:32:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.088+0000 7f2f82740640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f7c0d2300 0x7f2f7c0cd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.088+0000 7f2f82740640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f7c0d2fc0 0x7f2f7c15e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.088+0000 7f2f82740640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f7c15bde0 0x7f2f7c15d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.088+0000 7f2f82740640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c0c7d50 con 0x7f2f7c0d2300 2023-07-14T13:32:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.088+0000 7f2f82740640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c0c8030 con 0x7f2f7c15bde0 2023-07-14T13:32:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.088+0000 7f2f82740640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c0c8310 con 0x7f2f7c0d2fc0 2023-07-14T13:32:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.088+0000 7f2f7bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f7c0d2300 0x7f2f7c0cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.088+0000 7f2f7bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f7c0d2300 0x7f2f7c0cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36624/0 (socket says 172.21.15.5:36624) 2023-07-14T13:32:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.088+0000 7f2f7bfff640 1 -- 172.21.15.5:0/2439251546 learned_addr learned my addr 172.21.15.5:0/2439251546 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.088+0000 7f2f7b7fe640 1 --2- 172.21.15.5:0/2439251546 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f7c0d2fc0 0x7f2f7c15e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.088+0000 7f2f80cdd640 1 --2- 172.21.15.5:0/2439251546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f7c15bde0 0x7f2f7c15d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:45.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.088+0000 7f2f7bfff640 1 -- 172.21.15.5:0/2439251546 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f7c0d2fc0 msgr2=0x7f2f7c15e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.088+0000 7f2f7bfff640 1 --2- 172.21.15.5:0/2439251546 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f7c0d2fc0 0x7f2f7c15e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.088+0000 7f2f7bfff640 1 -- 172.21.15.5:0/2439251546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f7c15bde0 msgr2=0x7f2f7c15d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.088+0000 7f2f7bfff640 1 --2- 172.21.15.5:0/2439251546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f7c15bde0 0x7f2f7c15d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.088+0000 7f2f7bfff640 1 -- 172.21.15.5:0/2439251546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f70009420 con 0x7f2f7c0d2300 2023-07-14T13:32:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.088+0000 7f2f7b7fe640 1 --2- 172.21.15.5:0/2439251546 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f7c0d2fc0 0x7f2f7c15e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.088+0000 7f2f7bfff640 1 --2- 172.21.15.5:0/2439251546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f7c0d2300 0x7f2f7c0cd740 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c00c730 tx=0x7f2f6c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:45.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.088+0000 7f2f78ff9640 1 -- 172.21.15.5:0/2439251546 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c007270 con 0x7f2f7c0d2300 2023-07-14T13:32:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.088+0000 7f2f78ff9640 1 -- 172.21.15.5:0/2439251546 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6c0073f0 con 0x7f2f7c0d2300 2023-07-14T13:32:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.088+0000 7f2f82740640 1 -- 172.21.15.5:0/2439251546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f7c0c85f0 con 0x7f2f7c0d2300 2023-07-14T13:32:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.088+0000 7f2f78ff9640 1 -- 172.21.15.5:0/2439251546 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c001d10 con 0x7f2f7c0d2300 2023-07-14T13:32:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.088+0000 7f2f82740640 1 -- 172.21.15.5:0/2439251546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f7c0c7950 con 0x7f2f7c0d2300 2023-07-14T13:32:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.092+0000 7f2f82740640 1 -- 172.21.15.5:0/2439251546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f7c0678d0 con 0x7f2f7c0d2300 2023-07-14T13:32:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.092+0000 7f2f78ff9640 1 -- 172.21.15.5:0/2439251546 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 99) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f2f6c0057b0 con 0x7f2f7c0d2300 2023-07-14T13:32:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.092+0000 7f2f78ff9640 1 --2- 172.21.15.5:0/2439251546 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f2f68066480 0x7f2f68068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.092+0000 7f2f78ff9640 1 -- 172.21.15.5:0/2439251546 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f2f6c083df0 con 0x7f2f7c0d2300 2023-07-14T13:32:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.092+0000 7f2f7b7fe640 1 --2- 172.21.15.5:0/2439251546 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f2f68066480 0x7f2f68068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.092+0000 7f2f7b7fe640 1 --2- 172.21.15.5:0/2439251546 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f2f68066480 0x7f2f68068930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2f700af000 tx=0x7f2f700a7000 comp rx=0 tx=0).ready entity=mgr.8792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.096+0000 7f2f78ff9640 1 -- 172.21.15.5:0/2439251546 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2f6c050dd0 con 0x7f2f7c0d2300 2023-07-14T13:32:45.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.268+0000 7f2f82740640 1 -- 172.21.15.5:0/2439251546 --> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f7c0b0e90 con 0x7f2f68066480 2023-07-14T13:32:45.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.340+0000 7f2f78ff9640 1 -- 172.21.15.5:0/2439251546 <== mgr.8792 v2:172.21.15.154:6832/4121325793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f2f700040c0 con 0x7f2f68066480 2023-07-14T13:32:45.341 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule removed for path snap_test_dir1 2023-07-14T13:32:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.340+0000 7f2f82740640 1 -- 172.21.15.5:0/2439251546 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f2f68066480 msgr2=0x7f2f68068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.340+0000 7f2f82740640 1 --2- 172.21.15.5:0/2439251546 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f2f68066480 0x7f2f68068930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2f700af000 tx=0x7f2f700a7000 comp rx=0 tx=0).stop 2023-07-14T13:32:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.340+0000 7f2f82740640 1 -- 172.21.15.5:0/2439251546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f7c0d2300 msgr2=0x7f2f7c0cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.340+0000 7f2f82740640 1 --2- 172.21.15.5:0/2439251546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f7c0d2300 0x7f2f7c0cd740 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c00c730 tx=0x7f2f6c00cbf0 comp rx=0 tx=0).stop 2023-07-14T13:32:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.340+0000 7f2f82740640 1 -- 172.21.15.5:0/2439251546 shutdown_connections 2023-07-14T13:32:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.340+0000 7f2f82740640 1 --2- 172.21.15.5:0/2439251546 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f2f68066480 0x7f2f68068930 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.340+0000 7f2f82740640 1 --2- 172.21.15.5:0/2439251546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f7c15bde0 0x7f2f7c15d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.340+0000 7f2f82740640 1 --2- 172.21.15.5:0/2439251546 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f7c0d2fc0 0x7f2f7c15e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:45.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.340+0000 7f2f82740640 1 --2- 172.21.15.5:0/2439251546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f7c0d2300 0x7f2f7c0cd740 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:45.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.340+0000 7f2f82740640 1 -- 172.21.15.5:0/2439251546 >> 172.21.15.5:0/2439251546 conn(0x7f2f7c0659d0 msgr2=0x7f2f7c0aefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:45.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.340+0000 7f2f82740640 1 -- 172.21.15.5:0/2439251546 shutdown_connections 2023-07-14T13:32:45.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.340+0000 7f2f82740640 1 -- 172.21.15.5:0/2439251546 wait complete. 2023-07-14T13:32:45.362 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-07-14T13:32:45.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:45.363 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-14T13:32:45.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:45.375 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-14T13:32:45.426 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-14T13:32:45.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f5234f03640 1 Processor -- start 2023-07-14T13:32:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f5234f03640 1 -- start start 2023-07-14T13:32:45.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f5234f03640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f52300cd670 0x7f52300cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f5234f03640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52300b08d0 con 0x7f5230158df0 2023-07-14T13:32:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f5234f03640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5230159cb0 con 0x7f5230156560 2023-07-14T13:32:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f5234f03640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52301599d0 con 0x7f52300cd670 2023-07-14T13:32:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f522ed9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5230158df0 0x7f523006bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47908/0 (socket says 172.21.15.5:47908) 2023-07-14T13:32:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f522ed9d640 1 -- 172.21.15.5:0/623840572 learned_addr learned my addr 172.21.15.5:0/623840572 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f5227fff640 1 --2- 172.21.15.5:0/623840572 >> v2:172.21.15.154:3300/0 conn(0x7f52300cd670 0x7f52300cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f522dd9b640 1 -- 172.21.15.5:0/623840572 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443482042 0 0) 0x7f52300b08d0 con 0x7f5230158df0 2023-07-14T13:32:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f522dd9b640 1 -- 172.21.15.5:0/623840572 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f521c003530 con 0x7f5230158df0 2023-07-14T13:32:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f522dd9b640 1 -- 172.21.15.5:0/623840572 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 944019212 0 0) 0x7f521c003530 con 0x7f5230158df0 2023-07-14T13:32:45.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f522dd9b640 1 -- 172.21.15.5:0/623840572 >> v2:172.21.15.154:3300/0 conn(0x7f52300cd670 msgr2=0x7f52300cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f522dd9b640 1 --2- 172.21.15.5:0/623840572 >> v2:172.21.15.154:3300/0 conn(0x7f52300cd670 0x7f52300cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f522dd9b640 1 -- 172.21.15.5:0/623840572 >> v1:172.21.15.154:6789/0 conn(0x7f5230156560 legacy=0x7f52300ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f522dd9b640 1 -- 172.21.15.5:0/623840572 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52300ca900 con 0x7f5230158df0 2023-07-14T13:32:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f522dd9b640 1 -- 172.21.15.5:0/623840572 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f5228001a00 con 0x7f5230158df0 2023-07-14T13:32:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f522dd9b640 1 -- 172.21.15.5:0/623840572 >> v1:172.21.15.5:6789/0 conn(0x7f5230158df0 legacy=0x7f523006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f522dd9b640 1 --2- 172.21.15.5:0/623840572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f521c003980 0x7f521c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f522dd9b640 1 --2- 172.21.15.5:0/623840572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f521c0047d0 0x7f521c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f522dd9b640 1 --2- 172.21.15.5:0/623840572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f521c005180 0x7f521c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f522dd9b640 1 -- 172.21.15.5:0/623840572 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52301599d0 con 0x7f521c0047d0 2023-07-14T13:32:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f522dd9b640 1 -- 172.21.15.5:0/623840572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521c00c000 con 0x7f521c005180 2023-07-14T13:32:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f522dd9b640 1 -- 172.21.15.5:0/623840572 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521c00c1c0 con 0x7f521c003980 2023-07-14T13:32:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f5227fff640 1 --2- 172.21.15.5:0/623840572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f521c0047d0 0x7f521c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f522ed9d640 1 --2- 172.21.15.5:0/623840572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f521c005180 0x7f521c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:45.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f522e59c640 1 --2- 172.21.15.5:0/623840572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f521c003980 0x7f521c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:45.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f5227fff640 1 -- 172.21.15.5:0/623840572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f521c003980 msgr2=0x7f521c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:45.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f5227fff640 1 --2- 172.21.15.5:0/623840572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f521c003980 0x7f521c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:45.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f5227fff640 1 -- 172.21.15.5:0/623840572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f521c005180 msgr2=0x7f521c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:45.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f5227fff640 1 --2- 172.21.15.5:0/623840572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f521c005180 0x7f521c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:45.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f5227fff640 1 -- 172.21.15.5:0/623840572 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521c003530 con 0x7f521c0047d0 2023-07-14T13:32:45.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.612+0000 7f522ed9d640 1 -- 172.21.15.5:0/623840572 reap_dead start 2023-07-14T13:32:45.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.616+0000 7f5227fff640 1 --2- 172.21.15.5:0/623840572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f521c0047d0 0x7f521c004c40 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f5218009ab0 tx=0x7f521801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc56bb25f2d9ed13 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:45.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.616+0000 7f522dd9b640 1 -- 172.21.15.5:0/623840572 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52180a6440 con 0x7f521c0047d0 2023-07-14T13:32:45.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.616+0000 7f522dd9b640 1 -- 172.21.15.5:0/623840572 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52180a65a0 con 0x7f521c0047d0 2023-07-14T13:32:45.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.616+0000 7f522dd9b640 1 -- 172.21.15.5:0/623840572 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52180a6950 con 0x7f521c0047d0 2023-07-14T13:32:45.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.616+0000 7f5234f03640 1 -- 172.21.15.5:0/623840572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f521c0047d0 msgr2=0x7f521c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:45.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.616+0000 7f5234f03640 1 --2- 172.21.15.5:0/623840572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f521c0047d0 0x7f521c004c40 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f5218009ab0 tx=0x7f521801ca30 comp rx=0 tx=0).stop 2023-07-14T13:32:45.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.616+0000 7f5234f03640 1 -- 172.21.15.5:0/623840572 shutdown_connections 2023-07-14T13:32:45.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.616+0000 7f5234f03640 1 --2- 172.21.15.5:0/623840572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f521c0047d0 0x7f521c004c40 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:45.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.616+0000 7f5234f03640 1 -- 172.21.15.5:0/623840572 >> 172.21.15.5:0/623840572 conn(0x7f52300afac0 msgr2=0x7f52300afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:45.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.616+0000 7f5234f03640 1 -- 172.21.15.5:0/623840572 shutdown_connections 2023-07-14T13:32:45.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.616+0000 7f5234f03640 1 -- 172.21.15.5:0/623840572 wait complete. 2023-07-14T13:32:45.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.620+0000 7f5234f03640 1 Processor -- start 2023-07-14T13:32:45.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.620+0000 7f5234f03640 1 -- start start 2023-07-14T13:32:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.620+0000 7f5234f03640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f521c0047d0 0x7f52301f21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.620+0000 7f5234f03640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52300b3640 0x7f52300b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:45.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.620+0000 7f5234f03640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52300b1300 0x7f52301f1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:45.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.620+0000 7f5234f03640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52300b17a0 con 0x7f521c0047d0 2023-07-14T13:32:45.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.620+0000 7f5234f03640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52301f1db0 con 0x7f52300b3640 2023-07-14T13:32:45.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.620+0000 7f5234f03640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52300aba20 con 0x7f52300b1300 2023-07-14T13:32:45.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.620+0000 7f522e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f521c0047d0 0x7f52301f21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:45.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.620+0000 7f522e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f521c0047d0 0x7f52301f21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36638/0 (socket says 172.21.15.5:36638) 2023-07-14T13:32:45.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.620+0000 7f522e59c640 1 -- 172.21.15.5:0/860489806 learned_addr learned my addr 172.21.15.5:0/860489806 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:45.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.620+0000 7f522ed9d640 1 --2- 172.21.15.5:0/860489806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52300b1300 0x7f52301f1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:45.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.620+0000 7f5227fff640 1 --2- 172.21.15.5:0/860489806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52300b3640 0x7f52300b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:45.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.620+0000 7f522e59c640 1 -- 172.21.15.5:0/860489806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52300b1300 msgr2=0x7f52301f1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:45.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.620+0000 7f522e59c640 1 --2- 172.21.15.5:0/860489806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52300b1300 0x7f52301f1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:45.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.620+0000 7f522e59c640 1 -- 172.21.15.5:0/860489806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52300b3640 msgr2=0x7f52300b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:45.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.620+0000 7f522e59c640 1 --2- 172.21.15.5:0/860489806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52300b3640 0x7f52300b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:45.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.620+0000 7f522e59c640 1 -- 172.21.15.5:0/860489806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52300abd00 con 0x7f521c0047d0 2023-07-14T13:32:45.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.620+0000 7f522e59c640 1 --2- 172.21.15.5:0/860489806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f521c0047d0 0x7f52301f21d0 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f522000f7f0 tx=0x7f522000fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:45.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.620+0000 7f5226ffd640 1 -- 172.21.15.5:0/860489806 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52200050d0 con 0x7f521c0047d0 2023-07-14T13:32:45.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.620+0000 7f5226ffd640 1 -- 172.21.15.5:0/860489806 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5220005230 con 0x7f521c0047d0 2023-07-14T13:32:45.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.620+0000 7f5226ffd640 1 -- 172.21.15.5:0/860489806 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522000d730 con 0x7f521c0047d0 2023-07-14T13:32:45.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.620+0000 7f5234f03640 1 -- 172.21.15.5:0/860489806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52300abfe0 con 0x7f521c0047d0 2023-07-14T13:32:45.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.620+0000 7f5234f03640 1 -- 172.21.15.5:0/860489806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52301f1550 con 0x7f521c0047d0 2023-07-14T13:32:45.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.624+0000 7f5234f03640 1 -- 172.21.15.5:0/860489806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52300678d0 con 0x7f521c0047d0 2023-07-14T13:32:45.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.624+0000 7f5226ffd640 1 -- 172.21.15.5:0/860489806 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 99) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f522000d890 con 0x7f521c0047d0 2023-07-14T13:32:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.624+0000 7f5226ffd640 1 --2- 172.21.15.5:0/860489806 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f5210066470 0x7f5210068920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.624+0000 7f5226ffd640 1 -- 172.21.15.5:0/860489806 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f5220084220 con 0x7f521c0047d0 2023-07-14T13:32:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.624+0000 7f5227fff640 1 --2- 172.21.15.5:0/860489806 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f5210066470 0x7f5210068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.628+0000 7f5227fff640 1 --2- 172.21.15.5:0/860489806 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f5210066470 0x7f5210068920 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f52180ad000 tx=0x7f52180046d0 comp rx=0 tx=0).ready entity=mgr.8792 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:45.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.628+0000 7f5226ffd640 1 -- 172.21.15.5:0/860489806 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f5220051200 con 0x7f521c0047d0 2023-07-14T13:32:45.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:45.820+0000 7f5234f03640 1 -- 172.21.15.5:0/860489806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f523006b920 con 0x7f521c0047d0 2023-07-14T13:32:46.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.080+0000 7f5226ffd640 1 -- 172.21.15.5:0/860489806 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 100) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f52200515d0 con 0x7f521c0047d0 2023-07-14T13:32:46.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.084+0000 7f5226ffd640 1 -- 172.21.15.5:0/860489806 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v100) v1 ==== 93+0+0 (secure 0 0 0) 0x7f522006df70 con 0x7f521c0047d0 2023-07-14T13:32:46.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.084+0000 7f5234f03640 1 -- 172.21.15.5:0/860489806 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f5210066470 msgr2=0x7f5210068920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:46.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.084+0000 7f5234f03640 1 --2- 172.21.15.5:0/860489806 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f5210066470 0x7f5210068920 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f52180ad000 tx=0x7f52180046d0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.084+0000 7f5234f03640 1 -- 172.21.15.5:0/860489806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f521c0047d0 msgr2=0x7f52301f21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:46.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.084+0000 7f5234f03640 1 --2- 172.21.15.5:0/860489806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f521c0047d0 0x7f52301f21d0 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f522000f7f0 tx=0x7f522000fcb0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.084+0000 7f5234f03640 1 -- 172.21.15.5:0/860489806 shutdown_connections 2023-07-14T13:32:46.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.084+0000 7f5234f03640 1 --2- 172.21.15.5:0/860489806 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f5210066470 0x7f5210068920 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.084+0000 7f5234f03640 1 --2- 172.21.15.5:0/860489806 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f52300b1300 0x7f52301f1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.084+0000 7f5234f03640 1 --2- 172.21.15.5:0/860489806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52300b3640 0x7f52300b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.088+0000 7f5234f03640 1 --2- 172.21.15.5:0/860489806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f521c0047d0 0x7f52301f21d0 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.088+0000 7f5234f03640 1 -- 172.21.15.5:0/860489806 >> 172.21.15.5:0/860489806 conn(0x7f52300afac0 msgr2=0x7f52300ada10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:46.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.088+0000 7f5234f03640 1 -- 172.21.15.5:0/860489806 shutdown_connections 2023-07-14T13:32:46.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.088+0000 7f5234f03640 1 -- 172.21.15.5:0/860489806 wait complete. 2023-07-14T13:32:46.109 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-14T13:32:46.110 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:32:46.182 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-14T13:32:46.244 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-14T13:32:46.244 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:32:46.245 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:32:46.254 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:32:46.255 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:32:46.263 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:46.260+0000 7f2bf9446180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:32:46.268 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:46.271+0000 7fd8cb4e2180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T13:32:46.271 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:32:46.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.460+0000 7f3bf1a6a640 1 Processor -- start 2023-07-14T13:32:46.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.460+0000 7f3bf1a6a640 1 -- start start 2023-07-14T13:32:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.464+0000 7f3bf1a6a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3bec158ce0 0x7f3bec070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.464+0000 7f3bf1a6a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bec0c9730 0x7f3bec0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:46.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.464+0000 7f3bf1a6a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bec0cc700 con 0x7f3bec0c8ad0 2023-07-14T13:32:46.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.464+0000 7f3bf1a6a640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bec0b0ff0 con 0x7f3bec158ce0 2023-07-14T13:32:46.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.464+0000 7f3bf1a6a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec070c80 con 0x7f3bec0c9730 2023-07-14T13:32:46.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.464+0000 7f3beb7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3bec158ce0 0x7f3bec070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:46.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.464+0000 7f3beb7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3bec158ce0 0x7f3bec070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36670/0 (socket says 172.21.15.5:36670) 2023-07-14T13:32:46.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.464+0000 7f3beb7fe640 1 -- 172.21.15.5:0/2976901917 learned_addr learned my addr 172.21.15.5:0/2976901917 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.464+0000 7f3bebfff640 1 --2- 172.21.15.5:0/2976901917 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bec0c9730 0x7f3bec0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.464+0000 7f3beb7fe640 1 -- 172.21.15.5:0/2976901917 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bec0c9730 msgr2=0x7f3bec0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.464+0000 7f3beb7fe640 1 --2- 172.21.15.5:0/2976901917 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bec0c9730 0x7f3bec0ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.464+0000 7f3beb7fe640 1 -- 172.21.15.5:0/2976901917 >> v1:172.21.15.154:6789/0 conn(0x7f3bec0c8ad0 legacy=0x7f3bec0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:46.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.464+0000 7f3beb7fe640 1 -- 172.21.15.5:0/2976901917 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bec0cbdd0 con 0x7f3bec158ce0 2023-07-14T13:32:46.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.464+0000 7f3beb7fe640 1 --2- 172.21.15.5:0/2976901917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bec158ce0 0x7f3bec070450 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc009870 tx=0x7f3bdc01e600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c79c9152d47b22 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:46.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.464+0000 7f3bea7fc640 1 -- 172.21.15.5:0/2976901917 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc0ac680 con 0x7f3bec158ce0 2023-07-14T13:32:46.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.464+0000 7f3bea7fc640 1 -- 172.21.15.5:0/2976901917 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bdc0ac7e0 con 0x7f3bec158ce0 2023-07-14T13:32:46.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.464+0000 7f3bea7fc640 1 -- 172.21.15.5:0/2976901917 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc0acb70 con 0x7f3bec158ce0 2023-07-14T13:32:46.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.468+0000 7f3bf1a6a640 1 -- 172.21.15.5:0/2976901917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bec158ce0 msgr2=0x7f3bec070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:46.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.468+0000 7f3bf1a6a640 1 --2- 172.21.15.5:0/2976901917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bec158ce0 0x7f3bec070450 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc009870 tx=0x7f3bdc01e600 comp rx=0 tx=0).stop 2023-07-14T13:32:46.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.468+0000 7f3bf1a6a640 1 -- 172.21.15.5:0/2976901917 shutdown_connections 2023-07-14T13:32:46.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.468+0000 7f3bf1a6a640 1 --2- 172.21.15.5:0/2976901917 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bec0c9730 0x7f3bec0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.468+0000 7f3bf1a6a640 1 --2- 172.21.15.5:0/2976901917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bec158ce0 0x7f3bec070450 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.468+0000 7f3bf1a6a640 1 -- 172.21.15.5:0/2976901917 >> 172.21.15.5:0/2976901917 conn(0x7f3bec0afcf0 msgr2=0x7f3bec0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:46.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.468+0000 7f3bf1a6a640 1 -- 172.21.15.5:0/2976901917 shutdown_connections 2023-07-14T13:32:46.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.468+0000 7f3bf1a6a640 1 -- 172.21.15.5:0/2976901917 wait complete. 2023-07-14T13:32:46.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.468+0000 7f3bf1a6a640 1 Processor -- start 2023-07-14T13:32:46.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.468+0000 7f3bf1a6a640 1 -- start start 2023-07-14T13:32:46.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.468+0000 7f3bf1a6a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bec0c8ad0 0x7f3bec14b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:46.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.468+0000 7f3bf1a6a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bec0c9730 0x7f3bec159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:46.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.468+0000 7f3bf1a6a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bec158ce0 0x7f3bec159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:46.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.468+0000 7f3bf1a6a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec14ce40 con 0x7f3bec0c9730 2023-07-14T13:32:46.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.468+0000 7f3bf1a6a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec1f4090 con 0x7f3bec158ce0 2023-07-14T13:32:46.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.468+0000 7f3bf1a6a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec14bda0 con 0x7f3bec0c8ad0 2023-07-14T13:32:46.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.472+0000 7f3beaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bec0c9730 0x7f3bec159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:46.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.472+0000 7f3beaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bec0c9730 0x7f3bec159230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36682/0 (socket says 172.21.15.5:36682) 2023-07-14T13:32:46.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.472+0000 7f3beaffd640 1 -- 172.21.15.5:0/1297434740 learned_addr learned my addr 172.21.15.5:0/1297434740 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:46.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.472+0000 7f3beb7fe640 1 --2- 172.21.15.5:0/1297434740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bec0c8ad0 0x7f3bec14b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:46.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.472+0000 7f3bebfff640 1 --2- 172.21.15.5:0/1297434740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bec158ce0 0x7f3bec159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:46.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.472+0000 7f3beaffd640 1 -- 172.21.15.5:0/1297434740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bec0c8ad0 msgr2=0x7f3bec14b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:46.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.472+0000 7f3beaffd640 1 --2- 172.21.15.5:0/1297434740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bec0c8ad0 0x7f3bec14b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.472+0000 7f3beaffd640 1 -- 172.21.15.5:0/1297434740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bec158ce0 msgr2=0x7f3bec159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:46.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.472+0000 7f3beaffd640 1 --2- 172.21.15.5:0/1297434740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bec158ce0 0x7f3bec159770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.472+0000 7f3beaffd640 1 -- 172.21.15.5:0/1297434740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc0094d0 con 0x7f3bec0c9730 2023-07-14T13:32:46.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.472+0000 7f3beaffd640 1 --2- 172.21.15.5:0/1297434740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bec0c9730 0x7f3bec159230 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f3be000c500 tx=0x7f3be000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:46.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.472+0000 7f3bd3fff640 1 -- 172.21.15.5:0/1297434740 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0005220 con 0x7f3bec0c9730 2023-07-14T13:32:46.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.472+0000 7f3bd3fff640 1 -- 172.21.15.5:0/1297434740 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be0005380 con 0x7f3bec0c9730 2023-07-14T13:32:46.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.472+0000 7f3bd3fff640 1 -- 172.21.15.5:0/1297434740 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0007270 con 0x7f3bec0c9730 2023-07-14T13:32:46.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.472+0000 7f3bf1a6a640 1 -- 172.21.15.5:0/1297434740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bec14c080 con 0x7f3bec0c9730 2023-07-14T13:32:46.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.472+0000 7f3bf1a6a640 1 -- 172.21.15.5:0/1297434740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bec14c640 con 0x7f3bec0c9730 2023-07-14T13:32:46.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.472+0000 7f3bf1a6a640 1 -- 172.21.15.5:0/1297434740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bec0ca1a0 con 0x7f3bec0c9730 2023-07-14T13:32:46.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.472+0000 7f3bd3fff640 1 -- 172.21.15.5:0/1297434740 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 100) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f3be00073d0 con 0x7f3bec0c9730 2023-07-14T13:32:46.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.476+0000 7f3bd3fff640 1 --2- 172.21.15.5:0/1297434740 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f3bd8066430 0x7f3bd80688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:46.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.476+0000 7f3bd3fff640 1 -- 172.21.15.5:0/1297434740 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f3be0083960 con 0x7f3bec0c9730 2023-07-14T13:32:46.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.476+0000 7f3beb7fe640 1 -- 172.21.15.5:0/1297434740 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f3bd8066430 msgr2=0x7f3bd80688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/4121325793 2023-07-14T13:32:46.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.476+0000 7f3beb7fe640 1 --2- 172.21.15.5:0/1297434740 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f3bd8066430 0x7f3bd80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:32:46.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.484+0000 7f3bd3fff640 1 -- 172.21.15.5:0/1297434740 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3be0050aa0 con 0x7f3bec0c9730 2023-07-14T13:32:46.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.640+0000 7f3bf1a6a640 1 -- 172.21.15.5:0/1297434740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3bec0678d0 con 0x7f3bec0c9730 2023-07-14T13:32:46.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.644+0000 7f3bd3fff640 1 -- 172.21.15.5:0/1297434740 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) v1 ==== 74+0+18795 (secure 0 0 0) 0x7f3be00540c0 con 0x7f3bec0c9730 2023-07-14T13:32:46.643 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:46.644 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":192,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:32:43.012951+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:32:28.300155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-14T13:32:29.622154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/3652890289":"2023-07-15T13:32:43.012909+0000","172.21.15.154:0/88577192":"2023-07-15T13:32:43.012909+0000","172.21.15.154:0/191962473":"2023-07-15T13:32:43.012909+0000","172.21.15.154:0/1728568663":"2023-07-15T13:32:43.012909+0000","172.21.15.154:0/1982074443":"2023-07-15T13:32:43.012909+0000","172.21.15.154:6833/2194391064":"2023-07-15T13:32:43.012909+0000","172.21.15.154:0/3851820787":"2023-07-15T13:32:43.012909+0000","172.21.15.154:6832/2194391064":"2023-07-15T13:32:43.012909+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:32:46.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.644+0000 7f3bf1a6a640 1 -- 172.21.15.5:0/1297434740 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f3bd8066430 msgr2=0x7f3bd80688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:32:46.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.644+0000 7f3bf1a6a640 1 --2- 172.21.15.5:0/1297434740 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f3bd8066430 0x7f3bd80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.644+0000 7f3bf1a6a640 1 -- 172.21.15.5:0/1297434740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bec0c9730 msgr2=0x7f3bec159230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:46.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.644+0000 7f3bf1a6a640 1 --2- 172.21.15.5:0/1297434740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bec0c9730 0x7f3bec159230 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f3be000c500 tx=0x7f3be000c9c0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.644+0000 7f3bf1a6a640 1 -- 172.21.15.5:0/1297434740 shutdown_connections 2023-07-14T13:32:46.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.644+0000 7f3bf1a6a640 1 --2- 172.21.15.5:0/1297434740 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f3bd8066430 0x7f3bd80688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.644+0000 7f3bf1a6a640 1 --2- 172.21.15.5:0/1297434740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bec158ce0 0x7f3bec159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.644+0000 7f3bf1a6a640 1 --2- 172.21.15.5:0/1297434740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bec0c9730 0x7f3bec159230 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.644+0000 7f3bf1a6a640 1 --2- 172.21.15.5:0/1297434740 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bec0c8ad0 0x7f3bec14b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.644+0000 7f3bf1a6a640 1 -- 172.21.15.5:0/1297434740 >> 172.21.15.5:0/1297434740 conn(0x7f3bec0afcf0 msgr2=0x7f3bec156db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:46.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.644+0000 7f3bf1a6a640 1 -- 172.21.15.5:0/1297434740 shutdown_connections 2023-07-14T13:32:46.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.644+0000 7f3bf1a6a640 1 -- 172.21.15.5:0/1297434740 wait complete. 2023-07-14T13:32:46.667 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T13:32:28.300155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '190', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T13:32:29.622154+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '191', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:32:46.668 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:32:46.686 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:46.691+0000 7fd8cb4e2180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:32:46.714 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:46.712+0000 7f2bf9446180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T13:32:46.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.816+0000 7f1baf4d8640 1 Processor -- start 2023-07-14T13:32:46.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.816+0000 7f1baf4d8640 1 -- start start 2023-07-14T13:32:46.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.820+0000 7f1baf4d8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1ba815bde0 0x7f1ba80d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:46.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.820+0000 7f1baf4d8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1ba80d2300 0x7f1ba80d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:46.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.820+0000 7f1baf4d8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ba80b04c0 con 0x7f1ba80d2fc0 2023-07-14T13:32:46.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.820+0000 7f1baf4d8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba815c1b0 con 0x7f1ba815bde0 2023-07-14T13:32:46.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.820+0000 7f1baf4d8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba80b1060 con 0x7f1ba80d2300 2023-07-14T13:32:46.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.820+0000 7f1bad274640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1ba815bde0 0x7f1ba80d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:46.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.820+0000 7f1baca73640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1ba80d2fc0 0x7f1ba80b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47920/0 (socket says 172.21.15.5:47920) 2023-07-14T13:32:46.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.820+0000 7f1baca73640 1 -- 172.21.15.5:0/22498442 learned_addr learned my addr 172.21.15.5:0/22498442 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:46.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.820+0000 7f1bada75640 1 --2- 172.21.15.5:0/22498442 >> v2:172.21.15.154:3300/0 conn(0x7f1ba80d2300 0x7f1ba80d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:46.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.820+0000 7f1b9ffff640 1 -- 172.21.15.5:0/22498442 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380010055 0 0) 0x7f1ba80b04c0 con 0x7f1ba80d2fc0 2023-07-14T13:32:46.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.820+0000 7f1b9ffff640 1 -- 172.21.15.5:0/22498442 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b94003530 con 0x7f1ba80d2fc0 2023-07-14T13:32:46.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.820+0000 7f1bad274640 1 -- 172.21.15.5:0/22498442 >> v2:172.21.15.154:3300/0 conn(0x7f1ba80d2300 msgr2=0x7f1ba80d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:46.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.820+0000 7f1bad274640 1 --2- 172.21.15.5:0/22498442 >> v2:172.21.15.154:3300/0 conn(0x7f1ba80d2300 0x7f1ba80d2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.820+0000 7f1bad274640 1 -- 172.21.15.5:0/22498442 >> v1:172.21.15.5:6789/0 conn(0x7f1ba80d2fc0 legacy=0x7f1ba80b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:46.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.820+0000 7f1bad274640 1 -- 172.21.15.5:0/22498442 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba80d2c80 con 0x7f1ba815bde0 2023-07-14T13:32:46.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.824+0000 7f1bad274640 1 --2- 172.21.15.5:0/22498442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba815bde0 0x7f1ba80d0270 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f1ba808c820 tx=0x7f1ba401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d9f24275f9d2ee server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:46.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.824+0000 7f1b9ffff640 1 -- 172.21.15.5:0/22498442 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba4004230 con 0x7f1ba815bde0 2023-07-14T13:32:46.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.824+0000 7f1b9ffff640 1 -- 172.21.15.5:0/22498442 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba40a7050 con 0x7f1ba815bde0 2023-07-14T13:32:46.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.824+0000 7f1b9ffff640 1 -- 172.21.15.5:0/22498442 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba4003620 con 0x7f1ba815bde0 2023-07-14T13:32:46.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.824+0000 7f1baf4d8640 1 -- 172.21.15.5:0/22498442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba815bde0 msgr2=0x7f1ba80d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:46.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.824+0000 7f1baf4d8640 1 --2- 172.21.15.5:0/22498442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba815bde0 0x7f1ba80d0270 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f1ba808c820 tx=0x7f1ba401c440 comp rx=0 tx=0).stop 2023-07-14T13:32:46.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.824+0000 7f1baf4d8640 1 -- 172.21.15.5:0/22498442 shutdown_connections 2023-07-14T13:32:46.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.824+0000 7f1baf4d8640 1 --2- 172.21.15.5:0/22498442 >> v2:172.21.15.154:3300/0 conn(0x7f1ba80d2300 0x7f1ba80d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.824+0000 7f1baf4d8640 1 --2- 172.21.15.5:0/22498442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba815bde0 0x7f1ba80d0270 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.824+0000 7f1baf4d8640 1 -- 172.21.15.5:0/22498442 >> 172.21.15.5:0/22498442 conn(0x7f1ba80659d0 msgr2=0x7f1ba809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:46.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.824+0000 7f1baf4d8640 1 -- 172.21.15.5:0/22498442 shutdown_connections 2023-07-14T13:32:46.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.824+0000 7f1baf4d8640 1 -- 172.21.15.5:0/22498442 wait complete. 2023-07-14T13:32:46.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.824+0000 7f1baf4d8640 1 Processor -- start 2023-07-14T13:32:46.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.824+0000 7f1baf4d8640 1 -- start start 2023-07-14T13:32:46.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.828+0000 7f1baf4d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ba80d2300 0x7f1ba8154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:46.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.828+0000 7f1baf4d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba80d2fc0 0x7f1ba80c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:46.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.828+0000 7f1baf4d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ba815bde0 0x7f1ba81596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:46.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.828+0000 7f1baf4d8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba8151a00 con 0x7f1ba80d2fc0 2023-07-14T13:32:46.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.828+0000 7f1baf4d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba8150280 con 0x7f1ba80d2300 2023-07-14T13:32:46.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.828+0000 7f1baf4d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba8150560 con 0x7f1ba815bde0 2023-07-14T13:32:46.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.828+0000 7f1baca73640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba80d2fc0 0x7f1ba80c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:46.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.828+0000 7f1bad274640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ba80d2300 0x7f1ba8154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:46.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.828+0000 7f1baca73640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba80d2fc0 0x7f1ba80c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36698/0 (socket says 172.21.15.5:36698) 2023-07-14T13:32:46.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.828+0000 7f1baca73640 1 -- 172.21.15.5:0/2110255604 learned_addr learned my addr 172.21.15.5:0/2110255604 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:46.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.828+0000 7f1bada75640 1 --2- 172.21.15.5:0/2110255604 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ba815bde0 0x7f1ba81596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:46.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.828+0000 7f1baca73640 1 -- 172.21.15.5:0/2110255604 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ba815bde0 msgr2=0x7f1ba81596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:46.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.828+0000 7f1baca73640 1 --2- 172.21.15.5:0/2110255604 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ba815bde0 0x7f1ba81596f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.828+0000 7f1baca73640 1 -- 172.21.15.5:0/2110255604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ba80d2300 msgr2=0x7f1ba8154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:46.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.828+0000 7f1baca73640 1 --2- 172.21.15.5:0/2110255604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ba80d2300 0x7f1ba8154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.828+0000 7f1baca73640 1 -- 172.21.15.5:0/2110255604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba40093b0 con 0x7f1ba80d2fc0 2023-07-14T13:32:46.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.828+0000 7f1baca73640 1 --2- 172.21.15.5:0/2110255604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba80d2fc0 0x7f1ba80c5ea0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f1b9800c420 tx=0x7f1b9800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:46.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.828+0000 7f1b9dffb640 1 -- 172.21.15.5:0/2110255604 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b98005cf0 con 0x7f1ba80d2fc0 2023-07-14T13:32:46.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.828+0000 7f1b9dffb640 1 -- 172.21.15.5:0/2110255604 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b98005e70 con 0x7f1ba80d2fc0 2023-07-14T13:32:46.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.828+0000 7f1baf4d8640 1 -- 172.21.15.5:0/2110255604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba8150840 con 0x7f1ba80d2fc0 2023-07-14T13:32:46.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.828+0000 7f1b9dffb640 1 -- 172.21.15.5:0/2110255604 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b980072f0 con 0x7f1ba80d2fc0 2023-07-14T13:32:46.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.828+0000 7f1baf4d8640 1 -- 172.21.15.5:0/2110255604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba8150e00 con 0x7f1ba80d2fc0 2023-07-14T13:32:46.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.828+0000 7f1baf4d8640 1 -- 172.21.15.5:0/2110255604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba8150ff0 con 0x7f1ba80d2fc0 2023-07-14T13:32:46.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.832+0000 7f1b9dffb640 1 -- 172.21.15.5:0/2110255604 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 100) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f1b98007490 con 0x7f1ba80d2fc0 2023-07-14T13:32:46.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.832+0000 7f1b9dffb640 1 --2- 172.21.15.5:0/2110255604 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f1b8c066430 0x7f1b8c0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:46.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.832+0000 7f1b9dffb640 1 -- 172.21.15.5:0/2110255604 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f1b98083780 con 0x7f1ba80d2fc0 2023-07-14T13:32:46.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.832+0000 7f1bad274640 1 -- 172.21.15.5:0/2110255604 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f1b8c066430 msgr2=0x7f1b8c0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/4121325793 2023-07-14T13:32:46.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.832+0000 7f1bad274640 1 --2- 172.21.15.5:0/2110255604 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f1b8c066430 0x7f1b8c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:32:46.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.836+0000 7f1b9dffb640 1 -- 172.21.15.5:0/2110255604 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f1b98050980 con 0x7f1ba80d2fc0 2023-07-14T13:32:46.837 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:46.843+0000 7fd8cb4e2180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:32:46.877 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:46.876+0000 7f2bf9446180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T13:32:46.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.992+0000 7f1baf4d8640 1 -- 172.21.15.5:0/2110255604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1ba80678d0 con 0x7f1ba80d2fc0 2023-07-14T13:32:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.992+0000 7f1b9dffb640 1 -- 172.21.15.5:0/2110255604 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v192) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1b98017020 con 0x7f1ba80d2fc0 2023-07-14T13:32:46.992 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:32:46.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.992+0000 7f1baf4d8640 1 -- 172.21.15.5:0/2110255604 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f1b8c066430 msgr2=0x7f1b8c0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:32:46.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.992+0000 7f1baf4d8640 1 --2- 172.21.15.5:0/2110255604 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f1b8c066430 0x7f1b8c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.992+0000 7f1baf4d8640 1 -- 172.21.15.5:0/2110255604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba80d2fc0 msgr2=0x7f1ba80c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:46.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.992+0000 7f1baf4d8640 1 --2- 172.21.15.5:0/2110255604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba80d2fc0 0x7f1ba80c5ea0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f1b9800c420 tx=0x7f1b9800c8e0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.992+0000 7f1baf4d8640 1 -- 172.21.15.5:0/2110255604 shutdown_connections 2023-07-14T13:32:46.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.992+0000 7f1baf4d8640 1 --2- 172.21.15.5:0/2110255604 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f1b8c066430 0x7f1b8c0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.992+0000 7f1baf4d8640 1 --2- 172.21.15.5:0/2110255604 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ba815bde0 0x7f1ba81596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.992+0000 7f1baf4d8640 1 --2- 172.21.15.5:0/2110255604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba80d2fc0 0x7f1ba80c5ea0 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.992+0000 7f1baf4d8640 1 --2- 172.21.15.5:0/2110255604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ba80d2300 0x7f1ba8154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:46.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.992+0000 7f1baf4d8640 1 -- 172.21.15.5:0/2110255604 >> 172.21.15.5:0/2110255604 conn(0x7f1ba80659d0 msgr2=0x7f1ba80cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:46.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.992+0000 7f1baf4d8640 1 -- 172.21.15.5:0/2110255604 shutdown_connections 2023-07-14T13:32:46.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:46.992+0000 7f1baf4d8640 1 -- 172.21.15.5:0/2110255604 wait complete. 2023-07-14T13:32:47.014 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:32:47.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.208+0000 7faa01174640 1 Processor -- start 2023-07-14T13:32:47.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.208+0000 7faa01174640 1 -- start start 2023-07-14T13:32:47.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.208+0000 7faa01174640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa9fc15f320 0x7fa9fc0d22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:47.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.208+0000 7faa01174640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa9fc0d0230 0x7fa9fc0d2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.208+0000 7faa01174640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9fc0b0230 con 0x7fa9fc0b3690 2023-07-14T13:32:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.208+0000 7faa01174640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9fc0d0a60 con 0x7fa9fc0d0230 2023-07-14T13:32:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.208+0000 7faa01174640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9fc0af9d0 con 0x7fa9fc15f320 2023-07-14T13:32:47.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.208+0000 7fa9fa59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa9fc0d0230 0x7fa9fc0d2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:47.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.208+0000 7fa9fa59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa9fc0d0230 0x7fa9fc0d2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36704/0 (socket says 172.21.15.5:36704) 2023-07-14T13:32:47.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.208+0000 7fa9fa59c640 1 -- 172.21.15.5:0/4250330952 learned_addr learned my addr 172.21.15.5:0/4250330952 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:47.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.208+0000 7fa9fad9d640 1 --2- 172.21.15.5:0/4250330952 >> v2:172.21.15.154:3300/0 conn(0x7fa9fc15f320 0x7fa9fc0d22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:47.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.208+0000 7fa9fa59c640 1 -- 172.21.15.5:0/4250330952 >> v2:172.21.15.154:3300/0 conn(0x7fa9fc15f320 msgr2=0x7fa9fc0d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:47.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.208+0000 7fa9fa59c640 1 --2- 172.21.15.5:0/4250330952 >> v2:172.21.15.154:3300/0 conn(0x7fa9fc15f320 0x7fa9fc0d22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:47.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.208+0000 7fa9fa59c640 1 -- 172.21.15.5:0/4250330952 >> v1:172.21.15.5:6789/0 conn(0x7fa9fc0b3690 legacy=0x7fa9fc0b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:47.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.208+0000 7fa9fa59c640 1 -- 172.21.15.5:0/4250330952 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9fc0d0780 con 0x7fa9fc0d0230 2023-07-14T13:32:47.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.212+0000 7fa9fa59c640 1 --2- 172.21.15.5:0/4250330952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9fc0d0230 0x7fa9fc0d2800 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009870 tx=0x7fa9f001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74310c44afb3611 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:47.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.212+0000 7fa9f9d9b640 1 -- 172.21.15.5:0/4250330952 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f00ab5f0 con 0x7fa9fc0d0230 2023-07-14T13:32:47.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.212+0000 7fa9f9d9b640 1 -- 172.21.15.5:0/4250330952 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f00ab750 con 0x7fa9fc0d0230 2023-07-14T13:32:47.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.212+0000 7fa9f9d9b640 1 -- 172.21.15.5:0/4250330952 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f00abae0 con 0x7fa9fc0d0230 2023-07-14T13:32:47.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.212+0000 7faa01174640 1 -- 172.21.15.5:0/4250330952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9fc0d0230 msgr2=0x7fa9fc0d2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.212+0000 7faa01174640 1 --2- 172.21.15.5:0/4250330952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9fc0d0230 0x7fa9fc0d2800 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009870 tx=0x7fa9f001c500 comp rx=0 tx=0).stop 2023-07-14T13:32:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.212+0000 7faa01174640 1 -- 172.21.15.5:0/4250330952 shutdown_connections 2023-07-14T13:32:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.212+0000 7faa01174640 1 --2- 172.21.15.5:0/4250330952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9fc0d0230 0x7fa9fc0d2800 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.212+0000 7faa01174640 1 --2- 172.21.15.5:0/4250330952 >> v2:172.21.15.154:3300/0 conn(0x7fa9fc15f320 0x7fa9fc0d22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.212+0000 7faa01174640 1 -- 172.21.15.5:0/4250330952 >> 172.21.15.5:0/4250330952 conn(0x7fa9fc0659d0 msgr2=0x7fa9fc09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.212+0000 7faa01174640 1 -- 172.21.15.5:0/4250330952 shutdown_connections 2023-07-14T13:32:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.212+0000 7faa01174640 1 -- 172.21.15.5:0/4250330952 wait complete. 2023-07-14T13:32:47.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.216+0000 7faa01174640 1 Processor -- start 2023-07-14T13:32:47.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.216+0000 7faa01174640 1 -- start start 2023-07-14T13:32:47.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.216+0000 7faa01174640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9fc0b3690 0x7fa9fc0b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:47.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.216+0000 7faa01174640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9fc0d0230 0x7fa9fc14f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:47.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.216+0000 7faa01174640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9fc15f320 0x7fa9fc14d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:47.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.216+0000 7faa01174640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc0b59c0 con 0x7fa9fc0d0230 2023-07-14T13:32:47.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.216+0000 7faa01174640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc0b7fc0 con 0x7fa9fc0b3690 2023-07-14T13:32:47.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.216+0000 7faa01174640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc14ee10 con 0x7fa9fc15f320 2023-07-14T13:32:47.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.216+0000 7fa9fa59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9fc0d0230 0x7fa9fc14f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:47.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.216+0000 7fa9fa59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9fc0d0230 0x7fa9fc14f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36714/0 (socket says 172.21.15.5:36714) 2023-07-14T13:32:47.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.216+0000 7fa9fa59c640 1 -- 172.21.15.5:0/2431477739 learned_addr learned my addr 172.21.15.5:0/2431477739 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:47.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.216+0000 7fa9fad9d640 1 --2- 172.21.15.5:0/2431477739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9fc0b3690 0x7fa9fc0b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:47.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.216+0000 7fa9fb59e640 1 --2- 172.21.15.5:0/2431477739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9fc15f320 0x7fa9fc14d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:47.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.220+0000 7fa9fa59c640 1 -- 172.21.15.5:0/2431477739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9fc15f320 msgr2=0x7fa9fc14d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:47.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.220+0000 7fa9fa59c640 1 --2- 172.21.15.5:0/2431477739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9fc15f320 0x7fa9fc14d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:47.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.220+0000 7fa9fa59c640 1 -- 172.21.15.5:0/2431477739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9fc0b3690 msgr2=0x7fa9fc0b7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:47.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.220+0000 7fa9fa59c640 1 --2- 172.21.15.5:0/2431477739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9fc0b3690 0x7fa9fc0b7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:47.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.220+0000 7fa9fa59c640 1 -- 172.21.15.5:0/2431477739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f00094d0 con 0x7fa9fc0d0230 2023-07-14T13:32:47.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.220+0000 7fa9fad9d640 1 --2- 172.21.15.5:0/2431477739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9fc0b3690 0x7fa9fc0b7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:32:47.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.220+0000 7fa9fa59c640 1 --2- 172.21.15.5:0/2431477739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9fc0d0230 0x7fa9fc14f2a0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7fa9f00ad040 tx=0x7fa9f001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:47.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.220+0000 7fa9e37fe640 1 -- 172.21.15.5:0/2431477739 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f00be5f0 con 0x7fa9fc0d0230 2023-07-14T13:32:47.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.220+0000 7fa9e37fe640 1 -- 172.21.15.5:0/2431477739 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f00be770 con 0x7fa9fc0d0230 2023-07-14T13:32:47.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.220+0000 7faa01174640 1 -- 172.21.15.5:0/2431477739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9fc14e200 con 0x7fa9fc0d0230 2023-07-14T13:32:47.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.220+0000 7fa9e37fe640 1 -- 172.21.15.5:0/2431477739 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f00beb20 con 0x7fa9fc0d0230 2023-07-14T13:32:47.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.220+0000 7faa01174640 1 -- 172.21.15.5:0/2431477739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9fc14e7c0 con 0x7fa9fc0d0230 2023-07-14T13:32:47.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.220+0000 7faa01174640 1 -- 172.21.15.5:0/2431477739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9fc14ef80 con 0x7fa9fc0d0230 2023-07-14T13:32:47.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.220+0000 7fa9e37fe640 1 -- 172.21.15.5:0/2431477739 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 100) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fa9f00b43f0 con 0x7fa9fc0d0230 2023-07-14T13:32:47.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.224+0000 7fa9e37fe640 1 --2- 172.21.15.5:0/2431477739 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fa9e8066430 0x7fa9e80688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:47.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.224+0000 7fa9e37fe640 1 -- 172.21.15.5:0/2431477739 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6434+0+0 (secure 0 0 0) 0x7fa9f00a8050 con 0x7fa9fc0d0230 2023-07-14T13:32:47.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.224+0000 7fa9fad9d640 1 -- 172.21.15.5:0/2431477739 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fa9e8066430 msgr2=0x7fa9e80688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/4121325793 2023-07-14T13:32:47.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.224+0000 7fa9fad9d640 1 --2- 172.21.15.5:0/2431477739 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fa9e8066430 0x7fa9e80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:32:47.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.228+0000 7fa9e37fe640 1 -- 172.21.15.5:0/2431477739 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa9f00ebe90 con 0x7fa9fc0d0230 2023-07-14T13:32:47.325 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:47.331+0000 7fd8cb4e2180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:32:47.384 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:47.387+0000 7fd8cb4e2180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:32:47.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.384+0000 7faa01174640 1 -- 172.21.15.5:0/2431477739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa9fc0678d0 con 0x7fa9fc0d0230 2023-07-14T13:32:47.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.384+0000 7fa9e37fe640 1 -- 172.21.15.5:0/2431477739 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v192) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa9f00ef4b0 con 0x7fa9fc0d0230 2023-07-14T13:32:47.386 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:32:47.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.388+0000 7faa01174640 1 -- 172.21.15.5:0/2431477739 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fa9e8066430 msgr2=0x7fa9e80688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:32:47.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.388+0000 7faa01174640 1 --2- 172.21.15.5:0/2431477739 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fa9e8066430 0x7fa9e80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:47.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.388+0000 7faa01174640 1 -- 172.21.15.5:0/2431477739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9fc0d0230 msgr2=0x7fa9fc14f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:47.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.388+0000 7faa01174640 1 --2- 172.21.15.5:0/2431477739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9fc0d0230 0x7fa9fc14f2a0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7fa9f00ad040 tx=0x7fa9f001ad40 comp rx=0 tx=0).stop 2023-07-14T13:32:47.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.388+0000 7faa01174640 1 -- 172.21.15.5:0/2431477739 shutdown_connections 2023-07-14T13:32:47.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.388+0000 7faa01174640 1 --2- 172.21.15.5:0/2431477739 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fa9e8066430 0x7fa9e80688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:47.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.388+0000 7faa01174640 1 --2- 172.21.15.5:0/2431477739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa9fc15f320 0x7fa9fc14d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:47.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.388+0000 7faa01174640 1 --2- 172.21.15.5:0/2431477739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9fc0d0230 0x7fa9fc14f2a0 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:47.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.388+0000 7faa01174640 1 --2- 172.21.15.5:0/2431477739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa9fc0b3690 0x7fa9fc0b7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:47.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.388+0000 7faa01174640 1 -- 172.21.15.5:0/2431477739 >> 172.21.15.5:0/2431477739 conn(0x7fa9fc0659d0 msgr2=0x7fa9fc15ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:47.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.388+0000 7faa01174640 1 -- 172.21.15.5:0/2431477739 shutdown_connections 2023-07-14T13:32:47.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.388+0000 7faa01174640 1 -- 172.21.15.5:0/2431477739 wait complete. 2023-07-14T13:32:47.404 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:47.404+0000 7f2bf9446180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T13:32:47.408 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T13:32:47.440 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:47.443+0000 7fd8cb4e2180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:32:47.470 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:47.468+0000 7f2bf9446180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T13:32:47.527 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:47.531+0000 7fd8cb4e2180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:32:47.530 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:47.528+0000 7f2bf9446180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T13:32:47.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.560+0000 7f12f4340640 1 Processor -- start 2023-07-14T13:32:47.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.560+0000 7f12f4340640 1 -- start start 2023-07-14T13:32:47.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.560+0000 7f12f4340640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12ec0d2fc0 0x7f12ec0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:47.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.560+0000 7f12f4340640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ec0b04c0 con 0x7f12ec0d2300 2023-07-14T13:32:47.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.560+0000 7f12f4340640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ec0d0aa0 con 0x7f12ec15bde0 2023-07-14T13:32:47.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.560+0000 7f12f4340640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12ec15c1b0 con 0x7f12ec0d2fc0 2023-07-14T13:32:47.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.560+0000 7f12f28dd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f12ec0d2300 0x7f12ec0cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47938/0 (socket says 172.21.15.5:47938) 2023-07-14T13:32:47.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.560+0000 7f12f28dd640 1 -- 172.21.15.5:0/862555459 learned_addr learned my addr 172.21.15.5:0/862555459 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:47.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.560+0000 7f12f18db640 1 --2- 172.21.15.5:0/862555459 >> v2:172.21.15.154:3300/0 conn(0x7f12ec0d2fc0 0x7f12ec0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:47.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.560+0000 7f12f10da640 1 -- 172.21.15.5:0/862555459 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4209781516 0 0) 0x7f12ec0b04c0 con 0x7f12ec0d2300 2023-07-14T13:32:47.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.560+0000 7f12f10da640 1 -- 172.21.15.5:0/862555459 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12d8003530 con 0x7f12ec0d2300 2023-07-14T13:32:47.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.560+0000 7f12f18db640 1 -- 172.21.15.5:0/862555459 >> v1:172.21.15.154:6789/0 conn(0x7f12ec15bde0 legacy=0x7f12ec0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:47.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.560+0000 7f12f18db640 1 -- 172.21.15.5:0/862555459 >> v1:172.21.15.5:6789/0 conn(0x7f12ec0d2300 legacy=0x7f12ec0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:47.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.560+0000 7f12f18db640 1 -- 172.21.15.5:0/862555459 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec0afb90 con 0x7f12ec0d2fc0 2023-07-14T13:32:47.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.564+0000 7f12f18db640 1 --2- 172.21.15.5:0/862555459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12ec0d2fc0 0x7f12ec0b0950 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0097c0 tx=0x7f12dc01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c721d7f4614da547 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:47.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.564+0000 7f12f10da640 1 -- 172.21.15.5:0/862555459 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc0ab680 con 0x7f12ec0d2fc0 2023-07-14T13:32:47.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.564+0000 7f12f10da640 1 -- 172.21.15.5:0/862555459 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12dc0ab7e0 con 0x7f12ec0d2fc0 2023-07-14T13:32:47.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.564+0000 7f12f10da640 1 -- 172.21.15.5:0/862555459 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc0abb70 con 0x7f12ec0d2fc0 2023-07-14T13:32:47.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.564+0000 7f12f4340640 1 -- 172.21.15.5:0/862555459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12ec0d2fc0 msgr2=0x7f12ec0b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:47.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.564+0000 7f12f4340640 1 --2- 172.21.15.5:0/862555459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12ec0d2fc0 0x7f12ec0b0950 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0097c0 tx=0x7f12dc01c480 comp rx=0 tx=0).stop 2023-07-14T13:32:47.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.564+0000 7f12f4340640 1 -- 172.21.15.5:0/862555459 shutdown_connections 2023-07-14T13:32:47.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.564+0000 7f12f4340640 1 --2- 172.21.15.5:0/862555459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12ec0d2fc0 0x7f12ec0b0950 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:47.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.564+0000 7f12f4340640 1 -- 172.21.15.5:0/862555459 >> 172.21.15.5:0/862555459 conn(0x7f12ec0659d0 msgr2=0x7f12ec09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:47.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.564+0000 7f12f4340640 1 -- 172.21.15.5:0/862555459 shutdown_connections 2023-07-14T13:32:47.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.564+0000 7f12f4340640 1 -- 172.21.15.5:0/862555459 wait complete. 2023-07-14T13:32:47.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.568+0000 7f12f4340640 1 Processor -- start 2023-07-14T13:32:47.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.568+0000 7f12f4340640 1 -- start start 2023-07-14T13:32:47.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.568+0000 7f12f4340640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12ec0d2300 0x7f12ec06b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:47.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.568+0000 7f12f4340640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12ec0d2fc0 0x7f12ec150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:47.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.568+0000 7f12f4340640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12ec15bde0 0x7f12ec150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:47.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.568+0000 7f12f4340640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec150dd0 con 0x7f12ec0d2fc0 2023-07-14T13:32:47.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.568+0000 7f12f4340640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec0b2230 con 0x7f12ec0d2300 2023-07-14T13:32:47.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.568+0000 7f12f4340640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec0b1190 con 0x7f12ec15bde0 2023-07-14T13:32:47.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.568+0000 7f12f20dc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12ec0d2300 0x7f12ec06b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:47.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.568+0000 7f12f18db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12ec0d2fc0 0x7f12ec150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:47.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.568+0000 7f12f20dc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12ec0d2300 0x7f12ec06b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:58808/0 (socket says 172.21.15.5:58808) 2023-07-14T13:32:47.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.568+0000 7f12f20dc640 1 -- 172.21.15.5:0/4167580979 learned_addr learned my addr 172.21.15.5:0/4167580979 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:47.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.568+0000 7f12f28dd640 1 --2- 172.21.15.5:0/4167580979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12ec15bde0 0x7f12ec150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:47.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.568+0000 7f12f20dc640 1 -- 172.21.15.5:0/4167580979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12ec15bde0 msgr2=0x7f12ec150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:47.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.568+0000 7f12f20dc640 1 --2- 172.21.15.5:0/4167580979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12ec15bde0 0x7f12ec150890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:47.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.568+0000 7f12f20dc640 1 -- 172.21.15.5:0/4167580979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12ec0d2fc0 msgr2=0x7f12ec150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:47.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.568+0000 7f12f20dc640 1 --2- 172.21.15.5:0/4167580979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12ec0d2fc0 0x7f12ec150350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:47.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.568+0000 7f12f20dc640 1 -- 172.21.15.5:0/4167580979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc009420 con 0x7f12ec0d2300 2023-07-14T13:32:47.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.568+0000 7f12f20dc640 1 --2- 172.21.15.5:0/4167580979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12ec0d2300 0x7f12ec06b200 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f12e800c450 tx=0x7f12e800c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:47.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.568+0000 7f12e2ffd640 1 -- 172.21.15.5:0/4167580979 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e80052d0 con 0x7f12ec0d2300 2023-07-14T13:32:47.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.568+0000 7f12e2ffd640 1 -- 172.21.15.5:0/4167580979 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e8005430 con 0x7f12ec0d2300 2023-07-14T13:32:47.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.568+0000 7f12e2ffd640 1 -- 172.21.15.5:0/4167580979 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8003890 con 0x7f12ec0d2300 2023-07-14T13:32:47.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.568+0000 7f12f4340640 1 -- 172.21.15.5:0/4167580979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12ec0b1470 con 0x7f12ec0d2300 2023-07-14T13:32:47.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.568+0000 7f12f4340640 1 -- 172.21.15.5:0/4167580979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12ec0b1a30 con 0x7f12ec0d2300 2023-07-14T13:32:47.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.572+0000 7f12f4340640 1 -- 172.21.15.5:0/4167580979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12ec0678d0 con 0x7f12ec0d2300 2023-07-14T13:32:47.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.572+0000 7f12e2ffd640 1 -- 172.21.15.5:0/4167580979 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 100) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f12e80039f0 con 0x7f12ec0d2300 2023-07-14T13:32:47.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.572+0000 7f12e2ffd640 1 --2- 172.21.15.5:0/4167580979 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f12d0066430 0x7f12d00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:47.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.572+0000 7f12e2ffd640 1 -- 172.21.15.5:0/4167580979 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f12e8083b30 con 0x7f12ec0d2300 2023-07-14T13:32:47.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.572+0000 7f12f18db640 1 -- 172.21.15.5:0/4167580979 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f12d0066430 msgr2=0x7f12d00688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/4121325793 2023-07-14T13:32:47.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.572+0000 7f12f18db640 1 --2- 172.21.15.5:0/4167580979 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f12d0066430 0x7f12d00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:32:47.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.576+0000 7f12e2ffd640 1 -- 172.21.15.5:0/4167580979 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f12e8050cf0 con 0x7f12ec0d2300 2023-07-14T13:32:47.586 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:47.591+0000 7fd8cb4e2180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:32:47.625 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:47.624+0000 7f2bf9446180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T13:32:47.672 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:47.675+0000 7fd8cb4e2180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:32:47.685 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:47.684+0000 7f2bf9446180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T13:32:47.729 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:47.735+0000 7fd8cb4e2180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:32:47.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.732+0000 7f12f4340640 1 -- 172.21.15.5:0/4167580979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f12ec0cd8f0 con 0x7f12ec0d2300 2023-07-14T13:32:47.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.732+0000 7f12e2ffd640 1 -- 172.21.15.5:0/4167580979 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v192) v1 ==== 104+0+11 (secure 0 0 0) 0x7f12e8054310 con 0x7f12ec0d2300 2023-07-14T13:32:47.734 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T13:32:47.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.736+0000 7f12f4340640 1 -- 172.21.15.5:0/4167580979 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f12d0066430 msgr2=0x7f12d00688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:32:47.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.736+0000 7f12f4340640 1 --2- 172.21.15.5:0/4167580979 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f12d0066430 0x7f12d00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:47.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.736+0000 7f12f4340640 1 -- 172.21.15.5:0/4167580979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12ec0d2300 msgr2=0x7f12ec06b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:47.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.736+0000 7f12f4340640 1 --2- 172.21.15.5:0/4167580979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12ec0d2300 0x7f12ec06b200 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f12e800c450 tx=0x7f12e800c910 comp rx=0 tx=0).stop 2023-07-14T13:32:47.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.736+0000 7f12f4340640 1 -- 172.21.15.5:0/4167580979 shutdown_connections 2023-07-14T13:32:47.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.736+0000 7f12f4340640 1 --2- 172.21.15.5:0/4167580979 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f12d0066430 0x7f12d00688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:47.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.736+0000 7f12f4340640 1 --2- 172.21.15.5:0/4167580979 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12ec15bde0 0x7f12ec150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:47.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.736+0000 7f12f4340640 1 --2- 172.21.15.5:0/4167580979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12ec0d2fc0 0x7f12ec150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:47.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.736+0000 7f12f4340640 1 --2- 172.21.15.5:0/4167580979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12ec0d2300 0x7f12ec06b200 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:47.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.736+0000 7f12f4340640 1 -- 172.21.15.5:0/4167580979 >> 172.21.15.5:0/4167580979 conn(0x7f12ec0659d0 msgr2=0x7f12ec0cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:47.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.736+0000 7f12f4340640 1 -- 172.21.15.5:0/4167580979 shutdown_connections 2023-07-14T13:32:47.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.736+0000 7f12f4340640 1 -- 172.21.15.5:0/4167580979 wait complete. 2023-07-14T13:32:47.755 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T13:32:47.778 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:47.776+0000 7f2bf9446180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T13:32:47.839 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:47.836+0000 7f2bf9446180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T13:32:47.872 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:47.875+0000 7fd8cb4e2180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:32:47.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.904+0000 7fbf022d8640 1 Processor -- start 2023-07-14T13:32:47.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.904+0000 7fbf022d8640 1 -- start start 2023-07-14T13:32:47.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.904+0000 7fbf022d8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbefc15be30 0x7fbefc0d0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:47.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.904+0000 7fbf022d8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbefc160030 0x7fbefc0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:47.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.904+0000 7fbf022d8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbefc0aefc0 con 0x7fbefc0d0770 2023-07-14T13:32:47.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.904+0000 7fbf022d8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbefc0af2a0 con 0x7fbefc15be30 2023-07-14T13:32:47.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.904+0000 7fbf022d8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbefc15c200 con 0x7fbefc160030 2023-07-14T13:32:47.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.908+0000 7fbefbfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbefc15be30 0x7fbefc0d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:47.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.908+0000 7fbefb7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbefc0d0770 0x7fbefc15f920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:47944/0 (socket says 172.21.15.5:47944) 2023-07-14T13:32:47.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.908+0000 7fbefb7fe640 1 -- 172.21.15.5:0/3046459614 learned_addr learned my addr 172.21.15.5:0/3046459614 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:47.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.908+0000 7fbf00875640 1 --2- 172.21.15.5:0/3046459614 >> v2:172.21.15.154:3300/0 conn(0x7fbefc160030 0x7fbefc0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:47.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.908+0000 7fbefbfff640 1 -- 172.21.15.5:0/3046459614 >> v2:172.21.15.154:3300/0 conn(0x7fbefc160030 msgr2=0x7fbefc0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:47.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.908+0000 7fbefbfff640 1 --2- 172.21.15.5:0/3046459614 >> v2:172.21.15.154:3300/0 conn(0x7fbefc160030 0x7fbefc0af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:47.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.908+0000 7fbefbfff640 1 -- 172.21.15.5:0/3046459614 >> v1:172.21.15.5:6789/0 conn(0x7fbefc0d0770 legacy=0x7fbefc15f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.908+0000 7fbefbfff640 1 -- 172.21.15.5:0/3046459614 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbefc0d2aa0 con 0x7fbefc15be30 2023-07-14T13:32:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.908+0000 7fbefaffd640 1 -- 172.21.15.5:0/3046459614 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2958544848 0 0) 0x7fbefc0aefc0 con 0x7fbefc0d0770 2023-07-14T13:32:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.908+0000 7fbefbfff640 1 --2- 172.21.15.5:0/3046459614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbefc15be30 0x7fbefc0d0230 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7fbefc08bac0 tx=0x7fbeec01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6eb00a721466e17 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.912+0000 7fbefaffd640 1 -- 172.21.15.5:0/3046459614 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec0a7070 con 0x7fbefc15be30 2023-07-14T13:32:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.912+0000 7fbefaffd640 1 -- 172.21.15.5:0/3046459614 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeec0ab430 con 0x7fbefc15be30 2023-07-14T13:32:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.912+0000 7fbefaffd640 1 -- 172.21.15.5:0/3046459614 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec0ab7c0 con 0x7fbefc15be30 2023-07-14T13:32:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.912+0000 7fbf022d8640 1 -- 172.21.15.5:0/3046459614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbefc15be30 msgr2=0x7fbefc0d0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.912+0000 7fbf022d8640 1 --2- 172.21.15.5:0/3046459614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbefc15be30 0x7fbefc0d0230 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7fbefc08bac0 tx=0x7fbeec01c430 comp rx=0 tx=0).stop 2023-07-14T13:32:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.912+0000 7fbf022d8640 1 -- 172.21.15.5:0/3046459614 shutdown_connections 2023-07-14T13:32:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.912+0000 7fbf022d8640 1 --2- 172.21.15.5:0/3046459614 >> v2:172.21.15.154:3300/0 conn(0x7fbefc160030 0x7fbefc0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.912+0000 7fbf022d8640 1 --2- 172.21.15.5:0/3046459614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbefc15be30 0x7fbefc0d0230 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.912+0000 7fbf022d8640 1 -- 172.21.15.5:0/3046459614 >> 172.21.15.5:0/3046459614 conn(0x7fbefc0659d0 msgr2=0x7fbefc09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.912+0000 7fbf022d8640 1 -- 172.21.15.5:0/3046459614 shutdown_connections 2023-07-14T13:32:47.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.912+0000 7fbf022d8640 1 -- 172.21.15.5:0/3046459614 wait complete. 2023-07-14T13:32:47.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.912+0000 7fbf022d8640 1 Processor -- start 2023-07-14T13:32:47.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.912+0000 7fbf022d8640 1 -- start start 2023-07-14T13:32:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.912+0000 7fbf022d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbefc0d0770 0x7fbefc0b6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.912+0000 7fbf022d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbefc15be30 0x7fbefc14e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.912+0000 7fbf022d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbefc160030 0x7fbefc0b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.912+0000 7fbf022d8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc0b7c30 con 0x7fbefc160030 2023-07-14T13:32:47.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.912+0000 7fbf022d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc0b8050 con 0x7fbefc15be30 2023-07-14T13:32:47.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.912+0000 7fbf022d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc0b6fb0 con 0x7fbefc0d0770 2023-07-14T13:32:47.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.912+0000 7fbf00875640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbefc160030 0x7fbefc0b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:47.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.916+0000 7fbf00875640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbefc160030 0x7fbefc0b6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36734/0 (socket says 172.21.15.5:36734) 2023-07-14T13:32:47.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.916+0000 7fbf00875640 1 -- 172.21.15.5:0/1522893925 learned_addr learned my addr 172.21.15.5:0/1522893925 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:47.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.916+0000 7fbefbfff640 1 --2- 172.21.15.5:0/1522893925 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbefc0d0770 0x7fbefc0b6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:47.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.916+0000 7fbefb7fe640 1 --2- 172.21.15.5:0/1522893925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbefc15be30 0x7fbefc14e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:47.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.916+0000 7fbf00875640 1 -- 172.21.15.5:0/1522893925 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbefc0d0770 msgr2=0x7fbefc0b6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:47.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.916+0000 7fbf00875640 1 --2- 172.21.15.5:0/1522893925 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbefc0d0770 0x7fbefc0b6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.916+0000 7fbf00875640 1 -- 172.21.15.5:0/1522893925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbefc15be30 msgr2=0x7fbefc14e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.916+0000 7fbf00875640 1 --2- 172.21.15.5:0/1522893925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbefc15be30 0x7fbefc14e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.916+0000 7fbf00875640 1 -- 172.21.15.5:0/1522893925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeec009420 con 0x7fbefc160030 2023-07-14T13:32:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.916+0000 7fbf00875640 1 --2- 172.21.15.5:0/1522893925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbefc160030 0x7fbefc0b6080 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7fbef400efc0 tx=0x7fbef400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.916+0000 7fbef8ff9640 1 -- 172.21.15.5:0/1522893925 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef4009b20 con 0x7fbefc160030 2023-07-14T13:32:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.916+0000 7fbef8ff9640 1 -- 172.21.15.5:0/1522893925 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef400f040 con 0x7fbefc160030 2023-07-14T13:32:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.916+0000 7fbf022d8640 1 -- 172.21.15.5:0/1522893925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbefc0b7290 con 0x7fbefc160030 2023-07-14T13:32:47.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.916+0000 7fbef8ff9640 1 -- 172.21.15.5:0/1522893925 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef40146c0 con 0x7fbefc160030 2023-07-14T13:32:47.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.916+0000 7fbf022d8640 1 -- 172.21.15.5:0/1522893925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbefc0b7850 con 0x7fbefc160030 2023-07-14T13:32:47.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.916+0000 7fbf022d8640 1 -- 172.21.15.5:0/1522893925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbefc0b7d70 con 0x7fbefc160030 2023-07-14T13:32:47.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.916+0000 7fbef8ff9640 1 -- 172.21.15.5:0/1522893925 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 100) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fbef4014820 con 0x7fbefc160030 2023-07-14T13:32:47.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.920+0000 7fbef8ff9640 1 --2- 172.21.15.5:0/1522893925 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fbee8066430 0x7fbee80688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:47.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.920+0000 7fbef8ff9640 1 -- 172.21.15.5:0/1522893925 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6434+0+0 (secure 0 0 0) 0x7fbef4084ff0 con 0x7fbefc160030 2023-07-14T13:32:47.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.920+0000 7fbefbfff640 1 -- 172.21.15.5:0/1522893925 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fbee8066430 msgr2=0x7fbee80688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/4121325793 2023-07-14T13:32:47.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.920+0000 7fbefbfff640 1 --2- 172.21.15.5:0/1522893925 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fbee8066430 0x7fbee80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:32:47.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:47.924+0000 7fbef8ff9640 1 -- 172.21.15.5:0/1522893925 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fbefc0b7d70 con 0x7fbefc160030 2023-07-14T13:32:47.931 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:47.935+0000 7fd8cb4e2180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:32:47.994 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:47.992+0000 7f2bf9446180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T13:32:48.055 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:48.056+0000 7f2bf9446180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T13:32:48.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.080+0000 7fbf022d8640 1 -- 172.21.15.5:0/1522893925 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbefc0b7d70 con 0x7fbefc160030 2023-07-14T13:32:48.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.080+0000 7fbef8ff9640 1 -- 172.21.15.5:0/1522893925 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v192) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbefc0b7d70 con 0x7fbefc160030 2023-07-14T13:32:48.081 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T13:32:48.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.080+0000 7fbf022d8640 1 -- 172.21.15.5:0/1522893925 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fbee8066430 msgr2=0x7fbee80688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:32:48.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.080+0000 7fbf022d8640 1 --2- 172.21.15.5:0/1522893925 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fbee8066430 0x7fbee80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:48.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.080+0000 7fbf022d8640 1 -- 172.21.15.5:0/1522893925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbefc160030 msgr2=0x7fbefc0b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:48.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.080+0000 7fbf022d8640 1 --2- 172.21.15.5:0/1522893925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbefc160030 0x7fbefc0b6080 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7fbef400efc0 tx=0x7fbef400c490 comp rx=0 tx=0).stop 2023-07-14T13:32:48.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.080+0000 7fbf022d8640 1 -- 172.21.15.5:0/1522893925 shutdown_connections 2023-07-14T13:32:48.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.080+0000 7fbf022d8640 1 --2- 172.21.15.5:0/1522893925 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fbee8066430 0x7fbee80688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:48.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.080+0000 7fbf022d8640 1 --2- 172.21.15.5:0/1522893925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbefc160030 0x7fbefc0b6080 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:48.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.080+0000 7fbf022d8640 1 --2- 172.21.15.5:0/1522893925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbefc15be30 0x7fbefc14e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:48.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.080+0000 7fbf022d8640 1 --2- 172.21.15.5:0/1522893925 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbefc0d0770 0x7fbefc0b6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:48.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.080+0000 7fbf022d8640 1 -- 172.21.15.5:0/1522893925 >> 172.21.15.5:0/1522893925 conn(0x7fbefc0659d0 msgr2=0x7fbefc06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:48.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.080+0000 7fbf022d8640 1 -- 172.21.15.5:0/1522893925 shutdown_connections 2023-07-14T13:32:48.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.080+0000 7fbf022d8640 1 -- 172.21.15.5:0/1522893925 wait complete. 2023-07-14T13:32:48.104 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T13:32:48.173 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:32:48.173 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:32:48.173 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:32:48.181 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:48.187+0000 7fd8cb4e2180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:32:48.314 INFO:tasks.ceph.mgr.y.smithi005.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-14T13:32:48.314 INFO:tasks.ceph.mgr.y.smithi005.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-14T13:32:48.314 INFO:tasks.ceph.mgr.y.smithi005.stderr: from numpy import show_config as show_numpy_config 2023-07-14T13:32:48.317 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:48.323+0000 7fd8cb4e2180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:32:48.323 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:48.324+0000 7f2bf9446180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T13:32:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.324+0000 7f1cdc8d8640 1 Processor -- start 2023-07-14T13:32:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.324+0000 7f1cdc8d8640 1 -- start start 2023-07-14T13:32:48.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.328+0000 7f1cdc8d8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1cd80b7c70 0x7f1cd80d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:48.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.328+0000 7f1cdc8d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cd815fd60 0x7f1cd80d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:48.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.328+0000 7f1cdc8d8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd80ccaf0 con 0x7f1cd80d1850 2023-07-14T13:32:48.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.328+0000 7f1cdc8d8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd80d1190 con 0x7f1cd80b7c70 2023-07-14T13:32:48.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.328+0000 7f1cdc8d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd8160600 con 0x7f1cd815fd60 2023-07-14T13:32:48.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.328+0000 7f1cd659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1cd80b7c70 0x7f1cd80d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:48.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.328+0000 7f1cd659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1cd80b7c70 0x7f1cd80d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36742/0 (socket says 172.21.15.5:36742) 2023-07-14T13:32:48.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.328+0000 7f1cd659c640 1 -- 172.21.15.5:0/2497027824 learned_addr learned my addr 172.21.15.5:0/2497027824 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:48.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.328+0000 7f1cd6d9d640 1 --2- 172.21.15.5:0/2497027824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cd815fd60 0x7f1cd80d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:48.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.328+0000 7f1cd659c640 1 -- 172.21.15.5:0/2497027824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cd815fd60 msgr2=0x7f1cd80d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:48.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.328+0000 7f1cd659c640 1 --2- 172.21.15.5:0/2497027824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cd815fd60 0x7f1cd80d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:48.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.328+0000 7f1cd659c640 1 -- 172.21.15.5:0/2497027824 >> v1:172.21.15.154:6789/0 conn(0x7f1cd80d1850 legacy=0x7f1cd815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:48.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.328+0000 7f1cd659c640 1 -- 172.21.15.5:0/2497027824 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd8160320 con 0x7f1cd80b7c70 2023-07-14T13:32:48.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.332+0000 7f1cd659c640 1 --2- 172.21.15.5:0/2497027824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cd80b7c70 0x7f1cd80d0c50 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8009870 tx=0x7f1cc801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693ea4d0fa744b9d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:48.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.332+0000 7f1cd5d9b640 1 -- 172.21.15.5:0/2497027824 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc80a95f0 con 0x7f1cd80b7c70 2023-07-14T13:32:48.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.332+0000 7f1cd5d9b640 1 -- 172.21.15.5:0/2497027824 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc80a9750 con 0x7f1cd80b7c70 2023-07-14T13:32:48.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.332+0000 7f1cd5d9b640 1 -- 172.21.15.5:0/2497027824 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc80a9ae0 con 0x7f1cd80b7c70 2023-07-14T13:32:48.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.332+0000 7f1cdc8d8640 1 -- 172.21.15.5:0/2497027824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cd80b7c70 msgr2=0x7f1cd80d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:48.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.332+0000 7f1cdc8d8640 1 --2- 172.21.15.5:0/2497027824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cd80b7c70 0x7f1cd80d0c50 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8009870 tx=0x7f1cc801c510 comp rx=0 tx=0).stop 2023-07-14T13:32:48.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.332+0000 7f1cdc8d8640 1 -- 172.21.15.5:0/2497027824 shutdown_connections 2023-07-14T13:32:48.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.332+0000 7f1cdc8d8640 1 --2- 172.21.15.5:0/2497027824 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cd815fd60 0x7f1cd80d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:48.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.332+0000 7f1cdc8d8640 1 --2- 172.21.15.5:0/2497027824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cd80b7c70 0x7f1cd80d0c50 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:48.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.332+0000 7f1cdc8d8640 1 -- 172.21.15.5:0/2497027824 >> 172.21.15.5:0/2497027824 conn(0x7f1cd80650b0 msgr2=0x7f1cd80654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:48.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.332+0000 7f1cdc8d8640 1 -- 172.21.15.5:0/2497027824 shutdown_connections 2023-07-14T13:32:48.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.332+0000 7f1cdc8d8640 1 -- 172.21.15.5:0/2497027824 wait complete. 2023-07-14T13:32:48.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.332+0000 7f1cdc8d8640 1 Processor -- start 2023-07-14T13:32:48.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.332+0000 7f1cdc8d8640 1 -- start start 2023-07-14T13:32:48.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.336+0000 7f1cdc8d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cd80b7c70 0x7f1cd81541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:48.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.336+0000 7f1cdc8d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cd80d1850 0x7f1cd815ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:48.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.336+0000 7f1cdc8d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cd815fd60 0x7f1cd815d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:48.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.336+0000 7f1cdc8d8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd815ba40 con 0x7f1cd80d1850 2023-07-14T13:32:48.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.336+0000 7f1cdc8d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd815ae30 con 0x7f1cd815fd60 2023-07-14T13:32:48.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.336+0000 7f1cdc8d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd815b110 con 0x7f1cd80b7c70 2023-07-14T13:32:48.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.336+0000 7f1ccffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cd80d1850 0x7f1cd815ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:48.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.336+0000 7f1ccffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cd80d1850 0x7f1cd815ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36744/0 (socket says 172.21.15.5:36744) 2023-07-14T13:32:48.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.336+0000 7f1ccffff640 1 -- 172.21.15.5:0/2612771973 learned_addr learned my addr 172.21.15.5:0/2612771973 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:48.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.336+0000 7f1cd6d9d640 1 --2- 172.21.15.5:0/2612771973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cd815fd60 0x7f1cd815d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:48.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.336+0000 7f1cd659c640 1 --2- 172.21.15.5:0/2612771973 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cd80b7c70 0x7f1cd81541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:48.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.336+0000 7f1ccffff640 1 -- 172.21.15.5:0/2612771973 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cd80b7c70 msgr2=0x7f1cd81541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:48.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.336+0000 7f1ccffff640 1 --2- 172.21.15.5:0/2612771973 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cd80b7c70 0x7f1cd81541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:48.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.336+0000 7f1ccffff640 1 -- 172.21.15.5:0/2612771973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cd815fd60 msgr2=0x7f1cd815d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:48.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.336+0000 7f1ccffff640 1 --2- 172.21.15.5:0/2612771973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cd815fd60 0x7f1cd815d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:48.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.336+0000 7f1ccffff640 1 -- 172.21.15.5:0/2612771973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc80094d0 con 0x7f1cd80d1850 2023-07-14T13:32:48.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.336+0000 7f1ccffff640 1 --2- 172.21.15.5:0/2612771973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cd80d1850 0x7f1cd815ce60 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f1cc000c3c0 tx=0x7f1cc000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:48.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.336+0000 7f1cceffd640 1 -- 172.21.15.5:0/2612771973 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc00052d0 con 0x7f1cd80d1850 2023-07-14T13:32:48.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.336+0000 7f1cceffd640 1 -- 172.21.15.5:0/2612771973 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc0005430 con 0x7f1cd80d1850 2023-07-14T13:32:48.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.336+0000 7f1cdc8d8640 1 -- 172.21.15.5:0/2612771973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd815b3f0 con 0x7f1cd80d1850 2023-07-14T13:32:48.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.336+0000 7f1cceffd640 1 -- 172.21.15.5:0/2612771973 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc0003840 con 0x7f1cd80d1850 2023-07-14T13:32:48.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.336+0000 7f1cdc8d8640 1 -- 172.21.15.5:0/2612771973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd815aac0 con 0x7f1cd80d1850 2023-07-14T13:32:48.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.336+0000 7f1cdc8d8640 1 -- 172.21.15.5:0/2612771973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd80c92a0 con 0x7f1cd80d1850 2023-07-14T13:32:48.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.336+0000 7f1cceffd640 1 -- 172.21.15.5:0/2612771973 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 100) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f1cc00039a0 con 0x7f1cd80d1850 2023-07-14T13:32:48.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.340+0000 7f1cceffd640 1 --2- 172.21.15.5:0/2612771973 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f1cb8066430 0x7f1cb80688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:48.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.340+0000 7f1cceffd640 1 -- 172.21.15.5:0/2612771973 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f1cc0083650 con 0x7f1cd80d1850 2023-07-14T13:32:48.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.340+0000 7f1cd659c640 1 -- 172.21.15.5:0/2612771973 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f1cb8066430 msgr2=0x7f1cb80688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/4121325793 2023-07-14T13:32:48.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.340+0000 7f1cd659c640 1 --2- 172.21.15.5:0/2612771973 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f1cb8066430 0x7f1cb80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:32:48.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.344+0000 7f1cceffd640 1 -- 172.21.15.5:0/2612771973 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f1cd80c92a0 con 0x7f1cd80d1850 2023-07-14T13:32:48.444 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:48.447+0000 7fd8cb4e2180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:32:48.467 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:48.464+0000 7f2bf9446180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:32:48.518 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:48.519+0000 7fd8cb4e2180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:32:48.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.512+0000 7f1cdc8d8640 1 -- 172.21.15.5:0/2612771973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1cd80c92a0 con 0x7f1cd80d1850 2023-07-14T13:32:48.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.512+0000 7f1cceffd640 1 -- 172.21.15.5:0/2612771973 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v192) v1 ==== 80+0+475 (secure 0 0 0) 0x7f1cd80c92a0 con 0x7f1cd80d1850 2023-07-14T13:32:48.520 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/3652890289 2023-07-15T13:32:43.012909+0000 2023-07-14T13:32:48.520 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/88577192 2023-07-15T13:32:43.012909+0000 2023-07-14T13:32:48.520 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/191962473 2023-07-15T13:32:43.012909+0000 2023-07-14T13:32:48.520 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/1728568663 2023-07-15T13:32:43.012909+0000 2023-07-14T13:32:48.520 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/1982074443 2023-07-15T13:32:43.012909+0000 2023-07-14T13:32:48.520 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:6833/2194391064 2023-07-15T13:32:43.012909+0000 2023-07-14T13:32:48.521 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:0/3851820787 2023-07-15T13:32:43.012909+0000 2023-07-14T13:32:48.521 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.154:6832/2194391064 2023-07-15T13:32:43.012909+0000 2023-07-14T13:32:48.522 INFO:teuthology.orchestra.run.smithi005.stderr:listed 8 entries 2023-07-14T13:32:48.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.516+0000 7f1cdc8d8640 1 -- 172.21.15.5:0/2612771973 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f1cb8066430 msgr2=0x7f1cb80688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:32:48.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.516+0000 7f1cdc8d8640 1 --2- 172.21.15.5:0/2612771973 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f1cb8066430 0x7f1cb80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:48.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.516+0000 7f1cdc8d8640 1 -- 172.21.15.5:0/2612771973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cd80d1850 msgr2=0x7f1cd815ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:48.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.516+0000 7f1cdc8d8640 1 --2- 172.21.15.5:0/2612771973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cd80d1850 0x7f1cd815ce60 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f1cc000c3c0 tx=0x7f1cc000c880 comp rx=0 tx=0).stop 2023-07-14T13:32:48.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.516+0000 7f1cdc8d8640 1 -- 172.21.15.5:0/2612771973 shutdown_connections 2023-07-14T13:32:48.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.516+0000 7f1cdc8d8640 1 --2- 172.21.15.5:0/2612771973 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f1cb8066430 0x7f1cb80688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:48.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.516+0000 7f1cdc8d8640 1 --2- 172.21.15.5:0/2612771973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cd815fd60 0x7f1cd815d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:48.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.516+0000 7f1cdc8d8640 1 --2- 172.21.15.5:0/2612771973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cd80d1850 0x7f1cd815ce60 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:48.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.516+0000 7f1cdc8d8640 1 --2- 172.21.15.5:0/2612771973 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cd80b7c70 0x7f1cd81541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:48.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.516+0000 7f1cdc8d8640 1 -- 172.21.15.5:0/2612771973 >> 172.21.15.5:0/2612771973 conn(0x7f1cd80650b0 msgr2=0x7f1cd80b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:48.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.516+0000 7f1cdc8d8640 1 -- 172.21.15.5:0/2612771973 shutdown_connections 2023-07-14T13:32:48.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.516+0000 7f1cdc8d8640 1 -- 172.21.15.5:0/2612771973 wait complete. 2023-07-14T13:32:48.537 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-14T13:32:48.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:48.538 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-14T13:32:48.605 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:48.604+0000 7f2bf9446180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T13:32:48.615 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-07-14T13:32:48.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:48.616 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-14T13:32:48.626 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:32:48.627 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:32:48.636 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:32:48.637 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:32:48.637 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:32:48.650 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:48.655+0000 7fd8cb4e2180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:32:48.679 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:32:48.680 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:32:48.680 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:32:48.681 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:48.680+0000 7f2bf9446180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T13:32:48.689 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:32:48.690 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:32:48.822 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:48.820+0000 7f2bf9446180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T13:32:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.864+0000 7f122e27b640 1 Processor -- start 2023-07-14T13:32:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.864+0000 7f122e27b640 1 -- start start 2023-07-14T13:32:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.868+0000 7f122e27b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12280b7c70 0x7f12280d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.868+0000 7f122e27b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12280d1850 0x7f122815f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.868+0000 7f122e27b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12280ccaf0 con 0x7f12280d1300 2023-07-14T13:32:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.868+0000 7f122e27b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12280d1190 con 0x7f12280d1850 2023-07-14T13:32:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.868+0000 7f122e27b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1228160600 con 0x7f12280b7c70 2023-07-14T13:32:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.868+0000 7f1227fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12280b7c70 0x7f12280d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:48.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.868+0000 7f1227fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12280b7c70 0x7f12280d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:42138/0 (socket says 172.21.15.5:42138) 2023-07-14T13:32:48.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.868+0000 7f121ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12280d1850 0x7f122815f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:48.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.868+0000 7f1227fff640 1 -- 172.21.15.5:0/3684553953 learned_addr learned my addr 172.21.15.5:0/3684553953 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:48.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.868+0000 7f122c818640 1 --1- 172.21.15.5:0/3684553953 >> v1:172.21.15.154:6789/0 conn(0x7f12280d1300 0x7f12280d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:60096/0 (socket says 172.21.15.5:60096) 2023-07-14T13:32:48.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.868+0000 7f121ffff640 1 -- 172.21.15.5:0/3684553953 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12280b7c70 msgr2=0x7f12280d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:48.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.868+0000 7f121ffff640 1 --2- 172.21.15.5:0/3684553953 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12280b7c70 0x7f12280d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:48.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.868+0000 7f121ffff640 1 -- 172.21.15.5:0/3684553953 >> v1:172.21.15.154:6789/0 conn(0x7f12280d1300 legacy=0x7f12280d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:48.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.868+0000 7f121ffff640 1 -- 172.21.15.5:0/3684553953 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1228160320 con 0x7f12280d1850 2023-07-14T13:32:48.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.868+0000 7f1227fff640 1 --2- 172.21.15.5:0/3684553953 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12280b7c70 0x7f12280d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:32:48.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.872+0000 7f121ffff640 1 --2- 172.21.15.5:0/3684553953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12280d1850 0x7f122815f650 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f12100097f0 tx=0x7f121001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4bc9c77429a2e38 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:48.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.872+0000 7f12277fe640 1 -- 172.21.15.5:0/3684553953 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12100ad660 con 0x7f12280d1850 2023-07-14T13:32:48.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.872+0000 7f12277fe640 1 -- 172.21.15.5:0/3684553953 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12100ad7c0 con 0x7f12280d1850 2023-07-14T13:32:48.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.872+0000 7f12277fe640 1 -- 172.21.15.5:0/3684553953 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12100adb50 con 0x7f12280d1850 2023-07-14T13:32:48.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.872+0000 7f122e27b640 1 -- 172.21.15.5:0/3684553953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12280d1850 msgr2=0x7f122815f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:48.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.872+0000 7f122e27b640 1 --2- 172.21.15.5:0/3684553953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12280d1850 0x7f122815f650 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f12100097f0 tx=0x7f121001c450 comp rx=0 tx=0).stop 2023-07-14T13:32:48.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.872+0000 7f122e27b640 1 -- 172.21.15.5:0/3684553953 shutdown_connections 2023-07-14T13:32:48.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.872+0000 7f122e27b640 1 --2- 172.21.15.5:0/3684553953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12280d1850 0x7f122815f650 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:48.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.872+0000 7f122e27b640 1 --2- 172.21.15.5:0/3684553953 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12280b7c70 0x7f12280d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:48.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.872+0000 7f122e27b640 1 -- 172.21.15.5:0/3684553953 >> 172.21.15.5:0/3684553953 conn(0x7f12280650b0 msgr2=0x7f12280654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:48.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.872+0000 7f122e27b640 1 -- 172.21.15.5:0/3684553953 shutdown_connections 2023-07-14T13:32:48.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.872+0000 7f122e27b640 1 -- 172.21.15.5:0/3684553953 wait complete. 2023-07-14T13:32:48.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.876+0000 7f122e27b640 1 Processor -- start 2023-07-14T13:32:48.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.876+0000 7f122e27b640 1 -- start start 2023-07-14T13:32:48.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.876+0000 7f122e27b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12280b7c70 0x7f12281539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:48.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.876+0000 7f122e27b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12280d1300 0x7f12280c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:48.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.876+0000 7f122e27b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12280d1850 0x7f12280b5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:48.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.876+0000 7f122e27b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12281550c0 con 0x7f12280d1300 2023-07-14T13:32:48.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.876+0000 7f122e27b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12281554e0 con 0x7f12280d1850 2023-07-14T13:32:48.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.876+0000 7f122e27b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1228154160 con 0x7f12280b7c70 2023-07-14T13:32:48.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.876+0000 7f121ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12280d1300 0x7f12280c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:48.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.876+0000 7f121ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12280d1300 0x7f12280c9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36748/0 (socket says 172.21.15.5:36748) 2023-07-14T13:32:48.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.876+0000 7f121ffff640 1 -- 172.21.15.5:0/3247663283 learned_addr learned my addr 172.21.15.5:0/3247663283 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:48.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.876+0000 7f122c818640 1 --2- 172.21.15.5:0/3247663283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12280d1850 0x7f12280b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:48.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.876+0000 7f1227fff640 1 --2- 172.21.15.5:0/3247663283 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12280b7c70 0x7f12281539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:48.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.876+0000 7f121ffff640 1 -- 172.21.15.5:0/3247663283 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12280b7c70 msgr2=0x7f12281539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:48.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.876+0000 7f121ffff640 1 --2- 172.21.15.5:0/3247663283 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12280b7c70 0x7f12281539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:48.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.876+0000 7f121ffff640 1 -- 172.21.15.5:0/3247663283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12280d1850 msgr2=0x7f12280b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:48.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.876+0000 7f121ffff640 1 --2- 172.21.15.5:0/3247663283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12280d1850 0x7f12280b5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:48.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.876+0000 7f121ffff640 1 -- 172.21.15.5:0/3247663283 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12180094d0 con 0x7f12280d1300 2023-07-14T13:32:48.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.876+0000 7f121ffff640 1 --2- 172.21.15.5:0/3247663283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12280d1300 0x7f12280c9e50 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f12100b0040 tx=0x7f12100191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:48.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.876+0000 7f12257fa640 1 -- 172.21.15.5:0/3247663283 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12100b6610 con 0x7f12280d1300 2023-07-14T13:32:48.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.876+0000 7f122e27b640 1 -- 172.21.15.5:0/3247663283 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1210009420 con 0x7f12280d1300 2023-07-14T13:32:48.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.876+0000 7f122e27b640 1 -- 172.21.15.5:0/3247663283 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1228154720 con 0x7f12280d1300 2023-07-14T13:32:48.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.876+0000 7f12257fa640 1 -- 172.21.15.5:0/3247663283 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12100b6770 con 0x7f12280d1300 2023-07-14T13:32:48.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.876+0000 7f12257fa640 1 -- 172.21.15.5:0/3247663283 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12100b6ae0 con 0x7f12280d1300 2023-07-14T13:32:48.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.876+0000 7f122e27b640 1 -- 172.21.15.5:0/3247663283 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f120c005260 con 0x7f12280d1300 2023-07-14T13:32:48.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.880+0000 7f12257fa640 1 -- 172.21.15.5:0/3247663283 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 100) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f12100b4040 con 0x7f12280d1300 2023-07-14T13:32:48.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.880+0000 7f12257fa640 1 --2- 172.21.15.5:0/3247663283 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f1208066430 0x7f12080688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:48.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.880+0000 7f12257fa640 1 -- 172.21.15.5:0/3247663283 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f121011e5c0 con 0x7f12280d1300 2023-07-14T13:32:48.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.880+0000 7f1227fff640 1 -- 172.21.15.5:0/3247663283 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f1208066430 msgr2=0x7f12080688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/4121325793 2023-07-14T13:32:48.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.880+0000 7f1227fff640 1 --2- 172.21.15.5:0/3247663283 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f1208066430 0x7f12080688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:32:48.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:48.884+0000 7f12257fa640 1 -- 172.21.15.5:0/3247663283 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f12100eb6b0 con 0x7f12280d1300 2023-07-14T13:32:49.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.076+0000 7f122e27b640 1 -- 172.21.15.5:0/3247663283 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f120c005510 con 0x7f12280d1300 2023-07-14T13:32:49.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.076+0000 7f12257fa640 1 -- 172.21.15.5:0/3247663283 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4714 (secure 0 0 0) 0x7f12100eecd0 con 0x7f12280d1300 2023-07-14T13:32:49.076 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:49.076 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8669,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3337947661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3337947661},{"type":"v1","addr":"172.21.15.154:6835","nonce":3337947661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8675,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/695363750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":695363750},{"type":"v1","addr":"172.21.15.154:6837","nonce":695363750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":10542,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1412864639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1412864639},{"type":"v1","addr":"172.21.15.5:6833","nonce":1412864639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:32:30.624611+0000","modified":"2023-07-14T13:32:34.244769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10545":{"gid":10545,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6835/1752765831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1752765831},{"type":"v1","addr":"172.21.15.5:6835","nonce":1752765831}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-14T13:32:49.076 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 92 2023-07-14T13:32:49.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.076+0000 7f122e27b640 1 -- 172.21.15.5:0/3247663283 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f1208066430 msgr2=0x7f12080688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:32:49.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.076+0000 7f122e27b640 1 --2- 172.21.15.5:0/3247663283 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f1208066430 0x7f12080688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.076+0000 7f122e27b640 1 -- 172.21.15.5:0/3247663283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12280d1300 msgr2=0x7f12280c9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:49.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.076+0000 7f122e27b640 1 --2- 172.21.15.5:0/3247663283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12280d1300 0x7f12280c9e50 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f12100b0040 tx=0x7f12100191f0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.076+0000 7f122e27b640 1 -- 172.21.15.5:0/3247663283 shutdown_connections 2023-07-14T13:32:49.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.076+0000 7f122e27b640 1 --2- 172.21.15.5:0/3247663283 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f1208066430 0x7f12080688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.076+0000 7f122e27b640 1 --2- 172.21.15.5:0/3247663283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12280d1850 0x7f12280b5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.076+0000 7f122e27b640 1 --2- 172.21.15.5:0/3247663283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12280d1300 0x7f12280c9e50 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.076+0000 7f122e27b640 1 --2- 172.21.15.5:0/3247663283 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f12280b7c70 0x7f12281539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.076+0000 7f122e27b640 1 -- 172.21.15.5:0/3247663283 >> 172.21.15.5:0/3247663283 conn(0x7f12280650b0 msgr2=0x7f12280cef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:49.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.076+0000 7f122e27b640 1 -- 172.21.15.5:0/3247663283 shutdown_connections 2023-07-14T13:32:49.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.076+0000 7f122e27b640 1 -- 172.21.15.5:0/3247663283 wait complete. 2023-07-14T13:32:49.099 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:32:49.198 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:49.203+0000 7fd8cb4e2180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:32:49.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.248+0000 7fd6a3f59640 1 Processor -- start 2023-07-14T13:32:49.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.248+0000 7fd6a3f59640 1 -- start start 2023-07-14T13:32:49.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.248+0000 7fd6a3f59640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd69c0b7c70 0x7fd69c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.248+0000 7fd6a3f59640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd69c0ccaf0 con 0x7fd69c0d1850 2023-07-14T13:32:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.248+0000 7fd6a3f59640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd69c160320 con 0x7fd69c15fd60 2023-07-14T13:32:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.248+0000 7fd6a3f59640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd69c0d1190 con 0x7fd69c0b7c70 2023-07-14T13:32:49.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.248+0000 7fd6a14f4640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd69c0d1850 0x7fd69c15f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34544/0 (socket says 172.21.15.5:34544) 2023-07-14T13:32:49.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.248+0000 7fd6a14f4640 1 -- 172.21.15.5:0/3801353585 learned_addr learned my addr 172.21.15.5:0/3801353585 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:49.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.248+0000 7fd6a1cf5640 1 --2- 172.21.15.5:0/3801353585 >> v2:172.21.15.5:3300/0 conn(0x7fd69c0b7c70 0x7fd69c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:49.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.252+0000 7fd6a0cf3640 1 -- 172.21.15.5:0/3801353585 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 972930204 0 0) 0x7fd69c0ccaf0 con 0x7fd69c0d1850 2023-07-14T13:32:49.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.252+0000 7fd6a0cf3640 1 -- 172.21.15.5:0/3801353585 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd688003530 con 0x7fd69c0d1850 2023-07-14T13:32:49.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.252+0000 7fd6a0cf3640 1 -- 172.21.15.5:0/3801353585 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262555491 0 0) 0x7fd69c160320 con 0x7fd69c15fd60 2023-07-14T13:32:49.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.252+0000 7fd6a0cf3640 1 -- 172.21.15.5:0/3801353585 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd69c0ccaf0 con 0x7fd69c15fd60 2023-07-14T13:32:49.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.252+0000 7fd6a1cf5640 1 -- 172.21.15.5:0/3801353585 >> v1:172.21.15.154:6789/0 conn(0x7fd69c15fd60 legacy=0x7fd69c0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:49.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.252+0000 7fd6a1cf5640 1 -- 172.21.15.5:0/3801353585 >> v1:172.21.15.5:6789/0 conn(0x7fd69c0d1850 legacy=0x7fd69c15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:49.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.252+0000 7fd6a1cf5640 1 -- 172.21.15.5:0/3801353585 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69c0ccd90 con 0x7fd69c0b7c70 2023-07-14T13:32:49.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.252+0000 7fd6a1cf5640 1 --2- 172.21.15.5:0/3801353585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd69c0b7c70 0x7fd69c0d0c50 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7fd6980097c0 tx=0x7fd69801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5fc915e9968cccd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:49.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.252+0000 7fd6a0cf3640 1 -- 172.21.15.5:0/3801353585 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6980a8050 con 0x7fd69c0b7c70 2023-07-14T13:32:49.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.252+0000 7fd6a0cf3640 1 -- 172.21.15.5:0/3801353585 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6980ac5f0 con 0x7fd69c0b7c70 2023-07-14T13:32:49.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.252+0000 7fd6a0cf3640 1 -- 172.21.15.5:0/3801353585 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6980ac960 con 0x7fd69c0b7c70 2023-07-14T13:32:49.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.256+0000 7fd6a3f59640 1 -- 172.21.15.5:0/3801353585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd69c0b7c70 msgr2=0x7fd69c0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:49.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.256+0000 7fd6a3f59640 1 --2- 172.21.15.5:0/3801353585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd69c0b7c70 0x7fd69c0d0c50 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7fd6980097c0 tx=0x7fd69801c480 comp rx=0 tx=0).stop 2023-07-14T13:32:49.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.256+0000 7fd6a3f59640 1 -- 172.21.15.5:0/3801353585 shutdown_connections 2023-07-14T13:32:49.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.256+0000 7fd6a3f59640 1 --2- 172.21.15.5:0/3801353585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd69c0b7c70 0x7fd69c0d0c50 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.256+0000 7fd6a3f59640 1 -- 172.21.15.5:0/3801353585 >> 172.21.15.5:0/3801353585 conn(0x7fd69c0650b0 msgr2=0x7fd69c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:49.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.256+0000 7fd6a3f59640 1 -- 172.21.15.5:0/3801353585 shutdown_connections 2023-07-14T13:32:49.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.256+0000 7fd6a3f59640 1 -- 172.21.15.5:0/3801353585 wait complete. 2023-07-14T13:32:49.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.256+0000 7fd6a3f59640 1 Processor -- start 2023-07-14T13:32:49.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.256+0000 7fd6a3f59640 1 -- start start 2023-07-14T13:32:49.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.256+0000 7fd6a3f59640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd69c0b7c70 0x7fd69c1562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:49.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.256+0000 7fd6a3f59640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd69c0d1850 0x7fd69c0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:49.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.256+0000 7fd6a3f59640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd69c15fd60 0x7fd69c0cea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:49.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.256+0000 7fd6a3f59640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c0c8860 con 0x7fd69c15fd60 2023-07-14T13:32:49.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.256+0000 7fd6a3f59640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c0c7be0 con 0x7fd69c0d1850 2023-07-14T13:32:49.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.256+0000 7fd6a3f59640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c0c7ec0 con 0x7fd69c0b7c70 2023-07-14T13:32:49.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.256+0000 7fd6a24f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd69c15fd60 0x7fd69c0cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:49.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.256+0000 7fd6a1cf5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd69c0b7c70 0x7fd69c1562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:49.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.256+0000 7fd6a14f4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd69c0d1850 0x7fd69c0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:49.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.256+0000 7fd6a24f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd69c15fd60 0x7fd69c0cea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53944/0 (socket says 172.21.15.5:53944) 2023-07-14T13:32:49.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.256+0000 7fd6a24f6640 1 -- 172.21.15.5:0/79649736 learned_addr learned my addr 172.21.15.5:0/79649736 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:49.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.256+0000 7fd6a1cf5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd69c0b7c70 0x7fd69c1562b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:35110/0 (socket says 172.21.15.5:35110) 2023-07-14T13:32:49.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.260+0000 7fd6a1cf5640 1 -- 172.21.15.5:0/79649736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd69c0d1850 msgr2=0x7fd69c0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:49.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.260+0000 7fd6a1cf5640 1 --2- 172.21.15.5:0/79649736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd69c0d1850 0x7fd69c0ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.260+0000 7fd6a1cf5640 1 -- 172.21.15.5:0/79649736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd69c15fd60 msgr2=0x7fd69c0cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:49.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.260+0000 7fd6a1cf5640 1 --2- 172.21.15.5:0/79649736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd69c15fd60 0x7fd69c0cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.260+0000 7fd6a1cf5640 1 -- 172.21.15.5:0/79649736 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd698009420 con 0x7fd69c0b7c70 2023-07-14T13:32:49.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.260+0000 7fd6a24f6640 1 --2- 172.21.15.5:0/79649736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd69c15fd60 0x7fd69c0cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:32:49.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.260+0000 7fd6a1cf5640 1 --2- 172.21.15.5:0/79649736 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd69c0b7c70 0x7fd69c1562b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd6980ac000 tx=0x7fd698019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:49.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.260+0000 7fd6927fc640 1 -- 172.21.15.5:0/79649736 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6980bc070 con 0x7fd69c0b7c70 2023-07-14T13:32:49.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.260+0000 7fd6927fc640 1 -- 172.21.15.5:0/79649736 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd698006e20 con 0x7fd69c0b7c70 2023-07-14T13:32:49.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.260+0000 7fd6927fc640 1 -- 172.21.15.5:0/79649736 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6980acda0 con 0x7fd69c0b7c70 2023-07-14T13:32:49.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.260+0000 7fd6a3f59640 1 -- 172.21.15.5:0/79649736 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd69c0c81a0 con 0x7fd69c0b7c70 2023-07-14T13:32:49.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.260+0000 7fd6a3f59640 1 -- 172.21.15.5:0/79649736 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd69c0c6eb0 con 0x7fd69c0b7c70 2023-07-14T13:32:49.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.260+0000 7fd6a3f59640 1 -- 172.21.15.5:0/79649736 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd69c0678d0 con 0x7fd69c0b7c70 2023-07-14T13:32:49.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.260+0000 7fd6927fc640 1 -- 172.21.15.5:0/79649736 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 100) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fd6980b3050 con 0x7fd69c0b7c70 2023-07-14T13:32:49.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.264+0000 7fd6927fc640 1 --2- 172.21.15.5:0/79649736 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fd680066460 0x7fd680068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:49.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.264+0000 7fd6927fc640 1 -- 172.21.15.5:0/79649736 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6434+0+0 (secure 0 0 0) 0x7fd69811db10 con 0x7fd69c0b7c70 2023-07-14T13:32:49.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.264+0000 7fd6a14f4640 1 -- 172.21.15.5:0/79649736 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fd680066460 msgr2=0x7fd680068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/4121325793 2023-07-14T13:32:49.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.264+0000 7fd6a14f4640 1 --2- 172.21.15.5:0/79649736 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fd680066460 0x7fd680068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:32:49.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.268+0000 7fd6927fc640 1 -- 172.21.15.5:0/79649736 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd6980eabc0 con 0x7fd69c0b7c70 2023-07-14T13:32:49.286 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:49.291+0000 7fd8cb4e2180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:32:49.410 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:49.408+0000 7f2bf9446180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T13:32:49.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.424+0000 7fd6a3f59640 1 -- 172.21.15.5:0/79649736 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd69c0c8000 con 0x7fd69c0b7c70 2023-07-14T13:32:49.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.428+0000 7fd6927fc640 1 -- 172.21.15.5:0/79649736 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) v1 ==== 74+0+18795 (secure 0 0 0) 0x7fd69c0c8000 con 0x7fd69c0b7c70 2023-07-14T13:32:49.428 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:49.429 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":192,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:32:43.012951+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:32:28.300155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-14T13:32:29.622154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:0/3652890289":"2023-07-15T13:32:43.012909+0000","172.21.15.154:0/88577192":"2023-07-15T13:32:43.012909+0000","172.21.15.154:0/191962473":"2023-07-15T13:32:43.012909+0000","172.21.15.154:0/1728568663":"2023-07-15T13:32:43.012909+0000","172.21.15.154:0/1982074443":"2023-07-15T13:32:43.012909+0000","172.21.15.154:6833/2194391064":"2023-07-15T13:32:43.012909+0000","172.21.15.154:0/3851820787":"2023-07-15T13:32:43.012909+0000","172.21.15.154:6832/2194391064":"2023-07-15T13:32:43.012909+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:32:49.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.428+0000 7fd6a3f59640 1 -- 172.21.15.5:0/79649736 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fd680066460 msgr2=0x7fd680068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:32:49.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.428+0000 7fd6a3f59640 1 --2- 172.21.15.5:0/79649736 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fd680066460 0x7fd680068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.428+0000 7fd6a3f59640 1 -- 172.21.15.5:0/79649736 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd69c0b7c70 msgr2=0x7fd69c1562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.428+0000 7fd6a3f59640 1 --2- 172.21.15.5:0/79649736 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd69c0b7c70 0x7fd69c1562b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd6980ac000 tx=0x7fd698019220 comp rx=0 tx=0).stop 2023-07-14T13:32:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.428+0000 7fd6a3f59640 1 -- 172.21.15.5:0/79649736 shutdown_connections 2023-07-14T13:32:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.428+0000 7fd6a3f59640 1 --2- 172.21.15.5:0/79649736 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7fd680066460 0x7fd680068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.428+0000 7fd6a3f59640 1 --2- 172.21.15.5:0/79649736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd69c15fd60 0x7fd69c0cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.428+0000 7fd6a3f59640 1 --2- 172.21.15.5:0/79649736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd69c0d1850 0x7fd69c0ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.428+0000 7fd6a3f59640 1 --2- 172.21.15.5:0/79649736 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd69c0b7c70 0x7fd69c1562b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.428+0000 7fd6a3f59640 1 -- 172.21.15.5:0/79649736 >> 172.21.15.5:0/79649736 conn(0x7fd69c0650b0 msgr2=0x7fd69c152f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.428+0000 7fd6a3f59640 1 -- 172.21.15.5:0/79649736 shutdown_connections 2023-07-14T13:32:49.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.428+0000 7fd6a3f59640 1 -- 172.21.15.5:0/79649736 wait complete. 2023-07-14T13:32:49.436 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:49.439+0000 7fd8cb4e2180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:32:49.450 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:33.695213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-14T12:52:39.342125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T13:32:28.300155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '190', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T13:32:29.622154+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '191', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:32:49.451 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:32:49.503 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:49.504+0000 7f2bf9446180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T13:32:49.520 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:49.523+0000 7fd8cb4e2180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:32:49.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.600+0000 7f2b69140640 1 Processor -- start 2023-07-14T13:32:49.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.600+0000 7f2b69140640 1 -- start start 2023-07-14T13:32:49.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.604+0000 7f2b69140640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2b6415bde0 0x7f2b640d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:49.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.604+0000 7f2b69140640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2b640d2300 0x7f2b640d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:49.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.604+0000 7f2b69140640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b640b04c0 con 0x7f2b640d2fc0 2023-07-14T13:32:49.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.604+0000 7f2b69140640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b6415c1b0 con 0x7f2b6415bde0 2023-07-14T13:32:49.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.604+0000 7f2b69140640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b640b1060 con 0x7f2b640d2300 2023-07-14T13:32:49.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.604+0000 7f2b5bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2b640d2fc0 0x7f2b640b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34550/0 (socket says 172.21.15.5:34550) 2023-07-14T13:32:49.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.604+0000 7f2b5bfff640 1 -- 172.21.15.5:0/3694828039 learned_addr learned my addr 172.21.15.5:0/3694828039 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:49.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.604+0000 7f2b62d9d640 1 --2- 172.21.15.5:0/3694828039 >> v2:172.21.15.5:3300/0 conn(0x7f2b6415bde0 0x7f2b640d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:49.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.604+0000 7f2b6359e640 1 --2- 172.21.15.5:0/3694828039 >> v2:172.21.15.154:3300/0 conn(0x7f2b640d2300 0x7f2b640d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:49.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.604+0000 7f2b62d9d640 1 -- 172.21.15.5:0/3694828039 >> v2:172.21.15.154:3300/0 conn(0x7f2b640d2300 msgr2=0x7f2b640d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:49.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.604+0000 7f2b62d9d640 1 --2- 172.21.15.5:0/3694828039 >> v2:172.21.15.154:3300/0 conn(0x7f2b640d2300 0x7f2b640d2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.604+0000 7f2b62d9d640 1 -- 172.21.15.5:0/3694828039 >> v1:172.21.15.5:6789/0 conn(0x7f2b640d2fc0 legacy=0x7f2b640b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:49.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.604+0000 7f2b62d9d640 1 -- 172.21.15.5:0/3694828039 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b640d2c80 con 0x7f2b6415bde0 2023-07-14T13:32:49.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.604+0000 7f2b6259c640 1 -- 172.21.15.5:0/3694828039 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231057234 0 0) 0x7f2b640b04c0 con 0x7f2b640d2fc0 2023-07-14T13:32:49.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.604+0000 7f2b62d9d640 1 --2- 172.21.15.5:0/3694828039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b6415bde0 0x7f2b640d0270 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f2b6408c820 tx=0x7f2b5401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31c6592ce325a68 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:49.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.608+0000 7f2b6259c640 1 -- 172.21.15.5:0/3694828039 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b54004230 con 0x7f2b6415bde0 2023-07-14T13:32:49.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.608+0000 7f2b6259c640 1 -- 172.21.15.5:0/3694828039 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b540a7050 con 0x7f2b6415bde0 2023-07-14T13:32:49.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.608+0000 7f2b6259c640 1 -- 172.21.15.5:0/3694828039 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b54003620 con 0x7f2b6415bde0 2023-07-14T13:32:49.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.608+0000 7f2b69140640 1 -- 172.21.15.5:0/3694828039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b6415bde0 msgr2=0x7f2b640d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:49.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.608+0000 7f2b69140640 1 --2- 172.21.15.5:0/3694828039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b6415bde0 0x7f2b640d0270 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f2b6408c820 tx=0x7f2b5401c440 comp rx=0 tx=0).stop 2023-07-14T13:32:49.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.608+0000 7f2b69140640 1 -- 172.21.15.5:0/3694828039 shutdown_connections 2023-07-14T13:32:49.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.608+0000 7f2b69140640 1 --2- 172.21.15.5:0/3694828039 >> v2:172.21.15.154:3300/0 conn(0x7f2b640d2300 0x7f2b640d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.608+0000 7f2b69140640 1 --2- 172.21.15.5:0/3694828039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b6415bde0 0x7f2b640d0270 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.608+0000 7f2b69140640 1 -- 172.21.15.5:0/3694828039 >> 172.21.15.5:0/3694828039 conn(0x7f2b640659d0 msgr2=0x7f2b6409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:49.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.608+0000 7f2b69140640 1 -- 172.21.15.5:0/3694828039 shutdown_connections 2023-07-14T13:32:49.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.608+0000 7f2b69140640 1 -- 172.21.15.5:0/3694828039 wait complete. 2023-07-14T13:32:49.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.608+0000 7f2b69140640 1 Processor -- start 2023-07-14T13:32:49.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.608+0000 7f2b69140640 1 -- start start 2023-07-14T13:32:49.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.608+0000 7f2b69140640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b640d2300 0x7f2b64151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:49.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.608+0000 7f2b69140640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b640d2fc0 0x7f2b640c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:49.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.608+0000 7f2b69140640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b6415bde0 0x7f2b640ced20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:49.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.608+0000 7f2b69140640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b640c94e0 con 0x7f2b6415bde0 2023-07-14T13:32:49.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.608+0000 7f2b69140640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b641542a0 con 0x7f2b640d2300 2023-07-14T13:32:49.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.608+0000 7f2b69140640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b640c9750 con 0x7f2b640d2fc0 2023-07-14T13:32:49.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.608+0000 7f2b6359e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b6415bde0 0x7f2b640ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:49.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.612+0000 7f2b6359e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b6415bde0 0x7f2b640ced20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53970/0 (socket says 172.21.15.5:53970) 2023-07-14T13:32:49.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.612+0000 7f2b6359e640 1 -- 172.21.15.5:0/3809963787 learned_addr learned my addr 172.21.15.5:0/3809963787 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:49.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.612+0000 7f2b62d9d640 1 --2- 172.21.15.5:0/3809963787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b640d2300 0x7f2b64151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:49.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.612+0000 7f2b5bfff640 1 --2- 172.21.15.5:0/3809963787 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b640d2fc0 0x7f2b640c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:49.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.612+0000 7f2b6359e640 1 -- 172.21.15.5:0/3809963787 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b640d2fc0 msgr2=0x7f2b640c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:49.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.612+0000 7f2b6359e640 1 --2- 172.21.15.5:0/3809963787 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b640d2fc0 0x7f2b640c9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.612+0000 7f2b6359e640 1 -- 172.21.15.5:0/3809963787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b640d2300 msgr2=0x7f2b64151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:49.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.612+0000 7f2b6359e640 1 --2- 172.21.15.5:0/3809963787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b640d2300 0x7f2b64151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.612+0000 7f2b6359e640 1 -- 172.21.15.5:0/3809963787 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b540093b0 con 0x7f2b6415bde0 2023-07-14T13:32:49.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.612+0000 7f2b5bfff640 1 --2- 172.21.15.5:0/3809963787 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b640d2fc0 0x7f2b640c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:49.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.612+0000 7f2b6359e640 1 --2- 172.21.15.5:0/3809963787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b6415bde0 0x7f2b640ced20 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c00efc0 tx=0x7f2b5c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:49.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.612+0000 7f2b5b7fe640 1 -- 172.21.15.5:0/3809963787 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c014480 con 0x7f2b6415bde0 2023-07-14T13:32:49.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.612+0000 7f2b5b7fe640 1 -- 172.21.15.5:0/3809963787 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5c00f040 con 0x7f2b6415bde0 2023-07-14T13:32:49.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.612+0000 7f2b69140640 1 -- 172.21.15.5:0/3809963787 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b640c9a30 con 0x7f2b6415bde0 2023-07-14T13:32:49.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.612+0000 7f2b5b7fe640 1 -- 172.21.15.5:0/3809963787 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c014820 con 0x7f2b6415bde0 2023-07-14T13:32:49.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.612+0000 7f2b69140640 1 -- 172.21.15.5:0/3809963787 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b64154580 con 0x7f2b6415bde0 2023-07-14T13:32:49.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.612+0000 7f2b69140640 1 -- 172.21.15.5:0/3809963787 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b640678d0 con 0x7f2b6415bde0 2023-07-14T13:32:49.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.612+0000 7f2b5b7fe640 1 -- 172.21.15.5:0/3809963787 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 100) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f2b5c014980 con 0x7f2b6415bde0 2023-07-14T13:32:49.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.612+0000 7f2b5b7fe640 1 --2- 172.21.15.5:0/3809963787 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f2b44066430 0x7f2b440688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:49.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.616+0000 7f2b5b7fe640 1 -- 172.21.15.5:0/3809963787 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f2b5c084e60 con 0x7f2b6415bde0 2023-07-14T13:32:49.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.616+0000 7f2b62d9d640 1 -- 172.21.15.5:0/3809963787 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f2b44066430 msgr2=0x7f2b440688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.154:6832/4121325793 2023-07-14T13:32:49.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.616+0000 7f2b62d9d640 1 --2- 172.21.15.5:0/3809963787 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f2b44066430 0x7f2b440688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T13:32:49.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.616+0000 7f2b5b7fe640 1 -- 172.21.15.5:0/3809963787 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2b5c051d30 con 0x7f2b6415bde0 2023-07-14T13:32:49.664 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:49.664+0000 7f2bf9446180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T13:32:49.753 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:49.752+0000 7f2bf9446180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T13:32:49.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.776+0000 7f2b69140640 1 -- 172.21.15.5:0/3809963787 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2b64073040 con 0x7f2b6415bde0 2023-07-14T13:32:49.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.776+0000 7f2b5b7fe640 1 -- 172.21.15.5:0/3809963787 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v192) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2b5c018020 con 0x7f2b6415bde0 2023-07-14T13:32:49.778 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-07-14T13:32:49.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.780+0000 7f2b69140640 1 -- 172.21.15.5:0/3809963787 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f2b44066430 msgr2=0x7f2b440688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:32:49.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.780+0000 7f2b69140640 1 --2- 172.21.15.5:0/3809963787 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f2b44066430 0x7f2b440688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.780+0000 7f2b69140640 1 -- 172.21.15.5:0/3809963787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b6415bde0 msgr2=0x7f2b640ced20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:49.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.780+0000 7f2b69140640 1 --2- 172.21.15.5:0/3809963787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b6415bde0 0x7f2b640ced20 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c00efc0 tx=0x7f2b5c00c490 comp rx=0 tx=0).stop 2023-07-14T13:32:49.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.780+0000 7f2b69140640 1 -- 172.21.15.5:0/3809963787 shutdown_connections 2023-07-14T13:32:49.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.780+0000 7f2b69140640 1 --2- 172.21.15.5:0/3809963787 >> [v2:172.21.15.154:6832/4121325793,v1:172.21.15.154:6833/4121325793] conn(0x7f2b44066430 0x7f2b440688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.780+0000 7f2b69140640 1 --2- 172.21.15.5:0/3809963787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b6415bde0 0x7f2b640ced20 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.780+0000 7f2b69140640 1 --2- 172.21.15.5:0/3809963787 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b640d2fc0 0x7f2b640c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.780+0000 7f2b69140640 1 --2- 172.21.15.5:0/3809963787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b640d2300 0x7f2b64151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.780+0000 7f2b69140640 1 -- 172.21.15.5:0/3809963787 >> 172.21.15.5:0/3809963787 conn(0x7f2b640659d0 msgr2=0x7f2b640aefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:49.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.780+0000 7f2b69140640 1 -- 172.21.15.5:0/3809963787 shutdown_connections 2023-07-14T13:32:49.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.780+0000 7f2b69140640 1 -- 172.21.15.5:0/3809963787 wait complete. 2023-07-14T13:32:49.792 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:49.795+0000 7fd8cb4e2180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:32:49.799 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-14T13:32:49.853 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:49.855+0000 7fd8cb4e2180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:32:49.935 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:49.939+0000 7fd853d5a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:49.935 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:49.939+0000 7fd853d5a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:49.935 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:49.939+0000 7fd853d5a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:49.935 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:49.939+0000 7fd853d5a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:49.936 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:49.939+0000 7fd853d5a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:49.936 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:49.939+0000 7fd857561640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:49.936 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:49.939+0000 7fd857561640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:49.936 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:49.939+0000 7fd857561640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:49.936 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:49.939+0000 7fd857561640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:49.936 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-07-14T13:32:49.939+0000 7fd857561640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:32:49.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.960+0000 7f94a25fa640 1 Processor -- start 2023-07-14T13:32:49.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.960+0000 7f94a25fa640 1 -- start start 2023-07-14T13:32:49.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.960+0000 7f94a25fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f949c0d2fc0 0x7f949c0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:49.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.960+0000 7f94a25fa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f949c0d2300 0x7f949c0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:49.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.960+0000 7f94a25fa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f949c0b04c0 con 0x7f949c15bde0 2023-07-14T13:32:49.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.960+0000 7f94a25fa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f949c0d2ce0 con 0x7f949c0d2300 2023-07-14T13:32:49.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.960+0000 7f94a25fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f949c15c1b0 con 0x7f949c0d2fc0 2023-07-14T13:32:49.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.960+0000 7f949bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f949c15bde0 0x7f949c0d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34564/0 (socket says 172.21.15.5:34564) 2023-07-14T13:32:49.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.960+0000 7f949bfff640 1 -- 172.21.15.5:0/1636122286 learned_addr learned my addr 172.21.15.5:0/1636122286 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:49.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.960+0000 7f949b7fe640 1 --2- 172.21.15.5:0/1636122286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f949c0d2fc0 0x7f949c0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:49.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.960+0000 7f94a0b97640 1 --2- 172.21.15.5:0/1636122286 >> v2:172.21.15.154:3300/0 conn(0x7f949c0d2300 0x7f949c0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:49.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.960+0000 7f949affd640 1 -- 172.21.15.5:0/1636122286 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416730680 0 0) 0x7f949c0b04c0 con 0x7f949c15bde0 2023-07-14T13:32:49.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.960+0000 7f949affd640 1 -- 172.21.15.5:0/1636122286 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9484003530 con 0x7f949c15bde0 2023-07-14T13:32:49.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.960+0000 7f949affd640 1 -- 172.21.15.5:0/1636122286 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 886436558 0 0) 0x7f9484003530 con 0x7f949c15bde0 2023-07-14T13:32:49.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.964+0000 7f949affd640 1 -- 172.21.15.5:0/1636122286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f949c0d2fc0 msgr2=0x7f949c0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:49.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.964+0000 7f949affd640 1 --2- 172.21.15.5:0/1636122286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f949c0d2fc0 0x7f949c0b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.964+0000 7f949affd640 1 -- 172.21.15.5:0/1636122286 >> v2:172.21.15.154:3300/0 conn(0x7f949c0d2300 msgr2=0x7f949c0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:49.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.964+0000 7f949affd640 1 --2- 172.21.15.5:0/1636122286 >> v2:172.21.15.154:3300/0 conn(0x7f949c0d2300 0x7f949c0d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.964+0000 7f949affd640 1 -- 172.21.15.5:0/1636122286 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949c0d0aa0 con 0x7f949c15bde0 2023-07-14T13:32:49.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.964+0000 7f949affd640 1 -- 172.21.15.5:0/1636122286 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f948c001800 con 0x7f949c15bde0 2023-07-14T13:32:49.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.964+0000 7f949affd640 1 -- 172.21.15.5:0/1636122286 >> v1:172.21.15.5:6789/0 conn(0x7f949c15bde0 legacy=0x7f949c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:49.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.964+0000 7f949affd640 1 --2- 172.21.15.5:0/1636122286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9484003980 0x7f9484003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:49.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.964+0000 7f949affd640 1 --2- 172.21.15.5:0/1636122286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94840043b0 0x7f9484004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:49.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.964+0000 7f949affd640 1 --2- 172.21.15.5:0/1636122286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9484004e90 0x7f948400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:49.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.964+0000 7f949affd640 1 -- 172.21.15.5:0/1636122286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c15c1b0 con 0x7f9484004e90 2023-07-14T13:32:49.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.964+0000 7f949affd640 1 -- 172.21.15.5:0/1636122286 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94840056a0 con 0x7f9484003980 2023-07-14T13:32:49.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.964+0000 7f949affd640 1 -- 172.21.15.5:0/1636122286 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948400bf50 con 0x7f94840043b0 2023-07-14T13:32:49.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.964+0000 7f949b7fe640 1 --2- 172.21.15.5:0/1636122286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f949c0d2fc0 0x7f949c0b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:32:49.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.964+0000 7f94a0b97640 1 --2- 172.21.15.5:0/1636122286 >> v2:172.21.15.154:3300/0 conn(0x7f949c0d2300 0x7f949c0d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:32:49.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.964+0000 7f949bfff640 1 --2- 172.21.15.5:0/1636122286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9484003980 0x7f9484003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:49.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.964+0000 7f94a0b97640 1 --2- 172.21.15.5:0/1636122286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9484004e90 0x7f948400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:49.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.964+0000 7f949b7fe640 1 --2- 172.21.15.5:0/1636122286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94840043b0 0x7f9484004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:49.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.964+0000 7f949bfff640 1 -- 172.21.15.5:0/1636122286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94840043b0 msgr2=0x7f9484004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:49.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.964+0000 7f949bfff640 1 --2- 172.21.15.5:0/1636122286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94840043b0 0x7f9484004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.964+0000 7f949bfff640 1 -- 172.21.15.5:0/1636122286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9484004e90 msgr2=0x7f948400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:49.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.964+0000 7f949bfff640 1 --2- 172.21.15.5:0/1636122286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9484004e90 0x7f948400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.964+0000 7f949bfff640 1 -- 172.21.15.5:0/1636122286 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9484003530 con 0x7f9484003980 2023-07-14T13:32:49.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.964+0000 7f94a0b97640 1 --2- 172.21.15.5:0/1636122286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9484004e90 0x7f948400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:32:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.968+0000 7f949bfff640 1 --2- 172.21.15.5:0/1636122286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9484003980 0x7f9484003d90 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f948c00c240 tx=0x7f948c01cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfb10d4602fbbbb3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.968+0000 7f949affd640 1 -- 172.21.15.5:0/1636122286 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c0a5960 con 0x7f9484003980 2023-07-14T13:32:49.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.968+0000 7f949affd640 1 -- 172.21.15.5:0/1636122286 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948c0a5ac0 con 0x7f9484003980 2023-07-14T13:32:49.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.968+0000 7f949affd640 1 -- 172.21.15.5:0/1636122286 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c0a5e90 con 0x7f9484003980 2023-07-14T13:32:49.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.968+0000 7f94a25fa640 1 -- 172.21.15.5:0/1636122286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9484003980 msgr2=0x7f9484003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:49.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.968+0000 7f94a25fa640 1 --2- 172.21.15.5:0/1636122286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9484003980 0x7f9484003d90 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f948c00c240 tx=0x7f948c01cc60 comp rx=0 tx=0).stop 2023-07-14T13:32:49.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.968+0000 7f94a0b97640 1 -- 172.21.15.5:0/1636122286 reap_dead start 2023-07-14T13:32:49.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.968+0000 7f94a25fa640 1 -- 172.21.15.5:0/1636122286 shutdown_connections 2023-07-14T13:32:49.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.968+0000 7f94a25fa640 1 -- 172.21.15.5:0/1636122286 >> 172.21.15.5:0/1636122286 conn(0x7f949c0659d0 msgr2=0x7f949c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:49.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.968+0000 7f94a25fa640 1 -- 172.21.15.5:0/1636122286 shutdown_connections 2023-07-14T13:32:49.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.968+0000 7f94a25fa640 1 -- 172.21.15.5:0/1636122286 wait complete. 2023-07-14T13:32:49.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.968+0000 7f94a25fa640 1 Processor -- start 2023-07-14T13:32:49.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.968+0000 7f94a25fa640 1 -- start start 2023-07-14T13:32:49.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.972+0000 7f94a25fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9484003980 0x7f949c0b1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:49.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.972+0000 7f94a25fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f949c0c6140 0x7f949c1477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:49.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.972+0000 7f94a25fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f949c0b5230 0x7f949c0b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:49.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.972+0000 7f94a25fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c147d00 con 0x7f949c0c6140 2023-07-14T13:32:49.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.972+0000 7f94a25fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c0b5be0 con 0x7f949c0b5230 2023-07-14T13:32:49.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.972+0000 7f94a25fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f949c0c65b0 con 0x7f9484003980 2023-07-14T13:32:49.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.972+0000 7f949b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f949c0c6140 0x7f949c1477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:49.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.972+0000 7f949b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f949c0c6140 0x7f949c1477c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53986/0 (socket says 172.21.15.5:53986) 2023-07-14T13:32:49.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.972+0000 7f949b7fe640 1 -- 172.21.15.5:0/3237226548 learned_addr learned my addr 172.21.15.5:0/3237226548 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:49.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.972+0000 7f94a0b97640 1 --2- 172.21.15.5:0/3237226548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f949c0b5230 0x7f949c0b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:49.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.972+0000 7f949bfff640 1 --2- 172.21.15.5:0/3237226548 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9484003980 0x7f949c0b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:49.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.972+0000 7f949b7fe640 1 -- 172.21.15.5:0/3237226548 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9484003980 msgr2=0x7f949c0b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:49.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.972+0000 7f949b7fe640 1 --2- 172.21.15.5:0/3237226548 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9484003980 0x7f949c0b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.972+0000 7f949b7fe640 1 -- 172.21.15.5:0/3237226548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f949c0b5230 msgr2=0x7f949c0b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:49.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.972+0000 7f949b7fe640 1 --2- 172.21.15.5:0/3237226548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f949c0b5230 0x7f949c0b56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:49.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.972+0000 7f949b7fe640 1 -- 172.21.15.5:0/3237226548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949c0b1b40 con 0x7f949c0c6140 2023-07-14T13:32:49.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.972+0000 7f949b7fe640 1 --2- 172.21.15.5:0/3237226548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f949c0c6140 0x7f949c1477c0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f9490011a00 tx=0x7f9490011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:49.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.972+0000 7f9498ff9640 1 -- 172.21.15.5:0/3237226548 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949000f840 con 0x7f949c0c6140 2023-07-14T13:32:49.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.972+0000 7f9498ff9640 1 -- 172.21.15.5:0/3237226548 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949000f9a0 con 0x7f949c0c6140 2023-07-14T13:32:49.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.972+0000 7f9498ff9640 1 -- 172.21.15.5:0/3237226548 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949000fd10 con 0x7f949c0c6140 2023-07-14T13:32:49.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.972+0000 7f94a25fa640 1 -- 172.21.15.5:0/3237226548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f949c0b1e20 con 0x7f949c0c6140 2023-07-14T13:32:49.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.972+0000 7f94a25fa640 1 -- 172.21.15.5:0/3237226548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949c0b23e0 con 0x7f949c0c6140 2023-07-14T13:32:49.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.972+0000 7f94a25fa640 1 -- 172.21.15.5:0/3237226548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949c0b2600 con 0x7f949c0c6140 2023-07-14T13:32:49.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.972+0000 7f9498ff9640 1 -- 172.21.15.5:0/3237226548 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 101) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f9490014440 con 0x7f949c0c6140 2023-07-14T13:32:49.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.976+0000 7f9498ff9640 1 -- 172.21.15.5:0/3237226548 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f9490083ff0 con 0x7f949c0c6140 2023-07-14T13:32:49.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:49.980+0000 7f9498ff9640 1 -- 172.21.15.5:0/3237226548 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f94900b4720 con 0x7f949c0c6140 2023-07-14T13:32:50.064 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:50.064+0000 7f2bf9446180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T13:32:50.129 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-07-14T13:32:50.128+0000 7f2bf9446180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T13:32:50.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.136+0000 7f94a25fa640 1 -- 172.21.15.5:0/3237226548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f949c0678d0 con 0x7f949c0c6140 2023-07-14T13:32:50.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.136+0000 7f9498ff9640 1 -- 172.21.15.5:0/3237226548 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v193) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9490022020 con 0x7f949c0c6140 2023-07-14T13:32:50.138 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-07-14T13:32:50.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.140+0000 7f94a25fa640 1 -- 172.21.15.5:0/3237226548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f949c0c6140 msgr2=0x7f949c1477c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:50.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.140+0000 7f94a25fa640 1 --2- 172.21.15.5:0/3237226548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f949c0c6140 0x7f949c1477c0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f9490011a00 tx=0x7f9490011af0 comp rx=0 tx=0).stop 2023-07-14T13:32:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.140+0000 7f94a25fa640 1 -- 172.21.15.5:0/3237226548 shutdown_connections 2023-07-14T13:32:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.140+0000 7f94a25fa640 1 --2- 172.21.15.5:0/3237226548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f949c0b5230 0x7f949c0b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.140+0000 7f94a25fa640 1 --2- 172.21.15.5:0/3237226548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f949c0c6140 0x7f949c1477c0 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.140+0000 7f94a25fa640 1 --2- 172.21.15.5:0/3237226548 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9484003980 0x7f949c0b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.140+0000 7f94a25fa640 1 -- 172.21.15.5:0/3237226548 >> 172.21.15.5:0/3237226548 conn(0x7f949c0659d0 msgr2=0x7f949c1576e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.140+0000 7f94a25fa640 1 -- 172.21.15.5:0/3237226548 shutdown_connections 2023-07-14T13:32:50.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.140+0000 7f94a25fa640 1 -- 172.21.15.5:0/3237226548 wait complete. 2023-07-14T13:32:50.159 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T13:32:50.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.308+0000 7f3cc9626640 1 Processor -- start 2023-07-14T13:32:50.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.308+0000 7f3cc9626640 1 -- start start 2023-07-14T13:32:50.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.308+0000 7f3cc9626640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc41590a0 0x7f3cc40c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:50.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.308+0000 7f3cc9626640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cc40c37e0 con 0x7f3cc415b9c0 2023-07-14T13:32:50.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.308+0000 7f3cc9626640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cc40c3ac0 con 0x7f3cc40cba60 2023-07-14T13:32:50.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.308+0000 7f3cc9626640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc40c3da0 con 0x7f3cc41590a0 2023-07-14T13:32:50.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.308+0000 7f3cc37fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3cc415b9c0 0x7f3cc4159930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34568/0 (socket says 172.21.15.5:34568) 2023-07-14T13:32:50.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.308+0000 7f3cc37fe640 1 -- 172.21.15.5:0/2470293799 learned_addr learned my addr 172.21.15.5:0/2470293799 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:50.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.308+0000 7f3cbbfff640 1 --2- 172.21.15.5:0/2470293799 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc41590a0 0x7f3cc40c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:50.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.308+0000 7f3cc27fc640 1 -- 172.21.15.5:0/2470293799 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2841759971 0 0) 0x7f3cc40c37e0 con 0x7f3cc415b9c0 2023-07-14T13:32:50.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.308+0000 7f3cc27fc640 1 -- 172.21.15.5:0/2470293799 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cb0003530 con 0x7f3cc415b9c0 2023-07-14T13:32:50.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.308+0000 7f3cc27fc640 1 -- 172.21.15.5:0/2470293799 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586939090 0 0) 0x7f3cc40c3ac0 con 0x7f3cc40cba60 2023-07-14T13:32:50.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.308+0000 7f3cc27fc640 1 -- 172.21.15.5:0/2470293799 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cc40c37e0 con 0x7f3cc40cba60 2023-07-14T13:32:50.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.308+0000 7f3cbbfff640 1 -- 172.21.15.5:0/2470293799 >> v1:172.21.15.154:6789/0 conn(0x7f3cc40cba60 legacy=0x7f3cc40cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:50.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.308+0000 7f3cbbfff640 1 -- 172.21.15.5:0/2470293799 >> v1:172.21.15.5:6789/0 conn(0x7f3cc415b9c0 legacy=0x7f3cc4159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:50.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.308+0000 7f3cbbfff640 1 -- 172.21.15.5:0/2470293799 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc40c4080 con 0x7f3cc41590a0 2023-07-14T13:32:50.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.312+0000 7f3cbbfff640 1 --2- 172.21.15.5:0/2470293799 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc41590a0 0x7f3cc40c3150 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0097f0 tx=0x7f3cac01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1314837383326f1c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:50.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.312+0000 7f3cc27fc640 1 -- 172.21.15.5:0/2470293799 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac0ac630 con 0x7f3cc41590a0 2023-07-14T13:32:50.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.312+0000 7f3cc27fc640 1 -- 172.21.15.5:0/2470293799 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cac0ac790 con 0x7f3cc41590a0 2023-07-14T13:32:50.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.312+0000 7f3cc27fc640 1 -- 172.21.15.5:0/2470293799 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac0acb20 con 0x7f3cc41590a0 2023-07-14T13:32:50.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.312+0000 7f3cc9626640 1 -- 172.21.15.5:0/2470293799 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc41590a0 msgr2=0x7f3cc40c3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:50.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.312+0000 7f3cc9626640 1 --2- 172.21.15.5:0/2470293799 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc41590a0 0x7f3cc40c3150 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0097f0 tx=0x7f3cac01c3f0 comp rx=0 tx=0).stop 2023-07-14T13:32:50.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.312+0000 7f3cc9626640 1 -- 172.21.15.5:0/2470293799 shutdown_connections 2023-07-14T13:32:50.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.312+0000 7f3cc9626640 1 --2- 172.21.15.5:0/2470293799 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc41590a0 0x7f3cc40c3150 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:50.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.312+0000 7f3cc9626640 1 -- 172.21.15.5:0/2470293799 >> 172.21.15.5:0/2470293799 conn(0x7f3cc40cde90 msgr2=0x7f3cc40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:50.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.312+0000 7f3cc9626640 1 -- 172.21.15.5:0/2470293799 shutdown_connections 2023-07-14T13:32:50.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.312+0000 7f3cc9626640 1 -- 172.21.15.5:0/2470293799 wait complete. 2023-07-14T13:32:50.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.316+0000 7f3cc9626640 1 Processor -- start 2023-07-14T13:32:50.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.316+0000 7f3cc9626640 1 -- start start 2023-07-14T13:32:50.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.316+0000 7f3cc9626640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cc40cba60 0x7f3cc4137840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:50.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.316+0000 7f3cc9626640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc41590a0 0x7f3cc40c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:50.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.316+0000 7f3cc9626640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cc415b9c0 0x7f3cc4070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:50.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.316+0000 7f3cc9626640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc4145b60 con 0x7f3cc40cba60 2023-07-14T13:32:50.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.316+0000 7f3cc9626640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc40c6c20 con 0x7f3cc415b9c0 2023-07-14T13:32:50.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.316+0000 7f3cc9626640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc40c6e50 con 0x7f3cc41590a0 2023-07-14T13:32:50.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.316+0000 7f3cc2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cc40cba60 0x7f3cc4137840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:50.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.316+0000 7f3cc2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cc40cba60 0x7f3cc4137840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53998/0 (socket says 172.21.15.5:53998) 2023-07-14T13:32:50.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.316+0000 7f3cc2ffd640 1 -- 172.21.15.5:0/759638901 learned_addr learned my addr 172.21.15.5:0/759638901 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:50.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.316+0000 7f3cbbfff640 1 --2- 172.21.15.5:0/759638901 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc41590a0 0x7f3cc40c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:50.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.316+0000 7f3cc37fe640 1 --2- 172.21.15.5:0/759638901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cc415b9c0 0x7f3cc4070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:50.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.316+0000 7f3cc2ffd640 1 -- 172.21.15.5:0/759638901 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc41590a0 msgr2=0x7f3cc40c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:50.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.316+0000 7f3cc2ffd640 1 --2- 172.21.15.5:0/759638901 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc41590a0 0x7f3cc40c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:50.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.316+0000 7f3cc2ffd640 1 -- 172.21.15.5:0/759638901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cc415b9c0 msgr2=0x7f3cc4070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:50.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.316+0000 7f3cc2ffd640 1 --2- 172.21.15.5:0/759638901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cc415b9c0 0x7f3cc4070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:50.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.316+0000 7f3cc2ffd640 1 -- 172.21.15.5:0/759638901 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cac009420 con 0x7f3cc40cba60 2023-07-14T13:32:50.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.316+0000 7f3cc2ffd640 1 --2- 172.21.15.5:0/759638901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cc40cba60 0x7f3cc4137840 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400c430 tx=0x7f3cb400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:50.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.316+0000 7f3cbb7fe640 1 -- 172.21.15.5:0/759638901 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb40052d0 con 0x7f3cc40cba60 2023-07-14T13:32:50.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.316+0000 7f3cbb7fe640 1 -- 172.21.15.5:0/759638901 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb4005450 con 0x7f3cc40cba60 2023-07-14T13:32:50.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.316+0000 7f3cbb7fe640 1 -- 172.21.15.5:0/759638901 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4003840 con 0x7f3cc40cba60 2023-07-14T13:32:50.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.316+0000 7f3cc9626640 1 -- 172.21.15.5:0/759638901 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc40c7130 con 0x7f3cc40cba60 2023-07-14T13:32:50.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.316+0000 7f3cc9626640 1 -- 172.21.15.5:0/759638901 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc40c76f0 con 0x7f3cc40cba60 2023-07-14T13:32:50.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.316+0000 7f3cc9626640 1 -- 172.21.15.5:0/759638901 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc40714b0 con 0x7f3cc40cba60 2023-07-14T13:32:50.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.320+0000 7f3cbb7fe640 1 -- 172.21.15.5:0/759638901 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 101) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f3cb40039a0 con 0x7f3cc40cba60 2023-07-14T13:32:50.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.320+0000 7f3cbb7fe640 1 -- 172.21.15.5:0/759638901 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f3cb4083060 con 0x7f3cc40cba60 2023-07-14T13:32:50.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.324+0000 7f3cbb7fe640 1 -- 172.21.15.5:0/759638901 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3cb40506e0 con 0x7f3cc40cba60 2023-07-14T13:32:50.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.480+0000 7f3cc9626640 1 -- 172.21.15.5:0/759638901 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3cc40678d0 con 0x7f3cc40cba60 2023-07-14T13:32:50.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.480+0000 7f3cbb7fe640 1 -- 172.21.15.5:0/759638901 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v193) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3cb4053d00 con 0x7f3cc40cba60 2023-07-14T13:32:50.483 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-07-14T13:32:50.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.484+0000 7f3cc9626640 1 -- 172.21.15.5:0/759638901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cc40cba60 msgr2=0x7f3cc4137840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:50.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.484+0000 7f3cc9626640 1 --2- 172.21.15.5:0/759638901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cc40cba60 0x7f3cc4137840 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400c430 tx=0x7f3cb400c8f0 comp rx=0 tx=0).stop 2023-07-14T13:32:50.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.484+0000 7f3cc9626640 1 -- 172.21.15.5:0/759638901 shutdown_connections 2023-07-14T13:32:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.484+0000 7f3cc9626640 1 --2- 172.21.15.5:0/759638901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cc415b9c0 0x7f3cc4070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.484+0000 7f3cc9626640 1 --2- 172.21.15.5:0/759638901 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc41590a0 0x7f3cc40c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.484+0000 7f3cc9626640 1 --2- 172.21.15.5:0/759638901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cc40cba60 0x7f3cc4137840 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.484+0000 7f3cc9626640 1 -- 172.21.15.5:0/759638901 >> 172.21.15.5:0/759638901 conn(0x7f3cc40cde90 msgr2=0x7f3cc40cbe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:50.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.484+0000 7f3cc9626640 1 -- 172.21.15.5:0/759638901 shutdown_connections 2023-07-14T13:32:50.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.484+0000 7f3cc9626640 1 -- 172.21.15.5:0/759638901 wait complete. 2023-07-14T13:32:50.504 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T13:32:50.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.652+0000 7f388319f640 1 Processor -- start 2023-07-14T13:32:50.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.652+0000 7f388319f640 1 -- start start 2023-07-14T13:32:50.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.652+0000 7f388319f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f387c06a440 0x7f387c0b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:50.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.652+0000 7f388319f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f387c1453a0 0x7f387c06c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:50.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.652+0000 7f388319f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f387c06c040 con 0x7f387c15f690 2023-07-14T13:32:50.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.652+0000 7f388319f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f387c160170 con 0x7f387c1453a0 2023-07-14T13:32:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.652+0000 7f388319f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387c160600 con 0x7f387c06a440 2023-07-14T13:32:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.652+0000 7f387bfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f387c06a440 0x7f387c0b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:50.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.652+0000 7f387bfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f387c06a440 0x7f387c0b1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:35184/0 (socket says 172.21.15.5:35184) 2023-07-14T13:32:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.652+0000 7f387bfff640 1 -- 172.21.15.5:0/4003089071 learned_addr learned my addr 172.21.15.5:0/4003089071 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.652+0000 7f3880f3b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f387c15f690 0x7f387c15fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:53428/0 (socket says 172.21.15.5:53428) 2023-07-14T13:32:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.652+0000 7f388173c640 1 --2- 172.21.15.5:0/4003089071 >> v2:172.21.15.154:3300/0 conn(0x7f387c1453a0 0x7f387c06c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.652+0000 7f387bfff640 1 -- 172.21.15.5:0/4003089071 >> v2:172.21.15.154:3300/0 conn(0x7f387c1453a0 msgr2=0x7f387c06c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.652+0000 7f387bfff640 1 --2- 172.21.15.5:0/4003089071 >> v2:172.21.15.154:3300/0 conn(0x7f387c1453a0 0x7f387c06c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.652+0000 7f387bfff640 1 -- 172.21.15.5:0/4003089071 >> v1:172.21.15.154:6789/0 conn(0x7f387c15f690 legacy=0x7f387c15fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:50.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.652+0000 7f387bfff640 1 -- 172.21.15.5:0/4003089071 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387c160360 con 0x7f387c06a440 2023-07-14T13:32:50.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.656+0000 7f387bfff640 1 --2- 172.21.15.5:0/4003089071 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f387c06a440 0x7f387c0b1890 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3868009870 tx=0x7f386801c2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72bb87cda0b527d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:50.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.656+0000 7f387b7fe640 1 -- 172.21.15.5:0/4003089071 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38680ab600 con 0x7f387c06a440 2023-07-14T13:32:50.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.656+0000 7f387b7fe640 1 -- 172.21.15.5:0/4003089071 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38680a7050 con 0x7f387c06a440 2023-07-14T13:32:50.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.656+0000 7f387b7fe640 1 -- 172.21.15.5:0/4003089071 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38680ab980 con 0x7f387c06a440 2023-07-14T13:32:50.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.656+0000 7f388319f640 1 -- 172.21.15.5:0/4003089071 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f387c06a440 msgr2=0x7f387c0b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:50.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.656+0000 7f388319f640 1 --2- 172.21.15.5:0/4003089071 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f387c06a440 0x7f387c0b1890 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3868009870 tx=0x7f386801c2a0 comp rx=0 tx=0).stop 2023-07-14T13:32:50.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.656+0000 7f388319f640 1 -- 172.21.15.5:0/4003089071 shutdown_connections 2023-07-14T13:32:50.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.656+0000 7f388319f640 1 --2- 172.21.15.5:0/4003089071 >> v2:172.21.15.154:3300/0 conn(0x7f387c1453a0 0x7f387c06c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:50.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.656+0000 7f388319f640 1 --2- 172.21.15.5:0/4003089071 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f387c06a440 0x7f387c0b1890 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:50.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.656+0000 7f388319f640 1 -- 172.21.15.5:0/4003089071 >> 172.21.15.5:0/4003089071 conn(0x7f387c0b1210 msgr2=0x7f387c0ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:50.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.656+0000 7f388319f640 1 -- 172.21.15.5:0/4003089071 shutdown_connections 2023-07-14T13:32:50.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.656+0000 7f388319f640 1 -- 172.21.15.5:0/4003089071 wait complete. 2023-07-14T13:32:50.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.660+0000 7f388319f640 1 Processor -- start 2023-07-14T13:32:50.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.660+0000 7f388319f640 1 -- start start 2023-07-14T13:32:50.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.660+0000 7f388319f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f387c06a440 0x7f387c12a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:50.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.660+0000 7f388319f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f387c1453a0 0x7f387c15e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:50.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.660+0000 7f388319f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f387c15f690 0x7f387c15b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:50.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.660+0000 7f388319f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c144740 con 0x7f387c1453a0 2023-07-14T13:32:50.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.660+0000 7f388319f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c12a810 con 0x7f387c15f690 2023-07-14T13:32:50.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.660+0000 7f388319f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387c15e6e0 con 0x7f387c06a440 2023-07-14T13:32:50.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.660+0000 7f387bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f387c1453a0 0x7f387c15e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:50.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.660+0000 7f387bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f387c1453a0 0x7f387c15e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54004/0 (socket says 172.21.15.5:54004) 2023-07-14T13:32:50.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.660+0000 7f387bfff640 1 -- 172.21.15.5:0/2150823579 learned_addr learned my addr 172.21.15.5:0/2150823579 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:50.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.660+0000 7f3880f3b640 1 --2- 172.21.15.5:0/2150823579 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f387c06a440 0x7f387c12a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:50.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.660+0000 7f388173c640 1 --2- 172.21.15.5:0/2150823579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f387c15f690 0x7f387c15b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:50.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.660+0000 7f387bfff640 1 -- 172.21.15.5:0/2150823579 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f387c06a440 msgr2=0x7f387c12a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:50.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.660+0000 7f387bfff640 1 --2- 172.21.15.5:0/2150823579 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f387c06a440 0x7f387c12a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:50.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.660+0000 7f387bfff640 1 -- 172.21.15.5:0/2150823579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f387c15f690 msgr2=0x7f387c15b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:50.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.660+0000 7f387bfff640 1 --2- 172.21.15.5:0/2150823579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f387c15f690 0x7f387c15b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:50.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.660+0000 7f387bfff640 1 -- 172.21.15.5:0/2150823579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38680094d0 con 0x7f387c1453a0 2023-07-14T13:32:50.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.660+0000 7f3880f3b640 1 --2- 172.21.15.5:0/2150823579 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f387c06a440 0x7f387c12a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:32:50.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.660+0000 7f388173c640 1 --2- 172.21.15.5:0/2150823579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f387c15f690 0x7f387c15b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:32:50.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.660+0000 7f387bfff640 1 --2- 172.21.15.5:0/2150823579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f387c1453a0 0x7f387c15e1a0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f386801a950 tx=0x7f3868019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:50.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.660+0000 7f38797fa640 1 -- 172.21.15.5:0/2150823579 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38680b4420 con 0x7f387c1453a0 2023-07-14T13:32:50.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.660+0000 7f38797fa640 1 -- 172.21.15.5:0/2150823579 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38680b45a0 con 0x7f387c1453a0 2023-07-14T13:32:50.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.660+0000 7f388319f640 1 -- 172.21.15.5:0/2150823579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f387c13cfe0 con 0x7f387c1453a0 2023-07-14T13:32:50.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.660+0000 7f38797fa640 1 -- 172.21.15.5:0/2150823579 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38680b4950 con 0x7f387c1453a0 2023-07-14T13:32:50.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.660+0000 7f388319f640 1 -- 172.21.15.5:0/2150823579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f387c13d280 con 0x7f387c1453a0 2023-07-14T13:32:50.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.664+0000 7f388319f640 1 -- 172.21.15.5:0/2150823579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f387c127ad0 con 0x7f387c1453a0 2023-07-14T13:32:50.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.664+0000 7f38797fa640 1 -- 172.21.15.5:0/2150823579 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 101) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f38680b2070 con 0x7f387c1453a0 2023-07-14T13:32:50.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.664+0000 7f38797fa640 1 -- 172.21.15.5:0/2150823579 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f38680a4e40 con 0x7f387c1453a0 2023-07-14T13:32:50.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.668+0000 7f38797fa640 1 -- 172.21.15.5:0/2150823579 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f38680eabb0 con 0x7f387c1453a0 2023-07-14T13:32:50.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.824+0000 7f388319f640 1 -- 172.21.15.5:0/2150823579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f387c0678d0 con 0x7f387c1453a0 2023-07-14T13:32:50.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.824+0000 7f38797fa640 1 -- 172.21.15.5:0/2150823579 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v193) v1 ==== 100+0+11 (secure 0 0 0) 0x7f38680ee1d0 con 0x7f387c1453a0 2023-07-14T13:32:50.827 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-07-14T13:32:50.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.827+0000 7f388319f640 1 -- 172.21.15.5:0/2150823579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f387c1453a0 msgr2=0x7f387c15e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:50.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.827+0000 7f388319f640 1 --2- 172.21.15.5:0/2150823579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f387c1453a0 0x7f387c15e1a0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f386801a950 tx=0x7f3868019040 comp rx=0 tx=0).stop 2023-07-14T13:32:50.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.827+0000 7f388319f640 1 -- 172.21.15.5:0/2150823579 shutdown_connections 2023-07-14T13:32:50.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.827+0000 7f388319f640 1 --2- 172.21.15.5:0/2150823579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f387c15f690 0x7f387c15b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:50.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.827+0000 7f388319f640 1 --2- 172.21.15.5:0/2150823579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f387c1453a0 0x7f387c15e1a0 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:50.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.827+0000 7f388319f640 1 --2- 172.21.15.5:0/2150823579 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f387c06a440 0x7f387c12a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:50.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.827+0000 7f388319f640 1 -- 172.21.15.5:0/2150823579 >> 172.21.15.5:0/2150823579 conn(0x7f387c0b1210 msgr2=0x7f387c0afdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:50.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.827+0000 7f388319f640 1 -- 172.21.15.5:0/2150823579 shutdown_connections 2023-07-14T13:32:50.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.827+0000 7f388319f640 1 -- 172.21.15.5:0/2150823579 wait complete. 2023-07-14T13:32:50.847 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:32:50.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.991+0000 7f5335f9f640 1 Processor -- start 2023-07-14T13:32:50.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.991+0000 7f5335f9f640 1 -- start start 2023-07-14T13:32:50.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.995+0000 7f5335f9f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5330070b70 0x7f5330070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:50.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.995+0000 7f5335f9f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f533006b1e0 0x7f53300c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:50.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.995+0000 7f5335f9f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53300cac70 con 0x7f53300c21f0 2023-07-14T13:32:50.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.995+0000 7f5335f9f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5330071480 con 0x7f5330070b70 2023-07-14T13:32:50.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.995+0000 7f5335f9f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53300ca060 con 0x7f533006b1e0 2023-07-14T13:32:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.995+0000 7f532f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5330070b70 0x7f5330070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.995+0000 7f532f7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5330070b70 0x7f5330070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54008/0 (socket says 172.21.15.5:54008) 2023-07-14T13:32:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.995+0000 7f532f7fe640 1 -- 172.21.15.5:0/358843086 learned_addr learned my addr 172.21.15.5:0/358843086 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.995+0000 7f532effd640 1 --2- 172.21.15.5:0/358843086 >> v2:172.21.15.154:3300/0 conn(0x7f533006b1e0 0x7f53300c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.995+0000 7f532f7fe640 1 -- 172.21.15.5:0/358843086 >> v2:172.21.15.154:3300/0 conn(0x7f533006b1e0 msgr2=0x7f53300c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.995+0000 7f532f7fe640 1 --2- 172.21.15.5:0/358843086 >> v2:172.21.15.154:3300/0 conn(0x7f533006b1e0 0x7f53300c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:50.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.995+0000 7f532f7fe640 1 -- 172.21.15.5:0/358843086 >> v1:172.21.15.154:6789/0 conn(0x7f53300c21f0 legacy=0x7f53300cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:50.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.995+0000 7f532f7fe640 1 -- 172.21.15.5:0/358843086 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53300ca340 con 0x7f5330070b70 2023-07-14T13:32:50.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.999+0000 7f532f7fe640 1 --2- 172.21.15.5:0/358843086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5330070b70 0x7f5330070f40 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f533006f380 tx=0x7f532001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d68e817af2c42b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.999+0000 7f532e7fc640 1 -- 172.21.15.5:0/358843086 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53200aa430 con 0x7f5330070b70 2023-07-14T13:32:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.999+0000 7f532e7fc640 1 -- 172.21.15.5:0/358843086 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53200aa590 con 0x7f5330070b70 2023-07-14T13:32:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.999+0000 7f532e7fc640 1 -- 172.21.15.5:0/358843086 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53200aa920 con 0x7f5330070b70 2023-07-14T13:32:51.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.999+0000 7f5335f9f640 1 -- 172.21.15.5:0/358843086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5330070b70 msgr2=0x7f5330070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:51.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.999+0000 7f5335f9f640 1 --2- 172.21.15.5:0/358843086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5330070b70 0x7f5330070f40 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f533006f380 tx=0x7f532001c4d0 comp rx=0 tx=0).stop 2023-07-14T13:32:51.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.999+0000 7f5335f9f640 1 -- 172.21.15.5:0/358843086 shutdown_connections 2023-07-14T13:32:51.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.999+0000 7f5335f9f640 1 --2- 172.21.15.5:0/358843086 >> v2:172.21.15.154:3300/0 conn(0x7f533006b1e0 0x7f53300c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:51.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.999+0000 7f5335f9f640 1 --2- 172.21.15.5:0/358843086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5330070b70 0x7f5330070f40 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:51.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.999+0000 7f5335f9f640 1 -- 172.21.15.5:0/358843086 >> 172.21.15.5:0/358843086 conn(0x7f53300afcf0 msgr2=0x7f53300b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:51.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.999+0000 7f5335f9f640 1 -- 172.21.15.5:0/358843086 shutdown_connections 2023-07-14T13:32:51.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.999+0000 7f5335f9f640 1 -- 172.21.15.5:0/358843086 wait complete. 2023-07-14T13:32:51.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.999+0000 7f5335f9f640 1 Processor -- start 2023-07-14T13:32:51.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.999+0000 7f5335f9f640 1 -- start start 2023-07-14T13:32:51.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.999+0000 7f5335f9f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f533006b1e0 0x7f533014e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:51.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.999+0000 7f5335f9f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5330070b70 0x7f533014f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:51.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.999+0000 7f5335f9f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53300c21f0 0x7f53300ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:51.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.999+0000 7f5335f9f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53300b0ff0 con 0x7f5330070b70 2023-07-14T13:32:51.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.999+0000 7f5335f9f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53300b12d0 con 0x7f533006b1e0 2023-07-14T13:32:51.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:50.999+0000 7f5335f9f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53300b15b0 con 0x7f53300c21f0 2023-07-14T13:32:51.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.003+0000 7f532effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5330070b70 0x7f533014f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:51.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.003+0000 7f532effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5330070b70 0x7f533014f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54010/0 (socket says 172.21.15.5:54010) 2023-07-14T13:32:51.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.003+0000 7f532effd640 1 -- 172.21.15.5:0/3847476441 learned_addr learned my addr 172.21.15.5:0/3847476441 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:51.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.003+0000 7f532effd640 1 -- 172.21.15.5:0/3847476441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53300c21f0 msgr2=0x7f53300ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:51.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.003+0000 7f532effd640 1 --2- 172.21.15.5:0/3847476441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53300c21f0 0x7f53300ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:51.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.003+0000 7f532effd640 1 -- 172.21.15.5:0/3847476441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f533006b1e0 msgr2=0x7f533014e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:51.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.003+0000 7f532effd640 1 --2- 172.21.15.5:0/3847476441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f533006b1e0 0x7f533014e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:51.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.003+0000 7f532effd640 1 -- 172.21.15.5:0/3847476441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53200094d0 con 0x7f5330070b70 2023-07-14T13:32:51.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.003+0000 7f532effd640 1 --2- 172.21.15.5:0/3847476441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5330070b70 0x7f533014f6a0 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f532400d5f0 tx=0x7f532400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:51.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.003+0000 7f5317fff640 1 -- 172.21.15.5:0/3847476441 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53240125f0 con 0x7f5330070b70 2023-07-14T13:32:51.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.003+0000 7f5317fff640 1 -- 172.21.15.5:0/3847476441 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5324012750 con 0x7f5330070b70 2023-07-14T13:32:51.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.003+0000 7f5317fff640 1 -- 172.21.15.5:0/3847476441 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5324012ae0 con 0x7f5330070b70 2023-07-14T13:32:51.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.003+0000 7f5335f9f640 1 -- 172.21.15.5:0/3847476441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53300b1890 con 0x7f5330070b70 2023-07-14T13:32:51.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.003+0000 7f5335f9f640 1 -- 172.21.15.5:0/3847476441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f533014e870 con 0x7f5330070b70 2023-07-14T13:32:51.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.003+0000 7f5335f9f640 1 -- 172.21.15.5:0/3847476441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53300678d0 con 0x7f5330070b70 2023-07-14T13:32:51.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.003+0000 7f5317fff640 1 -- 172.21.15.5:0/3847476441 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 102) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f5324012c40 con 0x7f5330070b70 2023-07-14T13:32:51.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.003+0000 7f5317fff640 1 --2- 172.21.15.5:0/3847476441 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f531c0660d0 0x7f531c068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:51.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.007+0000 7f5317fff640 1 -- 172.21.15.5:0/3847476441 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f53240842d0 con 0x7f5330070b70 2023-07-14T13:32:51.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.007+0000 7f532f7fe640 1 --2- 172.21.15.5:0/3847476441 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f531c0660d0 0x7f531c068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:51.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.007+0000 7f532f7fe640 1 --2- 172.21.15.5:0/3847476441 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f531c0660d0 0x7f531c068580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f53200ae000 tx=0x7f5320008040 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:51.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.011+0000 7f5317fff640 1 -- 172.21.15.5:0/3847476441 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f5324051630 con 0x7f5330070b70 2023-07-14T13:32:51.188 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:32:51.193 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:32:51.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.199+0000 7f5335f9f640 1 -- 172.21.15.5:0/3847476441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53300c98c0 con 0x7f5330070b70 2023-07-14T13:32:51.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.203+0000 7f5317fff640 1 -- 172.21.15.5:0/3847476441 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4714 (secure 0 0 0) 0x7f5324007380 con 0x7f5330070b70 2023-07-14T13:32:51.203 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:51.203 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8669,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3337947661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3337947661},{"type":"v1","addr":"172.21.15.154:6835","nonce":3337947661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8675,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/695363750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":695363750},{"type":"v1","addr":"172.21.15.154:6837","nonce":695363750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":10542,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1412864639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1412864639},{"type":"v1","addr":"172.21.15.5:6833","nonce":1412864639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:32:30.624611+0000","modified":"2023-07-14T13:32:34.244769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10545":{"gid":10545,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6835/1752765831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1752765831},{"type":"v1","addr":"172.21.15.5:6835","nonce":1752765831}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-14T13:32:51.204 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 92 2023-07-14T13:32:51.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.203+0000 7f5335f9f640 1 -- 172.21.15.5:0/3847476441 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f531c0660d0 msgr2=0x7f531c068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:51.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.203+0000 7f5335f9f640 1 --2- 172.21.15.5:0/3847476441 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f531c0660d0 0x7f531c068580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f53200ae000 tx=0x7f5320008040 comp rx=0 tx=0).stop 2023-07-14T13:32:51.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.203+0000 7f5335f9f640 1 -- 172.21.15.5:0/3847476441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5330070b70 msgr2=0x7f533014f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:51.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.203+0000 7f5335f9f640 1 --2- 172.21.15.5:0/3847476441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5330070b70 0x7f533014f6a0 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f532400d5f0 tx=0x7f532400dab0 comp rx=0 tx=0).stop 2023-07-14T13:32:51.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.203+0000 7f5335f9f640 1 -- 172.21.15.5:0/3847476441 shutdown_connections 2023-07-14T13:32:51.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.203+0000 7f5335f9f640 1 --2- 172.21.15.5:0/3847476441 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f531c0660d0 0x7f531c068580 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:51.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.203+0000 7f5335f9f640 1 --2- 172.21.15.5:0/3847476441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53300c21f0 0x7f53300ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:51.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.203+0000 7f5335f9f640 1 --2- 172.21.15.5:0/3847476441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5330070b70 0x7f533014f6a0 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:51.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.203+0000 7f5335f9f640 1 --2- 172.21.15.5:0/3847476441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f533006b1e0 0x7f533014e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:51.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.203+0000 7f5335f9f640 1 -- 172.21.15.5:0/3847476441 >> 172.21.15.5:0/3847476441 conn(0x7f53300afcf0 msgr2=0x7f5330159030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:51.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.203+0000 7f5335f9f640 1 -- 172.21.15.5:0/3847476441 shutdown_connections 2023-07-14T13:32:51.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.203+0000 7f5335f9f640 1 -- 172.21.15.5:0/3847476441 wait complete. 2023-07-14T13:32:51.225 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:32:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.451+0000 7f04fb85c640 1 Processor -- start 2023-07-14T13:32:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.451+0000 7f04fb85c640 1 -- start start 2023-07-14T13:32:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.451+0000 7f04fb85c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f04f415b7c0 0x7f04f406b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.451+0000 7f04fb85c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04f40cb780 0x7f04f406b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.451+0000 7f04fb85c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f406f900 con 0x7f04f406fd90 2023-07-14T13:32:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.451+0000 7f04fb85c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f40cdce0 con 0x7f04f415b7c0 2023-07-14T13:32:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.451+0000 7f04fb85c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f40ca830 con 0x7f04f40cb780 2023-07-14T13:32:51.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.451+0000 7f04f8df7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04f40cb780 0x7f04f406b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:51.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.455+0000 7f04f8df7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04f40cb780 0x7f04f406b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:35212/0 (socket says 172.21.15.5:35212) 2023-07-14T13:32:51.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.455+0000 7f04f95f8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f04f415b7c0 0x7f04f406b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:51.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.455+0000 7f04f9df9640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f04f406fd90 0x7f04f4070180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:53448/0 (socket says 172.21.15.5:53448) 2023-07-14T13:32:51.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.455+0000 7f04f8df7640 1 -- 172.21.15.5:0/1879590185 learned_addr learned my addr 172.21.15.5:0/1879590185 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:51.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.455+0000 7f04f8df7640 1 -- 172.21.15.5:0/1879590185 >> v2:172.21.15.154:3300/0 conn(0x7f04f415b7c0 msgr2=0x7f04f406b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:51.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.455+0000 7f04f8df7640 1 --2- 172.21.15.5:0/1879590185 >> v2:172.21.15.154:3300/0 conn(0x7f04f415b7c0 0x7f04f406b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:51.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.455+0000 7f04f8df7640 1 -- 172.21.15.5:0/1879590185 >> v1:172.21.15.154:6789/0 conn(0x7f04f406fd90 legacy=0x7f04f4070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:51.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.455+0000 7f04f8df7640 1 -- 172.21.15.5:0/1879590185 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f415bb90 con 0x7f04f40cb780 2023-07-14T13:32:51.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.455+0000 7f04f8df7640 1 --2- 172.21.15.5:0/1879590185 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04f40cb780 0x7f04f406b720 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f04e4009870 tx=0x7f04e401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7926cf3be17c825 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:51.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.455+0000 7f04ebfff640 1 -- 172.21.15.5:0/1879590185 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e40aa5f0 con 0x7f04f40cb780 2023-07-14T13:32:51.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.455+0000 7f04ebfff640 1 -- 172.21.15.5:0/1879590185 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e40aa750 con 0x7f04f40cb780 2023-07-14T13:32:51.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.455+0000 7f04ebfff640 1 -- 172.21.15.5:0/1879590185 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e40aaae0 con 0x7f04f40cb780 2023-07-14T13:32:51.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.459+0000 7f04fb85c640 1 -- 172.21.15.5:0/1879590185 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04f40cb780 msgr2=0x7f04f406b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:51.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.459+0000 7f04fb85c640 1 --2- 172.21.15.5:0/1879590185 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04f40cb780 0x7f04f406b720 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f04e4009870 tx=0x7f04e401c510 comp rx=0 tx=0).stop 2023-07-14T13:32:51.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.459+0000 7f04fb85c640 1 -- 172.21.15.5:0/1879590185 shutdown_connections 2023-07-14T13:32:51.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.459+0000 7f04fb85c640 1 --2- 172.21.15.5:0/1879590185 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04f40cb780 0x7f04f406b720 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:51.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.459+0000 7f04fb85c640 1 --2- 172.21.15.5:0/1879590185 >> v2:172.21.15.154:3300/0 conn(0x7f04f415b7c0 0x7f04f406b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:51.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.459+0000 7f04fb85c640 1 -- 172.21.15.5:0/1879590185 >> 172.21.15.5:0/1879590185 conn(0x7f04f40afcf0 msgr2=0x7f04f40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:51.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.459+0000 7f04fb85c640 1 -- 172.21.15.5:0/1879590185 shutdown_connections 2023-07-14T13:32:51.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.459+0000 7f04fb85c640 1 -- 172.21.15.5:0/1879590185 wait complete. 2023-07-14T13:32:51.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.459+0000 7f04fb85c640 1 Processor -- start 2023-07-14T13:32:51.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.459+0000 7f04fb85c640 1 -- start start 2023-07-14T13:32:51.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.459+0000 7f04fb85c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04f406fd90 0x7f04f41531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:51.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.459+0000 7f04fb85c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04f415b7c0 0x7f04f40b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:51.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.459+0000 7f04fb85c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f41f8580 0x7f04f40c7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:51.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.459+0000 7f04fb85c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f40c5000 con 0x7f04f41f8580 2023-07-14T13:32:51.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.459+0000 7f04fb85c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f40b3a80 con 0x7f04f415b7c0 2023-07-14T13:32:51.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.459+0000 7f04fb85c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f40b3d60 con 0x7f04f406fd90 2023-07-14T13:32:51.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.459+0000 7f04f9df9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f41f8580 0x7f04f40c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:51.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.459+0000 7f04f9df9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f41f8580 0x7f04f40c7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54014/0 (socket says 172.21.15.5:54014) 2023-07-14T13:32:51.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.459+0000 7f04f9df9640 1 -- 172.21.15.5:0/4289528328 learned_addr learned my addr 172.21.15.5:0/4289528328 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:51.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.459+0000 7f04f95f8640 1 --2- 172.21.15.5:0/4289528328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04f406fd90 0x7f04f41531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:51.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.459+0000 7f04f8df7640 1 --2- 172.21.15.5:0/4289528328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04f415b7c0 0x7f04f40b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:51.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.463+0000 7f04f9df9640 1 -- 172.21.15.5:0/4289528328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04f406fd90 msgr2=0x7f04f41531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:51.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.463+0000 7f04f9df9640 1 --2- 172.21.15.5:0/4289528328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04f406fd90 0x7f04f41531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:51.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.463+0000 7f04f9df9640 1 -- 172.21.15.5:0/4289528328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04f415b7c0 msgr2=0x7f04f40b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:51.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.463+0000 7f04f9df9640 1 --2- 172.21.15.5:0/4289528328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04f415b7c0 0x7f04f40b3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:51.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.463+0000 7f04f9df9640 1 -- 172.21.15.5:0/4289528328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e40094d0 con 0x7f04f41f8580 2023-07-14T13:32:51.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.463+0000 7f04f8df7640 1 --2- 172.21.15.5:0/4289528328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04f415b7c0 0x7f04f40b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:32:51.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.463+0000 7f04f9df9640 1 --2- 172.21.15.5:0/4289528328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f41f8580 0x7f04f40c7240 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00c7a0 tx=0x7f04ec00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:51.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.463+0000 7f04e9ffb640 1 -- 172.21.15.5:0/4289528328 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec00a640 con 0x7f04f41f8580 2023-07-14T13:32:51.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.463+0000 7f04e9ffb640 1 -- 172.21.15.5:0/4289528328 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ec00a7a0 con 0x7f04f41f8580 2023-07-14T13:32:51.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.463+0000 7f04fb85c640 1 -- 172.21.15.5:0/4289528328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f41f7aa0 con 0x7f04f41f8580 2023-07-14T13:32:51.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.463+0000 7f04e9ffb640 1 -- 172.21.15.5:0/4289528328 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec00ab10 con 0x7f04f41f8580 2023-07-14T13:32:51.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.463+0000 7f04fb85c640 1 -- 172.21.15.5:0/4289528328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f41f8060 con 0x7f04f41f8580 2023-07-14T13:32:51.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.463+0000 7f04fb85c640 1 -- 172.21.15.5:0/4289528328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f41f7900 con 0x7f04f41f8580 2023-07-14T13:32:51.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.463+0000 7f04e9ffb640 1 -- 172.21.15.5:0/4289528328 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 102) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f04ec00ac70 con 0x7f04f41f8580 2023-07-14T13:32:51.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.463+0000 7f04e9ffb640 1 --2- 172.21.15.5:0/4289528328 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f04d80660d0 0x7f04d8068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:51.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.463+0000 7f04e9ffb640 1 -- 172.21.15.5:0/4289528328 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f04ec083520 con 0x7f04f41f8580 2023-07-14T13:32:51.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.467+0000 7f04f95f8640 1 --2- 172.21.15.5:0/4289528328 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f04d80660d0 0x7f04d8068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:51.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.467+0000 7f04f95f8640 1 --2- 172.21.15.5:0/4289528328 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f04d80660d0 0x7f04d8068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f04f0009a50 tx=0x7f04f0008040 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:51.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.467+0000 7f04e9ffb640 1 -- 172.21.15.5:0/4289528328 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f04f41f7900 con 0x7f04f41f8580 2023-07-14T13:32:51.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.627+0000 7f04fb85c640 1 -- 172.21.15.5:0/4289528328 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04f41f7900 con 0x7f04f41f8580 2023-07-14T13:32:51.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.627+0000 7f04e9ffb640 1 -- 172.21.15.5:0/4289528328 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) v1 ==== 74+0+19366 (secure 0 0 0) 0x7f04f41f7900 con 0x7f04f41f8580 2023-07-14T13:32:51.630 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:51.630 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":193,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:32:49.859696+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:32:28.300155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-14T13:32:29.622154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6833/4121325793":"2023-07-15T13:32:49.859631+0000","172.21.15.154:6832/4121325793":"2023-07-15T13:32:49.859631+0000","172.21.15.154:0/2193305732":"2023-07-15T13:32:49.859631+0000","172.21.15.154:0/2055629106":"2023-07-15T13:32:49.859631+0000","172.21.15.154:0/3652890289":"2023-07-15T13:32:43.012909+0000","172.21.15.154:0/4024881055":"2023-07-15T13:32:49.859631+0000","172.21.15.154:0/88577192":"2023-07-15T13:32:43.012909+0000","172.21.15.154:0/724628748":"2023-07-15T13:32:49.859631+0000","172.21.15.154:0/191962473":"2023-07-15T13:32:43.012909+0000","172.21.15.154:0/766636820":"2023-07-15T13:32:49.859631+0000","172.21.15.154:0/1728568663":"2023-07-15T13:32:43.012909+0000","172.21.15.154:0/2303773027":"2023-07-15T13:32:49.859631+0000","172.21.15.154:0/1982074443":"2023-07-15T13:32:43.012909+0000","172.21.15.154:6833/2194391064":"2023-07-15T13:32:43.012909+0000","172.21.15.154:0/1493655222":"2023-07-15T13:32:49.859631+0000","172.21.15.154:0/3851820787":"2023-07-15T13:32:43.012909+0000","172.21.15.154:6832/2194391064":"2023-07-15T13:32:43.012909+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:32:51.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.631+0000 7f04fb85c640 1 -- 172.21.15.5:0/4289528328 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f04d80660d0 msgr2=0x7f04d8068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.631+0000 7f04fb85c640 1 --2- 172.21.15.5:0/4289528328 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f04d80660d0 0x7f04d8068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f04f0009a50 tx=0x7f04f0008040 comp rx=0 tx=0).stop 2023-07-14T13:32:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.631+0000 7f04fb85c640 1 -- 172.21.15.5:0/4289528328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f41f8580 msgr2=0x7f04f40c7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.631+0000 7f04fb85c640 1 --2- 172.21.15.5:0/4289528328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f41f8580 0x7f04f40c7240 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00c7a0 tx=0x7f04ec00cc60 comp rx=0 tx=0).stop 2023-07-14T13:32:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.631+0000 7f04fb85c640 1 -- 172.21.15.5:0/4289528328 shutdown_connections 2023-07-14T13:32:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.631+0000 7f04fb85c640 1 --2- 172.21.15.5:0/4289528328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04f41f8580 0x7f04f40c7240 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.631+0000 7f04fb85c640 1 --2- 172.21.15.5:0/4289528328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04f415b7c0 0x7f04f40b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:51.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.631+0000 7f04fb85c640 1 --2- 172.21.15.5:0/4289528328 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f04d80660d0 0x7f04d8068580 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:51.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.631+0000 7f04fb85c640 1 --2- 172.21.15.5:0/4289528328 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04f406fd90 0x7f04f41531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:51.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.631+0000 7f04fb85c640 1 -- 172.21.15.5:0/4289528328 >> 172.21.15.5:0/4289528328 conn(0x7f04f40afcf0 msgr2=0x7f04f4157610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:51.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.631+0000 7f04fb85c640 1 -- 172.21.15.5:0/4289528328 shutdown_connections 2023-07-14T13:32:51.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.631+0000 7f04fb85c640 1 -- 172.21.15.5:0/4289528328 wait complete. 2023-07-14T13:32:51.651 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-14T13:32:51.652 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:32:51.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.795+0000 7f36ea1d2640 1 Processor -- start 2023-07-14T13:32:51.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.795+0000 7f36ea1d2640 1 -- start start 2023-07-14T13:32:51.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.795+0000 7f36ea1d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36e40b7c70 0x7f36e40d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:51.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.795+0000 7f36ea1d2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f36e40d1850 0x7f36e415f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:51.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.795+0000 7f36ea1d2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e40ccaf0 con 0x7f36e40d1300 2023-07-14T13:32:51.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.795+0000 7f36ea1d2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e40d1190 con 0x7f36e40d1850 2023-07-14T13:32:51.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.795+0000 7f36ea1d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e4160600 con 0x7f36e40b7c70 2023-07-14T13:32:51.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.795+0000 7f36e37fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36e40b7c70 0x7f36e40d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:51.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.795+0000 7f36e3fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f36e40d1300 0x7f36e40d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:53452/0 (socket says 172.21.15.5:53452) 2023-07-14T13:32:51.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.795+0000 7f36e2ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f36e40d1850 0x7f36e415f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:51.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.795+0000 7f36e3fff640 1 -- 172.21.15.5:0/252330019 learned_addr learned my addr 172.21.15.5:0/252330019 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:51.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.795+0000 7f36e37fe640 1 -- 172.21.15.5:0/252330019 >> v2:172.21.15.154:3300/0 conn(0x7f36e40d1850 msgr2=0x7f36e415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:51.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.795+0000 7f36e27fc640 1 -- 172.21.15.5:0/252330019 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1452938127 0 0) 0x7f36e40ccaf0 con 0x7f36e40d1300 2023-07-14T13:32:51.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.795+0000 7f36e37fe640 1 --2- 172.21.15.5:0/252330019 >> v2:172.21.15.154:3300/0 conn(0x7f36e40d1850 0x7f36e415f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:51.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.795+0000 7f36e37fe640 1 -- 172.21.15.5:0/252330019 >> v1:172.21.15.154:6789/0 conn(0x7f36e40d1300 legacy=0x7f36e40d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:51.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.795+0000 7f36e37fe640 1 -- 172.21.15.5:0/252330019 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e4160320 con 0x7f36e40b7c70 2023-07-14T13:32:51.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.795+0000 7f36e2ffd640 1 --2- 172.21.15.5:0/252330019 >> v2:172.21.15.154:3300/0 conn(0x7f36e40d1850 0x7f36e415f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:32:51.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.799+0000 7f36e37fe640 1 --2- 172.21.15.5:0/252330019 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36e40b7c70 0x7f36e40d0c50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f36d40097c0 tx=0x7f36d401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34f249de49d6ef6d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:51.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.799+0000 7f36e27fc640 1 -- 172.21.15.5:0/252330019 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d40ad660 con 0x7f36e40b7c70 2023-07-14T13:32:51.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.799+0000 7f36e27fc640 1 -- 172.21.15.5:0/252330019 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d40ad7c0 con 0x7f36e40b7c70 2023-07-14T13:32:51.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.799+0000 7f36e27fc640 1 -- 172.21.15.5:0/252330019 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d40adb50 con 0x7f36e40b7c70 2023-07-14T13:32:51.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.799+0000 7f36ea1d2640 1 -- 172.21.15.5:0/252330019 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36e40b7c70 msgr2=0x7f36e40d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:51.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.799+0000 7f36ea1d2640 1 --2- 172.21.15.5:0/252330019 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36e40b7c70 0x7f36e40d0c50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f36d40097c0 tx=0x7f36d401c450 comp rx=0 tx=0).stop 2023-07-14T13:32:51.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.799+0000 7f36ea1d2640 1 -- 172.21.15.5:0/252330019 shutdown_connections 2023-07-14T13:32:51.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.799+0000 7f36ea1d2640 1 --2- 172.21.15.5:0/252330019 >> v2:172.21.15.154:3300/0 conn(0x7f36e40d1850 0x7f36e415f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:51.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.799+0000 7f36ea1d2640 1 --2- 172.21.15.5:0/252330019 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36e40b7c70 0x7f36e40d0c50 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:51.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.799+0000 7f36ea1d2640 1 -- 172.21.15.5:0/252330019 >> 172.21.15.5:0/252330019 conn(0x7f36e40650b0 msgr2=0x7f36e40654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:51.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.803+0000 7f36ea1d2640 1 -- 172.21.15.5:0/252330019 shutdown_connections 2023-07-14T13:32:51.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.803+0000 7f36ea1d2640 1 -- 172.21.15.5:0/252330019 wait complete. 2023-07-14T13:32:51.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.803+0000 7f36ea1d2640 1 Processor -- start 2023-07-14T13:32:51.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.803+0000 7f36ea1d2640 1 -- start start 2023-07-14T13:32:51.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.803+0000 7f36ea1d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36e40b7c70 0x7f36e40ce770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:51.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.803+0000 7f36ea1d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36e40d1300 0x7f36e4157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:51.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.803+0000 7f36ea1d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e40d1850 0x7f36e40c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:51.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.803+0000 7f36ea1d2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e4154390 con 0x7f36e40d1850 2023-07-14T13:32:51.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.803+0000 7f36ea1d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e4153780 con 0x7f36e40d1300 2023-07-14T13:32:51.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.803+0000 7f36ea1d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e4153a60 con 0x7f36e40b7c70 2023-07-14T13:32:51.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.803+0000 7f36e3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e40d1850 0x7f36e40c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:51.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.803+0000 7f36e3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e40d1850 0x7f36e40c93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54028/0 (socket says 172.21.15.5:54028) 2023-07-14T13:32:51.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.803+0000 7f36e3fff640 1 -- 172.21.15.5:0/2604502718 learned_addr learned my addr 172.21.15.5:0/2604502718 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:51.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.803+0000 7f36e2ffd640 1 --2- 172.21.15.5:0/2604502718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36e40d1300 0x7f36e4157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:51.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.803+0000 7f36e37fe640 1 --2- 172.21.15.5:0/2604502718 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36e40b7c70 0x7f36e40ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:51.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.803+0000 7f36e3fff640 1 -- 172.21.15.5:0/2604502718 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36e40b7c70 msgr2=0x7f36e40ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:51.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.803+0000 7f36e3fff640 1 --2- 172.21.15.5:0/2604502718 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36e40b7c70 0x7f36e40ce770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:51.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.803+0000 7f36e3fff640 1 -- 172.21.15.5:0/2604502718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36e40d1300 msgr2=0x7f36e4157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:51.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.803+0000 7f36e3fff640 1 --2- 172.21.15.5:0/2604502718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36e40d1300 0x7f36e4157860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:51.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.803+0000 7f36e3fff640 1 -- 172.21.15.5:0/2604502718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d8009420 con 0x7f36e40d1850 2023-07-14T13:32:51.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.807+0000 7f36e3fff640 1 --2- 172.21.15.5:0/2604502718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e40d1850 0x7f36e40c93d0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f36dc00c780 tx=0x7f36dc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:51.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.807+0000 7f36cbfff640 1 -- 172.21.15.5:0/2604502718 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc00ce90 con 0x7f36e40d1850 2023-07-14T13:32:51.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.807+0000 7f36cbfff640 1 -- 172.21.15.5:0/2604502718 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36dc00a640 con 0x7f36e40d1850 2023-07-14T13:32:51.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.807+0000 7f36cbfff640 1 -- 172.21.15.5:0/2604502718 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc00a9d0 con 0x7f36e40d1850 2023-07-14T13:32:51.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.807+0000 7f36ea1d2640 1 -- 172.21.15.5:0/2604502718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d4009420 con 0x7f36e40d1850 2023-07-14T13:32:51.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.807+0000 7f36ea1d2640 1 -- 172.21.15.5:0/2604502718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e4154020 con 0x7f36e40d1850 2023-07-14T13:32:51.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.807+0000 7f36ea1d2640 1 -- 172.21.15.5:0/2604502718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e40678d0 con 0x7f36e40d1850 2023-07-14T13:32:51.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.807+0000 7f36cbfff640 1 -- 172.21.15.5:0/2604502718 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 102) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f36dc00ab30 con 0x7f36e40d1850 2023-07-14T13:32:51.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.807+0000 7f36cbfff640 1 --2- 172.21.15.5:0/2604502718 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f36d00660d0 0x7f36d0068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:51.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.807+0000 7f36cbfff640 1 -- 172.21.15.5:0/2604502718 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f36dc0831b0 con 0x7f36e40d1850 2023-07-14T13:32:51.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.807+0000 7f36e37fe640 1 --2- 172.21.15.5:0/2604502718 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f36d00660d0 0x7f36d0068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:51.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.811+0000 7f36e37fe640 1 --2- 172.21.15.5:0/2604502718 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f36d00660d0 0x7f36d0068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f36d40097c0 tx=0x7f36d40a7000 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:51.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.811+0000 7f36cbfff640 1 -- 172.21.15.5:0/2604502718 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f36dc050650 con 0x7f36e40d1850 2023-07-14T13:32:52.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.999+0000 7f36ea1d2640 1 -- 172.21.15.5:0/2604502718 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36e40d0d60 con 0x7f36e40d1850 2023-07-14T13:32:52.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:51.999+0000 7f36cbfff640 1 -- 172.21.15.5:0/2604502718 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4714 (secure 0 0 0) 0x7f36dc018090 con 0x7f36e40d1850 2023-07-14T13:32:52.002 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:52.003 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8669,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3337947661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3337947661},{"type":"v1","addr":"172.21.15.154:6835","nonce":3337947661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8675,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/695363750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":695363750},{"type":"v1","addr":"172.21.15.154:6837","nonce":695363750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":10542,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1412864639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1412864639},{"type":"v1","addr":"172.21.15.5:6833","nonce":1412864639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:32:30.624611+0000","modified":"2023-07-14T13:32:34.244769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10545":{"gid":10545,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6835/1752765831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1752765831},{"type":"v1","addr":"172.21.15.5:6835","nonce":1752765831}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-14T13:32:52.003 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 92 2023-07-14T13:32:52.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.003+0000 7f36ea1d2640 1 -- 172.21.15.5:0/2604502718 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f36d00660d0 msgr2=0x7f36d0068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:52.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.003+0000 7f36ea1d2640 1 --2- 172.21.15.5:0/2604502718 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f36d00660d0 0x7f36d0068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f36d40097c0 tx=0x7f36d40a7000 comp rx=0 tx=0).stop 2023-07-14T13:32:52.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.003+0000 7f36ea1d2640 1 -- 172.21.15.5:0/2604502718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e40d1850 msgr2=0x7f36e40c93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:52.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.003+0000 7f36ea1d2640 1 --2- 172.21.15.5:0/2604502718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e40d1850 0x7f36e40c93d0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f36dc00c780 tx=0x7f36dc00cc40 comp rx=0 tx=0).stop 2023-07-14T13:32:52.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.003+0000 7f36ea1d2640 1 -- 172.21.15.5:0/2604502718 shutdown_connections 2023-07-14T13:32:52.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.003+0000 7f36ea1d2640 1 --2- 172.21.15.5:0/2604502718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36e40d1850 0x7f36e40c93d0 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.003+0000 7f36ea1d2640 1 --2- 172.21.15.5:0/2604502718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36e40d1300 0x7f36e4157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.003+0000 7f36ea1d2640 1 --2- 172.21.15.5:0/2604502718 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f36d00660d0 0x7f36d0068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.003+0000 7f36ea1d2640 1 --2- 172.21.15.5:0/2604502718 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36e40b7c70 0x7f36e40ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.003+0000 7f36ea1d2640 1 -- 172.21.15.5:0/2604502718 >> 172.21.15.5:0/2604502718 conn(0x7f36e40650b0 msgr2=0x7f36e40b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:52.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.003+0000 7f36ea1d2640 1 -- 172.21.15.5:0/2604502718 shutdown_connections 2023-07-14T13:32:52.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.003+0000 7f36ea1d2640 1 -- 172.21.15.5:0/2604502718 wait complete. 2023-07-14T13:32:52.024 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:32:52.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.167+0000 7f921f9d2640 1 Processor -- start 2023-07-14T13:32:52.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.167+0000 7f921f9d2640 1 -- start start 2023-07-14T13:32:52.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.167+0000 7f921f9d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f921815bdf0 0x7f92180ca970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:52.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.167+0000 7f921f9d2640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f92180c8e70 0x7f92180c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:52.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.167+0000 7f921f9d2640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92180cb2e0 con 0x7f921815f970 2023-07-14T13:32:52.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.167+0000 7f921f9d2640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92180cb5c0 con 0x7f92180c8e70 2023-07-14T13:32:52.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.167+0000 7f921f9d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92180cb8a0 con 0x7f921815bdf0 2023-07-14T13:32:52.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.167+0000 7f921df6f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f92180c8e70 0x7f92180c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:52.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.167+0000 7f921cf6d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f921815f970 0x7f921815fdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34576/0 (socket says 172.21.15.5:34576) 2023-07-14T13:32:52.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.167+0000 7f921cf6d640 1 -- 172.21.15.5:0/1581290767 learned_addr learned my addr 172.21.15.5:0/1581290767 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:52.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.171+0000 7f921d76e640 1 --2- 172.21.15.5:0/1581290767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f921815bdf0 0x7f92180ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:52.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.171+0000 7f921df6f640 1 -- 172.21.15.5:0/1581290767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f921815bdf0 msgr2=0x7f92180ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:52.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.171+0000 7f921df6f640 1 --2- 172.21.15.5:0/1581290767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f921815bdf0 0x7f92180ca970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.171+0000 7f920ffff640 1 -- 172.21.15.5:0/1581290767 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066440132 0 0) 0x7f92180cb2e0 con 0x7f921815f970 2023-07-14T13:32:52.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.171+0000 7f921df6f640 1 -- 172.21.15.5:0/1581290767 >> v1:172.21.15.5:6789/0 conn(0x7f921815f970 legacy=0x7f921815fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:52.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.171+0000 7f921df6f640 1 -- 172.21.15.5:0/1581290767 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92180c8950 con 0x7f92180c8e70 2023-07-14T13:32:52.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.171+0000 7f921d76e640 1 --2- 172.21.15.5:0/1581290767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f921815bdf0 0x7f92180ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:32:52.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.171+0000 7f921df6f640 1 --2- 172.21.15.5:0/1581290767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92180c8e70 0x7f92180c92f0 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f9210009d90 tx=0x7f921001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be895de15ec8c19 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:52.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.171+0000 7f920ffff640 1 -- 172.21.15.5:0/1581290767 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92100a59a0 con 0x7f92180c8e70 2023-07-14T13:32:52.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.171+0000 7f920ffff640 1 -- 172.21.15.5:0/1581290767 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92100a5b00 con 0x7f92180c8e70 2023-07-14T13:32:52.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.171+0000 7f920ffff640 1 -- 172.21.15.5:0/1581290767 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92100a5e90 con 0x7f92180c8e70 2023-07-14T13:32:52.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.175+0000 7f921f9d2640 1 -- 172.21.15.5:0/1581290767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92180c8e70 msgr2=0x7f92180c92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:52.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.175+0000 7f921f9d2640 1 --2- 172.21.15.5:0/1581290767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92180c8e70 0x7f92180c92f0 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f9210009d90 tx=0x7f921001c8c0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.175+0000 7f921f9d2640 1 -- 172.21.15.5:0/1581290767 shutdown_connections 2023-07-14T13:32:52.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.175+0000 7f921f9d2640 1 --2- 172.21.15.5:0/1581290767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92180c8e70 0x7f92180c92f0 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.175+0000 7f921f9d2640 1 --2- 172.21.15.5:0/1581290767 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f921815bdf0 0x7f92180ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.175+0000 7f921f9d2640 1 -- 172.21.15.5:0/1581290767 >> 172.21.15.5:0/1581290767 conn(0x7f92180afcf0 msgr2=0x7f92180b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:52.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.175+0000 7f921f9d2640 1 -- 172.21.15.5:0/1581290767 shutdown_connections 2023-07-14T13:32:52.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.175+0000 7f921f9d2640 1 -- 172.21.15.5:0/1581290767 wait complete. 2023-07-14T13:32:52.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.175+0000 7f921f9d2640 1 Processor -- start 2023-07-14T13:32:52.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.175+0000 7f921f9d2640 1 -- start start 2023-07-14T13:32:52.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.175+0000 7f921f9d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92180c8e70 0x7f9218157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:52.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.175+0000 7f921f9d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f921815bdf0 0x7f92180c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:52.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.175+0000 7f921f9d2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f921815f970 0x7f92180b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:52.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.175+0000 7f921f9d2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92180c6450 con 0x7f92180c8e70 2023-07-14T13:32:52.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.175+0000 7f921f9d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92181578c0 con 0x7f921815bdf0 2023-07-14T13:32:52.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.175+0000 7f921f9d2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92180c66f0 con 0x7f921815f970 2023-07-14T13:32:52.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.175+0000 7f921d76e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92180c8e70 0x7f9218157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:52.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.175+0000 7f921d76e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92180c8e70 0x7f9218157380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54046/0 (socket says 172.21.15.5:54046) 2023-07-14T13:32:52.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.175+0000 7f921d76e640 1 -- 172.21.15.5:0/4186378253 learned_addr learned my addr 172.21.15.5:0/4186378253 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:52.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.175+0000 7f921df6f640 1 --2- 172.21.15.5:0/4186378253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f921815f970 0x7f92180b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:52.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.175+0000 7f921cf6d640 1 --2- 172.21.15.5:0/4186378253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f921815bdf0 0x7f92180c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:52.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.175+0000 7f921d76e640 1 -- 172.21.15.5:0/4186378253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f921815f970 msgr2=0x7f92180b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:52.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.175+0000 7f921d76e640 1 --2- 172.21.15.5:0/4186378253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f921815f970 0x7f92180b00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.175+0000 7f921d76e640 1 -- 172.21.15.5:0/4186378253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f921815bdf0 msgr2=0x7f92180c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:52.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.175+0000 7f921d76e640 1 --2- 172.21.15.5:0/4186378253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f921815bdf0 0x7f92180c71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.175+0000 7f921d76e640 1 -- 172.21.15.5:0/4186378253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9210009a70 con 0x7f92180c8e70 2023-07-14T13:32:52.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.179+0000 7f921d76e640 1 --2- 172.21.15.5:0/4186378253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92180c8e70 0x7f9218157380 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f921400c7c0 tx=0x7f921400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:52.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.179+0000 7f920dffb640 1 -- 172.21.15.5:0/4186378253 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9214007a30 con 0x7f92180c8e70 2023-07-14T13:32:52.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.179+0000 7f920dffb640 1 -- 172.21.15.5:0/4186378253 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9214007b90 con 0x7f92180c8e70 2023-07-14T13:32:52.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.179+0000 7f920dffb640 1 -- 172.21.15.5:0/4186378253 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921400ce70 con 0x7f92180c8e70 2023-07-14T13:32:52.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.179+0000 7f921f9d2640 1 -- 172.21.15.5:0/4186378253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92180c69d0 con 0x7f92180c8e70 2023-07-14T13:32:52.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.179+0000 7f921f9d2640 1 -- 172.21.15.5:0/4186378253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f921815f430 con 0x7f92180c8e70 2023-07-14T13:32:52.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.179+0000 7f921f9d2640 1 -- 172.21.15.5:0/4186378253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92180678d0 con 0x7f92180c8e70 2023-07-14T13:32:52.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.179+0000 7f920dffb640 1 -- 172.21.15.5:0/4186378253 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 102) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f92140113f0 con 0x7f92180c8e70 2023-07-14T13:32:52.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.179+0000 7f920dffb640 1 --2- 172.21.15.5:0/4186378253 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f91fc0660d0 0x7f91fc068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:52.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.179+0000 7f920dffb640 1 -- 172.21.15.5:0/4186378253 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f92140841c0 con 0x7f92180c8e70 2023-07-14T13:32:52.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.179+0000 7f921cf6d640 1 --2- 172.21.15.5:0/4186378253 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f91fc0660d0 0x7f91fc068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:52.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.183+0000 7f921cf6d640 1 --2- 172.21.15.5:0/4186378253 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f91fc0660d0 0x7f91fc068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f921815ec80 tx=0x7f9208007df0 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:52.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.183+0000 7f920dffb640 1 -- 172.21.15.5:0/4186378253 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f92140515d0 con 0x7f92180c8e70 2023-07-14T13:32:52.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.191+0000 7f920dffb640 1 -- 172.21.15.5:0/4186378253 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f92140519a0 con 0x7f92180c8e70 2023-07-14T13:32:52.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.375+0000 7f921f9d2640 1 -- 172.21.15.5:0/4186378253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92180c6e80 con 0x7f92180c8e70 2023-07-14T13:32:52.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.375+0000 7f920dffb640 1 -- 172.21.15.5:0/4186378253 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4714 (secure 0 0 0) 0x7f921406ee70 con 0x7f92180c8e70 2023-07-14T13:32:52.378 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:52.378 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8669,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3337947661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3337947661},{"type":"v1","addr":"172.21.15.154:6835","nonce":3337947661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8675,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/695363750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":695363750},{"type":"v1","addr":"172.21.15.154:6837","nonce":695363750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":10542,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1412864639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1412864639},{"type":"v1","addr":"172.21.15.5:6833","nonce":1412864639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T13:32:30.624611+0000","modified":"2023-07-14T13:32:34.244769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10545":{"gid":10545,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":5,"addr":"172.21.15.5:6835/1752765831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1752765831},{"type":"v1","addr":"172.21.15.5:6835","nonce":1752765831}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-14T13:32:52.379 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 92 2023-07-14T13:32:52.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.379+0000 7f921f9d2640 1 -- 172.21.15.5:0/4186378253 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f91fc0660d0 msgr2=0x7f91fc068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:52.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.379+0000 7f921f9d2640 1 --2- 172.21.15.5:0/4186378253 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f91fc0660d0 0x7f91fc068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f921815ec80 tx=0x7f9208007df0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.379+0000 7f921f9d2640 1 -- 172.21.15.5:0/4186378253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92180c8e70 msgr2=0x7f9218157380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:52.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.379+0000 7f921f9d2640 1 --2- 172.21.15.5:0/4186378253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92180c8e70 0x7f9218157380 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f921400c7c0 tx=0x7f921400cc80 comp rx=0 tx=0).stop 2023-07-14T13:32:52.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.379+0000 7f921f9d2640 1 -- 172.21.15.5:0/4186378253 shutdown_connections 2023-07-14T13:32:52.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.379+0000 7f921f9d2640 1 --2- 172.21.15.5:0/4186378253 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f91fc0660d0 0x7f91fc068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.379+0000 7f921f9d2640 1 --2- 172.21.15.5:0/4186378253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f921815f970 0x7f92180b00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.379+0000 7f921f9d2640 1 --2- 172.21.15.5:0/4186378253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f921815bdf0 0x7f92180c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.379+0000 7f921f9d2640 1 --2- 172.21.15.5:0/4186378253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92180c8e70 0x7f9218157380 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.379+0000 7f921f9d2640 1 -- 172.21.15.5:0/4186378253 >> 172.21.15.5:0/4186378253 conn(0x7f92180afcf0 msgr2=0x7f921815fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:52.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.379+0000 7f921f9d2640 1 -- 172.21.15.5:0/4186378253 shutdown_connections 2023-07-14T13:32:52.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.379+0000 7f921f9d2640 1 -- 172.21.15.5:0/4186378253 wait complete. 2023-07-14T13:32:52.399 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:32:52.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.543+0000 7ff73759e640 1 Processor -- start 2023-07-14T13:32:52.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.543+0000 7ff73759e640 1 -- start start 2023-07-14T13:32:52.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.543+0000 7ff73759e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73815f3f0 0x7ff7380b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:52.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.543+0000 7ff73759e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff7380d13f0 0x7ff7380b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:52.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.543+0000 7ff73759e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7380cc9a0 0x7ff7380ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:52.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.543+0000 7ff73759e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7380d0f60 con 0x7ff7380cc9a0 2023-07-14T13:32:52.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.543+0000 7ff73759e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7380d0390 con 0x7ff7380d13f0 2023-07-14T13:32:52.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.543+0000 7ff73759e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7380d0630 con 0x7ff73815f3f0 2023-07-14T13:32:52.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.543+0000 7ff736d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7380cc9a0 0x7ff7380ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:52.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.543+0000 7ff736d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff7380cc9a0 0x7ff7380ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54048/0 (socket says 172.21.15.5:54048) 2023-07-14T13:32:52.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.543+0000 7ff736d9d640 1 -- 172.21.15.5:0/3547001786 learned_addr learned my addr 172.21.15.5:0/3547001786 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:52.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.543+0000 7ff72ffff640 1 --2- 172.21.15.5:0/3547001786 >> v2:172.21.15.154:3300/0 conn(0x7ff7380d13f0 0x7ff7380b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:52.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.543+0000 7ff73659c640 1 --2- 172.21.15.5:0/3547001786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73815f3f0 0x7ff7380b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:52.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.543+0000 7ff736d9d640 1 -- 172.21.15.5:0/3547001786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73815f3f0 msgr2=0x7ff7380b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:52.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.543+0000 7ff736d9d640 1 --2- 172.21.15.5:0/3547001786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73815f3f0 0x7ff7380b7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.543+0000 7ff736d9d640 1 -- 172.21.15.5:0/3547001786 >> v2:172.21.15.154:3300/0 conn(0x7ff7380d13f0 msgr2=0x7ff7380b7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:52.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.543+0000 7ff736d9d640 1 --2- 172.21.15.5:0/3547001786 >> v2:172.21.15.154:3300/0 conn(0x7ff7380d13f0 0x7ff7380b7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.543+0000 7ff736d9d640 1 -- 172.21.15.5:0/3547001786 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7380d0910 con 0x7ff7380cc9a0 2023-07-14T13:32:52.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.547+0000 7ff736d9d640 1 --2- 172.21.15.5:0/3547001786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7380cc9a0 0x7ff7380ccdd0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7ff738066090 tx=0x7ff73001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6685f5e62fc593c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:52.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.547+0000 7ff735d9b640 1 -- 172.21.15.5:0/3547001786 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7300a5640 con 0x7ff7380cc9a0 2023-07-14T13:32:52.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.547+0000 7ff735d9b640 1 -- 172.21.15.5:0/3547001786 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7300a57a0 con 0x7ff7380cc9a0 2023-07-14T13:32:52.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.547+0000 7ff735d9b640 1 -- 172.21.15.5:0/3547001786 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7300a5b30 con 0x7ff7380cc9a0 2023-07-14T13:32:52.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.547+0000 7ff73759e640 1 -- 172.21.15.5:0/3547001786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7380cc9a0 msgr2=0x7ff7380ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:52.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.547+0000 7ff73759e640 1 --2- 172.21.15.5:0/3547001786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7380cc9a0 0x7ff7380ccdd0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7ff738066090 tx=0x7ff73001c940 comp rx=0 tx=0).stop 2023-07-14T13:32:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.547+0000 7ff73759e640 1 -- 172.21.15.5:0/3547001786 shutdown_connections 2023-07-14T13:32:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.547+0000 7ff73759e640 1 --2- 172.21.15.5:0/3547001786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7380cc9a0 0x7ff7380ccdd0 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.547+0000 7ff73759e640 1 --2- 172.21.15.5:0/3547001786 >> v2:172.21.15.154:3300/0 conn(0x7ff7380d13f0 0x7ff7380b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.547+0000 7ff73759e640 1 --2- 172.21.15.5:0/3547001786 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff73815f3f0 0x7ff7380b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.547+0000 7ff73759e640 1 -- 172.21.15.5:0/3547001786 >> 172.21.15.5:0/3547001786 conn(0x7ff738069f50 msgr2=0x7ff73806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.547+0000 7ff73759e640 1 -- 172.21.15.5:0/3547001786 shutdown_connections 2023-07-14T13:32:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.547+0000 7ff73759e640 1 -- 172.21.15.5:0/3547001786 wait complete. 2023-07-14T13:32:52.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.547+0000 7ff73759e640 1 Processor -- start 2023-07-14T13:32:52.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.551+0000 7ff73759e640 1 -- start start 2023-07-14T13:32:52.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.551+0000 7ff73759e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7380cc9a0 0x7ff7380c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:52.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.551+0000 7ff73759e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7380d13f0 0x7ff738154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:52.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.551+0000 7ff73759e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff73815f3f0 0x7ff738158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:52.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.551+0000 7ff73759e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7381f7610 con 0x7ff73815f3f0 2023-07-14T13:32:52.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.551+0000 7ff73759e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7381f78f0 con 0x7ff7380cc9a0 2023-07-14T13:32:52.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.551+0000 7ff73759e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7381f7bd0 con 0x7ff7380d13f0 2023-07-14T13:32:52.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.551+0000 7ff736d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff73815f3f0 0x7ff738158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:52.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.551+0000 7ff736d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff73815f3f0 0x7ff738158280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54064/0 (socket says 172.21.15.5:54064) 2023-07-14T13:32:52.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.551+0000 7ff736d9d640 1 -- 172.21.15.5:0/2726497705 learned_addr learned my addr 172.21.15.5:0/2726497705 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:52.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.551+0000 7ff73659c640 1 --2- 172.21.15.5:0/2726497705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7380cc9a0 0x7ff7380c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:52.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.551+0000 7ff72ffff640 1 --2- 172.21.15.5:0/2726497705 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7380d13f0 0x7ff738154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:52.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.551+0000 7ff736d9d640 1 -- 172.21.15.5:0/2726497705 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7380d13f0 msgr2=0x7ff738154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:52.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.551+0000 7ff736d9d640 1 --2- 172.21.15.5:0/2726497705 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7380d13f0 0x7ff738154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.551+0000 7ff736d9d640 1 -- 172.21.15.5:0/2726497705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7380cc9a0 msgr2=0x7ff7380c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:52.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.551+0000 7ff736d9d640 1 --2- 172.21.15.5:0/2726497705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7380cc9a0 0x7ff7380c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.551+0000 7ff736d9d640 1 -- 172.21.15.5:0/2726497705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff730009b30 con 0x7ff73815f3f0 2023-07-14T13:32:52.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.551+0000 7ff736d9d640 1 --2- 172.21.15.5:0/2726497705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff73815f3f0 0x7ff738158280 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7ff7300af040 tx=0x7ff7300196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:52.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.551+0000 7ff72effd640 1 -- 172.21.15.5:0/2726497705 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7300b8670 con 0x7ff73815f3f0 2023-07-14T13:32:52.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.551+0000 7ff72effd640 1 -- 172.21.15.5:0/2726497705 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7300b87d0 con 0x7ff73815f3f0 2023-07-14T13:32:52.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.551+0000 7ff73759e640 1 -- 172.21.15.5:0/2726497705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7381f7eb0 con 0x7ff73815f3f0 2023-07-14T13:32:52.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.551+0000 7ff72effd640 1 -- 172.21.15.5:0/2726497705 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7300b8b80 con 0x7ff73815f3f0 2023-07-14T13:32:52.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.551+0000 7ff73759e640 1 -- 172.21.15.5:0/2726497705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7381f51e0 con 0x7ff73815f3f0 2023-07-14T13:32:52.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.551+0000 7ff73759e640 1 -- 172.21.15.5:0/2726497705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7380678d0 con 0x7ff73815f3f0 2023-07-14T13:32:52.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.555+0000 7ff72effd640 1 -- 172.21.15.5:0/2726497705 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff7300b8ce0 con 0x7ff73815f3f0 2023-07-14T13:32:52.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.555+0000 7ff72effd640 1 --2- 172.21.15.5:0/2726497705 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7ff7180663a0 0x7ff718068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:52.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.555+0000 7ff72effd640 1 -- 172.21.15.5:0/2726497705 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6821+0+0 (secure 0 0 0) 0x7ff73011f670 con 0x7ff73815f3f0 2023-07-14T13:32:52.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.555+0000 7ff73659c640 1 --2- 172.21.15.5:0/2726497705 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7ff7180663a0 0x7ff718068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:52.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.555+0000 7ff73659c640 1 --2- 172.21.15.5:0/2726497705 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7ff7180663a0 0x7ff718068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff72800b930 tx=0x7ff728008040 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:52.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.559+0000 7ff72effd640 1 -- 172.21.15.5:0/2726497705 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff7300ec6d0 con 0x7ff73815f3f0 2023-07-14T13:32:52.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.711+0000 7ff73759e640 1 -- 172.21.15.5:0/2726497705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7381f8360 con 0x7ff73815f3f0 2023-07-14T13:32:52.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.715+0000 7ff72effd640 1 -- 172.21.15.5:0/2726497705 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) v1 ==== 74+0+19366 (secure 0 0 0) 0x7ff7300efcf0 con 0x7ff73815f3f0 2023-07-14T13:32:52.716 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:52.716 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":193,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:32:49.859696+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-14T13:32:28.300155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-14T13:32:29.622154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6833/4121325793":"2023-07-15T13:32:49.859631+0000","172.21.15.154:6832/4121325793":"2023-07-15T13:32:49.859631+0000","172.21.15.154:0/2193305732":"2023-07-15T13:32:49.859631+0000","172.21.15.154:0/2055629106":"2023-07-15T13:32:49.859631+0000","172.21.15.154:0/3652890289":"2023-07-15T13:32:43.012909+0000","172.21.15.154:0/4024881055":"2023-07-15T13:32:49.859631+0000","172.21.15.154:0/88577192":"2023-07-15T13:32:43.012909+0000","172.21.15.154:0/724628748":"2023-07-15T13:32:49.859631+0000","172.21.15.154:0/191962473":"2023-07-15T13:32:43.012909+0000","172.21.15.154:0/766636820":"2023-07-15T13:32:49.859631+0000","172.21.15.154:0/1728568663":"2023-07-15T13:32:43.012909+0000","172.21.15.154:0/2303773027":"2023-07-15T13:32:49.859631+0000","172.21.15.154:0/1982074443":"2023-07-15T13:32:43.012909+0000","172.21.15.154:6833/2194391064":"2023-07-15T13:32:43.012909+0000","172.21.15.154:0/1493655222":"2023-07-15T13:32:49.859631+0000","172.21.15.154:0/3851820787":"2023-07-15T13:32:43.012909+0000","172.21.15.154:6832/2194391064":"2023-07-15T13:32:43.012909+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:32:52.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.715+0000 7ff73759e640 1 -- 172.21.15.5:0/2726497705 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7ff7180663a0 msgr2=0x7ff718068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:52.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.715+0000 7ff73759e640 1 --2- 172.21.15.5:0/2726497705 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7ff7180663a0 0x7ff718068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff72800b930 tx=0x7ff728008040 comp rx=0 tx=0).stop 2023-07-14T13:32:52.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.715+0000 7ff73759e640 1 -- 172.21.15.5:0/2726497705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff73815f3f0 msgr2=0x7ff738158280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:52.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.715+0000 7ff73759e640 1 --2- 172.21.15.5:0/2726497705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff73815f3f0 0x7ff738158280 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7ff7300af040 tx=0x7ff7300196e0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.715+0000 7ff73759e640 1 -- 172.21.15.5:0/2726497705 shutdown_connections 2023-07-14T13:32:52.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.715+0000 7ff73759e640 1 --2- 172.21.15.5:0/2726497705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff73815f3f0 0x7ff738158280 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.715+0000 7ff73759e640 1 --2- 172.21.15.5:0/2726497705 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7ff7180663a0 0x7ff718068850 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.715+0000 7ff73759e640 1 --2- 172.21.15.5:0/2726497705 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7380d13f0 0x7ff738154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.715+0000 7ff73759e640 1 --2- 172.21.15.5:0/2726497705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7380cc9a0 0x7ff7380c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.715+0000 7ff73759e640 1 -- 172.21.15.5:0/2726497705 >> 172.21.15.5:0/2726497705 conn(0x7ff738069f50 msgr2=0x7ff7380b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:52.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.715+0000 7ff73759e640 1 -- 172.21.15.5:0/2726497705 shutdown_connections 2023-07-14T13:32:52.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.715+0000 7ff73759e640 1 -- 172.21.15.5:0/2726497705 wait complete. 2023-07-14T13:32:52.737 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-14T13:32:52.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.879+0000 7f240b5fa640 1 Processor -- start 2023-07-14T13:32:52.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.883+0000 7f240b5fa640 1 -- start start 2023-07-14T13:32:52.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.883+0000 7f240b5fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2404160330 0x7f24040cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:52.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.883+0000 7f240b5fa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f24040c8940 0x7f24040ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:52.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.883+0000 7f240b5fa640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f24040c0f80 0x7f24040cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:52.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.883+0000 7f240b5fa640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24040c17d0 con 0x7f24040c0f80 2023-07-14T13:32:52.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.883+0000 7f240b5fa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24040c14f0 con 0x7f24040c8940 2023-07-14T13:32:52.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.883+0000 7f240b5fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24040cac10 con 0x7f2404160330 2023-07-14T13:32:52.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.883+0000 7f2409b97640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f24040c0f80 0x7f24040cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:52.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.883+0000 7f2409b97640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f24040c0f80 0x7f24040cd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54080/0 (socket says 172.21.15.5:54080) 2023-07-14T13:32:52.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.883+0000 7f2409b97640 1 -- 172.21.15.5:0/397157672 learned_addr learned my addr 172.21.15.5:0/397157672 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:52.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.883+0000 7f2408b95640 1 --2- 172.21.15.5:0/397157672 >> v2:172.21.15.154:3300/0 conn(0x7f24040c8940 0x7f24040ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:52.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.883+0000 7f2409396640 1 --2- 172.21.15.5:0/397157672 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2404160330 0x7f24040cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:52.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.883+0000 7f2409b97640 1 -- 172.21.15.5:0/397157672 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2404160330 msgr2=0x7f24040cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.883+0000 7f2409b97640 1 --2- 172.21.15.5:0/397157672 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2404160330 0x7f24040cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.883+0000 7f2409b97640 1 -- 172.21.15.5:0/397157672 >> v2:172.21.15.154:3300/0 conn(0x7f24040c8940 msgr2=0x7f24040ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.883+0000 7f2409b97640 1 --2- 172.21.15.5:0/397157672 >> v2:172.21.15.154:3300/0 conn(0x7f24040c8940 0x7f24040ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.883+0000 7f2409b97640 1 -- 172.21.15.5:0/397157672 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24040caef0 con 0x7f24040c0f80 2023-07-14T13:32:52.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.883+0000 7f2408b95640 1 --2- 172.21.15.5:0/397157672 >> v2:172.21.15.154:3300/0 conn(0x7f24040c8940 0x7f24040ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:32:52.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.883+0000 7f2409396640 1 --2- 172.21.15.5:0/397157672 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2404160330 0x7f24040cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:32:52.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.887+0000 7f2409b97640 1 --2- 172.21.15.5:0/397157672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24040c0f80 0x7f24040cd490 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7f240406a6d0 tx=0x7f23fc01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca317383c06b0e66 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:52.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.887+0000 7f23fbfff640 1 -- 172.21.15.5:0/397157672 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc0af400 con 0x7f24040c0f80 2023-07-14T13:32:52.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.887+0000 7f23fbfff640 1 -- 172.21.15.5:0/397157672 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23fc0ab050 con 0x7f24040c0f80 2023-07-14T13:32:52.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.887+0000 7f23fbfff640 1 -- 172.21.15.5:0/397157672 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc0af780 con 0x7f24040c0f80 2023-07-14T13:32:52.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.887+0000 7f240b5fa640 1 -- 172.21.15.5:0/397157672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24040c0f80 msgr2=0x7f24040cd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:52.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.887+0000 7f240b5fa640 1 --2- 172.21.15.5:0/397157672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24040c0f80 0x7f24040cd490 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7f240406a6d0 tx=0x7f23fc01f1c0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.887+0000 7f240b5fa640 1 -- 172.21.15.5:0/397157672 shutdown_connections 2023-07-14T13:32:52.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.887+0000 7f240b5fa640 1 --2- 172.21.15.5:0/397157672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24040c0f80 0x7f24040cd490 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.887+0000 7f240b5fa640 1 --2- 172.21.15.5:0/397157672 >> v2:172.21.15.154:3300/0 conn(0x7f24040c8940 0x7f24040ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.887+0000 7f240b5fa640 1 --2- 172.21.15.5:0/397157672 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2404160330 0x7f24040cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.887+0000 7f240b5fa640 1 -- 172.21.15.5:0/397157672 >> 172.21.15.5:0/397157672 conn(0x7f24040afcf0 msgr2=0x7f24040b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:52.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.887+0000 7f240b5fa640 1 -- 172.21.15.5:0/397157672 shutdown_connections 2023-07-14T13:32:52.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.887+0000 7f240b5fa640 1 -- 172.21.15.5:0/397157672 wait complete. 2023-07-14T13:32:52.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.887+0000 7f240b5fa640 1 Processor -- start 2023-07-14T13:32:52.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.891+0000 7f240b5fa640 1 -- start start 2023-07-14T13:32:52.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.891+0000 7f240b5fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24040c0f80 0x7f2404160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:52.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.891+0000 7f240b5fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24040c8940 0x7f24040c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:52.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.891+0000 7f240b5fa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2404160330 0x7f24040c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:52.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.891+0000 7f240b5fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24040c44f0 con 0x7f24040c8940 2023-07-14T13:32:52.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.891+0000 7f240b5fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2404162b40 con 0x7f24040c0f80 2023-07-14T13:32:52.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.891+0000 7f240b5fa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24040c3870 con 0x7f2404160330 2023-07-14T13:32:52.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.891+0000 7f2408b95640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24040c8940 0x7f24040c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:52.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.891+0000 7f2408b95640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24040c8940 0x7f24040c2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54082/0 (socket says 172.21.15.5:54082) 2023-07-14T13:32:52.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.891+0000 7f2408b95640 1 -- 172.21.15.5:0/435034417 learned_addr learned my addr 172.21.15.5:0/435034417 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:52.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.891+0000 7f2409396640 1 --2- 172.21.15.5:0/435034417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24040c0f80 0x7f2404160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:52.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.891+0000 7f2409b97640 1 --2- 172.21.15.5:0/435034417 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2404160330 0x7f24040c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:52.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.891+0000 7f2408b95640 1 -- 172.21.15.5:0/435034417 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2404160330 msgr2=0x7f24040c31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:52.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.891+0000 7f2408b95640 1 --2- 172.21.15.5:0/435034417 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2404160330 0x7f24040c31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.891+0000 7f2408b95640 1 -- 172.21.15.5:0/435034417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24040c0f80 msgr2=0x7f2404160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:52.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.891+0000 7f2408b95640 1 --2- 172.21.15.5:0/435034417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24040c0f80 0x7f2404160ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:52.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.891+0000 7f2408b95640 1 -- 172.21.15.5:0/435034417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23fc009b30 con 0x7f24040c8940 2023-07-14T13:32:52.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.891+0000 7f2409396640 1 --2- 172.21.15.5:0/435034417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24040c0f80 0x7f2404160ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:32:52.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.891+0000 7f2409b97640 1 --2- 172.21.15.5:0/435034417 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2404160330 0x7f24040c31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:32:52.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.891+0000 7f2408b95640 1 --2- 172.21.15.5:0/435034417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24040c8940 0x7f24040c2c90 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f23f400c7f0 tx=0x7f23f400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:52.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.891+0000 7f23f9ffb640 1 -- 172.21.15.5:0/435034417 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f400cea0 con 0x7f24040c8940 2023-07-14T13:32:52.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.891+0000 7f23f9ffb640 1 -- 172.21.15.5:0/435034417 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f40079d0 con 0x7f24040c8940 2023-07-14T13:32:52.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.891+0000 7f240b5fa640 1 -- 172.21.15.5:0/435034417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24040c3b50 con 0x7f24040c8940 2023-07-14T13:32:52.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.891+0000 7f23f9ffb640 1 -- 172.21.15.5:0/435034417 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f4007d60 con 0x7f24040c8940 2023-07-14T13:32:52.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.891+0000 7f240b5fa640 1 -- 172.21.15.5:0/435034417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24040c4110 con 0x7f24040c8940 2023-07-14T13:32:52.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.891+0000 7f240b5fa640 1 -- 172.21.15.5:0/435034417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24040c4630 con 0x7f24040c8940 2023-07-14T13:32:52.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.895+0000 7f23f9ffb640 1 -- 172.21.15.5:0/435034417 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f23f40113f0 con 0x7f24040c8940 2023-07-14T13:32:52.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.895+0000 7f23f9ffb640 1 --2- 172.21.15.5:0/435034417 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f23e80663a0 0x7f23e8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:52.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.895+0000 7f23f9ffb640 1 -- 172.21.15.5:0/435034417 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f23f4084360 con 0x7f24040c8940 2023-07-14T13:32:52.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.895+0000 7f2409396640 1 --2- 172.21.15.5:0/435034417 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f23e80663a0 0x7f23e8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:52.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.895+0000 7f2409396640 1 --2- 172.21.15.5:0/435034417 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f23e80663a0 0x7f23e8068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f24040c48b0 tx=0x7f2400008040 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:52.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:52.899+0000 7f23f9ffb640 1 -- 172.21.15.5:0/435034417 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f23f40512b0 con 0x7f24040c8940 2023-07-14T13:32:53.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.087+0000 7f240b5fa640 1 -- 172.21.15.5:0/435034417 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f24040678d0 con 0x7f24040c8940 2023-07-14T13:32:53.089 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-07-14T13:32:53.087+0000 7f17b1648640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-14T13:32:53.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.091+0000 7f23f9ffb640 1 -- 172.21.15.5:0/435034417 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v93) v1 ==== 161+0+0 (secure 0 0 0) 0x7f23f40548d0 con 0x7f24040c8940 2023-07-14T13:32:53.095 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-14T13:32:53.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.095+0000 7f240b5fa640 1 -- 172.21.15.5:0/435034417 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f23e80663a0 msgr2=0x7f23e8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:53.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.095+0000 7f240b5fa640 1 --2- 172.21.15.5:0/435034417 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f23e80663a0 0x7f23e8068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f24040c48b0 tx=0x7f2400008040 comp rx=0 tx=0).stop 2023-07-14T13:32:53.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.095+0000 7f240b5fa640 1 -- 172.21.15.5:0/435034417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24040c8940 msgr2=0x7f24040c2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:53.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.095+0000 7f240b5fa640 1 --2- 172.21.15.5:0/435034417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24040c8940 0x7f24040c2c90 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f23f400c7f0 tx=0x7f23f400ccb0 comp rx=0 tx=0).stop 2023-07-14T13:32:53.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.095+0000 7f240b5fa640 1 -- 172.21.15.5:0/435034417 shutdown_connections 2023-07-14T13:32:53.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.095+0000 7f240b5fa640 1 --2- 172.21.15.5:0/435034417 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f23e80663a0 0x7f23e8068850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:53.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.095+0000 7f240b5fa640 1 --2- 172.21.15.5:0/435034417 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2404160330 0x7f24040c31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:53.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.095+0000 7f240b5fa640 1 --2- 172.21.15.5:0/435034417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24040c8940 0x7f24040c2c90 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:53.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.095+0000 7f240b5fa640 1 --2- 172.21.15.5:0/435034417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24040c0f80 0x7f2404160ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:53.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.095+0000 7f240b5fa640 1 -- 172.21.15.5:0/435034417 >> 172.21.15.5:0/435034417 conn(0x7f24040afcf0 msgr2=0x7f24040ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:53.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.095+0000 7f240b5fa640 1 -- 172.21.15.5:0/435034417 shutdown_connections 2023-07-14T13:32:53.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.095+0000 7f240b5fa640 1 -- 172.21.15.5:0/435034417 wait complete. 2023-07-14T13:32:53.101 INFO:tasks.ceph.mds.c.smithi005.stderr: -3663> 2023-07-14T13:32:34.380+0000 7f77afba4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T13:32:53.118 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-14T13:32:53.153 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-07-14T13:32:53.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.267+0000 7f5734d03640 1 Processor -- start 2023-07-14T13:32:53.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.267+0000 7f5734d03640 1 -- start start 2023-07-14T13:32:53.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.267+0000 7f5734d03640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f57301601f0 0x7f57300cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:53.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.267+0000 7f5734d03640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f573006a910 0x7f57300d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:53.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.267+0000 7f5734d03640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57300cd1f0 con 0x7f573006a540 2023-07-14T13:32:53.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.267+0000 7f5734d03640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57300cd4d0 con 0x7f57301601f0 2023-07-14T13:32:53.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.267+0000 7f5734d03640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57300cd7b0 con 0x7f573006a910 2023-07-14T13:32:53.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.271+0000 7f5727fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f57301601f0 0x7f57300cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:53.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.271+0000 7f572ed9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f573006a910 0x7f57300d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:53.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.271+0000 7f572e59c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f573006a540 0x7f57300cca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:53468/0 (socket says 172.21.15.5:53468) 2023-07-14T13:32:53.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.271+0000 7f572e59c640 1 -- 172.21.15.5:0/3188987584 learned_addr learned my addr 172.21.15.5:0/3188987584 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:53.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.271+0000 7f572ed9d640 1 -- 172.21.15.5:0/3188987584 >> v2:172.21.15.154:3300/0 conn(0x7f57301601f0 msgr2=0x7f57300cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:53.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.271+0000 7f572ed9d640 1 --2- 172.21.15.5:0/3188987584 >> v2:172.21.15.154:3300/0 conn(0x7f57301601f0 0x7f57300cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:53.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.271+0000 7f572ed9d640 1 -- 172.21.15.5:0/3188987584 >> v1:172.21.15.154:6789/0 conn(0x7f573006a540 legacy=0x7f57300cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:53.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.271+0000 7f572ed9d640 1 -- 172.21.15.5:0/3188987584 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57300cfe40 con 0x7f573006a910 2023-07-14T13:32:53.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.271+0000 7f572dd9b640 1 -- 172.21.15.5:0/3188987584 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3897827741 0 0) 0x7f57300cd1f0 con 0x7f573006a540 2023-07-14T13:32:53.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.271+0000 7f572ed9d640 1 --2- 172.21.15.5:0/3188987584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f573006a910 0x7f57300d0360 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5728009d90 tx=0x7f572801c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d444ed6ba16e0dcc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:53.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.271+0000 7f572dd9b640 1 -- 172.21.15.5:0/3188987584 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57280a57d0 con 0x7f573006a910 2023-07-14T13:32:53.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.271+0000 7f572dd9b640 1 -- 172.21.15.5:0/3188987584 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57280a5930 con 0x7f573006a910 2023-07-14T13:32:53.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.271+0000 7f572dd9b640 1 -- 172.21.15.5:0/3188987584 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57280a5cc0 con 0x7f573006a910 2023-07-14T13:32:53.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.275+0000 7f5734d03640 1 -- 172.21.15.5:0/3188987584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f573006a910 msgr2=0x7f57300d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:53.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.275+0000 7f5734d03640 1 --2- 172.21.15.5:0/3188987584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f573006a910 0x7f57300d0360 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5728009d90 tx=0x7f572801c830 comp rx=0 tx=0).stop 2023-07-14T13:32:53.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.275+0000 7f5734d03640 1 -- 172.21.15.5:0/3188987584 shutdown_connections 2023-07-14T13:32:53.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.275+0000 7f5734d03640 1 --2- 172.21.15.5:0/3188987584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f573006a910 0x7f57300d0360 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:53.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.275+0000 7f5734d03640 1 --2- 172.21.15.5:0/3188987584 >> v2:172.21.15.154:3300/0 conn(0x7f57301601f0 0x7f57300cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:53.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.275+0000 7f5734d03640 1 -- 172.21.15.5:0/3188987584 >> 172.21.15.5:0/3188987584 conn(0x7f5730099490 msgr2=0x7f5730089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:53.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.275+0000 7f5734d03640 1 -- 172.21.15.5:0/3188987584 shutdown_connections 2023-07-14T13:32:53.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.275+0000 7f5734d03640 1 -- 172.21.15.5:0/3188987584 wait complete. 2023-07-14T13:32:53.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.275+0000 7f5734d03640 1 Processor -- start 2023-07-14T13:32:53.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.275+0000 7f5734d03640 1 -- start start 2023-07-14T13:32:53.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.275+0000 7f5734d03640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f573006a540 0x7f573014f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:53.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.275+0000 7f5734d03640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f573006a910 0x7f57300b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:53.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.275+0000 7f5734d03640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57301601f0 0x7f573014d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:53.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.275+0000 7f5734d03640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573014fb60 con 0x7f573006a540 2023-07-14T13:32:53.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.275+0000 7f5734d03640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57300b3470 con 0x7f573006a910 2023-07-14T13:32:53.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.275+0000 7f5734d03640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5730159550 con 0x7f57301601f0 2023-07-14T13:32:53.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.275+0000 7f572e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f573006a540 0x7f573014f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:53.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.275+0000 7f572e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f573006a540 0x7f573014f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54114/0 (socket says 172.21.15.5:54114) 2023-07-14T13:32:53.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.275+0000 7f572e59c640 1 -- 172.21.15.5:0/801161617 learned_addr learned my addr 172.21.15.5:0/801161617 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:53.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.275+0000 7f572ed9d640 1 --2- 172.21.15.5:0/801161617 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57301601f0 0x7f573014d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:53.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.275+0000 7f5727fff640 1 --2- 172.21.15.5:0/801161617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f573006a910 0x7f57300b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:53.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.279+0000 7f572e59c640 1 -- 172.21.15.5:0/801161617 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57301601f0 msgr2=0x7f573014d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:53.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.279+0000 7f572e59c640 1 --2- 172.21.15.5:0/801161617 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57301601f0 0x7f573014d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:53.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.279+0000 7f572e59c640 1 -- 172.21.15.5:0/801161617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f573006a910 msgr2=0x7f57300b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:53.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.279+0000 7f572e59c640 1 --2- 172.21.15.5:0/801161617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f573006a910 0x7f57300b2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:53.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.279+0000 7f572e59c640 1 -- 172.21.15.5:0/801161617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5728009a70 con 0x7f573006a540 2023-07-14T13:32:53.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.279+0000 7f5727fff640 1 --2- 172.21.15.5:0/801161617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f573006a910 0x7f57300b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:32:53.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.279+0000 7f572e59c640 1 --2- 172.21.15.5:0/801161617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f573006a540 0x7f573014f2f0 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f572000c430 tx=0x7f572000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:53.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.279+0000 7f5726ffd640 1 -- 172.21.15.5:0/801161617 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57200074e0 con 0x7f573006a540 2023-07-14T13:32:53.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.279+0000 7f5726ffd640 1 -- 172.21.15.5:0/801161617 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5720007640 con 0x7f573006a540 2023-07-14T13:32:53.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.279+0000 7f5726ffd640 1 -- 172.21.15.5:0/801161617 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5720004a40 con 0x7f573006a540 2023-07-14T13:32:53.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.279+0000 7f5734d03640 1 -- 172.21.15.5:0/801161617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573015b0e0 con 0x7f573006a540 2023-07-14T13:32:53.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.279+0000 7f5734d03640 1 -- 172.21.15.5:0/801161617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57301597f0 con 0x7f573006a540 2023-07-14T13:32:53.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.279+0000 7f5734d03640 1 -- 172.21.15.5:0/801161617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57300678d0 con 0x7f573006a540 2023-07-14T13:32:53.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.279+0000 7f5726ffd640 1 -- 172.21.15.5:0/801161617 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5720004ba0 con 0x7f573006a540 2023-07-14T13:32:53.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.279+0000 7f5726ffd640 1 --2- 172.21.15.5:0/801161617 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f57100663a0 0x7f5710068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:53.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.279+0000 7f5726ffd640 1 -- 172.21.15.5:0/801161617 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6907+0+0 (secure 0 0 0) 0x7f5720083ef0 con 0x7f573006a540 2023-07-14T13:32:53.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.283+0000 7f5727fff640 1 --2- 172.21.15.5:0/801161617 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f57100663a0 0x7f5710068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:53.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.283+0000 7f5727fff640 1 --2- 172.21.15.5:0/801161617 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f57100663a0 0x7f5710068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f573009dff0 tx=0x7f5718009190 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:53.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.283+0000 7f5726ffd640 1 -- 172.21.15.5:0/801161617 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f5720050f20 con 0x7f573006a540 2023-07-14T13:32:53.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:53.471+0000 7f5734d03640 1 -- 172.21.15.5:0/801161617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f57300999b0 con 0x7f573006a540 2023-07-14T13:32:54.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.111+0000 7f5726ffd640 1 -- 172.21.15.5:0/801161617 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v94) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5720054540 con 0x7f573006a540 2023-07-14T13:32:54.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.111+0000 7f5734d03640 1 -- 172.21.15.5:0/801161617 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f57100663a0 msgr2=0x7f5710068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:54.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.111+0000 7f5734d03640 1 --2- 172.21.15.5:0/801161617 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f57100663a0 0x7f5710068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f573009dff0 tx=0x7f5718009190 comp rx=0 tx=0).stop 2023-07-14T13:32:54.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.111+0000 7f5734d03640 1 -- 172.21.15.5:0/801161617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f573006a540 msgr2=0x7f573014f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:54.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.111+0000 7f5734d03640 1 --2- 172.21.15.5:0/801161617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f573006a540 0x7f573014f2f0 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f572000c430 tx=0x7f572000c8f0 comp rx=0 tx=0).stop 2023-07-14T13:32:54.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.111+0000 7f5734d03640 1 -- 172.21.15.5:0/801161617 shutdown_connections 2023-07-14T13:32:54.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.111+0000 7f5734d03640 1 --2- 172.21.15.5:0/801161617 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f57100663a0 0x7f5710068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:54.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.111+0000 7f5734d03640 1 --2- 172.21.15.5:0/801161617 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57301601f0 0x7f573014d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:54.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.111+0000 7f5734d03640 1 --2- 172.21.15.5:0/801161617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f573006a910 0x7f57300b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:54.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.111+0000 7f5734d03640 1 --2- 172.21.15.5:0/801161617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f573006a540 0x7f573014f2f0 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:54.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.111+0000 7f5734d03640 1 -- 172.21.15.5:0/801161617 >> 172.21.15.5:0/801161617 conn(0x7f5730099490 msgr2=0x7f573006d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:54.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.111+0000 7f5734d03640 1 -- 172.21.15.5:0/801161617 shutdown_connections 2023-07-14T13:32:54.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.111+0000 7f5734d03640 1 -- 172.21.15.5:0/801161617 wait complete. 2023-07-14T13:32:54.138 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-14T13:32:54.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.335+0000 7f8f9400b640 1 Processor -- start 2023-07-14T13:32:54.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.335+0000 7f8f9400b640 1 -- start start 2023-07-14T13:32:54.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.339+0000 7f8f9400b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8f8c0cdd10 0x7f8f8c0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:54.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.339+0000 7f8f9400b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f8c0b1770 0x7f8f8c0d0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:54.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.339+0000 7f8f9400b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8f8c0d0650 0x7f8f8c0ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:54.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.339+0000 7f8f9400b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f8c0d0ad0 con 0x7f8f8c0d0650 2023-07-14T13:32:54.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.339+0000 7f8f9400b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f8c0b0450 con 0x7f8f8c0cdd10 2023-07-14T13:32:54.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.339+0000 7f8f9400b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c0ce620 con 0x7f8f8c0b1770 2023-07-14T13:32:54.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.339+0000 7f8f925a8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8f8c0d0650 0x7f8f8c0ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:54.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.339+0000 7f8f925a8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8f8c0d0650 0x7f8f8c0ccb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54124/0 (socket says 172.21.15.5:54124) 2023-07-14T13:32:54.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.339+0000 7f8f925a8640 1 -- 172.21.15.5:0/980792898 learned_addr learned my addr 172.21.15.5:0/980792898 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:54.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.339+0000 7f8f91da7640 1 --2- 172.21.15.5:0/980792898 >> v2:172.21.15.154:3300/0 conn(0x7f8f8c0cdd10 0x7f8f8c0ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:54.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.339+0000 7f8f915a6640 1 --2- 172.21.15.5:0/980792898 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f8c0b1770 0x7f8f8c0d0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:54.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.339+0000 7f8f925a8640 1 -- 172.21.15.5:0/980792898 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f8c0b1770 msgr2=0x7f8f8c0d0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:54.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.339+0000 7f8f925a8640 1 --2- 172.21.15.5:0/980792898 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f8c0b1770 0x7f8f8c0d0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:54.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.339+0000 7f8f925a8640 1 -- 172.21.15.5:0/980792898 >> v2:172.21.15.154:3300/0 conn(0x7f8f8c0cdd10 msgr2=0x7f8f8c0ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:54.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.339+0000 7f8f925a8640 1 --2- 172.21.15.5:0/980792898 >> v2:172.21.15.154:3300/0 conn(0x7f8f8c0cdd10 0x7f8f8c0ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:54.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.339+0000 7f8f925a8640 1 -- 172.21.15.5:0/980792898 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f8c0b06d0 con 0x7f8f8c0d0650 2023-07-14T13:32:54.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.339+0000 7f8f915a6640 1 --2- 172.21.15.5:0/980792898 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f8c0b1770 0x7f8f8c0d0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:54.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.343+0000 7f8f925a8640 1 --2- 172.21.15.5:0/980792898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f8c0d0650 0x7f8f8c0ccb50 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c0cdbd0 tx=0x7f8f8401c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7db586643e238f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.343+0000 7f8f90da5640 1 -- 172.21.15.5:0/980792898 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f840a5560 con 0x7f8f8c0d0650 2023-07-14T13:32:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.343+0000 7f8f90da5640 1 -- 172.21.15.5:0/980792898 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f840a56c0 con 0x7f8f8c0d0650 2023-07-14T13:32:54.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.343+0000 7f8f90da5640 1 -- 172.21.15.5:0/980792898 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f840a5a50 con 0x7f8f8c0d0650 2023-07-14T13:32:54.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.343+0000 7f8f9400b640 1 -- 172.21.15.5:0/980792898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f8c0d0650 msgr2=0x7f8f8c0ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:54.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.343+0000 7f8f9400b640 1 --2- 172.21.15.5:0/980792898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f8c0d0650 0x7f8f8c0ccb50 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c0cdbd0 tx=0x7f8f8401c6e0 comp rx=0 tx=0).stop 2023-07-14T13:32:54.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.343+0000 7f8f9400b640 1 -- 172.21.15.5:0/980792898 shutdown_connections 2023-07-14T13:32:54.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.343+0000 7f8f9400b640 1 --2- 172.21.15.5:0/980792898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f8c0d0650 0x7f8f8c0ccb50 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:54.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.343+0000 7f8f9400b640 1 --2- 172.21.15.5:0/980792898 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f8c0b1770 0x7f8f8c0d0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:54.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.343+0000 7f8f9400b640 1 --2- 172.21.15.5:0/980792898 >> v2:172.21.15.154:3300/0 conn(0x7f8f8c0cdd10 0x7f8f8c0ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:54.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.343+0000 7f8f9400b640 1 -- 172.21.15.5:0/980792898 >> 172.21.15.5:0/980792898 conn(0x7f8f8c099490 msgr2=0x7f8f8c089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:54.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.343+0000 7f8f9400b640 1 -- 172.21.15.5:0/980792898 shutdown_connections 2023-07-14T13:32:54.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.343+0000 7f8f9400b640 1 -- 172.21.15.5:0/980792898 wait complete. 2023-07-14T13:32:54.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.343+0000 7f8f9400b640 1 Processor -- start 2023-07-14T13:32:54.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.343+0000 7f8f9400b640 1 -- start start 2023-07-14T13:32:54.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.347+0000 7f8f9400b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f8c0b1770 0x7f8f8c158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:54.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.347+0000 7f8f9400b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8c0cdd10 0x7f8f8c13dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:54.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.347+0000 7f8f9400b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f8c0d0650 0x7f8f8c157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:54.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.347+0000 7f8f9400b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c140260 con 0x7f8f8c0d0650 2023-07-14T13:32:54.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.347+0000 7f8f9400b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c140540 con 0x7f8f8c0cdd10 2023-07-14T13:32:54.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.347+0000 7f8f9400b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8c140820 con 0x7f8f8c0b1770 2023-07-14T13:32:54.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.347+0000 7f8f925a8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f8c0d0650 0x7f8f8c157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:54.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.347+0000 7f8f925a8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f8c0d0650 0x7f8f8c157f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54128/0 (socket says 172.21.15.5:54128) 2023-07-14T13:32:54.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.347+0000 7f8f925a8640 1 -- 172.21.15.5:0/1931537977 learned_addr learned my addr 172.21.15.5:0/1931537977 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:54.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.347+0000 7f8f915a6640 1 --2- 172.21.15.5:0/1931537977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8c0cdd10 0x7f8f8c13dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:54.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.347+0000 7f8f91da7640 1 --2- 172.21.15.5:0/1931537977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f8c0b1770 0x7f8f8c158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:54.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.347+0000 7f8f925a8640 1 -- 172.21.15.5:0/1931537977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f8c0b1770 msgr2=0x7f8f8c158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:54.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.347+0000 7f8f925a8640 1 --2- 172.21.15.5:0/1931537977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f8c0b1770 0x7f8f8c158be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:54.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.347+0000 7f8f925a8640 1 -- 172.21.15.5:0/1931537977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8c0cdd10 msgr2=0x7f8f8c13dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:54.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.347+0000 7f8f925a8640 1 --2- 172.21.15.5:0/1931537977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8c0cdd10 0x7f8f8c13dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:54.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.347+0000 7f8f925a8640 1 -- 172.21.15.5:0/1931537977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f84009b30 con 0x7f8f8c0d0650 2023-07-14T13:32:54.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.347+0000 7f8f925a8640 1 --2- 172.21.15.5:0/1931537977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f8c0d0650 0x7f8f8c157f20 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f8f8401ad90 tx=0x7f8f84019480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:54.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.347+0000 7f8f827fc640 1 -- 172.21.15.5:0/1931537977 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f840a5560 con 0x7f8f8c0d0650 2023-07-14T13:32:54.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.347+0000 7f8f827fc640 1 -- 172.21.15.5:0/1931537977 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f840b8670 con 0x7f8f8c0d0650 2023-07-14T13:32:54.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.347+0000 7f8f9400b640 1 -- 172.21.15.5:0/1931537977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f8c140b00 con 0x7f8f8c0d0650 2023-07-14T13:32:54.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.347+0000 7f8f827fc640 1 -- 172.21.15.5:0/1931537977 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f840b8a20 con 0x7f8f8c0d0650 2023-07-14T13:32:54.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.347+0000 7f8f9400b640 1 -- 172.21.15.5:0/1931537977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f8c13e210 con 0x7f8f8c0d0650 2023-07-14T13:32:54.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.347+0000 7f8f9400b640 1 -- 172.21.15.5:0/1931537977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f8c140cc0 con 0x7f8f8c0d0650 2023-07-14T13:32:54.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.351+0000 7f8f827fc640 1 -- 172.21.15.5:0/1931537977 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8f840b8b80 con 0x7f8f8c0d0650 2023-07-14T13:32:54.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.351+0000 7f8f827fc640 1 --2- 172.21.15.5:0/1931537977 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f8f700663a0 0x7f8f70068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:54.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.351+0000 7f8f827fc640 1 -- 172.21.15.5:0/1931537977 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6907+0+0 (secure 0 0 0) 0x7f8f8411f3b0 con 0x7f8f8c0d0650 2023-07-14T13:32:54.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.351+0000 7f8f91da7640 1 --2- 172.21.15.5:0/1931537977 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f8f700663a0 0x7f8f70068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:54.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.351+0000 7f8f91da7640 1 --2- 172.21.15.5:0/1931537977 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f8f700663a0 0x7f8f70068850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009b60 tx=0x7f8f88009190 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:54.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.355+0000 7f8f827fc640 1 -- 172.21.15.5:0/1931537977 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f8f840ec3e0 con 0x7f8f8c0d0650 2023-07-14T13:32:54.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:54.507+0000 7f8f9400b640 1 -- 172.21.15.5:0/1931537977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8f8c0678d0 con 0x7f8f8c0d0650 2023-07-14T13:32:55.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.115+0000 7f8f827fc640 1 -- 172.21.15.5:0/1931537977 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v195) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8f84009510 con 0x7f8f8c0d0650 2023-07-14T13:32:55.116 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-07-14T13:32:55.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.119+0000 7f8f9400b640 1 -- 172.21.15.5:0/1931537977 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f8f700663a0 msgr2=0x7f8f70068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:55.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.119+0000 7f8f9400b640 1 --2- 172.21.15.5:0/1931537977 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f8f700663a0 0x7f8f70068850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009b60 tx=0x7f8f88009190 comp rx=0 tx=0).stop 2023-07-14T13:32:55.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.119+0000 7f8f9400b640 1 -- 172.21.15.5:0/1931537977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f8c0d0650 msgr2=0x7f8f8c157f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:55.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.119+0000 7f8f9400b640 1 --2- 172.21.15.5:0/1931537977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f8c0d0650 0x7f8f8c157f20 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f8f8401ad90 tx=0x7f8f84019480 comp rx=0 tx=0).stop 2023-07-14T13:32:55.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.119+0000 7f8f9400b640 1 -- 172.21.15.5:0/1931537977 shutdown_connections 2023-07-14T13:32:55.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.119+0000 7f8f9400b640 1 --2- 172.21.15.5:0/1931537977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f8c0d0650 0x7f8f8c157f20 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:55.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.119+0000 7f8f9400b640 1 --2- 172.21.15.5:0/1931537977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8c0cdd10 0x7f8f8c13dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:55.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.119+0000 7f8f9400b640 1 --2- 172.21.15.5:0/1931537977 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f8f700663a0 0x7f8f70068850 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:55.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.119+0000 7f8f9400b640 1 --2- 172.21.15.5:0/1931537977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f8c0b1770 0x7f8f8c158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:55.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.119+0000 7f8f9400b640 1 -- 172.21.15.5:0/1931537977 >> 172.21.15.5:0/1931537977 conn(0x7f8f8c099490 msgr2=0x7f8f8c0acd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:55.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.119+0000 7f8f9400b640 1 -- 172.21.15.5:0/1931537977 shutdown_connections 2023-07-14T13:32:55.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.119+0000 7f8f9400b640 1 -- 172.21.15.5:0/1931537977 wait complete. 2023-07-14T13:32:55.146 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-14T13:32:55.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.299+0000 7f2964ffa640 1 Processor -- start 2023-07-14T13:32:55.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.299+0000 7f2964ffa640 1 -- start start 2023-07-14T13:32:55.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.299+0000 7f2964ffa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f296015bde0 0x7f29600d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:55.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.299+0000 7f2964ffa640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29600b04c0 con 0x7f29600d2300 2023-07-14T13:32:55.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.299+0000 7f2964ffa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29600b1060 con 0x7f29600d2fc0 2023-07-14T13:32:55.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.299+0000 7f2964ffa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296015c1b0 con 0x7f296015bde0 2023-07-14T13:32:55.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.299+0000 7f295ed9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f29600d2300 0x7f29600cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34586/0 (socket says 172.21.15.5:34586) 2023-07-14T13:32:55.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.299+0000 7f295ed9d640 1 -- 172.21.15.5:0/930977994 learned_addr learned my addr 172.21.15.5:0/930977994 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:55.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.299+0000 7f295e59c640 1 --2- 172.21.15.5:0/930977994 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f296015bde0 0x7f29600d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:55.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.303+0000 7f295dd9b640 1 -- 172.21.15.5:0/930977994 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3057690401 0 0) 0x7f29600b04c0 con 0x7f29600d2300 2023-07-14T13:32:55.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.303+0000 7f295dd9b640 1 -- 172.21.15.5:0/930977994 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f294c003530 con 0x7f29600d2300 2023-07-14T13:32:55.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.303+0000 7f295dd9b640 1 -- 172.21.15.5:0/930977994 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773116205 0 0) 0x7f29600b1060 con 0x7f29600d2fc0 2023-07-14T13:32:55.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.303+0000 7f295dd9b640 1 -- 172.21.15.5:0/930977994 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29600b04c0 con 0x7f29600d2fc0 2023-07-14T13:32:55.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.303+0000 7f295e59c640 1 -- 172.21.15.5:0/930977994 >> v1:172.21.15.154:6789/0 conn(0x7f29600d2fc0 legacy=0x7f29600b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:55.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.303+0000 7f295e59c640 1 -- 172.21.15.5:0/930977994 >> v1:172.21.15.5:6789/0 conn(0x7f29600d2300 legacy=0x7f29600cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:55.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.303+0000 7f295e59c640 1 -- 172.21.15.5:0/930977994 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29600d0aa0 con 0x7f296015bde0 2023-07-14T13:32:55.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.303+0000 7f295e59c640 1 --2- 172.21.15.5:0/930977994 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f296015bde0 0x7f29600d0270 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f29500097d0 tx=0x7f295001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b56a6c6e6642aab8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:55.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.303+0000 7f295dd9b640 1 -- 172.21.15.5:0/930977994 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29500a6040 con 0x7f296015bde0 2023-07-14T13:32:55.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.303+0000 7f295dd9b640 1 -- 172.21.15.5:0/930977994 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29500aa600 con 0x7f296015bde0 2023-07-14T13:32:55.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.303+0000 7f295dd9b640 1 -- 172.21.15.5:0/930977994 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29500aa970 con 0x7f296015bde0 2023-07-14T13:32:55.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.307+0000 7f2964ffa640 1 -- 172.21.15.5:0/930977994 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f296015bde0 msgr2=0x7f29600d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:55.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.307+0000 7f2964ffa640 1 --2- 172.21.15.5:0/930977994 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f296015bde0 0x7f29600d0270 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f29500097d0 tx=0x7f295001c4a0 comp rx=0 tx=0).stop 2023-07-14T13:32:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.307+0000 7f2964ffa640 1 -- 172.21.15.5:0/930977994 shutdown_connections 2023-07-14T13:32:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.307+0000 7f2964ffa640 1 --2- 172.21.15.5:0/930977994 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f296015bde0 0x7f29600d0270 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.307+0000 7f2964ffa640 1 -- 172.21.15.5:0/930977994 >> 172.21.15.5:0/930977994 conn(0x7f29600659d0 msgr2=0x7f296009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.307+0000 7f2964ffa640 1 -- 172.21.15.5:0/930977994 shutdown_connections 2023-07-14T13:32:55.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.307+0000 7f2964ffa640 1 -- 172.21.15.5:0/930977994 wait complete. 2023-07-14T13:32:55.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.307+0000 7f2964ffa640 1 Processor -- start 2023-07-14T13:32:55.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.307+0000 7f2964ffa640 1 -- start start 2023-07-14T13:32:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.307+0000 7f2964ffa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29600d2300 0x7f296014d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.307+0000 7f2964ffa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29600d2fc0 0x7f29600c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.307+0000 7f2964ffa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f296015bde0 0x7f29600c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:55.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.307+0000 7f2964ffa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29600c6b00 con 0x7f29600d2fc0 2023-07-14T13:32:55.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.307+0000 7f2964ffa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29600c6de0 con 0x7f296015bde0 2023-07-14T13:32:55.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.307+0000 7f2964ffa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29600c70c0 con 0x7f29600d2300 2023-07-14T13:32:55.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.307+0000 7f2957fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29600d2fc0 0x7f29600c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:55.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.307+0000 7f2957fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29600d2fc0 0x7f29600c7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54138/0 (socket says 172.21.15.5:54138) 2023-07-14T13:32:55.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.307+0000 7f2957fff640 1 -- 172.21.15.5:0/1346967638 learned_addr learned my addr 172.21.15.5:0/1346967638 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:55.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.307+0000 7f295ed9d640 1 --2- 172.21.15.5:0/1346967638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f296015bde0 0x7f29600c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:55.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.307+0000 7f295e59c640 1 --2- 172.21.15.5:0/1346967638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29600d2300 0x7f296014d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:55.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.307+0000 7f2957fff640 1 -- 172.21.15.5:0/1346967638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29600d2300 msgr2=0x7f296014d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:55.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.307+0000 7f2957fff640 1 --2- 172.21.15.5:0/1346967638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29600d2300 0x7f296014d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.307+0000 7f2957fff640 1 -- 172.21.15.5:0/1346967638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f296015bde0 msgr2=0x7f29600c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.307+0000 7f2957fff640 1 --2- 172.21.15.5:0/1346967638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f296015bde0 0x7f29600c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.307+0000 7f2957fff640 1 -- 172.21.15.5:0/1346967638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29500093b0 con 0x7f29600d2fc0 2023-07-14T13:32:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.307+0000 7f295ed9d640 1 --2- 172.21.15.5:0/1346967638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f296015bde0 0x7f29600c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:55.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.311+0000 7f2957fff640 1 --2- 172.21.15.5:0/1346967638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29600d2fc0 0x7f29600c7e50 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f294800c500 tx=0x7f294800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:55.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.311+0000 7f2956ffd640 1 -- 172.21.15.5:0/1346967638 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29480052d0 con 0x7f29600d2fc0 2023-07-14T13:32:55.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.311+0000 7f2956ffd640 1 -- 172.21.15.5:0/1346967638 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2948005470 con 0x7f29600d2fc0 2023-07-14T13:32:55.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.311+0000 7f2956ffd640 1 -- 172.21.15.5:0/1346967638 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2948003840 con 0x7f29600d2fc0 2023-07-14T13:32:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.311+0000 7f2964ffa640 1 -- 172.21.15.5:0/1346967638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29600c73a0 con 0x7f29600d2fc0 2023-07-14T13:32:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.311+0000 7f2964ffa640 1 -- 172.21.15.5:0/1346967638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29600c8390 con 0x7f29600d2fc0 2023-07-14T13:32:55.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.311+0000 7f2964ffa640 1 -- 172.21.15.5:0/1346967638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2960157cc0 con 0x7f29600d2fc0 2023-07-14T13:32:55.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.311+0000 7f2956ffd640 1 -- 172.21.15.5:0/1346967638 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f29480039a0 con 0x7f29600d2fc0 2023-07-14T13:32:55.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.311+0000 7f2956ffd640 1 --2- 172.21.15.5:0/1346967638 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f29400663a0 0x7f2940068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:55.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.311+0000 7f2956ffd640 1 -- 172.21.15.5:0/1346967638 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6469+0+0 (secure 0 0 0) 0x7f2948083580 con 0x7f29600d2fc0 2023-07-14T13:32:55.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.311+0000 7f295e59c640 1 --2- 172.21.15.5:0/1346967638 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f29400663a0 0x7f2940068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:55.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.315+0000 7f295e59c640 1 --2- 172.21.15.5:0/1346967638 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f29400663a0 0x7f2940068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f29500ae000 tx=0x7f29500b5040 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:55.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.315+0000 7f2956ffd640 1 -- 172.21.15.5:0/1346967638 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2960157cc0 con 0x7f29600d2fc0 2023-07-14T13:32:55.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:55.471+0000 7f2964ffa640 1 -- 172.21.15.5:0/1346967638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2960157cc0 con 0x7f29600d2fc0 2023-07-14T13:32:56.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.135+0000 7f2956ffd640 1 -- 172.21.15.5:0/1346967638 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v196) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2960157cc0 con 0x7f29600d2fc0 2023-07-14T13:32:56.134 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-07-14T13:32:56.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.139+0000 7f2964ffa640 1 -- 172.21.15.5:0/1346967638 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f29400663a0 msgr2=0x7f2940068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:56.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.139+0000 7f2964ffa640 1 --2- 172.21.15.5:0/1346967638 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f29400663a0 0x7f2940068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f29500ae000 tx=0x7f29500b5040 comp rx=0 tx=0).stop 2023-07-14T13:32:56.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.139+0000 7f2964ffa640 1 -- 172.21.15.5:0/1346967638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29600d2fc0 msgr2=0x7f29600c7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:56.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.139+0000 7f2964ffa640 1 --2- 172.21.15.5:0/1346967638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29600d2fc0 0x7f29600c7e50 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f294800c500 tx=0x7f294800c9c0 comp rx=0 tx=0).stop 2023-07-14T13:32:56.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.139+0000 7f2964ffa640 1 -- 172.21.15.5:0/1346967638 shutdown_connections 2023-07-14T13:32:56.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.139+0000 7f2964ffa640 1 --2- 172.21.15.5:0/1346967638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f296015bde0 0x7f29600c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:56.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.139+0000 7f2964ffa640 1 --2- 172.21.15.5:0/1346967638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29600d2fc0 0x7f29600c7e50 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:56.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.139+0000 7f2964ffa640 1 --2- 172.21.15.5:0/1346967638 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f29400663a0 0x7f2940068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:56.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.139+0000 7f2964ffa640 1 --2- 172.21.15.5:0/1346967638 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29600d2300 0x7f296014d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:56.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.139+0000 7f2964ffa640 1 -- 172.21.15.5:0/1346967638 >> 172.21.15.5:0/1346967638 conn(0x7f29600659d0 msgr2=0x7f296015a790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:56.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.139+0000 7f2964ffa640 1 -- 172.21.15.5:0/1346967638 shutdown_connections 2023-07-14T13:32:56.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.139+0000 7f2964ffa640 1 -- 172.21.15.5:0/1346967638 wait complete. 2023-07-14T13:32:56.159 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-14T13:32:56.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.311+0000 7f00b8d3d640 1 Processor -- start 2023-07-14T13:32:56.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.311+0000 7f00b8d3d640 1 -- start start 2023-07-14T13:32:56.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.311+0000 7f00b8d3d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f00b40b1620 0x7f00b40ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:56.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.311+0000 7f00b8d3d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f00b4160750 0x7f00b415c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:56.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.311+0000 7f00b8d3d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b40cf430 con 0x7f00b40cc960 2023-07-14T13:32:56.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.311+0000 7f00b8d3d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b40cf710 con 0x7f00b4160750 2023-07-14T13:32:56.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.311+0000 7f00b8d3d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b415fc70 con 0x7f00b40b1620 2023-07-14T13:32:56.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.311+0000 7f00b3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f00b4160750 0x7f00b415c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:56.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.311+0000 7f00b3fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f00b4160750 0x7f00b415c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54144/0 (socket says 172.21.15.5:54144) 2023-07-14T13:32:56.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.311+0000 7f00b3fff640 1 -- 172.21.15.5:0/3765628068 learned_addr learned my addr 172.21.15.5:0/3765628068 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:56.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.311+0000 7f00b2ffd640 1 --2- 172.21.15.5:0/3765628068 >> v2:172.21.15.154:3300/0 conn(0x7f00b40b1620 0x7f00b40ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:56.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.311+0000 7f00b3fff640 1 -- 172.21.15.5:0/3765628068 >> v2:172.21.15.154:3300/0 conn(0x7f00b40b1620 msgr2=0x7f00b40ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:56.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.311+0000 7f00b3fff640 1 --2- 172.21.15.5:0/3765628068 >> v2:172.21.15.154:3300/0 conn(0x7f00b40b1620 0x7f00b40ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:56.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.311+0000 7f00b3fff640 1 -- 172.21.15.5:0/3765628068 >> v1:172.21.15.154:6789/0 conn(0x7f00b40cc960 legacy=0x7f00b40ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:56.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.311+0000 7f00b3fff640 1 -- 172.21.15.5:0/3765628068 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b415ff50 con 0x7f00b4160750 2023-07-14T13:32:56.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.315+0000 7f00b3fff640 1 --2- 172.21.15.5:0/3765628068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b4160750 0x7f00b415c310 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f00b406ac10 tx=0x7f00ac01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571e74c5c490734 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:56.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.315+0000 7f00b27fc640 1 -- 172.21.15.5:0/3765628068 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac0a5880 con 0x7f00b4160750 2023-07-14T13:32:56.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.315+0000 7f00b27fc640 1 -- 172.21.15.5:0/3765628068 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ac0a59e0 con 0x7f00b4160750 2023-07-14T13:32:56.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.315+0000 7f00b27fc640 1 -- 172.21.15.5:0/3765628068 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac0a5d70 con 0x7f00b4160750 2023-07-14T13:32:56.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.315+0000 7f00b8d3d640 1 -- 172.21.15.5:0/3765628068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b4160750 msgr2=0x7f00b415c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:56.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.315+0000 7f00b8d3d640 1 --2- 172.21.15.5:0/3765628068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b4160750 0x7f00b415c310 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f00b406ac10 tx=0x7f00ac01c9a0 comp rx=0 tx=0).stop 2023-07-14T13:32:56.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.315+0000 7f00b8d3d640 1 -- 172.21.15.5:0/3765628068 shutdown_connections 2023-07-14T13:32:56.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.315+0000 7f00b8d3d640 1 --2- 172.21.15.5:0/3765628068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b4160750 0x7f00b415c310 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:56.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.315+0000 7f00b8d3d640 1 --2- 172.21.15.5:0/3765628068 >> v2:172.21.15.154:3300/0 conn(0x7f00b40b1620 0x7f00b40ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:56.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.315+0000 7f00b8d3d640 1 -- 172.21.15.5:0/3765628068 >> 172.21.15.5:0/3765628068 conn(0x7f00b4069f50 msgr2=0x7f00b406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:56.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.315+0000 7f00b8d3d640 1 -- 172.21.15.5:0/3765628068 shutdown_connections 2023-07-14T13:32:56.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.315+0000 7f00b8d3d640 1 -- 172.21.15.5:0/3765628068 wait complete. 2023-07-14T13:32:56.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.319+0000 7f00b8d3d640 1 Processor -- start 2023-07-14T13:32:56.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.319+0000 7f00b8d3d640 1 -- start start 2023-07-14T13:32:56.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.319+0000 7f00b8d3d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b40b1620 0x7f00b41f5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:56.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.319+0000 7f00b8d3d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00b40cc960 0x7f00b415d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:56.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.319+0000 7f00b8d3d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00b4160750 0x7f00b415dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:56.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.319+0000 7f00b8d3d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b41f5ad0 con 0x7f00b40b1620 2023-07-14T13:32:56.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.319+0000 7f00b8d3d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b40b2ba0 con 0x7f00b40cc960 2023-07-14T13:32:56.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.319+0000 7f00b8d3d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b4154400 con 0x7f00b4160750 2023-07-14T13:32:56.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.319+0000 7f00b37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b40b1620 0x7f00b41f5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:56.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.319+0000 7f00b37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b40b1620 0x7f00b41f5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54152/0 (socket says 172.21.15.5:54152) 2023-07-14T13:32:56.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.319+0000 7f00b37fe640 1 -- 172.21.15.5:0/1672922305 learned_addr learned my addr 172.21.15.5:0/1672922305 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:56.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.319+0000 7f00b3fff640 1 --2- 172.21.15.5:0/1672922305 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00b4160750 0x7f00b415dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:56.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.319+0000 7f00b2ffd640 1 --2- 172.21.15.5:0/1672922305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00b40cc960 0x7f00b415d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:56.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.319+0000 7f00b37fe640 1 -- 172.21.15.5:0/1672922305 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00b4160750 msgr2=0x7f00b415dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:56.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.319+0000 7f00b37fe640 1 --2- 172.21.15.5:0/1672922305 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00b4160750 0x7f00b415dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:56.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.319+0000 7f00b37fe640 1 -- 172.21.15.5:0/1672922305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00b40cc960 msgr2=0x7f00b415d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:56.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.319+0000 7f00b37fe640 1 --2- 172.21.15.5:0/1672922305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00b40cc960 0x7f00b415d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:56.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.319+0000 7f00b37fe640 1 -- 172.21.15.5:0/1672922305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ac009b30 con 0x7f00b40b1620 2023-07-14T13:32:56.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.319+0000 7f00b37fe640 1 --2- 172.21.15.5:0/1672922305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b40b1620 0x7f00b41f5590 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f00a400c450 tx=0x7f00a400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:56.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.319+0000 7f009bfff640 1 -- 172.21.15.5:0/1672922305 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a40052d0 con 0x7f00b40b1620 2023-07-14T13:32:56.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.319+0000 7f009bfff640 1 -- 172.21.15.5:0/1672922305 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a4005450 con 0x7f00b40b1620 2023-07-14T13:32:56.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.319+0000 7f00b8d3d640 1 -- 172.21.15.5:0/1672922305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b41546e0 con 0x7f00b40b1620 2023-07-14T13:32:56.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.319+0000 7f009bfff640 1 -- 172.21.15.5:0/1672922305 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a4012870 con 0x7f00b40b1620 2023-07-14T13:32:56.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.319+0000 7f00b8d3d640 1 -- 172.21.15.5:0/1672922305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b4154ca0 con 0x7f00b40b1620 2023-07-14T13:32:56.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.319+0000 7f00b8d3d640 1 -- 172.21.15.5:0/1672922305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b404e020 con 0x7f00b40b1620 2023-07-14T13:32:56.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.323+0000 7f009bfff640 1 -- 172.21.15.5:0/1672922305 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f00a40129d0 con 0x7f00b40b1620 2023-07-14T13:32:56.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.323+0000 7f009bfff640 1 --2- 172.21.15.5:0/1672922305 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f00a00663d0 0x7f00a0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:56.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.323+0000 7f009bfff640 1 -- 172.21.15.5:0/1672922305 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7f00a4083a20 con 0x7f00b40b1620 2023-07-14T13:32:56.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.323+0000 7f00b2ffd640 1 --2- 172.21.15.5:0/1672922305 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f00a00663d0 0x7f00a0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:56.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.323+0000 7f00b2ffd640 1 --2- 172.21.15.5:0/1672922305 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f00a00663d0 0x7f00a0068880 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009790 tx=0x7f00a8008040 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:56.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.327+0000 7f009bfff640 1 -- 172.21.15.5:0/1672922305 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f00a4050cf0 con 0x7f00b40b1620 2023-07-14T13:32:56.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.479+0000 7f00b8d3d640 1 -- 172.21.15.5:0/1672922305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f00b40cfad0 con 0x7f00b40b1620 2023-07-14T13:32:56.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.487+0000 7f009bfff640 1 -- 172.21.15.5:0/1672922305 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v67) v1 ==== 120+0+0 (secure 0 0 0) 0x7f00a4083030 con 0x7f00b40b1620 2023-07-14T13:32:56.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.487+0000 7f00b8d3d640 1 -- 172.21.15.5:0/1672922305 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f00a00663d0 msgr2=0x7f00a0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:56.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.487+0000 7f00b8d3d640 1 --2- 172.21.15.5:0/1672922305 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f00a00663d0 0x7f00a0068880 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009790 tx=0x7f00a8008040 comp rx=0 tx=0).stop 2023-07-14T13:32:56.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.487+0000 7f00b8d3d640 1 -- 172.21.15.5:0/1672922305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b40b1620 msgr2=0x7f00b41f5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:56.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.487+0000 7f00b8d3d640 1 --2- 172.21.15.5:0/1672922305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b40b1620 0x7f00b41f5590 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f00a400c450 tx=0x7f00a400c910 comp rx=0 tx=0).stop 2023-07-14T13:32:56.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.487+0000 7f00b8d3d640 1 -- 172.21.15.5:0/1672922305 shutdown_connections 2023-07-14T13:32:56.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.487+0000 7f00b8d3d640 1 --2- 172.21.15.5:0/1672922305 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f00a00663d0 0x7f00a0068880 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:56.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.487+0000 7f00b8d3d640 1 --2- 172.21.15.5:0/1672922305 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00b4160750 0x7f00b415dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:56.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.487+0000 7f00b8d3d640 1 --2- 172.21.15.5:0/1672922305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00b40cc960 0x7f00b415d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:56.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.487+0000 7f00b8d3d640 1 --2- 172.21.15.5:0/1672922305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b40b1620 0x7f00b41f5590 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:56.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.487+0000 7f00b8d3d640 1 -- 172.21.15.5:0/1672922305 >> 172.21.15.5:0/1672922305 conn(0x7f00b4069f50 msgr2=0x7f00b40b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:56.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.487+0000 7f00b8d3d640 1 -- 172.21.15.5:0/1672922305 shutdown_connections 2023-07-14T13:32:56.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.487+0000 7f00b8d3d640 1 -- 172.21.15.5:0/1672922305 wait complete. 2023-07-14T13:32:56.505 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-14T13:32:56.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.659+0000 7fafd3d40640 1 Processor -- start 2023-07-14T13:32:56.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.659+0000 7fafd3d40640 1 -- start start 2023-07-14T13:32:56.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.659+0000 7fafd3d40640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fafcc0ca3d0 0x7fafcc15c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:56.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.659+0000 7fafd3d40640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fafcc0704e0 0x7fafcc06c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:56.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.659+0000 7fafd3d40640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafcc15cb00 con 0x7fafcc158a40 2023-07-14T13:32:56.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.659+0000 7fafd3d40640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafcc0cd070 con 0x7fafcc0ca3d0 2023-07-14T13:32:56.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.659+0000 7fafd3d40640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc15cd30 con 0x7fafcc0704e0 2023-07-14T13:32:56.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.659+0000 7fafd22dd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fafcc0704e0 0x7fafcc06c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:56.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.659+0000 7fafd1adc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fafcc158a40 0x7fafcc0c9cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:53498/0 (socket says 172.21.15.5:53498) 2023-07-14T13:32:56.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.659+0000 7fafd12db640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fafcc0ca3d0 0x7fafcc15c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:56.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.659+0000 7fafd1adc640 1 -- 172.21.15.5:0/1427845152 learned_addr learned my addr 172.21.15.5:0/1427845152 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:56.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.659+0000 7fafd12db640 1 -- 172.21.15.5:0/1427845152 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fafcc0704e0 msgr2=0x7fafcc06c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:56.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.659+0000 7fafd12db640 1 --2- 172.21.15.5:0/1427845152 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fafcc0704e0 0x7fafcc06c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:56.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.659+0000 7fafd12db640 1 -- 172.21.15.5:0/1427845152 >> v1:172.21.15.154:6789/0 conn(0x7fafcc158a40 legacy=0x7fafcc0c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:56.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.659+0000 7fafd12db640 1 -- 172.21.15.5:0/1427845152 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc15d010 con 0x7fafcc0ca3d0 2023-07-14T13:32:56.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.659+0000 7fafd0ada640 1 -- 172.21.15.5:0/1427845152 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145797926 0 0) 0x7fafcc15cb00 con 0x7fafcc158a40 2023-07-14T13:32:56.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.663+0000 7fafd12db640 1 --2- 172.21.15.5:0/1427845152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafcc0ca3d0 0x7fafcc15c5c0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fafbc0097c0 tx=0x7fafbc01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1e3f1fb30babaed server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:56.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.663+0000 7fafd0ada640 1 -- 172.21.15.5:0/1427845152 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc0ab600 con 0x7fafcc0ca3d0 2023-07-14T13:32:56.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.663+0000 7fafd0ada640 1 -- 172.21.15.5:0/1427845152 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafbc0a7050 con 0x7fafcc0ca3d0 2023-07-14T13:32:56.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.663+0000 7fafd0ada640 1 -- 172.21.15.5:0/1427845152 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc0ab980 con 0x7fafcc0ca3d0 2023-07-14T13:32:56.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.663+0000 7fafd3d40640 1 -- 172.21.15.5:0/1427845152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafcc0ca3d0 msgr2=0x7fafcc15c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:56.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.663+0000 7fafd3d40640 1 --2- 172.21.15.5:0/1427845152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafcc0ca3d0 0x7fafcc15c5c0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fafbc0097c0 tx=0x7fafbc01c480 comp rx=0 tx=0).stop 2023-07-14T13:32:56.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.663+0000 7fafd3d40640 1 -- 172.21.15.5:0/1427845152 shutdown_connections 2023-07-14T13:32:56.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.663+0000 7fafd3d40640 1 --2- 172.21.15.5:0/1427845152 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fafcc0704e0 0x7fafcc06c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:56.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.663+0000 7fafd3d40640 1 --2- 172.21.15.5:0/1427845152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafcc0ca3d0 0x7fafcc15c5c0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:56.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.663+0000 7fafd3d40640 1 -- 172.21.15.5:0/1427845152 >> 172.21.15.5:0/1427845152 conn(0x7fafcc0cc9a0 msgr2=0x7fafcc0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:56.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.663+0000 7fafd3d40640 1 -- 172.21.15.5:0/1427845152 shutdown_connections 2023-07-14T13:32:56.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.663+0000 7fafd3d40640 1 -- 172.21.15.5:0/1427845152 wait complete. 2023-07-14T13:32:56.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.667+0000 7fafd3d40640 1 Processor -- start 2023-07-14T13:32:56.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.667+0000 7fafd3d40640 1 -- start start 2023-07-14T13:32:56.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.667+0000 7fafd3d40640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fafcc0704e0 0x7fafcc15b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:56.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.667+0000 7fafd3d40640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafcc0ca3d0 0x7fafcc1599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:56.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.667+0000 7fafd3d40640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafcc158a40 0x7fafcc14b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:56.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.667+0000 7fafd3d40640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc14b6d0 con 0x7fafcc0ca3d0 2023-07-14T13:32:56.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.667+0000 7fafd3d40640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc15a030 con 0x7fafcc158a40 2023-07-14T13:32:56.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.667+0000 7fafd3d40640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc15a310 con 0x7fafcc0704e0 2023-07-14T13:32:56.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.667+0000 7fafd12db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafcc0ca3d0 0x7fafcc1599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:56.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.667+0000 7fafd12db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafcc0ca3d0 0x7fafcc1599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54162/0 (socket says 172.21.15.5:54162) 2023-07-14T13:32:56.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.667+0000 7fafd1adc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fafcc0704e0 0x7fafcc15b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:56.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.667+0000 7fafd12db640 1 -- 172.21.15.5:0/3886768555 learned_addr learned my addr 172.21.15.5:0/3886768555 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:56.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.667+0000 7fafd22dd640 1 --2- 172.21.15.5:0/3886768555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafcc158a40 0x7fafcc14b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:56.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.667+0000 7fafd12db640 1 -- 172.21.15.5:0/3886768555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fafcc0704e0 msgr2=0x7fafcc15b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:56.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.667+0000 7fafd12db640 1 --2- 172.21.15.5:0/3886768555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fafcc0704e0 0x7fafcc15b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:56.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.667+0000 7fafd12db640 1 -- 172.21.15.5:0/3886768555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafcc158a40 msgr2=0x7fafcc14b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:56.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.667+0000 7fafd12db640 1 --2- 172.21.15.5:0/3886768555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafcc158a40 0x7fafcc14b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:56.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.667+0000 7fafd12db640 1 -- 172.21.15.5:0/3886768555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafbc009420 con 0x7fafcc0ca3d0 2023-07-14T13:32:56.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.667+0000 7fafd12db640 1 --2- 172.21.15.5:0/3886768555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafcc0ca3d0 0x7fafcc1599a0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7fafbc0ae040 tx=0x7fafbc019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:56.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.667+0000 7fafc27fc640 1 -- 172.21.15.5:0/3886768555 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc0b4430 con 0x7fafcc0ca3d0 2023-07-14T13:32:56.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.667+0000 7fafc27fc640 1 -- 172.21.15.5:0/3886768555 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafbc0b4590 con 0x7fafcc0ca3d0 2023-07-14T13:32:56.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.667+0000 7fafd3d40640 1 -- 172.21.15.5:0/3886768555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafcc15a5f0 con 0x7fafcc0ca3d0 2023-07-14T13:32:56.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.667+0000 7fafc27fc640 1 -- 172.21.15.5:0/3886768555 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc0b4940 con 0x7fafcc0ca3d0 2023-07-14T13:32:56.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.667+0000 7fafd3d40640 1 -- 172.21.15.5:0/3886768555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafcc15abb0 con 0x7fafcc0ca3d0 2023-07-14T13:32:56.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.671+0000 7fafd3d40640 1 -- 172.21.15.5:0/3886768555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafcc15ada0 con 0x7fafcc0ca3d0 2023-07-14T13:32:56.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.671+0000 7fafc27fc640 1 -- 172.21.15.5:0/3886768555 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fafbc0b2040 con 0x7fafcc0ca3d0 2023-07-14T13:32:56.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.671+0000 7fafc27fc640 1 --2- 172.21.15.5:0/3886768555 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fafb00663a0 0x7fafb0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:56.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.671+0000 7fafc27fc640 1 -- 172.21.15.5:0/3886768555 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7fafbc11de30 con 0x7fafcc0ca3d0 2023-07-14T13:32:56.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.671+0000 7fafd1adc640 1 --2- 172.21.15.5:0/3886768555 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fafb00663a0 0x7fafb0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:56.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.671+0000 7fafd1adc640 1 --2- 172.21.15.5:0/3886768555 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fafb00663a0 0x7fafb0068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fafc8000f70 tx=0x7fafc8009040 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:56.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.675+0000 7fafc27fc640 1 -- 172.21.15.5:0/3886768555 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fafbc0eb0a0 con 0x7fafcc0ca3d0 2023-07-14T13:32:56.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.831+0000 7fafd3d40640 1 -- 172.21.15.5:0/3886768555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fafcc0678d0 con 0x7fafcc0ca3d0 2023-07-14T13:32:56.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.839+0000 7fafc27fc640 1 -- 172.21.15.5:0/3886768555 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v68) v1 ==== 104+0+0 (secure 0 0 0) 0x7fafbc0ee6c0 con 0x7fafcc0ca3d0 2023-07-14T13:32:56.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.839+0000 7fafd3d40640 1 -- 172.21.15.5:0/3886768555 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fafb00663a0 msgr2=0x7fafb0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:56.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.839+0000 7fafd3d40640 1 --2- 172.21.15.5:0/3886768555 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fafb00663a0 0x7fafb0068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fafc8000f70 tx=0x7fafc8009040 comp rx=0 tx=0).stop 2023-07-14T13:32:56.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.839+0000 7fafd3d40640 1 -- 172.21.15.5:0/3886768555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafcc0ca3d0 msgr2=0x7fafcc1599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:56.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.839+0000 7fafd3d40640 1 --2- 172.21.15.5:0/3886768555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafcc0ca3d0 0x7fafcc1599a0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7fafbc0ae040 tx=0x7fafbc019220 comp rx=0 tx=0).stop 2023-07-14T13:32:56.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.839+0000 7fafd3d40640 1 -- 172.21.15.5:0/3886768555 shutdown_connections 2023-07-14T13:32:56.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.839+0000 7fafd3d40640 1 --2- 172.21.15.5:0/3886768555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafcc158a40 0x7fafcc14b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:56.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.839+0000 7fafd3d40640 1 --2- 172.21.15.5:0/3886768555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafcc0ca3d0 0x7fafcc1599a0 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:56.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.839+0000 7fafd3d40640 1 --2- 172.21.15.5:0/3886768555 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fafb00663a0 0x7fafb0068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:56.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.839+0000 7fafd3d40640 1 --2- 172.21.15.5:0/3886768555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fafcc0704e0 0x7fafcc15b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:56.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.839+0000 7fafd3d40640 1 -- 172.21.15.5:0/3886768555 >> 172.21.15.5:0/3886768555 conn(0x7fafcc0cc9a0 msgr2=0x7fafcc0caee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:56.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.839+0000 7fafd3d40640 1 -- 172.21.15.5:0/3886768555 shutdown_connections 2023-07-14T13:32:56.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:56.839+0000 7fafd3d40640 1 -- 172.21.15.5:0/3886768555 wait complete. 2023-07-14T13:32:56.856 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-14T13:32:57.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa53e374640 1 Processor -- start 2023-07-14T13:32:57.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa53e374640 1 -- start start 2023-07-14T13:32:57.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa53e374640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa53806e700 0x7fa53806c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa53e374640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5380c6140 con 0x7fa5380ce620 2023-07-14T13:32:57.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa53e374640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53806dab0 con 0x7fa53815c050 2023-07-14T13:32:57.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa53e374640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53806c3f0 con 0x7fa53806e700 2023-07-14T13:32:57.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa537fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa5380ce620 0x7fa5380ce9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34590/0 (socket says 172.21.15.5:34590) 2023-07-14T13:32:57.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa537fff640 1 -- 172.21.15.5:0/1443928833 learned_addr learned my addr 172.21.15.5:0/1443928833 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:57.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa53c911640 1 --2- 172.21.15.5:0/1443928833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa53806e700 0x7fa53806c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa536ffd640 1 -- 172.21.15.5:0/1443928833 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1794781839 0 0) 0x7fa5380c6140 con 0x7fa5380ce620 2023-07-14T13:32:57.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa536ffd640 1 -- 172.21.15.5:0/1443928833 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa520003530 con 0x7fa5380ce620 2023-07-14T13:32:57.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa536ffd640 1 -- 172.21.15.5:0/1443928833 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199540242 0 0) 0x7fa53806dab0 con 0x7fa53815c050 2023-07-14T13:32:57.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa536ffd640 1 -- 172.21.15.5:0/1443928833 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5380c6140 con 0x7fa53815c050 2023-07-14T13:32:57.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa536ffd640 1 -- 172.21.15.5:0/1443928833 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1051872749 0 0) 0x7fa520003530 con 0x7fa5380ce620 2023-07-14T13:32:57.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa536ffd640 1 -- 172.21.15.5:0/1443928833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa53806e700 msgr2=0x7fa53806c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:57.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa536ffd640 1 --2- 172.21.15.5:0/1443928833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa53806e700 0x7fa53806c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa536ffd640 1 -- 172.21.15.5:0/1443928833 >> v1:172.21.15.154:6789/0 conn(0x7fa53815c050 legacy=0x7fa53815f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:57.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa536ffd640 1 -- 172.21.15.5:0/1443928833 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53806dd90 con 0x7fa5380ce620 2023-07-14T13:32:57.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa536ffd640 1 -- 172.21.15.5:0/1443928833 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7fa528001600 con 0x7fa5380ce620 2023-07-14T13:32:57.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa536ffd640 1 -- 172.21.15.5:0/1443928833 >> v1:172.21.15.5:6789/0 conn(0x7fa5380ce620 legacy=0x7fa5380ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:57.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa536ffd640 1 --2- 172.21.15.5:0/1443928833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa53806e700 0x7fa520003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa536ffd640 1 --2- 172.21.15.5:0/1443928833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5200040f0 0x7fa5200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa536ffd640 1 --2- 172.21.15.5:0/1443928833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa520004d10 0x7fa520005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa536ffd640 1 -- 172.21.15.5:0/1443928833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52000ba70 con 0x7fa520004d10 2023-07-14T13:32:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa536ffd640 1 -- 172.21.15.5:0/1443928833 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52000bbe0 con 0x7fa5200040f0 2023-07-14T13:32:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa536ffd640 1 -- 172.21.15.5:0/1443928833 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa52000bda0 con 0x7fa53806e700 2023-07-14T13:32:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa53c911640 1 --2- 172.21.15.5:0/1443928833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa520004d10 0x7fa520005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa5377fe640 1 --2- 172.21.15.5:0/1443928833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5200040f0 0x7fa5200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa537fff640 1 --2- 172.21.15.5:0/1443928833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa53806e700 0x7fa520003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa53c911640 1 -- 172.21.15.5:0/1443928833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa53806e700 msgr2=0x7fa520003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:57.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa53c911640 1 --2- 172.21.15.5:0/1443928833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa53806e700 0x7fa520003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa53c911640 1 -- 172.21.15.5:0/1443928833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5200040f0 msgr2=0x7fa5200047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:57.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa53c911640 1 --2- 172.21.15.5:0/1443928833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5200040f0 0x7fa5200047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.007+0000 7fa53c911640 1 -- 172.21.15.5:0/1443928833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa520003530 con 0x7fa520004d10 2023-07-14T13:32:57.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.011+0000 7fa53c911640 1 --2- 172.21.15.5:0/1443928833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa520004d10 0x7fa520005180 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7fa530009fc0 tx=0x7fa53001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6bbc04e25baabf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:57.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.011+0000 7fa536ffd640 1 -- 172.21.15.5:0/1443928833 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5300a5c70 con 0x7fa520004d10 2023-07-14T13:32:57.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.011+0000 7fa536ffd640 1 -- 172.21.15.5:0/1443928833 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53000f040 con 0x7fa520004d10 2023-07-14T13:32:57.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.011+0000 7fa536ffd640 1 -- 172.21.15.5:0/1443928833 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5300ad440 con 0x7fa520004d10 2023-07-14T13:32:57.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.011+0000 7fa53e374640 1 -- 172.21.15.5:0/1443928833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa520004d10 msgr2=0x7fa520005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:57.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.011+0000 7fa53e374640 1 --2- 172.21.15.5:0/1443928833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa520004d10 0x7fa520005180 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7fa530009fc0 tx=0x7fa53001cc60 comp rx=0 tx=0).stop 2023-07-14T13:32:57.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.011+0000 7fa53c911640 1 -- 172.21.15.5:0/1443928833 reap_dead start 2023-07-14T13:32:57.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.011+0000 7fa53e374640 1 -- 172.21.15.5:0/1443928833 shutdown_connections 2023-07-14T13:32:57.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.011+0000 7fa53e374640 1 -- 172.21.15.5:0/1443928833 >> 172.21.15.5:0/1443928833 conn(0x7fa5380cc9a0 msgr2=0x7fa5380cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:57.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.011+0000 7fa53e374640 1 -- 172.21.15.5:0/1443928833 shutdown_connections 2023-07-14T13:32:57.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.011+0000 7fa53e374640 1 -- 172.21.15.5:0/1443928833 wait complete. 2023-07-14T13:32:57.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.015+0000 7fa53e374640 1 Processor -- start 2023-07-14T13:32:57.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.015+0000 7fa53e374640 1 -- start start 2023-07-14T13:32:57.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.015+0000 7fa53e374640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa520004d10 0x7fa5380c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.015+0000 7fa53e374640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5380c59f0 0x7fa5380c2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.015+0000 7fa53e374640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5380c4a30 0x7fa5380c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.015+0000 7fa53e374640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5380c8d90 con 0x7fa520004d10 2023-07-14T13:32:57.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.015+0000 7fa53e374640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5380b3040 con 0x7fa5380c59f0 2023-07-14T13:32:57.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.015+0000 7fa53e374640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5381578a0 con 0x7fa5380c4a30 2023-07-14T13:32:57.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.015+0000 7fa537fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa520004d10 0x7fa5380c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.015+0000 7fa537fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa520004d10 0x7fa5380c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54184/0 (socket says 172.21.15.5:54184) 2023-07-14T13:32:57.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.015+0000 7fa537fff640 1 -- 172.21.15.5:0/1614013262 learned_addr learned my addr 172.21.15.5:0/1614013262 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:57.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.015+0000 7fa53c911640 1 --2- 172.21.15.5:0/1614013262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5380c4a30 0x7fa5380c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.015+0000 7fa5377fe640 1 --2- 172.21.15.5:0/1614013262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5380c59f0 0x7fa5380c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.015+0000 7fa537fff640 1 -- 172.21.15.5:0/1614013262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5380c4a30 msgr2=0x7fa5380c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:57.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.015+0000 7fa537fff640 1 --2- 172.21.15.5:0/1614013262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5380c4a30 0x7fa5380c4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.015+0000 7fa537fff640 1 -- 172.21.15.5:0/1614013262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5380c59f0 msgr2=0x7fa5380c2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:57.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.015+0000 7fa537fff640 1 --2- 172.21.15.5:0/1614013262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5380c59f0 0x7fa5380c2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.015+0000 7fa537fff640 1 -- 172.21.15.5:0/1614013262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5380b2430 con 0x7fa520004d10 2023-07-14T13:32:57.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.015+0000 7fa53c911640 1 --2- 172.21.15.5:0/1614013262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5380c4a30 0x7fa5380c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:32:57.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.015+0000 7fa5377fe640 1 --2- 172.21.15.5:0/1614013262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5380c59f0 0x7fa5380c2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:32:57.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.015+0000 7fa537fff640 1 --2- 172.21.15.5:0/1614013262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa520004d10 0x7fa5380c8850 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7fa528012800 tx=0x7fa528012cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:57.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.015+0000 7fa534ff9640 1 -- 172.21.15.5:0/1614013262 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528010960 con 0x7fa520004d10 2023-07-14T13:32:57.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.015+0000 7fa534ff9640 1 -- 172.21.15.5:0/1614013262 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa528010ac0 con 0x7fa520004d10 2023-07-14T13:32:57.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.015+0000 7fa534ff9640 1 -- 172.21.15.5:0/1614013262 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528010e70 con 0x7fa520004d10 2023-07-14T13:32:57.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.015+0000 7fa53e374640 1 -- 172.21.15.5:0/1614013262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5380b2710 con 0x7fa520004d10 2023-07-14T13:32:57.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.015+0000 7fa53e374640 1 -- 172.21.15.5:0/1614013262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5380b2cd0 con 0x7fa520004d10 2023-07-14T13:32:57.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.019+0000 7fa53e374640 1 -- 172.21.15.5:0/1614013262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5380b2e90 con 0x7fa520004d10 2023-07-14T13:32:57.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.019+0000 7fa534ff9640 1 -- 172.21.15.5:0/1614013262 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa528016480 con 0x7fa520004d10 2023-07-14T13:32:57.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.019+0000 7fa534ff9640 1 --2- 172.21.15.5:0/1614013262 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fa5240663a0 0x7fa524068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.019+0000 7fa534ff9640 1 -- 172.21.15.5:0/1614013262 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7fa528087420 con 0x7fa520004d10 2023-07-14T13:32:57.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.019+0000 7fa5377fe640 1 --2- 172.21.15.5:0/1614013262 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fa5240663a0 0x7fa524068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.019+0000 7fa5377fe640 1 --2- 172.21.15.5:0/1614013262 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fa5240663a0 0x7fa524068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa5380c9230 tx=0x7fa52c009040 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:57.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.023+0000 7fa534ff9640 1 -- 172.21.15.5:0/1614013262 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fa5280546f0 con 0x7fa520004d10 2023-07-14T13:32:57.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.187+0000 7fa53e374640 1 -- 172.21.15.5:0/1614013262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fa5380c2920 con 0x7fa520004d10 2023-07-14T13:32:57.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.195+0000 7fa534ff9640 1 -- 172.21.15.5:0/1614013262 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v69) v1 ==== 115+0+0 (secure 0 0 0) 0x7fa528057d10 con 0x7fa520004d10 2023-07-14T13:32:57.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.195+0000 7fa53e374640 1 -- 172.21.15.5:0/1614013262 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fa5240663a0 msgr2=0x7fa524068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:57.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.195+0000 7fa53e374640 1 --2- 172.21.15.5:0/1614013262 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fa5240663a0 0x7fa524068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa5380c9230 tx=0x7fa52c009040 comp rx=0 tx=0).stop 2023-07-14T13:32:57.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.195+0000 7fa53e374640 1 -- 172.21.15.5:0/1614013262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa520004d10 msgr2=0x7fa5380c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:57.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.195+0000 7fa53e374640 1 --2- 172.21.15.5:0/1614013262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa520004d10 0x7fa5380c8850 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7fa528012800 tx=0x7fa528012cc0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.195+0000 7fa53e374640 1 -- 172.21.15.5:0/1614013262 shutdown_connections 2023-07-14T13:32:57.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.195+0000 7fa53e374640 1 --2- 172.21.15.5:0/1614013262 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fa5240663a0 0x7fa524068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.195+0000 7fa53e374640 1 --2- 172.21.15.5:0/1614013262 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5380c4a30 0x7fa5380c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.195+0000 7fa53e374640 1 --2- 172.21.15.5:0/1614013262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5380c59f0 0x7fa5380c2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.195+0000 7fa53e374640 1 --2- 172.21.15.5:0/1614013262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa520004d10 0x7fa5380c8850 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.195+0000 7fa53e374640 1 -- 172.21.15.5:0/1614013262 >> 172.21.15.5:0/1614013262 conn(0x7fa5380cc9a0 msgr2=0x7fa5380ac930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:57.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.195+0000 7fa53e374640 1 -- 172.21.15.5:0/1614013262 shutdown_connections 2023-07-14T13:32:57.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.195+0000 7fa53e374640 1 -- 172.21.15.5:0/1614013262 wait complete. 2023-07-14T13:32:57.212 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-07-14T13:32:57.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.359+0000 7fc5aaaf9640 1 Processor -- start 2023-07-14T13:32:57.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.359+0000 7fc5aaaf9640 1 -- start start 2023-07-14T13:32:57.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.359+0000 7fc5aaaf9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5a40c9e20 0x7fc5a406dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.359+0000 7fc5aaaf9640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a406cdb0 con 0x7fc5a40ca360 2023-07-14T13:32:57.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.359+0000 7fc5aaaf9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a4071790 con 0x7fc5a40c98d0 2023-07-14T13:32:57.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.359+0000 7fc5aaaf9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a406cfe0 con 0x7fc5a40c9e20 2023-07-14T13:32:57.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.363+0000 7fc5a8895640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc5a40ca360 0x7fc5a40ca730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34604/0 (socket says 172.21.15.5:34604) 2023-07-14T13:32:57.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.363+0000 7fc5a8895640 1 -- 172.21.15.5:0/4161911078 learned_addr learned my addr 172.21.15.5:0/4161911078 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:57.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.363+0000 7fc5a37fe640 1 -- 172.21.15.5:0/4161911078 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2097527352 0 0) 0x7fc5a406cdb0 con 0x7fc5a40ca360 2023-07-14T13:32:57.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.363+0000 7fc5a37fe640 1 -- 172.21.15.5:0/4161911078 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc594003530 con 0x7fc5a40ca360 2023-07-14T13:32:57.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.363+0000 7fc5a9096640 1 --2- 172.21.15.5:0/4161911078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5a40c9e20 0x7fc5a406dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.363+0000 7fc5a37fe640 1 -- 172.21.15.5:0/4161911078 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4217872299 0 0) 0x7fc594003530 con 0x7fc5a40ca360 2023-07-14T13:32:57.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.363+0000 7fc5a37fe640 1 -- 172.21.15.5:0/4161911078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5a40c9e20 msgr2=0x7fc5a406dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:57.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.363+0000 7fc5a37fe640 1 --2- 172.21.15.5:0/4161911078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5a40c9e20 0x7fc5a406dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.363+0000 7fc5a37fe640 1 -- 172.21.15.5:0/4161911078 >> v1:172.21.15.154:6789/0 conn(0x7fc5a40c98d0 legacy=0x7fc5a40ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:57.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.363+0000 7fc5a37fe640 1 -- 172.21.15.5:0/4161911078 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a406d2c0 con 0x7fc5a40ca360 2023-07-14T13:32:57.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.363+0000 7fc5a37fe640 1 -- 172.21.15.5:0/4161911078 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7fc598001680 con 0x7fc5a40ca360 2023-07-14T13:32:57.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.363+0000 7fc5a37fe640 1 -- 172.21.15.5:0/4161911078 >> v1:172.21.15.5:6789/0 conn(0x7fc5a40ca360 legacy=0x7fc5a40ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:57.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.363+0000 7fc5a37fe640 1 --2- 172.21.15.5:0/4161911078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5940039b0 0x7fc594003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.363+0000 7fc5a37fe640 1 --2- 172.21.15.5:0/4161911078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5940047d0 0x7fc594004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.363+0000 7fc5a37fe640 1 --2- 172.21.15.5:0/4161911078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5a40c9e20 0x7fc5940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.363+0000 7fc5a37fe640 1 -- 172.21.15.5:0/4161911078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a406cfe0 con 0x7fc5940047d0 2023-07-14T13:32:57.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.363+0000 7fc5a37fe640 1 -- 172.21.15.5:0/4161911078 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59400baf0 con 0x7fc5940039b0 2023-07-14T13:32:57.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.363+0000 7fc5a37fe640 1 -- 172.21.15.5:0/4161911078 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59400bcb0 con 0x7fc5a40c9e20 2023-07-14T13:32:57.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.363+0000 7fc5a3fff640 1 --2- 172.21.15.5:0/4161911078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5940047d0 0x7fc594004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.363+0000 7fc5a9096640 1 --2- 172.21.15.5:0/4161911078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5a40c9e20 0x7fc5940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.363+0000 7fc5a8895640 1 --2- 172.21.15.5:0/4161911078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5940039b0 0x7fc594003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.363+0000 7fc5a3fff640 1 -- 172.21.15.5:0/4161911078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5a40c9e20 msgr2=0x7fc5940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:57.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.363+0000 7fc5a3fff640 1 --2- 172.21.15.5:0/4161911078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5a40c9e20 0x7fc5940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.363+0000 7fc5a3fff640 1 -- 172.21.15.5:0/4161911078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5940039b0 msgr2=0x7fc594003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:57.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.363+0000 7fc5a3fff640 1 --2- 172.21.15.5:0/4161911078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5940039b0 0x7fc594003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.363+0000 7fc5a3fff640 1 -- 172.21.15.5:0/4161911078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc594003530 con 0x7fc5940047d0 2023-07-14T13:32:57.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.367+0000 7fc5a3fff640 1 --2- 172.21.15.5:0/4161911078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5940047d0 0x7fc594004c40 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7fc590001750 tx=0x7fc59001c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fafaa342ce0833e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:57.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.367+0000 7fc5a37fe640 1 -- 172.21.15.5:0/4161911078 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5900052d0 con 0x7fc5940047d0 2023-07-14T13:32:57.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.367+0000 7fc5a37fe640 1 -- 172.21.15.5:0/4161911078 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5900a7050 con 0x7fc5940047d0 2023-07-14T13:32:57.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.367+0000 7fc5a37fe640 1 -- 172.21.15.5:0/4161911078 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590003600 con 0x7fc5940047d0 2023-07-14T13:32:57.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.367+0000 7fc5aaaf9640 1 -- 172.21.15.5:0/4161911078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5940047d0 msgr2=0x7fc594004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:57.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.367+0000 7fc5aaaf9640 1 --2- 172.21.15.5:0/4161911078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5940047d0 0x7fc594004c40 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7fc590001750 tx=0x7fc59001c300 comp rx=0 tx=0).stop 2023-07-14T13:32:57.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.367+0000 7fc5a9096640 1 -- 172.21.15.5:0/4161911078 reap_dead start 2023-07-14T13:32:57.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.367+0000 7fc5aaaf9640 1 -- 172.21.15.5:0/4161911078 shutdown_connections 2023-07-14T13:32:57.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.367+0000 7fc5aaaf9640 1 -- 172.21.15.5:0/4161911078 >> 172.21.15.5:0/4161911078 conn(0x7fc5a40b1840 msgr2=0x7fc5a40cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:57.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.367+0000 7fc5aaaf9640 1 -- 172.21.15.5:0/4161911078 shutdown_connections 2023-07-14T13:32:57.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.367+0000 7fc5aaaf9640 1 -- 172.21.15.5:0/4161911078 wait complete. 2023-07-14T13:32:57.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.367+0000 7fc5aaaf9640 1 Processor -- start 2023-07-14T13:32:57.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.367+0000 7fc5aaaf9640 1 -- start start 2023-07-14T13:32:57.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.371+0000 7fc5aaaf9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5940047d0 0x7fc5a4149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.371+0000 7fc5aaaf9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5a4151760 0x7fc5a414eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.371+0000 7fc5aaaf9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5a41492b0 0x7fc5a4152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.371+0000 7fc5aaaf9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a4151bf0 con 0x7fc5a4151760 2023-07-14T13:32:57.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.371+0000 7fc5aaaf9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a4151ed0 con 0x7fc5a41492b0 2023-07-14T13:32:57.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.371+0000 7fc5aaaf9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a41521b0 con 0x7fc5940047d0 2023-07-14T13:32:57.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.371+0000 7fc5a3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5a4151760 0x7fc5a414eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.371+0000 7fc5a3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5a4151760 0x7fc5a414eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54198/0 (socket says 172.21.15.5:54198) 2023-07-14T13:32:57.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.371+0000 7fc5a3fff640 1 -- 172.21.15.5:0/2183661833 learned_addr learned my addr 172.21.15.5:0/2183661833 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:57.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.371+0000 7fc5a9096640 1 --2- 172.21.15.5:0/2183661833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5a41492b0 0x7fc5a4152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.371+0000 7fc5a8895640 1 --2- 172.21.15.5:0/2183661833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5940047d0 0x7fc5a4149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.371+0000 7fc5a3fff640 1 -- 172.21.15.5:0/2183661833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5940047d0 msgr2=0x7fc5a4149a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:57.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.371+0000 7fc5a3fff640 1 --2- 172.21.15.5:0/2183661833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5940047d0 0x7fc5a4149a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.371+0000 7fc5a3fff640 1 -- 172.21.15.5:0/2183661833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5a41492b0 msgr2=0x7fc5a4152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:57.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.371+0000 7fc5a3fff640 1 --2- 172.21.15.5:0/2183661833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5a41492b0 0x7fc5a4152ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.371+0000 7fc5a3fff640 1 -- 172.21.15.5:0/2183661833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a4152490 con 0x7fc5a4151760 2023-07-14T13:32:57.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.371+0000 7fc5a8895640 1 --2- 172.21.15.5:0/2183661833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5940047d0 0x7fc5a4149a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:57.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.371+0000 7fc5a3fff640 1 --2- 172.21.15.5:0/2183661833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5a4151760 0x7fc5a414eb30 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7fc590005040 tx=0x7fc594005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:57.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.371+0000 7fc5a17fa640 1 -- 172.21.15.5:0/2183661833 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590007390 con 0x7fc5a4151760 2023-07-14T13:32:57.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.371+0000 7fc5a17fa640 1 -- 172.21.15.5:0/2183661833 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5900074f0 con 0x7fc5a4151760 2023-07-14T13:32:57.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.371+0000 7fc5a17fa640 1 -- 172.21.15.5:0/2183661833 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590006a00 con 0x7fc5a4151760 2023-07-14T13:32:57.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.371+0000 7fc5aaaf9640 1 -- 172.21.15.5:0/2183661833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a4149750 con 0x7fc5a4151760 2023-07-14T13:32:57.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.371+0000 7fc5aaaf9640 1 -- 172.21.15.5:0/2183661833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a414a2a0 con 0x7fc5a4151760 2023-07-14T13:32:57.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.371+0000 7fc5aaaf9640 1 -- 172.21.15.5:0/2183661833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a4152620 con 0x7fc5a4151760 2023-07-14T13:32:57.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.371+0000 7fc5a17fa640 1 -- 172.21.15.5:0/2183661833 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc590006b60 con 0x7fc5a4151760 2023-07-14T13:32:57.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.375+0000 7fc5a17fa640 1 --2- 172.21.15.5:0/2183661833 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fc5880663a0 0x7fc588068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.375+0000 7fc5a17fa640 1 -- 172.21.15.5:0/2183661833 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7fc59011e420 con 0x7fc5a4151760 2023-07-14T13:32:57.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.375+0000 7fc5a8895640 1 --2- 172.21.15.5:0/2183661833 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fc5880663a0 0x7fc588068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.375+0000 7fc5a8895640 1 --2- 172.21.15.5:0/2183661833 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fc5880663a0 0x7fc588068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc5a41570e0 tx=0x7fc598009040 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:57.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.379+0000 7fc5a17fa640 1 -- 172.21.15.5:0/2183661833 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fc5900ef070 con 0x7fc5a4151760 2023-07-14T13:32:57.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:57.591+0000 7fc5aaaf9640 1 -- 172.21.15.5:0/2183661833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7fc5a40678d0 con 0x7fc5a4151760 2023-07-14T13:32:58.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:58.143+0000 7fc5a17fa640 1 -- 172.21.15.5:0/2183661833 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v1440) v1 ==== 155+0+0 (secure 0 0 0) 0x7fc5900eec00 con 0x7fc5a4151760 2023-07-14T13:32:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:58.143+0000 7fc5aaaf9640 1 -- 172.21.15.5:0/2183661833 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fc5880663a0 msgr2=0x7fc588068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:58.143+0000 7fc5aaaf9640 1 --2- 172.21.15.5:0/2183661833 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fc5880663a0 0x7fc588068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc5a41570e0 tx=0x7fc598009040 comp rx=0 tx=0).stop 2023-07-14T13:32:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:58.143+0000 7fc5aaaf9640 1 -- 172.21.15.5:0/2183661833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5a4151760 msgr2=0x7fc5a414eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:58.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:58.143+0000 7fc5aaaf9640 1 --2- 172.21.15.5:0/2183661833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5a4151760 0x7fc5a414eb30 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7fc590005040 tx=0x7fc594005800 comp rx=0 tx=0).stop 2023-07-14T13:32:58.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:58.143+0000 7fc5aaaf9640 1 -- 172.21.15.5:0/2183661833 shutdown_connections 2023-07-14T13:32:58.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:58.143+0000 7fc5aaaf9640 1 --2- 172.21.15.5:0/2183661833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5a41492b0 0x7fc5a4152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:58.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:58.143+0000 7fc5aaaf9640 1 --2- 172.21.15.5:0/2183661833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5a4151760 0x7fc5a414eb30 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:58.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:58.143+0000 7fc5aaaf9640 1 --2- 172.21.15.5:0/2183661833 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fc5880663a0 0x7fc588068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:58.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:58.143+0000 7fc5aaaf9640 1 --2- 172.21.15.5:0/2183661833 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc5940047d0 0x7fc5a4149a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:58.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:58.143+0000 7fc5aaaf9640 1 -- 172.21.15.5:0/2183661833 >> 172.21.15.5:0/2183661833 conn(0x7fc5a40b1840 msgr2=0x7fc5a40ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:58.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:58.143+0000 7fc5aaaf9640 1 -- 172.21.15.5:0/2183661833 shutdown_connections 2023-07-14T13:32:58.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:58.143+0000 7fc5aaaf9640 1 -- 172.21.15.5:0/2183661833 wait complete. 2023-07-14T13:32:58.163 INFO:tasks.cephfs_test_runner:Test the correctness of snap directory name ... ok 2023-07-14T13:32:58.163 INFO:tasks.cephfs_test_runner: 2023-07-14T13:32:58.164 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-14T13:32:58.164 INFO:tasks.cephfs_test_runner:Ran 10 tests in 2381.520s 2023-07-14T13:32:58.164 INFO:tasks.cephfs_test_runner: 2023-07-14T13:32:58.165 INFO:tasks.cephfs_test_runner:OK 2023-07-14T13:32:58.165 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-07-14T13:32:58.174 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-07-14T13:32:58.213 INFO:tasks.kclient:Unmounting kernel clients... 2023-07-14T13:32:58.214 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:32:58.214 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:32:58.224 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:32:58.224 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-07-14T13:32:58.225 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:32:58.275 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14794 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276008k,nr_inodes=819002,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-14T13:32:58.275 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:32:58.275 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:32:58.285 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:32:58.286 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-14T13:32:58.286 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:32:58.337 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14890 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-14T13:32:58.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:58.337 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-07-14T13:32:58.346 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-14T13:32:58.347 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-14T13:32:58.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:58.348 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-14T13:32:58.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:58.414 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T13:32:58.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:58.497 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2023-07-14T13:32:58.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:58.678 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-07-14T13:32:58.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:58.688 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2023-07-14T13:32:58.759 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2023-07-14T13:32:58.761 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T13:32:58.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:58.762 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-07-14T13:32:58.771 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-14T13:32:58.771 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-14T13:32:58.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:58.773 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-14T13:32:58.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:58.844 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-14T13:32:58.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:58.945 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link delete ceph-brx 2023-07-14T13:32:59.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:59.192 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-07-14T13:32:59.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:32:59.202 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link delete ceph-brx 2023-07-14T13:32:59.276 INFO:teuthology.orchestra.run.smithi154.stderr:Cannot find device "ceph-brx" 2023-07-14T13:32:59.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T13:32:59.279 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-07-14T13:32:59.292 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-14T13:32:59.293 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:32:59.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.447+0000 7f2a40974640 1 Processor -- start 2023-07-14T13:32:59.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.447+0000 7f2a40974640 1 -- start start 2023-07-14T13:32:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.447+0000 7f2a40974640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2a3c0b7c70 0x7f2a3c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.447+0000 7f2a40974640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a3c0ccaf0 con 0x7f2a3c15fd60 2023-07-14T13:32:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.447+0000 7f2a40974640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a3c160320 con 0x7f2a3c0d1850 2023-07-14T13:32:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.447+0000 7f2a40974640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a3c0d1190 con 0x7f2a3c0b7c70 2023-07-14T13:32:59.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.447+0000 7f2a3ad9d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2a3c15fd60 0x7f2a3c0d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35300/0 (socket says 172.21.15.5:35300) 2023-07-14T13:32:59.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.447+0000 7f2a3ad9d640 1 -- 172.21.15.5:0/3294367374 learned_addr learned my addr 172.21.15.5:0/3294367374 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:59.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.447+0000 7f2a3a59c640 1 --2- 172.21.15.5:0/3294367374 >> v2:172.21.15.154:3300/0 conn(0x7f2a3c0b7c70 0x7f2a3c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:59.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.447+0000 7f2a39d9b640 1 -- 172.21.15.5:0/3294367374 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073818942 0 0) 0x7f2a3c0ccaf0 con 0x7f2a3c15fd60 2023-07-14T13:32:59.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.447+0000 7f2a39d9b640 1 -- 172.21.15.5:0/3294367374 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a28003530 con 0x7f2a3c15fd60 2023-07-14T13:32:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.447+0000 7f2a39d9b640 1 -- 172.21.15.5:0/3294367374 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3764557120 0 0) 0x7f2a3c160320 con 0x7f2a3c0d1850 2023-07-14T13:32:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.447+0000 7f2a39d9b640 1 -- 172.21.15.5:0/3294367374 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a3c0ccaf0 con 0x7f2a3c0d1850 2023-07-14T13:32:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.447+0000 7f2a39d9b640 1 -- 172.21.15.5:0/3294367374 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1586540484 0 0) 0x7f2a28003530 con 0x7f2a3c15fd60 2023-07-14T13:32:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.447+0000 7f2a3a59c640 1 -- 172.21.15.5:0/3294367374 >> v1:172.21.15.154:6789/0 conn(0x7f2a3c0d1850 legacy=0x7f2a3c15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.447+0000 7f2a3a59c640 1 -- 172.21.15.5:0/3294367374 >> v1:172.21.15.5:6789/0 conn(0x7f2a3c15fd60 legacy=0x7f2a3c0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.447+0000 7f2a3a59c640 1 -- 172.21.15.5:0/3294367374 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3c0ccd90 con 0x7f2a3c0b7c70 2023-07-14T13:32:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.451+0000 7f2a3a59c640 1 --2- 172.21.15.5:0/3294367374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a3c0b7c70 0x7f2a3c0d0c50 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0097c0 tx=0x7f2a2c01c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37fff8d92c55f81d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.451+0000 7f2a39d9b640 1 -- 172.21.15.5:0/3294367374 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34001a00 con 0x7f2a3c0b7c70 2023-07-14T13:32:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.451+0000 7f2a39d9b640 1 -- 172.21.15.5:0/3294367374 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c0a7050 con 0x7f2a3c0b7c70 2023-07-14T13:32:59.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.451+0000 7f2a39d9b640 1 -- 172.21.15.5:0/3294367374 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c0ab620 con 0x7f2a3c0b7c70 2023-07-14T13:32:59.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.451+0000 7f2a40974640 1 -- 172.21.15.5:0/3294367374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a3c0b7c70 msgr2=0x7f2a3c0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:59.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.451+0000 7f2a40974640 1 --2- 172.21.15.5:0/3294367374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a3c0b7c70 0x7f2a3c0d0c50 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0097c0 tx=0x7f2a2c01c3a0 comp rx=0 tx=0).stop 2023-07-14T13:32:59.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.451+0000 7f2a40974640 1 -- 172.21.15.5:0/3294367374 shutdown_connections 2023-07-14T13:32:59.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.451+0000 7f2a40974640 1 --2- 172.21.15.5:0/3294367374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a3c0b7c70 0x7f2a3c0d0c50 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:59.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.451+0000 7f2a40974640 1 -- 172.21.15.5:0/3294367374 >> 172.21.15.5:0/3294367374 conn(0x7f2a3c0650b0 msgr2=0x7f2a3c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:59.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.451+0000 7f2a40974640 1 -- 172.21.15.5:0/3294367374 shutdown_connections 2023-07-14T13:32:59.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.451+0000 7f2a40974640 1 -- 172.21.15.5:0/3294367374 wait complete. 2023-07-14T13:32:59.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.455+0000 7f2a40974640 1 Processor -- start 2023-07-14T13:32:59.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.455+0000 7f2a40974640 1 -- start start 2023-07-14T13:32:59.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.455+0000 7f2a40974640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a3c0b7c70 0x7f2a3c15db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:59.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.455+0000 7f2a40974640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a3c0d1850 0x7f2a3c14cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:59.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.455+0000 7f2a40974640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a3c15fd60 0x7f2a3c0b6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:59.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.455+0000 7f2a40974640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c1515a0 con 0x7f2a3c0b7c70 2023-07-14T13:32:59.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.455+0000 7f2a40974640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c15e090 con 0x7f2a3c15fd60 2023-07-14T13:32:59.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.455+0000 7f2a40974640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c151e00 con 0x7f2a3c0d1850 2023-07-14T13:32:59.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.455+0000 7f2a3a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a3c0b7c70 0x7f2a3c15db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:59.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.455+0000 7f2a3a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a3c0b7c70 0x7f2a3c15db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55170/0 (socket says 172.21.15.5:55170) 2023-07-14T13:32:59.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.455+0000 7f2a3a59c640 1 -- 172.21.15.5:0/2161061890 learned_addr learned my addr 172.21.15.5:0/2161061890 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:59.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.455+0000 7f2a3ad9d640 1 --2- 172.21.15.5:0/2161061890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a3c15fd60 0x7f2a3c0b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:59.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.455+0000 7f2a33fff640 1 --2- 172.21.15.5:0/2161061890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a3c0d1850 0x7f2a3c14cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:59.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.455+0000 7f2a3a59c640 1 -- 172.21.15.5:0/2161061890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a3c0d1850 msgr2=0x7f2a3c14cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:59.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.455+0000 7f2a3a59c640 1 --2- 172.21.15.5:0/2161061890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a3c0d1850 0x7f2a3c14cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:59.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.455+0000 7f2a3a59c640 1 -- 172.21.15.5:0/2161061890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a3c15fd60 msgr2=0x7f2a3c0b6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:59.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.455+0000 7f2a3a59c640 1 --2- 172.21.15.5:0/2161061890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a3c15fd60 0x7f2a3c0b6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:59.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.455+0000 7f2a3a59c640 1 -- 172.21.15.5:0/2161061890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c009420 con 0x7f2a3c0b7c70 2023-07-14T13:32:59.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.455+0000 7f2a33fff640 1 --2- 172.21.15.5:0/2161061890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a3c0d1850 0x7f2a3c14cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:59.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.455+0000 7f2a3ad9d640 1 --2- 172.21.15.5:0/2161061890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a3c15fd60 0x7f2a3c0b6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:59.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.455+0000 7f2a3a59c640 1 --2- 172.21.15.5:0/2161061890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a3c0b7c70 0x7f2a3c15db50 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0097c0 tx=0x7f2a2c01abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:59.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.455+0000 7f2a32ffd640 1 -- 172.21.15.5:0/2161061890 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c004220 con 0x7f2a3c0b7c70 2023-07-14T13:32:59.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.455+0000 7f2a32ffd640 1 -- 172.21.15.5:0/2161061890 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c004380 con 0x7f2a3c0b7c70 2023-07-14T13:32:59.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.455+0000 7f2a32ffd640 1 -- 172.21.15.5:0/2161061890 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c003860 con 0x7f2a3c0b7c70 2023-07-14T13:32:59.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.455+0000 7f2a40974640 1 -- 172.21.15.5:0/2161061890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a3c0c53d0 con 0x7f2a3c0b7c70 2023-07-14T13:32:59.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.455+0000 7f2a40974640 1 -- 172.21.15.5:0/2161061890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3c151a90 con 0x7f2a3c0b7c70 2023-07-14T13:32:59.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.455+0000 7f2a40974640 1 -- 172.21.15.5:0/2161061890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a3c0678d0 con 0x7f2a3c0b7c70 2023-07-14T13:32:59.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.459+0000 7f2a32ffd640 1 -- 172.21.15.5:0/2161061890 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2a2c0039c0 con 0x7f2a3c0b7c70 2023-07-14T13:32:59.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.459+0000 7f2a32ffd640 1 --2- 172.21.15.5:0/2161061890 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f2a1c0663d0 0x7f2a1c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:59.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.459+0000 7f2a32ffd640 1 -- 172.21.15.5:0/2161061890 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7f2a2c11d9a0 con 0x7f2a3c0b7c70 2023-07-14T13:32:59.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.459+0000 7f2a33fff640 1 --2- 172.21.15.5:0/2161061890 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f2a1c0663d0 0x7f2a1c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:59.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.459+0000 7f2a33fff640 1 --2- 172.21.15.5:0/2161061890 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f2a1c0663d0 0x7f2a1c068880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c15b090 tx=0x7f2a24009040 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:59.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.463+0000 7f2a32ffd640 1 -- 172.21.15.5:0/2161061890 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f2a2c0eab60 con 0x7f2a3c0b7c70 2023-07-14T13:32:59.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.615+0000 7f2a40974640 1 -- 172.21.15.5:0/2161061890 --> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2a3c157d00 con 0x7f2a1c0663d0 2023-07-14T13:32:59.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.615+0000 7f2a32ffd640 1 -- 172.21.15.5:0/2161061890 <== mgr.10192 v2:172.21.15.154:6832/317858933 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72578 (secure 0 0 0) 0x7f2a3c157d00 con 0x7f2a1c0663d0 2023-07-14T13:32:59.615 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:59.616 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:32:59.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.619+0000 7f2a40974640 1 -- 172.21.15.5:0/2161061890 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f2a1c0663d0 msgr2=0x7f2a1c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:59.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.619+0000 7f2a40974640 1 --2- 172.21.15.5:0/2161061890 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f2a1c0663d0 0x7f2a1c068880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c15b090 tx=0x7f2a24009040 comp rx=0 tx=0).stop 2023-07-14T13:32:59.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.619+0000 7f2a40974640 1 -- 172.21.15.5:0/2161061890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a3c0b7c70 msgr2=0x7f2a3c15db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:59.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.619+0000 7f2a40974640 1 --2- 172.21.15.5:0/2161061890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a3c0b7c70 0x7f2a3c15db50 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0097c0 tx=0x7f2a2c01abe0 comp rx=0 tx=0).stop 2023-07-14T13:32:59.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.619+0000 7f2a40974640 1 -- 172.21.15.5:0/2161061890 shutdown_connections 2023-07-14T13:32:59.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.619+0000 7f2a40974640 1 --2- 172.21.15.5:0/2161061890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a3c15fd60 0x7f2a3c0b6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:59.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.619+0000 7f2a40974640 1 --2- 172.21.15.5:0/2161061890 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f2a1c0663d0 0x7f2a1c068880 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:59.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.619+0000 7f2a40974640 1 --2- 172.21.15.5:0/2161061890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a3c0d1850 0x7f2a3c14cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:59.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.619+0000 7f2a40974640 1 --2- 172.21.15.5:0/2161061890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a3c0b7c70 0x7f2a3c15db50 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:59.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.619+0000 7f2a40974640 1 -- 172.21.15.5:0/2161061890 >> 172.21.15.5:0/2161061890 conn(0x7f2a3c0650b0 msgr2=0x7f2a3c15b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:59.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.619+0000 7f2a40974640 1 -- 172.21.15.5:0/2161061890 shutdown_connections 2023-07-14T13:32:59.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.619+0000 7f2a40974640 1 -- 172.21.15.5:0/2161061890 wait complete. 2023-07-14T13:32:59.636 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2023-07-14T13:32:57.883434+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":376948,"kb_used_data":21172,"kb_used_omap":0,"kb_used_meta":355712,"kb_avail":754597772,"statfs":{"total":773094113280,"available":772708118528,"internally_reserved":0,"allocated":21680128,"data_stored":12208528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":364249088},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-668216,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-317,"num_read_kb":-281,"num_write":-281,"num_write_kb":-2054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001381"},"pg_stats":[{"pgid":"1.0","version":"193'348","reported_seq":1309,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-07-14T13:32:55.273082+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:32:55.273082+0000","last_peered":"2023-07-14T13:32:55.273082+0000","last_clean":"2023-07-14T13:32:55.273082+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:32:55.273082+0000","last_undegraded":"2023-07-14T13:32:55.273082+0000","last_fullsized":"2023-07-14T13:32:55.273082+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:59:47.875694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":330,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-07-14T13:32:55.289086+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:32:55.289086+0000","last_peered":"2023-07-14T13:32:55.289086+0000","last_clean":"2023-07-14T13:32:55.289086+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:32:55.289086+0000","last_undegraded":"2023-07-14T13:32:55.289086+0000","last_fullsized":"2023-07-14T13:32:55.289086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:09:35.427380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":334,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-07-14T13:32:55.272942+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:32:55.272942+0000","last_peered":"2023-07-14T13:32:55.272942+0000","last_clean":"2023-07-14T13:32:55.272942+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:32:55.272942+0000","last_undegraded":"2023-07-14T13:32:55.272942+0000","last_fullsized":"2023-07-14T13:32:55.272942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:38:53.036556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":334,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-14T13:32:53.124355+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:32:53.124355+0000","last_peered":"2023-07-14T13:32:53.124355+0000","last_clean":"2023-07-14T13:32:53.124355+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:32:53.124355+0000","last_undegraded":"2023-07-14T13:32:53.124355+0000","last_fullsized":"2023-07-14T13:32:53.124355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:53:58.790201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":330,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-07-14T13:32:55.288815+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:32:55.288815+0000","last_peered":"2023-07-14T13:32:55.288815+0000","last_clean":"2023-07-14T13:32:55.288815+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:32:55.288815+0000","last_undegraded":"2023-07-14T13:32:55.288815+0000","last_fullsized":"2023-07-14T13:32:55.288815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:48.541992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":340,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-14T13:32:53.099343+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:32:53.099343+0000","last_peered":"2023-07-14T13:32:53.099343+0000","last_clean":"2023-07-14T13:32:53.099343+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:32:53.099343+0000","last_undegraded":"2023-07-14T13:32:53.099343+0000","last_fullsized":"2023-07-14T13:32:53.099343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:01:14.537216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":332,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-07-14T13:32:55.272990+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:32:55.272990+0000","last_peered":"2023-07-14T13:32:55.272990+0000","last_clean":"2023-07-14T13:32:55.272990+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:32:55.272990+0000","last_undegraded":"2023-07-14T13:32:55.272990+0000","last_fullsized":"2023-07-14T13:32:55.272990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:07:14.250168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":339,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-14T13:32:53.099559+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:32:53.099559+0000","last_peered":"2023-07-14T13:32:53.099559+0000","last_clean":"2023-07-14T13:32:53.099559+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:32:53.099559+0000","last_undegraded":"2023-07-14T13:32:53.099559+0000","last_fullsized":"2023-07-14T13:32:53.099559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:13:01.794741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":333,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-07-14T13:32:55.414232+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:32:55.414232+0000","last_peered":"2023-07-14T13:32:55.414232+0000","last_clean":"2023-07-14T13:32:55.414232+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:32:55.414232+0000","last_undegraded":"2023-07-14T13:32:55.414232+0000","last_fullsized":"2023-07-14T13:32:55.414232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:50:21.018632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575326,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60252,"kb_used_data":2964,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94311588,"statfs":{"total":96636764160,"available":96575066112,"internally_reserved":0,"allocated":3035136,"data_stored":1848421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.747,"15min":0.73999999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0449999999999999,"5min":1.208,"15min":1.208},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73699999999999999,"15min":0.74199999999999999},"min":{"1min":0.52700000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88,"5min":1.042,"15min":1.042},"last":0.64000000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.746,"15min":0.75800000000000001},"min":{"1min":0.51000000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.0820000000000001,"5min":1.444,"15min":1.444},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.76900000000000002,"15min":0.76300000000000001},"min":{"1min":0.48199999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.98599999999999999,"5min":1.534,"15min":1.534},"last":0.78400000000000003}]},{"osd":2,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.72899999999999998,"15min":0.73799999999999999},"min":{"1min":0.52800000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.90500000000000003,"5min":1.1120000000000001,"15min":1.1379999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.77400000000000002,"15min":0.77000000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0549999999999999,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.56599999999999995}]},{"osd":3,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.878,"5min":1.498,"15min":1.498},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78800000000000003,"15min":0.78300000000000003},"min":{"1min":0.51600000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0209999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.85599999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.47399999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.95399999999999996,"5min":1.0129999999999999,"15min":1.0620000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.627,"15min":0.624},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91700000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.73699999999999999}]},{"osd":5,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64400000000000002,"15min":0.61799999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41499999999999998},"max":{"1min":0.88100000000000001,"5min":1.145,"15min":1.145},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66100000000000003,"15min":0.65200000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0169999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.83499999999999996}]},{"osd":6,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72999999999999998,"15min":0.71599999999999997},"min":{"1min":0.50800000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.046,"5min":1.0700000000000001,"15min":1.0940000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.70799999999999996,"15min":0.69199999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.41999999999999998},"max":{"1min":1.0029999999999999,"5min":1.089,"15min":1.089},"last":0.80000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575327,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37512,"kb_used_data":2368,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334328,"statfs":{"total":96636764160,"available":96598351872,"internally_reserved":0,"allocated":2424832,"data_stored":1250938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.53500000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.98299999999999998,"5min":1.026,"15min":1.026},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.755,"15min":0.753},"min":{"1min":0.55600000000000005,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.012,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.81200000000000006}]},{"osd":1,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.59799999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.044,"5min":1.044,"15min":1.3300000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.746,"15min":0.746},"min":{"1min":0.57299999999999995,"5min":0.51900000000000002,"15min":0.47499999999999998},"max":{"1min":0.996,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.871}]},{"osd":2,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78000000000000003,"15min":0.78900000000000003},"min":{"1min":0.58599999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0740000000000001,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77200000000000002,"15min":0.76400000000000001},"min":{"1min":0.61799999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96799999999999997,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.78900000000000003}]},{"osd":3,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.77600000000000002,"15min":0.78100000000000003},"min":{"1min":0.59399999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.073,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76100000000000001,"15min":0.76700000000000002},"min":{"1min":0.56100000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.999,"5min":1.0249999999999999,"15min":1.2569999999999999},"last":0.77500000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57699999999999996,"15min":0.56799999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.36099999999999999},"max":{"1min":0.78200000000000003,"5min":1.02,"15min":1.175},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.626,"15min":0.61099999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.36799999999999999},"max":{"1min":0.755,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.51300000000000001}]},{"osd":5,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64700000000000002,"15min":0.63300000000000001},"min":{"1min":0.41899999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94499999999999995,"5min":1.0049999999999999,"15min":1.0860000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68500000000000005,"15min":0.67300000000000004},"min":{"1min":0.50900000000000001,"5min":0.46400000000000002,"15min":0.41699999999999998},"max":{"1min":0.878,"5min":1.0640000000000001,"15min":1.3180000000000001},"last":0.57899999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.64700000000000002,"15min":0.64300000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.42899999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":1.0269999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71599999999999997,"15min":0.70499999999999996},"min":{"1min":0.52600000000000002,"5min":0.49299999999999999,"15min":0.46200000000000002},"max":{"1min":0.92900000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.628}]}]},{"osd":5,"up_from":13,"seq":55834575326,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55572,"kb_used_data":2380,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316268,"statfs":{"total":96636764160,"available":96579858432,"internally_reserved":0,"allocated":2437120,"data_stored":1251163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71899999999999997,"15min":0.73699999999999999},"min":{"1min":0.46700000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.91200000000000003,"5min":1.0600000000000001,"15min":1.8},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.73099999999999998,"15min":0.754},"min":{"1min":0.443,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.88200000000000001,"5min":1.0369999999999999,"15min":1.8700000000000001},"last":0.60299999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.71999999999999997,"15min":0.74399999999999999},"min":{"1min":0.41099999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.85799999999999998,"5min":1.008,"15min":1.835},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.751,"15min":0.76100000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90800000000000003,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.63600000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.73699999999999999,"15min":0.79800000000000004},"min":{"1min":0.48899999999999999,"5min":0.45700000000000002,"15min":0.434},"max":{"1min":0.80900000000000005,"5min":1.2130000000000001,"15min":16.774000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.73699999999999999,"15min":0.80200000000000005},"min":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.85599999999999998,"5min":1.0449999999999999,"15min":16.751999999999999},"last":0.79200000000000004}]},{"osd":3,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.73999999999999999,"15min":0.76400000000000001},"min":{"1min":0.44,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86699999999999999,"5min":1.0209999999999999,"15min":1.115},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.76900000000000002,"15min":0.82799999999999996},"min":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95699999999999996,"5min":1.1140000000000001,"15min":16.731000000000002},"last":0.83799999999999997}]},{"osd":4,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.436,"5min":0.40400000000000003,"15min":0.38},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.72199999999999998,"15min":0.71399999999999997},"min":{"1min":0.40799999999999997,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":0.874,"5min":1.248,"15min":1.248},"last":0.82099999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.622,"15min":0.623},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.34999999999999998},"max":{"1min":0.77500000000000002,"5min":1.157,"15min":1.3100000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.65800000000000003,"15min":0.65100000000000002},"min":{"1min":0.46300000000000002,"5min":0.45400000000000001,"15min":0.42799999999999999},"max":{"1min":0.93200000000000005,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.89500000000000002}]},{"osd":7,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.66300000000000003,"15min":0.65800000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.86599999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.872},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.71099999999999997,"15min":0.69699999999999995},"min":{"1min":0.52900000000000003,"5min":0.433,"15min":0.40000000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.748}]}]},{"osd":4,"up_from":13,"seq":55834575326,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37852,"kb_used_data":2708,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333988,"statfs":{"total":96636764160,"available":96598003712,"internally_reserved":0,"allocated":2772992,"data_stored":1579934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.74299999999999999,"15min":0.75900000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.38100000000000001},"max":{"1min":0.98299999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.72899999999999998,"15min":0.752},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82299999999999995,"5min":0.94699999999999995,"15min":1.278},"last":0.84199999999999997}]},{"osd":1,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.751,"15min":0.77000000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.89500000000000002,"5min":1.0369999999999999,"15min":1.306},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.74199999999999999,"15min":0.74299999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.47599999999999998},"max":{"1min":0.91800000000000004,"5min":1.024,"15min":1.177},"last":0.94699999999999995}]},{"osd":2,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.73999999999999999,"15min":0.76300000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.79100000000000004,"5min":0.92600000000000005,"15min":1.137},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.76900000000000002,"15min":0.77400000000000002},"min":{"1min":0.53400000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94899999999999995,"5min":1,"15min":1},"last":0.81100000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74199999999999999,"15min":0.76200000000000001},"min":{"1min":0.53100000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.95899999999999996,"5min":0.96899999999999997,"15min":1.222},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.76400000000000001,"15min":0.77400000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.496},"max":{"1min":0.91900000000000004,"5min":1.018,"15min":1.1970000000000001},"last":0.85099999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40000000000000002},"max":{"1min":0.93600000000000005,"5min":0.94099999999999995,"15min":0.97799999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.625,"15min":0.61199999999999999},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.378},"max":{"1min":0.90300000000000002,"5min":0.96099999999999997,"15min":0.96799999999999997},"last":0.58099999999999996}]},{"osd":6,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.42499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.89200000000000002,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66600000000000004,"15min":0.66700000000000004},"min":{"1min":0.48499999999999999,"5min":0.47199999999999998,"15min":0.42699999999999999},"max":{"1min":0.96599999999999997,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.71299999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.44800000000000001,"5min":0.436,"15min":0.435},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.69599999999999995},"min":{"1min":0.50800000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0289999999999999,"5min":1.127,"15min":1.127},"last":0.60099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575326,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41956,"kb_used_data":2716,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329884,"statfs":{"total":96636764160,"available":96593801216,"internally_reserved":0,"allocated":2781184,"data_stored":1590627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.45300000000000001,"15min":0.46100000000000002},"min":{"1min":0.309,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68600000000000005,"5min":0.73799999999999999,"15min":0.92900000000000005},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.504,"15min":0.51800000000000002},"min":{"1min":0.372,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.752,"5min":0.77600000000000002,"15min":0.86599999999999999},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.48599999999999999,"15min":0.48299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65700000000000003,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54600000000000004,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71799999999999997,"5min":0.82199999999999995,"15min":0.85099999999999998},"last":0.52200000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.40699999999999997,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.68999999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59899999999999998,"15min":0.61199999999999999},"min":{"1min":0.45500000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77300000000000002,"5min":0.86099999999999999,"15min":0.88100000000000001},"last":0.59999999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71799999999999997,"15min":0.77000000000000002},"min":{"1min":0.53000000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.92700000000000005,"5min":1.0680000000000001,"15min":1.2529999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76100000000000001,"15min":0.79000000000000004},"min":{"1min":0.52000000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90900000000000003,"5min":1,"15min":1.4359999999999999},"last":0.81000000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.77000000000000002,"15min":0.81200000000000006},"min":{"1min":0.55400000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94999999999999996,"5min":1.069,"15min":1.3959999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.77800000000000002,"15min":0.80100000000000005},"min":{"1min":0.56699999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98999999999999999,"5min":1.1220000000000001,"15min":1.4970000000000001},"last":0.86099999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.77200000000000002,"15min":0.79500000000000004},"min":{"1min":0.56899999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.91700000000000004,"5min":1.1910000000000001,"15min":1.383},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.80300000000000005,"15min":0.82799999999999996},"min":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.92600000000000005,"5min":1.1439999999999999,"15min":1.3520000000000001},"last":0.95399999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.82799999999999996,"15min":0.85399999999999998},"min":{"1min":0.61399999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.97399999999999998,"5min":1.171,"15min":1.5449999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.79700000000000004,"15min":0.82999999999999996},"min":{"1min":0.58799999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.996,"5min":1.1579999999999999,"15min":1.4650000000000001},"last":0.97399999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575326,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59656,"kb_used_data":2368,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312184,"statfs":{"total":96636764160,"available":96575676416,"internally_reserved":0,"allocated":2424832,"data_stored":1250020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46400000000000002,"15min":0.46500000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.746,"5min":0.75900000000000001,"15min":0.79800000000000004},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.50700000000000001,"15min":0.52600000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65500000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.34399999999999997}]},{"osd":1,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.48099999999999998,"15min":0.46999999999999997},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70999999999999996,"5min":0.80600000000000005,"15min":0.84799999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.55700000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93799999999999994},"last":0.58699999999999997}]},{"osd":3,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.71599999999999997,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.433},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.35999999999999999},"max":{"1min":0.70299999999999996,"5min":0.77300000000000002,"15min":0.81999999999999995},"last":0.46200000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.51300000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1619999999999999,"5min":1.222,"15min":1.222},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80600000000000005,"15min":0.81699999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0589999999999999,"5min":1.298,"15min":1.3029999999999999},"last":0.67700000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.87,"15min":0.86599999999999999},"min":{"1min":0.59999999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.129,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.101,"5min":1.329,"15min":1.329},"last":0.82299999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.82499999999999996,"15min":0.82899999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.196,"5min":1.196,"15min":1.446},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.266},"last":0.79800000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.85799999999999998,"15min":0.84599999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.228,"5min":2.306,"15min":2.306},"last":0.752},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.85699999999999998,"15min":0.85299999999999998},"min":{"1min":0.627,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.282,"5min":1.282,"15min":1.371},"last":0.68400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575327,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41948,"kb_used_data":2708,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329892,"statfs":{"total":96636764160,"available":96593809408,"internally_reserved":0,"allocated":2772992,"data_stored":1590023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.46300000000000002},"min":{"1min":0.33200000000000002,"5min":0.316,"15min":0.28499999999999998},"max":{"1min":0.64400000000000002,"5min":0.76600000000000001,"15min":0.81599999999999995},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51300000000000001,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.32500000000000001,"15min":0.30199999999999999},"max":{"1min":0.80200000000000005,"5min":0.80300000000000005,"15min":0.81299999999999994},"last":0.41399999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.34699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69599999999999995,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54100000000000004,"15min":0.53600000000000003},"min":{"1min":0.42899999999999999,"5min":0.373,"15min":0.32800000000000001},"max":{"1min":0.71799999999999997,"5min":0.83399999999999996,"15min":0.89200000000000002},"last":0.441}]},{"osd":3,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.52100000000000002,"5min":0.501,"15min":0.42299999999999999},"max":{"1min":0.747,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57299999999999995,"15min":0.58699999999999997},"min":{"1min":0.41199999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80800000000000005,"5min":0.86899999999999999,"15min":0.90300000000000002},"last":0.45900000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79800000000000004,"15min":0.80900000000000005},"min":{"1min":0.56699999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1519999999999999,"5min":1.155,"15min":1.2470000000000001},"last":0.751},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81699999999999995,"15min":0.82499999999999996},"min":{"1min":0.61599999999999999,"5min":0.56100000000000005,"15min":0.497},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.81599999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.81699999999999995,"15min":0.82199999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1850000000000001,"5min":1.224,"15min":1.224},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.82399999999999995,"15min":0.83199999999999996},"min":{"1min":0.62,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0920000000000001,"5min":1.2010000000000001,"15min":1.202},"last":0.69199999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.82199999999999995,"15min":0.82899999999999996},"min":{"1min":0.623,"5min":0.60399999999999998,"15min":0.57799999999999996},"max":{"1min":1.0529999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.83499999999999996,"15min":0.85299999999999998},"min":{"1min":0.64800000000000002,"5min":0.60599999999999998,"15min":0.56399999999999995},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.83899999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.81799999999999995},"min":{"1min":0.63500000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.129,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.875,"5min":0.877,"15min":0.877},"min":{"1min":0.65600000000000003,"5min":0.60499999999999998,"15min":0.58899999999999997},"max":{"1min":1.2569999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.92300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575328,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42200,"kb_used_data":2960,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329640,"statfs":{"total":96636764160,"available":96593551360,"internally_reserved":0,"allocated":3031040,"data_stored":1847402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.45900000000000002,"15min":0.47899999999999998},"min":{"1min":0.307,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70999999999999996,"5min":0.81499999999999995,"15min":0.85299999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52600000000000002,"15min":0.53000000000000003},"min":{"1min":0.38300000000000001,"5min":0.34100000000000003,"15min":0.308},"max":{"1min":0.71299999999999997,"5min":0.73999999999999999,"15min":0.80700000000000005},"last":0.40899999999999997}]},{"osd":2,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52100000000000002,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.82099999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57099999999999995,"15min":0.57399999999999995},"min":{"1min":0.44800000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.79800000000000004,"5min":0.81200000000000006,"15min":0.91200000000000003},"last":0.49399999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.53200000000000003},"min":{"1min":0.35899999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.745,"5min":0.77000000000000002,"15min":0.80100000000000005},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.435,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.78400000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.64900000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0329999999999999,"5min":1.157,"15min":1.284},"last":0.629},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.84199999999999997,"15min":0.83799999999999997},"min":{"1min":0.63500000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0820000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.81299999999999994,"15min":0.83299999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.56699999999999995},"max":{"1min":1.1160000000000001,"5min":1.28,"15min":1.294},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85199999999999998,"15min":0.85299999999999998},"min":{"1min":0.69899999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0249999999999999,"5min":1.472,"15min":1.472},"last":0.66700000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83499999999999996,"15min":0.84299999999999997},"min":{"1min":0.65700000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.236,"5min":1.639,"15min":1.639},"last":0.877},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.85999999999999999,"15min":0.86299999999999999},"min":{"1min":0.64200000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.002,"5min":1.544,"15min":1.544},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86899999999999999,"15min":0.85799999999999998},"min":{"1min":0.621,"5min":0.621,"15min":0.55500000000000005},"max":{"1min":1.0640000000000001,"5min":1.236,"15min":1.3200000000000001},"last":0.748},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84899999999999998,"15min":0.85999999999999999},"min":{"1min":0.63100000000000001,"5min":0.57599999999999996,"15min":0.57499999999999996},"max":{"1min":1.202,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.56299999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:32:59.638 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:32:59.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.783+0000 7fd42ef59640 1 Processor -- start 2023-07-14T13:32:59.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.783+0000 7fd42ef59640 1 -- start start 2023-07-14T13:32:59.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.787+0000 7fd42ef59640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd428158ce0 0x7fd428070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:59.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.787+0000 7fd42ef59640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4280cc700 con 0x7fd4280c9730 2023-07-14T13:32:59.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.787+0000 7fd42ef59640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4280b0ff0 con 0x7fd4280c8ad0 2023-07-14T13:32:59.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.787+0000 7fd42ef59640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd428070c80 con 0x7fd428158ce0 2023-07-14T13:32:59.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.787+0000 7fd42d4f6640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd4280c9730 0x7fd4280ccb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35316/0 (socket says 172.21.15.5:35316) 2023-07-14T13:32:59.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.787+0000 7fd42d4f6640 1 -- 172.21.15.5:0/1540750126 learned_addr learned my addr 172.21.15.5:0/1540750126 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:32:59.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.787+0000 7fd42ccf5640 1 --2- 172.21.15.5:0/1540750126 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd428158ce0 0x7fd428070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:59.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.787+0000 7fd4277fe640 1 -- 172.21.15.5:0/1540750126 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712146043 0 0) 0x7fd4280cc700 con 0x7fd4280c9730 2023-07-14T13:32:59.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.787+0000 7fd4277fe640 1 -- 172.21.15.5:0/1540750126 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd418003530 con 0x7fd4280c9730 2023-07-14T13:32:59.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.787+0000 7fd4277fe640 1 -- 172.21.15.5:0/1540750126 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223471524 0 0) 0x7fd4280b0ff0 con 0x7fd4280c8ad0 2023-07-14T13:32:59.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.787+0000 7fd4277fe640 1 -- 172.21.15.5:0/1540750126 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4280cc700 con 0x7fd4280c8ad0 2023-07-14T13:32:59.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.787+0000 7fd4277fe640 1 -- 172.21.15.5:0/1540750126 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2123286029 0 0) 0x7fd418003530 con 0x7fd4280c9730 2023-07-14T13:32:59.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.787+0000 7fd42ccf5640 1 -- 172.21.15.5:0/1540750126 >> v1:172.21.15.154:6789/0 conn(0x7fd4280c8ad0 legacy=0x7fd4280c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:59.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.787+0000 7fd42ccf5640 1 -- 172.21.15.5:0/1540750126 >> v1:172.21.15.5:6789/0 conn(0x7fd4280c9730 legacy=0x7fd4280ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:59.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.787+0000 7fd42ccf5640 1 -- 172.21.15.5:0/1540750126 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4280cbdd0 con 0x7fd428158ce0 2023-07-14T13:32:59.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.791+0000 7fd42ccf5640 1 --2- 172.21.15.5:0/1540750126 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd428158ce0 0x7fd428070450 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0097f0 tx=0x7fd41c01c290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc52c0fcc8b11517 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:59.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.791+0000 7fd4277fe640 1 -- 172.21.15.5:0/1540750126 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd420001a00 con 0x7fd428158ce0 2023-07-14T13:32:59.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.791+0000 7fd4277fe640 1 -- 172.21.15.5:0/1540750126 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41c0a7050 con 0x7fd428158ce0 2023-07-14T13:32:59.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.791+0000 7fd4277fe640 1 -- 172.21.15.5:0/1540750126 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c0ab620 con 0x7fd428158ce0 2023-07-14T13:32:59.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.791+0000 7fd42ef59640 1 -- 172.21.15.5:0/1540750126 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd428158ce0 msgr2=0x7fd428070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:59.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.791+0000 7fd42ef59640 1 --2- 172.21.15.5:0/1540750126 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd428158ce0 0x7fd428070450 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0097f0 tx=0x7fd41c01c290 comp rx=0 tx=0).stop 2023-07-14T13:32:59.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.791+0000 7fd42ef59640 1 -- 172.21.15.5:0/1540750126 shutdown_connections 2023-07-14T13:32:59.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.791+0000 7fd42ef59640 1 --2- 172.21.15.5:0/1540750126 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd428158ce0 0x7fd428070450 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:59.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.791+0000 7fd42ef59640 1 -- 172.21.15.5:0/1540750126 >> 172.21.15.5:0/1540750126 conn(0x7fd4280afcf0 msgr2=0x7fd4280b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:59.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.791+0000 7fd42ef59640 1 -- 172.21.15.5:0/1540750126 shutdown_connections 2023-07-14T13:32:59.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.791+0000 7fd42ef59640 1 -- 172.21.15.5:0/1540750126 wait complete. 2023-07-14T13:32:59.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.791+0000 7fd42ef59640 1 Processor -- start 2023-07-14T13:32:59.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.791+0000 7fd42ef59640 1 -- start start 2023-07-14T13:32:59.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.795+0000 7fd42ef59640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4280c8ad0 0x7fd42814c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:59.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.795+0000 7fd42ef59640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4280c9730 0x7fd4280c2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:59.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.795+0000 7fd42ef59640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd428158ce0 0x7fd4280ce080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:59.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.795+0000 7fd42ef59640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4280b4130 con 0x7fd428158ce0 2023-07-14T13:32:59.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.795+0000 7fd42ef59640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4280b3b90 con 0x7fd4280c9730 2023-07-14T13:32:59.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.795+0000 7fd42ef59640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4280b2af0 con 0x7fd4280c8ad0 2023-07-14T13:32:59.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.795+0000 7fd42d4f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd428158ce0 0x7fd4280ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:59.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.795+0000 7fd42d4f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd428158ce0 0x7fd4280ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55176/0 (socket says 172.21.15.5:55176) 2023-07-14T13:32:59.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.795+0000 7fd42d4f6640 1 -- 172.21.15.5:0/1910498058 learned_addr learned my addr 172.21.15.5:0/1910498058 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:32:59.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.795+0000 7fd42ccf5640 1 --2- 172.21.15.5:0/1910498058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4280c8ad0 0x7fd42814c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:59.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.795+0000 7fd427fff640 1 --2- 172.21.15.5:0/1910498058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4280c9730 0x7fd4280c2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:59.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.795+0000 7fd42d4f6640 1 -- 172.21.15.5:0/1910498058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4280c8ad0 msgr2=0x7fd42814c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:59.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.795+0000 7fd42d4f6640 1 --2- 172.21.15.5:0/1910498058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4280c8ad0 0x7fd42814c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:59.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.795+0000 7fd42d4f6640 1 -- 172.21.15.5:0/1910498058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4280c9730 msgr2=0x7fd4280c2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:59.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.795+0000 7fd42d4f6640 1 --2- 172.21.15.5:0/1910498058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4280c9730 0x7fd4280c2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:59.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.795+0000 7fd42d4f6640 1 -- 172.21.15.5:0/1910498058 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41c009420 con 0x7fd428158ce0 2023-07-14T13:32:59.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.795+0000 7fd427fff640 1 --2- 172.21.15.5:0/1910498058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4280c9730 0x7fd4280c2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.795+0000 7fd42d4f6640 1 --2- 172.21.15.5:0/1910498058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd428158ce0 0x7fd4280ce080 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7fd420001f50 tx=0x7fd42000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.795+0000 7fd4257fa640 1 -- 172.21.15.5:0/1910498058 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd420012400 con 0x7fd428158ce0 2023-07-14T13:32:59.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.795+0000 7fd4257fa640 1 -- 172.21.15.5:0/1910498058 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd420012560 con 0x7fd428158ce0 2023-07-14T13:32:59.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.795+0000 7fd4257fa640 1 -- 172.21.15.5:0/1910498058 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4200128f0 con 0x7fd428158ce0 2023-07-14T13:32:59.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.795+0000 7fd42ef59640 1 -- 172.21.15.5:0/1910498058 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4280b2dd0 con 0x7fd428158ce0 2023-07-14T13:32:59.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.795+0000 7fd42ef59640 1 -- 172.21.15.5:0/1910498058 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4280b3390 con 0x7fd428158ce0 2023-07-14T13:32:59.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.795+0000 7fd42ef59640 1 -- 172.21.15.5:0/1910498058 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4280678d0 con 0x7fd428158ce0 2023-07-14T13:32:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.795+0000 7fd4257fa640 1 -- 172.21.15.5:0/1910498058 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd420012a50 con 0x7fd428158ce0 2023-07-14T13:32:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.799+0000 7fd4257fa640 1 --2- 172.21.15.5:0/1910498058 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fd40c0663a0 0x7fd40c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:59.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.799+0000 7fd4257fa640 1 -- 172.21.15.5:0/1910498058 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7fd420084650 con 0x7fd428158ce0 2023-07-14T13:32:59.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.799+0000 7fd42ccf5640 1 --2- 172.21.15.5:0/1910498058 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fd40c0663a0 0x7fd40c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:59.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.799+0000 7fd42ccf5640 1 --2- 172.21.15.5:0/1910498058 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fd40c0663a0 0x7fd40c068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0ad000 tx=0x7fd41c0a6000 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:59.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.803+0000 7fd4257fa640 1 -- 172.21.15.5:0/1910498058 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd420051920 con 0x7fd428158ce0 2023-07-14T13:32:59.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.955+0000 7fd42ef59640 1 -- 172.21.15.5:0/1910498058 --> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd4281590b0 con 0x7fd40c0663a0 2023-07-14T13:32:59.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.955+0000 7fd4257fa640 1 -- 172.21.15.5:0/1910498058 <== mgr.10192 v2:172.21.15.154:6832/317858933 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72578 (secure 0 0 0) 0x7fd41c0ab580 con 0x7fd40c0663a0 2023-07-14T13:32:59.955 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:32:59.955 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:32:59.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.959+0000 7fd42ef59640 1 -- 172.21.15.5:0/1910498058 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fd40c0663a0 msgr2=0x7fd40c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:59.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.959+0000 7fd42ef59640 1 --2- 172.21.15.5:0/1910498058 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fd40c0663a0 0x7fd40c068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0ad000 tx=0x7fd41c0a6000 comp rx=0 tx=0).stop 2023-07-14T13:32:59.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.959+0000 7fd42ef59640 1 -- 172.21.15.5:0/1910498058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd428158ce0 msgr2=0x7fd4280ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:59.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.959+0000 7fd42ef59640 1 --2- 172.21.15.5:0/1910498058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd428158ce0 0x7fd4280ce080 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7fd420001f50 tx=0x7fd42000a430 comp rx=0 tx=0).stop 2023-07-14T13:32:59.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.959+0000 7fd42ef59640 1 -- 172.21.15.5:0/1910498058 shutdown_connections 2023-07-14T13:32:59.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.959+0000 7fd42ef59640 1 --2- 172.21.15.5:0/1910498058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd428158ce0 0x7fd4280ce080 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:59.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.959+0000 7fd42ef59640 1 --2- 172.21.15.5:0/1910498058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4280c9730 0x7fd4280c2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:59.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.959+0000 7fd42ef59640 1 --2- 172.21.15.5:0/1910498058 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fd40c0663a0 0x7fd40c068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:59.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.959+0000 7fd42ef59640 1 --2- 172.21.15.5:0/1910498058 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4280c8ad0 0x7fd42814c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:59.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.959+0000 7fd42ef59640 1 -- 172.21.15.5:0/1910498058 >> 172.21.15.5:0/1910498058 conn(0x7fd4280afcf0 msgr2=0x7fd4280cab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:59.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.959+0000 7fd42ef59640 1 -- 172.21.15.5:0/1910498058 shutdown_connections 2023-07-14T13:32:59.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:32:59.959+0000 7fd42ef59640 1 -- 172.21.15.5:0/1910498058 wait complete. 2023-07-14T13:32:59.975 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2023-07-14T13:32:59.883828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":376948,"kb_used_data":21172,"kb_used_omap":0,"kb_used_meta":355712,"kb_avail":754597772,"statfs":{"total":773094113280,"available":772708118528,"internally_reserved":0,"allocated":21680128,"data_stored":12208528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":364249088},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-668216,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-317,"num_read_kb":-281,"num_write":-281,"num_write_kb":-2054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.782382"},"pg_stats":[{"pgid":"1.0","version":"193'348","reported_seq":1309,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-07-14T13:32:55.273082+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:32:55.273082+0000","last_peered":"2023-07-14T13:32:55.273082+0000","last_clean":"2023-07-14T13:32:55.273082+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:32:55.273082+0000","last_undegraded":"2023-07-14T13:32:55.273082+0000","last_fullsized":"2023-07-14T13:32:55.273082+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:59:47.875694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":330,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-07-14T13:32:55.289086+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:32:55.289086+0000","last_peered":"2023-07-14T13:32:55.289086+0000","last_clean":"2023-07-14T13:32:55.289086+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:32:55.289086+0000","last_undegraded":"2023-07-14T13:32:55.289086+0000","last_fullsized":"2023-07-14T13:32:55.289086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:09:35.427380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":334,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-07-14T13:32:55.272942+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:32:55.272942+0000","last_peered":"2023-07-14T13:32:55.272942+0000","last_clean":"2023-07-14T13:32:55.272942+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:32:55.272942+0000","last_undegraded":"2023-07-14T13:32:55.272942+0000","last_fullsized":"2023-07-14T13:32:55.272942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:38:53.036556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":334,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-14T13:32:53.124355+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:32:53.124355+0000","last_peered":"2023-07-14T13:32:53.124355+0000","last_clean":"2023-07-14T13:32:53.124355+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:32:53.124355+0000","last_undegraded":"2023-07-14T13:32:53.124355+0000","last_fullsized":"2023-07-14T13:32:53.124355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:53:58.790201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":330,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-07-14T13:32:55.288815+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:32:55.288815+0000","last_peered":"2023-07-14T13:32:55.288815+0000","last_clean":"2023-07-14T13:32:55.288815+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:32:55.288815+0000","last_undegraded":"2023-07-14T13:32:55.288815+0000","last_fullsized":"2023-07-14T13:32:55.288815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:48.541992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":340,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-14T13:32:53.099343+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:32:53.099343+0000","last_peered":"2023-07-14T13:32:53.099343+0000","last_clean":"2023-07-14T13:32:53.099343+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:32:53.099343+0000","last_undegraded":"2023-07-14T13:32:53.099343+0000","last_fullsized":"2023-07-14T13:32:53.099343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:01:14.537216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":332,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-07-14T13:32:55.272990+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:32:55.272990+0000","last_peered":"2023-07-14T13:32:55.272990+0000","last_clean":"2023-07-14T13:32:55.272990+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:32:55.272990+0000","last_undegraded":"2023-07-14T13:32:55.272990+0000","last_fullsized":"2023-07-14T13:32:55.272990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:07:14.250168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":339,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-14T13:32:53.099559+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:32:53.099559+0000","last_peered":"2023-07-14T13:32:53.099559+0000","last_clean":"2023-07-14T13:32:53.099559+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:32:53.099559+0000","last_undegraded":"2023-07-14T13:32:53.099559+0000","last_fullsized":"2023-07-14T13:32:53.099559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:13:01.794741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":333,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-07-14T13:32:55.414232+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:32:55.414232+0000","last_peered":"2023-07-14T13:32:55.414232+0000","last_clean":"2023-07-14T13:32:55.414232+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:32:55.414232+0000","last_undegraded":"2023-07-14T13:32:55.414232+0000","last_fullsized":"2023-07-14T13:32:55.414232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:50:21.018632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575326,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60252,"kb_used_data":2964,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94311588,"statfs":{"total":96636764160,"available":96575066112,"internally_reserved":0,"allocated":3035136,"data_stored":1848421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.747,"15min":0.73999999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0449999999999999,"5min":1.208,"15min":1.208},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73699999999999999,"15min":0.74199999999999999},"min":{"1min":0.52700000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88,"5min":1.042,"15min":1.042},"last":0.64000000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.746,"15min":0.75800000000000001},"min":{"1min":0.51000000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.0820000000000001,"5min":1.444,"15min":1.444},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.76900000000000002,"15min":0.76300000000000001},"min":{"1min":0.48199999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.98599999999999999,"5min":1.534,"15min":1.534},"last":0.78400000000000003}]},{"osd":2,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.72899999999999998,"15min":0.73799999999999999},"min":{"1min":0.52800000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.90500000000000003,"5min":1.1120000000000001,"15min":1.1379999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.77400000000000002,"15min":0.77000000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0549999999999999,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.56599999999999995}]},{"osd":3,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.878,"5min":1.498,"15min":1.498},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78800000000000003,"15min":0.78300000000000003},"min":{"1min":0.51600000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0209999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.85599999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.47399999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.95399999999999996,"5min":1.0129999999999999,"15min":1.0620000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.627,"15min":0.624},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91700000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.73699999999999999}]},{"osd":5,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64400000000000002,"15min":0.61799999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41499999999999998},"max":{"1min":0.88100000000000001,"5min":1.145,"15min":1.145},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66100000000000003,"15min":0.65200000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0169999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.83499999999999996}]},{"osd":6,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72999999999999998,"15min":0.71599999999999997},"min":{"1min":0.50800000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.046,"5min":1.0700000000000001,"15min":1.0940000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.70799999999999996,"15min":0.69199999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.41999999999999998},"max":{"1min":1.0029999999999999,"5min":1.089,"15min":1.089},"last":0.80000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575327,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37512,"kb_used_data":2368,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334328,"statfs":{"total":96636764160,"available":96598351872,"internally_reserved":0,"allocated":2424832,"data_stored":1250938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.53500000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.98299999999999998,"5min":1.026,"15min":1.026},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.755,"15min":0.753},"min":{"1min":0.55600000000000005,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.012,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.81200000000000006}]},{"osd":1,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.59799999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.044,"5min":1.044,"15min":1.3300000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.746,"15min":0.746},"min":{"1min":0.57299999999999995,"5min":0.51900000000000002,"15min":0.47499999999999998},"max":{"1min":0.996,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.871}]},{"osd":2,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78000000000000003,"15min":0.78900000000000003},"min":{"1min":0.58599999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0740000000000001,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77200000000000002,"15min":0.76400000000000001},"min":{"1min":0.61799999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96799999999999997,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.78900000000000003}]},{"osd":3,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.77600000000000002,"15min":0.78100000000000003},"min":{"1min":0.59399999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.073,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76100000000000001,"15min":0.76700000000000002},"min":{"1min":0.56100000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.999,"5min":1.0249999999999999,"15min":1.2569999999999999},"last":0.77500000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57699999999999996,"15min":0.56799999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.36099999999999999},"max":{"1min":0.78200000000000003,"5min":1.02,"15min":1.175},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.626,"15min":0.61099999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.36799999999999999},"max":{"1min":0.755,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.51300000000000001}]},{"osd":5,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64700000000000002,"15min":0.63300000000000001},"min":{"1min":0.41899999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94499999999999995,"5min":1.0049999999999999,"15min":1.0860000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68500000000000005,"15min":0.67300000000000004},"min":{"1min":0.50900000000000001,"5min":0.46400000000000002,"15min":0.41699999999999998},"max":{"1min":0.878,"5min":1.0640000000000001,"15min":1.3180000000000001},"last":0.57899999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.64700000000000002,"15min":0.64300000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.42899999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":1.0269999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71599999999999997,"15min":0.70499999999999996},"min":{"1min":0.52600000000000002,"5min":0.49299999999999999,"15min":0.46200000000000002},"max":{"1min":0.92900000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.628}]}]},{"osd":5,"up_from":13,"seq":55834575326,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55572,"kb_used_data":2380,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316268,"statfs":{"total":96636764160,"available":96579858432,"internally_reserved":0,"allocated":2437120,"data_stored":1251163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71899999999999997,"15min":0.73699999999999999},"min":{"1min":0.46700000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.91200000000000003,"5min":1.0600000000000001,"15min":1.8},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.73099999999999998,"15min":0.754},"min":{"1min":0.443,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.88200000000000001,"5min":1.0369999999999999,"15min":1.8700000000000001},"last":0.60299999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.71999999999999997,"15min":0.74399999999999999},"min":{"1min":0.41099999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.85799999999999998,"5min":1.008,"15min":1.835},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.751,"15min":0.76100000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90800000000000003,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.63600000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.73699999999999999,"15min":0.79800000000000004},"min":{"1min":0.48899999999999999,"5min":0.45700000000000002,"15min":0.434},"max":{"1min":0.80900000000000005,"5min":1.2130000000000001,"15min":16.774000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.73699999999999999,"15min":0.80200000000000005},"min":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.85599999999999998,"5min":1.0449999999999999,"15min":16.751999999999999},"last":0.79200000000000004}]},{"osd":3,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.73999999999999999,"15min":0.76400000000000001},"min":{"1min":0.44,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86699999999999999,"5min":1.0209999999999999,"15min":1.115},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.76900000000000002,"15min":0.82799999999999996},"min":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95699999999999996,"5min":1.1140000000000001,"15min":16.731000000000002},"last":0.83799999999999997}]},{"osd":4,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.436,"5min":0.40400000000000003,"15min":0.38},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.72199999999999998,"15min":0.71399999999999997},"min":{"1min":0.40799999999999997,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":0.874,"5min":1.248,"15min":1.248},"last":0.82099999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.622,"15min":0.623},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.34999999999999998},"max":{"1min":0.77500000000000002,"5min":1.157,"15min":1.3100000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.65800000000000003,"15min":0.65100000000000002},"min":{"1min":0.46300000000000002,"5min":0.45400000000000001,"15min":0.42799999999999999},"max":{"1min":0.93200000000000005,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.89500000000000002}]},{"osd":7,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.66300000000000003,"15min":0.65800000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.86599999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.872},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.71099999999999997,"15min":0.69699999999999995},"min":{"1min":0.52900000000000003,"5min":0.433,"15min":0.40000000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.748}]}]},{"osd":4,"up_from":13,"seq":55834575326,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37852,"kb_used_data":2708,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333988,"statfs":{"total":96636764160,"available":96598003712,"internally_reserved":0,"allocated":2772992,"data_stored":1579934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.74299999999999999,"15min":0.75900000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.38100000000000001},"max":{"1min":0.98299999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.72899999999999998,"15min":0.752},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82299999999999995,"5min":0.94699999999999995,"15min":1.278},"last":0.84199999999999997}]},{"osd":1,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.751,"15min":0.77000000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.89500000000000002,"5min":1.0369999999999999,"15min":1.306},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.74199999999999999,"15min":0.74299999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.47599999999999998},"max":{"1min":0.91800000000000004,"5min":1.024,"15min":1.177},"last":0.94699999999999995}]},{"osd":2,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.73999999999999999,"15min":0.76300000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.79100000000000004,"5min":0.92600000000000005,"15min":1.137},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.76900000000000002,"15min":0.77400000000000002},"min":{"1min":0.53400000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94899999999999995,"5min":1,"15min":1},"last":0.81100000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74199999999999999,"15min":0.76200000000000001},"min":{"1min":0.53100000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.95899999999999996,"5min":0.96899999999999997,"15min":1.222},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.76400000000000001,"15min":0.77400000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.496},"max":{"1min":0.91900000000000004,"5min":1.018,"15min":1.1970000000000001},"last":0.85099999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40000000000000002},"max":{"1min":0.93600000000000005,"5min":0.94099999999999995,"15min":0.97799999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.625,"15min":0.61199999999999999},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.378},"max":{"1min":0.90300000000000002,"5min":0.96099999999999997,"15min":0.96799999999999997},"last":0.58099999999999996}]},{"osd":6,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.42499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.89200000000000002,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66600000000000004,"15min":0.66700000000000004},"min":{"1min":0.48499999999999999,"5min":0.47199999999999998,"15min":0.42699999999999999},"max":{"1min":0.96599999999999997,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.71299999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.44800000000000001,"5min":0.436,"15min":0.435},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.69599999999999995},"min":{"1min":0.50800000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0289999999999999,"5min":1.127,"15min":1.127},"last":0.60099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575326,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41956,"kb_used_data":2716,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329884,"statfs":{"total":96636764160,"available":96593801216,"internally_reserved":0,"allocated":2781184,"data_stored":1590627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.45300000000000001,"15min":0.46100000000000002},"min":{"1min":0.309,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68600000000000005,"5min":0.73799999999999999,"15min":0.92900000000000005},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.504,"15min":0.51800000000000002},"min":{"1min":0.372,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.752,"5min":0.77600000000000002,"15min":0.86599999999999999},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.48599999999999999,"15min":0.48299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65700000000000003,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54600000000000004,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71799999999999997,"5min":0.82199999999999995,"15min":0.85099999999999998},"last":0.52200000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.40699999999999997,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.68999999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59899999999999998,"15min":0.61199999999999999},"min":{"1min":0.45500000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77300000000000002,"5min":0.86099999999999999,"15min":0.88100000000000001},"last":0.59999999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71799999999999997,"15min":0.77000000000000002},"min":{"1min":0.53000000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.92700000000000005,"5min":1.0680000000000001,"15min":1.2529999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76100000000000001,"15min":0.79000000000000004},"min":{"1min":0.52000000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90900000000000003,"5min":1,"15min":1.4359999999999999},"last":0.81000000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.77000000000000002,"15min":0.81200000000000006},"min":{"1min":0.55400000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94999999999999996,"5min":1.069,"15min":1.3959999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.77800000000000002,"15min":0.80100000000000005},"min":{"1min":0.56699999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98999999999999999,"5min":1.1220000000000001,"15min":1.4970000000000001},"last":0.86099999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.77200000000000002,"15min":0.79500000000000004},"min":{"1min":0.56899999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.91700000000000004,"5min":1.1910000000000001,"15min":1.383},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.80300000000000005,"15min":0.82799999999999996},"min":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.92600000000000005,"5min":1.1439999999999999,"15min":1.3520000000000001},"last":0.95399999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.82799999999999996,"15min":0.85399999999999998},"min":{"1min":0.61399999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.97399999999999998,"5min":1.171,"15min":1.5449999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.79700000000000004,"15min":0.82999999999999996},"min":{"1min":0.58799999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.996,"5min":1.1579999999999999,"15min":1.4650000000000001},"last":0.97399999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575326,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59656,"kb_used_data":2368,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312184,"statfs":{"total":96636764160,"available":96575676416,"internally_reserved":0,"allocated":2424832,"data_stored":1250020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46400000000000002,"15min":0.46500000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.746,"5min":0.75900000000000001,"15min":0.79800000000000004},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.50700000000000001,"15min":0.52600000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65500000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.34399999999999997}]},{"osd":1,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.48099999999999998,"15min":0.46999999999999997},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70999999999999996,"5min":0.80600000000000005,"15min":0.84799999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.55700000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93799999999999994},"last":0.58699999999999997}]},{"osd":3,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.71599999999999997,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.433},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.35999999999999999},"max":{"1min":0.70299999999999996,"5min":0.77300000000000002,"15min":0.81999999999999995},"last":0.46200000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.51300000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1619999999999999,"5min":1.222,"15min":1.222},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80600000000000005,"15min":0.81699999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0589999999999999,"5min":1.298,"15min":1.3029999999999999},"last":0.67700000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.87,"15min":0.86599999999999999},"min":{"1min":0.59999999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.129,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.101,"5min":1.329,"15min":1.329},"last":0.82299999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.82499999999999996,"15min":0.82899999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.196,"5min":1.196,"15min":1.446},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.266},"last":0.79800000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.85799999999999998,"15min":0.84599999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.228,"5min":2.306,"15min":2.306},"last":0.752},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.85699999999999998,"15min":0.85299999999999998},"min":{"1min":0.627,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.282,"5min":1.282,"15min":1.371},"last":0.68400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575327,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41948,"kb_used_data":2708,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329892,"statfs":{"total":96636764160,"available":96593809408,"internally_reserved":0,"allocated":2772992,"data_stored":1590023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.46300000000000002},"min":{"1min":0.33200000000000002,"5min":0.316,"15min":0.28499999999999998},"max":{"1min":0.64400000000000002,"5min":0.76600000000000001,"15min":0.81599999999999995},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51300000000000001,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.32500000000000001,"15min":0.30199999999999999},"max":{"1min":0.80200000000000005,"5min":0.80300000000000005,"15min":0.81299999999999994},"last":0.41399999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.34699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69599999999999995,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54100000000000004,"15min":0.53600000000000003},"min":{"1min":0.42899999999999999,"5min":0.373,"15min":0.32800000000000001},"max":{"1min":0.71799999999999997,"5min":0.83399999999999996,"15min":0.89200000000000002},"last":0.441}]},{"osd":3,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.52100000000000002,"5min":0.501,"15min":0.42299999999999999},"max":{"1min":0.747,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57299999999999995,"15min":0.58699999999999997},"min":{"1min":0.41199999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80800000000000005,"5min":0.86899999999999999,"15min":0.90300000000000002},"last":0.45900000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79800000000000004,"15min":0.80900000000000005},"min":{"1min":0.56699999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1519999999999999,"5min":1.155,"15min":1.2470000000000001},"last":0.751},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81699999999999995,"15min":0.82499999999999996},"min":{"1min":0.61599999999999999,"5min":0.56100000000000005,"15min":0.497},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.81599999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.81699999999999995,"15min":0.82199999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1850000000000001,"5min":1.224,"15min":1.224},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.82399999999999995,"15min":0.83199999999999996},"min":{"1min":0.62,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0920000000000001,"5min":1.2010000000000001,"15min":1.202},"last":0.69199999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.82199999999999995,"15min":0.82899999999999996},"min":{"1min":0.623,"5min":0.60399999999999998,"15min":0.57799999999999996},"max":{"1min":1.0529999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.83499999999999996,"15min":0.85299999999999998},"min":{"1min":0.64800000000000002,"5min":0.60599999999999998,"15min":0.56399999999999995},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.83899999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.81799999999999995},"min":{"1min":0.63500000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.129,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.875,"5min":0.877,"15min":0.877},"min":{"1min":0.65600000000000003,"5min":0.60499999999999998,"15min":0.58899999999999997},"max":{"1min":1.2569999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.92300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575328,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42200,"kb_used_data":2960,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329640,"statfs":{"total":96636764160,"available":96593551360,"internally_reserved":0,"allocated":3031040,"data_stored":1847402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.45900000000000002,"15min":0.47899999999999998},"min":{"1min":0.307,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70999999999999996,"5min":0.81499999999999995,"15min":0.85299999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52600000000000002,"15min":0.53000000000000003},"min":{"1min":0.38300000000000001,"5min":0.34100000000000003,"15min":0.308},"max":{"1min":0.71299999999999997,"5min":0.73999999999999999,"15min":0.80700000000000005},"last":0.40899999999999997}]},{"osd":2,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52100000000000002,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.82099999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57099999999999995,"15min":0.57399999999999995},"min":{"1min":0.44800000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.79800000000000004,"5min":0.81200000000000006,"15min":0.91200000000000003},"last":0.49399999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.53200000000000003},"min":{"1min":0.35899999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.745,"5min":0.77000000000000002,"15min":0.80100000000000005},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.435,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.78400000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.64900000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0329999999999999,"5min":1.157,"15min":1.284},"last":0.629},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.84199999999999997,"15min":0.83799999999999997},"min":{"1min":0.63500000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0820000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.81299999999999994,"15min":0.83299999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.56699999999999995},"max":{"1min":1.1160000000000001,"5min":1.28,"15min":1.294},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85199999999999998,"15min":0.85299999999999998},"min":{"1min":0.69899999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0249999999999999,"5min":1.472,"15min":1.472},"last":0.66700000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83499999999999996,"15min":0.84299999999999997},"min":{"1min":0.65700000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.236,"5min":1.639,"15min":1.639},"last":0.877},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.85999999999999999,"15min":0.86299999999999999},"min":{"1min":0.64200000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.002,"5min":1.544,"15min":1.544},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86899999999999999,"15min":0.85799999999999998},"min":{"1min":0.621,"5min":0.621,"15min":0.55500000000000005},"max":{"1min":1.0640000000000001,"5min":1.236,"15min":1.3200000000000001},"last":0.748},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84899999999999998,"15min":0.85999999999999999},"min":{"1min":0.63100000000000001,"5min":0.57599999999999996,"15min":0.57499999999999996},"max":{"1min":1.202,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.56299999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:32:59.978 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-14T13:32:59.979 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:33:00.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.127+0000 7f010f911640 1 Processor -- start 2023-07-14T13:33:00.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.127+0000 7f010f911640 1 -- start start 2023-07-14T13:33:00.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.127+0000 7f010f911640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f010815fd60 0x7f01080d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:00.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.127+0000 7f010f911640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01080ccaf0 con 0x7f01080b7c70 2023-07-14T13:33:00.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.127+0000 7f010f911640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0108160320 con 0x7f01080d1850 2023-07-14T13:33:00.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.127+0000 7f010f911640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01080d1190 con 0x7f010815fd60 2023-07-14T13:33:00.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.127+0000 7f010d6ad640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f01080b7c70 0x7f010815f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35322/0 (socket says 172.21.15.5:35322) 2023-07-14T13:33:00.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.127+0000 7f010d6ad640 1 -- 172.21.15.5:0/2980544016 learned_addr learned my addr 172.21.15.5:0/2980544016 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:33:00.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.127+0000 7f010ceac640 1 --2- 172.21.15.5:0/2980544016 >> v2:172.21.15.5:3300/0 conn(0x7f010815fd60 0x7f01080d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:00.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.127+0000 7f010ceac640 1 -- 172.21.15.5:0/2980544016 >> v1:172.21.15.154:6789/0 conn(0x7f01080d1850 legacy=0x7f01080d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:00.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.127+0000 7f010ceac640 1 -- 172.21.15.5:0/2980544016 >> v1:172.21.15.5:6789/0 conn(0x7f01080b7c70 legacy=0x7f010815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:00.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.127+0000 7f010ceac640 1 -- 172.21.15.5:0/2980544016 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01080ccd90 con 0x7f010815fd60 2023-07-14T13:33:00.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.127+0000 7f00fffff640 1 -- 172.21.15.5:0/2980544016 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3614134420 0 0) 0x7f01080ccaf0 con 0x7f01080b7c70 2023-07-14T13:33:00.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.131+0000 7f010ceac640 1 --2- 172.21.15.5:0/2980544016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f010815fd60 0x7f01080d0c50 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f00f80097c0 tx=0x7f00f801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2799cdb5a6ba02e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:00.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.131+0000 7f00fffff640 1 -- 172.21.15.5:0/2980544016 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8004230 con 0x7f010815fd60 2023-07-14T13:33:00.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.131+0000 7f00fffff640 1 -- 172.21.15.5:0/2980544016 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f80a7050 con 0x7f010815fd60 2023-07-14T13:33:00.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.131+0000 7f00fffff640 1 -- 172.21.15.5:0/2980544016 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8003620 con 0x7f010815fd60 2023-07-14T13:33:00.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.131+0000 7f010f911640 1 -- 172.21.15.5:0/2980544016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f010815fd60 msgr2=0x7f01080d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:00.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.131+0000 7f010f911640 1 --2- 172.21.15.5:0/2980544016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f010815fd60 0x7f01080d0c50 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f00f80097c0 tx=0x7f00f801c440 comp rx=0 tx=0).stop 2023-07-14T13:33:00.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.131+0000 7f010f911640 1 -- 172.21.15.5:0/2980544016 shutdown_connections 2023-07-14T13:33:00.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.131+0000 7f010f911640 1 --2- 172.21.15.5:0/2980544016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f010815fd60 0x7f01080d0c50 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:00.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.131+0000 7f010f911640 1 -- 172.21.15.5:0/2980544016 >> 172.21.15.5:0/2980544016 conn(0x7f01080650b0 msgr2=0x7f01080654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:00.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.131+0000 7f010f911640 1 -- 172.21.15.5:0/2980544016 shutdown_connections 2023-07-14T13:33:00.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.131+0000 7f010f911640 1 -- 172.21.15.5:0/2980544016 wait complete. 2023-07-14T13:33:00.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.135+0000 7f010f911640 1 Processor -- start 2023-07-14T13:33:00.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.135+0000 7f010f911640 1 -- start start 2023-07-14T13:33:00.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.135+0000 7f010f911640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01080b7c70 0x7f010815d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:00.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.135+0000 7f010f911640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01080d1850 0x7f01080c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:00.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.135+0000 7f010f911640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f010815fd60 0x7f0108157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:00.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.135+0000 7f010f911640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010815db70 con 0x7f01080d1850 2023-07-14T13:33:00.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.135+0000 7f010f911640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01080c5e30 con 0x7f01080b7c70 2023-07-14T13:33:00.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.135+0000 7f010f911640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01080c8580 con 0x7f010815fd60 2023-07-14T13:33:00.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.135+0000 7f010d6ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01080b7c70 0x7f010815d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:00.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.135+0000 7f010ceac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01080d1850 0x7f01080c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:00.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.135+0000 7f010d6ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01080b7c70 0x7f010815d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.5:54070/0 (socket says 172.21.15.5:54070) 2023-07-14T13:33:00.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.135+0000 7f010d6ad640 1 -- 172.21.15.5:0/4230768385 learned_addr learned my addr 172.21.15.5:0/4230768385 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:00.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.135+0000 7f010deae640 1 --2- 172.21.15.5:0/4230768385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f010815fd60 0x7f0108157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:00.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.135+0000 7f010ceac640 1 -- 172.21.15.5:0/4230768385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f010815fd60 msgr2=0x7f0108157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:00.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.135+0000 7f010ceac640 1 --2- 172.21.15.5:0/4230768385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f010815fd60 0x7f0108157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:00.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.135+0000 7f010ceac640 1 -- 172.21.15.5:0/4230768385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01080b7c70 msgr2=0x7f010815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:00.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.135+0000 7f010ceac640 1 --2- 172.21.15.5:0/4230768385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01080b7c70 0x7f010815d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:00.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.135+0000 7f010ceac640 1 -- 172.21.15.5:0/4230768385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f8009420 con 0x7f01080d1850 2023-07-14T13:33:00.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.135+0000 7f010ceac640 1 --2- 172.21.15.5:0/4230768385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01080d1850 0x7f01080c8040 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f00f8004000 tx=0x7f00f80191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:00.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.135+0000 7f00fdffb640 1 -- 172.21.15.5:0/4230768385 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f80be070 con 0x7f01080d1850 2023-07-14T13:33:00.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.135+0000 7f00fdffb640 1 -- 172.21.15.5:0/4230768385 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f8003d20 con 0x7f01080d1850 2023-07-14T13:33:00.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.135+0000 7f00fdffb640 1 -- 172.21.15.5:0/4230768385 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f80b66c0 con 0x7f01080d1850 2023-07-14T13:33:00.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.135+0000 7f010f911640 1 -- 172.21.15.5:0/4230768385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0108157660 con 0x7f01080d1850 2023-07-14T13:33:00.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.139+0000 7f010f911640 1 -- 172.21.15.5:0/4230768385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0108157bf0 con 0x7f01080d1850 2023-07-14T13:33:00.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.139+0000 7f010f911640 1 -- 172.21.15.5:0/4230768385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0108157de0 con 0x7f01080d1850 2023-07-14T13:33:00.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.139+0000 7f00fdffb640 1 -- 172.21.15.5:0/4230768385 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f00f80b2040 con 0x7f01080d1850 2023-07-14T13:33:00.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.139+0000 7f00fdffb640 1 --2- 172.21.15.5:0/4230768385 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f00ec0663a0 0x7f00ec068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:00.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.139+0000 7f00fdffb640 1 -- 172.21.15.5:0/4230768385 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7f00f811dee0 con 0x7f01080d1850 2023-07-14T13:33:00.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.139+0000 7f010d6ad640 1 --2- 172.21.15.5:0/4230768385 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f00ec0663a0 0x7f00ec068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:00.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.143+0000 7f010d6ad640 1 --2- 172.21.15.5:0/4230768385 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f00ec0663a0 0x7f00ec068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0104000f70 tx=0x7f0104007eb0 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:00.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.143+0000 7f00fdffb640 1 -- 172.21.15.5:0/4230768385 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f0108157de0 con 0x7f01080d1850 2023-07-14T13:33:00.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.295+0000 7f010f911640 1 -- 172.21.15.5:0/4230768385 --> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0108157de0 con 0x7f00ec0663a0 2023-07-14T13:33:00.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.299+0000 7f00fdffb640 1 -- 172.21.15.5:0/4230768385 <== mgr.10192 v2:172.21.15.154:6832/317858933 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72578 (secure 0 0 0) 0x7f0108157de0 con 0x7f00ec0663a0 2023-07-14T13:33:00.298 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:33:00.298 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:33:00.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.303+0000 7f010f911640 1 -- 172.21.15.5:0/4230768385 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f00ec0663a0 msgr2=0x7f00ec068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:00.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.303+0000 7f010f911640 1 --2- 172.21.15.5:0/4230768385 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f00ec0663a0 0x7f00ec068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0104000f70 tx=0x7f0104007eb0 comp rx=0 tx=0).stop 2023-07-14T13:33:00.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.303+0000 7f010f911640 1 -- 172.21.15.5:0/4230768385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01080d1850 msgr2=0x7f01080c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:00.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.303+0000 7f010f911640 1 --2- 172.21.15.5:0/4230768385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01080d1850 0x7f01080c8040 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f00f8004000 tx=0x7f00f80191e0 comp rx=0 tx=0).stop 2023-07-14T13:33:00.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.303+0000 7f010f911640 1 -- 172.21.15.5:0/4230768385 shutdown_connections 2023-07-14T13:33:00.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.303+0000 7f010f911640 1 --2- 172.21.15.5:0/4230768385 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f00ec0663a0 0x7f00ec068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:00.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.303+0000 7f010f911640 1 --2- 172.21.15.5:0/4230768385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f010815fd60 0x7f0108157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:00.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.303+0000 7f010f911640 1 --2- 172.21.15.5:0/4230768385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01080d1850 0x7f01080c8040 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:00.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.303+0000 7f010f911640 1 --2- 172.21.15.5:0/4230768385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01080b7c70 0x7f010815d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:00.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.303+0000 7f010f911640 1 -- 172.21.15.5:0/4230768385 >> 172.21.15.5:0/4230768385 conn(0x7f01080650b0 msgr2=0x7f01080b7270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:00.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.303+0000 7f010f911640 1 -- 172.21.15.5:0/4230768385 shutdown_connections 2023-07-14T13:33:00.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.303+0000 7f010f911640 1 -- 172.21.15.5:0/4230768385 wait complete. 2023-07-14T13:33:00.318 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2023-07-14T13:32:59.883828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":376948,"kb_used_data":21172,"kb_used_omap":0,"kb_used_meta":355712,"kb_avail":754597772,"statfs":{"total":773094113280,"available":772708118528,"internally_reserved":0,"allocated":21680128,"data_stored":12208528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":364249088},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-668216,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-317,"num_read_kb":-281,"num_write":-281,"num_write_kb":-2054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.782382"},"pg_stats":[{"pgid":"1.0","version":"193'348","reported_seq":1309,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-07-14T13:32:55.273082+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:32:55.273082+0000","last_peered":"2023-07-14T13:32:55.273082+0000","last_clean":"2023-07-14T13:32:55.273082+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:32:55.273082+0000","last_undegraded":"2023-07-14T13:32:55.273082+0000","last_fullsized":"2023-07-14T13:32:55.273082+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:59:47.875694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":330,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-07-14T13:32:55.289086+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:32:55.289086+0000","last_peered":"2023-07-14T13:32:55.289086+0000","last_clean":"2023-07-14T13:32:55.289086+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:32:55.289086+0000","last_undegraded":"2023-07-14T13:32:55.289086+0000","last_fullsized":"2023-07-14T13:32:55.289086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:09:35.427380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":334,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-07-14T13:32:55.272942+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:32:55.272942+0000","last_peered":"2023-07-14T13:32:55.272942+0000","last_clean":"2023-07-14T13:32:55.272942+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:32:55.272942+0000","last_undegraded":"2023-07-14T13:32:55.272942+0000","last_fullsized":"2023-07-14T13:32:55.272942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:38:53.036556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":334,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-14T13:32:53.124355+0000","last_change":"2023-07-14T12:52:41.040790+0000","last_active":"2023-07-14T13:32:53.124355+0000","last_peered":"2023-07-14T13:32:53.124355+0000","last_clean":"2023-07-14T13:32:53.124355+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:32:53.124355+0000","last_undegraded":"2023-07-14T13:32:53.124355+0000","last_fullsized":"2023-07-14T13:32:53.124355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:53:58.790201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":330,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-07-14T13:32:55.288815+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:32:55.288815+0000","last_peered":"2023-07-14T13:32:55.288815+0000","last_clean":"2023-07-14T13:32:55.288815+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:32:55.288815+0000","last_undegraded":"2023-07-14T13:32:55.288815+0000","last_fullsized":"2023-07-14T13:32:55.288815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:43:48.541992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":340,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-14T13:32:53.099343+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:32:53.099343+0000","last_peered":"2023-07-14T13:32:53.099343+0000","last_clean":"2023-07-14T13:32:53.099343+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:32:53.099343+0000","last_undegraded":"2023-07-14T13:32:53.099343+0000","last_fullsized":"2023-07-14T13:32:53.099343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:01:14.537216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":332,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-07-14T13:32:55.272990+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:32:55.272990+0000","last_peered":"2023-07-14T13:32:55.272990+0000","last_clean":"2023-07-14T13:32:55.272990+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:32:55.272990+0000","last_undegraded":"2023-07-14T13:32:55.272990+0000","last_fullsized":"2023-07-14T13:32:55.272990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:07:14.250168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":339,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-14T13:32:53.099559+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:32:53.099559+0000","last_peered":"2023-07-14T13:32:53.099559+0000","last_clean":"2023-07-14T13:32:53.099559+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:32:53.099559+0000","last_undegraded":"2023-07-14T13:32:53.099559+0000","last_fullsized":"2023-07-14T13:32:53.099559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:13:01.794741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":333,"reported_epoch":195,"state":"active+clean","last_fresh":"2023-07-14T13:32:55.414232+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:32:55.414232+0000","last_peered":"2023-07-14T13:32:55.414232+0000","last_clean":"2023-07-14T13:32:55.414232+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:32:55.414232+0000","last_undegraded":"2023-07-14T13:32:55.414232+0000","last_fullsized":"2023-07-14T13:32:55.414232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:50:21.018632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575326,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60252,"kb_used_data":2964,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94311588,"statfs":{"total":96636764160,"available":96575066112,"internally_reserved":0,"allocated":3035136,"data_stored":1848421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.747,"15min":0.73999999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0449999999999999,"5min":1.208,"15min":1.208},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73699999999999999,"15min":0.74199999999999999},"min":{"1min":0.52700000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88,"5min":1.042,"15min":1.042},"last":0.64000000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.746,"15min":0.75800000000000001},"min":{"1min":0.51000000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.0820000000000001,"5min":1.444,"15min":1.444},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.76900000000000002,"15min":0.76300000000000001},"min":{"1min":0.48199999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.98599999999999999,"5min":1.534,"15min":1.534},"last":0.78400000000000003}]},{"osd":2,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.72899999999999998,"15min":0.73799999999999999},"min":{"1min":0.52800000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.90500000000000003,"5min":1.1120000000000001,"15min":1.1379999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.77400000000000002,"15min":0.77000000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0549999999999999,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.56599999999999995}]},{"osd":3,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.878,"5min":1.498,"15min":1.498},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78800000000000003,"15min":0.78300000000000003},"min":{"1min":0.51600000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0209999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.85599999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.47399999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.95399999999999996,"5min":1.0129999999999999,"15min":1.0620000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.627,"15min":0.624},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91700000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.73699999999999999}]},{"osd":5,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64400000000000002,"15min":0.61799999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41499999999999998},"max":{"1min":0.88100000000000001,"5min":1.145,"15min":1.145},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66100000000000003,"15min":0.65200000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0169999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.83499999999999996}]},{"osd":6,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72999999999999998,"15min":0.71599999999999997},"min":{"1min":0.50800000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.046,"5min":1.0700000000000001,"15min":1.0940000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.70799999999999996,"15min":0.69199999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.41999999999999998},"max":{"1min":1.0029999999999999,"5min":1.089,"15min":1.089},"last":0.80000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575327,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37512,"kb_used_data":2368,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334328,"statfs":{"total":96636764160,"available":96598351872,"internally_reserved":0,"allocated":2424832,"data_stored":1250938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.53500000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.98299999999999998,"5min":1.026,"15min":1.026},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.755,"15min":0.753},"min":{"1min":0.55600000000000005,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.012,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.81200000000000006}]},{"osd":1,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.59799999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.044,"5min":1.044,"15min":1.3300000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.746,"15min":0.746},"min":{"1min":0.57299999999999995,"5min":0.51900000000000002,"15min":0.47499999999999998},"max":{"1min":0.996,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.871}]},{"osd":2,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78000000000000003,"15min":0.78900000000000003},"min":{"1min":0.58599999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0740000000000001,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77200000000000002,"15min":0.76400000000000001},"min":{"1min":0.61799999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96799999999999997,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.78900000000000003}]},{"osd":3,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.77600000000000002,"15min":0.78100000000000003},"min":{"1min":0.59399999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.073,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76100000000000001,"15min":0.76700000000000002},"min":{"1min":0.56100000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.999,"5min":1.0249999999999999,"15min":1.2569999999999999},"last":0.77500000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57699999999999996,"15min":0.56799999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.36099999999999999},"max":{"1min":0.78200000000000003,"5min":1.02,"15min":1.175},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.626,"15min":0.61099999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.36799999999999999},"max":{"1min":0.755,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.51300000000000001}]},{"osd":5,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64700000000000002,"15min":0.63300000000000001},"min":{"1min":0.41899999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94499999999999995,"5min":1.0049999999999999,"15min":1.0860000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68500000000000005,"15min":0.67300000000000004},"min":{"1min":0.50900000000000001,"5min":0.46400000000000002,"15min":0.41699999999999998},"max":{"1min":0.878,"5min":1.0640000000000001,"15min":1.3180000000000001},"last":0.57899999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.64700000000000002,"15min":0.64300000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.42899999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":1.0269999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71599999999999997,"15min":0.70499999999999996},"min":{"1min":0.52600000000000002,"5min":0.49299999999999999,"15min":0.46200000000000002},"max":{"1min":0.92900000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.628}]}]},{"osd":5,"up_from":13,"seq":55834575326,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55572,"kb_used_data":2380,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316268,"statfs":{"total":96636764160,"available":96579858432,"internally_reserved":0,"allocated":2437120,"data_stored":1251163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71899999999999997,"15min":0.73699999999999999},"min":{"1min":0.46700000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.91200000000000003,"5min":1.0600000000000001,"15min":1.8},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.73099999999999998,"15min":0.754},"min":{"1min":0.443,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.88200000000000001,"5min":1.0369999999999999,"15min":1.8700000000000001},"last":0.60299999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.71999999999999997,"15min":0.74399999999999999},"min":{"1min":0.41099999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.85799999999999998,"5min":1.008,"15min":1.835},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.751,"15min":0.76100000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90800000000000003,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.63600000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.73699999999999999,"15min":0.79800000000000004},"min":{"1min":0.48899999999999999,"5min":0.45700000000000002,"15min":0.434},"max":{"1min":0.80900000000000005,"5min":1.2130000000000001,"15min":16.774000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.73699999999999999,"15min":0.80200000000000005},"min":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.85599999999999998,"5min":1.0449999999999999,"15min":16.751999999999999},"last":0.79200000000000004}]},{"osd":3,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.73999999999999999,"15min":0.76400000000000001},"min":{"1min":0.44,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86699999999999999,"5min":1.0209999999999999,"15min":1.115},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.76900000000000002,"15min":0.82799999999999996},"min":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95699999999999996,"5min":1.1140000000000001,"15min":16.731000000000002},"last":0.83799999999999997}]},{"osd":4,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.436,"5min":0.40400000000000003,"15min":0.38},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.72199999999999998,"15min":0.71399999999999997},"min":{"1min":0.40799999999999997,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":0.874,"5min":1.248,"15min":1.248},"last":0.82099999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.622,"15min":0.623},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.34999999999999998},"max":{"1min":0.77500000000000002,"5min":1.157,"15min":1.3100000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.65800000000000003,"15min":0.65100000000000002},"min":{"1min":0.46300000000000002,"5min":0.45400000000000001,"15min":0.42799999999999999},"max":{"1min":0.93200000000000005,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.89500000000000002}]},{"osd":7,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.66300000000000003,"15min":0.65800000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.86599999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.872},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.71099999999999997,"15min":0.69699999999999995},"min":{"1min":0.52900000000000003,"5min":0.433,"15min":0.40000000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.748}]}]},{"osd":4,"up_from":13,"seq":55834575326,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37852,"kb_used_data":2708,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333988,"statfs":{"total":96636764160,"available":96598003712,"internally_reserved":0,"allocated":2772992,"data_stored":1579934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.74299999999999999,"15min":0.75900000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.38100000000000001},"max":{"1min":0.98299999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.72899999999999998,"15min":0.752},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82299999999999995,"5min":0.94699999999999995,"15min":1.278},"last":0.84199999999999997}]},{"osd":1,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.751,"15min":0.77000000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.89500000000000002,"5min":1.0369999999999999,"15min":1.306},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.74199999999999999,"15min":0.74299999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.47599999999999998},"max":{"1min":0.91800000000000004,"5min":1.024,"15min":1.177},"last":0.94699999999999995}]},{"osd":2,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.73999999999999999,"15min":0.76300000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.79100000000000004,"5min":0.92600000000000005,"15min":1.137},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.76900000000000002,"15min":0.77400000000000002},"min":{"1min":0.53400000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94899999999999995,"5min":1,"15min":1},"last":0.81100000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74199999999999999,"15min":0.76200000000000001},"min":{"1min":0.53100000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.95899999999999996,"5min":0.96899999999999997,"15min":1.222},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.76400000000000001,"15min":0.77400000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.496},"max":{"1min":0.91900000000000004,"5min":1.018,"15min":1.1970000000000001},"last":0.85099999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40000000000000002},"max":{"1min":0.93600000000000005,"5min":0.94099999999999995,"15min":0.97799999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.625,"15min":0.61199999999999999},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.378},"max":{"1min":0.90300000000000002,"5min":0.96099999999999997,"15min":0.96799999999999997},"last":0.58099999999999996}]},{"osd":6,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.42499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.89200000000000002,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66600000000000004,"15min":0.66700000000000004},"min":{"1min":0.48499999999999999,"5min":0.47199999999999998,"15min":0.42699999999999999},"max":{"1min":0.96599999999999997,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.71299999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.44800000000000001,"5min":0.436,"15min":0.435},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.69599999999999995},"min":{"1min":0.50800000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0289999999999999,"5min":1.127,"15min":1.127},"last":0.60099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575326,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41956,"kb_used_data":2716,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329884,"statfs":{"total":96636764160,"available":96593801216,"internally_reserved":0,"allocated":2781184,"data_stored":1590627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.45300000000000001,"15min":0.46100000000000002},"min":{"1min":0.309,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68600000000000005,"5min":0.73799999999999999,"15min":0.92900000000000005},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.504,"15min":0.51800000000000002},"min":{"1min":0.372,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.752,"5min":0.77600000000000002,"15min":0.86599999999999999},"last":0.46700000000000003}]},{"osd":1,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.48599999999999999,"15min":0.48299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65700000000000003,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54600000000000004,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71799999999999997,"5min":0.82199999999999995,"15min":0.85099999999999998},"last":0.52200000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.40699999999999997,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.68999999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59899999999999998,"15min":0.61199999999999999},"min":{"1min":0.45500000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77300000000000002,"5min":0.86099999999999999,"15min":0.88100000000000001},"last":0.59999999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71799999999999997,"15min":0.77000000000000002},"min":{"1min":0.53000000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.92700000000000005,"5min":1.0680000000000001,"15min":1.2529999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76100000000000001,"15min":0.79000000000000004},"min":{"1min":0.52000000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90900000000000003,"5min":1,"15min":1.4359999999999999},"last":0.81000000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.77000000000000002,"15min":0.81200000000000006},"min":{"1min":0.55400000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94999999999999996,"5min":1.069,"15min":1.3959999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.77800000000000002,"15min":0.80100000000000005},"min":{"1min":0.56699999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98999999999999999,"5min":1.1220000000000001,"15min":1.4970000000000001},"last":0.86099999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.77200000000000002,"15min":0.79500000000000004},"min":{"1min":0.56899999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.91700000000000004,"5min":1.1910000000000001,"15min":1.383},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.80300000000000005,"15min":0.82799999999999996},"min":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.92600000000000005,"5min":1.1439999999999999,"15min":1.3520000000000001},"last":0.95399999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.82799999999999996,"15min":0.85399999999999998},"min":{"1min":0.61399999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.97399999999999998,"5min":1.171,"15min":1.5449999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.79700000000000004,"15min":0.82999999999999996},"min":{"1min":0.58799999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.996,"5min":1.1579999999999999,"15min":1.4650000000000001},"last":0.97399999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575326,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59656,"kb_used_data":2368,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312184,"statfs":{"total":96636764160,"available":96575676416,"internally_reserved":0,"allocated":2424832,"data_stored":1250020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46400000000000002,"15min":0.46500000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.746,"5min":0.75900000000000001,"15min":0.79800000000000004},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.50700000000000001,"15min":0.52600000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65500000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.34399999999999997}]},{"osd":1,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.48099999999999998,"15min":0.46999999999999997},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70999999999999996,"5min":0.80600000000000005,"15min":0.84799999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.55700000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93799999999999994},"last":0.58699999999999997}]},{"osd":3,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.71599999999999997,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.433},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.35999999999999999},"max":{"1min":0.70299999999999996,"5min":0.77300000000000002,"15min":0.81999999999999995},"last":0.46200000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.51300000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1619999999999999,"5min":1.222,"15min":1.222},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80600000000000005,"15min":0.81699999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0589999999999999,"5min":1.298,"15min":1.3029999999999999},"last":0.67700000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.87,"15min":0.86599999999999999},"min":{"1min":0.59999999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.129,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.101,"5min":1.329,"15min":1.329},"last":0.82299999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.82499999999999996,"15min":0.82899999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.196,"5min":1.196,"15min":1.446},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.266},"last":0.79800000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.85799999999999998,"15min":0.84599999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.228,"5min":2.306,"15min":2.306},"last":0.752},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.85699999999999998,"15min":0.85299999999999998},"min":{"1min":0.627,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.282,"5min":1.282,"15min":1.371},"last":0.68400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575327,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41948,"kb_used_data":2708,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329892,"statfs":{"total":96636764160,"available":96593809408,"internally_reserved":0,"allocated":2772992,"data_stored":1590023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.46300000000000002},"min":{"1min":0.33200000000000002,"5min":0.316,"15min":0.28499999999999998},"max":{"1min":0.64400000000000002,"5min":0.76600000000000001,"15min":0.81599999999999995},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51300000000000001,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.32500000000000001,"15min":0.30199999999999999},"max":{"1min":0.80200000000000005,"5min":0.80300000000000005,"15min":0.81299999999999994},"last":0.41399999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.34699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69599999999999995,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54100000000000004,"15min":0.53600000000000003},"min":{"1min":0.42899999999999999,"5min":0.373,"15min":0.32800000000000001},"max":{"1min":0.71799999999999997,"5min":0.83399999999999996,"15min":0.89200000000000002},"last":0.441}]},{"osd":3,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.52100000000000002,"5min":0.501,"15min":0.42299999999999999},"max":{"1min":0.747,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57299999999999995,"15min":0.58699999999999997},"min":{"1min":0.41199999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80800000000000005,"5min":0.86899999999999999,"15min":0.90300000000000002},"last":0.45900000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79800000000000004,"15min":0.80900000000000005},"min":{"1min":0.56699999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1519999999999999,"5min":1.155,"15min":1.2470000000000001},"last":0.751},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81699999999999995,"15min":0.82499999999999996},"min":{"1min":0.61599999999999999,"5min":0.56100000000000005,"15min":0.497},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.81599999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.81699999999999995,"15min":0.82199999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1850000000000001,"5min":1.224,"15min":1.224},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.82399999999999995,"15min":0.83199999999999996},"min":{"1min":0.62,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0920000000000001,"5min":1.2010000000000001,"15min":1.202},"last":0.69199999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.82199999999999995,"15min":0.82899999999999996},"min":{"1min":0.623,"5min":0.60399999999999998,"15min":0.57799999999999996},"max":{"1min":1.0529999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.83499999999999996,"15min":0.85299999999999998},"min":{"1min":0.64800000000000002,"5min":0.60599999999999998,"15min":0.56399999999999995},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.83899999999999997}]},{"osd":7,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.81799999999999995},"min":{"1min":0.63500000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.129,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.875,"5min":0.877,"15min":0.877},"min":{"1min":0.65600000000000003,"5min":0.60499999999999998,"15min":0.58899999999999997},"max":{"1min":1.2569999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.92300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575328,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42200,"kb_used_data":2960,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329640,"statfs":{"total":96636764160,"available":96593551360,"internally_reserved":0,"allocated":3031040,"data_stored":1847402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.45900000000000002,"15min":0.47899999999999998},"min":{"1min":0.307,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70999999999999996,"5min":0.81499999999999995,"15min":0.85299999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52600000000000002,"15min":0.53000000000000003},"min":{"1min":0.38300000000000001,"5min":0.34100000000000003,"15min":0.308},"max":{"1min":0.71299999999999997,"5min":0.73999999999999999,"15min":0.80700000000000005},"last":0.40899999999999997}]},{"osd":2,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52100000000000002,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.82099999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57099999999999995,"15min":0.57399999999999995},"min":{"1min":0.44800000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.79800000000000004,"5min":0.81200000000000006,"15min":0.91200000000000003},"last":0.49399999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.53200000000000003},"min":{"1min":0.35899999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.745,"5min":0.77000000000000002,"15min":0.80100000000000005},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.435,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.78400000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.64900000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0329999999999999,"5min":1.157,"15min":1.284},"last":0.629},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.84199999999999997,"15min":0.83799999999999997},"min":{"1min":0.63500000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0820000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.81299999999999994,"15min":0.83299999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.56699999999999995},"max":{"1min":1.1160000000000001,"5min":1.28,"15min":1.294},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85199999999999998,"15min":0.85299999999999998},"min":{"1min":0.69899999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0249999999999999,"5min":1.472,"15min":1.472},"last":0.66700000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83499999999999996,"15min":0.84299999999999997},"min":{"1min":0.65700000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.236,"5min":1.639,"15min":1.639},"last":0.877},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.85999999999999999,"15min":0.86299999999999999},"min":{"1min":0.64200000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.002,"5min":1.544,"15min":1.544},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Jul 14 13:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86899999999999999,"15min":0.85799999999999998},"min":{"1min":0.621,"5min":0.621,"15min":0.55500000000000005},"max":{"1min":1.0640000000000001,"5min":1.236,"15min":1.3200000000000001},"last":0.748},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84899999999999998,"15min":0.85999999999999999},"min":{"1min":0.63100000000000001,"5min":0.57599999999999996,"15min":0.57499999999999996},"max":{"1min":1.202,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.56299999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:33:00.321 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:33:00.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.467+0000 7eff8a974640 1 Processor -- start 2023-07-14T13:33:00.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.467+0000 7eff8a974640 1 -- start start 2023-07-14T13:33:00.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.467+0000 7eff8a974640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7eff840b7c70 0x7eff840d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:00.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.467+0000 7eff8a974640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff840d1850 0x7eff8415f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:00.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.467+0000 7eff8a974640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7eff840d1300 0x7eff8415fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:00.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.467+0000 7eff8a974640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff840d1190 con 0x7eff840d1300 2023-07-14T13:33:00.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.467+0000 7eff8a974640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff84160600 con 0x7eff840b7c70 2023-07-14T13:33:00.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.467+0000 7eff8a974640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff841600d0 con 0x7eff840d1850 2023-07-14T13:33:00.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.467+0000 7eff88f11640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7eff840d1300 0x7eff8415fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.467+0000 7eff88f11640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7eff840d1300 0x7eff8415fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55212/0 (socket says 172.21.15.5:55212) 2023-07-14T13:33:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.467+0000 7eff88f11640 1 -- 172.21.15.5:0/3041929032 learned_addr learned my addr 172.21.15.5:0/3041929032 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:00.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.467+0000 7eff88f11640 1 -- 172.21.15.5:0/3041929032 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff840d1850 msgr2=0x7eff8415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:00.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.467+0000 7eff88f11640 1 --2- 172.21.15.5:0/3041929032 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff840d1850 0x7eff8415f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:00.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.467+0000 7eff88f11640 1 -- 172.21.15.5:0/3041929032 >> v2:172.21.15.154:3300/0 conn(0x7eff840b7c70 msgr2=0x7eff840d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:00.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.467+0000 7eff83fff640 1 --2- 172.21.15.5:0/3041929032 >> v2:172.21.15.154:3300/0 conn(0x7eff840b7c70 0x7eff840d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:00.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.467+0000 7eff88f11640 1 --2- 172.21.15.5:0/3041929032 >> v2:172.21.15.154:3300/0 conn(0x7eff840b7c70 0x7eff840d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:00.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.467+0000 7eff88f11640 1 -- 172.21.15.5:0/3041929032 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff840ccaf0 con 0x7eff840d1300 2023-07-14T13:33:00.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.467+0000 7eff83fff640 1 --2- 172.21.15.5:0/3041929032 >> v2:172.21.15.154:3300/0 conn(0x7eff840b7c70 0x7eff840d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:33:00.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.471+0000 7eff88f11640 1 --2- 172.21.15.5:0/3041929032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff840d1300 0x7eff8415fb90 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7eff840b40a0 tx=0x7eff7c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9f0c2c09366481 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:00.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.471+0000 7eff82ffd640 1 -- 172.21.15.5:0/3041929032 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c0a5730 con 0x7eff840d1300 2023-07-14T13:33:00.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.471+0000 7eff82ffd640 1 -- 172.21.15.5:0/3041929032 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7c0a5890 con 0x7eff840d1300 2023-07-14T13:33:00.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.471+0000 7eff82ffd640 1 -- 172.21.15.5:0/3041929032 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c0a5c20 con 0x7eff840d1300 2023-07-14T13:33:00.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.471+0000 7eff8a974640 1 -- 172.21.15.5:0/3041929032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff840d1300 msgr2=0x7eff8415fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:00.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.471+0000 7eff8a974640 1 --2- 172.21.15.5:0/3041929032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff840d1300 0x7eff8415fb90 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7eff840b40a0 tx=0x7eff7c01c9a0 comp rx=0 tx=0).stop 2023-07-14T13:33:00.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.471+0000 7eff8a974640 1 -- 172.21.15.5:0/3041929032 shutdown_connections 2023-07-14T13:33:00.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.471+0000 7eff8a974640 1 --2- 172.21.15.5:0/3041929032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff840d1300 0x7eff8415fb90 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:00.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.471+0000 7eff8a974640 1 --2- 172.21.15.5:0/3041929032 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff840d1850 0x7eff8415f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:00.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.471+0000 7eff8a974640 1 --2- 172.21.15.5:0/3041929032 >> v2:172.21.15.154:3300/0 conn(0x7eff840b7c70 0x7eff840d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:00.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.471+0000 7eff8a974640 1 -- 172.21.15.5:0/3041929032 >> 172.21.15.5:0/3041929032 conn(0x7eff840650b0 msgr2=0x7eff840654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:00.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.471+0000 7eff8a974640 1 -- 172.21.15.5:0/3041929032 shutdown_connections 2023-07-14T13:33:00.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.471+0000 7eff8a974640 1 -- 172.21.15.5:0/3041929032 wait complete. 2023-07-14T13:33:00.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.475+0000 7eff8a974640 1 Processor -- start 2023-07-14T13:33:00.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.475+0000 7eff8a974640 1 -- start start 2023-07-14T13:33:00.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.475+0000 7eff8a974640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff840b7c70 0x7eff841564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:00.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.475+0000 7eff8a974640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff840d1300 0x7eff840c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:00.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.475+0000 7eff8a974640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff840d1850 0x7eff8415da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:00.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.475+0000 7eff8a974640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff840c74c0 con 0x7eff840d1300 2023-07-14T13:33:00.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.475+0000 7eff8a974640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff840c68b0 con 0x7eff840b7c70 2023-07-14T13:33:00.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.475+0000 7eff8a974640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff840c6b90 con 0x7eff840d1850 2023-07-14T13:33:00.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.475+0000 7eff837fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff840d1300 0x7eff840c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:00.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.475+0000 7eff837fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff840d1300 0x7eff840c5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55228/0 (socket says 172.21.15.5:55228) 2023-07-14T13:33:00.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.475+0000 7eff837fe640 1 -- 172.21.15.5:0/3737289483 learned_addr learned my addr 172.21.15.5:0/3737289483 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:00.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.475+0000 7eff83fff640 1 --2- 172.21.15.5:0/3737289483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff840b7c70 0x7eff841564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:00.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.475+0000 7eff88f11640 1 --2- 172.21.15.5:0/3737289483 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff840d1850 0x7eff8415da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:00.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.475+0000 7eff837fe640 1 -- 172.21.15.5:0/3737289483 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff840d1850 msgr2=0x7eff8415da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:00.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.475+0000 7eff837fe640 1 --2- 172.21.15.5:0/3737289483 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff840d1850 0x7eff8415da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:00.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.475+0000 7eff837fe640 1 -- 172.21.15.5:0/3737289483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff840b7c70 msgr2=0x7eff841564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:00.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.475+0000 7eff837fe640 1 --2- 172.21.15.5:0/3737289483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff840b7c70 0x7eff841564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:00.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.475+0000 7eff837fe640 1 -- 172.21.15.5:0/3737289483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff7c009b30 con 0x7eff840d1300 2023-07-14T13:33:00.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.475+0000 7eff837fe640 1 --2- 172.21.15.5:0/3737289483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff840d1300 0x7eff840c5e30 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7eff7800b410 tx=0x7eff7800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:00.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.475+0000 7eff80ff9640 1 -- 172.21.15.5:0/3737289483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff78011830 con 0x7eff840d1300 2023-07-14T13:33:00.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.475+0000 7eff80ff9640 1 -- 172.21.15.5:0/3737289483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff78011990 con 0x7eff840d1300 2023-07-14T13:33:00.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.475+0000 7eff80ff9640 1 -- 172.21.15.5:0/3737289483 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff78011d40 con 0x7eff840d1300 2023-07-14T13:33:00.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.475+0000 7eff8a974640 1 -- 172.21.15.5:0/3737289483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff840c6e70 con 0x7eff840d1300 2023-07-14T13:33:00.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.479+0000 7eff8a974640 1 -- 172.21.15.5:0/3737289483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff840c7950 con 0x7eff840d1300 2023-07-14T13:33:00.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.479+0000 7eff8a974640 1 -- 172.21.15.5:0/3737289483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff840c7670 con 0x7eff840d1300 2023-07-14T13:33:00.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.479+0000 7eff80ff9640 1 -- 172.21.15.5:0/3737289483 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7eff7801a400 con 0x7eff840d1300 2023-07-14T13:33:00.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.479+0000 7eff80ff9640 1 --2- 172.21.15.5:0/3737289483 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7eff700663d0 0x7eff70068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:00.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.479+0000 7eff80ff9640 1 -- 172.21.15.5:0/3737289483 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7eff78083eb0 con 0x7eff840d1300 2023-07-14T13:33:00.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.479+0000 7eff83fff640 1 --2- 172.21.15.5:0/3737289483 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7eff700663d0 0x7eff70068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:00.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.483+0000 7eff83fff640 1 --2- 172.21.15.5:0/3737289483 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7eff700663d0 0x7eff70068880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7eff7400ab60 tx=0x7eff74008040 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:00.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.483+0000 7eff80ff9640 1 -- 172.21.15.5:0/3737289483 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7eff840c7670 con 0x7eff840d1300 2023-07-14T13:33:00.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.639+0000 7eff8a974640 1 -- 172.21.15.5:0/3737289483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff840678d0 con 0x7eff840d1300 2023-07-14T13:33:00.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.639+0000 7eff80ff9640 1 -- 172.21.15.5:0/3737289483 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v196) v1 ==== 74+0+15850 (secure 0 0 0) 0x7eff78015020 con 0x7eff840d1300 2023-07-14T13:33:00.639 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:33:00.639 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":196,"fsid":"22affb8d-e389-40f8-a764-dd40eb1759c8","created":"2023-07-14T12:52:20.667012+0000","modified":"2023-07-14T13:32:56.127959+0000","last_up_change":"2023-07-14T12:52:32.520036+0000","last_in_change":"2023-07-14T12:52:23.212067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:33.695213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-14T12:52:39.342125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b5d4170-8039-4c70-a6c2-84b9adc130d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6809","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6811","nonce":3251687665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6813","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6816","nonce":3251687665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6823","nonce":3251687665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3251687665},{"type":"v1","addr":"172.21.15.5:6820","nonce":3251687665}]},"public_addr":"172.21.15.5:6811/3251687665","cluster_addr":"172.21.15.5:6816/3251687665","heartbeat_back_addr":"172.21.15.5:6823/3251687665","heartbeat_front_addr":"172.21.15.5:6820/3251687665","state":["exists","up"]},{"osd":1,"uuid":"24f9a129-8121-4ae9-b0a2-db55951b75d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6810","nonce":4141609580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6814","nonce":4141609580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6819","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6821","nonce":4141609580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6815","nonce":4141609580},{"type":"v1","addr":"172.21.15.5:6817","nonce":4141609580}]},"public_addr":"172.21.15.5:6810/4141609580","cluster_addr":"172.21.15.5:6814/4141609580","heartbeat_back_addr":"172.21.15.5:6821/4141609580","heartbeat_front_addr":"172.21.15.5:6817/4141609580","state":["exists","up"]},{"osd":2,"uuid":"96df165e-d6f1-46fc-b59b-d01b30bebf3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6801","nonce":559368967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6803","nonce":559368967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6807","nonce":559368967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":559368967},{"type":"v1","addr":"172.21.15.5:6805","nonce":559368967}]},"public_addr":"172.21.15.5:6801/559368967","cluster_addr":"172.21.15.5:6803/559368967","heartbeat_back_addr":"172.21.15.5:6807/559368967","heartbeat_front_addr":"172.21.15.5:6805/559368967","state":["exists","up"]},{"osd":3,"uuid":"341ba276-347e-4e95-b16a-d28f4fff8d2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6825","nonce":4061664720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6827","nonce":4061664720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6831","nonce":4061664720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":4061664720},{"type":"v1","addr":"172.21.15.5:6829","nonce":4061664720}]},"public_addr":"172.21.15.5:6825/4061664720","cluster_addr":"172.21.15.5:6827/4061664720","heartbeat_back_addr":"172.21.15.5:6831/4061664720","heartbeat_front_addr":"172.21.15.5:6829/4061664720","state":["exists","up"]},{"osd":4,"uuid":"aa4274bf-d048-43f5-b03f-30613bbdc78e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6809","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6811","nonce":3408721900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6813","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6815","nonce":3408721900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6821","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6823","nonce":3408721900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6817","nonce":3408721900},{"type":"v1","addr":"172.21.15.154:6819","nonce":3408721900}]},"public_addr":"172.21.15.154:6811/3408721900","cluster_addr":"172.21.15.154:6815/3408721900","heartbeat_back_addr":"172.21.15.154:6823/3408721900","heartbeat_front_addr":"172.21.15.154:6819/3408721900","state":["exists","up"]},{"osd":5,"uuid":"7e96140e-6ae9-460d-9c5c-de34010e030c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6801","nonce":3949375489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6803","nonce":3949375489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6807","nonce":3949375489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3949375489},{"type":"v1","addr":"172.21.15.154:6805","nonce":3949375489}]},"public_addr":"172.21.15.154:6801/3949375489","cluster_addr":"172.21.15.154:6803/3949375489","heartbeat_back_addr":"172.21.15.154:6807/3949375489","heartbeat_front_addr":"172.21.15.154:6805/3949375489","state":["exists","up"]},{"osd":6,"uuid":"d40ff6ff-0eae-408f-a751-2f83b9d03620","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6825","nonce":1951324705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6827","nonce":1951324705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6831","nonce":1951324705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1951324705},{"type":"v1","addr":"172.21.15.154:6829","nonce":1951324705}]},"public_addr":"172.21.15.154:6825/1951324705","cluster_addr":"172.21.15.154:6827/1951324705","heartbeat_back_addr":"172.21.15.154:6831/1951324705","heartbeat_front_addr":"172.21.15.154:6829/1951324705","state":["exists","up"]},{"osd":7,"uuid":"e9467169-12e1-410b-9736-d698b22f92c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6810","nonce":1270457700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6814","nonce":1270457700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6822","nonce":1270457700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1270457700},{"type":"v1","addr":"172.21.15.154:6818","nonce":1270457700}]},"public_addr":"172.21.15.154:6810/1270457700","cluster_addr":"172.21.15.154:6814/1270457700","heartbeat_back_addr":"172.21.15.154:6822/1270457700","heartbeat_front_addr":"172.21.15.154:6818/1270457700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.936121+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.840332+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.730226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.899352+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.845365+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.052776+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:29.136367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:28.924722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6835/1752765831":"2023-07-15T13:32:53.093774+0000","172.21.15.5:6834/1752765831":"2023-07-15T13:32:53.093774+0000","172.21.15.154:6833/4121325793":"2023-07-15T13:32:49.859631+0000","172.21.15.154:6832/4121325793":"2023-07-15T13:32:49.859631+0000","172.21.15.154:0/2193305732":"2023-07-15T13:32:49.859631+0000","172.21.15.154:0/2055629106":"2023-07-15T13:32:49.859631+0000","172.21.15.154:0/3652890289":"2023-07-15T13:32:43.012909+0000","172.21.15.154:0/4024881055":"2023-07-15T13:32:49.859631+0000","172.21.15.154:0/88577192":"2023-07-15T13:32:43.012909+0000","172.21.15.154:0/724628748":"2023-07-15T13:32:49.859631+0000","172.21.15.154:0/191962473":"2023-07-15T13:32:43.012909+0000","172.21.15.154:0/766636820":"2023-07-15T13:32:49.859631+0000","172.21.15.154:0/1728568663":"2023-07-15T13:32:43.012909+0000","172.21.15.154:0/2303773027":"2023-07-15T13:32:49.859631+0000","172.21.15.154:0/1982074443":"2023-07-15T13:32:43.012909+0000","172.21.15.154:6833/2194391064":"2023-07-15T13:32:43.012909+0000","172.21.15.154:0/1493655222":"2023-07-15T13:32:49.859631+0000","172.21.15.154:0/3851820787":"2023-07-15T13:32:43.012909+0000","172.21.15.154:6832/2194391064":"2023-07-15T13:32:43.012909+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:33:00.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.643+0000 7eff8a974640 1 -- 172.21.15.5:0/3737289483 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7eff700663d0 msgr2=0x7eff70068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:00.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.643+0000 7eff8a974640 1 --2- 172.21.15.5:0/3737289483 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7eff700663d0 0x7eff70068880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7eff7400ab60 tx=0x7eff74008040 comp rx=0 tx=0).stop 2023-07-14T13:33:00.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.643+0000 7eff8a974640 1 -- 172.21.15.5:0/3737289483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff840d1300 msgr2=0x7eff840c5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:00.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.643+0000 7eff8a974640 1 --2- 172.21.15.5:0/3737289483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff840d1300 0x7eff840c5e30 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7eff7800b410 tx=0x7eff7800b8d0 comp rx=0 tx=0).stop 2023-07-14T13:33:00.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.643+0000 7eff8a974640 1 -- 172.21.15.5:0/3737289483 shutdown_connections 2023-07-14T13:33:00.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.643+0000 7eff8a974640 1 --2- 172.21.15.5:0/3737289483 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7eff700663d0 0x7eff70068880 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:00.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.643+0000 7eff8a974640 1 --2- 172.21.15.5:0/3737289483 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff840d1850 0x7eff8415da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:00.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.643+0000 7eff8a974640 1 --2- 172.21.15.5:0/3737289483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff840d1300 0x7eff840c5e30 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:00.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.643+0000 7eff8a974640 1 --2- 172.21.15.5:0/3737289483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff840b7c70 0x7eff841564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:00.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.643+0000 7eff8a974640 1 -- 172.21.15.5:0/3737289483 >> 172.21.15.5:0/3737289483 conn(0x7eff840650b0 msgr2=0x7eff840cfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:00.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.643+0000 7eff8a974640 1 -- 172.21.15.5:0/3737289483 shutdown_connections 2023-07-14T13:33:00.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:00.643+0000 7eff8a974640 1 -- 172.21.15.5:0/3737289483 wait complete. 2023-07-14T13:33:01.661 INFO:tasks.ceph:Scrubbing osd.0 2023-07-14T13:33:01.661 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-07-14T13:33:01.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.823+0000 7fbc48a6d640 1 Processor -- start 2023-07-14T13:33:01.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.823+0000 7fbc48a6d640 1 -- start start 2023-07-14T13:33:01.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.823+0000 7fbc48a6d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbc44070f30 0x7fbc440ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.823+0000 7fbc48a6d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbc440af2b0 0x7fbc4415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.823+0000 7fbc48a6d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc44159d70 con 0x7fbc44069430 2023-07-14T13:33:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.823+0000 7fbc48a6d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc440c9c60 con 0x7fbc440af2b0 2023-07-14T13:33:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.823+0000 7fbc48a6d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc440c9f40 con 0x7fbc44070f30 2023-07-14T13:33:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.823+0000 7fbc42d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbc440af2b0 0x7fbc4415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.827+0000 7fbc42d9d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbc440af2b0 0x7fbc4415a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55238/0 (socket says 172.21.15.5:55238) 2023-07-14T13:33:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.827+0000 7fbc42d9d640 1 -- 172.21.15.5:0/418849356 learned_addr learned my addr 172.21.15.5:0/418849356 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.827+0000 7fbc3bfff640 1 --2- 172.21.15.5:0/418849356 >> v2:172.21.15.154:3300/0 conn(0x7fbc44070f30 0x7fbc440ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.827+0000 7fbc42d9d640 1 -- 172.21.15.5:0/418849356 >> v2:172.21.15.154:3300/0 conn(0x7fbc44070f30 msgr2=0x7fbc440ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.827+0000 7fbc42d9d640 1 --2- 172.21.15.5:0/418849356 >> v2:172.21.15.154:3300/0 conn(0x7fbc44070f30 0x7fbc440ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.827+0000 7fbc42d9d640 1 -- 172.21.15.5:0/418849356 >> v1:172.21.15.154:6789/0 conn(0x7fbc44069430 legacy=0x7fbc44069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.827+0000 7fbc42d9d640 1 -- 172.21.15.5:0/418849356 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc440ca220 con 0x7fbc440af2b0 2023-07-14T13:33:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.827+0000 7fbc42d9d640 1 --2- 172.21.15.5:0/418849356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc440af2b0 0x7fbc4415a1f0 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7fbc440c9830 tx=0x7fbc3c01c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b213cea59c8ff5c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.827+0000 7fbc41d9b640 1 -- 172.21.15.5:0/418849356 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c0a5760 con 0x7fbc440af2b0 2023-07-14T13:33:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.827+0000 7fbc41d9b640 1 -- 172.21.15.5:0/418849356 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3c0a58c0 con 0x7fbc440af2b0 2023-07-14T13:33:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.827+0000 7fbc41d9b640 1 -- 172.21.15.5:0/418849356 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c0a5c50 con 0x7fbc440af2b0 2023-07-14T13:33:01.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.831+0000 7fbc48a6d640 1 -- 172.21.15.5:0/418849356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc440af2b0 msgr2=0x7fbc4415a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:01.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.831+0000 7fbc48a6d640 1 --2- 172.21.15.5:0/418849356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc440af2b0 0x7fbc4415a1f0 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7fbc440c9830 tx=0x7fbc3c01c990 comp rx=0 tx=0).stop 2023-07-14T13:33:01.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.831+0000 7fbc48a6d640 1 -- 172.21.15.5:0/418849356 shutdown_connections 2023-07-14T13:33:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.831+0000 7fbc48a6d640 1 --2- 172.21.15.5:0/418849356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc440af2b0 0x7fbc4415a1f0 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.831+0000 7fbc48a6d640 1 --2- 172.21.15.5:0/418849356 >> v2:172.21.15.154:3300/0 conn(0x7fbc44070f30 0x7fbc440ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.831+0000 7fbc48a6d640 1 -- 172.21.15.5:0/418849356 >> 172.21.15.5:0/418849356 conn(0x7fbc440cde90 msgr2=0x7fbc440ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.831+0000 7fbc48a6d640 1 -- 172.21.15.5:0/418849356 shutdown_connections 2023-07-14T13:33:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.831+0000 7fbc48a6d640 1 -- 172.21.15.5:0/418849356 wait complete. 2023-07-14T13:33:01.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.831+0000 7fbc48a6d640 1 Processor -- start 2023-07-14T13:33:01.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.831+0000 7fbc48a6d640 1 -- start start 2023-07-14T13:33:01.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.831+0000 7fbc48a6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc44069430 0x7fbc44151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:01.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.831+0000 7fbc48a6d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc44070f30 0x7fbc44157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:01.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.831+0000 7fbc48a6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc440af2b0 0x7fbc440c6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:01.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.831+0000 7fbc48a6d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc440c7dc0 con 0x7fbc440af2b0 2023-07-14T13:33:01.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.831+0000 7fbc48a6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc441f64b0 con 0x7fbc44069430 2023-07-14T13:33:01.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.831+0000 7fbc48a6d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc441f58a0 con 0x7fbc44070f30 2023-07-14T13:33:01.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.831+0000 7fbc42d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc440af2b0 0x7fbc440c6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:01.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.831+0000 7fbc42d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc440af2b0 0x7fbc440c6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55240/0 (socket says 172.21.15.5:55240) 2023-07-14T13:33:01.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.831+0000 7fbc42d9d640 1 -- 172.21.15.5:0/172553605 learned_addr learned my addr 172.21.15.5:0/172553605 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:01.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.831+0000 7fbc4259c640 1 --2- 172.21.15.5:0/172553605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc44069430 0x7fbc44151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:01.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.831+0000 7fbc3bfff640 1 --2- 172.21.15.5:0/172553605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc44070f30 0x7fbc44157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:01.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.835+0000 7fbc42d9d640 1 -- 172.21.15.5:0/172553605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc44070f30 msgr2=0x7fbc44157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:01.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.835+0000 7fbc42d9d640 1 --2- 172.21.15.5:0/172553605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc44070f30 0x7fbc44157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:01.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.835+0000 7fbc42d9d640 1 -- 172.21.15.5:0/172553605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc44069430 msgr2=0x7fbc44151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:01.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.835+0000 7fbc42d9d640 1 --2- 172.21.15.5:0/172553605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc44069430 0x7fbc44151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:01.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.835+0000 7fbc42d9d640 1 -- 172.21.15.5:0/172553605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c009b30 con 0x7fbc440af2b0 2023-07-14T13:33:01.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.835+0000 7fbc3bfff640 1 --2- 172.21.15.5:0/172553605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc44070f30 0x7fbc44157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:33:01.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.835+0000 7fbc42d9d640 1 --2- 172.21.15.5:0/172553605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc440af2b0 0x7fbc440c6660 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c01a5c0 tx=0x7fbc3c019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:01.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.835+0000 7fbc3affd640 1 -- 172.21.15.5:0/172553605 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c0b8670 con 0x7fbc440af2b0 2023-07-14T13:33:01.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.835+0000 7fbc3affd640 1 -- 172.21.15.5:0/172553605 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3c0b87d0 con 0x7fbc440af2b0 2023-07-14T13:33:01.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.835+0000 7fbc48a6d640 1 -- 172.21.15.5:0/172553605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc441f5b80 con 0x7fbc440af2b0 2023-07-14T13:33:01.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.835+0000 7fbc3affd640 1 -- 172.21.15.5:0/172553605 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c0b8b80 con 0x7fbc440af2b0 2023-07-14T13:33:01.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.835+0000 7fbc48a6d640 1 -- 172.21.15.5:0/172553605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc441f6140 con 0x7fbc440af2b0 2023-07-14T13:33:01.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.835+0000 7fbc48a6d640 1 -- 172.21.15.5:0/172553605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbc44157710 con 0x7fbc440af2b0 2023-07-14T13:33:01.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.835+0000 7fbc3affd640 1 -- 172.21.15.5:0/172553605 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbc3c0b8ce0 con 0x7fbc440af2b0 2023-07-14T13:33:01.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.835+0000 7fbc3affd640 1 --2- 172.21.15.5:0/172553605 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fbc240663a0 0x7fbc24068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:01.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.835+0000 7fbc3affd640 1 -- 172.21.15.5:0/172553605 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7fbc3c11f290 con 0x7fbc440af2b0 2023-07-14T13:33:01.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.835+0000 7fbc3affd640 1 --2- 172.21.15.5:0/172553605 >> [v2:172.21.15.5:6809/3251687665,v1:172.21.15.5:6811/3251687665] conn(0x7fbc2406ce50 0x7fbc2406f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:01.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.835+0000 7fbc3affd640 1 -- 172.21.15.5:0/172553605 --> [v2:172.21.15.5:6809/3251687665,v1:172.21.15.5:6811/3251687665] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc2406f930 con 0x7fbc2406ce50 2023-07-14T13:33:01.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.835+0000 7fbc3affd640 1 -- 172.21.15.5:0/172553605 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=196) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc3c121870 con 0x7fbc440af2b0 2023-07-14T13:33:01.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.835+0000 7fbc4259c640 1 --2- 172.21.15.5:0/172553605 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fbc240663a0 0x7fbc24068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:01.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.839+0000 7fbc3bfff640 1 --2- 172.21.15.5:0/172553605 >> [v2:172.21.15.5:6809/3251687665,v1:172.21.15.5:6811/3251687665] conn(0x7fbc2406ce50 0x7fbc2406f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:01.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.839+0000 7fbc3bfff640 1 --2- 172.21.15.5:0/172553605 >> [v2:172.21.15.5:6809/3251687665,v1:172.21.15.5:6811/3251687665] conn(0x7fbc2406ce50 0x7fbc2406f260 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:01.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.839+0000 7fbc4259c640 1 --2- 172.21.15.5:0/172553605 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fbc240663a0 0x7fbc24068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400b810 tx=0x7fbc34008040 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:01.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.839+0000 7fbc3affd640 1 -- 172.21.15.5:0/172553605 <== osd.0 v2:172.21.15.5:6809/3251687665 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fbc2406f930 con 0x7fbc2406ce50 2023-07-14T13:33:01.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.851+0000 7fbc48a6d640 1 -- 172.21.15.5:0/172553605 --> [v2:172.21.15.5:6809/3251687665,v1:172.21.15.5:6811/3251687665] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbc44159d70 con 0x7fbc2406ce50 2023-07-14T13:33:01.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.851+0000 7fbc3affd640 1 -- 172.21.15.5:0/172553605 <== osd.0 v2:172.21.15.5:6809/3251687665 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbc44159d70 con 0x7fbc2406ce50 2023-07-14T13:33:01.849 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T13:33:01.850 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-14T13:33:01.850 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T13:33:01.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.851+0000 7fbc48a6d640 1 -- 172.21.15.5:0/172553605 >> [v2:172.21.15.5:6809/3251687665,v1:172.21.15.5:6811/3251687665] conn(0x7fbc2406ce50 msgr2=0x7fbc2406f260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:01.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.851+0000 7fbc48a6d640 1 --2- 172.21.15.5:0/172553605 >> [v2:172.21.15.5:6809/3251687665,v1:172.21.15.5:6811/3251687665] conn(0x7fbc2406ce50 0x7fbc2406f260 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:01.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.851+0000 7fbc48a6d640 1 -- 172.21.15.5:0/172553605 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fbc240663a0 msgr2=0x7fbc24068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:01.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.851+0000 7fbc48a6d640 1 --2- 172.21.15.5:0/172553605 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fbc240663a0 0x7fbc24068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400b810 tx=0x7fbc34008040 comp rx=0 tx=0).stop 2023-07-14T13:33:01.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.851+0000 7fbc48a6d640 1 -- 172.21.15.5:0/172553605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc440af2b0 msgr2=0x7fbc440c6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:01.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.851+0000 7fbc48a6d640 1 --2- 172.21.15.5:0/172553605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc440af2b0 0x7fbc440c6660 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c01a5c0 tx=0x7fbc3c019730 comp rx=0 tx=0).stop 2023-07-14T13:33:01.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.851+0000 7fbc42d9d640 1 -- 172.21.15.5:0/172553605 reap_dead start 2023-07-14T13:33:01.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.851+0000 7fbc48a6d640 1 -- 172.21.15.5:0/172553605 shutdown_connections 2023-07-14T13:33:01.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.851+0000 7fbc48a6d640 1 -- 172.21.15.5:0/172553605 >> 172.21.15.5:0/172553605 conn(0x7fbc440cde90 msgr2=0x7fbc440ac130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:01.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.851+0000 7fbc48a6d640 1 -- 172.21.15.5:0/172553605 shutdown_connections 2023-07-14T13:33:01.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:01.851+0000 7fbc48a6d640 1 -- 172.21.15.5:0/172553605 wait complete. 2023-07-14T13:33:01.868 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-07-14T13:33:02.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.015+0000 7f1145d11640 1 Processor -- start 2023-07-14T13:33:02.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.015+0000 7f1145d11640 1 -- start start 2023-07-14T13:33:02.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.015+0000 7f1145d11640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11400c8ad0 0x7f11400c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:02.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.015+0000 7f1145d11640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f11400c9560 0x7f11400ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:02.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.015+0000 7f1145d11640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11400cc700 con 0x7f1140158ce0 2023-07-14T13:33:02.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.015+0000 7f1145d11640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11400c99e0 con 0x7f11400c9560 2023-07-14T13:33:02.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.015+0000 7f1145d11640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11400b0ff0 con 0x7f11400c8ad0 2023-07-14T13:33:02.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.019+0000 7f113effd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11400c8ad0 0x7f11400c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:02.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.019+0000 7f113f7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1140158ce0 0x7f1140070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.5:40240/0 (socket says 172.21.15.5:40240) 2023-07-14T13:33:02.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.019+0000 7f113f7fe640 1 -- 172.21.15.5:0/3396037703 learned_addr learned my addr 172.21.15.5:0/3396037703 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:33:02.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.019+0000 7f113ffff640 1 --2- 172.21.15.5:0/3396037703 >> v2:172.21.15.154:3300/0 conn(0x7f11400c9560 0x7f11400ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:02.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.019+0000 7f113e7fc640 1 -- 172.21.15.5:0/3396037703 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169109003 0 0) 0x7f11400cc700 con 0x7f1140158ce0 2023-07-14T13:33:02.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.019+0000 7f113e7fc640 1 -- 172.21.15.5:0/3396037703 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1128003530 con 0x7f1140158ce0 2023-07-14T13:33:02.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.019+0000 7f113ffff640 1 -- 172.21.15.5:0/3396037703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11400c8ad0 msgr2=0x7f11400c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:02.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.019+0000 7f113ffff640 1 --2- 172.21.15.5:0/3396037703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11400c8ad0 0x7f11400c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:02.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.019+0000 7f113ffff640 1 -- 172.21.15.5:0/3396037703 >> v1:172.21.15.154:6789/0 conn(0x7f1140158ce0 legacy=0x7f1140070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.019+0000 7f113ffff640 1 -- 172.21.15.5:0/3396037703 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1140070c80 con 0x7f11400c9560 2023-07-14T13:33:02.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.019+0000 7f113effd640 1 --2- 172.21.15.5:0/3396037703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11400c8ad0 0x7f11400c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:33:02.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.019+0000 7f113ffff640 1 --2- 172.21.15.5:0/3396037703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11400c9560 0x7f11400ccb90 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f1138009d90 tx=0x7f113801c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75922df9c9c9f91c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:02.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.023+0000 7f113e7fc640 1 -- 172.21.15.5:0/3396037703 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11380a57d0 con 0x7f11400c9560 2023-07-14T13:33:02.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.023+0000 7f113e7fc640 1 -- 172.21.15.5:0/3396037703 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11380a5930 con 0x7f11400c9560 2023-07-14T13:33:02.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.023+0000 7f113e7fc640 1 -- 172.21.15.5:0/3396037703 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11380a5cc0 con 0x7f11400c9560 2023-07-14T13:33:02.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.023+0000 7f1145d11640 1 -- 172.21.15.5:0/3396037703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11400c9560 msgr2=0x7f11400ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.023+0000 7f1145d11640 1 --2- 172.21.15.5:0/3396037703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11400c9560 0x7f11400ccb90 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f1138009d90 tx=0x7f113801c800 comp rx=0 tx=0).stop 2023-07-14T13:33:02.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.023+0000 7f1145d11640 1 -- 172.21.15.5:0/3396037703 shutdown_connections 2023-07-14T13:33:02.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.023+0000 7f1145d11640 1 --2- 172.21.15.5:0/3396037703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11400c9560 0x7f11400ccb90 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:02.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.023+0000 7f1145d11640 1 --2- 172.21.15.5:0/3396037703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11400c8ad0 0x7f11400c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:02.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.023+0000 7f1145d11640 1 -- 172.21.15.5:0/3396037703 >> 172.21.15.5:0/3396037703 conn(0x7f11400afcf0 msgr2=0x7f11400b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:02.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.023+0000 7f1145d11640 1 -- 172.21.15.5:0/3396037703 shutdown_connections 2023-07-14T13:33:02.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.023+0000 7f1145d11640 1 -- 172.21.15.5:0/3396037703 wait complete. 2023-07-14T13:33:02.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.023+0000 7f1145d11640 1 Processor -- start 2023-07-14T13:33:02.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.023+0000 7f1145d11640 1 -- start start 2023-07-14T13:33:02.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.023+0000 7f1145d11640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11400c8ad0 0x7f1140145310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:02.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.023+0000 7f1145d11640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11400c9560 0x7f11400abc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:02.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.023+0000 7f1145d11640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1140158ce0 0x7f11400ac160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:02.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.023+0000 7f1145d11640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11400c73a0 con 0x7f11400c8ad0 2023-07-14T13:33:02.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.023+0000 7f1145d11640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114014fea0 con 0x7f1140158ce0 2023-07-14T13:33:02.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.023+0000 7f1145d11640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1140150eb0 con 0x7f11400c9560 2023-07-14T13:33:02.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.023+0000 7f113f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11400c8ad0 0x7f1140145310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:02.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.023+0000 7f113f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11400c8ad0 0x7f1140145310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55248/0 (socket says 172.21.15.5:55248) 2023-07-14T13:33:02.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.023+0000 7f113f7fe640 1 -- 172.21.15.5:0/2541162607 learned_addr learned my addr 172.21.15.5:0/2541162607 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:02.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.027+0000 7f113ffff640 1 --2- 172.21.15.5:0/2541162607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1140158ce0 0x7f11400ac160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:02.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.027+0000 7f113effd640 1 --2- 172.21.15.5:0/2541162607 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11400c9560 0x7f11400abc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:02.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.027+0000 7f113f7fe640 1 -- 172.21.15.5:0/2541162607 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11400c9560 msgr2=0x7f11400abc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.027+0000 7f113f7fe640 1 --2- 172.21.15.5:0/2541162607 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11400c9560 0x7f11400abc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:02.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.027+0000 7f113f7fe640 1 -- 172.21.15.5:0/2541162607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1140158ce0 msgr2=0x7f11400ac160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.027+0000 7f113f7fe640 1 --2- 172.21.15.5:0/2541162607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1140158ce0 0x7f11400ac160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:02.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.027+0000 7f113f7fe640 1 -- 172.21.15.5:0/2541162607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1134009420 con 0x7f11400c8ad0 2023-07-14T13:33:02.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.027+0000 7f113f7fe640 1 --2- 172.21.15.5:0/2541162607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11400c8ad0 0x7f1140145310 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f113000c420 tx=0x7f113000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:02.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.027+0000 7f1127fff640 1 -- 172.21.15.5:0/2541162607 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130005cf0 con 0x7f11400c8ad0 2023-07-14T13:33:02.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.027+0000 7f1127fff640 1 -- 172.21.15.5:0/2541162607 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1130005e50 con 0x7f11400c8ad0 2023-07-14T13:33:02.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.027+0000 7f1145d11640 1 -- 172.21.15.5:0/2541162607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1138009a70 con 0x7f11400c8ad0 2023-07-14T13:33:02.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.027+0000 7f1127fff640 1 -- 172.21.15.5:0/2541162607 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11300072d0 con 0x7f11400c8ad0 2023-07-14T13:33:02.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.027+0000 7f1145d11640 1 -- 172.21.15.5:0/2541162607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11401506b0 con 0x7f11400c8ad0 2023-07-14T13:33:02.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.027+0000 7f1145d11640 1 -- 172.21.15.5:0/2541162607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11400ca1a0 con 0x7f11400c8ad0 2023-07-14T13:33:02.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.027+0000 7f1127fff640 1 -- 172.21.15.5:0/2541162607 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1130007430 con 0x7f11400c8ad0 2023-07-14T13:33:02.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.027+0000 7f1127fff640 1 --2- 172.21.15.5:0/2541162607 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f112c0663a0 0x7f112c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:02.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.027+0000 7f1127fff640 1 -- 172.21.15.5:0/2541162607 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7f11300834c0 con 0x7f11400c8ad0 2023-07-14T13:33:02.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.031+0000 7f113effd640 1 --2- 172.21.15.5:0/2541162607 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f112c0663a0 0x7f112c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:02.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.031+0000 7f113effd640 1 --2- 172.21.15.5:0/2541162607 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f112c0663a0 0x7f112c068850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f11400c9470 tx=0x7f1134009190 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:02.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.031+0000 7f1127fff640 1 -- 172.21.15.5:0/2541162607 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f11300507b0 con 0x7f11400c8ad0 2023-07-14T13:33:02.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.187+0000 7f1145d11640 1 -- 172.21.15.5:0/2541162607 --> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f11400cc390 con 0x7f112c0663a0 2023-07-14T13:33:02.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.187+0000 7f1127fff640 1 -- 172.21.15.5:0/2541162607 <== mgr.10192 v2:172.21.15.154:6832/317858933 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1134009940 con 0x7f112c0663a0 2023-07-14T13:33:02.186 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 0 to deep-scrub 2023-07-14T13:33:02.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.191+0000 7f1145d11640 1 -- 172.21.15.5:0/2541162607 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f112c0663a0 msgr2=0x7f112c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.191+0000 7f1145d11640 1 --2- 172.21.15.5:0/2541162607 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f112c0663a0 0x7f112c068850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f11400c9470 tx=0x7f1134009190 comp rx=0 tx=0).stop 2023-07-14T13:33:02.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.191+0000 7f1145d11640 1 -- 172.21.15.5:0/2541162607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11400c8ad0 msgr2=0x7f1140145310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.191+0000 7f1145d11640 1 --2- 172.21.15.5:0/2541162607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11400c8ad0 0x7f1140145310 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f113000c420 tx=0x7f113000c8e0 comp rx=0 tx=0).stop 2023-07-14T13:33:02.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.191+0000 7f1145d11640 1 -- 172.21.15.5:0/2541162607 shutdown_connections 2023-07-14T13:33:02.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.191+0000 7f1145d11640 1 --2- 172.21.15.5:0/2541162607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1140158ce0 0x7f11400ac160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:02.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.191+0000 7f1145d11640 1 --2- 172.21.15.5:0/2541162607 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f112c0663a0 0x7f112c068850 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:02.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.191+0000 7f1145d11640 1 --2- 172.21.15.5:0/2541162607 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11400c9560 0x7f11400abc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:02.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.191+0000 7f1145d11640 1 --2- 172.21.15.5:0/2541162607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11400c8ad0 0x7f1140145310 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:02.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.191+0000 7f1145d11640 1 -- 172.21.15.5:0/2541162607 >> 172.21.15.5:0/2541162607 conn(0x7f11400afcf0 msgr2=0x7f1140070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.191+0000 7f1145d11640 1 -- 172.21.15.5:0/2541162607 shutdown_connections 2023-07-14T13:33:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.191+0000 7f1145d11640 1 -- 172.21.15.5:0/2541162607 wait complete. 2023-07-14T13:33:02.209 INFO:tasks.ceph:Scrubbing osd.1 2023-07-14T13:33:02.209 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-07-14T13:33:02.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.367+0000 7f2abe40b640 1 Processor -- start 2023-07-14T13:33:02.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.367+0000 7f2abe40b640 1 -- start start 2023-07-14T13:33:02.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.367+0000 7f2abe40b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ab81453a0 0x7f2ab80b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:02.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.367+0000 7f2abe40b640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab806c040 con 0x7f2ab806a440 2023-07-14T13:33:02.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.367+0000 7f2abe40b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab8160600 con 0x7f2ab815f690 2023-07-14T13:33:02.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.367+0000 7f2abe40b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ab8160170 con 0x7f2ab81453a0 2023-07-14T13:33:02.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.367+0000 7f2abc9a8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ab81453a0 0x7f2ab80b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:02.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.367+0000 7f2abc9a8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2ab81453a0 0x7f2ab80b1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55262/0 (socket says 172.21.15.5:55262) 2023-07-14T13:33:02.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.367+0000 7f2abc9a8640 1 -- 172.21.15.5:0/188513588 learned_addr learned my addr 172.21.15.5:0/188513588 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:02.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.367+0000 7f2ab77fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2ab806a440 0x7f2ab806c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35324/0 (socket says 172.21.15.5:35324) 2023-07-14T13:33:02.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.367+0000 7f2abc9a8640 1 -- 172.21.15.5:0/188513588 >> v1:172.21.15.154:6789/0 conn(0x7f2ab815f690 legacy=0x7f2ab815fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:02.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.367+0000 7f2abc9a8640 1 -- 172.21.15.5:0/188513588 >> v1:172.21.15.5:6789/0 conn(0x7f2ab806a440 legacy=0x7f2ab806c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.367+0000 7f2abc9a8640 1 -- 172.21.15.5:0/188513588 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab8160360 con 0x7f2ab81453a0 2023-07-14T13:33:02.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.367+0000 7f2ab6ffd640 1 -- 172.21.15.5:0/188513588 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720675194 0 0) 0x7f2ab806c040 con 0x7f2ab806a440 2023-07-14T13:33:02.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.371+0000 7f2abc9a8640 1 --2- 172.21.15.5:0/188513588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ab81453a0 0x7f2ab80b1890 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0009e50 tx=0x7f2ab001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3ebf76e61ef4ad server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:02.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.371+0000 7f2ab6ffd640 1 -- 172.21.15.5:0/188513588 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab00a57d0 con 0x7f2ab81453a0 2023-07-14T13:33:02.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.371+0000 7f2ab6ffd640 1 -- 172.21.15.5:0/188513588 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab00a5930 con 0x7f2ab81453a0 2023-07-14T13:33:02.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.371+0000 7f2ab6ffd640 1 -- 172.21.15.5:0/188513588 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab00a5cc0 con 0x7f2ab81453a0 2023-07-14T13:33:02.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.371+0000 7f2abe40b640 1 -- 172.21.15.5:0/188513588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ab81453a0 msgr2=0x7f2ab80b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.371+0000 7f2abe40b640 1 --2- 172.21.15.5:0/188513588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ab81453a0 0x7f2ab80b1890 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0009e50 tx=0x7f2ab001c910 comp rx=0 tx=0).stop 2023-07-14T13:33:02.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.371+0000 7f2abe40b640 1 -- 172.21.15.5:0/188513588 shutdown_connections 2023-07-14T13:33:02.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.371+0000 7f2abe40b640 1 --2- 172.21.15.5:0/188513588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ab81453a0 0x7f2ab80b1890 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:02.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.371+0000 7f2abe40b640 1 -- 172.21.15.5:0/188513588 >> 172.21.15.5:0/188513588 conn(0x7f2ab80b1210 msgr2=0x7f2ab80ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:02.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.371+0000 7f2abe40b640 1 -- 172.21.15.5:0/188513588 shutdown_connections 2023-07-14T13:33:02.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.371+0000 7f2abe40b640 1 -- 172.21.15.5:0/188513588 wait complete. 2023-07-14T13:33:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.375+0000 7f2abe40b640 1 Processor -- start 2023-07-14T13:33:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.375+0000 7f2abe40b640 1 -- start start 2023-07-14T13:33:02.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.375+0000 7f2abe40b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ab806a440 0x7f2ab813bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:02.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.375+0000 7f2abe40b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ab81453a0 0x7f2ab806fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:02.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.375+0000 7f2abe40b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ab815f690 0x7f2ab813c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:02.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.375+0000 7f2abe40b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab813e5c0 con 0x7f2ab81453a0 2023-07-14T13:33:02.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.375+0000 7f2abe40b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab813e860 con 0x7f2ab815f690 2023-07-14T13:33:02.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.375+0000 7f2abe40b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab813eb40 con 0x7f2ab806a440 2023-07-14T13:33:02.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.375+0000 7f2ab77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ab81453a0 0x7f2ab806fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:02.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.375+0000 7f2ab77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ab81453a0 0x7f2ab806fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55270/0 (socket says 172.21.15.5:55270) 2023-07-14T13:33:02.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.375+0000 7f2ab77fe640 1 -- 172.21.15.5:0/1858109844 learned_addr learned my addr 172.21.15.5:0/1858109844 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:02.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.375+0000 7f2ab7fff640 1 --2- 172.21.15.5:0/1858109844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ab806a440 0x7f2ab813bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:02.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.375+0000 7f2abc9a8640 1 --2- 172.21.15.5:0/1858109844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ab815f690 0x7f2ab813c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:02.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.375+0000 7f2ab77fe640 1 -- 172.21.15.5:0/1858109844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ab806a440 msgr2=0x7f2ab813bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.375+0000 7f2ab77fe640 1 --2- 172.21.15.5:0/1858109844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ab806a440 0x7f2ab813bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:02.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.375+0000 7f2ab77fe640 1 -- 172.21.15.5:0/1858109844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ab815f690 msgr2=0x7f2ab813c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.375+0000 7f2ab77fe640 1 --2- 172.21.15.5:0/1858109844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ab815f690 0x7f2ab813c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:02.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.375+0000 7f2ab77fe640 1 -- 172.21.15.5:0/1858109844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab0009b30 con 0x7f2ab81453a0 2023-07-14T13:33:02.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.375+0000 7f2ab77fe640 1 --2- 172.21.15.5:0/1858109844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ab81453a0 0x7f2ab806fd10 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f2aac00c480 tx=0x7f2aac00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:02.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.375+0000 7f2ab4ff9640 1 -- 172.21.15.5:0/1858109844 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac0074e0 con 0x7f2ab81453a0 2023-07-14T13:33:02.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.375+0000 7f2ab4ff9640 1 -- 172.21.15.5:0/1858109844 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aac007660 con 0x7f2ab81453a0 2023-07-14T13:33:02.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.375+0000 7f2abe40b640 1 -- 172.21.15.5:0/1858109844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab813ee20 con 0x7f2ab81453a0 2023-07-14T13:33:02.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.375+0000 7f2ab4ff9640 1 -- 172.21.15.5:0/1858109844 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac004a30 con 0x7f2ab81453a0 2023-07-14T13:33:02.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.375+0000 7f2abe40b640 1 -- 172.21.15.5:0/1858109844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab813c0f0 con 0x7f2ab81453a0 2023-07-14T13:33:02.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.379+0000 7f2abe40b640 1 -- 172.21.15.5:0/1858109844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2ab806ad80 con 0x7f2ab81453a0 2023-07-14T13:33:02.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.379+0000 7f2ab4ff9640 1 -- 172.21.15.5:0/1858109844 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2aac004b90 con 0x7f2ab81453a0 2023-07-14T13:33:02.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.379+0000 7f2ab4ff9640 1 --2- 172.21.15.5:0/1858109844 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f2aa40663a0 0x7f2aa4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:02.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.379+0000 7f2ab4ff9640 1 -- 172.21.15.5:0/1858109844 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7f2aac083300 con 0x7f2ab81453a0 2023-07-14T13:33:02.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.379+0000 7f2ab4ff9640 1 --2- 172.21.15.5:0/1858109844 >> [v2:172.21.15.5:6808/4141609580,v1:172.21.15.5:6810/4141609580] conn(0x7f2aa406ce50 0x7f2aa406f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:02.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.379+0000 7f2ab4ff9640 1 -- 172.21.15.5:0/1858109844 --> [v2:172.21.15.5:6808/4141609580,v1:172.21.15.5:6810/4141609580] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2aa406f930 con 0x7f2aa406ce50 2023-07-14T13:33:02.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.379+0000 7f2ab4ff9640 1 -- 172.21.15.5:0/1858109844 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=196) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2aac0858e0 con 0x7f2ab81453a0 2023-07-14T13:33:02.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.379+0000 7f2ab7fff640 1 --2- 172.21.15.5:0/1858109844 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f2aa40663a0 0x7f2aa4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:02.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.379+0000 7f2abc9a8640 1 --2- 172.21.15.5:0/1858109844 >> [v2:172.21.15.5:6808/4141609580,v1:172.21.15.5:6810/4141609580] conn(0x7f2aa406ce50 0x7f2aa406f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:02.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.379+0000 7f2ab7fff640 1 --2- 172.21.15.5:0/1858109844 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f2aa40663a0 0x7f2aa4068850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8007fd0 tx=0x7f2aa8007e40 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:02.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.379+0000 7f2abc9a8640 1 --2- 172.21.15.5:0/1858109844 >> [v2:172.21.15.5:6808/4141609580,v1:172.21.15.5:6810/4141609580] conn(0x7f2aa406ce50 0x7f2aa406f260 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:02.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.383+0000 7f2ab4ff9640 1 -- 172.21.15.5:0/1858109844 <== osd.1 v2:172.21.15.5:6808/4141609580 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2aa406f930 con 0x7f2aa406ce50 2023-07-14T13:33:02.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.395+0000 7f2abe40b640 1 -- 172.21.15.5:0/1858109844 --> [v2:172.21.15.5:6808/4141609580,v1:172.21.15.5:6810/4141609580] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2ab813f2d0 con 0x7f2aa406ce50 2023-07-14T13:33:02.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.395+0000 7f2ab4ff9640 1 -- 172.21.15.5:0/1858109844 <== osd.1 v2:172.21.15.5:6808/4141609580 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2ab0009230 con 0x7f2aa406ce50 2023-07-14T13:33:02.392 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T13:33:02.392 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-14T13:33:02.392 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T13:33:02.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.395+0000 7f2abe40b640 1 -- 172.21.15.5:0/1858109844 >> [v2:172.21.15.5:6808/4141609580,v1:172.21.15.5:6810/4141609580] conn(0x7f2aa406ce50 msgr2=0x7f2aa406f260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.395+0000 7f2abe40b640 1 --2- 172.21.15.5:0/1858109844 >> [v2:172.21.15.5:6808/4141609580,v1:172.21.15.5:6810/4141609580] conn(0x7f2aa406ce50 0x7f2aa406f260 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:02.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.395+0000 7f2abe40b640 1 -- 172.21.15.5:0/1858109844 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f2aa40663a0 msgr2=0x7f2aa4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.395+0000 7f2abe40b640 1 --2- 172.21.15.5:0/1858109844 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f2aa40663a0 0x7f2aa4068850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8007fd0 tx=0x7f2aa8007e40 comp rx=0 tx=0).stop 2023-07-14T13:33:02.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.395+0000 7f2abe40b640 1 -- 172.21.15.5:0/1858109844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ab81453a0 msgr2=0x7f2ab806fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.395+0000 7f2abe40b640 1 --2- 172.21.15.5:0/1858109844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ab81453a0 0x7f2ab806fd10 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f2aac00c480 tx=0x7f2aac00c940 comp rx=0 tx=0).stop 2023-07-14T13:33:02.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.395+0000 7f2abc9a8640 1 -- 172.21.15.5:0/1858109844 reap_dead start 2023-07-14T13:33:02.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.395+0000 7f2abe40b640 1 -- 172.21.15.5:0/1858109844 shutdown_connections 2023-07-14T13:33:02.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.395+0000 7f2abe40b640 1 -- 172.21.15.5:0/1858109844 >> 172.21.15.5:0/1858109844 conn(0x7f2ab80b1210 msgr2=0x7f2ab80afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:02.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.395+0000 7f2abe40b640 1 -- 172.21.15.5:0/1858109844 shutdown_connections 2023-07-14T13:33:02.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.395+0000 7f2abe40b640 1 -- 172.21.15.5:0/1858109844 wait complete. 2023-07-14T13:33:02.410 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-07-14T13:33:02.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.559+0000 7fd69a29c640 1 Processor -- start 2023-07-14T13:33:02.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.559+0000 7fd69a29c640 1 -- start start 2023-07-14T13:33:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.563+0000 7fd69a29c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd694070b70 0x7fd694070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.563+0000 7fd69a29c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6940cac70 con 0x7fd6940cb100 2023-07-14T13:33:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.563+0000 7fd69a29c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd694071480 con 0x7fd69406b1e0 2023-07-14T13:33:02.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.563+0000 7fd69a29c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6940ca060 con 0x7fd694070b70 2023-07-14T13:33:02.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.563+0000 7fd698839640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd6940cb100 0x7fd6940cb520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35326/0 (socket says 172.21.15.5:35326) 2023-07-14T13:33:02.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.563+0000 7fd698839640 1 -- 172.21.15.5:0/3356667821 learned_addr learned my addr 172.21.15.5:0/3356667821 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:33:02.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.563+0000 7fd693fff640 1 --2- 172.21.15.5:0/3356667821 >> v2:172.21.15.154:3300/0 conn(0x7fd694070b70 0x7fd694070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:02.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.563+0000 7fd692ffd640 1 -- 172.21.15.5:0/3356667821 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763140310 0 0) 0x7fd6940cac70 con 0x7fd6940cb100 2023-07-14T13:33:02.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.563+0000 7fd692ffd640 1 -- 172.21.15.5:0/3356667821 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd67c003530 con 0x7fd6940cb100 2023-07-14T13:33:02.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.563+0000 7fd692ffd640 1 -- 172.21.15.5:0/3356667821 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 960287224 0 0) 0x7fd694071480 con 0x7fd69406b1e0 2023-07-14T13:33:02.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.563+0000 7fd692ffd640 1 -- 172.21.15.5:0/3356667821 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6940cac70 con 0x7fd69406b1e0 2023-07-14T13:33:02.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.563+0000 7fd693fff640 1 -- 172.21.15.5:0/3356667821 >> v1:172.21.15.154:6789/0 conn(0x7fd69406b1e0 legacy=0x7fd6940c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.563+0000 7fd693fff640 1 -- 172.21.15.5:0/3356667821 >> v1:172.21.15.5:6789/0 conn(0x7fd6940cb100 legacy=0x7fd6940cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.563+0000 7fd693fff640 1 -- 172.21.15.5:0/3356667821 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6940ca340 con 0x7fd694070b70 2023-07-14T13:33:02.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.567+0000 7fd693fff640 1 --2- 172.21.15.5:0/3356667821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd694070b70 0x7fd694070f40 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fd6840097c0 tx=0x7fd68401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=964e259d6fd8ddbf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:02.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.567+0000 7fd692ffd640 1 -- 172.21.15.5:0/3356667821 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6840ab650 con 0x7fd694070b70 2023-07-14T13:33:02.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.567+0000 7fd692ffd640 1 -- 172.21.15.5:0/3356667821 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6840ab7b0 con 0x7fd694070b70 2023-07-14T13:33:02.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.567+0000 7fd692ffd640 1 -- 172.21.15.5:0/3356667821 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6840abb20 con 0x7fd694070b70 2023-07-14T13:33:02.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.567+0000 7fd69a29c640 1 -- 172.21.15.5:0/3356667821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd694070b70 msgr2=0x7fd694070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.567+0000 7fd69a29c640 1 --2- 172.21.15.5:0/3356667821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd694070b70 0x7fd694070f40 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fd6840097c0 tx=0x7fd68401c450 comp rx=0 tx=0).stop 2023-07-14T13:33:02.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.567+0000 7fd69a29c640 1 -- 172.21.15.5:0/3356667821 shutdown_connections 2023-07-14T13:33:02.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.567+0000 7fd69a29c640 1 --2- 172.21.15.5:0/3356667821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd694070b70 0x7fd694070f40 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:02.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.567+0000 7fd69a29c640 1 -- 172.21.15.5:0/3356667821 >> 172.21.15.5:0/3356667821 conn(0x7fd6940afcf0 msgr2=0x7fd6940b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:02.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.567+0000 7fd69a29c640 1 -- 172.21.15.5:0/3356667821 shutdown_connections 2023-07-14T13:33:02.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.567+0000 7fd69a29c640 1 -- 172.21.15.5:0/3356667821 wait complete. 2023-07-14T13:33:02.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.571+0000 7fd69a29c640 1 Processor -- start 2023-07-14T13:33:02.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.571+0000 7fd69a29c640 1 -- start start 2023-07-14T13:33:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.571+0000 7fd69a29c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd69406b1e0 0x7fd69414dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.571+0000 7fd69a29c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd694070b70 0x7fd694152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.571+0000 7fd69a29c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6940cb100 0x7fd694158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.571+0000 7fd69a29c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69414ec00 con 0x7fd6940cb100 2023-07-14T13:33:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.571+0000 7fd69a29c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69414eee0 con 0x7fd69406b1e0 2023-07-14T13:33:02.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.571+0000 7fd69a29c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd69414f1c0 con 0x7fd694070b70 2023-07-14T13:33:02.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.571+0000 7fd698839640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6940cb100 0x7fd694158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:02.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.571+0000 7fd698839640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6940cb100 0x7fd694158b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55284/0 (socket says 172.21.15.5:55284) 2023-07-14T13:33:02.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.571+0000 7fd698839640 1 -- 172.21.15.5:0/2360445016 learned_addr learned my addr 172.21.15.5:0/2360445016 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:02.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.571+0000 7fd693fff640 1 --2- 172.21.15.5:0/2360445016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd69406b1e0 0x7fd69414dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:02.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.571+0000 7fd6937fe640 1 --2- 172.21.15.5:0/2360445016 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd694070b70 0x7fd694152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:02.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.571+0000 7fd698839640 1 -- 172.21.15.5:0/2360445016 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd694070b70 msgr2=0x7fd694152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.571+0000 7fd698839640 1 --2- 172.21.15.5:0/2360445016 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd694070b70 0x7fd694152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:02.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.571+0000 7fd698839640 1 -- 172.21.15.5:0/2360445016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd69406b1e0 msgr2=0x7fd69414dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.571+0000 7fd698839640 1 --2- 172.21.15.5:0/2360445016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd69406b1e0 0x7fd69414dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:02.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.571+0000 7fd698839640 1 -- 172.21.15.5:0/2360445016 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd684009420 con 0x7fd6940cb100 2023-07-14T13:33:02.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.571+0000 7fd698839640 1 --2- 172.21.15.5:0/2360445016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6940cb100 0x7fd694158b40 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7fd68c00cac0 tx=0x7fd68c00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:02.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.571+0000 7fd690ff9640 1 -- 172.21.15.5:0/2360445016 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c00ac30 con 0x7fd6940cb100 2023-07-14T13:33:02.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.571+0000 7fd690ff9640 1 -- 172.21.15.5:0/2360445016 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68c00ad90 con 0x7fd6940cb100 2023-07-14T13:33:02.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.571+0000 7fd690ff9640 1 -- 172.21.15.5:0/2360445016 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c012600 con 0x7fd6940cb100 2023-07-14T13:33:02.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.571+0000 7fd69a29c640 1 -- 172.21.15.5:0/2360445016 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd69414f4a0 con 0x7fd6940cb100 2023-07-14T13:33:02.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.571+0000 7fd69a29c640 1 -- 172.21.15.5:0/2360445016 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd69414e530 con 0x7fd6940cb100 2023-07-14T13:33:02.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.571+0000 7fd69a29c640 1 -- 172.21.15.5:0/2360445016 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6940678d0 con 0x7fd6940cb100 2023-07-14T13:33:02.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.575+0000 7fd690ff9640 1 -- 172.21.15.5:0/2360445016 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd68c007070 con 0x7fd6940cb100 2023-07-14T13:33:02.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.575+0000 7fd690ff9640 1 --2- 172.21.15.5:0/2360445016 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fd6800663a0 0x7fd680068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:02.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.575+0000 7fd690ff9640 1 -- 172.21.15.5:0/2360445016 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7fd68c083dd0 con 0x7fd6940cb100 2023-07-14T13:33:02.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.575+0000 7fd693fff640 1 --2- 172.21.15.5:0/2360445016 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fd6800663a0 0x7fd680068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:02.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.575+0000 7fd693fff640 1 --2- 172.21.15.5:0/2360445016 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fd6800663a0 0x7fd680068850 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd6840af000 tx=0x7fd6840a7000 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:02.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.579+0000 7fd690ff9640 1 -- 172.21.15.5:0/2360445016 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd68c0510c0 con 0x7fd6940cb100 2023-07-14T13:33:02.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.731+0000 7fd69a29c640 1 -- 172.21.15.5:0/2360445016 --> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6940c23c0 con 0x7fd6800663a0 2023-07-14T13:33:02.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.735+0000 7fd690ff9640 1 -- 172.21.15.5:0/2360445016 <== mgr.10192 v2:172.21.15.154:6832/317858933 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd6840ab920 con 0x7fd6800663a0 2023-07-14T13:33:02.732 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 1 to deep-scrub 2023-07-14T13:33:02.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.735+0000 7fd69a29c640 1 -- 172.21.15.5:0/2360445016 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fd6800663a0 msgr2=0x7fd680068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.735+0000 7fd69a29c640 1 --2- 172.21.15.5:0/2360445016 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fd6800663a0 0x7fd680068850 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd6840af000 tx=0x7fd6840a7000 comp rx=0 tx=0).stop 2023-07-14T13:33:02.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.735+0000 7fd69a29c640 1 -- 172.21.15.5:0/2360445016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6940cb100 msgr2=0x7fd694158b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.735+0000 7fd69a29c640 1 --2- 172.21.15.5:0/2360445016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6940cb100 0x7fd694158b40 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7fd68c00cac0 tx=0x7fd68c00cf80 comp rx=0 tx=0).stop 2023-07-14T13:33:02.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.735+0000 7fd69a29c640 1 -- 172.21.15.5:0/2360445016 shutdown_connections 2023-07-14T13:33:02.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.735+0000 7fd69a29c640 1 --2- 172.21.15.5:0/2360445016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6940cb100 0x7fd694158b40 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:02.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.735+0000 7fd69a29c640 1 --2- 172.21.15.5:0/2360445016 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fd6800663a0 0x7fd680068850 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:02.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.735+0000 7fd69a29c640 1 --2- 172.21.15.5:0/2360445016 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd694070b70 0x7fd694152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:02.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.735+0000 7fd69a29c640 1 --2- 172.21.15.5:0/2360445016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd69406b1e0 0x7fd69414dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:02.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.735+0000 7fd69a29c640 1 -- 172.21.15.5:0/2360445016 >> 172.21.15.5:0/2360445016 conn(0x7fd6940afcf0 msgr2=0x7fd6940c44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:02.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.735+0000 7fd69a29c640 1 -- 172.21.15.5:0/2360445016 shutdown_connections 2023-07-14T13:33:02.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.735+0000 7fd69a29c640 1 -- 172.21.15.5:0/2360445016 wait complete. 2023-07-14T13:33:02.753 INFO:tasks.ceph:Scrubbing osd.2 2023-07-14T13:33:02.754 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-07-14T13:33:02.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.907+0000 7f60f0048640 1 Processor -- start 2023-07-14T13:33:02.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.907+0000 7f60f0048640 1 -- start start 2023-07-14T13:33:02.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.907+0000 7f60f0048640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f60e80cd830 0x7f60e80c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:02.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.907+0000 7f60f0048640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e80695b0 con 0x7f60e80af2b0 2023-07-14T13:33:02.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.907+0000 7f60f0048640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e8069890 con 0x7f60e80c3ac0 2023-07-14T13:33:02.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.907+0000 7f60f0048640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e8069b70 con 0x7f60e80cd830 2023-07-14T13:33:02.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.907+0000 7f60ed5e3640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f60e80af2b0 0x7f60e80cd120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35330/0 (socket says 172.21.15.5:35330) 2023-07-14T13:33:02.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.907+0000 7f60ed5e3640 1 -- 172.21.15.5:0/1328334808 learned_addr learned my addr 172.21.15.5:0/1328334808 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:33:02.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.907+0000 7f60ee5e5640 1 --2- 172.21.15.5:0/1328334808 >> v2:172.21.15.5:3300/0 conn(0x7f60e80cd830 0x7f60e80c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:02.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.907+0000 7f60ecde2640 1 -- 172.21.15.5:0/1328334808 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131100228 0 0) 0x7f60e80695b0 con 0x7f60e80af2b0 2023-07-14T13:33:02.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.907+0000 7f60ecde2640 1 -- 172.21.15.5:0/1328334808 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60d4003530 con 0x7f60e80af2b0 2023-07-14T13:33:02.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.907+0000 7f60ecde2640 1 -- 172.21.15.5:0/1328334808 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1211296210 0 0) 0x7f60e8069890 con 0x7f60e80c3ac0 2023-07-14T13:33:02.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.907+0000 7f60ee5e5640 1 -- 172.21.15.5:0/1328334808 >> v1:172.21.15.154:6789/0 conn(0x7f60e80c3ac0 legacy=0x7f60e80ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.907+0000 7f60ee5e5640 1 -- 172.21.15.5:0/1328334808 >> v1:172.21.15.5:6789/0 conn(0x7f60e80af2b0 legacy=0x7f60e80cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.907+0000 7f60ee5e5640 1 -- 172.21.15.5:0/1328334808 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e8069e50 con 0x7f60e80cd830 2023-07-14T13:33:02.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.911+0000 7f60ee5e5640 1 --2- 172.21.15.5:0/1328334808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80cd830 0x7f60e80c2d30 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009d90 tx=0x7f60e001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df85299640c97ec5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:02.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.911+0000 7f60ecde2640 1 -- 172.21.15.5:0/1328334808 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e00a5a30 con 0x7f60e80cd830 2023-07-14T13:33:02.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.911+0000 7f60ecde2640 1 -- 172.21.15.5:0/1328334808 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e00a5b90 con 0x7f60e80cd830 2023-07-14T13:33:02.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.911+0000 7f60ecde2640 1 -- 172.21.15.5:0/1328334808 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e00ad440 con 0x7f60e80cd830 2023-07-14T13:33:02.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.911+0000 7f60f0048640 1 -- 172.21.15.5:0/1328334808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80cd830 msgr2=0x7f60e80c2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.911+0000 7f60f0048640 1 --2- 172.21.15.5:0/1328334808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80cd830 0x7f60e80c2d30 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009d90 tx=0x7f60e001c950 comp rx=0 tx=0).stop 2023-07-14T13:33:02.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.911+0000 7f60f0048640 1 -- 172.21.15.5:0/1328334808 shutdown_connections 2023-07-14T13:33:02.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.911+0000 7f60f0048640 1 --2- 172.21.15.5:0/1328334808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80cd830 0x7f60e80c2d30 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:02.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.911+0000 7f60f0048640 1 -- 172.21.15.5:0/1328334808 >> 172.21.15.5:0/1328334808 conn(0x7f60e80cde90 msgr2=0x7f60e80ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:02.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.911+0000 7f60f0048640 1 -- 172.21.15.5:0/1328334808 shutdown_connections 2023-07-14T13:33:02.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.911+0000 7f60f0048640 1 -- 172.21.15.5:0/1328334808 wait complete. 2023-07-14T13:33:02.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.915+0000 7f60f0048640 1 Processor -- start 2023-07-14T13:33:02.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.915+0000 7f60f0048640 1 -- start start 2023-07-14T13:33:02.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.915+0000 7f60f0048640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60e80af2b0 0x7f60e8151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:02.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.915+0000 7f60f0048640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80c3ac0 0x7f60e81529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:02.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.915+0000 7f60f0048640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60e80cd830 0x7f60e8146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:02.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.915+0000 7f60f0048640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e815a740 con 0x7f60e80c3ac0 2023-07-14T13:33:02.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.915+0000 7f60f0048640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e8151900 con 0x7f60e80cd830 2023-07-14T13:33:02.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.915+0000 7f60f0048640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e8151be0 con 0x7f60e80af2b0 2023-07-14T13:33:02.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.915+0000 7f60ed5e3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80c3ac0 0x7f60e81529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:02.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.915+0000 7f60ed5e3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80c3ac0 0x7f60e81529a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55302/0 (socket says 172.21.15.5:55302) 2023-07-14T13:33:02.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.915+0000 7f60ed5e3640 1 -- 172.21.15.5:0/2823729759 learned_addr learned my addr 172.21.15.5:0/2823729759 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:02.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.915+0000 7f60ee5e5640 1 --2- 172.21.15.5:0/2823729759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60e80cd830 0x7f60e8146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:02.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.915+0000 7f60edde4640 1 --2- 172.21.15.5:0/2823729759 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60e80af2b0 0x7f60e8151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:02.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.915+0000 7f60ed5e3640 1 -- 172.21.15.5:0/2823729759 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60e80af2b0 msgr2=0x7f60e8151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.915+0000 7f60ed5e3640 1 --2- 172.21.15.5:0/2823729759 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f60e80af2b0 0x7f60e8151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:02.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.915+0000 7f60ed5e3640 1 -- 172.21.15.5:0/2823729759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60e80cd830 msgr2=0x7f60e8146020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.915+0000 7f60ed5e3640 1 --2- 172.21.15.5:0/2823729759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60e80cd830 0x7f60e8146020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:02.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.915+0000 7f60ed5e3640 1 -- 172.21.15.5:0/2823729759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e0009a70 con 0x7f60e80c3ac0 2023-07-14T13:33:02.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.915+0000 7f60ed5e3640 1 --2- 172.21.15.5:0/2823729759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80c3ac0 0x7f60e81529a0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f60d800c450 tx=0x7f60d800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:02.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.915+0000 7f60de7fc640 1 -- 172.21.15.5:0/2823729759 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d8005cf0 con 0x7f60e80c3ac0 2023-07-14T13:33:02.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.915+0000 7f60de7fc640 1 -- 172.21.15.5:0/2823729759 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d8005e50 con 0x7f60e80c3ac0 2023-07-14T13:33:02.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.915+0000 7f60f0048640 1 -- 172.21.15.5:0/2823729759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e8151ec0 con 0x7f60e80c3ac0 2023-07-14T13:33:02.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.915+0000 7f60de7fc640 1 -- 172.21.15.5:0/2823729759 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d8007290 con 0x7f60e80c3ac0 2023-07-14T13:33:02.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.915+0000 7f60f0048640 1 -- 172.21.15.5:0/2823729759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e8152480 con 0x7f60e80c3ac0 2023-07-14T13:33:02.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.919+0000 7f60f0048640 1 -- 172.21.15.5:0/2823729759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f60e80678d0 con 0x7f60e80c3ac0 2023-07-14T13:33:02.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.919+0000 7f60de7fc640 1 -- 172.21.15.5:0/2823729759 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f60d80073f0 con 0x7f60e80c3ac0 2023-07-14T13:33:02.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.919+0000 7f60de7fc640 1 --2- 172.21.15.5:0/2823729759 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f60cc0663a0 0x7f60cc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:02.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.919+0000 7f60de7fc640 1 -- 172.21.15.5:0/2823729759 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7f60d8083c30 con 0x7f60e80c3ac0 2023-07-14T13:33:02.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.919+0000 7f60de7fc640 1 --2- 172.21.15.5:0/2823729759 >> [v2:172.21.15.5:6800/559368967,v1:172.21.15.5:6801/559368967] conn(0x7f60cc06ce50 0x7f60cc06f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:02.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.919+0000 7f60de7fc640 1 -- 172.21.15.5:0/2823729759 --> [v2:172.21.15.5:6800/559368967,v1:172.21.15.5:6801/559368967] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f60cc06f930 con 0x7f60cc06ce50 2023-07-14T13:33:02.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.919+0000 7f60de7fc640 1 -- 172.21.15.5:0/2823729759 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=196) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60d8083fa0 con 0x7f60e80c3ac0 2023-07-14T13:33:02.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.919+0000 7f60edde4640 1 --2- 172.21.15.5:0/2823729759 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f60cc0663a0 0x7f60cc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:02.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.919+0000 7f60ee5e5640 1 --2- 172.21.15.5:0/2823729759 >> [v2:172.21.15.5:6800/559368967,v1:172.21.15.5:6801/559368967] conn(0x7f60cc06ce50 0x7f60cc06f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:02.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.919+0000 7f60ee5e5640 1 --2- 172.21.15.5:0/2823729759 >> [v2:172.21.15.5:6800/559368967,v1:172.21.15.5:6801/559368967] conn(0x7f60cc06ce50 0x7f60cc06f260 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:02.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.919+0000 7f60edde4640 1 --2- 172.21.15.5:0/2823729759 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f60cc0663a0 0x7f60cc068850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f60e4000f70 tx=0x7f60e4009040 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:02.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.923+0000 7f60de7fc640 1 -- 172.21.15.5:0/2823729759 <== osd.2 v2:172.21.15.5:6800/559368967 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f60cc06f930 con 0x7f60cc06ce50 2023-07-14T13:33:02.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.935+0000 7f60f0048640 1 -- 172.21.15.5:0/2823729759 --> [v2:172.21.15.5:6800/559368967,v1:172.21.15.5:6801/559368967] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f60e80aeb80 con 0x7f60cc06ce50 2023-07-14T13:33:02.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.935+0000 7f60de7fc640 1 -- 172.21.15.5:0/2823729759 <== osd.2 v2:172.21.15.5:6800/559368967 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f60e80aeb80 con 0x7f60cc06ce50 2023-07-14T13:33:02.932 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T13:33:02.932 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-14T13:33:02.933 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T13:33:02.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.935+0000 7f60f0048640 1 -- 172.21.15.5:0/2823729759 >> [v2:172.21.15.5:6800/559368967,v1:172.21.15.5:6801/559368967] conn(0x7f60cc06ce50 msgr2=0x7f60cc06f260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.935+0000 7f60f0048640 1 --2- 172.21.15.5:0/2823729759 >> [v2:172.21.15.5:6800/559368967,v1:172.21.15.5:6801/559368967] conn(0x7f60cc06ce50 0x7f60cc06f260 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:02.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.935+0000 7f60f0048640 1 -- 172.21.15.5:0/2823729759 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f60cc0663a0 msgr2=0x7f60cc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.935+0000 7f60f0048640 1 --2- 172.21.15.5:0/2823729759 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f60cc0663a0 0x7f60cc068850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f60e4000f70 tx=0x7f60e4009040 comp rx=0 tx=0).stop 2023-07-14T13:33:02.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.935+0000 7f60f0048640 1 -- 172.21.15.5:0/2823729759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80c3ac0 msgr2=0x7f60e81529a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:02.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.935+0000 7f60f0048640 1 --2- 172.21.15.5:0/2823729759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60e80c3ac0 0x7f60e81529a0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f60d800c450 tx=0x7f60d800c910 comp rx=0 tx=0).stop 2023-07-14T13:33:02.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.935+0000 7f60ee5e5640 1 -- 172.21.15.5:0/2823729759 reap_dead start 2023-07-14T13:33:02.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.935+0000 7f60f0048640 1 -- 172.21.15.5:0/2823729759 shutdown_connections 2023-07-14T13:33:02.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.935+0000 7f60f0048640 1 -- 172.21.15.5:0/2823729759 >> 172.21.15.5:0/2823729759 conn(0x7f60e80cde90 msgr2=0x7f60e8070a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:02.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.935+0000 7f60f0048640 1 -- 172.21.15.5:0/2823729759 shutdown_connections 2023-07-14T13:33:02.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:02.935+0000 7f60f0048640 1 -- 172.21.15.5:0/2823729759 wait complete. 2023-07-14T13:33:02.950 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-07-14T13:33:03.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.099+0000 7fed9f69c640 1 Processor -- start 2023-07-14T13:33:03.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.099+0000 7fed9f69c640 1 -- start start 2023-07-14T13:33:03.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.099+0000 7fed9f69c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fed980c8ad0 0x7fed980c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.099+0000 7fed9f69c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed980c9560 0x7fed980ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.099+0000 7fed9f69c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed980cc700 con 0x7fed98158ce0 2023-07-14T13:33:03.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.099+0000 7fed9f69c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed980c99e0 con 0x7fed980c8ad0 2023-07-14T13:33:03.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.099+0000 7fed9f69c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed980b0ff0 con 0x7fed980c9560 2023-07-14T13:33:03.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.099+0000 7fed9d438640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fed98158ce0 0x7fed98070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35336/0 (socket says 172.21.15.5:35336) 2023-07-14T13:33:03.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.099+0000 7fed9d438640 1 -- 172.21.15.5:0/1119418916 learned_addr learned my addr 172.21.15.5:0/1119418916 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:33:03.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.099+0000 7fed9dc39640 1 --2- 172.21.15.5:0/1119418916 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed980c9560 0x7fed980ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:03.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.099+0000 7fed9cc37640 1 --2- 172.21.15.5:0/1119418916 >> v2:172.21.15.154:3300/0 conn(0x7fed980c8ad0 0x7fed980c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:03.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.099+0000 7fed8ffff640 1 -- 172.21.15.5:0/1119418916 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1021012353 0 0) 0x7fed980cc700 con 0x7fed98158ce0 2023-07-14T13:33:03.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.099+0000 7fed8ffff640 1 -- 172.21.15.5:0/1119418916 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed84003530 con 0x7fed98158ce0 2023-07-14T13:33:03.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.099+0000 7fed9dc39640 1 -- 172.21.15.5:0/1119418916 >> v2:172.21.15.154:3300/0 conn(0x7fed980c8ad0 msgr2=0x7fed980c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:03.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.099+0000 7fed9dc39640 1 --2- 172.21.15.5:0/1119418916 >> v2:172.21.15.154:3300/0 conn(0x7fed980c8ad0 0x7fed980c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.099+0000 7fed8ffff640 1 -- 172.21.15.5:0/1119418916 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 551699427 0 0) 0x7fed84003530 con 0x7fed98158ce0 2023-07-14T13:33:03.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.099+0000 7fed9dc39640 1 -- 172.21.15.5:0/1119418916 >> v1:172.21.15.5:6789/0 conn(0x7fed98158ce0 legacy=0x7fed98070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:03.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.099+0000 7fed9dc39640 1 -- 172.21.15.5:0/1119418916 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed98070c80 con 0x7fed980c9560 2023-07-14T13:33:03.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.103+0000 7fed9dc39640 1 --2- 172.21.15.5:0/1119418916 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed980c9560 0x7fed980ccb90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fed90009d90 tx=0x7fed9001c720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cd0ea619c54fa13 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:03.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.103+0000 7fed8ffff640 1 -- 172.21.15.5:0/1119418916 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed94001680 con 0x7fed980c9560 2023-07-14T13:33:03.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.103+0000 7fed8ffff640 1 -- 172.21.15.5:0/1119418916 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed900a6440 con 0x7fed980c9560 2023-07-14T13:33:03.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.103+0000 7fed8ffff640 1 -- 172.21.15.5:0/1119418916 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed900a67b0 con 0x7fed980c9560 2023-07-14T13:33:03.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.103+0000 7fed9f69c640 1 -- 172.21.15.5:0/1119418916 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed980c9560 msgr2=0x7fed980ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:03.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.103+0000 7fed9f69c640 1 --2- 172.21.15.5:0/1119418916 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed980c9560 0x7fed980ccb90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fed90009d90 tx=0x7fed9001c720 comp rx=0 tx=0).stop 2023-07-14T13:33:03.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.103+0000 7fed9f69c640 1 -- 172.21.15.5:0/1119418916 shutdown_connections 2023-07-14T13:33:03.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.103+0000 7fed9f69c640 1 --2- 172.21.15.5:0/1119418916 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed980c9560 0x7fed980ccb90 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.103+0000 7fed9f69c640 1 --2- 172.21.15.5:0/1119418916 >> v2:172.21.15.154:3300/0 conn(0x7fed980c8ad0 0x7fed980c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.103+0000 7fed9f69c640 1 -- 172.21.15.5:0/1119418916 >> 172.21.15.5:0/1119418916 conn(0x7fed980afcf0 msgr2=0x7fed980b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:03.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.103+0000 7fed9f69c640 1 -- 172.21.15.5:0/1119418916 shutdown_connections 2023-07-14T13:33:03.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.103+0000 7fed9f69c640 1 -- 172.21.15.5:0/1119418916 wait complete. 2023-07-14T13:33:03.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.107+0000 7fed9f69c640 1 Processor -- start 2023-07-14T13:33:03.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.107+0000 7fed9f69c640 1 -- start start 2023-07-14T13:33:03.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.107+0000 7fed9f69c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed980c8ad0 0x7fed980c4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.107+0000 7fed9f69c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed980c9560 0x7fed980b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.107+0000 7fed9f69c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed98158ce0 0x7fed980c2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.107+0000 7fed9f69c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed980c80e0 con 0x7fed980c9560 2023-07-14T13:33:03.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.107+0000 7fed9f69c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed980c3a40 con 0x7fed980c8ad0 2023-07-14T13:33:03.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.107+0000 7fed9f69c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed980c4050 con 0x7fed98158ce0 2023-07-14T13:33:03.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.107+0000 7fed9cc37640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed980c9560 0x7fed980b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:03.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.107+0000 7fed9cc37640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed980c9560 0x7fed980b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55306/0 (socket says 172.21.15.5:55306) 2023-07-14T13:33:03.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.107+0000 7fed9cc37640 1 -- 172.21.15.5:0/920366114 learned_addr learned my addr 172.21.15.5:0/920366114 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:03.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.107+0000 7fed9d438640 1 --2- 172.21.15.5:0/920366114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed980c8ad0 0x7fed980c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:03.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.107+0000 7fed9cc37640 1 -- 172.21.15.5:0/920366114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed98158ce0 msgr2=0x7fed980c2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:03.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.107+0000 7fed9cc37640 1 --2- 172.21.15.5:0/920366114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed98158ce0 0x7fed980c2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.107+0000 7fed9cc37640 1 -- 172.21.15.5:0/920366114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed980c8ad0 msgr2=0x7fed980c4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:03.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.107+0000 7fed9cc37640 1 --2- 172.21.15.5:0/920366114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed980c8ad0 0x7fed980c4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.107+0000 7fed9cc37640 1 -- 172.21.15.5:0/920366114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed90009a70 con 0x7fed980c9560 2023-07-14T13:33:03.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.107+0000 7fed9cc37640 1 --2- 172.21.15.5:0/920366114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed980c9560 0x7fed980b1130 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7fed8800e930 tx=0x7fed8800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:03.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.107+0000 7fed8dffb640 1 -- 172.21.15.5:0/920366114 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed88009690 con 0x7fed980c9560 2023-07-14T13:33:03.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.107+0000 7fed8dffb640 1 -- 172.21.15.5:0/920366114 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8800ca00 con 0x7fed980c9560 2023-07-14T13:33:03.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.107+0000 7fed8dffb640 1 -- 172.21.15.5:0/920366114 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8800cd70 con 0x7fed980c9560 2023-07-14T13:33:03.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.107+0000 7fed9f69c640 1 -- 172.21.15.5:0/920366114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed980c7e00 con 0x7fed980c9560 2023-07-14T13:33:03.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.107+0000 7fed9f69c640 1 -- 172.21.15.5:0/920366114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed980c7a40 con 0x7fed980c9560 2023-07-14T13:33:03.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.111+0000 7fed9f69c640 1 -- 172.21.15.5:0/920366114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed980ca1a0 con 0x7fed980c9560 2023-07-14T13:33:03.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.111+0000 7fed8dffb640 1 -- 172.21.15.5:0/920366114 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fed88013470 con 0x7fed980c9560 2023-07-14T13:33:03.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.111+0000 7fed8dffb640 1 --2- 172.21.15.5:0/920366114 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fed7c0663a0 0x7fed7c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.111+0000 7fed8dffb640 1 -- 172.21.15.5:0/920366114 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7fed880840d0 con 0x7fed980c9560 2023-07-14T13:33:03.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.111+0000 7fed9d438640 1 --2- 172.21.15.5:0/920366114 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fed7c0663a0 0x7fed7c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:03.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.111+0000 7fed9d438640 1 --2- 172.21.15.5:0/920366114 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fed7c0663a0 0x7fed7c068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fed94006ae0 tx=0x7fed94001d30 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:03.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.115+0000 7fed8dffb640 1 -- 172.21.15.5:0/920366114 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fed88051520 con 0x7fed980c9560 2023-07-14T13:33:03.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.271+0000 7fed9f69c640 1 -- 172.21.15.5:0/920366114 --> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fed981590b0 con 0x7fed7c0663a0 2023-07-14T13:33:03.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.271+0000 7fed8dffb640 1 -- 172.21.15.5:0/920366114 <== mgr.10192 v2:172.21.15.154:6832/317858933 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fed9400f830 con 0x7fed7c0663a0 2023-07-14T13:33:03.270 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 2 to deep-scrub 2023-07-14T13:33:03.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.275+0000 7fed9f69c640 1 -- 172.21.15.5:0/920366114 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fed7c0663a0 msgr2=0x7fed7c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:03.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.275+0000 7fed9f69c640 1 --2- 172.21.15.5:0/920366114 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fed7c0663a0 0x7fed7c068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fed94006ae0 tx=0x7fed94001d30 comp rx=0 tx=0).stop 2023-07-14T13:33:03.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.275+0000 7fed9f69c640 1 -- 172.21.15.5:0/920366114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed980c9560 msgr2=0x7fed980b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:03.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.275+0000 7fed9f69c640 1 --2- 172.21.15.5:0/920366114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed980c9560 0x7fed980b1130 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7fed8800e930 tx=0x7fed8800edf0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.275+0000 7fed9f69c640 1 -- 172.21.15.5:0/920366114 shutdown_connections 2023-07-14T13:33:03.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.275+0000 7fed9f69c640 1 --2- 172.21.15.5:0/920366114 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fed7c0663a0 0x7fed7c068850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.275+0000 7fed9f69c640 1 --2- 172.21.15.5:0/920366114 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fed98158ce0 0x7fed980c2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.275+0000 7fed9f69c640 1 --2- 172.21.15.5:0/920366114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed980c9560 0x7fed980b1130 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.275+0000 7fed9f69c640 1 --2- 172.21.15.5:0/920366114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed980c8ad0 0x7fed980c4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.275+0000 7fed9f69c640 1 -- 172.21.15.5:0/920366114 >> 172.21.15.5:0/920366114 conn(0x7fed980afcf0 msgr2=0x7fed980abe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:03.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.275+0000 7fed9f69c640 1 -- 172.21.15.5:0/920366114 shutdown_connections 2023-07-14T13:33:03.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.275+0000 7fed9f69c640 1 -- 172.21.15.5:0/920366114 wait complete. 2023-07-14T13:33:03.291 INFO:tasks.ceph:Scrubbing osd.3 2023-07-14T13:33:03.292 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-07-14T13:33:03.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.443+0000 7ff06eb96640 1 Processor -- start 2023-07-14T13:33:03.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.443+0000 7ff06eb96640 1 -- start start 2023-07-14T13:33:03.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.443+0000 7ff06eb96640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff068069430 0x7ff068069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.443+0000 7ff06eb96640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff0680af2b0 0x7ff06815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.443+0000 7ff06eb96640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff068159d70 con 0x7ff068070f30 2023-07-14T13:33:03.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.443+0000 7ff06eb96640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff068069d40 con 0x7ff068069430 2023-07-14T13:33:03.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.443+0000 7ff06eb96640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0680c9c60 con 0x7ff0680af2b0 2023-07-14T13:33:03.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.443+0000 7ff06c932640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff068069430 0x7ff068069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:03.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.443+0000 7ff06c932640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff068069430 0x7ff068069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55322/0 (socket says 172.21.15.5:55322) 2023-07-14T13:33:03.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.443+0000 7ff06c932640 1 -- 172.21.15.5:0/2796392858 learned_addr learned my addr 172.21.15.5:0/2796392858 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:03.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.447+0000 7ff06c932640 1 -- 172.21.15.5:0/2796392858 >> v2:172.21.15.154:3300/0 conn(0x7ff0680af2b0 msgr2=0x7ff06815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:03.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.447+0000 7ff06d133640 1 --2- 172.21.15.5:0/2796392858 >> v2:172.21.15.154:3300/0 conn(0x7ff0680af2b0 0x7ff06815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:03.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.447+0000 7ff06c932640 1 --2- 172.21.15.5:0/2796392858 >> v2:172.21.15.154:3300/0 conn(0x7ff0680af2b0 0x7ff06815a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.447+0000 7ff06c932640 1 -- 172.21.15.5:0/2796392858 >> v1:172.21.15.154:6789/0 conn(0x7ff068070f30 legacy=0x7ff0680ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:03.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.447+0000 7ff06c932640 1 -- 172.21.15.5:0/2796392858 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0680c9f40 con 0x7ff068069430 2023-07-14T13:33:03.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.447+0000 7ff06d133640 1 --2- 172.21.15.5:0/2796392858 >> v2:172.21.15.154:3300/0 conn(0x7ff0680af2b0 0x7ff06815a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:33:03.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.447+0000 7ff06c932640 1 --2- 172.21.15.5:0/2796392858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff068069430 0x7ff068069800 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7ff0680cef70 tx=0x7ff05c01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bccdd1d3e5f15bb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:03.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.447+0000 7ff0677fe640 1 -- 172.21.15.5:0/2796392858 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c0aa620 con 0x7ff068069430 2023-07-14T13:33:03.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.447+0000 7ff0677fe640 1 -- 172.21.15.5:0/2796392858 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05c0aa780 con 0x7ff068069430 2023-07-14T13:33:03.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.447+0000 7ff0677fe640 1 -- 172.21.15.5:0/2796392858 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c0aab10 con 0x7ff068069430 2023-07-14T13:33:03.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.447+0000 7ff06eb96640 1 -- 172.21.15.5:0/2796392858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff068069430 msgr2=0x7ff068069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:03.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.447+0000 7ff06eb96640 1 --2- 172.21.15.5:0/2796392858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff068069430 0x7ff068069800 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7ff0680cef70 tx=0x7ff05c01c4c0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.451+0000 7ff06eb96640 1 -- 172.21.15.5:0/2796392858 shutdown_connections 2023-07-14T13:33:03.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.451+0000 7ff06eb96640 1 --2- 172.21.15.5:0/2796392858 >> v2:172.21.15.154:3300/0 conn(0x7ff0680af2b0 0x7ff06815a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.451+0000 7ff06eb96640 1 --2- 172.21.15.5:0/2796392858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff068069430 0x7ff068069800 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.451+0000 7ff06eb96640 1 -- 172.21.15.5:0/2796392858 >> 172.21.15.5:0/2796392858 conn(0x7ff0680cde90 msgr2=0x7ff0680ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:03.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.451+0000 7ff06eb96640 1 -- 172.21.15.5:0/2796392858 shutdown_connections 2023-07-14T13:33:03.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.451+0000 7ff06eb96640 1 -- 172.21.15.5:0/2796392858 wait complete. 2023-07-14T13:33:03.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.451+0000 7ff06eb96640 1 Processor -- start 2023-07-14T13:33:03.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.451+0000 7ff06eb96640 1 -- start start 2023-07-14T13:33:03.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.451+0000 7ff06eb96640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff068069430 0x7ff068147d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.451+0000 7ff06eb96640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff068070f30 0x7ff06814c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.451+0000 7ff06eb96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0680af2b0 0x7ff06814a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.451+0000 7ff06eb96640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff068157890 con 0x7ff068069430 2023-07-14T13:33:03.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.451+0000 7ff06eb96640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff068157b70 con 0x7ff0680af2b0 2023-07-14T13:33:03.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.451+0000 7ff06eb96640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff068157e50 con 0x7ff068070f30 2023-07-14T13:33:03.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.451+0000 7ff06c932640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff068069430 0x7ff068147d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:03.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.451+0000 7ff06c932640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff068069430 0x7ff068147d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55332/0 (socket says 172.21.15.5:55332) 2023-07-14T13:33:03.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.451+0000 7ff06c932640 1 -- 172.21.15.5:0/2402819383 learned_addr learned my addr 172.21.15.5:0/2402819383 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:03.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.451+0000 7ff06d133640 1 --2- 172.21.15.5:0/2402819383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0680af2b0 0x7ff06814a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:03.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.451+0000 7ff067fff640 1 --2- 172.21.15.5:0/2402819383 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff068070f30 0x7ff06814c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:03.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.451+0000 7ff06c932640 1 -- 172.21.15.5:0/2402819383 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff068070f30 msgr2=0x7ff06814c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:03.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.451+0000 7ff06c932640 1 --2- 172.21.15.5:0/2402819383 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff068070f30 0x7ff06814c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.451+0000 7ff06c932640 1 -- 172.21.15.5:0/2402819383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0680af2b0 msgr2=0x7ff06814a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:03.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.451+0000 7ff06c932640 1 --2- 172.21.15.5:0/2402819383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0680af2b0 0x7ff06814a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.451+0000 7ff06c932640 1 -- 172.21.15.5:0/2402819383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05c0094d0 con 0x7ff068069430 2023-07-14T13:33:03.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.451+0000 7ff06c932640 1 --2- 172.21.15.5:0/2402819383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff068069430 0x7ff068147d60 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7ff05c01a0f0 tx=0x7ff05c01ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:03.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.455+0000 7ff0657fa640 1 -- 172.21.15.5:0/2402819383 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c0bd3f0 con 0x7ff068069430 2023-07-14T13:33:03.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.455+0000 7ff0657fa640 1 -- 172.21.15.5:0/2402819383 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05c0bd550 con 0x7ff068069430 2023-07-14T13:33:03.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.455+0000 7ff06eb96640 1 -- 172.21.15.5:0/2402819383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff068158130 con 0x7ff068069430 2023-07-14T13:33:03.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.455+0000 7ff0657fa640 1 -- 172.21.15.5:0/2402819383 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c0bd900 con 0x7ff068069430 2023-07-14T13:33:03.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.455+0000 7ff06eb96640 1 -- 172.21.15.5:0/2402819383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0681482a0 con 0x7ff068069430 2023-07-14T13:33:03.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.455+0000 7ff06eb96640 1 -- 172.21.15.5:0/2402819383 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff068157710 con 0x7ff068069430 2023-07-14T13:33:03.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.455+0000 7ff0657fa640 1 -- 172.21.15.5:0/2402819383 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff05c0b33f0 con 0x7ff068069430 2023-07-14T13:33:03.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.455+0000 7ff0657fa640 1 --2- 172.21.15.5:0/2402819383 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7ff04c0663a0 0x7ff04c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.455+0000 7ff0657fa640 1 -- 172.21.15.5:0/2402819383 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7ff05c11e4f0 con 0x7ff068069430 2023-07-14T13:33:03.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.455+0000 7ff0657fa640 1 --2- 172.21.15.5:0/2402819383 >> [v2:172.21.15.5:6824/4061664720,v1:172.21.15.5:6825/4061664720] conn(0x7ff04c06ce50 0x7ff04c06f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.455+0000 7ff0657fa640 1 -- 172.21.15.5:0/2402819383 --> [v2:172.21.15.5:6824/4061664720,v1:172.21.15.5:6825/4061664720] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff04c06f930 con 0x7ff04c06ce50 2023-07-14T13:33:03.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.455+0000 7ff0657fa640 1 -- 172.21.15.5:0/2402819383 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=196) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff05c120ad0 con 0x7ff068069430 2023-07-14T13:33:03.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.455+0000 7ff067fff640 1 --2- 172.21.15.5:0/2402819383 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7ff04c0663a0 0x7ff04c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:03.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.455+0000 7ff06d133640 1 --2- 172.21.15.5:0/2402819383 >> [v2:172.21.15.5:6824/4061664720,v1:172.21.15.5:6825/4061664720] conn(0x7ff04c06ce50 0x7ff04c06f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:03.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.459+0000 7ff06d133640 1 --2- 172.21.15.5:0/2402819383 >> [v2:172.21.15.5:6824/4061664720,v1:172.21.15.5:6825/4061664720] conn(0x7ff04c06ce50 0x7ff04c06f260 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:03.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.459+0000 7ff067fff640 1 --2- 172.21.15.5:0/2402819383 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7ff04c0663a0 0x7ff04c068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff06814d560 tx=0x7ff054009040 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:03.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.459+0000 7ff0657fa640 1 -- 172.21.15.5:0/2402819383 <== osd.3 v2:172.21.15.5:6824/4061664720 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff04c06f930 con 0x7ff04c06ce50 2023-07-14T13:33:03.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.471+0000 7ff06eb96640 1 -- 172.21.15.5:0/2402819383 --> [v2:172.21.15.5:6824/4061664720,v1:172.21.15.5:6825/4061664720] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff068159d70 con 0x7ff04c06ce50 2023-07-14T13:33:03.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.471+0000 7ff0657fa640 1 -- 172.21.15.5:0/2402819383 <== osd.3 v2:172.21.15.5:6824/4061664720 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff068159d70 con 0x7ff04c06ce50 2023-07-14T13:33:03.469 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T13:33:03.469 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-14T13:33:03.469 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T13:33:03.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.471+0000 7ff06eb96640 1 -- 172.21.15.5:0/2402819383 >> [v2:172.21.15.5:6824/4061664720,v1:172.21.15.5:6825/4061664720] conn(0x7ff04c06ce50 msgr2=0x7ff04c06f260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:03.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.471+0000 7ff06eb96640 1 --2- 172.21.15.5:0/2402819383 >> [v2:172.21.15.5:6824/4061664720,v1:172.21.15.5:6825/4061664720] conn(0x7ff04c06ce50 0x7ff04c06f260 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.471+0000 7ff06eb96640 1 -- 172.21.15.5:0/2402819383 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7ff04c0663a0 msgr2=0x7ff04c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:03.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.471+0000 7ff06eb96640 1 --2- 172.21.15.5:0/2402819383 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7ff04c0663a0 0x7ff04c068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff06814d560 tx=0x7ff054009040 comp rx=0 tx=0).stop 2023-07-14T13:33:03.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.471+0000 7ff06eb96640 1 -- 172.21.15.5:0/2402819383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff068069430 msgr2=0x7ff068147d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:03.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.471+0000 7ff06eb96640 1 --2- 172.21.15.5:0/2402819383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff068069430 0x7ff068147d60 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7ff05c01a0f0 tx=0x7ff05c01ad00 comp rx=0 tx=0).stop 2023-07-14T13:33:03.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.471+0000 7ff06d133640 1 -- 172.21.15.5:0/2402819383 reap_dead start 2023-07-14T13:33:03.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.471+0000 7ff06eb96640 1 -- 172.21.15.5:0/2402819383 shutdown_connections 2023-07-14T13:33:03.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.471+0000 7ff06eb96640 1 -- 172.21.15.5:0/2402819383 >> 172.21.15.5:0/2402819383 conn(0x7ff0680cde90 msgr2=0x7ff06806c310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:03.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.471+0000 7ff06eb96640 1 -- 172.21.15.5:0/2402819383 shutdown_connections 2023-07-14T13:33:03.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.471+0000 7ff06eb96640 1 -- 172.21.15.5:0/2402819383 wait complete. 2023-07-14T13:33:03.487 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-07-14T13:33:03.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.635+0000 7f42488d8640 1 Processor -- start 2023-07-14T13:33:03.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.635+0000 7f42488d8640 1 -- start start 2023-07-14T13:33:03.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.635+0000 7f42488d8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4244070b70 0x7f4244070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.635+0000 7f42488d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42440cb100 0x7f42440cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.635+0000 7f42488d8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42440cac70 con 0x7f424406b1e0 2023-07-14T13:33:03.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.635+0000 7f42488d8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42440cbaa0 con 0x7f4244070b70 2023-07-14T13:33:03.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.635+0000 7f42488d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4244071480 con 0x7f42440cb100 2023-07-14T13:33:03.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.635+0000 7f423bfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f424406b1e0 0x7f42440c1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35348/0 (socket says 172.21.15.5:35348) 2023-07-14T13:33:03.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.635+0000 7f423bfff640 1 -- 172.21.15.5:0/542582489 learned_addr learned my addr 172.21.15.5:0/542582489 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:33:03.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.635+0000 7f424259c640 1 --2- 172.21.15.5:0/542582489 >> v2:172.21.15.154:3300/0 conn(0x7f4244070b70 0x7f4244070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:03.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.635+0000 7f4242d9d640 1 --2- 172.21.15.5:0/542582489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42440cb100 0x7f42440cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:03.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.635+0000 7f4241d9b640 1 -- 172.21.15.5:0/542582489 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1295241598 0 0) 0x7f42440cac70 con 0x7f424406b1e0 2023-07-14T13:33:03.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.635+0000 7f4241d9b640 1 -- 172.21.15.5:0/542582489 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4230003530 con 0x7f424406b1e0 2023-07-14T13:33:03.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.635+0000 7f424259c640 1 -- 172.21.15.5:0/542582489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42440cb100 msgr2=0x7f42440cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:03.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.635+0000 7f424259c640 1 --2- 172.21.15.5:0/542582489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42440cb100 0x7f42440cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.635+0000 7f424259c640 1 -- 172.21.15.5:0/542582489 >> v1:172.21.15.5:6789/0 conn(0x7f424406b1e0 legacy=0x7f42440c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:03.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.635+0000 7f424259c640 1 -- 172.21.15.5:0/542582489 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42440ca060 con 0x7f4244070b70 2023-07-14T13:33:03.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.635+0000 7f4242d9d640 1 --2- 172.21.15.5:0/542582489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42440cb100 0x7f42440cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:33:03.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.639+0000 7f424259c640 1 --2- 172.21.15.5:0/542582489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4244070b70 0x7f4244070f40 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f42340097c0 tx=0x7f423401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f194e00503af1a62 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:03.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.639+0000 7f4241d9b640 1 -- 172.21.15.5:0/542582489 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42340ab650 con 0x7f4244070b70 2023-07-14T13:33:03.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.639+0000 7f4241d9b640 1 -- 172.21.15.5:0/542582489 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42340ab7b0 con 0x7f4244070b70 2023-07-14T13:33:03.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.639+0000 7f4241d9b640 1 -- 172.21.15.5:0/542582489 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42340abb40 con 0x7f4244070b70 2023-07-14T13:33:03.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.639+0000 7f42488d8640 1 -- 172.21.15.5:0/542582489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4244070b70 msgr2=0x7f4244070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:03.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.639+0000 7f42488d8640 1 --2- 172.21.15.5:0/542582489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4244070b70 0x7f4244070f40 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f42340097c0 tx=0x7f423401c450 comp rx=0 tx=0).stop 2023-07-14T13:33:03.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.643+0000 7f42488d8640 1 -- 172.21.15.5:0/542582489 shutdown_connections 2023-07-14T13:33:03.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.643+0000 7f42488d8640 1 --2- 172.21.15.5:0/542582489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42440cb100 0x7f42440cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.643+0000 7f42488d8640 1 --2- 172.21.15.5:0/542582489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4244070b70 0x7f4244070f40 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.643+0000 7f42488d8640 1 -- 172.21.15.5:0/542582489 >> 172.21.15.5:0/542582489 conn(0x7f42440afcf0 msgr2=0x7f42440b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:03.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.643+0000 7f42488d8640 1 -- 172.21.15.5:0/542582489 shutdown_connections 2023-07-14T13:33:03.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.643+0000 7f42488d8640 1 -- 172.21.15.5:0/542582489 wait complete. 2023-07-14T13:33:03.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.643+0000 7f42488d8640 1 Processor -- start 2023-07-14T13:33:03.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.643+0000 7f42488d8640 1 -- start start 2023-07-14T13:33:03.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.643+0000 7f42488d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f424406b1e0 0x7f424414a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.643+0000 7f42488d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4244070b70 0x7f42440af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.643+0000 7f42488d8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42440cb100 0x7f42440ad050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.643+0000 7f42488d8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42440a9f00 con 0x7f424406b1e0 2023-07-14T13:33:03.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.643+0000 7f42488d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424414ab80 con 0x7f4244070b70 2023-07-14T13:33:03.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.643+0000 7f42488d8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42440a9380 con 0x7f42440cb100 2023-07-14T13:33:03.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.643+0000 7f424259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f424406b1e0 0x7f424414a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:03.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.643+0000 7f424259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f424406b1e0 0x7f424414a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55334/0 (socket says 172.21.15.5:55334) 2023-07-14T13:33:03.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.643+0000 7f424259c640 1 -- 172.21.15.5:0/1803357046 learned_addr learned my addr 172.21.15.5:0/1803357046 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:03.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.643+0000 7f4242d9d640 1 --2- 172.21.15.5:0/1803357046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42440cb100 0x7f42440ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:03.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.643+0000 7f423bfff640 1 --2- 172.21.15.5:0/1803357046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4244070b70 0x7f42440af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:03.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.643+0000 7f424259c640 1 -- 172.21.15.5:0/1803357046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42440cb100 msgr2=0x7f42440ad050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:03.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.643+0000 7f424259c640 1 --2- 172.21.15.5:0/1803357046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42440cb100 0x7f42440ad050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.643+0000 7f424259c640 1 -- 172.21.15.5:0/1803357046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4244070b70 msgr2=0x7f42440af3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:03.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.643+0000 7f424259c640 1 --2- 172.21.15.5:0/1803357046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4244070b70 0x7f42440af3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.643+0000 7f424259c640 1 -- 172.21.15.5:0/1803357046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423c009a70 con 0x7f424406b1e0 2023-07-14T13:33:03.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.643+0000 7f424259c640 1 --2- 172.21.15.5:0/1803357046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f424406b1e0 0x7f424414a640 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f42340ad040 tx=0x7f423401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:03.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.647+0000 7f423affd640 1 -- 172.21.15.5:0/1803357046 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42340bf610 con 0x7f424406b1e0 2023-07-14T13:33:03.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.647+0000 7f423affd640 1 -- 172.21.15.5:0/1803357046 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42340bf7b0 con 0x7f424406b1e0 2023-07-14T13:33:03.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.647+0000 7f423affd640 1 -- 172.21.15.5:0/1803357046 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42340bfb60 con 0x7f424406b1e0 2023-07-14T13:33:03.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.647+0000 7f42488d8640 1 -- 172.21.15.5:0/1803357046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4234009420 con 0x7f424406b1e0 2023-07-14T13:33:03.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.647+0000 7f42488d8640 1 -- 172.21.15.5:0/1803357046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42440a9940 con 0x7f424406b1e0 2023-07-14T13:33:03.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.647+0000 7f42488d8640 1 -- 172.21.15.5:0/1803357046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42440678d0 con 0x7f424406b1e0 2023-07-14T13:33:03.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.647+0000 7f423affd640 1 -- 172.21.15.5:0/1803357046 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f42340b5400 con 0x7f424406b1e0 2023-07-14T13:33:03.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.647+0000 7f423affd640 1 --2- 172.21.15.5:0/1803357046 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f42240663a0 0x7f4224068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.647+0000 7f423affd640 1 -- 172.21.15.5:0/1803357046 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7f423411e990 con 0x7f424406b1e0 2023-07-14T13:33:03.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.647+0000 7f423bfff640 1 --2- 172.21.15.5:0/1803357046 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f42240663a0 0x7f4224068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:03.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.651+0000 7f423bfff640 1 --2- 172.21.15.5:0/1803357046 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f42240663a0 0x7f4224068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f42441f72a0 tx=0x7f422c009040 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:03.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.651+0000 7f423affd640 1 -- 172.21.15.5:0/1803357046 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f42340ebc60 con 0x7f424406b1e0 2023-07-14T13:33:03.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.807+0000 7f42488d8640 1 -- 172.21.15.5:0/1803357046 --> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f424406f5b0 con 0x7f42240663a0 2023-07-14T13:33:03.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.807+0000 7f423affd640 1 -- 172.21.15.5:0/1803357046 <== mgr.10192 v2:172.21.15.154:6832/317858933 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f422c0013f0 con 0x7f42240663a0 2023-07-14T13:33:03.805 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 3 to deep-scrub 2023-07-14T13:33:03.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.811+0000 7f42488d8640 1 -- 172.21.15.5:0/1803357046 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f42240663a0 msgr2=0x7f4224068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:03.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.811+0000 7f42488d8640 1 --2- 172.21.15.5:0/1803357046 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f42240663a0 0x7f4224068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f42441f72a0 tx=0x7f422c009040 comp rx=0 tx=0).stop 2023-07-14T13:33:03.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.811+0000 7f42488d8640 1 -- 172.21.15.5:0/1803357046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f424406b1e0 msgr2=0x7f424414a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:03.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.811+0000 7f42488d8640 1 --2- 172.21.15.5:0/1803357046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f424406b1e0 0x7f424414a640 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f42340ad040 tx=0x7f423401ac90 comp rx=0 tx=0).stop 2023-07-14T13:33:03.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.811+0000 7f42488d8640 1 -- 172.21.15.5:0/1803357046 shutdown_connections 2023-07-14T13:33:03.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.811+0000 7f42488d8640 1 --2- 172.21.15.5:0/1803357046 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f42240663a0 0x7f4224068850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.811+0000 7f42488d8640 1 --2- 172.21.15.5:0/1803357046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42440cb100 0x7f42440ad050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.811+0000 7f42488d8640 1 --2- 172.21.15.5:0/1803357046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4244070b70 0x7f42440af3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.811+0000 7f42488d8640 1 --2- 172.21.15.5:0/1803357046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f424406b1e0 0x7f424414a640 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.811+0000 7f42488d8640 1 -- 172.21.15.5:0/1803357046 >> 172.21.15.5:0/1803357046 conn(0x7f42440afcf0 msgr2=0x7f42440b3000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:03.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.811+0000 7f42488d8640 1 -- 172.21.15.5:0/1803357046 shutdown_connections 2023-07-14T13:33:03.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.811+0000 7f42488d8640 1 -- 172.21.15.5:0/1803357046 wait complete. 2023-07-14T13:33:03.827 INFO:tasks.ceph:Scrubbing osd.4 2023-07-14T13:33:03.827 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-07-14T13:33:03.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50ed293640 1 Processor -- start 2023-07-14T13:33:03.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50ed293640 1 -- start start 2023-07-14T13:33:03.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50ed293640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50e8145540 0x7f50e80cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50ed293640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f50e80ccd20 0x7f50e80d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50ed293640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e80d0f10 con 0x7f50e80d06e0 2023-07-14T13:33:03.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50ed293640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e80d11f0 con 0x7f50e80ccd20 2023-07-14T13:33:03.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50ed293640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e80d14d0 con 0x7f50e8145540 2023-07-14T13:33:03.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50e77fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f50e80d06e0 0x7f50e80b3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35350/0 (socket says 172.21.15.5:35350) 2023-07-14T13:33:03.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50e77fe640 1 -- 172.21.15.5:0/3759042559 learned_addr learned my addr 172.21.15.5:0/3759042559 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:33:03.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50dffff640 1 --2- 172.21.15.5:0/3759042559 >> v2:172.21.15.154:3300/0 conn(0x7f50e80ccd20 0x7f50e80d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:03.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50e6ffd640 1 --2- 172.21.15.5:0/3759042559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50e8145540 0x7f50e80cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:03.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50e67fc640 1 -- 172.21.15.5:0/3759042559 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747052840 0 0) 0x7f50e80d0f10 con 0x7f50e80d06e0 2023-07-14T13:33:03.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50e67fc640 1 -- 172.21.15.5:0/3759042559 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50d4003530 con 0x7f50e80d06e0 2023-07-14T13:33:03.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50e67fc640 1 -- 172.21.15.5:0/3759042559 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3185778349 0 0) 0x7f50d4003530 con 0x7f50e80d06e0 2023-07-14T13:33:03.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50e67fc640 1 -- 172.21.15.5:0/3759042559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50e8145540 msgr2=0x7f50e80cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:03.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50e67fc640 1 --2- 172.21.15.5:0/3759042559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50e8145540 0x7f50e80cc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50e67fc640 1 -- 172.21.15.5:0/3759042559 >> v2:172.21.15.154:3300/0 conn(0x7f50e80ccd20 msgr2=0x7f50e80d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:03.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50e67fc640 1 --2- 172.21.15.5:0/3759042559 >> v2:172.21.15.154:3300/0 conn(0x7f50e80ccd20 0x7f50e80d01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50e67fc640 1 -- 172.21.15.5:0/3759042559 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e80b5110 con 0x7f50e80d06e0 2023-07-14T13:33:03.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50e67fc640 1 -- 172.21.15.5:0/3759042559 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f50e0001a00 con 0x7f50e80d06e0 2023-07-14T13:33:03.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50e67fc640 1 -- 172.21.15.5:0/3759042559 >> v1:172.21.15.5:6789/0 conn(0x7f50e80d06e0 legacy=0x7f50e80b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:03.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50e67fc640 1 --2- 172.21.15.5:0/3759042559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50d4003980 0x7f50d4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50e67fc640 1 --2- 172.21.15.5:0/3759042559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50d4004360 0x7f50d4004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50e67fc640 1 --2- 172.21.15.5:0/3759042559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50d4004ea0 0x7f50d400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50e67fc640 1 -- 172.21.15.5:0/3759042559 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e80d11f0 con 0x7f50d4004ea0 2023-07-14T13:33:03.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50e67fc640 1 -- 172.21.15.5:0/3759042559 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e80d14d0 con 0x7f50d4004360 2023-07-14T13:33:03.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50e67fc640 1 -- 172.21.15.5:0/3759042559 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d400bed0 con 0x7f50d4003980 2023-07-14T13:33:03.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50e77fe640 1 --2- 172.21.15.5:0/3759042559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50d4004ea0 0x7f50d400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:03.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50e6ffd640 1 --2- 172.21.15.5:0/3759042559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50d4003980 0x7f50d4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:03.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50dffff640 1 --2- 172.21.15.5:0/3759042559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50d4004360 0x7f50d4004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:03.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50e77fe640 1 -- 172.21.15.5:0/3759042559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50d4003980 msgr2=0x7f50d4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:03.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50e77fe640 1 --2- 172.21.15.5:0/3759042559 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50d4003980 0x7f50d4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50e77fe640 1 -- 172.21.15.5:0/3759042559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50d4004360 msgr2=0x7f50d4004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:03.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50e77fe640 1 --2- 172.21.15.5:0/3759042559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50d4004360 0x7f50d4004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.979+0000 7f50e77fe640 1 -- 172.21.15.5:0/3759042559 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d4003530 con 0x7f50d4004ea0 2023-07-14T13:33:03.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.983+0000 7f50e77fe640 1 --2- 172.21.15.5:0/3759042559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50d4004ea0 0x7f50d400b990 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f50e000a860 tx=0x7f50e001d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac273493d3760a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:03.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.983+0000 7f50e67fc640 1 -- 172.21.15.5:0/3759042559 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e00ad630 con 0x7f50d4004ea0 2023-07-14T13:33:03.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.983+0000 7f50e67fc640 1 -- 172.21.15.5:0/3759042559 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e00a8070 con 0x7f50d4004ea0 2023-07-14T13:33:03.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.983+0000 7f50e67fc640 1 -- 172.21.15.5:0/3759042559 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e00ada30 con 0x7f50d4004ea0 2023-07-14T13:33:03.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.983+0000 7f50ed293640 1 -- 172.21.15.5:0/3759042559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50d4004ea0 msgr2=0x7f50d400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:03.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.983+0000 7f50ed293640 1 --2- 172.21.15.5:0/3759042559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50d4004ea0 0x7f50d400b990 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f50e000a860 tx=0x7f50e001d360 comp rx=0 tx=0).stop 2023-07-14T13:33:03.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.983+0000 7f50e77fe640 1 -- 172.21.15.5:0/3759042559 reap_dead start 2023-07-14T13:33:03.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.983+0000 7f50ed293640 1 -- 172.21.15.5:0/3759042559 shutdown_connections 2023-07-14T13:33:03.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.983+0000 7f50ed293640 1 -- 172.21.15.5:0/3759042559 >> 172.21.15.5:0/3759042559 conn(0x7f50e80d2220 msgr2=0x7f50e80d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:03.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.983+0000 7f50ed293640 1 -- 172.21.15.5:0/3759042559 shutdown_connections 2023-07-14T13:33:03.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.983+0000 7f50ed293640 1 -- 172.21.15.5:0/3759042559 wait complete. 2023-07-14T13:33:03.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.987+0000 7f50ed293640 1 Processor -- start 2023-07-14T13:33:03.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.987+0000 7f50ed293640 1 -- start start 2023-07-14T13:33:03.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.987+0000 7f50ed293640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50d4004ea0 0x7f50e80cef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.987+0000 7f50ed293640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50e815e410 0x7f50e81f37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.987+0000 7f50ed293640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50e815e900 0x7f50e81f3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.987+0000 7f50ed293640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e815ab70 con 0x7f50e815e410 2023-07-14T13:33:03.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.987+0000 7f50ed293640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e81f4230 con 0x7f50d4004ea0 2023-07-14T13:33:03.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.987+0000 7f50ed293640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e8159fa0 con 0x7f50e815e900 2023-07-14T13:33:03.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.987+0000 7f50dffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50e815e410 0x7f50e81f37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:03.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.987+0000 7f50dffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50e815e410 0x7f50e81f37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55348/0 (socket says 172.21.15.5:55348) 2023-07-14T13:33:03.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.987+0000 7f50dffff640 1 -- 172.21.15.5:0/1315895344 learned_addr learned my addr 172.21.15.5:0/1315895344 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:03.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.987+0000 7f50e6ffd640 1 --2- 172.21.15.5:0/1315895344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50d4004ea0 0x7f50e80cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:03.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.987+0000 7f50dffff640 1 -- 172.21.15.5:0/1315895344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50e815e900 msgr2=0x7f50e81f3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:03.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.987+0000 7f50dffff640 1 --2- 172.21.15.5:0/1315895344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f50e815e900 0x7f50e81f3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.987+0000 7f50dffff640 1 -- 172.21.15.5:0/1315895344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50d4004ea0 msgr2=0x7f50e80cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:03.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.987+0000 7f50dffff640 1 --2- 172.21.15.5:0/1315895344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50d4004ea0 0x7f50e80cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:03.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.987+0000 7f50dffff640 1 -- 172.21.15.5:0/1315895344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e815a240 con 0x7f50e815e410 2023-07-14T13:33:03.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.987+0000 7f50e6ffd640 1 --2- 172.21.15.5:0/1315895344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50d4004ea0 0x7f50e80cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:33:03.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.987+0000 7f50dffff640 1 --2- 172.21.15.5:0/1315895344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50e815e410 0x7f50e81f37b0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f50d0011930 tx=0x7f50d0011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:03.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.987+0000 7f50df7fe640 1 -- 172.21.15.5:0/1315895344 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d0004240 con 0x7f50e815e410 2023-07-14T13:33:03.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.987+0000 7f50df7fe640 1 -- 172.21.15.5:0/1315895344 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d00043a0 con 0x7f50e815e410 2023-07-14T13:33:03.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.987+0000 7f50df7fe640 1 -- 172.21.15.5:0/1315895344 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d000fb00 con 0x7f50e815e410 2023-07-14T13:33:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.987+0000 7f50ed293640 1 -- 172.21.15.5:0/1315895344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e815a520 con 0x7f50e815e410 2023-07-14T13:33:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.987+0000 7f50ed293640 1 -- 172.21.15.5:0/1315895344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e8157660 con 0x7f50e815e410 2023-07-14T13:33:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.991+0000 7f50ed293640 1 -- 172.21.15.5:0/1315895344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f50e80cd170 con 0x7f50e815e410 2023-07-14T13:33:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.991+0000 7f50df7fe640 1 -- 172.21.15.5:0/1315895344 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f50d000fc60 con 0x7f50e815e410 2023-07-14T13:33:03.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.991+0000 7f50df7fe640 1 --2- 172.21.15.5:0/1315895344 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f50c80663a0 0x7f50c8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.991+0000 7f50df7fe640 1 -- 172.21.15.5:0/1315895344 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7f50d0084c20 con 0x7f50e815e410 2023-07-14T13:33:03.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.991+0000 7f50df7fe640 1 --2- 172.21.15.5:0/1315895344 >> [v2:172.21.15.154:6809/3408721900,v1:172.21.15.154:6811/3408721900] conn(0x7f50c806ce50 0x7f50c806f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:03.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.991+0000 7f50df7fe640 1 -- 172.21.15.5:0/1315895344 --> [v2:172.21.15.154:6809/3408721900,v1:172.21.15.154:6811/3408721900] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f50c806f930 con 0x7f50c806ce50 2023-07-14T13:33:03.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.991+0000 7f50df7fe640 1 -- 172.21.15.5:0/1315895344 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=196) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50d0084f90 con 0x7f50e815e410 2023-07-14T13:33:03.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.991+0000 7f50e6ffd640 1 --2- 172.21.15.5:0/1315895344 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f50c80663a0 0x7f50c8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:03.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.991+0000 7f50e77fe640 1 --2- 172.21.15.5:0/1315895344 >> [v2:172.21.15.154:6809/3408721900,v1:172.21.15.154:6811/3408721900] conn(0x7f50c806ce50 0x7f50c806f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:03.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.991+0000 7f50e6ffd640 1 --2- 172.21.15.5:0/1315895344 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f50c80663a0 0x7f50c8068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f50e80b4db0 tx=0x7f50d8008040 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:03.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.991+0000 7f50e77fe640 1 --2- 172.21.15.5:0/1315895344 >> [v2:172.21.15.154:6809/3408721900,v1:172.21.15.154:6811/3408721900] conn(0x7f50c806ce50 0x7f50c806f260 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:03.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:03.995+0000 7f50df7fe640 1 -- 172.21.15.5:0/1315895344 <== osd.4 v2:172.21.15.154:6809/3408721900 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f50c806f930 con 0x7f50c806ce50 2023-07-14T13:33:04.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.007+0000 7f50ed293640 1 -- 172.21.15.5:0/1315895344 --> [v2:172.21.15.154:6809/3408721900,v1:172.21.15.154:6811/3408721900] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f50e80b53f0 con 0x7f50c806ce50 2023-07-14T13:33:04.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.007+0000 7f50df7fe640 1 -- 172.21.15.5:0/1315895344 <== osd.4 v2:172.21.15.154:6809/3408721900 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f50e00017c0 con 0x7f50c806ce50 2023-07-14T13:33:04.005 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T13:33:04.005 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-14T13:33:04.005 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T13:33:04.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.007+0000 7f50ed293640 1 -- 172.21.15.5:0/1315895344 >> [v2:172.21.15.154:6809/3408721900,v1:172.21.15.154:6811/3408721900] conn(0x7f50c806ce50 msgr2=0x7f50c806f260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:04.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.007+0000 7f50ed293640 1 --2- 172.21.15.5:0/1315895344 >> [v2:172.21.15.154:6809/3408721900,v1:172.21.15.154:6811/3408721900] conn(0x7f50c806ce50 0x7f50c806f260 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.007+0000 7f50ed293640 1 -- 172.21.15.5:0/1315895344 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f50c80663a0 msgr2=0x7f50c8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:04.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.007+0000 7f50ed293640 1 --2- 172.21.15.5:0/1315895344 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f50c80663a0 0x7f50c8068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f50e80b4db0 tx=0x7f50d8008040 comp rx=0 tx=0).stop 2023-07-14T13:33:04.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.007+0000 7f50ed293640 1 -- 172.21.15.5:0/1315895344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50e815e410 msgr2=0x7f50e81f37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:04.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.007+0000 7f50ed293640 1 --2- 172.21.15.5:0/1315895344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50e815e410 0x7f50e81f37b0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f50d0011930 tx=0x7f50d0011df0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.007+0000 7f50e77fe640 1 -- 172.21.15.5:0/1315895344 reap_dead start 2023-07-14T13:33:04.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.007+0000 7f50ed293640 1 -- 172.21.15.5:0/1315895344 shutdown_connections 2023-07-14T13:33:04.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.007+0000 7f50ed293640 1 -- 172.21.15.5:0/1315895344 >> 172.21.15.5:0/1315895344 conn(0x7f50e80d2220 msgr2=0x7f50e80b7930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:04.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.007+0000 7f50ed293640 1 -- 172.21.15.5:0/1315895344 shutdown_connections 2023-07-14T13:33:04.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.007+0000 7f50ed293640 1 -- 172.21.15.5:0/1315895344 wait complete. 2023-07-14T13:33:04.023 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-07-14T13:33:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.175+0000 7ff6b8b94640 1 Processor -- start 2023-07-14T13:33:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.175+0000 7ff6b8b94640 1 -- start start 2023-07-14T13:33:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.175+0000 7ff6b8b94640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff6b40b7d90 0x7ff6b40cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.175+0000 7ff6b8b94640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff6b40d13f0 0x7ff6b40ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:04.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.175+0000 7ff6b8b94640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b40d0f60 con 0x7ff6b415f3f0 2023-07-14T13:33:04.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.175+0000 7ff6b8b94640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b40d0390 con 0x7ff6b40b7d90 2023-07-14T13:33:04.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.175+0000 7ff6b8b94640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b40d0630 con 0x7ff6b40d13f0 2023-07-14T13:33:04.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.175+0000 7ff6b37fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff6b415f3f0 0x7ff6b40b7680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35354/0 (socket says 172.21.15.5:35354) 2023-07-14T13:33:04.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.175+0000 7ff6b37fe640 1 -- 172.21.15.5:0/2955903803 learned_addr learned my addr 172.21.15.5:0/2955903803 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:33:04.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.175+0000 7ff6b2ffd640 1 --2- 172.21.15.5:0/2955903803 >> v2:172.21.15.5:3300/0 conn(0x7ff6b40b7d90 0x7ff6b40cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:04.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.175+0000 7ff6b3fff640 1 --2- 172.21.15.5:0/2955903803 >> v2:172.21.15.154:3300/0 conn(0x7ff6b40d13f0 0x7ff6b40ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:04.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.175+0000 7ff6b2ffd640 1 -- 172.21.15.5:0/2955903803 >> v2:172.21.15.154:3300/0 conn(0x7ff6b40d13f0 msgr2=0x7ff6b40ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:04.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.175+0000 7ff6b2ffd640 1 --2- 172.21.15.5:0/2955903803 >> v2:172.21.15.154:3300/0 conn(0x7ff6b40d13f0 0x7ff6b40ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.175+0000 7ff6b2ffd640 1 -- 172.21.15.5:0/2955903803 >> v1:172.21.15.5:6789/0 conn(0x7ff6b415f3f0 legacy=0x7ff6b40b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:04.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.175+0000 7ff6b2ffd640 1 -- 172.21.15.5:0/2955903803 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b40d0910 con 0x7ff6b40b7d90 2023-07-14T13:33:04.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.175+0000 7ff6b27fc640 1 -- 172.21.15.5:0/2955903803 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1205860601 0 0) 0x7ff6b40d0f60 con 0x7ff6b415f3f0 2023-07-14T13:33:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.179+0000 7ff6b2ffd640 1 --2- 172.21.15.5:0/2955903803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6b40b7d90 0x7ff6b40cc9a0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40cd910 tx=0x7ff6a801c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0104f749d9e89f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.179+0000 7ff6b27fc640 1 -- 172.21.15.5:0/2955903803 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a80ab600 con 0x7ff6b40b7d90 2023-07-14T13:33:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.179+0000 7ff6b27fc640 1 -- 172.21.15.5:0/2955903803 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a80a7050 con 0x7ff6b40b7d90 2023-07-14T13:33:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.179+0000 7ff6b27fc640 1 -- 172.21.15.5:0/2955903803 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a80ab980 con 0x7ff6b40b7d90 2023-07-14T13:33:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.179+0000 7ff6b8b94640 1 -- 172.21.15.5:0/2955903803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6b40b7d90 msgr2=0x7ff6b40cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.179+0000 7ff6b8b94640 1 --2- 172.21.15.5:0/2955903803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6b40b7d90 0x7ff6b40cc9a0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40cd910 tx=0x7ff6a801c340 comp rx=0 tx=0).stop 2023-07-14T13:33:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.179+0000 7ff6b8b94640 1 -- 172.21.15.5:0/2955903803 shutdown_connections 2023-07-14T13:33:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.179+0000 7ff6b8b94640 1 --2- 172.21.15.5:0/2955903803 >> v2:172.21.15.154:3300/0 conn(0x7ff6b40d13f0 0x7ff6b40ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.179+0000 7ff6b8b94640 1 --2- 172.21.15.5:0/2955903803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6b40b7d90 0x7ff6b40cc9a0 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.179+0000 7ff6b8b94640 1 -- 172.21.15.5:0/2955903803 >> 172.21.15.5:0/2955903803 conn(0x7ff6b4069f50 msgr2=0x7ff6b406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:04.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.179+0000 7ff6b8b94640 1 -- 172.21.15.5:0/2955903803 shutdown_connections 2023-07-14T13:33:04.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.179+0000 7ff6b8b94640 1 -- 172.21.15.5:0/2955903803 wait complete. 2023-07-14T13:33:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.183+0000 7ff6b8b94640 1 Processor -- start 2023-07-14T13:33:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.183+0000 7ff6b8b94640 1 -- start start 2023-07-14T13:33:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.183+0000 7ff6b8b94640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b40b7d90 0x7ff6b41f4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.183+0000 7ff6b8b94640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b40d13f0 0x7ff6b40cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.183+0000 7ff6b8b94640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6b415f3f0 0x7ff6b415a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.183+0000 7ff6b8b94640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b415b800 con 0x7ff6b415f3f0 2023-07-14T13:33:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.183+0000 7ff6b8b94640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b41f4f50 con 0x7ff6b40d13f0 2023-07-14T13:33:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.183+0000 7ff6b8b94640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b41625f0 con 0x7ff6b40b7d90 2023-07-14T13:33:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.183+0000 7ff6b3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6b415f3f0 0x7ff6b415a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.183+0000 7ff6b3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6b415f3f0 0x7ff6b415a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55368/0 (socket says 172.21.15.5:55368) 2023-07-14T13:33:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.183+0000 7ff6b3fff640 1 -- 172.21.15.5:0/330931042 learned_addr learned my addr 172.21.15.5:0/330931042 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.183+0000 7ff6b2ffd640 1 --2- 172.21.15.5:0/330931042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b40d13f0 0x7ff6b40cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.183+0000 7ff6b37fe640 1 --2- 172.21.15.5:0/330931042 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b40b7d90 0x7ff6b41f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.183+0000 7ff6b3fff640 1 -- 172.21.15.5:0/330931042 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b40b7d90 msgr2=0x7ff6b41f4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.183+0000 7ff6b3fff640 1 --2- 172.21.15.5:0/330931042 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b40b7d90 0x7ff6b41f4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.183+0000 7ff6b3fff640 1 -- 172.21.15.5:0/330931042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b40d13f0 msgr2=0x7ff6b40cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.183+0000 7ff6b3fff640 1 --2- 172.21.15.5:0/330931042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b40d13f0 0x7ff6b40cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.183+0000 7ff6b3fff640 1 -- 172.21.15.5:0/330931042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a8009420 con 0x7ff6b415f3f0 2023-07-14T13:33:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.183+0000 7ff6b3fff640 1 --2- 172.21.15.5:0/330931042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6b415f3f0 0x7ff6b415a1b0 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac007e30 tx=0x7ff6ac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.183+0000 7ff69bfff640 1 -- 172.21.15.5:0/330931042 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac014620 con 0x7ff6b415f3f0 2023-07-14T13:33:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.183+0000 7ff69bfff640 1 -- 172.21.15.5:0/330931042 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ac00ee90 con 0x7ff6b415f3f0 2023-07-14T13:33:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.183+0000 7ff69bfff640 1 -- 172.21.15.5:0/330931042 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac0149c0 con 0x7ff6b415f3f0 2023-07-14T13:33:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.183+0000 7ff6b8b94640 1 -- 172.21.15.5:0/330931042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b41628d0 con 0x7ff6b415f3f0 2023-07-14T13:33:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.183+0000 7ff6b8b94640 1 -- 172.21.15.5:0/330931042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b4162e90 con 0x7ff6b415f3f0 2023-07-14T13:33:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.187+0000 7ff6b8b94640 1 -- 172.21.15.5:0/330931042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b40678d0 con 0x7ff6b415f3f0 2023-07-14T13:33:04.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.187+0000 7ff69bfff640 1 -- 172.21.15.5:0/330931042 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff6ac014b20 con 0x7ff6b415f3f0 2023-07-14T13:33:04.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.187+0000 7ff69bfff640 1 --2- 172.21.15.5:0/330931042 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7ff6a00663a0 0x7ff6a0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:04.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.187+0000 7ff69bfff640 1 -- 172.21.15.5:0/330931042 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7ff6ac084760 con 0x7ff6b415f3f0 2023-07-14T13:33:04.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.187+0000 7ff6b37fe640 1 --2- 172.21.15.5:0/330931042 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7ff6a00663a0 0x7ff6a0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:04.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.187+0000 7ff6b37fe640 1 --2- 172.21.15.5:0/330931042 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7ff6a00663a0 0x7ff6a0068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4000f70 tx=0x7ff6a4007df0 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:04.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.191+0000 7ff69bfff640 1 -- 172.21.15.5:0/330931042 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7ff6ac051ae0 con 0x7ff6b415f3f0 2023-07-14T13:33:04.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.347+0000 7ff6b8b94640 1 -- 172.21.15.5:0/330931042 --> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6b40cd420 con 0x7ff6a00663a0 2023-07-14T13:33:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.347+0000 7ff69bfff640 1 -- 172.21.15.5:0/330931042 <== mgr.10192 v2:172.21.15.154:6832/317858933 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff6a4004c80 con 0x7ff6a00663a0 2023-07-14T13:33:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 4 to deep-scrub 2023-07-14T13:33:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.347+0000 7ff6b8b94640 1 -- 172.21.15.5:0/330931042 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7ff6a00663a0 msgr2=0x7ff6a0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.347+0000 7ff6b8b94640 1 --2- 172.21.15.5:0/330931042 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7ff6a00663a0 0x7ff6a0068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4000f70 tx=0x7ff6a4007df0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.347+0000 7ff6b8b94640 1 -- 172.21.15.5:0/330931042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6b415f3f0 msgr2=0x7ff6b415a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.347+0000 7ff6b8b94640 1 --2- 172.21.15.5:0/330931042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6b415f3f0 0x7ff6b415a1b0 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac007e30 tx=0x7ff6ac00e4b0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.347+0000 7ff6b8b94640 1 -- 172.21.15.5:0/330931042 shutdown_connections 2023-07-14T13:33:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.347+0000 7ff6b8b94640 1 --2- 172.21.15.5:0/330931042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6b415f3f0 0x7ff6b415a1b0 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.347+0000 7ff6b8b94640 1 --2- 172.21.15.5:0/330931042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6b40d13f0 0x7ff6b40cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.347+0000 7ff6b8b94640 1 --2- 172.21.15.5:0/330931042 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7ff6a00663a0 0x7ff6a0068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.347+0000 7ff6b8b94640 1 --2- 172.21.15.5:0/330931042 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6b40b7d90 0x7ff6b41f4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.347+0000 7ff6b8b94640 1 -- 172.21.15.5:0/330931042 >> 172.21.15.5:0/330931042 conn(0x7ff6b4069f50 msgr2=0x7ff6b40b22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.347+0000 7ff6b8b94640 1 -- 172.21.15.5:0/330931042 shutdown_connections 2023-07-14T13:33:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.347+0000 7ff6b8b94640 1 -- 172.21.15.5:0/330931042 wait complete. 2023-07-14T13:33:04.366 INFO:tasks.ceph:Scrubbing osd.5 2023-07-14T13:33:04.366 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-07-14T13:33:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.515+0000 7fcf224f9640 1 Processor -- start 2023-07-14T13:33:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.515+0000 7fcf224f9640 1 -- start start 2023-07-14T13:33:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.519+0000 7fcf224f9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcf1c15f690 0x7fcf1c0b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.519+0000 7fcf224f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf1c1453a0 0x7fcf1c15fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.519+0000 7fcf224f9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1c06c040 con 0x7fcf1c06c4d0 2023-07-14T13:33:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.519+0000 7fcf224f9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf1c160600 con 0x7fcf1c15f690 2023-07-14T13:33:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.519+0000 7fcf224f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c160360 con 0x7fcf1c1453a0 2023-07-14T13:33:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.519+0000 7fcf1b7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf1c1453a0 0x7fcf1c15fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.519+0000 7fcf1b7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf1c1453a0 0x7fcf1c15fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:41918/0 (socket says 172.21.15.5:41918) 2023-07-14T13:33:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.519+0000 7fcf1b7fe640 1 -- 172.21.15.5:0/2210065809 learned_addr learned my addr 172.21.15.5:0/2210065809 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.519+0000 7fcf1bfff640 1 --2- 172.21.15.5:0/2210065809 >> v2:172.21.15.154:3300/0 conn(0x7fcf1c15f690 0x7fcf1c0b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.519+0000 7fcf1b7fe640 1 -- 172.21.15.5:0/2210065809 >> v2:172.21.15.154:3300/0 conn(0x7fcf1c15f690 msgr2=0x7fcf1c0b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.519+0000 7fcf1b7fe640 1 --2- 172.21.15.5:0/2210065809 >> v2:172.21.15.154:3300/0 conn(0x7fcf1c15f690 0x7fcf1c0b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.519+0000 7fcf1b7fe640 1 -- 172.21.15.5:0/2210065809 >> v1:172.21.15.154:6789/0 conn(0x7fcf1c06c4d0 legacy=0x7fcf1c06c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:04.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.519+0000 7fcf1b7fe640 1 -- 172.21.15.5:0/2210065809 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c06b9f0 con 0x7fcf1c1453a0 2023-07-14T13:33:04.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.523+0000 7fcf1b7fe640 1 --2- 172.21.15.5:0/2210065809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf1c1453a0 0x7fcf1c15fa60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcf10009870 tx=0x7fcf1001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8930b494947e88b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:04.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.523+0000 7fcf1affd640 1 -- 172.21.15.5:0/2210065809 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf100a6040 con 0x7fcf1c1453a0 2023-07-14T13:33:04.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.523+0000 7fcf1affd640 1 -- 172.21.15.5:0/2210065809 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf100aa600 con 0x7fcf1c1453a0 2023-07-14T13:33:04.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.523+0000 7fcf1affd640 1 -- 172.21.15.5:0/2210065809 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf100aa990 con 0x7fcf1c1453a0 2023-07-14T13:33:04.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.523+0000 7fcf224f9640 1 -- 172.21.15.5:0/2210065809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf1c1453a0 msgr2=0x7fcf1c15fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:04.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.523+0000 7fcf224f9640 1 --2- 172.21.15.5:0/2210065809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf1c1453a0 0x7fcf1c15fa60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcf10009870 tx=0x7fcf1001c480 comp rx=0 tx=0).stop 2023-07-14T13:33:04.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.523+0000 7fcf224f9640 1 -- 172.21.15.5:0/2210065809 shutdown_connections 2023-07-14T13:33:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.523+0000 7fcf224f9640 1 --2- 172.21.15.5:0/2210065809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf1c1453a0 0x7fcf1c15fa60 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.523+0000 7fcf224f9640 1 --2- 172.21.15.5:0/2210065809 >> v2:172.21.15.154:3300/0 conn(0x7fcf1c15f690 0x7fcf1c0b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.523+0000 7fcf224f9640 1 -- 172.21.15.5:0/2210065809 >> 172.21.15.5:0/2210065809 conn(0x7fcf1c0b1210 msgr2=0x7fcf1c0ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:04.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.523+0000 7fcf224f9640 1 -- 172.21.15.5:0/2210065809 shutdown_connections 2023-07-14T13:33:04.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.523+0000 7fcf224f9640 1 -- 172.21.15.5:0/2210065809 wait complete. 2023-07-14T13:33:04.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.523+0000 7fcf224f9640 1 Processor -- start 2023-07-14T13:33:04.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.527+0000 7fcf224f9640 1 -- start start 2023-07-14T13:33:04.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.527+0000 7fcf224f9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf1c06c4d0 0x7fcf1c1f8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.527+0000 7fcf224f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf1c1453a0 0x7fcf1c163750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.527+0000 7fcf224f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf1c15f690 0x7fcf1c0b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.527+0000 7fcf224f9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c1f8e80 con 0x7fcf1c1453a0 2023-07-14T13:33:04.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.527+0000 7fcf224f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c160ad0 con 0x7fcf1c15f690 2023-07-14T13:33:04.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.527+0000 7fcf224f9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c163c90 con 0x7fcf1c06c4d0 2023-07-14T13:33:04.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.527+0000 7fcf1b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf1c1453a0 0x7fcf1c163750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:04.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.527+0000 7fcf1b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf1c1453a0 0x7fcf1c163750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55378/0 (socket says 172.21.15.5:55378) 2023-07-14T13:33:04.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.527+0000 7fcf1b7fe640 1 -- 172.21.15.5:0/317913133 learned_addr learned my addr 172.21.15.5:0/317913133 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:04.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.527+0000 7fcf1bfff640 1 --2- 172.21.15.5:0/317913133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf1c06c4d0 0x7fcf1c1f8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:04.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.527+0000 7fcf20a96640 1 --2- 172.21.15.5:0/317913133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf1c15f690 0x7fcf1c0b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:04.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.527+0000 7fcf1b7fe640 1 -- 172.21.15.5:0/317913133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf1c06c4d0 msgr2=0x7fcf1c1f8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:04.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.527+0000 7fcf1b7fe640 1 --2- 172.21.15.5:0/317913133 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf1c06c4d0 0x7fcf1c1f8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.527+0000 7fcf1b7fe640 1 -- 172.21.15.5:0/317913133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf1c15f690 msgr2=0x7fcf1c0b2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:04.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.527+0000 7fcf1b7fe640 1 --2- 172.21.15.5:0/317913133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf1c15f690 0x7fcf1c0b2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.527+0000 7fcf1b7fe640 1 -- 172.21.15.5:0/317913133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf100094d0 con 0x7fcf1c1453a0 2023-07-14T13:33:04.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.527+0000 7fcf1b7fe640 1 --2- 172.21.15.5:0/317913133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf1c1453a0 0x7fcf1c163750 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7fcf1001c960 tx=0x7fcf1001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:04.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.527+0000 7fcf18ff9640 1 -- 172.21.15.5:0/317913133 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf100b3600 con 0x7fcf1c1453a0 2023-07-14T13:33:04.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.527+0000 7fcf18ff9640 1 -- 172.21.15.5:0/317913133 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf100b3780 con 0x7fcf1c1453a0 2023-07-14T13:33:04.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.527+0000 7fcf18ff9640 1 -- 172.21.15.5:0/317913133 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf100b3b30 con 0x7fcf1c1453a0 2023-07-14T13:33:04.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.527+0000 7fcf224f9640 1 -- 172.21.15.5:0/317913133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf1c166320 con 0x7fcf1c1453a0 2023-07-14T13:33:04.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.527+0000 7fcf224f9640 1 -- 172.21.15.5:0/317913133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1c1659f0 con 0x7fcf1c1453a0 2023-07-14T13:33:04.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.527+0000 7fcf224f9640 1 -- 172.21.15.5:0/317913133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcf1c144fe0 con 0x7fcf1c1453a0 2023-07-14T13:33:04.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.531+0000 7fcf18ff9640 1 -- 172.21.15.5:0/317913133 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcf100b3c90 con 0x7fcf1c1453a0 2023-07-14T13:33:04.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.531+0000 7fcf18ff9640 1 --2- 172.21.15.5:0/317913133 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fcf080663d0 0x7fcf08068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:04.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.531+0000 7fcf18ff9640 1 -- 172.21.15.5:0/317913133 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7fcf1011ec50 con 0x7fcf1c1453a0 2023-07-14T13:33:04.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.531+0000 7fcf18ff9640 1 --2- 172.21.15.5:0/317913133 >> [v2:172.21.15.154:6800/3949375489,v1:172.21.15.154:6801/3949375489] conn(0x7fcf0806ce80 0x7fcf0806f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:04.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.531+0000 7fcf18ff9640 1 -- 172.21.15.5:0/317913133 --> [v2:172.21.15.154:6800/3949375489,v1:172.21.15.154:6801/3949375489] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcf0806f960 con 0x7fcf0806ce80 2023-07-14T13:33:04.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.531+0000 7fcf18ff9640 1 -- 172.21.15.5:0/317913133 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=196) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf100a6020 con 0x7fcf1c1453a0 2023-07-14T13:33:04.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.531+0000 7fcf1bfff640 1 --2- 172.21.15.5:0/317913133 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fcf080663d0 0x7fcf08068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:04.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.531+0000 7fcf20a96640 1 --2- 172.21.15.5:0/317913133 >> [v2:172.21.15.154:6800/3949375489,v1:172.21.15.154:6801/3949375489] conn(0x7fcf0806ce80 0x7fcf0806f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:04.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.531+0000 7fcf1bfff640 1 --2- 172.21.15.5:0/317913133 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fcf080663d0 0x7fcf08068880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009af0 tx=0x7fcf0c008040 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:04.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.531+0000 7fcf20a96640 1 --2- 172.21.15.5:0/317913133 >> [v2:172.21.15.154:6800/3949375489,v1:172.21.15.154:6801/3949375489] conn(0x7fcf0806ce80 0x7fcf0806f290 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:04.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.531+0000 7fcf18ff9640 1 -- 172.21.15.5:0/317913133 <== osd.5 v2:172.21.15.154:6800/3949375489 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fcf0806f960 con 0x7fcf0806ce80 2023-07-14T13:33:04.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.547+0000 7fcf224f9640 1 -- 172.21.15.5:0/317913133 --> [v2:172.21.15.154:6800/3949375489,v1:172.21.15.154:6801/3949375489] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcf1c1664b0 con 0x7fcf0806ce80 2023-07-14T13:33:04.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.547+0000 7fcf18ff9640 1 -- 172.21.15.5:0/317913133 <== osd.5 v2:172.21.15.154:6800/3949375489 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fcf1c1664b0 con 0x7fcf0806ce80 2023-07-14T13:33:04.544 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T13:33:04.544 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-14T13:33:04.545 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T13:33:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.547+0000 7fcf224f9640 1 -- 172.21.15.5:0/317913133 >> [v2:172.21.15.154:6800/3949375489,v1:172.21.15.154:6801/3949375489] conn(0x7fcf0806ce80 msgr2=0x7fcf0806f290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.547+0000 7fcf224f9640 1 --2- 172.21.15.5:0/317913133 >> [v2:172.21.15.154:6800/3949375489,v1:172.21.15.154:6801/3949375489] conn(0x7fcf0806ce80 0x7fcf0806f290 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.547+0000 7fcf224f9640 1 -- 172.21.15.5:0/317913133 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fcf080663d0 msgr2=0x7fcf08068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.547+0000 7fcf224f9640 1 --2- 172.21.15.5:0/317913133 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fcf080663d0 0x7fcf08068880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009af0 tx=0x7fcf0c008040 comp rx=0 tx=0).stop 2023-07-14T13:33:04.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.547+0000 7fcf224f9640 1 -- 172.21.15.5:0/317913133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf1c1453a0 msgr2=0x7fcf1c163750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:04.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.547+0000 7fcf224f9640 1 --2- 172.21.15.5:0/317913133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf1c1453a0 0x7fcf1c163750 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7fcf1001c960 tx=0x7fcf1001acc0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.547+0000 7fcf20a96640 1 -- 172.21.15.5:0/317913133 reap_dead start 2023-07-14T13:33:04.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.547+0000 7fcf224f9640 1 -- 172.21.15.5:0/317913133 shutdown_connections 2023-07-14T13:33:04.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.547+0000 7fcf224f9640 1 -- 172.21.15.5:0/317913133 >> 172.21.15.5:0/317913133 conn(0x7fcf1c0b1210 msgr2=0x7fcf1c0afbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:04.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.547+0000 7fcf224f9640 1 -- 172.21.15.5:0/317913133 shutdown_connections 2023-07-14T13:33:04.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.547+0000 7fcf224f9640 1 -- 172.21.15.5:0/317913133 wait complete. 2023-07-14T13:33:04.562 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-07-14T13:33:04.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.707+0000 7f613bef9640 1 Processor -- start 2023-07-14T13:33:04.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.707+0000 7f613bef9640 1 -- start start 2023-07-14T13:33:04.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.711+0000 7f613bef9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6134070b70 0x7f6134070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:04.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.711+0000 7f613bef9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f613406b1e0 0x7f61340c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.711+0000 7f613bef9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61340cac70 con 0x7f61340c21f0 2023-07-14T13:33:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.711+0000 7f613bef9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6134071480 con 0x7f6134070b70 2023-07-14T13:33:04.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.711+0000 7f613bef9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61340ca060 con 0x7f613406b1e0 2023-07-14T13:33:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.711+0000 7f6139494640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f613406b1e0 0x7f61340c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.711+0000 7f6139494640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f613406b1e0 0x7f61340c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.5:41930/0 (socket says 172.21.15.5:41930) 2023-07-14T13:33:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.711+0000 7f6139494640 1 -- 172.21.15.5:0/2322752092 learned_addr learned my addr 172.21.15.5:0/2322752092 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.711+0000 7f6139c95640 1 --2- 172.21.15.5:0/2322752092 >> v2:172.21.15.154:3300/0 conn(0x7f6134070b70 0x7f6134070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:04.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.711+0000 7f6139494640 1 -- 172.21.15.5:0/2322752092 >> v2:172.21.15.154:3300/0 conn(0x7f6134070b70 msgr2=0x7f6134070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.711+0000 7f6139494640 1 --2- 172.21.15.5:0/2322752092 >> v2:172.21.15.154:3300/0 conn(0x7f6134070b70 0x7f6134070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.711+0000 7f6139494640 1 -- 172.21.15.5:0/2322752092 >> v1:172.21.15.154:6789/0 conn(0x7f61340c21f0 legacy=0x7f61340cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:04.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.711+0000 7f6139494640 1 -- 172.21.15.5:0/2322752092 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61340ca340 con 0x7f613406b1e0 2023-07-14T13:33:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.715+0000 7f6139494640 1 --2- 172.21.15.5:0/2322752092 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f613406b1e0 0x7f61340c1cb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6124009870 tx=0x7f612401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=124ef303312d1c4c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.715+0000 7f6138c93640 1 -- 172.21.15.5:0/2322752092 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61240ab680 con 0x7f613406b1e0 2023-07-14T13:33:04.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.715+0000 7f6138c93640 1 -- 172.21.15.5:0/2322752092 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61240ab7e0 con 0x7f613406b1e0 2023-07-14T13:33:04.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.715+0000 7f6138c93640 1 -- 172.21.15.5:0/2322752092 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61240abb70 con 0x7f613406b1e0 2023-07-14T13:33:04.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.715+0000 7f613bef9640 1 -- 172.21.15.5:0/2322752092 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f613406b1e0 msgr2=0x7f61340c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:04.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.715+0000 7f613bef9640 1 --2- 172.21.15.5:0/2322752092 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f613406b1e0 0x7f61340c1cb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6124009870 tx=0x7f612401c480 comp rx=0 tx=0).stop 2023-07-14T13:33:04.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.715+0000 7f613bef9640 1 -- 172.21.15.5:0/2322752092 shutdown_connections 2023-07-14T13:33:04.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.715+0000 7f613bef9640 1 --2- 172.21.15.5:0/2322752092 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f613406b1e0 0x7f61340c1cb0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.715+0000 7f613bef9640 1 --2- 172.21.15.5:0/2322752092 >> v2:172.21.15.154:3300/0 conn(0x7f6134070b70 0x7f6134070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.715+0000 7f613bef9640 1 -- 172.21.15.5:0/2322752092 >> 172.21.15.5:0/2322752092 conn(0x7f61340afcf0 msgr2=0x7f61340b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:04.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.715+0000 7f613bef9640 1 -- 172.21.15.5:0/2322752092 shutdown_connections 2023-07-14T13:33:04.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.715+0000 7f613bef9640 1 -- 172.21.15.5:0/2322752092 wait complete. 2023-07-14T13:33:04.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.715+0000 7f613bef9640 1 Processor -- start 2023-07-14T13:33:04.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.715+0000 7f613bef9640 1 -- start start 2023-07-14T13:33:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.719+0000 7f613bef9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f613406b1e0 0x7f6134152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.719+0000 7f613bef9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6134070b70 0x7f6134154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.719+0000 7f613bef9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61340c21f0 0x7f6134155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.719+0000 7f613bef9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61340c54f0 con 0x7f61340c21f0 2023-07-14T13:33:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.719+0000 7f613bef9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6134152e90 con 0x7f613406b1e0 2023-07-14T13:33:04.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.719+0000 7f613bef9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61341530c0 con 0x7f6134070b70 2023-07-14T13:33:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.719+0000 7f613a496640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61340c21f0 0x7f6134155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.719+0000 7f613a496640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61340c21f0 0x7f6134155420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55390/0 (socket says 172.21.15.5:55390) 2023-07-14T13:33:04.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.719+0000 7f613a496640 1 -- 172.21.15.5:0/2789139398 learned_addr learned my addr 172.21.15.5:0/2789139398 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.719+0000 7f6139c95640 1 --2- 172.21.15.5:0/2789139398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f613406b1e0 0x7f6134152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.719+0000 7f6139494640 1 --2- 172.21.15.5:0/2789139398 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6134070b70 0x7f6134154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.719+0000 7f613a496640 1 -- 172.21.15.5:0/2789139398 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6134070b70 msgr2=0x7f6134154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:04.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.719+0000 7f613a496640 1 --2- 172.21.15.5:0/2789139398 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6134070b70 0x7f6134154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.719+0000 7f613a496640 1 -- 172.21.15.5:0/2789139398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f613406b1e0 msgr2=0x7f6134152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.719+0000 7f613a496640 1 --2- 172.21.15.5:0/2789139398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f613406b1e0 0x7f6134152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.719+0000 7f613a496640 1 -- 172.21.15.5:0/2789139398 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61240094d0 con 0x7f61340c21f0 2023-07-14T13:33:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.719+0000 7f6139c95640 1 --2- 172.21.15.5:0/2789139398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f613406b1e0 0x7f6134152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:33:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.719+0000 7f6139494640 1 --2- 172.21.15.5:0/2789139398 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6134070b70 0x7f6134154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:33:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.719+0000 7f613a496640 1 --2- 172.21.15.5:0/2789139398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61340c21f0 0x7f6134155420 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f612c00c730 tx=0x7f612c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.719+0000 7f612a7fc640 1 -- 172.21.15.5:0/2789139398 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c003b80 con 0x7f61340c21f0 2023-07-14T13:33:04.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.719+0000 7f612a7fc640 1 -- 172.21.15.5:0/2789139398 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612c003ce0 con 0x7f61340c21f0 2023-07-14T13:33:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.719+0000 7f612a7fc640 1 -- 172.21.15.5:0/2789139398 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c005310 con 0x7f61340c21f0 2023-07-14T13:33:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.719+0000 7f613bef9640 1 -- 172.21.15.5:0/2789139398 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61341533a0 con 0x7f61340c21f0 2023-07-14T13:33:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.719+0000 7f613bef9640 1 -- 172.21.15.5:0/2789139398 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6134153960 con 0x7f61340c21f0 2023-07-14T13:33:04.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.719+0000 7f613bef9640 1 -- 172.21.15.5:0/2789139398 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6134071110 con 0x7f61340c21f0 2023-07-14T13:33:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.719+0000 7f612a7fc640 1 -- 172.21.15.5:0/2789139398 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f612c005680 con 0x7f61340c21f0 2023-07-14T13:33:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.723+0000 7f612a7fc640 1 --2- 172.21.15.5:0/2789139398 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f61180663a0 0x7f6118068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.723+0000 7f612a7fc640 1 -- 172.21.15.5:0/2789139398 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7f612c083e50 con 0x7f61340c21f0 2023-07-14T13:33:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.723+0000 7f6139c95640 1 --2- 172.21.15.5:0/2789139398 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f61180663a0 0x7f6118068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:04.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.723+0000 7f6139c95640 1 --2- 172.21.15.5:0/2789139398 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f61180663a0 0x7f6118068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f61341567f0 tx=0x7f6130008040 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:04.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.727+0000 7f612a7fc640 1 -- 172.21.15.5:0/2789139398 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f612c051120 con 0x7f61340c21f0 2023-07-14T13:33:04.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.883+0000 7f613bef9640 1 -- 172.21.15.5:0/2789139398 --> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f61340c9cf0 con 0x7f61180663a0 2023-07-14T13:33:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.887+0000 7f612a7fc640 1 -- 172.21.15.5:0/2789139398 <== mgr.10192 v2:172.21.15.154:6832/317858933 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6130010930 con 0x7f61180663a0 2023-07-14T13:33:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 5 to deep-scrub 2023-07-14T13:33:04.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.887+0000 7f613bef9640 1 -- 172.21.15.5:0/2789139398 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f61180663a0 msgr2=0x7f6118068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.887+0000 7f613bef9640 1 --2- 172.21.15.5:0/2789139398 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f61180663a0 0x7f6118068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f61341567f0 tx=0x7f6130008040 comp rx=0 tx=0).stop 2023-07-14T13:33:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.887+0000 7f613bef9640 1 -- 172.21.15.5:0/2789139398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61340c21f0 msgr2=0x7f6134155420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.887+0000 7f613bef9640 1 --2- 172.21.15.5:0/2789139398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61340c21f0 0x7f6134155420 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f612c00c730 tx=0x7f612c00cbf0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.887+0000 7f613bef9640 1 -- 172.21.15.5:0/2789139398 shutdown_connections 2023-07-14T13:33:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.887+0000 7f613bef9640 1 --2- 172.21.15.5:0/2789139398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61340c21f0 0x7f6134155420 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.887+0000 7f613bef9640 1 --2- 172.21.15.5:0/2789139398 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f61180663a0 0x7f6118068850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.887+0000 7f613bef9640 1 --2- 172.21.15.5:0/2789139398 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6134070b70 0x7f6134154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.887+0000 7f613bef9640 1 --2- 172.21.15.5:0/2789139398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f613406b1e0 0x7f6134152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:04.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.887+0000 7f613bef9640 1 -- 172.21.15.5:0/2789139398 >> 172.21.15.5:0/2789139398 conn(0x7f61340afcf0 msgr2=0x7f6134155c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:04.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.887+0000 7f613bef9640 1 -- 172.21.15.5:0/2789139398 shutdown_connections 2023-07-14T13:33:04.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:04.887+0000 7f613bef9640 1 -- 172.21.15.5:0/2789139398 wait complete. 2023-07-14T13:33:04.903 INFO:tasks.ceph:Scrubbing osd.6 2023-07-14T13:33:04.904 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-07-14T13:33:05.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.055+0000 7fd25c59d640 1 Processor -- start 2023-07-14T13:33:05.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.055+0000 7fd25c59d640 1 -- start start 2023-07-14T13:33:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.059+0000 7fd25c59d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd25415cef0 0x7fd254158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.059+0000 7fd25c59d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd254159270 0x7fd2540c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:05.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.059+0000 7fd25c59d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2541532b0 con 0x7fd2540aeb40 2023-07-14T13:33:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.059+0000 7fd25c59d640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd25415d360 con 0x7fd254159270 2023-07-14T13:33:05.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.059+0000 7fd25c59d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2540ca6f0 con 0x7fd25415cef0 2023-07-14T13:33:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.059+0000 7fd25ab3a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd254159270 0x7fd2540c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.059+0000 7fd25ab3a640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd254159270 0x7fd2540c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55392/0 (socket says 172.21.15.5:55392) 2023-07-14T13:33:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.059+0000 7fd25ab3a640 1 -- 172.21.15.5:0/657466228 learned_addr learned my addr 172.21.15.5:0/657466228 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.059+0000 7fd259b38640 1 --2- 172.21.15.5:0/657466228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd25415cef0 0x7fd254158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.059+0000 7fd25ab3a640 1 -- 172.21.15.5:0/657466228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd25415cef0 msgr2=0x7fd254158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.059+0000 7fd25ab3a640 1 --2- 172.21.15.5:0/657466228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd25415cef0 0x7fd254158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.059+0000 7fd25ab3a640 1 -- 172.21.15.5:0/657466228 >> v1:172.21.15.154:6789/0 conn(0x7fd2540aeb40 legacy=0x7fd2540aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:05.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.059+0000 7fd25ab3a640 1 -- 172.21.15.5:0/657466228 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2541599d0 con 0x7fd254159270 2023-07-14T13:33:05.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.059+0000 7fd259b38640 1 --2- 172.21.15.5:0/657466228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd25415cef0 0x7fd254158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:33:05.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.063+0000 7fd25ab3a640 1 --2- 172.21.15.5:0/657466228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd254159270 0x7fd2540c88c0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7fd24c009e50 tx=0x7fd24c01ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4658aac23503f0d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:05.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.063+0000 7fd259337640 1 -- 172.21.15.5:0/657466228 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c0a7ac0 con 0x7fd254159270 2023-07-14T13:33:05.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.063+0000 7fd259337640 1 -- 172.21.15.5:0/657466228 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24c0a7c20 con 0x7fd254159270 2023-07-14T13:33:05.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.063+0000 7fd259337640 1 -- 172.21.15.5:0/657466228 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c0af3f0 con 0x7fd254159270 2023-07-14T13:33:05.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.063+0000 7fd25c59d640 1 -- 172.21.15.5:0/657466228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd254159270 msgr2=0x7fd2540c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:05.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.063+0000 7fd25c59d640 1 --2- 172.21.15.5:0/657466228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd254159270 0x7fd2540c88c0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7fd24c009e50 tx=0x7fd24c01ebf0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.063+0000 7fd25c59d640 1 -- 172.21.15.5:0/657466228 shutdown_connections 2023-07-14T13:33:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.063+0000 7fd25c59d640 1 --2- 172.21.15.5:0/657466228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd254159270 0x7fd2540c88c0 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.063+0000 7fd25c59d640 1 --2- 172.21.15.5:0/657466228 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd25415cef0 0x7fd254158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.063+0000 7fd25c59d640 1 -- 172.21.15.5:0/657466228 >> 172.21.15.5:0/657466228 conn(0x7fd2540cde90 msgr2=0x7fd2540ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.063+0000 7fd25c59d640 1 -- 172.21.15.5:0/657466228 shutdown_connections 2023-07-14T13:33:05.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.063+0000 7fd25c59d640 1 -- 172.21.15.5:0/657466228 wait complete. 2023-07-14T13:33:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.063+0000 7fd25c59d640 1 Processor -- start 2023-07-14T13:33:05.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.063+0000 7fd25c59d640 1 -- start start 2023-07-14T13:33:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.067+0000 7fd25c59d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2540aeb40 0x7fd2541525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.067+0000 7fd25c59d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd254159270 0x7fd2540c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.067+0000 7fd25c59d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd25415cef0 0x7fd2541579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.067+0000 7fd25c59d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2540b2e90 con 0x7fd2540aeb40 2023-07-14T13:33:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.067+0000 7fd25c59d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd254070a90 con 0x7fd25415cef0 2023-07-14T13:33:05.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.067+0000 7fd25c59d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2540704d0 con 0x7fd254159270 2023-07-14T13:33:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.067+0000 7fd25a339640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2540aeb40 0x7fd2541525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.067+0000 7fd25a339640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2540aeb40 0x7fd2541525d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55398/0 (socket says 172.21.15.5:55398) 2023-07-14T13:33:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.067+0000 7fd25a339640 1 -- 172.21.15.5:0/1039897385 learned_addr learned my addr 172.21.15.5:0/1039897385 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.067+0000 7fd259b38640 1 --2- 172.21.15.5:0/1039897385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd254159270 0x7fd2540c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:05.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.067+0000 7fd25ab3a640 1 --2- 172.21.15.5:0/1039897385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd25415cef0 0x7fd2541579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.067+0000 7fd25a339640 1 -- 172.21.15.5:0/1039897385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd254159270 msgr2=0x7fd2540c3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.067+0000 7fd25a339640 1 --2- 172.21.15.5:0/1039897385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd254159270 0x7fd2540c3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.067+0000 7fd25a339640 1 -- 172.21.15.5:0/1039897385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd25415cef0 msgr2=0x7fd2541579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.067+0000 7fd25a339640 1 --2- 172.21.15.5:0/1039897385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd25415cef0 0x7fd2541579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.067+0000 7fd25a339640 1 -- 172.21.15.5:0/1039897385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c009b30 con 0x7fd2540aeb40 2023-07-14T13:33:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.067+0000 7fd25a339640 1 --2- 172.21.15.5:0/1039897385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2540aeb40 0x7fd2541525d0 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7fd25000c530 tx=0x7fd25000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.067+0000 7fd24affd640 1 -- 172.21.15.5:0/1039897385 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd250005220 con 0x7fd2540aeb40 2023-07-14T13:33:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.067+0000 7fd24affd640 1 -- 172.21.15.5:0/1039897385 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd250005380 con 0x7fd2540aeb40 2023-07-14T13:33:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.067+0000 7fd24affd640 1 -- 172.21.15.5:0/1039897385 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd250007270 con 0x7fd2540aeb40 2023-07-14T13:33:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.067+0000 7fd25c59d640 1 -- 172.21.15.5:0/1039897385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2540707b0 con 0x7fd2540aeb40 2023-07-14T13:33:05.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.067+0000 7fd25c59d640 1 -- 172.21.15.5:0/1039897385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2540b2ab0 con 0x7fd2540aeb40 2023-07-14T13:33:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.067+0000 7fd25c59d640 1 -- 172.21.15.5:0/1039897385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd25415c9d0 con 0x7fd2540aeb40 2023-07-14T13:33:05.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.067+0000 7fd24affd640 1 -- 172.21.15.5:0/1039897385 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd2500073d0 con 0x7fd2540aeb40 2023-07-14T13:33:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.071+0000 7fd24affd640 1 --2- 172.21.15.5:0/1039897385 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fd2380663a0 0x7fd238068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.071+0000 7fd24affd640 1 -- 172.21.15.5:0/1039897385 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7fd250083620 con 0x7fd2540aeb40 2023-07-14T13:33:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.071+0000 7fd24affd640 1 --2- 172.21.15.5:0/1039897385 >> [v2:172.21.15.154:6824/1951324705,v1:172.21.15.154:6825/1951324705] conn(0x7fd23806ce50 0x7fd23806f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.071+0000 7fd24affd640 1 -- 172.21.15.5:0/1039897385 --> [v2:172.21.15.154:6824/1951324705,v1:172.21.15.154:6825/1951324705] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd23806f930 con 0x7fd23806ce50 2023-07-14T13:33:05.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.071+0000 7fd24affd640 1 -- 172.21.15.5:0/1039897385 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=196) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd250085c00 con 0x7fd2540aeb40 2023-07-14T13:33:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.071+0000 7fd259b38640 1 --2- 172.21.15.5:0/1039897385 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fd2380663a0 0x7fd238068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.071+0000 7fd25ab3a640 1 --2- 172.21.15.5:0/1039897385 >> [v2:172.21.15.154:6824/1951324705,v1:172.21.15.154:6825/1951324705] conn(0x7fd23806ce50 0x7fd23806f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.071+0000 7fd259b38640 1 --2- 172.21.15.5:0/1039897385 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fd2380663a0 0x7fd238068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd2540b18b0 tx=0x7fd244008040 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:05.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.071+0000 7fd25ab3a640 1 --2- 172.21.15.5:0/1039897385 >> [v2:172.21.15.154:6824/1951324705,v1:172.21.15.154:6825/1951324705] conn(0x7fd23806ce50 0x7fd23806f260 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:05.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.071+0000 7fd24affd640 1 -- 172.21.15.5:0/1039897385 <== osd.6 v2:172.21.15.154:6824/1951324705 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd23806f930 con 0x7fd23806ce50 2023-07-14T13:33:05.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.083+0000 7fd25c59d640 1 -- 172.21.15.5:0/1039897385 --> [v2:172.21.15.154:6824/1951324705,v1:172.21.15.154:6825/1951324705] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd25415c6f0 con 0x7fd23806ce50 2023-07-14T13:33:05.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.083+0000 7fd24affd640 1 -- 172.21.15.5:0/1039897385 <== osd.6 v2:172.21.15.154:6824/1951324705 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd24c009150 con 0x7fd23806ce50 2023-07-14T13:33:05.083 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T13:33:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-14T13:33:05.083 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T13:33:05.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.087+0000 7fd25c59d640 1 -- 172.21.15.5:0/1039897385 >> [v2:172.21.15.154:6824/1951324705,v1:172.21.15.154:6825/1951324705] conn(0x7fd23806ce50 msgr2=0x7fd23806f260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:05.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.087+0000 7fd25c59d640 1 --2- 172.21.15.5:0/1039897385 >> [v2:172.21.15.154:6824/1951324705,v1:172.21.15.154:6825/1951324705] conn(0x7fd23806ce50 0x7fd23806f260 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.087+0000 7fd25c59d640 1 -- 172.21.15.5:0/1039897385 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fd2380663a0 msgr2=0x7fd238068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:05.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.087+0000 7fd25c59d640 1 --2- 172.21.15.5:0/1039897385 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fd2380663a0 0x7fd238068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd2540b18b0 tx=0x7fd244008040 comp rx=0 tx=0).stop 2023-07-14T13:33:05.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.087+0000 7fd25c59d640 1 -- 172.21.15.5:0/1039897385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2540aeb40 msgr2=0x7fd2541525d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:05.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.087+0000 7fd25c59d640 1 --2- 172.21.15.5:0/1039897385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2540aeb40 0x7fd2541525d0 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7fd25000c530 tx=0x7fd25000c9f0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.087+0000 7fd25ab3a640 1 -- 172.21.15.5:0/1039897385 reap_dead start 2023-07-14T13:33:05.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.087+0000 7fd25c59d640 1 -- 172.21.15.5:0/1039897385 shutdown_connections 2023-07-14T13:33:05.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.087+0000 7fd25c59d640 1 -- 172.21.15.5:0/1039897385 >> 172.21.15.5:0/1039897385 conn(0x7fd2540cde90 msgr2=0x7fd2540ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:05.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.087+0000 7fd25c59d640 1 -- 172.21.15.5:0/1039897385 shutdown_connections 2023-07-14T13:33:05.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.087+0000 7fd25c59d640 1 -- 172.21.15.5:0/1039897385 wait complete. 2023-07-14T13:33:05.101 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-07-14T13:33:05.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.251+0000 7f5f4b340640 1 Processor -- start 2023-07-14T13:33:05.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.251+0000 7f5f4b340640 1 -- start start 2023-07-14T13:33:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.251+0000 7f5f4b340640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f44158ce0 0x7f5f44070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.251+0000 7f5f4b340640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5f440c8ad0 0x7f5f440c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.251+0000 7f5f4b340640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f440cc700 con 0x7f5f440c9560 2023-07-14T13:33:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.251+0000 7f5f4b340640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f440c99e0 con 0x7f5f440c8ad0 2023-07-14T13:33:05.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.251+0000 7f5f4b340640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f440b0ff0 con 0x7f5f44158ce0 2023-07-14T13:33:05.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.251+0000 7f5f498dd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5f440c9560 0x7f5f440cab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35368/0 (socket says 172.21.15.5:35368) 2023-07-14T13:33:05.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.251+0000 7f5f498dd640 1 -- 172.21.15.5:0/1658343459 learned_addr learned my addr 172.21.15.5:0/1658343459 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:33:05.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.251+0000 7f5f490dc640 1 --2- 172.21.15.5:0/1658343459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f44158ce0 0x7f5f44070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.251+0000 7f5f488db640 1 --2- 172.21.15.5:0/1658343459 >> v2:172.21.15.154:3300/0 conn(0x7f5f440c8ad0 0x7f5f440c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.251+0000 7f5f3bfff640 1 -- 172.21.15.5:0/1658343459 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 600536602 0 0) 0x7f5f440cc700 con 0x7f5f440c9560 2023-07-14T13:33:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.251+0000 7f5f3bfff640 1 -- 172.21.15.5:0/1658343459 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f30005740 con 0x7f5f440c9560 2023-07-14T13:33:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.251+0000 7f5f488db640 1 -- 172.21.15.5:0/1658343459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f44158ce0 msgr2=0x7f5f44070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.251+0000 7f5f488db640 1 --2- 172.21.15.5:0/1658343459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f44158ce0 0x7f5f44070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.251+0000 7f5f488db640 1 -- 172.21.15.5:0/1658343459 >> v1:172.21.15.5:6789/0 conn(0x7f5f440c9560 legacy=0x7f5f440cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.251+0000 7f5f488db640 1 -- 172.21.15.5:0/1658343459 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f44070c80 con 0x7f5f440c8ad0 2023-07-14T13:33:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.251+0000 7f5f490dc640 1 --2- 172.21.15.5:0/1658343459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f44158ce0 0x7f5f44070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:33:05.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.255+0000 7f5f488db640 1 --2- 172.21.15.5:0/1658343459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f440c8ad0 0x7f5f440c9020 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f5f340097c0 tx=0x7f5f3401c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7def161a3f6dbc95 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.255+0000 7f5f3bfff640 1 -- 172.21.15.5:0/1658343459 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f440cba20 con 0x7f5f440c8ad0 2023-07-14T13:33:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.255+0000 7f5f3bfff640 1 -- 172.21.15.5:0/1658343459 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f340a7050 con 0x7f5f440c8ad0 2023-07-14T13:33:05.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.255+0000 7f5f3bfff640 1 -- 172.21.15.5:0/1658343459 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f340ab820 con 0x7f5f440c8ad0 2023-07-14T13:33:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.255+0000 7f5f4b340640 1 -- 172.21.15.5:0/1658343459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f440c8ad0 msgr2=0x7f5f440c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.255+0000 7f5f4b340640 1 --2- 172.21.15.5:0/1658343459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f440c8ad0 0x7f5f440c9020 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f5f340097c0 tx=0x7f5f3401c330 comp rx=0 tx=0).stop 2023-07-14T13:33:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.255+0000 7f5f4b340640 1 -- 172.21.15.5:0/1658343459 shutdown_connections 2023-07-14T13:33:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.255+0000 7f5f4b340640 1 --2- 172.21.15.5:0/1658343459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f440c8ad0 0x7f5f440c9020 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.255+0000 7f5f4b340640 1 --2- 172.21.15.5:0/1658343459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f44158ce0 0x7f5f44070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.255+0000 7f5f4b340640 1 -- 172.21.15.5:0/1658343459 >> 172.21.15.5:0/1658343459 conn(0x7f5f440afcf0 msgr2=0x7f5f440b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:05.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.255+0000 7f5f4b340640 1 -- 172.21.15.5:0/1658343459 shutdown_connections 2023-07-14T13:33:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.255+0000 7f5f4b340640 1 -- 172.21.15.5:0/1658343459 wait complete. 2023-07-14T13:33:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.259+0000 7f5f4b340640 1 Processor -- start 2023-07-14T13:33:05.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.259+0000 7f5f4b340640 1 -- start start 2023-07-14T13:33:05.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.259+0000 7f5f4b340640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f440c8ad0 0x7f5f44148520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:05.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.259+0000 7f5f4b340640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f440c9560 0x7f5f440c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:05.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.259+0000 7f5f4b340640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f44158ce0 0x7f5f440c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:05.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.259+0000 7f5f4b340640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f440b11e0 con 0x7f5f44158ce0 2023-07-14T13:33:05.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.259+0000 7f5f4b340640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f440c4b90 con 0x7f5f440c9560 2023-07-14T13:33:05.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.259+0000 7f5f4b340640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f440b14a0 con 0x7f5f440c8ad0 2023-07-14T13:33:05.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.259+0000 7f5f498dd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f44158ce0 0x7f5f440c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:05.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.259+0000 7f5f498dd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f44158ce0 0x7f5f440c4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55400/0 (socket says 172.21.15.5:55400) 2023-07-14T13:33:05.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.259+0000 7f5f498dd640 1 -- 172.21.15.5:0/148705444 learned_addr learned my addr 172.21.15.5:0/148705444 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:05.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.259+0000 7f5f490dc640 1 --2- 172.21.15.5:0/148705444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f440c8ad0 0x7f5f44148520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:05.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.259+0000 7f5f488db640 1 --2- 172.21.15.5:0/148705444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f440c9560 0x7f5f440c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:05.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.259+0000 7f5f498dd640 1 -- 172.21.15.5:0/148705444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f440c8ad0 msgr2=0x7f5f44148520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:05.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.259+0000 7f5f498dd640 1 --2- 172.21.15.5:0/148705444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f440c8ad0 0x7f5f44148520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.259+0000 7f5f498dd640 1 -- 172.21.15.5:0/148705444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f440c9560 msgr2=0x7f5f440c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:05.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.259+0000 7f5f498dd640 1 --2- 172.21.15.5:0/148705444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f440c9560 0x7f5f440c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.259+0000 7f5f498dd640 1 -- 172.21.15.5:0/148705444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f40009420 con 0x7f5f44158ce0 2023-07-14T13:33:05.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.259+0000 7f5f498dd640 1 --2- 172.21.15.5:0/148705444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f44158ce0 0x7f5f440c4020 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c00cb40 tx=0x7f5f3c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:05.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.259+0000 7f5f39ffb640 1 -- 172.21.15.5:0/148705444 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c00aca0 con 0x7f5f44158ce0 2023-07-14T13:33:05.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.259+0000 7f5f39ffb640 1 -- 172.21.15.5:0/148705444 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3c00ae00 con 0x7f5f44158ce0 2023-07-14T13:33:05.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.259+0000 7f5f39ffb640 1 -- 172.21.15.5:0/148705444 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c012620 con 0x7f5f44158ce0 2023-07-14T13:33:05.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.259+0000 7f5f4b340640 1 -- 172.21.15.5:0/148705444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f34009420 con 0x7f5f44158ce0 2023-07-14T13:33:05.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.259+0000 7f5f4b340640 1 -- 172.21.15.5:0/148705444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f440b1a60 con 0x7f5f44158ce0 2023-07-14T13:33:05.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.263+0000 7f5f4b340640 1 -- 172.21.15.5:0/148705444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f440ca1a0 con 0x7f5f44158ce0 2023-07-14T13:33:05.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.263+0000 7f5f39ffb640 1 -- 172.21.15.5:0/148705444 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5f3c007070 con 0x7f5f44158ce0 2023-07-14T13:33:05.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.263+0000 7f5f39ffb640 1 --2- 172.21.15.5:0/148705444 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f5f280663a0 0x7f5f28068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:05.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.263+0000 7f5f39ffb640 1 -- 172.21.15.5:0/148705444 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7f5f3c083ed0 con 0x7f5f44158ce0 2023-07-14T13:33:05.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.263+0000 7f5f490dc640 1 --2- 172.21.15.5:0/148705444 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f5f280663a0 0x7f5f28068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:05.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.263+0000 7f5f490dc640 1 --2- 172.21.15.5:0/148705444 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f5f280663a0 0x7f5f28068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5f440acf70 tx=0x7f5f40009190 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:05.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.267+0000 7f5f39ffb640 1 -- 172.21.15.5:0/148705444 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f5f3c051250 con 0x7f5f44158ce0 2023-07-14T13:33:05.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.427+0000 7f5f4b340640 1 -- 172.21.15.5:0/148705444 --> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f44070990 con 0x7f5f280663a0 2023-07-14T13:33:05.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.427+0000 7f5f39ffb640 1 -- 172.21.15.5:0/148705444 <== mgr.10192 v2:172.21.15.154:6832/317858933 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5f40009cf0 con 0x7f5f280663a0 2023-07-14T13:33:05.424 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 6 to deep-scrub 2023-07-14T13:33:05.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.427+0000 7f5f4b340640 1 -- 172.21.15.5:0/148705444 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f5f280663a0 msgr2=0x7f5f28068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:05.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.427+0000 7f5f4b340640 1 --2- 172.21.15.5:0/148705444 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f5f280663a0 0x7f5f28068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5f440acf70 tx=0x7f5f40009190 comp rx=0 tx=0).stop 2023-07-14T13:33:05.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.427+0000 7f5f4b340640 1 -- 172.21.15.5:0/148705444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f44158ce0 msgr2=0x7f5f440c4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.427+0000 7f5f4b340640 1 --2- 172.21.15.5:0/148705444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f44158ce0 0x7f5f440c4020 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c00cb40 tx=0x7f5f3c00a060 comp rx=0 tx=0).stop 2023-07-14T13:33:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.427+0000 7f5f4b340640 1 -- 172.21.15.5:0/148705444 shutdown_connections 2023-07-14T13:33:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.427+0000 7f5f4b340640 1 --2- 172.21.15.5:0/148705444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f44158ce0 0x7f5f440c4020 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.427+0000 7f5f4b340640 1 --2- 172.21.15.5:0/148705444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f440c9560 0x7f5f440c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.427+0000 7f5f4b340640 1 --2- 172.21.15.5:0/148705444 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f5f280663a0 0x7f5f28068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.427+0000 7f5f4b340640 1 --2- 172.21.15.5:0/148705444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f440c8ad0 0x7f5f44148520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.427+0000 7f5f4b340640 1 -- 172.21.15.5:0/148705444 >> 172.21.15.5:0/148705444 conn(0x7f5f440afcf0 msgr2=0x7f5f440ca6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:05.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.427+0000 7f5f4b340640 1 -- 172.21.15.5:0/148705444 shutdown_connections 2023-07-14T13:33:05.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.427+0000 7f5f4b340640 1 -- 172.21.15.5:0/148705444 wait complete. 2023-07-14T13:33:05.445 INFO:tasks.ceph:Scrubbing osd.7 2023-07-14T13:33:05.446 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-07-14T13:33:05.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.595+0000 7fadfee93640 1 Processor -- start 2023-07-14T13:33:05.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.595+0000 7fadfee93640 1 -- start start 2023-07-14T13:33:05.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.595+0000 7fadfee93640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadf8069430 0x7fadf80cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:05.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.595+0000 7fadfee93640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fadf8160030 0x7fadf8069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:05.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.595+0000 7fadfee93640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf8069d40 con 0x7fadf8070330 2023-07-14T13:33:05.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.595+0000 7fadfee93640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf80cb7d0 con 0x7fadf8160030 2023-07-14T13:33:05.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.595+0000 7fadfee93640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf806c510 con 0x7fadf8069430 2023-07-14T13:33:05.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.599+0000 7fadf7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fadf8160030 0x7fadf8069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:05.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.599+0000 7fadf7fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fadf8160030 0x7fadf8069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55414/0 (socket says 172.21.15.5:55414) 2023-07-14T13:33:05.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.599+0000 7fadf7fff640 1 -- 172.21.15.5:0/3571944674 learned_addr learned my addr 172.21.15.5:0/3571944674 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:05.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.599+0000 7fadfd430640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fadf8070330 0x7fadf80707b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35374/0 (socket says 172.21.15.5:35374) 2023-07-14T13:33:05.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.599+0000 7fadfcc2f640 1 --2- 172.21.15.5:0/3571944674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadf8069430 0x7fadf80cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:05.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.599+0000 7fadf7fff640 1 -- 172.21.15.5:0/3571944674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadf8069430 msgr2=0x7fadf80cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:05.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.599+0000 7fadf7fff640 1 --2- 172.21.15.5:0/3571944674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadf8069430 0x7fadf80cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.599+0000 7fadf7fff640 1 -- 172.21.15.5:0/3571944674 >> v1:172.21.15.5:6789/0 conn(0x7fadf8070330 legacy=0x7fadf80707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:05.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.599+0000 7fadf7fff640 1 -- 172.21.15.5:0/3571944674 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf806c7f0 con 0x7fadf8160030 2023-07-14T13:33:05.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.599+0000 7fadf77fe640 1 -- 172.21.15.5:0/3571944674 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3255915729 0 0) 0x7fadf8069d40 con 0x7fadf8070330 2023-07-14T13:33:05.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.599+0000 7fadf7fff640 1 --2- 172.21.15.5:0/3571944674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf8160030 0x7fadf8069800 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7fade4009870 tx=0x7fade401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=445feaa358cc88d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:05.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.599+0000 7fadf77fe640 1 -- 172.21.15.5:0/3571944674 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade40ab680 con 0x7fadf8160030 2023-07-14T13:33:05.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.599+0000 7fadf77fe640 1 -- 172.21.15.5:0/3571944674 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade40ab7e0 con 0x7fadf8160030 2023-07-14T13:33:05.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.599+0000 7fadf77fe640 1 -- 172.21.15.5:0/3571944674 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade40abb70 con 0x7fadf8160030 2023-07-14T13:33:05.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.603+0000 7fadfee93640 1 -- 172.21.15.5:0/3571944674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf8160030 msgr2=0x7fadf8069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:05.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.603+0000 7fadfee93640 1 --2- 172.21.15.5:0/3571944674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf8160030 0x7fadf8069800 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7fade4009870 tx=0x7fade401c480 comp rx=0 tx=0).stop 2023-07-14T13:33:05.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.603+0000 7fadfee93640 1 -- 172.21.15.5:0/3571944674 shutdown_connections 2023-07-14T13:33:05.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.603+0000 7fadfee93640 1 --2- 172.21.15.5:0/3571944674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf8160030 0x7fadf8069800 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.603+0000 7fadfee93640 1 --2- 172.21.15.5:0/3571944674 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadf8069430 0x7fadf80cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.603+0000 7fadfee93640 1 -- 172.21.15.5:0/3571944674 >> 172.21.15.5:0/3571944674 conn(0x7fadf80b1840 msgr2=0x7fadf80cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:05.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.603+0000 7fadfee93640 1 -- 172.21.15.5:0/3571944674 shutdown_connections 2023-07-14T13:33:05.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.603+0000 7fadfee93640 1 -- 172.21.15.5:0/3571944674 wait complete. 2023-07-14T13:33:05.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.603+0000 7fadfee93640 1 Processor -- start 2023-07-14T13:33:05.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.603+0000 7fadfee93640 1 -- start start 2023-07-14T13:33:05.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.603+0000 7fadfee93640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadf8069430 0x7fadf80ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:05.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.603+0000 7fadfee93640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf8070330 0x7fadf80cea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:05.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.603+0000 7fadfee93640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadf8160030 0x7fadf80c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:05.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.603+0000 7fadfee93640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf80cef80 con 0x7fadf8070330 2023-07-14T13:33:05.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.603+0000 7fadfee93640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf80cdea0 con 0x7fadf8160030 2023-07-14T13:33:05.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.603+0000 7fadfee93640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf80cd600 con 0x7fadf8069430 2023-07-14T13:33:05.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.603+0000 7fadf7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf8070330 0x7fadf80cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:05.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.603+0000 7fadf7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf8070330 0x7fadf80cea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55420/0 (socket says 172.21.15.5:55420) 2023-07-14T13:33:05.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.603+0000 7fadf7fff640 1 -- 172.21.15.5:0/3612343277 learned_addr learned my addr 172.21.15.5:0/3612343277 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:05.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.603+0000 7fadfcc2f640 1 --2- 172.21.15.5:0/3612343277 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadf8069430 0x7fadf80ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:05.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.603+0000 7fadfd430640 1 --2- 172.21.15.5:0/3612343277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadf8160030 0x7fadf80c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.603+0000 7fadf7fff640 1 -- 172.21.15.5:0/3612343277 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadf8069430 msgr2=0x7fadf80ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.603+0000 7fadf7fff640 1 --2- 172.21.15.5:0/3612343277 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fadf8069430 0x7fadf80ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.603+0000 7fadf7fff640 1 -- 172.21.15.5:0/3612343277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadf8160030 msgr2=0x7fadf80c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.603+0000 7fadf7fff640 1 --2- 172.21.15.5:0/3612343277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadf8160030 0x7fadf80c6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.603+0000 7fadf7fff640 1 -- 172.21.15.5:0/3612343277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade40094d0 con 0x7fadf8070330 2023-07-14T13:33:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.607+0000 7fadf7fff640 1 --2- 172.21.15.5:0/3612343277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf8070330 0x7fadf80cea40 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7fade40ad040 tx=0x7fade4019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:05.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.607+0000 7fadf57fa640 1 -- 172.21.15.5:0/3612343277 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade40b5810 con 0x7fadf8070330 2023-07-14T13:33:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.607+0000 7fadf57fa640 1 -- 172.21.15.5:0/3612343277 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade40b59b0 con 0x7fadf8070330 2023-07-14T13:33:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.607+0000 7fadfee93640 1 -- 172.21.15.5:0/3612343277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf80cd8e0 con 0x7fadf8070330 2023-07-14T13:33:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.607+0000 7fadf57fa640 1 -- 172.21.15.5:0/3612343277 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade40b5d60 con 0x7fadf8070330 2023-07-14T13:33:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.607+0000 7fadfee93640 1 -- 172.21.15.5:0/3612343277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf81f4730 con 0x7fadf8070330 2023-07-14T13:33:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.607+0000 7fadfee93640 1 -- 172.21.15.5:0/3612343277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fadf81f45c0 con 0x7fadf8070330 2023-07-14T13:33:05.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.607+0000 7fadf57fa640 1 -- 172.21.15.5:0/3612343277 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fade40bf410 con 0x7fadf8070330 2023-07-14T13:33:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.607+0000 7fadf57fa640 1 --2- 172.21.15.5:0/3612343277 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7faddc0663a0 0x7faddc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:05.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.607+0000 7fadf57fa640 1 -- 172.21.15.5:0/3612343277 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7fade411f0c0 con 0x7fadf8070330 2023-07-14T13:33:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.607+0000 7fadf57fa640 1 --2- 172.21.15.5:0/3612343277 >> [v2:172.21.15.154:6808/1270457700,v1:172.21.15.154:6810/1270457700] conn(0x7faddc06ce50 0x7faddc06f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.607+0000 7fadf57fa640 1 -- 172.21.15.5:0/3612343277 --> [v2:172.21.15.154:6808/1270457700,v1:172.21.15.154:6810/1270457700] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faddc06f930 con 0x7faddc06ce50 2023-07-14T13:33:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.607+0000 7fadf57fa640 1 -- 172.21.15.5:0/3612343277 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=196) v2 ==== 24+0+0 (secure 0 0 0) 0x7fade41216a0 con 0x7fadf8070330 2023-07-14T13:33:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.607+0000 7fadfcc2f640 1 --2- 172.21.15.5:0/3612343277 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7faddc0663a0 0x7faddc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.607+0000 7fadfd430640 1 --2- 172.21.15.5:0/3612343277 >> [v2:172.21.15.154:6808/1270457700,v1:172.21.15.154:6810/1270457700] conn(0x7faddc06ce50 0x7faddc06f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:05.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.611+0000 7fadfcc2f640 1 --2- 172.21.15.5:0/3612343277 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7faddc0663a0 0x7faddc068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fadec00b930 tx=0x7fadec008040 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.611+0000 7fadfd430640 1 --2- 172.21.15.5:0/3612343277 >> [v2:172.21.15.154:6808/1270457700,v1:172.21.15.154:6810/1270457700] conn(0x7faddc06ce50 0x7faddc06f260 crc :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:05.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.611+0000 7fadf57fa640 1 -- 172.21.15.5:0/3612343277 <== osd.7 v2:172.21.15.154:6808/1270457700 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7faddc06f930 con 0x7faddc06ce50 2023-07-14T13:33:05.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.623+0000 7fadfee93640 1 -- 172.21.15.5:0/3612343277 --> [v2:172.21.15.154:6808/1270457700,v1:172.21.15.154:6810/1270457700] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fadf8160480 con 0x7faddc06ce50 2023-07-14T13:33:05.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.623+0000 7fadf57fa640 1 -- 172.21.15.5:0/3612343277 <== osd.7 v2:172.21.15.154:6808/1270457700 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fadf00075d0 con 0x7faddc06ce50 2023-07-14T13:33:05.621 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-07-14T13:33:05.621 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-14T13:33:05.622 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-07-14T13:33:05.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.623+0000 7fadfee93640 1 -- 172.21.15.5:0/3612343277 >> [v2:172.21.15.154:6808/1270457700,v1:172.21.15.154:6810/1270457700] conn(0x7faddc06ce50 msgr2=0x7faddc06f260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:05.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.623+0000 7fadfee93640 1 --2- 172.21.15.5:0/3612343277 >> [v2:172.21.15.154:6808/1270457700,v1:172.21.15.154:6810/1270457700] conn(0x7faddc06ce50 0x7faddc06f260 crc :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.623+0000 7fadfee93640 1 -- 172.21.15.5:0/3612343277 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7faddc0663a0 msgr2=0x7faddc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:05.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.623+0000 7fadfee93640 1 --2- 172.21.15.5:0/3612343277 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7faddc0663a0 0x7faddc068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fadec00b930 tx=0x7fadec008040 comp rx=0 tx=0).stop 2023-07-14T13:33:05.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.623+0000 7fadfee93640 1 -- 172.21.15.5:0/3612343277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf8070330 msgr2=0x7fadf80cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:05.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.623+0000 7fadfee93640 1 --2- 172.21.15.5:0/3612343277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf8070330 0x7fadf80cea40 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7fade40ad040 tx=0x7fade4019220 comp rx=0 tx=0).stop 2023-07-14T13:33:05.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.623+0000 7fadfd430640 1 -- 172.21.15.5:0/3612343277 reap_dead start 2023-07-14T13:33:05.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.623+0000 7fadfee93640 1 -- 172.21.15.5:0/3612343277 shutdown_connections 2023-07-14T13:33:05.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.623+0000 7fadfee93640 1 -- 172.21.15.5:0/3612343277 >> 172.21.15.5:0/3612343277 conn(0x7fadf80b1840 msgr2=0x7fadf81555e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:05.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.623+0000 7fadfee93640 1 -- 172.21.15.5:0/3612343277 shutdown_connections 2023-07-14T13:33:05.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.623+0000 7fadfee93640 1 -- 172.21.15.5:0/3612343277 wait complete. 2023-07-14T13:33:05.639 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-07-14T13:33:05.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.787+0000 7f227727b640 1 Processor -- start 2023-07-14T13:33:05.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.787+0000 7f227727b640 1 -- start start 2023-07-14T13:33:05.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.787+0000 7f227727b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2270158ce0 0x7f2270070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:05.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.787+0000 7f227727b640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f22700c8ad0 0x7f22700c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:05.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.787+0000 7f227727b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22700c99c0 con 0x7f22700c9560 2023-07-14T13:33:05.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.787+0000 7f227727b640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22700cc700 con 0x7f22700c8ad0 2023-07-14T13:33:05.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.787+0000 7f227727b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22700b0ff0 con 0x7f2270158ce0 2023-07-14T13:33:05.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.787+0000 7f2274816640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f22700c8ad0 0x7f22700c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:05.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.787+0000 7f2274816640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f22700c8ad0 0x7f22700c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55432/0 (socket says 172.21.15.5:55432) 2023-07-14T13:33:05.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.787+0000 7f2274816640 1 -- 172.21.15.5:0/1802797858 learned_addr learned my addr 172.21.15.5:0/1802797858 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.791+0000 7f2274816640 1 -- 172.21.15.5:0/1802797858 >> v2:172.21.15.154:3300/0 conn(0x7f2270158ce0 msgr2=0x7f2270070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.791+0000 7f2275017640 1 --2- 172.21.15.5:0/1802797858 >> v2:172.21.15.154:3300/0 conn(0x7f2270158ce0 0x7f2270070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.791+0000 7f2274816640 1 --2- 172.21.15.5:0/1802797858 >> v2:172.21.15.154:3300/0 conn(0x7f2270158ce0 0x7f2270070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.791+0000 7f2274816640 1 -- 172.21.15.5:0/1802797858 >> v1:172.21.15.154:6789/0 conn(0x7f22700c9560 legacy=0x7f22700cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:05.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.791+0000 7f2274816640 1 -- 172.21.15.5:0/1802797858 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2270070c80 con 0x7f22700c8ad0 2023-07-14T13:33:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.791+0000 7f2275017640 1 --2- 172.21.15.5:0/1802797858 >> v2:172.21.15.154:3300/0 conn(0x7f2270158ce0 0x7f2270070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:33:05.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.791+0000 7f2274816640 1 --2- 172.21.15.5:0/1802797858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22700c8ad0 0x7f22700c9020 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7f2270071be0 tx=0x7f226001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ad44a0a4355559 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:05.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.791+0000 7f2267fff640 1 -- 172.21.15.5:0/1802797858 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22700cba20 con 0x7f22700c8ad0 2023-07-14T13:33:05.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.791+0000 7f2267fff640 1 -- 172.21.15.5:0/1802797858 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22600ac410 con 0x7f22700c8ad0 2023-07-14T13:33:05.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.791+0000 7f2267fff640 1 -- 172.21.15.5:0/1802797858 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22600ac7a0 con 0x7f22700c8ad0 2023-07-14T13:33:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.795+0000 7f227727b640 1 -- 172.21.15.5:0/1802797858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22700c8ad0 msgr2=0x7f22700c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.795+0000 7f227727b640 1 --2- 172.21.15.5:0/1802797858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22700c8ad0 0x7f22700c9020 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7f2270071be0 tx=0x7f226001c3b0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.795+0000 7f227727b640 1 -- 172.21.15.5:0/1802797858 shutdown_connections 2023-07-14T13:33:05.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.795+0000 7f227727b640 1 --2- 172.21.15.5:0/1802797858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22700c8ad0 0x7f22700c9020 unknown :-1 s=CLOSED pgs=2058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.795+0000 7f227727b640 1 --2- 172.21.15.5:0/1802797858 >> v2:172.21.15.154:3300/0 conn(0x7f2270158ce0 0x7f2270070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.795+0000 7f227727b640 1 -- 172.21.15.5:0/1802797858 >> 172.21.15.5:0/1802797858 conn(0x7f22700afcf0 msgr2=0x7f22700b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:05.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.795+0000 7f227727b640 1 -- 172.21.15.5:0/1802797858 shutdown_connections 2023-07-14T13:33:05.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.795+0000 7f227727b640 1 -- 172.21.15.5:0/1802797858 wait complete. 2023-07-14T13:33:05.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.795+0000 7f227727b640 1 Processor -- start 2023-07-14T13:33:05.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.795+0000 7f227727b640 1 -- start start 2023-07-14T13:33:05.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.795+0000 7f227727b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22700c8ad0 0x7f22701f3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:05.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.795+0000 7f227727b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22700c9560 0x7f22700b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:05.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.795+0000 7f227727b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2270158ce0 0x7f22701562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:05.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.795+0000 7f227727b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2270156820 con 0x7f22700c8ad0 2023-07-14T13:33:05.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.795+0000 7f227727b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2270156a20 con 0x7f22700c9560 2023-07-14T13:33:05.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.795+0000 7f227727b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2270156d00 con 0x7f2270158ce0 2023-07-14T13:33:05.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.795+0000 7f2275017640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22700c8ad0 0x7f22701f3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:05.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.795+0000 7f2275017640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22700c8ad0 0x7f22701f3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55442/0 (socket says 172.21.15.5:55442) 2023-07-14T13:33:05.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.795+0000 7f2275017640 1 -- 172.21.15.5:0/2318830927 learned_addr learned my addr 172.21.15.5:0/2318830927 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:05.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.795+0000 7f2274816640 1 --2- 172.21.15.5:0/2318830927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22700c9560 0x7f22700b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:05.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.795+0000 7f2275818640 1 --2- 172.21.15.5:0/2318830927 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2270158ce0 0x7f22701562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:05.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.795+0000 7f2275017640 1 -- 172.21.15.5:0/2318830927 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2270158ce0 msgr2=0x7f22701562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:05.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.795+0000 7f2275017640 1 --2- 172.21.15.5:0/2318830927 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2270158ce0 0x7f22701562e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.795+0000 7f2275017640 1 -- 172.21.15.5:0/2318830927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22700c9560 msgr2=0x7f22700b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:05.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.795+0000 7f2275017640 1 --2- 172.21.15.5:0/2318830927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22700c9560 0x7f22700b3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.795+0000 7f2275017640 1 -- 172.21.15.5:0/2318830927 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22600094d0 con 0x7f22700c8ad0 2023-07-14T13:33:05.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.795+0000 7f2275818640 1 --2- 172.21.15.5:0/2318830927 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2270158ce0 0x7f22701562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:33:05.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.799+0000 7f2275017640 1 --2- 172.21.15.5:0/2318830927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22700c8ad0 0x7f22701f3ed0 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f226c00c7f0 tx=0x7f226c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:05.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.799+0000 7f2265ffb640 1 -- 172.21.15.5:0/2318830927 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c007820 con 0x7f22700c8ad0 2023-07-14T13:33:05.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.799+0000 7f2265ffb640 1 -- 172.21.15.5:0/2318830927 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226c007980 con 0x7f22700c8ad0 2023-07-14T13:33:05.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.799+0000 7f2265ffb640 1 -- 172.21.15.5:0/2318830927 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c007d30 con 0x7f22700c8ad0 2023-07-14T13:33:05.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.799+0000 7f227727b640 1 -- 172.21.15.5:0/2318830927 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22700ab8a0 con 0x7f22700c8ad0 2023-07-14T13:33:05.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.799+0000 7f227727b640 1 -- 172.21.15.5:0/2318830927 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22700abe60 con 0x7f22700c8ad0 2023-07-14T13:33:05.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.799+0000 7f227727b640 1 -- 172.21.15.5:0/2318830927 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22700ca1a0 con 0x7f22700c8ad0 2023-07-14T13:33:05.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.799+0000 7f2265ffb640 1 -- 172.21.15.5:0/2318830927 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f226c0113f0 con 0x7f22700c8ad0 2023-07-14T13:33:05.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.799+0000 7f2265ffb640 1 --2- 172.21.15.5:0/2318830927 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f22540663a0 0x7f2254068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:05.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.803+0000 7f2265ffb640 1 -- 172.21.15.5:0/2318830927 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7f226c084320 con 0x7f22700c8ad0 2023-07-14T13:33:05.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.803+0000 7f2274816640 1 --2- 172.21.15.5:0/2318830927 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f22540663a0 0x7f2254068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:05.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.803+0000 7f2274816640 1 --2- 172.21.15.5:0/2318830927 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f22540663a0 0x7f2254068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f22600ae000 tx=0x7f2260009040 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:05.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.803+0000 7f2265ffb640 1 -- 172.21.15.5:0/2318830927 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f226c051590 con 0x7f22700c8ad0 2023-07-14T13:33:05.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.959+0000 7f227727b640 1 -- 172.21.15.5:0/2318830927 --> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f2270070990 con 0x7f22540663a0 2023-07-14T13:33:05.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.963+0000 7f2265ffb640 1 -- 172.21.15.5:0/2318830927 <== mgr.10192 v2:172.21.15.154:6832/317858933 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f22600ac9e0 con 0x7f22540663a0 2023-07-14T13:33:05.960 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 7 to deep-scrub 2023-07-14T13:33:05.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.963+0000 7f227727b640 1 -- 172.21.15.5:0/2318830927 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f22540663a0 msgr2=0x7f2254068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:05.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.963+0000 7f227727b640 1 --2- 172.21.15.5:0/2318830927 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f22540663a0 0x7f2254068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f22600ae000 tx=0x7f2260009040 comp rx=0 tx=0).stop 2023-07-14T13:33:05.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.963+0000 7f227727b640 1 -- 172.21.15.5:0/2318830927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22700c8ad0 msgr2=0x7f22701f3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:05.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.963+0000 7f227727b640 1 --2- 172.21.15.5:0/2318830927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22700c8ad0 0x7f22701f3ed0 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f226c00c7f0 tx=0x7f226c00ccb0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.963+0000 7f227727b640 1 -- 172.21.15.5:0/2318830927 shutdown_connections 2023-07-14T13:33:05.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.963+0000 7f227727b640 1 --2- 172.21.15.5:0/2318830927 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f22540663a0 0x7f2254068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.963+0000 7f227727b640 1 --2- 172.21.15.5:0/2318830927 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2270158ce0 0x7f22701562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.963+0000 7f227727b640 1 --2- 172.21.15.5:0/2318830927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22700c9560 0x7f22700b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.963+0000 7f227727b640 1 --2- 172.21.15.5:0/2318830927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22700c8ad0 0x7f22701f3ed0 unknown :-1 s=CLOSED pgs=2059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:05.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.963+0000 7f227727b640 1 -- 172.21.15.5:0/2318830927 >> 172.21.15.5:0/2318830927 conn(0x7f22700afcf0 msgr2=0x7f22700ae8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:05.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.963+0000 7f227727b640 1 -- 172.21.15.5:0/2318830927 shutdown_connections 2023-07-14T13:33:05.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:05.963+0000 7f227727b640 1 -- 172.21.15.5:0/2318830927 wait complete. 2023-07-14T13:33:05.980 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:33:06.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.127+0000 7f6bd329c640 1 Processor -- start 2023-07-14T13:33:06.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.127+0000 7f6bd329c640 1 -- start start 2023-07-14T13:33:06.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.127+0000 7f6bd329c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6bcc0c0f80 0x7f6bcc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:06.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.127+0000 7f6bd329c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bcc0c17d0 con 0x7f6bcc0c8940 2023-07-14T13:33:06.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.127+0000 7f6bd329c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bcc0c14f0 con 0x7f6bcc160330 2023-07-14T13:33:06.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.127+0000 7f6bd329c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bcc0cdd70 con 0x7f6bcc0c0f80 2023-07-14T13:33:06.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bd0837640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6bcc0c8940 0x7f6bcc0cd660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35386/0 (socket says 172.21.15.5:35386) 2023-07-14T13:33:06.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bd0837640 1 -- 172.21.15.5:0/2713344994 learned_addr learned my addr 172.21.15.5:0/2713344994 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:33:06.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bd1839640 1 --2- 172.21.15.5:0/2713344994 >> v2:172.21.15.154:3300/0 conn(0x7f6bcc0c0f80 0x7f6bcc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:06.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bc3fff640 1 -- 172.21.15.5:0/2713344994 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1986911642 0 0) 0x7f6bcc0c17d0 con 0x7f6bcc0c8940 2023-07-14T13:33:06.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bc3fff640 1 -- 172.21.15.5:0/2713344994 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bb8003530 con 0x7f6bcc0c8940 2023-07-14T13:33:06.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bc3fff640 1 -- 172.21.15.5:0/2713344994 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1200846457 0 0) 0x7f6bcc0c14f0 con 0x7f6bcc160330 2023-07-14T13:33:06.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bc3fff640 1 -- 172.21.15.5:0/2713344994 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bcc0c17d0 con 0x7f6bcc160330 2023-07-14T13:33:06.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bc3fff640 1 -- 172.21.15.5:0/2713344994 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3425549406 0 0) 0x7f6bb8003530 con 0x7f6bcc0c8940 2023-07-14T13:33:06.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bc3fff640 1 -- 172.21.15.5:0/2713344994 >> v2:172.21.15.154:3300/0 conn(0x7f6bcc0c0f80 msgr2=0x7f6bcc0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:06.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bc3fff640 1 --2- 172.21.15.5:0/2713344994 >> v2:172.21.15.154:3300/0 conn(0x7f6bcc0c0f80 0x7f6bcc0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:06.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bc3fff640 1 -- 172.21.15.5:0/2713344994 >> v1:172.21.15.154:6789/0 conn(0x7f6bcc160330 legacy=0x7f6bcc0ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:06.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bc3fff640 1 -- 172.21.15.5:0/2713344994 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bcc0cac10 con 0x7f6bcc0c8940 2023-07-14T13:33:06.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bc3fff640 1 -- 172.21.15.5:0/2713344994 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7f6bbc001680 con 0x7f6bcc0c8940 2023-07-14T13:33:06.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bc3fff640 1 -- 172.21.15.5:0/2713344994 >> v1:172.21.15.5:6789/0 conn(0x7f6bcc0c8940 legacy=0x7f6bcc0cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:06.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bc3fff640 1 --2- 172.21.15.5:0/2713344994 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bb8003b10 0x7f6bb8003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:06.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bc3fff640 1 --2- 172.21.15.5:0/2713344994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bb80047d0 0x7f6bb8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:06.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bc3fff640 1 --2- 172.21.15.5:0/2713344994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bb8005180 0x7f6bb800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:06.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bc3fff640 1 -- 172.21.15.5:0/2713344994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc0cdd70 con 0x7f6bb8005180 2023-07-14T13:33:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bc3fff640 1 -- 172.21.15.5:0/2713344994 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb800bf80 con 0x7f6bb80047d0 2023-07-14T13:33:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bc3fff640 1 -- 172.21.15.5:0/2713344994 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb800c110 con 0x7f6bb8003b10 2023-07-14T13:33:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bd1839640 1 --2- 172.21.15.5:0/2713344994 >> v2:172.21.15.154:3300/0 conn(0x7f6bcc0c0f80 0x7f6bcc0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:33:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bd1839640 1 --2- 172.21.15.5:0/2713344994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bb8005180 0x7f6bb800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bd1038640 1 --2- 172.21.15.5:0/2713344994 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bb8003b10 0x7f6bb8003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bd0837640 1 --2- 172.21.15.5:0/2713344994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bb80047d0 0x7f6bb8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:06.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bd1839640 1 -- 172.21.15.5:0/2713344994 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bb8003b10 msgr2=0x7f6bb8003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:06.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bd1839640 1 --2- 172.21.15.5:0/2713344994 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bb8003b10 0x7f6bb8003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:06.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bd1839640 1 -- 172.21.15.5:0/2713344994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bb80047d0 msgr2=0x7f6bb8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:06.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bd1839640 1 --2- 172.21.15.5:0/2713344994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bb80047d0 0x7f6bb8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:06.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bd1839640 1 -- 172.21.15.5:0/2713344994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb8003530 con 0x7f6bb8005180 2023-07-14T13:33:06.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bd1038640 1 --2- 172.21.15.5:0/2713344994 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bb8003b10 0x7f6bb8003f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:33:06.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.131+0000 7f6bd0837640 1 --2- 172.21.15.5:0/2713344994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bb80047d0 0x7f6bb8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:33:06.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.135+0000 7f6bd1839640 1 -- 172.21.15.5:0/2713344994 reap_dead start 2023-07-14T13:33:06.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.135+0000 7f6bd1839640 1 --2- 172.21.15.5:0/2713344994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bb8005180 0x7f6bb800b990 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7f6bc400e350 tx=0x7f6bc401ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7a6c5316d2687a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:06.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.135+0000 7f6bc3fff640 1 -- 172.21.15.5:0/2713344994 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc40a5e50 con 0x7f6bb8005180 2023-07-14T13:33:06.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.135+0000 7f6bc3fff640 1 -- 172.21.15.5:0/2713344994 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc400f040 con 0x7f6bb8005180 2023-07-14T13:33:06.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.135+0000 7f6bc3fff640 1 -- 172.21.15.5:0/2713344994 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4003be0 con 0x7f6bb8005180 2023-07-14T13:33:06.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.135+0000 7f6bd329c640 1 -- 172.21.15.5:0/2713344994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bb8005180 msgr2=0x7f6bb800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:06.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.135+0000 7f6bd329c640 1 --2- 172.21.15.5:0/2713344994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bb8005180 0x7f6bb800b990 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7f6bc400e350 tx=0x7f6bc401ce40 comp rx=0 tx=0).stop 2023-07-14T13:33:06.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.135+0000 7f6bd329c640 1 -- 172.21.15.5:0/2713344994 shutdown_connections 2023-07-14T13:33:06.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.135+0000 7f6bd329c640 1 --2- 172.21.15.5:0/2713344994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bb8005180 0x7f6bb800b990 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:06.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.135+0000 7f6bd329c640 1 -- 172.21.15.5:0/2713344994 >> 172.21.15.5:0/2713344994 conn(0x7f6bcc0afcf0 msgr2=0x7f6bcc0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:06.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.135+0000 7f6bd329c640 1 -- 172.21.15.5:0/2713344994 shutdown_connections 2023-07-14T13:33:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.135+0000 7f6bd329c640 1 -- 172.21.15.5:0/2713344994 wait complete. 2023-07-14T13:33:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.135+0000 7f6bd329c640 1 Processor -- start 2023-07-14T13:33:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.135+0000 7f6bd329c640 1 -- start start 2023-07-14T13:33:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.139+0000 7f6bd329c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bb8005180 0x7f6bcc0c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.139+0000 7f6bd329c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bcc0c5b80 0x7f6bcc0c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.139+0000 7f6bd329c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bcc0c6530 0x7f6bcc0c2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.139+0000 7f6bd329c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc0b3ec0 con 0x7f6bcc0c5b80 2023-07-14T13:33:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.139+0000 7f6bd329c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc0b2e20 con 0x7f6bcc0c6530 2023-07-14T13:33:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.139+0000 7f6bd329c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc0b3100 con 0x7f6bb8005180 2023-07-14T13:33:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.139+0000 7f6bd0837640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bcc0c5b80 0x7f6bcc0c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.139+0000 7f6bd0837640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bcc0c5b80 0x7f6bcc0c5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55456/0 (socket says 172.21.15.5:55456) 2023-07-14T13:33:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.139+0000 7f6bd0837640 1 -- 172.21.15.5:0/227615998 learned_addr learned my addr 172.21.15.5:0/227615998 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.139+0000 7f6bd1038640 1 --2- 172.21.15.5:0/227615998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bb8005180 0x7f6bcc0c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.139+0000 7f6bd1839640 1 --2- 172.21.15.5:0/227615998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bcc0c6530 0x7f6bcc0c2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:06.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.139+0000 7f6bd0837640 1 -- 172.21.15.5:0/227615998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bb8005180 msgr2=0x7f6bcc0c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:06.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.139+0000 7f6bd0837640 1 --2- 172.21.15.5:0/227615998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bb8005180 0x7f6bcc0c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:06.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.139+0000 7f6bd0837640 1 -- 172.21.15.5:0/227615998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bcc0c6530 msgr2=0x7f6bcc0c2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:06.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.139+0000 7f6bd0837640 1 --2- 172.21.15.5:0/227615998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bcc0c6530 0x7f6bcc0c2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:06.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.139+0000 7f6bd0837640 1 -- 172.21.15.5:0/227615998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bcc0b33e0 con 0x7f6bcc0c5b80 2023-07-14T13:33:06.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.139+0000 7f6bd0837640 1 --2- 172.21.15.5:0/227615998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bcc0c5b80 0x7f6bcc0c5ff0 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc000fe0 tx=0x7f6bbc00eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:06.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.139+0000 7f6bc1ffb640 1 -- 172.21.15.5:0/227615998 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc00c690 con 0x7f6bcc0c5b80 2023-07-14T13:33:06.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.139+0000 7f6bc1ffb640 1 -- 172.21.15.5:0/227615998 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc00c7f0 con 0x7f6bcc0c5b80 2023-07-14T13:33:06.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.139+0000 7f6bc1ffb640 1 -- 172.21.15.5:0/227615998 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc00cb60 con 0x7f6bcc0c5b80 2023-07-14T13:33:06.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.139+0000 7f6bd329c640 1 -- 172.21.15.5:0/227615998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bcc0b36c0 con 0x7f6bcc0c5b80 2023-07-14T13:33:06.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.139+0000 7f6bd329c640 1 -- 172.21.15.5:0/227615998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bcc0c69a0 con 0x7f6bcc0c5b80 2023-07-14T13:33:06.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.139+0000 7f6bd329c640 1 -- 172.21.15.5:0/227615998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bcc0b3be0 con 0x7f6bcc0c5b80 2023-07-14T13:33:06.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.139+0000 7f6bc1ffb640 1 -- 172.21.15.5:0/227615998 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6bbc00ccc0 con 0x7f6bcc0c5b80 2023-07-14T13:33:06.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.143+0000 7f6bc1ffb640 1 --2- 172.21.15.5:0/227615998 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f6bb00663a0 0x7f6bb0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:06.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.143+0000 7f6bc1ffb640 1 -- 172.21.15.5:0/227615998 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7f6bbc083c60 con 0x7f6bcc0c5b80 2023-07-14T13:33:06.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.143+0000 7f6bd1038640 1 --2- 172.21.15.5:0/227615998 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f6bb00663a0 0x7f6bb0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:06.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.143+0000 7f6bd1038640 1 --2- 172.21.15.5:0/227615998 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f6bb00663a0 0x7f6bb0068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8000f70 tx=0x7f6bc8009040 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:06.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.147+0000 7f6bc1ffb640 1 -- 172.21.15.5:0/227615998 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f6bcc0b3be0 con 0x7f6bcc0c5b80 2023-07-14T13:33:06.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.295+0000 7f6bd329c640 1 -- 172.21.15.5:0/227615998 --> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6bcc0cb1d0 con 0x7f6bb00663a0 2023-07-14T13:33:06.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.299+0000 7f6bc1ffb640 1 -- 172.21.15.5:0/227615998 <== mgr.10192 v2:172.21.15.154:6832/317858933 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72486 (secure 0 0 0) 0x7f6bc8001d10 con 0x7f6bb00663a0 2023-07-14T13:33:06.299 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:33:06.300 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:33:06.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.303+0000 7f6bd329c640 1 -- 172.21.15.5:0/227615998 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f6bb00663a0 msgr2=0x7f6bb0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:06.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.303+0000 7f6bd329c640 1 --2- 172.21.15.5:0/227615998 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f6bb00663a0 0x7f6bb0068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8000f70 tx=0x7f6bc8009040 comp rx=0 tx=0).stop 2023-07-14T13:33:06.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.303+0000 7f6bd329c640 1 -- 172.21.15.5:0/227615998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bcc0c5b80 msgr2=0x7f6bcc0c5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:06.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.303+0000 7f6bd329c640 1 --2- 172.21.15.5:0/227615998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bcc0c5b80 0x7f6bcc0c5ff0 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc000fe0 tx=0x7f6bbc00eba0 comp rx=0 tx=0).stop 2023-07-14T13:33:06.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.303+0000 7f6bd329c640 1 -- 172.21.15.5:0/227615998 shutdown_connections 2023-07-14T13:33:06.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.303+0000 7f6bd329c640 1 --2- 172.21.15.5:0/227615998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bcc0c6530 0x7f6bcc0c2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:06.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.303+0000 7f6bd329c640 1 --2- 172.21.15.5:0/227615998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bcc0c5b80 0x7f6bcc0c5ff0 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:06.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.303+0000 7f6bd329c640 1 --2- 172.21.15.5:0/227615998 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f6bb00663a0 0x7f6bb0068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:06.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.303+0000 7f6bd329c640 1 --2- 172.21.15.5:0/227615998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6bb8005180 0x7f6bcc0c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:06.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.303+0000 7f6bd329c640 1 -- 172.21.15.5:0/227615998 >> 172.21.15.5:0/227615998 conn(0x7f6bcc0afcf0 msgr2=0x7f6bcc0af560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:06.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.303+0000 7f6bd329c640 1 -- 172.21.15.5:0/227615998 shutdown_connections 2023-07-14T13:33:06.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:06.303+0000 7f6bd329c640 1 -- 172.21.15.5:0/227615998 wait complete. 2023-07-14T13:33:06.320 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2023-07-14T13:33:05.885221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":376128,"kb_used_data":20352,"kb_used_omap":0,"kb_used_meta":355712,"kb_avail":754598592,"statfs":{"total":773094113280,"available":772708958208,"internally_reserved":0,"allocated":20840448,"data_stored":11296538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":364249088},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002244"},"pg_stats":[{"pgid":"1.0","version":"193'348","reported_seq":1312,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-14T13:32:57.133552+0000","last_change":"2023-07-14T12:52:34.807219+0000","last_active":"2023-07-14T13:32:57.133552+0000","last_peered":"2023-07-14T13:32:57.133552+0000","last_clean":"2023-07-14T13:32:57.133552+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:32:57.133552+0000","last_undegraded":"2023-07-14T13:32:57.133552+0000","last_fullsized":"2023-07-14T13:32:57.133552+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:33.765666+0000","last_clean_scrub_stamp":"2023-07-14T12:52:33.765666+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:45:18.062365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":332,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-14T13:32:57.129011+0000","last_change":"2023-07-14T12:52:41.037701+0000","last_active":"2023-07-14T13:32:57.129011+0000","last_peered":"2023-07-14T13:32:57.129011+0000","last_clean":"2023-07-14T13:32:57.129011+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:32:57.129011+0000","last_undegraded":"2023-07-14T13:32:57.129011+0000","last_fullsized":"2023-07-14T13:32:57.129011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:41:14.788174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":336,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-14T13:32:57.133357+0000","last_change":"2023-07-14T12:52:41.036655+0000","last_active":"2023-07-14T13:32:57.133357+0000","last_peered":"2023-07-14T13:32:57.133357+0000","last_clean":"2023-07-14T13:32:57.133357+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:32:57.133357+0000","last_undegraded":"2023-07-14T13:32:57.133357+0000","last_fullsized":"2023-07-14T13:32:57.133357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:34:36.877959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":347,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-14T13:33:04.962990+0000","last_change":"2023-07-14T13:33:04.963029+0000","last_active":"2023-07-14T13:33:04.962990+0000","last_peered":"2023-07-14T13:33:04.962990+0000","last_clean":"2023-07-14T13:33:04.962990+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:33:04.962990+0000","last_undegraded":"2023-07-14T13:33:04.962990+0000","last_fullsized":"2023-07-14T13:33:04.962990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:33:04.962916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:33:04.962916+0000","last_clean_scrub_stamp":"2023-07-14T13:33:04.962916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:37:45.538629+0000","scrub_duration":0.0031059450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":332,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-14T13:32:57.129175+0000","last_change":"2023-07-14T12:52:41.036690+0000","last_active":"2023-07-14T13:32:57.129175+0000","last_peered":"2023-07-14T13:32:57.129175+0000","last_clean":"2023-07-14T13:32:57.129175+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:32:57.129175+0000","last_undegraded":"2023-07-14T13:32:57.129175+0000","last_fullsized":"2023-07-14T13:32:57.129175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:50:16.932741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":344,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-14T13:32:57.126433+0000","last_change":"2023-07-14T12:52:41.258556+0000","last_active":"2023-07-14T13:32:57.126433+0000","last_peered":"2023-07-14T13:32:57.126433+0000","last_clean":"2023-07-14T13:32:57.126433+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:32:57.126433+0000","last_undegraded":"2023-07-14T13:32:57.126433+0000","last_fullsized":"2023-07-14T13:32:57.126433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:24:57.957792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":334,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-14T13:32:57.131590+0000","last_change":"2023-07-14T12:52:41.259157+0000","last_active":"2023-07-14T13:32:57.131590+0000","last_peered":"2023-07-14T13:32:57.131590+0000","last_clean":"2023-07-14T13:32:57.131590+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:32:57.131590+0000","last_undegraded":"2023-07-14T13:32:57.131590+0000","last_fullsized":"2023-07-14T13:32:57.131590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:16:13.055038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":343,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-14T13:32:57.126848+0000","last_change":"2023-07-14T12:52:41.036907+0000","last_active":"2023-07-14T13:32:57.126848+0000","last_peered":"2023-07-14T13:32:57.126848+0000","last_clean":"2023-07-14T13:32:57.126848+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:32:57.126848+0000","last_undegraded":"2023-07-14T13:32:57.126848+0000","last_fullsized":"2023-07-14T13:32:57.126848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:47:35.231494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":335,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-14T13:32:57.127558+0000","last_change":"2023-07-14T12:52:41.038080+0000","last_active":"2023-07-14T13:32:57.127558+0000","last_peered":"2023-07-14T13:32:57.127558+0000","last_clean":"2023-07-14T13:32:57.127558+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:32:57.127558+0000","last_undegraded":"2023-07-14T13:32:57.127558+0000","last_fullsized":"2023-07-14T13:32:57.127558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:40.013533+0000","last_clean_scrub_stamp":"2023-07-14T12:52:40.013533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:11:03.538073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575327,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60268,"kb_used_data":2980,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94311572,"statfs":{"total":96636764160,"available":96575049728,"internally_reserved":0,"allocated":3051520,"data_stored":1855098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.747,"15min":0.73999999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0449999999999999,"5min":1.208,"15min":1.208},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73699999999999999,"15min":0.74199999999999999},"min":{"1min":0.52700000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88,"5min":1.042,"15min":1.042},"last":0.51600000000000001}]},{"osd":1,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.746,"15min":0.75800000000000001},"min":{"1min":0.51000000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.0820000000000001,"5min":1.444,"15min":1.444},"last":0.505},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.76900000000000002,"15min":0.76300000000000001},"min":{"1min":0.48199999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.98599999999999999,"5min":1.534,"15min":1.534},"last":0.55000000000000004}]},{"osd":2,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.72899999999999998,"15min":0.73799999999999999},"min":{"1min":0.52800000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.90500000000000003,"5min":1.1120000000000001,"15min":1.1379999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.77400000000000002,"15min":0.77000000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0549999999999999,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.56100000000000005}]},{"osd":3,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.878,"5min":1.498,"15min":1.498},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78800000000000003,"15min":0.78300000000000003},"min":{"1min":0.51600000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0209999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.47399999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.95399999999999996,"5min":1.0129999999999999,"15min":1.0620000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.627,"15min":0.624},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91700000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.41799999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64400000000000002,"15min":0.61799999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41499999999999998},"max":{"1min":0.88100000000000001,"5min":1.145,"15min":1.145},"last":0.379},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66100000000000003,"15min":0.65200000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0169999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.443}]},{"osd":6,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72999999999999998,"15min":0.71599999999999997},"min":{"1min":0.50800000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.046,"5min":1.0700000000000001,"15min":1.0940000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.70799999999999996,"15min":0.69199999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.41999999999999998},"max":{"1min":1.0029999999999999,"5min":1.089,"15min":1.089},"last":0.56799999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575328,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37544,"kb_used_data":2400,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334296,"statfs":{"total":96636764160,"available":96598319104,"internally_reserved":0,"allocated":2457600,"data_stored":1264730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.53500000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.98299999999999998,"5min":1.026,"15min":1.026},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.755,"15min":0.753},"min":{"1min":0.55600000000000005,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.012,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.58599999999999997}]},{"osd":1,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.59799999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.044,"5min":1.044,"15min":1.3300000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.746,"15min":0.746},"min":{"1min":0.57299999999999995,"5min":0.51900000000000002,"15min":0.47499999999999998},"max":{"1min":0.996,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.67700000000000005}]},{"osd":2,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78000000000000003,"15min":0.78900000000000003},"min":{"1min":0.58599999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0740000000000001,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":0.63},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77200000000000002,"15min":0.76400000000000001},"min":{"1min":0.61799999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96799999999999997,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.70099999999999996}]},{"osd":3,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.77600000000000002,"15min":0.78100000000000003},"min":{"1min":0.59399999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.073,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76100000000000001,"15min":0.76700000000000002},"min":{"1min":0.56100000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.999,"5min":1.0249999999999999,"15min":1.2569999999999999},"last":0.68999999999999995}]},{"osd":4,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57699999999999996,"15min":0.56799999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.36099999999999999},"max":{"1min":0.78200000000000003,"5min":1.02,"15min":1.175},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.626,"15min":0.61099999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.36799999999999999},"max":{"1min":0.755,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.66200000000000003}]},{"osd":5,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64700000000000002,"15min":0.63300000000000001},"min":{"1min":0.41899999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94499999999999995,"5min":1.0049999999999999,"15min":1.0860000000000001},"last":0.498},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68500000000000005,"15min":0.67300000000000004},"min":{"1min":0.50900000000000001,"5min":0.46400000000000002,"15min":0.41699999999999998},"max":{"1min":0.878,"5min":1.0640000000000001,"15min":1.3180000000000001},"last":0.52000000000000002}]},{"osd":7,"last update":"Fri Jul 14 13:31:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.64700000000000002,"15min":0.64300000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.42899999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":1.0269999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71599999999999997,"15min":0.70499999999999996},"min":{"1min":0.52600000000000002,"5min":0.49299999999999999,"15min":0.46200000000000002},"max":{"1min":0.92900000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.61099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575327,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55592,"kb_used_data":2400,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316248,"statfs":{"total":96636764160,"available":96579837952,"internally_reserved":0,"allocated":2457600,"data_stored":1264730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71899999999999997,"15min":0.73699999999999999},"min":{"1min":0.46700000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.91200000000000003,"5min":1.0600000000000001,"15min":1.8},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.73099999999999998,"15min":0.754},"min":{"1min":0.443,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.88200000000000001,"5min":1.0369999999999999,"15min":1.8700000000000001},"last":0.84599999999999997}]},{"osd":1,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.71999999999999997,"15min":0.74399999999999999},"min":{"1min":0.41099999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.85799999999999998,"5min":1.008,"15min":1.835},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.751,"15min":0.76100000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90800000000000003,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.96299999999999997}]},{"osd":2,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.73699999999999999,"15min":0.79800000000000004},"min":{"1min":0.48899999999999999,"5min":0.45700000000000002,"15min":0.434},"max":{"1min":0.80900000000000005,"5min":1.2130000000000001,"15min":16.774000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.73699999999999999,"15min":0.80200000000000005},"min":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.85599999999999998,"5min":1.0449999999999999,"15min":16.751999999999999},"last":0.72499999999999998}]},{"osd":3,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.73999999999999999,"15min":0.76400000000000001},"min":{"1min":0.44,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86699999999999999,"5min":1.0209999999999999,"15min":1.115},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.76900000000000002,"15min":0.82799999999999996},"min":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95699999999999996,"5min":1.1140000000000001,"15min":16.731000000000002},"last":0.94999999999999996}]},{"osd":4,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.436,"5min":0.40400000000000003,"15min":0.38},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.72199999999999998,"15min":0.71399999999999997},"min":{"1min":0.40799999999999997,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":0.874,"5min":1.248,"15min":1.248},"last":0.68600000000000005}]},{"osd":6,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.622,"15min":0.623},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.34999999999999998},"max":{"1min":0.77500000000000002,"5min":1.157,"15min":1.3100000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.65800000000000003,"15min":0.65100000000000002},"min":{"1min":0.46300000000000002,"5min":0.45400000000000001,"15min":0.42799999999999999},"max":{"1min":0.93200000000000005,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.66500000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.66300000000000003,"15min":0.65800000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.86599999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.71099999999999997,"15min":0.69699999999999995},"min":{"1min":0.52900000000000003,"5min":0.433,"15min":0.40000000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.63400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575328,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37544,"kb_used_data":2400,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334296,"statfs":{"total":96636764160,"available":96598319104,"internally_reserved":0,"allocated":2457600,"data_stored":1264730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.74299999999999999,"15min":0.75900000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.38100000000000001},"max":{"1min":0.98299999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.72899999999999998,"15min":0.752},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82299999999999995,"5min":0.94699999999999995,"15min":1.278},"last":0.74099999999999999}]},{"osd":1,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.751,"15min":0.77000000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.89500000000000002,"5min":1.0369999999999999,"15min":1.306},"last":0.874},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.74199999999999999,"15min":0.74299999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.47599999999999998},"max":{"1min":0.91800000000000004,"5min":1.024,"15min":1.177},"last":0.81100000000000005}]},{"osd":2,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.73999999999999999,"15min":0.76300000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.79100000000000004,"5min":0.92600000000000005,"15min":1.137},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.76900000000000002,"15min":0.77400000000000002},"min":{"1min":0.53400000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94899999999999995,"5min":1,"15min":1},"last":0.91600000000000004}]},{"osd":3,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74199999999999999,"15min":0.76200000000000001},"min":{"1min":0.53100000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.95899999999999996,"5min":0.96899999999999997,"15min":1.222},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.76400000000000001,"15min":0.77400000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.496},"max":{"1min":0.91900000000000004,"5min":1.018,"15min":1.1970000000000001},"last":0.85099999999999998}]},{"osd":5,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40000000000000002},"max":{"1min":0.93600000000000005,"5min":0.94099999999999995,"15min":0.97799999999999998},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.625,"15min":0.61199999999999999},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.378},"max":{"1min":0.90300000000000002,"5min":0.96099999999999997,"15min":0.96799999999999997},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.42499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.89200000000000002,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66600000000000004,"15min":0.66700000000000004},"min":{"1min":0.48499999999999999,"5min":0.47199999999999998,"15min":0.42699999999999999},"max":{"1min":0.96599999999999997,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.95699999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.44800000000000001,"5min":0.436,"15min":0.435},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.69599999999999995},"min":{"1min":0.50800000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0289999999999999,"5min":1.127,"15min":1.127},"last":0.89700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575327,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41640,"kb_used_data":2400,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330200,"statfs":{"total":96636764160,"available":96594124800,"internally_reserved":0,"allocated":2457600,"data_stored":1264730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.45300000000000001,"15min":0.46100000000000002},"min":{"1min":0.309,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68600000000000005,"5min":0.73799999999999999,"15min":0.92900000000000005},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.504,"15min":0.51800000000000002},"min":{"1min":0.372,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.752,"5min":0.77600000000000002,"15min":0.86599999999999999},"last":0.40500000000000003}]},{"osd":1,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.48599999999999999,"15min":0.48299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65700000000000003,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54600000000000004,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71799999999999997,"5min":0.82199999999999995,"15min":0.85099999999999998},"last":0.45600000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.40699999999999997,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.68999999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.434},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59899999999999998,"15min":0.61199999999999999},"min":{"1min":0.45500000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77300000000000002,"5min":0.86099999999999999,"15min":0.88100000000000001},"last":0.57499999999999996}]},{"osd":4,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71799999999999997,"15min":0.77000000000000002},"min":{"1min":0.53000000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.92700000000000005,"5min":1.0680000000000001,"15min":1.2529999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76100000000000001,"15min":0.79000000000000004},"min":{"1min":0.52000000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90900000000000003,"5min":1,"15min":1.4359999999999999},"last":0.55100000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.77000000000000002,"15min":0.81200000000000006},"min":{"1min":0.55400000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94999999999999996,"5min":1.069,"15min":1.3959999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.77800000000000002,"15min":0.80100000000000005},"min":{"1min":0.56699999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98999999999999999,"5min":1.1220000000000001,"15min":1.4970000000000001},"last":0.68500000000000005}]},{"osd":6,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.77200000000000002,"15min":0.79500000000000004},"min":{"1min":0.56899999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.91700000000000004,"5min":1.1910000000000001,"15min":1.383},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.80300000000000005,"15min":0.82799999999999996},"min":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.92600000000000005,"5min":1.1439999999999999,"15min":1.3520000000000001},"last":0.61199999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.82799999999999996,"15min":0.85399999999999998},"min":{"1min":0.61399999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.97399999999999998,"5min":1.171,"15min":1.5449999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.79700000000000004,"15min":0.82999999999999996},"min":{"1min":0.58799999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.996,"5min":1.1579999999999999,"15min":1.4650000000000001},"last":0.752}]}]},{"osd":2,"up_from":13,"seq":55834575328,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59684,"kb_used_data":2396,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312156,"statfs":{"total":96636764160,"available":96575647744,"internally_reserved":0,"allocated":2453504,"data_stored":1263711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46400000000000002,"15min":0.46500000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.746,"5min":0.75900000000000001,"15min":0.79800000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.50700000000000001,"15min":0.52600000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65500000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.40000000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.48099999999999998,"15min":0.46999999999999997},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70999999999999996,"5min":0.80600000000000005,"15min":0.84799999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.55700000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93799999999999994},"last":0.46200000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.71599999999999997,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.442},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.35999999999999999},"max":{"1min":0.70299999999999996,"5min":0.77300000000000002,"15min":0.81999999999999995},"last":0.51400000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.51300000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1619999999999999,"5min":1.222,"15min":1.222},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80600000000000005,"15min":0.81699999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0589999999999999,"5min":1.298,"15min":1.3029999999999999},"last":0.65900000000000003}]},{"osd":5,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.87,"15min":0.86599999999999999},"min":{"1min":0.59999999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.129,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.101,"5min":1.329,"15min":1.329},"last":0.67300000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.82499999999999996,"15min":0.82899999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.196,"5min":1.196,"15min":1.446},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.266},"last":0.78600000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.85799999999999998,"15min":0.84599999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.228,"5min":2.306,"15min":2.306},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.85699999999999998,"15min":0.85299999999999998},"min":{"1min":0.627,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.282,"5min":1.282,"15min":1.371},"last":0.64800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575328,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41640,"kb_used_data":2400,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330200,"statfs":{"total":96636764160,"available":96594124800,"internally_reserved":0,"allocated":2457600,"data_stored":1264730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.46300000000000002},"min":{"1min":0.33200000000000002,"5min":0.316,"15min":0.28499999999999998},"max":{"1min":0.64400000000000002,"5min":0.76600000000000001,"15min":0.81599999999999995},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51300000000000001,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.32500000000000001,"15min":0.30199999999999999},"max":{"1min":0.80200000000000005,"5min":0.80300000000000005,"15min":0.81299999999999994},"last":0.45500000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.34699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69599999999999995,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54100000000000004,"15min":0.53600000000000003},"min":{"1min":0.42899999999999999,"5min":0.373,"15min":0.32800000000000001},"max":{"1min":0.71799999999999997,"5min":0.83399999999999996,"15min":0.89200000000000002},"last":0.434}]},{"osd":3,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.52100000000000002,"5min":0.501,"15min":0.42299999999999999},"max":{"1min":0.747,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57299999999999995,"15min":0.58699999999999997},"min":{"1min":0.41199999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80800000000000005,"5min":0.86899999999999999,"15min":0.90300000000000002},"last":0.60499999999999998}]},{"osd":4,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79800000000000004,"15min":0.80900000000000005},"min":{"1min":0.56699999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1519999999999999,"5min":1.155,"15min":1.2470000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81699999999999995,"15min":0.82499999999999996},"min":{"1min":0.61599999999999999,"5min":0.56100000000000005,"15min":0.497},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.56999999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.81699999999999995,"15min":0.82199999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1850000000000001,"5min":1.224,"15min":1.224},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.82399999999999995,"15min":0.83199999999999996},"min":{"1min":0.62,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0920000000000001,"5min":1.2010000000000001,"15min":1.202},"last":0.61599999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.82199999999999995,"15min":0.82899999999999996},"min":{"1min":0.623,"5min":0.60399999999999998,"15min":0.57799999999999996},"max":{"1min":1.0529999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.83499999999999996,"15min":0.85299999999999998},"min":{"1min":0.64800000000000002,"5min":0.60599999999999998,"15min":0.56399999999999995},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.65600000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.81799999999999995},"min":{"1min":0.63500000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.129,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.747},{"interface":"front","average":{"1min":0.875,"5min":0.877,"15min":0.877},"min":{"1min":0.65600000000000003,"5min":0.60499999999999998,"15min":0.58899999999999997},"max":{"1min":1.2569999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.76400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575329,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42216,"kb_used_data":2976,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329624,"statfs":{"total":96636764160,"available":96593534976,"internally_reserved":0,"allocated":3047424,"data_stored":1854079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45900000000000002,"15min":0.47699999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.69799999999999995,"5min":0.81499999999999995,"15min":0.82799999999999996},"last":0.442},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.50700000000000001,"15min":0.52200000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.308},"max":{"1min":0.60199999999999998,"5min":0.73999999999999999,"15min":0.80700000000000005},"last":0.35399999999999998}]},{"osd":2,"last update":"Fri Jul 14 13:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51800000000000002,"15min":0.52900000000000003},"min":{"1min":0.32400000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75900000000000001,"5min":0.77200000000000002,"15min":0.82099999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.56000000000000005,"15min":0.56999999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73799999999999999,"5min":0.81200000000000006,"15min":0.91200000000000003},"last":0.52200000000000002}]},{"osd":3,"last update":"Fri Jul 14 13:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51600000000000001,"15min":0.52700000000000002},"min":{"1min":0.35499999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65400000000000003,"5min":0.76900000000000002,"15min":0.78600000000000003},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58899999999999997,"15min":0.60099999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85199999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri Jul 14 13:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.78400000000000003,"15min":0.81499999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.995,"5min":1.157,"15min":1.274},"last":0.88},{"interface":"front","average":{"1min":0.748,"5min":0.80400000000000005,"15min":0.82899999999999996},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.056,"5min":1.2190000000000001,"15min":1.4910000000000001},"last":0.80400000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.79000000000000004,"15min":0.82199999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.93400000000000005,"5min":1.161,"15min":1.294},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.81100000000000005,"15min":0.84299999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0580000000000001,"5min":1.1060000000000001,"15min":1.472},"last":0.79000000000000004}]},{"osd":6,"last update":"Fri Jul 14 13:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.80100000000000005,"15min":0.83299999999999996},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1,"5min":1.236,"15min":1.639},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.82199999999999995,"15min":0.85599999999999998},"min":{"1min":0.54600000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0980000000000001,"5min":1.202,"15min":1.544},"last":0.73899999999999999}]},{"osd":7,"last update":"Fri Jul 14 13:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.82999999999999996,"15min":0.84399999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.026,"5min":1.173,"15min":1.236},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.80800000000000005,"15min":0.84999999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0700000000000001,"5min":1.202,"15min":1.5880000000000001},"last":0.96299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:33:06.324 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-07-14T12:52:33.765666+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=12, tm_min=52, tm_sec=33, tm_wday=4, tm_yday=195, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=13, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=195, tm_isdst=0) 2023-07-14T13:33:06.325 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-07-14T12:52:40.013533+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=12, tm_min=52, tm_sec=40, tm_wday=4, tm_yday=195, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=13, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=195, tm_isdst=0) 2023-07-14T13:33:06.325 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-07-14T12:52:40.013533+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=12, tm_min=52, tm_sec=40, tm_wday=4, tm_yday=195, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=13, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=195, tm_isdst=0) 2023-07-14T13:33:06.325 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-07-14T12:52:40.013533+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=12, tm_min=52, tm_sec=40, tm_wday=4, tm_yday=195, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=13, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=195, tm_isdst=0) 2023-07-14T13:33:06.326 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-07-14T12:52:40.013533+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=12, tm_min=52, tm_sec=40, tm_wday=4, tm_yday=195, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=13, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=195, tm_isdst=0) 2023-07-14T13:33:06.326 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-07-14T12:52:40.013533+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=12, tm_min=52, tm_sec=40, tm_wday=4, tm_yday=195, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=13, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=195, tm_isdst=0) 2023-07-14T13:33:06.326 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-07-14T12:52:40.013533+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=12, tm_min=52, tm_sec=40, tm_wday=4, tm_yday=195, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=13, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=195, tm_isdst=0) 2023-07-14T13:33:06.326 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-07-14T12:52:40.013533+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=12, tm_min=52, tm_sec=40, tm_wday=4, tm_yday=195, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=14, tm_hour=13, tm_min=33, tm_sec=0, tm_wday=4, tm_yday=195, tm_isdst=0) 2023-07-14T13:33:06.326 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-07-14T13:33:21.267 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:33:21.272 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:33:26.327 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T13:33:26.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8cd4ca640 1 Processor -- start 2023-07-14T13:33:26.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8cd4ca640 1 -- start start 2023-07-14T13:33:26.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8cd4ca640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd8c815bdf0 0x7fd8c80ca970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:26.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8cd4ca640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c806c000 con 0x7fd8c815f970 2023-07-14T13:33:26.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8cd4ca640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c80cb2e0 con 0x7fd8c80c9e80 2023-07-14T13:33:26.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8cd4ca640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c80cb5c0 con 0x7fd8c815bdf0 2023-07-14T13:33:26.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8bffff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd8c815f970 0x7fd8c806b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49938/0 (socket says 172.21.15.5:49938) 2023-07-14T13:33:26.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8bffff640 1 -- 172.21.15.5:0/1896907271 learned_addr learned my addr 172.21.15.5:0/1896907271 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:33:26.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8c6ffd640 1 --2- 172.21.15.5:0/1896907271 >> v2:172.21.15.154:3300/0 conn(0x7fd8c815bdf0 0x7fd8c80ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:26.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8c67fc640 1 -- 172.21.15.5:0/1896907271 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633619141 0 0) 0x7fd8c806c000 con 0x7fd8c815f970 2023-07-14T13:33:26.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8c67fc640 1 -- 172.21.15.5:0/1896907271 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8b4003530 con 0x7fd8c815f970 2023-07-14T13:33:26.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8c67fc640 1 -- 172.21.15.5:0/1896907271 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327172773 0 0) 0x7fd8c80cb2e0 con 0x7fd8c80c9e80 2023-07-14T13:33:26.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8c67fc640 1 -- 172.21.15.5:0/1896907271 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8c806c000 con 0x7fd8c80c9e80 2023-07-14T13:33:26.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8c67fc640 1 -- 172.21.15.5:0/1896907271 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3325588014 0 0) 0x7fd8b4003530 con 0x7fd8c815f970 2023-07-14T13:33:26.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8c67fc640 1 -- 172.21.15.5:0/1896907271 >> v2:172.21.15.154:3300/0 conn(0x7fd8c815bdf0 msgr2=0x7fd8c80ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:26.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8c67fc640 1 --2- 172.21.15.5:0/1896907271 >> v2:172.21.15.154:3300/0 conn(0x7fd8c815bdf0 0x7fd8c80ca970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:26.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8c67fc640 1 -- 172.21.15.5:0/1896907271 >> v1:172.21.15.154:6789/0 conn(0x7fd8c80c9e80 legacy=0x7fd8c806b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:26.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8c67fc640 1 -- 172.21.15.5:0/1896907271 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c80cb8a0 con 0x7fd8c815f970 2023-07-14T13:33:26.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8c67fc640 1 -- 172.21.15.5:0/1896907271 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2239952263 0 0) 0x7fd8b0001680 con 0x7fd8c815f970 2023-07-14T13:33:26.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8c67fc640 1 -- 172.21.15.5:0/1896907271 >> v1:172.21.15.5:6789/0 conn(0x7fd8c815f970 legacy=0x7fd8c806b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:26.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8c67fc640 1 --2- 172.21.15.5:0/1896907271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8b4003b60 0x7fd8b4003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:26.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8c67fc640 1 --2- 172.21.15.5:0/1896907271 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8b40047d0 0x7fd8b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:26.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8c67fc640 1 --2- 172.21.15.5:0/1896907271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8b40051d0 0x7fd8b400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:26.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8c67fc640 1 -- 172.21.15.5:0/1896907271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c80cb5c0 con 0x7fd8b4003b60 2023-07-14T13:33:26.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8c67fc640 1 -- 172.21.15.5:0/1896907271 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b400c0e0 con 0x7fd8b40051d0 2023-07-14T13:33:26.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8c67fc640 1 -- 172.21.15.5:0/1896907271 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b400c2a0 con 0x7fd8b40047d0 2023-07-14T13:33:26.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8c6ffd640 1 --2- 172.21.15.5:0/1896907271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8b4003b60 0x7fd8b4003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:26.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8bffff640 1 --2- 172.21.15.5:0/1896907271 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8b40047d0 0x7fd8b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:26.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8c77fe640 1 --2- 172.21.15.5:0/1896907271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8b40051d0 0x7fd8b400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:26.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8c6ffd640 1 -- 172.21.15.5:0/1896907271 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8b40047d0 msgr2=0x7fd8b4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:26.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8c6ffd640 1 --2- 172.21.15.5:0/1896907271 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8b40047d0 0x7fd8b4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:26.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8c6ffd640 1 -- 172.21.15.5:0/1896907271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8b40051d0 msgr2=0x7fd8b400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:26.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8c6ffd640 1 --2- 172.21.15.5:0/1896907271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8b40051d0 0x7fd8b400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:26.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8c6ffd640 1 -- 172.21.15.5:0/1896907271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b4003530 con 0x7fd8b4003b60 2023-07-14T13:33:26.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.487+0000 7fd8c77fe640 1 -- 172.21.15.5:0/1896907271 reap_dead start 2023-07-14T13:33:26.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.491+0000 7fd8c6ffd640 1 --2- 172.21.15.5:0/1896907271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8b4003b60 0x7fd8b4003f50 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009ab0 tx=0x7fd8b801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2239b4186bd6fd57 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:26.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.491+0000 7fd8c67fc640 1 -- 172.21.15.5:0/1896907271 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80a5530 con 0x7fd8b4003b60 2023-07-14T13:33:26.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.491+0000 7fd8c67fc640 1 -- 172.21.15.5:0/1896907271 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b80a5690 con 0x7fd8b4003b60 2023-07-14T13:33:26.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.491+0000 7fd8c67fc640 1 -- 172.21.15.5:0/1896907271 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80a5a40 con 0x7fd8b4003b60 2023-07-14T13:33:26.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.491+0000 7fd8cd4ca640 1 -- 172.21.15.5:0/1896907271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8b4003b60 msgr2=0x7fd8b4003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:26.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.491+0000 7fd8cd4ca640 1 --2- 172.21.15.5:0/1896907271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8b4003b60 0x7fd8b4003f50 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009ab0 tx=0x7fd8b801ca00 comp rx=0 tx=0).stop 2023-07-14T13:33:26.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.491+0000 7fd8cd4ca640 1 -- 172.21.15.5:0/1896907271 shutdown_connections 2023-07-14T13:33:26.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.491+0000 7fd8cd4ca640 1 --2- 172.21.15.5:0/1896907271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8b4003b60 0x7fd8b4003f50 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:26.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.491+0000 7fd8cd4ca640 1 -- 172.21.15.5:0/1896907271 >> 172.21.15.5:0/1896907271 conn(0x7fd8c80afcf0 msgr2=0x7fd8c80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:26.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.491+0000 7fd8cd4ca640 1 -- 172.21.15.5:0/1896907271 shutdown_connections 2023-07-14T13:33:26.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.491+0000 7fd8cd4ca640 1 -- 172.21.15.5:0/1896907271 wait complete. 2023-07-14T13:33:26.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.495+0000 7fd8cd4ca640 1 Processor -- start 2023-07-14T13:33:26.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.495+0000 7fd8cd4ca640 1 -- start start 2023-07-14T13:33:26.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.495+0000 7fd8cd4ca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8b4003b60 0x7fd8c8155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.495+0000 7fd8cd4ca640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8c80c4390 0x7fd8c815e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.495+0000 7fd8cd4ca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8c80c4800 0x7fd8c815e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.495+0000 7fd8cd4ca640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c80c1c70 con 0x7fd8b4003b60 2023-07-14T13:33:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.495+0000 7fd8cd4ca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c80c1ec0 con 0x7fd8c80c4800 2023-07-14T13:33:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.495+0000 7fd8cd4ca640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c80c21a0 con 0x7fd8c80c4390 2023-07-14T13:33:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.495+0000 7fd8c6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8b4003b60 0x7fd8c8155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.495+0000 7fd8c6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8b4003b60 0x7fd8c8155330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58740/0 (socket says 172.21.15.5:58740) 2023-07-14T13:33:26.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.495+0000 7fd8c6ffd640 1 -- 172.21.15.5:0/2886167300 learned_addr learned my addr 172.21.15.5:0/2886167300 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:26.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.495+0000 7fd8bffff640 1 --2- 172.21.15.5:0/2886167300 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8c80c4390 0x7fd8c815e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:26.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.495+0000 7fd8c77fe640 1 --2- 172.21.15.5:0/2886167300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8c80c4800 0x7fd8c815e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:26.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.495+0000 7fd8c6ffd640 1 -- 172.21.15.5:0/2886167300 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8c80c4390 msgr2=0x7fd8c815e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:26.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.495+0000 7fd8c6ffd640 1 --2- 172.21.15.5:0/2886167300 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8c80c4390 0x7fd8c815e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:26.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.495+0000 7fd8c6ffd640 1 -- 172.21.15.5:0/2886167300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8c80c4800 msgr2=0x7fd8c815e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:26.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.495+0000 7fd8c6ffd640 1 --2- 172.21.15.5:0/2886167300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8c80c4800 0x7fd8c815e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:26.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.495+0000 7fd8c6ffd640 1 -- 172.21.15.5:0/2886167300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c80c2480 con 0x7fd8b4003b60 2023-07-14T13:33:26.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.495+0000 7fd8c77fe640 1 --2- 172.21.15.5:0/2886167300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8c80c4800 0x7fd8c815e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:33:26.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.495+0000 7fd8c6ffd640 1 --2- 172.21.15.5:0/2886167300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8b4003b60 0x7fd8c8155330 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009ab0 tx=0x7fd8b4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.495+0000 7fd8bf7fe640 1 -- 172.21.15.5:0/2886167300 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80be070 con 0x7fd8b4003b60 2023-07-14T13:33:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.495+0000 7fd8bf7fe640 1 -- 172.21.15.5:0/2886167300 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b80a5e80 con 0x7fd8b4003b60 2023-07-14T13:33:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.495+0000 7fd8bf7fe640 1 -- 172.21.15.5:0/2886167300 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8004020 con 0x7fd8b4003b60 2023-07-14T13:33:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.495+0000 7fd8cd4ca640 1 -- 172.21.15.5:0/2886167300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c80c2760 con 0x7fd8b4003b60 2023-07-14T13:33:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.495+0000 7fd8cd4ca640 1 -- 172.21.15.5:0/2886167300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c8155c40 con 0x7fd8b4003b60 2023-07-14T13:33:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.499+0000 7fd8cd4ca640 1 -- 172.21.15.5:0/2886167300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c80678d0 con 0x7fd8b4003b60 2023-07-14T13:33:26.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.499+0000 7fd8bf7fe640 1 -- 172.21.15.5:0/2886167300 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd8b80b4040 con 0x7fd8b4003b60 2023-07-14T13:33:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.499+0000 7fd8bf7fe640 1 --2- 172.21.15.5:0/2886167300 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fd8a80663a0 0x7fd8a8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.499+0000 7fd8bf7fe640 1 -- 172.21.15.5:0/2886167300 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7fd8b811d650 con 0x7fd8b4003b60 2023-07-14T13:33:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.499+0000 7fd8bffff640 1 --2- 172.21.15.5:0/2886167300 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fd8a80663a0 0x7fd8a8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:26.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.499+0000 7fd8bffff640 1 --2- 172.21.15.5:0/2886167300 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fd8a80663a0 0x7fd8a8068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0001b50 tx=0x7fd8b0001ae0 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:26.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.503+0000 7fd8bf7fe640 1 -- 172.21.15.5:0/2886167300 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7fd8b80eab00 con 0x7fd8b4003b60 2023-07-14T13:33:26.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.655+0000 7fd8cd4ca640 1 -- 172.21.15.5:0/2886167300 --> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8c80c2310 con 0x7fd8a80663a0 2023-07-14T13:33:26.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.659+0000 7fd8bf7fe640 1 -- 172.21.15.5:0/2886167300 <== mgr.10192 v2:172.21.15.154:6832/317858933 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72627 (secure 0 0 0) 0x7fd8c80c2310 con 0x7fd8a80663a0 2023-07-14T13:33:26.656 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:33:26.657 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-07-14T13:33:26.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.659+0000 7fd8cd4ca640 1 -- 172.21.15.5:0/2886167300 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fd8a80663a0 msgr2=0x7fd8a8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:26.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.659+0000 7fd8cd4ca640 1 --2- 172.21.15.5:0/2886167300 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fd8a80663a0 0x7fd8a8068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0001b50 tx=0x7fd8b0001ae0 comp rx=0 tx=0).stop 2023-07-14T13:33:26.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.659+0000 7fd8cd4ca640 1 -- 172.21.15.5:0/2886167300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8b4003b60 msgr2=0x7fd8c8155330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:26.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.659+0000 7fd8cd4ca640 1 --2- 172.21.15.5:0/2886167300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8b4003b60 0x7fd8c8155330 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009ab0 tx=0x7fd8b4005800 comp rx=0 tx=0).stop 2023-07-14T13:33:26.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.659+0000 7fd8cd4ca640 1 -- 172.21.15.5:0/2886167300 shutdown_connections 2023-07-14T13:33:26.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.659+0000 7fd8cd4ca640 1 --2- 172.21.15.5:0/2886167300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8c80c4800 0x7fd8c815e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:26.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.659+0000 7fd8cd4ca640 1 --2- 172.21.15.5:0/2886167300 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7fd8a80663a0 0x7fd8a8068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:26.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.659+0000 7fd8cd4ca640 1 --2- 172.21.15.5:0/2886167300 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd8c80c4390 0x7fd8c815e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:26.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.659+0000 7fd8cd4ca640 1 --2- 172.21.15.5:0/2886167300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8b4003b60 0x7fd8c8155330 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:26.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.659+0000 7fd8cd4ca640 1 -- 172.21.15.5:0/2886167300 >> 172.21.15.5:0/2886167300 conn(0x7fd8c80afcf0 msgr2=0x7fd8c815b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:26.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.659+0000 7fd8cd4ca640 1 -- 172.21.15.5:0/2886167300 shutdown_connections 2023-07-14T13:33:26.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.659+0000 7fd8cd4ca640 1 -- 172.21.15.5:0/2886167300 wait complete. 2023-07-14T13:33:26.676 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-07-14T13:33:25.890063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":349,"ondisk_log_size":349,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":376128,"kb_used_data":20352,"kb_used_omap":0,"kb_used_meta":355712,"kb_avail":754598592,"statfs":{"total":773094113280,"available":772708958208,"internally_reserved":0,"allocated":20840448,"data_stored":11296538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":364249088},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002919"},"pg_stats":[{"pgid":"1.0","version":"196'349","reported_seq":1322,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-14T13:33:08.495359+0000","last_change":"2023-07-14T13:33:08.495419+0000","last_active":"2023-07-14T13:33:08.495359+0000","last_peered":"2023-07-14T13:33:08.495359+0000","last_clean":"2023-07-14T13:33:08.495359+0000","last_became_active":"2023-07-14T12:52:34.806146+0000","last_became_peered":"2023-07-14T12:52:34.806146+0000","last_unstale":"2023-07-14T13:33:08.495359+0000","last_undegraded":"2023-07-14T13:33:08.495359+0000","last_fullsized":"2023-07-14T13:33:08.495359+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"196'349","last_scrub_stamp":"2023-07-14T13:33:08.495271+0000","last_deep_scrub":"196'349","last_deep_scrub_stamp":"2023-07-14T13:33:08.495271+0000","last_clean_scrub_stamp":"2023-07-14T13:33:08.495271+0000","objects_scrubbed":2,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:47:25.158046+0000","scrub_duration":0.0068471349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":341,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-14T13:33:06.251527+0000","last_change":"2023-07-14T13:33:06.251574+0000","last_active":"2023-07-14T13:33:06.251527+0000","last_peered":"2023-07-14T13:33:06.251527+0000","last_clean":"2023-07-14T13:33:06.251527+0000","last_became_active":"2023-07-14T12:52:41.037271+0000","last_became_peered":"2023-07-14T12:52:41.037271+0000","last_unstale":"2023-07-14T13:33:06.251527+0000","last_undegraded":"2023-07-14T13:33:06.251527+0000","last_fullsized":"2023-07-14T13:33:06.251527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:33:06.251417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:33:06.251417+0000","last_clean_scrub_stamp":"2023-07-14T13:33:06.251417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:06:17.970706+0000","scrub_duration":0.0036190440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":346,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-14T13:33:11.551259+0000","last_change":"2023-07-14T13:33:11.551307+0000","last_active":"2023-07-14T13:33:11.551259+0000","last_peered":"2023-07-14T13:33:11.551259+0000","last_clean":"2023-07-14T13:33:11.551259+0000","last_became_active":"2023-07-14T12:52:41.036275+0000","last_became_peered":"2023-07-14T12:52:41.036275+0000","last_unstale":"2023-07-14T13:33:11.551259+0000","last_undegraded":"2023-07-14T13:33:11.551259+0000","last_fullsized":"2023-07-14T13:33:11.551259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:33:11.551145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:33:11.551145+0000","last_clean_scrub_stamp":"2023-07-14T13:33:11.551145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:20:43.669403+0000","scrub_duration":0.0034853689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":347,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-14T13:33:04.962990+0000","last_change":"2023-07-14T13:33:04.963029+0000","last_active":"2023-07-14T13:33:04.962990+0000","last_peered":"2023-07-14T13:33:04.962990+0000","last_clean":"2023-07-14T13:33:04.962990+0000","last_became_active":"2023-07-14T12:52:41.040395+0000","last_became_peered":"2023-07-14T12:52:41.040395+0000","last_unstale":"2023-07-14T13:33:04.962990+0000","last_undegraded":"2023-07-14T13:33:04.962990+0000","last_fullsized":"2023-07-14T13:33:04.962990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:33:04.962916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:33:04.962916+0000","last_clean_scrub_stamp":"2023-07-14T13:33:04.962916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:37:45.538629+0000","scrub_duration":0.0031059450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":341,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-14T13:33:11.185801+0000","last_change":"2023-07-14T13:33:11.185862+0000","last_active":"2023-07-14T13:33:11.185801+0000","last_peered":"2023-07-14T13:33:11.185801+0000","last_clean":"2023-07-14T13:33:11.185801+0000","last_became_active":"2023-07-14T12:52:41.036288+0000","last_became_peered":"2023-07-14T12:52:41.036288+0000","last_unstale":"2023-07-14T13:33:11.185801+0000","last_undegraded":"2023-07-14T13:33:11.185801+0000","last_fullsized":"2023-07-14T13:33:11.185801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:33:11.185677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:33:11.185677+0000","last_clean_scrub_stamp":"2023-07-14T13:33:11.185677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:05:07.914455+0000","scrub_duration":0.004364087,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":353,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-14T13:33:03.175038+0000","last_change":"2023-07-14T13:33:03.175074+0000","last_active":"2023-07-14T13:33:03.175038+0000","last_peered":"2023-07-14T13:33:03.175038+0000","last_clean":"2023-07-14T13:33:03.175038+0000","last_became_active":"2023-07-14T12:52:41.258014+0000","last_became_peered":"2023-07-14T12:52:41.258014+0000","last_unstale":"2023-07-14T13:33:03.175038+0000","last_undegraded":"2023-07-14T13:33:03.175038+0000","last_fullsized":"2023-07-14T13:33:03.175038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:33:03.174961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:33:03.174961+0000","last_clean_scrub_stamp":"2023-07-14T13:33:03.174961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:04:59.903740+0000","scrub_duration":0.0028580400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":343,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-14T13:33:18.499614+0000","last_change":"2023-07-14T13:33:18.499661+0000","last_active":"2023-07-14T13:33:18.499614+0000","last_peered":"2023-07-14T13:33:18.499614+0000","last_clean":"2023-07-14T13:33:18.499614+0000","last_became_active":"2023-07-14T12:52:41.258862+0000","last_became_peered":"2023-07-14T12:52:41.258862+0000","last_unstale":"2023-07-14T13:33:18.499614+0000","last_undegraded":"2023-07-14T13:33:18.499614+0000","last_fullsized":"2023-07-14T13:33:18.499614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:33:18.499502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:33:18.499502+0000","last_clean_scrub_stamp":"2023-07-14T13:33:18.499502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:18:27.069672+0000","scrub_duration":0.0049283210000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":352,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-14T13:33:05.113004+0000","last_change":"2023-07-14T13:33:05.113047+0000","last_active":"2023-07-14T13:33:05.113004+0000","last_peered":"2023-07-14T13:33:05.113004+0000","last_clean":"2023-07-14T13:33:05.113004+0000","last_became_active":"2023-07-14T12:52:41.036600+0000","last_became_peered":"2023-07-14T12:52:41.036600+0000","last_unstale":"2023-07-14T13:33:05.113004+0000","last_undegraded":"2023-07-14T13:33:05.113004+0000","last_fullsized":"2023-07-14T13:33:05.113004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:33:05.112928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:33:05.112928+0000","last_clean_scrub_stamp":"2023-07-14T13:33:05.112928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:44:20.041967+0000","scrub_duration":0.003501367,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":344,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-14T13:33:07.398385+0000","last_change":"2023-07-14T13:33:07.398435+0000","last_active":"2023-07-14T13:33:07.398385+0000","last_peered":"2023-07-14T13:33:07.398385+0000","last_clean":"2023-07-14T13:33:07.398385+0000","last_became_active":"2023-07-14T12:52:41.037752+0000","last_became_peered":"2023-07-14T12:52:41.037752+0000","last_unstale":"2023-07-14T13:33:07.398385+0000","last_undegraded":"2023-07-14T13:33:07.398385+0000","last_fullsized":"2023-07-14T13:33:07.398385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T13:33:07.398284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T13:33:07.398284+0000","last_clean_scrub_stamp":"2023-07-14T13:33:07.398284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:26:03.362516+0000","scrub_duration":0.0034989169999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":349,"ondisk_log_size":349,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575332,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60268,"kb_used_data":2980,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94311572,"statfs":{"total":96636764160,"available":96575049728,"internally_reserved":0,"allocated":3051520,"data_stored":1855098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.747,"15min":0.73999999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0449999999999999,"5min":1.208,"15min":1.208},"last":0.749},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73699999999999999,"15min":0.74199999999999999},"min":{"1min":0.52700000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88,"5min":1.042,"15min":1.042},"last":0.60399999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.746,"15min":0.75800000000000001},"min":{"1min":0.51000000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.0820000000000001,"5min":1.444,"15min":1.444},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.76900000000000002,"15min":0.76300000000000001},"min":{"1min":0.48199999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.98599999999999999,"5min":1.534,"15min":1.534},"last":0.68100000000000005}]},{"osd":2,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.72899999999999998,"15min":0.73799999999999999},"min":{"1min":0.52800000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.90500000000000003,"5min":1.1120000000000001,"15min":1.1379999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.77400000000000002,"15min":0.77000000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0549999999999999,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.70799999999999996}]},{"osd":3,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.747,"15min":0.75700000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.878,"5min":1.498,"15min":1.498},"last":0.623},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78800000000000003,"15min":0.78300000000000003},"min":{"1min":0.51600000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0209999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.55500000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.47399999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.95399999999999996,"5min":1.0129999999999999,"15min":1.0620000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.627,"15min":0.624},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91700000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.57399999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64400000000000002,"15min":0.61799999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41499999999999998},"max":{"1min":0.88100000000000001,"5min":1.145,"15min":1.145},"last":0.505},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66100000000000003,"15min":0.65200000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0169999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.64000000000000001}]},{"osd":6,"last update":"Fri Jul 14 13:32:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72999999999999998,"15min":0.71599999999999997},"min":{"1min":0.50800000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.046,"5min":1.0700000000000001,"15min":1.0940000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.70799999999999996,"15min":0.69199999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.41999999999999998},"max":{"1min":1.0029999999999999,"5min":1.089,"15min":1.089},"last":0.65600000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575333,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37544,"kb_used_data":2400,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334296,"statfs":{"total":96636764160,"available":96598319104,"internally_reserved":0,"allocated":2457600,"data_stored":1264730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71199999999999997,"15min":0.73199999999999998},"min":{"1min":0.46899999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.999,"5min":0.999,"15min":1.026},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.73399999999999999,"15min":0.751},"min":{"1min":0.39300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.95199999999999996,"5min":1.0600000000000001,"15min":1.4259999999999999},"last":0.748}]},{"osd":1,"last update":"Fri Jul 14 13:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.746,"15min":0.75700000000000001},"min":{"1min":0.41499999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.94399999999999995,"5min":1.044,"15min":1.3300000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73599999999999999,"15min":0.74299999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47499999999999998},"max":{"1min":1.0429999999999999,"5min":1.048,"15min":1.0960000000000001},"last":0.83599999999999997}]},{"osd":2,"last update":"Fri Jul 14 13:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.77000000000000002,"15min":0.78300000000000003},"min":{"1min":0.45100000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98599999999999999,"5min":2.9049999999999998,"15min":2.9049999999999998},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75,"15min":0.76200000000000001},"min":{"1min":0.504,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.006,"5min":1.101,"15min":1.5029999999999999},"last":0.72899999999999998}]},{"osd":3,"last update":"Fri Jul 14 13:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.755,"15min":0.77700000000000002},"min":{"1min":0.44,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0700000000000001,"5min":1.2749999999999999,"15min":1.4510000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.76500000000000001},"min":{"1min":0.502,"5min":0.5,"15min":0.5},"max":{"1min":1.038,"5min":1.038,"15min":1.2569999999999999},"last":0.89800000000000002}]},{"osd":4,"last update":"Fri Jul 14 13:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.56699999999999995},"min":{"1min":0.41199999999999998,"5min":0.373,"15min":0.36099999999999999},"max":{"1min":0.89600000000000002,"5min":1.02,"15min":1.175},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.624,"15min":0.61299999999999999},"min":{"1min":0.47399999999999998,"5min":0.39300000000000002,"15min":0.36799999999999999},"max":{"1min":0.91700000000000004,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Jul 14 13:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64900000000000002,"15min":0.63300000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.84499999999999997,"5min":1.0049999999999999,"15min":1.0860000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68500000000000005,"15min":0.67500000000000004},"min":{"1min":0.46700000000000003,"5min":0.46400000000000002,"15min":0.41699999999999998},"max":{"1min":0.86199999999999999,"5min":1.0640000000000001,"15min":1.3180000000000001},"last":0.60299999999999998}]},{"osd":7,"last update":"Fri Jul 14 13:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63500000000000001,"15min":0.64300000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84399999999999997,"5min":0.91700000000000004,"15min":1.0269999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71199999999999997,"15min":0.70399999999999996},"min":{"1min":0.502,"5min":0.49299999999999999,"15min":0.46200000000000002},"max":{"1min":1.0529999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.76900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575332,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55592,"kb_used_data":2400,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316248,"statfs":{"total":96636764160,"available":96579837952,"internally_reserved":0,"allocated":2457600,"data_stored":1264730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71899999999999997,"15min":0.73699999999999999},"min":{"1min":0.46700000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.91200000000000003,"5min":1.0600000000000001,"15min":1.8},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.73099999999999998,"15min":0.754},"min":{"1min":0.443,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.88200000000000001,"5min":1.0369999999999999,"15min":1.8700000000000001},"last":0.68600000000000005}]},{"osd":1,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.71999999999999997,"15min":0.74399999999999999},"min":{"1min":0.41099999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.85799999999999998,"5min":1.008,"15min":1.835},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.751,"15min":0.76100000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90800000000000003,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.64900000000000002}]},{"osd":2,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.73699999999999999,"15min":0.79800000000000004},"min":{"1min":0.48899999999999999,"5min":0.45700000000000002,"15min":0.434},"max":{"1min":0.80900000000000005,"5min":1.2130000000000001,"15min":16.774000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.73699999999999999,"15min":0.80200000000000005},"min":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.85599999999999998,"5min":1.0449999999999999,"15min":16.751999999999999},"last":0.69899999999999995}]},{"osd":3,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.73999999999999999,"15min":0.76400000000000001},"min":{"1min":0.44,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86699999999999999,"5min":1.0209999999999999,"15min":1.115},"last":0.751},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.76900000000000002,"15min":0.82799999999999996},"min":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95699999999999996,"5min":1.1140000000000001,"15min":16.731000000000002},"last":0.629}]},{"osd":4,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.436,"5min":0.40400000000000003,"15min":0.38},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.72199999999999998,"15min":0.71399999999999997},"min":{"1min":0.40799999999999997,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":0.874,"5min":1.248,"15min":1.248},"last":0.57399999999999995}]},{"osd":6,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.622,"15min":0.623},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.34999999999999998},"max":{"1min":0.77500000000000002,"5min":1.157,"15min":1.3100000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.65800000000000003,"15min":0.65100000000000002},"min":{"1min":0.46300000000000002,"5min":0.45400000000000001,"15min":0.42799999999999999},"max":{"1min":0.93200000000000005,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.60399999999999998}]},{"osd":7,"last update":"Fri Jul 14 13:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.66300000000000003,"15min":0.65800000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.86599999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.71099999999999997,"15min":0.69699999999999995},"min":{"1min":0.52900000000000003,"5min":0.433,"15min":0.40000000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.51500000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575332,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37544,"kb_used_data":2400,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334296,"statfs":{"total":96636764160,"available":96598319104,"internally_reserved":0,"allocated":2457600,"data_stored":1264730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.74299999999999999,"15min":0.75900000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.38100000000000001},"max":{"1min":0.98299999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.72899999999999998,"15min":0.752},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.82299999999999995,"5min":0.94699999999999995,"15min":1.278},"last":0.98499999999999999}]},{"osd":1,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.751,"15min":0.77000000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.89500000000000002,"5min":1.0369999999999999,"15min":1.306},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.74199999999999999,"15min":0.74299999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.47599999999999998},"max":{"1min":0.91800000000000004,"5min":1.024,"15min":1.177},"last":0.91700000000000004}]},{"osd":2,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.73999999999999999,"15min":0.76300000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.79100000000000004,"5min":0.92600000000000005,"15min":1.137},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.76900000000000002,"15min":0.77400000000000002},"min":{"1min":0.53400000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94899999999999995,"5min":1,"15min":1},"last":0.86699999999999999}]},{"osd":3,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.74199999999999999,"15min":0.76200000000000001},"min":{"1min":0.53100000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.95899999999999996,"5min":0.96899999999999997,"15min":1.222},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.76400000000000001,"15min":0.77400000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.496},"max":{"1min":0.91900000000000004,"5min":1.018,"15min":1.1970000000000001},"last":0.81799999999999995}]},{"osd":5,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40000000000000002},"max":{"1min":0.93600000000000005,"5min":0.94099999999999995,"15min":0.97799999999999998},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.625,"15min":0.61199999999999999},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.378},"max":{"1min":0.90300000000000002,"5min":0.96099999999999997,"15min":0.96799999999999997},"last":0.73899999999999999}]},{"osd":6,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.42499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.89200000000000002,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66600000000000004,"15min":0.66700000000000004},"min":{"1min":0.48499999999999999,"5min":0.47199999999999998,"15min":0.42699999999999999},"max":{"1min":0.96599999999999997,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.79300000000000004}]},{"osd":7,"last update":"Fri Jul 14 13:32:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.44800000000000001,"5min":0.436,"15min":0.435},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.69599999999999995},"min":{"1min":0.50800000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0289999999999999,"5min":1.127,"15min":1.127},"last":0.90400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575332,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41640,"kb_used_data":2400,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330200,"statfs":{"total":96636764160,"available":96594124800,"internally_reserved":0,"allocated":2457600,"data_stored":1264730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.45300000000000001,"15min":0.46100000000000002},"min":{"1min":0.309,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68600000000000005,"5min":0.73799999999999999,"15min":0.92900000000000005},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.504,"15min":0.51800000000000002},"min":{"1min":0.372,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.752,"5min":0.77600000000000002,"15min":0.86599999999999999},"last":0.41499999999999998}]},{"osd":1,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.48599999999999999,"15min":0.48299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65700000000000003,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54600000000000004,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.71799999999999997,"5min":0.82199999999999995,"15min":0.85099999999999998},"last":0.44400000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.40699999999999997,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.68999999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59899999999999998,"15min":0.61199999999999999},"min":{"1min":0.45500000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77300000000000002,"5min":0.86099999999999999,"15min":0.88100000000000001},"last":0.50700000000000001}]},{"osd":4,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71799999999999997,"15min":0.77000000000000002},"min":{"1min":0.53000000000000003,"5min":0.437,"15min":0.437},"max":{"1min":0.92700000000000005,"5min":1.0680000000000001,"15min":1.2529999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76100000000000001,"15min":0.79000000000000004},"min":{"1min":0.52000000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90900000000000003,"5min":1,"15min":1.4359999999999999},"last":0.61299999999999999}]},{"osd":5,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.77000000000000002,"15min":0.81200000000000006},"min":{"1min":0.55400000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94999999999999996,"5min":1.069,"15min":1.3959999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.77800000000000002,"15min":0.80100000000000005},"min":{"1min":0.56699999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98999999999999999,"5min":1.1220000000000001,"15min":1.4970000000000001},"last":0.64600000000000002}]},{"osd":6,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.77200000000000002,"15min":0.79500000000000004},"min":{"1min":0.56899999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.91700000000000004,"5min":1.1910000000000001,"15min":1.383},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.80300000000000005,"15min":0.82799999999999996},"min":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.92600000000000005,"5min":1.1439999999999999,"15min":1.3520000000000001},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Jul 14 13:32:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.82799999999999996,"15min":0.85399999999999998},"min":{"1min":0.61399999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.97399999999999998,"5min":1.171,"15min":1.5449999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.79700000000000004,"15min":0.82999999999999996},"min":{"1min":0.58799999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.996,"5min":1.1579999999999999,"15min":1.4650000000000001},"last":0.71799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575332,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59684,"kb_used_data":2396,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312156,"statfs":{"total":96636764160,"available":96575647744,"internally_reserved":0,"allocated":2453504,"data_stored":1263711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46400000000000002,"15min":0.46500000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.746,"5min":0.75900000000000001,"15min":0.79800000000000004},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.50700000000000001,"15min":0.52600000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65500000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.45700000000000002}]},{"osd":1,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.48099999999999998,"15min":0.46999999999999997},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70999999999999996,"5min":0.80600000000000005,"15min":0.84799999999999998},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.55700000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93799999999999994},"last":0.623}]},{"osd":3,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.71599999999999997,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.35999999999999999},"max":{"1min":0.70299999999999996,"5min":0.77300000000000002,"15min":0.81999999999999995},"last":0.56899999999999995}]},{"osd":4,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.51300000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1619999999999999,"5min":1.222,"15min":1.222},"last":0.878},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80600000000000005,"15min":0.81699999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0589999999999999,"5min":1.298,"15min":1.3029999999999999},"last":0.86199999999999999}]},{"osd":5,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.87,"15min":0.86599999999999999},"min":{"1min":0.59999999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.129,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.101,"5min":1.329,"15min":1.329},"last":0.89700000000000002}]},{"osd":6,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.82499999999999996,"15min":0.82899999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.196,"5min":1.196,"15min":1.446},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.266},"last":0.70099999999999996}]},{"osd":7,"last update":"Fri Jul 14 13:32:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.85799999999999998,"15min":0.84599999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.228,"5min":2.306,"15min":2.306},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.85699999999999998,"15min":0.85299999999999998},"min":{"1min":0.627,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.282,"5min":1.282,"15min":1.371},"last":0.93600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575333,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41640,"kb_used_data":2400,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94330200,"statfs":{"total":96636764160,"available":96594124800,"internally_reserved":0,"allocated":2457600,"data_stored":1264730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 13:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.46800000000000003,"15min":0.46000000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61599999999999999,"5min":0.76600000000000001,"15min":0.81599999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.34999999999999998,"5min":0.32500000000000001,"15min":0.30199999999999999},"max":{"1min":0.65000000000000002,"5min":0.80200000000000005,"15min":0.81299999999999994},"last":0.51100000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63200000000000001,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.74199999999999999,"5min":0.83399999999999996,"15min":0.89200000000000002},"last":0.53100000000000003}]},{"osd":3,"last update":"Fri Jul 14 13:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.64100000000000001,"15min":0.65400000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.42299999999999999},"max":{"1min":0.80100000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.622},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56499999999999995,"15min":0.58299999999999996},"min":{"1min":0.36899999999999999,"5min":0.36399999999999999,"15min":0.34300000000000003},"max":{"1min":0.72899999999999998,"5min":0.86899999999999999,"15min":0.90300000000000002},"last":0.55700000000000005}]},{"osd":4,"last update":"Fri Jul 14 13:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.79800000000000004,"15min":0.80300000000000005},"min":{"1min":0.54200000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.97499999999999998,"5min":1.1519999999999999,"15min":1.2470000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.80300000000000005,"15min":0.81899999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.497},"max":{"1min":0.88900000000000001,"5min":1.202,"15min":1.202},"last":0.90300000000000002}]},{"osd":5,"last update":"Fri Jul 14 13:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.79700000000000004,"15min":0.81499999999999995},"min":{"1min":0.56100000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.93400000000000005,"5min":1.1850000000000001,"15min":1.224},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.82199999999999995,"15min":0.82499999999999996},"min":{"1min":0.60199999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.94499999999999995,"5min":1.2010000000000001,"15min":1.202},"last":0.874}]},{"osd":6,"last update":"Fri Jul 14 13:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.81699999999999995,"15min":0.82499999999999996},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.071,"5min":1.1339999999999999,"15min":1.1759999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.82199999999999995,"15min":0.84499999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.94499999999999995,"5min":1.22,"15min":1.22},"last":0.77400000000000002}]},{"osd":7,"last update":"Fri Jul 14 13:33:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.79700000000000004,"15min":0.81200000000000006},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.95999999999999996,"5min":1.2689999999999999,"15min":1.3100000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.86799999999999999,"15min":0.871},"min":{"1min":0.69199999999999995,"5min":0.60499999999999998,"15min":0.58899999999999997},"max":{"1min":1.0049999999999999,"5min":1.2569999999999999,"15min":1.3380000000000001},"last":0.95999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575334,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42216,"kb_used_data":2976,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329624,"statfs":{"total":96636764160,"available":96593534976,"internally_reserved":0,"allocated":3047424,"data_stored":1854079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 13:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45900000000000002,"15min":0.47699999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.69799999999999995,"5min":0.81499999999999995,"15min":0.82799999999999996},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.50700000000000001,"15min":0.52200000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.308},"max":{"1min":0.60199999999999998,"5min":0.73999999999999999,"15min":0.80700000000000005},"last":0.63300000000000001}]},{"osd":2,"last update":"Fri Jul 14 13:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51800000000000002,"15min":0.52900000000000003},"min":{"1min":0.32400000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75900000000000001,"5min":0.77200000000000002,"15min":0.82099999999999995},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.56000000000000005,"15min":0.56999999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73799999999999999,"5min":0.81200000000000006,"15min":0.91200000000000003},"last":0.67200000000000004}]},{"osd":3,"last update":"Fri Jul 14 13:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51600000000000001,"15min":0.52700000000000002},"min":{"1min":0.35499999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65400000000000003,"5min":0.76900000000000002,"15min":0.78600000000000003},"last":0.75},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58899999999999997,"15min":0.60099999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85199999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.70199999999999996}]},{"osd":4,"last update":"Fri Jul 14 13:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.78400000000000003,"15min":0.81499999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.995,"5min":1.157,"15min":1.274},"last":1.1619999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.80400000000000005,"15min":0.82899999999999996},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.056,"5min":1.2190000000000001,"15min":1.4910000000000001},"last":0.96699999999999997}]},{"osd":5,"last update":"Fri Jul 14 13:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.79000000000000004,"15min":0.82199999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.93400000000000005,"5min":1.161,"15min":1.294},"last":1.071},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.81100000000000005,"15min":0.84299999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0580000000000001,"5min":1.1060000000000001,"15min":1.472},"last":1.1120000000000001}]},{"osd":6,"last update":"Fri Jul 14 13:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.80100000000000005,"15min":0.83299999999999996},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1,"5min":1.236,"15min":1.639},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.82199999999999995,"15min":0.85599999999999998},"min":{"1min":0.54600000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0980000000000001,"5min":1.202,"15min":1.544},"last":1.135}]},{"osd":7,"last update":"Fri Jul 14 13:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.82999999999999996,"15min":0.84399999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.026,"5min":1.173,"15min":1.236},"last":1.01},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.80800000000000005,"15min":0.84999999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0700000000000001,"5min":1.202,"15min":1.5880000000000001},"last":1.046}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T13:33:26.679 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-07-14T13:33:26.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.823+0000 7f3e5579f640 1 Processor -- start 2023-07-14T13:33:26.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.823+0000 7f3e5579f640 1 -- start start 2023-07-14T13:33:26.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.827+0000 7f3e5579f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3e50159c10 0x7f3e50069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:26.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.827+0000 7f3e5579f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3e500ca340 0x7f3e500b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:26.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.827+0000 7f3e5579f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e500b3af0 con 0x7f3e500cce00 2023-07-14T13:33:26.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.827+0000 7f3e5579f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e5006b280 con 0x7f3e50159c10 2023-07-14T13:33:26.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.827+0000 7f3e5579f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e50159fe0 con 0x7f3e500ca340 2023-07-14T13:33:26.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.827+0000 7f3e4effd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3e50159c10 0x7f3e50069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:26.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.827+0000 7f3e4f7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3e500cce00 0x7f3e5006b6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49942/0 (socket says 172.21.15.5:49942) 2023-07-14T13:33:26.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.827+0000 7f3e4f7fe640 1 -- 172.21.15.5:0/610598054 learned_addr learned my addr 172.21.15.5:0/610598054 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:33:26.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.827+0000 7f3e47fff640 1 --2- 172.21.15.5:0/610598054 >> v2:172.21.15.154:3300/0 conn(0x7f3e500ca340 0x7f3e500b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:26.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.827+0000 7f3e4effd640 1 -- 172.21.15.5:0/610598054 >> v2:172.21.15.154:3300/0 conn(0x7f3e500ca340 msgr2=0x7f3e500b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:26.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.827+0000 7f3e4effd640 1 --2- 172.21.15.5:0/610598054 >> v2:172.21.15.154:3300/0 conn(0x7f3e500ca340 0x7f3e500b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:26.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.827+0000 7f3e4effd640 1 -- 172.21.15.5:0/610598054 >> v1:172.21.15.5:6789/0 conn(0x7f3e500cce00 legacy=0x7f3e5006b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:26.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.827+0000 7f3e4effd640 1 -- 172.21.15.5:0/610598054 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e50069a90 con 0x7f3e50159c10 2023-07-14T13:33:26.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.827+0000 7f3e4e7fc640 1 -- 172.21.15.5:0/610598054 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707411432 0 0) 0x7f3e500b3af0 con 0x7f3e500cce00 2023-07-14T13:33:26.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.831+0000 7f3e4effd640 1 --2- 172.21.15.5:0/610598054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e50159c10 0x7f3e50069430 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f3e5006eb30 tx=0x7f3e4001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2dc2d359ecadabe server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:26.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.831+0000 7f3e4e7fc640 1 -- 172.21.15.5:0/610598054 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e400ab600 con 0x7f3e50159c10 2023-07-14T13:33:26.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.831+0000 7f3e4e7fc640 1 -- 172.21.15.5:0/610598054 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e400a7050 con 0x7f3e50159c10 2023-07-14T13:33:26.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.831+0000 7f3e4e7fc640 1 -- 172.21.15.5:0/610598054 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e400ab980 con 0x7f3e50159c10 2023-07-14T13:33:26.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.831+0000 7f3e5579f640 1 -- 172.21.15.5:0/610598054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e50159c10 msgr2=0x7f3e50069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:26.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.831+0000 7f3e5579f640 1 --2- 172.21.15.5:0/610598054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e50159c10 0x7f3e50069430 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f3e5006eb30 tx=0x7f3e4001c460 comp rx=0 tx=0).stop 2023-07-14T13:33:26.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.831+0000 7f3e5579f640 1 -- 172.21.15.5:0/610598054 shutdown_connections 2023-07-14T13:33:26.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.831+0000 7f3e5579f640 1 --2- 172.21.15.5:0/610598054 >> v2:172.21.15.154:3300/0 conn(0x7f3e500ca340 0x7f3e500b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:26.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.831+0000 7f3e5579f640 1 --2- 172.21.15.5:0/610598054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e50159c10 0x7f3e50069430 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:26.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.831+0000 7f3e5579f640 1 -- 172.21.15.5:0/610598054 >> 172.21.15.5:0/610598054 conn(0x7f3e500cb4f0 msgr2=0x7f3e500cdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:26.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.831+0000 7f3e5579f640 1 -- 172.21.15.5:0/610598054 shutdown_connections 2023-07-14T13:33:26.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.831+0000 7f3e5579f640 1 -- 172.21.15.5:0/610598054 wait complete. 2023-07-14T13:33:26.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.831+0000 7f3e5579f640 1 Processor -- start 2023-07-14T13:33:26.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.831+0000 7f3e5579f640 1 -- start start 2023-07-14T13:33:26.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.831+0000 7f3e5579f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e500ca340 0x7f3e50146690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:26.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.831+0000 7f3e5579f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e500cce00 0x7f3e50147440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:26.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.831+0000 7f3e5579f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e50159c10 0x7f3e50147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:26.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.831+0000 7f3e5579f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500c4a30 con 0x7f3e500cce00 2023-07-14T13:33:26.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.831+0000 7f3e5579f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5014dd60 con 0x7f3e500ca340 2023-07-14T13:33:26.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.831+0000 7f3e5579f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e50146bd0 con 0x7f3e50159c10 2023-07-14T13:33:26.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.835+0000 7f3e47fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e500cce00 0x7f3e50147440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:26.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.835+0000 7f3e47fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e500cce00 0x7f3e50147440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58766/0 (socket says 172.21.15.5:58766) 2023-07-14T13:33:26.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.835+0000 7f3e47fff640 1 -- 172.21.15.5:0/3845495457 learned_addr learned my addr 172.21.15.5:0/3845495457 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:26.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.835+0000 7f3e4f7fe640 1 --2- 172.21.15.5:0/3845495457 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e50159c10 0x7f3e50147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:26.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.835+0000 7f3e47fff640 1 -- 172.21.15.5:0/3845495457 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e50159c10 msgr2=0x7f3e50147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:26.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.835+0000 7f3e47fff640 1 --2- 172.21.15.5:0/3845495457 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e50159c10 0x7f3e50147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:26.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.835+0000 7f3e47fff640 1 -- 172.21.15.5:0/3845495457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e500ca340 msgr2=0x7f3e50146690 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-14T13:33:26.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.835+0000 7f3e47fff640 1 --2- 172.21.15.5:0/3845495457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e500ca340 0x7f3e50146690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:26.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.835+0000 7f3e47fff640 1 -- 172.21.15.5:0/3845495457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e40009420 con 0x7f3e500cce00 2023-07-14T13:33:26.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.835+0000 7f3e47fff640 1 --2- 172.21.15.5:0/3845495457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e500cce00 0x7f3e50147440 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f3e3800d5f0 tx=0x7f3e3800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:26.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.835+0000 7f3e477fe640 1 -- 172.21.15.5:0/3845495457 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e380125f0 con 0x7f3e500cce00 2023-07-14T13:33:26.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.835+0000 7f3e477fe640 1 -- 172.21.15.5:0/3845495457 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e38012750 con 0x7f3e500cce00 2023-07-14T13:33:26.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.835+0000 7f3e477fe640 1 -- 172.21.15.5:0/3845495457 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e38012ae0 con 0x7f3e500cce00 2023-07-14T13:33:26.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.835+0000 7f3e5579f640 1 -- 172.21.15.5:0/3845495457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e50149850 con 0x7f3e500cce00 2023-07-14T13:33:26.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.835+0000 7f3e5579f640 1 -- 172.21.15.5:0/3845495457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e50149e10 con 0x7f3e500cce00 2023-07-14T13:33:26.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.835+0000 7f3e5579f640 1 -- 172.21.15.5:0/3845495457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e5004e020 con 0x7f3e500cce00 2023-07-14T13:33:26.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.835+0000 7f3e477fe640 1 -- 172.21.15.5:0/3845495457 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3e38012c40 con 0x7f3e500cce00 2023-07-14T13:33:26.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.839+0000 7f3e477fe640 1 --2- 172.21.15.5:0/3845495457 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f3e300663a0 0x7f3e30068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:26.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.839+0000 7f3e477fe640 1 -- 172.21.15.5:0/3845495457 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7f3e38084380 con 0x7f3e500cce00 2023-07-14T13:33:26.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.839+0000 7f3e4effd640 1 --2- 172.21.15.5:0/3845495457 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f3e300663a0 0x7f3e30068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:26.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.839+0000 7f3e4effd640 1 --2- 172.21.15.5:0/3845495457 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f3e300663a0 0x7f3e30068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3e400ad000 tx=0x7f3e40008040 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:26.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.839+0000 7f3e477fe640 1 -- 172.21.15.5:0/3845495457 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f3e380516f0 con 0x7f3e500cce00 2023-07-14T13:33:26.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:26.999+0000 7f3e5579f640 1 -- 172.21.15.5:0/3845495457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f3e50149fa0 con 0x7f3e500cce00 2023-07-14T13:33:27.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.003+0000 7f3e477fe640 1 -- 172.21.15.5:0/3845495457 <== mon.0 v2:172.21.15.5:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3e380073a0 con 0x7f3e500cce00 2023-07-14T13:33:27.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.003+0000 7f3e477fe640 1 -- 172.21.15.5:0/3845495457 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v70)=0 v70) v1 ==== 123+0+0 (secure 0 0 0) 0x7f3e38054d10 con 0x7f3e500cce00 2023-07-14T13:33:27.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.007+0000 7f3e5579f640 1 -- 172.21.15.5:0/3845495457 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f3e300663a0 msgr2=0x7f3e30068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:27.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.007+0000 7f3e5579f640 1 --2- 172.21.15.5:0/3845495457 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f3e300663a0 0x7f3e30068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3e400ad000 tx=0x7f3e40008040 comp rx=0 tx=0).stop 2023-07-14T13:33:27.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.007+0000 7f3e5579f640 1 -- 172.21.15.5:0/3845495457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e500cce00 msgr2=0x7f3e50147440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:27.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.007+0000 7f3e5579f640 1 --2- 172.21.15.5:0/3845495457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e500cce00 0x7f3e50147440 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f3e3800d5f0 tx=0x7f3e3800dab0 comp rx=0 tx=0).stop 2023-07-14T13:33:27.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.007+0000 7f3e5579f640 1 -- 172.21.15.5:0/3845495457 shutdown_connections 2023-07-14T13:33:27.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.007+0000 7f3e5579f640 1 --2- 172.21.15.5:0/3845495457 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f3e300663a0 0x7f3e30068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:27.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.007+0000 7f3e5579f640 1 --2- 172.21.15.5:0/3845495457 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e50159c10 0x7f3e50147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:27.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.007+0000 7f3e5579f640 1 --2- 172.21.15.5:0/3845495457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e500cce00 0x7f3e50147440 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:27.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.007+0000 7f3e5579f640 1 --2- 172.21.15.5:0/3845495457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e500ca340 0x7f3e50146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:27.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.007+0000 7f3e5579f640 1 -- 172.21.15.5:0/3845495457 >> 172.21.15.5:0/3845495457 conn(0x7f3e500cb4f0 msgr2=0x7f3e500b1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:27.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.007+0000 7f3e5579f640 1 -- 172.21.15.5:0/3845495457 shutdown_connections 2023-07-14T13:33:27.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.007+0000 7f3e5579f640 1 -- 172.21.15.5:0/3845495457 wait complete. 2023-07-14T13:33:27.022 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-14T13:33:27.022 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:33:27.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.171+0000 7f065a097640 1 Processor -- start 2023-07-14T13:33:27.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.171+0000 7f065a097640 1 -- start start 2023-07-14T13:33:27.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.171+0000 7f065a097640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06540b7d90 0x7f06540cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:27.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.171+0000 7f065a097640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06540d13f0 0x7f06540ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:27.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.171+0000 7f065a097640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06540d0f60 con 0x7f065415f3f0 2023-07-14T13:33:27.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.171+0000 7f065a097640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06540d0390 con 0x7f06540b7d90 2023-07-14T13:33:27.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.171+0000 7f065a097640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06540d0630 con 0x7f06540d13f0 2023-07-14T13:33:27.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.171+0000 7f0659095640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f065415f3f0 0x7f06540b7680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:49952/0 (socket says 172.21.15.5:49952) 2023-07-14T13:33:27.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.171+0000 7f0659095640 1 -- 172.21.15.5:0/404704520 learned_addr learned my addr 172.21.15.5:0/404704520 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-07-14T13:33:27.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.171+0000 7f0658894640 1 --2- 172.21.15.5:0/404704520 >> v2:172.21.15.5:3300/0 conn(0x7f06540b7d90 0x7f06540cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:27.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.171+0000 7f0659896640 1 --2- 172.21.15.5:0/404704520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06540d13f0 0x7f06540ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:27.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.171+0000 7f0658894640 1 -- 172.21.15.5:0/404704520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06540d13f0 msgr2=0x7f06540ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:27.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.171+0000 7f0658894640 1 --2- 172.21.15.5:0/404704520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06540d13f0 0x7f06540ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:27.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.171+0000 7f0658894640 1 -- 172.21.15.5:0/404704520 >> v1:172.21.15.5:6789/0 conn(0x7f065415f3f0 legacy=0x7f06540b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:27.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.171+0000 7f0658894640 1 -- 172.21.15.5:0/404704520 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06540d0910 con 0x7f06540b7d90 2023-07-14T13:33:27.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.171+0000 7f064bfff640 1 -- 172.21.15.5:0/404704520 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2168312987 0 0) 0x7f06540d0f60 con 0x7f065415f3f0 2023-07-14T13:33:27.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.171+0000 7f0659896640 1 --2- 172.21.15.5:0/404704520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06540d13f0 0x7f06540ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:33:27.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.175+0000 7f0658894640 1 --2- 172.21.15.5:0/404704520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06540b7d90 0x7f06540cc9a0 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f06440097c0 tx=0x7f064401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee971134457c5be6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:27.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.175+0000 7f064bfff640 1 -- 172.21.15.5:0/404704520 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06440ab600 con 0x7f06540b7d90 2023-07-14T13:33:27.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.175+0000 7f064bfff640 1 -- 172.21.15.5:0/404704520 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f06440a7050 con 0x7f06540b7d90 2023-07-14T13:33:27.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.175+0000 7f064bfff640 1 -- 172.21.15.5:0/404704520 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06440ab9a0 con 0x7f06540b7d90 2023-07-14T13:33:27.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.175+0000 7f065a097640 1 -- 172.21.15.5:0/404704520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06540b7d90 msgr2=0x7f06540cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:27.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.175+0000 7f065a097640 1 --2- 172.21.15.5:0/404704520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06540b7d90 0x7f06540cc9a0 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f06440097c0 tx=0x7f064401c3f0 comp rx=0 tx=0).stop 2023-07-14T13:33:27.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.175+0000 7f065a097640 1 -- 172.21.15.5:0/404704520 shutdown_connections 2023-07-14T13:33:27.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.175+0000 7f065a097640 1 --2- 172.21.15.5:0/404704520 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06540d13f0 0x7f06540ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:27.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.175+0000 7f065a097640 1 --2- 172.21.15.5:0/404704520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06540b7d90 0x7f06540cc9a0 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:27.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.175+0000 7f065a097640 1 -- 172.21.15.5:0/404704520 >> 172.21.15.5:0/404704520 conn(0x7f0654069f50 msgr2=0x7f065406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:27.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.175+0000 7f065a097640 1 -- 172.21.15.5:0/404704520 shutdown_connections 2023-07-14T13:33:27.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.175+0000 7f065a097640 1 -- 172.21.15.5:0/404704520 wait complete. 2023-07-14T13:33:27.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.175+0000 7f065a097640 1 Processor -- start 2023-07-14T13:33:27.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.179+0000 7f065a097640 1 -- start start 2023-07-14T13:33:27.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.179+0000 7f065a097640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06540b7d90 0x7f065415ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:27.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.179+0000 7f065a097640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06540d13f0 0x7f065415e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:27.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.179+0000 7f065a097640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f065415f3f0 0x7f06541f7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:27.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.179+0000 7f065a097640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0654154e30 con 0x7f065415f3f0 2023-07-14T13:33:27.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.179+0000 7f065a097640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065415eda0 con 0x7f06540b7d90 2023-07-14T13:33:27.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.179+0000 7f065a097640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f065415c480 con 0x7f06540d13f0 2023-07-14T13:33:27.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.179+0000 7f0659896640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f065415f3f0 0x7f06541f7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:27.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.179+0000 7f0659896640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f065415f3f0 0x7f06541f7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58774/0 (socket says 172.21.15.5:58774) 2023-07-14T13:33:27.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.179+0000 7f0659896640 1 -- 172.21.15.5:0/4164290807 learned_addr learned my addr 172.21.15.5:0/4164290807 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-07-14T13:33:27.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.179+0000 7f0659095640 1 --2- 172.21.15.5:0/4164290807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06540b7d90 0x7f065415ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:27.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.179+0000 7f0658894640 1 --2- 172.21.15.5:0/4164290807 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06540d13f0 0x7f065415e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:27.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.179+0000 7f0659896640 1 -- 172.21.15.5:0/4164290807 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06540d13f0 msgr2=0x7f065415e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:27.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.179+0000 7f0659896640 1 --2- 172.21.15.5:0/4164290807 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06540d13f0 0x7f065415e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:27.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.179+0000 7f0659896640 1 -- 172.21.15.5:0/4164290807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06540b7d90 msgr2=0x7f065415ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:27.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.179+0000 7f0659896640 1 --2- 172.21.15.5:0/4164290807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06540b7d90 0x7f065415ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:27.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.179+0000 7f0659896640 1 -- 172.21.15.5:0/4164290807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0644009420 con 0x7f065415f3f0 2023-07-14T13:33:27.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.179+0000 7f0658894640 1 --2- 172.21.15.5:0/4164290807 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06540d13f0 0x7f065415e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:33:27.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.179+0000 7f0659896640 1 --2- 172.21.15.5:0/4164290807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f065415f3f0 0x7f06541f7920 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7f064c00cf20 tx=0x7f064c00a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:27.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.179+0000 7f0649ffb640 1 -- 172.21.15.5:0/4164290807 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c00d840 con 0x7f065415f3f0 2023-07-14T13:33:27.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.179+0000 7f0649ffb640 1 -- 172.21.15.5:0/4164290807 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f064c00d9a0 con 0x7f065415f3f0 2023-07-14T13:33:27.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.179+0000 7f065a097640 1 -- 172.21.15.5:0/4164290807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f065415c760 con 0x7f065415f3f0 2023-07-14T13:33:27.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.179+0000 7f0649ffb640 1 -- 172.21.15.5:0/4164290807 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c00dd70 con 0x7f065415f3f0 2023-07-14T13:33:27.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.179+0000 7f065a097640 1 -- 172.21.15.5:0/4164290807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0654154a50 con 0x7f065415f3f0 2023-07-14T13:33:27.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.179+0000 7f065a097640 1 -- 172.21.15.5:0/4164290807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0654154f70 con 0x7f065415f3f0 2023-07-14T13:33:27.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.183+0000 7f0649ffb640 1 -- 172.21.15.5:0/4164290807 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 103) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f064c01e3b0 con 0x7f065415f3f0 2023-07-14T13:33:27.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.183+0000 7f0649ffb640 1 --2- 172.21.15.5:0/4164290807 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f06380663a0 0x7f0638068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:27.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.183+0000 7f0649ffb640 1 -- 172.21.15.5:0/4164290807 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6055+0+0 (secure 0 0 0) 0x7f064c084980 con 0x7f065415f3f0 2023-07-14T13:33:27.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.183+0000 7f0659095640 1 --2- 172.21.15.5:0/4164290807 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f06380663a0 0x7f0638068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:27.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.183+0000 7f0659095640 1 --2- 172.21.15.5:0/4164290807 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f06380663a0 0x7f0638068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0650000f70 tx=0x7f0650007c10 comp rx=0 tx=0).ready entity=mgr.10192 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:27.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.187+0000 7f0649ffb640 1 -- 172.21.15.5:0/4164290807 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169738 (secure 0 0 0) 0x7f0654154f70 con 0x7f065415f3f0 2023-07-14T13:33:27.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.371+0000 7f065a097640 1 -- 172.21.15.5:0/4164290807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0654154f70 con 0x7f065415f3f0 2023-07-14T13:33:27.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.371+0000 7f0649ffb640 1 -- 172.21.15.5:0/4164290807 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+3528 (secure 0 0 0) 0x7f0654154f70 con 0x7f065415f3f0 2023-07-14T13:33:27.369 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-07-14T13:33:27.369 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":94,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8669,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3337947661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3337947661},{"type":"v1","addr":"172.21.15.154:6835","nonce":3337947661}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":8675,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/695363750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":695363750},{"type":"v1","addr":"172.21.15.154:6837","nonce":695363750}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":10542,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6833/1412864639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":1412864639},{"type":"v1","addr":"172.21.15.5:6833","nonce":1412864639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":10986,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2203985440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2203985440},{"type":"v1","addr":"172.21.15.5:6835","nonce":2203985440}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94}],"filesystems":[]} 2023-07-14T13:33:27.370 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 94 2023-07-14T13:33:27.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.375+0000 7f065a097640 1 -- 172.21.15.5:0/4164290807 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f06380663a0 msgr2=0x7f0638068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:27.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.375+0000 7f065a097640 1 --2- 172.21.15.5:0/4164290807 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f06380663a0 0x7f0638068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0650000f70 tx=0x7f0650007c10 comp rx=0 tx=0).stop 2023-07-14T13:33:27.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.375+0000 7f065a097640 1 -- 172.21.15.5:0/4164290807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f065415f3f0 msgr2=0x7f06541f7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:27.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.375+0000 7f065a097640 1 --2- 172.21.15.5:0/4164290807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f065415f3f0 0x7f06541f7920 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7f064c00cf20 tx=0x7f064c00a7d0 comp rx=0 tx=0).stop 2023-07-14T13:33:27.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.375+0000 7f065a097640 1 -- 172.21.15.5:0/4164290807 shutdown_connections 2023-07-14T13:33:27.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.375+0000 7f065a097640 1 --2- 172.21.15.5:0/4164290807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f065415f3f0 0x7f06541f7920 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:27.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.375+0000 7f065a097640 1 --2- 172.21.15.5:0/4164290807 >> [v2:172.21.15.154:6832/317858933,v1:172.21.15.154:6833/317858933] conn(0x7f06380663a0 0x7f0638068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:27.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.375+0000 7f065a097640 1 --2- 172.21.15.5:0/4164290807 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06540d13f0 0x7f065415e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:27.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.375+0000 7f065a097640 1 --2- 172.21.15.5:0/4164290807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06540b7d90 0x7f065415ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:27.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.375+0000 7f065a097640 1 -- 172.21.15.5:0/4164290807 >> 172.21.15.5:0/4164290807 conn(0x7f0654069f50 msgr2=0x7f06540cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:27.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.375+0000 7f065a097640 1 -- 172.21.15.5:0/4164290807 shutdown_connections 2023-07-14T13:33:27.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-07-14T13:33:27.375+0000 7f065a097640 1 -- 172.21.15.5:0/4164290807 wait complete. 2023-07-14T13:33:27.391 DEBUG:tasks.cephfs.filesystem:already dead... 2023-07-14T13:33:27.392 INFO:teuthology.misc:Shutting down mds daemons... 2023-07-14T13:33:27.392 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-14T13:33:27.393 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:33:27.405 INFO:tasks.ceph.mds.a:Stopped 2023-07-14T13:33:27.405 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-14T13:33:27.406 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:33:27.458 INFO:tasks.ceph.mds.c:Stopped 2023-07-14T13:33:27.459 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-14T13:33:27.459 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:33:27.473 INFO:tasks.ceph.mds.b:Stopped 2023-07-14T13:33:27.474 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-14T13:33:27.474 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:33:27.530 INFO:tasks.ceph.mds.d:Stopped 2023-07-14T13:33:27.530 INFO:teuthology.misc:Shutting down osd daemons... 2023-07-14T13:33:27.530 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-07-14T13:33:27.531 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:33:27.609 INFO:tasks.ceph.osd.0:Stopped 2023-07-14T13:33:27.609 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-07-14T13:33:27.609 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:33:27.690 INFO:tasks.ceph.osd.1:Stopped 2023-07-14T13:33:27.690 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-07-14T13:33:27.691 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:33:28.829 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-07-14T13:33:33.793 INFO:tasks.ceph.osd.2:Stopped 2023-07-14T13:33:33.793 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-07-14T13:33:33.794 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:33:33.856 INFO:tasks.ceph.osd.3:Stopped 2023-07-14T13:33:33.856 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-07-14T13:33:33.857 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:33:33.948 INFO:tasks.ceph.osd.4:Stopped 2023-07-14T13:33:33.948 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-07-14T13:33:33.948 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:33:34.023 INFO:tasks.ceph.osd.5:Stopped 2023-07-14T13:33:34.024 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-07-14T13:33:34.024 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:33:34.101 INFO:tasks.ceph.osd.6:Stopped 2023-07-14T13:33:34.102 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-07-14T13:33:34.102 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:33:34.193 INFO:tasks.ceph.osd.7:Stopped 2023-07-14T13:33:34.193 INFO:teuthology.misc:Shutting down mgr daemons... 2023-07-14T13:33:34.194 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-07-14T13:33:34.194 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:33:34.252 INFO:tasks.ceph.mgr.y:Stopped 2023-07-14T13:33:34.253 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-07-14T13:33:34.253 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:33:34.310 INFO:tasks.ceph.mgr.x:Stopped 2023-07-14T13:33:34.310 INFO:teuthology.misc:Shutting down mon daemons... 2023-07-14T13:33:34.311 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-07-14T13:33:34.311 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:33:34.337 INFO:tasks.ceph.mon.a:Stopped 2023-07-14T13:33:34.337 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-07-14T13:33:34.338 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:33:34.356 INFO:tasks.ceph.mon.b:Stopped 2023-07-14T13:33:34.357 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-07-14T13:33:34.357 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:33:34.422 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-07-14T13:33:34.422 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-07-14T13:33:34.423 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-07-14T13:33:34.423 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-07-14T13:33:34.423 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-07-14T13:33:34.423 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-07-14T13:33:34.423 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-07-14T13:33:34.423 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-07-14T13:33:34.424 INFO:tasks.ceph.mon.c:Stopped 2023-07-14T13:33:34.424 INFO:tasks.ceph:Checking cluster log for badness... 2023-07-14T13:33:34.425 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-07-14T13:33:34.457 INFO:teuthology.orchestra.run.smithi005.stdout:2023-07-14T12:55:02.482844+0000 mon.a (mon.0) 352 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2023-07-14T13:33:34.458 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-07-14T13:33:34.458 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-07-14T13:33:34.532 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-07-14T13:33:34.610 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-07-14T13:33:34.687 INFO:teuthology.orchestra.run.smithi005.stdout:2023-07-14T12:55:02.482844+0000 mon.a (mon.0) 352 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2023-07-14T13:33:34.688 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi005.front.sepia.ceph.com 2023-07-14T13:33:34.689 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-07-14T13:33:35.164 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi005.front.sepia.ceph.com 2023-07-14T13:33:35.165 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-07-14T13:33:35.640 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi005.front.sepia.ceph.com 2023-07-14T13:33:35.641 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-07-14T13:33:35.981 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi005.front.sepia.ceph.com 2023-07-14T13:33:35.982 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-07-14T13:33:36.532 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi154.front.sepia.ceph.com 2023-07-14T13:33:36.533 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-07-14T13:33:36.930 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi154.front.sepia.ceph.com 2023-07-14T13:33:36.931 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-07-14T13:33:37.426 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi154.front.sepia.ceph.com 2023-07-14T13:33:37.427 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-07-14T13:33:37.762 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi154.front.sepia.ceph.com 2023-07-14T13:33:37.763 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-07-14T13:33:38.282 INFO:tasks.ceph:Archiving mon data... 2023-07-14T13:33:38.287 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337461/data/mon.a.tgz 2023-07-14T13:33:38.287 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2023-07-14T13:33:38.297 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.u6lcxVs07O 2023-07-14T13:33:38.298 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.u6lcxVs07O 2023-07-14T13:33:38.754 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.u6lcxVs07O 2023-07-14T13:33:38.830 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.u6lcxVs07O is 2MB 2023-07-14T13:33:38.918 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.u6lcxVs07O 2023-07-14T13:33:38.928 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337461/data/mon.b.tgz 2023-07-14T13:33:38.928 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2023-07-14T13:33:38.938 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.IcKBlu8Eic 2023-07-14T13:33:38.938 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.IcKBlu8Eic 2023-07-14T13:33:39.389 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.IcKBlu8Eic 2023-07-14T13:33:39.424 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-07-14T13:33:39.424 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-07-14T13:33:39.424 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-07-14T13:33:39.425 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-07-14T13:33:39.425 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-07-14T13:33:39.425 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-07-14T13:33:39.425 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-07-14T13:33:39.463 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.IcKBlu8Eic is 2MB 2023-07-14T13:33:39.560 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.IcKBlu8Eic 2023-07-14T13:33:39.569 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337461/data/mon.c.tgz 2023-07-14T13:33:39.570 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2023-07-14T13:33:39.624 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.oUa8V0chOr 2023-07-14T13:33:39.625 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.oUa8V0chOr 2023-07-14T13:33:40.056 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.oUa8V0chOr 2023-07-14T13:33:40.136 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.oUa8V0chOr is 2MB 2023-07-14T13:33:40.219 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.oUa8V0chOr 2023-07-14T13:33:40.229 INFO:tasks.ceph:Cleaning ceph cluster... 2023-07-14T13:33:40.229 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-14T13:33:40.233 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-14T13:33:40.295 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-07-14T13:33:40.296 DEBUG:teuthology.orchestra.run.smithi005:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-14T13:33:40.299 DEBUG:teuthology.orchestra.run.smithi154:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-14T13:33:40.333 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-14T13:33:40.378 INFO:teuthology.orchestra.run.smithi154.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-14T13:33:40.384 INFO:tasks.ceph:Archiving crash dumps... 2023-07-14T13:33:40.386 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337461/remote/smithi005/crash 2023-07-14T13:33:40.388 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-14T13:33:40.412 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337461/remote/smithi154/crash 2023-07-14T13:33:40.415 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-14T13:33:40.446 INFO:tasks.ceph:Shutting down logrotate 2023-07-14T13:33:40.447 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:33:40.461 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-14T13:33:40.552 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-14T13:33:40.575 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-14T13:33:40.595 INFO:tasks.ceph:Compressing logs... 2023-07-14T13:33:40.596 DEBUG:teuthology.orchestra.run.smithi005:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-14T13:33:40.624 DEBUG:teuthology.orchestra.run.smithi154:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-14T13:33:40.651 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48499.log 2023-07-14T13:33:40.654 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54946.log 2023-07-14T13:33:40.654 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44622.log 2023-07-14T13:33:40.654 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48499.log.gz 2023-07-14T13:33:40.655 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66050.log 2023-07-14T13:33:40.655 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54946.log.gz 2023-07-14T13:33:40.656 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42078.log 2023-07-14T13:33:40.656 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44622.log.gz 2023-07-14T13:33:40.656 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.66050.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.66050.log.gz -5 2023-07-14T13:33:40.657 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.59959.log 2023-07-14T13:33:40.657 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53738.log 2023-07-14T13:33:40.657 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42078.log.gz 2023-07-14T13:33:40.658 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45643.log 2023-07-14T13:33:40.658 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59959.log.gz 2023-07-14T13:33:40.659 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53738.log: gzip -5 87.8% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.53738.log.gz /var/log/ceph/ceph-client.admin.56740.log 2023-07-14T13:33:40.659 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-07-14T13:33:40.660 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48296.log 2023-07-14T13:33:40.660 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45643.log.gz 2023-07-14T13:33:40.661 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47111.log 2023-07-14T13:33:40.661 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56740.log.gz 2023-07-14T13:33:40.662 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48296.log: gzip -5 --verbose -- 87.5% /var/log/ceph/ceph-client.admin.59168.log -- replaced with /var/log/ceph/ceph-client.admin.48296.log.gz 2023-07-14T13:33:40.662 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-07-14T13:33:40.663 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43411.log 2023-07-14T13:33:40.663 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47111.log: gzip 88.2% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.47111.log.gz -- 2023-07-14T13:33:40.664 INFO:teuthology.orchestra.run.smithi005.stderr: /var/log/ceph/ceph-client.admin.56636.log 2023-07-14T13:33:40.665 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59168.log: gzip -5 88.3% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.59168.log.gz /var/log/ceph/ceph-client.admin.64318.log 2023-07-14T13:33:40.665 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-07-14T13:33:40.665 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37712.log 2023-07-14T13:33:40.665 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.1.43411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43411.log.gz 2023-07-14T13:33:40.666 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-07-14T13:33:40.666 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37712.log: gzip -5 --verbose 87.9% -- -- replaced with /var/log/ceph/ceph-client.admin.37712.log.gz 2023-07-14T13:33:40.667 INFO:teuthology.orchestra.run.smithi154.stderr: /var/log/ceph/ceph-client.admin.37640.log 2023-07-14T13:33:40.667 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56636.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56636.log.gz 2023-07-14T13:33:40.668 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51801.log 2023-07-14T13:33:40.668 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65169.log 2023-07-14T13:33:40.668 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.64318.log.gz 2023-07-14T13:33:40.668 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47754.log 2023-07-14T13:33:40.668 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51801.log.gz 2023-07-14T13:33:40.669 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65169.log: gzip 88.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.65169.log.gz --verbose 2023-07-14T13:33:40.669 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/ceph-client.admin.60337.log 2023-07-14T13:33:40.670 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-07-14T13:33:40.670 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37640.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37640.log.gz 2023-07-14T13:33:40.670 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-07-14T13:33:40.671 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37760.log 2023-07-14T13:33:40.671 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37616.log 2023-07-14T13:33:40.672 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37760.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37760.log.gz 2023-07-14T13:33:40.672 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-07-14T13:33:40.672 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58465.log 2023-07-14T13:33:40.673 INFO:teuthology.orchestra.run.smithi005.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47754.log.gz 2023-07-14T13:33:40.673 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60337.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60337.log.gz 2023-07-14T13:33:40.673 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59575.log 2023-07-14T13:33:40.673 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58465.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.58465.log.gz -5 2023-07-14T13:33:40.673 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48714.log 2023-07-14T13:33:40.673 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59575.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59575.log.gz 2023-07-14T13:33:40.674 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56504.log 2023-07-14T13:33:40.675 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56310.log 2023-07-14T13:33:40.675 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48714.log.gz 2023-07-14T13:33:40.675 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52515.log 2023-07-14T13:33:40.676 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56504.log.gz 2023-07-14T13:33:40.676 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37616.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-07-14T13:33:40.676 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37616.log.gz 2023-07-14T13:33:40.676 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-07-14T13:33:40.676 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43496.log 2023-07-14T13:33:40.678 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-07-14T13:33:40.678 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.3.43496.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.43496.log.gz 2023-07-14T13:33:40.679 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56946.log 2023-07-14T13:33:40.679 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56310.log.gz 2023-07-14T13:33:40.679 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43558.log 2023-07-14T13:33:40.679 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52515.log.gz 2023-07-14T13:33:40.679 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.56946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56946.log.gz 2023-07-14T13:33:40.679 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54279.log 2023-07-14T13:33:40.681 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-07-14T13:33:40.681 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43501.log 2023-07-14T13:33:40.681 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61437.log 2023-07-14T13:33:40.682 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43558.log.gz 2023-07-14T13:33:40.682 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58385.log 2023-07-14T13:33:40.682 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54279.log.gz 2023-07-14T13:33:40.682 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61437.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.61437.log.gz 2023-07-14T13:33:40.682 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51603.log 2023-07-14T13:33:40.682 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58385.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-07-14T13:33:40.683 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58385.log.gz 2023-07-14T13:33:40.683 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mds.d.log: 93.6% -- replaced with /var/log/ceph/ceph.log.gz 2023-07-14T13:33:40.684 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51603.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.51603.log.gz 2023-07-14T13:33:40.684 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45803.log 2023-07-14T13:33:40.684 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61541.log 2023-07-14T13:33:40.685 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37688.log 2023-07-14T13:33:40.685 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45803.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.45803.log.gz 2023-07-14T13:33:40.685 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51743.log 2023-07-14T13:33:40.686 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.3.43501.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.43501.log.gz 2023-07-14T13:33:40.687 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61716.log 2023-07-14T13:33:40.687 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61541.log.gz 2023-07-14T13:33:40.687 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44856.log 2023-07-14T13:33:40.687 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51743.log.gz 2023-07-14T13:33:40.688 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-07-14T13:33:40.688 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44882.log 2023-07-14T13:33:40.688 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61716.log.gz 2023-07-14T13:33:40.690 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44856.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44856.log.gz 2023-07-14T13:33:40.690 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51062.log 2023-07-14T13:33:40.690 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37688.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37688.log.gz 2023-07-14T13:33:40.690 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-14T13:33:40.691 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37664.log 2023-07-14T13:33:40.691 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44882.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44882.log.gz 2023-07-14T13:33:40.692 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46152.log 2023-07-14T13:33:40.692 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51062.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51062.log.gz 2023-07-14T13:33:40.692 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50060.log 2023-07-14T13:33:40.693 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-07-14T13:33:40.693 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46152.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.46152.log.gz 2023-07-14T13:33:40.694 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55846.log 2023-07-14T13:33:40.694 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50060.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50060.log.gz 2023-07-14T13:33:40.694 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52104.log 2023-07-14T13:33:40.695 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37664.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37664.log.gz 2023-07-14T13:33:40.695 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44002.log 2023-07-14T13:33:40.696 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55846.log.gz 2023-07-14T13:33:40.696 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52104.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52104.log.gz 2023-07-14T13:33:40.696 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55872.log 2023-07-14T13:33:40.697 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37736.log 2023-07-14T13:33:40.697 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44002.log: gzip -5 89.3% --verbose -- replaced with /var/log/ceph/ceph-client.admin.44002.log.gz -- 2023-07-14T13:33:40.697 INFO:teuthology.orchestra.run.smithi005.stderr: /var/log/ceph/ceph-client.admin.65529.log 2023-07-14T13:33:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55872.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.55872.log.gz 2023-07-14T13:33:40.698 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55468.log 2023-07-14T13:33:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56610.log 2023-07-14T13:33:40.699 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.65529.log.gz 2023-07-14T13:33:40.699 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55468.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55468.log.gz 2023-07-14T13:33:40.699 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49500.log 2023-07-14T13:33:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56610.log: gzip 88.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.56610.log.gz 2023-07-14T13:33:40.700 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47279.log 2023-07-14T13:33:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.49500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49500.log.gz 2023-07-14T13:33:40.701 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48376.log 2023-07-14T13:33:40.702 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53621.log 2023-07-14T13:33:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47279.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47279.log.gz 2023-07-14T13:33:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49495.log 2023-07-14T13:33:40.704 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48376.log.gz 2023-07-14T13:33:40.704 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53621.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53621.log.gz 2023-07-14T13:33:40.705 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51254.log 2023-07-14T13:33:40.706 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.49495.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49495.log.gz 2023-07-14T13:33:40.706 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52463.log 2023-07-14T13:33:40.706 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mon.b.log: 93.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-07-14T13:33:40.707 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54712.log 2023-07-14T13:33:40.707 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51254.log.gz 2023-07-14T13:33:40.707 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-07-14T13:33:40.708 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52463.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52463.log.gz 2023-07-14T13:33:40.708 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54175.log 2023-07-14T13:33:40.709 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49399.log 2023-07-14T13:33:40.709 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54712.log.gz 2023-07-14T13:33:40.710 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37736.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37736.log.gz 2023-07-14T13:33:40.710 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59620.log 2023-07-14T13:33:40.710 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54175.log.gz 2023-07-14T13:33:40.711 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37784.log 2023-07-14T13:33:40.712 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54201.log 2023-07-14T13:33:40.712 INFO:teuthology.orchestra.run.smithi005.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49399.log.gz 2023-07-14T13:33:40.712 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59620.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59620.log.gz -5 2023-07-14T13:33:40.712 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50086.log 2023-07-14T13:33:40.713 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63359.log 2023-07-14T13:33:40.713 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54201.log.gz 2023-07-14T13:33:40.714 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50086.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50086.log.gz 2023-07-14T13:33:40.714 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49566.log 2023-07-14T13:33:40.715 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63359.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63359.log.gz 2023-07-14T13:33:40.715 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42104.log 2023-07-14T13:33:40.716 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51358.log 2023-07-14T13:33:40.717 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49566.log.gz 2023-07-14T13:33:40.717 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42104.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42104.log.gz 2023-07-14T13:33:40.717 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61265.log 2023-07-14T13:33:40.718 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45725.log 2023-07-14T13:33:40.718 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51358.log.gz 2023-07-14T13:33:40.719 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61265.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61265.log.gz 2023-07-14T13:33:40.719 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60620.log 2023-07-14T13:33:40.720 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50876.log 2023-07-14T13:33:40.721 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45725.log.gz 2023-07-14T13:33:40.721 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.60620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60620.log.gz 2023-07-14T13:33:40.722 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42573.log 2023-07-14T13:33:40.722 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50876.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50876.log.gz 2023-07-14T13:33:40.723 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64798.log 2023-07-14T13:33:40.723 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42573.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42573.log.gz 2023-07-14T13:33:40.724 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46953.log 2023-07-14T13:33:40.724 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56584.log 2023-07-14T13:33:40.725 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.64798.log.gz 2023-07-14T13:33:40.725 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43420.log 2023-07-14T13:33:40.726 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46953.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46953.log.gz 2023-07-14T13:33:40.726 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45527.log 2023-07-14T13:33:40.727 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56584.log: gzip -5 --verbose 89.1% -- -- replaced with /var/log/ceph/ceph-client.admin.56584.log.gz 2023-07-14T13:33:40.727 INFO:teuthology.orchestra.run.smithi005.stderr: /var/log/ceph/ceph-client.admin.61905.log 2023-07-14T13:33:40.727 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.37784.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37784.log.gz 2023-07-14T13:33:40.728 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45527.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45527.log.gz 2023-07-14T13:33:40.728 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50229.log 2023-07-14T13:33:40.729 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61905.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.61905.log.gz 2023-07-14T13:33:40.729 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41896.log 2023-07-14T13:33:40.729 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50229.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50229.log.gz 2023-07-14T13:33:40.730 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65078.log 2023-07-14T13:33:40.731 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41896.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41896.log.gz 2023-07-14T13:33:40.731 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48139.log 2023-07-14T13:33:40.732 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65078.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.65078.log.gz 2023-07-14T13:33:40.732 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55898.log 2023-07-14T13:33:40.733 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48139.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48139.log.gz 2023-07-14T13:33:40.733 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-07-14T13:33:40.734 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65406.log 2023-07-14T13:33:40.734 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55898.log.gz 2023-07-14T13:33:40.735 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48971.log 2023-07-14T13:33:40.736 INFO:teuthology.orchestra.run.smithi005.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-07-14T13:33:40.736 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65406.log: gzip -5 --verbose 88.2% -- /var/log/ceph/ceph-client.admin.60119.log -- replaced with /var/log/ceph/ceph-client.admin.65406.log.gz 2023-07-14T13:33:40.736 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-07-14T13:33:40.737 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48971.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47389.log 2023-07-14T13:33:40.738 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48971.log.gz 2023-07-14T13:33:40.738 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.1.43420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43420.log.gz 2023-07-14T13:33:40.739 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60119.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60119.log.gz 2023-07-14T13:33:40.739 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42366.log 2023-07-14T13:33:40.740 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52804.log 2023-07-14T13:33:40.740 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47389.log.gz 2023-07-14T13:33:40.740 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53351.log 2023-07-14T13:33:40.741 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42366.log.gz 2023-07-14T13:33:40.741 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52804.log: gzip 87.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.52804.log.gz --verbose 2023-07-14T13:33:40.742 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/ceph-client.admin.53128.log 2023-07-14T13:33:40.743 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50164.log 2023-07-14T13:33:40.743 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53351.log.gz 2023-07-14T13:33:40.744 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53128.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53128.log.gz 2023-07-14T13:33:40.744 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59698.log 2023-07-14T13:33:40.745 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50164.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50164.log.gz -5 2023-07-14T13:33:40.745 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.61515.log 2023-07-14T13:33:40.746 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59698.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59698.log.gz 2023-07-14T13:33:40.746 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51827.log 2023-07-14T13:33:40.747 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61515.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61515.log.gz 2023-07-14T13:33:40.747 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59313.log 2023-07-14T13:33:40.748 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51827.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51827.log.gz 2023-07-14T13:33:40.748 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61593.log 2023-07-14T13:33:40.749 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63529.log 88.0% 2023-07-14T13:33:40.749 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59313.log.gz 2023-07-14T13:33:40.750 INFO:teuthology.orchestra.run.smithi154.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-07-14T13:33:40.750 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61593.log: gzip 87.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.61593.log.gz 2023-07-14T13:33:40.751 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46438.log 2023-07-14T13:33:40.751 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63529.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.63529.log.gz 2023-07-14T13:33:40.751 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52210.log 2023-07-14T13:33:40.752 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46438.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46438.log.gz 2023-07-14T13:33:40.752 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49139.log 2023-07-14T13:33:40.753 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52210.log: gzip 88.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.52210.log.gz --verbose 2023-07-14T13:33:40.753 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/ceph-client.admin.42140.log 2023-07-14T13:33:40.754 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52052.log 2023-07-14T13:33:40.754 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49139.log.gz 2023-07-14T13:33:40.755 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42140.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42140.log.gz 2023-07-14T13:33:40.755 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54684.log 2023-07-14T13:33:40.756 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52052.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52052.log.gz 2023-07-14T13:33:40.756 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66076.log 2023-07-14T13:33:40.757 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63198.log 2023-07-14T13:33:40.757 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54684.log.gz 2023-07-14T13:33:40.758 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.66076.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.66076.log.gz 2023-07-14T13:33:40.758 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41870.log 2023-07-14T13:33:40.759 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63198.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.63198.log.gz 2023-07-14T13:33:40.759 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48839.log 2023-07-14T13:33:40.760 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41870.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41870.log.gz 2023-07-14T13:33:40.760 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60441.log 2023-07-14T13:33:40.761 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48839.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48839.log.gz 2023-07-14T13:33:40.761 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61239.log 2023-07-14T13:33:40.762 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49295.log 2023-07-14T13:33:40.762 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60441.log.gz 2023-07-14T13:33:40.763 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55332.log 88.2% 2023-07-14T13:33:40.763 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61239.log.gz 2023-07-14T13:33:40.764 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49295.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49295.log.gz 2023-07-14T13:33:40.764 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61411.log 2023-07-14T13:33:40.765 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55332.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55332.log.gz 2023-07-14T13:33:40.765 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51202.log 2023-07-14T13:33:40.766 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59750.log 2023-07-14T13:33:40.766 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61411.log.gz 2023-07-14T13:33:40.766 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51202.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.51202.log.gz 2023-07-14T13:33:40.767 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46875.log 2023-07-14T13:33:40.768 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56101.log 2023-07-14T13:33:40.768 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59750.log.gz 2023-07-14T13:33:40.769 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46875.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46875.log.gz 2023-07-14T13:33:40.769 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45699.log 2023-07-14T13:33:40.770 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54764.log 2023-07-14T13:33:40.770 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56101.log.gz 2023-07-14T13:33:40.771 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45699.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45699.log.gz 2023-07-14T13:33:40.771 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50334.log 2023-07-14T13:33:40.772 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57727.log 2023-07-14T13:33:40.773 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54764.log.gz 2023-07-14T13:33:40.773 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50334.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50334.log.gz 2023-07-14T13:33:40.774 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49514.log 2023-07-14T13:33:40.775 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57727.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57727.log.gz 2023-07-14T13:33:40.775 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47251.log 2023-07-14T13:33:40.776 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49514.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49514.log.gz 2023-07-14T13:33:40.776 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43066.log 2023-07-14T13:33:40.776 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47251.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47251.log.gz 2023-07-14T13:33:40.777 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53595.log 2023-07-14T13:33:40.778 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43066.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43066.log.gz 2023-07-14T13:33:40.778 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51006.log 2023-07-14T13:33:40.779 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53595.log: gzip 88.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.53595.log.gz 2023-07-14T13:33:40.779 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.54436.log 2023-07-14T13:33:40.780 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54227.log 2023-07-14T13:33:40.780 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51006.log.gz 2023-07-14T13:33:40.781 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54436.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54436.log.gz 2023-07-14T13:33:40.781 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58139.log 2023-07-14T13:33:40.782 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46086.log 2023-07-14T13:33:40.783 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54227.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54227.log.gz 2023-07-14T13:33:40.783 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58139.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58139.log.gz 2023-07-14T13:33:40.783 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66284.log 2023-07-14T13:33:40.784 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.46086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46086.log.gz 2023-07-14T13:33:40.784 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46270.log 2023-07-14T13:33:40.785 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.66284.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.66284.log.gz -5 2023-07-14T13:33:40.785 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47031.log 2023-07-14T13:33:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59933.log 2023-07-14T13:33:40.786 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46270.log.gz 2023-07-14T13:33:40.787 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42832.log 87.0% 2023-07-14T13:33:40.787 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47031.log.gz 2023-07-14T13:33:40.788 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48746.log 2023-07-14T13:33:40.788 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59933.log.gz 2023-07-14T13:33:40.789 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42832.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42832.log.gz 2023-07-14T13:33:40.790 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42362.log 2023-07-14T13:33:40.790 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48746.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48746.log.gz 2023-07-14T13:33:40.790 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54868.log 2023-07-14T13:33:40.791 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42362.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.42362.log.gz 2023-07-14T13:33:40.791 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42936.log 2023-07-14T13:33:40.792 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57597.log 2023-07-14T13:33:40.792 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54868.log.gz 2023-07-14T13:33:40.793 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42936.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42936.log.gz 2023-07-14T13:33:40.793 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52236.log 2023-07-14T13:33:40.794 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53843.log 2023-07-14T13:33:40.795 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57597.log.gz 2023-07-14T13:33:40.795 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52236.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52236.log.gz 2023-07-14T13:33:40.796 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47335.log 2023-07-14T13:33:40.796 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62734.log 2023-07-14T13:33:40.797 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53843.log.gz 2023-07-14T13:33:40.797 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52972.log 2023-07-14T13:33:40.798 INFO:teuthology.orchestra.run.smithi005.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47335.log.gz 2023-07-14T13:33:40.799 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54596.log 2023-07-14T13:33:40.799 INFO:teuthology.orchestra.run.smithi005.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.62734.log.gz 2023-07-14T13:33:40.799 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52972.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52972.log.gz 2023-07-14T13:33:40.800 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43844.log 2023-07-14T13:33:40.801 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51558.log 2023-07-14T13:33:40.801 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54596.log.gz 2023-07-14T13:33:40.802 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54658.log 2023-07-14T13:33:40.802 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43844.log.gz 2023-07-14T13:33:40.802 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.51558.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51558.log.gz 2023-07-14T13:33:40.803 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52359.log 2023-07-14T13:33:40.804 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60285.log 2023-07-14T13:33:40.804 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54658.log.gz 2023-07-14T13:33:40.805 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52359.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52359.log.gz 2023-07-14T13:33:40.805 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56688.log 2023-07-14T13:33:40.806 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59116.log 2023-07-14T13:33:40.806 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60285.log.gz 2023-07-14T13:33:40.807 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46901.log 2023-07-14T13:33:40.807 INFO:teuthology.orchestra.run.smithi005.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.56688.log.gz 2023-07-14T13:33:40.808 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59116.log: gzip -5 --verbose 88.5% -- /var/log/ceph/ceph-client.admin.57623.log -- replaced with /var/log/ceph/ceph-client.admin.59116.log.gz 2023-07-14T13:33:40.808 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-07-14T13:33:40.809 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45116.log 2023-07-14T13:33:40.809 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46901.log.gz 2023-07-14T13:33:40.810 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57623.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57623.log.gz 2023-07-14T13:33:40.810 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56986.log 2023-07-14T13:33:40.811 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54738.log 2023-07-14T13:33:40.811 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45116.log.gz 2023-07-14T13:33:40.812 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59672.log 2023-07-14T13:33:40.812 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56986.log.gz 2023-07-14T13:33:40.813 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42365.log 2023-07-14T13:33:40.813 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54738.log.gz 2023-07-14T13:33:40.813 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60634.log 2023-07-14T13:33:40.814 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59672.log.gz 2023-07-14T13:33:40.815 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42365.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42365.log.gz 2023-07-14T13:33:40.815 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56362.log 2023-07-14T13:33:40.816 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63782.log 2023-07-14T13:33:40.816 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60634.log.gz 2023-07-14T13:33:40.817 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56362.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56362.log.gz 2023-07-14T13:33:40.817 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57675.log 2023-07-14T13:33:40.818 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63782.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63782.log.gz 2023-07-14T13:33:40.818 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56767.log 2023-07-14T13:33:40.819 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57675.log: gzip -5 --verbose 87.7% -- -- replaced with /var/log/ceph/ceph-client.admin.57675.log.gz /var/log/ceph/ceph-client.admin.53973.log 2023-07-14T13:33:40.819 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-07-14T13:33:40.820 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56767.log: gzip -5 --verbose 87.9% -- -- replaced with /var/log/ceph/ceph-client.admin.56767.log.gz /var/log/ceph/ceph-client.admin.45881.log 2023-07-14T13:33:40.820 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-07-14T13:33:40.821 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57928.log 2023-07-14T13:33:40.821 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53973.log.gz 2023-07-14T13:33:40.822 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44270.log 2023-07-14T13:33:40.822 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45881.log.gz 2023-07-14T13:33:40.823 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48165.log 88.6% 2023-07-14T13:33:40.823 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57928.log.gz 2023-07-14T13:33:40.824 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42141.log 2023-07-14T13:33:40.824 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44270.log.gz 2023-07-14T13:33:40.825 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48681.log 2023-07-14T13:33:40.825 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48165.log.gz 2023-07-14T13:33:40.826 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61872.log 2023-07-14T13:33:40.826 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42141.log.gz 2023-07-14T13:33:40.827 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64424.log 2023-07-14T13:33:40.827 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48681.log.gz 2023-07-14T13:33:40.828 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61187.log 2023-07-14T13:33:40.828 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61872.log.gz 2023-07-14T13:33:40.829 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64424.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64424.log.gz 2023-07-14T13:33:40.829 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64681.log 2023-07-14T13:33:40.830 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61187.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.61187.log.gz 2023-07-14T13:33:40.830 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42150.log 2023-07-14T13:33:40.831 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.64681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64681.log.gz 2023-07-14T13:33:40.831 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55664.log 2023-07-14T13:33:40.832 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62276.log 2023-07-14T13:33:40.832 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42150.log.gz 2023-07-14T13:33:40.833 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54051.log 2023-07-14T13:33:40.833 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55664.log.gz 2023-07-14T13:33:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62276.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-07-14T13:33:40.834 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62276.log.gz 2023-07-14T13:33:40.835 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44166.log 2023-07-14T13:33:40.835 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54051.log.gz 2023-07-14T13:33:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56416.log 2023-07-14T13:33:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59287.log 2023-07-14T13:33:40.837 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44166.log.gz 2023-07-14T13:33:40.838 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56416.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56416.log.gz 2023-07-14T13:33:40.838 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66310.log 2023-07-14T13:33:40.839 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59287.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59287.log.gz 2023-07-14T13:33:40.839 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47806.log 2023-07-14T13:33:40.840 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.66310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60660.log 2023-07-14T13:33:40.841 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66310.log.gz 2023-07-14T13:33:40.841 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47806.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47806.log.gz 2023-07-14T13:33:40.842 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61619.log 2023-07-14T13:33:40.843 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60660.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60660.log.gzgzip 2023-07-14T13:33:40.843 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48813.log 2023-07-14T13:33:40.844 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61619.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61619.log.gz 2023-07-14T13:33:40.844 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42158.log 2023-07-14T13:33:40.845 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48813.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48813.log.gz 2023-07-14T13:33:40.845 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52646.log 2023-07-14T13:33:40.846 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63281.log 2023-07-14T13:33:40.846 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42158.log.gz 2023-07-14T13:33:40.847 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52646.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52646.log.gz 2023-07-14T13:33:40.847 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66232.log 2023-07-14T13:33:40.849 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63281.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63281.log.gz 2023-07-14T13:33:40.849 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56388.log 2023-07-14T13:33:40.850 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.66232.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66232.log.gz 2023-07-14T13:33:40.850 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65052.log 2023-07-14T13:33:40.851 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56388.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56388.log.gz 2023-07-14T13:33:40.851 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63886.log 2023-07-14T13:33:40.851 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65052.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65052.log.gz 2023-07-14T13:33:40.852 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60091.log 2023-07-14T13:33:40.853 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63886.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63886.log.gz 2023-07-14T13:33:40.853 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46232.log 2023-07-14T13:33:40.854 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60091.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60091.log.gz 2023-07-14T13:33:40.854 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57753.log 2023-07-14T13:33:40.855 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46232.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46232.log.gz 2023-07-14T13:33:40.855 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52130.log 2023-07-14T13:33:40.856 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57753.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.57753.log.gz 2023-07-14T13:33:40.856 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64676.log 2023-07-14T13:33:40.857 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52130.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52130.log.gz 2023-07-14T13:33:40.857 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57545.log 2023-07-14T13:33:40.858 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.64676.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64676.log.gz 2023-07-14T13:33:40.858 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65195.log 2023-07-14T13:33:40.859 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57545.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.57545.log.gz 2023-07-14T13:33:40.859 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58013.log 2023-07-14T13:33:40.860 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65195.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65195.log.gz 2023-07-14T13:33:40.861 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51462.log 2023-07-14T13:33:40.861 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58013.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58013.log.gz 2023-07-14T13:33:40.862 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59523.log 2023-07-14T13:33:40.863 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52998.log 2023-07-14T13:33:40.863 INFO:teuthology.orchestra.run.smithi005.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.51462.log.gz 2023-07-14T13:33:40.864 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59523.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59523.log.gz 2023-07-14T13:33:40.864 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65790.log 2023-07-14T13:33:40.865 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52998.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52998.log.gz 2023-07-14T13:33:40.865 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44804.log 2023-07-14T13:33:40.866 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65790.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.65790.log.gz 2023-07-14T13:33:40.866 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57466.log 2023-07-14T13:33:40.867 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44804.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44804.log.gz 2023-07-14T13:33:40.867 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60926.log 2023-07-14T13:33:40.868 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57466.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57466.log.gz 2023-07-14T13:33:40.868 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65326.log 2023-07-14T13:33:40.869 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60926.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60926.log.gz 2023-07-14T13:33:40.870 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64150.log 2023-07-14T13:33:40.870 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65326.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65326.log.gz 2023-07-14T13:33:40.871 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66206.log 2023-07-14T13:33:40.872 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64150.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64150.log.gz 2023-07-14T13:33:40.872 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45669.log 2023-07-14T13:33:40.873 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.66206.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66206.log.gz 2023-07-14T13:33:40.873 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44960.log 2023-07-14T13:33:40.874 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45669.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45669.log.gz 2023-07-14T13:33:40.874 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-07-14T13:33:40.875 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44960.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44960.log.gz 2023-07-14T13:33:40.875 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58621.log 2023-07-14T13:33:40.876 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56941.log 2023-07-14T13:33:40.877 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58621.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58621.log.gz 2023-07-14T13:33:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56127.log 2023-07-14T13:33:40.878 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.56941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56941.log.gz 2023-07-14T13:33:40.879 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55969.log 2023-07-14T13:33:40.880 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56127.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56127.log.gz 2023-07-14T13:33:40.880 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48218.log 2023-07-14T13:33:40.882 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42026.log 2023-07-14T13:33:40.882 INFO:teuthology.orchestra.run.smithi005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55969.log.gz 2023-07-14T13:33:40.883 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48218.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48218.log.gz 2023-07-14T13:33:40.883 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63808.log 2023-07-14T13:33:40.884 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42026.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42026.log.gz 2023-07-14T13:33:40.885 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55611.log 2023-07-14T13:33:40.886 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63808.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63808.log.gz 2023-07-14T13:33:40.887 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42754.log 2023-07-14T13:33:40.887 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55611.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55611.log.gz 2023-07-14T13:33:40.888 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59194.log 2023-07-14T13:33:40.889 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65868.log 2023-07-14T13:33:40.889 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42754.log.gz 2023-07-14T13:33:40.890 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59194.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59194.log.gz 2023-07-14T13:33:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58699.log 2023-07-14T13:33:40.892 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53764.log 2023-07-14T13:33:40.892 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65868.log.gz 2023-07-14T13:33:40.893 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58699.log: gzip -5 --verbose -- 91.0% /var/log/ceph/ceph-client.admin.53869.log 2023-07-14T13:33:40.893 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58699.log.gz 2023-07-14T13:33:40.894 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42000.log 2023-07-14T13:33:40.895 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53764.log.gz 2023-07-14T13:33:40.896 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49165.log 2023-07-14T13:33:40.896 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53869.log.gz 2023-07-14T13:33:40.897 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42000.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42000.log.gz 2023-07-14T13:33:40.897 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64072.log 2023-07-14T13:33:40.898 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64502.log 2023-07-14T13:33:40.898 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49165.log.gz 2023-07-14T13:33:40.899 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64072.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64072.log.gz 2023-07-14T13:33:40.900 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61463.log 2023-07-14T13:33:40.901 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64502.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64502.log.gz 2023-07-14T13:33:40.901 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42562.log 2023-07-14T13:33:40.902 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59260.log 2023-07-14T13:33:40.902 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61463.log.gz 2023-07-14T13:33:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42562.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42562.log.gz 2023-07-14T13:33:40.903 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53236.log 2023-07-14T13:33:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59260.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59260.log.gz 2023-07-14T13:33:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48270.log 2023-07-14T13:33:40.905 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59142.log 2023-07-14T13:33:40.906 INFO:teuthology.orchestra.run.smithi005.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53236.log.gz 2023-07-14T13:33:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48270.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48270.log.gz 2023-07-14T13:33:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52489.log 2023-07-14T13:33:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59142.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59142.log.gz 2023-07-14T13:33:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50282.log 2023-07-14T13:33:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52489.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52489.log.gz 2023-07-14T13:33:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51906.log 2023-07-14T13:33:40.909 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50282.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50282.log.gz 2023-07-14T13:33:40.910 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62592.log 2023-07-14T13:33:40.911 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51906.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51906.log.gz 2023-07-14T13:33:40.911 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61846.log 2023-07-14T13:33:40.912 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44380.log 2023-07-14T13:33:40.912 INFO:teuthology.orchestra.run.smithi005.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.62592.log.gz 2023-07-14T13:33:40.913 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61846.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61846.log.gz 2023-07-14T13:33:40.913 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43974.log 2023-07-14T13:33:40.914 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44380.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44380.log.gz 2023-07-14T13:33:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60179.log 2023-07-14T13:33:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43974.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43974.log.gz 2023-07-14T13:33:40.916 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65946.log 2023-07-14T13:33:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60179.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60179.log.gz 2023-07-14T13:33:40.917 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54568.log 2023-07-14T13:33:40.918 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65946.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65946.log.gz 2023-07-14T13:33:40.918 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42364.log 2023-07-14T13:33:40.919 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54568.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54568.log.gz 2023-07-14T13:33:40.919 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55275.log 2023-07-14T13:33:40.920 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42364.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42364.log.gz 2023-07-14T13:33:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55048.log 2023-07-14T13:33:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55275.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55275.log.gz 2023-07-14T13:33:40.922 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65659.log 2023-07-14T13:33:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55048.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55048.log.gz 2023-07-14T13:33:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62356.log 2023-07-14T13:33:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65659.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65659.log.gz 2023-07-14T13:33:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58749.log 2023-07-14T13:33:40.925 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62356.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62356.log.gz 2023-07-14T13:33:40.925 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48428.log 2023-07-14T13:33:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58749.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58749.log.gz 2023-07-14T13:33:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46081.log 2023-07-14T13:33:40.927 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48428.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48428.log.gz 2023-07-14T13:33:40.927 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48322.log 2023-07-14T13:33:40.928 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.46081.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46081.log.gz 2023-07-14T13:33:40.928 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57649.log 2023-07-14T13:33:40.929 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48322.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48322.log.gz 2023-07-14T13:33:40.930 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42806.log 2023-07-14T13:33:40.931 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57649.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57649.log.gz 2023-07-14T13:33:40.931 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50256.log 2023-07-14T13:33:40.932 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42806.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42806.log.gz 2023-07-14T13:33:40.932 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62566.log 2023-07-14T13:33:40.933 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50256.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50256.log.gz 2023-07-14T13:33:40.933 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41656.log 2023-07-14T13:33:40.934 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62566.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62566.log.gz 2023-07-14T13:33:40.934 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52918.log 2023-07-14T13:33:40.935 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41656.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41656.log.gz 2023-07-14T13:33:40.935 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62330.log 2023-07-14T13:33:40.936 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52918.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52918.log.gz 2023-07-14T13:33:40.936 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64630.log 2023-07-14T13:33:40.937 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62330.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62330.log.gz 2023-07-14T13:33:40.938 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58299.log 2023-07-14T13:33:40.939 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64630.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64630.log.gz 2023-07-14T13:33:40.939 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65026.log 2023-07-14T13:33:40.940 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58299.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.58299.log.gz 2023-07-14T13:33:40.940 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49321.log 2023-07-14T13:33:40.941 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65026.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.65026.log.gz 2023-07-14T13:33:40.941 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47363.log 2023-07-14T13:33:40.942 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49321.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49321.log.gz 2023-07-14T13:33:40.943 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60686.log 2023-07-14T13:33:40.943 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47363.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47363.log.gz 2023-07-14T13:33:40.943 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45142.log 2023-07-14T13:33:40.944 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60686.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.60686.log.gz 2023-07-14T13:33:40.944 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59497.log 2023-07-14T13:33:40.945 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45142.log: gzip 88.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.45142.log.gz --verbose 2023-07-14T13:33:40.945 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/ceph-client.admin.45064.log 2023-07-14T13:33:40.947 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59497.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59497.log.gz 2023-07-14T13:33:40.947 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56960.log 2023-07-14T13:33:40.948 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45064.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45064.log.gz 2023-07-14T13:33:40.948 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.32585.log 2023-07-14T13:33:40.949 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56960.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56960.log.gz 2023-07-14T13:33:40.949 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45371.log 2023-07-14T13:33:40.950 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.tmp-client.admin.32585.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.32585.log.gz 2023-07-14T13:33:40.950 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58543.log 2023-07-14T13:33:40.952 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45371.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45371.log.gz 2023-07-14T13:33:40.952 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57349.log 2023-07-14T13:33:40.954 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58543.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58543.log.gz 2023-07-14T13:33:40.954 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53377.log 2023-07-14T13:33:40.954 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60802.log 2023-07-14T13:33:40.955 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57349.log.gz 2023-07-14T13:33:40.955 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53377.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53377.log.gz 2023-07-14T13:33:40.955 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48629.log 2023-07-14T13:33:40.956 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60802.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60802.log.gz 2023-07-14T13:33:40.956 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60205.log 2023-07-14T13:33:40.957 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48629.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48629.log.gz 2023-07-14T13:33:40.957 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44700.log 2023-07-14T13:33:40.958 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60205.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60205.log.gz 2023-07-14T13:33:40.959 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58243.log 2023-07-14T13:33:40.960 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44700.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44700.log.gz 2023-07-14T13:33:40.960 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45241.log 2023-07-14T13:33:40.961 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58243.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58243.log.gz 2023-07-14T13:33:40.961 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42559.log 2023-07-14T13:33:40.962 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45241.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45241.log.gz 2023-07-14T13:33:40.962 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55113.log 2023-07-14T13:33:40.963 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42559.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42559.log.gz 2023-07-14T13:33:40.963 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46979.log 2023-07-14T13:33:40.964 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55113.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55113.log.gz 2023-07-14T13:33:40.964 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64826.log 2023-07-14T13:33:40.965 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46979.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46979.log.gz 2023-07-14T13:33:40.965 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65484.log 2023-07-14T13:33:40.966 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64826.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64826.log.gz 2023-07-14T13:33:40.967 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60736.log 2023-07-14T13:33:40.967 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65484.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65484.log.gz 2023-07-14T13:33:40.968 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46572.log 2023-07-14T13:33:40.968 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60736.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60736.log.gz 2023-07-14T13:33:40.969 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64748.log 2023-07-14T13:33:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46572.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46572.log.gz 2023-07-14T13:33:40.970 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64344.log 2023-07-14T13:33:40.971 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64748.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.64748.log.gz 2023-07-14T13:33:40.971 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53647.log 2023-07-14T13:33:40.972 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64344.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64344.log.gz 2023-07-14T13:33:40.972 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56258.log 2023-07-14T13:33:40.973 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53647.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53647.log.gz 2023-07-14T13:33:40.974 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57323.log 2023-07-14T13:33:40.975 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62029.log 2023-07-14T13:33:40.975 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56258.log.gz 2023-07-14T13:33:40.976 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62304.log 2023-07-14T13:33:40.976 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57323.log.gz 2023-07-14T13:33:40.976 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62029.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62029.log.gz 2023-07-14T13:33:40.977 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55139.log 2023-07-14T13:33:40.978 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62304.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62304.log.gz 2023-07-14T13:33:40.978 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56819.log 2023-07-14T13:33:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55139.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55139.log.gz 2023-07-14T13:33:40.979 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55716.log 2023-07-14T13:33:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56819.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56819.log.gz 2023-07-14T13:33:40.980 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53158.log 2023-07-14T13:33:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55716.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55716.log.gz 2023-07-14T13:33:40.981 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59090.log 2023-07-14T13:33:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53158.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53158.log.gz 2023-07-14T13:33:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61037.log 2023-07-14T13:33:40.983 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59090.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59090.log.gz 2023-07-14T13:33:40.984 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45501.log 2023-07-14T13:33:40.985 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61037.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61037.log.gz 2023-07-14T13:33:40.985 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60569.log 2023-07-14T13:33:40.986 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53102.log 2023-07-14T13:33:40.986 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45501.log.gz 2023-07-14T13:33:40.987 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60569.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60569.log.gz 2023-07-14T13:33:40.987 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53999.log 2023-07-14T13:33:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53102.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53102.log.gz 2023-07-14T13:33:40.988 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57824.log 2023-07-14T13:33:40.989 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53999.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53999.log.gz 2023-07-14T13:33:40.989 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50561.log 2023-07-14T13:33:40.990 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57824.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.57824.log.gz 2023-07-14T13:33:40.991 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66102.log 2023-07-14T13:33:40.992 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50561.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50561.log.gz 2023-07-14T13:33:40.993 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61958.log 2023-07-14T13:33:40.994 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.66102.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66102.log.gz 2023-07-14T13:33:40.994 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52437.log 2023-07-14T13:33:40.996 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61958.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61958.log.gz 2023-07-14T13:33:40.996 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65354.log 2023-07-14T13:33:40.997 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52437.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52437.log.gz 2023-07-14T13:33:40.997 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59227.log 2023-07-14T13:33:40.998 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65354.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65354.log.gz 2023-07-14T13:33:40.999 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60493.log 2023-07-14T13:33:41.000 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59227.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59227.log.gz 2023-07-14T13:33:41.001 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41577.log 2023-07-14T13:33:41.002 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60493.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60493.log.gz 2023-07-14T13:33:41.002 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52946.log 2023-07-14T13:33:41.003 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41577.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41577.log.gz 2023-07-14T13:33:41.004 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54149.log 2023-07-14T13:33:41.005 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52946.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52946.log.gz 2023-07-14T13:33:41.005 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61291.log 2023-07-14T13:33:41.007 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60259.log 2023-07-14T13:33:41.007 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54149.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54149.log.gz 2023-07-14T13:33:41.008 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61291.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61291.log.gz 2023-07-14T13:33:41.008 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37672.log 2023-07-14T13:33:41.010 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47083.log 2023-07-14T13:33:41.010 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60259.log.gz 2023-07-14T13:33:41.011 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37672.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37672.log.gz 2023-07-14T13:33:41.011 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63659.log 2023-07-14T13:33:41.012 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47083.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47083.log.gz 2023-07-14T13:33:41.013 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66024.log 2023-07-14T13:33:41.014 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63659.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63659.log.gz 2023-07-14T13:33:41.015 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56895.log 2023-07-14T13:33:41.016 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.66024.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66024.log.gz 2023-07-14T13:33:41.016 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44106.log 2023-07-14T13:33:41.017 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56895.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56895.log.gz 2023-07-14T13:33:41.018 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59445.log 2023-07-14T13:33:41.019 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44106.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44106.log.gz 2023-07-14T13:33:41.019 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49976.log 2023-07-14T13:33:41.020 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59445.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59445.log.gz 2023-07-14T13:33:41.021 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62134.log 2023-07-14T13:33:41.022 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49976.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49976.log.gz 2023-07-14T13:33:41.022 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61099.log 2023-07-14T13:33:41.024 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62134.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62134.log.gz 2023-07-14T13:33:41.024 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41429.log 2023-07-14T13:33:41.025 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61099.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61099.log.gz 2023-07-14T13:33:41.026 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56530.log 2023-07-14T13:33:41.028 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41429.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41429.log.gz 2023-07-14T13:33:41.028 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58113.log 2023-07-14T13:33:41.029 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56530.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56530.log.gz 2023-07-14T13:33:41.029 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43818.log 2023-07-14T13:33:41.030 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58113.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58113.log.gz 2023-07-14T13:33:41.031 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64476.log 2023-07-14T13:33:41.033 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43818.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43818.log.gz 2023-07-14T13:33:41.033 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43196.log 2023-07-14T13:33:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64476.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-07-14T13:33:41.034 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64476.log.gz 2023-07-14T13:33:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51708.log 2023-07-14T13:33:41.036 INFO:teuthology.orchestra.run.smithi005.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.43196.log.gz 2023-07-14T13:33:41.037 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57124.log 2023-07-14T13:33:41.039 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46520.log 2023-07-14T13:33:41.039 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51708.log.gz 2023-07-14T13:33:41.040 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57124.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57124.log.gz 2023-07-14T13:33:41.041 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46126.log 2023-07-14T13:33:41.042 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51176.log 2023-07-14T13:33:41.042 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46520.log.gz 2023-07-14T13:33:41.043 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46126.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46126.log.gz 2023-07-14T13:33:41.044 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55358.log 2023-07-14T13:33:41.045 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58945.log 2023-07-14T13:33:41.045 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51176.log.gz 2023-07-14T13:33:41.046 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55358.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55358.log.gz 2023-07-14T13:33:41.047 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41454.log 2023-07-14T13:33:41.048 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55768.log 2023-07-14T13:33:41.048 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58945.log.gz 2023-07-14T13:33:41.049 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41454.log: gzip -5 --verbose 88.0% -- -- replaced with /var/log/ceph/ceph-client.admin.41454.log.gz /var/log/ceph/ceph-client.admin.45475.log 2023-07-14T13:33:41.049 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-07-14T13:33:41.050 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43118.log 2023-07-14T13:33:41.051 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55768.log.gz 2023-07-14T13:33:41.052 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51034.log 2023-07-14T13:33:41.053 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45475.log.gz 2023-07-14T13:33:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50980.log 2023-07-14T13:33:41.054 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43118.log.gz 2023-07-14T13:33:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62872.log 2023-07-14T13:33:41.055 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51034.log.gz 2023-07-14T13:33:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44674.log 2023-07-14T13:33:41.057 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50980.log.gz 2023-07-14T13:33:41.058 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44192.log 2023-07-14T13:33:41.059 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62872.log.gz 2023-07-14T13:33:41.060 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52620.log 2023-07-14T13:33:41.060 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44674.log.gz 2023-07-14T13:33:41.061 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46624.log 2023-07-14T13:33:41.061 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44192.log.gz 2023-07-14T13:33:41.062 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41948.log 2023-07-14T13:33:41.063 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52620.log.gz 2023-07-14T13:33:41.064 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46624.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46624.log.gz 2023-07-14T13:33:41.064 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56444.log 2023-07-14T13:33:41.065 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48402.log 2023-07-14T13:33:41.065 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41948.log.gz 2023-07-14T13:33:41.066 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62162.log 2023-07-14T13:33:41.067 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56444.log.gz 2023-07-14T13:33:41.068 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43256.log 2023-07-14T13:33:41.069 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48402.log.gz 2023-07-14T13:33:41.070 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56049.log 2023-07-14T13:33:41.070 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62162.log.gz 2023-07-14T13:33:41.071 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42884.log 2023-07-14T13:33:41.072 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43256.log.gz 2023-07-14T13:33:41.073 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54998.log 2023-07-14T13:33:41.073 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56049.log.gz 2023-07-14T13:33:41.075 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42884.log: gzip -5 --verbose 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42884.log.gz 2023-07-14T13:33:41.075 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/ceph-client.admin.58916.log 2023-07-14T13:33:41.077 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48655.log 2023-07-14T13:33:41.077 INFO:teuthology.orchestra.run.smithi005.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.54998.log.gz 2023-07-14T13:33:41.077 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58916.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58916.log.gz 2023-07-14T13:33:41.078 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55546.log 2023-07-14T13:33:41.080 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48655.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48655.log.gz 2023-07-14T13:33:41.080 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42780.log 2023-07-14T13:33:41.081 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55546.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55546.log.gz 2023-07-14T13:33:41.082 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59985.log 2023-07-14T13:33:41.083 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42780.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42780.log.gz 2023-07-14T13:33:41.084 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62898.log 2023-07-14T13:33:41.085 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59985.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59985.log.gz 2023-07-14T13:33:41.086 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62688.log 2023-07-14T13:33:41.087 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62898.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62898.log.gz 2023-07-14T13:33:41.087 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63860.log 2023-07-14T13:33:41.088 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.62688.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62688.log.gz 2023-07-14T13:33:41.089 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43170.log 2023-07-14T13:33:41.090 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63860.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63860.log.gz 2023-07-14T13:33:41.091 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48577.log 2023-07-14T13:33:41.092 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43170.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43170.log.gz 2023-07-14T13:33:41.093 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58439.log 2023-07-14T13:33:41.095 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48577.log: gzip 89.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.56845.log 2023-07-14T13:33:41.095 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48577.log.gz 2023-07-14T13:33:41.096 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64554.log 2023-07-14T13:33:41.097 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58439.log.gz 2023-07-14T13:33:41.098 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55520.log 2023-07-14T13:33:41.099 INFO:teuthology.orchestra.run.smithi005.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.56845.log.gz 2023-07-14T13:33:41.102 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64554.log: gzip -5 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64554.log.gz 2023-07-14T13:33:41.103 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45751.log 2023-07-14T13:33:41.103 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55520.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55520.log.gz 2023-07-14T13:33:41.103 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65738.log 2023-07-14T13:33:41.107 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45751.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45751.log.gz 2023-07-14T13:33:41.107 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45617.log 2023-07-14T13:33:41.108 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65738.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65738.log.gz 2023-07-14T13:33:41.108 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48551.log 2023-07-14T13:33:41.108 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45617.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45617.log.gz 2023-07-14T13:33:41.108 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65274.log 2023-07-14T13:33:41.109 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48551.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48551.log.gz 2023-07-14T13:33:41.109 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57440.log 2023-07-14T13:33:41.111 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65274.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.65274.log.gz 2023-07-14T13:33:41.111 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53921.log 2023-07-14T13:33:41.112 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57440.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57440.log.gz 2023-07-14T13:33:41.112 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46728.log 2023-07-14T13:33:41.113 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53921.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53921.log.gz 2023-07-14T13:33:41.114 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42155.log 2023-07-14T13:33:41.116 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46728.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46728.log.gz 2023-07-14T13:33:41.116 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45090.log 2023-07-14T13:33:41.117 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42155.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42155.log.gz 2023-07-14T13:33:41.118 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60389.log 2023-07-14T13:33:41.118 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45090.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45090.log.gz 2023-07-14T13:33:41.119 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53024.log 2023-07-14T13:33:41.121 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60389.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60389.log.gz 2023-07-14T13:33:41.121 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60900.log 2023-07-14T13:33:41.122 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53024.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53024.log.gz 2023-07-14T13:33:41.123 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44140.log 2023-07-14T13:33:41.124 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60900.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60900.log.gz 2023-07-14T13:33:41.126 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48865.log 2023-07-14T13:33:41.126 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44140.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44140.log.gz 2023-07-14T13:33:41.127 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54025.log 2023-07-14T13:33:41.128 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48865.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48865.log.gz 2023-07-14T13:33:41.129 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56192.log 2023-07-14T13:33:41.129 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54025.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54025.log.gz 2023-07-14T13:33:41.130 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52750.log 2023-07-14T13:33:41.131 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56192.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56192.log.gz 2023-07-14T13:33:41.132 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-07-14T13:33:41.133 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52750.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52750.log.gz 2023-07-14T13:33:41.134 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42352.log 2023-07-14T13:33:41.136 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48192.log 2023-07-14T13:33:41.137 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42352.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42352.log.gz 2023-07-14T13:33:41.138 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46927.log 2023-07-14T13:33:41.139 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48192.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48192.log.gz 2023-07-14T13:33:41.140 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44908.log 2023-07-14T13:33:41.141 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46927.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46927.log.gz 2023-07-14T13:33:41.141 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60311.log 2023-07-14T13:33:41.142 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44908.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44908.log.gz 2023-07-14T13:33:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42560.log 2023-07-14T13:33:41.144 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60311.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60311.log.gz 2023-07-14T13:33:41.145 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55494.log 2023-07-14T13:33:41.146 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42560.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42560.log.gz 2023-07-14T13:33:41.147 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65633.log 2023-07-14T13:33:41.148 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55494.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55494.log.gz 2023-07-14T13:33:41.148 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53569.log 2023-07-14T13:33:41.149 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65633.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.65633.log.gz 2023-07-14T13:33:41.150 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57375.log 2023-07-14T13:33:41.151 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53569.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53569.log.gz 2023-07-14T13:33:41.152 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51853.log 2023-07-14T13:33:41.153 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57375.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57375.log.gz 2023-07-14T13:33:41.154 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42910.log 2023-07-14T13:33:41.155 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51853.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51853.log.gz 2023-07-14T13:33:41.156 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44487.log 2023-07-14T13:33:41.156 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42910.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42910.log.gz 2023-07-14T13:33:41.158 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44726.log 2023-07-14T13:33:41.159 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44487.log: 89.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.44487.log.gz 2023-07-14T13:33:41.159 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54096.log 2023-07-14T13:33:41.160 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61159.log 88.3% 2023-07-14T13:33:41.160 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44726.log.gz 2023-07-14T13:33:41.162 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51148.log 2023-07-14T13:33:41.162 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54096.log.gz 2023-07-14T13:33:41.164 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48073.log 2023-07-14T13:33:41.164 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61159.log.gz 2023-07-14T13:33:41.165 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37547.log 2023-07-14T13:33:41.165 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51148.log.gz 2023-07-14T13:33:41.166 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48073.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48073.log.gz -5 2023-07-14T13:33:41.167 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.58191.log 2023-07-14T13:33:41.168 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37547.log: gzip 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37547.log.gz -5 2023-07-14T13:33:41.168 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50203.log 2023-07-14T13:33:41.169 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58191.log: gzip 88.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.58191.log.gz --verbose 2023-07-14T13:33:41.170 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/ceph-client.admin.44028.log 2023-07-14T13:33:41.171 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45985.log 2023-07-14T13:33:41.171 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50203.log.gz 2023-07-14T13:33:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44028.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45293.log 2023-07-14T13:33:41.172 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44028.log.gz 2023-07-14T13:33:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59391.log 2023-07-14T13:33:41.174 INFO:teuthology.orchestra.run.smithi005.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45985.log.gz 2023-07-14T13:33:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48917.log 2023-07-14T13:33:41.175 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45293.log.gz 2023-07-14T13:33:41.177 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44830.log 2023-07-14T13:33:41.178 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48917.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59391.log.gz 2023-07-14T13:33:41.179 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59365.log 2023-07-14T13:33:41.179 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48917.log.gz 2023-07-14T13:33:41.180 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46598.log 2023-07-14T13:33:41.180 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44830.log.gz 2023-07-14T13:33:41.181 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59365.log: gzip 86.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.59365.log.gz --verbose 2023-07-14T13:33:41.182 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/ceph-client.admin.44513.log 2023-07-14T13:33:41.183 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46598.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65104.log 2023-07-14T13:33:41.183 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46598.log.gz 2023-07-14T13:33:41.185 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63834.log 2023-07-14T13:33:41.185 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44513.log.gz 2023-07-14T13:33:41.186 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57902.log 2023-07-14T13:33:41.187 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63834.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.65104.log.gz 2023-07-14T13:33:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64370.log 2023-07-14T13:33:41.188 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63834.log.gz 2023-07-14T13:33:41.188 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57902.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57902.log.gz 2023-07-14T13:33:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45267.log 2023-07-14T13:33:41.191 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44934.log 2023-07-14T13:33:41.191 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64370.log.gz 2023-07-14T13:33:41.192 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49217.log 2023-07-14T13:33:41.192 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45267.log.gz 2023-07-14T13:33:41.194 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47057.log 2023-07-14T13:33:41.194 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44934.log.gz 2023-07-14T13:33:41.195 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49217.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49217.log.gz 2023-07-14T13:33:41.196 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55416.log 2023-07-14T13:33:41.197 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47057.log: 87.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63385.log 2023-07-14T13:33:41.197 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47057.log.gz 2023-07-14T13:33:41.199 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45777.log 2023-07-14T13:33:41.199 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55416.log.gz 2023-07-14T13:33:41.201 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.43486.log 2023-07-14T13:33:41.202 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45777.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63385.log.gz 2023-07-14T13:33:41.202 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45777.log.gz 2023-07-14T13:33:41.203 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50691.log 2023-07-14T13:33:41.203 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.2.43486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.43486.log.gz 2023-07-14T13:33:41.204 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42052.log 2023-07-14T13:33:41.205 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58517.log 2023-07-14T13:33:41.205 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50691.log.gz 2023-07-14T13:33:41.207 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44986.log 2023-07-14T13:33:41.207 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42052.log.gz 2023-07-14T13:33:41.208 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53286.log 2023-07-14T13:33:41.209 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58517.log.gz 2023-07-14T13:33:41.210 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44986.log: gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44986.log.gz -5 2023-07-14T13:33:41.210 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.62108.log 2023-07-14T13:33:41.211 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53286.log: 89.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53817.log 2023-07-14T13:33:41.212 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53286.log.gz 2023-07-14T13:33:41.213 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52411.log 2023-07-14T13:33:41.213 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62108.log.gz 2023-07-14T13:33:41.215 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59776.log 2023-07-14T13:33:41.215 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52411.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.53817.log.gz 2023-07-14T13:33:41.216 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63685.log 2023-07-14T13:33:41.216 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52411.log.gz 2023-07-14T13:33:41.218 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59776.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64098.log 2023-07-14T13:33:41.218 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59776.log.gz 2023-07-14T13:33:41.219 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55794.log 2023-07-14T13:33:41.219 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.63685.log.gz 2023-07-14T13:33:41.221 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46546.log 2023-07-14T13:33:41.221 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55794.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64098.log.gz 2023-07-14T13:33:41.222 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58795.log 2023-07-14T13:33:41.222 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55794.log.gz 2023-07-14T13:33:41.223 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46546.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46546.log.gz 2023-07-14T13:33:41.225 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50928.log 2023-07-14T13:33:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.58795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58795.log.gz 2023-07-14T13:33:41.226 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55742.log 2023-07-14T13:33:41.228 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50928.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61385.log 2023-07-14T13:33:41.228 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50928.log.gz 2023-07-14T13:33:41.229 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50034.log 2023-07-14T13:33:41.229 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55742.log.gz 2023-07-14T13:33:41.231 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54514.log 2023-07-14T13:33:41.232 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50034.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61385.log.gz 2023-07-14T13:33:41.232 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63424.log 2023-07-14T13:33:41.233 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50034.log.gz 2023-07-14T13:33:41.234 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46326.log 2023-07-14T13:33:41.234 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54514.log.gz 2023-07-14T13:33:41.236 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58800.log 2023-07-14T13:33:41.236 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46326.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.63424.log.gz 2023-07-14T13:33:41.237 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51332.log 2023-07-14T13:33:41.237 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46326.log.gz 2023-07-14T13:33:41.238 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.58800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58800.log.gz 2023-07-14T13:33:41.239 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43014.log 2023-07-14T13:33:41.240 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51332.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62382.log 2023-07-14T13:33:41.240 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51332.log.gz 2023-07-14T13:33:41.241 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43014.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43014.log.gz 2023-07-14T13:33:41.241 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54920.log 2023-07-14T13:33:41.243 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60153.log 2023-07-14T13:33:41.244 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62382.log.gz 2023-07-14T13:33:41.245 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62055.log 2023-07-14T13:33:41.245 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54920.log.gz 2023-07-14T13:33:41.247 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44461.log 2023-07-14T13:33:41.247 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60153.log.gz 2023-07-14T13:33:41.249 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50902.log 2023-07-14T13:33:41.249 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62055.log.gz 2023-07-14T13:33:41.250 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64722.log 2023-07-14T13:33:41.250 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50902.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44461.log.gz 2023-07-14T13:33:41.251 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43399.log 2023-07-14T13:33:41.251 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50902.log.gz 2023-07-14T13:33:41.252 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46702.log 2023-07-14T13:33:41.253 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64722.log.gz 2023-07-14T13:33:41.253 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43399.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43399.log.gz 2023-07-14T13:33:41.254 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57271.log 2023-07-14T13:33:41.256 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50464.log 2023-07-14T13:33:41.256 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46702.log.gz 2023-07-14T13:33:41.257 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57271.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57571.log 2023-07-14T13:33:41.257 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57271.log.gz 2023-07-14T13:33:41.258 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50464.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50464.log.gz 2023-07-14T13:33:41.259 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44752.log 2023-07-14T13:33:41.261 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53479.log 2023-07-14T13:33:41.265 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44752.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57571.log.gz 2023-07-14T13:33:41.265 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62540.log 2023-07-14T13:33:41.265 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44752.log.gz 2023-07-14T13:33:41.266 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46410.log 2023-07-14T13:33:41.266 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53479.log.gz 2023-07-14T13:33:41.267 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51880.log 2023-07-14T13:33:41.267 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62540.log.gz 2023-07-14T13:33:41.268 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57493.log 2023-07-14T13:33:41.268 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46410.log.gz 2023-07-14T13:33:41.268 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54842.log 2023-07-14T13:33:41.269 INFO:teuthology.orchestra.run.smithi005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51880.log.gz 2023-07-14T13:33:41.269 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50776.log 2023-07-14T13:33:41.270 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2%/var/log/ceph/ceph-client.admin.54842.log: -- replaced with /var/log/ceph/ceph-client.admin.57493.log.gz 2023-07-14T13:33:41.271 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43532.log 2023-07-14T13:33:41.271 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54842.log.gz 2023-07-14T13:33:41.272 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64528.log 2023-07-14T13:33:41.272 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50776.log.gz 2023-07-14T13:33:41.274 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62190.log 2023-07-14T13:33:41.275 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64528.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43532.log.gz 2023-07-14T13:33:41.276 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59339.log 2023-07-14T13:33:41.276 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64528.log.gz 2023-07-14T13:33:41.277 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62190.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53332.log 2023-07-14T13:33:41.277 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62190.log.gz 2023-07-14T13:33:41.278 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41480.log 2023-07-14T13:33:41.279 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59339.log.gz 2023-07-14T13:33:41.280 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.53332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54894.log 2023-07-14T13:33:41.281 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53332.log.gz 2023-07-14T13:33:41.282 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46466.log 2023-07-14T13:33:41.282 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41480.log.gz 2023-07-14T13:33:41.283 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54894.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54894.log.gz 2023-07-14T13:33:41.283 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61489.log 2023-07-14T13:33:41.285 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62838.log 2023-07-14T13:33:41.285 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46466.log.gz 2023-07-14T13:33:41.286 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55306.log 2023-07-14T13:33:41.287 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61489.log.gz 2023-07-14T13:33:41.288 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53050.log 2023-07-14T13:33:41.288 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62838.log.gz 2023-07-14T13:33:41.289 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55306.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55306.log.gz 2023-07-14T13:33:41.290 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50587.log 2023-07-14T13:33:41.292 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53050.log: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57214.log 2023-07-14T13:33:41.292 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53050.log.gz 2023-07-14T13:33:41.294 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56160.log 2023-07-14T13:33:41.294 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50587.log.gz 2023-07-14T13:33:41.295 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-07-14T13:33:41.297 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57214.log: /var/log/ceph/ceph-client.admin.56160.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57214.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60519.log 2023-07-14T13:33:41.297 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56160.log.gz 2023-07-14T13:33:41.297 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-07-14T13:33:41.298 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64886.log 2023-07-14T13:33:41.300 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62708.log 2023-07-14T13:33:41.300 INFO:teuthology.orchestra.run.smithi005.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.60519.log.gz 2023-07-14T13:33:41.302 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63912.log 2023-07-14T13:33:41.302 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64886.log.gz 2023-07-14T13:33:41.303 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62708.log: 88.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-07-14T13:33:41.303 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62708.log.gz 2023-07-14T13:33:41.304 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58979.log 2023-07-14T13:33:41.306 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44406.log 2023-07-14T13:33:41.306 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63912.log.gz 2023-07-14T13:33:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52698.log 2023-07-14T13:33:41.307 INFO:teuthology.orchestra.run.smithi005.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58979.log.gz 2023-07-14T13:33:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60467.log 2023-07-14T13:33:41.310 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52698.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44406.log.gz 2023-07-14T13:33:41.311 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52698.log.gz 2023-07-14T13:33:41.311 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62003.log 2023-07-14T13:33:41.312 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60467.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60467.log.gz 2023-07-14T13:33:41.312 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47493.log 2023-07-14T13:33:41.314 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62224.log 2023-07-14T13:33:41.314 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.62003.log.gz 2023-07-14T13:33:41.315 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47493.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47493.log.gz -5 2023-07-14T13:33:41.316 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49033.log 2023-07-14T13:33:41.317 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46650.log 2023-07-14T13:33:41.318 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49033.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62224.log.gz 2023-07-14T13:33:41.319 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 88.5% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.49033.log.gz /var/log/ceph/ceph-client.admin.56793.log 2023-07-14T13:33:41.319 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-07-14T13:33:41.320 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62250.log 2023-07-14T13:33:41.320 INFO:teuthology.orchestra.run.smithi005.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46650.log.gz 2023-07-14T13:33:41.321 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56793.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65972.log 2023-07-14T13:33:41.321 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56793.log.gz 2023-07-14T13:33:41.323 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62250.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62250.log.gz 2023-07-14T13:33:41.323 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64912.log 2023-07-14T13:33:41.325 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65998.log 2023-07-14T13:33:41.326 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64912.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65972.log.gz 2023-07-14T13:33:41.326 INFO:teuthology.orchestra.run.smithi005.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.64912.log.gz 2023-07-14T13:33:41.327 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42574.log 2023-07-14T13:33:41.328 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43766.log 2023-07-14T13:33:41.329 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.65998.log.gz 2023-07-14T13:33:41.329 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42574.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49085.log 2023-07-14T13:33:41.329 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42574.log.gz 2023-07-14T13:33:41.332 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54488.log 2023-07-14T13:33:41.332 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43766.log.gz 2023-07-14T13:33:41.333 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49085.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49085.log.gz 2023-07-14T13:33:41.333 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52866.log 2023-07-14T13:33:41.334 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54488.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54488.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47545.log 2023-07-14T13:33:41.334 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-07-14T13:33:41.335 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52866.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.2.43481.log 2023-07-14T13:33:41.336 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52866.log.gz 2023-07-14T13:33:41.337 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55165.log 2023-07-14T13:33:41.338 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47545.log.gz 2023-07-14T13:33:41.339 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.2.43481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.43481.log.gz 2023-07-14T13:33:41.339 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57954.log 2023-07-14T13:33:41.341 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58271.log 2023-07-14T13:33:41.341 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55165.log.gz 2023-07-14T13:33:41.342 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57954.log: gzip 87.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.57954.log.gz --verbose 2023-07-14T13:33:41.343 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/ceph-client.admin.66180.log 2023-07-14T13:33:41.344 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54632.log 2023-07-14T13:33:41.344 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58271.log.gz 2023-07-14T13:33:41.350 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.66180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52832.log 2023-07-14T13:33:41.350 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.66180.log.gz 2023-07-14T13:33:41.351 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54632.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43379.log 2023-07-14T13:33:41.351 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54632.log.gz 2023-07-14T13:33:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55997.log 2023-07-14T13:33:41.352 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52832.log.gz 2023-07-14T13:33:41.352 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.43379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43379.log.gz 2023-07-14T13:33:41.353 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61213.log 2023-07-14T13:33:41.353 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57701.log 2023-07-14T13:33:41.354 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55997.log.gz 2023-07-14T13:33:41.354 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61645.log 2023-07-14T13:33:41.354 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61213.log.gz 2023-07-14T13:33:41.355 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57701.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61567.log 2023-07-14T13:33:41.356 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57701.log.gz 2023-07-14T13:33:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61645.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61645.log.gz 2023-07-14T13:33:41.357 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49540.log 2023-07-14T13:33:41.358 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65712.log 2023-07-14T13:33:41.360 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3%/var/log/ceph/ceph-client.admin.49540.log: -- replaced with /var/log/ceph/ceph-client.admin.61567.log.gz 2023-07-14T13:33:41.360 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58595.log 2023-07-14T13:33:41.360 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49540.log.gz 2023-07-14T13:33:41.361 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65712.log: gzip 87.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.65712.log.gz -- 2023-07-14T13:33:41.362 INFO:teuthology.orchestra.run.smithi005.stderr: /var/log/ceph/ceph-client.admin.53453.log 2023-07-14T13:33:41.362 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58595.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58595.log.gz -5 2023-07-14T13:33:41.362 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47223.log 2023-07-14T13:33:41.363 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53453.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53453.log.gz 2023-07-14T13:33:41.364 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42546.log 2023-07-14T13:33:41.369 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56336.log 2023-07-14T13:33:41.369 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47223.log.gz 2023-07-14T13:33:41.370 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54972.log 2023-07-14T13:33:41.370 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42546.log.gz 2023-07-14T13:33:41.371 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57297.log 2023-07-14T13:33:41.371 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56336.log.gz 2023-07-14T13:33:41.373 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46354.log 2023-07-14T13:33:41.373 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54972.log.gz 2023-07-14T13:33:41.374 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57297.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57297.log.gz -5 2023-07-14T13:33:41.374 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45449.log 2023-07-14T13:33:41.375 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46676.log 2023-07-14T13:33:41.375 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46354.log.gz 2023-07-14T13:33:41.376 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41760.log 2023-07-14T13:33:41.377 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45449.log.gz 2023-07-14T13:33:41.377 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46676.log: gzip 88.6% -5 --verbose -- /var/log/ceph/ceph-client.admin.49059.log 2023-07-14T13:33:41.377 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46676.log.gz 2023-07-14T13:33:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41760.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41760.log.gz 2023-07-14T13:33:41.379 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51306.log 2023-07-14T13:33:41.379 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47597.log 2023-07-14T13:33:41.381 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49059.log.gz 2023-07-14T13:33:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43040.log 2023-07-14T13:33:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47597.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51306.log.gz 2023-07-14T13:33:41.383 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59835.log 2023-07-14T13:33:41.383 INFO:teuthology.orchestra.run.smithi005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47597.log.gz 2023-07-14T13:33:41.384 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43040.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43040.log.gz 2023-07-14T13:33:41.385 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65842.log 2023-07-14T13:33:41.386 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58217.log 2023-07-14T13:33:41.387 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59835.log.gz 2023-07-14T13:33:41.387 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53184.log 2023-07-14T13:33:41.388 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.65842.log.gz 2023-07-14T13:33:41.389 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54816.log 2023-07-14T13:33:41.389 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58217.log.gz 2023-07-14T13:33:41.391 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51436.log 2023-07-14T13:33:41.393 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53184.log.gz/var/log/ceph/ceph-client.admin.54816.log: 2023-07-14T13:33:41.393 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60766.log 2023-07-14T13:33:41.393 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54816.log.gz 2023-07-14T13:33:41.394 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58045.log 2023-07-14T13:33:41.394 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60766.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51436.log.gz 2023-07-14T13:33:41.395 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58333.log 2023-07-14T13:33:41.395 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60766.log.gz 2023-07-14T13:33:41.395 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62488.log 2023-07-14T13:33:41.395 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58045.log.gz 2023-07-14T13:33:41.396 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58333.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43370.log 2023-07-14T13:33:41.397 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58333.log.gz 2023-07-14T13:33:41.398 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62488.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62488.log.gz 2023-07-14T13:33:41.398 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56558.log 2023-07-14T13:33:41.400 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.43370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41512.log 2023-07-14T13:33:41.400 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43370.log.gz 2023-07-14T13:33:41.401 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56558.log: gzip 88.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.56558.log.gz -- 2023-07-14T13:33:41.402 INFO:teuthology.orchestra.run.smithi005.stderr: /var/log/ceph/ceph-client.admin.51629.log 2023-07-14T13:33:41.403 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51228.log 2023-07-14T13:33:41.403 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41512.log.gz 2023-07-14T13:33:41.405 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46100.log 2023-07-14T13:33:41.405 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51228.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51629.log.gz 2023-07-14T13:33:41.406 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54410.log 2023-07-14T13:33:41.406 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51228.log.gz 2023-07-14T13:33:41.407 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46100.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52262.log 2023-07-14T13:33:41.408 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46100.log.gz 2023-07-14T13:33:41.409 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43662.log 2023-07-14T13:33:41.409 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54410.log.gz 2023-07-14T13:33:41.411 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64284.log 2023-07-14T13:33:41.411 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43662.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52262.log.gz 2023-07-14T13:33:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43948.log 2023-07-14T13:33:41.412 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43662.log.gz 2023-07-14T13:33:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64284.log: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53791.log 2023-07-14T13:33:41.414 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64284.log.gz 2023-07-14T13:33:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43948.log: gzip -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.50665.log 2023-07-14T13:33:41.415 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43948.log.gz 2023-07-14T13:33:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47858.log 2023-07-14T13:33:41.417 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53791.log.gz 2023-07-14T13:33:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57980.log 2023-07-14T13:33:41.419 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47858.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50665.log.gz 2023-07-14T13:33:41.420 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65764.log 2023-07-14T13:33:41.420 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47858.log.gz 2023-07-14T13:33:41.421 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57980.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57980.log.gz 2023-07-14T13:33:41.421 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41629.log 2023-07-14T13:33:41.422 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65764.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.65764.log.gz 2023-07-14T13:33:41.423 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54462.log 2023-07-14T13:33:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41629.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49243.log 2023-07-14T13:33:41.425 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41629.log.gz 2023-07-14T13:33:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54462.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54462.log.gz 2023-07-14T13:33:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63737.log 2023-07-14T13:33:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62693.log 2023-07-14T13:33:41.429 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63737.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49243.log.gz 2023-07-14T13:33:41.429 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50613.log 2023-07-14T13:33:41.430 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63737.log.gz 2023-07-14T13:33:41.430 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.62693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62693.log.gz 2023-07-14T13:33:41.431 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63998.log 2023-07-14T13:33:41.432 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50613.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50613.log.gz 2023-07-14T13:33:41.433 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48350.log 2023-07-14T13:33:41.434 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43584.log 2023-07-14T13:33:41.434 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63998.log.gz 2023-07-14T13:33:41.435 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48350.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54123.log 2023-07-14T13:33:41.436 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48350.log.gz 2023-07-14T13:33:41.437 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41922.log 2023-07-14T13:33:41.437 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43584.log.gz 2023-07-14T13:33:41.438 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47195.log 2023-07-14T13:33:41.439 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54123.log.gz 2023-07-14T13:33:41.440 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50138.log 2023-07-14T13:33:41.440 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41922.log.gz 2023-07-14T13:33:41.441 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47195.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45555.log 2023-07-14T13:33:41.442 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47195.log.gz 2023-07-14T13:33:41.443 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50138.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52184.log 2023-07-14T13:33:41.443 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50138.log.gz 2023-07-14T13:33:41.445 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47005.log 2023-07-14T13:33:41.445 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45555.log.gz 2023-07-14T13:33:41.446 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52184.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52184.log.gz 2023-07-14T13:33:41.447 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65300.log 2023-07-14T13:33:41.448 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51679.log 2023-07-14T13:33:41.448 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47005.log.gz 2023-07-14T13:33:41.449 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65300.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.65300.log.gz 2023-07-14T13:33:41.450 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42988.log 2023-07-14T13:33:41.451 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46382.log 2023-07-14T13:33:41.451 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51679.log.gz 2023-07-14T13:33:41.452 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42988.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55215.log 2023-07-14T13:33:41.453 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42988.log.gz 2023-07-14T13:33:41.454 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54312.log 2023-07-14T13:33:41.454 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46382.log.gz 2023-07-14T13:33:41.456 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62810.log 2023-07-14T13:33:41.456 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54312.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55215.log.gz 2023-07-14T13:33:41.457 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59802.log 2023-07-14T13:33:41.457 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54312.log.gz 2023-07-14T13:33:41.458 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62810.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62810.log.gz 2023-07-14T13:33:41.460 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49373.log 2023-07-14T13:33:41.461 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57182.log 2023-07-14T13:33:41.462 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59802.log.gz 2023-07-14T13:33:41.463 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62082.log 2023-07-14T13:33:41.463 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49373.log.gz 2023-07-14T13:33:41.464 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47969.log 2023-07-14T13:33:41.465 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4%/var/log/ceph/ceph-client.admin.62082.log: -- replaced with /var/log/ceph/ceph-client.admin.57182.log.gz 2023-07-14T13:33:41.466 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62082.log.gz 2023-07-14T13:33:41.466 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45038.log 2023-07-14T13:33:41.468 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47969.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47969.log.gz -5 2023-07-14T13:33:41.468 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.57062.log 2023-07-14T13:33:41.469 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50954.log 2023-07-14T13:33:41.469 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45038.log.gz 2023-07-14T13:33:41.471 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57062.log: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63711.log 2023-07-14T13:33:41.471 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57062.log.gz 2023-07-14T13:33:41.472 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50954.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.50954.log.gz --verbose 2023-07-14T13:33:41.472 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/ceph-client.admin.44328.log 2023-07-14T13:33:41.474 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66260.log 2023-07-14T13:33:41.475 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.63711.log.gz 2023-07-14T13:33:41.476 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44328.log: gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44328.log.gz -5 2023-07-14T13:33:41.476 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45397.log 2023-07-14T13:33:41.477 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.66260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64580.log 2023-07-14T13:33:41.477 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66260.log.gz 2023-07-14T13:33:41.479 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63965.log 2023-07-14T13:33:41.479 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45397.log.gz 2023-07-14T13:33:41.480 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42962.log 2023-07-14T13:33:41.481 INFO:teuthology.orchestra.run.smithi005.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.64580.log.gz 2023-07-14T13:33:41.482 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58413.log 2023-07-14T13:33:41.482 INFO:teuthology.orchestra.run.smithi005.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63965.log.gz 2023-07-14T13:33:41.484 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42962.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42962.log.gz 2023-07-14T13:33:41.484 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-07-14T13:33:41.485 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58413.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44054.log 2023-07-14T13:33:41.485 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58413.log.gz 2023-07-14T13:33:41.486 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61011.log 2023-07-14T13:33:41.488 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44778.log 2023-07-14T13:33:41.489 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44054.log.gz 2023-07-14T13:33:41.491 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60037.log 2023-07-14T13:33:41.491 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61011.log.gz/var/log/ceph/ceph-client.admin.44778.log: 2023-07-14T13:33:41.492 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44778.log.gz 2023-07-14T13:33:41.492 INFO:teuthology.orchestra.run.smithi005.stderr: 90.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-14T13:33:41.497 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-07-14T13:33:41.498 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60037.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45855.log 2023-07-14T13:33:41.498 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60037.log.gz 2023-07-14T13:33:41.498 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65380.log 2023-07-14T13:33:41.499 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59471.log 2023-07-14T13:33:41.500 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65380.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45855.log.gz 2023-07-14T13:33:41.500 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65380.log.gz 2023-07-14T13:33:41.508 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53210.log 2023-07-14T13:33:41.509 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60011.log 2023-07-14T13:33:41.509 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59471.log: /var/log/ceph/ceph-client.admin.53210.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59471.log.gz 2023-07-14T13:33:41.512 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53210.log.gz 2023-07-14T13:33:41.512 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62760.log 2023-07-14T13:33:41.515 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42345.log 2023-07-14T13:33:41.516 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60011.log.gz 2023-07-14T13:33:41.517 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62760.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62760.log.gz 2023-07-14T13:33:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50717.log 2023-07-14T13:33:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42345.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42345.log.gz 2023-07-14T13:33:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52892.log 2023-07-14T13:33:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42154.log 2023-07-14T13:33:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52892.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50717.log.gz 2023-07-14T13:33:41.522 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52892.log.gz 2023-07-14T13:33:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45319.log 2023-07-14T13:33:41.524 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42154.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-07-14T13:33:41.524 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42154.log.gz 2023-07-14T13:33:41.525 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45319.log: 89.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50386.log 2023-07-14T13:33:41.525 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45319.log.gz 2023-07-14T13:33:41.526 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63555.log 2023-07-14T13:33:41.528 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50386.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50386.log.gz 2023-07-14T13:33:41.529 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62514.log 2023-07-14T13:33:41.531 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63555.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63555.log.gz 2023-07-14T13:33:41.532 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65894.log 2023-07-14T13:33:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62514.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62514.log.gz 2023-07-14T13:33:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43688.log 2023-07-14T13:33:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65894.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65894.log.gz 2023-07-14T13:33:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44302.log 2023-07-14T13:33:41.541 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43688.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43688.log.gz 2023-07-14T13:33:41.542 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66128.log 2023-07-14T13:33:41.544 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44302.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44302.log.gz 2023-07-14T13:33:41.546 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51939.log 2023-07-14T13:33:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.66128.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66128.log.gz 2023-07-14T13:33:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57401.log 2023-07-14T13:33:41.551 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51939.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51939.log.gz 2023-07-14T13:33:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63503.log 2023-07-14T13:33:41.554 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57401.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57401.log.gz 2023-07-14T13:33:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65816.log 2023-07-14T13:33:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63503.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63503.log.gz 2023-07-14T13:33:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48891.log 2023-07-14T13:33:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65816.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.65816.log.gz 2023-07-14T13:33:41.564 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48525.log 2023-07-14T13:33:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48891.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48891.log.gz 2023-07-14T13:33:41.567 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49706.log 2023-07-14T13:33:41.568 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48525.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48525.log.gz 2023-07-14T13:33:41.569 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47139.log 2023-07-14T13:33:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49706.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49706.log.gz 2023-07-14T13:33:41.573 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54344.log 2023-07-14T13:33:41.574 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47139.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47139.log.gz 2023-07-14T13:33:41.576 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64228.log 2023-07-14T13:33:41.578 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54344.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54344.log.gz 2023-07-14T13:33:41.580 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46754.log 2023-07-14T13:33:41.582 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64228.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64228.log.gz 2023-07-14T13:33:41.584 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65581.log 2023-07-14T13:33:41.586 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46754.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46754.log.gz 2023-07-14T13:33:41.587 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37437.log 2023-07-14T13:33:41.589 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65581.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65581.log.gz 2023-07-14T13:33:41.591 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54790.log 2023-07-14T13:33:41.593 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.37437.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37437.log.gz 2023-07-14T13:33:41.595 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60983.log 2023-07-14T13:33:41.597 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54790.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54790.log.gz 2023-07-14T13:33:41.599 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53076.log 2023-07-14T13:33:41.601 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60983.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60983.log.gz 2023-07-14T13:33:41.602 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52333.log 2023-07-14T13:33:41.604 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53076.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53076.log.gz 2023-07-14T13:33:41.606 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43144.log 2023-07-14T13:33:41.608 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52333.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52333.log.gz 2023-07-14T13:33:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41682.log 2023-07-14T13:33:41.612 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43144.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43144.log.gz 2023-07-14T13:33:41.614 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49449.log 2023-07-14T13:33:41.615 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41682.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41682.log.gz 2023-07-14T13:33:41.617 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47995.log 2023-07-14T13:33:41.619 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49449.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49449.log.gz 2023-07-14T13:33:41.621 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60063.log 2023-07-14T13:33:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47995.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47995.log.gz 2023-07-14T13:33:41.625 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45174.log 2023-07-14T13:33:41.627 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60063.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60063.log.gz 2023-07-14T13:33:41.629 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47910.log 2023-07-14T13:33:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45174.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45174.log.gz 2023-07-14T13:33:41.632 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52776.log 2023-07-14T13:33:41.635 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47910.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47910.log.gz 2023-07-14T13:33:41.636 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57850.log 2023-07-14T13:33:41.638 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52776.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52776.log.gz 2023-07-14T13:33:41.640 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55943.log 2023-07-14T13:33:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57850.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57850.log.gz 2023-07-14T13:33:41.644 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54540.log 2023-07-14T13:33:41.646 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55943.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.55943.log.gz 2023-07-14T13:33:41.648 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52026.log 2023-07-14T13:33:41.650 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54540.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54540.log.gz 2023-07-14T13:33:41.651 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62408.log 2023-07-14T13:33:41.653 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52026.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52026.log.gz 2023-07-14T13:33:41.655 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61332.log 2023-07-14T13:33:41.658 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62408.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62408.log.gz 2023-07-14T13:33:41.659 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43506.log 2023-07-14T13:33:41.661 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61332.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61332.log.gz 2023-07-14T13:33:41.663 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58840.log 2023-07-14T13:33:41.665 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43506.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43506.log.gz 2023-07-14T13:33:41.667 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63450.log 2023-07-14T13:33:41.669 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58840.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58840.log.gz 2023-07-14T13:33:41.671 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50516.log 2023-07-14T13:33:41.673 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63450.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63450.log.gz 2023-07-14T13:33:41.675 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55585.log 2023-07-14T13:33:41.677 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50516.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50516.log.gz 2023-07-14T13:33:41.679 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47649.log 2023-07-14T13:33:41.681 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55585.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55585.log.gz 2023-07-14T13:33:41.682 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42359.log 2023-07-14T13:33:41.684 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47649.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47649.log.gz 2023-07-14T13:33:41.686 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62642.log 2023-07-14T13:33:41.688 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42359.log: 92.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-07-14T13:33:41.688 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42359.log.gz 2023-07-14T13:33:41.690 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52724.log 2023-07-14T13:33:41.691 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62642.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62642.log.gz 2023-07-14T13:33:41.692 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48943.log 2023-07-14T13:33:41.693 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60363.log 2023-07-14T13:33:41.694 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52724.log.gz 2023-07-14T13:33:41.695 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48943.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48943.log.gz 2023-07-14T13:33:41.695 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50639.log 2023-07-14T13:33:41.697 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60363.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60363.log.gz 2023-07-14T13:33:41.698 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46035.log 2023-07-14T13:33:41.700 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50639.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50639.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44080.log 2023-07-14T13:33:41.700 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-07-14T13:33:41.701 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45933.log 2023-07-14T13:33:41.702 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44080.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46035.log.gz 2023-07-14T13:33:41.703 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44080.log.gz 2023-07-14T13:33:41.704 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59005.log 2023-07-14T13:33:41.705 INFO:teuthology.orchestra.run.smithi154.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-07-14T13:33:41.705 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45583.log 2023-07-14T13:33:41.706 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59005.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45933.log.gz 2023-07-14T13:33:41.707 INFO:teuthology.orchestra.run.smithi005.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.59005.log.gz 2023-07-14T13:33:41.707 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59724.log 2023-07-14T13:33:41.709 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55099.log 2023-07-14T13:33:41.710 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59724.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45583.log.gz 2023-07-14T13:33:41.711 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59724.log.gz 2023-07-14T13:33:41.711 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44432.log 2023-07-14T13:33:41.713 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.55099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45345.log 2023-07-14T13:33:41.714 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55099.log.gz 2023-07-14T13:33:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44432.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44432.log.gz 2023-07-14T13:33:41.715 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41974.log 2023-07-14T13:33:41.717 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58165.log 2023-07-14T13:33:41.717 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45345.log.gz 2023-07-14T13:33:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41974.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41974.log.gz 2023-07-14T13:33:41.719 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52288.log 2023-07-14T13:33:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58165.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58165.log.gz 2023-07-14T13:33:41.721 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64696.log 2023-07-14T13:33:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46298.log 2023-07-14T13:33:41.723 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52288.log.gz 2023-07-14T13:33:41.724 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64696.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64696.log.gz 2023-07-14T13:33:41.725 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41818.log 2023-07-14T13:33:41.726 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46298.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46298.log.gz 2023-07-14T13:33:41.728 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49347.log 2023-07-14T13:33:41.729 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41818.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41818.log.gz 2023-07-14T13:33:41.730 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64202.log 2023-07-14T13:33:41.731 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65130.log 2023-07-14T13:33:41.732 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64202.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49347.log.gz 2023-07-14T13:33:41.733 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64202.log.gz 2023-07-14T13:33:41.733 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56478.log 2023-07-14T13:33:41.735 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65222.log 2023-07-14T13:33:41.736 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56478.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65130.log.gz 2023-07-14T13:33:41.737 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56478.log.gz 2023-07-14T13:33:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41844.log 2023-07-14T13:33:41.739 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56023.log 2023-07-14T13:33:41.740 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41844.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.65222.log.gz 2023-07-14T13:33:41.741 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41844.log.gz 2023-07-14T13:33:41.742 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46494.log 2023-07-14T13:33:41.743 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50438.log 2023-07-14T13:33:41.744 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6%/var/log/ceph/ceph-client.admin.46494.log: -- replaced with /var/log/ceph/ceph-client.admin.56023.log.gz 2023-07-14T13:33:41.745 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46494.log.gz 2023-07-14T13:33:41.745 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64942.log 2023-07-14T13:33:41.749 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41734.log 2023-07-14T13:33:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50438.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50438.log.gz 2023-07-14T13:33:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64942.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64942.log.gz 2023-07-14T13:33:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51563.log 2023-07-14T13:33:41.751 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-07-14T13:33:41.752 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55690.log 2023-07-14T13:33:41.752 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.51563.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41734.log.gz 2023-07-14T13:33:41.753 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51563.log.gz 2023-07-14T13:33:41.753 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50743.log 2023-07-14T13:33:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54253.log 2023-07-14T13:33:41.756 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50743.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55690.log.gz 2023-07-14T13:33:41.757 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50743.log.gz 2023-07-14T13:33:41.758 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47167.log 2023-07-14T13:33:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54253.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54253.log.gz 2023-07-14T13:33:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62434.log 2023-07-14T13:33:41.766 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52672.log 2023-07-14T13:33:41.766 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47167.log.gz 2023-07-14T13:33:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62434.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62434.log.gz 2023-07-14T13:33:41.767 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43636.log 2023-07-14T13:33:41.768 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52672.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52672.log.gz 2023-07-14T13:33:41.769 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65555.log 2023-07-14T13:33:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63581.log 2023-07-14T13:33:41.774 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65555.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43636.log.gz 2023-07-14T13:33:41.775 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65555.log.gz 2023-07-14T13:33:41.775 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43922.log 2023-07-14T13:33:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56662.log 2023-07-14T13:33:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43922.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63581.log.gz 2023-07-14T13:33:41.777 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43922.log.gz 2023-07-14T13:33:41.777 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44591.log 2023-07-14T13:33:41.780 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44565.log 2023-07-14T13:33:41.780 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44591.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56662.log.gz 2023-07-14T13:33:41.780 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44591.log.gz 2023-07-14T13:33:41.781 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42858.log 2023-07-14T13:33:41.781 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66154.log 2023-07-14T13:33:41.781 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42858.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44565.log.gz 2023-07-14T13:33:41.783 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42858.log.gz 2023-07-14T13:33:41.784 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49680.log 2023-07-14T13:33:41.784 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.66154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61742.log 2023-07-14T13:33:41.784 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8%/var/log/ceph/ceph-client.admin.49680.log: -- replaced with /var/log/ceph/ceph-client.admin.66154.log.gz 2023-07-14T13:33:41.786 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49680.log.gz 2023-07-14T13:33:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44354.log 2023-07-14T13:33:41.788 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64176.log 2023-07-14T13:33:41.788 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44354.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61742.log.gz 2023-07-14T13:33:41.788 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44354.log.gz 2023-07-14T13:33:41.789 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64860.log 2023-07-14T13:33:41.790 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53403.log 2023-07-14T13:33:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64860.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64176.log.gz 2023-07-14T13:33:41.792 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64860.log.gz 2023-07-14T13:33:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53947.log 2023-07-14T13:33:41.794 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53337.log 2023-07-14T13:33:41.795 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53403.log: /var/log/ceph/ceph-client.admin.53947.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53403.log.gz 2023-07-14T13:33:41.795 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53947.log.gz 2023-07-14T13:33:41.796 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60615.log 2023-07-14T13:33:41.799 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.53337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58673.log 2023-07-14T13:33:41.799 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53337.log.gz 2023-07-14T13:33:41.800 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.60615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60615.log.gz 2023-07-14T13:33:41.800 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46849.log 2023-07-14T13:33:41.802 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63607.log 2023-07-14T13:33:41.803 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46849.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58673.log.gz 2023-07-14T13:33:41.804 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46849.log.gz 2023-07-14T13:33:41.804 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65000.log 2023-07-14T13:33:41.806 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47441.log 2023-07-14T13:33:41.807 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65000.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63607.log.gz 2023-07-14T13:33:41.807 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65000.log.gz 2023-07-14T13:33:41.808 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57876.log 2023-07-14T13:33:41.809 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58569.log 2023-07-14T13:33:41.810 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57876.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47441.log.gz 2023-07-14T13:33:41.811 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57876.log.gz 2023-07-14T13:33:41.811 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45423.log 2023-07-14T13:33:41.814 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44648.log 2023-07-14T13:33:41.815 INFO:teuthology.orchestra.run.smithi154.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-07-14T13:33:41.816 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45423.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45423.log.gz 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58569.log.gz 2023-07-14T13:33:41.816 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-07-14T13:33:41.817 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51512.log 2023-07-14T13:33:41.818 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49113.log 2023-07-14T13:33:41.819 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44648.log.gz/var/log/ceph/ceph-client.admin.51512.log: 2023-07-14T13:33:41.819 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51512.log.gz 2023-07-14T13:33:41.820 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55638.log 2023-07-14T13:33:41.822 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64124.log 2023-07-14T13:33:41.823 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55638.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49113.log.gz 2023-07-14T13:33:41.823 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55638.log.gz 2023-07-14T13:33:41.824 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58814.log 2023-07-14T13:33:41.825 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46202.log 2023-07-14T13:33:41.826 INFO:teuthology.orchestra.run.smithi005.stderr: 89.5%/var/log/ceph/ceph-client.admin.58814.log: -- replaced with /var/log/ceph/ceph-client.admin.64124.log.gz 2023-07-14T13:33:41.827 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58814.log.gz 2023-07-14T13:33:41.828 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48454.log 2023-07-14T13:33:41.831 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63938.log 2023-07-14T13:33:41.831 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48454.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46202.log.gz 2023-07-14T13:33:41.831 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48454.log.gz 2023-07-14T13:33:41.832 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45907.log 2023-07-14T13:33:41.833 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45959.log 2023-07-14T13:33:41.834 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45907.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63938.log.gz 2023-07-14T13:33:41.835 INFO:teuthology.orchestra.run.smithi005.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45907.log.gz 2023-07-14T13:33:41.836 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43740.log 2023-07-14T13:33:41.837 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63477.log 2023-07-14T13:33:41.838 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43740.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45959.log.gz 2023-07-14T13:33:41.839 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43740.log.gz 2023-07-14T13:33:41.839 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43792.log 2023-07-14T13:33:41.841 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51577.log 2023-07-14T13:33:41.842 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43792.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63477.log.gz 2023-07-14T13:33:41.843 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43792.log.gz 2023-07-14T13:33:41.843 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65920.log 2023-07-14T13:33:41.845 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63633.log 2023-07-14T13:33:41.846 INFO:teuthology.orchestra.run.smithi005.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51577.log.gz 2023-07-14T13:33:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65920.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.65920.log.gz 2023-07-14T13:33:41.847 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42157.log 2023-07-14T13:33:41.849 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57798.log 2023-07-14T13:33:41.850 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42157.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63633.log.gz 2023-07-14T13:33:41.851 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42157.log.gz 2023-07-14T13:33:41.851 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48021.log 2023-07-14T13:33:41.853 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61358.log 2023-07-14T13:33:41.854 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48021.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57798.log.gz 2023-07-14T13:33:41.855 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48021.log.gz 2023-07-14T13:33:41.856 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42351.log 2023-07-14T13:33:41.857 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65458.log 2023-07-14T13:33:41.858 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42351.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61358.log.gz 2023-07-14T13:33:41.859 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42351.log.gz 2023-07-14T13:33:41.860 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50308.log 2023-07-14T13:33:41.861 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42146.log 2023-07-14T13:33:41.862 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50308.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.65458.log.gz 2023-07-14T13:33:41.863 INFO:teuthology.orchestra.run.smithi005.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50308.log.gz 2023-07-14T13:33:41.864 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41372.log 2023-07-14T13:33:41.865 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55820.log 2023-07-14T13:33:41.867 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41372.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42146.log.gz 2023-07-14T13:33:41.867 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41372.log.gz 2023-07-14T13:33:41.868 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50360.log 2023-07-14T13:33:41.870 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51973.log 2023-07-14T13:33:41.870 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50360.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55820.log.gz 2023-07-14T13:33:41.871 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50360.log.gz 2023-07-14T13:33:41.872 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59867.log 2023-07-14T13:33:41.874 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52078.log 2023-07-14T13:33:41.874 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59867.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51973.log.gz 2023-07-14T13:33:41.875 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59867.log.gz 2023-07-14T13:33:41.876 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43896.log 2023-07-14T13:33:41.877 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57090.log 2023-07-14T13:33:41.879 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52078.log.gz 2023-07-14T13:33:41.879 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43896.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43896.log.gz 2023-07-14T13:33:41.880 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43092.log 2023-07-14T13:33:41.882 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53895.log 2023-07-14T13:33:41.883 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43092.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57090.log.gz 2023-07-14T13:33:41.883 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43092.log.gz 2023-07-14T13:33:41.884 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50810.log 2023-07-14T13:33:41.886 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49191.log 2023-07-14T13:33:41.887 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50810.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53895.log.gz 2023-07-14T13:33:41.888 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50810.log.gz 2023-07-14T13:33:41.888 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50490.log 2023-07-14T13:33:41.890 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51384.log 2023-07-14T13:33:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50490.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49191.log.gz 2023-07-14T13:33:41.892 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50490.log.gz 2023-07-14T13:33:41.892 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41603.log 2023-07-14T13:33:41.895 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41788.log 2023-07-14T13:33:41.895 INFO:teuthology.orchestra.run.smithi005.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51384.log.gz 2023-07-14T13:33:41.896 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65248.log 2023-07-14T13:33:41.897 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5%/var/log/ceph/ceph-client.admin.41788.log: -- replaced with /var/log/ceph/ceph-client.admin.41603.log.gz 2023-07-14T13:33:41.898 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41788.log.gz 2023-07-14T13:33:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47307.log 2023-07-14T13:33:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65248.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63333.log 2023-07-14T13:33:41.901 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65248.log.gz 2023-07-14T13:33:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59646.log 2023-07-14T13:33:41.903 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63333.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47307.log.gz 2023-07-14T13:33:41.904 INFO:teuthology.orchestra.run.smithi005.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.63333.log.gz 2023-07-14T13:33:41.905 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53673.log 2023-07-14T13:33:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55241.log 2023-07-14T13:33:41.908 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59646.log: /var/log/ceph/ceph-client.admin.53673.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59646.log.gz 2023-07-14T13:33:41.908 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53673.log.gz 2023-07-14T13:33:41.909 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51410.log 2023-07-14T13:33:41.911 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61768.log 2023-07-14T13:33:41.912 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51410.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55241.log.gz 2023-07-14T13:33:41.913 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51410.log.gz 2023-07-14T13:33:41.913 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57519.log 2023-07-14T13:33:41.915 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56284.log 2023-07-14T13:33:41.916 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57519.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61768.log.gz 2023-07-14T13:33:41.917 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57519.log.gz 2023-07-14T13:33:41.917 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49269.log 2023-07-14T13:33:41.919 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58491.log 2023-07-14T13:33:41.920 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56284.log.gz 2023-07-14T13:33:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49269.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49269.log.gz 2023-07-14T13:33:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59419.log 2023-07-14T13:33:41.922 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58491.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58491.log.gz 2023-07-14T13:33:41.924 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48047.log 2023-07-14T13:33:41.926 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59419.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57012.log 2023-07-14T13:33:41.926 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59419.log.gz 2023-07-14T13:33:41.927 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60233.log 2023-07-14T13:33:41.928 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48047.log.gz 2023-07-14T13:33:41.930 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57012.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48099.log 2023-07-14T13:33:41.930 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57012.log.gz 2023-07-14T13:33:41.931 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60233.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60233.log.gz 2023-07-14T13:33:41.932 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60415.log 2023-07-14T13:33:41.933 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61820.log 2023-07-14T13:33:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60415.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48099.log.gz 2023-07-14T13:33:41.935 INFO:teuthology.orchestra.run.smithi005.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60415.log.gz 2023-07-14T13:33:41.935 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65607.log 2023-07-14T13:33:41.937 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44218.log 2023-07-14T13:33:41.938 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65607.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61820.log.gz 2023-07-14T13:33:41.939 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65607.log.gz 2023-07-14T13:33:41.939 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65432.log 2023-07-14T13:33:41.941 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53699.log 2023-07-14T13:33:41.942 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65432.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44218.log.gz 2023-07-14T13:33:41.943 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.65432.log.gz 2023-07-14T13:33:41.943 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41708.log 2023-07-14T13:33:41.945 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58866.log 2023-07-14T13:33:41.946 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41708.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53699.log.gz 2023-07-14T13:33:41.947 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41708.log.gz 2023-07-14T13:33:41.947 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51096.log 2023-07-14T13:33:41.949 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43870.log 2023-07-14T13:33:41.950 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51096.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58866.log.gz 2023-07-14T13:33:41.951 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51096.log.gz 2023-07-14T13:33:41.952 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56714.log 2023-07-14T13:33:41.953 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48603.log 2023-07-14T13:33:41.954 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43870.log: /var/log/ceph/ceph-client.admin.56714.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43870.log.gz 2023-07-14T13:33:41.955 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56714.log.gz 2023-07-14T13:33:41.955 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49616.log 2023-07-14T13:33:41.958 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48999.log 2023-07-14T13:33:41.958 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48603.log: /var/log/ceph/ceph-client.admin.49616.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48603.log.gz 2023-07-14T13:33:41.959 INFO:teuthology.orchestra.run.smithi005.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49616.log.gz 2023-07-14T13:33:41.960 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64256.log 2023-07-14T13:33:41.962 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62462.log 2023-07-14T13:33:41.962 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64256.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48999.log.gz 2023-07-14T13:33:41.963 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64256.log.gz 2023-07-14T13:33:41.964 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53512.log 2023-07-14T13:33:41.965 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50112.log 2023-07-14T13:33:41.966 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8%/var/log/ceph/ceph-client.admin.53512.log: -- replaced with /var/log/ceph/ceph-client.admin.62462.log.gz 2023-07-14T13:33:41.967 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53512.log.gz 2023-07-14T13:33:41.968 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58359.log 2023-07-14T13:33:41.970 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52548.log 2023-07-14T13:33:41.971 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50112.log: /var/log/ceph/ceph-client.admin.58359.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50112.log.gz 2023-07-14T13:33:41.971 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58359.log.gz 2023-07-14T13:33:41.972 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51999.log 2023-07-14T13:33:41.974 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50412.log 2023-07-14T13:33:41.974 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52548.log.gz 2023-07-14T13:33:41.977 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51999.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52158.log 2023-07-14T13:33:41.977 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51999.log.gz 2023-07-14T13:33:41.978 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50412.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50412.log.gz 2023-07-14T13:33:41.978 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61690.log 2023-07-14T13:33:41.979 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64398.log 2023-07-14T13:33:41.980 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52158.log.gz 2023-07-14T13:33:41.982 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61690.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49942.log 2023-07-14T13:33:41.982 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61690.log.gz 2023-07-14T13:33:41.983 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64398.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64398.log.gz 2023-07-14T13:33:41.984 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51280.log 2023-07-14T13:33:41.985 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55442.log 2023-07-14T13:33:41.986 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3%/var/log/ceph/ceph-client.admin.51280.log: -- replaced with /var/log/ceph/ceph-client.admin.49942.log.gz 2023-07-14T13:33:41.987 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51280.log.gz 2023-07-14T13:33:41.988 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48244.log 2023-07-14T13:33:41.989 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43610.log 2023-07-14T13:33:41.990 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48244.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55442.log.gz 2023-07-14T13:33:41.991 INFO:teuthology.orchestra.run.smithi154.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-07-14T13:33:41.992 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48244.log.gz 2023-07-14T13:33:41.992 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59549.log 2023-07-14T13:33:41.993 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59032.log 2023-07-14T13:33:41.994 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59549.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43610.log.gz 2023-07-14T13:33:41.995 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59549.log.gz 2023-07-14T13:33:41.996 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47701.log 2023-07-14T13:33:41.998 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51122.log 2023-07-14T13:33:41.999 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47701.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59032.log.gz 2023-07-14T13:33:42.000 INFO:teuthology.orchestra.run.smithi005.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47701.log.gz 2023-07-14T13:33:42.001 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63255.log 2023-07-14T13:33:42.002 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45012.log 2023-07-14T13:33:42.003 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63255.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51122.log.gz 2023-07-14T13:33:42.003 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63255.log.gz 2023-07-14T13:33:42.004 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45829.log 2023-07-14T13:33:42.006 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42555.log 2023-07-14T13:33:42.007 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45829.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45012.log.gz 2023-07-14T13:33:42.007 INFO:teuthology.orchestra.run.smithi005.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45829.log.gz 2023-07-14T13:33:42.008 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56075.log 2023-07-14T13:33:42.010 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44539.log 2023-07-14T13:33:42.011 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56075.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42555.log.gz 2023-07-14T13:33:42.012 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56075.log.gz 2023-07-14T13:33:42.013 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43714.log 2023-07-14T13:33:42.014 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63307.log 2023-07-14T13:33:42.015 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43714.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44539.log.gz 2023-07-14T13:33:42.016 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43714.log.gz 2023-07-14T13:33:42.017 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61794.log 2023-07-14T13:33:42.019 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64450.log 2023-07-14T13:33:42.019 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61794.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63307.log.gz 2023-07-14T13:33:42.020 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61794.log.gz 2023-07-14T13:33:42.021 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63166.log 2023-07-14T13:33:42.022 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58647.log 2023-07-14T13:33:42.023 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63166.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64450.log.gz 2023-07-14T13:33:42.024 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63166.log.gz 2023-07-14T13:33:42.025 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55094.log 2023-07-14T13:33:42.026 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.58647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49644.log 2023-07-14T13:33:42.027 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58647.log.gz 2023-07-14T13:33:42.028 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.0.55094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55094.log.gz 2023-07-14T13:33:42.029 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44244.log 2023-07-14T13:33:42.030 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42572.log 2023-07-14T13:33:42.030 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49644.log.gz 2023-07-14T13:33:42.032 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52385.log 2023-07-14T13:33:42.033 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.42572.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44244.log.gz 2023-07-14T13:33:42.033 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42572.log.gz 2023-07-14T13:33:42.036 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52385.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52385.log.gz 2023-07-14T13:33:42.460 INFO:teuthology.orchestra.run.smithi154.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-07-14T13:33:42.652 INFO:teuthology.orchestra.run.smithi005.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-07-14T13:33:42.657 INFO:teuthology.orchestra.run.smithi154.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-07-14T13:33:42.687 INFO:teuthology.orchestra.run.smithi005.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-07-14T13:33:42.801 INFO:teuthology.orchestra.run.smithi005.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-07-14T13:33:42.814 INFO:teuthology.orchestra.run.smithi154.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-07-14T13:33:42.816 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-07-14T13:33:42.816 INFO:teuthology.orchestra.run.smithi154.stderr:real 0m2.170s 2023-07-14T13:33:42.816 INFO:teuthology.orchestra.run.smithi154.stderr:user 0m9.771s 2023-07-14T13:33:42.817 INFO:teuthology.orchestra.run.smithi154.stderr:sys 0m0.832s 2023-07-14T13:33:43.069 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-07-14T13:33:43.107 INFO:teuthology.orchestra.run.smithi005.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-07-14T13:33:43.668 INFO:teuthology.orchestra.run.smithi005.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-07-14T13:33:43.670 INFO:teuthology.orchestra.run.smithi005.stderr: 2023-07-14T13:33:43.671 INFO:teuthology.orchestra.run.smithi005.stderr:real 0m3.042s 2023-07-14T13:33:43.671 INFO:teuthology.orchestra.run.smithi005.stderr:user 0m12.144s 2023-07-14T13:33:43.671 INFO:teuthology.orchestra.run.smithi005.stderr:sys 0m2.545s 2023-07-14T13:33:43.671 INFO:tasks.ceph:Archiving logs... 2023-07-14T13:33:43.672 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337461/remote/smithi005/log 2023-07-14T13:33:43.673 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-14T13:33:45.306 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337461/remote/smithi154/log 2023-07-14T13:33:45.308 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-14T13:33:46.266 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-07-14T13:33:46.275 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-07-14T13:33:46.275 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-14T13:33:46.279 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-14T13:33:46.377 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-07-14T13:33:46.387 INFO:teuthology.task.clock:Checking final clock skew... 2023-07-14T13:33:46.387 DEBUG:teuthology.orchestra.run.smithi005:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-14T13:33:46.391 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-14T13:33:46.405 INFO:teuthology.orchestra.run.smithi005.stdout: remote refid st t when poll reach delay offset jitter 2023-07-14T13:33:46.405 INFO:teuthology.orchestra.run.smithi005.stdout:============================================================================== 2023-07-14T13:33:46.405 INFO:teuthology.orchestra.run.smithi005.stdout:*hv01.front.sepi 44.4.53.2 2 u 40 128 377 0.071 -1.956 1.072 2023-07-14T13:33:46.405 INFO:teuthology.orchestra.run.smithi005.stdout:+hv02.front.sepi 63.231.80.2 3 u 58 128 377 0.083 -1.592 1.324 2023-07-14T13:33:46.406 INFO:teuthology.orchestra.run.smithi005.stdout:+hv03.front.sepi 74.6.168.72 3 u 58 128 377 0.104 -0.324 0.872 2023-07-14T13:33:46.406 INFO:teuthology.orchestra.run.smithi005.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-07-14T13:33:46.408 INFO:teuthology.orchestra.run.smithi154.stdout: remote refid st t when poll reach delay offset jitter 2023-07-14T13:33:46.409 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================== 2023-07-14T13:33:46.409 INFO:teuthology.orchestra.run.smithi154.stdout:*hv01.front.sepi 44.4.53.2 2 u 33 64 377 0.088 -4.720 1.127 2023-07-14T13:33:46.409 INFO:teuthology.orchestra.run.smithi154.stdout:+hv02.front.sepi 63.231.80.2 3 u 42 64 377 0.085 -1.493 1.945 2023-07-14T13:33:46.409 INFO:teuthology.orchestra.run.smithi154.stdout:+hv03.front.sepi 74.6.168.72 3 u 44 64 377 0.118 -2.659 1.104 2023-07-14T13:33:46.409 INFO:teuthology.orchestra.run.smithi154.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-07-14T13:33:46.410 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-07-14T13:33:46.420 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-07-14T13:33:46.421 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-07-14T13:33:46.445 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-07-14T13:33:46.477 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-07-14T13:33:46.515 INFO:teuthology.task.internal:Duration was 3275.684036 seconds 2023-07-14T13:33:46.516 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-07-14T13:33:46.544 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-07-14T13:33:46.545 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-14T13:33:46.549 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-14T13:33:46.652 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-07-14T13:33:46.652 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi005.front.sepia.ceph.com 2023-07-14T13:33:46.653 DEBUG:teuthology.orchestra.run.smithi005:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-14T13:33:46.676 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2023-07-14T13:33:46.678 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-14T13:33:46.701 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-07-14T13:33:46.702 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-14T13:33:46.725 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-14T13:33:46.783 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-07-14T13:33:46.783 DEBUG:teuthology.orchestra.run.smithi005:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-14T13:33:46.812 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-14T13:33:46.899 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-07-14T13:33:46.909 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-07-14T13:33:46.910 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-14T13:33:46.932 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-14T13:33:46.953 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-07-14T13:33:46.967 DEBUG:teuthology.orchestra.run.smithi005:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-14T13:33:46.977 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-14T13:33:46.992 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = core 2023-07-14T13:33:47.018 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2023-07-14T13:33:47.037 DEBUG:teuthology.orchestra.run.smithi005:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-14T13:33:47.060 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T13:33:47.061 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-14T13:33:47.086 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T13:33:47.086 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-07-14T13:33:47.096 INFO:teuthology.task.internal:Transferring archived files... 2023-07-14T13:33:47.097 DEBUG:teuthology.misc:Transferring archived files from smithi005:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337461/remote/smithi005 2023-07-14T13:33:47.097 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-14T13:33:47.127 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337461/remote/smithi154 2023-07-14T13:33:47.127 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-14T13:33:47.152 INFO:teuthology.task.internal:Removing archive directory... 2023-07-14T13:33:47.152 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-14T13:33:47.168 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-14T13:33:47.208 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-07-14T13:33:47.219 INFO:teuthology.task.internal:Not uploading archives. 2023-07-14T13:33:47.220 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-07-14T13:33:47.245 INFO:teuthology.task.internal:Tidying up after the test... 2023-07-14T13:33:47.246 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-14T13:33:47.249 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-14T13:33:47.255 INFO:teuthology.orchestra.run.smithi005.stdout: 658142 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 14 13:33 /home/ubuntu/cephtest 2023-07-14T13:33:47.263 INFO:teuthology.orchestra.run.smithi154.stdout: 657822 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 14 13:33 /home/ubuntu/cephtest 2023-07-14T13:33:47.264 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-07-14T13:33:47.278 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-07-14T13:33:47.348 INFO:teuthology.nuke:Checking targets against current locks 2023-07-14T13:33:47.378 DEBUG:teuthology.nuke:shortname: smithi005 2023-07-14T13:33:47.378 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T13:33:47.402 DEBUG:teuthology.nuke:shortname: smithi154 2023-07-14T13:33:47.403 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T13:33:47.409 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337461', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 12:13:01.952668', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIO6MUPJGyxhEQGbyPRalUYJJyyKVvFI90MtlRSRJVrh4lI8MN5kZBhRyHOlto2qEY1DLWW6iNyoLvvpOLCrWak='} 2023-07-14T13:33:47.429 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337461', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 12:13:01.950658', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJgfpGvqME+amZ3DxuaEgD4CZDCoPQNjjnrXGmd7lLic'} 2023-07-14T13:33:47.469 INFO:teuthology.orchestra.console:Power off smithi005 2023-07-14T13:33:47.470 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T13:33:47.491 INFO:teuthology.orchestra.console:Power off smithi154 2023-07-14T13:33:47.492 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T13:33:47.505 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T13:33:47.519 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T13:33:51.534 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T13:33:51.546 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T13:33:55.648 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T13:33:55.659 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T13:33:55.871 INFO:teuthology.orchestra.console:Power off for smithi154 completed 2023-07-14T13:33:59.761 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T13:33:59.971 INFO:teuthology.orchestra.console:Power off for smithi005 completed 2023-07-14T13:34:00.076 INFO:teuthology.run:Summary data: client.0-kernel-sha1: a440c79eee0258ae07e4988d8690fe6187b8b7a3 client.1-kernel-sha1: a440c79eee0258ae07e4988d8690fe6187b8b7a3 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} duration: 3275.6840364933014 failure_reason: '"2023-07-14T12:55:02.482844+0000 mon.a (mon.0) 352 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log' flavor: default owner: scheduled_rishabh@teuthology success: false 2023-07-14T13:34:00.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T13:34:00.156 INFO:teuthology.run:FAIL